2024-09-19T05:54:31.360 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-19T05:54:31.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T05:54:31.481 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911712 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/suites/iozone}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7911712' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount dry_run: true install: ceph: flavor: default sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 kclient: client.0: mount_subvol_num: 1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1747 sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 sleep_before_teardown: 0 subset: 176/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi002.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBVObP/IP51VPIZ7fAAxZJkW1tE1TWVUlmZglIUyoJwgeNkmXzWdIYnIurVULMx6v9fDJeoKMkKcUrsXHN67GYo= smithi089.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMJyjGGoAKc8kcseKH9xamRTdllbVQ4+1RUQJElQuk0tW7R769jKiYlxMrTi/mOYWs2q5Ik7zyL35S+39qZMdo4= smithi090.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN/Y4FYVcYZDyi1jffjU6gYaDVEmBHy3sDi01xHo1u00p06vzCVM+hbUPD7CZNocYx6gKMbuDe2vz+cly8HSaSY= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/iozone.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-19T05:54:31.481 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa; will attempt to use it 2024-09-19T05:54:31.482 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks 2024-09-19T05:54:31.482 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-19T05:54:31.483 INFO:teuthology.task.internal:Checking packages... 2024-09-19T05:54:31.505 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2f599a46ad10e37c929e5c43da2f6907ddcd1961' 2024-09-19T05:54:31.505 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T05:54:31.506 INFO:teuthology.packaging:ref: None 2024-09-19T05:54:31.506 INFO:teuthology.packaging:tag: None 2024-09-19T05:54:31.506 INFO:teuthology.packaging:branch: squid 2024-09-19T05:54:31.506 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:54:31.506 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-19T05:54:31.719 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-363.g6fad5dd7 2024-09-19T05:54:31.721 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-19T05:54:31.729 INFO:teuthology.task.internal:no buildpackages task found 2024-09-19T05:54:31.729 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-19T05:54:31.743 INFO:teuthology.task.internal:Saving configuration 2024-09-19T05:54:31.766 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-19T05:54:31.775 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-19T05:54:31.800 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi002.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911712', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 05:48:43.127145', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBVObP/IP51VPIZ7fAAxZJkW1tE1TWVUlmZglIUyoJwgeNkmXzWdIYnIurVULMx6v9fDJeoKMkKcUrsXHN67GYo='} 2024-09-19T05:54:31.824 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911712', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 05:48:43.125327', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMJyjGGoAKc8kcseKH9xamRTdllbVQ4+1RUQJElQuk0tW7R769jKiYlxMrTi/mOYWs2q5Ik7zyL35S+39qZMdo4='} 2024-09-19T05:54:31.847 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi090.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911712', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 05:48:43.129222', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN/Y4FYVcYZDyi1jffjU6gYaDVEmBHy3sDi01xHo1u00p06vzCVM+hbUPD7CZNocYx6gKMbuDe2vz+cly8HSaSY='} 2024-09-19T05:54:31.847 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-19T05:54:31.855 INFO:teuthology.task.internal:roles: ubuntu@smithi002.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-19T05:54:31.855 INFO:teuthology.task.internal:roles: ubuntu@smithi089.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-19T05:54:31.855 INFO:teuthology.task.internal:roles: ubuntu@smithi090.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-19T05:54:31.856 INFO:teuthology.run_tasks:Running task console_log... 2024-09-19T05:54:31.960 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5ddc1b7520>, signals=[15]) 2024-09-19T05:54:31.960 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-19T05:54:32.012 INFO:teuthology.task.internal:Opening connections... 2024-09-19T05:54:32.013 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi002.front.sepia.ceph.com 2024-09-19T05:54:32.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:54:32.104 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi089.front.sepia.ceph.com 2024-09-19T05:54:32.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:54:32.180 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi090.front.sepia.ceph.com 2024-09-19T05:54:32.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:54:32.256 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-19T05:54:32.512 DEBUG:teuthology.orchestra.run.smithi002:> uname -m 2024-09-19T05:54:32.531 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64 2024-09-19T05:54:32.531 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2024-09-19T05:54:32.590 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream" 2024-09-19T05:54:32.590 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="9" 2024-09-19T05:54:32.590 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos" 2024-09-19T05:54:32.590 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora" 2024-09-19T05:54:32.590 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="9" 2024-09-19T05:54:32.591 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el9" 2024-09-19T05:54:32.591 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T05:54:32.591 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31" 2024-09-19T05:54:32.591 INFO:teuthology.orchestra.run.smithi002.stdout:LOGO="fedora-logo-icon" 2024-09-19T05:54:32.591 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T05:54:32.591 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/" 2024-09-19T05:54:32.591 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T05:54:32.591 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T05:54:32.591 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T05:54:32.592 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2024-09-19T05:54:32.615 DEBUG:teuthology.orchestra.run.smithi089:> uname -m 2024-09-19T05:54:32.634 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2024-09-19T05:54:32.634 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2024-09-19T05:54:32.693 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="CentOS Stream" 2024-09-19T05:54:32.693 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="9" 2024-09-19T05:54:32.693 INFO:teuthology.orchestra.run.smithi089.stdout:ID="centos" 2024-09-19T05:54:32.693 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="rhel fedora" 2024-09-19T05:54:32.693 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="9" 2024-09-19T05:54:32.693 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el9" 2024-09-19T05:54:32.694 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T05:54:32.694 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31" 2024-09-19T05:54:32.694 INFO:teuthology.orchestra.run.smithi089.stdout:LOGO="fedora-logo-icon" 2024-09-19T05:54:32.694 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T05:54:32.694 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://centos.org/" 2024-09-19T05:54:32.694 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T05:54:32.694 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T05:54:32.694 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T05:54:32.694 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2024-09-19T05:54:32.715 DEBUG:teuthology.orchestra.run.smithi090:> uname -m 2024-09-19T05:54:32.734 INFO:teuthology.orchestra.run.smithi090.stdout:x86_64 2024-09-19T05:54:32.734 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2024-09-19T05:54:32.792 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream" 2024-09-19T05:54:32.793 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="9" 2024-09-19T05:54:32.793 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos" 2024-09-19T05:54:32.793 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora" 2024-09-19T05:54:32.793 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="9" 2024-09-19T05:54:32.793 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el9" 2024-09-19T05:54:32.793 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T05:54:32.793 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31" 2024-09-19T05:54:32.793 INFO:teuthology.orchestra.run.smithi090.stdout:LOGO="fedora-logo-icon" 2024-09-19T05:54:32.793 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T05:54:32.793 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/" 2024-09-19T05:54:32.793 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T05:54:32.793 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T05:54:32.793 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T05:54:32.794 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2024-09-19T05:54:32.815 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-19T05:54:33.205 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-19T05:54:33.271 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-19T05:54:33.272 DEBUG:teuthology.orchestra.run.smithi002:> test '!' -e /home/ubuntu/cephtest 2024-09-19T05:54:33.275 DEBUG:teuthology.orchestra.run.smithi089:> test '!' -e /home/ubuntu/cephtest 2024-09-19T05:54:33.277 DEBUG:teuthology.orchestra.run.smithi090:> test '!' -e /home/ubuntu/cephtest 2024-09-19T05:54:33.294 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-19T05:54:33.301 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-19T05:54:33.301 DEBUG:teuthology.orchestra.run.smithi002:> test -z $(ls -A /var/lib/ceph) 2024-09-19T05:54:33.334 DEBUG:teuthology.orchestra.run.smithi089:> test -z $(ls -A /var/lib/ceph) 2024-09-19T05:54:33.336 DEBUG:teuthology.orchestra.run.smithi090:> test -z $(ls -A /var/lib/ceph) 2024-09-19T05:54:33.428 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-19T05:54:33.505 INFO:teuthology.run_tasks:Running task kernel... 2024-09-19T05:54:33.526 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-19T05:54:33.526 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-19T05:54:33.526 DEBUG:teuthology.orchestra.run.smithi002:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T05:54:33.527 DEBUG:teuthology.orchestra.run.smithi089:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T05:54:33.528 DEBUG:teuthology.orchestra.run.smithi090:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T05:54:33.546 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:54:33.547 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2024-09-19T05:54:33.549 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:54:33.550 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:54:33.551 DEBUG:teuthology.orchestra.run.smithi090:> uname -r 2024-09-19T05:54:33.551 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2024-09-19T05:54:33.607 INFO:teuthology.orchestra.run.smithi002.stdout:5.14.0-503.el9.x86_64 2024-09-19T05:54:33.607 INFO:teuthology.task.kernel:Running kernel on smithi002: 5.14.0-503.el9.x86_64 2024-09-19T05:54:33.607 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum install -y kernel 2024-09-19T05:54:33.608 INFO:teuthology.orchestra.run.smithi090.stdout:5.14.0-503.el9.x86_64 2024-09-19T05:54:33.608 INFO:teuthology.task.kernel:Running kernel on smithi090: 5.14.0-503.el9.x86_64 2024-09-19T05:54:33.608 DEBUG:teuthology.orchestra.run.smithi090:> sudo yum install -y kernel 2024-09-19T05:54:33.610 INFO:teuthology.orchestra.run.smithi089.stdout:5.14.0-503.el9.x86_64 2024-09-19T05:54:33.610 INFO:teuthology.task.kernel:Running kernel on smithi089: 5.14.0-503.el9.x86_64 2024-09-19T05:54:33.610 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum install -y kernel 2024-09-19T05:54:36.456 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.3 MB 00:00 2024-09-19T05:54:37.201 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 8.3 MB 00:01 2024-09-19T05:54:37.251 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.3 MB 00:01 2024-09-19T05:54:38.432 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-19T05:54:40.169 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - AppStream 11 MB/s | 20 MB 00:01 2024-09-19T05:54:40.394 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - AppStream 9.6 MB/s | 20 MB 00:02 2024-09-19T05:54:43.801 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 6.5 MB 00:01 2024-09-19T05:54:45.260 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - Extras packages 97 kB/s | 19 kB 00:00 2024-09-19T05:54:45.661 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - CRB 4.0 MB/s | 6.5 MB 00:01 2024-09-19T05:54:45.819 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.5 MB 00:01 2024-09-19T05:54:46.316 INFO:teuthology.orchestra.run.smithi090.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-19T05:54:47.253 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 19 kB 00:00 2024-09-19T05:54:47.712 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - Extras packages 28 kB/s | 19 kB 00:00 2024-09-19T05:54:48.224 INFO:teuthology.orchestra.run.smithi002.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-19T05:54:48.741 INFO:teuthology.orchestra.run.smithi089.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-19T05:54:51.697 INFO:teuthology.orchestra.run.smithi090.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-19T05:54:53.637 INFO:teuthology.orchestra.run.smithi090.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T05:54:53.637 INFO:teuthology.orchestra.run.smithi090.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T05:54:53.750 INFO:teuthology.orchestra.run.smithi090.stdout:Dependencies resolved. 2024-09-19T05:54:53.764 INFO:teuthology.orchestra.run.smithi090.stdout:================================================================================ 2024-09-19T05:54:53.764 INFO:teuthology.orchestra.run.smithi090.stdout: Package Architecture Version Repository Size 2024-09-19T05:54:53.764 INFO:teuthology.orchestra.run.smithi090.stdout:================================================================================ 2024-09-19T05:54:53.764 INFO:teuthology.orchestra.run.smithi090.stdout:Installing: 2024-09-19T05:54:53.764 INFO:teuthology.orchestra.run.smithi090.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T05:54:53.764 INFO:teuthology.orchestra.run.smithi090.stdout:Installing dependencies: 2024-09-19T05:54:53.764 INFO:teuthology.orchestra.run.smithi090.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T05:54:53.764 INFO:teuthology.orchestra.run.smithi090.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T05:54:53.764 INFO:teuthology.orchestra.run.smithi090.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T05:54:53.764 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-19T05:54:53.765 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction Summary 2024-09-19T05:54:53.765 INFO:teuthology.orchestra.run.smithi090.stdout:================================================================================ 2024-09-19T05:54:53.765 INFO:teuthology.orchestra.run.smithi090.stdout:Install 4 Packages 2024-09-19T05:54:53.765 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-19T05:54:53.765 INFO:teuthology.orchestra.run.smithi090.stdout:Total download size: 79 M 2024-09-19T05:54:53.765 INFO:teuthology.orchestra.run.smithi090.stdout:Installed size: 126 M 2024-09-19T05:54:53.765 INFO:teuthology.orchestra.run.smithi090.stdout:Downloading Packages: 2024-09-19T05:54:53.863 INFO:teuthology.orchestra.run.smithi002.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2024-09-19T05:54:54.097 INFO:teuthology.orchestra.run.smithi089.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-19T05:54:54.174 INFO:teuthology.orchestra.run.smithi090.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 122 kB/s | 36 kB 00:00 2024-09-19T05:54:55.828 INFO:teuthology.orchestra.run.smithi002.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T05:54:55.828 INFO:teuthology.orchestra.run.smithi002.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T05:54:55.920 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-19T05:54:55.927 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-19T05:54:55.927 INFO:teuthology.orchestra.run.smithi002.stdout: Package Architecture Version Repository Size 2024-09-19T05:54:55.927 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-19T05:54:55.927 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-19T05:54:55.927 INFO:teuthology.orchestra.run.smithi002.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T05:54:55.928 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-19T05:54:55.928 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T05:54:55.928 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T05:54:55.928 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T05:54:55.928 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T05:54:55.928 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-19T05:54:55.928 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-19T05:54:55.928 INFO:teuthology.orchestra.run.smithi002.stdout:Install 4 Packages 2024-09-19T05:54:55.928 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T05:54:55.929 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 79 M 2024-09-19T05:54:55.929 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 126 M 2024-09-19T05:54:55.929 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-19T05:54:55.994 INFO:teuthology.orchestra.run.smithi089.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T05:54:55.995 INFO:teuthology.orchestra.run.smithi089.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T05:54:56.096 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-19T05:54:56.104 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-19T05:54:56.105 INFO:teuthology.orchestra.run.smithi089.stdout: Package Architecture Version Repository Size 2024-09-19T05:54:56.105 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-19T05:54:56.105 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-19T05:54:56.105 INFO:teuthology.orchestra.run.smithi089.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T05:54:56.105 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-09-19T05:54:56.105 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T05:54:56.105 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T05:54:56.105 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T05:54:56.105 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-19T05:54:56.105 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-19T05:54:56.105 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-19T05:54:56.105 INFO:teuthology.orchestra.run.smithi089.stdout:Install 4 Packages 2024-09-19T05:54:56.105 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-19T05:54:56.106 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 79 M 2024-09-19T05:54:56.106 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 126 M 2024-09-19T05:54:56.106 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-19T05:54:56.190 INFO:teuthology.orchestra.run.smithi002.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 249 kB/s | 36 kB 00:00 2024-09-19T05:54:56.273 INFO:teuthology.orchestra.run.smithi089.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 300 kB/s | 36 kB 00:00 2024-09-19T05:54:56.673 INFO:teuthology.orchestra.run.smithi002.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 25 MB/s | 16 MB 00:00 2024-09-19T05:54:57.148 INFO:teuthology.orchestra.run.smithi002.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 31 MB/s | 35 MB 00:01 2024-09-19T05:54:57.407 INFO:teuthology.orchestra.run.smithi002.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 23 MB/s | 29 MB 00:01 2024-09-19T05:54:57.407 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-19T05:54:57.407 INFO:teuthology.orchestra.run.smithi002.stdout:Total 53 MB/s | 79 MB 00:01 2024-09-19T05:54:58.122 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-19T05:54:58.503 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-19T05:54:58.503 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-19T05:54:58.899 INFO:teuthology.orchestra.run.smithi090.stdout:(2/4): kernel-modules-core-5.14.0-508.el9.x86_6 6.0 MB/s | 29 MB 00:04 2024-09-19T05:54:59.497 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-19T05:54:59.497 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-19T05:55:02.035 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-19T05:55:02.719 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T05:55:02.799 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T05:55:03.047 INFO:teuthology.orchestra.run.smithi089.stdout:(2/4): kernel-modules-core-5.14.0-508.el9.x86_6 4.2 MB/s | 29 MB 00:06 2024-09-19T05:55:03.206 INFO:teuthology.orchestra.run.smithi089.stdout:(3/4): kernel-core-5.14.0-508.el9.x86_64.rpm 2.2 MB/s | 16 MB 00:07 2024-09-19T05:55:04.448 INFO:teuthology.orchestra.run.smithi089.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 4.2 MB/s | 35 MB 00:08 2024-09-19T05:55:04.448 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-19T05:55:04.448 INFO:teuthology.orchestra.run.smithi089.stdout:Total 9.4 MB/s | 79 MB 00:08 2024-09-19T05:55:05.126 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-19T05:55:05.475 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-19T05:55:05.475 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-19T05:55:05.555 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T05:55:05.685 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T05:55:06.426 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-19T05:55:06.426 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-19T05:55:08.844 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-19T05:55:09.425 INFO:teuthology.orchestra.run.smithi090.stdout:(3/4): kernel-core-5.14.0-508.el9.x86_64.rpm 1.0 MB/s | 16 MB 00:15 2024-09-19T05:55:09.524 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T05:55:09.615 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T05:55:10.805 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T05:55:10.844 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:55:12.399 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T05:55:12.536 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T05:55:15.986 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:55:17.340 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T05:55:17.445 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:55:22.263 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:55:36.700 INFO:teuthology.orchestra.run.smithi090.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 826 kB/s | 35 MB 00:42 2024-09-19T05:55:36.700 INFO:teuthology.orchestra.run.smithi090.stdout:-------------------------------------------------------------------------------- 2024-09-19T05:55:36.700 INFO:teuthology.orchestra.run.smithi090.stdout:Total 1.8 MB/s | 79 MB 00:42 2024-09-19T05:55:37.377 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction check 2024-09-19T05:55:37.737 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction check succeeded. 2024-09-19T05:55:37.737 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction test 2024-09-19T05:55:38.700 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction test succeeded. 2024-09-19T05:55:38.700 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction 2024-09-19T05:55:41.170 INFO:teuthology.orchestra.run.smithi090.stdout: Preparing : 1/1 2024-09-19T05:55:41.891 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T05:55:41.999 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T05:55:44.792 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T05:55:44.942 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T05:55:49.756 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T05:55:49.811 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:55:54.636 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:55:55.090 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:55:55.131 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:55:55.505 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:55:55.505 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T05:55:55.505 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T05:55:55.505 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T05:55:56.361 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:55:56.361 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T05:55:56.361 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-19T05:55:56.361 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T05:55:56.361 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T05:55:56.361 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T05:55:56.361 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T05:55:56.361 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T05:55:56.362 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-19T05:55:56.711 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T05:55:56.813 INFO:teuthology.orchestra.run.smithi002.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T05:55:56.813 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T05:55:56.813 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T05:55:56.813 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T05:55:56.813 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T05:55:56.813 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-19T05:55:56.814 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi002.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T05:55:56.814 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T05:55:56.871 INFO:teuthology.orchestra.run.smithi002.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T05:55:56.872 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T05:55:56.872 DEBUG:teuthology.orchestra.run.smithi002:> sudo rpm -qi grub2-tools 2024-09-19T05:55:56.903 INFO:teuthology.orchestra.run.smithi002.stdout:Name : grub2-tools 2024-09-19T05:55:56.904 INFO:teuthology.orchestra.run.smithi002.stdout:Epoch : 1 2024-09-19T05:55:56.904 INFO:teuthology.orchestra.run.smithi002.stdout:Version : 2.06 2024-09-19T05:55:56.904 INFO:teuthology.orchestra.run.smithi002.stdout:Release : 82.el9 2024-09-19T05:55:56.904 INFO:teuthology.orchestra.run.smithi002.stdout:Architecture: x86_64 2024-09-19T05:55:56.904 INFO:teuthology.orchestra.run.smithi002.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T05:55:56.904 INFO:teuthology.orchestra.run.smithi002.stdout:Group : Unspecified 2024-09-19T05:55:56.904 INFO:teuthology.orchestra.run.smithi002.stdout:Size : 8274670 2024-09-19T05:55:56.904 INFO:teuthology.orchestra.run.smithi002.stdout:License : GPLv3+ 2024-09-19T05:55:56.904 INFO:teuthology.orchestra.run.smithi002.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T05:55:56.904 INFO:teuthology.orchestra.run.smithi002.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T05:55:56.904 INFO:teuthology.orchestra.run.smithi002.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T05:55:56.904 INFO:teuthology.orchestra.run.smithi002.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T05:55:56.904 INFO:teuthology.orchestra.run.smithi002.stdout:Packager : builder@centos.org 2024-09-19T05:55:56.905 INFO:teuthology.orchestra.run.smithi002.stdout:Vendor : CentOS 2024-09-19T05:55:56.905 INFO:teuthology.orchestra.run.smithi002.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T05:55:56.905 INFO:teuthology.orchestra.run.smithi002.stdout:Summary : Support tools for GRUB. 2024-09-19T05:55:56.905 INFO:teuthology.orchestra.run.smithi002.stdout:Description : 2024-09-19T05:55:56.905 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T05:55:56.905 INFO:teuthology.orchestra.run.smithi002.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T05:55:56.905 INFO:teuthology.orchestra.run.smithi002.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T05:55:56.905 INFO:teuthology.orchestra.run.smithi002.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T05:55:56.905 INFO:teuthology.orchestra.run.smithi002.stdout:hardware devices. 2024-09-19T05:55:56.905 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T05:55:56.905 INFO:teuthology.orchestra.run.smithi002.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T05:55:56.906 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T05:55:56.906 INFO:teuthology.task.kernel:Updating grub on smithi002 to boot 5.14.0-508.el9.x86_64 2024-09-19T05:55:56.906 DEBUG:teuthology.orchestra.run.smithi002:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T05:55:57.584 INFO:teuthology.orchestra.run.smithi002.stderr:Generating grub configuration file ... 2024-09-19T05:55:58.868 INFO:teuthology.orchestra.run.smithi002.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T05:55:58.910 INFO:teuthology.orchestra.run.smithi002.stderr:done 2024-09-19T05:55:58.912 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2024-09-19T05:55:58.927 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.Ue5ideCkvD 2024-09-19T05:55:58.927 DEBUG:teuthology.orchestra.run.smithi002:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Ue5ideCkvD 2024-09-19T05:55:58.999 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.Ue5ideCkvD 2024-09-19T05:55:59.143 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.Ue5ideCkvD is 6KB 2024-09-19T05:55:59.192 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.Ue5ideCkvD 2024-09-19T05:55:59.206 DEBUG:teuthology.orchestra.run.smithi002:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T05:55:59.270 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T05:55:59.271 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T05:55:59.271 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T05:55:59.271 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T05:55:59.273 DEBUG:teuthology.orchestra.run.smithi002:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T05:55:59.435 DEBUG:teuthology.orchestra.run.smithi002:> sudo shutdown -r now 2024-09-19T05:56:00.386 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:56:00.427 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:56:00.818 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:56:00.818 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T05:56:00.818 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T05:56:00.818 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T05:56:01.664 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:56:01.664 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-19T05:56:01.665 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-19T05:56:01.665 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T05:56:01.665 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T05:56:01.665 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T05:56:01.665 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T05:56:01.665 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-19T05:56:01.665 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-19T05:56:02.011 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T05:56:02.096 INFO:teuthology.orchestra.run.smithi089.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T05:56:02.097 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T05:56:02.097 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T05:56:02.097 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T05:56:02.098 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T05:56:02.098 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-19T05:56:02.098 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi089.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T05:56:02.098 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T05:56:02.157 INFO:teuthology.orchestra.run.smithi089.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T05:56:02.157 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T05:56:02.157 DEBUG:teuthology.orchestra.run.smithi089:> sudo rpm -qi grub2-tools 2024-09-19T05:56:02.189 INFO:teuthology.orchestra.run.smithi089.stdout:Name : grub2-tools 2024-09-19T05:56:02.189 INFO:teuthology.orchestra.run.smithi089.stdout:Epoch : 1 2024-09-19T05:56:02.189 INFO:teuthology.orchestra.run.smithi089.stdout:Version : 2.06 2024-09-19T05:56:02.189 INFO:teuthology.orchestra.run.smithi089.stdout:Release : 82.el9 2024-09-19T05:56:02.189 INFO:teuthology.orchestra.run.smithi089.stdout:Architecture: x86_64 2024-09-19T05:56:02.189 INFO:teuthology.orchestra.run.smithi089.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T05:56:02.190 INFO:teuthology.orchestra.run.smithi089.stdout:Group : Unspecified 2024-09-19T05:56:02.190 INFO:teuthology.orchestra.run.smithi089.stdout:Size : 8274670 2024-09-19T05:56:02.190 INFO:teuthology.orchestra.run.smithi089.stdout:License : GPLv3+ 2024-09-19T05:56:02.190 INFO:teuthology.orchestra.run.smithi089.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T05:56:02.190 INFO:teuthology.orchestra.run.smithi089.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T05:56:02.190 INFO:teuthology.orchestra.run.smithi089.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T05:56:02.190 INFO:teuthology.orchestra.run.smithi089.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T05:56:02.190 INFO:teuthology.orchestra.run.smithi089.stdout:Packager : builder@centos.org 2024-09-19T05:56:02.190 INFO:teuthology.orchestra.run.smithi089.stdout:Vendor : CentOS 2024-09-19T05:56:02.190 INFO:teuthology.orchestra.run.smithi089.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T05:56:02.190 INFO:teuthology.orchestra.run.smithi089.stdout:Summary : Support tools for GRUB. 2024-09-19T05:56:02.190 INFO:teuthology.orchestra.run.smithi089.stdout:Description : 2024-09-19T05:56:02.190 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-19T05:56:02.191 INFO:teuthology.orchestra.run.smithi089.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T05:56:02.191 INFO:teuthology.orchestra.run.smithi089.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T05:56:02.191 INFO:teuthology.orchestra.run.smithi089.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T05:56:02.191 INFO:teuthology.orchestra.run.smithi089.stdout:hardware devices. 2024-09-19T05:56:02.191 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-19T05:56:02.191 INFO:teuthology.orchestra.run.smithi089.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T05:56:02.192 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T05:56:02.192 INFO:teuthology.task.kernel:Updating grub on smithi089 to boot 5.14.0-508.el9.x86_64 2024-09-19T05:56:02.192 DEBUG:teuthology.orchestra.run.smithi089:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T05:56:02.836 INFO:teuthology.orchestra.run.smithi089.stderr:Generating grub configuration file ... 2024-09-19T05:56:04.128 INFO:teuthology.orchestra.run.smithi089.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T05:56:04.160 INFO:teuthology.orchestra.run.smithi089.stderr:done 2024-09-19T05:56:04.163 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2024-09-19T05:56:04.181 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.k0tW6jRCQi 2024-09-19T05:56:04.181 DEBUG:teuthology.orchestra.run.smithi089:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.k0tW6jRCQi 2024-09-19T05:56:04.252 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.k0tW6jRCQi 2024-09-19T05:56:04.389 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.k0tW6jRCQi is 6KB 2024-09-19T05:56:04.438 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.k0tW6jRCQi 2024-09-19T05:56:04.453 DEBUG:teuthology.orchestra.run.smithi089:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T05:56:04.529 INFO:teuthology.orchestra.run.smithi089.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T05:56:04.529 INFO:teuthology.orchestra.run.smithi089.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T05:56:04.529 INFO:teuthology.orchestra.run.smithi089.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T05:56:04.529 INFO:teuthology.orchestra.run.smithi089.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T05:56:04.531 DEBUG:teuthology.orchestra.run.smithi089:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T05:56:04.704 DEBUG:teuthology.orchestra.run.smithi089:> sudo shutdown -r now 2024-09-19T05:56:29.437 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-19T05:56:29.438 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-19T05:56:29.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:56:34.287 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:56:34.326 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:56:34.707 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-19T05:56:34.708 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-19T05:56:34.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:56:34.797 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:56:34.797 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T05:56:34.797 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T05:56:34.797 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T05:56:35.770 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:56:35.770 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-19T05:56:35.770 INFO:teuthology.orchestra.run.smithi090.stdout:Installed: 2024-09-19T05:56:35.770 INFO:teuthology.orchestra.run.smithi090.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T05:56:35.770 INFO:teuthology.orchestra.run.smithi090.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T05:56:35.770 INFO:teuthology.orchestra.run.smithi090.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T05:56:35.770 INFO:teuthology.orchestra.run.smithi090.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T05:56:35.770 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-19T05:56:35.770 INFO:teuthology.orchestra.run.smithi090.stdout:Complete! 2024-09-19T05:56:36.162 DEBUG:teuthology.orchestra.run.smithi090:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T05:56:36.271 INFO:teuthology.orchestra.run.smithi090.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T05:56:36.271 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T05:56:36.271 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T05:56:36.271 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T05:56:36.271 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T05:56:36.271 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2024-09-19T05:56:36.271 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi090.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T05:56:36.272 DEBUG:teuthology.orchestra.run.smithi090:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T05:56:36.330 INFO:teuthology.orchestra.run.smithi090.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T05:56:36.331 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T05:56:36.331 DEBUG:teuthology.orchestra.run.smithi090:> sudo rpm -qi grub2-tools 2024-09-19T05:56:36.362 INFO:teuthology.orchestra.run.smithi090.stdout:Name : grub2-tools 2024-09-19T05:56:36.362 INFO:teuthology.orchestra.run.smithi090.stdout:Epoch : 1 2024-09-19T05:56:36.362 INFO:teuthology.orchestra.run.smithi090.stdout:Version : 2.06 2024-09-19T05:56:36.362 INFO:teuthology.orchestra.run.smithi090.stdout:Release : 82.el9 2024-09-19T05:56:36.362 INFO:teuthology.orchestra.run.smithi090.stdout:Architecture: x86_64 2024-09-19T05:56:36.362 INFO:teuthology.orchestra.run.smithi090.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T05:56:36.362 INFO:teuthology.orchestra.run.smithi090.stdout:Group : Unspecified 2024-09-19T05:56:36.362 INFO:teuthology.orchestra.run.smithi090.stdout:Size : 8274670 2024-09-19T05:56:36.362 INFO:teuthology.orchestra.run.smithi090.stdout:License : GPLv3+ 2024-09-19T05:56:36.363 INFO:teuthology.orchestra.run.smithi090.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T05:56:36.363 INFO:teuthology.orchestra.run.smithi090.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T05:56:36.363 INFO:teuthology.orchestra.run.smithi090.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T05:56:36.363 INFO:teuthology.orchestra.run.smithi090.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T05:56:36.363 INFO:teuthology.orchestra.run.smithi090.stdout:Packager : builder@centos.org 2024-09-19T05:56:36.363 INFO:teuthology.orchestra.run.smithi090.stdout:Vendor : CentOS 2024-09-19T05:56:36.363 INFO:teuthology.orchestra.run.smithi090.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T05:56:36.363 INFO:teuthology.orchestra.run.smithi090.stdout:Summary : Support tools for GRUB. 2024-09-19T05:56:36.363 INFO:teuthology.orchestra.run.smithi090.stdout:Description : 2024-09-19T05:56:36.363 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-19T05:56:36.363 INFO:teuthology.orchestra.run.smithi090.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T05:56:36.364 INFO:teuthology.orchestra.run.smithi090.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T05:56:36.364 INFO:teuthology.orchestra.run.smithi090.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T05:56:36.364 INFO:teuthology.orchestra.run.smithi090.stdout:hardware devices. 2024-09-19T05:56:36.364 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-19T05:56:36.364 INFO:teuthology.orchestra.run.smithi090.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T05:56:36.365 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T05:56:36.365 INFO:teuthology.task.kernel:Updating grub on smithi090 to boot 5.14.0-508.el9.x86_64 2024-09-19T05:56:36.365 DEBUG:teuthology.orchestra.run.smithi090:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T05:56:36.994 INFO:teuthology.orchestra.run.smithi090.stderr:Generating grub configuration file ... 2024-09-19T05:56:38.843 INFO:teuthology.orchestra.run.smithi090.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T05:56:38.865 INFO:teuthology.orchestra.run.smithi090.stderr:done 2024-09-19T05:56:38.867 DEBUG:teuthology.orchestra.run.smithi090:> mktemp 2024-09-19T05:56:38.895 INFO:teuthology.orchestra.run.smithi090.stdout:/tmp/tmp.jOdv5KxPut 2024-09-19T05:56:38.895 DEBUG:teuthology.orchestra.run.smithi090:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.jOdv5KxPut 2024-09-19T05:56:38.971 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 0666 /tmp/tmp.jOdv5KxPut 2024-09-19T05:56:39.115 DEBUG:teuthology.orchestra.remote:smithi090:/tmp/tmp.jOdv5KxPut is 6KB 2024-09-19T05:56:39.163 DEBUG:teuthology.orchestra.run.smithi090:> rm -fr /tmp/tmp.jOdv5KxPut 2024-09-19T05:56:39.178 DEBUG:teuthology.orchestra.run.smithi090:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T05:56:39.249 INFO:teuthology.orchestra.run.smithi090.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T05:56:39.249 INFO:teuthology.orchestra.run.smithi090.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T05:56:39.249 INFO:teuthology.orchestra.run.smithi090.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T05:56:39.249 INFO:teuthology.orchestra.run.smithi090.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T05:56:39.251 DEBUG:teuthology.orchestra.run.smithi090:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T05:56:39.405 DEBUG:teuthology.orchestra.run.smithi090:> sudo shutdown -r now 2024-09-19T05:56:47.805 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.2 2024-09-19T05:56:53.181 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-09-19T05:56:56.807 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-19T05:56:56.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:57:02.186 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-19T05:57:02.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:57:05.245 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-09-19T05:57:09.412 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-09-19T05:57:09.412 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-09-19T05:57:09.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:57:15.197 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.2 2024-09-19T05:57:17.247 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-19T05:57:17.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:57:20.317 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-09-19T05:57:27.205 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-19T05:57:27.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:57:27.741 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-09-19T05:57:30.269 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.2 2024-09-19T05:57:35.321 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-19T05:57:35.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:57:36.742 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-09-19T05:57:36.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:57:38.401 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-09-19T05:57:39.805 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-09-19T05:57:45.273 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-19T05:57:45.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:57:45.586 DEBUG:teuthology.orchestra.run.smithi002:> true 2024-09-19T05:57:45.948 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-19T05:57:45.948 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-19T05:57:45.948 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2024-09-19T05:57:45.965 INFO:teuthology.orchestra.run.smithi002.stdout:5.14.0-508.el9.x86_64 2024-09-19T05:57:45.965 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T05:57:45.965 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T05:57:45.965 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T05:57:46.967 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-19T05:57:46.967 DEBUG:teuthology.orchestra.run.smithi002:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T05:57:47.041 INFO:teuthology.orchestra.run.smithi002.stdout:ttyS1 2024-09-19T05:57:47.065 DEBUG:teuthology.parallel:result is None 2024-09-19T05:57:51.806 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-09-19T05:57:51.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:57:54.880 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-09-19T05:57:56.402 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-19T05:57:56.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:57:56.931 DEBUG:teuthology.orchestra.run.smithi089:> true 2024-09-19T05:57:57.290 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-19T05:57:57.290 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-508.el9.x86_64"... 2024-09-19T05:57:57.291 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2024-09-19T05:57:57.306 INFO:teuthology.orchestra.run.smithi089.stdout:5.14.0-508.el9.x86_64 2024-09-19T05:57:57.307 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T05:57:57.307 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T05:57:57.307 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T05:57:58.308 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-19T05:57:58.308 DEBUG:teuthology.orchestra.run.smithi089:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T05:57:58.370 INFO:teuthology.orchestra.run.smithi089.stdout:ttyS1 2024-09-19T05:57:58.392 DEBUG:teuthology.parallel:result is None 2024-09-19T05:58:09.881 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-09-19T05:58:09.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:58:28.413 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-09-19T05:58:46.414 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-09-19T05:58:46.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:58:46.822 DEBUG:teuthology.orchestra.run.smithi090:> true 2024-09-19T05:58:47.245 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-09-19T05:58:47.245 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-508.el9.x86_64"... 2024-09-19T05:58:47.245 DEBUG:teuthology.orchestra.run.smithi090:> uname -r 2024-09-19T05:58:47.259 INFO:teuthology.orchestra.run.smithi090.stdout:5.14.0-508.el9.x86_64 2024-09-19T05:58:47.260 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T05:58:47.260 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T05:58:47.260 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T05:58:48.261 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-09-19T05:58:48.261 DEBUG:teuthology.orchestra.run.smithi090:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T05:58:48.363 INFO:teuthology.orchestra.run.smithi090.stdout:ttyS1 2024-09-19T05:58:48.384 DEBUG:teuthology.parallel:result is None 2024-09-19T05:58:48.385 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-19T05:58:48.393 INFO:teuthology.task.internal:Creating test directory... 2024-09-19T05:58:48.393 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T05:58:48.396 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T05:58:48.399 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T05:58:48.415 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-19T05:58:48.491 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-19T05:58:48.501 INFO:teuthology.task.internal:Creating archive directory... 2024-09-19T05:58:48.501 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T05:58:48.503 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T05:58:48.506 DEBUG:teuthology.orchestra.run.smithi090:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T05:58:48.536 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-19T05:58:48.542 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-19T05:58:48.542 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T05:58:48.573 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T05:58:48.576 DEBUG:teuthology.orchestra.run.smithi090:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T05:58:48.604 INFO:teuthology.orchestra.run.smithi090.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:58:48.609 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:58:48.613 INFO:teuthology.orchestra.run.smithi090.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:58:48.615 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:58:48.621 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:58:48.627 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:58:48.629 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-19T05:58:48.636 INFO:teuthology.task.internal:Configuring sudo... 2024-09-19T05:58:48.636 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T05:58:48.665 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T05:58:48.672 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T05:58:48.699 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-19T05:58:48.708 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-19T05:58:48.708 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T05:58:48.734 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T05:58:48.742 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T05:58:48.757 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T05:58:48.833 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T05:58:48.884 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T05:58:48.963 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T05:58:49.010 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-19T05:58:49.010 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T05:58:49.077 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T05:58:49.122 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T05:58:49.176 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T05:58:49.260 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T05:58:49.304 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-19T05:58:49.304 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T05:58:49.371 DEBUG:teuthology.orchestra.run.smithi090:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T05:58:49.416 DEBUG:teuthology.orchestra.run.smithi090:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T05:58:49.478 DEBUG:teuthology.orchestra.run.smithi090:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T05:58:49.548 DEBUG:teuthology.orchestra.run.smithi090:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T05:58:49.632 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-19T05:58:49.632 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T05:58:49.694 DEBUG:teuthology.orchestra.run.smithi002:> sudo service rsyslog restart 2024-09-19T05:58:49.697 DEBUG:teuthology.orchestra.run.smithi089:> sudo service rsyslog restart 2024-09-19T05:58:49.699 DEBUG:teuthology.orchestra.run.smithi090:> sudo service rsyslog restart 2024-09-19T05:58:49.739 INFO:teuthology.orchestra.run.smithi089.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T05:58:49.745 INFO:teuthology.orchestra.run.smithi002.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T05:58:49.815 INFO:teuthology.orchestra.run.smithi090.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T05:58:50.247 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-19T05:58:50.255 INFO:teuthology.task.internal:Starting timer... 2024-09-19T05:58:50.255 INFO:teuthology.run_tasks:Running task pcp... 2024-09-19T05:58:50.275 INFO:teuthology.run_tasks:Running task selinux... 2024-09-19T05:58:50.284 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-19T05:58:50.284 DEBUG:teuthology.orchestra.run.smithi002:> sudo service auditd rotate 2024-09-19T05:58:50.336 INFO:teuthology.orchestra.run.smithi002.stdout:Rotating logs: 2024-09-19T05:58:50.338 DEBUG:teuthology.orchestra.run.smithi089:> sudo service auditd rotate 2024-09-19T05:58:50.397 INFO:teuthology.orchestra.run.smithi089.stdout:Rotating logs: 2024-09-19T05:58:50.399 DEBUG:teuthology.orchestra.run.smithi090:> sudo service auditd rotate 2024-09-19T05:58:50.586 INFO:teuthology.orchestra.run.smithi090.stdout:Rotating logs: 2024-09-19T05:58:50.588 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-19T05:58:50.588 DEBUG:teuthology.orchestra.run.smithi002:> /usr/sbin/getenforce 2024-09-19T05:58:50.617 INFO:teuthology.orchestra.run.smithi002.stdout:Permissive 2024-09-19T05:58:50.617 DEBUG:teuthology.orchestra.run.smithi089:> /usr/sbin/getenforce 2024-09-19T05:58:50.643 INFO:teuthology.orchestra.run.smithi089.stdout:Permissive 2024-09-19T05:58:50.644 DEBUG:teuthology.orchestra.run.smithi090:> /usr/sbin/getenforce 2024-09-19T05:58:50.675 INFO:teuthology.orchestra.run.smithi090.stdout:Permissive 2024-09-19T05:58:50.675 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi002.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi089.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi090.front.sepia.ceph.com': 'permissive'} 2024-09-19T05:58:50.675 DEBUG:teuthology.orchestra.run.smithi002:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T05:58:50.705 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:58:50.705 DEBUG:teuthology.orchestra.run.smithi089:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T05:58:50.734 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:58:50.735 DEBUG:teuthology.orchestra.run.smithi090:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T05:58:50.760 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:58:50.760 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-19T05:58:50.760 DEBUG:teuthology.orchestra.run.smithi002:> sudo /usr/sbin/setenforce permissive 2024-09-19T05:58:50.789 DEBUG:teuthology.orchestra.run.smithi089:> sudo /usr/sbin/setenforce permissive 2024-09-19T05:58:50.825 DEBUG:teuthology.orchestra.run.smithi090:> sudo /usr/sbin/setenforce permissive 2024-09-19T05:58:51.047 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-19T05:58:51.065 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-19T05:58:51.076 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-19T05:58:51.077 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi002.front.sepia.ceph.com,smithi089.front.sepia.ceph.com,smithi090.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-19T06:02:38.629 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi002.front.sepia.ceph.com'), Remote(name='ubuntu@smithi089.front.sepia.ceph.com'), Remote(name='ubuntu@smithi090.front.sepia.ceph.com')] 2024-09-19T06:02:38.630 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-19T06:02:38.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:02:38.709 DEBUG:teuthology.orchestra.run.smithi002:> true 2024-09-19T06:02:38.799 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-19T06:02:38.800 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-19T06:02:38.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:02:38.876 DEBUG:teuthology.orchestra.run.smithi089:> true 2024-09-19T06:02:38.958 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-19T06:02:38.958 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-09-19T06:02:38.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:02:39.034 DEBUG:teuthology.orchestra.run.smithi090:> true 2024-09-19T06:02:39.119 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-09-19T06:02:39.119 INFO:teuthology.run_tasks:Running task clock... 2024-09-19T06:02:39.301 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-19T06:02:39.302 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T06:02:39.302 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T06:02:39.305 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T06:02:39.305 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T06:02:39.308 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T06:02:39.308 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T06:02:39.338 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T06:02:39.339 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T06:02:39.341 INFO:teuthology.orchestra.run.smithi090.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T06:02:39.355 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T06:02:39.355 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T06:02:39.357 INFO:teuthology.orchestra.run.smithi090.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T06:02:39.381 INFO:teuthology.orchestra.run.smithi089.stderr:sudo: ntpd: command not found 2024-09-19T06:02:39.382 INFO:teuthology.orchestra.run.smithi002.stderr:sudo: ntpd: command not found 2024-09-19T06:02:39.385 INFO:teuthology.orchestra.run.smithi090.stderr:sudo: ntpd: command not found 2024-09-19T06:02:39.393 INFO:teuthology.orchestra.run.smithi089.stdout:506 Cannot talk to daemon 2024-09-19T06:02:39.395 INFO:teuthology.orchestra.run.smithi002.stdout:506 Cannot talk to daemon 2024-09-19T06:02:39.397 INFO:teuthology.orchestra.run.smithi090.stdout:506 Cannot talk to daemon 2024-09-19T06:02:39.408 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T06:02:39.411 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T06:02:39.412 INFO:teuthology.orchestra.run.smithi090.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T06:02:39.423 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T06:02:39.426 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T06:02:39.426 INFO:teuthology.orchestra.run.smithi090.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T06:02:39.488 INFO:teuthology.orchestra.run.smithi089.stderr:bash: line 1: ntpq: command not found 2024-09-19T06:02:39.489 INFO:teuthology.orchestra.run.smithi090.stderr:bash: line 1: ntpq: command not found 2024-09-19T06:02:39.489 INFO:teuthology.orchestra.run.smithi002.stderr:bash: line 1: ntpq: command not found 2024-09-19T06:02:39.491 INFO:teuthology.orchestra.run.smithi089.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T06:02:39.491 INFO:teuthology.orchestra.run.smithi089.stdout:=============================================================================== 2024-09-19T06:02:39.491 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:02:39.491 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:02:39.492 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:02:39.492 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:02:39.492 INFO:teuthology.orchestra.run.smithi090.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T06:02:39.492 INFO:teuthology.orchestra.run.smithi090.stdout:=============================================================================== 2024-09-19T06:02:39.492 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:02:39.492 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:02:39.492 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:02:39.493 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:02:39.494 INFO:teuthology.orchestra.run.smithi002.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T06:02:39.494 INFO:teuthology.orchestra.run.smithi002.stdout:=============================================================================== 2024-09-19T06:02:39.495 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:02:39.495 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:02:39.495 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:02:39.495 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:02:39.495 INFO:teuthology.run_tasks:Running task install... 2024-09-19T06:02:39.503 DEBUG:teuthology.task.install:project ceph 2024-09-19T06:02:39.503 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}} 2024-09-19T06:02:39.503 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'} 2024-09-19T06:02:39.503 INFO:teuthology.task.install:Using flavor: default 2024-09-19T06:02:39.509 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-19T06:02:39.509 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-19T06:02:39.509 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T06:02:39.510 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:02:39.512 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T06:02:39.512 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:02:39.513 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T06:02:39.513 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:02:39.652 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T06:02:39.652 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T06:02:39.664 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T06:02:39.664 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T06:02:39.677 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T06:02:39.677 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T06:02:39.764 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T06:02:39.764 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-19T06:02:39.764 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T06:02:39.775 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T06:02:39.775 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-19T06:02:39.775 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T06:02:39.785 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T06:02:39.785 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-19T06:02:39.785 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T06:02:39.791 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T06:02:39.791 DEBUG:teuthology.orchestra.run.smithi002:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T06:02:39.801 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T06:02:39.802 DEBUG:teuthology.orchestra.run.smithi090:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T06:02:39.810 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T06:02:39.811 DEBUG:teuthology.orchestra.run.smithi089:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T06:02:39.858 DEBUG:teuthology.orchestra.run.smithi002:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T06:02:39.867 DEBUG:teuthology.orchestra.run.smithi090:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T06:02:39.876 DEBUG:teuthology.orchestra.run.smithi089:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T06:02:39.935 DEBUG:teuthology.orchestra.run.smithi002:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T06:02:39.942 DEBUG:teuthology.orchestra.run.smithi090:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T06:02:39.951 DEBUG:teuthology.orchestra.run.smithi089:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T06:02:40.000 INFO:teuthology.orchestra.run.smithi002.stdout:check_obsoletes = 1 2024-09-19T06:02:40.002 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum clean all 2024-09-19T06:02:40.006 INFO:teuthology.orchestra.run.smithi090.stdout:check_obsoletes = 1 2024-09-19T06:02:40.007 DEBUG:teuthology.orchestra.run.smithi090:> sudo yum clean all 2024-09-19T06:02:40.015 INFO:teuthology.orchestra.run.smithi089.stdout:check_obsoletes = 1 2024-09-19T06:02:40.016 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum clean all 2024-09-19T06:02:40.242 INFO:teuthology.orchestra.run.smithi090.stdout:45 files removed 2024-09-19T06:02:40.246 INFO:teuthology.orchestra.run.smithi002.stdout:45 files removed 2024-09-19T06:02:40.253 INFO:teuthology.orchestra.run.smithi089.stdout:45 files removed 2024-09-19T06:02:40.269 DEBUG:teuthology.orchestra.run.smithi090:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T06:02:40.274 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T06:02:40.279 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T06:02:40.834 INFO:teuthology.orchestra.run.smithi090.stdout:ceph packages for x86_64 298 kB/s | 84 kB 00:00 2024-09-19T06:02:40.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph packages for x86_64 310 kB/s | 84 kB 00:00 2024-09-19T06:02:40.845 INFO:teuthology.orchestra.run.smithi089.stdout:ceph packages for x86_64 297 kB/s | 84 kB 00:00 2024-09-19T06:02:41.126 INFO:teuthology.orchestra.run.smithi090.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-19T06:02:41.129 INFO:teuthology.orchestra.run.smithi089.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-19T06:02:41.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-19T06:02:41.385 INFO:teuthology.orchestra.run.smithi090.stdout:ceph source packages 8.6 kB/s | 1.9 kB 00:00 2024-09-19T06:02:41.404 INFO:teuthology.orchestra.run.smithi089.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-19T06:02:41.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-19T06:02:42.287 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - BaseOS 9.8 MB/s | 8.3 MB 00:00 2024-09-19T06:02:42.755 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - BaseOS 6.3 MB/s | 8.3 MB 00:01 2024-09-19T06:02:44.105 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - AppStream 29 MB/s | 20 MB 00:00 2024-09-19T06:02:44.406 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - AppStream 35 MB/s | 20 MB 00:00 2024-09-19T06:02:48.706 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-19T06:02:49.086 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - BaseOS 1.1 MB/s | 8.3 MB 00:07 2024-09-19T06:02:50.440 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 19 kB 00:00 2024-09-19T06:02:50.899 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - CRB 2.5 MB/s | 6.5 MB 00:02 2024-09-19T06:02:51.277 INFO:teuthology.orchestra.run.smithi002.stdout:Extra Packages for Enterprise Linux 32 MB/s | 23 MB 00:00 2024-09-19T06:02:52.633 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - Extras packages 50 kB/s | 19 kB 00:00 2024-09-19T06:02:53.620 INFO:teuthology.orchestra.run.smithi089.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-19T06:02:56.992 INFO:teuthology.orchestra.run.smithi002.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-19T06:02:57.781 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - AppStream 2.7 MB/s | 20 MB 00:07 2024-09-19T06:02:59.027 INFO:teuthology.orchestra.run.smithi089.stdout:lab-extras 39 kB/s | 1.7 kB 00:00 2024-09-19T06:02:59.289 INFO:teuthology.orchestra.run.smithi002.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T06:02:59.289 INFO:teuthology.orchestra.run.smithi002.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T06:02:59.304 INFO:teuthology.orchestra.run.smithi002.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T06:02:59.305 INFO:teuthology.orchestra.run.smithi002.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T06:02:59.306 INFO:teuthology.orchestra.run.smithi002.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T06:02:59.307 INFO:teuthology.orchestra.run.smithi002.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T06:02:59.309 INFO:teuthology.orchestra.run.smithi002.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T06:02:59.312 INFO:teuthology.orchestra.run.smithi002.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T06:02:59.313 INFO:teuthology.orchestra.run.smithi002.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T06:02:59.380 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-19T06:02:59.406 INFO:teuthology.orchestra.run.smithi002.stdout:====================================================================================== 2024-09-19T06:02:59.406 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-19T06:02:59.406 INFO:teuthology.orchestra.run.smithi002.stdout:====================================================================================== 2024-09-19T06:02:59.406 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-19T06:02:59.406 INFO:teuthology.orchestra.run.smithi002.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T06:02:59.407 INFO:teuthology.orchestra.run.smithi002.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T06:02:59.407 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T06:02:59.407 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T06:02:59.407 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T06:02:59.407 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T06:02:59.407 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T06:02:59.407 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T06:02:59.407 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T06:02:59.407 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T06:02:59.407 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T06:02:59.407 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T06:02:59.408 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T06:02:59.408 INFO:teuthology.orchestra.run.smithi002.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T06:02:59.408 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T06:02:59.408 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T06:02:59.408 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T06:02:59.408 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T06:02:59.408 INFO:teuthology.orchestra.run.smithi002.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T06:02:59.408 INFO:teuthology.orchestra.run.smithi002.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T06:02:59.408 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T06:02:59.408 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T06:02:59.408 INFO:teuthology.orchestra.run.smithi002.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T06:02:59.408 INFO:teuthology.orchestra.run.smithi002.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T06:02:59.408 INFO:teuthology.orchestra.run.smithi002.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T06:02:59.409 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T06:02:59.413 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T06:02:59.413 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T06:02:59.413 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T06:02:59.413 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T06:02:59.413 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T06:02:59.413 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T06:02:59.413 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T06:02:59.413 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T06:02:59.413 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T06:02:59.414 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T06:02:59.414 INFO:teuthology.orchestra.run.smithi002.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T06:02:59.414 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrading: 2024-09-19T06:02:59.414 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T06:02:59.414 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T06:02:59.414 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T06:02:59.414 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T06:02:59.414 INFO:teuthology.orchestra.run.smithi002.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T06:02:59.414 INFO:teuthology.orchestra.run.smithi002.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T06:02:59.414 INFO:teuthology.orchestra.run.smithi002.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T06:02:59.415 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T06:02:59.415 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-19T06:02:59.415 INFO:teuthology.orchestra.run.smithi002.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T06:02:59.415 INFO:teuthology.orchestra.run.smithi002.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T06:02:59.415 INFO:teuthology.orchestra.run.smithi002.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T06:02:59.415 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T06:02:59.415 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T06:02:59.416 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T06:02:59.416 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T06:02:59.416 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T06:02:59.416 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T06:02:59.416 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T06:02:59.416 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T06:02:59.416 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T06:02:59.416 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T06:02:59.416 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T06:02:59.416 INFO:teuthology.orchestra.run.smithi002.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T06:02:59.416 INFO:teuthology.orchestra.run.smithi002.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T06:02:59.417 INFO:teuthology.orchestra.run.smithi002.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T06:02:59.417 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T06:02:59.417 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T06:02:59.417 INFO:teuthology.orchestra.run.smithi002.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T06:02:59.417 INFO:teuthology.orchestra.run.smithi002.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T06:02:59.417 INFO:teuthology.orchestra.run.smithi002.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T06:02:59.417 INFO:teuthology.orchestra.run.smithi002.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T06:02:59.417 INFO:teuthology.orchestra.run.smithi002.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T06:02:59.417 INFO:teuthology.orchestra.run.smithi002.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T06:02:59.417 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T06:02:59.417 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T06:02:59.418 INFO:teuthology.orchestra.run.smithi002.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T06:02:59.418 INFO:teuthology.orchestra.run.smithi002.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T06:02:59.418 INFO:teuthology.orchestra.run.smithi002.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T06:02:59.418 INFO:teuthology.orchestra.run.smithi002.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T06:02:59.418 INFO:teuthology.orchestra.run.smithi002.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T06:02:59.418 INFO:teuthology.orchestra.run.smithi002.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T06:02:59.418 INFO:teuthology.orchestra.run.smithi002.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T06:02:59.418 INFO:teuthology.orchestra.run.smithi002.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T06:02:59.418 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T06:02:59.418 INFO:teuthology.orchestra.run.smithi002.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T06:02:59.419 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T06:02:59.419 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T06:02:59.419 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T06:02:59.419 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T06:02:59.419 INFO:teuthology.orchestra.run.smithi002.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T06:02:59.419 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T06:02:59.419 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T06:02:59.419 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T06:02:59.419 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T06:02:59.419 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T06:02:59.419 INFO:teuthology.orchestra.run.smithi002.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T06:02:59.419 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T06:02:59.420 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T06:02:59.420 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T06:02:59.420 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T06:02:59.420 INFO:teuthology.orchestra.run.smithi002.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T06:02:59.420 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T06:02:59.420 INFO:teuthology.orchestra.run.smithi002.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T06:02:59.420 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T06:02:59.420 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T06:02:59.420 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T06:02:59.420 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T06:02:59.421 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T06:02:59.421 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T06:02:59.421 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T06:02:59.421 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T06:02:59.421 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T06:02:59.421 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T06:02:59.421 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T06:02:59.421 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T06:02:59.421 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T06:02:59.421 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T06:02:59.422 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T06:02:59.422 INFO:teuthology.orchestra.run.smithi002.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T06:02:59.422 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T06:02:59.422 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T06:02:59.422 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T06:02:59.422 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T06:02:59.422 INFO:teuthology.orchestra.run.smithi002.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T06:02:59.422 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T06:02:59.422 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T06:02:59.422 INFO:teuthology.orchestra.run.smithi002.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T06:02:59.422 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T06:02:59.423 INFO:teuthology.orchestra.run.smithi002.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T06:02:59.423 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T06:02:59.423 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T06:02:59.423 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T06:02:59.423 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T06:02:59.423 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T06:02:59.423 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T06:02:59.423 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T06:02:59.423 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T06:02:59.423 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T06:02:59.423 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T06:02:59.424 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T06:02:59.424 INFO:teuthology.orchestra.run.smithi002.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T06:02:59.424 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T06:02:59.424 INFO:teuthology.orchestra.run.smithi002.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T06:02:59.424 INFO:teuthology.orchestra.run.smithi002.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T06:02:59.424 INFO:teuthology.orchestra.run.smithi002.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T06:02:59.424 INFO:teuthology.orchestra.run.smithi002.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T06:02:59.424 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T06:02:59.424 INFO:teuthology.orchestra.run.smithi002.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T06:02:59.424 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T06:02:59.424 INFO:teuthology.orchestra.run.smithi002.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T06:02:59.425 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T06:02:59.425 INFO:teuthology.orchestra.run.smithi002.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T06:02:59.425 INFO:teuthology.orchestra.run.smithi002.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T06:02:59.425 INFO:teuthology.orchestra.run.smithi002.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T06:02:59.425 INFO:teuthology.orchestra.run.smithi002.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T06:02:59.425 INFO:teuthology.orchestra.run.smithi002.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T06:02:59.425 INFO:teuthology.orchestra.run.smithi002.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T06:02:59.425 INFO:teuthology.orchestra.run.smithi002.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T06:02:59.425 INFO:teuthology.orchestra.run.smithi002.stdout:Installing weak dependencies: 2024-09-19T06:02:59.425 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T06:02:59.425 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:02:59.426 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-19T06:02:59.426 INFO:teuthology.orchestra.run.smithi002.stdout:====================================================================================== 2024-09-19T06:02:59.426 INFO:teuthology.orchestra.run.smithi002.stdout:Install 148 Packages 2024-09-19T06:02:59.426 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrade 8 Packages 2024-09-19T06:02:59.426 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:02:59.426 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 226 M 2024-09-19T06:02:59.427 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-19T06:02:59.776 INFO:teuthology.orchestra.run.smithi002.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 50 kB/s | 6.6 kB 00:00 2024-09-19T06:03:00.259 INFO:teuthology.orchestra.run.smithi002.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 1.8 MB/s | 896 kB 00:00 2024-09-19T06:03:00.377 INFO:teuthology.orchestra.run.smithi002.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.2 MB/s | 145 kB 00:00 2024-09-19T06:03:00.985 INFO:teuthology.orchestra.run.smithi002.stdout:(4/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 3.9 MB/s | 2.4 MB 00:00 2024-09-19T06:03:01.144 INFO:teuthology.orchestra.run.smithi002.stdout:(5/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 3.6 MB/s | 5.4 MB 00:01 2024-09-19T06:03:01.195 INFO:teuthology.orchestra.run.smithi089.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T06:03:01.195 INFO:teuthology.orchestra.run.smithi089.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T06:03:01.202 INFO:teuthology.orchestra.run.smithi002.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 7.0 MB/s | 1.5 MB 00:00 2024-09-19T06:03:01.206 INFO:teuthology.orchestra.run.smithi089.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T06:03:01.207 INFO:teuthology.orchestra.run.smithi089.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T06:03:01.208 INFO:teuthology.orchestra.run.smithi089.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T06:03:01.209 INFO:teuthology.orchestra.run.smithi089.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T06:03:01.210 INFO:teuthology.orchestra.run.smithi089.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T06:03:01.212 INFO:teuthology.orchestra.run.smithi089.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T06:03:01.213 INFO:teuthology.orchestra.run.smithi089.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T06:03:01.274 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-19T06:03:01.300 INFO:teuthology.orchestra.run.smithi089.stdout:====================================================================================== 2024-09-19T06:03:01.300 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-09-19T06:03:01.300 INFO:teuthology.orchestra.run.smithi089.stdout:====================================================================================== 2024-09-19T06:03:01.300 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-19T06:03:01.300 INFO:teuthology.orchestra.run.smithi089.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T06:03:01.300 INFO:teuthology.orchestra.run.smithi089.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T06:03:01.300 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T06:03:01.300 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T06:03:01.301 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T06:03:01.301 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T06:03:01.301 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T06:03:01.301 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T06:03:01.301 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T06:03:01.301 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T06:03:01.301 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T06:03:01.301 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T06:03:01.301 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T06:03:01.301 INFO:teuthology.orchestra.run.smithi089.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T06:03:01.301 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T06:03:01.302 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T06:03:01.302 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T06:03:01.302 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T06:03:01.302 INFO:teuthology.orchestra.run.smithi089.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T06:03:01.302 INFO:teuthology.orchestra.run.smithi089.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T06:03:01.302 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T06:03:01.302 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T06:03:01.302 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T06:03:01.302 INFO:teuthology.orchestra.run.smithi089.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T06:03:01.302 INFO:teuthology.orchestra.run.smithi089.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T06:03:01.302 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T06:03:01.302 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T06:03:01.302 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T06:03:01.303 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T06:03:01.303 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T06:03:01.303 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T06:03:01.303 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T06:03:01.303 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T06:03:01.303 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T06:03:01.303 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T06:03:01.303 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T06:03:01.303 INFO:teuthology.orchestra.run.smithi089.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T06:03:01.303 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrading: 2024-09-19T06:03:01.303 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T06:03:01.304 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T06:03:01.304 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T06:03:01.304 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T06:03:01.304 INFO:teuthology.orchestra.run.smithi089.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T06:03:01.304 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T06:03:01.304 INFO:teuthology.orchestra.run.smithi089.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T06:03:01.304 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T06:03:01.304 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-09-19T06:03:01.304 INFO:teuthology.orchestra.run.smithi089.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T06:03:01.304 INFO:teuthology.orchestra.run.smithi089.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T06:03:01.304 INFO:teuthology.orchestra.run.smithi089.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T06:03:01.305 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T06:03:01.305 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T06:03:01.305 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T06:03:01.305 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T06:03:01.305 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T06:03:01.305 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T06:03:01.305 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T06:03:01.305 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T06:03:01.305 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T06:03:01.305 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T06:03:01.305 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T06:03:01.306 INFO:teuthology.orchestra.run.smithi089.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T06:03:01.306 INFO:teuthology.orchestra.run.smithi089.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T06:03:01.306 INFO:teuthology.orchestra.run.smithi089.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T06:03:01.306 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T06:03:01.306 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T06:03:01.306 INFO:teuthology.orchestra.run.smithi089.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T06:03:01.306 INFO:teuthology.orchestra.run.smithi089.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T06:03:01.307 INFO:teuthology.orchestra.run.smithi089.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T06:03:01.307 INFO:teuthology.orchestra.run.smithi089.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T06:03:01.307 INFO:teuthology.orchestra.run.smithi089.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T06:03:01.307 INFO:teuthology.orchestra.run.smithi089.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T06:03:01.307 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T06:03:01.307 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T06:03:01.307 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T06:03:01.307 INFO:teuthology.orchestra.run.smithi089.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T06:03:01.307 INFO:teuthology.orchestra.run.smithi089.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T06:03:01.307 INFO:teuthology.orchestra.run.smithi089.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T06:03:01.308 INFO:teuthology.orchestra.run.smithi089.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T06:03:01.308 INFO:teuthology.orchestra.run.smithi089.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T06:03:01.308 INFO:teuthology.orchestra.run.smithi089.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T06:03:01.308 INFO:teuthology.orchestra.run.smithi089.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T06:03:01.308 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T06:03:01.308 INFO:teuthology.orchestra.run.smithi089.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T06:03:01.308 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T06:03:01.308 INFO:teuthology.orchestra.run.smithi089.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T06:03:01.308 INFO:teuthology.orchestra.run.smithi089.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T06:03:01.308 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T06:03:01.308 INFO:teuthology.orchestra.run.smithi089.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T06:03:01.308 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T06:03:01.308 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T06:03:01.309 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T06:03:01.309 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T06:03:01.309 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T06:03:01.309 INFO:teuthology.orchestra.run.smithi089.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T06:03:01.312 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T06:03:01.313 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T06:03:01.313 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T06:03:01.313 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T06:03:01.313 INFO:teuthology.orchestra.run.smithi089.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T06:03:01.313 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T06:03:01.313 INFO:teuthology.orchestra.run.smithi089.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T06:03:01.313 INFO:teuthology.orchestra.run.smithi089.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T06:03:01.314 INFO:teuthology.orchestra.run.smithi089.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T06:03:01.314 INFO:teuthology.orchestra.run.smithi089.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T06:03:01.314 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T06:03:01.314 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T06:03:01.314 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T06:03:01.314 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T06:03:01.314 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T06:03:01.314 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T06:03:01.314 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T06:03:01.314 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T06:03:01.314 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T06:03:01.315 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T06:03:01.315 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T06:03:01.315 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T06:03:01.315 INFO:teuthology.orchestra.run.smithi089.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T06:03:01.315 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T06:03:01.315 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T06:03:01.315 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T06:03:01.315 INFO:teuthology.orchestra.run.smithi089.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T06:03:01.315 INFO:teuthology.orchestra.run.smithi089.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T06:03:01.315 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T06:03:01.315 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T06:03:01.315 INFO:teuthology.orchestra.run.smithi089.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T06:03:01.315 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T06:03:01.316 INFO:teuthology.orchestra.run.smithi089.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T06:03:01.316 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T06:03:01.316 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T06:03:01.316 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T06:03:01.316 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T06:03:01.316 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T06:03:01.316 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T06:03:01.316 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T06:03:01.317 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T06:03:01.317 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T06:03:01.317 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T06:03:01.317 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T06:03:01.317 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T06:03:01.317 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T06:03:01.317 INFO:teuthology.orchestra.run.smithi089.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T06:03:01.317 INFO:teuthology.orchestra.run.smithi089.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T06:03:01.317 INFO:teuthology.orchestra.run.smithi089.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T06:03:01.317 INFO:teuthology.orchestra.run.smithi089.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T06:03:01.317 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T06:03:01.317 INFO:teuthology.orchestra.run.smithi089.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T06:03:01.317 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T06:03:01.318 INFO:teuthology.orchestra.run.smithi089.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T06:03:01.318 INFO:teuthology.orchestra.run.smithi089.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T06:03:01.318 INFO:teuthology.orchestra.run.smithi089.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T06:03:01.318 INFO:teuthology.orchestra.run.smithi089.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T06:03:01.318 INFO:teuthology.orchestra.run.smithi089.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T06:03:01.318 INFO:teuthology.orchestra.run.smithi089.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T06:03:01.318 INFO:teuthology.orchestra.run.smithi089.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T06:03:01.318 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T06:03:01.318 INFO:teuthology.orchestra.run.smithi089.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T06:03:01.318 INFO:teuthology.orchestra.run.smithi089.stdout:Installing weak dependencies: 2024-09-19T06:03:01.318 INFO:teuthology.orchestra.run.smithi089.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T06:03:01.318 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-19T06:03:01.319 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-19T06:03:01.319 INFO:teuthology.orchestra.run.smithi089.stdout:====================================================================================== 2024-09-19T06:03:01.319 INFO:teuthology.orchestra.run.smithi089.stdout:Install 148 Packages 2024-09-19T06:03:01.319 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrade 8 Packages 2024-09-19T06:03:01.319 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-19T06:03:01.320 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 226 M 2024-09-19T06:03:01.320 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-19T06:03:01.495 INFO:teuthology.orchestra.run.smithi002.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 13 MB/s | 4.7 MB 00:00 2024-09-19T06:03:02.007 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-19T06:03:02.020 INFO:teuthology.orchestra.run.smithi002.stdout:(8/156): ceph-radosgw-19.1.1-361.g2f599a46.el9. 20 MB/s | 11 MB 00:00 2024-09-19T06:03:02.212 INFO:teuthology.orchestra.run.smithi002.stdout:(9/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86_ 17 MB/s | 17 MB 00:01 2024-09-19T06:03:02.229 INFO:teuthology.orchestra.run.smithi002.stdout:(10/156): ceph-selinux-19.1.1-361.g2f599a46.el9 121 kB/s | 25 kB 00:00 2024-09-19T06:03:02.236 INFO:teuthology.orchestra.run.smithi089.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 49 kB/s | 6.6 kB 00:00 2024-09-19T06:03:02.281 INFO:teuthology.orchestra.run.smithi002.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 4.5 MB/s | 228 kB 00:00 2024-09-19T06:03:02.329 INFO:teuthology.orchestra.run.smithi002.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 543 kB/s | 27 kB 00:00 2024-09-19T06:03:02.379 INFO:teuthology.orchestra.run.smithi002.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 634 kB/s | 32 kB 00:00 2024-09-19T06:03:02.463 INFO:teuthology.orchestra.run.smithi002.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 8.8 MB/s | 751 kB 00:00 2024-09-19T06:03:02.530 INFO:teuthology.orchestra.run.smithi002.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.4 MB/s | 163 kB 00:00 2024-09-19T06:03:02.587 INFO:teuthology.orchestra.run.smithi089.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 2.5 MB/s | 896 kB 00:00 2024-09-19T06:03:02.597 INFO:teuthology.orchestra.run.smithi002.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 1.9 MB/s | 127 kB 00:00 2024-09-19T06:03:02.637 INFO:teuthology.orchestra.run.smithi089.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 2.8 MB/s | 145 kB 00:00 2024-09-19T06:03:02.681 INFO:teuthology.orchestra.run.smithi002.stdout:(17/156): libradosstriper1-19.1.1-361.g2f599a46 5.9 MB/s | 506 kB 00:00 2024-09-19T06:03:03.114 INFO:teuthology.orchestra.run.smithi002.stdout:(18/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 12 MB/s | 5.3 MB 00:00 2024-09-19T06:03:03.156 INFO:teuthology.orchestra.run.smithi002.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 1.1 MB/s | 45 kB 00:00 2024-09-19T06:03:03.248 INFO:teuthology.orchestra.run.smithi002.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 1.5 MB/s | 136 kB 00:00 2024-09-19T06:03:03.340 INFO:teuthology.orchestra.run.smithi002.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 1.7 MB/s | 161 kB 00:00 2024-09-19T06:03:03.405 INFO:teuthology.orchestra.run.smithi089.stdout:(4/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 3.1 MB/s | 2.4 MB 00:00 2024-09-19T06:03:03.416 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - Extras packages 107 kB/s | 19 kB 00:00 2024-09-19T06:03:03.432 INFO:teuthology.orchestra.run.smithi002.stdout:(22/156): python3-rados-19.1.1-361.g2f599a46.el 3.4 MB/s | 320 kB 00:00 2024-09-19T06:03:03.526 INFO:teuthology.orchestra.run.smithi002.stdout:(23/156): python3-rbd-19.1.1-361.g2f599a46.el9. 3.1 MB/s | 300 kB 00:00 2024-09-19T06:03:03.638 INFO:teuthology.orchestra.run.smithi089.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 6.5 MB/s | 1.5 MB 00:00 2024-09-19T06:03:03.714 INFO:teuthology.orchestra.run.smithi089.stdout:(6/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 3.4 MB/s | 5.4 MB 00:01 2024-09-19T06:03:03.960 INFO:teuthology.orchestra.run.smithi002.stdout:(24/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 28 MB/s | 49 MB 00:01 2024-09-19T06:03:03.985 INFO:teuthology.orchestra.run.smithi002.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 217 kB/s | 99 kB 00:00 2024-09-19T06:03:04.018 INFO:teuthology.orchestra.run.smithi002.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.4 MB/s | 85 kB 00:00 2024-09-19T06:03:04.055 INFO:teuthology.orchestra.run.smithi089.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 11 MB/s | 4.7 MB 00:00 2024-09-19T06:03:04.069 INFO:teuthology.orchestra.run.smithi002.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 3.3 MB/s | 171 kB 00:00 2024-09-19T06:03:04.153 INFO:teuthology.orchestra.run.smithi002.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 382 kB/s | 32 kB 00:00 2024-09-19T06:03:04.211 INFO:teuthology.orchestra.run.smithi002.stdout:(29/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 14 MB/s | 3.1 MB 00:00 2024-09-19T06:03:04.236 INFO:teuthology.orchestra.run.smithi002.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 1.7 MB/s | 146 kB 00:00 2024-09-19T06:03:04.487 INFO:teuthology.orchestra.run.smithi002.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 13 MB/s | 3.6 MB 00:00 2024-09-19T06:03:04.488 INFO:teuthology.orchestra.run.smithi090.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-19T06:03:04.497 INFO:teuthology.orchestra.run.smithi089.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 8.9 MB/s | 21 MB 00:02 2024-09-19T06:03:04.545 INFO:teuthology.orchestra.run.smithi002.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 4.2 MB/s | 249 kB 00:00 2024-09-19T06:03:04.547 INFO:teuthology.orchestra.run.smithi089.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 505 kB/s | 25 kB 00:00 2024-09-19T06:03:04.671 INFO:teuthology.orchestra.run.smithi002.stdout:(33/156): ceph-mgr-diskprediction-local-19.1.1- 17 MB/s | 7.4 MB 00:00 2024-09-19T06:03:04.687 INFO:teuthology.orchestra.run.smithi002.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 348 kB/s | 49 kB 00:00 2024-09-19T06:03:04.732 INFO:teuthology.orchestra.run.smithi002.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 282 kB/s | 16 kB 00:00 2024-09-19T06:03:04.755 INFO:teuthology.orchestra.run.smithi002.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 4.1 MB/s | 285 kB 00:00 2024-09-19T06:03:04.813 INFO:teuthology.orchestra.run.smithi002.stdout:(37/156): cephadm-19.1.1-361.g2f599a46.el9.noar 8.9 MB/s | 765 kB 00:00 2024-09-19T06:03:04.855 INFO:teuthology.orchestra.run.smithi002.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 182 kB/s | 18 kB 00:00 2024-09-19T06:03:05.106 INFO:teuthology.orchestra.run.smithi089.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 10 MB/s | 11 MB 00:01 2024-09-19T06:03:05.289 INFO:teuthology.orchestra.run.smithi089.stdout:(11/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 11 MB/s | 17 MB 00:01 2024-09-19T06:03:05.297 INFO:teuthology.orchestra.run.smithi002.stdout:(39/156): ceph-common-19.1.1-361.g2f599a46.el9. 3.8 MB/s | 21 MB 00:05 2024-09-19T06:03:05.323 INFO:teuthology.orchestra.run.smithi089.stdout:(12/156): cephfs-mirror-19.1.1-361.g2f599a46.el 1.0 MB/s | 228 kB 00:00 2024-09-19T06:03:05.331 INFO:teuthology.orchestra.run.smithi002.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 154 kB/s | 80 kB 00:00 2024-09-19T06:03:05.348 INFO:teuthology.orchestra.run.smithi089.stdout:(13/156): cephfs-shell-19.1.1-361.g2f599a46.el9 462 kB/s | 27 kB 00:00 2024-09-19T06:03:05.374 INFO:teuthology.orchestra.run.smithi089.stdout:(14/156): libcephfs-devel-19.1.1-361.g2f599a46. 629 kB/s | 32 kB 00:00 2024-09-19T06:03:05.424 INFO:teuthology.orchestra.run.smithi089.stdout:(15/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 9.7 MB/s | 751 kB 00:00 2024-09-19T06:03:05.449 INFO:teuthology.orchestra.run.smithi089.stdout:(16/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.1 MB/s | 163 kB 00:00 2024-09-19T06:03:05.491 INFO:teuthology.orchestra.run.smithi089.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 1.9 MB/s | 127 kB 00:00 2024-09-19T06:03:05.525 INFO:teuthology.orchestra.run.smithi089.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 6.6 MB/s | 506 kB 00:00 2024-09-19T06:03:05.592 INFO:teuthology.orchestra.run.smithi089.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 678 kB/s | 45 kB 00:00 2024-09-19T06:03:05.676 INFO:teuthology.orchestra.run.smithi089.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 1.6 MB/s | 136 kB 00:00 2024-09-19T06:03:05.759 INFO:teuthology.orchestra.run.smithi089.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 1.9 MB/s | 161 kB 00:00 2024-09-19T06:03:05.789 INFO:teuthology.orchestra.run.smithi002.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 553 kB/s | 253 kB 00:00 2024-09-19T06:03:05.815 INFO:teuthology.orchestra.run.smithi002.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 836 kB/s | 801 kB 00:00 2024-09-19T06:03:05.840 INFO:teuthology.orchestra.run.smithi002.stdout:(43/156): libquadmath-11.5.0-2.el9.x86_64.rpm 352 kB/s | 191 kB 00:00 2024-09-19T06:03:05.843 INFO:teuthology.orchestra.run.smithi089.stdout:(22/156): python3-rados-19.1.1-361.g2f599a46.el 3.7 MB/s | 320 kB 00:00 2024-09-19T06:03:05.924 INFO:teuthology.orchestra.run.smithi002.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 981 kB/s | 106 kB 00:00 2024-09-19T06:03:05.927 INFO:teuthology.orchestra.run.smithi089.stdout:(23/156): python3-rbd-19.1.1-361.g2f599a46.el9. 3.5 MB/s | 300 kB 00:00 2024-09-19T06:03:06.041 INFO:teuthology.orchestra.run.smithi002.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-09-19T06:03:06.044 INFO:teuthology.orchestra.run.smithi089.stdout:(24/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 9.7 MB/s | 5.3 MB 00:00 2024-09-19T06:03:06.066 INFO:teuthology.orchestra.run.smithi002.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 599 kB/s | 135 kB 00:00 2024-09-19T06:03:06.069 INFO:teuthology.orchestra.run.smithi089.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 700 kB/s | 99 kB 00:00 2024-09-19T06:03:06.094 INFO:teuthology.orchestra.run.smithi089.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-19T06:03:06.145 INFO:teuthology.orchestra.run.smithi089.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 3.3 MB/s | 171 kB 00:00 2024-09-19T06:03:06.158 INFO:teuthology.orchestra.run.smithi002.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-09-19T06:03:06.200 INFO:teuthology.orchestra.run.smithi002.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 3.0 MB/s | 1.2 MB 00:00 2024-09-19T06:03:06.212 INFO:teuthology.orchestra.run.smithi089.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 478 kB/s | 32 kB 00:00 2024-09-19T06:03:06.333 INFO:teuthology.orchestra.run.smithi002.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 802 kB/s | 107 kB 00:00 2024-09-19T06:03:06.369 INFO:teuthology.orchestra.run.smithi002.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 2.2 MB/s | 689 kB 00:00 2024-09-19T06:03:06.392 INFO:teuthology.orchestra.run.smithi002.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 368 kB/s | 22 kB 00:00 2024-09-19T06:03:06.442 INFO:teuthology.orchestra.run.smithi002.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 655 kB/s | 33 kB 00:00 2024-09-19T06:03:06.485 INFO:teuthology.orchestra.run.smithi002.stdout:(53/156): bison-3.7.4-5.el9.x86_64.rpm 2.8 MB/s | 943 kB 00:00 2024-09-19T06:03:06.518 INFO:teuthology.orchestra.run.smithi002.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.0 MB/s | 313 kB 00:00 2024-09-19T06:03:06.544 INFO:teuthology.orchestra.run.smithi002.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 311 kB/s | 18 kB 00:00 2024-09-19T06:03:06.569 INFO:teuthology.orchestra.run.smithi002.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-19T06:03:06.594 INFO:teuthology.orchestra.run.smithi002.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-19T06:03:06.619 INFO:teuthology.orchestra.run.smithi002.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 902 kB/s | 45 kB 00:00 2024-09-19T06:03:06.687 INFO:teuthology.orchestra.run.smithi089.stdout:(29/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 23 MB/s | 49 MB 00:02 2024-09-19T06:03:06.712 INFO:teuthology.orchestra.run.smithi089.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 292 kB/s | 146 kB 00:00 2024-09-19T06:03:06.736 INFO:teuthology.orchestra.run.smithi002.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 4.6 MB/s | 662 kB 00:00 2024-09-19T06:03:06.761 INFO:teuthology.orchestra.run.smithi002.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 4.0 MB/s | 581 kB 00:00 2024-09-19T06:03:06.771 INFO:teuthology.orchestra.run.smithi089.stdout:(31/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 4.4 MB/s | 3.1 MB 00:00 2024-09-19T06:03:06.778 INFO:teuthology.orchestra.run.smithi002.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 583 kB/s | 24 kB 00:00 2024-09-19T06:03:06.804 INFO:teuthology.orchestra.run.smithi002.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-19T06:03:06.862 INFO:teuthology.orchestra.run.smithi002.stdout:(63/156): lua-5.4.4-4.el9.x86_64.rpm 3.2 MB/s | 188 kB 00:00 2024-09-19T06:03:06.863 INFO:teuthology.orchestra.run.smithi089.stdout:(32/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 20 MB/s | 3.6 MB 00:00 2024-09-19T06:03:06.888 INFO:teuthology.orchestra.run.smithi089.stdout:(33/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.1 MB/s | 249 kB 00:00 2024-09-19T06:03:06.896 INFO:teuthology.orchestra.run.smithi002.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-19T06:03:06.913 INFO:teuthology.orchestra.run.smithi002.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 768 kB/s | 38 kB 00:00 2024-09-19T06:03:06.914 INFO:teuthology.orchestra.run.smithi089.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 986 kB/s | 49 kB 00:00 2024-09-19T06:03:06.939 INFO:teuthology.orchestra.run.smithi089.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 327 kB/s | 16 kB 00:00 2024-09-19T06:03:06.973 INFO:teuthology.orchestra.run.smithi089.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 4.8 MB/s | 285 kB 00:00 2024-09-19T06:03:07.013 INFO:teuthology.orchestra.run.smithi002.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.2 MB/s | 3.0 MB 00:00 2024-09-19T06:03:07.023 INFO:teuthology.orchestra.run.smithi089.stdout:(37/156): cephadm-19.1.1-361.g2f599a46.el9.noar 9.0 MB/s | 765 kB 00:00 2024-09-19T06:03:07.040 INFO:teuthology.orchestra.run.smithi089.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 273 kB/s | 18 kB 00:00 2024-09-19T06:03:07.141 INFO:teuthology.orchestra.run.smithi089.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 682 kB/s | 80 kB 00:00 2024-09-19T06:03:07.233 INFO:teuthology.orchestra.run.smithi089.stdout:(40/156): ceph-mgr-diskprediction-local-19.1.1- 14 MB/s | 7.4 MB 00:00 2024-09-19T06:03:07.258 INFO:teuthology.orchestra.run.smithi089.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.6 MB/s | 191 kB 00:00 2024-09-19T06:03:07.297 INFO:teuthology.orchestra.run.smithi002.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 5.6 MB/s | 1.6 MB 00:00 2024-09-19T06:03:07.308 INFO:teuthology.orchestra.run.smithi089.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.9 MB/s | 801 kB 00:00 2024-09-19T06:03:07.350 INFO:teuthology.orchestra.run.smithi089.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 13 MB/s | 1.2 MB 00:00 2024-09-19T06:03:07.375 INFO:teuthology.orchestra.run.smithi089.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-19T06:03:07.401 INFO:teuthology.orchestra.run.smithi089.stdout:(45/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.5 MB/s | 253 kB 00:00 2024-09-19T06:03:07.426 INFO:teuthology.orchestra.run.smithi089.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 1.7 MB/s | 135 kB 00:00 2024-09-19T06:03:07.451 INFO:teuthology.orchestra.run.smithi089.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-09-19T06:03:07.477 INFO:teuthology.orchestra.run.smithi089.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-19T06:03:07.652 INFO:teuthology.orchestra.run.smithi089.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 611 kB/s | 107 kB 00:00 2024-09-19T06:03:07.664 INFO:teuthology.orchestra.run.smithi002.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 2.4 MB/s | 910 kB 00:00 2024-09-19T06:03:07.711 INFO:teuthology.orchestra.run.smithi089.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 2.4 MB/s | 689 kB 00:00 2024-09-19T06:03:07.722 INFO:teuthology.orchestra.run.smithi002.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-19T06:03:07.736 INFO:teuthology.orchestra.run.smithi089.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 259 kB/s | 22 kB 00:00 2024-09-19T06:03:07.778 INFO:teuthology.orchestra.run.smithi089.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 2.8 MB/s | 943 kB 00:00 2024-09-19T06:03:07.789 INFO:teuthology.orchestra.run.smithi002.stdout:(70/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 5.1 MB/s | 4.4 MB 00:00 2024-09-19T06:03:07.803 INFO:teuthology.orchestra.run.smithi089.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 488 kB/s | 33 kB 00:00 2024-09-19T06:03:07.829 INFO:teuthology.orchestra.run.smithi089.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-19T06:03:07.854 INFO:teuthology.orchestra.run.smithi089.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 361 kB/s | 18 kB 00:00 2024-09-19T06:03:07.879 INFO:teuthology.orchestra.run.smithi089.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 221 kB/s | 11 kB 00:00 2024-09-19T06:03:07.929 INFO:teuthology.orchestra.run.smithi089.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 906 kB/s | 45 kB 00:00 2024-09-19T06:03:07.939 INFO:teuthology.orchestra.run.smithi002.stdout:(71/156): openblas-openmp-0.3.26-2.el9.x86_64.r 4.7 MB/s | 4.9 MB 00:01 2024-09-19T06:03:07.954 INFO:teuthology.orchestra.run.smithi089.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 160 kB 00:00 2024-09-19T06:03:07.990 INFO:teuthology.orchestra.run.smithi002.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-09-19T06:03:08.013 INFO:teuthology.orchestra.run.smithi089.stdout:(59/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-09-19T06:03:08.047 INFO:teuthology.orchestra.run.smithi089.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-09-19T06:03:08.048 INFO:teuthology.orchestra.run.smithi002.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 3.9 MB/s | 1.0 MB 00:00 2024-09-19T06:03:08.072 INFO:teuthology.orchestra.run.smithi089.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 417 kB/s | 24 kB 00:00 2024-09-19T06:03:08.098 INFO:teuthology.orchestra.run.smithi002.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-19T06:03:08.106 INFO:teuthology.orchestra.run.smithi089.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 3.8 MB/s | 581 kB 00:00 2024-09-19T06:03:08.131 INFO:teuthology.orchestra.run.smithi089.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 566 kB/s | 47 kB 00:00 2024-09-19T06:03:08.165 INFO:teuthology.orchestra.run.smithi089.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-09-19T06:03:08.182 INFO:teuthology.orchestra.run.smithi002.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-19T06:03:08.182 INFO:teuthology.orchestra.run.smithi089.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 760 kB/s | 38 kB 00:00 2024-09-19T06:03:08.207 INFO:teuthology.orchestra.run.smithi089.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-09-19T06:03:08.274 INFO:teuthology.orchestra.run.smithi002.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.6 MB/s | 248 kB 00:00 2024-09-19T06:03:08.316 INFO:teuthology.orchestra.run.smithi002.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 617 kB/s | 26 kB 00:00 2024-09-19T06:03:08.324 INFO:teuthology.orchestra.run.smithi089.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-19T06:03:08.358 INFO:teuthology.orchestra.run.smithi002.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 462 kB/s | 19 kB 00:00 2024-09-19T06:03:08.417 INFO:teuthology.orchestra.run.smithi089.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 20 MB/s | 4.9 MB 00:00 2024-09-19T06:03:08.417 INFO:teuthology.orchestra.run.smithi002.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-19T06:03:08.458 INFO:teuthology.orchestra.run.smithi089.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 6.7 MB/s | 910 kB 00:00 2024-09-19T06:03:08.467 INFO:teuthology.orchestra.run.smithi002.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 698 kB/s | 35 kB 00:00 2024-09-19T06:03:08.492 INFO:teuthology.orchestra.run.smithi089.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.8 MB/s | 137 kB 00:00 2024-09-19T06:03:08.559 INFO:teuthology.orchestra.run.smithi089.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-19T06:03:08.609 INFO:teuthology.orchestra.run.smithi089.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 8.6 MB/s | 1.0 MB 00:00 2024-09-19T06:03:08.635 INFO:teuthology.orchestra.run.smithi089.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 87 kB 00:00 2024-09-19T06:03:08.685 INFO:teuthology.orchestra.run.smithi089.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-19T06:03:08.794 INFO:teuthology.orchestra.run.smithi089.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 17 MB/s | 5.8 MB 00:00 2024-09-19T06:03:08.821 INFO:teuthology.orchestra.run.smithi089.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.8 MB/s | 245 kB 00:00 2024-09-19T06:03:08.853 INFO:teuthology.orchestra.run.smithi089.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-09-19T06:03:08.878 INFO:teuthology.orchestra.run.smithi089.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 436 kB/s | 26 kB 00:00 2024-09-19T06:03:08.953 INFO:teuthology.orchestra.run.smithi089.stdout:(79/156): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-09-19T06:03:08.976 INFO:teuthology.orchestra.run.smithi002.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 4.6 MB/s | 5.8 MB 00:01 2024-09-19T06:03:08.979 INFO:teuthology.orchestra.run.smithi089.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 152 kB/s | 19 kB 00:00 2024-09-19T06:03:09.004 INFO:teuthology.orchestra.run.smithi089.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-19T06:03:09.029 INFO:teuthology.orchestra.run.smithi089.stdout:(82/156): python3-markupsafe-1.1.1-12.el9.x86_6 459 kB/s | 35 kB 00:00 2024-09-19T06:03:09.063 INFO:teuthology.orchestra.run.smithi089.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-09-19T06:03:09.084 INFO:teuthology.orchestra.run.smithi002.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 5.4 MB/s | 6.0 MB 00:01 2024-09-19T06:03:09.096 INFO:teuthology.orchestra.run.smithi089.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.2 MB/s | 222 kB 00:00 2024-09-19T06:03:09.110 INFO:teuthology.orchestra.run.smithi002.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.8 MB/s | 250 kB 00:00 2024-09-19T06:03:09.122 INFO:teuthology.orchestra.run.smithi089.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-19T06:03:09.143 INFO:teuthology.orchestra.run.smithi002.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-19T06:03:09.155 INFO:teuthology.orchestra.run.smithi089.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 720 kB/s | 42 kB 00:00 2024-09-19T06:03:09.168 INFO:teuthology.orchestra.run.smithi002.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-19T06:03:09.181 INFO:teuthology.orchestra.run.smithi089.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-19T06:03:09.194 INFO:teuthology.orchestra.run.smithi002.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 841 kB/s | 42 kB 00:00 2024-09-19T06:03:09.244 INFO:teuthology.orchestra.run.smithi002.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-19T06:03:09.256 INFO:teuthology.orchestra.run.smithi089.stdout:(88/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 18 MB/s | 5.1 MB 00:00 2024-09-19T06:03:09.278 INFO:teuthology.orchestra.run.smithi002.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 2.4 MB/s | 269 kB 00:00 2024-09-19T06:03:09.281 INFO:teuthology.orchestra.run.smithi089.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-19T06:03:09.307 INFO:teuthology.orchestra.run.smithi089.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.2 MB/s | 279 kB 00:00 2024-09-19T06:03:09.332 INFO:teuthology.orchestra.run.smithi089.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 672 kB/s | 51 kB 00:00 2024-09-19T06:03:09.336 INFO:teuthology.orchestra.run.smithi002.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.0 MB/s | 279 kB 00:00 2024-09-19T06:03:09.357 INFO:teuthology.orchestra.run.smithi089.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 707 kB/s | 54 kB 00:00 2024-09-19T06:03:09.361 INFO:teuthology.orchestra.run.smithi002.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 611 kB/s | 51 kB 00:00 2024-09-19T06:03:09.383 INFO:teuthology.orchestra.run.smithi089.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 825 kB/s | 42 kB 00:00 2024-09-19T06:03:09.387 INFO:teuthology.orchestra.run.smithi002.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-19T06:03:09.416 INFO:teuthology.orchestra.run.smithi089.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 753 kB/s | 44 kB 00:00 2024-09-19T06:03:09.437 INFO:teuthology.orchestra.run.smithi002.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 835 kB/s | 42 kB 00:00 2024-09-19T06:03:09.458 INFO:teuthology.orchestra.run.smithi089.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-09-19T06:03:09.476 INFO:teuthology.orchestra.run.smithi089.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 608 kB/s | 36 kB 00:00 2024-09-19T06:03:09.504 INFO:teuthology.orchestra.run.smithi002.stdout:(93/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.9 MB/s | 5.1 MB 00:01 2024-09-19T06:03:09.509 INFO:teuthology.orchestra.run.smithi089.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 941 kB/s | 47 kB 00:00 2024-09-19T06:03:09.529 INFO:teuthology.orchestra.run.smithi002.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 481 kB/s | 44 kB 00:00 2024-09-19T06:03:09.534 INFO:teuthology.orchestra.run.smithi089.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-19T06:03:09.551 INFO:teuthology.orchestra.run.smithi089.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.3 MB/s | 58 kB 00:00 2024-09-19T06:03:09.580 INFO:teuthology.orchestra.run.smithi002.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 719 kB/s | 36 kB 00:00 2024-09-19T06:03:09.585 INFO:teuthology.orchestra.run.smithi089.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-19T06:03:09.602 INFO:teuthology.orchestra.run.smithi089.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-19T06:03:09.605 INFO:teuthology.orchestra.run.smithi002.stdout:(96/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.1 MB/s | 221 kB 00:00 2024-09-19T06:03:09.628 INFO:teuthology.orchestra.run.smithi089.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.0 MB/s | 45 kB 00:00 2024-09-19T06:03:09.630 INFO:teuthology.orchestra.run.smithi002.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-19T06:03:09.689 INFO:teuthology.orchestra.run.smithi002.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 992 kB/s | 58 kB 00:00 2024-09-19T06:03:09.719 INFO:teuthology.orchestra.run.smithi089.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 191 kB/s | 22 kB 00:00 2024-09-19T06:03:09.722 INFO:teuthology.orchestra.run.smithi002.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.5 MB/s | 304 kB 00:00 2024-09-19T06:03:09.748 INFO:teuthology.orchestra.run.smithi002.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-19T06:03:09.778 INFO:teuthology.orchestra.run.smithi089.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.1 MB/s | 548 kB 00:00 2024-09-19T06:03:09.781 INFO:teuthology.orchestra.run.smithi002.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-19T06:03:09.803 INFO:teuthology.orchestra.run.smithi089.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 12 MB/s | 308 kB 00:00 2024-09-19T06:03:09.806 INFO:teuthology.orchestra.run.smithi002.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 766 kB/s | 45 kB 00:00 2024-09-19T06:03:09.829 INFO:teuthology.orchestra.run.smithi089.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 778 kB/s | 19 kB 00:00 2024-09-19T06:03:09.882 INFO:teuthology.orchestra.run.smithi002.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 223 kB/s | 22 kB 00:00 2024-09-19T06:03:09.921 INFO:teuthology.orchestra.run.smithi090.stdout:lab-extras 18 kB/s | 1.7 kB 00:00 2024-09-19T06:03:09.941 INFO:teuthology.orchestra.run.smithi002.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-19T06:03:09.974 INFO:teuthology.orchestra.run.smithi002.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-19T06:03:09.996 INFO:teuthology.orchestra.run.smithi089.stdout:(107/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-09-19T06:03:10.016 INFO:teuthology.orchestra.run.smithi002.stdout:(106/156): protobuf-compiler-3.14.0-13.el9.x86_ 4.0 MB/s | 863 kB 00:00 2024-09-19T06:03:10.046 INFO:teuthology.orchestra.run.smithi089.stdout:(108/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.0 MB/s | 863 kB 00:00 2024-09-19T06:03:10.050 INFO:teuthology.orchestra.run.smithi002.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 259 kB/s | 19 kB 00:00 2024-09-19T06:03:10.080 INFO:teuthology.orchestra.run.smithi089.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 312 kB/s | 26 kB 00:00 2024-09-19T06:03:10.083 INFO:teuthology.orchestra.run.smithi002.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 828 kB/s | 26 kB 00:00 2024-09-19T06:03:10.114 INFO:teuthology.orchestra.run.smithi089.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 743 kB/s | 49 kB 00:00 2024-09-19T06:03:10.117 INFO:teuthology.orchestra.run.smithi002.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-19T06:03:10.139 INFO:teuthology.orchestra.run.smithi089.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.2 MB/s | 67 kB 00:00 2024-09-19T06:03:10.142 INFO:teuthology.orchestra.run.smithi002.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-19T06:03:10.172 INFO:teuthology.orchestra.run.smithi089.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-09-19T06:03:10.176 INFO:teuthology.orchestra.run.smithi002.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-19T06:03:10.248 INFO:teuthology.orchestra.run.smithi089.stdout:(113/156): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-19T06:03:10.273 INFO:teuthology.orchestra.run.smithi089.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 5.3 MB/s | 548 kB 00:00 2024-09-19T06:03:10.299 INFO:teuthology.orchestra.run.smithi089.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 862 kB/s | 43 kB 00:00 2024-09-19T06:03:10.310 INFO:teuthology.orchestra.run.smithi002.stdout:(112/156): libarrow-9.0.0-11.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-09-19T06:03:10.324 INFO:teuthology.orchestra.run.smithi089.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 636 kB/s | 32 kB 00:00 2024-09-19T06:03:10.343 INFO:teuthology.orchestra.run.smithi002.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-19T06:03:10.349 INFO:teuthology.orchestra.run.smithi089.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-09-19T06:03:10.369 INFO:teuthology.orchestra.run.smithi002.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T06:03:10.375 INFO:teuthology.orchestra.run.smithi089.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-19T06:03:10.394 INFO:teuthology.orchestra.run.smithi002.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-19T06:03:10.408 INFO:teuthology.orchestra.run.smithi089.stdout:(119/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.0 MB/s | 839 kB 00:00 2024-09-19T06:03:10.419 INFO:teuthology.orchestra.run.smithi002.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 563 kB/s | 14 kB 00:00 2024-09-19T06:03:10.442 INFO:teuthology.orchestra.run.smithi089.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-09-19T06:03:10.461 INFO:teuthology.orchestra.run.smithi002.stdout:(117/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 2.9 MB/s | 839 kB 00:00 2024-09-19T06:03:10.467 INFO:teuthology.orchestra.run.smithi089.stdout:(121/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.2 MB/s | 303 kB 00:00 2024-09-19T06:03:10.492 INFO:teuthology.orchestra.run.smithi089.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 2.6 MB/s | 220 kB 00:00 2024-09-19T06:03:10.511 INFO:teuthology.orchestra.run.smithi002.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 1.8 MB/s | 172 kB 00:00 2024-09-19T06:03:10.518 INFO:teuthology.orchestra.run.smithi089.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-19T06:03:10.543 INFO:teuthology.orchestra.run.smithi089.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 212 kB/s | 11 kB 00:00 2024-09-19T06:03:10.545 INFO:teuthology.orchestra.run.smithi002.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-09-19T06:03:10.568 INFO:teuthology.orchestra.run.smithi089.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-19T06:03:10.570 INFO:teuthology.orchestra.run.smithi002.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-19T06:03:10.594 INFO:teuthology.orchestra.run.smithi089.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 459 kB/s | 23 kB 00:00 2024-09-19T06:03:10.604 INFO:teuthology.orchestra.run.smithi002.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-19T06:03:10.636 INFO:teuthology.orchestra.run.smithi089.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 290 kB/s | 19 kB 00:00 2024-09-19T06:03:10.638 INFO:teuthology.orchestra.run.smithi002.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-19T06:03:10.654 INFO:teuthology.orchestra.run.smithi002.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 653 kB/s | 11 kB 00:00 2024-09-19T06:03:10.661 INFO:teuthology.orchestra.run.smithi089.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 293 kB/s | 20 kB 00:00 2024-09-19T06:03:10.671 INFO:teuthology.orchestra.run.smithi002.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-19T06:03:10.678 INFO:teuthology.orchestra.run.smithi089.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-19T06:03:10.688 INFO:teuthology.orchestra.run.smithi002.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-19T06:03:10.703 INFO:teuthology.orchestra.run.smithi089.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T06:03:10.706 INFO:teuthology.orchestra.run.smithi002.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 1.1 MB/s | 19 kB 00:00 2024-09-19T06:03:10.720 INFO:teuthology.orchestra.run.smithi089.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-09-19T06:03:10.722 INFO:teuthology.orchestra.run.smithi002.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 1.2 MB/s | 20 kB 00:00 2024-09-19T06:03:10.755 INFO:teuthology.orchestra.run.smithi089.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 8.6 MB/s | 1.0 MB 00:00 2024-09-19T06:03:10.779 INFO:teuthology.orchestra.run.smithi089.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2024-09-19T06:03:10.789 INFO:teuthology.orchestra.run.smithi002.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 9.3 MB/s | 2.0 MB 00:00 2024-09-19T06:03:10.805 INFO:teuthology.orchestra.run.smithi089.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-09-19T06:03:10.815 INFO:teuthology.orchestra.run.smithi002.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T06:03:10.830 INFO:teuthology.orchestra.run.smithi089.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-19T06:03:10.840 INFO:teuthology.orchestra.run.smithi002.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T06:03:10.855 INFO:teuthology.orchestra.run.smithi089.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-19T06:03:10.865 INFO:teuthology.orchestra.run.smithi002.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-19T06:03:10.880 INFO:teuthology.orchestra.run.smithi089.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 610 kB/s | 31 kB 00:00 2024-09-19T06:03:10.906 INFO:teuthology.orchestra.run.smithi089.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-19T06:03:10.907 INFO:teuthology.orchestra.run.smithi002.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 5.5 MB/s | 1.0 MB 00:00 2024-09-19T06:03:10.931 INFO:teuthology.orchestra.run.smithi089.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-19T06:03:10.941 INFO:teuthology.orchestra.run.smithi002.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-19T06:03:10.957 INFO:teuthology.orchestra.run.smithi089.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 708 kB/s | 36 kB 00:00 2024-09-19T06:03:10.966 INFO:teuthology.orchestra.run.smithi002.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 281 kB/s | 16 kB 00:00 2024-09-19T06:03:10.990 INFO:teuthology.orchestra.run.smithi089.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.2 MB/s | 74 kB 00:00 2024-09-19T06:03:10.991 INFO:teuthology.orchestra.run.smithi002.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-19T06:03:11.016 INFO:teuthology.orchestra.run.smithi089.stdout:(142/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.8 MB/s | 230 kB 00:00 2024-09-19T06:03:11.016 INFO:teuthology.orchestra.run.smithi002.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-19T06:03:11.041 INFO:teuthology.orchestra.run.smithi089.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-19T06:03:11.042 INFO:teuthology.orchestra.run.smithi002.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-19T06:03:11.067 INFO:teuthology.orchestra.run.smithi002.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-19T06:03:11.083 INFO:teuthology.orchestra.run.smithi089.stdout:(144/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.2 MB/s | 2.0 MB 00:00 2024-09-19T06:03:11.093 INFO:teuthology.orchestra.run.smithi002.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-19T06:03:11.108 INFO:teuthology.orchestra.run.smithi089.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 298 kB/s | 20 kB 00:00 2024-09-19T06:03:11.118 INFO:teuthology.orchestra.run.smithi002.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-09-19T06:03:11.142 INFO:teuthology.orchestra.run.smithi089.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-19T06:03:11.151 INFO:teuthology.orchestra.run.smithi002.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 2.2 MB/s | 74 kB 00:00 2024-09-19T06:03:11.168 INFO:teuthology.orchestra.run.smithi089.stdout:(147/156): re2-20211101-20.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-19T06:03:11.177 INFO:teuthology.orchestra.run.smithi002.stdout:(142/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.9 MB/s | 230 kB 00:00 2024-09-19T06:03:11.202 INFO:teuthology.orchestra.run.smithi002.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-19T06:03:11.218 INFO:teuthology.orchestra.run.smithi089.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-19T06:03:11.227 INFO:teuthology.orchestra.run.smithi002.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 807 kB/s | 20 kB 00:00 2024-09-19T06:03:11.253 INFO:teuthology.orchestra.run.smithi002.stdout:(145/156): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-19T06:03:11.278 INFO:teuthology.orchestra.run.smithi002.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-09-19T06:03:11.393 INFO:teuthology.orchestra.run.smithi089.stdout:(149/156): NetworkManager-1.51.0-1.el9.x86_64.r 14 MB/s | 2.3 MB 00:00 2024-09-19T06:03:11.453 INFO:teuthology.orchestra.run.smithi002.stdout:(147/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.8 MB/s | 16 MB 00:02 2024-09-19T06:03:11.460 INFO:teuthology.orchestra.run.smithi089.stdout:(150/156): librados2-19.1.1-361.g2f599a46.el9.x 11 MB/s | 3.4 MB 00:00 2024-09-19T06:03:11.502 INFO:teuthology.orchestra.run.smithi089.stdout:(151/156): NetworkManager-libnm-1.51.0-1.el9.x8 17 MB/s | 1.8 MB 00:00 2024-09-19T06:03:11.504 INFO:teuthology.orchestra.run.smithi002.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 6.3 MB/s | 1.6 MB 00:00 2024-09-19T06:03:11.527 INFO:teuthology.orchestra.run.smithi089.stdout:(152/156): NetworkManager-team-1.51.0-1.el9.x86 611 kB/s | 41 kB 00:00 2024-09-19T06:03:11.553 INFO:teuthology.orchestra.run.smithi089.stdout:(153/156): NetworkManager-tui-1.51.0-1.el9.x86_ 4.8 MB/s | 249 kB 00:00 2024-09-19T06:03:11.611 INFO:teuthology.orchestra.run.smithi089.stdout:(154/156): librbd1-19.1.1-361.g2f599a46.el9.x86 7.1 MB/s | 3.2 MB 00:00 2024-09-19T06:03:11.646 INFO:teuthology.orchestra.run.smithi002.stdout:(149/156): librados2-19.1.1-361.g2f599a46.el9.x 9.3 MB/s | 3.4 MB 00:00 2024-09-19T06:03:11.670 INFO:teuthology.orchestra.run.smithi089.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 20 MB/s | 2.4 MB 00:00 2024-09-19T06:03:11.720 INFO:teuthology.orchestra.run.smithi089.stdout:(156/156): openssl-3.2.2-6.el9.x86_64.rpm 7.0 MB/s | 1.4 MB 00:00 2024-09-19T06:03:11.725 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:03:11.725 INFO:teuthology.orchestra.run.smithi089.stdout:Total 22 MB/s | 226 MB 00:10 2024-09-19T06:03:11.921 INFO:teuthology.orchestra.run.smithi002.stdout:(150/156): librbd1-19.1.1-361.g2f599a46.el9.x86 6.8 MB/s | 3.2 MB 00:00 2024-09-19T06:03:12.225 INFO:teuthology.orchestra.run.smithi090.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T06:03:12.226 INFO:teuthology.orchestra.run.smithi090.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T06:03:12.239 INFO:teuthology.orchestra.run.smithi090.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T06:03:12.240 INFO:teuthology.orchestra.run.smithi090.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T06:03:12.241 INFO:teuthology.orchestra.run.smithi090.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T06:03:12.242 INFO:teuthology.orchestra.run.smithi090.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T06:03:12.244 INFO:teuthology.orchestra.run.smithi090.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T06:03:12.247 INFO:teuthology.orchestra.run.smithi090.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T06:03:12.248 INFO:teuthology.orchestra.run.smithi090.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T06:03:12.296 INFO:teuthology.orchestra.run.smithi002.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 109 kB/s | 41 kB 00:00 2024-09-19T06:03:12.311 INFO:teuthology.orchestra.run.smithi090.stdout:Dependencies resolved. 2024-09-19T06:03:12.338 INFO:teuthology.orchestra.run.smithi090.stdout:====================================================================================== 2024-09-19T06:03:12.338 INFO:teuthology.orchestra.run.smithi090.stdout: Package Arch Version Repository Size 2024-09-19T06:03:12.338 INFO:teuthology.orchestra.run.smithi090.stdout:====================================================================================== 2024-09-19T06:03:12.338 INFO:teuthology.orchestra.run.smithi090.stdout:Installing: 2024-09-19T06:03:12.338 INFO:teuthology.orchestra.run.smithi090.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T06:03:12.338 INFO:teuthology.orchestra.run.smithi090.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T06:03:12.338 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T06:03:12.338 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T06:03:12.338 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T06:03:12.338 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T06:03:12.339 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T06:03:12.339 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T06:03:12.339 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T06:03:12.339 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T06:03:12.339 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T06:03:12.339 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T06:03:12.339 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T06:03:12.339 INFO:teuthology.orchestra.run.smithi090.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T06:03:12.339 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T06:03:12.339 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T06:03:12.339 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T06:03:12.339 INFO:teuthology.orchestra.run.smithi090.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T06:03:12.340 INFO:teuthology.orchestra.run.smithi090.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T06:03:12.340 INFO:teuthology.orchestra.run.smithi090.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T06:03:12.340 INFO:teuthology.orchestra.run.smithi090.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T06:03:12.340 INFO:teuthology.orchestra.run.smithi090.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T06:03:12.340 INFO:teuthology.orchestra.run.smithi090.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T06:03:12.340 INFO:teuthology.orchestra.run.smithi090.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T06:03:12.340 INFO:teuthology.orchestra.run.smithi090.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T06:03:12.340 INFO:teuthology.orchestra.run.smithi090.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T06:03:12.340 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T06:03:12.340 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T06:03:12.341 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T06:03:12.341 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T06:03:12.341 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T06:03:12.341 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T06:03:12.341 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T06:03:12.341 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T06:03:12.341 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T06:03:12.341 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T06:03:12.341 INFO:teuthology.orchestra.run.smithi090.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T06:03:12.341 INFO:teuthology.orchestra.run.smithi090.stdout:Upgrading: 2024-09-19T06:03:12.341 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T06:03:12.341 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T06:03:12.342 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T06:03:12.342 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T06:03:12.342 INFO:teuthology.orchestra.run.smithi090.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T06:03:12.342 INFO:teuthology.orchestra.run.smithi090.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T06:03:12.342 INFO:teuthology.orchestra.run.smithi090.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T06:03:12.342 INFO:teuthology.orchestra.run.smithi090.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T06:03:12.342 INFO:teuthology.orchestra.run.smithi090.stdout:Installing dependencies: 2024-09-19T06:03:12.342 INFO:teuthology.orchestra.run.smithi090.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T06:03:12.342 INFO:teuthology.orchestra.run.smithi090.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T06:03:12.342 INFO:teuthology.orchestra.run.smithi090.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T06:03:12.342 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T06:03:12.342 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T06:03:12.342 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T06:03:12.342 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T06:03:12.343 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T06:03:12.343 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T06:03:12.343 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T06:03:12.343 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T06:03:12.343 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T06:03:12.343 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T06:03:12.343 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T06:03:12.343 INFO:teuthology.orchestra.run.smithi090.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T06:03:12.343 INFO:teuthology.orchestra.run.smithi090.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T06:03:12.343 INFO:teuthology.orchestra.run.smithi090.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T06:03:12.343 INFO:teuthology.orchestra.run.smithi090.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T06:03:12.343 INFO:teuthology.orchestra.run.smithi090.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T06:03:12.343 INFO:teuthology.orchestra.run.smithi090.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T06:03:12.344 INFO:teuthology.orchestra.run.smithi090.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T06:03:12.344 INFO:teuthology.orchestra.run.smithi090.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T06:03:12.344 INFO:teuthology.orchestra.run.smithi090.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T06:03:12.344 INFO:teuthology.orchestra.run.smithi090.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T06:03:12.344 INFO:teuthology.orchestra.run.smithi090.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T06:03:12.344 INFO:teuthology.orchestra.run.smithi090.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T06:03:12.344 INFO:teuthology.orchestra.run.smithi090.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T06:03:12.344 INFO:teuthology.orchestra.run.smithi090.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T06:03:12.344 INFO:teuthology.orchestra.run.smithi090.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T06:03:12.344 INFO:teuthology.orchestra.run.smithi090.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T06:03:12.344 INFO:teuthology.orchestra.run.smithi090.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T06:03:12.344 INFO:teuthology.orchestra.run.smithi090.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T06:03:12.344 INFO:teuthology.orchestra.run.smithi090.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T06:03:12.345 INFO:teuthology.orchestra.run.smithi090.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T06:03:12.345 INFO:teuthology.orchestra.run.smithi090.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T06:03:12.345 INFO:teuthology.orchestra.run.smithi090.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T06:03:12.345 INFO:teuthology.orchestra.run.smithi090.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T06:03:12.345 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T06:03:12.345 INFO:teuthology.orchestra.run.smithi090.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T06:03:12.345 INFO:teuthology.orchestra.run.smithi090.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T06:03:12.345 INFO:teuthology.orchestra.run.smithi090.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T06:03:12.345 INFO:teuthology.orchestra.run.smithi090.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T06:03:12.345 INFO:teuthology.orchestra.run.smithi090.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T06:03:12.345 INFO:teuthology.orchestra.run.smithi090.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T06:03:12.345 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T06:03:12.345 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T06:03:12.346 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T06:03:12.346 INFO:teuthology.orchestra.run.smithi090.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T06:03:12.346 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T06:03:12.346 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T06:03:12.346 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T06:03:12.346 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T06:03:12.346 INFO:teuthology.orchestra.run.smithi090.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T06:03:12.346 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T06:03:12.346 INFO:teuthology.orchestra.run.smithi090.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T06:03:12.346 INFO:teuthology.orchestra.run.smithi090.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T06:03:12.346 INFO:teuthology.orchestra.run.smithi090.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T06:03:12.346 INFO:teuthology.orchestra.run.smithi090.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T06:03:12.346 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T06:03:12.347 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T06:03:12.347 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T06:03:12.347 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T06:03:12.347 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T06:03:12.347 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T06:03:12.347 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T06:03:12.347 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T06:03:12.347 INFO:teuthology.orchestra.run.smithi090.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T06:03:12.347 INFO:teuthology.orchestra.run.smithi090.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T06:03:12.347 INFO:teuthology.orchestra.run.smithi090.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T06:03:12.347 INFO:teuthology.orchestra.run.smithi090.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T06:03:12.347 INFO:teuthology.orchestra.run.smithi090.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T06:03:12.347 INFO:teuthology.orchestra.run.smithi090.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T06:03:12.348 INFO:teuthology.orchestra.run.smithi090.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T06:03:12.348 INFO:teuthology.orchestra.run.smithi090.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T06:03:12.348 INFO:teuthology.orchestra.run.smithi090.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T06:03:12.348 INFO:teuthology.orchestra.run.smithi090.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T06:03:12.348 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T06:03:12.348 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T06:03:12.348 INFO:teuthology.orchestra.run.smithi090.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T06:03:12.348 INFO:teuthology.orchestra.run.smithi090.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T06:03:12.348 INFO:teuthology.orchestra.run.smithi090.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T06:03:12.348 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T06:03:12.348 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T06:03:12.348 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T06:03:12.348 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T06:03:12.349 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T06:03:12.349 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T06:03:12.349 INFO:teuthology.orchestra.run.smithi090.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T06:03:12.349 INFO:teuthology.orchestra.run.smithi090.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T06:03:12.349 INFO:teuthology.orchestra.run.smithi090.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T06:03:12.349 INFO:teuthology.orchestra.run.smithi090.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T06:03:12.349 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T06:03:12.349 INFO:teuthology.orchestra.run.smithi090.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T06:03:12.349 INFO:teuthology.orchestra.run.smithi090.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T06:03:12.349 INFO:teuthology.orchestra.run.smithi090.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T06:03:12.349 INFO:teuthology.orchestra.run.smithi090.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T06:03:12.349 INFO:teuthology.orchestra.run.smithi090.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T06:03:12.349 INFO:teuthology.orchestra.run.smithi090.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T06:03:12.349 INFO:teuthology.orchestra.run.smithi090.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T06:03:12.350 INFO:teuthology.orchestra.run.smithi090.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T06:03:12.350 INFO:teuthology.orchestra.run.smithi090.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T06:03:12.350 INFO:teuthology.orchestra.run.smithi090.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T06:03:12.350 INFO:teuthology.orchestra.run.smithi090.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T06:03:12.350 INFO:teuthology.orchestra.run.smithi090.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T06:03:12.350 INFO:teuthology.orchestra.run.smithi090.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T06:03:12.350 INFO:teuthology.orchestra.run.smithi090.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T06:03:12.350 INFO:teuthology.orchestra.run.smithi090.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T06:03:12.350 INFO:teuthology.orchestra.run.smithi090.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T06:03:12.350 INFO:teuthology.orchestra.run.smithi090.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T06:03:12.350 INFO:teuthology.orchestra.run.smithi090.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T06:03:12.350 INFO:teuthology.orchestra.run.smithi090.stdout:Installing weak dependencies: 2024-09-19T06:03:12.350 INFO:teuthology.orchestra.run.smithi090.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T06:03:12.351 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-19T06:03:12.351 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction Summary 2024-09-19T06:03:12.351 INFO:teuthology.orchestra.run.smithi090.stdout:====================================================================================== 2024-09-19T06:03:12.351 INFO:teuthology.orchestra.run.smithi090.stdout:Install 148 Packages 2024-09-19T06:03:12.351 INFO:teuthology.orchestra.run.smithi090.stdout:Upgrade 8 Packages 2024-09-19T06:03:12.351 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-19T06:03:12.351 INFO:teuthology.orchestra.run.smithi090.stdout:Total download size: 226 M 2024-09-19T06:03:12.352 INFO:teuthology.orchestra.run.smithi090.stdout:Downloading Packages: 2024-09-19T06:03:12.496 INFO:teuthology.orchestra.run.smithi002.stdout:(152/156): NetworkManager-1.51.0-1.el9.x86_64.r 2.3 MB/s | 2.3 MB 00:00 2024-09-19T06:03:12.638 INFO:teuthology.orchestra.run.smithi002.stdout:(153/156): openssl-3.2.2-6.el9.x86_64.rpm 9.6 MB/s | 1.4 MB 00:00 2024-09-19T06:03:12.705 INFO:teuthology.orchestra.run.smithi002.stdout:(154/156): NetworkManager-libnm-1.51.0-1.el9.x8 1.7 MB/s | 1.8 MB 00:01 2024-09-19T06:03:12.764 INFO:teuthology.orchestra.run.smithi002.stdout:(155/156): NetworkManager-tui-1.51.0-1.el9.x86_ 532 kB/s | 249 kB 00:00 2024-09-19T06:03:12.908 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-19T06:03:12.965 INFO:teuthology.orchestra.run.smithi090.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 50 kB/s | 6.6 kB 00:00 2024-09-19T06:03:13.057 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-19T06:03:13.058 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-19T06:03:13.157 INFO:teuthology.orchestra.run.smithi090.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 4.6 MB/s | 896 kB 00:00 2024-09-19T06:03:13.249 INFO:teuthology.orchestra.run.smithi090.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.5 MB/s | 145 kB 00:00 2024-09-19T06:03:13.341 INFO:teuthology.orchestra.run.smithi090.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-19T06:03:13.441 INFO:teuthology.orchestra.run.smithi090.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 15 MB/s | 1.5 MB 00:00 2024-09-19T06:03:13.480 INFO:teuthology.orchestra.run.smithi002.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.8 MB/s | 2.4 MB 00:00 2024-09-19T06:03:13.486 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:03:13.486 INFO:teuthology.orchestra.run.smithi002.stdout:Total 16 MB/s | 226 MB 00:14 2024-09-19T06:03:13.508 INFO:teuthology.orchestra.run.smithi090.stdout:(6/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 9.2 MB/s | 2.4 MB 00:00 2024-09-19T06:03:13.675 INFO:teuthology.orchestra.run.smithi090.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 20 MB/s | 4.7 MB 00:00 2024-09-19T06:03:14.184 INFO:teuthology.orchestra.run.smithi090.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 16 MB/s | 21 MB 00:01 2024-09-19T06:03:14.343 INFO:teuthology.orchestra.run.smithi090.stdout:(9/156): ceph-radosgw-19.1.1-361.g2f599a46.el9. 16 MB/s | 11 MB 00:00 2024-09-19T06:03:14.368 INFO:teuthology.orchestra.run.smithi090.stdout:(10/156): ceph-selinux-19.1.1-361.g2f599a46.el9 137 kB/s | 25 kB 00:00 2024-09-19T06:03:14.435 INFO:teuthology.orchestra.run.smithi090.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 3.3 MB/s | 228 kB 00:00 2024-09-19T06:03:14.502 INFO:teuthology.orchestra.run.smithi090.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 406 kB/s | 27 kB 00:00 2024-09-19T06:03:14.702 INFO:teuthology.orchestra.run.smithi090.stdout:(13/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 14 MB/s | 17 MB 00:01 2024-09-19T06:03:14.728 INFO:teuthology.orchestra.run.smithi090.stdout:(14/156): libcephfs-devel-19.1.1-361.g2f599a46. 141 kB/s | 32 kB 00:00 2024-09-19T06:03:14.761 INFO:teuthology.orchestra.run.smithi090.stdout:(15/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 13 MB/s | 751 kB 00:00 2024-09-19T06:03:14.764 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-19T06:03:14.795 INFO:teuthology.orchestra.run.smithi090.stdout:(16/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.4 MB/s | 163 kB 00:00 2024-09-19T06:03:14.821 INFO:teuthology.orchestra.run.smithi090.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 2.1 MB/s | 127 kB 00:00 2024-09-19T06:03:14.873 INFO:teuthology.orchestra.run.smithi090.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 6.4 MB/s | 506 kB 00:00 2024-09-19T06:03:14.933 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-19T06:03:14.933 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-19T06:03:14.948 INFO:teuthology.orchestra.run.smithi090.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 603 kB/s | 45 kB 00:00 2024-09-19T06:03:15.014 INFO:teuthology.orchestra.run.smithi090.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 2.0 MB/s | 136 kB 00:00 2024-09-19T06:03:15.090 INFO:teuthology.orchestra.run.smithi090.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 2.1 MB/s | 161 kB 00:00 2024-09-19T06:03:15.190 INFO:teuthology.orchestra.run.smithi090.stdout:(22/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 14 MB/s | 5.3 MB 00:00 2024-09-19T06:03:15.224 INFO:teuthology.orchestra.run.smithi090.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 2.3 MB/s | 320 kB 00:00 2024-09-19T06:03:15.258 INFO:teuthology.orchestra.run.smithi090.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 4.4 MB/s | 300 kB 00:00 2024-09-19T06:03:15.283 INFO:teuthology.orchestra.run.smithi090.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.6 MB/s | 99 kB 00:00 2024-09-19T06:03:15.290 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-19T06:03:15.290 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-19T06:03:15.308 INFO:teuthology.orchestra.run.smithi090.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-19T06:03:15.367 INFO:teuthology.orchestra.run.smithi090.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.9 MB/s | 171 kB 00:00 2024-09-19T06:03:15.476 INFO:teuthology.orchestra.run.smithi090.stdout:(28/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 16 MB/s | 3.1 MB 00:00 2024-09-19T06:03:15.493 INFO:teuthology.orchestra.run.smithi090.stdout:(29/156): ceph-grafana-dashboards-19.1.1-361.g2 254 kB/s | 32 kB 00:00 2024-09-19T06:03:15.526 INFO:teuthology.orchestra.run.smithi090.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.8 MB/s | 146 kB 00:00 2024-09-19T06:03:15.794 INFO:teuthology.orchestra.run.smithi090.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 12 MB/s | 3.6 MB 00:00 2024-09-19T06:03:15.869 INFO:teuthology.orchestra.run.smithi090.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 3.2 MB/s | 249 kB 00:00 2024-09-19T06:03:15.944 INFO:teuthology.orchestra.run.smithi090.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 659 kB/s | 49 kB 00:00 2024-09-19T06:03:16.084 INFO:teuthology.orchestra.run.smithi090.stdout:(34/156): ceph-mgr-diskprediction-local-19.1.1- 13 MB/s | 7.4 MB 00:00 2024-09-19T06:03:16.103 INFO:teuthology.orchestra.run.smithi090.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 103 kB/s | 16 kB 00:00 2024-09-19T06:03:16.137 INFO:teuthology.orchestra.run.smithi090.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 5.3 MB/s | 285 kB 00:00 2024-09-19T06:03:16.179 INFO:teuthology.orchestra.run.smithi090.stdout:(37/156): cephadm-19.1.1-361.g2f599a46.el9.noar 9.9 MB/s | 765 kB 00:00 2024-09-19T06:03:16.204 INFO:teuthology.orchestra.run.smithi090.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 271 kB/s | 18 kB 00:00 2024-09-19T06:03:16.730 INFO:teuthology.orchestra.run.smithi090.stdout:(39/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 20 MB/s | 49 MB 00:02 2024-09-19T06:03:16.798 INFO:teuthology.orchestra.run.smithi090.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 129 kB/s | 80 kB 00:00 2024-09-19T06:03:16.857 INFO:teuthology.orchestra.run.smithi090.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-09-19T06:03:16.890 INFO:teuthology.orchestra.run.smithi090.stdout:(42/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-19T06:03:16.933 INFO:teuthology.orchestra.run.smithi090.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 801 kB 00:00 2024-09-19T06:03:16.958 INFO:teuthology.orchestra.run.smithi090.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-19T06:03:16.992 INFO:teuthology.orchestra.run.smithi090.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-19T06:03:17.025 INFO:teuthology.orchestra.run.smithi090.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-09-19T06:03:17.059 INFO:teuthology.orchestra.run.smithi090.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-09-19T06:03:17.109 INFO:teuthology.orchestra.run.smithi090.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 4.9 MB/s | 1.2 MB 00:00 2024-09-19T06:03:17.185 INFO:teuthology.orchestra.run.smithi090.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 4.2 MB/s | 689 kB 00:00 2024-09-19T06:03:17.227 INFO:teuthology.orchestra.run.smithi090.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 912 kB/s | 107 kB 00:00 2024-09-19T06:03:17.252 INFO:teuthology.orchestra.run.smithi090.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 324 kB/s | 22 kB 00:00 2024-09-19T06:03:17.269 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-19T06:03:17.270 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-19T06:03:17.311 INFO:teuthology.orchestra.run.smithi090.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 3.7 MB/s | 943 kB 00:00 2024-09-19T06:03:17.336 INFO:teuthology.orchestra.run.smithi090.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 390 kB/s | 33 kB 00:00 2024-09-19T06:03:17.370 INFO:teuthology.orchestra.run.smithi090.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.1 MB/s | 313 kB 00:00 2024-09-19T06:03:17.412 INFO:teuthology.orchestra.run.smithi090.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 241 kB/s | 18 kB 00:00 2024-09-19T06:03:17.437 INFO:teuthology.orchestra.run.smithi090.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 166 kB/s | 11 kB 00:00 2024-09-19T06:03:17.487 INFO:teuthology.orchestra.run.smithi090.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-19T06:03:17.513 INFO:teuthology.orchestra.run.smithi090.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 601 kB/s | 45 kB 00:00 2024-09-19T06:03:17.572 INFO:teuthology.orchestra.run.smithi090.stdout:(59/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2024-09-19T06:03:17.605 INFO:teuthology.orchestra.run.smithi090.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 6.2 MB/s | 581 kB 00:00 2024-09-19T06:03:17.639 INFO:teuthology.orchestra.run.smithi090.stdout:(61/156): librdkafka-1.6.1-102.el9.x86_64.rpm 4.3 MB/s | 662 kB 00:00 2024-09-19T06:03:17.664 INFO:teuthology.orchestra.run.smithi090.stdout:(62/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 265 kB/s | 24 kB 00:00 2024-09-19T06:03:17.689 INFO:teuthology.orchestra.run.smithi090.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 565 kB/s | 47 kB 00:00 2024-09-19T06:03:17.724 INFO:teuthology.orchestra.run.smithi090.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-19T06:03:17.750 INFO:teuthology.orchestra.run.smithi090.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-19T06:03:17.775 INFO:teuthology.orchestra.run.smithi090.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 451 kB/s | 38 kB 00:00 2024-09-19T06:03:17.876 INFO:teuthology.orchestra.run.smithi090.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 33 MB/s | 4.9 MB 00:00 2024-09-19T06:03:17.934 INFO:teuthology.orchestra.run.smithi090.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-09-19T06:03:17.976 INFO:teuthology.orchestra.run.smithi090.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 8.9 MB/s | 910 kB 00:00 2024-09-19T06:03:18.002 INFO:teuthology.orchestra.run.smithi090.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-19T06:03:18.085 INFO:teuthology.orchestra.run.smithi090.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-09-19T06:03:18.127 INFO:teuthology.orchestra.run.smithi090.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 8.0 MB/s | 1.0 MB 00:00 2024-09-19T06:03:18.153 INFO:teuthology.orchestra.run.smithi090.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-19T06:03:18.253 INFO:teuthology.orchestra.run.smithi090.stdout:(74/156): postgresql-server-13.16-1.el9.x86_64. 21 MB/s | 5.8 MB 00:00 2024-09-19T06:03:18.278 INFO:teuthology.orchestra.run.smithi090.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 489 kB/s | 61 kB 00:00 2024-09-19T06:03:18.337 INFO:teuthology.orchestra.run.smithi090.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-19T06:03:18.429 INFO:teuthology.orchestra.run.smithi090.stdout:(77/156): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 6.0 MB 00:00 2024-09-19T06:03:18.454 INFO:teuthology.orchestra.run.smithi090.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 219 kB/s | 26 kB 00:00 2024-09-19T06:03:18.480 INFO:teuthology.orchestra.run.smithi090.stdout:(79/156): python3-jinja2-2.11.3-6.el9.noarch.rp 1.2 MB/s | 248 kB 00:00 2024-09-19T06:03:18.505 INFO:teuthology.orchestra.run.smithi090.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 253 kB/s | 19 kB 00:00 2024-09-19T06:03:18.530 INFO:teuthology.orchestra.run.smithi090.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-19T06:03:18.556 INFO:teuthology.orchestra.run.smithi090.stdout:(82/156): python3-markupsafe-1.1.1-12.el9.x86_6 458 kB/s | 35 kB 00:00 2024-09-19T06:03:18.598 INFO:teuthology.orchestra.run.smithi090.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.6 MB/s | 250 kB 00:00 2024-09-19T06:03:18.640 INFO:teuthology.orchestra.run.smithi090.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-09-19T06:03:18.724 INFO:teuthology.orchestra.run.smithi090.stdout:(85/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 23 MB/s | 5.1 MB 00:00 2024-09-19T06:03:18.749 INFO:teuthology.orchestra.run.smithi090.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 389 kB/s | 42 kB 00:00 2024-09-19T06:03:18.776 INFO:teuthology.orchestra.run.smithi090.stdout:(87/156): python3-packaging-20.9-5.el9.noarch.r 435 kB/s | 77 kB 00:00 2024-09-19T06:03:18.801 INFO:teuthology.orchestra.run.smithi090.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 3.4 MB/s | 269 kB 00:00 2024-09-19T06:03:18.826 INFO:teuthology.orchestra.run.smithi090.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.0 MB/s | 159 kB 00:00 2024-09-19T06:03:18.860 INFO:teuthology.orchestra.run.smithi090.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.2 MB/s | 279 kB 00:00 2024-09-19T06:03:18.885 INFO:teuthology.orchestra.run.smithi090.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 607 kB/s | 51 kB 00:00 2024-09-19T06:03:18.911 INFO:teuthology.orchestra.run.smithi090.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 638 kB/s | 54 kB 00:00 2024-09-19T06:03:18.944 INFO:teuthology.orchestra.run.smithi090.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 709 kB/s | 42 kB 00:00 2024-09-19T06:03:18.978 INFO:teuthology.orchestra.run.smithi090.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 660 kB/s | 44 kB 00:00 2024-09-19T06:03:19.011 INFO:teuthology.orchestra.run.smithi090.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-19T06:03:19.037 INFO:teuthology.orchestra.run.smithi090.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 612 kB/s | 36 kB 00:00 2024-09-19T06:03:19.071 INFO:teuthology.orchestra.run.smithi090.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 807 kB/s | 47 kB 00:00 2024-09-19T06:03:19.113 INFO:teuthology.orchestra.run.smithi090.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 3.9 MB/s | 304 kB 00:00 2024-09-19T06:03:19.138 INFO:teuthology.orchestra.run.smithi090.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 863 kB/s | 58 kB 00:00 2024-09-19T06:03:19.172 INFO:teuthology.orchestra.run.smithi090.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-19T06:03:19.205 INFO:teuthology.orchestra.run.smithi090.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 948 kB/s | 64 kB 00:00 2024-09-19T06:03:19.414 INFO:teuthology.orchestra.run.smithi090.stdout:(102/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-09-19T06:03:19.439 INFO:teuthology.orchestra.run.smithi090.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 95 kB/s | 22 kB 00:00 2024-09-19T06:03:19.465 INFO:teuthology.orchestra.run.smithi090.stdout:(104/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 153 kB/s | 45 kB 00:00 2024-09-19T06:03:19.523 INFO:teuthology.orchestra.run.smithi090.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 6.4 MB/s | 548 kB 00:00 2024-09-19T06:03:19.540 INFO:teuthology.orchestra.run.smithi090.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 1.2 MB/s | 19 kB 00:00 2024-09-19T06:03:19.582 INFO:teuthology.orchestra.run.smithi090.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 5.0 MB/s | 863 kB 00:00 2024-09-19T06:03:19.608 INFO:teuthology.orchestra.run.smithi090.stdout:(108/156): gperftools-libs-2.9.1-3.el9.x86_64.r 2.1 MB/s | 308 kB 00:00 2024-09-19T06:03:19.642 INFO:teuthology.orchestra.run.smithi090.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.8 MB/s | 49 kB 00:00 2024-09-19T06:03:19.675 INFO:teuthology.orchestra.run.smithi090.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.1 MB/s | 67 kB 00:00 2024-09-19T06:03:19.701 INFO:teuthology.orchestra.run.smithi090.stdout:(111/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 220 kB/s | 26 kB 00:00 2024-09-19T06:03:19.727 INFO:teuthology.orchestra.run.smithi090.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-19T06:03:19.777 INFO:teuthology.orchestra.run.smithi090.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-19T06:03:19.811 INFO:teuthology.orchestra.run.smithi090.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-09-19T06:03:19.845 INFO:teuthology.orchestra.run.smithi090.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 966 kB/s | 32 kB 00:00 2024-09-19T06:03:19.879 INFO:teuthology.orchestra.run.smithi090.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 422 kB/s | 14 kB 00:00 2024-09-19T06:03:19.912 INFO:teuthology.orchestra.run.smithi090.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 5.0 MB/s | 172 kB 00:00 2024-09-19T06:03:19.946 INFO:teuthology.orchestra.run.smithi090.stdout:(118/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.3 MB/s | 839 kB 00:00 2024-09-19T06:03:20.021 INFO:teuthology.orchestra.run.smithi090.stdout:(119/156): libarrow-9.0.0-11.el9.x86_64.rpm 9.2 MB/s | 4.4 MB 00:00 2024-09-19T06:03:20.055 INFO:teuthology.orchestra.run.smithi090.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 2.5 MB/s | 358 kB 00:00 2024-09-19T06:03:20.089 INFO:teuthology.orchestra.run.smithi090.stdout:(121/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.1 MB/s | 303 kB 00:00 2024-09-19T06:03:20.114 INFO:teuthology.orchestra.run.smithi090.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 2.3 MB/s | 220 kB 00:00 2024-09-19T06:03:20.139 INFO:teuthology.orchestra.run.smithi090.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-19T06:03:20.165 INFO:teuthology.orchestra.run.smithi090.stdout:(124/156): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-09-19T06:03:20.190 INFO:teuthology.orchestra.run.smithi090.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 351 kB/s | 18 kB 00:00 2024-09-19T06:03:20.215 INFO:teuthology.orchestra.run.smithi090.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 459 kB/s | 23 kB 00:00 2024-09-19T06:03:20.241 INFO:teuthology.orchestra.run.smithi090.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-19T06:03:20.266 INFO:teuthology.orchestra.run.smithi090.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-19T06:03:20.291 INFO:teuthology.orchestra.run.smithi090.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T06:03:20.325 INFO:teuthology.orchestra.run.smithi090.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-19T06:03:20.350 INFO:teuthology.orchestra.run.smithi090.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.2 MB/s | 58 kB 00:00 2024-09-19T06:03:20.401 INFO:teuthology.orchestra.run.smithi090.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 6.4 MB/s | 1.0 MB 00:00 2024-09-19T06:03:20.434 INFO:teuthology.orchestra.run.smithi090.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-19T06:03:20.460 INFO:teuthology.orchestra.run.smithi090.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 279 kB/s | 16 kB 00:00 2024-09-19T06:03:20.495 INFO:teuthology.orchestra.run.smithi090.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-19T06:03:20.520 INFO:teuthology.orchestra.run.smithi090.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 472 kB/s | 28 kB 00:00 2024-09-19T06:03:20.571 INFO:teuthology.orchestra.run.smithi090.stdout:(137/156): python3-grpcio-1.46.7-10.el9.x86_64. 4.0 MB/s | 2.0 MB 00:00 2024-09-19T06:03:20.596 INFO:teuthology.orchestra.run.smithi090.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 305 kB/s | 31 kB 00:00 2024-09-19T06:03:20.621 INFO:teuthology.orchestra.run.smithi090.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-19T06:03:20.647 INFO:teuthology.orchestra.run.smithi090.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 711 kB/s | 36 kB 00:00 2024-09-19T06:03:20.672 INFO:teuthology.orchestra.run.smithi090.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-19T06:03:20.707 INFO:teuthology.orchestra.run.smithi090.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 886 kB/s | 74 kB 00:00 2024-09-19T06:03:20.739 INFO:teuthology.orchestra.run.smithi090.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-09-19T06:03:20.765 INFO:teuthology.orchestra.run.smithi090.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 801 kB/s | 20 kB 00:00 2024-09-19T06:03:20.790 INFO:teuthology.orchestra.run.smithi090.stdout:(145/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.6 MB/s | 230 kB 00:00 2024-09-19T06:03:20.824 INFO:teuthology.orchestra.run.smithi090.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-19T06:03:20.857 INFO:teuthology.orchestra.run.smithi090.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-09-19T06:03:20.916 INFO:teuthology.orchestra.run.smithi090.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-19T06:03:21.117 INFO:teuthology.orchestra.run.smithi090.stdout:(149/156): NetworkManager-1.51.0-1.el9.x86_64.r 12 MB/s | 2.3 MB 00:00 2024-09-19T06:03:21.242 INFO:teuthology.orchestra.run.smithi090.stdout:(150/156): librados2-19.1.1-361.g2f599a46.el9.x 8.2 MB/s | 3.4 MB 00:00 2024-09-19T06:03:21.309 INFO:teuthology.orchestra.run.smithi090.stdout:(151/156): librbd1-19.1.1-361.g2f599a46.el9.x86 7.0 MB/s | 3.2 MB 00:00 2024-09-19T06:03:21.334 INFO:teuthology.orchestra.run.smithi090.stdout:(152/156): NetworkManager-team-1.51.0-1.el9.x86 445 kB/s | 41 kB 00:00 2024-09-19T06:03:21.393 INFO:teuthology.orchestra.run.smithi090.stdout:(153/156): NetworkManager-libnm-1.51.0-1.el9.x8 6.5 MB/s | 1.8 MB 00:00 2024-09-19T06:03:21.452 INFO:teuthology.orchestra.run.smithi090.stdout:(154/156): NetworkManager-tui-1.51.0-1.el9.x86_ 1.7 MB/s | 249 kB 00:00 2024-09-19T06:03:21.510 INFO:teuthology.orchestra.run.smithi090.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 20 MB/s | 2.4 MB 00:00 2024-09-19T06:03:21.560 INFO:teuthology.orchestra.run.smithi090.stdout:(156/156): openssl-3.2.2-6.el9.x86_64.rpm 6.0 MB/s | 1.4 MB 00:00 2024-09-19T06:03:21.567 INFO:teuthology.orchestra.run.smithi090.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:03:21.567 INFO:teuthology.orchestra.run.smithi090.stdout:Total 25 MB/s | 226 MB 00:09 2024-09-19T06:03:21.791 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-19T06:03:21.884 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T06:03:21.925 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T06:03:21.991 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T06:03:22.025 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T06:03:22.057 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T06:03:22.118 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T06:03:22.447 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T06:03:22.559 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:03:22.664 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:03:22.694 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:03:22.768 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:03:22.802 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T06:03:22.804 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction check 2024-09-19T06:03:22.955 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction check succeeded. 2024-09-19T06:03:22.955 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction test 2024-09-19T06:03:22.975 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T06:03:23.029 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T06:03:23.057 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:03:23.159 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:03:23.183 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T06:03:23.229 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T06:03:23.251 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T06:03:23.271 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T06:03:23.469 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T06:03:23.648 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T06:03:23.766 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T06:03:23.876 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:03:23.952 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:03:24.075 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-19T06:03:24.182 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:03:24.185 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T06:03:24.227 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T06:03:24.286 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T06:03:24.298 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T06:03:24.319 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T06:03:24.353 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T06:03:24.393 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T06:03:24.411 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T06:03:24.433 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T06:03:24.467 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T06:03:24.530 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T06:03:24.575 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T06:03:24.608 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T06:03:24.652 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T06:03:24.685 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T06:03:24.713 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T06:03:24.760 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T06:03:24.780 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T06:03:24.843 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T06:03:24.870 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:03:24.883 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T06:03:24.926 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T06:03:24.995 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:03:25.003 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T06:03:25.021 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:03:25.037 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T06:03:25.080 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T06:03:25.109 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T06:03:25.114 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:03:25.151 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T06:03:25.177 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T06:03:25.223 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T06:03:25.314 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T06:03:25.326 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction test succeeded. 2024-09-19T06:03:25.326 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction 2024-09-19T06:03:25.336 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T06:03:25.382 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T06:03:25.409 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:03:25.453 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T06:03:25.510 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T06:03:25.515 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:03:25.544 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T06:03:25.606 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T06:03:25.628 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T06:03:25.652 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T06:03:25.847 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T06:03:26.022 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T06:03:26.052 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T06:03:26.113 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T06:03:26.144 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T06:03:26.176 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T06:03:26.179 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T06:03:26.216 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T06:03:26.260 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T06:03:26.285 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:03:26.361 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:03:26.430 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T06:03:26.486 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T06:03:26.549 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T06:03:26.578 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:03:26.631 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T06:03:26.663 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T06:03:26.695 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T06:03:26.698 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T06:03:26.745 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T06:03:26.782 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T06:03:26.790 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T06:03:26.825 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T06:03:26.825 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T06:03:26.859 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T06:03:26.867 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T06:03:26.936 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T06:03:26.986 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T06:03:27.009 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T06:03:27.026 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T06:03:27.061 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T06:03:27.069 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T06:03:27.103 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T06:03:27.110 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T06:03:27.146 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T06:03:27.204 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T06:03:27.217 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T06:03:27.237 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T06:03:27.269 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T06:03:27.277 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T06:03:27.300 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T06:03:27.302 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T06:03:27.327 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T06:03:27.343 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T06:03:27.422 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T06:03:27.461 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T06:03:27.506 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T06:03:27.533 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T06:03:27.607 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T06:03:27.612 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T06:03:27.657 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T06:03:27.735 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T06:03:27.794 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T06:03:27.835 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T06:03:27.863 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T06:03:27.880 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T06:03:27.897 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T06:03:27.936 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T06:03:27.937 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T06:03:27.972 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T06:03:28.019 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T06:03:28.053 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T06:03:28.087 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T06:03:28.128 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T06:03:28.163 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T06:03:28.248 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T06:03:28.301 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T06:03:28.333 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T06:03:28.434 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T06:03:28.483 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T06:03:28.493 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T06:03:28.582 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T06:03:28.617 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T06:03:28.660 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T06:03:28.698 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T06:03:28.741 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T06:03:28.907 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T06:03:28.985 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T06:03:29.049 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T06:03:29.123 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T06:03:29.160 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T06:03:29.196 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T06:03:29.198 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T06:03:29.244 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T06:03:29.257 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T06:03:29.279 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T06:03:29.291 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T06:03:29.323 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T06:03:29.373 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T06:03:29.389 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T06:03:29.446 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T06:03:29.490 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T06:03:29.525 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T06:03:29.568 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T06:03:29.611 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T06:03:29.742 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T06:03:29.784 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T06:03:29.793 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T06:03:29.825 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T06:03:29.901 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T06:03:29.903 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T06:03:29.942 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T06:03:29.982 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T06:03:30.015 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T06:03:30.040 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T06:03:30.141 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T06:03:30.274 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T06:03:30.308 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T06:03:30.346 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T06:03:30.388 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T06:03:30.435 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T06:03:30.475 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T06:03:30.504 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T06:03:30.539 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T06:03:30.572 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T06:03:30.614 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T06:03:30.649 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T06:03:30.739 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T06:03:30.746 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T06:03:30.788 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T06:03:30.827 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T06:03:30.872 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T06:03:30.935 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T06:03:31.012 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T06:03:31.620 INFO:teuthology.orchestra.run.smithi090.stdout: Preparing : 1/1 2024-09-19T06:03:31.768 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T06:03:31.805 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T06:03:31.814 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T06:03:31.858 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T06:03:31.885 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T06:03:31.892 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T06:03:31.927 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T06:03:31.961 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T06:03:32.003 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T06:03:32.006 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T06:03:32.064 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T06:03:32.118 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T06:03:32.118 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T06:03:32.208 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T06:03:32.213 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T06:03:32.241 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T06:03:32.245 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T06:03:32.277 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T06:03:32.343 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T06:03:32.437 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T06:03:32.459 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T06:03:32.489 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:03:32.548 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T06:03:32.584 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T06:03:32.611 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:03:32.623 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T06:03:32.640 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:03:32.696 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T06:03:32.728 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T06:03:32.731 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:03:32.761 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T06:03:32.764 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T06:03:32.949 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T06:03:33.009 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T06:03:33.036 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:03:33.150 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:03:33.172 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T06:03:33.235 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T06:03:33.244 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T06:03:33.244 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T06:03:33.257 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T06:03:33.279 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T06:03:33.285 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T06:03:33.347 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T06:03:33.370 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T06:03:33.370 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T06:03:33.455 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T06:03:33.651 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T06:03:33.799 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T06:03:33.924 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:03:34.051 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:03:34.262 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:03:34.385 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T06:03:34.486 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T06:03:34.528 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T06:03:34.575 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T06:03:34.647 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T06:03:34.693 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T06:03:34.696 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T06:03:34.726 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T06:03:34.778 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T06:03:34.787 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T06:03:34.816 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T06:03:34.825 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T06:03:34.849 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T06:03:34.856 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T06:03:34.932 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T06:03:34.999 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T06:03:35.035 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T06:03:35.069 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T06:03:35.137 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T06:03:35.172 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T06:03:35.175 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T06:03:35.216 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T06:03:35.219 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T06:03:35.246 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T06:03:35.311 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T06:03:35.324 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T06:03:35.341 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T06:03:35.369 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T06:03:35.387 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T06:03:35.443 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T06:03:35.584 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T06:03:35.638 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T06:03:35.692 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T06:03:35.734 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T06:03:35.895 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T06:03:35.931 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T06:03:35.995 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T06:03:36.024 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T06:03:36.166 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T06:03:36.261 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T06:03:36.276 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T06:03:36.299 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T06:03:36.312 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T06:03:36.353 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T06:03:36.388 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T06:03:36.403 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T06:03:36.403 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T06:03:36.403 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T06:03:36.403 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-19T06:03:36.446 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T06:03:36.456 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T06:03:36.656 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T06:03:36.701 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T06:03:36.755 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T06:03:36.829 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T06:03:36.861 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T06:03:36.898 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T06:03:36.945 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T06:03:36.981 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T06:03:37.024 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T06:03:37.066 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T06:03:37.202 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T06:03:37.253 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T06:03:37.295 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T06:03:37.404 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T06:03:37.456 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T06:03:37.505 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T06:03:37.615 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T06:03:37.895 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T06:03:38.207 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T06:03:38.348 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T06:03:38.383 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T06:03:38.428 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T06:03:38.463 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T06:03:38.499 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T06:03:38.502 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T06:03:38.537 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T06:03:38.543 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T06:03:38.581 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T06:03:38.616 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T06:03:38.649 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T06:03:38.690 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T06:03:38.726 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T06:03:38.812 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T06:03:38.865 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T06:03:38.905 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T06:03:39.008 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T06:03:39.065 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T06:03:39.120 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T06:03:39.166 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T06:03:39.257 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T06:03:39.258 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T06:03:39.258 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T06:03:39.258 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:03:39.300 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T06:03:39.776 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T06:03:39.830 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T06:03:39.864 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T06:03:39.964 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T06:03:40.021 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T06:03:40.073 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T06:03:40.160 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T06:03:40.202 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T06:03:40.382 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T06:03:40.409 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T06:03:40.500 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T06:03:41.168 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T06:03:41.309 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T06:03:42.577 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T06:03:42.662 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T06:03:42.689 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T06:03:42.723 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T06:03:43.038 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T06:03:43.086 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T06:03:43.178 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T06:03:43.326 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T06:03:43.381 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T06:03:43.868 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T06:03:43.908 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T06:03:43.971 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T06:03:44.001 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T06:03:46.320 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T06:03:46.375 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T06:03:46.938 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T06:03:46.980 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T06:03:47.072 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T06:03:47.072 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T06:03:47.072 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T06:03:47.073 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-19T06:03:47.116 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T06:03:48.476 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T06:03:48.476 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /sys 2024-09-19T06:03:48.476 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /proc 2024-09-19T06:03:48.476 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /mnt 2024-09-19T06:03:48.476 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /var/tmp 2024-09-19T06:03:48.476 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /home 2024-09-19T06:03:48.476 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /root 2024-09-19T06:03:48.476 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /tmp 2024-09-19T06:03:48.477 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-19T06:03:48.672 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T06:03:48.688 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T06:03:48.689 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:03:48.689 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T06:03:48.689 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-19T06:03:50.151 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T06:03:50.177 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T06:03:50.178 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:03:50.178 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T06:03:50.178 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T06:03:50.178 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T06:03:50.178 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-19T06:03:50.402 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T06:03:50.425 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T06:03:50.425 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:03:50.425 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T06:03:50.425 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T06:03:50.425 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T06:03:50.425 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-19T06:03:50.860 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T06:03:50.884 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T06:03:50.884 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:03:50.884 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T06:03:50.884 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T06:03:50.884 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T06:03:50.884 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-19T06:03:50.982 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T06:03:51.031 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T06:03:51.095 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T06:03:51.279 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T06:03:51.328 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T06:03:51.397 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T06:03:51.494 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T06:03:51.633 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T06:03:51.685 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T06:03:51.719 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T06:03:51.719 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /sys 2024-09-19T06:03:51.719 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /proc 2024-09-19T06:03:51.719 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /mnt 2024-09-19T06:03:51.719 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /var/tmp 2024-09-19T06:03:51.719 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /home 2024-09-19T06:03:51.719 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /root 2024-09-19T06:03:51.719 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /tmp 2024-09-19T06:03:51.720 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:03:51.720 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T06:03:51.747 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T06:03:51.904 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T06:03:51.922 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T06:03:51.922 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:03:51.922 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T06:03:51.923 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:03:52.108 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T06:03:52.138 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T06:03:52.170 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T06:03:52.232 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T06:03:52.261 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T06:03:53.303 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T06:03:53.339 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T06:03:53.458 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T06:03:53.486 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T06:03:53.487 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:03:53.487 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T06:03:53.487 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T06:03:53.487 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T06:03:53.487 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:03:53.725 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T06:03:53.750 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T06:03:53.750 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:03:53.750 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T06:03:53.750 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T06:03:53.750 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T06:03:53.750 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:03:54.217 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T06:03:54.243 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T06:03:54.243 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:03:54.243 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T06:03:54.243 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T06:03:54.243 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T06:03:54.243 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:03:54.296 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T06:03:54.322 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T06:03:54.356 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T06:03:54.415 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T06:03:54.426 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T06:03:54.478 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T06:03:54.593 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T06:03:54.625 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T06:03:54.649 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T06:03:54.649 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:03:54.649 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T06:03:54.649 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T06:03:54.649 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T06:03:54.649 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-19T06:03:54.672 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T06:03:54.709 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T06:03:54.721 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T06:03:54.727 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T06:03:54.809 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T06:03:54.822 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T06:03:54.877 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T06:03:54.905 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T06:03:55.051 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T06:03:55.110 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T06:03:55.142 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T06:03:55.169 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T06:03:55.642 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T06:03:55.668 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T06:03:55.700 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T06:03:55.765 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T06:03:55.790 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T06:03:55.794 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T06:03:55.828 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T06:03:55.852 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T06:03:55.853 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:03:55.853 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T06:03:55.853 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T06:03:55.853 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T06:03:55.853 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-19T06:03:55.904 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T06:03:55.927 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T06:03:55.928 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:03:55.928 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T06:03:55.928 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-19T06:03:55.972 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T06:03:55.994 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T06:03:55.995 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:03:55.995 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T06:03:55.995 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T06:03:55.995 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T06:03:55.995 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-19T06:03:56.306 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T06:03:56.329 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T06:03:56.329 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:03:56.329 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T06:03:56.330 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T06:03:56.330 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T06:03:56.330 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-19T06:03:56.905 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T06:03:56.934 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T06:03:57.951 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T06:03:57.976 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T06:03:58.087 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T06:03:58.254 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T06:03:58.286 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T06:03:58.312 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T06:03:58.312 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:03:58.312 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T06:03:58.312 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T06:03:58.312 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T06:03:58.312 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:03:58.362 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T06:03:58.375 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T06:03:58.476 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T06:03:58.531 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T06:03:59.506 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T06:03:59.539 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T06:03:59.565 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T06:03:59.565 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:03:59.565 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T06:03:59.565 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T06:03:59.565 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T06:03:59.565 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:03:59.608 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T06:03:59.632 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T06:03:59.632 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:03:59.632 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T06:03:59.632 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:03:59.682 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T06:03:59.707 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T06:03:59.708 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:03:59.708 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T06:03:59.708 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T06:03:59.708 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T06:03:59.708 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:04:00.025 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T06:04:00.049 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T06:04:00.049 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:04:00.050 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T06:04:00.050 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T06:04:00.050 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T06:04:00.050 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:04:00.677 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T06:04:00.677 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /sys 2024-09-19T06:04:00.678 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /proc 2024-09-19T06:04:00.678 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /mnt 2024-09-19T06:04:00.678 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /var/tmp 2024-09-19T06:04:00.678 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /home 2024-09-19T06:04:00.678 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /root 2024-09-19T06:04:00.678 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /tmp 2024-09-19T06:04:00.678 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-19T06:04:00.860 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T06:04:00.868 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T06:04:00.879 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T06:04:00.879 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:04:00.879 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T06:04:00.879 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-19T06:04:00.918 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T06:04:00.967 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T06:04:01.000 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T06:04:01.027 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T06:04:01.224 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T06:04:01.283 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T06:04:01.313 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T06:04:01.343 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T06:04:01.389 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T06:04:02.005 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:04:02.055 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:04:02.075 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:04:02.390 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T06:04:02.418 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T06:04:02.418 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:04:02.418 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T06:04:02.418 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T06:04:02.418 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T06:04:02.418 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-19T06:04:02.650 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T06:04:02.673 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T06:04:02.674 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:04:02.674 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T06:04:02.674 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T06:04:02.674 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T06:04:02.674 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-19T06:04:02.886 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T06:04:02.977 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T06:04:03.022 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T06:04:03.108 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T06:04:03.109 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T06:04:03.132 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T06:04:03.132 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:04:03.132 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T06:04:03.132 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T06:04:03.132 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T06:04:03.133 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-19T06:04:03.139 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T06:04:03.165 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T06:04:03.199 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T06:04:03.199 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T06:04:03.239 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T06:04:03.284 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T06:04:03.284 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T06:04:03.287 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T06:04:03.351 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T06:04:03.368 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T06:04:03.393 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T06:04:03.398 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:04:03.398 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:04:03.535 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T06:04:03.569 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:04:03.570 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T06:04:03.595 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T06:04:03.654 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T06:04:03.672 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T06:04:03.726 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:04:03.761 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T06:04:03.899 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T06:04:03.964 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T06:04:04.003 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T06:04:04.031 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T06:04:04.470 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T06:04:04.498 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T06:04:04.529 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T06:04:04.592 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T06:04:04.622 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T06:04:04.879 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T06:04:04.920 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T06:04:04.961 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T06:04:04.993 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T06:04:05.020 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T06:04:05.224 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T06:04:05.275 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T06:04:05.305 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T06:04:05.335 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T06:04:05.381 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T06:04:05.664 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T06:04:05.749 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T06:04:06.045 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:04:06.086 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:04:06.108 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:04:06.710 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T06:04:06.767 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T06:04:06.869 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T06:04:07.027 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T06:04:07.039 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T06:04:07.070 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T06:04:07.094 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T06:04:07.094 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:04:07.095 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T06:04:07.095 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T06:04:07.095 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T06:04:07.095 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-19T06:04:07.116 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T06:04:07.146 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T06:04:07.158 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T06:04:07.168 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T06:04:07.255 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T06:04:07.266 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T06:04:07.294 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T06:04:07.313 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T06:04:07.336 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T06:04:07.362 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T06:04:07.362 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T06:04:07.438 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T06:04:07.438 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T06:04:07.513 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T06:04:07.539 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T06:04:07.544 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:04:07.545 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:04:07.724 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:04:07.724 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T06:04:07.816 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T06:04:07.885 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:04:08.239 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T06:04:08.282 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T06:04:08.306 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T06:04:08.307 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:04:08.307 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T06:04:08.307 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T06:04:08.307 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T06:04:08.307 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-19T06:04:08.350 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T06:04:08.373 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T06:04:08.373 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:04:08.373 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T06:04:08.373 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-19T06:04:08.427 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T06:04:08.451 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T06:04:08.451 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:04:08.451 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T06:04:08.451 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T06:04:08.451 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T06:04:08.451 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-19T06:04:08.761 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T06:04:08.785 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T06:04:08.785 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:04:08.785 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T06:04:08.785 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T06:04:08.785 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T06:04:08.785 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-19T06:04:09.649 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:04:09.649 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T06:04:09.649 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T06:04:09.649 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T06:04:09.649 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T06:04:09.649 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T06:04:09.649 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T06:04:09.650 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T06:04:09.650 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:04:09.650 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:04:09.650 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T06:04:09.650 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T06:04:09.650 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T06:04:09.650 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:04:09.650 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T06:04:09.650 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T06:04:09.650 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T06:04:09.650 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T06:04:09.650 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T06:04:09.651 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T06:04:09.651 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T06:04:09.651 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T06:04:09.651 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T06:04:09.651 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T06:04:09.651 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T06:04:09.651 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T06:04:09.651 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T06:04:09.651 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T06:04:09.651 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T06:04:09.651 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T06:04:09.651 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T06:04:09.651 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T06:04:09.652 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T06:04:09.652 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T06:04:09.652 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T06:04:09.652 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T06:04:09.652 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T06:04:09.652 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T06:04:09.652 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T06:04:09.652 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T06:04:09.652 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T06:04:09.652 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T06:04:09.652 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T06:04:09.653 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T06:04:09.653 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T06:04:09.653 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T06:04:09.653 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T06:04:09.653 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T06:04:09.653 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T06:04:09.653 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T06:04:09.653 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T06:04:09.653 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T06:04:09.653 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T06:04:09.653 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T06:04:09.653 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T06:04:09.653 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T06:04:09.654 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T06:04:09.654 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T06:04:09.654 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T06:04:09.654 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T06:04:09.654 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T06:04:09.654 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T06:04:09.654 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T06:04:09.654 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T06:04:09.654 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T06:04:09.654 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T06:04:09.654 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T06:04:09.654 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T06:04:09.655 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T06:04:09.655 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T06:04:09.655 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T06:04:09.655 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T06:04:09.655 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T06:04:09.655 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T06:04:09.655 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T06:04:09.655 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T06:04:09.655 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T06:04:09.655 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T06:04:09.655 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T06:04:09.655 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T06:04:09.656 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T06:04:09.656 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T06:04:09.656 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T06:04:09.656 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T06:04:09.656 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T06:04:09.656 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T06:04:09.656 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T06:04:09.656 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T06:04:09.656 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T06:04:09.656 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T06:04:09.656 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T06:04:09.656 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T06:04:09.657 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T06:04:09.657 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T06:04:09.657 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T06:04:09.657 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T06:04:09.657 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T06:04:09.657 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T06:04:09.657 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T06:04:09.657 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T06:04:09.657 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T06:04:09.657 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T06:04:09.657 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T06:04:09.657 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T06:04:09.657 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T06:04:09.657 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T06:04:09.658 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T06:04:09.658 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T06:04:09.658 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T06:04:09.658 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T06:04:09.658 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T06:04:09.658 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T06:04:09.658 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T06:04:09.658 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T06:04:09.658 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T06:04:09.658 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T06:04:09.658 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T06:04:09.658 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T06:04:09.659 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T06:04:09.659 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T06:04:09.659 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T06:04:09.659 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T06:04:09.659 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T06:04:09.659 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T06:04:09.659 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T06:04:09.659 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T06:04:09.659 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T06:04:09.659 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T06:04:09.659 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T06:04:09.659 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T06:04:09.660 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T06:04:09.660 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T06:04:09.660 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T06:04:09.660 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T06:04:09.660 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T06:04:09.660 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T06:04:09.660 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T06:04:09.660 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T06:04:09.660 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T06:04:09.660 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T06:04:09.660 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T06:04:09.660 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T06:04:09.661 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T06:04:09.661 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T06:04:09.661 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T06:04:09.661 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T06:04:09.661 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T06:04:09.661 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T06:04:09.661 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T06:04:09.661 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T06:04:09.661 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T06:04:09.661 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T06:04:09.661 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T06:04:09.661 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T06:04:09.661 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T06:04:09.662 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T06:04:09.662 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T06:04:09.662 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T06:04:09.662 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T06:04:09.662 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T06:04:09.662 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T06:04:09.662 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T06:04:09.662 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T06:04:09.662 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T06:04:12.281 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:04:12.281 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-19T06:04:12.281 INFO:teuthology.orchestra.run.smithi089.stdout:Upgraded: 2024-09-19T06:04:12.281 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T06:04:12.281 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T06:04:12.281 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T06:04:12.281 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T06:04:12.281 INFO:teuthology.orchestra.run.smithi089.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:12.282 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:12.282 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T06:04:12.282 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T06:04:12.282 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-19T06:04:12.282 INFO:teuthology.orchestra.run.smithi089.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T06:04:12.282 INFO:teuthology.orchestra.run.smithi089.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T06:04:12.282 INFO:teuthology.orchestra.run.smithi089.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T06:04:12.282 INFO:teuthology.orchestra.run.smithi089.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T06:04:12.282 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:12.282 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:12.282 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:12.283 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:12.283 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:04:12.283 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:12.283 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:12.283 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:12.283 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:04:12.283 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:04:12.283 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:04:12.283 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:04:12.283 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:04:12.283 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:12.283 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:12.284 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:04:12.284 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:12.284 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:12.284 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:12.284 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:04:12.284 INFO:teuthology.orchestra.run.smithi089.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:04:12.284 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:12.284 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:12.284 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:04:12.284 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T06:04:12.284 INFO:teuthology.orchestra.run.smithi089.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T06:04:12.284 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T06:04:12.285 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T06:04:12.285 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T06:04:12.285 INFO:teuthology.orchestra.run.smithi089.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T06:04:12.285 INFO:teuthology.orchestra.run.smithi089.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T06:04:12.285 INFO:teuthology.orchestra.run.smithi089.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T06:04:12.285 INFO:teuthology.orchestra.run.smithi089.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T06:04:12.285 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T06:04:12.285 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T06:04:12.285 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:12.285 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:12.285 INFO:teuthology.orchestra.run.smithi089.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:12.287 INFO:teuthology.orchestra.run.smithi089.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T06:04:12.288 INFO:teuthology.orchestra.run.smithi089.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T06:04:12.288 INFO:teuthology.orchestra.run.smithi089.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T06:04:12.288 INFO:teuthology.orchestra.run.smithi089.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T06:04:12.288 INFO:teuthology.orchestra.run.smithi089.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T06:04:12.288 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:12.288 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:12.288 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T06:04:12.288 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:12.288 INFO:teuthology.orchestra.run.smithi089.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T06:04:12.288 INFO:teuthology.orchestra.run.smithi089.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T06:04:12.288 INFO:teuthology.orchestra.run.smithi089.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T06:04:12.288 INFO:teuthology.orchestra.run.smithi089.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T06:04:12.289 INFO:teuthology.orchestra.run.smithi089.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T06:04:12.289 INFO:teuthology.orchestra.run.smithi089.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T06:04:12.289 INFO:teuthology.orchestra.run.smithi089.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T06:04:12.289 INFO:teuthology.orchestra.run.smithi089.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T06:04:12.289 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T06:04:12.289 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T06:04:12.289 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T06:04:12.289 INFO:teuthology.orchestra.run.smithi089.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T06:04:12.289 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T06:04:12.289 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T06:04:12.289 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T06:04:12.289 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T06:04:12.290 INFO:teuthology.orchestra.run.smithi089.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T06:04:12.290 INFO:teuthology.orchestra.run.smithi089.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T06:04:12.290 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T06:04:12.290 INFO:teuthology.orchestra.run.smithi089.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T06:04:12.290 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T06:04:12.290 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T06:04:12.290 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T06:04:12.290 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:12.290 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:12.290 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:12.290 INFO:teuthology.orchestra.run.smithi089.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T06:04:12.290 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T06:04:12.291 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T06:04:12.291 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T06:04:12.291 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T06:04:12.291 INFO:teuthology.orchestra.run.smithi089.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T06:04:12.291 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T06:04:12.291 INFO:teuthology.orchestra.run.smithi089.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T06:04:12.291 INFO:teuthology.orchestra.run.smithi089.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T06:04:12.291 INFO:teuthology.orchestra.run.smithi089.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T06:04:12.291 INFO:teuthology.orchestra.run.smithi089.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T06:04:12.291 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T06:04:12.291 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T06:04:12.291 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T06:04:12.291 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T06:04:12.292 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T06:04:12.292 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T06:04:12.292 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T06:04:12.292 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T06:04:12.292 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T06:04:12.292 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T06:04:12.292 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T06:04:12.292 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T06:04:12.292 INFO:teuthology.orchestra.run.smithi089.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T06:04:12.292 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T06:04:12.292 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T06:04:12.292 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T06:04:12.293 INFO:teuthology.orchestra.run.smithi089.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T06:04:12.293 INFO:teuthology.orchestra.run.smithi089.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T06:04:12.293 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T06:04:12.293 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T06:04:12.293 INFO:teuthology.orchestra.run.smithi089.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T06:04:12.293 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T06:04:12.293 INFO:teuthology.orchestra.run.smithi089.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T06:04:12.293 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T06:04:12.293 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T06:04:12.293 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T06:04:12.293 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T06:04:12.293 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T06:04:12.294 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T06:04:12.294 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:12.294 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:12.294 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T06:04:12.294 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T06:04:12.294 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T06:04:12.294 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:12.294 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T06:04:12.294 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T06:04:12.294 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T06:04:12.294 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T06:04:12.294 INFO:teuthology.orchestra.run.smithi089.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T06:04:12.294 INFO:teuthology.orchestra.run.smithi089.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T06:04:12.295 INFO:teuthology.orchestra.run.smithi089.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T06:04:12.295 INFO:teuthology.orchestra.run.smithi089.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T06:04:12.295 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T06:04:12.295 INFO:teuthology.orchestra.run.smithi089.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T06:04:12.295 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T06:04:12.295 INFO:teuthology.orchestra.run.smithi089.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T06:04:12.295 INFO:teuthology.orchestra.run.smithi089.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T06:04:12.295 INFO:teuthology.orchestra.run.smithi089.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T06:04:12.295 INFO:teuthology.orchestra.run.smithi089.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T06:04:12.295 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:12.295 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:12.295 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:12.295 INFO:teuthology.orchestra.run.smithi089.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T06:04:12.296 INFO:teuthology.orchestra.run.smithi089.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T06:04:12.296 INFO:teuthology.orchestra.run.smithi089.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T06:04:12.296 INFO:teuthology.orchestra.run.smithi089.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T06:04:12.296 INFO:teuthology.orchestra.run.smithi089.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T06:04:12.296 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T06:04:12.296 INFO:teuthology.orchestra.run.smithi089.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T06:04:12.296 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-19T06:04:12.296 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-19T06:04:12.720 DEBUG:teuthology.parallel:result is None 2024-09-19T06:04:13.391 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T06:04:13.432 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T06:04:13.481 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T06:04:13.515 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T06:04:13.551 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T06:04:13.578 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:04:13.578 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T06:04:13.578 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T06:04:13.578 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T06:04:13.578 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T06:04:13.578 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T06:04:13.578 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T06:04:13.579 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T06:04:13.579 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:04:13.579 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:04:13.579 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T06:04:13.579 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T06:04:13.579 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T06:04:13.579 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:04:13.579 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T06:04:13.579 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T06:04:13.579 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T06:04:13.579 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T06:04:13.579 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T06:04:13.579 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T06:04:13.580 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T06:04:13.580 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T06:04:13.580 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T06:04:13.580 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T06:04:13.580 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T06:04:13.580 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T06:04:13.580 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T06:04:13.580 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T06:04:13.580 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T06:04:13.592 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T06:04:13.592 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T06:04:13.592 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T06:04:13.593 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T06:04:13.593 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T06:04:13.593 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T06:04:13.593 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T06:04:13.593 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T06:04:13.593 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T06:04:13.593 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T06:04:13.593 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T06:04:13.593 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T06:04:13.593 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T06:04:13.593 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T06:04:13.593 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T06:04:13.594 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T06:04:13.594 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T06:04:13.594 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T06:04:13.594 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T06:04:13.594 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T06:04:13.594 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T06:04:13.594 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T06:04:13.594 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T06:04:13.594 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T06:04:13.594 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T06:04:13.594 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T06:04:13.594 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T06:04:13.595 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T06:04:13.595 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T06:04:13.595 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T06:04:13.595 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T06:04:13.595 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T06:04:13.595 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T06:04:13.595 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T06:04:13.595 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T06:04:13.595 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T06:04:13.595 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T06:04:13.595 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T06:04:13.595 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T06:04:13.596 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T06:04:13.596 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T06:04:13.596 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T06:04:13.596 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T06:04:13.596 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T06:04:13.596 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T06:04:13.596 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T06:04:13.596 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T06:04:13.597 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T06:04:13.597 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T06:04:13.597 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T06:04:13.597 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T06:04:13.597 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T06:04:13.597 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T06:04:13.597 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T06:04:13.597 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T06:04:13.597 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T06:04:13.597 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T06:04:13.597 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T06:04:13.597 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T06:04:13.597 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T06:04:13.598 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T06:04:13.598 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T06:04:13.598 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T06:04:13.598 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T06:04:13.598 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T06:04:13.598 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T06:04:13.598 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T06:04:13.598 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T06:04:13.598 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T06:04:13.598 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T06:04:13.598 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T06:04:13.598 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T06:04:13.598 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T06:04:13.599 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T06:04:13.599 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T06:04:13.599 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T06:04:13.599 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T06:04:13.599 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T06:04:13.599 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T06:04:13.599 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T06:04:13.599 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T06:04:13.599 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T06:04:13.599 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T06:04:13.599 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T06:04:13.599 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T06:04:13.599 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T06:04:13.600 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T06:04:13.600 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T06:04:13.600 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T06:04:13.600 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T06:04:13.600 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T06:04:13.600 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T06:04:13.600 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T06:04:13.600 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T06:04:13.600 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T06:04:13.600 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T06:04:13.600 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T06:04:13.600 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T06:04:13.600 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T06:04:13.601 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T06:04:13.601 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T06:04:13.601 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T06:04:13.601 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T06:04:13.601 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T06:04:13.601 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T06:04:13.601 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T06:04:13.601 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T06:04:13.601 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T06:04:13.601 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T06:04:13.601 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T06:04:13.601 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T06:04:13.601 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T06:04:13.602 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T06:04:13.602 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T06:04:13.602 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T06:04:13.602 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T06:04:13.602 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T06:04:13.602 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T06:04:13.602 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T06:04:13.602 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T06:04:13.602 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T06:04:13.602 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T06:04:13.602 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T06:04:13.602 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T06:04:13.602 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T06:04:13.602 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T06:04:13.603 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T06:04:13.603 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T06:04:13.603 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T06:04:13.603 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T06:04:13.603 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T06:04:13.603 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T06:04:13.603 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T06:04:13.603 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T06:04:13.603 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T06:04:13.744 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T06:04:13.798 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T06:04:13.829 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T06:04:13.860 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T06:04:13.915 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T06:04:14.544 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:04:14.599 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:04:14.619 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:04:15.449 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T06:04:15.549 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T06:04:15.604 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T06:04:15.699 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T06:04:15.729 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T06:04:15.758 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T06:04:15.797 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T06:04:15.797 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T06:04:15.898 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T06:04:15.898 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T06:04:15.991 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T06:04:16.024 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T06:04:16.030 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:04:16.030 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:04:16.211 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:04:16.211 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T06:04:16.295 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T06:04:16.368 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:04:16.626 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:04:16.626 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:04:16.626 INFO:teuthology.orchestra.run.smithi002.stdout:Upgraded: 2024-09-19T06:04:16.626 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T06:04:16.626 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T06:04:16.626 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T06:04:16.627 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T06:04:16.627 INFO:teuthology.orchestra.run.smithi002.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:16.627 INFO:teuthology.orchestra.run.smithi002.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:16.627 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T06:04:16.627 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T06:04:16.627 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-19T06:04:16.627 INFO:teuthology.orchestra.run.smithi002.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T06:04:16.627 INFO:teuthology.orchestra.run.smithi002.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T06:04:16.627 INFO:teuthology.orchestra.run.smithi002.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T06:04:16.627 INFO:teuthology.orchestra.run.smithi002.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T06:04:16.627 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:16.627 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:16.627 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:16.628 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:16.628 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:04:16.628 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:16.628 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:16.628 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:16.628 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:04:16.628 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:04:16.628 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:04:16.628 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:04:16.628 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:04:16.628 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:16.628 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:16.629 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:04:16.629 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:16.629 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:16.629 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:16.629 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:04:16.629 INFO:teuthology.orchestra.run.smithi002.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:04:16.629 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:16.629 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:16.629 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:04:16.629 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T06:04:16.629 INFO:teuthology.orchestra.run.smithi002.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T06:04:16.629 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T06:04:16.630 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T06:04:16.630 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T06:04:16.630 INFO:teuthology.orchestra.run.smithi002.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T06:04:16.630 INFO:teuthology.orchestra.run.smithi002.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T06:04:16.630 INFO:teuthology.orchestra.run.smithi002.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T06:04:16.630 INFO:teuthology.orchestra.run.smithi002.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T06:04:16.630 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T06:04:16.630 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T06:04:16.630 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:16.630 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:16.630 INFO:teuthology.orchestra.run.smithi002.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:16.630 INFO:teuthology.orchestra.run.smithi002.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T06:04:16.631 INFO:teuthology.orchestra.run.smithi002.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T06:04:16.631 INFO:teuthology.orchestra.run.smithi002.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T06:04:16.631 INFO:teuthology.orchestra.run.smithi002.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T06:04:16.631 INFO:teuthology.orchestra.run.smithi002.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T06:04:16.631 INFO:teuthology.orchestra.run.smithi002.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:16.631 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:16.631 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T06:04:16.631 INFO:teuthology.orchestra.run.smithi002.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:16.631 INFO:teuthology.orchestra.run.smithi002.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T06:04:16.631 INFO:teuthology.orchestra.run.smithi002.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T06:04:16.631 INFO:teuthology.orchestra.run.smithi002.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T06:04:16.631 INFO:teuthology.orchestra.run.smithi002.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T06:04:16.632 INFO:teuthology.orchestra.run.smithi002.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T06:04:16.632 INFO:teuthology.orchestra.run.smithi002.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T06:04:16.632 INFO:teuthology.orchestra.run.smithi002.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T06:04:16.632 INFO:teuthology.orchestra.run.smithi002.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T06:04:16.632 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T06:04:16.632 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T06:04:16.632 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T06:04:16.632 INFO:teuthology.orchestra.run.smithi002.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T06:04:16.632 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T06:04:16.632 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T06:04:16.632 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T06:04:16.632 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T06:04:16.632 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T06:04:16.633 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T06:04:16.633 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T06:04:16.633 INFO:teuthology.orchestra.run.smithi002.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T06:04:16.633 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T06:04:16.633 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T06:04:16.633 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T06:04:16.633 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:16.633 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:16.633 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:16.633 INFO:teuthology.orchestra.run.smithi002.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T06:04:16.633 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T06:04:16.633 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T06:04:16.634 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T06:04:16.634 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T06:04:16.634 INFO:teuthology.orchestra.run.smithi002.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T06:04:16.634 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T06:04:16.634 INFO:teuthology.orchestra.run.smithi002.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T06:04:16.634 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T06:04:16.634 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T06:04:16.634 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T06:04:16.634 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T06:04:16.634 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T06:04:16.634 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T06:04:16.634 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T06:04:16.634 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T06:04:16.635 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T06:04:16.635 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T06:04:16.635 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T06:04:16.635 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T06:04:16.635 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T06:04:16.635 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T06:04:16.635 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T06:04:16.635 INFO:teuthology.orchestra.run.smithi002.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T06:04:16.635 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T06:04:16.635 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T06:04:16.635 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T06:04:16.635 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T06:04:16.635 INFO:teuthology.orchestra.run.smithi002.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T06:04:16.636 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T06:04:16.636 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T06:04:16.636 INFO:teuthology.orchestra.run.smithi002.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T06:04:16.636 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T06:04:16.636 INFO:teuthology.orchestra.run.smithi002.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T06:04:16.636 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T06:04:16.636 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T06:04:16.636 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T06:04:16.636 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T06:04:16.636 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T06:04:16.636 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T06:04:16.636 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:16.636 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:16.637 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T06:04:16.637 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T06:04:16.637 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T06:04:16.637 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:16.637 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T06:04:16.637 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T06:04:16.637 INFO:teuthology.orchestra.run.smithi002.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T06:04:16.637 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T06:04:16.637 INFO:teuthology.orchestra.run.smithi002.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T06:04:16.637 INFO:teuthology.orchestra.run.smithi002.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T06:04:16.637 INFO:teuthology.orchestra.run.smithi002.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T06:04:16.637 INFO:teuthology.orchestra.run.smithi002.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T06:04:16.637 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T06:04:16.638 INFO:teuthology.orchestra.run.smithi002.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T06:04:16.638 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T06:04:16.638 INFO:teuthology.orchestra.run.smithi002.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T06:04:16.638 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T06:04:16.638 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T06:04:16.638 INFO:teuthology.orchestra.run.smithi002.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T06:04:16.638 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:16.638 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:16.638 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:16.638 INFO:teuthology.orchestra.run.smithi002.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T06:04:16.638 INFO:teuthology.orchestra.run.smithi002.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T06:04:16.638 INFO:teuthology.orchestra.run.smithi002.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T06:04:16.639 INFO:teuthology.orchestra.run.smithi002.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T06:04:16.639 INFO:teuthology.orchestra.run.smithi002.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T06:04:16.639 INFO:teuthology.orchestra.run.smithi002.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T06:04:16.639 INFO:teuthology.orchestra.run.smithi002.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T06:04:16.639 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:04:16.639 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-19T06:04:17.232 DEBUG:teuthology.parallel:result is None 2024-09-19T06:04:24.022 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:04:24.022 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T06:04:24.022 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T06:04:24.022 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T06:04:24.022 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T06:04:24.022 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T06:04:24.023 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T06:04:24.023 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T06:04:24.023 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:04:24.023 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:04:24.023 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T06:04:24.023 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T06:04:24.023 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T06:04:24.023 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:04:24.023 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T06:04:24.023 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T06:04:24.023 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T06:04:24.023 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T06:04:24.024 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T06:04:24.024 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T06:04:24.024 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T06:04:24.024 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T06:04:24.024 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T06:04:24.024 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T06:04:24.024 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T06:04:24.024 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T06:04:24.024 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T06:04:24.024 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T06:04:24.024 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T06:04:24.024 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T06:04:24.037 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T06:04:24.037 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T06:04:24.037 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T06:04:24.038 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T06:04:24.038 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T06:04:24.038 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T06:04:24.038 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T06:04:24.038 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T06:04:24.038 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T06:04:24.038 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T06:04:24.038 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T06:04:24.038 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T06:04:24.038 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T06:04:24.038 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T06:04:24.038 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T06:04:24.039 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T06:04:24.039 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T06:04:24.039 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T06:04:24.039 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T06:04:24.039 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T06:04:24.039 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T06:04:24.039 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T06:04:24.039 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T06:04:24.039 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T06:04:24.039 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T06:04:24.039 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T06:04:24.039 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T06:04:24.039 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T06:04:24.040 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T06:04:24.040 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T06:04:24.040 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T06:04:24.040 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T06:04:24.040 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T06:04:24.040 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T06:04:24.040 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T06:04:24.040 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T06:04:24.040 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T06:04:24.040 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T06:04:24.040 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T06:04:24.040 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T06:04:24.041 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T06:04:24.041 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T06:04:24.041 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T06:04:24.041 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T06:04:24.041 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T06:04:24.041 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T06:04:24.041 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T06:04:24.041 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T06:04:24.041 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T06:04:24.041 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T06:04:24.041 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T06:04:24.041 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T06:04:24.041 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T06:04:24.042 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T06:04:24.042 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T06:04:24.042 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T06:04:24.042 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T06:04:24.042 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T06:04:24.042 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T06:04:24.042 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T06:04:24.042 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T06:04:24.042 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T06:04:24.042 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T06:04:24.042 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T06:04:24.042 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T06:04:24.042 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T06:04:24.043 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T06:04:24.043 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T06:04:24.043 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T06:04:24.043 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T06:04:24.043 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T06:04:24.043 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T06:04:24.043 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T06:04:24.043 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T06:04:24.043 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T06:04:24.043 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T06:04:24.043 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T06:04:24.043 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T06:04:24.044 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T06:04:24.044 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T06:04:24.044 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T06:04:24.044 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T06:04:24.044 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T06:04:24.044 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T06:04:24.044 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T06:04:24.044 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T06:04:24.044 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T06:04:24.044 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T06:04:24.044 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T06:04:24.044 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T06:04:24.045 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T06:04:24.045 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T06:04:24.045 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T06:04:24.045 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T06:04:24.045 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T06:04:24.045 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T06:04:24.045 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T06:04:24.045 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T06:04:24.045 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T06:04:24.045 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T06:04:24.045 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T06:04:24.045 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T06:04:24.045 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T06:04:24.046 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T06:04:24.046 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T06:04:24.046 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T06:04:24.046 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T06:04:24.046 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T06:04:24.046 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T06:04:24.046 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T06:04:24.046 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T06:04:24.046 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T06:04:24.046 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T06:04:24.046 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T06:04:24.046 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T06:04:24.047 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T06:04:24.047 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T06:04:24.047 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T06:04:24.047 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T06:04:24.047 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T06:04:24.047 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T06:04:24.047 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T06:04:24.047 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T06:04:24.047 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T06:04:24.047 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T06:04:24.047 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T06:04:24.047 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T06:04:24.047 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T06:04:24.048 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T06:04:24.048 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T06:04:24.048 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T06:04:24.048 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T06:04:24.048 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T06:04:24.048 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T06:04:26.283 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:04:26.283 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-19T06:04:26.283 INFO:teuthology.orchestra.run.smithi090.stdout:Upgraded: 2024-09-19T06:04:26.283 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T06:04:26.283 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T06:04:26.283 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T06:04:26.284 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T06:04:26.284 INFO:teuthology.orchestra.run.smithi090.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:26.284 INFO:teuthology.orchestra.run.smithi090.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:26.284 INFO:teuthology.orchestra.run.smithi090.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T06:04:26.284 INFO:teuthology.orchestra.run.smithi090.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T06:04:26.284 INFO:teuthology.orchestra.run.smithi090.stdout:Installed: 2024-09-19T06:04:26.284 INFO:teuthology.orchestra.run.smithi090.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T06:04:26.284 INFO:teuthology.orchestra.run.smithi090.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T06:04:26.285 INFO:teuthology.orchestra.run.smithi090.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T06:04:26.285 INFO:teuthology.orchestra.run.smithi090.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T06:04:26.285 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:26.285 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:26.285 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:26.285 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:26.285 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:04:26.285 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:26.285 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:26.285 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:26.285 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:04:26.285 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:04:26.285 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:04:26.286 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:04:26.286 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:04:26.286 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:26.286 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:26.286 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:04:26.286 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:26.286 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:26.286 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:26.286 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:04:26.286 INFO:teuthology.orchestra.run.smithi090.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:04:26.286 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:26.286 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:26.287 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:04:26.287 INFO:teuthology.orchestra.run.smithi090.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T06:04:26.287 INFO:teuthology.orchestra.run.smithi090.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T06:04:26.287 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T06:04:26.287 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T06:04:26.287 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T06:04:26.287 INFO:teuthology.orchestra.run.smithi090.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T06:04:26.287 INFO:teuthology.orchestra.run.smithi090.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T06:04:26.287 INFO:teuthology.orchestra.run.smithi090.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T06:04:26.287 INFO:teuthology.orchestra.run.smithi090.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T06:04:26.287 INFO:teuthology.orchestra.run.smithi090.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T06:04:26.287 INFO:teuthology.orchestra.run.smithi090.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T06:04:26.287 INFO:teuthology.orchestra.run.smithi090.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:26.288 INFO:teuthology.orchestra.run.smithi090.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:26.288 INFO:teuthology.orchestra.run.smithi090.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:26.288 INFO:teuthology.orchestra.run.smithi090.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T06:04:26.288 INFO:teuthology.orchestra.run.smithi090.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T06:04:26.288 INFO:teuthology.orchestra.run.smithi090.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T06:04:26.288 INFO:teuthology.orchestra.run.smithi090.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T06:04:26.288 INFO:teuthology.orchestra.run.smithi090.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T06:04:26.288 INFO:teuthology.orchestra.run.smithi090.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:26.288 INFO:teuthology.orchestra.run.smithi090.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:26.288 INFO:teuthology.orchestra.run.smithi090.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T06:04:26.288 INFO:teuthology.orchestra.run.smithi090.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:26.288 INFO:teuthology.orchestra.run.smithi090.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T06:04:26.289 INFO:teuthology.orchestra.run.smithi090.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T06:04:26.289 INFO:teuthology.orchestra.run.smithi090.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T06:04:26.289 INFO:teuthology.orchestra.run.smithi090.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T06:04:26.289 INFO:teuthology.orchestra.run.smithi090.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T06:04:26.289 INFO:teuthology.orchestra.run.smithi090.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T06:04:26.289 INFO:teuthology.orchestra.run.smithi090.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T06:04:26.289 INFO:teuthology.orchestra.run.smithi090.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T06:04:26.289 INFO:teuthology.orchestra.run.smithi090.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T06:04:26.289 INFO:teuthology.orchestra.run.smithi090.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T06:04:26.289 INFO:teuthology.orchestra.run.smithi090.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T06:04:26.289 INFO:teuthology.orchestra.run.smithi090.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T06:04:26.289 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T06:04:26.290 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T06:04:26.290 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T06:04:26.290 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T06:04:26.290 INFO:teuthology.orchestra.run.smithi090.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T06:04:26.290 INFO:teuthology.orchestra.run.smithi090.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T06:04:26.290 INFO:teuthology.orchestra.run.smithi090.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T06:04:26.290 INFO:teuthology.orchestra.run.smithi090.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T06:04:26.290 INFO:teuthology.orchestra.run.smithi090.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T06:04:26.290 INFO:teuthology.orchestra.run.smithi090.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T06:04:26.290 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T06:04:26.290 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:26.290 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:26.290 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:26.291 INFO:teuthology.orchestra.run.smithi090.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T06:04:26.291 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T06:04:26.291 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T06:04:26.291 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T06:04:26.291 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T06:04:26.291 INFO:teuthology.orchestra.run.smithi090.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T06:04:26.291 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T06:04:26.291 INFO:teuthology.orchestra.run.smithi090.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T06:04:26.291 INFO:teuthology.orchestra.run.smithi090.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T06:04:26.291 INFO:teuthology.orchestra.run.smithi090.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T06:04:26.291 INFO:teuthology.orchestra.run.smithi090.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T06:04:26.291 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T06:04:26.292 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T06:04:26.292 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T06:04:26.292 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T06:04:26.292 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T06:04:26.292 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T06:04:26.292 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T06:04:26.292 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T06:04:26.292 INFO:teuthology.orchestra.run.smithi090.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T06:04:26.292 INFO:teuthology.orchestra.run.smithi090.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T06:04:26.292 INFO:teuthology.orchestra.run.smithi090.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T06:04:26.292 INFO:teuthology.orchestra.run.smithi090.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T06:04:26.292 INFO:teuthology.orchestra.run.smithi090.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T06:04:26.293 INFO:teuthology.orchestra.run.smithi090.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T06:04:26.293 INFO:teuthology.orchestra.run.smithi090.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T06:04:26.293 INFO:teuthology.orchestra.run.smithi090.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T06:04:26.293 INFO:teuthology.orchestra.run.smithi090.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T06:04:26.293 INFO:teuthology.orchestra.run.smithi090.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T06:04:26.293 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T06:04:26.293 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T06:04:26.293 INFO:teuthology.orchestra.run.smithi090.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T06:04:26.293 INFO:teuthology.orchestra.run.smithi090.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T06:04:26.293 INFO:teuthology.orchestra.run.smithi090.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T06:04:26.293 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T06:04:26.293 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T06:04:26.293 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T06:04:26.294 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T06:04:26.294 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T06:04:26.294 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T06:04:26.294 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:26.294 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:26.294 INFO:teuthology.orchestra.run.smithi090.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T06:04:26.294 INFO:teuthology.orchestra.run.smithi090.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T06:04:26.294 INFO:teuthology.orchestra.run.smithi090.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T06:04:26.294 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:26.294 INFO:teuthology.orchestra.run.smithi090.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T06:04:26.294 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T06:04:26.295 INFO:teuthology.orchestra.run.smithi090.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T06:04:26.295 INFO:teuthology.orchestra.run.smithi090.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T06:04:26.295 INFO:teuthology.orchestra.run.smithi090.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T06:04:26.295 INFO:teuthology.orchestra.run.smithi090.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T06:04:26.295 INFO:teuthology.orchestra.run.smithi090.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T06:04:26.295 INFO:teuthology.orchestra.run.smithi090.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T06:04:26.295 INFO:teuthology.orchestra.run.smithi090.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T06:04:26.295 INFO:teuthology.orchestra.run.smithi090.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T06:04:26.295 INFO:teuthology.orchestra.run.smithi090.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T06:04:26.295 INFO:teuthology.orchestra.run.smithi090.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T06:04:26.295 INFO:teuthology.orchestra.run.smithi090.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T06:04:26.295 INFO:teuthology.orchestra.run.smithi090.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T06:04:26.296 INFO:teuthology.orchestra.run.smithi090.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T06:04:26.296 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:26.296 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:26.296 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:04:26.296 INFO:teuthology.orchestra.run.smithi090.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T06:04:26.296 INFO:teuthology.orchestra.run.smithi090.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T06:04:26.296 INFO:teuthology.orchestra.run.smithi090.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T06:04:26.296 INFO:teuthology.orchestra.run.smithi090.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T06:04:26.296 INFO:teuthology.orchestra.run.smithi090.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T06:04:26.296 INFO:teuthology.orchestra.run.smithi090.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T06:04:26.297 INFO:teuthology.orchestra.run.smithi090.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T06:04:26.297 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-19T06:04:26.297 INFO:teuthology.orchestra.run.smithi090.stdout:Complete! 2024-09-19T06:04:26.777 DEBUG:teuthology.parallel:result is None 2024-09-19T06:04:26.777 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:04:26.913 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T06:04:26.940 INFO:teuthology.orchestra.run.smithi002.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T06:04:26.941 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T06:04:26.941 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T06:04:26.943 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:04:27.077 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T06:04:27.104 INFO:teuthology.orchestra.run.smithi089.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T06:04:27.104 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T06:04:27.104 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T06:04:27.106 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:04:27.239 DEBUG:teuthology.orchestra.run.smithi090:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T06:04:27.264 INFO:teuthology.orchestra.run.smithi090.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T06:04:27.264 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T06:04:27.264 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T06:04:27.266 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-19T06:04:27.266 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-19T06:04:27.266 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T06:04:27.299 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-19T06:04:27.299 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T06:04:27.332 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-19T06:04:27.332 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T06:04:27.362 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-19T06:04:27.363 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-19T06:04:27.363 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T06:04:27.392 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T06:04:27.461 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-19T06:04:27.461 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T06:04:27.490 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T06:04:27.556 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-19T06:04:27.557 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T06:04:27.584 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T06:04:27.650 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-19T06:04:27.650 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-19T06:04:27.650 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T06:04:27.679 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T06:04:27.747 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-19T06:04:27.747 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T06:04:27.773 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T06:04:27.836 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-19T06:04:27.837 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T06:04:27.865 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T06:04:27.931 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-19T06:04:27.932 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-19T06:04:27.932 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T06:04:27.958 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T06:04:28.025 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-19T06:04:28.025 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T06:04:28.050 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T06:04:28.114 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-19T06:04:28.115 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T06:04:28.142 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T06:04:28.209 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-19T06:04:28.316 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-19T06:04:28.316 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:04:28.317 INFO:tasks.cephadm:Cluster fsid is 078f6612-764d-11ef-bceb-c7b262605968 2024-09-19T06:04:28.317 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-19T06:04:28.317 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.2', 'mon.b': '172.21.15.89', 'mon.c': '172.21.15.90'} 2024-09-19T06:04:28.317 INFO:tasks.cephadm:First mon is mon.a on smithi002 2024-09-19T06:04:28.317 INFO:tasks.cephadm:First mgr is x 2024-09-19T06:04:28.318 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-19T06:04:28.318 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname $(hostname -s) 2024-09-19T06:04:28.344 DEBUG:teuthology.orchestra.run.smithi089:> sudo hostname $(hostname -s) 2024-09-19T06:04:28.369 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname $(hostname -s) 2024-09-19T06:04:28.398 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-19T06:04:28.398 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:04:28.541 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56106/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-361-g2f599a46', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-361.g2f599a46'}, 'url': 'https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-18 17:52:24.287651', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-19T06:04:28.676 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref squid, sha1 2f599a46ad10e37c929e5c43da2f6907ddcd1961 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:04:28.678 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T06:04:28.678 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T06:04:28.678 DEBUG:teuthology.orchestra.run.smithi002:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T06:04:29.051 INFO:teuthology.orchestra.run.smithi002.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 06:04 /home/ubuntu/cephtest/cephadm 2024-09-19T06:04:29.052 DEBUG:teuthology.orchestra.run.smithi089:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T06:04:29.421 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 06:04 /home/ubuntu/cephtest/cephadm 2024-09-19T06:04:29.421 DEBUG:teuthology.orchestra.run.smithi090:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T06:04:29.831 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 06:04 /home/ubuntu/cephtest/cephadm 2024-09-19T06:04:29.832 DEBUG:teuthology.orchestra.run.smithi002:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T06:04:29.852 DEBUG:teuthology.orchestra.run.smithi089:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T06:04:29.869 DEBUG:teuthology.orchestra.run.smithi090:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T06:04:29.904 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 on all hosts... 2024-09-19T06:04:29.904 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T06:04:29.906 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T06:04:29.910 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T06:04:31.527 INFO:teuthology.orchestra.run.smithi002.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T06:04:31.656 INFO:teuthology.orchestra.run.smithi089.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T06:04:32.349 INFO:teuthology.orchestra.run.smithi090.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T06:05:02.219 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-19T06:05:02.220 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T06:05:02.220 INFO:teuthology.orchestra.run.smithi090.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T06:05:02.220 INFO:teuthology.orchestra.run.smithi090.stdout: "repo_digests": [ 2024-09-19T06:05:02.220 INFO:teuthology.orchestra.run.smithi090.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T06:05:02.220 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-19T06:05:02.220 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-19T06:05:06.835 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-19T06:05:06.835 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T06:05:06.835 INFO:teuthology.orchestra.run.smithi089.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T06:05:06.835 INFO:teuthology.orchestra.run.smithi089.stdout: "repo_digests": [ 2024-09-19T06:05:06.835 INFO:teuthology.orchestra.run.smithi089.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T06:05:06.835 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-19T06:05:06.835 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-19T06:05:08.477 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:05:08.477 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T06:05:08.477 INFO:teuthology.orchestra.run.smithi002.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T06:05:08.477 INFO:teuthology.orchestra.run.smithi002.stdout: "repo_digests": [ 2024-09-19T06:05:08.477 INFO:teuthology.orchestra.run.smithi002.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T06:05:08.477 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-19T06:05:08.477 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:05:08.503 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /etc/ceph 2024-09-19T06:05:08.542 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /etc/ceph 2024-09-19T06:05:08.575 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /etc/ceph 2024-09-19T06:05:08.609 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 777 /etc/ceph 2024-09-19T06:05:08.635 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 777 /etc/ceph 2024-09-19T06:05:08.665 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 777 /etc/ceph 2024-09-19T06:05:08.694 INFO:tasks.cephadm:Writing seed config... 2024-09-19T06:05:08.696 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-19T06:05:08.696 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-19T06:05:08.696 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-19T06:05:08.696 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-19T06:05:08.696 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-19T06:05:08.696 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-19T06:05:08.696 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-19T06:05:08.696 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-19T06:05:08.696 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-19T06:05:08.696 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-19T06:05:08.696 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-19T06:05:08.696 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-19T06:05:08.697 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-19T06:05:08.697 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-19T06:05:08.697 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-19T06:05:08.697 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-19T06:05:08.697 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-19T06:05:08.697 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-09-19T06:05:08.697 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-19T06:05:08.697 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-19T06:05:08.697 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-19T06:05:08.697 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-19T06:05:08.697 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-09-19T06:05:08.697 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-19T06:05:08.697 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-19T06:05:08.697 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-19T06:05:08.698 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-19T06:05:08.698 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-19T06:05:08.698 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-19T06:05:08.698 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-19T06:05:08.698 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-19T06:05:08.698 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-19T06:05:08.698 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-19T06:05:08.698 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-19T06:05:08.698 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-19T06:05:08.698 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-19T06:05:08.699 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-19T06:05:08.699 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-19T06:05:08.699 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-19T06:05:08.699 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-19T06:05:08.699 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-19T06:05:08.699 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-19T06:05:08.699 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-19T06:05:08.699 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-19T06:05:08.699 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-19T06:05:08.699 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-19T06:05:08.699 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-19T06:05:08.699 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-19T06:05:08.699 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-19T06:05:08.699 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-19T06:05:08.700 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-19T06:05:08.700 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-19T06:05:08.717 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 078f6612-764d-11ef-bceb-c7b262605968 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-19T06:05:08.717 DEBUG:teuthology.orchestra.run.smithi002:mon.a> sudo journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@mon.a.service 2024-09-19T06:05:08.761 DEBUG:teuthology.orchestra.run.smithi002:mgr.x> sudo journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@mgr.x.service 2024-09-19T06:05:08.805 INFO:tasks.cephadm:Bootstrapping... 2024-09-19T06:05:08.806 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 -v bootstrap --fsid 078f6612-764d-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.2 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:05:09.017 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:05:09.017 INFO:teuthology.orchestra.run.smithi002.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961', '-v', 'bootstrap', '--fsid', '078f6612-764d-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.2', '--skip-admin-label'] 2024-09-19T06:05:09.018 INFO:teuthology.orchestra.run.smithi002.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-19T06:05:09.018 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying podman|docker is present... 2024-09-19T06:05:09.042 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stdout 5.2.2 2024-09-19T06:05:09.042 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying lvm2 is present... 2024-09-19T06:05:09.042 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying time synchronization is in place... 2024-09-19T06:05:09.050 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T06:05:09.050 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T06:05:09.056 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T06:05:09.056 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-19T06:05:09.063 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout enabled 2024-09-19T06:05:09.069 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout active 2024-09-19T06:05:09.070 INFO:teuthology.orchestra.run.smithi002.stdout:Unit chronyd.service is enabled and running 2024-09-19T06:05:09.070 INFO:teuthology.orchestra.run.smithi002.stdout:Repeating the final host check... 2024-09-19T06:05:09.092 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stdout 5.2.2 2024-09-19T06:05:09.092 INFO:teuthology.orchestra.run.smithi002.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-19T06:05:09.092 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl is present 2024-09-19T06:05:09.092 INFO:teuthology.orchestra.run.smithi002.stdout:lvcreate is present 2024-09-19T06:05:09.099 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T06:05:09.099 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T06:05:09.105 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T06:05:09.105 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-19T06:05:09.112 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout enabled 2024-09-19T06:05:09.118 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout active 2024-09-19T06:05:09.119 INFO:teuthology.orchestra.run.smithi002.stdout:Unit chronyd.service is enabled and running 2024-09-19T06:05:09.119 INFO:teuthology.orchestra.run.smithi002.stdout:Host looks OK 2024-09-19T06:05:09.119 INFO:teuthology.orchestra.run.smithi002.stdout:Cluster fsid: 078f6612-764d-11ef-bceb-c7b262605968 2024-09-19T06:05:09.119 INFO:teuthology.orchestra.run.smithi002.stdout:Acquiring lock 140480516875264 on /run/cephadm/078f6612-764d-11ef-bceb-c7b262605968.lock 2024-09-19T06:05:09.119 INFO:teuthology.orchestra.run.smithi002.stdout:Lock 140480516875264 acquired on /run/cephadm/078f6612-764d-11ef-bceb-c7b262605968.lock 2024-09-19T06:05:09.119 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying IP 172.21.15.2 port 3300 ... 2024-09-19T06:05:09.120 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying IP 172.21.15.2 port 6789 ... 2024-09-19T06:05:09.120 INFO:teuthology.orchestra.run.smithi002.stdout:Base mon IP(s) is [172.21.15.2:3300, 172.21.15.2:6789], mon addrv is [v2:172.21.15.2:3300,v1:172.21.15.2:6789] 2024-09-19T06:05:09.123 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.2 metric 100 2024-09-19T06:05:09.123 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.2 metric 100 2024-09-19T06:05:09.126 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-19T06:05:09.126 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-19T06:05:09.126 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1750sec hoplimit 64 pref medium 2024-09-19T06:05:09.128 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-19T06:05:09.128 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-19T06:05:09.128 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T06:05:09.128 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-19T06:05:09.129 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1920/64 scope link 2024-09-19T06:05:09.129 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T06:05:09.129 INFO:teuthology.orchestra.run.smithi002.stdout:Mon IP `172.21.15.2` is in CIDR network `172.21.0.0/20` 2024-09-19T06:05:09.129 INFO:teuthology.orchestra.run.smithi002.stdout:Mon IP `172.21.15.2` is in CIDR network `172.21.0.0/20` 2024-09-19T06:05:09.129 INFO:teuthology.orchestra.run.smithi002.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-19T06:05:09.130 INFO:teuthology.orchestra.run.smithi002.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-19T06:05:09.131 INFO:teuthology.orchestra.run.smithi002.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T06:05:09.605 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stdout d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T06:05:09.605 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T06:05:09.605 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Getting image source signatures 2024-09-19T06:05:09.605 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Copying blob sha256:c4221751d16d26d2a4b7031ebd71ecffffff13c8cf7401cf95ce80dab3b6d67a 2024-09-19T06:05:09.605 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-19T06:05:09.606 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Copying config sha256:d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T06:05:09.606 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-19T06:05:10.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph: stdout ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T06:05:10.475 INFO:teuthology.orchestra.run.smithi002.stdout:Ceph version: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T06:05:10.475 INFO:teuthology.orchestra.run.smithi002.stdout:Extracting ceph user uid/gid from container image... 2024-09-19T06:05:11.389 INFO:teuthology.orchestra.run.smithi002.stdout:stat: stdout 167 167 2024-09-19T06:05:11.390 INFO:teuthology.orchestra.run.smithi002.stdout:Creating initial keys... 2024-09-19T06:05:12.311 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph-authtool: stdout AQAXv+tmsayIKhAAhPudJeT1P9pQo2FMRYfc8A== 2024-09-19T06:05:13.216 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph-authtool: stdout AQAYv+tm6JXvJRAAXJwxbz2IM8CMHg/V3N9QUA== 2024-09-19T06:05:14.221 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph-authtool: stdout AQAZv+tmK5q0IxAAYFz4xAIiO6UkO1XTiU7nLA== 2024-09-19T06:05:14.222 INFO:teuthology.orchestra.run.smithi002.stdout:Creating initial monmap... 2024-09-19T06:05:15.178 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T06:05:15.178 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-19T06:05:15.178 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 078f6612-764d-11ef-bceb-c7b262605968 2024-09-19T06:05:15.178 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T06:05:15.178 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool for a [v2:172.21.15.2:3300,v1:172.21.15.2:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T06:05:15.178 INFO:teuthology.orchestra.run.smithi002.stdout:setting min_mon_release = quincy 2024-09-19T06:05:15.178 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: set fsid to 078f6612-764d-11ef-bceb-c7b262605968 2024-09-19T06:05:15.178 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T06:05:15.179 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:05:15.179 INFO:teuthology.orchestra.run.smithi002.stdout:Creating mon... 2024-09-19T06:05:16.092 INFO:teuthology.orchestra.run.smithi002.stdout:create mon.a on 2024-09-19T06:05:16.309 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-19T06:05:16.479 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-19T06:05:16.657 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-078f6612-764d-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-078f6612-764d-11ef-bceb-c7b262605968.target. 2024-09-19T06:05:16.657 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-078f6612-764d-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-078f6612-764d-11ef-bceb-c7b262605968.target. 2024-09-19T06:05:16.926 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-078f6612-764d-11ef-bceb-c7b262605968@mon.a 2024-09-19T06:05:16.926 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to reset failed state of unit ceph-078f6612-764d-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-078f6612-764d-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-19T06:05:17.109 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-078f6612-764d-11ef-bceb-c7b262605968.target.wants/ceph-078f6612-764d-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-078f6612-764d-11ef-bceb-c7b262605968@.service. 2024-09-19T06:05:17.166 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:17 smithi002 systemd[1]: Starting Ceph mon.a for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:05:17.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:17 smithi002 podman[30596]: 2024-09-19 06:05:17.261543912 +0000 UTC m=+0.022975208 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:05:17.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:17 smithi002 podman[30596]: 2024-09-19 06:05:17.365003365 +0000 UTC m=+0.126434649 container create be2f3088690ed56b9d66d194b1c31aacb25a14421af46ec29117d92838306561 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mon-a, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-19T06:05:17.657 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T06:05:17.657 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-09-19T06:05:17.664 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T06:05:17.665 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-19T06:05:17.665 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-09-19T06:05:17.665 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T06:05:17.665 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mon to start... 2024-09-19T06:05:17.665 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mon... 2024-09-19T06:05:17.735 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:17 smithi002 podman[30596]: 2024-09-19 06:05:17.567089921 +0000 UTC m=+0.328521208 container init be2f3088690ed56b9d66d194b1c31aacb25a14421af46ec29117d92838306561 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mon-a, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-19T06:05:17.735 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:17 smithi002 podman[30596]: 2024-09-19 06:05:17.570395196 +0000 UTC m=+0.331826480 container start be2f3088690ed56b9d66d194b1c31aacb25a14421af46ec29117d92838306561 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mon-a, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-19T06:05:17.735 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:17 smithi002 ceph-mon[30615]: mkfs 078f6612-764d-11ef-bceb-c7b262605968 2024-09-19T06:05:17.735 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:17 smithi002 ceph-mon[30615]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T06:05:17.735 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:17 smithi002 bash[30596]: be2f3088690ed56b9d66d194b1c31aacb25a14421af46ec29117d92838306561 2024-09-19T06:05:17.735 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:17 smithi002 systemd[1]: Started Ceph mon.a for 078f6612-764d-11ef-bceb-c7b262605968. 2024-09-19T06:05:18.775 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:18 smithi002 ceph-mon[30615]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T06:05:18.775 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:18 smithi002 ceph-mon[30615]: monmap epoch 1 2024-09-19T06:05:18.775 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:18 smithi002 ceph-mon[30615]: fsid 078f6612-764d-11ef-bceb-c7b262605968 2024-09-19T06:05:18.775 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:18 smithi002 ceph-mon[30615]: last_changed 2024-09-19T06:05:14.578448+0000 2024-09-19T06:05:18.775 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:18 smithi002 ceph-mon[30615]: created 2024-09-19T06:05:14.578448+0000 2024-09-19T06:05:18.775 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:18 smithi002 ceph-mon[30615]: min_mon_release 19 (squid) 2024-09-19T06:05:18.775 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:18 smithi002 ceph-mon[30615]: election_strategy: 1 2024-09-19T06:05:18.776 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:18 smithi002 ceph-mon[30615]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-19T06:05:18.776 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:18 smithi002 ceph-mon[30615]: fsmap 2024-09-19T06:05:18.776 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:18 smithi002 ceph-mon[30615]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T06:05:18.776 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:18 smithi002 ceph-mon[30615]: mgrmap e1: no daemons active 2024-09-19T06:05:18.776 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:18 smithi002 ceph-mon[30615]: from='client.? 172.21.15.2:0/2631227435' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-19T06:05:18.778 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout cluster: 2024-09-19T06:05:18.785 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout id: 078f6612-764d-11ef-bceb-c7b262605968 2024-09-19T06:05:18.785 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-19T06:05:18.786 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-19T06:05:18.786 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout services: 2024-09-19T06:05:18.786 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.55446s) 2024-09-19T06:05:18.786 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-19T06:05:18.786 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-19T06:05:18.786 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-19T06:05:18.786 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout data: 2024-09-19T06:05:18.786 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-19T06:05:18.786 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-19T06:05:18.786 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-19T06:05:18.786 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout pgs: 2024-09-19T06:05:18.787 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-19T06:05:18.787 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.090+0000 7fddc7909640 1 Processor -- start 2024-09-19T06:05:18.787 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.090+0000 7fddc7909640 1 -- start start 2024-09-19T06:05:18.787 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.091+0000 7fddc7909640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddc01081e0 0x7fddc010a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:18.787 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.091+0000 7fddc7909640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fddc007bdc0 con 0x7fddc01081e0 2024-09-19T06:05:18.787 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.091+0000 7fddc56a5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddc01081e0 0x7fddc010a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:18.787 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.091+0000 7fddc56a5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddc01081e0 0x7fddc010a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34656/0 (socket says 172.21.15.2:34656) 2024-09-19T06:05:18.787 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.091+0000 7fddc56a5640 1 -- 172.21.15.2:0/2848769648 learned_addr learned my addr 172.21.15.2:0/2848769648 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:05:18.787 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.091+0000 7fddc56a5640 1 -- 172.21.15.2:0/2848769648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddc010ab10 con 0x7fddc01081e0 2024-09-19T06:05:18.788 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.093+0000 7fddc56a5640 1 --2- 172.21.15.2:0/2848769648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddc01081e0 0x7fddc010a5d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fddbc009820 tx=0x7fddbc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea2448343f733d56 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:18.788 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.093+0000 7fddb7fff640 1 -- 172.21.15.2:0/2848769648 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddbc037070 con 0x7fddc01081e0 2024-09-19T06:05:18.788 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.093+0000 7fddb7fff640 1 -- 172.21.15.2:0/2848769648 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddbc032440 con 0x7fddc01081e0 2024-09-19T06:05:18.788 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.093+0000 7fddb7fff640 1 -- 172.21.15.2:0/2848769648 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddbc032740 con 0x7fddc01081e0 2024-09-19T06:05:18.788 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.094+0000 7fddc7909640 1 -- 172.21.15.2:0/2848769648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddc01081e0 msgr2=0x7fddc010a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:18.788 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.094+0000 7fddc7909640 1 --2- 172.21.15.2:0/2848769648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddc01081e0 0x7fddc010a5d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fddbc009820 tx=0x7fddbc02a270 comp rx=0 tx=0).stop 2024-09-19T06:05:18.788 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.094+0000 7fddc7909640 1 -- 172.21.15.2:0/2848769648 shutdown_connections 2024-09-19T06:05:18.788 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.094+0000 7fddc7909640 1 --2- 172.21.15.2:0/2848769648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddc01081e0 0x7fddc010a5d0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:18.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.094+0000 7fddc7909640 1 -- 172.21.15.2:0/2848769648 >> 172.21.15.2:0/2848769648 conn(0x7fddc0101d40 msgr2=0x7fddc01041c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:18.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.094+0000 7fddc7909640 1 -- 172.21.15.2:0/2848769648 shutdown_connections 2024-09-19T06:05:18.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.094+0000 7fddc7909640 1 -- 172.21.15.2:0/2848769648 wait complete. 2024-09-19T06:05:18.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.095+0000 7fddc7909640 1 Processor -- start 2024-09-19T06:05:18.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.095+0000 7fddc7909640 1 -- start start 2024-09-19T06:05:18.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.095+0000 7fddc7909640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddc01081e0 0x7fddc019ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:18.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.095+0000 7fddc7909640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fddc010af80 con 0x7fddc01081e0 2024-09-19T06:05:18.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.095+0000 7fddc56a5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddc01081e0 0x7fddc019ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:18.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.095+0000 7fddc56a5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddc01081e0 0x7fddc019ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34664/0 (socket says 172.21.15.2:34664) 2024-09-19T06:05:18.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.095+0000 7fddc56a5640 1 -- 172.21.15.2:0/2631227435 learned_addr learned my addr 172.21.15.2:0/2631227435 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:05:18.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.095+0000 7fddc56a5640 1 -- 172.21.15.2:0/2631227435 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddc019b3b0 con 0x7fddc01081e0 2024-09-19T06:05:18.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.096+0000 7fddc56a5640 1 --2- 172.21.15.2:0/2631227435 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddc01081e0 0x7fddc019ae70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fddbc0090b0 tx=0x7fddbc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:18.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.096+0000 7fddb67fc640 1 -- 172.21.15.2:0/2631227435 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddbc041070 con 0x7fddc01081e0 2024-09-19T06:05:18.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.096+0000 7fddb67fc640 1 -- 172.21.15.2:0/2631227435 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddbc03c7a0 con 0x7fddc01081e0 2024-09-19T06:05:18.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.096+0000 7fddc7909640 1 -- 172.21.15.2:0/2631227435 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddc019b640 con 0x7fddc01081e0 2024-09-19T06:05:18.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.096+0000 7fddb67fc640 1 -- 172.21.15.2:0/2631227435 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddbc037040 con 0x7fddc01081e0 2024-09-19T06:05:18.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.096+0000 7fddc7909640 1 -- 172.21.15.2:0/2631227435 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddc019e330 con 0x7fddc01081e0 2024-09-19T06:05:18.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.096+0000 7fddb67fc640 1 -- 172.21.15.2:0/2631227435 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fddbc044070 con 0x7fddc01081e0 2024-09-19T06:05:18.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.096+0000 7fddb67fc640 1 -- 172.21.15.2:0/2631227435 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fddbc03d3f0 con 0x7fddc01081e0 2024-09-19T06:05:18.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.097+0000 7fddc7909640 1 -- 172.21.15.2:0/2631227435 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddc0108640 con 0x7fddc01081e0 2024-09-19T06:05:18.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.099+0000 7fddb67fc640 1 -- 172.21.15.2:0/2631227435 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fddbc046450 con 0x7fddc01081e0 2024-09-19T06:05:18.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.160+0000 7fddc7909640 1 -- 172.21.15.2:0/2631227435 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fddc002d910 con 0x7fddc01081e0 2024-09-19T06:05:18.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.160+0000 7fddb67fc640 1 -- 172.21.15.2:0/2631227435 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+316 (secure 0 0 0) 0x7fddbc046630 con 0x7fddc01081e0 2024-09-19T06:05:18.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.161+0000 7fddc7909640 1 -- 172.21.15.2:0/2631227435 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddc01081e0 msgr2=0x7fddc019ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:18.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.161+0000 7fddc7909640 1 --2- 172.21.15.2:0/2631227435 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddc01081e0 0x7fddc019ae70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fddbc0090b0 tx=0x7fddbc0046c0 comp rx=0 tx=0).stop 2024-09-19T06:05:18.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.161+0000 7fddc7909640 1 -- 172.21.15.2:0/2631227435 shutdown_connections 2024-09-19T06:05:18.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.161+0000 7fddc7909640 1 --2- 172.21.15.2:0/2631227435 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddc01081e0 0x7fddc019ae70 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:18.792 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.161+0000 7fddc7909640 1 -- 172.21.15.2:0/2631227435 >> 172.21.15.2:0/2631227435 conn(0x7fddc0101d40 msgr2=0x7fddc0102d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:18.792 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.161+0000 7fddc7909640 1 -- 172.21.15.2:0/2631227435 shutdown_connections 2024-09-19T06:05:18.792 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:18.161+0000 7fddc7909640 1 -- 172.21.15.2:0/2631227435 wait complete. 2024-09-19T06:05:18.792 INFO:teuthology.orchestra.run.smithi002.stdout:mon is available 2024-09-19T06:05:18.792 INFO:teuthology.orchestra.run.smithi002.stdout:Assimilating anything we can from ceph.conf... 2024-09-19T06:05:19.833 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:19 smithi002 ceph-mon[30615]: from='client.? 172.21.15.2:0/406110981' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T06:05:19.833 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:19 smithi002 ceph-mon[30615]: from='client.? 172.21.15.2:0/406110981' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-19T06:05:19.841 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-19T06:05:19.841 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T06:05:19.841 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout fsid = 078f6612-764d-11ef-bceb-c7b262605968 2024-09-19T06:05:19.841 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.2:3300,v1:172.21.15.2:6789] 2024-09-19T06:05:19.841 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T06:05:19.841 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T06:05:19.842 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T06:05:19.842 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T06:05:19.842 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-19T06:05:19.842 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T06:05:19.842 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T06:05:19.842 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-19T06:05:19.842 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T06:05:19.842 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T06:05:19.842 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T06:05:19.842 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T06:05:19.842 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T06:05:19.843 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T06:05:19.843 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.179+0000 7fb0b3176640 1 Processor -- start 2024-09-19T06:05:19.843 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.179+0000 7fb0b3176640 1 -- start start 2024-09-19T06:05:19.843 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.179+0000 7fb0b3176640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0ac1077b0 0x7fb0ac107bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:19.843 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.179+0000 7fb0b3176640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ac108180 con 0x7fb0ac1077b0 2024-09-19T06:05:19.843 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.179+0000 7fb0b0f12640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0ac1077b0 0x7fb0ac107bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:19.843 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.179+0000 7fb0b0f12640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0ac1077b0 0x7fb0ac107bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34666/0 (socket says 172.21.15.2:34666) 2024-09-19T06:05:19.843 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.179+0000 7fb0b0f12640 1 -- 172.21.15.2:0/3490536636 learned_addr learned my addr 172.21.15.2:0/3490536636 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:05:19.843 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.180+0000 7fb0b0f12640 1 -- 172.21.15.2:0/3490536636 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0ac108910 con 0x7fb0ac1077b0 2024-09-19T06:05:19.843 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.180+0000 7fb0b0f12640 1 --2- 172.21.15.2:0/3490536636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0ac1077b0 0x7fb0ac107bb0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0009820 tx=0x7fb0a002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=989294269c30eeac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:19.844 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.180+0000 7fb0ab7fe640 1 -- 172.21.15.2:0/3490536636 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0a0037070 con 0x7fb0ac1077b0 2024-09-19T06:05:19.844 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.180+0000 7fb0ab7fe640 1 -- 172.21.15.2:0/3490536636 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0a0032440 con 0x7fb0ac1077b0 2024-09-19T06:05:19.844 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.181+0000 7fb0ab7fe640 1 -- 172.21.15.2:0/3490536636 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0a0032740 con 0x7fb0ac1077b0 2024-09-19T06:05:19.844 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.181+0000 7fb0b3176640 1 -- 172.21.15.2:0/3490536636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0ac1077b0 msgr2=0x7fb0ac107bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:19.844 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.181+0000 7fb0b3176640 1 --2- 172.21.15.2:0/3490536636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0ac1077b0 0x7fb0ac107bb0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0009820 tx=0x7fb0a002a270 comp rx=0 tx=0).stop 2024-09-19T06:05:19.844 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.181+0000 7fb0b3176640 1 -- 172.21.15.2:0/3490536636 shutdown_connections 2024-09-19T06:05:19.844 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.181+0000 7fb0b3176640 1 --2- 172.21.15.2:0/3490536636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0ac1077b0 0x7fb0ac107bb0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:19.844 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.181+0000 7fb0b3176640 1 -- 172.21.15.2:0/3490536636 >> 172.21.15.2:0/3490536636 conn(0x7fb0ac102f60 msgr2=0x7fb0ac105380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:19.844 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.181+0000 7fb0b3176640 1 -- 172.21.15.2:0/3490536636 shutdown_connections 2024-09-19T06:05:19.844 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.181+0000 7fb0b3176640 1 -- 172.21.15.2:0/3490536636 wait complete. 2024-09-19T06:05:19.845 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.182+0000 7fb0b3176640 1 Processor -- start 2024-09-19T06:05:19.845 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.182+0000 7fb0b3176640 1 -- start start 2024-09-19T06:05:19.845 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.182+0000 7fb0b3176640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0ac1077b0 0x7fb0ac19aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:19.845 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.182+0000 7fb0b3176640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ac108eb0 con 0x7fb0ac1077b0 2024-09-19T06:05:19.845 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.182+0000 7fb0b0f12640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0ac1077b0 0x7fb0ac19aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:19.845 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.182+0000 7fb0b0f12640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0ac1077b0 0x7fb0ac19aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34678/0 (socket says 172.21.15.2:34678) 2024-09-19T06:05:19.845 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.182+0000 7fb0b0f12640 1 -- 172.21.15.2:0/406110981 learned_addr learned my addr 172.21.15.2:0/406110981 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:05:19.845 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.182+0000 7fb0b0f12640 1 -- 172.21.15.2:0/406110981 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0ac19b3f0 con 0x7fb0ac1077b0 2024-09-19T06:05:19.845 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.182+0000 7fb0b0f12640 1 --2- 172.21.15.2:0/406110981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0ac1077b0 0x7fb0ac19aeb0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fb0a00090b0 tx=0x7fb0a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:19.845 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.183+0000 7fb0a9ffb640 1 -- 172.21.15.2:0/406110981 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0a0041070 con 0x7fb0ac1077b0 2024-09-19T06:05:19.845 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.183+0000 7fb0a9ffb640 1 -- 172.21.15.2:0/406110981 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0a003c7a0 con 0x7fb0ac1077b0 2024-09-19T06:05:19.846 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.183+0000 7fb0b3176640 1 -- 172.21.15.2:0/406110981 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0ac19b680 con 0x7fb0ac1077b0 2024-09-19T06:05:19.846 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.183+0000 7fb0a9ffb640 1 -- 172.21.15.2:0/406110981 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0a0037040 con 0x7fb0ac1077b0 2024-09-19T06:05:19.846 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.183+0000 7fb0b3176640 1 -- 172.21.15.2:0/406110981 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0ac19e370 con 0x7fb0ac1077b0 2024-09-19T06:05:19.846 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.183+0000 7fb0a9ffb640 1 -- 172.21.15.2:0/406110981 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb0a0044070 con 0x7fb0ac1077b0 2024-09-19T06:05:19.846 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.183+0000 7fb0a9ffb640 1 -- 172.21.15.2:0/406110981 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb0a003d3f0 con 0x7fb0ac1077b0 2024-09-19T06:05:19.846 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.184+0000 7fb0b3176640 1 -- 172.21.15.2:0/406110981 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0ac109500 con 0x7fb0ac1077b0 2024-09-19T06:05:19.846 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.186+0000 7fb0a9ffb640 1 -- 172.21.15.2:0/406110981 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fb0a0046450 con 0x7fb0ac1077b0 2024-09-19T06:05:19.846 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.245+0000 7fb0b3176640 1 -- 172.21.15.2:0/406110981 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fb0ac19fa50 con 0x7fb0ac1077b0 2024-09-19T06:05:19.846 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.248+0000 7fb0a9ffb640 1 -- 172.21.15.2:0/406110981 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+427 (secure 0 0 0) 0x7fb0a0046630 con 0x7fb0ac1077b0 2024-09-19T06:05:19.846 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.249+0000 7fb0a9ffb640 1 -- 172.21.15.2:0/406110981 <== mon.0 v2:172.21.15.2:3300/0 8 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fb0a0056070 con 0x7fb0ac1077b0 2024-09-19T06:05:19.847 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.249+0000 7fb0b3176640 1 -- 172.21.15.2:0/406110981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0ac1077b0 msgr2=0x7fb0ac19aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:19.847 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.249+0000 7fb0b3176640 1 --2- 172.21.15.2:0/406110981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0ac1077b0 0x7fb0ac19aeb0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fb0a00090b0 tx=0x7fb0a00046c0 comp rx=0 tx=0).stop 2024-09-19T06:05:19.847 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.250+0000 7fb0b3176640 1 -- 172.21.15.2:0/406110981 shutdown_connections 2024-09-19T06:05:19.847 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.250+0000 7fb0b3176640 1 --2- 172.21.15.2:0/406110981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0ac1077b0 0x7fb0ac19aeb0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:19.847 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.250+0000 7fb0b3176640 1 -- 172.21.15.2:0/406110981 >> 172.21.15.2:0/406110981 conn(0x7fb0ac102f60 msgr2=0x7fb0ac18f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:19.847 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.250+0000 7fb0b3176640 1 -- 172.21.15.2:0/406110981 shutdown_connections 2024-09-19T06:05:19.847 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:19.250+0000 7fb0b3176640 1 -- 172.21.15.2:0/406110981 wait complete. 2024-09-19T06:05:19.847 INFO:teuthology.orchestra.run.smithi002.stdout:Generating new minimal ceph.conf... 2024-09-19T06:05:20.845 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.246+0000 7fd495141640 1 Processor -- start 2024-09-19T06:05:20.845 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.246+0000 7fd495141640 1 -- start start 2024-09-19T06:05:20.845 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.246+0000 7fd495141640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd490108200 0x7fd49010a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:20.846 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.246+0000 7fd495141640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd49007bdc0 con 0x7fd490108200 2024-09-19T06:05:20.846 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.246+0000 7fd48ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd490108200 0x7fd49010a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:20.846 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.246+0000 7fd48ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd490108200 0x7fd49010a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34690/0 (socket says 172.21.15.2:34690) 2024-09-19T06:05:20.846 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.246+0000 7fd48ed9d640 1 -- 172.21.15.2:0/380734989 learned_addr learned my addr 172.21.15.2:0/380734989 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:05:20.846 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.246+0000 7fd48ed9d640 1 -- 172.21.15.2:0/380734989 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd49010ab30 con 0x7fd490108200 2024-09-19T06:05:20.846 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.247+0000 7fd48ed9d640 1 --2- 172.21.15.2:0/380734989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd490108200 0x7fd49010a5f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd480009820 tx=0x7fd48002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=758b5abbc9b82f29 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:20.846 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.247+0000 7fd48e59c640 1 -- 172.21.15.2:0/380734989 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd480037070 con 0x7fd490108200 2024-09-19T06:05:20.846 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.247+0000 7fd48e59c640 1 -- 172.21.15.2:0/380734989 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fd4800328d0 con 0x7fd490108200 2024-09-19T06:05:20.846 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.247+0000 7fd48e59c640 1 -- 172.21.15.2:0/380734989 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4800307d0 con 0x7fd490108200 2024-09-19T06:05:20.846 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.248+0000 7fd495141640 1 -- 172.21.15.2:0/380734989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd490108200 msgr2=0x7fd49010a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:20.846 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.248+0000 7fd495141640 1 --2- 172.21.15.2:0/380734989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd490108200 0x7fd49010a5f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd480009820 tx=0x7fd48002a270 comp rx=0 tx=0).stop 2024-09-19T06:05:20.847 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.248+0000 7fd495141640 1 -- 172.21.15.2:0/380734989 shutdown_connections 2024-09-19T06:05:20.847 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.248+0000 7fd495141640 1 --2- 172.21.15.2:0/380734989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd490108200 0x7fd49010a5f0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:20.847 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.248+0000 7fd495141640 1 -- 172.21.15.2:0/380734989 >> 172.21.15.2:0/380734989 conn(0x7fd490101e20 msgr2=0x7fd490104240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:20.847 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.248+0000 7fd495141640 1 -- 172.21.15.2:0/380734989 shutdown_connections 2024-09-19T06:05:20.847 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.248+0000 7fd495141640 1 -- 172.21.15.2:0/380734989 wait complete. 2024-09-19T06:05:20.847 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.249+0000 7fd495141640 1 Processor -- start 2024-09-19T06:05:20.847 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.249+0000 7fd495141640 1 -- start start 2024-09-19T06:05:20.848 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.249+0000 7fd495141640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd490108200 0x7fd49019b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:20.848 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.249+0000 7fd495141640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd49010bab0 con 0x7fd490108200 2024-09-19T06:05:20.848 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.249+0000 7fd48ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd490108200 0x7fd49019b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:20.848 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.249+0000 7fd48ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd490108200 0x7fd49019b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34704/0 (socket says 172.21.15.2:34704) 2024-09-19T06:05:20.848 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.249+0000 7fd48ed9d640 1 -- 172.21.15.2:0/1075106551 learned_addr learned my addr 172.21.15.2:0/1075106551 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:05:20.848 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.249+0000 7fd48ed9d640 1 -- 172.21.15.2:0/1075106551 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd49019bc00 con 0x7fd490108200 2024-09-19T06:05:20.848 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.249+0000 7fd48ed9d640 1 --2- 172.21.15.2:0/1075106551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd490108200 0x7fd49019b6c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd4800097f0 tx=0x7fd480030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:20.848 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.250+0000 7fd48cd99640 1 -- 172.21.15.2:0/1075106551 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd480037040 con 0x7fd490108200 2024-09-19T06:05:20.849 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.250+0000 7fd48cd99640 1 -- 172.21.15.2:0/1075106551 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fd48003b3f0 con 0x7fd490108200 2024-09-19T06:05:20.849 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.250+0000 7fd495141640 1 -- 172.21.15.2:0/1075106551 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd49019be90 con 0x7fd490108200 2024-09-19T06:05:20.849 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.250+0000 7fd48cd99640 1 -- 172.21.15.2:0/1075106551 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd48003a520 con 0x7fd490108200 2024-09-19T06:05:20.849 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.250+0000 7fd495141640 1 -- 172.21.15.2:0/1075106551 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd49019eb80 con 0x7fd490108200 2024-09-19T06:05:20.849 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.250+0000 7fd48cd99640 1 -- 172.21.15.2:0/1075106551 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd48003a710 con 0x7fd490108200 2024-09-19T06:05:20.849 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.250+0000 7fd48cd99640 1 -- 172.21.15.2:0/1075106551 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd480043360 con 0x7fd490108200 2024-09-19T06:05:20.849 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.251+0000 7fd495141640 1 -- 172.21.15.2:0/1075106551 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd490108660 con 0x7fd490108200 2024-09-19T06:05:20.849 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.253+0000 7fd48cd99640 1 -- 172.21.15.2:0/1075106551 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fd48003b980 con 0x7fd490108200 2024-09-19T06:05:20.850 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.313+0000 7fd495141640 1 -- 172.21.15.2:0/1075106551 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fd49019f050 con 0x7fd490108200 2024-09-19T06:05:20.850 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.313+0000 7fd48cd99640 1 -- 172.21.15.2:0/1075106551 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+173 (secure 0 0 0) 0x7fd48003b5a0 con 0x7fd490108200 2024-09-19T06:05:20.850 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.314+0000 7fd495141640 1 -- 172.21.15.2:0/1075106551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd490108200 msgr2=0x7fd49019b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:20.850 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.314+0000 7fd495141640 1 --2- 172.21.15.2:0/1075106551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd490108200 0x7fd49019b6c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd4800097f0 tx=0x7fd480030d00 comp rx=0 tx=0).stop 2024-09-19T06:05:20.850 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.314+0000 7fd495141640 1 -- 172.21.15.2:0/1075106551 shutdown_connections 2024-09-19T06:05:20.850 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.314+0000 7fd495141640 1 --2- 172.21.15.2:0/1075106551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd490108200 0x7fd49019b6c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:20.850 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.314+0000 7fd495141640 1 -- 172.21.15.2:0/1075106551 >> 172.21.15.2:0/1075106551 conn(0x7fd490101e20 msgr2=0x7fd490102a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:20.850 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.314+0000 7fd495141640 1 -- 172.21.15.2:0/1075106551 shutdown_connections 2024-09-19T06:05:20.850 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:20.314+0000 7fd495141640 1 -- 172.21.15.2:0/1075106551 wait complete. 2024-09-19T06:05:20.850 INFO:teuthology.orchestra.run.smithi002.stdout:Restarting the monitor... 2024-09-19T06:05:20.856 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:20 smithi002 ceph-mon[30615]: from='client.? 172.21.15.2:0/1075106551' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:20.856 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:20 smithi002 systemd[1]: Stopping Ceph mon.a for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:05:21.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:21 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mon-a[30611]: 2024-09-19T06:05:21.122+0000 7f78eebe9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:05:21.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:21 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mon-a[30611]: 2024-09-19T06:05:21.122+0000 7f78eebe9640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-19T06:05:21.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:21 smithi002 podman[30859]: 2024-09-19 06:05:21.297137968 +0000 UTC m=+0.295646793 container died be2f3088690ed56b9d66d194b1c31aacb25a14421af46ec29117d92838306561 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mon-a, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-19T06:05:21.823 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:21 smithi002 podman[30859]: 2024-09-19 06:05:21.555230297 +0000 UTC m=+0.553739121 container cleanup be2f3088690ed56b9d66d194b1c31aacb25a14421af46ec29117d92838306561 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-19T06:05:21.823 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:21 smithi002 bash[30859]: ceph-078f6612-764d-11ef-bceb-c7b262605968-mon-a 2024-09-19T06:05:22.191 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:21 smithi002 podman[30874]: 2024-09-19 06:05:21.822624663 +0000 UTC m=+0.520191190 container remove be2f3088690ed56b9d66d194b1c31aacb25a14421af46ec29117d92838306561 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mon-a, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-19T06:05:22.191 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:21 smithi002 systemd[1]: ceph-078f6612-764d-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-19T06:05:22.191 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:21 smithi002 systemd[1]: Stopped Ceph mon.a for 078f6612-764d-11ef-bceb-c7b262605968. 2024-09-19T06:05:22.191 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:21 smithi002 systemd[1]: Starting Ceph mon.a for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:05:22.432 INFO:teuthology.orchestra.run.smithi002.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-19T06:05:22.461 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 podman[30963]: 2024-09-19 06:05:22.190059984 +0000 UTC m=+0.112583588 container create 61e6476b375d0595726df2baaf0abdfbe8296ac4482c3b3e828206d2431c9d1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mon-a, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-19T06:05:22.461 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 podman[30963]: 2024-09-19 06:05:22.094040247 +0000 UTC m=+0.016563818 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:05:22.461 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 podman[30963]: 2024-09-19 06:05:22.36705272 +0000 UTC m=+0.289576292 container init 61e6476b375d0595726df2baaf0abdfbe8296ac4482c3b3e828206d2431c9d1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mon-a, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4) 2024-09-19T06:05:22.461 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 podman[30963]: 2024-09-19 06:05:22.370144457 +0000 UTC m=+0.292668028 container start 61e6476b375d0595726df2baaf0abdfbe8296ac4482c3b3e828206d2431c9d1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-19T06:05:22.461 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T06:05:22.461 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T06:05:22.461 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: pidfile_write: ignore empty --pid-file 2024-09-19T06:05:22.461 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: load: jerasure load: lrc 2024-09-19T06:05:22.461 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: RocksDB version: 7.9.2 2024-09-19T06:05:22.462 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Git sha 0 2024-09-19T06:05:22.462 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T06:05:22.462 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: DB SUMMARY 2024-09-19T06:05:22.462 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: DB Session ID: KC5DJTUNRJRPDC06OX48 2024-09-19T06:05:22.462 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: CURRENT file: CURRENT 2024-09-19T06:05:22.462 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T06:05:22.462 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-19T06:05:22.462 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-19T06:05:22.462 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 106622 ; 2024-09-19T06:05:22.462 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.error_if_exists: 0 2024-09-19T06:05:22.463 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.create_if_missing: 0 2024-09-19T06:05:22.463 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.paranoid_checks: 1 2024-09-19T06:05:22.463 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T06:05:22.463 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T06:05:22.463 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T06:05:22.463 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.env: 0x558d39c3b940 2024-09-19T06:05:22.463 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T06:05:22.463 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.info_log: 0x558d3be576e0 2024-09-19T06:05:22.463 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T06:05:22.463 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.statistics: (nil) 2024-09-19T06:05:22.464 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.use_fsync: 0 2024-09-19T06:05:22.464 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.max_log_file_size: 0 2024-09-19T06:05:22.464 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T06:05:22.464 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T06:05:22.464 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T06:05:22.464 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T06:05:22.464 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.allow_fallocate: 1 2024-09-19T06:05:22.464 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T06:05:22.464 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T06:05:22.464 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.use_direct_reads: 0 2024-09-19T06:05:22.464 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T06:05:22.464 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T06:05:22.465 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.db_log_dir: 2024-09-19T06:05:22.465 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.wal_dir: 2024-09-19T06:05:22.465 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T06:05:22.465 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T06:05:22.465 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T06:05:22.465 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T06:05:22.465 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T06:05:22.465 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T06:05:22.465 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T06:05:22.465 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T06:05:22.465 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.write_buffer_manager: 0x558d3be66dc0 2024-09-19T06:05:22.465 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T06:05:22.466 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T06:05:22.466 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T06:05:22.466 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T06:05:22.466 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T06:05:22.466 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T06:05:22.467 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T06:05:22.467 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T06:05:22.467 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.unordered_write: 0 2024-09-19T06:05:22.467 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T06:05:22.467 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T06:05:22.467 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T06:05:22.468 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T06:05:22.468 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.row_cache: None 2024-09-19T06:05:22.468 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.wal_filter: None 2024-09-19T06:05:22.468 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T06:05:22.468 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T06:05:22.468 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.two_write_queues: 0 2024-09-19T06:05:22.468 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T06:05:22.468 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.wal_compression: 0 2024-09-19T06:05:22.468 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.atomic_flush: 0 2024-09-19T06:05:22.468 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T06:05:22.468 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T06:05:22.469 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T06:05:22.469 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.log_readahead_size: 0 2024-09-19T06:05:22.469 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T06:05:22.469 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T06:05:22.469 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T06:05:22.469 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T06:05:22.469 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T06:05:22.469 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T06:05:22.469 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T06:05:22.469 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.max_background_jobs: 2 2024-09-19T06:05:22.469 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.max_background_compactions: -1 2024-09-19T06:05:22.469 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.max_subcompactions: 1 2024-09-19T06:05:22.470 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T06:05:22.470 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T06:05:22.470 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T06:05:22.470 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T06:05:22.470 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T06:05:22.470 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T06:05:22.470 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T06:05:22.470 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T06:05:22.470 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.max_open_files: -1 2024-09-19T06:05:22.470 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T06:05:22.470 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T06:05:22.470 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T06:05:22.470 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T06:05:22.471 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.max_background_flushes: -1 2024-09-19T06:05:22.471 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Compression algorithms supported: 2024-09-19T06:05:22.471 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: kZSTD supported: 0 2024-09-19T06:05:22.471 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: kXpressCompression supported: 0 2024-09-19T06:05:22.471 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: kBZip2Compression supported: 0 2024-09-19T06:05:22.471 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T06:05:22.471 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: kLZ4Compression supported: 1 2024-09-19T06:05:22.471 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: kZlibCompression supported: 1 2024-09-19T06:05:22.471 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T06:05:22.471 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: kSnappyCompression supported: 1 2024-09-19T06:05:22.471 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T06:05:22.471 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T06:05:22.471 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-19T06:05:22.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T06:05:22.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T06:05:22.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.merge_operator: 2024-09-19T06:05:22.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.compaction_filter: None 2024-09-19T06:05:22.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T06:05:22.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T06:05:22.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T06:05:22.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T06:05:22.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x558d3be57320) 2024-09-19T06:05:22.472 INFO:journalctl@ceph.mon.a.smithi002.stdout: cache_index_and_filter_blocks: 1 2024-09-19T06:05:22.472 INFO:journalctl@ceph.mon.a.smithi002.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T06:05:22.472 INFO:journalctl@ceph.mon.a.smithi002.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T06:05:22.472 INFO:journalctl@ceph.mon.a.smithi002.stdout: pin_top_level_index_and_filter: 1 2024-09-19T06:05:22.473 INFO:journalctl@ceph.mon.a.smithi002.stdout: index_type: 0 2024-09-19T06:05:22.473 INFO:journalctl@ceph.mon.a.smithi002.stdout: data_block_index_type: 0 2024-09-19T06:05:22.473 INFO:journalctl@ceph.mon.a.smithi002.stdout: index_shortening: 1 2024-09-19T06:05:22.473 INFO:journalctl@ceph.mon.a.smithi002.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T06:05:22.473 INFO:journalctl@ceph.mon.a.smithi002.stdout: checksum: 4 2024-09-19T06:05:22.473 INFO:journalctl@ceph.mon.a.smithi002.stdout: no_block_cache: 0 2024-09-19T06:05:22.473 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_cache: 0x558d3be4b1f0 2024-09-19T06:05:22.473 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_cache_name: BinnedLRUCache 2024-09-19T06:05:22.473 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_cache_options: 2024-09-19T06:05:22.473 INFO:journalctl@ceph.mon.a.smithi002.stdout: capacity : 536870912 2024-09-19T06:05:22.473 INFO:journalctl@ceph.mon.a.smithi002.stdout: num_shard_bits : 4 2024-09-19T06:05:22.473 INFO:journalctl@ceph.mon.a.smithi002.stdout: strict_capacity_limit : 0 2024-09-19T06:05:22.473 INFO:journalctl@ceph.mon.a.smithi002.stdout: high_pri_pool_ratio: 0.000 2024-09-19T06:05:22.474 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_cache_compressed: (nil) 2024-09-19T06:05:22.474 INFO:journalctl@ceph.mon.a.smithi002.stdout: persistent_cache: (nil) 2024-09-19T06:05:22.474 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_size: 4096 2024-09-19T06:05:22.474 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_size_deviation: 10 2024-09-19T06:05:22.474 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_restart_interval: 16 2024-09-19T06:05:22.474 INFO:journalctl@ceph.mon.a.smithi002.stdout: index_block_restart_interval: 1 2024-09-19T06:05:22.474 INFO:journalctl@ceph.mon.a.smithi002.stdout: metadata_block_size: 4096 2024-09-19T06:05:22.474 INFO:journalctl@ceph.mon.a.smithi002.stdout: partition_filters: 0 2024-09-19T06:05:22.474 INFO:journalctl@ceph.mon.a.smithi002.stdout: use_delta_encoding: 1 2024-09-19T06:05:22.474 INFO:journalctl@ceph.mon.a.smithi002.stdout: filter_policy: bloomfilter 2024-09-19T06:05:22.474 INFO:journalctl@ceph.mon.a.smithi002.stdout: whole_key_filtering: 1 2024-09-19T06:05:22.474 INFO:journalctl@ceph.mon.a.smithi002.stdout: verify_compression: 0 2024-09-19T06:05:22.475 INFO:journalctl@ceph.mon.a.smithi002.stdout: read_amp_bytes_per_bit: 0 2024-09-19T06:05:22.475 INFO:journalctl@ceph.mon.a.smithi002.stdout: format_version: 5 2024-09-19T06:05:22.475 INFO:journalctl@ceph.mon.a.smithi002.stdout: enable_index_compression: 1 2024-09-19T06:05:22.475 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_align: 0 2024-09-19T06:05:22.475 INFO:journalctl@ceph.mon.a.smithi002.stdout: max_auto_readahead_size: 262144 2024-09-19T06:05:22.475 INFO:journalctl@ceph.mon.a.smithi002.stdout: prepopulate_block_cache: 0 2024-09-19T06:05:22.475 INFO:journalctl@ceph.mon.a.smithi002.stdout: initial_auto_readahead_size: 8192 2024-09-19T06:05:22.475 INFO:journalctl@ceph.mon.a.smithi002.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T06:05:22.475 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T06:05:22.475 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T06:05:22.475 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.compression: NoCompression 2024-09-19T06:05:22.475 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T06:05:22.475 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T06:05:22.476 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T06:05:22.476 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.num_levels: 7 2024-09-19T06:05:22.476 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T06:05:22.476 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T06:05:22.476 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T06:05:22.476 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T06:05:22.476 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T06:05:22.476 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T06:05:22.476 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T06:05:22.476 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T06:05:22.476 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T06:05:22.476 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T06:05:22.476 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T06:05:22.477 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T06:05:22.477 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T06:05:22.477 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T06:05:22.477 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T06:05:22.477 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T06:05:22.477 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T06:05:22.477 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T06:05:22.477 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T06:05:22.477 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T06:05:22.477 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T06:05:22.477 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T06:05:22.477 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T06:05:22.478 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T06:05:22.478 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T06:05:22.478 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T06:05:22.478 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T06:05:22.478 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T06:05:22.478 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T06:05:22.478 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T06:05:22.478 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T06:05:22.478 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T06:05:22.478 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T06:05:22.478 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T06:05:22.478 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T06:05:22.478 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T06:05:22.478 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T06:05:22.479 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T06:05:22.479 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T06:05:22.479 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T06:05:22.479 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T06:05:22.479 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T06:05:22.479 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T06:05:22.479 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T06:05:22.479 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T06:05:22.479 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T06:05:22.479 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T06:05:22.479 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T06:05:22.479 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T06:05:22.479 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T06:05:22.480 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T06:05:22.480 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T06:05:22.480 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T06:05:22.480 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T06:05:22.480 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.inplace_update_support: 0 2024-09-19T06:05:22.480 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T06:05:22.480 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T06:05:22.480 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T06:05:22.480 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T06:05:22.480 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.bloom_locality: 0 2024-09-19T06:05:22.480 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.max_successive_merges: 0 2024-09-19T06:05:22.481 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T06:05:22.481 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T06:05:22.481 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T06:05:22.481 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T06:05:22.481 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.ttl: 2592000 2024-09-19T06:05:22.481 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T06:05:22.481 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T06:05:22.481 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T06:05:22.481 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.enable_blob_files: false 2024-09-19T06:05:22.481 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.min_blob_size: 0 2024-09-19T06:05:22.481 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T06:05:22.481 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T06:05:22.481 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T06:05:22.482 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T06:05:22.482 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T06:05:22.482 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T06:05:22.482 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T06:05:22.482 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T06:05:22.482 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-19T06:05:22.482 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-19T06:05:22.482 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 3c9e357a-c0ad-480d-9b00-8a6526ff5c06 2024-09-19T06:05:22.482 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726725922397501, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-19T06:05:22.482 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-19T06:05:22.482 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726725922399113, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 101568, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 334, "table_properties": {"data_size": 99453, "index_size": 307, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14647, "raw_average_key_size": 49, "raw_value_size": 91520, "raw_average_value_size": 312, "num_data_blocks": 12, "num_entries": 293, "num_filter_entries": 293, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726725922, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "3c9e357a-c0ad-480d-9b00-8a6526ff5c06", "db_session_id": "KC5DJTUNRJRPDC06OX48", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-19T06:05:22.482 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726725922399249, "job": 1, "event": "recovery_finished"} 2024-09-19T06:05:22.482 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-19T06:05:22.483 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T06:05:22.483 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x558d3be78e00 2024-09-19T06:05:22.483 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: DB pointer 0x558d3bf74000 2024-09-19T06:05:22.483 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T06:05:22.483 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T06:05:22.483 INFO:journalctl@ceph.mon.a.smithi002.stdout: ** DB Stats ** 2024-09-19T06:05:22.483 INFO:journalctl@ceph.mon.a.smithi002.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T06:05:22.483 INFO:journalctl@ceph.mon.a.smithi002.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T06:05:22.483 INFO:journalctl@ceph.mon.a.smithi002.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T06:05:22.483 INFO:journalctl@ceph.mon.a.smithi002.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T06:05:22.483 INFO:journalctl@ceph.mon.a.smithi002.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T06:05:22.483 INFO:journalctl@ceph.mon.a.smithi002.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T06:05:22.484 INFO:journalctl@ceph.mon.a.smithi002.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T06:05:22.484 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-09-19T06:05:22.484 INFO:journalctl@ceph.mon.a.smithi002.stdout: ** Compaction Stats [default] ** 2024-09-19T06:05:22.484 INFO:journalctl@ceph.mon.a.smithi002.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T06:05:22.484 INFO:journalctl@ceph.mon.a.smithi002.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T06:05:22.484 INFO:journalctl@ceph.mon.a.smithi002.stdout: L0 2/0 101.05 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 100.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T06:05:22.484 INFO:journalctl@ceph.mon.a.smithi002.stdout: Sum 2/0 101.05 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 100.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T06:05:22.484 INFO:journalctl@ceph.mon.a.smithi002.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 100.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T06:05:22.484 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-09-19T06:05:22.484 INFO:journalctl@ceph.mon.a.smithi002.stdout: ** Compaction Stats [default] ** 2024-09-19T06:05:22.484 INFO:journalctl@ceph.mon.a.smithi002.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T06:05:22.484 INFO:journalctl@ceph.mon.a.smithi002.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T06:05:22.484 INFO:journalctl@ceph.mon.a.smithi002.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 100.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T06:05:22.485 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-09-19T06:05:22.485 INFO:journalctl@ceph.mon.a.smithi002.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T06:05:22.485 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-09-19T06:05:22.485 INFO:journalctl@ceph.mon.a.smithi002.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T06:05:22.485 INFO:journalctl@ceph.mon.a.smithi002.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T06:05:22.485 INFO:journalctl@ceph.mon.a.smithi002.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T06:05:22.485 INFO:journalctl@ceph.mon.a.smithi002.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T06:05:22.485 INFO:journalctl@ceph.mon.a.smithi002.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T06:05:22.485 INFO:journalctl@ceph.mon.a.smithi002.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T06:05:22.485 INFO:journalctl@ceph.mon.a.smithi002.stdout: Cumulative compaction: 0.00 GB write, 20.46 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T06:05:22.485 INFO:journalctl@ceph.mon.a.smithi002.stdout: Interval compaction: 0.00 GB write, 20.46 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T06:05:22.486 INFO:journalctl@ceph.mon.a.smithi002.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T06:05:22.486 INFO:journalctl@ceph.mon.a.smithi002.stdout: Block cache BinnedLRUCache@0x558d3be4b1f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-09-19T06:05:22.486 INFO:journalctl@ceph.mon.a.smithi002.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-19T06:05:22.486 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-09-19T06:05:22.486 INFO:journalctl@ceph.mon.a.smithi002.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T06:05:22.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: starting mon.a rank 0 at public addrs [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] at bind addrs [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 078f6612-764d-11ef-bceb-c7b262605968 2024-09-19T06:05:22.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: mon.a@-1(???) e1 preinit fsid 078f6612-764d-11ef-bceb-c7b262605968 2024-09-19T06:05:22.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: mon.a@-1(???).mds e1 new map 2024-09-19T06:05:22.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: mon.a@-1(???).mds e1 print_map 2024-09-19T06:05:22.486 INFO:journalctl@ceph.mon.a.smithi002.stdout: e1 2024-09-19T06:05:22.487 INFO:journalctl@ceph.mon.a.smithi002.stdout: btime 2024-09-19T06:05:17:607764+0000 2024-09-19T06:05:22.487 INFO:journalctl@ceph.mon.a.smithi002.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:05:22.487 INFO:journalctl@ceph.mon.a.smithi002.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T06:05:22.487 INFO:journalctl@ceph.mon.a.smithi002.stdout: legacy client fscid: -1 2024-09-19T06:05:22.487 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-09-19T06:05:22.487 INFO:journalctl@ceph.mon.a.smithi002.stdout: No filesystems configured 2024-09-19T06:05:22.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T06:05:22.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T06:05:22.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T06:05:22.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T06:05:22.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-19T06:05:22.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 bash[30963]: 61e6476b375d0595726df2baaf0abdfbe8296ac4482c3b3e828206d2431c9d1b 2024-09-19T06:05:22.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 systemd[1]: Started Ceph mon.a for 078f6612-764d-11ef-bceb-c7b262605968. 2024-09-19T06:05:22.488 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T06:05:22.488 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: monmap epoch 1 2024-09-19T06:05:22.488 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: fsid 078f6612-764d-11ef-bceb-c7b262605968 2024-09-19T06:05:22.488 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: last_changed 2024-09-19T06:05:14.578448+0000 2024-09-19T06:05:22.488 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: created 2024-09-19T06:05:14.578448+0000 2024-09-19T06:05:22.488 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: min_mon_release 19 (squid) 2024-09-19T06:05:22.488 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: election_strategy: 1 2024-09-19T06:05:22.488 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-19T06:05:22.488 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: fsmap 2024-09-19T06:05:22.488 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T06:05:22.489 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:22 smithi002 ceph-mon[30982]: mgrmap e1: no daemons active 2024-09-19T06:05:23.582 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.887+0000 7f6bf524d640 1 Processor -- start 2024-09-19T06:05:23.582 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.887+0000 7f6bf524d640 1 -- start start 2024-09-19T06:05:23.582 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.888+0000 7f6bf524d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bf0109940 0x7f6bf0109d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:23.582 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.888+0000 7f6bf524d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf010a310 con 0x7f6bf0109940 2024-09-19T06:05:23.582 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.888+0000 7f6beed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bf0109940 0x7f6bf0109d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:23.582 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.888+0000 7f6beed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bf0109940 0x7f6bf0109d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34706/0 (socket says 172.21.15.2:34706) 2024-09-19T06:05:23.583 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.888+0000 7f6beed9d640 1 -- 172.21.15.2:0/108383361 learned_addr learned my addr 172.21.15.2:0/108383361 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:05:23.583 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.888+0000 7f6beed9d640 1 -- 172.21.15.2:0/108383361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bf010aaf0 con 0x7f6bf0109940 2024-09-19T06:05:23.583 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.890+0000 7f6beed9d640 1 --2- 172.21.15.2:0/108383361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bf0109940 0x7f6bf0109d40 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6be0009820 tx=0x7f6be002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=354bfac8c94c1312 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:23.583 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.890+0000 7f6bee59c640 1 -- 172.21.15.2:0/108383361 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6be0037070 con 0x7f6bf0109940 2024-09-19T06:05:23.583 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.890+0000 7f6bee59c640 1 -- 172.21.15.2:0/108383361 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f6be00328d0 con 0x7f6bf0109940 2024-09-19T06:05:23.583 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.890+0000 7f6bee59c640 1 -- 172.21.15.2:0/108383361 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6be00307d0 con 0x7f6bf0109940 2024-09-19T06:05:23.583 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.891+0000 7f6bf524d640 1 -- 172.21.15.2:0/108383361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bf0109940 msgr2=0x7f6bf0109d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:23.583 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.891+0000 7f6bf524d640 1 --2- 172.21.15.2:0/108383361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bf0109940 0x7f6bf0109d40 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6be0009820 tx=0x7f6be002a270 comp rx=0 tx=0).stop 2024-09-19T06:05:23.583 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.891+0000 7f6bf524d640 1 -- 172.21.15.2:0/108383361 shutdown_connections 2024-09-19T06:05:23.583 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.891+0000 7f6bf524d640 1 --2- 172.21.15.2:0/108383361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bf0109940 0x7f6bf0109d40 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:23.584 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.891+0000 7f6bf524d640 1 -- 172.21.15.2:0/108383361 >> 172.21.15.2:0/108383361 conn(0x7f6bf007cf00 msgr2=0x7f6bf007d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:23.585 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.891+0000 7f6bf524d640 1 -- 172.21.15.2:0/108383361 shutdown_connections 2024-09-19T06:05:23.585 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.891+0000 7f6bf524d640 1 -- 172.21.15.2:0/108383361 wait complete. 2024-09-19T06:05:23.585 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.892+0000 7f6bf524d640 1 Processor -- start 2024-09-19T06:05:23.585 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.892+0000 7f6bf524d640 1 -- start start 2024-09-19T06:05:23.585 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.892+0000 7f6bf524d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bf0109940 0x7f6bf019d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:23.585 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.892+0000 7f6bf524d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf010dea0 con 0x7f6bf0109940 2024-09-19T06:05:23.585 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.892+0000 7f6beed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bf0109940 0x7f6bf019d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:23.585 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.892+0000 7f6beed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bf0109940 0x7f6bf019d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34718/0 (socket says 172.21.15.2:34718) 2024-09-19T06:05:23.585 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.892+0000 7f6beed9d640 1 -- 172.21.15.2:0/1403123469 learned_addr learned my addr 172.21.15.2:0/1403123469 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:05:23.586 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.893+0000 7f6beed9d640 1 -- 172.21.15.2:0/1403123469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bf019de60 con 0x7f6bf0109940 2024-09-19T06:05:23.586 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.893+0000 7f6beed9d640 1 --2- 172.21.15.2:0/1403123469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bf0109940 0x7f6bf019d920 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6be00097f0 tx=0x7f6be0030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:23.586 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.893+0000 7f6becd99640 1 -- 172.21.15.2:0/1403123469 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6be0037040 con 0x7f6bf0109940 2024-09-19T06:05:23.586 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.893+0000 7f6becd99640 1 -- 172.21.15.2:0/1403123469 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f6be0032bb0 con 0x7f6bf0109940 2024-09-19T06:05:23.586 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.893+0000 7f6becd99640 1 -- 172.21.15.2:0/1403123469 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6be003a390 con 0x7f6bf0109940 2024-09-19T06:05:23.586 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.893+0000 7f6bf524d640 1 -- 172.21.15.2:0/1403123469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bf019e0f0 con 0x7f6bf0109940 2024-09-19T06:05:23.586 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.893+0000 7f6bf524d640 1 -- 172.21.15.2:0/1403123469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bf01a0de0 con 0x7f6bf0109940 2024-09-19T06:05:23.586 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.894+0000 7f6becd99640 1 -- 172.21.15.2:0/1403123469 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6be003b3f0 con 0x7f6bf0109940 2024-09-19T06:05:23.586 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.894+0000 7f6becd99640 1 -- 172.21.15.2:0/1403123469 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6be0044740 con 0x7f6bf0109940 2024-09-19T06:05:23.587 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.894+0000 7f6bf524d640 1 -- 172.21.15.2:0/1403123469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bf010e020 con 0x7f6bf0109940 2024-09-19T06:05:23.587 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.897+0000 7f6becd99640 1 -- 172.21.15.2:0/1403123469 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f6be0032d60 con 0x7f6bf0109940 2024-09-19T06:05:23.587 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.956+0000 7f6bf524d640 1 -- 172.21.15.2:0/1403123469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f6bf01a13d0 con 0x7f6bf0109940 2024-09-19T06:05:23.587 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.958+0000 7f6becd99640 1 -- 172.21.15.2:0/1403123469 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f6be003b880 con 0x7f6bf0109940 2024-09-19T06:05:23.587 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.959+0000 7f6bf524d640 1 -- 172.21.15.2:0/1403123469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bf0109940 msgr2=0x7f6bf019d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:23.587 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.959+0000 7f6bf524d640 1 --2- 172.21.15.2:0/1403123469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bf0109940 0x7f6bf019d920 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6be00097f0 tx=0x7f6be0030d00 comp rx=0 tx=0).stop 2024-09-19T06:05:23.587 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.959+0000 7f6bf524d640 1 -- 172.21.15.2:0/1403123469 shutdown_connections 2024-09-19T06:05:23.587 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.959+0000 7f6bf524d640 1 --2- 172.21.15.2:0/1403123469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bf0109940 0x7f6bf019d920 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:23.587 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.959+0000 7f6bf524d640 1 -- 172.21.15.2:0/1403123469 >> 172.21.15.2:0/1403123469 conn(0x7f6bf007cf00 msgr2=0x7f6bf0107520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:23.587 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.959+0000 7f6bf524d640 1 -- 172.21.15.2:0/1403123469 shutdown_connections 2024-09-19T06:05:23.587 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:22.959+0000 7f6bf524d640 1 -- 172.21.15.2:0/1403123469 wait complete. 2024-09-19T06:05:23.587 INFO:teuthology.orchestra.run.smithi002.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-19T06:05:23.628 INFO:teuthology.orchestra.run.smithi002.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:05:23.629 INFO:teuthology.orchestra.run.smithi002.stdout:Creating mgr... 2024-09-19T06:05:23.629 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-19T06:05:23.629 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-19T06:05:23.896 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-078f6612-764d-11ef-bceb-c7b262605968@mgr.x 2024-09-19T06:05:23.896 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to reset failed state of unit ceph-078f6612-764d-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-078f6612-764d-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-19T06:05:24.049 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-078f6612-764d-11ef-bceb-c7b262605968.target.wants/ceph-078f6612-764d-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-078f6612-764d-11ef-bceb-c7b262605968@.service. 2024-09-19T06:05:24.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:23 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1403123469' entity='client.admin' 2024-09-19T06:05:24.223 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:24 smithi002 systemd[1]: Starting Ceph mgr.x for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:05:24.539 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:24 smithi002 podman[31196]: 2024-09-19 06:05:24.268493974 +0000 UTC m=+0.104970603 container create 74011ddbdaeee5c381e1eaafd453238de364f4c71fff97f3ca852131caa9ea42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4) 2024-09-19T06:05:24.539 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:24 smithi002 podman[31196]: 2024-09-19 06:05:24.179683031 +0000 UTC m=+0.016159636 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:05:24.539 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:24 smithi002 podman[31196]: 2024-09-19 06:05:24.462099722 +0000 UTC m=+0.298576319 container init 74011ddbdaeee5c381e1eaafd453238de364f4c71fff97f3ca852131caa9ea42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T06:05:24.539 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:24 smithi002 podman[31196]: 2024-09-19 06:05:24.46507473 +0000 UTC m=+0.301551328 container start 74011ddbdaeee5c381e1eaafd453238de364f4c71fff97f3ca852131caa9ea42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, ceph=True, GIT_CLEAN=True) 2024-09-19T06:05:24.540 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:24 smithi002 bash[31196]: 74011ddbdaeee5c381e1eaafd453238de364f4c71fff97f3ca852131caa9ea42 2024-09-19T06:05:24.555 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T06:05:24.555 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-09-19T06:05:24.564 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T06:05:24.564 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-19T06:05:24.565 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-09-19T06:05:24.565 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T06:05:24.575 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T06:05:24.575 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-09-19T06:05:24.584 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T06:05:24.584 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-19T06:05:24.584 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-09-19T06:05:24.584 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-19T06:05:24.584 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr to start... 2024-09-19T06:05:24.584 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr... 2024-09-19T06:05:24.801 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:24 smithi002 systemd[1]: Started Ceph mgr.x for 078f6612-764d-11ef-bceb-c7b262605968. 2024-09-19T06:05:24.801 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:24 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:24.597+0000 7f487000a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T06:05:24.801 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:24 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:24.658+0000 7f487000a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T06:05:25.068 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:24 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:24.818+0000 7f487000a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T06:05:25.069 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:24 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:24.888+0000 7f487000a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T06:05:25.069 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:25 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:25.047+0000 7f487000a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:05:25.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:25 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/2314215641' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T06:05:25.472 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:25 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:25.198+0000 7f487000a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T06:05:25.640 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-19T06:05:25.640 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-19T06:05:25.640 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsid": "078f6612-764d-11ef-bceb-c7b262605968", 2024-09-19T06:05:25.640 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T06:05:25.640 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T06:05:25.640 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T06:05:25.640 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T06:05:25.640 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:05:25.640 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T06:05:25.641 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T06:05:25.641 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 0 2024-09-19T06:05:25.641 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:05:25.641 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T06:05:25.641 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T06:05:25.641 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:05:25.641 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-19T06:05:25.641 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T06:05:25.641 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:05:25.641 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T06:05:25.641 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T06:05:25.641 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:05:25.641 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T06:05:25.642 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:05:25.642 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T06:05:25.650 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T06:05:25.650 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T06:05:25.650 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T06:05:25.650 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T06:05:25.650 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T06:05:25.650 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:05:25.650 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T06:05:25.650 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T06:05:25.650 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T06:05:25.651 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T06:05:25.651 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T06:05:25.651 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T06:05:25.651 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T06:05:25.651 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T06:05:25.651 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T06:05:25.651 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:05:25.651 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T06:05:25.651 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:05:25.651 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T06:05:17:607764+0000", 2024-09-19T06:05:25.651 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T06:05:25.651 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T06:05:25.651 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:05:25.652 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T06:05:25.652 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T06:05:25.652 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T06:05:25.652 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T06:05:25.652 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T06:05:25.652 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T06:05:25.652 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T06:05:25.652 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:05:25.652 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T06:05:25.652 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:05:25.652 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T06:05:25.652 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:05:25.652 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T06:05:17.608408+0000", 2024-09-19T06:05:25.653 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T06:05:25.653 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:05:25.653 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T06:05:25.653 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-19T06:05:25.653 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:24.995+0000 7fcaa8894640 1 Processor -- start 2024-09-19T06:05:25.653 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:24.995+0000 7fcaa8894640 1 -- start start 2024-09-19T06:05:25.653 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:24.995+0000 7fcaa8894640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcaa41081c0 0x7fcaa410a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:25.653 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:24.995+0000 7fcaa8894640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa407bde0 con 0x7fcaa41081c0 2024-09-19T06:05:25.653 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:24.996+0000 7fcaa259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcaa41081c0 0x7fcaa410a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:25.653 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:24.996+0000 7fcaa259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcaa41081c0 0x7fcaa410a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34748/0 (socket says 172.21.15.2:34748) 2024-09-19T06:05:25.653 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:24.996+0000 7fcaa259c640 1 -- 172.21.15.2:0/4139017890 learned_addr learned my addr 172.21.15.2:0/4139017890 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:05:25.653 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:24.996+0000 7fcaa259c640 1 -- 172.21.15.2:0/4139017890 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa410aaf0 con 0x7fcaa41081c0 2024-09-19T06:05:25.654 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:24.997+0000 7fcaa259c640 1 --2- 172.21.15.2:0/4139017890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcaa41081c0 0x7fcaa410a5b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fca94009820 tx=0x7fca9402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cce3057f65733802 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:25.654 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:24.997+0000 7fcaa159a640 1 -- 172.21.15.2:0/4139017890 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca94037070 con 0x7fcaa41081c0 2024-09-19T06:05:25.654 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:24.997+0000 7fcaa159a640 1 -- 172.21.15.2:0/4139017890 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fca940328d0 con 0x7fcaa41081c0 2024-09-19T06:05:25.654 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:24.997+0000 7fcaa159a640 1 -- 172.21.15.2:0/4139017890 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca940307d0 con 0x7fcaa41081c0 2024-09-19T06:05:25.654 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:24.998+0000 7fcaa8894640 1 -- 172.21.15.2:0/4139017890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcaa41081c0 msgr2=0x7fcaa410a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:25.654 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:24.998+0000 7fcaa8894640 1 --2- 172.21.15.2:0/4139017890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcaa41081c0 0x7fcaa410a5b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fca94009820 tx=0x7fca9402a270 comp rx=0 tx=0).stop 2024-09-19T06:05:25.654 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:24.998+0000 7fcaa8894640 1 -- 172.21.15.2:0/4139017890 shutdown_connections 2024-09-19T06:05:25.654 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:24.998+0000 7fcaa8894640 1 --2- 172.21.15.2:0/4139017890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcaa41081c0 0x7fcaa410a5b0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:25.654 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:24.998+0000 7fcaa8894640 1 -- 172.21.15.2:0/4139017890 >> 172.21.15.2:0/4139017890 conn(0x7fcaa4101d40 msgr2=0x7fcaa41041c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:25.654 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:24.998+0000 7fcaa8894640 1 -- 172.21.15.2:0/4139017890 shutdown_connections 2024-09-19T06:05:25.654 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:24.998+0000 7fcaa8894640 1 -- 172.21.15.2:0/4139017890 wait complete. 2024-09-19T06:05:25.654 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:24.999+0000 7fcaa8894640 1 Processor -- start 2024-09-19T06:05:25.655 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:24.999+0000 7fcaa8894640 1 -- start start 2024-09-19T06:05:25.655 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:24.999+0000 7fcaa8894640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcaa41081c0 0x7fcaa4107a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:25.655 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:24.999+0000 7fcaa8894640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa410bad0 con 0x7fcaa41081c0 2024-09-19T06:05:25.655 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:24.999+0000 7fcaa259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcaa41081c0 0x7fcaa4107a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:25.655 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:24.999+0000 7fcaa259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcaa41081c0 0x7fcaa4107a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34764/0 (socket says 172.21.15.2:34764) 2024-09-19T06:05:25.655 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:24.999+0000 7fcaa259c640 1 -- 172.21.15.2:0/2314215641 learned_addr learned my addr 172.21.15.2:0/2314215641 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:05:25.655 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:25.000+0000 7fcaa259c640 1 -- 172.21.15.2:0/2314215641 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa4107f80 con 0x7fcaa41081c0 2024-09-19T06:05:25.655 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:25.000+0000 7fcaa259c640 1 --2- 172.21.15.2:0/2314215641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcaa41081c0 0x7fcaa4107a40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fca940097f0 tx=0x7fca94030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:25.655 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:25.000+0000 7fca937fe640 1 -- 172.21.15.2:0/2314215641 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca94037040 con 0x7fcaa41081c0 2024-09-19T06:05:25.655 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:25.000+0000 7fcaa8894640 1 -- 172.21.15.2:0/2314215641 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaa4106170 con 0x7fcaa41081c0 2024-09-19T06:05:25.655 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:25.000+0000 7fca937fe640 1 -- 172.21.15.2:0/2314215641 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fca9403b3f0 con 0x7fcaa41081c0 2024-09-19T06:05:25.655 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:25.000+0000 7fca937fe640 1 -- 172.21.15.2:0/2314215641 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca9403a520 con 0x7fcaa41081c0 2024-09-19T06:05:25.655 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:25.000+0000 7fcaa8894640 1 -- 172.21.15.2:0/2314215641 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaa41066b0 con 0x7fcaa41081c0 2024-09-19T06:05:25.656 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:25.000+0000 7fca937fe640 1 -- 172.21.15.2:0/2314215641 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fca9403a710 con 0x7fcaa41081c0 2024-09-19T06:05:25.656 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:25.000+0000 7fca937fe640 1 -- 172.21.15.2:0/2314215641 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fca94044ba0 con 0x7fcaa41081c0 2024-09-19T06:05:25.656 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:25.001+0000 7fcaa8894640 1 -- 172.21.15.2:0/2314215641 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaa4108620 con 0x7fcaa41081c0 2024-09-19T06:05:25.656 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:25.003+0000 7fca937fe640 1 -- 172.21.15.2:0/2314215641 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fca94044400 con 0x7fcaa41081c0 2024-09-19T06:05:25.656 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:25.066+0000 7fcaa8894640 1 -- 172.21.15.2:0/2314215641 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fcaa41069f0 con 0x7fcaa41081c0 2024-09-19T06:05:25.656 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:25.067+0000 7fca937fe640 1 -- 172.21.15.2:0/2314215641 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fca94032820 con 0x7fcaa41081c0 2024-09-19T06:05:25.656 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:25.068+0000 7fcaa8894640 1 -- 172.21.15.2:0/2314215641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcaa41081c0 msgr2=0x7fcaa4107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:25.656 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:25.068+0000 7fcaa8894640 1 --2- 172.21.15.2:0/2314215641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcaa41081c0 0x7fcaa4107a40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fca940097f0 tx=0x7fca94030d00 comp rx=0 tx=0).stop 2024-09-19T06:05:25.656 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:25.068+0000 7fcaa8894640 1 -- 172.21.15.2:0/2314215641 shutdown_connections 2024-09-19T06:05:25.656 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:25.068+0000 7fcaa8894640 1 --2- 172.21.15.2:0/2314215641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcaa41081c0 0x7fcaa4107a40 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:25.656 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:25.068+0000 7fcaa8894640 1 -- 172.21.15.2:0/2314215641 >> 172.21.15.2:0/2314215641 conn(0x7fcaa4101d40 msgr2=0x7fcaa4102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:25.656 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:25.068+0000 7fcaa8894640 1 -- 172.21.15.2:0/2314215641 shutdown_connections 2024-09-19T06:05:25.656 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:25.068+0000 7fcaa8894640 1 -- 172.21.15.2:0/2314215641 wait complete. 2024-09-19T06:05:25.657 INFO:teuthology.orchestra.run.smithi002.stdout:mgr not available, waiting (1/15)... 2024-09-19T06:05:25.791 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:25 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:25.531+0000 7f487000a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T06:05:25.791 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:25 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:25.595+0000 7f487000a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T06:05:26.222 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:25 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:25.788+0000 7f487000a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T06:05:26.972 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:26 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:26.709+0000 7f487000a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T06:05:26.972 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:26 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:26.779+0000 7f487000a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T06:05:27.804 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:27 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:27.547+0000 7f487000a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T06:05:27.804 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:27 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:27.669+0000 7f487000a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T06:05:28.055 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:27 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:27.824+0000 7f487000a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:05:28.055 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:27 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:27.891+0000 7f487000a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T06:05:28.056 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:28 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:28.050+0000 7f487000a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T06:05:28.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:28 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1523414699' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T06:05:28.360 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:28 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:28.124+0000 7f487000a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T06:05:28.360 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:28 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:28.191+0000 7f487000a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T06:05:28.360 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:28 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:28.358+0000 7f487000a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T06:05:28.648 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:28 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:28.427+0000 7f487000a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T06:05:28.648 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:28 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:28.497+0000 7f487000a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T06:05:28.648 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:28 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:28.584+0000 7f487000a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T06:05:28.648 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:28 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:28.646+0000 7f487000a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T06:05:28.796 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-19T06:05:28.797 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-19T06:05:28.797 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsid": "078f6612-764d-11ef-bceb-c7b262605968", 2024-09-19T06:05:28.797 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T06:05:28.797 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T06:05:28.797 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T06:05:28.797 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T06:05:28.797 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:05:28.797 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T06:05:28.797 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T06:05:28.797 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 0 2024-09-19T06:05:28.798 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:05:28.798 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T06:05:28.798 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T06:05:28.798 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:05:28.798 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-19T06:05:28.798 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T06:05:28.798 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:05:28.798 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T06:05:28.798 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T06:05:28.798 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:05:28.798 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T06:05:28.798 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:05:28.798 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T06:05:28.799 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T06:05:28.799 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T06:05:28.806 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T06:05:28.806 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T06:05:28.806 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T06:05:28.807 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:05:28.807 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T06:05:28.807 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T06:05:28.807 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T06:05:28.807 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T06:05:28.807 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T06:05:28.807 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T06:05:28.807 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T06:05:28.807 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T06:05:28.807 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T06:05:28.807 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:05:28.807 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T06:05:28.808 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:05:28.808 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T06:05:17:607764+0000", 2024-09-19T06:05:28.808 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T06:05:28.808 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T06:05:28.808 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:05:28.808 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T06:05:28.808 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T06:05:28.808 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T06:05:28.808 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T06:05:28.808 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T06:05:28.808 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T06:05:28.808 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T06:05:28.808 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:05:28.809 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T06:05:28.809 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:05:28.809 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T06:05:28.809 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:05:28.809 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T06:05:17.608408+0000", 2024-09-19T06:05:28.809 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T06:05:28.809 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:05:28.809 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T06:05:28.809 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-19T06:05:28.809 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.075+0000 7faa3660a640 1 Processor -- start 2024-09-19T06:05:28.809 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.075+0000 7faa3660a640 1 -- start start 2024-09-19T06:05:28.809 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.075+0000 7faa3660a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa30108170 0x7faa3010a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:28.810 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.075+0000 7faa3660a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faa3007bdf0 con 0x7faa30108170 2024-09-19T06:05:28.810 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.075+0000 7faa2ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa30108170 0x7faa3010a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:28.810 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.075+0000 7faa2ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa30108170 0x7faa3010a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43572/0 (socket says 172.21.15.2:43572) 2024-09-19T06:05:28.810 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.075+0000 7faa2ffff640 1 -- 172.21.15.2:0/1111082959 learned_addr learned my addr 172.21.15.2:0/1111082959 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:05:28.810 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.076+0000 7faa2ffff640 1 -- 172.21.15.2:0/1111082959 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa3010aaa0 con 0x7faa30108170 2024-09-19T06:05:28.810 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.077+0000 7faa2ffff640 1 --2- 172.21.15.2:0/1111082959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa30108170 0x7faa3010a560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7faa20009820 tx=0x7faa2002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=739947a059f794b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:28.810 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.077+0000 7faa2effd640 1 -- 172.21.15.2:0/1111082959 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa20037070 con 0x7faa30108170 2024-09-19T06:05:28.810 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.077+0000 7faa2effd640 1 -- 172.21.15.2:0/1111082959 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7faa200328d0 con 0x7faa30108170 2024-09-19T06:05:28.810 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.077+0000 7faa2effd640 1 -- 172.21.15.2:0/1111082959 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa200307d0 con 0x7faa30108170 2024-09-19T06:05:28.810 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.078+0000 7faa3660a640 1 -- 172.21.15.2:0/1111082959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa30108170 msgr2=0x7faa3010a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:28.810 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.078+0000 7faa3660a640 1 --2- 172.21.15.2:0/1111082959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa30108170 0x7faa3010a560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7faa20009820 tx=0x7faa2002a270 comp rx=0 tx=0).stop 2024-09-19T06:05:28.811 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.078+0000 7faa3660a640 1 -- 172.21.15.2:0/1111082959 shutdown_connections 2024-09-19T06:05:28.811 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.078+0000 7faa3660a640 1 --2- 172.21.15.2:0/1111082959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa30108170 0x7faa3010a560 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:28.811 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.078+0000 7faa3660a640 1 -- 172.21.15.2:0/1111082959 >> 172.21.15.2:0/1111082959 conn(0x7faa30101d90 msgr2=0x7faa301041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:28.811 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.078+0000 7faa3660a640 1 -- 172.21.15.2:0/1111082959 shutdown_connections 2024-09-19T06:05:28.811 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.078+0000 7faa3660a640 1 -- 172.21.15.2:0/1111082959 wait complete. 2024-09-19T06:05:28.811 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.078+0000 7faa3660a640 1 Processor -- start 2024-09-19T06:05:28.811 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.078+0000 7faa3660a640 1 -- start start 2024-09-19T06:05:28.811 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.079+0000 7faa3660a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa30108170 0x7faa301079f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:28.811 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.079+0000 7faa3660a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faa3010ba80 con 0x7faa30108170 2024-09-19T06:05:28.811 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.079+0000 7faa2ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa30108170 0x7faa301079f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:28.811 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.079+0000 7faa2ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa30108170 0x7faa301079f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43586/0 (socket says 172.21.15.2:43586) 2024-09-19T06:05:28.811 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.079+0000 7faa2ffff640 1 -- 172.21.15.2:0/1523414699 learned_addr learned my addr 172.21.15.2:0/1523414699 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:05:28.811 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.079+0000 7faa2ffff640 1 -- 172.21.15.2:0/1523414699 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa30107f30 con 0x7faa30108170 2024-09-19T06:05:28.812 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.079+0000 7faa2ffff640 1 --2- 172.21.15.2:0/1523414699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa30108170 0x7faa301079f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7faa20032e10 tx=0x7faa20032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:28.812 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.079+0000 7faa2d7fa640 1 -- 172.21.15.2:0/1523414699 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa20042070 con 0x7faa30108170 2024-09-19T06:05:28.812 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.080+0000 7faa3660a640 1 -- 172.21.15.2:0/1523414699 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa30106120 con 0x7faa30108170 2024-09-19T06:05:28.812 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.080+0000 7faa2d7fa640 1 -- 172.21.15.2:0/1523414699 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7faa20030c80 con 0x7faa30108170 2024-09-19T06:05:28.812 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.080+0000 7faa2d7fa640 1 -- 172.21.15.2:0/1523414699 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa20037040 con 0x7faa30108170 2024-09-19T06:05:28.812 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.080+0000 7faa3660a640 1 -- 172.21.15.2:0/1523414699 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa30106660 con 0x7faa30108170 2024-09-19T06:05:28.812 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.080+0000 7faa2d7fa640 1 -- 172.21.15.2:0/1523414699 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7faa20045070 con 0x7faa30108170 2024-09-19T06:05:28.812 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.080+0000 7faa2d7fa640 1 -- 172.21.15.2:0/1523414699 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7faa20047a40 con 0x7faa30108170 2024-09-19T06:05:28.812 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.081+0000 7faa3660a640 1 -- 172.21.15.2:0/1523414699 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa301085d0 con 0x7faa30108170 2024-09-19T06:05:28.812 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.083+0000 7faa2d7fa640 1 -- 172.21.15.2:0/1523414699 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7faa2003c6b0 con 0x7faa30108170 2024-09-19T06:05:28.812 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.145+0000 7faa3660a640 1 -- 172.21.15.2:0/1523414699 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7faa301069a0 con 0x7faa30108170 2024-09-19T06:05:28.812 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.145+0000 7faa2d7fa640 1 -- 172.21.15.2:0/1523414699 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7faa2003c890 con 0x7faa30108170 2024-09-19T06:05:28.813 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.146+0000 7faa3660a640 1 -- 172.21.15.2:0/1523414699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa30108170 msgr2=0x7faa301079f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:28.813 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.146+0000 7faa3660a640 1 --2- 172.21.15.2:0/1523414699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa30108170 0x7faa301079f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7faa20032e10 tx=0x7faa20032e40 comp rx=0 tx=0).stop 2024-09-19T06:05:28.813 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.146+0000 7faa3660a640 1 -- 172.21.15.2:0/1523414699 shutdown_connections 2024-09-19T06:05:28.813 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.146+0000 7faa3660a640 1 --2- 172.21.15.2:0/1523414699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa30108170 0x7faa301079f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:28.813 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.146+0000 7faa3660a640 1 -- 172.21.15.2:0/1523414699 >> 172.21.15.2:0/1523414699 conn(0x7faa30101d90 msgr2=0x7faa301028f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:28.813 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.146+0000 7faa3660a640 1 -- 172.21.15.2:0/1523414699 shutdown_connections 2024-09-19T06:05:28.813 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:28.146+0000 7faa3660a640 1 -- 172.21.15.2:0/1523414699 wait complete. 2024-09-19T06:05:28.813 INFO:teuthology.orchestra.run.smithi002.stdout:mgr not available, waiting (2/15)... 2024-09-19T06:05:28.972 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:28 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:28.708+0000 7f487000a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T06:05:29.972 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:29 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:29.534+0000 7f487000a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T06:05:29.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:29 smithi002 ceph-mon[30982]: Activating manager daemon x 2024-09-19T06:05:29.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:29 smithi002 ceph-mon[30982]: mgrmap e2: x(active, starting, since 0.00327302s) 2024-09-19T06:05:29.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:29 smithi002 ceph-mon[30982]: from='mgr.14100 172.21.15.2:0/1727348863' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T06:05:29.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:29 smithi002 ceph-mon[30982]: from='mgr.14100 172.21.15.2:0/1727348863' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T06:05:29.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:29 smithi002 ceph-mon[30982]: from='mgr.14100 172.21.15.2:0/1727348863' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T06:05:29.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:29 smithi002 ceph-mon[30982]: from='mgr.14100 172.21.15.2:0/1727348863' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:05:29.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:29 smithi002 ceph-mon[30982]: from='mgr.14100 172.21.15.2:0/1727348863' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T06:05:29.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:29 smithi002 ceph-mon[30982]: Manager daemon x is now available 2024-09-19T06:05:29.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:29 smithi002 ceph-mon[30982]: from='mgr.14100 172.21.15.2:0/1727348863' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T06:05:29.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:29 smithi002 ceph-mon[30982]: from='mgr.14100 172.21.15.2:0/1727348863' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T06:05:29.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:29 smithi002 ceph-mon[30982]: from='mgr.14100 172.21.15.2:0/1727348863' entity='mgr.x' 2024-09-19T06:05:29.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:29 smithi002 ceph-mon[30982]: from='mgr.14100 172.21.15.2:0/1727348863' entity='mgr.x' 2024-09-19T06:05:29.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:29 smithi002 ceph-mon[30982]: from='mgr.14100 172.21.15.2:0/1727348863' entity='mgr.x' 2024-09-19T06:05:31.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:31 smithi002 ceph-mon[30982]: mgrmap e3: x(active, since 1.00703s) 2024-09-19T06:05:31.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:31 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1878298751' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T06:05:31.994 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-19T06:05:31.994 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-19T06:05:31.994 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsid": "078f6612-764d-11ef-bceb-c7b262605968", 2024-09-19T06:05:31.994 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T06:05:31.994 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T06:05:31.994 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T06:05:31.994 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T06:05:31.995 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:05:31.995 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T06:05:31.995 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T06:05:31.995 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 0 2024-09-19T06:05:31.995 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:05:31.995 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T06:05:31.995 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T06:05:31.995 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:05:31.995 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-19T06:05:31.995 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T06:05:31.995 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:05:31.995 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T06:05:31.995 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T06:05:31.996 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:05:31.996 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T06:05:31.996 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:05:31.996 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T06:05:31.996 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T06:05:31.996 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T06:05:32.005 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T06:05:32.005 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T06:05:32.005 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T06:05:32.005 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:05:32.005 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T06:05:32.005 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T06:05:32.005 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T06:05:32.005 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T06:05:32.005 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T06:05:32.006 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T06:05:32.006 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T06:05:32.006 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T06:05:32.006 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T06:05:32.006 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:05:32.006 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T06:05:32.006 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:05:32.006 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T06:05:17:607764+0000", 2024-09-19T06:05:32.006 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T06:05:32.006 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T06:05:32.006 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:05:32.006 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T06:05:32.006 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T06:05:32.007 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T06:05:32.007 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T06:05:32.007 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T06:05:32.007 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T06:05:32.007 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T06:05:32.007 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:05:32.007 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T06:05:32.007 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:05:32.007 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T06:05:32.007 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:05:32.007 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T06:05:17.608408+0000", 2024-09-19T06:05:32.007 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T06:05:32.007 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:05:32.008 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T06:05:32.008 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-19T06:05:32.008 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.198+0000 7f83d6d0c640 1 Processor -- start 2024-09-19T06:05:32.008 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.198+0000 7f83d6d0c640 1 -- start start 2024-09-19T06:05:32.008 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.199+0000 7f83d6d0c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83d01059e0 0x7f83d0105de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:32.008 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.199+0000 7f83d6d0c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f83d01063b0 con 0x7f83d01059e0 2024-09-19T06:05:32.008 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.199+0000 7f83d4aa8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83d01059e0 0x7f83d0105de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:32.008 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.199+0000 7f83d4aa8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83d01059e0 0x7f83d0105de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43646/0 (socket says 172.21.15.2:43646) 2024-09-19T06:05:32.008 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.199+0000 7f83d4aa8640 1 -- 172.21.15.2:0/2072692085 learned_addr learned my addr 172.21.15.2:0/2072692085 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:05:32.008 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.199+0000 7f83d4aa8640 1 -- 172.21.15.2:0/2072692085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83d01089c0 con 0x7f83d01059e0 2024-09-19T06:05:32.008 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.200+0000 7f83d4aa8640 1 --2- 172.21.15.2:0/2072692085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83d01059e0 0x7f83d0105de0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f83c0009820 tx=0x7f83c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2be44a62824223b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:32.008 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.200+0000 7f83cf7fe640 1 -- 172.21.15.2:0/2072692085 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83c0037070 con 0x7f83d01059e0 2024-09-19T06:05:32.009 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.200+0000 7f83cf7fe640 1 -- 172.21.15.2:0/2072692085 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f83c00328d0 con 0x7f83d01059e0 2024-09-19T06:05:32.009 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.200+0000 7f83cf7fe640 1 -- 172.21.15.2:0/2072692085 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83c00307d0 con 0x7f83d01059e0 2024-09-19T06:05:32.009 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.201+0000 7f83d6d0c640 1 -- 172.21.15.2:0/2072692085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83d01059e0 msgr2=0x7f83d0105de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:32.009 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.201+0000 7f83d6d0c640 1 --2- 172.21.15.2:0/2072692085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83d01059e0 0x7f83d0105de0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f83c0009820 tx=0x7f83c002a270 comp rx=0 tx=0).stop 2024-09-19T06:05:32.009 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.201+0000 7f83d6d0c640 1 -- 172.21.15.2:0/2072692085 shutdown_connections 2024-09-19T06:05:32.009 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.201+0000 7f83d6d0c640 1 --2- 172.21.15.2:0/2072692085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83d01059e0 0x7f83d0105de0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:32.009 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.201+0000 7f83d6d0c640 1 -- 172.21.15.2:0/2072692085 >> 172.21.15.2:0/2072692085 conn(0x7f83d0101590 msgr2=0x7f83d01039b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:32.009 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.201+0000 7f83d6d0c640 1 -- 172.21.15.2:0/2072692085 shutdown_connections 2024-09-19T06:05:32.009 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.201+0000 7f83d6d0c640 1 -- 172.21.15.2:0/2072692085 wait complete. 2024-09-19T06:05:32.009 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.202+0000 7f83d6d0c640 1 Processor -- start 2024-09-19T06:05:32.009 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.202+0000 7f83d6d0c640 1 -- start start 2024-09-19T06:05:32.009 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.202+0000 7f83d6d0c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83d01059e0 0x7f83d019b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:32.010 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.202+0000 7f83d6d0c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f83d010bbf0 con 0x7f83d01059e0 2024-09-19T06:05:32.010 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.202+0000 7f83d4aa8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83d01059e0 0x7f83d019b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:32.010 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.202+0000 7f83d4aa8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83d01059e0 0x7f83d019b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43658/0 (socket says 172.21.15.2:43658) 2024-09-19T06:05:32.010 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.202+0000 7f83d4aa8640 1 -- 172.21.15.2:0/1878298751 learned_addr learned my addr 172.21.15.2:0/1878298751 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:05:32.010 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.202+0000 7f83d4aa8640 1 -- 172.21.15.2:0/1878298751 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83d019bc10 con 0x7f83d01059e0 2024-09-19T06:05:32.010 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.203+0000 7f83d4aa8640 1 --2- 172.21.15.2:0/1878298751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83d01059e0 0x7f83d019b6d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f83c00097f0 tx=0x7f83c0030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:32.010 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.203+0000 7f83cdffb640 1 -- 172.21.15.2:0/1878298751 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83c0037040 con 0x7f83d01059e0 2024-09-19T06:05:32.010 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.203+0000 7f83cdffb640 1 -- 172.21.15.2:0/1878298751 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f83c0032bb0 con 0x7f83d01059e0 2024-09-19T06:05:32.010 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.203+0000 7f83d6d0c640 1 -- 172.21.15.2:0/1878298751 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83d019bea0 con 0x7f83d01059e0 2024-09-19T06:05:32.010 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.203+0000 7f83cdffb640 1 -- 172.21.15.2:0/1878298751 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83c003a390 con 0x7f83d01059e0 2024-09-19T06:05:32.010 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.203+0000 7f83d6d0c640 1 -- 172.21.15.2:0/1878298751 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83d019eb90 con 0x7f83d01059e0 2024-09-19T06:05:32.010 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.204+0000 7f83cdffb640 1 -- 172.21.15.2:0/1878298751 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 3) ==== 46344+0+0 (secure 0 0 0) 0x7f83c003a580 con 0x7f83d01059e0 2024-09-19T06:05:32.010 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.204+0000 7f83cdffb640 1 --2- 172.21.15.2:0/1878298751 >> [v2:172.21.15.2:6800/1602650352,v1:172.21.15.2:6801/1602650352] conn(0x7f83b80390a0 0x7f83b803b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:32.011 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.204+0000 7f83d6d0c640 1 -- 172.21.15.2:0/1878298751 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83d0105e60 con 0x7f83d01059e0 2024-09-19T06:05:32.011 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.204+0000 7f83cdffb640 1 -- 172.21.15.2:0/1878298751 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f83c006c150 con 0x7f83d01059e0 2024-09-19T06:05:32.011 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.204+0000 7f83cffff640 1 --2- 172.21.15.2:0/1878298751 >> [v2:172.21.15.2:6800/1602650352,v1:172.21.15.2:6801/1602650352] conn(0x7f83b80390a0 0x7f83b803b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:32.011 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.205+0000 7f83cffff640 1 --2- 172.21.15.2:0/1878298751 >> [v2:172.21.15.2:6800/1602650352,v1:172.21.15.2:6801/1602650352] conn(0x7f83b80390a0 0x7f83b803b560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f83c40098c0 tx=0x7f83c4006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:32.011 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.210+0000 7f83cdffb640 1 -- 172.21.15.2:0/1878298751 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f83c0040210 con 0x7f83d01059e0 2024-09-19T06:05:32.011 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.452+0000 7f83d6d0c640 1 -- 172.21.15.2:0/1878298751 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f83d019f210 con 0x7f83d01059e0 2024-09-19T06:05:32.011 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.452+0000 7f83cdffb640 1 -- 172.21.15.2:0/1878298751 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7f83c0031560 con 0x7f83d01059e0 2024-09-19T06:05:32.011 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.455+0000 7f83d6d0c640 1 -- 172.21.15.2:0/1878298751 >> [v2:172.21.15.2:6800/1602650352,v1:172.21.15.2:6801/1602650352] conn(0x7f83b80390a0 msgr2=0x7f83b803b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:32.011 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.455+0000 7f83d6d0c640 1 --2- 172.21.15.2:0/1878298751 >> [v2:172.21.15.2:6800/1602650352,v1:172.21.15.2:6801/1602650352] conn(0x7f83b80390a0 0x7f83b803b560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f83c40098c0 tx=0x7f83c4006db0 comp rx=0 tx=0).stop 2024-09-19T06:05:32.011 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.455+0000 7f83d6d0c640 1 -- 172.21.15.2:0/1878298751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83d01059e0 msgr2=0x7f83d019b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:32.011 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.455+0000 7f83d6d0c640 1 --2- 172.21.15.2:0/1878298751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83d01059e0 0x7f83d019b6d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f83c00097f0 tx=0x7f83c0030d00 comp rx=0 tx=0).stop 2024-09-19T06:05:32.011 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.455+0000 7f83d6d0c640 1 -- 172.21.15.2:0/1878298751 shutdown_connections 2024-09-19T06:05:32.011 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.455+0000 7f83d6d0c640 1 --2- 172.21.15.2:0/1878298751 >> [v2:172.21.15.2:6800/1602650352,v1:172.21.15.2:6801/1602650352] conn(0x7f83b80390a0 0x7f83b803b560 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:32.012 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.455+0000 7f83d6d0c640 1 --2- 172.21.15.2:0/1878298751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83d01059e0 0x7f83d019b6d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:32.012 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.455+0000 7f83d6d0c640 1 -- 172.21.15.2:0/1878298751 >> 172.21.15.2:0/1878298751 conn(0x7f83d0101590 msgr2=0x7f83d0102100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:32.012 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.455+0000 7f83d6d0c640 1 -- 172.21.15.2:0/1878298751 shutdown_connections 2024-09-19T06:05:32.012 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:31.455+0000 7f83d6d0c640 1 -- 172.21.15.2:0/1878298751 wait complete. 2024-09-19T06:05:32.012 INFO:teuthology.orchestra.run.smithi002.stdout:mgr is available 2024-09-19T06:05:32.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:32 smithi002 ceph-mon[30982]: mgrmap e4: x(active, since 2s) 2024-09-19T06:05:33.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:33 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/338773651' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T06:05:39.276 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-19T06:05:39.276 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T06:05:39.276 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout fsid = 078f6612-764d-11ef-bceb-c7b262605968 2024-09-19T06:05:39.277 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.2:3300,v1:172.21.15.2:6789] 2024-09-19T06:05:39.277 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T06:05:39.277 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T06:05:39.277 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T06:05:39.286 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T06:05:39.286 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-19T06:05:39.286 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T06:05:39.286 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T06:05:39.286 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-19T06:05:39.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T06:05:39.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T06:05:39.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T06:05:39.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T06:05:39.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T06:05:39.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T06:05:39.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.557+0000 7fe194d94640 1 Processor -- start 2024-09-19T06:05:39.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.557+0000 7fe194d94640 1 -- start start 2024-09-19T06:05:39.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.558+0000 7fe194d94640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1901065f0 0x7fe1901069f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:39.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.558+0000 7fe194d94640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe190106fc0 con 0x7fe1901065f0 2024-09-19T06:05:39.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.558+0000 7fe18e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1901065f0 0x7fe1901069f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:39.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.558+0000 7fe18e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1901065f0 0x7fe1901069f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43660/0 (socket says 172.21.15.2:43660) 2024-09-19T06:05:39.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.558+0000 7fe18e59c640 1 -- 172.21.15.2:0/1298035142 learned_addr learned my addr 172.21.15.2:0/1298035142 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:05:39.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.558+0000 7fe18e59c640 1 -- 172.21.15.2:0/1298035142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1901077f0 con 0x7fe1901065f0 2024-09-19T06:05:39.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.559+0000 7fe18e59c640 1 --2- 172.21.15.2:0/1298035142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1901065f0 0x7fe1901069f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe180009820 tx=0x7fe18002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=379fcf28db349935 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:39.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.559+0000 7fe18d59a640 1 -- 172.21.15.2:0/1298035142 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe180037070 con 0x7fe1901065f0 2024-09-19T06:05:39.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.559+0000 7fe18d59a640 1 -- 172.21.15.2:0/1298035142 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fe1800328d0 con 0x7fe1901065f0 2024-09-19T06:05:39.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.559+0000 7fe18d59a640 1 -- 172.21.15.2:0/1298035142 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1800307d0 con 0x7fe1901065f0 2024-09-19T06:05:39.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.560+0000 7fe194d94640 1 -- 172.21.15.2:0/1298035142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1901065f0 msgr2=0x7fe1901069f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:39.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.560+0000 7fe194d94640 1 --2- 172.21.15.2:0/1298035142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1901065f0 0x7fe1901069f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe180009820 tx=0x7fe18002a270 comp rx=0 tx=0).stop 2024-09-19T06:05:39.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.560+0000 7fe194d94640 1 -- 172.21.15.2:0/1298035142 shutdown_connections 2024-09-19T06:05:39.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.560+0000 7fe194d94640 1 --2- 172.21.15.2:0/1298035142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1901065f0 0x7fe1901069f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:39.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.560+0000 7fe194d94640 1 -- 172.21.15.2:0/1298035142 >> 172.21.15.2:0/1298035142 conn(0x7fe190101d40 msgr2=0x7fe1901041c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:39.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.560+0000 7fe194d94640 1 -- 172.21.15.2:0/1298035142 shutdown_connections 2024-09-19T06:05:39.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.560+0000 7fe194d94640 1 -- 172.21.15.2:0/1298035142 wait complete. 2024-09-19T06:05:39.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.561+0000 7fe194d94640 1 Processor -- start 2024-09-19T06:05:39.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.561+0000 7fe194d94640 1 -- start start 2024-09-19T06:05:39.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.561+0000 7fe194d94640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1901065f0 0x7fe190191820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:39.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.561+0000 7fe194d94640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe19010aba0 con 0x7fe1901065f0 2024-09-19T06:05:39.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.561+0000 7fe18e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1901065f0 0x7fe190191820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:39.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.561+0000 7fe18e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1901065f0 0x7fe190191820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43666/0 (socket says 172.21.15.2:43666) 2024-09-19T06:05:39.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.561+0000 7fe18e59c640 1 -- 172.21.15.2:0/338773651 learned_addr learned my addr 172.21.15.2:0/338773651 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:05:39.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.561+0000 7fe18e59c640 1 -- 172.21.15.2:0/338773651 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe190191d60 con 0x7fe1901065f0 2024-09-19T06:05:39.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.561+0000 7fe18e59c640 1 --2- 172.21.15.2:0/338773651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1901065f0 0x7fe190191820 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe1800097f0 tx=0x7fe180030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:39.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.562+0000 7fe1877fe640 1 -- 172.21.15.2:0/338773651 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe180037040 con 0x7fe1901065f0 2024-09-19T06:05:39.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.562+0000 7fe1877fe640 1 -- 172.21.15.2:0/338773651 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fe180032bb0 con 0x7fe1901065f0 2024-09-19T06:05:39.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.562+0000 7fe1877fe640 1 -- 172.21.15.2:0/338773651 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe18003a390 con 0x7fe1901065f0 2024-09-19T06:05:39.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.562+0000 7fe194d94640 1 -- 172.21.15.2:0/338773651 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe19018ff50 con 0x7fe1901065f0 2024-09-19T06:05:39.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.562+0000 7fe194d94640 1 -- 172.21.15.2:0/338773651 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe190190490 con 0x7fe1901065f0 2024-09-19T06:05:39.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.563+0000 7fe1877fe640 1 -- 172.21.15.2:0/338773651 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7fe18003a580 con 0x7fe1901065f0 2024-09-19T06:05:39.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.563+0000 7fe1877fe640 1 --2- 172.21.15.2:0/338773651 >> [v2:172.21.15.2:6800/1602650352,v1:172.21.15.2:6801/1602650352] conn(0x7fe17c0391b0 0x7fe17c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:39.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.563+0000 7fe1877fe640 1 -- 172.21.15.2:0/338773651 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe18006c520 con 0x7fe1901065f0 2024-09-19T06:05:39.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.563+0000 7fe194d94640 1 -- 172.21.15.2:0/338773651 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe19010ad20 con 0x7fe1901065f0 2024-09-19T06:05:39.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.563+0000 7fe18dd9b640 1 --2- 172.21.15.2:0/338773651 >> [v2:172.21.15.2:6800/1602650352,v1:172.21.15.2:6801/1602650352] conn(0x7fe17c0391b0 0x7fe17c03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:39.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.563+0000 7fe18dd9b640 1 --2- 172.21.15.2:0/338773651 >> [v2:172.21.15.2:6800/1602650352,v1:172.21.15.2:6801/1602650352] conn(0x7fe17c0391b0 0x7fe17c03b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe1780098c0 tx=0x7fe178006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:39.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.568+0000 7fe1877fe640 1 -- 172.21.15.2:0/338773651 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe1800313a0 con 0x7fe1901065f0 2024-09-19T06:05:39.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.747+0000 7fe194d94640 1 -- 172.21.15.2:0/338773651 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fe190195470 con 0x7fe1901065f0 2024-09-19T06:05:39.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.748+0000 7fe1877fe640 1 -- 172.21.15.2:0/338773651 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+427 (secure 0 0 0) 0x7fe18006bf40 con 0x7fe1901065f0 2024-09-19T06:05:39.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.750+0000 7fe194d94640 1 -- 172.21.15.2:0/338773651 >> [v2:172.21.15.2:6800/1602650352,v1:172.21.15.2:6801/1602650352] conn(0x7fe17c0391b0 msgr2=0x7fe17c03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:39.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.750+0000 7fe194d94640 1 --2- 172.21.15.2:0/338773651 >> [v2:172.21.15.2:6800/1602650352,v1:172.21.15.2:6801/1602650352] conn(0x7fe17c0391b0 0x7fe17c03b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe1780098c0 tx=0x7fe178006db0 comp rx=0 tx=0).stop 2024-09-19T06:05:39.292 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.750+0000 7fe194d94640 1 -- 172.21.15.2:0/338773651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1901065f0 msgr2=0x7fe190191820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:39.292 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.750+0000 7fe194d94640 1 --2- 172.21.15.2:0/338773651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1901065f0 0x7fe190191820 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe1800097f0 tx=0x7fe180030d00 comp rx=0 tx=0).stop 2024-09-19T06:05:39.292 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.751+0000 7fe194d94640 1 -- 172.21.15.2:0/338773651 shutdown_connections 2024-09-19T06:05:39.292 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.751+0000 7fe194d94640 1 --2- 172.21.15.2:0/338773651 >> [v2:172.21.15.2:6800/1602650352,v1:172.21.15.2:6801/1602650352] conn(0x7fe17c0391b0 0x7fe17c03b670 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:39.292 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.751+0000 7fe194d94640 1 --2- 172.21.15.2:0/338773651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1901065f0 0x7fe190191820 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:39.292 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.751+0000 7fe194d94640 1 -- 172.21.15.2:0/338773651 >> 172.21.15.2:0/338773651 conn(0x7fe190101d40 msgr2=0x7fe190102c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:39.292 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.751+0000 7fe194d94640 1 -- 172.21.15.2:0/338773651 shutdown_connections 2024-09-19T06:05:39.292 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:32.751+0000 7fe194d94640 1 -- 172.21.15.2:0/338773651 wait complete. 2024-09-19T06:05:39.292 INFO:teuthology.orchestra.run.smithi002.stdout:Enabling cephadm module... 2024-09-19T06:05:42.633 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:42 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/2286757985' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-19T06:05:42.634 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:42 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: ignoring --setuser ceph since I am not root 2024-09-19T06:05:42.634 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:42 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: ignoring --setgroup ceph since I am not root 2024-09-19T06:05:42.634 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:42 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:42.570+0000 7f1e55ae5040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T06:05:42.634 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:42 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:42.631+0000 7f1e55ae5040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T06:05:42.909 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:42 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:42.785+0000 7f1e55ae5040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T06:05:42.910 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:42 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:42.855+0000 7f1e55ae5040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T06:05:43.176 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:43 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:43.011+0000 7f1e55ae5040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:05:43.176 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:43 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:43.158+0000 7f1e55ae5040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T06:05:43.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:43 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/2286757985' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-19T06:05:43.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:43 smithi002 ceph-mon[30982]: mgrmap e5: x(active, since 12s) 2024-09-19T06:05:43.752 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:43 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:43.489+0000 7f1e55ae5040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T06:05:43.752 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:43 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:43.553+0000 7f1e55ae5040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T06:05:43.752 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:43 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:43.750+0000 7f1e55ae5040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T06:05:44.719 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.133+0000 7f273cc80640 1 Processor -- start 2024-09-19T06:05:44.719 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.133+0000 7f273cc80640 1 -- start start 2024-09-19T06:05:44.719 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.133+0000 7f273cc80640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27381081b0 0x7f273810a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:44.720 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.133+0000 7f273cc80640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f273807bdf0 con 0x7f27381081b0 2024-09-19T06:05:44.720 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.134+0000 7f273659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27381081b0 0x7f273810a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:44.720 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.134+0000 7f273659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27381081b0 0x7f273810a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51168/0 (socket says 172.21.15.2:51168) 2024-09-19T06:05:44.720 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.134+0000 7f273659c640 1 -- 172.21.15.2:0/2915935931 learned_addr learned my addr 172.21.15.2:0/2915935931 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:05:44.720 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.134+0000 7f273659c640 1 -- 172.21.15.2:0/2915935931 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f273810aae0 con 0x7f27381081b0 2024-09-19T06:05:44.720 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.135+0000 7f273659c640 1 --2- 172.21.15.2:0/2915935931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27381081b0 0x7f273810a5a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2728009e80 tx=0x7f272802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5219e928fe09b6d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:44.720 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.135+0000 7f273559a640 1 -- 172.21.15.2:0/2915935931 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2728036070 con 0x7f27381081b0 2024-09-19T06:05:44.720 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.135+0000 7f273559a640 1 -- 172.21.15.2:0/2915935931 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f2728031890 con 0x7f27381081b0 2024-09-19T06:05:44.720 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.135+0000 7f273559a640 1 -- 172.21.15.2:0/2915935931 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2728007980 con 0x7f27381081b0 2024-09-19T06:05:44.720 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.135+0000 7f273cc80640 1 -- 172.21.15.2:0/2915935931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27381081b0 msgr2=0x7f273810a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:44.720 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.135+0000 7f273cc80640 1 --2- 172.21.15.2:0/2915935931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27381081b0 0x7f273810a5a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2728009e80 tx=0x7f272802a7a0 comp rx=0 tx=0).stop 2024-09-19T06:05:44.720 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.136+0000 7f273cc80640 1 -- 172.21.15.2:0/2915935931 shutdown_connections 2024-09-19T06:05:44.721 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.136+0000 7f273cc80640 1 --2- 172.21.15.2:0/2915935931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27381081b0 0x7f273810a5a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:44.721 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.136+0000 7f273cc80640 1 -- 172.21.15.2:0/2915935931 >> 172.21.15.2:0/2915935931 conn(0x7f2738101dd0 msgr2=0x7f2738104210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:44.721 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.136+0000 7f273cc80640 1 -- 172.21.15.2:0/2915935931 shutdown_connections 2024-09-19T06:05:44.721 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.136+0000 7f273cc80640 1 -- 172.21.15.2:0/2915935931 wait complete. 2024-09-19T06:05:44.721 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.136+0000 7f273cc80640 1 Processor -- start 2024-09-19T06:05:44.721 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.136+0000 7f273cc80640 1 -- start start 2024-09-19T06:05:44.721 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.137+0000 7f273cc80640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27381081b0 0x7f273819b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:44.721 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.137+0000 7f273cc80640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f273810bac0 con 0x7f27381081b0 2024-09-19T06:05:44.721 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.137+0000 7f273659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27381081b0 0x7f273819b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:44.721 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.137+0000 7f273659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27381081b0 0x7f273819b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51184/0 (socket says 172.21.15.2:51184) 2024-09-19T06:05:44.721 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.137+0000 7f273659c640 1 -- 172.21.15.2:0/2286757985 learned_addr learned my addr 172.21.15.2:0/2286757985 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:05:44.721 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.137+0000 7f273659c640 1 -- 172.21.15.2:0/2286757985 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f273819bc10 con 0x7f27381081b0 2024-09-19T06:05:44.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.137+0000 7f273659c640 1 --2- 172.21.15.2:0/2286757985 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27381081b0 0x7f273819b6d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2728009680 tx=0x7f2728031c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:44.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.137+0000 7f272f7fe640 1 -- 172.21.15.2:0/2286757985 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2728041020 con 0x7f27381081b0 2024-09-19T06:05:44.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.137+0000 7f272f7fe640 1 -- 172.21.15.2:0/2286757985 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f272803c900 con 0x7f27381081b0 2024-09-19T06:05:44.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.137+0000 7f273cc80640 1 -- 172.21.15.2:0/2286757985 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f273819bea0 con 0x7f27381081b0 2024-09-19T06:05:44.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.137+0000 7f272f7fe640 1 -- 172.21.15.2:0/2286757985 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2728036040 con 0x7f27381081b0 2024-09-19T06:05:44.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.138+0000 7f273cc80640 1 -- 172.21.15.2:0/2286757985 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f273819eb90 con 0x7f27381081b0 2024-09-19T06:05:44.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.138+0000 7f272f7fe640 1 -- 172.21.15.2:0/2286757985 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f2728044020 con 0x7f27381081b0 2024-09-19T06:05:44.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.139+0000 7f272f7fe640 1 --2- 172.21.15.2:0/2286757985 >> [v2:172.21.15.2:6800/1602650352,v1:172.21.15.2:6801/1602650352] conn(0x7f27240391b0 0x7f272403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:44.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.139+0000 7f272f7fe640 1 -- 172.21.15.2:0/2286757985 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f272806d330 con 0x7f27381081b0 2024-09-19T06:05:44.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.139+0000 7f273cc80640 1 -- 172.21.15.2:0/2286757985 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2738108610 con 0x7f27381081b0 2024-09-19T06:05:44.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.139+0000 7f2735d9b640 1 --2- 172.21.15.2:0/2286757985 >> [v2:172.21.15.2:6800/1602650352,v1:172.21.15.2:6801/1602650352] conn(0x7f27240391b0 0x7f272403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:44.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.139+0000 7f2735d9b640 1 --2- 172.21.15.2:0/2286757985 >> [v2:172.21.15.2:6800/1602650352,v1:172.21.15.2:6801/1602650352] conn(0x7f27240391b0 0x7f272403b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f27200098c0 tx=0x7f2720006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:44.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.144+0000 7f272f7fe640 1 -- 172.21.15.2:0/2286757985 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f272804b020 con 0x7f27381081b0 2024-09-19T06:05:44.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.366+0000 7f273cc80640 1 -- 172.21.15.2:0/2286757985 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f273819ed60 con 0x7f27381081b0 2024-09-19T06:05:44.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.418+0000 7f272f7fe640 1 -- 172.21.15.2:0/2286757985 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f273819ed60 con 0x7f27381081b0 2024-09-19T06:05:44.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.419+0000 7f272f7fe640 1 -- 172.21.15.2:0/2286757985 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f2728046400 con 0x7f27381081b0 2024-09-19T06:05:44.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.421+0000 7f273cc80640 1 -- 172.21.15.2:0/2286757985 >> [v2:172.21.15.2:6800/1602650352,v1:172.21.15.2:6801/1602650352] conn(0x7f27240391b0 msgr2=0x7f272403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:44.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.421+0000 7f273cc80640 1 --2- 172.21.15.2:0/2286757985 >> [v2:172.21.15.2:6800/1602650352,v1:172.21.15.2:6801/1602650352] conn(0x7f27240391b0 0x7f272403b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f27200098c0 tx=0x7f2720006db0 comp rx=0 tx=0).stop 2024-09-19T06:05:44.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.421+0000 7f273cc80640 1 -- 172.21.15.2:0/2286757985 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27381081b0 msgr2=0x7f273819b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:44.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.421+0000 7f273cc80640 1 --2- 172.21.15.2:0/2286757985 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27381081b0 0x7f273819b6d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2728009680 tx=0x7f2728031c70 comp rx=0 tx=0).stop 2024-09-19T06:05:44.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.421+0000 7f273cc80640 1 -- 172.21.15.2:0/2286757985 shutdown_connections 2024-09-19T06:05:44.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.421+0000 7f273cc80640 1 --2- 172.21.15.2:0/2286757985 >> [v2:172.21.15.2:6800/1602650352,v1:172.21.15.2:6801/1602650352] conn(0x7f27240391b0 0x7f272403b670 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:44.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.421+0000 7f273cc80640 1 --2- 172.21.15.2:0/2286757985 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27381081b0 0x7f273819b6d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:44.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.421+0000 7f273cc80640 1 -- 172.21.15.2:0/2286757985 >> 172.21.15.2:0/2286757985 conn(0x7f2738101dd0 msgr2=0x7f27381029d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:44.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.421+0000 7f273cc80640 1 -- 172.21.15.2:0/2286757985 shutdown_connections 2024-09-19T06:05:44.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:42.421+0000 7f273cc80640 1 -- 172.21.15.2:0/2286757985 wait complete. 2024-09-19T06:05:44.767 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:44 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:44.690+0000 7f1e55ae5040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T06:05:44.767 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:44 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:44.764+0000 7f1e55ae5040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T06:05:45.660 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:45 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/927904838' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T06:05:45.660 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:45 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:45.535+0000 7f1e55ae5040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T06:05:45.660 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:45 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:45.658+0000 7f1e55ae5040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T06:05:45.972 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:45 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:45.809+0000 7f1e55ae5040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:05:45.972 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:45 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:45.874+0000 7f1e55ae5040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T06:05:46.336 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:46 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:46.033+0000 7f1e55ae5040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T06:05:46.337 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:46 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:46.104+0000 7f1e55ae5040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T06:05:46.337 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:46 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:46.167+0000 7f1e55ae5040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T06:05:46.337 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:46 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:46.334+0000 7f1e55ae5040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T06:05:46.501 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-19T06:05:46.502 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-19T06:05:46.502 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T06:05:46.502 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T06:05:46.502 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T06:05:46.502 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-19T06:05:46.502 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.119+0000 7f7a05947640 1 Processor -- start 2024-09-19T06:05:46.502 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.119+0000 7f7a05947640 1 -- start start 2024-09-19T06:05:46.503 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.119+0000 7f7a05947640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a001081c0 0x7f7a0010a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:46.503 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.119+0000 7f7a05947640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7a0007be00 con 0x7f7a001081c0 2024-09-19T06:05:46.503 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.120+0000 7f79feffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a001081c0 0x7f7a0010a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:46.503 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.120+0000 7f79feffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a001081c0 0x7f7a0010a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51226/0 (socket says 172.21.15.2:51226) 2024-09-19T06:05:46.503 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.120+0000 7f79feffd640 1 -- 172.21.15.2:0/1349768751 learned_addr learned my addr 172.21.15.2:0/1349768751 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:05:46.503 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.120+0000 7f79feffd640 1 -- 172.21.15.2:0/1349768751 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a0010aaf0 con 0x7f7a001081c0 2024-09-19T06:05:46.503 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.121+0000 7f79feffd640 1 --2- 172.21.15.2:0/1349768751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a001081c0 0x7f7a0010a5b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f79f0009820 tx=0x7f79f002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=208e837fd67ce60c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:46.503 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.121+0000 7f79fe7fc640 1 -- 172.21.15.2:0/1349768751 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79f0037070 con 0x7f7a001081c0 2024-09-19T06:05:46.503 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.121+0000 7f79fe7fc640 1 -- 172.21.15.2:0/1349768751 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f79f00328d0 con 0x7f7a001081c0 2024-09-19T06:05:46.503 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.121+0000 7f79fe7fc640 1 -- 172.21.15.2:0/1349768751 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79f00307d0 con 0x7f7a001081c0 2024-09-19T06:05:46.503 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.122+0000 7f7a05947640 1 -- 172.21.15.2:0/1349768751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a001081c0 msgr2=0x7f7a0010a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:46.503 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.122+0000 7f7a05947640 1 --2- 172.21.15.2:0/1349768751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a001081c0 0x7f7a0010a5b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f79f0009820 tx=0x7f79f002a270 comp rx=0 tx=0).stop 2024-09-19T06:05:46.504 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.122+0000 7f7a05947640 1 -- 172.21.15.2:0/1349768751 shutdown_connections 2024-09-19T06:05:46.504 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.122+0000 7f7a05947640 1 --2- 172.21.15.2:0/1349768751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a001081c0 0x7f7a0010a5b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:46.504 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.122+0000 7f7a05947640 1 -- 172.21.15.2:0/1349768751 >> 172.21.15.2:0/1349768751 conn(0x7f7a00101e20 msgr2=0x7f7a00104240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:46.504 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.122+0000 7f7a05947640 1 -- 172.21.15.2:0/1349768751 shutdown_connections 2024-09-19T06:05:46.504 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.122+0000 7f7a05947640 1 -- 172.21.15.2:0/1349768751 wait complete. 2024-09-19T06:05:46.504 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.122+0000 7f7a05947640 1 Processor -- start 2024-09-19T06:05:46.504 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.122+0000 7f7a05947640 1 -- start start 2024-09-19T06:05:46.504 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.122+0000 7f7a05947640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a001081c0 0x7f7a0019b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:46.504 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.122+0000 7f7a05947640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7a0010bad0 con 0x7f7a001081c0 2024-09-19T06:05:46.504 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.123+0000 7f79feffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a001081c0 0x7f7a0019b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:46.504 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.123+0000 7f79feffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a001081c0 0x7f7a0019b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51240/0 (socket says 172.21.15.2:51240) 2024-09-19T06:05:46.504 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.123+0000 7f79feffd640 1 -- 172.21.15.2:0/927904838 learned_addr learned my addr 172.21.15.2:0/927904838 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:05:46.504 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.123+0000 7f79feffd640 1 -- 172.21.15.2:0/927904838 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a0019bc20 con 0x7f7a001081c0 2024-09-19T06:05:46.505 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.123+0000 7f79feffd640 1 --2- 172.21.15.2:0/927904838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a001081c0 0x7f7a0019b6e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f79f0030520 tx=0x7f79f0032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:46.505 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.123+0000 7f7a04945640 1 -- 172.21.15.2:0/927904838 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79f0042070 con 0x7f7a001081c0 2024-09-19T06:05:46.505 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.123+0000 7f7a04945640 1 -- 172.21.15.2:0/927904838 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f79f0030cc0 con 0x7f7a001081c0 2024-09-19T06:05:46.505 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.123+0000 7f7a05947640 1 -- 172.21.15.2:0/927904838 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a0019beb0 con 0x7f7a001081c0 2024-09-19T06:05:46.505 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.123+0000 7f7a04945640 1 -- 172.21.15.2:0/927904838 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79f0037040 con 0x7f7a001081c0 2024-09-19T06:05:46.505 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.123+0000 7f7a05947640 1 -- 172.21.15.2:0/927904838 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a0019eba0 con 0x7f7a001081c0 2024-09-19T06:05:46.505 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.124+0000 7f7a04945640 1 -- 172.21.15.2:0/927904838 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f79f0045070 con 0x7f7a001081c0 2024-09-19T06:05:46.505 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.124+0000 7f7a05947640 1 -- 172.21.15.2:0/927904838 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a00108620 con 0x7f7a001081c0 2024-09-19T06:05:46.505 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.125+0000 7f7a04945640 1 --2- 172.21.15.2:0/927904838 >> [v2:172.21.15.2:6800/1602650352,v1:172.21.15.2:6801/1602650352] conn(0x7f79ec0391b0 0x7f79ec03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:46.505 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.125+0000 7f7a04945640 1 -- 172.21.15.2:0/927904838 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f79f006c2d0 con 0x7f7a001081c0 2024-09-19T06:05:46.505 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.125+0000 7f79f7fff640 1 -- 172.21.15.2:0/927904838 >> [v2:172.21.15.2:6800/1602650352,v1:172.21.15.2:6801/1602650352] conn(0x7f79ec0391b0 msgr2=0x7f79ec03b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/1602650352 2024-09-19T06:05:46.505 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.125+0000 7f79f7fff640 1 --2- 172.21.15.2:0/927904838 >> [v2:172.21.15.2:6800/1602650352,v1:172.21.15.2:6801/1602650352] conn(0x7f79ec0391b0 0x7f79ec03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:05:46.505 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.133+0000 7f7a04945640 1 -- 172.21.15.2:0/927904838 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f79f003be10 con 0x7f7a001081c0 2024-09-19T06:05:46.506 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.326+0000 7f79f7fff640 1 -- 172.21.15.2:0/927904838 >> [v2:172.21.15.2:6800/1602650352,v1:172.21.15.2:6801/1602650352] conn(0x7f79ec0391b0 msgr2=0x7f79ec03b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/1602650352 2024-09-19T06:05:46.506 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.326+0000 7f79f7fff640 1 --2- 172.21.15.2:0/927904838 >> [v2:172.21.15.2:6800/1602650352,v1:172.21.15.2:6801/1602650352] conn(0x7f79ec0391b0 0x7f79ec03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T06:05:46.506 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.356+0000 7f7a05947640 1 -- 172.21.15.2:0/927904838 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f7a0019f220 con 0x7f7a001081c0 2024-09-19T06:05:46.506 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.357+0000 7f7a04945640 1 -- 172.21.15.2:0/927904838 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f79f0046bd0 con 0x7f7a001081c0 2024-09-19T06:05:46.506 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.359+0000 7f7a05947640 1 -- 172.21.15.2:0/927904838 >> [v2:172.21.15.2:6800/1602650352,v1:172.21.15.2:6801/1602650352] conn(0x7f79ec0391b0 msgr2=0x7f79ec03b670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:05:46.506 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.359+0000 7f7a05947640 1 --2- 172.21.15.2:0/927904838 >> [v2:172.21.15.2:6800/1602650352,v1:172.21.15.2:6801/1602650352] conn(0x7f79ec0391b0 0x7f79ec03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:46.506 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.359+0000 7f7a05947640 1 -- 172.21.15.2:0/927904838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a001081c0 msgr2=0x7f7a0019b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:46.506 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.359+0000 7f7a05947640 1 --2- 172.21.15.2:0/927904838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a001081c0 0x7f7a0019b6e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f79f0030520 tx=0x7f79f0032dd0 comp rx=0 tx=0).stop 2024-09-19T06:05:46.506 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.359+0000 7f7a05947640 1 -- 172.21.15.2:0/927904838 shutdown_connections 2024-09-19T06:05:46.506 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.359+0000 7f7a05947640 1 --2- 172.21.15.2:0/927904838 >> [v2:172.21.15.2:6800/1602650352,v1:172.21.15.2:6801/1602650352] conn(0x7f79ec0391b0 0x7f79ec03b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:46.506 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.359+0000 7f7a05947640 1 --2- 172.21.15.2:0/927904838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a001081c0 0x7f7a0019b6e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:46.506 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.359+0000 7f7a05947640 1 -- 172.21.15.2:0/927904838 >> 172.21.15.2:0/927904838 conn(0x7f7a00101e20 msgr2=0x7f7a00102a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:46.506 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.359+0000 7f7a05947640 1 -- 172.21.15.2:0/927904838 shutdown_connections 2024-09-19T06:05:46.507 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:45.359+0000 7f7a05947640 1 -- 172.21.15.2:0/927904838 wait complete. 2024-09-19T06:05:46.507 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for the mgr to restart... 2024-09-19T06:05:46.507 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr epoch 5... 2024-09-19T06:05:46.628 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:46 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:46.403+0000 7f1e55ae5040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T06:05:46.628 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:46 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:46.473+0000 7f1e55ae5040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T06:05:46.628 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:46 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:46.570+0000 7f1e55ae5040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T06:05:46.897 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:46 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:46.633+0000 7f1e55ae5040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T06:05:46.897 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:46 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:46.696+0000 7f1e55ae5040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T06:05:47.972 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:47 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:47.536+0000 7f1e55ae5040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T06:05:47.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:47 smithi002 ceph-mon[30982]: Active manager daemon x restarted 2024-09-19T06:05:47.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:47 smithi002 ceph-mon[30982]: Activating manager daemon x 2024-09-19T06:05:47.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:47 smithi002 ceph-mon[30982]: osdmap e2: 0 total, 0 up, 0 in 2024-09-19T06:05:47.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:47 smithi002 ceph-mon[30982]: mgrmap e6: x(active, starting, since 0.00327336s) 2024-09-19T06:05:47.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:47 smithi002 ceph-mon[30982]: from='mgr.14118 172.21.15.2:0/1043732806' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:05:47.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:47 smithi002 ceph-mon[30982]: from='mgr.14118 172.21.15.2:0/1043732806' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T06:05:47.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:47 smithi002 ceph-mon[30982]: from='mgr.14118 172.21.15.2:0/1043732806' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T06:05:47.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:47 smithi002 ceph-mon[30982]: from='mgr.14118 172.21.15.2:0/1043732806' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T06:05:47.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:47 smithi002 ceph-mon[30982]: from='mgr.14118 172.21.15.2:0/1043732806' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T06:05:47.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:47 smithi002 ceph-mon[30982]: Manager daemon x is now available 2024-09-19T06:05:47.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:47 smithi002 ceph-mon[30982]: from='mgr.14118 172.21.15.2:0/1043732806' entity='mgr.x' 2024-09-19T06:05:47.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:47 smithi002 ceph-mon[30982]: from='mgr.14118 172.21.15.2:0/1043732806' entity='mgr.x' 2024-09-19T06:05:47.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:47 smithi002 ceph-mon[30982]: from='mgr.14118 172.21.15.2:0/1043732806' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:05:47.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:47 smithi002 ceph-mon[30982]: from='mgr.14118 172.21.15.2:0/1043732806' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:05:47.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:47 smithi002 ceph-mon[30982]: from='mgr.14118 172.21.15.2:0/1043732806' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T06:05:47.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:47 smithi002 ceph-mon[30982]: from='mgr.14118 172.21.15.2:0/1043732806' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T06:05:48.899 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:48 smithi002 ceph-mon[30982]: Found migration_current of "None". Setting to last migration. 2024-09-19T06:05:48.899 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:48 smithi002 ceph-mon[30982]: mgrmap e7: x(active, since 1.00547s) 2024-09-19T06:05:49.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-19T06:05:49.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-19T06:05:49.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T06:05:49.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-19T06:05:49.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:46.975+0000 7f5915065640 1 Processor -- start 2024-09-19T06:05:49.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:46.975+0000 7f5915065640 1 -- start start 2024-09-19T06:05:49.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:46.975+0000 7f5915065640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5910108160 0x7f591010a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:49.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:46.975+0000 7f5915065640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f591007be40 con 0x7f5910108160 2024-09-19T06:05:49.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:46.975+0000 7f590ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5910108160 0x7f591010a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:49.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:46.975+0000 7f590ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5910108160 0x7f591010a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56188/0 (socket says 172.21.15.2:56188) 2024-09-19T06:05:49.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:46.975+0000 7f590ed9d640 1 -- 172.21.15.2:0/1014322193 learned_addr learned my addr 172.21.15.2:0/1014322193 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:05:49.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:46.975+0000 7f590ed9d640 1 -- 172.21.15.2:0/1014322193 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f591010aa90 con 0x7f5910108160 2024-09-19T06:05:49.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:46.976+0000 7f590ed9d640 1 --2- 172.21.15.2:0/1014322193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5910108160 0x7f591010a550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5900009820 tx=0x7f590002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be4068c5f447a6f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:49.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:46.976+0000 7f590dd9b640 1 -- 172.21.15.2:0/1014322193 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5900037070 con 0x7f5910108160 2024-09-19T06:05:49.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:46.976+0000 7f590dd9b640 1 -- 172.21.15.2:0/1014322193 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f59000328d0 con 0x7f5910108160 2024-09-19T06:05:49.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:46.976+0000 7f590dd9b640 1 -- 172.21.15.2:0/1014322193 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59000307d0 con 0x7f5910108160 2024-09-19T06:05:49.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:46.977+0000 7f5915065640 1 -- 172.21.15.2:0/1014322193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5910108160 msgr2=0x7f591010a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:49.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:46.977+0000 7f5915065640 1 --2- 172.21.15.2:0/1014322193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5910108160 0x7f591010a550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5900009820 tx=0x7f590002a270 comp rx=0 tx=0).stop 2024-09-19T06:05:49.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:46.977+0000 7f5915065640 1 -- 172.21.15.2:0/1014322193 shutdown_connections 2024-09-19T06:05:49.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:46.977+0000 7f5915065640 1 --2- 172.21.15.2:0/1014322193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5910108160 0x7f591010a550 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:49.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:46.977+0000 7f5915065640 1 -- 172.21.15.2:0/1014322193 >> 172.21.15.2:0/1014322193 conn(0x7f5910101d40 msgr2=0x7f59101041c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:49.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:46.977+0000 7f5915065640 1 -- 172.21.15.2:0/1014322193 shutdown_connections 2024-09-19T06:05:49.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:46.977+0000 7f5915065640 1 -- 172.21.15.2:0/1014322193 wait complete. 2024-09-19T06:05:49.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:46.978+0000 7f5915065640 1 Processor -- start 2024-09-19T06:05:49.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:46.978+0000 7f5915065640 1 -- start start 2024-09-19T06:05:49.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:46.979+0000 7f5915065640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5910108160 0x7f591019b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:49.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:46.979+0000 7f5915065640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f591010bad0 con 0x7f5910108160 2024-09-19T06:05:49.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:46.979+0000 7f590ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5910108160 0x7f591019b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:49.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:46.979+0000 7f590ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5910108160 0x7f591019b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56200/0 (socket says 172.21.15.2:56200) 2024-09-19T06:05:49.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:46.979+0000 7f590ed9d640 1 -- 172.21.15.2:0/396257365 learned_addr learned my addr 172.21.15.2:0/396257365 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:05:49.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:46.979+0000 7f590ed9d640 1 -- 172.21.15.2:0/396257365 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f591019bbd0 con 0x7f5910108160 2024-09-19T06:05:49.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:46.979+0000 7f590ed9d640 1 --2- 172.21.15.2:0/396257365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5910108160 0x7f591019b690 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5900030520 tx=0x7f5900032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:49.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:46.979+0000 7f58f7fff640 1 -- 172.21.15.2:0/396257365 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5900042070 con 0x7f5910108160 2024-09-19T06:05:49.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:46.979+0000 7f58f7fff640 1 -- 172.21.15.2:0/396257365 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f5900030cc0 con 0x7f5910108160 2024-09-19T06:05:49.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:46.979+0000 7f5915065640 1 -- 172.21.15.2:0/396257365 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f591019be60 con 0x7f5910108160 2024-09-19T06:05:49.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:46.979+0000 7f58f7fff640 1 -- 172.21.15.2:0/396257365 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5900037040 con 0x7f5910108160 2024-09-19T06:05:49.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:46.979+0000 7f5915065640 1 -- 172.21.15.2:0/396257365 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f591019eb50 con 0x7f5910108160 2024-09-19T06:05:49.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:46.980+0000 7f58f7fff640 1 -- 172.21.15.2:0/396257365 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f5900045070 con 0x7f5910108160 2024-09-19T06:05:49.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:46.981+0000 7f58f7fff640 1 --2- 172.21.15.2:0/396257365 >> [v2:172.21.15.2:6800/1602650352,v1:172.21.15.2:6801/1602650352] conn(0x7f58f8039200 0x7f58f803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:49.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:46.981+0000 7f58f7fff640 1 -- 172.21.15.2:0/396257365 --> [v2:172.21.15.2:6800/1602650352,v1:172.21.15.2:6801/1602650352] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f58f803bdd0 con 0x7f58f8039200 2024-09-19T06:05:49.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:46.981+0000 7f590e59c640 1 -- 172.21.15.2:0/396257365 >> [v2:172.21.15.2:6800/1602650352,v1:172.21.15.2:6801/1602650352] conn(0x7f58f8039200 msgr2=0x7f58f803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/1602650352 2024-09-19T06:05:49.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:46.981+0000 7f58f7fff640 1 -- 172.21.15.2:0/396257365 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f590006c1d0 con 0x7f5910108160 2024-09-19T06:05:49.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:46.981+0000 7f590e59c640 1 --2- 172.21.15.2:0/396257365 >> [v2:172.21.15.2:6800/1602650352,v1:172.21.15.2:6801/1602650352] conn(0x7f58f8039200 0x7f58f803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:05:49.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:47.182+0000 7f590e59c640 1 -- 172.21.15.2:0/396257365 >> [v2:172.21.15.2:6800/1602650352,v1:172.21.15.2:6801/1602650352] conn(0x7f58f8039200 msgr2=0x7f58f803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/1602650352 2024-09-19T06:05:49.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:47.182+0000 7f590e59c640 1 --2- 172.21.15.2:0/396257365 >> [v2:172.21.15.2:6800/1602650352,v1:172.21.15.2:6801/1602650352] conn(0x7f58f8039200 0x7f58f803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T06:05:49.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:47.539+0000 7f58f7fff640 1 -- 172.21.15.2:0/396257365 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mgrmap(e 6) ==== 46228+0+0 (secure 0 0 0) 0x7f590006ad50 con 0x7f5910108160 2024-09-19T06:05:49.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:47.539+0000 7f58f7fff640 1 -- 172.21.15.2:0/396257365 >> [v2:172.21.15.2:6800/1602650352,v1:172.21.15.2:6801/1602650352] conn(0x7f58f8039200 msgr2=0x7f58f803b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:05:49.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:47.539+0000 7f58f7fff640 1 --2- 172.21.15.2:0/396257365 >> [v2:172.21.15.2:6800/1602650352,v1:172.21.15.2:6801/1602650352] conn(0x7f58f8039200 0x7f58f803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:49.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:48.540+0000 7f58f7fff640 1 -- 172.21.15.2:0/396257365 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7f590006ddc0 con 0x7f5910108160 2024-09-19T06:05:49.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:48.541+0000 7f58f7fff640 1 --2- 172.21.15.2:0/396257365 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f58f803cb30 0x7f58f803ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:49.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:48.541+0000 7f58f7fff640 1 -- 172.21.15.2:0/396257365 --> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f58f803bdd0 con 0x7f58f803cb30 2024-09-19T06:05:49.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:48.541+0000 7f590e59c640 1 --2- 172.21.15.2:0/396257365 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f58f803cb30 0x7f58f803ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:49.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:48.542+0000 7f590e59c640 1 --2- 172.21.15.2:0/396257365 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f58f803cb30 0x7f58f803ef20 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5904003980 tx=0x7f5904006df0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:49.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:48.542+0000 7f58f7fff640 1 -- 172.21.15.2:0/396257365 <== mgr.14118 v2:172.21.15.2:6800/1200011821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f58f803bdd0 con 0x7f58f803cb30 2024-09-19T06:05:49.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:48.549+0000 7f5915065640 1 -- 172.21.15.2:0/396257365 --> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f59101085c0 con 0x7f58f803cb30 2024-09-19T06:05:49.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:48.550+0000 7f58f7fff640 1 -- 172.21.15.2:0/396257365 <== mgr.14118 v2:172.21.15.2:6800/1200011821 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f59101085c0 con 0x7f58f803cb30 2024-09-19T06:05:49.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:48.550+0000 7f5915065640 1 -- 172.21.15.2:0/396257365 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f58f803cb30 msgr2=0x7f58f803ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:49.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:48.550+0000 7f5915065640 1 --2- 172.21.15.2:0/396257365 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f58f803cb30 0x7f58f803ef20 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5904003980 tx=0x7f5904006df0 comp rx=0 tx=0).stop 2024-09-19T06:05:49.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:48.550+0000 7f5915065640 1 -- 172.21.15.2:0/396257365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5910108160 msgr2=0x7f591019b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:49.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:48.550+0000 7f5915065640 1 --2- 172.21.15.2:0/396257365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5910108160 0x7f591019b690 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5900030520 tx=0x7f5900032dd0 comp rx=0 tx=0).stop 2024-09-19T06:05:49.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:48.550+0000 7f5915065640 1 -- 172.21.15.2:0/396257365 shutdown_connections 2024-09-19T06:05:49.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:48.550+0000 7f5915065640 1 --2- 172.21.15.2:0/396257365 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f58f803cb30 0x7f58f803ef20 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:49.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:48.550+0000 7f5915065640 1 --2- 172.21.15.2:0/396257365 >> [v2:172.21.15.2:6800/1602650352,v1:172.21.15.2:6801/1602650352] conn(0x7f58f8039200 0x7f58f803b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:49.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:48.550+0000 7f5915065640 1 --2- 172.21.15.2:0/396257365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5910108160 0x7f591019b690 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:49.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:48.550+0000 7f5915065640 1 -- 172.21.15.2:0/396257365 >> 172.21.15.2:0/396257365 conn(0x7f5910101d40 msgr2=0x7f5910102940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:49.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:48.550+0000 7f5915065640 1 -- 172.21.15.2:0/396257365 shutdown_connections 2024-09-19T06:05:49.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:48.550+0000 7f5915065640 1 -- 172.21.15.2:0/396257365 wait complete. 2024-09-19T06:05:49.190 INFO:teuthology.orchestra.run.smithi002.stdout:mgr epoch 5 is available 2024-09-19T06:05:49.190 INFO:teuthology.orchestra.run.smithi002.stdout:Setting orchestrator backend to cephadm... 2024-09-19T06:05:50.356 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:50 smithi002 ceph-mon[30982]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T06:05:50.356 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:50 smithi002 ceph-mon[30982]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T06:05:50.357 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:50 smithi002 ceph-mon[30982]: from='mgr.14118 172.21.15.2:0/1043732806' entity='mgr.x' 2024-09-19T06:05:50.357 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:50 smithi002 ceph-mon[30982]: from='mgr.14118 172.21.15.2:0/1043732806' entity='mgr.x' 2024-09-19T06:05:50.357 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:50 smithi002 ceph-mon[30982]: from='mgr.14118 172.21.15.2:0/1043732806' entity='mgr.x' 2024-09-19T06:05:50.357 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:50 smithi002 ceph-mon[30982]: from='mgr.14118 172.21.15.2:0/1043732806' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:05:50.364 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.581+0000 7fae525c1640 1 Processor -- start 2024-09-19T06:05:50.365 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.581+0000 7fae525c1640 1 -- start start 2024-09-19T06:05:50.365 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.582+0000 7fae525c1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae4c1065f0 0x7fae4c1069f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:50.365 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.582+0000 7fae525c1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fae4c106fc0 con 0x7fae4c1065f0 2024-09-19T06:05:50.365 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.582+0000 7fae4bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae4c1065f0 0x7fae4c1069f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:50.365 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.582+0000 7fae4bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae4c1065f0 0x7fae4c1069f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56270/0 (socket says 172.21.15.2:56270) 2024-09-19T06:05:50.365 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.582+0000 7fae4bfff640 1 -- 172.21.15.2:0/1900645649 learned_addr learned my addr 172.21.15.2:0/1900645649 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:05:50.366 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.582+0000 7fae4bfff640 1 -- 172.21.15.2:0/1900645649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae4c1077f0 con 0x7fae4c1065f0 2024-09-19T06:05:50.366 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.583+0000 7fae4bfff640 1 --2- 172.21.15.2:0/1900645649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae4c1065f0 0x7fae4c1069f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fae3c009820 tx=0x7fae3c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f512d62dfb0f40d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:50.366 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.583+0000 7fae4affd640 1 -- 172.21.15.2:0/1900645649 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae3c037070 con 0x7fae4c1065f0 2024-09-19T06:05:50.366 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.583+0000 7fae4affd640 1 -- 172.21.15.2:0/1900645649 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fae3c0328d0 con 0x7fae4c1065f0 2024-09-19T06:05:50.366 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.583+0000 7fae4affd640 1 -- 172.21.15.2:0/1900645649 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae3c0307d0 con 0x7fae4c1065f0 2024-09-19T06:05:50.366 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.584+0000 7fae525c1640 1 -- 172.21.15.2:0/1900645649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae4c1065f0 msgr2=0x7fae4c1069f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:50.366 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.584+0000 7fae525c1640 1 --2- 172.21.15.2:0/1900645649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae4c1065f0 0x7fae4c1069f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fae3c009820 tx=0x7fae3c02a270 comp rx=0 tx=0).stop 2024-09-19T06:05:50.366 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.584+0000 7fae525c1640 1 -- 172.21.15.2:0/1900645649 shutdown_connections 2024-09-19T06:05:50.367 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.584+0000 7fae525c1640 1 --2- 172.21.15.2:0/1900645649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae4c1065f0 0x7fae4c1069f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:50.367 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.584+0000 7fae525c1640 1 -- 172.21.15.2:0/1900645649 >> 172.21.15.2:0/1900645649 conn(0x7fae4c101d40 msgr2=0x7fae4c1041c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:50.367 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.584+0000 7fae525c1640 1 -- 172.21.15.2:0/1900645649 shutdown_connections 2024-09-19T06:05:50.367 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.584+0000 7fae525c1640 1 -- 172.21.15.2:0/1900645649 wait complete. 2024-09-19T06:05:50.367 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.584+0000 7fae525c1640 1 Processor -- start 2024-09-19T06:05:50.367 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.585+0000 7fae525c1640 1 -- start start 2024-09-19T06:05:50.367 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.585+0000 7fae525c1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae4c1065f0 0x7fae4c19a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:50.367 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.585+0000 7fae525c1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fae4c10aba0 con 0x7fae4c1065f0 2024-09-19T06:05:50.367 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.585+0000 7fae4bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae4c1065f0 0x7fae4c19a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:50.367 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.585+0000 7fae4bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae4c1065f0 0x7fae4c19a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56286/0 (socket says 172.21.15.2:56286) 2024-09-19T06:05:50.367 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.585+0000 7fae4bfff640 1 -- 172.21.15.2:0/982690892 learned_addr learned my addr 172.21.15.2:0/982690892 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:05:50.367 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.585+0000 7fae4bfff640 1 -- 172.21.15.2:0/982690892 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae4c19ab20 con 0x7fae4c1065f0 2024-09-19T06:05:50.367 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.585+0000 7fae4bfff640 1 --2- 172.21.15.2:0/982690892 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae4c1065f0 0x7fae4c19a5e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fae3c0097f0 tx=0x7fae3c030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:50.368 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.586+0000 7fae497fa640 1 -- 172.21.15.2:0/982690892 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae3c037040 con 0x7fae4c1065f0 2024-09-19T06:05:50.368 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.586+0000 7fae497fa640 1 -- 172.21.15.2:0/982690892 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fae3c032bb0 con 0x7fae4c1065f0 2024-09-19T06:05:50.368 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.586+0000 7fae525c1640 1 -- 172.21.15.2:0/982690892 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae4c19adb0 con 0x7fae4c1065f0 2024-09-19T06:05:50.368 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.586+0000 7fae497fa640 1 -- 172.21.15.2:0/982690892 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae3c03a390 con 0x7fae4c1065f0 2024-09-19T06:05:50.368 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.586+0000 7fae525c1640 1 -- 172.21.15.2:0/982690892 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae4c19daa0 con 0x7fae4c1065f0 2024-09-19T06:05:50.368 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.586+0000 7fae497fa640 1 -- 172.21.15.2:0/982690892 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7fae3c03a580 con 0x7fae4c1065f0 2024-09-19T06:05:50.369 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.587+0000 7fae525c1640 1 -- 172.21.15.2:0/982690892 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae4c10ad20 con 0x7fae4c1065f0 2024-09-19T06:05:50.369 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.587+0000 7fae497fa640 1 --2- 172.21.15.2:0/982690892 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7fae340390f0 0x7fae3403b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:50.369 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.587+0000 7fae497fa640 1 -- 172.21.15.2:0/982690892 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fae3c06c280 con 0x7fae4c1065f0 2024-09-19T06:05:50.369 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.587+0000 7fae4b7fe640 1 --2- 172.21.15.2:0/982690892 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7fae340390f0 0x7fae3403b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:50.369 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.587+0000 7fae4b7fe640 1 --2- 172.21.15.2:0/982690892 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7fae340390f0 0x7fae3403b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fae400098c0 tx=0x7fae40006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:50.369 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.592+0000 7fae497fa640 1 -- 172.21.15.2:0/982690892 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fae3c040210 con 0x7fae4c1065f0 2024-09-19T06:05:50.369 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.780+0000 7fae525c1640 1 -- 172.21.15.2:0/982690892 --> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7fae4c102fc0 con 0x7fae340390f0 2024-09-19T06:05:50.369 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.785+0000 7fae497fa640 1 -- 172.21.15.2:0/982690892 <== mgr.14118 v2:172.21.15.2:6800/1200011821 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fae4c102fc0 con 0x7fae340390f0 2024-09-19T06:05:50.369 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.787+0000 7fae525c1640 1 -- 172.21.15.2:0/982690892 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7fae340390f0 msgr2=0x7fae3403b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:50.369 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.787+0000 7fae525c1640 1 --2- 172.21.15.2:0/982690892 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7fae340390f0 0x7fae3403b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fae400098c0 tx=0x7fae40006db0 comp rx=0 tx=0).stop 2024-09-19T06:05:50.370 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.787+0000 7fae525c1640 1 -- 172.21.15.2:0/982690892 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae4c1065f0 msgr2=0x7fae4c19a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:50.370 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.787+0000 7fae525c1640 1 --2- 172.21.15.2:0/982690892 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae4c1065f0 0x7fae4c19a5e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fae3c0097f0 tx=0x7fae3c030d00 comp rx=0 tx=0).stop 2024-09-19T06:05:50.370 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.787+0000 7fae525c1640 1 -- 172.21.15.2:0/982690892 shutdown_connections 2024-09-19T06:05:50.370 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.787+0000 7fae525c1640 1 --2- 172.21.15.2:0/982690892 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7fae340390f0 0x7fae3403b5b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:50.370 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.787+0000 7fae525c1640 1 --2- 172.21.15.2:0/982690892 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae4c1065f0 0x7fae4c19a5e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:50.370 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.787+0000 7fae525c1640 1 -- 172.21.15.2:0/982690892 >> 172.21.15.2:0/982690892 conn(0x7fae4c101d40 msgr2=0x7fae4c1028b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:50.370 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.787+0000 7fae525c1640 1 -- 172.21.15.2:0/982690892 shutdown_connections 2024-09-19T06:05:50.370 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:49.787+0000 7fae525c1640 1 -- 172.21.15.2:0/982690892 wait complete. 2024-09-19T06:05:50.659 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:50 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:50.482+0000 7f1dc260a640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:06:05:50] ENGINE Error in HTTPServer.serve 2024-09-19T06:05:50.660 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:50 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: Traceback (most recent call last): 2024-09-19T06:05:50.660 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:50 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:05:50.660 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:50 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: self._connections.run(self.expiration_interval) 2024-09-19T06:05:50.660 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:50 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:05:50.660 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:50 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: self._run(expiration_interval) 2024-09-19T06:05:50.660 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:50 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:05:50.660 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:50 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:05:50.660 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:50 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:05:50.660 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:50 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:05:50.660 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:50 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:05:50.661 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:50 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: s = self.context.wrap_socket( 2024-09-19T06:05:50.661 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:50 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:05:50.661 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:50 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: return self.sslsocket_class._create( 2024-09-19T06:05:50.661 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:50 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:05:50.661 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:50 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: self.do_handshake() 2024-09-19T06:05:50.661 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:50 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:05:50.661 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:50 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: self._sslobj.do_handshake() 2024-09-19T06:05:50.661 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:50 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:05:50.661 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:50 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:05:51.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:51 smithi002 ceph-mon[30982]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:05:51.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:51 smithi002 ceph-mon[30982]: mgrmap e8: x(active, since 2s) 2024-09-19T06:05:51.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:51 smithi002 ceph-mon[30982]: [19/Sep/2024:06:05:50] ENGINE Bus STARTING 2024-09-19T06:05:51.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:51 smithi002 ceph-mon[30982]: from='mgr.14118 172.21.15.2:0/1043732806' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:05:51.478 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-19T06:05:51.479 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.743+0000 7f5a9ea25640 1 Processor -- start 2024-09-19T06:05:51.479 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.743+0000 7f5a9ea25640 1 -- start start 2024-09-19T06:05:51.479 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.743+0000 7f5a9ea25640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a98108160 0x7f5a9810a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:51.479 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.743+0000 7f5a9ea25640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5a9807be40 con 0x7f5a98108160 2024-09-19T06:05:51.479 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.744+0000 7f5a97fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a98108160 0x7f5a9810a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:51.479 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.744+0000 7f5a97fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a98108160 0x7f5a9810a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56298/0 (socket says 172.21.15.2:56298) 2024-09-19T06:05:51.479 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.744+0000 7f5a97fff640 1 -- 172.21.15.2:0/3486919756 learned_addr learned my addr 172.21.15.2:0/3486919756 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:05:51.479 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.744+0000 7f5a97fff640 1 -- 172.21.15.2:0/3486919756 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a9810aa90 con 0x7f5a98108160 2024-09-19T06:05:51.479 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.745+0000 7f5a97fff640 1 --2- 172.21.15.2:0/3486919756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a98108160 0x7f5a9810a550 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5a88009820 tx=0x7f5a8802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd087037f5dfe747 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:51.479 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.745+0000 7f5a96ffd640 1 -- 172.21.15.2:0/3486919756 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a88037070 con 0x7f5a98108160 2024-09-19T06:05:51.479 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.745+0000 7f5a96ffd640 1 -- 172.21.15.2:0/3486919756 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f5a880328d0 con 0x7f5a98108160 2024-09-19T06:05:51.479 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.745+0000 7f5a96ffd640 1 -- 172.21.15.2:0/3486919756 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a880307d0 con 0x7f5a98108160 2024-09-19T06:05:51.480 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.746+0000 7f5a9ea25640 1 -- 172.21.15.2:0/3486919756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a98108160 msgr2=0x7f5a9810a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:51.480 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.746+0000 7f5a9ea25640 1 --2- 172.21.15.2:0/3486919756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a98108160 0x7f5a9810a550 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5a88009820 tx=0x7f5a8802a270 comp rx=0 tx=0).stop 2024-09-19T06:05:51.480 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.746+0000 7f5a9ea25640 1 -- 172.21.15.2:0/3486919756 shutdown_connections 2024-09-19T06:05:51.480 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.746+0000 7f5a9ea25640 1 --2- 172.21.15.2:0/3486919756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a98108160 0x7f5a9810a550 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:51.480 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.746+0000 7f5a9ea25640 1 -- 172.21.15.2:0/3486919756 >> 172.21.15.2:0/3486919756 conn(0x7f5a98101d40 msgr2=0x7f5a981041c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:51.480 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.746+0000 7f5a9ea25640 1 -- 172.21.15.2:0/3486919756 shutdown_connections 2024-09-19T06:05:51.480 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.746+0000 7f5a9ea25640 1 -- 172.21.15.2:0/3486919756 wait complete. 2024-09-19T06:05:51.480 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.747+0000 7f5a9ea25640 1 Processor -- start 2024-09-19T06:05:51.480 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.747+0000 7f5a9ea25640 1 -- start start 2024-09-19T06:05:51.480 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.747+0000 7f5a9ea25640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a98108160 0x7f5a981079e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:51.480 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.747+0000 7f5a9ea25640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5a9810bad0 con 0x7f5a98108160 2024-09-19T06:05:51.480 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.747+0000 7f5a97fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a98108160 0x7f5a981079e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:51.481 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.747+0000 7f5a97fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a98108160 0x7f5a981079e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56304/0 (socket says 172.21.15.2:56304) 2024-09-19T06:05:51.481 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.747+0000 7f5a97fff640 1 -- 172.21.15.2:0/3459427571 learned_addr learned my addr 172.21.15.2:0/3459427571 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:05:51.481 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.748+0000 7f5a97fff640 1 -- 172.21.15.2:0/3459427571 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a98107f20 con 0x7f5a98108160 2024-09-19T06:05:51.481 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.748+0000 7f5a97fff640 1 --2- 172.21.15.2:0/3459427571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a98108160 0x7f5a981079e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5a88030520 tx=0x7f5a88032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:51.481 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.748+0000 7f5a957fa640 1 -- 172.21.15.2:0/3459427571 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a88042070 con 0x7f5a98108160 2024-09-19T06:05:51.481 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.748+0000 7f5a957fa640 1 -- 172.21.15.2:0/3459427571 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f5a88030cc0 con 0x7f5a98108160 2024-09-19T06:05:51.481 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.748+0000 7f5a957fa640 1 -- 172.21.15.2:0/3459427571 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a88037040 con 0x7f5a98108160 2024-09-19T06:05:51.481 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.748+0000 7f5a9ea25640 1 -- 172.21.15.2:0/3459427571 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a98106110 con 0x7f5a98108160 2024-09-19T06:05:51.481 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.748+0000 7f5a9ea25640 1 -- 172.21.15.2:0/3459427571 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a98106650 con 0x7f5a98108160 2024-09-19T06:05:51.481 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.749+0000 7f5a957fa640 1 -- 172.21.15.2:0/3459427571 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f5a88045070 con 0x7f5a98108160 2024-09-19T06:05:51.481 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.749+0000 7f5a957fa640 1 --2- 172.21.15.2:0/3459427571 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f5a800391b0 0x7f5a8003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:51.481 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.750+0000 7f5a957fa640 1 -- 172.21.15.2:0/3459427571 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f5a8806c2e0 con 0x7f5a98108160 2024-09-19T06:05:51.482 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.750+0000 7f5a9ea25640 1 -- 172.21.15.2:0/3459427571 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a981085c0 con 0x7f5a98108160 2024-09-19T06:05:51.482 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.750+0000 7f5a977fe640 1 --2- 172.21.15.2:0/3459427571 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f5a800391b0 0x7f5a8003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:51.482 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.750+0000 7f5a977fe640 1 --2- 172.21.15.2:0/3459427571 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f5a800391b0 0x7f5a8003b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c0098c0 tx=0x7f5a8c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:51.482 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.755+0000 7f5a957fa640 1 -- 172.21.15.2:0/3459427571 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5a88045360 con 0x7f5a98108160 2024-09-19T06:05:51.482 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.932+0000 7f5a9ea25640 1 -- 172.21.15.2:0/3459427571 --> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f5a98106fc0 con 0x7f5a800391b0 2024-09-19T06:05:51.482 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.932+0000 7f5a957fa640 1 -- 172.21.15.2:0/3459427571 <== mgr.14118 v2:172.21.15.2:6800/1200011821 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f5a8c0094d0 con 0x7f5a800391b0 2024-09-19T06:05:51.482 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.934+0000 7f5a9ea25640 1 -- 172.21.15.2:0/3459427571 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f5a800391b0 msgr2=0x7f5a8003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:51.482 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.934+0000 7f5a9ea25640 1 --2- 172.21.15.2:0/3459427571 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f5a800391b0 0x7f5a8003b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c0098c0 tx=0x7f5a8c006db0 comp rx=0 tx=0).stop 2024-09-19T06:05:51.482 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.934+0000 7f5a9ea25640 1 -- 172.21.15.2:0/3459427571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a98108160 msgr2=0x7f5a981079e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:51.482 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.934+0000 7f5a9ea25640 1 --2- 172.21.15.2:0/3459427571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a98108160 0x7f5a981079e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5a88030520 tx=0x7f5a88032dd0 comp rx=0 tx=0).stop 2024-09-19T06:05:51.482 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.934+0000 7f5a9ea25640 1 -- 172.21.15.2:0/3459427571 shutdown_connections 2024-09-19T06:05:51.482 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.934+0000 7f5a9ea25640 1 --2- 172.21.15.2:0/3459427571 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f5a800391b0 0x7f5a8003b670 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:51.482 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.934+0000 7f5a9ea25640 1 --2- 172.21.15.2:0/3459427571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a98108160 0x7f5a981079e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:51.483 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.934+0000 7f5a9ea25640 1 -- 172.21.15.2:0/3459427571 >> 172.21.15.2:0/3459427571 conn(0x7f5a98101d40 msgr2=0x7f5a98102940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:51.483 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.935+0000 7f5a9ea25640 1 -- 172.21.15.2:0/3459427571 shutdown_connections 2024-09-19T06:05:51.483 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:50.935+0000 7f5a9ea25640 1 -- 172.21.15.2:0/3459427571 wait complete. 2024-09-19T06:05:51.483 INFO:teuthology.orchestra.run.smithi002.stdout:Generating ssh key... 2024-09-19T06:05:52.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:52 smithi002 ceph-mon[30982]: [19/Sep/2024:06:05:50] ENGINE Serving on https://172.21.15.2:7150 2024-09-19T06:05:52.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:52 smithi002 ceph-mon[30982]: [19/Sep/2024:06:05:50] ENGINE Error in HTTPServer.serve 2024-09-19T06:05:52.222 INFO:journalctl@ceph.mon.a.smithi002.stdout: Traceback (most recent call last): 2024-09-19T06:05:52.222 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:05:52.223 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._connections.run(self.expiration_interval) 2024-09-19T06:05:52.223 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:05:52.223 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._run(expiration_interval) 2024-09-19T06:05:52.223 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:05:52.223 INFO:journalctl@ceph.mon.a.smithi002.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:05:52.223 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:05:52.223 INFO:journalctl@ceph.mon.a.smithi002.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:05:52.223 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:05:52.223 INFO:journalctl@ceph.mon.a.smithi002.stdout: s = self.context.wrap_socket( 2024-09-19T06:05:52.223 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:05:52.223 INFO:journalctl@ceph.mon.a.smithi002.stdout: return self.sslsocket_class._create( 2024-09-19T06:05:52.223 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:05:52.223 INFO:journalctl@ceph.mon.a.smithi002.stdout: self.do_handshake() 2024-09-19T06:05:52.224 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:05:52.224 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._sslobj.do_handshake() 2024-09-19T06:05:52.224 INFO:journalctl@ceph.mon.a.smithi002.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:05:52.224 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:52 smithi002 ceph-mon[30982]: [19/Sep/2024:06:05:50] ENGINE Serving on http://172.21.15.2:8765 2024-09-19T06:05:52.224 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:52 smithi002 ceph-mon[30982]: [19/Sep/2024:06:05:50] ENGINE Bus STARTED 2024-09-19T06:05:52.224 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:52 smithi002 ceph-mon[30982]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:05:52.693 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:52 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: Generating public/private rsa key pair. 2024-09-19T06:05:52.694 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:52 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: Your identification has been saved in /tmp/tmpgx28ar87/key 2024-09-19T06:05:52.694 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:52 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: Your public key has been saved in /tmp/tmpgx28ar87/key.pub 2024-09-19T06:05:52.694 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:52 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: The key fingerprint is: 2024-09-19T06:05:52.694 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:52 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: SHA256:CW5RxC5O8lKuQN5fTeCqWgDuXQ6vFGWTb79WsDpC5BE ceph-078f6612-764d-11ef-bceb-c7b262605968 2024-09-19T06:05:52.694 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:52 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: The key's randomart image is: 2024-09-19T06:05:52.694 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:52 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: +---[RSA 3072]----+ 2024-09-19T06:05:52.694 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:52 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: | oo | 2024-09-19T06:05:52.694 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:52 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: | E..o | 2024-09-19T06:05:52.694 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:52 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: |. =+o . | 2024-09-19T06:05:52.694 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:52 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: |... ++*ooo. | 2024-09-19T06:05:52.694 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:52 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: | +.+oO+=Soo | 2024-09-19T06:05:52.695 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:52 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: |. +.O+* o... | 2024-09-19T06:05:52.695 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:52 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: | . +oB .... | 2024-09-19T06:05:52.695 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:52 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: | ..+..o .. | 2024-09-19T06:05:52.695 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:52 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: | .o . o. | 2024-09-19T06:05:52.695 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:05:52 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: +----[SHA256]-----+ 2024-09-19T06:05:52.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:51.863+0000 7f33df44a640 1 Processor -- start 2024-09-19T06:05:52.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:51.863+0000 7f33df44a640 1 -- start start 2024-09-19T06:05:52.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:51.863+0000 7f33df44a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33d8109920 0x7f33d8109d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:52.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:51.863+0000 7f33df44a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f33d810a2f0 con 0x7f33d8109920 2024-09-19T06:05:52.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:51.864+0000 7f33dd1e6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33d8109920 0x7f33d8109d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:52.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:51.864+0000 7f33dd1e6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33d8109920 0x7f33d8109d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56310/0 (socket says 172.21.15.2:56310) 2024-09-19T06:05:52.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:51.864+0000 7f33dd1e6640 1 -- 172.21.15.2:0/2386709573 learned_addr learned my addr 172.21.15.2:0/2386709573 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:05:52.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:51.864+0000 7f33dd1e6640 1 -- 172.21.15.2:0/2386709573 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33d810aaf0 con 0x7f33d8109920 2024-09-19T06:05:52.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:51.865+0000 7f33dd1e6640 1 --2- 172.21.15.2:0/2386709573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33d8109920 0x7f33d8109d20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f33cc009820 tx=0x7f33cc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffeb1f77cb155955 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:52.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:51.865+0000 7f33cbfff640 1 -- 172.21.15.2:0/2386709573 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33cc037070 con 0x7f33d8109920 2024-09-19T06:05:52.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:51.865+0000 7f33cbfff640 1 -- 172.21.15.2:0/2386709573 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f33cc0328d0 con 0x7f33d8109920 2024-09-19T06:05:52.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:51.865+0000 7f33cbfff640 1 -- 172.21.15.2:0/2386709573 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33cc0307d0 con 0x7f33d8109920 2024-09-19T06:05:52.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:51.865+0000 7f33df44a640 1 -- 172.21.15.2:0/2386709573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33d8109920 msgr2=0x7f33d8109d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:52.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:51.865+0000 7f33df44a640 1 --2- 172.21.15.2:0/2386709573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33d8109920 0x7f33d8109d20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f33cc009820 tx=0x7f33cc02a270 comp rx=0 tx=0).stop 2024-09-19T06:05:52.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:51.865+0000 7f33df44a640 1 -- 172.21.15.2:0/2386709573 shutdown_connections 2024-09-19T06:05:52.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:51.866+0000 7f33df44a640 1 --2- 172.21.15.2:0/2386709573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33d8109920 0x7f33d8109d20 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:52.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:51.866+0000 7f33df44a640 1 -- 172.21.15.2:0/2386709573 >> 172.21.15.2:0/2386709573 conn(0x7f33d807cf50 msgr2=0x7f33d807d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:52.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:51.866+0000 7f33df44a640 1 -- 172.21.15.2:0/2386709573 shutdown_connections 2024-09-19T06:05:52.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:51.866+0000 7f33df44a640 1 -- 172.21.15.2:0/2386709573 wait complete. 2024-09-19T06:05:52.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:51.866+0000 7f33df44a640 1 Processor -- start 2024-09-19T06:05:52.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:51.866+0000 7f33df44a640 1 -- start start 2024-09-19T06:05:52.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:51.866+0000 7f33df44a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33d8109920 0x7f33d819d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:52.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:51.866+0000 7f33df44a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f33d810dea0 con 0x7f33d8109920 2024-09-19T06:05:52.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:51.867+0000 7f33dd1e6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33d8109920 0x7f33d819d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:52.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:51.867+0000 7f33dd1e6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33d8109920 0x7f33d819d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56320/0 (socket says 172.21.15.2:56320) 2024-09-19T06:05:52.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:51.867+0000 7f33dd1e6640 1 -- 172.21.15.2:0/1199488468 learned_addr learned my addr 172.21.15.2:0/1199488468 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:05:52.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:51.867+0000 7f33dd1e6640 1 -- 172.21.15.2:0/1199488468 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33d819de60 con 0x7f33d8109920 2024-09-19T06:05:52.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:51.867+0000 7f33dd1e6640 1 --2- 172.21.15.2:0/1199488468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33d8109920 0x7f33d819d920 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f33cc030520 tx=0x7f33cc032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:52.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:51.867+0000 7f33ca7fc640 1 -- 172.21.15.2:0/1199488468 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33cc042070 con 0x7f33d8109920 2024-09-19T06:05:52.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:51.867+0000 7f33ca7fc640 1 -- 172.21.15.2:0/1199488468 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f33cc030cc0 con 0x7f33d8109920 2024-09-19T06:05:52.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:51.867+0000 7f33df44a640 1 -- 172.21.15.2:0/1199488468 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33d819e0f0 con 0x7f33d8109920 2024-09-19T06:05:52.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:51.867+0000 7f33ca7fc640 1 -- 172.21.15.2:0/1199488468 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33cc037040 con 0x7f33d8109920 2024-09-19T06:05:52.955 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:51.867+0000 7f33df44a640 1 -- 172.21.15.2:0/1199488468 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33d81a0de0 con 0x7f33d8109920 2024-09-19T06:05:52.955 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:51.868+0000 7f33ca7fc640 1 -- 172.21.15.2:0/1199488468 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f33cc045070 con 0x7f33d8109920 2024-09-19T06:05:52.955 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:51.868+0000 7f33ca7fc640 1 --2- 172.21.15.2:0/1199488468 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f33c4039200 0x7f33c403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:52.955 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:51.868+0000 7f33df44a640 1 -- 172.21.15.2:0/1199488468 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33d810e020 con 0x7f33d8109920 2024-09-19T06:05:52.955 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:51.868+0000 7f33ca7fc640 1 -- 172.21.15.2:0/1199488468 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f33cc06c260 con 0x7f33d8109920 2024-09-19T06:05:52.955 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:51.869+0000 7f33dc9e5640 1 --2- 172.21.15.2:0/1199488468 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f33c4039200 0x7f33c403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:52.955 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:51.869+0000 7f33dc9e5640 1 --2- 172.21.15.2:0/1199488468 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f33c4039200 0x7f33c403b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f33d40098c0 tx=0x7f33d4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:52.955 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:51.873+0000 7f33ca7fc640 1 -- 172.21.15.2:0/1199488468 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f33cc046e00 con 0x7f33d8109920 2024-09-19T06:05:52.955 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:52.049+0000 7f33df44a640 1 -- 172.21.15.2:0/1199488468 --> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f33d8107c60 con 0x7f33c4039200 2024-09-19T06:05:52.955 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:52.393+0000 7f33ca7fc640 1 -- 172.21.15.2:0/1199488468 <== mgr.14118 v2:172.21.15.2:6800/1200011821 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f33d8107c60 con 0x7f33c4039200 2024-09-19T06:05:52.955 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:52.395+0000 7f33df44a640 1 -- 172.21.15.2:0/1199488468 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f33c4039200 msgr2=0x7f33c403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:52.955 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:52.395+0000 7f33df44a640 1 --2- 172.21.15.2:0/1199488468 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f33c4039200 0x7f33c403b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f33d40098c0 tx=0x7f33d4006db0 comp rx=0 tx=0).stop 2024-09-19T06:05:52.956 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:52.395+0000 7f33df44a640 1 -- 172.21.15.2:0/1199488468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33d8109920 msgr2=0x7f33d819d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:52.956 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:52.395+0000 7f33df44a640 1 --2- 172.21.15.2:0/1199488468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33d8109920 0x7f33d819d920 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f33cc030520 tx=0x7f33cc032dd0 comp rx=0 tx=0).stop 2024-09-19T06:05:52.956 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:52.395+0000 7f33df44a640 1 -- 172.21.15.2:0/1199488468 shutdown_connections 2024-09-19T06:05:52.956 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:52.395+0000 7f33df44a640 1 --2- 172.21.15.2:0/1199488468 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f33c4039200 0x7f33c403b6c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:52.956 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:52.395+0000 7f33df44a640 1 --2- 172.21.15.2:0/1199488468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33d8109920 0x7f33d819d920 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:52.956 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:52.395+0000 7f33df44a640 1 -- 172.21.15.2:0/1199488468 >> 172.21.15.2:0/1199488468 conn(0x7f33d807cf50 msgr2=0x7f33d8107550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:52.956 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:52.395+0000 7f33df44a640 1 -- 172.21.15.2:0/1199488468 shutdown_connections 2024-09-19T06:05:52.956 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:52.395+0000 7f33df44a640 1 -- 172.21.15.2:0/1199488468 wait complete. 2024-09-19T06:05:53.498 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:53 smithi002 ceph-mon[30982]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:05:53.498 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:53 smithi002 ceph-mon[30982]: Generating ssh key... 2024-09-19T06:05:53.498 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:53 smithi002 ceph-mon[30982]: from='mgr.14118 172.21.15.2:0/1043732806' entity='mgr.x' 2024-09-19T06:05:53.499 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:53 smithi002 ceph-mon[30982]: from='mgr.14118 172.21.15.2:0/1043732806' entity='mgr.x' 2024-09-19T06:05:54.057 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCph5uC3rHal7LKe77k2CA94394jWQMAJQPlGzrKajzL2bYacVqwGPBw2gbFs+rbesqkySC8RLHOYiYQv3AE2qlkAYpSaPDWWGhUCgLX+4KZ+0khV8fOiWp4s9tQNuXpelrEhObHaa2Ak3Q2xeoASCftRo+AJeEbk/Un8AFaeF5AgumZAU3NpLsko/eGCYxhw4GSkB3406YDfC0vPVFs4N7pyJ+9Y4gjMeRBrMQWt3udbp74A/r0ECr/3VMl6tzJJ5r78ztQ1FrXRKFYvp+gVwuy21i6hbNCofoRoUJL+TIMQblrzRLF12t1A0xqMIo6Xy0Cv4dD3Kr6trNwV0OxeitdYQwnLP3QYfLjoSibYUunPe0FMWBNHXIiOOTdWKkm1+92ZptRlna5mm/Uo1f0orDWpqezGpJiBzV1cLpiP5hhBLAeiabSXtaujrh1/Ozx+HChizpZSfmIyt6I1eQqBZxYNtRGaP6LDdN3gSXlG5f0P5+KFKWmvBvuxY4JdkTkNU= ceph-078f6612-764d-11ef-bceb-c7b262605968 2024-09-19T06:05:54.057 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.308+0000 7fb8b02da640 1 Processor -- start 2024-09-19T06:05:54.057 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.308+0000 7fb8b02da640 1 -- start start 2024-09-19T06:05:54.057 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.309+0000 7fb8b02da640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8a81077b0 0x7fb8a8107bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:54.057 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.309+0000 7fb8b02da640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a8108180 con 0x7fb8a81077b0 2024-09-19T06:05:54.057 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.309+0000 7fb8ae076640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8a81077b0 0x7fb8a8107bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:54.057 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.309+0000 7fb8ae076640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8a81077b0 0x7fb8a8107bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56334/0 (socket says 172.21.15.2:56334) 2024-09-19T06:05:54.057 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.309+0000 7fb8ae076640 1 -- 172.21.15.2:0/3383125637 learned_addr learned my addr 172.21.15.2:0/3383125637 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:05:54.058 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.309+0000 7fb8ae076640 1 -- 172.21.15.2:0/3383125637 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8a8108910 con 0x7fb8a81077b0 2024-09-19T06:05:54.058 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.310+0000 7fb8ae076640 1 --2- 172.21.15.2:0/3383125637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8a81077b0 0x7fb8a8107bb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4009820 tx=0x7fb8a402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f52ea6fdbef40d0e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:54.058 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.310+0000 7fb8ad074640 1 -- 172.21.15.2:0/3383125637 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8a4037070 con 0x7fb8a81077b0 2024-09-19T06:05:54.058 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.310+0000 7fb8ad074640 1 -- 172.21.15.2:0/3383125637 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fb8a40328d0 con 0x7fb8a81077b0 2024-09-19T06:05:54.058 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.310+0000 7fb8ad074640 1 -- 172.21.15.2:0/3383125637 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8a40307d0 con 0x7fb8a81077b0 2024-09-19T06:05:54.058 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.311+0000 7fb8b02da640 1 -- 172.21.15.2:0/3383125637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8a81077b0 msgr2=0x7fb8a8107bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:54.058 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.311+0000 7fb8b02da640 1 --2- 172.21.15.2:0/3383125637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8a81077b0 0x7fb8a8107bb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4009820 tx=0x7fb8a402a270 comp rx=0 tx=0).stop 2024-09-19T06:05:54.058 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.311+0000 7fb8b02da640 1 -- 172.21.15.2:0/3383125637 shutdown_connections 2024-09-19T06:05:54.058 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.311+0000 7fb8b02da640 1 --2- 172.21.15.2:0/3383125637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8a81077b0 0x7fb8a8107bb0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:54.058 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.311+0000 7fb8b02da640 1 -- 172.21.15.2:0/3383125637 >> 172.21.15.2:0/3383125637 conn(0x7fb8a8102f60 msgr2=0x7fb8a8105380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:54.059 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.311+0000 7fb8b02da640 1 -- 172.21.15.2:0/3383125637 shutdown_connections 2024-09-19T06:05:54.059 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.311+0000 7fb8b02da640 1 -- 172.21.15.2:0/3383125637 wait complete. 2024-09-19T06:05:54.059 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.312+0000 7fb8b02da640 1 Processor -- start 2024-09-19T06:05:54.059 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.312+0000 7fb8b02da640 1 -- start start 2024-09-19T06:05:54.059 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.312+0000 7fb8b02da640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8a81077b0 0x7fb8a807db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:54.059 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.312+0000 7fb8b02da640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a810bcc0 con 0x7fb8a81077b0 2024-09-19T06:05:54.059 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.312+0000 7fb8ae076640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8a81077b0 0x7fb8a807db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:54.059 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.312+0000 7fb8ae076640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8a81077b0 0x7fb8a807db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56342/0 (socket says 172.21.15.2:56342) 2024-09-19T06:05:54.059 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.312+0000 7fb8ae076640 1 -- 172.21.15.2:0/1417346688 learned_addr learned my addr 172.21.15.2:0/1417346688 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:05:54.059 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.312+0000 7fb8ae076640 1 -- 172.21.15.2:0/1417346688 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8a807e040 con 0x7fb8a81077b0 2024-09-19T06:05:54.059 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.313+0000 7fb8ae076640 1 --2- 172.21.15.2:0/1417346688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8a81077b0 0x7fb8a807db00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb8a40097f0 tx=0x7fb8a4030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:54.060 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.313+0000 7fb89f7fe640 1 -- 172.21.15.2:0/1417346688 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8a4037040 con 0x7fb8a81077b0 2024-09-19T06:05:54.060 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.313+0000 7fb89f7fe640 1 -- 172.21.15.2:0/1417346688 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fb8a4032bb0 con 0x7fb8a81077b0 2024-09-19T06:05:54.060 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.313+0000 7fb8b02da640 1 -- 172.21.15.2:0/1417346688 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8a807c230 con 0x7fb8a81077b0 2024-09-19T06:05:54.060 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.313+0000 7fb89f7fe640 1 -- 172.21.15.2:0/1417346688 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8a403a390 con 0x7fb8a81077b0 2024-09-19T06:05:54.060 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.313+0000 7fb8b02da640 1 -- 172.21.15.2:0/1417346688 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8a807c770 con 0x7fb8a81077b0 2024-09-19T06:05:54.060 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.314+0000 7fb89f7fe640 1 -- 172.21.15.2:0/1417346688 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fb8a403a580 con 0x7fb8a81077b0 2024-09-19T06:05:54.060 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.314+0000 7fb89f7fe640 1 --2- 172.21.15.2:0/1417346688 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7fb894039200 0x7fb89403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:54.060 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.314+0000 7fb89f7fe640 1 -- 172.21.15.2:0/1417346688 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb8a406c490 con 0x7fb8a81077b0 2024-09-19T06:05:54.060 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.314+0000 7fb8b02da640 1 -- 172.21.15.2:0/1417346688 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8a810be40 con 0x7fb8a81077b0 2024-09-19T06:05:54.061 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.314+0000 7fb8ad875640 1 --2- 172.21.15.2:0/1417346688 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7fb894039200 0x7fb89403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:54.061 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.315+0000 7fb8ad875640 1 --2- 172.21.15.2:0/1417346688 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7fb894039200 0x7fb89403b6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb8980098c0 tx=0x7fb898006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:54.061 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.319+0000 7fb89f7fe640 1 -- 172.21.15.2:0/1417346688 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb8a4040210 con 0x7fb8a81077b0 2024-09-19T06:05:54.061 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.496+0000 7fb8b02da640 1 -- 172.21.15.2:0/1417346688 --> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7fb8a807cf40 con 0x7fb894039200 2024-09-19T06:05:54.061 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.497+0000 7fb89f7fe640 1 -- 172.21.15.2:0/1417346688 <== mgr.14118 v2:172.21.15.2:6800/1200011821 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7fb8a807cf40 con 0x7fb894039200 2024-09-19T06:05:54.061 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.499+0000 7fb8b02da640 1 -- 172.21.15.2:0/1417346688 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7fb894039200 msgr2=0x7fb89403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:54.061 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.499+0000 7fb8b02da640 1 --2- 172.21.15.2:0/1417346688 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7fb894039200 0x7fb89403b6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb8980098c0 tx=0x7fb898006db0 comp rx=0 tx=0).stop 2024-09-19T06:05:54.061 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.499+0000 7fb8b02da640 1 -- 172.21.15.2:0/1417346688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8a81077b0 msgr2=0x7fb8a807db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:54.061 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.499+0000 7fb8b02da640 1 --2- 172.21.15.2:0/1417346688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8a81077b0 0x7fb8a807db00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb8a40097f0 tx=0x7fb8a4030d00 comp rx=0 tx=0).stop 2024-09-19T06:05:54.061 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.499+0000 7fb8b02da640 1 -- 172.21.15.2:0/1417346688 shutdown_connections 2024-09-19T06:05:54.062 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.499+0000 7fb8b02da640 1 --2- 172.21.15.2:0/1417346688 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7fb894039200 0x7fb89403b6c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:54.062 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.499+0000 7fb8b02da640 1 --2- 172.21.15.2:0/1417346688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8a81077b0 0x7fb8a807db00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:54.062 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.499+0000 7fb8b02da640 1 -- 172.21.15.2:0/1417346688 >> 172.21.15.2:0/1417346688 conn(0x7fb8a8102f60 msgr2=0x7fb8a8103a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:54.062 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.499+0000 7fb8b02da640 1 -- 172.21.15.2:0/1417346688 shutdown_connections 2024-09-19T06:05:54.062 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:53.499+0000 7fb8b02da640 1 -- 172.21.15.2:0/1417346688 wait complete. 2024-09-19T06:05:54.062 INFO:teuthology.orchestra.run.smithi002.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-19T06:05:54.062 INFO:teuthology.orchestra.run.smithi002.stdout:Adding key to root@localhost authorized_keys... 2024-09-19T06:05:54.064 INFO:teuthology.orchestra.run.smithi002.stdout:Adding host smithi002... 2024-09-19T06:05:54.675 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:54 smithi002 ceph-mon[30982]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:05:55.707 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:55 smithi002 ceph-mon[30982]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi002", "addr": "172.21.15.2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:05:56.621 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:56 smithi002 ceph-mon[30982]: Deploying cephadm binary to smithi002 2024-09-19T06:05:59.172 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Added host 'smithi002' with addr '172.21.15.2' 2024-09-19T06:05:59.172 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:54.483+0000 7fe6b61f1640 1 Processor -- start 2024-09-19T06:05:59.172 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:54.483+0000 7fe6b61f1640 1 -- start start 2024-09-19T06:05:59.172 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:54.483+0000 7fe6b61f1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6b01077b0 0x7fe6b0107bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:59.172 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:54.483+0000 7fe6b61f1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b0108180 con 0x7fe6b01077b0 2024-09-19T06:05:59.172 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:54.483+0000 7fe6af7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6b01077b0 0x7fe6b0107bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:59.172 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:54.483+0000 7fe6af7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6b01077b0 0x7fe6b0107bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56352/0 (socket says 172.21.15.2:56352) 2024-09-19T06:05:59.172 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:54.483+0000 7fe6af7fe640 1 -- 172.21.15.2:0/481176483 learned_addr learned my addr 172.21.15.2:0/481176483 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:05:59.172 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:54.484+0000 7fe6af7fe640 1 -- 172.21.15.2:0/481176483 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6b0108910 con 0x7fe6b01077b0 2024-09-19T06:05:59.172 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:54.484+0000 7fe6af7fe640 1 --2- 172.21.15.2:0/481176483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6b01077b0 0x7fe6b0107bb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0009820 tx=0x7fe6a002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec7773b7fac25fe1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:59.173 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:54.484+0000 7fe6ae7fc640 1 -- 172.21.15.2:0/481176483 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6a0037070 con 0x7fe6b01077b0 2024-09-19T06:05:59.173 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:54.485+0000 7fe6ae7fc640 1 -- 172.21.15.2:0/481176483 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fe6a00328d0 con 0x7fe6b01077b0 2024-09-19T06:05:59.173 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:54.485+0000 7fe6ae7fc640 1 -- 172.21.15.2:0/481176483 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6a00307d0 con 0x7fe6b01077b0 2024-09-19T06:05:59.173 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:54.485+0000 7fe6b61f1640 1 -- 172.21.15.2:0/481176483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6b01077b0 msgr2=0x7fe6b0107bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:59.173 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:54.485+0000 7fe6b61f1640 1 --2- 172.21.15.2:0/481176483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6b01077b0 0x7fe6b0107bb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0009820 tx=0x7fe6a002a270 comp rx=0 tx=0).stop 2024-09-19T06:05:59.173 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:54.485+0000 7fe6b61f1640 1 -- 172.21.15.2:0/481176483 shutdown_connections 2024-09-19T06:05:59.173 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:54.485+0000 7fe6b61f1640 1 --2- 172.21.15.2:0/481176483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6b01077b0 0x7fe6b0107bb0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:59.173 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:54.485+0000 7fe6b61f1640 1 -- 172.21.15.2:0/481176483 >> 172.21.15.2:0/481176483 conn(0x7fe6b0102f60 msgr2=0x7fe6b0105380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:59.173 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:54.485+0000 7fe6b61f1640 1 -- 172.21.15.2:0/481176483 shutdown_connections 2024-09-19T06:05:59.173 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:54.485+0000 7fe6b61f1640 1 -- 172.21.15.2:0/481176483 wait complete. 2024-09-19T06:05:59.173 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:54.486+0000 7fe6b61f1640 1 Processor -- start 2024-09-19T06:05:59.173 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:54.486+0000 7fe6b61f1640 1 -- start start 2024-09-19T06:05:59.173 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:54.486+0000 7fe6b61f1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6b01077b0 0x7fe6b019b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:59.174 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:54.486+0000 7fe6b61f1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b010bcc0 con 0x7fe6b01077b0 2024-09-19T06:05:59.174 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:54.486+0000 7fe6af7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6b01077b0 0x7fe6b019b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:59.174 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:54.486+0000 7fe6af7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6b01077b0 0x7fe6b019b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56354/0 (socket says 172.21.15.2:56354) 2024-09-19T06:05:59.174 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:54.486+0000 7fe6af7fe640 1 -- 172.21.15.2:0/3633244518 learned_addr learned my addr 172.21.15.2:0/3633244518 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:05:59.174 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:54.487+0000 7fe6af7fe640 1 -- 172.21.15.2:0/3633244518 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6b019bbf0 con 0x7fe6b01077b0 2024-09-19T06:05:59.174 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:54.487+0000 7fe6af7fe640 1 --2- 172.21.15.2:0/3633244518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6b01077b0 0x7fe6b019b6b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe6a00097f0 tx=0x7fe6a0030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:59.174 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:54.487+0000 7fe6acff9640 1 -- 172.21.15.2:0/3633244518 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6a0037040 con 0x7fe6b01077b0 2024-09-19T06:05:59.174 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:54.487+0000 7fe6acff9640 1 -- 172.21.15.2:0/3633244518 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fe6a0032bb0 con 0x7fe6b01077b0 2024-09-19T06:05:59.174 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:54.487+0000 7fe6b61f1640 1 -- 172.21.15.2:0/3633244518 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6b019be80 con 0x7fe6b01077b0 2024-09-19T06:05:59.174 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:54.487+0000 7fe6acff9640 1 -- 172.21.15.2:0/3633244518 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6a003a390 con 0x7fe6b01077b0 2024-09-19T06:05:59.174 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:54.487+0000 7fe6b61f1640 1 -- 172.21.15.2:0/3633244518 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6b019eb70 con 0x7fe6b01077b0 2024-09-19T06:05:59.174 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:54.488+0000 7fe6acff9640 1 -- 172.21.15.2:0/3633244518 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fe6a003a580 con 0x7fe6b01077b0 2024-09-19T06:05:59.174 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:54.488+0000 7fe6b61f1640 1 -- 172.21.15.2:0/3633244518 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6b010be40 con 0x7fe6b01077b0 2024-09-19T06:05:59.175 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:54.488+0000 7fe6acff9640 1 --2- 172.21.15.2:0/3633244518 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7fe698039200 0x7fe69803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:59.175 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:54.488+0000 7fe6acff9640 1 -- 172.21.15.2:0/3633244518 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe6a006c5e0 con 0x7fe6b01077b0 2024-09-19T06:05:59.175 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:54.488+0000 7fe6aeffd640 1 --2- 172.21.15.2:0/3633244518 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7fe698039200 0x7fe69803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:59.175 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:54.489+0000 7fe6aeffd640 1 --2- 172.21.15.2:0/3633244518 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7fe698039200 0x7fe69803b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe6a40098c0 tx=0x7fe6a4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:59.175 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:54.493+0000 7fe6acff9640 1 -- 172.21.15.2:0/3633244518 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe6a0032dd0 con 0x7fe6b01077b0 2024-09-19T06:05:59.175 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:54.673+0000 7fe6b61f1640 1 -- 172.21.15.2:0/3633244518 --> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi002", "addr": "172.21.15.2", "target": ["mon-mgr", ""]}) -- 0x7fe6b0104170 con 0x7fe698039200 2024-09-19T06:05:59.175 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:58.569+0000 7fe6acff9640 1 -- 172.21.15.2:0/3633244518 <== mgr.14118 v2:172.21.15.2:6800/1200011821 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7fe6b0104170 con 0x7fe698039200 2024-09-19T06:05:59.175 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:58.572+0000 7fe6b61f1640 1 -- 172.21.15.2:0/3633244518 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7fe698039200 msgr2=0x7fe69803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:59.175 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:58.572+0000 7fe6b61f1640 1 --2- 172.21.15.2:0/3633244518 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7fe698039200 0x7fe69803b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe6a40098c0 tx=0x7fe6a4006db0 comp rx=0 tx=0).stop 2024-09-19T06:05:59.175 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:58.572+0000 7fe6b61f1640 1 -- 172.21.15.2:0/3633244518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6b01077b0 msgr2=0x7fe6b019b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:59.175 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:58.572+0000 7fe6b61f1640 1 --2- 172.21.15.2:0/3633244518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6b01077b0 0x7fe6b019b6b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe6a00097f0 tx=0x7fe6a0030d00 comp rx=0 tx=0).stop 2024-09-19T06:05:59.175 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:58.572+0000 7fe6b61f1640 1 -- 172.21.15.2:0/3633244518 shutdown_connections 2024-09-19T06:05:59.176 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:58.572+0000 7fe6b61f1640 1 --2- 172.21.15.2:0/3633244518 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7fe698039200 0x7fe69803b6c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:59.176 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:58.572+0000 7fe6b61f1640 1 --2- 172.21.15.2:0/3633244518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6b01077b0 0x7fe6b019b6b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:59.176 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:58.572+0000 7fe6b61f1640 1 -- 172.21.15.2:0/3633244518 >> 172.21.15.2:0/3633244518 conn(0x7fe6b0102f60 msgr2=0x7fe6b0103a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:59.176 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:58.572+0000 7fe6b61f1640 1 -- 172.21.15.2:0/3633244518 shutdown_connections 2024-09-19T06:05:59.176 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:58.572+0000 7fe6b61f1640 1 -- 172.21.15.2:0/3633244518 wait complete. 2024-09-19T06:05:59.176 INFO:teuthology.orchestra.run.smithi002.stdout:Deploying unmanaged mon service... 2024-09-19T06:05:59.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:59 smithi002 ceph-mon[30982]: from='mgr.14118 172.21.15.2:0/1043732806' entity='mgr.x' 2024-09-19T06:05:59.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:59 smithi002 ceph-mon[30982]: Added host smithi002 2024-09-19T06:05:59.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:05:59 smithi002 ceph-mon[30982]: from='mgr.14118 172.21.15.2:0/1043732806' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:06:00.564 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-19T06:06:00.564 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.596+0000 7f67a6e1d640 1 Processor -- start 2024-09-19T06:06:00.564 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.596+0000 7f67a6e1d640 1 -- start start 2024-09-19T06:06:00.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.596+0000 7f67a6e1d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67a007de00 0x7f67a007c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:00.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.596+0000 7f67a6e1d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f67a007c880 con 0x7f67a007de00 2024-09-19T06:06:00.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.596+0000 7f67a4bb9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67a007de00 0x7f67a007c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:00.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.596+0000 7f67a4bb9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67a007de00 0x7f67a007c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42032/0 (socket says 172.21.15.2:42032) 2024-09-19T06:06:00.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.597+0000 7f67a4bb9640 1 -- 172.21.15.2:0/4069715436 learned_addr learned my addr 172.21.15.2:0/4069715436 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:06:00.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.597+0000 7f67a4bb9640 1 -- 172.21.15.2:0/4069715436 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67a007ca00 con 0x7f67a007de00 2024-09-19T06:06:00.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.597+0000 7f67a4bb9640 1 --2- 172.21.15.2:0/4069715436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67a007de00 0x7f67a007c2b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6790009820 tx=0x7f679002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=987d4048ac1c5810 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:00.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.598+0000 7f679f7fe640 1 -- 172.21.15.2:0/4069715436 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6790037070 con 0x7f67a007de00 2024-09-19T06:06:00.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.598+0000 7f679f7fe640 1 -- 172.21.15.2:0/4069715436 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f67900328d0 con 0x7f67a007de00 2024-09-19T06:06:00.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.598+0000 7f679f7fe640 1 -- 172.21.15.2:0/4069715436 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67900307d0 con 0x7f67a007de00 2024-09-19T06:06:00.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.598+0000 7f67a6e1d640 1 -- 172.21.15.2:0/4069715436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67a007de00 msgr2=0x7f67a007c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:00.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.598+0000 7f67a6e1d640 1 --2- 172.21.15.2:0/4069715436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67a007de00 0x7f67a007c2b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6790009820 tx=0x7f679002a270 comp rx=0 tx=0).stop 2024-09-19T06:06:00.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.598+0000 7f67a6e1d640 1 -- 172.21.15.2:0/4069715436 shutdown_connections 2024-09-19T06:06:00.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.598+0000 7f67a6e1d640 1 --2- 172.21.15.2:0/4069715436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67a007de00 0x7f67a007c2b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:00.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.598+0000 7f67a6e1d640 1 -- 172.21.15.2:0/4069715436 >> 172.21.15.2:0/4069715436 conn(0x7f67a0102ea0 msgr2=0x7f67a0105300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:00.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.598+0000 7f67a6e1d640 1 -- 172.21.15.2:0/4069715436 shutdown_connections 2024-09-19T06:06:00.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.598+0000 7f67a6e1d640 1 -- 172.21.15.2:0/4069715436 wait complete. 2024-09-19T06:06:00.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.599+0000 7f67a6e1d640 1 Processor -- start 2024-09-19T06:06:00.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.599+0000 7f67a6e1d640 1 -- start start 2024-09-19T06:06:00.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.599+0000 7f67a6e1d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67a007de00 0x7f67a019d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:00.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.599+0000 7f67a6e1d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f67a010dcc0 con 0x7f67a007de00 2024-09-19T06:06:00.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.599+0000 7f67a4bb9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67a007de00 0x7f67a019d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:00.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.599+0000 7f67a4bb9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67a007de00 0x7f67a019d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42044/0 (socket says 172.21.15.2:42044) 2024-09-19T06:06:00.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.599+0000 7f67a4bb9640 1 -- 172.21.15.2:0/4234070828 learned_addr learned my addr 172.21.15.2:0/4234070828 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:06:00.567 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.600+0000 7f67a4bb9640 1 -- 172.21.15.2:0/4234070828 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67a019ddd0 con 0x7f67a007de00 2024-09-19T06:06:00.567 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.600+0000 7f67a4bb9640 1 --2- 172.21.15.2:0/4234070828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67a007de00 0x7f67a019d890 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f67900097f0 tx=0x7f6790030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:00.567 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.600+0000 7f679dffb640 1 -- 172.21.15.2:0/4234070828 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6790037040 con 0x7f67a007de00 2024-09-19T06:06:00.567 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.600+0000 7f679dffb640 1 -- 172.21.15.2:0/4234070828 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f6790032bb0 con 0x7f67a007de00 2024-09-19T06:06:00.567 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.600+0000 7f67a6e1d640 1 -- 172.21.15.2:0/4234070828 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67a019e060 con 0x7f67a007de00 2024-09-19T06:06:00.567 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.600+0000 7f679dffb640 1 -- 172.21.15.2:0/4234070828 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f679003a390 con 0x7f67a007de00 2024-09-19T06:06:00.567 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.600+0000 7f67a6e1d640 1 -- 172.21.15.2:0/4234070828 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67a01a0d50 con 0x7f67a007de00 2024-09-19T06:06:00.567 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.601+0000 7f679dffb640 1 -- 172.21.15.2:0/4234070828 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f679003a580 con 0x7f67a007de00 2024-09-19T06:06:00.567 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.601+0000 7f67a6e1d640 1 -- 172.21.15.2:0/4234070828 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67a007c330 con 0x7f67a007de00 2024-09-19T06:06:00.567 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.601+0000 7f679dffb640 1 --2- 172.21.15.2:0/4234070828 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f6788039200 0x7f678803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:00.567 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.601+0000 7f679dffb640 1 -- 172.21.15.2:0/4234070828 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f679006c5f0 con 0x7f67a007de00 2024-09-19T06:06:00.568 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.601+0000 7f679ffff640 1 --2- 172.21.15.2:0/4234070828 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f6788039200 0x7f678803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:00.568 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.602+0000 7f679ffff640 1 --2- 172.21.15.2:0/4234070828 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f6788039200 0x7f678803b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f67940098c0 tx=0x7f6794006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:00.568 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.606+0000 7f679dffb640 1 -- 172.21.15.2:0/4234070828 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6790032dd0 con 0x7f67a007de00 2024-09-19T06:06:00.568 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.807+0000 7f67a6e1d640 1 -- 172.21.15.2:0/4234070828 --> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f67a0104150 con 0x7f6788039200 2024-09-19T06:06:00.568 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.811+0000 7f679dffb640 1 -- 172.21.15.2:0/4234070828 <== mgr.14118 v2:172.21.15.2:6800/1200011821 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f67a0104150 con 0x7f6788039200 2024-09-19T06:06:00.568 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.813+0000 7f67a6e1d640 1 -- 172.21.15.2:0/4234070828 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f6788039200 msgr2=0x7f678803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:00.568 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.813+0000 7f67a6e1d640 1 --2- 172.21.15.2:0/4234070828 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f6788039200 0x7f678803b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f67940098c0 tx=0x7f6794006db0 comp rx=0 tx=0).stop 2024-09-19T06:06:00.568 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.813+0000 7f67a6e1d640 1 -- 172.21.15.2:0/4234070828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67a007de00 msgr2=0x7f67a019d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:00.568 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.813+0000 7f67a6e1d640 1 --2- 172.21.15.2:0/4234070828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67a007de00 0x7f67a019d890 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f67900097f0 tx=0x7f6790030d00 comp rx=0 tx=0).stop 2024-09-19T06:06:00.569 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.814+0000 7f67a6e1d640 1 -- 172.21.15.2:0/4234070828 shutdown_connections 2024-09-19T06:06:00.569 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.814+0000 7f67a6e1d640 1 --2- 172.21.15.2:0/4234070828 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f6788039200 0x7f678803b6c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:00.569 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.814+0000 7f67a6e1d640 1 --2- 172.21.15.2:0/4234070828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67a007de00 0x7f67a019d890 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:00.569 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.814+0000 7f67a6e1d640 1 -- 172.21.15.2:0/4234070828 >> 172.21.15.2:0/4234070828 conn(0x7f67a0102ea0 msgr2=0x7f67a0103a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:00.569 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.814+0000 7f67a6e1d640 1 -- 172.21.15.2:0/4234070828 shutdown_connections 2024-09-19T06:06:00.569 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:05:59.814+0000 7f67a6e1d640 1 -- 172.21.15.2:0/4234070828 wait complete. 2024-09-19T06:06:00.569 INFO:teuthology.orchestra.run.smithi002.stdout:Deploying unmanaged mgr service... 2024-09-19T06:06:01.094 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:00 smithi002 ceph-mon[30982]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:06:01.094 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:00 smithi002 ceph-mon[30982]: Saving service mon spec with placement count:5 2024-09-19T06:06:01.094 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:00 smithi002 ceph-mon[30982]: from='mgr.14118 172.21.15.2:0/1043732806' entity='mgr.x' 2024-09-19T06:06:02.083 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-19T06:06:02.083 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:00.985+0000 7fb157bf4640 1 Processor -- start 2024-09-19T06:06:02.084 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:00.985+0000 7fb157bf4640 1 -- start start 2024-09-19T06:06:02.084 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:00.985+0000 7fb157bf4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb150105fd0 0x7fb1501063d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:02.084 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:00.985+0000 7fb157bf4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb15007bdc0 con 0x7fb150105fd0 2024-09-19T06:06:02.084 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:00.985+0000 7fb155990640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb150105fd0 0x7fb1501063d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:02.084 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:00.985+0000 7fb155990640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb150105fd0 0x7fb1501063d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42046/0 (socket says 172.21.15.2:42046) 2024-09-19T06:06:02.084 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:00.985+0000 7fb155990640 1 -- 172.21.15.2:0/824226444 learned_addr learned my addr 172.21.15.2:0/824226444 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:06:02.084 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:00.986+0000 7fb155990640 1 -- 172.21.15.2:0/824226444 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb150106910 con 0x7fb150105fd0 2024-09-19T06:06:02.084 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:00.986+0000 7fb155990640 1 --2- 172.21.15.2:0/824226444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb150105fd0 0x7fb1501063d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb14c009820 tx=0x7fb14c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6752ffe1571915b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:02.085 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:00.987+0000 7fb15498e640 1 -- 172.21.15.2:0/824226444 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb14c037070 con 0x7fb150105fd0 2024-09-19T06:06:02.085 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:00.987+0000 7fb15498e640 1 -- 172.21.15.2:0/824226444 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fb14c0328d0 con 0x7fb150105fd0 2024-09-19T06:06:02.085 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:00.987+0000 7fb15498e640 1 -- 172.21.15.2:0/824226444 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb14c0307d0 con 0x7fb150105fd0 2024-09-19T06:06:02.085 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:00.987+0000 7fb157bf4640 1 -- 172.21.15.2:0/824226444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb150105fd0 msgr2=0x7fb1501063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:02.085 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:00.987+0000 7fb157bf4640 1 --2- 172.21.15.2:0/824226444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb150105fd0 0x7fb1501063d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb14c009820 tx=0x7fb14c02a270 comp rx=0 tx=0).stop 2024-09-19T06:06:02.085 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:00.987+0000 7fb157bf4640 1 -- 172.21.15.2:0/824226444 shutdown_connections 2024-09-19T06:06:02.085 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:00.987+0000 7fb157bf4640 1 --2- 172.21.15.2:0/824226444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb150105fd0 0x7fb1501063d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:02.085 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:00.987+0000 7fb157bf4640 1 -- 172.21.15.2:0/824226444 >> 172.21.15.2:0/824226444 conn(0x7fb150101d40 msgr2=0x7fb1501041c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:02.085 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:00.987+0000 7fb157bf4640 1 -- 172.21.15.2:0/824226444 shutdown_connections 2024-09-19T06:06:02.086 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:00.987+0000 7fb157bf4640 1 -- 172.21.15.2:0/824226444 wait complete. 2024-09-19T06:06:02.086 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:00.988+0000 7fb157bf4640 1 Processor -- start 2024-09-19T06:06:02.086 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:00.988+0000 7fb157bf4640 1 -- start start 2024-09-19T06:06:02.086 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:00.988+0000 7fb157bf4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb150105fd0 0x7fb15019d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:02.086 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:00.988+0000 7fb157bf4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb1501079b0 con 0x7fb150105fd0 2024-09-19T06:06:02.086 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:00.988+0000 7fb155990640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb150105fd0 0x7fb15019d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:02.086 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:00.988+0000 7fb155990640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb150105fd0 0x7fb15019d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42054/0 (socket says 172.21.15.2:42054) 2024-09-19T06:06:02.087 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:00.988+0000 7fb155990640 1 -- 172.21.15.2:0/806020581 learned_addr learned my addr 172.21.15.2:0/806020581 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:06:02.087 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:00.988+0000 7fb155990640 1 -- 172.21.15.2:0/806020581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb15019dde0 con 0x7fb150105fd0 2024-09-19T06:06:02.087 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:00.989+0000 7fb155990640 1 --2- 172.21.15.2:0/806020581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb150105fd0 0x7fb15019d8a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb14c0097f0 tx=0x7fb14c030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:02.087 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:00.989+0000 7fb146ffd640 1 -- 172.21.15.2:0/806020581 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb14c037040 con 0x7fb150105fd0 2024-09-19T06:06:02.087 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:00.989+0000 7fb146ffd640 1 -- 172.21.15.2:0/806020581 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fb14c03b3f0 con 0x7fb150105fd0 2024-09-19T06:06:02.087 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:00.989+0000 7fb146ffd640 1 -- 172.21.15.2:0/806020581 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb14c03a520 con 0x7fb150105fd0 2024-09-19T06:06:02.087 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:00.989+0000 7fb157bf4640 1 -- 172.21.15.2:0/806020581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb15019e070 con 0x7fb150105fd0 2024-09-19T06:06:02.087 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:00.989+0000 7fb157bf4640 1 -- 172.21.15.2:0/806020581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1501a0d60 con 0x7fb150105fd0 2024-09-19T06:06:02.087 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:00.990+0000 7fb146ffd640 1 -- 172.21.15.2:0/806020581 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fb14c03b5a0 con 0x7fb150105fd0 2024-09-19T06:06:02.087 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:00.990+0000 7fb146ffd640 1 --2- 172.21.15.2:0/806020581 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7fb13c039200 0x7fb13c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:02.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:00.990+0000 7fb146ffd640 1 -- 172.21.15.2:0/806020581 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb14c06c420 con 0x7fb150105fd0 2024-09-19T06:06:02.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:00.990+0000 7fb157bf4640 1 -- 172.21.15.2:0/806020581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1501063d0 con 0x7fb150105fd0 2024-09-19T06:06:02.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:00.990+0000 7fb15518f640 1 --2- 172.21.15.2:0/806020581 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7fb13c039200 0x7fb13c03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:02.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:00.991+0000 7fb15518f640 1 --2- 172.21.15.2:0/806020581 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7fb13c039200 0x7fb13c03b6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb1400098c0 tx=0x7fb140006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:02.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:00.995+0000 7fb146ffd640 1 -- 172.21.15.2:0/806020581 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb14c03b980 con 0x7fb150105fd0 2024-09-19T06:06:02.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:01.186+0000 7fb157bf4640 1 -- 172.21.15.2:0/806020581 --> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fb15002daa0 con 0x7fb13c039200 2024-09-19T06:06:02.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:01.191+0000 7fb146ffd640 1 -- 172.21.15.2:0/806020581 <== mgr.14118 v2:172.21.15.2:6800/1200011821 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fb15002daa0 con 0x7fb13c039200 2024-09-19T06:06:02.089 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:01.193+0000 7fb157bf4640 1 -- 172.21.15.2:0/806020581 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7fb13c039200 msgr2=0x7fb13c03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:02.089 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:01.193+0000 7fb157bf4640 1 --2- 172.21.15.2:0/806020581 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7fb13c039200 0x7fb13c03b6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb1400098c0 tx=0x7fb140006db0 comp rx=0 tx=0).stop 2024-09-19T06:06:02.089 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:01.193+0000 7fb157bf4640 1 -- 172.21.15.2:0/806020581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb150105fd0 msgr2=0x7fb15019d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:02.089 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:01.193+0000 7fb157bf4640 1 --2- 172.21.15.2:0/806020581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb150105fd0 0x7fb15019d8a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb14c0097f0 tx=0x7fb14c030d00 comp rx=0 tx=0).stop 2024-09-19T06:06:02.089 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:01.193+0000 7fb157bf4640 1 -- 172.21.15.2:0/806020581 shutdown_connections 2024-09-19T06:06:02.089 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:01.193+0000 7fb157bf4640 1 --2- 172.21.15.2:0/806020581 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7fb13c039200 0x7fb13c03b6c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:02.089 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:01.193+0000 7fb157bf4640 1 --2- 172.21.15.2:0/806020581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb150105fd0 0x7fb15019d8a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:02.090 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:01.193+0000 7fb157bf4640 1 -- 172.21.15.2:0/806020581 >> 172.21.15.2:0/806020581 conn(0x7fb150101d40 msgr2=0x7fb150194520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:02.090 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:01.193+0000 7fb157bf4640 1 -- 172.21.15.2:0/806020581 shutdown_connections 2024-09-19T06:06:02.090 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:01.193+0000 7fb157bf4640 1 -- 172.21.15.2:0/806020581 wait complete. 2024-09-19T06:06:02.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:02 smithi002 ceph-mon[30982]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:06:02.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:02 smithi002 ceph-mon[30982]: Saving service mgr spec with placement count:2 2024-09-19T06:06:02.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:02 smithi002 ceph-mon[30982]: from='mgr.14118 172.21.15.2:0/1043732806' entity='mgr.x' 2024-09-19T06:06:03.470 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.506+0000 7fee8af36640 1 Processor -- start 2024-09-19T06:06:03.470 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.506+0000 7fee8af36640 1 -- start start 2024-09-19T06:06:03.470 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.506+0000 7fee8af36640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee84105a10 0x7fee84105e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:03.471 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.506+0000 7fee8af36640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fee841063e0 con 0x7fee84105a10 2024-09-19T06:06:03.471 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.506+0000 7fee88cd2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee84105a10 0x7fee84105e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:03.471 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.506+0000 7fee88cd2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee84105a10 0x7fee84105e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42064/0 (socket says 172.21.15.2:42064) 2024-09-19T06:06:03.471 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.506+0000 7fee88cd2640 1 -- 172.21.15.2:0/2354433912 learned_addr learned my addr 172.21.15.2:0/2354433912 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:06:03.471 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.506+0000 7fee88cd2640 1 -- 172.21.15.2:0/2354433912 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee84106560 con 0x7fee84105a10 2024-09-19T06:06:03.471 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.507+0000 7fee88cd2640 1 --2- 172.21.15.2:0/2354433912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee84105a10 0x7fee84105e10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fee74009820 tx=0x7fee7402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95218b4f45fe57ff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:03.471 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.507+0000 7fee837fe640 1 -- 172.21.15.2:0/2354433912 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee74037070 con 0x7fee84105a10 2024-09-19T06:06:03.471 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.507+0000 7fee837fe640 1 -- 172.21.15.2:0/2354433912 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fee740328d0 con 0x7fee84105a10 2024-09-19T06:06:03.471 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.507+0000 7fee837fe640 1 -- 172.21.15.2:0/2354433912 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee740307d0 con 0x7fee84105a10 2024-09-19T06:06:03.471 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.508+0000 7fee8af36640 1 -- 172.21.15.2:0/2354433912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee84105a10 msgr2=0x7fee84105e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:03.472 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.508+0000 7fee8af36640 1 --2- 172.21.15.2:0/2354433912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee84105a10 0x7fee84105e10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fee74009820 tx=0x7fee7402a270 comp rx=0 tx=0).stop 2024-09-19T06:06:03.472 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.508+0000 7fee8af36640 1 -- 172.21.15.2:0/2354433912 shutdown_connections 2024-09-19T06:06:03.472 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.508+0000 7fee8af36640 1 --2- 172.21.15.2:0/2354433912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee84105a10 0x7fee84105e10 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:03.472 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.508+0000 7fee8af36640 1 -- 172.21.15.2:0/2354433912 >> 172.21.15.2:0/2354433912 conn(0x7fee84101590 msgr2=0x7fee841039b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:03.472 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.508+0000 7fee8af36640 1 -- 172.21.15.2:0/2354433912 shutdown_connections 2024-09-19T06:06:03.472 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.508+0000 7fee8af36640 1 -- 172.21.15.2:0/2354433912 wait complete. 2024-09-19T06:06:03.472 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.509+0000 7fee8af36640 1 Processor -- start 2024-09-19T06:06:03.472 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.509+0000 7fee8af36640 1 -- start start 2024-09-19T06:06:03.472 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.509+0000 7fee8af36640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee84105a10 0x7fee8419b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:03.472 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.509+0000 7fee8af36640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fee8410bc70 con 0x7fee84105a10 2024-09-19T06:06:03.473 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.509+0000 7fee88cd2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee84105a10 0x7fee8419b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:03.473 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.509+0000 7fee88cd2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee84105a10 0x7fee8419b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42080/0 (socket says 172.21.15.2:42080) 2024-09-19T06:06:03.473 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.509+0000 7fee88cd2640 1 -- 172.21.15.2:0/2330444960 learned_addr learned my addr 172.21.15.2:0/2330444960 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:06:03.473 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.509+0000 7fee88cd2640 1 -- 172.21.15.2:0/2330444960 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee8419bc20 con 0x7fee84105a10 2024-09-19T06:06:03.473 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.510+0000 7fee88cd2640 1 --2- 172.21.15.2:0/2330444960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee84105a10 0x7fee8419b6e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fee74009940 tx=0x7fee74032e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:03.473 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.510+0000 7fee81ffb640 1 -- 172.21.15.2:0/2330444960 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee74042070 con 0x7fee84105a10 2024-09-19T06:06:03.473 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.510+0000 7fee8af36640 1 -- 172.21.15.2:0/2330444960 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee8419beb0 con 0x7fee84105a10 2024-09-19T06:06:03.473 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.510+0000 7fee81ffb640 1 -- 172.21.15.2:0/2330444960 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fee74030c80 con 0x7fee84105a10 2024-09-19T06:06:03.473 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.510+0000 7fee81ffb640 1 -- 172.21.15.2:0/2330444960 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee74037040 con 0x7fee84105a10 2024-09-19T06:06:03.474 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.510+0000 7fee8af36640 1 -- 172.21.15.2:0/2330444960 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee8419eba0 con 0x7fee84105a10 2024-09-19T06:06:03.474 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.511+0000 7fee81ffb640 1 -- 172.21.15.2:0/2330444960 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fee74045070 con 0x7fee84105a10 2024-09-19T06:06:03.474 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.511+0000 7fee81ffb640 1 --2- 172.21.15.2:0/2330444960 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7fee6c039200 0x7fee6c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:03.474 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.511+0000 7fee81ffb640 1 -- 172.21.15.2:0/2330444960 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fee7403d840 con 0x7fee84105a10 2024-09-19T06:06:03.474 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.511+0000 7fee83fff640 1 --2- 172.21.15.2:0/2330444960 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7fee6c039200 0x7fee6c03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:03.474 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.511+0000 7fee8af36640 1 -- 172.21.15.2:0/2330444960 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee8410bdf0 con 0x7fee84105a10 2024-09-19T06:06:03.474 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.512+0000 7fee83fff640 1 --2- 172.21.15.2:0/2330444960 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7fee6c039200 0x7fee6c03b6c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fee780098c0 tx=0x7fee78006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:03.474 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.516+0000 7fee81ffb640 1 -- 172.21.15.2:0/2330444960 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fee74045360 con 0x7fee84105a10 2024-09-19T06:06:03.474 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.698+0000 7fee8af36640 1 -- 172.21.15.2:0/2330444960 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fee8419f030 con 0x7fee84105a10 2024-09-19T06:06:03.475 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.701+0000 7fee81ffb640 1 -- 172.21.15.2:0/2330444960 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v6)=0 v6) ==== 142+0+0 (secure 0 0 0) 0x7fee74046dd0 con 0x7fee84105a10 2024-09-19T06:06:03.475 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.703+0000 7fee8af36640 1 -- 172.21.15.2:0/2330444960 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7fee6c039200 msgr2=0x7fee6c03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:03.475 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.703+0000 7fee8af36640 1 --2- 172.21.15.2:0/2330444960 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7fee6c039200 0x7fee6c03b6c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fee780098c0 tx=0x7fee78006db0 comp rx=0 tx=0).stop 2024-09-19T06:06:03.475 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.703+0000 7fee8af36640 1 -- 172.21.15.2:0/2330444960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee84105a10 msgr2=0x7fee8419b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:03.475 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.703+0000 7fee8af36640 1 --2- 172.21.15.2:0/2330444960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee84105a10 0x7fee8419b6e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fee74009940 tx=0x7fee74032e10 comp rx=0 tx=0).stop 2024-09-19T06:06:03.475 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.703+0000 7fee8af36640 1 -- 172.21.15.2:0/2330444960 shutdown_connections 2024-09-19T06:06:03.475 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.703+0000 7fee8af36640 1 --2- 172.21.15.2:0/2330444960 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7fee6c039200 0x7fee6c03b6c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:03.475 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.703+0000 7fee8af36640 1 --2- 172.21.15.2:0/2330444960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee84105a10 0x7fee8419b6e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:03.476 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.703+0000 7fee8af36640 1 -- 172.21.15.2:0/2330444960 >> 172.21.15.2:0/2330444960 conn(0x7fee84101590 msgr2=0x7fee841020e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:03.476 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.703+0000 7fee8af36640 1 -- 172.21.15.2:0/2330444960 shutdown_connections 2024-09-19T06:06:03.476 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:02.703+0000 7fee8af36640 1 -- 172.21.15.2:0/2330444960 wait complete. 2024-09-19T06:06:03.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:03 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/2330444960' entity='client.admin' 2024-09-19T06:06:03.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:03 smithi002 ceph-mon[30982]: from='mgr.14118 172.21.15.2:0/1043732806' entity='mgr.x' 2024-09-19T06:06:03.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:03 smithi002 ceph-mon[30982]: from='mgr.14118 172.21.15.2:0/1043732806' entity='mgr.x' 2024-09-19T06:06:05.360 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:03.929+0000 7f1b0c876640 1 Processor -- start 2024-09-19T06:06:05.360 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:03.929+0000 7f1b0c876640 1 -- start start 2024-09-19T06:06:05.361 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:03.929+0000 7f1b0c876640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b0807dd70 0x7f1b0807c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:05.361 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:03.929+0000 7f1b0c876640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1b0807c7b0 con 0x7f1b0807dd70 2024-09-19T06:06:05.361 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:03.929+0000 7f1b0659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b0807dd70 0x7f1b0807c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:05.361 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:03.929+0000 7f1b0659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b0807dd70 0x7f1b0807c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42084/0 (socket says 172.21.15.2:42084) 2024-09-19T06:06:05.361 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:03.929+0000 7f1b0659c640 1 -- 172.21.15.2:0/556705829 learned_addr learned my addr 172.21.15.2:0/556705829 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:06:05.361 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:03.930+0000 7f1b0659c640 1 -- 172.21.15.2:0/556705829 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b0807c930 con 0x7f1b0807dd70 2024-09-19T06:06:05.361 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:03.930+0000 7f1b0659c640 1 --2- 172.21.15.2:0/556705829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b0807dd70 0x7f1b0807c270 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1af8009820 tx=0x7f1af802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe698d340dc885c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:05.361 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:03.930+0000 7f1b0559a640 1 -- 172.21.15.2:0/556705829 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1af8037070 con 0x7f1b0807dd70 2024-09-19T06:06:05.361 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:03.931+0000 7f1b0559a640 1 -- 172.21.15.2:0/556705829 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1af80328f0 con 0x7f1b0807dd70 2024-09-19T06:06:05.361 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:03.931+0000 7f1b0559a640 1 -- 172.21.15.2:0/556705829 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1af8030740 con 0x7f1b0807dd70 2024-09-19T06:06:05.361 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:03.931+0000 7f1b0c876640 1 -- 172.21.15.2:0/556705829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b0807dd70 msgr2=0x7f1b0807c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:05.361 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:03.931+0000 7f1b0c876640 1 --2- 172.21.15.2:0/556705829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b0807dd70 0x7f1b0807c270 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1af8009820 tx=0x7f1af802a270 comp rx=0 tx=0).stop 2024-09-19T06:06:05.362 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:03.931+0000 7f1b0c876640 1 -- 172.21.15.2:0/556705829 shutdown_connections 2024-09-19T06:06:05.362 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:03.931+0000 7f1b0c876640 1 --2- 172.21.15.2:0/556705829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b0807dd70 0x7f1b0807c270 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:05.362 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:03.931+0000 7f1b0c876640 1 -- 172.21.15.2:0/556705829 >> 172.21.15.2:0/556705829 conn(0x7f1b08102f60 msgr2=0x7f1b08105380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:05.362 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:03.931+0000 7f1b0c876640 1 -- 172.21.15.2:0/556705829 shutdown_connections 2024-09-19T06:06:05.362 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:03.931+0000 7f1b0c876640 1 -- 172.21.15.2:0/556705829 wait complete. 2024-09-19T06:06:05.362 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:03.932+0000 7f1b0c876640 1 Processor -- start 2024-09-19T06:06:05.362 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:03.932+0000 7f1b0c876640 1 -- start start 2024-09-19T06:06:05.362 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:03.932+0000 7f1b0c876640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b0807dd70 0x7f1b0819d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:05.362 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:03.932+0000 7f1b0c876640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1b0810dd20 con 0x7f1b0807dd70 2024-09-19T06:06:05.362 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:03.932+0000 7f1b0659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b0807dd70 0x7f1b0819d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:05.362 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:03.932+0000 7f1b0659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b0807dd70 0x7f1b0819d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42094/0 (socket says 172.21.15.2:42094) 2024-09-19T06:06:05.362 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:03.932+0000 7f1b0659c640 1 -- 172.21.15.2:0/3245645505 learned_addr learned my addr 172.21.15.2:0/3245645505 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:06:05.363 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:03.933+0000 7f1b0659c640 1 -- 172.21.15.2:0/3245645505 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b0819ddb0 con 0x7f1b0807dd70 2024-09-19T06:06:05.363 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:03.933+0000 7f1b0659c640 1 --2- 172.21.15.2:0/3245645505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b0807dd70 0x7f1b0819d870 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1af80097f0 tx=0x7f1af8030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:05.363 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:03.933+0000 7f1af77fe640 1 -- 172.21.15.2:0/3245645505 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1af8042070 con 0x7f1b0807dd70 2024-09-19T06:06:05.363 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:03.933+0000 7f1af77fe640 1 -- 172.21.15.2:0/3245645505 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1af8030d80 con 0x7f1b0807dd70 2024-09-19T06:06:05.363 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:03.933+0000 7f1b0c876640 1 -- 172.21.15.2:0/3245645505 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b0819e040 con 0x7f1b0807dd70 2024-09-19T06:06:05.363 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:03.933+0000 7f1af77fe640 1 -- 172.21.15.2:0/3245645505 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1af8037040 con 0x7f1b0807dd70 2024-09-19T06:06:05.363 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:03.933+0000 7f1b0c876640 1 -- 172.21.15.2:0/3245645505 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b081a0d30 con 0x7f1b0807dd70 2024-09-19T06:06:05.363 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:03.934+0000 7f1af77fe640 1 -- 172.21.15.2:0/3245645505 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f1af8045070 con 0x7f1b0807dd70 2024-09-19T06:06:05.363 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:03.934+0000 7f1b0c876640 1 -- 172.21.15.2:0/3245645505 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b0807c2f0 con 0x7f1b0807dd70 2024-09-19T06:06:05.363 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:03.934+0000 7f1af77fe640 1 --2- 172.21.15.2:0/3245645505 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f1af0039200 0x7f1af003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:05.363 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:03.934+0000 7f1af77fe640 1 -- 172.21.15.2:0/3245645505 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f1af806c340 con 0x7f1b0807dd70 2024-09-19T06:06:05.363 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:03.934+0000 7f1b05d9b640 1 --2- 172.21.15.2:0/3245645505 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f1af0039200 0x7f1af003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:05.363 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:03.935+0000 7f1b05d9b640 1 --2- 172.21.15.2:0/3245645505 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f1af0039200 0x7f1af003b6c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1afc0098c0 tx=0x7f1afc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:05.364 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:03.939+0000 7f1af77fe640 1 -- 172.21.15.2:0/3245645505 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1af803ae30 con 0x7f1b0807dd70 2024-09-19T06:06:05.364 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:04.130+0000 7f1b0c876640 1 -- 172.21.15.2:0/3245645505 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f1b081a0f00 con 0x7f1b0807dd70 2024-09-19T06:06:05.364 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:04.132+0000 7f1af77fe640 1 -- 172.21.15.2:0/3245645505 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f1af8045520 con 0x7f1b0807dd70 2024-09-19T06:06:05.364 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:04.134+0000 7f1b0c876640 1 -- 172.21.15.2:0/3245645505 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f1af0039200 msgr2=0x7f1af003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:05.364 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:04.134+0000 7f1b0c876640 1 --2- 172.21.15.2:0/3245645505 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f1af0039200 0x7f1af003b6c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1afc0098c0 tx=0x7f1afc006db0 comp rx=0 tx=0).stop 2024-09-19T06:06:05.364 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:04.134+0000 7f1b0c876640 1 -- 172.21.15.2:0/3245645505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b0807dd70 msgr2=0x7f1b0819d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:05.364 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:04.134+0000 7f1b0c876640 1 --2- 172.21.15.2:0/3245645505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b0807dd70 0x7f1b0819d870 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1af80097f0 tx=0x7f1af8030c70 comp rx=0 tx=0).stop 2024-09-19T06:06:05.364 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:04.134+0000 7f1b0c876640 1 -- 172.21.15.2:0/3245645505 shutdown_connections 2024-09-19T06:06:05.364 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:04.135+0000 7f1b0c876640 1 --2- 172.21.15.2:0/3245645505 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f1af0039200 0x7f1af003b6c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:05.364 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:04.135+0000 7f1b0c876640 1 --2- 172.21.15.2:0/3245645505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b0807dd70 0x7f1b0819d870 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:05.364 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:04.135+0000 7f1b0c876640 1 -- 172.21.15.2:0/3245645505 >> 172.21.15.2:0/3245645505 conn(0x7f1b08102f60 msgr2=0x7f1b08103ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:05.364 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:04.135+0000 7f1b0c876640 1 -- 172.21.15.2:0/3245645505 shutdown_connections 2024-09-19T06:06:05.365 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:04.135+0000 7f1b0c876640 1 -- 172.21.15.2:0/3245645505 wait complete. 2024-09-19T06:06:05.365 INFO:teuthology.orchestra.run.smithi002.stdout:Enabling the dashboard module... 2024-09-19T06:06:05.384 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:05 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/3245645505' entity='client.admin' 2024-09-19T06:06:05.384 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:05 smithi002 ceph-mon[30982]: from='mgr.14118 172.21.15.2:0/1043732806' entity='mgr.x' 2024-09-19T06:06:07.154 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:06 smithi002 ceph-mon[30982]: from='mgr.14118 172.21.15.2:0/1043732806' entity='mgr.x' 2024-09-19T06:06:07.155 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:06 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1001120755' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-19T06:06:07.155 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:06 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: ignoring --setuser ceph since I am not root 2024-09-19T06:06:07.155 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:06 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: ignoring --setgroup ceph since I am not root 2024-09-19T06:06:07.155 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:06 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:06:06.976+0000 7f81b68e5040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T06:06:07.155 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:07 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:06:07.035+0000 7f81b68e5040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T06:06:07.418 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:07 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:06:07.192+0000 7f81b68e5040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T06:06:07.418 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:07 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:06:07.260+0000 7f81b68e5040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T06:06:07.722 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:07 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:06:07.416+0000 7f81b68e5040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:06:07.722 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:07 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:06:07.563+0000 7f81b68e5040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T06:06:07.741 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:05.754+0000 7f4c139ee640 1 Processor -- start 2024-09-19T06:06:07.741 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:05.754+0000 7f4c139ee640 1 -- start start 2024-09-19T06:06:07.742 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:05.755+0000 7f4c139ee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c0c107710 0x7f4c0c107b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:07.742 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:05.755+0000 7f4c139ee640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0c1080e0 con 0x7f4c0c107710 2024-09-19T06:06:07.742 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:05.755+0000 7f4c1178a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c0c107710 0x7f4c0c107b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:07.742 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:05.755+0000 7f4c1178a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c0c107710 0x7f4c0c107b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44948/0 (socket says 172.21.15.2:44948) 2024-09-19T06:06:07.742 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:05.755+0000 7f4c1178a640 1 -- 172.21.15.2:0/483064345 learned_addr learned my addr 172.21.15.2:0/483064345 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:06:07.742 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:05.755+0000 7f4c1178a640 1 -- 172.21.15.2:0/483064345 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c0c108910 con 0x7f4c0c107710 2024-09-19T06:06:07.742 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:05.756+0000 7f4c1178a640 1 --2- 172.21.15.2:0/483064345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c0c107710 0x7f4c0c107b10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4c08009820 tx=0x7f4c0802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c7c478d548a7646 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:07.742 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:05.756+0000 7f4c03fff640 1 -- 172.21.15.2:0/483064345 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c08037070 con 0x7f4c0c107710 2024-09-19T06:06:07.742 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:05.756+0000 7f4c03fff640 1 -- 172.21.15.2:0/483064345 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4c080328f0 con 0x7f4c0c107710 2024-09-19T06:06:07.742 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:05.756+0000 7f4c03fff640 1 -- 172.21.15.2:0/483064345 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c08030740 con 0x7f4c0c107710 2024-09-19T06:06:07.742 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:05.757+0000 7f4c139ee640 1 -- 172.21.15.2:0/483064345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c0c107710 msgr2=0x7f4c0c107b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:07.743 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:05.757+0000 7f4c139ee640 1 --2- 172.21.15.2:0/483064345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c0c107710 0x7f4c0c107b10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4c08009820 tx=0x7f4c0802a270 comp rx=0 tx=0).stop 2024-09-19T06:06:07.743 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:05.757+0000 7f4c139ee640 1 -- 172.21.15.2:0/483064345 shutdown_connections 2024-09-19T06:06:07.743 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:05.757+0000 7f4c139ee640 1 --2- 172.21.15.2:0/483064345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c0c107710 0x7f4c0c107b10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.743 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:05.757+0000 7f4c139ee640 1 -- 172.21.15.2:0/483064345 >> 172.21.15.2:0/483064345 conn(0x7f4c0c102e80 msgr2=0x7f4c0c1052e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:07.743 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:05.757+0000 7f4c139ee640 1 -- 172.21.15.2:0/483064345 shutdown_connections 2024-09-19T06:06:07.743 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:05.757+0000 7f4c139ee640 1 -- 172.21.15.2:0/483064345 wait complete. 2024-09-19T06:06:07.743 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:05.758+0000 7f4c139ee640 1 Processor -- start 2024-09-19T06:06:07.743 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:05.758+0000 7f4c139ee640 1 -- start start 2024-09-19T06:06:07.743 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:05.758+0000 7f4c139ee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c0c107710 0x7f4c0c19d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:07.743 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:05.758+0000 7f4c139ee640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0c10bcc0 con 0x7f4c0c107710 2024-09-19T06:06:07.744 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:05.758+0000 7f4c1178a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c0c107710 0x7f4c0c19d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:07.744 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:05.758+0000 7f4c1178a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c0c107710 0x7f4c0c19d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44952/0 (socket says 172.21.15.2:44952) 2024-09-19T06:06:07.744 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:05.758+0000 7f4c1178a640 1 -- 172.21.15.2:0/1001120755 learned_addr learned my addr 172.21.15.2:0/1001120755 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:06:07.744 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:05.758+0000 7f4c1178a640 1 -- 172.21.15.2:0/1001120755 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c0c19de10 con 0x7f4c0c107710 2024-09-19T06:06:07.744 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:05.759+0000 7f4c1178a640 1 --2- 172.21.15.2:0/1001120755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c0c107710 0x7f4c0c19d8d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4c08009940 tx=0x7f4c08030cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:07.744 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:05.759+0000 7f4c027fc640 1 -- 172.21.15.2:0/1001120755 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c08042070 con 0x7f4c0c107710 2024-09-19T06:06:07.744 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:05.759+0000 7f4c139ee640 1 -- 172.21.15.2:0/1001120755 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c0c19e0a0 con 0x7f4c0c107710 2024-09-19T06:06:07.744 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:05.759+0000 7f4c027fc640 1 -- 172.21.15.2:0/1001120755 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4c08030e30 con 0x7f4c0c107710 2024-09-19T06:06:07.744 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:05.759+0000 7f4c027fc640 1 -- 172.21.15.2:0/1001120755 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c08037040 con 0x7f4c0c107710 2024-09-19T06:06:07.744 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:05.759+0000 7f4c139ee640 1 -- 172.21.15.2:0/1001120755 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c0c1a0d90 con 0x7f4c0c107710 2024-09-19T06:06:07.744 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:05.760+0000 7f4c027fc640 1 -- 172.21.15.2:0/1001120755 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f4c08045070 con 0x7f4c0c107710 2024-09-19T06:06:07.745 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:05.760+0000 7f4c027fc640 1 --2- 172.21.15.2:0/1001120755 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f4bf80391b0 0x7f4bf803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:07.745 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:05.760+0000 7f4c027fc640 1 -- 172.21.15.2:0/1001120755 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f4c0806c300 con 0x7f4c0c107710 2024-09-19T06:06:07.745 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:05.760+0000 7f4c139ee640 1 -- 172.21.15.2:0/1001120755 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c0c10be40 con 0x7f4c0c107710 2024-09-19T06:06:07.745 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:05.760+0000 7f4c10f89640 1 --2- 172.21.15.2:0/1001120755 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f4bf80391b0 0x7f4bf803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:07.745 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:05.761+0000 7f4c10f89640 1 --2- 172.21.15.2:0/1001120755 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f4bf80391b0 0x7f4bf803b670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc0098c0 tx=0x7f4bfc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:07.745 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:05.765+0000 7f4c027fc640 1 -- 172.21.15.2:0/1001120755 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4c0804b170 con 0x7f4c0c107710 2024-09-19T06:06:07.745 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:05.994+0000 7f4c139ee640 1 -- 172.21.15.2:0/1001120755 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f4c0c1a0f60 con 0x7f4c0c107710 2024-09-19T06:06:07.745 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:06.821+0000 7f4c027fc640 1 -- 172.21.15.2:0/1001120755 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f4c08045520 con 0x7f4c0c107710 2024-09-19T06:06:07.745 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:06.823+0000 7f4c027fc640 1 -- 172.21.15.2:0/1001120755 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f4c08042d00 con 0x7f4c0c107710 2024-09-19T06:06:07.745 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:06.824+0000 7f4c139ee640 1 -- 172.21.15.2:0/1001120755 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f4bf80391b0 msgr2=0x7f4bf803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:07.745 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:06.824+0000 7f4c139ee640 1 --2- 172.21.15.2:0/1001120755 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f4bf80391b0 0x7f4bf803b670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc0098c0 tx=0x7f4bfc006db0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.745 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:06.824+0000 7f4c139ee640 1 -- 172.21.15.2:0/1001120755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c0c107710 msgr2=0x7f4c0c19d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:07.745 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:06.824+0000 7f4c139ee640 1 --2- 172.21.15.2:0/1001120755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c0c107710 0x7f4c0c19d8d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4c08009940 tx=0x7f4c08030cc0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.746 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:06.825+0000 7f4c139ee640 1 -- 172.21.15.2:0/1001120755 shutdown_connections 2024-09-19T06:06:07.746 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:06.825+0000 7f4c139ee640 1 --2- 172.21.15.2:0/1001120755 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f4bf80391b0 0x7f4bf803b670 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.746 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:06.825+0000 7f4c139ee640 1 --2- 172.21.15.2:0/1001120755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c0c107710 0x7f4c0c19d8d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.746 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:06.825+0000 7f4c139ee640 1 -- 172.21.15.2:0/1001120755 >> 172.21.15.2:0/1001120755 conn(0x7f4c0c102e80 msgr2=0x7f4c0c103970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:07.746 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:06.825+0000 7f4c139ee640 1 -- 172.21.15.2:0/1001120755 shutdown_connections 2024-09-19T06:06:07.746 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:06.825+0000 7f4c139ee640 1 -- 172.21.15.2:0/1001120755 wait complete. 2024-09-19T06:06:08.086 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:07 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1001120755' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-19T06:06:08.086 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:07 smithi002 ceph-mon[30982]: mgrmap e9: x(active, since 19s) 2024-09-19T06:06:08.086 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:07 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:06:07.895+0000 7f81b68e5040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T06:06:08.086 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:07 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:06:07.962+0000 7f81b68e5040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T06:06:08.373 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:08 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:06:08.157+0000 7f81b68e5040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T06:06:08.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:08 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/379787887' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T06:06:08.998 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-19T06:06:08.998 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-19T06:06:08.998 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T06:06:08.998 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T06:06:08.998 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T06:06:08.998 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-19T06:06:08.999 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.164+0000 7ff74b7ac640 1 Processor -- start 2024-09-19T06:06:08.999 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.164+0000 7ff74b7ac640 1 -- start start 2024-09-19T06:06:08.999 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.164+0000 7ff74b7ac640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff744108160 0x7ff74410a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:08.999 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.164+0000 7ff74b7ac640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff74407be40 con 0x7ff744108160 2024-09-19T06:06:08.999 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.165+0000 7ff749548640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff744108160 0x7ff74410a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:08.999 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.165+0000 7ff749548640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff744108160 0x7ff74410a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44970/0 (socket says 172.21.15.2:44970) 2024-09-19T06:06:08.999 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.165+0000 7ff749548640 1 -- 172.21.15.2:0/905249105 learned_addr learned my addr 172.21.15.2:0/905249105 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:06:08.999 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.165+0000 7ff749548640 1 -- 172.21.15.2:0/905249105 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff74410aa90 con 0x7ff744108160 2024-09-19T06:06:08.999 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.166+0000 7ff749548640 1 --2- 172.21.15.2:0/905249105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff744108160 0x7ff74410a550 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff740009820 tx=0x7ff74002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b74ea1d3b98d0c80 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:08.999 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.166+0000 7ff73bfff640 1 -- 172.21.15.2:0/905249105 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff740037070 con 0x7ff744108160 2024-09-19T06:06:09.000 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.166+0000 7ff73bfff640 1 -- 172.21.15.2:0/905249105 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff7400328f0 con 0x7ff744108160 2024-09-19T06:06:09.000 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.166+0000 7ff73bfff640 1 -- 172.21.15.2:0/905249105 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff740030740 con 0x7ff744108160 2024-09-19T06:06:09.000 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.167+0000 7ff74b7ac640 1 -- 172.21.15.2:0/905249105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff744108160 msgr2=0x7ff74410a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:09.000 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.167+0000 7ff74b7ac640 1 --2- 172.21.15.2:0/905249105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff744108160 0x7ff74410a550 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff740009820 tx=0x7ff74002a270 comp rx=0 tx=0).stop 2024-09-19T06:06:09.000 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.167+0000 7ff74b7ac640 1 -- 172.21.15.2:0/905249105 shutdown_connections 2024-09-19T06:06:09.000 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.167+0000 7ff74b7ac640 1 --2- 172.21.15.2:0/905249105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff744108160 0x7ff74410a550 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:09.000 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.167+0000 7ff74b7ac640 1 -- 172.21.15.2:0/905249105 >> 172.21.15.2:0/905249105 conn(0x7ff744101d40 msgr2=0x7ff7441041c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:09.000 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.167+0000 7ff74b7ac640 1 -- 172.21.15.2:0/905249105 shutdown_connections 2024-09-19T06:06:09.001 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.167+0000 7ff74b7ac640 1 -- 172.21.15.2:0/905249105 wait complete. 2024-09-19T06:06:09.001 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.167+0000 7ff74b7ac640 1 Processor -- start 2024-09-19T06:06:09.001 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.167+0000 7ff74b7ac640 1 -- start start 2024-09-19T06:06:09.001 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.168+0000 7ff74b7ac640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff744108160 0x7ff74419b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:09.001 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.168+0000 7ff74b7ac640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff74410bb10 con 0x7ff744108160 2024-09-19T06:06:09.001 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.168+0000 7ff749548640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff744108160 0x7ff74419b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:09.001 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.168+0000 7ff749548640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff744108160 0x7ff74419b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44974/0 (socket says 172.21.15.2:44974) 2024-09-19T06:06:09.001 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.168+0000 7ff749548640 1 -- 172.21.15.2:0/379787887 learned_addr learned my addr 172.21.15.2:0/379787887 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:06:09.001 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.168+0000 7ff749548640 1 -- 172.21.15.2:0/379787887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff74419bbf0 con 0x7ff744108160 2024-09-19T06:06:09.002 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.168+0000 7ff749548640 1 --2- 172.21.15.2:0/379787887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff744108160 0x7ff74419b6b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff7400097f0 tx=0x7ff740030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:09.002 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.168+0000 7ff73a7fc640 1 -- 172.21.15.2:0/379787887 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff740042070 con 0x7ff744108160 2024-09-19T06:06:09.002 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.168+0000 7ff73a7fc640 1 -- 172.21.15.2:0/379787887 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff740030e80 con 0x7ff744108160 2024-09-19T06:06:09.002 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.168+0000 7ff74b7ac640 1 -- 172.21.15.2:0/379787887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff74419be80 con 0x7ff744108160 2024-09-19T06:06:09.002 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.168+0000 7ff73a7fc640 1 -- 172.21.15.2:0/379787887 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff740037040 con 0x7ff744108160 2024-09-19T06:06:09.002 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.168+0000 7ff74b7ac640 1 -- 172.21.15.2:0/379787887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff74419eb70 con 0x7ff744108160 2024-09-19T06:06:09.002 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.169+0000 7ff73a7fc640 1 -- 172.21.15.2:0/379787887 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7ff740045070 con 0x7ff744108160 2024-09-19T06:06:09.002 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.170+0000 7ff73a7fc640 1 --2- 172.21.15.2:0/379787887 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7ff730039200 0x7ff73003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:09.002 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.170+0000 7ff74b7ac640 1 -- 172.21.15.2:0/379787887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7441085c0 con 0x7ff744108160 2024-09-19T06:06:09.003 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.170+0000 7ff748d47640 1 -- 172.21.15.2:0/379787887 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7ff730039200 msgr2=0x7ff73003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/1200011821 2024-09-19T06:06:09.003 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.170+0000 7ff73a7fc640 1 -- 172.21.15.2:0/379787887 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff74006c4e0 con 0x7ff744108160 2024-09-19T06:06:09.003 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.170+0000 7ff748d47640 1 --2- 172.21.15.2:0/379787887 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7ff730039200 0x7ff73003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:06:09.003 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.174+0000 7ff73a7fc640 1 -- 172.21.15.2:0/379787887 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff74006be70 con 0x7ff744108160 2024-09-19T06:06:09.003 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.371+0000 7ff748d47640 1 -- 172.21.15.2:0/379787887 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7ff730039200 msgr2=0x7ff73003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/1200011821 2024-09-19T06:06:09.003 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.371+0000 7ff748d47640 1 --2- 172.21.15.2:0/379787887 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7ff730039200 0x7ff73003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T06:06:09.003 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.399+0000 7ff74b7ac640 1 -- 172.21.15.2:0/379787887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7ff74419f130 con 0x7ff744108160 2024-09-19T06:06:09.003 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.400+0000 7ff73a7fc640 1 -- 172.21.15.2:0/379787887 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7ff740045520 con 0x7ff744108160 2024-09-19T06:06:09.003 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.402+0000 7ff74b7ac640 1 -- 172.21.15.2:0/379787887 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7ff730039200 msgr2=0x7ff73003b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:06:09.003 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.402+0000 7ff74b7ac640 1 --2- 172.21.15.2:0/379787887 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7ff730039200 0x7ff73003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:09.003 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.402+0000 7ff74b7ac640 1 -- 172.21.15.2:0/379787887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff744108160 msgr2=0x7ff74419b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:09.003 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.402+0000 7ff74b7ac640 1 --2- 172.21.15.2:0/379787887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff744108160 0x7ff74419b6b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff7400097f0 tx=0x7ff740030c70 comp rx=0 tx=0).stop 2024-09-19T06:06:09.004 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.402+0000 7ff74b7ac640 1 -- 172.21.15.2:0/379787887 shutdown_connections 2024-09-19T06:06:09.004 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.402+0000 7ff74b7ac640 1 --2- 172.21.15.2:0/379787887 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7ff730039200 0x7ff73003b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:09.004 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.402+0000 7ff74b7ac640 1 --2- 172.21.15.2:0/379787887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff744108160 0x7ff74419b6b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:09.004 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.402+0000 7ff74b7ac640 1 -- 172.21.15.2:0/379787887 >> 172.21.15.2:0/379787887 conn(0x7ff744101d40 msgr2=0x7ff744102940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:09.004 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.402+0000 7ff74b7ac640 1 -- 172.21.15.2:0/379787887 shutdown_connections 2024-09-19T06:06:09.004 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:08.402+0000 7ff74b7ac640 1 -- 172.21.15.2:0/379787887 wait complete. 2024-09-19T06:06:09.004 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for the mgr to restart... 2024-09-19T06:06:09.004 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr epoch 9... 2024-09-19T06:06:09.341 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:09 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:06:09.099+0000 7f81b68e5040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T06:06:09.341 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:09 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:06:09.171+0000 7f81b68e5040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T06:06:09.972 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:09 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:06:09.923+0000 7f81b68e5040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T06:06:10.363 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:10 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:06:10.044+0000 7f81b68e5040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T06:06:10.363 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:10 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:06:10.193+0000 7f81b68e5040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:06:10.363 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:10 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:06:10.257+0000 7f81b68e5040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T06:06:10.624 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:10 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:06:10.415+0000 7f81b68e5040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T06:06:10.624 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:10 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:06:10.487+0000 7f81b68e5040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T06:06:10.625 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:10 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:06:10.550+0000 7f81b68e5040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T06:06:10.909 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:10 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:06:10.720+0000 7f81b68e5040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T06:06:10.909 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:10 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:06:10.790+0000 7f81b68e5040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T06:06:10.909 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:10 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:06:10.863+0000 7f81b68e5040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T06:06:11.222 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:10 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:06:10.951+0000 7f81b68e5040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T06:06:11.222 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:11 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:06:11.014+0000 7f81b68e5040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T06:06:11.222 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:11 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:06:11.078+0000 7f81b68e5040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T06:06:12.165 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:11 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:06:11.910+0000 7f81b68e5040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T06:06:12.165 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:11 smithi002 ceph-mon[30982]: Active manager daemon x restarted 2024-09-19T06:06:12.165 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:11 smithi002 ceph-mon[30982]: Activating manager daemon x 2024-09-19T06:06:12.165 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:11 smithi002 ceph-mon[30982]: osdmap e3: 0 total, 0 up, 0 in 2024-09-19T06:06:12.166 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:11 smithi002 ceph-mon[30982]: mgrmap e10: x(active, starting, since 0.00326354s) 2024-09-19T06:06:12.166 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:11 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:06:12.166 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:11 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T06:06:12.166 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:11 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T06:06:12.166 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:11 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T06:06:12.166 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:11 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T06:06:12.166 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:11 smithi002 ceph-mon[30982]: Manager daemon x is now available 2024-09-19T06:06:12.166 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:11 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:06:12.166 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:11 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T06:06:12.166 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:11 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T06:06:13.574 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-19T06:06:13.581 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-19T06:06:13.581 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T06:06:13.581 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-19T06:06:13.581 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:09.498+0000 7f3094055640 1 Processor -- start 2024-09-19T06:06:13.581 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:09.498+0000 7f3094055640 1 -- start start 2024-09-19T06:06:13.581 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:09.498+0000 7f3094055640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f308c105f50 0x7f308c106350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:13.581 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:09.498+0000 7f3094055640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f308c07be40 con 0x7f308c105f50 2024-09-19T06:06:13.581 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:09.498+0000 7f3091df1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f308c105f50 0x7f308c106350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:13.582 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:09.498+0000 7f3091df1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f308c105f50 0x7f308c106350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44982/0 (socket says 172.21.15.2:44982) 2024-09-19T06:06:13.582 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:09.498+0000 7f3091df1640 1 -- 172.21.15.2:0/3834113017 learned_addr learned my addr 172.21.15.2:0/3834113017 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:06:13.582 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:09.499+0000 7f3091df1640 1 -- 172.21.15.2:0/3834113017 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f308c106890 con 0x7f308c105f50 2024-09-19T06:06:13.582 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:09.499+0000 7f3091df1640 1 --2- 172.21.15.2:0/3834113017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f308c105f50 0x7f308c106350 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3088009820 tx=0x7f308802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dcb4bb9a48471fb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:13.582 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:09.500+0000 7f3090def640 1 -- 172.21.15.2:0/3834113017 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3088037070 con 0x7f308c105f50 2024-09-19T06:06:13.582 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:09.500+0000 7f3090def640 1 -- 172.21.15.2:0/3834113017 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f30880328f0 con 0x7f308c105f50 2024-09-19T06:06:13.582 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:09.500+0000 7f3090def640 1 -- 172.21.15.2:0/3834113017 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3088030740 con 0x7f308c105f50 2024-09-19T06:06:13.582 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:09.500+0000 7f3094055640 1 -- 172.21.15.2:0/3834113017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f308c105f50 msgr2=0x7f308c106350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:13.582 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:09.500+0000 7f3094055640 1 --2- 172.21.15.2:0/3834113017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f308c105f50 0x7f308c106350 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3088009820 tx=0x7f308802a270 comp rx=0 tx=0).stop 2024-09-19T06:06:13.582 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:09.500+0000 7f3094055640 1 -- 172.21.15.2:0/3834113017 shutdown_connections 2024-09-19T06:06:13.582 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:09.500+0000 7f3094055640 1 --2- 172.21.15.2:0/3834113017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f308c105f50 0x7f308c106350 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:13.582 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:09.500+0000 7f3094055640 1 -- 172.21.15.2:0/3834113017 >> 172.21.15.2:0/3834113017 conn(0x7f308c101d40 msgr2=0x7f308c1041c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:13.583 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:09.501+0000 7f3094055640 1 -- 172.21.15.2:0/3834113017 shutdown_connections 2024-09-19T06:06:13.583 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:09.501+0000 7f3094055640 1 -- 172.21.15.2:0/3834113017 wait complete. 2024-09-19T06:06:13.583 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:09.501+0000 7f3094055640 1 Processor -- start 2024-09-19T06:06:13.583 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:09.501+0000 7f3094055640 1 -- start start 2024-09-19T06:06:13.583 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:09.501+0000 7f3094055640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f308c105f50 0x7f308c19d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:13.583 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:09.501+0000 7f3094055640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f308c107970 con 0x7f308c105f50 2024-09-19T06:06:13.583 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:09.501+0000 7f3091df1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f308c105f50 0x7f308c19d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:13.583 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:09.501+0000 7f3091df1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f308c105f50 0x7f308c19d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44986/0 (socket says 172.21.15.2:44986) 2024-09-19T06:06:13.584 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:09.502+0000 7f3091df1640 1 -- 172.21.15.2:0/447484229 learned_addr learned my addr 172.21.15.2:0/447484229 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:06:13.584 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:09.502+0000 7f3091df1640 1 -- 172.21.15.2:0/447484229 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f308c19ddf0 con 0x7f308c105f50 2024-09-19T06:06:13.584 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:09.502+0000 7f3091df1640 1 --2- 172.21.15.2:0/447484229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f308c105f50 0x7f308c19d8b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f30880097f0 tx=0x7f3088030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:13.584 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:09.502+0000 7f3082ffd640 1 -- 172.21.15.2:0/447484229 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3088042070 con 0x7f308c105f50 2024-09-19T06:06:13.584 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:09.502+0000 7f3082ffd640 1 -- 172.21.15.2:0/447484229 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3088030e80 con 0x7f308c105f50 2024-09-19T06:06:13.584 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:09.502+0000 7f3094055640 1 -- 172.21.15.2:0/447484229 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f308c19e080 con 0x7f308c105f50 2024-09-19T06:06:13.584 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:09.502+0000 7f3082ffd640 1 -- 172.21.15.2:0/447484229 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3088037040 con 0x7f308c105f50 2024-09-19T06:06:13.584 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:09.502+0000 7f3094055640 1 -- 172.21.15.2:0/447484229 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f308c1a0d70 con 0x7f308c105f50 2024-09-19T06:06:13.584 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:09.503+0000 7f3082ffd640 1 -- 172.21.15.2:0/447484229 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f3088045070 con 0x7f308c105f50 2024-09-19T06:06:13.584 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:09.503+0000 7f3082ffd640 1 --2- 172.21.15.2:0/447484229 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f3078039260 0x7f307803b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:13.584 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:09.503+0000 7f3082ffd640 1 -- 172.21.15.2:0/447484229 --> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f307803be30 con 0x7f3078039260 2024-09-19T06:06:13.584 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:09.503+0000 7f3082ffd640 1 -- 172.21.15.2:0/447484229 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f308806c360 con 0x7f308c105f50 2024-09-19T06:06:13.585 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:09.503+0000 7f30915f0640 1 -- 172.21.15.2:0/447484229 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f3078039260 msgr2=0x7f307803b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/1200011821 2024-09-19T06:06:13.585 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:09.504+0000 7f30915f0640 1 --2- 172.21.15.2:0/447484229 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f3078039260 0x7f307803b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:06:13.585 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:09.705+0000 7f30915f0640 1 -- 172.21.15.2:0/447484229 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f3078039260 msgr2=0x7f307803b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/1200011821 2024-09-19T06:06:13.585 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:09.705+0000 7f30915f0640 1 --2- 172.21.15.2:0/447484229 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f3078039260 0x7f307803b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T06:06:13.585 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:10.106+0000 7f30915f0640 1 -- 172.21.15.2:0/447484229 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f3078039260 msgr2=0x7f307803b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/1200011821 2024-09-19T06:06:13.585 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:10.106+0000 7f30915f0640 1 --2- 172.21.15.2:0/447484229 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f3078039260 0x7f307803b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T06:06:13.585 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:10.907+0000 7f30915f0640 1 -- 172.21.15.2:0/447484229 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f3078039260 msgr2=0x7f307803b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/1200011821 2024-09-19T06:06:13.585 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:10.907+0000 7f30915f0640 1 --2- 172.21.15.2:0/447484229 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f3078039260 0x7f307803b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T06:06:13.585 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:11.913+0000 7f3082ffd640 1 -- 172.21.15.2:0/447484229 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mgrmap(e 10) ==== 46241+0+0 (secure 0 0 0) 0x7f308803db70 con 0x7f308c105f50 2024-09-19T06:06:13.585 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:11.914+0000 7f3082ffd640 1 -- 172.21.15.2:0/447484229 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f3078039260 msgr2=0x7f307803b720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:06:13.585 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:11.914+0000 7f3082ffd640 1 --2- 172.21.15.2:0/447484229 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f3078039260 0x7f307803b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:13.585 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:12.915+0000 7f3082ffd640 1 -- 172.21.15.2:0/447484229 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7f308802fd40 con 0x7f308c105f50 2024-09-19T06:06:13.585 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:12.915+0000 7f3082ffd640 1 --2- 172.21.15.2:0/447484229 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f307803cd20 0x7f307803f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:13.586 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:12.915+0000 7f3082ffd640 1 -- 172.21.15.2:0/447484229 --> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3088041ec0 con 0x7f307803cd20 2024-09-19T06:06:13.586 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:12.916+0000 7f30915f0640 1 --2- 172.21.15.2:0/447484229 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f307803cd20 0x7f307803f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:13.586 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:12.917+0000 7f30915f0640 1 --2- 172.21.15.2:0/447484229 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f307803cd20 0x7f307803f110 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f307c003980 tx=0x7f307c0092b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:13.586 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:12.917+0000 7f3082ffd640 1 -- 172.21.15.2:0/447484229 <== mgr.14150 v2:172.21.15.2:6800/4180340554 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f3088041ec0 con 0x7f307803cd20 2024-09-19T06:06:13.586 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:12.932+0000 7f3094055640 1 -- 172.21.15.2:0/447484229 --> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f308c106350 con 0x7f307803cd20 2024-09-19T06:06:13.586 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:12.932+0000 7f3082ffd640 1 -- 172.21.15.2:0/447484229 <== mgr.14150 v2:172.21.15.2:6800/4180340554 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f308c106350 con 0x7f307803cd20 2024-09-19T06:06:13.586 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:12.932+0000 7f3094055640 1 -- 172.21.15.2:0/447484229 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f307803cd20 msgr2=0x7f307803f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:13.586 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:12.932+0000 7f3094055640 1 --2- 172.21.15.2:0/447484229 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f307803cd20 0x7f307803f110 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f307c003980 tx=0x7f307c0092b0 comp rx=0 tx=0).stop 2024-09-19T06:06:13.586 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:12.932+0000 7f3094055640 1 -- 172.21.15.2:0/447484229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f308c105f50 msgr2=0x7f308c19d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:13.586 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:12.932+0000 7f3094055640 1 --2- 172.21.15.2:0/447484229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f308c105f50 0x7f308c19d8b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f30880097f0 tx=0x7f3088030c70 comp rx=0 tx=0).stop 2024-09-19T06:06:13.586 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:12.932+0000 7f3094055640 1 -- 172.21.15.2:0/447484229 shutdown_connections 2024-09-19T06:06:13.586 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:12.932+0000 7f3094055640 1 --2- 172.21.15.2:0/447484229 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f307803cd20 0x7f307803f110 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:13.586 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:12.932+0000 7f3094055640 1 --2- 172.21.15.2:0/447484229 >> [v2:172.21.15.2:6800/1200011821,v1:172.21.15.2:6801/1200011821] conn(0x7f3078039260 0x7f307803b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:13.587 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:12.932+0000 7f3094055640 1 --2- 172.21.15.2:0/447484229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f308c105f50 0x7f308c19d8b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:13.587 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:12.933+0000 7f3094055640 1 -- 172.21.15.2:0/447484229 >> 172.21.15.2:0/447484229 conn(0x7f308c101d40 msgr2=0x7f308c191bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:13.587 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:12.933+0000 7f3094055640 1 -- 172.21.15.2:0/447484229 shutdown_connections 2024-09-19T06:06:13.587 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:12.933+0000 7f3094055640 1 -- 172.21.15.2:0/447484229 wait complete. 2024-09-19T06:06:13.587 INFO:teuthology.orchestra.run.smithi002.stdout:mgr epoch 9 is available 2024-09-19T06:06:13.587 INFO:teuthology.orchestra.run.smithi002.stdout:Generating a dashboard self-signed certificate... 2024-09-19T06:06:14.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:13 smithi002 ceph-mon[30982]: mgrmap e11: x(active, since 1.00614s) 2024-09-19T06:06:14.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:13 smithi002 ceph-mon[30982]: [19/Sep/2024:06:06:13] ENGINE Bus STARTING 2024-09-19T06:06:14.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:13 smithi002 ceph-mon[30982]: [19/Sep/2024:06:06:13] ENGINE Serving on https://172.21.15.2:7150 2024-09-19T06:06:14.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:13 smithi002 ceph-mon[30982]: [19/Sep/2024:06:06:13] ENGINE Error in HTTPServer.serve 2024-09-19T06:06:14.223 INFO:journalctl@ceph.mon.a.smithi002.stdout: Traceback (most recent call last): 2024-09-19T06:06:14.223 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:06:14.223 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._connections.run(self.expiration_interval) 2024-09-19T06:06:14.223 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:06:14.223 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._run(expiration_interval) 2024-09-19T06:06:14.223 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:06:14.223 INFO:journalctl@ceph.mon.a.smithi002.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:06:14.223 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:06:14.223 INFO:journalctl@ceph.mon.a.smithi002.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:06:14.223 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:06:14.223 INFO:journalctl@ceph.mon.a.smithi002.stdout: s = self.context.wrap_socket( 2024-09-19T06:06:14.223 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:06:14.223 INFO:journalctl@ceph.mon.a.smithi002.stdout: return self.sslsocket_class._create( 2024-09-19T06:06:14.224 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:06:14.224 INFO:journalctl@ceph.mon.a.smithi002.stdout: self.do_handshake() 2024-09-19T06:06:14.224 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:06:14.224 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._sslobj.do_handshake() 2024-09-19T06:06:14.224 INFO:journalctl@ceph.mon.a.smithi002.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:06:14.224 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:13 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:06:13.835+0000 7f8121bf9640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:06:06:13] ENGINE Error in HTTPServer.serve 2024-09-19T06:06:14.224 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:13 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: Traceback (most recent call last): 2024-09-19T06:06:14.224 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:13 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:06:14.224 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:13 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: self._connections.run(self.expiration_interval) 2024-09-19T06:06:14.224 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:13 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:06:14.225 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:13 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: self._run(expiration_interval) 2024-09-19T06:06:14.225 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:13 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:06:14.225 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:13 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:06:14.225 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:13 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:06:14.225 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:13 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:06:14.225 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:13 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:06:14.225 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:13 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: s = self.context.wrap_socket( 2024-09-19T06:06:14.225 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:13 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:06:14.225 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:13 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: return self.sslsocket_class._create( 2024-09-19T06:06:14.225 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:13 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:06:14.225 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:13 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: self.do_handshake() 2024-09-19T06:06:14.225 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:13 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:06:14.225 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:13 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: self._sslobj.do_handshake() 2024-09-19T06:06:14.226 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:13 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:06:14.226 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:06:13 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:06:15.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:14 smithi002 ceph-mon[30982]: mgrmap e12: x(active, since 2s) 2024-09-19T06:06:15.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:14 smithi002 ceph-mon[30982]: [19/Sep/2024:06:06:13] ENGINE Serving on http://172.21.15.2:8765 2024-09-19T06:06:15.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:14 smithi002 ceph-mon[30982]: [19/Sep/2024:06:06:13] ENGINE Bus STARTED 2024-09-19T06:06:15.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:14 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:15.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:14 smithi002 ceph-mon[30982]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:06:15.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:14 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:15.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:14 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:15.401 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-19T06:06:15.402 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.339+0000 7fd4b3f77640 1 Processor -- start 2024-09-19T06:06:15.402 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.340+0000 7fd4b3f77640 1 -- start start 2024-09-19T06:06:15.402 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.340+0000 7fd4b3f77640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4ac105fc0 0x7fd4ac1063c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:15.402 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.340+0000 7fd4b3f77640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ac07bd90 con 0x7fd4ac105fc0 2024-09-19T06:06:15.402 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.340+0000 7fd4b1d13640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4ac105fc0 0x7fd4ac1063c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:15.402 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.340+0000 7fd4b1d13640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4ac105fc0 0x7fd4ac1063c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45052/0 (socket says 172.21.15.2:45052) 2024-09-19T06:06:15.402 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.340+0000 7fd4b1d13640 1 -- 172.21.15.2:0/1105175960 learned_addr learned my addr 172.21.15.2:0/1105175960 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:06:15.402 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.340+0000 7fd4b1d13640 1 -- 172.21.15.2:0/1105175960 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4ac106900 con 0x7fd4ac105fc0 2024-09-19T06:06:15.402 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.341+0000 7fd4b1d13640 1 --2- 172.21.15.2:0/1105175960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4ac105fc0 0x7fd4ac1063c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8009820 tx=0x7fd4a802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8778626dc35349f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:15.407 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.341+0000 7fd4b0d11640 1 -- 172.21.15.2:0/1105175960 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4a8037070 con 0x7fd4ac105fc0 2024-09-19T06:06:15.407 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.341+0000 7fd4b0d11640 1 -- 172.21.15.2:0/1105175960 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd4a80328f0 con 0x7fd4ac105fc0 2024-09-19T06:06:15.407 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.341+0000 7fd4b0d11640 1 -- 172.21.15.2:0/1105175960 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4a8030740 con 0x7fd4ac105fc0 2024-09-19T06:06:15.407 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.342+0000 7fd4b3f77640 1 -- 172.21.15.2:0/1105175960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4ac105fc0 msgr2=0x7fd4ac1063c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:15.407 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.342+0000 7fd4b3f77640 1 --2- 172.21.15.2:0/1105175960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4ac105fc0 0x7fd4ac1063c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8009820 tx=0x7fd4a802a270 comp rx=0 tx=0).stop 2024-09-19T06:06:15.407 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.342+0000 7fd4b3f77640 1 -- 172.21.15.2:0/1105175960 shutdown_connections 2024-09-19T06:06:15.407 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.342+0000 7fd4b3f77640 1 --2- 172.21.15.2:0/1105175960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4ac105fc0 0x7fd4ac1063c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:15.407 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.342+0000 7fd4b3f77640 1 -- 172.21.15.2:0/1105175960 >> 172.21.15.2:0/1105175960 conn(0x7fd4ac101d90 msgr2=0x7fd4ac1041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:15.407 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.342+0000 7fd4b3f77640 1 -- 172.21.15.2:0/1105175960 shutdown_connections 2024-09-19T06:06:15.407 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.342+0000 7fd4b3f77640 1 -- 172.21.15.2:0/1105175960 wait complete. 2024-09-19T06:06:15.408 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.343+0000 7fd4b3f77640 1 Processor -- start 2024-09-19T06:06:15.408 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.343+0000 7fd4b3f77640 1 -- start start 2024-09-19T06:06:15.408 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.343+0000 7fd4b3f77640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4ac105fc0 0x7fd4ac19d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:15.408 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.343+0000 7fd4b3f77640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ac1079e0 con 0x7fd4ac105fc0 2024-09-19T06:06:15.408 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.344+0000 7fd4b1d13640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4ac105fc0 0x7fd4ac19d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:15.408 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.344+0000 7fd4b1d13640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4ac105fc0 0x7fd4ac19d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45054/0 (socket says 172.21.15.2:45054) 2024-09-19T06:06:15.408 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.344+0000 7fd4b1d13640 1 -- 172.21.15.2:0/2252211922 learned_addr learned my addr 172.21.15.2:0/2252211922 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:06:15.408 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.344+0000 7fd4b1d13640 1 -- 172.21.15.2:0/2252211922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4ac19dda0 con 0x7fd4ac105fc0 2024-09-19T06:06:15.408 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.344+0000 7fd4b1d13640 1 --2- 172.21.15.2:0/2252211922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4ac105fc0 0x7fd4ac19d860 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8030cc0 tx=0x7fd4a8030cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:15.408 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.344+0000 7fd4a2ffd640 1 -- 172.21.15.2:0/2252211922 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4a8042070 con 0x7fd4ac105fc0 2024-09-19T06:06:15.408 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.344+0000 7fd4a2ffd640 1 -- 172.21.15.2:0/2252211922 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd4a8030e60 con 0x7fd4ac105fc0 2024-09-19T06:06:15.409 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.344+0000 7fd4b3f77640 1 -- 172.21.15.2:0/2252211922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4ac19e030 con 0x7fd4ac105fc0 2024-09-19T06:06:15.409 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.344+0000 7fd4b3f77640 1 -- 172.21.15.2:0/2252211922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4ac1a0d20 con 0x7fd4ac105fc0 2024-09-19T06:06:15.409 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.344+0000 7fd4a2ffd640 1 -- 172.21.15.2:0/2252211922 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4a8037040 con 0x7fd4ac105fc0 2024-09-19T06:06:15.409 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.346+0000 7fd4a2ffd640 1 -- 172.21.15.2:0/2252211922 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7fd4a8045070 con 0x7fd4ac105fc0 2024-09-19T06:06:15.409 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.345+0000 7fd4b3f77640 1 -- 172.21.15.2:0/2252211922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4900052c0 con 0x7fd4ac105fc0 2024-09-19T06:06:15.409 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.346+0000 7fd4a2ffd640 1 --2- 172.21.15.2:0/2252211922 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fd498039260 0x7fd49803b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:15.409 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.346+0000 7fd4a2ffd640 1 -- 172.21.15.2:0/2252211922 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd4a802ed90 con 0x7fd4ac105fc0 2024-09-19T06:06:15.409 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.346+0000 7fd4b1512640 1 --2- 172.21.15.2:0/2252211922 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fd498039260 0x7fd49803b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:15.409 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.347+0000 7fd4b1512640 1 --2- 172.21.15.2:0/2252211922 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fd498039260 0x7fd49803b720 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd49c0098c0 tx=0x7fd49c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:15.409 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.351+0000 7fd4a2ffd640 1 -- 172.21.15.2:0/2252211922 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd4a803bd50 con 0x7fd4ac105fc0 2024-09-19T06:06:15.409 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.593+0000 7fd4b3f77640 1 -- 172.21.15.2:0/2252211922 --> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7fd490000bf0 con 0x7fd498039260 2024-09-19T06:06:15.409 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.672+0000 7fd4a2ffd640 1 -- 172.21.15.2:0/2252211922 <== mgr.14150 v2:172.21.15.2:6800/4180340554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fd490000bf0 con 0x7fd498039260 2024-09-19T06:06:15.409 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.675+0000 7fd4b3f77640 1 -- 172.21.15.2:0/2252211922 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fd498039260 msgr2=0x7fd49803b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:15.410 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.675+0000 7fd4b3f77640 1 --2- 172.21.15.2:0/2252211922 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fd498039260 0x7fd49803b720 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd49c0098c0 tx=0x7fd49c006db0 comp rx=0 tx=0).stop 2024-09-19T06:06:15.410 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.675+0000 7fd4b3f77640 1 -- 172.21.15.2:0/2252211922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4ac105fc0 msgr2=0x7fd4ac19d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:15.410 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.675+0000 7fd4b3f77640 1 --2- 172.21.15.2:0/2252211922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4ac105fc0 0x7fd4ac19d860 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8030cc0 tx=0x7fd4a8030cf0 comp rx=0 tx=0).stop 2024-09-19T06:06:15.410 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.675+0000 7fd4b3f77640 1 -- 172.21.15.2:0/2252211922 shutdown_connections 2024-09-19T06:06:15.410 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.675+0000 7fd4b3f77640 1 --2- 172.21.15.2:0/2252211922 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fd498039260 0x7fd49803b720 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:15.410 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.675+0000 7fd4b3f77640 1 --2- 172.21.15.2:0/2252211922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4ac105fc0 0x7fd4ac19d860 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:15.410 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.675+0000 7fd4b3f77640 1 -- 172.21.15.2:0/2252211922 >> 172.21.15.2:0/2252211922 conn(0x7fd4ac101d90 msgr2=0x7fd4ac194520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:15.410 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.675+0000 7fd4b3f77640 1 -- 172.21.15.2:0/2252211922 shutdown_connections 2024-09-19T06:06:15.410 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:14.675+0000 7fd4b3f77640 1 -- 172.21.15.2:0/2252211922 wait complete. 2024-09-19T06:06:15.410 INFO:teuthology.orchestra.run.smithi002.stdout:Creating initial admin user... 2024-09-19T06:06:16.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:16 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:16.986 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$1ALcahPI/ug2iyuJA9vwxubs2fG4pRU7WED2bVww8eY8bLvwsKBKy", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726725976, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-19T06:06:16.987 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:15.783+0000 7ff060a33640 1 Processor -- start 2024-09-19T06:06:16.987 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:15.783+0000 7ff060a33640 1 -- start start 2024-09-19T06:06:16.987 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:15.783+0000 7ff060a33640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff05c1065f0 0x7ff05c1069f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:16.987 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:15.783+0000 7ff060a33640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff05c106fc0 con 0x7ff05c1065f0 2024-09-19T06:06:16.987 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:15.783+0000 7ff05a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff05c1065f0 0x7ff05c1069f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:16.987 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:15.783+0000 7ff05a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff05c1065f0 0x7ff05c1069f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49680/0 (socket says 172.21.15.2:49680) 2024-09-19T06:06:16.987 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:15.783+0000 7ff05a59c640 1 -- 172.21.15.2:0/428795760 learned_addr learned my addr 172.21.15.2:0/428795760 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:06:16.987 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:15.784+0000 7ff05a59c640 1 -- 172.21.15.2:0/428795760 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff05c1077f0 con 0x7ff05c1065f0 2024-09-19T06:06:16.987 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:15.784+0000 7ff05a59c640 1 --2- 172.21.15.2:0/428795760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff05c1065f0 0x7ff05c1069f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff04c009820 tx=0x7ff04c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db506151870c4782 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:16.987 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:15.785+0000 7ff059d9b640 1 -- 172.21.15.2:0/428795760 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff04c037070 con 0x7ff05c1065f0 2024-09-19T06:06:16.987 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:15.785+0000 7ff059d9b640 1 -- 172.21.15.2:0/428795760 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff04c0328f0 con 0x7ff05c1065f0 2024-09-19T06:06:16.988 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:15.785+0000 7ff059d9b640 1 -- 172.21.15.2:0/428795760 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff04c030740 con 0x7ff05c1065f0 2024-09-19T06:06:16.988 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:15.785+0000 7ff060a33640 1 -- 172.21.15.2:0/428795760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff05c1065f0 msgr2=0x7ff05c1069f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:16.988 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:15.785+0000 7ff060a33640 1 --2- 172.21.15.2:0/428795760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff05c1065f0 0x7ff05c1069f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff04c009820 tx=0x7ff04c02a270 comp rx=0 tx=0).stop 2024-09-19T06:06:16.988 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:15.785+0000 7ff060a33640 1 -- 172.21.15.2:0/428795760 shutdown_connections 2024-09-19T06:06:16.988 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:15.785+0000 7ff060a33640 1 --2- 172.21.15.2:0/428795760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff05c1065f0 0x7ff05c1069f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:16.988 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:15.785+0000 7ff060a33640 1 -- 172.21.15.2:0/428795760 >> 172.21.15.2:0/428795760 conn(0x7ff05c101d40 msgr2=0x7ff05c1041c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:16.988 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:15.785+0000 7ff060a33640 1 -- 172.21.15.2:0/428795760 shutdown_connections 2024-09-19T06:06:16.988 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:15.785+0000 7ff060a33640 1 -- 172.21.15.2:0/428795760 wait complete. 2024-09-19T06:06:16.988 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:15.786+0000 7ff060a33640 1 Processor -- start 2024-09-19T06:06:16.988 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:15.786+0000 7ff060a33640 1 -- start start 2024-09-19T06:06:16.988 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:15.786+0000 7ff060a33640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff05c1065f0 0x7ff05c19b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:16.988 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:15.786+0000 7ff060a33640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff05c10aba0 con 0x7ff05c1065f0 2024-09-19T06:06:16.989 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:15.786+0000 7ff05a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff05c1065f0 0x7ff05c19b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:16.989 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:15.786+0000 7ff05a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff05c1065f0 0x7ff05c19b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49686/0 (socket says 172.21.15.2:49686) 2024-09-19T06:06:16.989 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:15.786+0000 7ff05a59c640 1 -- 172.21.15.2:0/1792313315 learned_addr learned my addr 172.21.15.2:0/1792313315 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:06:16.989 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:15.787+0000 7ff05a59c640 1 -- 172.21.15.2:0/1792313315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff05c19bcb0 con 0x7ff05c1065f0 2024-09-19T06:06:16.989 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:15.787+0000 7ff05a59c640 1 --2- 172.21.15.2:0/1792313315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff05c1065f0 0x7ff05c19b770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff04c009940 tx=0x7ff04c0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:16.989 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:15.787+0000 7ff0537fe640 1 -- 172.21.15.2:0/1792313315 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff04c042070 con 0x7ff05c1065f0 2024-09-19T06:06:16.989 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:15.787+0000 7ff0537fe640 1 -- 172.21.15.2:0/1792313315 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff04c030d00 con 0x7ff05c1065f0 2024-09-19T06:06:16.989 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:15.787+0000 7ff060a33640 1 -- 172.21.15.2:0/1792313315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff05c19bf40 con 0x7ff05c1065f0 2024-09-19T06:06:16.989 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:15.787+0000 7ff0537fe640 1 -- 172.21.15.2:0/1792313315 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff04c037040 con 0x7ff05c1065f0 2024-09-19T06:06:16.989 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:15.787+0000 7ff060a33640 1 -- 172.21.15.2:0/1792313315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff05c19ec30 con 0x7ff05c1065f0 2024-09-19T06:06:16.989 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:15.788+0000 7ff0537fe640 1 -- 172.21.15.2:0/1792313315 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7ff04c045070 con 0x7ff05c1065f0 2024-09-19T06:06:16.989 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:15.788+0000 7ff0537fe640 1 --2- 172.21.15.2:0/1792313315 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7ff048039260 0x7ff04803b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:16.989 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:15.788+0000 7ff0537fe640 1 -- 172.21.15.2:0/1792313315 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff04c06c710 con 0x7ff05c1065f0 2024-09-19T06:06:16.990 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:15.789+0000 7ff060a33640 1 -- 172.21.15.2:0/1792313315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff05c10ad20 con 0x7ff05c1065f0 2024-09-19T06:06:16.990 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:15.789+0000 7ff053fff640 1 --2- 172.21.15.2:0/1792313315 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7ff048039260 0x7ff04803b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:16.990 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:15.790+0000 7ff053fff640 1 --2- 172.21.15.2:0/1792313315 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7ff048039260 0x7ff04803b720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff0440098c0 tx=0x7ff044006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:16.990 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:15.794+0000 7ff0537fe640 1 -- 172.21.15.2:0/1792313315 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff04c045360 con 0x7ff05c1065f0 2024-09-19T06:06:16.990 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:16.005+0000 7ff060a33640 1 -- 172.21.15.2:0/1792313315 --> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7ff05c106a70 con 0x7ff048039260 2024-09-19T06:06:16.990 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:16.255+0000 7ff0537fe640 1 -- 172.21.15.2:0/1792313315 <== mgr.14150 v2:172.21.15.2:6800/4180340554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7ff05c106a70 con 0x7ff048039260 2024-09-19T06:06:16.990 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:16.258+0000 7ff060a33640 1 -- 172.21.15.2:0/1792313315 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7ff048039260 msgr2=0x7ff04803b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:16.990 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:16.258+0000 7ff060a33640 1 --2- 172.21.15.2:0/1792313315 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7ff048039260 0x7ff04803b720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff0440098c0 tx=0x7ff044006db0 comp rx=0 tx=0).stop 2024-09-19T06:06:16.990 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:16.258+0000 7ff060a33640 1 -- 172.21.15.2:0/1792313315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff05c1065f0 msgr2=0x7ff05c19b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:16.990 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:16.258+0000 7ff060a33640 1 --2- 172.21.15.2:0/1792313315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff05c1065f0 0x7ff05c19b770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff04c009940 tx=0x7ff04c0327b0 comp rx=0 tx=0).stop 2024-09-19T06:06:16.990 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:16.258+0000 7ff060a33640 1 -- 172.21.15.2:0/1792313315 shutdown_connections 2024-09-19T06:06:16.990 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:16.258+0000 7ff060a33640 1 --2- 172.21.15.2:0/1792313315 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7ff048039260 0x7ff04803b720 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:16.990 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:16.258+0000 7ff060a33640 1 --2- 172.21.15.2:0/1792313315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff05c1065f0 0x7ff05c19b770 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:16.991 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:16.258+0000 7ff060a33640 1 -- 172.21.15.2:0/1792313315 >> 172.21.15.2:0/1792313315 conn(0x7ff05c101d40 msgr2=0x7ff05c102cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:16.991 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:16.258+0000 7ff060a33640 1 -- 172.21.15.2:0/1792313315 shutdown_connections 2024-09-19T06:06:16.991 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:16.258+0000 7ff060a33640 1 -- 172.21.15.2:0/1792313315 wait complete. 2024-09-19T06:06:16.991 INFO:teuthology.orchestra.run.smithi002.stdout:Fetching dashboard port number... 2024-09-19T06:06:17.586 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:17 smithi002 ceph-mon[30982]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:06:17.587 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:17 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:18.467 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 8443 2024-09-19T06:06:18.467 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.398+0000 7f13c17d5640 1 Processor -- start 2024-09-19T06:06:18.467 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.398+0000 7f13c17d5640 1 -- start start 2024-09-19T06:06:18.467 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.398+0000 7f13c17d5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13bc1082d0 0x7f13bc10a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:18.468 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.398+0000 7f13c17d5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f13bc07bd60 con 0x7f13bc1082d0 2024-09-19T06:06:18.468 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.398+0000 7f13baffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13bc1082d0 0x7f13bc10a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:18.468 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.398+0000 7f13baffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13bc1082d0 0x7f13bc10a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49696/0 (socket says 172.21.15.2:49696) 2024-09-19T06:06:18.468 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.398+0000 7f13baffd640 1 -- 172.21.15.2:0/3991600642 learned_addr learned my addr 172.21.15.2:0/3991600642 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:06:18.468 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.399+0000 7f13baffd640 1 -- 172.21.15.2:0/3991600642 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13bc10ac00 con 0x7f13bc1082d0 2024-09-19T06:06:18.468 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.399+0000 7f13baffd640 1 --2- 172.21.15.2:0/3991600642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13bc1082d0 0x7f13bc10a6c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f13ac009820 tx=0x7f13ac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e7bcca469831f09 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:18.468 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.400+0000 7f13b9ffb640 1 -- 172.21.15.2:0/3991600642 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13ac037070 con 0x7f13bc1082d0 2024-09-19T06:06:18.468 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.400+0000 7f13b9ffb640 1 -- 172.21.15.2:0/3991600642 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f13ac0328f0 con 0x7f13bc1082d0 2024-09-19T06:06:18.468 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.400+0000 7f13b9ffb640 1 -- 172.21.15.2:0/3991600642 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13ac030740 con 0x7f13bc1082d0 2024-09-19T06:06:18.468 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.400+0000 7f13c17d5640 1 -- 172.21.15.2:0/3991600642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13bc1082d0 msgr2=0x7f13bc10a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:18.468 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.400+0000 7f13c17d5640 1 --2- 172.21.15.2:0/3991600642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13bc1082d0 0x7f13bc10a6c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f13ac009820 tx=0x7f13ac02a270 comp rx=0 tx=0).stop 2024-09-19T06:06:18.468 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.400+0000 7f13c17d5640 1 -- 172.21.15.2:0/3991600642 shutdown_connections 2024-09-19T06:06:18.468 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.400+0000 7f13c17d5640 1 --2- 172.21.15.2:0/3991600642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13bc1082d0 0x7f13bc10a6c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:18.469 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.400+0000 7f13c17d5640 1 -- 172.21.15.2:0/3991600642 >> 172.21.15.2:0/3991600642 conn(0x7f13bc101dd0 msgr2=0x7f13bc104250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:18.469 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.400+0000 7f13c17d5640 1 -- 172.21.15.2:0/3991600642 shutdown_connections 2024-09-19T06:06:18.469 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.400+0000 7f13c17d5640 1 -- 172.21.15.2:0/3991600642 wait complete. 2024-09-19T06:06:18.469 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.401+0000 7f13c17d5640 1 Processor -- start 2024-09-19T06:06:18.469 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.401+0000 7f13c17d5640 1 -- start start 2024-09-19T06:06:18.469 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.401+0000 7f13c17d5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13bc1082d0 0x7f13bc19b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:18.469 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.401+0000 7f13c17d5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f13bc10baf0 con 0x7f13bc1082d0 2024-09-19T06:06:18.469 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.401+0000 7f13baffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13bc1082d0 0x7f13bc19b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:18.469 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.401+0000 7f13baffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13bc1082d0 0x7f13bc19b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49710/0 (socket says 172.21.15.2:49710) 2024-09-19T06:06:18.469 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.401+0000 7f13baffd640 1 -- 172.21.15.2:0/177438693 learned_addr learned my addr 172.21.15.2:0/177438693 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:06:18.469 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.402+0000 7f13baffd640 1 -- 172.21.15.2:0/177438693 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13bc19bce0 con 0x7f13bc1082d0 2024-09-19T06:06:18.469 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.402+0000 7f13baffd640 1 --2- 172.21.15.2:0/177438693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13bc1082d0 0x7f13bc19b7a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f13ac0097f0 tx=0x7f13ac030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:18.469 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.402+0000 7f13a3fff640 1 -- 172.21.15.2:0/177438693 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13ac042070 con 0x7f13bc1082d0 2024-09-19T06:06:18.469 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.402+0000 7f13c17d5640 1 -- 172.21.15.2:0/177438693 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13bc19bf70 con 0x7f13bc1082d0 2024-09-19T06:06:18.470 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.402+0000 7f13a3fff640 1 -- 172.21.15.2:0/177438693 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f13ac030e80 con 0x7f13bc1082d0 2024-09-19T06:06:18.470 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.402+0000 7f13a3fff640 1 -- 172.21.15.2:0/177438693 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13ac037040 con 0x7f13bc1082d0 2024-09-19T06:06:18.470 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.402+0000 7f13c17d5640 1 -- 172.21.15.2:0/177438693 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13bc19ec60 con 0x7f13bc1082d0 2024-09-19T06:06:18.470 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.403+0000 7f13a3fff640 1 -- 172.21.15.2:0/177438693 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f13ac045070 con 0x7f13bc1082d0 2024-09-19T06:06:18.470 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.403+0000 7f13c17d5640 1 -- 172.21.15.2:0/177438693 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13bc108730 con 0x7f13bc1082d0 2024-09-19T06:06:18.470 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.403+0000 7f13a3fff640 1 --2- 172.21.15.2:0/177438693 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f13a4039260 0x7f13a403b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:18.470 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.403+0000 7f13a3fff640 1 -- 172.21.15.2:0/177438693 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f13ac06c580 con 0x7f13bc1082d0 2024-09-19T06:06:18.470 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.403+0000 7f13ba7fc640 1 --2- 172.21.15.2:0/177438693 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f13a4039260 0x7f13a403b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:18.470 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.404+0000 7f13ba7fc640 1 --2- 172.21.15.2:0/177438693 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f13a4039260 0x7f13a403b720 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f13b00098c0 tx=0x7f13b0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:18.470 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.408+0000 7f13a3fff640 1 -- 172.21.15.2:0/177438693 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f13ac045360 con 0x7f13bc1082d0 2024-09-19T06:06:18.470 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.584+0000 7f13c17d5640 1 -- 172.21.15.2:0/177438693 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f13bc19ee30 con 0x7f13bc1082d0 2024-09-19T06:06:18.470 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.585+0000 7f13a3fff640 1 -- 172.21.15.2:0/177438693 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f13ac03bdf0 con 0x7f13bc1082d0 2024-09-19T06:06:18.471 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.587+0000 7f13c17d5640 1 -- 172.21.15.2:0/177438693 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f13a4039260 msgr2=0x7f13a403b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:18.471 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.587+0000 7f13c17d5640 1 --2- 172.21.15.2:0/177438693 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f13a4039260 0x7f13a403b720 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f13b00098c0 tx=0x7f13b0006db0 comp rx=0 tx=0).stop 2024-09-19T06:06:18.471 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.587+0000 7f13c17d5640 1 -- 172.21.15.2:0/177438693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13bc1082d0 msgr2=0x7f13bc19b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:18.471 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.587+0000 7f13c17d5640 1 --2- 172.21.15.2:0/177438693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13bc1082d0 0x7f13bc19b7a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f13ac0097f0 tx=0x7f13ac030c70 comp rx=0 tx=0).stop 2024-09-19T06:06:18.471 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.587+0000 7f13c17d5640 1 -- 172.21.15.2:0/177438693 shutdown_connections 2024-09-19T06:06:18.471 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.587+0000 7f13c17d5640 1 --2- 172.21.15.2:0/177438693 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f13a4039260 0x7f13a403b720 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:18.471 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.587+0000 7f13c17d5640 1 --2- 172.21.15.2:0/177438693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13bc1082d0 0x7f13bc19b7a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:18.471 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.587+0000 7f13c17d5640 1 -- 172.21.15.2:0/177438693 >> 172.21.15.2:0/177438693 conn(0x7f13bc101dd0 msgr2=0x7f13bc1029f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:18.471 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.587+0000 7f13c17d5640 1 -- 172.21.15.2:0/177438693 shutdown_connections 2024-09-19T06:06:18.471 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:17.587+0000 7f13c17d5640 1 -- 172.21.15.2:0/177438693 wait complete. 2024-09-19T06:06:18.476 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T06:06:18.476 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-09-19T06:06:18.484 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T06:06:18.485 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-19T06:06:18.485 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-09-19T06:06:18.485 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-19T06:06:18.487 INFO:teuthology.orchestra.run.smithi002.stdout:Ceph Dashboard is now available at: 2024-09-19T06:06:18.487 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:06:18.487 INFO:teuthology.orchestra.run.smithi002.stdout: URL: https://smithi002.front.sepia.ceph.com:8443/ 2024-09-19T06:06:18.487 INFO:teuthology.orchestra.run.smithi002.stdout: User: admin 2024-09-19T06:06:18.487 INFO:teuthology.orchestra.run.smithi002.stdout: Password: 0ui0yie0j5 2024-09-19T06:06:18.487 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:06:18.488 INFO:teuthology.orchestra.run.smithi002.stdout:Saving cluster configuration to /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/config directory 2024-09-19T06:06:18.612 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:18 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/177438693' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-19T06:06:19.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:19 smithi002 ceph-mon[30982]: mgrmap e13: x(active, since 6s) 2024-09-19T06:06:19.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:19 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/2192389199' entity='client.admin' 2024-09-19T06:06:19.738 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:18.909+0000 7f43baf5f640 1 Processor -- start 2024-09-19T06:06:19.739 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:18.909+0000 7f43baf5f640 1 -- start start 2024-09-19T06:06:19.739 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:18.909+0000 7f43baf5f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43b407dd90 0x7f43b407c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:19.739 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:18.909+0000 7f43baf5f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f43b407c7d0 con 0x7f43b407dd90 2024-09-19T06:06:19.739 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:18.909+0000 7f43b8cfb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43b407dd90 0x7f43b407c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:19.739 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:18.909+0000 7f43b8cfb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43b407dd90 0x7f43b407c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49716/0 (socket says 172.21.15.2:49716) 2024-09-19T06:06:19.739 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:18.909+0000 7f43b8cfb640 1 -- 172.21.15.2:0/3256667977 learned_addr learned my addr 172.21.15.2:0/3256667977 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:06:19.739 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:18.910+0000 7f43b8cfb640 1 -- 172.21.15.2:0/3256667977 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b407c950 con 0x7f43b407dd90 2024-09-19T06:06:19.739 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:18.910+0000 7f43b8cfb640 1 --2- 172.21.15.2:0/3256667977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43b407dd90 0x7f43b407c290 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f43a8009820 tx=0x7f43a802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad78315826010a90 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:19.739 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:18.911+0000 7f43b37fe640 1 -- 172.21.15.2:0/3256667977 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43a8037070 con 0x7f43b407dd90 2024-09-19T06:06:19.739 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:18.911+0000 7f43b37fe640 1 -- 172.21.15.2:0/3256667977 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f43a80328f0 con 0x7f43b407dd90 2024-09-19T06:06:19.740 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:18.911+0000 7f43b37fe640 1 -- 172.21.15.2:0/3256667977 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43a8030740 con 0x7f43b407dd90 2024-09-19T06:06:19.740 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:18.911+0000 7f43baf5f640 1 -- 172.21.15.2:0/3256667977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43b407dd90 msgr2=0x7f43b407c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:19.740 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:18.911+0000 7f43baf5f640 1 --2- 172.21.15.2:0/3256667977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43b407dd90 0x7f43b407c290 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f43a8009820 tx=0x7f43a802a270 comp rx=0 tx=0).stop 2024-09-19T06:06:19.740 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:18.911+0000 7f43baf5f640 1 -- 172.21.15.2:0/3256667977 shutdown_connections 2024-09-19T06:06:19.740 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:18.911+0000 7f43baf5f640 1 --2- 172.21.15.2:0/3256667977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43b407dd90 0x7f43b407c290 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:19.740 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:18.911+0000 7f43baf5f640 1 -- 172.21.15.2:0/3256667977 >> 172.21.15.2:0/3256667977 conn(0x7f43b4102f60 msgr2=0x7f43b4105380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:19.740 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:18.911+0000 7f43baf5f640 1 -- 172.21.15.2:0/3256667977 shutdown_connections 2024-09-19T06:06:19.740 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:18.911+0000 7f43baf5f640 1 -- 172.21.15.2:0/3256667977 wait complete. 2024-09-19T06:06:19.740 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:18.912+0000 7f43baf5f640 1 Processor -- start 2024-09-19T06:06:19.741 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:18.912+0000 7f43baf5f640 1 -- start start 2024-09-19T06:06:19.741 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:18.912+0000 7f43baf5f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43b407dd90 0x7f43b419d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:19.741 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:18.912+0000 7f43baf5f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f43b410dd00 con 0x7f43b407dd90 2024-09-19T06:06:19.741 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:18.912+0000 7f43b8cfb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43b407dd90 0x7f43b419d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:19.741 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:18.912+0000 7f43b8cfb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43b407dd90 0x7f43b419d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49728/0 (socket says 172.21.15.2:49728) 2024-09-19T06:06:19.741 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:18.912+0000 7f43b8cfb640 1 -- 172.21.15.2:0/2192389199 learned_addr learned my addr 172.21.15.2:0/2192389199 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:06:19.741 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:18.913+0000 7f43b8cfb640 1 -- 172.21.15.2:0/2192389199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b419ddd0 con 0x7f43b407dd90 2024-09-19T06:06:19.741 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:18.913+0000 7f43b8cfb640 1 --2- 172.21.15.2:0/2192389199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43b407dd90 0x7f43b419d890 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f43a80097f0 tx=0x7f43a8030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:19.741 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:18.913+0000 7f43b1ffb640 1 -- 172.21.15.2:0/2192389199 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43a8042070 con 0x7f43b407dd90 2024-09-19T06:06:19.741 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:18.913+0000 7f43b1ffb640 1 -- 172.21.15.2:0/2192389199 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f43a8030d80 con 0x7f43b407dd90 2024-09-19T06:06:19.742 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:18.913+0000 7f43baf5f640 1 -- 172.21.15.2:0/2192389199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43b419e060 con 0x7f43b407dd90 2024-09-19T06:06:19.742 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:18.913+0000 7f43b1ffb640 1 -- 172.21.15.2:0/2192389199 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43a8037040 con 0x7f43b407dd90 2024-09-19T06:06:19.742 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:18.913+0000 7f43baf5f640 1 -- 172.21.15.2:0/2192389199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43b41a0d50 con 0x7f43b407dd90 2024-09-19T06:06:19.742 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:18.914+0000 7f43b1ffb640 1 -- 172.21.15.2:0/2192389199 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f43a8045070 con 0x7f43b407dd90 2024-09-19T06:06:19.742 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:18.914+0000 7f43b1ffb640 1 --2- 172.21.15.2:0/2192389199 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f43a4039300 0x7f43a403b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:19.742 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:18.914+0000 7f43b1ffb640 1 -- 172.21.15.2:0/2192389199 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f43a806c4e0 con 0x7f43b407dd90 2024-09-19T06:06:19.742 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:18.915+0000 7f43b3fff640 1 --2- 172.21.15.2:0/2192389199 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f43a4039300 0x7f43a403b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:19.742 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:18.915+0000 7f43baf5f640 1 -- 172.21.15.2:0/2192389199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43b407c310 con 0x7f43b407dd90 2024-09-19T06:06:19.742 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:18.915+0000 7f43b3fff640 1 --2- 172.21.15.2:0/2192389199 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f43a4039300 0x7f43a403b7c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f43a00098c0 tx=0x7f43a0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:19.743 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:18.920+0000 7f43b1ffb640 1 -- 172.21.15.2:0/2192389199 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f43a8045360 con 0x7f43b407dd90 2024-09-19T06:06:19.743 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:19.189+0000 7f43baf5f640 1 -- 172.21.15.2:0/2192389199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f43b41a1210 con 0x7f43b407dd90 2024-09-19T06:06:19.743 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:19.192+0000 7f43b1ffb640 1 -- 172.21.15.2:0/2192389199 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f43a803ada0 con 0x7f43b407dd90 2024-09-19T06:06:19.743 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-19T06:06:19.743 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:19.194+0000 7f43baf5f640 1 -- 172.21.15.2:0/2192389199 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f43a4039300 msgr2=0x7f43a403b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:19.743 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:19.194+0000 7f43baf5f640 1 --2- 172.21.15.2:0/2192389199 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f43a4039300 0x7f43a403b7c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f43a00098c0 tx=0x7f43a0006db0 comp rx=0 tx=0).stop 2024-09-19T06:06:19.743 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:19.194+0000 7f43baf5f640 1 -- 172.21.15.2:0/2192389199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43b407dd90 msgr2=0x7f43b419d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:19.743 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:19.194+0000 7f43baf5f640 1 --2- 172.21.15.2:0/2192389199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43b407dd90 0x7f43b419d890 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f43a80097f0 tx=0x7f43a8030c70 comp rx=0 tx=0).stop 2024-09-19T06:06:19.743 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:19.194+0000 7f43baf5f640 1 -- 172.21.15.2:0/2192389199 shutdown_connections 2024-09-19T06:06:19.743 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:19.194+0000 7f43baf5f640 1 --2- 172.21.15.2:0/2192389199 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f43a4039300 0x7f43a403b7c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:19.744 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:19.194+0000 7f43baf5f640 1 --2- 172.21.15.2:0/2192389199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43b407dd90 0x7f43b419d890 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:19.744 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:19.195+0000 7f43baf5f640 1 -- 172.21.15.2:0/2192389199 >> 172.21.15.2:0/2192389199 conn(0x7f43b4102f60 msgr2=0x7f43b4103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:19.744 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:19.195+0000 7f43baf5f640 1 -- 172.21.15.2:0/2192389199 shutdown_connections 2024-09-19T06:06:19.744 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-19T06:06:19.195+0000 7f43baf5f640 1 -- 172.21.15.2:0/2192389199 wait complete. 2024-09-19T06:06:19.744 INFO:teuthology.orchestra.run.smithi002.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-19T06:06:19.744 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:06:19.744 INFO:teuthology.orchestra.run.smithi002.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:06:19.744 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:06:19.744 INFO:teuthology.orchestra.run.smithi002.stdout:Or, if you are only running a single cluster on this host: 2024-09-19T06:06:19.744 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:06:19.744 INFO:teuthology.orchestra.run.smithi002.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-19T06:06:19.745 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:06:19.745 INFO:teuthology.orchestra.run.smithi002.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-19T06:06:19.745 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:06:19.745 INFO:teuthology.orchestra.run.smithi002.stdout: ceph telemetry on 2024-09-19T06:06:19.745 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:06:19.745 INFO:teuthology.orchestra.run.smithi002.stdout:For more information see: 2024-09-19T06:06:19.745 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:06:19.745 INFO:teuthology.orchestra.run.smithi002.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-19T06:06:19.745 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:06:19.745 INFO:teuthology.orchestra.run.smithi002.stdout:Bootstrap complete. 2024-09-19T06:06:19.779 INFO:tasks.cephadm:Fetching config... 2024-09-19T06:06:19.779 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-19T06:06:19.779 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-19T06:06:19.796 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-19T06:06:19.796 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-19T06:06:19.796 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-19T06:06:19.853 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-19T06:06:19.853 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-19T06:06:19.853 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-19T06:06:19.920 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-19T06:06:19.920 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-19T06:06:19.920 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-19T06:06:19.977 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-19T06:06:19.977 DEBUG:teuthology.orchestra.run.smithi002:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCph5uC3rHal7LKe77k2CA94394jWQMAJQPlGzrKajzL2bYacVqwGPBw2gbFs+rbesqkySC8RLHOYiYQv3AE2qlkAYpSaPDWWGhUCgLX+4KZ+0khV8fOiWp4s9tQNuXpelrEhObHaa2Ak3Q2xeoASCftRo+AJeEbk/Un8AFaeF5AgumZAU3NpLsko/eGCYxhw4GSkB3406YDfC0vPVFs4N7pyJ+9Y4gjMeRBrMQWt3udbp74A/r0ECr/3VMl6tzJJ5r78ztQ1FrXRKFYvp+gVwuy21i6hbNCofoRoUJL+TIMQblrzRLF12t1A0xqMIo6Xy0Cv4dD3Kr6trNwV0OxeitdYQwnLP3QYfLjoSibYUunPe0FMWBNHXIiOOTdWKkm1+92ZptRlna5mm/Uo1f0orDWpqezGpJiBzV1cLpiP5hhBLAeiabSXtaujrh1/Ozx+HChizpZSfmIyt6I1eQqBZxYNtRGaP6LDdN3gSXlG5f0P5+KFKWmvBvuxY4JdkTkNU= ceph-078f6612-764d-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T06:06:20.052 INFO:teuthology.orchestra.run.smithi002.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCph5uC3rHal7LKe77k2CA94394jWQMAJQPlGzrKajzL2bYacVqwGPBw2gbFs+rbesqkySC8RLHOYiYQv3AE2qlkAYpSaPDWWGhUCgLX+4KZ+0khV8fOiWp4s9tQNuXpelrEhObHaa2Ak3Q2xeoASCftRo+AJeEbk/Un8AFaeF5AgumZAU3NpLsko/eGCYxhw4GSkB3406YDfC0vPVFs4N7pyJ+9Y4gjMeRBrMQWt3udbp74A/r0ECr/3VMl6tzJJ5r78ztQ1FrXRKFYvp+gVwuy21i6hbNCofoRoUJL+TIMQblrzRLF12t1A0xqMIo6Xy0Cv4dD3Kr6trNwV0OxeitdYQwnLP3QYfLjoSibYUunPe0FMWBNHXIiOOTdWKkm1+92ZptRlna5mm/Uo1f0orDWpqezGpJiBzV1cLpiP5hhBLAeiabSXtaujrh1/Ozx+HChizpZSfmIyt6I1eQqBZxYNtRGaP6LDdN3gSXlG5f0P5+KFKWmvBvuxY4JdkTkNU= ceph-078f6612-764d-11ef-bceb-c7b262605968 2024-09-19T06:06:20.064 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCph5uC3rHal7LKe77k2CA94394jWQMAJQPlGzrKajzL2bYacVqwGPBw2gbFs+rbesqkySC8RLHOYiYQv3AE2qlkAYpSaPDWWGhUCgLX+4KZ+0khV8fOiWp4s9tQNuXpelrEhObHaa2Ak3Q2xeoASCftRo+AJeEbk/Un8AFaeF5AgumZAU3NpLsko/eGCYxhw4GSkB3406YDfC0vPVFs4N7pyJ+9Y4gjMeRBrMQWt3udbp74A/r0ECr/3VMl6tzJJ5r78ztQ1FrXRKFYvp+gVwuy21i6hbNCofoRoUJL+TIMQblrzRLF12t1A0xqMIo6Xy0Cv4dD3Kr6trNwV0OxeitdYQwnLP3QYfLjoSibYUunPe0FMWBNHXIiOOTdWKkm1+92ZptRlna5mm/Uo1f0orDWpqezGpJiBzV1cLpiP5hhBLAeiabSXtaujrh1/Ozx+HChizpZSfmIyt6I1eQqBZxYNtRGaP6LDdN3gSXlG5f0P5+KFKWmvBvuxY4JdkTkNU= ceph-078f6612-764d-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T06:06:20.190 INFO:teuthology.orchestra.run.smithi089.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCph5uC3rHal7LKe77k2CA94394jWQMAJQPlGzrKajzL2bYacVqwGPBw2gbFs+rbesqkySC8RLHOYiYQv3AE2qlkAYpSaPDWWGhUCgLX+4KZ+0khV8fOiWp4s9tQNuXpelrEhObHaa2Ak3Q2xeoASCftRo+AJeEbk/Un8AFaeF5AgumZAU3NpLsko/eGCYxhw4GSkB3406YDfC0vPVFs4N7pyJ+9Y4gjMeRBrMQWt3udbp74A/r0ECr/3VMl6tzJJ5r78ztQ1FrXRKFYvp+gVwuy21i6hbNCofoRoUJL+TIMQblrzRLF12t1A0xqMIo6Xy0Cv4dD3Kr6trNwV0OxeitdYQwnLP3QYfLjoSibYUunPe0FMWBNHXIiOOTdWKkm1+92ZptRlna5mm/Uo1f0orDWpqezGpJiBzV1cLpiP5hhBLAeiabSXtaujrh1/Ozx+HChizpZSfmIyt6I1eQqBZxYNtRGaP6LDdN3gSXlG5f0P5+KFKWmvBvuxY4JdkTkNU= ceph-078f6612-764d-11ef-bceb-c7b262605968 2024-09-19T06:06:20.204 DEBUG:teuthology.orchestra.run.smithi090:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCph5uC3rHal7LKe77k2CA94394jWQMAJQPlGzrKajzL2bYacVqwGPBw2gbFs+rbesqkySC8RLHOYiYQv3AE2qlkAYpSaPDWWGhUCgLX+4KZ+0khV8fOiWp4s9tQNuXpelrEhObHaa2Ak3Q2xeoASCftRo+AJeEbk/Un8AFaeF5AgumZAU3NpLsko/eGCYxhw4GSkB3406YDfC0vPVFs4N7pyJ+9Y4gjMeRBrMQWt3udbp74A/r0ECr/3VMl6tzJJ5r78ztQ1FrXRKFYvp+gVwuy21i6hbNCofoRoUJL+TIMQblrzRLF12t1A0xqMIo6Xy0Cv4dD3Kr6trNwV0OxeitdYQwnLP3QYfLjoSibYUunPe0FMWBNHXIiOOTdWKkm1+92ZptRlna5mm/Uo1f0orDWpqezGpJiBzV1cLpiP5hhBLAeiabSXtaujrh1/Ozx+HChizpZSfmIyt6I1eQqBZxYNtRGaP6LDdN3gSXlG5f0P5+KFKWmvBvuxY4JdkTkNU= ceph-078f6612-764d-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T06:06:20.272 INFO:teuthology.orchestra.run.smithi090.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCph5uC3rHal7LKe77k2CA94394jWQMAJQPlGzrKajzL2bYacVqwGPBw2gbFs+rbesqkySC8RLHOYiYQv3AE2qlkAYpSaPDWWGhUCgLX+4KZ+0khV8fOiWp4s9tQNuXpelrEhObHaa2Ak3Q2xeoASCftRo+AJeEbk/Un8AFaeF5AgumZAU3NpLsko/eGCYxhw4GSkB3406YDfC0vPVFs4N7pyJ+9Y4gjMeRBrMQWt3udbp74A/r0ECr/3VMl6tzJJ5r78ztQ1FrXRKFYvp+gVwuy21i6hbNCofoRoUJL+TIMQblrzRLF12t1A0xqMIo6Xy0Cv4dD3Kr6trNwV0OxeitdYQwnLP3QYfLjoSibYUunPe0FMWBNHXIiOOTdWKkm1+92ZptRlna5mm/Uo1f0orDWpqezGpJiBzV1cLpiP5hhBLAeiabSXtaujrh1/Ozx+HChizpZSfmIyt6I1eQqBZxYNtRGaP6LDdN3gSXlG5f0P5+KFKWmvBvuxY4JdkTkNU= ceph-078f6612-764d-11ef-bceb-c7b262605968 2024-09-19T06:06:20.285 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-19T06:06:20.544 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:21.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:21.019+0000 7f2382e43640 1 -- 172.21.15.2:0/1508787401 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f237c101600 msgr2=0x7f237c101a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:21.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:21.019+0000 7f2382e43640 1 --2- 172.21.15.2:0/1508787401 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f237c101600 0x7f237c101a00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2370009880 tx=0x7f237002a5d0 comp rx=0 tx=0).stop 2024-09-19T06:06:21.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:21.019+0000 7f2382e43640 1 -- 172.21.15.2:0/1508787401 shutdown_connections 2024-09-19T06:06:21.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:21.019+0000 7f2382e43640 1 --2- 172.21.15.2:0/1508787401 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f237c101600 0x7f237c101a00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:21.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:21.019+0000 7f2382e43640 1 -- 172.21.15.2:0/1508787401 >> 172.21.15.2:0/1508787401 conn(0x7f237c0fcdb0 msgr2=0x7f237c0ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:21.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:21.019+0000 7f2382e43640 1 -- 172.21.15.2:0/1508787401 shutdown_connections 2024-09-19T06:06:21.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:21.019+0000 7f2382e43640 1 -- 172.21.15.2:0/1508787401 wait complete. 2024-09-19T06:06:21.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:21.020+0000 7f2382e43640 1 Processor -- start 2024-09-19T06:06:21.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:21.020+0000 7f2382e43640 1 -- start start 2024-09-19T06:06:21.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:21.020+0000 7f2382e43640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f237c101600 0x7f237c196cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:21.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:21.020+0000 7f2382e43640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f237c1075c0 con 0x7f237c101600 2024-09-19T06:06:21.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:21.020+0000 7f2380bdf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f237c101600 0x7f237c196cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:21.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:21.020+0000 7f2380bdf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f237c101600 0x7f237c196cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49748/0 (socket says 172.21.15.2:49748) 2024-09-19T06:06:21.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:21.020+0000 7f2380bdf640 1 -- 172.21.15.2:0/1504008599 learned_addr learned my addr 172.21.15.2:0/1504008599 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:06:21.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:21.020+0000 7f2380bdf640 1 -- 172.21.15.2:0/1504008599 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f237c197200 con 0x7f237c101600 2024-09-19T06:06:21.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:21.021+0000 7f2380bdf640 1 --2- 172.21.15.2:0/1504008599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f237c101600 0x7f237c196cc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2370009230 tx=0x7f23700048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:21.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:21.021+0000 7f2379ffb640 1 -- 172.21.15.2:0/1504008599 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f237003f070 con 0x7f237c101600 2024-09-19T06:06:21.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:21.021+0000 7f2379ffb640 1 -- 172.21.15.2:0/1504008599 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2370003aa0 con 0x7f237c101600 2024-09-19T06:06:21.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:21.021+0000 7f2382e43640 1 -- 172.21.15.2:0/1504008599 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f237c197490 con 0x7f237c101600 2024-09-19T06:06:21.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:21.021+0000 7f2379ffb640 1 -- 172.21.15.2:0/1504008599 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2370035030 con 0x7f237c101600 2024-09-19T06:06:21.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:21.021+0000 7f2382e43640 1 -- 172.21.15.2:0/1504008599 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f237c19a180 con 0x7f237c101600 2024-09-19T06:06:21.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:21.022+0000 7f2379ffb640 1 -- 172.21.15.2:0/1504008599 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f2370042070 con 0x7f237c101600 2024-09-19T06:06:21.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:21.022+0000 7f2382e43640 1 -- 172.21.15.2:0/1504008599 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f237c107d40 con 0x7f237c101600 2024-09-19T06:06:21.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:21.022+0000 7f2379ffb640 1 --2- 172.21.15.2:0/1504008599 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f236c039300 0x7f236c03b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:21.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:21.022+0000 7f2379ffb640 1 -- 172.21.15.2:0/1504008599 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f237006d080 con 0x7f237c101600 2024-09-19T06:06:21.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:21.022+0000 7f237bfff640 1 --2- 172.21.15.2:0/1504008599 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f236c039300 0x7f236c03b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:21.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:21.023+0000 7f237bfff640 1 --2- 172.21.15.2:0/1504008599 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f236c039300 0x7f236c03b7c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f23680098c0 tx=0x7f2368006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:21.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:21.027+0000 7f2379ffb640 1 -- 172.21.15.2:0/1504008599 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2370039350 con 0x7f237c101600 2024-09-19T06:06:21.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:21.207+0000 7f2382e43640 1 -- 172.21.15.2:0/1504008599 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f237c02d830 con 0x7f237c101600 2024-09-19T06:06:21.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:21.209+0000 7f2379ffb640 1 -- 172.21.15.2:0/1504008599 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f2370003c50 con 0x7f237c101600 2024-09-19T06:06:21.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:21.212+0000 7f2382e43640 1 -- 172.21.15.2:0/1504008599 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f236c039300 msgr2=0x7f236c03b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:21.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:21.212+0000 7f2382e43640 1 --2- 172.21.15.2:0/1504008599 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f236c039300 0x7f236c03b7c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f23680098c0 tx=0x7f2368006db0 comp rx=0 tx=0).stop 2024-09-19T06:06:21.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:21.212+0000 7f2382e43640 1 -- 172.21.15.2:0/1504008599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f237c101600 msgr2=0x7f237c196cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:21.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:21.212+0000 7f2382e43640 1 --2- 172.21.15.2:0/1504008599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f237c101600 0x7f237c196cc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2370009230 tx=0x7f23700048f0 comp rx=0 tx=0).stop 2024-09-19T06:06:21.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:21.212+0000 7f2382e43640 1 -- 172.21.15.2:0/1504008599 shutdown_connections 2024-09-19T06:06:21.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:21.212+0000 7f2382e43640 1 --2- 172.21.15.2:0/1504008599 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f236c039300 0x7f236c03b7c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:21.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:21.212+0000 7f2382e43640 1 --2- 172.21.15.2:0/1504008599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f237c101600 0x7f237c196cc0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:21.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:21.212+0000 7f2382e43640 1 -- 172.21.15.2:0/1504008599 >> 172.21.15.2:0/1504008599 conn(0x7f237c0fcdb0 msgr2=0x7f237c0fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:21.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:21.212+0000 7f2382e43640 1 -- 172.21.15.2:0/1504008599 shutdown_connections 2024-09-19T06:06:21.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:21.212+0000 7f2382e43640 1 -- 172.21.15.2:0/1504008599 wait complete. 2024-09-19T06:06:22.122 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-19T06:06:22.122 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-19T06:06:22.410 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:22 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1504008599' entity='client.admin' 2024-09-19T06:06:22.624 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:23.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:23.102+0000 7fe9893b3640 1 -- 172.21.15.2:0/506729909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9841020d0 msgr2=0x7fe9841044c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:23.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:23.102+0000 7fe9893b3640 1 --2- 172.21.15.2:0/506729909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9841020d0 0x7fe9841044c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe974009880 tx=0x7fe97402a5d0 comp rx=0 tx=0).stop 2024-09-19T06:06:23.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:23.102+0000 7fe9893b3640 1 -- 172.21.15.2:0/506729909 shutdown_connections 2024-09-19T06:06:23.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:23.102+0000 7fe9893b3640 1 --2- 172.21.15.2:0/506729909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9841020d0 0x7fe9841044c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:23.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:23.102+0000 7fe9893b3640 1 -- 172.21.15.2:0/506729909 >> 172.21.15.2:0/506729909 conn(0x7fe9840fbcd0 msgr2=0x7fe9840fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:23.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:23.102+0000 7fe9893b3640 1 -- 172.21.15.2:0/506729909 shutdown_connections 2024-09-19T06:06:23.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:23.102+0000 7fe9893b3640 1 -- 172.21.15.2:0/506729909 wait complete. 2024-09-19T06:06:23.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:23.102+0000 7fe9893b3640 1 Processor -- start 2024-09-19T06:06:23.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:23.103+0000 7fe9893b3640 1 -- start start 2024-09-19T06:06:23.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:23.103+0000 7fe9893b3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9841020d0 0x7fe984196c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:23.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:23.103+0000 7fe9893b3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe984107520 con 0x7fe9841020d0 2024-09-19T06:06:23.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:23.103+0000 7fe982ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9841020d0 0x7fe984196c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:23.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:23.103+0000 7fe982ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9841020d0 0x7fe984196c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49770/0 (socket says 172.21.15.2:49770) 2024-09-19T06:06:23.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:23.103+0000 7fe982ffd640 1 -- 172.21.15.2:0/763123286 learned_addr learned my addr 172.21.15.2:0/763123286 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:06:23.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:23.103+0000 7fe982ffd640 1 -- 172.21.15.2:0/763123286 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe984197150 con 0x7fe9841020d0 2024-09-19T06:06:23.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:23.104+0000 7fe982ffd640 1 --2- 172.21.15.2:0/763123286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9841020d0 0x7fe984196c10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe974009230 tx=0x7fe9740048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:23.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:23.104+0000 7fe96bfff640 1 -- 172.21.15.2:0/763123286 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe97403f070 con 0x7fe9841020d0 2024-09-19T06:06:23.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:23.104+0000 7fe9893b3640 1 -- 172.21.15.2:0/763123286 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe984197440 con 0x7fe9841020d0 2024-09-19T06:06:23.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:23.104+0000 7fe96bfff640 1 -- 172.21.15.2:0/763123286 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe974003aa0 con 0x7fe9841020d0 2024-09-19T06:06:23.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:23.104+0000 7fe96bfff640 1 -- 172.21.15.2:0/763123286 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe974035030 con 0x7fe9841020d0 2024-09-19T06:06:23.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:23.104+0000 7fe9893b3640 1 -- 172.21.15.2:0/763123286 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe98419a0d0 con 0x7fe9841020d0 2024-09-19T06:06:23.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:23.105+0000 7fe96bfff640 1 -- 172.21.15.2:0/763123286 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fe974042070 con 0x7fe9841020d0 2024-09-19T06:06:23.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:23.105+0000 7fe9893b3640 1 -- 172.21.15.2:0/763123286 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe984107ca0 con 0x7fe9841020d0 2024-09-19T06:06:23.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:23.105+0000 7fe96bfff640 1 --2- 172.21.15.2:0/763123286 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fe96c0392a0 0x7fe96c03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:23.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:23.105+0000 7fe96bfff640 1 -- 172.21.15.2:0/763123286 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe97406d080 con 0x7fe9841020d0 2024-09-19T06:06:23.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:23.105+0000 7fe9827fc640 1 --2- 172.21.15.2:0/763123286 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fe96c0392a0 0x7fe96c03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:23.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:23.106+0000 7fe9827fc640 1 --2- 172.21.15.2:0/763123286 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fe96c0392a0 0x7fe96c03b760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe9780098c0 tx=0x7fe978006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:23.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:23.113+0000 7fe96bfff640 1 -- 172.21.15.2:0/763123286 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe9740433b0 con 0x7fe9841020d0 2024-09-19T06:06:23.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:23.295+0000 7fe9893b3640 1 -- 172.21.15.2:0/763123286 --> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fe98402d9b0 con 0x7fe96c0392a0 2024-09-19T06:06:23.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:23.299+0000 7fe96bfff640 1 -- 172.21.15.2:0/763123286 <== mgr.14150 v2:172.21.15.2:6800/4180340554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe98402d9b0 con 0x7fe96c0392a0 2024-09-19T06:06:23.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:23.300+0000 7fe9893b3640 1 -- 172.21.15.2:0/763123286 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fe96c0392a0 msgr2=0x7fe96c03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:23.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:23.301+0000 7fe9893b3640 1 --2- 172.21.15.2:0/763123286 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fe96c0392a0 0x7fe96c03b760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe9780098c0 tx=0x7fe978006db0 comp rx=0 tx=0).stop 2024-09-19T06:06:23.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:23.301+0000 7fe9893b3640 1 -- 172.21.15.2:0/763123286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9841020d0 msgr2=0x7fe984196c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:23.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:23.301+0000 7fe9893b3640 1 --2- 172.21.15.2:0/763123286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9841020d0 0x7fe984196c10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe974009230 tx=0x7fe9740048f0 comp rx=0 tx=0).stop 2024-09-19T06:06:23.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:23.301+0000 7fe9893b3640 1 -- 172.21.15.2:0/763123286 shutdown_connections 2024-09-19T06:06:23.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:23.301+0000 7fe9893b3640 1 --2- 172.21.15.2:0/763123286 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fe96c0392a0 0x7fe96c03b760 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:23.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:23.301+0000 7fe9893b3640 1 --2- 172.21.15.2:0/763123286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9841020d0 0x7fe984196c10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:23.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:23.301+0000 7fe9893b3640 1 -- 172.21.15.2:0/763123286 >> 172.21.15.2:0/763123286 conn(0x7fe9840fbcd0 msgr2=0x7fe9840fc780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:23.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:23.301+0000 7fe9893b3640 1 -- 172.21.15.2:0/763123286 shutdown_connections 2024-09-19T06:06:23.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:23.301+0000 7fe9893b3640 1 -- 172.21.15.2:0/763123286 wait complete. 2024-09-19T06:06:23.911 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi089 2024-09-19T06:06:23.911 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-19T06:06:23.911 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/etc/ceph/ceph.conf 2024-09-19T06:06:23.930 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-19T06:06:23.931 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:06:23.989 INFO:tasks.cephadm:Adding host smithi089 to orchestrator... 2024-09-19T06:06:23.989 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph orch host add smithi089 2024-09-19T06:06:24.425 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:24.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:24 smithi002 ceph-mon[30982]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:06:24.560 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:24 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:24.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:24.947+0000 7f5931951640 1 -- 172.21.15.2:0/2534609954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f592c100540 msgr2=0x7f592c100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:24.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:24.947+0000 7f5931951640 1 --2- 172.21.15.2:0/2534609954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f592c100540 0x7f592c100940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f591c009880 tx=0x7f591c02a5d0 comp rx=0 tx=0).stop 2024-09-19T06:06:24.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:24.947+0000 7f5931951640 1 -- 172.21.15.2:0/2534609954 shutdown_connections 2024-09-19T06:06:24.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:24.947+0000 7f5931951640 1 --2- 172.21.15.2:0/2534609954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f592c100540 0x7f592c100940 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:24.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:24.947+0000 7f5931951640 1 -- 172.21.15.2:0/2534609954 >> 172.21.15.2:0/2534609954 conn(0x7f592c0fbcd0 msgr2=0x7f592c0fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:24.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:24.947+0000 7f5931951640 1 -- 172.21.15.2:0/2534609954 shutdown_connections 2024-09-19T06:06:24.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:24.947+0000 7f5931951640 1 -- 172.21.15.2:0/2534609954 wait complete. 2024-09-19T06:06:24.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:24.948+0000 7f5931951640 1 Processor -- start 2024-09-19T06:06:24.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:24.948+0000 7f5931951640 1 -- start start 2024-09-19T06:06:24.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:24.948+0000 7f5931951640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f592c100540 0x7f592c0fdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:24.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:24.948+0000 7f5931951640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f592c1064a0 con 0x7f592c100540 2024-09-19T06:06:24.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:24.948+0000 7f592affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f592c100540 0x7f592c0fdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:24.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:24.948+0000 7f592affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f592c100540 0x7f592c0fdb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49776/0 (socket says 172.21.15.2:49776) 2024-09-19T06:06:24.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:24.948+0000 7f592affd640 1 -- 172.21.15.2:0/1426127533 learned_addr learned my addr 172.21.15.2:0/1426127533 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:06:24.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:24.949+0000 7f592affd640 1 -- 172.21.15.2:0/1426127533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f592c0fe0d0 con 0x7f592c100540 2024-09-19T06:06:24.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:24.949+0000 7f592affd640 1 --2- 172.21.15.2:0/1426127533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f592c100540 0x7f592c0fdb90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f591c005ec0 tx=0x7f591c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:24.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:24.949+0000 7f593094f640 1 -- 172.21.15.2:0/1426127533 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f591c03f070 con 0x7f592c100540 2024-09-19T06:06:24.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:24.949+0000 7f593094f640 1 -- 172.21.15.2:0/1426127533 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f591c003aa0 con 0x7f592c100540 2024-09-19T06:06:24.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:24.949+0000 7f593094f640 1 -- 172.21.15.2:0/1426127533 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f591c035030 con 0x7f592c100540 2024-09-19T06:06:24.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:24.949+0000 7f5931951640 1 -- 172.21.15.2:0/1426127533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f592c0fc2c0 con 0x7f592c100540 2024-09-19T06:06:24.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:24.949+0000 7f5931951640 1 -- 172.21.15.2:0/1426127533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f592c0fc800 con 0x7f592c100540 2024-09-19T06:06:24.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:24.950+0000 7f593094f640 1 -- 172.21.15.2:0/1426127533 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f591c042070 con 0x7f592c100540 2024-09-19T06:06:24.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:24.950+0000 7f5931951640 1 -- 172.21.15.2:0/1426127533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f592c106c20 con 0x7f592c100540 2024-09-19T06:06:24.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:24.951+0000 7f593094f640 1 --2- 172.21.15.2:0/1426127533 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f5918039300 0x7f591803b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:24.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:24.951+0000 7f593094f640 1 -- 172.21.15.2:0/1426127533 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f591c06d1b0 con 0x7f592c100540 2024-09-19T06:06:24.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:24.951+0000 7f59227fc640 1 --2- 172.21.15.2:0/1426127533 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f5918039300 0x7f591803b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:24.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:24.951+0000 7f59227fc640 1 --2- 172.21.15.2:0/1426127533 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f5918039300 0x7f591803b7c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f59140098c0 tx=0x7f5914006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:24.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:24.955+0000 7f593094f640 1 -- 172.21.15.2:0/1426127533 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f591c0433b0 con 0x7f592c100540 2024-09-19T06:06:25.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:25.177+0000 7f5931951640 1 -- 172.21.15.2:0/1426127533 --> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi089", "target": ["mon-mgr", ""]}) -- 0x7f592c190230 con 0x7f5918039300 2024-09-19T06:06:25.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:25 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:25.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:25 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:25.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:25 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi002", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:06:25.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:25 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:06:25.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:25 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:06:25.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:25 smithi002 ceph-mon[30982]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-19T06:06:25.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:25 smithi002 ceph-mon[30982]: Updating smithi002:/var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:06:25.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:25 smithi002 ceph-mon[30982]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:06:25.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:25 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:25.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:25 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:25.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:25 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:25.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:25 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:06:25.474 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:25 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:06:25.474 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:25 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:06:25.474 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:25 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:26.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:26 smithi002 ceph-mon[30982]: Updating smithi002:/var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:06:26.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:26 smithi002 ceph-mon[30982]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi089", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:06:27.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:27 smithi002 ceph-mon[30982]: Deploying cephadm binary to smithi089 2024-09-19T06:06:29.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:29.041+0000 7f593094f640 1 -- 172.21.15.2:0/1426127533 <== mgr.14150 v2:172.21.15.2:6800/4180340554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f592c190230 con 0x7f5918039300 2024-09-19T06:06:29.043 INFO:teuthology.orchestra.run.smithi002.stdout:Added host 'smithi089' with addr '172.21.15.89' 2024-09-19T06:06:29.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:29.044+0000 7f5931951640 1 -- 172.21.15.2:0/1426127533 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f5918039300 msgr2=0x7f591803b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:29.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:29.044+0000 7f5931951640 1 --2- 172.21.15.2:0/1426127533 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f5918039300 0x7f591803b7c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f59140098c0 tx=0x7f5914006db0 comp rx=0 tx=0).stop 2024-09-19T06:06:29.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:29.044+0000 7f5931951640 1 -- 172.21.15.2:0/1426127533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f592c100540 msgr2=0x7f592c0fdb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:29.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:29.044+0000 7f5931951640 1 --2- 172.21.15.2:0/1426127533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f592c100540 0x7f592c0fdb90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f591c005ec0 tx=0x7f591c0048f0 comp rx=0 tx=0).stop 2024-09-19T06:06:29.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:29.044+0000 7f5931951640 1 -- 172.21.15.2:0/1426127533 shutdown_connections 2024-09-19T06:06:29.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:29.044+0000 7f5931951640 1 --2- 172.21.15.2:0/1426127533 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f5918039300 0x7f591803b7c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:29.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:29.044+0000 7f5931951640 1 --2- 172.21.15.2:0/1426127533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f592c100540 0x7f592c0fdb90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:29.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:29.044+0000 7f5931951640 1 -- 172.21.15.2:0/1426127533 >> 172.21.15.2:0/1426127533 conn(0x7f592c0fbcd0 msgr2=0x7f592c069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:29.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:29.044+0000 7f5931951640 1 -- 172.21.15.2:0/1426127533 shutdown_connections 2024-09-19T06:06:29.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:29.044+0000 7f5931951640 1 -- 172.21.15.2:0/1426127533 wait complete. 2024-09-19T06:06:29.589 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T06:06:29.840 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:30.221 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:30 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:30.221 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:30 smithi002 ceph-mon[30982]: Added host smithi089 2024-09-19T06:06:30.221 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:30 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:06:30.221 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:30 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:30.221 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:30 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:30.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:30.302+0000 7f51cc683640 1 -- 172.21.15.2:0/2015814274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51c4102790 msgr2=0x7f51c4102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:30.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:30.302+0000 7f51cc683640 1 --2- 172.21.15.2:0/2015814274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51c4102790 0x7f51c4102b70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f51c0009810 tx=0x7f51c002a540 comp rx=0 tx=0).stop 2024-09-19T06:06:30.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:30.302+0000 7f51cc683640 1 -- 172.21.15.2:0/2015814274 shutdown_connections 2024-09-19T06:06:30.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:30.302+0000 7f51cc683640 1 --2- 172.21.15.2:0/2015814274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51c4102790 0x7f51c4102b70 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:30.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:30.302+0000 7f51cc683640 1 -- 172.21.15.2:0/2015814274 >> 172.21.15.2:0/2015814274 conn(0x7f51c4077310 msgr2=0x7f51c40fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:30.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:30.302+0000 7f51cc683640 1 -- 172.21.15.2:0/2015814274 shutdown_connections 2024-09-19T06:06:30.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:30.302+0000 7f51cc683640 1 -- 172.21.15.2:0/2015814274 wait complete. 2024-09-19T06:06:30.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:30.303+0000 7f51cc683640 1 Processor -- start 2024-09-19T06:06:30.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:30.303+0000 7f51cc683640 1 -- start start 2024-09-19T06:06:30.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:30.303+0000 7f51cc683640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51c4102790 0x7f51c41003f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:30.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:30.303+0000 7f51cc683640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f51c410bb30 con 0x7f51c4102790 2024-09-19T06:06:30.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:30.303+0000 7f51ca41f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51c4102790 0x7f51c41003f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:30.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:30.303+0000 7f51ca41f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51c4102790 0x7f51c41003f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44720/0 (socket says 172.21.15.2:44720) 2024-09-19T06:06:30.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:30.303+0000 7f51ca41f640 1 -- 172.21.15.2:0/3558460215 learned_addr learned my addr 172.21.15.2:0/3558460215 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:06:30.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:30.304+0000 7f51ca41f640 1 -- 172.21.15.2:0/3558460215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51c41022e0 con 0x7f51c4102790 2024-09-19T06:06:30.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:30.304+0000 7f51ca41f640 1 --2- 172.21.15.2:0/3558460215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51c4102790 0x7f51c41003f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f51c0030b00 tx=0x7f51c0030b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:30.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:30.304+0000 7f51bb7fe640 1 -- 172.21.15.2:0/3558460215 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51c0040070 con 0x7f51c4102790 2024-09-19T06:06:30.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:30.304+0000 7f51bb7fe640 1 -- 172.21.15.2:0/3558460215 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f51c00318b0 con 0x7f51c4102790 2024-09-19T06:06:30.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:30.304+0000 7f51cc683640 1 -- 172.21.15.2:0/3558460215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51c4100930 con 0x7f51c4102790 2024-09-19T06:06:30.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:30.304+0000 7f51bb7fe640 1 -- 172.21.15.2:0/3558460215 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51c0003de0 con 0x7f51c4102790 2024-09-19T06:06:30.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:30.304+0000 7f51cc683640 1 -- 172.21.15.2:0/3558460215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51c4100df0 con 0x7f51c4102790 2024-09-19T06:06:30.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:30.305+0000 7f51bb7fe640 1 -- 172.21.15.2:0/3558460215 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f51c0039040 con 0x7f51c4102790 2024-09-19T06:06:30.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:30.305+0000 7f51cc683640 1 -- 172.21.15.2:0/3558460215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51c4069f30 con 0x7f51c4102790 2024-09-19T06:06:30.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:30.305+0000 7f51bb7fe640 1 --2- 172.21.15.2:0/3558460215 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f51b0039300 0x7f51b003b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:30.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:30.305+0000 7f51bb7fe640 1 -- 172.21.15.2:0/3558460215 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f51c006d7a0 con 0x7f51c4102790 2024-09-19T06:06:30.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:30.305+0000 7f51c9c1e640 1 --2- 172.21.15.2:0/3558460215 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f51b0039300 0x7f51b003b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:30.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:30.306+0000 7f51c9c1e640 1 --2- 172.21.15.2:0/3558460215 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f51b0039300 0x7f51b003b7c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f51b40098c0 tx=0x7f51b4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:30.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:30.310+0000 7f51bb7fe640 1 -- 172.21.15.2:0/3558460215 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f51c0043c00 con 0x7f51c4102790 2024-09-19T06:06:30.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:30.494+0000 7f51cc683640 1 -- 172.21.15.2:0/3558460215 --> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f51c4101920 con 0x7f51b0039300 2024-09-19T06:06:30.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:30.495+0000 7f51bb7fe640 1 -- 172.21.15.2:0/3558460215 <== mgr.14150 v2:172.21.15.2:6800/4180340554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+158 (secure 0 0 0) 0x7f51c4101920 con 0x7f51b0039300 2024-09-19T06:06:30.497 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:06:30.497 INFO:teuthology.orchestra.run.smithi002.stdout:[{"addr": "172.21.15.2", "hostname": "smithi002", "labels": [], "status": ""}, {"addr": "172.21.15.89", "hostname": "smithi089", "labels": [], "status": ""}] 2024-09-19T06:06:30.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:30.497+0000 7f51cc683640 1 -- 172.21.15.2:0/3558460215 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f51b0039300 msgr2=0x7f51b003b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:30.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:30.497+0000 7f51cc683640 1 --2- 172.21.15.2:0/3558460215 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f51b0039300 0x7f51b003b7c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f51b40098c0 tx=0x7f51b4006db0 comp rx=0 tx=0).stop 2024-09-19T06:06:30.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:30.497+0000 7f51cc683640 1 -- 172.21.15.2:0/3558460215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51c4102790 msgr2=0x7f51c41003f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:30.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:30.497+0000 7f51cc683640 1 --2- 172.21.15.2:0/3558460215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51c4102790 0x7f51c41003f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f51c0030b00 tx=0x7f51c0030b30 comp rx=0 tx=0).stop 2024-09-19T06:06:30.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:30.497+0000 7f51cc683640 1 -- 172.21.15.2:0/3558460215 shutdown_connections 2024-09-19T06:06:30.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:30.497+0000 7f51cc683640 1 --2- 172.21.15.2:0/3558460215 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f51b0039300 0x7f51b003b7c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:30.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:30.497+0000 7f51cc683640 1 --2- 172.21.15.2:0/3558460215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51c4102790 0x7f51c41003f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:30.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:30.497+0000 7f51cc683640 1 -- 172.21.15.2:0/3558460215 >> 172.21.15.2:0/3558460215 conn(0x7f51c4077310 msgr2=0x7f51c4103510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:30.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:30.498+0000 7f51cc683640 1 -- 172.21.15.2:0/3558460215 shutdown_connections 2024-09-19T06:06:30.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:30.498+0000 7f51cc683640 1 -- 172.21.15.2:0/3558460215 wait complete. 2024-09-19T06:06:31.074 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi090 2024-09-19T06:06:31.075 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-19T06:06:31.075 DEBUG:teuthology.orchestra.run.smithi090:> dd of=/etc/ceph/ceph.conf 2024-09-19T06:06:31.097 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-19T06:06:31.098 DEBUG:teuthology.orchestra.run.smithi090:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:06:31.156 INFO:tasks.cephadm:Adding host smithi090 to orchestrator... 2024-09-19T06:06:31.156 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph orch host add smithi090 2024-09-19T06:06:31.422 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:31.644 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:31 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:31.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:31 smithi002 ceph-mon[30982]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:06:31.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:31.867+0000 7f7b3e270640 1 -- 172.21.15.2:0/3624770455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b38106560 msgr2=0x7f7b38106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:31.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:31.867+0000 7f7b3e270640 1 --2- 172.21.15.2:0/3624770455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b38106560 0x7f7b38106940 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7b28009880 tx=0x7f7b2802a5d0 comp rx=0 tx=0).stop 2024-09-19T06:06:31.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:31.867+0000 7f7b3e270640 1 -- 172.21.15.2:0/3624770455 shutdown_connections 2024-09-19T06:06:31.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:31.867+0000 7f7b3e270640 1 --2- 172.21.15.2:0/3624770455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b38106560 0x7f7b38106940 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:31.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:31.867+0000 7f7b3e270640 1 -- 172.21.15.2:0/3624770455 >> 172.21.15.2:0/3624770455 conn(0x7f7b380fc1b0 msgr2=0x7f7b380fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:31.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:31.867+0000 7f7b3e270640 1 -- 172.21.15.2:0/3624770455 shutdown_connections 2024-09-19T06:06:31.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:31.867+0000 7f7b3e270640 1 -- 172.21.15.2:0/3624770455 wait complete. 2024-09-19T06:06:31.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:31.868+0000 7f7b3e270640 1 Processor -- start 2024-09-19T06:06:31.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:31.868+0000 7f7b3e270640 1 -- start start 2024-09-19T06:06:31.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:31.868+0000 7f7b3e270640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b38106560 0x7f7b38197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:31.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:31.868+0000 7f7b3e270640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7b3810aa40 con 0x7f7b38106560 2024-09-19T06:06:31.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:31.868+0000 7f7b37fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b38106560 0x7f7b38197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:31.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:31.868+0000 7f7b37fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b38106560 0x7f7b38197e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44730/0 (socket says 172.21.15.2:44730) 2024-09-19T06:06:31.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:31.868+0000 7f7b37fff640 1 -- 172.21.15.2:0/2671630584 learned_addr learned my addr 172.21.15.2:0/2671630584 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:06:31.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:31.869+0000 7f7b37fff640 1 -- 172.21.15.2:0/2671630584 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b38198390 con 0x7f7b38106560 2024-09-19T06:06:31.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:31.869+0000 7f7b37fff640 1 --2- 172.21.15.2:0/2671630584 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b38106560 0x7f7b38197e50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7b28009230 tx=0x7f7b280048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:31.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:31.869+0000 7f7b357fa640 1 -- 172.21.15.2:0/2671630584 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b2803f070 con 0x7f7b38106560 2024-09-19T06:06:31.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:31.869+0000 7f7b357fa640 1 -- 172.21.15.2:0/2671630584 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7b28004d10 con 0x7f7b38106560 2024-09-19T06:06:31.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:31.869+0000 7f7b3e270640 1 -- 172.21.15.2:0/2671630584 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b38198620 con 0x7f7b38106560 2024-09-19T06:06:31.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:31.869+0000 7f7b357fa640 1 -- 172.21.15.2:0/2671630584 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b28035030 con 0x7f7b38106560 2024-09-19T06:06:31.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:31.869+0000 7f7b3e270640 1 -- 172.21.15.2:0/2671630584 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b38198a80 con 0x7f7b38106560 2024-09-19T06:06:31.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:31.870+0000 7f7b357fa640 1 -- 172.21.15.2:0/2671630584 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f7b28042070 con 0x7f7b38106560 2024-09-19T06:06:31.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:31.870+0000 7f7b3e270640 1 -- 172.21.15.2:0/2671630584 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b38101bd0 con 0x7f7b38106560 2024-09-19T06:06:31.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:31.870+0000 7f7b357fa640 1 --2- 172.21.15.2:0/2671630584 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f7b200392a0 0x7f7b2003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:31.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:31.870+0000 7f7b357fa640 1 -- 172.21.15.2:0/2671630584 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f7b2806cfc0 con 0x7f7b38106560 2024-09-19T06:06:31.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:31.870+0000 7f7b377fe640 1 --2- 172.21.15.2:0/2671630584 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f7b200392a0 0x7f7b2003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:31.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:31.871+0000 7f7b377fe640 1 --2- 172.21.15.2:0/2671630584 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f7b200392a0 0x7f7b2003b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c0098c0 tx=0x7f7b2c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:31.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:31.875+0000 7f7b357fa640 1 -- 172.21.15.2:0/2671630584 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7b28042360 con 0x7f7b38106560 2024-09-19T06:06:32.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:32.071+0000 7f7b3e270640 1 -- 172.21.15.2:0/2671630584 --> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi090", "target": ["mon-mgr", ""]}) -- 0x7f7b381069c0 con 0x7f7b200392a0 2024-09-19T06:06:33.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:32 smithi002 ceph-mon[30982]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:06:33.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:32 smithi002 ceph-mon[30982]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi090", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:06:34.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:34 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:34.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:34 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:34.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:34 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:34.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:34 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:34.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:34 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi089", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:06:34.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:34 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:06:34.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:34 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:06:34.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:34 smithi002 ceph-mon[30982]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-19T06:06:34.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:34 smithi002 ceph-mon[30982]: Deploying cephadm binary to smithi090 2024-09-19T06:06:34.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:34 smithi002 ceph-mon[30982]: Updating smithi089:/var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:06:34.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:34 smithi002 ceph-mon[30982]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:06:34.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:34 smithi002 ceph-mon[30982]: Updating smithi089:/var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:06:34.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:34 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:34.474 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:34 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:34.474 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:34 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:35.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:35 smithi002 ceph-mon[30982]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:06:35.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:35.897+0000 7f7b357fa640 1 -- 172.21.15.2:0/2671630584 <== mgr.14150 v2:172.21.15.2:6800/4180340554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f7b381069c0 con 0x7f7b200392a0 2024-09-19T06:06:35.899 INFO:teuthology.orchestra.run.smithi002.stdout:Added host 'smithi090' with addr '172.21.15.90' 2024-09-19T06:06:35.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:35.899+0000 7f7b3e270640 1 -- 172.21.15.2:0/2671630584 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f7b200392a0 msgr2=0x7f7b2003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:35.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:35.899+0000 7f7b3e270640 1 --2- 172.21.15.2:0/2671630584 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f7b200392a0 0x7f7b2003b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c0098c0 tx=0x7f7b2c006db0 comp rx=0 tx=0).stop 2024-09-19T06:06:35.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:35.899+0000 7f7b3e270640 1 -- 172.21.15.2:0/2671630584 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b38106560 msgr2=0x7f7b38197e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:35.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:35.899+0000 7f7b3e270640 1 --2- 172.21.15.2:0/2671630584 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b38106560 0x7f7b38197e50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7b28009230 tx=0x7f7b280048f0 comp rx=0 tx=0).stop 2024-09-19T06:06:35.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:35.899+0000 7f7b3e270640 1 -- 172.21.15.2:0/2671630584 shutdown_connections 2024-09-19T06:06:35.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:35.899+0000 7f7b3e270640 1 --2- 172.21.15.2:0/2671630584 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f7b200392a0 0x7f7b2003b760 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:35.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:35.899+0000 7f7b3e270640 1 --2- 172.21.15.2:0/2671630584 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b38106560 0x7f7b38197e50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:35.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:35.899+0000 7f7b3e270640 1 -- 172.21.15.2:0/2671630584 >> 172.21.15.2:0/2671630584 conn(0x7f7b380fc1b0 msgr2=0x7f7b380fdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:35.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:35.899+0000 7f7b3e270640 1 -- 172.21.15.2:0/2671630584 shutdown_connections 2024-09-19T06:06:35.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:35.899+0000 7f7b3e270640 1 -- 172.21.15.2:0/2671630584 wait complete. 2024-09-19T06:06:36.502 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T06:06:36.753 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:37.183 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:36 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:37.183 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:36 smithi002 ceph-mon[30982]: Added host smithi090 2024-09-19T06:06:37.184 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:36 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:06:37.184 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:36 smithi002 ceph-mon[30982]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:06:37.184 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:36 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:37.184 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:36 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:37.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:37.189+0000 7f326f2e8640 1 -- 172.21.15.2:0/355920663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32681027d0 msgr2=0x7f3268102bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:37.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:37.189+0000 7f326f2e8640 1 --2- 172.21.15.2:0/355920663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32681027d0 0x7f3268102bb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3260009c20 tx=0x7f326002ab20 comp rx=0 tx=0).stop 2024-09-19T06:06:37.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:37.189+0000 7f326f2e8640 1 -- 172.21.15.2:0/355920663 shutdown_connections 2024-09-19T06:06:37.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:37.189+0000 7f326f2e8640 1 --2- 172.21.15.2:0/355920663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32681027d0 0x7f3268102bb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:37.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:37.189+0000 7f326f2e8640 1 -- 172.21.15.2:0/355920663 >> 172.21.15.2:0/355920663 conn(0x7f32680fc190 msgr2=0x7f32680fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:37.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:37.189+0000 7f326f2e8640 1 -- 172.21.15.2:0/355920663 shutdown_connections 2024-09-19T06:06:37.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:37.189+0000 7f326f2e8640 1 -- 172.21.15.2:0/355920663 wait complete. 2024-09-19T06:06:37.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:37.190+0000 7f326f2e8640 1 Processor -- start 2024-09-19T06:06:37.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:37.190+0000 7f326f2e8640 1 -- start start 2024-09-19T06:06:37.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:37.190+0000 7f326f2e8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32681027d0 0x7f3268100430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:37.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:37.190+0000 7f326f2e8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f326810bb60 con 0x7f32681027d0 2024-09-19T06:06:37.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:37.190+0000 7f326d084640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32681027d0 0x7f3268100430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:37.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:37.190+0000 7f326d084640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32681027d0 0x7f3268100430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39940/0 (socket says 172.21.15.2:39940) 2024-09-19T06:06:37.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:37.190+0000 7f326d084640 1 -- 172.21.15.2:0/4092408808 learned_addr learned my addr 172.21.15.2:0/4092408808 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:06:37.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:37.191+0000 7f326d084640 1 -- 172.21.15.2:0/4092408808 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3268102320 con 0x7f32681027d0 2024-09-19T06:06:37.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:37.191+0000 7f326d084640 1 --2- 172.21.15.2:0/4092408808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32681027d0 0x7f3268100430 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f326002e890 tx=0x7f326002e8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:37.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:37.191+0000 7f32667fc640 1 -- 172.21.15.2:0/4092408808 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3260047070 con 0x7f32681027d0 2024-09-19T06:06:37.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:37.191+0000 7f32667fc640 1 -- 172.21.15.2:0/4092408808 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f326002eb30 con 0x7f32681027d0 2024-09-19T06:06:37.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:37.191+0000 7f326f2e8640 1 -- 172.21.15.2:0/4092408808 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3268100970 con 0x7f32681027d0 2024-09-19T06:06:37.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:37.191+0000 7f32667fc640 1 -- 172.21.15.2:0/4092408808 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32600045b0 con 0x7f32681027d0 2024-09-19T06:06:37.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:37.191+0000 7f326f2e8640 1 -- 172.21.15.2:0/4092408808 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3268100e30 con 0x7f32681027d0 2024-09-19T06:06:37.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:37.192+0000 7f32667fc640 1 -- 172.21.15.2:0/4092408808 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f326004a070 con 0x7f32681027d0 2024-09-19T06:06:37.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:37.192+0000 7f326f2e8640 1 -- 172.21.15.2:0/4092408808 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f326806a730 con 0x7f32681027d0 2024-09-19T06:06:37.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:37.192+0000 7f32667fc640 1 --2- 172.21.15.2:0/4092408808 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f32500392a0 0x7f325003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:37.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:37.192+0000 7f32667fc640 1 -- 172.21.15.2:0/4092408808 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f326003d030 con 0x7f32681027d0 2024-09-19T06:06:37.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:37.192+0000 7f326c883640 1 --2- 172.21.15.2:0/4092408808 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f32500392a0 0x7f325003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:37.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:37.193+0000 7f326c883640 1 --2- 172.21.15.2:0/4092408808 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f32500392a0 0x7f325003b760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f325c0098c0 tx=0x7f325c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:37.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:37.197+0000 7f32667fc640 1 -- 172.21.15.2:0/4092408808 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3260032030 con 0x7f32681027d0 2024-09-19T06:06:37.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:37.382+0000 7f326f2e8640 1 -- 172.21.15.2:0/4092408808 --> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3268101960 con 0x7f32500392a0 2024-09-19T06:06:37.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:37.383+0000 7f32667fc640 1 -- 172.21.15.2:0/4092408808 <== mgr.14150 v2:172.21.15.2:6800/4180340554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+237 (secure 0 0 0) 0x7f3268101960 con 0x7f32500392a0 2024-09-19T06:06:37.386 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:06:37.386 INFO:teuthology.orchestra.run.smithi002.stdout:[{"addr": "172.21.15.2", "hostname": "smithi002", "labels": [], "status": ""}, {"addr": "172.21.15.89", "hostname": "smithi089", "labels": [], "status": ""}, {"addr": "172.21.15.90", "hostname": "smithi090", "labels": [], "status": ""}] 2024-09-19T06:06:37.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:37.385+0000 7f326f2e8640 1 -- 172.21.15.2:0/4092408808 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f32500392a0 msgr2=0x7f325003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:37.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:37.385+0000 7f326f2e8640 1 --2- 172.21.15.2:0/4092408808 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f32500392a0 0x7f325003b760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f325c0098c0 tx=0x7f325c006db0 comp rx=0 tx=0).stop 2024-09-19T06:06:37.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:37.385+0000 7f326f2e8640 1 -- 172.21.15.2:0/4092408808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32681027d0 msgr2=0x7f3268100430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:37.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:37.385+0000 7f326f2e8640 1 --2- 172.21.15.2:0/4092408808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32681027d0 0x7f3268100430 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f326002e890 tx=0x7f326002e8c0 comp rx=0 tx=0).stop 2024-09-19T06:06:37.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:37.385+0000 7f326f2e8640 1 -- 172.21.15.2:0/4092408808 shutdown_connections 2024-09-19T06:06:37.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:37.385+0000 7f326f2e8640 1 --2- 172.21.15.2:0/4092408808 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f32500392a0 0x7f325003b760 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:37.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:37.385+0000 7f326f2e8640 1 --2- 172.21.15.2:0/4092408808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32681027d0 0x7f3268100430 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:37.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:37.385+0000 7f326f2e8640 1 -- 172.21.15.2:0/4092408808 >> 172.21.15.2:0/4092408808 conn(0x7f32680fc190 msgr2=0x7f3268105590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:37.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:37.385+0000 7f326f2e8640 1 -- 172.21.15.2:0/4092408808 shutdown_connections 2024-09-19T06:06:37.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:37.385+0000 7f326f2e8640 1 -- 172.21.15.2:0/4092408808 wait complete. 2024-09-19T06:06:37.949 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-19T06:06:37.949 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-19T06:06:38.199 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:38.530 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:38 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:38.531 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:38 smithi002 ceph-mon[30982]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:06:38.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:38.613+0000 7fd6e530c640 1 -- 172.21.15.2:0/779975452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6e0074510 msgr2=0x7fd6e00748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:38.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:38.613+0000 7fd6e530c640 1 --2- 172.21.15.2:0/779975452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6e0074510 0x7fd6e00748f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0009880 tx=0x7fd6d002a670 comp rx=0 tx=0).stop 2024-09-19T06:06:38.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:38.614+0000 7fd6e530c640 1 -- 172.21.15.2:0/779975452 shutdown_connections 2024-09-19T06:06:38.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:38.614+0000 7fd6e530c640 1 --2- 172.21.15.2:0/779975452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6e0074510 0x7fd6e00748f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:38.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:38.614+0000 7fd6e530c640 1 -- 172.21.15.2:0/779975452 >> 172.21.15.2:0/779975452 conn(0x7fd6e00fd290 msgr2=0x7fd6e00ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:38.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:38.614+0000 7fd6e530c640 1 -- 172.21.15.2:0/779975452 shutdown_connections 2024-09-19T06:06:38.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:38.614+0000 7fd6e530c640 1 -- 172.21.15.2:0/779975452 wait complete. 2024-09-19T06:06:38.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:38.614+0000 7fd6e530c640 1 Processor -- start 2024-09-19T06:06:38.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:38.614+0000 7fd6e530c640 1 -- start start 2024-09-19T06:06:38.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:38.615+0000 7fd6e530c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6e0074510 0x7fd6e01992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:38.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:38.615+0000 7fd6e530c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e010dd50 con 0x7fd6e0074510 2024-09-19T06:06:38.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:38.615+0000 7fd6deffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6e0074510 0x7fd6e01992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:38.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:38.615+0000 7fd6deffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6e0074510 0x7fd6e01992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39958/0 (socket says 172.21.15.2:39958) 2024-09-19T06:06:38.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:38.615+0000 7fd6deffd640 1 -- 172.21.15.2:0/4058330673 learned_addr learned my addr 172.21.15.2:0/4058330673 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:06:38.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:38.615+0000 7fd6deffd640 1 -- 172.21.15.2:0/4058330673 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6e0199810 con 0x7fd6e0074510 2024-09-19T06:06:38.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:38.615+0000 7fd6deffd640 1 --2- 172.21.15.2:0/4058330673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6e0074510 0x7fd6e01992d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0009230 tx=0x7fd6d00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:38.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:38.615+0000 7fd6dcff9640 1 -- 172.21.15.2:0/4058330673 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6d003f070 con 0x7fd6e0074510 2024-09-19T06:06:38.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:38.615+0000 7fd6e530c640 1 -- 172.21.15.2:0/4058330673 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6e0199aa0 con 0x7fd6e0074510 2024-09-19T06:06:38.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:38.615+0000 7fd6dcff9640 1 -- 172.21.15.2:0/4058330673 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd6d0004d10 con 0x7fd6e0074510 2024-09-19T06:06:38.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:38.615+0000 7fd6dcff9640 1 -- 172.21.15.2:0/4058330673 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6d0035030 con 0x7fd6e0074510 2024-09-19T06:06:38.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:38.616+0000 7fd6e530c640 1 -- 172.21.15.2:0/4058330673 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6e0199f00 con 0x7fd6e0074510 2024-09-19T06:06:38.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:38.617+0000 7fd6dcff9640 1 -- 172.21.15.2:0/4058330673 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fd6d0042070 con 0x7fd6e0074510 2024-09-19T06:06:38.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:38.617+0000 7fd6e530c640 1 -- 172.21.15.2:0/4058330673 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6e0075c50 con 0x7fd6e0074510 2024-09-19T06:06:38.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:38.617+0000 7fd6dcff9640 1 --2- 172.21.15.2:0/4058330673 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fd6cc0392a0 0x7fd6cc03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:38.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:38.617+0000 7fd6dcff9640 1 -- 172.21.15.2:0/4058330673 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd6d006d0f0 con 0x7fd6e0074510 2024-09-19T06:06:38.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:38.617+0000 7fd6d7fff640 1 --2- 172.21.15.2:0/4058330673 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fd6cc0392a0 0x7fd6cc03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:38.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:38.617+0000 7fd6d7fff640 1 --2- 172.21.15.2:0/4058330673 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fd6cc0392a0 0x7fd6cc03b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd6c80098c0 tx=0x7fd6c8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:38.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:38.622+0000 7fd6dcff9640 1 -- 172.21.15.2:0/4058330673 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd6d00303a0 con 0x7fd6e0074510 2024-09-19T06:06:38.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:38.805+0000 7fd6e530c640 1 -- 172.21.15.2:0/4058330673 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fd6e019a630 con 0x7fd6e0074510 2024-09-19T06:06:39.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:39.256+0000 7fd6dcff9640 1 -- 172.21.15.2:0/4058330673 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7fd6d0031400 con 0x7fd6e0074510 2024-09-19T06:06:39.258 INFO:teuthology.orchestra.run.smithi002.stderr:adjusted tunables profile to default 2024-09-19T06:06:39.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:39.259+0000 7fd6e530c640 1 -- 172.21.15.2:0/4058330673 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fd6cc0392a0 msgr2=0x7fd6cc03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:39.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:39.259+0000 7fd6e530c640 1 --2- 172.21.15.2:0/4058330673 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fd6cc0392a0 0x7fd6cc03b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd6c80098c0 tx=0x7fd6c8006db0 comp rx=0 tx=0).stop 2024-09-19T06:06:39.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:39.259+0000 7fd6e530c640 1 -- 172.21.15.2:0/4058330673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6e0074510 msgr2=0x7fd6e01992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:39.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:39.259+0000 7fd6e530c640 1 --2- 172.21.15.2:0/4058330673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6e0074510 0x7fd6e01992d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0009230 tx=0x7fd6d00048f0 comp rx=0 tx=0).stop 2024-09-19T06:06:39.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:39.259+0000 7fd6e530c640 1 -- 172.21.15.2:0/4058330673 shutdown_connections 2024-09-19T06:06:39.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:39.259+0000 7fd6e530c640 1 --2- 172.21.15.2:0/4058330673 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fd6cc0392a0 0x7fd6cc03b760 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:39.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:39.259+0000 7fd6e530c640 1 --2- 172.21.15.2:0/4058330673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6e0074510 0x7fd6e01992d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:39.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:39.259+0000 7fd6e530c640 1 -- 172.21.15.2:0/4058330673 >> 172.21.15.2:0/4058330673 conn(0x7fd6e00fd290 msgr2=0x7fd6e01078c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:39.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:39.259+0000 7fd6e530c640 1 -- 172.21.15.2:0/4058330673 shutdown_connections 2024-09-19T06:06:39.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:06:39.259+0000 7fd6e530c640 1 -- 172.21.15.2:0/4058330673 wait complete. 2024-09-19T06:06:39.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:39 smithi002 ceph-mon[30982]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:06:39.560 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:39 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/4058330673' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T06:06:39.853 INFO:tasks.cephadm:Adding mon.a on smithi002 2024-09-19T06:06:39.853 INFO:tasks.cephadm:Adding mon.b on smithi089 2024-09-19T06:06:39.854 INFO:tasks.cephadm:Adding mon.c on smithi090 2024-09-19T06:06:39.854 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi002:172.21.15.2=a;smithi089:172.21.15.89=b;smithi090:172.21.15.90=c' 2024-09-19T06:06:40.100 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T06:06:40.145 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T06:06:40.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:40.586+0000 7f78ff773640 1 -- 172.21.15.90:0/3767067106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78f80fff20 msgr2=0x7f78f8100320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:40.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:40.586+0000 7f78ff773640 1 --2- 172.21.15.90:0/3767067106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78f80fff20 0x7f78f8100320 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f78f4009880 tx=0x7f78f402a5d0 comp rx=0 tx=0).stop 2024-09-19T06:06:40.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:40.587+0000 7f78ff773640 1 -- 172.21.15.90:0/3767067106 shutdown_connections 2024-09-19T06:06:40.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:40.587+0000 7f78ff773640 1 --2- 172.21.15.90:0/3767067106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78f80fff20 0x7f78f8100320 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:40.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:40.587+0000 7f78ff773640 1 -- 172.21.15.90:0/3767067106 >> 172.21.15.90:0/3767067106 conn(0x7f78f80fbcd0 msgr2=0x7f78f80fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:40.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:40.587+0000 7f78ff773640 1 -- 172.21.15.90:0/3767067106 shutdown_connections 2024-09-19T06:06:40.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:40.587+0000 7f78ff773640 1 -- 172.21.15.90:0/3767067106 wait complete. 2024-09-19T06:06:40.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:40.587+0000 7f78ff773640 1 Processor -- start 2024-09-19T06:06:40.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:40.587+0000 7f78ff773640 1 -- start start 2024-09-19T06:06:40.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:40.587+0000 7f78ff773640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78f80fff20 0x7f78f8198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:40.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:40.587+0000 7f78ff773640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f78f8109780 con 0x7f78f80fff20 2024-09-19T06:06:40.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:40.588+0000 7f78fd50f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78f80fff20 0x7f78f8198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:40.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:40.588+0000 7f78fd50f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78f80fff20 0x7f78f8198ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.90:60092/0 (socket says 172.21.15.90:60092) 2024-09-19T06:06:40.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:40.588+0000 7f78fd50f640 1 -- 172.21.15.90:0/2250096531 learned_addr learned my addr 172.21.15.90:0/2250096531 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-19T06:06:40.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:40.588+0000 7f78fd50f640 1 -- 172.21.15.90:0/2250096531 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78f81993e0 con 0x7f78f80fff20 2024-09-19T06:06:40.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:40.588+0000 7f78fd50f640 1 --2- 172.21.15.90:0/2250096531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78f80fff20 0x7f78f8198ea0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f78f4009230 tx=0x7f78f40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:40.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:40.588+0000 7f78ee7fc640 1 -- 172.21.15.90:0/2250096531 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78f403f070 con 0x7f78f80fff20 2024-09-19T06:06:40.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:40.588+0000 7f78ff773640 1 -- 172.21.15.90:0/2250096531 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78f8199670 con 0x7f78f80fff20 2024-09-19T06:06:40.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:40.588+0000 7f78ee7fc640 1 -- 172.21.15.90:0/2250096531 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f78f4003aa0 con 0x7f78f80fff20 2024-09-19T06:06:40.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:40.588+0000 7f78ee7fc640 1 -- 172.21.15.90:0/2250096531 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78f4035030 con 0x7f78f80fff20 2024-09-19T06:06:40.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:40.588+0000 7f78ff773640 1 -- 172.21.15.90:0/2250096531 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78f819c360 con 0x7f78f80fff20 2024-09-19T06:06:40.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:40.589+0000 7f78ee7fc640 1 -- 172.21.15.90:0/2250096531 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f78f4042070 con 0x7f78f80fff20 2024-09-19T06:06:40.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:40.589+0000 7f78ff773640 1 -- 172.21.15.90:0/2250096531 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78f8109f00 con 0x7f78f80fff20 2024-09-19T06:06:40.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:40.589+0000 7f78ee7fc640 1 --2- 172.21.15.90:0/2250096531 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f78e4039300 0x7f78e403b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:40.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:40.590+0000 7f78ee7fc640 1 -- 172.21.15.90:0/2250096531 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f78f406d030 con 0x7f78f80fff20 2024-09-19T06:06:40.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:40.590+0000 7f78fcd0e640 1 --2- 172.21.15.90:0/2250096531 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f78e4039300 0x7f78e403b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:40.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:40.590+0000 7f78fcd0e640 1 --2- 172.21.15.90:0/2250096531 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f78e4039300 0x7f78e403b7c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f78e80098c0 tx=0x7f78e8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:40.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:40.595+0000 7f78ee7fc640 1 -- 172.21.15.90:0/2250096531 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f78f404a260 con 0x7f78f80fff20 2024-09-19T06:06:40.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:40 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/4058330673' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T06:06:40.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:40 smithi002 ceph-mon[30982]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:06:40.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:40 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:40.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:40 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:40.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:40 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:40.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:40 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:40.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:40 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi090", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:06:40.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:40 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:06:40.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:40 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:06:40.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:40.783+0000 7f78ff773640 1 -- 172.21.15.90:0/2250096531 --> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi002:172.21.15.2=a;smithi089:172.21.15.89=b;smithi090:172.21.15.90=c", "target": ["mon-mgr", ""]}) -- 0x7f78f802d8e0 con 0x7f78e4039300 2024-09-19T06:06:40.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:40.788+0000 7f78ee7fc640 1 -- 172.21.15.90:0/2250096531 <== mgr.14150 v2:172.21.15.2:6800/4180340554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f78f802d8e0 con 0x7f78e4039300 2024-09-19T06:06:40.790 INFO:teuthology.orchestra.run.smithi090.stdout:Scheduled mon update... 2024-09-19T06:06:40.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:40.790+0000 7f78ff773640 1 -- 172.21.15.90:0/2250096531 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f78e4039300 msgr2=0x7f78e403b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:40.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:40.790+0000 7f78ff773640 1 --2- 172.21.15.90:0/2250096531 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f78e4039300 0x7f78e403b7c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f78e80098c0 tx=0x7f78e8006db0 comp rx=0 tx=0).stop 2024-09-19T06:06:40.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:40.790+0000 7f78ff773640 1 -- 172.21.15.90:0/2250096531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78f80fff20 msgr2=0x7f78f8198ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:40.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:40.790+0000 7f78ff773640 1 --2- 172.21.15.90:0/2250096531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78f80fff20 0x7f78f8198ea0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f78f4009230 tx=0x7f78f40048f0 comp rx=0 tx=0).stop 2024-09-19T06:06:40.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:40.790+0000 7f78ff773640 1 -- 172.21.15.90:0/2250096531 shutdown_connections 2024-09-19T06:06:40.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:40.790+0000 7f78ff773640 1 --2- 172.21.15.90:0/2250096531 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f78e4039300 0x7f78e403b7c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:40.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:40.790+0000 7f78ff773640 1 --2- 172.21.15.90:0/2250096531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78f80fff20 0x7f78f8198ea0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:40.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:40.790+0000 7f78ff773640 1 -- 172.21.15.90:0/2250096531 >> 172.21.15.90:0/2250096531 conn(0x7f78f80fbcd0 msgr2=0x7f78f80fc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:40.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:40.791+0000 7f78ff773640 1 -- 172.21.15.90:0/2250096531 shutdown_connections 2024-09-19T06:06:40.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:40.791+0000 7f78ff773640 1 -- 172.21.15.90:0/2250096531 wait complete. 2024-09-19T06:06:41.420 DEBUG:teuthology.orchestra.run.smithi089:mon.b> sudo journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@mon.b.service 2024-09-19T06:06:41.423 DEBUG:teuthology.orchestra.run.smithi090:mon.c> sudo journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@mon.c.service 2024-09-19T06:06:41.426 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T06:06:41.426 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T06:06:42.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:41 smithi002 ceph-mon[30982]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:06:42.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:41 smithi002 ceph-mon[30982]: Updating smithi090:/etc/ceph/ceph.conf 2024-09-19T06:06:42.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:41 smithi002 ceph-mon[30982]: Updating smithi090:/var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:06:42.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:41 smithi002 ceph-mon[30982]: Updating smithi090:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:06:42.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:41 smithi002 ceph-mon[30982]: Updating smithi090:/var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:06:42.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:41 smithi002 ceph-mon[30982]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi002:172.21.15.2=a;smithi089:172.21.15.89=b;smithi090:172.21.15.90=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:06:42.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:41 smithi002 ceph-mon[30982]: Saving service mon spec with placement smithi002:172.21.15.2=a;smithi089:172.21.15.89=b;smithi090:172.21.15.90=c;count:3 2024-09-19T06:06:42.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:41 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:42.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:41 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:42.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:41 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:42.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:41 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:42.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:41 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:06:42.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:41 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:06:42.441 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:06:43.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:42 smithi002 ceph-mon[30982]: Deploying daemon mon.c on smithi090 2024-09-19T06:06:43.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:43.423+0000 7fc319f9c640 1 -- 172.21.15.90:0/4275034569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc314106540 msgr2=0x7fc314106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:43.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:43.423+0000 7fc319f9c640 1 --2- 172.21.15.90:0/4275034569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc314106540 0x7fc314106920 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc304009c10 tx=0x7fc30402aa10 comp rx=0 tx=0).stop 2024-09-19T06:06:43.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:43.423+0000 7fc319f9c640 1 -- 172.21.15.90:0/4275034569 shutdown_connections 2024-09-19T06:06:43.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:43.423+0000 7fc319f9c640 1 --2- 172.21.15.90:0/4275034569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc314106540 0x7fc314106920 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:43.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:43.423+0000 7fc319f9c640 1 -- 172.21.15.90:0/4275034569 >> 172.21.15.90:0/4275034569 conn(0x7fc314077310 msgr2=0x7fc3140fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:43.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:43.423+0000 7fc319f9c640 1 -- 172.21.15.90:0/4275034569 shutdown_connections 2024-09-19T06:06:43.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:43.424+0000 7fc319f9c640 1 -- 172.21.15.90:0/4275034569 wait complete. 2024-09-19T06:06:43.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:43.424+0000 7fc319f9c640 1 Processor -- start 2024-09-19T06:06:43.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:43.424+0000 7fc319f9c640 1 -- start start 2024-09-19T06:06:43.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:43.424+0000 7fc319f9c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc314106540 0x7fc3140fd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:43.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:43.424+0000 7fc319f9c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc31410aa20 con 0x7fc314106540 2024-09-19T06:06:43.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:43.425+0000 7fc3137fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc314106540 0x7fc3140fd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:43.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:43.425+0000 7fc3137fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc314106540 0x7fc3140fd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.90:60106/0 (socket says 172.21.15.90:60106) 2024-09-19T06:06:43.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:43.425+0000 7fc3137fe640 1 -- 172.21.15.90:0/1368664442 learned_addr learned my addr 172.21.15.90:0/1368664442 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-19T06:06:43.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:43.425+0000 7fc3137fe640 1 -- 172.21.15.90:0/1368664442 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3140ff2d0 con 0x7fc314106540 2024-09-19T06:06:43.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:43.425+0000 7fc3137fe640 1 --2- 172.21.15.90:0/1368664442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc314106540 0x7fc3140fd3e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc304005dd0 tx=0x7fc30402f980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:43.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:43.425+0000 7fc310ff9640 1 -- 172.21.15.90:0/1368664442 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc304034070 con 0x7fc314106540 2024-09-19T06:06:43.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:43.425+0000 7fc310ff9640 1 -- 172.21.15.90:0/1368664442 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc30402feb0 con 0x7fc314106540 2024-09-19T06:06:43.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:43.425+0000 7fc310ff9640 1 -- 172.21.15.90:0/1368664442 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc304004360 con 0x7fc314106540 2024-09-19T06:06:43.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:43.425+0000 7fc319f9c640 1 -- 172.21.15.90:0/1368664442 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3140fd920 con 0x7fc314106540 2024-09-19T06:06:43.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:43.426+0000 7fc319f9c640 1 -- 172.21.15.90:0/1368664442 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3140fdd80 con 0x7fc314106540 2024-09-19T06:06:43.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:43.426+0000 7fc310ff9640 1 -- 172.21.15.90:0/1368664442 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fc304037020 con 0x7fc314106540 2024-09-19T06:06:43.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:43.427+0000 7fc319f9c640 1 -- 172.21.15.90:0/1368664442 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc314101bb0 con 0x7fc314106540 2024-09-19T06:06:43.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:43.427+0000 7fc310ff9640 1 --2- 172.21.15.90:0/1368664442 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fc300039300 0x7fc30003b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:43.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:43.427+0000 7fc310ff9640 1 -- 172.21.15.90:0/1368664442 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc30406d390 con 0x7fc314106540 2024-09-19T06:06:43.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:43.427+0000 7fc312ffd640 1 --2- 172.21.15.90:0/1368664442 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fc300039300 0x7fc30003b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:43.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:43.427+0000 7fc312ffd640 1 --2- 172.21.15.90:0/1368664442 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fc300039300 0x7fc30003b7c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc0098c0 tx=0x7fc2fc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:43.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:43.432+0000 7fc310ff9640 1 -- 172.21.15.90:0/1368664442 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc30403f070 con 0x7fc314106540 2024-09-19T06:06:43.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:43.664+0000 7fc319f9c640 1 -- 172.21.15.90:0/1368664442 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fc3140fe910 con 0x7fc314106540 2024-09-19T06:06:43.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:43.665+0000 7fc310ff9640 1 -- 172.21.15.90:0/1368664442 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+741 (secure 0 0 0) 0x7fc30402c040 con 0x7fc314106540 2024-09-19T06:06:43.667 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-19T06:06:43.667 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":1,"fsid":"078f6612-764d-11ef-bceb-c7b262605968","modified":"2024-09-19T06:05:14.578448Z","created":"2024-09-19T06:05:14.578448Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T06:06:43.667 INFO:teuthology.orchestra.run.smithi090.stderr:dumped monmap epoch 1 2024-09-19T06:06:43.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:43.667+0000 7fc319f9c640 1 -- 172.21.15.90:0/1368664442 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fc300039300 msgr2=0x7fc30003b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:43.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:43.667+0000 7fc319f9c640 1 --2- 172.21.15.90:0/1368664442 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fc300039300 0x7fc30003b7c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc0098c0 tx=0x7fc2fc006db0 comp rx=0 tx=0).stop 2024-09-19T06:06:43.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:43.667+0000 7fc319f9c640 1 -- 172.21.15.90:0/1368664442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc314106540 msgr2=0x7fc3140fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:43.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:43.667+0000 7fc319f9c640 1 --2- 172.21.15.90:0/1368664442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc314106540 0x7fc3140fd3e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc304005dd0 tx=0x7fc30402f980 comp rx=0 tx=0).stop 2024-09-19T06:06:43.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:43.667+0000 7fc319f9c640 1 -- 172.21.15.90:0/1368664442 shutdown_connections 2024-09-19T06:06:43.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:43.667+0000 7fc319f9c640 1 --2- 172.21.15.90:0/1368664442 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fc300039300 0x7fc30003b7c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:43.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:43.667+0000 7fc319f9c640 1 --2- 172.21.15.90:0/1368664442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc314106540 0x7fc3140fd3e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:43.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:43.667+0000 7fc319f9c640 1 -- 172.21.15.90:0/1368664442 >> 172.21.15.90:0/1368664442 conn(0x7fc314077310 msgr2=0x7fc3140696b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:43.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:43.667+0000 7fc319f9c640 1 -- 172.21.15.90:0/1368664442 shutdown_connections 2024-09-19T06:06:43.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:43.667+0000 7fc319f9c640 1 -- 172.21.15.90:0/1368664442 wait complete. 2024-09-19T06:06:44.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:43 smithi002 ceph-mon[30982]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:06:44.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:43 smithi002 ceph-mon[30982]: from='client.? 172.21.15.90:0/1368664442' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:06:45.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 podman[34479]: 2024-09-19 06:06:45.065324353 +0000 UTC m=+0.016191204 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:06:45.483 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T06:06:45.484 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T06:06:45.731 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:06:45.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 podman[34479]: 2024-09-19 06:06:45.376766467 +0000 UTC m=+0.327633316 container init ddaf5a97aa8b1603dea8bd23e7da4bfe34d711bcb0817c8867252cb0c0529d78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mon-c, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS) 2024-09-19T06:06:45.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 podman[34479]: 2024-09-19 06:06:45.380218267 +0000 UTC m=+0.331085111 container start ddaf5a97aa8b1603dea8bd23e7da4bfe34d711bcb0817c8867252cb0c0529d78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mon-c, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-19T06:06:45.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T06:06:45.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T06:06:45.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: pidfile_write: ignore empty --pid-file 2024-09-19T06:06:45.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: load: jerasure load: lrc 2024-09-19T06:06:45.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: RocksDB version: 7.9.2 2024-09-19T06:06:45.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Git sha 0 2024-09-19T06:06:45.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T06:06:45.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: DB SUMMARY 2024-09-19T06:06:45.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: DB Session ID: AUMK8KJU68KB8KELXA6B 2024-09-19T06:06:45.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: CURRENT file: CURRENT 2024-09-19T06:06:45.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T06:06:45.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-19T06:06:45.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-19T06:06:45.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-19T06:06:45.742 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.error_if_exists: 0 2024-09-19T06:06:45.742 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.create_if_missing: 0 2024-09-19T06:06:45.742 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.paranoid_checks: 1 2024-09-19T06:06:45.742 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T06:06:45.742 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T06:06:45.742 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T06:06:45.742 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.env: 0x561735ee5940 2024-09-19T06:06:45.742 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T06:06:45.742 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.info_log: 0x5617376d16e0 2024-09-19T06:06:45.742 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T06:06:45.744 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.statistics: (nil) 2024-09-19T06:06:45.744 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.use_fsync: 0 2024-09-19T06:06:45.744 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.max_log_file_size: 0 2024-09-19T06:06:45.744 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T06:06:45.744 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T06:06:45.744 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T06:06:45.744 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T06:06:45.744 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.allow_fallocate: 1 2024-09-19T06:06:45.744 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T06:06:45.745 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T06:06:45.745 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.use_direct_reads: 0 2024-09-19T06:06:45.745 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T06:06:45.745 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T06:06:45.745 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.db_log_dir: 2024-09-19T06:06:45.745 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.wal_dir: 2024-09-19T06:06:45.745 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T06:06:45.745 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T06:06:45.745 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T06:06:45.745 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T06:06:45.745 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T06:06:45.745 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T06:06:45.745 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T06:06:45.746 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T06:06:45.746 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.write_buffer_manager: 0x5617376e0dc0 2024-09-19T06:06:45.746 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T06:06:45.746 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T06:06:45.746 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T06:06:45.746 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T06:06:45.746 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T06:06:45.746 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T06:06:45.746 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T06:06:45.746 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T06:06:45.746 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.unordered_write: 0 2024-09-19T06:06:45.746 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T06:06:45.747 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T06:06:45.747 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T06:06:45.747 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T06:06:45.747 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.row_cache: None 2024-09-19T06:06:45.747 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.wal_filter: None 2024-09-19T06:06:45.747 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T06:06:45.747 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T06:06:45.747 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.two_write_queues: 0 2024-09-19T06:06:45.747 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T06:06:45.747 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.wal_compression: 0 2024-09-19T06:06:45.747 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.atomic_flush: 0 2024-09-19T06:06:45.747 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T06:06:45.747 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T06:06:45.748 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T06:06:45.748 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.log_readahead_size: 0 2024-09-19T06:06:45.748 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T06:06:45.748 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T06:06:45.748 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T06:06:45.748 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T06:06:45.748 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T06:06:45.748 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T06:06:45.748 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T06:06:45.748 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.max_background_jobs: 2 2024-09-19T06:06:45.748 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.max_background_compactions: -1 2024-09-19T06:06:45.748 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.max_subcompactions: 1 2024-09-19T06:06:45.748 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T06:06:45.749 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T06:06:45.749 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T06:06:45.749 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T06:06:45.749 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T06:06:45.749 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T06:06:45.749 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T06:06:45.749 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T06:06:45.749 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.max_open_files: -1 2024-09-19T06:06:45.749 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T06:06:45.749 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T06:06:45.749 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T06:06:45.749 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T06:06:45.750 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.max_background_flushes: -1 2024-09-19T06:06:45.750 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Compression algorithms supported: 2024-09-19T06:06:45.750 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: kZSTD supported: 0 2024-09-19T06:06:45.750 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: kXpressCompression supported: 0 2024-09-19T06:06:45.750 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: kBZip2Compression supported: 0 2024-09-19T06:06:45.750 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T06:06:45.750 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: kLZ4Compression supported: 1 2024-09-19T06:06:45.750 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: kZlibCompression supported: 1 2024-09-19T06:06:45.750 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T06:06:45.750 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: kSnappyCompression supported: 1 2024-09-19T06:06:45.750 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T06:06:45.750 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T06:06:45.750 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-19T06:06:45.751 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T06:06:45.751 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T06:06:45.751 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.merge_operator: 2024-09-19T06:06:45.751 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.compaction_filter: None 2024-09-19T06:06:45.751 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T06:06:45.751 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T06:06:45.751 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T06:06:45.751 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T06:06:45.751 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5617376d1320) 2024-09-19T06:06:45.751 INFO:journalctl@ceph.mon.c.smithi090.stdout: cache_index_and_filter_blocks: 1 2024-09-19T06:06:45.751 INFO:journalctl@ceph.mon.c.smithi090.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T06:06:45.751 INFO:journalctl@ceph.mon.c.smithi090.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T06:06:45.751 INFO:journalctl@ceph.mon.c.smithi090.stdout: pin_top_level_index_and_filter: 1 2024-09-19T06:06:45.752 INFO:journalctl@ceph.mon.c.smithi090.stdout: index_type: 0 2024-09-19T06:06:45.752 INFO:journalctl@ceph.mon.c.smithi090.stdout: data_block_index_type: 0 2024-09-19T06:06:45.752 INFO:journalctl@ceph.mon.c.smithi090.stdout: index_shortening: 1 2024-09-19T06:06:45.752 INFO:journalctl@ceph.mon.c.smithi090.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T06:06:45.752 INFO:journalctl@ceph.mon.c.smithi090.stdout: checksum: 4 2024-09-19T06:06:45.752 INFO:journalctl@ceph.mon.c.smithi090.stdout: no_block_cache: 0 2024-09-19T06:06:45.752 INFO:journalctl@ceph.mon.c.smithi090.stdout: block_cache: 0x5617376c51f0 2024-09-19T06:06:45.752 INFO:journalctl@ceph.mon.c.smithi090.stdout: block_cache_name: BinnedLRUCache 2024-09-19T06:06:45.752 INFO:journalctl@ceph.mon.c.smithi090.stdout: block_cache_options: 2024-09-19T06:06:45.752 INFO:journalctl@ceph.mon.c.smithi090.stdout: capacity : 536870912 2024-09-19T06:06:45.752 INFO:journalctl@ceph.mon.c.smithi090.stdout: num_shard_bits : 4 2024-09-19T06:06:45.752 INFO:journalctl@ceph.mon.c.smithi090.stdout: strict_capacity_limit : 0 2024-09-19T06:06:45.752 INFO:journalctl@ceph.mon.c.smithi090.stdout: high_pri_pool_ratio: 0.000 2024-09-19T06:06:45.753 INFO:journalctl@ceph.mon.c.smithi090.stdout: block_cache_compressed: (nil) 2024-09-19T06:06:45.753 INFO:journalctl@ceph.mon.c.smithi090.stdout: persistent_cache: (nil) 2024-09-19T06:06:45.753 INFO:journalctl@ceph.mon.c.smithi090.stdout: block_size: 4096 2024-09-19T06:06:45.753 INFO:journalctl@ceph.mon.c.smithi090.stdout: block_size_deviation: 10 2024-09-19T06:06:45.753 INFO:journalctl@ceph.mon.c.smithi090.stdout: block_restart_interval: 16 2024-09-19T06:06:45.753 INFO:journalctl@ceph.mon.c.smithi090.stdout: index_block_restart_interval: 1 2024-09-19T06:06:45.753 INFO:journalctl@ceph.mon.c.smithi090.stdout: metadata_block_size: 4096 2024-09-19T06:06:45.753 INFO:journalctl@ceph.mon.c.smithi090.stdout: partition_filters: 0 2024-09-19T06:06:45.753 INFO:journalctl@ceph.mon.c.smithi090.stdout: use_delta_encoding: 1 2024-09-19T06:06:45.753 INFO:journalctl@ceph.mon.c.smithi090.stdout: filter_policy: bloomfilter 2024-09-19T06:06:45.753 INFO:journalctl@ceph.mon.c.smithi090.stdout: whole_key_filtering: 1 2024-09-19T06:06:45.753 INFO:journalctl@ceph.mon.c.smithi090.stdout: verify_compression: 0 2024-09-19T06:06:45.754 INFO:journalctl@ceph.mon.c.smithi090.stdout: read_amp_bytes_per_bit: 0 2024-09-19T06:06:45.754 INFO:journalctl@ceph.mon.c.smithi090.stdout: format_version: 5 2024-09-19T06:06:45.754 INFO:journalctl@ceph.mon.c.smithi090.stdout: enable_index_compression: 1 2024-09-19T06:06:45.754 INFO:journalctl@ceph.mon.c.smithi090.stdout: block_align: 0 2024-09-19T06:06:45.754 INFO:journalctl@ceph.mon.c.smithi090.stdout: max_auto_readahead_size: 262144 2024-09-19T06:06:45.754 INFO:journalctl@ceph.mon.c.smithi090.stdout: prepopulate_block_cache: 0 2024-09-19T06:06:45.754 INFO:journalctl@ceph.mon.c.smithi090.stdout: initial_auto_readahead_size: 8192 2024-09-19T06:06:45.754 INFO:journalctl@ceph.mon.c.smithi090.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T06:06:45.754 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T06:06:45.754 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T06:06:45.754 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.compression: NoCompression 2024-09-19T06:06:45.754 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T06:06:45.754 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T06:06:45.755 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T06:06:45.755 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.num_levels: 7 2024-09-19T06:06:45.755 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T06:06:45.755 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T06:06:45.755 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T06:06:45.755 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T06:06:45.755 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T06:06:45.755 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T06:06:45.755 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T06:06:45.755 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T06:06:45.755 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T06:06:45.755 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T06:06:45.755 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T06:06:45.756 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T06:06:45.756 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T06:06:45.756 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T06:06:45.756 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T06:06:45.756 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T06:06:45.756 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T06:06:45.756 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T06:06:45.756 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T06:06:45.756 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T06:06:45.756 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T06:06:45.756 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T06:06:45.756 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T06:06:45.757 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T06:06:45.757 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T06:06:45.757 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T06:06:45.757 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T06:06:45.757 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T06:06:45.757 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T06:06:45.757 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T06:06:45.757 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T06:06:45.757 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T06:06:45.757 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T06:06:45.757 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T06:06:45.757 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T06:06:45.757 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T06:06:45.758 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T06:06:45.758 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T06:06:45.758 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T06:06:45.758 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T06:06:45.758 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T06:06:45.758 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T06:06:45.758 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T06:06:45.758 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T06:06:45.758 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T06:06:45.758 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T06:06:45.758 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T06:06:45.758 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T06:06:45.758 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T06:06:45.758 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T06:06:45.759 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T06:06:45.759 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T06:06:45.759 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T06:06:45.759 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T06:06:45.759 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.inplace_update_support: 0 2024-09-19T06:06:45.759 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T06:06:45.759 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T06:06:45.759 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T06:06:45.759 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T06:06:45.760 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.bloom_locality: 0 2024-09-19T06:06:45.760 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.max_successive_merges: 0 2024-09-19T06:06:45.760 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T06:06:45.760 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T06:06:45.760 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T06:06:45.760 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T06:06:45.760 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.ttl: 2592000 2024-09-19T06:06:45.760 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T06:06:45.760 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T06:06:45.760 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T06:06:45.760 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.enable_blob_files: false 2024-09-19T06:06:45.760 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.min_blob_size: 0 2024-09-19T06:06:45.760 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T06:06:45.761 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T06:06:45.761 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T06:06:45.761 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T06:06:45.761 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T06:06:45.761 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T06:06:45.761 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T06:06:45.761 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T06:06:45.761 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-19T06:06:45.761 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-19T06:06:45.761 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 96ee298b-5d96-4198-918c-dbfa1be36fc3 2024-09-19T06:06:45.761 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726726005407147, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-19T06:06:45.761 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-19T06:06:45.762 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726726005407574, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726726005, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "96ee298b-5d96-4198-918c-dbfa1be36fc3", "db_session_id": "AUMK8KJU68KB8KELXA6B", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-19T06:06:45.762 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726726005407669, "job": 1, "event": "recovery_finished"} 2024-09-19T06:06:45.762 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-19T06:06:45.762 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T06:06:45.762 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5617376f2e00 2024-09-19T06:06:45.762 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: DB pointer 0x5617377ee000 2024-09-19T06:06:45.762 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T06:06:45.762 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T06:06:45.762 INFO:journalctl@ceph.mon.c.smithi090.stdout: ** DB Stats ** 2024-09-19T06:06:45.762 INFO:journalctl@ceph.mon.c.smithi090.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T06:06:45.762 INFO:journalctl@ceph.mon.c.smithi090.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T06:06:45.762 INFO:journalctl@ceph.mon.c.smithi090.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T06:06:45.762 INFO:journalctl@ceph.mon.c.smithi090.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T06:06:45.763 INFO:journalctl@ceph.mon.c.smithi090.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T06:06:45.763 INFO:journalctl@ceph.mon.c.smithi090.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T06:06:45.763 INFO:journalctl@ceph.mon.c.smithi090.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T06:06:45.763 INFO:journalctl@ceph.mon.c.smithi090.stdout: 2024-09-19T06:06:45.763 INFO:journalctl@ceph.mon.c.smithi090.stdout: ** Compaction Stats [default] ** 2024-09-19T06:06:45.763 INFO:journalctl@ceph.mon.c.smithi090.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T06:06:45.763 INFO:journalctl@ceph.mon.c.smithi090.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T06:06:45.763 INFO:journalctl@ceph.mon.c.smithi090.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T06:06:45.763 INFO:journalctl@ceph.mon.c.smithi090.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T06:06:45.763 INFO:journalctl@ceph.mon.c.smithi090.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T06:06:45.763 INFO:journalctl@ceph.mon.c.smithi090.stdout: 2024-09-19T06:06:45.763 INFO:journalctl@ceph.mon.c.smithi090.stdout: ** Compaction Stats [default] ** 2024-09-19T06:06:45.763 INFO:journalctl@ceph.mon.c.smithi090.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T06:06:45.764 INFO:journalctl@ceph.mon.c.smithi090.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T06:06:45.764 INFO:journalctl@ceph.mon.c.smithi090.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T06:06:45.764 INFO:journalctl@ceph.mon.c.smithi090.stdout: 2024-09-19T06:06:45.764 INFO:journalctl@ceph.mon.c.smithi090.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T06:06:45.764 INFO:journalctl@ceph.mon.c.smithi090.stdout: 2024-09-19T06:06:45.764 INFO:journalctl@ceph.mon.c.smithi090.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T06:06:45.764 INFO:journalctl@ceph.mon.c.smithi090.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T06:06:45.764 INFO:journalctl@ceph.mon.c.smithi090.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T06:06:45.764 INFO:journalctl@ceph.mon.c.smithi090.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T06:06:45.764 INFO:journalctl@ceph.mon.c.smithi090.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T06:06:45.764 INFO:journalctl@ceph.mon.c.smithi090.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T06:06:45.764 INFO:journalctl@ceph.mon.c.smithi090.stdout: Cumulative compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T06:06:45.764 INFO:journalctl@ceph.mon.c.smithi090.stdout: Interval compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T06:06:45.765 INFO:journalctl@ceph.mon.c.smithi090.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T06:06:45.765 INFO:journalctl@ceph.mon.c.smithi090.stdout: Block cache BinnedLRUCache@0x5617376c51f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-19T06:06:45.765 INFO:journalctl@ceph.mon.c.smithi090.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-19T06:06:45.765 INFO:journalctl@ceph.mon.c.smithi090.stdout: 2024-09-19T06:06:45.765 INFO:journalctl@ceph.mon.c.smithi090.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T06:06:45.765 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-19T06:06:45.765 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: using public_addr v2:172.21.15.90:0/0 -> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] 2024-09-19T06:06:45.765 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: starting mon.c rank -1 at public addrs [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] at bind addrs [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 078f6612-764d-11ef-bceb-c7b262605968 2024-09-19T06:06:45.765 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: mon.c@-1(???) e0 preinit fsid 078f6612-764d-11ef-bceb-c7b262605968 2024-09-19T06:06:45.765 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: mon.c@-1(synchronizing).mds e1 new map 2024-09-19T06:06:45.765 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-19T06:06:45.765 INFO:journalctl@ceph.mon.c.smithi090.stdout: e1 2024-09-19T06:06:45.765 INFO:journalctl@ceph.mon.c.smithi090.stdout: btime 2024-09-19T06:05:17:607764+0000 2024-09-19T06:06:45.766 INFO:journalctl@ceph.mon.c.smithi090.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:06:45.766 INFO:journalctl@ceph.mon.c.smithi090.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T06:06:45.766 INFO:journalctl@ceph.mon.c.smithi090.stdout: legacy client fscid: -1 2024-09-19T06:06:45.766 INFO:journalctl@ceph.mon.c.smithi090.stdout: 2024-09-19T06:06:45.766 INFO:journalctl@ceph.mon.c.smithi090.stdout: No filesystems configured 2024-09-19T06:06:45.766 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-19T06:06:45.766 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-19T06:06:45.766 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-19T06:06:45.766 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-19T06:06:45.766 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-19T06:06:45.766 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-19T06:06:45.766 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T06:06:45.766 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T06:06:45.767 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T06:06:45.767 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T06:06:45.767 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:45.767 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:06:45.767 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:06:45.767 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/4058330673' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T06:06:45.767 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/4058330673' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T06:06:45.767 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:06:45.767 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:45.767 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:45.767 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:45.767 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:45.767 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi090", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:06:45.767 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:06:45.768 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:06:45.768 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:06:45.768 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: Updating smithi090:/etc/ceph/ceph.conf 2024-09-19T06:06:45.768 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: Updating smithi090:/var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:06:45.768 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: Updating smithi090:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:06:45.768 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: Updating smithi090:/var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:06:45.768 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi002:172.21.15.2=a;smithi089:172.21.15.89=b;smithi090:172.21.15.90=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:06:45.768 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: Saving service mon spec with placement smithi002:172.21.15.2=a;smithi089:172.21.15.89=b;smithi090:172.21.15.90=c;count:3 2024-09-19T06:06:45.768 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:45.768 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:45.768 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:45.768 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:45.768 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:06:45.769 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:06:45.769 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: Deploying daemon mon.c on smithi090 2024-09-19T06:06:45.769 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:06:45.769 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: from='client.? 172.21.15.90:0/1368664442' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:06:45.769 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 ceph-mon[34497]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-19T06:06:45.769 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 bash[34479]: ddaf5a97aa8b1603dea8bd23e7da4bfe34d711bcb0817c8867252cb0c0529d78 2024-09-19T06:06:45.769 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:45 smithi090 systemd[1]: Started Ceph mon.c for 078f6612-764d-11ef-bceb-c7b262605968. 2024-09-19T06:06:50.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.532+0000 7fc4f40ab640 1 -- 172.21.15.90:0/294766289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4d4003530 msgr2=0x7fc4d40059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:50.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.532+0000 7fc4f40ab640 1 --2- 172.21.15.90:0/294766289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4d4003530 0x7fc4d40059c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec1016e0 tx=0x7fc4e402c490 comp rx=0 tx=0).stop 2024-09-19T06:06:50.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.533+0000 7fc4f40ab640 1 -- 172.21.15.90:0/294766289 shutdown_connections 2024-09-19T06:06:50.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.533+0000 7fc4f40ab640 1 --2- 172.21.15.90:0/294766289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4d4003530 0x7fc4d40059c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:50.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.533+0000 7fc4f40ab640 1 -- 172.21.15.90:0/294766289 >> 172.21.15.90:0/294766289 conn(0x7fc4ec0fc2c0 msgr2=0x7fc4ec0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:50.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.533+0000 7fc4f40ab640 1 -- 172.21.15.90:0/294766289 shutdown_connections 2024-09-19T06:06:50.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.533+0000 7fc4f40ab640 1 -- 172.21.15.90:0/294766289 wait complete. 2024-09-19T06:06:50.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.534+0000 7fc4f40ab640 1 Processor -- start 2024-09-19T06:06:50.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.534+0000 7fc4f40ab640 1 -- start start 2024-09-19T06:06:50.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.534+0000 7fc4f40ab640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4d4003530 0x7fc4ec198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:50.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.534+0000 7fc4f40ab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4ec198560 0x7fc4ec1989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:50.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.534+0000 7fc4f40ab640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ec108560 con 0x7fc4ec198560 2024-09-19T06:06:50.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.534+0000 7fc4f40ab640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ec1083e0 con 0x7fc4d4003530 2024-09-19T06:06:50.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.534+0000 7fc4f1e47640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4d4003530 0x7fc4ec198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:50.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.534+0000 7fc4f1e47640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4d4003530 0x7fc4ec198020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43004/0 (socket says 172.21.15.90:43004) 2024-09-19T06:06:50.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.534+0000 7fc4f1e47640 1 -- 172.21.15.90:0/463912434 learned_addr learned my addr 172.21.15.90:0/463912434 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-19T06:06:50.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.534+0000 7fc4f1e47640 1 -- 172.21.15.90:0/463912434 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4d4003530 msgr2=0x7fc4ec198020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T06:06:50.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.534+0000 7fc4f1e47640 1 -- 172.21.15.90:0/463912434 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4d4003530 msgr2=0x7fc4ec198020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T06:06:50.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.534+0000 7fc4f1e47640 1 --2- 172.21.15.90:0/463912434 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4d4003530 0x7fc4ec198020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T06:06:50.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.534+0000 7fc4f1e47640 1 --2- 172.21.15.90:0/463912434 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4d4003530 0x7fc4ec198020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:06:50.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.534+0000 7fc4f1646640 1 --2- 172.21.15.90:0/463912434 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4ec198560 0x7fc4ec1989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:50.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.535+0000 7fc4f1646640 1 -- 172.21.15.90:0/463912434 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4d4003530 msgr2=0x7fc4ec198020 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:06:50.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.535+0000 7fc4f1646640 1 --2- 172.21.15.90:0/463912434 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4d4003530 0x7fc4ec198020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:50.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.535+0000 7fc4f1646640 1 -- 172.21.15.90:0/463912434 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4ec1a1090 con 0x7fc4ec198560 2024-09-19T06:06:50.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.535+0000 7fc4f1646640 1 --2- 172.21.15.90:0/463912434 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4ec198560 0x7fc4ec1989c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc4e000b9b0 tx=0x7fc4e000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:50.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.535+0000 7fc4eaffd640 1 -- 172.21.15.90:0/463912434 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fc4e000c920 con 0x7fc4ec198560 2024-09-19T06:06:50.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.535+0000 7fc4eaffd640 1 -- 172.21.15.90:0/463912434 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc4e0014440 con 0x7fc4ec198560 2024-09-19T06:06:50.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.535+0000 7fc4eaffd640 1 -- 172.21.15.90:0/463912434 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fc4e0012520 con 0x7fc4ec198560 2024-09-19T06:06:50.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.535+0000 7fc4f40ab640 1 -- 172.21.15.90:0/463912434 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4ec1a1260 con 0x7fc4ec198560 2024-09-19T06:06:50.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.535+0000 7fc4f40ab640 1 -- 172.21.15.90:0/463912434 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4ec1a17f0 con 0x7fc4ec198560 2024-09-19T06:06:50.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.536+0000 7fc4eaffd640 1 -- 172.21.15.90:0/463912434 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fc4e001c070 con 0x7fc4ec198560 2024-09-19T06:06:50.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.537+0000 7fc4eaffd640 1 --2- 172.21.15.90:0/463912434 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fc4d8039090 0x7fc4d803b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:50.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.537+0000 7fc4eaffd640 1 -- 172.21.15.90:0/463912434 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc4e004bbf0 con 0x7fc4ec198560 2024-09-19T06:06:50.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.537+0000 7fc4f40ab640 1 -- 172.21.15.90:0/463912434 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4ec101ce0 con 0x7fc4ec198560 2024-09-19T06:06:50.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.537+0000 7fc4f1e47640 1 --2- 172.21.15.90:0/463912434 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fc4d8039090 0x7fc4d803b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:50.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.537+0000 7fc4f1e47640 1 --2- 172.21.15.90:0/463912434 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fc4d8039090 0x7fc4d803b550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4012c10 tx=0x7fc4e40323a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:50.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.542+0000 7fc4eaffd640 1 -- 172.21.15.90:0/463912434 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc4e0013560 con 0x7fc4ec198560 2024-09-19T06:06:50.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.774+0000 7fc4f40ab640 1 -- 172.21.15.90:0/463912434 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fc4ec18fcc0 con 0x7fc4ec198560 2024-09-19T06:06:50.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.774+0000 7fc4eaffd640 1 -- 172.21.15.90:0/463912434 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1007 (secure 0 0 0) 0x7fc4e00137c0 con 0x7fc4ec198560 2024-09-19T06:06:50.776 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:50 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:06:50.776 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:50 smithi090 ceph-mon[34497]: mon.a calling monitor election 2024-09-19T06:06:50.777 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:50 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:06:50.777 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:50 smithi090 ceph-mon[34497]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:06:50.777 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:50 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:06:50.777 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:50 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:06:50.777 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:50 smithi090 ceph-mon[34497]: mon.c calling monitor election 2024-09-19T06:06:50.777 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:50 smithi090 ceph-mon[34497]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:06:50.777 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:50 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:06:50.777 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:50 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:06:50.777 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:50 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:06:50.777 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:50 smithi090 ceph-mon[34497]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T06:06:50.777 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:50 smithi090 ceph-mon[34497]: monmap epoch 2 2024-09-19T06:06:50.777 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:50 smithi090 ceph-mon[34497]: fsid 078f6612-764d-11ef-bceb-c7b262605968 2024-09-19T06:06:50.777 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:50 smithi090 ceph-mon[34497]: last_changed 2024-09-19T06:06:45.432587+0000 2024-09-19T06:06:50.778 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:50 smithi090 ceph-mon[34497]: created 2024-09-19T06:05:14.578448+0000 2024-09-19T06:06:50.778 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:50 smithi090 ceph-mon[34497]: min_mon_release 19 (squid) 2024-09-19T06:06:50.778 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:50 smithi090 ceph-mon[34497]: election_strategy: 1 2024-09-19T06:06:50.778 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:50 smithi090 ceph-mon[34497]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-19T06:06:50.778 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:50 smithi090 ceph-mon[34497]: 1: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.c 2024-09-19T06:06:50.778 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:50 smithi090 ceph-mon[34497]: fsmap 2024-09-19T06:06:50.778 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:50 smithi090 ceph-mon[34497]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:06:50.778 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:50 smithi090 ceph-mon[34497]: mgrmap e13: x(active, since 38s) 2024-09-19T06:06:50.778 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:50 smithi090 ceph-mon[34497]: overall HEALTH_OK 2024-09-19T06:06:50.778 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:50 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:50.778 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:50 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:50.778 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:50 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:50.778 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:50 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:06:50.779 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:50 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:06:50.779 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-19T06:06:50.779 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":2,"fsid":"078f6612-764d-11ef-bceb-c7b262605968","modified":"2024-09-19T06:06:45.432587Z","created":"2024-09-19T06:05:14.578448Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T06:06:50.780 INFO:teuthology.orchestra.run.smithi090.stderr:dumped monmap epoch 2 2024-09-19T06:06:50.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.776+0000 7fc4f40ab640 1 -- 172.21.15.90:0/463912434 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fc4d8039090 msgr2=0x7fc4d803b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:50.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.776+0000 7fc4f40ab640 1 --2- 172.21.15.90:0/463912434 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fc4d8039090 0x7fc4d803b550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4012c10 tx=0x7fc4e40323a0 comp rx=0 tx=0).stop 2024-09-19T06:06:50.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.776+0000 7fc4f40ab640 1 -- 172.21.15.90:0/463912434 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4ec198560 msgr2=0x7fc4ec1989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:50.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.776+0000 7fc4f40ab640 1 --2- 172.21.15.90:0/463912434 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4ec198560 0x7fc4ec1989c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc4e000b9b0 tx=0x7fc4e000be70 comp rx=0 tx=0).stop 2024-09-19T06:06:50.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.776+0000 7fc4f40ab640 1 -- 172.21.15.90:0/463912434 shutdown_connections 2024-09-19T06:06:50.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.776+0000 7fc4f40ab640 1 --2- 172.21.15.90:0/463912434 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fc4d8039090 0x7fc4d803b550 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:50.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.776+0000 7fc4f40ab640 1 --2- 172.21.15.90:0/463912434 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4ec198560 0x7fc4ec1989c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:50.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.776+0000 7fc4f40ab640 1 --2- 172.21.15.90:0/463912434 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4d4003530 0x7fc4ec198020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:50.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.776+0000 7fc4f40ab640 1 -- 172.21.15.90:0/463912434 >> 172.21.15.90:0/463912434 conn(0x7fc4ec0fc2c0 msgr2=0x7fc4ec0fe210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:50.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.776+0000 7fc4f40ab640 1 -- 172.21.15.90:0/463912434 shutdown_connections 2024-09-19T06:06:50.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:50.776+0000 7fc4f40ab640 1 -- 172.21.15.90:0/463912434 wait complete. 2024-09-19T06:06:50.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:50 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:06:50.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:50 smithi002 ceph-mon[30982]: mon.a calling monitor election 2024-09-19T06:06:50.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:50 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:06:50.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:50 smithi002 ceph-mon[30982]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:06:50.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:50 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:06:50.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:50 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:06:50.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:50 smithi002 ceph-mon[30982]: mon.c calling monitor election 2024-09-19T06:06:50.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:50 smithi002 ceph-mon[30982]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:06:50.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:50 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:06:50.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:50 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:06:50.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:50 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:06:50.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:50 smithi002 ceph-mon[30982]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T06:06:50.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:50 smithi002 ceph-mon[30982]: monmap epoch 2 2024-09-19T06:06:50.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:50 smithi002 ceph-mon[30982]: fsid 078f6612-764d-11ef-bceb-c7b262605968 2024-09-19T06:06:50.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:50 smithi002 ceph-mon[30982]: last_changed 2024-09-19T06:06:45.432587+0000 2024-09-19T06:06:50.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:50 smithi002 ceph-mon[30982]: created 2024-09-19T06:05:14.578448+0000 2024-09-19T06:06:50.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:50 smithi002 ceph-mon[30982]: min_mon_release 19 (squid) 2024-09-19T06:06:50.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:50 smithi002 ceph-mon[30982]: election_strategy: 1 2024-09-19T06:06:50.975 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:50 smithi002 ceph-mon[30982]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-19T06:06:50.975 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:50 smithi002 ceph-mon[30982]: 1: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.c 2024-09-19T06:06:50.975 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:50 smithi002 ceph-mon[30982]: fsmap 2024-09-19T06:06:50.975 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:50 smithi002 ceph-mon[30982]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:06:50.975 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:50 smithi002 ceph-mon[30982]: mgrmap e13: x(active, since 38s) 2024-09-19T06:06:50.975 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:50 smithi002 ceph-mon[30982]: overall HEALTH_OK 2024-09-19T06:06:50.975 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:50 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:50.975 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:50 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:50.975 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:50 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:50.975 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:50 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:06:50.975 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:50 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:06:51.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:51 smithi090 ceph-mon[34497]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:06:51.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:51 smithi090 ceph-mon[34497]: Deploying daemon mon.b on smithi089 2024-09-19T06:06:51.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:51 smithi090 ceph-mon[34497]: from='client.? 172.21.15.90:0/463912434' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:06:51.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:51 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:06:51.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:51 smithi002 ceph-mon[30982]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:06:51.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:51 smithi002 ceph-mon[30982]: Deploying daemon mon.b on smithi089 2024-09-19T06:06:51.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:51 smithi002 ceph-mon[30982]: from='client.? 172.21.15.90:0/463912434' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:06:51.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:51 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:06:52.381 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T06:06:52.381 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T06:06:52.632 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:06:53.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.052+0000 7f7516f89640 1 -- 172.21.15.90:0/1263431602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7510102860 msgr2=0x7f7510102c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:53.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.052+0000 7f7516f89640 1 --2- 172.21.15.90:0/1263431602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7510102860 0x7f7510102c40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f750c009880 tx=0x7f750c02a670 comp rx=0 tx=0).stop 2024-09-19T06:06:53.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.052+0000 7f7516f89640 1 -- 172.21.15.90:0/1263431602 shutdown_connections 2024-09-19T06:06:53.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.052+0000 7f7516f89640 1 --2- 172.21.15.90:0/1263431602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7510102860 0x7f7510102c40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:53.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.052+0000 7f7516f89640 1 -- 172.21.15.90:0/1263431602 >> 172.21.15.90:0/1263431602 conn(0x7f75100fc2c0 msgr2=0x7f75100fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:53.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.052+0000 7f7516f89640 1 -- 172.21.15.90:0/1263431602 shutdown_connections 2024-09-19T06:06:53.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.052+0000 7f7516f89640 1 -- 172.21.15.90:0/1263431602 wait complete. 2024-09-19T06:06:53.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.053+0000 7f7516f89640 1 Processor -- start 2024-09-19T06:06:53.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.053+0000 7f7516f89640 1 -- start start 2024-09-19T06:06:53.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.053+0000 7f7516f89640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7510102860 0x7f75101972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:53.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.053+0000 7f7516f89640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7510197830 0x7f751019bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:53.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.053+0000 7f7516f89640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f751010bc80 con 0x7f7510197830 2024-09-19T06:06:53.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.053+0000 7f7516f89640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f751010bb00 con 0x7f7510102860 2024-09-19T06:06:53.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.053+0000 7f7507fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7510197830 0x7f751019bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:53.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.054+0000 7f7514d25640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7510102860 0x7f75101972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:53.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.054+0000 7f7507fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7510197830 0x7f751019bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.90:42992/0 (socket says 172.21.15.90:42992) 2024-09-19T06:06:53.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.054+0000 7f7507fff640 1 -- 172.21.15.90:0/4176837809 learned_addr learned my addr 172.21.15.90:0/4176837809 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-19T06:06:53.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.054+0000 7f7514d25640 1 -- 172.21.15.90:0/4176837809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7510102860 msgr2=0x7f75101972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T06:06:53.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.054+0000 7f7514d25640 1 -- 172.21.15.90:0/4176837809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7510102860 msgr2=0x7f75101972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T06:06:53.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.054+0000 7f7514d25640 1 --2- 172.21.15.90:0/4176837809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7510102860 0x7f75101972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T06:06:53.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.054+0000 7f7514d25640 1 --2- 172.21.15.90:0/4176837809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7510102860 0x7f75101972f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:06:53.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.054+0000 7f7507fff640 1 -- 172.21.15.90:0/4176837809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7510102860 msgr2=0x7f75101972f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:06:53.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.054+0000 7f7507fff640 1 --2- 172.21.15.90:0/4176837809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7510102860 0x7f75101972f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:53.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.054+0000 7f7507fff640 1 -- 172.21.15.90:0/4176837809 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7510197e50 con 0x7f7510197830 2024-09-19T06:06:53.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.054+0000 7f7507fff640 1 --2- 172.21.15.90:0/4176837809 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7510197830 0x7f751019bbc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f750000b4a0 tx=0x7f750000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:53.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.054+0000 7f7505ffb640 1 -- 172.21.15.90:0/4176837809 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f7500010610 con 0x7f7510197830 2024-09-19T06:06:53.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.054+0000 7f7516f89640 1 -- 172.21.15.90:0/4176837809 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f751019c100 con 0x7f7510197830 2024-09-19T06:06:53.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.054+0000 7f7505ffb640 1 -- 172.21.15.90:0/4176837809 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7500010c60 con 0x7f7510197830 2024-09-19T06:06:53.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.054+0000 7f7505ffb640 1 -- 172.21.15.90:0/4176837809 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f7500017da0 con 0x7f7510197830 2024-09-19T06:06:53.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.054+0000 7f7516f89640 1 -- 172.21.15.90:0/4176837809 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f751019c640 con 0x7f7510197830 2024-09-19T06:06:53.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.055+0000 7f7505ffb640 1 -- 172.21.15.90:0/4176837809 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f7500017070 con 0x7f7510197830 2024-09-19T06:06:53.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.055+0000 7f7516f89640 1 -- 172.21.15.90:0/4176837809 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f751006a4e0 con 0x7f7510197830 2024-09-19T06:06:53.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.055+0000 7f7505ffb640 1 --2- 172.21.15.90:0/4176837809 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f74f8039040 0x7f74f803b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:53.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.055+0000 7f7505ffb640 1 -- 172.21.15.90:0/4176837809 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f750000d040 con 0x7f7510197830 2024-09-19T06:06:53.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.056+0000 7f7514d25640 1 --2- 172.21.15.90:0/4176837809 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f74f8039040 0x7f74f803b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:53.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.056+0000 7f7514d25640 1 --2- 172.21.15.90:0/4176837809 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f74f8039040 0x7f74f803b500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f750c0096c0 tx=0x7f750c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:53.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.061+0000 7f7505ffb640 1 -- 172.21.15.90:0/4176837809 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f750001e020 con 0x7f7510197830 2024-09-19T06:06:53.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.293+0000 7f7516f89640 1 -- 172.21.15.90:0/4176837809 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f751019c950 con 0x7f7510197830 2024-09-19T06:06:53.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.294+0000 7f7505ffb640 1 -- 172.21.15.90:0/4176837809 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1007 (secure 0 0 0) 0x7f7500019450 con 0x7f7510197830 2024-09-19T06:06:53.296 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-19T06:06:53.296 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":2,"fsid":"078f6612-764d-11ef-bceb-c7b262605968","modified":"2024-09-19T06:06:45.432587Z","created":"2024-09-19T06:05:14.578448Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T06:06:53.297 INFO:teuthology.orchestra.run.smithi090.stderr:dumped monmap epoch 2 2024-09-19T06:06:53.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.296+0000 7f7516f89640 1 -- 172.21.15.90:0/4176837809 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f74f8039040 msgr2=0x7f74f803b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:53.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.296+0000 7f7516f89640 1 --2- 172.21.15.90:0/4176837809 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f74f8039040 0x7f74f803b500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f750c0096c0 tx=0x7f750c0058d0 comp rx=0 tx=0).stop 2024-09-19T06:06:53.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.296+0000 7f7516f89640 1 -- 172.21.15.90:0/4176837809 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7510197830 msgr2=0x7f751019bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:53.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.296+0000 7f7516f89640 1 --2- 172.21.15.90:0/4176837809 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7510197830 0x7f751019bbc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f750000b4a0 tx=0x7f750000b960 comp rx=0 tx=0).stop 2024-09-19T06:06:53.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.296+0000 7f7516f89640 1 -- 172.21.15.90:0/4176837809 shutdown_connections 2024-09-19T06:06:53.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.296+0000 7f7516f89640 1 --2- 172.21.15.90:0/4176837809 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f74f8039040 0x7f74f803b500 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:53.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.296+0000 7f7516f89640 1 --2- 172.21.15.90:0/4176837809 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7510197830 0x7f751019bbc0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:53.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.296+0000 7f7516f89640 1 --2- 172.21.15.90:0/4176837809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7510102860 0x7f75101972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:53.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.296+0000 7f7516f89640 1 -- 172.21.15.90:0/4176837809 >> 172.21.15.90:0/4176837809 conn(0x7f75100fc2c0 msgr2=0x7f7510105620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:53.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.296+0000 7f7516f89640 1 -- 172.21.15.90:0/4176837809 shutdown_connections 2024-09-19T06:06:53.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:53.296+0000 7f7516f89640 1 -- 172.21.15.90:0/4176837809 wait complete. 2024-09-19T06:06:53.704 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:53 smithi090 ceph-mon[34497]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:06:53.704 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:53 smithi090 ceph-mon[34497]: from='client.? 172.21.15.90:0/4176837809' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:06:53.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:53 smithi002 ceph-mon[30982]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:06:53.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:53 smithi002 ceph-mon[30982]: from='client.? 172.21.15.90:0/4176837809' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:06:54.074 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 podman[34142]: 2024-09-19 06:06:54.051434751 +0000 UTC m=+0.355610867 container start 10e7a033d3342b8a56d802310516e64a810b0a0033bedc39000d5fbd81683ab5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mon-b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-19T06:06:54.075 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T06:06:54.075 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T06:06:54.075 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: pidfile_write: ignore empty --pid-file 2024-09-19T06:06:54.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: load: jerasure load: lrc 2024-09-19T06:06:54.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: RocksDB version: 7.9.2 2024-09-19T06:06:54.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Git sha 0 2024-09-19T06:06:54.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T06:06:54.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: DB SUMMARY 2024-09-19T06:06:54.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: DB Session ID: YAKTG1U9B2BS95K7W5XU 2024-09-19T06:06:54.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: CURRENT file: CURRENT 2024-09-19T06:06:54.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T06:06:54.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-19T06:06:54.544 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-19T06:06:54.544 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-09-19T06:06:54.544 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.error_if_exists: 0 2024-09-19T06:06:54.544 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.create_if_missing: 0 2024-09-19T06:06:54.544 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.paranoid_checks: 1 2024-09-19T06:06:54.544 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T06:06:54.544 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T06:06:54.544 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T06:06:54.544 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.env: 0x55c96ce00940 2024-09-19T06:06:54.545 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T06:06:54.545 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.info_log: 0x55c96ed076e0 2024-09-19T06:06:54.545 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T06:06:54.545 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.statistics: (nil) 2024-09-19T06:06:54.545 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.use_fsync: 0 2024-09-19T06:06:54.545 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.max_log_file_size: 0 2024-09-19T06:06:54.545 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T06:06:54.545 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T06:06:54.545 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T06:06:54.545 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T06:06:54.545 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.allow_fallocate: 1 2024-09-19T06:06:54.545 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T06:06:54.545 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T06:06:54.546 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.use_direct_reads: 0 2024-09-19T06:06:54.546 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T06:06:54.546 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T06:06:54.546 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.db_log_dir: 2024-09-19T06:06:54.546 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.wal_dir: 2024-09-19T06:06:54.546 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T06:06:54.546 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T06:06:54.546 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T06:06:54.546 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T06:06:54.548 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T06:06:54.548 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T06:06:54.548 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T06:06:54.548 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T06:06:54.548 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.write_buffer_manager: 0x55c96ed16dc0 2024-09-19T06:06:54.548 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T06:06:54.548 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T06:06:54.548 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T06:06:54.548 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T06:06:54.548 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T06:06:54.549 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T06:06:54.549 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T06:06:54.549 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T06:06:54.549 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.unordered_write: 0 2024-09-19T06:06:54.549 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T06:06:54.549 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T06:06:54.549 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T06:06:54.549 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T06:06:54.549 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.row_cache: None 2024-09-19T06:06:54.549 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.wal_filter: None 2024-09-19T06:06:54.549 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T06:06:54.549 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T06:06:54.550 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.two_write_queues: 0 2024-09-19T06:06:54.550 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T06:06:54.550 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.wal_compression: 0 2024-09-19T06:06:54.550 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.atomic_flush: 0 2024-09-19T06:06:54.550 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T06:06:54.550 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T06:06:54.550 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T06:06:54.550 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.log_readahead_size: 0 2024-09-19T06:06:54.551 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T06:06:54.551 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T06:06:54.551 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T06:06:54.551 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T06:06:54.551 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T06:06:54.551 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T06:06:54.551 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T06:06:54.551 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.max_background_jobs: 2 2024-09-19T06:06:54.551 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.max_background_compactions: -1 2024-09-19T06:06:54.551 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.max_subcompactions: 1 2024-09-19T06:06:54.552 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T06:06:54.552 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T06:06:54.552 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T06:06:54.552 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T06:06:54.552 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T06:06:54.552 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T06:06:54.552 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T06:06:54.552 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T06:06:54.552 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.max_open_files: -1 2024-09-19T06:06:54.553 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T06:06:54.553 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T06:06:54.553 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T06:06:54.553 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T06:06:54.553 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.max_background_flushes: -1 2024-09-19T06:06:54.553 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Compression algorithms supported: 2024-09-19T06:06:54.553 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: kZSTD supported: 0 2024-09-19T06:06:54.553 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: kXpressCompression supported: 0 2024-09-19T06:06:54.553 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: kBZip2Compression supported: 0 2024-09-19T06:06:54.553 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T06:06:54.554 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: kLZ4Compression supported: 1 2024-09-19T06:06:54.554 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: kZlibCompression supported: 1 2024-09-19T06:06:54.554 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T06:06:54.554 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: kSnappyCompression supported: 1 2024-09-19T06:06:54.554 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T06:06:54.554 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T06:06:54.554 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-19T06:06:54.555 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T06:06:54.555 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T06:06:54.555 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.merge_operator: 2024-09-19T06:06:54.555 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.compaction_filter: None 2024-09-19T06:06:54.555 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T06:06:54.555 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T06:06:54.556 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T06:06:54.556 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T06:06:54.556 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c96ed07320) 2024-09-19T06:06:54.556 INFO:journalctl@ceph.mon.b.smithi089.stdout: cache_index_and_filter_blocks: 1 2024-09-19T06:06:54.556 INFO:journalctl@ceph.mon.b.smithi089.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T06:06:54.556 INFO:journalctl@ceph.mon.b.smithi089.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T06:06:54.557 INFO:journalctl@ceph.mon.b.smithi089.stdout: pin_top_level_index_and_filter: 1 2024-09-19T06:06:54.557 INFO:journalctl@ceph.mon.b.smithi089.stdout: index_type: 0 2024-09-19T06:06:54.557 INFO:journalctl@ceph.mon.b.smithi089.stdout: data_block_index_type: 0 2024-09-19T06:06:54.557 INFO:journalctl@ceph.mon.b.smithi089.stdout: index_shortening: 1 2024-09-19T06:06:54.557 INFO:journalctl@ceph.mon.b.smithi089.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T06:06:54.558 INFO:journalctl@ceph.mon.b.smithi089.stdout: checksum: 4 2024-09-19T06:06:54.558 INFO:journalctl@ceph.mon.b.smithi089.stdout: no_block_cache: 0 2024-09-19T06:06:54.558 INFO:journalctl@ceph.mon.b.smithi089.stdout: block_cache: 0x55c96ecfb1f0 2024-09-19T06:06:54.558 INFO:journalctl@ceph.mon.b.smithi089.stdout: block_cache_name: BinnedLRUCache 2024-09-19T06:06:54.558 INFO:journalctl@ceph.mon.b.smithi089.stdout: block_cache_options: 2024-09-19T06:06:54.558 INFO:journalctl@ceph.mon.b.smithi089.stdout: capacity : 536870912 2024-09-19T06:06:54.559 INFO:journalctl@ceph.mon.b.smithi089.stdout: num_shard_bits : 4 2024-09-19T06:06:54.559 INFO:journalctl@ceph.mon.b.smithi089.stdout: strict_capacity_limit : 0 2024-09-19T06:06:54.559 INFO:journalctl@ceph.mon.b.smithi089.stdout: high_pri_pool_ratio: 0.000 2024-09-19T06:06:54.559 INFO:journalctl@ceph.mon.b.smithi089.stdout: block_cache_compressed: (nil) 2024-09-19T06:06:54.559 INFO:journalctl@ceph.mon.b.smithi089.stdout: persistent_cache: (nil) 2024-09-19T06:06:54.559 INFO:journalctl@ceph.mon.b.smithi089.stdout: block_size: 4096 2024-09-19T06:06:54.560 INFO:journalctl@ceph.mon.b.smithi089.stdout: block_size_deviation: 10 2024-09-19T06:06:54.560 INFO:journalctl@ceph.mon.b.smithi089.stdout: block_restart_interval: 16 2024-09-19T06:06:54.560 INFO:journalctl@ceph.mon.b.smithi089.stdout: index_block_restart_interval: 1 2024-09-19T06:06:54.560 INFO:journalctl@ceph.mon.b.smithi089.stdout: metadata_block_size: 4096 2024-09-19T06:06:54.560 INFO:journalctl@ceph.mon.b.smithi089.stdout: partition_filters: 0 2024-09-19T06:06:54.560 INFO:journalctl@ceph.mon.b.smithi089.stdout: use_delta_encoding: 1 2024-09-19T06:06:54.561 INFO:journalctl@ceph.mon.b.smithi089.stdout: filter_policy: bloomfilter 2024-09-19T06:06:54.561 INFO:journalctl@ceph.mon.b.smithi089.stdout: whole_key_filtering: 1 2024-09-19T06:06:54.561 INFO:journalctl@ceph.mon.b.smithi089.stdout: verify_compression: 0 2024-09-19T06:06:54.561 INFO:journalctl@ceph.mon.b.smithi089.stdout: read_amp_bytes_per_bit: 0 2024-09-19T06:06:54.561 INFO:journalctl@ceph.mon.b.smithi089.stdout: format_version: 5 2024-09-19T06:06:54.561 INFO:journalctl@ceph.mon.b.smithi089.stdout: enable_index_compression: 1 2024-09-19T06:06:54.562 INFO:journalctl@ceph.mon.b.smithi089.stdout: block_align: 0 2024-09-19T06:06:54.562 INFO:journalctl@ceph.mon.b.smithi089.stdout: max_auto_readahead_size: 262144 2024-09-19T06:06:54.562 INFO:journalctl@ceph.mon.b.smithi089.stdout: prepopulate_block_cache: 0 2024-09-19T06:06:54.562 INFO:journalctl@ceph.mon.b.smithi089.stdout: initial_auto_readahead_size: 8192 2024-09-19T06:06:54.562 INFO:journalctl@ceph.mon.b.smithi089.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T06:06:54.562 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T06:06:54.563 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T06:06:54.563 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.compression: NoCompression 2024-09-19T06:06:54.563 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T06:06:54.563 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T06:06:54.563 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T06:06:54.563 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.num_levels: 7 2024-09-19T06:06:54.564 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T06:06:54.564 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T06:06:54.564 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T06:06:54.564 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T06:06:54.565 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T06:06:54.565 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T06:06:54.565 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T06:06:54.565 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T06:06:54.565 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T06:06:54.565 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T06:06:54.566 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T06:06:54.566 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T06:06:54.566 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T06:06:54.566 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T06:06:54.566 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T06:06:54.566 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T06:06:54.567 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T06:06:54.567 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T06:06:54.567 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T06:06:54.567 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T06:06:54.567 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T06:06:54.567 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T06:06:54.568 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T06:06:54.568 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T06:06:54.568 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T06:06:54.568 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T06:06:54.568 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T06:06:54.568 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T06:06:54.569 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T06:06:54.569 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T06:06:54.569 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T06:06:54.569 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T06:06:54.569 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T06:06:54.569 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T06:06:54.570 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T06:06:54.570 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T06:06:54.570 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T06:06:54.570 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T06:06:54.570 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T06:06:54.570 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T06:06:54.571 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T06:06:54.571 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T06:06:54.571 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T06:06:54.571 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T06:06:54.571 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T06:06:54.571 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T06:06:54.572 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T06:06:54.572 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T06:06:54.572 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T06:06:54.572 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T06:06:54.572 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T06:06:54.573 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T06:06:54.573 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T06:06:54.573 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T06:06:54.573 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.inplace_update_support: 0 2024-09-19T06:06:54.573 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T06:06:54.573 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T06:06:54.574 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T06:06:54.574 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T06:06:54.574 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.bloom_locality: 0 2024-09-19T06:06:54.574 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.max_successive_merges: 0 2024-09-19T06:06:54.574 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T06:06:54.574 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T06:06:54.575 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T06:06:54.575 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T06:06:54.575 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.ttl: 2592000 2024-09-19T06:06:54.575 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T06:06:54.575 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T06:06:54.575 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T06:06:54.576 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.enable_blob_files: false 2024-09-19T06:06:54.576 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.min_blob_size: 0 2024-09-19T06:06:54.576 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T06:06:54.576 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T06:06:54.576 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T06:06:54.576 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T06:06:54.577 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T06:06:54.577 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T06:06:54.577 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T06:06:54.577 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T06:06:54.577 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-19T06:06:54.578 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-19T06:06:54.578 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 4a823134-2103-4ec1-9cbf-6a1697d76895 2024-09-19T06:06:54.578 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726726014078356, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-19T06:06:54.578 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-19T06:06:54.578 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726726014078774, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726726014, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "4a823134-2103-4ec1-9cbf-6a1697d76895", "db_session_id": "YAKTG1U9B2BS95K7W5XU", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-19T06:06:54.578 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726726014078864, "job": 1, "event": "recovery_finished"} 2024-09-19T06:06:54.579 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-19T06:06:54.579 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T06:06:54.579 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55c96ed28e00 2024-09-19T06:06:54.579 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: DB pointer 0x55c96ee24000 2024-09-19T06:06:54.579 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T06:06:54.580 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T06:06:54.580 INFO:journalctl@ceph.mon.b.smithi089.stdout: ** DB Stats ** 2024-09-19T06:06:54.580 INFO:journalctl@ceph.mon.b.smithi089.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T06:06:54.580 INFO:journalctl@ceph.mon.b.smithi089.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T06:06:54.580 INFO:journalctl@ceph.mon.b.smithi089.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T06:06:54.580 INFO:journalctl@ceph.mon.b.smithi089.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T06:06:54.581 INFO:journalctl@ceph.mon.b.smithi089.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T06:06:54.581 INFO:journalctl@ceph.mon.b.smithi089.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T06:06:54.581 INFO:journalctl@ceph.mon.b.smithi089.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T06:06:54.581 INFO:journalctl@ceph.mon.b.smithi089.stdout: 2024-09-19T06:06:54.581 INFO:journalctl@ceph.mon.b.smithi089.stdout: ** Compaction Stats [default] ** 2024-09-19T06:06:54.581 INFO:journalctl@ceph.mon.b.smithi089.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T06:06:54.582 INFO:journalctl@ceph.mon.b.smithi089.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T06:06:54.582 INFO:journalctl@ceph.mon.b.smithi089.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T06:06:54.582 INFO:journalctl@ceph.mon.b.smithi089.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T06:06:54.582 INFO:journalctl@ceph.mon.b.smithi089.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T06:06:54.582 INFO:journalctl@ceph.mon.b.smithi089.stdout: 2024-09-19T06:06:54.583 INFO:journalctl@ceph.mon.b.smithi089.stdout: ** Compaction Stats [default] ** 2024-09-19T06:06:54.583 INFO:journalctl@ceph.mon.b.smithi089.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T06:06:54.583 INFO:journalctl@ceph.mon.b.smithi089.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T06:06:54.583 INFO:journalctl@ceph.mon.b.smithi089.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T06:06:54.583 INFO:journalctl@ceph.mon.b.smithi089.stdout: 2024-09-19T06:06:54.583 INFO:journalctl@ceph.mon.b.smithi089.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T06:06:54.584 INFO:journalctl@ceph.mon.b.smithi089.stdout: 2024-09-19T06:06:54.584 INFO:journalctl@ceph.mon.b.smithi089.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T06:06:54.584 INFO:journalctl@ceph.mon.b.smithi089.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T06:06:54.584 INFO:journalctl@ceph.mon.b.smithi089.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T06:06:54.584 INFO:journalctl@ceph.mon.b.smithi089.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T06:06:54.584 INFO:journalctl@ceph.mon.b.smithi089.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T06:06:54.585 INFO:journalctl@ceph.mon.b.smithi089.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T06:06:54.585 INFO:journalctl@ceph.mon.b.smithi089.stdout: Cumulative compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T06:06:54.585 INFO:journalctl@ceph.mon.b.smithi089.stdout: Interval compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T06:06:54.585 INFO:journalctl@ceph.mon.b.smithi089.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T06:06:54.585 INFO:journalctl@ceph.mon.b.smithi089.stdout: Block cache BinnedLRUCache@0x55c96ecfb1f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-19T06:06:54.585 INFO:journalctl@ceph.mon.b.smithi089.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-19T06:06:54.586 INFO:journalctl@ceph.mon.b.smithi089.stdout: 2024-09-19T06:06:54.586 INFO:journalctl@ceph.mon.b.smithi089.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T06:06:54.586 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-19T06:06:54.586 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: using public_addr v2:172.21.15.89:0/0 -> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] 2024-09-19T06:06:54.586 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: starting mon.b rank -1 at public addrs [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] at bind addrs [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 078f6612-764d-11ef-bceb-c7b262605968 2024-09-19T06:06:54.587 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: mon.b@-1(???) e0 preinit fsid 078f6612-764d-11ef-bceb-c7b262605968 2024-09-19T06:06:54.587 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: mon.b@-1(synchronizing).mds e1 new map 2024-09-19T06:06:54.587 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-19T06:06:54.587 INFO:journalctl@ceph.mon.b.smithi089.stdout: e1 2024-09-19T06:06:54.587 INFO:journalctl@ceph.mon.b.smithi089.stdout: btime 2024-09-19T06:05:17:607764+0000 2024-09-19T06:06:54.587 INFO:journalctl@ceph.mon.b.smithi089.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:06:54.588 INFO:journalctl@ceph.mon.b.smithi089.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T06:06:54.588 INFO:journalctl@ceph.mon.b.smithi089.stdout: legacy client fscid: -1 2024-09-19T06:06:54.588 INFO:journalctl@ceph.mon.b.smithi089.stdout: 2024-09-19T06:06:54.588 INFO:journalctl@ceph.mon.b.smithi089.stdout: No filesystems configured 2024-09-19T06:06:54.588 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-19T06:06:54.589 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-19T06:06:54.589 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-19T06:06:54.589 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-19T06:06:54.589 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-19T06:06:54.589 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-19T06:06:54.589 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T06:06:54.590 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T06:06:54.590 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T06:06:54.590 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T06:06:54.590 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:54.590 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:06:54.591 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:06:54.591 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/4058330673' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T06:06:54.591 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/4058330673' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T06:06:54.591 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:06:54.591 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:54.592 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:54.592 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:54.592 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:54.592 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi090", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:06:54.592 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:06:54.592 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:06:54.593 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:06:54.593 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: Updating smithi090:/etc/ceph/ceph.conf 2024-09-19T06:06:54.593 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: Updating smithi090:/var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:06:54.593 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: Updating smithi090:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:06:54.593 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: Updating smithi090:/var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:06:54.594 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi002:172.21.15.2=a;smithi089:172.21.15.89=b;smithi090:172.21.15.90=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:06:54.594 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: Saving service mon spec with placement smithi002:172.21.15.2=a;smithi089:172.21.15.89=b;smithi090:172.21.15.90=c;count:3 2024-09-19T06:06:54.594 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:54.594 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:54.594 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:54.594 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:54.595 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:06:54.595 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:06:54.595 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: Deploying daemon mon.c on smithi090 2024-09-19T06:06:54.595 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:06:54.595 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: from='client.? 172.21.15.90:0/1368664442' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:06:54.595 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:06:54.596 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: mon.a calling monitor election 2024-09-19T06:06:54.596 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:06:54.596 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:06:54.596 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:06:54.596 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:06:54.596 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: mon.c calling monitor election 2024-09-19T06:06:54.597 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:06:54.597 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:06:54.597 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:06:54.597 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:06:54.597 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T06:06:54.597 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: monmap epoch 2 2024-09-19T06:06:54.598 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: fsid 078f6612-764d-11ef-bceb-c7b262605968 2024-09-19T06:06:54.598 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: last_changed 2024-09-19T06:06:45.432587+0000 2024-09-19T06:06:54.598 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: created 2024-09-19T06:05:14.578448+0000 2024-09-19T06:06:54.598 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: min_mon_release 19 (squid) 2024-09-19T06:06:54.598 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: election_strategy: 1 2024-09-19T06:06:54.599 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-19T06:06:54.599 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: 1: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.c 2024-09-19T06:06:54.599 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: fsmap 2024-09-19T06:06:54.599 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:06:54.599 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: mgrmap e13: x(active, since 38s) 2024-09-19T06:06:54.599 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: overall HEALTH_OK 2024-09-19T06:06:54.600 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:54.600 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:54.600 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:54.600 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:06:54.600 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:06:54.601 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:06:54.601 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: Deploying daemon mon.b on smithi089 2024-09-19T06:06:54.601 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: from='client.? 172.21.15.90:0/463912434' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:06:54.601 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:06:54.601 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:06:54.601 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: from='client.? 172.21.15.90:0/4176837809' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:06:54.602 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 ceph-mon[34160]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-19T06:06:54.602 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 bash[34142]: 10e7a033d3342b8a56d802310516e64a810b0a0033bedc39000d5fbd81683ab5 2024-09-19T06:06:54.602 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:06:54 smithi089 systemd[1]: Started Ceph mon.b for 078f6612-764d-11ef-bceb-c7b262605968. 2024-09-19T06:06:54.730 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T06:06:54.731 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T06:06:54.981 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:06:59.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:59 smithi002 ceph-mon[30982]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:06:59.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:59 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:06:59.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:59 smithi002 ceph-mon[30982]: mon.c calling monitor election 2024-09-19T06:06:59.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:59 smithi002 ceph-mon[30982]: mon.a calling monitor election 2024-09-19T06:06:59.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:59 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:06:59.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:59 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:06:59.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:59 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:06:59.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:59 smithi002 ceph-mon[30982]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:06:59.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:59 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:06:59.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:59 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:06:59.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:59 smithi002 ceph-mon[30982]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:06:59.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:59 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:06:59.474 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:59 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:06:59.474 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:59 smithi002 ceph-mon[30982]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T06:06:59.474 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:59 smithi002 ceph-mon[30982]: monmap epoch 3 2024-09-19T06:06:59.474 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:59 smithi002 ceph-mon[30982]: fsid 078f6612-764d-11ef-bceb-c7b262605968 2024-09-19T06:06:59.474 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:59 smithi002 ceph-mon[30982]: last_changed 2024-09-19T06:06:54.102757+0000 2024-09-19T06:06:59.474 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:59 smithi002 ceph-mon[30982]: created 2024-09-19T06:05:14.578448+0000 2024-09-19T06:06:59.474 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:59 smithi002 ceph-mon[30982]: min_mon_release 19 (squid) 2024-09-19T06:06:59.474 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:59 smithi002 ceph-mon[30982]: election_strategy: 1 2024-09-19T06:06:59.474 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:59 smithi002 ceph-mon[30982]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-19T06:06:59.474 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:59 smithi002 ceph-mon[30982]: 1: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.c 2024-09-19T06:06:59.474 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:59 smithi002 ceph-mon[30982]: 2: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.b 2024-09-19T06:06:59.474 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:59 smithi002 ceph-mon[30982]: fsmap 2024-09-19T06:06:59.475 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:59 smithi002 ceph-mon[30982]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:06:59.475 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:59 smithi002 ceph-mon[30982]: mgrmap e13: x(active, since 47s) 2024-09-19T06:06:59.475 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:59 smithi002 ceph-mon[30982]: overall HEALTH_OK 2024-09-19T06:06:59.475 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:59 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:59.475 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:59 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:59.475 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:59 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:59.475 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:06:59 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:59.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:59 smithi090 ceph-mon[34497]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:06:59.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:59 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:06:59.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:59 smithi090 ceph-mon[34497]: mon.c calling monitor election 2024-09-19T06:06:59.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:59 smithi090 ceph-mon[34497]: mon.a calling monitor election 2024-09-19T06:06:59.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:59 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:06:59.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:59 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:06:59.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:59 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:06:59.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:59 smithi090 ceph-mon[34497]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:06:59.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:59 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:06:59.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:59 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:06:59.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:59 smithi090 ceph-mon[34497]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:06:59.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:59 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:06:59.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:59 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:06:59.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:59 smithi090 ceph-mon[34497]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T06:06:59.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:59 smithi090 ceph-mon[34497]: monmap epoch 3 2024-09-19T06:06:59.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:59 smithi090 ceph-mon[34497]: fsid 078f6612-764d-11ef-bceb-c7b262605968 2024-09-19T06:06:59.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:59 smithi090 ceph-mon[34497]: last_changed 2024-09-19T06:06:54.102757+0000 2024-09-19T06:06:59.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:59 smithi090 ceph-mon[34497]: created 2024-09-19T06:05:14.578448+0000 2024-09-19T06:06:59.492 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:59 smithi090 ceph-mon[34497]: min_mon_release 19 (squid) 2024-09-19T06:06:59.492 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:59 smithi090 ceph-mon[34497]: election_strategy: 1 2024-09-19T06:06:59.492 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:59 smithi090 ceph-mon[34497]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-19T06:06:59.492 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:59 smithi090 ceph-mon[34497]: 1: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.c 2024-09-19T06:06:59.492 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:59 smithi090 ceph-mon[34497]: 2: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.b 2024-09-19T06:06:59.492 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:59 smithi090 ceph-mon[34497]: fsmap 2024-09-19T06:06:59.492 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:59 smithi090 ceph-mon[34497]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:06:59.492 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:59 smithi090 ceph-mon[34497]: mgrmap e13: x(active, since 47s) 2024-09-19T06:06:59.492 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:59 smithi090 ceph-mon[34497]: overall HEALTH_OK 2024-09-19T06:06:59.492 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:59 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:59.492 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:59 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:59.492 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:59 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:59.492 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:06:59 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:06:59.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.814+0000 7f9b8c5ac640 1 -- 172.21.15.90:0/2872755490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b70003530 msgr2=0x7f9b700059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:59.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.814+0000 7f9b8c5ac640 1 --2- 172.21.15.90:0/2872755490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b70003530 0x7f9b700059c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9b841016e0 tx=0x7f9b8002c490 comp rx=0 tx=0).stop 2024-09-19T06:06:59.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.814+0000 7f9b8c5ac640 1 -- 172.21.15.90:0/2872755490 shutdown_connections 2024-09-19T06:06:59.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.814+0000 7f9b8c5ac640 1 --2- 172.21.15.90:0/2872755490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b70003530 0x7f9b700059c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:59.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.814+0000 7f9b8c5ac640 1 -- 172.21.15.90:0/2872755490 >> 172.21.15.90:0/2872755490 conn(0x7f9b840fc280 msgr2=0x7f9b840fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:59.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.814+0000 7f9b8c5ac640 1 -- 172.21.15.90:0/2872755490 shutdown_connections 2024-09-19T06:06:59.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.814+0000 7f9b8c5ac640 1 -- 172.21.15.90:0/2872755490 wait complete. 2024-09-19T06:06:59.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.815+0000 7f9b8c5ac640 1 Processor -- start 2024-09-19T06:06:59.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.815+0000 7f9b8c5ac640 1 -- start start 2024-09-19T06:06:59.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.815+0000 7f9b8c5ac640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b70003530 0x7f9b84196190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:59.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.815+0000 7f9b8c5ac640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b841966d0 0x7f9b8419aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:59.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.815+0000 7f9b8c5ac640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b8419afa0 0x7f9b8419b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:59.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.815+0000 7f9b8c5ac640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9b84108550 con 0x7f9b841966d0 2024-09-19T06:06:59.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.815+0000 7f9b8c5ac640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9b841083d0 con 0x7f9b8419afa0 2024-09-19T06:06:59.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.815+0000 7f9b8c5ac640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9b841086d0 con 0x7f9b70003530 2024-09-19T06:06:59.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.815+0000 7f9b8a348640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b70003530 0x7f9b84196190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:59.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.815+0000 7f9b8a348640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b70003530 0x7f9b84196190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43012/0 (socket says 172.21.15.90:43012) 2024-09-19T06:06:59.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.815+0000 7f9b8a348640 1 -- 172.21.15.90:0/2882319459 learned_addr learned my addr 172.21.15.90:0/2882319459 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-19T06:06:59.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.815+0000 7f9b8a348640 1 -- 172.21.15.90:0/2882319459 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b70003530 msgr2=0x7f9b84196190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T06:06:59.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.815+0000 7f9b8a348640 1 -- 172.21.15.90:0/2882319459 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b70003530 msgr2=0x7f9b84196190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T06:06:59.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.815+0000 7f9b8a348640 1 --2- 172.21.15.90:0/2882319459 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b70003530 0x7f9b84196190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T06:06:59.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.815+0000 7f9b8a348640 1 --2- 172.21.15.90:0/2882319459 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b70003530 0x7f9b84196190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:06:59.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.815+0000 7f9b8ab49640 1 --2- 172.21.15.90:0/2882319459 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b8419afa0 0x7f9b8419b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:59.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.815+0000 7f9b89b47640 1 --2- 172.21.15.90:0/2882319459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b841966d0 0x7f9b8419aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:59.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.816+0000 7f9b8ab49640 1 -- 172.21.15.90:0/2882319459 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b8419afa0 msgr2=0x7f9b8419b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-19T06:06:59.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.816+0000 7f9b8ab49640 1 -- 172.21.15.90:0/2882319459 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b8419afa0 msgr2=0x7f9b8419b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T06:06:59.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.816+0000 7f9b8ab49640 1 --2- 172.21.15.90:0/2882319459 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b8419afa0 0x7f9b8419b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T06:06:59.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.816+0000 7f9b8ab49640 1 --2- 172.21.15.90:0/2882319459 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b8419afa0 0x7f9b8419b450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:06:59.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.816+0000 7f9b89b47640 1 -- 172.21.15.90:0/2882319459 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b70003530 msgr2=0x7f9b84196190 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:06:59.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.816+0000 7f9b89b47640 1 --2- 172.21.15.90:0/2882319459 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b70003530 0x7f9b84196190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:59.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.816+0000 7f9b89b47640 1 -- 172.21.15.90:0/2882319459 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b8419afa0 msgr2=0x7f9b8419b450 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:06:59.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.816+0000 7f9b89b47640 1 --2- 172.21.15.90:0/2882319459 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b8419afa0 0x7f9b8419b450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:59.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.816+0000 7f9b89b47640 1 -- 172.21.15.90:0/2882319459 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b841a2d10 con 0x7f9b841966d0 2024-09-19T06:06:59.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.816+0000 7f9b89b47640 1 --2- 172.21.15.90:0/2882319459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b841966d0 0x7f9b8419aa60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9b7400b450 tx=0x7f9b7400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:59.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.816+0000 7f9b7b7fe640 1 -- 172.21.15.90:0/2882319459 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b74004230 con 0x7f9b841966d0 2024-09-19T06:06:59.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.816+0000 7f9b7b7fe640 1 -- 172.21.15.90:0/2882319459 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9b740043d0 con 0x7f9b841966d0 2024-09-19T06:06:59.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.816+0000 7f9b7b7fe640 1 -- 172.21.15.90:0/2882319459 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b74003be0 con 0x7f9b841966d0 2024-09-19T06:06:59.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.816+0000 7f9b8c5ac640 1 -- 172.21.15.90:0/2882319459 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b841a2f40 con 0x7f9b841966d0 2024-09-19T06:06:59.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.816+0000 7f9b8c5ac640 1 -- 172.21.15.90:0/2882319459 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b841a34c0 con 0x7f9b841966d0 2024-09-19T06:06:59.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.817+0000 7f9b7b7fe640 1 -- 172.21.15.90:0/2882319459 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f9b7400f050 con 0x7f9b841966d0 2024-09-19T06:06:59.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.817+0000 7f9b8c5ac640 1 -- 172.21.15.90:0/2882319459 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b84109640 con 0x7f9b841966d0 2024-09-19T06:06:59.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.818+0000 7f9b7b7fe640 1 --2- 172.21.15.90:0/2882319459 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f9b68039730 0x7f9b6803bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:59.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.818+0000 7f9b7b7fe640 1 -- 172.21.15.90:0/2882319459 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f9b7404c1f0 con 0x7f9b841966d0 2024-09-19T06:06:59.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.818+0000 7f9b8a348640 1 --2- 172.21.15.90:0/2882319459 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f9b68039730 0x7f9b6803bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:59.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.818+0000 7f9b8a348640 1 --2- 172.21.15.90:0/2882319459 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f9b68039730 0x7f9b6803bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9b8002ca00 tx=0x7f9b8002c990 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:59.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:06:59.823+0000 7f9b7b7fe640 1 -- 172.21.15.90:0/2882319459 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9b7400d040 con 0x7f9b841966d0 2024-09-19T06:07:00.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:00.061+0000 7f9b8c5ac640 1 -- 172.21.15.90:0/2882319459 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f9b8402d7c0 con 0x7f9b841966d0 2024-09-19T06:07:00.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:00.061+0000 7f9b7b7fe640 1 -- 172.21.15.90:0/2882319459 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1271 (secure 0 0 0) 0x7f9b7400f340 con 0x7f9b841966d0 2024-09-19T06:07:00.064 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-19T06:07:00.064 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":3,"fsid":"078f6612-764d-11ef-bceb-c7b262605968","modified":"2024-09-19T06:06:54.102757Z","created":"2024-09-19T06:05:14.578448Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T06:07:00.064 INFO:teuthology.orchestra.run.smithi090.stderr:dumped monmap epoch 3 2024-09-19T06:07:00.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:00.064+0000 7f9b8c5ac640 1 -- 172.21.15.90:0/2882319459 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f9b68039730 msgr2=0x7f9b6803bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:00.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:00.064+0000 7f9b8c5ac640 1 --2- 172.21.15.90:0/2882319459 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f9b68039730 0x7f9b6803bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9b8002ca00 tx=0x7f9b8002c990 comp rx=0 tx=0).stop 2024-09-19T06:07:00.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:00.064+0000 7f9b8c5ac640 1 -- 172.21.15.90:0/2882319459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b841966d0 msgr2=0x7f9b8419aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:00.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:00.064+0000 7f9b8c5ac640 1 --2- 172.21.15.90:0/2882319459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b841966d0 0x7f9b8419aa60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9b7400b450 tx=0x7f9b7400b910 comp rx=0 tx=0).stop 2024-09-19T06:07:00.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:00.064+0000 7f9b8c5ac640 1 -- 172.21.15.90:0/2882319459 shutdown_connections 2024-09-19T06:07:00.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:00.064+0000 7f9b8c5ac640 1 --2- 172.21.15.90:0/2882319459 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f9b68039730 0x7f9b6803bbf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:00.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:00.064+0000 7f9b8c5ac640 1 --2- 172.21.15.90:0/2882319459 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b8419afa0 0x7f9b8419b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:00.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:00.064+0000 7f9b8c5ac640 1 --2- 172.21.15.90:0/2882319459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b841966d0 0x7f9b8419aa60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:00.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:00.064+0000 7f9b8c5ac640 1 --2- 172.21.15.90:0/2882319459 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b70003530 0x7f9b84196190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:00.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:00.064+0000 7f9b8c5ac640 1 -- 172.21.15.90:0/2882319459 >> 172.21.15.90:0/2882319459 conn(0x7f9b840fc280 msgr2=0x7f9b84105160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:00.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:00.064+0000 7f9b8c5ac640 1 -- 172.21.15.90:0/2882319459 shutdown_connections 2024-09-19T06:07:00.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:00.064+0000 7f9b8c5ac640 1 -- 172.21.15.90:0/2882319459 wait complete. 2024-09-19T06:07:00.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:00 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:00.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:00 smithi002 ceph-mon[30982]: from='client.? 172.21.15.90:0/2882319459' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:07:00.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:00 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:07:00.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:00 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:00.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:00 smithi090 ceph-mon[34497]: from='client.? 172.21.15.90:0/2882319459' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:07:00.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:00 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:07:00.906 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-19T06:07:00.906 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-19T06:07:01.539 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:01.539 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:07:01.539 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: mon.c calling monitor election 2024-09-19T06:07:01.539 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: mon.a calling monitor election 2024-09-19T06:07:01.539 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:07:01.540 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:07:01.540 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:07:01.540 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:01.540 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:07:01.540 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:07:01.540 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:01.540 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:07:01.540 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:07:01.540 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T06:07:01.540 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: monmap epoch 3 2024-09-19T06:07:01.540 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: fsid 078f6612-764d-11ef-bceb-c7b262605968 2024-09-19T06:07:01.541 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: last_changed 2024-09-19T06:06:54.102757+0000 2024-09-19T06:07:01.541 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: created 2024-09-19T06:05:14.578448+0000 2024-09-19T06:07:01.541 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: min_mon_release 19 (squid) 2024-09-19T06:07:01.541 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: election_strategy: 1 2024-09-19T06:07:01.541 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-19T06:07:01.541 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: 1: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.c 2024-09-19T06:07:01.541 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: 2: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.b 2024-09-19T06:07:01.541 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: fsmap 2024-09-19T06:07:01.541 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:07:01.541 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: mgrmap e13: x(active, since 47s) 2024-09-19T06:07:01.541 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: overall HEALTH_OK 2024-09-19T06:07:01.541 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:01.541 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:01.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:01.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:01.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:01.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: from='client.? 172.21.15.90:0/2882319459' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:07:01.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:07:01.707 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:07:02.123 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: mon.b calling monitor election 2024-09-19T06:07:02.123 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: mon.b calling monitor election 2024-09-19T06:07:02.123 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: mon.c calling monitor election 2024-09-19T06:07:02.123 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: mon.a calling monitor election 2024-09-19T06:07:02.123 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T06:07:02.123 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: monmap epoch 3 2024-09-19T06:07:02.123 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: fsid 078f6612-764d-11ef-bceb-c7b262605968 2024-09-19T06:07:02.124 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: last_changed 2024-09-19T06:06:54.102757+0000 2024-09-19T06:07:02.124 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: created 2024-09-19T06:05:14.578448+0000 2024-09-19T06:07:02.124 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: min_mon_release 19 (squid) 2024-09-19T06:07:02.124 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: election_strategy: 1 2024-09-19T06:07:02.124 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-19T06:07:02.124 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: 1: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.c 2024-09-19T06:07:02.124 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: 2: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.b 2024-09-19T06:07:02.124 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: fsmap 2024-09-19T06:07:02.124 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:07:02.124 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: mgrmap e13: x(active, since 49s) 2024-09-19T06:07:02.124 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:01 smithi089 ceph-mon[34160]: overall HEALTH_OK 2024-09-19T06:07:02.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:01 smithi002 ceph-mon[30982]: mon.b calling monitor election 2024-09-19T06:07:02.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:01 smithi002 ceph-mon[30982]: mon.b calling monitor election 2024-09-19T06:07:02.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:01 smithi002 ceph-mon[30982]: mon.c calling monitor election 2024-09-19T06:07:02.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:01 smithi002 ceph-mon[30982]: mon.a calling monitor election 2024-09-19T06:07:02.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:01 smithi002 ceph-mon[30982]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T06:07:02.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:01 smithi002 ceph-mon[30982]: monmap epoch 3 2024-09-19T06:07:02.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:01 smithi002 ceph-mon[30982]: fsid 078f6612-764d-11ef-bceb-c7b262605968 2024-09-19T06:07:02.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:01 smithi002 ceph-mon[30982]: last_changed 2024-09-19T06:06:54.102757+0000 2024-09-19T06:07:02.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:01 smithi002 ceph-mon[30982]: created 2024-09-19T06:05:14.578448+0000 2024-09-19T06:07:02.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:01 smithi002 ceph-mon[30982]: min_mon_release 19 (squid) 2024-09-19T06:07:02.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:01 smithi002 ceph-mon[30982]: election_strategy: 1 2024-09-19T06:07:02.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:01 smithi002 ceph-mon[30982]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-19T06:07:02.133 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:01 smithi002 ceph-mon[30982]: 1: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.c 2024-09-19T06:07:02.133 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:01 smithi002 ceph-mon[30982]: 2: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.b 2024-09-19T06:07:02.133 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:01 smithi002 ceph-mon[30982]: fsmap 2024-09-19T06:07:02.133 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:01 smithi002 ceph-mon[30982]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:07:02.133 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:01 smithi002 ceph-mon[30982]: mgrmap e13: x(active, since 49s) 2024-09-19T06:07:02.133 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:01 smithi002 ceph-mon[30982]: overall HEALTH_OK 2024-09-19T06:07:02.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:01 smithi090 ceph-mon[34497]: mon.b calling monitor election 2024-09-19T06:07:02.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:01 smithi090 ceph-mon[34497]: mon.b calling monitor election 2024-09-19T06:07:02.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:01 smithi090 ceph-mon[34497]: mon.c calling monitor election 2024-09-19T06:07:02.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:01 smithi090 ceph-mon[34497]: mon.a calling monitor election 2024-09-19T06:07:02.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:01 smithi090 ceph-mon[34497]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T06:07:02.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:01 smithi090 ceph-mon[34497]: monmap epoch 3 2024-09-19T06:07:02.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:01 smithi090 ceph-mon[34497]: fsid 078f6612-764d-11ef-bceb-c7b262605968 2024-09-19T06:07:02.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:01 smithi090 ceph-mon[34497]: last_changed 2024-09-19T06:06:54.102757+0000 2024-09-19T06:07:02.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:01 smithi090 ceph-mon[34497]: created 2024-09-19T06:05:14.578448+0000 2024-09-19T06:07:02.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:01 smithi090 ceph-mon[34497]: min_mon_release 19 (squid) 2024-09-19T06:07:02.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:01 smithi090 ceph-mon[34497]: election_strategy: 1 2024-09-19T06:07:02.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:01 smithi090 ceph-mon[34497]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-19T06:07:02.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:01 smithi090 ceph-mon[34497]: 1: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.c 2024-09-19T06:07:02.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:01 smithi090 ceph-mon[34497]: 2: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.b 2024-09-19T06:07:02.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:01 smithi090 ceph-mon[34497]: fsmap 2024-09-19T06:07:02.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:01 smithi090 ceph-mon[34497]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:07:02.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:01 smithi090 ceph-mon[34497]: mgrmap e13: x(active, since 49s) 2024-09-19T06:07:02.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:01 smithi090 ceph-mon[34497]: overall HEALTH_OK 2024-09-19T06:07:02.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.211+0000 7f0d7ca17640 1 -- 172.21.15.2:0/2143805709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d78102810 msgr2=0x7f0d78102bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:02.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.211+0000 7f0d7ca17640 1 --2- 172.21.15.2:0/2143805709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d78102810 0x7f0d78102bf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0d68009880 tx=0x7f0d6802a670 comp rx=0 tx=0).stop 2024-09-19T06:07:02.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.212+0000 7f0d7ca17640 1 -- 172.21.15.2:0/2143805709 shutdown_connections 2024-09-19T06:07:02.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.212+0000 7f0d7ca17640 1 --2- 172.21.15.2:0/2143805709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d78102810 0x7f0d78102bf0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:02.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.212+0000 7f0d7ca17640 1 -- 172.21.15.2:0/2143805709 >> 172.21.15.2:0/2143805709 conn(0x7f0d780fc1b0 msgr2=0x7f0d780fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:02.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.212+0000 7f0d7ca17640 1 -- 172.21.15.2:0/2143805709 shutdown_connections 2024-09-19T06:07:02.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.212+0000 7f0d7ca17640 1 -- 172.21.15.2:0/2143805709 wait complete. 2024-09-19T06:07:02.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.212+0000 7f0d7ca17640 1 Processor -- start 2024-09-19T06:07:02.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.212+0000 7f0d7ca17640 1 -- start start 2024-09-19T06:07:02.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.213+0000 7f0d7ca17640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d78102810 0x7f0d781973b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:02.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.213+0000 7f0d7ca17640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d781978f0 0x7f0d7819bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:02.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.213+0000 7f0d7ca17640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d7819c1c0 0x7f0d7819c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:02.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.213+0000 7f0d7ca17640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7810bb10 con 0x7f0d781978f0 2024-09-19T06:07:02.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.213+0000 7f0d7ca17640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7810b990 con 0x7f0d7819c1c0 2024-09-19T06:07:02.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.213+0000 7f0d7ca17640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7810bc90 con 0x7f0d78102810 2024-09-19T06:07:02.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.213+0000 7f0d75d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d781978f0 0x7f0d7819bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:02.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.213+0000 7f0d75d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d781978f0 0x7f0d7819bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48954/0 (socket says 172.21.15.2:48954) 2024-09-19T06:07:02.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.213+0000 7f0d75d9b640 1 -- 172.21.15.2:0/441695896 learned_addr learned my addr 172.21.15.2:0/441695896 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:07:02.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.213+0000 7f0d7659c640 1 --2- 172.21.15.2:0/441695896 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d78102810 0x7f0d781973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:02.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.213+0000 7f0d76d9d640 1 --2- 172.21.15.2:0/441695896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d7819c1c0 0x7f0d7819c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:02.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.213+0000 7f0d75d9b640 1 -- 172.21.15.2:0/441695896 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d78102810 msgr2=0x7f0d781973b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:02.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.213+0000 7f0d75d9b640 1 --2- 172.21.15.2:0/441695896 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d78102810 0x7f0d781973b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:02.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.213+0000 7f0d75d9b640 1 -- 172.21.15.2:0/441695896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d7819c1c0 msgr2=0x7f0d7819c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:02.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.213+0000 7f0d75d9b640 1 --2- 172.21.15.2:0/441695896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d7819c1c0 0x7f0d7819c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:02.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.213+0000 7f0d75d9b640 1 -- 172.21.15.2:0/441695896 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d781a3f30 con 0x7f0d781978f0 2024-09-19T06:07:02.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.213+0000 7f0d7659c640 1 --2- 172.21.15.2:0/441695896 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d78102810 0x7f0d781973b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:07:02.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.213+0000 7f0d76d9d640 1 --2- 172.21.15.2:0/441695896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d7819c1c0 0x7f0d7819c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:07:02.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.213+0000 7f0d75d9b640 1 --2- 172.21.15.2:0/441695896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d781978f0 0x7f0d7819bc80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00b520 tx=0x7f0d6c00b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:02.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.213+0000 7f0d677fe640 1 -- 172.21.15.2:0/441695896 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c004230 con 0x7f0d781978f0 2024-09-19T06:07:02.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.213+0000 7f0d677fe640 1 -- 172.21.15.2:0/441695896 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0d6c0043d0 con 0x7f0d781978f0 2024-09-19T06:07:02.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.213+0000 7f0d7ca17640 1 -- 172.21.15.2:0/441695896 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d781a4160 con 0x7f0d781978f0 2024-09-19T06:07:02.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.213+0000 7f0d677fe640 1 -- 172.21.15.2:0/441695896 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c003cf0 con 0x7f0d781978f0 2024-09-19T06:07:02.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.214+0000 7f0d7ca17640 1 -- 172.21.15.2:0/441695896 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d781a4670 con 0x7f0d781978f0 2024-09-19T06:07:02.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.214+0000 7f0d677fe640 1 -- 172.21.15.2:0/441695896 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f0d6c00e070 con 0x7f0d781978f0 2024-09-19T06:07:02.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.214+0000 7f0d677fe640 1 --2- 172.21.15.2:0/441695896 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f0d60039730 0x7f0d6003bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:02.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.215+0000 7f0d677fe640 1 -- 172.21.15.2:0/441695896 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f0d6c04bd60 con 0x7f0d781978f0 2024-09-19T06:07:02.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.215+0000 7f0d7ca17640 1 -- 172.21.15.2:0/441695896 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d78102c70 con 0x7f0d781978f0 2024-09-19T06:07:02.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.215+0000 7f0d7659c640 1 --2- 172.21.15.2:0/441695896 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f0d60039730 0x7f0d6003bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:02.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.215+0000 7f0d7659c640 1 --2- 172.21.15.2:0/441695896 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f0d60039730 0x7f0d6003bbf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0d68006010 tx=0x7f0d68005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:02.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.219+0000 7f0d677fe640 1 -- 172.21.15.2:0/441695896 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0d6c014020 con 0x7f0d781978f0 2024-09-19T06:07:02.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.398+0000 7f0d7ca17640 1 -- 172.21.15.2:0/441695896 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f0d781a4900 con 0x7f0d781978f0 2024-09-19T06:07:02.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.398+0000 7f0d677fe640 1 -- 172.21.15.2:0/441695896 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+269 (secure 0 0 0) 0x7f0d6c014200 con 0x7f0d781978f0 2024-09-19T06:07:02.400 INFO:teuthology.orchestra.run.smithi002.stdout:# minimal ceph.conf for 078f6612-764d-11ef-bceb-c7b262605968 2024-09-19T06:07:02.400 INFO:teuthology.orchestra.run.smithi002.stdout:[global] 2024-09-19T06:07:02.400 INFO:teuthology.orchestra.run.smithi002.stdout: fsid = 078f6612-764d-11ef-bceb-c7b262605968 2024-09-19T06:07:02.401 INFO:teuthology.orchestra.run.smithi002.stdout: mon_host = [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] 2024-09-19T06:07:02.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.400+0000 7f0d7ca17640 1 -- 172.21.15.2:0/441695896 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f0d60039730 msgr2=0x7f0d6003bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:02.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.400+0000 7f0d7ca17640 1 --2- 172.21.15.2:0/441695896 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f0d60039730 0x7f0d6003bbf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0d68006010 tx=0x7f0d68005a20 comp rx=0 tx=0).stop 2024-09-19T06:07:02.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.400+0000 7f0d7ca17640 1 -- 172.21.15.2:0/441695896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d781978f0 msgr2=0x7f0d7819bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:02.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.400+0000 7f0d7ca17640 1 --2- 172.21.15.2:0/441695896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d781978f0 0x7f0d7819bc80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00b520 tx=0x7f0d6c00b9e0 comp rx=0 tx=0).stop 2024-09-19T06:07:02.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.400+0000 7f0d7ca17640 1 -- 172.21.15.2:0/441695896 shutdown_connections 2024-09-19T06:07:02.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.400+0000 7f0d7ca17640 1 --2- 172.21.15.2:0/441695896 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f0d60039730 0x7f0d6003bbf0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:02.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.400+0000 7f0d7ca17640 1 --2- 172.21.15.2:0/441695896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d7819c1c0 0x7f0d7819c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:02.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.400+0000 7f0d7ca17640 1 --2- 172.21.15.2:0/441695896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d781978f0 0x7f0d7819bc80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:02.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.400+0000 7f0d7ca17640 1 --2- 172.21.15.2:0/441695896 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d78102810 0x7f0d781973b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:02.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.400+0000 7f0d7ca17640 1 -- 172.21.15.2:0/441695896 >> 172.21.15.2:0/441695896 conn(0x7f0d780fc1b0 msgr2=0x7f0d781055d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:02.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.400+0000 7f0d7ca17640 1 -- 172.21.15.2:0/441695896 shutdown_connections 2024-09-19T06:07:02.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:02.400+0000 7f0d7ca17640 1 -- 172.21.15.2:0/441695896 wait complete. 2024-09-19T06:07:03.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:02 smithi002 ceph-mon[30982]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:03.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:02 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:03.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:02 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:07:03.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:02 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/441695896' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:03.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:02 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:03.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:02 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:03.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:02 smithi002 ceph-mon[30982]: Reconfiguring mon.b (monmap changed)... 2024-09-19T06:07:03.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:02 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:07:03.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:02 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:07:03.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:02 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:03.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:02 smithi002 ceph-mon[30982]: Reconfiguring daemon mon.b on smithi089 2024-09-19T06:07:03.233 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:02 smithi089 ceph-mon[34160]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:03.233 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:02 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:03.233 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:02 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:07:03.233 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:02 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/441695896' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:03.233 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:02 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:03.233 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:02 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:03.233 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:02 smithi089 ceph-mon[34160]: Reconfiguring mon.b (monmap changed)... 2024-09-19T06:07:03.233 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:02 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:07:03.233 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:02 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:07:03.233 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:02 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:03.233 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:02 smithi089 ceph-mon[34160]: Reconfiguring daemon mon.b on smithi089 2024-09-19T06:07:03.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:02 smithi090 ceph-mon[34497]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:03.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:02 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:03.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:02 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:07:03.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:02 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/441695896' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:03.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:02 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:03.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:02 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:03.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:02 smithi090 ceph-mon[34497]: Reconfiguring mon.b (monmap changed)... 2024-09-19T06:07:03.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:02 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:07:03.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:02 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:07:03.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:02 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:03.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:02 smithi090 ceph-mon[34497]: Reconfiguring daemon mon.b on smithi089 2024-09-19T06:07:03.310 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-19T06:07:03.310 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-19T06:07:03.310 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T06:07:03.339 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-19T06:07:03.340 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:07:03.405 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-19T06:07:03.406 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T06:07:03.433 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-19T06:07:03.433 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:07:03.498 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-19T06:07:03.498 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T06:07:03.530 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-19T06:07:03.530 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:07:03.599 INFO:tasks.cephadm:Adding mgr.x on smithi002 2024-09-19T06:07:03.600 INFO:tasks.cephadm:Adding mgr.y on smithi089 2024-09-19T06:07:03.600 INFO:tasks.cephadm:Adding mgr.z on smithi090 2024-09-19T06:07:03.600 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi002=x;smithi089=y;smithi090=z' 2024-09-19T06:07:03.885 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:07:04.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.299+0000 7f481df6f640 1 -- 172.21.15.90:0/2635244074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4818100610 msgr2=0x7f4818100a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:04.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.299+0000 7f481df6f640 1 --2- 172.21.15.90:0/2635244074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4818100610 0x7f4818100a10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4808009880 tx=0x7f480802a5d0 comp rx=0 tx=0).stop 2024-09-19T06:07:04.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.299+0000 7f481df6f640 1 -- 172.21.15.90:0/2635244074 shutdown_connections 2024-09-19T06:07:04.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.299+0000 7f481df6f640 1 --2- 172.21.15.90:0/2635244074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4818100610 0x7f4818100a10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:04.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.299+0000 7f481df6f640 1 -- 172.21.15.90:0/2635244074 >> 172.21.15.90:0/2635244074 conn(0x7f48180fbdc0 msgr2=0x7f48180fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:04.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.299+0000 7f481df6f640 1 -- 172.21.15.90:0/2635244074 shutdown_connections 2024-09-19T06:07:04.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.300+0000 7f481df6f640 1 -- 172.21.15.90:0/2635244074 wait complete. 2024-09-19T06:07:04.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.300+0000 7f481df6f640 1 Processor -- start 2024-09-19T06:07:04.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.301+0000 7f481df6f640 1 -- start start 2024-09-19T06:07:04.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.301+0000 7f481df6f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4818100610 0x7f4818196f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:04.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.301+0000 7f481df6f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4818197460 0x7f481819c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:04.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.301+0000 7f481df6f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48181978e0 0x7f481819ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:04.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.301+0000 7f481df6f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f48181065b0 con 0x7f48181978e0 2024-09-19T06:07:04.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.301+0000 7f481df6f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4818106430 con 0x7f4818100610 2024-09-19T06:07:04.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.301+0000 7f481df6f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4818106730 con 0x7f4818197460 2024-09-19T06:07:04.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.301+0000 7f4816ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4818197460 0x7f481819c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:04.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.301+0000 7f4816ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4818197460 0x7f481819c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:42158/0 (socket says 172.21.15.90:42158) 2024-09-19T06:07:04.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.301+0000 7f4816ffd640 1 -- 172.21.15.90:0/613457575 learned_addr learned my addr 172.21.15.90:0/613457575 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-19T06:07:04.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.301+0000 7f4817fff640 1 --2- 172.21.15.90:0/613457575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48181978e0 0x7f481819ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:04.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.301+0000 7f48177fe640 1 --2- 172.21.15.90:0/613457575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4818100610 0x7f4818196f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:04.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.301+0000 7f4816ffd640 1 -- 172.21.15.90:0/613457575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4818100610 msgr2=0x7f4818196f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:04.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.301+0000 7f4816ffd640 1 --2- 172.21.15.90:0/613457575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4818100610 0x7f4818196f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:04.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.301+0000 7f4816ffd640 1 -- 172.21.15.90:0/613457575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48181978e0 msgr2=0x7f481819ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:04.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.301+0000 7f4816ffd640 1 --2- 172.21.15.90:0/613457575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48181978e0 0x7f481819ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:04.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.301+0000 7f4816ffd640 1 -- 172.21.15.90:0/613457575 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f481819f320 con 0x7f4818197460 2024-09-19T06:07:04.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.301+0000 7f4817fff640 1 --2- 172.21.15.90:0/613457575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48181978e0 0x7f481819ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:07:04.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.302+0000 7f4816ffd640 1 --2- 172.21.15.90:0/613457575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4818197460 0x7f481819c4d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f480c00b520 tx=0x7f480c00b9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:04.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.302+0000 7f4814ff9640 1 -- 172.21.15.90:0/613457575 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f480c004230 con 0x7f4818197460 2024-09-19T06:07:04.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.302+0000 7f481df6f640 1 -- 172.21.15.90:0/613457575 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f481819f610 con 0x7f4818197460 2024-09-19T06:07:04.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.302+0000 7f4814ff9640 1 -- 172.21.15.90:0/613457575 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f480c0043d0 con 0x7f4818197460 2024-09-19T06:07:04.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.302+0000 7f4814ff9640 1 -- 172.21.15.90:0/613457575 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f480c003cf0 con 0x7f4818197460 2024-09-19T06:07:04.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.302+0000 7f481df6f640 1 -- 172.21.15.90:0/613457575 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f481819fc20 con 0x7f4818197460 2024-09-19T06:07:04.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.303+0000 7f4814ff9640 1 -- 172.21.15.90:0/613457575 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f480c00e070 con 0x7f4818197460 2024-09-19T06:07:04.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.303+0000 7f4814ff9640 1 --2- 172.21.15.90:0/613457575 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f4800039730 0x7f480003bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:04.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.303+0000 7f4814ff9640 1 -- 172.21.15.90:0/613457575 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f480c04bc60 con 0x7f4818197460 2024-09-19T06:07:04.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.303+0000 7f481df6f640 1 -- 172.21.15.90:0/613457575 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f481819fee0 con 0x7f4818197460 2024-09-19T06:07:04.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.303+0000 7f48177fe640 1 --2- 172.21.15.90:0/613457575 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f4800039730 0x7f480003bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:04.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.304+0000 7f48177fe640 1 --2- 172.21.15.90:0/613457575 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f4800039730 0x7f480003bbf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f48080314e0 tx=0x7f4808005bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:04.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.308+0000 7f4814ff9640 1 -- 172.21.15.90:0/613457575 <== mon.1 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f480c014020 con 0x7f4818197460 2024-09-19T06:07:04.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.493+0000 7f481df6f640 1 -- 172.21.15.90:0/613457575 --> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi002=x;smithi089=y;smithi090=z", "target": ["mon-mgr", ""]}) -- 0x7f4818062630 con 0x7f4800039730 2024-09-19T06:07:04.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.499+0000 7f4814ff9640 1 -- 172.21.15.90:0/613457575 <== mgr.14150 v2:172.21.15.2:6800/4180340554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f4818062630 con 0x7f4800039730 2024-09-19T06:07:04.501 INFO:teuthology.orchestra.run.smithi090.stdout:Scheduled mgr update... 2024-09-19T06:07:04.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.501+0000 7f481df6f640 1 -- 172.21.15.90:0/613457575 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f4800039730 msgr2=0x7f480003bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:04.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.501+0000 7f481df6f640 1 --2- 172.21.15.90:0/613457575 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f4800039730 0x7f480003bbf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f48080314e0 tx=0x7f4808005bd0 comp rx=0 tx=0).stop 2024-09-19T06:07:04.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.501+0000 7f481df6f640 1 -- 172.21.15.90:0/613457575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4818197460 msgr2=0x7f481819c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:04.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.501+0000 7f481df6f640 1 --2- 172.21.15.90:0/613457575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4818197460 0x7f481819c4d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f480c00b520 tx=0x7f480c00b9e0 comp rx=0 tx=0).stop 2024-09-19T06:07:04.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.501+0000 7f481df6f640 1 -- 172.21.15.90:0/613457575 shutdown_connections 2024-09-19T06:07:04.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.501+0000 7f481df6f640 1 --2- 172.21.15.90:0/613457575 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f4800039730 0x7f480003bbf0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:04.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.501+0000 7f481df6f640 1 --2- 172.21.15.90:0/613457575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48181978e0 0x7f481819ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:04.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.501+0000 7f481df6f640 1 --2- 172.21.15.90:0/613457575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4818197460 0x7f481819c4d0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:04.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.501+0000 7f481df6f640 1 --2- 172.21.15.90:0/613457575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4818100610 0x7f4818196f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:04.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.501+0000 7f481df6f640 1 -- 172.21.15.90:0/613457575 >> 172.21.15.90:0/613457575 conn(0x7f48180fbdc0 msgr2=0x7f481806acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:04.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.501+0000 7f481df6f640 1 -- 172.21.15.90:0/613457575 shutdown_connections 2024-09-19T06:07:04.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:07:04.501+0000 7f481df6f640 1 -- 172.21.15.90:0/613457575 wait complete. 2024-09-19T06:07:05.093 DEBUG:teuthology.orchestra.run.smithi089:mgr.y> sudo journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@mgr.y.service 2024-09-19T06:07:05.096 DEBUG:teuthology.orchestra.run.smithi090:mgr.z> sudo journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@mgr.z.service 2024-09-19T06:07:05.098 INFO:tasks.cephadm:Deploying OSDs... 2024-09-19T06:07:05.098 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-19T06:07:05.098 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T06:07:05.117 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T06:07:05.117 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_1 2024-09-19T06:07:05.174 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T06:07:05.174 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:07:05.174 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-19T06:07:05.174 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:07:05.174 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:07:05.174 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-19 06:06:22.947911371 +0000 2024-09-19T06:07:05.174 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-19 06:02:19.448777031 +0000 2024-09-19T06:07:05.174 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-19 06:02:19.448777031 +0000 2024-09-19T06:07:05.174 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-19 06:02:19.448777031 +0000 2024-09-19T06:07:05.175 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T06:07:05.242 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-19T06:07:05.242 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-19T06:07:05.242 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000120568 s, 4.2 MB/s 2024-09-19T06:07:05.244 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T06:07:05.276 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:05 smithi090 ceph-mon[34497]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:05.276 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:05 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:05.276 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:05 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:05.276 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:05 smithi090 ceph-mon[34497]: Reconfiguring mon.c (monmap changed)... 2024-09-19T06:07:05.276 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:05 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:07:05.277 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:05 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:07:05.277 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:05 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:05.277 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:05 smithi090 ceph-mon[34497]: Reconfiguring daemon mon.c on smithi090 2024-09-19T06:07:05.277 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:05 smithi090 ceph-mon[34497]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi002=x;smithi089=y;smithi090=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:07:05.277 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:05 smithi090 ceph-mon[34497]: Saving service mgr spec with placement smithi002=x;smithi089=y;smithi090=z;count:3 2024-09-19T06:07:05.277 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:05 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:05.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:05 smithi089 ceph-mon[34160]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:05.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:05 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:05.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:05 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:05.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:05 smithi089 ceph-mon[34160]: Reconfiguring mon.c (monmap changed)... 2024-09-19T06:07:05.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:05 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:07:05.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:05 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:07:05.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:05 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:05.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:05 smithi089 ceph-mon[34160]: Reconfiguring daemon mon.c on smithi090 2024-09-19T06:07:05.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:05 smithi089 ceph-mon[34160]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi002=x;smithi089=y;smithi090=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:07:05.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:05 smithi089 ceph-mon[34160]: Saving service mgr spec with placement smithi002=x;smithi089=y;smithi090=z;count:3 2024-09-19T06:07:05.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:05 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:05.301 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_2 2024-09-19T06:07:05.359 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T06:07:05.359 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:07:05.360 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-19T06:07:05.360 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:07:05.360 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:07:05.360 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-19 06:06:22.977910701 +0000 2024-09-19T06:07:05.360 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-19 06:02:19.778769684 +0000 2024-09-19T06:07:05.360 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-19 06:02:19.778769684 +0000 2024-09-19T06:07:05.360 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-19 06:02:19.778769684 +0000 2024-09-19T06:07:05.360 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T06:07:05.423 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:05 smithi002 ceph-mon[30982]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:05.423 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:05 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:05.423 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:05 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:05.423 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:05 smithi002 ceph-mon[30982]: Reconfiguring mon.c (monmap changed)... 2024-09-19T06:07:05.423 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:05 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:07:05.423 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:05 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:07:05.423 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:05 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:05.423 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:05 smithi002 ceph-mon[30982]: Reconfiguring daemon mon.c on smithi090 2024-09-19T06:07:05.423 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:05 smithi002 ceph-mon[30982]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi002=x;smithi089=y;smithi090=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:07:05.424 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:05 smithi002 ceph-mon[30982]: Saving service mgr spec with placement smithi002=x;smithi089=y;smithi090=z;count:3 2024-09-19T06:07:05.424 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:05 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:05.425 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-19T06:07:05.425 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-19T06:07:05.425 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000108594 s, 4.7 MB/s 2024-09-19T06:07:05.426 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T06:07:05.484 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_3 2024-09-19T06:07:05.541 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T06:07:05.541 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:07:05.541 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-19T06:07:05.541 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:07:05.541 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:07:05.541 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-19 06:06:23.006910054 +0000 2024-09-19T06:07:05.541 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-19 06:02:20.114762203 +0000 2024-09-19T06:07:05.541 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-19 06:02:20.114762203 +0000 2024-09-19T06:07:05.542 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-19 06:02:20.114762203 +0000 2024-09-19T06:07:05.542 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T06:07:05.607 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-19T06:07:05.607 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-19T06:07:05.607 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000116835 s, 4.4 MB/s 2024-09-19T06:07:05.608 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T06:07:05.666 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_4 2024-09-19T06:07:05.723 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T06:07:05.723 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:07:05.723 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-19T06:07:05.724 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:07:05.724 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:07:05.724 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-19 06:06:23.036909385 +0000 2024-09-19T06:07:05.724 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-19 06:02:20.437755012 +0000 2024-09-19T06:07:05.724 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-19 06:02:20.437755012 +0000 2024-09-19T06:07:05.724 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-19 06:02:20.437755012 +0000 2024-09-19T06:07:05.724 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T06:07:05.789 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-19T06:07:05.789 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-19T06:07:05.789 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000115381 s, 4.4 MB/s 2024-09-19T06:07:05.790 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T06:07:05.848 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-19T06:07:05.848 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T06:07:05.867 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T06:07:05.868 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_1 2024-09-19T06:07:05.925 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T06:07:05.925 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:07:05.926 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-19T06:07:05.926 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:07:05.926 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:07:05.926 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-09-19 06:06:53.522365771 +0000 2024-09-19T06:07:05.926 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-09-19 06:02:14.179855983 +0000 2024-09-19T06:07:05.926 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-09-19 06:02:14.179855983 +0000 2024-09-19T06:07:05.926 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-09-19 06:02:14.179855983 +0000 2024-09-19T06:07:05.926 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T06:07:05.991 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-09-19T06:07:05.992 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-09-19T06:07:05.992 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.00022583 s, 2.3 MB/s 2024-09-19T06:07:05.993 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T06:07:06.051 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_2 2024-09-19T06:07:06.108 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T06:07:06.108 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:07:06.108 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-19T06:07:06.108 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:07:06.108 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:07:06.108 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-09-19 06:06:53.522365771 +0000 2024-09-19T06:07:06.108 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-09-19 06:02:14.501848678 +0000 2024-09-19T06:07:06.109 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-09-19 06:02:14.501848678 +0000 2024-09-19T06:07:06.109 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-09-19 06:02:14.501848678 +0000 2024-09-19T06:07:06.109 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T06:07:06.173 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-09-19T06:07:06.173 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-09-19T06:07:06.173 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000297784 s, 1.7 MB/s 2024-09-19T06:07:06.174 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T06:07:06.231 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_3 2024-09-19T06:07:06.287 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T06:07:06.288 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:07:06.288 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-19T06:07:06.288 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:07:06.288 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:07:06.288 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-09-19 06:06:53.522365771 +0000 2024-09-19T06:07:06.288 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-09-19 06:02:14.828841260 +0000 2024-09-19T06:07:06.288 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-09-19 06:02:14.828841260 +0000 2024-09-19T06:07:06.288 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-09-19 06:02:14.828841260 +0000 2024-09-19T06:07:06.288 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T06:07:06.351 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-09-19T06:07:06.352 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-09-19T06:07:06.352 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000257406 s, 2.0 MB/s 2024-09-19T06:07:06.353 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T06:07:06.410 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_4 2024-09-19T06:07:06.466 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T06:07:06.467 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:07:06.467 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-19T06:07:06.467 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:07:06.467 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:07:06.467 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-09-19 06:06:53.523365749 +0000 2024-09-19T06:07:06.467 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-09-19 06:02:15.151833933 +0000 2024-09-19T06:07:06.467 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-09-19 06:02:15.151833933 +0000 2024-09-19T06:07:06.467 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-09-19 06:02:15.151833933 +0000 2024-09-19T06:07:06.467 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T06:07:06.530 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-09-19T06:07:06.530 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-09-19T06:07:06.530 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.00019657 s, 2.6 MB/s 2024-09-19T06:07:06.531 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T06:07:06.588 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-19T06:07:06.588 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T06:07:06.604 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T06:07:06.604 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_1 2024-09-19T06:07:06.660 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T06:07:06.660 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:07:06.660 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-19T06:07:06.660 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:07:06.660 INFO:teuthology.orchestra.run.smithi090.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:07:06.660 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2024-09-19 06:06:44.859767870 +0000 2024-09-19T06:07:06.660 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2024-09-19 06:02:19.762651110 +0000 2024-09-19T06:07:06.660 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2024-09-19 06:02:19.762651110 +0000 2024-09-19T06:07:06.660 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: 2024-09-19 06:02:19.762651110 +0000 2024-09-19T06:07:06.660 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T06:07:06.724 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2024-09-19T06:07:06.724 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2024-09-19T06:07:06.724 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000343405 s, 1.5 MB/s 2024-09-19T06:07:06.726 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T06:07:06.782 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_2 2024-09-19T06:07:06.837 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T06:07:06.837 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:07:06.837 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-19T06:07:06.837 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:07:06.837 INFO:teuthology.orchestra.run.smithi090.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:07:06.837 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2024-09-19 06:06:44.859767870 +0000 2024-09-19T06:07:06.837 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2024-09-19 06:02:20.086646019 +0000 2024-09-19T06:07:06.837 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2024-09-19 06:02:20.086646019 +0000 2024-09-19T06:07:06.837 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: 2024-09-19 06:02:20.086646019 +0000 2024-09-19T06:07:06.838 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T06:07:06.900 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2024-09-19T06:07:06.900 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2024-09-19T06:07:06.900 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000177802 s, 2.9 MB/s 2024-09-19T06:07:06.901 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T06:07:06.958 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_3 2024-09-19T06:07:07.012 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T06:07:07.012 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:07:07.013 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-19T06:07:07.013 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:07:07.013 INFO:teuthology.orchestra.run.smithi090.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:07:07.013 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2024-09-19 06:06:44.860767854 +0000 2024-09-19T06:07:07.013 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2024-09-19 06:02:20.408640959 +0000 2024-09-19T06:07:07.013 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2024-09-19 06:02:20.408640959 +0000 2024-09-19T06:07:07.013 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: 2024-09-19 06:02:20.408640959 +0000 2024-09-19T06:07:07.013 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T06:07:07.076 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2024-09-19T06:07:07.076 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2024-09-19T06:07:07.076 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000192647 s, 2.7 MB/s 2024-09-19T06:07:07.077 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T06:07:07.133 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_4 2024-09-19T06:07:07.189 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T06:07:07.189 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:07:07.189 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-19T06:07:07.189 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:07:07.189 INFO:teuthology.orchestra.run.smithi090.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:07:07.189 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2024-09-19 06:06:44.860767854 +0000 2024-09-19T06:07:07.189 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2024-09-19 06:02:20.726635962 +0000 2024-09-19T06:07:07.189 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2024-09-19 06:02:20.726635962 +0000 2024-09-19T06:07:07.189 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: 2024-09-19 06:02:20.726635962 +0000 2024-09-19T06:07:07.190 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T06:07:07.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:06 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:07.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:06 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:07.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:06 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:07.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:06 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:07.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:06 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:07.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:06 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:07.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:06 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:07:07.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:06 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T06:07:07.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:06 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:07:07.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:06 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:07.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:06 smithi002 ceph-mon[30982]: Deploying daemon mgr.z on smithi090 2024-09-19T06:07:07.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:06 smithi002 ceph-mon[30982]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:07.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:06 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:07.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:06 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:07.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:06 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:07.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:06 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:07.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:06 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:07.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:06 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:07.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:06 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:07:07.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:06 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T06:07:07.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:06 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:07:07.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:06 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:07.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:06 smithi090 ceph-mon[34497]: Deploying daemon mgr.z on smithi090 2024-09-19T06:07:07.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:06 smithi090 ceph-mon[34497]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:07.252 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2024-09-19T06:07:07.252 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2024-09-19T06:07:07.252 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000190177 s, 2.7 MB/s 2024-09-19T06:07:07.253 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T06:07:07.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:06 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:07.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:06 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:07.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:06 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:07.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:06 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:07.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:06 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:07.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:06 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:07.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:06 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:07:07.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:06 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T06:07:07.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:06 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:07:07.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:06 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:07.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:06 smithi089 ceph-mon[34160]: Deploying daemon mgr.z on smithi090 2024-09-19T06:07:07.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:06 smithi089 ceph-mon[34160]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:07.310 INFO:tasks.cephadm:Deploying osd.0 on smithi002 with /dev/vg_nvme/lv_4... 2024-09-19T06:07:07.310 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T06:07:07.573 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:07:07.963 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:07:07 smithi090 systemd[1]: Starting Ceph mgr.z for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:07:08.225 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:07:07 smithi090 podman[36287]: 2024-09-19 06:07:07.864115941 +0000 UTC m=+0.015756848 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:07:08.225 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:07:07 smithi090 podman[36287]: 2024-09-19 06:07:07.9675179 +0000 UTC m=+0.119158804 container create dbce46062315ffbfb32897cf0229a8efb5ff89d635ab4dc3f4bc2d069481cdf7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux ) 2024-09-19T06:07:08.225 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:07:08 smithi090 podman[36287]: 2024-09-19 06:07:08.195268085 +0000 UTC m=+0.346908992 container init dbce46062315ffbfb32897cf0229a8efb5ff89d635ab4dc3f4bc2d069481cdf7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-19T06:07:08.225 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:07:08 smithi090 podman[36287]: 2024-09-19 06:07:08.198889345 +0000 UTC m=+0.350530250 container start dbce46062315ffbfb32897cf0229a8efb5ff89d635ab4dc3f4bc2d069481cdf7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:07:08.225 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:07:08 smithi090 ceph-mgr[36306]: -- 172.21.15.90:0/370765483 <== mon.1 v2:172.21.15.90:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557abc8130e0 con 0x557abc7f0800 2024-09-19T06:07:08.490 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:07:08 smithi090 bash[36287]: dbce46062315ffbfb32897cf0229a8efb5ff89d635ab4dc3f4bc2d069481cdf7 2024-09-19T06:07:08.490 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:07:08 smithi090 systemd[1]: Started Ceph mgr.z for 078f6612-764d-11ef-bceb-c7b262605968. 2024-09-19T06:07:08.490 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:07:08 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:07:08.322+0000 7f715e52d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T06:07:08.490 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:07:08 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:07:08.393+0000 7f715e52d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T06:07:08.890 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:07:08 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:07:08.542+0000 7f715e52d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T06:07:08.890 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:07:08 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:07:08.607+0000 7f715e52d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T06:07:08.890 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:07:08 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:07:08.751+0000 7f715e52d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:07:08.890 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:07:08 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:07:08.888+0000 7f715e52d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T06:07:09.490 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:07:09 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:07:09.196+0000 7f715e52d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T06:07:09.490 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:07:09 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:07:09.255+0000 7f715e52d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T06:07:09.490 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:07:09 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:07:09.437+0000 7f715e52d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T06:07:09.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:09 smithi090 ceph-mon[34497]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:09.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:09 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:09.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:09 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:09.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:09 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:09.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:09 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:07:09.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:09 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T06:07:09.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:09 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:07:09.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:09 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:09.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:09 smithi090 ceph-mon[34497]: Deploying daemon mgr.y on smithi089 2024-09-19T06:07:09.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:09 smithi002 ceph-mon[30982]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:09.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:09 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:09.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:09 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:09.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:09 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:09.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:09 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:07:09.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:09 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T06:07:09.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:09 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:07:09.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:09 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:09.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:09 smithi002 ceph-mon[30982]: Deploying daemon mgr.y on smithi089 2024-09-19T06:07:09.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:09 smithi089 ceph-mon[34160]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:09.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:09 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:09.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:09 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:09.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:09 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:09.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:09 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:07:09.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:09 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T06:07:09.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:09 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:07:09.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:09 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:09.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:09 smithi089 ceph-mon[34160]: Deploying daemon mgr.y on smithi089 2024-09-19T06:07:10.087 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:07:10.113 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi002:vg_nvme/lv_4 2024-09-19T06:07:10.363 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:07:10.542 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:07:10 smithi089 systemd[1]: Starting Ceph mgr.y for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:07:10.740 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:07:10 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:07:10.311+0000 7f715e52d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T06:07:10.740 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:07:10 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:07:10.377+0000 7f715e52d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T06:07:10.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:10.788+0000 7f9a2f4ee640 1 -- 172.21.15.2:0/2155542104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a28102e10 msgr2=0x7f9a28103290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:10.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:10.788+0000 7f9a2f4ee640 1 --2- 172.21.15.2:0/2155542104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a28102e10 0x7f9a28103290 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9a18009900 tx=0x7f9a1802a410 comp rx=0 tx=0).stop 2024-09-19T06:07:10.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:10.788+0000 7f9a2f4ee640 1 -- 172.21.15.2:0/2155542104 shutdown_connections 2024-09-19T06:07:10.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:10.788+0000 7f9a2f4ee640 1 --2- 172.21.15.2:0/2155542104 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a281037d0 0x7f9a2810a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:10.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:10.788+0000 7f9a2f4ee640 1 --2- 172.21.15.2:0/2155542104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a28102e10 0x7f9a28103290 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:10.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:10.788+0000 7f9a2f4ee640 1 --2- 172.21.15.2:0/2155542104 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a28101c10 0x7f9a28102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:10.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:10.788+0000 7f9a2f4ee640 1 -- 172.21.15.2:0/2155542104 >> 172.21.15.2:0/2155542104 conn(0x7f9a280fd3c0 msgr2=0x7f9a280ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:10.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:10.788+0000 7f9a2f4ee640 1 -- 172.21.15.2:0/2155542104 shutdown_connections 2024-09-19T06:07:10.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:10.788+0000 7f9a2f4ee640 1 -- 172.21.15.2:0/2155542104 wait complete. 2024-09-19T06:07:10.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:10.789+0000 7f9a2f4ee640 1 Processor -- start 2024-09-19T06:07:10.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:10.789+0000 7f9a2f4ee640 1 -- start start 2024-09-19T06:07:10.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:10.789+0000 7f9a2f4ee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a28101c10 0x7f9a28197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:10.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:10.789+0000 7f9a2f4ee640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a28102e10 0x7f9a28198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:10.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:10.789+0000 7f9a2f4ee640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a281037d0 0x7f9a2819f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:10.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:10.789+0000 7f9a2f4ee640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9a2810d720 con 0x7f9a28101c10 2024-09-19T06:07:10.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:10.789+0000 7f9a2f4ee640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9a2810d5a0 con 0x7f9a28102e10 2024-09-19T06:07:10.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:10.789+0000 7f9a2f4ee640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9a2810d8a0 con 0x7f9a281037d0 2024-09-19T06:07:10.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:10.789+0000 7f9a2d28a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a28101c10 0x7f9a28197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:10.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:10.789+0000 7f9a2d28a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a28101c10 0x7f9a28197e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45104/0 (socket says 172.21.15.2:45104) 2024-09-19T06:07:10.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:10.789+0000 7f9a2d28a640 1 -- 172.21.15.2:0/3048149706 learned_addr learned my addr 172.21.15.2:0/3048149706 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:07:10.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:10.789+0000 7f9a2ca89640 1 --2- 172.21.15.2:0/3048149706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a28102e10 0x7f9a28198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:10.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:10.789+0000 7f9a2da8b640 1 --2- 172.21.15.2:0/3048149706 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a281037d0 0x7f9a2819f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:10.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:10.789+0000 7f9a2d28a640 1 -- 172.21.15.2:0/3048149706 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a281037d0 msgr2=0x7f9a2819f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:10.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:10.789+0000 7f9a2d28a640 1 --2- 172.21.15.2:0/3048149706 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a281037d0 0x7f9a2819f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:10.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:10.789+0000 7f9a2d28a640 1 -- 172.21.15.2:0/3048149706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a28102e10 msgr2=0x7f9a28198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:10.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:10.789+0000 7f9a2d28a640 1 --2- 172.21.15.2:0/3048149706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a28102e10 0x7f9a28198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:10.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:10.789+0000 7f9a2d28a640 1 -- 172.21.15.2:0/3048149706 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a2819fa50 con 0x7f9a28101c10 2024-09-19T06:07:10.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:10.790+0000 7f9a2d28a640 1 --2- 172.21.15.2:0/3048149706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a28101c10 0x7f9a28197e20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9a2400e9c0 tx=0x7f9a2400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:10.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:10.790+0000 7f9a1e7fc640 1 -- 172.21.15.2:0/3048149706 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a2400cd80 con 0x7f9a28101c10 2024-09-19T06:07:10.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:10.790+0000 7f9a2f4ee640 1 -- 172.21.15.2:0/3048149706 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a2819fd40 con 0x7f9a28101c10 2024-09-19T06:07:10.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:10.790+0000 7f9a1e7fc640 1 -- 172.21.15.2:0/3048149706 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9a240035f0 con 0x7f9a28101c10 2024-09-19T06:07:10.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:10.790+0000 7f9a1e7fc640 1 -- 172.21.15.2:0/3048149706 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a24010690 con 0x7f9a28101c10 2024-09-19T06:07:10.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:10.790+0000 7f9a2f4ee640 1 -- 172.21.15.2:0/3048149706 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a281a0190 con 0x7f9a28101c10 2024-09-19T06:07:10.795 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:07:10 smithi089 podman[35511]: 2024-09-19 06:07:10.443115382 +0000 UTC m=+0.015428016 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:07:10.795 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:07:10 smithi089 podman[35511]: 2024-09-19 06:07:10.541931854 +0000 UTC m=+0.114244484 container create a85a1cae896c99f0e8ef37d17bc88f23a3756938746cb1fdbff0bdb2fc0c0622 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:07:10.795 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:07:10 smithi089 podman[35511]: 2024-09-19 06:07:10.752511436 +0000 UTC m=+0.324824076 container init a85a1cae896c99f0e8ef37d17bc88f23a3756938746cb1fdbff0bdb2fc0c0622 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4) 2024-09-19T06:07:10.795 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:07:10 smithi089 podman[35511]: 2024-09-19 06:07:10.755248999 +0000 UTC m=+0.327561630 container start a85a1cae896c99f0e8ef37d17bc88f23a3756938746cb1fdbff0bdb2fc0c0622 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-19T06:07:10.796 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:07:10 smithi089 ceph-mgr[35530]: -- 172.21.15.89:0/3786828218 <== mon.2 v2:172.21.15.89:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555ae29210e0 con 0x555ae28ff400 2024-09-19T06:07:10.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:10.791+0000 7f9a1e7fc640 1 -- 172.21.15.2:0/3048149706 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f9a240037a0 con 0x7f9a28101c10 2024-09-19T06:07:10.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:10.791+0000 7f9a2f4ee640 1 -- 172.21.15.2:0/3048149706 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a281090a0 con 0x7f9a28101c10 2024-09-19T06:07:10.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:10.791+0000 7f9a1e7fc640 1 --2- 172.21.15.2:0/3048149706 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f9a14039500 0x7f9a1403b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:10.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:10.791+0000 7f9a1e7fc640 1 -- 172.21.15.2:0/3048149706 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f9a2404c9c0 con 0x7f9a28101c10 2024-09-19T06:07:10.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:10.791+0000 7f9a2ca89640 1 --2- 172.21.15.2:0/3048149706 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f9a14039500 0x7f9a1403b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:10.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:10.792+0000 7f9a2ca89640 1 --2- 172.21.15.2:0/3048149706 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f9a14039500 0x7f9a1403b9c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9a18006010 tx=0x7f9a18000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:10.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:10.796+0000 7f9a1e7fc640 1 -- 172.21.15.2:0/3048149706 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9a2404ee20 con 0x7f9a28101c10 2024-09-19T06:07:10.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:10.982+0000 7f9a2f4ee640 1 -- 172.21.15.2:0/3048149706 --> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f9a28062630 con 0x7f9a14039500 2024-09-19T06:07:11.093 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:07:10 smithi089 bash[35511]: a85a1cae896c99f0e8ef37d17bc88f23a3756938746cb1fdbff0bdb2fc0c0622 2024-09-19T06:07:11.093 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:07:10 smithi089 systemd[1]: Started Ceph mgr.y for 078f6612-764d-11ef-bceb-c7b262605968. 2024-09-19T06:07:11.093 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:07:10 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:07:10.875+0000 7face6f69040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T06:07:11.093 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:07:10 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:07:10.934+0000 7face6f69040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T06:07:11.093 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:07:11 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:07:11.090+0000 7face6f69040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T06:07:11.383 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:07:11 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:07:11.097+0000 7f715e52d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T06:07:11.383 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:07:11 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:07:11.217+0000 7f715e52d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T06:07:11.383 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:07:11 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:07:11.158+0000 7face6f69040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T06:07:11.383 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:07:11 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:07:11.317+0000 7face6f69040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:07:11.657 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:11 smithi002 ceph-mon[30982]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:11.657 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:11 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:11.657 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:11 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:11.657 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:11 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:11.657 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:11 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:11.657 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:11 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:07:11.657 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:11 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:07:11.658 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:11 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:11.658 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:11 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:11.682 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:11 smithi090 ceph-mon[34497]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:11.683 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:11 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:11.683 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:11 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:11.683 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:11 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:11.683 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:11 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:11.683 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:11 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:07:11.683 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:11 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:07:11.683 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:11 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:11.683 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:11 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:11.683 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:07:11 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:07:11.391+0000 7f715e52d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:07:11.683 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:07:11 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:07:11.456+0000 7f715e52d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T06:07:11.683 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:07:11 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:07:11.608+0000 7f715e52d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T06:07:11.684 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:07:11 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:07:11.680+0000 7f715e52d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T06:07:11.714 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:07:11 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:07:11.466+0000 7face6f69040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T06:07:11.714 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:11 smithi089 ceph-mon[34160]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:11.714 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:11 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:11.714 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:11 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:11.714 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:11 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:11.714 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:11 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:11.714 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:11 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:07:11.715 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:11 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:07:11.715 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:11 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:11.715 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:11 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:11.978 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:07:11 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:07:11.751+0000 7f715e52d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T06:07:11.978 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:07:11 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:07:11.911+0000 7f715e52d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T06:07:11.979 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:07:11 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:07:11.976+0000 7f715e52d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T06:07:12.042 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:07:11 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:07:11.789+0000 7face6f69040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T06:07:12.042 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:07:11 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:07:11.851+0000 7face6f69040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T06:07:12.240 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:07:12 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:07:12.051+0000 7f715e52d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T06:07:12.240 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:07:12 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:07:12.135+0000 7f715e52d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T06:07:12.240 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:07:12 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:07:12.198+0000 7f715e52d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T06:07:12.387 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:07:12 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:07:12.047+0000 7face6f69040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T06:07:12.579 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:12 smithi002 ceph-mon[30982]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:07:12.579 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:12 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:12.579 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:12 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:12.579 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:12 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:12.579 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:12 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:12.579 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:12 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:12.580 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:12 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:12.580 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:12 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:12.580 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:12 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:12.580 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:12 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:07:12.580 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:12 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:07:12.580 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:12 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:12.740 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:07:12 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:07:12.258+0000 7f715e52d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T06:07:12.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:12 smithi090 ceph-mon[34497]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:07:12.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:12 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:12.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:12 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:12.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:12 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:12.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:12 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:12.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:12 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:12.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:12 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:12.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:12 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:12.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:12 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:12.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:12 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:07:12.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:12 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:07:12.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:12 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:12.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:12 smithi089 ceph-mon[34160]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:07:12.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:12 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:12.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:12 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:12.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:12 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:12.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:12 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:12.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:12 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:12.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:12 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:12.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:12 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:12.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:12 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:12.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:12 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:07:12.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:12 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:07:12.794 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:12 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:13.292 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:07:12 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:07:12.929+0000 7face6f69040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T06:07:13.292 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:07:12 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:07:12.996+0000 7face6f69040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T06:07:13.388 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:07:13 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:07:13.037+0000 7f715e52d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T06:07:13.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:13.394+0000 7f9a1e7fc640 1 -- 172.21.15.2:0/3048149706 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 14) ==== 92407+0+0 (secure 0 0 0) 0x7f9a240217c0 con 0x7f9a28101c10 2024-09-19T06:07:13.718 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:13 smithi089 ceph-mon[34160]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:13.719 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:13 smithi089 ceph-mon[34160]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T06:07:13.719 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:13 smithi089 ceph-mon[34160]: Reconfiguring daemon mgr.x on smithi002 2024-09-19T06:07:13.719 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:13 smithi089 ceph-mon[34160]: Standby manager daemon z started 2024-09-19T06:07:13.719 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:13 smithi089 ceph-mon[34160]: from='mgr.? 172.21.15.90:0/3189886812' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T06:07:13.719 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:13 smithi089 ceph-mon[34160]: from='mgr.? 172.21.15.90:0/3189886812' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:07:13.719 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:13 smithi089 ceph-mon[34160]: from='mgr.? 172.21.15.90:0/3189886812' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T06:07:13.719 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:13 smithi089 ceph-mon[34160]: from='mgr.? 172.21.15.90:0/3189886812' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:07:13.719 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:13 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1003288063' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0de97a3d-2d27-455b-9998-ddd2319c148d"}]: dispatch 2024-09-19T06:07:13.719 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:13 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1003288063' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0de97a3d-2d27-455b-9998-ddd2319c148d"}]': finished 2024-09-19T06:07:13.720 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:13 smithi089 ceph-mon[34160]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T06:07:13.720 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:13 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:07:13.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:13 smithi002 ceph-mon[30982]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:13.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:13 smithi002 ceph-mon[30982]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T06:07:13.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:13 smithi002 ceph-mon[30982]: Reconfiguring daemon mgr.x on smithi002 2024-09-19T06:07:13.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:13 smithi002 ceph-mon[30982]: Standby manager daemon z started 2024-09-19T06:07:13.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:13 smithi002 ceph-mon[30982]: from='mgr.? 172.21.15.90:0/3189886812' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T06:07:13.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:13 smithi002 ceph-mon[30982]: from='mgr.? 172.21.15.90:0/3189886812' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:07:13.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:13 smithi002 ceph-mon[30982]: from='mgr.? 172.21.15.90:0/3189886812' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T06:07:13.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:13 smithi002 ceph-mon[30982]: from='mgr.? 172.21.15.90:0/3189886812' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:07:13.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:13 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1003288063' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0de97a3d-2d27-455b-9998-ddd2319c148d"}]: dispatch 2024-09-19T06:07:13.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:13 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1003288063' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0de97a3d-2d27-455b-9998-ddd2319c148d"}]': finished 2024-09-19T06:07:13.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:13 smithi002 ceph-mon[30982]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T06:07:13.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:13 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:07:13.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:13 smithi090 ceph-mon[34497]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:13.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:13 smithi090 ceph-mon[34497]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T06:07:13.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:13 smithi090 ceph-mon[34497]: Reconfiguring daemon mgr.x on smithi002 2024-09-19T06:07:13.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:13 smithi090 ceph-mon[34497]: Standby manager daemon z started 2024-09-19T06:07:13.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:13 smithi090 ceph-mon[34497]: from='mgr.? 172.21.15.90:0/3189886812' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T06:07:13.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:13 smithi090 ceph-mon[34497]: from='mgr.? 172.21.15.90:0/3189886812' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:07:13.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:13 smithi090 ceph-mon[34497]: from='mgr.? 172.21.15.90:0/3189886812' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T06:07:13.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:13 smithi090 ceph-mon[34497]: from='mgr.? 172.21.15.90:0/3189886812' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:07:13.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:13 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1003288063' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0de97a3d-2d27-455b-9998-ddd2319c148d"}]: dispatch 2024-09-19T06:07:13.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:13 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1003288063' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0de97a3d-2d27-455b-9998-ddd2319c148d"}]': finished 2024-09-19T06:07:13.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:13 smithi090 ceph-mon[34497]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T06:07:13.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:13 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:07:13.974 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:07:13 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:07:13.715+0000 7face6f69040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T06:07:13.975 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:07:13 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:07:13.830+0000 7face6f69040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T06:07:13.975 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:07:13 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:07:13.971+0000 7face6f69040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:07:14.250 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:07:14 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:07:14.032+0000 7face6f69040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T06:07:14.250 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:07:14 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:07:14.180+0000 7face6f69040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T06:07:14.251 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:07:14 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:07:14.247+0000 7face6f69040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T06:07:14.534 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:14 smithi089 ceph-mon[34160]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-19T06:07:14.534 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:14 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T06:07:14.535 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:14 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1962778421' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:07:14.535 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:07:14 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:07:14.307+0000 7face6f69040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T06:07:14.535 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:07:14 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:07:14.466+0000 7face6f69040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T06:07:14.535 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:07:14 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:07:14.531+0000 7face6f69040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T06:07:14.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:14 smithi002 ceph-mon[30982]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-19T06:07:14.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:14 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T06:07:14.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:14 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1962778421' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:07:14.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:14 smithi090 ceph-mon[34497]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-19T06:07:14.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:14 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T06:07:14.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:14 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1962778421' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:07:14.792 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:07:14 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:07:14.598+0000 7face6f69040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T06:07:14.792 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:07:14 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:07:14.680+0000 7face6f69040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T06:07:14.792 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:07:14 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:07:14.739+0000 7face6f69040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T06:07:15.292 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:07:14 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:07:14.798+0000 7face6f69040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T06:07:15.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:15 smithi002 ceph-mon[30982]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:15.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:15 smithi090 ceph-mon[34497]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:15.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:15 smithi089 ceph-mon[34160]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:15.793 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:07:15 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:07:15.583+0000 7face6f69040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T06:07:16.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:16.409+0000 7f9a1e7fc640 1 -- 172.21.15.2:0/3048149706 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mgrmap(e 15) ==== 138298+0+0 (secure 0 0 0) 0x7f9a240203a0 con 0x7f9a28101c10 2024-09-19T06:07:16.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:16 smithi002 ceph-mon[30982]: Standby manager daemon y started 2024-09-19T06:07:16.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:16 smithi002 ceph-mon[30982]: from='mgr.? 172.21.15.89:0/572946804' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T06:07:16.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:16 smithi002 ceph-mon[30982]: from='mgr.? 172.21.15.89:0/572946804' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:07:16.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:16 smithi002 ceph-mon[30982]: from='mgr.? 172.21.15.89:0/572946804' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T06:07:16.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:16 smithi002 ceph-mon[30982]: from='mgr.? 172.21.15.89:0/572946804' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:07:16.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:16 smithi090 ceph-mon[34497]: Standby manager daemon y started 2024-09-19T06:07:16.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:16 smithi090 ceph-mon[34497]: from='mgr.? 172.21.15.89:0/572946804' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T06:07:16.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:16 smithi090 ceph-mon[34497]: from='mgr.? 172.21.15.89:0/572946804' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:07:16.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:16 smithi090 ceph-mon[34497]: from='mgr.? 172.21.15.89:0/572946804' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T06:07:16.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:16 smithi090 ceph-mon[34497]: from='mgr.? 172.21.15.89:0/572946804' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:07:16.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:16 smithi089 ceph-mon[34160]: Standby manager daemon y started 2024-09-19T06:07:16.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:16 smithi089 ceph-mon[34160]: from='mgr.? 172.21.15.89:0/572946804' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T06:07:16.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:16 smithi089 ceph-mon[34160]: from='mgr.? 172.21.15.89:0/572946804' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:07:16.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:16 smithi089 ceph-mon[34160]: from='mgr.? 172.21.15.89:0/572946804' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T06:07:16.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:16 smithi089 ceph-mon[34160]: from='mgr.? 172.21.15.89:0/572946804' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:07:17.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:17 smithi002 ceph-mon[30982]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:17.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:17 smithi002 ceph-mon[30982]: mgrmap e15: x(active, since 64s), standbys: z, y 2024-09-19T06:07:17.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:17 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T06:07:17.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:17 smithi090 ceph-mon[34497]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:17.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:17 smithi090 ceph-mon[34497]: mgrmap e15: x(active, since 64s), standbys: z, y 2024-09-19T06:07:17.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:17 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T06:07:17.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:17 smithi089 ceph-mon[34160]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:17.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:17 smithi089 ceph-mon[34160]: mgrmap e15: x(active, since 64s), standbys: z, y 2024-09-19T06:07:17.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:17 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T06:07:19.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:19 smithi002 ceph-mon[30982]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:19.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:19 smithi090 ceph-mon[34497]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:19.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:19 smithi089 ceph-mon[34160]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:21.566 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:21 smithi002 ceph-mon[30982]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:21.566 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:21 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:21.566 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:21 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:21.566 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:21 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:21.566 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:21 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:21.566 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:21 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:21.566 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:21 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:21.594 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:21 smithi089 ceph-mon[34160]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:21.595 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:21 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:21.595 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:21 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:21.595 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:21 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:21.595 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:21 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:21.595 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:21 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:21.595 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:21 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:21.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:21 smithi090 ceph-mon[34497]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:21.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:21 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:21.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:21 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:21.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:21 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:21.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:21 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:21.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:21 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:21.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:21 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:23.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:23 smithi002 ceph-mon[30982]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:23.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:23 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T06:07:23.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:23 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:23.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:23 smithi002 ceph-mon[30982]: Deploying daemon osd.0 on smithi002 2024-09-19T06:07:23.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:23 smithi090 ceph-mon[34497]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:23.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:23 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T06:07:23.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:23 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:23.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:23 smithi090 ceph-mon[34497]: Deploying daemon osd.0 on smithi002 2024-09-19T06:07:23.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:23 smithi089 ceph-mon[34160]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:23.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:23 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T06:07:23.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:23 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:23.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:23 smithi089 ceph-mon[34160]: Deploying daemon osd.0 on smithi002 2024-09-19T06:07:25.673 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:25 smithi002 ceph-mon[30982]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:25.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:25 smithi090 ceph-mon[34497]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:25.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:25 smithi089 ceph-mon[34160]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:27.621 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:27 smithi002 ceph-mon[30982]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:27.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:27 smithi090 ceph-mon[34497]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:27.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:27 smithi089 ceph-mon[34160]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:29.581 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:29 smithi002 ceph-mon[30982]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:29.581 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:29 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:29.581 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:29 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:29.581 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:29 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:29.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:29 smithi090 ceph-mon[34497]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:29.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:29 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:29.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:29 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:29.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:29 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:29.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:29 smithi089 ceph-mon[34160]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:29.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:29 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:29.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:29 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:29.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:29 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:31.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:31 smithi002 ceph-mon[30982]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:31.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:31 smithi090 ceph-mon[34497]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:31.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:31 smithi089 ceph-mon[34160]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:32.650 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:32 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:32.651 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:32 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:32.651 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:32 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:32.651 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:32 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:32.651 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:32 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:32.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:32 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:32.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:32 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:32.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:32 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:32.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:32 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:32.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:32 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:32.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:32 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:32.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:32 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:32.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:32 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:32.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:32 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:32.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:32 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:32.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:32.935+0000 7f9a1e7fc640 1 -- 172.21.15.2:0/3048149706 <== mgr.14150 v2:172.21.15.2:6800/4180340554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9a28062630 con 0x7f9a14039500 2024-09-19T06:07:32.939 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 0 on host 'smithi002' 2024-09-19T06:07:32.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:32.940+0000 7f9a2f4ee640 1 -- 172.21.15.2:0/3048149706 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f9a14039500 msgr2=0x7f9a1403b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:32.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:32.940+0000 7f9a2f4ee640 1 --2- 172.21.15.2:0/3048149706 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f9a14039500 0x7f9a1403b9c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9a18006010 tx=0x7f9a18000bc0 comp rx=0 tx=0).stop 2024-09-19T06:07:32.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:32.940+0000 7f9a2f4ee640 1 -- 172.21.15.2:0/3048149706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a28101c10 msgr2=0x7f9a28197e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:32.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:32.940+0000 7f9a2f4ee640 1 --2- 172.21.15.2:0/3048149706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a28101c10 0x7f9a28197e20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9a2400e9c0 tx=0x7f9a2400ee80 comp rx=0 tx=0).stop 2024-09-19T06:07:32.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:32.940+0000 7f9a2f4ee640 1 -- 172.21.15.2:0/3048149706 shutdown_connections 2024-09-19T06:07:32.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:32.940+0000 7f9a2f4ee640 1 --2- 172.21.15.2:0/3048149706 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f9a14039500 0x7f9a1403b9c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:32.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:32.940+0000 7f9a2f4ee640 1 --2- 172.21.15.2:0/3048149706 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a281037d0 0x7f9a2819f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:32.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:32.940+0000 7f9a2f4ee640 1 --2- 172.21.15.2:0/3048149706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a28102e10 0x7f9a28198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:32.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:32.940+0000 7f9a2f4ee640 1 --2- 172.21.15.2:0/3048149706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a28101c10 0x7f9a28197e20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:32.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:32.940+0000 7f9a2f4ee640 1 -- 172.21.15.2:0/3048149706 >> 172.21.15.2:0/3048149706 conn(0x7f9a280fd3c0 msgr2=0x7f9a28106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:32.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:32.940+0000 7f9a2f4ee640 1 -- 172.21.15.2:0/3048149706 shutdown_connections 2024-09-19T06:07:32.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:07:32.940+0000 7f9a2f4ee640 1 -- 172.21.15.2:0/3048149706 wait complete. 2024-09-19T06:07:33.506 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:33 smithi002 ceph-mon[30982]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:33.507 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:33 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:33.507 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:33 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:33.507 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:33 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:33.539 DEBUG:teuthology.orchestra.run.smithi002:osd.0> sudo journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@osd.0.service 2024-09-19T06:07:33.541 INFO:tasks.cephadm:Deploying osd.1 on smithi089 with /dev/vg_nvme/lv_4... 2024-09-19T06:07:33.541 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T06:07:33.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:33 smithi090 ceph-mon[34497]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:33.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:33 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:33.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:33 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:33.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:33 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:33.778 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:07:33.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:33 smithi089 ceph-mon[34160]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:33.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:33 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:33.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:33 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:33.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:33 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:35.387 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:35 smithi002 ceph-mon[30982]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:35.388 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:35 smithi002 ceph-mon[30982]: from='osd.0 [v2:172.21.15.2:6802/915165910,v1:172.21.15.2:6803/915165910]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T06:07:35.388 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:35 smithi002 ceph-mon[30982]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T06:07:35.388 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 06:07:35 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-0[44988]: 2024-09-19T06:07:35.105+0000 7efd0ba82640 -1 osd.0 0 log_to_monitors true 2024-09-19T06:07:35.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:35 smithi089 ceph-mon[34160]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:35.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:35 smithi089 ceph-mon[34160]: from='osd.0 [v2:172.21.15.2:6802/915165910,v1:172.21.15.2:6803/915165910]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T06:07:35.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:35 smithi089 ceph-mon[34160]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T06:07:35.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:35 smithi090 ceph-mon[34497]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:35.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:35 smithi090 ceph-mon[34497]: from='osd.0 [v2:172.21.15.2:6802/915165910,v1:172.21.15.2:6803/915165910]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T06:07:35.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:35 smithi090 ceph-mon[34497]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T06:07:36.146 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-19T06:07:36.171 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi089:vg_nvme/lv_4 2024-09-19T06:07:36.423 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:07:36.653 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:36 smithi089 ceph-mon[34160]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T06:07:36.653 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:36 smithi089 ceph-mon[34160]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T06:07:36.653 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:36 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:07:36.653 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:36 smithi089 ceph-mon[34160]: from='osd.0 [v2:172.21.15.2:6802/915165910,v1:172.21.15.2:6803/915165910]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-19T06:07:36.653 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:36 smithi089 ceph-mon[34160]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-19T06:07:36.653 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:36 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:36.653 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:36 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:36.654 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:36 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:36.654 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:36 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:36.654 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:36 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:36.654 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:36 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:36.654 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:36 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:36.722 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 06:07:36 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-0[44988]: 2024-09-19T06:07:36.366+0000 7efd071e2640 -1 osd.0 0 waiting for initial osdmap 2024-09-19T06:07:36.722 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 06:07:36 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-0[44988]: 2024-09-19T06:07:36.369+0000 7efd0381c640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:07:36.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:36 smithi002 ceph-mon[30982]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T06:07:36.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:36 smithi002 ceph-mon[30982]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T06:07:36.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:36 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:07:36.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:36 smithi002 ceph-mon[30982]: from='osd.0 [v2:172.21.15.2:6802/915165910,v1:172.21.15.2:6803/915165910]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-19T06:07:36.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:36 smithi002 ceph-mon[30982]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-19T06:07:36.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:36 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:36.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:36 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:36.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:36 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:36.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:36 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:36.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:36 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:36.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:36 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:36.724 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:36 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:36.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:36 smithi090 ceph-mon[34497]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T06:07:36.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:36 smithi090 ceph-mon[34497]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T06:07:36.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:36 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:07:36.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:36 smithi090 ceph-mon[34497]: from='osd.0 [v2:172.21.15.2:6802/915165910,v1:172.21.15.2:6803/915165910]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-19T06:07:36.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:36 smithi090 ceph-mon[34497]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-19T06:07:36.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:36 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:36.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:36 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:36.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:36 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:36.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:36 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:36.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:36 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:36.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:36 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:36.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:36 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:36.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:36.898+0000 7f9c744cd640 1 -- 172.21.15.89:0/2187638893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c6c107960 msgr2=0x7f9c6c109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:36.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:36.898+0000 7f9c744cd640 1 --2- 172.21.15.89:0/2187638893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c6c107960 0x7f9c6c109d50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9c64009ca0 tx=0x7f9c6402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:07:36.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:36.898+0000 7f9c744cd640 1 -- 172.21.15.89:0/2187638893 shutdown_connections 2024-09-19T06:07:36.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:36.898+0000 7f9c744cd640 1 --2- 172.21.15.89:0/2187638893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c6c107960 0x7f9c6c109d50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:36.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:36.898+0000 7f9c744cd640 1 --2- 172.21.15.89:0/2187638893 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c6c105030 0x7f9c6c107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:36.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:36.898+0000 7f9c744cd640 1 --2- 172.21.15.89:0/2187638893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c6c102700 0x7f9c6c104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:36.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:36.898+0000 7f9c744cd640 1 -- 172.21.15.89:0/2187638893 >> 172.21.15.89:0/2187638893 conn(0x7f9c6c0fc280 msgr2=0x7f9c6c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:36.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:36.898+0000 7f9c744cd640 1 -- 172.21.15.89:0/2187638893 shutdown_connections 2024-09-19T06:07:36.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:36.898+0000 7f9c744cd640 1 -- 172.21.15.89:0/2187638893 wait complete. 2024-09-19T06:07:36.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:36.899+0000 7f9c744cd640 1 Processor -- start 2024-09-19T06:07:36.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:36.899+0000 7f9c744cd640 1 -- start start 2024-09-19T06:07:36.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:36.899+0000 7f9c744cd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c6c102700 0x7f9c6c197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:36.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:36.899+0000 7f9c744cd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c6c105030 0x7f9c6c198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:36.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:36.899+0000 7f9c744cd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c6c107960 0x7f9c6c19f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:36.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:36.899+0000 7f9c744cd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9c6c10d710 con 0x7f9c6c102700 2024-09-19T06:07:36.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:36.899+0000 7f9c744cd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9c6c10d590 con 0x7f9c6c105030 2024-09-19T06:07:36.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:36.899+0000 7f9c744cd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9c6c10d890 con 0x7f9c6c107960 2024-09-19T06:07:36.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:36.899+0000 7f9c71a68640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c6c105030 0x7f9c6c198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:36.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:36.899+0000 7f9c71a68640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c6c105030 0x7f9c6c198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37132/0 (socket says 172.21.15.89:37132) 2024-09-19T06:07:36.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:36.899+0000 7f9c71a68640 1 -- 172.21.15.89:0/2272078262 learned_addr learned my addr 172.21.15.89:0/2272078262 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-19T06:07:36.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:36.899+0000 7f9c72a6a640 1 --2- 172.21.15.89:0/2272078262 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c6c107960 0x7f9c6c19f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:36.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:36.899+0000 7f9c72269640 1 --2- 172.21.15.89:0/2272078262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c6c102700 0x7f9c6c197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:36.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:36.899+0000 7f9c71a68640 1 -- 172.21.15.89:0/2272078262 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c6c107960 msgr2=0x7f9c6c19f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:36.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:36.899+0000 7f9c71a68640 1 --2- 172.21.15.89:0/2272078262 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c6c107960 0x7f9c6c19f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:36.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:36.899+0000 7f9c71a68640 1 -- 172.21.15.89:0/2272078262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c6c102700 msgr2=0x7f9c6c197e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:36.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:36.899+0000 7f9c71a68640 1 --2- 172.21.15.89:0/2272078262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c6c102700 0x7f9c6c197e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:36.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:36.900+0000 7f9c71a68640 1 -- 172.21.15.89:0/2272078262 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c6c19fa30 con 0x7f9c6c105030 2024-09-19T06:07:36.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:36.900+0000 7f9c72269640 1 --2- 172.21.15.89:0/2272078262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c6c102700 0x7f9c6c197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:07:36.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:36.900+0000 7f9c71a68640 1 --2- 172.21.15.89:0/2272078262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c6c105030 0x7f9c6c198340 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9c6800c970 tx=0x7f9c6800ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:36.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:36.900+0000 7f9c637fe640 1 -- 172.21.15.89:0/2272078262 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c68007bb0 con 0x7f9c6c105030 2024-09-19T06:07:36.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:36.900+0000 7f9c637fe640 1 -- 172.21.15.89:0/2272078262 <== mon.2 v2:172.21.15.89:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9c68007d50 con 0x7f9c6c105030 2024-09-19T06:07:36.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:36.900+0000 7f9c744cd640 1 -- 172.21.15.89:0/2272078262 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c6c19fd20 con 0x7f9c6c105030 2024-09-19T06:07:36.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:36.900+0000 7f9c637fe640 1 -- 172.21.15.89:0/2272078262 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c6800f450 con 0x7f9c6c105030 2024-09-19T06:07:36.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:36.900+0000 7f9c744cd640 1 -- 172.21.15.89:0/2272078262 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c6c1a0250 con 0x7f9c6c105030 2024-09-19T06:07:36.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:36.901+0000 7f9c744cd640 1 -- 172.21.15.89:0/2272078262 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c6c0fdd70 con 0x7f9c6c105030 2024-09-19T06:07:36.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:36.902+0000 7f9c637fe640 1 -- 172.21.15.89:0/2272078262 <== mon.2 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 15) ==== 138298+0+0 (secure 0 0 0) 0x7f9c68004f20 con 0x7f9c6c105030 2024-09-19T06:07:36.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:36.903+0000 7f9c637fe640 1 --2- 172.21.15.89:0/2272078262 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f9c580a3260 0x7f9c580a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:36.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:36.903+0000 7f9c637fe640 1 -- 172.21.15.89:0/2272078262 <== mon.2 v2:172.21.15.89:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f9c680cd910 con 0x7f9c6c105030 2024-09-19T06:07:36.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:36.903+0000 7f9c72269640 1 --2- 172.21.15.89:0/2272078262 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f9c580a3260 0x7f9c580a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:36.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:36.903+0000 7f9c72269640 1 --2- 172.21.15.89:0/2272078262 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f9c580a3260 0x7f9c580a5720 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c0058c0 tx=0x7f9c5c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:36.909 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:36.907+0000 7f9c637fe640 1 -- 172.21.15.89:0/2272078262 <== mon.2 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9c68014030 con 0x7f9c6c105030 2024-09-19T06:07:37.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:37.088+0000 7f9c744cd640 1 -- 172.21.15.89:0/2272078262 --> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f9c6c062630 con 0x7f9c580a3260 2024-09-19T06:07:37.639 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:37 smithi089 ceph-mon[34160]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:37.639 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:37 smithi089 ceph-mon[34160]: Detected new or changed devices on smithi002 2024-09-19T06:07:37.639 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:37 smithi089 ceph-mon[34160]: Adjusting osd_memory_target on smithi002 to 17092M 2024-09-19T06:07:37.639 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:37 smithi089 ceph-mon[34160]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-19T06:07:37.639 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:37 smithi089 ceph-mon[34160]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T06:07:37.639 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:37 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:07:37.639 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:37 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:07:37.639 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:37 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:07:37.639 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:37 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:07:37.640 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:37 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:37.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:37 smithi002 ceph-mon[30982]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:37.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:37 smithi002 ceph-mon[30982]: Detected new or changed devices on smithi002 2024-09-19T06:07:37.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:37 smithi002 ceph-mon[30982]: Adjusting osd_memory_target on smithi002 to 17092M 2024-09-19T06:07:37.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:37 smithi002 ceph-mon[30982]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-19T06:07:37.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:37 smithi002 ceph-mon[30982]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T06:07:37.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:37 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:07:37.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:37 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:07:37.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:37 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:07:37.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:37 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:07:37.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:37 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:37.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:37 smithi090 ceph-mon[34497]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:37.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:37 smithi090 ceph-mon[34497]: Detected new or changed devices on smithi002 2024-09-19T06:07:37.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:37 smithi090 ceph-mon[34497]: Adjusting osd_memory_target on smithi002 to 17092M 2024-09-19T06:07:37.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:37 smithi090 ceph-mon[34497]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-19T06:07:37.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:37 smithi090 ceph-mon[34497]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T06:07:37.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:37 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:07:37.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:37 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:07:37.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:37 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:07:37.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:37 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:07:37.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:37 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:38.629 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:38 smithi089 ceph-mon[34160]: purged_snaps scrub starts 2024-09-19T06:07:38.629 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:38 smithi089 ceph-mon[34160]: purged_snaps scrub ok 2024-09-19T06:07:38.629 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:38 smithi089 ceph-mon[34160]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:07:38.629 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:38 smithi089 ceph-mon[34160]: osd.0 [v2:172.21.15.2:6802/915165910,v1:172.21.15.2:6803/915165910] boot 2024-09-19T06:07:38.629 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:38 smithi089 ceph-mon[34160]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T06:07:38.629 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:38 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:07:38.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:38 smithi002 ceph-mon[30982]: purged_snaps scrub starts 2024-09-19T06:07:38.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:38 smithi002 ceph-mon[30982]: purged_snaps scrub ok 2024-09-19T06:07:38.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:38 smithi002 ceph-mon[30982]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:07:38.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:38 smithi002 ceph-mon[30982]: osd.0 [v2:172.21.15.2:6802/915165910,v1:172.21.15.2:6803/915165910] boot 2024-09-19T06:07:38.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:38 smithi002 ceph-mon[30982]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T06:07:38.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:38 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:07:38.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:38 smithi090 ceph-mon[34497]: purged_snaps scrub starts 2024-09-19T06:07:38.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:38 smithi090 ceph-mon[34497]: purged_snaps scrub ok 2024-09-19T06:07:38.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:38 smithi090 ceph-mon[34497]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:07:38.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:38 smithi090 ceph-mon[34497]: osd.0 [v2:172.21.15.2:6802/915165910,v1:172.21.15.2:6803/915165910] boot 2024-09-19T06:07:38.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:38 smithi090 ceph-mon[34497]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T06:07:38.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:38 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:07:39.653 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:39 smithi089 ceph-mon[34160]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:39.653 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:39 smithi089 ceph-mon[34160]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T06:07:39.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:39 smithi002 ceph-mon[30982]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:39.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:39 smithi002 ceph-mon[30982]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T06:07:39.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:39 smithi090 ceph-mon[34497]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:07:39.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:39 smithi090 ceph-mon[34497]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T06:07:40.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:40 smithi002 ceph-mon[30982]: from='client.? 172.21.15.89:0/1122572570' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "056d229e-2de4-4902-922e-21e1a5d3f061"}]: dispatch 2024-09-19T06:07:40.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:40 smithi002 ceph-mon[30982]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "056d229e-2de4-4902-922e-21e1a5d3f061"}]: dispatch 2024-09-19T06:07:40.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:40 smithi002 ceph-mon[30982]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "056d229e-2de4-4902-922e-21e1a5d3f061"}]': finished 2024-09-19T06:07:40.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:40 smithi002 ceph-mon[30982]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T06:07:40.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:40 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:07:40.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:40 smithi002 ceph-mon[30982]: from='client.? 172.21.15.89:0/1987518084' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:07:40.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:40 smithi090 ceph-mon[34497]: from='client.? 172.21.15.89:0/1122572570' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "056d229e-2de4-4902-922e-21e1a5d3f061"}]: dispatch 2024-09-19T06:07:40.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:40 smithi090 ceph-mon[34497]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "056d229e-2de4-4902-922e-21e1a5d3f061"}]: dispatch 2024-09-19T06:07:40.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:40 smithi090 ceph-mon[34497]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "056d229e-2de4-4902-922e-21e1a5d3f061"}]': finished 2024-09-19T06:07:40.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:40 smithi090 ceph-mon[34497]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T06:07:40.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:40 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:07:40.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:40 smithi090 ceph-mon[34497]: from='client.? 172.21.15.89:0/1987518084' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:07:40.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:40 smithi089 ceph-mon[34160]: from='client.? 172.21.15.89:0/1122572570' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "056d229e-2de4-4902-922e-21e1a5d3f061"}]: dispatch 2024-09-19T06:07:40.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:40 smithi089 ceph-mon[34160]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "056d229e-2de4-4902-922e-21e1a5d3f061"}]: dispatch 2024-09-19T06:07:40.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:40 smithi089 ceph-mon[34160]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "056d229e-2de4-4902-922e-21e1a5d3f061"}]': finished 2024-09-19T06:07:40.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:40 smithi089 ceph-mon[34160]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T06:07:40.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:40 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:07:40.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:40 smithi089 ceph-mon[34160]: from='client.? 172.21.15.89:0/1987518084' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:07:41.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:41 smithi002 ceph-mon[30982]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:07:41.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:41 smithi090 ceph-mon[34497]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:07:41.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:41 smithi089 ceph-mon[34160]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:07:43.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:43 smithi002 ceph-mon[30982]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:07:43.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:43 smithi090 ceph-mon[34497]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:07:43.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:43 smithi089 ceph-mon[34160]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:07:45.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:45 smithi002 ceph-mon[30982]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:07:45.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:45 smithi090 ceph-mon[34497]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:07:45.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:45 smithi089 ceph-mon[34160]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:07:47.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:47 smithi002 ceph-mon[30982]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:07:47.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:47 smithi090 ceph-mon[34497]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:07:47.757 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:47 smithi089 ceph-mon[34160]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:07:48.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:48 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T06:07:48.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:48 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:48.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:48 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T06:07:48.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:48 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:48.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:48 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T06:07:48.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:48 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:49.627 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:49 smithi089 ceph-mon[34160]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:07:49.627 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:49 smithi089 ceph-mon[34160]: Deploying daemon osd.1 on smithi089 2024-09-19T06:07:49.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:49 smithi002 ceph-mon[30982]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:07:49.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:49 smithi002 ceph-mon[30982]: Deploying daemon osd.1 on smithi089 2024-09-19T06:07:49.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:49 smithi090 ceph-mon[34497]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:07:49.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:49 smithi090 ceph-mon[34497]: Deploying daemon osd.1 on smithi089 2024-09-19T06:07:51.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:51 smithi089 ceph-mon[34160]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:07:51.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:51 smithi002 ceph-mon[30982]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:07:51.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:51 smithi090 ceph-mon[34497]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:07:53.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:53 smithi002 ceph-mon[30982]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:07:53.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:53 smithi090 ceph-mon[34497]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:07:53.770 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:53 smithi089 ceph-mon[34160]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:07:54.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:54 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:54.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:54 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:54.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:54 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:54.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:54 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:54.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:54 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:54.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:54 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:54.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:54 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:54.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:54 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:54.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:54 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:55.738 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:55 smithi089 ceph-mon[34160]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:07:55.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:55 smithi090 ceph-mon[34497]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:07:55.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:55 smithi002 ceph-mon[30982]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:07:57.639 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:57 smithi089 ceph-mon[34160]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:07:57.639 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:57 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:57.639 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:57 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:57.639 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:57 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:57.640 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:57 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:57.640 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:57 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:57.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:57 smithi090 ceph-mon[34497]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:07:57.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:57 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:57.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:57 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:57.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:57 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:57.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:57 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:57.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:57 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:57.971 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:57.968+0000 7f9c637fe640 1 -- 172.21.15.89:0/2272078262 <== mgr.14150 v2:172.21.15.2:6800/4180340554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9c6c062630 con 0x7f9c580a3260 2024-09-19T06:07:57.971 INFO:teuthology.orchestra.run.smithi089.stdout:Created osd(s) 1 on host 'smithi089' 2024-09-19T06:07:57.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:57 smithi002 ceph-mon[30982]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:07:57.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:57 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:57.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:57 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:57.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:57 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:57.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:57 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:57.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:57 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:57.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:57.970+0000 7f9c744cd640 1 -- 172.21.15.89:0/2272078262 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f9c580a3260 msgr2=0x7f9c580a5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:57.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:57.970+0000 7f9c744cd640 1 --2- 172.21.15.89:0/2272078262 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f9c580a3260 0x7f9c580a5720 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c0058c0 tx=0x7f9c5c005850 comp rx=0 tx=0).stop 2024-09-19T06:07:57.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:57.970+0000 7f9c744cd640 1 -- 172.21.15.89:0/2272078262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c6c105030 msgr2=0x7f9c6c198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:57.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:57.970+0000 7f9c744cd640 1 --2- 172.21.15.89:0/2272078262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c6c105030 0x7f9c6c198340 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9c6800c970 tx=0x7f9c6800ce30 comp rx=0 tx=0).stop 2024-09-19T06:07:57.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:57.970+0000 7f9c744cd640 1 -- 172.21.15.89:0/2272078262 shutdown_connections 2024-09-19T06:07:57.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:57.970+0000 7f9c744cd640 1 --2- 172.21.15.89:0/2272078262 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f9c580a3260 0x7f9c580a5720 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:57.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:57.970+0000 7f9c744cd640 1 --2- 172.21.15.89:0/2272078262 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c6c107960 0x7f9c6c19f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:57.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:57.970+0000 7f9c744cd640 1 --2- 172.21.15.89:0/2272078262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c6c105030 0x7f9c6c198340 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:57.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:57.970+0000 7f9c744cd640 1 --2- 172.21.15.89:0/2272078262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c6c102700 0x7f9c6c197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:57.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:57.970+0000 7f9c744cd640 1 -- 172.21.15.89:0/2272078262 >> 172.21.15.89:0/2272078262 conn(0x7f9c6c0fc280 msgr2=0x7f9c6c1031e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:57.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:57.971+0000 7f9c744cd640 1 -- 172.21.15.89:0/2272078262 shutdown_connections 2024-09-19T06:07:57.974 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:07:57.971+0000 7f9c744cd640 1 -- 172.21.15.89:0/2272078262 wait complete. 2024-09-19T06:07:58.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:58 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:58.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:58 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:58.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:58 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:58.619 DEBUG:teuthology.orchestra.run.smithi089:osd.1> sudo journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@osd.1.service 2024-09-19T06:07:58.622 INFO:tasks.cephadm:Deploying osd.2 on smithi090 with /dev/vg_nvme/lv_4... 2024-09-19T06:07:58.622 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T06:07:58.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:58 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:58.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:58 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:58.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:58 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:58.874 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:07:58.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:58 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:58.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:58 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:58.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:58 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:07:59.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:07:59 smithi090 ceph-mon[34497]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:07:59.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:07:59 smithi089 ceph-mon[34160]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:07:59.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:07:59 smithi002 ceph-mon[30982]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:08:00.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:00 smithi090 ceph-mon[34497]: from='osd.1 [v2:172.21.15.89:6800/4097264171,v1:172.21.15.89:6801/4097264171]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T06:08:00.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:00 smithi090 ceph-mon[34497]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T06:08:00.787 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:00 smithi089 ceph-mon[34160]: from='osd.1 [v2:172.21.15.89:6800/4097264171,v1:172.21.15.89:6801/4097264171]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T06:08:00.788 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:00 smithi089 ceph-mon[34160]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T06:08:00.788 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 19 06:08:00 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-1[38628]: 2024-09-19T06:08:00.455+0000 7fdc8c6aa640 -1 osd.1 0 log_to_monitors true 2024-09-19T06:08:00.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:00 smithi002 ceph-mon[30982]: from='osd.1 [v2:172.21.15.89:6800/4097264171,v1:172.21.15.89:6801/4097264171]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T06:08:00.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:00 smithi002 ceph-mon[30982]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T06:08:01.177 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-19T06:08:01.201 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi090:vg_nvme/lv_4 2024-09-19T06:08:01.448 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:08:01.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:01 smithi090 ceph-mon[34497]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:08:01.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:01 smithi090 ceph-mon[34497]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T06:08:01.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:01 smithi090 ceph-mon[34497]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T06:08:01.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:01 smithi090 ceph-mon[34497]: from='osd.1 [v2:172.21.15.89:6800/4097264171,v1:172.21.15.89:6801/4097264171]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-19T06:08:01.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:01 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:08:01.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:01 smithi090 ceph-mon[34497]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-19T06:08:01.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:01 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:01.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:01 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:01.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:01 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:08:01.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:01 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:01.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:01 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:01.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:01 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:08:01.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:01 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:01.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:01 smithi089 ceph-mon[34160]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:08:01.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:01 smithi089 ceph-mon[34160]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T06:08:01.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:01 smithi089 ceph-mon[34160]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T06:08:01.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:01 smithi089 ceph-mon[34160]: from='osd.1 [v2:172.21.15.89:6800/4097264171,v1:172.21.15.89:6801/4097264171]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-19T06:08:01.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:01 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:08:01.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:01 smithi089 ceph-mon[34160]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-19T06:08:01.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:01 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:01.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:01 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:01.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:01 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:08:01.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:01 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:01.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:01 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:01.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:01 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:08:01.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:01 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:01.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:01.910+0000 7f995c0d7640 1 -- 172.21.15.90:0/1062915137 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9954102690 msgr2=0x7f9954108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:01.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:01.910+0000 7f995c0d7640 1 --2- 172.21.15.90:0/1062915137 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9954102690 0x7f9954108f20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f994c009ca0 tx=0x7f994c02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:08:01.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:01.911+0000 7f995c0d7640 1 -- 172.21.15.90:0/1062915137 shutdown_connections 2024-09-19T06:08:01.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:01.911+0000 7f995c0d7640 1 --2- 172.21.15.90:0/1062915137 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9954102690 0x7f9954108f20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:01.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:01.911+0000 7f995c0d7640 1 --2- 172.21.15.90:0/1062915137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9954101cd0 0x7f9954102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:01.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:01.911+0000 7f995c0d7640 1 --2- 172.21.15.90:0/1062915137 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9954100ad0 0x7f9954100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:01.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:01.911+0000 7f995c0d7640 1 -- 172.21.15.90:0/1062915137 >> 172.21.15.90:0/1062915137 conn(0x7f99540fc280 msgr2=0x7f99540fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:01.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:01.911+0000 7f995c0d7640 1 -- 172.21.15.90:0/1062915137 shutdown_connections 2024-09-19T06:08:01.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:01.911+0000 7f995c0d7640 1 -- 172.21.15.90:0/1062915137 wait complete. 2024-09-19T06:08:01.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:01.911+0000 7f995c0d7640 1 Processor -- start 2024-09-19T06:08:01.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:01.911+0000 7f995c0d7640 1 -- start start 2024-09-19T06:08:01.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:01.911+0000 7f995c0d7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9954100ad0 0x7f9954197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:01.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:01.911+0000 7f995c0d7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9954101cd0 0x7f9954198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:01.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:01.911+0000 7f995c0d7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9954102690 0x7f995419f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:01.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:01.911+0000 7f995c0d7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f995410c600 con 0x7f9954101cd0 2024-09-19T06:08:01.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:01.911+0000 7f995c0d7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f995410c480 con 0x7f9954100ad0 2024-09-19T06:08:01.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:01.911+0000 7f995c0d7640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f995410c780 con 0x7f9954102690 2024-09-19T06:08:01.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:01.912+0000 7f9959e73640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9954100ad0 0x7f9954197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:01.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:01.912+0000 7f995a674640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9954102690 0x7f995419f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:01.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:01.912+0000 7f9959e73640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9954100ad0 0x7f9954197dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.90:53754/0 (socket says 172.21.15.90:53754) 2024-09-19T06:08:01.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:01.912+0000 7f9959e73640 1 -- 172.21.15.90:0/166500631 learned_addr learned my addr 172.21.15.90:0/166500631 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-19T06:08:01.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:01.912+0000 7f9959672640 1 --2- 172.21.15.90:0/166500631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9954101cd0 0x7f9954198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:01.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:01.912+0000 7f995a674640 1 -- 172.21.15.90:0/166500631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9954100ad0 msgr2=0x7f9954197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:01.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:01.912+0000 7f995a674640 1 --2- 172.21.15.90:0/166500631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9954100ad0 0x7f9954197dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:01.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:01.912+0000 7f995a674640 1 -- 172.21.15.90:0/166500631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9954101cd0 msgr2=0x7f9954198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:01.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:01.912+0000 7f995a674640 1 --2- 172.21.15.90:0/166500631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9954101cd0 0x7f9954198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:01.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:01.912+0000 7f995a674640 1 -- 172.21.15.90:0/166500631 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f995419fa00 con 0x7f9954102690 2024-09-19T06:08:01.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:01.912+0000 7f995a674640 1 --2- 172.21.15.90:0/166500631 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9954102690 0x7f995419f390 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f994c031040 tx=0x7f994c003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:01.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:01.912+0000 7f994affd640 1 -- 172.21.15.90:0/166500631 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994c004040 con 0x7f9954102690 2024-09-19T06:08:01.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:01.912+0000 7f994affd640 1 -- 172.21.15.90:0/166500631 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f994c004690 con 0x7f9954102690 2024-09-19T06:08:01.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:01.912+0000 7f995c0d7640 1 -- 172.21.15.90:0/166500631 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f995419fc90 con 0x7f9954102690 2024-09-19T06:08:01.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:01.912+0000 7f994affd640 1 -- 172.21.15.90:0/166500631 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994c030c30 con 0x7f9954102690 2024-09-19T06:08:01.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:01.912+0000 7f995c0d7640 1 -- 172.21.15.90:0/166500631 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99541a0180 con 0x7f9954102690 2024-09-19T06:08:01.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:01.913+0000 7f995c0d7640 1 -- 172.21.15.90:0/166500631 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99541a03b0 con 0x7f9954102690 2024-09-19T06:08:01.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:01.915+0000 7f994affd640 1 -- 172.21.15.90:0/166500631 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 15) ==== 138298+0+0 (secure 0 0 0) 0x7f994c0041e0 con 0x7f9954102690 2024-09-19T06:08:01.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:01.916+0000 7f994affd640 1 --2- 172.21.15.90:0/166500631 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f99400a31e0 0x7f99400a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:01.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:01.916+0000 7f994affd640 1 -- 172.21.15.90:0/166500631 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7f994c0ef470 con 0x7f9954102690 2024-09-19T06:08:01.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:01.916+0000 7f9959e73640 1 --2- 172.21.15.90:0/166500631 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f99400a31e0 0x7f99400a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:01.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:01.916+0000 7f9959e73640 1 --2- 172.21.15.90:0/166500631 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f99400a31e0 0x7f99400a56a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f99500058c0 tx=0x7f9950005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:01.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:01.919+0000 7f994affd640 1 -- 172.21.15.90:0/166500631 <== mon.1 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f994c0bdb00 con 0x7f9954102690 2024-09-19T06:08:01.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:01 smithi002 ceph-mon[30982]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:08:01.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:01 smithi002 ceph-mon[30982]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T06:08:01.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:01 smithi002 ceph-mon[30982]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T06:08:01.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:01 smithi002 ceph-mon[30982]: from='osd.1 [v2:172.21.15.89:6800/4097264171,v1:172.21.15.89:6801/4097264171]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-19T06:08:01.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:01 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:08:01.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:01 smithi002 ceph-mon[30982]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-19T06:08:01.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:01 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:01.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:01 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:01.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:01 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:08:01.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:01 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:01.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:01 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:01.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:01 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:08:01.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:01 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:02.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:02.101+0000 7f995c0d7640 1 -- 172.21.15.90:0/166500631 --> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f99541a0580 con 0x7f99400a31e0 2024-09-19T06:08:02.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:02 smithi090 ceph-mon[34497]: Detected new or changed devices on smithi089 2024-09-19T06:08:02.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:02 smithi090 ceph-mon[34497]: Adjusting osd_memory_target on smithi089 to 17087M 2024-09-19T06:08:02.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:02 smithi090 ceph-mon[34497]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-19T06:08:02.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:02 smithi090 ceph-mon[34497]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T06:08:02.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:02 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:08:02.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:02 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:08:02.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:02 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:08:02.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:02 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:08:02.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:02 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:02.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:02 smithi090 ceph-mon[34497]: from='osd.1 ' entity='osd.1' 2024-09-19T06:08:02.792 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 19 06:08:02 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-1[38628]: 2024-09-19T06:08:02.325+0000 7fdc87e0a640 -1 osd.1 0 waiting for initial osdmap 2024-09-19T06:08:02.792 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 19 06:08:02 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-1[38628]: 2024-09-19T06:08:02.330+0000 7fdc8043c640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:08:02.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:02 smithi089 ceph-mon[34160]: Detected new or changed devices on smithi089 2024-09-19T06:08:02.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:02 smithi089 ceph-mon[34160]: Adjusting osd_memory_target on smithi089 to 17087M 2024-09-19T06:08:02.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:02 smithi089 ceph-mon[34160]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-19T06:08:02.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:02 smithi089 ceph-mon[34160]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T06:08:02.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:02 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:08:02.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:02 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:08:02.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:02 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:08:02.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:02 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:08:02.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:02 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:02.794 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:02 smithi089 ceph-mon[34160]: from='osd.1 ' entity='osd.1' 2024-09-19T06:08:02.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:02 smithi002 ceph-mon[30982]: Detected new or changed devices on smithi089 2024-09-19T06:08:02.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:02 smithi002 ceph-mon[30982]: Adjusting osd_memory_target on smithi089 to 17087M 2024-09-19T06:08:02.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:02 smithi002 ceph-mon[30982]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-19T06:08:02.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:02 smithi002 ceph-mon[30982]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T06:08:02.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:02 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:08:02.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:02 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:08:02.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:02 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:08:02.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:02 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:08:02.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:02 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:02.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:02 smithi002 ceph-mon[30982]: from='osd.1 ' entity='osd.1' 2024-09-19T06:08:03.691 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:03 smithi090 ceph-mon[34497]: purged_snaps scrub starts 2024-09-19T06:08:03.691 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:03 smithi090 ceph-mon[34497]: purged_snaps scrub ok 2024-09-19T06:08:03.691 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:03 smithi090 ceph-mon[34497]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:08:03.691 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:03 smithi090 ceph-mon[34497]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:08:03.692 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:03 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:08:03.692 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:03 smithi090 ceph-mon[34497]: osd.1 [v2:172.21.15.89:6800/4097264171,v1:172.21.15.89:6801/4097264171] boot 2024-09-19T06:08:03.692 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:03 smithi090 ceph-mon[34497]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T06:08:03.692 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:03 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:08:03.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:03 smithi089 ceph-mon[34160]: purged_snaps scrub starts 2024-09-19T06:08:03.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:03 smithi089 ceph-mon[34160]: purged_snaps scrub ok 2024-09-19T06:08:03.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:03 smithi089 ceph-mon[34160]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:08:03.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:03 smithi089 ceph-mon[34160]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:08:03.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:03 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:08:03.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:03 smithi089 ceph-mon[34160]: osd.1 [v2:172.21.15.89:6800/4097264171,v1:172.21.15.89:6801/4097264171] boot 2024-09-19T06:08:03.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:03 smithi089 ceph-mon[34160]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T06:08:03.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:03 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:08:03.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:03 smithi002 ceph-mon[30982]: purged_snaps scrub starts 2024-09-19T06:08:03.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:03 smithi002 ceph-mon[30982]: purged_snaps scrub ok 2024-09-19T06:08:03.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:03 smithi002 ceph-mon[30982]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:08:03.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:03 smithi002 ceph-mon[30982]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:08:03.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:03 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:08:03.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:03 smithi002 ceph-mon[30982]: osd.1 [v2:172.21.15.89:6800/4097264171,v1:172.21.15.89:6801/4097264171] boot 2024-09-19T06:08:03.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:03 smithi002 ceph-mon[30982]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T06:08:03.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:03 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:08:04.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:04 smithi089 ceph-mon[34160]: from='client.? 172.21.15.90:0/3103222023' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2a4e7147-4125-4ee6-b5ad-85518d7066d9"}]: dispatch 2024-09-19T06:08:04.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:04 smithi089 ceph-mon[34160]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2a4e7147-4125-4ee6-b5ad-85518d7066d9"}]: dispatch 2024-09-19T06:08:04.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:04 smithi089 ceph-mon[34160]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2a4e7147-4125-4ee6-b5ad-85518d7066d9"}]': finished 2024-09-19T06:08:04.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:04 smithi089 ceph-mon[34160]: osdmap e14: 3 total, 2 up, 3 in 2024-09-19T06:08:04.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:04 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:08:04.813 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:04 smithi090 ceph-mon[34497]: from='client.? 172.21.15.90:0/3103222023' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2a4e7147-4125-4ee6-b5ad-85518d7066d9"}]: dispatch 2024-09-19T06:08:04.813 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:04 smithi090 ceph-mon[34497]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2a4e7147-4125-4ee6-b5ad-85518d7066d9"}]: dispatch 2024-09-19T06:08:04.813 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:04 smithi090 ceph-mon[34497]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2a4e7147-4125-4ee6-b5ad-85518d7066d9"}]': finished 2024-09-19T06:08:04.813 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:04 smithi090 ceph-mon[34497]: osdmap e14: 3 total, 2 up, 3 in 2024-09-19T06:08:04.813 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:04 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:08:04.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:04 smithi002 ceph-mon[30982]: from='client.? 172.21.15.90:0/3103222023' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2a4e7147-4125-4ee6-b5ad-85518d7066d9"}]: dispatch 2024-09-19T06:08:04.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:04 smithi002 ceph-mon[30982]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2a4e7147-4125-4ee6-b5ad-85518d7066d9"}]: dispatch 2024-09-19T06:08:04.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:04 smithi002 ceph-mon[30982]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2a4e7147-4125-4ee6-b5ad-85518d7066d9"}]': finished 2024-09-19T06:08:04.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:04 smithi002 ceph-mon[30982]: osdmap e14: 3 total, 2 up, 3 in 2024-09-19T06:08:04.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:04 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:08:05.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:05 smithi089 ceph-mon[34160]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:08:05.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:05 smithi089 ceph-mon[34160]: from='client.? 172.21.15.90:0/1464035717' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:08:05.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:05 smithi002 ceph-mon[30982]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:08:05.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:05 smithi002 ceph-mon[30982]: from='client.? 172.21.15.90:0/1464035717' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:08:05.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:05 smithi090 ceph-mon[34497]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:08:05.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:05 smithi090 ceph-mon[34497]: from='client.? 172.21.15.90:0/1464035717' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:08:07.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:07 smithi089 ceph-mon[34160]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:08:07.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:07 smithi002 ceph-mon[30982]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:08:07.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:07 smithi090 ceph-mon[34497]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:08:09.628 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:09 smithi090 ceph-mon[34497]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:08:09.774 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:09 smithi002 ceph-mon[30982]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:08:09.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:09 smithi089 ceph-mon[34160]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:08:11.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:11 smithi089 ceph-mon[34160]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:08:11.876 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:11 smithi090 ceph-mon[34497]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:08:11.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:11 smithi002 ceph-mon[30982]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:08:13.640 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:13 smithi090 ceph-mon[34497]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:08:13.640 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:13 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T06:08:13.640 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:13 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:13.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:13 smithi089 ceph-mon[34160]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:08:13.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:13 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T06:08:13.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:13 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:13.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:13 smithi002 ceph-mon[30982]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:08:13.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:13 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T06:08:13.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:13 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:14.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:14 smithi089 ceph-mon[34160]: Deploying daemon osd.2 on smithi090 2024-09-19T06:08:14.801 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:14 smithi090 ceph-mon[34497]: Deploying daemon osd.2 on smithi090 2024-09-19T06:08:14.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:14 smithi002 ceph-mon[30982]: Deploying daemon osd.2 on smithi090 2024-09-19T06:08:15.713 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:15 smithi090 ceph-mon[34497]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:08:15.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:15 smithi089 ceph-mon[34160]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:08:15.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:15 smithi002 ceph-mon[30982]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:08:17.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:17 smithi089 ceph-mon[34160]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:08:17.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:17 smithi002 ceph-mon[30982]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:08:17.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:17 smithi090 ceph-mon[34497]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:08:19.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:19 smithi089 ceph-mon[34160]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:08:19.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:19 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:08:19.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:19 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:19.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:19 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:19.806 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:19 smithi090 ceph-mon[34497]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:08:19.806 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:19 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:08:19.806 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:19 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:19.806 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:19 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:19.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:19 smithi002 ceph-mon[30982]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:08:19.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:19 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:08:19.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:19 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:19.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:19 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:21.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:21 smithi090 ceph-mon[34497]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:08:21.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:21 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:21.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:21 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:21.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:21 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:21.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:21 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:08:21.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:21 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:21.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:21 smithi089 ceph-mon[34160]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:08:21.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:21 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:21.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:21 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:21.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:21 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:21.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:21 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:08:21.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:21 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:21.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:21 smithi002 ceph-mon[30982]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:08:21.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:21 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:21.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:21 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:21.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:21 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:21.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:21 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:08:21.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:21 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:23.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:23.247+0000 7f994affd640 1 -- 172.21.15.90:0/166500631 <== mgr.14150 v2:172.21.15.2:6800/4180340554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f99541a0580 con 0x7f99400a31e0 2024-09-19T06:08:23.250 INFO:teuthology.orchestra.run.smithi090.stdout:Created osd(s) 2 on host 'smithi090' 2024-09-19T06:08:23.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:23.249+0000 7f995c0d7640 1 -- 172.21.15.90:0/166500631 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f99400a31e0 msgr2=0x7f99400a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:23.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:23.249+0000 7f995c0d7640 1 --2- 172.21.15.90:0/166500631 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f99400a31e0 0x7f99400a56a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f99500058c0 tx=0x7f9950005f90 comp rx=0 tx=0).stop 2024-09-19T06:08:23.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:23.249+0000 7f995c0d7640 1 -- 172.21.15.90:0/166500631 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9954102690 msgr2=0x7f995419f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:23.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:23.249+0000 7f995c0d7640 1 --2- 172.21.15.90:0/166500631 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9954102690 0x7f995419f390 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f994c031040 tx=0x7f994c003ba0 comp rx=0 tx=0).stop 2024-09-19T06:08:23.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:23.249+0000 7f995c0d7640 1 -- 172.21.15.90:0/166500631 shutdown_connections 2024-09-19T06:08:23.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:23.249+0000 7f995c0d7640 1 --2- 172.21.15.90:0/166500631 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f99400a31e0 0x7f99400a56a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:23.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:23.249+0000 7f995c0d7640 1 --2- 172.21.15.90:0/166500631 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9954102690 0x7f995419f390 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:23.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:23.249+0000 7f995c0d7640 1 --2- 172.21.15.90:0/166500631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9954101cd0 0x7f9954198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:23.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:23.249+0000 7f995c0d7640 1 --2- 172.21.15.90:0/166500631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9954100ad0 0x7f9954197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:23.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:23.249+0000 7f995c0d7640 1 -- 172.21.15.90:0/166500631 >> 172.21.15.90:0/166500631 conn(0x7f99540fc280 msgr2=0x7f9954069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:23.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:23.249+0000 7f995c0d7640 1 -- 172.21.15.90:0/166500631 shutdown_connections 2024-09-19T06:08:23.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:08:23.249+0000 7f995c0d7640 1 -- 172.21.15.90:0/166500631 wait complete. 2024-09-19T06:08:23.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:23 smithi089 ceph-mon[34160]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:08:23.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:23 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:08:23.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:23 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:23.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:23 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:23.813 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:23 smithi090 ceph-mon[34497]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:08:23.813 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:23 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:08:23.814 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:23 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:23.814 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:23 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:23.841 DEBUG:teuthology.orchestra.run.smithi090:osd.2> sudo journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@osd.2.service 2024-09-19T06:08:23.844 INFO:tasks.cephadm:Deploying osd.3 on smithi002 with /dev/vg_nvme/lv_3... 2024-09-19T06:08:23.844 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T06:08:23.868 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:23 smithi002 ceph-mon[30982]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:08:23.868 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:23 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:08:23.868 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:23 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:23.868 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:23 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:24.096 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:08:25.550 INFO:journalctl@ceph.osd.2.smithi090.stdout:Sep 19 06:08:25 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-2[39473]: 2024-09-19T06:08:25.441+0000 7f5155299640 -1 osd.2 0 log_to_monitors true 2024-09-19T06:08:25.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:25 smithi002 ceph-mon[30982]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:08:25.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:25 smithi002 ceph-mon[30982]: from='osd.2 [v2:172.21.15.90:6800/1479908200,v1:172.21.15.90:6801/1479908200]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T06:08:25.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:25 smithi002 ceph-mon[30982]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T06:08:25.971 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:25 smithi090 ceph-mon[34497]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:08:25.971 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:25 smithi090 ceph-mon[34497]: from='osd.2 [v2:172.21.15.90:6800/1479908200,v1:172.21.15.90:6801/1479908200]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T06:08:25.971 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:25 smithi090 ceph-mon[34497]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T06:08:26.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:25 smithi089 ceph-mon[34160]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:08:26.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:25 smithi089 ceph-mon[34160]: from='osd.2 [v2:172.21.15.90:6800/1479908200,v1:172.21.15.90:6801/1479908200]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T06:08:26.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:25 smithi089 ceph-mon[34160]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T06:08:26.566 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:08:26.595 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:26 smithi002 ceph-mon[30982]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T06:08:26.595 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:26 smithi002 ceph-mon[30982]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T06:08:26.595 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:26 smithi002 ceph-mon[30982]: from='osd.2 [v2:172.21.15.90:6800/1479908200,v1:172.21.15.90:6801/1479908200]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-09-19T06:08:26.595 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:26 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:08:26.595 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:26 smithi002 ceph-mon[30982]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-09-19T06:08:26.595 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:26 smithi002 ceph-mon[30982]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]': finished 2024-09-19T06:08:26.595 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:26 smithi002 ceph-mon[30982]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T06:08:26.595 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:26 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:08:26.597 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi002:vg_nvme/lv_3 2024-09-19T06:08:26.740 INFO:journalctl@ceph.osd.2.smithi090.stdout:Sep 19 06:08:26 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-2[39473]: 2024-09-19T06:08:26.548+0000 7f51509f9640 -1 osd.2 0 waiting for initial osdmap 2024-09-19T06:08:26.740 INFO:journalctl@ceph.osd.2.smithi090.stdout:Sep 19 06:08:26 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-2[39473]: 2024-09-19T06:08:26.555+0000 7f514d033640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:08:26.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:26 smithi090 ceph-mon[34497]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T06:08:26.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:26 smithi090 ceph-mon[34497]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T06:08:26.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:26 smithi090 ceph-mon[34497]: from='osd.2 [v2:172.21.15.90:6800/1479908200,v1:172.21.15.90:6801/1479908200]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-09-19T06:08:26.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:26 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:08:26.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:26 smithi090 ceph-mon[34497]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-09-19T06:08:26.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:26 smithi090 ceph-mon[34497]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]': finished 2024-09-19T06:08:26.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:26 smithi090 ceph-mon[34497]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T06:08:26.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:26 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:08:26.897 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:08:27.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:26 smithi089 ceph-mon[34160]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T06:08:27.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:26 smithi089 ceph-mon[34160]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T06:08:27.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:26 smithi089 ceph-mon[34160]: from='osd.2 [v2:172.21.15.90:6800/1479908200,v1:172.21.15.90:6801/1479908200]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-09-19T06:08:27.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:26 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:08:27.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:26 smithi089 ceph-mon[34160]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-09-19T06:08:27.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:26 smithi089 ceph-mon[34160]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]': finished 2024-09-19T06:08:27.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:26 smithi089 ceph-mon[34160]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T06:08:27.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:26 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:08:27.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:27.406+0000 7f6f33e5b640 1 -- 172.21.15.2:0/729019764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f2c074c50 msgr2=0x7f6f2c0750b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:27.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:27.406+0000 7f6f33e5b640 1 --2- 172.21.15.2:0/729019764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f2c074c50 0x7f6f2c0750b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6f20009ca0 tx=0x7f6f2002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:08:27.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:27.406+0000 7f6f33e5b640 1 -- 172.21.15.2:0/729019764 shutdown_connections 2024-09-19T06:08:27.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:27.406+0000 7f6f33e5b640 1 --2- 172.21.15.2:0/729019764 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f2c10e1f0 0x7f6f2c1105e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:27.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:27.406+0000 7f6f33e5b640 1 --2- 172.21.15.2:0/729019764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f2c074c50 0x7f6f2c0750b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:27.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:27.406+0000 7f6f33e5b640 1 --2- 172.21.15.2:0/729019764 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f2c076220 0x7f6f2c074680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:27.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:27.406+0000 7f6f33e5b640 1 -- 172.21.15.2:0/729019764 >> 172.21.15.2:0/729019764 conn(0x7f6f2c0fd3c0 msgr2=0x7f6f2c0ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:27.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:27.406+0000 7f6f33e5b640 1 -- 172.21.15.2:0/729019764 shutdown_connections 2024-09-19T06:08:27.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:27.406+0000 7f6f33e5b640 1 -- 172.21.15.2:0/729019764 wait complete. 2024-09-19T06:08:27.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:27.406+0000 7f6f33e5b640 1 Processor -- start 2024-09-19T06:08:27.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:27.406+0000 7f6f33e5b640 1 -- start start 2024-09-19T06:08:27.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:27.407+0000 7f6f33e5b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f2c074c50 0x7f6f2c19e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:27.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:27.407+0000 7f6f33e5b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f2c076220 0x7f6f2c19e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:27.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:27.407+0000 7f6f33e5b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f2c10e1f0 0x7f6f2c1a5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:27.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:27.407+0000 7f6f33e5b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6f2c113db0 con 0x7f6f2c10e1f0 2024-09-19T06:08:27.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:27.407+0000 7f6f33e5b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6f2c113c30 con 0x7f6f2c076220 2024-09-19T06:08:27.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:27.407+0000 7f6f33e5b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6f2c113f30 con 0x7f6f2c074c50 2024-09-19T06:08:27.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:27.407+0000 7f6f323f8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f2c10e1f0 0x7f6f2c1a5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:27.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:27.407+0000 7f6f323f8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f2c10e1f0 0x7f6f2c1a5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58596/0 (socket says 172.21.15.2:58596) 2024-09-19T06:08:27.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:27.407+0000 7f6f323f8640 1 -- 172.21.15.2:0/2915164402 learned_addr learned my addr 172.21.15.2:0/2915164402 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:08:27.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:27.407+0000 7f6f313f6640 1 --2- 172.21.15.2:0/2915164402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f2c076220 0x7f6f2c19e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:27.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:27.407+0000 7f6f31bf7640 1 --2- 172.21.15.2:0/2915164402 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f2c074c50 0x7f6f2c19e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:27.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:27.407+0000 7f6f323f8640 1 -- 172.21.15.2:0/2915164402 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f2c074c50 msgr2=0x7f6f2c19e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:27.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:27.407+0000 7f6f323f8640 1 --2- 172.21.15.2:0/2915164402 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f2c074c50 0x7f6f2c19e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:27.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:27.407+0000 7f6f323f8640 1 -- 172.21.15.2:0/2915164402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f2c076220 msgr2=0x7f6f2c19e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:27.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:27.407+0000 7f6f323f8640 1 --2- 172.21.15.2:0/2915164402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f2c076220 0x7f6f2c19e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:27.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:27.407+0000 7f6f323f8640 1 -- 172.21.15.2:0/2915164402 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f2c1a6070 con 0x7f6f2c10e1f0 2024-09-19T06:08:27.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:27.407+0000 7f6f323f8640 1 --2- 172.21.15.2:0/2915164402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f2c10e1f0 0x7f6f2c1a5a00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6f2400d750 tx=0x7f6f2400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:27.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:27.408+0000 7f6f2affd640 1 -- 172.21.15.2:0/2915164402 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f24017070 con 0x7f6f2c10e1f0 2024-09-19T06:08:27.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:27.408+0000 7f6f33e5b640 1 -- 172.21.15.2:0/2915164402 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f2c1a6360 con 0x7f6f2c10e1f0 2024-09-19T06:08:27.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:27.408+0000 7f6f33e5b640 1 -- 172.21.15.2:0/2915164402 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f2c1a6870 con 0x7f6f2c10e1f0 2024-09-19T06:08:27.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:27.408+0000 7f6f2affd640 1 -- 172.21.15.2:0/2915164402 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6f240054d0 con 0x7f6f2c10e1f0 2024-09-19T06:08:27.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:27.408+0000 7f6f2affd640 1 -- 172.21.15.2:0/2915164402 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f24004c60 con 0x7f6f2c10e1f0 2024-09-19T06:08:27.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:27.409+0000 7f6f33e5b640 1 -- 172.21.15.2:0/2915164402 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f2c103b90 con 0x7f6f2c10e1f0 2024-09-19T06:08:27.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:27.410+0000 7f6f2affd640 1 -- 172.21.15.2:0/2915164402 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) ==== 138298+0+0 (secure 0 0 0) 0x7f6f24004e00 con 0x7f6f2c10e1f0 2024-09-19T06:08:27.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:27.411+0000 7f6f2affd640 1 --2- 172.21.15.2:0/2915164402 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f6f140a3260 0x7f6f140a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:27.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:27.411+0000 7f6f31bf7640 1 --2- 172.21.15.2:0/2915164402 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f6f140a3260 0x7f6f140a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:27.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:27.411+0000 7f6f2affd640 1 -- 172.21.15.2:0/2915164402 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2571+0+0 (secure 0 0 0) 0x7f6f240cd9d0 con 0x7f6f2c10e1f0 2024-09-19T06:08:27.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:27.411+0000 7f6f31bf7640 1 --2- 172.21.15.2:0/2915164402 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f6f140a3260 0x7f6f140a5720 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c0058c0 tx=0x7f6f1c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:27.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:27.415+0000 7f6f2affd640 1 -- 172.21.15.2:0/2915164402 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6f2409b7f0 con 0x7f6f2c10e1f0 2024-09-19T06:08:27.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:27.604+0000 7f6f33e5b640 1 -- 172.21.15.2:0/2915164402 --> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f6f2c062630 con 0x7f6f140a3260 2024-09-19T06:08:27.943 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:27 smithi002 ceph-mon[30982]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:08:27.943 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:27 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:08:27.943 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:27 smithi002 ceph-mon[30982]: Detected new or changed devices on smithi090 2024-09-19T06:08:27.943 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:27 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:27.943 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:27 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:27.943 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:27 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:08:27.944 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:27 smithi002 ceph-mon[30982]: Adjusting osd_memory_target on smithi090 to 17088M 2024-09-19T06:08:27.944 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:27 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:27.944 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:27 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:27.944 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:27 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:08:27.944 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:27 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:27.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:27 smithi090 ceph-mon[34497]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:08:27.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:27 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:08:27.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:27 smithi090 ceph-mon[34497]: Detected new or changed devices on smithi090 2024-09-19T06:08:27.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:27 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:27.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:27 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:27.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:27 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:08:27.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:27 smithi090 ceph-mon[34497]: Adjusting osd_memory_target on smithi090 to 17088M 2024-09-19T06:08:27.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:27 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:27.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:27 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:27.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:27 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:08:27.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:27 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:28.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:27 smithi089 ceph-mon[34160]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:08:28.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:27 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:08:28.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:27 smithi089 ceph-mon[34160]: Detected new or changed devices on smithi090 2024-09-19T06:08:28.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:27 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:28.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:27 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:28.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:27 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:08:28.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:27 smithi089 ceph-mon[34160]: Adjusting osd_memory_target on smithi090 to 17088M 2024-09-19T06:08:28.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:27 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:28.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:27 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:28.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:27 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:08:28.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:27 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:28.922 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:28 smithi002 ceph-mon[30982]: purged_snaps scrub starts 2024-09-19T06:08:28.923 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:28 smithi002 ceph-mon[30982]: purged_snaps scrub ok 2024-09-19T06:08:28.923 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:28 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:08:28.923 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:28 smithi002 ceph-mon[30982]: osd.2 [v2:172.21.15.90:6800/1479908200,v1:172.21.15.90:6801/1479908200] boot 2024-09-19T06:08:28.923 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:28 smithi002 ceph-mon[30982]: osdmap e17: 3 total, 3 up, 3 in 2024-09-19T06:08:28.923 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:28 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:08:28.923 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:28 smithi002 ceph-mon[30982]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:08:28.923 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:28 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:08:28.923 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:28 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:08:28.923 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:28 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:28.923 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:28 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:08:28.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:28 smithi090 ceph-mon[34497]: purged_snaps scrub starts 2024-09-19T06:08:28.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:28 smithi090 ceph-mon[34497]: purged_snaps scrub ok 2024-09-19T06:08:28.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:28 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:08:28.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:28 smithi090 ceph-mon[34497]: osd.2 [v2:172.21.15.90:6800/1479908200,v1:172.21.15.90:6801/1479908200] boot 2024-09-19T06:08:28.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:28 smithi090 ceph-mon[34497]: osdmap e17: 3 total, 3 up, 3 in 2024-09-19T06:08:28.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:28 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:08:28.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:28 smithi090 ceph-mon[34497]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:08:28.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:28 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:08:28.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:28 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:08:28.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:28 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:28.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:28 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:08:29.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:28 smithi089 ceph-mon[34160]: purged_snaps scrub starts 2024-09-19T06:08:29.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:28 smithi089 ceph-mon[34160]: purged_snaps scrub ok 2024-09-19T06:08:29.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:28 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:08:29.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:28 smithi089 ceph-mon[34160]: osd.2 [v2:172.21.15.90:6800/1479908200,v1:172.21.15.90:6801/1479908200] boot 2024-09-19T06:08:29.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:28 smithi089 ceph-mon[34160]: osdmap e17: 3 total, 3 up, 3 in 2024-09-19T06:08:29.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:28 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:08:29.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:28 smithi089 ceph-mon[34160]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:08:29.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:28 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:08:29.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:28 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:08:29.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:28 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:29.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:28 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:08:29.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:29 smithi002 ceph-mon[30982]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:08:29.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:29 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T06:08:29.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:29 smithi002 ceph-mon[30982]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T06:08:29.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:29 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:08:29.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:29 smithi090 ceph-mon[34497]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:08:29.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:29 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T06:08:29.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:29 smithi090 ceph-mon[34497]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T06:08:29.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:29 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:08:30.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:29 smithi089 ceph-mon[34160]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:08:30.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:29 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T06:08:30.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:29 smithi089 ceph-mon[34160]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T06:08:30.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:29 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:08:30.570 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 06:08:30 smithi002 sudo[49430]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T06:08:30.570 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 06:08:30 smithi002 sudo[49430]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:08:30.570 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 06:08:30 smithi002 sudo[49430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:08:30.570 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 06:08:30 smithi002 sudo[49430]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:08:30.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:30 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T06:08:30.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:30 smithi002 ceph-mon[30982]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T06:08:30.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:30 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/3424468040' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b3da775-0f0a-4b46-a8dc-9ec822a54301"}]: dispatch 2024-09-19T06:08:30.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:30 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/3424468040' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7b3da775-0f0a-4b46-a8dc-9ec822a54301"}]': finished 2024-09-19T06:08:30.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:30 smithi002 ceph-mon[30982]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T06:08:30.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:30 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:08:30.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:30 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T06:08:30.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:30 smithi090 ceph-mon[34497]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T06:08:30.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:30 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/3424468040' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b3da775-0f0a-4b46-a8dc-9ec822a54301"}]: dispatch 2024-09-19T06:08:30.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:30 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/3424468040' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7b3da775-0f0a-4b46-a8dc-9ec822a54301"}]': finished 2024-09-19T06:08:30.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:30 smithi090 ceph-mon[34497]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T06:08:30.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:30 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:08:31.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:30 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T06:08:31.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:30 smithi089 ceph-mon[34160]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T06:08:31.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:30 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/3424468040' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b3da775-0f0a-4b46-a8dc-9ec822a54301"}]: dispatch 2024-09-19T06:08:31.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:30 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/3424468040' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7b3da775-0f0a-4b46-a8dc-9ec822a54301"}]': finished 2024-09-19T06:08:31.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:30 smithi089 ceph-mon[34160]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T06:08:31.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:30 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:08:31.472 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 06:08:31 smithi002 sudo[49483]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T06:08:31.472 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 06:08:31 smithi002 sudo[49483]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:08:31.472 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 06:08:31 smithi002 sudo[49483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:08:31.473 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 06:08:31 smithi002 sudo[49483]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:08:31.535 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 19 06:08:31 smithi089 sudo[42360]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T06:08:31.536 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 19 06:08:31 smithi089 sudo[42360]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:08:31.536 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 19 06:08:31 smithi089 sudo[42360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:08:31.536 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 19 06:08:31 smithi089 sudo[42360]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:08:31.792 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 19 06:08:31 smithi089 sudo[42363]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T06:08:31.792 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 19 06:08:31 smithi089 sudo[42363]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:08:31.792 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 19 06:08:31 smithi089 sudo[42363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:08:31.792 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 19 06:08:31 smithi089 sudo[42363]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:08:31.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:31 smithi089 ceph-mon[34160]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:08:31.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:31 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/3609674029' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:08:31.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:31 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:31.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:31 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:31.945 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:31 smithi090 ceph-mon[34497]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:08:31.945 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:31 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/3609674029' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:08:31.946 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:31 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:31.946 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:31 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:31.946 INFO:journalctl@ceph.osd.2.smithi090.stdout:Sep 19 06:08:31 smithi090 sudo[43380]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T06:08:31.946 INFO:journalctl@ceph.osd.2.smithi090.stdout:Sep 19 06:08:31 smithi090 sudo[43380]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:08:31.946 INFO:journalctl@ceph.osd.2.smithi090.stdout:Sep 19 06:08:31 smithi090 sudo[43380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:08:31.946 INFO:journalctl@ceph.osd.2.smithi090.stdout:Sep 19 06:08:31 smithi090 sudo[43380]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:08:31.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:31 smithi002 ceph-mon[30982]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:08:31.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:31 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/3609674029' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:08:31.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:31 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:31.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:31 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:32.240 INFO:journalctl@ceph.osd.2.smithi090.stdout:Sep 19 06:08:32 smithi090 sudo[43383]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T06:08:32.240 INFO:journalctl@ceph.osd.2.smithi090.stdout:Sep 19 06:08:32 smithi090 sudo[43383]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:08:32.240 INFO:journalctl@ceph.osd.2.smithi090.stdout:Sep 19 06:08:32 smithi090 sudo[43383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:08:32.240 INFO:journalctl@ceph.osd.2.smithi090.stdout:Sep 19 06:08:32 smithi090 sudo[43383]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:08:32.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:32 smithi002 sudo[49862]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T06:08:32.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:32 smithi002 sudo[49862]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:08:32.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:32 smithi002 sudo[49862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:08:32.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:32 smithi002 sudo[49862]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:08:33.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:33.001+0000 7f6f2affd640 1 -- 172.21.15.2:0/2915164402 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f6f24097e60 con 0x7f6f2c10e1f0 2024-09-19T06:08:33.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:32 smithi002 sudo[49874]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T06:08:33.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:32 smithi002 sudo[49874]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:08:33.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:32 smithi002 sudo[49874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:08:33.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:32 smithi002 sudo[49874]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:08:33.489 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:33 smithi090 sudo[43387]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T06:08:33.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:33 smithi090 sudo[43387]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:08:33.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:33 smithi090 sudo[43387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:08:33.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:33 smithi090 sudo[43387]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:08:33.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:33 smithi090 sudo[43390]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T06:08:33.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:33 smithi090 sudo[43390]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:08:33.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:33 smithi090 sudo[43390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:08:33.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:33 smithi090 sudo[43390]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:08:33.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:33 smithi090 ceph-mon[34497]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:08:33.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:33 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:33.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:33 smithi090 ceph-mon[34497]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:08:33.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:33 smithi090 ceph-mon[34497]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:08:33.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:33 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:08:33.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:33 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:08:33.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:33 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:08:33.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:33 smithi090 ceph-mon[34497]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T06:08:33.742 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:33 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:08:33.742 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:33 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:08:33.742 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:33 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:08:33.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:33 smithi002 ceph-mon[30982]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:08:33.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:33 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:33.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:33 smithi002 ceph-mon[30982]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:08:33.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:33 smithi002 ceph-mon[30982]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:08:33.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:33 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:08:33.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:33 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:08:33.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:33 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:08:33.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:33 smithi002 ceph-mon[30982]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T06:08:33.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:33 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:08:33.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:33 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:08:33.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:33 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:08:33.986 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:33 smithi089 sudo[42366]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T06:08:33.986 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:33 smithi089 sudo[42366]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:08:33.986 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:33 smithi089 sudo[42366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:08:33.986 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:33 smithi089 sudo[42366]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:08:34.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:33 smithi089 sudo[42369]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T06:08:34.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:33 smithi089 sudo[42369]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:08:34.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:33 smithi089 sudo[42369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:08:34.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:33 smithi089 sudo[42369]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:08:34.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:33 smithi089 ceph-mon[34160]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:08:34.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:33 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:34.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:33 smithi089 ceph-mon[34160]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:08:34.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:33 smithi089 ceph-mon[34160]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:08:34.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:33 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:08:34.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:33 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:08:34.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:33 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:08:34.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:33 smithi089 ceph-mon[34160]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T06:08:34.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:33 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:08:34.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:33 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:08:34.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:33 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:08:34.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:34 smithi089 ceph-mon[34160]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:08:34.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:34 smithi089 ceph-mon[34160]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:08:34.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:34 smithi089 ceph-mon[34160]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:08:34.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:34 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:08:34.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:34 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:08:34.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:34 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:08:34.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:34 smithi089 ceph-mon[34160]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:08:34.885 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:34 smithi002 ceph-mon[30982]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:08:34.886 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:34 smithi002 ceph-mon[30982]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:08:34.886 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:34 smithi002 ceph-mon[30982]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:08:34.886 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:34 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:08:34.886 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:34 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:08:34.886 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:34 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:08:34.886 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:34 smithi002 ceph-mon[30982]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:08:34.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:34 smithi090 ceph-mon[34497]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:08:34.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:34 smithi090 ceph-mon[34497]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:08:34.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:34 smithi090 ceph-mon[34497]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:08:34.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:34 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:08:34.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:34 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:08:34.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:34 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:08:34.992 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:34 smithi090 ceph-mon[34497]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:08:35.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:35 smithi089 ceph-mon[34160]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:08:35.805 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:35 smithi002 ceph-mon[30982]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:08:35.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:35 smithi090 ceph-mon[34497]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:08:37.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:37 smithi089 ceph-mon[34160]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:08:37.842 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:37 smithi002 ceph-mon[30982]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:08:37.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:37 smithi090 ceph-mon[34497]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:08:38.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:38 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T06:08:38.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:38 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:38.919 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:38 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T06:08:38.919 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:38 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:38.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:38 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T06:08:38.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:38 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:39.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:39 smithi089 ceph-mon[34160]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:08:39.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:39 smithi089 ceph-mon[34160]: Deploying daemon osd.3 on smithi002 2024-09-19T06:08:39.800 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:39 smithi002 ceph-mon[30982]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:08:39.800 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:39 smithi002 ceph-mon[30982]: Deploying daemon osd.3 on smithi002 2024-09-19T06:08:39.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:39 smithi090 ceph-mon[34497]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:08:39.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:39 smithi090 ceph-mon[34497]: Deploying daemon osd.3 on smithi002 2024-09-19T06:08:41.609 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:41 smithi002 ceph-mon[30982]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-19T06:08:41.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:41 smithi089 ceph-mon[34160]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-19T06:08:41.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:41 smithi090 ceph-mon[34497]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-19T06:08:43.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:43 smithi002 ceph-mon[30982]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-19T06:08:43.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:43 smithi089 ceph-mon[34160]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-19T06:08:43.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:43 smithi090 ceph-mon[34497]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-19T06:08:45.690 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:45 smithi002 ceph-mon[30982]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T06:08:45.691 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:45 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:08:45.691 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:45 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:45.691 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:45 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:45.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:45 smithi089 ceph-mon[34160]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T06:08:45.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:45 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:08:45.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:45 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:45.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:45 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:45.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:45 smithi090 ceph-mon[34497]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T06:08:45.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:45 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:08:45.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:45 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:45.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:45 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:47.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:47 smithi089 ceph-mon[34160]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T06:08:47.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:47 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:47.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:47 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:47.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:47 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:47.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:47 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:08:47.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:47 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:47.941 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:47 smithi002 ceph-mon[30982]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T06:08:47.941 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:47 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:47.941 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:47 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:47.941 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:47 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:47.941 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:47 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:08:47.941 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:47 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:47.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:47 smithi090 ceph-mon[34497]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T06:08:47.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:47 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:47.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:47 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:47.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:47 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:47.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:47 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:08:47.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:47 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:48.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:48.557+0000 7f6f2affd640 1 -- 172.21.15.2:0/2915164402 <== mgr.14150 v2:172.21.15.2:6800/4180340554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6f2c062630 con 0x7f6f140a3260 2024-09-19T06:08:48.559 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 3 on host 'smithi002' 2024-09-19T06:08:48.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:48.560+0000 7f6f33e5b640 1 -- 172.21.15.2:0/2915164402 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f6f140a3260 msgr2=0x7f6f140a5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:48.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:48.560+0000 7f6f33e5b640 1 --2- 172.21.15.2:0/2915164402 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f6f140a3260 0x7f6f140a5720 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c0058c0 tx=0x7f6f1c00a2d0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:48.560+0000 7f6f33e5b640 1 -- 172.21.15.2:0/2915164402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f2c10e1f0 msgr2=0x7f6f2c1a5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:48.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:48.560+0000 7f6f33e5b640 1 --2- 172.21.15.2:0/2915164402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f2c10e1f0 0x7f6f2c1a5a00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6f2400d750 tx=0x7f6f2400dc10 comp rx=0 tx=0).stop 2024-09-19T06:08:48.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:48.560+0000 7f6f33e5b640 1 -- 172.21.15.2:0/2915164402 shutdown_connections 2024-09-19T06:08:48.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:48.560+0000 7f6f33e5b640 1 --2- 172.21.15.2:0/2915164402 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f6f140a3260 0x7f6f140a5720 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:48.560+0000 7f6f33e5b640 1 --2- 172.21.15.2:0/2915164402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f2c10e1f0 0x7f6f2c1a5a00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:48.560+0000 7f6f33e5b640 1 --2- 172.21.15.2:0/2915164402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f2c076220 0x7f6f2c19e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:48.560+0000 7f6f33e5b640 1 --2- 172.21.15.2:0/2915164402 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f2c074c50 0x7f6f2c19e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:48.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:48.560+0000 7f6f33e5b640 1 -- 172.21.15.2:0/2915164402 >> 172.21.15.2:0/2915164402 conn(0x7f6f2c0fd3c0 msgr2=0x7f6f2c0ff7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:48.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:48.560+0000 7f6f33e5b640 1 -- 172.21.15.2:0/2915164402 shutdown_connections 2024-09-19T06:08:48.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:08:48.560+0000 7f6f33e5b640 1 -- 172.21.15.2:0/2915164402 wait complete. 2024-09-19T06:08:49.225 DEBUG:teuthology.orchestra.run.smithi002:osd.3> sudo journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@osd.3.service 2024-09-19T06:08:49.227 INFO:tasks.cephadm:Deploying osd.4 on smithi089 with /dev/vg_nvme/lv_3... 2024-09-19T06:08:49.228 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T06:08:49.478 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:08:49.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:49 smithi089 ceph-mon[34160]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T06:08:49.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:49 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:08:49.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:49 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:49.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:49 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:49.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:49 smithi002 ceph-mon[30982]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T06:08:49.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:49 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:08:49.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:49 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:49.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:49 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:49.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:49 smithi090 ceph-mon[34497]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T06:08:49.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:49 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:08:49.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:49 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:49.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:49 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:50.973 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 19 06:08:50 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-3[51470]: 2024-09-19T06:08:50.677+0000 7f4af94c3640 -1 osd.3 0 log_to_monitors true 2024-09-19T06:08:51.635 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:51 smithi089 ceph-mon[34160]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T06:08:51.635 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:51 smithi089 ceph-mon[34160]: from='osd.3 [v2:172.21.15.2:6810/1796948193,v1:172.21.15.2:6811/1796948193]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T06:08:51.683 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:51 smithi002 ceph-mon[30982]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T06:08:51.683 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:51 smithi002 ceph-mon[30982]: from='osd.3 [v2:172.21.15.2:6810/1796948193,v1:172.21.15.2:6811/1796948193]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T06:08:51.792 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:51 smithi090 ceph-mon[34497]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T06:08:51.792 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:51 smithi090 ceph-mon[34497]: from='osd.3 [v2:172.21.15.2:6810/1796948193,v1:172.21.15.2:6811/1796948193]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T06:08:52.265 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-19T06:08:52.291 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi089:vg_nvme/lv_3 2024-09-19T06:08:52.543 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:08:52.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:52 smithi089 ceph-mon[34160]: from='osd.3 [v2:172.21.15.2:6810/1796948193,v1:172.21.15.2:6811/1796948193]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T06:08:52.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:52 smithi089 ceph-mon[34160]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T06:08:52.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:52 smithi089 ceph-mon[34160]: from='osd.3 [v2:172.21.15.2:6810/1796948193,v1:172.21.15.2:6811/1796948193]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-19T06:08:52.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:52 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:08:52.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:52 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:52.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:52 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:52.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:52 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:08:52.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:52 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:08:52.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:52 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:52.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:52 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:52.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:52 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:08:52.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:52 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:52.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:52 smithi002 ceph-mon[30982]: from='osd.3 [v2:172.21.15.2:6810/1796948193,v1:172.21.15.2:6811/1796948193]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T06:08:52.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:52 smithi002 ceph-mon[30982]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T06:08:52.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:52 smithi002 ceph-mon[30982]: from='osd.3 [v2:172.21.15.2:6810/1796948193,v1:172.21.15.2:6811/1796948193]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-19T06:08:52.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:52 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:08:52.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:52 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:52.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:52 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:52.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:52 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:08:52.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:52 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:08:52.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:52 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:52.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:52 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:52.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:52 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:08:52.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:52 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:52.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:52 smithi090 ceph-mon[34497]: from='osd.3 [v2:172.21.15.2:6810/1796948193,v1:172.21.15.2:6811/1796948193]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T06:08:52.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:52 smithi090 ceph-mon[34497]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T06:08:52.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:52 smithi090 ceph-mon[34497]: from='osd.3 [v2:172.21.15.2:6810/1796948193,v1:172.21.15.2:6811/1796948193]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-19T06:08:52.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:52 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:08:52.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:52 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:52.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:52 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:52.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:52 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:08:52.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:52 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:08:52.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:52 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:52.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:52 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:52.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:52 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:08:52.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:52 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:08:53.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.003+0000 7fed8a65c640 1 -- 172.21.15.89:0/3318388566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed84101c10 msgr2=0x7fed84102010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:53.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.003+0000 7fed8a65c640 1 --2- 172.21.15.89:0/3318388566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed84101c10 0x7fed84102010 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fed74009900 tx=0x7fed7402a410 comp rx=0 tx=0).stop 2024-09-19T06:08:53.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.003+0000 7fed8a65c640 1 -- 172.21.15.89:0/3318388566 shutdown_connections 2024-09-19T06:08:53.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.003+0000 7fed8a65c640 1 --2- 172.21.15.89:0/3318388566 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fed841037d0 0x7fed8410a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:53.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.003+0000 7fed8a65c640 1 --2- 172.21.15.89:0/3318388566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed84102e10 0x7fed84103290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:53.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.003+0000 7fed8a65c640 1 --2- 172.21.15.89:0/3318388566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed84101c10 0x7fed84102010 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:53.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.003+0000 7fed8a65c640 1 -- 172.21.15.89:0/3318388566 >> 172.21.15.89:0/3318388566 conn(0x7fed840fd3c0 msgr2=0x7fed840ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:53.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.003+0000 7fed8a65c640 1 -- 172.21.15.89:0/3318388566 shutdown_connections 2024-09-19T06:08:53.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.003+0000 7fed8a65c640 1 -- 172.21.15.89:0/3318388566 wait complete. 2024-09-19T06:08:53.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.004+0000 7fed8a65c640 1 Processor -- start 2024-09-19T06:08:53.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.004+0000 7fed8a65c640 1 -- start start 2024-09-19T06:08:53.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.004+0000 7fed8a65c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed84101c10 0x7fed84197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:53.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.004+0000 7fed8a65c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fed84102e10 0x7fed84198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:53.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.004+0000 7fed8a65c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed841037d0 0x7fed8419f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:53.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.004+0000 7fed8a65c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fed8410d7a0 con 0x7fed84101c10 2024-09-19T06:08:53.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.004+0000 7fed8a65c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fed8410d620 con 0x7fed841037d0 2024-09-19T06:08:53.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.004+0000 7fed8a65c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fed8410d920 con 0x7fed84102e10 2024-09-19T06:08:53.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.004+0000 7fed83fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed84101c10 0x7fed84197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:53.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.004+0000 7fed88bf9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed841037d0 0x7fed8419f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:53.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.004+0000 7fed837fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fed84102e10 0x7fed84198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:53.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.004+0000 7fed88bf9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed841037d0 0x7fed8419f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45608/0 (socket says 172.21.15.89:45608) 2024-09-19T06:08:53.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.004+0000 7fed88bf9640 1 -- 172.21.15.89:0/2773490237 learned_addr learned my addr 172.21.15.89:0/2773490237 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-19T06:08:53.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.004+0000 7fed83fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed84101c10 0x7fed84197e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.89:37904/0 (socket says 172.21.15.89:37904) 2024-09-19T06:08:53.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.005+0000 7fed837fe640 1 -- 172.21.15.89:0/2773490237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed841037d0 msgr2=0x7fed8419f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:53.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.005+0000 7fed837fe640 1 --2- 172.21.15.89:0/2773490237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed841037d0 0x7fed8419f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:53.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.005+0000 7fed837fe640 1 -- 172.21.15.89:0/2773490237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed84101c10 msgr2=0x7fed84197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:53.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.005+0000 7fed837fe640 1 --2- 172.21.15.89:0/2773490237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed84101c10 0x7fed84197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:53.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.005+0000 7fed837fe640 1 -- 172.21.15.89:0/2773490237 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed8419fa50 con 0x7fed84102e10 2024-09-19T06:08:53.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.005+0000 7fed88bf9640 1 --2- 172.21.15.89:0/2773490237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed841037d0 0x7fed8419f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:08:53.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.005+0000 7fed837fe640 1 --2- 172.21.15.89:0/2773490237 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fed84102e10 0x7fed84198360 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fed7800e9f0 tx=0x7fed7800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:53.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.005+0000 7fed817fa640 1 -- 172.21.15.89:0/2773490237 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed7800ccc0 con 0x7fed84102e10 2024-09-19T06:08:53.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.005+0000 7fed8a65c640 1 -- 172.21.15.89:0/2773490237 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed8419fd40 con 0x7fed84102e10 2024-09-19T06:08:53.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.005+0000 7fed817fa640 1 -- 172.21.15.89:0/2773490237 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fed780108e0 con 0x7fed84102e10 2024-09-19T06:08:53.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.005+0000 7fed817fa640 1 -- 172.21.15.89:0/2773490237 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed78018880 con 0x7fed84102e10 2024-09-19T06:08:53.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.005+0000 7fed8a65c640 1 -- 172.21.15.89:0/2773490237 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed841a0220 con 0x7fed84102e10 2024-09-19T06:08:53.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.006+0000 7fed8a65c640 1 -- 172.21.15.89:0/2773490237 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed84109060 con 0x7fed84102e10 2024-09-19T06:08:53.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.007+0000 7fed817fa640 1 -- 172.21.15.89:0/2773490237 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fed78010a90 con 0x7fed84102e10 2024-09-19T06:08:53.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.008+0000 7fed817fa640 1 --2- 172.21.15.89:0/2773490237 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fed6c0a3270 0x7fed6c0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:53.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.008+0000 7fed817fa640 1 -- 172.21.15.89:0/2773490237 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 3422+0+0 (secure 0 0 0) 0x7fed780ceaa0 con 0x7fed84102e10 2024-09-19T06:08:53.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.008+0000 7fed83fff640 1 --2- 172.21.15.89:0/2773490237 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fed6c0a3270 0x7fed6c0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:53.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.008+0000 7fed83fff640 1 --2- 172.21.15.89:0/2773490237 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fed6c0a3270 0x7fed6c0a5730 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fed74005ab0 tx=0x7fed74005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:53.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.015+0000 7fed817fa640 1 -- 172.21.15.89:0/2773490237 <== mon.1 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fed78010e00 con 0x7fed84102e10 2024-09-19T06:08:53.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:08:53.192+0000 7fed8a65c640 1 -- 172.21.15.89:0/2773490237 --> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fed84062630 con 0x7fed6c0a3270 2024-09-19T06:08:53.543 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 19 06:08:53 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-3[51470]: 2024-09-19T06:08:53.250+0000 7f4af4c23640 -1 osd.3 0 waiting for initial osdmap 2024-09-19T06:08:53.543 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 19 06:08:53 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-3[51470]: 2024-09-19T06:08:53.256+0000 7f4aed255640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:08:53.851 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:53 smithi089 ceph-mon[34160]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:08:53.851 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:53 smithi089 ceph-mon[34160]: Detected new or changed devices on smithi002 2024-09-19T06:08:53.851 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:53 smithi089 ceph-mon[34160]: Adjusting osd_memory_target on smithi002 to 8546M 2024-09-19T06:08:53.851 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:53 smithi089 ceph-mon[34160]: from='osd.3 [v2:172.21.15.2:6810/1796948193,v1:172.21.15.2:6811/1796948193]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-19T06:08:53.851 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:53 smithi089 ceph-mon[34160]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T06:08:53.851 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:53 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:08:53.851 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:53 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:08:53.851 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:53 smithi089 ceph-mon[34160]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T06:08:53.851 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:53 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:08:53.851 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:53 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:08:53.852 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:53 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:08:53.852 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:53 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:53.852 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:53 smithi089 ceph-mon[34160]: from='osd.3 [v2:172.21.15.2:6810/1796948193,v1:172.21.15.2:6811/1796948193]' entity='osd.3' 2024-09-19T06:08:53.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:53 smithi002 ceph-mon[30982]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:08:53.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:53 smithi002 ceph-mon[30982]: Detected new or changed devices on smithi002 2024-09-19T06:08:53.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:53 smithi002 ceph-mon[30982]: Adjusting osd_memory_target on smithi002 to 8546M 2024-09-19T06:08:53.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:53 smithi002 ceph-mon[30982]: from='osd.3 [v2:172.21.15.2:6810/1796948193,v1:172.21.15.2:6811/1796948193]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-19T06:08:53.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:53 smithi002 ceph-mon[30982]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T06:08:53.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:53 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:08:53.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:53 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:08:53.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:53 smithi002 ceph-mon[30982]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T06:08:53.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:53 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:08:53.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:53 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:08:53.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:53 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:08:53.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:53 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:53.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:53 smithi002 ceph-mon[30982]: from='osd.3 [v2:172.21.15.2:6810/1796948193,v1:172.21.15.2:6811/1796948193]' entity='osd.3' 2024-09-19T06:08:53.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:53 smithi090 ceph-mon[34497]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:08:53.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:53 smithi090 ceph-mon[34497]: Detected new or changed devices on smithi002 2024-09-19T06:08:53.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:53 smithi090 ceph-mon[34497]: Adjusting osd_memory_target on smithi002 to 8546M 2024-09-19T06:08:53.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:53 smithi090 ceph-mon[34497]: from='osd.3 [v2:172.21.15.2:6810/1796948193,v1:172.21.15.2:6811/1796948193]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-19T06:08:53.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:53 smithi090 ceph-mon[34497]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T06:08:53.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:53 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:08:53.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:53 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:08:53.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:53 smithi090 ceph-mon[34497]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T06:08:53.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:53 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:08:53.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:53 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:08:53.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:53 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:08:53.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:53 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:53.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:53 smithi090 ceph-mon[34497]: from='osd.3 [v2:172.21.15.2:6810/1796948193,v1:172.21.15.2:6811/1796948193]' entity='osd.3' 2024-09-19T06:08:54.554 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:54 smithi089 ceph-mon[34160]: purged_snaps scrub starts 2024-09-19T06:08:54.554 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:54 smithi089 ceph-mon[34160]: purged_snaps scrub ok 2024-09-19T06:08:54.554 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:54 smithi089 ceph-mon[34160]: from='client.24220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:08:54.555 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:54 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:08:54.555 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:54 smithi089 ceph-mon[34160]: osd.3 [v2:172.21.15.2:6810/1796948193,v1:172.21.15.2:6811/1796948193] boot 2024-09-19T06:08:54.555 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:54 smithi089 ceph-mon[34160]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T06:08:54.555 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:54 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:08:54.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:54 smithi002 ceph-mon[30982]: purged_snaps scrub starts 2024-09-19T06:08:54.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:54 smithi002 ceph-mon[30982]: purged_snaps scrub ok 2024-09-19T06:08:54.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:54 smithi002 ceph-mon[30982]: from='client.24220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:08:54.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:54 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:08:54.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:54 smithi002 ceph-mon[30982]: osd.3 [v2:172.21.15.2:6810/1796948193,v1:172.21.15.2:6811/1796948193] boot 2024-09-19T06:08:54.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:54 smithi002 ceph-mon[30982]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T06:08:54.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:54 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:08:54.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:54 smithi090 ceph-mon[34497]: purged_snaps scrub starts 2024-09-19T06:08:54.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:54 smithi090 ceph-mon[34497]: purged_snaps scrub ok 2024-09-19T06:08:54.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:54 smithi090 ceph-mon[34497]: from='client.24220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:08:54.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:54 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:08:54.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:54 smithi090 ceph-mon[34497]: osd.3 [v2:172.21.15.2:6810/1796948193,v1:172.21.15.2:6811/1796948193] boot 2024-09-19T06:08:54.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:54 smithi090 ceph-mon[34497]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T06:08:54.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:54 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:08:55.820 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:55 smithi089 ceph-mon[34160]: pgmap v94: 1 pgs: 1 remapped+peering; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:08:55.820 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:55 smithi089 ceph-mon[34160]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T06:08:55.820 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:55 smithi089 ceph-mon[34160]: from='client.? 172.21.15.89:0/3315681069' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d4c8bafc-c844-4ff1-a3d8-7a53576e6b5d"}]: dispatch 2024-09-19T06:08:55.820 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:55 smithi089 ceph-mon[34160]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d4c8bafc-c844-4ff1-a3d8-7a53576e6b5d"}]: dispatch 2024-09-19T06:08:55.820 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:55 smithi089 ceph-mon[34160]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d4c8bafc-c844-4ff1-a3d8-7a53576e6b5d"}]': finished 2024-09-19T06:08:55.820 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:55 smithi089 ceph-mon[34160]: osdmap e26: 5 total, 4 up, 5 in 2024-09-19T06:08:55.820 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:55 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:08:55.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:55 smithi002 ceph-mon[30982]: pgmap v94: 1 pgs: 1 remapped+peering; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:08:55.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:55 smithi002 ceph-mon[30982]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T06:08:55.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:55 smithi002 ceph-mon[30982]: from='client.? 172.21.15.89:0/3315681069' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d4c8bafc-c844-4ff1-a3d8-7a53576e6b5d"}]: dispatch 2024-09-19T06:08:55.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:55 smithi002 ceph-mon[30982]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d4c8bafc-c844-4ff1-a3d8-7a53576e6b5d"}]: dispatch 2024-09-19T06:08:55.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:55 smithi002 ceph-mon[30982]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d4c8bafc-c844-4ff1-a3d8-7a53576e6b5d"}]': finished 2024-09-19T06:08:55.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:55 smithi002 ceph-mon[30982]: osdmap e26: 5 total, 4 up, 5 in 2024-09-19T06:08:55.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:55 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:08:55.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:55 smithi090 ceph-mon[34497]: pgmap v94: 1 pgs: 1 remapped+peering; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:08:55.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:55 smithi090 ceph-mon[34497]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T06:08:55.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:55 smithi090 ceph-mon[34497]: from='client.? 172.21.15.89:0/3315681069' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d4c8bafc-c844-4ff1-a3d8-7a53576e6b5d"}]: dispatch 2024-09-19T06:08:55.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:55 smithi090 ceph-mon[34497]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d4c8bafc-c844-4ff1-a3d8-7a53576e6b5d"}]: dispatch 2024-09-19T06:08:55.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:55 smithi090 ceph-mon[34497]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d4c8bafc-c844-4ff1-a3d8-7a53576e6b5d"}]': finished 2024-09-19T06:08:55.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:55 smithi090 ceph-mon[34497]: osdmap e26: 5 total, 4 up, 5 in 2024-09-19T06:08:55.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:55 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:08:56.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:56 smithi002 ceph-mon[30982]: from='client.? 172.21.15.89:0/2837792451' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:08:56.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:56 smithi002 ceph-mon[30982]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T06:08:56.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:56 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:08:56.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:56 smithi090 ceph-mon[34497]: from='client.? 172.21.15.89:0/2837792451' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:08:56.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:56 smithi090 ceph-mon[34497]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T06:08:56.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:56 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:08:57.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:56 smithi089 ceph-mon[34160]: from='client.? 172.21.15.89:0/2837792451' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:08:57.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:56 smithi089 ceph-mon[34160]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T06:08:57.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:56 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:08:57.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:57 smithi002 ceph-mon[30982]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:08:57.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:57 smithi002 ceph-mon[30982]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T06:08:57.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:57 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:08:57.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:57 smithi090 ceph-mon[34497]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:08:57.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:57 smithi090 ceph-mon[34497]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T06:08:57.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:57 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:08:58.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:57 smithi089 ceph-mon[34160]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:08:58.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:57 smithi089 ceph-mon[34160]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T06:08:58.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:57 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:08:59.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:08:59 smithi002 ceph-mon[30982]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:08:59.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:08:59 smithi090 ceph-mon[34497]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:09:00.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:08:59 smithi089 ceph-mon[34160]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:09:01.846 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:01 smithi089 ceph-mon[34160]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-19T06:09:01.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:01 smithi002 ceph-mon[30982]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-19T06:09:01.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:01 smithi090 ceph-mon[34497]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-19T06:09:03.744 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:03 smithi089 ceph-mon[34160]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-19T06:09:03.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:03 smithi002 ceph-mon[30982]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-19T06:09:03.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:03 smithi090 ceph-mon[34497]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-19T06:09:04.716 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:04 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T06:09:04.716 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:04 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:04.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:04 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T06:09:04.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:04 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:04.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:04 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T06:09:04.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:04 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:05.760 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:05 smithi089 ceph-mon[34160]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T06:09:05.760 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:05 smithi089 ceph-mon[34160]: Deploying daemon osd.4 on smithi089 2024-09-19T06:09:05.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:05 smithi002 ceph-mon[30982]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T06:09:05.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:05 smithi002 ceph-mon[30982]: Deploying daemon osd.4 on smithi089 2024-09-19T06:09:05.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:05 smithi090 ceph-mon[34497]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T06:09:05.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:05 smithi090 ceph-mon[34497]: Deploying daemon osd.4 on smithi089 2024-09-19T06:09:07.734 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:07 smithi089 ceph-mon[34160]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-19T06:09:07.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:07 smithi002 ceph-mon[30982]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-19T06:09:07.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:07 smithi090 ceph-mon[34497]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-19T06:09:09.938 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:09 smithi089 ceph-mon[34160]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-19T06:09:09.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:09 smithi002 ceph-mon[30982]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-19T06:09:09.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:09 smithi090 ceph-mon[34497]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-19T06:09:10.953 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:10 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:09:10.953 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:10 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:10.953 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:10 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:10.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:10 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:09:10.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:10 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:10.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:10 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:10.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:10 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:09:10.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:10 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:10.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:10 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:11.758 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:11 smithi089 ceph-mon[34160]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:09:11.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:11 smithi002 ceph-mon[30982]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:09:11.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:11 smithi090 ceph-mon[34497]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:09:13.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:09:13.812+0000 7fed817fa640 1 -- 172.21.15.89:0/2773490237 <== mgr.14150 v2:172.21.15.2:6800/4180340554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fed84062630 con 0x7fed6c0a3270 2024-09-19T06:09:13.814 INFO:teuthology.orchestra.run.smithi089.stdout:Created osd(s) 4 on host 'smithi089' 2024-09-19T06:09:13.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:09:13.814+0000 7fed8a65c640 1 -- 172.21.15.89:0/2773490237 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fed6c0a3270 msgr2=0x7fed6c0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:13.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:09:13.814+0000 7fed8a65c640 1 --2- 172.21.15.89:0/2773490237 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fed6c0a3270 0x7fed6c0a5730 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fed74005ab0 tx=0x7fed74005a20 comp rx=0 tx=0).stop 2024-09-19T06:09:13.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:09:13.814+0000 7fed8a65c640 1 -- 172.21.15.89:0/2773490237 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fed84102e10 msgr2=0x7fed84198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:13.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:09:13.814+0000 7fed8a65c640 1 --2- 172.21.15.89:0/2773490237 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fed84102e10 0x7fed84198360 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fed7800e9f0 tx=0x7fed7800eeb0 comp rx=0 tx=0).stop 2024-09-19T06:09:13.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:09:13.814+0000 7fed8a65c640 1 -- 172.21.15.89:0/2773490237 shutdown_connections 2024-09-19T06:09:13.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:09:13.814+0000 7fed8a65c640 1 --2- 172.21.15.89:0/2773490237 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fed6c0a3270 0x7fed6c0a5730 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:13.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:09:13.814+0000 7fed8a65c640 1 --2- 172.21.15.89:0/2773490237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed841037d0 0x7fed8419f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:13.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:09:13.814+0000 7fed8a65c640 1 --2- 172.21.15.89:0/2773490237 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fed84102e10 0x7fed84198360 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:13.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:09:13.814+0000 7fed8a65c640 1 --2- 172.21.15.89:0/2773490237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed84101c10 0x7fed84197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:13.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:09:13.814+0000 7fed8a65c640 1 -- 172.21.15.89:0/2773490237 >> 172.21.15.89:0/2773490237 conn(0x7fed840fd3c0 msgr2=0x7fed84106230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:13.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:09:13.814+0000 7fed8a65c640 1 -- 172.21.15.89:0/2773490237 shutdown_connections 2024-09-19T06:09:13.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:09:13.814+0000 7fed8a65c640 1 -- 172.21.15.89:0/2773490237 wait complete. 2024-09-19T06:09:14.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:13 smithi089 ceph-mon[34160]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:09:14.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:13 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:14.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:13 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:14.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:13 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:14.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:13 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:09:14.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:13 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:14.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:13 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:09:14.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:13 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:14.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:13 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:14.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:13 smithi002 ceph-mon[30982]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:09:14.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:13 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:14.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:13 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:14.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:13 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:14.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:13 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:09:14.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:13 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:14.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:13 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:09:14.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:13 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:14.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:13 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:14.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:13 smithi090 ceph-mon[34497]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:09:14.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:13 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:14.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:13 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:14.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:13 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:14.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:13 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:09:14.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:13 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:14.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:13 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:09:14.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:13 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:14.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:13 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:14.439 DEBUG:teuthology.orchestra.run.smithi089:osd.4> sudo journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@osd.4.service 2024-09-19T06:09:14.442 INFO:tasks.cephadm:Deploying osd.5 on smithi090 with /dev/vg_nvme/lv_3... 2024-09-19T06:09:14.442 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T06:09:14.695 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:09:15.635 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 19 06:09:15 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-4[45135]: 2024-09-19T06:09:15.548+0000 7f544cfa2640 -1 osd.4 0 log_to_monitors true 2024-09-19T06:09:15.920 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:15 smithi089 ceph-mon[34160]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:09:15.920 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:15 smithi089 ceph-mon[34160]: from='osd.4 [v2:172.21.15.89:6808/4256848315,v1:172.21.15.89:6809/4256848315]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:09:15.920 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:15 smithi089 ceph-mon[34160]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:09:15.941 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:15 smithi090 ceph-mon[34497]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:09:15.941 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:15 smithi090 ceph-mon[34497]: from='osd.4 [v2:172.21.15.89:6808/4256848315,v1:172.21.15.89:6809/4256848315]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:09:15.941 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:15 smithi090 ceph-mon[34497]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:09:16.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:15 smithi002 ceph-mon[30982]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:09:16.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:15 smithi002 ceph-mon[30982]: from='osd.4 [v2:172.21.15.89:6808/4256848315,v1:172.21.15.89:6809/4256848315]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:09:16.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:15 smithi002 ceph-mon[30982]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:09:16.966 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-19T06:09:16.991 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi090:vg_nvme/lv_3 2024-09-19T06:09:17.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:16 smithi002 ceph-mon[30982]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T06:09:17.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:16 smithi002 ceph-mon[30982]: from='osd.4 [v2:172.21.15.89:6808/4256848315,v1:172.21.15.89:6809/4256848315]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-19T06:09:17.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:16 smithi002 ceph-mon[30982]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T06:09:17.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:16 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:09:17.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:16 smithi002 ceph-mon[30982]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-19T06:09:17.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:16 smithi002 ceph-mon[30982]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-19T06:09:17.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:16 smithi090 ceph-mon[34497]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T06:09:17.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:16 smithi090 ceph-mon[34497]: from='osd.4 [v2:172.21.15.89:6808/4256848315,v1:172.21.15.89:6809/4256848315]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-19T06:09:17.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:16 smithi090 ceph-mon[34497]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T06:09:17.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:16 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:09:17.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:16 smithi090 ceph-mon[34497]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-19T06:09:17.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:16 smithi090 ceph-mon[34497]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-19T06:09:17.258 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:09:17.291 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:16 smithi089 ceph-mon[34160]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T06:09:17.291 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:16 smithi089 ceph-mon[34160]: from='osd.4 [v2:172.21.15.89:6808/4256848315,v1:172.21.15.89:6809/4256848315]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-19T06:09:17.291 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:16 smithi089 ceph-mon[34160]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T06:09:17.291 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:16 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:09:17.291 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:16 smithi089 ceph-mon[34160]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-19T06:09:17.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:16 smithi089 ceph-mon[34160]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-19T06:09:17.731 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.727+0000 7f2f677fe640 1 -- 172.21.15.90:0/672704311 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f60102690 msgr2=0x7f2f60108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:17.731 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.727+0000 7f2f677fe640 1 --2- 172.21.15.90:0/672704311 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f60102690 0x7f2f60108f20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2f58009ca0 tx=0x7f2f5802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:09:17.731 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.727+0000 7f2f677fe640 1 -- 172.21.15.90:0/672704311 shutdown_connections 2024-09-19T06:09:17.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.727+0000 7f2f677fe640 1 --2- 172.21.15.90:0/672704311 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f60102690 0x7f2f60108f20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:17.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.727+0000 7f2f677fe640 1 --2- 172.21.15.90:0/672704311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f60101cd0 0x7f2f60102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:17.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.727+0000 7f2f677fe640 1 --2- 172.21.15.90:0/672704311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f60100ad0 0x7f2f60100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:17.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.727+0000 7f2f677fe640 1 -- 172.21.15.90:0/672704311 >> 172.21.15.90:0/672704311 conn(0x7f2f600fc280 msgr2=0x7f2f600fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:17.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.727+0000 7f2f677fe640 1 -- 172.21.15.90:0/672704311 shutdown_connections 2024-09-19T06:09:17.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.727+0000 7f2f677fe640 1 -- 172.21.15.90:0/672704311 wait complete. 2024-09-19T06:09:17.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.728+0000 7f2f677fe640 1 Processor -- start 2024-09-19T06:09:17.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.728+0000 7f2f677fe640 1 -- start start 2024-09-19T06:09:17.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.728+0000 7f2f677fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f60100ad0 0x7f2f60104a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:17.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.728+0000 7f2f677fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f60101cd0 0x7f2f601030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:17.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.728+0000 7f2f677fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f60102690 0x7f2f601035f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:17.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.728+0000 7f2f677fe640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2f6010c600 con 0x7f2f60101cd0 2024-09-19T06:09:17.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.728+0000 7f2f677fe640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2f6010c480 con 0x7f2f60100ad0 2024-09-19T06:09:17.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.728+0000 7f2f677fe640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2f6010c780 con 0x7f2f60102690 2024-09-19T06:09:17.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.728+0000 7f2f65d9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f60102690 0x7f2f601035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:17.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.728+0000 7f2f6559a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f60100ad0 0x7f2f60104a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:17.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.728+0000 7f2f6559a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f60100ad0 0x7f2f60104a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.90:42578/0 (socket says 172.21.15.90:42578) 2024-09-19T06:09:17.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.728+0000 7f2f65d9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f60102690 0x7f2f601035f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36902/0 (socket says 172.21.15.90:36902) 2024-09-19T06:09:17.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.728+0000 7f2f6559a640 1 -- 172.21.15.90:0/212793328 learned_addr learned my addr 172.21.15.90:0/212793328 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-19T06:09:17.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.728+0000 7f2f64d99640 1 --2- 172.21.15.90:0/212793328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f60101cd0 0x7f2f601030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:17.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.728+0000 7f2f6559a640 1 -- 172.21.15.90:0/212793328 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f60102690 msgr2=0x7f2f601035f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:17.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.728+0000 7f2f6559a640 1 --2- 172.21.15.90:0/212793328 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f60102690 0x7f2f601035f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:17.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.728+0000 7f2f6559a640 1 -- 172.21.15.90:0/212793328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f60101cd0 msgr2=0x7f2f601030b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:17.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.728+0000 7f2f6559a640 1 --2- 172.21.15.90:0/212793328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f60101cd0 0x7f2f601030b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:17.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.728+0000 7f2f6559a640 1 -- 172.21.15.90:0/212793328 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f60103eb0 con 0x7f2f60100ad0 2024-09-19T06:09:17.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.728+0000 7f2f65d9b640 1 --2- 172.21.15.90:0/212793328 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f60102690 0x7f2f601035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:09:17.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.728+0000 7f2f64d99640 1 --2- 172.21.15.90:0/212793328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f60101cd0 0x7f2f601030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:09:17.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.729+0000 7f2f6559a640 1 --2- 172.21.15.90:0/212793328 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f60100ad0 0x7f2f60104a60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2f5000c970 tx=0x7f2f5000ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:17.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.729+0000 7f2f567fc640 1 -- 172.21.15.90:0/212793328 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f50007c10 con 0x7f2f60100ad0 2024-09-19T06:09:17.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.729+0000 7f2f677fe640 1 -- 172.21.15.90:0/212793328 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f601a1ed0 con 0x7f2f60100ad0 2024-09-19T06:09:17.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.729+0000 7f2f677fe640 1 -- 172.21.15.90:0/212793328 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f601a2320 con 0x7f2f60100ad0 2024-09-19T06:09:17.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.729+0000 7f2f567fc640 1 -- 172.21.15.90:0/212793328 <== mon.2 v2:172.21.15.89:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2f50007db0 con 0x7f2f60100ad0 2024-09-19T06:09:17.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.729+0000 7f2f567fc640 1 -- 172.21.15.90:0/212793328 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f5000f710 con 0x7f2f60100ad0 2024-09-19T06:09:17.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.730+0000 7f2f677fe640 1 -- 172.21.15.90:0/212793328 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f601a2600 con 0x7f2f60100ad0 2024-09-19T06:09:17.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.731+0000 7f2f567fc640 1 -- 172.21.15.90:0/212793328 <== mon.2 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f2f50018a50 con 0x7f2f60100ad0 2024-09-19T06:09:17.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.731+0000 7f2f567fc640 1 --2- 172.21.15.90:0/212793328 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f2f4c0a3240 0x7f2f4c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:17.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.732+0000 7f2f567fc640 1 -- 172.21.15.90:0/212793328 <== mon.2 v2:172.21.15.89:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3821+0+0 (secure 0 0 0) 0x7f2f500ceb60 con 0x7f2f60100ad0 2024-09-19T06:09:17.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.732+0000 7f2f64d99640 1 --2- 172.21.15.90:0/212793328 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f2f4c0a3240 0x7f2f4c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:17.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.732+0000 7f2f64d99640 1 --2- 172.21.15.90:0/212793328 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f2f4c0a3240 0x7f2f4c0a5700 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2f601047e0 tx=0x7f2f5c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:17.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.736+0000 7f2f567fc640 1 -- 172.21.15.90:0/212793328 <== mon.2 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2f5009ca80 con 0x7f2f60100ad0 2024-09-19T06:09:17.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:17.916+0000 7f2f677fe640 1 -- 172.21.15.90:0/212793328 --> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f2f6006a6b0 con 0x7f2f4c0a3240 2024-09-19T06:09:18.042 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 19 06:09:17 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-4[45135]: 2024-09-19T06:09:17.689+0000 7f5449739640 -1 osd.4 0 waiting for initial osdmap 2024-09-19T06:09:18.042 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 19 06:09:17 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-4[45135]: 2024-09-19T06:09:17.699+0000 7f5440d34640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:09:18.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:17 smithi089 ceph-mon[34160]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:09:18.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:17 smithi089 ceph-mon[34160]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T06:09:18.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:17 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:09:18.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:17 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:09:18.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:17 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:18.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:17 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:18.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:17 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:09:18.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:17 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:09:18.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:17 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:18.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:17 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:18.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:17 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:09:18.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:17 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:18.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:17 smithi089 ceph-mon[34160]: from='osd.4 ' entity='osd.4' 2024-09-19T06:09:18.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:17 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:09:18.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:17 smithi002 ceph-mon[30982]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:09:18.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:17 smithi002 ceph-mon[30982]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T06:09:18.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:17 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:09:18.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:17 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:09:18.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:17 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:18.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:17 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:18.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:17 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:09:18.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:17 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:09:18.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:17 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:18.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:17 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:18.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:17 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:09:18.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:17 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:18.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:17 smithi002 ceph-mon[30982]: from='osd.4 ' entity='osd.4' 2024-09-19T06:09:18.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:17 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:09:18.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:17 smithi090 ceph-mon[34497]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:09:18.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:17 smithi090 ceph-mon[34497]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T06:09:18.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:17 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:09:18.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:17 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:09:18.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:17 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:18.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:17 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:18.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:17 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:09:18.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:17 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:09:18.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:17 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:18.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:17 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:18.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:17 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:09:18.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:17 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:18.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:17 smithi090 ceph-mon[34497]: from='osd.4 ' entity='osd.4' 2024-09-19T06:09:18.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:17 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:09:19.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:18 smithi002 ceph-mon[30982]: purged_snaps scrub starts 2024-09-19T06:09:19.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:18 smithi002 ceph-mon[30982]: purged_snaps scrub ok 2024-09-19T06:09:19.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:18 smithi002 ceph-mon[30982]: Detected new or changed devices on smithi089 2024-09-19T06:09:19.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:18 smithi002 ceph-mon[30982]: Adjusting osd_memory_target on smithi089 to 8543M 2024-09-19T06:09:19.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:18 smithi002 ceph-mon[30982]: from='client.24236 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:09:19.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:18 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:09:19.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:18 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:09:19.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:18 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:19.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:18 smithi002 ceph-mon[30982]: osd.4 [v2:172.21.15.89:6808/4256848315,v1:172.21.15.89:6809/4256848315] boot 2024-09-19T06:09:19.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:18 smithi002 ceph-mon[30982]: osdmap e31: 5 total, 5 up, 5 in 2024-09-19T06:09:19.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:18 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:09:19.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:18 smithi090 ceph-mon[34497]: purged_snaps scrub starts 2024-09-19T06:09:19.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:18 smithi090 ceph-mon[34497]: purged_snaps scrub ok 2024-09-19T06:09:19.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:18 smithi090 ceph-mon[34497]: Detected new or changed devices on smithi089 2024-09-19T06:09:19.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:18 smithi090 ceph-mon[34497]: Adjusting osd_memory_target on smithi089 to 8543M 2024-09-19T06:09:19.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:18 smithi090 ceph-mon[34497]: from='client.24236 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:09:19.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:18 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:09:19.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:18 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:09:19.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:18 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:19.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:18 smithi090 ceph-mon[34497]: osd.4 [v2:172.21.15.89:6808/4256848315,v1:172.21.15.89:6809/4256848315] boot 2024-09-19T06:09:19.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:18 smithi090 ceph-mon[34497]: osdmap e31: 5 total, 5 up, 5 in 2024-09-19T06:09:19.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:18 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:09:19.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:18 smithi089 ceph-mon[34160]: purged_snaps scrub starts 2024-09-19T06:09:19.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:18 smithi089 ceph-mon[34160]: purged_snaps scrub ok 2024-09-19T06:09:19.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:18 smithi089 ceph-mon[34160]: Detected new or changed devices on smithi089 2024-09-19T06:09:19.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:18 smithi089 ceph-mon[34160]: Adjusting osd_memory_target on smithi089 to 8543M 2024-09-19T06:09:19.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:18 smithi089 ceph-mon[34160]: from='client.24236 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:09:19.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:18 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:09:19.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:18 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:09:19.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:18 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:19.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:18 smithi089 ceph-mon[34160]: osd.4 [v2:172.21.15.89:6808/4256848315,v1:172.21.15.89:6809/4256848315] boot 2024-09-19T06:09:19.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:18 smithi089 ceph-mon[34160]: osdmap e31: 5 total, 5 up, 5 in 2024-09-19T06:09:19.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:18 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:09:20.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:19 smithi002 ceph-mon[30982]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:09:20.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:19 smithi090 ceph-mon[34497]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:09:20.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:19 smithi089 ceph-mon[34160]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:09:21.194 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:20 smithi089 ceph-mon[34160]: osdmap e32: 5 total, 5 up, 5 in 2024-09-19T06:09:21.194 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:20 smithi089 ceph-mon[34160]: from='client.? 172.21.15.90:0/1949583521' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8dc9bb55-29e0-4b04-9415-3b9bb5ed05cb"}]: dispatch 2024-09-19T06:09:21.194 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:20 smithi089 ceph-mon[34160]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8dc9bb55-29e0-4b04-9415-3b9bb5ed05cb"}]: dispatch 2024-09-19T06:09:21.194 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:20 smithi089 ceph-mon[34160]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8dc9bb55-29e0-4b04-9415-3b9bb5ed05cb"}]': finished 2024-09-19T06:09:21.194 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:20 smithi089 ceph-mon[34160]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T06:09:21.194 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:20 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:09:21.194 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:20 smithi089 ceph-mon[34160]: from='client.? 172.21.15.90:0/1824266370' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:09:21.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:20 smithi002 ceph-mon[30982]: osdmap e32: 5 total, 5 up, 5 in 2024-09-19T06:09:21.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:20 smithi002 ceph-mon[30982]: from='client.? 172.21.15.90:0/1949583521' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8dc9bb55-29e0-4b04-9415-3b9bb5ed05cb"}]: dispatch 2024-09-19T06:09:21.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:20 smithi002 ceph-mon[30982]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8dc9bb55-29e0-4b04-9415-3b9bb5ed05cb"}]: dispatch 2024-09-19T06:09:21.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:20 smithi002 ceph-mon[30982]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8dc9bb55-29e0-4b04-9415-3b9bb5ed05cb"}]': finished 2024-09-19T06:09:21.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:20 smithi002 ceph-mon[30982]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T06:09:21.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:20 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:09:21.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:20 smithi002 ceph-mon[30982]: from='client.? 172.21.15.90:0/1824266370' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:09:21.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:20 smithi090 ceph-mon[34497]: osdmap e32: 5 total, 5 up, 5 in 2024-09-19T06:09:21.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:20 smithi090 ceph-mon[34497]: from='client.? 172.21.15.90:0/1949583521' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8dc9bb55-29e0-4b04-9415-3b9bb5ed05cb"}]: dispatch 2024-09-19T06:09:21.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:20 smithi090 ceph-mon[34497]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8dc9bb55-29e0-4b04-9415-3b9bb5ed05cb"}]: dispatch 2024-09-19T06:09:21.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:20 smithi090 ceph-mon[34497]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8dc9bb55-29e0-4b04-9415-3b9bb5ed05cb"}]': finished 2024-09-19T06:09:21.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:20 smithi090 ceph-mon[34497]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T06:09:21.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:20 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:09:21.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:20 smithi090 ceph-mon[34497]: from='client.? 172.21.15.90:0/1824266370' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:09:22.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:21 smithi002 ceph-mon[30982]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:09:22.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:21 smithi090 ceph-mon[34497]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:09:22.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:21 smithi089 ceph-mon[34160]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:09:23.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:22 smithi090 ceph-mon[34497]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:09:23.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:22 smithi089 ceph-mon[34160]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:09:23.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:22 smithi002 ceph-mon[30982]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:09:25.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:24 smithi090 ceph-mon[34497]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:09:25.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:24 smithi089 ceph-mon[34160]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:09:25.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:24 smithi002 ceph-mon[30982]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:09:27.097 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:26 smithi090 ceph-mon[34497]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:09:27.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:26 smithi089 ceph-mon[34160]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:09:27.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:26 smithi002 ceph-mon[30982]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:09:29.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:28 smithi090 ceph-mon[34497]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:09:29.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:28 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T06:09:29.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:28 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:29.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:28 smithi090 ceph-mon[34497]: Deploying daemon osd.5 on smithi090 2024-09-19T06:09:29.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:28 smithi089 ceph-mon[34160]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:09:29.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:28 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T06:09:29.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:28 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:29.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:28 smithi089 ceph-mon[34160]: Deploying daemon osd.5 on smithi090 2024-09-19T06:09:29.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:28 smithi002 ceph-mon[30982]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:09:29.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:28 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T06:09:29.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:28 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:29.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:28 smithi002 ceph-mon[30982]: Deploying daemon osd.5 on smithi090 2024-09-19T06:09:31.287 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:30 smithi090 ceph-mon[34497]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:09:31.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:30 smithi089 ceph-mon[34160]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:09:31.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:30 smithi002 ceph-mon[30982]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:09:33.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:32 smithi089 ceph-mon[34160]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:09:33.416 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:32 smithi090 ceph-mon[34497]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:09:33.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:32 smithi002 ceph-mon[30982]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:09:35.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:34 smithi089 ceph-mon[34160]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:09:35.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:34 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:09:35.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:34 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:35.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:34 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:35.329 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:34 smithi090 ceph-mon[34497]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:09:35.329 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:34 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:09:35.330 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:34 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:35.330 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:34 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:35.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:34 smithi002 ceph-mon[30982]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:09:35.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:34 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:09:35.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:34 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:35.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:34 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:38.139 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:37 smithi090 ceph-mon[34497]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:09:38.139 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:37 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:38.139 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:37 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:38.139 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:37 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:38.140 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:37 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:09:38.140 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:37 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:38.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:37 smithi002 ceph-mon[30982]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:09:38.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:37 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:38.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:37 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:38.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:37 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:38.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:37 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:09:38.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:37 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:38.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:37 smithi089 ceph-mon[34160]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:09:38.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:37 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:38.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:37 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:38.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:37 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:38.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:37 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:09:38.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:37 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:38.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:38.464+0000 7f2f567fc640 1 -- 172.21.15.90:0/212793328 <== mgr.14150 v2:172.21.15.2:6800/4180340554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2f6006a6b0 con 0x7f2f4c0a3240 2024-09-19T06:09:38.469 INFO:teuthology.orchestra.run.smithi090.stdout:Created osd(s) 5 on host 'smithi090' 2024-09-19T06:09:38.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:38.467+0000 7f2f677fe640 1 -- 172.21.15.90:0/212793328 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f2f4c0a3240 msgr2=0x7f2f4c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:38.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:38.467+0000 7f2f677fe640 1 --2- 172.21.15.90:0/212793328 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f2f4c0a3240 0x7f2f4c0a5700 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2f601047e0 tx=0x7f2f5c005f90 comp rx=0 tx=0).stop 2024-09-19T06:09:38.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:38.467+0000 7f2f677fe640 1 -- 172.21.15.90:0/212793328 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f60100ad0 msgr2=0x7f2f60104a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:38.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:38.467+0000 7f2f677fe640 1 --2- 172.21.15.90:0/212793328 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f60100ad0 0x7f2f60104a60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2f5000c970 tx=0x7f2f5000ce30 comp rx=0 tx=0).stop 2024-09-19T06:09:38.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:38.467+0000 7f2f677fe640 1 -- 172.21.15.90:0/212793328 shutdown_connections 2024-09-19T06:09:38.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:38.467+0000 7f2f677fe640 1 --2- 172.21.15.90:0/212793328 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f2f4c0a3240 0x7f2f4c0a5700 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:38.467+0000 7f2f677fe640 1 --2- 172.21.15.90:0/212793328 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f60102690 0x7f2f601035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:38.467+0000 7f2f677fe640 1 --2- 172.21.15.90:0/212793328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f60101cd0 0x7f2f601030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:38.467+0000 7f2f677fe640 1 --2- 172.21.15.90:0/212793328 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f60100ad0 0x7f2f60104a60 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:38.467+0000 7f2f677fe640 1 -- 172.21.15.90:0/212793328 >> 172.21.15.90:0/212793328 conn(0x7f2f600fc280 msgr2=0x7f2f60069fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:38.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:38.467+0000 7f2f677fe640 1 -- 172.21.15.90:0/212793328 shutdown_connections 2024-09-19T06:09:38.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:09:38.467+0000 7f2f677fe640 1 -- 172.21.15.90:0/212793328 wait complete. 2024-09-19T06:09:39.113 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:38 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:09:39.113 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:38 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:39.113 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:38 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:39.123 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:38 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:09:39.123 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:38 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:39.123 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:38 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:39.140 DEBUG:teuthology.orchestra.run.smithi090:osd.5> sudo journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@osd.5.service 2024-09-19T06:09:39.142 INFO:tasks.cephadm:Deploying osd.6 on smithi002 with /dev/vg_nvme/lv_2... 2024-09-19T06:09:39.142 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T06:09:39.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:38 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:09:39.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:38 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:39.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:38 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:39.408 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:09:39.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:39 smithi002 ceph-mon[30982]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:09:40.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:39 smithi090 ceph-mon[34497]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:09:40.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:39 smithi089 ceph-mon[34160]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:09:41.222 INFO:journalctl@ceph.osd.5.smithi090.stdout:Sep 19 06:09:40 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-5[46234]: 2024-09-19T06:09:40.907+0000 7f3eab116640 -1 osd.5 0 log_to_monitors true 2024-09-19T06:09:42.119 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:41 smithi002 ceph-mon[30982]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:09:42.119 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:41 smithi002 ceph-mon[30982]: from='osd.5 [v2:172.21.15.90:6808/189855967,v1:172.21.15.90:6809/189855967]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:09:42.119 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:41 smithi002 ceph-mon[30982]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:09:42.121 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:09:42.147 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi002:vg_nvme/lv_2 2024-09-19T06:09:42.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:41 smithi090 ceph-mon[34497]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:09:42.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:41 smithi090 ceph-mon[34497]: from='osd.5 [v2:172.21.15.90:6808/189855967,v1:172.21.15.90:6809/189855967]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:09:42.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:41 smithi090 ceph-mon[34497]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:09:42.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:41 smithi089 ceph-mon[34160]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:09:42.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:41 smithi089 ceph-mon[34160]: from='osd.5 [v2:172.21.15.90:6808/189855967,v1:172.21.15.90:6809/189855967]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:09:42.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:41 smithi089 ceph-mon[34160]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:09:42.399 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:09:42.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:09:42.832+0000 7f0c5af05640 1 -- 172.21.15.2:0/2196957161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c54102690 msgr2=0x7f0c54108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:42.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:09:42.832+0000 7f0c5af05640 1 --2- 172.21.15.2:0/2196957161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c54102690 0x7f0c54108f20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c009ca0 tx=0x7f0c4c02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:09:42.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:09:42.832+0000 7f0c5af05640 1 -- 172.21.15.2:0/2196957161 shutdown_connections 2024-09-19T06:09:42.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:09:42.832+0000 7f0c5af05640 1 --2- 172.21.15.2:0/2196957161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c54102690 0x7f0c54108f20 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:42.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:09:42.832+0000 7f0c5af05640 1 --2- 172.21.15.2:0/2196957161 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c54101cd0 0x7f0c54102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:42.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:09:42.832+0000 7f0c5af05640 1 --2- 172.21.15.2:0/2196957161 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c54100ad0 0x7f0c54100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:42.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:09:42.832+0000 7f0c5af05640 1 -- 172.21.15.2:0/2196957161 >> 172.21.15.2:0/2196957161 conn(0x7f0c540fc280 msgr2=0x7f0c540fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:42.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:09:42.832+0000 7f0c5af05640 1 -- 172.21.15.2:0/2196957161 shutdown_connections 2024-09-19T06:09:42.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:09:42.832+0000 7f0c5af05640 1 -- 172.21.15.2:0/2196957161 wait complete. 2024-09-19T06:09:42.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:09:42.833+0000 7f0c5af05640 1 Processor -- start 2024-09-19T06:09:42.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:09:42.833+0000 7f0c5af05640 1 -- start start 2024-09-19T06:09:42.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:09:42.833+0000 7f0c5af05640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c54100ad0 0x7f0c54197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:42.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:09:42.833+0000 7f0c5af05640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c54101cd0 0x7f0c54198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:42.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:09:42.833+0000 7f0c5af05640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c54102690 0x7f0c5419f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:42.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:09:42.833+0000 7f0c5af05640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5410c600 con 0x7f0c54101cd0 2024-09-19T06:09:42.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:09:42.833+0000 7f0c5af05640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5410c480 con 0x7f0c54100ad0 2024-09-19T06:09:42.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:09:42.833+0000 7f0c5af05640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5410c780 con 0x7f0c54102690 2024-09-19T06:09:42.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:09:42.833+0000 7f0c53fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c54101cd0 0x7f0c54198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:42.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:09:42.833+0000 7f0c53fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c54101cd0 0x7f0c54198310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52334/0 (socket says 172.21.15.2:52334) 2024-09-19T06:09:42.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:09:42.833+0000 7f0c53fff640 1 -- 172.21.15.2:0/4123406890 learned_addr learned my addr 172.21.15.2:0/4123406890 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:09:42.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:09:42.833+0000 7f0c58ca1640 1 --2- 172.21.15.2:0/4123406890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c54100ad0 0x7f0c54197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:42.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:09:42.833+0000 7f0c594a2640 1 --2- 172.21.15.2:0/4123406890 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c54102690 0x7f0c5419f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:42.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:09:42.833+0000 7f0c53fff640 1 -- 172.21.15.2:0/4123406890 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c54102690 msgr2=0x7f0c5419f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:42.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:09:42.833+0000 7f0c53fff640 1 --2- 172.21.15.2:0/4123406890 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c54102690 0x7f0c5419f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:42.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:09:42.833+0000 7f0c53fff640 1 -- 172.21.15.2:0/4123406890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c54100ad0 msgr2=0x7f0c54197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:42.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:09:42.833+0000 7f0c53fff640 1 --2- 172.21.15.2:0/4123406890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c54100ad0 0x7f0c54197dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:42.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:09:42.833+0000 7f0c53fff640 1 -- 172.21.15.2:0/4123406890 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c5419fa00 con 0x7f0c54101cd0 2024-09-19T06:09:42.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:09:42.833+0000 7f0c594a2640 1 --2- 172.21.15.2:0/4123406890 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c54102690 0x7f0c5419f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:09:42.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:09:42.834+0000 7f0c53fff640 1 --2- 172.21.15.2:0/4123406890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c54101cd0 0x7f0c54198310 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0c4800d950 tx=0x7f0c4800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:42.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:09:42.834+0000 7f0c51ffb640 1 -- 172.21.15.2:0/4123406890 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c48017030 con 0x7f0c54101cd0 2024-09-19T06:09:42.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:09:42.834+0000 7f0c51ffb640 1 -- 172.21.15.2:0/4123406890 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0c48004020 con 0x7f0c54101cd0 2024-09-19T06:09:42.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:09:42.834+0000 7f0c5af05640 1 -- 172.21.15.2:0/4123406890 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c5419fcf0 con 0x7f0c54101cd0 2024-09-19T06:09:42.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:09:42.834+0000 7f0c51ffb640 1 -- 172.21.15.2:0/4123406890 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c480047a0 con 0x7f0c54101cd0 2024-09-19T06:09:42.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:09:42.834+0000 7f0c5af05640 1 -- 172.21.15.2:0/4123406890 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c541a0220 con 0x7f0c54101cd0 2024-09-19T06:09:42.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:09:42.835+0000 7f0c5af05640 1 -- 172.21.15.2:0/4123406890 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c541a04b0 con 0x7f0c54101cd0 2024-09-19T06:09:42.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:09:42.836+0000 7f0c51ffb640 1 -- 172.21.15.2:0/4123406890 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f0c480041d0 con 0x7f0c54101cd0 2024-09-19T06:09:42.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:09:42.837+0000 7f0c51ffb640 1 --2- 172.21.15.2:0/4123406890 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f0c3c0a32f0 0x7f0c3c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:42.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:09:42.837+0000 7f0c58ca1640 1 --2- 172.21.15.2:0/4123406890 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f0c3c0a32f0 0x7f0c3c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:42.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:09:42.837+0000 7f0c51ffb640 1 -- 172.21.15.2:0/4123406890 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4237+0+0 (secure 0 0 0) 0x7f0c480ce3a0 con 0x7f0c54101cd0 2024-09-19T06:09:42.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:09:42.837+0000 7f0c58ca1640 1 --2- 172.21.15.2:0/4123406890 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f0c3c0a32f0 0x7f0c3c0a57b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0c440058c0 tx=0x7f0c4400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:42.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:09:42.841+0000 7f0c51ffb640 1 -- 172.21.15.2:0/4123406890 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0c4809c010 con 0x7f0c54101cd0 2024-09-19T06:09:43.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:09:43.031+0000 7f0c5af05640 1 -- 172.21.15.2:0/4123406890 --> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f0c5406a730 con 0x7f0c3c0a32f0 2024-09-19T06:09:43.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:42 smithi002 ceph-mon[30982]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T06:09:43.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:42 smithi002 ceph-mon[30982]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T06:09:43.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:42 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:09:43.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:42 smithi002 ceph-mon[30982]: from='osd.5 [v2:172.21.15.90:6808/189855967,v1:172.21.15.90:6809/189855967]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-09-19T06:09:43.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:42 smithi002 ceph-mon[30982]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-09-19T06:09:43.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:42 smithi002 ceph-mon[30982]: Detected new or changed devices on smithi090 2024-09-19T06:09:43.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:42 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:43.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:42 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:43.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:42 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:09:43.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:42 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:09:43.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:42 smithi002 ceph-mon[30982]: Adjusting osd_memory_target on smithi090 to 8544M 2024-09-19T06:09:43.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:42 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:43.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:42 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:43.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:42 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:09:43.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:42 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:43.240 INFO:journalctl@ceph.osd.5.smithi090.stdout:Sep 19 06:09:42 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-5[46234]: 2024-09-19T06:09:42.860+0000 7f3ea6876640 -1 osd.5 0 waiting for initial osdmap 2024-09-19T06:09:43.240 INFO:journalctl@ceph.osd.5.smithi090.stdout:Sep 19 06:09:42 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-5[46234]: 2024-09-19T06:09:42.868+0000 7f3ea2eb0640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:09:43.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:42 smithi090 ceph-mon[34497]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T06:09:43.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:42 smithi090 ceph-mon[34497]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T06:09:43.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:42 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:09:43.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:42 smithi090 ceph-mon[34497]: from='osd.5 [v2:172.21.15.90:6808/189855967,v1:172.21.15.90:6809/189855967]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-09-19T06:09:43.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:42 smithi090 ceph-mon[34497]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-09-19T06:09:43.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:42 smithi090 ceph-mon[34497]: Detected new or changed devices on smithi090 2024-09-19T06:09:43.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:42 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:43.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:42 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:43.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:42 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:09:43.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:42 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:09:43.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:42 smithi090 ceph-mon[34497]: Adjusting osd_memory_target on smithi090 to 8544M 2024-09-19T06:09:43.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:42 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:43.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:42 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:43.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:42 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:09:43.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:42 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:43.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:42 smithi089 ceph-mon[34160]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T06:09:43.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:42 smithi089 ceph-mon[34160]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T06:09:43.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:42 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:09:43.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:42 smithi089 ceph-mon[34160]: from='osd.5 [v2:172.21.15.90:6808/189855967,v1:172.21.15.90:6809/189855967]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-09-19T06:09:43.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:42 smithi089 ceph-mon[34160]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-09-19T06:09:43.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:42 smithi089 ceph-mon[34160]: Detected new or changed devices on smithi090 2024-09-19T06:09:43.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:42 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:43.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:42 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:43.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:42 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:09:43.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:42 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:09:43.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:42 smithi089 ceph-mon[34160]: Adjusting osd_memory_target on smithi090 to 8544M 2024-09-19T06:09:43.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:42 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:43.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:42 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:43.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:42 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:09:43.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:42 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:09:44.136 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:43 smithi002 ceph-mon[30982]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:09:44.136 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:43 smithi002 ceph-mon[30982]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]': finished 2024-09-19T06:09:44.136 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:43 smithi002 ceph-mon[30982]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T06:09:44.136 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:43 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:09:44.137 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:43 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:09:44.137 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:43 smithi002 ceph-mon[30982]: osd.5 [v2:172.21.15.90:6808/189855967,v1:172.21.15.90:6809/189855967] boot 2024-09-19T06:09:44.137 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:43 smithi002 ceph-mon[30982]: osdmap e36: 6 total, 6 up, 6 in 2024-09-19T06:09:44.137 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:43 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:09:44.137 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:43 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:09:44.137 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:43 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:09:44.137 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:43 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:44.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:43 smithi090 ceph-mon[34497]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:09:44.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:43 smithi090 ceph-mon[34497]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]': finished 2024-09-19T06:09:44.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:43 smithi090 ceph-mon[34497]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T06:09:44.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:43 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:09:44.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:43 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:09:44.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:43 smithi090 ceph-mon[34497]: osd.5 [v2:172.21.15.90:6808/189855967,v1:172.21.15.90:6809/189855967] boot 2024-09-19T06:09:44.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:43 smithi090 ceph-mon[34497]: osdmap e36: 6 total, 6 up, 6 in 2024-09-19T06:09:44.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:43 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:09:44.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:43 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:09:44.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:43 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:09:44.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:43 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:44.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:43 smithi089 ceph-mon[34160]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:09:44.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:43 smithi089 ceph-mon[34160]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]': finished 2024-09-19T06:09:44.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:43 smithi089 ceph-mon[34160]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T06:09:44.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:43 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:09:44.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:43 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:09:44.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:43 smithi089 ceph-mon[34160]: osd.5 [v2:172.21.15.90:6808/189855967,v1:172.21.15.90:6809/189855967] boot 2024-09-19T06:09:44.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:43 smithi089 ceph-mon[34160]: osdmap e36: 6 total, 6 up, 6 in 2024-09-19T06:09:44.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:43 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:09:44.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:43 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:09:44.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:43 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:09:44.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:43 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:45.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:44 smithi002 ceph-mon[30982]: purged_snaps scrub starts 2024-09-19T06:09:45.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:44 smithi002 ceph-mon[30982]: purged_snaps scrub ok 2024-09-19T06:09:45.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:44 smithi002 ceph-mon[30982]: from='client.14349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:09:45.103 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:44 smithi002 ceph-mon[30982]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T06:09:45.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:44 smithi090 ceph-mon[34497]: purged_snaps scrub starts 2024-09-19T06:09:45.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:44 smithi090 ceph-mon[34497]: purged_snaps scrub ok 2024-09-19T06:09:45.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:44 smithi090 ceph-mon[34497]: from='client.14349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:09:45.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:44 smithi090 ceph-mon[34497]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T06:09:45.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:44 smithi089 ceph-mon[34160]: purged_snaps scrub starts 2024-09-19T06:09:45.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:44 smithi089 ceph-mon[34160]: purged_snaps scrub ok 2024-09-19T06:09:45.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:44 smithi089 ceph-mon[34160]: from='client.14349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:09:45.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:44 smithi089 ceph-mon[34160]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T06:09:45.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:45 smithi002 ceph-mon[30982]: pgmap v132: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:09:45.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:45 smithi002 ceph-mon[30982]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T06:09:45.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:45 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1193495407' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "86d1443a-9b43-46de-abd7-4c95b43207f5"}]: dispatch 2024-09-19T06:09:45.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:45 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1193495407' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "86d1443a-9b43-46de-abd7-4c95b43207f5"}]': finished 2024-09-19T06:09:45.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:45 smithi002 ceph-mon[30982]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T06:09:45.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:45 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:09:46.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:45 smithi090 ceph-mon[34497]: pgmap v132: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:09:46.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:45 smithi090 ceph-mon[34497]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T06:09:46.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:45 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1193495407' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "86d1443a-9b43-46de-abd7-4c95b43207f5"}]: dispatch 2024-09-19T06:09:46.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:45 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1193495407' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "86d1443a-9b43-46de-abd7-4c95b43207f5"}]': finished 2024-09-19T06:09:46.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:45 smithi090 ceph-mon[34497]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T06:09:46.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:45 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:09:46.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:45 smithi089 ceph-mon[34160]: pgmap v132: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:09:46.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:45 smithi089 ceph-mon[34160]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T06:09:46.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:45 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1193495407' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "86d1443a-9b43-46de-abd7-4c95b43207f5"}]: dispatch 2024-09-19T06:09:46.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:45 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1193495407' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "86d1443a-9b43-46de-abd7-4c95b43207f5"}]': finished 2024-09-19T06:09:46.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:45 smithi089 ceph-mon[34160]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T06:09:46.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:45 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:09:47.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:46 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/291319775' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:09:47.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:46 smithi002 ceph-mon[30982]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T06:09:47.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:46 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:09:47.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:46 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/291319775' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:09:47.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:46 smithi090 ceph-mon[34497]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T06:09:47.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:46 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:09:47.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:46 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/291319775' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:09:47.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:46 smithi089 ceph-mon[34160]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T06:09:47.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:46 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:09:48.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:47 smithi002 ceph-mon[30982]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:09:48.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:47 smithi090 ceph-mon[34497]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:09:48.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:47 smithi089 ceph-mon[34160]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:09:50.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:49 smithi002 ceph-mon[30982]: pgmap v138: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:09:50.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:49 smithi090 ceph-mon[34497]: pgmap v138: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:09:50.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:49 smithi089 ceph-mon[34160]: pgmap v138: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:09:51.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:51 smithi002 ceph-mon[30982]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-19T06:09:52.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:51 smithi090 ceph-mon[34497]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-19T06:09:52.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:51 smithi089 ceph-mon[34160]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-19T06:09:54.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:53 smithi002 ceph-mon[30982]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-19T06:09:54.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:53 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T06:09:54.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:53 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:54.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:53 smithi090 ceph-mon[34497]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-19T06:09:54.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:53 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T06:09:54.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:53 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:54.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:53 smithi089 ceph-mon[34160]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-19T06:09:54.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:53 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T06:09:54.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:53 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:55.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:54 smithi002 ceph-mon[30982]: Deploying daemon osd.6 on smithi002 2024-09-19T06:09:55.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:54 smithi090 ceph-mon[34497]: Deploying daemon osd.6 on smithi002 2024-09-19T06:09:55.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:54 smithi089 ceph-mon[34160]: Deploying daemon osd.6 on smithi002 2024-09-19T06:09:56.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:55 smithi002 ceph-mon[30982]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-19T06:09:56.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:55 smithi090 ceph-mon[34497]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-19T06:09:56.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:55 smithi089 ceph-mon[34160]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-19T06:09:58.174 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:57 smithi002 ceph-mon[30982]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T06:09:58.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:57 smithi090 ceph-mon[34497]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T06:09:58.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:57 smithi089 ceph-mon[34160]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T06:10:00.164 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:59 smithi002 ceph-mon[30982]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-19T06:10:00.165 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:59 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:10:00.165 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:59 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:00.165 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:09:59 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:00.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:59 smithi090 ceph-mon[34497]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-19T06:10:00.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:59 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:10:00.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:59 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:00.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:09:59 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:00.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:59 smithi089 ceph-mon[34160]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-19T06:10:00.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:59 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:10:00.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:59 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:00.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:09:59 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:01.161 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:00 smithi002 ceph-mon[30982]: overall HEALTH_OK 2024-09-19T06:10:01.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:00 smithi090 ceph-mon[34497]: overall HEALTH_OK 2024-09-19T06:10:01.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:00 smithi089 ceph-mon[34160]: overall HEALTH_OK 2024-09-19T06:10:02.193 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:01 smithi002 ceph-mon[30982]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:10:02.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:01 smithi090 ceph-mon[34497]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:10:02.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:01 smithi089 ceph-mon[34160]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:10:03.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:03.401+0000 7f0c51ffb640 1 -- 172.21.15.2:0/4123406890 <== mgr.14150 v2:172.21.15.2:6800/4180340554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0c5406a730 con 0x7f0c3c0a32f0 2024-09-19T06:10:03.404 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 6 on host 'smithi002' 2024-09-19T06:10:03.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:03.404+0000 7f0c5af05640 1 -- 172.21.15.2:0/4123406890 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f0c3c0a32f0 msgr2=0x7f0c3c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:03.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:03.404+0000 7f0c5af05640 1 --2- 172.21.15.2:0/4123406890 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f0c3c0a32f0 0x7f0c3c0a57b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0c440058c0 tx=0x7f0c4400a2d0 comp rx=0 tx=0).stop 2024-09-19T06:10:03.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:03.404+0000 7f0c5af05640 1 -- 172.21.15.2:0/4123406890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c54101cd0 msgr2=0x7f0c54198310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:03.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:03.404+0000 7f0c5af05640 1 --2- 172.21.15.2:0/4123406890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c54101cd0 0x7f0c54198310 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0c4800d950 tx=0x7f0c4800de10 comp rx=0 tx=0).stop 2024-09-19T06:10:03.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:03.404+0000 7f0c5af05640 1 -- 172.21.15.2:0/4123406890 shutdown_connections 2024-09-19T06:10:03.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:03.404+0000 7f0c5af05640 1 --2- 172.21.15.2:0/4123406890 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f0c3c0a32f0 0x7f0c3c0a57b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:03.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:03.404+0000 7f0c5af05640 1 --2- 172.21.15.2:0/4123406890 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c54102690 0x7f0c5419f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:03.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:03.404+0000 7f0c5af05640 1 --2- 172.21.15.2:0/4123406890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c54101cd0 0x7f0c54198310 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:03.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:03.404+0000 7f0c5af05640 1 --2- 172.21.15.2:0/4123406890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c54100ad0 0x7f0c54197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:03.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:03.404+0000 7f0c5af05640 1 -- 172.21.15.2:0/4123406890 >> 172.21.15.2:0/4123406890 conn(0x7f0c540fc280 msgr2=0x7f0c5406a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:03.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:03.404+0000 7f0c5af05640 1 -- 172.21.15.2:0/4123406890 shutdown_connections 2024-09-19T06:10:03.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:03.404+0000 7f0c5af05640 1 -- 172.21.15.2:0/4123406890 wait complete. 2024-09-19T06:10:03.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:03 smithi002 ceph-mon[30982]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:10:03.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:03 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:03.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:03 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:03.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:03 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:10:03.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:03 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:10:03.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:03 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:03.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:03 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:10:03.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:03 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:03.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:03 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:03.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:03 smithi090 ceph-mon[34497]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:10:03.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:03 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:03.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:03 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:03.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:03 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:10:03.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:03 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:10:03.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:03 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:03.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:03 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:10:03.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:03 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:03.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:03 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:03.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:03 smithi089 ceph-mon[34160]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:10:03.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:03 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:03.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:03 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:03.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:03 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:10:03.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:03 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:10:03.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:03 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:03.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:03 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:10:03.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:03 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:03.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:03 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:04.068 DEBUG:teuthology.orchestra.run.smithi002:osd.6> sudo journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@osd.6.service 2024-09-19T06:10:04.070 INFO:tasks.cephadm:Deploying osd.7 on smithi089 with /dev/vg_nvme/lv_2... 2024-09-19T06:10:04.070 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T06:10:04.326 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:10:05.618 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:05 smithi089 ceph-mon[34160]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:10:05.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:05 smithi002 ceph-mon[30982]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:10:05.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:05 smithi090 ceph-mon[34497]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:10:06.421 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:10:06 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:10:06.046+0000 7f8f88391640 -1 osd.6 0 log_to_monitors true 2024-09-19T06:10:06.713 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:06 smithi002 ceph-mon[30982]: from='osd.6 [v2:172.21.15.2:6818/3886336279,v1:172.21.15.2:6819/3886336279]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T06:10:06.769 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:06 smithi089 ceph-mon[34160]: from='osd.6 [v2:172.21.15.2:6818/3886336279,v1:172.21.15.2:6819/3886336279]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T06:10:06.771 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-19T06:10:06.799 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi089:vg_nvme/lv_2 2024-09-19T06:10:06.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:06 smithi090 ceph-mon[34497]: from='osd.6 [v2:172.21.15.2:6818/3886336279,v1:172.21.15.2:6819/3886336279]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T06:10:07.047 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:10:07.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:07.503+0000 7fa465cf5640 1 -- 172.21.15.89:0/100929304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa460101c00 msgr2=0x7fa460102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:07.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:07.503+0000 7fa465cf5640 1 --2- 172.21.15.89:0/100929304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa460101c00 0x7fa460102000 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa450009ca0 tx=0x7fa45002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:10:07.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:07.504+0000 7fa465cf5640 1 -- 172.21.15.89:0/100929304 shutdown_connections 2024-09-19T06:10:07.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:07.504+0000 7fa465cf5640 1 --2- 172.21.15.89:0/100929304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4601037c0 0x7fa46010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:07.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:07.504+0000 7fa465cf5640 1 --2- 172.21.15.89:0/100929304 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa460102e00 0x7fa460103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:07.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:07.504+0000 7fa465cf5640 1 --2- 172.21.15.89:0/100929304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa460101c00 0x7fa460102000 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:07.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:07.504+0000 7fa465cf5640 1 -- 172.21.15.89:0/100929304 >> 172.21.15.89:0/100929304 conn(0x7fa4600fd3b0 msgr2=0x7fa4600ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:07.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:07.504+0000 7fa465cf5640 1 -- 172.21.15.89:0/100929304 shutdown_connections 2024-09-19T06:10:07.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:07.504+0000 7fa465cf5640 1 -- 172.21.15.89:0/100929304 wait complete. 2024-09-19T06:10:07.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:07.504+0000 7fa465cf5640 1 Processor -- start 2024-09-19T06:10:07.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:07.504+0000 7fa465cf5640 1 -- start start 2024-09-19T06:10:07.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:07.504+0000 7fa465cf5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa460101c00 0x7fa460075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:07.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:07.504+0000 7fa465cf5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa460102e00 0x7fa4600745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:07.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:07.504+0000 7fa465cf5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4601037c0 0x7fa460074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:07.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:07.505+0000 7fa465cf5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa46010d760 con 0x7fa4601037c0 2024-09-19T06:10:07.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:07.505+0000 7fa465cf5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa46010d5e0 con 0x7fa460101c00 2024-09-19T06:10:07.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:07.505+0000 7fa465cf5640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa46010d8e0 con 0x7fa460102e00 2024-09-19T06:10:07.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:07.505+0000 7fa45f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa460101c00 0x7fa460075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:07.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:07.505+0000 7fa45f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa460101c00 0x7fa460075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54674/0 (socket says 172.21.15.89:54674) 2024-09-19T06:10:07.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:07.505+0000 7fa45f7fe640 1 -- 172.21.15.89:0/1624850154 learned_addr learned my addr 172.21.15.89:0/1624850154 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-19T06:10:07.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:07.505+0000 7fa45ffff640 1 --2- 172.21.15.89:0/1624850154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4601037c0 0x7fa460074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:07.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:07.505+0000 7fa45f7fe640 1 -- 172.21.15.89:0/1624850154 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa460102e00 msgr2=0x7fa4600745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:07.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:07.505+0000 7fa45effd640 1 --2- 172.21.15.89:0/1624850154 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa460102e00 0x7fa4600745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:07.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:07.505+0000 7fa45f7fe640 1 --2- 172.21.15.89:0/1624850154 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa460102e00 0x7fa4600745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:07.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:07.505+0000 7fa45f7fe640 1 -- 172.21.15.89:0/1624850154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4601037c0 msgr2=0x7fa460074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:07.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:07.505+0000 7fa45f7fe640 1 --2- 172.21.15.89:0/1624850154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4601037c0 0x7fa460074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:07.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:07.505+0000 7fa45f7fe640 1 -- 172.21.15.89:0/1624850154 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4600753e0 con 0x7fa460101c00 2024-09-19T06:10:07.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:07.505+0000 7fa45ffff640 1 --2- 172.21.15.89:0/1624850154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4601037c0 0x7fa460074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:10:07.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:07.505+0000 7fa45f7fe640 1 --2- 172.21.15.89:0/1624850154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa460101c00 0x7fa460075f90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa45002aeb0 tx=0x7fa450003c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:07.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:07.505+0000 7fa45cff9640 1 -- 172.21.15.89:0/1624850154 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa450004240 con 0x7fa460101c00 2024-09-19T06:10:07.512 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:07.505+0000 7fa45cff9640 1 -- 172.21.15.89:0/1624850154 <== mon.2 v2:172.21.15.89:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa450032ec0 con 0x7fa460101c00 2024-09-19T06:10:07.512 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:07.505+0000 7fa465cf5640 1 -- 172.21.15.89:0/1624850154 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4601a1f10 con 0x7fa460101c00 2024-09-19T06:10:07.512 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:07.505+0000 7fa45cff9640 1 -- 172.21.15.89:0/1624850154 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa450030db0 con 0x7fa460101c00 2024-09-19T06:10:07.512 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:07.505+0000 7fa465cf5640 1 -- 172.21.15.89:0/1624850154 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4601a2300 con 0x7fa460101c00 2024-09-19T06:10:07.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:07.506+0000 7fa465cf5640 1 -- 172.21.15.89:0/1624850154 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4601090a0 con 0x7fa460101c00 2024-09-19T06:10:07.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:07.508+0000 7fa45cff9640 1 -- 172.21.15.89:0/1624850154 <== mon.2 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fa4500305c0 con 0x7fa460101c00 2024-09-19T06:10:07.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:07.508+0000 7fa45cff9640 1 --2- 172.21.15.89:0/1624850154 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fa4480a3240 0x7fa4480a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:07.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:07.509+0000 7fa45effd640 1 --2- 172.21.15.89:0/1624850154 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fa4480a3240 0x7fa4480a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:07.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:07.509+0000 7fa45effd640 1 --2- 172.21.15.89:0/1624850154 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fa4480a3240 0x7fa4480a5700 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa454005fd0 tx=0x7fa454005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:07.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:07.509+0000 7fa45cff9640 1 -- 172.21.15.89:0/1624850154 <== mon.2 v2:172.21.15.89:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4685+0+0 (secure 0 0 0) 0x7fa450044e20 con 0x7fa460101c00 2024-09-19T06:10:07.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:07.514+0000 7fa45cff9640 1 -- 172.21.15.89:0/1624850154 <== mon.2 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa4500bdc00 con 0x7fa460101c00 2024-09-19T06:10:07.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:07.690+0000 7fa465cf5640 1 -- 172.21.15.89:0/1624850154 --> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fa460062630 con 0x7fa4480a3240 2024-09-19T06:10:07.694 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:07 smithi089 ceph-mon[34160]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:10:07.694 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:07 smithi089 ceph-mon[34160]: from='osd.6 [v2:172.21.15.2:6818/3886336279,v1:172.21.15.2:6819/3886336279]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T06:10:07.694 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:07 smithi089 ceph-mon[34160]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T06:10:07.694 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:07 smithi089 ceph-mon[34160]: from='osd.6 [v2:172.21.15.2:6818/3886336279,v1:172.21.15.2:6819/3886336279]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-19T06:10:07.694 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:07 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:10:07.694 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:07 smithi089 ceph-mon[34160]: Detected new or changed devices on smithi002 2024-09-19T06:10:07.694 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:07 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:07.694 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:07 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:07.694 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:07 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:10:07.694 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:07 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:10:07.694 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:07 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:10:07.695 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:07 smithi089 ceph-mon[34160]: Adjusting osd_memory_target on smithi002 to 5697M 2024-09-19T06:10:07.695 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:07 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:07.695 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:07 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:10:07.695 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:07 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:10:07.695 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:07 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:07.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:07 smithi002 ceph-mon[30982]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:10:07.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:07 smithi002 ceph-mon[30982]: from='osd.6 [v2:172.21.15.2:6818/3886336279,v1:172.21.15.2:6819/3886336279]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T06:10:07.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:07 smithi002 ceph-mon[30982]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T06:10:07.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:07 smithi002 ceph-mon[30982]: from='osd.6 [v2:172.21.15.2:6818/3886336279,v1:172.21.15.2:6819/3886336279]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-19T06:10:07.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:07 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:10:07.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:07 smithi002 ceph-mon[30982]: Detected new or changed devices on smithi002 2024-09-19T06:10:07.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:07 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:07.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:07 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:07.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:07 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:10:07.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:07 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:10:07.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:07 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:10:07.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:07 smithi002 ceph-mon[30982]: Adjusting osd_memory_target on smithi002 to 5697M 2024-09-19T06:10:07.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:07 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:07.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:07 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:10:07.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:07 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:10:07.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:07 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:07.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:07 smithi090 ceph-mon[34497]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:10:07.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:07 smithi090 ceph-mon[34497]: from='osd.6 [v2:172.21.15.2:6818/3886336279,v1:172.21.15.2:6819/3886336279]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T06:10:07.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:07 smithi090 ceph-mon[34497]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T06:10:07.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:07 smithi090 ceph-mon[34497]: from='osd.6 [v2:172.21.15.2:6818/3886336279,v1:172.21.15.2:6819/3886336279]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-19T06:10:07.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:07 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:10:07.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:07 smithi090 ceph-mon[34497]: Detected new or changed devices on smithi002 2024-09-19T06:10:07.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:07 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:07.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:07 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:07.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:07 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:10:07.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:07 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:10:07.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:07 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:10:07.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:07 smithi090 ceph-mon[34497]: Adjusting osd_memory_target on smithi002 to 5697M 2024-09-19T06:10:07.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:07 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:07.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:07 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:10:07.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:07 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:10:07.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:07 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:08.472 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:10:08 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:10:08.198+0000 7f8f83af1640 -1 osd.6 0 waiting for initial osdmap 2024-09-19T06:10:08.472 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:10:08 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:10:08.207+0000 7f8f7c123640 -1 osd.6 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:10:08.712 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:08 smithi089 ceph-mon[34160]: from='osd.6 [v2:172.21.15.2:6818/3886336279,v1:172.21.15.2:6819/3886336279]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-19T06:10:08.712 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:08 smithi089 ceph-mon[34160]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T06:10:08.712 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:08 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:10:08.712 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:08 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:10:08.712 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:08 smithi089 ceph-mon[34160]: from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:10:08.712 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:08 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:10:08.712 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:08 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:10:08.712 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:08 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:10:08.712 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:08 smithi089 ceph-mon[34160]: from='osd.6 [v2:172.21.15.2:6818/3886336279,v1:172.21.15.2:6819/3886336279]' entity='osd.6' 2024-09-19T06:10:08.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:08 smithi002 ceph-mon[30982]: from='osd.6 [v2:172.21.15.2:6818/3886336279,v1:172.21.15.2:6819/3886336279]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-19T06:10:08.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:08 smithi002 ceph-mon[30982]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T06:10:08.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:08 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:10:08.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:08 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:10:08.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:08 smithi002 ceph-mon[30982]: from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:10:08.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:08 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:10:08.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:08 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:10:08.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:08 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:10:08.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:08 smithi002 ceph-mon[30982]: from='osd.6 [v2:172.21.15.2:6818/3886336279,v1:172.21.15.2:6819/3886336279]' entity='osd.6' 2024-09-19T06:10:08.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:08 smithi090 ceph-mon[34497]: from='osd.6 [v2:172.21.15.2:6818/3886336279,v1:172.21.15.2:6819/3886336279]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-19T06:10:08.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:08 smithi090 ceph-mon[34497]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T06:10:08.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:08 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:10:08.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:08 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:10:08.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:08 smithi090 ceph-mon[34497]: from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:10:08.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:08 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:10:08.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:08 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:10:08.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:08 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:10:08.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:08 smithi090 ceph-mon[34497]: from='osd.6 [v2:172.21.15.2:6818/3886336279,v1:172.21.15.2:6819/3886336279]' entity='osd.6' 2024-09-19T06:10:09.697 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:09 smithi089 ceph-mon[34160]: purged_snaps scrub starts 2024-09-19T06:10:09.697 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:09 smithi089 ceph-mon[34160]: purged_snaps scrub ok 2024-09-19T06:10:09.697 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:09 smithi089 ceph-mon[34160]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:10:09.697 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:09 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:10:09.697 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:09 smithi089 ceph-mon[34160]: osd.6 [v2:172.21.15.2:6818/3886336279,v1:172.21.15.2:6819/3886336279] boot 2024-09-19T06:10:09.697 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:09 smithi089 ceph-mon[34160]: osdmap e43: 7 total, 7 up, 7 in 2024-09-19T06:10:09.697 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:09 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:10:09.874 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:09 smithi002 ceph-mon[30982]: purged_snaps scrub starts 2024-09-19T06:10:09.874 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:09 smithi002 ceph-mon[30982]: purged_snaps scrub ok 2024-09-19T06:10:09.875 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:09 smithi002 ceph-mon[30982]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:10:09.875 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:09 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:10:09.875 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:09 smithi002 ceph-mon[30982]: osd.6 [v2:172.21.15.2:6818/3886336279,v1:172.21.15.2:6819/3886336279] boot 2024-09-19T06:10:09.875 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:09 smithi002 ceph-mon[30982]: osdmap e43: 7 total, 7 up, 7 in 2024-09-19T06:10:09.875 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:09 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:10:09.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:09 smithi090 ceph-mon[34497]: purged_snaps scrub starts 2024-09-19T06:10:09.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:09 smithi090 ceph-mon[34497]: purged_snaps scrub ok 2024-09-19T06:10:09.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:09 smithi090 ceph-mon[34497]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:10:09.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:09 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:10:09.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:09 smithi090 ceph-mon[34497]: osd.6 [v2:172.21.15.2:6818/3886336279,v1:172.21.15.2:6819/3886336279] boot 2024-09-19T06:10:09.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:09 smithi090 ceph-mon[34497]: osdmap e43: 7 total, 7 up, 7 in 2024-09-19T06:10:09.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:09 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:10:10.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:10 smithi089 ceph-mon[34160]: from='client.? 172.21.15.89:0/2336416801' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1cc5554c-80d2-4e77-b29a-fd2ada68d82d"}]: dispatch 2024-09-19T06:10:10.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:10 smithi089 ceph-mon[34160]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1cc5554c-80d2-4e77-b29a-fd2ada68d82d"}]: dispatch 2024-09-19T06:10:10.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:10 smithi089 ceph-mon[34160]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1cc5554c-80d2-4e77-b29a-fd2ada68d82d"}]': finished 2024-09-19T06:10:10.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:10 smithi089 ceph-mon[34160]: osdmap e44: 8 total, 7 up, 8 in 2024-09-19T06:10:10.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:10 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:10:10.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:10 smithi002 ceph-mon[30982]: from='client.? 172.21.15.89:0/2336416801' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1cc5554c-80d2-4e77-b29a-fd2ada68d82d"}]: dispatch 2024-09-19T06:10:10.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:10 smithi002 ceph-mon[30982]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1cc5554c-80d2-4e77-b29a-fd2ada68d82d"}]: dispatch 2024-09-19T06:10:10.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:10 smithi002 ceph-mon[30982]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1cc5554c-80d2-4e77-b29a-fd2ada68d82d"}]': finished 2024-09-19T06:10:10.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:10 smithi002 ceph-mon[30982]: osdmap e44: 8 total, 7 up, 8 in 2024-09-19T06:10:10.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:10 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:10:10.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:10 smithi090 ceph-mon[34497]: from='client.? 172.21.15.89:0/2336416801' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1cc5554c-80d2-4e77-b29a-fd2ada68d82d"}]: dispatch 2024-09-19T06:10:10.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:10 smithi090 ceph-mon[34497]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1cc5554c-80d2-4e77-b29a-fd2ada68d82d"}]: dispatch 2024-09-19T06:10:10.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:10 smithi090 ceph-mon[34497]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1cc5554c-80d2-4e77-b29a-fd2ada68d82d"}]': finished 2024-09-19T06:10:10.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:10 smithi090 ceph-mon[34497]: osdmap e44: 8 total, 7 up, 8 in 2024-09-19T06:10:10.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:10 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:10:11.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:11 smithi089 ceph-mon[34160]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:10:11.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:11 smithi089 ceph-mon[34160]: from='client.? 172.21.15.89:0/170232900' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:10:11.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:11 smithi002 ceph-mon[30982]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:10:11.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:11 smithi002 ceph-mon[30982]: from='client.? 172.21.15.89:0/170232900' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:10:11.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:11 smithi090 ceph-mon[34497]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:10:11.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:11 smithi090 ceph-mon[34497]: from='client.? 172.21.15.89:0/170232900' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:10:13.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:13 smithi089 ceph-mon[34160]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:10:13.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:13 smithi002 ceph-mon[30982]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:10:13.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:13 smithi090 ceph-mon[34497]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:10:15.745 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:15 smithi089 ceph-mon[34160]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:10:15.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:15 smithi002 ceph-mon[30982]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:10:15.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:15 smithi090 ceph-mon[34497]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:10:17.753 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:17 smithi089 ceph-mon[34160]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:10:17.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:17 smithi002 ceph-mon[30982]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:10:17.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:17 smithi090 ceph-mon[34497]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:10:19.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:19 smithi089 ceph-mon[34160]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:10:19.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:19 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T06:10:19.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:19 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:10:19.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:19 smithi089 ceph-mon[34160]: Deploying daemon osd.7 on smithi089 2024-09-19T06:10:19.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:19 smithi002 ceph-mon[30982]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:10:19.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:19 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T06:10:19.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:19 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:10:19.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:19 smithi002 ceph-mon[30982]: Deploying daemon osd.7 on smithi089 2024-09-19T06:10:19.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:19 smithi090 ceph-mon[34497]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:10:19.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:19 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T06:10:19.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:19 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:10:19.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:19 smithi090 ceph-mon[34497]: Deploying daemon osd.7 on smithi089 2024-09-19T06:10:21.676 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:21 smithi089 ceph-mon[34160]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:10:21.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:21 smithi002 ceph-mon[30982]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:10:21.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:21 smithi090 ceph-mon[34497]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:10:23.792 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:23 smithi090 ceph-mon[34497]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:10:23.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:23 smithi089 ceph-mon[34160]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:10:23.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:23 smithi002 ceph-mon[30982]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:10:25.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:25 smithi089 ceph-mon[34160]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:10:25.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:25 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:10:25.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:25 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:25.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:25 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:25.969 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:25 smithi090 ceph-mon[34497]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:10:25.969 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:25 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:10:25.970 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:25 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:25.970 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:25 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:25.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:25 smithi002 ceph-mon[30982]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:10:25.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:25 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:10:25.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:25 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:25.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:25 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:27.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:27 smithi002 ceph-mon[30982]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:10:27.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:27 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:27.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:27 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:27.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:27 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:10:27.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:27 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:10:27.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:27 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:27.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:27 smithi090 ceph-mon[34497]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:10:27.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:27 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:27.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:27 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:27.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:27 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:10:27.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:27 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:10:27.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:27 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:28.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:27 smithi089 ceph-mon[34160]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:10:28.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:27 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:28.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:27 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:28.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:27 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:10:28.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:27 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:10:28.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:27 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:28.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:28.374+0000 7fa45cff9640 1 -- 172.21.15.89:0/1624850154 <== mgr.14150 v2:172.21.15.2:6800/4180340554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa460062630 con 0x7fa4480a3240 2024-09-19T06:10:28.377 INFO:teuthology.orchestra.run.smithi089.stdout:Created osd(s) 7 on host 'smithi089' 2024-09-19T06:10:28.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:28.377+0000 7fa465cf5640 1 -- 172.21.15.89:0/1624850154 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fa4480a3240 msgr2=0x7fa4480a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:28.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:28.377+0000 7fa465cf5640 1 --2- 172.21.15.89:0/1624850154 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fa4480a3240 0x7fa4480a5700 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa454005fd0 tx=0x7fa454005c70 comp rx=0 tx=0).stop 2024-09-19T06:10:28.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:28.377+0000 7fa465cf5640 1 -- 172.21.15.89:0/1624850154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa460101c00 msgr2=0x7fa460075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:28.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:28.377+0000 7fa465cf5640 1 --2- 172.21.15.89:0/1624850154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa460101c00 0x7fa460075f90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa45002aeb0 tx=0x7fa450003c20 comp rx=0 tx=0).stop 2024-09-19T06:10:28.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:28.377+0000 7fa465cf5640 1 -- 172.21.15.89:0/1624850154 shutdown_connections 2024-09-19T06:10:28.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:28.377+0000 7fa465cf5640 1 --2- 172.21.15.89:0/1624850154 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fa4480a3240 0x7fa4480a5700 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:28.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:28.377+0000 7fa465cf5640 1 --2- 172.21.15.89:0/1624850154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4601037c0 0x7fa460074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:28.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:28.377+0000 7fa465cf5640 1 --2- 172.21.15.89:0/1624850154 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa460102e00 0x7fa4600745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:28.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:28.377+0000 7fa465cf5640 1 --2- 172.21.15.89:0/1624850154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa460101c00 0x7fa460075f90 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:28.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:28.377+0000 7fa465cf5640 1 -- 172.21.15.89:0/1624850154 >> 172.21.15.89:0/1624850154 conn(0x7fa4600fd3b0 msgr2=0x7fa460106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:28.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:28.377+0000 7fa465cf5640 1 -- 172.21.15.89:0/1624850154 shutdown_connections 2024-09-19T06:10:28.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:10:28.377+0000 7fa465cf5640 1 -- 172.21.15.89:0/1624850154 wait complete. 2024-09-19T06:10:28.746 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:28 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:10:28.746 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:28 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:28.746 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:28 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:28.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:28 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:10:28.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:28 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:28.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:28 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:28.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:28 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:10:28.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:28 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:28.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:28 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:29.083 DEBUG:teuthology.orchestra.run.smithi089:osd.7> sudo journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@osd.7.service 2024-09-19T06:10:29.085 INFO:tasks.cephadm:Deploying osd.8 on smithi090 with /dev/vg_nvme/lv_2... 2024-09-19T06:10:29.085 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T06:10:29.339 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:10:29.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:29 smithi090 ceph-mon[34497]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:10:29.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:29 smithi089 ceph-mon[34160]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:10:29.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:29 smithi002 ceph-mon[30982]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:10:31.292 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:10:31 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:10:31.016+0000 7f222205e640 -1 osd.7 0 log_to_monitors true 2024-09-19T06:10:31.790 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-19T06:10:31.813 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:31 smithi090 ceph-mon[34497]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:10:31.814 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:31 smithi090 ceph-mon[34497]: from='osd.7 [v2:172.21.15.89:6816/508513510,v1:172.21.15.89:6817/508513510]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T06:10:31.814 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:31 smithi090 ceph-mon[34497]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T06:10:31.816 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi090:vg_nvme/lv_2 2024-09-19T06:10:31.852 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:31 smithi089 ceph-mon[34160]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:10:31.852 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:31 smithi089 ceph-mon[34160]: from='osd.7 [v2:172.21.15.89:6816/508513510,v1:172.21.15.89:6817/508513510]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T06:10:31.852 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:31 smithi089 ceph-mon[34160]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T06:10:31.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:31 smithi002 ceph-mon[30982]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:10:31.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:31 smithi002 ceph-mon[30982]: from='osd.7 [v2:172.21.15.89:6816/508513510,v1:172.21.15.89:6817/508513510]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T06:10:31.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:31 smithi002 ceph-mon[30982]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T06:10:32.063 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:10:32.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:32.531+0000 7f9a3b409640 1 -- 172.21.15.90:0/2425665180 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a34102e00 msgr2=0x7f9a34103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:32.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:32.531+0000 7f9a3b409640 1 --2- 172.21.15.90:0/2425665180 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a34102e00 0x7f9a34103280 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9a24009900 tx=0x7f9a2402a410 comp rx=0 tx=0).stop 2024-09-19T06:10:32.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:32.531+0000 7f9a3b409640 1 -- 172.21.15.90:0/2425665180 shutdown_connections 2024-09-19T06:10:32.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:32.531+0000 7f9a3b409640 1 --2- 172.21.15.90:0/2425665180 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a341037c0 0x7f9a3410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:32.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:32.531+0000 7f9a3b409640 1 --2- 172.21.15.90:0/2425665180 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a34102e00 0x7f9a34103280 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:32.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:32.531+0000 7f9a3b409640 1 --2- 172.21.15.90:0/2425665180 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a34101c00 0x7f9a34102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:32.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:32.531+0000 7f9a3b409640 1 -- 172.21.15.90:0/2425665180 >> 172.21.15.90:0/2425665180 conn(0x7f9a340fd390 msgr2=0x7f9a340ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:32.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:32.531+0000 7f9a3b409640 1 -- 172.21.15.90:0/2425665180 shutdown_connections 2024-09-19T06:10:32.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:32.531+0000 7f9a3b409640 1 -- 172.21.15.90:0/2425665180 wait complete. 2024-09-19T06:10:32.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:32.532+0000 7f9a3b409640 1 Processor -- start 2024-09-19T06:10:32.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:32.532+0000 7f9a3b409640 1 -- start start 2024-09-19T06:10:32.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:32.532+0000 7f9a3b409640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a34101c00 0x7f9a34197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:32.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:32.532+0000 7f9a3b409640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a34102e00 0x7f9a341984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:32.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:32.532+0000 7f9a3b409640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a341037c0 0x7f9a3419f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:32.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:32.532+0000 7f9a3b409640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9a3410d830 con 0x7f9a34102e00 2024-09-19T06:10:32.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:32.532+0000 7f9a3b409640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9a3410d6b0 con 0x7f9a34101c00 2024-09-19T06:10:32.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:32.532+0000 7f9a3b409640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9a3410d9b0 con 0x7f9a341037c0 2024-09-19T06:10:32.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:32.532+0000 7f9a399a6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a341037c0 0x7f9a3419f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:32.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:32.532+0000 7f9a399a6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a341037c0 0x7f9a3419f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58408/0 (socket says 172.21.15.90:58408) 2024-09-19T06:10:32.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:32.532+0000 7f9a399a6640 1 -- 172.21.15.90:0/773013857 learned_addr learned my addr 172.21.15.90:0/773013857 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-19T06:10:32.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:32.532+0000 7f9a389a4640 1 --2- 172.21.15.90:0/773013857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a34102e00 0x7f9a341984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:32.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:32.532+0000 7f9a391a5640 1 --2- 172.21.15.90:0/773013857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a34101c00 0x7f9a34197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:32.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:32.532+0000 7f9a399a6640 1 -- 172.21.15.90:0/773013857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a34101c00 msgr2=0x7f9a34197fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:32.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:32.532+0000 7f9a399a6640 1 --2- 172.21.15.90:0/773013857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a34101c00 0x7f9a34197fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:32.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:32.532+0000 7f9a399a6640 1 -- 172.21.15.90:0/773013857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a34102e00 msgr2=0x7f9a341984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:32.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:32.532+0000 7f9a399a6640 1 --2- 172.21.15.90:0/773013857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a34102e00 0x7f9a341984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:32.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:32.532+0000 7f9a399a6640 1 -- 172.21.15.90:0/773013857 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a3419fbd0 con 0x7f9a341037c0 2024-09-19T06:10:32.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:32.532+0000 7f9a399a6640 1 --2- 172.21.15.90:0/773013857 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a341037c0 0x7f9a3419f560 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c00b970 tx=0x7f9a2c00be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:32.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:32.532+0000 7f9a2a7fc640 1 -- 172.21.15.90:0/773013857 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c019070 con 0x7f9a341037c0 2024-09-19T06:10:32.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:32.532+0000 7f9a2a7fc640 1 -- 172.21.15.90:0/773013857 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9a2c014440 con 0x7f9a341037c0 2024-09-19T06:10:32.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:32.532+0000 7f9a3b409640 1 -- 172.21.15.90:0/773013857 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a3419fec0 con 0x7f9a341037c0 2024-09-19T06:10:32.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:32.533+0000 7f9a2a7fc640 1 -- 172.21.15.90:0/773013857 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c0075d0 con 0x7f9a341037c0 2024-09-19T06:10:32.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:32.533+0000 7f9a3b409640 1 -- 172.21.15.90:0/773013857 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a341a03a0 con 0x7f9a341037c0 2024-09-19T06:10:32.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:32.534+0000 7f9a3b409640 1 -- 172.21.15.90:0/773013857 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a34109090 con 0x7f9a341037c0 2024-09-19T06:10:32.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:32.535+0000 7f9a2a7fc640 1 -- 172.21.15.90:0/773013857 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f9a2c01c070 con 0x7f9a341037c0 2024-09-19T06:10:32.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:32.536+0000 7f9a2a7fc640 1 --2- 172.21.15.90:0/773013857 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f9a200a3270 0x7f9a200a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:32.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:32.536+0000 7f9a2a7fc640 1 -- 172.21.15.90:0/773013857 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5101+0+0 (secure 0 0 0) 0x7f9a2c0ce6d0 con 0x7f9a341037c0 2024-09-19T06:10:32.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:32.536+0000 7f9a391a5640 1 --2- 172.21.15.90:0/773013857 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f9a200a3270 0x7f9a200a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:32.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:32.537+0000 7f9a391a5640 1 --2- 172.21.15.90:0/773013857 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f9a200a3270 0x7f9a200a5730 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9a34102c60 tx=0x7f9a30008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:32.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:32.539+0000 7f9a2a7fc640 1 -- 172.21.15.90:0/773013857 <== mon.1 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9a2c09c080 con 0x7f9a341037c0 2024-09-19T06:10:32.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:32.719+0000 7f9a3b409640 1 -- 172.21.15.90:0/773013857 --> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f9a34062630 con 0x7f9a200a3270 2024-09-19T06:10:32.722 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:32 smithi090 ceph-mon[34497]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T06:10:32.722 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:32 smithi090 ceph-mon[34497]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T06:10:32.722 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:32 smithi090 ceph-mon[34497]: from='osd.7 [v2:172.21.15.89:6816/508513510,v1:172.21.15.89:6817/508513510]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-19T06:10:32.722 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:32 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:10:32.722 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:32 smithi090 ceph-mon[34497]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-19T06:10:32.722 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:32 smithi090 ceph-mon[34497]: Detected new or changed devices on smithi089 2024-09-19T06:10:32.722 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:32 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:32.722 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:32 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:32.722 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:32 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:10:32.723 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:32 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:10:32.723 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:32 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:10:32.723 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:32 smithi090 ceph-mon[34497]: Adjusting osd_memory_target on smithi089 to 5695M 2024-09-19T06:10:32.723 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:32 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:32.723 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:32 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:10:32.723 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:32 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:10:32.723 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:32 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:32.723 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:32 smithi090 ceph-mon[34497]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-19T06:10:32.723 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:32 smithi090 ceph-mon[34497]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T06:10:32.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:32 smithi002 ceph-mon[30982]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T06:10:32.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:32 smithi002 ceph-mon[30982]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T06:10:32.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:32 smithi002 ceph-mon[30982]: from='osd.7 [v2:172.21.15.89:6816/508513510,v1:172.21.15.89:6817/508513510]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-19T06:10:32.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:32 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:10:32.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:32 smithi002 ceph-mon[30982]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-19T06:10:32.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:32 smithi002 ceph-mon[30982]: Detected new or changed devices on smithi089 2024-09-19T06:10:32.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:32 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:32.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:32 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:32.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:32 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:10:32.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:32 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:10:32.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:32 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:10:32.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:32 smithi002 ceph-mon[30982]: Adjusting osd_memory_target on smithi089 to 5695M 2024-09-19T06:10:32.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:32 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:32.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:32 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:10:32.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:32 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:10:32.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:32 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:32.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:32 smithi002 ceph-mon[30982]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-19T06:10:32.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:32 smithi002 ceph-mon[30982]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T06:10:33.042 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:10:32 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:10:32.562+0000 7f221d7be640 -1 osd.7 0 waiting for initial osdmap 2024-09-19T06:10:33.042 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:10:32 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:10:32.573+0000 7f2219df8640 -1 osd.7 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:10:33.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:32 smithi089 ceph-mon[34160]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T06:10:33.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:32 smithi089 ceph-mon[34160]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T06:10:33.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:32 smithi089 ceph-mon[34160]: from='osd.7 [v2:172.21.15.89:6816/508513510,v1:172.21.15.89:6817/508513510]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-19T06:10:33.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:32 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:10:33.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:32 smithi089 ceph-mon[34160]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-19T06:10:33.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:32 smithi089 ceph-mon[34160]: Detected new or changed devices on smithi089 2024-09-19T06:10:33.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:32 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:33.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:32 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:33.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:32 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:10:33.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:32 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:10:33.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:32 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:10:33.044 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:32 smithi089 ceph-mon[34160]: Adjusting osd_memory_target on smithi089 to 5695M 2024-09-19T06:10:33.044 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:32 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:33.044 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:32 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:10:33.044 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:32 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:10:33.044 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:32 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:33.044 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:32 smithi089 ceph-mon[34160]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-19T06:10:33.044 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:32 smithi089 ceph-mon[34160]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T06:10:33.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:33 smithi090 ceph-mon[34497]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:10:33.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:33 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:10:33.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:33 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:10:33.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:33 smithi090 ceph-mon[34497]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:10:33.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:33 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:10:33.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:33 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:10:33.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:33 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:10:33.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:33 smithi090 ceph-mon[34497]: osd.7 [v2:172.21.15.89:6816/508513510,v1:172.21.15.89:6817/508513510] boot 2024-09-19T06:10:33.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:33 smithi090 ceph-mon[34497]: osdmap e47: 8 total, 8 up, 8 in 2024-09-19T06:10:33.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:33 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:10:33.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:33 smithi002 ceph-mon[30982]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:10:33.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:33 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:10:33.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:33 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:10:33.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:33 smithi002 ceph-mon[30982]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:10:33.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:33 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:10:33.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:33 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:10:33.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:33 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:10:33.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:33 smithi002 ceph-mon[30982]: osd.7 [v2:172.21.15.89:6816/508513510,v1:172.21.15.89:6817/508513510] boot 2024-09-19T06:10:33.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:33 smithi002 ceph-mon[30982]: osdmap e47: 8 total, 8 up, 8 in 2024-09-19T06:10:33.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:33 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:10:33.975 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:33 smithi089 ceph-mon[34160]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:10:33.975 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:33 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:10:33.975 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:33 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:10:33.975 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:33 smithi089 ceph-mon[34160]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:10:33.976 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:33 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:10:33.976 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:33 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:10:33.976 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:33 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:10:33.976 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:33 smithi089 ceph-mon[34160]: osd.7 [v2:172.21.15.89:6816/508513510,v1:172.21.15.89:6817/508513510] boot 2024-09-19T06:10:33.976 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:33 smithi089 ceph-mon[34160]: osdmap e47: 8 total, 8 up, 8 in 2024-09-19T06:10:33.976 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:33 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:10:35.273 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:35 smithi090 ceph-mon[34497]: purged_snaps scrub starts 2024-09-19T06:10:35.274 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:35 smithi090 ceph-mon[34497]: purged_snaps scrub ok 2024-09-19T06:10:35.274 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:35 smithi090 ceph-mon[34497]: pgmap v168: 1 pgs: 1 remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:10:35.274 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:35 smithi090 ceph-mon[34497]: osdmap e48: 8 total, 8 up, 8 in 2024-09-19T06:10:35.274 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:35 smithi090 ceph-mon[34497]: from='client.? 172.21.15.90:0/1981934160' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e9b2eb92-9af2-4f26-a259-fcaf972e4fd0"}]: dispatch 2024-09-19T06:10:35.274 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:35 smithi090 ceph-mon[34497]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e9b2eb92-9af2-4f26-a259-fcaf972e4fd0"}]: dispatch 2024-09-19T06:10:35.274 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:35 smithi090 ceph-mon[34497]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e9b2eb92-9af2-4f26-a259-fcaf972e4fd0"}]': finished 2024-09-19T06:10:35.274 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:35 smithi090 ceph-mon[34497]: osdmap e49: 9 total, 8 up, 9 in 2024-09-19T06:10:35.274 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:35 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:10:35.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:35 smithi089 ceph-mon[34160]: purged_snaps scrub starts 2024-09-19T06:10:35.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:35 smithi089 ceph-mon[34160]: purged_snaps scrub ok 2024-09-19T06:10:35.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:35 smithi089 ceph-mon[34160]: pgmap v168: 1 pgs: 1 remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:10:35.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:35 smithi089 ceph-mon[34160]: osdmap e48: 8 total, 8 up, 8 in 2024-09-19T06:10:35.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:35 smithi089 ceph-mon[34160]: from='client.? 172.21.15.90:0/1981934160' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e9b2eb92-9af2-4f26-a259-fcaf972e4fd0"}]: dispatch 2024-09-19T06:10:35.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:35 smithi089 ceph-mon[34160]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e9b2eb92-9af2-4f26-a259-fcaf972e4fd0"}]: dispatch 2024-09-19T06:10:35.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:35 smithi089 ceph-mon[34160]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e9b2eb92-9af2-4f26-a259-fcaf972e4fd0"}]': finished 2024-09-19T06:10:35.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:35 smithi089 ceph-mon[34160]: osdmap e49: 9 total, 8 up, 9 in 2024-09-19T06:10:35.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:35 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:10:35.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:35 smithi002 ceph-mon[30982]: purged_snaps scrub starts 2024-09-19T06:10:35.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:35 smithi002 ceph-mon[30982]: purged_snaps scrub ok 2024-09-19T06:10:35.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:35 smithi002 ceph-mon[30982]: pgmap v168: 1 pgs: 1 remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:10:35.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:35 smithi002 ceph-mon[30982]: osdmap e48: 8 total, 8 up, 8 in 2024-09-19T06:10:35.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:35 smithi002 ceph-mon[30982]: from='client.? 172.21.15.90:0/1981934160' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e9b2eb92-9af2-4f26-a259-fcaf972e4fd0"}]: dispatch 2024-09-19T06:10:35.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:35 smithi002 ceph-mon[30982]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e9b2eb92-9af2-4f26-a259-fcaf972e4fd0"}]: dispatch 2024-09-19T06:10:35.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:35 smithi002 ceph-mon[30982]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e9b2eb92-9af2-4f26-a259-fcaf972e4fd0"}]': finished 2024-09-19T06:10:35.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:35 smithi002 ceph-mon[30982]: osdmap e49: 9 total, 8 up, 9 in 2024-09-19T06:10:35.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:35 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:10:36.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:36 smithi002 ceph-mon[30982]: from='client.? 172.21.15.90:0/3107228765' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:10:36.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:36 smithi002 ceph-mon[30982]: osdmap e50: 9 total, 8 up, 9 in 2024-09-19T06:10:36.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:36 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:10:36.489 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:36 smithi090 ceph-mon[34497]: from='client.? 172.21.15.90:0/3107228765' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:10:36.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:36 smithi090 ceph-mon[34497]: osdmap e50: 9 total, 8 up, 9 in 2024-09-19T06:10:36.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:36 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:10:36.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:36 smithi089 ceph-mon[34160]: from='client.? 172.21.15.90:0/3107228765' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:10:36.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:36 smithi089 ceph-mon[34160]: osdmap e50: 9 total, 8 up, 9 in 2024-09-19T06:10:36.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:36 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:10:37.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:37 smithi002 ceph-mon[30982]: pgmap v171: 1 pgs: 1 remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:10:37.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:37 smithi002 ceph-mon[30982]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T06:10:37.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:37 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:10:37.489 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:37 smithi090 ceph-mon[34497]: pgmap v171: 1 pgs: 1 remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:10:37.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:37 smithi090 ceph-mon[34497]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T06:10:37.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:37 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:10:37.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:37 smithi089 ceph-mon[34160]: pgmap v171: 1 pgs: 1 remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:10:37.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:37 smithi089 ceph-mon[34160]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T06:10:37.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:37 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:10:39.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:39 smithi002 ceph-mon[30982]: pgmap v174: 1 pgs: 1 remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:10:39.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:39 smithi090 ceph-mon[34497]: pgmap v174: 1 pgs: 1 remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:10:39.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:39 smithi089 ceph-mon[34160]: pgmap v174: 1 pgs: 1 remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:10:41.382 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:41 smithi090 ceph-mon[34497]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:10:41.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:41 smithi002 ceph-mon[30982]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:10:41.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:41 smithi089 ceph-mon[34160]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:10:43.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:43 smithi090 ceph-mon[34497]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:10:43.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:43 smithi002 ceph-mon[30982]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:10:43.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:43 smithi089 ceph-mon[34160]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:10:44.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:44 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T06:10:44.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:44 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:10:44.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:44 smithi002 ceph-mon[30982]: Deploying daemon osd.8 on smithi090 2024-09-19T06:10:44.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:44 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T06:10:44.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:44 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:10:44.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:44 smithi090 ceph-mon[34497]: Deploying daemon osd.8 on smithi090 2024-09-19T06:10:44.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:44 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T06:10:44.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:44 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:10:44.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:44 smithi089 ceph-mon[34160]: Deploying daemon osd.8 on smithi090 2024-09-19T06:10:45.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:45 smithi090 ceph-mon[34497]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:10:45.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:45 smithi002 ceph-mon[30982]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:10:45.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:45 smithi089 ceph-mon[34160]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:10:47.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:47 smithi002 ceph-mon[30982]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:10:47.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:47 smithi090 ceph-mon[34497]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:10:47.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:47 smithi089 ceph-mon[34160]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:10:49.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:49 smithi090 ceph-mon[34497]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:10:49.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:49 smithi002 ceph-mon[30982]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:10:49.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:49 smithi089 ceph-mon[34160]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:10:50.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:50 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:10:50.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:50 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:50.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:50 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:50.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:50 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:10:50.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:50 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:50.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:50 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:50.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:50 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:10:50.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:50 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:50.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:50 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:51.449 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:51 smithi090 ceph-mon[34497]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:10:51.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:51 smithi002 ceph-mon[30982]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:10:51.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:51 smithi089 ceph-mon[34160]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:10:52.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:52.752+0000 7f9a2a7fc640 1 -- 172.21.15.90:0/773013857 <== mgr.14150 v2:172.21.15.2:6800/4180340554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9a34062630 con 0x7f9a200a3270 2024-09-19T06:10:52.755 INFO:teuthology.orchestra.run.smithi090.stdout:Created osd(s) 8 on host 'smithi090' 2024-09-19T06:10:52.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:52.754+0000 7f9a3b409640 1 -- 172.21.15.90:0/773013857 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f9a200a3270 msgr2=0x7f9a200a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:52.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:52.754+0000 7f9a3b409640 1 --2- 172.21.15.90:0/773013857 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f9a200a3270 0x7f9a200a5730 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9a34102c60 tx=0x7f9a30008040 comp rx=0 tx=0).stop 2024-09-19T06:10:52.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:52.755+0000 7f9a3b409640 1 -- 172.21.15.90:0/773013857 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a341037c0 msgr2=0x7f9a3419f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:52.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:52.755+0000 7f9a3b409640 1 --2- 172.21.15.90:0/773013857 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a341037c0 0x7f9a3419f560 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c00b970 tx=0x7f9a2c00be30 comp rx=0 tx=0).stop 2024-09-19T06:10:52.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:52.755+0000 7f9a3b409640 1 -- 172.21.15.90:0/773013857 shutdown_connections 2024-09-19T06:10:52.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:52.755+0000 7f9a3b409640 1 --2- 172.21.15.90:0/773013857 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f9a200a3270 0x7f9a200a5730 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:52.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:52.755+0000 7f9a3b409640 1 --2- 172.21.15.90:0/773013857 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a341037c0 0x7f9a3419f560 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:52.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:52.755+0000 7f9a3b409640 1 --2- 172.21.15.90:0/773013857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a34102e00 0x7f9a341984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:52.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:52.755+0000 7f9a3b409640 1 --2- 172.21.15.90:0/773013857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a34101c00 0x7f9a34197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:52.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:52.755+0000 7f9a3b409640 1 -- 172.21.15.90:0/773013857 >> 172.21.15.90:0/773013857 conn(0x7f9a340fd390 msgr2=0x7f9a34106260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:52.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:52.755+0000 7f9a3b409640 1 -- 172.21.15.90:0/773013857 shutdown_connections 2024-09-19T06:10:52.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:10:52.755+0000 7f9a3b409640 1 -- 172.21.15.90:0/773013857 wait complete. 2024-09-19T06:10:52.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:52 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:52.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:52 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:52.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:52 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:10:52.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:52 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:10:52.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:52 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:52.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:52 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:10:52.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:52 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:52.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:52 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:53.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:52 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:53.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:52 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:53.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:52 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:10:53.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:52 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:10:53.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:52 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:53.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:52 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:10:53.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:52 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:53.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:52 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:53.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:52 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:53.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:52 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:53.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:52 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:10:53.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:52 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:10:53.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:52 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:53.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:52 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:10:53.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:52 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:53.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:52 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:53.387 DEBUG:teuthology.orchestra.run.smithi090:osd.8> sudo journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@osd.8.service 2024-09-19T06:10:53.390 INFO:tasks.cephadm:Deploying osd.9 on smithi002 with /dev/vg_nvme/lv_1... 2024-09-19T06:10:53.390 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T06:10:53.657 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:53.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:53 smithi090 ceph-mon[34497]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:10:54.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:53 smithi089 ceph-mon[34160]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:10:54.072 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:53 smithi002 ceph-mon[30982]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:10:55.806 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:10:55 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:10:55.511+0000 7fab89f8f640 -1 osd.8 0 log_to_monitors true 2024-09-19T06:10:56.000 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:55 smithi002 ceph-mon[30982]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:10:56.000 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:55 smithi002 ceph-mon[30982]: from='osd.8 [v2:172.21.15.90:6816/3558544480,v1:172.21.15.90:6817/3558544480]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T06:10:56.189 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:55 smithi090 ceph-mon[34497]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:10:56.189 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:55 smithi090 ceph-mon[34497]: from='osd.8 [v2:172.21.15.90:6816/3558544480,v1:172.21.15.90:6817/3558544480]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T06:10:56.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:55 smithi089 ceph-mon[34160]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:10:56.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:55 smithi089 ceph-mon[34160]: from='osd.8 [v2:172.21.15.90:6816/3558544480,v1:172.21.15.90:6817/3558544480]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T06:10:56.394 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:10:56.422 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi002:vg_nvme/lv_1 2024-09-19T06:10:56.684 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:57.064 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:56 smithi002 ceph-mon[30982]: from='osd.8 [v2:172.21.15.90:6816/3558544480,v1:172.21.15.90:6817/3558544480]' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T06:10:57.065 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:56 smithi002 ceph-mon[30982]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T06:10:57.065 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:56 smithi002 ceph-mon[30982]: from='osd.8 [v2:172.21.15.90:6816/3558544480,v1:172.21.15.90:6817/3558544480]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-09-19T06:10:57.065 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:56 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:10:57.065 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:56 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:57.065 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:56 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:57.065 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:56 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:10:57.065 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:56 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:10:57.065 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:56 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:10:57.065 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:56 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:57.065 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:56 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:10:57.065 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:56 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:10:57.065 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:56 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:57.065 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:56 smithi002 ceph-mon[30982]: from='osd.8 [v2:172.21.15.90:6816/3558544480,v1:172.21.15.90:6817/3558544480]' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]': finished 2024-09-19T06:10:57.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:57.164+0000 7fa49a75e640 1 -- 172.21.15.2:0/1677201727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa494107900 msgr2=0x7fa494109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:57.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:57.164+0000 7fa49a75e640 1 --2- 172.21.15.2:0/1677201727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa494107900 0x7fa494109d50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa48c009ca0 tx=0x7fa48c02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:10:57.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:57.164+0000 7fa49a75e640 1 -- 172.21.15.2:0/1677201727 shutdown_connections 2024-09-19T06:10:57.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:57.164+0000 7fa49a75e640 1 --2- 172.21.15.2:0/1677201727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa494107900 0x7fa494109d50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:57.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:57.164+0000 7fa49a75e640 1 --2- 172.21.15.2:0/1677201727 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa494104fd0 0x7fa4941073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:57.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:57.164+0000 7fa49a75e640 1 --2- 172.21.15.2:0/1677201727 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4941026a0 0x7fa494104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:57.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:57.164+0000 7fa49a75e640 1 -- 172.21.15.2:0/1677201727 >> 172.21.15.2:0/1677201727 conn(0x7fa4940fc2a0 msgr2=0x7fa4940fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:57.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:57.164+0000 7fa49a75e640 1 -- 172.21.15.2:0/1677201727 shutdown_connections 2024-09-19T06:10:57.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:57.164+0000 7fa49a75e640 1 -- 172.21.15.2:0/1677201727 wait complete. 2024-09-19T06:10:57.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:57.165+0000 7fa49a75e640 1 Processor -- start 2024-09-19T06:10:57.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:57.165+0000 7fa49a75e640 1 -- start start 2024-09-19T06:10:57.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:57.165+0000 7fa49a75e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4941026a0 0x7fa494197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:57.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:57.165+0000 7fa49a75e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa494104fd0 0x7fa4941983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:57.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:57.165+0000 7fa49a75e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa494107900 0x7fa49419f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:57.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:57.165+0000 7fa49a75e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa49410d7f0 con 0x7fa4941026a0 2024-09-19T06:10:57.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:57.165+0000 7fa49a75e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa49410d670 con 0x7fa494104fd0 2024-09-19T06:10:57.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:57.165+0000 7fa49a75e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa49410d970 con 0x7fa494107900 2024-09-19T06:10:57.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:57.165+0000 7fa493fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4941026a0 0x7fa494197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:57.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:57.165+0000 7fa493fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4941026a0 0x7fa494197eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32842/0 (socket says 172.21.15.2:32842) 2024-09-19T06:10:57.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:57.165+0000 7fa493fff640 1 -- 172.21.15.2:0/3459971445 learned_addr learned my addr 172.21.15.2:0/3459971445 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:10:57.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:57.165+0000 7fa498cfb640 1 --2- 172.21.15.2:0/3459971445 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa494107900 0x7fa49419f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:57.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:57.166+0000 7fa4937fe640 1 --2- 172.21.15.2:0/3459971445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa494104fd0 0x7fa4941983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:57.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:57.166+0000 7fa493fff640 1 -- 172.21.15.2:0/3459971445 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa494107900 msgr2=0x7fa49419f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:57.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:57.166+0000 7fa493fff640 1 --2- 172.21.15.2:0/3459971445 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa494107900 0x7fa49419f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:57.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:57.166+0000 7fa493fff640 1 -- 172.21.15.2:0/3459971445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa494104fd0 msgr2=0x7fa4941983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:57.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:57.166+0000 7fa493fff640 1 --2- 172.21.15.2:0/3459971445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa494104fd0 0x7fa4941983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:57.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:57.166+0000 7fa493fff640 1 -- 172.21.15.2:0/3459971445 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa49419fae0 con 0x7fa4941026a0 2024-09-19T06:10:57.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:57.166+0000 7fa493fff640 1 --2- 172.21.15.2:0/3459971445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4941026a0 0x7fa494197eb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa48400b4a0 tx=0x7fa48400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:57.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:57.166+0000 7fa4917fa640 1 -- 172.21.15.2:0/3459971445 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa484014070 con 0x7fa4941026a0 2024-09-19T06:10:57.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:57.166+0000 7fa4917fa640 1 -- 172.21.15.2:0/3459971445 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa484010ac0 con 0x7fa4941026a0 2024-09-19T06:10:57.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:57.166+0000 7fa49a75e640 1 -- 172.21.15.2:0/3459971445 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa49419fdd0 con 0x7fa4941026a0 2024-09-19T06:10:57.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:57.166+0000 7fa4917fa640 1 -- 172.21.15.2:0/3459971445 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa484017c30 con 0x7fa4941026a0 2024-09-19T06:10:57.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:57.166+0000 7fa49a75e640 1 -- 172.21.15.2:0/3459971445 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4941a0280 con 0x7fa4941026a0 2024-09-19T06:10:57.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:57.167+0000 7fa49a75e640 1 -- 172.21.15.2:0/3459971445 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4940fdd90 con 0x7fa4941026a0 2024-09-19T06:10:57.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:57.169+0000 7fa4917fa640 1 -- 172.21.15.2:0/3459971445 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fa484017070 con 0x7fa4941026a0 2024-09-19T06:10:57.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:57.169+0000 7fa4917fa640 1 --2- 172.21.15.2:0/3459971445 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fa47c0a32f0 0x7fa47c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:57.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:57.170+0000 7fa4937fe640 1 --2- 172.21.15.2:0/3459971445 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fa47c0a32f0 0x7fa47c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:57.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:57.170+0000 7fa4917fa640 1 -- 172.21.15.2:0/3459971445 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5549+0+0 (secure 0 0 0) 0x7fa4840ce4f0 con 0x7fa4941026a0 2024-09-19T06:10:57.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:57.170+0000 7fa4937fe640 1 --2- 172.21.15.2:0/3459971445 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fa47c0a32f0 0x7fa47c0a57b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa4941993d0 tx=0x7fa488005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:57.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:57.173+0000 7fa4917fa640 1 -- 172.21.15.2:0/3459971445 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa48409bcc0 con 0x7fa4941026a0 2024-09-19T06:10:57.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:56 smithi090 ceph-mon[34497]: from='osd.8 [v2:172.21.15.90:6816/3558544480,v1:172.21.15.90:6817/3558544480]' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T06:10:57.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:56 smithi090 ceph-mon[34497]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T06:10:57.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:56 smithi090 ceph-mon[34497]: from='osd.8 [v2:172.21.15.90:6816/3558544480,v1:172.21.15.90:6817/3558544480]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-09-19T06:10:57.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:56 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:10:57.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:56 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:57.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:56 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:57.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:56 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:10:57.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:56 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:10:57.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:56 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:10:57.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:56 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:57.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:56 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:10:57.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:56 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:10:57.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:56 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:57.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:56 smithi090 ceph-mon[34497]: from='osd.8 [v2:172.21.15.90:6816/3558544480,v1:172.21.15.90:6817/3558544480]' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]': finished 2024-09-19T06:10:57.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:56 smithi089 ceph-mon[34160]: from='osd.8 [v2:172.21.15.90:6816/3558544480,v1:172.21.15.90:6817/3558544480]' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T06:10:57.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:56 smithi089 ceph-mon[34160]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T06:10:57.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:56 smithi089 ceph-mon[34160]: from='osd.8 [v2:172.21.15.90:6816/3558544480,v1:172.21.15.90:6817/3558544480]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-09-19T06:10:57.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:56 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:10:57.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:56 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:57.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:56 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:57.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:56 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:10:57.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:56 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:10:57.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:56 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:10:57.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:56 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:57.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:56 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:10:57.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:56 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:10:57.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:56 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:10:57.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:56 smithi089 ceph-mon[34160]: from='osd.8 [v2:172.21.15.90:6816/3558544480,v1:172.21.15.90:6817/3558544480]' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]': finished 2024-09-19T06:10:57.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:10:57.357+0000 7fa49a75e640 1 -- 172.21.15.2:0/3459971445 --> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fa494062630 con 0x7fa47c0a32f0 2024-09-19T06:10:57.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:10:57 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:10:57.626+0000 7fab856ef640 -1 osd.8 0 waiting for initial osdmap 2024-09-19T06:10:57.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:10:57 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:10:57.645+0000 7fab7dd21640 -1 osd.8 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:10:57.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:57 smithi090 ceph-mon[34497]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:10:57.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:57 smithi090 ceph-mon[34497]: Detected new or changed devices on smithi090 2024-09-19T06:10:57.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:57 smithi090 ceph-mon[34497]: Adjusting osd_memory_target on smithi090 to 5696M 2024-09-19T06:10:57.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:57 smithi090 ceph-mon[34497]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T06:10:57.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:57 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:10:57.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:57 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:10:57.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:57 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:10:57.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:57 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:10:57.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:57 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:10:57.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:57 smithi090 ceph-mon[34497]: from='osd.8 [v2:172.21.15.90:6816/3558544480,v1:172.21.15.90:6817/3558544480]' entity='osd.8' 2024-09-19T06:10:57.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:57 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:10:57.992 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:57 smithi090 ceph-mon[34497]: osd.8 [v2:172.21.15.90:6816/3558544480,v1:172.21.15.90:6817/3558544480] boot 2024-09-19T06:10:57.992 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:57 smithi090 ceph-mon[34497]: osdmap e54: 9 total, 9 up, 9 in 2024-09-19T06:10:57.992 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:57 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:10:58.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:57 smithi002 ceph-mon[30982]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:10:58.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:57 smithi002 ceph-mon[30982]: Detected new or changed devices on smithi090 2024-09-19T06:10:58.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:57 smithi002 ceph-mon[30982]: Adjusting osd_memory_target on smithi090 to 5696M 2024-09-19T06:10:58.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:57 smithi002 ceph-mon[30982]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T06:10:58.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:57 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:10:58.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:57 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:10:58.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:57 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:10:58.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:57 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:10:58.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:57 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:10:58.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:57 smithi002 ceph-mon[30982]: from='osd.8 [v2:172.21.15.90:6816/3558544480,v1:172.21.15.90:6817/3558544480]' entity='osd.8' 2024-09-19T06:10:58.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:57 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:10:58.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:57 smithi002 ceph-mon[30982]: osd.8 [v2:172.21.15.90:6816/3558544480,v1:172.21.15.90:6817/3558544480] boot 2024-09-19T06:10:58.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:57 smithi002 ceph-mon[30982]: osdmap e54: 9 total, 9 up, 9 in 2024-09-19T06:10:58.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:57 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:10:58.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:57 smithi089 ceph-mon[34160]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:10:58.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:57 smithi089 ceph-mon[34160]: Detected new or changed devices on smithi090 2024-09-19T06:10:58.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:57 smithi089 ceph-mon[34160]: Adjusting osd_memory_target on smithi090 to 5696M 2024-09-19T06:10:58.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:57 smithi089 ceph-mon[34160]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T06:10:58.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:57 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:10:58.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:57 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:10:58.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:57 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:10:58.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:57 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:10:58.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:57 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:10:58.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:57 smithi089 ceph-mon[34160]: from='osd.8 [v2:172.21.15.90:6816/3558544480,v1:172.21.15.90:6817/3558544480]' entity='osd.8' 2024-09-19T06:10:58.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:57 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:10:58.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:57 smithi089 ceph-mon[34160]: osd.8 [v2:172.21.15.90:6816/3558544480,v1:172.21.15.90:6817/3558544480] boot 2024-09-19T06:10:58.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:57 smithi089 ceph-mon[34160]: osdmap e54: 9 total, 9 up, 9 in 2024-09-19T06:10:58.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:57 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:10:59.081 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:58 smithi002 ceph-mon[30982]: purged_snaps scrub starts 2024-09-19T06:10:59.081 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:58 smithi002 ceph-mon[30982]: purged_snaps scrub ok 2024-09-19T06:10:59.081 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:58 smithi002 ceph-mon[30982]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:10:59.081 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:58 smithi002 ceph-mon[30982]: osdmap e55: 9 total, 9 up, 9 in 2024-09-19T06:10:59.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:58 smithi090 ceph-mon[34497]: purged_snaps scrub starts 2024-09-19T06:10:59.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:58 smithi090 ceph-mon[34497]: purged_snaps scrub ok 2024-09-19T06:10:59.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:58 smithi090 ceph-mon[34497]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:10:59.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:58 smithi090 ceph-mon[34497]: osdmap e55: 9 total, 9 up, 9 in 2024-09-19T06:10:59.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:58 smithi089 ceph-mon[34160]: purged_snaps scrub starts 2024-09-19T06:10:59.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:58 smithi089 ceph-mon[34160]: purged_snaps scrub ok 2024-09-19T06:10:59.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:58 smithi089 ceph-mon[34160]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:10:59.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:58 smithi089 ceph-mon[34160]: osdmap e55: 9 total, 9 up, 9 in 2024-09-19T06:11:00.151 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:59 smithi002 ceph-mon[30982]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:11:00.151 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:59 smithi002 ceph-mon[30982]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T06:11:00.151 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:59 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1333290367' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "194d4c64-dd29-4d35-bc54-0858c44815cd"}]: dispatch 2024-09-19T06:11:00.151 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:59 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1333290367' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "194d4c64-dd29-4d35-bc54-0858c44815cd"}]': finished 2024-09-19T06:11:00.151 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:59 smithi002 ceph-mon[30982]: osdmap e57: 10 total, 9 up, 10 in 2024-09-19T06:11:00.151 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:10:59 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:11:00.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:59 smithi090 ceph-mon[34497]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:11:00.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:59 smithi090 ceph-mon[34497]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T06:11:00.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:59 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1333290367' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "194d4c64-dd29-4d35-bc54-0858c44815cd"}]: dispatch 2024-09-19T06:11:00.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:59 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1333290367' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "194d4c64-dd29-4d35-bc54-0858c44815cd"}]': finished 2024-09-19T06:11:00.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:59 smithi090 ceph-mon[34497]: osdmap e57: 10 total, 9 up, 10 in 2024-09-19T06:11:00.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:10:59 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:11:00.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:59 smithi089 ceph-mon[34160]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:11:00.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:59 smithi089 ceph-mon[34160]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T06:11:00.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:59 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1333290367' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "194d4c64-dd29-4d35-bc54-0858c44815cd"}]: dispatch 2024-09-19T06:11:00.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:59 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1333290367' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "194d4c64-dd29-4d35-bc54-0858c44815cd"}]': finished 2024-09-19T06:11:00.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:59 smithi089 ceph-mon[34160]: osdmap e57: 10 total, 9 up, 10 in 2024-09-19T06:11:00.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:10:59 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:11:01.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:00 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/46237984' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:11:01.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:00 smithi002 ceph-mon[30982]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T06:11:01.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:00 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:11:01.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:00 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/46237984' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:11:01.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:00 smithi090 ceph-mon[34497]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T06:11:01.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:00 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:11:01.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:00 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/46237984' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:11:01.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:00 smithi089 ceph-mon[34160]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T06:11:01.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:00 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:11:02.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:01 smithi002 ceph-mon[30982]: pgmap v191: 1 pgs: 1 remapped+peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:11:02.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:01 smithi090 ceph-mon[34497]: pgmap v191: 1 pgs: 1 remapped+peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:11:02.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:01 smithi089 ceph-mon[34160]: pgmap v191: 1 pgs: 1 remapped+peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:11:04.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:03 smithi002 ceph-mon[30982]: pgmap v193: 1 pgs: 1 remapped+peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:11:04.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:03 smithi090 ceph-mon[34497]: pgmap v193: 1 pgs: 1 remapped+peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:11:04.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:03 smithi089 ceph-mon[34160]: pgmap v193: 1 pgs: 1 remapped+peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:11:06.111 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:05 smithi090 ceph-mon[34497]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-19T06:11:06.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:05 smithi002 ceph-mon[30982]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-19T06:11:06.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:05 smithi089 ceph-mon[34160]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-19T06:11:08.085 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:07 smithi002 ceph-mon[30982]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-19T06:11:08.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:07 smithi090 ceph-mon[34497]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-19T06:11:08.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:07 smithi089 ceph-mon[34160]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-19T06:11:08.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:08 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T06:11:08.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:08 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:11:09.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:08 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T06:11:09.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:08 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:11:09.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:08 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T06:11:09.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:08 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:11:10.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:09 smithi002 ceph-mon[30982]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-19T06:11:10.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:09 smithi002 ceph-mon[30982]: Deploying daemon osd.9 on smithi002 2024-09-19T06:11:10.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:09 smithi090 ceph-mon[34497]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-19T06:11:10.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:09 smithi090 ceph-mon[34497]: Deploying daemon osd.9 on smithi002 2024-09-19T06:11:10.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:09 smithi089 ceph-mon[34160]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-19T06:11:10.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:09 smithi089 ceph-mon[34160]: Deploying daemon osd.9 on smithi002 2024-09-19T06:11:12.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:11 smithi002 ceph-mon[30982]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T06:11:12.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:11 smithi090 ceph-mon[34497]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T06:11:12.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:11 smithi089 ceph-mon[34160]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T06:11:14.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:13 smithi002 ceph-mon[30982]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-19T06:11:14.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:13 smithi090 ceph-mon[34497]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-19T06:11:14.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:13 smithi089 ceph-mon[34160]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-19T06:11:16.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:15 smithi002 ceph-mon[30982]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:11:16.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:15 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:11:16.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:15 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:16.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:15 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:16.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:15 smithi090 ceph-mon[34497]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:11:16.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:15 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:11:16.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:15 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:16.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:15 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:16.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:15 smithi089 ceph-mon[34160]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:11:16.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:15 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:11:16.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:15 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:16.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:15 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:18.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:17 smithi002 ceph-mon[30982]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:11:18.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:17 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:18.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:17 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:18.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:17 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:11:18.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:17 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:11:18.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:17 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:18.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:17 smithi090 ceph-mon[34497]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:11:18.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:17 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:18.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:17 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:18.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:17 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:11:18.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:17 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:11:18.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:17 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:18.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:17 smithi089 ceph-mon[34160]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:11:18.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:17 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:18.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:17 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:18.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:17 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:11:18.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:17 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:11:18.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:17 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:18.374 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 9 on host 'smithi002' 2024-09-19T06:11:18.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:11:18.372+0000 7fa4917fa640 1 -- 172.21.15.2:0/3459971445 <== mgr.14150 v2:172.21.15.2:6800/4180340554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa494062630 con 0x7fa47c0a32f0 2024-09-19T06:11:18.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:11:18.375+0000 7fa49a75e640 1 -- 172.21.15.2:0/3459971445 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fa47c0a32f0 msgr2=0x7fa47c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:18.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:11:18.375+0000 7fa49a75e640 1 --2- 172.21.15.2:0/3459971445 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fa47c0a32f0 0x7fa47c0a57b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa4941993d0 tx=0x7fa488005f90 comp rx=0 tx=0).stop 2024-09-19T06:11:18.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:11:18.375+0000 7fa49a75e640 1 -- 172.21.15.2:0/3459971445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4941026a0 msgr2=0x7fa494197eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:18.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:11:18.375+0000 7fa49a75e640 1 --2- 172.21.15.2:0/3459971445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4941026a0 0x7fa494197eb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa48400b4a0 tx=0x7fa48400b960 comp rx=0 tx=0).stop 2024-09-19T06:11:18.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:11:18.375+0000 7fa49a75e640 1 -- 172.21.15.2:0/3459971445 shutdown_connections 2024-09-19T06:11:18.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:11:18.375+0000 7fa49a75e640 1 --2- 172.21.15.2:0/3459971445 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fa47c0a32f0 0x7fa47c0a57b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:18.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:11:18.375+0000 7fa49a75e640 1 --2- 172.21.15.2:0/3459971445 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa494107900 0x7fa49419f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:18.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:11:18.375+0000 7fa49a75e640 1 --2- 172.21.15.2:0/3459971445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa494104fd0 0x7fa4941983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:18.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:11:18.375+0000 7fa49a75e640 1 --2- 172.21.15.2:0/3459971445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4941026a0 0x7fa494197eb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:18.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:11:18.375+0000 7fa49a75e640 1 -- 172.21.15.2:0/3459971445 >> 172.21.15.2:0/3459971445 conn(0x7fa4940fc2a0 msgr2=0x7fa494103000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:18.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:11:18.375+0000 7fa49a75e640 1 -- 172.21.15.2:0/3459971445 shutdown_connections 2024-09-19T06:11:18.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:11:18.375+0000 7fa49a75e640 1 -- 172.21.15.2:0/3459971445 wait complete. 2024-09-19T06:11:19.013 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:18 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:11:19.013 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:18 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:19.013 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:18 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:19.042 DEBUG:teuthology.orchestra.run.smithi002:osd.9> sudo journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@osd.9.service 2024-09-19T06:11:19.045 INFO:tasks.cephadm:Deploying osd.10 on smithi089 with /dev/vg_nvme/lv_1... 2024-09-19T06:11:19.045 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T06:11:19.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:18 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:11:19.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:18 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:19.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:18 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:19.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:18 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:11:19.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:18 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:19.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:18 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:19.299 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:11:20.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:19 smithi089 ceph-mon[34160]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:11:20.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:19 smithi002 ceph-mon[30982]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:11:20.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:19 smithi090 ceph-mon[34497]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:11:21.222 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:11:20 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:11:20.942+0000 7f415f63c640 -1 osd.9 0 log_to_monitors true 2024-09-19T06:11:21.717 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-19T06:11:21.742 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi089:vg_nvme/lv_1 2024-09-19T06:11:21.997 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:11:22.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:21 smithi089 ceph-mon[34160]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:11:22.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:21 smithi089 ceph-mon[34160]: from='osd.9 [v2:172.21.15.2:6826/2690758100,v1:172.21.15.2:6827/2690758100]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T06:11:22.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:21 smithi002 ceph-mon[30982]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:11:22.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:21 smithi002 ceph-mon[30982]: from='osd.9 [v2:172.21.15.2:6826/2690758100,v1:172.21.15.2:6827/2690758100]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T06:11:22.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:21 smithi090 ceph-mon[34497]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:11:22.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:21 smithi090 ceph-mon[34497]: from='osd.9 [v2:172.21.15.2:6826/2690758100,v1:172.21.15.2:6827/2690758100]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T06:11:22.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:22.473+0000 7f20c6f5d640 1 -- 172.21.15.89:0/1438064040 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20c01026d0 msgr2=0x7f20c0108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:22.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:22.473+0000 7f20c6f5d640 1 --2- 172.21.15.89:0/1438064040 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20c01026d0 0x7f20c0108f60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f20b8009ca0 tx=0x7f20b802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:11:22.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:22.473+0000 7f20c6f5d640 1 -- 172.21.15.89:0/1438064040 shutdown_connections 2024-09-19T06:11:22.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:22.473+0000 7f20c6f5d640 1 --2- 172.21.15.89:0/1438064040 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20c01026d0 0x7f20c0108f60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:22.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:22.473+0000 7f20c6f5d640 1 --2- 172.21.15.89:0/1438064040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20c0101d10 0x7f20c0102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:22.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:22.473+0000 7f20c6f5d640 1 --2- 172.21.15.89:0/1438064040 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20c0100b10 0x7f20c0100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:22.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:22.473+0000 7f20c6f5d640 1 -- 172.21.15.89:0/1438064040 >> 172.21.15.89:0/1438064040 conn(0x7f20c00fc2a0 msgr2=0x7f20c00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:22.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:22.473+0000 7f20c6f5d640 1 -- 172.21.15.89:0/1438064040 shutdown_connections 2024-09-19T06:11:22.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:22.473+0000 7f20c6f5d640 1 -- 172.21.15.89:0/1438064040 wait complete. 2024-09-19T06:11:22.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:22.473+0000 7f20c6f5d640 1 Processor -- start 2024-09-19T06:11:22.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:22.473+0000 7f20c6f5d640 1 -- start start 2024-09-19T06:11:22.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:22.473+0000 7f20c6f5d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20c0100b10 0x7f20c006b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:22.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:22.473+0000 7f20c6f5d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20c0101d10 0x7f20c019caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:22.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:22.473+0000 7f20c6f5d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20c01026d0 0x7f20c019f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:22.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:22.473+0000 7f20c6f5d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f20c010c640 con 0x7f20c0101d10 2024-09-19T06:11:22.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:22.473+0000 7f20c6f5d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f20c010c4c0 con 0x7f20c01026d0 2024-09-19T06:11:22.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:22.473+0000 7f20c6f5d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f20c010c7c0 con 0x7f20c0100b10 2024-09-19T06:11:22.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:22.474+0000 7f20c54fa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20c01026d0 0x7f20c019f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:22.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:22.474+0000 7f20c54fa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20c01026d0 0x7f20c019f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33192/0 (socket says 172.21.15.89:33192) 2024-09-19T06:11:22.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:22.474+0000 7f20c54fa640 1 -- 172.21.15.89:0/3131937329 learned_addr learned my addr 172.21.15.89:0/3131937329 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-19T06:11:22.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:22.474+0000 7f20c4cf9640 1 --2- 172.21.15.89:0/3131937329 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20c0100b10 0x7f20c006b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:22.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:22.474+0000 7f20bffff640 1 --2- 172.21.15.89:0/3131937329 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20c0101d10 0x7f20c019caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:22.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:22.474+0000 7f20c54fa640 1 -- 172.21.15.89:0/3131937329 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20c0100b10 msgr2=0x7f20c006b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:22.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:22.474+0000 7f20c54fa640 1 --2- 172.21.15.89:0/3131937329 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20c0100b10 0x7f20c006b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:22.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:22.474+0000 7f20c54fa640 1 -- 172.21.15.89:0/3131937329 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20c0101d10 msgr2=0x7f20c019caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:22.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:22.474+0000 7f20c54fa640 1 --2- 172.21.15.89:0/3131937329 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20c0101d10 0x7f20c019caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:22.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:22.474+0000 7f20c54fa640 1 -- 172.21.15.89:0/3131937329 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20c019fa00 con 0x7f20c01026d0 2024-09-19T06:11:22.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:22.474+0000 7f20c54fa640 1 --2- 172.21.15.89:0/3131937329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20c01026d0 0x7f20c019f140 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f20b8009dc0 tx=0x7f20b8003ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:22.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:22.474+0000 7f20bdffb640 1 -- 172.21.15.89:0/3131937329 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b8004040 con 0x7f20c01026d0 2024-09-19T06:11:22.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:22.474+0000 7f20bdffb640 1 -- 172.21.15.89:0/3131937329 <== mon.2 v2:172.21.15.89:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f20b8004690 con 0x7f20c01026d0 2024-09-19T06:11:22.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:22.474+0000 7f20c6f5d640 1 -- 172.21.15.89:0/3131937329 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20c019fc90 con 0x7f20c01026d0 2024-09-19T06:11:22.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:22.474+0000 7f20bdffb640 1 -- 172.21.15.89:0/3131937329 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b802f4c0 con 0x7f20c01026d0 2024-09-19T06:11:22.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:22.475+0000 7f20c6f5d640 1 -- 172.21.15.89:0/3131937329 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20c01a0180 con 0x7f20c01026d0 2024-09-19T06:11:22.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:22.476+0000 7f20c6f5d640 1 -- 172.21.15.89:0/3131937329 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20c0107f60 con 0x7f20c01026d0 2024-09-19T06:11:22.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:22.477+0000 7f20bdffb640 1 -- 172.21.15.89:0/3131937329 <== mon.2 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f20b8030650 con 0x7f20c01026d0 2024-09-19T06:11:22.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:22.477+0000 7f20bdffb640 1 --2- 172.21.15.89:0/3131937329 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f20a80a3240 0x7f20a80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:22.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:22.477+0000 7f20bdffb640 1 -- 172.21.15.89:0/3131937329 <== mon.2 v2:172.21.15.89:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5965+0+0 (secure 0 0 0) 0x7f20b80f0910 con 0x7f20c01026d0 2024-09-19T06:11:22.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:22.478+0000 7f20c4cf9640 1 --2- 172.21.15.89:0/3131937329 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f20a80a3240 0x7f20a80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:22.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:22.478+0000 7f20c4cf9640 1 --2- 172.21.15.89:0/3131937329 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f20a80a3240 0x7f20a80a5700 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f20b00058c0 tx=0x7f20b000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:22.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:22.481+0000 7f20bdffb640 1 -- 172.21.15.89:0/3131937329 <== mon.2 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f20b80bdf40 con 0x7f20c01026d0 2024-09-19T06:11:22.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:22.654+0000 7f20c6f5d640 1 -- 172.21.15.89:0/3131937329 --> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f20c0062630 con 0x7f20a80a3240 2024-09-19T06:11:23.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:22 smithi089 ceph-mon[34160]: from='osd.9 [v2:172.21.15.2:6826/2690758100,v1:172.21.15.2:6827/2690758100]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T06:11:23.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:22 smithi089 ceph-mon[34160]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T06:11:23.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:22 smithi089 ceph-mon[34160]: from='osd.9 [v2:172.21.15.2:6826/2690758100,v1:172.21.15.2:6827/2690758100]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-19T06:11:23.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:22 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:11:23.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:22 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:23.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:22 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:23.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:22 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:11:23.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:22 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:11:23.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:22 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:11:23.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:22 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:11:23.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:22 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:23.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:22 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:11:23.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:22 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:11:23.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:22 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:23.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:22 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:11:23.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:22 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:11:23.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:22 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:11:23.222 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:11:22 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:11:22.900+0000 7f415ad9c640 -1 osd.9 0 waiting for initial osdmap 2024-09-19T06:11:23.222 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:11:22 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:11:22.914+0000 7f41573d6640 -1 osd.9 60 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:11:23.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:22 smithi002 ceph-mon[30982]: from='osd.9 [v2:172.21.15.2:6826/2690758100,v1:172.21.15.2:6827/2690758100]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T06:11:23.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:22 smithi002 ceph-mon[30982]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T06:11:23.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:22 smithi002 ceph-mon[30982]: from='osd.9 [v2:172.21.15.2:6826/2690758100,v1:172.21.15.2:6827/2690758100]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-19T06:11:23.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:22 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:11:23.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:22 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:23.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:22 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:23.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:22 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:11:23.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:22 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:11:23.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:22 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:11:23.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:22 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:11:23.224 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:22 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:23.224 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:22 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:11:23.224 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:22 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:11:23.224 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:22 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:23.224 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:22 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:11:23.224 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:22 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:11:23.224 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:22 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:11:23.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:22 smithi090 ceph-mon[34497]: from='osd.9 [v2:172.21.15.2:6826/2690758100,v1:172.21.15.2:6827/2690758100]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T06:11:23.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:22 smithi090 ceph-mon[34497]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T06:11:23.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:22 smithi090 ceph-mon[34497]: from='osd.9 [v2:172.21.15.2:6826/2690758100,v1:172.21.15.2:6827/2690758100]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-19T06:11:23.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:22 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:11:23.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:22 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:23.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:22 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:23.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:22 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:11:23.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:22 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:11:23.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:22 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:11:23.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:22 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:11:23.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:22 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:23.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:22 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:11:23.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:22 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:11:23.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:22 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:23.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:22 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:11:23.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:22 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:11:23.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:22 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:11:24.159 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:23 smithi090 ceph-mon[34497]: Detected new or changed devices on smithi002 2024-09-19T06:11:24.159 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:23 smithi090 ceph-mon[34497]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:11:24.159 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:23 smithi090 ceph-mon[34497]: Adjusting osd_memory_target on smithi002 to 4273M 2024-09-19T06:11:24.159 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:23 smithi090 ceph-mon[34497]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:11:24.159 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:23 smithi090 ceph-mon[34497]: from='osd.9 [v2:172.21.15.2:6826/2690758100,v1:172.21.15.2:6827/2690758100]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-19T06:11:24.160 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:23 smithi090 ceph-mon[34497]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T06:11:24.160 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:23 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:11:24.160 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:23 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:11:24.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:23 smithi002 ceph-mon[30982]: Detected new or changed devices on smithi002 2024-09-19T06:11:24.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:23 smithi002 ceph-mon[30982]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:11:24.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:23 smithi002 ceph-mon[30982]: Adjusting osd_memory_target on smithi002 to 4273M 2024-09-19T06:11:24.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:23 smithi002 ceph-mon[30982]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:11:24.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:23 smithi002 ceph-mon[30982]: from='osd.9 [v2:172.21.15.2:6826/2690758100,v1:172.21.15.2:6827/2690758100]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-19T06:11:24.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:23 smithi002 ceph-mon[30982]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T06:11:24.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:23 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:11:24.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:23 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:11:24.250 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:23 smithi089 ceph-mon[34160]: Detected new or changed devices on smithi002 2024-09-19T06:11:24.251 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:23 smithi089 ceph-mon[34160]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:11:24.251 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:23 smithi089 ceph-mon[34160]: Adjusting osd_memory_target on smithi002 to 4273M 2024-09-19T06:11:24.251 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:23 smithi089 ceph-mon[34160]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:11:24.251 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:23 smithi089 ceph-mon[34160]: from='osd.9 [v2:172.21.15.2:6826/2690758100,v1:172.21.15.2:6827/2690758100]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-19T06:11:24.251 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:23 smithi089 ceph-mon[34160]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T06:11:24.251 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:23 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:11:24.251 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:23 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:11:25.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:24 smithi002 ceph-mon[30982]: purged_snaps scrub starts 2024-09-19T06:11:25.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:24 smithi002 ceph-mon[30982]: purged_snaps scrub ok 2024-09-19T06:11:25.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:24 smithi002 ceph-mon[30982]: osd.9 [v2:172.21.15.2:6826/2690758100,v1:172.21.15.2:6827/2690758100] boot 2024-09-19T06:11:25.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:24 smithi002 ceph-mon[30982]: osdmap e61: 10 total, 10 up, 10 in 2024-09-19T06:11:25.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:24 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:11:25.223 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:24 smithi089 ceph-mon[34160]: purged_snaps scrub starts 2024-09-19T06:11:25.223 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:24 smithi089 ceph-mon[34160]: purged_snaps scrub ok 2024-09-19T06:11:25.223 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:24 smithi089 ceph-mon[34160]: osd.9 [v2:172.21.15.2:6826/2690758100,v1:172.21.15.2:6827/2690758100] boot 2024-09-19T06:11:25.223 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:24 smithi089 ceph-mon[34160]: osdmap e61: 10 total, 10 up, 10 in 2024-09-19T06:11:25.223 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:24 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:11:25.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:24 smithi090 ceph-mon[34497]: purged_snaps scrub starts 2024-09-19T06:11:25.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:24 smithi090 ceph-mon[34497]: purged_snaps scrub ok 2024-09-19T06:11:25.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:24 smithi090 ceph-mon[34497]: osd.9 [v2:172.21.15.2:6826/2690758100,v1:172.21.15.2:6827/2690758100] boot 2024-09-19T06:11:25.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:24 smithi090 ceph-mon[34497]: osdmap e61: 10 total, 10 up, 10 in 2024-09-19T06:11:25.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:24 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:11:26.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:25 smithi002 ceph-mon[30982]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:11:26.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:25 smithi002 ceph-mon[30982]: osdmap e62: 10 total, 10 up, 10 in 2024-09-19T06:11:26.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:25 smithi002 ceph-mon[30982]: from='client.? 172.21.15.89:0/1322287782' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7695fa4a-b94e-4afc-b166-690a197ad730"}]: dispatch 2024-09-19T06:11:26.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:25 smithi002 ceph-mon[30982]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7695fa4a-b94e-4afc-b166-690a197ad730"}]: dispatch 2024-09-19T06:11:26.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:25 smithi002 ceph-mon[30982]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7695fa4a-b94e-4afc-b166-690a197ad730"}]': finished 2024-09-19T06:11:26.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:25 smithi002 ceph-mon[30982]: osdmap e63: 11 total, 10 up, 11 in 2024-09-19T06:11:26.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:25 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:11:26.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:25 smithi002 ceph-mon[30982]: from='client.? 172.21.15.89:0/202795181' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:11:26.238 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:25 smithi089 ceph-mon[34160]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:11:26.238 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:25 smithi089 ceph-mon[34160]: osdmap e62: 10 total, 10 up, 10 in 2024-09-19T06:11:26.238 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:25 smithi089 ceph-mon[34160]: from='client.? 172.21.15.89:0/1322287782' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7695fa4a-b94e-4afc-b166-690a197ad730"}]: dispatch 2024-09-19T06:11:26.238 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:25 smithi089 ceph-mon[34160]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7695fa4a-b94e-4afc-b166-690a197ad730"}]: dispatch 2024-09-19T06:11:26.238 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:25 smithi089 ceph-mon[34160]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7695fa4a-b94e-4afc-b166-690a197ad730"}]': finished 2024-09-19T06:11:26.238 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:25 smithi089 ceph-mon[34160]: osdmap e63: 11 total, 10 up, 11 in 2024-09-19T06:11:26.238 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:25 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:11:26.239 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:25 smithi089 ceph-mon[34160]: from='client.? 172.21.15.89:0/202795181' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:11:26.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:25 smithi090 ceph-mon[34497]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:11:26.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:25 smithi090 ceph-mon[34497]: osdmap e62: 10 total, 10 up, 10 in 2024-09-19T06:11:26.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:25 smithi090 ceph-mon[34497]: from='client.? 172.21.15.89:0/1322287782' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7695fa4a-b94e-4afc-b166-690a197ad730"}]: dispatch 2024-09-19T06:11:26.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:25 smithi090 ceph-mon[34497]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7695fa4a-b94e-4afc-b166-690a197ad730"}]: dispatch 2024-09-19T06:11:26.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:25 smithi090 ceph-mon[34497]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7695fa4a-b94e-4afc-b166-690a197ad730"}]': finished 2024-09-19T06:11:26.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:25 smithi090 ceph-mon[34497]: osdmap e63: 11 total, 10 up, 11 in 2024-09-19T06:11:26.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:25 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:11:26.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:25 smithi090 ceph-mon[34497]: from='client.? 172.21.15.89:0/202795181' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:11:28.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:27 smithi002 ceph-mon[30982]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:11:28.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:27 smithi090 ceph-mon[34497]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:11:28.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:27 smithi089 ceph-mon[34160]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:11:30.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:29 smithi002 ceph-mon[30982]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:11:30.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:29 smithi090 ceph-mon[34497]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:11:30.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:29 smithi089 ceph-mon[34160]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:11:32.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:31 smithi089 ceph-mon[34160]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:11:32.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:31 smithi002 ceph-mon[30982]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:11:32.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:31 smithi090 ceph-mon[34497]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:11:34.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:33 smithi089 ceph-mon[34160]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:11:34.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:33 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T06:11:34.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:33 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:11:34.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:33 smithi002 ceph-mon[30982]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:11:34.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:33 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T06:11:34.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:33 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:11:34.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:33 smithi090 ceph-mon[34497]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:11:34.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:33 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T06:11:34.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:33 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:11:35.205 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:34 smithi089 ceph-mon[34160]: Deploying daemon osd.10 on smithi089 2024-09-19T06:11:35.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:34 smithi002 ceph-mon[30982]: Deploying daemon osd.10 on smithi089 2024-09-19T06:11:35.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:34 smithi090 ceph-mon[34497]: Deploying daemon osd.10 on smithi089 2024-09-19T06:11:36.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:35 smithi089 ceph-mon[34160]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:11:36.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:35 smithi002 ceph-mon[30982]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:11:36.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:35 smithi090 ceph-mon[34497]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:11:37.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:36 smithi002 ceph-mon[30982]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:11:37.234 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:36 smithi089 ceph-mon[34160]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:11:37.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:36 smithi090 ceph-mon[34497]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:11:39.162 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:39 smithi089 ceph-mon[34160]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:11:39.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:39 smithi002 ceph-mon[30982]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:11:39.489 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:39 smithi090 ceph-mon[34497]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:11:40.284 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:40 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:11:40.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:40 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:40.285 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:40 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:40.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:40 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:11:40.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:40 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:40.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:40 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:40.489 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:40 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:11:40.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:40 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:40.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:40 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:41.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:41 smithi089 ceph-mon[34160]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:11:41.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:41 smithi002 ceph-mon[30982]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:11:41.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:41 smithi090 ceph-mon[34497]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:11:43.098 INFO:teuthology.orchestra.run.smithi089.stdout:Created osd(s) 10 on host 'smithi089' 2024-09-19T06:11:43.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:43.096+0000 7f20bdffb640 1 -- 172.21.15.89:0/3131937329 <== mgr.14150 v2:172.21.15.2:6800/4180340554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f20c0062630 con 0x7f20a80a3240 2024-09-19T06:11:43.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:43.098+0000 7f20c6f5d640 1 -- 172.21.15.89:0/3131937329 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f20a80a3240 msgr2=0x7f20a80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:43.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:43.098+0000 7f20c6f5d640 1 --2- 172.21.15.89:0/3131937329 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f20a80a3240 0x7f20a80a5700 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f20b00058c0 tx=0x7f20b000a2d0 comp rx=0 tx=0).stop 2024-09-19T06:11:43.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:43.098+0000 7f20c6f5d640 1 -- 172.21.15.89:0/3131937329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20c01026d0 msgr2=0x7f20c019f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:43.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:43.098+0000 7f20c6f5d640 1 --2- 172.21.15.89:0/3131937329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20c01026d0 0x7f20c019f140 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f20b8009dc0 tx=0x7f20b8003ba0 comp rx=0 tx=0).stop 2024-09-19T06:11:43.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:43.098+0000 7f20c6f5d640 1 -- 172.21.15.89:0/3131937329 shutdown_connections 2024-09-19T06:11:43.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:43.098+0000 7f20c6f5d640 1 --2- 172.21.15.89:0/3131937329 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f20a80a3240 0x7f20a80a5700 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:43.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:43.098+0000 7f20c6f5d640 1 --2- 172.21.15.89:0/3131937329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20c01026d0 0x7f20c019f140 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:43.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:43.098+0000 7f20c6f5d640 1 --2- 172.21.15.89:0/3131937329 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20c0101d10 0x7f20c019caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:43.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:43.098+0000 7f20c6f5d640 1 --2- 172.21.15.89:0/3131937329 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20c0100b10 0x7f20c006b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:43.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:43.098+0000 7f20c6f5d640 1 -- 172.21.15.89:0/3131937329 >> 172.21.15.89:0/3131937329 conn(0x7f20c00fc2a0 msgr2=0x7f20c0105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:43.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:43.098+0000 7f20c6f5d640 1 -- 172.21.15.89:0/3131937329 shutdown_connections 2024-09-19T06:11:43.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-19T06:11:43.099+0000 7f20c6f5d640 1 -- 172.21.15.89:0/3131937329 wait complete. 2024-09-19T06:11:43.711 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:43 smithi089 ceph-mon[34160]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:11:43.711 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:43 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:43.711 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:43 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:43.712 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:43 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:11:43.712 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:43 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:11:43.712 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:43 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:43.712 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:43 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:11:43.712 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:43 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:43.712 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:43 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:43.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:43 smithi002 ceph-mon[30982]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:11:43.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:43 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:43.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:43 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:43.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:43 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:11:43.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:43 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:11:43.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:43 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:43.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:43 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:11:43.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:43 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:43.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:43 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:43.740 DEBUG:teuthology.orchestra.run.smithi089:osd.10> sudo journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@osd.10.service 2024-09-19T06:11:43.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:43 smithi090 ceph-mon[34497]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:11:43.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:43 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:43.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:43 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:43.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:43 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:11:43.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:43 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:11:43.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:43 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:43.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:43 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:11:43.742 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:43 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:43.742 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:43 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:43.744 INFO:tasks.cephadm:Deploying osd.11 on smithi090 with /dev/vg_nvme/lv_1... 2024-09-19T06:11:43.744 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T06:11:43.997 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:11:45.414 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:45 smithi090 ceph-mon[34497]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:11:45.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:45 smithi089 ceph-mon[34160]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:11:45.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:45 smithi002 ceph-mon[30982]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:11:46.250 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:11:45 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:11:45.866+0000 7f6dcf4fc640 -1 osd.10 0 log_to_monitors true 2024-09-19T06:11:46.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:46 smithi090 ceph-mon[34497]: from='osd.10 [v2:172.21.15.89:6824/1141925395,v1:172.21.15.89:6825/1141925395]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T06:11:46.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:46 smithi090 ceph-mon[34497]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T06:11:46.521 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-19T06:11:46.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:46 smithi089 ceph-mon[34160]: from='osd.10 [v2:172.21.15.89:6824/1141925395,v1:172.21.15.89:6825/1141925395]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T06:11:46.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:46 smithi089 ceph-mon[34160]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T06:11:46.548 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi090:vg_nvme/lv_1 2024-09-19T06:11:46.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:46 smithi002 ceph-mon[30982]: from='osd.10 [v2:172.21.15.89:6824/1141925395,v1:172.21.15.89:6825/1141925395]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T06:11:46.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:46 smithi002 ceph-mon[30982]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T06:11:46.799 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:11:47.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:11:47.242+0000 7f9767158640 1 -- 172.21.15.90:0/3651945469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9760100ad0 msgr2=0x7f9760100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:47.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:11:47.242+0000 7f9767158640 1 --2- 172.21.15.90:0/3651945469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9760100ad0 0x7f9760100ed0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9754009900 tx=0x7f975402a410 comp rx=0 tx=0).stop 2024-09-19T06:11:47.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:11:47.242+0000 7f9767158640 1 -- 172.21.15.90:0/3651945469 shutdown_connections 2024-09-19T06:11:47.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:11:47.242+0000 7f9767158640 1 --2- 172.21.15.90:0/3651945469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9760102690 0x7f9760108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:47.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:11:47.242+0000 7f9767158640 1 --2- 172.21.15.90:0/3651945469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9760101cd0 0x7f9760102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:47.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:11:47.242+0000 7f9767158640 1 --2- 172.21.15.90:0/3651945469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9760100ad0 0x7f9760100ed0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:47.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:11:47.242+0000 7f9767158640 1 -- 172.21.15.90:0/3651945469 >> 172.21.15.90:0/3651945469 conn(0x7f97600fc280 msgr2=0x7f97600fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:47.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:11:47.242+0000 7f9767158640 1 -- 172.21.15.90:0/3651945469 shutdown_connections 2024-09-19T06:11:47.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:11:47.242+0000 7f9767158640 1 -- 172.21.15.90:0/3651945469 wait complete. 2024-09-19T06:11:47.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:11:47.243+0000 7f9767158640 1 Processor -- start 2024-09-19T06:11:47.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:11:47.243+0000 7f9767158640 1 -- start start 2024-09-19T06:11:47.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:11:47.243+0000 7f9767158640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9760100ad0 0x7f976006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:47.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:11:47.243+0000 7f9767158640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9760101cd0 0x7f976019cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:47.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:11:47.243+0000 7f9767158640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9760102690 0x7f976019f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:47.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:11:47.243+0000 7f9767158640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f976010c5e0 con 0x7f9760100ad0 2024-09-19T06:11:47.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:11:47.243+0000 7f9767158640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f976010c460 con 0x7f9760101cd0 2024-09-19T06:11:47.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:11:47.243+0000 7f9767158640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f976010c760 con 0x7f9760102690 2024-09-19T06:11:47.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:11:47.243+0000 7f97656f5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9760102690 0x7f976019f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:47.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:11:47.243+0000 7f97656f5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9760102690 0x7f976019f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44638/0 (socket says 172.21.15.90:44638) 2024-09-19T06:11:47.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:11:47.243+0000 7f97656f5640 1 -- 172.21.15.90:0/3024423405 learned_addr learned my addr 172.21.15.90:0/3024423405 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-19T06:11:47.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:11:47.243+0000 7f9764ef4640 1 --2- 172.21.15.90:0/3024423405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9760100ad0 0x7f976006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:47.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:11:47.243+0000 7f975ffff640 1 --2- 172.21.15.90:0/3024423405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9760101cd0 0x7f976019cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:47.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:11:47.244+0000 7f97656f5640 1 -- 172.21.15.90:0/3024423405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9760101cd0 msgr2=0x7f976019cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:47.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:11:47.244+0000 7f97656f5640 1 --2- 172.21.15.90:0/3024423405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9760101cd0 0x7f976019cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:47.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:11:47.244+0000 7f97656f5640 1 -- 172.21.15.90:0/3024423405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9760100ad0 msgr2=0x7f976006ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:47.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:11:47.244+0000 7f97656f5640 1 --2- 172.21.15.90:0/3024423405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9760100ad0 0x7f976006ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:47.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:11:47.244+0000 7f97656f5640 1 -- 172.21.15.90:0/3024423405 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f976019fa20 con 0x7f9760102690 2024-09-19T06:11:47.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:11:47.244+0000 7f975ffff640 1 --2- 172.21.15.90:0/3024423405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9760101cd0 0x7f976019cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:11:47.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:11:47.244+0000 7f97656f5640 1 --2- 172.21.15.90:0/3024423405 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9760102690 0x7f976019f160 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f975800eb10 tx=0x7f975800c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:47.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:11:47.244+0000 7f975dffb640 1 -- 172.21.15.90:0/3024423405 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9758004b20 con 0x7f9760102690 2024-09-19T06:11:47.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:11:47.244+0000 7f9767158640 1 -- 172.21.15.90:0/3024423405 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f976019fd10 con 0x7f9760102690 2024-09-19T06:11:47.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:11:47.244+0000 7f975dffb640 1 -- 172.21.15.90:0/3024423405 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9758004cc0 con 0x7f9760102690 2024-09-19T06:11:47.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:11:47.244+0000 7f975dffb640 1 -- 172.21.15.90:0/3024423405 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9758010690 con 0x7f9760102690 2024-09-19T06:11:47.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:11:47.244+0000 7f9767158640 1 -- 172.21.15.90:0/3024423405 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97601a0170 con 0x7f9760102690 2024-09-19T06:11:47.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:11:47.245+0000 7f9767158640 1 -- 172.21.15.90:0/3024423405 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9760108010 con 0x7f9760102690 2024-09-19T06:11:47.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:11:47.246+0000 7f975dffb640 1 -- 172.21.15.90:0/3024423405 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f9758005020 con 0x7f9760102690 2024-09-19T06:11:47.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:11:47.247+0000 7f975dffb640 1 --2- 172.21.15.90:0/3024423405 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f97500a3240 0x7f97500a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:47.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:11:47.247+0000 7f975dffb640 1 -- 172.21.15.90:0/3024423405 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6398+0+0 (secure 0 0 0) 0x7f97580cf730 con 0x7f9760102690 2024-09-19T06:11:47.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:11:47.247+0000 7f9764ef4640 1 --2- 172.21.15.90:0/3024423405 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f97500a3240 0x7f97500a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:47.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:11:47.248+0000 7f9764ef4640 1 --2- 172.21.15.90:0/3024423405 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f97500a3240 0x7f97500a5700 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9754004770 tx=0x7f9754000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:47.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:11:47.252+0000 7f975dffb640 1 -- 172.21.15.90:0/3024423405 <== mon.1 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f975809cbd0 con 0x7f9760102690 2024-09-19T06:11:47.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:11:47.434+0000 7f9767158640 1 -- 172.21.15.90:0/3024423405 --> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f9760062630 con 0x7f97500a3240 2024-09-19T06:11:47.436 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:47 smithi090 ceph-mon[34497]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:11:47.437 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:47 smithi090 ceph-mon[34497]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T06:11:47.437 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:47 smithi090 ceph-mon[34497]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T06:11:47.437 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:47 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:11:47.437 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:47 smithi090 ceph-mon[34497]: from='osd.10 [v2:172.21.15.89:6824/1141925395,v1:172.21.15.89:6825/1141925395]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-19T06:11:47.437 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:47 smithi090 ceph-mon[34497]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-19T06:11:47.437 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:47 smithi090 ceph-mon[34497]: Detected new or changed devices on smithi089 2024-09-19T06:11:47.437 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:47 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:47.437 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:47 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:47.437 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:47 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:11:47.437 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:47 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:11:47.437 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:47 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:11:47.437 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:47 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:11:47.437 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:47 smithi090 ceph-mon[34497]: Adjusting osd_memory_target on smithi089 to 4271M 2024-09-19T06:11:47.438 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:47 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:47.438 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:47 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:11:47.438 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:47 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:11:47.438 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:47 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:47.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:47 smithi002 ceph-mon[30982]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:11:47.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:47 smithi002 ceph-mon[30982]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T06:11:47.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:47 smithi002 ceph-mon[30982]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T06:11:47.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:47 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:11:47.724 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:47 smithi002 ceph-mon[30982]: from='osd.10 [v2:172.21.15.89:6824/1141925395,v1:172.21.15.89:6825/1141925395]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-19T06:11:47.724 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:47 smithi002 ceph-mon[30982]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-19T06:11:47.724 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:47 smithi002 ceph-mon[30982]: Detected new or changed devices on smithi089 2024-09-19T06:11:47.724 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:47 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:47.724 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:47 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:47.725 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:47 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:11:47.725 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:47 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:11:47.725 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:47 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:11:47.725 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:47 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:11:47.725 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:47 smithi002 ceph-mon[30982]: Adjusting osd_memory_target on smithi089 to 4271M 2024-09-19T06:11:47.725 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:47 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:47.725 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:47 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:11:47.725 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:47 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:11:47.725 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:47 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:47.792 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:11:47 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:11:47.386+0000 7f6dcac5c640 -1 osd.10 0 waiting for initial osdmap 2024-09-19T06:11:47.792 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:11:47 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:11:47.400+0000 7f6dc7296640 -1 osd.10 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:11:47.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:47 smithi089 ceph-mon[34160]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:11:47.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:47 smithi089 ceph-mon[34160]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T06:11:47.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:47 smithi089 ceph-mon[34160]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T06:11:47.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:47 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:11:47.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:47 smithi089 ceph-mon[34160]: from='osd.10 [v2:172.21.15.89:6824/1141925395,v1:172.21.15.89:6825/1141925395]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-19T06:11:47.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:47 smithi089 ceph-mon[34160]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-19T06:11:47.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:47 smithi089 ceph-mon[34160]: Detected new or changed devices on smithi089 2024-09-19T06:11:47.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:47 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:47.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:47 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:47.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:47 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:11:47.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:47 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:11:47.794 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:47 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:11:47.794 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:47 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:11:47.794 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:47 smithi089 ceph-mon[34160]: Adjusting osd_memory_target on smithi089 to 4271M 2024-09-19T06:11:47.794 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:47 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:47.794 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:47 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:11:47.794 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:47 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:11:47.794 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:47 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:11:48.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:48 smithi002 ceph-mon[30982]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-19T06:11:48.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:48 smithi002 ceph-mon[30982]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T06:11:48.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:48 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:11:48.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:48 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:11:48.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:48 smithi002 ceph-mon[30982]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:11:48.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:48 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:11:48.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:48 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:11:48.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:48 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:11:48.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:48 smithi002 ceph-mon[30982]: osd.10 [v2:172.21.15.89:6824/1141925395,v1:172.21.15.89:6825/1141925395] boot 2024-09-19T06:11:48.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:48 smithi002 ceph-mon[30982]: osdmap e66: 11 total, 11 up, 11 in 2024-09-19T06:11:48.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:48 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:11:48.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:48 smithi090 ceph-mon[34497]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-19T06:11:48.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:48 smithi090 ceph-mon[34497]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T06:11:48.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:48 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:11:48.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:48 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:11:48.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:48 smithi090 ceph-mon[34497]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:11:48.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:48 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:11:48.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:48 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:11:48.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:48 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:11:48.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:48 smithi090 ceph-mon[34497]: osd.10 [v2:172.21.15.89:6824/1141925395,v1:172.21.15.89:6825/1141925395] boot 2024-09-19T06:11:48.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:48 smithi090 ceph-mon[34497]: osdmap e66: 11 total, 11 up, 11 in 2024-09-19T06:11:48.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:48 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:11:48.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:48 smithi089 ceph-mon[34160]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-19T06:11:48.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:48 smithi089 ceph-mon[34160]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T06:11:48.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:48 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:11:48.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:48 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:11:48.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:48 smithi089 ceph-mon[34160]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:11:48.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:48 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:11:48.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:48 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:11:48.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:48 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:11:48.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:48 smithi089 ceph-mon[34160]: osd.10 [v2:172.21.15.89:6824/1141925395,v1:172.21.15.89:6825/1141925395] boot 2024-09-19T06:11:48.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:48 smithi089 ceph-mon[34160]: osdmap e66: 11 total, 11 up, 11 in 2024-09-19T06:11:48.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:48 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:11:49.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:49 smithi002 ceph-mon[30982]: purged_snaps scrub starts 2024-09-19T06:11:49.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:49 smithi002 ceph-mon[30982]: purged_snaps scrub ok 2024-09-19T06:11:49.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:49 smithi002 ceph-mon[30982]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:11:49.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:49 smithi002 ceph-mon[30982]: osdmap e67: 11 total, 11 up, 11 in 2024-09-19T06:11:49.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:49 smithi090 ceph-mon[34497]: purged_snaps scrub starts 2024-09-19T06:11:49.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:49 smithi090 ceph-mon[34497]: purged_snaps scrub ok 2024-09-19T06:11:49.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:49 smithi090 ceph-mon[34497]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:11:49.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:49 smithi090 ceph-mon[34497]: osdmap e67: 11 total, 11 up, 11 in 2024-09-19T06:11:49.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:49 smithi089 ceph-mon[34160]: purged_snaps scrub starts 2024-09-19T06:11:49.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:49 smithi089 ceph-mon[34160]: purged_snaps scrub ok 2024-09-19T06:11:49.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:49 smithi089 ceph-mon[34160]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:11:49.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:49 smithi089 ceph-mon[34160]: osdmap e67: 11 total, 11 up, 11 in 2024-09-19T06:11:50.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:50 smithi002 ceph-mon[30982]: from='client.? 172.21.15.90:0/2757458934' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1815a999-bfdb-46b9-afcd-632ee8ba56d3"}]: dispatch 2024-09-19T06:11:50.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:50 smithi002 ceph-mon[30982]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1815a999-bfdb-46b9-afcd-632ee8ba56d3"}]: dispatch 2024-09-19T06:11:50.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:50 smithi002 ceph-mon[30982]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1815a999-bfdb-46b9-afcd-632ee8ba56d3"}]': finished 2024-09-19T06:11:50.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:50 smithi002 ceph-mon[30982]: osdmap e68: 12 total, 11 up, 12 in 2024-09-19T06:11:50.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:50 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:11:50.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:50 smithi002 ceph-mon[30982]: from='client.? 172.21.15.90:0/2351852248' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:11:50.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:50 smithi090 ceph-mon[34497]: from='client.? 172.21.15.90:0/2757458934' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1815a999-bfdb-46b9-afcd-632ee8ba56d3"}]: dispatch 2024-09-19T06:11:50.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:50 smithi090 ceph-mon[34497]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1815a999-bfdb-46b9-afcd-632ee8ba56d3"}]: dispatch 2024-09-19T06:11:50.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:50 smithi090 ceph-mon[34497]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1815a999-bfdb-46b9-afcd-632ee8ba56d3"}]': finished 2024-09-19T06:11:50.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:50 smithi090 ceph-mon[34497]: osdmap e68: 12 total, 11 up, 12 in 2024-09-19T06:11:50.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:50 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:11:50.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:50 smithi090 ceph-mon[34497]: from='client.? 172.21.15.90:0/2351852248' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:11:50.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:50 smithi089 ceph-mon[34160]: from='client.? 172.21.15.90:0/2757458934' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1815a999-bfdb-46b9-afcd-632ee8ba56d3"}]: dispatch 2024-09-19T06:11:50.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:50 smithi089 ceph-mon[34160]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1815a999-bfdb-46b9-afcd-632ee8ba56d3"}]: dispatch 2024-09-19T06:11:50.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:50 smithi089 ceph-mon[34160]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1815a999-bfdb-46b9-afcd-632ee8ba56d3"}]': finished 2024-09-19T06:11:50.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:50 smithi089 ceph-mon[34160]: osdmap e68: 12 total, 11 up, 12 in 2024-09-19T06:11:50.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:50 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:11:50.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:50 smithi089 ceph-mon[34160]: from='client.? 172.21.15.90:0/2351852248' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:11:52.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:51 smithi002 ceph-mon[30982]: pgmap v227: 1 pgs: 1 remapped+peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:11:52.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:51 smithi002 ceph-mon[30982]: osdmap e69: 12 total, 11 up, 12 in 2024-09-19T06:11:52.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:51 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:11:52.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:51 smithi090 ceph-mon[34497]: pgmap v227: 1 pgs: 1 remapped+peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:11:52.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:51 smithi090 ceph-mon[34497]: osdmap e69: 12 total, 11 up, 12 in 2024-09-19T06:11:52.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:51 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:11:52.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:51 smithi089 ceph-mon[34160]: pgmap v227: 1 pgs: 1 remapped+peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:11:52.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:51 smithi089 ceph-mon[34160]: osdmap e69: 12 total, 11 up, 12 in 2024-09-19T06:11:52.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:51 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:11:53.141 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:52 smithi090 ceph-mon[34497]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T06:11:53.141 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:52 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:11:53.194 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:52 smithi089 ceph-mon[34160]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T06:11:53.194 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:52 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:11:53.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:52 smithi002 ceph-mon[30982]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T06:11:53.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:52 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:11:54.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:53 smithi002 ceph-mon[30982]: pgmap v230: 1 pgs: 1 remapped+peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:11:54.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:53 smithi090 ceph-mon[34497]: pgmap v230: 1 pgs: 1 remapped+peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:11:54.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:53 smithi089 ceph-mon[34160]: pgmap v230: 1 pgs: 1 remapped+peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:11:55.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:55 smithi090 ceph-mon[34497]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-19T06:11:56.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:55 smithi002 ceph-mon[30982]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-19T06:11:56.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:55 smithi089 ceph-mon[34160]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-19T06:11:57.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:57 smithi090 ceph-mon[34497]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-19T06:11:58.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:57 smithi002 ceph-mon[30982]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-19T06:11:58.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:57 smithi089 ceph-mon[34160]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-19T06:11:59.978 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:59 smithi090 ceph-mon[34497]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T06:11:59.978 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:59 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T06:11:59.978 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:59 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:11:59.978 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:11:59 smithi090 ceph-mon[34497]: Deploying daemon osd.11 on smithi090 2024-09-19T06:12:00.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:59 smithi002 ceph-mon[30982]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T06:12:00.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:59 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T06:12:00.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:59 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:00.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:11:59 smithi002 ceph-mon[30982]: Deploying daemon osd.11 on smithi090 2024-09-19T06:12:00.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:59 smithi089 ceph-mon[34160]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T06:12:00.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:59 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T06:12:00.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:59 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:00.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:11:59 smithi089 ceph-mon[34160]: Deploying daemon osd.11 on smithi090 2024-09-19T06:12:02.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:01 smithi002 ceph-mon[30982]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-19T06:12:02.238 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:01 smithi090 ceph-mon[34497]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-19T06:12:02.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:01 smithi089 ceph-mon[34160]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-19T06:12:03.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:03 smithi090 ceph-mon[34497]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-19T06:12:04.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:03 smithi002 ceph-mon[30982]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-19T06:12:04.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:03 smithi089 ceph-mon[34160]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-19T06:12:05.148 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:04 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:12:05.148 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:04 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:05.148 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:04 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:05.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:04 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:12:05.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:04 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:05.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:04 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:05.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:04 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:12:05.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:04 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:05.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:04 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:06.217 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:05 smithi090 ceph-mon[34497]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:12:06.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:05 smithi002 ceph-mon[30982]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:12:06.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:05 smithi089 ceph-mon[34160]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:12:08.114 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:07 smithi090 ceph-mon[34497]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:12:08.114 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:07 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:08.114 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:07 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:08.114 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:07 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:08.114 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:07 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:12:08.114 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:07 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:08.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:08.152+0000 7f975dffb640 1 -- 172.21.15.90:0/3024423405 <== mgr.14150 v2:172.21.15.2:6800/4180340554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f9760062630 con 0x7f97500a3240 2024-09-19T06:12:08.155 INFO:teuthology.orchestra.run.smithi090.stdout:Created osd(s) 11 on host 'smithi090' 2024-09-19T06:12:08.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:08.155+0000 7f9767158640 1 -- 172.21.15.90:0/3024423405 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f97500a3240 msgr2=0x7f97500a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:08.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:08.155+0000 7f9767158640 1 --2- 172.21.15.90:0/3024423405 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f97500a3240 0x7f97500a5700 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9754004770 tx=0x7f9754000bc0 comp rx=0 tx=0).stop 2024-09-19T06:12:08.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:08.155+0000 7f9767158640 1 -- 172.21.15.90:0/3024423405 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9760102690 msgr2=0x7f976019f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:08.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:08.155+0000 7f9767158640 1 --2- 172.21.15.90:0/3024423405 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9760102690 0x7f976019f160 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f975800eb10 tx=0x7f975800c2d0 comp rx=0 tx=0).stop 2024-09-19T06:12:08.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:08.155+0000 7f9767158640 1 -- 172.21.15.90:0/3024423405 shutdown_connections 2024-09-19T06:12:08.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:08.155+0000 7f9767158640 1 --2- 172.21.15.90:0/3024423405 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f97500a3240 0x7f97500a5700 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:08.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:08.155+0000 7f9767158640 1 --2- 172.21.15.90:0/3024423405 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9760102690 0x7f976019f160 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:08.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:08.155+0000 7f9767158640 1 --2- 172.21.15.90:0/3024423405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9760101cd0 0x7f976019cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:08.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:08.155+0000 7f9767158640 1 --2- 172.21.15.90:0/3024423405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9760100ad0 0x7f976006ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:08.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:08.155+0000 7f9767158640 1 -- 172.21.15.90:0/3024423405 >> 172.21.15.90:0/3024423405 conn(0x7f97600fc280 msgr2=0x7f97601051e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:08.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:08.155+0000 7f9767158640 1 -- 172.21.15.90:0/3024423405 shutdown_connections 2024-09-19T06:12:08.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:08.155+0000 7f9767158640 1 -- 172.21.15.90:0/3024423405 wait complete. 2024-09-19T06:12:08.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:07 smithi002 ceph-mon[30982]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:12:08.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:07 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:08.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:07 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:08.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:07 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:08.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:07 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:12:08.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:07 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:08.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:07 smithi089 ceph-mon[34160]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:12:08.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:07 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:08.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:07 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:08.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:07 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:08.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:07 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:12:08.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:07 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:08.772 DEBUG:teuthology.orchestra.run.smithi090:osd.11> sudo journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@osd.11.service 2024-09-19T06:12:08.775 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-19T06:12:08.775 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T06:12:09.045 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:12:09.095 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:08 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:12:09.095 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:08 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:09.095 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:08 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:09.123 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:08 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:12:09.124 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:08 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:09.124 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:08 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:09.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:08 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:12:09.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:08 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:09.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:08 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:09.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.518+0000 7f5c1db70640 1 -- 172.21.15.2:0/1390581355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c181037c0 msgr2=0x7f5c1810a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:09.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.518+0000 7f5c1db70640 1 --2- 172.21.15.2:0/1390581355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c181037c0 0x7f5c1810a050 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5c10009ca0 tx=0x7f5c1002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:12:09.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.518+0000 7f5c1db70640 1 -- 172.21.15.2:0/1390581355 shutdown_connections 2024-09-19T06:12:09.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.518+0000 7f5c1db70640 1 --2- 172.21.15.2:0/1390581355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c181037c0 0x7f5c1810a050 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:09.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.518+0000 7f5c1db70640 1 --2- 172.21.15.2:0/1390581355 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c18102e00 0x7f5c18103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:09.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.518+0000 7f5c1db70640 1 --2- 172.21.15.2:0/1390581355 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5c18101c00 0x7f5c18102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:09.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.518+0000 7f5c1db70640 1 -- 172.21.15.2:0/1390581355 >> 172.21.15.2:0/1390581355 conn(0x7f5c180fd3b0 msgr2=0x7f5c180ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:09.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.518+0000 7f5c1db70640 1 -- 172.21.15.2:0/1390581355 shutdown_connections 2024-09-19T06:12:09.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.518+0000 7f5c1db70640 1 -- 172.21.15.2:0/1390581355 wait complete. 2024-09-19T06:12:09.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.519+0000 7f5c1db70640 1 Processor -- start 2024-09-19T06:12:09.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.520+0000 7f5c1db70640 1 -- start start 2024-09-19T06:12:09.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.520+0000 7f5c1db70640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c18101c00 0x7f5c18197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:09.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.520+0000 7f5c1db70640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c18102e00 0x7f5c181982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:09.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.520+0000 7f5c1db70640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5c181037c0 0x7f5c1819f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:09.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.520+0000 7f5c1db70640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1810d710 con 0x7f5c18101c00 2024-09-19T06:12:09.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.520+0000 7f5c1db70640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1810d590 con 0x7f5c18102e00 2024-09-19T06:12:09.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.520+0000 7f5c1db70640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1810d890 con 0x7f5c181037c0 2024-09-19T06:12:09.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.520+0000 7f5c177fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c18101c00 0x7f5c18197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:09.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.520+0000 7f5c177fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c18101c00 0x7f5c18197db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59496/0 (socket says 172.21.15.2:59496) 2024-09-19T06:12:09.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.520+0000 7f5c177fe640 1 -- 172.21.15.2:0/2731535287 learned_addr learned my addr 172.21.15.2:0/2731535287 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:12:09.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.520+0000 7f5c17fff640 1 --2- 172.21.15.2:0/2731535287 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5c181037c0 0x7f5c1819f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:09.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.520+0000 7f5c16ffd640 1 --2- 172.21.15.2:0/2731535287 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c18102e00 0x7f5c181982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:09.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.520+0000 7f5c177fe640 1 -- 172.21.15.2:0/2731535287 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5c181037c0 msgr2=0x7f5c1819f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:09.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.520+0000 7f5c177fe640 1 --2- 172.21.15.2:0/2731535287 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5c181037c0 0x7f5c1819f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:09.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.520+0000 7f5c177fe640 1 -- 172.21.15.2:0/2731535287 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c18102e00 msgr2=0x7f5c181982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:09.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.520+0000 7f5c177fe640 1 --2- 172.21.15.2:0/2731535287 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c18102e00 0x7f5c181982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:09.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.520+0000 7f5c177fe640 1 -- 172.21.15.2:0/2731535287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c18074420 con 0x7f5c18101c00 2024-09-19T06:12:09.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.520+0000 7f5c177fe640 1 --2- 172.21.15.2:0/2731535287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c18101c00 0x7f5c18197db0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5c0800e9c0 tx=0x7f5c0800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:09.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.521+0000 7f5c14ff9640 1 -- 172.21.15.2:0/2731535287 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0800cd80 con 0x7f5c18101c00 2024-09-19T06:12:09.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.521+0000 7f5c14ff9640 1 -- 172.21.15.2:0/2731535287 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5c080035f0 con 0x7f5c18101c00 2024-09-19T06:12:09.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.521+0000 7f5c1db70640 1 -- 172.21.15.2:0/2731535287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c18074710 con 0x7f5c18101c00 2024-09-19T06:12:09.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.521+0000 7f5c14ff9640 1 -- 172.21.15.2:0/2731535287 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c08010690 con 0x7f5c18101c00 2024-09-19T06:12:09.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.521+0000 7f5c1db70640 1 -- 172.21.15.2:0/2731535287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c18074c50 con 0x7f5c18101c00 2024-09-19T06:12:09.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.522+0000 7f5c1db70640 1 -- 172.21.15.2:0/2731535287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c1802d7c0 con 0x7f5c18101c00 2024-09-19T06:12:09.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.523+0000 7f5c14ff9640 1 -- 172.21.15.2:0/2731535287 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f5c080037a0 con 0x7f5c18101c00 2024-09-19T06:12:09.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.524+0000 7f5c14ff9640 1 --2- 172.21.15.2:0/2731535287 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f5c040a3240 0x7f5c040a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:09.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.524+0000 7f5c16ffd640 1 --2- 172.21.15.2:0/2731535287 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f5c040a3240 0x7f5c040a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:09.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.524+0000 7f5c14ff9640 1 -- 172.21.15.2:0/2731535287 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6809+0+0 (secure 0 0 0) 0x7f5c080cf770 con 0x7f5c18101c00 2024-09-19T06:12:09.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.525+0000 7f5c16ffd640 1 --2- 172.21.15.2:0/2731535287 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f5c040a3240 0x7f5c040a5700 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5c00009bd0 tx=0x7f5c00005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:09.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.529+0000 7f5c14ff9640 1 -- 172.21.15.2:0/2731535287 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5c0809c9d0 con 0x7f5c18101c00 2024-09-19T06:12:09.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.728+0000 7f5c1db70640 1 -- 172.21.15.2:0/2731535287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f5c18108ca0 con 0x7f5c18101c00 2024-09-19T06:12:09.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.728+0000 7f5c14ff9640 1 -- 172.21.15.2:0/2731535287 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v70) ==== 74+0+133 (secure 0 0 0) 0x7f5c0809c2d0 con 0x7f5c18101c00 2024-09-19T06:12:09.730 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:12:09.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.730+0000 7f5c1db70640 1 -- 172.21.15.2:0/2731535287 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f5c040a3240 msgr2=0x7f5c040a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:09.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.730+0000 7f5c1db70640 1 --2- 172.21.15.2:0/2731535287 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f5c040a3240 0x7f5c040a5700 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5c00009bd0 tx=0x7f5c00005f90 comp rx=0 tx=0).stop 2024-09-19T06:12:09.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.730+0000 7f5c1db70640 1 -- 172.21.15.2:0/2731535287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c18101c00 msgr2=0x7f5c18197db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:09.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.730+0000 7f5c1db70640 1 --2- 172.21.15.2:0/2731535287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c18101c00 0x7f5c18197db0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5c0800e9c0 tx=0x7f5c0800ee80 comp rx=0 tx=0).stop 2024-09-19T06:12:09.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.730+0000 7f5c1db70640 1 -- 172.21.15.2:0/2731535287 shutdown_connections 2024-09-19T06:12:09.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.730+0000 7f5c1db70640 1 --2- 172.21.15.2:0/2731535287 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f5c040a3240 0x7f5c040a5700 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:09.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.730+0000 7f5c1db70640 1 --2- 172.21.15.2:0/2731535287 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5c181037c0 0x7f5c1819f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:09.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.730+0000 7f5c1db70640 1 --2- 172.21.15.2:0/2731535287 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c18102e00 0x7f5c181982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:09.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.730+0000 7f5c1db70640 1 --2- 172.21.15.2:0/2731535287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c18101c00 0x7f5c18197db0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:09.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.730+0000 7f5c1db70640 1 -- 172.21.15.2:0/2731535287 >> 172.21.15.2:0/2731535287 conn(0x7f5c180fd3b0 msgr2=0x7f5c18106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:09.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.731+0000 7f5c1db70640 1 -- 172.21.15.2:0/2731535287 shutdown_connections 2024-09-19T06:12:09.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:09.731+0000 7f5c1db70640 1 -- 172.21.15.2:0/2731535287 wait complete. 2024-09-19T06:12:10.145 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:09 smithi090 ceph-mon[34497]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:12:10.145 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:09 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/2731535287' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:12:10.186 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:09 smithi002 ceph-mon[30982]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:12:10.187 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:09 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/2731535287' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:12:10.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:09 smithi089 ceph-mon[34160]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:12:10.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:09 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/2731535287' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:12:10.534 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":70,"num_osds":12,"num_up_osds":11,"osd_up_since":1726726308,"num_in_osds":12,"osd_in_since":1726726309,"num_remapped_pgs":0} 2024-09-19T06:12:11.154 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:12:10 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:12:10.895+0000 7f1ec4d42640 -1 osd.11 0 log_to_monitors true 2024-09-19T06:12:11.536 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T06:12:11.802 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:12:12.162 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:11 smithi002 ceph-mon[30982]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:12:12.162 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:11 smithi002 ceph-mon[30982]: from='osd.11 [v2:172.21.15.90:6824/468380924,v1:172.21.15.90:6825/468380924]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T06:12:12.162 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:11 smithi002 ceph-mon[30982]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T06:12:12.162 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:11 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:12.162 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:11 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:12.162 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:11 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:12.162 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:11 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:12.162 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:11 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:12.162 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:11 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:12.162 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:11 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:12.163 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:11 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:12.163 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:11 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:12:12.163 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:11 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:12.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:11 smithi090 ceph-mon[34497]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:12:12.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:11 smithi090 ceph-mon[34497]: from='osd.11 [v2:172.21.15.90:6824/468380924,v1:172.21.15.90:6825/468380924]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T06:12:12.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:11 smithi090 ceph-mon[34497]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T06:12:12.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:11 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:12.242 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:11 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:12.242 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:11 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:12.242 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:11 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:12.242 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:11 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:12.242 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:11 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:12.242 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:11 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:12.242 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:11 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:12.242 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:11 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:12:12.242 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:11 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:12.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.241+0000 7fc01380d640 1 -- 172.21.15.2:0/3291447661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc00c100490 msgr2=0x7fc00c100890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:12.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.241+0000 7fc01380d640 1 --2- 172.21.15.2:0/3291447661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc00c100490 0x7fc00c100890 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc008009900 tx=0x7fc00802a410 comp rx=0 tx=0).stop 2024-09-19T06:12:12.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.241+0000 7fc01380d640 1 -- 172.21.15.2:0/3291447661 shutdown_connections 2024-09-19T06:12:12.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.241+0000 7fc01380d640 1 --2- 172.21.15.2:0/3291447661 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc00c101770 0x7fc00c101c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.241+0000 7fc01380d640 1 --2- 172.21.15.2:0/3291447661 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc00c100dd0 0x7fc00c101230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.241+0000 7fc01380d640 1 --2- 172.21.15.2:0/3291447661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc00c100490 0x7fc00c100890 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.241+0000 7fc01380d640 1 -- 172.21.15.2:0/3291447661 >> 172.21.15.2:0/3291447661 conn(0x7fc00c0fc2a0 msgr2=0x7fc00c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:12.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.242+0000 7fc01380d640 1 -- 172.21.15.2:0/3291447661 shutdown_connections 2024-09-19T06:12:12.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.242+0000 7fc01380d640 1 -- 172.21.15.2:0/3291447661 wait complete. 2024-09-19T06:12:12.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.242+0000 7fc01380d640 1 Processor -- start 2024-09-19T06:12:12.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.242+0000 7fc01380d640 1 -- start start 2024-09-19T06:12:12.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.242+0000 7fc01380d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc00c100490 0x7fc00c19a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:12.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.242+0000 7fc01380d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc00c100dd0 0x7fc00c19a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:12.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.242+0000 7fc01380d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc00c101770 0x7fc00c1a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:12.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.242+0000 7fc01380d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc00c10f930 con 0x7fc00c101770 2024-09-19T06:12:12.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.242+0000 7fc01380d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc00c10f7b0 con 0x7fc00c100490 2024-09-19T06:12:12.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.242+0000 7fc01380d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc00c10fab0 con 0x7fc00c100dd0 2024-09-19T06:12:12.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.243+0000 7fc011daa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc00c101770 0x7fc00c1a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:12.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.243+0000 7fc011daa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc00c101770 0x7fc00c1a15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59510/0 (socket says 172.21.15.2:59510) 2024-09-19T06:12:12.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.243+0000 7fc011daa640 1 -- 172.21.15.2:0/619137469 learned_addr learned my addr 172.21.15.2:0/619137469 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:12:12.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.243+0000 7fc010da8640 1 --2- 172.21.15.2:0/619137469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc00c100dd0 0x7fc00c19a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:12.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.243+0000 7fc0115a9640 1 --2- 172.21.15.2:0/619137469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc00c100490 0x7fc00c19a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:12.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.243+0000 7fc011daa640 1 -- 172.21.15.2:0/619137469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc00c100dd0 msgr2=0x7fc00c19a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:12.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.243+0000 7fc011daa640 1 --2- 172.21.15.2:0/619137469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc00c100dd0 0x7fc00c19a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.243+0000 7fc011daa640 1 -- 172.21.15.2:0/619137469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc00c100490 msgr2=0x7fc00c19a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:12.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.243+0000 7fc011daa640 1 --2- 172.21.15.2:0/619137469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc00c100490 0x7fc00c19a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.243+0000 7fc011daa640 1 -- 172.21.15.2:0/619137469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc00c1a1c50 con 0x7fc00c101770 2024-09-19T06:12:12.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.243+0000 7fc011daa640 1 --2- 172.21.15.2:0/619137469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc00c101770 0x7fc00c1a15e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc00400eb10 tx=0x7fc00400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:12.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.243+0000 7fc0027fc640 1 -- 172.21.15.2:0/619137469 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc004004b20 con 0x7fc00c101770 2024-09-19T06:12:12.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.243+0000 7fc0027fc640 1 -- 172.21.15.2:0/619137469 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc004004cc0 con 0x7fc00c101770 2024-09-19T06:12:12.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.243+0000 7fc01380d640 1 -- 172.21.15.2:0/619137469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc00c1a1f40 con 0x7fc00c101770 2024-09-19T06:12:12.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.243+0000 7fc0027fc640 1 -- 172.21.15.2:0/619137469 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc004010690 con 0x7fc00c101770 2024-09-19T06:12:12.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.243+0000 7fc01380d640 1 -- 172.21.15.2:0/619137469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc00c1a23f0 con 0x7fc00c101770 2024-09-19T06:12:12.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.244+0000 7fc01380d640 1 -- 172.21.15.2:0/619137469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc00c10b1e0 con 0x7fc00c101770 2024-09-19T06:12:12.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.245+0000 7fc0027fc640 1 -- 172.21.15.2:0/619137469 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fc004005000 con 0x7fc00c101770 2024-09-19T06:12:12.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.246+0000 7fc0027fc640 1 --2- 172.21.15.2:0/619137469 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fbff80a3270 0x7fbff80a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:12.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.246+0000 7fc0115a9640 1 --2- 172.21.15.2:0/619137469 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fbff80a3270 0x7fbff80a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:12.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.246+0000 7fc0027fc640 1 -- 172.21.15.2:0/619137469 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6831+0+0 (secure 0 0 0) 0x7fc0040cfae0 con 0x7fc00c101770 2024-09-19T06:12:12.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.247+0000 7fc0115a9640 1 --2- 172.21.15.2:0/619137469 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fbff80a3270 0x7fbff80a5730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc008006010 tx=0x7fc008000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:12.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.249+0000 7fc0027fc640 1 -- 172.21.15.2:0/619137469 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc004054210 con 0x7fc00c101770 2024-09-19T06:12:12.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:11 smithi089 ceph-mon[34160]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:12:12.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:11 smithi089 ceph-mon[34160]: from='osd.11 [v2:172.21.15.90:6824/468380924,v1:172.21.15.90:6825/468380924]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T06:12:12.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:11 smithi089 ceph-mon[34160]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T06:12:12.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:11 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:12.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:11 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:12.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:11 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:12.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:11 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:12.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:11 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:12.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:11 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:12.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:11 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:12.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:11 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:12.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:11 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:12:12.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:11 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:12.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.425+0000 7fc01380d640 1 -- 172.21.15.2:0/619137469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fc00c02da10 con 0x7fc00c101770 2024-09-19T06:12:12.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.425+0000 7fc0027fc640 1 -- 172.21.15.2:0/619137469 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v71) ==== 74+0+133 (secure 0 0 0) 0x7fc00409cd30 con 0x7fc00c101770 2024-09-19T06:12:12.428 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:12:12.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.427+0000 7fc01380d640 1 -- 172.21.15.2:0/619137469 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fbff80a3270 msgr2=0x7fbff80a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:12.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.427+0000 7fc01380d640 1 --2- 172.21.15.2:0/619137469 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fbff80a3270 0x7fbff80a5730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc008006010 tx=0x7fc008000bc0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.427+0000 7fc01380d640 1 -- 172.21.15.2:0/619137469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc00c101770 msgr2=0x7fc00c1a15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:12.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.427+0000 7fc01380d640 1 --2- 172.21.15.2:0/619137469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc00c101770 0x7fc00c1a15e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc00400eb10 tx=0x7fc00400c2d0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.428+0000 7fc01380d640 1 -- 172.21.15.2:0/619137469 shutdown_connections 2024-09-19T06:12:12.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.428+0000 7fc01380d640 1 --2- 172.21.15.2:0/619137469 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fbff80a3270 0x7fbff80a5730 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.428+0000 7fc01380d640 1 --2- 172.21.15.2:0/619137469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc00c101770 0x7fc00c1a15e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.428+0000 7fc01380d640 1 --2- 172.21.15.2:0/619137469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc00c100dd0 0x7fc00c19a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.428+0000 7fc01380d640 1 --2- 172.21.15.2:0/619137469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc00c100490 0x7fc00c19a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.428+0000 7fc01380d640 1 -- 172.21.15.2:0/619137469 >> 172.21.15.2:0/619137469 conn(0x7fc00c0fc2a0 msgr2=0x7fc00c0fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:12.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.428+0000 7fc01380d640 1 -- 172.21.15.2:0/619137469 shutdown_connections 2024-09-19T06:12:12.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:12.428+0000 7fc01380d640 1 -- 172.21.15.2:0/619137469 wait complete. 2024-09-19T06:12:12.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:12 smithi002 ceph-mon[30982]: Detected new or changed devices on smithi090 2024-09-19T06:12:12.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:12 smithi002 ceph-mon[30982]: Adjusting osd_memory_target on smithi090 to 4272M 2024-09-19T06:12:12.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:12 smithi002 ceph-mon[30982]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T06:12:12.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:12 smithi002 ceph-mon[30982]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T06:12:12.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:12 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:12:12.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:12 smithi002 ceph-mon[30982]: from='osd.11 [v2:172.21.15.90:6824/468380924,v1:172.21.15.90:6825/468380924]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-09-19T06:12:12.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:12 smithi002 ceph-mon[30982]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-09-19T06:12:12.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:12 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/619137469' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:12:13.186 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":71,"num_osds":12,"num_up_osds":11,"osd_up_since":1726726308,"num_in_osds":12,"osd_in_since":1726726309,"num_remapped_pgs":0} 2024-09-19T06:12:13.240 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:12:12 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:12:12.862+0000 7f1ec04a2640 -1 osd.11 0 waiting for initial osdmap 2024-09-19T06:12:13.240 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:12:12 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:12:12.877+0000 7f1ebcadc640 -1 osd.11 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:12:13.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:12 smithi090 ceph-mon[34497]: Detected new or changed devices on smithi090 2024-09-19T06:12:13.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:12 smithi090 ceph-mon[34497]: Adjusting osd_memory_target on smithi090 to 4272M 2024-09-19T06:12:13.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:12 smithi090 ceph-mon[34497]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T06:12:13.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:12 smithi090 ceph-mon[34497]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T06:12:13.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:12 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:12:13.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:12 smithi090 ceph-mon[34497]: from='osd.11 [v2:172.21.15.90:6824/468380924,v1:172.21.15.90:6825/468380924]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-09-19T06:12:13.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:12 smithi090 ceph-mon[34497]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-09-19T06:12:13.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:12 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/619137469' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:12:13.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:12 smithi089 ceph-mon[34160]: Detected new or changed devices on smithi090 2024-09-19T06:12:13.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:12 smithi089 ceph-mon[34160]: Adjusting osd_memory_target on smithi090 to 4272M 2024-09-19T06:12:13.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:12 smithi089 ceph-mon[34160]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T06:12:13.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:12 smithi089 ceph-mon[34160]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T06:12:13.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:12 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:12:13.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:12 smithi089 ceph-mon[34160]: from='osd.11 [v2:172.21.15.90:6824/468380924,v1:172.21.15.90:6825/468380924]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-09-19T06:12:13.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:12 smithi089 ceph-mon[34160]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]: dispatch 2024-09-19T06:12:13.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:12 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/619137469' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:12:14.188 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T06:12:14.218 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:13 smithi002 ceph-mon[30982]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:12:14.218 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:13 smithi002 ceph-mon[30982]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]': finished 2024-09-19T06:12:14.218 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:13 smithi002 ceph-mon[30982]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T06:12:14.218 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:13 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:12:14.218 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:13 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:12:14.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:13 smithi090 ceph-mon[34497]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:12:14.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:13 smithi090 ceph-mon[34497]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]': finished 2024-09-19T06:12:14.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:13 smithi090 ceph-mon[34497]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T06:12:14.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:13 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:12:14.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:13 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:12:14.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:13 smithi089 ceph-mon[34160]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:12:14.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:13 smithi089 ceph-mon[34160]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]': finished 2024-09-19T06:12:14.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:13 smithi089 ceph-mon[34160]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T06:12:14.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:13 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:12:14.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:13 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:12:14.457 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:12:14.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:14.900+0000 7f1c585af640 1 -- 172.21.15.2:0/3904515506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c501037c0 msgr2=0x7f1c5010a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:14.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:14.900+0000 7f1c585af640 1 --2- 172.21.15.2:0/3904515506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c501037c0 0x7f1c5010a050 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1c48009ca0 tx=0x7f1c4802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:12:14.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:14.900+0000 7f1c585af640 1 -- 172.21.15.2:0/3904515506 shutdown_connections 2024-09-19T06:12:14.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:14.900+0000 7f1c585af640 1 --2- 172.21.15.2:0/3904515506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c501037c0 0x7f1c5010a050 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:14.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:14.900+0000 7f1c585af640 1 --2- 172.21.15.2:0/3904515506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c50102e00 0x7f1c50103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:14.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:14.900+0000 7f1c585af640 1 --2- 172.21.15.2:0/3904515506 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1c50101c00 0x7f1c50102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:14.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:14.900+0000 7f1c585af640 1 -- 172.21.15.2:0/3904515506 >> 172.21.15.2:0/3904515506 conn(0x7f1c500fd390 msgr2=0x7f1c500ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:14.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:14.900+0000 7f1c585af640 1 -- 172.21.15.2:0/3904515506 shutdown_connections 2024-09-19T06:12:14.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:14.900+0000 7f1c585af640 1 -- 172.21.15.2:0/3904515506 wait complete. 2024-09-19T06:12:14.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:14.901+0000 7f1c585af640 1 Processor -- start 2024-09-19T06:12:14.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:14.901+0000 7f1c585af640 1 -- start start 2024-09-19T06:12:14.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:14.901+0000 7f1c585af640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1c50101c00 0x7f1c50197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:14.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:14.901+0000 7f1c585af640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c50102e00 0x7f1c50198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:14.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:14.901+0000 7f1c585af640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c501037c0 0x7f1c5019f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:14.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:14.901+0000 7f1c585af640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1c5010d730 con 0x7f1c501037c0 2024-09-19T06:12:14.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:14.901+0000 7f1c585af640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f1c5010d5b0 con 0x7f1c50102e00 2024-09-19T06:12:14.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:14.901+0000 7f1c585af640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1c5010d8b0 con 0x7f1c50101c00 2024-09-19T06:12:14.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:14.901+0000 7f1c56b4c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c501037c0 0x7f1c5019f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:14.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:14.901+0000 7f1c55b4a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c50102e00 0x7f1c50198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:14.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:14.901+0000 7f1c56b4c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c501037c0 0x7f1c5019f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59522/0 (socket says 172.21.15.2:59522) 2024-09-19T06:12:14.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:14.901+0000 7f1c56b4c640 1 -- 172.21.15.2:0/1230700287 learned_addr learned my addr 172.21.15.2:0/1230700287 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:12:14.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:14.901+0000 7f1c5634b640 1 --2- 172.21.15.2:0/1230700287 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1c50101c00 0x7f1c50197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:14.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:14.902+0000 7f1c56b4c640 1 -- 172.21.15.2:0/1230700287 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1c50101c00 msgr2=0x7f1c50197dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:14.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:14.902+0000 7f1c56b4c640 1 --2- 172.21.15.2:0/1230700287 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1c50101c00 0x7f1c50197dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:14.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:14.902+0000 7f1c56b4c640 1 -- 172.21.15.2:0/1230700287 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c50102e00 msgr2=0x7f1c50198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:14.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:14.902+0000 7f1c56b4c640 1 --2- 172.21.15.2:0/1230700287 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c50102e00 0x7f1c50198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:14.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:14.902+0000 7f1c56b4c640 1 -- 172.21.15.2:0/1230700287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c5019f9f0 con 0x7f1c501037c0 2024-09-19T06:12:14.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:14.902+0000 7f1c55b4a640 1 --2- 172.21.15.2:0/1230700287 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c50102e00 0x7f1c50198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:14.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:14.902+0000 7f1c56b4c640 1 --2- 172.21.15.2:0/1230700287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c501037c0 0x7f1c5019f380 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1c48009dc0 tx=0x7f1c48003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:14.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:14.902+0000 7f1c477fe640 1 -- 172.21.15.2:0/1230700287 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c48032ec0 con 0x7f1c501037c0 2024-09-19T06:12:14.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:14.902+0000 7f1c477fe640 1 -- 172.21.15.2:0/1230700287 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1c480044f0 con 0x7f1c501037c0 2024-09-19T06:12:14.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:14.902+0000 7f1c585af640 1 -- 172.21.15.2:0/1230700287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c5019fc80 con 0x7f1c501037c0 2024-09-19T06:12:14.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:14.902+0000 7f1c477fe640 1 -- 172.21.15.2:0/1230700287 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c48030d40 con 0x7f1c501037c0 2024-09-19T06:12:14.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:14.902+0000 7f1c585af640 1 -- 172.21.15.2:0/1230700287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c501a01c0 con 0x7f1c501037c0 2024-09-19T06:12:14.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:14.903+0000 7f1c585af640 1 -- 172.21.15.2:0/1230700287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c50109050 con 0x7f1c501037c0 2024-09-19T06:12:14.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:14.905+0000 7f1c477fe640 1 -- 172.21.15.2:0/1230700287 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f1c48004040 con 0x7f1c501037c0 2024-09-19T06:12:14.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:14.905+0000 7f1c477fe640 1 --2- 172.21.15.2:0/1230700287 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f1c3c0a3410 0x7f1c3c0a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:14.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:14.905+0000 7f1c477fe640 1 -- 172.21.15.2:0/1230700287 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f1c480f0af0 con 0x7f1c501037c0 2024-09-19T06:12:14.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:14.905+0000 7f1c5634b640 1 --2- 172.21.15.2:0/1230700287 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f1c3c0a3410 0x7f1c3c0a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:14.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:14.906+0000 7f1c5634b640 1 --2- 172.21.15.2:0/1230700287 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f1c3c0a3410 0x7f1c3c0a58d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1c50102c60 tx=0x7f1c4c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:14.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:14.908+0000 7f1c477fe640 1 -- 172.21.15.2:0/1230700287 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1c480bdcb0 con 0x7f1c501037c0 2024-09-19T06:12:15.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:15.084+0000 7f1c585af640 1 -- 172.21.15.2:0/1230700287 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f1c5002da10 con 0x7f1c501037c0 2024-09-19T06:12:15.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:15.084+0000 7f1c477fe640 1 -- 172.21.15.2:0/1230700287 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v74) ==== 74+0+133 (secure 0 0 0) 0x7f1c480bd5b0 con 0x7f1c501037c0 2024-09-19T06:12:15.086 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:12:15.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:15.086+0000 7f1c585af640 1 -- 172.21.15.2:0/1230700287 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f1c3c0a3410 msgr2=0x7f1c3c0a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:15.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:15.086+0000 7f1c585af640 1 --2- 172.21.15.2:0/1230700287 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f1c3c0a3410 0x7f1c3c0a58d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1c50102c60 tx=0x7f1c4c00a2d0 comp rx=0 tx=0).stop 2024-09-19T06:12:15.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:15.086+0000 7f1c585af640 1 -- 172.21.15.2:0/1230700287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c501037c0 msgr2=0x7f1c5019f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:15.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:15.086+0000 7f1c585af640 1 --2- 172.21.15.2:0/1230700287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c501037c0 0x7f1c5019f380 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1c48009dc0 tx=0x7f1c48003ba0 comp rx=0 tx=0).stop 2024-09-19T06:12:15.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:15.086+0000 7f1c585af640 1 -- 172.21.15.2:0/1230700287 shutdown_connections 2024-09-19T06:12:15.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:15.086+0000 7f1c585af640 1 --2- 172.21.15.2:0/1230700287 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f1c3c0a3410 0x7f1c3c0a58d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:15.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:15.086+0000 7f1c585af640 1 --2- 172.21.15.2:0/1230700287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c501037c0 0x7f1c5019f380 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:15.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:15.086+0000 7f1c585af640 1 --2- 172.21.15.2:0/1230700287 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c50102e00 0x7f1c50198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:15.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:15.086+0000 7f1c585af640 1 --2- 172.21.15.2:0/1230700287 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1c50101c00 0x7f1c50197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:15.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:15.086+0000 7f1c585af640 1 -- 172.21.15.2:0/1230700287 >> 172.21.15.2:0/1230700287 conn(0x7f1c500fd390 msgr2=0x7f1c50106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:15.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:15.087+0000 7f1c585af640 1 -- 172.21.15.2:0/1230700287 shutdown_connections 2024-09-19T06:12:15.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:15.087+0000 7f1c585af640 1 -- 172.21.15.2:0/1230700287 wait complete. 2024-09-19T06:12:15.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:14 smithi002 ceph-mon[30982]: purged_snaps scrub starts 2024-09-19T06:12:15.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:14 smithi002 ceph-mon[30982]: purged_snaps scrub ok 2024-09-19T06:12:15.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:14 smithi002 ceph-mon[30982]: osd.11 [v2:172.21.15.90:6824/468380924,v1:172.21.15.90:6825/468380924] boot 2024-09-19T06:12:15.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:14 smithi002 ceph-mon[30982]: osdmap e73: 12 total, 12 up, 12 in 2024-09-19T06:12:15.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:14 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:12:15.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:14 smithi090 ceph-mon[34497]: purged_snaps scrub starts 2024-09-19T06:12:15.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:14 smithi090 ceph-mon[34497]: purged_snaps scrub ok 2024-09-19T06:12:15.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:14 smithi090 ceph-mon[34497]: osd.11 [v2:172.21.15.90:6824/468380924,v1:172.21.15.90:6825/468380924] boot 2024-09-19T06:12:15.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:14 smithi090 ceph-mon[34497]: osdmap e73: 12 total, 12 up, 12 in 2024-09-19T06:12:15.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:14 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:12:15.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:14 smithi089 ceph-mon[34160]: purged_snaps scrub starts 2024-09-19T06:12:15.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:14 smithi089 ceph-mon[34160]: purged_snaps scrub ok 2024-09-19T06:12:15.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:14 smithi089 ceph-mon[34160]: osd.11 [v2:172.21.15.90:6824/468380924,v1:172.21.15.90:6825/468380924] boot 2024-09-19T06:12:15.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:14 smithi089 ceph-mon[34160]: osdmap e73: 12 total, 12 up, 12 in 2024-09-19T06:12:15.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:14 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:12:15.844 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":74,"num_osds":12,"num_up_osds":12,"osd_up_since":1726726333,"num_in_osds":12,"osd_in_since":1726726309,"num_remapped_pgs":0} 2024-09-19T06:12:15.845 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:12:16.139 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:12:16.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:15 smithi002 ceph-mon[30982]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:16.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:15 smithi002 ceph-mon[30982]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T06:12:16.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:15 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1230700287' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:12:16.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:15 smithi090 ceph-mon[34497]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:16.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:15 smithi090 ceph-mon[34497]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T06:12:16.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:15 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1230700287' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:12:16.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:15 smithi089 ceph-mon[34160]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:16.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:15 smithi089 ceph-mon[34160]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T06:12:16.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:15 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1230700287' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:12:16.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.587+0000 7ff69b48a640 1 -- 172.21.15.2:0/3513393415 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff694102ef0 msgr2=0x7ff69410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:16.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.587+0000 7ff69b48a640 1 --2- 172.21.15.2:0/3513393415 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff694102ef0 0x7ff69410da40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff68c009ca0 tx=0x7ff68c02a950 comp rx=0 tx=0).stop 2024-09-19T06:12:16.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.587+0000 7ff69b48a640 1 -- 172.21.15.2:0/3513393415 shutdown_connections 2024-09-19T06:12:16.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.587+0000 7ff69b48a640 1 --2- 172.21.15.2:0/3513393415 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff694102ef0 0x7ff69410da40 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:16.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.587+0000 7ff69b48a640 1 --2- 172.21.15.2:0/3513393415 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff694102570 0x7ff6941029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:16.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.587+0000 7ff69b48a640 1 --2- 172.21.15.2:0/3513393415 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff694100e20 0x7ff694101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:16.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.587+0000 7ff69b48a640 1 -- 172.21.15.2:0/3513393415 >> 172.21.15.2:0/3513393415 conn(0x7ff6940fc7d0 msgr2=0x7ff6940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:16.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.587+0000 7ff69b48a640 1 -- 172.21.15.2:0/3513393415 shutdown_connections 2024-09-19T06:12:16.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.587+0000 7ff69b48a640 1 -- 172.21.15.2:0/3513393415 wait complete. 2024-09-19T06:12:16.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.587+0000 7ff69b48a640 1 Processor -- start 2024-09-19T06:12:16.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.588+0000 7ff69b48a640 1 -- start start 2024-09-19T06:12:16.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.588+0000 7ff69b48a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff694100e20 0x7ff69410e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:16.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.588+0000 7ff69b48a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff694102570 0x7ff69410ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:16.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.588+0000 7ff69b48a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff694102ef0 0x7ff69410ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:16.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.588+0000 7ff69b48a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff694111f50 con 0x7ff694100e20 2024-09-19T06:12:16.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.588+0000 7ff69b48a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff694111dd0 con 0x7ff694102570 2024-09-19T06:12:16.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.588+0000 7ff69b48a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff6941120d0 con 0x7ff694102ef0 2024-09-19T06:12:16.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.588+0000 7ff699226640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff694100e20 0x7ff69410e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:16.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.588+0000 7ff699226640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff694100e20 0x7ff69410e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55960/0 (socket says 172.21.15.2:55960) 2024-09-19T06:12:16.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.588+0000 7ff699226640 1 -- 172.21.15.2:0/2198469952 learned_addr learned my addr 172.21.15.2:0/2198469952 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:12:16.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.588+0000 7ff698a25640 1 --2- 172.21.15.2:0/2198469952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff694102570 0x7ff69410ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:16.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.588+0000 7ff699a27640 1 --2- 172.21.15.2:0/2198469952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff694102ef0 0x7ff69410ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:16.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.588+0000 7ff699226640 1 -- 172.21.15.2:0/2198469952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff694102ef0 msgr2=0x7ff69410ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:16.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.588+0000 7ff699226640 1 --2- 172.21.15.2:0/2198469952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff694102ef0 0x7ff69410ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:16.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.588+0000 7ff699226640 1 -- 172.21.15.2:0/2198469952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff694102570 msgr2=0x7ff69410ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:16.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.588+0000 7ff699226640 1 --2- 172.21.15.2:0/2198469952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff694102570 0x7ff69410ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:16.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.588+0000 7ff699226640 1 -- 172.21.15.2:0/2198469952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6941a6970 con 0x7ff694100e20 2024-09-19T06:12:16.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.588+0000 7ff698a25640 1 --2- 172.21.15.2:0/2198469952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff694102570 0x7ff69410ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:12:16.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.589+0000 7ff699226640 1 --2- 172.21.15.2:0/2198469952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff694100e20 0x7ff69410e4d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff69000b4a0 tx=0x7ff69000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:16.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.589+0000 7ff6867fc640 1 -- 172.21.15.2:0/2198469952 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff690014070 con 0x7ff694100e20 2024-09-19T06:12:16.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.589+0000 7ff6867fc640 1 -- 172.21.15.2:0/2198469952 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff690010ac0 con 0x7ff694100e20 2024-09-19T06:12:16.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.589+0000 7ff69b48a640 1 -- 172.21.15.2:0/2198469952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6941a6c60 con 0x7ff694100e20 2024-09-19T06:12:16.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.589+0000 7ff6867fc640 1 -- 172.21.15.2:0/2198469952 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff690017c30 con 0x7ff694100e20 2024-09-19T06:12:16.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.589+0000 7ff69b48a640 1 -- 172.21.15.2:0/2198469952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6941a71a0 con 0x7ff694100e20 2024-09-19T06:12:16.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.590+0000 7ff69b48a640 1 -- 172.21.15.2:0/2198469952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff694101200 con 0x7ff694100e20 2024-09-19T06:12:16.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.591+0000 7ff6867fc640 1 -- 172.21.15.2:0/2198469952 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7ff690017070 con 0x7ff694100e20 2024-09-19T06:12:16.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.591+0000 7ff6867fc640 1 --2- 172.21.15.2:0/2198469952 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7ff6800a3240 0x7ff6800a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:16.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.592+0000 7ff698a25640 1 --2- 172.21.15.2:0/2198469952 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7ff6800a3240 0x7ff6800a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:16.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.592+0000 7ff6867fc640 1 -- 172.21.15.2:0/2198469952 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7ff6900cebf0 con 0x7ff694100e20 2024-09-19T06:12:16.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.592+0000 7ff698a25640 1 --2- 172.21.15.2:0/2198469952 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7ff6800a3240 0x7ff6800a5700 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff69410ff60 tx=0x7ff688005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:16.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.596+0000 7ff6867fc640 1 -- 172.21.15.2:0/2198469952 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff69009bdb0 con 0x7ff694100e20 2024-09-19T06:12:16.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.774+0000 7ff69b48a640 1 -- 172.21.15.2:0/2198469952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff69410fa00 con 0x7ff694100e20 2024-09-19T06:12:16.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.775+0000 7ff6867fc640 1 -- 172.21.15.2:0/2198469952 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+18315 (secure 0 0 0) 0x7ff69009b6b0 con 0x7ff694100e20 2024-09-19T06:12:16.777 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:12:16.777 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":74,"fsid":"078f6612-764d-11ef-bceb-c7b262605968","created":"2024-09-19T06:05:17.607927+0000","modified":"2024-09-19T06:12:14.865228+0000","last_up_change":"2024-09-19T06:12:13.856684+0000","last_in_change":"2024-09-19T06:11:49.745266+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:08:28.425566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0de97a3d-2d27-455b-9998-ddd2319c148d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6803","nonce":915165910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6805","nonce":915165910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6809","nonce":915165910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6807","nonce":915165910}]},"public_addr":"172.21.15.2:6803/915165910","cluster_addr":"172.21.15.2:6805/915165910","heartbeat_back_addr":"172.21.15.2:6809/915165910","heartbeat_front_addr":"172.21.15.2:6807/915165910","state":["exists","up"]},{"osd":1,"uuid":"056d229e-2de4-4902-922e-21e1a5d3f061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6801","nonce":4097264171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6803","nonce":4097264171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6807","nonce":4097264171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6805","nonce":4097264171}]},"public_addr":"172.21.15.89:6801/4097264171","cluster_addr":"172.21.15.89:6803/4097264171","heartbeat_back_addr":"172.21.15.89:6807/4097264171","heartbeat_front_addr":"172.21.15.89:6805/4097264171","state":["exists","up"]},{"osd":2,"uuid":"2a4e7147-4125-4ee6-b5ad-85518d7066d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6801","nonce":1479908200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6803","nonce":1479908200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6807","nonce":1479908200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6805","nonce":1479908200}]},"public_addr":"172.21.15.90:6801/1479908200","cluster_addr":"172.21.15.90:6803/1479908200","heartbeat_back_addr":"172.21.15.90:6807/1479908200","heartbeat_front_addr":"172.21.15.90:6805/1479908200","state":["exists","up"]},{"osd":3,"uuid":"7b3da775-0f0a-4b46-a8dc-9ec822a54301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6811","nonce":1796948193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6813","nonce":1796948193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6817","nonce":1796948193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6815","nonce":1796948193}]},"public_addr":"172.21.15.2:6811/1796948193","cluster_addr":"172.21.15.2:6813/1796948193","heartbeat_back_addr":"172.21.15.2:6817/1796948193","heartbeat_front_addr":"172.21.15.2:6815/1796948193","state":["exists","up"]},{"osd":4,"uuid":"d4c8bafc-c844-4ff1-a3d8-7a53576e6b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6809","nonce":4256848315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6811","nonce":4256848315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6815","nonce":4256848315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6813","nonce":4256848315}]},"public_addr":"172.21.15.89:6809/4256848315","cluster_addr":"172.21.15.89:6811/4256848315","heartbeat_back_addr":"172.21.15.89:6815/4256848315","heartbeat_front_addr":"172.21.15.89:6813/4256848315","state":["exists","up"]},{"osd":5,"uuid":"8dc9bb55-29e0-4b04-9415-3b9bb5ed05cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6809","nonce":189855967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6811","nonce":189855967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6815","nonce":189855967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6813","nonce":189855967}]},"public_addr":"172.21.15.90:6809/189855967","cluster_addr":"172.21.15.90:6811/189855967","heartbeat_back_addr":"172.21.15.90:6815/189855967","heartbeat_front_addr":"172.21.15.90:6813/189855967","state":["exists","up"]},{"osd":6,"uuid":"86d1443a-9b43-46de-abd7-4c95b43207f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6819","nonce":3886336279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6821","nonce":3886336279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6825","nonce":3886336279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6823","nonce":3886336279}]},"public_addr":"172.21.15.2:6819/3886336279","cluster_addr":"172.21.15.2:6821/3886336279","heartbeat_back_addr":"172.21.15.2:6825/3886336279","heartbeat_front_addr":"172.21.15.2:6823/3886336279","state":["exists","up"]},{"osd":7,"uuid":"1cc5554c-80d2-4e77-b29a-fd2ada68d82d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6817","nonce":508513510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6819","nonce":508513510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6823","nonce":508513510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6821","nonce":508513510}]},"public_addr":"172.21.15.89:6817/508513510","cluster_addr":"172.21.15.89:6819/508513510","heartbeat_back_addr":"172.21.15.89:6823/508513510","heartbeat_front_addr":"172.21.15.89:6821/508513510","state":["exists","up"]},{"osd":8,"uuid":"e9b2eb92-9af2-4f26-a259-fcaf972e4fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6817","nonce":3558544480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6819","nonce":3558544480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6823","nonce":3558544480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6821","nonce":3558544480}]},"public_addr":"172.21.15.90:6817/3558544480","cluster_addr":"172.21.15.90:6819/3558544480","heartbeat_back_addr":"172.21.15.90:6823/3558544480","heartbeat_front_addr":"172.21.15.90:6821/3558544480","state":["exists","up"]},{"osd":9,"uuid":"194d4c64-dd29-4d35-bc54-0858c44815cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6827","nonce":2690758100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6829","nonce":2690758100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6833","nonce":2690758100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6831","nonce":2690758100}]},"public_addr":"172.21.15.2:6827/2690758100","cluster_addr":"172.21.15.2:6829/2690758100","heartbeat_back_addr":"172.21.15.2:6833/2690758100","heartbeat_front_addr":"172.21.15.2:6831/2690758100","state":["exists","up"]},{"osd":10,"uuid":"7695fa4a-b94e-4afc-b166-690a197ad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6825","nonce":1141925395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6827","nonce":1141925395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6831","nonce":1141925395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6829","nonce":1141925395}]},"public_addr":"172.21.15.89:6825/1141925395","cluster_addr":"172.21.15.89:6827/1141925395","heartbeat_back_addr":"172.21.15.89:6831/1141925395","heartbeat_front_addr":"172.21.15.89:6829/1141925395","state":["exists","up"]},{"osd":11,"uuid":"1815a999-bfdb-46b9-afcd-632ee8ba56d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6825","nonce":468380924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6827","nonce":468380924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6831","nonce":468380924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6829","nonce":468380924}]},"public_addr":"172.21.15.90:6825/468380924","cluster_addr":"172.21.15.90:6827/468380924","heartbeat_back_addr":"172.21.15.90:6831/468380924","heartbeat_front_addr":"172.21.15.90:6829/468380924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:07:36.125754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:01.415356+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:26.420808+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:51.722673+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:09:16.562300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:09:41.958465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:10:07.056167+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:10:32.066195+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:10:56.497875+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:11:21.973083+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:11:46.891515+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:12:11.910012+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/874985787":"2024-09-20T06:06:11.912585+0000","172.21.15.2:0/1280963020":"2024-09-20T06:06:11.912585+0000","172.21.15.2:0/2976372536":"2024-09-20T06:06:11.912585+0000","172.21.15.2:6801/1602650352":"2024-09-20T06:05:47.538477+0000","172.21.15.2:6800/1602650352":"2024-09-20T06:05:47.538477+0000","172.21.15.2:6800/1200011821":"2024-09-20T06:06:11.912585+0000","172.21.15.2:0/3899165140":"2024-09-20T06:05:47.538477+0000","172.21.15.2:6801/1200011821":"2024-09-20T06:06:11.912585+0000","172.21.15.2:0/1361067708":"2024-09-20T06:05:47.538477+0000","172.21.15.2:0/3763089457":"2024-09-20T06:05:47.538477+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:12:16.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.777+0000 7ff69b48a640 1 -- 172.21.15.2:0/2198469952 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7ff6800a3240 msgr2=0x7ff6800a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:16.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.777+0000 7ff69b48a640 1 --2- 172.21.15.2:0/2198469952 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7ff6800a3240 0x7ff6800a5700 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff69410ff60 tx=0x7ff688005d30 comp rx=0 tx=0).stop 2024-09-19T06:12:16.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.777+0000 7ff69b48a640 1 -- 172.21.15.2:0/2198469952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff694100e20 msgr2=0x7ff69410e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:16.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.777+0000 7ff69b48a640 1 --2- 172.21.15.2:0/2198469952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff694100e20 0x7ff69410e4d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff69000b4a0 tx=0x7ff69000b960 comp rx=0 tx=0).stop 2024-09-19T06:12:16.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.777+0000 7ff69b48a640 1 -- 172.21.15.2:0/2198469952 shutdown_connections 2024-09-19T06:12:16.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.777+0000 7ff69b48a640 1 --2- 172.21.15.2:0/2198469952 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7ff6800a3240 0x7ff6800a5700 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:16.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.777+0000 7ff69b48a640 1 --2- 172.21.15.2:0/2198469952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff694102ef0 0x7ff69410ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:16.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.777+0000 7ff69b48a640 1 --2- 172.21.15.2:0/2198469952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff694102570 0x7ff69410ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:16.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.777+0000 7ff69b48a640 1 --2- 172.21.15.2:0/2198469952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff694100e20 0x7ff69410e4d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:16.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.777+0000 7ff69b48a640 1 -- 172.21.15.2:0/2198469952 >> 172.21.15.2:0/2198469952 conn(0x7ff6940fc7d0 msgr2=0x7ff6940febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:16.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.777+0000 7ff69b48a640 1 -- 172.21.15.2:0/2198469952 shutdown_connections 2024-09-19T06:12:16.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:16.777+0000 7ff69b48a640 1 -- 172.21.15.2:0/2198469952 wait complete. 2024-09-19T06:12:17.078 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:16 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/2198469952' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:12:17.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:16 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/2198469952' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:12:17.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:16 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/2198469952' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:12:17.433 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T06:08:28.425566+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T06:12:17.434 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-19T06:12:17.686 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:12:18.117 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:17 smithi002 ceph-mon[30982]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:18.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.114+0000 7f80ed6e6640 1 -- 172.21.15.2:0/2951873138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80e8108300 msgr2=0x7f80e810ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:18.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.114+0000 7f80ed6e6640 1 --2- 172.21.15.2:0/2951873138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80e8108300 0x7f80e810ec70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f80e0009930 tx=0x7f80e002a420 comp rx=0 tx=0).stop 2024-09-19T06:12:18.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.115+0000 7f80ed6e6640 1 -- 172.21.15.2:0/2951873138 shutdown_connections 2024-09-19T06:12:18.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.115+0000 7f80ed6e6640 1 --2- 172.21.15.2:0/2951873138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80e8108300 0x7f80e810ec70 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:18.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.115+0000 7f80ed6e6640 1 --2- 172.21.15.2:0/2951873138 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80e8103780 0x7f80e8107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:18.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.115+0000 7f80ed6e6640 1 --2- 172.21.15.2:0/2951873138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80e8102dd0 0x7f80e81031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:18.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.115+0000 7f80ed6e6640 1 -- 172.21.15.2:0/2951873138 >> 172.21.15.2:0/2951873138 conn(0x7f80e80fc7d0 msgr2=0x7f80e80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:18.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.115+0000 7f80ed6e6640 1 -- 172.21.15.2:0/2951873138 shutdown_connections 2024-09-19T06:12:18.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.115+0000 7f80ed6e6640 1 -- 172.21.15.2:0/2951873138 wait complete. 2024-09-19T06:12:18.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.115+0000 7f80ed6e6640 1 Processor -- start 2024-09-19T06:12:18.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.115+0000 7f80ed6e6640 1 -- start start 2024-09-19T06:12:18.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.116+0000 7f80ed6e6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80e8102dd0 0x7f80e8100a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:18.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.116+0000 7f80ed6e6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80e8103780 0x7f80e8100f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:18.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.116+0000 7f80ed6e6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80e8108300 0x7f80e81014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:18.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.116+0000 7f80ed6e6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f80e8111f80 con 0x7f80e8103780 2024-09-19T06:12:18.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.116+0000 7f80ed6e6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f80e8111e00 con 0x7f80e8102dd0 2024-09-19T06:12:18.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.116+0000 7f80ed6e6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f80e8112100 con 0x7f80e8108300 2024-09-19T06:12:18.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.116+0000 7f80e67fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80e8103780 0x7f80e8100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:18.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.116+0000 7f80e67fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80e8103780 0x7f80e8100f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55974/0 (socket says 172.21.15.2:55974) 2024-09-19T06:12:18.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.116+0000 7f80e67fc640 1 -- 172.21.15.2:0/1014710083 learned_addr learned my addr 172.21.15.2:0/1014710083 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:12:18.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.116+0000 7f80e6ffd640 1 --2- 172.21.15.2:0/1014710083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80e8102dd0 0x7f80e8100a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:18.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.116+0000 7f80e77fe640 1 --2- 172.21.15.2:0/1014710083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80e8108300 0x7f80e81014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:18.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.116+0000 7f80e67fc640 1 -- 172.21.15.2:0/1014710083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80e8108300 msgr2=0x7f80e81014b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:18.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.116+0000 7f80e67fc640 1 --2- 172.21.15.2:0/1014710083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80e8108300 0x7f80e81014b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:18.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.116+0000 7f80e67fc640 1 -- 172.21.15.2:0/1014710083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80e8102dd0 msgr2=0x7f80e8100a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:18.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.116+0000 7f80e67fc640 1 --2- 172.21.15.2:0/1014710083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80e8102dd0 0x7f80e8100a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:18.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.116+0000 7f80e67fc640 1 -- 172.21.15.2:0/1014710083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e81a6960 con 0x7f80e8103780 2024-09-19T06:12:18.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.116+0000 7f80e77fe640 1 --2- 172.21.15.2:0/1014710083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80e8108300 0x7f80e81014b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:12:18.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.116+0000 7f80e67fc640 1 --2- 172.21.15.2:0/1014710083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80e8103780 0x7f80e8100f70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f80dc00d750 tx=0x7f80dc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:18.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.116+0000 7f80cffff640 1 -- 172.21.15.2:0/1014710083 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80dc017070 con 0x7f80e8103780 2024-09-19T06:12:18.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.117+0000 7f80ed6e6640 1 -- 172.21.15.2:0/1014710083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80e81a6c50 con 0x7f80e8103780 2024-09-19T06:12:18.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.117+0000 7f80cffff640 1 -- 172.21.15.2:0/1014710083 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f80dc0054d0 con 0x7f80e8103780 2024-09-19T06:12:18.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.117+0000 7f80cffff640 1 -- 172.21.15.2:0/1014710083 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80dc004cf0 con 0x7f80e8103780 2024-09-19T06:12:18.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.117+0000 7f80ed6e6640 1 -- 172.21.15.2:0/1014710083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80e81a7190 con 0x7f80e8103780 2024-09-19T06:12:18.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.118+0000 7f80ed6e6640 1 -- 172.21.15.2:0/1014710083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80e81031b0 con 0x7f80e8103780 2024-09-19T06:12:18.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.119+0000 7f80cffff640 1 -- 172.21.15.2:0/1014710083 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f80dc004e90 con 0x7f80e8103780 2024-09-19T06:12:18.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.120+0000 7f80cffff640 1 --2- 172.21.15.2:0/1014710083 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f80d00a3240 0x7f80d00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:18.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.120+0000 7f80e6ffd640 1 --2- 172.21.15.2:0/1014710083 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f80d00a3240 0x7f80d00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:18.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.120+0000 7f80cffff640 1 -- 172.21.15.2:0/1014710083 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f80dc0cf180 con 0x7f80e8103780 2024-09-19T06:12:18.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.120+0000 7f80e6ffd640 1 --2- 172.21.15.2:0/1014710083 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f80d00a3240 0x7f80d00a5700 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f80d8005fd0 tx=0x7f80d8009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:18.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.123+0000 7f80cffff640 1 -- 172.21.15.2:0/1014710083 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f80dc09c340 con 0x7f80e8103780 2024-09-19T06:12:18.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:17 smithi090 ceph-mon[34497]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:18.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:17 smithi089 ceph-mon[34160]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:18.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.298+0000 7f80ed6e6640 1 -- 172.21.15.2:0/1014710083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f80e810a290 con 0x7f80e8103780 2024-09-19T06:12:18.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.298+0000 7f80cffff640 1 -- 172.21.15.2:0/1014710083 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) ==== 93+0+10 (secure 0 0 0) 0x7f80dc09bc40 con 0x7f80e8103780 2024-09-19T06:12:18.301 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-09-19T06:12:18.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.300+0000 7f80ed6e6640 1 -- 172.21.15.2:0/1014710083 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f80d00a3240 msgr2=0x7f80d00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:18.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.300+0000 7f80ed6e6640 1 --2- 172.21.15.2:0/1014710083 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f80d00a3240 0x7f80d00a5700 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f80d8005fd0 tx=0x7f80d8009680 comp rx=0 tx=0).stop 2024-09-19T06:12:18.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.300+0000 7f80ed6e6640 1 -- 172.21.15.2:0/1014710083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80e8103780 msgr2=0x7f80e8100f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:18.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.300+0000 7f80ed6e6640 1 --2- 172.21.15.2:0/1014710083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80e8103780 0x7f80e8100f70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f80dc00d750 tx=0x7f80dc00dc10 comp rx=0 tx=0).stop 2024-09-19T06:12:18.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.300+0000 7f80ed6e6640 1 -- 172.21.15.2:0/1014710083 shutdown_connections 2024-09-19T06:12:18.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.300+0000 7f80ed6e6640 1 --2- 172.21.15.2:0/1014710083 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f80d00a3240 0x7f80d00a5700 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:18.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.300+0000 7f80ed6e6640 1 --2- 172.21.15.2:0/1014710083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80e8108300 0x7f80e81014b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:18.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.300+0000 7f80ed6e6640 1 --2- 172.21.15.2:0/1014710083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80e8103780 0x7f80e8100f70 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:18.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.300+0000 7f80ed6e6640 1 --2- 172.21.15.2:0/1014710083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80e8102dd0 0x7f80e8100a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:18.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.300+0000 7f80ed6e6640 1 -- 172.21.15.2:0/1014710083 >> 172.21.15.2:0/1014710083 conn(0x7f80e80fc7d0 msgr2=0x7f80e8105e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:18.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.301+0000 7f80ed6e6640 1 -- 172.21.15.2:0/1014710083 shutdown_connections 2024-09-19T06:12:18.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:18.301+0000 7f80ed6e6640 1 -- 172.21.15.2:0/1014710083 wait complete. 2024-09-19T06:12:19.063 INFO:tasks.cephadm:Adding mds.a on smithi002 2024-09-19T06:12:19.063 INFO:tasks.cephadm:Adding mds.d on smithi002 2024-09-19T06:12:19.063 INFO:tasks.cephadm:Adding mds.g on smithi002 2024-09-19T06:12:19.063 INFO:tasks.cephadm:Adding mds.j on smithi002 2024-09-19T06:12:19.064 INFO:tasks.cephadm:Adding mds.b on smithi089 2024-09-19T06:12:19.064 INFO:tasks.cephadm:Adding mds.e on smithi089 2024-09-19T06:12:19.064 INFO:tasks.cephadm:Adding mds.h on smithi089 2024-09-19T06:12:19.064 INFO:tasks.cephadm:Adding mds.k on smithi089 2024-09-19T06:12:19.064 INFO:tasks.cephadm:Adding mds.c on smithi090 2024-09-19T06:12:19.064 INFO:tasks.cephadm:Adding mds.f on smithi090 2024-09-19T06:12:19.064 INFO:tasks.cephadm:Adding mds.i on smithi090 2024-09-19T06:12:19.064 INFO:tasks.cephadm:Adding mds.l on smithi090 2024-09-19T06:12:19.064 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi089=b;smithi089=e;smithi089=h;smithi089=k;smithi090=c;smithi090=f;smithi090=i;smithi090=l' 2024-09-19T06:12:19.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:18 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1014710083' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:12:19.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:18 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1014710083' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:12:19.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:18 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1014710083' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:12:19.326 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:12:19.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.724+0000 7f47897ff640 1 -- 172.21.15.90:0/86499287 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47841026d0 msgr2=0x7f4784108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:19.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.724+0000 7f47897ff640 1 --2- 172.21.15.90:0/86499287 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47841026d0 0x7f4784108f60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f477c009ca0 tx=0x7f477c02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.724+0000 7f47897ff640 1 -- 172.21.15.90:0/86499287 shutdown_connections 2024-09-19T06:12:19.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.724+0000 7f47897ff640 1 --2- 172.21.15.90:0/86499287 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47841026d0 0x7f4784108f60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.724+0000 7f47897ff640 1 --2- 172.21.15.90:0/86499287 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4784101d10 0x7f4784102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.724+0000 7f47897ff640 1 --2- 172.21.15.90:0/86499287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4784100b10 0x7f4784100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.724+0000 7f47897ff640 1 -- 172.21.15.90:0/86499287 >> 172.21.15.90:0/86499287 conn(0x7f47840fc2a0 msgr2=0x7f47840fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:19.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.725+0000 7f47897ff640 1 -- 172.21.15.90:0/86499287 shutdown_connections 2024-09-19T06:12:19.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.725+0000 7f47897ff640 1 -- 172.21.15.90:0/86499287 wait complete. 2024-09-19T06:12:19.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.725+0000 7f47897ff640 1 Processor -- start 2024-09-19T06:12:19.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.725+0000 7f47897ff640 1 -- start start 2024-09-19T06:12:19.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.725+0000 7f47897ff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4784100b10 0x7f478419a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:19.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.725+0000 7f47897ff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4784101d10 0x7f478419a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:19.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.725+0000 7f47897ff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47841026d0 0x7f47841a1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:19.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.725+0000 7f47897ff640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f478410c6f0 con 0x7f4784100b10 2024-09-19T06:12:19.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.725+0000 7f47897ff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f478410c570 con 0x7f4784101d10 2024-09-19T06:12:19.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.725+0000 7f47897ff640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f478410c870 con 0x7f47841026d0 2024-09-19T06:12:19.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.726+0000 7f4782ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4784100b10 0x7f478419a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:19.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.726+0000 7f477bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4784101d10 0x7f478419a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:19.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.726+0000 7f4782ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4784100b10 0x7f478419a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.90:58206/0 (socket says 172.21.15.90:58206) 2024-09-19T06:12:19.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.726+0000 7f4782ffd640 1 -- 172.21.15.90:0/2339992068 learned_addr learned my addr 172.21.15.90:0/2339992068 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-19T06:12:19.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.726+0000 7f477bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4784101d10 0x7f478419a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.90:51618/0 (socket says 172.21.15.90:51618) 2024-09-19T06:12:19.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.726+0000 7f47837fe640 1 --2- 172.21.15.90:0/2339992068 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47841026d0 0x7f47841a1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:19.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.726+0000 7f4782ffd640 1 -- 172.21.15.90:0/2339992068 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47841026d0 msgr2=0x7f47841a1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:19.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.726+0000 7f4782ffd640 1 --2- 172.21.15.90:0/2339992068 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47841026d0 0x7f47841a1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.726+0000 7f4782ffd640 1 -- 172.21.15.90:0/2339992068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4784101d10 msgr2=0x7f478419a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:19.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.726+0000 7f4782ffd640 1 --2- 172.21.15.90:0/2339992068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4784101d10 0x7f478419a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.726+0000 7f4782ffd640 1 -- 172.21.15.90:0/2339992068 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47841a1d90 con 0x7f4784100b10 2024-09-19T06:12:19.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.726+0000 7f47837fe640 1 --2- 172.21.15.90:0/2339992068 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47841026d0 0x7f47841a1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:19.731 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.726+0000 7f4782ffd640 1 --2- 172.21.15.90:0/2339992068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4784100b10 0x7f478419a160 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f477400b450 tx=0x7f477400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:19.731 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.727+0000 7f4780ff9640 1 -- 172.21.15.90:0/2339992068 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4774015020 con 0x7f4784100b10 2024-09-19T06:12:19.731 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.727+0000 7f47897ff640 1 -- 172.21.15.90:0/2339992068 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47841a2080 con 0x7f4784100b10 2024-09-19T06:12:19.731 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.727+0000 7f4780ff9640 1 -- 172.21.15.90:0/2339992068 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4774011d40 con 0x7f4784100b10 2024-09-19T06:12:19.731 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.727+0000 7f4780ff9640 1 -- 172.21.15.90:0/2339992068 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477400f340 con 0x7f4784100b10 2024-09-19T06:12:19.731 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.727+0000 7f47897ff640 1 -- 172.21.15.90:0/2339992068 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47841a2610 con 0x7f4784100b10 2024-09-19T06:12:19.731 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.728+0000 7f47897ff640 1 -- 172.21.15.90:0/2339992068 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47841a2930 con 0x7f4784100b10 2024-09-19T06:12:19.731 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.730+0000 7f4780ff9640 1 -- 172.21.15.90:0/2339992068 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f4774018020 con 0x7f4784100b10 2024-09-19T06:12:19.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.730+0000 7f4780ff9640 1 --2- 172.21.15.90:0/2339992068 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f47700a3270 0x7f47700a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:19.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.730+0000 7f4780ff9640 1 -- 172.21.15.90:0/2339992068 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f47740cf3c0 con 0x7f4784100b10 2024-09-19T06:12:19.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.731+0000 7f477bfff640 1 --2- 172.21.15.90:0/2339992068 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f47700a3270 0x7f47700a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:19.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.731+0000 7f477bfff640 1 --2- 172.21.15.90:0/2339992068 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f47700a3270 0x7f47700a5730 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f478419b680 tx=0x7f476c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:19.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.734+0000 7f4780ff9640 1 -- 172.21.15.90:0/2339992068 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f477401f020 con 0x7f4784100b10 2024-09-19T06:12:19.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.915+0000 7f47897ff640 1 -- 172.21.15.90:0/2339992068 --> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi089=b;smithi089=e;smithi089=h;smithi089=k;smithi090=c;smithi090=f;smithi090=i;smithi090=l", "target": ["mon-mgr", ""]}) -- 0x7f478406af30 con 0x7f47700a3270 2024-09-19T06:12:19.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.922+0000 7f4780ff9640 1 -- 172.21.15.90:0/2339992068 <== mgr.14150 v2:172.21.15.2:6800/4180340554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f478406af30 con 0x7f47700a3270 2024-09-19T06:12:19.924 INFO:teuthology.orchestra.run.smithi090.stdout:Scheduled mds.all update... 2024-09-19T06:12:19.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.925+0000 7f47897ff640 1 -- 172.21.15.90:0/2339992068 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f47700a3270 msgr2=0x7f47700a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:19.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.925+0000 7f47897ff640 1 --2- 172.21.15.90:0/2339992068 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f47700a3270 0x7f47700a5730 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f478419b680 tx=0x7f476c00b390 comp rx=0 tx=0).stop 2024-09-19T06:12:19.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.925+0000 7f47897ff640 1 -- 172.21.15.90:0/2339992068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4784100b10 msgr2=0x7f478419a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:19.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.925+0000 7f47897ff640 1 --2- 172.21.15.90:0/2339992068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4784100b10 0x7f478419a160 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f477400b450 tx=0x7f477400b910 comp rx=0 tx=0).stop 2024-09-19T06:12:19.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.925+0000 7f47897ff640 1 -- 172.21.15.90:0/2339992068 shutdown_connections 2024-09-19T06:12:19.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.925+0000 7f47897ff640 1 --2- 172.21.15.90:0/2339992068 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f47700a3270 0x7f47700a5730 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.925+0000 7f47897ff640 1 --2- 172.21.15.90:0/2339992068 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47841026d0 0x7f47841a1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.925+0000 7f47897ff640 1 --2- 172.21.15.90:0/2339992068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4784101d10 0x7f478419a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.925+0000 7f47897ff640 1 --2- 172.21.15.90:0/2339992068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4784100b10 0x7f478419a160 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:19.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.925+0000 7f47897ff640 1 -- 172.21.15.90:0/2339992068 >> 172.21.15.90:0/2339992068 conn(0x7f47840fc2a0 msgr2=0x7f478406a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:19.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.925+0000 7f47897ff640 1 -- 172.21.15.90:0/2339992068 shutdown_connections 2024-09-19T06:12:19.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-19T06:12:19.925+0000 7f47897ff640 1 -- 172.21.15.90:0/2339992068 wait complete. 2024-09-19T06:12:19.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:19 smithi090 ceph-mon[34497]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:20.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:19 smithi002 ceph-mon[30982]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:20.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:19 smithi089 ceph-mon[34160]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:20.573 DEBUG:teuthology.orchestra.run.smithi002:mds.a> sudo journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@mds.a.service 2024-09-19T06:12:20.576 DEBUG:teuthology.orchestra.run.smithi002:mds.d> sudo journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@mds.d.service 2024-09-19T06:12:20.620 DEBUG:teuthology.orchestra.run.smithi002:mds.g> sudo journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@mds.g.service 2024-09-19T06:12:20.662 DEBUG:teuthology.orchestra.run.smithi002:mds.j> sudo journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@mds.j.service 2024-09-19T06:12:20.705 DEBUG:teuthology.orchestra.run.smithi089:mds.b> sudo journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@mds.b.service 2024-09-19T06:12:20.708 DEBUG:teuthology.orchestra.run.smithi089:mds.e> sudo journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@mds.e.service 2024-09-19T06:12:20.750 DEBUG:teuthology.orchestra.run.smithi089:mds.h> sudo journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@mds.h.service 2024-09-19T06:12:20.793 DEBUG:teuthology.orchestra.run.smithi089:mds.k> sudo journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@mds.k.service 2024-09-19T06:12:20.836 DEBUG:teuthology.orchestra.run.smithi090:mds.c> sudo journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@mds.c.service 2024-09-19T06:12:20.838 DEBUG:teuthology.orchestra.run.smithi090:mds.f> sudo journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@mds.f.service 2024-09-19T06:12:20.881 DEBUG:teuthology.orchestra.run.smithi090:mds.i> sudo journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@mds.i.service 2024-09-19T06:12:20.924 DEBUG:teuthology.orchestra.run.smithi090:mds.l> sudo journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@mds.l.service 2024-09-19T06:12:20.967 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-19T06:12:20.968 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:12:20.987 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:20 smithi090 ceph-mon[34497]: from='client.14505 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi089=b;smithi089=e;smithi089=h;smithi089=k;smithi090=c;smithi090=f;smithi090=i;smithi090=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:12:20.987 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:20 smithi090 ceph-mon[34497]: Saving service mds.all spec with placement smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi089=b;smithi089=e;smithi089=h;smithi089=k;smithi090=c;smithi090=f;smithi090=i;smithi090=l;count:12 2024-09-19T06:12:20.987 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:20 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:20.987 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:20 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:12:20.987 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:20 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:20.987 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:20 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:12:20.987 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:20 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:20.987 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:20 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:12:20.987 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:20 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:12:20.987 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:20 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:21.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:20 smithi089 ceph-mon[34160]: from='client.14505 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi089=b;smithi089=e;smithi089=h;smithi089=k;smithi090=c;smithi090=f;smithi090=i;smithi090=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:12:21.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:20 smithi089 ceph-mon[34160]: Saving service mds.all spec with placement smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi089=b;smithi089=e;smithi089=h;smithi089=k;smithi090=c;smithi090=f;smithi090=i;smithi090=l;count:12 2024-09-19T06:12:21.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:20 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:21.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:20 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:12:21.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:20 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:21.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:20 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:12:21.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:20 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:21.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:20 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:12:21.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:20 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:12:21.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:20 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:21.219 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:12:21.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:20 smithi002 ceph-mon[30982]: from='client.14505 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi089=b;smithi089=e;smithi089=h;smithi089=k;smithi090=c;smithi090=f;smithi090=i;smithi090=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:12:21.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:20 smithi002 ceph-mon[30982]: Saving service mds.all spec with placement smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi089=b;smithi089=e;smithi089=h;smithi089=k;smithi090=c;smithi090=f;smithi090=i;smithi090=l;count:12 2024-09-19T06:12:21.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:20 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:21.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:20 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:12:21.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:20 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:21.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:20 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:12:21.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:20 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:21.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:20 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:12:21.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:20 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:12:21.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:20 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:21.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.651+0000 7f1a49618640 1 -- 172.21.15.2:0/2199898856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a44103660 msgr2=0x7f1a4410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:21.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.651+0000 7f1a49618640 1 --2- 172.21.15.2:0/2199898856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a44103660 0x7f1a4410bb50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1a38009900 tx=0x7f1a3802a480 comp rx=0 tx=0).stop 2024-09-19T06:12:21.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.651+0000 7f1a49618640 1 -- 172.21.15.2:0/2199898856 shutdown_connections 2024-09-19T06:12:21.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.651+0000 7f1a49618640 1 --2- 172.21.15.2:0/2199898856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a4410c170 0x7f1a4410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:21.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.651+0000 7f1a49618640 1 --2- 172.21.15.2:0/2199898856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a44103660 0x7f1a4410bb50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:21.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.651+0000 7f1a49618640 1 --2- 172.21.15.2:0/2199898856 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a44102d40 0x7f1a44103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:21.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.651+0000 7f1a49618640 1 -- 172.21.15.2:0/2199898856 >> 172.21.15.2:0/2199898856 conn(0x7f1a440fc7a0 msgr2=0x7f1a440febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:21.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.651+0000 7f1a49618640 1 -- 172.21.15.2:0/2199898856 shutdown_connections 2024-09-19T06:12:21.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.651+0000 7f1a49618640 1 -- 172.21.15.2:0/2199898856 wait complete. 2024-09-19T06:12:21.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.652+0000 7f1a49618640 1 Processor -- start 2024-09-19T06:12:21.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.652+0000 7f1a49618640 1 -- start start 2024-09-19T06:12:21.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.652+0000 7f1a49618640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a44102d40 0x7f1a44198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:21.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.652+0000 7f1a49618640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a44103660 0x7f1a44198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:21.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.652+0000 7f1a49618640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a4410c170 0x7f1a4419cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:21.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.652+0000 7f1a49618640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1a44111e20 con 0x7f1a4410c170 2024-09-19T06:12:21.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.652+0000 7f1a49618640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f1a44111ca0 con 0x7f1a44103660 2024-09-19T06:12:21.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.652+0000 7f1a49618640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1a44111fa0 con 0x7f1a44102d40 2024-09-19T06:12:21.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.652+0000 7f1a437fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a4410c170 0x7f1a4419cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:21.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.652+0000 7f1a437fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a4410c170 0x7f1a4419cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55986/0 (socket says 172.21.15.2:55986) 2024-09-19T06:12:21.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.652+0000 7f1a437fe640 1 -- 172.21.15.2:0/3473660120 learned_addr learned my addr 172.21.15.2:0/3473660120 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:12:21.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.653+0000 7f1a42ffd640 1 --2- 172.21.15.2:0/3473660120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a44102d40 0x7f1a44198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:21.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.653+0000 7f1a427fc640 1 --2- 172.21.15.2:0/3473660120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a44103660 0x7f1a44198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:21.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.653+0000 7f1a437fe640 1 -- 172.21.15.2:0/3473660120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a44102d40 msgr2=0x7f1a44198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:21.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.653+0000 7f1a437fe640 1 --2- 172.21.15.2:0/3473660120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a44102d40 0x7f1a44198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:21.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.653+0000 7f1a437fe640 1 -- 172.21.15.2:0/3473660120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a44103660 msgr2=0x7f1a44198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:21.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.653+0000 7f1a437fe640 1 --2- 172.21.15.2:0/3473660120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a44103660 0x7f1a44198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:21.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.653+0000 7f1a437fe640 1 -- 172.21.15.2:0/3473660120 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a4419d2d0 con 0x7f1a4410c170 2024-09-19T06:12:21.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.653+0000 7f1a437fe640 1 --2- 172.21.15.2:0/3473660120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a4410c170 0x7f1a4419cbf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c00cce0 tx=0x7f1a3c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:21.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.653+0000 7f1a2bfff640 1 -- 172.21.15.2:0/3473660120 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c00f450 con 0x7f1a4410c170 2024-09-19T06:12:21.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.654+0000 7f1a2bfff640 1 -- 172.21.15.2:0/3473660120 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1a3c00faa0 con 0x7f1a4410c170 2024-09-19T06:12:21.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.654+0000 7f1a2bfff640 1 -- 172.21.15.2:0/3473660120 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c018b70 con 0x7f1a4410c170 2024-09-19T06:12:21.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.654+0000 7f1a49618640 1 -- 172.21.15.2:0/3473660120 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a4419d5c0 con 0x7f1a4410c170 2024-09-19T06:12:21.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.655+0000 7f1a49618640 1 -- 172.21.15.2:0/3473660120 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a441a4ea0 con 0x7f1a4410c170 2024-09-19T06:12:21.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.656+0000 7f1a49618640 1 -- 172.21.15.2:0/3473660120 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a44103120 con 0x7f1a4410c170 2024-09-19T06:12:21.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.657+0000 7f1a2bfff640 1 -- 172.21.15.2:0/3473660120 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f1a3c018d10 con 0x7f1a4410c170 2024-09-19T06:12:21.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.657+0000 7f1a2bfff640 1 --2- 172.21.15.2:0/3473660120 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f1a2c0a3390 0x7f1a2c0a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:21.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.658+0000 7f1a2bfff640 1 -- 172.21.15.2:0/3473660120 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f1a3c0cf780 con 0x7f1a4410c170 2024-09-19T06:12:21.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.658+0000 7f1a42ffd640 1 --2- 172.21.15.2:0/3473660120 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f1a2c0a3390 0x7f1a2c0a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:21.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.658+0000 7f1a42ffd640 1 --2- 172.21.15.2:0/3473660120 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f1a2c0a3390 0x7f1a2c0a5850 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1a3400bbe0 tx=0x7f1a3400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:21.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.662+0000 7f1a2bfff640 1 -- 172.21.15.2:0/3473660120 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1a3c014030 con 0x7f1a4410c170 2024-09-19T06:12:21.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.872+0000 7f1a49618640 1 -- 172.21.15.2:0/3473660120 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1a441071e0 con 0x7f1a4410c170 2024-09-19T06:12:21.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.872+0000 7f1a2bfff640 1 -- 172.21.15.2:0/3473660120 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f1a3c09c8a0 con 0x7f1a4410c170 2024-09-19T06:12:21.874 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:12:21.874 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":1,"btime":"2024-09-19T06:05:17:607764+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-19T06:12:21.874 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 1 2024-09-19T06:12:21.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.874+0000 7f1a49618640 1 -- 172.21.15.2:0/3473660120 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f1a2c0a3390 msgr2=0x7f1a2c0a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:21.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.874+0000 7f1a49618640 1 --2- 172.21.15.2:0/3473660120 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f1a2c0a3390 0x7f1a2c0a5850 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1a3400bbe0 tx=0x7f1a3400b390 comp rx=0 tx=0).stop 2024-09-19T06:12:21.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.874+0000 7f1a49618640 1 -- 172.21.15.2:0/3473660120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a4410c170 msgr2=0x7f1a4419cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:21.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.874+0000 7f1a49618640 1 --2- 172.21.15.2:0/3473660120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a4410c170 0x7f1a4419cbf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c00cce0 tx=0x7f1a3c00a620 comp rx=0 tx=0).stop 2024-09-19T06:12:21.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.874+0000 7f1a49618640 1 -- 172.21.15.2:0/3473660120 shutdown_connections 2024-09-19T06:12:21.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.874+0000 7f1a49618640 1 --2- 172.21.15.2:0/3473660120 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f1a2c0a3390 0x7f1a2c0a5850 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:21.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.874+0000 7f1a49618640 1 --2- 172.21.15.2:0/3473660120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a4410c170 0x7f1a4419cbf0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:21.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.874+0000 7f1a49618640 1 --2- 172.21.15.2:0/3473660120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a44103660 0x7f1a44198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:21.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.874+0000 7f1a49618640 1 --2- 172.21.15.2:0/3473660120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a44102d40 0x7f1a44198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:21.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.874+0000 7f1a49618640 1 -- 172.21.15.2:0/3473660120 >> 172.21.15.2:0/3473660120 conn(0x7f1a440fc7a0 msgr2=0x7f1a440fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:21.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.875+0000 7f1a49618640 1 -- 172.21.15.2:0/3473660120 shutdown_connections 2024-09-19T06:12:21.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:21.875+0000 7f1a49618640 1 -- 172.21.15.2:0/3473660120 wait complete. 2024-09-19T06:12:22.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:21 smithi002 ceph-mon[30982]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:22.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:21 smithi002 ceph-mon[30982]: Deploying daemon mds.l on smithi090 2024-09-19T06:12:22.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:21 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/3473660120' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:12:22.223 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:21 smithi090 ceph-mon[34497]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:22.223 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:21 smithi090 ceph-mon[34497]: Deploying daemon mds.l on smithi090 2024-09-19T06:12:22.223 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:21 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/3473660120' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:12:22.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:21 smithi089 ceph-mon[34160]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:22.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:21 smithi089 ceph-mon[34160]: Deploying daemon mds.l on smithi090 2024-09-19T06:12:22.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:21 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/3473660120' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:12:22.490 INFO:journalctl@ceph.mds.l.smithi090.stdout:Sep 19 06:12:22 smithi090 systemd[1]: Starting Ceph mds.l for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:12:22.878 INFO:journalctl@ceph.mds.l.smithi090.stdout:Sep 19 06:12:22 smithi090 podman[64052]: 2024-09-19 06:12:22.612186964 +0000 UTC m=+0.103429548 container create 776c0eda70fd4009d0359f0a0881a2baeea881c8a9193f71cb6df2bbbae4a64c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-l, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-19T06:12:22.878 INFO:journalctl@ceph.mds.l.smithi090.stdout:Sep 19 06:12:22 smithi090 podman[64052]: 2024-09-19 06:12:22.524824466 +0000 UTC m=+0.016067061 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:12:22.878 INFO:journalctl@ceph.mds.l.smithi090.stdout:Sep 19 06:12:22 smithi090 podman[64052]: 2024-09-19 06:12:22.877150676 +0000 UTC m=+0.368393266 container init 776c0eda70fd4009d0359f0a0881a2baeea881c8a9193f71cb6df2bbbae4a64c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-l, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:12:23.240 INFO:journalctl@ceph.mds.l.smithi090.stdout:Sep 19 06:12:22 smithi090 podman[64052]: 2024-09-19 06:12:22.880160431 +0000 UTC m=+0.371403019 container start 776c0eda70fd4009d0359f0a0881a2baeea881c8a9193f71cb6df2bbbae4a64c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-l, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:12:23.240 INFO:journalctl@ceph.mds.l.smithi090.stdout:Sep 19 06:12:22 smithi090 ceph-mds[64071]: -- 172.21.15.90:0/924755629 <== mon.1 v2:172.21.15.90:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b06e503860 con 0x55b06e4e0800 2024-09-19T06:12:23.240 INFO:journalctl@ceph.mds.l.smithi090.stdout:Sep 19 06:12:22 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-l[64067]: starting mds.l at 2024-09-19T06:12:23.240 INFO:journalctl@ceph.mds.l.smithi090.stdout:Sep 19 06:12:22 smithi090 bash[64052]: 776c0eda70fd4009d0359f0a0881a2baeea881c8a9193f71cb6df2bbbae4a64c 2024-09-19T06:12:23.240 INFO:journalctl@ceph.mds.l.smithi090.stdout:Sep 19 06:12:22 smithi090 systemd[1]: Started Ceph mds.l for 078f6612-764d-11ef-bceb-c7b262605968. 2024-09-19T06:12:23.995 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:23 smithi089 ceph-mon[34160]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:23.995 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:23 smithi089 ceph-mon[34160]: mds.? [v2:172.21.15.90:6832/3201908791,v1:172.21.15.90:6833/3201908791] up:boot 2024-09-19T06:12:23.995 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:23 smithi089 ceph-mon[34160]: fsmap 1 up:standby 2024-09-19T06:12:23.995 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:23 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T06:12:23.995 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:23 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:23.995 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:23 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:23.995 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:23 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:23.995 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:23 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:12:23.995 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:23 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:12:23.995 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:23 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:24.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:23 smithi002 ceph-mon[30982]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:24.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:23 smithi002 ceph-mon[30982]: mds.? [v2:172.21.15.90:6832/3201908791,v1:172.21.15.90:6833/3201908791] up:boot 2024-09-19T06:12:24.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:23 smithi002 ceph-mon[30982]: fsmap 1 up:standby 2024-09-19T06:12:24.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:23 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T06:12:24.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:23 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:24.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:23 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:24.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:23 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:24.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:23 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:12:24.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:23 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:12:24.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:23 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:24.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:23 smithi090 ceph-mon[34497]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:24.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:23 smithi090 ceph-mon[34497]: mds.? [v2:172.21.15.90:6832/3201908791,v1:172.21.15.90:6833/3201908791] up:boot 2024-09-19T06:12:24.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:23 smithi090 ceph-mon[34497]: fsmap 1 up:standby 2024-09-19T06:12:24.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:23 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T06:12:24.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:23 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:24.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:23 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:24.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:23 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:24.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:23 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:12:24.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:23 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:12:24.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:23 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:24.602 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:12:24.870 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:12:25.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:24 smithi002 ceph-mon[30982]: Deploying daemon mds.k on smithi089 2024-09-19T06:12:25.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:24 smithi090 ceph-mon[34497]: Deploying daemon mds.k on smithi089 2024-09-19T06:12:25.240 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:24 smithi089 ceph-mon[34160]: Deploying daemon mds.k on smithi089 2024-09-19T06:12:25.241 INFO:journalctl@ceph.mds.k.smithi089.stdout:Sep 19 06:12:25 smithi089 systemd[1]: Starting Ceph mds.k for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:12:25.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.326+0000 7f6dc88da640 1 -- 172.21.15.2:0/1492029359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dc4102d40 msgr2=0x7f6dc4103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:25.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.326+0000 7f6dc88da640 1 --2- 172.21.15.2:0/1492029359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dc4102d40 0x7f6dc4103120 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6db4009900 tx=0x7f6db402a480 comp rx=0 tx=0).stop 2024-09-19T06:12:25.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.326+0000 7f6dc88da640 1 -- 172.21.15.2:0/1492029359 shutdown_connections 2024-09-19T06:12:25.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.326+0000 7f6dc88da640 1 --2- 172.21.15.2:0/1492029359 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dc410c170 0x7f6dc410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:25.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.326+0000 7f6dc88da640 1 --2- 172.21.15.2:0/1492029359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6dc4103660 0x7f6dc410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:25.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.326+0000 7f6dc88da640 1 --2- 172.21.15.2:0/1492029359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dc4102d40 0x7f6dc4103120 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:25.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.326+0000 7f6dc88da640 1 -- 172.21.15.2:0/1492029359 >> 172.21.15.2:0/1492029359 conn(0x7f6dc40fc7a0 msgr2=0x7f6dc40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:25.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.326+0000 7f6dc88da640 1 -- 172.21.15.2:0/1492029359 shutdown_connections 2024-09-19T06:12:25.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.326+0000 7f6dc88da640 1 -- 172.21.15.2:0/1492029359 wait complete. 2024-09-19T06:12:25.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.327+0000 7f6dc88da640 1 Processor -- start 2024-09-19T06:12:25.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.327+0000 7f6dc88da640 1 -- start start 2024-09-19T06:12:25.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.328+0000 7f6dc88da640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6dc4102d40 0x7f6dc419a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:25.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.328+0000 7f6dc88da640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dc4103660 0x7f6dc419a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:25.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.328+0000 7f6dc88da640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dc410c170 0x7f6dc419ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:25.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.328+0000 7f6dc88da640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc4111e20 con 0x7f6dc4103660 2024-09-19T06:12:25.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.328+0000 7f6dc88da640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc4111ca0 con 0x7f6dc4102d40 2024-09-19T06:12:25.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.328+0000 7f6dc88da640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc4111fa0 con 0x7f6dc410c170 2024-09-19T06:12:25.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.328+0000 7f6db9d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dc4103660 0x7f6dc419a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:25.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.328+0000 7f6db9d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dc4103660 0x7f6dc419a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52178/0 (socket says 172.21.15.2:52178) 2024-09-19T06:12:25.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.328+0000 7f6db9d9b640 1 -- 172.21.15.2:0/2716197304 learned_addr learned my addr 172.21.15.2:0/2716197304 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:12:25.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.328+0000 7f6dc259c640 1 --2- 172.21.15.2:0/2716197304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6dc4102d40 0x7f6dc419a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:25.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.328+0000 7f6dc2d9d640 1 --2- 172.21.15.2:0/2716197304 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dc410c170 0x7f6dc419ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:25.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.328+0000 7f6db9d9b640 1 -- 172.21.15.2:0/2716197304 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dc410c170 msgr2=0x7f6dc419ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:25.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.328+0000 7f6db9d9b640 1 --2- 172.21.15.2:0/2716197304 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dc410c170 0x7f6dc419ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:25.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.328+0000 7f6db9d9b640 1 -- 172.21.15.2:0/2716197304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6dc4102d40 msgr2=0x7f6dc419a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:25.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.328+0000 7f6db9d9b640 1 --2- 172.21.15.2:0/2716197304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6dc4102d40 0x7f6dc419a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:25.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.328+0000 7f6db9d9b640 1 -- 172.21.15.2:0/2716197304 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc419f460 con 0x7f6dc4103660 2024-09-19T06:12:25.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.328+0000 7f6dc259c640 1 --2- 172.21.15.2:0/2716197304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6dc4102d40 0x7f6dc419a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:12:25.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.328+0000 7f6dc2d9d640 1 --2- 172.21.15.2:0/2716197304 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dc410c170 0x7f6dc419ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:12:25.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.328+0000 7f6db9d9b640 1 --2- 172.21.15.2:0/2716197304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dc4103660 0x7f6dc419a9f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6dac00c970 tx=0x7f6dac00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:25.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.328+0000 7f6dbbfff640 1 -- 172.21.15.2:0/2716197304 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dac007bb0 con 0x7f6dc4103660 2024-09-19T06:12:25.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.328+0000 7f6dc88da640 1 -- 172.21.15.2:0/2716197304 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dc419f750 con 0x7f6dc4103660 2024-09-19T06:12:25.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.328+0000 7f6dbbfff640 1 -- 172.21.15.2:0/2716197304 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6dac007d50 con 0x7f6dc4103660 2024-09-19T06:12:25.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.328+0000 7f6dbbfff640 1 -- 172.21.15.2:0/2716197304 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dac018780 con 0x7f6dc4103660 2024-09-19T06:12:25.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.328+0000 7f6dc88da640 1 -- 172.21.15.2:0/2716197304 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dc41a7030 con 0x7f6dc4103660 2024-09-19T06:12:25.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.330+0000 7f6dc88da640 1 -- 172.21.15.2:0/2716197304 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dc4103120 con 0x7f6dc4103660 2024-09-19T06:12:25.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.331+0000 7f6dbbfff640 1 -- 172.21.15.2:0/2716197304 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f6dac00f450 con 0x7f6dc4103660 2024-09-19T06:12:25.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.331+0000 7f6dbbfff640 1 --2- 172.21.15.2:0/2716197304 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f6db00a3240 0x7f6db00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:25.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.331+0000 7f6dc259c640 1 --2- 172.21.15.2:0/2716197304 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f6db00a3240 0x7f6db00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:25.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.331+0000 7f6dbbfff640 1 -- 172.21.15.2:0/2716197304 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f6dac0cf5d0 con 0x7f6dc4103660 2024-09-19T06:12:25.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.332+0000 7f6dc259c640 1 --2- 172.21.15.2:0/2716197304 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f6db00a3240 0x7f6db00a5700 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6db4031440 tx=0x7f6db40095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:25.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.335+0000 7f6dbbfff640 1 -- 172.21.15.2:0/2716197304 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6dac014030 con 0x7f6dc4103660 2024-09-19T06:12:25.510 INFO:journalctl@ceph.mds.k.smithi089.stdout:Sep 19 06:12:25 smithi089 podman[62936]: 2024-09-19 06:12:25.142543964 +0000 UTC m=+0.015607617 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:12:25.510 INFO:journalctl@ceph.mds.k.smithi089.stdout:Sep 19 06:12:25 smithi089 podman[62936]: 2024-09-19 06:12:25.273277363 +0000 UTC m=+0.146341011 container create 78935390e7860dd9fdec25ad3d534cbb00e9cfa8631db3a3478d29e95fc6d6d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-k, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-19T06:12:25.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.548+0000 7f6dc88da640 1 -- 172.21.15.2:0/2716197304 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6dc41a72c0 con 0x7f6dc4103660 2024-09-19T06:12:25.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.548+0000 7f6dbbfff640 1 -- 172.21.15.2:0/2716197304 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1435 (secure 0 0 0) 0x7f6dac00de20 con 0x7f6dc4103660 2024-09-19T06:12:25.550 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:12:25.550 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":2,"btime":"2024-09-19T06:12:22:907987+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T06:12:25.551 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 2 2024-09-19T06:12:25.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.550+0000 7f6dc88da640 1 -- 172.21.15.2:0/2716197304 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f6db00a3240 msgr2=0x7f6db00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:25.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.551+0000 7f6dc88da640 1 --2- 172.21.15.2:0/2716197304 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f6db00a3240 0x7f6db00a5700 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6db4031440 tx=0x7f6db40095f0 comp rx=0 tx=0).stop 2024-09-19T06:12:25.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.551+0000 7f6dc88da640 1 -- 172.21.15.2:0/2716197304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dc4103660 msgr2=0x7f6dc419a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:25.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.551+0000 7f6dc88da640 1 --2- 172.21.15.2:0/2716197304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dc4103660 0x7f6dc419a9f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6dac00c970 tx=0x7f6dac00ce30 comp rx=0 tx=0).stop 2024-09-19T06:12:25.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.551+0000 7f6dc88da640 1 -- 172.21.15.2:0/2716197304 shutdown_connections 2024-09-19T06:12:25.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.551+0000 7f6dc88da640 1 --2- 172.21.15.2:0/2716197304 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f6db00a3240 0x7f6db00a5700 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:25.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.551+0000 7f6dc88da640 1 --2- 172.21.15.2:0/2716197304 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6dc410c170 0x7f6dc419ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:25.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.551+0000 7f6dc88da640 1 --2- 172.21.15.2:0/2716197304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dc4103660 0x7f6dc419a9f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:25.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.551+0000 7f6dc88da640 1 --2- 172.21.15.2:0/2716197304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6dc4102d40 0x7f6dc419a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:25.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.551+0000 7f6dc88da640 1 -- 172.21.15.2:0/2716197304 >> 172.21.15.2:0/2716197304 conn(0x7f6dc40fc7a0 msgr2=0x7f6dc40feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:25.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.551+0000 7f6dc88da640 1 -- 172.21.15.2:0/2716197304 shutdown_connections 2024-09-19T06:12:25.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:25.551+0000 7f6dc88da640 1 -- 172.21.15.2:0/2716197304 wait complete. 2024-09-19T06:12:25.792 INFO:journalctl@ceph.mds.k.smithi089.stdout:Sep 19 06:12:25 smithi089 podman[62936]: 2024-09-19 06:12:25.509139366 +0000 UTC m=+0.382203014 container init 78935390e7860dd9fdec25ad3d534cbb00e9cfa8631db3a3478d29e95fc6d6d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-k, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-19T06:12:25.792 INFO:journalctl@ceph.mds.k.smithi089.stdout:Sep 19 06:12:25 smithi089 podman[62936]: 2024-09-19 06:12:25.51220686 +0000 UTC m=+0.385270509 container start 78935390e7860dd9fdec25ad3d534cbb00e9cfa8631db3a3478d29e95fc6d6d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-k, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-19T06:12:25.792 INFO:journalctl@ceph.mds.k.smithi089.stdout:Sep 19 06:12:25 smithi089 ceph-mds[62956]: -- 172.21.15.89:0/3526660562 <== mon.2 v2:172.21.15.89:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558566a17860 con 0x5585669f4800 2024-09-19T06:12:25.792 INFO:journalctl@ceph.mds.k.smithi089.stdout:Sep 19 06:12:25 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-k[62952]: starting mds.k at 2024-09-19T06:12:25.792 INFO:journalctl@ceph.mds.k.smithi089.stdout:Sep 19 06:12:25 smithi089 bash[62936]: 78935390e7860dd9fdec25ad3d534cbb00e9cfa8631db3a3478d29e95fc6d6d5 2024-09-19T06:12:25.793 INFO:journalctl@ceph.mds.k.smithi089.stdout:Sep 19 06:12:25 smithi089 systemd[1]: Started Ceph mds.k for 078f6612-764d-11ef-bceb-c7b262605968. 2024-09-19T06:12:26.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:25 smithi002 ceph-mon[30982]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:26.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:25 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/2716197304' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:12:26.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:25 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:26.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:25 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:26.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:25 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:26.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:25 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:12:26.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:25 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:12:26.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:25 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:26.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:25 smithi090 ceph-mon[34497]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:26.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:25 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/2716197304' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:12:26.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:25 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:26.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:25 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:26.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:25 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:26.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:25 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:12:26.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:25 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:12:26.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:25 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:26.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:25 smithi089 ceph-mon[34160]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:26.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:25 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/2716197304' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:12:26.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:25 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:26.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:25 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:26.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:25 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:26.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:25 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:12:26.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:25 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:12:26.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:25 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:27.157 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:26 smithi002 ceph-mon[30982]: Deploying daemon mds.j on smithi002 2024-09-19T06:12:27.157 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:26 smithi002 ceph-mon[30982]: mds.? [v2:172.21.15.89:6832/2529057952,v1:172.21.15.89:6833/2529057952] up:boot 2024-09-19T06:12:27.157 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:26 smithi002 ceph-mon[30982]: fsmap 2 up:standby 2024-09-19T06:12:27.157 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:26 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T06:12:27.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:26 smithi090 ceph-mon[34497]: Deploying daemon mds.j on smithi002 2024-09-19T06:12:27.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:26 smithi090 ceph-mon[34497]: mds.? [v2:172.21.15.89:6832/2529057952,v1:172.21.15.89:6833/2529057952] up:boot 2024-09-19T06:12:27.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:26 smithi090 ceph-mon[34497]: fsmap 2 up:standby 2024-09-19T06:12:27.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:26 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T06:12:27.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:26 smithi089 ceph-mon[34160]: Deploying daemon mds.j on smithi002 2024-09-19T06:12:27.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:26 smithi089 ceph-mon[34160]: mds.? [v2:172.21.15.89:6832/2529057952,v1:172.21.15.89:6833/2529057952] up:boot 2024-09-19T06:12:27.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:26 smithi089 ceph-mon[34160]: fsmap 2 up:standby 2024-09-19T06:12:27.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:26 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T06:12:28.151 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:27 smithi002 ceph-mon[30982]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:28.151 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 19 06:12:27 smithi002 systemd[1]: Starting Ceph mds.j for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:12:28.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:27 smithi090 ceph-mon[34497]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:28.279 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:12:28.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:27 smithi089 ceph-mon[34160]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:28.425 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 19 06:12:28 smithi002 podman[69861]: 2024-09-19 06:12:28.149600802 +0000 UTC m=+0.101831407 container create 2ba4e9513e7a0bc6a32e9a78a4026a3d3f050cdb1a581071fa7ab3cb736a4025 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T06:12:28.425 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 19 06:12:28 smithi002 podman[69861]: 2024-09-19 06:12:28.064141031 +0000 UTC m=+0.016371651 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:12:28.425 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 19 06:12:28 smithi002 podman[69861]: 2024-09-19 06:12:28.394367164 +0000 UTC m=+0.346597779 container init 2ba4e9513e7a0bc6a32e9a78a4026a3d3f050cdb1a581071fa7ab3cb736a4025 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:12:28.425 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 19 06:12:28 smithi002 podman[69861]: 2024-09-19 06:12:28.398515256 +0000 UTC m=+0.350745867 container start 2ba4e9513e7a0bc6a32e9a78a4026a3d3f050cdb1a581071fa7ab3cb736a4025 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-j, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-19T06:12:28.425 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 19 06:12:28 smithi002 ceph-mds[69898]: -- 172.21.15.2:0/3386784742 <== mon.0 v2:172.21.15.2:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56528a46b860 con 0x56528a449000 2024-09-19T06:12:28.553 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:12:28.676 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 19 06:12:28 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-j[69876]: starting mds.j at 2024-09-19T06:12:28.676 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 19 06:12:28 smithi002 bash[69861]: 2ba4e9513e7a0bc6a32e9a78a4026a3d3f050cdb1a581071fa7ab3cb736a4025 2024-09-19T06:12:28.676 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 19 06:12:28 smithi002 systemd[1]: Started Ceph mds.j for 078f6612-764d-11ef-bceb-c7b262605968. 2024-09-19T06:12:29.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.022+0000 7f147a270640 1 -- 172.21.15.2:0/4131263501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1474102790 msgr2=0x7f14741067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:29.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.022+0000 7f147a270640 1 --2- 172.21.15.2:0/4131263501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1474102790 0x7f14741067e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1468009900 tx=0x7f146802a410 comp rx=0 tx=0).stop 2024-09-19T06:12:29.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.022+0000 7f147a270640 1 -- 172.21.15.2:0/4131263501 shutdown_connections 2024-09-19T06:12:29.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.022+0000 7f147a270640 1 --2- 172.21.15.2:0/4131263501 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1474106f10 0x7f147410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:29.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.022+0000 7f147a270640 1 --2- 172.21.15.2:0/4131263501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1474102790 0x7f14741067e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:29.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.022+0000 7f147a270640 1 --2- 172.21.15.2:0/4131263501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1474101de0 0x7f14741021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:29.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.022+0000 7f147a270640 1 -- 172.21.15.2:0/4131263501 >> 172.21.15.2:0/4131263501 conn(0x7f14740fd8c0 msgr2=0x7f14740ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:29.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.022+0000 7f147a270640 1 -- 172.21.15.2:0/4131263501 shutdown_connections 2024-09-19T06:12:29.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.022+0000 7f147a270640 1 -- 172.21.15.2:0/4131263501 wait complete. 2024-09-19T06:12:29.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.022+0000 7f147a270640 1 Processor -- start 2024-09-19T06:12:29.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.022+0000 7f147a270640 1 -- start start 2024-09-19T06:12:29.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.023+0000 7f147a270640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1474101de0 0x7f14741983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:29.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.023+0000 7f147a270640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1474102790 0x7f14741988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:29.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.023+0000 7f147a270640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1474106f10 0x7f147419cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:29.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.023+0000 7f147a270640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1474111e20 con 0x7f1474106f10 2024-09-19T06:12:29.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.023+0000 7f147a270640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f1474111ca0 con 0x7f1474101de0 2024-09-19T06:12:29.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.023+0000 7f147a270640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1474111fa0 con 0x7f1474102790 2024-09-19T06:12:29.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.023+0000 7f147880d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1474106f10 0x7f147419cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:29.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.023+0000 7f147880d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1474106f10 0x7f147419cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52206/0 (socket says 172.21.15.2:52206) 2024-09-19T06:12:29.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.023+0000 7f147880d640 1 -- 172.21.15.2:0/883917473 learned_addr learned my addr 172.21.15.2:0/883917473 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:12:29.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.023+0000 7f14737fe640 1 --2- 172.21.15.2:0/883917473 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1474102790 0x7f14741988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:29.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.023+0000 7f1473fff640 1 --2- 172.21.15.2:0/883917473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1474101de0 0x7f14741983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:29.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.023+0000 7f147880d640 1 -- 172.21.15.2:0/883917473 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1474102790 msgr2=0x7f14741988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:29.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.023+0000 7f147880d640 1 --2- 172.21.15.2:0/883917473 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1474102790 0x7f14741988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:29.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.023+0000 7f147880d640 1 -- 172.21.15.2:0/883917473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1474101de0 msgr2=0x7f14741983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:29.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.023+0000 7f147880d640 1 --2- 172.21.15.2:0/883917473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1474101de0 0x7f14741983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:29.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.023+0000 7f147880d640 1 -- 172.21.15.2:0/883917473 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f147419d350 con 0x7f1474106f10 2024-09-19T06:12:29.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.023+0000 7f147880d640 1 --2- 172.21.15.2:0/883917473 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1474106f10 0x7f147419cc70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f146c00eaa0 tx=0x7f146c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:29.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.024+0000 7f14717fa640 1 -- 172.21.15.2:0/883917473 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146c00cdb0 con 0x7f1474106f10 2024-09-19T06:12:29.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.024+0000 7f147a270640 1 -- 172.21.15.2:0/883917473 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f147419d640 con 0x7f1474106f10 2024-09-19T06:12:29.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.024+0000 7f14717fa640 1 -- 172.21.15.2:0/883917473 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f146c005020 con 0x7f1474106f10 2024-09-19T06:12:29.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.024+0000 7f14717fa640 1 -- 172.21.15.2:0/883917473 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146c0116d0 con 0x7f1474106f10 2024-09-19T06:12:29.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.024+0000 7f147a270640 1 -- 172.21.15.2:0/883917473 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14741a4f20 con 0x7f1474106f10 2024-09-19T06:12:29.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.025+0000 7f147a270640 1 -- 172.21.15.2:0/883917473 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14741021c0 con 0x7f1474106f10 2024-09-19T06:12:29.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.026+0000 7f14717fa640 1 -- 172.21.15.2:0/883917473 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f146c0051d0 con 0x7f1474106f10 2024-09-19T06:12:29.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.027+0000 7f14717fa640 1 --2- 172.21.15.2:0/883917473 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f145c0a3240 0x7f145c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:29.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.027+0000 7f1473fff640 1 --2- 172.21.15.2:0/883917473 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f145c0a3240 0x7f145c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:29.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.027+0000 7f14717fa640 1 -- 172.21.15.2:0/883917473 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f146c0cf6b0 con 0x7f1474106f10 2024-09-19T06:12:29.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.027+0000 7f1473fff640 1 --2- 172.21.15.2:0/883917473 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f145c0a3240 0x7f145c0a5700 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1464005fd0 tx=0x7f1464005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:29.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.032+0000 7f14717fa640 1 -- 172.21.15.2:0/883917473 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f146c016030 con 0x7f1474106f10 2024-09-19T06:12:29.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.251+0000 7f147a270640 1 -- 172.21.15.2:0/883917473 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f147402d7c0 con 0x7f1474106f10 2024-09-19T06:12:29.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.251+0000 7f14717fa640 1 -- 172.21.15.2:0/883917473 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3079 (secure 0 0 0) 0x7f146c09c870 con 0x7f1474106f10 2024-09-19T06:12:29.254 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:12:29.254 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":4,"btime":"2024-09-19T06:12:28:927539+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T06:12:29.254 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 4 2024-09-19T06:12:29.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.254+0000 7f147a270640 1 -- 172.21.15.2:0/883917473 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f145c0a3240 msgr2=0x7f145c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:29.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.254+0000 7f147a270640 1 --2- 172.21.15.2:0/883917473 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f145c0a3240 0x7f145c0a5700 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1464005fd0 tx=0x7f1464005850 comp rx=0 tx=0).stop 2024-09-19T06:12:29.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.254+0000 7f147a270640 1 -- 172.21.15.2:0/883917473 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1474106f10 msgr2=0x7f147419cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:29.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.254+0000 7f147a270640 1 --2- 172.21.15.2:0/883917473 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1474106f10 0x7f147419cc70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f146c00eaa0 tx=0x7f146c00ef60 comp rx=0 tx=0).stop 2024-09-19T06:12:29.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.254+0000 7f147a270640 1 -- 172.21.15.2:0/883917473 shutdown_connections 2024-09-19T06:12:29.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.254+0000 7f147a270640 1 --2- 172.21.15.2:0/883917473 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f145c0a3240 0x7f145c0a5700 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:29.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.254+0000 7f147a270640 1 --2- 172.21.15.2:0/883917473 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1474106f10 0x7f147419cc70 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:29.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.254+0000 7f147a270640 1 --2- 172.21.15.2:0/883917473 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1474102790 0x7f14741988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:29.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.254+0000 7f147a270640 1 --2- 172.21.15.2:0/883917473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1474101de0 0x7f14741983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:29.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.254+0000 7f147a270640 1 -- 172.21.15.2:0/883917473 >> 172.21.15.2:0/883917473 conn(0x7f14740fd8c0 msgr2=0x7f14740feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:29.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.254+0000 7f147a270640 1 -- 172.21.15.2:0/883917473 shutdown_connections 2024-09-19T06:12:29.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:29.254+0000 7f147a270640 1 -- 172.21.15.2:0/883917473 wait complete. 2024-09-19T06:12:29.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:29 smithi089 ceph-mon[34160]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:29.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:29 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:29.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:29 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:29.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:29 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:29.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:29 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:12:29.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:29 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:12:29.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:29 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:29.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:29 smithi089 ceph-mon[34160]: Deploying daemon mds.d on smithi002 2024-09-19T06:12:29.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:29 smithi089 ceph-mon[34160]: mds.? [v2:172.21.15.2:6834/528892925,v1:172.21.15.2:6835/528892925] up:boot 2024-09-19T06:12:29.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:29 smithi089 ceph-mon[34160]: fsmap 3 up:standby 2024-09-19T06:12:29.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:29 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T06:12:29.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:29 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/883917473' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:12:29.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:29 smithi002 ceph-mon[30982]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:29.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:29 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:29.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:29 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:29.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:29 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:29.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:29 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:12:29.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:29 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:12:29.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:29 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:29.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:29 smithi002 ceph-mon[30982]: Deploying daemon mds.d on smithi002 2024-09-19T06:12:29.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:29 smithi002 ceph-mon[30982]: mds.? [v2:172.21.15.2:6834/528892925,v1:172.21.15.2:6835/528892925] up:boot 2024-09-19T06:12:29.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:29 smithi002 ceph-mon[30982]: fsmap 3 up:standby 2024-09-19T06:12:29.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:29 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T06:12:29.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:29 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/883917473' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:12:29.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:29 smithi090 ceph-mon[34497]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:29.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:29 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:29.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:29 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:29.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:29 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:29.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:29 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:12:29.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:29 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:12:29.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:29 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:29.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:29 smithi090 ceph-mon[34497]: Deploying daemon mds.d on smithi002 2024-09-19T06:12:29.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:29 smithi090 ceph-mon[34497]: mds.? [v2:172.21.15.2:6834/528892925,v1:172.21.15.2:6835/528892925] up:boot 2024-09-19T06:12:29.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:29 smithi090 ceph-mon[34497]: fsmap 3 up:standby 2024-09-19T06:12:29.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:29 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T06:12:29.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:29 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/883917473' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:12:31.472 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 19 06:12:31 smithi002 systemd[1]: Starting Ceph mds.d for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:12:31.765 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:31 smithi002 ceph-mon[30982]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:31.765 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 19 06:12:31 smithi002 podman[70279]: 2024-09-19 06:12:31.50127124 +0000 UTC m=+0.109413646 container create fe9f8ad5291e77d3114a5b2d3e63b033081fd77ece2003caf4f1122ce2b1c428 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-2f599a4, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-19T06:12:31.766 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 19 06:12:31 smithi002 podman[70279]: 2024-09-19 06:12:31.408205823 +0000 UTC m=+0.016348229 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:12:31.766 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 19 06:12:31 smithi002 podman[70279]: 2024-09-19 06:12:31.737127187 +0000 UTC m=+0.345269593 container init fe9f8ad5291e77d3114a5b2d3e63b033081fd77ece2003caf4f1122ce2b1c428 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-d, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-19T06:12:31.766 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 19 06:12:31 smithi002 podman[70279]: 2024-09-19 06:12:31.740256122 +0000 UTC m=+0.348398530 container start fe9f8ad5291e77d3114a5b2d3e63b033081fd77ece2003caf4f1122ce2b1c428 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-d, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4) 2024-09-19T06:12:31.766 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 19 06:12:31 smithi002 ceph-mds[70298]: -- 172.21.15.2:0/748994166 <== mon.0 v2:172.21.15.2:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b8e0e45860 con 0x55b8e0e23000 2024-09-19T06:12:31.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:31 smithi090 ceph-mon[34497]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:32.044 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:31 smithi089 ceph-mon[34160]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:32.222 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 19 06:12:31 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-d[70294]: starting mds.d at 2024-09-19T06:12:32.222 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 19 06:12:31 smithi002 bash[70279]: fe9f8ad5291e77d3114a5b2d3e63b033081fd77ece2003caf4f1122ce2b1c428 2024-09-19T06:12:32.223 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 19 06:12:31 smithi002 systemd[1]: Started Ceph mds.d for 078f6612-764d-11ef-bceb-c7b262605968. 2024-09-19T06:12:32.369 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:12:32.635 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:12:33.025 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:32 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:33.025 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:32 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:33.025 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:32 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:33.025 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:32 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:12:33.025 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:32 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:12:33.025 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:32 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:33.025 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:32 smithi002 ceph-mon[30982]: Deploying daemon mds.e on smithi089 2024-09-19T06:12:33.025 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:32 smithi002 ceph-mon[30982]: mds.? [v2:172.21.15.2:6836/2791215527,v1:172.21.15.2:6837/2791215527] up:boot 2024-09-19T06:12:33.025 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:32 smithi002 ceph-mon[30982]: fsmap 4 up:standby 2024-09-19T06:12:33.026 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:32 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T06:12:33.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.106+0000 7fdb5565c640 1 -- 172.21.15.2:0/1018148158 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb50106f20 msgr2=0x7fdb5010eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:33.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.106+0000 7fdb5565c640 1 --2- 172.21.15.2:0/1018148158 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb50106f20 0x7fdb5010eaa0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdb48009900 tx=0x7fdb4802a410 comp rx=0 tx=0).stop 2024-09-19T06:12:33.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.106+0000 7fdb5565c640 1 -- 172.21.15.2:0/1018148158 shutdown_connections 2024-09-19T06:12:33.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.106+0000 7fdb5565c640 1 --2- 172.21.15.2:0/1018148158 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb50106f20 0x7fdb5010eaa0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:33.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.106+0000 7fdb5565c640 1 --2- 172.21.15.2:0/1018148158 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb501027a0 0x7fdb501067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:33.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.106+0000 7fdb5565c640 1 --2- 172.21.15.2:0/1018148158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb50101df0 0x7fdb501021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:33.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.106+0000 7fdb5565c640 1 -- 172.21.15.2:0/1018148158 >> 172.21.15.2:0/1018148158 conn(0x7fdb500fd8b0 msgr2=0x7fdb500ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:33.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.106+0000 7fdb5565c640 1 -- 172.21.15.2:0/1018148158 shutdown_connections 2024-09-19T06:12:33.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.106+0000 7fdb5565c640 1 -- 172.21.15.2:0/1018148158 wait complete. 2024-09-19T06:12:33.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.107+0000 7fdb5565c640 1 Processor -- start 2024-09-19T06:12:33.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.107+0000 7fdb5565c640 1 -- start start 2024-09-19T06:12:33.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.107+0000 7fdb5565c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb50101df0 0x7fdb50198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:33.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.107+0000 7fdb5565c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb501027a0 0x7fdb501988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:33.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.107+0000 7fdb5565c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb50106f20 0x7fdb5019cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:33.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.107+0000 7fdb5565c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdb50111e50 con 0x7fdb50106f20 2024-09-19T06:12:33.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.107+0000 7fdb5565c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fdb50111cd0 con 0x7fdb50101df0 2024-09-19T06:12:33.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.107+0000 7fdb5565c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdb50111fd0 con 0x7fdb501027a0 2024-09-19T06:12:33.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.107+0000 7fdb4f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb50106f20 0x7fdb5019cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:33.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.107+0000 7fdb4f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb50106f20 0x7fdb5019cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52236/0 (socket says 172.21.15.2:52236) 2024-09-19T06:12:33.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.107+0000 7fdb4f7fe640 1 -- 172.21.15.2:0/932518288 learned_addr learned my addr 172.21.15.2:0/932518288 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:12:33.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.107+0000 7fdb4effd640 1 --2- 172.21.15.2:0/932518288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb50101df0 0x7fdb50198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:33.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.108+0000 7fdb4e7fc640 1 --2- 172.21.15.2:0/932518288 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb501027a0 0x7fdb501988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:33.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.108+0000 7fdb4f7fe640 1 -- 172.21.15.2:0/932518288 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb501027a0 msgr2=0x7fdb501988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:33.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.108+0000 7fdb4f7fe640 1 --2- 172.21.15.2:0/932518288 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb501027a0 0x7fdb501988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:33.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.108+0000 7fdb4f7fe640 1 -- 172.21.15.2:0/932518288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb50101df0 msgr2=0x7fdb50198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:33.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.108+0000 7fdb4f7fe640 1 --2- 172.21.15.2:0/932518288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb50101df0 0x7fdb50198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:33.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.108+0000 7fdb4f7fe640 1 -- 172.21.15.2:0/932518288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb5019d320 con 0x7fdb50106f20 2024-09-19T06:12:33.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.108+0000 7fdb4e7fc640 1 --2- 172.21.15.2:0/932518288 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb501027a0 0x7fdb501988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:12:33.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.108+0000 7fdb4f7fe640 1 --2- 172.21.15.2:0/932518288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb50106f20 0x7fdb5019cc40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdb48009230 tx=0x7fdb48004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:33.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.108+0000 7fdb37fff640 1 -- 172.21.15.2:0/932518288 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4803f030 con 0x7fdb50106f20 2024-09-19T06:12:33.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.108+0000 7fdb37fff640 1 -- 172.21.15.2:0/932518288 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdb48003aa0 con 0x7fdb50106f20 2024-09-19T06:12:33.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.108+0000 7fdb5565c640 1 -- 172.21.15.2:0/932518288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb5019d5b0 con 0x7fdb50106f20 2024-09-19T06:12:33.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.108+0000 7fdb37fff640 1 -- 172.21.15.2:0/932518288 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb48035070 con 0x7fdb50106f20 2024-09-19T06:12:33.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.108+0000 7fdb5565c640 1 -- 172.21.15.2:0/932518288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb501a4ef0 con 0x7fdb50106f20 2024-09-19T06:12:33.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.109+0000 7fdb5565c640 1 -- 172.21.15.2:0/932518288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb501021d0 con 0x7fdb50106f20 2024-09-19T06:12:33.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.110+0000 7fdb37fff640 1 -- 172.21.15.2:0/932518288 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fdb48042030 con 0x7fdb50106f20 2024-09-19T06:12:33.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.111+0000 7fdb37fff640 1 --2- 172.21.15.2:0/932518288 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fdb380a3240 0x7fdb380a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:33.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.111+0000 7fdb37fff640 1 -- 172.21.15.2:0/932518288 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fdb480efca0 con 0x7fdb50106f20 2024-09-19T06:12:33.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.111+0000 7fdb4effd640 1 --2- 172.21.15.2:0/932518288 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fdb380a3240 0x7fdb380a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:33.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.111+0000 7fdb4effd640 1 --2- 172.21.15.2:0/932518288 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fdb380a3240 0x7fdb380a5700 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdb40005fd0 tx=0x7fdb40009870 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:33.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.115+0000 7fdb37fff640 1 -- 172.21.15.2:0/932518288 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdb480bce60 con 0x7fdb50106f20 2024-09-19T06:12:33.158 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:32 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:33.158 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:32 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:33.158 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:32 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:33.158 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:32 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:12:33.158 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:32 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:12:33.159 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:32 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:33.159 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:32 smithi089 ceph-mon[34160]: Deploying daemon mds.e on smithi089 2024-09-19T06:12:33.159 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:32 smithi089 ceph-mon[34160]: mds.? [v2:172.21.15.2:6836/2791215527,v1:172.21.15.2:6837/2791215527] up:boot 2024-09-19T06:12:33.159 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:32 smithi089 ceph-mon[34160]: fsmap 4 up:standby 2024-09-19T06:12:33.159 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:32 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T06:12:33.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:32 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:33.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:32 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:33.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:32 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:33.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:32 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:12:33.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:32 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:12:33.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:32 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:33.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:32 smithi090 ceph-mon[34497]: Deploying daemon mds.e on smithi089 2024-09-19T06:12:33.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:32 smithi090 ceph-mon[34497]: mds.? [v2:172.21.15.2:6836/2791215527,v1:172.21.15.2:6837/2791215527] up:boot 2024-09-19T06:12:33.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:32 smithi090 ceph-mon[34497]: fsmap 4 up:standby 2024-09-19T06:12:33.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:32 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T06:12:33.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.327+0000 7fdb5565c640 1 -- 172.21.15.2:0/932518288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb5010a100 con 0x7fdb50106f20 2024-09-19T06:12:33.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.328+0000 7fdb37fff640 1 -- 172.21.15.2:0/932518288 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3901 (secure 0 0 0) 0x7fdb480bc760 con 0x7fdb50106f20 2024-09-19T06:12:33.330 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:12:33.330 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":5,"btime":"2024-09-19T06:12:32:543148+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T06:12:33.330 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 5 2024-09-19T06:12:33.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.330+0000 7fdb5565c640 1 -- 172.21.15.2:0/932518288 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fdb380a3240 msgr2=0x7fdb380a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:33.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.330+0000 7fdb5565c640 1 --2- 172.21.15.2:0/932518288 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fdb380a3240 0x7fdb380a5700 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdb40005fd0 tx=0x7fdb40009870 comp rx=0 tx=0).stop 2024-09-19T06:12:33.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.330+0000 7fdb5565c640 1 -- 172.21.15.2:0/932518288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb50106f20 msgr2=0x7fdb5019cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:33.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.330+0000 7fdb5565c640 1 --2- 172.21.15.2:0/932518288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb50106f20 0x7fdb5019cc40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdb48009230 tx=0x7fdb48004270 comp rx=0 tx=0).stop 2024-09-19T06:12:33.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.330+0000 7fdb5565c640 1 -- 172.21.15.2:0/932518288 shutdown_connections 2024-09-19T06:12:33.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.330+0000 7fdb5565c640 1 --2- 172.21.15.2:0/932518288 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fdb380a3240 0x7fdb380a5700 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:33.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.330+0000 7fdb5565c640 1 --2- 172.21.15.2:0/932518288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb50106f20 0x7fdb5019cc40 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:33.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.330+0000 7fdb5565c640 1 --2- 172.21.15.2:0/932518288 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb501027a0 0x7fdb501988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:33.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.330+0000 7fdb5565c640 1 --2- 172.21.15.2:0/932518288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb50101df0 0x7fdb50198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:33.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.330+0000 7fdb5565c640 1 -- 172.21.15.2:0/932518288 >> 172.21.15.2:0/932518288 conn(0x7fdb500fd8b0 msgr2=0x7fdb500fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:33.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.330+0000 7fdb5565c640 1 -- 172.21.15.2:0/932518288 shutdown_connections 2024-09-19T06:12:33.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:33.330+0000 7fdb5565c640 1 -- 172.21.15.2:0/932518288 wait complete. 2024-09-19T06:12:33.792 INFO:journalctl@ceph.mds.e.smithi089.stdout:Sep 19 06:12:33 smithi089 systemd[1]: Starting Ceph mds.e for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:12:34.071 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:33 smithi002 ceph-mon[30982]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:34.071 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:33 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/932518288' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:12:34.089 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:33 smithi089 ceph-mon[34160]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:34.089 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:33 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/932518288' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:12:34.089 INFO:journalctl@ceph.mds.e.smithi089.stdout:Sep 19 06:12:33 smithi089 podman[63241]: 2024-09-19 06:12:33.733384978 +0000 UTC m=+0.016174611 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:12:34.089 INFO:journalctl@ceph.mds.e.smithi089.stdout:Sep 19 06:12:33 smithi089 podman[63241]: 2024-09-19 06:12:33.834182295 +0000 UTC m=+0.116971917 container create 886a88d8b8ad245715ae2575c233baff337dc38a5c7d811de830350488f58472 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-e, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-19T06:12:34.089 INFO:journalctl@ceph.mds.e.smithi089.stdout:Sep 19 06:12:34 smithi089 podman[63241]: 2024-09-19 06:12:34.061742922 +0000 UTC m=+0.344532551 container init 886a88d8b8ad245715ae2575c233baff337dc38a5c7d811de830350488f58472 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-e, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0) 2024-09-19T06:12:34.090 INFO:journalctl@ceph.mds.e.smithi089.stdout:Sep 19 06:12:34 smithi089 podman[63241]: 2024-09-19 06:12:34.064521976 +0000 UTC m=+0.347311608 container start 886a88d8b8ad245715ae2575c233baff337dc38a5c7d811de830350488f58472 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-19T06:12:34.090 INFO:journalctl@ceph.mds.e.smithi089.stdout:Sep 19 06:12:34 smithi089 ceph-mds[63261]: -- 172.21.15.89:0/184754373 <== mon.2 v2:172.21.15.89:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d884669860 con 0x55d884646800 2024-09-19T06:12:34.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:33 smithi090 ceph-mon[34497]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:34.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:33 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/932518288' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:12:34.542 INFO:journalctl@ceph.mds.e.smithi089.stdout:Sep 19 06:12:34 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-e[63257]: starting mds.e at 2024-09-19T06:12:34.542 INFO:journalctl@ceph.mds.e.smithi089.stdout:Sep 19 06:12:34 smithi089 bash[63241]: 886a88d8b8ad245715ae2575c233baff337dc38a5c7d811de830350488f58472 2024-09-19T06:12:34.542 INFO:journalctl@ceph.mds.e.smithi089.stdout:Sep 19 06:12:34 smithi089 systemd[1]: Started Ceph mds.e for 078f6612-764d-11ef-bceb-c7b262605968. 2024-09-19T06:12:35.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:35 smithi002 ceph-mon[30982]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:35.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:35 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:35.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:35 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:35.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:35 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:35.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:35 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:12:35.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:35 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:12:35.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:35 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:35.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:35 smithi002 ceph-mon[30982]: Deploying daemon mds.f on smithi090 2024-09-19T06:12:35.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:35 smithi002 ceph-mon[30982]: mds.? [v2:172.21.15.89:6834/56684343,v1:172.21.15.89:6835/56684343] up:boot 2024-09-19T06:12:35.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:35 smithi002 ceph-mon[30982]: fsmap 5 up:standby 2024-09-19T06:12:35.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:35 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T06:12:35.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:35 smithi090 ceph-mon[34497]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:35.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:35 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:35.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:35 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:35.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:35 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:35.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:35 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:12:35.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:35 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:12:35.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:35 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:35.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:35 smithi090 ceph-mon[34497]: Deploying daemon mds.f on smithi090 2024-09-19T06:12:35.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:35 smithi090 ceph-mon[34497]: mds.? [v2:172.21.15.89:6834/56684343,v1:172.21.15.89:6835/56684343] up:boot 2024-09-19T06:12:35.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:35 smithi090 ceph-mon[34497]: fsmap 5 up:standby 2024-09-19T06:12:35.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:35 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T06:12:35.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:35 smithi089 ceph-mon[34160]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:35.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:35 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:35.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:35 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:35.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:35 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:35.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:35 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:12:35.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:35 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:12:35.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:35 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:35.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:35 smithi089 ceph-mon[34160]: Deploying daemon mds.f on smithi090 2024-09-19T06:12:35.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:35 smithi089 ceph-mon[34160]: mds.? [v2:172.21.15.89:6834/56684343,v1:172.21.15.89:6835/56684343] up:boot 2024-09-19T06:12:35.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:35 smithi089 ceph-mon[34160]: fsmap 5 up:standby 2024-09-19T06:12:35.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:35 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T06:12:36.106 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:12:36.240 INFO:journalctl@ceph.mds.f.smithi090.stdout:Sep 19 06:12:36 smithi090 systemd[1]: Starting Ceph mds.f for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:12:36.375 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:12:36.584 INFO:journalctl@ceph.mds.f.smithi090.stdout:Sep 19 06:12:36 smithi090 podman[64354]: 2024-09-19 06:12:36.219929672 +0000 UTC m=+0.015593001 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:12:36.584 INFO:journalctl@ceph.mds.f.smithi090.stdout:Sep 19 06:12:36 smithi090 podman[64354]: 2024-09-19 06:12:36.329555149 +0000 UTC m=+0.125218505 container create ec0f0937d3fc452b5ed62d5d90339c4d8440981686636d7987847849b034a30f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-f, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-19T06:12:36.584 INFO:journalctl@ceph.mds.f.smithi090.stdout:Sep 19 06:12:36 smithi090 podman[64354]: 2024-09-19 06:12:36.557333723 +0000 UTC m=+0.352997048 container init ec0f0937d3fc452b5ed62d5d90339c4d8440981686636d7987847849b034a30f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-f, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-2f599a4) 2024-09-19T06:12:36.584 INFO:journalctl@ceph.mds.f.smithi090.stdout:Sep 19 06:12:36 smithi090 podman[64354]: 2024-09-19 06:12:36.56001734 +0000 UTC m=+0.355680672 container start ec0f0937d3fc452b5ed62d5d90339c4d8440981686636d7987847849b034a30f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-f, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2) 2024-09-19T06:12:36.584 INFO:journalctl@ceph.mds.f.smithi090.stdout:Sep 19 06:12:36 smithi090 ceph-mds[64374]: -- 172.21.15.90:0/596144867 <== mon.1 v2:172.21.15.90:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5557d199d860 con 0x5557d197b000 2024-09-19T06:12:36.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:36.814+0000 7fa91743c640 1 -- 172.21.15.2:0/3129895835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa910103660 msgr2=0x7fa91010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:36.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:36.814+0000 7fa91743c640 1 --2- 172.21.15.2:0/3129895835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa910103660 0x7fa91010bb50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa900009900 tx=0x7fa90002a480 comp rx=0 tx=0).stop 2024-09-19T06:12:36.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:36.814+0000 7fa91743c640 1 -- 172.21.15.2:0/3129895835 shutdown_connections 2024-09-19T06:12:36.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:36.814+0000 7fa91743c640 1 --2- 172.21.15.2:0/3129895835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa91010c170 0x7fa91010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:36.814+0000 7fa91743c640 1 --2- 172.21.15.2:0/3129895835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa910103660 0x7fa91010bb50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:36.814+0000 7fa91743c640 1 --2- 172.21.15.2:0/3129895835 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa910102d40 0x7fa910103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:36.814+0000 7fa91743c640 1 -- 172.21.15.2:0/3129895835 >> 172.21.15.2:0/3129895835 conn(0x7fa9100fc7a0 msgr2=0x7fa9100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:36.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:36.814+0000 7fa91743c640 1 -- 172.21.15.2:0/3129895835 shutdown_connections 2024-09-19T06:12:36.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:36.814+0000 7fa91743c640 1 -- 172.21.15.2:0/3129895835 wait complete. 2024-09-19T06:12:36.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:36.815+0000 7fa91743c640 1 Processor -- start 2024-09-19T06:12:36.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:36.815+0000 7fa91743c640 1 -- start start 2024-09-19T06:12:36.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:36.815+0000 7fa91743c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa910102d40 0x7fa910198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:36.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:36.815+0000 7fa91743c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa910103660 0x7fa9101988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:36.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:36.815+0000 7fa91743c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa91010c170 0x7fa91019cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:36.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:36.815+0000 7fa91743c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa910111e20 con 0x7fa910102d40 2024-09-19T06:12:36.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:36.815+0000 7fa91743c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa910111ca0 con 0x7fa91010c170 2024-09-19T06:12:36.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:36.815+0000 7fa91743c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa910111fa0 con 0x7fa910103660 2024-09-19T06:12:36.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:36.815+0000 7fa9151d8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa910102d40 0x7fa910198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:36.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:36.815+0000 7fa9151d8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa910102d40 0x7fa910198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54902/0 (socket says 172.21.15.2:54902) 2024-09-19T06:12:36.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:36.815+0000 7fa9151d8640 1 -- 172.21.15.2:0/1712027613 learned_addr learned my addr 172.21.15.2:0/1712027613 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:12:36.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:36.815+0000 7fa9149d7640 1 --2- 172.21.15.2:0/1712027613 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa910103660 0x7fa9101988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:36.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:36.815+0000 7fa9159d9640 1 --2- 172.21.15.2:0/1712027613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa91010c170 0x7fa91019cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:36.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:36.815+0000 7fa9151d8640 1 -- 172.21.15.2:0/1712027613 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa910103660 msgr2=0x7fa9101988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:36.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:36.815+0000 7fa9151d8640 1 --2- 172.21.15.2:0/1712027613 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa910103660 0x7fa9101988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:36.815+0000 7fa9151d8640 1 -- 172.21.15.2:0/1712027613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa91010c170 msgr2=0x7fa91019cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:36.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:36.815+0000 7fa9151d8640 1 --2- 172.21.15.2:0/1712027613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa91010c170 0x7fa91019cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:36.815+0000 7fa9151d8640 1 -- 172.21.15.2:0/1712027613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa91019d320 con 0x7fa910102d40 2024-09-19T06:12:36.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:36.816+0000 7fa9159d9640 1 --2- 172.21.15.2:0/1712027613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa91010c170 0x7fa91019cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:12:36.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:36.816+0000 7fa9149d7640 1 --2- 172.21.15.2:0/1712027613 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa910103660 0x7fa9101988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:36.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:36.816+0000 7fa9151d8640 1 --2- 172.21.15.2:0/1712027613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa910102d40 0x7fa910198370 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa90c00e9f0 tx=0x7fa90c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:36.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:36.816+0000 7fa9067fc640 1 -- 172.21.15.2:0/1712027613 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90c00cd80 con 0x7fa910102d40 2024-09-19T06:12:36.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:36.816+0000 7fa9067fc640 1 -- 172.21.15.2:0/1712027613 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa90c0054d0 con 0x7fa910102d40 2024-09-19T06:12:36.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:36.816+0000 7fa91743c640 1 -- 172.21.15.2:0/1712027613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa91019d610 con 0x7fa910102d40 2024-09-19T06:12:36.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:36.816+0000 7fa9067fc640 1 -- 172.21.15.2:0/1712027613 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90c010490 con 0x7fa910102d40 2024-09-19T06:12:36.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:36.816+0000 7fa91743c640 1 -- 172.21.15.2:0/1712027613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9101a4ef0 con 0x7fa910102d40 2024-09-19T06:12:36.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:36.817+0000 7fa91743c640 1 -- 172.21.15.2:0/1712027613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa910103120 con 0x7fa910102d40 2024-09-19T06:12:36.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:36.818+0000 7fa9067fc640 1 -- 172.21.15.2:0/1712027613 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fa90c005020 con 0x7fa910102d40 2024-09-19T06:12:36.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:36.819+0000 7fa9067fc640 1 --2- 172.21.15.2:0/1712027613 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fa8fc0a3240 0x7fa8fc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:36.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:36.819+0000 7fa9149d7640 1 --2- 172.21.15.2:0/1712027613 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fa8fc0a3240 0x7fa8fc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:36.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:36.819+0000 7fa9067fc640 1 -- 172.21.15.2:0/1712027613 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fa90c0cf920 con 0x7fa910102d40 2024-09-19T06:12:36.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:36.819+0000 7fa9149d7640 1 --2- 172.21.15.2:0/1712027613 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fa8fc0a3240 0x7fa8fc0a5700 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa900031440 tx=0x7fa900005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:36.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:36.823+0000 7fa9067fc640 1 -- 172.21.15.2:0/1712027613 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa90c09ca40 con 0x7fa910102d40 2024-09-19T06:12:36.990 INFO:journalctl@ceph.mds.f.smithi090.stdout:Sep 19 06:12:36 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-f[64370]: starting mds.f at 2024-09-19T06:12:36.990 INFO:journalctl@ceph.mds.f.smithi090.stdout:Sep 19 06:12:36 smithi090 bash[64354]: ec0f0937d3fc452b5ed62d5d90339c4d8440981686636d7987847849b034a30f 2024-09-19T06:12:36.990 INFO:journalctl@ceph.mds.f.smithi090.stdout:Sep 19 06:12:36 smithi090 systemd[1]: Started Ceph mds.f for 078f6612-764d-11ef-bceb-c7b262605968. 2024-09-19T06:12:37.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:37.035+0000 7fa91743c640 1 -- 172.21.15.2:0/1712027613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa910107210 con 0x7fa910102d40 2024-09-19T06:12:37.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:37.036+0000 7fa9067fc640 1 -- 172.21.15.2:0/1712027613 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4720 (secure 0 0 0) 0x7fa90c09c340 con 0x7fa910102d40 2024-09-19T06:12:37.038 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:12:37.038 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":6,"btime":"2024-09-19T06:12:34:896185+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-19T06:12:37.038 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 6 2024-09-19T06:12:37.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:37.038+0000 7fa91743c640 1 -- 172.21.15.2:0/1712027613 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fa8fc0a3240 msgr2=0x7fa8fc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:37.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:37.038+0000 7fa91743c640 1 --2- 172.21.15.2:0/1712027613 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fa8fc0a3240 0x7fa8fc0a5700 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa900031440 tx=0x7fa900005b50 comp rx=0 tx=0).stop 2024-09-19T06:12:37.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:37.038+0000 7fa91743c640 1 -- 172.21.15.2:0/1712027613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa910102d40 msgr2=0x7fa910198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:37.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:37.038+0000 7fa91743c640 1 --2- 172.21.15.2:0/1712027613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa910102d40 0x7fa910198370 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa90c00e9f0 tx=0x7fa90c00edf0 comp rx=0 tx=0).stop 2024-09-19T06:12:37.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:37.038+0000 7fa91743c640 1 -- 172.21.15.2:0/1712027613 shutdown_connections 2024-09-19T06:12:37.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:37.038+0000 7fa91743c640 1 --2- 172.21.15.2:0/1712027613 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fa8fc0a3240 0x7fa8fc0a5700 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:37.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:37.038+0000 7fa91743c640 1 --2- 172.21.15.2:0/1712027613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa91010c170 0x7fa91019cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:37.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:37.038+0000 7fa91743c640 1 --2- 172.21.15.2:0/1712027613 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa910103660 0x7fa9101988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:37.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:37.038+0000 7fa91743c640 1 --2- 172.21.15.2:0/1712027613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa910102d40 0x7fa910198370 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:37.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:37.038+0000 7fa91743c640 1 -- 172.21.15.2:0/1712027613 >> 172.21.15.2:0/1712027613 conn(0x7fa9100fc7a0 msgr2=0x7fa9100fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:37.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:37.038+0000 7fa91743c640 1 -- 172.21.15.2:0/1712027613 shutdown_connections 2024-09-19T06:12:37.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:37.038+0000 7fa91743c640 1 -- 172.21.15.2:0/1712027613 wait complete. 2024-09-19T06:12:37.761 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:37 smithi002 ceph-mon[30982]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:37.761 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:37 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:37.761 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:37 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:37.761 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:37 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:37.761 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:37 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:12:37.761 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:37 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:12:37.761 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:37 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:37.762 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:37 smithi002 ceph-mon[30982]: Deploying daemon mds.c on smithi090 2024-09-19T06:12:37.762 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:37 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1712027613' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:12:37.762 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:37 smithi002 ceph-mon[30982]: mds.? [v2:172.21.15.90:6834/1607170353,v1:172.21.15.90:6835/1607170353] up:boot 2024-09-19T06:12:37.762 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:37 smithi002 ceph-mon[30982]: fsmap 6 up:standby 2024-09-19T06:12:37.762 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:37 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T06:12:37.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:37 smithi090 ceph-mon[34497]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:37.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:37 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:37.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:37 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:37.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:37 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:37.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:37 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:12:37.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:37 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:12:37.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:37 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:37.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:37 smithi090 ceph-mon[34497]: Deploying daemon mds.c on smithi090 2024-09-19T06:12:37.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:37 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1712027613' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:12:37.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:37 smithi090 ceph-mon[34497]: mds.? [v2:172.21.15.90:6834/1607170353,v1:172.21.15.90:6835/1607170353] up:boot 2024-09-19T06:12:37.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:37 smithi090 ceph-mon[34497]: fsmap 6 up:standby 2024-09-19T06:12:37.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:37 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T06:12:38.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:37 smithi089 ceph-mon[34160]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:38.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:37 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:38.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:37 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:38.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:37 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:38.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:37 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:12:38.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:37 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:12:38.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:37 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:38.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:37 smithi089 ceph-mon[34160]: Deploying daemon mds.c on smithi090 2024-09-19T06:12:38.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:37 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1712027613' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:12:38.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:37 smithi089 ceph-mon[34160]: mds.? [v2:172.21.15.90:6834/1607170353,v1:172.21.15.90:6835/1607170353] up:boot 2024-09-19T06:12:38.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:37 smithi089 ceph-mon[34160]: fsmap 6 up:standby 2024-09-19T06:12:38.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:37 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T06:12:38.740 INFO:journalctl@ceph.mds.c.smithi090.stdout:Sep 19 06:12:38 smithi090 systemd[1]: Starting Ceph mds.c for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:12:39.077 INFO:journalctl@ceph.mds.c.smithi090.stdout:Sep 19 06:12:38 smithi090 podman[64657]: 2024-09-19 06:12:38.709740582 +0000 UTC m=+0.015801567 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:12:39.077 INFO:journalctl@ceph.mds.c.smithi090.stdout:Sep 19 06:12:38 smithi090 podman[64657]: 2024-09-19 06:12:38.821793649 +0000 UTC m=+0.127854670 container create e0f74ff4e3feb06550129c1ce97170aff6ab7badb96cf7678789979dca140000 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-c, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-19T06:12:39.077 INFO:journalctl@ceph.mds.c.smithi090.stdout:Sep 19 06:12:39 smithi090 podman[64657]: 2024-09-19 06:12:39.049735034 +0000 UTC m=+0.355796022 container init e0f74ff4e3feb06550129c1ce97170aff6ab7badb96cf7678789979dca140000 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-19T06:12:39.077 INFO:journalctl@ceph.mds.c.smithi090.stdout:Sep 19 06:12:39 smithi090 podman[64657]: 2024-09-19 06:12:39.052563401 +0000 UTC m=+0.358624381 container start e0f74ff4e3feb06550129c1ce97170aff6ab7badb96cf7678789979dca140000 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-c, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-19T06:12:39.490 INFO:journalctl@ceph.mds.c.smithi090.stdout:Sep 19 06:12:39 smithi090 ceph-mds[64676]: -- 172.21.15.90:0/2808604058 <== mon.1 v2:172.21.15.90:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56267d805860 con 0x56267d7e2800 2024-09-19T06:12:39.490 INFO:journalctl@ceph.mds.c.smithi090.stdout:Sep 19 06:12:39 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-c[64672]: starting mds.c at 2024-09-19T06:12:39.490 INFO:journalctl@ceph.mds.c.smithi090.stdout:Sep 19 06:12:39 smithi090 bash[64657]: e0f74ff4e3feb06550129c1ce97170aff6ab7badb96cf7678789979dca140000 2024-09-19T06:12:39.490 INFO:journalctl@ceph.mds.c.smithi090.stdout:Sep 19 06:12:39 smithi090 systemd[1]: Started Ceph mds.c for 078f6612-764d-11ef-bceb-c7b262605968. 2024-09-19T06:12:39.798 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:12:39.903 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:39 smithi089 ceph-mon[34160]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:39.903 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:39 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:39.903 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:39 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:39.903 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:39 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:39.903 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:39 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:12:39.903 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:39 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:12:39.903 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:39 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:39.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:39 smithi002 ceph-mon[30982]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:39.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:39 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:39.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:39 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:39.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:39 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:39.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:39 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:12:39.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:39 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:12:39.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:39 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:39.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:39 smithi090 ceph-mon[34497]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:39.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:39 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:39.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:39 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:39.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:39 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:39.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:39 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:12:39.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:39 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:12:39.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:39 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:40.075 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:12:40.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.542+0000 7fbaa47c5640 1 -- 172.21.15.2:0/513074748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba9c100e20 msgr2=0x7fba9c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:40.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.542+0000 7fbaa47c5640 1 --2- 172.21.15.2:0/513074748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba9c100e20 0x7fba9c101200 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fba8c009ca0 tx=0x7fba8c02a950 comp rx=0 tx=0).stop 2024-09-19T06:12:40.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.543+0000 7fbaa47c5640 1 -- 172.21.15.2:0/513074748 shutdown_connections 2024-09-19T06:12:40.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.543+0000 7fbaa47c5640 1 --2- 172.21.15.2:0/513074748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba9c102ef0 0x7fba9c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:40.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.543+0000 7fbaa47c5640 1 --2- 172.21.15.2:0/513074748 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba9c102570 0x7fba9c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:40.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.543+0000 7fbaa47c5640 1 --2- 172.21.15.2:0/513074748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba9c100e20 0x7fba9c101200 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:40.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.543+0000 7fbaa47c5640 1 -- 172.21.15.2:0/513074748 >> 172.21.15.2:0/513074748 conn(0x7fba9c0fc7d0 msgr2=0x7fba9c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:40.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.543+0000 7fbaa47c5640 1 -- 172.21.15.2:0/513074748 shutdown_connections 2024-09-19T06:12:40.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.543+0000 7fbaa47c5640 1 -- 172.21.15.2:0/513074748 wait complete. 2024-09-19T06:12:40.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.543+0000 7fbaa47c5640 1 Processor -- start 2024-09-19T06:12:40.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.543+0000 7fbaa47c5640 1 -- start start 2024-09-19T06:12:40.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.544+0000 7fbaa47c5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba9c100e20 0x7fba9c198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:40.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.544+0000 7fbaa47c5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba9c102570 0x7fba9c198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:40.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.544+0000 7fbaa47c5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba9c102ef0 0x7fba9c19cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:40.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.544+0000 7fbaa47c5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fba9c110e30 con 0x7fba9c100e20 2024-09-19T06:12:40.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.544+0000 7fbaa2561640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba9c100e20 0x7fba9c198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:40.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.544+0000 7fbaa47c5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fba9c110cb0 con 0x7fba9c102570 2024-09-19T06:12:40.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.544+0000 7fbaa2561640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba9c100e20 0x7fba9c198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54912/0 (socket says 172.21.15.2:54912) 2024-09-19T06:12:40.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.544+0000 7fbaa47c5640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fba9c110fb0 con 0x7fba9c102ef0 2024-09-19T06:12:40.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.544+0000 7fbaa1d60640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba9c102570 0x7fba9c198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:40.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.544+0000 7fbaa2561640 1 -- 172.21.15.2:0/3477127302 learned_addr learned my addr 172.21.15.2:0/3477127302 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:12:40.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.544+0000 7fbaa2d62640 1 --2- 172.21.15.2:0/3477127302 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba9c102ef0 0x7fba9c19cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:40.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.544+0000 7fbaa2561640 1 -- 172.21.15.2:0/3477127302 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba9c102ef0 msgr2=0x7fba9c19cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:40.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.544+0000 7fbaa2561640 1 --2- 172.21.15.2:0/3477127302 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba9c102ef0 0x7fba9c19cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:40.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.544+0000 7fbaa2561640 1 -- 172.21.15.2:0/3477127302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba9c102570 msgr2=0x7fba9c198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:40.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.544+0000 7fbaa2561640 1 --2- 172.21.15.2:0/3477127302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba9c102570 0x7fba9c198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:40.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.544+0000 7fbaa2561640 1 -- 172.21.15.2:0/3477127302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba9c19d3f0 con 0x7fba9c100e20 2024-09-19T06:12:40.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.544+0000 7fbaa2561640 1 --2- 172.21.15.2:0/3477127302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba9c100e20 0x7fba9c198440 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fba8c005cc0 tx=0x7fba8c02f3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:40.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.544+0000 7fba9b7fe640 1 -- 172.21.15.2:0/3477127302 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8c034040 con 0x7fba9c100e20 2024-09-19T06:12:40.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.545+0000 7fba9b7fe640 1 -- 172.21.15.2:0/3477127302 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fba8c0308f0 con 0x7fba9c100e20 2024-09-19T06:12:40.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.545+0000 7fbaa47c5640 1 -- 172.21.15.2:0/3477127302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba9c19d680 con 0x7fba9c100e20 2024-09-19T06:12:40.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.545+0000 7fba9b7fe640 1 -- 172.21.15.2:0/3477127302 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8c004640 con 0x7fba9c100e20 2024-09-19T06:12:40.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.545+0000 7fbaa47c5640 1 -- 172.21.15.2:0/3477127302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba9c1a4fc0 con 0x7fba9c100e20 2024-09-19T06:12:40.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.546+0000 7fbaa47c5640 1 -- 172.21.15.2:0/3477127302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba9c101200 con 0x7fba9c100e20 2024-09-19T06:12:40.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.547+0000 7fba9b7fe640 1 -- 172.21.15.2:0/3477127302 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fba8c037020 con 0x7fba9c100e20 2024-09-19T06:12:40.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.548+0000 7fba9b7fe640 1 --2- 172.21.15.2:0/3477127302 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fba840a32c0 0x7fba840a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:40.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.548+0000 7fbaa1d60640 1 --2- 172.21.15.2:0/3477127302 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fba840a32c0 0x7fba840a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:40.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.548+0000 7fba9b7fe640 1 -- 172.21.15.2:0/3477127302 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fba8c0f0400 con 0x7fba9c100e20 2024-09-19T06:12:40.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.549+0000 7fbaa1d60640 1 --2- 172.21.15.2:0/3477127302 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fba840a32c0 0x7fba840a5780 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fba9c0fef00 tx=0x7fba90005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:40.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.552+0000 7fba9b7fe640 1 -- 172.21.15.2:0/3477127302 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fba8c081210 con 0x7fba9c100e20 2024-09-19T06:12:40.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.766+0000 7fbaa47c5640 1 -- 172.21.15.2:0/3477127302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fba9c1a5190 con 0x7fba9c100e20 2024-09-19T06:12:40.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.767+0000 7fba9b7fe640 1 -- 172.21.15.2:0/3477127302 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6370 (secure 0 0 0) 0x7fba8c0bd520 con 0x7fba9c100e20 2024-09-19T06:12:40.769 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:12:40.769 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":8,"btime":"2024-09-19T06:12:39:716770+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24448,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24460,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-19T06:12:40.769 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 8 2024-09-19T06:12:40.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.769+0000 7fbaa47c5640 1 -- 172.21.15.2:0/3477127302 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fba840a32c0 msgr2=0x7fba840a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:40.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.769+0000 7fbaa47c5640 1 --2- 172.21.15.2:0/3477127302 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fba840a32c0 0x7fba840a5780 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fba9c0fef00 tx=0x7fba90005f90 comp rx=0 tx=0).stop 2024-09-19T06:12:40.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.769+0000 7fbaa47c5640 1 -- 172.21.15.2:0/3477127302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba9c100e20 msgr2=0x7fba9c198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:40.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.769+0000 7fbaa47c5640 1 --2- 172.21.15.2:0/3477127302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba9c100e20 0x7fba9c198440 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fba8c005cc0 tx=0x7fba8c02f3a0 comp rx=0 tx=0).stop 2024-09-19T06:12:40.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.769+0000 7fbaa47c5640 1 -- 172.21.15.2:0/3477127302 shutdown_connections 2024-09-19T06:12:40.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.769+0000 7fbaa47c5640 1 --2- 172.21.15.2:0/3477127302 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fba840a32c0 0x7fba840a5780 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:40.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.769+0000 7fbaa47c5640 1 --2- 172.21.15.2:0/3477127302 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba9c102ef0 0x7fba9c19cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:40.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.769+0000 7fbaa47c5640 1 --2- 172.21.15.2:0/3477127302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba9c102570 0x7fba9c198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:40.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.769+0000 7fbaa47c5640 1 --2- 172.21.15.2:0/3477127302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba9c100e20 0x7fba9c198440 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:40.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.769+0000 7fbaa47c5640 1 -- 172.21.15.2:0/3477127302 >> 172.21.15.2:0/3477127302 conn(0x7fba9c0fc7d0 msgr2=0x7fba9c069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:40.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.769+0000 7fbaa47c5640 1 -- 172.21.15.2:0/3477127302 shutdown_connections 2024-09-19T06:12:40.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:40.769+0000 7fbaa47c5640 1 -- 172.21.15.2:0/3477127302 wait complete. 2024-09-19T06:12:40.971 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:40 smithi089 ceph-mon[34160]: Deploying daemon mds.h on smithi089 2024-09-19T06:12:40.971 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:40 smithi089 ceph-mon[34160]: mds.? [v2:172.21.15.90:6836/2402014616,v1:172.21.15.90:6837/2402014616] up:boot 2024-09-19T06:12:40.971 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:40 smithi089 ceph-mon[34160]: fsmap 7 up:standby 2024-09-19T06:12:40.971 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:40 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T06:12:40.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:40 smithi002 ceph-mon[30982]: Deploying daemon mds.h on smithi089 2024-09-19T06:12:40.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:40 smithi002 ceph-mon[30982]: mds.? [v2:172.21.15.90:6836/2402014616,v1:172.21.15.90:6837/2402014616] up:boot 2024-09-19T06:12:40.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:40 smithi002 ceph-mon[30982]: fsmap 7 up:standby 2024-09-19T06:12:40.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:40 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T06:12:40.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:40 smithi090 ceph-mon[34497]: Deploying daemon mds.h on smithi089 2024-09-19T06:12:40.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:40 smithi090 ceph-mon[34497]: mds.? [v2:172.21.15.90:6836/2402014616,v1:172.21.15.90:6837/2402014616] up:boot 2024-09-19T06:12:40.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:40 smithi090 ceph-mon[34497]: fsmap 7 up:standby 2024-09-19T06:12:40.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:40 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T06:12:41.292 INFO:journalctl@ceph.mds.h.smithi089.stdout:Sep 19 06:12:41 smithi089 systemd[1]: Starting Ceph mds.h for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:12:41.658 INFO:journalctl@ceph.mds.h.smithi089.stdout:Sep 19 06:12:41 smithi089 podman[63543]: 2024-09-19 06:12:41.256558396 +0000 UTC m=+0.015803879 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:12:41.658 INFO:journalctl@ceph.mds.h.smithi089.stdout:Sep 19 06:12:41 smithi089 podman[63543]: 2024-09-19 06:12:41.354511219 +0000 UTC m=+0.113756690 container create e38fe5bd3cc8c263e3ed3c7aaf3427d025119be0b1bb6d54e5c217006225a028 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-h, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:12:41.658 INFO:journalctl@ceph.mds.h.smithi089.stdout:Sep 19 06:12:41 smithi089 podman[63543]: 2024-09-19 06:12:41.565127415 +0000 UTC m=+0.324372893 container init e38fe5bd3cc8c263e3ed3c7aaf3427d025119be0b1bb6d54e5c217006225a028 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-h, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-19T06:12:41.658 INFO:journalctl@ceph.mds.h.smithi089.stdout:Sep 19 06:12:41 smithi089 podman[63543]: 2024-09-19 06:12:41.567886142 +0000 UTC m=+0.327131613 container start e38fe5bd3cc8c263e3ed3c7aaf3427d025119be0b1bb6d54e5c217006225a028 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-h, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-19T06:12:41.658 INFO:journalctl@ceph.mds.h.smithi089.stdout:Sep 19 06:12:41 smithi089 ceph-mds[63562]: -- 172.21.15.89:0/4001881158 <== mon.2 v2:172.21.15.89:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562d348a1860 con 0x562d3487f000 2024-09-19T06:12:41.658 INFO:journalctl@ceph.mds.h.smithi089.stdout:Sep 19 06:12:41 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-h[63558]: starting mds.h at 2024-09-19T06:12:41.658 INFO:journalctl@ceph.mds.h.smithi089.stdout:Sep 19 06:12:41 smithi089 bash[63543]: e38fe5bd3cc8c263e3ed3c7aaf3427d025119be0b1bb6d54e5c217006225a028 2024-09-19T06:12:41.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:41 smithi090 ceph-mon[34497]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:41.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:41 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/3477127302' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:12:41.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:41 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:41.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:41 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:41.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:41 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:41.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:41 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:12:41.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:41 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:12:41.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:41 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:42.042 INFO:journalctl@ceph.mds.h.smithi089.stdout:Sep 19 06:12:41 smithi089 systemd[1]: Started Ceph mds.h for 078f6612-764d-11ef-bceb-c7b262605968. 2024-09-19T06:12:42.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:41 smithi089 ceph-mon[34160]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:42.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:41 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/3477127302' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:12:42.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:41 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:42.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:41 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:42.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:41 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:42.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:41 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:12:42.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:41 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:12:42.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:41 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:42.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:41 smithi002 ceph-mon[30982]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:42.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:41 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/3477127302' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:12:42.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:41 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:42.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:41 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:42.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:41 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:42.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:41 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:12:42.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:41 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:12:42.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:41 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:43.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:42 smithi089 ceph-mon[34160]: Deploying daemon mds.i on smithi090 2024-09-19T06:12:43.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:42 smithi089 ceph-mon[34160]: mds.? [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] up:boot 2024-09-19T06:12:43.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:42 smithi089 ceph-mon[34160]: fsmap 8 up:standby 2024-09-19T06:12:43.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:42 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T06:12:43.094 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:42 smithi090 ceph-mon[34497]: Deploying daemon mds.i on smithi090 2024-09-19T06:12:43.094 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:42 smithi090 ceph-mon[34497]: mds.? [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] up:boot 2024-09-19T06:12:43.094 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:42 smithi090 ceph-mon[34497]: fsmap 8 up:standby 2024-09-19T06:12:43.094 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:42 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T06:12:43.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:42 smithi002 ceph-mon[30982]: Deploying daemon mds.i on smithi090 2024-09-19T06:12:43.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:42 smithi002 ceph-mon[30982]: mds.? [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] up:boot 2024-09-19T06:12:43.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:42 smithi002 ceph-mon[30982]: fsmap 8 up:standby 2024-09-19T06:12:43.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:42 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T06:12:43.404 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:12:43.676 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:12:43.740 INFO:journalctl@ceph.mds.i.smithi090.stdout:Sep 19 06:12:43 smithi090 systemd[1]: Starting Ceph mds.i for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:12:44.030 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:43 smithi002 ceph-mon[30982]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:44.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:43 smithi089 ceph-mon[34160]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:44.060 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:43 smithi090 ceph-mon[34497]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:44.060 INFO:journalctl@ceph.mds.i.smithi090.stdout:Sep 19 06:12:43 smithi090 podman[64959]: 2024-09-19 06:12:43.676010208 +0000 UTC m=+0.015824647 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:12:44.060 INFO:journalctl@ceph.mds.i.smithi090.stdout:Sep 19 06:12:43 smithi090 podman[64959]: 2024-09-19 06:12:43.797896611 +0000 UTC m=+0.137711053 container create 1f2d0c1584a5878e490cbb1763825e0fb82311a7924140a423832788239ad1d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-i, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-19T06:12:44.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.238+0000 7fae942bf640 1 -- 172.21.15.2:0/2564679977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae8c102ef0 msgr2=0x7fae8c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:44.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.238+0000 7fae942bf640 1 --2- 172.21.15.2:0/2564679977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae8c102ef0 0x7fae8c10da40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fae84009ca0 tx=0x7fae8402a950 comp rx=0 tx=0).stop 2024-09-19T06:12:44.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.238+0000 7fae942bf640 1 -- 172.21.15.2:0/2564679977 shutdown_connections 2024-09-19T06:12:44.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.238+0000 7fae942bf640 1 --2- 172.21.15.2:0/2564679977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae8c102ef0 0x7fae8c10da40 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:44.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.238+0000 7fae942bf640 1 --2- 172.21.15.2:0/2564679977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae8c102570 0x7fae8c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:44.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.238+0000 7fae942bf640 1 --2- 172.21.15.2:0/2564679977 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae8c100e20 0x7fae8c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:44.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.238+0000 7fae942bf640 1 -- 172.21.15.2:0/2564679977 >> 172.21.15.2:0/2564679977 conn(0x7fae8c0fc7d0 msgr2=0x7fae8c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:44.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.238+0000 7fae942bf640 1 -- 172.21.15.2:0/2564679977 shutdown_connections 2024-09-19T06:12:44.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.238+0000 7fae942bf640 1 -- 172.21.15.2:0/2564679977 wait complete. 2024-09-19T06:12:44.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.239+0000 7fae942bf640 1 Processor -- start 2024-09-19T06:12:44.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.239+0000 7fae942bf640 1 -- start start 2024-09-19T06:12:44.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.239+0000 7fae942bf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae8c100e20 0x7fae8c197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:44.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.239+0000 7fae942bf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae8c102570 0x7fae8c1975d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:44.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.239+0000 7fae942bf640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae8c102ef0 0x7fae8c197b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:44.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.239+0000 7fae942bf640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fae8c110e30 con 0x7fae8c100e20 2024-09-19T06:12:44.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.239+0000 7fae942bf640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fae8c110cb0 con 0x7fae8c102570 2024-09-19T06:12:44.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.239+0000 7fae942bf640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fae8c110fb0 con 0x7fae8c102ef0 2024-09-19T06:12:44.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.239+0000 7fae9205b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae8c100e20 0x7fae8c197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:44.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.239+0000 7fae9205b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae8c100e20 0x7fae8c197090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54934/0 (socket says 172.21.15.2:54934) 2024-09-19T06:12:44.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.239+0000 7fae9205b640 1 -- 172.21.15.2:0/126697567 learned_addr learned my addr 172.21.15.2:0/126697567 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:12:44.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.239+0000 7fae9185a640 1 --2- 172.21.15.2:0/126697567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae8c102570 0x7fae8c1975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:44.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.239+0000 7fae9285c640 1 --2- 172.21.15.2:0/126697567 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae8c102ef0 0x7fae8c197b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:44.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.240+0000 7fae9205b640 1 -- 172.21.15.2:0/126697567 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae8c102ef0 msgr2=0x7fae8c197b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:44.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.240+0000 7fae9205b640 1 --2- 172.21.15.2:0/126697567 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae8c102ef0 0x7fae8c197b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:44.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.240+0000 7fae9205b640 1 -- 172.21.15.2:0/126697567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae8c102570 msgr2=0x7fae8c1975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:44.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.240+0000 7fae9205b640 1 --2- 172.21.15.2:0/126697567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae8c102570 0x7fae8c1975d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:44.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.240+0000 7fae9205b640 1 -- 172.21.15.2:0/126697567 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae8c1a6900 con 0x7fae8c100e20 2024-09-19T06:12:44.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.240+0000 7fae9185a640 1 --2- 172.21.15.2:0/126697567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae8c102570 0x7fae8c1975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:12:44.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.240+0000 7fae9205b640 1 --2- 172.21.15.2:0/126697567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae8c100e20 0x7fae8c197090 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fae8800d950 tx=0x7fae8800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:44.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.240+0000 7fae837fe640 1 -- 172.21.15.2:0/126697567 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae88017070 con 0x7fae8c100e20 2024-09-19T06:12:44.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.240+0000 7fae837fe640 1 -- 172.21.15.2:0/126697567 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fae88009c30 con 0x7fae8c100e20 2024-09-19T06:12:44.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.240+0000 7fae942bf640 1 -- 172.21.15.2:0/126697567 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae8c1a6bf0 con 0x7fae8c100e20 2024-09-19T06:12:44.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.240+0000 7fae837fe640 1 -- 172.21.15.2:0/126697567 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae8800f620 con 0x7fae8c100e20 2024-09-19T06:12:44.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.240+0000 7fae942bf640 1 -- 172.21.15.2:0/126697567 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae8c1a7130 con 0x7fae8c100e20 2024-09-19T06:12:44.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.241+0000 7fae942bf640 1 -- 172.21.15.2:0/126697567 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae8c101200 con 0x7fae8c100e20 2024-09-19T06:12:44.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.242+0000 7fae837fe640 1 -- 172.21.15.2:0/126697567 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fae880109a0 con 0x7fae8c100e20 2024-09-19T06:12:44.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.243+0000 7fae837fe640 1 --2- 172.21.15.2:0/126697567 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fae780a3240 0x7fae780a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:44.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.243+0000 7fae9185a640 1 --2- 172.21.15.2:0/126697567 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fae780a3240 0x7fae780a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:44.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.243+0000 7fae837fe640 1 -- 172.21.15.2:0/126697567 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fae880cf1f0 con 0x7fae8c100e20 2024-09-19T06:12:44.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.244+0000 7fae9185a640 1 --2- 172.21.15.2:0/126697567 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fae780a3240 0x7fae780a5700 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fae7c005fd0 tx=0x7fae7c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:44.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.248+0000 7fae837fe640 1 -- 172.21.15.2:0/126697567 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fae88009de0 con 0x7fae8c100e20 2024-09-19T06:12:44.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.466+0000 7fae942bf640 1 -- 172.21.15.2:0/126697567 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fae8c02d7c0 con 0x7fae8c100e20 2024-09-19T06:12:44.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.467+0000 7fae837fe640 1 -- 172.21.15.2:0/126697567 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7195 (secure 0 0 0) 0x7fae8809c310 con 0x7fae8c100e20 2024-09-19T06:12:44.469 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:12:44.469 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":9,"btime":"2024-09-19T06:12:41:728989+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24448,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24460,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-19T06:12:44.469 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 9 2024-09-19T06:12:44.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.470+0000 7fae942bf640 1 -- 172.21.15.2:0/126697567 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fae780a3240 msgr2=0x7fae780a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:44.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.470+0000 7fae942bf640 1 --2- 172.21.15.2:0/126697567 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fae780a3240 0x7fae780a5700 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fae7c005fd0 tx=0x7fae7c005850 comp rx=0 tx=0).stop 2024-09-19T06:12:44.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.470+0000 7fae942bf640 1 -- 172.21.15.2:0/126697567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae8c100e20 msgr2=0x7fae8c197090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:44.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.470+0000 7fae942bf640 1 --2- 172.21.15.2:0/126697567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae8c100e20 0x7fae8c197090 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fae8800d950 tx=0x7fae8800de10 comp rx=0 tx=0).stop 2024-09-19T06:12:44.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.470+0000 7fae942bf640 1 -- 172.21.15.2:0/126697567 shutdown_connections 2024-09-19T06:12:44.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.470+0000 7fae942bf640 1 --2- 172.21.15.2:0/126697567 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fae780a3240 0x7fae780a5700 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:44.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.470+0000 7fae942bf640 1 --2- 172.21.15.2:0/126697567 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae8c102ef0 0x7fae8c197b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:44.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.470+0000 7fae942bf640 1 --2- 172.21.15.2:0/126697567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae8c102570 0x7fae8c1975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:44.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.470+0000 7fae942bf640 1 --2- 172.21.15.2:0/126697567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae8c100e20 0x7fae8c197090 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:44.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.470+0000 7fae942bf640 1 -- 172.21.15.2:0/126697567 >> 172.21.15.2:0/126697567 conn(0x7fae8c0fc7d0 msgr2=0x7fae8c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:44.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.470+0000 7fae942bf640 1 -- 172.21.15.2:0/126697567 shutdown_connections 2024-09-19T06:12:44.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:44.470+0000 7fae942bf640 1 -- 172.21.15.2:0/126697567 wait complete. 2024-09-19T06:12:44.490 INFO:journalctl@ceph.mds.i.smithi090.stdout:Sep 19 06:12:44 smithi090 podman[64959]: 2024-09-19 06:12:44.059408423 +0000 UTC m=+0.399222869 container init 1f2d0c1584a5878e490cbb1763825e0fb82311a7924140a423832788239ad1d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-i, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-19T06:12:44.490 INFO:journalctl@ceph.mds.i.smithi090.stdout:Sep 19 06:12:44 smithi090 podman[64959]: 2024-09-19 06:12:44.062347026 +0000 UTC m=+0.402161466 container start 1f2d0c1584a5878e490cbb1763825e0fb82311a7924140a423832788239ad1d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-i, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:12:44.490 INFO:journalctl@ceph.mds.i.smithi090.stdout:Sep 19 06:12:44 smithi090 ceph-mds[64977]: -- 172.21.15.90:0/3017161549 <== mon.1 v2:172.21.15.90:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x565324e91860 con 0x565324e6e800 2024-09-19T06:12:44.490 INFO:journalctl@ceph.mds.i.smithi090.stdout:Sep 19 06:12:44 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-i[64973]: starting mds.i at 2024-09-19T06:12:44.490 INFO:journalctl@ceph.mds.i.smithi090.stdout:Sep 19 06:12:44 smithi090 bash[64959]: 1f2d0c1584a5878e490cbb1763825e0fb82311a7924140a423832788239ad1d1 2024-09-19T06:12:44.490 INFO:journalctl@ceph.mds.i.smithi090.stdout:Sep 19 06:12:44 smithi090 systemd[1]: Started Ceph mds.i for 078f6612-764d-11ef-bceb-c7b262605968. 2024-09-19T06:12:45.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:45 smithi002 ceph-mon[30982]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:45.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:45 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:45.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:45 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:45.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:45 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:45.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:45 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:12:45.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:45 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:12:45.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:45 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:45.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:45 smithi002 ceph-mon[30982]: Deploying daemon mds.g on smithi002 2024-09-19T06:12:45.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:45 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/126697567' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:12:45.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:45 smithi002 ceph-mon[30982]: mds.? [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] up:boot 2024-09-19T06:12:45.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:45 smithi002 ceph-mon[30982]: fsmap 9 up:standby 2024-09-19T06:12:45.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:45 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:12:45.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:45 smithi090 ceph-mon[34497]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:45.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:45 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:45.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:45 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:45.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:45 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:45.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:45 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:12:45.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:45 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:12:45.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:45 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:45.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:45 smithi090 ceph-mon[34497]: Deploying daemon mds.g on smithi002 2024-09-19T06:12:45.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:45 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/126697567' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:12:45.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:45 smithi090 ceph-mon[34497]: mds.? [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] up:boot 2024-09-19T06:12:45.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:45 smithi090 ceph-mon[34497]: fsmap 9 up:standby 2024-09-19T06:12:45.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:45 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:12:45.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:45 smithi089 ceph-mon[34160]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:45.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:45 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:45.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:45 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:45.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:45 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:45.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:45 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:12:45.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:45 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:12:45.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:45 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:45.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:45 smithi089 ceph-mon[34160]: Deploying daemon mds.g on smithi002 2024-09-19T06:12:45.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:45 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/126697567' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:12:45.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:45 smithi089 ceph-mon[34160]: mds.? [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] up:boot 2024-09-19T06:12:45.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:45 smithi089 ceph-mon[34160]: fsmap 9 up:standby 2024-09-19T06:12:45.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:45 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:12:47.080 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:12:47.350 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:12:47.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:47 smithi002 ceph-mon[30982]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:47.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:47 smithi090 ceph-mon[34497]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:47.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:47 smithi089 ceph-mon[34160]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:47.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:47.839+0000 7f451b23b640 1 -- 172.21.15.2:0/3535129761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4514102d40 msgr2=0x7f4514103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:47.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:47.839+0000 7f451b23b640 1 --2- 172.21.15.2:0/3535129761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4514102d40 0x7f4514103120 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4508009900 tx=0x7f450802a480 comp rx=0 tx=0).stop 2024-09-19T06:12:47.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:47.839+0000 7f451b23b640 1 -- 172.21.15.2:0/3535129761 shutdown_connections 2024-09-19T06:12:47.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:47.839+0000 7f451b23b640 1 --2- 172.21.15.2:0/3535129761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f451410c170 0x7f451410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:47.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:47.840+0000 7f451b23b640 1 --2- 172.21.15.2:0/3535129761 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4514103660 0x7f451410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:47.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:47.840+0000 7f451b23b640 1 --2- 172.21.15.2:0/3535129761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4514102d40 0x7f4514103120 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:47.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:47.840+0000 7f451b23b640 1 -- 172.21.15.2:0/3535129761 >> 172.21.15.2:0/3535129761 conn(0x7f45140fc7a0 msgr2=0x7f45140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:47.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:47.840+0000 7f451b23b640 1 -- 172.21.15.2:0/3535129761 shutdown_connections 2024-09-19T06:12:47.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:47.840+0000 7f451b23b640 1 -- 172.21.15.2:0/3535129761 wait complete. 2024-09-19T06:12:47.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:47.840+0000 7f451b23b640 1 Processor -- start 2024-09-19T06:12:47.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:47.840+0000 7f451b23b640 1 -- start start 2024-09-19T06:12:47.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:47.840+0000 7f451b23b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4514102d40 0x7f45141009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:47.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:47.840+0000 7f451b23b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4514103660 0x7f4514100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:47.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:47.840+0000 7f451b23b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f451410c170 0x7f4514101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:47.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:47.840+0000 7f451b23b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4514111e60 con 0x7f451410c170 2024-09-19T06:12:47.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:47.840+0000 7f451b23b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4514111ce0 con 0x7f4514103660 2024-09-19T06:12:47.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:47.840+0000 7f451b23b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4514111fe0 con 0x7f4514102d40 2024-09-19T06:12:47.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:47.841+0000 7f45197d8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f451410c170 0x7f4514101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:47.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:47.841+0000 7f45197d8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f451410c170 0x7f4514101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38950/0 (socket says 172.21.15.2:38950) 2024-09-19T06:12:47.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:47.841+0000 7f45197d8640 1 -- 172.21.15.2:0/3722704181 learned_addr learned my addr 172.21.15.2:0/3722704181 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:12:47.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:47.841+0000 7f4518fd7640 1 --2- 172.21.15.2:0/3722704181 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4514102d40 0x7f45141009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:47.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:47.841+0000 7f4513fff640 1 --2- 172.21.15.2:0/3722704181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4514103660 0x7f4514100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:47.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:47.841+0000 7f45197d8640 1 -- 172.21.15.2:0/3722704181 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4514102d40 msgr2=0x7f45141009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:47.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:47.841+0000 7f45197d8640 1 --2- 172.21.15.2:0/3722704181 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4514102d40 0x7f45141009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:47.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:47.841+0000 7f45197d8640 1 -- 172.21.15.2:0/3722704181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4514103660 msgr2=0x7f4514100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:47.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:47.841+0000 7f45197d8640 1 --2- 172.21.15.2:0/3722704181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4514103660 0x7f4514100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:47.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:47.841+0000 7f45197d8640 1 -- 172.21.15.2:0/3722704181 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45141a6920 con 0x7f451410c170 2024-09-19T06:12:47.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:47.841+0000 7f4513fff640 1 --2- 172.21.15.2:0/3722704181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4514103660 0x7f4514100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:12:47.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:47.841+0000 7f45197d8640 1 --2- 172.21.15.2:0/3722704181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f451410c170 0x7f4514101420 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f450c00b970 tx=0x7f450c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:47.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:47.841+0000 7f4511ffb640 1 -- 172.21.15.2:0/3722704181 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f450c019070 con 0x7f451410c170 2024-09-19T06:12:47.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:47.841+0000 7f4511ffb640 1 -- 172.21.15.2:0/3722704181 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f450c014440 con 0x7f451410c170 2024-09-19T06:12:47.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:47.841+0000 7f451b23b640 1 -- 172.21.15.2:0/3722704181 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45141a6c10 con 0x7f451410c170 2024-09-19T06:12:47.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:47.841+0000 7f4511ffb640 1 -- 172.21.15.2:0/3722704181 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f450c0075d0 con 0x7f451410c170 2024-09-19T06:12:47.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:47.842+0000 7f451b23b640 1 -- 172.21.15.2:0/3722704181 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45141a7100 con 0x7f451410c170 2024-09-19T06:12:47.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:47.843+0000 7f451b23b640 1 -- 172.21.15.2:0/3722704181 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4514103120 con 0x7f451410c170 2024-09-19T06:12:47.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:47.844+0000 7f4511ffb640 1 -- 172.21.15.2:0/3722704181 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f450c01c070 con 0x7f451410c170 2024-09-19T06:12:47.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:47.845+0000 7f4511ffb640 1 --2- 172.21.15.2:0/3722704181 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f45040a3240 0x7f45040a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:47.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:47.845+0000 7f4518fd7640 1 --2- 172.21.15.2:0/3722704181 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f45040a3240 0x7f45040a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:47.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:47.845+0000 7f4511ffb640 1 -- 172.21.15.2:0/3722704181 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f450c0cea40 con 0x7f451410c170 2024-09-19T06:12:47.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:47.845+0000 7f4518fd7640 1 --2- 172.21.15.2:0/3722704181 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f45040a3240 0x7f45040a5700 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4508031440 tx=0x7f4508005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:47.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:47.849+0000 7f4511ffb640 1 -- 172.21.15.2:0/3722704181 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f450c09b5b0 con 0x7f451410c170 2024-09-19T06:12:48.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:48.071+0000 7f451b23b640 1 -- 172.21.15.2:0/3722704181 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f45141071e0 con 0x7f451410c170 2024-09-19T06:12:48.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:48.072+0000 7f4511ffb640 1 -- 172.21.15.2:0/3722704181 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8845 (secure 0 0 0) 0x7f450c09f8b0 con 0x7f451410c170 2024-09-19T06:12:48.074 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:12:48.075 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":11,"btime":"2024-09-19T06:12:47:210389+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24448,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24460,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24472,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T06:12:48.075 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 11 2024-09-19T06:12:48.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:48.074+0000 7f451b23b640 1 -- 172.21.15.2:0/3722704181 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f45040a3240 msgr2=0x7f45040a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:48.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:48.074+0000 7f451b23b640 1 --2- 172.21.15.2:0/3722704181 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f45040a3240 0x7f45040a5700 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4508031440 tx=0x7f4508005b50 comp rx=0 tx=0).stop 2024-09-19T06:12:48.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:48.074+0000 7f451b23b640 1 -- 172.21.15.2:0/3722704181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f451410c170 msgr2=0x7f4514101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:48.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:48.074+0000 7f451b23b640 1 --2- 172.21.15.2:0/3722704181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f451410c170 0x7f4514101420 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f450c00b970 tx=0x7f450c00be30 comp rx=0 tx=0).stop 2024-09-19T06:12:48.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:48.074+0000 7f451b23b640 1 -- 172.21.15.2:0/3722704181 shutdown_connections 2024-09-19T06:12:48.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:48.074+0000 7f451b23b640 1 --2- 172.21.15.2:0/3722704181 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f45040a3240 0x7f45040a5700 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:48.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:48.074+0000 7f451b23b640 1 --2- 172.21.15.2:0/3722704181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f451410c170 0x7f4514101420 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:48.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:48.074+0000 7f451b23b640 1 --2- 172.21.15.2:0/3722704181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4514103660 0x7f4514100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:48.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:48.074+0000 7f451b23b640 1 --2- 172.21.15.2:0/3722704181 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4514102d40 0x7f45141009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:48.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:48.074+0000 7f451b23b640 1 -- 172.21.15.2:0/3722704181 >> 172.21.15.2:0/3722704181 conn(0x7f45140fc7a0 msgr2=0x7f45140fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:48.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:48.074+0000 7f451b23b640 1 -- 172.21.15.2:0/3722704181 shutdown_connections 2024-09-19T06:12:48.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:48.074+0000 7f451b23b640 1 -- 172.21.15.2:0/3722704181 wait complete. 2024-09-19T06:12:48.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:48 smithi002 ceph-mon[30982]: mds.? [v2:172.21.15.2:6838/3747228076,v1:172.21.15.2:6839/3747228076] up:boot 2024-09-19T06:12:48.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:48 smithi002 ceph-mon[30982]: fsmap 10 up:standby 2024-09-19T06:12:48.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:48 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T06:12:48.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:48 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:48.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:48 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:48.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:48 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:48.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:48 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:12:48.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:48 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:12:48.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:48 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:48.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:48 smithi002 ceph-mon[30982]: Deploying daemon mds.a on smithi002 2024-09-19T06:12:48.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:48 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/3722704181' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:12:48.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:48 smithi090 ceph-mon[34497]: mds.? [v2:172.21.15.2:6838/3747228076,v1:172.21.15.2:6839/3747228076] up:boot 2024-09-19T06:12:48.755 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:48 smithi090 ceph-mon[34497]: fsmap 10 up:standby 2024-09-19T06:12:48.755 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:48 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T06:12:48.755 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:48 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:48.756 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:48 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:48.756 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:48 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:48.756 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:48 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:12:48.756 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:48 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:12:48.756 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:48 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:48.756 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:48 smithi090 ceph-mon[34497]: Deploying daemon mds.a on smithi002 2024-09-19T06:12:48.756 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:48 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/3722704181' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:12:48.757 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:48 smithi089 ceph-mon[34160]: mds.? [v2:172.21.15.2:6838/3747228076,v1:172.21.15.2:6839/3747228076] up:boot 2024-09-19T06:12:48.757 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:48 smithi089 ceph-mon[34160]: fsmap 10 up:standby 2024-09-19T06:12:48.757 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:48 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T06:12:48.757 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:48 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:48.757 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:48 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:48.757 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:48 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:48.757 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:48 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:12:48.757 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:48 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:12:48.757 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:48 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:48.757 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:48 smithi089 ceph-mon[34160]: Deploying daemon mds.a on smithi002 2024-09-19T06:12:48.758 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:48 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/3722704181' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:12:49.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:49 smithi002 ceph-mon[30982]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:49.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:49 smithi090 ceph-mon[34497]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:49.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:49 smithi089 ceph-mon[34160]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:49.939 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 19 06:12:49 smithi002 systemd[1]: Starting Ceph mds.a for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:12:50.198 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 19 06:12:49 smithi002 podman[71472]: 2024-09-19 06:12:49.840537216 +0000 UTC m=+0.016213590 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:12:50.198 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 19 06:12:49 smithi002 podman[71472]: 2024-09-19 06:12:49.961610912 +0000 UTC m=+0.137287285 container create 687570e27fbe3debf3a2c07d6cf1029cdee29e443a838bc9d387a6bd6ebc9342 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-a, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:12:50.722 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 19 06:12:50 smithi002 podman[71472]: 2024-09-19 06:12:50.3110064 +0000 UTC m=+0.486682777 container init 687570e27fbe3debf3a2c07d6cf1029cdee29e443a838bc9d387a6bd6ebc9342 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-a, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731) 2024-09-19T06:12:50.722 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 19 06:12:50 smithi002 podman[71472]: 2024-09-19 06:12:50.313919905 +0000 UTC m=+0.489596286 container start 687570e27fbe3debf3a2c07d6cf1029cdee29e443a838bc9d387a6bd6ebc9342 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-a, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-19T06:12:50.722 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 19 06:12:50 smithi002 ceph-mds[71491]: -- 172.21.15.2:0/1504636144 <== mon.0 v2:172.21.15.2:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56074e9e5860 con 0x56074e9c3400 2024-09-19T06:12:50.722 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 19 06:12:50 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-a[71487]: starting mds.a at 2024-09-19T06:12:50.722 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 19 06:12:50 smithi002 bash[71472]: 687570e27fbe3debf3a2c07d6cf1029cdee29e443a838bc9d387a6bd6ebc9342 2024-09-19T06:12:50.723 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 19 06:12:50 smithi002 systemd[1]: Started Ceph mds.a for 078f6612-764d-11ef-bceb-c7b262605968. 2024-09-19T06:12:51.670 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:12:51.698 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:51 smithi002 ceph-mon[30982]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:51.698 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:51 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:51.698 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:51 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:51.699 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:51 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:51.699 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:51 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:12:51.699 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:51 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:12:51.699 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:51 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:51.699 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:51 smithi002 ceph-mon[30982]: Deploying daemon mds.b on smithi089 2024-09-19T06:12:51.699 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:51 smithi002 ceph-mon[30982]: mds.? [v2:172.21.15.2:6840/3902749142,v1:172.21.15.2:6841/3902749142] up:boot 2024-09-19T06:12:51.699 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:51 smithi002 ceph-mon[30982]: fsmap 11 up:standby 2024-09-19T06:12:51.699 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:51 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T06:12:51.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:51 smithi090 ceph-mon[34497]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:51.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:51 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:51.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:51 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:51.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:51 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:51.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:51 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:12:51.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:51 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:12:51.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:51 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:51.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:51 smithi090 ceph-mon[34497]: Deploying daemon mds.b on smithi089 2024-09-19T06:12:51.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:51 smithi090 ceph-mon[34497]: mds.? [v2:172.21.15.2:6840/3902749142,v1:172.21.15.2:6841/3902749142] up:boot 2024-09-19T06:12:51.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:51 smithi090 ceph-mon[34497]: fsmap 11 up:standby 2024-09-19T06:12:51.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:51 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T06:12:51.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:51 smithi089 ceph-mon[34160]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:51.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:51 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:51.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:51 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:51.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:51 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:51.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:51 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:12:51.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:51 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:12:51.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:51 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:51.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:51 smithi089 ceph-mon[34160]: Deploying daemon mds.b on smithi089 2024-09-19T06:12:51.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:51 smithi089 ceph-mon[34160]: mds.? [v2:172.21.15.2:6840/3902749142,v1:172.21.15.2:6841/3902749142] up:boot 2024-09-19T06:12:51.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:51 smithi089 ceph-mon[34160]: fsmap 11 up:standby 2024-09-19T06:12:51.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:51 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T06:12:51.939 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:12:52.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.421+0000 7f2ae0baa640 1 -- 172.21.15.2:0/225381565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2adc106f10 msgr2=0x7f2adc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:52.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.421+0000 7f2ae0baa640 1 --2- 172.21.15.2:0/225381565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2adc106f10 0x7f2adc10ea90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4009ca0 tx=0x7f2ad402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:12:52.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.421+0000 7f2ae0baa640 1 -- 172.21.15.2:0/225381565 shutdown_connections 2024-09-19T06:12:52.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.421+0000 7f2ae0baa640 1 --2- 172.21.15.2:0/225381565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2adc106f10 0x7f2adc10ea90 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:52.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.421+0000 7f2ae0baa640 1 --2- 172.21.15.2:0/225381565 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2adc102790 0x7f2adc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:52.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.421+0000 7f2ae0baa640 1 --2- 172.21.15.2:0/225381565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2adc101de0 0x7f2adc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:52.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.421+0000 7f2ae0baa640 1 -- 172.21.15.2:0/225381565 >> 172.21.15.2:0/225381565 conn(0x7f2adc0fd8c0 msgr2=0x7f2adc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:52.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.421+0000 7f2ae0baa640 1 -- 172.21.15.2:0/225381565 shutdown_connections 2024-09-19T06:12:52.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.421+0000 7f2ae0baa640 1 -- 172.21.15.2:0/225381565 wait complete. 2024-09-19T06:12:52.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.422+0000 7f2ae0baa640 1 Processor -- start 2024-09-19T06:12:52.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.422+0000 7f2ae0baa640 1 -- start start 2024-09-19T06:12:52.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.422+0000 7f2ae0baa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2adc101de0 0x7f2adc1983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:52.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.422+0000 7f2ae0baa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2adc102790 0x7f2adc1988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:52.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.422+0000 7f2ae0baa640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2adc106f10 0x7f2adc19cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:52.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.422+0000 7f2ae0baa640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2adc111e70 con 0x7f2adc101de0 2024-09-19T06:12:52.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.422+0000 7f2ae0baa640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2adc111cf0 con 0x7f2adc102790 2024-09-19T06:12:52.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.422+0000 7f2ae0baa640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2adc111ff0 con 0x7f2adc106f10 2024-09-19T06:12:52.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.422+0000 7f2ada59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2adc101de0 0x7f2adc1983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:52.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.422+0000 7f2ada59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2adc101de0 0x7f2adc1983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38974/0 (socket says 172.21.15.2:38974) 2024-09-19T06:12:52.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.422+0000 7f2ada59c640 1 -- 172.21.15.2:0/1132658433 learned_addr learned my addr 172.21.15.2:0/1132658433 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:12:52.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.422+0000 7f2ad3fff640 1 --2- 172.21.15.2:0/1132658433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2adc102790 0x7f2adc1988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:52.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.422+0000 7f2adad9d640 1 --2- 172.21.15.2:0/1132658433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2adc106f10 0x7f2adc19cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:52.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.423+0000 7f2ada59c640 1 -- 172.21.15.2:0/1132658433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2adc106f10 msgr2=0x7f2adc19cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:52.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.423+0000 7f2ada59c640 1 --2- 172.21.15.2:0/1132658433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2adc106f10 0x7f2adc19cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:52.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.423+0000 7f2ada59c640 1 -- 172.21.15.2:0/1132658433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2adc102790 msgr2=0x7f2adc1988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:52.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.423+0000 7f2ada59c640 1 --2- 172.21.15.2:0/1132658433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2adc102790 0x7f2adc1988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:52.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.423+0000 7f2ada59c640 1 -- 172.21.15.2:0/1132658433 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2adc19d360 con 0x7f2adc101de0 2024-09-19T06:12:52.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.423+0000 7f2ad3fff640 1 --2- 172.21.15.2:0/1132658433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2adc102790 0x7f2adc1988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:52.773 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 19 06:12:52 smithi089 systemd[1]: Starting Ceph mds.b for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:12:52.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.423+0000 7f2ada59c640 1 --2- 172.21.15.2:0/1132658433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2adc101de0 0x7f2adc1983b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2acc00d770 tx=0x7f2acc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:52.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.423+0000 7f2ad37fe640 1 -- 172.21.15.2:0/1132658433 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2acc017070 con 0x7f2adc101de0 2024-09-19T06:12:52.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.423+0000 7f2ad37fe640 1 -- 172.21.15.2:0/1132658433 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2acc0054d0 con 0x7f2adc101de0 2024-09-19T06:12:52.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.423+0000 7f2ae0baa640 1 -- 172.21.15.2:0/1132658433 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2adc19d650 con 0x7f2adc101de0 2024-09-19T06:12:52.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.423+0000 7f2ad37fe640 1 -- 172.21.15.2:0/1132658433 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2acc004cf0 con 0x7f2adc101de0 2024-09-19T06:12:52.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.423+0000 7f2ae0baa640 1 -- 172.21.15.2:0/1132658433 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2adc1a4f30 con 0x7f2adc101de0 2024-09-19T06:12:52.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.424+0000 7f2ae0baa640 1 -- 172.21.15.2:0/1132658433 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2adc1021c0 con 0x7f2adc101de0 2024-09-19T06:12:52.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.425+0000 7f2ad37fe640 1 -- 172.21.15.2:0/1132658433 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f2acc004e90 con 0x7f2adc101de0 2024-09-19T06:12:52.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.426+0000 7f2ad37fe640 1 --2- 172.21.15.2:0/1132658433 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f2ac80a3240 0x7f2ac80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:52.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.426+0000 7f2ad3fff640 1 --2- 172.21.15.2:0/1132658433 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f2ac80a3240 0x7f2ac80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:52.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.426+0000 7f2ad37fe640 1 -- 172.21.15.2:0/1132658433 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f2acc0cee30 con 0x7f2adc101de0 2024-09-19T06:12:52.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.426+0000 7f2ad3fff640 1 --2- 172.21.15.2:0/1132658433 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f2ac80a3240 0x7f2ac80a5700 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2adc1087d0 tx=0x7f2ac400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:52.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.430+0000 7f2ad37fe640 1 -- 172.21.15.2:0/1132658433 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2acc09b9a0 con 0x7f2adc101de0 2024-09-19T06:12:52.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.643+0000 7f2ae0baa640 1 -- 172.21.15.2:0/1132658433 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2adc10a150 con 0x7f2adc101de0 2024-09-19T06:12:52.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.643+0000 7f2ad37fe640 1 -- 172.21.15.2:0/1132658433 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9668 (secure 0 0 0) 0x7f2acc09fca0 con 0x7f2adc101de0 2024-09-19T06:12:52.775 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:12:52.775 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":12,"btime":"2024-09-19T06:12:51:236870+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24448,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24460,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24472,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T06:12:52.776 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 12 2024-09-19T06:12:52.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.645+0000 7f2ae0baa640 1 -- 172.21.15.2:0/1132658433 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f2ac80a3240 msgr2=0x7f2ac80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:52.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.646+0000 7f2ae0baa640 1 --2- 172.21.15.2:0/1132658433 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f2ac80a3240 0x7f2ac80a5700 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2adc1087d0 tx=0x7f2ac400b390 comp rx=0 tx=0).stop 2024-09-19T06:12:52.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.646+0000 7f2ae0baa640 1 -- 172.21.15.2:0/1132658433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2adc101de0 msgr2=0x7f2adc1983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:52.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.646+0000 7f2ae0baa640 1 --2- 172.21.15.2:0/1132658433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2adc101de0 0x7f2adc1983b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2acc00d770 tx=0x7f2acc00dc30 comp rx=0 tx=0).stop 2024-09-19T06:12:52.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.646+0000 7f2ae0baa640 1 -- 172.21.15.2:0/1132658433 shutdown_connections 2024-09-19T06:12:52.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.646+0000 7f2ae0baa640 1 --2- 172.21.15.2:0/1132658433 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f2ac80a3240 0x7f2ac80a5700 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:52.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.646+0000 7f2ae0baa640 1 --2- 172.21.15.2:0/1132658433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2adc106f10 0x7f2adc19cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:52.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.646+0000 7f2ae0baa640 1 --2- 172.21.15.2:0/1132658433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2adc102790 0x7f2adc1988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:52.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.646+0000 7f2ae0baa640 1 --2- 172.21.15.2:0/1132658433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2adc101de0 0x7f2adc1983b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:52.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.646+0000 7f2ae0baa640 1 -- 172.21.15.2:0/1132658433 >> 172.21.15.2:0/1132658433 conn(0x7f2adc0fd8c0 msgr2=0x7f2adc0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:52.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.646+0000 7f2ae0baa640 1 -- 172.21.15.2:0/1132658433 shutdown_connections 2024-09-19T06:12:52.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:52.646+0000 7f2ae0baa640 1 -- 172.21.15.2:0/1132658433 wait complete. 2024-09-19T06:12:52.978 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 19 06:12:52 smithi089 podman[63844]: 2024-09-19 06:12:52.622846371 +0000 UTC m=+0.015989356 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:12:52.978 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 19 06:12:52 smithi089 podman[63844]: 2024-09-19 06:12:52.732417917 +0000 UTC m=+0.125560889 container create f173cf3a545657e02798a2ccbc71ed5fd036e771909c8a1296195838639c32cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-b, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-19T06:12:52.978 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 19 06:12:52 smithi089 podman[63844]: 2024-09-19 06:12:52.951517601 +0000 UTC m=+0.344660581 container init f173cf3a545657e02798a2ccbc71ed5fd036e771909c8a1296195838639c32cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-b, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-19T06:12:52.979 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 19 06:12:52 smithi089 podman[63844]: 2024-09-19 06:12:52.954226099 +0000 UTC m=+0.347369074 container start f173cf3a545657e02798a2ccbc71ed5fd036e771909c8a1296195838639c32cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-b, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux ) 2024-09-19T06:12:53.292 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 19 06:12:52 smithi089 ceph-mds[63863]: -- 172.21.15.89:0/3349662330 <== mon.2 v2:172.21.15.89:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55902210bc20 con 0x5590220e9000 2024-09-19T06:12:53.292 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 19 06:12:52 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-b[63859]: starting mds.b at 2024-09-19T06:12:53.292 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 19 06:12:53 smithi089 bash[63844]: f173cf3a545657e02798a2ccbc71ed5fd036e771909c8a1296195838639c32cb 2024-09-19T06:12:53.292 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 19 06:12:53 smithi089 systemd[1]: Started Ceph mds.b for 078f6612-764d-11ef-bceb-c7b262605968. 2024-09-19T06:12:53.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:53 smithi002 ceph-mon[30982]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:53.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:53 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1132658433' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:12:53.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:53 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:53.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:53 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:53.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:53 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:53.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:53 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:53.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:53 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:53.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:53 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:12:53.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:53 smithi090 ceph-mon[34497]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:53.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:53 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1132658433' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:12:53.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:53 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:53.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:53 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:53.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:53 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:53.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:53 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:53.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:53 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:53.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:53 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:12:53.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:53 smithi089 ceph-mon[34160]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:53.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:53 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1132658433' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:12:53.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:53 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:53.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:53 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:53.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:53 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:53.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:53 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:53.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:53 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:53.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:53 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:12:54.585 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:54 smithi089 ceph-mon[34160]: mds.? [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] up:boot 2024-09-19T06:12:54.585 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:54 smithi089 ceph-mon[34160]: fsmap 12 up:standby 2024-09-19T06:12:54.585 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:54 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:12:54.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:54 smithi002 ceph-mon[30982]: mds.? [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] up:boot 2024-09-19T06:12:54.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:54 smithi002 ceph-mon[30982]: fsmap 12 up:standby 2024-09-19T06:12:54.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:54 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:12:54.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:54 smithi090 ceph-mon[34497]: mds.? [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] up:boot 2024-09-19T06:12:54.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:54 smithi090 ceph-mon[34497]: fsmap 12 up:standby 2024-09-19T06:12:54.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:54 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:12:55.325 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:12:55.591 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:12:55.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:55 smithi002 ceph-mon[30982]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:55.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:55 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:55.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:55 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:55.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:55 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:55.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:55 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:55.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:55 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:55.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:55 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:55.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:55 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:55.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:55 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:12:55.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:55 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:55.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:55 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:12:55.974 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:55 smithi089 ceph-mon[34160]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:55.974 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:55 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:55.974 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:55 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:55.975 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:55 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:55.975 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:55 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:55.975 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:55 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:55.975 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:55 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:55.975 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:55 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:55.975 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:55 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:12:55.975 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:55 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:55.975 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:55 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:12:55.980 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:55 smithi090 ceph-mon[34497]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:55.980 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:55 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:55.980 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:55 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:55.980 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:55 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:55.980 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:55 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:55.981 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:55 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:55.981 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:55 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:55.981 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:55 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:55.981 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:55 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:12:55.981 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:55 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:55.981 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:55 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:12:56.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.586+0000 7fa809a49640 1 -- 172.21.15.2:0/1695290132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8041036c0 msgr2=0x7fa80410bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:56.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.586+0000 7fa809a49640 1 --2- 172.21.15.2:0/1695290132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8041036c0 0x7fa80410bbb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009900 tx=0x7fa7ec02a480 comp rx=0 tx=0).stop 2024-09-19T06:12:56.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.586+0000 7fa809a49640 1 -- 172.21.15.2:0/1695290132 shutdown_connections 2024-09-19T06:12:56.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.586+0000 7fa809a49640 1 --2- 172.21.15.2:0/1695290132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa80410c180 0x7fa80410e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:56.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.586+0000 7fa809a49640 1 --2- 172.21.15.2:0/1695290132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8041036c0 0x7fa80410bbb0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:56.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.586+0000 7fa809a49640 1 --2- 172.21.15.2:0/1695290132 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa804102da0 0x7fa804103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:56.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.586+0000 7fa809a49640 1 -- 172.21.15.2:0/1695290132 >> 172.21.15.2:0/1695290132 conn(0x7fa8040fc7a0 msgr2=0x7fa8040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:56.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.586+0000 7fa809a49640 1 -- 172.21.15.2:0/1695290132 shutdown_connections 2024-09-19T06:12:56.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.586+0000 7fa809a49640 1 -- 172.21.15.2:0/1695290132 wait complete. 2024-09-19T06:12:56.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.587+0000 7fa809a49640 1 Processor -- start 2024-09-19T06:12:56.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.587+0000 7fa809a49640 1 -- start start 2024-09-19T06:12:56.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.587+0000 7fa809a49640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa804102da0 0x7fa804100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:56.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.587+0000 7fa809a49640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8041036c0 0x7fa804100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:56.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.587+0000 7fa809a49640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa80410c180 0x7fa804101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:56.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.587+0000 7fa809a49640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa804111e10 con 0x7fa80410c180 2024-09-19T06:12:56.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.587+0000 7fa809a49640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa804111c90 con 0x7fa804102da0 2024-09-19T06:12:56.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.587+0000 7fa809a49640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa804111f90 con 0x7fa8041036c0 2024-09-19T06:12:56.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.587+0000 7fa8037fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa80410c180 0x7fa804101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:56.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.587+0000 7fa8037fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa80410c180 0x7fa804101480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55948/0 (socket says 172.21.15.2:55948) 2024-09-19T06:12:56.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.587+0000 7fa802ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa804102da0 0x7fa804100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:56.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.587+0000 7fa8037fe640 1 -- 172.21.15.2:0/1392246062 learned_addr learned my addr 172.21.15.2:0/1392246062 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:12:56.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.588+0000 7fa7fbfff640 1 --2- 172.21.15.2:0/1392246062 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8041036c0 0x7fa804100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:56.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.588+0000 7fa8037fe640 1 -- 172.21.15.2:0/1392246062 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8041036c0 msgr2=0x7fa804100f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:56.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.588+0000 7fa8037fe640 1 --2- 172.21.15.2:0/1392246062 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8041036c0 0x7fa804100f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:56.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.588+0000 7fa8037fe640 1 -- 172.21.15.2:0/1392246062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa804102da0 msgr2=0x7fa804100a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:56.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.588+0000 7fa8037fe640 1 --2- 172.21.15.2:0/1392246062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa804102da0 0x7fa804100a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:56.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.588+0000 7fa8037fe640 1 -- 172.21.15.2:0/1392246062 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8041a68d0 con 0x7fa80410c180 2024-09-19T06:12:56.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.588+0000 7fa802ffd640 1 --2- 172.21.15.2:0/1392246062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa804102da0 0x7fa804100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:56.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.588+0000 7fa8037fe640 1 --2- 172.21.15.2:0/1392246062 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa80410c180 0x7fa804101480 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc00eb10 tx=0x7fa7fc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:56.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.588+0000 7fa808a47640 1 -- 172.21.15.2:0/1392246062 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc004b20 con 0x7fa80410c180 2024-09-19T06:12:56.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.588+0000 7fa808a47640 1 -- 172.21.15.2:0/1392246062 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa7fc004cc0 con 0x7fa80410c180 2024-09-19T06:12:56.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.588+0000 7fa809a49640 1 -- 172.21.15.2:0/1392246062 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8041a6bc0 con 0x7fa80410c180 2024-09-19T06:12:56.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.588+0000 7fa808a47640 1 -- 172.21.15.2:0/1392246062 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc010690 con 0x7fa80410c180 2024-09-19T06:12:56.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.588+0000 7fa809a49640 1 -- 172.21.15.2:0/1392246062 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8041a70d0 con 0x7fa80410c180 2024-09-19T06:12:56.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.589+0000 7fa809a49640 1 -- 172.21.15.2:0/1392246062 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa804103180 con 0x7fa80410c180 2024-09-19T06:12:56.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.590+0000 7fa808a47640 1 -- 172.21.15.2:0/1392246062 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fa7fc005020 con 0x7fa80410c180 2024-09-19T06:12:56.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.591+0000 7fa808a47640 1 --2- 172.21.15.2:0/1392246062 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fa7f00a32c0 0x7fa7f00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:56.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.591+0000 7fa808a47640 1 -- 172.21.15.2:0/1392246062 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fa7fc0cf9a0 con 0x7fa80410c180 2024-09-19T06:12:56.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.591+0000 7fa802ffd640 1 --2- 172.21.15.2:0/1392246062 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fa7f00a32c0 0x7fa7f00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:56.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.592+0000 7fa802ffd640 1 --2- 172.21.15.2:0/1392246062 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fa7f00a32c0 0x7fa7f00a5780 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4005fd0 tx=0x7fa7f400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:56.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.595+0000 7fa808a47640 1 -- 172.21.15.2:0/1392246062 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa7fc09cac0 con 0x7fa80410c180 2024-09-19T06:12:56.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.819+0000 7fa809a49640 1 -- 172.21.15.2:0/1392246062 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa8041071c0 con 0x7fa80410c180 2024-09-19T06:12:56.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.819+0000 7fa808a47640 1 -- 172.21.15.2:0/1392246062 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10494 (secure 0 0 0) 0x7fa7fc09c3c0 con 0x7fa80410c180 2024-09-19T06:12:56.821 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:12:56.821 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":13,"btime":"2024-09-19T06:12:53:453509+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24448,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24460,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24472,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-19T06:12:56.822 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 13 2024-09-19T06:12:56.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.823+0000 7fa809a49640 1 -- 172.21.15.2:0/1392246062 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fa7f00a32c0 msgr2=0x7fa7f00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:56.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.823+0000 7fa809a49640 1 --2- 172.21.15.2:0/1392246062 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fa7f00a32c0 0x7fa7f00a5780 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4005fd0 tx=0x7fa7f400b390 comp rx=0 tx=0).stop 2024-09-19T06:12:56.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.823+0000 7fa809a49640 1 -- 172.21.15.2:0/1392246062 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa80410c180 msgr2=0x7fa804101480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:56.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.823+0000 7fa809a49640 1 --2- 172.21.15.2:0/1392246062 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa80410c180 0x7fa804101480 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc00eb10 tx=0x7fa7fc00c2d0 comp rx=0 tx=0).stop 2024-09-19T06:12:56.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.823+0000 7fa809a49640 1 -- 172.21.15.2:0/1392246062 shutdown_connections 2024-09-19T06:12:56.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.823+0000 7fa809a49640 1 --2- 172.21.15.2:0/1392246062 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fa7f00a32c0 0x7fa7f00a5780 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:56.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.823+0000 7fa809a49640 1 --2- 172.21.15.2:0/1392246062 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa80410c180 0x7fa804101480 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:56.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.823+0000 7fa809a49640 1 --2- 172.21.15.2:0/1392246062 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8041036c0 0x7fa804100f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:56.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.823+0000 7fa809a49640 1 --2- 172.21.15.2:0/1392246062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa804102da0 0x7fa804100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:56.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.823+0000 7fa809a49640 1 -- 172.21.15.2:0/1392246062 >> 172.21.15.2:0/1392246062 conn(0x7fa8040fc7a0 msgr2=0x7fa8040fe230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:56.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.823+0000 7fa809a49640 1 -- 172.21.15.2:0/1392246062 shutdown_connections 2024-09-19T06:12:56.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:56.823+0000 7fa809a49640 1 -- 172.21.15.2:0/1392246062 wait complete. 2024-09-19T06:12:57.513 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-19T06:12:57.785 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:12:57.906 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:57 smithi002 ceph-mon[30982]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:57.906 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:57 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:57.906 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:57 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:57.906 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:57 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:57.906 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:57 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:57.906 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:57 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1392246062' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:12:57.906 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:57 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:57.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:57 smithi090 ceph-mon[34497]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:57.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:57 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:57.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:57 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:57.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:57 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:57.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:57 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:57.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:57 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1392246062' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:12:57.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:57 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:58.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:57 smithi089 ceph-mon[34160]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:58.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:57 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:58.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:57 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:58.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:57 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:58.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:57 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:58.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:57 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1392246062' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:12:58.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:57 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:58.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.252+0000 7f161a985640 1 -- 172.21.15.2:0/289936628 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1614102570 msgr2=0x7f16141029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:58.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.252+0000 7f161a985640 1 --2- 172.21.15.2:0/289936628 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1614102570 0x7f16141029b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f15fc009900 tx=0x7f15fc02a480 comp rx=0 tx=0).stop 2024-09-19T06:12:58.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.252+0000 7f161a985640 1 -- 172.21.15.2:0/289936628 shutdown_connections 2024-09-19T06:12:58.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.252+0000 7f161a985640 1 --2- 172.21.15.2:0/289936628 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1614102ef0 0x7f161410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:58.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.252+0000 7f161a985640 1 --2- 172.21.15.2:0/289936628 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1614102570 0x7f16141029b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:58.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.252+0000 7f161a985640 1 --2- 172.21.15.2:0/289936628 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1614100e20 0x7f1614101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:58.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.252+0000 7f161a985640 1 -- 172.21.15.2:0/289936628 >> 172.21.15.2:0/289936628 conn(0x7f16140fc7d0 msgr2=0x7f16140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:58.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.252+0000 7f161a985640 1 -- 172.21.15.2:0/289936628 shutdown_connections 2024-09-19T06:12:58.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.252+0000 7f161a985640 1 -- 172.21.15.2:0/289936628 wait complete. 2024-09-19T06:12:58.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.252+0000 7f161a985640 1 Processor -- start 2024-09-19T06:12:58.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.252+0000 7f161a985640 1 -- start start 2024-09-19T06:12:58.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.253+0000 7f161a985640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1614100e20 0x7f1614197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:58.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.253+0000 7f161a985640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1614102570 0x7f1614197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:58.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.253+0000 7f161a985640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1614102ef0 0x7f161419bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:58.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.253+0000 7f161a985640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1614110e30 con 0x7f1614100e20 2024-09-19T06:12:58.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.253+0000 7f161a985640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f1614110cb0 con 0x7f1614102570 2024-09-19T06:12:58.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.253+0000 7f161a985640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1614110fb0 con 0x7f1614102ef0 2024-09-19T06:12:58.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.253+0000 7f1613fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1614100e20 0x7f1614197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:58.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.253+0000 7f1613fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1614100e20 0x7f1614197300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55970/0 (socket says 172.21.15.2:55970) 2024-09-19T06:12:58.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.253+0000 7f1613fff640 1 -- 172.21.15.2:0/273925215 learned_addr learned my addr 172.21.15.2:0/273925215 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:12:58.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.253+0000 7f1618f22640 1 --2- 172.21.15.2:0/273925215 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1614102ef0 0x7f161419bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:58.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.253+0000 7f160bfff640 1 --2- 172.21.15.2:0/273925215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1614102570 0x7f1614197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:58.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.253+0000 7f1613fff640 1 -- 172.21.15.2:0/273925215 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1614102ef0 msgr2=0x7f161419bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:58.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.253+0000 7f1613fff640 1 --2- 172.21.15.2:0/273925215 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1614102ef0 0x7f161419bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:58.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.253+0000 7f1613fff640 1 -- 172.21.15.2:0/273925215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1614102570 msgr2=0x7f1614197840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:58.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.253+0000 7f1613fff640 1 --2- 172.21.15.2:0/273925215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1614102570 0x7f1614197840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:58.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.253+0000 7f1613fff640 1 -- 172.21.15.2:0/273925215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f161419c2b0 con 0x7f1614100e20 2024-09-19T06:12:58.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.253+0000 7f160bfff640 1 --2- 172.21.15.2:0/273925215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1614102570 0x7f1614197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:12:58.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.253+0000 7f1618f22640 1 --2- 172.21.15.2:0/273925215 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1614102ef0 0x7f161419bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:12:58.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.253+0000 7f1613fff640 1 --2- 172.21.15.2:0/273925215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1614100e20 0x7f1614197300 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f160400c970 tx=0x7f160400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:58.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.253+0000 7f1611ffb640 1 -- 172.21.15.2:0/273925215 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1604007bb0 con 0x7f1614100e20 2024-09-19T06:12:58.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.254+0000 7f1611ffb640 1 -- 172.21.15.2:0/273925215 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1604007d50 con 0x7f1614100e20 2024-09-19T06:12:58.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.254+0000 7f161a985640 1 -- 172.21.15.2:0/273925215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f161419c5a0 con 0x7f1614100e20 2024-09-19T06:12:58.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.254+0000 7f1611ffb640 1 -- 172.21.15.2:0/273925215 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160400f450 con 0x7f1614100e20 2024-09-19T06:12:58.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.254+0000 7f161a985640 1 -- 172.21.15.2:0/273925215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1614069f70 con 0x7f1614100e20 2024-09-19T06:12:58.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.255+0000 7f161a985640 1 -- 172.21.15.2:0/273925215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1614101200 con 0x7f1614100e20 2024-09-19T06:12:58.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.256+0000 7f1611ffb640 1 -- 172.21.15.2:0/273925215 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f1604004f00 con 0x7f1614100e20 2024-09-19T06:12:58.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.257+0000 7f1611ffb640 1 --2- 172.21.15.2:0/273925215 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f16000a32c0 0x7f16000a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:58.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.257+0000 7f160bfff640 1 --2- 172.21.15.2:0/273925215 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f16000a32c0 0x7f16000a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:58.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.257+0000 7f1611ffb640 1 -- 172.21.15.2:0/273925215 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f16040cf620 con 0x7f1614100e20 2024-09-19T06:12:58.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.257+0000 7f160bfff640 1 --2- 172.21.15.2:0/273925215 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f16000a32c0 0x7f16000a5780 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f15fc000c00 tx=0x7f15fc032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:58.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.260+0000 7f1611ffb640 1 -- 172.21.15.2:0/273925215 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1604014030 con 0x7f1614100e20 2024-09-19T06:12:58.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.437+0000 7f161a985640 1 -- 172.21.15.2:0/273925215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f1614198660 con 0x7f1614100e20 2024-09-19T06:12:58.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.438+0000 7f1611ffb640 1 -- 172.21.15.2:0/273925215 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v74) ==== 84+0+65 (secure 0 0 0) 0x7f160409c860 con 0x7f1614100e20 2024-09-19T06:12:58.440 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:12:58.440 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2024-09-19T06:12:58.440 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:12:58.440 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 1, 2024-09-19T06:12:58.440 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": ".mgr" 2024-09-19T06:12:58.440 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:12:58.440 INFO:teuthology.orchestra.run.smithi002.stdout:] 2024-09-19T06:12:58.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.440+0000 7f161a985640 1 -- 172.21.15.2:0/273925215 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f16000a32c0 msgr2=0x7f16000a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:58.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.440+0000 7f161a985640 1 --2- 172.21.15.2:0/273925215 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f16000a32c0 0x7f16000a5780 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f15fc000c00 tx=0x7f15fc032c70 comp rx=0 tx=0).stop 2024-09-19T06:12:58.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.440+0000 7f161a985640 1 -- 172.21.15.2:0/273925215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1614100e20 msgr2=0x7f1614197300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:58.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.440+0000 7f161a985640 1 --2- 172.21.15.2:0/273925215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1614100e20 0x7f1614197300 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f160400c970 tx=0x7f160400ce30 comp rx=0 tx=0).stop 2024-09-19T06:12:58.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.440+0000 7f161a985640 1 -- 172.21.15.2:0/273925215 shutdown_connections 2024-09-19T06:12:58.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.440+0000 7f161a985640 1 --2- 172.21.15.2:0/273925215 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f16000a32c0 0x7f16000a5780 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:58.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.440+0000 7f161a985640 1 --2- 172.21.15.2:0/273925215 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1614102ef0 0x7f161419bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:58.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.440+0000 7f161a985640 1 --2- 172.21.15.2:0/273925215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1614102570 0x7f1614197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:58.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.440+0000 7f161a985640 1 --2- 172.21.15.2:0/273925215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1614100e20 0x7f1614197300 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:58.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.441+0000 7f161a985640 1 -- 172.21.15.2:0/273925215 >> 172.21.15.2:0/273925215 conn(0x7f16140fc7d0 msgr2=0x7f16140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:58.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.441+0000 7f161a985640 1 -- 172.21.15.2:0/273925215 shutdown_connections 2024-09-19T06:12:58.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:58.441+0000 7f161a985640 1 -- 172.21.15.2:0/273925215 wait complete. 2024-09-19T06:12:58.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:58 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:58.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:58 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:58.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:58 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:58.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:58 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:12:58.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:58 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:58.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:58 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/273925215' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T06:12:58.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:58 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:58.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:58 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:58.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:58 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:58.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:58 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:12:58.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:58 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:58.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:58 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/273925215' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T06:12:59.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:58 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:59.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:58 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:59.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:58 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:59.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:58 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:12:59.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:58 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:12:59.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:58 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/273925215' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T06:12:59.141 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T06:12:59.141 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T06:12:59.401 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:12:59.778 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:12:59 smithi002 ceph-mon[30982]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:59.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:59.863+0000 7f000a151640 1 -- 172.21.15.2:0/2544474719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00041082e0 msgr2=0x7f000410ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:59.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:59.863+0000 7f000a151640 1 --2- 172.21.15.2:0/2544474719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00041082e0 0x7f000410ec50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efffc009cd0 tx=0x7efffc02a8f0 comp rx=0 tx=0).stop 2024-09-19T06:12:59.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:59.863+0000 7f000a151640 1 -- 172.21.15.2:0/2544474719 shutdown_connections 2024-09-19T06:12:59.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:59.863+0000 7f000a151640 1 --2- 172.21.15.2:0/2544474719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00041082e0 0x7f000410ec50 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:59.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:59.863+0000 7f000a151640 1 --2- 172.21.15.2:0/2544474719 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0004103760 0x7f0004107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:59.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:59.863+0000 7f000a151640 1 --2- 172.21.15.2:0/2544474719 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0004102db0 0x7f0004103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:59.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:59.863+0000 7f000a151640 1 -- 172.21.15.2:0/2544474719 >> 172.21.15.2:0/2544474719 conn(0x7f00040fc7d0 msgr2=0x7f00040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:59.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:59.863+0000 7f000a151640 1 -- 172.21.15.2:0/2544474719 shutdown_connections 2024-09-19T06:12:59.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:59.863+0000 7f000a151640 1 -- 172.21.15.2:0/2544474719 wait complete. 2024-09-19T06:12:59.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:59.863+0000 7f000a151640 1 Processor -- start 2024-09-19T06:12:59.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:59.864+0000 7f000a151640 1 -- start start 2024-09-19T06:12:59.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:59.864+0000 7f000a151640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0004102db0 0x7f0004100a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:59.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:59.864+0000 7f000a151640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0004103760 0x7f0004100f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:59.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:59.864+0000 7f000a151640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f00041082e0 0x7f0004101490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:59.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:59.864+0000 7f000a151640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0004111fb0 con 0x7f0004102db0 2024-09-19T06:12:59.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:59.864+0000 7f000a151640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0004111e30 con 0x7f0004103760 2024-09-19T06:12:59.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:59.864+0000 7f000a151640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0004112130 con 0x7f00041082e0 2024-09-19T06:12:59.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:59.864+0000 7f00037fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0004102db0 0x7f0004100a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:59.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:59.864+0000 7f00037fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0004102db0 0x7f0004100a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55988/0 (socket says 172.21.15.2:55988) 2024-09-19T06:12:59.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:59.864+0000 7f00037fe640 1 -- 172.21.15.2:0/3436608791 learned_addr learned my addr 172.21.15.2:0/3436608791 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:12:59.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:59.864+0000 7f0003fff640 1 --2- 172.21.15.2:0/3436608791 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f00041082e0 0x7f0004101490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:59.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:59.864+0000 7f0002ffd640 1 --2- 172.21.15.2:0/3436608791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0004103760 0x7f0004100f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:59.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:59.864+0000 7f00037fe640 1 -- 172.21.15.2:0/3436608791 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f00041082e0 msgr2=0x7f0004101490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:59.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:59.864+0000 7f00037fe640 1 --2- 172.21.15.2:0/3436608791 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f00041082e0 0x7f0004101490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:59.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:59.864+0000 7f00037fe640 1 -- 172.21.15.2:0/3436608791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0004103760 msgr2=0x7f0004100f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:59.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:59.864+0000 7f00037fe640 1 --2- 172.21.15.2:0/3436608791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0004103760 0x7f0004100f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:59.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:59.864+0000 7f00037fe640 1 -- 172.21.15.2:0/3436608791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00041a67c0 con 0x7f0004102db0 2024-09-19T06:12:59.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:59.864+0000 7f0002ffd640 1 --2- 172.21.15.2:0/3436608791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0004103760 0x7f0004100f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:12:59.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:59.864+0000 7f00037fe640 1 --2- 172.21.15.2:0/3436608791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0004102db0 0x7f0004100a10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efff400c920 tx=0x7efff400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:59.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:59.865+0000 7f0000ff9640 1 -- 172.21.15.2:0/3436608791 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff4007c70 con 0x7f0004102db0 2024-09-19T06:12:59.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:59.865+0000 7f0000ff9640 1 -- 172.21.15.2:0/3436608791 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efff4007e10 con 0x7f0004102db0 2024-09-19T06:12:59.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:59.865+0000 7f000a151640 1 -- 172.21.15.2:0/3436608791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00041a6ab0 con 0x7f0004102db0 2024-09-19T06:12:59.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:59.865+0000 7f0000ff9640 1 -- 172.21.15.2:0/3436608791 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff4018820 con 0x7f0004102db0 2024-09-19T06:12:59.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:59.865+0000 7f000a151640 1 -- 172.21.15.2:0/3436608791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00041a7040 con 0x7f0004102db0 2024-09-19T06:12:59.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:59.866+0000 7f000a151640 1 -- 172.21.15.2:0/3436608791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0004103190 con 0x7f0004102db0 2024-09-19T06:12:59.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:59.867+0000 7f0000ff9640 1 -- 172.21.15.2:0/3436608791 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7efff40189c0 con 0x7f0004102db0 2024-09-19T06:12:59.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:59.868+0000 7f0000ff9640 1 --2- 172.21.15.2:0/3436608791 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7effec0a32c0 0x7effec0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:59.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:59.868+0000 7f0002ffd640 1 --2- 172.21.15.2:0/3436608791 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7effec0a32c0 0x7effec0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:59.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:59.868+0000 7f0000ff9640 1 -- 172.21.15.2:0/3436608791 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7efff40cf520 con 0x7f0004102db0 2024-09-19T06:12:59.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:59.868+0000 7f0002ffd640 1 --2- 172.21.15.2:0/3436608791 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7effec0a32c0 0x7effec0a5780 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7efff8005e10 tx=0x7efff8005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:59.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:12:59.872+0000 7f0000ff9640 1 -- 172.21.15.2:0/3436608791 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efff4014030 con 0x7f0004102db0 2024-09-19T06:12:59.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:12:59 smithi090 ceph-mon[34497]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:13:00.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:12:59 smithi089 ceph-mon[34160]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:13:00.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:00.049+0000 7f000a151640 1 -- 172.21.15.2:0/3436608791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f0004101f40 con 0x7f0004102db0 2024-09-19T06:13:00.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:00.637+0000 7f0000ff9640 1 -- 172.21.15.2:0/3436608791 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v75) ==== 138+0+0 (secure 0 0 0) 0x7efff409c6e0 con 0x7f0004102db0 2024-09-19T06:13:00.639 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2024-09-19T06:13:00.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:00.639+0000 7f000a151640 1 -- 172.21.15.2:0/3436608791 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7effec0a32c0 msgr2=0x7effec0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:00.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:00.639+0000 7f000a151640 1 --2- 172.21.15.2:0/3436608791 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7effec0a32c0 0x7effec0a5780 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7efff8005e10 tx=0x7efff8005da0 comp rx=0 tx=0).stop 2024-09-19T06:13:00.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:00.639+0000 7f000a151640 1 -- 172.21.15.2:0/3436608791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0004102db0 msgr2=0x7f0004100a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:00.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:00.639+0000 7f000a151640 1 --2- 172.21.15.2:0/3436608791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0004102db0 0x7f0004100a10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efff400c920 tx=0x7efff400cde0 comp rx=0 tx=0).stop 2024-09-19T06:13:00.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:00.639+0000 7f000a151640 1 -- 172.21.15.2:0/3436608791 shutdown_connections 2024-09-19T06:13:00.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:00.639+0000 7f000a151640 1 --2- 172.21.15.2:0/3436608791 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7effec0a32c0 0x7effec0a5780 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:00.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:00.639+0000 7f000a151640 1 --2- 172.21.15.2:0/3436608791 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f00041082e0 0x7f0004101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:00.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:00.639+0000 7f000a151640 1 --2- 172.21.15.2:0/3436608791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0004103760 0x7f0004100f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:00.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:00.639+0000 7f000a151640 1 --2- 172.21.15.2:0/3436608791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0004102db0 0x7f0004100a10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:00.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:00.639+0000 7f000a151640 1 -- 172.21.15.2:0/3436608791 >> 172.21.15.2:0/3436608791 conn(0x7f00040fc7d0 msgr2=0x7f00040fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:00.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:00.639+0000 7f000a151640 1 -- 172.21.15.2:0/3436608791 shutdown_connections 2024-09-19T06:13:00.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:00.640+0000 7f000a151640 1 -- 172.21.15.2:0/3436608791 wait complete. 2024-09-19T06:13:00.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:00 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/3436608791' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T06:13:00.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:00 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/3436608791' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T06:13:01.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:00 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/3436608791' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T06:13:01.410 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T06:13:01.651 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:01 smithi002 ceph-mon[30982]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:13:01.651 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:01 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/3436608791' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T06:13:01.651 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:01 smithi002 ceph-mon[30982]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T06:13:01.684 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:01.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:01 smithi090 ceph-mon[34497]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:13:01.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:01 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/3436608791' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T06:13:01.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:01 smithi090 ceph-mon[34497]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T06:13:02.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:01 smithi089 ceph-mon[34160]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:13:02.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:01 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/3436608791' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T06:13:02.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:01 smithi089 ceph-mon[34160]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T06:13:02.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.147+0000 7fb51e1f8640 1 -- 172.21.15.2:0/2331923793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb518102790 msgr2=0x7fb5181067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:02.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.147+0000 7fb51e1f8640 1 --2- 172.21.15.2:0/2331923793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb518102790 0x7fb5181067e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb50c009900 tx=0x7fb50c02a410 comp rx=0 tx=0).stop 2024-09-19T06:13:02.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.147+0000 7fb51e1f8640 1 -- 172.21.15.2:0/2331923793 shutdown_connections 2024-09-19T06:13:02.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.147+0000 7fb51e1f8640 1 --2- 172.21.15.2:0/2331923793 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb518106f10 0x7fb51810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:02.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.147+0000 7fb51e1f8640 1 --2- 172.21.15.2:0/2331923793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb518102790 0x7fb5181067e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:02.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.147+0000 7fb51e1f8640 1 --2- 172.21.15.2:0/2331923793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb518101de0 0x7fb5181021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:02.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.147+0000 7fb51e1f8640 1 -- 172.21.15.2:0/2331923793 >> 172.21.15.2:0/2331923793 conn(0x7fb5180fd8c0 msgr2=0x7fb5180ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:02.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.147+0000 7fb51e1f8640 1 -- 172.21.15.2:0/2331923793 shutdown_connections 2024-09-19T06:13:02.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.147+0000 7fb51e1f8640 1 -- 172.21.15.2:0/2331923793 wait complete. 2024-09-19T06:13:02.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.148+0000 7fb51e1f8640 1 Processor -- start 2024-09-19T06:13:02.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.148+0000 7fb51e1f8640 1 -- start start 2024-09-19T06:13:02.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.148+0000 7fb51e1f8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb518101de0 0x7fb518198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:02.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.148+0000 7fb51e1f8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb518102790 0x7fb518198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:02.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.148+0000 7fb51e1f8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb518106f10 0x7fb51819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:02.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.148+0000 7fb51e1f8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb518111e40 con 0x7fb518106f10 2024-09-19T06:13:02.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.148+0000 7fb51e1f8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb518111cc0 con 0x7fb518102790 2024-09-19T06:13:02.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.148+0000 7fb51e1f8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb518111fc0 con 0x7fb518101de0 2024-09-19T06:13:02.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.148+0000 7fb517fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb518106f10 0x7fb51819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:02.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.149+0000 7fb517fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb518106f10 0x7fb51819cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56004/0 (socket says 172.21.15.2:56004) 2024-09-19T06:13:02.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.149+0000 7fb517fff640 1 -- 172.21.15.2:0/1358005151 learned_addr learned my addr 172.21.15.2:0/1358005151 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:13:02.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.149+0000 7fb5177fe640 1 --2- 172.21.15.2:0/1358005151 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb518101de0 0x7fb518198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:02.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.149+0000 7fb516ffd640 1 --2- 172.21.15.2:0/1358005151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb518102790 0x7fb518198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:02.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.149+0000 7fb517fff640 1 -- 172.21.15.2:0/1358005151 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb518101de0 msgr2=0x7fb518198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:02.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.149+0000 7fb517fff640 1 --2- 172.21.15.2:0/1358005151 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb518101de0 0x7fb518198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:02.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.149+0000 7fb517fff640 1 -- 172.21.15.2:0/1358005151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb518102790 msgr2=0x7fb518198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:02.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.149+0000 7fb517fff640 1 --2- 172.21.15.2:0/1358005151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb518102790 0x7fb518198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:02.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.149+0000 7fb517fff640 1 -- 172.21.15.2:0/1358005151 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb51819d3e0 con 0x7fb518106f10 2024-09-19T06:13:02.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.149+0000 7fb516ffd640 1 --2- 172.21.15.2:0/1358005151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb518102790 0x7fb518198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:13:02.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.149+0000 7fb517fff640 1 --2- 172.21.15.2:0/1358005151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb518106f10 0x7fb51819cd00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb51000b970 tx=0x7fb51000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:02.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.149+0000 7fb514ff9640 1 -- 172.21.15.2:0/1358005151 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb510019070 con 0x7fb518106f10 2024-09-19T06:13:02.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.149+0000 7fb514ff9640 1 -- 172.21.15.2:0/1358005151 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb510014440 con 0x7fb518106f10 2024-09-19T06:13:02.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.149+0000 7fb51e1f8640 1 -- 172.21.15.2:0/1358005151 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb51819d6d0 con 0x7fb518106f10 2024-09-19T06:13:02.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.149+0000 7fb514ff9640 1 -- 172.21.15.2:0/1358005151 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5100075d0 con 0x7fb518106f10 2024-09-19T06:13:02.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.149+0000 7fb51e1f8640 1 -- 172.21.15.2:0/1358005151 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5181a4fb0 con 0x7fb518106f10 2024-09-19T06:13:02.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.150+0000 7fb51e1f8640 1 -- 172.21.15.2:0/1358005151 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5181021c0 con 0x7fb518106f10 2024-09-19T06:13:02.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.152+0000 7fb514ff9640 1 -- 172.21.15.2:0/1358005151 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fb51001c070 con 0x7fb518106f10 2024-09-19T06:13:02.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.152+0000 7fb514ff9640 1 --2- 172.21.15.2:0/1358005151 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fb5000a3240 0x7fb5000a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:02.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.152+0000 7fb514ff9640 1 -- 172.21.15.2:0/1358005151 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7497+0+0 (secure 0 0 0) 0x7fb5100cebb0 con 0x7fb518106f10 2024-09-19T06:13:02.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.152+0000 7fb5177fe640 1 --2- 172.21.15.2:0/1358005151 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fb5000a3240 0x7fb5000a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:02.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.153+0000 7fb5177fe640 1 --2- 172.21.15.2:0/1358005151 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fb5000a3240 0x7fb5000a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb508005d00 tx=0x7fb50800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:02.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.157+0000 7fb514ff9640 1 -- 172.21.15.2:0/1358005151 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb51009b5b0 con 0x7fb518106f10 2024-09-19T06:13:02.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.333+0000 7fb51e1f8640 1 -- 172.21.15.2:0/1358005151 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb51810a0f0 con 0x7fb518106f10 2024-09-19T06:13:02.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.771+0000 7fb514ff9640 1 -- 172.21.15.2:0/1358005151 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v77) ==== 170+0+0 (secure 0 0 0) 0x7fb51009f8b0 con 0x7fb518106f10 2024-09-19T06:13:02.774 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' created 2024-09-19T06:13:02.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.774+0000 7fb51e1f8640 1 -- 172.21.15.2:0/1358005151 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fb5000a3240 msgr2=0x7fb5000a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:02.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.774+0000 7fb51e1f8640 1 --2- 172.21.15.2:0/1358005151 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fb5000a3240 0x7fb5000a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb508005d00 tx=0x7fb50800b410 comp rx=0 tx=0).stop 2024-09-19T06:13:02.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.774+0000 7fb51e1f8640 1 -- 172.21.15.2:0/1358005151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb518106f10 msgr2=0x7fb51819cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:02.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.774+0000 7fb51e1f8640 1 --2- 172.21.15.2:0/1358005151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb518106f10 0x7fb51819cd00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb51000b970 tx=0x7fb51000be30 comp rx=0 tx=0).stop 2024-09-19T06:13:02.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.774+0000 7fb51e1f8640 1 -- 172.21.15.2:0/1358005151 shutdown_connections 2024-09-19T06:13:02.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.774+0000 7fb51e1f8640 1 --2- 172.21.15.2:0/1358005151 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fb5000a3240 0x7fb5000a5700 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:02.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.774+0000 7fb51e1f8640 1 --2- 172.21.15.2:0/1358005151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb518106f10 0x7fb51819cd00 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:02.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.774+0000 7fb51e1f8640 1 --2- 172.21.15.2:0/1358005151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb518102790 0x7fb518198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:02.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.774+0000 7fb51e1f8640 1 --2- 172.21.15.2:0/1358005151 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb518101de0 0x7fb518198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:02.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.774+0000 7fb51e1f8640 1 -- 172.21.15.2:0/1358005151 >> 172.21.15.2:0/1358005151 conn(0x7fb5180fd8c0 msgr2=0x7fb5180fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:02.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.774+0000 7fb51e1f8640 1 -- 172.21.15.2:0/1358005151 shutdown_connections 2024-09-19T06:13:02.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:02.774+0000 7fb51e1f8640 1 -- 172.21.15.2:0/1358005151 wait complete. 2024-09-19T06:13:03.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:02 smithi089 ceph-mon[34160]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T06:13:03.072 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:02 smithi002 ceph-mon[30982]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T06:13:03.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:02 smithi090 ceph-mon[34497]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T06:13:03.405 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T06:13:03.664 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:04.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:03 smithi089 ceph-mon[34160]: pgmap v271: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:13:04.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:03 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1358005151' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T06:13:04.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:03 smithi089 ceph-mon[34160]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T06:13:04.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:03 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1358005151' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T06:13:04.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:03 smithi089 ceph-mon[34160]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T06:13:04.043 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:03 smithi002 ceph-mon[30982]: pgmap v271: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:13:04.043 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:03 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1358005151' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T06:13:04.043 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:03 smithi002 ceph-mon[30982]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T06:13:04.043 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:03 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1358005151' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T06:13:04.043 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:03 smithi002 ceph-mon[30982]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T06:13:04.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.125+0000 7f58fe59d640 1 -- 172.21.15.2:0/1271036397 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58f8103510 msgr2=0x7f58f810ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:04.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.125+0000 7f58fe59d640 1 --2- 172.21.15.2:0/1271036397 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58f8103510 0x7f58f810ba00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f58ec009900 tx=0x7f58ec02a480 comp rx=0 tx=0).stop 2024-09-19T06:13:04.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.125+0000 7f58fe59d640 1 -- 172.21.15.2:0/1271036397 shutdown_connections 2024-09-19T06:13:04.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.125+0000 7f58fe59d640 1 --2- 172.21.15.2:0/1271036397 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58f810bfd0 0x7f58f810e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:04.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.125+0000 7f58fe59d640 1 --2- 172.21.15.2:0/1271036397 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58f8103510 0x7f58f810ba00 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:04.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.125+0000 7f58fe59d640 1 --2- 172.21.15.2:0/1271036397 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58f8102bf0 0x7f58f8102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:04.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.125+0000 7f58fe59d640 1 -- 172.21.15.2:0/1271036397 >> 172.21.15.2:0/1271036397 conn(0x7f58f80fc630 msgr2=0x7f58f80fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:04.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.125+0000 7f58fe59d640 1 -- 172.21.15.2:0/1271036397 shutdown_connections 2024-09-19T06:13:04.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.125+0000 7f58fe59d640 1 -- 172.21.15.2:0/1271036397 wait complete. 2024-09-19T06:13:04.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.126+0000 7f58fe59d640 1 Processor -- start 2024-09-19T06:13:04.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.126+0000 7f58fe59d640 1 -- start start 2024-09-19T06:13:04.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.126+0000 7f58fe59d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58f8102bf0 0x7f58f8100850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:04.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.126+0000 7f58fe59d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58f8103510 0x7f58f8100d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:04.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.126+0000 7f58fe59d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58f810bfd0 0x7f58f81012d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:04.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.126+0000 7f58fe59d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f58f8111c60 con 0x7f58f8102bf0 2024-09-19T06:13:04.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.126+0000 7f58fe59d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f58f8111ae0 con 0x7f58f810bfd0 2024-09-19T06:13:04.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.126+0000 7f58fe59d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f58f8111de0 con 0x7f58f8103510 2024-09-19T06:13:04.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.126+0000 7f58fd59b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58f8102bf0 0x7f58f8100850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:04.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.126+0000 7f58fd59b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58f8102bf0 0x7f58f8100850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56010/0 (socket says 172.21.15.2:56010) 2024-09-19T06:13:04.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.126+0000 7f58fd59b640 1 -- 172.21.15.2:0/3333613596 learned_addr learned my addr 172.21.15.2:0/3333613596 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:13:04.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.126+0000 7f58fdd9c640 1 --2- 172.21.15.2:0/3333613596 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58f810bfd0 0x7f58f81012d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:04.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.126+0000 7f58fcd9a640 1 --2- 172.21.15.2:0/3333613596 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58f8103510 0x7f58f8100d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:04.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.126+0000 7f58fd59b640 1 -- 172.21.15.2:0/3333613596 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58f8103510 msgr2=0x7f58f8100d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:04.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.126+0000 7f58fd59b640 1 --2- 172.21.15.2:0/3333613596 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58f8103510 0x7f58f8100d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:04.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.126+0000 7f58fd59b640 1 -- 172.21.15.2:0/3333613596 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58f810bfd0 msgr2=0x7f58f81012d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:04.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.126+0000 7f58fd59b640 1 --2- 172.21.15.2:0/3333613596 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58f810bfd0 0x7f58f81012d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:04.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.126+0000 7f58fd59b640 1 -- 172.21.15.2:0/3333613596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58f81a6640 con 0x7f58f8102bf0 2024-09-19T06:13:04.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.126+0000 7f58fdd9c640 1 --2- 172.21.15.2:0/3333613596 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58f810bfd0 0x7f58f81012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:13:04.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.127+0000 7f58fd59b640 1 --2- 172.21.15.2:0/3333613596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58f8102bf0 0x7f58f8100850 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f58f400eab0 tx=0x7f58f400ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:04.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.127+0000 7f58ea7fc640 1 -- 172.21.15.2:0/3333613596 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f400ce40 con 0x7f58f8102bf0 2024-09-19T06:13:04.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.127+0000 7f58ea7fc640 1 -- 172.21.15.2:0/3333613596 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f58f4011920 con 0x7f58f8102bf0 2024-09-19T06:13:04.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.127+0000 7f58fe59d640 1 -- 172.21.15.2:0/3333613596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58f81a6930 con 0x7f58f8102bf0 2024-09-19T06:13:04.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.127+0000 7f58ea7fc640 1 -- 172.21.15.2:0/3333613596 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f4010a00 con 0x7f58f8102bf0 2024-09-19T06:13:04.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.127+0000 7f58fe59d640 1 -- 172.21.15.2:0/3333613596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58f81a6ec0 con 0x7f58f8102bf0 2024-09-19T06:13:04.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.128+0000 7f58fe59d640 1 -- 172.21.15.2:0/3333613596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58f8102fd0 con 0x7f58f8102bf0 2024-09-19T06:13:04.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.129+0000 7f58ea7fc640 1 -- 172.21.15.2:0/3333613596 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f58f4011ad0 con 0x7f58f8102bf0 2024-09-19T06:13:04.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.130+0000 7f58ea7fc640 1 --2- 172.21.15.2:0/3333613596 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f58e40a32c0 0x7f58e40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:04.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.130+0000 7f58ea7fc640 1 -- 172.21.15.2:0/3333613596 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7879+0+0 (secure 0 0 0) 0x7f58f40cfdd0 con 0x7f58f8102bf0 2024-09-19T06:13:04.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.130+0000 7f58fcd9a640 1 --2- 172.21.15.2:0/3333613596 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f58e40a32c0 0x7f58e40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:04.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.130+0000 7f58fcd9a640 1 --2- 172.21.15.2:0/3333613596 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f58e40a32c0 0x7f58e40a5780 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f58ec006010 tx=0x7f58ec000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:04.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.133+0000 7f58ea7fc640 1 -- 172.21.15.2:0/3333613596 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f58f4016030 con 0x7f58f8102bf0 2024-09-19T06:13:04.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:03 smithi090 ceph-mon[34497]: pgmap v271: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:13:04.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:03 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1358005151' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T06:13:04.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:03 smithi090 ceph-mon[34497]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T06:13:04.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:03 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1358005151' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T06:13:04.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:03 smithi090 ceph-mon[34497]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T06:13:04.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.346+0000 7f58fe59d640 1 -- 172.21.15.2:0/3333613596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f58f8101d80 con 0x7f58f8102bf0 2024-09-19T06:13:04.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.784+0000 7f58ea7fc640 1 -- 172.21.15.2:0/3333613596 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f58f4021350 con 0x7f58f8102bf0 2024-09-19T06:13:04.787 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 2 and data pool 3 2024-09-19T06:13:04.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.787+0000 7f58fe59d640 1 -- 172.21.15.2:0/3333613596 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f58e40a32c0 msgr2=0x7f58e40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:04.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.787+0000 7f58fe59d640 1 --2- 172.21.15.2:0/3333613596 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f58e40a32c0 0x7f58e40a5780 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f58ec006010 tx=0x7f58ec000bc0 comp rx=0 tx=0).stop 2024-09-19T06:13:04.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.787+0000 7f58fe59d640 1 -- 172.21.15.2:0/3333613596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58f8102bf0 msgr2=0x7f58f8100850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:04.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.787+0000 7f58fe59d640 1 --2- 172.21.15.2:0/3333613596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58f8102bf0 0x7f58f8100850 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f58f400eab0 tx=0x7f58f400ef70 comp rx=0 tx=0).stop 2024-09-19T06:13:04.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.787+0000 7f58fe59d640 1 -- 172.21.15.2:0/3333613596 shutdown_connections 2024-09-19T06:13:04.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.787+0000 7f58fe59d640 1 --2- 172.21.15.2:0/3333613596 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f58e40a32c0 0x7f58e40a5780 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:04.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.787+0000 7f58fe59d640 1 --2- 172.21.15.2:0/3333613596 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58f810bfd0 0x7f58f81012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:04.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.787+0000 7f58fe59d640 1 --2- 172.21.15.2:0/3333613596 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58f8103510 0x7f58f8100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:04.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.787+0000 7f58fe59d640 1 --2- 172.21.15.2:0/3333613596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58f8102bf0 0x7f58f8100850 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:04.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.787+0000 7f58fe59d640 1 -- 172.21.15.2:0/3333613596 >> 172.21.15.2:0/3333613596 conn(0x7f58f80fc630 msgr2=0x7f58f80fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:04.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.787+0000 7f58fe59d640 1 -- 172.21.15.2:0/3333613596 shutdown_connections 2024-09-19T06:13:04.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:04.787+0000 7f58fe59d640 1 -- 172.21.15.2:0/3333613596 wait complete. 2024-09-19T06:13:05.085 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:04 smithi089 ceph-mon[34160]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T06:13:05.085 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:04 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/3333613596' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T06:13:05.085 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:04 smithi089 ceph-mon[34160]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T06:13:05.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:04 smithi002 ceph-mon[30982]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T06:13:05.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:04 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/3333613596' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T06:13:05.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:04 smithi002 ceph-mon[30982]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T06:13:05.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:04 smithi090 ceph-mon[34497]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T06:13:05.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:04 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/3333613596' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T06:13:05.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:04 smithi090 ceph-mon[34497]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T06:13:05.499 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:13:05.762 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:06.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:05 smithi089 ceph-mon[34160]: pgmap v274: 97 pgs: 30 creating+peering, 43 active+clean, 24 unknown; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:13:06.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:05 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/3333613596' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T06:13:06.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:05 smithi089 ceph-mon[34160]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T06:13:06.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:05 smithi089 ceph-mon[34160]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T06:13:06.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:05 smithi089 ceph-mon[34160]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T06:13:06.056 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:05 smithi002 ceph-mon[30982]: pgmap v274: 97 pgs: 30 creating+peering, 43 active+clean, 24 unknown; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:13:06.056 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:05 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/3333613596' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T06:13:06.056 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:05 smithi002 ceph-mon[30982]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T06:13:06.056 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:05 smithi002 ceph-mon[30982]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T06:13:06.056 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:05 smithi002 ceph-mon[30982]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T06:13:06.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:05 smithi090 ceph-mon[34497]: pgmap v274: 97 pgs: 30 creating+peering, 43 active+clean, 24 unknown; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:13:06.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:05 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/3333613596' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T06:13:06.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:05 smithi090 ceph-mon[34497]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T06:13:06.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:05 smithi090 ceph-mon[34497]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T06:13:06.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:05 smithi090 ceph-mon[34497]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T06:13:06.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.279+0000 7fdbdad33640 1 -- 172.21.15.2:0/2903294535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbd4106f10 msgr2=0x7fdbd410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:06.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.279+0000 7fdbdad33640 1 --2- 172.21.15.2:0/2903294535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbd4106f10 0x7fdbd410ea90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc009ca0 tx=0x7fdbcc02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:13:06.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.279+0000 7fdbdad33640 1 -- 172.21.15.2:0/2903294535 shutdown_connections 2024-09-19T06:13:06.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.279+0000 7fdbdad33640 1 --2- 172.21.15.2:0/2903294535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbd4106f10 0x7fdbd410ea90 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:06.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.279+0000 7fdbdad33640 1 --2- 172.21.15.2:0/2903294535 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbd4102790 0x7fdbd41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:06.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.279+0000 7fdbdad33640 1 --2- 172.21.15.2:0/2903294535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbd4101de0 0x7fdbd41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:06.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.279+0000 7fdbdad33640 1 -- 172.21.15.2:0/2903294535 >> 172.21.15.2:0/2903294535 conn(0x7fdbd40fd8c0 msgr2=0x7fdbd40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:06.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.279+0000 7fdbdad33640 1 -- 172.21.15.2:0/2903294535 shutdown_connections 2024-09-19T06:13:06.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.279+0000 7fdbdad33640 1 -- 172.21.15.2:0/2903294535 wait complete. 2024-09-19T06:13:06.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.280+0000 7fdbdad33640 1 Processor -- start 2024-09-19T06:13:06.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.280+0000 7fdbdad33640 1 -- start start 2024-09-19T06:13:06.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.280+0000 7fdbdad33640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbd4101de0 0x7fdbd40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:06.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.280+0000 7fdbdad33640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbd4102790 0x7fdbd4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:06.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.280+0000 7fdbdad33640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbd4106f10 0x7fdbd4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:06.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.280+0000 7fdbdad33640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd4111e40 con 0x7fdbd4106f10 2024-09-19T06:13:06.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.280+0000 7fdbdad33640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd4111cc0 con 0x7fdbd4102790 2024-09-19T06:13:06.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.280+0000 7fdbdad33640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd4111fc0 con 0x7fdbd4101de0 2024-09-19T06:13:06.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.280+0000 7fdbd92d0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbd4106f10 0x7fdbd4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:06.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.280+0000 7fdbd92d0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbd4106f10 0x7fdbd4074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55226/0 (socket says 172.21.15.2:55226) 2024-09-19T06:13:06.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.280+0000 7fdbd92d0640 1 -- 172.21.15.2:0/454567197 learned_addr learned my addr 172.21.15.2:0/454567197 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:13:06.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.280+0000 7fdbd3fff640 1 --2- 172.21.15.2:0/454567197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbd4102790 0x7fdbd4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:06.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.281+0000 7fdbd8acf640 1 --2- 172.21.15.2:0/454567197 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbd4101de0 0x7fdbd40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:06.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.281+0000 7fdbd92d0640 1 -- 172.21.15.2:0/454567197 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbd4101de0 msgr2=0x7fdbd40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:06.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.281+0000 7fdbd92d0640 1 --2- 172.21.15.2:0/454567197 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbd4101de0 0x7fdbd40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:06.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.281+0000 7fdbd92d0640 1 -- 172.21.15.2:0/454567197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbd4102790 msgr2=0x7fdbd4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:06.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.281+0000 7fdbd92d0640 1 --2- 172.21.15.2:0/454567197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbd4102790 0x7fdbd4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:06.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.281+0000 7fdbd92d0640 1 -- 172.21.15.2:0/454567197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbd41a68c0 con 0x7fdbd4106f10 2024-09-19T06:13:06.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.281+0000 7fdbd92d0640 1 --2- 172.21.15.2:0/454567197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbd4106f10 0x7fdbd4074f70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc009dc0 tx=0x7fdbcc032ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:06.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.282+0000 7fdbd1ffb640 1 -- 172.21.15.2:0/454567197 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc003cf0 con 0x7fdbd4106f10 2024-09-19T06:13:06.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.282+0000 7fdbd1ffb640 1 -- 172.21.15.2:0/454567197 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdbcc0044f0 con 0x7fdbd4106f10 2024-09-19T06:13:06.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.282+0000 7fdbdad33640 1 -- 172.21.15.2:0/454567197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbd41a6b50 con 0x7fdbd4106f10 2024-09-19T06:13:06.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.282+0000 7fdbd1ffb640 1 -- 172.21.15.2:0/454567197 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc030b80 con 0x7fdbd4106f10 2024-09-19T06:13:06.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.282+0000 7fdbdad33640 1 -- 172.21.15.2:0/454567197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbd41a70e0 con 0x7fdbd4106f10 2024-09-19T06:13:06.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.283+0000 7fdbdad33640 1 -- 172.21.15.2:0/454567197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbd41021c0 con 0x7fdbd4106f10 2024-09-19T06:13:06.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.284+0000 7fdbd1ffb640 1 -- 172.21.15.2:0/454567197 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fdbcc0046a0 con 0x7fdbd4106f10 2024-09-19T06:13:06.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.285+0000 7fdbd1ffb640 1 --2- 172.21.15.2:0/454567197 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fdbc40a32c0 0x7fdbc40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:06.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.285+0000 7fdbd8acf640 1 --2- 172.21.15.2:0/454567197 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fdbc40a32c0 0x7fdbc40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:06.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.285+0000 7fdbd1ffb640 1 -- 172.21.15.2:0/454567197 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7fdbcc0f0cf0 con 0x7fdbd4106f10 2024-09-19T06:13:06.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.285+0000 7fdbd8acf640 1 --2- 172.21.15.2:0/454567197 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fdbc40a32c0 0x7fdbc40a5780 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdbc800bbe0 tx=0x7fdbc800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:06.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.289+0000 7fdbd1ffb640 1 -- 172.21.15.2:0/454567197 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdbcc0bdac0 con 0x7fdbd4106f10 2024-09-19T06:13:06.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.467+0000 7fdbdad33640 1 -- 172.21.15.2:0/454567197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdbd410a0f0 con 0x7fdbd4106f10 2024-09-19T06:13:06.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.469+0000 7fdbd1ffb640 1 -- 172.21.15.2:0/454567197 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+22126 (secure 0 0 0) 0x7fdbcc0bd3c0 con 0x7fdbd4106f10 2024-09-19T06:13:06.471 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:13:06.471 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":79,"fsid":"078f6612-764d-11ef-bceb-c7b262605968","created":"2024-09-19T06:05:17.607927+0000","modified":"2024-09-19T06:13:04.348374+0000","last_up_change":"2024-09-19T06:12:13.856684+0000","last_in_change":"2024-09-19T06:11:49.745266+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:08:28.425566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:13:00.482789+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:13:02.768221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0de97a3d-2d27-455b-9998-ddd2319c148d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6803","nonce":915165910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6805","nonce":915165910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6809","nonce":915165910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6807","nonce":915165910}]},"public_addr":"172.21.15.2:6803/915165910","cluster_addr":"172.21.15.2:6805/915165910","heartbeat_back_addr":"172.21.15.2:6809/915165910","heartbeat_front_addr":"172.21.15.2:6807/915165910","state":["exists","up"]},{"osd":1,"uuid":"056d229e-2de4-4902-922e-21e1a5d3f061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6801","nonce":4097264171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6803","nonce":4097264171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6807","nonce":4097264171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6805","nonce":4097264171}]},"public_addr":"172.21.15.89:6801/4097264171","cluster_addr":"172.21.15.89:6803/4097264171","heartbeat_back_addr":"172.21.15.89:6807/4097264171","heartbeat_front_addr":"172.21.15.89:6805/4097264171","state":["exists","up"]},{"osd":2,"uuid":"2a4e7147-4125-4ee6-b5ad-85518d7066d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6801","nonce":1479908200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6803","nonce":1479908200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6807","nonce":1479908200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6805","nonce":1479908200}]},"public_addr":"172.21.15.90:6801/1479908200","cluster_addr":"172.21.15.90:6803/1479908200","heartbeat_back_addr":"172.21.15.90:6807/1479908200","heartbeat_front_addr":"172.21.15.90:6805/1479908200","state":["exists","up"]},{"osd":3,"uuid":"7b3da775-0f0a-4b46-a8dc-9ec822a54301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6811","nonce":1796948193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6813","nonce":1796948193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6817","nonce":1796948193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6815","nonce":1796948193}]},"public_addr":"172.21.15.2:6811/1796948193","cluster_addr":"172.21.15.2:6813/1796948193","heartbeat_back_addr":"172.21.15.2:6817/1796948193","heartbeat_front_addr":"172.21.15.2:6815/1796948193","state":["exists","up"]},{"osd":4,"uuid":"d4c8bafc-c844-4ff1-a3d8-7a53576e6b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6809","nonce":4256848315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6811","nonce":4256848315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6815","nonce":4256848315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6813","nonce":4256848315}]},"public_addr":"172.21.15.89:6809/4256848315","cluster_addr":"172.21.15.89:6811/4256848315","heartbeat_back_addr":"172.21.15.89:6815/4256848315","heartbeat_front_addr":"172.21.15.89:6813/4256848315","state":["exists","up"]},{"osd":5,"uuid":"8dc9bb55-29e0-4b04-9415-3b9bb5ed05cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6809","nonce":189855967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6811","nonce":189855967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6815","nonce":189855967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6813","nonce":189855967}]},"public_addr":"172.21.15.90:6809/189855967","cluster_addr":"172.21.15.90:6811/189855967","heartbeat_back_addr":"172.21.15.90:6815/189855967","heartbeat_front_addr":"172.21.15.90:6813/189855967","state":["exists","up"]},{"osd":6,"uuid":"86d1443a-9b43-46de-abd7-4c95b43207f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6819","nonce":3886336279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6821","nonce":3886336279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6825","nonce":3886336279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6823","nonce":3886336279}]},"public_addr":"172.21.15.2:6819/3886336279","cluster_addr":"172.21.15.2:6821/3886336279","heartbeat_back_addr":"172.21.15.2:6825/3886336279","heartbeat_front_addr":"172.21.15.2:6823/3886336279","state":["exists","up"]},{"osd":7,"uuid":"1cc5554c-80d2-4e77-b29a-fd2ada68d82d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6817","nonce":508513510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6819","nonce":508513510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6823","nonce":508513510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6821","nonce":508513510}]},"public_addr":"172.21.15.89:6817/508513510","cluster_addr":"172.21.15.89:6819/508513510","heartbeat_back_addr":"172.21.15.89:6823/508513510","heartbeat_front_addr":"172.21.15.89:6821/508513510","state":["exists","up"]},{"osd":8,"uuid":"e9b2eb92-9af2-4f26-a259-fcaf972e4fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6817","nonce":3558544480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6819","nonce":3558544480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6823","nonce":3558544480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6821","nonce":3558544480}]},"public_addr":"172.21.15.90:6817/3558544480","cluster_addr":"172.21.15.90:6819/3558544480","heartbeat_back_addr":"172.21.15.90:6823/3558544480","heartbeat_front_addr":"172.21.15.90:6821/3558544480","state":["exists","up"]},{"osd":9,"uuid":"194d4c64-dd29-4d35-bc54-0858c44815cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6827","nonce":2690758100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6829","nonce":2690758100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6833","nonce":2690758100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6831","nonce":2690758100}]},"public_addr":"172.21.15.2:6827/2690758100","cluster_addr":"172.21.15.2:6829/2690758100","heartbeat_back_addr":"172.21.15.2:6833/2690758100","heartbeat_front_addr":"172.21.15.2:6831/2690758100","state":["exists","up"]},{"osd":10,"uuid":"7695fa4a-b94e-4afc-b166-690a197ad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6825","nonce":1141925395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6827","nonce":1141925395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6831","nonce":1141925395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6829","nonce":1141925395}]},"public_addr":"172.21.15.89:6825/1141925395","cluster_addr":"172.21.15.89:6827/1141925395","heartbeat_back_addr":"172.21.15.89:6831/1141925395","heartbeat_front_addr":"172.21.15.89:6829/1141925395","state":["exists","up"]},{"osd":11,"uuid":"1815a999-bfdb-46b9-afcd-632ee8ba56d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6825","nonce":468380924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6827","nonce":468380924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6831","nonce":468380924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6829","nonce":468380924}]},"public_addr":"172.21.15.90:6825/468380924","cluster_addr":"172.21.15.90:6827/468380924","heartbeat_back_addr":"172.21.15.90:6831/468380924","heartbeat_front_addr":"172.21.15.90:6829/468380924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:07:36.125754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:01.415356+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:26.420808+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:51.722673+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:09:16.562300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:09:41.958465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:10:07.056167+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:10:32.066195+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:10:56.497875+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:11:21.973083+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:11:46.891515+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:12:11.910012+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/874985787":"2024-09-20T06:06:11.912585+0000","172.21.15.2:0/1280963020":"2024-09-20T06:06:11.912585+0000","172.21.15.2:0/2976372536":"2024-09-20T06:06:11.912585+0000","172.21.15.2:6801/1602650352":"2024-09-20T06:05:47.538477+0000","172.21.15.2:6800/1602650352":"2024-09-20T06:05:47.538477+0000","172.21.15.2:6800/1200011821":"2024-09-20T06:06:11.912585+0000","172.21.15.2:0/3899165140":"2024-09-20T06:05:47.538477+0000","172.21.15.2:6801/1200011821":"2024-09-20T06:06:11.912585+0000","172.21.15.2:0/1361067708":"2024-09-20T06:05:47.538477+0000","172.21.15.2:0/3763089457":"2024-09-20T06:05:47.538477+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:13:06.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.471+0000 7fdbdad33640 1 -- 172.21.15.2:0/454567197 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fdbc40a32c0 msgr2=0x7fdbc40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:06.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.471+0000 7fdbdad33640 1 --2- 172.21.15.2:0/454567197 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fdbc40a32c0 0x7fdbc40a5780 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdbc800bbe0 tx=0x7fdbc800b390 comp rx=0 tx=0).stop 2024-09-19T06:13:06.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.471+0000 7fdbdad33640 1 -- 172.21.15.2:0/454567197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbd4106f10 msgr2=0x7fdbd4074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:06.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.471+0000 7fdbdad33640 1 --2- 172.21.15.2:0/454567197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbd4106f10 0x7fdbd4074f70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc009dc0 tx=0x7fdbcc032ff0 comp rx=0 tx=0).stop 2024-09-19T06:13:06.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.471+0000 7fdbdad33640 1 -- 172.21.15.2:0/454567197 shutdown_connections 2024-09-19T06:13:06.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.471+0000 7fdbdad33640 1 --2- 172.21.15.2:0/454567197 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fdbc40a32c0 0x7fdbc40a5780 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:06.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.471+0000 7fdbdad33640 1 --2- 172.21.15.2:0/454567197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbd4106f10 0x7fdbd4074f70 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:06.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.471+0000 7fdbdad33640 1 --2- 172.21.15.2:0/454567197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbd4102790 0x7fdbd4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:06.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.471+0000 7fdbdad33640 1 --2- 172.21.15.2:0/454567197 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbd4101de0 0x7fdbd40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:06.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.471+0000 7fdbdad33640 1 -- 172.21.15.2:0/454567197 >> 172.21.15.2:0/454567197 conn(0x7fdbd40fd8c0 msgr2=0x7fdbd40fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:06.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.471+0000 7fdbdad33640 1 -- 172.21.15.2:0/454567197 shutdown_connections 2024-09-19T06:13:06.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:06.471+0000 7fdbdad33640 1 -- 172.21.15.2:0/454567197 wait complete. 2024-09-19T06:13:07.095 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:06 smithi002 ceph-mon[30982]: mds.? [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] up:active 2024-09-19T06:13:07.095 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:06 smithi002 ceph-mon[30982]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:13:07.095 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:06 smithi002 ceph-mon[30982]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:13:07.095 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:06 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/454567197' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:13:07.125 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:13:07.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:06 smithi090 ceph-mon[34497]: mds.? [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] up:active 2024-09-19T06:13:07.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:06 smithi090 ceph-mon[34497]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:13:07.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:06 smithi090 ceph-mon[34497]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:13:07.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:06 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/454567197' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:13:07.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:06 smithi089 ceph-mon[34160]: mds.? [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] up:active 2024-09-19T06:13:07.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:06 smithi089 ceph-mon[34160]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:13:07.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:06 smithi089 ceph-mon[34160]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:13:07.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:06 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/454567197' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:13:07.380 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:07.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:07.845+0000 7fb94877b640 1 -- 172.21.15.2:0/84935154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb940101420 msgr2=0x7fb94010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:07.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:07.845+0000 7fb94877b640 1 --2- 172.21.15.2:0/84935154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb940101420 0x7fb94010d950 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb938009cd0 tx=0x7fb93802a8e0 comp rx=0 tx=0).stop 2024-09-19T06:13:07.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:07.845+0000 7fb94877b640 1 -- 172.21.15.2:0/84935154 shutdown_connections 2024-09-19T06:13:07.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:07.845+0000 7fb94877b640 1 --2- 172.21.15.2:0/84935154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb940101420 0x7fb94010d950 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:07.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:07.845+0000 7fb94877b640 1 --2- 172.21.15.2:0/84935154 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb940100a80 0x7fb940100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:07.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:07.845+0000 7fb94877b640 1 --2- 172.21.15.2:0/84935154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb940106a80 0x7fb940106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:07.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:07.845+0000 7fb94877b640 1 -- 172.21.15.2:0/84935154 >> 172.21.15.2:0/84935154 conn(0x7fb9400fc7a0 msgr2=0x7fb9400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:07.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:07.845+0000 7fb94877b640 1 -- 172.21.15.2:0/84935154 shutdown_connections 2024-09-19T06:13:07.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:07.845+0000 7fb94877b640 1 -- 172.21.15.2:0/84935154 wait complete. 2024-09-19T06:13:07.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:07.845+0000 7fb94877b640 1 Processor -- start 2024-09-19T06:13:07.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:07.846+0000 7fb94877b640 1 -- start start 2024-09-19T06:13:07.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:07.846+0000 7fb94877b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb940100a80 0x7fb94019a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:07.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:07.846+0000 7fb94877b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb940101420 0x7fb94019ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:07.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:07.846+0000 7fb94877b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb940106a80 0x7fb94019eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:07.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:07.846+0000 7fb94877b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb940110d30 con 0x7fb940100a80 2024-09-19T06:13:07.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:07.846+0000 7fb94877b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb940110bb0 con 0x7fb940106a80 2024-09-19T06:13:07.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:07.846+0000 7fb94877b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb940110eb0 con 0x7fb940101420 2024-09-19T06:13:07.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:07.846+0000 7fb946517640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb940100a80 0x7fb94019a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:07.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:07.846+0000 7fb946517640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb940100a80 0x7fb94019a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55244/0 (socket says 172.21.15.2:55244) 2024-09-19T06:13:07.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:07.846+0000 7fb946517640 1 -- 172.21.15.2:0/623248463 learned_addr learned my addr 172.21.15.2:0/623248463 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:13:07.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:07.846+0000 7fb945d16640 1 --2- 172.21.15.2:0/623248463 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb940101420 0x7fb94019ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:07.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:07.846+0000 7fb946d18640 1 --2- 172.21.15.2:0/623248463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb940106a80 0x7fb94019eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:07.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:07.846+0000 7fb946517640 1 -- 172.21.15.2:0/623248463 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb940101420 msgr2=0x7fb94019ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:07.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:07.846+0000 7fb946517640 1 --2- 172.21.15.2:0/623248463 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb940101420 0x7fb94019ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:07.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:07.846+0000 7fb946517640 1 -- 172.21.15.2:0/623248463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb940106a80 msgr2=0x7fb94019eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:07.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:07.846+0000 7fb946517640 1 --2- 172.21.15.2:0/623248463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb940106a80 0x7fb94019eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:07.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:07.846+0000 7fb946517640 1 -- 172.21.15.2:0/623248463 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb94019f580 con 0x7fb940100a80 2024-09-19T06:13:07.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:07.846+0000 7fb946d18640 1 --2- 172.21.15.2:0/623248463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb940106a80 0x7fb94019eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:13:07.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:07.846+0000 7fb946517640 1 --2- 172.21.15.2:0/623248463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb940100a80 0x7fb94019a5d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb93c00d950 tx=0x7fb93c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:07.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:07.846+0000 7fb9377fe640 1 -- 172.21.15.2:0/623248463 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93c017070 con 0x7fb940100a80 2024-09-19T06:13:07.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:07.847+0000 7fb94877b640 1 -- 172.21.15.2:0/623248463 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb94019f870 con 0x7fb940100a80 2024-09-19T06:13:07.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:07.847+0000 7fb9377fe640 1 -- 172.21.15.2:0/623248463 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb93c009c30 con 0x7fb940100a80 2024-09-19T06:13:07.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:07.847+0000 7fb9377fe640 1 -- 172.21.15.2:0/623248463 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93c00f620 con 0x7fb940100a80 2024-09-19T06:13:07.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:07.847+0000 7fb94877b640 1 -- 172.21.15.2:0/623248463 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9401a7150 con 0x7fb940100a80 2024-09-19T06:13:07.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:07.848+0000 7fb94877b640 1 -- 172.21.15.2:0/623248463 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb940100ee0 con 0x7fb940100a80 2024-09-19T06:13:07.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:07.849+0000 7fb9377fe640 1 -- 172.21.15.2:0/623248463 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fb93c0109a0 con 0x7fb940100a80 2024-09-19T06:13:07.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:07.850+0000 7fb9377fe640 1 --2- 172.21.15.2:0/623248463 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fb92c0a3240 0x7fb92c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:07.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:07.850+0000 7fb945d16640 1 --2- 172.21.15.2:0/623248463 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fb92c0a3240 0x7fb92c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:07.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:07.850+0000 7fb9377fe640 1 -- 172.21.15.2:0/623248463 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7fb93c0cf400 con 0x7fb940100a80 2024-09-19T06:13:07.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:07.850+0000 7fb945d16640 1 --2- 172.21.15.2:0/623248463 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fb92c0a3240 0x7fb92c0a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb94006b870 tx=0x7fb93000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:07.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:07.853+0000 7fb9377fe640 1 -- 172.21.15.2:0/623248463 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb93c009de0 con 0x7fb940100a80 2024-09-19T06:13:08.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:08.031+0000 7fb94877b640 1 -- 172.21.15.2:0/623248463 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb9401a7320 con 0x7fb940100a80 2024-09-19T06:13:08.033 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:07 smithi002 ceph-mon[30982]: pgmap v276: 97 pgs: 30 creating+peering, 67 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 234 B/s wr, 0 op/s 2024-09-19T06:13:08.033 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:07 smithi002 ceph-mon[30982]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T06:13:08.034 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:07 smithi002 ceph-mon[30982]: Cluster is now healthy 2024-09-19T06:13:08.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:08.034+0000 7fb9377fe640 1 -- 172.21.15.2:0/623248463 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+22126 (secure 0 0 0) 0x7fb93c09c1d0 con 0x7fb940100a80 2024-09-19T06:13:08.035 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:13:08.036 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":79,"fsid":"078f6612-764d-11ef-bceb-c7b262605968","created":"2024-09-19T06:05:17.607927+0000","modified":"2024-09-19T06:13:04.348374+0000","last_up_change":"2024-09-19T06:12:13.856684+0000","last_in_change":"2024-09-19T06:11:49.745266+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:08:28.425566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:13:00.482789+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:13:02.768221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0de97a3d-2d27-455b-9998-ddd2319c148d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6803","nonce":915165910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6805","nonce":915165910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6809","nonce":915165910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6807","nonce":915165910}]},"public_addr":"172.21.15.2:6803/915165910","cluster_addr":"172.21.15.2:6805/915165910","heartbeat_back_addr":"172.21.15.2:6809/915165910","heartbeat_front_addr":"172.21.15.2:6807/915165910","state":["exists","up"]},{"osd":1,"uuid":"056d229e-2de4-4902-922e-21e1a5d3f061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6801","nonce":4097264171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6803","nonce":4097264171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6807","nonce":4097264171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6805","nonce":4097264171}]},"public_addr":"172.21.15.89:6801/4097264171","cluster_addr":"172.21.15.89:6803/4097264171","heartbeat_back_addr":"172.21.15.89:6807/4097264171","heartbeat_front_addr":"172.21.15.89:6805/4097264171","state":["exists","up"]},{"osd":2,"uuid":"2a4e7147-4125-4ee6-b5ad-85518d7066d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6801","nonce":1479908200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6803","nonce":1479908200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6807","nonce":1479908200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6805","nonce":1479908200}]},"public_addr":"172.21.15.90:6801/1479908200","cluster_addr":"172.21.15.90:6803/1479908200","heartbeat_back_addr":"172.21.15.90:6807/1479908200","heartbeat_front_addr":"172.21.15.90:6805/1479908200","state":["exists","up"]},{"osd":3,"uuid":"7b3da775-0f0a-4b46-a8dc-9ec822a54301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6811","nonce":1796948193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6813","nonce":1796948193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6817","nonce":1796948193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6815","nonce":1796948193}]},"public_addr":"172.21.15.2:6811/1796948193","cluster_addr":"172.21.15.2:6813/1796948193","heartbeat_back_addr":"172.21.15.2:6817/1796948193","heartbeat_front_addr":"172.21.15.2:6815/1796948193","state":["exists","up"]},{"osd":4,"uuid":"d4c8bafc-c844-4ff1-a3d8-7a53576e6b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6809","nonce":4256848315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6811","nonce":4256848315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6815","nonce":4256848315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6813","nonce":4256848315}]},"public_addr":"172.21.15.89:6809/4256848315","cluster_addr":"172.21.15.89:6811/4256848315","heartbeat_back_addr":"172.21.15.89:6815/4256848315","heartbeat_front_addr":"172.21.15.89:6813/4256848315","state":["exists","up"]},{"osd":5,"uuid":"8dc9bb55-29e0-4b04-9415-3b9bb5ed05cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6809","nonce":189855967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6811","nonce":189855967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6815","nonce":189855967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6813","nonce":189855967}]},"public_addr":"172.21.15.90:6809/189855967","cluster_addr":"172.21.15.90:6811/189855967","heartbeat_back_addr":"172.21.15.90:6815/189855967","heartbeat_front_addr":"172.21.15.90:6813/189855967","state":["exists","up"]},{"osd":6,"uuid":"86d1443a-9b43-46de-abd7-4c95b43207f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6819","nonce":3886336279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6821","nonce":3886336279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6825","nonce":3886336279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6823","nonce":3886336279}]},"public_addr":"172.21.15.2:6819/3886336279","cluster_addr":"172.21.15.2:6821/3886336279","heartbeat_back_addr":"172.21.15.2:6825/3886336279","heartbeat_front_addr":"172.21.15.2:6823/3886336279","state":["exists","up"]},{"osd":7,"uuid":"1cc5554c-80d2-4e77-b29a-fd2ada68d82d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6817","nonce":508513510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6819","nonce":508513510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6823","nonce":508513510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6821","nonce":508513510}]},"public_addr":"172.21.15.89:6817/508513510","cluster_addr":"172.21.15.89:6819/508513510","heartbeat_back_addr":"172.21.15.89:6823/508513510","heartbeat_front_addr":"172.21.15.89:6821/508513510","state":["exists","up"]},{"osd":8,"uuid":"e9b2eb92-9af2-4f26-a259-fcaf972e4fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6817","nonce":3558544480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6819","nonce":3558544480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6823","nonce":3558544480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6821","nonce":3558544480}]},"public_addr":"172.21.15.90:6817/3558544480","cluster_addr":"172.21.15.90:6819/3558544480","heartbeat_back_addr":"172.21.15.90:6823/3558544480","heartbeat_front_addr":"172.21.15.90:6821/3558544480","state":["exists","up"]},{"osd":9,"uuid":"194d4c64-dd29-4d35-bc54-0858c44815cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6827","nonce":2690758100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6829","nonce":2690758100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6833","nonce":2690758100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6831","nonce":2690758100}]},"public_addr":"172.21.15.2:6827/2690758100","cluster_addr":"172.21.15.2:6829/2690758100","heartbeat_back_addr":"172.21.15.2:6833/2690758100","heartbeat_front_addr":"172.21.15.2:6831/2690758100","state":["exists","up"]},{"osd":10,"uuid":"7695fa4a-b94e-4afc-b166-690a197ad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6825","nonce":1141925395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6827","nonce":1141925395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6831","nonce":1141925395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6829","nonce":1141925395}]},"public_addr":"172.21.15.89:6825/1141925395","cluster_addr":"172.21.15.89:6827/1141925395","heartbeat_back_addr":"172.21.15.89:6831/1141925395","heartbeat_front_addr":"172.21.15.89:6829/1141925395","state":["exists","up"]},{"osd":11,"uuid":"1815a999-bfdb-46b9-afcd-632ee8ba56d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6825","nonce":468380924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6827","nonce":468380924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6831","nonce":468380924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6829","nonce":468380924}]},"public_addr":"172.21.15.90:6825/468380924","cluster_addr":"172.21.15.90:6827/468380924","heartbeat_back_addr":"172.21.15.90:6831/468380924","heartbeat_front_addr":"172.21.15.90:6829/468380924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:07:36.125754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:01.415356+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:26.420808+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:51.722673+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:09:16.562300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:09:41.958465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:10:07.056167+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:10:32.066195+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:10:56.497875+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:11:21.973083+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:11:46.891515+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:12:11.910012+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/874985787":"2024-09-20T06:06:11.912585+0000","172.21.15.2:0/1280963020":"2024-09-20T06:06:11.912585+0000","172.21.15.2:0/2976372536":"2024-09-20T06:06:11.912585+0000","172.21.15.2:6801/1602650352":"2024-09-20T06:05:47.538477+0000","172.21.15.2:6800/1602650352":"2024-09-20T06:05:47.538477+0000","172.21.15.2:6800/1200011821":"2024-09-20T06:06:11.912585+0000","172.21.15.2:0/3899165140":"2024-09-20T06:05:47.538477+0000","172.21.15.2:6801/1200011821":"2024-09-20T06:06:11.912585+0000","172.21.15.2:0/1361067708":"2024-09-20T06:05:47.538477+0000","172.21.15.2:0/3763089457":"2024-09-20T06:05:47.538477+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:13:08.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:08.036+0000 7fb94877b640 1 -- 172.21.15.2:0/623248463 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fb92c0a3240 msgr2=0x7fb92c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:08.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:08.036+0000 7fb94877b640 1 --2- 172.21.15.2:0/623248463 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fb92c0a3240 0x7fb92c0a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb94006b870 tx=0x7fb93000b390 comp rx=0 tx=0).stop 2024-09-19T06:13:08.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:08.036+0000 7fb94877b640 1 -- 172.21.15.2:0/623248463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb940100a80 msgr2=0x7fb94019a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:08.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:08.036+0000 7fb94877b640 1 --2- 172.21.15.2:0/623248463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb940100a80 0x7fb94019a5d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb93c00d950 tx=0x7fb93c00de10 comp rx=0 tx=0).stop 2024-09-19T06:13:08.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:08.036+0000 7fb94877b640 1 -- 172.21.15.2:0/623248463 shutdown_connections 2024-09-19T06:13:08.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:08.036+0000 7fb94877b640 1 --2- 172.21.15.2:0/623248463 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fb92c0a3240 0x7fb92c0a5700 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:08.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:08.036+0000 7fb94877b640 1 --2- 172.21.15.2:0/623248463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb940106a80 0x7fb94019eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:08.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:08.036+0000 7fb94877b640 1 --2- 172.21.15.2:0/623248463 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb940101420 0x7fb94019ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:08.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:08.036+0000 7fb94877b640 1 --2- 172.21.15.2:0/623248463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb940100a80 0x7fb94019a5d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:08.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:08.036+0000 7fb94877b640 1 -- 172.21.15.2:0/623248463 >> 172.21.15.2:0/623248463 conn(0x7fb9400fc7a0 msgr2=0x7fb94006a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:08.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:08.036+0000 7fb94877b640 1 -- 172.21.15.2:0/623248463 shutdown_connections 2024-09-19T06:13:08.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:08.036+0000 7fb94877b640 1 -- 172.21.15.2:0/623248463 wait complete. 2024-09-19T06:13:08.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:07 smithi090 ceph-mon[34497]: pgmap v276: 97 pgs: 30 creating+peering, 67 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 234 B/s wr, 0 op/s 2024-09-19T06:13:08.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:07 smithi090 ceph-mon[34497]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T06:13:08.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:07 smithi090 ceph-mon[34497]: Cluster is now healthy 2024-09-19T06:13:08.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:07 smithi089 ceph-mon[34160]: pgmap v276: 97 pgs: 30 creating+peering, 67 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 234 B/s wr, 0 op/s 2024-09-19T06:13:08.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:07 smithi089 ceph-mon[34160]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T06:13:08.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:07 smithi089 ceph-mon[34160]: Cluster is now healthy 2024-09-19T06:13:08.641 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-19T06:13:08.792 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 19 06:13:08 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-b[63859]: 2024-09-19T06:13:08.461+0000 7f61b9ecd640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T06:13:08.901 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:09.157 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:08 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/623248463' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:13:09.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:08 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/623248463' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:13:09.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:08 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/623248463' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:13:09.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.380+0000 7f7b034c1640 1 -- 172.21.15.2:0/1365987894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7afc100ce0 msgr2=0x7f7afc106820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:09.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.380+0000 7f7b034c1640 1 --2- 172.21.15.2:0/1365987894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7afc100ce0 0x7f7afc106820 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7aec009930 tx=0x7f7aec02a420 comp rx=0 tx=0).stop 2024-09-19T06:13:09.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.380+0000 7f7b034c1640 1 -- 172.21.15.2:0/1365987894 shutdown_connections 2024-09-19T06:13:09.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.380+0000 7f7b034c1640 1 --2- 172.21.15.2:0/1365987894 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7afc106f30 0x7f7afc10ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:09.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.380+0000 7f7b034c1640 1 --2- 172.21.15.2:0/1365987894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7afc100ce0 0x7f7afc106820 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:09.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.380+0000 7f7b034c1640 1 --2- 172.21.15.2:0/1365987894 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7afc100330 0x7f7afc100710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:09.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.380+0000 7f7b034c1640 1 -- 172.21.15.2:0/1365987894 >> 172.21.15.2:0/1365987894 conn(0x7f7afc0fbee0 msgr2=0x7f7afc0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:09.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.380+0000 7f7b034c1640 1 -- 172.21.15.2:0/1365987894 shutdown_connections 2024-09-19T06:13:09.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.380+0000 7f7b034c1640 1 -- 172.21.15.2:0/1365987894 wait complete. 2024-09-19T06:13:09.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.381+0000 7f7b034c1640 1 Processor -- start 2024-09-19T06:13:09.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.381+0000 7f7b034c1640 1 -- start start 2024-09-19T06:13:09.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.381+0000 7f7b034c1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7afc100330 0x7f7afc1012b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:09.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.381+0000 7f7b034c1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7afc100ce0 0x7f7afc1017f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:09.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.381+0000 7f7b034c1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7afc106f30 0x7f7afc101d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:09.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.381+0000 7f7b034c1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7afc111e30 con 0x7f7afc106f30 2024-09-19T06:13:09.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.381+0000 7f7b034c1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7afc111cb0 con 0x7f7afc100ce0 2024-09-19T06:13:09.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.381+0000 7f7b034c1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7afc111fb0 con 0x7f7afc100330 2024-09-19T06:13:09.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.381+0000 7f7b01a5e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7afc106f30 0x7f7afc101d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:09.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.381+0000 7f7b01a5e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7afc106f30 0x7f7afc101d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55270/0 (socket says 172.21.15.2:55270) 2024-09-19T06:13:09.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.381+0000 7f7b01a5e640 1 -- 172.21.15.2:0/1201114609 learned_addr learned my addr 172.21.15.2:0/1201114609 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:13:09.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.382+0000 7f7b00a5c640 1 --2- 172.21.15.2:0/1201114609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7afc100ce0 0x7f7afc1017f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:09.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.382+0000 7f7b0125d640 1 --2- 172.21.15.2:0/1201114609 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7afc100330 0x7f7afc1012b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:09.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.382+0000 7f7b01a5e640 1 -- 172.21.15.2:0/1201114609 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7afc100330 msgr2=0x7f7afc1012b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:09.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.382+0000 7f7b01a5e640 1 --2- 172.21.15.2:0/1201114609 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7afc100330 0x7f7afc1012b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:09.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.382+0000 7f7b01a5e640 1 -- 172.21.15.2:0/1201114609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7afc100ce0 msgr2=0x7f7afc1017f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:09.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.382+0000 7f7b01a5e640 1 --2- 172.21.15.2:0/1201114609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7afc100ce0 0x7f7afc1017f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:09.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.382+0000 7f7b01a5e640 1 -- 172.21.15.2:0/1201114609 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7afc1a68f0 con 0x7f7afc106f30 2024-09-19T06:13:09.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.382+0000 7f7b01a5e640 1 --2- 172.21.15.2:0/1201114609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7afc106f30 0x7f7afc101d30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7af4009fd0 tx=0x7f7af400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:09.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.382+0000 7f7af27fc640 1 -- 172.21.15.2:0/1201114609 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af4017070 con 0x7f7afc106f30 2024-09-19T06:13:09.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.382+0000 7f7af27fc640 1 -- 172.21.15.2:0/1201114609 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7af4003e20 con 0x7f7afc106f30 2024-09-19T06:13:09.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.382+0000 7f7b034c1640 1 -- 172.21.15.2:0/1201114609 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7afc1a6be0 con 0x7f7afc106f30 2024-09-19T06:13:09.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.382+0000 7f7b034c1640 1 -- 172.21.15.2:0/1201114609 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7afc1a70f0 con 0x7f7afc106f30 2024-09-19T06:13:09.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.382+0000 7f7af27fc640 1 -- 172.21.15.2:0/1201114609 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af4010460 con 0x7f7afc106f30 2024-09-19T06:13:09.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.383+0000 7f7b034c1640 1 -- 172.21.15.2:0/1201114609 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7afc100710 con 0x7f7afc106f30 2024-09-19T06:13:09.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.385+0000 7f7af27fc640 1 -- 172.21.15.2:0/1201114609 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f7af4003970 con 0x7f7afc106f30 2024-09-19T06:13:09.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.385+0000 7f7af27fc640 1 --2- 172.21.15.2:0/1201114609 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f7ae80a32c0 0x7f7ae80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:09.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.385+0000 7f7af27fc640 1 -- 172.21.15.2:0/1201114609 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7f7af40cf400 con 0x7f7afc106f30 2024-09-19T06:13:09.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.385+0000 7f7b0125d640 1 --2- 172.21.15.2:0/1201114609 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f7ae80a32c0 0x7f7ae80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:09.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.386+0000 7f7b0125d640 1 --2- 172.21.15.2:0/1201114609 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f7ae80a32c0 0x7f7ae80a5780 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7af800bbe0 tx=0x7f7af800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:09.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.389+0000 7f7af27fc640 1 -- 172.21.15.2:0/1201114609 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7af409bca0 con 0x7f7afc106f30 2024-09-19T06:13:09.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.605+0000 7f7b034c1640 1 -- 172.21.15.2:0/1201114609 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f7afc10a100 con 0x7f7afc106f30 2024-09-19T06:13:09.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.809+0000 7f7af27fc640 1 -- 172.21.15.2:0/1201114609 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f7af409ffa0 con 0x7f7afc106f30 2024-09-19T06:13:09.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.812+0000 7f7b034c1640 1 -- 172.21.15.2:0/1201114609 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f7ae80a32c0 msgr2=0x7f7ae80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:09.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.812+0000 7f7b034c1640 1 --2- 172.21.15.2:0/1201114609 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f7ae80a32c0 0x7f7ae80a5780 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7af800bbe0 tx=0x7f7af800b390 comp rx=0 tx=0).stop 2024-09-19T06:13:09.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.812+0000 7f7b034c1640 1 -- 172.21.15.2:0/1201114609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7afc106f30 msgr2=0x7f7afc101d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:09.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.812+0000 7f7b034c1640 1 --2- 172.21.15.2:0/1201114609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7afc106f30 0x7f7afc101d30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7af4009fd0 tx=0x7f7af400b260 comp rx=0 tx=0).stop 2024-09-19T06:13:09.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.812+0000 7f7b034c1640 1 -- 172.21.15.2:0/1201114609 shutdown_connections 2024-09-19T06:13:09.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.812+0000 7f7b034c1640 1 --2- 172.21.15.2:0/1201114609 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f7ae80a32c0 0x7f7ae80a5780 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:09.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.812+0000 7f7b034c1640 1 --2- 172.21.15.2:0/1201114609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7afc106f30 0x7f7afc101d30 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:09.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.812+0000 7f7b034c1640 1 --2- 172.21.15.2:0/1201114609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7afc100ce0 0x7f7afc1017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:09.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.812+0000 7f7b034c1640 1 --2- 172.21.15.2:0/1201114609 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7afc100330 0x7f7afc1012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:09.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.812+0000 7f7b034c1640 1 -- 172.21.15.2:0/1201114609 >> 172.21.15.2:0/1201114609 conn(0x7f7afc0fbee0 msgr2=0x7f7afc0fd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:09.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.812+0000 7f7b034c1640 1 -- 172.21.15.2:0/1201114609 shutdown_connections 2024-09-19T06:13:09.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:09.812+0000 7f7b034c1640 1 -- 172.21.15.2:0/1201114609 wait complete. 2024-09-19T06:13:09.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:09 smithi002 ceph-mon[30982]: pgmap v277: 97 pgs: 30 creating+peering, 67 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-19T06:13:09.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:09 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1201114609' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T06:13:10.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:09 smithi090 ceph-mon[34497]: pgmap v277: 97 pgs: 30 creating+peering, 67 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-19T06:13:10.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:09 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1201114609' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T06:13:10.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:09 smithi089 ceph-mon[34160]: pgmap v277: 97 pgs: 30 creating+peering, 67 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-19T06:13:10.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:09 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1201114609' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T06:13:10.566 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-19T06:13:10.566 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-09-19T06:13:10.831 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:11.071 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:10 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1201114609' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T06:13:11.071 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:10 smithi002 ceph-mon[30982]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:13:11.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:10 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1201114609' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T06:13:11.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:10 smithi090 ceph-mon[34497]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:13:11.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.281+0000 7faa89f13640 1 -- 172.21.15.2:0/3137515736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa84102570 msgr2=0x7faa841029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:11.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.281+0000 7faa89f13640 1 --2- 172.21.15.2:0/3137515736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa84102570 0x7faa841029b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7faa6c009900 tx=0x7faa6c02a480 comp rx=0 tx=0).stop 2024-09-19T06:13:11.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.281+0000 7faa89f13640 1 -- 172.21.15.2:0/3137515736 shutdown_connections 2024-09-19T06:13:11.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.281+0000 7faa89f13640 1 --2- 172.21.15.2:0/3137515736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa84102ef0 0x7faa8410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:11.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.281+0000 7faa89f13640 1 --2- 172.21.15.2:0/3137515736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa84102570 0x7faa841029b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:11.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.281+0000 7faa89f13640 1 --2- 172.21.15.2:0/3137515736 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa84100e20 0x7faa84101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:11.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.281+0000 7faa89f13640 1 -- 172.21.15.2:0/3137515736 >> 172.21.15.2:0/3137515736 conn(0x7faa840fc7d0 msgr2=0x7faa840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:11.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.281+0000 7faa89f13640 1 -- 172.21.15.2:0/3137515736 shutdown_connections 2024-09-19T06:13:11.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.281+0000 7faa89f13640 1 -- 172.21.15.2:0/3137515736 wait complete. 2024-09-19T06:13:11.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.282+0000 7faa89f13640 1 Processor -- start 2024-09-19T06:13:11.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.282+0000 7faa89f13640 1 -- start start 2024-09-19T06:13:11.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.282+0000 7faa89f13640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa84100e20 0x7faa84196ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:11.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.282+0000 7faa89f13640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa84102570 0x7faa84197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:11.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.282+0000 7faa89f13640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa84102ef0 0x7faa84197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:11.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.282+0000 7faa89f13640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faa84110e30 con 0x7faa84102570 2024-09-19T06:13:11.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.282+0000 7faa89f13640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7faa84110cb0 con 0x7faa84100e20 2024-09-19T06:13:11.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.282+0000 7faa89f13640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7faa84110fb0 con 0x7faa84102ef0 2024-09-19T06:13:11.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.282+0000 7faa7bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa84102570 0x7faa84197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:11.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.282+0000 7faa7bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa84102570 0x7faa84197530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55288/0 (socket says 172.21.15.2:55288) 2024-09-19T06:13:11.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.282+0000 7faa7bfff640 1 -- 172.21.15.2:0/312435769 learned_addr learned my addr 172.21.15.2:0/312435769 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:13:11.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.283+0000 7faa837fe640 1 --2- 172.21.15.2:0/312435769 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa84100e20 0x7faa84196ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:11.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.283+0000 7faa83fff640 1 --2- 172.21.15.2:0/312435769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa84102ef0 0x7faa84197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:11.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.283+0000 7faa7bfff640 1 -- 172.21.15.2:0/312435769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa84102ef0 msgr2=0x7faa84197a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:11.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.283+0000 7faa7bfff640 1 --2- 172.21.15.2:0/312435769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa84102ef0 0x7faa84197a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:11.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.283+0000 7faa7bfff640 1 -- 172.21.15.2:0/312435769 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa84100e20 msgr2=0x7faa84196ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:11.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.283+0000 7faa7bfff640 1 --2- 172.21.15.2:0/312435769 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa84100e20 0x7faa84196ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:11.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.283+0000 7faa7bfff640 1 -- 172.21.15.2:0/312435769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa841a6860 con 0x7faa84102570 2024-09-19T06:13:11.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.283+0000 7faa7bfff640 1 --2- 172.21.15.2:0/312435769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa84102570 0x7faa84197530 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7faa6c006010 tx=0x7faa6c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:11.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.283+0000 7faa817fa640 1 -- 172.21.15.2:0/312435769 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6c03f070 con 0x7faa84102570 2024-09-19T06:13:11.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.283+0000 7faa817fa640 1 -- 172.21.15.2:0/312435769 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7faa6c003aa0 con 0x7faa84102570 2024-09-19T06:13:11.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.283+0000 7faa89f13640 1 -- 172.21.15.2:0/312435769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa841a6af0 con 0x7faa84102570 2024-09-19T06:13:11.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.283+0000 7faa817fa640 1 -- 172.21.15.2:0/312435769 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6c035030 con 0x7faa84102570 2024-09-19T06:13:11.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.283+0000 7faa89f13640 1 -- 172.21.15.2:0/312435769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa841a7020 con 0x7faa84102570 2024-09-19T06:13:11.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.284+0000 7faa89f13640 1 -- 172.21.15.2:0/312435769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa84101200 con 0x7faa84102570 2024-09-19T06:13:11.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.286+0000 7faa817fa640 1 -- 172.21.15.2:0/312435769 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7faa6c042070 con 0x7faa84102570 2024-09-19T06:13:11.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.286+0000 7faa817fa640 1 --2- 172.21.15.2:0/312435769 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7faa700a32c0 0x7faa700a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:11.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.286+0000 7faa837fe640 1 --2- 172.21.15.2:0/312435769 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7faa700a32c0 0x7faa700a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:11.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.286+0000 7faa817fa640 1 -- 172.21.15.2:0/312435769 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7faa6c0f02e0 con 0x7faa84102570 2024-09-19T06:13:11.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.287+0000 7faa837fe640 1 --2- 172.21.15.2:0/312435769 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7faa700a32c0 0x7faa700a5780 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7faa740058c0 tx=0x7faa7400a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:11.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.289+0000 7faa817fa640 1 -- 172.21.15.2:0/312435769 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faa6c0bd150 con 0x7faa84102570 2024-09-19T06:13:11.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:10 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1201114609' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T06:13:11.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:10 smithi089 ceph-mon[34160]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:13:11.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.503+0000 7faa89f13640 1 -- 172.21.15.2:0/312435769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7faa84109090 con 0x7faa84102570 2024-09-19T06:13:11.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.815+0000 7faa817fa640 1 -- 172.21.15.2:0/312435769 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7faa6c0bca50 con 0x7faa84102570 2024-09-19T06:13:11.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.818+0000 7faa89f13640 1 -- 172.21.15.2:0/312435769 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7faa700a32c0 msgr2=0x7faa700a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:11.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.818+0000 7faa89f13640 1 --2- 172.21.15.2:0/312435769 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7faa700a32c0 0x7faa700a5780 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7faa740058c0 tx=0x7faa7400a250 comp rx=0 tx=0).stop 2024-09-19T06:13:11.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.818+0000 7faa89f13640 1 -- 172.21.15.2:0/312435769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa84102570 msgr2=0x7faa84197530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:11.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.818+0000 7faa89f13640 1 --2- 172.21.15.2:0/312435769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa84102570 0x7faa84197530 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7faa6c006010 tx=0x7faa6c0042f0 comp rx=0 tx=0).stop 2024-09-19T06:13:11.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.819+0000 7faa89f13640 1 -- 172.21.15.2:0/312435769 shutdown_connections 2024-09-19T06:13:11.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.819+0000 7faa89f13640 1 --2- 172.21.15.2:0/312435769 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7faa700a32c0 0x7faa700a5780 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:11.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.819+0000 7faa89f13640 1 --2- 172.21.15.2:0/312435769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa84102ef0 0x7faa84197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:11.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.819+0000 7faa89f13640 1 --2- 172.21.15.2:0/312435769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa84102570 0x7faa84197530 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:11.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.819+0000 7faa89f13640 1 --2- 172.21.15.2:0/312435769 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa84100e20 0x7faa84196ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:11.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.819+0000 7faa89f13640 1 -- 172.21.15.2:0/312435769 >> 172.21.15.2:0/312435769 conn(0x7faa840fc7d0 msgr2=0x7faa840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:11.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.819+0000 7faa89f13640 1 -- 172.21.15.2:0/312435769 shutdown_connections 2024-09-19T06:13:11.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:11.819+0000 7faa89f13640 1 -- 172.21.15.2:0/312435769 wait complete. 2024-09-19T06:13:12.175 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:11 smithi002 ceph-mon[30982]: pgmap v278: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-19T06:13:12.175 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:11 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/312435769' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-19T06:13:12.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:11 smithi090 ceph-mon[34497]: pgmap v278: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-19T06:13:12.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:11 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/312435769' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-19T06:13:12.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:11 smithi089 ceph-mon[34160]: pgmap v278: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-19T06:13:12.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:11 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/312435769' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-19T06:13:12.445 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-19T06:13:12.703 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:13.078 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:12 smithi002 ceph-mon[30982]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T06:13:13.079 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:12 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/312435769' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-19T06:13:13.079 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:12 smithi002 ceph-mon[30982]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T06:13:13.079 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:12 smithi002 ceph-mon[30982]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:13:13.079 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:12 smithi002 ceph-mon[30982]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-19T06:13:13.079 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:12 smithi002 ceph-mon[30982]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-19T06:13:13.079 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:12 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]: dispatch 2024-09-19T06:13:13.080 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:12 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-09-19T06:13:13.080 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:12 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-09-19T06:13:13.080 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:12 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-09-19T06:13:13.080 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:12 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-09-19T06:13:13.080 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:12 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9, 4, 8]}]: dispatch 2024-09-19T06:13:13.080 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:12 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-09-19T06:13:13.081 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:12 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2024-09-19T06:13:13.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.163+0000 7f04b6914640 1 -- 172.21.15.2:0/1778798073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04b0109b10 msgr2=0x7f04b0114570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:13.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.163+0000 7f04b6914640 1 --2- 172.21.15.2:0/1778798073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04b0109b10 0x7f04b0114570 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f04a4009900 tx=0x7f04a402a480 comp rx=0 tx=0).stop 2024-09-19T06:13:13.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.163+0000 7f04b6914640 1 -- 172.21.15.2:0/1778798073 shutdown_connections 2024-09-19T06:13:13.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.163+0000 7f04b6914640 1 --2- 172.21.15.2:0/1778798073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04b0114ab0 0x7f04b0116ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:13.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.163+0000 7f04b6914640 1 --2- 172.21.15.2:0/1778798073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04b0109b10 0x7f04b0114570 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:13.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.163+0000 7f04b6914640 1 --2- 172.21.15.2:0/1778798073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04b01091f0 0x7f04b01095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:13.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.163+0000 7f04b6914640 1 -- 172.21.15.2:0/1778798073 >> 172.21.15.2:0/1778798073 conn(0x7f04b006e140 msgr2=0x7f04b006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:13.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.163+0000 7f04b6914640 1 -- 172.21.15.2:0/1778798073 shutdown_connections 2024-09-19T06:13:13.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.163+0000 7f04b6914640 1 -- 172.21.15.2:0/1778798073 wait complete. 2024-09-19T06:13:13.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.163+0000 7f04b6914640 1 Processor -- start 2024-09-19T06:13:13.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.163+0000 7f04b6914640 1 -- start start 2024-09-19T06:13:13.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.164+0000 7f04b6914640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04b01091f0 0x7f04b01a68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:13.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.164+0000 7f04b6914640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04b0109b10 0x7f04b01a6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:13.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.164+0000 7f04b6914640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04b0114ab0 0x7f04b01a0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:13.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.164+0000 7f04b6914640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f04b011a6e0 con 0x7f04b0114ab0 2024-09-19T06:13:13.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.164+0000 7f04b6914640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f04b011a560 con 0x7f04b01091f0 2024-09-19T06:13:13.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.164+0000 7f04b6914640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f04b011a860 con 0x7f04b0109b10 2024-09-19T06:13:13.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.164+0000 7f04b4eb1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04b0114ab0 0x7f04b01a0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:13.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.164+0000 7f04b4eb1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04b0114ab0 0x7f04b01a0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55302/0 (socket says 172.21.15.2:55302) 2024-09-19T06:13:13.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.164+0000 7f04b4eb1640 1 -- 172.21.15.2:0/871578810 learned_addr learned my addr 172.21.15.2:0/871578810 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:13:13.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.164+0000 7f04af7fe640 1 --2- 172.21.15.2:0/871578810 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04b0109b10 0x7f04b01a6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:13.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.164+0000 7f04affff640 1 --2- 172.21.15.2:0/871578810 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04b01091f0 0x7f04b01a68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:13.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.164+0000 7f04b4eb1640 1 -- 172.21.15.2:0/871578810 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04b0109b10 msgr2=0x7f04b01a6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:13.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.164+0000 7f04b4eb1640 1 --2- 172.21.15.2:0/871578810 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04b0109b10 0x7f04b01a6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:13.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.164+0000 7f04b4eb1640 1 -- 172.21.15.2:0/871578810 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04b01091f0 msgr2=0x7f04b01a68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:13.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.164+0000 7f04b4eb1640 1 --2- 172.21.15.2:0/871578810 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04b01091f0 0x7f04b01a68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:13.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.164+0000 7f04b4eb1640 1 -- 172.21.15.2:0/871578810 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04b01a11b0 con 0x7f04b0114ab0 2024-09-19T06:13:13.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.164+0000 7f04af7fe640 1 --2- 172.21.15.2:0/871578810 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04b0109b10 0x7f04b01a6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:13:13.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.164+0000 7f04affff640 1 --2- 172.21.15.2:0/871578810 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04b01091f0 0x7f04b01a68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:13:13.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.165+0000 7f04b4eb1640 1 --2- 172.21.15.2:0/871578810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04b0114ab0 0x7f04b01a0a80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f04a8009fd0 tx=0x7f04a800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:13.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.165+0000 7f04ad7fa640 1 -- 172.21.15.2:0/871578810 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a8004d20 con 0x7f04b0114ab0 2024-09-19T06:13:13.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.165+0000 7f04ad7fa640 1 -- 172.21.15.2:0/871578810 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f04a8005020 con 0x7f04b0114ab0 2024-09-19T06:13:13.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.165+0000 7f04b6914640 1 -- 172.21.15.2:0/871578810 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04b01a14a0 con 0x7f04b0114ab0 2024-09-19T06:13:13.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.165+0000 7f04ad7fa640 1 -- 172.21.15.2:0/871578810 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a80116b0 con 0x7f04b0114ab0 2024-09-19T06:13:13.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.165+0000 7f04b6914640 1 -- 172.21.15.2:0/871578810 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04b01ad790 con 0x7f04b0114ab0 2024-09-19T06:13:13.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.166+0000 7f04b6914640 1 -- 172.21.15.2:0/871578810 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04b01095d0 con 0x7f04b0114ab0 2024-09-19T06:13:13.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.167+0000 7f04ad7fa640 1 -- 172.21.15.2:0/871578810 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f04a80051d0 con 0x7f04b0114ab0 2024-09-19T06:13:13.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.168+0000 7f04ad7fa640 1 --2- 172.21.15.2:0/871578810 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f04980a3240 0x7f04980a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:13.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.168+0000 7f04ad7fa640 1 -- 172.21.15.2:0/871578810 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f04a80cff40 con 0x7f04b0114ab0 2024-09-19T06:13:13.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.168+0000 7f04affff640 1 --2- 172.21.15.2:0/871578810 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f04980a3240 0x7f04980a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:13.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.168+0000 7f04affff640 1 --2- 172.21.15.2:0/871578810 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f04980a3240 0x7f04980a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f04b01a1bc0 tx=0x7f04a0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:13.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.172+0000 7f04ad7fa640 1 -- 172.21.15.2:0/871578810 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f04a8016030 con 0x7f04b0114ab0 2024-09-19T06:13:13.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:12 smithi090 ceph-mon[34497]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T06:13:13.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:12 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/312435769' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-19T06:13:13.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:12 smithi090 ceph-mon[34497]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T06:13:13.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:12 smithi090 ceph-mon[34497]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:13:13.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:12 smithi090 ceph-mon[34497]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-19T06:13:13.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:12 smithi090 ceph-mon[34497]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-19T06:13:13.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:12 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]: dispatch 2024-09-19T06:13:13.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:12 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-09-19T06:13:13.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:12 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-09-19T06:13:13.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:12 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-09-19T06:13:13.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:12 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-09-19T06:13:13.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:12 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9, 4, 8]}]: dispatch 2024-09-19T06:13:13.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:12 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-09-19T06:13:13.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:12 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2024-09-19T06:13:13.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:12 smithi089 ceph-mon[34160]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T06:13:13.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:12 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/312435769' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-19T06:13:13.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:12 smithi089 ceph-mon[34160]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T06:13:13.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:12 smithi089 ceph-mon[34160]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:13:13.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:12 smithi089 ceph-mon[34160]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-19T06:13:13.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:12 smithi089 ceph-mon[34160]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-19T06:13:13.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:12 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]: dispatch 2024-09-19T06:13:13.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:12 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-09-19T06:13:13.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:12 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-09-19T06:13:13.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:12 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-09-19T06:13:13.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:12 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-09-19T06:13:13.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:12 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9, 4, 8]}]: dispatch 2024-09-19T06:13:13.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:12 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-09-19T06:13:13.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:12 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2024-09-19T06:13:13.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.384+0000 7f04b6914640 1 -- 172.21.15.2:0/871578810 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f04b010fc90 con 0x7f04b0114ab0 2024-09-19T06:13:13.792 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 19 06:13:13 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-b[63859]: 2024-09-19T06:13:13.461+0000 7f61b9ecd640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-19T06:13:13.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.846+0000 7f04ad7fa640 1 -- 172.21.15.2:0/871578810 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f04a80bc030 con 0x7f04b0114ab0 2024-09-19T06:13:13.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.849+0000 7f04b6914640 1 -- 172.21.15.2:0/871578810 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f04980a3240 msgr2=0x7f04980a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:13.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.849+0000 7f04b6914640 1 --2- 172.21.15.2:0/871578810 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f04980a3240 0x7f04980a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f04b01a1bc0 tx=0x7f04a0008040 comp rx=0 tx=0).stop 2024-09-19T06:13:13.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.849+0000 7f04b6914640 1 -- 172.21.15.2:0/871578810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04b0114ab0 msgr2=0x7f04b01a0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:13.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.849+0000 7f04b6914640 1 --2- 172.21.15.2:0/871578810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04b0114ab0 0x7f04b01a0a80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f04a8009fd0 tx=0x7f04a800ee60 comp rx=0 tx=0).stop 2024-09-19T06:13:13.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.849+0000 7f04b6914640 1 -- 172.21.15.2:0/871578810 shutdown_connections 2024-09-19T06:13:13.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.849+0000 7f04b6914640 1 --2- 172.21.15.2:0/871578810 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f04980a3240 0x7f04980a5700 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:13.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.849+0000 7f04b6914640 1 --2- 172.21.15.2:0/871578810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04b0114ab0 0x7f04b01a0a80 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:13.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.849+0000 7f04b6914640 1 --2- 172.21.15.2:0/871578810 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04b0109b10 0x7f04b01a6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:13.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.849+0000 7f04b6914640 1 --2- 172.21.15.2:0/871578810 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04b01091f0 0x7f04b01a68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:13.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.849+0000 7f04b6914640 1 -- 172.21.15.2:0/871578810 >> 172.21.15.2:0/871578810 conn(0x7f04b006e140 msgr2=0x7f04b0071f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:13.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.849+0000 7f04b6914640 1 -- 172.21.15.2:0/871578810 shutdown_connections 2024-09-19T06:13:13.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:13.849+0000 7f04b6914640 1 -- 172.21.15.2:0/871578810 wait complete. 2024-09-19T06:13:14.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:13 smithi002 ceph-mon[30982]: pgmap v279: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T06:13:14.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:13 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]': finished 2024-09-19T06:13:14.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:13 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-19T06:13:14.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:13 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-19T06:13:14.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:13 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-09-19T06:13:14.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:13 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-09-19T06:13:14.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:13 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9, 4, 8]}]': finished 2024-09-19T06:13:14.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:13 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-19T06:13:14.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:13 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-09-19T06:13:14.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:13 smithi002 ceph-mon[30982]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T06:13:14.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:13 smithi002 ceph-mon[30982]: mds.? [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] up:active 2024-09-19T06:13:14.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:13 smithi002 ceph-mon[30982]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T06:13:14.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:13 smithi002 ceph-mon[30982]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T06:13:14.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:13 smithi002 ceph-mon[30982]: Cluster is now healthy 2024-09-19T06:13:14.224 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:13 smithi002 ceph-mon[30982]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-19T06:13:14.224 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:13 smithi002 ceph-mon[30982]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-19T06:13:14.224 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:13 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/871578810' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T06:13:14.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:13 smithi090 ceph-mon[34497]: pgmap v279: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T06:13:14.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:13 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]': finished 2024-09-19T06:13:14.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:13 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-19T06:13:14.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:13 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-19T06:13:14.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:13 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-09-19T06:13:14.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:13 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-09-19T06:13:14.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:13 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9, 4, 8]}]': finished 2024-09-19T06:13:14.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:13 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-19T06:13:14.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:13 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-09-19T06:13:14.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:13 smithi090 ceph-mon[34497]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T06:13:14.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:13 smithi090 ceph-mon[34497]: mds.? [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] up:active 2024-09-19T06:13:14.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:13 smithi090 ceph-mon[34497]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T06:13:14.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:13 smithi090 ceph-mon[34497]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T06:13:14.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:13 smithi090 ceph-mon[34497]: Cluster is now healthy 2024-09-19T06:13:14.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:13 smithi090 ceph-mon[34497]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-19T06:13:14.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:13 smithi090 ceph-mon[34497]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-19T06:13:14.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:13 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/871578810' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T06:13:14.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:13 smithi089 ceph-mon[34160]: pgmap v279: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T06:13:14.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:13 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]': finished 2024-09-19T06:13:14.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:13 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-19T06:13:14.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:13 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-19T06:13:14.294 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:13 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-09-19T06:13:14.294 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:13 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-09-19T06:13:14.294 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:13 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9, 4, 8]}]': finished 2024-09-19T06:13:14.294 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:13 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-19T06:13:14.294 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:13 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-09-19T06:13:14.294 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:13 smithi089 ceph-mon[34160]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T06:13:14.294 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:13 smithi089 ceph-mon[34160]: mds.? [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] up:active 2024-09-19T06:13:14.294 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:13 smithi089 ceph-mon[34160]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T06:13:14.294 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:13 smithi089 ceph-mon[34160]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T06:13:14.294 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:13 smithi089 ceph-mon[34160]: Cluster is now healthy 2024-09-19T06:13:14.294 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:13 smithi089 ceph-mon[34160]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-19T06:13:14.294 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:13 smithi089 ceph-mon[34160]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-19T06:13:14.295 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:13 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/871578810' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T06:13:14.559 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-19T06:13:14.823 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:15.194 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:14 smithi002 ceph-mon[30982]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T06:13:15.194 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:14 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/871578810' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T06:13:15.194 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:14 smithi002 ceph-mon[30982]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-19T06:13:15.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:14 smithi090 ceph-mon[34497]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T06:13:15.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:14 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/871578810' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T06:13:15.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:14 smithi090 ceph-mon[34497]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-19T06:13:15.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.276+0000 7fe0a8d97640 1 -- 172.21.15.2:0/635228001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0a4100a80 msgr2=0x7fe0a4100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:15.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.276+0000 7fe0a8d97640 1 --2- 172.21.15.2:0/635228001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0a4100a80 0x7fe0a4100ee0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe08c009930 tx=0x7fe08c02a420 comp rx=0 tx=0).stop 2024-09-19T06:13:15.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.276+0000 7fe0a8d97640 1 -- 172.21.15.2:0/635228001 shutdown_connections 2024-09-19T06:13:15.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.276+0000 7fe0a8d97640 1 --2- 172.21.15.2:0/635228001 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0a4101420 0x7fe0a410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:15.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.276+0000 7fe0a8d97640 1 --2- 172.21.15.2:0/635228001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0a4100a80 0x7fe0a4100ee0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:15.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.276+0000 7fe0a8d97640 1 --2- 172.21.15.2:0/635228001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0a4106a80 0x7fe0a4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:15.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.276+0000 7fe0a8d97640 1 -- 172.21.15.2:0/635228001 >> 172.21.15.2:0/635228001 conn(0x7fe0a40fc7a0 msgr2=0x7fe0a40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:15.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.276+0000 7fe0a8d97640 1 -- 172.21.15.2:0/635228001 shutdown_connections 2024-09-19T06:13:15.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.276+0000 7fe0a8d97640 1 -- 172.21.15.2:0/635228001 wait complete. 2024-09-19T06:13:15.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.277+0000 7fe0a8d97640 1 Processor -- start 2024-09-19T06:13:15.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.277+0000 7fe0a8d97640 1 -- start start 2024-09-19T06:13:15.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.277+0000 7fe0a8d97640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0a4100a80 0x7fe0a4197050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:15.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.277+0000 7fe0a8d97640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0a4101420 0x7fe0a4197590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:15.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.277+0000 7fe0a8d97640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0a4106a80 0x7fe0a4197ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:15.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.277+0000 7fe0a8d97640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a4110d50 con 0x7fe0a4101420 2024-09-19T06:13:15.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.277+0000 7fe0a8d97640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a4110bd0 con 0x7fe0a4106a80 2024-09-19T06:13:15.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.277+0000 7fe0a8d97640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a4110ed0 con 0x7fe0a4100a80 2024-09-19T06:13:15.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.277+0000 7fe09bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0a4101420 0x7fe0a4197590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:15.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.277+0000 7fe09bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0a4101420 0x7fe0a4197590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55326/0 (socket says 172.21.15.2:55326) 2024-09-19T06:13:15.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.277+0000 7fe09bfff640 1 -- 172.21.15.2:0/1304180927 learned_addr learned my addr 172.21.15.2:0/1304180927 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:13:15.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.277+0000 7fe0a259c640 1 --2- 172.21.15.2:0/1304180927 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0a4100a80 0x7fe0a4197050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:15.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.278+0000 7fe0a2d9d640 1 --2- 172.21.15.2:0/1304180927 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0a4106a80 0x7fe0a4197ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:15.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.278+0000 7fe09bfff640 1 -- 172.21.15.2:0/1304180927 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0a4100a80 msgr2=0x7fe0a4197050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:15.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.278+0000 7fe09bfff640 1 --2- 172.21.15.2:0/1304180927 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0a4100a80 0x7fe0a4197050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:15.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.278+0000 7fe09bfff640 1 -- 172.21.15.2:0/1304180927 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0a4106a80 msgr2=0x7fe0a4197ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:15.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.278+0000 7fe09bfff640 1 --2- 172.21.15.2:0/1304180927 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0a4106a80 0x7fe0a4197ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:15.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.278+0000 7fe09bfff640 1 -- 172.21.15.2:0/1304180927 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a41a68c0 con 0x7fe0a4101420 2024-09-19T06:13:15.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.278+0000 7fe09bfff640 1 --2- 172.21.15.2:0/1304180927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0a4101420 0x7fe0a4197590 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe08c005940 tx=0x7fe08c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:15.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.278+0000 7fe09b7fe640 1 -- 172.21.15.2:0/1304180927 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08c03f030 con 0x7fe0a4101420 2024-09-19T06:13:15.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.278+0000 7fe09b7fe640 1 -- 172.21.15.2:0/1304180927 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe08c003cb0 con 0x7fe0a4101420 2024-09-19T06:13:15.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.278+0000 7fe09b7fe640 1 -- 172.21.15.2:0/1304180927 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08c035070 con 0x7fe0a4101420 2024-09-19T06:13:15.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.278+0000 7fe0a8d97640 1 -- 172.21.15.2:0/1304180927 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0a41a6b50 con 0x7fe0a4101420 2024-09-19T06:13:15.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.278+0000 7fe0a8d97640 1 -- 172.21.15.2:0/1304180927 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0a41a6fe0 con 0x7fe0a4101420 2024-09-19T06:13:15.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.279+0000 7fe0a8d97640 1 -- 172.21.15.2:0/1304180927 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0a4100ee0 con 0x7fe0a4101420 2024-09-19T06:13:15.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.280+0000 7fe09b7fe640 1 -- 172.21.15.2:0/1304180927 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fe08c042030 con 0x7fe0a4101420 2024-09-19T06:13:15.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.281+0000 7fe09b7fe640 1 --2- 172.21.15.2:0/1304180927 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fe0900a3240 0x7fe0900a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:15.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.281+0000 7fe09b7fe640 1 -- 172.21.15.2:0/1304180927 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7fe08c0efe90 con 0x7fe0a4101420 2024-09-19T06:13:15.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.281+0000 7fe0a259c640 1 --2- 172.21.15.2:0/1304180927 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fe0900a3240 0x7fe0900a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:15.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.281+0000 7fe0a259c640 1 --2- 172.21.15.2:0/1304180927 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fe0900a3240 0x7fe0900a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe0940058c0 tx=0x7fe09400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:15.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.285+0000 7fe09b7fe640 1 -- 172.21.15.2:0/1304180927 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe08c0bcbc0 con 0x7fe0a4101420 2024-09-19T06:13:15.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:14 smithi089 ceph-mon[34160]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T06:13:15.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:14 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/871578810' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T06:13:15.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:14 smithi089 ceph-mon[34160]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-19T06:13:15.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.499+0000 7fe0a8d97640 1 -- 172.21.15.2:0/1304180927 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fe0a406ad80 con 0x7fe0a4101420 2024-09-19T06:13:15.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.848+0000 7fe09b7fe640 1 -- 172.21.15.2:0/1304180927 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v23) ==== 115+0+0 (secure 0 0 0) 0x7fe08c0bc4c0 con 0x7fe0a4101420 2024-09-19T06:13:15.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.850+0000 7fe0a8d97640 1 -- 172.21.15.2:0/1304180927 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fe0900a3240 msgr2=0x7fe0900a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:15.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.851+0000 7fe0a8d97640 1 --2- 172.21.15.2:0/1304180927 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fe0900a3240 0x7fe0900a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe0940058c0 tx=0x7fe09400a2d0 comp rx=0 tx=0).stop 2024-09-19T06:13:15.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.851+0000 7fe0a8d97640 1 -- 172.21.15.2:0/1304180927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0a4101420 msgr2=0x7fe0a4197590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:15.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.851+0000 7fe0a8d97640 1 --2- 172.21.15.2:0/1304180927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0a4101420 0x7fe0a4197590 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe08c005940 tx=0x7fe08c0042f0 comp rx=0 tx=0).stop 2024-09-19T06:13:15.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.851+0000 7fe0a8d97640 1 -- 172.21.15.2:0/1304180927 shutdown_connections 2024-09-19T06:13:15.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.851+0000 7fe0a8d97640 1 --2- 172.21.15.2:0/1304180927 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fe0900a3240 0x7fe0900a5700 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:15.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.851+0000 7fe0a8d97640 1 --2- 172.21.15.2:0/1304180927 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0a4106a80 0x7fe0a4197ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:15.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.851+0000 7fe0a8d97640 1 --2- 172.21.15.2:0/1304180927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0a4101420 0x7fe0a4197590 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:15.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.851+0000 7fe0a8d97640 1 --2- 172.21.15.2:0/1304180927 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0a4100a80 0x7fe0a4197050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:15.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.851+0000 7fe0a8d97640 1 -- 172.21.15.2:0/1304180927 >> 172.21.15.2:0/1304180927 conn(0x7fe0a40fc7a0 msgr2=0x7fe0a40fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:15.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.851+0000 7fe0a8d97640 1 -- 172.21.15.2:0/1304180927 shutdown_connections 2024-09-19T06:13:15.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:15.851+0000 7fe0a8d97640 1 -- 172.21.15.2:0/1304180927 wait complete. 2024-09-19T06:13:16.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:15 smithi002 ceph-mon[30982]: pgmap v282: 97 pgs: 3 peering, 94 active+clean; 581 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s wr, 12 op/s; 80 B/s, 0 objects/s recovering 2024-09-19T06:13:16.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:15 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1304180927' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T06:13:16.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:15 smithi090 ceph-mon[34497]: pgmap v282: 97 pgs: 3 peering, 94 active+clean; 581 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s wr, 12 op/s; 80 B/s, 0 objects/s recovering 2024-09-19T06:13:16.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:15 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1304180927' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T06:13:16.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:15 smithi089 ceph-mon[34160]: pgmap v282: 97 pgs: 3 peering, 94 active+clean; 581 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s wr, 12 op/s; 80 B/s, 0 objects/s recovering 2024-09-19T06:13:16.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:15 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1304180927' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T06:13:16.473 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-09-19T06:13:16.473 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-19T06:13:16.735 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:17.117 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:16 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1304180927' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T06:13:17.118 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:16 smithi002 ceph-mon[30982]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-19T06:13:17.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.200+0000 7f8196f8e640 1 -- 172.21.15.2:0/1782828275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8190101bc0 msgr2=0x7f819010d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:17.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.200+0000 7f8196f8e640 1 --2- 172.21.15.2:0/1782828275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8190101bc0 0x7f819010d910 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8188009ca0 tx=0x7f818802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:13:17.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.200+0000 7f8196f8e640 1 -- 172.21.15.2:0/1782828275 shutdown_connections 2024-09-19T06:13:17.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.200+0000 7f8196f8e640 1 --2- 172.21.15.2:0/1782828275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8190101bc0 0x7f819010d910 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:17.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.200+0000 7f8196f8e640 1 --2- 172.21.15.2:0/1782828275 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8190101240 0x7f8190101680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:17.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.200+0000 7f8196f8e640 1 --2- 172.21.15.2:0/1782828275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8190105a90 0x7f8190105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:17.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.200+0000 7f8196f8e640 1 -- 172.21.15.2:0/1782828275 >> 172.21.15.2:0/1782828275 conn(0x7f8190077210 msgr2=0x7f81900fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:17.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.200+0000 7f8196f8e640 1 -- 172.21.15.2:0/1782828275 shutdown_connections 2024-09-19T06:13:17.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.200+0000 7f8196f8e640 1 -- 172.21.15.2:0/1782828275 wait complete. 2024-09-19T06:13:17.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.201+0000 7f8196f8e640 1 Processor -- start 2024-09-19T06:13:17.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.201+0000 7f8196f8e640 1 -- start start 2024-09-19T06:13:17.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.201+0000 7f8196f8e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8190101240 0x7f8190198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:17.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.201+0000 7f8196f8e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8190101bc0 0x7f81901988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:17.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.201+0000 7f8196f8e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8190105a90 0x7f819019cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:17.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.201+0000 7f8196f8e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8190111f40 con 0x7f8190105a90 2024-09-19T06:13:17.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.201+0000 7f8196f8e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8190111dc0 con 0x7f8190101bc0 2024-09-19T06:13:17.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.201+0000 7f8196f8e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f81901120c0 con 0x7f8190101240 2024-09-19T06:13:17.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.201+0000 7f819552b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8190105a90 0x7f819019cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:17.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.201+0000 7f819552b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8190105a90 0x7f819019cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54202/0 (socket says 172.21.15.2:54202) 2024-09-19T06:13:17.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.201+0000 7f819552b640 1 -- 172.21.15.2:0/1226891333 learned_addr learned my addr 172.21.15.2:0/1226891333 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:13:17.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.201+0000 7f818ffff640 1 --2- 172.21.15.2:0/1226891333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8190101bc0 0x7f81901988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:17.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.202+0000 7f8194d2a640 1 --2- 172.21.15.2:0/1226891333 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8190101240 0x7f8190198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:17.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.202+0000 7f819552b640 1 -- 172.21.15.2:0/1226891333 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8190101240 msgr2=0x7f8190198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:17.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.202+0000 7f819552b640 1 --2- 172.21.15.2:0/1226891333 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8190101240 0x7f8190198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:17.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.202+0000 7f819552b640 1 -- 172.21.15.2:0/1226891333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8190101bc0 msgr2=0x7f81901988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:17.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.202+0000 7f819552b640 1 --2- 172.21.15.2:0/1226891333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8190101bc0 0x7f81901988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:17.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.202+0000 7f819552b640 1 -- 172.21.15.2:0/1226891333 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f819019d340 con 0x7f8190105a90 2024-09-19T06:13:17.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.202+0000 7f819552b640 1 --2- 172.21.15.2:0/1226891333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8190105a90 0x7f819019cc60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8188009dc0 tx=0x7f8188032fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:17.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.202+0000 7f818dffb640 1 -- 172.21.15.2:0/1226891333 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8188003cf0 con 0x7f8190105a90 2024-09-19T06:13:17.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.202+0000 7f8196f8e640 1 -- 172.21.15.2:0/1226891333 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f819019d5d0 con 0x7f8190105a90 2024-09-19T06:13:17.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.202+0000 7f818dffb640 1 -- 172.21.15.2:0/1226891333 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f81880044f0 con 0x7f8190105a90 2024-09-19T06:13:17.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.202+0000 7f818dffb640 1 -- 172.21.15.2:0/1226891333 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8188030bf0 con 0x7f8190105a90 2024-09-19T06:13:17.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.202+0000 7f8196f8e640 1 -- 172.21.15.2:0/1226891333 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81901a4f10 con 0x7f8190105a90 2024-09-19T06:13:17.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.203+0000 7f8196f8e640 1 -- 172.21.15.2:0/1226891333 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8190101680 con 0x7f8190105a90 2024-09-19T06:13:17.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.204+0000 7f818dffb640 1 -- 172.21.15.2:0/1226891333 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f8188004040 con 0x7f8190105a90 2024-09-19T06:13:17.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.205+0000 7f818dffb640 1 --2- 172.21.15.2:0/1226891333 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f81800a3240 0x7f81800a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:17.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.205+0000 7f8194d2a640 1 --2- 172.21.15.2:0/1226891333 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f81800a3240 0x7f81800a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:17.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.205+0000 7f818dffb640 1 -- 172.21.15.2:0/1226891333 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f81880f0f10 con 0x7f8190105a90 2024-09-19T06:13:17.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.206+0000 7f8194d2a640 1 --2- 172.21.15.2:0/1226891333 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f81800a3240 0x7f81800a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8184005fd0 tx=0x7f8184005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:17.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.209+0000 7f818dffb640 1 -- 172.21.15.2:0/1226891333 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f81880bdc40 con 0x7f8190105a90 2024-09-19T06:13:17.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:16 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1304180927' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T06:13:17.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:16 smithi090 ceph-mon[34497]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-19T06:13:17.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:16 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1304180927' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T06:13:17.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:16 smithi089 ceph-mon[34160]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-19T06:13:17.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.407+0000 7f8196f8e640 1 -- 172.21.15.2:0/1226891333 --> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f8190109010 con 0x7f81800a3240 2024-09-19T06:13:17.722 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:13:17 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:13:17.413+0000 7f812247a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:13:17.722 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:13:17 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:13:17.413+0000 7f812247a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:13:17.722 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:13:17 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:13:17.413+0000 7f812247a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:13:17.722 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:13:17 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:13:17.413+0000 7f812247a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:13:17.722 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:13:17 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:13:17.413+0000 7f812247a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:13:17.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.881+0000 7f818dffb640 1 -- 172.21.15.2:0/1226891333 <== mgr.14150 v2:172.21.15.2:6800/4180340554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8190109010 con 0x7f81800a3240 2024-09-19T06:13:17.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.883+0000 7f8196f8e640 1 -- 172.21.15.2:0/1226891333 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f81800a3240 msgr2=0x7f81800a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:17.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.883+0000 7f8196f8e640 1 --2- 172.21.15.2:0/1226891333 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f81800a3240 0x7f81800a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8184005fd0 tx=0x7f8184005850 comp rx=0 tx=0).stop 2024-09-19T06:13:17.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.883+0000 7f8196f8e640 1 -- 172.21.15.2:0/1226891333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8190105a90 msgr2=0x7f819019cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:17.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.883+0000 7f8196f8e640 1 --2- 172.21.15.2:0/1226891333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8190105a90 0x7f819019cc60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8188009dc0 tx=0x7f8188032fe0 comp rx=0 tx=0).stop 2024-09-19T06:13:17.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.883+0000 7f8196f8e640 1 -- 172.21.15.2:0/1226891333 shutdown_connections 2024-09-19T06:13:17.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.883+0000 7f8196f8e640 1 --2- 172.21.15.2:0/1226891333 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f81800a3240 0x7f81800a5700 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:17.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.883+0000 7f8196f8e640 1 --2- 172.21.15.2:0/1226891333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8190105a90 0x7f819019cc60 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:17.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.883+0000 7f8196f8e640 1 --2- 172.21.15.2:0/1226891333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8190101bc0 0x7f81901988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:17.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.883+0000 7f8196f8e640 1 --2- 172.21.15.2:0/1226891333 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8190101240 0x7f8190198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:17.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.883+0000 7f8196f8e640 1 -- 172.21.15.2:0/1226891333 >> 172.21.15.2:0/1226891333 conn(0x7f8190077210 msgr2=0x7f8190104320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:17.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.883+0000 7f8196f8e640 1 -- 172.21.15.2:0/1226891333 shutdown_connections 2024-09-19T06:13:17.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:17.883+0000 7f8196f8e640 1 -- 172.21.15.2:0/1226891333 wait complete. 2024-09-19T06:13:18.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:17 smithi002 ceph-mon[30982]: pgmap v283: 97 pgs: 3 peering, 94 active+clean; 582 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s wr, 14 op/s; 80 B/s, 0 objects/s recovering 2024-09-19T06:13:18.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:17 smithi002 ceph-mon[30982]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-19T06:13:18.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:17 smithi090 ceph-mon[34497]: pgmap v283: 97 pgs: 3 peering, 94 active+clean; 582 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s wr, 14 op/s; 80 B/s, 0 objects/s recovering 2024-09-19T06:13:18.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:17 smithi090 ceph-mon[34497]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-19T06:13:18.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:17 smithi089 ceph-mon[34160]: pgmap v283: 97 pgs: 3 peering, 94 active+clean; 582 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s wr, 14 op/s; 80 B/s, 0 objects/s recovering 2024-09-19T06:13:18.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:17 smithi089 ceph-mon[34160]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-19T06:13:18.555 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-19T06:13:18.792 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 19 06:13:18 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-b[63859]: 2024-09-19T06:13:18.462+0000 7f61b9ecd640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-19T06:13:18.816 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:19.199 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:18 smithi002 ceph-mon[30982]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:13:19.200 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:18 smithi002 ceph-mon[30982]: mds.? [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] up:active 2024-09-19T06:13:19.200 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:18 smithi002 ceph-mon[30982]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-19T06:13:19.200 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:18 smithi002 ceph-mon[30982]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:13:19.244 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:18 smithi090 ceph-mon[34497]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:13:19.245 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:18 smithi090 ceph-mon[34497]: mds.? [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] up:active 2024-09-19T06:13:19.245 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:18 smithi090 ceph-mon[34497]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-19T06:13:19.245 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:18 smithi090 ceph-mon[34497]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:13:19.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.285+0000 7f509bfa5640 1 -- 172.21.15.2:0/2737156172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5094102570 msgr2=0x7f50941029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:19.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.285+0000 7f509bfa5640 1 --2- 172.21.15.2:0/2737156172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5094102570 0x7f50941029b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5084009900 tx=0x7f508402a480 comp rx=0 tx=0).stop 2024-09-19T06:13:19.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.285+0000 7f509bfa5640 1 -- 172.21.15.2:0/2737156172 shutdown_connections 2024-09-19T06:13:19.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.285+0000 7f509bfa5640 1 --2- 172.21.15.2:0/2737156172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5094102ef0 0x7f509410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:19.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.285+0000 7f509bfa5640 1 --2- 172.21.15.2:0/2737156172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5094102570 0x7f50941029b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:19.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.285+0000 7f509bfa5640 1 --2- 172.21.15.2:0/2737156172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5094100e20 0x7f5094101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:19.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.285+0000 7f509bfa5640 1 -- 172.21.15.2:0/2737156172 >> 172.21.15.2:0/2737156172 conn(0x7f50940fc7d0 msgr2=0x7f50940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:19.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.285+0000 7f509bfa5640 1 -- 172.21.15.2:0/2737156172 shutdown_connections 2024-09-19T06:13:19.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.285+0000 7f509bfa5640 1 -- 172.21.15.2:0/2737156172 wait complete. 2024-09-19T06:13:19.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.286+0000 7f509bfa5640 1 Processor -- start 2024-09-19T06:13:19.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.286+0000 7f509bfa5640 1 -- start start 2024-09-19T06:13:19.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.286+0000 7f509bfa5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5094100e20 0x7f5094198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:19.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.286+0000 7f509bfa5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5094102570 0x7f50941989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:19.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.286+0000 7f509bfa5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5094102ef0 0x7f509419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:19.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.286+0000 7f509bfa5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5094110e30 con 0x7f5094100e20 2024-09-19T06:13:19.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.286+0000 7f509bfa5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f5094110cb0 con 0x7f5094102ef0 2024-09-19T06:13:19.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.286+0000 7f509bfa5640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5094110fb0 con 0x7f5094102570 2024-09-19T06:13:19.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.286+0000 7f5099d41640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5094100e20 0x7f5094198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:19.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.286+0000 7f5099d41640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5094100e20 0x7f5094198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54226/0 (socket says 172.21.15.2:54226) 2024-09-19T06:13:19.294 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:18 smithi089 ceph-mon[34160]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:13:19.295 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:18 smithi089 ceph-mon[34160]: mds.? [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] up:active 2024-09-19T06:13:19.295 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:18 smithi089 ceph-mon[34160]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-19T06:13:19.295 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:18 smithi089 ceph-mon[34160]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:13:19.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.286+0000 7f5099d41640 1 -- 172.21.15.2:0/4193920744 learned_addr learned my addr 172.21.15.2:0/4193920744 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:13:19.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.286+0000 7f5099540640 1 --2- 172.21.15.2:0/4193920744 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5094102570 0x7f50941989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:19.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.286+0000 7f509a542640 1 --2- 172.21.15.2:0/4193920744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5094102ef0 0x7f509419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:19.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.287+0000 7f5099d41640 1 -- 172.21.15.2:0/4193920744 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5094102570 msgr2=0x7f50941989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:19.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.287+0000 7f5099d41640 1 --2- 172.21.15.2:0/4193920744 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5094102570 0x7f50941989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:19.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.287+0000 7f5099d41640 1 -- 172.21.15.2:0/4193920744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5094102ef0 msgr2=0x7f509419cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:19.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.287+0000 7f5099d41640 1 --2- 172.21.15.2:0/4193920744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5094102ef0 0x7f509419cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:19.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.287+0000 7f5099d41640 1 -- 172.21.15.2:0/4193920744 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f509419d410 con 0x7f5094100e20 2024-09-19T06:13:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.287+0000 7f5099d41640 1 --2- 172.21.15.2:0/4193920744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5094100e20 0x7f5094198460 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f509000d770 tx=0x7f509000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.287+0000 7f508affd640 1 -- 172.21.15.2:0/4193920744 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5090017070 con 0x7f5094100e20 2024-09-19T06:13:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.287+0000 7f508affd640 1 -- 172.21.15.2:0/4193920744 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f50900054d0 con 0x7f5094100e20 2024-09-19T06:13:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.287+0000 7f509bfa5640 1 -- 172.21.15.2:0/4193920744 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f509419d700 con 0x7f5094100e20 2024-09-19T06:13:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.287+0000 7f508affd640 1 -- 172.21.15.2:0/4193920744 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5090004cf0 con 0x7f5094100e20 2024-09-19T06:13:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.287+0000 7f509bfa5640 1 -- 172.21.15.2:0/4193920744 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50941a4fe0 con 0x7f5094100e20 2024-09-19T06:13:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.288+0000 7f509bfa5640 1 -- 172.21.15.2:0/4193920744 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5094101200 con 0x7f5094100e20 2024-09-19T06:13:19.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.290+0000 7f508affd640 1 -- 172.21.15.2:0/4193920744 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f5090004e90 con 0x7f5094100e20 2024-09-19T06:13:19.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.290+0000 7f508affd640 1 --2- 172.21.15.2:0/4193920744 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f50800a3350 0x7f50800a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:19.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.291+0000 7f5099540640 1 --2- 172.21.15.2:0/4193920744 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f50800a3350 0x7f50800a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:19.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.291+0000 7f508affd640 1 -- 172.21.15.2:0/4193920744 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f50900cf3d0 con 0x7f5094100e20 2024-09-19T06:13:19.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.291+0000 7f5099540640 1 --2- 172.21.15.2:0/4193920744 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f50800a3350 0x7f50800a5810 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5084009230 tx=0x7f50840058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:19.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.295+0000 7f508affd640 1 -- 172.21.15.2:0/4193920744 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f509009b950 con 0x7f5094100e20 2024-09-19T06:13:19.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.495+0000 7f509bfa5640 1 -- 172.21.15.2:0/4193920744 --> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f5094062630 con 0x7f50800a3350 2024-09-19T06:13:19.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.521+0000 7f508affd640 1 -- 172.21.15.2:0/4193920744 <== mgr.14150 v2:172.21.15.2:6800/4180340554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5094062630 con 0x7f50800a3350 2024-09-19T06:13:19.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.523+0000 7f509bfa5640 1 -- 172.21.15.2:0/4193920744 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f50800a3350 msgr2=0x7f50800a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:19.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.523+0000 7f509bfa5640 1 --2- 172.21.15.2:0/4193920744 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f50800a3350 0x7f50800a5810 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5084009230 tx=0x7f50840058d0 comp rx=0 tx=0).stop 2024-09-19T06:13:19.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.523+0000 7f509bfa5640 1 -- 172.21.15.2:0/4193920744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5094100e20 msgr2=0x7f5094198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:19.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.523+0000 7f509bfa5640 1 --2- 172.21.15.2:0/4193920744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5094100e20 0x7f5094198460 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f509000d770 tx=0x7f509000dc30 comp rx=0 tx=0).stop 2024-09-19T06:13:19.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.524+0000 7f509bfa5640 1 -- 172.21.15.2:0/4193920744 shutdown_connections 2024-09-19T06:13:19.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.524+0000 7f509bfa5640 1 --2- 172.21.15.2:0/4193920744 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f50800a3350 0x7f50800a5810 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:19.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.524+0000 7f509bfa5640 1 --2- 172.21.15.2:0/4193920744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5094102ef0 0x7f509419cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:19.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.524+0000 7f509bfa5640 1 --2- 172.21.15.2:0/4193920744 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5094102570 0x7f50941989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:19.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.524+0000 7f509bfa5640 1 --2- 172.21.15.2:0/4193920744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5094100e20 0x7f5094198460 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:19.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.524+0000 7f509bfa5640 1 -- 172.21.15.2:0/4193920744 >> 172.21.15.2:0/4193920744 conn(0x7f50940fc7d0 msgr2=0x7f509406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:19.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.524+0000 7f509bfa5640 1 -- 172.21.15.2:0/4193920744 shutdown_connections 2024-09-19T06:13:19.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:19.524+0000 7f509bfa5640 1 -- 172.21.15.2:0/4193920744 wait complete. 2024-09-19T06:13:20.187 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:19 smithi002 ceph-mon[30982]: pgmap v284: 97 pgs: 3 peering, 94 active+clean; 582 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s wr, 9 op/s; 80 B/s, 0 objects/s recovering 2024-09-19T06:13:20.187 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:19 smithi002 ceph-mon[30982]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T06:13:20.216 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-19T06:13:20.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:19 smithi090 ceph-mon[34497]: pgmap v284: 97 pgs: 3 peering, 94 active+clean; 582 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s wr, 9 op/s; 80 B/s, 0 objects/s recovering 2024-09-19T06:13:20.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:19 smithi090 ceph-mon[34497]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T06:13:20.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:19 smithi089 ceph-mon[34160]: pgmap v284: 97 pgs: 3 peering, 94 active+clean; 582 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s wr, 9 op/s; 80 B/s, 0 objects/s recovering 2024-09-19T06:13:20.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:19 smithi089 ceph-mon[34160]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T06:13:20.473 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:20.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:20.901+0000 7fc3b64c4640 1 -- 172.21.15.2:0/3415779433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3b0101de0 msgr2=0x7fc3b01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:20.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:20.901+0000 7fc3b64c4640 1 --2- 172.21.15.2:0/3415779433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3b0101de0 0x7fc3b01021c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0009900 tx=0x7fc3a002a410 comp rx=0 tx=0).stop 2024-09-19T06:13:20.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:20.901+0000 7fc3b64c4640 1 -- 172.21.15.2:0/3415779433 shutdown_connections 2024-09-19T06:13:20.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:20.901+0000 7fc3b64c4640 1 --2- 172.21.15.2:0/3415779433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3b0106f10 0x7fc3b010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:20.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:20.901+0000 7fc3b64c4640 1 --2- 172.21.15.2:0/3415779433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3b0102790 0x7fc3b01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:20.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:20.901+0000 7fc3b64c4640 1 --2- 172.21.15.2:0/3415779433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3b0101de0 0x7fc3b01021c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:20.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:20.901+0000 7fc3b64c4640 1 -- 172.21.15.2:0/3415779433 >> 172.21.15.2:0/3415779433 conn(0x7fc3b00fd8c0 msgr2=0x7fc3b00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:20.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:20.901+0000 7fc3b64c4640 1 -- 172.21.15.2:0/3415779433 shutdown_connections 2024-09-19T06:13:20.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:20.901+0000 7fc3b64c4640 1 -- 172.21.15.2:0/3415779433 wait complete. 2024-09-19T06:13:20.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:20.902+0000 7fc3b64c4640 1 Processor -- start 2024-09-19T06:13:20.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:20.902+0000 7fc3b64c4640 1 -- start start 2024-09-19T06:13:20.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:20.902+0000 7fc3b64c4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3b0101de0 0x7fc3b00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:20.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:20.902+0000 7fc3b64c4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3b0102790 0x7fc3b0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:20.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:20.902+0000 7fc3b64c4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3b0106f10 0x7fc3b0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:20.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:20.902+0000 7fc3b64c4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b0111e20 con 0x7fc3b0106f10 2024-09-19T06:13:20.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:20.902+0000 7fc3b64c4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b0111ca0 con 0x7fc3b0101de0 2024-09-19T06:13:20.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:20.902+0000 7fc3b64c4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b0111fa0 con 0x7fc3b0102790 2024-09-19T06:13:20.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:20.902+0000 7fc3b4a61640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3b0106f10 0x7fc3b0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:20.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:20.902+0000 7fc3b4a61640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3b0106f10 0x7fc3b0074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54246/0 (socket says 172.21.15.2:54246) 2024-09-19T06:13:20.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:20.902+0000 7fc3b4a61640 1 -- 172.21.15.2:0/994456063 learned_addr learned my addr 172.21.15.2:0/994456063 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:13:20.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:20.902+0000 7fc3a7fff640 1 --2- 172.21.15.2:0/994456063 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3b0102790 0x7fc3b0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:20.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:20.902+0000 7fc3affff640 1 --2- 172.21.15.2:0/994456063 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3b0101de0 0x7fc3b00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:20.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:20.903+0000 7fc3b4a61640 1 -- 172.21.15.2:0/994456063 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3b0102790 msgr2=0x7fc3b0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:20.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:20.903+0000 7fc3b4a61640 1 --2- 172.21.15.2:0/994456063 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3b0102790 0x7fc3b0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:20.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:20.903+0000 7fc3b4a61640 1 -- 172.21.15.2:0/994456063 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3b0101de0 msgr2=0x7fc3b00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:20.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:20.903+0000 7fc3b4a61640 1 --2- 172.21.15.2:0/994456063 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3b0101de0 0x7fc3b00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:20.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:20.903+0000 7fc3b4a61640 1 -- 172.21.15.2:0/994456063 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3b01a6820 con 0x7fc3b0106f10 2024-09-19T06:13:20.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:20.903+0000 7fc3b4a61640 1 --2- 172.21.15.2:0/994456063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3b0106f10 0x7fc3b0074f70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc3a800eaa0 tx=0x7fc3a800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:20.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:20.903+0000 7fc3adffb640 1 -- 172.21.15.2:0/994456063 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a800cdb0 con 0x7fc3b0106f10 2024-09-19T06:13:20.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:20.903+0000 7fc3adffb640 1 -- 172.21.15.2:0/994456063 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc3a8005020 con 0x7fc3b0106f10 2024-09-19T06:13:20.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:20.903+0000 7fc3b64c4640 1 -- 172.21.15.2:0/994456063 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3b01a6b10 con 0x7fc3b0106f10 2024-09-19T06:13:20.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:20.903+0000 7fc3adffb640 1 -- 172.21.15.2:0/994456063 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a80116d0 con 0x7fc3b0106f10 2024-09-19T06:13:20.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:20.903+0000 7fc3b64c4640 1 -- 172.21.15.2:0/994456063 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3b01a7050 con 0x7fc3b0106f10 2024-09-19T06:13:20.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:20.904+0000 7fc3b64c4640 1 -- 172.21.15.2:0/994456063 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3b01021c0 con 0x7fc3b0106f10 2024-09-19T06:13:20.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:20.905+0000 7fc3adffb640 1 -- 172.21.15.2:0/994456063 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fc3a80051d0 con 0x7fc3b0106f10 2024-09-19T06:13:20.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:20.906+0000 7fc3adffb640 1 --2- 172.21.15.2:0/994456063 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fc39c0a32d0 0x7fc39c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:20.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:20.906+0000 7fc3adffb640 1 -- 172.21.15.2:0/994456063 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7fc3a80cfb40 con 0x7fc3b0106f10 2024-09-19T06:13:20.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:20.906+0000 7fc3affff640 1 --2- 172.21.15.2:0/994456063 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fc39c0a32d0 0x7fc39c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:20.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:20.906+0000 7fc3affff640 1 --2- 172.21.15.2:0/994456063 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fc39c0a32d0 0x7fc39c0a5790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0031440 tx=0x7fc3a0005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:20.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:20.910+0000 7fc3adffb640 1 -- 172.21.15.2:0/994456063 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc3a8016030 con 0x7fc3b0106f10 2024-09-19T06:13:21.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:21.112+0000 7fc3b64c4640 1 -- 172.21.15.2:0/994456063 --> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fc3b010a160 con 0x7fc39c0a32d0 2024-09-19T06:13:21.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:21.117+0000 7fc3adffb640 1 -- 172.21.15.2:0/994456063 <== mgr.14150 v2:172.21.15.2:6800/4180340554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fc3a0032de0 con 0x7fc39c0a32d0 2024-09-19T06:13:21.119 INFO:teuthology.orchestra.run.smithi002.stdout:/volumes/qa/sv_0/87850fdf-e92c-40dd-b101-bfcd7e3cd2f9 2024-09-19T06:13:21.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:21.120+0000 7fc3b64c4640 1 -- 172.21.15.2:0/994456063 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fc39c0a32d0 msgr2=0x7fc39c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:21.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:21.120+0000 7fc3b64c4640 1 --2- 172.21.15.2:0/994456063 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fc39c0a32d0 0x7fc39c0a5790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0031440 tx=0x7fc3a0005b50 comp rx=0 tx=0).stop 2024-09-19T06:13:21.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:21.120+0000 7fc3b64c4640 1 -- 172.21.15.2:0/994456063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3b0106f10 msgr2=0x7fc3b0074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:21.120+0000 7fc3b64c4640 1 --2- 172.21.15.2:0/994456063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3b0106f10 0x7fc3b0074f70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc3a800eaa0 tx=0x7fc3a800ef60 comp rx=0 tx=0).stop 2024-09-19T06:13:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:21.120+0000 7fc3b64c4640 1 -- 172.21.15.2:0/994456063 shutdown_connections 2024-09-19T06:13:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:21.120+0000 7fc3b64c4640 1 --2- 172.21.15.2:0/994456063 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fc39c0a32d0 0x7fc39c0a5790 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:21.120+0000 7fc3b64c4640 1 --2- 172.21.15.2:0/994456063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3b0106f10 0x7fc3b0074f70 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:21.120+0000 7fc3b64c4640 1 --2- 172.21.15.2:0/994456063 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3b0102790 0x7fc3b0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:21.120+0000 7fc3b64c4640 1 --2- 172.21.15.2:0/994456063 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3b0101de0 0x7fc3b00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:21.120+0000 7fc3b64c4640 1 -- 172.21.15.2:0/994456063 >> 172.21.15.2:0/994456063 conn(0x7fc3b00fd8c0 msgr2=0x7fc3b00fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:21.120+0000 7fc3b64c4640 1 -- 172.21.15.2:0/994456063 shutdown_connections 2024-09-19T06:13:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:21.120+0000 7fc3b64c4640 1 -- 172.21.15.2:0/994456063 wait complete. 2024-09-19T06:13:21.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:20 smithi002 ceph-mon[30982]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:13:21.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:20 smithi090 ceph-mon[34497]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:13:21.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:20 smithi089 ceph-mon[34160]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:13:21.832 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-19T06:13:22.095 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:22.216 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:21 smithi002 ceph-mon[30982]: pgmap v285: 97 pgs: 97 active+clean; 588 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 4.2 KiB/s wr, 14 op/s; 80 B/s, 0 objects/s recovering 2024-09-19T06:13:22.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:21 smithi090 ceph-mon[34497]: pgmap v285: 97 pgs: 97 active+clean; 588 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 4.2 KiB/s wr, 14 op/s; 80 B/s, 0 objects/s recovering 2024-09-19T06:13:22.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:21 smithi089 ceph-mon[34160]: pgmap v285: 97 pgs: 97 active+clean; 588 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 4.2 KiB/s wr, 14 op/s; 80 B/s, 0 objects/s recovering 2024-09-19T06:13:22.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.548+0000 7f4972034640 1 -- 172.21.15.2:0/687637586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f496c103660 msgr2=0x7f496c10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:22.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.548+0000 7f4972034640 1 --2- 172.21.15.2:0/687637586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f496c103660 0x7f496c10bb50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4960009900 tx=0x7f496002a480 comp rx=0 tx=0).stop 2024-09-19T06:13:22.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.548+0000 7f4972034640 1 -- 172.21.15.2:0/687637586 shutdown_connections 2024-09-19T06:13:22.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.548+0000 7f4972034640 1 --2- 172.21.15.2:0/687637586 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f496c10c170 0x7f496c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:22.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.548+0000 7f4972034640 1 --2- 172.21.15.2:0/687637586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f496c103660 0x7f496c10bb50 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:22.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.548+0000 7f4972034640 1 --2- 172.21.15.2:0/687637586 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f496c102d40 0x7f496c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:22.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.548+0000 7f4972034640 1 -- 172.21.15.2:0/687637586 >> 172.21.15.2:0/687637586 conn(0x7f496c0fc7a0 msgr2=0x7f496c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:22.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.548+0000 7f4972034640 1 -- 172.21.15.2:0/687637586 shutdown_connections 2024-09-19T06:13:22.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.548+0000 7f4972034640 1 -- 172.21.15.2:0/687637586 wait complete. 2024-09-19T06:13:22.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.549+0000 7f4972034640 1 Processor -- start 2024-09-19T06:13:22.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.549+0000 7f4972034640 1 -- start start 2024-09-19T06:13:22.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.550+0000 7f4972034640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f496c102d40 0x7f496c198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:22.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.550+0000 7f4972034640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f496c103660 0x7f496c198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:22.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.550+0000 7f4972034640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f496c10c170 0x7f496c19cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:22.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.550+0000 7f4972034640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f496c111e60 con 0x7f496c102d40 2024-09-19T06:13:22.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.550+0000 7f4972034640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f496c111ce0 con 0x7f496c10c170 2024-09-19T06:13:22.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.550+0000 7f4972034640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f496c111fe0 con 0x7f496c103660 2024-09-19T06:13:22.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.550+0000 7f496b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f496c102d40 0x7f496c198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:22.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.550+0000 7f496b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f496c102d40 0x7f496c198310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54272/0 (socket says 172.21.15.2:54272) 2024-09-19T06:13:22.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.550+0000 7f496b7fe640 1 -- 172.21.15.2:0/2554030097 learned_addr learned my addr 172.21.15.2:0/2554030097 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:13:22.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.550+0000 7f496affd640 1 --2- 172.21.15.2:0/2554030097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f496c103660 0x7f496c198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:22.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.550+0000 7f496bfff640 1 --2- 172.21.15.2:0/2554030097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f496c10c170 0x7f496c19cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:22.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.550+0000 7f496b7fe640 1 -- 172.21.15.2:0/2554030097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f496c103660 msgr2=0x7f496c198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:22.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.550+0000 7f496b7fe640 1 --2- 172.21.15.2:0/2554030097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f496c103660 0x7f496c198850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:22.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.550+0000 7f496b7fe640 1 -- 172.21.15.2:0/2554030097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f496c10c170 msgr2=0x7f496c19cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:22.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.550+0000 7f496b7fe640 1 --2- 172.21.15.2:0/2554030097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f496c10c170 0x7f496c19cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:22.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.550+0000 7f496b7fe640 1 -- 172.21.15.2:0/2554030097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f496c19d2c0 con 0x7f496c102d40 2024-09-19T06:13:22.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.550+0000 7f496bfff640 1 --2- 172.21.15.2:0/2554030097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f496c10c170 0x7f496c19cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:13:22.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.550+0000 7f496b7fe640 1 --2- 172.21.15.2:0/2554030097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f496c102d40 0x7f496c198310 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f495c00c920 tx=0x7f495c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:22.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.550+0000 7f4968ff9640 1 -- 172.21.15.2:0/2554030097 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f495c007c70 con 0x7f496c102d40 2024-09-19T06:13:22.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.550+0000 7f4972034640 1 -- 172.21.15.2:0/2554030097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f496c19d5b0 con 0x7f496c102d40 2024-09-19T06:13:22.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.550+0000 7f4968ff9640 1 -- 172.21.15.2:0/2554030097 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f495c007e10 con 0x7f496c102d40 2024-09-19T06:13:22.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.550+0000 7f4968ff9640 1 -- 172.21.15.2:0/2554030097 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f495c018820 con 0x7f496c102d40 2024-09-19T06:13:22.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.551+0000 7f4972034640 1 -- 172.21.15.2:0/2554030097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f496c1a4e90 con 0x7f496c102d40 2024-09-19T06:13:22.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.552+0000 7f4972034640 1 -- 172.21.15.2:0/2554030097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f496c103120 con 0x7f496c102d40 2024-09-19T06:13:22.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.553+0000 7f4968ff9640 1 -- 172.21.15.2:0/2554030097 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f495c0189c0 con 0x7f496c102d40 2024-09-19T06:13:22.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.553+0000 7f4968ff9640 1 --2- 172.21.15.2:0/2554030097 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f49540a32d0 0x7f49540a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:22.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.553+0000 7f496affd640 1 --2- 172.21.15.2:0/2554030097 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f49540a32d0 0x7f49540a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:22.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.553+0000 7f4968ff9640 1 -- 172.21.15.2:0/2554030097 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f495c0cfbc0 con 0x7f496c102d40 2024-09-19T06:13:22.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.554+0000 7f496affd640 1 --2- 172.21.15.2:0/2554030097 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f49540a32d0 0x7f49540a5790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4960031440 tx=0x7f4960005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:22.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.557+0000 7f4968ff9640 1 -- 172.21.15.2:0/2554030097 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f495c014030 con 0x7f496c102d40 2024-09-19T06:13:22.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.758+0000 7f4972034640 1 -- 172.21.15.2:0/2554030097 --> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f496c062630 con 0x7f49540a32d0 2024-09-19T06:13:22.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.786+0000 7f4968ff9640 1 -- 172.21.15.2:0/2554030097 <== mgr.14150 v2:172.21.15.2:6800/4180340554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f496c062630 con 0x7f49540a32d0 2024-09-19T06:13:22.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.788+0000 7f4972034640 1 -- 172.21.15.2:0/2554030097 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f49540a32d0 msgr2=0x7f49540a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:22.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.788+0000 7f4972034640 1 --2- 172.21.15.2:0/2554030097 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f49540a32d0 0x7f49540a5790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4960031440 tx=0x7f4960005e80 comp rx=0 tx=0).stop 2024-09-19T06:13:22.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.788+0000 7f4972034640 1 -- 172.21.15.2:0/2554030097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f496c102d40 msgr2=0x7f496c198310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:22.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.788+0000 7f4972034640 1 --2- 172.21.15.2:0/2554030097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f496c102d40 0x7f496c198310 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f495c00c920 tx=0x7f495c00cde0 comp rx=0 tx=0).stop 2024-09-19T06:13:22.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.788+0000 7f4972034640 1 -- 172.21.15.2:0/2554030097 shutdown_connections 2024-09-19T06:13:22.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.788+0000 7f4972034640 1 --2- 172.21.15.2:0/2554030097 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f49540a32d0 0x7f49540a5790 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:22.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.788+0000 7f4972034640 1 --2- 172.21.15.2:0/2554030097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f496c10c170 0x7f496c19cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:22.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.788+0000 7f4972034640 1 --2- 172.21.15.2:0/2554030097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f496c103660 0x7f496c198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:22.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.788+0000 7f4972034640 1 --2- 172.21.15.2:0/2554030097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f496c102d40 0x7f496c198310 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:22.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.788+0000 7f4972034640 1 -- 172.21.15.2:0/2554030097 >> 172.21.15.2:0/2554030097 conn(0x7f496c0fc7a0 msgr2=0x7f496c0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:22.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.788+0000 7f4972034640 1 -- 172.21.15.2:0/2554030097 shutdown_connections 2024-09-19T06:13:22.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:22.788+0000 7f4972034640 1 -- 172.21.15.2:0/2554030097 wait complete. 2024-09-19T06:13:23.141 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:22 smithi090 ceph-mon[34497]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:13:23.150 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:22 smithi002 ceph-mon[30982]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:13:23.193 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:22 smithi089 ceph-mon[34160]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:13:23.463 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-19T06:13:23.725 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:24.129 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:23 smithi002 ceph-mon[30982]: pgmap v286: 97 pgs: 97 active+clean; 588 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 3.7 KiB/s wr, 12 op/s; 70 B/s, 0 objects/s recovering 2024-09-19T06:13:24.129 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:23 smithi002 ceph-mon[30982]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:13:24.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.215+0000 7ffbea7fd640 1 -- 172.21.15.2:0/428656132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbe4101420 msgr2=0x7ffbe410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:24.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.215+0000 7ffbea7fd640 1 --2- 172.21.15.2:0/428656132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbe4101420 0x7ffbe410d950 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc009cd0 tx=0x7ffbdc02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:13:24.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.215+0000 7ffbea7fd640 1 -- 172.21.15.2:0/428656132 shutdown_connections 2024-09-19T06:13:24.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.215+0000 7ffbea7fd640 1 --2- 172.21.15.2:0/428656132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbe4101420 0x7ffbe410d950 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:24.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.215+0000 7ffbea7fd640 1 --2- 172.21.15.2:0/428656132 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbe4100a80 0x7ffbe4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:24.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.215+0000 7ffbea7fd640 1 --2- 172.21.15.2:0/428656132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffbe4106a80 0x7ffbe4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:24.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.215+0000 7ffbea7fd640 1 -- 172.21.15.2:0/428656132 >> 172.21.15.2:0/428656132 conn(0x7ffbe40fc7a0 msgr2=0x7ffbe40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:24.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.215+0000 7ffbea7fd640 1 -- 172.21.15.2:0/428656132 shutdown_connections 2024-09-19T06:13:24.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.215+0000 7ffbea7fd640 1 -- 172.21.15.2:0/428656132 wait complete. 2024-09-19T06:13:24.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.216+0000 7ffbea7fd640 1 Processor -- start 2024-09-19T06:13:24.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.216+0000 7ffbea7fd640 1 -- start start 2024-09-19T06:13:24.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.216+0000 7ffbea7fd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbe4100a80 0x7ffbe4199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:24.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.216+0000 7ffbea7fd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffbe4101420 0x7ffbe41996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:24.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.217+0000 7ffbea7fd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbe4106a80 0x7ffbe41a41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:24.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.217+0000 7ffbea7fd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe4110d30 con 0x7ffbe4106a80 2024-09-19T06:13:24.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.217+0000 7ffbea7fd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe4110bb0 con 0x7ffbe4101420 2024-09-19T06:13:24.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.217+0000 7ffbea7fd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe4110eb0 con 0x7ffbe4100a80 2024-09-19T06:13:24.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.217+0000 7ffbe37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffbe4101420 0x7ffbe41996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:24.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.217+0000 7ffbe37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffbe4101420 0x7ffbe41996a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:60834/0 (socket says 172.21.15.2:60834) 2024-09-19T06:13:24.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.217+0000 7ffbe3fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbe4100a80 0x7ffbe4199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:24.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.217+0000 7ffbe37fe640 1 -- 172.21.15.2:0/948112825 learned_addr learned my addr 172.21.15.2:0/948112825 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:13:24.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.217+0000 7ffbe8d9a640 1 --2- 172.21.15.2:0/948112825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbe4106a80 0x7ffbe41a41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:24.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.217+0000 7ffbe37fe640 1 -- 172.21.15.2:0/948112825 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbe4100a80 msgr2=0x7ffbe4199160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:24.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.217+0000 7ffbe37fe640 1 --2- 172.21.15.2:0/948112825 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbe4100a80 0x7ffbe4199160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:24.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.217+0000 7ffbe37fe640 1 -- 172.21.15.2:0/948112825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbe4106a80 msgr2=0x7ffbe41a41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:24.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.217+0000 7ffbe37fe640 1 --2- 172.21.15.2:0/948112825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbe4106a80 0x7ffbe41a41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:24.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.217+0000 7ffbe37fe640 1 -- 172.21.15.2:0/948112825 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbe41a4720 con 0x7ffbe4101420 2024-09-19T06:13:24.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.217+0000 7ffbe37fe640 1 --2- 172.21.15.2:0/948112825 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffbe4101420 0x7ffbe41996a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ffbd800e9f0 tx=0x7ffbd800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:24.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.217+0000 7ffbe17fa640 1 -- 172.21.15.2:0/948112825 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd800cd80 con 0x7ffbe4101420 2024-09-19T06:13:24.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.217+0000 7ffbe17fa640 1 -- 172.21.15.2:0/948112825 <== mon.2 v2:172.21.15.89:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffbd80108e0 con 0x7ffbe4101420 2024-09-19T06:13:24.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.217+0000 7ffbea7fd640 1 -- 172.21.15.2:0/948112825 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbe41a48f0 con 0x7ffbe4101420 2024-09-19T06:13:24.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.217+0000 7ffbe17fa640 1 -- 172.21.15.2:0/948112825 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd8018920 con 0x7ffbe4101420 2024-09-19T06:13:24.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.217+0000 7ffbea7fd640 1 -- 172.21.15.2:0/948112825 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbe41a4e00 con 0x7ffbe4101420 2024-09-19T06:13:24.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.218+0000 7ffbea7fd640 1 -- 172.21.15.2:0/948112825 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbe4100ee0 con 0x7ffbe4101420 2024-09-19T06:13:24.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.220+0000 7ffbe17fa640 1 -- 172.21.15.2:0/948112825 <== mon.2 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7ffbd8010a90 con 0x7ffbe4101420 2024-09-19T06:13:24.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.220+0000 7ffbe17fa640 1 --2- 172.21.15.2:0/948112825 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7ffbcc0a32d0 0x7ffbcc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:24.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.220+0000 7ffbe3fff640 1 --2- 172.21.15.2:0/948112825 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7ffbcc0a32d0 0x7ffbcc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:24.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.220+0000 7ffbe17fa640 1 -- 172.21.15.2:0/948112825 <== mon.2 v2:172.21.15.89:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7ffbd80cfdc0 con 0x7ffbe4101420 2024-09-19T06:13:24.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.221+0000 7ffbe3fff640 1 --2- 172.21.15.2:0/948112825 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7ffbcc0a32d0 0x7ffbcc0a5790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4009b50 tx=0x7ffbd4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:24.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.225+0000 7ffbe17fa640 1 -- 172.21.15.2:0/948112825 <== mon.2 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ffbd809c2e0 con 0x7ffbe4101420 2024-09-19T06:13:24.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:23 smithi090 ceph-mon[34497]: pgmap v286: 97 pgs: 97 active+clean; 588 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 3.7 KiB/s wr, 12 op/s; 70 B/s, 0 objects/s recovering 2024-09-19T06:13:24.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:23 smithi090 ceph-mon[34497]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:13:24.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:23 smithi089 ceph-mon[34160]: pgmap v286: 97 pgs: 97 active+clean; 588 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 3.7 KiB/s wr, 12 op/s; 70 B/s, 0 objects/s recovering 2024-09-19T06:13:24.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:23 smithi089 ceph-mon[34160]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:13:24.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.427+0000 7ffbea7fd640 1 -- 172.21.15.2:0/948112825 --> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7ffbe4062630 con 0x7ffbcc0a32d0 2024-09-19T06:13:24.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.432+0000 7ffbe17fa640 1 -- 172.21.15.2:0/948112825 <== mgr.14150 v2:172.21.15.2:6800/4180340554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7ffbe4062630 con 0x7ffbcc0a32d0 2024-09-19T06:13:24.434 INFO:teuthology.orchestra.run.smithi002.stdout:/volumes/qa/sv_1/0fa06e47-8331-43a0-a80a-58d262c00a93 2024-09-19T06:13:24.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.434+0000 7ffbea7fd640 1 -- 172.21.15.2:0/948112825 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7ffbcc0a32d0 msgr2=0x7ffbcc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:24.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.434+0000 7ffbea7fd640 1 --2- 172.21.15.2:0/948112825 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7ffbcc0a32d0 0x7ffbcc0a5790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4009b50 tx=0x7ffbd4005f90 comp rx=0 tx=0).stop 2024-09-19T06:13:24.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.434+0000 7ffbea7fd640 1 -- 172.21.15.2:0/948112825 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffbe4101420 msgr2=0x7ffbe41996a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:24.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.434+0000 7ffbea7fd640 1 --2- 172.21.15.2:0/948112825 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffbe4101420 0x7ffbe41996a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ffbd800e9f0 tx=0x7ffbd800eeb0 comp rx=0 tx=0).stop 2024-09-19T06:13:24.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.434+0000 7ffbea7fd640 1 -- 172.21.15.2:0/948112825 shutdown_connections 2024-09-19T06:13:24.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.434+0000 7ffbea7fd640 1 --2- 172.21.15.2:0/948112825 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7ffbcc0a32d0 0x7ffbcc0a5790 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:24.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.434+0000 7ffbea7fd640 1 --2- 172.21.15.2:0/948112825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbe4106a80 0x7ffbe41a41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:24.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.434+0000 7ffbea7fd640 1 --2- 172.21.15.2:0/948112825 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffbe4101420 0x7ffbe41996a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:24.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.434+0000 7ffbea7fd640 1 --2- 172.21.15.2:0/948112825 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbe4100a80 0x7ffbe4199160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:24.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.434+0000 7ffbea7fd640 1 -- 172.21.15.2:0/948112825 >> 172.21.15.2:0/948112825 conn(0x7ffbe40fc7a0 msgr2=0x7ffbe40fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:24.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.434+0000 7ffbea7fd640 1 -- 172.21.15.2:0/948112825 shutdown_connections 2024-09-19T06:13:24.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:24.434+0000 7ffbea7fd640 1 -- 172.21.15.2:0/948112825 wait complete. 2024-09-19T06:13:25.176 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:13:25.440 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:25.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:25.876+0000 7f720cb50640 1 -- 172.21.15.2:0/1896664955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7208100a70 msgr2=0x7f720810ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:25.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:25.876+0000 7f720cb50640 1 --2- 172.21.15.2:0/1896664955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7208100a70 0x7f720810ea60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7200009ca0 tx=0x7f720002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:13:25.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:25.876+0000 7f720cb50640 1 -- 172.21.15.2:0/1896664955 shutdown_connections 2024-09-19T06:13:25.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:25.876+0000 7f720cb50640 1 --2- 172.21.15.2:0/1896664955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7208100a70 0x7f720810ea60 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:25.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:25.876+0000 7f720cb50640 1 --2- 172.21.15.2:0/1896664955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72081000d0 0x7f7208100530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:25.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:25.876+0000 7f720cb50640 1 --2- 172.21.15.2:0/1896664955 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7208106ba0 0x7f7208106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:25.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:25.876+0000 7f720cb50640 1 -- 172.21.15.2:0/1896664955 >> 172.21.15.2:0/1896664955 conn(0x7f7208077210 msgr2=0x7f72080fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:25.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:25.876+0000 7f720cb50640 1 -- 172.21.15.2:0/1896664955 shutdown_connections 2024-09-19T06:13:25.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:25.876+0000 7f720cb50640 1 -- 172.21.15.2:0/1896664955 wait complete. 2024-09-19T06:13:25.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:25.877+0000 7f720cb50640 1 Processor -- start 2024-09-19T06:13:25.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:25.877+0000 7f720cb50640 1 -- start start 2024-09-19T06:13:25.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:25.877+0000 7f720cb50640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72081000d0 0x7f7208198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:25.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:25.877+0000 7f720cb50640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7208100a70 0x7f72081989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:25.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:25.877+0000 7f720cb50640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7208106ba0 0x7f720819cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:25.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:25.877+0000 7f720cb50640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7208111f60 con 0x7f7208100a70 2024-09-19T06:13:25.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:25.877+0000 7f720cb50640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7208111de0 con 0x7f7208106ba0 2024-09-19T06:13:25.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:25.877+0000 7f720cb50640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f72081120e0 con 0x7f72081000d0 2024-09-19T06:13:25.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:25.878+0000 7f7205d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7208100a70 0x7f72081989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:25.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:25.878+0000 7f7205d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7208100a70 0x7f72081989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35018/0 (socket says 172.21.15.2:35018) 2024-09-19T06:13:25.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:25.878+0000 7f7205d9b640 1 -- 172.21.15.2:0/326390097 learned_addr learned my addr 172.21.15.2:0/326390097 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:13:25.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:25.878+0000 7f720659c640 1 --2- 172.21.15.2:0/326390097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72081000d0 0x7f7208198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:25.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:25.878+0000 7f7206d9d640 1 --2- 172.21.15.2:0/326390097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7208106ba0 0x7f720819cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:25.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:25.878+0000 7f7205d9b640 1 -- 172.21.15.2:0/326390097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72081000d0 msgr2=0x7f7208198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:25.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:25.878+0000 7f7205d9b640 1 --2- 172.21.15.2:0/326390097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72081000d0 0x7f7208198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:25.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:25.878+0000 7f7205d9b640 1 -- 172.21.15.2:0/326390097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7208106ba0 msgr2=0x7f720819cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:25.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:25.878+0000 7f7205d9b640 1 --2- 172.21.15.2:0/326390097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7208106ba0 0x7f720819cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:25.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:25.878+0000 7f7205d9b640 1 -- 172.21.15.2:0/326390097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f720819d430 con 0x7f7208100a70 2024-09-19T06:13:25.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:25.878+0000 7f7205d9b640 1 --2- 172.21.15.2:0/326390097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7208100a70 0x7f72081989c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f71fc00d950 tx=0x7f71fc00dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:25.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:25.878+0000 7f71f77fe640 1 -- 172.21.15.2:0/326390097 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71fc017070 con 0x7f7208100a70 2024-09-19T06:13:25.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:25.878+0000 7f71f77fe640 1 -- 172.21.15.2:0/326390097 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f71fc00de80 con 0x7f7208100a70 2024-09-19T06:13:25.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:25.878+0000 7f720cb50640 1 -- 172.21.15.2:0/326390097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f720819d720 con 0x7f7208100a70 2024-09-19T06:13:25.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:25.878+0000 7f71f77fe640 1 -- 172.21.15.2:0/326390097 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71fc00f620 con 0x7f7208100a70 2024-09-19T06:13:25.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:25.879+0000 7f720cb50640 1 -- 172.21.15.2:0/326390097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72081a5000 con 0x7f7208100a70 2024-09-19T06:13:25.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:25.879+0000 7f720cb50640 1 -- 172.21.15.2:0/326390097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7208100530 con 0x7f7208100a70 2024-09-19T06:13:25.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:25.881+0000 7f71f77fe640 1 -- 172.21.15.2:0/326390097 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f71fc009c30 con 0x7f7208100a70 2024-09-19T06:13:25.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:25.881+0000 7f71f77fe640 1 --2- 172.21.15.2:0/326390097 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f71f00a32d0 0x7f71f00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:25.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:25.882+0000 7f720659c640 1 --2- 172.21.15.2:0/326390097 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f71f00a32d0 0x7f71f00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:25.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:25.882+0000 7f71f77fe640 1 -- 172.21.15.2:0/326390097 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f71fc0cf6c0 con 0x7f7208100a70 2024-09-19T06:13:25.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:25.882+0000 7f720659c640 1 --2- 172.21.15.2:0/326390097 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f71f00a32d0 0x7f71f00a5790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f71f8009990 tx=0x7f71f8009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:25.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:25.886+0000 7f71f77fe640 1 -- 172.21.15.2:0/326390097 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f71fc09c230 con 0x7f7208100a70 2024-09-19T06:13:26.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:26.099+0000 7f720cb50640 1 -- 172.21.15.2:0/326390097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7208109b00 con 0x7f7208100a70 2024-09-19T06:13:26.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:26.100+0000 7f71f77fe640 1 -- 172.21.15.2:0/326390097 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11882 (secure 0 0 0) 0x7f71fc09bb30 con 0x7f7208100a70 2024-09-19T06:13:26.102 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:13:26.102 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":25,"btime":"2024-09-19T06:13:17:867959+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:13:17.867946+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24472,24470]},"id":1}]} 2024-09-19T06:13:26.102 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 25 2024-09-19T06:13:26.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:26.102+0000 7f720cb50640 1 -- 172.21.15.2:0/326390097 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f71f00a32d0 msgr2=0x7f71f00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:26.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:26.102+0000 7f720cb50640 1 --2- 172.21.15.2:0/326390097 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f71f00a32d0 0x7f71f00a5790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f71f8009990 tx=0x7f71f8009110 comp rx=0 tx=0).stop 2024-09-19T06:13:26.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:26.102+0000 7f720cb50640 1 -- 172.21.15.2:0/326390097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7208100a70 msgr2=0x7f72081989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:26.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:26.102+0000 7f720cb50640 1 --2- 172.21.15.2:0/326390097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7208100a70 0x7f72081989c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f71fc00d950 tx=0x7f71fc00dd50 comp rx=0 tx=0).stop 2024-09-19T06:13:26.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:26.102+0000 7f720cb50640 1 -- 172.21.15.2:0/326390097 shutdown_connections 2024-09-19T06:13:26.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:26.102+0000 7f720cb50640 1 --2- 172.21.15.2:0/326390097 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f71f00a32d0 0x7f71f00a5790 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:26.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:26.102+0000 7f720cb50640 1 --2- 172.21.15.2:0/326390097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7208106ba0 0x7f720819cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:26.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:26.102+0000 7f720cb50640 1 --2- 172.21.15.2:0/326390097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7208100a70 0x7f72081989c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:26.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:26.102+0000 7f720cb50640 1 --2- 172.21.15.2:0/326390097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72081000d0 0x7f7208198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:26.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:26.102+0000 7f720cb50640 1 -- 172.21.15.2:0/326390097 >> 172.21.15.2:0/326390097 conn(0x7f7208077210 msgr2=0x7f7208104c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:26.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:26.102+0000 7f720cb50640 1 -- 172.21.15.2:0/326390097 shutdown_connections 2024-09-19T06:13:26.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:26.102+0000 7f720cb50640 1 -- 172.21.15.2:0/326390097 wait complete. 2024-09-19T06:13:26.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:25 smithi002 ceph-mon[30982]: pgmap v287: 97 pgs: 97 active+clean; 626 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 7.1 KiB/s wr, 11 op/s; 63 B/s, 0 objects/s recovering 2024-09-19T06:13:26.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:25 smithi002 ceph-mon[30982]: from='client.24575 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:13:26.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:25 smithi090 ceph-mon[34497]: pgmap v287: 97 pgs: 97 active+clean; 626 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 7.1 KiB/s wr, 11 op/s; 63 B/s, 0 objects/s recovering 2024-09-19T06:13:26.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:25 smithi090 ceph-mon[34497]: from='client.24575 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:13:26.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:25 smithi089 ceph-mon[34160]: pgmap v287: 97 pgs: 97 active+clean; 626 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 7.1 KiB/s wr, 11 op/s; 63 B/s, 0 objects/s recovering 2024-09-19T06:13:26.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:25 smithi089 ceph-mon[34160]: from='client.24575 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:13:26.854 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:13:27.111 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:27.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:26 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/326390097' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:13:27.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:26 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/326390097' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:13:27.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:26 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/326390097' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:13:27.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.598+0000 7fbee3bbc640 1 -- 172.21.15.2:0/2196980199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbedc100a80 msgr2=0x7fbedc100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:27.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.598+0000 7fbee3bbc640 1 --2- 172.21.15.2:0/2196980199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbedc100a80 0x7fbedc100ee0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009930 tx=0x7fbecc02a420 comp rx=0 tx=0).stop 2024-09-19T06:13:27.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.598+0000 7fbee3bbc640 1 -- 172.21.15.2:0/2196980199 shutdown_connections 2024-09-19T06:13:27.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.598+0000 7fbee3bbc640 1 --2- 172.21.15.2:0/2196980199 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbedc101420 0x7fbedc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.598+0000 7fbee3bbc640 1 --2- 172.21.15.2:0/2196980199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbedc100a80 0x7fbedc100ee0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.598+0000 7fbee3bbc640 1 --2- 172.21.15.2:0/2196980199 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbedc106a80 0x7fbedc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.598+0000 7fbee3bbc640 1 -- 172.21.15.2:0/2196980199 >> 172.21.15.2:0/2196980199 conn(0x7fbedc0fc7a0 msgr2=0x7fbedc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:27.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.598+0000 7fbee3bbc640 1 -- 172.21.15.2:0/2196980199 shutdown_connections 2024-09-19T06:13:27.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.598+0000 7fbee3bbc640 1 -- 172.21.15.2:0/2196980199 wait complete. 2024-09-19T06:13:27.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.599+0000 7fbee3bbc640 1 Processor -- start 2024-09-19T06:13:27.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.599+0000 7fbee3bbc640 1 -- start start 2024-09-19T06:13:27.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.599+0000 7fbee3bbc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbedc100a80 0x7fbedc0fce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:27.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.599+0000 7fbee3bbc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbedc101420 0x7fbedc0fd370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:27.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.599+0000 7fbee3bbc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbedc106a80 0x7fbedc0fd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:27.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.599+0000 7fbee3bbc640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbedc110d30 con 0x7fbedc101420 2024-09-19T06:13:27.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.599+0000 7fbee3bbc640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fbedc110bb0 con 0x7fbedc100a80 2024-09-19T06:13:27.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.599+0000 7fbee3bbc640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbedc110eb0 con 0x7fbedc106a80 2024-09-19T06:13:27.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.599+0000 7fbee1157640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbedc101420 0x7fbedc0fd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:27.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.599+0000 7fbee1157640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbedc101420 0x7fbedc0fd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35038/0 (socket says 172.21.15.2:35038) 2024-09-19T06:13:27.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.599+0000 7fbee1157640 1 -- 172.21.15.2:0/158622504 learned_addr learned my addr 172.21.15.2:0/158622504 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:13:27.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.599+0000 7fbee1958640 1 --2- 172.21.15.2:0/158622504 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbedc100a80 0x7fbedc0fce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:27.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.599+0000 7fbee2159640 1 --2- 172.21.15.2:0/158622504 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbedc106a80 0x7fbedc0fd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:27.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.600+0000 7fbee1157640 1 -- 172.21.15.2:0/158622504 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbedc106a80 msgr2=0x7fbedc0fd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:27.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.600+0000 7fbee1157640 1 --2- 172.21.15.2:0/158622504 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbedc106a80 0x7fbedc0fd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.600+0000 7fbee1157640 1 -- 172.21.15.2:0/158622504 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbedc100a80 msgr2=0x7fbedc0fce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:27.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.600+0000 7fbee1157640 1 --2- 172.21.15.2:0/158622504 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbedc100a80 0x7fbedc0fce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.600+0000 7fbee1157640 1 -- 172.21.15.2:0/158622504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbedc1a6810 con 0x7fbedc101420 2024-09-19T06:13:27.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.600+0000 7fbee1157640 1 --2- 172.21.15.2:0/158622504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbedc101420 0x7fbedc0fd370 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbecc005940 tx=0x7fbecc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:27.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.600+0000 7fbed2ffd640 1 -- 172.21.15.2:0/158622504 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbecc03f030 con 0x7fbedc101420 2024-09-19T06:13:27.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.600+0000 7fbed2ffd640 1 -- 172.21.15.2:0/158622504 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbecc003cb0 con 0x7fbedc101420 2024-09-19T06:13:27.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.600+0000 7fbee3bbc640 1 -- 172.21.15.2:0/158622504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbedc1a6aa0 con 0x7fbedc101420 2024-09-19T06:13:27.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.600+0000 7fbed2ffd640 1 -- 172.21.15.2:0/158622504 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbecc035070 con 0x7fbedc101420 2024-09-19T06:13:27.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.600+0000 7fbee3bbc640 1 -- 172.21.15.2:0/158622504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbedc1a6f80 con 0x7fbedc101420 2024-09-19T06:13:27.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.601+0000 7fbee3bbc640 1 -- 172.21.15.2:0/158622504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbedc100ee0 con 0x7fbedc101420 2024-09-19T06:13:27.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.602+0000 7fbed2ffd640 1 -- 172.21.15.2:0/158622504 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fbecc042030 con 0x7fbedc101420 2024-09-19T06:13:27.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.603+0000 7fbed2ffd640 1 --2- 172.21.15.2:0/158622504 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fbec80a32d0 0x7fbec80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:27.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.603+0000 7fbed2ffd640 1 -- 172.21.15.2:0/158622504 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7fbecc0eff70 con 0x7fbedc101420 2024-09-19T06:13:27.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.603+0000 7fbee1958640 1 --2- 172.21.15.2:0/158622504 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fbec80a32d0 0x7fbec80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:27.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.603+0000 7fbee1958640 1 --2- 172.21.15.2:0/158622504 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fbec80a32d0 0x7fbec80a5790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbed80058c0 tx=0x7fbed800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:27.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.607+0000 7fbed2ffd640 1 -- 172.21.15.2:0/158622504 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbecc0bc4f0 con 0x7fbedc101420 2024-09-19T06:13:27.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.787+0000 7fbee3bbc640 1 -- 172.21.15.2:0/158622504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbedc10a000 con 0x7fbedc101420 2024-09-19T06:13:27.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.789+0000 7fbed2ffd640 1 -- 172.21.15.2:0/158622504 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22577 (secure 0 0 0) 0x7fbecc0c07f0 con 0x7fbedc101420 2024-09-19T06:13:27.791 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:13:27.791 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":81,"fsid":"078f6612-764d-11ef-bceb-c7b262605968","created":"2024-09-19T06:05:17.607927+0000","modified":"2024-09-19T06:13:13.827600+0000","last_up_change":"2024-09-19T06:12:13.856684+0000","last_in_change":"2024-09-19T06:11:49.745266+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:08:28.425566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:13:00.482789+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:13:02.768221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0de97a3d-2d27-455b-9998-ddd2319c148d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6803","nonce":915165910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6805","nonce":915165910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6809","nonce":915165910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6807","nonce":915165910}]},"public_addr":"172.21.15.2:6803/915165910","cluster_addr":"172.21.15.2:6805/915165910","heartbeat_back_addr":"172.21.15.2:6809/915165910","heartbeat_front_addr":"172.21.15.2:6807/915165910","state":["exists","up"]},{"osd":1,"uuid":"056d229e-2de4-4902-922e-21e1a5d3f061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6801","nonce":4097264171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6803","nonce":4097264171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6807","nonce":4097264171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6805","nonce":4097264171}]},"public_addr":"172.21.15.89:6801/4097264171","cluster_addr":"172.21.15.89:6803/4097264171","heartbeat_back_addr":"172.21.15.89:6807/4097264171","heartbeat_front_addr":"172.21.15.89:6805/4097264171","state":["exists","up"]},{"osd":2,"uuid":"2a4e7147-4125-4ee6-b5ad-85518d7066d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6801","nonce":1479908200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6803","nonce":1479908200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6807","nonce":1479908200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6805","nonce":1479908200}]},"public_addr":"172.21.15.90:6801/1479908200","cluster_addr":"172.21.15.90:6803/1479908200","heartbeat_back_addr":"172.21.15.90:6807/1479908200","heartbeat_front_addr":"172.21.15.90:6805/1479908200","state":["exists","up"]},{"osd":3,"uuid":"7b3da775-0f0a-4b46-a8dc-9ec822a54301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6811","nonce":1796948193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6813","nonce":1796948193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6817","nonce":1796948193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6815","nonce":1796948193}]},"public_addr":"172.21.15.2:6811/1796948193","cluster_addr":"172.21.15.2:6813/1796948193","heartbeat_back_addr":"172.21.15.2:6817/1796948193","heartbeat_front_addr":"172.21.15.2:6815/1796948193","state":["exists","up"]},{"osd":4,"uuid":"d4c8bafc-c844-4ff1-a3d8-7a53576e6b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6809","nonce":4256848315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6811","nonce":4256848315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6815","nonce":4256848315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6813","nonce":4256848315}]},"public_addr":"172.21.15.89:6809/4256848315","cluster_addr":"172.21.15.89:6811/4256848315","heartbeat_back_addr":"172.21.15.89:6815/4256848315","heartbeat_front_addr":"172.21.15.89:6813/4256848315","state":["exists","up"]},{"osd":5,"uuid":"8dc9bb55-29e0-4b04-9415-3b9bb5ed05cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6809","nonce":189855967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6811","nonce":189855967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6815","nonce":189855967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6813","nonce":189855967}]},"public_addr":"172.21.15.90:6809/189855967","cluster_addr":"172.21.15.90:6811/189855967","heartbeat_back_addr":"172.21.15.90:6815/189855967","heartbeat_front_addr":"172.21.15.90:6813/189855967","state":["exists","up"]},{"osd":6,"uuid":"86d1443a-9b43-46de-abd7-4c95b43207f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6819","nonce":3886336279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6821","nonce":3886336279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6825","nonce":3886336279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6823","nonce":3886336279}]},"public_addr":"172.21.15.2:6819/3886336279","cluster_addr":"172.21.15.2:6821/3886336279","heartbeat_back_addr":"172.21.15.2:6825/3886336279","heartbeat_front_addr":"172.21.15.2:6823/3886336279","state":["exists","up"]},{"osd":7,"uuid":"1cc5554c-80d2-4e77-b29a-fd2ada68d82d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6817","nonce":508513510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6819","nonce":508513510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6823","nonce":508513510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6821","nonce":508513510}]},"public_addr":"172.21.15.89:6817/508513510","cluster_addr":"172.21.15.89:6819/508513510","heartbeat_back_addr":"172.21.15.89:6823/508513510","heartbeat_front_addr":"172.21.15.89:6821/508513510","state":["exists","up"]},{"osd":8,"uuid":"e9b2eb92-9af2-4f26-a259-fcaf972e4fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6817","nonce":3558544480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6819","nonce":3558544480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6823","nonce":3558544480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6821","nonce":3558544480}]},"public_addr":"172.21.15.90:6817/3558544480","cluster_addr":"172.21.15.90:6819/3558544480","heartbeat_back_addr":"172.21.15.90:6823/3558544480","heartbeat_front_addr":"172.21.15.90:6821/3558544480","state":["exists","up"]},{"osd":9,"uuid":"194d4c64-dd29-4d35-bc54-0858c44815cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6827","nonce":2690758100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6829","nonce":2690758100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6833","nonce":2690758100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6831","nonce":2690758100}]},"public_addr":"172.21.15.2:6827/2690758100","cluster_addr":"172.21.15.2:6829/2690758100","heartbeat_back_addr":"172.21.15.2:6833/2690758100","heartbeat_front_addr":"172.21.15.2:6831/2690758100","state":["exists","up"]},{"osd":10,"uuid":"7695fa4a-b94e-4afc-b166-690a197ad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6825","nonce":1141925395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6827","nonce":1141925395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6831","nonce":1141925395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6829","nonce":1141925395}]},"public_addr":"172.21.15.89:6825/1141925395","cluster_addr":"172.21.15.89:6827/1141925395","heartbeat_back_addr":"172.21.15.89:6831/1141925395","heartbeat_front_addr":"172.21.15.89:6829/1141925395","state":["exists","up"]},{"osd":11,"uuid":"1815a999-bfdb-46b9-afcd-632ee8ba56d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6825","nonce":468380924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6827","nonce":468380924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6831","nonce":468380924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6829","nonce":468380924}]},"public_addr":"172.21.15.90:6825/468380924","cluster_addr":"172.21.15.90:6827/468380924","heartbeat_back_addr":"172.21.15.90:6831/468380924","heartbeat_front_addr":"172.21.15.90:6829/468380924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:07:36.125754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:01.415356+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:26.420808+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:51.722673+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:09:16.562300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:09:41.958465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:10:07.056167+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:10:32.066195+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:10:56.497875+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:11:21.973083+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:11:46.891515+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:12:11.910012+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9},{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/874985787":"2024-09-20T06:06:11.912585+0000","172.21.15.2:0/1280963020":"2024-09-20T06:06:11.912585+0000","172.21.15.2:0/2976372536":"2024-09-20T06:06:11.912585+0000","172.21.15.2:6801/1602650352":"2024-09-20T06:05:47.538477+0000","172.21.15.2:6800/1602650352":"2024-09-20T06:05:47.538477+0000","172.21.15.2:6800/1200011821":"2024-09-20T06:06:11.912585+0000","172.21.15.2:0/3899165140":"2024-09-20T06:05:47.538477+0000","172.21.15.2:6801/1200011821":"2024-09-20T06:06:11.912585+0000","172.21.15.2:0/1361067708":"2024-09-20T06:05:47.538477+0000","172.21.15.2:0/3763089457":"2024-09-20T06:05:47.538477+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:13:27.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.791+0000 7fbee3bbc640 1 -- 172.21.15.2:0/158622504 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fbec80a32d0 msgr2=0x7fbec80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:27.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.791+0000 7fbee3bbc640 1 --2- 172.21.15.2:0/158622504 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fbec80a32d0 0x7fbec80a5790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbed80058c0 tx=0x7fbed800a2d0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.791+0000 7fbee3bbc640 1 -- 172.21.15.2:0/158622504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbedc101420 msgr2=0x7fbedc0fd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:27.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.791+0000 7fbee3bbc640 1 --2- 172.21.15.2:0/158622504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbedc101420 0x7fbedc0fd370 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbecc005940 tx=0x7fbecc0042f0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.791+0000 7fbee3bbc640 1 -- 172.21.15.2:0/158622504 shutdown_connections 2024-09-19T06:13:27.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.792+0000 7fbee3bbc640 1 --2- 172.21.15.2:0/158622504 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fbec80a32d0 0x7fbec80a5790 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.792+0000 7fbee3bbc640 1 --2- 172.21.15.2:0/158622504 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbedc106a80 0x7fbedc0fd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.792+0000 7fbee3bbc640 1 --2- 172.21.15.2:0/158622504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbedc101420 0x7fbedc0fd370 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.792+0000 7fbee3bbc640 1 --2- 172.21.15.2:0/158622504 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbedc100a80 0x7fbedc0fce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.792+0000 7fbee3bbc640 1 -- 172.21.15.2:0/158622504 >> 172.21.15.2:0/158622504 conn(0x7fbedc0fc7a0 msgr2=0x7fbedc06aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:27.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.792+0000 7fbee3bbc640 1 -- 172.21.15.2:0/158622504 shutdown_connections 2024-09-19T06:13:27.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:27.792+0000 7fbee3bbc640 1 -- 172.21.15.2:0/158622504 wait complete. 2024-09-19T06:13:28.164 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:27 smithi002 ceph-mon[30982]: pgmap v288: 97 pgs: 97 active+clean; 626 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 KiB/s wr, 8 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T06:13:28.165 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:27 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/158622504' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:13:28.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:27 smithi090 ceph-mon[34497]: pgmap v288: 97 pgs: 97 active+clean; 626 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 KiB/s wr, 8 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T06:13:28.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:27 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/158622504' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:13:28.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:27 smithi089 ceph-mon[34160]: pgmap v288: 97 pgs: 97 active+clean; 626 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.7 KiB/s wr, 8 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T06:13:28.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:27 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/158622504' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:13:28.534 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T06:13:28.535 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T06:13:28.796 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:29.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.264+0000 7f9c3d1ad640 1 -- 172.21.15.2:0/2242108246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c38101420 msgr2=0x7f9c3810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:29.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.264+0000 7f9c3d1ad640 1 --2- 172.21.15.2:0/2242108246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c38101420 0x7f9c3810d950 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9c30009cd0 tx=0x7f9c3002a8e0 comp rx=0 tx=0).stop 2024-09-19T06:13:29.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.264+0000 7f9c3d1ad640 1 -- 172.21.15.2:0/2242108246 shutdown_connections 2024-09-19T06:13:29.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.264+0000 7f9c3d1ad640 1 --2- 172.21.15.2:0/2242108246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c38101420 0x7f9c3810d950 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:29.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.264+0000 7f9c3d1ad640 1 --2- 172.21.15.2:0/2242108246 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c38100a80 0x7f9c38100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:29.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.264+0000 7f9c3d1ad640 1 --2- 172.21.15.2:0/2242108246 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c38106a80 0x7f9c38106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:29.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.264+0000 7f9c3d1ad640 1 -- 172.21.15.2:0/2242108246 >> 172.21.15.2:0/2242108246 conn(0x7f9c380fc7a0 msgr2=0x7f9c380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:29.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.264+0000 7f9c3d1ad640 1 -- 172.21.15.2:0/2242108246 shutdown_connections 2024-09-19T06:13:29.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.264+0000 7f9c3d1ad640 1 -- 172.21.15.2:0/2242108246 wait complete. 2024-09-19T06:13:29.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.265+0000 7f9c3d1ad640 1 Processor -- start 2024-09-19T06:13:29.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.265+0000 7f9c3d1ad640 1 -- start start 2024-09-19T06:13:29.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.265+0000 7f9c3d1ad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c38100a80 0x7f9c3819a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:29.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.265+0000 7f9c3d1ad640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c38101420 0x7f9c3819aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:29.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.265+0000 7f9c3d1ad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c38106a80 0x7f9c3819ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:29.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.265+0000 7f9c3d1ad640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9c38110d30 con 0x7f9c38100a80 2024-09-19T06:13:29.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.265+0000 7f9c3d1ad640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9c38110bb0 con 0x7f9c38106a80 2024-09-19T06:13:29.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.265+0000 7f9c3d1ad640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9c38110eb0 con 0x7f9c38101420 2024-09-19T06:13:29.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.265+0000 7f9c36d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c38100a80 0x7f9c3819a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:29.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.265+0000 7f9c36d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c38100a80 0x7f9c3819a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35052/0 (socket says 172.21.15.2:35052) 2024-09-19T06:13:29.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.265+0000 7f9c36d9d640 1 -- 172.21.15.2:0/2895140514 learned_addr learned my addr 172.21.15.2:0/2895140514 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:13:29.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.266+0000 7f9c3659c640 1 --2- 172.21.15.2:0/2895140514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c38101420 0x7f9c3819aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:29.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.266+0000 7f9c3759e640 1 --2- 172.21.15.2:0/2895140514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c38106a80 0x7f9c3819ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:29.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.266+0000 7f9c36d9d640 1 -- 172.21.15.2:0/2895140514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c38101420 msgr2=0x7f9c3819aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:29.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.266+0000 7f9c36d9d640 1 --2- 172.21.15.2:0/2895140514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c38101420 0x7f9c3819aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:29.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.266+0000 7f9c36d9d640 1 -- 172.21.15.2:0/2895140514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c38106a80 msgr2=0x7f9c3819ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:29.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.266+0000 7f9c36d9d640 1 --2- 172.21.15.2:0/2895140514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c38106a80 0x7f9c3819ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:29.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.266+0000 7f9c36d9d640 1 -- 172.21.15.2:0/2895140514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c3819f520 con 0x7f9c38100a80 2024-09-19T06:13:29.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.266+0000 7f9c3759e640 1 --2- 172.21.15.2:0/2895140514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c38106a80 0x7f9c3819ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:13:29.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.266+0000 7f9c3659c640 1 --2- 172.21.15.2:0/2895140514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c38101420 0x7f9c3819aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:13:29.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.266+0000 7f9c36d9d640 1 --2- 172.21.15.2:0/2895140514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c38100a80 0x7f9c3819a570 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9c2800d950 tx=0x7f9c2800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:29.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.266+0000 7f9c1ffff640 1 -- 172.21.15.2:0/2895140514 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c28017070 con 0x7f9c38100a80 2024-09-19T06:13:29.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.266+0000 7f9c3d1ad640 1 -- 172.21.15.2:0/2895140514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c3819f810 con 0x7f9c38100a80 2024-09-19T06:13:29.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.266+0000 7f9c1ffff640 1 -- 172.21.15.2:0/2895140514 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9c28009c30 con 0x7f9c38100a80 2024-09-19T06:13:29.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.266+0000 7f9c1ffff640 1 -- 172.21.15.2:0/2895140514 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c2800f620 con 0x7f9c38100a80 2024-09-19T06:13:29.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.266+0000 7f9c3d1ad640 1 -- 172.21.15.2:0/2895140514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c381a70f0 con 0x7f9c38100a80 2024-09-19T06:13:29.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.267+0000 7f9c3d1ad640 1 -- 172.21.15.2:0/2895140514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c38100ee0 con 0x7f9c38100a80 2024-09-19T06:13:29.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.268+0000 7f9c1ffff640 1 -- 172.21.15.2:0/2895140514 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f9c280109a0 con 0x7f9c38100a80 2024-09-19T06:13:29.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.269+0000 7f9c1ffff640 1 --2- 172.21.15.2:0/2895140514 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f9c200a32d0 0x7f9c200a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:29.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.269+0000 7f9c3659c640 1 --2- 172.21.15.2:0/2895140514 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f9c200a32d0 0x7f9c200a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:29.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.269+0000 7f9c1ffff640 1 -- 172.21.15.2:0/2895140514 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f9c280cf700 con 0x7f9c38100a80 2024-09-19T06:13:29.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.270+0000 7f9c3659c640 1 --2- 172.21.15.2:0/2895140514 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f9c200a32d0 0x7f9c200a5790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9c380ff270 tx=0x7f9c2c00b5f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:29.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.272+0000 7f9c1ffff640 1 -- 172.21.15.2:0/2895140514 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9c28009de0 con 0x7f9c38100a80 2024-09-19T06:13:29.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.444+0000 7f9c3d1ad640 1 -- 172.21.15.2:0/2895140514 --> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9c3810cd00 con 0x7f9c200a32d0 2024-09-19T06:13:29.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.452+0000 7f9c1ffff640 1 -- 172.21.15.2:0/2895140514 <== mgr.14150 v2:172.21.15.2:6800/4180340554 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258696 (secure 0 0 0) 0x7f9c3810cd00 con 0x7f9c200a32d0 2024-09-19T06:13:29.457 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:13:29.458 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-19T06:13:29.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.455+0000 7f9c3d1ad640 1 -- 172.21.15.2:0/2895140514 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f9c200a32d0 msgr2=0x7f9c200a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:29.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.455+0000 7f9c3d1ad640 1 --2- 172.21.15.2:0/2895140514 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f9c200a32d0 0x7f9c200a5790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9c380ff270 tx=0x7f9c2c00b5f0 comp rx=0 tx=0).stop 2024-09-19T06:13:29.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.455+0000 7f9c3d1ad640 1 -- 172.21.15.2:0/2895140514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c38100a80 msgr2=0x7f9c3819a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:29.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.455+0000 7f9c3d1ad640 1 --2- 172.21.15.2:0/2895140514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c38100a80 0x7f9c3819a570 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9c2800d950 tx=0x7f9c2800de10 comp rx=0 tx=0).stop 2024-09-19T06:13:29.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.455+0000 7f9c3d1ad640 1 -- 172.21.15.2:0/2895140514 shutdown_connections 2024-09-19T06:13:29.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.455+0000 7f9c3d1ad640 1 --2- 172.21.15.2:0/2895140514 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f9c200a32d0 0x7f9c200a5790 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:29.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.455+0000 7f9c3d1ad640 1 --2- 172.21.15.2:0/2895140514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c38106a80 0x7f9c3819ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:29.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.455+0000 7f9c3d1ad640 1 --2- 172.21.15.2:0/2895140514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c38101420 0x7f9c3819aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:29.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.455+0000 7f9c3d1ad640 1 --2- 172.21.15.2:0/2895140514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c38100a80 0x7f9c3819a570 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:29.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.455+0000 7f9c3d1ad640 1 -- 172.21.15.2:0/2895140514 >> 172.21.15.2:0/2895140514 conn(0x7f9c380fc7a0 msgr2=0x7f9c3806a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:29.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.455+0000 7f9c3d1ad640 1 -- 172.21.15.2:0/2895140514 shutdown_connections 2024-09-19T06:13:29.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:29.455+0000 7f9c3d1ad640 1 -- 172.21.15.2:0/2895140514 wait complete. 2024-09-19T06:13:30.089 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:29 smithi002 ceph-mon[30982]: pgmap v289: 97 pgs: 97 active+clean; 626 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.6 KiB/s wr, 7 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T06:13:30.119 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":289,"stamp":"2024-09-19T06:13:28.006276+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":641014,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":197,"num_read_kb":199,"num_write":330,"num_write_kb":3031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1181380,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":266,"ondisk_log_size":266,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369904,"kb_used_data":12312,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124571920,"statfs":{"total":1151940427776,"available":1151561646080,"internally_reserved":0,"allocated":12607488,"data_stored":7028258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":45424,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":61,"num_read_kb":80,"num_write":26,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002451"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.833979+0000","last_change":"2024-09-19T06:13:03.799398+0000","last_active":"2024-09-19T06:13:13.833979+0000","last_peered":"2024-09-19T06:13:13.833979+0000","last_clean":"2024-09-19T06:13:13.833979+0000","last_became_active":"2024-09-19T06:13:03.799027+0000","last_became_peered":"2024-09-19T06:13:03.799027+0000","last_unstale":"2024-09-19T06:13:13.833979+0000","last_undegraded":"2024-09-19T06:13:13.833979+0000","last_fullsized":"2024-09-19T06:13:13.833979+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:35:45.934040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834912+0000","last_change":"2024-09-19T06:13:03.791878+0000","last_active":"2024-09-19T06:13:13.834912+0000","last_peered":"2024-09-19T06:13:13.834912+0000","last_clean":"2024-09-19T06:13:13.834912+0000","last_became_active":"2024-09-19T06:13:03.791637+0000","last_became_peered":"2024-09-19T06:13:03.791637+0000","last_unstale":"2024-09-19T06:13:13.834912+0000","last_undegraded":"2024-09-19T06:13:13.834912+0000","last_fullsized":"2024-09-19T06:13:13.834912+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:00.078010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834885+0000","last_change":"2024-09-19T06:13:03.798969+0000","last_active":"2024-09-19T06:13:13.834885+0000","last_peered":"2024-09-19T06:13:13.834885+0000","last_clean":"2024-09-19T06:13:13.834885+0000","last_became_active":"2024-09-19T06:13:03.798410+0000","last_became_peered":"2024-09-19T06:13:03.798410+0000","last_unstale":"2024-09-19T06:13:13.834885+0000","last_undegraded":"2024-09-19T06:13:13.834885+0000","last_fullsized":"2024-09-19T06:13:13.834885+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:48.381506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836750+0000","last_change":"2024-09-19T06:13:03.806455+0000","last_active":"2024-09-19T06:13:13.836750+0000","last_peered":"2024-09-19T06:13:13.836750+0000","last_clean":"2024-09-19T06:13:13.836750+0000","last_became_active":"2024-09-19T06:13:03.805830+0000","last_became_peered":"2024-09-19T06:13:03.805830+0000","last_unstale":"2024-09-19T06:13:13.836750+0000","last_undegraded":"2024-09-19T06:13:13.836750+0000","last_fullsized":"2024-09-19T06:13:13.836750+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:03.206791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834548+0000","last_change":"2024-09-19T06:13:03.785009+0000","last_active":"2024-09-19T06:13:13.834548+0000","last_peered":"2024-09-19T06:13:13.834548+0000","last_clean":"2024-09-19T06:13:13.834548+0000","last_became_active":"2024-09-19T06:13:03.784638+0000","last_became_peered":"2024-09-19T06:13:03.784638+0000","last_unstale":"2024-09-19T06:13:13.834548+0000","last_undegraded":"2024-09-19T06:13:13.834548+0000","last_fullsized":"2024-09-19T06:13:13.834548+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:36:43.099492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.831398+0000","last_change":"2024-09-19T06:13:03.789006+0000","last_active":"2024-09-19T06:13:13.831398+0000","last_peered":"2024-09-19T06:13:13.831398+0000","last_clean":"2024-09-19T06:13:13.831398+0000","last_became_active":"2024-09-19T06:13:03.788639+0000","last_became_peered":"2024-09-19T06:13:03.788639+0000","last_unstale":"2024-09-19T06:13:13.831398+0000","last_undegraded":"2024-09-19T06:13:13.831398+0000","last_fullsized":"2024-09-19T06:13:13.831398+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:18.692491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836740+0000","last_change":"2024-09-19T06:13:03.805264+0000","last_active":"2024-09-19T06:13:13.836740+0000","last_peered":"2024-09-19T06:13:13.836740+0000","last_clean":"2024-09-19T06:13:13.836740+0000","last_became_active":"2024-09-19T06:13:03.804948+0000","last_became_peered":"2024-09-19T06:13:03.804948+0000","last_unstale":"2024-09-19T06:13:13.836740+0000","last_undegraded":"2024-09-19T06:13:13.836740+0000","last_fullsized":"2024-09-19T06:13:13.836740+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:56:26.613785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.841510+0000","last_change":"2024-09-19T06:13:13.841110+0000","last_active":"2024-09-19T06:13:13.841510+0000","last_peered":"2024-09-19T06:13:13.841510+0000","last_clean":"2024-09-19T06:13:13.841510+0000","last_became_active":"2024-09-19T06:13:13.840736+0000","last_became_peered":"2024-09-19T06:13:13.840736+0000","last_unstale":"2024-09-19T06:13:13.841510+0000","last_undegraded":"2024-09-19T06:13:13.841510+0000","last_fullsized":"2024-09-19T06:13:13.841510+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:46.304692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.987340+0000","last_change":"2024-09-19T06:13:03.808432+0000","last_active":"2024-09-19T06:13:13.987340+0000","last_peered":"2024-09-19T06:13:13.987340+0000","last_clean":"2024-09-19T06:13:13.987340+0000","last_became_active":"2024-09-19T06:13:03.808120+0000","last_became_peered":"2024-09-19T06:13:03.808120+0000","last_unstale":"2024-09-19T06:13:13.987340+0000","last_undegraded":"2024-09-19T06:13:13.987340+0000","last_fullsized":"2024-09-19T06:13:13.987340+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:31.270525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.843937+0000","last_change":"2024-09-19T06:13:13.843937+0000","last_active":"2024-09-19T06:13:13.843937+0000","last_peered":"2024-09-19T06:13:13.843937+0000","last_clean":"2024-09-19T06:13:13.843937+0000","last_became_active":"2024-09-19T06:13:13.843541+0000","last_became_peered":"2024-09-19T06:13:13.843541+0000","last_unstale":"2024-09-19T06:13:13.843937+0000","last_undegraded":"2024-09-19T06:13:13.843937+0000","last_fullsized":"2024-09-19T06:13:13.843937+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:23.115055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837559+0000","last_change":"2024-09-19T06:13:03.803361+0000","last_active":"2024-09-19T06:13:13.837559+0000","last_peered":"2024-09-19T06:13:13.837559+0000","last_clean":"2024-09-19T06:13:13.837559+0000","last_became_active":"2024-09-19T06:13:03.802794+0000","last_became_peered":"2024-09-19T06:13:03.802794+0000","last_unstale":"2024-09-19T06:13:13.837559+0000","last_undegraded":"2024-09-19T06:13:13.837559+0000","last_fullsized":"2024-09-19T06:13:13.837559+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:53.126456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836847+0000","last_change":"2024-09-19T06:13:03.806163+0000","last_active":"2024-09-19T06:13:13.836847+0000","last_peered":"2024-09-19T06:13:13.836847+0000","last_clean":"2024-09-19T06:13:13.836847+0000","last_became_active":"2024-09-19T06:13:03.805406+0000","last_became_peered":"2024-09-19T06:13:03.805406+0000","last_unstale":"2024-09-19T06:13:13.836847+0000","last_undegraded":"2024-09-19T06:13:13.836847+0000","last_fullsized":"2024-09-19T06:13:13.836847+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:28:17.793408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.830616+0000","last_change":"2024-09-19T06:13:03.794617+0000","last_active":"2024-09-19T06:13:13.830616+0000","last_peered":"2024-09-19T06:13:13.830616+0000","last_clean":"2024-09-19T06:13:13.830616+0000","last_became_active":"2024-09-19T06:13:03.794264+0000","last_became_peered":"2024-09-19T06:13:03.794264+0000","last_unstale":"2024-09-19T06:13:13.830616+0000","last_undegraded":"2024-09-19T06:13:13.830616+0000","last_fullsized":"2024-09-19T06:13:13.830616+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:32.200624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834631+0000","last_change":"2024-09-19T06:13:03.792632+0000","last_active":"2024-09-19T06:13:13.834631+0000","last_peered":"2024-09-19T06:13:13.834631+0000","last_clean":"2024-09-19T06:13:13.834631+0000","last_became_active":"2024-09-19T06:13:03.792409+0000","last_became_peered":"2024-09-19T06:13:03.792409+0000","last_unstale":"2024-09-19T06:13:13.834631+0000","last_undegraded":"2024-09-19T06:13:13.834631+0000","last_fullsized":"2024-09-19T06:13:13.834631+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:01.193404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834588+0000","last_change":"2024-09-19T06:13:03.801784+0000","last_active":"2024-09-19T06:13:13.834588+0000","last_peered":"2024-09-19T06:13:13.834588+0000","last_clean":"2024-09-19T06:13:13.834588+0000","last_became_active":"2024-09-19T06:13:03.801350+0000","last_became_peered":"2024-09-19T06:13:03.801350+0000","last_unstale":"2024-09-19T06:13:13.834588+0000","last_undegraded":"2024-09-19T06:13:13.834588+0000","last_fullsized":"2024-09-19T06:13:13.834588+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:50:40.542264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.986643+0000","last_change":"2024-09-19T06:13:03.800069+0000","last_active":"2024-09-19T06:13:13.986643+0000","last_peered":"2024-09-19T06:13:13.986643+0000","last_clean":"2024-09-19T06:13:13.986643+0000","last_became_active":"2024-09-19T06:13:03.799690+0000","last_became_peered":"2024-09-19T06:13:03.799690+0000","last_unstale":"2024-09-19T06:13:13.986643+0000","last_undegraded":"2024-09-19T06:13:13.986643+0000","last_fullsized":"2024-09-19T06:13:13.986643+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:36:01.882849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834326+0000","last_change":"2024-09-19T06:13:03.800180+0000","last_active":"2024-09-19T06:13:13.834326+0000","last_peered":"2024-09-19T06:13:13.834326+0000","last_clean":"2024-09-19T06:13:13.834326+0000","last_became_active":"2024-09-19T06:13:03.798981+0000","last_became_peered":"2024-09-19T06:13:03.798981+0000","last_unstale":"2024-09-19T06:13:13.834326+0000","last_undegraded":"2024-09-19T06:13:13.834326+0000","last_fullsized":"2024-09-19T06:13:13.834326+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:29.241021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.833656+0000","last_change":"2024-09-19T06:13:03.796889+0000","last_active":"2024-09-19T06:13:13.833656+0000","last_peered":"2024-09-19T06:13:13.833656+0000","last_clean":"2024-09-19T06:13:13.833656+0000","last_became_active":"2024-09-19T06:13:03.796539+0000","last_became_peered":"2024-09-19T06:13:03.796539+0000","last_unstale":"2024-09-19T06:13:13.833656+0000","last_undegraded":"2024-09-19T06:13:13.833656+0000","last_fullsized":"2024-09-19T06:13:13.833656+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:10.462303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.841576+0000","last_change":"2024-09-19T06:13:03.798758+0000","last_active":"2024-09-19T06:13:13.841576+0000","last_peered":"2024-09-19T06:13:13.841576+0000","last_clean":"2024-09-19T06:13:13.841576+0000","last_became_active":"2024-09-19T06:13:03.798422+0000","last_became_peered":"2024-09-19T06:13:03.798422+0000","last_unstale":"2024-09-19T06:13:13.841576+0000","last_undegraded":"2024-09-19T06:13:13.841576+0000","last_fullsized":"2024-09-19T06:13:13.841576+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:03.712394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.833498+0000","last_change":"2024-09-19T06:13:03.800825+0000","last_active":"2024-09-19T06:13:13.833498+0000","last_peered":"2024-09-19T06:13:13.833498+0000","last_clean":"2024-09-19T06:13:13.833498+0000","last_became_active":"2024-09-19T06:13:03.800505+0000","last_became_peered":"2024-09-19T06:13:03.800505+0000","last_unstale":"2024-09-19T06:13:13.833498+0000","last_undegraded":"2024-09-19T06:13:13.833498+0000","last_fullsized":"2024-09-19T06:13:13.833498+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:15.640802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.830731+0000","last_change":"2024-09-19T06:13:03.797868+0000","last_active":"2024-09-19T06:13:13.830731+0000","last_peered":"2024-09-19T06:13:13.830731+0000","last_clean":"2024-09-19T06:13:13.830731+0000","last_became_active":"2024-09-19T06:13:03.797576+0000","last_became_peered":"2024-09-19T06:13:03.797576+0000","last_unstale":"2024-09-19T06:13:13.830731+0000","last_undegraded":"2024-09-19T06:13:13.830731+0000","last_fullsized":"2024-09-19T06:13:13.830731+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:29:18.953446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.986839+0000","last_change":"2024-09-19T06:13:03.805201+0000","last_active":"2024-09-19T06:13:13.986839+0000","last_peered":"2024-09-19T06:13:13.986839+0000","last_clean":"2024-09-19T06:13:13.986839+0000","last_became_active":"2024-09-19T06:13:03.803758+0000","last_became_peered":"2024-09-19T06:13:03.803758+0000","last_unstale":"2024-09-19T06:13:13.986839+0000","last_undegraded":"2024-09-19T06:13:13.986839+0000","last_fullsized":"2024-09-19T06:13:13.986839+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:49:26.088519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.986859+0000","last_change":"2024-09-19T06:13:03.796086+0000","last_active":"2024-09-19T06:13:13.986859+0000","last_peered":"2024-09-19T06:13:13.986859+0000","last_clean":"2024-09-19T06:13:13.986859+0000","last_became_active":"2024-09-19T06:13:03.795594+0000","last_became_peered":"2024-09-19T06:13:03.795594+0000","last_unstale":"2024-09-19T06:13:13.986859+0000","last_undegraded":"2024-09-19T06:13:13.986859+0000","last_fullsized":"2024-09-19T06:13:13.986859+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:26.374596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837062+0000","last_change":"2024-09-19T06:13:03.796727+0000","last_active":"2024-09-19T06:13:13.837062+0000","last_peered":"2024-09-19T06:13:13.837062+0000","last_clean":"2024-09-19T06:13:13.837062+0000","last_became_active":"2024-09-19T06:13:03.796334+0000","last_became_peered":"2024-09-19T06:13:03.796334+0000","last_unstale":"2024-09-19T06:13:13.837062+0000","last_undegraded":"2024-09-19T06:13:13.837062+0000","last_fullsized":"2024-09-19T06:13:13.837062+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:47.660748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.987433+0000","last_change":"2024-09-19T06:13:03.800994+0000","last_active":"2024-09-19T06:13:13.987433+0000","last_peered":"2024-09-19T06:13:13.987433+0000","last_clean":"2024-09-19T06:13:13.987433+0000","last_became_active":"2024-09-19T06:13:03.800690+0000","last_became_peered":"2024-09-19T06:13:03.800690+0000","last_unstale":"2024-09-19T06:13:13.987433+0000","last_undegraded":"2024-09-19T06:13:13.987433+0000","last_fullsized":"2024-09-19T06:13:13.987433+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:37.204106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.841755+0000","last_change":"2024-09-19T06:13:03.797503+0000","last_active":"2024-09-19T06:13:13.841755+0000","last_peered":"2024-09-19T06:13:13.841755+0000","last_clean":"2024-09-19T06:13:13.841755+0000","last_became_active":"2024-09-19T06:13:03.797189+0000","last_became_peered":"2024-09-19T06:13:03.797189+0000","last_unstale":"2024-09-19T06:13:13.841755+0000","last_undegraded":"2024-09-19T06:13:13.841755+0000","last_fullsized":"2024-09-19T06:13:13.841755+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:16:18.036236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.833849+0000","last_change":"2024-09-19T06:13:03.795462+0000","last_active":"2024-09-19T06:13:13.833849+0000","last_peered":"2024-09-19T06:13:13.833849+0000","last_clean":"2024-09-19T06:13:13.833849+0000","last_became_active":"2024-09-19T06:13:03.793882+0000","last_became_peered":"2024-09-19T06:13:03.793882+0000","last_unstale":"2024-09-19T06:13:13.833849+0000","last_undegraded":"2024-09-19T06:13:13.833849+0000","last_fullsized":"2024-09-19T06:13:13.833849+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:04.329608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.830520+0000","last_change":"2024-09-19T06:13:03.800425+0000","last_active":"2024-09-19T06:13:13.830520+0000","last_peered":"2024-09-19T06:13:13.830520+0000","last_clean":"2024-09-19T06:13:13.830520+0000","last_became_active":"2024-09-19T06:13:03.800061+0000","last_became_peered":"2024-09-19T06:13:03.800061+0000","last_unstale":"2024-09-19T06:13:13.830520+0000","last_undegraded":"2024-09-19T06:13:13.830520+0000","last_fullsized":"2024-09-19T06:13:13.830520+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:36.454869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834825+0000","last_change":"2024-09-19T06:13:03.801630+0000","last_active":"2024-09-19T06:13:13.834825+0000","last_peered":"2024-09-19T06:13:13.834825+0000","last_clean":"2024-09-19T06:13:13.834825+0000","last_became_active":"2024-09-19T06:13:03.801118+0000","last_became_peered":"2024-09-19T06:13:03.801118+0000","last_unstale":"2024-09-19T06:13:13.834825+0000","last_undegraded":"2024-09-19T06:13:13.834825+0000","last_fullsized":"2024-09-19T06:13:13.834825+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:52.641042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.840928+0000","last_change":"2024-09-19T06:13:03.793435+0000","last_active":"2024-09-19T06:13:13.840928+0000","last_peered":"2024-09-19T06:13:13.840928+0000","last_clean":"2024-09-19T06:13:13.840928+0000","last_became_active":"2024-09-19T06:13:03.793138+0000","last_became_peered":"2024-09-19T06:13:03.793138+0000","last_unstale":"2024-09-19T06:13:13.840928+0000","last_undegraded":"2024-09-19T06:13:13.840928+0000","last_fullsized":"2024-09-19T06:13:13.840928+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:40.967328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.841127+0000","last_change":"2024-09-19T06:13:03.800324+0000","last_active":"2024-09-19T06:13:13.841127+0000","last_peered":"2024-09-19T06:13:13.841127+0000","last_clean":"2024-09-19T06:13:13.841127+0000","last_became_active":"2024-09-19T06:13:03.799996+0000","last_became_peered":"2024-09-19T06:13:03.799996+0000","last_unstale":"2024-09-19T06:13:13.841127+0000","last_undegraded":"2024-09-19T06:13:13.841127+0000","last_fullsized":"2024-09-19T06:13:13.841127+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:04.012607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.833462+0000","last_change":"2024-09-19T06:13:03.794669+0000","last_active":"2024-09-19T06:13:13.833462+0000","last_peered":"2024-09-19T06:13:13.833462+0000","last_clean":"2024-09-19T06:13:13.833462+0000","last_became_active":"2024-09-19T06:13:03.794333+0000","last_became_peered":"2024-09-19T06:13:03.794333+0000","last_unstale":"2024-09-19T06:13:13.833462+0000","last_undegraded":"2024-09-19T06:13:13.833462+0000","last_fullsized":"2024-09-19T06:13:13.833462+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:27.690064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834261+0000","last_change":"2024-09-19T06:13:03.794058+0000","last_active":"2024-09-19T06:13:13.834261+0000","last_peered":"2024-09-19T06:13:13.834261+0000","last_clean":"2024-09-19T06:13:13.834261+0000","last_became_active":"2024-09-19T06:13:03.793710+0000","last_became_peered":"2024-09-19T06:13:03.793710+0000","last_unstale":"2024-09-19T06:13:13.834261+0000","last_undegraded":"2024-09-19T06:13:13.834261+0000","last_fullsized":"2024-09-19T06:13:13.834261+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:56:05.395718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"79'5","reported_seq":47,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:21.885828+0000","last_change":"2024-09-19T06:13:13.848686+0000","last_active":"2024-09-19T06:13:21.885828+0000","last_peered":"2024-09-19T06:13:21.885828+0000","last_clean":"2024-09-19T06:13:21.885828+0000","last_became_active":"2024-09-19T06:13:13.843205+0000","last_became_peered":"2024-09-19T06:13:13.843205+0000","last_unstale":"2024-09-19T06:13:21.885828+0000","last_undegraded":"2024-09-19T06:13:21.885828+0000","last_fullsized":"2024-09-19T06:13:21.885828+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:49.016417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836811+0000","last_change":"2024-09-19T06:13:03.801206+0000","last_active":"2024-09-19T06:13:13.836811+0000","last_peered":"2024-09-19T06:13:13.836811+0000","last_clean":"2024-09-19T06:13:13.836811+0000","last_became_active":"2024-09-19T06:13:03.800661+0000","last_became_peered":"2024-09-19T06:13:03.800661+0000","last_unstale":"2024-09-19T06:13:13.836811+0000","last_undegraded":"2024-09-19T06:13:13.836811+0000","last_fullsized":"2024-09-19T06:13:13.836811+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:28:11.187583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.831489+0000","last_change":"2024-09-19T06:13:01.656487+0000","last_active":"2024-09-19T06:13:13.831489+0000","last_peered":"2024-09-19T06:13:13.831489+0000","last_clean":"2024-09-19T06:13:13.831489+0000","last_became_active":"2024-09-19T06:13:01.656099+0000","last_became_peered":"2024-09-19T06:13:01.656099+0000","last_unstale":"2024-09-19T06:13:13.831489+0000","last_undegraded":"2024-09-19T06:13:13.831489+0000","last_fullsized":"2024-09-19T06:13:13.831489+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:01.437614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.830367+0000","last_change":"2024-09-19T06:13:01.656435+0000","last_active":"2024-09-19T06:13:13.830367+0000","last_peered":"2024-09-19T06:13:13.830367+0000","last_clean":"2024-09-19T06:13:13.830367+0000","last_became_active":"2024-09-19T06:13:01.655660+0000","last_became_peered":"2024-09-19T06:13:01.655660+0000","last_unstale":"2024-09-19T06:13:13.830367+0000","last_undegraded":"2024-09-19T06:13:13.830367+0000","last_fullsized":"2024-09-19T06:13:13.830367+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:35:06.211974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.986952+0000","last_change":"2024-09-19T06:13:03.784573+0000","last_active":"2024-09-19T06:13:13.986952+0000","last_peered":"2024-09-19T06:13:13.986952+0000","last_clean":"2024-09-19T06:13:13.986952+0000","last_became_active":"2024-09-19T06:13:03.784152+0000","last_became_peered":"2024-09-19T06:13:03.784152+0000","last_unstale":"2024-09-19T06:13:13.986952+0000","last_undegraded":"2024-09-19T06:13:13.986952+0000","last_fullsized":"2024-09-19T06:13:13.986952+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:28:39.606178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'1","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837384+0000","last_change":"2024-09-19T06:13:01.656150+0000","last_active":"2024-09-19T06:13:13.837384+0000","last_peered":"2024-09-19T06:13:13.837384+0000","last_clean":"2024-09-19T06:13:13.837384+0000","last_became_active":"2024-09-19T06:13:01.655826+0000","last_became_peered":"2024-09-19T06:13:01.655826+0000","last_unstale":"2024-09-19T06:13:13.837384+0000","last_undegraded":"2024-09-19T06:13:13.837384+0000","last_fullsized":"2024-09-19T06:13:13.837384+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:57.782393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.833363+0000","last_change":"2024-09-19T06:13:03.784567+0000","last_active":"2024-09-19T06:13:13.833363+0000","last_peered":"2024-09-19T06:13:13.833363+0000","last_clean":"2024-09-19T06:13:13.833363+0000","last_became_active":"2024-09-19T06:13:03.784187+0000","last_became_peered":"2024-09-19T06:13:03.784187+0000","last_unstale":"2024-09-19T06:13:13.833363+0000","last_undegraded":"2024-09-19T06:13:13.833363+0000","last_fullsized":"2024-09-19T06:13:13.833363+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:21.037052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'3","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:21.885341+0000","last_change":"2024-09-19T06:13:01.659641+0000","last_active":"2024-09-19T06:13:21.885341+0000","last_peered":"2024-09-19T06:13:21.885341+0000","last_clean":"2024-09-19T06:13:21.885341+0000","last_became_active":"2024-09-19T06:13:01.659338+0000","last_became_peered":"2024-09-19T06:13:01.659338+0000","last_unstale":"2024-09-19T06:13:21.885341+0000","last_undegraded":"2024-09-19T06:13:21.885341+0000","last_fullsized":"2024-09-19T06:13:21.885341+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:26.230690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.987249+0000","last_change":"2024-09-19T06:13:03.797095+0000","last_active":"2024-09-19T06:13:13.987249+0000","last_peered":"2024-09-19T06:13:13.987249+0000","last_clean":"2024-09-19T06:13:13.987249+0000","last_became_active":"2024-09-19T06:13:03.796588+0000","last_became_peered":"2024-09-19T06:13:03.796588+0000","last_unstale":"2024-09-19T06:13:13.987249+0000","last_undegraded":"2024-09-19T06:13:13.987249+0000","last_fullsized":"2024-09-19T06:13:13.987249+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:33.705210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836583+0000","last_change":"2024-09-19T06:13:01.659995+0000","last_active":"2024-09-19T06:13:13.836583+0000","last_peered":"2024-09-19T06:13:13.836583+0000","last_clean":"2024-09-19T06:13:13.836583+0000","last_became_active":"2024-09-19T06:13:01.659621+0000","last_became_peered":"2024-09-19T06:13:01.659621+0000","last_unstale":"2024-09-19T06:13:13.836583+0000","last_undegraded":"2024-09-19T06:13:13.836583+0000","last_fullsized":"2024-09-19T06:13:13.836583+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:44.893111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.835148+0000","last_change":"2024-09-19T06:13:03.800859+0000","last_active":"2024-09-19T06:13:13.835148+0000","last_peered":"2024-09-19T06:13:13.835148+0000","last_clean":"2024-09-19T06:13:13.835148+0000","last_became_active":"2024-09-19T06:13:03.800540+0000","last_became_peered":"2024-09-19T06:13:03.800540+0000","last_unstale":"2024-09-19T06:13:13.835148+0000","last_undegraded":"2024-09-19T06:13:13.835148+0000","last_fullsized":"2024-09-19T06:13:13.835148+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:25:11.198557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'4","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837224+0000","last_change":"2024-09-19T06:13:01.654666+0000","last_active":"2024-09-19T06:13:13.837224+0000","last_peered":"2024-09-19T06:13:13.837224+0000","last_clean":"2024-09-19T06:13:13.837224+0000","last_became_active":"2024-09-19T06:13:01.654241+0000","last_became_peered":"2024-09-19T06:13:01.654241+0000","last_unstale":"2024-09-19T06:13:13.837224+0000","last_undegraded":"2024-09-19T06:13:13.837224+0000","last_fullsized":"2024-09-19T06:13:13.837224+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:45.211100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.986872+0000","last_change":"2024-09-19T06:13:03.799906+0000","last_active":"2024-09-19T06:13:13.986872+0000","last_peered":"2024-09-19T06:13:13.986872+0000","last_clean":"2024-09-19T06:13:13.986872+0000","last_became_active":"2024-09-19T06:13:03.799566+0000","last_became_peered":"2024-09-19T06:13:03.799566+0000","last_unstale":"2024-09-19T06:13:13.986872+0000","last_undegraded":"2024-09-19T06:13:13.986872+0000","last_fullsized":"2024-09-19T06:13:13.986872+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:34.268480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'22","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:22.984707+0000","last_change":"2024-09-19T06:13:01.657204+0000","last_active":"2024-09-19T06:13:22.984707+0000","last_peered":"2024-09-19T06:13:22.984707+0000","last_clean":"2024-09-19T06:13:22.984707+0000","last_became_active":"2024-09-19T06:13:01.656886+0000","last_became_peered":"2024-09-19T06:13:01.656886+0000","last_unstale":"2024-09-19T06:13:22.984707+0000","last_undegraded":"2024-09-19T06:13:22.984707+0000","last_fullsized":"2024-09-19T06:13:22.984707+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:32:18.033428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46802,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":49,"num_write":23,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834343+0000","last_change":"2024-09-19T06:13:03.798605+0000","last_active":"2024-09-19T06:13:13.834343+0000","last_peered":"2024-09-19T06:13:13.834343+0000","last_clean":"2024-09-19T06:13:13.834343+0000","last_became_active":"2024-09-19T06:13:03.798022+0000","last_became_peered":"2024-09-19T06:13:03.798022+0000","last_unstale":"2024-09-19T06:13:13.834343+0000","last_undegraded":"2024-09-19T06:13:13.834343+0000","last_fullsized":"2024-09-19T06:13:13.834343+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:10.094031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.841613+0000","last_change":"2024-09-19T06:13:01.652192+0000","last_active":"2024-09-19T06:13:13.841613+0000","last_peered":"2024-09-19T06:13:13.841613+0000","last_clean":"2024-09-19T06:13:13.841613+0000","last_became_active":"2024-09-19T06:13:01.651774+0000","last_became_peered":"2024-09-19T06:13:01.651774+0000","last_unstale":"2024-09-19T06:13:13.841613+0000","last_undegraded":"2024-09-19T06:13:13.841613+0000","last_fullsized":"2024-09-19T06:13:13.841613+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:39:47.683863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.830386+0000","last_change":"2024-09-19T06:13:03.798674+0000","last_active":"2024-09-19T06:13:13.830386+0000","last_peered":"2024-09-19T06:13:13.830386+0000","last_clean":"2024-09-19T06:13:13.830386+0000","last_became_active":"2024-09-19T06:13:03.798397+0000","last_became_peered":"2024-09-19T06:13:03.798397+0000","last_unstale":"2024-09-19T06:13:13.830386+0000","last_undegraded":"2024-09-19T06:13:13.830386+0000","last_fullsized":"2024-09-19T06:13:13.830386+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:37.155730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836668+0000","last_change":"2024-09-19T06:13:01.655777+0000","last_active":"2024-09-19T06:13:13.836668+0000","last_peered":"2024-09-19T06:13:13.836668+0000","last_clean":"2024-09-19T06:13:13.836668+0000","last_became_active":"2024-09-19T06:13:01.655420+0000","last_became_peered":"2024-09-19T06:13:01.655420+0000","last_unstale":"2024-09-19T06:13:13.836668+0000","last_undegraded":"2024-09-19T06:13:13.836668+0000","last_fullsized":"2024-09-19T06:13:13.836668+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:02.593204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836731+0000","last_change":"2024-09-19T06:13:03.803799+0000","last_active":"2024-09-19T06:13:13.836731+0000","last_peered":"2024-09-19T06:13:13.836731+0000","last_clean":"2024-09-19T06:13:13.836731+0000","last_became_active":"2024-09-19T06:13:03.803350+0000","last_became_peered":"2024-09-19T06:13:03.803350+0000","last_unstale":"2024-09-19T06:13:13.836731+0000","last_undegraded":"2024-09-19T06:13:13.836731+0000","last_fullsized":"2024-09-19T06:13:13.836731+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:15.806363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'3","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:22.887205+0000","last_change":"2024-09-19T06:13:01.656007+0000","last_active":"2024-09-19T06:13:22.887205+0000","last_peered":"2024-09-19T06:13:22.887205+0000","last_clean":"2024-09-19T06:13:22.887205+0000","last_became_active":"2024-09-19T06:13:01.655642+0000","last_became_peered":"2024-09-19T06:13:01.655642+0000","last_unstale":"2024-09-19T06:13:22.887205+0000","last_undegraded":"2024-09-19T06:13:22.887205+0000","last_fullsized":"2024-09-19T06:13:22.887205+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:54.391122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836490+0000","last_change":"2024-09-19T06:13:03.804426+0000","last_active":"2024-09-19T06:13:13.836490+0000","last_peered":"2024-09-19T06:13:13.836490+0000","last_clean":"2024-09-19T06:13:13.836490+0000","last_became_active":"2024-09-19T06:13:03.804146+0000","last_became_peered":"2024-09-19T06:13:03.804146+0000","last_unstale":"2024-09-19T06:13:13.836490+0000","last_undegraded":"2024-09-19T06:13:13.836490+0000","last_fullsized":"2024-09-19T06:13:13.836490+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:56.198679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834205+0000","last_change":"2024-09-19T06:13:01.650023+0000","last_active":"2024-09-19T06:13:13.834205+0000","last_peered":"2024-09-19T06:13:13.834205+0000","last_clean":"2024-09-19T06:13:13.834205+0000","last_became_active":"2024-09-19T06:13:01.649674+0000","last_became_peered":"2024-09-19T06:13:01.649674+0000","last_unstale":"2024-09-19T06:13:13.834205+0000","last_undegraded":"2024-09-19T06:13:13.834205+0000","last_fullsized":"2024-09-19T06:13:13.834205+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:56:11.164070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836300+0000","last_change":"2024-09-19T06:13:03.802078+0000","last_active":"2024-09-19T06:13:13.836300+0000","last_peered":"2024-09-19T06:13:13.836300+0000","last_clean":"2024-09-19T06:13:13.836300+0000","last_became_active":"2024-09-19T06:13:03.801552+0000","last_became_peered":"2024-09-19T06:13:03.801552+0000","last_unstale":"2024-09-19T06:13:13.836300+0000","last_undegraded":"2024-09-19T06:13:13.836300+0000","last_fullsized":"2024-09-19T06:13:13.836300+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:57.025457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:17.875451+0000","last_change":"2024-09-19T06:13:13.843721+0000","last_active":"2024-09-19T06:13:17.875451+0000","last_peered":"2024-09-19T06:13:17.875451+0000","last_clean":"2024-09-19T06:13:17.875451+0000","last_became_active":"2024-09-19T06:13:13.838567+0000","last_became_peered":"2024-09-19T06:13:13.838567+0000","last_unstale":"2024-09-19T06:13:17.875451+0000","last_undegraded":"2024-09-19T06:13:17.875451+0000","last_fullsized":"2024-09-19T06:13:17.875451+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:44.479675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.833649+0000","last_change":"2024-09-19T06:13:03.801534+0000","last_active":"2024-09-19T06:13:13.833649+0000","last_peered":"2024-09-19T06:13:13.833649+0000","last_clean":"2024-09-19T06:13:13.833649+0000","last_became_active":"2024-09-19T06:13:03.801142+0000","last_became_peered":"2024-09-19T06:13:03.801142+0000","last_unstale":"2024-09-19T06:13:13.833649+0000","last_undegraded":"2024-09-19T06:13:13.833649+0000","last_fullsized":"2024-09-19T06:13:13.833649+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:45.029662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.830492+0000","last_change":"2024-09-19T06:13:01.655075+0000","last_active":"2024-09-19T06:13:13.830492+0000","last_peered":"2024-09-19T06:13:13.830492+0000","last_clean":"2024-09-19T06:13:13.830492+0000","last_became_active":"2024-09-19T06:13:01.649236+0000","last_became_peered":"2024-09-19T06:13:01.649236+0000","last_unstale":"2024-09-19T06:13:13.830492+0000","last_undegraded":"2024-09-19T06:13:13.830492+0000","last_fullsized":"2024-09-19T06:13:13.830492+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:06.007418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836658+0000","last_change":"2024-09-19T06:13:03.795674+0000","last_active":"2024-09-19T06:13:13.836658+0000","last_peered":"2024-09-19T06:13:13.836658+0000","last_clean":"2024-09-19T06:13:13.836658+0000","last_became_active":"2024-09-19T06:13:03.794843+0000","last_became_peered":"2024-09-19T06:13:03.794843+0000","last_unstale":"2024-09-19T06:13:13.836658+0000","last_undegraded":"2024-09-19T06:13:13.836658+0000","last_fullsized":"2024-09-19T06:13:13.836658+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:41:57.669988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837389+0000","last_change":"2024-09-19T06:13:01.656696+0000","last_active":"2024-09-19T06:13:13.837389+0000","last_peered":"2024-09-19T06:13:13.837389+0000","last_clean":"2024-09-19T06:13:13.837389+0000","last_became_active":"2024-09-19T06:13:01.655260+0000","last_became_peered":"2024-09-19T06:13:01.655260+0000","last_unstale":"2024-09-19T06:13:13.837389+0000","last_undegraded":"2024-09-19T06:13:13.837389+0000","last_fullsized":"2024-09-19T06:13:13.837389+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:50.281013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837373+0000","last_change":"2024-09-19T06:13:03.804411+0000","last_active":"2024-09-19T06:13:13.837373+0000","last_peered":"2024-09-19T06:13:13.837373+0000","last_clean":"2024-09-19T06:13:13.837373+0000","last_became_active":"2024-09-19T06:13:03.804052+0000","last_became_peered":"2024-09-19T06:13:03.804052+0000","last_unstale":"2024-09-19T06:13:13.837373+0000","last_undegraded":"2024-09-19T06:13:13.837373+0000","last_fullsized":"2024-09-19T06:13:13.837373+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:33.394141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.841525+0000","last_change":"2024-09-19T06:13:01.655164+0000","last_active":"2024-09-19T06:13:13.841525+0000","last_peered":"2024-09-19T06:13:13.841525+0000","last_clean":"2024-09-19T06:13:13.841525+0000","last_became_active":"2024-09-19T06:13:01.654297+0000","last_became_peered":"2024-09-19T06:13:01.654297+0000","last_unstale":"2024-09-19T06:13:13.841525+0000","last_undegraded":"2024-09-19T06:13:13.841525+0000","last_fullsized":"2024-09-19T06:13:13.841525+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:02:02.861982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837562+0000","last_change":"2024-09-19T06:13:03.802799+0000","last_active":"2024-09-19T06:13:13.837562+0000","last_peered":"2024-09-19T06:13:13.837562+0000","last_clean":"2024-09-19T06:13:13.837562+0000","last_became_active":"2024-09-19T06:13:03.802348+0000","last_became_peered":"2024-09-19T06:13:03.802348+0000","last_unstale":"2024-09-19T06:13:13.837562+0000","last_undegraded":"2024-09-19T06:13:13.837562+0000","last_fullsized":"2024-09-19T06:13:13.837562+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:05:52.685874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":345,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837478+0000","last_change":"2024-09-19T06:11:51.805685+0000","last_active":"2024-09-19T06:13:13.837478+0000","last_peered":"2024-09-19T06:13:13.837478+0000","last_clean":"2024-09-19T06:13:13.837478+0000","last_became_active":"2024-09-19T06:11:51.805191+0000","last_became_peered":"2024-09-19T06:11:51.805191+0000","last_unstale":"2024-09-19T06:13:13.837478+0000","last_undegraded":"2024-09-19T06:13:13.837478+0000","last_fullsized":"2024-09-19T06:13:13.837478+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:08:28.556644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:08:28.556644+0000","last_clean_scrub_stamp":"2024-09-19T06:08:28.556644+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:19.169542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:17.875306+0000","last_change":"2024-09-19T06:13:01.656796+0000","last_active":"2024-09-19T06:13:17.875306+0000","last_peered":"2024-09-19T06:13:17.875306+0000","last_clean":"2024-09-19T06:13:17.875306+0000","last_became_active":"2024-09-19T06:13:01.656350+0000","last_became_peered":"2024-09-19T06:13:01.656350+0000","last_unstale":"2024-09-19T06:13:17.875306+0000","last_undegraded":"2024-09-19T06:13:17.875306+0000","last_fullsized":"2024-09-19T06:13:17.875306+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:19:03.820218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.986968+0000","last_change":"2024-09-19T06:13:03.793697+0000","last_active":"2024-09-19T06:13:13.986968+0000","last_peered":"2024-09-19T06:13:13.986968+0000","last_clean":"2024-09-19T06:13:13.986968+0000","last_became_active":"2024-09-19T06:13:03.793378+0000","last_became_peered":"2024-09-19T06:13:03.793378+0000","last_unstale":"2024-09-19T06:13:13.986968+0000","last_undegraded":"2024-09-19T06:13:13.986968+0000","last_fullsized":"2024-09-19T06:13:13.986968+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:29:44.236255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836624+0000","last_change":"2024-09-19T06:13:01.658035+0000","last_active":"2024-09-19T06:13:13.836624+0000","last_peered":"2024-09-19T06:13:13.836624+0000","last_clean":"2024-09-19T06:13:13.836624+0000","last_became_active":"2024-09-19T06:13:01.657602+0000","last_became_peered":"2024-09-19T06:13:01.657602+0000","last_unstale":"2024-09-19T06:13:13.836624+0000","last_undegraded":"2024-09-19T06:13:13.836624+0000","last_fullsized":"2024-09-19T06:13:13.836624+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:27.015086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.830368+0000","last_change":"2024-09-19T06:13:03.793377+0000","last_active":"2024-09-19T06:13:13.830368+0000","last_peered":"2024-09-19T06:13:13.830368+0000","last_clean":"2024-09-19T06:13:13.830368+0000","last_became_active":"2024-09-19T06:13:03.793047+0000","last_became_peered":"2024-09-19T06:13:03.793047+0000","last_unstale":"2024-09-19T06:13:13.830368+0000","last_undegraded":"2024-09-19T06:13:13.830368+0000","last_fullsized":"2024-09-19T06:13:13.830368+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:22.883358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:22.886668+0000","last_change":"2024-09-19T06:13:01.650179+0000","last_active":"2024-09-19T06:13:22.886668+0000","last_peered":"2024-09-19T06:13:22.886668+0000","last_clean":"2024-09-19T06:13:22.886668+0000","last_became_active":"2024-09-19T06:13:01.649889+0000","last_became_peered":"2024-09-19T06:13:01.649889+0000","last_unstale":"2024-09-19T06:13:22.886668+0000","last_undegraded":"2024-09-19T06:13:22.886668+0000","last_fullsized":"2024-09-19T06:13:22.886668+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:55:00.400406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837144+0000","last_change":"2024-09-19T06:13:03.800277+0000","last_active":"2024-09-19T06:13:13.837144+0000","last_peered":"2024-09-19T06:13:13.837144+0000","last_clean":"2024-09-19T06:13:13.837144+0000","last_became_active":"2024-09-19T06:13:03.799862+0000","last_became_peered":"2024-09-19T06:13:03.799862+0000","last_unstale":"2024-09-19T06:13:13.837144+0000","last_undegraded":"2024-09-19T06:13:13.837144+0000","last_fullsized":"2024-09-19T06:13:13.837144+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:51.558276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837565+0000","last_change":"2024-09-19T06:13:01.659592+0000","last_active":"2024-09-19T06:13:13.837565+0000","last_peered":"2024-09-19T06:13:13.837565+0000","last_clean":"2024-09-19T06:13:13.837565+0000","last_became_active":"2024-09-19T06:13:01.659258+0000","last_became_peered":"2024-09-19T06:13:01.659258+0000","last_unstale":"2024-09-19T06:13:13.837565+0000","last_undegraded":"2024-09-19T06:13:13.837565+0000","last_fullsized":"2024-09-19T06:13:13.837565+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:46.097656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.831602+0000","last_change":"2024-09-19T06:13:03.793100+0000","last_active":"2024-09-19T06:13:13.831602+0000","last_peered":"2024-09-19T06:13:13.831602+0000","last_clean":"2024-09-19T06:13:13.831602+0000","last_became_active":"2024-09-19T06:13:03.792768+0000","last_became_peered":"2024-09-19T06:13:03.792768+0000","last_unstale":"2024-09-19T06:13:13.831602+0000","last_undegraded":"2024-09-19T06:13:13.831602+0000","last_fullsized":"2024-09-19T06:13:13.831602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:11:36.122712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.833570+0000","last_change":"2024-09-19T06:13:01.650511+0000","last_active":"2024-09-19T06:13:13.833570+0000","last_peered":"2024-09-19T06:13:13.833570+0000","last_clean":"2024-09-19T06:13:13.833570+0000","last_became_active":"2024-09-19T06:13:01.650099+0000","last_became_peered":"2024-09-19T06:13:01.650099+0000","last_unstale":"2024-09-19T06:13:13.833570+0000","last_undegraded":"2024-09-19T06:13:13.833570+0000","last_fullsized":"2024-09-19T06:13:13.833570+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:16.386025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.831722+0000","last_change":"2024-09-19T06:13:03.783690+0000","last_active":"2024-09-19T06:13:13.831722+0000","last_peered":"2024-09-19T06:13:13.831722+0000","last_clean":"2024-09-19T06:13:13.831722+0000","last_became_active":"2024-09-19T06:13:03.783296+0000","last_became_peered":"2024-09-19T06:13:03.783296+0000","last_unstale":"2024-09-19T06:13:13.831722+0000","last_undegraded":"2024-09-19T06:13:13.831722+0000","last_fullsized":"2024-09-19T06:13:13.831722+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:49:19.605979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"79'1","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834623+0000","last_change":"2024-09-19T06:13:01.648671+0000","last_active":"2024-09-19T06:13:13.834623+0000","last_peered":"2024-09-19T06:13:13.834623+0000","last_clean":"2024-09-19T06:13:13.834623+0000","last_became_active":"2024-09-19T06:13:01.647329+0000","last_became_peered":"2024-09-19T06:13:01.647329+0000","last_unstale":"2024-09-19T06:13:13.834623+0000","last_undegraded":"2024-09-19T06:13:13.834623+0000","last_fullsized":"2024-09-19T06:13:13.834623+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:31.026561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.830593+0000","last_change":"2024-09-19T06:13:03.795195+0000","last_active":"2024-09-19T06:13:13.830593+0000","last_peered":"2024-09-19T06:13:13.830593+0000","last_clean":"2024-09-19T06:13:13.830593+0000","last_became_active":"2024-09-19T06:13:03.794882+0000","last_became_peered":"2024-09-19T06:13:03.794882+0000","last_unstale":"2024-09-19T06:13:13.830593+0000","last_undegraded":"2024-09-19T06:13:13.830593+0000","last_fullsized":"2024-09-19T06:13:13.830593+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:47.290917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:22.795659+0000","last_change":"2024-09-19T06:13:01.652133+0000","last_active":"2024-09-19T06:13:22.795659+0000","last_peered":"2024-09-19T06:13:22.795659+0000","last_clean":"2024-09-19T06:13:22.795659+0000","last_became_active":"2024-09-19T06:13:01.651796+0000","last_became_peered":"2024-09-19T06:13:01.651796+0000","last_unstale":"2024-09-19T06:13:22.795659+0000","last_undegraded":"2024-09-19T06:13:22.795659+0000","last_fullsized":"2024-09-19T06:13:22.795659+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:01.576308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.987457+0000","last_change":"2024-09-19T06:13:03.799332+0000","last_active":"2024-09-19T06:13:13.987457+0000","last_peered":"2024-09-19T06:13:13.987457+0000","last_clean":"2024-09-19T06:13:13.987457+0000","last_became_active":"2024-09-19T06:13:03.798996+0000","last_became_peered":"2024-09-19T06:13:03.798996+0000","last_unstale":"2024-09-19T06:13:13.987457+0000","last_undegraded":"2024-09-19T06:13:13.987457+0000","last_fullsized":"2024-09-19T06:13:13.987457+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:37:32.245396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836564+0000","last_change":"2024-09-19T06:13:01.652392+0000","last_active":"2024-09-19T06:13:13.836564+0000","last_peered":"2024-09-19T06:13:13.836564+0000","last_clean":"2024-09-19T06:13:13.836564+0000","last_became_active":"2024-09-19T06:13:01.651982+0000","last_became_peered":"2024-09-19T06:13:01.651982+0000","last_unstale":"2024-09-19T06:13:13.836564+0000","last_undegraded":"2024-09-19T06:13:13.836564+0000","last_fullsized":"2024-09-19T06:13:13.836564+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:15:39.590215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.988765+0000","last_change":"2024-09-19T06:13:13.988765+0000","last_active":"2024-09-19T06:13:13.988765+0000","last_peered":"2024-09-19T06:13:13.988765+0000","last_clean":"2024-09-19T06:13:13.988765+0000","last_became_active":"2024-09-19T06:13:13.988328+0000","last_became_peered":"2024-09-19T06:13:13.988328+0000","last_unstale":"2024-09-19T06:13:13.988765+0000","last_undegraded":"2024-09-19T06:13:13.988765+0000","last_fullsized":"2024-09-19T06:13:13.988765+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:10.219202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.986807+0000","last_change":"2024-09-19T06:13:01.658954+0000","last_active":"2024-09-19T06:13:13.986807+0000","last_peered":"2024-09-19T06:13:13.986807+0000","last_clean":"2024-09-19T06:13:13.986807+0000","last_became_active":"2024-09-19T06:13:01.658453+0000","last_became_peered":"2024-09-19T06:13:01.658453+0000","last_unstale":"2024-09-19T06:13:13.986807+0000","last_undegraded":"2024-09-19T06:13:13.986807+0000","last_fullsized":"2024-09-19T06:13:13.986807+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:17.134858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834131+0000","last_change":"2024-09-19T06:13:03.786812+0000","last_active":"2024-09-19T06:13:13.834131+0000","last_peered":"2024-09-19T06:13:13.834131+0000","last_clean":"2024-09-19T06:13:13.834131+0000","last_became_active":"2024-09-19T06:13:03.786481+0000","last_became_peered":"2024-09-19T06:13:03.786481+0000","last_unstale":"2024-09-19T06:13:13.834131+0000","last_undegraded":"2024-09-19T06:13:13.834131+0000","last_fullsized":"2024-09-19T06:13:13.834131+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:46.614073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.986953+0000","last_change":"2024-09-19T06:13:01.652062+0000","last_active":"2024-09-19T06:13:13.986953+0000","last_peered":"2024-09-19T06:13:13.986953+0000","last_clean":"2024-09-19T06:13:13.986953+0000","last_became_active":"2024-09-19T06:13:01.651718+0000","last_became_peered":"2024-09-19T06:13:01.651718+0000","last_unstale":"2024-09-19T06:13:13.986953+0000","last_undegraded":"2024-09-19T06:13:13.986953+0000","last_fullsized":"2024-09-19T06:13:13.986953+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:22.428954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.833537+0000","last_change":"2024-09-19T06:13:03.792868+0000","last_active":"2024-09-19T06:13:13.833537+0000","last_peered":"2024-09-19T06:13:13.833537+0000","last_clean":"2024-09-19T06:13:13.833537+0000","last_became_active":"2024-09-19T06:13:03.792482+0000","last_became_peered":"2024-09-19T06:13:03.792482+0000","last_unstale":"2024-09-19T06:13:13.833537+0000","last_undegraded":"2024-09-19T06:13:13.833537+0000","last_fullsized":"2024-09-19T06:13:13.833537+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:05:11.294500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.840945+0000","last_change":"2024-09-19T06:13:01.654572+0000","last_active":"2024-09-19T06:13:13.840945+0000","last_peered":"2024-09-19T06:13:13.840945+0000","last_clean":"2024-09-19T06:13:13.840945+0000","last_became_active":"2024-09-19T06:13:01.653865+0000","last_became_peered":"2024-09-19T06:13:01.653865+0000","last_unstale":"2024-09-19T06:13:13.840945+0000","last_undegraded":"2024-09-19T06:13:13.840945+0000","last_fullsized":"2024-09-19T06:13:13.840945+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:45.842230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.987135+0000","last_change":"2024-09-19T06:13:03.791077+0000","last_active":"2024-09-19T06:13:13.987135+0000","last_peered":"2024-09-19T06:13:13.987135+0000","last_clean":"2024-09-19T06:13:13.987135+0000","last_became_active":"2024-09-19T06:13:03.790710+0000","last_became_peered":"2024-09-19T06:13:03.790710+0000","last_unstale":"2024-09-19T06:13:13.987135+0000","last_undegraded":"2024-09-19T06:13:13.987135+0000","last_fullsized":"2024-09-19T06:13:13.987135+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:15:53.498311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.992580+0000","last_change":"2024-09-19T06:13:13.992222+0000","last_active":"2024-09-19T06:13:13.992580+0000","last_peered":"2024-09-19T06:13:13.992580+0000","last_clean":"2024-09-19T06:13:13.992580+0000","last_became_active":"2024-09-19T06:13:13.988046+0000","last_became_peered":"2024-09-19T06:13:13.988046+0000","last_unstale":"2024-09-19T06:13:13.992580+0000","last_undegraded":"2024-09-19T06:13:13.992580+0000","last_fullsized":"2024-09-19T06:13:13.992580+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:21:56.013401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837205+0000","last_change":"2024-09-19T06:13:03.808060+0000","last_active":"2024-09-19T06:13:13.837205+0000","last_peered":"2024-09-19T06:13:13.837205+0000","last_clean":"2024-09-19T06:13:13.837205+0000","last_became_active":"2024-09-19T06:13:03.807455+0000","last_became_peered":"2024-09-19T06:13:03.807455+0000","last_unstale":"2024-09-19T06:13:13.837205+0000","last_undegraded":"2024-09-19T06:13:13.837205+0000","last_fullsized":"2024-09-19T06:13:13.837205+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:27:19.172298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.988516+0000","last_change":"2024-09-19T06:13:13.987967+0000","last_active":"2024-09-19T06:13:13.988516+0000","last_peered":"2024-09-19T06:13:13.988516+0000","last_clean":"2024-09-19T06:13:13.988516+0000","last_became_active":"2024-09-19T06:13:13.987431+0000","last_became_peered":"2024-09-19T06:13:13.987431+0000","last_unstale":"2024-09-19T06:13:13.988516+0000","last_undegraded":"2024-09-19T06:13:13.988516+0000","last_fullsized":"2024-09-19T06:13:13.988516+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:05.785455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,1],"acting":[9,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834591+0000","last_change":"2024-09-19T06:13:01.658264+0000","last_active":"2024-09-19T06:13:13.834591+0000","last_peered":"2024-09-19T06:13:13.834591+0000","last_clean":"2024-09-19T06:13:13.834591+0000","last_became_active":"2024-09-19T06:13:01.657912+0000","last_became_peered":"2024-09-19T06:13:01.657912+0000","last_unstale":"2024-09-19T06:13:13.834591+0000","last_undegraded":"2024-09-19T06:13:13.834591+0000","last_fullsized":"2024-09-19T06:13:13.834591+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:19.618987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.986874+0000","last_change":"2024-09-19T06:13:03.791917+0000","last_active":"2024-09-19T06:13:13.986874+0000","last_peered":"2024-09-19T06:13:13.986874+0000","last_clean":"2024-09-19T06:13:13.986874+0000","last_became_active":"2024-09-19T06:13:03.791284+0000","last_became_peered":"2024-09-19T06:13:03.791284+0000","last_unstale":"2024-09-19T06:13:13.986874+0000","last_undegraded":"2024-09-19T06:13:13.986874+0000","last_fullsized":"2024-09-19T06:13:13.986874+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:29.685827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.851212+0000","last_change":"2024-09-19T06:13:13.850753+0000","last_active":"2024-09-19T06:13:13.851212+0000","last_peered":"2024-09-19T06:13:13.851212+0000","last_clean":"2024-09-19T06:13:13.851212+0000","last_became_active":"2024-09-19T06:13:13.843601+0000","last_became_peered":"2024-09-19T06:13:13.843601+0000","last_unstale":"2024-09-19T06:13:13.851212+0000","last_undegraded":"2024-09-19T06:13:13.851212+0000","last_fullsized":"2024-09-19T06:13:13.851212+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:11.452118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.835131+0000","last_change":"2024-09-19T06:13:03.798722+0000","last_active":"2024-09-19T06:13:13.835131+0000","last_peered":"2024-09-19T06:13:13.835131+0000","last_clean":"2024-09-19T06:13:13.835131+0000","last_became_active":"2024-09-19T06:13:03.798428+0000","last_became_peered":"2024-09-19T06:13:03.798428+0000","last_unstale":"2024-09-19T06:13:13.835131+0000","last_undegraded":"2024-09-19T06:13:13.835131+0000","last_fullsized":"2024-09-19T06:13:13.835131+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:11:15.179515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.987601+0000","last_change":"2024-09-19T06:13:01.651003+0000","last_active":"2024-09-19T06:13:13.987601+0000","last_peered":"2024-09-19T06:13:13.987601+0000","last_clean":"2024-09-19T06:13:13.987601+0000","last_became_active":"2024-09-19T06:13:01.650697+0000","last_became_peered":"2024-09-19T06:13:01.650697+0000","last_unstale":"2024-09-19T06:13:13.987601+0000","last_undegraded":"2024-09-19T06:13:13.987601+0000","last_fullsized":"2024-09-19T06:13:13.987601+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:47.982845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.987236+0000","last_change":"2024-09-19T06:13:03.796907+0000","last_active":"2024-09-19T06:13:13.987236+0000","last_peered":"2024-09-19T06:13:13.987236+0000","last_clean":"2024-09-19T06:13:13.987236+0000","last_became_active":"2024-09-19T06:13:03.796426+0000","last_became_peered":"2024-09-19T06:13:03.796426+0000","last_unstale":"2024-09-19T06:13:13.987236+0000","last_undegraded":"2024-09-19T06:13:13.987236+0000","last_fullsized":"2024-09-19T06:13:13.987236+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:26.455773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.833916+0000","last_change":"2024-09-19T06:13:01.654788+0000","last_active":"2024-09-19T06:13:13.833916+0000","last_peered":"2024-09-19T06:13:13.833916+0000","last_clean":"2024-09-19T06:13:13.833916+0000","last_became_active":"2024-09-19T06:13:01.654461+0000","last_became_peered":"2024-09-19T06:13:01.654461+0000","last_unstale":"2024-09-19T06:13:13.833916+0000","last_undegraded":"2024-09-19T06:13:13.833916+0000","last_fullsized":"2024-09-19T06:13:13.833916+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:41.374288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":50412,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":61,"num_read_kb":80,"num_write":147,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":644,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":380928,"data_stored":151236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612624,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":880640,"data_stored":430117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841557,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28524,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716628,"statfs":{"total":95995035648,"available":95965827072,"internally_reserved":0,"allocated":1536000,"data_stored":1043908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005083,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":430331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234016,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":888832,"data_stored":430229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462948,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28476,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716676,"statfs":{"total":95995035648,"available":95965876224,"internally_reserved":0,"allocated":1486848,"data_stored":1021790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593770,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40364,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704788,"statfs":{"total":95995035648,"available":95953702912,"internally_reserved":0,"allocated":880640,"data_stored":429720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822702,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28488,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716664,"statfs":{"total":95995035648,"available":95965863936,"internally_reserved":0,"allocated":1499136,"data_stored":1021474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986228,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":892928,"data_stored":430779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215161,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":897024,"data_stored":430031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444094,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":477043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":905216,"data_stored":451845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738439,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":901120,"data_stored":430991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":46802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":47530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":48380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:13:30.124 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T06:13:30.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:29 smithi090 ceph-mon[34497]: pgmap v289: 97 pgs: 97 active+clean; 626 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.6 KiB/s wr, 7 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T06:13:30.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:29 smithi089 ceph-mon[34160]: pgmap v289: 97 pgs: 97 active+clean; 626 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.6 KiB/s wr, 7 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T06:13:30.379 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:30.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.798+0000 7ff9ab99f640 1 -- 172.21.15.2:0/368270115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9a4102570 msgr2=0x7ff9a41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:30.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.798+0000 7ff9ab99f640 1 --2- 172.21.15.2:0/368270115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9a4102570 0x7ff9a41029b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff994009900 tx=0x7ff99402a480 comp rx=0 tx=0).stop 2024-09-19T06:13:30.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.798+0000 7ff9ab99f640 1 -- 172.21.15.2:0/368270115 shutdown_connections 2024-09-19T06:13:30.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.798+0000 7ff9ab99f640 1 --2- 172.21.15.2:0/368270115 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a4102ef0 0x7ff9a410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:30.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.798+0000 7ff9ab99f640 1 --2- 172.21.15.2:0/368270115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9a4102570 0x7ff9a41029b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:30.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.798+0000 7ff9ab99f640 1 --2- 172.21.15.2:0/368270115 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff9a4100e20 0x7ff9a4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:30.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.798+0000 7ff9ab99f640 1 -- 172.21.15.2:0/368270115 >> 172.21.15.2:0/368270115 conn(0x7ff9a40fc7d0 msgr2=0x7ff9a40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:30.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.798+0000 7ff9ab99f640 1 -- 172.21.15.2:0/368270115 shutdown_connections 2024-09-19T06:13:30.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.798+0000 7ff9ab99f640 1 -- 172.21.15.2:0/368270115 wait complete. 2024-09-19T06:13:30.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.799+0000 7ff9ab99f640 1 Processor -- start 2024-09-19T06:13:30.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.799+0000 7ff9ab99f640 1 -- start start 2024-09-19T06:13:30.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.799+0000 7ff9ab99f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a4100e20 0x7ff9a40fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:30.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.799+0000 7ff9ab99f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9a4102570 0x7ff9a40fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:30.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.799+0000 7ff9ab99f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff9a4102ef0 0x7ff9a40fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:30.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.799+0000 7ff9ab99f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a4110e30 con 0x7ff9a4102570 2024-09-19T06:13:30.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.799+0000 7ff9ab99f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a4110cb0 con 0x7ff9a4100e20 2024-09-19T06:13:30.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.799+0000 7ff9ab99f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a4110fb0 con 0x7ff9a4102ef0 2024-09-19T06:13:30.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.799+0000 7ff9a8f3a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9a4102570 0x7ff9a40fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:30.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.799+0000 7ff9a8f3a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9a4102570 0x7ff9a40fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35064/0 (socket says 172.21.15.2:35064) 2024-09-19T06:13:30.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.799+0000 7ff9a8f3a640 1 -- 172.21.15.2:0/212448508 learned_addr learned my addr 172.21.15.2:0/212448508 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:13:30.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.800+0000 7ff9a973b640 1 --2- 172.21.15.2:0/212448508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a4100e20 0x7ff9a40fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:30.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.800+0000 7ff9a8f3a640 1 -- 172.21.15.2:0/212448508 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff9a4102ef0 msgr2=0x7ff9a40fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:30.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.800+0000 7ff9a8f3a640 1 --2- 172.21.15.2:0/212448508 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff9a4102ef0 0x7ff9a40fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:30.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.800+0000 7ff9a8f3a640 1 -- 172.21.15.2:0/212448508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a4100e20 msgr2=0x7ff9a40fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:30.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.800+0000 7ff9a8f3a640 1 --2- 172.21.15.2:0/212448508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a4100e20 0x7ff9a40fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:30.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.800+0000 7ff9a8f3a640 1 -- 172.21.15.2:0/212448508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9a41a68e0 con 0x7ff9a4102570 2024-09-19T06:13:30.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.800+0000 7ff9a8f3a640 1 --2- 172.21.15.2:0/212448508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9a4102570 0x7ff9a40fd1c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff994006010 tx=0x7ff994004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:30.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.800+0000 7ff99a7fc640 1 -- 172.21.15.2:0/212448508 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99403f030 con 0x7ff9a4102570 2024-09-19T06:13:30.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.800+0000 7ff9ab99f640 1 -- 172.21.15.2:0/212448508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9a41a6b70 con 0x7ff9a4102570 2024-09-19T06:13:30.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.800+0000 7ff99a7fc640 1 -- 172.21.15.2:0/212448508 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff994003aa0 con 0x7ff9a4102570 2024-09-19T06:13:30.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.800+0000 7ff99a7fc640 1 -- 172.21.15.2:0/212448508 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff994035070 con 0x7ff9a4102570 2024-09-19T06:13:30.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.800+0000 7ff9ab99f640 1 -- 172.21.15.2:0/212448508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9a41a7050 con 0x7ff9a4102570 2024-09-19T06:13:30.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.801+0000 7ff9ab99f640 1 -- 172.21.15.2:0/212448508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9a4101200 con 0x7ff9a4102570 2024-09-19T06:13:30.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.802+0000 7ff99a7fc640 1 -- 172.21.15.2:0/212448508 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7ff994042030 con 0x7ff9a4102570 2024-09-19T06:13:30.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.803+0000 7ff99a7fc640 1 --2- 172.21.15.2:0/212448508 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7ff9900a32d0 0x7ff9900a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:30.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.803+0000 7ff9a973b640 1 --2- 172.21.15.2:0/212448508 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7ff9900a32d0 0x7ff9900a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:30.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.803+0000 7ff99a7fc640 1 -- 172.21.15.2:0/212448508 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7ff9940efee0 con 0x7ff9a4102570 2024-09-19T06:13:30.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.804+0000 7ff9a973b640 1 --2- 172.21.15.2:0/212448508 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7ff9900a32d0 0x7ff9900a5790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0009aa0 tx=0x7ff9a0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:30.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.807+0000 7ff99a7fc640 1 -- 172.21.15.2:0/212448508 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff9940bcab0 con 0x7ff9a4102570 2024-09-19T06:13:30.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.979+0000 7ff9ab99f640 1 -- 172.21.15.2:0/212448508 --> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff9a4106f10 con 0x7ff9900a32d0 2024-09-19T06:13:30.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.985+0000 7ff99a7fc640 1 -- 172.21.15.2:0/212448508 <== mgr.14150 v2:172.21.15.2:6800/4180340554 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258707 (secure 0 0 0) 0x7ff9a4106f10 con 0x7ff9900a32d0 2024-09-19T06:13:30.989 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:13:30.990 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-19T06:13:30.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.988+0000 7ff9ab99f640 1 -- 172.21.15.2:0/212448508 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7ff9900a32d0 msgr2=0x7ff9900a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:30.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.988+0000 7ff9ab99f640 1 --2- 172.21.15.2:0/212448508 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7ff9900a32d0 0x7ff9900a5790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0009aa0 tx=0x7ff9a0005f90 comp rx=0 tx=0).stop 2024-09-19T06:13:30.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.988+0000 7ff9ab99f640 1 -- 172.21.15.2:0/212448508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9a4102570 msgr2=0x7ff9a40fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:30.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.988+0000 7ff9ab99f640 1 --2- 172.21.15.2:0/212448508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9a4102570 0x7ff9a40fd1c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff994006010 tx=0x7ff994004270 comp rx=0 tx=0).stop 2024-09-19T06:13:30.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.988+0000 7ff9ab99f640 1 -- 172.21.15.2:0/212448508 shutdown_connections 2024-09-19T06:13:30.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.988+0000 7ff9ab99f640 1 --2- 172.21.15.2:0/212448508 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7ff9900a32d0 0x7ff9900a5790 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:30.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.988+0000 7ff9ab99f640 1 --2- 172.21.15.2:0/212448508 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff9a4102ef0 0x7ff9a40fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:30.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.988+0000 7ff9ab99f640 1 --2- 172.21.15.2:0/212448508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9a4102570 0x7ff9a40fd1c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:30.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.988+0000 7ff9ab99f640 1 --2- 172.21.15.2:0/212448508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a4100e20 0x7ff9a40fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:30.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.988+0000 7ff9ab99f640 1 -- 172.21.15.2:0/212448508 >> 172.21.15.2:0/212448508 conn(0x7ff9a40fc7d0 msgr2=0x7ff9a4069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:30.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.989+0000 7ff9ab99f640 1 -- 172.21.15.2:0/212448508 shutdown_connections 2024-09-19T06:13:30.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:30.989+0000 7ff9ab99f640 1 -- 172.21.15.2:0/212448508 wait complete. 2024-09-19T06:13:31.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:30 smithi002 ceph-mon[30982]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:13:31.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:30 smithi090 ceph-mon[34497]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:13:31.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:30 smithi089 ceph-mon[34160]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:13:31.924 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":290,"stamp":"2024-09-19T06:13:30.006844+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":649166,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":228,"num_read_kb":220,"num_write":339,"num_write_kb":3041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1181380,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":272,"ondisk_log_size":272,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369960,"kb_used_data":12368,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124571864,"statfs":{"total":1151940427776,"available":1151561588736,"internally_reserved":0,"allocated":12664832,"data_stored":7085350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":53576,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":92,"num_read_kb":101,"num_write":35,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002631"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.833979+0000","last_change":"2024-09-19T06:13:03.799398+0000","last_active":"2024-09-19T06:13:13.833979+0000","last_peered":"2024-09-19T06:13:13.833979+0000","last_clean":"2024-09-19T06:13:13.833979+0000","last_became_active":"2024-09-19T06:13:03.799027+0000","last_became_peered":"2024-09-19T06:13:03.799027+0000","last_unstale":"2024-09-19T06:13:13.833979+0000","last_undegraded":"2024-09-19T06:13:13.833979+0000","last_fullsized":"2024-09-19T06:13:13.833979+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:35:45.934040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834912+0000","last_change":"2024-09-19T06:13:03.791878+0000","last_active":"2024-09-19T06:13:13.834912+0000","last_peered":"2024-09-19T06:13:13.834912+0000","last_clean":"2024-09-19T06:13:13.834912+0000","last_became_active":"2024-09-19T06:13:03.791637+0000","last_became_peered":"2024-09-19T06:13:03.791637+0000","last_unstale":"2024-09-19T06:13:13.834912+0000","last_undegraded":"2024-09-19T06:13:13.834912+0000","last_fullsized":"2024-09-19T06:13:13.834912+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:00.078010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834885+0000","last_change":"2024-09-19T06:13:03.798969+0000","last_active":"2024-09-19T06:13:13.834885+0000","last_peered":"2024-09-19T06:13:13.834885+0000","last_clean":"2024-09-19T06:13:13.834885+0000","last_became_active":"2024-09-19T06:13:03.798410+0000","last_became_peered":"2024-09-19T06:13:03.798410+0000","last_unstale":"2024-09-19T06:13:13.834885+0000","last_undegraded":"2024-09-19T06:13:13.834885+0000","last_fullsized":"2024-09-19T06:13:13.834885+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:48.381506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836750+0000","last_change":"2024-09-19T06:13:03.806455+0000","last_active":"2024-09-19T06:13:13.836750+0000","last_peered":"2024-09-19T06:13:13.836750+0000","last_clean":"2024-09-19T06:13:13.836750+0000","last_became_active":"2024-09-19T06:13:03.805830+0000","last_became_peered":"2024-09-19T06:13:03.805830+0000","last_unstale":"2024-09-19T06:13:13.836750+0000","last_undegraded":"2024-09-19T06:13:13.836750+0000","last_fullsized":"2024-09-19T06:13:13.836750+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:03.206791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834548+0000","last_change":"2024-09-19T06:13:03.785009+0000","last_active":"2024-09-19T06:13:13.834548+0000","last_peered":"2024-09-19T06:13:13.834548+0000","last_clean":"2024-09-19T06:13:13.834548+0000","last_became_active":"2024-09-19T06:13:03.784638+0000","last_became_peered":"2024-09-19T06:13:03.784638+0000","last_unstale":"2024-09-19T06:13:13.834548+0000","last_undegraded":"2024-09-19T06:13:13.834548+0000","last_fullsized":"2024-09-19T06:13:13.834548+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:36:43.099492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.831398+0000","last_change":"2024-09-19T06:13:03.789006+0000","last_active":"2024-09-19T06:13:13.831398+0000","last_peered":"2024-09-19T06:13:13.831398+0000","last_clean":"2024-09-19T06:13:13.831398+0000","last_became_active":"2024-09-19T06:13:03.788639+0000","last_became_peered":"2024-09-19T06:13:03.788639+0000","last_unstale":"2024-09-19T06:13:13.831398+0000","last_undegraded":"2024-09-19T06:13:13.831398+0000","last_fullsized":"2024-09-19T06:13:13.831398+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:18.692491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836740+0000","last_change":"2024-09-19T06:13:03.805264+0000","last_active":"2024-09-19T06:13:13.836740+0000","last_peered":"2024-09-19T06:13:13.836740+0000","last_clean":"2024-09-19T06:13:13.836740+0000","last_became_active":"2024-09-19T06:13:03.804948+0000","last_became_peered":"2024-09-19T06:13:03.804948+0000","last_unstale":"2024-09-19T06:13:13.836740+0000","last_undegraded":"2024-09-19T06:13:13.836740+0000","last_fullsized":"2024-09-19T06:13:13.836740+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:56:26.613785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.841510+0000","last_change":"2024-09-19T06:13:13.841110+0000","last_active":"2024-09-19T06:13:13.841510+0000","last_peered":"2024-09-19T06:13:13.841510+0000","last_clean":"2024-09-19T06:13:13.841510+0000","last_became_active":"2024-09-19T06:13:13.840736+0000","last_became_peered":"2024-09-19T06:13:13.840736+0000","last_unstale":"2024-09-19T06:13:13.841510+0000","last_undegraded":"2024-09-19T06:13:13.841510+0000","last_fullsized":"2024-09-19T06:13:13.841510+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:46.304692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.987340+0000","last_change":"2024-09-19T06:13:03.808432+0000","last_active":"2024-09-19T06:13:13.987340+0000","last_peered":"2024-09-19T06:13:13.987340+0000","last_clean":"2024-09-19T06:13:13.987340+0000","last_became_active":"2024-09-19T06:13:03.808120+0000","last_became_peered":"2024-09-19T06:13:03.808120+0000","last_unstale":"2024-09-19T06:13:13.987340+0000","last_undegraded":"2024-09-19T06:13:13.987340+0000","last_fullsized":"2024-09-19T06:13:13.987340+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:31.270525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.843937+0000","last_change":"2024-09-19T06:13:13.843937+0000","last_active":"2024-09-19T06:13:13.843937+0000","last_peered":"2024-09-19T06:13:13.843937+0000","last_clean":"2024-09-19T06:13:13.843937+0000","last_became_active":"2024-09-19T06:13:13.843541+0000","last_became_peered":"2024-09-19T06:13:13.843541+0000","last_unstale":"2024-09-19T06:13:13.843937+0000","last_undegraded":"2024-09-19T06:13:13.843937+0000","last_fullsized":"2024-09-19T06:13:13.843937+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:23.115055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837559+0000","last_change":"2024-09-19T06:13:03.803361+0000","last_active":"2024-09-19T06:13:13.837559+0000","last_peered":"2024-09-19T06:13:13.837559+0000","last_clean":"2024-09-19T06:13:13.837559+0000","last_became_active":"2024-09-19T06:13:03.802794+0000","last_became_peered":"2024-09-19T06:13:03.802794+0000","last_unstale":"2024-09-19T06:13:13.837559+0000","last_undegraded":"2024-09-19T06:13:13.837559+0000","last_fullsized":"2024-09-19T06:13:13.837559+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:53.126456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836847+0000","last_change":"2024-09-19T06:13:03.806163+0000","last_active":"2024-09-19T06:13:13.836847+0000","last_peered":"2024-09-19T06:13:13.836847+0000","last_clean":"2024-09-19T06:13:13.836847+0000","last_became_active":"2024-09-19T06:13:03.805406+0000","last_became_peered":"2024-09-19T06:13:03.805406+0000","last_unstale":"2024-09-19T06:13:13.836847+0000","last_undegraded":"2024-09-19T06:13:13.836847+0000","last_fullsized":"2024-09-19T06:13:13.836847+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:28:17.793408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.830616+0000","last_change":"2024-09-19T06:13:03.794617+0000","last_active":"2024-09-19T06:13:13.830616+0000","last_peered":"2024-09-19T06:13:13.830616+0000","last_clean":"2024-09-19T06:13:13.830616+0000","last_became_active":"2024-09-19T06:13:03.794264+0000","last_became_peered":"2024-09-19T06:13:03.794264+0000","last_unstale":"2024-09-19T06:13:13.830616+0000","last_undegraded":"2024-09-19T06:13:13.830616+0000","last_fullsized":"2024-09-19T06:13:13.830616+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:32.200624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834631+0000","last_change":"2024-09-19T06:13:03.792632+0000","last_active":"2024-09-19T06:13:13.834631+0000","last_peered":"2024-09-19T06:13:13.834631+0000","last_clean":"2024-09-19T06:13:13.834631+0000","last_became_active":"2024-09-19T06:13:03.792409+0000","last_became_peered":"2024-09-19T06:13:03.792409+0000","last_unstale":"2024-09-19T06:13:13.834631+0000","last_undegraded":"2024-09-19T06:13:13.834631+0000","last_fullsized":"2024-09-19T06:13:13.834631+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:01.193404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834588+0000","last_change":"2024-09-19T06:13:03.801784+0000","last_active":"2024-09-19T06:13:13.834588+0000","last_peered":"2024-09-19T06:13:13.834588+0000","last_clean":"2024-09-19T06:13:13.834588+0000","last_became_active":"2024-09-19T06:13:03.801350+0000","last_became_peered":"2024-09-19T06:13:03.801350+0000","last_unstale":"2024-09-19T06:13:13.834588+0000","last_undegraded":"2024-09-19T06:13:13.834588+0000","last_fullsized":"2024-09-19T06:13:13.834588+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:50:40.542264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.986643+0000","last_change":"2024-09-19T06:13:03.800069+0000","last_active":"2024-09-19T06:13:13.986643+0000","last_peered":"2024-09-19T06:13:13.986643+0000","last_clean":"2024-09-19T06:13:13.986643+0000","last_became_active":"2024-09-19T06:13:03.799690+0000","last_became_peered":"2024-09-19T06:13:03.799690+0000","last_unstale":"2024-09-19T06:13:13.986643+0000","last_undegraded":"2024-09-19T06:13:13.986643+0000","last_fullsized":"2024-09-19T06:13:13.986643+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:36:01.882849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834326+0000","last_change":"2024-09-19T06:13:03.800180+0000","last_active":"2024-09-19T06:13:13.834326+0000","last_peered":"2024-09-19T06:13:13.834326+0000","last_clean":"2024-09-19T06:13:13.834326+0000","last_became_active":"2024-09-19T06:13:03.798981+0000","last_became_peered":"2024-09-19T06:13:03.798981+0000","last_unstale":"2024-09-19T06:13:13.834326+0000","last_undegraded":"2024-09-19T06:13:13.834326+0000","last_fullsized":"2024-09-19T06:13:13.834326+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:29.241021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.833656+0000","last_change":"2024-09-19T06:13:03.796889+0000","last_active":"2024-09-19T06:13:13.833656+0000","last_peered":"2024-09-19T06:13:13.833656+0000","last_clean":"2024-09-19T06:13:13.833656+0000","last_became_active":"2024-09-19T06:13:03.796539+0000","last_became_peered":"2024-09-19T06:13:03.796539+0000","last_unstale":"2024-09-19T06:13:13.833656+0000","last_undegraded":"2024-09-19T06:13:13.833656+0000","last_fullsized":"2024-09-19T06:13:13.833656+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:10.462303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.841576+0000","last_change":"2024-09-19T06:13:03.798758+0000","last_active":"2024-09-19T06:13:13.841576+0000","last_peered":"2024-09-19T06:13:13.841576+0000","last_clean":"2024-09-19T06:13:13.841576+0000","last_became_active":"2024-09-19T06:13:03.798422+0000","last_became_peered":"2024-09-19T06:13:03.798422+0000","last_unstale":"2024-09-19T06:13:13.841576+0000","last_undegraded":"2024-09-19T06:13:13.841576+0000","last_fullsized":"2024-09-19T06:13:13.841576+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:03.712394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.833498+0000","last_change":"2024-09-19T06:13:03.800825+0000","last_active":"2024-09-19T06:13:13.833498+0000","last_peered":"2024-09-19T06:13:13.833498+0000","last_clean":"2024-09-19T06:13:13.833498+0000","last_became_active":"2024-09-19T06:13:03.800505+0000","last_became_peered":"2024-09-19T06:13:03.800505+0000","last_unstale":"2024-09-19T06:13:13.833498+0000","last_undegraded":"2024-09-19T06:13:13.833498+0000","last_fullsized":"2024-09-19T06:13:13.833498+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:15.640802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.830731+0000","last_change":"2024-09-19T06:13:03.797868+0000","last_active":"2024-09-19T06:13:13.830731+0000","last_peered":"2024-09-19T06:13:13.830731+0000","last_clean":"2024-09-19T06:13:13.830731+0000","last_became_active":"2024-09-19T06:13:03.797576+0000","last_became_peered":"2024-09-19T06:13:03.797576+0000","last_unstale":"2024-09-19T06:13:13.830731+0000","last_undegraded":"2024-09-19T06:13:13.830731+0000","last_fullsized":"2024-09-19T06:13:13.830731+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:29:18.953446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.986839+0000","last_change":"2024-09-19T06:13:03.805201+0000","last_active":"2024-09-19T06:13:13.986839+0000","last_peered":"2024-09-19T06:13:13.986839+0000","last_clean":"2024-09-19T06:13:13.986839+0000","last_became_active":"2024-09-19T06:13:03.803758+0000","last_became_peered":"2024-09-19T06:13:03.803758+0000","last_unstale":"2024-09-19T06:13:13.986839+0000","last_undegraded":"2024-09-19T06:13:13.986839+0000","last_fullsized":"2024-09-19T06:13:13.986839+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:49:26.088519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.986859+0000","last_change":"2024-09-19T06:13:03.796086+0000","last_active":"2024-09-19T06:13:13.986859+0000","last_peered":"2024-09-19T06:13:13.986859+0000","last_clean":"2024-09-19T06:13:13.986859+0000","last_became_active":"2024-09-19T06:13:03.795594+0000","last_became_peered":"2024-09-19T06:13:03.795594+0000","last_unstale":"2024-09-19T06:13:13.986859+0000","last_undegraded":"2024-09-19T06:13:13.986859+0000","last_fullsized":"2024-09-19T06:13:13.986859+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:26.374596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837062+0000","last_change":"2024-09-19T06:13:03.796727+0000","last_active":"2024-09-19T06:13:13.837062+0000","last_peered":"2024-09-19T06:13:13.837062+0000","last_clean":"2024-09-19T06:13:13.837062+0000","last_became_active":"2024-09-19T06:13:03.796334+0000","last_became_peered":"2024-09-19T06:13:03.796334+0000","last_unstale":"2024-09-19T06:13:13.837062+0000","last_undegraded":"2024-09-19T06:13:13.837062+0000","last_fullsized":"2024-09-19T06:13:13.837062+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:47.660748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.987433+0000","last_change":"2024-09-19T06:13:03.800994+0000","last_active":"2024-09-19T06:13:13.987433+0000","last_peered":"2024-09-19T06:13:13.987433+0000","last_clean":"2024-09-19T06:13:13.987433+0000","last_became_active":"2024-09-19T06:13:03.800690+0000","last_became_peered":"2024-09-19T06:13:03.800690+0000","last_unstale":"2024-09-19T06:13:13.987433+0000","last_undegraded":"2024-09-19T06:13:13.987433+0000","last_fullsized":"2024-09-19T06:13:13.987433+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:37.204106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.841755+0000","last_change":"2024-09-19T06:13:03.797503+0000","last_active":"2024-09-19T06:13:13.841755+0000","last_peered":"2024-09-19T06:13:13.841755+0000","last_clean":"2024-09-19T06:13:13.841755+0000","last_became_active":"2024-09-19T06:13:03.797189+0000","last_became_peered":"2024-09-19T06:13:03.797189+0000","last_unstale":"2024-09-19T06:13:13.841755+0000","last_undegraded":"2024-09-19T06:13:13.841755+0000","last_fullsized":"2024-09-19T06:13:13.841755+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:16:18.036236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.833849+0000","last_change":"2024-09-19T06:13:03.795462+0000","last_active":"2024-09-19T06:13:13.833849+0000","last_peered":"2024-09-19T06:13:13.833849+0000","last_clean":"2024-09-19T06:13:13.833849+0000","last_became_active":"2024-09-19T06:13:03.793882+0000","last_became_peered":"2024-09-19T06:13:03.793882+0000","last_unstale":"2024-09-19T06:13:13.833849+0000","last_undegraded":"2024-09-19T06:13:13.833849+0000","last_fullsized":"2024-09-19T06:13:13.833849+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:04.329608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.830520+0000","last_change":"2024-09-19T06:13:03.800425+0000","last_active":"2024-09-19T06:13:13.830520+0000","last_peered":"2024-09-19T06:13:13.830520+0000","last_clean":"2024-09-19T06:13:13.830520+0000","last_became_active":"2024-09-19T06:13:03.800061+0000","last_became_peered":"2024-09-19T06:13:03.800061+0000","last_unstale":"2024-09-19T06:13:13.830520+0000","last_undegraded":"2024-09-19T06:13:13.830520+0000","last_fullsized":"2024-09-19T06:13:13.830520+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:36.454869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834825+0000","last_change":"2024-09-19T06:13:03.801630+0000","last_active":"2024-09-19T06:13:13.834825+0000","last_peered":"2024-09-19T06:13:13.834825+0000","last_clean":"2024-09-19T06:13:13.834825+0000","last_became_active":"2024-09-19T06:13:03.801118+0000","last_became_peered":"2024-09-19T06:13:03.801118+0000","last_unstale":"2024-09-19T06:13:13.834825+0000","last_undegraded":"2024-09-19T06:13:13.834825+0000","last_fullsized":"2024-09-19T06:13:13.834825+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:52.641042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.840928+0000","last_change":"2024-09-19T06:13:03.793435+0000","last_active":"2024-09-19T06:13:13.840928+0000","last_peered":"2024-09-19T06:13:13.840928+0000","last_clean":"2024-09-19T06:13:13.840928+0000","last_became_active":"2024-09-19T06:13:03.793138+0000","last_became_peered":"2024-09-19T06:13:03.793138+0000","last_unstale":"2024-09-19T06:13:13.840928+0000","last_undegraded":"2024-09-19T06:13:13.840928+0000","last_fullsized":"2024-09-19T06:13:13.840928+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:40.967328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.841127+0000","last_change":"2024-09-19T06:13:03.800324+0000","last_active":"2024-09-19T06:13:13.841127+0000","last_peered":"2024-09-19T06:13:13.841127+0000","last_clean":"2024-09-19T06:13:13.841127+0000","last_became_active":"2024-09-19T06:13:03.799996+0000","last_became_peered":"2024-09-19T06:13:03.799996+0000","last_unstale":"2024-09-19T06:13:13.841127+0000","last_undegraded":"2024-09-19T06:13:13.841127+0000","last_fullsized":"2024-09-19T06:13:13.841127+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:04.012607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.833462+0000","last_change":"2024-09-19T06:13:03.794669+0000","last_active":"2024-09-19T06:13:13.833462+0000","last_peered":"2024-09-19T06:13:13.833462+0000","last_clean":"2024-09-19T06:13:13.833462+0000","last_became_active":"2024-09-19T06:13:03.794333+0000","last_became_peered":"2024-09-19T06:13:03.794333+0000","last_unstale":"2024-09-19T06:13:13.833462+0000","last_undegraded":"2024-09-19T06:13:13.833462+0000","last_fullsized":"2024-09-19T06:13:13.833462+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:27.690064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834261+0000","last_change":"2024-09-19T06:13:03.794058+0000","last_active":"2024-09-19T06:13:13.834261+0000","last_peered":"2024-09-19T06:13:13.834261+0000","last_clean":"2024-09-19T06:13:13.834261+0000","last_became_active":"2024-09-19T06:13:03.793710+0000","last_became_peered":"2024-09-19T06:13:03.793710+0000","last_unstale":"2024-09-19T06:13:13.834261+0000","last_undegraded":"2024-09-19T06:13:13.834261+0000","last_fullsized":"2024-09-19T06:13:13.834261+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:56:05.395718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"79'5","reported_seq":52,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:26.891902+0000","last_change":"2024-09-19T06:13:13.848686+0000","last_active":"2024-09-19T06:13:26.891902+0000","last_peered":"2024-09-19T06:13:26.891902+0000","last_clean":"2024-09-19T06:13:26.891902+0000","last_became_active":"2024-09-19T06:13:13.843205+0000","last_became_peered":"2024-09-19T06:13:13.843205+0000","last_unstale":"2024-09-19T06:13:26.891902+0000","last_undegraded":"2024-09-19T06:13:26.891902+0000","last_fullsized":"2024-09-19T06:13:26.891902+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:49.016417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836811+0000","last_change":"2024-09-19T06:13:03.801206+0000","last_active":"2024-09-19T06:13:13.836811+0000","last_peered":"2024-09-19T06:13:13.836811+0000","last_clean":"2024-09-19T06:13:13.836811+0000","last_became_active":"2024-09-19T06:13:03.800661+0000","last_became_peered":"2024-09-19T06:13:03.800661+0000","last_unstale":"2024-09-19T06:13:13.836811+0000","last_undegraded":"2024-09-19T06:13:13.836811+0000","last_fullsized":"2024-09-19T06:13:13.836811+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:28:11.187583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.831489+0000","last_change":"2024-09-19T06:13:01.656487+0000","last_active":"2024-09-19T06:13:13.831489+0000","last_peered":"2024-09-19T06:13:13.831489+0000","last_clean":"2024-09-19T06:13:13.831489+0000","last_became_active":"2024-09-19T06:13:01.656099+0000","last_became_peered":"2024-09-19T06:13:01.656099+0000","last_unstale":"2024-09-19T06:13:13.831489+0000","last_undegraded":"2024-09-19T06:13:13.831489+0000","last_fullsized":"2024-09-19T06:13:13.831489+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:01.437614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.830367+0000","last_change":"2024-09-19T06:13:01.656435+0000","last_active":"2024-09-19T06:13:13.830367+0000","last_peered":"2024-09-19T06:13:13.830367+0000","last_clean":"2024-09-19T06:13:13.830367+0000","last_became_active":"2024-09-19T06:13:01.655660+0000","last_became_peered":"2024-09-19T06:13:01.655660+0000","last_unstale":"2024-09-19T06:13:13.830367+0000","last_undegraded":"2024-09-19T06:13:13.830367+0000","last_fullsized":"2024-09-19T06:13:13.830367+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:35:06.211974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.986952+0000","last_change":"2024-09-19T06:13:03.784573+0000","last_active":"2024-09-19T06:13:13.986952+0000","last_peered":"2024-09-19T06:13:13.986952+0000","last_clean":"2024-09-19T06:13:13.986952+0000","last_became_active":"2024-09-19T06:13:03.784152+0000","last_became_peered":"2024-09-19T06:13:03.784152+0000","last_unstale":"2024-09-19T06:13:13.986952+0000","last_undegraded":"2024-09-19T06:13:13.986952+0000","last_fullsized":"2024-09-19T06:13:13.986952+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:28:39.606178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'1","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837384+0000","last_change":"2024-09-19T06:13:01.656150+0000","last_active":"2024-09-19T06:13:13.837384+0000","last_peered":"2024-09-19T06:13:13.837384+0000","last_clean":"2024-09-19T06:13:13.837384+0000","last_became_active":"2024-09-19T06:13:01.655826+0000","last_became_peered":"2024-09-19T06:13:01.655826+0000","last_unstale":"2024-09-19T06:13:13.837384+0000","last_undegraded":"2024-09-19T06:13:13.837384+0000","last_fullsized":"2024-09-19T06:13:13.837384+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:57.782393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.833363+0000","last_change":"2024-09-19T06:13:03.784567+0000","last_active":"2024-09-19T06:13:13.833363+0000","last_peered":"2024-09-19T06:13:13.833363+0000","last_clean":"2024-09-19T06:13:13.833363+0000","last_became_active":"2024-09-19T06:13:03.784187+0000","last_became_peered":"2024-09-19T06:13:03.784187+0000","last_unstale":"2024-09-19T06:13:13.833363+0000","last_undegraded":"2024-09-19T06:13:13.833363+0000","last_fullsized":"2024-09-19T06:13:13.833363+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:21.037052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'3","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:26.891382+0000","last_change":"2024-09-19T06:13:01.659641+0000","last_active":"2024-09-19T06:13:26.891382+0000","last_peered":"2024-09-19T06:13:26.891382+0000","last_clean":"2024-09-19T06:13:26.891382+0000","last_became_active":"2024-09-19T06:13:01.659338+0000","last_became_peered":"2024-09-19T06:13:01.659338+0000","last_unstale":"2024-09-19T06:13:26.891382+0000","last_undegraded":"2024-09-19T06:13:26.891382+0000","last_fullsized":"2024-09-19T06:13:26.891382+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:26.230690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.987249+0000","last_change":"2024-09-19T06:13:03.797095+0000","last_active":"2024-09-19T06:13:13.987249+0000","last_peered":"2024-09-19T06:13:13.987249+0000","last_clean":"2024-09-19T06:13:13.987249+0000","last_became_active":"2024-09-19T06:13:03.796588+0000","last_became_peered":"2024-09-19T06:13:03.796588+0000","last_unstale":"2024-09-19T06:13:13.987249+0000","last_undegraded":"2024-09-19T06:13:13.987249+0000","last_fullsized":"2024-09-19T06:13:13.987249+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:33.705210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836583+0000","last_change":"2024-09-19T06:13:01.659995+0000","last_active":"2024-09-19T06:13:13.836583+0000","last_peered":"2024-09-19T06:13:13.836583+0000","last_clean":"2024-09-19T06:13:13.836583+0000","last_became_active":"2024-09-19T06:13:01.659621+0000","last_became_peered":"2024-09-19T06:13:01.659621+0000","last_unstale":"2024-09-19T06:13:13.836583+0000","last_undegraded":"2024-09-19T06:13:13.836583+0000","last_fullsized":"2024-09-19T06:13:13.836583+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:44.893111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.835148+0000","last_change":"2024-09-19T06:13:03.800859+0000","last_active":"2024-09-19T06:13:13.835148+0000","last_peered":"2024-09-19T06:13:13.835148+0000","last_clean":"2024-09-19T06:13:13.835148+0000","last_became_active":"2024-09-19T06:13:03.800540+0000","last_became_peered":"2024-09-19T06:13:03.800540+0000","last_unstale":"2024-09-19T06:13:13.835148+0000","last_undegraded":"2024-09-19T06:13:13.835148+0000","last_fullsized":"2024-09-19T06:13:13.835148+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:25:11.198557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'4","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837224+0000","last_change":"2024-09-19T06:13:01.654666+0000","last_active":"2024-09-19T06:13:13.837224+0000","last_peered":"2024-09-19T06:13:13.837224+0000","last_clean":"2024-09-19T06:13:13.837224+0000","last_became_active":"2024-09-19T06:13:01.654241+0000","last_became_peered":"2024-09-19T06:13:01.654241+0000","last_unstale":"2024-09-19T06:13:13.837224+0000","last_undegraded":"2024-09-19T06:13:13.837224+0000","last_fullsized":"2024-09-19T06:13:13.837224+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:45.211100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.986872+0000","last_change":"2024-09-19T06:13:03.799906+0000","last_active":"2024-09-19T06:13:13.986872+0000","last_peered":"2024-09-19T06:13:13.986872+0000","last_clean":"2024-09-19T06:13:13.986872+0000","last_became_active":"2024-09-19T06:13:03.799566+0000","last_became_peered":"2024-09-19T06:13:03.799566+0000","last_unstale":"2024-09-19T06:13:13.986872+0000","last_undegraded":"2024-09-19T06:13:13.986872+0000","last_fullsized":"2024-09-19T06:13:13.986872+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:34.268480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'25","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:27.985594+0000","last_change":"2024-09-19T06:13:01.657204+0000","last_active":"2024-09-19T06:13:27.985594+0000","last_peered":"2024-09-19T06:13:27.985594+0000","last_clean":"2024-09-19T06:13:27.985594+0000","last_became_active":"2024-09-19T06:13:01.656886+0000","last_became_peered":"2024-09-19T06:13:01.656886+0000","last_unstale":"2024-09-19T06:13:27.985594+0000","last_undegraded":"2024-09-19T06:13:27.985594+0000","last_fullsized":"2024-09-19T06:13:27.985594+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:32:18.033428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54954,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":60,"num_write":26,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834343+0000","last_change":"2024-09-19T06:13:03.798605+0000","last_active":"2024-09-19T06:13:13.834343+0000","last_peered":"2024-09-19T06:13:13.834343+0000","last_clean":"2024-09-19T06:13:13.834343+0000","last_became_active":"2024-09-19T06:13:03.798022+0000","last_became_peered":"2024-09-19T06:13:03.798022+0000","last_unstale":"2024-09-19T06:13:13.834343+0000","last_undegraded":"2024-09-19T06:13:13.834343+0000","last_fullsized":"2024-09-19T06:13:13.834343+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:10.094031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.841613+0000","last_change":"2024-09-19T06:13:01.652192+0000","last_active":"2024-09-19T06:13:13.841613+0000","last_peered":"2024-09-19T06:13:13.841613+0000","last_clean":"2024-09-19T06:13:13.841613+0000","last_became_active":"2024-09-19T06:13:01.651774+0000","last_became_peered":"2024-09-19T06:13:01.651774+0000","last_unstale":"2024-09-19T06:13:13.841613+0000","last_undegraded":"2024-09-19T06:13:13.841613+0000","last_fullsized":"2024-09-19T06:13:13.841613+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:39:47.683863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.830386+0000","last_change":"2024-09-19T06:13:03.798674+0000","last_active":"2024-09-19T06:13:13.830386+0000","last_peered":"2024-09-19T06:13:13.830386+0000","last_clean":"2024-09-19T06:13:13.830386+0000","last_became_active":"2024-09-19T06:13:03.798397+0000","last_became_peered":"2024-09-19T06:13:03.798397+0000","last_unstale":"2024-09-19T06:13:13.830386+0000","last_undegraded":"2024-09-19T06:13:13.830386+0000","last_fullsized":"2024-09-19T06:13:13.830386+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:37.155730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836668+0000","last_change":"2024-09-19T06:13:01.655777+0000","last_active":"2024-09-19T06:13:13.836668+0000","last_peered":"2024-09-19T06:13:13.836668+0000","last_clean":"2024-09-19T06:13:13.836668+0000","last_became_active":"2024-09-19T06:13:01.655420+0000","last_became_peered":"2024-09-19T06:13:01.655420+0000","last_unstale":"2024-09-19T06:13:13.836668+0000","last_undegraded":"2024-09-19T06:13:13.836668+0000","last_fullsized":"2024-09-19T06:13:13.836668+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:02.593204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836731+0000","last_change":"2024-09-19T06:13:03.803799+0000","last_active":"2024-09-19T06:13:13.836731+0000","last_peered":"2024-09-19T06:13:13.836731+0000","last_clean":"2024-09-19T06:13:13.836731+0000","last_became_active":"2024-09-19T06:13:03.803350+0000","last_became_peered":"2024-09-19T06:13:03.803350+0000","last_unstale":"2024-09-19T06:13:13.836731+0000","last_undegraded":"2024-09-19T06:13:13.836731+0000","last_fullsized":"2024-09-19T06:13:13.836731+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:15.806363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'3","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:27.893741+0000","last_change":"2024-09-19T06:13:01.656007+0000","last_active":"2024-09-19T06:13:27.893741+0000","last_peered":"2024-09-19T06:13:27.893741+0000","last_clean":"2024-09-19T06:13:27.893741+0000","last_became_active":"2024-09-19T06:13:01.655642+0000","last_became_peered":"2024-09-19T06:13:01.655642+0000","last_unstale":"2024-09-19T06:13:27.893741+0000","last_undegraded":"2024-09-19T06:13:27.893741+0000","last_fullsized":"2024-09-19T06:13:27.893741+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:54.391122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836490+0000","last_change":"2024-09-19T06:13:03.804426+0000","last_active":"2024-09-19T06:13:13.836490+0000","last_peered":"2024-09-19T06:13:13.836490+0000","last_clean":"2024-09-19T06:13:13.836490+0000","last_became_active":"2024-09-19T06:13:03.804146+0000","last_became_peered":"2024-09-19T06:13:03.804146+0000","last_unstale":"2024-09-19T06:13:13.836490+0000","last_undegraded":"2024-09-19T06:13:13.836490+0000","last_fullsized":"2024-09-19T06:13:13.836490+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:56.198679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834205+0000","last_change":"2024-09-19T06:13:01.650023+0000","last_active":"2024-09-19T06:13:13.834205+0000","last_peered":"2024-09-19T06:13:13.834205+0000","last_clean":"2024-09-19T06:13:13.834205+0000","last_became_active":"2024-09-19T06:13:01.649674+0000","last_became_peered":"2024-09-19T06:13:01.649674+0000","last_unstale":"2024-09-19T06:13:13.834205+0000","last_undegraded":"2024-09-19T06:13:13.834205+0000","last_fullsized":"2024-09-19T06:13:13.834205+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:56:11.164070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836300+0000","last_change":"2024-09-19T06:13:03.802078+0000","last_active":"2024-09-19T06:13:13.836300+0000","last_peered":"2024-09-19T06:13:13.836300+0000","last_clean":"2024-09-19T06:13:13.836300+0000","last_became_active":"2024-09-19T06:13:03.801552+0000","last_became_peered":"2024-09-19T06:13:03.801552+0000","last_unstale":"2024-09-19T06:13:13.836300+0000","last_undegraded":"2024-09-19T06:13:13.836300+0000","last_fullsized":"2024-09-19T06:13:13.836300+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:57.025457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:17.875451+0000","last_change":"2024-09-19T06:13:13.843721+0000","last_active":"2024-09-19T06:13:17.875451+0000","last_peered":"2024-09-19T06:13:17.875451+0000","last_clean":"2024-09-19T06:13:17.875451+0000","last_became_active":"2024-09-19T06:13:13.838567+0000","last_became_peered":"2024-09-19T06:13:13.838567+0000","last_unstale":"2024-09-19T06:13:17.875451+0000","last_undegraded":"2024-09-19T06:13:17.875451+0000","last_fullsized":"2024-09-19T06:13:17.875451+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:44.479675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.833649+0000","last_change":"2024-09-19T06:13:03.801534+0000","last_active":"2024-09-19T06:13:13.833649+0000","last_peered":"2024-09-19T06:13:13.833649+0000","last_clean":"2024-09-19T06:13:13.833649+0000","last_became_active":"2024-09-19T06:13:03.801142+0000","last_became_peered":"2024-09-19T06:13:03.801142+0000","last_unstale":"2024-09-19T06:13:13.833649+0000","last_undegraded":"2024-09-19T06:13:13.833649+0000","last_fullsized":"2024-09-19T06:13:13.833649+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:45.029662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.830492+0000","last_change":"2024-09-19T06:13:01.655075+0000","last_active":"2024-09-19T06:13:13.830492+0000","last_peered":"2024-09-19T06:13:13.830492+0000","last_clean":"2024-09-19T06:13:13.830492+0000","last_became_active":"2024-09-19T06:13:01.649236+0000","last_became_peered":"2024-09-19T06:13:01.649236+0000","last_unstale":"2024-09-19T06:13:13.830492+0000","last_undegraded":"2024-09-19T06:13:13.830492+0000","last_fullsized":"2024-09-19T06:13:13.830492+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:06.007418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836658+0000","last_change":"2024-09-19T06:13:03.795674+0000","last_active":"2024-09-19T06:13:13.836658+0000","last_peered":"2024-09-19T06:13:13.836658+0000","last_clean":"2024-09-19T06:13:13.836658+0000","last_became_active":"2024-09-19T06:13:03.794843+0000","last_became_peered":"2024-09-19T06:13:03.794843+0000","last_unstale":"2024-09-19T06:13:13.836658+0000","last_undegraded":"2024-09-19T06:13:13.836658+0000","last_fullsized":"2024-09-19T06:13:13.836658+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:41:57.669988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837389+0000","last_change":"2024-09-19T06:13:01.656696+0000","last_active":"2024-09-19T06:13:13.837389+0000","last_peered":"2024-09-19T06:13:13.837389+0000","last_clean":"2024-09-19T06:13:13.837389+0000","last_became_active":"2024-09-19T06:13:01.655260+0000","last_became_peered":"2024-09-19T06:13:01.655260+0000","last_unstale":"2024-09-19T06:13:13.837389+0000","last_undegraded":"2024-09-19T06:13:13.837389+0000","last_fullsized":"2024-09-19T06:13:13.837389+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:50.281013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837373+0000","last_change":"2024-09-19T06:13:03.804411+0000","last_active":"2024-09-19T06:13:13.837373+0000","last_peered":"2024-09-19T06:13:13.837373+0000","last_clean":"2024-09-19T06:13:13.837373+0000","last_became_active":"2024-09-19T06:13:03.804052+0000","last_became_peered":"2024-09-19T06:13:03.804052+0000","last_unstale":"2024-09-19T06:13:13.837373+0000","last_undegraded":"2024-09-19T06:13:13.837373+0000","last_fullsized":"2024-09-19T06:13:13.837373+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:33.394141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.841525+0000","last_change":"2024-09-19T06:13:01.655164+0000","last_active":"2024-09-19T06:13:13.841525+0000","last_peered":"2024-09-19T06:13:13.841525+0000","last_clean":"2024-09-19T06:13:13.841525+0000","last_became_active":"2024-09-19T06:13:01.654297+0000","last_became_peered":"2024-09-19T06:13:01.654297+0000","last_unstale":"2024-09-19T06:13:13.841525+0000","last_undegraded":"2024-09-19T06:13:13.841525+0000","last_fullsized":"2024-09-19T06:13:13.841525+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:02:02.861982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837562+0000","last_change":"2024-09-19T06:13:03.802799+0000","last_active":"2024-09-19T06:13:13.837562+0000","last_peered":"2024-09-19T06:13:13.837562+0000","last_clean":"2024-09-19T06:13:13.837562+0000","last_became_active":"2024-09-19T06:13:03.802348+0000","last_became_peered":"2024-09-19T06:13:03.802348+0000","last_unstale":"2024-09-19T06:13:13.837562+0000","last_undegraded":"2024-09-19T06:13:13.837562+0000","last_fullsized":"2024-09-19T06:13:13.837562+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:05:52.685874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":345,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837478+0000","last_change":"2024-09-19T06:11:51.805685+0000","last_active":"2024-09-19T06:13:13.837478+0000","last_peered":"2024-09-19T06:13:13.837478+0000","last_clean":"2024-09-19T06:13:13.837478+0000","last_became_active":"2024-09-19T06:11:51.805191+0000","last_became_peered":"2024-09-19T06:11:51.805191+0000","last_unstale":"2024-09-19T06:13:13.837478+0000","last_undegraded":"2024-09-19T06:13:13.837478+0000","last_fullsized":"2024-09-19T06:13:13.837478+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:08:28.556644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:08:28.556644+0000","last_clean_scrub_stamp":"2024-09-19T06:08:28.556644+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:19.169542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:17.875306+0000","last_change":"2024-09-19T06:13:01.656796+0000","last_active":"2024-09-19T06:13:17.875306+0000","last_peered":"2024-09-19T06:13:17.875306+0000","last_clean":"2024-09-19T06:13:17.875306+0000","last_became_active":"2024-09-19T06:13:01.656350+0000","last_became_peered":"2024-09-19T06:13:01.656350+0000","last_unstale":"2024-09-19T06:13:17.875306+0000","last_undegraded":"2024-09-19T06:13:17.875306+0000","last_fullsized":"2024-09-19T06:13:17.875306+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:19:03.820218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.986968+0000","last_change":"2024-09-19T06:13:03.793697+0000","last_active":"2024-09-19T06:13:13.986968+0000","last_peered":"2024-09-19T06:13:13.986968+0000","last_clean":"2024-09-19T06:13:13.986968+0000","last_became_active":"2024-09-19T06:13:03.793378+0000","last_became_peered":"2024-09-19T06:13:03.793378+0000","last_unstale":"2024-09-19T06:13:13.986968+0000","last_undegraded":"2024-09-19T06:13:13.986968+0000","last_fullsized":"2024-09-19T06:13:13.986968+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:29:44.236255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836624+0000","last_change":"2024-09-19T06:13:01.658035+0000","last_active":"2024-09-19T06:13:13.836624+0000","last_peered":"2024-09-19T06:13:13.836624+0000","last_clean":"2024-09-19T06:13:13.836624+0000","last_became_active":"2024-09-19T06:13:01.657602+0000","last_became_peered":"2024-09-19T06:13:01.657602+0000","last_unstale":"2024-09-19T06:13:13.836624+0000","last_undegraded":"2024-09-19T06:13:13.836624+0000","last_fullsized":"2024-09-19T06:13:13.836624+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:27.015086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.830368+0000","last_change":"2024-09-19T06:13:03.793377+0000","last_active":"2024-09-19T06:13:13.830368+0000","last_peered":"2024-09-19T06:13:13.830368+0000","last_clean":"2024-09-19T06:13:13.830368+0000","last_became_active":"2024-09-19T06:13:03.793047+0000","last_became_peered":"2024-09-19T06:13:03.793047+0000","last_unstale":"2024-09-19T06:13:13.830368+0000","last_undegraded":"2024-09-19T06:13:13.830368+0000","last_fullsized":"2024-09-19T06:13:13.830368+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:22.883358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:27.893233+0000","last_change":"2024-09-19T06:13:01.650179+0000","last_active":"2024-09-19T06:13:27.893233+0000","last_peered":"2024-09-19T06:13:27.893233+0000","last_clean":"2024-09-19T06:13:27.893233+0000","last_became_active":"2024-09-19T06:13:01.649889+0000","last_became_peered":"2024-09-19T06:13:01.649889+0000","last_unstale":"2024-09-19T06:13:27.893233+0000","last_undegraded":"2024-09-19T06:13:27.893233+0000","last_fullsized":"2024-09-19T06:13:27.893233+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:55:00.400406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837144+0000","last_change":"2024-09-19T06:13:03.800277+0000","last_active":"2024-09-19T06:13:13.837144+0000","last_peered":"2024-09-19T06:13:13.837144+0000","last_clean":"2024-09-19T06:13:13.837144+0000","last_became_active":"2024-09-19T06:13:03.799862+0000","last_became_peered":"2024-09-19T06:13:03.799862+0000","last_unstale":"2024-09-19T06:13:13.837144+0000","last_undegraded":"2024-09-19T06:13:13.837144+0000","last_fullsized":"2024-09-19T06:13:13.837144+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:51.558276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837565+0000","last_change":"2024-09-19T06:13:01.659592+0000","last_active":"2024-09-19T06:13:13.837565+0000","last_peered":"2024-09-19T06:13:13.837565+0000","last_clean":"2024-09-19T06:13:13.837565+0000","last_became_active":"2024-09-19T06:13:01.659258+0000","last_became_peered":"2024-09-19T06:13:01.659258+0000","last_unstale":"2024-09-19T06:13:13.837565+0000","last_undegraded":"2024-09-19T06:13:13.837565+0000","last_fullsized":"2024-09-19T06:13:13.837565+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:46.097656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.831602+0000","last_change":"2024-09-19T06:13:03.793100+0000","last_active":"2024-09-19T06:13:13.831602+0000","last_peered":"2024-09-19T06:13:13.831602+0000","last_clean":"2024-09-19T06:13:13.831602+0000","last_became_active":"2024-09-19T06:13:03.792768+0000","last_became_peered":"2024-09-19T06:13:03.792768+0000","last_unstale":"2024-09-19T06:13:13.831602+0000","last_undegraded":"2024-09-19T06:13:13.831602+0000","last_fullsized":"2024-09-19T06:13:13.831602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:11:36.122712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.833570+0000","last_change":"2024-09-19T06:13:01.650511+0000","last_active":"2024-09-19T06:13:13.833570+0000","last_peered":"2024-09-19T06:13:13.833570+0000","last_clean":"2024-09-19T06:13:13.833570+0000","last_became_active":"2024-09-19T06:13:01.650099+0000","last_became_peered":"2024-09-19T06:13:01.650099+0000","last_unstale":"2024-09-19T06:13:13.833570+0000","last_undegraded":"2024-09-19T06:13:13.833570+0000","last_fullsized":"2024-09-19T06:13:13.833570+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:16.386025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.831722+0000","last_change":"2024-09-19T06:13:03.783690+0000","last_active":"2024-09-19T06:13:13.831722+0000","last_peered":"2024-09-19T06:13:13.831722+0000","last_clean":"2024-09-19T06:13:13.831722+0000","last_became_active":"2024-09-19T06:13:03.783296+0000","last_became_peered":"2024-09-19T06:13:03.783296+0000","last_unstale":"2024-09-19T06:13:13.831722+0000","last_undegraded":"2024-09-19T06:13:13.831722+0000","last_fullsized":"2024-09-19T06:13:13.831722+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:49:19.605979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"79'1","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834623+0000","last_change":"2024-09-19T06:13:01.648671+0000","last_active":"2024-09-19T06:13:13.834623+0000","last_peered":"2024-09-19T06:13:13.834623+0000","last_clean":"2024-09-19T06:13:13.834623+0000","last_became_active":"2024-09-19T06:13:01.647329+0000","last_became_peered":"2024-09-19T06:13:01.647329+0000","last_unstale":"2024-09-19T06:13:13.834623+0000","last_undegraded":"2024-09-19T06:13:13.834623+0000","last_fullsized":"2024-09-19T06:13:13.834623+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:31.026561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.830593+0000","last_change":"2024-09-19T06:13:03.795195+0000","last_active":"2024-09-19T06:13:13.830593+0000","last_peered":"2024-09-19T06:13:13.830593+0000","last_clean":"2024-09-19T06:13:13.830593+0000","last_became_active":"2024-09-19T06:13:03.794882+0000","last_became_peered":"2024-09-19T06:13:03.794882+0000","last_unstale":"2024-09-19T06:13:13.830593+0000","last_undegraded":"2024-09-19T06:13:13.830593+0000","last_fullsized":"2024-09-19T06:13:13.830593+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:47.290917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'10","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:26.796685+0000","last_change":"2024-09-19T06:13:01.652133+0000","last_active":"2024-09-19T06:13:26.796685+0000","last_peered":"2024-09-19T06:13:26.796685+0000","last_clean":"2024-09-19T06:13:26.796685+0000","last_became_active":"2024-09-19T06:13:01.651796+0000","last_became_peered":"2024-09-19T06:13:01.651796+0000","last_unstale":"2024-09-19T06:13:26.796685+0000","last_undegraded":"2024-09-19T06:13:26.796685+0000","last_fullsized":"2024-09-19T06:13:26.796685+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:01.576308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.987457+0000","last_change":"2024-09-19T06:13:03.799332+0000","last_active":"2024-09-19T06:13:13.987457+0000","last_peered":"2024-09-19T06:13:13.987457+0000","last_clean":"2024-09-19T06:13:13.987457+0000","last_became_active":"2024-09-19T06:13:03.798996+0000","last_became_peered":"2024-09-19T06:13:03.798996+0000","last_unstale":"2024-09-19T06:13:13.987457+0000","last_undegraded":"2024-09-19T06:13:13.987457+0000","last_fullsized":"2024-09-19T06:13:13.987457+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:37:32.245396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836564+0000","last_change":"2024-09-19T06:13:01.652392+0000","last_active":"2024-09-19T06:13:13.836564+0000","last_peered":"2024-09-19T06:13:13.836564+0000","last_clean":"2024-09-19T06:13:13.836564+0000","last_became_active":"2024-09-19T06:13:01.651982+0000","last_became_peered":"2024-09-19T06:13:01.651982+0000","last_unstale":"2024-09-19T06:13:13.836564+0000","last_undegraded":"2024-09-19T06:13:13.836564+0000","last_fullsized":"2024-09-19T06:13:13.836564+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:15:39.590215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.988765+0000","last_change":"2024-09-19T06:13:13.988765+0000","last_active":"2024-09-19T06:13:13.988765+0000","last_peered":"2024-09-19T06:13:13.988765+0000","last_clean":"2024-09-19T06:13:13.988765+0000","last_became_active":"2024-09-19T06:13:13.988328+0000","last_became_peered":"2024-09-19T06:13:13.988328+0000","last_unstale":"2024-09-19T06:13:13.988765+0000","last_undegraded":"2024-09-19T06:13:13.988765+0000","last_fullsized":"2024-09-19T06:13:13.988765+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:10.219202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.986807+0000","last_change":"2024-09-19T06:13:01.658954+0000","last_active":"2024-09-19T06:13:13.986807+0000","last_peered":"2024-09-19T06:13:13.986807+0000","last_clean":"2024-09-19T06:13:13.986807+0000","last_became_active":"2024-09-19T06:13:01.658453+0000","last_became_peered":"2024-09-19T06:13:01.658453+0000","last_unstale":"2024-09-19T06:13:13.986807+0000","last_undegraded":"2024-09-19T06:13:13.986807+0000","last_fullsized":"2024-09-19T06:13:13.986807+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:17.134858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834131+0000","last_change":"2024-09-19T06:13:03.786812+0000","last_active":"2024-09-19T06:13:13.834131+0000","last_peered":"2024-09-19T06:13:13.834131+0000","last_clean":"2024-09-19T06:13:13.834131+0000","last_became_active":"2024-09-19T06:13:03.786481+0000","last_became_peered":"2024-09-19T06:13:03.786481+0000","last_unstale":"2024-09-19T06:13:13.834131+0000","last_undegraded":"2024-09-19T06:13:13.834131+0000","last_fullsized":"2024-09-19T06:13:13.834131+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:46.614073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.986953+0000","last_change":"2024-09-19T06:13:01.652062+0000","last_active":"2024-09-19T06:13:13.986953+0000","last_peered":"2024-09-19T06:13:13.986953+0000","last_clean":"2024-09-19T06:13:13.986953+0000","last_became_active":"2024-09-19T06:13:01.651718+0000","last_became_peered":"2024-09-19T06:13:01.651718+0000","last_unstale":"2024-09-19T06:13:13.986953+0000","last_undegraded":"2024-09-19T06:13:13.986953+0000","last_fullsized":"2024-09-19T06:13:13.986953+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:22.428954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.833537+0000","last_change":"2024-09-19T06:13:03.792868+0000","last_active":"2024-09-19T06:13:13.833537+0000","last_peered":"2024-09-19T06:13:13.833537+0000","last_clean":"2024-09-19T06:13:13.833537+0000","last_became_active":"2024-09-19T06:13:03.792482+0000","last_became_peered":"2024-09-19T06:13:03.792482+0000","last_unstale":"2024-09-19T06:13:13.833537+0000","last_undegraded":"2024-09-19T06:13:13.833537+0000","last_fullsized":"2024-09-19T06:13:13.833537+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:05:11.294500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.840945+0000","last_change":"2024-09-19T06:13:01.654572+0000","last_active":"2024-09-19T06:13:13.840945+0000","last_peered":"2024-09-19T06:13:13.840945+0000","last_clean":"2024-09-19T06:13:13.840945+0000","last_became_active":"2024-09-19T06:13:01.653865+0000","last_became_peered":"2024-09-19T06:13:01.653865+0000","last_unstale":"2024-09-19T06:13:13.840945+0000","last_undegraded":"2024-09-19T06:13:13.840945+0000","last_fullsized":"2024-09-19T06:13:13.840945+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:45.842230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.987135+0000","last_change":"2024-09-19T06:13:03.791077+0000","last_active":"2024-09-19T06:13:13.987135+0000","last_peered":"2024-09-19T06:13:13.987135+0000","last_clean":"2024-09-19T06:13:13.987135+0000","last_became_active":"2024-09-19T06:13:03.790710+0000","last_became_peered":"2024-09-19T06:13:03.790710+0000","last_unstale":"2024-09-19T06:13:13.987135+0000","last_undegraded":"2024-09-19T06:13:13.987135+0000","last_fullsized":"2024-09-19T06:13:13.987135+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:15:53.498311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.992580+0000","last_change":"2024-09-19T06:13:13.992222+0000","last_active":"2024-09-19T06:13:13.992580+0000","last_peered":"2024-09-19T06:13:13.992580+0000","last_clean":"2024-09-19T06:13:13.992580+0000","last_became_active":"2024-09-19T06:13:13.988046+0000","last_became_peered":"2024-09-19T06:13:13.988046+0000","last_unstale":"2024-09-19T06:13:13.992580+0000","last_undegraded":"2024-09-19T06:13:13.992580+0000","last_fullsized":"2024-09-19T06:13:13.992580+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:21:56.013401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837205+0000","last_change":"2024-09-19T06:13:03.808060+0000","last_active":"2024-09-19T06:13:13.837205+0000","last_peered":"2024-09-19T06:13:13.837205+0000","last_clean":"2024-09-19T06:13:13.837205+0000","last_became_active":"2024-09-19T06:13:03.807455+0000","last_became_peered":"2024-09-19T06:13:03.807455+0000","last_unstale":"2024-09-19T06:13:13.837205+0000","last_undegraded":"2024-09-19T06:13:13.837205+0000","last_fullsized":"2024-09-19T06:13:13.837205+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:27:19.172298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.988516+0000","last_change":"2024-09-19T06:13:13.987967+0000","last_active":"2024-09-19T06:13:13.988516+0000","last_peered":"2024-09-19T06:13:13.988516+0000","last_clean":"2024-09-19T06:13:13.988516+0000","last_became_active":"2024-09-19T06:13:13.987431+0000","last_became_peered":"2024-09-19T06:13:13.987431+0000","last_unstale":"2024-09-19T06:13:13.988516+0000","last_undegraded":"2024-09-19T06:13:13.988516+0000","last_fullsized":"2024-09-19T06:13:13.988516+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:05.785455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,1],"acting":[9,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834591+0000","last_change":"2024-09-19T06:13:01.658264+0000","last_active":"2024-09-19T06:13:13.834591+0000","last_peered":"2024-09-19T06:13:13.834591+0000","last_clean":"2024-09-19T06:13:13.834591+0000","last_became_active":"2024-09-19T06:13:01.657912+0000","last_became_peered":"2024-09-19T06:13:01.657912+0000","last_unstale":"2024-09-19T06:13:13.834591+0000","last_undegraded":"2024-09-19T06:13:13.834591+0000","last_fullsized":"2024-09-19T06:13:13.834591+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:19.618987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.986874+0000","last_change":"2024-09-19T06:13:03.791917+0000","last_active":"2024-09-19T06:13:13.986874+0000","last_peered":"2024-09-19T06:13:13.986874+0000","last_clean":"2024-09-19T06:13:13.986874+0000","last_became_active":"2024-09-19T06:13:03.791284+0000","last_became_peered":"2024-09-19T06:13:03.791284+0000","last_unstale":"2024-09-19T06:13:13.986874+0000","last_undegraded":"2024-09-19T06:13:13.986874+0000","last_fullsized":"2024-09-19T06:13:13.986874+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:29.685827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.851212+0000","last_change":"2024-09-19T06:13:13.850753+0000","last_active":"2024-09-19T06:13:13.851212+0000","last_peered":"2024-09-19T06:13:13.851212+0000","last_clean":"2024-09-19T06:13:13.851212+0000","last_became_active":"2024-09-19T06:13:13.843601+0000","last_became_peered":"2024-09-19T06:13:13.843601+0000","last_unstale":"2024-09-19T06:13:13.851212+0000","last_undegraded":"2024-09-19T06:13:13.851212+0000","last_fullsized":"2024-09-19T06:13:13.851212+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:11.452118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.835131+0000","last_change":"2024-09-19T06:13:03.798722+0000","last_active":"2024-09-19T06:13:13.835131+0000","last_peered":"2024-09-19T06:13:13.835131+0000","last_clean":"2024-09-19T06:13:13.835131+0000","last_became_active":"2024-09-19T06:13:03.798428+0000","last_became_peered":"2024-09-19T06:13:03.798428+0000","last_unstale":"2024-09-19T06:13:13.835131+0000","last_undegraded":"2024-09-19T06:13:13.835131+0000","last_fullsized":"2024-09-19T06:13:13.835131+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:11:15.179515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.987601+0000","last_change":"2024-09-19T06:13:01.651003+0000","last_active":"2024-09-19T06:13:13.987601+0000","last_peered":"2024-09-19T06:13:13.987601+0000","last_clean":"2024-09-19T06:13:13.987601+0000","last_became_active":"2024-09-19T06:13:01.650697+0000","last_became_peered":"2024-09-19T06:13:01.650697+0000","last_unstale":"2024-09-19T06:13:13.987601+0000","last_undegraded":"2024-09-19T06:13:13.987601+0000","last_fullsized":"2024-09-19T06:13:13.987601+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:47.982845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.987236+0000","last_change":"2024-09-19T06:13:03.796907+0000","last_active":"2024-09-19T06:13:13.987236+0000","last_peered":"2024-09-19T06:13:13.987236+0000","last_clean":"2024-09-19T06:13:13.987236+0000","last_became_active":"2024-09-19T06:13:03.796426+0000","last_became_peered":"2024-09-19T06:13:03.796426+0000","last_unstale":"2024-09-19T06:13:13.987236+0000","last_undegraded":"2024-09-19T06:13:13.987236+0000","last_fullsized":"2024-09-19T06:13:13.987236+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:26.455773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.833916+0000","last_change":"2024-09-19T06:13:01.654788+0000","last_active":"2024-09-19T06:13:13.833916+0000","last_peered":"2024-09-19T06:13:13.833916+0000","last_clean":"2024-09-19T06:13:13.833916+0000","last_became_active":"2024-09-19T06:13:01.654461+0000","last_became_peered":"2024-09-19T06:13:01.654461+0000","last_unstale":"2024-09-19T06:13:13.833916+0000","last_undegraded":"2024-09-19T06:13:13.833916+0000","last_fullsized":"2024-09-19T06:13:13.833916+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:41.374288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":58564,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":92,"num_read_kb":101,"num_write":156,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":644,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":175692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612625,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":880640,"data_stored":430117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841558,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28548,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716604,"statfs":{"total":95995035648,"available":95965802496,"internally_reserved":0,"allocated":1560576,"data_stored":1068378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005084,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":430331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234017,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":888832,"data_stored":430229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462949,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28476,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716676,"statfs":{"total":95995035648,"available":95965876224,"internally_reserved":0,"allocated":1486848,"data_stored":1021790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593771,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40364,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704788,"statfs":{"total":95995035648,"available":95953702912,"internally_reserved":0,"allocated":880640,"data_stored":429720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822703,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28488,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716664,"statfs":{"total":95995035648,"available":95965863936,"internally_reserved":0,"allocated":1499136,"data_stored":1021474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986229,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":892928,"data_stored":430779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215162,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":897024,"data_stored":430031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444095,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":485195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":929792,"data_stored":476315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":901120,"data_stored":430991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":54954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":55682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":56532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:13:31.928 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T06:13:31.929 INFO:tasks.cephadm:Setting up client nodes... 2024-09-19T06:13:31.929 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-19T06:13:32.191 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:32.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:31 smithi002 ceph-mon[30982]: pgmap v290: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.4 KiB/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T06:13:32.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:31 smithi090 ceph-mon[34497]: pgmap v290: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.4 KiB/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T06:13:32.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:31 smithi089 ceph-mon[34160]: pgmap v290: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.4 KiB/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T06:13:32.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.638+0000 7f761af1a640 1 -- 172.21.15.2:0/4238891920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7614104fc0 msgr2=0x7f76141073b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:32.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.638+0000 7f761af1a640 1 --2- 172.21.15.2:0/4238891920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7614104fc0 0x7f76141073b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f75fc009900 tx=0x7f75fc02a410 comp rx=0 tx=0).stop 2024-09-19T06:13:32.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.638+0000 7f761af1a640 1 -- 172.21.15.2:0/4238891920 shutdown_connections 2024-09-19T06:13:32.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.639+0000 7f761af1a640 1 --2- 172.21.15.2:0/4238891920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76141078f0 0x7f7614109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:32.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.639+0000 7f761af1a640 1 --2- 172.21.15.2:0/4238891920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7614104fc0 0x7f76141073b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:32.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.639+0000 7f761af1a640 1 --2- 172.21.15.2:0/4238891920 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7614102690 0x7f7614104a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:32.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.639+0000 7f761af1a640 1 -- 172.21.15.2:0/4238891920 >> 172.21.15.2:0/4238891920 conn(0x7f76140fc290 msgr2=0x7f76140fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:32.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.639+0000 7f761af1a640 1 -- 172.21.15.2:0/4238891920 shutdown_connections 2024-09-19T06:13:32.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.639+0000 7f761af1a640 1 -- 172.21.15.2:0/4238891920 wait complete. 2024-09-19T06:13:32.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.639+0000 7f761af1a640 1 Processor -- start 2024-09-19T06:13:32.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.639+0000 7f761af1a640 1 -- start start 2024-09-19T06:13:32.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.640+0000 7f761af1a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7614102690 0x7f7614197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:32.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.640+0000 7f761af1a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7614104fc0 0x7f7614198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:32.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.640+0000 7f761af1a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76141078f0 0x7f761419f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:32.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.640+0000 7f761af1a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f761410d7b0 con 0x7f76141078f0 2024-09-19T06:13:32.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.640+0000 7f761af1a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f761410d630 con 0x7f7614102690 2024-09-19T06:13:32.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.640+0000 7f761af1a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f761410d930 con 0x7f7614104fc0 2024-09-19T06:13:32.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.640+0000 7f76194b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76141078f0 0x7f761419f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:32.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.640+0000 7f7618cb6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7614102690 0x7f7614197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:32.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.640+0000 7f7618cb6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7614102690 0x7f7614197f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:43946/0 (socket says 172.21.15.2:43946) 2024-09-19T06:13:32.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.640+0000 7f76194b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76141078f0 0x7f761419f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35070/0 (socket says 172.21.15.2:35070) 2024-09-19T06:13:32.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.640+0000 7f7618cb6640 1 -- 172.21.15.2:0/4019741188 learned_addr learned my addr 172.21.15.2:0/4019741188 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:13:32.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.640+0000 7f7613fff640 1 --2- 172.21.15.2:0/4019741188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7614104fc0 0x7f7614198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:32.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.640+0000 7f76194b7640 1 -- 172.21.15.2:0/4019741188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7614104fc0 msgr2=0x7f7614198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:32.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.640+0000 7f76194b7640 1 --2- 172.21.15.2:0/4019741188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7614104fc0 0x7f7614198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:32.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.640+0000 7f76194b7640 1 -- 172.21.15.2:0/4019741188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7614102690 msgr2=0x7f7614197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:32.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.640+0000 7f76194b7640 1 --2- 172.21.15.2:0/4019741188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7614102690 0x7f7614197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:32.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.640+0000 7f76194b7640 1 -- 172.21.15.2:0/4019741188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f761419fb80 con 0x7f76141078f0 2024-09-19T06:13:32.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.640+0000 7f7613fff640 1 --2- 172.21.15.2:0/4019741188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7614104fc0 0x7f7614198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:13:32.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.640+0000 7f76194b7640 1 --2- 172.21.15.2:0/4019741188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76141078f0 0x7f761419f510 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f760c00b410 tx=0x7f760c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:32.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.640+0000 7f7611ffb640 1 -- 172.21.15.2:0/4019741188 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f760c015020 con 0x7f76141078f0 2024-09-19T06:13:32.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.641+0000 7f7611ffb640 1 -- 172.21.15.2:0/4019741188 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f760c011ce0 con 0x7f76141078f0 2024-09-19T06:13:32.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.641+0000 7f761af1a640 1 -- 172.21.15.2:0/4019741188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f761419fe70 con 0x7f76141078f0 2024-09-19T06:13:32.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.641+0000 7f7611ffb640 1 -- 172.21.15.2:0/4019741188 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f760c010da0 con 0x7f76141078f0 2024-09-19T06:13:32.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.641+0000 7f761af1a640 1 -- 172.21.15.2:0/4019741188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76141a0350 con 0x7f76141078f0 2024-09-19T06:13:32.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.642+0000 7f761af1a640 1 -- 172.21.15.2:0/4019741188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76140fdd80 con 0x7f76141078f0 2024-09-19T06:13:32.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.643+0000 7f7611ffb640 1 -- 172.21.15.2:0/4019741188 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f760c018020 con 0x7f76141078f0 2024-09-19T06:13:32.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.643+0000 7f7611ffb640 1 --2- 172.21.15.2:0/4019741188 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f76000a3300 0x7f76000a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:32.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.644+0000 7f7611ffb640 1 -- 172.21.15.2:0/4019741188 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f760c0cf160 con 0x7f76141078f0 2024-09-19T06:13:32.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.644+0000 7f7618cb6640 1 --2- 172.21.15.2:0/4019741188 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f76000a3300 0x7f76000a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:32.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.644+0000 7f7618cb6640 1 --2- 172.21.15.2:0/4019741188 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f76000a3300 0x7f76000a57c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7604009270 tx=0x7f7604009700 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:32.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.648+0000 7f7611ffb640 1 -- 172.21.15.2:0/4019741188 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f760c01f020 con 0x7f76141078f0 2024-09-19T06:13:32.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.892+0000 7f761af1a640 1 -- 172.21.15.2:0/4019741188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f761402d970 con 0x7f76141078f0 2024-09-19T06:13:32.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.894+0000 7f7611ffb640 1 -- 172.21.15.2:0/4019741188 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f760c09be40 con 0x7f76141078f0 2024-09-19T06:13:32.896 INFO:teuthology.orchestra.run.smithi002.stdout:[client.0] 2024-09-19T06:13:32.896 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQAMwetmYmpKNRAA/qhbTL3YlSFxCj91Vr+J4A== 2024-09-19T06:13:32.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.896+0000 7f761af1a640 1 -- 172.21.15.2:0/4019741188 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f76000a3300 msgr2=0x7f76000a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:32.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.896+0000 7f761af1a640 1 --2- 172.21.15.2:0/4019741188 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f76000a3300 0x7f76000a57c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7604009270 tx=0x7f7604009700 comp rx=0 tx=0).stop 2024-09-19T06:13:32.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.896+0000 7f761af1a640 1 -- 172.21.15.2:0/4019741188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76141078f0 msgr2=0x7f761419f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:32.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.896+0000 7f761af1a640 1 --2- 172.21.15.2:0/4019741188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76141078f0 0x7f761419f510 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f760c00b410 tx=0x7f760c00b8d0 comp rx=0 tx=0).stop 2024-09-19T06:13:32.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.897+0000 7f761af1a640 1 -- 172.21.15.2:0/4019741188 shutdown_connections 2024-09-19T06:13:32.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.897+0000 7f761af1a640 1 --2- 172.21.15.2:0/4019741188 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f76000a3300 0x7f76000a57c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:32.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.897+0000 7f761af1a640 1 --2- 172.21.15.2:0/4019741188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76141078f0 0x7f761419f510 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:32.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.897+0000 7f761af1a640 1 --2- 172.21.15.2:0/4019741188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7614104fc0 0x7f7614198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:32.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.897+0000 7f761af1a640 1 --2- 172.21.15.2:0/4019741188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7614102690 0x7f7614197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:32.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.897+0000 7f761af1a640 1 -- 172.21.15.2:0/4019741188 >> 172.21.15.2:0/4019741188 conn(0x7f76140fc290 msgr2=0x7f76141030f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:32.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.897+0000 7f761af1a640 1 -- 172.21.15.2:0/4019741188 shutdown_connections 2024-09-19T06:13:32.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:32.897+0000 7f761af1a640 1 -- 172.21.15.2:0/4019741188 wait complete. 2024-09-19T06:13:33.211 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:32 smithi002 ceph-mon[30982]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:13:33.211 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:32 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/4019741188' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T06:13:33.211 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:32 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/4019741188' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T06:13:33.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:32 smithi090 ceph-mon[34497]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:13:33.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:32 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/4019741188' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T06:13:33.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:32 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/4019741188' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T06:13:33.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:32 smithi089 ceph-mon[34160]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:13:33.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:32 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/4019741188' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T06:13:33.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:32 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/4019741188' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T06:13:33.520 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-19T06:13:33.520 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-19T06:13:33.520 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-19T06:13:33.561 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-19T06:13:33.561 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-19T06:13:33.562 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-19T06:13:33.859 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:34.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:33 smithi002 ceph-mon[30982]: pgmap v291: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.6 KiB/s wr, 7 op/s 2024-09-19T06:13:34.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:33 smithi090 ceph-mon[34497]: pgmap v291: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.6 KiB/s wr, 7 op/s 2024-09-19T06:13:34.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:33 smithi089 ceph-mon[34160]: pgmap v291: 97 pgs: 97 active+clean; 634 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.6 KiB/s wr, 7 op/s 2024-09-19T06:13:34.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.328+0000 7f59ab928640 1 -- 172.21.15.2:0/3240318429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59a4101df0 msgr2=0x7f59a41021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:34.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.328+0000 7f59ab928640 1 --2- 172.21.15.2:0/3240318429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59a4101df0 0x7f59a41021d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f59a0009900 tx=0x7f59a002a410 comp rx=0 tx=0).stop 2024-09-19T06:13:34.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.329+0000 7f59ab928640 1 -- 172.21.15.2:0/3240318429 shutdown_connections 2024-09-19T06:13:34.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.329+0000 7f59ab928640 1 --2- 172.21.15.2:0/3240318429 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59a4106f20 0x7f59a410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:34.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.329+0000 7f59ab928640 1 --2- 172.21.15.2:0/3240318429 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59a41027a0 0x7f59a41067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:34.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.329+0000 7f59ab928640 1 --2- 172.21.15.2:0/3240318429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59a4101df0 0x7f59a41021d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:34.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.329+0000 7f59ab928640 1 -- 172.21.15.2:0/3240318429 >> 172.21.15.2:0/3240318429 conn(0x7f59a40fd8b0 msgr2=0x7f59a40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:34.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.329+0000 7f59ab928640 1 -- 172.21.15.2:0/3240318429 shutdown_connections 2024-09-19T06:13:34.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.329+0000 7f59ab928640 1 -- 172.21.15.2:0/3240318429 wait complete. 2024-09-19T06:13:34.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.329+0000 7f59ab928640 1 Processor -- start 2024-09-19T06:13:34.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.329+0000 7f59ab928640 1 -- start start 2024-09-19T06:13:34.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.330+0000 7f59ab928640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59a4101df0 0x7f59a419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:34.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.330+0000 7f59ab928640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59a41027a0 0x7f59a419a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:34.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.330+0000 7f59ab928640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59a4106f20 0x7f59a419ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:34.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.330+0000 7f59ab928640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f59a4111e30 con 0x7f59a41027a0 2024-09-19T06:13:34.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.330+0000 7f59ab928640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f59a4111cb0 con 0x7f59a4106f20 2024-09-19T06:13:34.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.330+0000 7f59ab928640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f59a4111fb0 con 0x7f59a4101df0 2024-09-19T06:13:34.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.330+0000 7f59a8ec3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59a41027a0 0x7f59a419a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:34.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.330+0000 7f59a9ec5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59a4106f20 0x7f59a419ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:34.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.330+0000 7f59a9ec5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59a4106f20 0x7f59a419ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:43964/0 (socket says 172.21.15.2:43964) 2024-09-19T06:13:34.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.330+0000 7f59a9ec5640 1 -- 172.21.15.2:0/3626102847 learned_addr learned my addr 172.21.15.2:0/3626102847 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:13:34.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.331+0000 7f59a96c4640 1 --2- 172.21.15.2:0/3626102847 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59a4101df0 0x7f59a419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:34.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.331+0000 7f59a9ec5640 1 -- 172.21.15.2:0/3626102847 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59a4101df0 msgr2=0x7f59a419a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:34.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.331+0000 7f59a9ec5640 1 --2- 172.21.15.2:0/3626102847 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59a4101df0 0x7f59a419a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:34.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.331+0000 7f59a9ec5640 1 -- 172.21.15.2:0/3626102847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59a41027a0 msgr2=0x7f59a419a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:34.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.331+0000 7f59a9ec5640 1 --2- 172.21.15.2:0/3626102847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59a41027a0 0x7f59a419a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:34.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.331+0000 7f59a9ec5640 1 -- 172.21.15.2:0/3626102847 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a419f450 con 0x7f59a4106f20 2024-09-19T06:13:34.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.331+0000 7f59a9ec5640 1 --2- 172.21.15.2:0/3626102847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59a4106f20 0x7f59a419ed70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f599c00cad0 tx=0x7f599c00ced0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:34.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.331+0000 7f599a7fc640 1 -- 172.21.15.2:0/3626102847 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f599c00ad60 con 0x7f59a4106f20 2024-09-19T06:13:34.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.331+0000 7f59ab928640 1 -- 172.21.15.2:0/3626102847 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59a419f740 con 0x7f59a4106f20 2024-09-19T06:13:34.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.331+0000 7f599a7fc640 1 -- 172.21.15.2:0/3626102847 <== mon.2 v2:172.21.15.89:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f599c005020 con 0x7f59a4106f20 2024-09-19T06:13:34.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.331+0000 7f599a7fc640 1 -- 172.21.15.2:0/3626102847 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f599c00f6b0 con 0x7f59a4106f20 2024-09-19T06:13:34.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.331+0000 7f59ab928640 1 -- 172.21.15.2:0/3626102847 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59a41a7020 con 0x7f59a4106f20 2024-09-19T06:13:34.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.332+0000 7f59ab928640 1 -- 172.21.15.2:0/3626102847 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59a41021d0 con 0x7f59a4106f20 2024-09-19T06:13:34.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.334+0000 7f599a7fc640 1 -- 172.21.15.2:0/3626102847 <== mon.2 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f599c0051d0 con 0x7f59a4106f20 2024-09-19T06:13:34.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.335+0000 7f599a7fc640 1 --2- 172.21.15.2:0/3626102847 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f59900a32d0 0x7f59900a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:34.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.335+0000 7f59a96c4640 1 --2- 172.21.15.2:0/3626102847 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f59900a32d0 0x7f59900a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:34.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.335+0000 7f599a7fc640 1 -- 172.21.15.2:0/3626102847 <== mon.2 v2:172.21.15.89:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f599c0cfda0 con 0x7f59a4106f20 2024-09-19T06:13:34.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.335+0000 7f59a96c4640 1 --2- 172.21.15.2:0/3626102847 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f59900a32d0 0x7f59900a5790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f59a0031440 tx=0x7f59a0005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:34.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.338+0000 7f599a7fc640 1 -- 172.21.15.2:0/3626102847 <== mon.2 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f599c014030 con 0x7f59a4106f20 2024-09-19T06:13:34.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.565+0000 7f59ab928640 1 -- 172.21.15.2:0/3626102847 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f59a419b800 con 0x7f59a4106f20 2024-09-19T06:13:34.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.569+0000 7f599a7fc640 1 -- 172.21.15.2:0/3626102847 <== mon.2 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264038 (secure 0 0 0) 0x7f59a419b800 con 0x7f59a4106f20 2024-09-19T06:13:34.574 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:13:34.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.572+0000 7f59ab928640 1 -- 172.21.15.2:0/3626102847 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f59900a32d0 msgr2=0x7f59900a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:34.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.572+0000 7f59ab928640 1 --2- 172.21.15.2:0/3626102847 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f59900a32d0 0x7f59900a5790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f59a0031440 tx=0x7f59a0005e80 comp rx=0 tx=0).stop 2024-09-19T06:13:34.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.572+0000 7f59ab928640 1 -- 172.21.15.2:0/3626102847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59a4106f20 msgr2=0x7f59a419ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:34.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.572+0000 7f59ab928640 1 --2- 172.21.15.2:0/3626102847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59a4106f20 0x7f59a419ed70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f599c00cad0 tx=0x7f599c00ced0 comp rx=0 tx=0).stop 2024-09-19T06:13:34.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.572+0000 7f59ab928640 1 -- 172.21.15.2:0/3626102847 shutdown_connections 2024-09-19T06:13:34.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.572+0000 7f59ab928640 1 --2- 172.21.15.2:0/3626102847 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f59900a32d0 0x7f59900a5790 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:34.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.572+0000 7f59ab928640 1 --2- 172.21.15.2:0/3626102847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59a4106f20 0x7f59a419ed70 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:34.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.572+0000 7f59ab928640 1 --2- 172.21.15.2:0/3626102847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59a41027a0 0x7f59a419a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:34.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.572+0000 7f59ab928640 1 --2- 172.21.15.2:0/3626102847 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59a4101df0 0x7f59a419a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:34.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.572+0000 7f59ab928640 1 -- 172.21.15.2:0/3626102847 >> 172.21.15.2:0/3626102847 conn(0x7f59a40fd8b0 msgr2=0x7f59a40ffc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:34.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.572+0000 7f59ab928640 1 -- 172.21.15.2:0/3626102847 shutdown_connections 2024-09-19T06:13:34.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:34.572+0000 7f59ab928640 1 -- 172.21.15.2:0/3626102847 wait complete. 2024-09-19T06:13:35.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:34 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/3626102847' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T06:13:35.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:34 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/3626102847' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T06:13:35.268 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4180340554},{"type":"v1","addr":"172.21.15.2:6801","nonce":4180340554}]},"active_addr":"172.21.15.2:6801/4180340554","active_change":"2024-09-19T06:06:11.912734+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24106,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24107,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.2:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":2508383651}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":2134106196}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":3813883133}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":2612001712}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":2365642}]}]} 2024-09-19T06:13:35.274 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-19T06:13:35.274 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-19T06:13:35.274 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:13:35.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:34 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/3626102847' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T06:13:35.533 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:36.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.003+0000 7fe18a558640 1 -- 172.21.15.2:0/410207209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe184106f10 msgr2=0x7fe18410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:36.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.003+0000 7fe18a558640 1 --2- 172.21.15.2:0/410207209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe184106f10 0x7fe18410ea90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe17c009ca0 tx=0x7fe17c02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:13:36.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.003+0000 7fe18a558640 1 -- 172.21.15.2:0/410207209 shutdown_connections 2024-09-19T06:13:36.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.003+0000 7fe18a558640 1 --2- 172.21.15.2:0/410207209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe184106f10 0x7fe18410ea90 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:36.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.003+0000 7fe18a558640 1 --2- 172.21.15.2:0/410207209 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe184102790 0x7fe1841067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:36.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.003+0000 7fe18a558640 1 --2- 172.21.15.2:0/410207209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe184101de0 0x7fe1841021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:36.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.003+0000 7fe18a558640 1 -- 172.21.15.2:0/410207209 >> 172.21.15.2:0/410207209 conn(0x7fe1840fd8c0 msgr2=0x7fe1840ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:36.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.003+0000 7fe18a558640 1 -- 172.21.15.2:0/410207209 shutdown_connections 2024-09-19T06:13:36.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.003+0000 7fe18a558640 1 -- 172.21.15.2:0/410207209 wait complete. 2024-09-19T06:13:36.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.004+0000 7fe18a558640 1 Processor -- start 2024-09-19T06:13:36.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.004+0000 7fe18a558640 1 -- start start 2024-09-19T06:13:36.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.004+0000 7fe18a558640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe184101de0 0x7fe184198200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:36.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.004+0000 7fe18a558640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe184102790 0x7fe184198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:36.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.004+0000 7fe18a558640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe184106f10 0x7fe18419cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:36.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.004+0000 7fe18a558640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe184111e20 con 0x7fe184102790 2024-09-19T06:13:36.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.004+0000 7fe18a558640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe184111ca0 con 0x7fe184106f10 2024-09-19T06:13:36.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.004+0000 7fe18a558640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe184111fa0 con 0x7fe184101de0 2024-09-19T06:13:36.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.004+0000 7fe1837fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe184102790 0x7fe184198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:36.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.004+0000 7fe1837fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe184102790 0x7fe184198740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51716/0 (socket says 172.21.15.2:51716) 2024-09-19T06:13:36.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.004+0000 7fe1837fe640 1 -- 172.21.15.2:0/1647371464 learned_addr learned my addr 172.21.15.2:0/1647371464 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:13:36.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.004+0000 7fe188af5640 1 --2- 172.21.15.2:0/1647371464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe184106f10 0x7fe18419cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:36.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.004+0000 7fe183fff640 1 --2- 172.21.15.2:0/1647371464 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe184101de0 0x7fe184198200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:36.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.005+0000 7fe1837fe640 1 -- 172.21.15.2:0/1647371464 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe184101de0 msgr2=0x7fe184198200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:36.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.005+0000 7fe1837fe640 1 --2- 172.21.15.2:0/1647371464 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe184101de0 0x7fe184198200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:36.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.005+0000 7fe1837fe640 1 -- 172.21.15.2:0/1647371464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe184106f10 msgr2=0x7fe18419cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:36.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.005+0000 7fe1837fe640 1 --2- 172.21.15.2:0/1647371464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe184106f10 0x7fe18419cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:36.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.005+0000 7fe1837fe640 1 -- 172.21.15.2:0/1647371464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe18419d1b0 con 0x7fe184102790 2024-09-19T06:13:36.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.005+0000 7fe188af5640 1 --2- 172.21.15.2:0/1647371464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe184106f10 0x7fe18419cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:13:36.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.005+0000 7fe1837fe640 1 --2- 172.21.15.2:0/1647371464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe184102790 0x7fe184198740 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe17800c920 tx=0x7fe17800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:36.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.005+0000 7fe1817fa640 1 -- 172.21.15.2:0/1647371464 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe178007c70 con 0x7fe184102790 2024-09-19T06:13:36.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.005+0000 7fe18a558640 1 -- 172.21.15.2:0/1647371464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe18419d4a0 con 0x7fe184102790 2024-09-19T06:13:36.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.005+0000 7fe1817fa640 1 -- 172.21.15.2:0/1647371464 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe178007e10 con 0x7fe184102790 2024-09-19T06:13:36.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.005+0000 7fe1817fa640 1 -- 172.21.15.2:0/1647371464 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe178018820 con 0x7fe184102790 2024-09-19T06:13:36.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.005+0000 7fe18a558640 1 -- 172.21.15.2:0/1647371464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1841a4d80 con 0x7fe184102790 2024-09-19T06:13:36.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.006+0000 7fe18a558640 1 -- 172.21.15.2:0/1647371464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1841021c0 con 0x7fe184102790 2024-09-19T06:13:36.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.007+0000 7fe1817fa640 1 -- 172.21.15.2:0/1647371464 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fe1780189c0 con 0x7fe184102790 2024-09-19T06:13:36.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.008+0000 7fe1817fa640 1 --2- 172.21.15.2:0/1647371464 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fe16c0a32d0 0x7fe16c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:36.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.008+0000 7fe183fff640 1 --2- 172.21.15.2:0/1647371464 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fe16c0a32d0 0x7fe16c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:36.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.008+0000 7fe1817fa640 1 -- 172.21.15.2:0/1647371464 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7fe1780cfc50 con 0x7fe184102790 2024-09-19T06:13:36.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.008+0000 7fe183fff640 1 --2- 172.21.15.2:0/1647371464 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fe16c0a32d0 0x7fe16c0a5790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe174005e10 tx=0x7fe174005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:36.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.012+0000 7fe1817fa640 1 -- 172.21.15.2:0/1647371464 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe178014030 con 0x7fe184102790 2024-09-19T06:13:36.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.190+0000 7fe18a558640 1 -- 172.21.15.2:0/1647371464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe1841a5010 con 0x7fe184102790 2024-09-19T06:13:36.192 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:35 smithi002 ceph-mon[30982]: pgmap v292: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.0 KiB/s wr, 9 op/s 2024-09-19T06:13:36.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.191+0000 7fe1817fa640 1 -- 172.21.15.2:0/1647371464 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22577 (secure 0 0 0) 0x7fe17809c820 con 0x7fe184102790 2024-09-19T06:13:36.193 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:13:36.193 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":81,"fsid":"078f6612-764d-11ef-bceb-c7b262605968","created":"2024-09-19T06:05:17.607927+0000","modified":"2024-09-19T06:13:13.827600+0000","last_up_change":"2024-09-19T06:12:13.856684+0000","last_in_change":"2024-09-19T06:11:49.745266+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:08:28.425566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:13:00.482789+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:13:02.768221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0de97a3d-2d27-455b-9998-ddd2319c148d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6803","nonce":915165910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6805","nonce":915165910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6809","nonce":915165910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6807","nonce":915165910}]},"public_addr":"172.21.15.2:6803/915165910","cluster_addr":"172.21.15.2:6805/915165910","heartbeat_back_addr":"172.21.15.2:6809/915165910","heartbeat_front_addr":"172.21.15.2:6807/915165910","state":["exists","up"]},{"osd":1,"uuid":"056d229e-2de4-4902-922e-21e1a5d3f061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6801","nonce":4097264171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6803","nonce":4097264171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6807","nonce":4097264171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6805","nonce":4097264171}]},"public_addr":"172.21.15.89:6801/4097264171","cluster_addr":"172.21.15.89:6803/4097264171","heartbeat_back_addr":"172.21.15.89:6807/4097264171","heartbeat_front_addr":"172.21.15.89:6805/4097264171","state":["exists","up"]},{"osd":2,"uuid":"2a4e7147-4125-4ee6-b5ad-85518d7066d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6801","nonce":1479908200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6803","nonce":1479908200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6807","nonce":1479908200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6805","nonce":1479908200}]},"public_addr":"172.21.15.90:6801/1479908200","cluster_addr":"172.21.15.90:6803/1479908200","heartbeat_back_addr":"172.21.15.90:6807/1479908200","heartbeat_front_addr":"172.21.15.90:6805/1479908200","state":["exists","up"]},{"osd":3,"uuid":"7b3da775-0f0a-4b46-a8dc-9ec822a54301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6811","nonce":1796948193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6813","nonce":1796948193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6817","nonce":1796948193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6815","nonce":1796948193}]},"public_addr":"172.21.15.2:6811/1796948193","cluster_addr":"172.21.15.2:6813/1796948193","heartbeat_back_addr":"172.21.15.2:6817/1796948193","heartbeat_front_addr":"172.21.15.2:6815/1796948193","state":["exists","up"]},{"osd":4,"uuid":"d4c8bafc-c844-4ff1-a3d8-7a53576e6b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6809","nonce":4256848315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6811","nonce":4256848315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6815","nonce":4256848315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6813","nonce":4256848315}]},"public_addr":"172.21.15.89:6809/4256848315","cluster_addr":"172.21.15.89:6811/4256848315","heartbeat_back_addr":"172.21.15.89:6815/4256848315","heartbeat_front_addr":"172.21.15.89:6813/4256848315","state":["exists","up"]},{"osd":5,"uuid":"8dc9bb55-29e0-4b04-9415-3b9bb5ed05cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6809","nonce":189855967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6811","nonce":189855967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6815","nonce":189855967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6813","nonce":189855967}]},"public_addr":"172.21.15.90:6809/189855967","cluster_addr":"172.21.15.90:6811/189855967","heartbeat_back_addr":"172.21.15.90:6815/189855967","heartbeat_front_addr":"172.21.15.90:6813/189855967","state":["exists","up"]},{"osd":6,"uuid":"86d1443a-9b43-46de-abd7-4c95b43207f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6819","nonce":3886336279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6821","nonce":3886336279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6825","nonce":3886336279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6823","nonce":3886336279}]},"public_addr":"172.21.15.2:6819/3886336279","cluster_addr":"172.21.15.2:6821/3886336279","heartbeat_back_addr":"172.21.15.2:6825/3886336279","heartbeat_front_addr":"172.21.15.2:6823/3886336279","state":["exists","up"]},{"osd":7,"uuid":"1cc5554c-80d2-4e77-b29a-fd2ada68d82d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6817","nonce":508513510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6819","nonce":508513510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6823","nonce":508513510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6821","nonce":508513510}]},"public_addr":"172.21.15.89:6817/508513510","cluster_addr":"172.21.15.89:6819/508513510","heartbeat_back_addr":"172.21.15.89:6823/508513510","heartbeat_front_addr":"172.21.15.89:6821/508513510","state":["exists","up"]},{"osd":8,"uuid":"e9b2eb92-9af2-4f26-a259-fcaf972e4fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6817","nonce":3558544480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6819","nonce":3558544480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6823","nonce":3558544480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6821","nonce":3558544480}]},"public_addr":"172.21.15.90:6817/3558544480","cluster_addr":"172.21.15.90:6819/3558544480","heartbeat_back_addr":"172.21.15.90:6823/3558544480","heartbeat_front_addr":"172.21.15.90:6821/3558544480","state":["exists","up"]},{"osd":9,"uuid":"194d4c64-dd29-4d35-bc54-0858c44815cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6827","nonce":2690758100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6829","nonce":2690758100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6833","nonce":2690758100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6831","nonce":2690758100}]},"public_addr":"172.21.15.2:6827/2690758100","cluster_addr":"172.21.15.2:6829/2690758100","heartbeat_back_addr":"172.21.15.2:6833/2690758100","heartbeat_front_addr":"172.21.15.2:6831/2690758100","state":["exists","up"]},{"osd":10,"uuid":"7695fa4a-b94e-4afc-b166-690a197ad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6825","nonce":1141925395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6827","nonce":1141925395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6831","nonce":1141925395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6829","nonce":1141925395}]},"public_addr":"172.21.15.89:6825/1141925395","cluster_addr":"172.21.15.89:6827/1141925395","heartbeat_back_addr":"172.21.15.89:6831/1141925395","heartbeat_front_addr":"172.21.15.89:6829/1141925395","state":["exists","up"]},{"osd":11,"uuid":"1815a999-bfdb-46b9-afcd-632ee8ba56d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6825","nonce":468380924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6827","nonce":468380924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6831","nonce":468380924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6829","nonce":468380924}]},"public_addr":"172.21.15.90:6825/468380924","cluster_addr":"172.21.15.90:6827/468380924","heartbeat_back_addr":"172.21.15.90:6831/468380924","heartbeat_front_addr":"172.21.15.90:6829/468380924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:07:36.125754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:01.415356+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:26.420808+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:51.722673+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:09:16.562300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:09:41.958465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:10:07.056167+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:10:32.066195+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:10:56.497875+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:11:21.973083+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:11:46.891515+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:12:11.910012+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9},{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/874985787":"2024-09-20T06:06:11.912585+0000","172.21.15.2:0/1280963020":"2024-09-20T06:06:11.912585+0000","172.21.15.2:0/2976372536":"2024-09-20T06:06:11.912585+0000","172.21.15.2:6801/1602650352":"2024-09-20T06:05:47.538477+0000","172.21.15.2:6800/1602650352":"2024-09-20T06:05:47.538477+0000","172.21.15.2:6800/1200011821":"2024-09-20T06:06:11.912585+0000","172.21.15.2:0/3899165140":"2024-09-20T06:05:47.538477+0000","172.21.15.2:6801/1200011821":"2024-09-20T06:06:11.912585+0000","172.21.15.2:0/1361067708":"2024-09-20T06:05:47.538477+0000","172.21.15.2:0/3763089457":"2024-09-20T06:05:47.538477+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:13:36.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.194+0000 7fe18a558640 1 -- 172.21.15.2:0/1647371464 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fe16c0a32d0 msgr2=0x7fe16c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:36.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.194+0000 7fe18a558640 1 --2- 172.21.15.2:0/1647371464 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fe16c0a32d0 0x7fe16c0a5790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe174005e10 tx=0x7fe174005da0 comp rx=0 tx=0).stop 2024-09-19T06:13:36.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.194+0000 7fe18a558640 1 -- 172.21.15.2:0/1647371464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe184102790 msgr2=0x7fe184198740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:36.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.194+0000 7fe18a558640 1 --2- 172.21.15.2:0/1647371464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe184102790 0x7fe184198740 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe17800c920 tx=0x7fe17800cde0 comp rx=0 tx=0).stop 2024-09-19T06:13:36.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.194+0000 7fe18a558640 1 -- 172.21.15.2:0/1647371464 shutdown_connections 2024-09-19T06:13:36.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.194+0000 7fe18a558640 1 --2- 172.21.15.2:0/1647371464 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fe16c0a32d0 0x7fe16c0a5790 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:36.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.194+0000 7fe18a558640 1 --2- 172.21.15.2:0/1647371464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe184106f10 0x7fe18419cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:36.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.194+0000 7fe18a558640 1 --2- 172.21.15.2:0/1647371464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe184102790 0x7fe184198740 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:36.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.194+0000 7fe18a558640 1 --2- 172.21.15.2:0/1647371464 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe184101de0 0x7fe184198200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:36.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.194+0000 7fe18a558640 1 -- 172.21.15.2:0/1647371464 >> 172.21.15.2:0/1647371464 conn(0x7fe1840fd8c0 msgr2=0x7fe1840fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:36.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.194+0000 7fe18a558640 1 -- 172.21.15.2:0/1647371464 shutdown_connections 2024-09-19T06:13:36.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:36.194+0000 7fe18a558640 1 -- 172.21.15.2:0/1647371464 wait complete. 2024-09-19T06:13:36.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:35 smithi090 ceph-mon[34497]: pgmap v292: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.0 KiB/s wr, 9 op/s 2024-09-19T06:13:36.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:35 smithi089 ceph-mon[34160]: pgmap v292: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.0 KiB/s wr, 9 op/s 2024-09-19T06:13:36.930 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-19T06:13:36.930 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:13:37.191 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:37.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:36 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1647371464' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:13:37.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:36 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1647371464' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:13:37.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:36 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1647371464' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:13:37.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.636+0000 7f2590eb2640 1 -- 172.21.15.2:0/3724183904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f258c103780 msgr2=0x7f258c107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:37.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.636+0000 7f2590eb2640 1 --2- 172.21.15.2:0/3724183904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f258c103780 0x7f258c107bc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2574009930 tx=0x7f257402a420 comp rx=0 tx=0).stop 2024-09-19T06:13:37.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.636+0000 7f2590eb2640 1 -- 172.21.15.2:0/3724183904 shutdown_connections 2024-09-19T06:13:37.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.636+0000 7f2590eb2640 1 --2- 172.21.15.2:0/3724183904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f258c108300 0x7f258c10ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:37.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.636+0000 7f2590eb2640 1 --2- 172.21.15.2:0/3724183904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f258c103780 0x7f258c107bc0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:37.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.636+0000 7f2590eb2640 1 --2- 172.21.15.2:0/3724183904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f258c102dd0 0x7f258c1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:37.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.636+0000 7f2590eb2640 1 -- 172.21.15.2:0/3724183904 >> 172.21.15.2:0/3724183904 conn(0x7f258c0fc7d0 msgr2=0x7f258c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:37.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.636+0000 7f2590eb2640 1 -- 172.21.15.2:0/3724183904 shutdown_connections 2024-09-19T06:13:37.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.636+0000 7f2590eb2640 1 -- 172.21.15.2:0/3724183904 wait complete. 2024-09-19T06:13:37.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.637+0000 7f2590eb2640 1 Processor -- start 2024-09-19T06:13:37.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.637+0000 7f2590eb2640 1 -- start start 2024-09-19T06:13:37.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.637+0000 7f2590eb2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f258c102dd0 0x7f258c198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:37.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.637+0000 7f2590eb2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f258c103780 0x7f258c198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:37.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.637+0000 7f2590eb2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f258c108300 0x7f258c19ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:37.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.637+0000 7f2590eb2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f258c111f80 con 0x7f258c103780 2024-09-19T06:13:37.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.637+0000 7f2590eb2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f258c111e00 con 0x7f258c102dd0 2024-09-19T06:13:37.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.637+0000 7f2590eb2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f258c112100 con 0x7f258c108300 2024-09-19T06:13:37.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.637+0000 7f2589d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f258c103780 0x7f258c198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:37.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.637+0000 7f2589d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f258c103780 0x7f258c198ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51732/0 (socket says 172.21.15.2:51732) 2024-09-19T06:13:37.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.637+0000 7f2589d9b640 1 -- 172.21.15.2:0/1182502237 learned_addr learned my addr 172.21.15.2:0/1182502237 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:13:37.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.637+0000 7f258a59c640 1 --2- 172.21.15.2:0/1182502237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f258c102dd0 0x7f258c198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:37.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.637+0000 7f258ad9d640 1 --2- 172.21.15.2:0/1182502237 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f258c108300 0x7f258c19ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:37.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.637+0000 7f2589d9b640 1 -- 172.21.15.2:0/1182502237 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f258c108300 msgr2=0x7f258c19ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:37.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.637+0000 7f2589d9b640 1 --2- 172.21.15.2:0/1182502237 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f258c108300 0x7f258c19ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:37.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.637+0000 7f2589d9b640 1 -- 172.21.15.2:0/1182502237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f258c102dd0 msgr2=0x7f258c198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:37.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.637+0000 7f2589d9b640 1 --2- 172.21.15.2:0/1182502237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f258c102dd0 0x7f258c198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:37.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.637+0000 7f2589d9b640 1 -- 172.21.15.2:0/1182502237 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f258c19d530 con 0x7f258c103780 2024-09-19T06:13:37.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.638+0000 7f2589d9b640 1 --2- 172.21.15.2:0/1182502237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f258c103780 0x7f258c198ac0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2574009230 tx=0x7f2574004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:37.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.638+0000 7f25837fe640 1 -- 172.21.15.2:0/1182502237 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f257403f030 con 0x7f258c103780 2024-09-19T06:13:37.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.638+0000 7f2590eb2640 1 -- 172.21.15.2:0/1182502237 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f258c19d7c0 con 0x7f258c103780 2024-09-19T06:13:37.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.638+0000 7f25837fe640 1 -- 172.21.15.2:0/1182502237 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f25740035f0 con 0x7f258c103780 2024-09-19T06:13:37.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.638+0000 7f25837fe640 1 -- 172.21.15.2:0/1182502237 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2574035070 con 0x7f258c103780 2024-09-19T06:13:37.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.638+0000 7f2590eb2640 1 -- 172.21.15.2:0/1182502237 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f258c100960 con 0x7f258c103780 2024-09-19T06:13:37.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.639+0000 7f2590eb2640 1 -- 172.21.15.2:0/1182502237 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f258c06a7b0 con 0x7f258c103780 2024-09-19T06:13:37.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.640+0000 7f25837fe640 1 -- 172.21.15.2:0/1182502237 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f2574003aa0 con 0x7f258c103780 2024-09-19T06:13:37.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.641+0000 7f25837fe640 1 --2- 172.21.15.2:0/1182502237 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f25780a32d0 0x7f25780a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:37.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.641+0000 7f258a59c640 1 --2- 172.21.15.2:0/1182502237 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f25780a32d0 0x7f25780a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:37.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.641+0000 7f25837fe640 1 -- 172.21.15.2:0/1182502237 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f25740effc0 con 0x7f258c103780 2024-09-19T06:13:37.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.641+0000 7f258a59c640 1 --2- 172.21.15.2:0/1182502237 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f25780a32d0 0x7f25780a5790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f257c005c40 tx=0x7f257c00a590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:37.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.645+0000 7f25837fe640 1 -- 172.21.15.2:0/1182502237 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f25740bc540 con 0x7f258c103780 2024-09-19T06:13:37.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.821+0000 7f2590eb2640 1 -- 172.21.15.2:0/1182502237 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f258c1998e0 con 0x7f258c103780 2024-09-19T06:13:37.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.822+0000 7f25837fe640 1 -- 172.21.15.2:0/1182502237 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22577 (secure 0 0 0) 0x7f25740c0840 con 0x7f258c103780 2024-09-19T06:13:37.825 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:13:37.825 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":81,"fsid":"078f6612-764d-11ef-bceb-c7b262605968","created":"2024-09-19T06:05:17.607927+0000","modified":"2024-09-19T06:13:13.827600+0000","last_up_change":"2024-09-19T06:12:13.856684+0000","last_in_change":"2024-09-19T06:11:49.745266+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:08:28.425566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:13:00.482789+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:13:02.768221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0de97a3d-2d27-455b-9998-ddd2319c148d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6803","nonce":915165910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6805","nonce":915165910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6809","nonce":915165910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6807","nonce":915165910}]},"public_addr":"172.21.15.2:6803/915165910","cluster_addr":"172.21.15.2:6805/915165910","heartbeat_back_addr":"172.21.15.2:6809/915165910","heartbeat_front_addr":"172.21.15.2:6807/915165910","state":["exists","up"]},{"osd":1,"uuid":"056d229e-2de4-4902-922e-21e1a5d3f061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6801","nonce":4097264171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6803","nonce":4097264171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6807","nonce":4097264171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6805","nonce":4097264171}]},"public_addr":"172.21.15.89:6801/4097264171","cluster_addr":"172.21.15.89:6803/4097264171","heartbeat_back_addr":"172.21.15.89:6807/4097264171","heartbeat_front_addr":"172.21.15.89:6805/4097264171","state":["exists","up"]},{"osd":2,"uuid":"2a4e7147-4125-4ee6-b5ad-85518d7066d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6801","nonce":1479908200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6803","nonce":1479908200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6807","nonce":1479908200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6805","nonce":1479908200}]},"public_addr":"172.21.15.90:6801/1479908200","cluster_addr":"172.21.15.90:6803/1479908200","heartbeat_back_addr":"172.21.15.90:6807/1479908200","heartbeat_front_addr":"172.21.15.90:6805/1479908200","state":["exists","up"]},{"osd":3,"uuid":"7b3da775-0f0a-4b46-a8dc-9ec822a54301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6811","nonce":1796948193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6813","nonce":1796948193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6817","nonce":1796948193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6815","nonce":1796948193}]},"public_addr":"172.21.15.2:6811/1796948193","cluster_addr":"172.21.15.2:6813/1796948193","heartbeat_back_addr":"172.21.15.2:6817/1796948193","heartbeat_front_addr":"172.21.15.2:6815/1796948193","state":["exists","up"]},{"osd":4,"uuid":"d4c8bafc-c844-4ff1-a3d8-7a53576e6b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6809","nonce":4256848315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6811","nonce":4256848315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6815","nonce":4256848315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6813","nonce":4256848315}]},"public_addr":"172.21.15.89:6809/4256848315","cluster_addr":"172.21.15.89:6811/4256848315","heartbeat_back_addr":"172.21.15.89:6815/4256848315","heartbeat_front_addr":"172.21.15.89:6813/4256848315","state":["exists","up"]},{"osd":5,"uuid":"8dc9bb55-29e0-4b04-9415-3b9bb5ed05cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6809","nonce":189855967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6811","nonce":189855967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6815","nonce":189855967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6813","nonce":189855967}]},"public_addr":"172.21.15.90:6809/189855967","cluster_addr":"172.21.15.90:6811/189855967","heartbeat_back_addr":"172.21.15.90:6815/189855967","heartbeat_front_addr":"172.21.15.90:6813/189855967","state":["exists","up"]},{"osd":6,"uuid":"86d1443a-9b43-46de-abd7-4c95b43207f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6819","nonce":3886336279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6821","nonce":3886336279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6825","nonce":3886336279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6823","nonce":3886336279}]},"public_addr":"172.21.15.2:6819/3886336279","cluster_addr":"172.21.15.2:6821/3886336279","heartbeat_back_addr":"172.21.15.2:6825/3886336279","heartbeat_front_addr":"172.21.15.2:6823/3886336279","state":["exists","up"]},{"osd":7,"uuid":"1cc5554c-80d2-4e77-b29a-fd2ada68d82d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6817","nonce":508513510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6819","nonce":508513510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6823","nonce":508513510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6821","nonce":508513510}]},"public_addr":"172.21.15.89:6817/508513510","cluster_addr":"172.21.15.89:6819/508513510","heartbeat_back_addr":"172.21.15.89:6823/508513510","heartbeat_front_addr":"172.21.15.89:6821/508513510","state":["exists","up"]},{"osd":8,"uuid":"e9b2eb92-9af2-4f26-a259-fcaf972e4fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6817","nonce":3558544480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6819","nonce":3558544480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6823","nonce":3558544480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6821","nonce":3558544480}]},"public_addr":"172.21.15.90:6817/3558544480","cluster_addr":"172.21.15.90:6819/3558544480","heartbeat_back_addr":"172.21.15.90:6823/3558544480","heartbeat_front_addr":"172.21.15.90:6821/3558544480","state":["exists","up"]},{"osd":9,"uuid":"194d4c64-dd29-4d35-bc54-0858c44815cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6827","nonce":2690758100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6829","nonce":2690758100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6833","nonce":2690758100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6831","nonce":2690758100}]},"public_addr":"172.21.15.2:6827/2690758100","cluster_addr":"172.21.15.2:6829/2690758100","heartbeat_back_addr":"172.21.15.2:6833/2690758100","heartbeat_front_addr":"172.21.15.2:6831/2690758100","state":["exists","up"]},{"osd":10,"uuid":"7695fa4a-b94e-4afc-b166-690a197ad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6825","nonce":1141925395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6827","nonce":1141925395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6831","nonce":1141925395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6829","nonce":1141925395}]},"public_addr":"172.21.15.89:6825/1141925395","cluster_addr":"172.21.15.89:6827/1141925395","heartbeat_back_addr":"172.21.15.89:6831/1141925395","heartbeat_front_addr":"172.21.15.89:6829/1141925395","state":["exists","up"]},{"osd":11,"uuid":"1815a999-bfdb-46b9-afcd-632ee8ba56d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6825","nonce":468380924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6827","nonce":468380924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6831","nonce":468380924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6829","nonce":468380924}]},"public_addr":"172.21.15.90:6825/468380924","cluster_addr":"172.21.15.90:6827/468380924","heartbeat_back_addr":"172.21.15.90:6831/468380924","heartbeat_front_addr":"172.21.15.90:6829/468380924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:07:36.125754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:01.415356+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:26.420808+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:51.722673+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:09:16.562300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:09:41.958465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:10:07.056167+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:10:32.066195+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:10:56.497875+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:11:21.973083+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:11:46.891515+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:12:11.910012+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9},{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/874985787":"2024-09-20T06:06:11.912585+0000","172.21.15.2:0/1280963020":"2024-09-20T06:06:11.912585+0000","172.21.15.2:0/2976372536":"2024-09-20T06:06:11.912585+0000","172.21.15.2:6801/1602650352":"2024-09-20T06:05:47.538477+0000","172.21.15.2:6800/1602650352":"2024-09-20T06:05:47.538477+0000","172.21.15.2:6800/1200011821":"2024-09-20T06:06:11.912585+0000","172.21.15.2:0/3899165140":"2024-09-20T06:05:47.538477+0000","172.21.15.2:6801/1200011821":"2024-09-20T06:06:11.912585+0000","172.21.15.2:0/1361067708":"2024-09-20T06:05:47.538477+0000","172.21.15.2:0/3763089457":"2024-09-20T06:05:47.538477+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:13:37.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.825+0000 7f2590eb2640 1 -- 172.21.15.2:0/1182502237 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f25780a32d0 msgr2=0x7f25780a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:37.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.825+0000 7f2590eb2640 1 --2- 172.21.15.2:0/1182502237 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f25780a32d0 0x7f25780a5790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f257c005c40 tx=0x7f257c00a590 comp rx=0 tx=0).stop 2024-09-19T06:13:37.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.825+0000 7f2590eb2640 1 -- 172.21.15.2:0/1182502237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f258c103780 msgr2=0x7f258c198ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:37.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.825+0000 7f2590eb2640 1 --2- 172.21.15.2:0/1182502237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f258c103780 0x7f258c198ac0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2574009230 tx=0x7f2574004270 comp rx=0 tx=0).stop 2024-09-19T06:13:37.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.825+0000 7f2590eb2640 1 -- 172.21.15.2:0/1182502237 shutdown_connections 2024-09-19T06:13:37.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.825+0000 7f2590eb2640 1 --2- 172.21.15.2:0/1182502237 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f25780a32d0 0x7f25780a5790 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:37.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.825+0000 7f2590eb2640 1 --2- 172.21.15.2:0/1182502237 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f258c108300 0x7f258c19ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:37.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.825+0000 7f2590eb2640 1 --2- 172.21.15.2:0/1182502237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f258c103780 0x7f258c198ac0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:37.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.825+0000 7f2590eb2640 1 --2- 172.21.15.2:0/1182502237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f258c102dd0 0x7f258c198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:37.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.825+0000 7f2590eb2640 1 -- 172.21.15.2:0/1182502237 >> 172.21.15.2:0/1182502237 conn(0x7f258c0fc7d0 msgr2=0x7f258c105ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:37.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.825+0000 7f2590eb2640 1 -- 172.21.15.2:0/1182502237 shutdown_connections 2024-09-19T06:13:37.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:37.825+0000 7f2590eb2640 1 -- 172.21.15.2:0/1182502237 wait complete. 2024-09-19T06:13:38.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:37 smithi002 ceph-mon[30982]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-19T06:13:38.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:37 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1182502237' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:13:38.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:37 smithi090 ceph-mon[34497]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-19T06:13:38.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:37 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1182502237' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:13:38.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:37 smithi089 ceph-mon[34160]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-19T06:13:38.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:37 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1182502237' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:13:38.586 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-19T06:13:38.586 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-19T06:13:38.587 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-19T06:13:38.587 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-19T06:13:38.588 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-19T06:13:38.588 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-19T06:13:38.588 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-19T06:13:38.589 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-19T06:13:38.589 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-19T06:13:38.590 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-19T06:13:38.590 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-19T06:13:38.591 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-19T06:13:39.270 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:39.323 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:39.374 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:39.830 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:39.837 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:39.842 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:39.842 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:39.848 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:39.850 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:39.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:39 smithi002 ceph-mon[30982]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-19T06:13:40.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:39 smithi090 ceph-mon[34497]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-19T06:13:40.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:39 smithi089 ceph-mon[34160]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-19T06:13:40.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.398+0000 7f786c6e8640 1 -- 172.21.15.2:0/1776515467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7864102ef0 msgr2=0x7f786410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:40.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.398+0000 7f786c6e8640 1 --2- 172.21.15.2:0/1776515467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7864102ef0 0x7f786410da40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f785c009900 tx=0x7f785c02a480 comp rx=0 tx=0).stop 2024-09-19T06:13:40.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.399+0000 7f786c6e8640 1 -- 172.21.15.2:0/1776515467 shutdown_connections 2024-09-19T06:13:40.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.399+0000 7f786c6e8640 1 --2- 172.21.15.2:0/1776515467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7864102ef0 0x7f786410da40 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:40.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.399+0000 7f786c6e8640 1 --2- 172.21.15.2:0/1776515467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7864102570 0x7f78641029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:40.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.399+0000 7f786c6e8640 1 --2- 172.21.15.2:0/1776515467 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7864100e20 0x7f7864101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:40.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.399+0000 7f786c6e8640 1 -- 172.21.15.2:0/1776515467 >> 172.21.15.2:0/1776515467 conn(0x7f78640fc7d0 msgr2=0x7f78640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:40.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.399+0000 7f786c6e8640 1 -- 172.21.15.2:0/1776515467 shutdown_connections 2024-09-19T06:13:40.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.399+0000 7f786c6e8640 1 -- 172.21.15.2:0/1776515467 wait complete. 2024-09-19T06:13:40.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.400+0000 7f786c6e8640 1 Processor -- start 2024-09-19T06:13:40.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.400+0000 7f786c6e8640 1 -- start start 2024-09-19T06:13:40.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.400+0000 7f786c6e8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7864100e20 0x7f7864198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:40.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.400+0000 7f786c6e8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7864102570 0x7f7864198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:40.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.400+0000 7f786c6e8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7864102ef0 0x7f786419cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:40.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.400+0000 7f786c6e8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7864110e30 con 0x7f7864102ef0 2024-09-19T06:13:40.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.400+0000 7f786c6e8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7864110cb0 con 0x7f7864100e20 2024-09-19T06:13:40.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.400+0000 7f786c6e8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7864110fb0 con 0x7f7864102570 2024-09-19T06:13:40.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.400+0000 7f786ac85640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7864102ef0 0x7f786419cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:40.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.400+0000 7f786ac85640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7864102ef0 0x7f786419cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51778/0 (socket says 172.21.15.2:51778) 2024-09-19T06:13:40.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.400+0000 7f786ac85640 1 -- 172.21.15.2:0/3397471855 learned_addr learned my addr 172.21.15.2:0/3397471855 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:13:40.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.400+0000 7f786a484640 1 --2- 172.21.15.2:0/3397471855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7864100e20 0x7f7864198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:40.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.400+0000 7f7869c83640 1 --2- 172.21.15.2:0/3397471855 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7864102570 0x7f7864198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:40.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.400+0000 7f786ac85640 1 -- 172.21.15.2:0/3397471855 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7864102570 msgr2=0x7f7864198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:40.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.400+0000 7f786ac85640 1 --2- 172.21.15.2:0/3397471855 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7864102570 0x7f7864198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:40.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.400+0000 7f786ac85640 1 -- 172.21.15.2:0/3397471855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7864100e20 msgr2=0x7f7864198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:40.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.400+0000 7f786ac85640 1 --2- 172.21.15.2:0/3397471855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7864100e20 0x7f7864198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:40.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.400+0000 7f786ac85640 1 -- 172.21.15.2:0/3397471855 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f786419d2f0 con 0x7f7864102ef0 2024-09-19T06:13:40.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.400+0000 7f7869c83640 1 --2- 172.21.15.2:0/3397471855 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7864102570 0x7f7864198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:13:40.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.400+0000 7f786a484640 1 --2- 172.21.15.2:0/3397471855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7864100e20 0x7f7864198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:13:40.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.401+0000 7f786ac85640 1 --2- 172.21.15.2:0/3397471855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7864102ef0 0x7f786419cc10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f785c005ab0 tx=0x7f785c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:40.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.401+0000 7f78637fe640 1 -- 172.21.15.2:0/3397471855 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f785c03f030 con 0x7f7864102ef0 2024-09-19T06:13:40.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.401+0000 7f78637fe640 1 -- 172.21.15.2:0/3397471855 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f785c003cb0 con 0x7f7864102ef0 2024-09-19T06:13:40.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.401+0000 7f786c6e8640 1 -- 172.21.15.2:0/3397471855 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f786419d580 con 0x7f7864102ef0 2024-09-19T06:13:40.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.402+0000 7f78637fe640 1 -- 172.21.15.2:0/3397471855 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f785c035070 con 0x7f7864102ef0 2024-09-19T06:13:40.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.402+0000 7f786c6e8640 1 -- 172.21.15.2:0/3397471855 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78641a4ec0 con 0x7f7864102ef0 2024-09-19T06:13:40.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.402+0000 7f786c6e8640 1 -- 172.21.15.2:0/3397471855 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7864062940 con 0x7f7864102ef0 2024-09-19T06:13:40.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.403+0000 7f78637fe640 1 -- 172.21.15.2:0/3397471855 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f785c042030 con 0x7f7864102ef0 2024-09-19T06:13:40.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.404+0000 7f78637fe640 1 --2- 172.21.15.2:0/3397471855 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f784c0a3350 0x7f784c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:40.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.404+0000 7f786a484640 1 --2- 172.21.15.2:0/3397471855 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f784c0a3350 0x7f784c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:40.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.404+0000 7f78637fe640 1 -- 172.21.15.2:0/3397471855 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f785c0f01f0 con 0x7f7864102ef0 2024-09-19T06:13:40.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.404+0000 7f78637fe640 1 --2- 172.21.15.2:0/3397471855 >> [v2:172.21.15.89:6808/4256848315,v1:172.21.15.89:6809/4256848315] conn(0x7f784c0acf00 0x7f784c0af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:40.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.404+0000 7f78637fe640 1 -- 172.21.15.2:0/3397471855 --> [v2:172.21.15.89:6808/4256848315,v1:172.21.15.89:6809/4256848315] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f784c0afa70 con 0x7f784c0acf00 2024-09-19T06:13:40.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.404+0000 7f78637fe640 1 -- 172.21.15.2:0/3397471855 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f785c0f7050 con 0x7f7864102ef0 2024-09-19T06:13:40.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.405+0000 7f786a484640 1 --2- 172.21.15.2:0/3397471855 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f784c0a3350 0x7f784c0a5810 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7854009fd0 tx=0x7f7854009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:40.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.405+0000 7f7869c83640 1 --2- 172.21.15.2:0/3397471855 >> [v2:172.21.15.89:6808/4256848315,v1:172.21.15.89:6809/4256848315] conn(0x7f784c0acf00 0x7f784c0af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:40.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.405+0000 7f7869c83640 1 --2- 172.21.15.2:0/3397471855 >> [v2:172.21.15.89:6808/4256848315,v1:172.21.15.89:6809/4256848315] conn(0x7f784c0acf00 0x7f784c0af3a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:40.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.406+0000 7f78637fe640 1 -- 172.21.15.2:0/3397471855 <== osd.4 v2:172.21.15.89:6808/4256848315 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f784c0afa70 con 0x7f784c0acf00 2024-09-19T06:13:40.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.421+0000 7f786c6e8640 1 -- 172.21.15.2:0/3397471855 --> [v2:172.21.15.89:6808/4256848315,v1:172.21.15.89:6809/4256848315] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7864062dc0 con 0x7f784c0acf00 2024-09-19T06:13:40.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.421+0000 7f78637fe640 1 -- 172.21.15.2:0/3397471855 <== osd.4 v2:172.21.15.89:6808/4256848315 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7864062dc0 con 0x7f784c0acf00 2024-09-19T06:13:40.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.422+0000 7f786c6e8640 1 -- 172.21.15.2:0/3397471855 >> [v2:172.21.15.89:6808/4256848315,v1:172.21.15.89:6809/4256848315] conn(0x7f784c0acf00 msgr2=0x7f784c0af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:40.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.422+0000 7f786c6e8640 1 --2- 172.21.15.2:0/3397471855 >> [v2:172.21.15.89:6808/4256848315,v1:172.21.15.89:6809/4256848315] conn(0x7f784c0acf00 0x7f784c0af3a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:40.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.422+0000 7f786c6e8640 1 -- 172.21.15.2:0/3397471855 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f784c0a3350 msgr2=0x7f784c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:40.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.422+0000 7f786c6e8640 1 --2- 172.21.15.2:0/3397471855 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f784c0a3350 0x7f784c0a5810 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7854009fd0 tx=0x7f7854009680 comp rx=0 tx=0).stop 2024-09-19T06:13:40.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.422+0000 7f786c6e8640 1 -- 172.21.15.2:0/3397471855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7864102ef0 msgr2=0x7f786419cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:40.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.422+0000 7f786c6e8640 1 --2- 172.21.15.2:0/3397471855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7864102ef0 0x7f786419cc10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f785c005ab0 tx=0x7f785c0042f0 comp rx=0 tx=0).stop 2024-09-19T06:13:40.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.422+0000 7f786ac85640 1 -- 172.21.15.2:0/3397471855 reap_dead start 2024-09-19T06:13:40.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.423+0000 7f786c6e8640 1 -- 172.21.15.2:0/3397471855 shutdown_connections 2024-09-19T06:13:40.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.423+0000 7f786c6e8640 1 -- 172.21.15.2:0/3397471855 >> 172.21.15.2:0/3397471855 conn(0x7f78640fc7d0 msgr2=0x7f786406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:40.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.423+0000 7f786c6e8640 1 -- 172.21.15.2:0/3397471855 shutdown_connections 2024-09-19T06:13:40.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.423+0000 7f786c6e8640 1 -- 172.21.15.2:0/3397471855 wait complete. 2024-09-19T06:13:40.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.283+0000 7f051d01d640 1 -- 172.21.15.2:0/1495174464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0518102ef0 msgr2=0x7f051810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:40.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.283+0000 7f051d01d640 1 --2- 172.21.15.2:0/1495174464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0518102ef0 0x7f051810da40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0510009ca0 tx=0x7f051002a950 comp rx=0 tx=0).stop 2024-09-19T06:13:40.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.284+0000 7f051d01d640 1 -- 172.21.15.2:0/1495174464 shutdown_connections 2024-09-19T06:13:40.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.284+0000 7f051d01d640 1 --2- 172.21.15.2:0/1495174464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0518102ef0 0x7f051810da40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:40.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.284+0000 7f051d01d640 1 --2- 172.21.15.2:0/1495174464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0518102570 0x7f05181029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:40.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.284+0000 7f051d01d640 1 --2- 172.21.15.2:0/1495174464 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0518100e20 0x7f0518101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:40.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.284+0000 7f051d01d640 1 -- 172.21.15.2:0/1495174464 >> 172.21.15.2:0/1495174464 conn(0x7f05180fc7d0 msgr2=0x7f05180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:40.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.284+0000 7f051d01d640 1 -- 172.21.15.2:0/1495174464 shutdown_connections 2024-09-19T06:13:40.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.284+0000 7f051d01d640 1 -- 172.21.15.2:0/1495174464 wait complete. 2024-09-19T06:13:40.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.284+0000 7f051d01d640 1 Processor -- start 2024-09-19T06:13:40.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.285+0000 7f051d01d640 1 -- start start 2024-09-19T06:13:40.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.285+0000 7f051d01d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0518100e20 0x7f0518199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:40.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.285+0000 7f051d01d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0518102570 0x7f0518199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:40.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.285+0000 7f051d01d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0518102ef0 0x7f05181a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:40.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.285+0000 7f051d01d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0518110e30 con 0x7f0518100e20 2024-09-19T06:13:40.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.285+0000 7f051d01d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0518110cb0 con 0x7f0518102ef0 2024-09-19T06:13:40.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.285+0000 7f051d01d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0518110fb0 con 0x7f0518102570 2024-09-19T06:13:40.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.285+0000 7f0516d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0518100e20 0x7f0518199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:40.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.285+0000 7f0516d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0518100e20 0x7f0518199240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51756/0 (socket says 172.21.15.2:51756) 2024-09-19T06:13:40.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.285+0000 7f0516d9d640 1 -- 172.21.15.2:0/589325951 learned_addr learned my addr 172.21.15.2:0/589325951 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:13:40.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.285+0000 7f050ffff640 1 --2- 172.21.15.2:0/589325951 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0518102570 0x7f0518199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:40.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.285+0000 7f051759e640 1 --2- 172.21.15.2:0/589325951 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0518102ef0 0x7f05181a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:40.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.285+0000 7f0516d9d640 1 -- 172.21.15.2:0/589325951 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0518102570 msgr2=0x7f0518199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:40.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.285+0000 7f0516d9d640 1 --2- 172.21.15.2:0/589325951 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0518102570 0x7f0518199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:40.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.285+0000 7f0516d9d640 1 -- 172.21.15.2:0/589325951 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0518102ef0 msgr2=0x7f05181a42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:40.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.285+0000 7f0516d9d640 1 --2- 172.21.15.2:0/589325951 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0518102ef0 0x7f05181a42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:40.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.285+0000 7f0516d9d640 1 -- 172.21.15.2:0/589325951 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05181a4800 con 0x7f0518100e20 2024-09-19T06:13:40.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.285+0000 7f0516d9d640 1 --2- 172.21.15.2:0/589325951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0518100e20 0x7f0518199240 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f050800d950 tx=0x7f050800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:40.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.286+0000 7f0514d99640 1 -- 172.21.15.2:0/589325951 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0508017030 con 0x7f0518100e20 2024-09-19T06:13:40.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.286+0000 7f0514d99640 1 -- 172.21.15.2:0/589325951 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0508004020 con 0x7f0518100e20 2024-09-19T06:13:40.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.286+0000 7f051d01d640 1 -- 172.21.15.2:0/589325951 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05181a49d0 con 0x7f0518100e20 2024-09-19T06:13:40.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.286+0000 7f0514d99640 1 -- 172.21.15.2:0/589325951 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05080047a0 con 0x7f0518100e20 2024-09-19T06:13:40.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.286+0000 7f051d01d640 1 -- 172.21.15.2:0/589325951 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05181a4ee0 con 0x7f0518100e20 2024-09-19T06:13:40.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.287+0000 7f051d01d640 1 -- 172.21.15.2:0/589325951 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0518062980 con 0x7f0518100e20 2024-09-19T06:13:40.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.288+0000 7f0514d99640 1 -- 172.21.15.2:0/589325951 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f05080041d0 con 0x7f0518100e20 2024-09-19T06:13:40.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.288+0000 7f0514d99640 1 --2- 172.21.15.2:0/589325951 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f05040a32d0 0x7f05040a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:40.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.289+0000 7f050ffff640 1 --2- 172.21.15.2:0/589325951 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f05040a32d0 0x7f05040a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:40.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.289+0000 7f0514d99640 1 -- 172.21.15.2:0/589325951 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f05080cfbc0 con 0x7f0518100e20 2024-09-19T06:13:40.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.289+0000 7f0514d99640 1 --2- 172.21.15.2:0/589325951 >> [v2:172.21.15.90:6800/1479908200,v1:172.21.15.90:6801/1479908200] conn(0x7f05040ace80 0x7f05040af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:40.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.289+0000 7f0514d99640 1 -- 172.21.15.2:0/589325951 --> [v2:172.21.15.90:6800/1479908200,v1:172.21.15.90:6801/1479908200] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f05080056a0 con 0x7f05040ace80 2024-09-19T06:13:40.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.289+0000 7f0514d99640 1 -- 172.21.15.2:0/589325951 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f05080cff70 con 0x7f0518100e20 2024-09-19T06:13:40.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.289+0000 7f050ffff640 1 --2- 172.21.15.2:0/589325951 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f05040a32d0 0x7f05040a5790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f051806aac0 tx=0x7f0500005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:40.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.289+0000 7f051759e640 1 --2- 172.21.15.2:0/589325951 >> [v2:172.21.15.90:6800/1479908200,v1:172.21.15.90:6801/1479908200] conn(0x7f05040ace80 0x7f05040af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:40.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.290+0000 7f051759e640 1 --2- 172.21.15.2:0/589325951 >> [v2:172.21.15.90:6800/1479908200,v1:172.21.15.90:6801/1479908200] conn(0x7f05040ace80 0x7f05040af320 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:40.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.290+0000 7f0514d99640 1 -- 172.21.15.2:0/589325951 <== osd.2 v2:172.21.15.90:6800/1479908200 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f05080056a0 con 0x7f05040ace80 2024-09-19T06:13:40.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.305+0000 7f051d01d640 1 -- 172.21.15.2:0/589325951 --> [v2:172.21.15.90:6800/1479908200,v1:172.21.15.90:6801/1479908200] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0518062e00 con 0x7f05040ace80 2024-09-19T06:13:40.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.306+0000 7f0514d99640 1 -- 172.21.15.2:0/589325951 <== osd.2 v2:172.21.15.90:6800/1479908200 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0518062e00 con 0x7f05040ace80 2024-09-19T06:13:40.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.306+0000 7f051d01d640 1 -- 172.21.15.2:0/589325951 >> [v2:172.21.15.90:6800/1479908200,v1:172.21.15.90:6801/1479908200] conn(0x7f05040ace80 msgr2=0x7f05040af320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:40.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.306+0000 7f051d01d640 1 --2- 172.21.15.2:0/589325951 >> [v2:172.21.15.90:6800/1479908200,v1:172.21.15.90:6801/1479908200] conn(0x7f05040ace80 0x7f05040af320 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:40.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.306+0000 7f051d01d640 1 -- 172.21.15.2:0/589325951 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f05040a32d0 msgr2=0x7f05040a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:40.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.306+0000 7f051d01d640 1 --2- 172.21.15.2:0/589325951 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f05040a32d0 0x7f05040a5790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f051806aac0 tx=0x7f0500005f90 comp rx=0 tx=0).stop 2024-09-19T06:13:40.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.306+0000 7f051d01d640 1 -- 172.21.15.2:0/589325951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0518100e20 msgr2=0x7f0518199240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:40.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.306+0000 7f051d01d640 1 --2- 172.21.15.2:0/589325951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0518100e20 0x7f0518199240 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f050800d950 tx=0x7f050800de10 comp rx=0 tx=0).stop 2024-09-19T06:13:40.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.306+0000 7f051759e640 1 -- 172.21.15.2:0/589325951 reap_dead start 2024-09-19T06:13:40.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.307+0000 7f051d01d640 1 -- 172.21.15.2:0/589325951 shutdown_connections 2024-09-19T06:13:40.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.307+0000 7f051d01d640 1 -- 172.21.15.2:0/589325951 >> 172.21.15.2:0/589325951 conn(0x7f05180fc7d0 msgr2=0x7f05180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:40.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.307+0000 7f051d01d640 1 -- 172.21.15.2:0/589325951 shutdown_connections 2024-09-19T06:13:40.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:40.307+0000 7f051d01d640 1 -- 172.21.15.2:0/589325951 wait complete. 2024-09-19T06:13:41.418 INFO:teuthology.orchestra.run.smithi002.stdout:73014444098 2024-09-19T06:13:41.418 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-19T06:13:41.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.612+0000 7ff0d1447640 1 -- 172.21.15.2:0/3197422404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0cc106f00 msgr2=0x7ff0cc10ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:41.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.612+0000 7ff0d1447640 1 --2- 172.21.15.2:0/3197422404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0cc106f00 0x7ff0cc10ea80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff0c4009ca0 tx=0x7ff0c402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:13:41.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.612+0000 7ff0d1447640 1 -- 172.21.15.2:0/3197422404 shutdown_connections 2024-09-19T06:13:41.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.612+0000 7ff0d1447640 1 --2- 172.21.15.2:0/3197422404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0cc106f00 0x7ff0cc10ea80 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:41.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.612+0000 7ff0d1447640 1 --2- 172.21.15.2:0/3197422404 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0cc102780 0x7ff0cc1067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:41.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.612+0000 7ff0d1447640 1 --2- 172.21.15.2:0/3197422404 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0cc101dd0 0x7ff0cc1021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:41.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.612+0000 7ff0d1447640 1 -- 172.21.15.2:0/3197422404 >> 172.21.15.2:0/3197422404 conn(0x7ff0cc0fd8b0 msgr2=0x7ff0cc0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:41.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.612+0000 7ff0d1447640 1 -- 172.21.15.2:0/3197422404 shutdown_connections 2024-09-19T06:13:41.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.612+0000 7ff0d1447640 1 -- 172.21.15.2:0/3197422404 wait complete. 2024-09-19T06:13:41.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.613+0000 7ff0d1447640 1 Processor -- start 2024-09-19T06:13:41.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.613+0000 7ff0d1447640 1 -- start start 2024-09-19T06:13:41.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.613+0000 7ff0d1447640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0cc101dd0 0x7ff0cc1981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:41.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.613+0000 7ff0d1447640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0cc102780 0x7ff0cc198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:41.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.613+0000 7ff0d1447640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0cc106f00 0x7ff0cc19cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:41.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.613+0000 7ff0d1447640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff0cc111e10 con 0x7ff0cc101dd0 2024-09-19T06:13:41.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.613+0000 7ff0d1447640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff0cc111c90 con 0x7ff0cc106f00 2024-09-19T06:13:41.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.613+0000 7ff0d1447640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff0cc111f90 con 0x7ff0cc102780 2024-09-19T06:13:41.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.614+0000 7ff0caffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0cc101dd0 0x7ff0cc1981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:41.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.614+0000 7ff0caffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0cc101dd0 0x7ff0cc1981e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51794/0 (socket says 172.21.15.2:51794) 2024-09-19T06:13:41.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.614+0000 7ff0caffd640 1 -- 172.21.15.2:0/2602716849 learned_addr learned my addr 172.21.15.2:0/2602716849 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:13:41.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.614+0000 7ff0cb7fe640 1 --2- 172.21.15.2:0/2602716849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0cc106f00 0x7ff0cc19cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:41.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.614+0000 7ff0ca7fc640 1 --2- 172.21.15.2:0/2602716849 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0cc102780 0x7ff0cc198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:41.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.614+0000 7ff0caffd640 1 -- 172.21.15.2:0/2602716849 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0cc102780 msgr2=0x7ff0cc198720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:41.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.614+0000 7ff0caffd640 1 --2- 172.21.15.2:0/2602716849 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0cc102780 0x7ff0cc198720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:41.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.614+0000 7ff0caffd640 1 -- 172.21.15.2:0/2602716849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0cc106f00 msgr2=0x7ff0cc19cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:41.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.614+0000 7ff0caffd640 1 --2- 172.21.15.2:0/2602716849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0cc106f00 0x7ff0cc19cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:41.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.614+0000 7ff0caffd640 1 -- 172.21.15.2:0/2602716849 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0cc19d190 con 0x7ff0cc101dd0 2024-09-19T06:13:41.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.614+0000 7ff0caffd640 1 --2- 172.21.15.2:0/2602716849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0cc101dd0 0x7ff0cc1981e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc00c920 tx=0x7ff0bc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:41.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.614+0000 7ff0b3fff640 1 -- 172.21.15.2:0/2602716849 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc007c70 con 0x7ff0cc101dd0 2024-09-19T06:13:41.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.614+0000 7ff0d1447640 1 -- 172.21.15.2:0/2602716849 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0cc19d480 con 0x7ff0cc101dd0 2024-09-19T06:13:41.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.614+0000 7ff0b3fff640 1 -- 172.21.15.2:0/2602716849 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff0bc007e10 con 0x7ff0cc101dd0 2024-09-19T06:13:41.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.614+0000 7ff0b3fff640 1 -- 172.21.15.2:0/2602716849 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc018820 con 0x7ff0cc101dd0 2024-09-19T06:13:41.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.614+0000 7ff0d1447640 1 -- 172.21.15.2:0/2602716849 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0cc1a4d60 con 0x7ff0cc101dd0 2024-09-19T06:13:41.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.615+0000 7ff0d1447640 1 -- 172.21.15.2:0/2602716849 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff0cc062980 con 0x7ff0cc101dd0 2024-09-19T06:13:41.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.616+0000 7ff0b3fff640 1 -- 172.21.15.2:0/2602716849 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7ff0bc0189c0 con 0x7ff0cc101dd0 2024-09-19T06:13:41.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.617+0000 7ff0b3fff640 1 --2- 172.21.15.2:0/2602716849 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7ff0b40a32d0 0x7ff0b40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:41.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.617+0000 7ff0ca7fc640 1 --2- 172.21.15.2:0/2602716849 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7ff0b40a32d0 0x7ff0b40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:41.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.617+0000 7ff0b3fff640 1 -- 172.21.15.2:0/2602716849 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7ff0bc0d0020 con 0x7ff0cc101dd0 2024-09-19T06:13:41.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.617+0000 7ff0b3fff640 1 --2- 172.21.15.2:0/2602716849 >> [v2:172.21.15.2:6826/2690758100,v1:172.21.15.2:6827/2690758100] conn(0x7ff0b40ace80 0x7ff0b40af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:41.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.617+0000 7ff0b3fff640 1 -- 172.21.15.2:0/2602716849 --> [v2:172.21.15.2:6826/2690758100,v1:172.21.15.2:6827/2690758100] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff0bc015e70 con 0x7ff0b40ace80 2024-09-19T06:13:41.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.617+0000 7ff0b3fff640 1 -- 172.21.15.2:0/2602716849 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7ff0bc0d0470 con 0x7ff0cc101dd0 2024-09-19T06:13:41.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.617+0000 7ff0cb7fe640 1 --2- 172.21.15.2:0/2602716849 >> [v2:172.21.15.2:6826/2690758100,v1:172.21.15.2:6827/2690758100] conn(0x7ff0b40ace80 0x7ff0b40af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:41.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.618+0000 7ff0ca7fc640 1 --2- 172.21.15.2:0/2602716849 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7ff0b40a32d0 0x7ff0b40a5790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc108870 tx=0x7ff0c000c4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:41.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.618+0000 7ff0cb7fe640 1 --2- 172.21.15.2:0/2602716849 >> [v2:172.21.15.2:6826/2690758100,v1:172.21.15.2:6827/2690758100] conn(0x7ff0b40ace80 0x7ff0b40af320 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:41.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.618+0000 7ff0b3fff640 1 -- 172.21.15.2:0/2602716849 <== osd.9 v2:172.21.15.2:6826/2690758100 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff0bc015e70 con 0x7ff0b40ace80 2024-09-19T06:13:41.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.633+0000 7ff0d1447640 1 -- 172.21.15.2:0/2602716849 --> [v2:172.21.15.2:6826/2690758100,v1:172.21.15.2:6827/2690758100] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff0cc062d80 con 0x7ff0b40ace80 2024-09-19T06:13:41.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.634+0000 7ff0b3fff640 1 -- 172.21.15.2:0/2602716849 <== osd.9 v2:172.21.15.2:6826/2690758100 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff0cc062d80 con 0x7ff0b40ace80 2024-09-19T06:13:41.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.634+0000 7ff0d1447640 1 -- 172.21.15.2:0/2602716849 >> [v2:172.21.15.2:6826/2690758100,v1:172.21.15.2:6827/2690758100] conn(0x7ff0b40ace80 msgr2=0x7ff0b40af320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:41.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.634+0000 7ff0d1447640 1 --2- 172.21.15.2:0/2602716849 >> [v2:172.21.15.2:6826/2690758100,v1:172.21.15.2:6827/2690758100] conn(0x7ff0b40ace80 0x7ff0b40af320 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:41.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.634+0000 7ff0d1447640 1 -- 172.21.15.2:0/2602716849 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7ff0b40a32d0 msgr2=0x7ff0b40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:41.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.634+0000 7ff0d1447640 1 --2- 172.21.15.2:0/2602716849 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7ff0b40a32d0 0x7ff0b40a5790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc108870 tx=0x7ff0c000c4a0 comp rx=0 tx=0).stop 2024-09-19T06:13:41.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.634+0000 7ff0d1447640 1 -- 172.21.15.2:0/2602716849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0cc101dd0 msgr2=0x7ff0cc1981e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:41.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.634+0000 7ff0d1447640 1 --2- 172.21.15.2:0/2602716849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0cc101dd0 0x7ff0cc1981e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc00c920 tx=0x7ff0bc00cde0 comp rx=0 tx=0).stop 2024-09-19T06:13:41.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.634+0000 7ff0cb7fe640 1 -- 172.21.15.2:0/2602716849 reap_dead start 2024-09-19T06:13:41.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.634+0000 7ff0d1447640 1 -- 172.21.15.2:0/2602716849 shutdown_connections 2024-09-19T06:13:41.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.634+0000 7ff0d1447640 1 -- 172.21.15.2:0/2602716849 >> 172.21.15.2:0/2602716849 conn(0x7ff0cc0fd8b0 msgr2=0x7ff0cc0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:41.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.635+0000 7ff0d1447640 1 -- 172.21.15.2:0/2602716849 shutdown_connections 2024-09-19T06:13:41.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:41.635+0000 7ff0d1447640 1 -- 172.21.15.2:0/2602716849 wait complete. 2024-09-19T06:13:42.030 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:41 smithi002 ceph-mon[30982]: pgmap v295: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-19T06:13:42.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.028+0000 7f5bbed3b640 1 -- 172.21.15.2:0/3218006645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bb810c170 msgr2=0x7f5bb810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:42.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.028+0000 7f5bbed3b640 1 --2- 172.21.15.2:0/3218006645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bb810c170 0x7f5bb810e610 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0009ca0 tx=0x7f5bb002a950 comp rx=0 tx=0).stop 2024-09-19T06:13:42.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.028+0000 7f5bbed3b640 1 -- 172.21.15.2:0/3218006645 shutdown_connections 2024-09-19T06:13:42.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.028+0000 7f5bbed3b640 1 --2- 172.21.15.2:0/3218006645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bb810c170 0x7f5bb810e610 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:42.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.028+0000 7f5bbed3b640 1 --2- 172.21.15.2:0/3218006645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5bb8103660 0x7f5bb810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:42.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.028+0000 7f5bbed3b640 1 --2- 172.21.15.2:0/3218006645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bb8102d40 0x7f5bb8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:42.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.028+0000 7f5bbed3b640 1 -- 172.21.15.2:0/3218006645 >> 172.21.15.2:0/3218006645 conn(0x7f5bb80fc7a0 msgr2=0x7f5bb80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:42.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.028+0000 7f5bbed3b640 1 -- 172.21.15.2:0/3218006645 shutdown_connections 2024-09-19T06:13:42.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.028+0000 7f5bbed3b640 1 -- 172.21.15.2:0/3218006645 wait complete. 2024-09-19T06:13:42.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.029+0000 7f5bbed3b640 1 Processor -- start 2024-09-19T06:13:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.029+0000 7f5bbed3b640 1 -- start start 2024-09-19T06:13:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.029+0000 7f5bbed3b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bb8102d40 0x7f5bb81a45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.029+0000 7f5bbed3b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5bb8103660 0x7f5bb81a4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.029+0000 7f5bbed3b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bb810c170 0x7f5bb810ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.029+0000 7f5bbed3b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb8111e20 con 0x7f5bb8102d40 2024-09-19T06:13:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.029+0000 7f5bbed3b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb8111ca0 con 0x7f5bb810c170 2024-09-19T06:13:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.029+0000 7f5bbed3b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb8111fa0 con 0x7f5bb8103660 2024-09-19T06:13:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.029+0000 7f5bbcad7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bb8102d40 0x7f5bb81a45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.029+0000 7f5bbcad7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bb8102d40 0x7f5bb81a45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51816/0 (socket says 172.21.15.2:51816) 2024-09-19T06:13:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.030+0000 7f5bbcad7640 1 -- 172.21.15.2:0/1093765763 learned_addr learned my addr 172.21.15.2:0/1093765763 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:13:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.030+0000 7f5bb7fff640 1 --2- 172.21.15.2:0/1093765763 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5bb8103660 0x7f5bb81a4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.030+0000 7f5bbd2d8640 1 --2- 172.21.15.2:0/1093765763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bb810c170 0x7f5bb810ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.030+0000 7f5bbcad7640 1 -- 172.21.15.2:0/1093765763 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5bb8103660 msgr2=0x7f5bb81a4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.030+0000 7f5bbcad7640 1 --2- 172.21.15.2:0/1093765763 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5bb8103660 0x7f5bb81a4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.030+0000 7f5bbcad7640 1 -- 172.21.15.2:0/1093765763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bb810c170 msgr2=0x7f5bb810ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.030+0000 7f5bbcad7640 1 --2- 172.21.15.2:0/1093765763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bb810c170 0x7f5bb810ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.030+0000 7f5bbcad7640 1 -- 172.21.15.2:0/1093765763 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bb810b540 con 0x7f5bb8102d40 2024-09-19T06:13:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.030+0000 7f5bbd2d8640 1 --2- 172.21.15.2:0/1093765763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bb810c170 0x7f5bb810ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:13:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.030+0000 7f5bbcad7640 1 --2- 172.21.15.2:0/1093765763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bb8102d40 0x7f5bb81a45b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5bac00c890 tx=0x7f5bac00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.030+0000 7f5bb5ffb640 1 -- 172.21.15.2:0/1093765763 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bac004220 con 0x7f5bb8102d40 2024-09-19T06:13:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.030+0000 7f5bbed3b640 1 -- 172.21.15.2:0/1093765763 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bb810b830 con 0x7f5bb8102d40 2024-09-19T06:13:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.030+0000 7f5bb5ffb640 1 -- 172.21.15.2:0/1093765763 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5bac0043c0 con 0x7f5bb8102d40 2024-09-19T06:13:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.030+0000 7f5bb5ffb640 1 -- 172.21.15.2:0/1093765763 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bac004a00 con 0x7f5bb8102d40 2024-09-19T06:13:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.031+0000 7f5bbed3b640 1 -- 172.21.15.2:0/1093765763 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bb81ab530 con 0x7f5bb8102d40 2024-09-19T06:13:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.031+0000 7f5bbed3b640 1 -- 172.21.15.2:0/1093765763 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5bb80fe530 con 0x7f5bb8102d40 2024-09-19T06:13:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.032+0000 7f5bb5ffb640 1 -- 172.21.15.2:0/1093765763 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f5bac004ba0 con 0x7f5bb8102d40 2024-09-19T06:13:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.033+0000 7f5bb5ffb640 1 --2- 172.21.15.2:0/1093765763 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f5ba80a32d0 0x7f5ba80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.033+0000 7f5bb7fff640 1 --2- 172.21.15.2:0/1093765763 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f5ba80a32d0 0x7f5ba80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.033+0000 7f5bb5ffb640 1 -- 172.21.15.2:0/1093765763 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f5bac0cfba0 con 0x7f5bb8102d40 2024-09-19T06:13:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.033+0000 7f5bb5ffb640 1 --2- 172.21.15.2:0/1093765763 >> [v2:172.21.15.89:6800/4097264171,v1:172.21.15.89:6801/4097264171] conn(0x7f5ba80ace80 0x7f5ba80af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.033+0000 7f5bb5ffb640 1 -- 172.21.15.2:0/1093765763 --> [v2:172.21.15.89:6800/4097264171,v1:172.21.15.89:6801/4097264171] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5bac023ef0 con 0x7f5ba80ace80 2024-09-19T06:13:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.033+0000 7f5bb5ffb640 1 -- 172.21.15.2:0/1093765763 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f5bac0cfff0 con 0x7f5bb8102d40 2024-09-19T06:13:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.034+0000 7f5bb7fff640 1 --2- 172.21.15.2:0/1093765763 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f5ba80a32d0 0x7f5ba80a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5bb819fe40 tx=0x7f5ba400a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.034+0000 7f5bbd2d8640 1 --2- 172.21.15.2:0/1093765763 >> [v2:172.21.15.89:6800/4097264171,v1:172.21.15.89:6801/4097264171] conn(0x7f5ba80ace80 0x7f5ba80af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.034+0000 7f5bbd2d8640 1 --2- 172.21.15.2:0/1093765763 >> [v2:172.21.15.89:6800/4097264171,v1:172.21.15.89:6801/4097264171] conn(0x7f5ba80ace80 0x7f5ba80af320 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.035+0000 7f5bb5ffb640 1 -- 172.21.15.2:0/1093765763 <== osd.1 v2:172.21.15.89:6800/4097264171 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5bac023ef0 con 0x7f5ba80ace80 2024-09-19T06:13:42.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.048+0000 7f5bbed3b640 1 -- 172.21.15.2:0/1093765763 --> [v2:172.21.15.89:6800/4097264171,v1:172.21.15.89:6801/4097264171] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5bb806b070 con 0x7f5ba80ace80 2024-09-19T06:13:42.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.049+0000 7f5bb5ffb640 1 -- 172.21.15.2:0/1093765763 <== osd.1 v2:172.21.15.89:6800/4097264171 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5bb806b070 con 0x7f5ba80ace80 2024-09-19T06:13:42.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.049+0000 7f5bbed3b640 1 -- 172.21.15.2:0/1093765763 >> [v2:172.21.15.89:6800/4097264171,v1:172.21.15.89:6801/4097264171] conn(0x7f5ba80ace80 msgr2=0x7f5ba80af320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:42.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.049+0000 7f5bbed3b640 1 --2- 172.21.15.2:0/1093765763 >> [v2:172.21.15.89:6800/4097264171,v1:172.21.15.89:6801/4097264171] conn(0x7f5ba80ace80 0x7f5ba80af320 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:42.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.049+0000 7f5bbed3b640 1 -- 172.21.15.2:0/1093765763 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f5ba80a32d0 msgr2=0x7f5ba80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:42.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.049+0000 7f5bbed3b640 1 --2- 172.21.15.2:0/1093765763 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f5ba80a32d0 0x7f5ba80a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5bb819fe40 tx=0x7f5ba400a250 comp rx=0 tx=0).stop 2024-09-19T06:13:42.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.049+0000 7f5bbed3b640 1 -- 172.21.15.2:0/1093765763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bb8102d40 msgr2=0x7f5bb81a45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:42.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.049+0000 7f5bbed3b640 1 --2- 172.21.15.2:0/1093765763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bb8102d40 0x7f5bb81a45b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5bac00c890 tx=0x7f5bac00cd50 comp rx=0 tx=0).stop 2024-09-19T06:13:42.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.050+0000 7f5bbd2d8640 1 -- 172.21.15.2:0/1093765763 reap_dead start 2024-09-19T06:13:42.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.050+0000 7f5bbed3b640 1 -- 172.21.15.2:0/1093765763 shutdown_connections 2024-09-19T06:13:42.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.050+0000 7f5bbed3b640 1 -- 172.21.15.2:0/1093765763 >> 172.21.15.2:0/1093765763 conn(0x7f5bb80fc7a0 msgr2=0x7f5bb80fcb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:42.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.050+0000 7f5bbed3b640 1 -- 172.21.15.2:0/1093765763 shutdown_connections 2024-09-19T06:13:42.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:42.050+0000 7f5bbed3b640 1 -- 172.21.15.2:0/1093765763 wait complete. 2024-09-19T06:13:42.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:41 smithi090 ceph-mon[34497]: pgmap v295: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-19T06:13:42.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:41 smithi089 ceph-mon[34160]: pgmap v295: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-19T06:13:42.647 INFO:teuthology.orchestra.run.smithi002.stdout:55834574919 2024-09-19T06:13:42.648 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-19T06:13:43.054 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:43.055 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:43.536 INFO:teuthology.orchestra.run.smithi002.stdout:133143986232 2024-09-19T06:13:43.537 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-19T06:13:43.938 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:44.048 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:43 smithi002 ceph-mon[30982]: pgmap v296: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-19T06:13:44.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:43 smithi090 ceph-mon[34497]: pgmap v296: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-19T06:13:44.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:43 smithi089 ceph-mon[34160]: pgmap v296: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-19T06:13:44.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.358+0000 7f881e4e5640 1 -- 172.21.15.2:0/520478096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8818101de0 msgr2=0x7f88181021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:44.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.358+0000 7f881e4e5640 1 --2- 172.21.15.2:0/520478096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8818101de0 0x7f88181021c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8808009900 tx=0x7f880802a410 comp rx=0 tx=0).stop 2024-09-19T06:13:44.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.358+0000 7f881e4e5640 1 -- 172.21.15.2:0/520478096 shutdown_connections 2024-09-19T06:13:44.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.358+0000 7f881e4e5640 1 --2- 172.21.15.2:0/520478096 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8818106f10 0x7f881810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:44.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.358+0000 7f881e4e5640 1 --2- 172.21.15.2:0/520478096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8818102790 0x7f88181067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:44.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.358+0000 7f881e4e5640 1 --2- 172.21.15.2:0/520478096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8818101de0 0x7f88181021c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:44.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.358+0000 7f881e4e5640 1 -- 172.21.15.2:0/520478096 >> 172.21.15.2:0/520478096 conn(0x7f88180fd8c0 msgr2=0x7f88180ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:44.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.358+0000 7f881e4e5640 1 -- 172.21.15.2:0/520478096 shutdown_connections 2024-09-19T06:13:44.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.358+0000 7f881e4e5640 1 -- 172.21.15.2:0/520478096 wait complete. 2024-09-19T06:13:44.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.358+0000 7f881e4e5640 1 Processor -- start 2024-09-19T06:13:44.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.358+0000 7f881e4e5640 1 -- start start 2024-09-19T06:13:44.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.359+0000 7f881e4e5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8818101de0 0x7f8818198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:44.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.359+0000 7f881e4e5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8818102790 0x7f8818198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:44.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.359+0000 7f881e4e5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8818106f10 0x7f881819cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:44.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.359+0000 7f881e4e5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8818111e20 con 0x7f8818101de0 2024-09-19T06:13:44.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.359+0000 7f881e4e5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8818111ca0 con 0x7f8818102790 2024-09-19T06:13:44.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.359+0000 7f881e4e5640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8818111fa0 con 0x7f8818106f10 2024-09-19T06:13:44.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.359+0000 7f8817fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8818101de0 0x7f8818198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:44.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.359+0000 7f8817fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8818101de0 0x7f8818198310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51842/0 (socket says 172.21.15.2:51842) 2024-09-19T06:13:44.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.359+0000 7f8817fff640 1 -- 172.21.15.2:0/4010391823 learned_addr learned my addr 172.21.15.2:0/4010391823 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:13:44.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.359+0000 7f88177fe640 1 --2- 172.21.15.2:0/4010391823 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8818102790 0x7f8818198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:44.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.359+0000 7f881ca82640 1 --2- 172.21.15.2:0/4010391823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8818106f10 0x7f881819cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:44.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.359+0000 7f8817fff640 1 -- 172.21.15.2:0/4010391823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8818106f10 msgr2=0x7f881819cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:44.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.359+0000 7f8817fff640 1 --2- 172.21.15.2:0/4010391823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8818106f10 0x7f881819cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:44.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.359+0000 7f8817fff640 1 -- 172.21.15.2:0/4010391823 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8818102790 msgr2=0x7f8818198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:44.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.359+0000 7f8817fff640 1 --2- 172.21.15.2:0/4010391823 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8818102790 0x7f8818198850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:44.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.359+0000 7f8817fff640 1 -- 172.21.15.2:0/4010391823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f881819d2c0 con 0x7f8818101de0 2024-09-19T06:13:44.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.359+0000 7f8817fff640 1 --2- 172.21.15.2:0/4010391823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8818101de0 0x7f8818198310 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8808005940 tx=0x7f8808004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:44.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.360+0000 7f88157fa640 1 -- 172.21.15.2:0/4010391823 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f880803f030 con 0x7f8818101de0 2024-09-19T06:13:44.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.360+0000 7f88157fa640 1 -- 172.21.15.2:0/4010391823 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8808003aa0 con 0x7f8818101de0 2024-09-19T06:13:44.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.360+0000 7f881e4e5640 1 -- 172.21.15.2:0/4010391823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f881819d550 con 0x7f8818101de0 2024-09-19T06:13:44.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.360+0000 7f88157fa640 1 -- 172.21.15.2:0/4010391823 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8808035070 con 0x7f8818101de0 2024-09-19T06:13:44.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.360+0000 7f881e4e5640 1 -- 172.21.15.2:0/4010391823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88181a4e90 con 0x7f8818101de0 2024-09-19T06:13:44.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.361+0000 7f881e4e5640 1 -- 172.21.15.2:0/4010391823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8818062980 con 0x7f8818101de0 2024-09-19T06:13:44.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.362+0000 7f88157fa640 1 -- 172.21.15.2:0/4010391823 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f8808042030 con 0x7f8818101de0 2024-09-19T06:13:44.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.363+0000 7f88157fa640 1 --2- 172.21.15.2:0/4010391823 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f88000a3350 0x7f88000a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:44.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.363+0000 7f88177fe640 1 --2- 172.21.15.2:0/4010391823 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f88000a3350 0x7f88000a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:44.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.363+0000 7f88157fa640 1 -- 172.21.15.2:0/4010391823 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f88080f0970 con 0x7f8818101de0 2024-09-19T06:13:44.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.363+0000 7f88157fa640 1 --2- 172.21.15.2:0/4010391823 >> [v2:172.21.15.90:6808/189855967,v1:172.21.15.90:6809/189855967] conn(0x7f88000acf00 0x7f88000af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:44.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.363+0000 7f88157fa640 1 -- 172.21.15.2:0/4010391823 --> [v2:172.21.15.90:6808/189855967,v1:172.21.15.90:6809/189855967] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f88000afa70 con 0x7f88000acf00 2024-09-19T06:13:44.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.363+0000 7f88157fa640 1 -- 172.21.15.2:0/4010391823 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f88080f0d20 con 0x7f8818101de0 2024-09-19T06:13:44.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.363+0000 7f88177fe640 1 --2- 172.21.15.2:0/4010391823 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f88000a3350 0x7f88000a5810 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f88180ffee0 tx=0x7f880c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:44.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.363+0000 7f881ca82640 1 --2- 172.21.15.2:0/4010391823 >> [v2:172.21.15.90:6808/189855967,v1:172.21.15.90:6809/189855967] conn(0x7f88000acf00 0x7f88000af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:44.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.364+0000 7f881ca82640 1 --2- 172.21.15.2:0/4010391823 >> [v2:172.21.15.90:6808/189855967,v1:172.21.15.90:6809/189855967] conn(0x7f88000acf00 0x7f88000af3a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:44.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.365+0000 7f88157fa640 1 -- 172.21.15.2:0/4010391823 <== osd.5 v2:172.21.15.90:6808/189855967 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f88000afa70 con 0x7f88000acf00 2024-09-19T06:13:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.378+0000 7f881e4e5640 1 -- 172.21.15.2:0/4010391823 --> [v2:172.21.15.90:6808/189855967,v1:172.21.15.90:6809/189855967] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8818062d80 con 0x7f88000acf00 2024-09-19T06:13:44.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.379+0000 7f88157fa640 1 -- 172.21.15.2:0/4010391823 <== osd.5 v2:172.21.15.90:6808/189855967 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8818062d80 con 0x7f88000acf00 2024-09-19T06:13:44.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.379+0000 7f881e4e5640 1 -- 172.21.15.2:0/4010391823 >> [v2:172.21.15.90:6808/189855967,v1:172.21.15.90:6809/189855967] conn(0x7f88000acf00 msgr2=0x7f88000af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:44.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.379+0000 7f881e4e5640 1 --2- 172.21.15.2:0/4010391823 >> [v2:172.21.15.90:6808/189855967,v1:172.21.15.90:6809/189855967] conn(0x7f88000acf00 0x7f88000af3a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:44.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.379+0000 7f881e4e5640 1 -- 172.21.15.2:0/4010391823 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f88000a3350 msgr2=0x7f88000a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:44.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.379+0000 7f881e4e5640 1 --2- 172.21.15.2:0/4010391823 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f88000a3350 0x7f88000a5810 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f88180ffee0 tx=0x7f880c00b390 comp rx=0 tx=0).stop 2024-09-19T06:13:44.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.379+0000 7f881e4e5640 1 -- 172.21.15.2:0/4010391823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8818101de0 msgr2=0x7f8818198310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:44.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.379+0000 7f881e4e5640 1 --2- 172.21.15.2:0/4010391823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8818101de0 0x7f8818198310 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8808005940 tx=0x7f8808004270 comp rx=0 tx=0).stop 2024-09-19T06:13:44.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.379+0000 7f881ca82640 1 -- 172.21.15.2:0/4010391823 reap_dead start 2024-09-19T06:13:44.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.380+0000 7f881e4e5640 1 -- 172.21.15.2:0/4010391823 shutdown_connections 2024-09-19T06:13:44.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.380+0000 7f881e4e5640 1 -- 172.21.15.2:0/4010391823 >> 172.21.15.2:0/4010391823 conn(0x7f88180fd8c0 msgr2=0x7f88180fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:44.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.380+0000 7f881e4e5640 1 -- 172.21.15.2:0/4010391823 shutdown_connections 2024-09-19T06:13:44.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:44.380+0000 7f881e4e5640 1 -- 172.21.15.2:0/4010391823 wait complete. 2024-09-19T06:13:45.017 INFO:teuthology.orchestra.run.smithi002.stdout:261993005087 2024-09-19T06:13:45.017 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-19T06:13:45.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.549+0000 7f2cd7f33640 1 -- 172.21.15.2:0/2314088410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cd0101420 msgr2=0x7f2cd010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:45.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.549+0000 7f2cd7f33640 1 --2- 172.21.15.2:0/2314088410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cd0101420 0x7f2cd010d950 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8009cd0 tx=0x7f2cc802a8e0 comp rx=0 tx=0).stop 2024-09-19T06:13:45.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.549+0000 7f2cd7f33640 1 -- 172.21.15.2:0/2314088410 shutdown_connections 2024-09-19T06:13:45.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.549+0000 7f2cd7f33640 1 --2- 172.21.15.2:0/2314088410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cd0101420 0x7f2cd010d950 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:45.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.549+0000 7f2cd7f33640 1 --2- 172.21.15.2:0/2314088410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2cd0100a80 0x7f2cd0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:45.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.549+0000 7f2cd7f33640 1 --2- 172.21.15.2:0/2314088410 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2cd0106a80 0x7f2cd0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:45.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.549+0000 7f2cd7f33640 1 -- 172.21.15.2:0/2314088410 >> 172.21.15.2:0/2314088410 conn(0x7f2cd00fc7a0 msgr2=0x7f2cd00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:45.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.549+0000 7f2cd7f33640 1 -- 172.21.15.2:0/2314088410 shutdown_connections 2024-09-19T06:13:45.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.549+0000 7f2cd7f33640 1 -- 172.21.15.2:0/2314088410 wait complete. 2024-09-19T06:13:45.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.549+0000 7f2cd7f33640 1 Processor -- start 2024-09-19T06:13:45.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.550+0000 7f2cd7f33640 1 -- start start 2024-09-19T06:13:45.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.550+0000 7f2cd7f33640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2cd0100a80 0x7f2cd01991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:45.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.550+0000 7f2cd7f33640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2cd0101420 0x7f2cd01996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:45.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.550+0000 7f2cd7f33640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cd0106a80 0x7f2cd01a4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:45.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.550+0000 7f2cd7f33640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd0110d50 con 0x7f2cd0106a80 2024-09-19T06:13:45.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.550+0000 7f2cd7f33640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd0110bd0 con 0x7f2cd0100a80 2024-09-19T06:13:45.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.550+0000 7f2cd7f33640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd0110ed0 con 0x7f2cd0101420 2024-09-19T06:13:45.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.550+0000 7f2cd64d0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cd0106a80 0x7f2cd01a4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:45.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.550+0000 7f2cd64d0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cd0106a80 0x7f2cd01a4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57716/0 (socket says 172.21.15.2:57716) 2024-09-19T06:13:45.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.550+0000 7f2cd64d0640 1 -- 172.21.15.2:0/674704172 learned_addr learned my addr 172.21.15.2:0/674704172 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:13:45.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.550+0000 7f2cd54ce640 1 --2- 172.21.15.2:0/674704172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2cd0101420 0x7f2cd01996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:45.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.550+0000 7f2cd5ccf640 1 --2- 172.21.15.2:0/674704172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2cd0100a80 0x7f2cd01991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:45.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.550+0000 7f2cd64d0640 1 -- 172.21.15.2:0/674704172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2cd0101420 msgr2=0x7f2cd01996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:45.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.550+0000 7f2cd64d0640 1 --2- 172.21.15.2:0/674704172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2cd0101420 0x7f2cd01996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:45.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.550+0000 7f2cd64d0640 1 -- 172.21.15.2:0/674704172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2cd0100a80 msgr2=0x7f2cd01991a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:45.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.550+0000 7f2cd64d0640 1 --2- 172.21.15.2:0/674704172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2cd0100a80 0x7f2cd01991a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:45.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.550+0000 7f2cd64d0640 1 -- 172.21.15.2:0/674704172 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cd01a4760 con 0x7f2cd0106a80 2024-09-19T06:13:45.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.550+0000 7f2cd64d0640 1 --2- 172.21.15.2:0/674704172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cd0106a80 0x7f2cd01a4220 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8005cc0 tx=0x7f2cc8003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:45.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.551+0000 7f2cc6ffd640 1 -- 172.21.15.2:0/674704172 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8004240 con 0x7f2cd0106a80 2024-09-19T06:13:45.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.551+0000 7f2cc6ffd640 1 -- 172.21.15.2:0/674704172 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2cc80305a0 con 0x7f2cd0106a80 2024-09-19T06:13:45.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.551+0000 7f2cd7f33640 1 -- 172.21.15.2:0/674704172 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cd01a4930 con 0x7f2cd0106a80 2024-09-19T06:13:45.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.551+0000 7f2cc6ffd640 1 -- 172.21.15.2:0/674704172 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc80466c0 con 0x7f2cd0106a80 2024-09-19T06:13:45.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.551+0000 7f2cd7f33640 1 -- 172.21.15.2:0/674704172 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cd01a4e10 con 0x7f2cd0106a80 2024-09-19T06:13:45.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.552+0000 7f2cd7f33640 1 -- 172.21.15.2:0/674704172 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2cd0062900 con 0x7f2cd0106a80 2024-09-19T06:13:45.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.553+0000 7f2cc6ffd640 1 -- 172.21.15.2:0/674704172 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f2cc8030ac0 con 0x7f2cd0106a80 2024-09-19T06:13:45.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.553+0000 7f2cc6ffd640 1 --2- 172.21.15.2:0/674704172 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f2cbc0a3350 0x7f2cbc0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:45.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.554+0000 7f2cd5ccf640 1 --2- 172.21.15.2:0/674704172 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f2cbc0a3350 0x7f2cbc0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:45.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.554+0000 7f2cc6ffd640 1 -- 172.21.15.2:0/674704172 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f2cc802e030 con 0x7f2cd0106a80 2024-09-19T06:13:45.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.554+0000 7f2cc6ffd640 1 --2- 172.21.15.2:0/674704172 >> [v2:172.21.15.90:6816/3558544480,v1:172.21.15.90:6817/3558544480] conn(0x7f2cbc0acf00 0x7f2cbc0af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:45.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.554+0000 7f2cc6ffd640 1 -- 172.21.15.2:0/674704172 --> [v2:172.21.15.90:6816/3558544480,v1:172.21.15.90:6817/3558544480] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2cbc0afa70 con 0x7f2cbc0acf00 2024-09-19T06:13:45.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.554+0000 7f2cc6ffd640 1 -- 172.21.15.2:0/674704172 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f2cc80f11a0 con 0x7f2cd0106a80 2024-09-19T06:13:45.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.554+0000 7f2cd5ccf640 1 --2- 172.21.15.2:0/674704172 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f2cbc0a3350 0x7f2cbc0a5810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc00abe0 tx=0x7f2ccc00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:45.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.554+0000 7f2cd54ce640 1 --2- 172.21.15.2:0/674704172 >> [v2:172.21.15.90:6816/3558544480,v1:172.21.15.90:6817/3558544480] conn(0x7f2cbc0acf00 0x7f2cbc0af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:45.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.554+0000 7f2cd54ce640 1 --2- 172.21.15.2:0/674704172 >> [v2:172.21.15.90:6816/3558544480,v1:172.21.15.90:6817/3558544480] conn(0x7f2cbc0acf00 0x7f2cbc0af3a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:45.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.555+0000 7f2cc6ffd640 1 -- 172.21.15.2:0/674704172 <== osd.8 v2:172.21.15.90:6816/3558544480 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2cbc0afa70 con 0x7f2cbc0acf00 2024-09-19T06:13:45.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.569+0000 7f2cd7f33640 1 -- 172.21.15.2:0/674704172 --> [v2:172.21.15.90:6816/3558544480,v1:172.21.15.90:6817/3558544480] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2cd0062d80 con 0x7f2cbc0acf00 2024-09-19T06:13:45.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.569+0000 7f2cc6ffd640 1 -- 172.21.15.2:0/674704172 <== osd.8 v2:172.21.15.90:6816/3558544480 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2cd0062d80 con 0x7f2cbc0acf00 2024-09-19T06:13:45.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.570+0000 7f2cd7f33640 1 -- 172.21.15.2:0/674704172 >> [v2:172.21.15.90:6816/3558544480,v1:172.21.15.90:6817/3558544480] conn(0x7f2cbc0acf00 msgr2=0x7f2cbc0af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:45.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.570+0000 7f2cd7f33640 1 --2- 172.21.15.2:0/674704172 >> [v2:172.21.15.90:6816/3558544480,v1:172.21.15.90:6817/3558544480] conn(0x7f2cbc0acf00 0x7f2cbc0af3a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:45.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.570+0000 7f2cd7f33640 1 -- 172.21.15.2:0/674704172 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f2cbc0a3350 msgr2=0x7f2cbc0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:45.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.570+0000 7f2cd7f33640 1 --2- 172.21.15.2:0/674704172 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f2cbc0a3350 0x7f2cbc0a5810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc00abe0 tx=0x7f2ccc00a2d0 comp rx=0 tx=0).stop 2024-09-19T06:13:45.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.570+0000 7f2cd7f33640 1 -- 172.21.15.2:0/674704172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cd0106a80 msgr2=0x7f2cd01a4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:45.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.570+0000 7f2cd7f33640 1 --2- 172.21.15.2:0/674704172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cd0106a80 0x7f2cd01a4220 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8005cc0 tx=0x7f2cc8003ba0 comp rx=0 tx=0).stop 2024-09-19T06:13:45.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.570+0000 7f2cd64d0640 1 -- 172.21.15.2:0/674704172 reap_dead start 2024-09-19T06:13:45.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.570+0000 7f2cd7f33640 1 -- 172.21.15.2:0/674704172 shutdown_connections 2024-09-19T06:13:45.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.570+0000 7f2cd7f33640 1 -- 172.21.15.2:0/674704172 >> 172.21.15.2:0/674704172 conn(0x7f2cd00fc7a0 msgr2=0x7f2cd00fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:45.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.570+0000 7f2cd7f33640 1 -- 172.21.15.2:0/674704172 shutdown_connections 2024-09-19T06:13:45.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.570+0000 7f2cd7f33640 1 -- 172.21.15.2:0/674704172 wait complete. 2024-09-19T06:13:45.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.714+0000 7f6e308f5640 1 -- 172.21.15.2:0/638481472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e2c106f10 msgr2=0x7f6e2c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:45.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.714+0000 7f6e308f5640 1 --2- 172.21.15.2:0/638481472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e2c106f10 0x7f6e2c10ea90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6e24009900 tx=0x7f6e2402a410 comp rx=0 tx=0).stop 2024-09-19T06:13:45.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.714+0000 7f6e308f5640 1 -- 172.21.15.2:0/638481472 shutdown_connections 2024-09-19T06:13:45.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.714+0000 7f6e308f5640 1 --2- 172.21.15.2:0/638481472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e2c106f10 0x7f6e2c10ea90 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:45.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.714+0000 7f6e308f5640 1 --2- 172.21.15.2:0/638481472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e2c102790 0x7f6e2c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:45.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.714+0000 7f6e308f5640 1 --2- 172.21.15.2:0/638481472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e2c101de0 0x7f6e2c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:45.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.714+0000 7f6e308f5640 1 -- 172.21.15.2:0/638481472 >> 172.21.15.2:0/638481472 conn(0x7f6e2c0fd8c0 msgr2=0x7f6e2c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:45.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.715+0000 7f6e308f5640 1 -- 172.21.15.2:0/638481472 shutdown_connections 2024-09-19T06:13:45.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.715+0000 7f6e308f5640 1 -- 172.21.15.2:0/638481472 wait complete. 2024-09-19T06:13:45.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.715+0000 7f6e308f5640 1 Processor -- start 2024-09-19T06:13:45.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.715+0000 7f6e308f5640 1 -- start start 2024-09-19T06:13:45.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.716+0000 7f6e308f5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e2c101de0 0x7f6e2c19a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:45.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.716+0000 7f6e308f5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e2c102790 0x7f6e2c19aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:45.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.716+0000 7f6e308f5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e2c106f10 0x7f6e2c19ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:45.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.716+0000 7f6e308f5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6e2c111e20 con 0x7f6e2c102790 2024-09-19T06:13:45.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.716+0000 7f6e308f5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6e2c111ca0 con 0x7f6e2c101de0 2024-09-19T06:13:45.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.716+0000 7f6e308f5640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6e2c111fa0 con 0x7f6e2c106f10 2024-09-19T06:13:45.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.716+0000 7f6e29d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e2c102790 0x7f6e2c19aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:45.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.716+0000 7f6e29d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e2c102790 0x7f6e2c19aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57738/0 (socket says 172.21.15.2:57738) 2024-09-19T06:13:45.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.716+0000 7f6e29d9b640 1 -- 172.21.15.2:0/1311068327 learned_addr learned my addr 172.21.15.2:0/1311068327 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:13:45.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.716+0000 7f6e2a59c640 1 --2- 172.21.15.2:0/1311068327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e2c101de0 0x7f6e2c19a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:45.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.716+0000 7f6e29d9b640 1 -- 172.21.15.2:0/1311068327 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e2c106f10 msgr2=0x7f6e2c19ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:45.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.716+0000 7f6e29d9b640 1 --2- 172.21.15.2:0/1311068327 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e2c106f10 0x7f6e2c19ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:45.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.716+0000 7f6e29d9b640 1 -- 172.21.15.2:0/1311068327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e2c101de0 msgr2=0x7f6e2c19a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:45.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.716+0000 7f6e29d9b640 1 --2- 172.21.15.2:0/1311068327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e2c101de0 0x7f6e2c19a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:45.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.716+0000 7f6e29d9b640 1 -- 172.21.15.2:0/1311068327 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e2c19f4e0 con 0x7f6e2c102790 2024-09-19T06:13:45.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.716+0000 7f6e2a59c640 1 --2- 172.21.15.2:0/1311068327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e2c101de0 0x7f6e2c19a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:13:45.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.716+0000 7f6e29d9b640 1 --2- 172.21.15.2:0/1311068327 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e2c102790 0x7f6e2c19aa70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6e1400d770 tx=0x7f6e1400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:45.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.717+0000 7f6e237fe640 1 -- 172.21.15.2:0/1311068327 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e14017070 con 0x7f6e2c102790 2024-09-19T06:13:45.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.717+0000 7f6e308f5640 1 -- 172.21.15.2:0/1311068327 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e2c19f7d0 con 0x7f6e2c102790 2024-09-19T06:13:45.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.717+0000 7f6e237fe640 1 -- 172.21.15.2:0/1311068327 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6e140054d0 con 0x7f6e2c102790 2024-09-19T06:13:45.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.717+0000 7f6e237fe640 1 -- 172.21.15.2:0/1311068327 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e14004cf0 con 0x7f6e2c102790 2024-09-19T06:13:45.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.717+0000 7f6e308f5640 1 -- 172.21.15.2:0/1311068327 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e2c1a70b0 con 0x7f6e2c102790 2024-09-19T06:13:45.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.718+0000 7f6e308f5640 1 -- 172.21.15.2:0/1311068327 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6e2c075780 con 0x7f6e2c102790 2024-09-19T06:13:45.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.719+0000 7f6e237fe640 1 -- 172.21.15.2:0/1311068327 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f6e14004e90 con 0x7f6e2c102790 2024-09-19T06:13:45.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.720+0000 7f6e237fe640 1 --2- 172.21.15.2:0/1311068327 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f6e180a32d0 0x7f6e180a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:45.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.720+0000 7f6e2a59c640 1 --2- 172.21.15.2:0/1311068327 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f6e180a32d0 0x7f6e180a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:45.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.720+0000 7f6e237fe640 1 -- 172.21.15.2:0/1311068327 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f6e140cf900 con 0x7f6e2c102790 2024-09-19T06:13:45.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.720+0000 7f6e237fe640 1 --2- 172.21.15.2:0/1311068327 >> [v2:172.21.15.89:6824/1141925395,v1:172.21.15.89:6825/1141925395] conn(0x7f6e180ace80 0x7f6e180af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:45.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.720+0000 7f6e237fe640 1 -- 172.21.15.2:0/1311068327 --> [v2:172.21.15.89:6824/1141925395,v1:172.21.15.89:6825/1141925395] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6e14005320 con 0x7f6e180ace80 2024-09-19T06:13:45.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.720+0000 7f6e237fe640 1 -- 172.21.15.2:0/1311068327 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f6e140cfcb0 con 0x7f6e2c102790 2024-09-19T06:13:45.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.720+0000 7f6e2a59c640 1 --2- 172.21.15.2:0/1311068327 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f6e180a32d0 0x7f6e180a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c005fd0 tx=0x7f6e1c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:45.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.721+0000 7f6e2ad9d640 1 --2- 172.21.15.2:0/1311068327 >> [v2:172.21.15.89:6824/1141925395,v1:172.21.15.89:6825/1141925395] conn(0x7f6e180ace80 0x7f6e180af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:45.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.721+0000 7f6e2ad9d640 1 --2- 172.21.15.2:0/1311068327 >> [v2:172.21.15.89:6824/1141925395,v1:172.21.15.89:6825/1141925395] conn(0x7f6e180ace80 0x7f6e180af320 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:45.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.722+0000 7f6e237fe640 1 -- 172.21.15.2:0/1311068327 <== osd.10 v2:172.21.15.89:6824/1141925395 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6e14005320 con 0x7f6e180ace80 2024-09-19T06:13:45.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.735+0000 7f6e308f5640 1 -- 172.21.15.2:0/1311068327 --> [v2:172.21.15.89:6824/1141925395,v1:172.21.15.89:6825/1141925395] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6e2c1032c0 con 0x7f6e180ace80 2024-09-19T06:13:45.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.736+0000 7f6e237fe640 1 -- 172.21.15.2:0/1311068327 <== osd.10 v2:172.21.15.89:6824/1141925395 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6e2c1032c0 con 0x7f6e180ace80 2024-09-19T06:13:45.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.737+0000 7f6e308f5640 1 -- 172.21.15.2:0/1311068327 >> [v2:172.21.15.89:6824/1141925395,v1:172.21.15.89:6825/1141925395] conn(0x7f6e180ace80 msgr2=0x7f6e180af320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:45.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.737+0000 7f6e308f5640 1 --2- 172.21.15.2:0/1311068327 >> [v2:172.21.15.89:6824/1141925395,v1:172.21.15.89:6825/1141925395] conn(0x7f6e180ace80 0x7f6e180af320 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:45.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.737+0000 7f6e308f5640 1 -- 172.21.15.2:0/1311068327 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f6e180a32d0 msgr2=0x7f6e180a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:45.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.737+0000 7f6e308f5640 1 --2- 172.21.15.2:0/1311068327 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f6e180a32d0 0x7f6e180a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c005fd0 tx=0x7f6e1c009500 comp rx=0 tx=0).stop 2024-09-19T06:13:45.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.737+0000 7f6e308f5640 1 -- 172.21.15.2:0/1311068327 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e2c102790 msgr2=0x7f6e2c19aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:45.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.737+0000 7f6e308f5640 1 --2- 172.21.15.2:0/1311068327 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e2c102790 0x7f6e2c19aa70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6e1400d770 tx=0x7f6e1400dc30 comp rx=0 tx=0).stop 2024-09-19T06:13:45.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.737+0000 7f6e2ad9d640 1 -- 172.21.15.2:0/1311068327 reap_dead start 2024-09-19T06:13:45.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.737+0000 7f6e308f5640 1 -- 172.21.15.2:0/1311068327 shutdown_connections 2024-09-19T06:13:45.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.737+0000 7f6e308f5640 1 -- 172.21.15.2:0/1311068327 >> 172.21.15.2:0/1311068327 conn(0x7f6e2c0fd8c0 msgr2=0x7f6e2c0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:45.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.737+0000 7f6e308f5640 1 -- 172.21.15.2:0/1311068327 shutdown_connections 2024-09-19T06:13:45.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:45.737+0000 7f6e308f5640 1 -- 172.21.15.2:0/1311068327 wait complete. 2024-09-19T06:13:45.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:45 smithi002 ceph-mon[30982]: pgmap v297: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-19T06:13:46.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:45 smithi090 ceph-mon[34497]: pgmap v297: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-19T06:13:46.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:45 smithi089 ceph-mon[34160]: pgmap v297: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-19T06:13:46.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.621+0000 7fe6c4293640 1 -- 172.21.15.2:0/3562968835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6bc102d30 msgr2=0x7fe6bc103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:46.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.621+0000 7fe6c4293640 1 --2- 172.21.15.2:0/3562968835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6bc102d30 0x7fe6bc103110 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8009930 tx=0x7fe6b802a420 comp rx=0 tx=0).stop 2024-09-19T06:13:46.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.621+0000 7fe6c4293640 1 -- 172.21.15.2:0/3562968835 shutdown_connections 2024-09-19T06:13:46.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.621+0000 7fe6c4293640 1 --2- 172.21.15.2:0/3562968835 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe6bc1082a0 0x7fe6bc10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:46.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.621+0000 7fe6c4293640 1 --2- 172.21.15.2:0/3562968835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6bc1036e0 0x7fe6bc107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:46.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.621+0000 7fe6c4293640 1 --2- 172.21.15.2:0/3562968835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6bc102d30 0x7fe6bc103110 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:46.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.621+0000 7fe6c4293640 1 -- 172.21.15.2:0/3562968835 >> 172.21.15.2:0/3562968835 conn(0x7fe6bc0fc7d0 msgr2=0x7fe6bc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:46.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.621+0000 7fe6c4293640 1 -- 172.21.15.2:0/3562968835 shutdown_connections 2024-09-19T06:13:46.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.621+0000 7fe6c4293640 1 -- 172.21.15.2:0/3562968835 wait complete. 2024-09-19T06:13:46.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.621+0000 7fe6c4293640 1 Processor -- start 2024-09-19T06:13:46.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.621+0000 7fe6c4293640 1 -- start start 2024-09-19T06:13:46.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.622+0000 7fe6c4293640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe6bc102d30 0x7fe6bc19a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:46.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.622+0000 7fe6c4293640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6bc1036e0 0x7fe6bc19abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:46.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.622+0000 7fe6c4293640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6bc1082a0 0x7fe6bc19ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:46.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.622+0000 7fe6c4293640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc111f50 con 0x7fe6bc1082a0 2024-09-19T06:13:46.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.622+0000 7fe6c4293640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc111dd0 con 0x7fe6bc1036e0 2024-09-19T06:13:46.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.622+0000 7fe6c4293640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc1120d0 con 0x7fe6bc102d30 2024-09-19T06:13:46.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.622+0000 7fe6c2830640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6bc1082a0 0x7fe6bc19ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:46.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.622+0000 7fe6c2830640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6bc1082a0 0x7fe6bc19ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57752/0 (socket says 172.21.15.2:57752) 2024-09-19T06:13:46.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.622+0000 7fe6c2830640 1 -- 172.21.15.2:0/2356728935 learned_addr learned my addr 172.21.15.2:0/2356728935 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:13:46.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.622+0000 7fe6c182e640 1 --2- 172.21.15.2:0/2356728935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6bc1036e0 0x7fe6bc19abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:46.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.622+0000 7fe6c202f640 1 --2- 172.21.15.2:0/2356728935 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe6bc102d30 0x7fe6bc19a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:46.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.622+0000 7fe6c2830640 1 -- 172.21.15.2:0/2356728935 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe6bc102d30 msgr2=0x7fe6bc19a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:46.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.622+0000 7fe6c2830640 1 --2- 172.21.15.2:0/2356728935 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe6bc102d30 0x7fe6bc19a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:46.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.622+0000 7fe6c2830640 1 -- 172.21.15.2:0/2356728935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6bc1036e0 msgr2=0x7fe6bc19abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:46.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.622+0000 7fe6c2830640 1 --2- 172.21.15.2:0/2356728935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6bc1036e0 0x7fe6bc19abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:46.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.622+0000 7fe6c2830640 1 -- 172.21.15.2:0/2356728935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6bc19f640 con 0x7fe6bc1082a0 2024-09-19T06:13:46.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.622+0000 7fe6c2830640 1 --2- 172.21.15.2:0/2356728935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6bc1082a0 0x7fe6bc19ef60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe6b400cce0 tx=0x7fe6b400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:46.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.622+0000 7fe6b37fe640 1 -- 172.21.15.2:0/2356728935 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b400f450 con 0x7fe6bc1082a0 2024-09-19T06:13:46.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.623+0000 7fe6c4293640 1 -- 172.21.15.2:0/2356728935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6bc19f930 con 0x7fe6bc1082a0 2024-09-19T06:13:46.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.623+0000 7fe6b37fe640 1 -- 172.21.15.2:0/2356728935 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe6b400faa0 con 0x7fe6bc1082a0 2024-09-19T06:13:46.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.623+0000 7fe6b37fe640 1 -- 172.21.15.2:0/2356728935 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b4018b70 con 0x7fe6bc1082a0 2024-09-19T06:13:46.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.623+0000 7fe6c4293640 1 -- 172.21.15.2:0/2356728935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6bc1a7210 con 0x7fe6bc1082a0 2024-09-19T06:13:46.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.624+0000 7fe6c4293640 1 -- 172.21.15.2:0/2356728935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe6bc10eac0 con 0x7fe6bc1082a0 2024-09-19T06:13:46.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.625+0000 7fe6b37fe640 1 -- 172.21.15.2:0/2356728935 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fe6b4018d10 con 0x7fe6bc1082a0 2024-09-19T06:13:46.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.625+0000 7fe6b37fe640 1 --2- 172.21.15.2:0/2356728935 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fe6a80a32d0 0x7fe6a80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:46.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.626+0000 7fe6c202f640 1 --2- 172.21.15.2:0/2356728935 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fe6a80a32d0 0x7fe6a80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:46.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.626+0000 7fe6b37fe640 1 -- 172.21.15.2:0/2356728935 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7fe6b40d00f0 con 0x7fe6bc1082a0 2024-09-19T06:13:46.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.626+0000 7fe6b37fe640 1 --2- 172.21.15.2:0/2356728935 >> [v2:172.21.15.89:6816/508513510,v1:172.21.15.89:6817/508513510] conn(0x7fe6a80ace80 0x7fe6a80af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:46.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.626+0000 7fe6b37fe640 1 -- 172.21.15.2:0/2356728935 --> [v2:172.21.15.89:6816/508513510,v1:172.21.15.89:6817/508513510] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe6b4015e70 con 0x7fe6a80ace80 2024-09-19T06:13:46.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.626+0000 7fe6b37fe640 1 -- 172.21.15.2:0/2356728935 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fe6b40d0540 con 0x7fe6bc1082a0 2024-09-19T06:13:46.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.626+0000 7fe6c202f640 1 --2- 172.21.15.2:0/2356728935 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fe6a80a32d0 0x7fe6a80a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8000c00 tx=0x7fe6b8032c80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:46.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.626+0000 7fe6c182e640 1 --2- 172.21.15.2:0/2356728935 >> [v2:172.21.15.89:6816/508513510,v1:172.21.15.89:6817/508513510] conn(0x7fe6a80ace80 0x7fe6a80af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:46.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.627+0000 7fe6c182e640 1 --2- 172.21.15.2:0/2356728935 >> [v2:172.21.15.89:6816/508513510,v1:172.21.15.89:6817/508513510] conn(0x7fe6a80ace80 0x7fe6a80af320 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:46.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.627+0000 7fe6b37fe640 1 -- 172.21.15.2:0/2356728935 <== osd.7 v2:172.21.15.89:6816/508513510 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe6b4015e70 con 0x7fe6a80ace80 2024-09-19T06:13:46.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.642+0000 7fe6c4293640 1 -- 172.21.15.2:0/2356728935 --> [v2:172.21.15.89:6816/508513510,v1:172.21.15.89:6817/508513510] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe6bc06a850 con 0x7fe6a80ace80 2024-09-19T06:13:46.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.643+0000 7fe6b37fe640 1 -- 172.21.15.2:0/2356728935 <== osd.7 v2:172.21.15.89:6816/508513510 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe6bc06a850 con 0x7fe6a80ace80 2024-09-19T06:13:46.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.643+0000 7fe6c4293640 1 -- 172.21.15.2:0/2356728935 >> [v2:172.21.15.89:6816/508513510,v1:172.21.15.89:6817/508513510] conn(0x7fe6a80ace80 msgr2=0x7fe6a80af320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:46.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.643+0000 7fe6c4293640 1 --2- 172.21.15.2:0/2356728935 >> [v2:172.21.15.89:6816/508513510,v1:172.21.15.89:6817/508513510] conn(0x7fe6a80ace80 0x7fe6a80af320 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:46.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.643+0000 7fe6c4293640 1 -- 172.21.15.2:0/2356728935 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fe6a80a32d0 msgr2=0x7fe6a80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:46.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.643+0000 7fe6c4293640 1 --2- 172.21.15.2:0/2356728935 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fe6a80a32d0 0x7fe6a80a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8000c00 tx=0x7fe6b8032c80 comp rx=0 tx=0).stop 2024-09-19T06:13:46.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.643+0000 7fe6c4293640 1 -- 172.21.15.2:0/2356728935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6bc1082a0 msgr2=0x7fe6bc19ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:46.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.643+0000 7fe6c4293640 1 --2- 172.21.15.2:0/2356728935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6bc1082a0 0x7fe6bc19ef60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe6b400cce0 tx=0x7fe6b400a620 comp rx=0 tx=0).stop 2024-09-19T06:13:46.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.643+0000 7fe6c2830640 1 -- 172.21.15.2:0/2356728935 reap_dead start 2024-09-19T06:13:46.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.643+0000 7fe6c4293640 1 -- 172.21.15.2:0/2356728935 shutdown_connections 2024-09-19T06:13:46.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.643+0000 7fe6c4293640 1 -- 172.21.15.2:0/2356728935 >> 172.21.15.2:0/2356728935 conn(0x7fe6bc0fc7d0 msgr2=0x7fe6bc10d050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:46.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.643+0000 7fe6c4293640 1 -- 172.21.15.2:0/2356728935 shutdown_connections 2024-09-19T06:13:46.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.643+0000 7fe6c4293640 1 -- 172.21.15.2:0/2356728935 wait complete. 2024-09-19T06:13:47.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.831+0000 7f1217f01640 1 -- 172.21.15.2:0/1650276730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1210102b50 msgr2=0x7f1210100090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:47.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.831+0000 7f1217f01640 1 --2- 172.21.15.2:0/1650276730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1210102b50 0x7f1210100090 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f120c009900 tx=0x7f120c02a400 comp rx=0 tx=0).stop 2024-09-19T06:13:47.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.831+0000 7f1217f01640 1 -- 172.21.15.2:0/1650276730 shutdown_connections 2024-09-19T06:13:47.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.831+0000 7f1217f01640 1 --2- 172.21.15.2:0/1650276730 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f121010e810 0x7f1210110c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:47.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.831+0000 7f1217f01640 1 --2- 172.21.15.2:0/1650276730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1210102fc0 0x7f12101005d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:47.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.831+0000 7f1217f01640 1 --2- 172.21.15.2:0/1650276730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1210102b50 0x7f1210100090 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:47.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.831+0000 7f1217f01640 1 -- 172.21.15.2:0/1650276730 >> 172.21.15.2:0/1650276730 conn(0x7f1210077210 msgr2=0x7f12100fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:47.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.831+0000 7f1217f01640 1 -- 172.21.15.2:0/1650276730 shutdown_connections 2024-09-19T06:13:47.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.831+0000 7f1217f01640 1 -- 172.21.15.2:0/1650276730 wait complete. 2024-09-19T06:13:47.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.832+0000 7f1217f01640 1 Processor -- start 2024-09-19T06:13:47.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.832+0000 7f1217f01640 1 -- start start 2024-09-19T06:13:47.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.832+0000 7f1217f01640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1210102b50 0x7f121019a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:47.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.832+0000 7f1217f01640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f121010e810 0x7f121019ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:47.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.832+0000 7f1217f01640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f121019eec0 0x7f121019f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:47.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.832+0000 7f1217f01640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1210114070 con 0x7f121019eec0 2024-09-19T06:13:47.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.832+0000 7f1217f01640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f1210113ef0 con 0x7f1210102b50 2024-09-19T06:13:47.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.832+0000 7f1217f01640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f12101141f0 con 0x7f121010e810 2024-09-19T06:13:47.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.832+0000 7f121649e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f121019eec0 0x7f121019f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:47.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.832+0000 7f121649e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f121019eec0 0x7f121019f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57772/0 (socket says 172.21.15.2:57772) 2024-09-19T06:13:47.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.832+0000 7f121649e640 1 -- 172.21.15.2:0/3804063729 learned_addr learned my addr 172.21.15.2:0/3804063729 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:13:47.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.832+0000 7f121549c640 1 --2- 172.21.15.2:0/3804063729 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f121010e810 0x7f121019ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:47.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.832+0000 7f1215c9d640 1 --2- 172.21.15.2:0/3804063729 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1210102b50 0x7f121019a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:47.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.832+0000 7f121649e640 1 -- 172.21.15.2:0/3804063729 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f121010e810 msgr2=0x7f121019ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:47.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.832+0000 7f121649e640 1 --2- 172.21.15.2:0/3804063729 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f121010e810 0x7f121019ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:47.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.832+0000 7f121649e640 1 -- 172.21.15.2:0/3804063729 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1210102b50 msgr2=0x7f121019a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:47.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.832+0000 7f121649e640 1 --2- 172.21.15.2:0/3804063729 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1210102b50 0x7f121019a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:47.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.832+0000 7f121649e640 1 -- 172.21.15.2:0/3804063729 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f121019f980 con 0x7f121019eec0 2024-09-19T06:13:47.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.832+0000 7f1215c9d640 1 --2- 172.21.15.2:0/3804063729 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1210102b50 0x7f121019a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:13:47.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.833+0000 7f121649e640 1 --2- 172.21.15.2:0/3804063729 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f121019eec0 0x7f121019f370 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1208009fd0 tx=0x7f120800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:47.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.833+0000 7f1206ffd640 1 -- 172.21.15.2:0/3804063729 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1208017070 con 0x7f121019eec0 2024-09-19T06:13:47.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.833+0000 7f1217f01640 1 -- 172.21.15.2:0/3804063729 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f121019fc70 con 0x7f121019eec0 2024-09-19T06:13:47.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.833+0000 7f1206ffd640 1 -- 172.21.15.2:0/3804063729 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1208003e20 con 0x7f121019eec0 2024-09-19T06:13:47.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.833+0000 7f1206ffd640 1 -- 172.21.15.2:0/3804063729 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1208010460 con 0x7f121019eec0 2024-09-19T06:13:47.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.833+0000 7f1217f01640 1 -- 172.21.15.2:0/3804063729 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12101a7400 con 0x7f121019eec0 2024-09-19T06:13:47.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.834+0000 7f1217f01640 1 -- 172.21.15.2:0/3804063729 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f12101012b0 con 0x7f121019eec0 2024-09-19T06:13:47.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.835+0000 7f1206ffd640 1 -- 172.21.15.2:0/3804063729 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f1208003970 con 0x7f121019eec0 2024-09-19T06:13:47.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.836+0000 7f1206ffd640 1 --2- 172.21.15.2:0/3804063729 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f11fc0a32d0 0x7f11fc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:47.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.836+0000 7f1215c9d640 1 --2- 172.21.15.2:0/3804063729 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f11fc0a32d0 0x7f11fc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:47.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.836+0000 7f1206ffd640 1 -- 172.21.15.2:0/3804063729 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f12080cfc40 con 0x7f121019eec0 2024-09-19T06:13:47.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.836+0000 7f1206ffd640 1 --2- 172.21.15.2:0/3804063729 >> [v2:172.21.15.2:6802/915165910,v1:172.21.15.2:6803/915165910] conn(0x7f11fc0ace80 0x7f11fc0af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:47.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.836+0000 7f1206ffd640 1 -- 172.21.15.2:0/3804063729 --> [v2:172.21.15.2:6802/915165910,v1:172.21.15.2:6803/915165910] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f11fc0af9f0 con 0x7f11fc0ace80 2024-09-19T06:13:47.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.836+0000 7f1206ffd640 1 -- 172.21.15.2:0/3804063729 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f12080d0090 con 0x7f121019eec0 2024-09-19T06:13:47.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.836+0000 7f121549c640 1 --2- 172.21.15.2:0/3804063729 >> [v2:172.21.15.2:6802/915165910,v1:172.21.15.2:6803/915165910] conn(0x7f11fc0ace80 0x7f11fc0af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:47.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.836+0000 7f1215c9d640 1 --2- 172.21.15.2:0/3804063729 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f11fc0a32d0 0x7f11fc0a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f120c031440 tx=0x7f120c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:47.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.836+0000 7f121549c640 1 --2- 172.21.15.2:0/3804063729 >> [v2:172.21.15.2:6802/915165910,v1:172.21.15.2:6803/915165910] conn(0x7f11fc0ace80 0x7f11fc0af320 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:47.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.837+0000 7f1206ffd640 1 -- 172.21.15.2:0/3804063729 <== osd.0 v2:172.21.15.2:6802/915165910 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f11fc0af9f0 con 0x7f11fc0ace80 2024-09-19T06:13:47.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.851+0000 7f1217f01640 1 -- 172.21.15.2:0/3804063729 --> [v2:172.21.15.2:6802/915165910,v1:172.21.15.2:6803/915165910] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1210110770 con 0x7f11fc0ace80 2024-09-19T06:13:47.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.851+0000 7f1206ffd640 1 -- 172.21.15.2:0/3804063729 <== osd.0 v2:172.21.15.2:6802/915165910 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1210110770 con 0x7f11fc0ace80 2024-09-19T06:13:47.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.851+0000 7f1217f01640 1 -- 172.21.15.2:0/3804063729 >> [v2:172.21.15.2:6802/915165910,v1:172.21.15.2:6803/915165910] conn(0x7f11fc0ace80 msgr2=0x7f11fc0af320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:47.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.851+0000 7f1217f01640 1 --2- 172.21.15.2:0/3804063729 >> [v2:172.21.15.2:6802/915165910,v1:172.21.15.2:6803/915165910] conn(0x7f11fc0ace80 0x7f11fc0af320 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:47.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.851+0000 7f1217f01640 1 -- 172.21.15.2:0/3804063729 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f11fc0a32d0 msgr2=0x7f11fc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:47.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.851+0000 7f1217f01640 1 --2- 172.21.15.2:0/3804063729 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f11fc0a32d0 0x7f11fc0a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f120c031440 tx=0x7f120c005a20 comp rx=0 tx=0).stop 2024-09-19T06:13:47.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.851+0000 7f1217f01640 1 -- 172.21.15.2:0/3804063729 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f121019eec0 msgr2=0x7f121019f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:47.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.851+0000 7f1217f01640 1 --2- 172.21.15.2:0/3804063729 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f121019eec0 0x7f121019f370 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1208009fd0 tx=0x7f120800b260 comp rx=0 tx=0).stop 2024-09-19T06:13:47.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.851+0000 7f121649e640 1 -- 172.21.15.2:0/3804063729 reap_dead start 2024-09-19T06:13:47.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.851+0000 7f1217f01640 1 -- 172.21.15.2:0/3804063729 shutdown_connections 2024-09-19T06:13:47.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.851+0000 7f1217f01640 1 -- 172.21.15.2:0/3804063729 >> 172.21.15.2:0/3804063729 conn(0x7f1210077210 msgr2=0x7f121010fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:47.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.851+0000 7f1217f01640 1 -- 172.21.15.2:0/3804063729 shutdown_connections 2024-09-19T06:13:47.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.851+0000 7f1217f01640 1 -- 172.21.15.2:0/3804063729 wait complete. 2024-09-19T06:13:47.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.752+0000 7f14db2f6640 1 -- 172.21.15.2:0/2911647355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14d4106a80 msgr2=0x7f14d4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:47.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.752+0000 7f14db2f6640 1 --2- 172.21.15.2:0/2911647355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14d4106a80 0x7f14d4106e60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f14c4009cd0 tx=0x7f14c402a8e0 comp rx=0 tx=0).stop 2024-09-19T06:13:47.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.752+0000 7f14db2f6640 1 -- 172.21.15.2:0/2911647355 shutdown_connections 2024-09-19T06:13:47.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.752+0000 7f14db2f6640 1 --2- 172.21.15.2:0/2911647355 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14d4101420 0x7f14d410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:47.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.752+0000 7f14db2f6640 1 --2- 172.21.15.2:0/2911647355 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14d4100a80 0x7f14d4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:47.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.752+0000 7f14db2f6640 1 --2- 172.21.15.2:0/2911647355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14d4106a80 0x7f14d4106e60 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:47.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.752+0000 7f14db2f6640 1 -- 172.21.15.2:0/2911647355 >> 172.21.15.2:0/2911647355 conn(0x7f14d40fc7a0 msgr2=0x7f14d40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:47.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.752+0000 7f14db2f6640 1 -- 172.21.15.2:0/2911647355 shutdown_connections 2024-09-19T06:13:47.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.752+0000 7f14db2f6640 1 -- 172.21.15.2:0/2911647355 wait complete. 2024-09-19T06:13:47.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.752+0000 7f14db2f6640 1 Processor -- start 2024-09-19T06:13:47.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.752+0000 7f14db2f6640 1 -- start start 2024-09-19T06:13:47.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.753+0000 7f14db2f6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14d4100a80 0x7f14d4198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:47.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.753+0000 7f14db2f6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14d4101420 0x7f14d41988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:47.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.753+0000 7f14db2f6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14d4106a80 0x7f14d419cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:47.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.753+0000 7f14db2f6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f14d4110d30 con 0x7f14d4106a80 2024-09-19T06:13:47.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.753+0000 7f14db2f6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f14d4110bb0 con 0x7f14d4100a80 2024-09-19T06:13:47.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.753+0000 7f14db2f6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f14d4110eb0 con 0x7f14d4101420 2024-09-19T06:13:47.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.753+0000 7f14d9893640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14d4106a80 0x7f14d419cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:47.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.753+0000 7f14d9893640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14d4106a80 0x7f14d419cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57820/0 (socket says 172.21.15.2:57820) 2024-09-19T06:13:47.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.753+0000 7f14d9893640 1 -- 172.21.15.2:0/3277651302 learned_addr learned my addr 172.21.15.2:0/3277651302 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:13:47.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.753+0000 7f14d9092640 1 --2- 172.21.15.2:0/3277651302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14d4100a80 0x7f14d4198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:47.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.753+0000 7f14d8891640 1 --2- 172.21.15.2:0/3277651302 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14d4101420 0x7f14d41988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:47.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.753+0000 7f14d9893640 1 -- 172.21.15.2:0/3277651302 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14d4101420 msgr2=0x7f14d41988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:47.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.753+0000 7f14d9893640 1 --2- 172.21.15.2:0/3277651302 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14d4101420 0x7f14d41988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:47.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.753+0000 7f14d9893640 1 -- 172.21.15.2:0/3277651302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14d4100a80 msgr2=0x7f14d4198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:47.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.753+0000 7f14d9893640 1 --2- 172.21.15.2:0/3277651302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14d4100a80 0x7f14d4198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:47.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.753+0000 7f14d9893640 1 -- 172.21.15.2:0/3277651302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14d419d340 con 0x7f14d4106a80 2024-09-19T06:13:47.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.753+0000 7f14d9893640 1 --2- 172.21.15.2:0/3277651302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14d4106a80 0x7f14d419cc60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f14cc00d950 tx=0x7f14cc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:47.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.753+0000 7f14d27fc640 1 -- 172.21.15.2:0/3277651302 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14cc017030 con 0x7f14d4106a80 2024-09-19T06:13:47.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.753+0000 7f14db2f6640 1 -- 172.21.15.2:0/3277651302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14d419d630 con 0x7f14d4106a80 2024-09-19T06:13:47.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.753+0000 7f14d27fc640 1 -- 172.21.15.2:0/3277651302 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f14cc004020 con 0x7f14d4106a80 2024-09-19T06:13:47.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.753+0000 7f14d27fc640 1 -- 172.21.15.2:0/3277651302 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14cc003b20 con 0x7f14d4106a80 2024-09-19T06:13:47.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.754+0000 7f14db2f6640 1 -- 172.21.15.2:0/3277651302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14d41a4f10 con 0x7f14d4106a80 2024-09-19T06:13:47.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.754+0000 7f14db2f6640 1 -- 172.21.15.2:0/3277651302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f14d4105af0 con 0x7f14d4106a80 2024-09-19T06:13:47.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.756+0000 7f14d27fc640 1 -- 172.21.15.2:0/3277651302 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f14cc01a070 con 0x7f14d4106a80 2024-09-19T06:13:47.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.756+0000 7f14d27fc640 1 --2- 172.21.15.2:0/3277651302 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f14bc0a32d0 0x7f14bc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:47.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.757+0000 7f14d9092640 1 --2- 172.21.15.2:0/3277651302 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f14bc0a32d0 0x7f14bc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:47.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.757+0000 7f14d27fc640 1 -- 172.21.15.2:0/3277651302 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f14cc0cfbd0 con 0x7f14d4106a80 2024-09-19T06:13:47.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.757+0000 7f14d27fc640 1 --2- 172.21.15.2:0/3277651302 >> [v2:172.21.15.2:6818/3886336279,v1:172.21.15.2:6819/3886336279] conn(0x7f14bc0ace80 0x7f14bc0af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:47.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.757+0000 7f14d27fc640 1 -- 172.21.15.2:0/3277651302 --> [v2:172.21.15.2:6818/3886336279,v1:172.21.15.2:6819/3886336279] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f14cc00ae50 con 0x7f14bc0ace80 2024-09-19T06:13:47.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.757+0000 7f14d27fc640 1 -- 172.21.15.2:0/3277651302 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f14cc0d0020 con 0x7f14d4106a80 2024-09-19T06:13:47.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.757+0000 7f14d8891640 1 --2- 172.21.15.2:0/3277651302 >> [v2:172.21.15.2:6818/3886336279,v1:172.21.15.2:6819/3886336279] conn(0x7f14bc0ace80 0x7f14bc0af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:47.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.757+0000 7f14d9092640 1 --2- 172.21.15.2:0/3277651302 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f14bc0a32d0 0x7f14bc0a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f14c4006010 tx=0x7f14c40099c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:47.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.757+0000 7f14d8891640 1 --2- 172.21.15.2:0/3277651302 >> [v2:172.21.15.2:6818/3886336279,v1:172.21.15.2:6819/3886336279] conn(0x7f14bc0ace80 0x7f14bc0af320 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:47.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.758+0000 7f14d27fc640 1 -- 172.21.15.2:0/3277651302 <== osd.6 v2:172.21.15.2:6818/3886336279 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f14cc00ae50 con 0x7f14bc0ace80 2024-09-19T06:13:47.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.772+0000 7f14db2f6640 1 -- 172.21.15.2:0/3277651302 --> [v2:172.21.15.2:6818/3886336279,v1:172.21.15.2:6819/3886336279] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f14d41021c0 con 0x7f14bc0ace80 2024-09-19T06:13:47.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.772+0000 7f14d27fc640 1 -- 172.21.15.2:0/3277651302 <== osd.6 v2:172.21.15.2:6818/3886336279 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f14d41021c0 con 0x7f14bc0ace80 2024-09-19T06:13:47.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.772+0000 7f14db2f6640 1 -- 172.21.15.2:0/3277651302 >> [v2:172.21.15.2:6818/3886336279,v1:172.21.15.2:6819/3886336279] conn(0x7f14bc0ace80 msgr2=0x7f14bc0af320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:47.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.772+0000 7f14db2f6640 1 --2- 172.21.15.2:0/3277651302 >> [v2:172.21.15.2:6818/3886336279,v1:172.21.15.2:6819/3886336279] conn(0x7f14bc0ace80 0x7f14bc0af320 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:47.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.772+0000 7f14db2f6640 1 -- 172.21.15.2:0/3277651302 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f14bc0a32d0 msgr2=0x7f14bc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:47.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.772+0000 7f14db2f6640 1 --2- 172.21.15.2:0/3277651302 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f14bc0a32d0 0x7f14bc0a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f14c4006010 tx=0x7f14c40099c0 comp rx=0 tx=0).stop 2024-09-19T06:13:47.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.772+0000 7f14db2f6640 1 -- 172.21.15.2:0/3277651302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14d4106a80 msgr2=0x7f14d419cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:47.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.772+0000 7f14db2f6640 1 --2- 172.21.15.2:0/3277651302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14d4106a80 0x7f14d419cc60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f14cc00d950 tx=0x7f14cc00de10 comp rx=0 tx=0).stop 2024-09-19T06:13:47.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.772+0000 7f14d9893640 1 -- 172.21.15.2:0/3277651302 reap_dead start 2024-09-19T06:13:47.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.772+0000 7f14db2f6640 1 -- 172.21.15.2:0/3277651302 shutdown_connections 2024-09-19T06:13:47.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.772+0000 7f14db2f6640 1 -- 172.21.15.2:0/3277651302 >> 172.21.15.2:0/3277651302 conn(0x7f14d40fc7a0 msgr2=0x7f14d406a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:47.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.772+0000 7f14db2f6640 1 -- 172.21.15.2:0/3277651302 shutdown_connections 2024-09-19T06:13:47.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:47.773+0000 7f14db2f6640 1 -- 172.21.15.2:0/3277651302 wait complete. 2024-09-19T06:13:48.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:47 smithi002 ceph-mon[30982]: pgmap v298: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-19T06:13:48.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:47 smithi090 ceph-mon[34497]: pgmap v298: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-19T06:13:48.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:47 smithi089 ceph-mon[34160]: pgmap v298: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-19T06:13:48.669 INFO:teuthology.orchestra.run.smithi002.stdout:201863462953 2024-09-19T06:13:48.670 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-19T06:13:48.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.947+0000 7f443b559640 1 -- 172.21.15.2:0/396348105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4434101de0 msgr2=0x7f44341021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:48.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.947+0000 7f443b559640 1 --2- 172.21.15.2:0/396348105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4434101de0 0x7f44341021c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4424009ca0 tx=0x7f442402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:13:48.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.947+0000 7f443b559640 1 -- 172.21.15.2:0/396348105 shutdown_connections 2024-09-19T06:13:48.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.947+0000 7f443b559640 1 --2- 172.21.15.2:0/396348105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4434106f10 0x7f443410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:48.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.947+0000 7f443b559640 1 --2- 172.21.15.2:0/396348105 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4434102790 0x7f44341067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:48.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.947+0000 7f443b559640 1 --2- 172.21.15.2:0/396348105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4434101de0 0x7f44341021c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:48.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.947+0000 7f443b559640 1 -- 172.21.15.2:0/396348105 >> 172.21.15.2:0/396348105 conn(0x7f44340fd8c0 msgr2=0x7f44340ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:48.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.947+0000 7f443b559640 1 -- 172.21.15.2:0/396348105 shutdown_connections 2024-09-19T06:13:48.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.947+0000 7f443b559640 1 -- 172.21.15.2:0/396348105 wait complete. 2024-09-19T06:13:48.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.947+0000 7f443b559640 1 Processor -- start 2024-09-19T06:13:48.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.948+0000 7f443b559640 1 -- start start 2024-09-19T06:13:48.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.948+0000 7f443b559640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4434101de0 0x7f44340744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:48.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.948+0000 7f443b559640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4434102790 0x7f4434074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:48.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.948+0000 7f443b559640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4434106f10 0x7f4434074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:48.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.948+0000 7f443b559640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4434111e40 con 0x7f4434102790 2024-09-19T06:13:48.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.948+0000 7f443b559640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4434111cc0 con 0x7f4434101de0 2024-09-19T06:13:48.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.948+0000 7f443b559640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4434111fc0 con 0x7f4434106f10 2024-09-19T06:13:48.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.948+0000 7f4438af4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4434102790 0x7f4434074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:48.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.948+0000 7f4438af4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4434102790 0x7f4434074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57792/0 (socket says 172.21.15.2:57792) 2024-09-19T06:13:48.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.948+0000 7f44392f5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4434101de0 0x7f44340744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:48.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.948+0000 7f4438af4640 1 -- 172.21.15.2:0/624227556 learned_addr learned my addr 172.21.15.2:0/624227556 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:13:48.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.948+0000 7f4439af6640 1 --2- 172.21.15.2:0/624227556 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4434106f10 0x7f4434074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:48.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.948+0000 7f4438af4640 1 -- 172.21.15.2:0/624227556 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4434106f10 msgr2=0x7f4434074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:48.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.948+0000 7f4438af4640 1 --2- 172.21.15.2:0/624227556 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4434106f10 0x7f4434074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:48.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.948+0000 7f4438af4640 1 -- 172.21.15.2:0/624227556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4434101de0 msgr2=0x7f44340744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:48.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.948+0000 7f4438af4640 1 --2- 172.21.15.2:0/624227556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4434101de0 0x7f44340744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:48.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.948+0000 7f4438af4640 1 -- 172.21.15.2:0/624227556 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44341a68a0 con 0x7f4434102790 2024-09-19T06:13:48.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.948+0000 7f4438af4640 1 --2- 172.21.15.2:0/624227556 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4434102790 0x7f4434074a30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f442800b4a0 tx=0x7f442800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:48.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.949+0000 7f44327fc640 1 -- 172.21.15.2:0/624227556 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4428014070 con 0x7f4434102790 2024-09-19T06:13:48.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.949+0000 7f44327fc640 1 -- 172.21.15.2:0/624227556 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4428010ac0 con 0x7f4434102790 2024-09-19T06:13:48.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.949+0000 7f443b559640 1 -- 172.21.15.2:0/624227556 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44341a6b90 con 0x7f4434102790 2024-09-19T06:13:48.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.949+0000 7f44327fc640 1 -- 172.21.15.2:0/624227556 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4428017c30 con 0x7f4434102790 2024-09-19T06:13:48.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.949+0000 7f443b559640 1 -- 172.21.15.2:0/624227556 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44341a7120 con 0x7f4434102790 2024-09-19T06:13:48.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.949+0000 7f443b559640 1 -- 172.21.15.2:0/624227556 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4434062880 con 0x7f4434102790 2024-09-19T06:13:48.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.951+0000 7f44327fc640 1 -- 172.21.15.2:0/624227556 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f4428017070 con 0x7f4434102790 2024-09-19T06:13:48.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.951+0000 7f44327fc640 1 --2- 172.21.15.2:0/624227556 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f441c0a3350 0x7f441c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:48.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.952+0000 7f44392f5640 1 --2- 172.21.15.2:0/624227556 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f441c0a3350 0x7f441c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:48.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.952+0000 7f44327fc640 1 -- 172.21.15.2:0/624227556 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f44280cefb0 con 0x7f4434102790 2024-09-19T06:13:48.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.952+0000 7f44327fc640 1 --2- 172.21.15.2:0/624227556 >> [v2:172.21.15.2:6810/1796948193,v1:172.21.15.2:6811/1796948193] conn(0x7f441c0acf00 0x7f441c0af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:48.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.952+0000 7f44327fc640 1 -- 172.21.15.2:0/624227556 --> [v2:172.21.15.2:6810/1796948193,v1:172.21.15.2:6811/1796948193] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f441c0afa70 con 0x7f441c0acf00 2024-09-19T06:13:48.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.952+0000 7f44327fc640 1 -- 172.21.15.2:0/624227556 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f44280cf400 con 0x7f4434102790 2024-09-19T06:13:48.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.952+0000 7f4439af6640 1 --2- 172.21.15.2:0/624227556 >> [v2:172.21.15.2:6810/1796948193,v1:172.21.15.2:6811/1796948193] conn(0x7f441c0acf00 0x7f441c0af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:48.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.952+0000 7f44392f5640 1 --2- 172.21.15.2:0/624227556 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f441c0a3350 0x7f441c0a5810 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4424009a60 tx=0x7f4424031000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:48.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.952+0000 7f4439af6640 1 --2- 172.21.15.2:0/624227556 >> [v2:172.21.15.2:6810/1796948193,v1:172.21.15.2:6811/1796948193] conn(0x7f441c0acf00 0x7f441c0af3a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:48.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.953+0000 7f44327fc640 1 -- 172.21.15.2:0/624227556 <== osd.3 v2:172.21.15.2:6810/1796948193 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f441c0afa70 con 0x7f441c0acf00 2024-09-19T06:13:48.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.967+0000 7f443b559640 1 -- 172.21.15.2:0/624227556 --> [v2:172.21.15.2:6810/1796948193,v1:172.21.15.2:6811/1796948193] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4434062c80 con 0x7f441c0acf00 2024-09-19T06:13:48.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.967+0000 7f44327fc640 1 -- 172.21.15.2:0/624227556 <== osd.3 v2:172.21.15.2:6810/1796948193 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4434062c80 con 0x7f441c0acf00 2024-09-19T06:13:48.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.967+0000 7f443b559640 1 -- 172.21.15.2:0/624227556 >> [v2:172.21.15.2:6810/1796948193,v1:172.21.15.2:6811/1796948193] conn(0x7f441c0acf00 msgr2=0x7f441c0af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:48.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.967+0000 7f443b559640 1 --2- 172.21.15.2:0/624227556 >> [v2:172.21.15.2:6810/1796948193,v1:172.21.15.2:6811/1796948193] conn(0x7f441c0acf00 0x7f441c0af3a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:48.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.967+0000 7f443b559640 1 -- 172.21.15.2:0/624227556 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f441c0a3350 msgr2=0x7f441c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:48.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.967+0000 7f443b559640 1 --2- 172.21.15.2:0/624227556 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f441c0a3350 0x7f441c0a5810 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4424009a60 tx=0x7f4424031000 comp rx=0 tx=0).stop 2024-09-19T06:13:48.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.967+0000 7f443b559640 1 -- 172.21.15.2:0/624227556 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4434102790 msgr2=0x7f4434074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:48.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.967+0000 7f443b559640 1 --2- 172.21.15.2:0/624227556 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4434102790 0x7f4434074a30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f442800b4a0 tx=0x7f442800b960 comp rx=0 tx=0).stop 2024-09-19T06:13:48.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.967+0000 7f4439af6640 1 -- 172.21.15.2:0/624227556 reap_dead start 2024-09-19T06:13:48.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.967+0000 7f443b559640 1 -- 172.21.15.2:0/624227556 shutdown_connections 2024-09-19T06:13:48.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.967+0000 7f443b559640 1 -- 172.21.15.2:0/624227556 >> 172.21.15.2:0/624227556 conn(0x7f44340fd8c0 msgr2=0x7f44340fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:48.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.968+0000 7f443b559640 1 -- 172.21.15.2:0/624227556 shutdown_connections 2024-09-19T06:13:48.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:46.968+0000 7f443b559640 1 -- 172.21.15.2:0/624227556 wait complete. 2024-09-19T06:13:49.676 INFO:teuthology.orchestra.run.smithi002.stdout:184683593775 2024-09-19T06:13:49.676 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-19T06:13:50.194 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:49 smithi002 ceph-mon[30982]: pgmap v299: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-09-19T06:13:50.227 INFO:teuthology.orchestra.run.smithi002.stdout:154618822707 2024-09-19T06:13:50.228 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-19T06:13:50.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:49 smithi090 ceph-mon[34497]: pgmap v299: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-09-19T06:13:50.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:49 smithi089 ceph-mon[34160]: pgmap v299: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-09-19T06:13:50.681 INFO:teuthology.orchestra.run.smithi002.stdout:283467841562 2024-09-19T06:13:50.682 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-19T06:13:51.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.015+0000 7f7c2b371640 1 -- 172.21.15.2:0/1302034372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c24100e20 msgr2=0x7f7c24101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:51.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.015+0000 7f7c2b371640 1 --2- 172.21.15.2:0/1302034372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c24100e20 0x7f7c24101200 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7c20009900 tx=0x7f7c2002a480 comp rx=0 tx=0).stop 2024-09-19T06:13:51.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.015+0000 7f7c2b371640 1 -- 172.21.15.2:0/1302034372 shutdown_connections 2024-09-19T06:13:51.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.015+0000 7f7c2b371640 1 --2- 172.21.15.2:0/1302034372 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c24102ef0 0x7f7c2410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:51.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.015+0000 7f7c2b371640 1 --2- 172.21.15.2:0/1302034372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c24102570 0x7f7c241029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:51.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.015+0000 7f7c2b371640 1 --2- 172.21.15.2:0/1302034372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c24100e20 0x7f7c24101200 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:51.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.015+0000 7f7c2b371640 1 -- 172.21.15.2:0/1302034372 >> 172.21.15.2:0/1302034372 conn(0x7f7c240fc7d0 msgr2=0x7f7c240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:51.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.015+0000 7f7c2b371640 1 -- 172.21.15.2:0/1302034372 shutdown_connections 2024-09-19T06:13:51.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.015+0000 7f7c2b371640 1 -- 172.21.15.2:0/1302034372 wait complete. 2024-09-19T06:13:51.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.015+0000 7f7c2b371640 1 Processor -- start 2024-09-19T06:13:51.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.016+0000 7f7c2b371640 1 -- start start 2024-09-19T06:13:51.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.016+0000 7f7c2b371640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c24100e20 0x7f7c24198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:51.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.016+0000 7f7c2b371640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c24102570 0x7f7c24198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:51.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.016+0000 7f7c2b371640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c24102ef0 0x7f7c2419cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:51.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.016+0000 7f7c2b371640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7c24111f50 con 0x7f7c24102ef0 2024-09-19T06:13:51.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.016+0000 7f7c2b371640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7c24111dd0 con 0x7f7c24102570 2024-09-19T06:13:51.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.016+0000 7f7c2b371640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7c241120d0 con 0x7f7c24100e20 2024-09-19T06:13:51.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.016+0000 7f7c2990e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c24102ef0 0x7f7c2419cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:51.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.016+0000 7f7c2910d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c24100e20 0x7f7c24198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:51.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.016+0000 7f7c2990e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c24102ef0 0x7f7c2419cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57840/0 (socket says 172.21.15.2:57840) 2024-09-19T06:13:51.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.016+0000 7f7c2990e640 1 -- 172.21.15.2:0/1830534836 learned_addr learned my addr 172.21.15.2:0/1830534836 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:13:51.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.016+0000 7f7c2890c640 1 --2- 172.21.15.2:0/1830534836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c24102570 0x7f7c24198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:51.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.016+0000 7f7c2990e640 1 -- 172.21.15.2:0/1830534836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c24100e20 msgr2=0x7f7c24198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:51.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.016+0000 7f7c2990e640 1 --2- 172.21.15.2:0/1830534836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c24100e20 0x7f7c24198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:51.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.016+0000 7f7c2990e640 1 -- 172.21.15.2:0/1830534836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c24102570 msgr2=0x7f7c24198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:51.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.016+0000 7f7c2990e640 1 --2- 172.21.15.2:0/1830534836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c24102570 0x7f7c24198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:51.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.016+0000 7f7c2990e640 1 -- 172.21.15.2:0/1830534836 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c2419d400 con 0x7f7c24102ef0 2024-09-19T06:13:51.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.016+0000 7f7c2990e640 1 --2- 172.21.15.2:0/1830534836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c24102ef0 0x7f7c2419cd20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c00eaa0 tx=0x7f7c1c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:51.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.017+0000 7f7c1a7fc640 1 -- 172.21.15.2:0/1830534836 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c00cdb0 con 0x7f7c24102ef0 2024-09-19T06:13:51.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.017+0000 7f7c1a7fc640 1 -- 172.21.15.2:0/1830534836 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7c1c005020 con 0x7f7c24102ef0 2024-09-19T06:13:51.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.017+0000 7f7c2b371640 1 -- 172.21.15.2:0/1830534836 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c2419d6f0 con 0x7f7c24102ef0 2024-09-19T06:13:51.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.017+0000 7f7c1a7fc640 1 -- 172.21.15.2:0/1830534836 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c0116d0 con 0x7f7c24102ef0 2024-09-19T06:13:51.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.017+0000 7f7c2b371640 1 -- 172.21.15.2:0/1830534836 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c241a4fd0 con 0x7f7c24102ef0 2024-09-19T06:13:51.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.017+0000 7f7c2b371640 1 -- 172.21.15.2:0/1830534836 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7c24062940 con 0x7f7c24102ef0 2024-09-19T06:13:51.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.019+0000 7f7c1a7fc640 1 -- 172.21.15.2:0/1830534836 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f7c1c0051d0 con 0x7f7c24102ef0 2024-09-19T06:13:51.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.019+0000 7f7c1a7fc640 1 --2- 172.21.15.2:0/1830534836 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f7c100a32d0 0x7f7c100a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:51.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.019+0000 7f7c2910d640 1 --2- 172.21.15.2:0/1830534836 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f7c100a32d0 0x7f7c100a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:51.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.020+0000 7f7c1a7fc640 1 -- 172.21.15.2:0/1830534836 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f7c1c0cff70 con 0x7f7c24102ef0 2024-09-19T06:13:51.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.020+0000 7f7c1a7fc640 1 --2- 172.21.15.2:0/1830534836 >> [v2:172.21.15.90:6824/468380924,v1:172.21.15.90:6825/468380924] conn(0x7f7c100ace80 0x7f7c100af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:51.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.020+0000 7f7c1a7fc640 1 -- 172.21.15.2:0/1830534836 --> [v2:172.21.15.90:6824/468380924,v1:172.21.15.90:6825/468380924] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7c1c014ec0 con 0x7f7c100ace80 2024-09-19T06:13:51.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.020+0000 7f7c1a7fc640 1 -- 172.21.15.2:0/1830534836 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f7c1c0d03c0 con 0x7f7c24102ef0 2024-09-19T06:13:51.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.020+0000 7f7c2910d640 1 --2- 172.21.15.2:0/1830534836 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f7c100a32d0 0x7f7c100a5790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7c20009230 tx=0x7f7c200058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:51.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.020+0000 7f7c2890c640 1 --2- 172.21.15.2:0/1830534836 >> [v2:172.21.15.90:6824/468380924,v1:172.21.15.90:6825/468380924] conn(0x7f7c100ace80 0x7f7c100af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:51.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.020+0000 7f7c2890c640 1 --2- 172.21.15.2:0/1830534836 >> [v2:172.21.15.90:6824/468380924,v1:172.21.15.90:6825/468380924] conn(0x7f7c100ace80 0x7f7c100af320 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:51.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.021+0000 7f7c1a7fc640 1 -- 172.21.15.2:0/1830534836 <== osd.11 v2:172.21.15.90:6824/468380924 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7c1c014ec0 con 0x7f7c100ace80 2024-09-19T06:13:51.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.038+0000 7f7c2b371640 1 -- 172.21.15.2:0/1830534836 --> [v2:172.21.15.90:6824/468380924,v1:172.21.15.90:6825/468380924] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7c24062dc0 con 0x7f7c100ace80 2024-09-19T06:13:51.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.039+0000 7f7c1a7fc640 1 -- 172.21.15.2:0/1830534836 <== osd.11 v2:172.21.15.90:6824/468380924 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7c24062dc0 con 0x7f7c100ace80 2024-09-19T06:13:51.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.039+0000 7f7c2b371640 1 -- 172.21.15.2:0/1830534836 >> [v2:172.21.15.90:6824/468380924,v1:172.21.15.90:6825/468380924] conn(0x7f7c100ace80 msgr2=0x7f7c100af320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:51.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.039+0000 7f7c2b371640 1 --2- 172.21.15.2:0/1830534836 >> [v2:172.21.15.90:6824/468380924,v1:172.21.15.90:6825/468380924] conn(0x7f7c100ace80 0x7f7c100af320 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:51.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.039+0000 7f7c2b371640 1 -- 172.21.15.2:0/1830534836 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f7c100a32d0 msgr2=0x7f7c100a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:51.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.039+0000 7f7c2b371640 1 --2- 172.21.15.2:0/1830534836 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f7c100a32d0 0x7f7c100a5790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7c20009230 tx=0x7f7c200058d0 comp rx=0 tx=0).stop 2024-09-19T06:13:51.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.039+0000 7f7c2b371640 1 -- 172.21.15.2:0/1830534836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c24102ef0 msgr2=0x7f7c2419cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:51.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.039+0000 7f7c2b371640 1 --2- 172.21.15.2:0/1830534836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c24102ef0 0x7f7c2419cd20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c00eaa0 tx=0x7f7c1c00ef60 comp rx=0 tx=0).stop 2024-09-19T06:13:51.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.039+0000 7f7c2990e640 1 -- 172.21.15.2:0/1830534836 reap_dead start 2024-09-19T06:13:51.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.039+0000 7f7c2b371640 1 -- 172.21.15.2:0/1830534836 shutdown_connections 2024-09-19T06:13:51.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.039+0000 7f7c2b371640 1 -- 172.21.15.2:0/1830534836 >> 172.21.15.2:0/1830534836 conn(0x7f7c240fc7d0 msgr2=0x7f7c240febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:51.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.040+0000 7f7c2b371640 1 -- 172.21.15.2:0/1830534836 shutdown_connections 2024-09-19T06:13:51.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:51.040+0000 7f7c2b371640 1 -- 172.21.15.2:0/1830534836 wait complete. 2024-09-19T06:13:51.548 INFO:teuthology.orchestra.run.smithi002.stdout:231928234021 2024-09-19T06:13:51.548 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-19T06:13:51.948 INFO:teuthology.orchestra.run.smithi002.stdout:34359738444 2024-09-19T06:13:51.948 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-19T06:13:52.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:51 smithi002 ceph-mon[30982]: pgmap v300: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-19T06:13:52.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:51 smithi090 ceph-mon[34497]: pgmap v300: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-19T06:13:52.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:51 smithi089 ceph-mon[34160]: pgmap v300: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-19T06:13:52.424 INFO:teuthology.orchestra.run.smithi002.stdout:103079215166 2024-09-19T06:13:52.424 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-19T06:13:52.669 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:52.673 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:53.063 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:53.099 INFO:teuthology.orchestra.run.smithi002.stdout:313532612630 2024-09-19T06:13:53.100 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-19T06:13:53.108 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:53.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:53.899+0000 7fdb2c0ef640 1 -- 172.21.15.2:0/2150077795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb24100a80 msgr2=0x7fdb24100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:53.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:53.899+0000 7fdb2c0ef640 1 --2- 172.21.15.2:0/2150077795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb24100a80 0x7fdb24100ee0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fdb14009930 tx=0x7fdb1402a420 comp rx=0 tx=0).stop 2024-09-19T06:13:53.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:53.899+0000 7fdb2c0ef640 1 -- 172.21.15.2:0/2150077795 shutdown_connections 2024-09-19T06:13:53.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:53.899+0000 7fdb2c0ef640 1 --2- 172.21.15.2:0/2150077795 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb24101420 0x7fdb2410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:53.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:53.899+0000 7fdb2c0ef640 1 --2- 172.21.15.2:0/2150077795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb24100a80 0x7fdb24100ee0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:53.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:53.899+0000 7fdb2c0ef640 1 --2- 172.21.15.2:0/2150077795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb24106a80 0x7fdb24106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:53.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:53.899+0000 7fdb2c0ef640 1 -- 172.21.15.2:0/2150077795 >> 172.21.15.2:0/2150077795 conn(0x7fdb240fc7a0 msgr2=0x7fdb240febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:53.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:53.899+0000 7fdb2c0ef640 1 -- 172.21.15.2:0/2150077795 shutdown_connections 2024-09-19T06:13:53.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:53.899+0000 7fdb2c0ef640 1 -- 172.21.15.2:0/2150077795 wait complete. 2024-09-19T06:13:53.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:53.900+0000 7fdb2c0ef640 1 Processor -- start 2024-09-19T06:13:53.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:53.900+0000 7fdb2c0ef640 1 -- start start 2024-09-19T06:13:53.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:53.900+0000 7fdb2c0ef640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb24100a80 0x7fdb241991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:53.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:53.900+0000 7fdb2c0ef640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb24101420 0x7fdb24199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:53.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:53.900+0000 7fdb2c0ef640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb24106a80 0x7fdb241a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:53.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:53.900+0000 7fdb2c0ef640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdb24110d30 con 0x7fdb24101420 2024-09-19T06:13:53.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:53.900+0000 7fdb2c0ef640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fdb24110bb0 con 0x7fdb24100a80 2024-09-19T06:13:53.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:53.900+0000 7fdb2c0ef640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdb24110eb0 con 0x7fdb24106a80 2024-09-19T06:13:53.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:53.900+0000 7fdb2968a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb24101420 0x7fdb24199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:53.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:53.900+0000 7fdb2968a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb24101420 0x7fdb24199700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57864/0 (socket says 172.21.15.2:57864) 2024-09-19T06:13:53.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:53.900+0000 7fdb2968a640 1 -- 172.21.15.2:0/1077456263 learned_addr learned my addr 172.21.15.2:0/1077456263 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:13:53.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:53.901+0000 7fdb29e8b640 1 --2- 172.21.15.2:0/1077456263 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb24100a80 0x7fdb241991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:53.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:53.901+0000 7fdb2a68c640 1 --2- 172.21.15.2:0/1077456263 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb24106a80 0x7fdb241a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:53.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:53.901+0000 7fdb2968a640 1 -- 172.21.15.2:0/1077456263 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb24106a80 msgr2=0x7fdb241a4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:53.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:53.901+0000 7fdb2968a640 1 --2- 172.21.15.2:0/1077456263 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb24106a80 0x7fdb241a4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:53.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:53.901+0000 7fdb2968a640 1 -- 172.21.15.2:0/1077456263 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb24100a80 msgr2=0x7fdb241991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:53.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:53.901+0000 7fdb2968a640 1 --2- 172.21.15.2:0/1077456263 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb24100a80 0x7fdb241991c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:53.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:53.901+0000 7fdb2968a640 1 -- 172.21.15.2:0/1077456263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb241a4780 con 0x7fdb24101420 2024-09-19T06:13:53.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:53.901+0000 7fdb2968a640 1 --2- 172.21.15.2:0/1077456263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb24101420 0x7fdb24199700 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdb14005940 tx=0x7fdb140042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:53.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:53.901+0000 7fdb1affd640 1 -- 172.21.15.2:0/1077456263 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb1403f030 con 0x7fdb24101420 2024-09-19T06:13:53.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:53.901+0000 7fdb1affd640 1 -- 172.21.15.2:0/1077456263 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdb14003cb0 con 0x7fdb24101420 2024-09-19T06:13:53.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:53.901+0000 7fdb2c0ef640 1 -- 172.21.15.2:0/1077456263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb241a4950 con 0x7fdb24101420 2024-09-19T06:13:53.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:53.901+0000 7fdb1affd640 1 -- 172.21.15.2:0/1077456263 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb14035070 con 0x7fdb24101420 2024-09-19T06:13:53.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:53.901+0000 7fdb2c0ef640 1 -- 172.21.15.2:0/1077456263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb241a4e00 con 0x7fdb24101420 2024-09-19T06:13:53.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:53.902+0000 7fdb2c0ef640 1 -- 172.21.15.2:0/1077456263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb24100ee0 con 0x7fdb24101420 2024-09-19T06:13:53.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:53.904+0000 7fdb1affd640 1 -- 172.21.15.2:0/1077456263 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fdb14042030 con 0x7fdb24101420 2024-09-19T06:13:53.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:53.904+0000 7fdb1affd640 1 --2- 172.21.15.2:0/1077456263 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fdb100a3350 0x7fdb100a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:53.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:53.904+0000 7fdb29e8b640 1 --2- 172.21.15.2:0/1077456263 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fdb100a3350 0x7fdb100a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:53.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:53.904+0000 7fdb1affd640 1 -- 172.21.15.2:0/1077456263 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7fdb140f0070 con 0x7fdb24101420 2024-09-19T06:13:53.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:53.905+0000 7fdb29e8b640 1 --2- 172.21.15.2:0/1077456263 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fdb100a3350 0x7fdb100a5810 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdb2000cac0 tx=0x7fdb2000c4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:53.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:53.909+0000 7fdb1affd640 1 -- 172.21.15.2:0/1077456263 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdb140bcbe0 con 0x7fdb24101420 2024-09-19T06:13:54.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.092+0000 7fdb2c0ef640 1 -- 172.21.15.2:0/1077456263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fdb24108a80 con 0x7fdb24101420 2024-09-19T06:13:54.094 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:53 smithi002 ceph-mon[30982]: pgmap v301: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:13:54.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.092+0000 7fdb1affd640 1 -- 172.21.15.2:0/1077456263 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fdb140bc4e0 con 0x7fdb24101420 2024-09-19T06:13:54.094 INFO:teuthology.orchestra.run.smithi002.stdout:133143986234 2024-09-19T06:13:54.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.094+0000 7fdb2c0ef640 1 -- 172.21.15.2:0/1077456263 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fdb100a3350 msgr2=0x7fdb100a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:54.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.094+0000 7fdb2c0ef640 1 --2- 172.21.15.2:0/1077456263 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fdb100a3350 0x7fdb100a5810 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdb2000cac0 tx=0x7fdb2000c4a0 comp rx=0 tx=0).stop 2024-09-19T06:13:54.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.094+0000 7fdb2c0ef640 1 -- 172.21.15.2:0/1077456263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb24101420 msgr2=0x7fdb24199700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:54.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.094+0000 7fdb2c0ef640 1 --2- 172.21.15.2:0/1077456263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb24101420 0x7fdb24199700 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdb14005940 tx=0x7fdb140042f0 comp rx=0 tx=0).stop 2024-09-19T06:13:54.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.094+0000 7fdb2c0ef640 1 -- 172.21.15.2:0/1077456263 shutdown_connections 2024-09-19T06:13:54.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.094+0000 7fdb2c0ef640 1 --2- 172.21.15.2:0/1077456263 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fdb100a3350 0x7fdb100a5810 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:54.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.094+0000 7fdb2c0ef640 1 --2- 172.21.15.2:0/1077456263 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb24106a80 0x7fdb241a4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:54.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.094+0000 7fdb2c0ef640 1 --2- 172.21.15.2:0/1077456263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb24101420 0x7fdb24199700 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:54.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.094+0000 7fdb2c0ef640 1 --2- 172.21.15.2:0/1077456263 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb24100a80 0x7fdb241991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:54.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.095+0000 7fdb2c0ef640 1 -- 172.21.15.2:0/1077456263 >> 172.21.15.2:0/1077456263 conn(0x7fdb240fc7a0 msgr2=0x7fdb240fcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:54.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.095+0000 7fdb2c0ef640 1 -- 172.21.15.2:0/1077456263 shutdown_connections 2024-09-19T06:13:54.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.095+0000 7fdb2c0ef640 1 -- 172.21.15.2:0/1077456263 wait complete. 2024-09-19T06:13:54.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:53 smithi090 ceph-mon[34497]: pgmap v301: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:13:54.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:53 smithi089 ceph-mon[34160]: pgmap v301: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:13:54.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.361+0000 7f6324d13640 1 -- 172.21.15.2:0/1561076836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63201036c0 msgr2=0x7f632010bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:54.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.361+0000 7f6324d13640 1 --2- 172.21.15.2:0/1561076836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63201036c0 0x7f632010bbb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6308009900 tx=0x7f630802a480 comp rx=0 tx=0).stop 2024-09-19T06:13:54.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.361+0000 7f6324d13640 1 -- 172.21.15.2:0/1561076836 shutdown_connections 2024-09-19T06:13:54.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.361+0000 7f6324d13640 1 --2- 172.21.15.2:0/1561076836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f632010c180 0x7f632010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:54.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.361+0000 7f6324d13640 1 --2- 172.21.15.2:0/1561076836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63201036c0 0x7f632010bbb0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:54.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.361+0000 7f6324d13640 1 --2- 172.21.15.2:0/1561076836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6320102da0 0x7f6320103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:54.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.361+0000 7f6324d13640 1 -- 172.21.15.2:0/1561076836 >> 172.21.15.2:0/1561076836 conn(0x7f63200fc7a0 msgr2=0x7f63200febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:54.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.361+0000 7f6324d13640 1 -- 172.21.15.2:0/1561076836 shutdown_connections 2024-09-19T06:13:54.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.362+0000 7f6324d13640 1 -- 172.21.15.2:0/1561076836 wait complete. 2024-09-19T06:13:54.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.362+0000 7f6324d13640 1 Processor -- start 2024-09-19T06:13:54.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.362+0000 7f6324d13640 1 -- start start 2024-09-19T06:13:54.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.363+0000 7f6324d13640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6320102da0 0x7f6320100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:54.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.363+0000 7f6324d13640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63201036c0 0x7f6320100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:54.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.363+0000 7f6324d13640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f632010c180 0x7f6320101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:54.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.363+0000 7f6324d13640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6320111e10 con 0x7f6320102da0 2024-09-19T06:13:54.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.363+0000 7f631e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6320102da0 0x7f6320100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:54.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.363+0000 7f631e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6320102da0 0x7f6320100a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57880/0 (socket says 172.21.15.2:57880) 2024-09-19T06:13:54.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.363+0000 7f631dd9b640 1 --2- 172.21.15.2:0/125646123 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63201036c0 0x7f6320100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:54.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.363+0000 7f631e59c640 1 -- 172.21.15.2:0/125646123 learned_addr learned my addr 172.21.15.2:0/125646123 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:13:54.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.363+0000 7f631ed9d640 1 --2- 172.21.15.2:0/125646123 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f632010c180 0x7f6320101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:54.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.363+0000 7f6324d13640 1 -- 172.21.15.2:0/125646123 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6320111c90 con 0x7f632010c180 2024-09-19T06:13:54.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.363+0000 7f6324d13640 1 -- 172.21.15.2:0/125646123 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6320111f90 con 0x7f63201036c0 2024-09-19T06:13:54.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.363+0000 7f631e59c640 1 -- 172.21.15.2:0/125646123 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63201036c0 msgr2=0x7f6320100f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:54.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.363+0000 7f631e59c640 1 --2- 172.21.15.2:0/125646123 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63201036c0 0x7f6320100f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:54.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.363+0000 7f631e59c640 1 -- 172.21.15.2:0/125646123 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f632010c180 msgr2=0x7f6320101480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:54.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.363+0000 7f631e59c640 1 --2- 172.21.15.2:0/125646123 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f632010c180 0x7f6320101480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:54.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.363+0000 7f631e59c640 1 -- 172.21.15.2:0/125646123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63201a6830 con 0x7f6320102da0 2024-09-19T06:13:54.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.364+0000 7f631e59c640 1 --2- 172.21.15.2:0/125646123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6320102da0 0x7f6320100a00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f631000db80 tx=0x7f631000b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:54.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.364+0000 7f63177fe640 1 -- 172.21.15.2:0/125646123 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6310017070 con 0x7f6320102da0 2024-09-19T06:13:54.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.364+0000 7f6324d13640 1 -- 172.21.15.2:0/125646123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63201a6b20 con 0x7f6320102da0 2024-09-19T06:13:54.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.364+0000 7f63177fe640 1 -- 172.21.15.2:0/125646123 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6310003b70 con 0x7f6320102da0 2024-09-19T06:13:54.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.364+0000 7f63177fe640 1 -- 172.21.15.2:0/125646123 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6310010480 con 0x7f6320102da0 2024-09-19T06:13:54.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.364+0000 7f6324d13640 1 -- 172.21.15.2:0/125646123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63201a7080 con 0x7f6320102da0 2024-09-19T06:13:54.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.365+0000 7f6324d13640 1 -- 172.21.15.2:0/125646123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6320103180 con 0x7f6320102da0 2024-09-19T06:13:54.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.366+0000 7f63177fe640 1 -- 172.21.15.2:0/125646123 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f6310004020 con 0x7f6320102da0 2024-09-19T06:13:54.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.367+0000 7f63177fe640 1 --2- 172.21.15.2:0/125646123 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f630c0a32d0 0x7f630c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:54.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.367+0000 7f63177fe640 1 -- 172.21.15.2:0/125646123 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f63100cfab0 con 0x7f6320102da0 2024-09-19T06:13:54.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.367+0000 7f631dd9b640 1 --2- 172.21.15.2:0/125646123 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f630c0a32d0 0x7f630c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:54.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.368+0000 7f631dd9b640 1 --2- 172.21.15.2:0/125646123 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f630c0a32d0 0x7f630c0a5790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6308031440 tx=0x7f6308005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:54.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.371+0000 7f63177fe640 1 -- 172.21.15.2:0/125646123 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f631009c680 con 0x7f6320102da0 2024-09-19T06:13:54.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.549+0000 7f6324d13640 1 -- 172.21.15.2:0/125646123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f63201071c0 con 0x7f6320102da0 2024-09-19T06:13:54.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.549+0000 7f63177fe640 1 -- 172.21.15.2:0/125646123 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f631009bf80 con 0x7f6320102da0 2024-09-19T06:13:54.551 INFO:teuthology.orchestra.run.smithi002.stdout:73014444100 2024-09-19T06:13:54.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.551+0000 7f6324d13640 1 -- 172.21.15.2:0/125646123 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f630c0a32d0 msgr2=0x7f630c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:54.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.551+0000 7f6324d13640 1 --2- 172.21.15.2:0/125646123 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f630c0a32d0 0x7f630c0a5790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6308031440 tx=0x7f6308005b50 comp rx=0 tx=0).stop 2024-09-19T06:13:54.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.551+0000 7f6324d13640 1 -- 172.21.15.2:0/125646123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6320102da0 msgr2=0x7f6320100a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:54.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.551+0000 7f6324d13640 1 --2- 172.21.15.2:0/125646123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6320102da0 0x7f6320100a00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f631000db80 tx=0x7f631000b630 comp rx=0 tx=0).stop 2024-09-19T06:13:54.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.551+0000 7f6324d13640 1 -- 172.21.15.2:0/125646123 shutdown_connections 2024-09-19T06:13:54.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.551+0000 7f6324d13640 1 --2- 172.21.15.2:0/125646123 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f630c0a32d0 0x7f630c0a5790 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:54.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.551+0000 7f6324d13640 1 --2- 172.21.15.2:0/125646123 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f632010c180 0x7f6320101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:54.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.551+0000 7f6324d13640 1 --2- 172.21.15.2:0/125646123 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63201036c0 0x7f6320100f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:54.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.551+0000 7f6324d13640 1 --2- 172.21.15.2:0/125646123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6320102da0 0x7f6320100a00 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:54.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.551+0000 7f6324d13640 1 -- 172.21.15.2:0/125646123 >> 172.21.15.2:0/125646123 conn(0x7f63200fc7a0 msgr2=0x7f63200fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:54.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.551+0000 7f6324d13640 1 -- 172.21.15.2:0/125646123 shutdown_connections 2024-09-19T06:13:54.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.551+0000 7f6324d13640 1 -- 172.21.15.2:0/125646123 wait complete. 2024-09-19T06:13:54.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.565+0000 7faec8a3c640 1 -- 172.21.15.2:0/3535952192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec4101dd0 msgr2=0x7faec41021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:54.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.565+0000 7faec8a3c640 1 --2- 172.21.15.2:0/3535952192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec4101dd0 0x7faec41021b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7faeb4009900 tx=0x7faeb402a410 comp rx=0 tx=0).stop 2024-09-19T06:13:54.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.565+0000 7faec8a3c640 1 -- 172.21.15.2:0/3535952192 shutdown_connections 2024-09-19T06:13:54.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.565+0000 7faec8a3c640 1 --2- 172.21.15.2:0/3535952192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faec4106f00 0x7faec410ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:54.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.565+0000 7faec8a3c640 1 --2- 172.21.15.2:0/3535952192 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faec4102780 0x7faec41067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:54.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.565+0000 7faec8a3c640 1 --2- 172.21.15.2:0/3535952192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec4101dd0 0x7faec41021b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:54.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.565+0000 7faec8a3c640 1 -- 172.21.15.2:0/3535952192 >> 172.21.15.2:0/3535952192 conn(0x7faec40fd8b0 msgr2=0x7faec40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:54.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.565+0000 7faec8a3c640 1 -- 172.21.15.2:0/3535952192 shutdown_connections 2024-09-19T06:13:54.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.565+0000 7faec8a3c640 1 -- 172.21.15.2:0/3535952192 wait complete. 2024-09-19T06:13:54.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.566+0000 7faec8a3c640 1 Processor -- start 2024-09-19T06:13:54.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.566+0000 7faec8a3c640 1 -- start start 2024-09-19T06:13:54.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.567+0000 7faec8a3c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec4101dd0 0x7faec4198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:54.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.567+0000 7faec8a3c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faec4102780 0x7faec41988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:54.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.567+0000 7faec8a3c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faec4106f00 0x7faec419cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:54.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.567+0000 7faec8a3c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faec4111e10 con 0x7faec4101dd0 2024-09-19T06:13:54.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.567+0000 7faec8a3c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7faec4111c90 con 0x7faec4102780 2024-09-19T06:13:54.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.567+0000 7faec8a3c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7faec4111f90 con 0x7faec4106f00 2024-09-19T06:13:54.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.567+0000 7faec259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec4101dd0 0x7faec4198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:54.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.567+0000 7faec2d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faec4106f00 0x7faec419cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:54.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.567+0000 7faec2d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faec4106f00 0x7faec419cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:41020/0 (socket says 172.21.15.2:41020) 2024-09-19T06:13:54.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.567+0000 7faec2d9d640 1 -- 172.21.15.2:0/3846536954 learned_addr learned my addr 172.21.15.2:0/3846536954 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:13:54.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.567+0000 7faebbfff640 1 --2- 172.21.15.2:0/3846536954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faec4102780 0x7faec41988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:54.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.567+0000 7faebbfff640 1 -- 172.21.15.2:0/3846536954 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faec4106f00 msgr2=0x7faec419cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:54.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.567+0000 7faebbfff640 1 --2- 172.21.15.2:0/3846536954 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faec4106f00 0x7faec419cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:54.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.567+0000 7faebbfff640 1 -- 172.21.15.2:0/3846536954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec4101dd0 msgr2=0x7faec4198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:54.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.567+0000 7faebbfff640 1 --2- 172.21.15.2:0/3846536954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec4101dd0 0x7faec4198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:54.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.567+0000 7faebbfff640 1 -- 172.21.15.2:0/3846536954 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec419d340 con 0x7faec4102780 2024-09-19T06:13:54.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.567+0000 7faec2d9d640 1 --2- 172.21.15.2:0/3846536954 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faec4106f00 0x7faec419cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:13:54.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.568+0000 7faebbfff640 1 --2- 172.21.15.2:0/3846536954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faec4102780 0x7faec41988d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faeac00e9f0 tx=0x7faeac00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:54.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.568+0000 7faebb7fe640 1 -- 172.21.15.2:0/3846536954 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeac00ccc0 con 0x7faec4102780 2024-09-19T06:13:54.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.568+0000 7faec8a3c640 1 -- 172.21.15.2:0/3846536954 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faec419d630 con 0x7faec4102780 2024-09-19T06:13:54.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.568+0000 7faebb7fe640 1 -- 172.21.15.2:0/3846536954 <== mon.2 v2:172.21.15.89:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7faeac005020 con 0x7faec4102780 2024-09-19T06:13:54.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.568+0000 7faebb7fe640 1 -- 172.21.15.2:0/3846536954 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeac004a00 con 0x7faec4102780 2024-09-19T06:13:54.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.568+0000 7faec8a3c640 1 -- 172.21.15.2:0/3846536954 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faec41a4f10 con 0x7faec4102780 2024-09-19T06:13:54.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.569+0000 7faec8a3c640 1 -- 172.21.15.2:0/3846536954 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faec41021b0 con 0x7faec4102780 2024-09-19T06:13:54.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.571+0000 7faebb7fe640 1 -- 172.21.15.2:0/3846536954 <== mon.2 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7faeac004ba0 con 0x7faec4102780 2024-09-19T06:13:54.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.571+0000 7faebb7fe640 1 --2- 172.21.15.2:0/3846536954 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7faeb00a3350 0x7faeb00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:54.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.571+0000 7faebb7fe640 1 -- 172.21.15.2:0/3846536954 <== mon.2 v2:172.21.15.89:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7faeac0cf9a0 con 0x7faec4102780 2024-09-19T06:13:54.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.571+0000 7faec259c640 1 --2- 172.21.15.2:0/3846536954 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7faeb00a3350 0x7faeb00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:54.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.572+0000 7faec259c640 1 --2- 172.21.15.2:0/3846536954 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7faeb00a3350 0x7faeb00a5810 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7faeb4031440 tx=0x7faeb4005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:54.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.576+0000 7faebb7fe640 1 -- 172.21.15.2:0/3846536954 <== mon.2 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faeac09c570 con 0x7faec4102780 2024-09-19T06:13:54.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.753+0000 7faec8a3c640 1 -- 172.21.15.2:0/3846536954 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7faec41996f0 con 0x7faec4102780 2024-09-19T06:13:54.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.753+0000 7faebb7fe640 1 -- 172.21.15.2:0/3846536954 <== mon.2 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faec41996f0 con 0x7faec4102780 2024-09-19T06:13:54.755 INFO:teuthology.orchestra.run.smithi002.stdout:55834574921 2024-09-19T06:13:54.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.755+0000 7faec8a3c640 1 -- 172.21.15.2:0/3846536954 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7faeb00a3350 msgr2=0x7faeb00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:54.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.755+0000 7faec8a3c640 1 --2- 172.21.15.2:0/3846536954 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7faeb00a3350 0x7faeb00a5810 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7faeb4031440 tx=0x7faeb4005b50 comp rx=0 tx=0).stop 2024-09-19T06:13:54.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.755+0000 7faec8a3c640 1 -- 172.21.15.2:0/3846536954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faec4102780 msgr2=0x7faec41988d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:54.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.755+0000 7faec8a3c640 1 --2- 172.21.15.2:0/3846536954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faec4102780 0x7faec41988d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faeac00e9f0 tx=0x7faeac00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:13:54.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.755+0000 7faec8a3c640 1 -- 172.21.15.2:0/3846536954 shutdown_connections 2024-09-19T06:13:54.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.755+0000 7faec8a3c640 1 --2- 172.21.15.2:0/3846536954 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7faeb00a3350 0x7faeb00a5810 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:54.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.755+0000 7faec8a3c640 1 --2- 172.21.15.2:0/3846536954 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faec4106f00 0x7faec419cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:54.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.755+0000 7faec8a3c640 1 --2- 172.21.15.2:0/3846536954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faec4102780 0x7faec41988d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:54.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.755+0000 7faec8a3c640 1 --2- 172.21.15.2:0/3846536954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec4101dd0 0x7faec4198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:54.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.756+0000 7faec8a3c640 1 -- 172.21.15.2:0/3846536954 >> 172.21.15.2:0/3846536954 conn(0x7faec40fd8b0 msgr2=0x7faec40fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:54.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.756+0000 7faec8a3c640 1 -- 172.21.15.2:0/3846536954 shutdown_connections 2024-09-19T06:13:54.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:54.756+0000 7faec8a3c640 1 -- 172.21.15.2:0/3846536954 wait complete. 2024-09-19T06:13:55.055 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:55.056 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:55.057 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:55.058 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:55.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:54 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1077456263' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T06:13:55.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:54 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/125646123' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T06:13:55.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:54 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/3846536954' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T06:13:55.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:54 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1077456263' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T06:13:55.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:54 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/125646123' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T06:13:55.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:54 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/3846536954' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T06:13:55.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:54 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1077456263' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T06:13:55.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:54 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/125646123' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T06:13:55.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:54 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/3846536954' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T06:13:55.446 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444098 got 73014444100 for osd.2 2024-09-19T06:13:55.446 DEBUG:teuthology.parallel:result is None 2024-09-19T06:13:55.962 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986232 got 133143986234 for osd.4 2024-09-19T06:13:55.962 DEBUG:teuthology.parallel:result is None 2024-09-19T06:13:56.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:55 smithi002 ceph-mon[30982]: pgmap v302: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T06:13:56.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:55 smithi090 ceph-mon[34497]: pgmap v302: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T06:13:56.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:55 smithi089 ceph-mon[34160]: pgmap v302: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T06:13:56.555 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574919 got 55834574921 for osd.1 2024-09-19T06:13:56.555 DEBUG:teuthology.parallel:result is None 2024-09-19T06:13:56.739 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:56.983 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:57.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.298+0000 7fafd2548640 1 -- 172.21.15.2:0/3095545638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafcc10c170 msgr2=0x7fafcc10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:57.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.298+0000 7fafd2548640 1 --2- 172.21.15.2:0/3095545638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafcc10c170 0x7fafcc10e610 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fafc4009ca0 tx=0x7fafc402a950 comp rx=0 tx=0).stop 2024-09-19T06:13:57.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.298+0000 7fafd2548640 1 -- 172.21.15.2:0/3095545638 shutdown_connections 2024-09-19T06:13:57.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.298+0000 7fafd2548640 1 --2- 172.21.15.2:0/3095545638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafcc10c170 0x7fafcc10e610 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.298+0000 7fafd2548640 1 --2- 172.21.15.2:0/3095545638 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafcc103660 0x7fafcc10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.298+0000 7fafd2548640 1 --2- 172.21.15.2:0/3095545638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fafcc102d40 0x7fafcc103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.298+0000 7fafd2548640 1 -- 172.21.15.2:0/3095545638 >> 172.21.15.2:0/3095545638 conn(0x7fafcc0fc7a0 msgr2=0x7fafcc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:57.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.298+0000 7fafd2548640 1 -- 172.21.15.2:0/3095545638 shutdown_connections 2024-09-19T06:13:57.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.298+0000 7fafd2548640 1 -- 172.21.15.2:0/3095545638 wait complete. 2024-09-19T06:13:57.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.298+0000 7fafd2548640 1 Processor -- start 2024-09-19T06:13:57.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.298+0000 7fafd2548640 1 -- start start 2024-09-19T06:13:57.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.298+0000 7fafd2548640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafcc102d40 0x7fafcc1982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:57.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.298+0000 7fafd2548640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fafcc103660 0x7fafcc198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:57.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.298+0000 7fafd2548640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafcc10c170 0x7fafcc19cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:57.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.298+0000 7fafd2548640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fafcc111e20 con 0x7fafcc10c170 2024-09-19T06:13:57.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.298+0000 7fafd2548640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fafcc111ca0 con 0x7fafcc103660 2024-09-19T06:13:57.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.299+0000 7fafd2548640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fafcc111fa0 con 0x7fafcc102d40 2024-09-19T06:13:57.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.299+0000 7fafd0ae5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafcc10c170 0x7fafcc19cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:57.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.299+0000 7fafd0ae5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafcc10c170 0x7fafcc19cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58286/0 (socket says 172.21.15.2:58286) 2024-09-19T06:13:57.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.299+0000 7fafd0ae5640 1 -- 172.21.15.2:0/4039808530 learned_addr learned my addr 172.21.15.2:0/4039808530 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:13:57.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.299+0000 7fafc3fff640 1 --2- 172.21.15.2:0/4039808530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fafcc103660 0x7fafcc198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:57.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.299+0000 7fafcbfff640 1 --2- 172.21.15.2:0/4039808530 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafcc102d40 0x7fafcc1982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:57.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.299+0000 7fafd0ae5640 1 -- 172.21.15.2:0/4039808530 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafcc102d40 msgr2=0x7fafcc1982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:57.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.299+0000 7fafd0ae5640 1 --2- 172.21.15.2:0/4039808530 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafcc102d40 0x7fafcc1982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.299+0000 7fafd0ae5640 1 -- 172.21.15.2:0/4039808530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fafcc103660 msgr2=0x7fafcc198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:57.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.299+0000 7fafd0ae5640 1 --2- 172.21.15.2:0/4039808530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fafcc103660 0x7fafcc198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.299+0000 7fafd0ae5640 1 -- 172.21.15.2:0/4039808530 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafcc19d290 con 0x7fafcc10c170 2024-09-19T06:13:57.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.299+0000 7fafd0ae5640 1 --2- 172.21.15.2:0/4039808530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafcc10c170 0x7fafcc19cbb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fafc4004af0 tx=0x7fafc402f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:57.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.299+0000 7fafc9ffb640 1 -- 172.21.15.2:0/4039808530 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc4034040 con 0x7fafcc10c170 2024-09-19T06:13:57.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.299+0000 7fafc9ffb640 1 -- 172.21.15.2:0/4039808530 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fafc402fe80 con 0x7fafcc10c170 2024-09-19T06:13:57.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.299+0000 7fafd2548640 1 -- 172.21.15.2:0/4039808530 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafcc19d520 con 0x7fafcc10c170 2024-09-19T06:13:57.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.299+0000 7fafc9ffb640 1 -- 172.21.15.2:0/4039808530 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc40046a0 con 0x7fafcc10c170 2024-09-19T06:13:57.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.299+0000 7fafd2548640 1 -- 172.21.15.2:0/4039808530 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafcc1a4e60 con 0x7fafcc10c170 2024-09-19T06:13:57.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.300+0000 7fafd2548640 1 -- 172.21.15.2:0/4039808530 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafcc103120 con 0x7fafcc10c170 2024-09-19T06:13:57.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.301+0000 7fafc9ffb640 1 -- 172.21.15.2:0/4039808530 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fafc4037020 con 0x7fafcc10c170 2024-09-19T06:13:57.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.302+0000 7fafc9ffb640 1 --2- 172.21.15.2:0/4039808530 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fafb80a3350 0x7fafb80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:57.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.302+0000 7fafc9ffb640 1 -- 172.21.15.2:0/4039808530 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7fafc40f0840 con 0x7fafcc10c170 2024-09-19T06:13:57.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.302+0000 7fafcbfff640 1 --2- 172.21.15.2:0/4039808530 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fafb80a3350 0x7fafb80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:57.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.303+0000 7fafcbfff640 1 --2- 172.21.15.2:0/4039808530 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fafb80a3350 0x7fafb80a5810 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fafbc009aa0 tx=0x7fafbc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:57.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.306+0000 7fafc9ffb640 1 -- 172.21.15.2:0/4039808530 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fafc40bd520 con 0x7fafcc10c170 2024-09-19T06:13:57.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.489+0000 7fafd2548640 1 -- 172.21.15.2:0/4039808530 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fafcc1071e0 con 0x7fafcc10c170 2024-09-19T06:13:57.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.489+0000 7fafc9ffb640 1 -- 172.21.15.2:0/4039808530 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fafc40bce20 con 0x7fafcc10c170 2024-09-19T06:13:57.491 INFO:teuthology.orchestra.run.smithi002.stdout:201863462955 2024-09-19T06:13:57.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.491+0000 7fafd2548640 1 -- 172.21.15.2:0/4039808530 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fafb80a3350 msgr2=0x7fafb80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:57.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.491+0000 7fafd2548640 1 --2- 172.21.15.2:0/4039808530 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fafb80a3350 0x7fafb80a5810 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fafbc009aa0 tx=0x7fafbc005f90 comp rx=0 tx=0).stop 2024-09-19T06:13:57.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.491+0000 7fafd2548640 1 -- 172.21.15.2:0/4039808530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafcc10c170 msgr2=0x7fafcc19cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:57.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.491+0000 7fafd2548640 1 --2- 172.21.15.2:0/4039808530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafcc10c170 0x7fafcc19cbb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fafc4004af0 tx=0x7fafc402f5d0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.491+0000 7fafd2548640 1 -- 172.21.15.2:0/4039808530 shutdown_connections 2024-09-19T06:13:57.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.491+0000 7fafd2548640 1 --2- 172.21.15.2:0/4039808530 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fafb80a3350 0x7fafb80a5810 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.491+0000 7fafd2548640 1 --2- 172.21.15.2:0/4039808530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafcc10c170 0x7fafcc19cbb0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.491+0000 7fafd2548640 1 --2- 172.21.15.2:0/4039808530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fafcc103660 0x7fafcc198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.491+0000 7fafd2548640 1 --2- 172.21.15.2:0/4039808530 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafcc102d40 0x7fafcc1982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.491+0000 7fafd2548640 1 -- 172.21.15.2:0/4039808530 >> 172.21.15.2:0/4039808530 conn(0x7fafcc0fc7a0 msgr2=0x7fafcc0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:57.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.492+0000 7fafd2548640 1 -- 172.21.15.2:0/4039808530 shutdown_connections 2024-09-19T06:13:57.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.492+0000 7fafd2548640 1 -- 172.21.15.2:0/4039808530 wait complete. 2024-09-19T06:13:57.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.819+0000 7f55c98d4640 1 -- 172.21.15.2:0/3313430619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55c4101df0 msgr2=0x7f55c41021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:57.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.819+0000 7f55c98d4640 1 --2- 172.21.15.2:0/3313430619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55c4101df0 0x7f55c41021d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f55b4009900 tx=0x7f55b402a410 comp rx=0 tx=0).stop 2024-09-19T06:13:57.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.819+0000 7f55c98d4640 1 -- 172.21.15.2:0/3313430619 shutdown_connections 2024-09-19T06:13:57.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.819+0000 7f55c98d4640 1 --2- 172.21.15.2:0/3313430619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55c4106f20 0x7f55c410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.819+0000 7f55c98d4640 1 --2- 172.21.15.2:0/3313430619 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55c41027a0 0x7f55c41067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.819+0000 7f55c98d4640 1 --2- 172.21.15.2:0/3313430619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55c4101df0 0x7f55c41021d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.819+0000 7f55c98d4640 1 -- 172.21.15.2:0/3313430619 >> 172.21.15.2:0/3313430619 conn(0x7f55c40fd8b0 msgr2=0x7f55c40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:57.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.819+0000 7f55c98d4640 1 -- 172.21.15.2:0/3313430619 shutdown_connections 2024-09-19T06:13:57.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.819+0000 7f55c98d4640 1 -- 172.21.15.2:0/3313430619 wait complete. 2024-09-19T06:13:57.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.820+0000 7f55c98d4640 1 Processor -- start 2024-09-19T06:13:57.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.820+0000 7f55c98d4640 1 -- start start 2024-09-19T06:13:57.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.821+0000 7f55c98d4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55c4101df0 0x7f55c4198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:57.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.821+0000 7f55c98d4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55c41027a0 0x7f55c41988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:57.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.821+0000 7f55c98d4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55c4106f20 0x7f55c419cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:57.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.821+0000 7f55c98d4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f55c4111e80 con 0x7f55c4101df0 2024-09-19T06:13:57.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.821+0000 7f55c2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55c4101df0 0x7f55c4198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:57.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.821+0000 7f55c2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55c4101df0 0x7f55c4198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58308/0 (socket says 172.21.15.2:58308) 2024-09-19T06:13:57.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.821+0000 7f55c2ffd640 1 -- 172.21.15.2:0/753118723 learned_addr learned my addr 172.21.15.2:0/753118723 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:13:57.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.821+0000 7f55c98d4640 1 -- 172.21.15.2:0/753118723 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f55c4111d00 con 0x7f55c41027a0 2024-09-19T06:13:57.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.821+0000 7f55c37fe640 1 --2- 172.21.15.2:0/753118723 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55c4106f20 0x7f55c419cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:57.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.821+0000 7f55c98d4640 1 -- 172.21.15.2:0/753118723 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f55c4112000 con 0x7f55c4106f20 2024-09-19T06:13:57.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.821+0000 7f55c27fc640 1 --2- 172.21.15.2:0/753118723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55c41027a0 0x7f55c41988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:57.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.821+0000 7f55c37fe640 1 -- 172.21.15.2:0/753118723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55c41027a0 msgr2=0x7f55c41988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:57.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.821+0000 7f55c37fe640 1 --2- 172.21.15.2:0/753118723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55c41027a0 0x7f55c41988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.821+0000 7f55c37fe640 1 -- 172.21.15.2:0/753118723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55c4101df0 msgr2=0x7f55c4198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:57.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.821+0000 7f55c37fe640 1 --2- 172.21.15.2:0/753118723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55c4101df0 0x7f55c4198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.821+0000 7f55c37fe640 1 -- 172.21.15.2:0/753118723 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55c419d330 con 0x7f55c4106f20 2024-09-19T06:13:57.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.821+0000 7f55c2ffd640 1 --2- 172.21.15.2:0/753118723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55c4101df0 0x7f55c4198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:13:57.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.822+0000 7f55c37fe640 1 --2- 172.21.15.2:0/753118723 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55c4106f20 0x7f55c419cc50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f55bc00da10 tx=0x7f55bc00ded0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:57.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.822+0000 7f55c88d2640 1 -- 172.21.15.2:0/753118723 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55bc00bd70 con 0x7f55c4106f20 2024-09-19T06:13:57.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.822+0000 7f55c98d4640 1 -- 172.21.15.2:0/753118723 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55c419d620 con 0x7f55c4106f20 2024-09-19T06:13:57.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.822+0000 7f55c88d2640 1 -- 172.21.15.2:0/753118723 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f55bc003e20 con 0x7f55c4106f20 2024-09-19T06:13:57.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.822+0000 7f55c98d4640 1 -- 172.21.15.2:0/753118723 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55c41a4f00 con 0x7f55c4106f20 2024-09-19T06:13:57.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.822+0000 7f55c88d2640 1 -- 172.21.15.2:0/753118723 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55bc0106c0 con 0x7f55c4106f20 2024-09-19T06:13:57.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.823+0000 7f55c98d4640 1 -- 172.21.15.2:0/753118723 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55b0005290 con 0x7f55c4106f20 2024-09-19T06:13:57.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.824+0000 7f55c88d2640 1 -- 172.21.15.2:0/753118723 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f55bc003970 con 0x7f55c4106f20 2024-09-19T06:13:57.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.825+0000 7f55c88d2640 1 --2- 172.21.15.2:0/753118723 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f55ac0a3350 0x7f55ac0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:57.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.825+0000 7f55c2ffd640 1 --2- 172.21.15.2:0/753118723 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f55ac0a3350 0x7f55ac0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:57.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.825+0000 7f55c88d2640 1 -- 172.21.15.2:0/753118723 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f55bc0cfc10 con 0x7f55c4106f20 2024-09-19T06:13:57.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.825+0000 7f55c2ffd640 1 --2- 172.21.15.2:0/753118723 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f55ac0a3350 0x7f55ac0a5810 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f55b40096c0 tx=0x7f55b4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:57.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:57.828+0000 7f55c88d2640 1 -- 172.21.15.2:0/753118723 <== mon.1 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f55bc09c800 con 0x7f55c4106f20 2024-09-19T06:13:58.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.012+0000 7f55c98d4640 1 -- 172.21.15.2:0/753118723 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f55b0005850 con 0x7f55c4106f20 2024-09-19T06:13:58.014 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:57 smithi002 ceph-mon[30982]: pgmap v303: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T06:13:58.014 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:57 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/4039808530' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T06:13:58.014 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:57 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:13:58.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.013+0000 7f55c88d2640 1 -- 172.21.15.2:0/753118723 <== mon.1 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f55bc09c100 con 0x7f55c4106f20 2024-09-19T06:13:58.015 INFO:teuthology.orchestra.run.smithi002.stdout:154618822709 2024-09-19T06:13:58.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.015+0000 7f55c98d4640 1 -- 172.21.15.2:0/753118723 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f55ac0a3350 msgr2=0x7f55ac0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:58.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.015+0000 7f55c98d4640 1 --2- 172.21.15.2:0/753118723 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f55ac0a3350 0x7f55ac0a5810 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f55b40096c0 tx=0x7f55b4005a20 comp rx=0 tx=0).stop 2024-09-19T06:13:58.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.015+0000 7f55c98d4640 1 -- 172.21.15.2:0/753118723 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55c4106f20 msgr2=0x7f55c419cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:58.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.015+0000 7f55c98d4640 1 --2- 172.21.15.2:0/753118723 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55c4106f20 0x7f55c419cc50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f55bc00da10 tx=0x7f55bc00ded0 comp rx=0 tx=0).stop 2024-09-19T06:13:58.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.015+0000 7f55c98d4640 1 -- 172.21.15.2:0/753118723 shutdown_connections 2024-09-19T06:13:58.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.015+0000 7f55c98d4640 1 --2- 172.21.15.2:0/753118723 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f55ac0a3350 0x7f55ac0a5810 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:58.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.015+0000 7f55c98d4640 1 --2- 172.21.15.2:0/753118723 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55c4106f20 0x7f55c419cc50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:58.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.015+0000 7f55c98d4640 1 --2- 172.21.15.2:0/753118723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55c41027a0 0x7f55c41988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:58.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.015+0000 7f55c98d4640 1 --2- 172.21.15.2:0/753118723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55c4101df0 0x7f55c4198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:58.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.015+0000 7f55c98d4640 1 -- 172.21.15.2:0/753118723 >> 172.21.15.2:0/753118723 conn(0x7f55c40fd8b0 msgr2=0x7f55c40fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:58.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.015+0000 7f55c98d4640 1 -- 172.21.15.2:0/753118723 shutdown_connections 2024-09-19T06:13:58.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.015+0000 7f55c98d4640 1 -- 172.21.15.2:0/753118723 wait complete. 2024-09-19T06:13:58.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:57 smithi090 ceph-mon[34497]: pgmap v303: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T06:13:58.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:57 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/4039808530' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T06:13:58.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:57 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:13:58.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:57 smithi089 ceph-mon[34160]: pgmap v303: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T06:13:58.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:57 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/4039808530' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T06:13:58.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:57 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:13:58.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.540+0000 7f1407502640 1 -- 172.21.15.2:0/3192412921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1400102ef0 msgr2=0x7f140010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:58.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.541+0000 7f1407502640 1 --2- 172.21.15.2:0/3192412921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1400102ef0 0x7f140010da40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f13f8009ca0 tx=0x7f13f802a950 comp rx=0 tx=0).stop 2024-09-19T06:13:58.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.541+0000 7f1407502640 1 -- 172.21.15.2:0/3192412921 shutdown_connections 2024-09-19T06:13:58.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.541+0000 7f1407502640 1 --2- 172.21.15.2:0/3192412921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1400102ef0 0x7f140010da40 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:58.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.541+0000 7f1407502640 1 --2- 172.21.15.2:0/3192412921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1400102570 0x7f14001029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:58.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.541+0000 7f1407502640 1 --2- 172.21.15.2:0/3192412921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1400100e20 0x7f1400101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:58.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.541+0000 7f1407502640 1 -- 172.21.15.2:0/3192412921 >> 172.21.15.2:0/3192412921 conn(0x7f14000fc7d0 msgr2=0x7f14000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:58.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.541+0000 7f1407502640 1 -- 172.21.15.2:0/3192412921 shutdown_connections 2024-09-19T06:13:58.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.541+0000 7f1407502640 1 -- 172.21.15.2:0/3192412921 wait complete. 2024-09-19T06:13:58.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.542+0000 7f1407502640 1 Processor -- start 2024-09-19T06:13:58.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.542+0000 7f1407502640 1 -- start start 2024-09-19T06:13:58.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.542+0000 7f1407502640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1400100e20 0x7f14001991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:58.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.542+0000 7f1407502640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1400102570 0x7f1400199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:58.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.542+0000 7f1407502640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1400102ef0 0x7f1400199ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:58.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.542+0000 7f1407502640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1400110e30 con 0x7f1400100e20 2024-09-19T06:13:58.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.542+0000 7f1407502640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f1400110cb0 con 0x7f1400102ef0 2024-09-19T06:13:58.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.542+0000 7f1407502640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1400110fb0 con 0x7f1400102570 2024-09-19T06:13:58.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.542+0000 7f140529e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1400100e20 0x7f14001991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:58.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.542+0000 7f140529e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1400100e20 0x7f14001991e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58352/0 (socket says 172.21.15.2:58352) 2024-09-19T06:13:58.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.542+0000 7f140529e640 1 -- 172.21.15.2:0/372196824 learned_addr learned my addr 172.21.15.2:0/372196824 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:13:58.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.542+0000 7f1405a9f640 1 --2- 172.21.15.2:0/372196824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1400102ef0 0x7f1400199ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:58.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.542+0000 7f1404a9d640 1 --2- 172.21.15.2:0/372196824 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1400102570 0x7f1400199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:58.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.542+0000 7f140529e640 1 -- 172.21.15.2:0/372196824 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1400102570 msgr2=0x7f1400199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:58.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.542+0000 7f140529e640 1 --2- 172.21.15.2:0/372196824 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1400102570 0x7f1400199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:58.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.542+0000 7f140529e640 1 -- 172.21.15.2:0/372196824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1400102ef0 msgr2=0x7f1400199ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:58.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.542+0000 7f140529e640 1 --2- 172.21.15.2:0/372196824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1400102ef0 0x7f1400199ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:58.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.542+0000 7f140529e640 1 -- 172.21.15.2:0/372196824 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14001a45e0 con 0x7f1400100e20 2024-09-19T06:13:58.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.543+0000 7f140529e640 1 --2- 172.21.15.2:0/372196824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1400100e20 0x7f14001991e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f13f400c920 tx=0x7f13f400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:58.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.543+0000 7f13f27fc640 1 -- 172.21.15.2:0/372196824 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f4007c70 con 0x7f1400100e20 2024-09-19T06:13:58.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.543+0000 7f13f27fc640 1 -- 172.21.15.2:0/372196824 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f13f4007e10 con 0x7f1400100e20 2024-09-19T06:13:58.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.543+0000 7f13f27fc640 1 -- 172.21.15.2:0/372196824 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f4018820 con 0x7f1400100e20 2024-09-19T06:13:58.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.543+0000 7f1407502640 1 -- 172.21.15.2:0/372196824 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14001a48d0 con 0x7f1400100e20 2024-09-19T06:13:58.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.543+0000 7f1407502640 1 -- 172.21.15.2:0/372196824 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14001a4dc0 con 0x7f1400100e20 2024-09-19T06:13:58.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.544+0000 7f1407502640 1 -- 172.21.15.2:0/372196824 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1400101200 con 0x7f1400100e20 2024-09-19T06:13:58.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.546+0000 7f13f27fc640 1 -- 172.21.15.2:0/372196824 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f13f40189c0 con 0x7f1400100e20 2024-09-19T06:13:58.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.547+0000 7f13f27fc640 1 --2- 172.21.15.2:0/372196824 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f13ec0a3350 0x7f13ec0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:58.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.547+0000 7f13f27fc640 1 -- 172.21.15.2:0/372196824 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f13f40cfdf0 con 0x7f1400100e20 2024-09-19T06:13:58.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.547+0000 7f1404a9d640 1 --2- 172.21.15.2:0/372196824 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f13ec0a3350 0x7f13ec0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:58.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.547+0000 7f1404a9d640 1 --2- 172.21.15.2:0/372196824 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f13ec0a3350 0x7f13ec0a5810 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f13fc005fd0 tx=0x7f13fc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:58.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.550+0000 7f13f27fc640 1 -- 172.21.15.2:0/372196824 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f13f4014030 con 0x7f1400100e20 2024-09-19T06:13:58.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.731+0000 7f1407502640 1 -- 172.21.15.2:0/372196824 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f140006a560 con 0x7f1400100e20 2024-09-19T06:13:58.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.731+0000 7f13f27fc640 1 -- 172.21.15.2:0/372196824 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f13f409cad0 con 0x7f1400100e20 2024-09-19T06:13:58.733 INFO:teuthology.orchestra.run.smithi002.stdout:261993005090 2024-09-19T06:13:58.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.733+0000 7f1407502640 1 -- 172.21.15.2:0/372196824 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f13ec0a3350 msgr2=0x7f13ec0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:58.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.733+0000 7f1407502640 1 --2- 172.21.15.2:0/372196824 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f13ec0a3350 0x7f13ec0a5810 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f13fc005fd0 tx=0x7f13fc005850 comp rx=0 tx=0).stop 2024-09-19T06:13:58.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.733+0000 7f1407502640 1 -- 172.21.15.2:0/372196824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1400100e20 msgr2=0x7f14001991e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:58.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.733+0000 7f1407502640 1 --2- 172.21.15.2:0/372196824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1400100e20 0x7f14001991e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f13f400c920 tx=0x7f13f400cde0 comp rx=0 tx=0).stop 2024-09-19T06:13:58.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.734+0000 7f1407502640 1 -- 172.21.15.2:0/372196824 shutdown_connections 2024-09-19T06:13:58.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.734+0000 7f1407502640 1 --2- 172.21.15.2:0/372196824 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f13ec0a3350 0x7f13ec0a5810 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:58.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.734+0000 7f1407502640 1 --2- 172.21.15.2:0/372196824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1400102ef0 0x7f1400199ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:58.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.734+0000 7f1407502640 1 --2- 172.21.15.2:0/372196824 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1400102570 0x7f1400199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:58.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.734+0000 7f1407502640 1 --2- 172.21.15.2:0/372196824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1400100e20 0x7f14001991e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:58.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.734+0000 7f1407502640 1 -- 172.21.15.2:0/372196824 >> 172.21.15.2:0/372196824 conn(0x7f14000fc7d0 msgr2=0x7f14000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:58.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.734+0000 7f1407502640 1 -- 172.21.15.2:0/372196824 shutdown_connections 2024-09-19T06:13:58.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.734+0000 7f1407502640 1 -- 172.21.15.2:0/372196824 wait complete. 2024-09-19T06:13:59.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.448+0000 7f4cc25f1640 1 -- 172.21.15.2:0/3777439501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4cbc103740 msgr2=0x7f4cbc107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:59.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.448+0000 7f4cc25f1640 1 --2- 172.21.15.2:0/3777439501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4cbc103740 0x7f4cbc107b80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4009930 tx=0x7f4ca402a420 comp rx=0 tx=0).stop 2024-09-19T06:13:59.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.448+0000 7f4cc25f1640 1 -- 172.21.15.2:0/3777439501 shutdown_connections 2024-09-19T06:13:59.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.448+0000 7f4cc25f1640 1 --2- 172.21.15.2:0/3777439501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cbc108290 0x7f4cbc10ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.448+0000 7f4cc25f1640 1 --2- 172.21.15.2:0/3777439501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4cbc103740 0x7f4cbc107b80 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.448+0000 7f4cc25f1640 1 --2- 172.21.15.2:0/3777439501 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4cbc102d90 0x7f4cbc103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.448+0000 7f4cc25f1640 1 -- 172.21.15.2:0/3777439501 >> 172.21.15.2:0/3777439501 conn(0x7f4cbc0fc7d0 msgr2=0x7f4cbc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:59.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.448+0000 7f4cc25f1640 1 -- 172.21.15.2:0/3777439501 shutdown_connections 2024-09-19T06:13:59.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.448+0000 7f4cc25f1640 1 -- 172.21.15.2:0/3777439501 wait complete. 2024-09-19T06:13:59.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.449+0000 7f4cc25f1640 1 Processor -- start 2024-09-19T06:13:59.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.449+0000 7f4cc25f1640 1 -- start start 2024-09-19T06:13:59.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.449+0000 7f4cc25f1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4cbc102d90 0x7f4cbc1009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:59.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.449+0000 7f4cc25f1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4cbc103740 0x7f4cbc100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:59.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.449+0000 7f4cc25f1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cbc108290 0x7f4cbc101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:59.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.449+0000 7f4cc25f1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4cbc111f00 con 0x7f4cbc103740 2024-09-19T06:13:59.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.449+0000 7f4cc25f1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4cbc111d80 con 0x7f4cbc108290 2024-09-19T06:13:59.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.449+0000 7f4cc25f1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4cbc112080 con 0x7f4cbc102d90 2024-09-19T06:13:59.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.449+0000 7f4cb3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4cbc103740 0x7f4cbc100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:59.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.449+0000 7f4cb3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4cbc103740 0x7f4cbc100f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58322/0 (socket says 172.21.15.2:58322) 2024-09-19T06:13:59.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.449+0000 7f4cb3fff640 1 -- 172.21.15.2:0/1913989276 learned_addr learned my addr 172.21.15.2:0/1913989276 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:13:59.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.449+0000 7f4cbbfff640 1 --2- 172.21.15.2:0/1913989276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4cbc102d90 0x7f4cbc1009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:59.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.449+0000 7f4cc0b8e640 1 --2- 172.21.15.2:0/1913989276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cbc108290 0x7f4cbc101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:59.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.450+0000 7f4cb3fff640 1 -- 172.21.15.2:0/1913989276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4cbc102d90 msgr2=0x7f4cbc1009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:59.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.450+0000 7f4cb3fff640 1 --2- 172.21.15.2:0/1913989276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4cbc102d90 0x7f4cbc1009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.450+0000 7f4cb3fff640 1 -- 172.21.15.2:0/1913989276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cbc108290 msgr2=0x7f4cbc101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:59.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.450+0000 7f4cb3fff640 1 --2- 172.21.15.2:0/1913989276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cbc108290 0x7f4cbc101470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.450+0000 7f4cb3fff640 1 -- 172.21.15.2:0/1913989276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cbc1a6a00 con 0x7f4cbc103740 2024-09-19T06:13:59.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.450+0000 7f4cb3fff640 1 --2- 172.21.15.2:0/1913989276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4cbc103740 0x7f4cbc100f30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4031440 tx=0x7f4ca4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:59.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.450+0000 7f4cb9ffb640 1 -- 172.21.15.2:0/1913989276 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca403f030 con 0x7f4cbc103740 2024-09-19T06:13:59.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.450+0000 7f4cb9ffb640 1 -- 172.21.15.2:0/1913989276 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4ca4003aa0 con 0x7f4cbc103740 2024-09-19T06:13:59.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.450+0000 7f4cc25f1640 1 -- 172.21.15.2:0/1913989276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cbc1a6c90 con 0x7f4cbc103740 2024-09-19T06:13:59.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.450+0000 7f4cb9ffb640 1 -- 172.21.15.2:0/1913989276 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca4035070 con 0x7f4cbc103740 2024-09-19T06:13:59.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.450+0000 7f4cc25f1640 1 -- 172.21.15.2:0/1913989276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cbc1a7170 con 0x7f4cbc103740 2024-09-19T06:13:59.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.451+0000 7f4cc25f1640 1 -- 172.21.15.2:0/1913989276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cbc103170 con 0x7f4cbc103740 2024-09-19T06:13:59.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.452+0000 7f4cb9ffb640 1 -- 172.21.15.2:0/1913989276 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f4ca4042030 con 0x7f4cbc103740 2024-09-19T06:13:59.127 INFO:teuthology.orchestra.run.smithi002.stdout:184683593777 2024-09-19T06:13:59.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.453+0000 7f4cb9ffb640 1 --2- 172.21.15.2:0/1913989276 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f4ca80a32d0 0x7f4ca80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:59.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.453+0000 7f4cbbfff640 1 --2- 172.21.15.2:0/1913989276 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f4ca80a32d0 0x7f4ca80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:59.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.453+0000 7f4cb9ffb640 1 -- 172.21.15.2:0/1913989276 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f4ca40efff0 con 0x7f4cbc103740 2024-09-19T06:13:59.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.454+0000 7f4cbbfff640 1 --2- 172.21.15.2:0/1913989276 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f4ca80a32d0 0x7f4ca80a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4cac005d00 tx=0x7f4cac00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:59.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.457+0000 7f4cb9ffb640 1 -- 172.21.15.2:0/1913989276 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4ca40bc570 con 0x7f4cbc103740 2024-09-19T06:13:59.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.638+0000 7f4cc25f1640 1 -- 172.21.15.2:0/1913989276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f4cbc10a2a0 con 0x7f4cbc103740 2024-09-19T06:13:59.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.639+0000 7f4cb9ffb640 1 -- 172.21.15.2:0/1913989276 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f4ca40c0870 con 0x7f4cbc103740 2024-09-19T06:13:59.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.641+0000 7f4cc25f1640 1 -- 172.21.15.2:0/1913989276 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f4ca80a32d0 msgr2=0x7f4ca80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:59.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.641+0000 7f4cc25f1640 1 --2- 172.21.15.2:0/1913989276 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f4ca80a32d0 0x7f4ca80a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4cac005d00 tx=0x7f4cac00b410 comp rx=0 tx=0).stop 2024-09-19T06:13:59.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.641+0000 7f4cc25f1640 1 -- 172.21.15.2:0/1913989276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4cbc103740 msgr2=0x7f4cbc100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:59.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.641+0000 7f4cc25f1640 1 --2- 172.21.15.2:0/1913989276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4cbc103740 0x7f4cbc100f30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4031440 tx=0x7f4ca4004270 comp rx=0 tx=0).stop 2024-09-19T06:13:59.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.641+0000 7f4cc25f1640 1 -- 172.21.15.2:0/1913989276 shutdown_connections 2024-09-19T06:13:59.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.641+0000 7f4cc25f1640 1 --2- 172.21.15.2:0/1913989276 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f4ca80a32d0 0x7f4ca80a5790 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.641+0000 7f4cc25f1640 1 --2- 172.21.15.2:0/1913989276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cbc108290 0x7f4cbc101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.641+0000 7f4cc25f1640 1 --2- 172.21.15.2:0/1913989276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4cbc103740 0x7f4cbc100f30 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.641+0000 7f4cc25f1640 1 --2- 172.21.15.2:0/1913989276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4cbc102d90 0x7f4cbc1009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.641+0000 7f4cc25f1640 1 -- 172.21.15.2:0/1913989276 >> 172.21.15.2:0/1913989276 conn(0x7f4cbc0fc7d0 msgr2=0x7f4cbc103e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:59.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.641+0000 7f4cc25f1640 1 -- 172.21.15.2:0/1913989276 shutdown_connections 2024-09-19T06:13:59.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:13:58.641+0000 7f4cc25f1640 1 -- 172.21.15.2:0/1913989276 wait complete. 2024-09-19T06:13:59.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:58 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/753118723' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T06:13:59.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:58 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1913989276' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T06:13:59.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:58 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/372196824' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T06:13:59.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:58 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/753118723' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T06:13:59.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:58 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1913989276' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T06:13:59.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:58 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/372196824' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T06:13:59.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:58 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/753118723' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T06:13:59.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:58 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1913989276' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T06:13:59.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:58 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/372196824' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T06:13:59.824 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:59.855 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462953 got 201863462955 for osd.7 2024-09-19T06:13:59.856 DEBUG:teuthology.parallel:result is None 2024-09-19T06:14:00.082 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:59 smithi002 ceph-mon[30982]: pgmap v304: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-19T06:14:00.082 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:59 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:14:00.082 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:59 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:14:00.082 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:59 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:14:00.082 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:13:59 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:14:00.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:59 smithi090 ceph-mon[34497]: pgmap v304: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-19T06:14:00.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:59 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:14:00.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:59 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:14:00.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:59 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:14:00.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:13:59 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:14:00.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.271+0000 7f4431bb8640 1 -- 172.21.15.2:0/3834157230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f442c106f10 msgr2=0x7f442c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:00.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.271+0000 7f4431bb8640 1 --2- 172.21.15.2:0/3834157230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f442c106f10 0x7f442c10ea90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4424009ca0 tx=0x7f442402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:14:00.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.271+0000 7f4431bb8640 1 -- 172.21.15.2:0/3834157230 shutdown_connections 2024-09-19T06:14:00.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.271+0000 7f4431bb8640 1 --2- 172.21.15.2:0/3834157230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f442c106f10 0x7f442c10ea90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:00.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.271+0000 7f4431bb8640 1 --2- 172.21.15.2:0/3834157230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f442c102790 0x7f442c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:00.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.271+0000 7f4431bb8640 1 --2- 172.21.15.2:0/3834157230 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f442c101de0 0x7f442c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:00.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.271+0000 7f4431bb8640 1 -- 172.21.15.2:0/3834157230 >> 172.21.15.2:0/3834157230 conn(0x7f442c0fd8c0 msgr2=0x7f442c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:00.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.271+0000 7f4431bb8640 1 -- 172.21.15.2:0/3834157230 shutdown_connections 2024-09-19T06:14:00.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.271+0000 7f4431bb8640 1 -- 172.21.15.2:0/3834157230 wait complete. 2024-09-19T06:14:00.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.272+0000 7f4431bb8640 1 Processor -- start 2024-09-19T06:14:00.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.272+0000 7f4431bb8640 1 -- start start 2024-09-19T06:14:00.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.272+0000 7f4431bb8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f442c101de0 0x7f442c198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:00.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.272+0000 7f4431bb8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f442c102790 0x7f442c198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:00.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.272+0000 7f4431bb8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f442c106f10 0x7f442c19cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:00.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.272+0000 7f4431bb8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f442c111e40 con 0x7f442c101de0 2024-09-19T06:14:00.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.272+0000 7f4431bb8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f442c111cc0 con 0x7f442c106f10 2024-09-19T06:14:00.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.272+0000 7f4431bb8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f442c111fc0 con 0x7f442c102790 2024-09-19T06:14:00.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.273+0000 7f442b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f442c101de0 0x7f442c198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:00.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.273+0000 7f442b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f442c101de0 0x7f442c198320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58372/0 (socket says 172.21.15.2:58372) 2024-09-19T06:14:00.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.273+0000 7f442b7fe640 1 -- 172.21.15.2:0/1688966451 learned_addr learned my addr 172.21.15.2:0/1688966451 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:00.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.273+0000 7f4422ffd640 1 --2- 172.21.15.2:0/1688966451 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f442c102790 0x7f442c198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:00.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.273+0000 7f442bfff640 1 --2- 172.21.15.2:0/1688966451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f442c106f10 0x7f442c19cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:00.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.273+0000 7f442b7fe640 1 -- 172.21.15.2:0/1688966451 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f442c102790 msgr2=0x7f442c198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:00.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.273+0000 7f442b7fe640 1 --2- 172.21.15.2:0/1688966451 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f442c102790 0x7f442c198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:00.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.273+0000 7f442b7fe640 1 -- 172.21.15.2:0/1688966451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f442c106f10 msgr2=0x7f442c19cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:00.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.273+0000 7f442b7fe640 1 --2- 172.21.15.2:0/1688966451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f442c106f10 0x7f442c19cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:00.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.273+0000 7f442b7fe640 1 -- 172.21.15.2:0/1688966451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f442c19d2d0 con 0x7f442c101de0 2024-09-19T06:14:00.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.273+0000 7f442bfff640 1 --2- 172.21.15.2:0/1688966451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f442c106f10 0x7f442c19cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:14:00.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.273+0000 7f442b7fe640 1 --2- 172.21.15.2:0/1688966451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f442c101de0 0x7f442c198320 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f441c00b4a0 tx=0x7f441c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:00.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.273+0000 7f44297fa640 1 -- 172.21.15.2:0/1688966451 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441c015020 con 0x7f442c101de0 2024-09-19T06:14:00.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.273+0000 7f44297fa640 1 -- 172.21.15.2:0/1688966451 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f441c011ce0 con 0x7f442c101de0 2024-09-19T06:14:00.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.273+0000 7f4431bb8640 1 -- 172.21.15.2:0/1688966451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f442c19d5c0 con 0x7f442c101de0 2024-09-19T06:14:00.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.274+0000 7f44297fa640 1 -- 172.21.15.2:0/1688966451 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441c010dc0 con 0x7f442c101de0 2024-09-19T06:14:00.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.274+0000 7f4431bb8640 1 -- 172.21.15.2:0/1688966451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f442c1a4ea0 con 0x7f442c101de0 2024-09-19T06:14:00.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.275+0000 7f4431bb8640 1 -- 172.21.15.2:0/1688966451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f442c1021c0 con 0x7f442c101de0 2024-09-19T06:14:00.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.276+0000 7f44297fa640 1 -- 172.21.15.2:0/1688966451 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f441c018020 con 0x7f442c101de0 2024-09-19T06:14:00.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.277+0000 7f44297fa640 1 --2- 172.21.15.2:0/1688966451 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f44180a3350 0x7f44180a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:00.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.277+0000 7f4422ffd640 1 --2- 172.21.15.2:0/1688966451 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f44180a3350 0x7f44180a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:00.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.277+0000 7f44297fa640 1 -- 172.21.15.2:0/1688966451 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f441c0cf200 con 0x7f442c101de0 2024-09-19T06:14:00.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.277+0000 7f4422ffd640 1 --2- 172.21.15.2:0/1688966451 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f44180a3350 0x7f44180a5810 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f442c0fdce0 tx=0x7f441400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:00.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.281+0000 7f44297fa640 1 -- 172.21.15.2:0/1688966451 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f441c01f020 con 0x7f442c101de0 2024-09-19T06:14:00.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:59 smithi089 ceph-mon[34160]: pgmap v304: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-19T06:14:00.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:59 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:14:00.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:59 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:14:00.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:59 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:14:00.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:13:59 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:14:00.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.458+0000 7f4431bb8640 1 -- 172.21.15.2:0/1688966451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f442c109b60 con 0x7f442c101de0 2024-09-19T06:14:00.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.458+0000 7f44297fa640 1 -- 172.21.15.2:0/1688966451 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f441c09bee0 con 0x7f442c101de0 2024-09-19T06:14:00.460 INFO:teuthology.orchestra.run.smithi002.stdout:34359738446 2024-09-19T06:14:00.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.461+0000 7f4431bb8640 1 -- 172.21.15.2:0/1688966451 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f44180a3350 msgr2=0x7f44180a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:00.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.461+0000 7f4431bb8640 1 --2- 172.21.15.2:0/1688966451 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f44180a3350 0x7f44180a5810 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f442c0fdce0 tx=0x7f441400a2d0 comp rx=0 tx=0).stop 2024-09-19T06:14:00.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.461+0000 7f4431bb8640 1 -- 172.21.15.2:0/1688966451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f442c101de0 msgr2=0x7f442c198320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:00.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.461+0000 7f4431bb8640 1 --2- 172.21.15.2:0/1688966451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f442c101de0 0x7f442c198320 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f441c00b4a0 tx=0x7f441c00b8a0 comp rx=0 tx=0).stop 2024-09-19T06:14:00.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.461+0000 7f4431bb8640 1 -- 172.21.15.2:0/1688966451 shutdown_connections 2024-09-19T06:14:00.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.461+0000 7f4431bb8640 1 --2- 172.21.15.2:0/1688966451 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f44180a3350 0x7f44180a5810 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:00.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.461+0000 7f4431bb8640 1 --2- 172.21.15.2:0/1688966451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f442c106f10 0x7f442c19cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:00.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.461+0000 7f4431bb8640 1 --2- 172.21.15.2:0/1688966451 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f442c102790 0x7f442c198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:00.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.461+0000 7f4431bb8640 1 --2- 172.21.15.2:0/1688966451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f442c101de0 0x7f442c198320 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:00.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.461+0000 7f4431bb8640 1 -- 172.21.15.2:0/1688966451 >> 172.21.15.2:0/1688966451 conn(0x7f442c0fd8c0 msgr2=0x7f442c0fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:00.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.462+0000 7f4431bb8640 1 -- 172.21.15.2:0/1688966451 shutdown_connections 2024-09-19T06:14:00.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:00.462+0000 7f4431bb8640 1 -- 172.21.15.2:0/1688966451 wait complete. 2024-09-19T06:14:01.082 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738444 got 34359738446 for osd.0 2024-09-19T06:14:01.082 DEBUG:teuthology.parallel:result is None 2024-09-19T06:14:01.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:00 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1688966451' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T06:14:01.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:00 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1688966451' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T06:14:01.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:00 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1688966451' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T06:14:01.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.335+0000 7f1d0a169640 1 -- 172.21.15.2:0/2277519895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d04102570 msgr2=0x7f1d041029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:01.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.335+0000 7f1d0a169640 1 --2- 172.21.15.2:0/2277519895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d04102570 0x7f1d041029b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8009900 tx=0x7f1cf802a480 comp rx=0 tx=0).stop 2024-09-19T06:14:01.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.335+0000 7f1d0a169640 1 -- 172.21.15.2:0/2277519895 shutdown_connections 2024-09-19T06:14:01.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.335+0000 7f1d0a169640 1 --2- 172.21.15.2:0/2277519895 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d04102ef0 0x7f1d0410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:01.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.335+0000 7f1d0a169640 1 --2- 172.21.15.2:0/2277519895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d04102570 0x7f1d041029b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:01.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.335+0000 7f1d0a169640 1 --2- 172.21.15.2:0/2277519895 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d04100e20 0x7f1d04101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:01.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.335+0000 7f1d0a169640 1 -- 172.21.15.2:0/2277519895 >> 172.21.15.2:0/2277519895 conn(0x7f1d040fc7d0 msgr2=0x7f1d040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:01.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.335+0000 7f1d0a169640 1 -- 172.21.15.2:0/2277519895 shutdown_connections 2024-09-19T06:14:01.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.335+0000 7f1d0a169640 1 -- 172.21.15.2:0/2277519895 wait complete. 2024-09-19T06:14:01.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.336+0000 7f1d0a169640 1 Processor -- start 2024-09-19T06:14:01.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.336+0000 7f1d0a169640 1 -- start start 2024-09-19T06:14:01.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.336+0000 7f1d0a169640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d04100e20 0x7f1d040fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:01.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.336+0000 7f1d0a169640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d04102570 0x7f1d040fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:01.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.336+0000 7f1d0a169640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d04102ef0 0x7f1d040fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:01.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.336+0000 7f1d0a169640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1d04110ea0 con 0x7f1d04102570 2024-09-19T06:14:01.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.336+0000 7f1d0a169640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f1d04110d20 con 0x7f1d04102ef0 2024-09-19T06:14:01.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.336+0000 7f1d0a169640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1d04111020 con 0x7f1d04100e20 2024-09-19T06:14:01.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.337+0000 7f1d02ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d04102570 0x7f1d040fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:01.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.337+0000 7f1d02ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d04102570 0x7f1d040fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58394/0 (socket says 172.21.15.2:58394) 2024-09-19T06:14:01.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.337+0000 7f1d02ffd640 1 -- 172.21.15.2:0/3244890793 learned_addr learned my addr 172.21.15.2:0/3244890793 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:01.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.337+0000 7f1d037fe640 1 --2- 172.21.15.2:0/3244890793 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d04100e20 0x7f1d040fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:01.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.337+0000 7f1d03fff640 1 --2- 172.21.15.2:0/3244890793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d04102ef0 0x7f1d040fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:01.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.337+0000 7f1d02ffd640 1 -- 172.21.15.2:0/3244890793 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d04100e20 msgr2=0x7f1d040fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:01.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.337+0000 7f1d02ffd640 1 --2- 172.21.15.2:0/3244890793 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d04100e20 0x7f1d040fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:01.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.337+0000 7f1d02ffd640 1 -- 172.21.15.2:0/3244890793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d04102ef0 msgr2=0x7f1d040fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:01.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.337+0000 7f1d02ffd640 1 --2- 172.21.15.2:0/3244890793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d04102ef0 0x7f1d040fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:01.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.337+0000 7f1d02ffd640 1 -- 172.21.15.2:0/3244890793 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d041a6920 con 0x7f1d04102570 2024-09-19T06:14:01.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.337+0000 7f1d02ffd640 1 --2- 172.21.15.2:0/3244890793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d04102570 0x7f1d040fd1c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8006010 tx=0x7f1cf8003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:01.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.337+0000 7f1d00ff9640 1 -- 172.21.15.2:0/3244890793 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf803f070 con 0x7f1d04102570 2024-09-19T06:14:01.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.337+0000 7f1d0a169640 1 -- 172.21.15.2:0/3244890793 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d041a6bb0 con 0x7f1d04102570 2024-09-19T06:14:01.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.337+0000 7f1d00ff9640 1 -- 172.21.15.2:0/3244890793 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1cf803bd20 con 0x7f1d04102570 2024-09-19T06:14:01.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.337+0000 7f1d00ff9640 1 -- 172.21.15.2:0/3244890793 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf8035030 con 0x7f1d04102570 2024-09-19T06:14:01.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.337+0000 7f1d0a169640 1 -- 172.21.15.2:0/3244890793 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d041a70e0 con 0x7f1d04102570 2024-09-19T06:14:01.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.339+0000 7f1d0a169640 1 -- 172.21.15.2:0/3244890793 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d04101200 con 0x7f1d04102570 2024-09-19T06:14:01.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.340+0000 7f1d00ff9640 1 -- 172.21.15.2:0/3244890793 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f1cf8042070 con 0x7f1d04102570 2024-09-19T06:14:01.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.340+0000 7f1d00ff9640 1 --2- 172.21.15.2:0/3244890793 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f1cec0a32d0 0x7f1cec0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:01.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.341+0000 7f1d037fe640 1 --2- 172.21.15.2:0/3244890793 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f1cec0a32d0 0x7f1cec0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:01.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.341+0000 7f1d00ff9640 1 -- 172.21.15.2:0/3244890793 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f1cf80f0090 con 0x7f1d04102570 2024-09-19T06:14:01.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.341+0000 7f1d037fe640 1 --2- 172.21.15.2:0/3244890793 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f1cec0a32d0 0x7f1cec0a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1cf400abe0 tx=0x7f1cf400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:01.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.345+0000 7f1d00ff9640 1 -- 172.21.15.2:0/3244890793 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1cf80bcc60 con 0x7f1d04102570 2024-09-19T06:14:01.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.504+0000 7f7184057640 1 -- 172.21.15.2:0/3165235810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f717c1011e0 msgr2=0x7f717c105980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:01.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.504+0000 7f7184057640 1 --2- 172.21.15.2:0/3165235810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f717c1011e0 0x7f717c105980 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f716c009900 tx=0x7f716c02a410 comp rx=0 tx=0).stop 2024-09-19T06:14:01.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.504+0000 7f7184057640 1 -- 172.21.15.2:0/3165235810 shutdown_connections 2024-09-19T06:14:01.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.504+0000 7f7184057640 1 --2- 172.21.15.2:0/3165235810 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f717c105ec0 0x7f717c106340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:01.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.504+0000 7f7184057640 1 --2- 172.21.15.2:0/3165235810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f717c1011e0 0x7f717c105980 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:01.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.504+0000 7f7184057640 1 --2- 172.21.15.2:0/3165235810 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f717c1008c0 0x7f717c100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:01.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.505+0000 7f7184057640 1 -- 172.21.15.2:0/3165235810 >> 172.21.15.2:0/3165235810 conn(0x7f717c0fc7d0 msgr2=0x7f717c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:01.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.505+0000 7f7184057640 1 -- 172.21.15.2:0/3165235810 shutdown_connections 2024-09-19T06:14:01.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.505+0000 7f7184057640 1 -- 172.21.15.2:0/3165235810 wait complete. 2024-09-19T06:14:01.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.505+0000 7f7184057640 1 Processor -- start 2024-09-19T06:14:01.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.506+0000 7f7184057640 1 -- start start 2024-09-19T06:14:01.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.506+0000 7f7184057640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f717c1008c0 0x7f717c1a4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:01.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.506+0000 7f7184057640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f717c1011e0 0x7f717c1a4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:01.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.506+0000 7f7184057640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f717c105ec0 0x7f717c19e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:01.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.506+0000 7f7184057640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f717c1184e0 con 0x7f717c1008c0 2024-09-19T06:14:01.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.506+0000 7f7184057640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f717c118360 con 0x7f717c105ec0 2024-09-19T06:14:01.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.506+0000 7f7184057640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f717c118660 con 0x7f717c1011e0 2024-09-19T06:14:01.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.506+0000 7f7181df3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f717c1008c0 0x7f717c1a4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:01.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.506+0000 7f7181df3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f717c1008c0 0x7f717c1a4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58400/0 (socket says 172.21.15.2:58400) 2024-09-19T06:14:01.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.506+0000 7f7181df3640 1 -- 172.21.15.2:0/1131930757 learned_addr learned my addr 172.21.15.2:0/1131930757 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:01.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.506+0000 7f71815f2640 1 --2- 172.21.15.2:0/1131930757 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f717c1011e0 0x7f717c1a4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:01.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.506+0000 7f71825f4640 1 --2- 172.21.15.2:0/1131930757 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f717c105ec0 0x7f717c19e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:01.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.506+0000 7f7181df3640 1 -- 172.21.15.2:0/1131930757 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f717c1011e0 msgr2=0x7f717c1a4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:01.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.507+0000 7f7181df3640 1 --2- 172.21.15.2:0/1131930757 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f717c1011e0 0x7f717c1a4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:01.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.507+0000 7f7181df3640 1 -- 172.21.15.2:0/1131930757 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f717c105ec0 msgr2=0x7f717c19e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:01.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.507+0000 7f7181df3640 1 --2- 172.21.15.2:0/1131930757 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f717c105ec0 0x7f717c19e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:01.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.507+0000 7f7181df3640 1 -- 172.21.15.2:0/1131930757 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f717c19f060 con 0x7f717c1008c0 2024-09-19T06:14:01.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.507+0000 7f71815f2640 1 --2- 172.21.15.2:0/1131930757 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f717c1011e0 0x7f717c1a4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:01.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.507+0000 7f7181df3640 1 --2- 172.21.15.2:0/1131930757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f717c1008c0 0x7f717c1a4770 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f717800d770 tx=0x7f717800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:01.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.507+0000 7f7172ffd640 1 -- 172.21.15.2:0/1131930757 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7178017070 con 0x7f717c1008c0 2024-09-19T06:14:01.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.507+0000 7f7172ffd640 1 -- 172.21.15.2:0/1131930757 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f71780054d0 con 0x7f717c1008c0 2024-09-19T06:14:01.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.507+0000 7f7184057640 1 -- 172.21.15.2:0/1131930757 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f717c19f350 con 0x7f717c1008c0 2024-09-19T06:14:01.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.507+0000 7f7172ffd640 1 -- 172.21.15.2:0/1131930757 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7178004cf0 con 0x7f717c1008c0 2024-09-19T06:14:01.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.507+0000 7f7184057640 1 -- 172.21.15.2:0/1131930757 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f717c1ab640 con 0x7f717c1008c0 2024-09-19T06:14:01.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.508+0000 7f7184057640 1 -- 172.21.15.2:0/1131930757 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f717c06a850 con 0x7f717c1008c0 2024-09-19T06:14:01.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.510+0000 7f7172ffd640 1 -- 172.21.15.2:0/1131930757 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f7178004e90 con 0x7f717c1008c0 2024-09-19T06:14:01.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.510+0000 7f7172ffd640 1 --2- 172.21.15.2:0/1131930757 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f71680a32d0 0x7f71680a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:01.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.511+0000 7f71815f2640 1 --2- 172.21.15.2:0/1131930757 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f71680a32d0 0x7f71680a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:01.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.511+0000 7f7172ffd640 1 -- 172.21.15.2:0/1131930757 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f71780cf8a0 con 0x7f717c1008c0 2024-09-19T06:14:01.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.511+0000 7f71815f2640 1 --2- 172.21.15.2:0/1131930757 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f71680a32d0 0x7f71680a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f716c009230 tx=0x7f716c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:01.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.518+0000 7f7172ffd640 1 -- 172.21.15.2:0/1131930757 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f717809be20 con 0x7f717c1008c0 2024-09-19T06:14:01.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.528+0000 7f1d0a169640 1 -- 172.21.15.2:0/3244890793 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f1d0410a0a0 con 0x7f1d04102570 2024-09-19T06:14:01.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.528+0000 7f1d00ff9640 1 -- 172.21.15.2:0/3244890793 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f1cf80bc560 con 0x7f1d04102570 2024-09-19T06:14:01.530 INFO:teuthology.orchestra.run.smithi002.stdout:231928234024 2024-09-19T06:14:01.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.530+0000 7f1d0a169640 1 -- 172.21.15.2:0/3244890793 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f1cec0a32d0 msgr2=0x7f1cec0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:01.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.530+0000 7f1d0a169640 1 --2- 172.21.15.2:0/3244890793 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f1cec0a32d0 0x7f1cec0a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1cf400abe0 tx=0x7f1cf400a2d0 comp rx=0 tx=0).stop 2024-09-19T06:14:01.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.530+0000 7f1d0a169640 1 -- 172.21.15.2:0/3244890793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d04102570 msgr2=0x7f1d040fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:01.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.530+0000 7f1d0a169640 1 --2- 172.21.15.2:0/3244890793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d04102570 0x7f1d040fd1c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8006010 tx=0x7f1cf8003d50 comp rx=0 tx=0).stop 2024-09-19T06:14:01.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.530+0000 7f1d0a169640 1 -- 172.21.15.2:0/3244890793 shutdown_connections 2024-09-19T06:14:01.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.530+0000 7f1d0a169640 1 --2- 172.21.15.2:0/3244890793 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f1cec0a32d0 0x7f1cec0a5790 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:01.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.530+0000 7f1d0a169640 1 --2- 172.21.15.2:0/3244890793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d04102ef0 0x7f1d040fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:01.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.530+0000 7f1d0a169640 1 --2- 172.21.15.2:0/3244890793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d04102570 0x7f1d040fd1c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:01.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.530+0000 7f1d0a169640 1 --2- 172.21.15.2:0/3244890793 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d04100e20 0x7f1d040fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:01.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.530+0000 7f1d0a169640 1 -- 172.21.15.2:0/3244890793 >> 172.21.15.2:0/3244890793 conn(0x7f1d040fc7d0 msgr2=0x7f1d0406a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:01.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.531+0000 7f1d0a169640 1 -- 172.21.15.2:0/3244890793 shutdown_connections 2024-09-19T06:14:01.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.531+0000 7f1d0a169640 1 -- 172.21.15.2:0/3244890793 wait complete. 2024-09-19T06:14:01.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.708+0000 7f7184057640 1 -- 172.21.15.2:0/1131930757 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f717c105980 con 0x7f717c1008c0 2024-09-19T06:14:01.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.708+0000 7f7172ffd640 1 -- 172.21.15.2:0/1131930757 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f71780a0120 con 0x7f717c1008c0 2024-09-19T06:14:01.710 INFO:teuthology.orchestra.run.smithi002.stdout:103079215169 2024-09-19T06:14:01.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.710+0000 7f7184057640 1 -- 172.21.15.2:0/1131930757 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f71680a32d0 msgr2=0x7f71680a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:01.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.710+0000 7f7184057640 1 --2- 172.21.15.2:0/1131930757 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f71680a32d0 0x7f71680a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f716c009230 tx=0x7f716c0058d0 comp rx=0 tx=0).stop 2024-09-19T06:14:01.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.710+0000 7f7184057640 1 -- 172.21.15.2:0/1131930757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f717c1008c0 msgr2=0x7f717c1a4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:01.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.710+0000 7f7184057640 1 --2- 172.21.15.2:0/1131930757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f717c1008c0 0x7f717c1a4770 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f717800d770 tx=0x7f717800dc30 comp rx=0 tx=0).stop 2024-09-19T06:14:01.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.710+0000 7f7184057640 1 -- 172.21.15.2:0/1131930757 shutdown_connections 2024-09-19T06:14:01.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.710+0000 7f7184057640 1 --2- 172.21.15.2:0/1131930757 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f71680a32d0 0x7f71680a5790 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:01.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.710+0000 7f7184057640 1 --2- 172.21.15.2:0/1131930757 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f717c105ec0 0x7f717c19e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:01.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.710+0000 7f7184057640 1 --2- 172.21.15.2:0/1131930757 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f717c1011e0 0x7f717c1a4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:01.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.710+0000 7f7184057640 1 --2- 172.21.15.2:0/1131930757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f717c1008c0 0x7f717c1a4770 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:01.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.710+0000 7f7184057640 1 -- 172.21.15.2:0/1131930757 >> 172.21.15.2:0/1131930757 conn(0x7f717c0fc7d0 msgr2=0x7f717c0fda40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:01.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.710+0000 7f7184057640 1 -- 172.21.15.2:0/1131930757 shutdown_connections 2024-09-19T06:14:01.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:01.710+0000 7f7184057640 1 -- 172.21.15.2:0/1131930757 wait complete. 2024-09-19T06:14:02.162 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:01 smithi002 ceph-mon[30982]: pgmap v305: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-19T06:14:02.163 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:01 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/3244890793' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T06:14:02.163 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:01 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1131930757' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T06:14:02.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:01 smithi090 ceph-mon[34497]: pgmap v305: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-19T06:14:02.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:01 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/3244890793' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T06:14:02.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:01 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1131930757' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T06:14:02.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:01 smithi089 ceph-mon[34160]: pgmap v305: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-19T06:14:02.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:01 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/3244890793' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T06:14:02.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:01 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1131930757' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T06:14:02.777 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215166 got 103079215169 for osd.3 2024-09-19T06:14:02.777 DEBUG:teuthology.parallel:result is None 2024-09-19T06:14:03.143 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:02 smithi002 ceph-mon[30982]: pgmap v306: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:03.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:02 smithi090 ceph-mon[34497]: pgmap v306: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:03.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.231+0000 7ffbf4650640 1 -- 172.21.15.2:0/3819514176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbec106f10 msgr2=0x7ffbec10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:03.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.231+0000 7ffbf4650640 1 --2- 172.21.15.2:0/3819514176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbec106f10 0x7ffbec10ea90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ffbe4009ca0 tx=0x7ffbe402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:14:03.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.232+0000 7ffbf4650640 1 -- 172.21.15.2:0/3819514176 shutdown_connections 2024-09-19T06:14:03.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.232+0000 7ffbf4650640 1 --2- 172.21.15.2:0/3819514176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbec106f10 0x7ffbec10ea90 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:03.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.232+0000 7ffbf4650640 1 --2- 172.21.15.2:0/3819514176 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbec102790 0x7ffbec1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:03.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.232+0000 7ffbf4650640 1 --2- 172.21.15.2:0/3819514176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffbec101de0 0x7ffbec1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:03.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.232+0000 7ffbf4650640 1 -- 172.21.15.2:0/3819514176 >> 172.21.15.2:0/3819514176 conn(0x7ffbec0fd8c0 msgr2=0x7ffbec0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:03.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.232+0000 7ffbf4650640 1 -- 172.21.15.2:0/3819514176 shutdown_connections 2024-09-19T06:14:03.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.232+0000 7ffbf4650640 1 -- 172.21.15.2:0/3819514176 wait complete. 2024-09-19T06:14:03.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.233+0000 7ffbf4650640 1 Processor -- start 2024-09-19T06:14:03.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.233+0000 7ffbf4650640 1 -- start start 2024-09-19T06:14:03.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.233+0000 7ffbf4650640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbec101de0 0x7ffbec198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:03.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.233+0000 7ffbf4650640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffbec102790 0x7ffbec1987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:03.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.233+0000 7ffbf4650640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbec106f10 0x7ffbec19cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:03.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.233+0000 7ffbf4650640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ffbec111e20 con 0x7ffbec101de0 2024-09-19T06:14:03.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.233+0000 7ffbf4650640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ffbec111ca0 con 0x7ffbec102790 2024-09-19T06:14:03.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.233+0000 7ffbf4650640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ffbec111fa0 con 0x7ffbec106f10 2024-09-19T06:14:03.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.233+0000 7ffbf23ec640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbec101de0 0x7ffbec198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:03.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.233+0000 7ffbf23ec640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbec101de0 0x7ffbec198260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58420/0 (socket says 172.21.15.2:58420) 2024-09-19T06:14:03.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.233+0000 7ffbf23ec640 1 -- 172.21.15.2:0/538797247 learned_addr learned my addr 172.21.15.2:0/538797247 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:03.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.233+0000 7ffbf1beb640 1 --2- 172.21.15.2:0/538797247 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffbec102790 0x7ffbec1987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:03.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.233+0000 7ffbf2bed640 1 --2- 172.21.15.2:0/538797247 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbec106f10 0x7ffbec19cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:03.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.233+0000 7ffbf23ec640 1 -- 172.21.15.2:0/538797247 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbec106f10 msgr2=0x7ffbec19cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:03.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.233+0000 7ffbf23ec640 1 --2- 172.21.15.2:0/538797247 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbec106f10 0x7ffbec19cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:03.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.233+0000 7ffbf23ec640 1 -- 172.21.15.2:0/538797247 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffbec102790 msgr2=0x7ffbec1987a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:03.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.233+0000 7ffbf23ec640 1 --2- 172.21.15.2:0/538797247 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffbec102790 0x7ffbec1987a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:03.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.233+0000 7ffbf23ec640 1 -- 172.21.15.2:0/538797247 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbec19d210 con 0x7ffbec101de0 2024-09-19T06:14:03.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.233+0000 7ffbf2bed640 1 --2- 172.21.15.2:0/538797247 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbec106f10 0x7ffbec19cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:14:03.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.234+0000 7ffbf23ec640 1 --2- 172.21.15.2:0/538797247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbec101de0 0x7ffbec198260 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ffbe800d950 tx=0x7ffbe800dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:03.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.234+0000 7ffbe37fe640 1 -- 172.21.15.2:0/538797247 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe8017070 con 0x7ffbec101de0 2024-09-19T06:14:03.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.234+0000 7ffbe37fe640 1 -- 172.21.15.2:0/538797247 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffbe800de80 con 0x7ffbec101de0 2024-09-19T06:14:03.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.234+0000 7ffbf4650640 1 -- 172.21.15.2:0/538797247 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbec19d500 con 0x7ffbec101de0 2024-09-19T06:14:03.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.234+0000 7ffbe37fe640 1 -- 172.21.15.2:0/538797247 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe800f620 con 0x7ffbec101de0 2024-09-19T06:14:03.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.234+0000 7ffbf4650640 1 -- 172.21.15.2:0/538797247 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbec1a4de0 con 0x7ffbec101de0 2024-09-19T06:14:03.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.235+0000 7ffbf4650640 1 -- 172.21.15.2:0/538797247 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbec1021c0 con 0x7ffbec101de0 2024-09-19T06:14:03.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.236+0000 7ffbe37fe640 1 -- 172.21.15.2:0/538797247 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7ffbe8009c30 con 0x7ffbec101de0 2024-09-19T06:14:03.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.237+0000 7ffbe37fe640 1 --2- 172.21.15.2:0/538797247 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7ffbd80a32d0 0x7ffbd80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:03.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.237+0000 7ffbf1beb640 1 --2- 172.21.15.2:0/538797247 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7ffbd80a32d0 0x7ffbd80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:03.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.237+0000 7ffbe37fe640 1 -- 172.21.15.2:0/538797247 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7ffbe80cf720 con 0x7ffbec101de0 2024-09-19T06:14:03.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.237+0000 7ffbf1beb640 1 --2- 172.21.15.2:0/538797247 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7ffbd80a32d0 0x7ffbd80a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ffbec1088e0 tx=0x7ffbdc00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:03.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.240+0000 7ffbe37fe640 1 -- 172.21.15.2:0/538797247 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ffbe809c290 con 0x7ffbec101de0 2024-09-19T06:14:03.262 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:03.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:02 smithi089 ceph-mon[34160]: pgmap v306: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:03.417 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593775 got 184683593777 for osd.6 2024-09-19T06:14:03.417 DEBUG:teuthology.parallel:result is None 2024-09-19T06:14:03.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.421+0000 7ffbf4650640 1 -- 172.21.15.2:0/538797247 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7ffbec1995c0 con 0x7ffbec101de0 2024-09-19T06:14:03.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.421+0000 7ffbe37fe640 1 -- 172.21.15.2:0/538797247 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7ffbe809bb90 con 0x7ffbec101de0 2024-09-19T06:14:03.423 INFO:teuthology.orchestra.run.smithi002.stdout:313532612632 2024-09-19T06:14:03.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.423+0000 7ffbf4650640 1 -- 172.21.15.2:0/538797247 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7ffbd80a32d0 msgr2=0x7ffbd80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:03.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.423+0000 7ffbf4650640 1 --2- 172.21.15.2:0/538797247 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7ffbd80a32d0 0x7ffbd80a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ffbec1088e0 tx=0x7ffbdc00a2d0 comp rx=0 tx=0).stop 2024-09-19T06:14:03.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.423+0000 7ffbf4650640 1 -- 172.21.15.2:0/538797247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbec101de0 msgr2=0x7ffbec198260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:03.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.423+0000 7ffbf4650640 1 --2- 172.21.15.2:0/538797247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbec101de0 0x7ffbec198260 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ffbe800d950 tx=0x7ffbe800dd50 comp rx=0 tx=0).stop 2024-09-19T06:14:03.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.423+0000 7ffbf4650640 1 -- 172.21.15.2:0/538797247 shutdown_connections 2024-09-19T06:14:03.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.423+0000 7ffbf4650640 1 --2- 172.21.15.2:0/538797247 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7ffbd80a32d0 0x7ffbd80a5790 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:03.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.423+0000 7ffbf4650640 1 --2- 172.21.15.2:0/538797247 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbec106f10 0x7ffbec19cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.423+0000 7ffbf4650640 1 --2- 172.21.15.2:0/538797247 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffbec102790 0x7ffbec1987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.423+0000 7ffbf4650640 1 --2- 172.21.15.2:0/538797247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbec101de0 0x7ffbec198260 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.423+0000 7ffbf4650640 1 -- 172.21.15.2:0/538797247 >> 172.21.15.2:0/538797247 conn(0x7ffbec0fd8c0 msgr2=0x7ffbec0fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.423+0000 7ffbf4650640 1 -- 172.21.15.2:0/538797247 shutdown_connections 2024-09-19T06:14:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:03.424+0000 7ffbf4650640 1 -- 172.21.15.2:0/538797247 wait complete. 2024-09-19T06:14:04.128 INFO:tasks.cephadm.ceph_manager.ceph:need seq 231928234021 got 231928234024 for osd.8 2024-09-19T06:14:04.128 DEBUG:teuthology.parallel:result is None 2024-09-19T06:14:04.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:03 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/538797247' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T06:14:04.284 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:03 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/538797247' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T06:14:04.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:03 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/538797247' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T06:14:04.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.291+0000 7f71eb4ea640 1 -- 172.21.15.2:0/3815244212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71e4100620 msgr2=0x7f71e410ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:04.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.291+0000 7f71eb4ea640 1 --2- 172.21.15.2:0/3815244212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71e4100620 0x7f71e410ea40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f71dc009cd0 tx=0x7f71dc02a970 comp rx=0 tx=0).stop 2024-09-19T06:14:04.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.291+0000 7f71eb4ea640 1 -- 172.21.15.2:0/3815244212 shutdown_connections 2024-09-19T06:14:04.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.291+0000 7f71eb4ea640 1 --2- 172.21.15.2:0/3815244212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71e4100620 0x7f71e410ea40 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.291+0000 7f71eb4ea640 1 --2- 172.21.15.2:0/3815244212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71e40ffc60 0x7f71e41000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.291+0000 7f71eb4ea640 1 --2- 172.21.15.2:0/3815244212 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71e4106be0 0x7f71e4106fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.291+0000 7f71eb4ea640 1 -- 172.21.15.2:0/3815244212 >> 172.21.15.2:0/3815244212 conn(0x7f71e40fba90 msgr2=0x7f71e40fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:04.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.292+0000 7f71eb4ea640 1 -- 172.21.15.2:0/3815244212 shutdown_connections 2024-09-19T06:14:04.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.292+0000 7f71eb4ea640 1 -- 172.21.15.2:0/3815244212 wait complete. 2024-09-19T06:14:04.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.292+0000 7f71eb4ea640 1 Processor -- start 2024-09-19T06:14:04.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.292+0000 7f71eb4ea640 1 -- start start 2024-09-19T06:14:04.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.292+0000 7f71eb4ea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71e40ffc60 0x7f71e419a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:04.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.292+0000 7f71eb4ea640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71e4100620 0x7f71e419a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:04.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.292+0000 7f71eb4ea640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71e4106be0 0x7f71e419ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:04.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.292+0000 7f71eb4ea640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f71e4111de0 con 0x7f71e40ffc60 2024-09-19T06:14:04.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.292+0000 7f71eb4ea640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f71e4111c60 con 0x7f71e4106be0 2024-09-19T06:14:04.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.292+0000 7f71eb4ea640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f71e4111f60 con 0x7f71e4100620 2024-09-19T06:14:04.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.293+0000 7f71e9286640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71e40ffc60 0x7f71e419a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:04.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.293+0000 7f71e9286640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71e40ffc60 0x7f71e419a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58448/0 (socket says 172.21.15.2:58448) 2024-09-19T06:14:04.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.293+0000 7f71e9286640 1 -- 172.21.15.2:0/1908039055 learned_addr learned my addr 172.21.15.2:0/1908039055 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:04.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.293+0000 7f71e8a85640 1 --2- 172.21.15.2:0/1908039055 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71e4100620 0x7f71e419a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:04.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.293+0000 7f71e9a87640 1 --2- 172.21.15.2:0/1908039055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71e4106be0 0x7f71e419ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:04.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.293+0000 7f71e9286640 1 -- 172.21.15.2:0/1908039055 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71e4100620 msgr2=0x7f71e419a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:04.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.293+0000 7f71e9286640 1 --2- 172.21.15.2:0/1908039055 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71e4100620 0x7f71e419a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.293+0000 7f71e9286640 1 -- 172.21.15.2:0/1908039055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71e4106be0 msgr2=0x7f71e419ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:04.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.293+0000 7f71e9286640 1 --2- 172.21.15.2:0/1908039055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71e4106be0 0x7f71e419ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.293+0000 7f71e9286640 1 -- 172.21.15.2:0/1908039055 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71e419f420 con 0x7f71e40ffc60 2024-09-19T06:14:04.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.293+0000 7f71e9286640 1 --2- 172.21.15.2:0/1908039055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71e40ffc60 0x7f71e419a470 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f71e000c920 tx=0x7f71e000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:04.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.293+0000 7f71da7fc640 1 -- 172.21.15.2:0/1908039055 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e0007c70 con 0x7f71e40ffc60 2024-09-19T06:14:04.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.293+0000 7f71da7fc640 1 -- 172.21.15.2:0/1908039055 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f71e0007e10 con 0x7f71e40ffc60 2024-09-19T06:14:04.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.293+0000 7f71eb4ea640 1 -- 172.21.15.2:0/1908039055 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71e419f710 con 0x7f71e40ffc60 2024-09-19T06:14:04.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.293+0000 7f71da7fc640 1 -- 172.21.15.2:0/1908039055 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e0018820 con 0x7f71e40ffc60 2024-09-19T06:14:04.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.293+0000 7f71eb4ea640 1 -- 172.21.15.2:0/1908039055 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71e41a6ff0 con 0x7f71e40ffc60 2024-09-19T06:14:04.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.294+0000 7f71eb4ea640 1 -- 172.21.15.2:0/1908039055 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71e41000e0 con 0x7f71e40ffc60 2024-09-19T06:14:04.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.296+0000 7f71da7fc640 1 -- 172.21.15.2:0/1908039055 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f71e00189c0 con 0x7f71e40ffc60 2024-09-19T06:14:04.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.297+0000 7f71da7fc640 1 --2- 172.21.15.2:0/1908039055 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f71d00a3350 0x7f71d00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:04.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.297+0000 7f71e8a85640 1 --2- 172.21.15.2:0/1908039055 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f71d00a3350 0x7f71d00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:04.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.297+0000 7f71da7fc640 1 -- 172.21.15.2:0/1908039055 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f71e00cfd30 con 0x7f71e40ffc60 2024-09-19T06:14:04.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.298+0000 7f71e8a85640 1 --2- 172.21.15.2:0/1908039055 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f71d00a3350 0x7f71d00a5810 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f71e40fe4d0 tx=0x7f71d400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:04.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.300+0000 7f71da7fc640 1 -- 172.21.15.2:0/1908039055 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f71e0014030 con 0x7f71e40ffc60 2024-09-19T06:14:04.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.482+0000 7f71eb4ea640 1 -- 172.21.15.2:0/1908039055 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f71e419b7d0 con 0x7f71e40ffc60 2024-09-19T06:14:04.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.482+0000 7f71da7fc640 1 -- 172.21.15.2:0/1908039055 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f71e009ca10 con 0x7f71e40ffc60 2024-09-19T06:14:04.484 INFO:teuthology.orchestra.run.smithi002.stdout:283467841565 2024-09-19T06:14:04.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.484+0000 7f71eb4ea640 1 -- 172.21.15.2:0/1908039055 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f71d00a3350 msgr2=0x7f71d00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:04.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.484+0000 7f71eb4ea640 1 --2- 172.21.15.2:0/1908039055 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f71d00a3350 0x7f71d00a5810 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f71e40fe4d0 tx=0x7f71d400b390 comp rx=0 tx=0).stop 2024-09-19T06:14:04.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.484+0000 7f71eb4ea640 1 -- 172.21.15.2:0/1908039055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71e40ffc60 msgr2=0x7f71e419a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:04.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.484+0000 7f71eb4ea640 1 --2- 172.21.15.2:0/1908039055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71e40ffc60 0x7f71e419a470 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f71e000c920 tx=0x7f71e000cde0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.484+0000 7f71eb4ea640 1 -- 172.21.15.2:0/1908039055 shutdown_connections 2024-09-19T06:14:04.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.484+0000 7f71eb4ea640 1 --2- 172.21.15.2:0/1908039055 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f71d00a3350 0x7f71d00a5810 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.484+0000 7f71eb4ea640 1 --2- 172.21.15.2:0/1908039055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71e4106be0 0x7f71e419ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.484+0000 7f71eb4ea640 1 --2- 172.21.15.2:0/1908039055 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71e4100620 0x7f71e419a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.484+0000 7f71eb4ea640 1 --2- 172.21.15.2:0/1908039055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71e40ffc60 0x7f71e419a470 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.484+0000 7f71eb4ea640 1 -- 172.21.15.2:0/1908039055 >> 172.21.15.2:0/1908039055 conn(0x7f71e40fba90 msgr2=0x7f71e40fd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:04.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.484+0000 7f71eb4ea640 1 -- 172.21.15.2:0/1908039055 shutdown_connections 2024-09-19T06:14:04.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:04.484+0000 7f71eb4ea640 1 -- 172.21.15.2:0/1908039055 wait complete. 2024-09-19T06:14:04.697 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822707 got 154618822709 for osd.5 2024-09-19T06:14:04.697 DEBUG:teuthology.parallel:result is None 2024-09-19T06:14:05.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:04 smithi090 ceph-mon[34497]: pgmap v307: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T06:14:05.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:04 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1908039055' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T06:14:05.242 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:04 smithi002 ceph-mon[30982]: pgmap v307: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T06:14:05.242 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:04 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1908039055' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T06:14:05.243 INFO:tasks.cephadm.ceph_manager.ceph:need seq 283467841562 got 283467841565 for osd.10 2024-09-19T06:14:05.244 DEBUG:teuthology.parallel:result is None 2024-09-19T06:14:05.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:04 smithi089 ceph-mon[34160]: pgmap v307: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T06:14:05.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:04 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1908039055' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T06:14:05.649 INFO:tasks.cephadm.ceph_manager.ceph:need seq 261993005087 got 261993005090 for osd.9 2024-09-19T06:14:05.649 DEBUG:teuthology.parallel:result is None 2024-09-19T06:14:06.310 INFO:tasks.cephadm.ceph_manager.ceph:need seq 313532612630 got 313532612632 for osd.11 2024-09-19T06:14:06.310 DEBUG:teuthology.parallel:result is None 2024-09-19T06:14:06.310 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T06:14:06.310 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T06:14:07.154 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:07.364 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:07 smithi002 ceph-mon[30982]: pgmap v308: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T06:14:07.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:07 smithi090 ceph-mon[34497]: pgmap v308: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T06:14:07.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:07 smithi089 ceph-mon[34160]: pgmap v308: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T06:14:07.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.578+0000 7f2d3d626640 1 -- 172.21.15.2:0/3741103471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d38103740 msgr2=0x7f2d38107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:07.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.578+0000 7f2d3d626640 1 --2- 172.21.15.2:0/3741103471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d38103740 0x7f2d38107b80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c009930 tx=0x7f2d2c02a420 comp rx=0 tx=0).stop 2024-09-19T06:14:07.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.578+0000 7f2d3d626640 1 -- 172.21.15.2:0/3741103471 shutdown_connections 2024-09-19T06:14:07.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.578+0000 7f2d3d626640 1 --2- 172.21.15.2:0/3741103471 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d38108290 0x7f2d3810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:07.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.578+0000 7f2d3d626640 1 --2- 172.21.15.2:0/3741103471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d38103740 0x7f2d38107b80 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:07.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.578+0000 7f2d3d626640 1 --2- 172.21.15.2:0/3741103471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d38102d90 0x7f2d38103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:07.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.578+0000 7f2d3d626640 1 -- 172.21.15.2:0/3741103471 >> 172.21.15.2:0/3741103471 conn(0x7f2d380fc7d0 msgr2=0x7f2d380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:07.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.578+0000 7f2d3d626640 1 -- 172.21.15.2:0/3741103471 shutdown_connections 2024-09-19T06:14:07.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.578+0000 7f2d3d626640 1 -- 172.21.15.2:0/3741103471 wait complete. 2024-09-19T06:14:07.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.578+0000 7f2d3d626640 1 Processor -- start 2024-09-19T06:14:07.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.579+0000 7f2d3d626640 1 -- start start 2024-09-19T06:14:07.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.579+0000 7f2d3d626640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d38102d90 0x7f2d38198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:07.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.579+0000 7f2d3d626640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d38103740 0x7f2d38198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:07.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.579+0000 7f2d3d626640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d38108290 0x7f2d3819ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:07.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.579+0000 7f2d3d626640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2d38111f60 con 0x7f2d38108290 2024-09-19T06:14:07.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.579+0000 7f2d3d626640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2d38111de0 con 0x7f2d38102d90 2024-09-19T06:14:07.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.579+0000 7f2d3d626640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2d381120e0 con 0x7f2d38103740 2024-09-19T06:14:07.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.579+0000 7f2d377fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d38108290 0x7f2d3819ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:07.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.579+0000 7f2d377fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d38108290 0x7f2d3819ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42060/0 (socket says 172.21.15.2:42060) 2024-09-19T06:14:07.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.579+0000 7f2d377fe640 1 -- 172.21.15.2:0/2798377741 learned_addr learned my addr 172.21.15.2:0/2798377741 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:07.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.579+0000 7f2d367fc640 1 --2- 172.21.15.2:0/2798377741 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d38103740 0x7f2d38198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:07.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.579+0000 7f2d36ffd640 1 --2- 172.21.15.2:0/2798377741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d38102d90 0x7f2d38198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:07.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.579+0000 7f2d377fe640 1 -- 172.21.15.2:0/2798377741 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d38103740 msgr2=0x7f2d38198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:07.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.579+0000 7f2d377fe640 1 --2- 172.21.15.2:0/2798377741 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d38103740 0x7f2d38198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:07.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.579+0000 7f2d377fe640 1 -- 172.21.15.2:0/2798377741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d38102d90 msgr2=0x7f2d38198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:07.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.579+0000 7f2d377fe640 1 --2- 172.21.15.2:0/2798377741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d38102d90 0x7f2d38198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:07.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.579+0000 7f2d377fe640 1 -- 172.21.15.2:0/2798377741 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d3819d530 con 0x7f2d38108290 2024-09-19T06:14:07.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.579+0000 7f2d377fe640 1 --2- 172.21.15.2:0/2798377741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d38108290 0x7f2d3819ce50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2d3000cad0 tx=0x7f2d3000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:07.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.580+0000 7f2d1ffff640 1 -- 172.21.15.2:0/2798377741 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d3000ae20 con 0x7f2d38108290 2024-09-19T06:14:07.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.580+0000 7f2d3d626640 1 -- 172.21.15.2:0/2798377741 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d3819d820 con 0x7f2d38108290 2024-09-19T06:14:07.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.580+0000 7f2d1ffff640 1 -- 172.21.15.2:0/2798377741 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2d30005020 con 0x7f2d38108290 2024-09-19T06:14:07.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.580+0000 7f2d1ffff640 1 -- 172.21.15.2:0/2798377741 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d3000f6b0 con 0x7f2d38108290 2024-09-19T06:14:07.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.580+0000 7f2d3d626640 1 -- 172.21.15.2:0/2798377741 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d381a5100 con 0x7f2d38108290 2024-09-19T06:14:07.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.581+0000 7f2d3d626640 1 -- 172.21.15.2:0/2798377741 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d3806a7f0 con 0x7f2d38108290 2024-09-19T06:14:07.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.582+0000 7f2d1ffff640 1 -- 172.21.15.2:0/2798377741 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f2d300051d0 con 0x7f2d38108290 2024-09-19T06:14:07.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.583+0000 7f2d1ffff640 1 --2- 172.21.15.2:0/2798377741 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f2d200a32d0 0x7f2d200a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:07.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.583+0000 7f2d36ffd640 1 --2- 172.21.15.2:0/2798377741 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f2d200a32d0 0x7f2d200a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:07.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.583+0000 7f2d1ffff640 1 -- 172.21.15.2:0/2798377741 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f2d300cfff0 con 0x7f2d38108290 2024-09-19T06:14:07.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.583+0000 7f2d36ffd640 1 --2- 172.21.15.2:0/2798377741 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f2d200a32d0 0x7f2d200a5790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2d28009890 tx=0x7f2d28008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:07.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.586+0000 7f2d1ffff640 1 -- 172.21.15.2:0/2798377741 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2d30014030 con 0x7f2d38108290 2024-09-19T06:14:07.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.775+0000 7f2d3d626640 1 -- 172.21.15.2:0/2798377741 --> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2d38062630 con 0x7f2d200a32d0 2024-09-19T06:14:07.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.787+0000 7f2d1ffff640 1 -- 172.21.15.2:0/2798377741 <== mgr.14150 v2:172.21.15.2:6800/4180340554 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258704 (secure 0 0 0) 0x7f2d38062630 con 0x7f2d200a32d0 2024-09-19T06:14:07.791 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:14:07.792 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-19T06:14:07.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.791+0000 7f2d3d626640 1 -- 172.21.15.2:0/2798377741 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f2d200a32d0 msgr2=0x7f2d200a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:07.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.791+0000 7f2d3d626640 1 --2- 172.21.15.2:0/2798377741 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f2d200a32d0 0x7f2d200a5790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2d28009890 tx=0x7f2d28008040 comp rx=0 tx=0).stop 2024-09-19T06:14:07.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.791+0000 7f2d3d626640 1 -- 172.21.15.2:0/2798377741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d38108290 msgr2=0x7f2d3819ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:07.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.791+0000 7f2d3d626640 1 --2- 172.21.15.2:0/2798377741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d38108290 0x7f2d3819ce50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2d3000cad0 tx=0x7f2d3000cf90 comp rx=0 tx=0).stop 2024-09-19T06:14:07.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.791+0000 7f2d3d626640 1 -- 172.21.15.2:0/2798377741 shutdown_connections 2024-09-19T06:14:07.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.791+0000 7f2d3d626640 1 --2- 172.21.15.2:0/2798377741 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f2d200a32d0 0x7f2d200a5790 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:07.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.791+0000 7f2d3d626640 1 --2- 172.21.15.2:0/2798377741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d38108290 0x7f2d3819ce50 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:07.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.791+0000 7f2d3d626640 1 --2- 172.21.15.2:0/2798377741 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d38103740 0x7f2d38198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:07.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.791+0000 7f2d3d626640 1 --2- 172.21.15.2:0/2798377741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d38102d90 0x7f2d38198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:07.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.791+0000 7f2d3d626640 1 -- 172.21.15.2:0/2798377741 >> 172.21.15.2:0/2798377741 conn(0x7f2d380fc7d0 msgr2=0x7f2d38105e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:07.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.791+0000 7f2d3d626640 1 -- 172.21.15.2:0/2798377741 shutdown_connections 2024-09-19T06:14:07.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:07.791+0000 7f2d3d626640 1 -- 172.21.15.2:0/2798377741 wait complete. 2024-09-19T06:14:08.523 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":308,"stamp":"2024-09-19T06:14:06.016264+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653423,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":439,"num_read_kb":338,"num_write":342,"num_write_kb":3046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1181380,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":274,"ondisk_log_size":274,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369988,"kb_used_data":12396,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124571836,"statfs":{"total":1151940427776,"available":1151561560064,"internally_reserved":0,"allocated":12693504,"data_stored":7114425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003436"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.833979+0000","last_change":"2024-09-19T06:13:03.799398+0000","last_active":"2024-09-19T06:13:13.833979+0000","last_peered":"2024-09-19T06:13:13.833979+0000","last_clean":"2024-09-19T06:13:13.833979+0000","last_became_active":"2024-09-19T06:13:03.799027+0000","last_became_peered":"2024-09-19T06:13:03.799027+0000","last_unstale":"2024-09-19T06:13:13.833979+0000","last_undegraded":"2024-09-19T06:13:13.833979+0000","last_fullsized":"2024-09-19T06:13:13.833979+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:35:45.934040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834912+0000","last_change":"2024-09-19T06:13:03.791878+0000","last_active":"2024-09-19T06:13:13.834912+0000","last_peered":"2024-09-19T06:13:13.834912+0000","last_clean":"2024-09-19T06:13:13.834912+0000","last_became_active":"2024-09-19T06:13:03.791637+0000","last_became_peered":"2024-09-19T06:13:03.791637+0000","last_unstale":"2024-09-19T06:13:13.834912+0000","last_undegraded":"2024-09-19T06:13:13.834912+0000","last_fullsized":"2024-09-19T06:13:13.834912+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:00.078010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834885+0000","last_change":"2024-09-19T06:13:03.798969+0000","last_active":"2024-09-19T06:13:13.834885+0000","last_peered":"2024-09-19T06:13:13.834885+0000","last_clean":"2024-09-19T06:13:13.834885+0000","last_became_active":"2024-09-19T06:13:03.798410+0000","last_became_peered":"2024-09-19T06:13:03.798410+0000","last_unstale":"2024-09-19T06:13:13.834885+0000","last_undegraded":"2024-09-19T06:13:13.834885+0000","last_fullsized":"2024-09-19T06:13:13.834885+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:48.381506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836750+0000","last_change":"2024-09-19T06:13:03.806455+0000","last_active":"2024-09-19T06:13:13.836750+0000","last_peered":"2024-09-19T06:13:13.836750+0000","last_clean":"2024-09-19T06:13:13.836750+0000","last_became_active":"2024-09-19T06:13:03.805830+0000","last_became_peered":"2024-09-19T06:13:03.805830+0000","last_unstale":"2024-09-19T06:13:13.836750+0000","last_undegraded":"2024-09-19T06:13:13.836750+0000","last_fullsized":"2024-09-19T06:13:13.836750+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:03.206791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834548+0000","last_change":"2024-09-19T06:13:03.785009+0000","last_active":"2024-09-19T06:13:13.834548+0000","last_peered":"2024-09-19T06:13:13.834548+0000","last_clean":"2024-09-19T06:13:13.834548+0000","last_became_active":"2024-09-19T06:13:03.784638+0000","last_became_peered":"2024-09-19T06:13:03.784638+0000","last_unstale":"2024-09-19T06:13:13.834548+0000","last_undegraded":"2024-09-19T06:13:13.834548+0000","last_fullsized":"2024-09-19T06:13:13.834548+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:36:43.099492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.831398+0000","last_change":"2024-09-19T06:13:03.789006+0000","last_active":"2024-09-19T06:13:13.831398+0000","last_peered":"2024-09-19T06:13:13.831398+0000","last_clean":"2024-09-19T06:13:13.831398+0000","last_became_active":"2024-09-19T06:13:03.788639+0000","last_became_peered":"2024-09-19T06:13:03.788639+0000","last_unstale":"2024-09-19T06:13:13.831398+0000","last_undegraded":"2024-09-19T06:13:13.831398+0000","last_fullsized":"2024-09-19T06:13:13.831398+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:18.692491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836740+0000","last_change":"2024-09-19T06:13:03.805264+0000","last_active":"2024-09-19T06:13:13.836740+0000","last_peered":"2024-09-19T06:13:13.836740+0000","last_clean":"2024-09-19T06:13:13.836740+0000","last_became_active":"2024-09-19T06:13:03.804948+0000","last_became_peered":"2024-09-19T06:13:03.804948+0000","last_unstale":"2024-09-19T06:13:13.836740+0000","last_undegraded":"2024-09-19T06:13:13.836740+0000","last_fullsized":"2024-09-19T06:13:13.836740+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:56:26.613785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.841510+0000","last_change":"2024-09-19T06:13:13.841110+0000","last_active":"2024-09-19T06:13:13.841510+0000","last_peered":"2024-09-19T06:13:13.841510+0000","last_clean":"2024-09-19T06:13:13.841510+0000","last_became_active":"2024-09-19T06:13:13.840736+0000","last_became_peered":"2024-09-19T06:13:13.840736+0000","last_unstale":"2024-09-19T06:13:13.841510+0000","last_undegraded":"2024-09-19T06:13:13.841510+0000","last_fullsized":"2024-09-19T06:13:13.841510+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:46.304692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.987340+0000","last_change":"2024-09-19T06:13:03.808432+0000","last_active":"2024-09-19T06:13:13.987340+0000","last_peered":"2024-09-19T06:13:13.987340+0000","last_clean":"2024-09-19T06:13:13.987340+0000","last_became_active":"2024-09-19T06:13:03.808120+0000","last_became_peered":"2024-09-19T06:13:03.808120+0000","last_unstale":"2024-09-19T06:13:13.987340+0000","last_undegraded":"2024-09-19T06:13:13.987340+0000","last_fullsized":"2024-09-19T06:13:13.987340+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:31.270525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.843937+0000","last_change":"2024-09-19T06:13:13.843937+0000","last_active":"2024-09-19T06:13:13.843937+0000","last_peered":"2024-09-19T06:13:13.843937+0000","last_clean":"2024-09-19T06:13:13.843937+0000","last_became_active":"2024-09-19T06:13:13.843541+0000","last_became_peered":"2024-09-19T06:13:13.843541+0000","last_unstale":"2024-09-19T06:13:13.843937+0000","last_undegraded":"2024-09-19T06:13:13.843937+0000","last_fullsized":"2024-09-19T06:13:13.843937+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:23.115055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837559+0000","last_change":"2024-09-19T06:13:03.803361+0000","last_active":"2024-09-19T06:13:13.837559+0000","last_peered":"2024-09-19T06:13:13.837559+0000","last_clean":"2024-09-19T06:13:13.837559+0000","last_became_active":"2024-09-19T06:13:03.802794+0000","last_became_peered":"2024-09-19T06:13:03.802794+0000","last_unstale":"2024-09-19T06:13:13.837559+0000","last_undegraded":"2024-09-19T06:13:13.837559+0000","last_fullsized":"2024-09-19T06:13:13.837559+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:53.126456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836847+0000","last_change":"2024-09-19T06:13:03.806163+0000","last_active":"2024-09-19T06:13:13.836847+0000","last_peered":"2024-09-19T06:13:13.836847+0000","last_clean":"2024-09-19T06:13:13.836847+0000","last_became_active":"2024-09-19T06:13:03.805406+0000","last_became_peered":"2024-09-19T06:13:03.805406+0000","last_unstale":"2024-09-19T06:13:13.836847+0000","last_undegraded":"2024-09-19T06:13:13.836847+0000","last_fullsized":"2024-09-19T06:13:13.836847+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:28:17.793408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.830616+0000","last_change":"2024-09-19T06:13:03.794617+0000","last_active":"2024-09-19T06:13:13.830616+0000","last_peered":"2024-09-19T06:13:13.830616+0000","last_clean":"2024-09-19T06:13:13.830616+0000","last_became_active":"2024-09-19T06:13:03.794264+0000","last_became_peered":"2024-09-19T06:13:03.794264+0000","last_unstale":"2024-09-19T06:13:13.830616+0000","last_undegraded":"2024-09-19T06:13:13.830616+0000","last_fullsized":"2024-09-19T06:13:13.830616+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:32.200624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834631+0000","last_change":"2024-09-19T06:13:03.792632+0000","last_active":"2024-09-19T06:13:13.834631+0000","last_peered":"2024-09-19T06:13:13.834631+0000","last_clean":"2024-09-19T06:13:13.834631+0000","last_became_active":"2024-09-19T06:13:03.792409+0000","last_became_peered":"2024-09-19T06:13:03.792409+0000","last_unstale":"2024-09-19T06:13:13.834631+0000","last_undegraded":"2024-09-19T06:13:13.834631+0000","last_fullsized":"2024-09-19T06:13:13.834631+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:01.193404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834588+0000","last_change":"2024-09-19T06:13:03.801784+0000","last_active":"2024-09-19T06:13:13.834588+0000","last_peered":"2024-09-19T06:13:13.834588+0000","last_clean":"2024-09-19T06:13:13.834588+0000","last_became_active":"2024-09-19T06:13:03.801350+0000","last_became_peered":"2024-09-19T06:13:03.801350+0000","last_unstale":"2024-09-19T06:13:13.834588+0000","last_undegraded":"2024-09-19T06:13:13.834588+0000","last_fullsized":"2024-09-19T06:13:13.834588+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:50:40.542264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.986643+0000","last_change":"2024-09-19T06:13:03.800069+0000","last_active":"2024-09-19T06:13:13.986643+0000","last_peered":"2024-09-19T06:13:13.986643+0000","last_clean":"2024-09-19T06:13:13.986643+0000","last_became_active":"2024-09-19T06:13:03.799690+0000","last_became_peered":"2024-09-19T06:13:03.799690+0000","last_unstale":"2024-09-19T06:13:13.986643+0000","last_undegraded":"2024-09-19T06:13:13.986643+0000","last_fullsized":"2024-09-19T06:13:13.986643+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:36:01.882849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834326+0000","last_change":"2024-09-19T06:13:03.800180+0000","last_active":"2024-09-19T06:13:13.834326+0000","last_peered":"2024-09-19T06:13:13.834326+0000","last_clean":"2024-09-19T06:13:13.834326+0000","last_became_active":"2024-09-19T06:13:03.798981+0000","last_became_peered":"2024-09-19T06:13:03.798981+0000","last_unstale":"2024-09-19T06:13:13.834326+0000","last_undegraded":"2024-09-19T06:13:13.834326+0000","last_fullsized":"2024-09-19T06:13:13.834326+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:29.241021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.833656+0000","last_change":"2024-09-19T06:13:03.796889+0000","last_active":"2024-09-19T06:13:13.833656+0000","last_peered":"2024-09-19T06:13:13.833656+0000","last_clean":"2024-09-19T06:13:13.833656+0000","last_became_active":"2024-09-19T06:13:03.796539+0000","last_became_peered":"2024-09-19T06:13:03.796539+0000","last_unstale":"2024-09-19T06:13:13.833656+0000","last_undegraded":"2024-09-19T06:13:13.833656+0000","last_fullsized":"2024-09-19T06:13:13.833656+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:10.462303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.841576+0000","last_change":"2024-09-19T06:13:03.798758+0000","last_active":"2024-09-19T06:13:13.841576+0000","last_peered":"2024-09-19T06:13:13.841576+0000","last_clean":"2024-09-19T06:13:13.841576+0000","last_became_active":"2024-09-19T06:13:03.798422+0000","last_became_peered":"2024-09-19T06:13:03.798422+0000","last_unstale":"2024-09-19T06:13:13.841576+0000","last_undegraded":"2024-09-19T06:13:13.841576+0000","last_fullsized":"2024-09-19T06:13:13.841576+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:03.712394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.833498+0000","last_change":"2024-09-19T06:13:03.800825+0000","last_active":"2024-09-19T06:13:13.833498+0000","last_peered":"2024-09-19T06:13:13.833498+0000","last_clean":"2024-09-19T06:13:13.833498+0000","last_became_active":"2024-09-19T06:13:03.800505+0000","last_became_peered":"2024-09-19T06:13:03.800505+0000","last_unstale":"2024-09-19T06:13:13.833498+0000","last_undegraded":"2024-09-19T06:13:13.833498+0000","last_fullsized":"2024-09-19T06:13:13.833498+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:15.640802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.830731+0000","last_change":"2024-09-19T06:13:03.797868+0000","last_active":"2024-09-19T06:13:13.830731+0000","last_peered":"2024-09-19T06:13:13.830731+0000","last_clean":"2024-09-19T06:13:13.830731+0000","last_became_active":"2024-09-19T06:13:03.797576+0000","last_became_peered":"2024-09-19T06:13:03.797576+0000","last_unstale":"2024-09-19T06:13:13.830731+0000","last_undegraded":"2024-09-19T06:13:13.830731+0000","last_fullsized":"2024-09-19T06:13:13.830731+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:29:18.953446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.986839+0000","last_change":"2024-09-19T06:13:03.805201+0000","last_active":"2024-09-19T06:13:13.986839+0000","last_peered":"2024-09-19T06:13:13.986839+0000","last_clean":"2024-09-19T06:13:13.986839+0000","last_became_active":"2024-09-19T06:13:03.803758+0000","last_became_peered":"2024-09-19T06:13:03.803758+0000","last_unstale":"2024-09-19T06:13:13.986839+0000","last_undegraded":"2024-09-19T06:13:13.986839+0000","last_fullsized":"2024-09-19T06:13:13.986839+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:49:26.088519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.986859+0000","last_change":"2024-09-19T06:13:03.796086+0000","last_active":"2024-09-19T06:13:13.986859+0000","last_peered":"2024-09-19T06:13:13.986859+0000","last_clean":"2024-09-19T06:13:13.986859+0000","last_became_active":"2024-09-19T06:13:03.795594+0000","last_became_peered":"2024-09-19T06:13:03.795594+0000","last_unstale":"2024-09-19T06:13:13.986859+0000","last_undegraded":"2024-09-19T06:13:13.986859+0000","last_fullsized":"2024-09-19T06:13:13.986859+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:26.374596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837062+0000","last_change":"2024-09-19T06:13:03.796727+0000","last_active":"2024-09-19T06:13:13.837062+0000","last_peered":"2024-09-19T06:13:13.837062+0000","last_clean":"2024-09-19T06:13:13.837062+0000","last_became_active":"2024-09-19T06:13:03.796334+0000","last_became_peered":"2024-09-19T06:13:03.796334+0000","last_unstale":"2024-09-19T06:13:13.837062+0000","last_undegraded":"2024-09-19T06:13:13.837062+0000","last_fullsized":"2024-09-19T06:13:13.837062+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:47.660748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.987433+0000","last_change":"2024-09-19T06:13:03.800994+0000","last_active":"2024-09-19T06:13:13.987433+0000","last_peered":"2024-09-19T06:13:13.987433+0000","last_clean":"2024-09-19T06:13:13.987433+0000","last_became_active":"2024-09-19T06:13:03.800690+0000","last_became_peered":"2024-09-19T06:13:03.800690+0000","last_unstale":"2024-09-19T06:13:13.987433+0000","last_undegraded":"2024-09-19T06:13:13.987433+0000","last_fullsized":"2024-09-19T06:13:13.987433+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:37.204106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.841755+0000","last_change":"2024-09-19T06:13:03.797503+0000","last_active":"2024-09-19T06:13:13.841755+0000","last_peered":"2024-09-19T06:13:13.841755+0000","last_clean":"2024-09-19T06:13:13.841755+0000","last_became_active":"2024-09-19T06:13:03.797189+0000","last_became_peered":"2024-09-19T06:13:03.797189+0000","last_unstale":"2024-09-19T06:13:13.841755+0000","last_undegraded":"2024-09-19T06:13:13.841755+0000","last_fullsized":"2024-09-19T06:13:13.841755+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:16:18.036236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.833849+0000","last_change":"2024-09-19T06:13:03.795462+0000","last_active":"2024-09-19T06:13:13.833849+0000","last_peered":"2024-09-19T06:13:13.833849+0000","last_clean":"2024-09-19T06:13:13.833849+0000","last_became_active":"2024-09-19T06:13:03.793882+0000","last_became_peered":"2024-09-19T06:13:03.793882+0000","last_unstale":"2024-09-19T06:13:13.833849+0000","last_undegraded":"2024-09-19T06:13:13.833849+0000","last_fullsized":"2024-09-19T06:13:13.833849+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:04.329608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.830520+0000","last_change":"2024-09-19T06:13:03.800425+0000","last_active":"2024-09-19T06:13:13.830520+0000","last_peered":"2024-09-19T06:13:13.830520+0000","last_clean":"2024-09-19T06:13:13.830520+0000","last_became_active":"2024-09-19T06:13:03.800061+0000","last_became_peered":"2024-09-19T06:13:03.800061+0000","last_unstale":"2024-09-19T06:13:13.830520+0000","last_undegraded":"2024-09-19T06:13:13.830520+0000","last_fullsized":"2024-09-19T06:13:13.830520+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:36.454869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834825+0000","last_change":"2024-09-19T06:13:03.801630+0000","last_active":"2024-09-19T06:13:13.834825+0000","last_peered":"2024-09-19T06:13:13.834825+0000","last_clean":"2024-09-19T06:13:13.834825+0000","last_became_active":"2024-09-19T06:13:03.801118+0000","last_became_peered":"2024-09-19T06:13:03.801118+0000","last_unstale":"2024-09-19T06:13:13.834825+0000","last_undegraded":"2024-09-19T06:13:13.834825+0000","last_fullsized":"2024-09-19T06:13:13.834825+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:52.641042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.840928+0000","last_change":"2024-09-19T06:13:03.793435+0000","last_active":"2024-09-19T06:13:13.840928+0000","last_peered":"2024-09-19T06:13:13.840928+0000","last_clean":"2024-09-19T06:13:13.840928+0000","last_became_active":"2024-09-19T06:13:03.793138+0000","last_became_peered":"2024-09-19T06:13:03.793138+0000","last_unstale":"2024-09-19T06:13:13.840928+0000","last_undegraded":"2024-09-19T06:13:13.840928+0000","last_fullsized":"2024-09-19T06:13:13.840928+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:40.967328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.841127+0000","last_change":"2024-09-19T06:13:03.800324+0000","last_active":"2024-09-19T06:13:13.841127+0000","last_peered":"2024-09-19T06:13:13.841127+0000","last_clean":"2024-09-19T06:13:13.841127+0000","last_became_active":"2024-09-19T06:13:03.799996+0000","last_became_peered":"2024-09-19T06:13:03.799996+0000","last_unstale":"2024-09-19T06:13:13.841127+0000","last_undegraded":"2024-09-19T06:13:13.841127+0000","last_fullsized":"2024-09-19T06:13:13.841127+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:04.012607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.833462+0000","last_change":"2024-09-19T06:13:03.794669+0000","last_active":"2024-09-19T06:13:13.833462+0000","last_peered":"2024-09-19T06:13:13.833462+0000","last_clean":"2024-09-19T06:13:13.833462+0000","last_became_active":"2024-09-19T06:13:03.794333+0000","last_became_peered":"2024-09-19T06:13:03.794333+0000","last_unstale":"2024-09-19T06:13:13.833462+0000","last_undegraded":"2024-09-19T06:13:13.833462+0000","last_fullsized":"2024-09-19T06:13:13.833462+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:27.690064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834261+0000","last_change":"2024-09-19T06:13:03.794058+0000","last_active":"2024-09-19T06:13:13.834261+0000","last_peered":"2024-09-19T06:13:13.834261+0000","last_clean":"2024-09-19T06:13:13.834261+0000","last_became_active":"2024-09-19T06:13:03.793710+0000","last_became_peered":"2024-09-19T06:13:03.793710+0000","last_unstale":"2024-09-19T06:13:13.834261+0000","last_undegraded":"2024-09-19T06:13:13.834261+0000","last_fullsized":"2024-09-19T06:13:13.834261+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:56:05.395718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"79'5","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:14:01.940682+0000","last_change":"2024-09-19T06:13:13.848686+0000","last_active":"2024-09-19T06:14:01.940682+0000","last_peered":"2024-09-19T06:14:01.940682+0000","last_clean":"2024-09-19T06:14:01.940682+0000","last_became_active":"2024-09-19T06:13:13.843205+0000","last_became_peered":"2024-09-19T06:13:13.843205+0000","last_unstale":"2024-09-19T06:14:01.940682+0000","last_undegraded":"2024-09-19T06:14:01.940682+0000","last_fullsized":"2024-09-19T06:14:01.940682+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:49.016417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":48,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836811+0000","last_change":"2024-09-19T06:13:03.801206+0000","last_active":"2024-09-19T06:13:13.836811+0000","last_peered":"2024-09-19T06:13:13.836811+0000","last_clean":"2024-09-19T06:13:13.836811+0000","last_became_active":"2024-09-19T06:13:03.800661+0000","last_became_peered":"2024-09-19T06:13:03.800661+0000","last_unstale":"2024-09-19T06:13:13.836811+0000","last_undegraded":"2024-09-19T06:13:13.836811+0000","last_fullsized":"2024-09-19T06:13:13.836811+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:28:11.187583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.831489+0000","last_change":"2024-09-19T06:13:01.656487+0000","last_active":"2024-09-19T06:13:13.831489+0000","last_peered":"2024-09-19T06:13:13.831489+0000","last_clean":"2024-09-19T06:13:13.831489+0000","last_became_active":"2024-09-19T06:13:01.656099+0000","last_became_peered":"2024-09-19T06:13:01.656099+0000","last_unstale":"2024-09-19T06:13:13.831489+0000","last_undegraded":"2024-09-19T06:13:13.831489+0000","last_fullsized":"2024-09-19T06:13:13.831489+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:01.437614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.830367+0000","last_change":"2024-09-19T06:13:01.656435+0000","last_active":"2024-09-19T06:13:13.830367+0000","last_peered":"2024-09-19T06:13:13.830367+0000","last_clean":"2024-09-19T06:13:13.830367+0000","last_became_active":"2024-09-19T06:13:01.655660+0000","last_became_peered":"2024-09-19T06:13:01.655660+0000","last_unstale":"2024-09-19T06:13:13.830367+0000","last_undegraded":"2024-09-19T06:13:13.830367+0000","last_fullsized":"2024-09-19T06:13:13.830367+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:35:06.211974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.986952+0000","last_change":"2024-09-19T06:13:03.784573+0000","last_active":"2024-09-19T06:13:13.986952+0000","last_peered":"2024-09-19T06:13:13.986952+0000","last_clean":"2024-09-19T06:13:13.986952+0000","last_became_active":"2024-09-19T06:13:03.784152+0000","last_became_peered":"2024-09-19T06:13:03.784152+0000","last_unstale":"2024-09-19T06:13:13.986952+0000","last_undegraded":"2024-09-19T06:13:13.986952+0000","last_fullsized":"2024-09-19T06:13:13.986952+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:28:39.606178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'1","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837384+0000","last_change":"2024-09-19T06:13:01.656150+0000","last_active":"2024-09-19T06:13:13.837384+0000","last_peered":"2024-09-19T06:13:13.837384+0000","last_clean":"2024-09-19T06:13:13.837384+0000","last_became_active":"2024-09-19T06:13:01.655826+0000","last_became_peered":"2024-09-19T06:13:01.655826+0000","last_unstale":"2024-09-19T06:13:13.837384+0000","last_undegraded":"2024-09-19T06:13:13.837384+0000","last_fullsized":"2024-09-19T06:13:13.837384+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:57.782393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.833363+0000","last_change":"2024-09-19T06:13:03.784567+0000","last_active":"2024-09-19T06:13:13.833363+0000","last_peered":"2024-09-19T06:13:13.833363+0000","last_clean":"2024-09-19T06:13:13.833363+0000","last_became_active":"2024-09-19T06:13:03.784187+0000","last_became_peered":"2024-09-19T06:13:03.784187+0000","last_unstale":"2024-09-19T06:13:13.833363+0000","last_undegraded":"2024-09-19T06:13:13.833363+0000","last_fullsized":"2024-09-19T06:13:13.833363+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:21.037052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'3","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:14:01.940143+0000","last_change":"2024-09-19T06:13:01.659641+0000","last_active":"2024-09-19T06:14:01.940143+0000","last_peered":"2024-09-19T06:14:01.940143+0000","last_clean":"2024-09-19T06:14:01.940143+0000","last_became_active":"2024-09-19T06:13:01.659338+0000","last_became_peered":"2024-09-19T06:13:01.659338+0000","last_unstale":"2024-09-19T06:14:01.940143+0000","last_undegraded":"2024-09-19T06:14:01.940143+0000","last_fullsized":"2024-09-19T06:14:01.940143+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:26.230690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.987249+0000","last_change":"2024-09-19T06:13:03.797095+0000","last_active":"2024-09-19T06:13:13.987249+0000","last_peered":"2024-09-19T06:13:13.987249+0000","last_clean":"2024-09-19T06:13:13.987249+0000","last_became_active":"2024-09-19T06:13:03.796588+0000","last_became_peered":"2024-09-19T06:13:03.796588+0000","last_unstale":"2024-09-19T06:13:13.987249+0000","last_undegraded":"2024-09-19T06:13:13.987249+0000","last_fullsized":"2024-09-19T06:13:13.987249+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:33.705210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836583+0000","last_change":"2024-09-19T06:13:01.659995+0000","last_active":"2024-09-19T06:13:13.836583+0000","last_peered":"2024-09-19T06:13:13.836583+0000","last_clean":"2024-09-19T06:13:13.836583+0000","last_became_active":"2024-09-19T06:13:01.659621+0000","last_became_peered":"2024-09-19T06:13:01.659621+0000","last_unstale":"2024-09-19T06:13:13.836583+0000","last_undegraded":"2024-09-19T06:13:13.836583+0000","last_fullsized":"2024-09-19T06:13:13.836583+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:44.893111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.835148+0000","last_change":"2024-09-19T06:13:03.800859+0000","last_active":"2024-09-19T06:13:13.835148+0000","last_peered":"2024-09-19T06:13:13.835148+0000","last_clean":"2024-09-19T06:13:13.835148+0000","last_became_active":"2024-09-19T06:13:03.800540+0000","last_became_peered":"2024-09-19T06:13:03.800540+0000","last_unstale":"2024-09-19T06:13:13.835148+0000","last_undegraded":"2024-09-19T06:13:13.835148+0000","last_fullsized":"2024-09-19T06:13:13.835148+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:25:11.198557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'4","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837224+0000","last_change":"2024-09-19T06:13:01.654666+0000","last_active":"2024-09-19T06:13:13.837224+0000","last_peered":"2024-09-19T06:13:13.837224+0000","last_clean":"2024-09-19T06:13:13.837224+0000","last_became_active":"2024-09-19T06:13:01.654241+0000","last_became_peered":"2024-09-19T06:13:01.654241+0000","last_unstale":"2024-09-19T06:13:13.837224+0000","last_undegraded":"2024-09-19T06:13:13.837224+0000","last_fullsized":"2024-09-19T06:13:13.837224+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:45.211100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.986872+0000","last_change":"2024-09-19T06:13:03.799906+0000","last_active":"2024-09-19T06:13:13.986872+0000","last_peered":"2024-09-19T06:13:13.986872+0000","last_clean":"2024-09-19T06:13:13.986872+0000","last_became_active":"2024-09-19T06:13:03.799566+0000","last_became_peered":"2024-09-19T06:13:03.799566+0000","last_unstale":"2024-09-19T06:13:13.986872+0000","last_undegraded":"2024-09-19T06:13:13.986872+0000","last_fullsized":"2024-09-19T06:13:13.986872+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:34.268480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'26","reported_seq":148,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:14:02.941652+0000","last_change":"2024-09-19T06:13:01.657204+0000","last_active":"2024-09-19T06:14:02.941652+0000","last_peered":"2024-09-19T06:14:02.941652+0000","last_clean":"2024-09-19T06:14:02.941652+0000","last_became_active":"2024-09-19T06:13:01.656886+0000","last_became_peered":"2024-09-19T06:13:01.656886+0000","last_unstale":"2024-09-19T06:14:02.941652+0000","last_undegraded":"2024-09-19T06:14:02.941652+0000","last_fullsized":"2024-09-19T06:14:02.941652+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:32:18.033428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59211,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":100,"num_read_kb":108,"num_write":27,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834343+0000","last_change":"2024-09-19T06:13:03.798605+0000","last_active":"2024-09-19T06:13:13.834343+0000","last_peered":"2024-09-19T06:13:13.834343+0000","last_clean":"2024-09-19T06:13:13.834343+0000","last_became_active":"2024-09-19T06:13:03.798022+0000","last_became_peered":"2024-09-19T06:13:03.798022+0000","last_unstale":"2024-09-19T06:13:13.834343+0000","last_undegraded":"2024-09-19T06:13:13.834343+0000","last_fullsized":"2024-09-19T06:13:13.834343+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:10.094031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.841613+0000","last_change":"2024-09-19T06:13:01.652192+0000","last_active":"2024-09-19T06:13:13.841613+0000","last_peered":"2024-09-19T06:13:13.841613+0000","last_clean":"2024-09-19T06:13:13.841613+0000","last_became_active":"2024-09-19T06:13:01.651774+0000","last_became_peered":"2024-09-19T06:13:01.651774+0000","last_unstale":"2024-09-19T06:13:13.841613+0000","last_undegraded":"2024-09-19T06:13:13.841613+0000","last_fullsized":"2024-09-19T06:13:13.841613+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:39:47.683863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.830386+0000","last_change":"2024-09-19T06:13:03.798674+0000","last_active":"2024-09-19T06:13:13.830386+0000","last_peered":"2024-09-19T06:13:13.830386+0000","last_clean":"2024-09-19T06:13:13.830386+0000","last_became_active":"2024-09-19T06:13:03.798397+0000","last_became_peered":"2024-09-19T06:13:03.798397+0000","last_unstale":"2024-09-19T06:13:13.830386+0000","last_undegraded":"2024-09-19T06:13:13.830386+0000","last_fullsized":"2024-09-19T06:13:13.830386+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:37.155730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836668+0000","last_change":"2024-09-19T06:13:01.655777+0000","last_active":"2024-09-19T06:13:13.836668+0000","last_peered":"2024-09-19T06:13:13.836668+0000","last_clean":"2024-09-19T06:13:13.836668+0000","last_became_active":"2024-09-19T06:13:01.655420+0000","last_became_peered":"2024-09-19T06:13:01.655420+0000","last_unstale":"2024-09-19T06:13:13.836668+0000","last_undegraded":"2024-09-19T06:13:13.836668+0000","last_fullsized":"2024-09-19T06:13:13.836668+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:02.593204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836731+0000","last_change":"2024-09-19T06:13:03.803799+0000","last_active":"2024-09-19T06:13:13.836731+0000","last_peered":"2024-09-19T06:13:13.836731+0000","last_clean":"2024-09-19T06:13:13.836731+0000","last_became_active":"2024-09-19T06:13:03.803350+0000","last_became_peered":"2024-09-19T06:13:03.803350+0000","last_unstale":"2024-09-19T06:13:13.836731+0000","last_undegraded":"2024-09-19T06:13:13.836731+0000","last_fullsized":"2024-09-19T06:13:13.836731+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:15.806363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'3","reported_seq":73,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:14:01.941055+0000","last_change":"2024-09-19T06:13:01.656007+0000","last_active":"2024-09-19T06:14:01.941055+0000","last_peered":"2024-09-19T06:14:01.941055+0000","last_clean":"2024-09-19T06:14:01.941055+0000","last_became_active":"2024-09-19T06:13:01.655642+0000","last_became_peered":"2024-09-19T06:13:01.655642+0000","last_unstale":"2024-09-19T06:14:01.941055+0000","last_undegraded":"2024-09-19T06:14:01.941055+0000","last_fullsized":"2024-09-19T06:14:01.941055+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:54.391122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":49,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836490+0000","last_change":"2024-09-19T06:13:03.804426+0000","last_active":"2024-09-19T06:13:13.836490+0000","last_peered":"2024-09-19T06:13:13.836490+0000","last_clean":"2024-09-19T06:13:13.836490+0000","last_became_active":"2024-09-19T06:13:03.804146+0000","last_became_peered":"2024-09-19T06:13:03.804146+0000","last_unstale":"2024-09-19T06:13:13.836490+0000","last_undegraded":"2024-09-19T06:13:13.836490+0000","last_fullsized":"2024-09-19T06:13:13.836490+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:56.198679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834205+0000","last_change":"2024-09-19T06:13:01.650023+0000","last_active":"2024-09-19T06:13:13.834205+0000","last_peered":"2024-09-19T06:13:13.834205+0000","last_clean":"2024-09-19T06:13:13.834205+0000","last_became_active":"2024-09-19T06:13:01.649674+0000","last_became_peered":"2024-09-19T06:13:01.649674+0000","last_unstale":"2024-09-19T06:13:13.834205+0000","last_undegraded":"2024-09-19T06:13:13.834205+0000","last_fullsized":"2024-09-19T06:13:13.834205+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:56:11.164070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836300+0000","last_change":"2024-09-19T06:13:03.802078+0000","last_active":"2024-09-19T06:13:13.836300+0000","last_peered":"2024-09-19T06:13:13.836300+0000","last_clean":"2024-09-19T06:13:13.836300+0000","last_became_active":"2024-09-19T06:13:03.801552+0000","last_became_peered":"2024-09-19T06:13:03.801552+0000","last_unstale":"2024-09-19T06:13:13.836300+0000","last_undegraded":"2024-09-19T06:13:13.836300+0000","last_fullsized":"2024-09-19T06:13:13.836300+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:57.025457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:17.875451+0000","last_change":"2024-09-19T06:13:13.843721+0000","last_active":"2024-09-19T06:13:17.875451+0000","last_peered":"2024-09-19T06:13:17.875451+0000","last_clean":"2024-09-19T06:13:17.875451+0000","last_became_active":"2024-09-19T06:13:13.838567+0000","last_became_peered":"2024-09-19T06:13:13.838567+0000","last_unstale":"2024-09-19T06:13:17.875451+0000","last_undegraded":"2024-09-19T06:13:17.875451+0000","last_fullsized":"2024-09-19T06:13:17.875451+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:44.479675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.833649+0000","last_change":"2024-09-19T06:13:03.801534+0000","last_active":"2024-09-19T06:13:13.833649+0000","last_peered":"2024-09-19T06:13:13.833649+0000","last_clean":"2024-09-19T06:13:13.833649+0000","last_became_active":"2024-09-19T06:13:03.801142+0000","last_became_peered":"2024-09-19T06:13:03.801142+0000","last_unstale":"2024-09-19T06:13:13.833649+0000","last_undegraded":"2024-09-19T06:13:13.833649+0000","last_fullsized":"2024-09-19T06:13:13.833649+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:45.029662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.830492+0000","last_change":"2024-09-19T06:13:01.655075+0000","last_active":"2024-09-19T06:13:13.830492+0000","last_peered":"2024-09-19T06:13:13.830492+0000","last_clean":"2024-09-19T06:13:13.830492+0000","last_became_active":"2024-09-19T06:13:01.649236+0000","last_became_peered":"2024-09-19T06:13:01.649236+0000","last_unstale":"2024-09-19T06:13:13.830492+0000","last_undegraded":"2024-09-19T06:13:13.830492+0000","last_fullsized":"2024-09-19T06:13:13.830492+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:06.007418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836658+0000","last_change":"2024-09-19T06:13:03.795674+0000","last_active":"2024-09-19T06:13:13.836658+0000","last_peered":"2024-09-19T06:13:13.836658+0000","last_clean":"2024-09-19T06:13:13.836658+0000","last_became_active":"2024-09-19T06:13:03.794843+0000","last_became_peered":"2024-09-19T06:13:03.794843+0000","last_unstale":"2024-09-19T06:13:13.836658+0000","last_undegraded":"2024-09-19T06:13:13.836658+0000","last_fullsized":"2024-09-19T06:13:13.836658+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:41:57.669988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837389+0000","last_change":"2024-09-19T06:13:01.656696+0000","last_active":"2024-09-19T06:13:13.837389+0000","last_peered":"2024-09-19T06:13:13.837389+0000","last_clean":"2024-09-19T06:13:13.837389+0000","last_became_active":"2024-09-19T06:13:01.655260+0000","last_became_peered":"2024-09-19T06:13:01.655260+0000","last_unstale":"2024-09-19T06:13:13.837389+0000","last_undegraded":"2024-09-19T06:13:13.837389+0000","last_fullsized":"2024-09-19T06:13:13.837389+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:50.281013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837373+0000","last_change":"2024-09-19T06:13:03.804411+0000","last_active":"2024-09-19T06:13:13.837373+0000","last_peered":"2024-09-19T06:13:13.837373+0000","last_clean":"2024-09-19T06:13:13.837373+0000","last_became_active":"2024-09-19T06:13:03.804052+0000","last_became_peered":"2024-09-19T06:13:03.804052+0000","last_unstale":"2024-09-19T06:13:13.837373+0000","last_undegraded":"2024-09-19T06:13:13.837373+0000","last_fullsized":"2024-09-19T06:13:13.837373+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:33.394141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.841525+0000","last_change":"2024-09-19T06:13:01.655164+0000","last_active":"2024-09-19T06:13:13.841525+0000","last_peered":"2024-09-19T06:13:13.841525+0000","last_clean":"2024-09-19T06:13:13.841525+0000","last_became_active":"2024-09-19T06:13:01.654297+0000","last_became_peered":"2024-09-19T06:13:01.654297+0000","last_unstale":"2024-09-19T06:13:13.841525+0000","last_undegraded":"2024-09-19T06:13:13.841525+0000","last_fullsized":"2024-09-19T06:13:13.841525+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:02:02.861982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837562+0000","last_change":"2024-09-19T06:13:03.802799+0000","last_active":"2024-09-19T06:13:13.837562+0000","last_peered":"2024-09-19T06:13:13.837562+0000","last_clean":"2024-09-19T06:13:13.837562+0000","last_became_active":"2024-09-19T06:13:03.802348+0000","last_became_peered":"2024-09-19T06:13:03.802348+0000","last_unstale":"2024-09-19T06:13:13.837562+0000","last_undegraded":"2024-09-19T06:13:13.837562+0000","last_fullsized":"2024-09-19T06:13:13.837562+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:05:52.685874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":345,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837478+0000","last_change":"2024-09-19T06:11:51.805685+0000","last_active":"2024-09-19T06:13:13.837478+0000","last_peered":"2024-09-19T06:13:13.837478+0000","last_clean":"2024-09-19T06:13:13.837478+0000","last_became_active":"2024-09-19T06:11:51.805191+0000","last_became_peered":"2024-09-19T06:11:51.805191+0000","last_unstale":"2024-09-19T06:13:13.837478+0000","last_undegraded":"2024-09-19T06:13:13.837478+0000","last_fullsized":"2024-09-19T06:13:13.837478+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:08:28.556644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:08:28.556644+0000","last_clean_scrub_stamp":"2024-09-19T06:08:28.556644+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:19.169542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:17.875306+0000","last_change":"2024-09-19T06:13:01.656796+0000","last_active":"2024-09-19T06:13:17.875306+0000","last_peered":"2024-09-19T06:13:17.875306+0000","last_clean":"2024-09-19T06:13:17.875306+0000","last_became_active":"2024-09-19T06:13:01.656350+0000","last_became_peered":"2024-09-19T06:13:01.656350+0000","last_unstale":"2024-09-19T06:13:17.875306+0000","last_undegraded":"2024-09-19T06:13:17.875306+0000","last_fullsized":"2024-09-19T06:13:17.875306+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:19:03.820218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.986968+0000","last_change":"2024-09-19T06:13:03.793697+0000","last_active":"2024-09-19T06:13:13.986968+0000","last_peered":"2024-09-19T06:13:13.986968+0000","last_clean":"2024-09-19T06:13:13.986968+0000","last_became_active":"2024-09-19T06:13:03.793378+0000","last_became_peered":"2024-09-19T06:13:03.793378+0000","last_unstale":"2024-09-19T06:13:13.986968+0000","last_undegraded":"2024-09-19T06:13:13.986968+0000","last_fullsized":"2024-09-19T06:13:13.986968+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:29:44.236255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836624+0000","last_change":"2024-09-19T06:13:01.658035+0000","last_active":"2024-09-19T06:13:13.836624+0000","last_peered":"2024-09-19T06:13:13.836624+0000","last_clean":"2024-09-19T06:13:13.836624+0000","last_became_active":"2024-09-19T06:13:01.657602+0000","last_became_peered":"2024-09-19T06:13:01.657602+0000","last_unstale":"2024-09-19T06:13:13.836624+0000","last_undegraded":"2024-09-19T06:13:13.836624+0000","last_fullsized":"2024-09-19T06:13:13.836624+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:27.015086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.830368+0000","last_change":"2024-09-19T06:13:03.793377+0000","last_active":"2024-09-19T06:13:13.830368+0000","last_peered":"2024-09-19T06:13:13.830368+0000","last_clean":"2024-09-19T06:13:13.830368+0000","last_became_active":"2024-09-19T06:13:03.793047+0000","last_became_peered":"2024-09-19T06:13:03.793047+0000","last_unstale":"2024-09-19T06:13:13.830368+0000","last_undegraded":"2024-09-19T06:13:13.830368+0000","last_fullsized":"2024-09-19T06:13:13.830368+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:22.883358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":73,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:14:02.941995+0000","last_change":"2024-09-19T06:13:01.650179+0000","last_active":"2024-09-19T06:14:02.941995+0000","last_peered":"2024-09-19T06:14:02.941995+0000","last_clean":"2024-09-19T06:14:02.941995+0000","last_became_active":"2024-09-19T06:13:01.649889+0000","last_became_peered":"2024-09-19T06:13:01.649889+0000","last_unstale":"2024-09-19T06:14:02.941995+0000","last_undegraded":"2024-09-19T06:14:02.941995+0000","last_fullsized":"2024-09-19T06:14:02.941995+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:55:00.400406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837144+0000","last_change":"2024-09-19T06:13:03.800277+0000","last_active":"2024-09-19T06:13:13.837144+0000","last_peered":"2024-09-19T06:13:13.837144+0000","last_clean":"2024-09-19T06:13:13.837144+0000","last_became_active":"2024-09-19T06:13:03.799862+0000","last_became_peered":"2024-09-19T06:13:03.799862+0000","last_unstale":"2024-09-19T06:13:13.837144+0000","last_undegraded":"2024-09-19T06:13:13.837144+0000","last_fullsized":"2024-09-19T06:13:13.837144+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:51.558276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837565+0000","last_change":"2024-09-19T06:13:01.659592+0000","last_active":"2024-09-19T06:13:13.837565+0000","last_peered":"2024-09-19T06:13:13.837565+0000","last_clean":"2024-09-19T06:13:13.837565+0000","last_became_active":"2024-09-19T06:13:01.659258+0000","last_became_peered":"2024-09-19T06:13:01.659258+0000","last_unstale":"2024-09-19T06:13:13.837565+0000","last_undegraded":"2024-09-19T06:13:13.837565+0000","last_fullsized":"2024-09-19T06:13:13.837565+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:46.097656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.831602+0000","last_change":"2024-09-19T06:13:03.793100+0000","last_active":"2024-09-19T06:13:13.831602+0000","last_peered":"2024-09-19T06:13:13.831602+0000","last_clean":"2024-09-19T06:13:13.831602+0000","last_became_active":"2024-09-19T06:13:03.792768+0000","last_became_peered":"2024-09-19T06:13:03.792768+0000","last_unstale":"2024-09-19T06:13:13.831602+0000","last_undegraded":"2024-09-19T06:13:13.831602+0000","last_fullsized":"2024-09-19T06:13:13.831602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:11:36.122712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.833570+0000","last_change":"2024-09-19T06:13:01.650511+0000","last_active":"2024-09-19T06:13:13.833570+0000","last_peered":"2024-09-19T06:13:13.833570+0000","last_clean":"2024-09-19T06:13:13.833570+0000","last_became_active":"2024-09-19T06:13:01.650099+0000","last_became_peered":"2024-09-19T06:13:01.650099+0000","last_unstale":"2024-09-19T06:13:13.833570+0000","last_undegraded":"2024-09-19T06:13:13.833570+0000","last_fullsized":"2024-09-19T06:13:13.833570+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:16.386025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.831722+0000","last_change":"2024-09-19T06:13:03.783690+0000","last_active":"2024-09-19T06:13:13.831722+0000","last_peered":"2024-09-19T06:13:13.831722+0000","last_clean":"2024-09-19T06:13:13.831722+0000","last_became_active":"2024-09-19T06:13:03.783296+0000","last_became_peered":"2024-09-19T06:13:03.783296+0000","last_unstale":"2024-09-19T06:13:13.831722+0000","last_undegraded":"2024-09-19T06:13:13.831722+0000","last_fullsized":"2024-09-19T06:13:13.831722+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:49:19.605979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"79'1","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834623+0000","last_change":"2024-09-19T06:13:01.648671+0000","last_active":"2024-09-19T06:13:13.834623+0000","last_peered":"2024-09-19T06:13:13.834623+0000","last_clean":"2024-09-19T06:13:13.834623+0000","last_became_active":"2024-09-19T06:13:01.647329+0000","last_became_peered":"2024-09-19T06:13:01.647329+0000","last_unstale":"2024-09-19T06:13:13.834623+0000","last_undegraded":"2024-09-19T06:13:13.834623+0000","last_fullsized":"2024-09-19T06:13:13.834623+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:31.026561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.830593+0000","last_change":"2024-09-19T06:13:03.795195+0000","last_active":"2024-09-19T06:13:13.830593+0000","last_peered":"2024-09-19T06:13:13.830593+0000","last_clean":"2024-09-19T06:13:13.830593+0000","last_became_active":"2024-09-19T06:13:03.794882+0000","last_became_peered":"2024-09-19T06:13:03.794882+0000","last_unstale":"2024-09-19T06:13:13.830593+0000","last_undegraded":"2024-09-19T06:13:13.830593+0000","last_fullsized":"2024-09-19T06:13:13.830593+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:47.290917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'11","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:28.796882+0000","last_change":"2024-09-19T06:13:01.652133+0000","last_active":"2024-09-19T06:13:28.796882+0000","last_peered":"2024-09-19T06:13:28.796882+0000","last_clean":"2024-09-19T06:13:28.796882+0000","last_became_active":"2024-09-19T06:13:01.651796+0000","last_became_peered":"2024-09-19T06:13:01.651796+0000","last_unstale":"2024-09-19T06:13:28.796882+0000","last_undegraded":"2024-09-19T06:13:28.796882+0000","last_fullsized":"2024-09-19T06:13:28.796882+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:01.576308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.987457+0000","last_change":"2024-09-19T06:13:03.799332+0000","last_active":"2024-09-19T06:13:13.987457+0000","last_peered":"2024-09-19T06:13:13.987457+0000","last_clean":"2024-09-19T06:13:13.987457+0000","last_became_active":"2024-09-19T06:13:03.798996+0000","last_became_peered":"2024-09-19T06:13:03.798996+0000","last_unstale":"2024-09-19T06:13:13.987457+0000","last_undegraded":"2024-09-19T06:13:13.987457+0000","last_fullsized":"2024-09-19T06:13:13.987457+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:37:32.245396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836564+0000","last_change":"2024-09-19T06:13:01.652392+0000","last_active":"2024-09-19T06:13:13.836564+0000","last_peered":"2024-09-19T06:13:13.836564+0000","last_clean":"2024-09-19T06:13:13.836564+0000","last_became_active":"2024-09-19T06:13:01.651982+0000","last_became_peered":"2024-09-19T06:13:01.651982+0000","last_unstale":"2024-09-19T06:13:13.836564+0000","last_undegraded":"2024-09-19T06:13:13.836564+0000","last_fullsized":"2024-09-19T06:13:13.836564+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:15:39.590215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.988765+0000","last_change":"2024-09-19T06:13:13.988765+0000","last_active":"2024-09-19T06:13:13.988765+0000","last_peered":"2024-09-19T06:13:13.988765+0000","last_clean":"2024-09-19T06:13:13.988765+0000","last_became_active":"2024-09-19T06:13:13.988328+0000","last_became_peered":"2024-09-19T06:13:13.988328+0000","last_unstale":"2024-09-19T06:13:13.988765+0000","last_undegraded":"2024-09-19T06:13:13.988765+0000","last_fullsized":"2024-09-19T06:13:13.988765+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:10.219202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.986807+0000","last_change":"2024-09-19T06:13:01.658954+0000","last_active":"2024-09-19T06:13:13.986807+0000","last_peered":"2024-09-19T06:13:13.986807+0000","last_clean":"2024-09-19T06:13:13.986807+0000","last_became_active":"2024-09-19T06:13:01.658453+0000","last_became_peered":"2024-09-19T06:13:01.658453+0000","last_unstale":"2024-09-19T06:13:13.986807+0000","last_undegraded":"2024-09-19T06:13:13.986807+0000","last_fullsized":"2024-09-19T06:13:13.986807+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:17.134858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834131+0000","last_change":"2024-09-19T06:13:03.786812+0000","last_active":"2024-09-19T06:13:13.834131+0000","last_peered":"2024-09-19T06:13:13.834131+0000","last_clean":"2024-09-19T06:13:13.834131+0000","last_became_active":"2024-09-19T06:13:03.786481+0000","last_became_peered":"2024-09-19T06:13:03.786481+0000","last_unstale":"2024-09-19T06:13:13.834131+0000","last_undegraded":"2024-09-19T06:13:13.834131+0000","last_fullsized":"2024-09-19T06:13:13.834131+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:46.614073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.986953+0000","last_change":"2024-09-19T06:13:01.652062+0000","last_active":"2024-09-19T06:13:13.986953+0000","last_peered":"2024-09-19T06:13:13.986953+0000","last_clean":"2024-09-19T06:13:13.986953+0000","last_became_active":"2024-09-19T06:13:01.651718+0000","last_became_peered":"2024-09-19T06:13:01.651718+0000","last_unstale":"2024-09-19T06:13:13.986953+0000","last_undegraded":"2024-09-19T06:13:13.986953+0000","last_fullsized":"2024-09-19T06:13:13.986953+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:22.428954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.833537+0000","last_change":"2024-09-19T06:13:03.792868+0000","last_active":"2024-09-19T06:13:13.833537+0000","last_peered":"2024-09-19T06:13:13.833537+0000","last_clean":"2024-09-19T06:13:13.833537+0000","last_became_active":"2024-09-19T06:13:03.792482+0000","last_became_peered":"2024-09-19T06:13:03.792482+0000","last_unstale":"2024-09-19T06:13:13.833537+0000","last_undegraded":"2024-09-19T06:13:13.833537+0000","last_fullsized":"2024-09-19T06:13:13.833537+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:05:11.294500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.840945+0000","last_change":"2024-09-19T06:13:01.654572+0000","last_active":"2024-09-19T06:13:13.840945+0000","last_peered":"2024-09-19T06:13:13.840945+0000","last_clean":"2024-09-19T06:13:13.840945+0000","last_became_active":"2024-09-19T06:13:01.653865+0000","last_became_peered":"2024-09-19T06:13:01.653865+0000","last_unstale":"2024-09-19T06:13:13.840945+0000","last_undegraded":"2024-09-19T06:13:13.840945+0000","last_fullsized":"2024-09-19T06:13:13.840945+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:45.842230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.987135+0000","last_change":"2024-09-19T06:13:03.791077+0000","last_active":"2024-09-19T06:13:13.987135+0000","last_peered":"2024-09-19T06:13:13.987135+0000","last_clean":"2024-09-19T06:13:13.987135+0000","last_became_active":"2024-09-19T06:13:03.790710+0000","last_became_peered":"2024-09-19T06:13:03.790710+0000","last_unstale":"2024-09-19T06:13:13.987135+0000","last_undegraded":"2024-09-19T06:13:13.987135+0000","last_fullsized":"2024-09-19T06:13:13.987135+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:15:53.498311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.992580+0000","last_change":"2024-09-19T06:13:13.992222+0000","last_active":"2024-09-19T06:13:13.992580+0000","last_peered":"2024-09-19T06:13:13.992580+0000","last_clean":"2024-09-19T06:13:13.992580+0000","last_became_active":"2024-09-19T06:13:13.988046+0000","last_became_peered":"2024-09-19T06:13:13.988046+0000","last_unstale":"2024-09-19T06:13:13.992580+0000","last_undegraded":"2024-09-19T06:13:13.992580+0000","last_fullsized":"2024-09-19T06:13:13.992580+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:21:56.013401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837205+0000","last_change":"2024-09-19T06:13:03.808060+0000","last_active":"2024-09-19T06:13:13.837205+0000","last_peered":"2024-09-19T06:13:13.837205+0000","last_clean":"2024-09-19T06:13:13.837205+0000","last_became_active":"2024-09-19T06:13:03.807455+0000","last_became_peered":"2024-09-19T06:13:03.807455+0000","last_unstale":"2024-09-19T06:13:13.837205+0000","last_undegraded":"2024-09-19T06:13:13.837205+0000","last_fullsized":"2024-09-19T06:13:13.837205+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:27:19.172298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.988516+0000","last_change":"2024-09-19T06:13:13.987967+0000","last_active":"2024-09-19T06:13:13.988516+0000","last_peered":"2024-09-19T06:13:13.988516+0000","last_clean":"2024-09-19T06:13:13.988516+0000","last_became_active":"2024-09-19T06:13:13.987431+0000","last_became_peered":"2024-09-19T06:13:13.987431+0000","last_unstale":"2024-09-19T06:13:13.988516+0000","last_undegraded":"2024-09-19T06:13:13.988516+0000","last_fullsized":"2024-09-19T06:13:13.988516+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:05.785455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,1],"acting":[9,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834591+0000","last_change":"2024-09-19T06:13:01.658264+0000","last_active":"2024-09-19T06:13:13.834591+0000","last_peered":"2024-09-19T06:13:13.834591+0000","last_clean":"2024-09-19T06:13:13.834591+0000","last_became_active":"2024-09-19T06:13:01.657912+0000","last_became_peered":"2024-09-19T06:13:01.657912+0000","last_unstale":"2024-09-19T06:13:13.834591+0000","last_undegraded":"2024-09-19T06:13:13.834591+0000","last_fullsized":"2024-09-19T06:13:13.834591+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:19.618987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.986874+0000","last_change":"2024-09-19T06:13:03.791917+0000","last_active":"2024-09-19T06:13:13.986874+0000","last_peered":"2024-09-19T06:13:13.986874+0000","last_clean":"2024-09-19T06:13:13.986874+0000","last_became_active":"2024-09-19T06:13:03.791284+0000","last_became_peered":"2024-09-19T06:13:03.791284+0000","last_unstale":"2024-09-19T06:13:13.986874+0000","last_undegraded":"2024-09-19T06:13:13.986874+0000","last_fullsized":"2024-09-19T06:13:13.986874+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:29.685827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.851212+0000","last_change":"2024-09-19T06:13:13.850753+0000","last_active":"2024-09-19T06:13:13.851212+0000","last_peered":"2024-09-19T06:13:13.851212+0000","last_clean":"2024-09-19T06:13:13.851212+0000","last_became_active":"2024-09-19T06:13:13.843601+0000","last_became_peered":"2024-09-19T06:13:13.843601+0000","last_unstale":"2024-09-19T06:13:13.851212+0000","last_undegraded":"2024-09-19T06:13:13.851212+0000","last_fullsized":"2024-09-19T06:13:13.851212+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:11.452118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.835131+0000","last_change":"2024-09-19T06:13:03.798722+0000","last_active":"2024-09-19T06:13:13.835131+0000","last_peered":"2024-09-19T06:13:13.835131+0000","last_clean":"2024-09-19T06:13:13.835131+0000","last_became_active":"2024-09-19T06:13:03.798428+0000","last_became_peered":"2024-09-19T06:13:03.798428+0000","last_unstale":"2024-09-19T06:13:13.835131+0000","last_undegraded":"2024-09-19T06:13:13.835131+0000","last_fullsized":"2024-09-19T06:13:13.835131+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:11:15.179515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.987601+0000","last_change":"2024-09-19T06:13:01.651003+0000","last_active":"2024-09-19T06:13:13.987601+0000","last_peered":"2024-09-19T06:13:13.987601+0000","last_clean":"2024-09-19T06:13:13.987601+0000","last_became_active":"2024-09-19T06:13:01.650697+0000","last_became_peered":"2024-09-19T06:13:01.650697+0000","last_unstale":"2024-09-19T06:13:13.987601+0000","last_undegraded":"2024-09-19T06:13:13.987601+0000","last_fullsized":"2024-09-19T06:13:13.987601+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:47.982845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.987236+0000","last_change":"2024-09-19T06:13:03.796907+0000","last_active":"2024-09-19T06:13:13.987236+0000","last_peered":"2024-09-19T06:13:13.987236+0000","last_clean":"2024-09-19T06:13:13.987236+0000","last_became_active":"2024-09-19T06:13:03.796426+0000","last_became_peered":"2024-09-19T06:13:03.796426+0000","last_unstale":"2024-09-19T06:13:13.987236+0000","last_undegraded":"2024-09-19T06:13:13.987236+0000","last_fullsized":"2024-09-19T06:13:13.987236+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:26.455773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.833916+0000","last_change":"2024-09-19T06:13:01.654788+0000","last_active":"2024-09-19T06:13:13.833916+0000","last_peered":"2024-09-19T06:13:13.833916+0000","last_clean":"2024-09-19T06:13:13.833916+0000","last_became_active":"2024-09-19T06:13:01.654461+0000","last_became_peered":"2024-09-19T06:13:01.654461+0000","last_unstale":"2024-09-19T06:13:13.833916+0000","last_undegraded":"2024-09-19T06:13:13.833916+0000","last_fullsized":"2024-09-19T06:13:13.833916+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:41.374288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":62821,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":303,"num_read_kb":219,"num_write":159,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":644,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":188463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612633,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":880640,"data_stored":430117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841566,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28560,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716592,"statfs":{"total":95995035648,"available":95965790208,"internally_reserved":0,"allocated":1572864,"data_stored":1080787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005092,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":430331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234025,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":888832,"data_stored":430229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462957,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28476,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716676,"statfs":{"total":95995035648,"available":95965876224,"internally_reserved":0,"allocated":1486848,"data_stored":1021790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593779,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40364,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704788,"statfs":{"total":95995035648,"available":95953702912,"internally_reserved":0,"allocated":880640,"data_stored":429720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822711,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28488,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716664,"statfs":{"total":95995035648,"available":95965863936,"internally_reserved":0,"allocated":1499136,"data_stored":1021474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986237,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":892928,"data_stored":430779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215170,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":897024,"data_stored":430031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444103,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":489452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32104,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713048,"statfs":{"total":95995035648,"available":95962161152,"internally_reserved":0,"allocated":942080,"data_stored":488724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":901120,"data_stored":430991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":59939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":60789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:14:08.528 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T06:14:08.782 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:09.069 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:08 smithi002 ceph-mon[30982]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:14:09.070 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:08 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:14:09.070 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:08 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:14:09.070 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:08 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:14:09.070 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:08 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:14:09.070 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:08 smithi002 ceph-mon[30982]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:14:09.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:08 smithi090 ceph-mon[34497]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:14:09.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:08 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:14:09.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:08 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:14:09.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:08 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:14:09.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:08 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:14:09.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:08 smithi090 ceph-mon[34497]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:14:09.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.256+0000 7f471412b640 1 -- 172.21.15.2:0/2455673341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f470c102ef0 msgr2=0x7f470c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:09.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.256+0000 7f471412b640 1 --2- 172.21.15.2:0/2455673341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f470c102ef0 0x7f470c10da40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4704009ca0 tx=0x7f470402a950 comp rx=0 tx=0).stop 2024-09-19T06:14:09.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.257+0000 7f471412b640 1 -- 172.21.15.2:0/2455673341 shutdown_connections 2024-09-19T06:14:09.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.257+0000 7f471412b640 1 --2- 172.21.15.2:0/2455673341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f470c102ef0 0x7f470c10da40 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:09.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.257+0000 7f471412b640 1 --2- 172.21.15.2:0/2455673341 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f470c102570 0x7f470c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:09.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.257+0000 7f471412b640 1 --2- 172.21.15.2:0/2455673341 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f470c100e20 0x7f470c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:09.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.257+0000 7f471412b640 1 -- 172.21.15.2:0/2455673341 >> 172.21.15.2:0/2455673341 conn(0x7f470c0fc7d0 msgr2=0x7f470c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:09.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.257+0000 7f471412b640 1 -- 172.21.15.2:0/2455673341 shutdown_connections 2024-09-19T06:14:09.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.257+0000 7f471412b640 1 -- 172.21.15.2:0/2455673341 wait complete. 2024-09-19T06:14:09.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.257+0000 7f471412b640 1 Processor -- start 2024-09-19T06:14:09.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.257+0000 7f471412b640 1 -- start start 2024-09-19T06:14:09.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.257+0000 7f471412b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f470c100e20 0x7f470c197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:09.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.257+0000 7f471412b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f470c102570 0x7f470c197870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:09.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.258+0000 7f471412b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f470c102ef0 0x7f470c19bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:09.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.258+0000 7f471412b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f470c110e30 con 0x7f470c100e20 2024-09-19T06:14:09.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.258+0000 7f471412b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f470c110cb0 con 0x7f470c102ef0 2024-09-19T06:14:09.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.258+0000 7f471412b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f470c110fb0 con 0x7f470c102570 2024-09-19T06:14:09.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.258+0000 7f4711ec7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f470c100e20 0x7f470c197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:09.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.258+0000 7f4711ec7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f470c100e20 0x7f470c197330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42084/0 (socket says 172.21.15.2:42084) 2024-09-19T06:14:09.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.258+0000 7f4711ec7640 1 -- 172.21.15.2:0/1118512684 learned_addr learned my addr 172.21.15.2:0/1118512684 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:09.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.258+0000 7f47126c8640 1 --2- 172.21.15.2:0/1118512684 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f470c102ef0 0x7f470c19bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:09.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.258+0000 7f47116c6640 1 --2- 172.21.15.2:0/1118512684 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f470c102570 0x7f470c197870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:09.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.258+0000 7f4711ec7640 1 -- 172.21.15.2:0/1118512684 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f470c102570 msgr2=0x7f470c197870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:09.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.258+0000 7f4711ec7640 1 --2- 172.21.15.2:0/1118512684 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f470c102570 0x7f470c197870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:09.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.258+0000 7f4711ec7640 1 -- 172.21.15.2:0/1118512684 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f470c102ef0 msgr2=0x7f470c19bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:09.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.258+0000 7f4711ec7640 1 --2- 172.21.15.2:0/1118512684 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f470c102ef0 0x7f470c19bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:09.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.258+0000 7f4711ec7640 1 -- 172.21.15.2:0/1118512684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f470c19c2e0 con 0x7f470c100e20 2024-09-19T06:14:09.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.258+0000 7f4711ec7640 1 --2- 172.21.15.2:0/1118512684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f470c100e20 0x7f470c197330 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4708009970 tx=0x7f4708009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:09.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.258+0000 7f4702ffd640 1 -- 172.21.15.2:0/1118512684 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470800d020 con 0x7f470c100e20 2024-09-19T06:14:09.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.258+0000 7f4702ffd640 1 -- 172.21.15.2:0/1118512684 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f470800d1c0 con 0x7f470c100e20 2024-09-19T06:14:09.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.258+0000 7f4702ffd640 1 -- 172.21.15.2:0/1118512684 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470800cc50 con 0x7f470c100e20 2024-09-19T06:14:09.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.258+0000 7f471412b640 1 -- 172.21.15.2:0/1118512684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f470c19c5d0 con 0x7f470c100e20 2024-09-19T06:14:09.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.259+0000 7f471412b640 1 -- 172.21.15.2:0/1118512684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f470c069f70 con 0x7f470c100e20 2024-09-19T06:14:09.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.260+0000 7f471412b640 1 -- 172.21.15.2:0/1118512684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f470c101200 con 0x7f470c100e20 2024-09-19T06:14:09.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.261+0000 7f4702ffd640 1 -- 172.21.15.2:0/1118512684 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f470800c460 con 0x7f470c100e20 2024-09-19T06:14:09.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.262+0000 7f4702ffd640 1 --2- 172.21.15.2:0/1118512684 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f46f80a3350 0x7f46f80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:09.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.262+0000 7f47116c6640 1 --2- 172.21.15.2:0/1118512684 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f46f80a3350 0x7f46f80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:09.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.262+0000 7f4702ffd640 1 -- 172.21.15.2:0/1118512684 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f47080d1230 con 0x7f470c100e20 2024-09-19T06:14:09.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.262+0000 7f47116c6640 1 --2- 172.21.15.2:0/1118512684 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f46f80a3350 0x7f46f80a5810 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f470c0ffe20 tx=0x7f46fc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:09.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.265+0000 7f4702ffd640 1 -- 172.21.15.2:0/1118512684 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f470809d750 con 0x7f470c100e20 2024-09-19T06:14:09.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:08 smithi089 ceph-mon[34160]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:14:09.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:08 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:14:09.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:08 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:14:09.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:08 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:14:09.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:08 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:14:09.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:08 smithi089 ceph-mon[34160]: from='mgr.14150 172.21.15.2:0/1681471349' entity='mgr.x' 2024-09-19T06:14:09.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.440+0000 7f471412b640 1 -- 172.21.15.2:0/1118512684 --> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f470c06a290 con 0x7f46f80a3350 2024-09-19T06:14:09.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.447+0000 7f4702ffd640 1 -- 172.21.15.2:0/1118512684 <== mgr.14150 v2:172.21.15.2:6800/4180340554 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258704 (secure 0 0 0) 0x7f470c06a290 con 0x7f46f80a3350 2024-09-19T06:14:09.451 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:14:09.452 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-19T06:14:09.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.450+0000 7f471412b640 1 -- 172.21.15.2:0/1118512684 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f46f80a3350 msgr2=0x7f46f80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:09.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.450+0000 7f471412b640 1 --2- 172.21.15.2:0/1118512684 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f46f80a3350 0x7f46f80a5810 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f470c0ffe20 tx=0x7f46fc00b390 comp rx=0 tx=0).stop 2024-09-19T06:14:09.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.450+0000 7f471412b640 1 -- 172.21.15.2:0/1118512684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f470c100e20 msgr2=0x7f470c197330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:09.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.450+0000 7f471412b640 1 --2- 172.21.15.2:0/1118512684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f470c100e20 0x7f470c197330 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4708009970 tx=0x7f4708009e30 comp rx=0 tx=0).stop 2024-09-19T06:14:09.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.451+0000 7f471412b640 1 -- 172.21.15.2:0/1118512684 shutdown_connections 2024-09-19T06:14:09.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.451+0000 7f471412b640 1 --2- 172.21.15.2:0/1118512684 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f46f80a3350 0x7f46f80a5810 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:09.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.451+0000 7f471412b640 1 --2- 172.21.15.2:0/1118512684 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f470c102ef0 0x7f470c19bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:09.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.451+0000 7f471412b640 1 --2- 172.21.15.2:0/1118512684 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f470c102570 0x7f470c197870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:09.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.451+0000 7f471412b640 1 --2- 172.21.15.2:0/1118512684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f470c100e20 0x7f470c197330 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:09.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.451+0000 7f471412b640 1 -- 172.21.15.2:0/1118512684 >> 172.21.15.2:0/1118512684 conn(0x7f470c0fc7d0 msgr2=0x7f470c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:09.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.451+0000 7f471412b640 1 -- 172.21.15.2:0/1118512684 shutdown_connections 2024-09-19T06:14:09.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:09.451+0000 7f471412b640 1 -- 172.21.15.2:0/1118512684 wait complete. 2024-09-19T06:14:10.069 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:09 smithi002 ceph-mon[30982]: pgmap v309: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:10.098 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":309,"stamp":"2024-09-19T06:14:08.016792+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653423,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":439,"num_read_kb":338,"num_write":342,"num_write_kb":3046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1181380,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":274,"ondisk_log_size":274,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369988,"kb_used_data":12396,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124571836,"statfs":{"total":1151940427776,"available":1151561560064,"internally_reserved":0,"allocated":12693504,"data_stored":7114425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003344"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.833979+0000","last_change":"2024-09-19T06:13:03.799398+0000","last_active":"2024-09-19T06:13:13.833979+0000","last_peered":"2024-09-19T06:13:13.833979+0000","last_clean":"2024-09-19T06:13:13.833979+0000","last_became_active":"2024-09-19T06:13:03.799027+0000","last_became_peered":"2024-09-19T06:13:03.799027+0000","last_unstale":"2024-09-19T06:13:13.833979+0000","last_undegraded":"2024-09-19T06:13:13.833979+0000","last_fullsized":"2024-09-19T06:13:13.833979+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:35:45.934040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834912+0000","last_change":"2024-09-19T06:13:03.791878+0000","last_active":"2024-09-19T06:13:13.834912+0000","last_peered":"2024-09-19T06:13:13.834912+0000","last_clean":"2024-09-19T06:13:13.834912+0000","last_became_active":"2024-09-19T06:13:03.791637+0000","last_became_peered":"2024-09-19T06:13:03.791637+0000","last_unstale":"2024-09-19T06:13:13.834912+0000","last_undegraded":"2024-09-19T06:13:13.834912+0000","last_fullsized":"2024-09-19T06:13:13.834912+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:00.078010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834885+0000","last_change":"2024-09-19T06:13:03.798969+0000","last_active":"2024-09-19T06:13:13.834885+0000","last_peered":"2024-09-19T06:13:13.834885+0000","last_clean":"2024-09-19T06:13:13.834885+0000","last_became_active":"2024-09-19T06:13:03.798410+0000","last_became_peered":"2024-09-19T06:13:03.798410+0000","last_unstale":"2024-09-19T06:13:13.834885+0000","last_undegraded":"2024-09-19T06:13:13.834885+0000","last_fullsized":"2024-09-19T06:13:13.834885+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:48.381506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836750+0000","last_change":"2024-09-19T06:13:03.806455+0000","last_active":"2024-09-19T06:13:13.836750+0000","last_peered":"2024-09-19T06:13:13.836750+0000","last_clean":"2024-09-19T06:13:13.836750+0000","last_became_active":"2024-09-19T06:13:03.805830+0000","last_became_peered":"2024-09-19T06:13:03.805830+0000","last_unstale":"2024-09-19T06:13:13.836750+0000","last_undegraded":"2024-09-19T06:13:13.836750+0000","last_fullsized":"2024-09-19T06:13:13.836750+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:03.206791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834548+0000","last_change":"2024-09-19T06:13:03.785009+0000","last_active":"2024-09-19T06:13:13.834548+0000","last_peered":"2024-09-19T06:13:13.834548+0000","last_clean":"2024-09-19T06:13:13.834548+0000","last_became_active":"2024-09-19T06:13:03.784638+0000","last_became_peered":"2024-09-19T06:13:03.784638+0000","last_unstale":"2024-09-19T06:13:13.834548+0000","last_undegraded":"2024-09-19T06:13:13.834548+0000","last_fullsized":"2024-09-19T06:13:13.834548+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:36:43.099492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.831398+0000","last_change":"2024-09-19T06:13:03.789006+0000","last_active":"2024-09-19T06:13:13.831398+0000","last_peered":"2024-09-19T06:13:13.831398+0000","last_clean":"2024-09-19T06:13:13.831398+0000","last_became_active":"2024-09-19T06:13:03.788639+0000","last_became_peered":"2024-09-19T06:13:03.788639+0000","last_unstale":"2024-09-19T06:13:13.831398+0000","last_undegraded":"2024-09-19T06:13:13.831398+0000","last_fullsized":"2024-09-19T06:13:13.831398+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:18.692491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836740+0000","last_change":"2024-09-19T06:13:03.805264+0000","last_active":"2024-09-19T06:13:13.836740+0000","last_peered":"2024-09-19T06:13:13.836740+0000","last_clean":"2024-09-19T06:13:13.836740+0000","last_became_active":"2024-09-19T06:13:03.804948+0000","last_became_peered":"2024-09-19T06:13:03.804948+0000","last_unstale":"2024-09-19T06:13:13.836740+0000","last_undegraded":"2024-09-19T06:13:13.836740+0000","last_fullsized":"2024-09-19T06:13:13.836740+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:56:26.613785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.841510+0000","last_change":"2024-09-19T06:13:13.841110+0000","last_active":"2024-09-19T06:13:13.841510+0000","last_peered":"2024-09-19T06:13:13.841510+0000","last_clean":"2024-09-19T06:13:13.841510+0000","last_became_active":"2024-09-19T06:13:13.840736+0000","last_became_peered":"2024-09-19T06:13:13.840736+0000","last_unstale":"2024-09-19T06:13:13.841510+0000","last_undegraded":"2024-09-19T06:13:13.841510+0000","last_fullsized":"2024-09-19T06:13:13.841510+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:46.304692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.987340+0000","last_change":"2024-09-19T06:13:03.808432+0000","last_active":"2024-09-19T06:13:13.987340+0000","last_peered":"2024-09-19T06:13:13.987340+0000","last_clean":"2024-09-19T06:13:13.987340+0000","last_became_active":"2024-09-19T06:13:03.808120+0000","last_became_peered":"2024-09-19T06:13:03.808120+0000","last_unstale":"2024-09-19T06:13:13.987340+0000","last_undegraded":"2024-09-19T06:13:13.987340+0000","last_fullsized":"2024-09-19T06:13:13.987340+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:31.270525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.843937+0000","last_change":"2024-09-19T06:13:13.843937+0000","last_active":"2024-09-19T06:13:13.843937+0000","last_peered":"2024-09-19T06:13:13.843937+0000","last_clean":"2024-09-19T06:13:13.843937+0000","last_became_active":"2024-09-19T06:13:13.843541+0000","last_became_peered":"2024-09-19T06:13:13.843541+0000","last_unstale":"2024-09-19T06:13:13.843937+0000","last_undegraded":"2024-09-19T06:13:13.843937+0000","last_fullsized":"2024-09-19T06:13:13.843937+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:23.115055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837559+0000","last_change":"2024-09-19T06:13:03.803361+0000","last_active":"2024-09-19T06:13:13.837559+0000","last_peered":"2024-09-19T06:13:13.837559+0000","last_clean":"2024-09-19T06:13:13.837559+0000","last_became_active":"2024-09-19T06:13:03.802794+0000","last_became_peered":"2024-09-19T06:13:03.802794+0000","last_unstale":"2024-09-19T06:13:13.837559+0000","last_undegraded":"2024-09-19T06:13:13.837559+0000","last_fullsized":"2024-09-19T06:13:13.837559+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:53.126456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836847+0000","last_change":"2024-09-19T06:13:03.806163+0000","last_active":"2024-09-19T06:13:13.836847+0000","last_peered":"2024-09-19T06:13:13.836847+0000","last_clean":"2024-09-19T06:13:13.836847+0000","last_became_active":"2024-09-19T06:13:03.805406+0000","last_became_peered":"2024-09-19T06:13:03.805406+0000","last_unstale":"2024-09-19T06:13:13.836847+0000","last_undegraded":"2024-09-19T06:13:13.836847+0000","last_fullsized":"2024-09-19T06:13:13.836847+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:28:17.793408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.830616+0000","last_change":"2024-09-19T06:13:03.794617+0000","last_active":"2024-09-19T06:13:13.830616+0000","last_peered":"2024-09-19T06:13:13.830616+0000","last_clean":"2024-09-19T06:13:13.830616+0000","last_became_active":"2024-09-19T06:13:03.794264+0000","last_became_peered":"2024-09-19T06:13:03.794264+0000","last_unstale":"2024-09-19T06:13:13.830616+0000","last_undegraded":"2024-09-19T06:13:13.830616+0000","last_fullsized":"2024-09-19T06:13:13.830616+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:32.200624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834631+0000","last_change":"2024-09-19T06:13:03.792632+0000","last_active":"2024-09-19T06:13:13.834631+0000","last_peered":"2024-09-19T06:13:13.834631+0000","last_clean":"2024-09-19T06:13:13.834631+0000","last_became_active":"2024-09-19T06:13:03.792409+0000","last_became_peered":"2024-09-19T06:13:03.792409+0000","last_unstale":"2024-09-19T06:13:13.834631+0000","last_undegraded":"2024-09-19T06:13:13.834631+0000","last_fullsized":"2024-09-19T06:13:13.834631+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:01.193404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834588+0000","last_change":"2024-09-19T06:13:03.801784+0000","last_active":"2024-09-19T06:13:13.834588+0000","last_peered":"2024-09-19T06:13:13.834588+0000","last_clean":"2024-09-19T06:13:13.834588+0000","last_became_active":"2024-09-19T06:13:03.801350+0000","last_became_peered":"2024-09-19T06:13:03.801350+0000","last_unstale":"2024-09-19T06:13:13.834588+0000","last_undegraded":"2024-09-19T06:13:13.834588+0000","last_fullsized":"2024-09-19T06:13:13.834588+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:50:40.542264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.986643+0000","last_change":"2024-09-19T06:13:03.800069+0000","last_active":"2024-09-19T06:13:13.986643+0000","last_peered":"2024-09-19T06:13:13.986643+0000","last_clean":"2024-09-19T06:13:13.986643+0000","last_became_active":"2024-09-19T06:13:03.799690+0000","last_became_peered":"2024-09-19T06:13:03.799690+0000","last_unstale":"2024-09-19T06:13:13.986643+0000","last_undegraded":"2024-09-19T06:13:13.986643+0000","last_fullsized":"2024-09-19T06:13:13.986643+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:36:01.882849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834326+0000","last_change":"2024-09-19T06:13:03.800180+0000","last_active":"2024-09-19T06:13:13.834326+0000","last_peered":"2024-09-19T06:13:13.834326+0000","last_clean":"2024-09-19T06:13:13.834326+0000","last_became_active":"2024-09-19T06:13:03.798981+0000","last_became_peered":"2024-09-19T06:13:03.798981+0000","last_unstale":"2024-09-19T06:13:13.834326+0000","last_undegraded":"2024-09-19T06:13:13.834326+0000","last_fullsized":"2024-09-19T06:13:13.834326+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:29.241021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.833656+0000","last_change":"2024-09-19T06:13:03.796889+0000","last_active":"2024-09-19T06:13:13.833656+0000","last_peered":"2024-09-19T06:13:13.833656+0000","last_clean":"2024-09-19T06:13:13.833656+0000","last_became_active":"2024-09-19T06:13:03.796539+0000","last_became_peered":"2024-09-19T06:13:03.796539+0000","last_unstale":"2024-09-19T06:13:13.833656+0000","last_undegraded":"2024-09-19T06:13:13.833656+0000","last_fullsized":"2024-09-19T06:13:13.833656+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:10.462303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.841576+0000","last_change":"2024-09-19T06:13:03.798758+0000","last_active":"2024-09-19T06:13:13.841576+0000","last_peered":"2024-09-19T06:13:13.841576+0000","last_clean":"2024-09-19T06:13:13.841576+0000","last_became_active":"2024-09-19T06:13:03.798422+0000","last_became_peered":"2024-09-19T06:13:03.798422+0000","last_unstale":"2024-09-19T06:13:13.841576+0000","last_undegraded":"2024-09-19T06:13:13.841576+0000","last_fullsized":"2024-09-19T06:13:13.841576+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:03.712394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.833498+0000","last_change":"2024-09-19T06:13:03.800825+0000","last_active":"2024-09-19T06:13:13.833498+0000","last_peered":"2024-09-19T06:13:13.833498+0000","last_clean":"2024-09-19T06:13:13.833498+0000","last_became_active":"2024-09-19T06:13:03.800505+0000","last_became_peered":"2024-09-19T06:13:03.800505+0000","last_unstale":"2024-09-19T06:13:13.833498+0000","last_undegraded":"2024-09-19T06:13:13.833498+0000","last_fullsized":"2024-09-19T06:13:13.833498+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:15.640802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.830731+0000","last_change":"2024-09-19T06:13:03.797868+0000","last_active":"2024-09-19T06:13:13.830731+0000","last_peered":"2024-09-19T06:13:13.830731+0000","last_clean":"2024-09-19T06:13:13.830731+0000","last_became_active":"2024-09-19T06:13:03.797576+0000","last_became_peered":"2024-09-19T06:13:03.797576+0000","last_unstale":"2024-09-19T06:13:13.830731+0000","last_undegraded":"2024-09-19T06:13:13.830731+0000","last_fullsized":"2024-09-19T06:13:13.830731+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:29:18.953446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.986839+0000","last_change":"2024-09-19T06:13:03.805201+0000","last_active":"2024-09-19T06:13:13.986839+0000","last_peered":"2024-09-19T06:13:13.986839+0000","last_clean":"2024-09-19T06:13:13.986839+0000","last_became_active":"2024-09-19T06:13:03.803758+0000","last_became_peered":"2024-09-19T06:13:03.803758+0000","last_unstale":"2024-09-19T06:13:13.986839+0000","last_undegraded":"2024-09-19T06:13:13.986839+0000","last_fullsized":"2024-09-19T06:13:13.986839+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:49:26.088519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.986859+0000","last_change":"2024-09-19T06:13:03.796086+0000","last_active":"2024-09-19T06:13:13.986859+0000","last_peered":"2024-09-19T06:13:13.986859+0000","last_clean":"2024-09-19T06:13:13.986859+0000","last_became_active":"2024-09-19T06:13:03.795594+0000","last_became_peered":"2024-09-19T06:13:03.795594+0000","last_unstale":"2024-09-19T06:13:13.986859+0000","last_undegraded":"2024-09-19T06:13:13.986859+0000","last_fullsized":"2024-09-19T06:13:13.986859+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:26.374596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837062+0000","last_change":"2024-09-19T06:13:03.796727+0000","last_active":"2024-09-19T06:13:13.837062+0000","last_peered":"2024-09-19T06:13:13.837062+0000","last_clean":"2024-09-19T06:13:13.837062+0000","last_became_active":"2024-09-19T06:13:03.796334+0000","last_became_peered":"2024-09-19T06:13:03.796334+0000","last_unstale":"2024-09-19T06:13:13.837062+0000","last_undegraded":"2024-09-19T06:13:13.837062+0000","last_fullsized":"2024-09-19T06:13:13.837062+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:47.660748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.987433+0000","last_change":"2024-09-19T06:13:03.800994+0000","last_active":"2024-09-19T06:13:13.987433+0000","last_peered":"2024-09-19T06:13:13.987433+0000","last_clean":"2024-09-19T06:13:13.987433+0000","last_became_active":"2024-09-19T06:13:03.800690+0000","last_became_peered":"2024-09-19T06:13:03.800690+0000","last_unstale":"2024-09-19T06:13:13.987433+0000","last_undegraded":"2024-09-19T06:13:13.987433+0000","last_fullsized":"2024-09-19T06:13:13.987433+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:37.204106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.841755+0000","last_change":"2024-09-19T06:13:03.797503+0000","last_active":"2024-09-19T06:13:13.841755+0000","last_peered":"2024-09-19T06:13:13.841755+0000","last_clean":"2024-09-19T06:13:13.841755+0000","last_became_active":"2024-09-19T06:13:03.797189+0000","last_became_peered":"2024-09-19T06:13:03.797189+0000","last_unstale":"2024-09-19T06:13:13.841755+0000","last_undegraded":"2024-09-19T06:13:13.841755+0000","last_fullsized":"2024-09-19T06:13:13.841755+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:16:18.036236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.833849+0000","last_change":"2024-09-19T06:13:03.795462+0000","last_active":"2024-09-19T06:13:13.833849+0000","last_peered":"2024-09-19T06:13:13.833849+0000","last_clean":"2024-09-19T06:13:13.833849+0000","last_became_active":"2024-09-19T06:13:03.793882+0000","last_became_peered":"2024-09-19T06:13:03.793882+0000","last_unstale":"2024-09-19T06:13:13.833849+0000","last_undegraded":"2024-09-19T06:13:13.833849+0000","last_fullsized":"2024-09-19T06:13:13.833849+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:04.329608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.830520+0000","last_change":"2024-09-19T06:13:03.800425+0000","last_active":"2024-09-19T06:13:13.830520+0000","last_peered":"2024-09-19T06:13:13.830520+0000","last_clean":"2024-09-19T06:13:13.830520+0000","last_became_active":"2024-09-19T06:13:03.800061+0000","last_became_peered":"2024-09-19T06:13:03.800061+0000","last_unstale":"2024-09-19T06:13:13.830520+0000","last_undegraded":"2024-09-19T06:13:13.830520+0000","last_fullsized":"2024-09-19T06:13:13.830520+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:36.454869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834825+0000","last_change":"2024-09-19T06:13:03.801630+0000","last_active":"2024-09-19T06:13:13.834825+0000","last_peered":"2024-09-19T06:13:13.834825+0000","last_clean":"2024-09-19T06:13:13.834825+0000","last_became_active":"2024-09-19T06:13:03.801118+0000","last_became_peered":"2024-09-19T06:13:03.801118+0000","last_unstale":"2024-09-19T06:13:13.834825+0000","last_undegraded":"2024-09-19T06:13:13.834825+0000","last_fullsized":"2024-09-19T06:13:13.834825+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:52.641042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.840928+0000","last_change":"2024-09-19T06:13:03.793435+0000","last_active":"2024-09-19T06:13:13.840928+0000","last_peered":"2024-09-19T06:13:13.840928+0000","last_clean":"2024-09-19T06:13:13.840928+0000","last_became_active":"2024-09-19T06:13:03.793138+0000","last_became_peered":"2024-09-19T06:13:03.793138+0000","last_unstale":"2024-09-19T06:13:13.840928+0000","last_undegraded":"2024-09-19T06:13:13.840928+0000","last_fullsized":"2024-09-19T06:13:13.840928+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:40.967328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.841127+0000","last_change":"2024-09-19T06:13:03.800324+0000","last_active":"2024-09-19T06:13:13.841127+0000","last_peered":"2024-09-19T06:13:13.841127+0000","last_clean":"2024-09-19T06:13:13.841127+0000","last_became_active":"2024-09-19T06:13:03.799996+0000","last_became_peered":"2024-09-19T06:13:03.799996+0000","last_unstale":"2024-09-19T06:13:13.841127+0000","last_undegraded":"2024-09-19T06:13:13.841127+0000","last_fullsized":"2024-09-19T06:13:13.841127+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:04.012607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.833462+0000","last_change":"2024-09-19T06:13:03.794669+0000","last_active":"2024-09-19T06:13:13.833462+0000","last_peered":"2024-09-19T06:13:13.833462+0000","last_clean":"2024-09-19T06:13:13.833462+0000","last_became_active":"2024-09-19T06:13:03.794333+0000","last_became_peered":"2024-09-19T06:13:03.794333+0000","last_unstale":"2024-09-19T06:13:13.833462+0000","last_undegraded":"2024-09-19T06:13:13.833462+0000","last_fullsized":"2024-09-19T06:13:13.833462+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:27.690064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834261+0000","last_change":"2024-09-19T06:13:03.794058+0000","last_active":"2024-09-19T06:13:13.834261+0000","last_peered":"2024-09-19T06:13:13.834261+0000","last_clean":"2024-09-19T06:13:13.834261+0000","last_became_active":"2024-09-19T06:13:03.793710+0000","last_became_peered":"2024-09-19T06:13:03.793710+0000","last_unstale":"2024-09-19T06:13:13.834261+0000","last_undegraded":"2024-09-19T06:13:13.834261+0000","last_fullsized":"2024-09-19T06:13:13.834261+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:56:05.395718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"79'5","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:14:01.940682+0000","last_change":"2024-09-19T06:13:13.848686+0000","last_active":"2024-09-19T06:14:01.940682+0000","last_peered":"2024-09-19T06:14:01.940682+0000","last_clean":"2024-09-19T06:14:01.940682+0000","last_became_active":"2024-09-19T06:13:13.843205+0000","last_became_peered":"2024-09-19T06:13:13.843205+0000","last_unstale":"2024-09-19T06:14:01.940682+0000","last_undegraded":"2024-09-19T06:14:01.940682+0000","last_fullsized":"2024-09-19T06:14:01.940682+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:49.016417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":48,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836811+0000","last_change":"2024-09-19T06:13:03.801206+0000","last_active":"2024-09-19T06:13:13.836811+0000","last_peered":"2024-09-19T06:13:13.836811+0000","last_clean":"2024-09-19T06:13:13.836811+0000","last_became_active":"2024-09-19T06:13:03.800661+0000","last_became_peered":"2024-09-19T06:13:03.800661+0000","last_unstale":"2024-09-19T06:13:13.836811+0000","last_undegraded":"2024-09-19T06:13:13.836811+0000","last_fullsized":"2024-09-19T06:13:13.836811+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:28:11.187583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.831489+0000","last_change":"2024-09-19T06:13:01.656487+0000","last_active":"2024-09-19T06:13:13.831489+0000","last_peered":"2024-09-19T06:13:13.831489+0000","last_clean":"2024-09-19T06:13:13.831489+0000","last_became_active":"2024-09-19T06:13:01.656099+0000","last_became_peered":"2024-09-19T06:13:01.656099+0000","last_unstale":"2024-09-19T06:13:13.831489+0000","last_undegraded":"2024-09-19T06:13:13.831489+0000","last_fullsized":"2024-09-19T06:13:13.831489+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:01.437614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.830367+0000","last_change":"2024-09-19T06:13:01.656435+0000","last_active":"2024-09-19T06:13:13.830367+0000","last_peered":"2024-09-19T06:13:13.830367+0000","last_clean":"2024-09-19T06:13:13.830367+0000","last_became_active":"2024-09-19T06:13:01.655660+0000","last_became_peered":"2024-09-19T06:13:01.655660+0000","last_unstale":"2024-09-19T06:13:13.830367+0000","last_undegraded":"2024-09-19T06:13:13.830367+0000","last_fullsized":"2024-09-19T06:13:13.830367+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:35:06.211974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.986952+0000","last_change":"2024-09-19T06:13:03.784573+0000","last_active":"2024-09-19T06:13:13.986952+0000","last_peered":"2024-09-19T06:13:13.986952+0000","last_clean":"2024-09-19T06:13:13.986952+0000","last_became_active":"2024-09-19T06:13:03.784152+0000","last_became_peered":"2024-09-19T06:13:03.784152+0000","last_unstale":"2024-09-19T06:13:13.986952+0000","last_undegraded":"2024-09-19T06:13:13.986952+0000","last_fullsized":"2024-09-19T06:13:13.986952+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:28:39.606178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'1","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837384+0000","last_change":"2024-09-19T06:13:01.656150+0000","last_active":"2024-09-19T06:13:13.837384+0000","last_peered":"2024-09-19T06:13:13.837384+0000","last_clean":"2024-09-19T06:13:13.837384+0000","last_became_active":"2024-09-19T06:13:01.655826+0000","last_became_peered":"2024-09-19T06:13:01.655826+0000","last_unstale":"2024-09-19T06:13:13.837384+0000","last_undegraded":"2024-09-19T06:13:13.837384+0000","last_fullsized":"2024-09-19T06:13:13.837384+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:57.782393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.833363+0000","last_change":"2024-09-19T06:13:03.784567+0000","last_active":"2024-09-19T06:13:13.833363+0000","last_peered":"2024-09-19T06:13:13.833363+0000","last_clean":"2024-09-19T06:13:13.833363+0000","last_became_active":"2024-09-19T06:13:03.784187+0000","last_became_peered":"2024-09-19T06:13:03.784187+0000","last_unstale":"2024-09-19T06:13:13.833363+0000","last_undegraded":"2024-09-19T06:13:13.833363+0000","last_fullsized":"2024-09-19T06:13:13.833363+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:21.037052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'3","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:14:01.940143+0000","last_change":"2024-09-19T06:13:01.659641+0000","last_active":"2024-09-19T06:14:01.940143+0000","last_peered":"2024-09-19T06:14:01.940143+0000","last_clean":"2024-09-19T06:14:01.940143+0000","last_became_active":"2024-09-19T06:13:01.659338+0000","last_became_peered":"2024-09-19T06:13:01.659338+0000","last_unstale":"2024-09-19T06:14:01.940143+0000","last_undegraded":"2024-09-19T06:14:01.940143+0000","last_fullsized":"2024-09-19T06:14:01.940143+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:26.230690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.987249+0000","last_change":"2024-09-19T06:13:03.797095+0000","last_active":"2024-09-19T06:13:13.987249+0000","last_peered":"2024-09-19T06:13:13.987249+0000","last_clean":"2024-09-19T06:13:13.987249+0000","last_became_active":"2024-09-19T06:13:03.796588+0000","last_became_peered":"2024-09-19T06:13:03.796588+0000","last_unstale":"2024-09-19T06:13:13.987249+0000","last_undegraded":"2024-09-19T06:13:13.987249+0000","last_fullsized":"2024-09-19T06:13:13.987249+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:33.705210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836583+0000","last_change":"2024-09-19T06:13:01.659995+0000","last_active":"2024-09-19T06:13:13.836583+0000","last_peered":"2024-09-19T06:13:13.836583+0000","last_clean":"2024-09-19T06:13:13.836583+0000","last_became_active":"2024-09-19T06:13:01.659621+0000","last_became_peered":"2024-09-19T06:13:01.659621+0000","last_unstale":"2024-09-19T06:13:13.836583+0000","last_undegraded":"2024-09-19T06:13:13.836583+0000","last_fullsized":"2024-09-19T06:13:13.836583+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:44.893111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.835148+0000","last_change":"2024-09-19T06:13:03.800859+0000","last_active":"2024-09-19T06:13:13.835148+0000","last_peered":"2024-09-19T06:13:13.835148+0000","last_clean":"2024-09-19T06:13:13.835148+0000","last_became_active":"2024-09-19T06:13:03.800540+0000","last_became_peered":"2024-09-19T06:13:03.800540+0000","last_unstale":"2024-09-19T06:13:13.835148+0000","last_undegraded":"2024-09-19T06:13:13.835148+0000","last_fullsized":"2024-09-19T06:13:13.835148+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:25:11.198557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'4","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837224+0000","last_change":"2024-09-19T06:13:01.654666+0000","last_active":"2024-09-19T06:13:13.837224+0000","last_peered":"2024-09-19T06:13:13.837224+0000","last_clean":"2024-09-19T06:13:13.837224+0000","last_became_active":"2024-09-19T06:13:01.654241+0000","last_became_peered":"2024-09-19T06:13:01.654241+0000","last_unstale":"2024-09-19T06:13:13.837224+0000","last_undegraded":"2024-09-19T06:13:13.837224+0000","last_fullsized":"2024-09-19T06:13:13.837224+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:45.211100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.986872+0000","last_change":"2024-09-19T06:13:03.799906+0000","last_active":"2024-09-19T06:13:13.986872+0000","last_peered":"2024-09-19T06:13:13.986872+0000","last_clean":"2024-09-19T06:13:13.986872+0000","last_became_active":"2024-09-19T06:13:03.799566+0000","last_became_peered":"2024-09-19T06:13:03.799566+0000","last_unstale":"2024-09-19T06:13:13.986872+0000","last_undegraded":"2024-09-19T06:13:13.986872+0000","last_fullsized":"2024-09-19T06:13:13.986872+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:34.268480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'26","reported_seq":148,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:14:02.941652+0000","last_change":"2024-09-19T06:13:01.657204+0000","last_active":"2024-09-19T06:14:02.941652+0000","last_peered":"2024-09-19T06:14:02.941652+0000","last_clean":"2024-09-19T06:14:02.941652+0000","last_became_active":"2024-09-19T06:13:01.656886+0000","last_became_peered":"2024-09-19T06:13:01.656886+0000","last_unstale":"2024-09-19T06:14:02.941652+0000","last_undegraded":"2024-09-19T06:14:02.941652+0000","last_fullsized":"2024-09-19T06:14:02.941652+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:32:18.033428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59211,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":100,"num_read_kb":108,"num_write":27,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834343+0000","last_change":"2024-09-19T06:13:03.798605+0000","last_active":"2024-09-19T06:13:13.834343+0000","last_peered":"2024-09-19T06:13:13.834343+0000","last_clean":"2024-09-19T06:13:13.834343+0000","last_became_active":"2024-09-19T06:13:03.798022+0000","last_became_peered":"2024-09-19T06:13:03.798022+0000","last_unstale":"2024-09-19T06:13:13.834343+0000","last_undegraded":"2024-09-19T06:13:13.834343+0000","last_fullsized":"2024-09-19T06:13:13.834343+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:10.094031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.841613+0000","last_change":"2024-09-19T06:13:01.652192+0000","last_active":"2024-09-19T06:13:13.841613+0000","last_peered":"2024-09-19T06:13:13.841613+0000","last_clean":"2024-09-19T06:13:13.841613+0000","last_became_active":"2024-09-19T06:13:01.651774+0000","last_became_peered":"2024-09-19T06:13:01.651774+0000","last_unstale":"2024-09-19T06:13:13.841613+0000","last_undegraded":"2024-09-19T06:13:13.841613+0000","last_fullsized":"2024-09-19T06:13:13.841613+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:39:47.683863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.830386+0000","last_change":"2024-09-19T06:13:03.798674+0000","last_active":"2024-09-19T06:13:13.830386+0000","last_peered":"2024-09-19T06:13:13.830386+0000","last_clean":"2024-09-19T06:13:13.830386+0000","last_became_active":"2024-09-19T06:13:03.798397+0000","last_became_peered":"2024-09-19T06:13:03.798397+0000","last_unstale":"2024-09-19T06:13:13.830386+0000","last_undegraded":"2024-09-19T06:13:13.830386+0000","last_fullsized":"2024-09-19T06:13:13.830386+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:37.155730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836668+0000","last_change":"2024-09-19T06:13:01.655777+0000","last_active":"2024-09-19T06:13:13.836668+0000","last_peered":"2024-09-19T06:13:13.836668+0000","last_clean":"2024-09-19T06:13:13.836668+0000","last_became_active":"2024-09-19T06:13:01.655420+0000","last_became_peered":"2024-09-19T06:13:01.655420+0000","last_unstale":"2024-09-19T06:13:13.836668+0000","last_undegraded":"2024-09-19T06:13:13.836668+0000","last_fullsized":"2024-09-19T06:13:13.836668+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:02.593204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836731+0000","last_change":"2024-09-19T06:13:03.803799+0000","last_active":"2024-09-19T06:13:13.836731+0000","last_peered":"2024-09-19T06:13:13.836731+0000","last_clean":"2024-09-19T06:13:13.836731+0000","last_became_active":"2024-09-19T06:13:03.803350+0000","last_became_peered":"2024-09-19T06:13:03.803350+0000","last_unstale":"2024-09-19T06:13:13.836731+0000","last_undegraded":"2024-09-19T06:13:13.836731+0000","last_fullsized":"2024-09-19T06:13:13.836731+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:15.806363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'3","reported_seq":73,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:14:01.941055+0000","last_change":"2024-09-19T06:13:01.656007+0000","last_active":"2024-09-19T06:14:01.941055+0000","last_peered":"2024-09-19T06:14:01.941055+0000","last_clean":"2024-09-19T06:14:01.941055+0000","last_became_active":"2024-09-19T06:13:01.655642+0000","last_became_peered":"2024-09-19T06:13:01.655642+0000","last_unstale":"2024-09-19T06:14:01.941055+0000","last_undegraded":"2024-09-19T06:14:01.941055+0000","last_fullsized":"2024-09-19T06:14:01.941055+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:54.391122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":49,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836490+0000","last_change":"2024-09-19T06:13:03.804426+0000","last_active":"2024-09-19T06:13:13.836490+0000","last_peered":"2024-09-19T06:13:13.836490+0000","last_clean":"2024-09-19T06:13:13.836490+0000","last_became_active":"2024-09-19T06:13:03.804146+0000","last_became_peered":"2024-09-19T06:13:03.804146+0000","last_unstale":"2024-09-19T06:13:13.836490+0000","last_undegraded":"2024-09-19T06:13:13.836490+0000","last_fullsized":"2024-09-19T06:13:13.836490+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:56.198679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834205+0000","last_change":"2024-09-19T06:13:01.650023+0000","last_active":"2024-09-19T06:13:13.834205+0000","last_peered":"2024-09-19T06:13:13.834205+0000","last_clean":"2024-09-19T06:13:13.834205+0000","last_became_active":"2024-09-19T06:13:01.649674+0000","last_became_peered":"2024-09-19T06:13:01.649674+0000","last_unstale":"2024-09-19T06:13:13.834205+0000","last_undegraded":"2024-09-19T06:13:13.834205+0000","last_fullsized":"2024-09-19T06:13:13.834205+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:56:11.164070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836300+0000","last_change":"2024-09-19T06:13:03.802078+0000","last_active":"2024-09-19T06:13:13.836300+0000","last_peered":"2024-09-19T06:13:13.836300+0000","last_clean":"2024-09-19T06:13:13.836300+0000","last_became_active":"2024-09-19T06:13:03.801552+0000","last_became_peered":"2024-09-19T06:13:03.801552+0000","last_unstale":"2024-09-19T06:13:13.836300+0000","last_undegraded":"2024-09-19T06:13:13.836300+0000","last_fullsized":"2024-09-19T06:13:13.836300+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:57.025457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:17.875451+0000","last_change":"2024-09-19T06:13:13.843721+0000","last_active":"2024-09-19T06:13:17.875451+0000","last_peered":"2024-09-19T06:13:17.875451+0000","last_clean":"2024-09-19T06:13:17.875451+0000","last_became_active":"2024-09-19T06:13:13.838567+0000","last_became_peered":"2024-09-19T06:13:13.838567+0000","last_unstale":"2024-09-19T06:13:17.875451+0000","last_undegraded":"2024-09-19T06:13:17.875451+0000","last_fullsized":"2024-09-19T06:13:17.875451+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:44.479675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.833649+0000","last_change":"2024-09-19T06:13:03.801534+0000","last_active":"2024-09-19T06:13:13.833649+0000","last_peered":"2024-09-19T06:13:13.833649+0000","last_clean":"2024-09-19T06:13:13.833649+0000","last_became_active":"2024-09-19T06:13:03.801142+0000","last_became_peered":"2024-09-19T06:13:03.801142+0000","last_unstale":"2024-09-19T06:13:13.833649+0000","last_undegraded":"2024-09-19T06:13:13.833649+0000","last_fullsized":"2024-09-19T06:13:13.833649+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:45.029662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.830492+0000","last_change":"2024-09-19T06:13:01.655075+0000","last_active":"2024-09-19T06:13:13.830492+0000","last_peered":"2024-09-19T06:13:13.830492+0000","last_clean":"2024-09-19T06:13:13.830492+0000","last_became_active":"2024-09-19T06:13:01.649236+0000","last_became_peered":"2024-09-19T06:13:01.649236+0000","last_unstale":"2024-09-19T06:13:13.830492+0000","last_undegraded":"2024-09-19T06:13:13.830492+0000","last_fullsized":"2024-09-19T06:13:13.830492+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:06.007418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836658+0000","last_change":"2024-09-19T06:13:03.795674+0000","last_active":"2024-09-19T06:13:13.836658+0000","last_peered":"2024-09-19T06:13:13.836658+0000","last_clean":"2024-09-19T06:13:13.836658+0000","last_became_active":"2024-09-19T06:13:03.794843+0000","last_became_peered":"2024-09-19T06:13:03.794843+0000","last_unstale":"2024-09-19T06:13:13.836658+0000","last_undegraded":"2024-09-19T06:13:13.836658+0000","last_fullsized":"2024-09-19T06:13:13.836658+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:41:57.669988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837389+0000","last_change":"2024-09-19T06:13:01.656696+0000","last_active":"2024-09-19T06:13:13.837389+0000","last_peered":"2024-09-19T06:13:13.837389+0000","last_clean":"2024-09-19T06:13:13.837389+0000","last_became_active":"2024-09-19T06:13:01.655260+0000","last_became_peered":"2024-09-19T06:13:01.655260+0000","last_unstale":"2024-09-19T06:13:13.837389+0000","last_undegraded":"2024-09-19T06:13:13.837389+0000","last_fullsized":"2024-09-19T06:13:13.837389+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:50.281013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837373+0000","last_change":"2024-09-19T06:13:03.804411+0000","last_active":"2024-09-19T06:13:13.837373+0000","last_peered":"2024-09-19T06:13:13.837373+0000","last_clean":"2024-09-19T06:13:13.837373+0000","last_became_active":"2024-09-19T06:13:03.804052+0000","last_became_peered":"2024-09-19T06:13:03.804052+0000","last_unstale":"2024-09-19T06:13:13.837373+0000","last_undegraded":"2024-09-19T06:13:13.837373+0000","last_fullsized":"2024-09-19T06:13:13.837373+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:33.394141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.841525+0000","last_change":"2024-09-19T06:13:01.655164+0000","last_active":"2024-09-19T06:13:13.841525+0000","last_peered":"2024-09-19T06:13:13.841525+0000","last_clean":"2024-09-19T06:13:13.841525+0000","last_became_active":"2024-09-19T06:13:01.654297+0000","last_became_peered":"2024-09-19T06:13:01.654297+0000","last_unstale":"2024-09-19T06:13:13.841525+0000","last_undegraded":"2024-09-19T06:13:13.841525+0000","last_fullsized":"2024-09-19T06:13:13.841525+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:02:02.861982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837562+0000","last_change":"2024-09-19T06:13:03.802799+0000","last_active":"2024-09-19T06:13:13.837562+0000","last_peered":"2024-09-19T06:13:13.837562+0000","last_clean":"2024-09-19T06:13:13.837562+0000","last_became_active":"2024-09-19T06:13:03.802348+0000","last_became_peered":"2024-09-19T06:13:03.802348+0000","last_unstale":"2024-09-19T06:13:13.837562+0000","last_undegraded":"2024-09-19T06:13:13.837562+0000","last_fullsized":"2024-09-19T06:13:13.837562+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:05:52.685874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":345,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837478+0000","last_change":"2024-09-19T06:11:51.805685+0000","last_active":"2024-09-19T06:13:13.837478+0000","last_peered":"2024-09-19T06:13:13.837478+0000","last_clean":"2024-09-19T06:13:13.837478+0000","last_became_active":"2024-09-19T06:11:51.805191+0000","last_became_peered":"2024-09-19T06:11:51.805191+0000","last_unstale":"2024-09-19T06:13:13.837478+0000","last_undegraded":"2024-09-19T06:13:13.837478+0000","last_fullsized":"2024-09-19T06:13:13.837478+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:08:28.556644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:08:28.556644+0000","last_clean_scrub_stamp":"2024-09-19T06:08:28.556644+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:19.169542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:17.875306+0000","last_change":"2024-09-19T06:13:01.656796+0000","last_active":"2024-09-19T06:13:17.875306+0000","last_peered":"2024-09-19T06:13:17.875306+0000","last_clean":"2024-09-19T06:13:17.875306+0000","last_became_active":"2024-09-19T06:13:01.656350+0000","last_became_peered":"2024-09-19T06:13:01.656350+0000","last_unstale":"2024-09-19T06:13:17.875306+0000","last_undegraded":"2024-09-19T06:13:17.875306+0000","last_fullsized":"2024-09-19T06:13:17.875306+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:19:03.820218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.986968+0000","last_change":"2024-09-19T06:13:03.793697+0000","last_active":"2024-09-19T06:13:13.986968+0000","last_peered":"2024-09-19T06:13:13.986968+0000","last_clean":"2024-09-19T06:13:13.986968+0000","last_became_active":"2024-09-19T06:13:03.793378+0000","last_became_peered":"2024-09-19T06:13:03.793378+0000","last_unstale":"2024-09-19T06:13:13.986968+0000","last_undegraded":"2024-09-19T06:13:13.986968+0000","last_fullsized":"2024-09-19T06:13:13.986968+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:29:44.236255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836624+0000","last_change":"2024-09-19T06:13:01.658035+0000","last_active":"2024-09-19T06:13:13.836624+0000","last_peered":"2024-09-19T06:13:13.836624+0000","last_clean":"2024-09-19T06:13:13.836624+0000","last_became_active":"2024-09-19T06:13:01.657602+0000","last_became_peered":"2024-09-19T06:13:01.657602+0000","last_unstale":"2024-09-19T06:13:13.836624+0000","last_undegraded":"2024-09-19T06:13:13.836624+0000","last_fullsized":"2024-09-19T06:13:13.836624+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:27.015086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.830368+0000","last_change":"2024-09-19T06:13:03.793377+0000","last_active":"2024-09-19T06:13:13.830368+0000","last_peered":"2024-09-19T06:13:13.830368+0000","last_clean":"2024-09-19T06:13:13.830368+0000","last_became_active":"2024-09-19T06:13:03.793047+0000","last_became_peered":"2024-09-19T06:13:03.793047+0000","last_unstale":"2024-09-19T06:13:13.830368+0000","last_undegraded":"2024-09-19T06:13:13.830368+0000","last_fullsized":"2024-09-19T06:13:13.830368+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:22.883358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":73,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:14:02.941995+0000","last_change":"2024-09-19T06:13:01.650179+0000","last_active":"2024-09-19T06:14:02.941995+0000","last_peered":"2024-09-19T06:14:02.941995+0000","last_clean":"2024-09-19T06:14:02.941995+0000","last_became_active":"2024-09-19T06:13:01.649889+0000","last_became_peered":"2024-09-19T06:13:01.649889+0000","last_unstale":"2024-09-19T06:14:02.941995+0000","last_undegraded":"2024-09-19T06:14:02.941995+0000","last_fullsized":"2024-09-19T06:14:02.941995+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:55:00.400406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837144+0000","last_change":"2024-09-19T06:13:03.800277+0000","last_active":"2024-09-19T06:13:13.837144+0000","last_peered":"2024-09-19T06:13:13.837144+0000","last_clean":"2024-09-19T06:13:13.837144+0000","last_became_active":"2024-09-19T06:13:03.799862+0000","last_became_peered":"2024-09-19T06:13:03.799862+0000","last_unstale":"2024-09-19T06:13:13.837144+0000","last_undegraded":"2024-09-19T06:13:13.837144+0000","last_fullsized":"2024-09-19T06:13:13.837144+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:51.558276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837565+0000","last_change":"2024-09-19T06:13:01.659592+0000","last_active":"2024-09-19T06:13:13.837565+0000","last_peered":"2024-09-19T06:13:13.837565+0000","last_clean":"2024-09-19T06:13:13.837565+0000","last_became_active":"2024-09-19T06:13:01.659258+0000","last_became_peered":"2024-09-19T06:13:01.659258+0000","last_unstale":"2024-09-19T06:13:13.837565+0000","last_undegraded":"2024-09-19T06:13:13.837565+0000","last_fullsized":"2024-09-19T06:13:13.837565+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:46.097656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.831602+0000","last_change":"2024-09-19T06:13:03.793100+0000","last_active":"2024-09-19T06:13:13.831602+0000","last_peered":"2024-09-19T06:13:13.831602+0000","last_clean":"2024-09-19T06:13:13.831602+0000","last_became_active":"2024-09-19T06:13:03.792768+0000","last_became_peered":"2024-09-19T06:13:03.792768+0000","last_unstale":"2024-09-19T06:13:13.831602+0000","last_undegraded":"2024-09-19T06:13:13.831602+0000","last_fullsized":"2024-09-19T06:13:13.831602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:11:36.122712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.833570+0000","last_change":"2024-09-19T06:13:01.650511+0000","last_active":"2024-09-19T06:13:13.833570+0000","last_peered":"2024-09-19T06:13:13.833570+0000","last_clean":"2024-09-19T06:13:13.833570+0000","last_became_active":"2024-09-19T06:13:01.650099+0000","last_became_peered":"2024-09-19T06:13:01.650099+0000","last_unstale":"2024-09-19T06:13:13.833570+0000","last_undegraded":"2024-09-19T06:13:13.833570+0000","last_fullsized":"2024-09-19T06:13:13.833570+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:16.386025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.831722+0000","last_change":"2024-09-19T06:13:03.783690+0000","last_active":"2024-09-19T06:13:13.831722+0000","last_peered":"2024-09-19T06:13:13.831722+0000","last_clean":"2024-09-19T06:13:13.831722+0000","last_became_active":"2024-09-19T06:13:03.783296+0000","last_became_peered":"2024-09-19T06:13:03.783296+0000","last_unstale":"2024-09-19T06:13:13.831722+0000","last_undegraded":"2024-09-19T06:13:13.831722+0000","last_fullsized":"2024-09-19T06:13:13.831722+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:49:19.605979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"79'1","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834623+0000","last_change":"2024-09-19T06:13:01.648671+0000","last_active":"2024-09-19T06:13:13.834623+0000","last_peered":"2024-09-19T06:13:13.834623+0000","last_clean":"2024-09-19T06:13:13.834623+0000","last_became_active":"2024-09-19T06:13:01.647329+0000","last_became_peered":"2024-09-19T06:13:01.647329+0000","last_unstale":"2024-09-19T06:13:13.834623+0000","last_undegraded":"2024-09-19T06:13:13.834623+0000","last_fullsized":"2024-09-19T06:13:13.834623+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:31.026561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.830593+0000","last_change":"2024-09-19T06:13:03.795195+0000","last_active":"2024-09-19T06:13:13.830593+0000","last_peered":"2024-09-19T06:13:13.830593+0000","last_clean":"2024-09-19T06:13:13.830593+0000","last_became_active":"2024-09-19T06:13:03.794882+0000","last_became_peered":"2024-09-19T06:13:03.794882+0000","last_unstale":"2024-09-19T06:13:13.830593+0000","last_undegraded":"2024-09-19T06:13:13.830593+0000","last_fullsized":"2024-09-19T06:13:13.830593+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:47.290917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'11","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:28.796882+0000","last_change":"2024-09-19T06:13:01.652133+0000","last_active":"2024-09-19T06:13:28.796882+0000","last_peered":"2024-09-19T06:13:28.796882+0000","last_clean":"2024-09-19T06:13:28.796882+0000","last_became_active":"2024-09-19T06:13:01.651796+0000","last_became_peered":"2024-09-19T06:13:01.651796+0000","last_unstale":"2024-09-19T06:13:28.796882+0000","last_undegraded":"2024-09-19T06:13:28.796882+0000","last_fullsized":"2024-09-19T06:13:28.796882+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:01.576308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.987457+0000","last_change":"2024-09-19T06:13:03.799332+0000","last_active":"2024-09-19T06:13:13.987457+0000","last_peered":"2024-09-19T06:13:13.987457+0000","last_clean":"2024-09-19T06:13:13.987457+0000","last_became_active":"2024-09-19T06:13:03.798996+0000","last_became_peered":"2024-09-19T06:13:03.798996+0000","last_unstale":"2024-09-19T06:13:13.987457+0000","last_undegraded":"2024-09-19T06:13:13.987457+0000","last_fullsized":"2024-09-19T06:13:13.987457+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:37:32.245396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.836564+0000","last_change":"2024-09-19T06:13:01.652392+0000","last_active":"2024-09-19T06:13:13.836564+0000","last_peered":"2024-09-19T06:13:13.836564+0000","last_clean":"2024-09-19T06:13:13.836564+0000","last_became_active":"2024-09-19T06:13:01.651982+0000","last_became_peered":"2024-09-19T06:13:01.651982+0000","last_unstale":"2024-09-19T06:13:13.836564+0000","last_undegraded":"2024-09-19T06:13:13.836564+0000","last_fullsized":"2024-09-19T06:13:13.836564+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:15:39.590215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.988765+0000","last_change":"2024-09-19T06:13:13.988765+0000","last_active":"2024-09-19T06:13:13.988765+0000","last_peered":"2024-09-19T06:13:13.988765+0000","last_clean":"2024-09-19T06:13:13.988765+0000","last_became_active":"2024-09-19T06:13:13.988328+0000","last_became_peered":"2024-09-19T06:13:13.988328+0000","last_unstale":"2024-09-19T06:13:13.988765+0000","last_undegraded":"2024-09-19T06:13:13.988765+0000","last_fullsized":"2024-09-19T06:13:13.988765+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:10.219202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.986807+0000","last_change":"2024-09-19T06:13:01.658954+0000","last_active":"2024-09-19T06:13:13.986807+0000","last_peered":"2024-09-19T06:13:13.986807+0000","last_clean":"2024-09-19T06:13:13.986807+0000","last_became_active":"2024-09-19T06:13:01.658453+0000","last_became_peered":"2024-09-19T06:13:01.658453+0000","last_unstale":"2024-09-19T06:13:13.986807+0000","last_undegraded":"2024-09-19T06:13:13.986807+0000","last_fullsized":"2024-09-19T06:13:13.986807+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:17.134858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834131+0000","last_change":"2024-09-19T06:13:03.786812+0000","last_active":"2024-09-19T06:13:13.834131+0000","last_peered":"2024-09-19T06:13:13.834131+0000","last_clean":"2024-09-19T06:13:13.834131+0000","last_became_active":"2024-09-19T06:13:03.786481+0000","last_became_peered":"2024-09-19T06:13:03.786481+0000","last_unstale":"2024-09-19T06:13:13.834131+0000","last_undegraded":"2024-09-19T06:13:13.834131+0000","last_fullsized":"2024-09-19T06:13:13.834131+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:46.614073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'3","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.986953+0000","last_change":"2024-09-19T06:13:01.652062+0000","last_active":"2024-09-19T06:13:13.986953+0000","last_peered":"2024-09-19T06:13:13.986953+0000","last_clean":"2024-09-19T06:13:13.986953+0000","last_became_active":"2024-09-19T06:13:01.651718+0000","last_became_peered":"2024-09-19T06:13:01.651718+0000","last_unstale":"2024-09-19T06:13:13.986953+0000","last_undegraded":"2024-09-19T06:13:13.986953+0000","last_fullsized":"2024-09-19T06:13:13.986953+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:22.428954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.833537+0000","last_change":"2024-09-19T06:13:03.792868+0000","last_active":"2024-09-19T06:13:13.833537+0000","last_peered":"2024-09-19T06:13:13.833537+0000","last_clean":"2024-09-19T06:13:13.833537+0000","last_became_active":"2024-09-19T06:13:03.792482+0000","last_became_peered":"2024-09-19T06:13:03.792482+0000","last_unstale":"2024-09-19T06:13:13.833537+0000","last_undegraded":"2024-09-19T06:13:13.833537+0000","last_fullsized":"2024-09-19T06:13:13.833537+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:05:11.294500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.840945+0000","last_change":"2024-09-19T06:13:01.654572+0000","last_active":"2024-09-19T06:13:13.840945+0000","last_peered":"2024-09-19T06:13:13.840945+0000","last_clean":"2024-09-19T06:13:13.840945+0000","last_became_active":"2024-09-19T06:13:01.653865+0000","last_became_peered":"2024-09-19T06:13:01.653865+0000","last_unstale":"2024-09-19T06:13:13.840945+0000","last_undegraded":"2024-09-19T06:13:13.840945+0000","last_fullsized":"2024-09-19T06:13:13.840945+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:45.842230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.987135+0000","last_change":"2024-09-19T06:13:03.791077+0000","last_active":"2024-09-19T06:13:13.987135+0000","last_peered":"2024-09-19T06:13:13.987135+0000","last_clean":"2024-09-19T06:13:13.987135+0000","last_became_active":"2024-09-19T06:13:03.790710+0000","last_became_peered":"2024-09-19T06:13:03.790710+0000","last_unstale":"2024-09-19T06:13:13.987135+0000","last_undegraded":"2024-09-19T06:13:13.987135+0000","last_fullsized":"2024-09-19T06:13:13.987135+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:15:53.498311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.992580+0000","last_change":"2024-09-19T06:13:13.992222+0000","last_active":"2024-09-19T06:13:13.992580+0000","last_peered":"2024-09-19T06:13:13.992580+0000","last_clean":"2024-09-19T06:13:13.992580+0000","last_became_active":"2024-09-19T06:13:13.988046+0000","last_became_peered":"2024-09-19T06:13:13.988046+0000","last_unstale":"2024-09-19T06:13:13.992580+0000","last_undegraded":"2024-09-19T06:13:13.992580+0000","last_fullsized":"2024-09-19T06:13:13.992580+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:21:56.013401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.837205+0000","last_change":"2024-09-19T06:13:03.808060+0000","last_active":"2024-09-19T06:13:13.837205+0000","last_peered":"2024-09-19T06:13:13.837205+0000","last_clean":"2024-09-19T06:13:13.837205+0000","last_became_active":"2024-09-19T06:13:03.807455+0000","last_became_peered":"2024-09-19T06:13:03.807455+0000","last_unstale":"2024-09-19T06:13:13.837205+0000","last_undegraded":"2024-09-19T06:13:13.837205+0000","last_fullsized":"2024-09-19T06:13:13.837205+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:27:19.172298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.988516+0000","last_change":"2024-09-19T06:13:13.987967+0000","last_active":"2024-09-19T06:13:13.988516+0000","last_peered":"2024-09-19T06:13:13.988516+0000","last_clean":"2024-09-19T06:13:13.988516+0000","last_became_active":"2024-09-19T06:13:13.987431+0000","last_became_peered":"2024-09-19T06:13:13.987431+0000","last_unstale":"2024-09-19T06:13:13.988516+0000","last_undegraded":"2024-09-19T06:13:13.988516+0000","last_fullsized":"2024-09-19T06:13:13.988516+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:05.785455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,1],"acting":[9,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.834591+0000","last_change":"2024-09-19T06:13:01.658264+0000","last_active":"2024-09-19T06:13:13.834591+0000","last_peered":"2024-09-19T06:13:13.834591+0000","last_clean":"2024-09-19T06:13:13.834591+0000","last_became_active":"2024-09-19T06:13:01.657912+0000","last_became_peered":"2024-09-19T06:13:01.657912+0000","last_unstale":"2024-09-19T06:13:13.834591+0000","last_undegraded":"2024-09-19T06:13:13.834591+0000","last_fullsized":"2024-09-19T06:13:13.834591+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:19.618987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.986874+0000","last_change":"2024-09-19T06:13:03.791917+0000","last_active":"2024-09-19T06:13:13.986874+0000","last_peered":"2024-09-19T06:13:13.986874+0000","last_clean":"2024-09-19T06:13:13.986874+0000","last_became_active":"2024-09-19T06:13:03.791284+0000","last_became_peered":"2024-09-19T06:13:03.791284+0000","last_unstale":"2024-09-19T06:13:13.986874+0000","last_undegraded":"2024-09-19T06:13:13.986874+0000","last_fullsized":"2024-09-19T06:13:13.986874+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:29.685827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.851212+0000","last_change":"2024-09-19T06:13:13.850753+0000","last_active":"2024-09-19T06:13:13.851212+0000","last_peered":"2024-09-19T06:13:13.851212+0000","last_clean":"2024-09-19T06:13:13.851212+0000","last_became_active":"2024-09-19T06:13:13.843601+0000","last_became_peered":"2024-09-19T06:13:13.843601+0000","last_unstale":"2024-09-19T06:13:13.851212+0000","last_undegraded":"2024-09-19T06:13:13.851212+0000","last_fullsized":"2024-09-19T06:13:13.851212+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:11.452118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.835131+0000","last_change":"2024-09-19T06:13:03.798722+0000","last_active":"2024-09-19T06:13:13.835131+0000","last_peered":"2024-09-19T06:13:13.835131+0000","last_clean":"2024-09-19T06:13:13.835131+0000","last_became_active":"2024-09-19T06:13:03.798428+0000","last_became_peered":"2024-09-19T06:13:03.798428+0000","last_unstale":"2024-09-19T06:13:13.835131+0000","last_undegraded":"2024-09-19T06:13:13.835131+0000","last_fullsized":"2024-09-19T06:13:13.835131+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:11:15.179515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.987601+0000","last_change":"2024-09-19T06:13:01.651003+0000","last_active":"2024-09-19T06:13:13.987601+0000","last_peered":"2024-09-19T06:13:13.987601+0000","last_clean":"2024-09-19T06:13:13.987601+0000","last_became_active":"2024-09-19T06:13:01.650697+0000","last_became_peered":"2024-09-19T06:13:01.650697+0000","last_unstale":"2024-09-19T06:13:13.987601+0000","last_undegraded":"2024-09-19T06:13:13.987601+0000","last_fullsized":"2024-09-19T06:13:13.987601+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:47.982845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.987236+0000","last_change":"2024-09-19T06:13:03.796907+0000","last_active":"2024-09-19T06:13:13.987236+0000","last_peered":"2024-09-19T06:13:13.987236+0000","last_clean":"2024-09-19T06:13:13.987236+0000","last_became_active":"2024-09-19T06:13:03.796426+0000","last_became_peered":"2024-09-19T06:13:03.796426+0000","last_unstale":"2024-09-19T06:13:13.987236+0000","last_undegraded":"2024-09-19T06:13:13.987236+0000","last_fullsized":"2024-09-19T06:13:13.987236+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:26.455773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:13:13.833916+0000","last_change":"2024-09-19T06:13:01.654788+0000","last_active":"2024-09-19T06:13:13.833916+0000","last_peered":"2024-09-19T06:13:13.833916+0000","last_clean":"2024-09-19T06:13:13.833916+0000","last_became_active":"2024-09-19T06:13:01.654461+0000","last_became_peered":"2024-09-19T06:13:01.654461+0000","last_unstale":"2024-09-19T06:13:13.833916+0000","last_undegraded":"2024-09-19T06:13:13.833916+0000","last_fullsized":"2024-09-19T06:13:13.833916+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:41.374288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":62821,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":303,"num_read_kb":219,"num_write":159,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":644,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":188463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612633,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":880640,"data_stored":430117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841566,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28560,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716592,"statfs":{"total":95995035648,"available":95965790208,"internally_reserved":0,"allocated":1572864,"data_stored":1080787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005092,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":430331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234025,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":888832,"data_stored":430229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462957,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28476,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716676,"statfs":{"total":95995035648,"available":95965876224,"internally_reserved":0,"allocated":1486848,"data_stored":1021790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593779,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40364,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704788,"statfs":{"total":95995035648,"available":95953702912,"internally_reserved":0,"allocated":880640,"data_stored":429720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822711,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28488,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716664,"statfs":{"total":95995035648,"available":95965863936,"internally_reserved":0,"allocated":1499136,"data_stored":1021474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986237,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":892928,"data_stored":430779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215170,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":897024,"data_stored":430031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444103,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":489452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32104,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713048,"statfs":{"total":95995035648,"available":95962161152,"internally_reserved":0,"allocated":942080,"data_stored":488724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":901120,"data_stored":430991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":59939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":60789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:14:10.102 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T06:14:10.102 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-19T06:14:10.102 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-19T06:14:10.102 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-19T06:14:10.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:09 smithi090 ceph-mon[34497]: pgmap v309: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:10.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:09 smithi089 ceph-mon[34160]: pgmap v309: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:10.366 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:10.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:10.812+0000 7f9df6640640 1 -- 172.21.15.2:0/3740717059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9df0101280 msgr2=0x7f9df010df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:10.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:10.812+0000 7f9df6640640 1 --2- 172.21.15.2:0/3740717059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9df0101280 0x7f9df010df40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8009900 tx=0x7f9dd802a410 comp rx=0 tx=0).stop 2024-09-19T06:14:10.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:10.813+0000 7f9df6640640 1 -- 172.21.15.2:0/3740717059 shutdown_connections 2024-09-19T06:14:10.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:10.813+0000 7f9df6640640 1 --2- 172.21.15.2:0/3740717059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9df010e480 0x7f9df0110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:10.813+0000 7f9df6640640 1 --2- 172.21.15.2:0/3740717059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9df0101280 0x7f9df010df40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:10.813+0000 7f9df6640640 1 --2- 172.21.15.2:0/3740717059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9df01008d0 0x7f9df0100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:10.813+0000 7f9df6640640 1 -- 172.21.15.2:0/3740717059 >> 172.21.15.2:0/3740717059 conn(0x7f9df00fc7a0 msgr2=0x7f9df00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:10.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:10.813+0000 7f9df6640640 1 -- 172.21.15.2:0/3740717059 shutdown_connections 2024-09-19T06:14:10.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:10.813+0000 7f9df6640640 1 -- 172.21.15.2:0/3740717059 wait complete. 2024-09-19T06:14:10.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:10.813+0000 7f9df6640640 1 Processor -- start 2024-09-19T06:14:10.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:10.813+0000 7f9df6640640 1 -- start start 2024-09-19T06:14:10.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:10.814+0000 7f9df6640640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9df01008d0 0x7f9df01a03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:10.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:10.814+0000 7f9df6640640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9df0101280 0x7f9df01a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:10.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:10.814+0000 7f9df6640640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9df010e480 0x7f9df019a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:10.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:10.814+0000 7f9df6640640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9df0114110 con 0x7f9df0101280 2024-09-19T06:14:10.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:10.814+0000 7f9df6640640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9df0113f90 con 0x7f9df010e480 2024-09-19T06:14:10.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:10.814+0000 7f9df6640640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9df0114290 con 0x7f9df01008d0 2024-09-19T06:14:10.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:10.814+0000 7f9de7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9df0101280 0x7f9df01a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:10.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:10.814+0000 7f9de7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9df0101280 0x7f9df01a0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42094/0 (socket says 172.21.15.2:42094) 2024-09-19T06:14:10.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:10.814+0000 7f9de7fff640 1 -- 172.21.15.2:0/584270789 learned_addr learned my addr 172.21.15.2:0/584270789 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:10.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:10.814+0000 7f9df4bdd640 1 --2- 172.21.15.2:0/584270789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9df010e480 0x7f9df019a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:10.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:10.814+0000 7f9deffff640 1 --2- 172.21.15.2:0/584270789 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9df01008d0 0x7f9df01a03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:10.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:10.814+0000 7f9de7fff640 1 -- 172.21.15.2:0/584270789 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9df01008d0 msgr2=0x7f9df01a03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:10.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:10.814+0000 7f9de7fff640 1 --2- 172.21.15.2:0/584270789 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9df01008d0 0x7f9df01a03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:10.814+0000 7f9de7fff640 1 -- 172.21.15.2:0/584270789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9df010e480 msgr2=0x7f9df019a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:10.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:10.814+0000 7f9de7fff640 1 --2- 172.21.15.2:0/584270789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9df010e480 0x7f9df019a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:10.814+0000 7f9de7fff640 1 -- 172.21.15.2:0/584270789 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9df019ace0 con 0x7f9df0101280 2024-09-19T06:14:10.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:10.814+0000 7f9deffff640 1 --2- 172.21.15.2:0/584270789 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9df01008d0 0x7f9df01a03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:14:10.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:10.814+0000 7f9de7fff640 1 --2- 172.21.15.2:0/584270789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9df0101280 0x7f9df01a0930 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8005940 tx=0x7f9dd8004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:10.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:10.814+0000 7f9dedffb640 1 -- 172.21.15.2:0/584270789 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd803f070 con 0x7f9df0101280 2024-09-19T06:14:10.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:10.814+0000 7f9dedffb640 1 -- 172.21.15.2:0/584270789 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9dd8003aa0 con 0x7f9df0101280 2024-09-19T06:14:10.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:10.814+0000 7f9df6640640 1 -- 172.21.15.2:0/584270789 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9df019af70 con 0x7f9df0101280 2024-09-19T06:14:10.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:10.815+0000 7f9dedffb640 1 -- 172.21.15.2:0/584270789 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd8035030 con 0x7f9df0101280 2024-09-19T06:14:10.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:10.815+0000 7f9df6640640 1 -- 172.21.15.2:0/584270789 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9df01a72c0 con 0x7f9df0101280 2024-09-19T06:14:10.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:10.816+0000 7f9df6640640 1 -- 172.21.15.2:0/584270789 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9df0100d30 con 0x7f9df0101280 2024-09-19T06:14:10.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:10.817+0000 7f9dedffb640 1 -- 172.21.15.2:0/584270789 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f9dd8042070 con 0x7f9df0101280 2024-09-19T06:14:10.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:10.817+0000 7f9dedffb640 1 --2- 172.21.15.2:0/584270789 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f9ddc0a3350 0x7f9ddc0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:10.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:10.818+0000 7f9deffff640 1 --2- 172.21.15.2:0/584270789 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f9ddc0a3350 0x7f9ddc0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:10.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:10.818+0000 7f9dedffb640 1 -- 172.21.15.2:0/584270789 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f9dd80f0160 con 0x7f9df0101280 2024-09-19T06:14:10.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:10.818+0000 7f9deffff640 1 --2- 172.21.15.2:0/584270789 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f9ddc0a3350 0x7f9ddc0a5810 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9de0006fd0 tx=0x7f9de0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:10.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:10.822+0000 7f9dedffb640 1 -- 172.21.15.2:0/584270789 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9dd80bcd30 con 0x7f9df0101280 2024-09-19T06:14:11.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:11.033+0000 7f9df6640640 1 -- 172.21.15.2:0/584270789 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9df0109610 con 0x7f9df0101280 2024-09-19T06:14:11.035 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:10 smithi002 ceph-mon[30982]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:14:11.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:11.034+0000 7f9dedffb640 1 -- 172.21.15.2:0/584270789 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f9dd80bc630 con 0x7f9df0101280 2024-09-19T06:14:11.036 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:14:11.036 INFO:teuthology.orchestra.run.smithi002.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-19T06:14:11.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:11.036+0000 7f9df6640640 1 -- 172.21.15.2:0/584270789 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f9ddc0a3350 msgr2=0x7f9ddc0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:11.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:11.036+0000 7f9df6640640 1 --2- 172.21.15.2:0/584270789 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f9ddc0a3350 0x7f9ddc0a5810 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9de0006fd0 tx=0x7f9de0008040 comp rx=0 tx=0).stop 2024-09-19T06:14:11.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:11.036+0000 7f9df6640640 1 -- 172.21.15.2:0/584270789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9df0101280 msgr2=0x7f9df01a0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:11.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:11.036+0000 7f9df6640640 1 --2- 172.21.15.2:0/584270789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9df0101280 0x7f9df01a0930 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8005940 tx=0x7f9dd8004430 comp rx=0 tx=0).stop 2024-09-19T06:14:11.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:11.036+0000 7f9df6640640 1 -- 172.21.15.2:0/584270789 shutdown_connections 2024-09-19T06:14:11.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:11.036+0000 7f9df6640640 1 --2- 172.21.15.2:0/584270789 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f9ddc0a3350 0x7f9ddc0a5810 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:11.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:11.036+0000 7f9df6640640 1 --2- 172.21.15.2:0/584270789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9df010e480 0x7f9df019a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:11.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:11.036+0000 7f9df6640640 1 --2- 172.21.15.2:0/584270789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9df0101280 0x7f9df01a0930 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:11.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:11.036+0000 7f9df6640640 1 --2- 172.21.15.2:0/584270789 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9df01008d0 0x7f9df01a03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:11.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:11.036+0000 7f9df6640640 1 -- 172.21.15.2:0/584270789 >> 172.21.15.2:0/584270789 conn(0x7f9df00fc7a0 msgr2=0x7f9df00feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:11.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:11.036+0000 7f9df6640640 1 -- 172.21.15.2:0/584270789 shutdown_connections 2024-09-19T06:14:11.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:11.036+0000 7f9df6640640 1 -- 172.21.15.2:0/584270789 wait complete. 2024-09-19T06:14:11.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:10 smithi090 ceph-mon[34497]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:14:11.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:10 smithi089 ceph-mon[34160]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:14:11.647 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-19T06:14:11.648 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:14:11.905 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:11.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:11 smithi002 ceph-mon[30982]: pgmap v310: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:14:11.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:11 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/584270789' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T06:14:12.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:11 smithi090 ceph-mon[34497]: pgmap v310: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:14:12.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:11 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/584270789' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T06:14:12.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:11 smithi089 ceph-mon[34160]: pgmap v310: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:14:12.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:11 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/584270789' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T06:14:12.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.384+0000 7f57ed084640 1 -- 172.21.15.2:0/1450774534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57e8103660 msgr2=0x7f57e810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:12.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.384+0000 7f57ed084640 1 --2- 172.21.15.2:0/1450774534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57e8103660 0x7f57e810bb50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f57dc009900 tx=0x7f57dc02a480 comp rx=0 tx=0).stop 2024-09-19T06:14:12.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.384+0000 7f57ed084640 1 -- 172.21.15.2:0/1450774534 shutdown_connections 2024-09-19T06:14:12.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.384+0000 7f57ed084640 1 --2- 172.21.15.2:0/1450774534 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57e810c170 0x7f57e810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.384+0000 7f57ed084640 1 --2- 172.21.15.2:0/1450774534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57e8103660 0x7f57e810bb50 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.384+0000 7f57ed084640 1 --2- 172.21.15.2:0/1450774534 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57e8102d40 0x7f57e8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.384+0000 7f57ed084640 1 -- 172.21.15.2:0/1450774534 >> 172.21.15.2:0/1450774534 conn(0x7f57e80fc7a0 msgr2=0x7f57e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:12.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.384+0000 7f57ed084640 1 -- 172.21.15.2:0/1450774534 shutdown_connections 2024-09-19T06:14:12.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.385+0000 7f57ed084640 1 -- 172.21.15.2:0/1450774534 wait complete. 2024-09-19T06:14:12.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.385+0000 7f57ed084640 1 Processor -- start 2024-09-19T06:14:12.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.385+0000 7f57ed084640 1 -- start start 2024-09-19T06:14:12.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.386+0000 7f57ed084640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57e8102d40 0x7f57e81009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:12.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.386+0000 7f57ed084640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57e8103660 0x7f57e8100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:12.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.386+0000 7f57ed084640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57e810c170 0x7f57e8101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:12.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.386+0000 7f57ed084640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f57e8111e60 con 0x7f57e8102d40 2024-09-19T06:14:12.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.386+0000 7f57ed084640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f57e8111ce0 con 0x7f57e810c170 2024-09-19T06:14:12.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.386+0000 7f57ed084640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f57e8111fe0 con 0x7f57e8103660 2024-09-19T06:14:12.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.386+0000 7f57e6d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57e8102d40 0x7f57e81009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:12.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.386+0000 7f57e6d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57e8102d40 0x7f57e81009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42114/0 (socket says 172.21.15.2:42114) 2024-09-19T06:14:12.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.386+0000 7f57e6d9d640 1 -- 172.21.15.2:0/3520511604 learned_addr learned my addr 172.21.15.2:0/3520511604 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:12.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.386+0000 7f57e759e640 1 --2- 172.21.15.2:0/3520511604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57e810c170 0x7f57e8101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:12.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.386+0000 7f57e659c640 1 --2- 172.21.15.2:0/3520511604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57e8103660 0x7f57e8100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:12.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.386+0000 7f57e6d9d640 1 -- 172.21.15.2:0/3520511604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57e8103660 msgr2=0x7f57e8100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:12.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.386+0000 7f57e6d9d640 1 --2- 172.21.15.2:0/3520511604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57e8103660 0x7f57e8100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.386+0000 7f57e6d9d640 1 -- 172.21.15.2:0/3520511604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57e810c170 msgr2=0x7f57e8101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:12.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.386+0000 7f57e6d9d640 1 --2- 172.21.15.2:0/3520511604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57e810c170 0x7f57e8101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.386+0000 7f57e6d9d640 1 -- 172.21.15.2:0/3520511604 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57e81a68b0 con 0x7f57e8102d40 2024-09-19T06:14:12.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.387+0000 7f57e6d9d640 1 --2- 172.21.15.2:0/3520511604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57e8102d40 0x7f57e81009a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f57d800c890 tx=0x7f57d800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:12.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.387+0000 7f57cffff640 1 -- 172.21.15.2:0/3520511604 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d8004220 con 0x7f57e8102d40 2024-09-19T06:14:12.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.387+0000 7f57cffff640 1 -- 172.21.15.2:0/3520511604 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f57d80043c0 con 0x7f57e8102d40 2024-09-19T06:14:12.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.387+0000 7f57cffff640 1 -- 172.21.15.2:0/3520511604 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d8004a00 con 0x7f57e8102d40 2024-09-19T06:14:12.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.387+0000 7f57ed084640 1 -- 172.21.15.2:0/3520511604 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57e81a6ba0 con 0x7f57e8102d40 2024-09-19T06:14:12.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.388+0000 7f57ed084640 1 -- 172.21.15.2:0/3520511604 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57e81a7060 con 0x7f57e8102d40 2024-09-19T06:14:12.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.389+0000 7f57ed084640 1 -- 172.21.15.2:0/3520511604 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57e806b070 con 0x7f57e8102d40 2024-09-19T06:14:12.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.389+0000 7f57cffff640 1 -- 172.21.15.2:0/3520511604 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f57d8004ba0 con 0x7f57e8102d40 2024-09-19T06:14:12.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.390+0000 7f57cffff640 1 --2- 172.21.15.2:0/3520511604 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f57d00a3420 0x7f57d00a58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:12.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.390+0000 7f57cffff640 1 -- 172.21.15.2:0/3520511604 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f57d80cf720 con 0x7f57e8102d40 2024-09-19T06:14:12.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.390+0000 7f57e659c640 1 --2- 172.21.15.2:0/3520511604 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f57d00a3420 0x7f57d00a58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:12.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.391+0000 7f57e659c640 1 --2- 172.21.15.2:0/3520511604 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f57d00a3420 0x7f57d00a58e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f57dc031440 tx=0x7f57dc0095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:12.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.394+0000 7f57cffff640 1 -- 172.21.15.2:0/3520511604 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f57d8014030 con 0x7f57e8102d40 2024-09-19T06:14:12.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.604+0000 7f57ed084640 1 -- 172.21.15.2:0/3520511604 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f57e802d7c0 con 0x7f57e8102d40 2024-09-19T06:14:12.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.605+0000 7f57cffff640 1 -- 172.21.15.2:0/3520511604 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11882 (secure 0 0 0) 0x7f57d809c2f0 con 0x7f57e8102d40 2024-09-19T06:14:12.607 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:14:12.607 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":25,"btime":"2024-09-19T06:13:17:867959+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:13:17.867946+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24472,24470]},"id":1}]} 2024-09-19T06:14:12.607 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 25 2024-09-19T06:14:12.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.607+0000 7f57ed084640 1 -- 172.21.15.2:0/3520511604 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f57d00a3420 msgr2=0x7f57d00a58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:12.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.607+0000 7f57ed084640 1 --2- 172.21.15.2:0/3520511604 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f57d00a3420 0x7f57d00a58e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f57dc031440 tx=0x7f57dc0095f0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.607+0000 7f57ed084640 1 -- 172.21.15.2:0/3520511604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57e8102d40 msgr2=0x7f57e81009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:12.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.607+0000 7f57ed084640 1 --2- 172.21.15.2:0/3520511604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57e8102d40 0x7f57e81009a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f57d800c890 tx=0x7f57d800cd50 comp rx=0 tx=0).stop 2024-09-19T06:14:12.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.607+0000 7f57ed084640 1 -- 172.21.15.2:0/3520511604 shutdown_connections 2024-09-19T06:14:12.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.607+0000 7f57ed084640 1 --2- 172.21.15.2:0/3520511604 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f57d00a3420 0x7f57d00a58e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.607+0000 7f57ed084640 1 --2- 172.21.15.2:0/3520511604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57e810c170 0x7f57e8101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.607+0000 7f57ed084640 1 --2- 172.21.15.2:0/3520511604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57e8103660 0x7f57e8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.607+0000 7f57ed084640 1 --2- 172.21.15.2:0/3520511604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57e8102d40 0x7f57e81009a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.607+0000 7f57ed084640 1 -- 172.21.15.2:0/3520511604 >> 172.21.15.2:0/3520511604 conn(0x7f57e80fc7a0 msgr2=0x7f57e80fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:12.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.607+0000 7f57ed084640 1 -- 172.21.15.2:0/3520511604 shutdown_connections 2024-09-19T06:14:12.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:12.607+0000 7f57ed084640 1 -- 172.21.15.2:0/3520511604 wait complete. 2024-09-19T06:14:12.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:12 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/3520511604' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:14:13.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:12 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/3520511604' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:14:13.243 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:14:13.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:12 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/3520511604' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:14:13.505 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:13.878 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:13 smithi002 ceph-mon[30982]: pgmap v311: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:13.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:13.959+0000 7fe75f5ac640 1 -- 172.21.15.2:0/2984898665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe75810e3c0 msgr2=0x7fe758110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:13.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:13.959+0000 7fe75f5ac640 1 --2- 172.21.15.2:0/2984898665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe75810e3c0 0x7fe758110810 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe750009ca0 tx=0x7fe75002a950 comp rx=0 tx=0).stop 2024-09-19T06:14:13.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:13.959+0000 7fe75f5ac640 1 -- 172.21.15.2:0/2984898665 shutdown_connections 2024-09-19T06:14:13.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:13.959+0000 7fe75f5ac640 1 --2- 172.21.15.2:0/2984898665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe75810e3c0 0x7fe758110810 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:13.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:13.959+0000 7fe75f5ac640 1 --2- 172.21.15.2:0/2984898665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe758074f40 0x7fe75810de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:13.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:13.959+0000 7fe75f5ac640 1 --2- 172.21.15.2:0/2984898665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe758074620 0x7fe758074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:13.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:13.959+0000 7fe75f5ac640 1 -- 172.21.15.2:0/2984898665 >> 172.21.15.2:0/2984898665 conn(0x7fe7580fd8c0 msgr2=0x7fe7580ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:13.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:13.959+0000 7fe75f5ac640 1 -- 172.21.15.2:0/2984898665 shutdown_connections 2024-09-19T06:14:13.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:13.959+0000 7fe75f5ac640 1 -- 172.21.15.2:0/2984898665 wait complete. 2024-09-19T06:14:13.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:13.959+0000 7fe75f5ac640 1 Processor -- start 2024-09-19T06:14:13.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:13.960+0000 7fe75f5ac640 1 -- start start 2024-09-19T06:14:13.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:13.960+0000 7fe75f5ac640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe758074620 0x7fe75819a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:13.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:13.960+0000 7fe75f5ac640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe758074f40 0x7fe75819aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:13.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:13.960+0000 7fe75f5ac640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe75810e3c0 0x7fe75819ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:13.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:13.960+0000 7fe75f5ac640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe758114020 con 0x7fe75810e3c0 2024-09-19T06:14:13.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:13.960+0000 7fe75f5ac640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe758113ea0 con 0x7fe758074620 2024-09-19T06:14:13.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:13.960+0000 7fe75f5ac640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe7581141a0 con 0x7fe758074f40 2024-09-19T06:14:13.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:13.960+0000 7fe75db49640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe75810e3c0 0x7fe75819ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:13.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:13.960+0000 7fe75db49640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe75810e3c0 0x7fe75819ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42138/0 (socket says 172.21.15.2:42138) 2024-09-19T06:14:13.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:13.960+0000 7fe75db49640 1 -- 172.21.15.2:0/1378228138 learned_addr learned my addr 172.21.15.2:0/1378228138 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:13.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:13.960+0000 7fe75cb47640 1 --2- 172.21.15.2:0/1378228138 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe758074f40 0x7fe75819aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:13.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:13.960+0000 7fe75d348640 1 --2- 172.21.15.2:0/1378228138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe758074620 0x7fe75819a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:13.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:13.960+0000 7fe75db49640 1 -- 172.21.15.2:0/1378228138 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe758074f40 msgr2=0x7fe75819aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:13.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:13.960+0000 7fe75db49640 1 --2- 172.21.15.2:0/1378228138 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe758074f40 0x7fe75819aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:13.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:13.960+0000 7fe75db49640 1 -- 172.21.15.2:0/1378228138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe758074620 msgr2=0x7fe75819a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:13.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:13.960+0000 7fe75db49640 1 --2- 172.21.15.2:0/1378228138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe758074620 0x7fe75819a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:13.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:13.960+0000 7fe75db49640 1 -- 172.21.15.2:0/1378228138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe75819f510 con 0x7fe75810e3c0 2024-09-19T06:14:13.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:13.960+0000 7fe75db49640 1 --2- 172.21.15.2:0/1378228138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe75810e3c0 0x7fe75819ee30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe750004af0 tx=0x7fe750031f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:13.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:13.961+0000 7fe74e7fc640 1 -- 172.21.15.2:0/1378228138 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe750034040 con 0x7fe75810e3c0 2024-09-19T06:14:13.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:13.961+0000 7fe74e7fc640 1 -- 172.21.15.2:0/1378228138 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe7500308f0 con 0x7fe75810e3c0 2024-09-19T06:14:13.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:13.961+0000 7fe75f5ac640 1 -- 172.21.15.2:0/1378228138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe75819f7a0 con 0x7fe75810e3c0 2024-09-19T06:14:13.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:13.961+0000 7fe74e7fc640 1 -- 172.21.15.2:0/1378228138 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe750004600 con 0x7fe75810e3c0 2024-09-19T06:14:13.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:13.961+0000 7fe75f5ac640 1 -- 172.21.15.2:0/1378228138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7581a70e0 con 0x7fe75810e3c0 2024-09-19T06:14:13.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:13.962+0000 7fe75f5ac640 1 -- 172.21.15.2:0/1378228138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe758074a00 con 0x7fe75810e3c0 2024-09-19T06:14:13.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:13.963+0000 7fe74e7fc640 1 -- 172.21.15.2:0/1378228138 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fe750037020 con 0x7fe75810e3c0 2024-09-19T06:14:13.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:13.963+0000 7fe74e7fc640 1 --2- 172.21.15.2:0/1378228138 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fe7440a3350 0x7fe7440a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:13.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:13.964+0000 7fe75d348640 1 --2- 172.21.15.2:0/1378228138 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fe7440a3350 0x7fe7440a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:13.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:13.964+0000 7fe74e7fc640 1 -- 172.21.15.2:0/1378228138 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7fe7500f0710 con 0x7fe75810e3c0 2024-09-19T06:14:13.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:13.964+0000 7fe75d348640 1 --2- 172.21.15.2:0/1378228138 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fe7440a3350 0x7fe7440a5810 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe754009b60 tx=0x7fe754005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:13.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:13.968+0000 7fe74e7fc640 1 -- 172.21.15.2:0/1378228138 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe7500bd390 con 0x7fe75810e3c0 2024-09-19T06:14:14.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:14.181+0000 7fe75f5ac640 1 -- 172.21.15.2:0/1378228138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe758109540 con 0x7fe75810e3c0 2024-09-19T06:14:14.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:14.182+0000 7fe74e7fc640 1 -- 172.21.15.2:0/1378228138 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11882 (secure 0 0 0) 0x7fe7500d4e80 con 0x7fe75810e3c0 2024-09-19T06:14:14.184 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:14:14.184 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":25,"btime":"2024-09-19T06:13:17:867959+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:13:17.867946+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24472,24470]},"id":1}]} 2024-09-19T06:14:14.184 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 25 2024-09-19T06:14:14.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:14.185+0000 7fe75f5ac640 1 -- 172.21.15.2:0/1378228138 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fe7440a3350 msgr2=0x7fe7440a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:14.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:14.185+0000 7fe75f5ac640 1 --2- 172.21.15.2:0/1378228138 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fe7440a3350 0x7fe7440a5810 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe754009b60 tx=0x7fe754005f90 comp rx=0 tx=0).stop 2024-09-19T06:14:14.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:14.185+0000 7fe75f5ac640 1 -- 172.21.15.2:0/1378228138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe75810e3c0 msgr2=0x7fe75819ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:14.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:14.185+0000 7fe75f5ac640 1 --2- 172.21.15.2:0/1378228138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe75810e3c0 0x7fe75819ee30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe750004af0 tx=0x7fe750031f50 comp rx=0 tx=0).stop 2024-09-19T06:14:14.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:14.185+0000 7fe75f5ac640 1 -- 172.21.15.2:0/1378228138 shutdown_connections 2024-09-19T06:14:14.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:14.185+0000 7fe75f5ac640 1 --2- 172.21.15.2:0/1378228138 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fe7440a3350 0x7fe7440a5810 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:14.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:14.185+0000 7fe75f5ac640 1 --2- 172.21.15.2:0/1378228138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe75810e3c0 0x7fe75819ee30 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:14.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:14.185+0000 7fe75f5ac640 1 --2- 172.21.15.2:0/1378228138 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe758074f40 0x7fe75819aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:14.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:14.185+0000 7fe75f5ac640 1 --2- 172.21.15.2:0/1378228138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe758074620 0x7fe75819a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:14.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:14.185+0000 7fe75f5ac640 1 -- 172.21.15.2:0/1378228138 >> 172.21.15.2:0/1378228138 conn(0x7fe7580fd8c0 msgr2=0x7fe7580fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:14.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:14.185+0000 7fe75f5ac640 1 -- 172.21.15.2:0/1378228138 shutdown_connections 2024-09-19T06:14:14.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:14.185+0000 7fe75f5ac640 1 -- 172.21.15.2:0/1378228138 wait complete. 2024-09-19T06:14:14.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:13 smithi090 ceph-mon[34497]: pgmap v311: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:14.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:13 smithi089 ceph-mon[34160]: pgmap v311: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:14.782 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:14:15.039 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:15.160 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:14 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1378228138' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:14:15.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:14 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1378228138' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:14:15.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:14 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1378228138' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:14:15.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.478+0000 7fac6abc0640 1 -- 172.21.15.2:0/2596571296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac64101de0 msgr2=0x7fac641021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:15.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.478+0000 7fac6abc0640 1 --2- 172.21.15.2:0/2596571296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac64101de0 0x7fac641021c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fac60009900 tx=0x7fac6002a410 comp rx=0 tx=0).stop 2024-09-19T06:14:15.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.478+0000 7fac6abc0640 1 -- 172.21.15.2:0/2596571296 shutdown_connections 2024-09-19T06:14:15.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.478+0000 7fac6abc0640 1 --2- 172.21.15.2:0/2596571296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac64106f10 0x7fac6410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:15.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.478+0000 7fac6abc0640 1 --2- 172.21.15.2:0/2596571296 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac64102790 0x7fac641067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:15.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.478+0000 7fac6abc0640 1 --2- 172.21.15.2:0/2596571296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac64101de0 0x7fac641021c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:15.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.478+0000 7fac6abc0640 1 -- 172.21.15.2:0/2596571296 >> 172.21.15.2:0/2596571296 conn(0x7fac640fd8c0 msgr2=0x7fac640ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:15.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.478+0000 7fac6abc0640 1 -- 172.21.15.2:0/2596571296 shutdown_connections 2024-09-19T06:14:15.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.478+0000 7fac6abc0640 1 -- 172.21.15.2:0/2596571296 wait complete. 2024-09-19T06:14:15.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.479+0000 7fac6abc0640 1 Processor -- start 2024-09-19T06:14:15.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.479+0000 7fac6abc0640 1 -- start start 2024-09-19T06:14:15.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.479+0000 7fac6abc0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac64101de0 0x7fac6419a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:15.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.479+0000 7fac6abc0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac64102790 0x7fac6419ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:15.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.479+0000 7fac6abc0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac64106f10 0x7fac6419ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:15.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.479+0000 7fac6abc0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fac64111e40 con 0x7fac64101de0 2024-09-19T06:14:15.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.479+0000 7fac6abc0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fac64111cc0 con 0x7fac64106f10 2024-09-19T06:14:15.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.479+0000 7fac6abc0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fac64111fc0 con 0x7fac64102790 2024-09-19T06:14:15.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.479+0000 7fac6895c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac64101de0 0x7fac6419a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:15.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.479+0000 7fac6895c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac64101de0 0x7fac6419a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36692/0 (socket says 172.21.15.2:36692) 2024-09-19T06:14:15.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.479+0000 7fac6895c640 1 -- 172.21.15.2:0/440758884 learned_addr learned my addr 172.21.15.2:0/440758884 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:15.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.480+0000 7fac5bfff640 1 --2- 172.21.15.2:0/440758884 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac64102790 0x7fac6419ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:15.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.480+0000 7fac6915d640 1 --2- 172.21.15.2:0/440758884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac64106f10 0x7fac6419ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:15.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.480+0000 7fac6895c640 1 -- 172.21.15.2:0/440758884 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac64102790 msgr2=0x7fac6419ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:15.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.480+0000 7fac6895c640 1 --2- 172.21.15.2:0/440758884 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac64102790 0x7fac6419ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:15.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.480+0000 7fac6895c640 1 -- 172.21.15.2:0/440758884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac64106f10 msgr2=0x7fac6419ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:15.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.480+0000 7fac6895c640 1 --2- 172.21.15.2:0/440758884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac64106f10 0x7fac6419ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:15.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.480+0000 7fac6895c640 1 -- 172.21.15.2:0/440758884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac6419f670 con 0x7fac64101de0 2024-09-19T06:14:15.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.480+0000 7fac5bfff640 1 --2- 172.21.15.2:0/440758884 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac64102790 0x7fac6419ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:14:15.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.480+0000 7fac6915d640 1 --2- 172.21.15.2:0/440758884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac64106f10 0x7fac6419ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:14:15.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.480+0000 7fac6895c640 1 --2- 172.21.15.2:0/440758884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac64101de0 0x7fac6419a6c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fac60006010 tx=0x7fac60004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:15.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.480+0000 7fac59ffb640 1 -- 172.21.15.2:0/440758884 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6003f030 con 0x7fac64101de0 2024-09-19T06:14:15.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.480+0000 7fac59ffb640 1 -- 172.21.15.2:0/440758884 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fac600035f0 con 0x7fac64101de0 2024-09-19T06:14:15.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.480+0000 7fac6abc0640 1 -- 172.21.15.2:0/440758884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac6419f900 con 0x7fac64101de0 2024-09-19T06:14:15.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.480+0000 7fac59ffb640 1 -- 172.21.15.2:0/440758884 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac60035070 con 0x7fac64101de0 2024-09-19T06:14:15.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.480+0000 7fac6abc0640 1 -- 172.21.15.2:0/440758884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac641a7240 con 0x7fac64101de0 2024-09-19T06:14:15.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.481+0000 7fac6abc0640 1 -- 172.21.15.2:0/440758884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac641021c0 con 0x7fac64101de0 2024-09-19T06:14:15.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.482+0000 7fac59ffb640 1 -- 172.21.15.2:0/440758884 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fac60003b10 con 0x7fac64101de0 2024-09-19T06:14:15.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.483+0000 7fac59ffb640 1 --2- 172.21.15.2:0/440758884 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fac4c0a3350 0x7fac4c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:15.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.483+0000 7fac5bfff640 1 --2- 172.21.15.2:0/440758884 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fac4c0a3350 0x7fac4c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:15.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.484+0000 7fac59ffb640 1 -- 172.21.15.2:0/440758884 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7fac600f06a0 con 0x7fac64101de0 2024-09-19T06:14:15.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.484+0000 7fac5bfff640 1 --2- 172.21.15.2:0/440758884 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fac4c0a3350 0x7fac4c0a5810 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fac54006fd0 tx=0x7fac54008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:15.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.488+0000 7fac59ffb640 1 -- 172.21.15.2:0/440758884 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fac600bd210 con 0x7fac64101de0 2024-09-19T06:14:15.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.668+0000 7fac6abc0640 1 -- 172.21.15.2:0/440758884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fac641a7410 con 0x7fac64101de0 2024-09-19T06:14:15.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.670+0000 7fac59ffb640 1 -- 172.21.15.2:0/440758884 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22577 (secure 0 0 0) 0x7fac600bcb10 con 0x7fac64101de0 2024-09-19T06:14:15.671 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:14:15.672 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":81,"fsid":"078f6612-764d-11ef-bceb-c7b262605968","created":"2024-09-19T06:05:17.607927+0000","modified":"2024-09-19T06:13:13.827600+0000","last_up_change":"2024-09-19T06:12:13.856684+0000","last_in_change":"2024-09-19T06:11:49.745266+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:08:28.425566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:13:00.482789+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:13:02.768221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0de97a3d-2d27-455b-9998-ddd2319c148d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6803","nonce":915165910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6805","nonce":915165910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6809","nonce":915165910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6807","nonce":915165910}]},"public_addr":"172.21.15.2:6803/915165910","cluster_addr":"172.21.15.2:6805/915165910","heartbeat_back_addr":"172.21.15.2:6809/915165910","heartbeat_front_addr":"172.21.15.2:6807/915165910","state":["exists","up"]},{"osd":1,"uuid":"056d229e-2de4-4902-922e-21e1a5d3f061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6801","nonce":4097264171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6803","nonce":4097264171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6807","nonce":4097264171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6805","nonce":4097264171}]},"public_addr":"172.21.15.89:6801/4097264171","cluster_addr":"172.21.15.89:6803/4097264171","heartbeat_back_addr":"172.21.15.89:6807/4097264171","heartbeat_front_addr":"172.21.15.89:6805/4097264171","state":["exists","up"]},{"osd":2,"uuid":"2a4e7147-4125-4ee6-b5ad-85518d7066d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6801","nonce":1479908200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6803","nonce":1479908200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6807","nonce":1479908200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6805","nonce":1479908200}]},"public_addr":"172.21.15.90:6801/1479908200","cluster_addr":"172.21.15.90:6803/1479908200","heartbeat_back_addr":"172.21.15.90:6807/1479908200","heartbeat_front_addr":"172.21.15.90:6805/1479908200","state":["exists","up"]},{"osd":3,"uuid":"7b3da775-0f0a-4b46-a8dc-9ec822a54301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6811","nonce":1796948193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6813","nonce":1796948193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6817","nonce":1796948193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6815","nonce":1796948193}]},"public_addr":"172.21.15.2:6811/1796948193","cluster_addr":"172.21.15.2:6813/1796948193","heartbeat_back_addr":"172.21.15.2:6817/1796948193","heartbeat_front_addr":"172.21.15.2:6815/1796948193","state":["exists","up"]},{"osd":4,"uuid":"d4c8bafc-c844-4ff1-a3d8-7a53576e6b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6809","nonce":4256848315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6811","nonce":4256848315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6815","nonce":4256848315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6813","nonce":4256848315}]},"public_addr":"172.21.15.89:6809/4256848315","cluster_addr":"172.21.15.89:6811/4256848315","heartbeat_back_addr":"172.21.15.89:6815/4256848315","heartbeat_front_addr":"172.21.15.89:6813/4256848315","state":["exists","up"]},{"osd":5,"uuid":"8dc9bb55-29e0-4b04-9415-3b9bb5ed05cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6809","nonce":189855967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6811","nonce":189855967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6815","nonce":189855967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6813","nonce":189855967}]},"public_addr":"172.21.15.90:6809/189855967","cluster_addr":"172.21.15.90:6811/189855967","heartbeat_back_addr":"172.21.15.90:6815/189855967","heartbeat_front_addr":"172.21.15.90:6813/189855967","state":["exists","up"]},{"osd":6,"uuid":"86d1443a-9b43-46de-abd7-4c95b43207f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6819","nonce":3886336279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6821","nonce":3886336279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6825","nonce":3886336279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6823","nonce":3886336279}]},"public_addr":"172.21.15.2:6819/3886336279","cluster_addr":"172.21.15.2:6821/3886336279","heartbeat_back_addr":"172.21.15.2:6825/3886336279","heartbeat_front_addr":"172.21.15.2:6823/3886336279","state":["exists","up"]},{"osd":7,"uuid":"1cc5554c-80d2-4e77-b29a-fd2ada68d82d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6817","nonce":508513510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6819","nonce":508513510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6823","nonce":508513510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6821","nonce":508513510}]},"public_addr":"172.21.15.89:6817/508513510","cluster_addr":"172.21.15.89:6819/508513510","heartbeat_back_addr":"172.21.15.89:6823/508513510","heartbeat_front_addr":"172.21.15.89:6821/508513510","state":["exists","up"]},{"osd":8,"uuid":"e9b2eb92-9af2-4f26-a259-fcaf972e4fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6817","nonce":3558544480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6819","nonce":3558544480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6823","nonce":3558544480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6821","nonce":3558544480}]},"public_addr":"172.21.15.90:6817/3558544480","cluster_addr":"172.21.15.90:6819/3558544480","heartbeat_back_addr":"172.21.15.90:6823/3558544480","heartbeat_front_addr":"172.21.15.90:6821/3558544480","state":["exists","up"]},{"osd":9,"uuid":"194d4c64-dd29-4d35-bc54-0858c44815cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6827","nonce":2690758100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6829","nonce":2690758100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6833","nonce":2690758100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6831","nonce":2690758100}]},"public_addr":"172.21.15.2:6827/2690758100","cluster_addr":"172.21.15.2:6829/2690758100","heartbeat_back_addr":"172.21.15.2:6833/2690758100","heartbeat_front_addr":"172.21.15.2:6831/2690758100","state":["exists","up"]},{"osd":10,"uuid":"7695fa4a-b94e-4afc-b166-690a197ad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6825","nonce":1141925395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6827","nonce":1141925395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6831","nonce":1141925395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6829","nonce":1141925395}]},"public_addr":"172.21.15.89:6825/1141925395","cluster_addr":"172.21.15.89:6827/1141925395","heartbeat_back_addr":"172.21.15.89:6831/1141925395","heartbeat_front_addr":"172.21.15.89:6829/1141925395","state":["exists","up"]},{"osd":11,"uuid":"1815a999-bfdb-46b9-afcd-632ee8ba56d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6825","nonce":468380924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6827","nonce":468380924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6831","nonce":468380924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6829","nonce":468380924}]},"public_addr":"172.21.15.90:6825/468380924","cluster_addr":"172.21.15.90:6827/468380924","heartbeat_back_addr":"172.21.15.90:6831/468380924","heartbeat_front_addr":"172.21.15.90:6829/468380924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:07:36.125754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:01.415356+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:26.420808+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:51.722673+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:09:16.562300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:09:41.958465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:10:07.056167+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:10:32.066195+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:10:56.497875+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:11:21.973083+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:11:46.891515+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:12:11.910012+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9},{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/874985787":"2024-09-20T06:06:11.912585+0000","172.21.15.2:0/1280963020":"2024-09-20T06:06:11.912585+0000","172.21.15.2:0/2976372536":"2024-09-20T06:06:11.912585+0000","172.21.15.2:6801/1602650352":"2024-09-20T06:05:47.538477+0000","172.21.15.2:6800/1602650352":"2024-09-20T06:05:47.538477+0000","172.21.15.2:6800/1200011821":"2024-09-20T06:06:11.912585+0000","172.21.15.2:0/3899165140":"2024-09-20T06:05:47.538477+0000","172.21.15.2:6801/1200011821":"2024-09-20T06:06:11.912585+0000","172.21.15.2:0/1361067708":"2024-09-20T06:05:47.538477+0000","172.21.15.2:0/3763089457":"2024-09-20T06:05:47.538477+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:14:15.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.672+0000 7fac6abc0640 1 -- 172.21.15.2:0/440758884 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fac4c0a3350 msgr2=0x7fac4c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:15.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.672+0000 7fac6abc0640 1 --2- 172.21.15.2:0/440758884 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fac4c0a3350 0x7fac4c0a5810 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fac54006fd0 tx=0x7fac54008040 comp rx=0 tx=0).stop 2024-09-19T06:14:15.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.672+0000 7fac6abc0640 1 -- 172.21.15.2:0/440758884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac64101de0 msgr2=0x7fac6419a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:15.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.672+0000 7fac6abc0640 1 --2- 172.21.15.2:0/440758884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac64101de0 0x7fac6419a6c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fac60006010 tx=0x7fac60004270 comp rx=0 tx=0).stop 2024-09-19T06:14:15.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.672+0000 7fac6abc0640 1 -- 172.21.15.2:0/440758884 shutdown_connections 2024-09-19T06:14:15.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.672+0000 7fac6abc0640 1 --2- 172.21.15.2:0/440758884 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fac4c0a3350 0x7fac4c0a5810 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:15.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.672+0000 7fac6abc0640 1 --2- 172.21.15.2:0/440758884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac64106f10 0x7fac6419ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:15.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.672+0000 7fac6abc0640 1 --2- 172.21.15.2:0/440758884 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac64102790 0x7fac6419ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:15.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.672+0000 7fac6abc0640 1 --2- 172.21.15.2:0/440758884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac64101de0 0x7fac6419a6c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:15.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.672+0000 7fac6abc0640 1 -- 172.21.15.2:0/440758884 >> 172.21.15.2:0/440758884 conn(0x7fac640fd8c0 msgr2=0x7fac640fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:15.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.672+0000 7fac6abc0640 1 -- 172.21.15.2:0/440758884 shutdown_connections 2024-09-19T06:14:15.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:15.672+0000 7fac6abc0640 1 -- 172.21.15.2:0/440758884 wait complete. 2024-09-19T06:14:16.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:15 smithi002 ceph-mon[30982]: pgmap v312: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T06:14:16.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:15 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/440758884' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:14:16.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:15 smithi090 ceph-mon[34497]: pgmap v312: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T06:14:16.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:15 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/440758884' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:14:16.275 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:14:16.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:15 smithi089 ceph-mon[34160]: pgmap v312: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T06:14:16.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:15 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/440758884' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:14:16.532 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:16.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:16.982+0000 7fa52c700640 1 -- 172.21.15.2:0/1463035193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa524106f50 msgr2=0x7fa52410eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:16.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:16.982+0000 7fa52c700640 1 --2- 172.21.15.2:0/1463035193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa524106f50 0x7fa52410eaf0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa51c009cd0 tx=0x7fa51c02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:14:16.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:16.982+0000 7fa52c700640 1 -- 172.21.15.2:0/1463035193 shutdown_connections 2024-09-19T06:14:16.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:16.982+0000 7fa52c700640 1 --2- 172.21.15.2:0/1463035193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa524106f50 0x7fa52410eaf0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:16.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:16.982+0000 7fa52c700640 1 --2- 172.21.15.2:0/1463035193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa524100d00 0x7fa524106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:16.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:16.982+0000 7fa52c700640 1 --2- 172.21.15.2:0/1463035193 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa524100350 0x7fa524100730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:16.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:16.982+0000 7fa52c700640 1 -- 172.21.15.2:0/1463035193 >> 172.21.15.2:0/1463035193 conn(0x7fa524077210 msgr2=0x7fa5240fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:16.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:16.982+0000 7fa52c700640 1 -- 172.21.15.2:0/1463035193 shutdown_connections 2024-09-19T06:14:16.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:16.982+0000 7fa52c700640 1 -- 172.21.15.2:0/1463035193 wait complete. 2024-09-19T06:14:16.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:16.983+0000 7fa52c700640 1 Processor -- start 2024-09-19T06:14:16.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:16.983+0000 7fa52c700640 1 -- start start 2024-09-19T06:14:16.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:16.983+0000 7fa52c700640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa524100350 0x7fa5241984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:16.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:16.983+0000 7fa52c700640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa524100d00 0x7fa524198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:16.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:16.983+0000 7fa52c700640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa524106f50 0x7fa52419cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:16.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:16.983+0000 7fa52c700640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa524111f30 con 0x7fa524106f50 2024-09-19T06:14:16.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:16.983+0000 7fa52c700640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa524111db0 con 0x7fa524100d00 2024-09-19T06:14:16.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:16.983+0000 7fa52c700640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa5241120b0 con 0x7fa524100350 2024-09-19T06:14:16.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:16.983+0000 7fa52ac9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa524106f50 0x7fa52419cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:16.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:16.983+0000 7fa52ac9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa524106f50 0x7fa52419cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36712/0 (socket says 172.21.15.2:36712) 2024-09-19T06:14:16.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:16.983+0000 7fa52ac9d640 1 -- 172.21.15.2:0/3889013673 learned_addr learned my addr 172.21.15.2:0/3889013673 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:16.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:16.983+0000 7fa529c9b640 1 --2- 172.21.15.2:0/3889013673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa524100d00 0x7fa524198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:16.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:16.983+0000 7fa52a49c640 1 --2- 172.21.15.2:0/3889013673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa524100350 0x7fa5241984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:16.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:16.984+0000 7fa52ac9d640 1 -- 172.21.15.2:0/3889013673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa524100350 msgr2=0x7fa5241984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:16.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:16.984+0000 7fa52ac9d640 1 --2- 172.21.15.2:0/3889013673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa524100350 0x7fa5241984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:16.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:16.984+0000 7fa52ac9d640 1 -- 172.21.15.2:0/3889013673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa524100d00 msgr2=0x7fa524198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:16.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:16.984+0000 7fa52ac9d640 1 --2- 172.21.15.2:0/3889013673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa524100d00 0x7fa524198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:16.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:16.984+0000 7fa52ac9d640 1 -- 172.21.15.2:0/3889013673 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa52419d4a0 con 0x7fa524106f50 2024-09-19T06:14:16.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:16.984+0000 7fa52a49c640 1 --2- 172.21.15.2:0/3889013673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa524100350 0x7fa5241984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:14:16.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:16.984+0000 7fa52ac9d640 1 --2- 172.21.15.2:0/3889013673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa524106f50 0x7fa52419cdc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa51c005cc0 tx=0x7fa51c003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:16.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:16.984+0000 7fa51b7fe640 1 -- 172.21.15.2:0/3889013673 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa51c004240 con 0x7fa524106f50 2024-09-19T06:14:16.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:16.984+0000 7fa51b7fe640 1 -- 172.21.15.2:0/3889013673 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa51c0305a0 con 0x7fa524106f50 2024-09-19T06:14:16.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:16.984+0000 7fa51b7fe640 1 -- 172.21.15.2:0/3889013673 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa51c0466c0 con 0x7fa524106f50 2024-09-19T06:14:16.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:16.984+0000 7fa52c700640 1 -- 172.21.15.2:0/3889013673 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa52419d730 con 0x7fa524106f50 2024-09-19T06:14:16.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:16.984+0000 7fa52c700640 1 -- 172.21.15.2:0/3889013673 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5241a5070 con 0x7fa524106f50 2024-09-19T06:14:16.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:16.985+0000 7fa52c700640 1 -- 172.21.15.2:0/3889013673 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5241007b0 con 0x7fa524106f50 2024-09-19T06:14:16.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:16.986+0000 7fa51b7fe640 1 -- 172.21.15.2:0/3889013673 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fa51c030ac0 con 0x7fa524106f50 2024-09-19T06:14:16.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:16.987+0000 7fa51b7fe640 1 --2- 172.21.15.2:0/3889013673 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fa5100a32d0 0x7fa5100a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:16.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:16.987+0000 7fa51b7fe640 1 -- 172.21.15.2:0/3889013673 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7fa51c02e030 con 0x7fa524106f50 2024-09-19T06:14:16.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:16.987+0000 7fa52a49c640 1 --2- 172.21.15.2:0/3889013673 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fa5100a32d0 0x7fa5100a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:16.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:16.988+0000 7fa52a49c640 1 --2- 172.21.15.2:0/3889013673 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fa5100a32d0 0x7fa5100a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa520009930 tx=0x7fa520008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:16.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:16.990+0000 7fa51b7fe640 1 -- 172.21.15.2:0/3889013673 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa51c04b060 con 0x7fa524106f50 2024-09-19T06:14:17.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:17.200+0000 7fa52c700640 1 -- 172.21.15.2:0/3889013673 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa52410a1a0 con 0x7fa524106f50 2024-09-19T06:14:17.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:17.201+0000 7fa51b7fe640 1 -- 172.21.15.2:0/3889013673 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11882 (secure 0 0 0) 0x7fa51c0be120 con 0x7fa524106f50 2024-09-19T06:14:17.203 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:14:17.203 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":25,"btime":"2024-09-19T06:13:17:867959+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:13:17.867946+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24472,24470]},"id":1}]} 2024-09-19T06:14:17.203 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 25 2024-09-19T06:14:17.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:17.203+0000 7fa52c700640 1 -- 172.21.15.2:0/3889013673 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fa5100a32d0 msgr2=0x7fa5100a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:17.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:17.203+0000 7fa52c700640 1 --2- 172.21.15.2:0/3889013673 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fa5100a32d0 0x7fa5100a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa520009930 tx=0x7fa520008040 comp rx=0 tx=0).stop 2024-09-19T06:14:17.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:17.203+0000 7fa52c700640 1 -- 172.21.15.2:0/3889013673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa524106f50 msgr2=0x7fa52419cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:17.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:17.203+0000 7fa52c700640 1 --2- 172.21.15.2:0/3889013673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa524106f50 0x7fa52419cdc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa51c005cc0 tx=0x7fa51c003ba0 comp rx=0 tx=0).stop 2024-09-19T06:14:17.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:17.203+0000 7fa52c700640 1 -- 172.21.15.2:0/3889013673 shutdown_connections 2024-09-19T06:14:17.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:17.203+0000 7fa52c700640 1 --2- 172.21.15.2:0/3889013673 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fa5100a32d0 0x7fa5100a5790 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:17.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:17.203+0000 7fa52c700640 1 --2- 172.21.15.2:0/3889013673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa524106f50 0x7fa52419cdc0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:17.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:17.203+0000 7fa52c700640 1 --2- 172.21.15.2:0/3889013673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa524100d00 0x7fa524198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:17.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:17.203+0000 7fa52c700640 1 --2- 172.21.15.2:0/3889013673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa524100350 0x7fa5241984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:17.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:17.203+0000 7fa52c700640 1 -- 172.21.15.2:0/3889013673 >> 172.21.15.2:0/3889013673 conn(0x7fa524077210 msgr2=0x7fa524105300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:17.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:17.203+0000 7fa52c700640 1 -- 172.21.15.2:0/3889013673 shutdown_connections 2024-09-19T06:14:17.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:17.203+0000 7fa52c700640 1 -- 172.21.15.2:0/3889013673 wait complete. 2024-09-19T06:14:17.762 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T06:13:04.348577+0000', 'modified': '2024-09-19T06:13:17.867946+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24497, 'mds_1': 24472, 'mds_2': 24470}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24448': {'gid': 24448, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.90:6835/1607170353', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6834', 'nonce': 1607170353}, {'type': 'v1', 'addr': '172.21.15.90:6835', 'nonce': 1607170353}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24449': {'gid': 24449, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.89:6835/56684343', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6834', 'nonce': 56684343}, {'type': 'v1', 'addr': '172.21.15.89:6835', 'nonce': 56684343}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24460': {'gid': 24460, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.90:6837/2402014616', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6836', 'nonce': 2402014616}, {'type': 'v1', 'addr': '172.21.15.90:6837', 'nonce': 2402014616}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24470': {'gid': 24470, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.89:6837/1620064646', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6836', 'nonce': 1620064646}, {'type': 'v1', 'addr': '172.21.15.89:6837', 'nonce': 1620064646}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24472': {'gid': 24472, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.90:6839/3866538228', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6838', 'nonce': 3866538228}, {'type': 'v1', 'addr': '172.21.15.90:6839', 'nonce': 3866538228}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24497': {'gid': 24497, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.89:6839/3897636568', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6838', 'nonce': 3897636568}, {'type': 'v1', 'addr': '172.21.15.89:6839', 'nonce': 3897636568}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24497, 'qdb_cluster': [24497, 24472, 24470]} 2024-09-19T06:14:17.763 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-19T06:14:17.763 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-19T06:14:17.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:17 smithi002 ceph-mon[30982]: pgmap v313: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T06:14:17.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:17 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/3889013673' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:14:18.022 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:18.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:17 smithi090 ceph-mon[34497]: pgmap v313: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T06:14:18.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:17 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/3889013673' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:14:18.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:17 smithi089 ceph-mon[34160]: pgmap v313: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T06:14:18.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:17 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/3889013673' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:14:18.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.432+0000 7fb83676c640 1 -- 172.21.15.2:0/2342392532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb83010c1a0 msgr2=0x7fb83010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:18.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.432+0000 7fb83676c640 1 --2- 172.21.15.2:0/2342392532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb83010c1a0 0x7fb83010e610 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb828009ca0 tx=0x7fb82802a950 comp rx=0 tx=0).stop 2024-09-19T06:14:18.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.432+0000 7fb83676c640 1 -- 172.21.15.2:0/2342392532 shutdown_connections 2024-09-19T06:14:18.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.432+0000 7fb83676c640 1 --2- 172.21.15.2:0/2342392532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb83010c1a0 0x7fb83010e610 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:18.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.432+0000 7fb83676c640 1 --2- 172.21.15.2:0/2342392532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb830103720 0x7fb83010bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:18.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.432+0000 7fb83676c640 1 --2- 172.21.15.2:0/2342392532 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb830102e00 0x7fb8301031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:18.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.432+0000 7fb83676c640 1 -- 172.21.15.2:0/2342392532 >> 172.21.15.2:0/2342392532 conn(0x7fb8300fc7a0 msgr2=0x7fb8300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:18.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.432+0000 7fb83676c640 1 -- 172.21.15.2:0/2342392532 shutdown_connections 2024-09-19T06:14:18.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.432+0000 7fb83676c640 1 -- 172.21.15.2:0/2342392532 wait complete. 2024-09-19T06:14:18.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.433+0000 7fb83676c640 1 Processor -- start 2024-09-19T06:14:18.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.434+0000 7fb83676c640 1 -- start start 2024-09-19T06:14:18.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.434+0000 7fb83676c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb830102e00 0x7fb830198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:18.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.434+0000 7fb83676c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb830103720 0x7fb8301988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:18.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.434+0000 7fb83676c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb83010c1a0 0x7fb83019cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:18.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.434+0000 7fb83676c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb830111e60 con 0x7fb830102e00 2024-09-19T06:14:18.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.434+0000 7fb83676c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb830111ce0 con 0x7fb83010c1a0 2024-09-19T06:14:18.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.434+0000 7fb83676c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb830111fe0 con 0x7fb830103720 2024-09-19T06:14:18.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.434+0000 7fb82ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb830102e00 0x7fb830198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:18.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.434+0000 7fb82ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb830102e00 0x7fb830198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36736/0 (socket says 172.21.15.2:36736) 2024-09-19T06:14:18.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.434+0000 7fb82ffff640 1 -- 172.21.15.2:0/3397928400 learned_addr learned my addr 172.21.15.2:0/3397928400 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:18.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.434+0000 7fb834d09640 1 --2- 172.21.15.2:0/3397928400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb83010c1a0 0x7fb83019cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:18.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.435+0000 7fb82f7fe640 1 --2- 172.21.15.2:0/3397928400 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb830103720 0x7fb8301988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:18.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.435+0000 7fb82ffff640 1 -- 172.21.15.2:0/3397928400 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb830103720 msgr2=0x7fb8301988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:18.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.435+0000 7fb82ffff640 1 --2- 172.21.15.2:0/3397928400 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb830103720 0x7fb8301988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:18.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.435+0000 7fb82ffff640 1 -- 172.21.15.2:0/3397928400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb83010c1a0 msgr2=0x7fb83019cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:18.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.435+0000 7fb82ffff640 1 --2- 172.21.15.2:0/3397928400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb83010c1a0 0x7fb83019cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:18.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.435+0000 7fb82ffff640 1 -- 172.21.15.2:0/3397928400 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb83019d340 con 0x7fb830102e00 2024-09-19T06:14:18.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.435+0000 7fb82ffff640 1 --2- 172.21.15.2:0/3397928400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb830102e00 0x7fb830198390 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb82000b4a0 tx=0x7fb82000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:18.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.435+0000 7fb82d7fa640 1 -- 172.21.15.2:0/3397928400 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb820014070 con 0x7fb830102e00 2024-09-19T06:14:18.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.435+0000 7fb83676c640 1 -- 172.21.15.2:0/3397928400 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb83019d630 con 0x7fb830102e00 2024-09-19T06:14:18.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.435+0000 7fb82d7fa640 1 -- 172.21.15.2:0/3397928400 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb820010ac0 con 0x7fb830102e00 2024-09-19T06:14:18.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.435+0000 7fb82d7fa640 1 -- 172.21.15.2:0/3397928400 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb820017c30 con 0x7fb830102e00 2024-09-19T06:14:18.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.435+0000 7fb83676c640 1 -- 172.21.15.2:0/3397928400 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8301a4f10 con 0x7fb830102e00 2024-09-19T06:14:18.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.438+0000 7fb82d7fa640 1 -- 172.21.15.2:0/3397928400 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fb820017070 con 0x7fb830102e00 2024-09-19T06:14:18.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.438+0000 7fb838b45740 1 Processor -- start 2024-09-19T06:14:18.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.438+0000 7fb838b45740 1 -- start start 2024-09-19T06:14:18.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.438+0000 7fb838b45740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565b5d579d0 0x5565b5d57db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:18.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.438+0000 7fb838b45740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5565b5d582f0 0x5565b5d62670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:18.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.438+0000 7fb838b45740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5565b5d62bb0 0x5565b5d64fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:18.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.438+0000 7fb838b45740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5565b5cbe090 con 0x5565b5d579d0 2024-09-19T06:14:18.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.438+0000 7fb838b45740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5565b5c65a70 con 0x5565b5d582f0 2024-09-19T06:14:18.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.438+0000 7fb838b45740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5565b5cba050 con 0x5565b5d62bb0 2024-09-19T06:14:18.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.438+0000 7fb834d09640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565b5d579d0 0x5565b5d57db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:18.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.438+0000 7fb834d09640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565b5d579d0 0x5565b5d57db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36752/0 (socket says 172.21.15.2:36752) 2024-09-19T06:14:18.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.438+0000 7fb834d09640 1 -- 172.21.15.2:0/175499042 learned_addr learned my addr 172.21.15.2:0/175499042 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:18.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.439+0000 7fb82f7fe640 1 --2- 172.21.15.2:0/175499042 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5565b5d62bb0 0x5565b5d64fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:18.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.439+0000 7fb82ffff640 1 --2- 172.21.15.2:0/175499042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5565b5d582f0 0x5565b5d62670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:18.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.439+0000 7fb82d7fa640 1 --2- 172.21.15.2:0/3397928400 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fb8180a32d0 0x7fb8180a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:18.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.439+0000 7fb834d09640 1 -- 172.21.15.2:0/175499042 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5565b5d62bb0 msgr2=0x5565b5d64fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:18.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.439+0000 7fb834d09640 1 --2- 172.21.15.2:0/175499042 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5565b5d62bb0 0x5565b5d64fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:18.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.439+0000 7fb834d09640 1 -- 172.21.15.2:0/175499042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5565b5d582f0 msgr2=0x5565b5d62670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:18.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.439+0000 7fb834d09640 1 --2- 172.21.15.2:0/175499042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5565b5d582f0 0x5565b5d62670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:18.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.439+0000 7fb834d09640 1 -- 172.21.15.2:0/175499042 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565b5c72130 con 0x5565b5d579d0 2024-09-19T06:14:18.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.439+0000 7fb834d09640 1 --2- 172.21.15.2:0/3397928400 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fb8180a32d0 0x7fb8180a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:18.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.439+0000 7fb82d7fa640 1 -- 172.21.15.2:0/3397928400 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7fb8200cf0b0 con 0x7fb830102e00 2024-09-19T06:14:18.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.439+0000 7fb834d09640 1 --2- 172.21.15.2:0/175499042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565b5d579d0 0x5565b5d57db0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb828035000 tx=0x7fb82802fea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=374ce24dd4081092 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:18.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.439+0000 7fb8167fc640 1 -- 172.21.15.2:0/175499042 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb828034040 con 0x5565b5d579d0 2024-09-19T06:14:18.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.439+0000 7fb8167fc640 1 -- 172.21.15.2:0/175499042 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb82802f520 con 0x5565b5d579d0 2024-09-19T06:14:18.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.439+0000 7fb8167fc640 1 -- 172.21.15.2:0/175499042 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8280466e0 con 0x5565b5d579d0 2024-09-19T06:14:18.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.440+0000 7fb838b45740 1 -- 172.21.15.2:0/175499042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565b5d579d0 msgr2=0x5565b5d57db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:18.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.440+0000 7fb838b45740 1 --2- 172.21.15.2:0/175499042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565b5d579d0 0x5565b5d57db0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb828035000 tx=0x7fb82802fea0 comp rx=0 tx=0).stop 2024-09-19T06:14:18.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.440+0000 7fb834d09640 1 --2- 172.21.15.2:0/3397928400 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fb8180a32d0 0x7fb8180a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb82804d000 tx=0x7fb82804a000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:18.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.440+0000 7fb838b45740 1 -- 172.21.15.2:0/175499042 shutdown_connections 2024-09-19T06:14:18.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.440+0000 7fb838b45740 1 --2- 172.21.15.2:0/175499042 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5565b5d62bb0 0x5565b5d64fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:18.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.440+0000 7fb838b45740 1 --2- 172.21.15.2:0/175499042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5565b5d582f0 0x5565b5d62670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:18.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.440+0000 7fb838b45740 1 --2- 172.21.15.2:0/175499042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565b5d579d0 0x5565b5d57db0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:18.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.440+0000 7fb838b45740 1 -- 172.21.15.2:0/175499042 >> 172.21.15.2:0/175499042 conn(0x5565b5d53f60 msgr2=0x5565b5d54340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:18.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.440+0000 7fb838b45740 1 -- 172.21.15.2:0/175499042 shutdown_connections 2024-09-19T06:14:18.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.440+0000 7fb838b45740 1 -- 172.21.15.2:0/175499042 wait complete. 2024-09-19T06:14:18.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.440+0000 7fb838b45740 1 -- start start 2024-09-19T06:14:18.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.441+0000 7fb838b45740 1 Processor -- start 2024-09-19T06:14:18.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.441+0000 7fb838b45740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5565b5d579d0 0x5565b5d62450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:18.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.441+0000 7fb838b45740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5565b5d582f0 0x5565b5d5f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:18.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.441+0000 7fb838b45740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565b5d62bb0 0x5565b5d5fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:18.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.441+0000 7fb838b45740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5565b5d65780 con 0x5565b5d62bb0 2024-09-19T06:14:18.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.441+0000 7fb838b45740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5565b5c78f20 con 0x5565b5d582f0 2024-09-19T06:14:18.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.441+0000 7fb838b45740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5565b5d65900 con 0x5565b5d579d0 2024-09-19T06:14:18.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.441+0000 7fb838b45740 10 client.0 _ll_register_callbacks cb 0x5565b5c42030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:18.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.441+0000 7fb834d09640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565b5d62bb0 0x5565b5d5fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:18.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.441+0000 7fb834d09640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565b5d62bb0 0x5565b5d5fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36754/0 (socket says 172.21.15.2:36754) 2024-09-19T06:14:18.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.441+0000 7fb82ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5565b5d579d0 0x5565b5d62450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:18.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.441+0000 7fb834d09640 1 -- 172.21.15.2:0/756903118 learned_addr learned my addr 172.21.15.2:0/756903118 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:18.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.441+0000 7fb82f7fe640 1 --2- 172.21.15.2:0/756903118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5565b5d582f0 0x5565b5d5f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:18.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.441+0000 7fb834d09640 1 -- 172.21.15.2:0/756903118 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5565b5d579d0 msgr2=0x5565b5d62450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:18.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.441+0000 7fb834d09640 1 --2- 172.21.15.2:0/756903118 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5565b5d579d0 0x5565b5d62450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:18.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.441+0000 7fb834d09640 1 -- 172.21.15.2:0/756903118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5565b5d582f0 msgr2=0x5565b5d5f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:18.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.441+0000 7fb834d09640 1 --2- 172.21.15.2:0/756903118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5565b5d582f0 0x5565b5d5f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:18.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.441+0000 7fb834d09640 1 -- 172.21.15.2:0/756903118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565b5a2f2b0 con 0x5565b5d62bb0 2024-09-19T06:14:18.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.442+0000 7fb82ffff640 1 --2- 172.21.15.2:0/756903118 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5565b5d579d0 0x5565b5d62450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:18.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.442+0000 7fb834d09640 1 --2- 172.21.15.2:0/756903118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565b5d62bb0 0x5565b5d5fce0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb828046cb0 tx=0x7fb828004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7272ed49e4a73308 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:18.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.442+0000 7fb80f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:14:18.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.442+0000 7fb80f7fe640 1 -- 172.21.15.2:0/756903118 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb828009800 con 0x5565b5d62bb0 2024-09-19T06:14:18.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.442+0000 7fb80f7fe640 1 -- 172.21.15.2:0/756903118 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7fb828004250 con 0x5565b5d62bb0 2024-09-19T06:14:18.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.442+0000 7fb838b45740 1 -- 172.21.15.2:0/756903118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb82802f520 con 0x5565b5d62bb0 2024-09-19T06:14:18.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.442+0000 7fb80f7fe640 1 -- 172.21.15.2:0/756903118 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb828004450 con 0x5565b5d62bb0 2024-09-19T06:14:18.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.442+0000 7fb838b45740 10 client.14964 fetch_fsmap learned FSMap version 25 2024-09-19T06:14:18.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.442+0000 7fb838b45740 1 -- 172.21.15.2:0/756903118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5565b5d65780 con 0x5565b5d62bb0 2024-09-19T06:14:18.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.442+0000 7fb80f7fe640 1 -- 172.21.15.2:0/756903118 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb82802f520 con 0x5565b5d62bb0 2024-09-19T06:14:18.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.443+0000 7fb80f7fe640 1 -- 172.21.15.2:0/756903118 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb8280309d0 con 0x5565b5d62bb0 2024-09-19T06:14:18.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.443+0000 7fb838b45740 10 client.14964 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T06:14:18.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.443+0000 7fb838b45740 10 client.14964 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T06:14:18.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.443+0000 7fb838b45740 20 client.14964 populate_metadata read hostname 'smithi002' 2024-09-19T06:14:18.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.443+0000 7fb838b45740 1 --2- 172.21.15.2:0/756903118 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x5565b5d73240 0x5565b5d746b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:18.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.443+0000 7fb838b45740 4 client.14964 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:14:18.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.443+0000 7fb838b45740 1 -- 172.21.15.2:0/756903118 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5565b5ccb600 con 0x5565b5d73240 2024-09-19T06:14:18.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.443+0000 7fb82ffff640 1 --2- 172.21.15.2:0/756903118 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x5565b5d73240 0x5565b5d746b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:18.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.444+0000 7fb82ffff640 1 --2- 172.21.15.2:0/756903118 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x5565b5d73240 0x5565b5d746b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f57628edeb1d6cb7 server_cookie=8d714b8cdc6b5a63 in_seq=0 out_seq=0 2024-09-19T06:14:18.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.444+0000 7fb80f7fe640 10 client.14964 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:14:18.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.444+0000 7fb80f7fe640 1 -- 172.21.15.2:0/756903118 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5565b5ccb600 con 0x5565b5d73240 2024-09-19T06:14:18.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.444+0000 7fb80f7fe640 10 client.14964 handle_command_reply: tid=0 2024-09-19T06:14:18.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.444+0000 7fb838b45740 1 client.14964 shutdown 2024-09-19T06:14:18.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.445+0000 7fb838b45740 1 -- 172.21.15.2:0/756903118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565b5d62bb0 msgr2=0x5565b5d5fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:18.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.445+0000 7fb838b45740 1 --2- 172.21.15.2:0/756903118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565b5d62bb0 0x5565b5d5fce0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb828046cb0 tx=0x7fb828004a40 comp rx=0 tx=0).stop 2024-09-19T06:14:18.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.445+0000 7fb838b45740 1 -- 172.21.15.2:0/756903118 shutdown_connections 2024-09-19T06:14:18.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.445+0000 7fb838b45740 1 --2- 172.21.15.2:0/756903118 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x5565b5d73240 0x5565b5d746b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:18.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.445+0000 7fb838b45740 1 --2- 172.21.15.2:0/756903118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565b5d62bb0 0x5565b5d5fce0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:18.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.445+0000 7fb838b45740 1 --2- 172.21.15.2:0/756903118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5565b5d582f0 0x5565b5d5f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:18.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.445+0000 7fb838b45740 1 --2- 172.21.15.2:0/756903118 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5565b5d579d0 0x5565b5d62450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:18.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.445+0000 7fb80f7fe640 0 client.14964 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:14:18.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.445+0000 7fb838b45740 1 -- 172.21.15.2:0/756903118 >> 172.21.15.2:0/756903118 conn(0x5565b5d53f60 msgr2=0x5565b5d59c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:18.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.445+0000 7fb838b45740 1 -- 172.21.15.2:0/756903118 shutdown_connections 2024-09-19T06:14:18.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.445+0000 7fb838b45740 1 -- 172.21.15.2:0/756903118 wait complete. 2024-09-19T06:14:18.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.445+0000 7fb838b45740 20 client.14964 trim_cache size 0 max 16384 2024-09-19T06:14:18.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.463+0000 7fb838b45740 1 Processor -- start 2024-09-19T06:14:18.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.463+0000 7fb838b45740 1 -- start start 2024-09-19T06:14:18.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.463+0000 7fb838b45740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565b5d579d0 0x5565b5d746b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:18.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.463+0000 7fb838b45740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5565b5d582f0 0x5565b5d4ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:18.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.463+0000 7fb838b45740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5565b5d62bb0 0x5565b5d5ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:18.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.463+0000 7fb838b45740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5565b5d729f0 con 0x5565b5d579d0 2024-09-19T06:14:18.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.463+0000 7fb838b45740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5565b5d730c0 con 0x5565b5d62bb0 2024-09-19T06:14:18.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.463+0000 7fb838b45740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5565b5d73790 con 0x5565b5d582f0 2024-09-19T06:14:18.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.463+0000 7fb82ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565b5d579d0 0x5565b5d746b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:18.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.463+0000 7fb82ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565b5d579d0 0x5565b5d746b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36756/0 (socket says 172.21.15.2:36756) 2024-09-19T06:14:18.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.463+0000 7fb82ffff640 1 -- 172.21.15.2:0/3417097318 learned_addr learned my addr 172.21.15.2:0/3417097318 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:18.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.463+0000 7fb82f7fe640 1 --2- 172.21.15.2:0/3417097318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5565b5d582f0 0x5565b5d4ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:18.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.463+0000 7fb82ffff640 1 -- 172.21.15.2:0/3417097318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5565b5d582f0 msgr2=0x5565b5d4ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:18.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.463+0000 7fb82ffff640 1 --2- 172.21.15.2:0/3417097318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5565b5d582f0 0x5565b5d4ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:18.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.463+0000 7fb834d09640 1 --2- 172.21.15.2:0/3417097318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5565b5d62bb0 0x5565b5d5ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:18.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.463+0000 7fb82ffff640 1 -- 172.21.15.2:0/3417097318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5565b5d62bb0 msgr2=0x5565b5d5ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:18.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.463+0000 7fb82ffff640 1 --2- 172.21.15.2:0/3417097318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5565b5d62bb0 0x5565b5d5ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:18.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.463+0000 7fb82ffff640 1 -- 172.21.15.2:0/3417097318 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565b5d58120 con 0x5565b5d579d0 2024-09-19T06:14:18.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.463+0000 7fb82ffff640 1 --2- 172.21.15.2:0/3417097318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565b5d579d0 0x5565b5d746b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb820098060 tx=0x7fb820097a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0a3574324e144be server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:18.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.464+0000 7fb815ffb640 1 -- 172.21.15.2:0/3417097318 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb82001e040 con 0x5565b5d579d0 2024-09-19T06:14:18.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.464+0000 7fb815ffb640 1 -- 172.21.15.2:0/3417097318 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb82009bd90 con 0x5565b5d579d0 2024-09-19T06:14:18.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.464+0000 7fb815ffb640 1 -- 172.21.15.2:0/3417097318 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8200cccc0 con 0x5565b5d579d0 2024-09-19T06:14:18.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.464+0000 7fb838b45740 1 -- 172.21.15.2:0/3417097318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565b5d579d0 msgr2=0x5565b5d746b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:18.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.464+0000 7fb838b45740 1 --2- 172.21.15.2:0/3417097318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565b5d579d0 0x5565b5d746b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb820098060 tx=0x7fb820097a60 comp rx=0 tx=0).stop 2024-09-19T06:14:18.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.464+0000 7fb838b45740 1 -- 172.21.15.2:0/3417097318 shutdown_connections 2024-09-19T06:14:18.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.464+0000 7fb838b45740 1 --2- 172.21.15.2:0/3417097318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5565b5d62bb0 0x5565b5d5ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:18.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.464+0000 7fb838b45740 1 --2- 172.21.15.2:0/3417097318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5565b5d582f0 0x5565b5d4ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:18.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.464+0000 7fb838b45740 1 --2- 172.21.15.2:0/3417097318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565b5d579d0 0x5565b5d746b0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:18.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.464+0000 7fb838b45740 1 -- 172.21.15.2:0/3417097318 >> 172.21.15.2:0/3417097318 conn(0x5565b5d53f60 msgr2=0x5565b5d5ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:18.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.464+0000 7fb838b45740 1 -- 172.21.15.2:0/3417097318 shutdown_connections 2024-09-19T06:14:18.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.464+0000 7fb838b45740 1 -- 172.21.15.2:0/3417097318 wait complete. 2024-09-19T06:14:18.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.465+0000 7fb838b45740 1 -- start start 2024-09-19T06:14:18.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.465+0000 7fb838b45740 1 Processor -- start 2024-09-19T06:14:18.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.465+0000 7fb838b45740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565b5d579d0 0x5565b5d758b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:18.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.465+0000 7fb838b45740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5565b5d582f0 0x5565b5d75df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:18.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.465+0000 7fb838b45740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5565b5d62bb0 0x5565b5d76330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:18.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.465+0000 7fb838b45740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5565b5d74530 con 0x5565b5d579d0 2024-09-19T06:14:18.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.465+0000 7fb838b45740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5565b5d73e60 con 0x5565b5d582f0 2024-09-19T06:14:18.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.465+0000 7fb838b45740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5565b5d74c00 con 0x5565b5d62bb0 2024-09-19T06:14:18.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.465+0000 7fb838b45740 10 client.0 _ll_register_callbacks cb 0x7fb8200979b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:18.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.465+0000 7fb82ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565b5d579d0 0x5565b5d758b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:18.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.465+0000 7fb82ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565b5d579d0 0x5565b5d758b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36770/0 (socket says 172.21.15.2:36770) 2024-09-19T06:14:18.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.465+0000 7fb82ffff640 1 -- 172.21.15.2:0/3495062648 learned_addr learned my addr 172.21.15.2:0/3495062648 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:18.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.465+0000 7fb82f7fe640 1 --2- 172.21.15.2:0/3495062648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5565b5d582f0 0x5565b5d75df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:18.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.466+0000 7fb834d09640 1 --2- 172.21.15.2:0/3495062648 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5565b5d62bb0 0x5565b5d76330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:18.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.466+0000 7fb82ffff640 1 -- 172.21.15.2:0/3495062648 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5565b5d62bb0 msgr2=0x5565b5d76330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:18.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.466+0000 7fb82ffff640 1 --2- 172.21.15.2:0/3495062648 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5565b5d62bb0 0x5565b5d76330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:18.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.466+0000 7fb82ffff640 1 -- 172.21.15.2:0/3495062648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5565b5d582f0 msgr2=0x5565b5d75df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:18.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.466+0000 7fb82ffff640 1 --2- 172.21.15.2:0/3495062648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5565b5d582f0 0x5565b5d75df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:18.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.466+0000 7fb82ffff640 1 -- 172.21.15.2:0/3495062648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565b5ddbaa0 con 0x5565b5d579d0 2024-09-19T06:14:18.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.466+0000 7fb834d09640 1 --2- 172.21.15.2:0/3495062648 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5565b5d62bb0 0x5565b5d76330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:14:18.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.466+0000 7fb82f7fe640 1 --2- 172.21.15.2:0/3495062648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5565b5d582f0 0x5565b5d75df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:14:18.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.466+0000 7fb82ffff640 1 --2- 172.21.15.2:0/3495062648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565b5d579d0 0x5565b5d758b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb82000be60 tx=0x7fb820009330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e45d61d5cc35a82 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:18.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.466+0000 7fb80f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:14:18.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.466+0000 7fb80f7fe640 1 -- 172.21.15.2:0/3495062648 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb820082050 con 0x5565b5d579d0 2024-09-19T06:14:18.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.466+0000 7fb80f7fe640 1 -- 172.21.15.2:0/3495062648 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7fb820017dd0 con 0x5565b5d579d0 2024-09-19T06:14:18.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.466+0000 7fb838b45740 1 -- 172.21.15.2:0/3495062648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb82009bd90 con 0x5565b5d579d0 2024-09-19T06:14:18.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.466+0000 7fb80f7fe640 1 -- 172.21.15.2:0/3495062648 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb82001e070 con 0x5565b5d579d0 2024-09-19T06:14:18.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.466+0000 7fb838b45740 10 client.14970 fetch_fsmap learned FSMap version 25 2024-09-19T06:14:18.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.466+0000 7fb838b45740 1 -- 172.21.15.2:0/3495062648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5565b5ddcda0 con 0x5565b5d579d0 2024-09-19T06:14:18.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.466+0000 7fb80f7fe640 1 -- 172.21.15.2:0/3495062648 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb82009bd90 con 0x5565b5d579d0 2024-09-19T06:14:18.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.467+0000 7fb80f7fe640 1 -- 172.21.15.2:0/3495062648 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb820010c70 con 0x5565b5d579d0 2024-09-19T06:14:18.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.467+0000 7fb838b45740 10 client.14970 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T06:14:18.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.467+0000 7fb838b45740 10 client.14970 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T06:14:18.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.467+0000 7fb838b45740 20 client.14970 populate_metadata read hostname 'smithi002' 2024-09-19T06:14:18.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.467+0000 7fb838b45740 1 --2- 172.21.15.2:0/3495062648 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x5565b5de1470 0x5565b5de0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:18.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.467+0000 7fb838b45740 4 client.14970 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:14:18.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.467+0000 7fb838b45740 1 -- 172.21.15.2:0/3495062648 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "status"}) -- 0x5565b5cc5b10 con 0x5565b5de1470 2024-09-19T06:14:18.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.467+0000 7fb82f7fe640 1 --2- 172.21.15.2:0/3495062648 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x5565b5de1470 0x5565b5de0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:18.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.467+0000 7fb82f7fe640 1 --2- 172.21.15.2:0/3495062648 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x5565b5de1470 0x5565b5de0180 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a3f2cd1aa3268e85 server_cookie=62f99320d26fd6a9 in_seq=0 out_seq=0 2024-09-19T06:14:18.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.467+0000 7fb80f7fe640 10 client.14970 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:14:18.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.467+0000 7fb80f7fe640 1 -- 172.21.15.2:0/3495062648 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5565b5cc5b10 con 0x5565b5de1470 2024-09-19T06:14:18.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.467+0000 7fb80f7fe640 10 client.14970 handle_command_reply: tid=0 2024-09-19T06:14:18.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.468+0000 7fb838b45740 1 client.14970 shutdown 2024-09-19T06:14:18.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.468+0000 7fb838b45740 1 -- 172.21.15.2:0/3495062648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565b5d579d0 msgr2=0x5565b5d758b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:18.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.468+0000 7fb838b45740 1 --2- 172.21.15.2:0/3495062648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565b5d579d0 0x5565b5d758b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb82000be60 tx=0x7fb820009330 comp rx=0 tx=0).stop 2024-09-19T06:14:18.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.468+0000 7fb838b45740 1 -- 172.21.15.2:0/3495062648 shutdown_connections 2024-09-19T06:14:18.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.468+0000 7fb838b45740 1 --2- 172.21.15.2:0/3495062648 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x5565b5de1470 0x5565b5de0180 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:18.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.468+0000 7fb838b45740 1 --2- 172.21.15.2:0/3495062648 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5565b5d62bb0 0x5565b5d76330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:18.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.468+0000 7fb838b45740 1 --2- 172.21.15.2:0/3495062648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5565b5d582f0 0x5565b5d75df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:18.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.468+0000 7fb80f7fe640 0 client.14970 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:14:18.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.468+0000 7fb838b45740 1 --2- 172.21.15.2:0/3495062648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5565b5d579d0 0x5565b5d758b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:18.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.468+0000 7fb838b45740 1 -- 172.21.15.2:0/3495062648 >> 172.21.15.2:0/3495062648 conn(0x5565b5d53f60 msgr2=0x5565b5d5e890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:18.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.468+0000 7fb838b45740 1 -- 172.21.15.2:0/3495062648 shutdown_connections 2024-09-19T06:14:18.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.468+0000 7fb838b45740 1 -- 172.21.15.2:0/3495062648 wait complete. 2024-09-19T06:14:18.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.468+0000 7fb838b45740 20 client.14970 trim_cache size 0 max 16384 2024-09-19T06:14:18.477 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:14:18.477 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "078f6612-764d-11ef-bceb-c7b262605968", 2024-09-19T06:14:18.477 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 2, 2024-09-19T06:14:18.477 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24470, 2024-09-19T06:14:18.477 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-09-19T06:14:18.477 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-09-19T06:14:18.477 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-09-19T06:14:18.477 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 65.628691470000007, 2024-09-19T06:14:18.478 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 25, 2024-09-19T06:14:18.478 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 81, 2024-09-19T06:14:18.478 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 81, 2024-09-19T06:14:18.478 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 96.874695215000003 2024-09-19T06:14:18.478 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:14:18.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.468+0000 7fb83676c640 1 -- 172.21.15.2:0/3397928400 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fb8180a32d0 msgr2=0x7fb8180a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:18.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.468+0000 7fb83676c640 1 --2- 172.21.15.2:0/3397928400 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fb8180a32d0 0x7fb8180a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb82804d000 tx=0x7fb82804a000 comp rx=0 tx=0).stop 2024-09-19T06:14:18.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.469+0000 7fb83676c640 1 -- 172.21.15.2:0/3397928400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb830102e00 msgr2=0x7fb830198390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:18.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.469+0000 7fb83676c640 1 --2- 172.21.15.2:0/3397928400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb830102e00 0x7fb830198390 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb82000b4a0 tx=0x7fb82000b960 comp rx=0 tx=0).stop 2024-09-19T06:14:18.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.469+0000 7fb83676c640 1 -- 172.21.15.2:0/3397928400 shutdown_connections 2024-09-19T06:14:18.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.469+0000 7fb83676c640 1 --2- 172.21.15.2:0/3397928400 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fb8180a32d0 0x7fb8180a5790 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:18.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.469+0000 7fb83676c640 1 --2- 172.21.15.2:0/3397928400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb83010c1a0 0x7fb83019cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:18.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.469+0000 7fb83676c640 1 --2- 172.21.15.2:0/3397928400 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb830103720 0x7fb8301988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:18.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.469+0000 7fb83676c640 1 --2- 172.21.15.2:0/3397928400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb830102e00 0x7fb830198390 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:18.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.469+0000 7fb83676c640 1 -- 172.21.15.2:0/3397928400 >> 172.21.15.2:0/3397928400 conn(0x7fb8300fc7a0 msgr2=0x7fb8300fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:18.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.469+0000 7fb83676c640 1 -- 172.21.15.2:0/3397928400 shutdown_connections 2024-09-19T06:14:18.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:18.469+0000 7fb83676c640 1 -- 172.21.15.2:0/3397928400 wait complete. 2024-09-19T06:14:19.087 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T06:14:19.345 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:19.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.783+0000 7f2d6d362640 1 -- 172.21.15.2:0/1338022033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d68102ef0 msgr2=0x7f2d6810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:19.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.783+0000 7f2d6d362640 1 --2- 172.21.15.2:0/1338022033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d68102ef0 0x7f2d6810da40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2d58009ca0 tx=0x7f2d5802a950 comp rx=0 tx=0).stop 2024-09-19T06:14:19.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.784+0000 7f2d6d362640 1 -- 172.21.15.2:0/1338022033 shutdown_connections 2024-09-19T06:14:19.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.784+0000 7f2d6d362640 1 --2- 172.21.15.2:0/1338022033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d68102ef0 0x7f2d6810da40 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:19.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.784+0000 7f2d6d362640 1 --2- 172.21.15.2:0/1338022033 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d68102570 0x7f2d681029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:19.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.784+0000 7f2d6d362640 1 --2- 172.21.15.2:0/1338022033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d68100e20 0x7f2d68101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:19.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.784+0000 7f2d6d362640 1 -- 172.21.15.2:0/1338022033 >> 172.21.15.2:0/1338022033 conn(0x7f2d680fc7d0 msgr2=0x7f2d680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:19.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.784+0000 7f2d6d362640 1 -- 172.21.15.2:0/1338022033 shutdown_connections 2024-09-19T06:14:19.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.784+0000 7f2d6d362640 1 -- 172.21.15.2:0/1338022033 wait complete. 2024-09-19T06:14:19.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.784+0000 7f2d6d362640 1 Processor -- start 2024-09-19T06:14:19.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.784+0000 7f2d6d362640 1 -- start start 2024-09-19T06:14:19.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.785+0000 7f2d6d362640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d68100e20 0x7f2d681983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:19.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.785+0000 7f2d6d362640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d68102570 0x7f2d68198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:19.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.785+0000 7f2d6d362640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d68102ef0 0x7f2d6819ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:19.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.785+0000 7f2d6d362640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2d68111f50 con 0x7f2d68102ef0 2024-09-19T06:14:19.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.785+0000 7f2d6d362640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2d68111dd0 con 0x7f2d68102570 2024-09-19T06:14:19.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.785+0000 7f2d6d362640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2d681120d0 con 0x7f2d68100e20 2024-09-19T06:14:19.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.785+0000 7f2d677fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d68102ef0 0x7f2d6819ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:19.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.785+0000 7f2d677fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d68102ef0 0x7f2d6819ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36782/0 (socket says 172.21.15.2:36782) 2024-09-19T06:14:19.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.785+0000 7f2d677fe640 1 -- 172.21.15.2:0/1654730363 learned_addr learned my addr 172.21.15.2:0/1654730363 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:19.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.785+0000 7f2d667fc640 1 --2- 172.21.15.2:0/1654730363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d68102570 0x7f2d68198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:19.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.785+0000 7f2d66ffd640 1 --2- 172.21.15.2:0/1654730363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d68100e20 0x7f2d681983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:19.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.785+0000 7f2d677fe640 1 -- 172.21.15.2:0/1654730363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d68100e20 msgr2=0x7f2d681983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:19.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.785+0000 7f2d677fe640 1 --2- 172.21.15.2:0/1654730363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d68100e20 0x7f2d681983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:19.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.785+0000 7f2d677fe640 1 -- 172.21.15.2:0/1654730363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d68102570 msgr2=0x7f2d68198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:19.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.785+0000 7f2d677fe640 1 --2- 172.21.15.2:0/1654730363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d68102570 0x7f2d68198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:19.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.785+0000 7f2d677fe640 1 -- 172.21.15.2:0/1654730363 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d6819d3a0 con 0x7f2d68102ef0 2024-09-19T06:14:19.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.785+0000 7f2d677fe640 1 --2- 172.21.15.2:0/1654730363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d68102ef0 0x7f2d6819ccc0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2d5802ae70 tx=0x7f2d5802f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:19.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.785+0000 7f2d5ffff640 1 -- 172.21.15.2:0/1654730363 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d58034040 con 0x7f2d68102ef0 2024-09-19T06:14:19.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.785+0000 7f2d5ffff640 1 -- 172.21.15.2:0/1654730363 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2d580308f0 con 0x7f2d68102ef0 2024-09-19T06:14:19.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.785+0000 7f2d6d362640 1 -- 172.21.15.2:0/1654730363 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d6819d630 con 0x7f2d68102ef0 2024-09-19T06:14:19.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.785+0000 7f2d5ffff640 1 -- 172.21.15.2:0/1654730363 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d58004780 con 0x7f2d68102ef0 2024-09-19T06:14:19.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.785+0000 7f2d6d362640 1 -- 172.21.15.2:0/1654730363 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d681a4f70 con 0x7f2d68102ef0 2024-09-19T06:14:19.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.788+0000 7f2d5ffff640 1 -- 172.21.15.2:0/1654730363 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f2d58037020 con 0x7f2d68102ef0 2024-09-19T06:14:19.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.788+0000 7f2d6f73b740 1 Processor -- start 2024-09-19T06:14:19.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.788+0000 7f2d6f73b740 1 -- start start 2024-09-19T06:14:19.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.788+0000 7f2d6f73b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9a116890 0x556c9a116c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:19.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.788+0000 7f2d6f73b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556c9a1171b0 0x556c9a125a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:19.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.788+0000 7f2d6f73b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c9a125fc0 0x556c9a1283b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:19.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.789+0000 7f2d6f73b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556c9a07d090 con 0x556c9a116890 2024-09-19T06:14:19.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.789+0000 7f2d6f73b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x556c9a024a70 con 0x556c9a125fc0 2024-09-19T06:14:19.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.789+0000 7f2d6f73b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556c9a079050 con 0x556c9a1171b0 2024-09-19T06:14:19.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.789+0000 7f2d667fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9a116890 0x556c9a116c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:19.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.789+0000 7f2d667fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9a116890 0x556c9a116c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36794/0 (socket says 172.21.15.2:36794) 2024-09-19T06:14:19.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.789+0000 7f2d667fc640 1 -- 172.21.15.2:0/933971290 learned_addr learned my addr 172.21.15.2:0/933971290 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:19.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.789+0000 7f2d667fc640 1 --2- 172.21.15.2:0/933971290 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c9a125fc0 0x556c9a1283b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:19.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.789+0000 7f2d5ffff640 1 --2- 172.21.15.2:0/1654730363 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f2d540a3350 0x7f2d540a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:19.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.789+0000 7f2d667fc640 1 -- 172.21.15.2:0/933971290 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556c9a1171b0 msgr2=0x556c9a125a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:19.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.789+0000 7f2d66ffd640 1 --2- 172.21.15.2:0/933971290 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556c9a1171b0 0x556c9a125a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:19.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.789+0000 7f2d667fc640 1 --2- 172.21.15.2:0/933971290 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556c9a1171b0 0x556c9a125a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:19.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.789+0000 7f2d667fc640 1 -- 172.21.15.2:0/933971290 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c9a125fc0 msgr2=0x556c9a1283b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:19.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.789+0000 7f2d667fc640 1 --2- 172.21.15.2:0/933971290 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c9a125fc0 0x556c9a1283b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:19.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.789+0000 7f2d667fc640 1 -- 172.21.15.2:0/933971290 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c9a031130 con 0x556c9a116890 2024-09-19T06:14:19.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.789+0000 7f2d677fe640 1 --2- 172.21.15.2:0/1654730363 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f2d540a3350 0x7f2d540a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:19.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.789+0000 7f2d5ffff640 1 -- 172.21.15.2:0/1654730363 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f2d580f0990 con 0x7f2d68102ef0 2024-09-19T06:14:19.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.789+0000 7f2d667fc640 1 --2- 172.21.15.2:0/933971290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9a116890 0x556c9a116c70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2d5000bba0 tx=0x7f2d500041d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddc564129d481a77 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:19.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.789+0000 7f2d5d7fa640 1 -- 172.21.15.2:0/933971290 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d50005020 con 0x556c9a116890 2024-09-19T06:14:19.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.789+0000 7f2d5d7fa640 1 -- 172.21.15.2:0/933971290 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2d50005670 con 0x556c9a116890 2024-09-19T06:14:19.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.789+0000 7f2d5d7fa640 1 -- 172.21.15.2:0/933971290 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d50010460 con 0x556c9a116890 2024-09-19T06:14:19.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.790+0000 7f2d6f73b740 1 -- 172.21.15.2:0/933971290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9a116890 msgr2=0x556c9a116c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:19.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.790+0000 7f2d677fe640 1 --2- 172.21.15.2:0/1654730363 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f2d540a3350 0x7f2d540a5810 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2d580bcea0 tx=0x7f2d5803c040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:19.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.790+0000 7f2d6f73b740 1 --2- 172.21.15.2:0/933971290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9a116890 0x556c9a116c70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2d5000bba0 tx=0x7f2d500041d0 comp rx=0 tx=0).stop 2024-09-19T06:14:19.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.790+0000 7f2d6f73b740 1 -- 172.21.15.2:0/933971290 shutdown_connections 2024-09-19T06:14:19.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.790+0000 7f2d6f73b740 1 --2- 172.21.15.2:0/933971290 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c9a125fc0 0x556c9a1283b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:19.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.790+0000 7f2d6f73b740 1 --2- 172.21.15.2:0/933971290 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556c9a1171b0 0x556c9a125a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:19.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.790+0000 7f2d6f73b740 1 --2- 172.21.15.2:0/933971290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9a116890 0x556c9a116c70 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:19.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.790+0000 7f2d6f73b740 1 -- 172.21.15.2:0/933971290 >> 172.21.15.2:0/933971290 conn(0x556c9a112f60 msgr2=0x556c9a113340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:19.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.790+0000 7f2d6f73b740 1 -- 172.21.15.2:0/933971290 shutdown_connections 2024-09-19T06:14:19.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.790+0000 7f2d6f73b740 1 -- 172.21.15.2:0/933971290 wait complete. 2024-09-19T06:14:19.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.791+0000 7f2d6f73b740 1 -- start start 2024-09-19T06:14:19.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.791+0000 7f2d6f73b740 1 Processor -- start 2024-09-19T06:14:19.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.791+0000 7f2d6f73b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9a116890 0x556c9a1258e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:19.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.791+0000 7f2d6f73b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c9a1171b0 0x556c9a122c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:19.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.791+0000 7f2d6f73b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556c9a125fc0 0x556c9a123170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:19.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.791+0000 7f2d6f73b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556c9a128b30 con 0x556c9a116890 2024-09-19T06:14:19.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.791+0000 7f2d6f73b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x556c9a037f20 con 0x556c9a1171b0 2024-09-19T06:14:19.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.791+0000 7f2d6f73b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556c9a128cb0 con 0x556c9a125fc0 2024-09-19T06:14:19.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.791+0000 7f2d6f73b740 10 client.0 _ll_register_callbacks cb 0x556c9a001030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:19.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.791+0000 7f2d667fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9a116890 0x556c9a1258e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:19.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.791+0000 7f2d667fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9a116890 0x556c9a1258e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36798/0 (socket says 172.21.15.2:36798) 2024-09-19T06:14:19.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.791+0000 7f2d667fc640 1 -- 172.21.15.2:0/1601497740 learned_addr learned my addr 172.21.15.2:0/1601497740 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:19.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.791+0000 7f2d66ffd640 1 --2- 172.21.15.2:0/1601497740 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c9a1171b0 0x556c9a122c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:19.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.791+0000 7f2d667fc640 1 --2- 172.21.15.2:0/1601497740 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556c9a125fc0 0x556c9a123170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:19.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.791+0000 7f2d667fc640 1 -- 172.21.15.2:0/1601497740 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556c9a125fc0 msgr2=0x556c9a123170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:19.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.791+0000 7f2d667fc640 1 --2- 172.21.15.2:0/1601497740 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556c9a125fc0 0x556c9a123170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:19.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.791+0000 7f2d667fc640 1 -- 172.21.15.2:0/1601497740 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c9a1171b0 msgr2=0x556c9a122c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:19.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.791+0000 7f2d667fc640 1 --2- 172.21.15.2:0/1601497740 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c9a1171b0 0x556c9a122c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:19.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.791+0000 7f2d667fc640 1 -- 172.21.15.2:0/1601497740 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c99dee2b0 con 0x556c9a116890 2024-09-19T06:14:19.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.792+0000 7f2d667fc640 1 --2- 172.21.15.2:0/1601497740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9a116890 0x556c9a1258e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2d500040b0 tx=0x7f2d50005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea639b7f3960b245 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:19.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.792+0000 7f2d4e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:14:19.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.792+0000 7f2d4e7fc640 1 -- 172.21.15.2:0/1601497740 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d500048c0 con 0x556c9a116890 2024-09-19T06:14:19.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.792+0000 7f2d6f73b740 1 -- 172.21.15.2:0/1601497740 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d50005670 con 0x556c9a116890 2024-09-19T06:14:19.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.792+0000 7f2d4e7fc640 1 -- 172.21.15.2:0/1601497740 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f2d50004a60 con 0x556c9a116890 2024-09-19T06:14:19.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.792+0000 7f2d4e7fc640 1 -- 172.21.15.2:0/1601497740 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2d50020480 con 0x556c9a116890 2024-09-19T06:14:19.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.792+0000 7f2d6f73b740 10 client.14982 fetch_fsmap learned FSMap version 25 2024-09-19T06:14:19.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.792+0000 7f2d6f73b740 1 -- 172.21.15.2:0/1601497740 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556c9a1344f0 con 0x556c9a116890 2024-09-19T06:14:19.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.792+0000 7f2d4e7fc640 1 -- 172.21.15.2:0/1601497740 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2d50005670 con 0x556c9a116890 2024-09-19T06:14:19.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.792+0000 7f2d4e7fc640 1 -- 172.21.15.2:0/1601497740 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2d5001f3e0 con 0x556c9a116890 2024-09-19T06:14:19.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.792+0000 7f2d6f73b740 10 client.14982 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T06:14:19.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.792+0000 7f2d6f73b740 10 client.14982 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T06:14:19.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.792+0000 7f2d6f73b740 20 client.14982 populate_metadata read hostname 'smithi002' 2024-09-19T06:14:19.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.792+0000 7f2d6f73b740 1 --2- 172.21.15.2:0/1601497740 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x556c9a136860 0x556c9a137cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:19.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.792+0000 7f2d6f73b740 4 client.14982 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:14:19.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.792+0000 7f2d6f73b740 1 -- 172.21.15.2:0/1601497740 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c9a08a600 con 0x556c9a136860 2024-09-19T06:14:19.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.793+0000 7f2d66ffd640 1 --2- 172.21.15.2:0/1601497740 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x556c9a136860 0x556c9a137cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:19.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.793+0000 7f2d66ffd640 1 --2- 172.21.15.2:0/1601497740 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x556c9a136860 0x556c9a137cd0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c7358b1ffbaef414 server_cookie=f152f1f2b3ccd145 in_seq=0 out_seq=0 2024-09-19T06:14:19.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.793+0000 7f2d4e7fc640 10 client.14982 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:14:19.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.794+0000 7f2d4e7fc640 1 -- 172.21.15.2:0/1601497740 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556c9a08a600 con 0x556c9a136860 2024-09-19T06:14:19.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.794+0000 7f2d4e7fc640 10 client.14982 handle_command_reply: tid=0 2024-09-19T06:14:19.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.794+0000 7f2d6f73b740 1 client.14982 shutdown 2024-09-19T06:14:19.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.794+0000 7f2d6f73b740 1 -- 172.21.15.2:0/1601497740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9a116890 msgr2=0x556c9a1258e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:19.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.794+0000 7f2d6f73b740 1 --2- 172.21.15.2:0/1601497740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9a116890 0x556c9a1258e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2d500040b0 tx=0x7f2d50005f90 comp rx=0 tx=0).stop 2024-09-19T06:14:19.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.794+0000 7f2d6f73b740 1 -- 172.21.15.2:0/1601497740 shutdown_connections 2024-09-19T06:14:19.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.794+0000 7f2d6f73b740 1 --2- 172.21.15.2:0/1601497740 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x556c9a136860 0x556c9a137cd0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:19.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.794+0000 7f2d6f73b740 1 --2- 172.21.15.2:0/1601497740 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556c9a125fc0 0x556c9a123170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:19.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.794+0000 7f2d6f73b740 1 --2- 172.21.15.2:0/1601497740 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c9a1171b0 0x556c9a122c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:19.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.794+0000 7f2d4e7fc640 0 client.14982 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:14:19.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.794+0000 7f2d6f73b740 1 --2- 172.21.15.2:0/1601497740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9a116890 0x556c9a1258e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:19.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.794+0000 7f2d6f73b740 1 -- 172.21.15.2:0/1601497740 >> 172.21.15.2:0/1601497740 conn(0x556c9a112f60 msgr2=0x556c9a118cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:19.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.794+0000 7f2d6f73b740 1 -- 172.21.15.2:0/1601497740 shutdown_connections 2024-09-19T06:14:19.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.795+0000 7f2d6f73b740 1 -- 172.21.15.2:0/1601497740 wait complete. 2024-09-19T06:14:19.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.795+0000 7f2d6f73b740 20 client.14982 trim_cache size 0 max 16384 2024-09-19T06:14:19.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.812+0000 7f2d6f73b740 1 Processor -- start 2024-09-19T06:14:19.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.812+0000 7f2d6f73b740 1 -- start start 2024-09-19T06:14:19.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.813+0000 7f2d6f73b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9a116890 0x556c9a136190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:19.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.813+0000 7f2d6f73b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556c9a1171b0 0x556c9a136f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:19.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.813+0000 7f2d6f73b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c9a125fc0 0x556c9a135900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:19.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.813+0000 7f2d6f73b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556c9a136010 con 0x556c9a116890 2024-09-19T06:14:19.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.813+0000 7f2d6f73b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x556c9a1366e0 con 0x556c9a125fc0 2024-09-19T06:14:19.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.813+0000 7f2d6f73b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556c9a136db0 con 0x556c9a1171b0 2024-09-19T06:14:19.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.813+0000 7f2d667fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9a116890 0x556c9a136190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:19.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.813+0000 7f2d667fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9a116890 0x556c9a136190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36810/0 (socket says 172.21.15.2:36810) 2024-09-19T06:14:19.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.813+0000 7f2d667fc640 1 -- 172.21.15.2:0/3206703587 learned_addr learned my addr 172.21.15.2:0/3206703587 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:19.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.813+0000 7f2d667fc640 1 -- 172.21.15.2:0/3206703587 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556c9a1171b0 msgr2=0x556c9a136f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:19.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.813+0000 7f2d667fc640 1 --2- 172.21.15.2:0/3206703587 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556c9a1171b0 0x556c9a136f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:19.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.813+0000 7f2d667fc640 1 -- 172.21.15.2:0/3206703587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c9a125fc0 msgr2=0x556c9a135900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:19.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.813+0000 7f2d667fc640 1 --2- 172.21.15.2:0/3206703587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c9a125fc0 0x556c9a135900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:19.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.813+0000 7f2d667fc640 1 -- 172.21.15.2:0/3206703587 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c9a135e40 con 0x556c9a116890 2024-09-19T06:14:19.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.813+0000 7f2d667fc640 1 --2- 172.21.15.2:0/3206703587 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9a116890 0x556c9a136190 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2d50004080 tx=0x7f2d500058f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6adabce4d216fd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:19.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.813+0000 7f2d5cff9640 1 -- 172.21.15.2:0/3206703587 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d50004e80 con 0x556c9a116890 2024-09-19T06:14:19.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.813+0000 7f2d5cff9640 1 -- 172.21.15.2:0/3206703587 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2d5001f5c0 con 0x556c9a116890 2024-09-19T06:14:19.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.813+0000 7f2d5cff9640 1 -- 172.21.15.2:0/3206703587 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d50004630 con 0x556c9a116890 2024-09-19T06:14:19.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.814+0000 7f2d6f73b740 1 -- 172.21.15.2:0/3206703587 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9a116890 msgr2=0x556c9a136190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:19.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.814+0000 7f2d6f73b740 1 --2- 172.21.15.2:0/3206703587 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9a116890 0x556c9a136190 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2d50004080 tx=0x7f2d500058f0 comp rx=0 tx=0).stop 2024-09-19T06:14:19.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.814+0000 7f2d6f73b740 1 -- 172.21.15.2:0/3206703587 shutdown_connections 2024-09-19T06:14:19.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.814+0000 7f2d6f73b740 1 --2- 172.21.15.2:0/3206703587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c9a125fc0 0x556c9a135900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:19.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.814+0000 7f2d6f73b740 1 --2- 172.21.15.2:0/3206703587 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556c9a1171b0 0x556c9a136f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:19.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.814+0000 7f2d6f73b740 1 --2- 172.21.15.2:0/3206703587 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9a116890 0x556c9a136190 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:19.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.814+0000 7f2d6f73b740 1 -- 172.21.15.2:0/3206703587 >> 172.21.15.2:0/3206703587 conn(0x556c9a112f60 msgr2=0x556c9a113340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:19.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.814+0000 7f2d6f73b740 1 -- 172.21.15.2:0/3206703587 shutdown_connections 2024-09-19T06:14:19.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.814+0000 7f2d6f73b740 1 -- 172.21.15.2:0/3206703587 wait complete. 2024-09-19T06:14:19.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.814+0000 7f2d6f73b740 1 -- start start 2024-09-19T06:14:19.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.815+0000 7f2d6f73b740 1 Processor -- start 2024-09-19T06:14:19.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.815+0000 7f2d6f73b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556c9a116890 0x556c9a140890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:19.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.815+0000 7f2d6f73b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9a1171b0 0x556c9a13e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:19.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.815+0000 7f2d6f73b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c9a125fc0 0x556c9a13ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:19.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.815+0000 7f2d6f73b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556c9a137b50 con 0x556c9a1171b0 2024-09-19T06:14:19.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.815+0000 7f2d6f73b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x556c9a137480 con 0x556c9a125fc0 2024-09-19T06:14:19.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.815+0000 7f2d6f73b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556c9a138220 con 0x556c9a116890 2024-09-19T06:14:19.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.815+0000 7f2d6f73b740 10 client.0 _ll_register_callbacks cb 0x7f2d5000ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:19.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.815+0000 7f2d66ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9a1171b0 0x556c9a13e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:19.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.815+0000 7f2d66ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9a1171b0 0x556c9a13e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36822/0 (socket says 172.21.15.2:36822) 2024-09-19T06:14:19.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.815+0000 7f2d66ffd640 1 -- 172.21.15.2:0/1658475428 learned_addr learned my addr 172.21.15.2:0/1658475428 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:19.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.815+0000 7f2d667fc640 1 --2- 172.21.15.2:0/1658475428 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556c9a116890 0x556c9a140890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:19.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.815+0000 7f2d667fc640 1 --2- 172.21.15.2:0/1658475428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c9a125fc0 0x556c9a13ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:19.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.815+0000 7f2d66ffd640 1 -- 172.21.15.2:0/1658475428 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556c9a116890 msgr2=0x556c9a140890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:19.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.815+0000 7f2d66ffd640 1 --2- 172.21.15.2:0/1658475428 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556c9a116890 0x556c9a140890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:19.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.815+0000 7f2d66ffd640 1 -- 172.21.15.2:0/1658475428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c9a125fc0 msgr2=0x556c9a13ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:19.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.815+0000 7f2d66ffd640 1 --2- 172.21.15.2:0/1658475428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c9a125fc0 0x556c9a13ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:19.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.815+0000 7f2d66ffd640 1 -- 172.21.15.2:0/1658475428 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c9a138d90 con 0x556c9a1171b0 2024-09-19T06:14:19.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.815+0000 7f2d667fc640 1 --2- 172.21.15.2:0/1658475428 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556c9a116890 0x556c9a140890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:14:19.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.815+0000 7f2d66ffd640 1 --2- 172.21.15.2:0/1658475428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9a1171b0 0x556c9a13e700 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2d60005d00 tx=0x7f2d6000b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74ce9855fbadcaeb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:19.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.815+0000 7f2d4e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:14:19.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.816+0000 7f2d4e7fc640 1 -- 172.21.15.2:0/1658475428 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d60004020 con 0x556c9a1171b0 2024-09-19T06:14:19.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.816+0000 7f2d4e7fc640 1 -- 172.21.15.2:0/1658475428 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f2d600041c0 con 0x556c9a1171b0 2024-09-19T06:14:19.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.816+0000 7f2d6f73b740 1 -- 172.21.15.2:0/1658475428 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d5001f5c0 con 0x556c9a1171b0 2024-09-19T06:14:19.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.816+0000 7f2d4e7fc640 1 -- 172.21.15.2:0/1658475428 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2d600043c0 con 0x556c9a1171b0 2024-09-19T06:14:19.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.816+0000 7f2d6f73b740 10 client.14988 fetch_fsmap learned FSMap version 25 2024-09-19T06:14:19.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.816+0000 7f2d6f73b740 1 -- 172.21.15.2:0/1658475428 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556c9a13d6b0 con 0x556c9a1171b0 2024-09-19T06:14:19.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.816+0000 7f2d4e7fc640 1 -- 172.21.15.2:0/1658475428 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2d5001f5c0 con 0x556c9a1171b0 2024-09-19T06:14:19.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.816+0000 7f2d4e7fc640 1 -- 172.21.15.2:0/1658475428 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2d60012610 con 0x556c9a1171b0 2024-09-19T06:14:19.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.816+0000 7f2d6f73b740 10 client.14988 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T06:14:19.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.816+0000 7f2d6f73b740 10 client.14988 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T06:14:19.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.816+0000 7f2d6f73b740 20 client.14988 populate_metadata read hostname 'smithi002' 2024-09-19T06:14:19.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.816+0000 7f2d6f73b740 1 --2- 172.21.15.2:0/1658475428 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x556c9a136860 0x556c9a1a3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:19.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.816+0000 7f2d6f73b740 4 client.14988 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:14:19.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.816+0000 7f2d6f73b740 1 -- 172.21.15.2:0/1658475428 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "status"}) -- 0x556c9a084b10 con 0x556c9a136860 2024-09-19T06:14:19.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.817+0000 7f2d667fc640 1 --2- 172.21.15.2:0/1658475428 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x556c9a136860 0x556c9a1a3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:19.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.817+0000 7f2d667fc640 1 --2- 172.21.15.2:0/1658475428 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x556c9a136860 0x556c9a1a3b60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=629cc34d394288a7 server_cookie=b8823b2479eb9080 in_seq=0 out_seq=0 2024-09-19T06:14:19.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.817+0000 7f2d4e7fc640 10 client.14988 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:14:19.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.817+0000 7f2d4e7fc640 1 -- 172.21.15.2:0/1658475428 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x556c9a084b10 con 0x556c9a136860 2024-09-19T06:14:19.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.817+0000 7f2d4e7fc640 10 client.14988 handle_command_reply: tid=0 2024-09-19T06:14:19.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.817+0000 7f2d6f73b740 1 client.14988 shutdown 2024-09-19T06:14:19.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.817+0000 7f2d6f73b740 1 -- 172.21.15.2:0/1658475428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9a1171b0 msgr2=0x556c9a13e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:19.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.817+0000 7f2d6f73b740 1 --2- 172.21.15.2:0/1658475428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9a1171b0 0x556c9a13e700 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2d60005d00 tx=0x7f2d6000b920 comp rx=0 tx=0).stop 2024-09-19T06:14:19.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.817+0000 7f2d6f73b740 1 -- 172.21.15.2:0/1658475428 shutdown_connections 2024-09-19T06:14:19.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.817+0000 7f2d6f73b740 1 --2- 172.21.15.2:0/1658475428 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x556c9a136860 0x556c9a1a3b60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:19.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.817+0000 7f2d4e7fc640 0 client.14988 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:14:19.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.817+0000 7f2d6f73b740 1 --2- 172.21.15.2:0/1658475428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556c9a125fc0 0x556c9a13ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:19.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.817+0000 7f2d6f73b740 1 --2- 172.21.15.2:0/1658475428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556c9a1171b0 0x556c9a13e700 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:19.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.817+0000 7f2d6f73b740 1 --2- 172.21.15.2:0/1658475428 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556c9a116890 0x556c9a140890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:19.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.817+0000 7f2d6f73b740 1 -- 172.21.15.2:0/1658475428 >> 172.21.15.2:0/1658475428 conn(0x556c9a112f60 msgr2=0x556c9a10dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:19.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.818+0000 7f2d6f73b740 1 -- 172.21.15.2:0/1658475428 shutdown_connections 2024-09-19T06:14:19.847 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:14:19.847 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "078f6612-764d-11ef-bceb-c7b262605968", 2024-09-19T06:14:19.847 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 1, 2024-09-19T06:14:19.847 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24472, 2024-09-19T06:14:19.847 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-09-19T06:14:19.847 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-09-19T06:14:19.847 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-09-19T06:14:19.847 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 67.994440232000002, 2024-09-19T06:14:19.847 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 25, 2024-09-19T06:14:19.847 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 81, 2024-09-19T06:14:19.847 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 81, 2024-09-19T06:14:19.847 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 95.730256252000004 2024-09-19T06:14:19.848 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:14:19.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.818+0000 7f2d6f73b740 1 -- 172.21.15.2:0/1658475428 wait complete. 2024-09-19T06:14:19.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.818+0000 7f2d6f73b740 20 client.14988 trim_cache size 0 max 16384 2024-09-19T06:14:19.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.818+0000 7f2d6d362640 1 -- 172.21.15.2:0/1654730363 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f2d540a3350 msgr2=0x7f2d540a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:19.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.818+0000 7f2d6d362640 1 --2- 172.21.15.2:0/1654730363 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f2d540a3350 0x7f2d540a5810 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2d580bcea0 tx=0x7f2d5803c040 comp rx=0 tx=0).stop 2024-09-19T06:14:19.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.818+0000 7f2d6d362640 1 -- 172.21.15.2:0/1654730363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d68102ef0 msgr2=0x7f2d6819ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:19.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.818+0000 7f2d6d362640 1 --2- 172.21.15.2:0/1654730363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d68102ef0 0x7f2d6819ccc0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2d5802ae70 tx=0x7f2d5802f5d0 comp rx=0 tx=0).stop 2024-09-19T06:14:19.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.818+0000 7f2d6d362640 1 -- 172.21.15.2:0/1654730363 shutdown_connections 2024-09-19T06:14:19.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.818+0000 7f2d6d362640 1 --2- 172.21.15.2:0/1654730363 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f2d540a3350 0x7f2d540a5810 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:19.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.818+0000 7f2d6d362640 1 --2- 172.21.15.2:0/1654730363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d68102ef0 0x7f2d6819ccc0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:19.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.818+0000 7f2d6d362640 1 --2- 172.21.15.2:0/1654730363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d68102570 0x7f2d68198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:19.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.818+0000 7f2d6d362640 1 --2- 172.21.15.2:0/1654730363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d68100e20 0x7f2d681983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:19.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.818+0000 7f2d6d362640 1 -- 172.21.15.2:0/1654730363 >> 172.21.15.2:0/1654730363 conn(0x7f2d680fc7d0 msgr2=0x7f2d680febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:19.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.819+0000 7f2d6d362640 1 -- 172.21.15.2:0/1654730363 shutdown_connections 2024-09-19T06:14:19.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:19.819+0000 7f2d6d362640 1 -- 172.21.15.2:0/1654730363 wait complete. 2024-09-19T06:14:19.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:19 smithi002 ceph-mon[30982]: pgmap v314: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:20.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:19 smithi090 ceph-mon[34497]: pgmap v314: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:20.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:19 smithi089 ceph-mon[34160]: pgmap v314: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:20.475 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T06:14:20.731 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:21.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.139+0000 7fb35bc07640 1 -- 172.21.15.2:0/1908463759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb354106a80 msgr2=0x7fb354106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:21.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.139+0000 7fb35bc07640 1 --2- 172.21.15.2:0/1908463759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb354106a80 0x7fb354106e60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb350009930 tx=0x7fb35002a420 comp rx=0 tx=0).stop 2024-09-19T06:14:21.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.139+0000 7fb35bc07640 1 -- 172.21.15.2:0/1908463759 shutdown_connections 2024-09-19T06:14:21.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.139+0000 7fb35bc07640 1 --2- 172.21.15.2:0/1908463759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb354101420 0x7fb35410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:21.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.139+0000 7fb35bc07640 1 --2- 172.21.15.2:0/1908463759 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb354100a80 0x7fb354100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:21.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.139+0000 7fb35bc07640 1 --2- 172.21.15.2:0/1908463759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb354106a80 0x7fb354106e60 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:21.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.139+0000 7fb35bc07640 1 -- 172.21.15.2:0/1908463759 >> 172.21.15.2:0/1908463759 conn(0x7fb3540fc7a0 msgr2=0x7fb3540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:21.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.139+0000 7fb35bc07640 1 -- 172.21.15.2:0/1908463759 shutdown_connections 2024-09-19T06:14:21.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.139+0000 7fb35bc07640 1 -- 172.21.15.2:0/1908463759 wait complete. 2024-09-19T06:14:21.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.140+0000 7fb35bc07640 1 Processor -- start 2024-09-19T06:14:21.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.140+0000 7fb35bc07640 1 -- start start 2024-09-19T06:14:21.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.140+0000 7fb35bc07640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb354100a80 0x7fb3540fced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:21.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.140+0000 7fb35bc07640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb354101420 0x7fb3540fd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.140+0000 7fb35bc07640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb354106a80 0x7fb3540fd950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.140+0000 7fb35bc07640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb354110d50 con 0x7fb354101420 2024-09-19T06:14:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.140+0000 7fb35bc07640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb354110bd0 con 0x7fb354106a80 2024-09-19T06:14:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.140+0000 7fb35bc07640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb354110ed0 con 0x7fb354100a80 2024-09-19T06:14:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.140+0000 7fb3591a2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb354101420 0x7fb3540fd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.140+0000 7fb3591a2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb354101420 0x7fb3540fd410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36838/0 (socket says 172.21.15.2:36838) 2024-09-19T06:14:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.140+0000 7fb3591a2640 1 -- 172.21.15.2:0/2587891111 learned_addr learned my addr 172.21.15.2:0/2587891111 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.140+0000 7fb35a1a4640 1 --2- 172.21.15.2:0/2587891111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb354106a80 0x7fb3540fd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.140+0000 7fb3599a3640 1 --2- 172.21.15.2:0/2587891111 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb354100a80 0x7fb3540fced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.141+0000 7fb3591a2640 1 -- 172.21.15.2:0/2587891111 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb354100a80 msgr2=0x7fb3540fced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.141+0000 7fb3591a2640 1 --2- 172.21.15.2:0/2587891111 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb354100a80 0x7fb3540fced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.141+0000 7fb3591a2640 1 -- 172.21.15.2:0/2587891111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb354106a80 msgr2=0x7fb3540fd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.141+0000 7fb3591a2640 1 --2- 172.21.15.2:0/2587891111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb354106a80 0x7fb3540fd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:21.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.141+0000 7fb3591a2640 1 -- 172.21.15.2:0/2587891111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3541a68e0 con 0x7fb354101420 2024-09-19T06:14:21.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.141+0000 7fb3591a2640 1 --2- 172.21.15.2:0/2587891111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb354101420 0x7fb3540fd410 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb34400b4a0 tx=0x7fb34400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:21.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.141+0000 7fb34affd640 1 -- 172.21.15.2:0/2587891111 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb344014070 con 0x7fb354101420 2024-09-19T06:14:21.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.141+0000 7fb34affd640 1 -- 172.21.15.2:0/2587891111 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb344010ac0 con 0x7fb354101420 2024-09-19T06:14:21.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.141+0000 7fb34affd640 1 -- 172.21.15.2:0/2587891111 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb344017c30 con 0x7fb354101420 2024-09-19T06:14:21.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.141+0000 7fb35bc07640 1 -- 172.21.15.2:0/2587891111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3541a6bd0 con 0x7fb354101420 2024-09-19T06:14:21.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.141+0000 7fb35bc07640 1 -- 172.21.15.2:0/2587891111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3541a7160 con 0x7fb354101420 2024-09-19T06:14:21.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.143+0000 7fb34affd640 1 -- 172.21.15.2:0/2587891111 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fb344017070 con 0x7fb354101420 2024-09-19T06:14:21.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.144+0000 7fb35dfe0740 1 Processor -- start 2024-09-19T06:14:21.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.144+0000 7fb35dfe0740 1 -- start start 2024-09-19T06:14:21.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.144+0000 7fb35dfe0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625125bc9d0 0x5625125bcdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:21.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.144+0000 7fb35dfe0740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625125bd2f0 0x5625125c7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:21.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.144+0000 7fb35dfe0740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5625125c7bb0 0x5625125c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:21.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.144+0000 7fb35dfe0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562512523090 con 0x5625125bc9d0 2024-09-19T06:14:21.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.144+0000 7fb35dfe0740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5625124caa70 con 0x5625125c7bb0 2024-09-19T06:14:21.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.144+0000 7fb35dfe0740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56251251f050 con 0x5625125bd2f0 2024-09-19T06:14:21.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.144+0000 7fb35a1a4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625125bc9d0 0x5625125bcdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:21.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.144+0000 7fb34affd640 1 --2- 172.21.15.2:0/2587891111 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fb3400a3350 0x7fb3400a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:21.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.144+0000 7fb35a1a4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625125bc9d0 0x5625125bcdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36840/0 (socket says 172.21.15.2:36840) 2024-09-19T06:14:21.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.144+0000 7fb35a1a4640 1 -- 172.21.15.2:0/303174747 learned_addr learned my addr 172.21.15.2:0/303174747 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:21.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.144+0000 7fb3591a2640 1 --2- 172.21.15.2:0/303174747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5625125c7bb0 0x5625125c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:21.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.144+0000 7fb3599a3640 1 --2- 172.21.15.2:0/303174747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625125bd2f0 0x5625125c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:21.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.145+0000 7fb35a1a4640 1 --2- 172.21.15.2:0/2587891111 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fb3400a3350 0x7fb3400a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:21.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.145+0000 7fb35a1a4640 1 -- 172.21.15.2:0/303174747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625125bd2f0 msgr2=0x5625125c7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:21.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.145+0000 7fb35a1a4640 1 --2- 172.21.15.2:0/303174747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625125bd2f0 0x5625125c7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:21.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.145+0000 7fb34affd640 1 -- 172.21.15.2:0/2587891111 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7fb3440cef60 con 0x7fb354101420 2024-09-19T06:14:21.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.145+0000 7fb35a1a4640 1 -- 172.21.15.2:0/303174747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5625125c7bb0 msgr2=0x5625125c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:21.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.145+0000 7fb35a1a4640 1 --2- 172.21.15.2:0/303174747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5625125c7bb0 0x5625125c9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:21.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.145+0000 7fb35a1a4640 1 -- 172.21.15.2:0/303174747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625124d7130 con 0x5625125bc9d0 2024-09-19T06:14:21.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.145+0000 7fb3591a2640 1 --2- 172.21.15.2:0/303174747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5625125c7bb0 0x5625125c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:21.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.145+0000 7fb35a1a4640 1 --2- 172.21.15.2:0/303174747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625125bc9d0 0x5625125bcdb0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb34c005f40 tx=0x7fb34c014f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57f9ed7c52c6bc54 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:21.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.145+0000 7fb33ffff640 1 -- 172.21.15.2:0/303174747 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb34c012d90 con 0x5625125bc9d0 2024-09-19T06:14:21.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.145+0000 7fb33ffff640 1 -- 172.21.15.2:0/303174747 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb34c023070 con 0x5625125bc9d0 2024-09-19T06:14:21.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.145+0000 7fb33ffff640 1 -- 172.21.15.2:0/303174747 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb34c01ddc0 con 0x5625125bc9d0 2024-09-19T06:14:21.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.145+0000 7fb35a1a4640 1 --2- 172.21.15.2:0/2587891111 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fb3400a3350 0x7fb3400a5810 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb34c022000 tx=0x7fb34c020000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.146+0000 7fb35dfe0740 1 -- 172.21.15.2:0/303174747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625125bc9d0 msgr2=0x5625125bcdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.146+0000 7fb35dfe0740 1 --2- 172.21.15.2:0/303174747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625125bc9d0 0x5625125bcdb0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb34c005f40 tx=0x7fb34c014f70 comp rx=0 tx=0).stop 2024-09-19T06:14:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.146+0000 7fb35dfe0740 1 -- 172.21.15.2:0/303174747 shutdown_connections 2024-09-19T06:14:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.146+0000 7fb35dfe0740 1 --2- 172.21.15.2:0/303174747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5625125c7bb0 0x5625125c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.146+0000 7fb35dfe0740 1 --2- 172.21.15.2:0/303174747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625125bd2f0 0x5625125c7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.146+0000 7fb35dfe0740 1 --2- 172.21.15.2:0/303174747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625125bc9d0 0x5625125bcdb0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.146+0000 7fb35dfe0740 1 -- 172.21.15.2:0/303174747 >> 172.21.15.2:0/303174747 conn(0x5625125b8f60 msgr2=0x5625125b9340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.146+0000 7fb35dfe0740 1 -- 172.21.15.2:0/303174747 shutdown_connections 2024-09-19T06:14:21.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.146+0000 7fb35dfe0740 1 -- 172.21.15.2:0/303174747 wait complete. 2024-09-19T06:14:21.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.146+0000 7fb35dfe0740 1 -- start start 2024-09-19T06:14:21.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.146+0000 7fb35dfe0740 1 Processor -- start 2024-09-19T06:14:21.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.147+0000 7fb35dfe0740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5625125bc9d0 0x5625125c7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:21.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.147+0000 7fb35dfe0740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625125bd2f0 0x5625125c4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:21.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.147+0000 7fb35dfe0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625125c7bb0 0x5625125c4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:21.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.147+0000 7fb35dfe0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5625125ca780 con 0x5625125c7bb0 2024-09-19T06:14:21.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.147+0000 7fb35dfe0740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5625124ddf20 con 0x5625125bc9d0 2024-09-19T06:14:21.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.147+0000 7fb35dfe0740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5625125ca900 con 0x5625125bd2f0 2024-09-19T06:14:21.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.147+0000 7fb35dfe0740 10 client.0 _ll_register_callbacks cb 0x5625124a7030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:21.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.147+0000 7fb3591a2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625125bd2f0 0x5625125c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:21.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.147+0000 7fb35a1a4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625125c7bb0 0x5625125c4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:21.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.147+0000 7fb3591a2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625125bd2f0 0x5625125c4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:50264/0 (socket says 172.21.15.2:50264) 2024-09-19T06:14:21.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.147+0000 7fb3591a2640 1 -- 172.21.15.2:0/3361807267 learned_addr learned my addr 172.21.15.2:0/3361807267 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:21.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.147+0000 7fb3599a3640 1 --2- 172.21.15.2:0/3361807267 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5625125bc9d0 0x5625125c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:21.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.147+0000 7fb35a1a4640 1 -- 172.21.15.2:0/3361807267 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625125bd2f0 msgr2=0x5625125c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:21.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.147+0000 7fb35a1a4640 1 --2- 172.21.15.2:0/3361807267 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625125bd2f0 0x5625125c4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:21.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.147+0000 7fb35a1a4640 1 -- 172.21.15.2:0/3361807267 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5625125bc9d0 msgr2=0x5625125c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:21.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.147+0000 7fb35a1a4640 1 --2- 172.21.15.2:0/3361807267 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5625125bc9d0 0x5625125c7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:21.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.147+0000 7fb35a1a4640 1 -- 172.21.15.2:0/3361807267 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625122942b0 con 0x5625125c7bb0 2024-09-19T06:14:21.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.147+0000 7fb3591a2640 1 --2- 172.21.15.2:0/3361807267 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625125bd2f0 0x5625125c4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:21.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.148+0000 7fb35a1a4640 1 --2- 172.21.15.2:0/3361807267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625125c7bb0 0x5625125c4cc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb34c00a010 tx=0x7fb34c009c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49b9a5dbcf8a962b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:21.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.148+0000 7fb33d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:14:21.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.148+0000 7fb33d7fa640 1 -- 172.21.15.2:0/3361807267 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb34c01ec50 con 0x5625125c7bb0 2024-09-19T06:14:21.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.148+0000 7fb33d7fa640 1 -- 172.21.15.2:0/3361807267 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7fb34c012d90 con 0x5625125c7bb0 2024-09-19T06:14:21.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.148+0000 7fb35dfe0740 1 -- 172.21.15.2:0/3361807267 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb34c023070 con 0x5625125c7bb0 2024-09-19T06:14:21.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.148+0000 7fb33d7fa640 1 -- 172.21.15.2:0/3361807267 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb34c01db40 con 0x5625125c7bb0 2024-09-19T06:14:21.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.148+0000 7fb35dfe0740 10 client.15000 fetch_fsmap learned FSMap version 25 2024-09-19T06:14:21.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.148+0000 7fb35dfe0740 1 -- 172.21.15.2:0/3361807267 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5625125d6090 con 0x5625125c7bb0 2024-09-19T06:14:21.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.148+0000 7fb33d7fa640 1 -- 172.21.15.2:0/3361807267 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb34c023070 con 0x5625125c7bb0 2024-09-19T06:14:21.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.148+0000 7fb33d7fa640 1 -- 172.21.15.2:0/3361807267 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb34c00f040 con 0x5625125c7bb0 2024-09-19T06:14:21.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.148+0000 7fb35dfe0740 10 client.15000 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T06:14:21.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.149+0000 7fb35dfe0740 10 client.15000 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T06:14:21.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.149+0000 7fb35dfe0740 20 client.15000 populate_metadata read hostname 'smithi002' 2024-09-19T06:14:21.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.149+0000 7fb35dfe0740 1 --2- 172.21.15.2:0/3361807267 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5625125d84a0 0x5625125d9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:21.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.149+0000 7fb35dfe0740 4 client.15000 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:14:21.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.149+0000 7fb35dfe0740 1 -- 172.21.15.2:0/3361807267 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562512530600 con 0x5625125d84a0 2024-09-19T06:14:21.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.149+0000 7fb3599a3640 1 --2- 172.21.15.2:0/3361807267 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5625125d84a0 0x5625125d9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:21.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.149+0000 7fb3599a3640 1 --2- 172.21.15.2:0/3361807267 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5625125d84a0 0x5625125d9910 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f46c65651f3bcb0c server_cookie=b5bc778ff9ac073b in_seq=0 out_seq=0 2024-09-19T06:14:21.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.149+0000 7fb33d7fa640 10 client.15000 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:14:21.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.150+0000 7fb33d7fa640 1 -- 172.21.15.2:0/3361807267 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562512530600 con 0x5625125d84a0 2024-09-19T06:14:21.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.150+0000 7fb33d7fa640 10 client.15000 handle_command_reply: tid=0 2024-09-19T06:14:21.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.150+0000 7fb35dfe0740 1 client.15000 shutdown 2024-09-19T06:14:21.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.150+0000 7fb35dfe0740 1 -- 172.21.15.2:0/3361807267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625125c7bb0 msgr2=0x5625125c4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:21.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.150+0000 7fb35dfe0740 1 --2- 172.21.15.2:0/3361807267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625125c7bb0 0x5625125c4cc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb34c00a010 tx=0x7fb34c009c90 comp rx=0 tx=0).stop 2024-09-19T06:14:21.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.150+0000 7fb35dfe0740 1 -- 172.21.15.2:0/3361807267 shutdown_connections 2024-09-19T06:14:21.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.150+0000 7fb35dfe0740 1 --2- 172.21.15.2:0/3361807267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625125c7bb0 0x5625125c4cc0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:21.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.150+0000 7fb35dfe0740 1 --2- 172.21.15.2:0/3361807267 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625125bd2f0 0x5625125c4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:21.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.150+0000 7fb35dfe0740 1 --2- 172.21.15.2:0/3361807267 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5625125d84a0 0x5625125d9910 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:21.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.150+0000 7fb35dfe0740 1 --2- 172.21.15.2:0/3361807267 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5625125bc9d0 0x5625125c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:21.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.150+0000 7fb33d7fa640 0 client.15000 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:14:21.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.150+0000 7fb35dfe0740 1 -- 172.21.15.2:0/3361807267 >> 172.21.15.2:0/3361807267 conn(0x5625125b8f60 msgr2=0x5625125bec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:21.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.150+0000 7fb35dfe0740 1 -- 172.21.15.2:0/3361807267 shutdown_connections 2024-09-19T06:14:21.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.150+0000 7fb35dfe0740 1 -- 172.21.15.2:0/3361807267 wait complete. 2024-09-19T06:14:21.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.151+0000 7fb35dfe0740 20 client.15000 trim_cache size 0 max 16384 2024-09-19T06:14:21.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.168+0000 7fb35dfe0740 1 Processor -- start 2024-09-19T06:14:21.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.168+0000 7fb35dfe0740 1 -- start start 2024-09-19T06:14:21.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.168+0000 7fb35dfe0740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5625125bc9d0 0x5625125d9240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:21.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.168+0000 7fb35dfe0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625125bd2f0 0x5625125e1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:21.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.168+0000 7fb35dfe0740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625125c7bb0 0x5625125e2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:21.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.168+0000 7fb35dfe0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5625125d7c50 con 0x5625125bd2f0 2024-09-19T06:14:21.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.168+0000 7fb35dfe0740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5625125d8320 con 0x5625125bc9d0 2024-09-19T06:14:21.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.168+0000 7fb35dfe0740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5625125d89f0 con 0x5625125c7bb0 2024-09-19T06:14:21.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.169+0000 7fb3591a2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625125bd2f0 0x5625125e1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:21.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.169+0000 7fb3591a2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625125bd2f0 0x5625125e1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36864/0 (socket says 172.21.15.2:36864) 2024-09-19T06:14:21.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.169+0000 7fb3591a2640 1 -- 172.21.15.2:0/2058444500 learned_addr learned my addr 172.21.15.2:0/2058444500 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:21.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.169+0000 7fb3599a3640 1 --2- 172.21.15.2:0/2058444500 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5625125bc9d0 0x5625125d9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:21.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.169+0000 7fb35a1a4640 1 --2- 172.21.15.2:0/2058444500 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625125c7bb0 0x5625125e2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:21.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.169+0000 7fb3591a2640 1 -- 172.21.15.2:0/2058444500 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625125c7bb0 msgr2=0x5625125e2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:21.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.169+0000 7fb3591a2640 1 --2- 172.21.15.2:0/2058444500 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625125c7bb0 0x5625125e2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:21.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.169+0000 7fb3591a2640 1 -- 172.21.15.2:0/2058444500 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5625125bc9d0 msgr2=0x5625125d9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:21.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.169+0000 7fb3591a2640 1 --2- 172.21.15.2:0/2058444500 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5625125bc9d0 0x5625125d9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:21.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.169+0000 7fb3591a2640 1 -- 172.21.15.2:0/2058444500 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625125c5540 con 0x5625125bd2f0 2024-09-19T06:14:21.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.169+0000 7fb35a1a4640 1 --2- 172.21.15.2:0/2058444500 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625125c7bb0 0x5625125e2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:14:21.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.169+0000 7fb3591a2640 1 --2- 172.21.15.2:0/2058444500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625125bd2f0 0x5625125e1bf0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb34409b290 tx=0x7fb34409b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4fd1b2fb616e740 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:21.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.169+0000 7fb33f7fe640 1 -- 172.21.15.2:0/2058444500 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb34401e040 con 0x5625125bd2f0 2024-09-19T06:14:21.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.169+0000 7fb33f7fe640 1 -- 172.21.15.2:0/2058444500 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb344099890 con 0x5625125bd2f0 2024-09-19T06:14:21.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.169+0000 7fb33f7fe640 1 -- 172.21.15.2:0/2058444500 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb34409b7f0 con 0x5625125bd2f0 2024-09-19T06:14:21.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.170+0000 7fb35dfe0740 1 -- 172.21.15.2:0/2058444500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625125bd2f0 msgr2=0x5625125e1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:21.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.170+0000 7fb35dfe0740 1 --2- 172.21.15.2:0/2058444500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625125bd2f0 0x5625125e1bf0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb34409b290 tx=0x7fb34409b650 comp rx=0 tx=0).stop 2024-09-19T06:14:21.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.170+0000 7fb35dfe0740 1 -- 172.21.15.2:0/2058444500 shutdown_connections 2024-09-19T06:14:21.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.170+0000 7fb35dfe0740 1 --2- 172.21.15.2:0/2058444500 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625125c7bb0 0x5625125e2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:21.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.170+0000 7fb35dfe0740 1 --2- 172.21.15.2:0/2058444500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625125bd2f0 0x5625125e1bf0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:21.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.170+0000 7fb35dfe0740 1 --2- 172.21.15.2:0/2058444500 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5625125bc9d0 0x5625125d9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:21.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.170+0000 7fb35dfe0740 1 -- 172.21.15.2:0/2058444500 >> 172.21.15.2:0/2058444500 conn(0x5625125b8f60 msgr2=0x5625125b3ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:21.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.170+0000 7fb35dfe0740 1 -- 172.21.15.2:0/2058444500 shutdown_connections 2024-09-19T06:14:21.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.170+0000 7fb35dfe0740 1 -- 172.21.15.2:0/2058444500 wait complete. 2024-09-19T06:14:21.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.170+0000 7fb35dfe0740 1 -- start start 2024-09-19T06:14:21.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.170+0000 7fb35dfe0740 1 Processor -- start 2024-09-19T06:14:21.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.171+0000 7fb35dfe0740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5625125bc9d0 0x5625125dcfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:21.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.171+0000 7fb35dfe0740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625125bd2f0 0x5625125dd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:21.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.171+0000 7fb35dfe0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625125c7bb0 0x562512640ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:21.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.171+0000 7fb35dfe0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5625125d9790 con 0x5625125c7bb0 2024-09-19T06:14:21.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.171+0000 7fb35dfe0740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5625125d90c0 con 0x5625125bc9d0 2024-09-19T06:14:21.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.171+0000 7fb35dfe0740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5625125d9e60 con 0x5625125bd2f0 2024-09-19T06:14:21.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.171+0000 7fb35dfe0740 10 client.0 _ll_register_callbacks cb 0x7fb34409b360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:21.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.171+0000 7fb35a1a4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625125c7bb0 0x562512640ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:21.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.171+0000 7fb3599a3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5625125bc9d0 0x5625125dcfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:21.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.171+0000 7fb35a1a4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625125c7bb0 0x562512640ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36874/0 (socket says 172.21.15.2:36874) 2024-09-19T06:14:21.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.171+0000 7fb35a1a4640 1 -- 172.21.15.2:0/711752389 learned_addr learned my addr 172.21.15.2:0/711752389 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:21.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.171+0000 7fb3591a2640 1 --2- 172.21.15.2:0/711752389 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625125bd2f0 0x5625125dd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:21.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.171+0000 7fb35a1a4640 1 -- 172.21.15.2:0/711752389 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625125bd2f0 msgr2=0x5625125dd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:21.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.171+0000 7fb35a1a4640 1 --2- 172.21.15.2:0/711752389 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625125bd2f0 0x5625125dd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:21.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.171+0000 7fb35a1a4640 1 -- 172.21.15.2:0/711752389 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5625125bc9d0 msgr2=0x5625125dcfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:21.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.171+0000 7fb35a1a4640 1 --2- 172.21.15.2:0/711752389 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5625125bc9d0 0x5625125dcfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:21.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.171+0000 7fb35a1a4640 1 -- 172.21.15.2:0/711752389 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625126410e0 con 0x5625125c7bb0 2024-09-19T06:14:21.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.171+0000 7fb35a1a4640 1 --2- 172.21.15.2:0/711752389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625125c7bb0 0x562512640ba0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb34c009770 tx=0x7fb34c012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d9dc306ca69623e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:21.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.171+0000 7fb33d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:14:21.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.171+0000 7fb33d7fa640 1 -- 172.21.15.2:0/711752389 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb34c012d90 con 0x5625125c7bb0 2024-09-19T06:14:21.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.171+0000 7fb33d7fa640 1 -- 172.21.15.2:0/711752389 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7fb34c02e070 con 0x5625125c7bb0 2024-09-19T06:14:21.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.171+0000 7fb35dfe0740 1 -- 172.21.15.2:0/711752389 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb344099890 con 0x5625125c7bb0 2024-09-19T06:14:21.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.172+0000 7fb33d7fa640 1 -- 172.21.15.2:0/711752389 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb34c01dce0 con 0x5625125c7bb0 2024-09-19T06:14:21.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.172+0000 7fb35dfe0740 10 client.15006 fetch_fsmap learned FSMap version 25 2024-09-19T06:14:21.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.172+0000 7fb35dfe0740 1 -- 172.21.15.2:0/711752389 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5625126422d0 con 0x5625125c7bb0 2024-09-19T06:14:21.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.172+0000 7fb33d7fa640 1 -- 172.21.15.2:0/711752389 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb344099890 con 0x5625125c7bb0 2024-09-19T06:14:21.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.172+0000 7fb33d7fa640 1 -- 172.21.15.2:0/711752389 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb34c00e6f0 con 0x5625125c7bb0 2024-09-19T06:14:21.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.172+0000 7fb35dfe0740 10 client.15006 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T06:14:21.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.172+0000 7fb35dfe0740 10 client.15006 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T06:14:21.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.172+0000 7fb35dfe0740 20 client.15006 populate_metadata read hostname 'smithi002' 2024-09-19T06:14:21.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.172+0000 7fb35dfe0740 1 --2- 172.21.15.2:0/711752389 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562512646ea0 0x562512645bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:21.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.172+0000 7fb35dfe0740 4 client.15006 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:14:21.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.172+0000 7fb35dfe0740 1 -- 172.21.15.2:0/711752389 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "status"}) -- 0x56251252ab10 con 0x562512646ea0 2024-09-19T06:14:21.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.172+0000 7fb3599a3640 1 --2- 172.21.15.2:0/711752389 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562512646ea0 0x562512645bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:21.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.173+0000 7fb3599a3640 1 --2- 172.21.15.2:0/711752389 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562512646ea0 0x562512645bb0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1613fe129cff0e3 server_cookie=7136eefcd62e4882 in_seq=0 out_seq=0 2024-09-19T06:14:21.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.173+0000 7fb33d7fa640 10 client.15006 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:14:21.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.173+0000 7fb33d7fa640 1 -- 172.21.15.2:0/711752389 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x56251252ab10 con 0x562512646ea0 2024-09-19T06:14:21.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.173+0000 7fb33d7fa640 10 client.15006 handle_command_reply: tid=0 2024-09-19T06:14:21.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.173+0000 7fb35dfe0740 1 client.15006 shutdown 2024-09-19T06:14:21.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.173+0000 7fb35dfe0740 1 -- 172.21.15.2:0/711752389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625125c7bb0 msgr2=0x562512640ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:21.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.173+0000 7fb35dfe0740 1 --2- 172.21.15.2:0/711752389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625125c7bb0 0x562512640ba0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb34c009770 tx=0x7fb34c012820 comp rx=0 tx=0).stop 2024-09-19T06:14:21.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.173+0000 7fb35dfe0740 1 -- 172.21.15.2:0/711752389 shutdown_connections 2024-09-19T06:14:21.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.173+0000 7fb35dfe0740 1 --2- 172.21.15.2:0/711752389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625125c7bb0 0x562512640ba0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:21.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.173+0000 7fb35dfe0740 1 --2- 172.21.15.2:0/711752389 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625125bd2f0 0x5625125dd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:21.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.173+0000 7fb35dfe0740 1 --2- 172.21.15.2:0/711752389 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562512646ea0 0x562512645bb0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:21.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.173+0000 7fb35dfe0740 1 --2- 172.21.15.2:0/711752389 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5625125bc9d0 0x5625125dcfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:21.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.173+0000 7fb33d7fa640 0 client.15006 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:14:21.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.173+0000 7fb35dfe0740 1 -- 172.21.15.2:0/711752389 >> 172.21.15.2:0/711752389 conn(0x5625125b8f60 msgr2=0x5625125b77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:21.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.173+0000 7fb35dfe0740 1 -- 172.21.15.2:0/711752389 shutdown_connections 2024-09-19T06:14:21.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.173+0000 7fb35dfe0740 1 -- 172.21.15.2:0/711752389 wait complete. 2024-09-19T06:14:21.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.174+0000 7fb35dfe0740 20 client.15006 trim_cache size 0 max 16384 2024-09-19T06:14:21.184 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:14:21.184 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "078f6612-764d-11ef-bceb-c7b262605968", 2024-09-19T06:14:21.184 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2024-09-19T06:14:21.184 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24497, 2024-09-19T06:14:21.184 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-09-19T06:14:21.184 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-09-19T06:14:21.185 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-09-19T06:14:21.185 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 76.386408297000003, 2024-09-19T06:14:21.185 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 25, 2024-09-19T06:14:21.185 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 81, 2024-09-19T06:14:21.185 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 81, 2024-09-19T06:14:21.185 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 88.193833803000004 2024-09-19T06:14:21.185 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:14:21.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.174+0000 7fb35bc07640 1 -- 172.21.15.2:0/2587891111 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fb3400a3350 msgr2=0x7fb3400a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:21.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.174+0000 7fb35bc07640 1 --2- 172.21.15.2:0/2587891111 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fb3400a3350 0x7fb3400a5810 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb34c022000 tx=0x7fb34c020000 comp rx=0 tx=0).stop 2024-09-19T06:14:21.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.174+0000 7fb35bc07640 1 -- 172.21.15.2:0/2587891111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb354101420 msgr2=0x7fb3540fd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:21.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.174+0000 7fb35bc07640 1 --2- 172.21.15.2:0/2587891111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb354101420 0x7fb3540fd410 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb34400b4a0 tx=0x7fb34400b960 comp rx=0 tx=0).stop 2024-09-19T06:14:21.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.174+0000 7fb35bc07640 1 -- 172.21.15.2:0/2587891111 shutdown_connections 2024-09-19T06:14:21.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.174+0000 7fb35bc07640 1 --2- 172.21.15.2:0/2587891111 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fb3400a3350 0x7fb3400a5810 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:21.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.174+0000 7fb35bc07640 1 --2- 172.21.15.2:0/2587891111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb354106a80 0x7fb3540fd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:21.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.174+0000 7fb35bc07640 1 --2- 172.21.15.2:0/2587891111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb354101420 0x7fb3540fd410 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:21.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.174+0000 7fb35bc07640 1 --2- 172.21.15.2:0/2587891111 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb354100a80 0x7fb3540fced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:21.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.174+0000 7fb35bc07640 1 -- 172.21.15.2:0/2587891111 >> 172.21.15.2:0/2587891111 conn(0x7fb3540fc7a0 msgr2=0x7fb35406ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:21.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.174+0000 7fb35bc07640 1 -- 172.21.15.2:0/2587891111 shutdown_connections 2024-09-19T06:14:21.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:21.174+0000 7fb35bc07640 1 -- 172.21.15.2:0/2587891111 wait complete. 2024-09-19T06:14:21.891 INFO:tasks.cephadm:Setup complete, yielding 2024-09-19T06:14:21.891 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T06:14:21.901 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-19T06:14:21.901 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-19T06:14:22.156 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:22.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:21 smithi002 ceph-mon[30982]: pgmap v315: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:14:22.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:21 smithi090 ceph-mon[34497]: pgmap v315: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:14:22.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:21 smithi089 ceph-mon[34160]: pgmap v315: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:14:22.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.579+0000 7f6593dac640 1 -- 172.21.15.2:0/2766967521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f658c104fd0 msgr2=0x7f658c1073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:22.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.579+0000 7f6593dac640 1 --2- 172.21.15.2:0/2766967521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f658c104fd0 0x7f658c1073c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f657c009900 tx=0x7f657c02a410 comp rx=0 tx=0).stop 2024-09-19T06:14:22.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.579+0000 7f6593dac640 1 -- 172.21.15.2:0/2766967521 shutdown_connections 2024-09-19T06:14:22.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.579+0000 7f6593dac640 1 --2- 172.21.15.2:0/2766967521 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f658c107900 0x7f658c109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:22.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.579+0000 7f6593dac640 1 --2- 172.21.15.2:0/2766967521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f658c104fd0 0x7f658c1073c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:22.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.579+0000 7f6593dac640 1 --2- 172.21.15.2:0/2766967521 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f658c1026a0 0x7f658c104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:22.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.579+0000 7f6593dac640 1 -- 172.21.15.2:0/2766967521 >> 172.21.15.2:0/2766967521 conn(0x7f658c0fc2a0 msgr2=0x7f658c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:22.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.579+0000 7f6593dac640 1 -- 172.21.15.2:0/2766967521 shutdown_connections 2024-09-19T06:14:22.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.579+0000 7f6593dac640 1 -- 172.21.15.2:0/2766967521 wait complete. 2024-09-19T06:14:22.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.580+0000 7f6593dac640 1 Processor -- start 2024-09-19T06:14:22.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.580+0000 7f6593dac640 1 -- start start 2024-09-19T06:14:22.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.580+0000 7f6593dac640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f658c1026a0 0x7f658c102000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:22.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.580+0000 7f6593dac640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f658c104fd0 0x7f658c100650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:22.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.580+0000 7f6593dac640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f658c107900 0x7f658c100b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:22.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.580+0000 7f6593dac640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f658c10d730 con 0x7f658c1026a0 2024-09-19T06:14:22.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.580+0000 7f6593dac640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f658c10d5b0 con 0x7f658c104fd0 2024-09-19T06:14:22.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.580+0000 7f6593dac640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f658c10d8b0 con 0x7f658c107900 2024-09-19T06:14:22.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.580+0000 7f6591b48640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f658c1026a0 0x7f658c102000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:22.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.580+0000 7f6591b48640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f658c1026a0 0x7f658c102000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36900/0 (socket says 172.21.15.2:36900) 2024-09-19T06:14:22.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.580+0000 7f6591b48640 1 -- 172.21.15.2:0/1497197088 learned_addr learned my addr 172.21.15.2:0/1497197088 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:22.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.580+0000 7f6591347640 1 --2- 172.21.15.2:0/1497197088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f658c104fd0 0x7f658c100650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:22.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.581+0000 7f6592349640 1 --2- 172.21.15.2:0/1497197088 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f658c107900 0x7f658c100b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:22.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.581+0000 7f6591b48640 1 -- 172.21.15.2:0/1497197088 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f658c107900 msgr2=0x7f658c100b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:22.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.581+0000 7f6591b48640 1 --2- 172.21.15.2:0/1497197088 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f658c107900 0x7f658c100b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:22.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.581+0000 7f6591b48640 1 -- 172.21.15.2:0/1497197088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f658c104fd0 msgr2=0x7f658c100650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:22.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.581+0000 7f6591b48640 1 --2- 172.21.15.2:0/1497197088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f658c104fd0 0x7f658c100650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:22.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.581+0000 7f6591b48640 1 -- 172.21.15.2:0/1497197088 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f658c101450 con 0x7f658c1026a0 2024-09-19T06:14:22.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.581+0000 7f6591b48640 1 --2- 172.21.15.2:0/1497197088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f658c1026a0 0x7f658c102000 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f658800c920 tx=0x7f658800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:22.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.581+0000 7f6582ffd640 1 -- 172.21.15.2:0/1497197088 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6588007c70 con 0x7f658c1026a0 2024-09-19T06:14:22.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.581+0000 7f6593dac640 1 -- 172.21.15.2:0/1497197088 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f658c1a1fa0 con 0x7f658c1026a0 2024-09-19T06:14:22.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.581+0000 7f6582ffd640 1 -- 172.21.15.2:0/1497197088 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6588007e10 con 0x7f658c1026a0 2024-09-19T06:14:22.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.581+0000 7f6582ffd640 1 -- 172.21.15.2:0/1497197088 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6588018820 con 0x7f658c1026a0 2024-09-19T06:14:22.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.581+0000 7f6593dac640 1 -- 172.21.15.2:0/1497197088 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f658c1a23f0 con 0x7f658c1026a0 2024-09-19T06:14:22.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.582+0000 7f6593dac640 1 -- 172.21.15.2:0/1497197088 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f658c0fdd90 con 0x7f658c1026a0 2024-09-19T06:14:22.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.583+0000 7f6582ffd640 1 -- 172.21.15.2:0/1497197088 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f65880189c0 con 0x7f658c1026a0 2024-09-19T06:14:22.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.584+0000 7f6582ffd640 1 --2- 172.21.15.2:0/1497197088 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f65780a32d0 0x7f65780a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:22.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.584+0000 7f6591347640 1 --2- 172.21.15.2:0/1497197088 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f65780a32d0 0x7f65780a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:22.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.584+0000 7f6582ffd640 1 -- 172.21.15.2:0/1497197088 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f65880cfbc0 con 0x7f658c1026a0 2024-09-19T06:14:22.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.584+0000 7f6591347640 1 --2- 172.21.15.2:0/1497197088 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f65780a32d0 0x7f65780a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f657c004770 tx=0x7f657c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:22.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.588+0000 7f6582ffd640 1 -- 172.21.15.2:0/1497197088 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6588014030 con 0x7f658c1026a0 2024-09-19T06:14:22.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.781+0000 7f6593dac640 1 -- 172.21.15.2:0/1497197088 --> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f658c062630 con 0x7f65780a32d0 2024-09-19T06:14:22.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.782+0000 7f6582ffd640 1 -- 172.21.15.2:0/1497197088 <== mgr.14150 v2:172.21.15.2:6800/4180340554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f658c062630 con 0x7f65780a32d0 2024-09-19T06:14:22.784 INFO:teuthology.orchestra.run.smithi002.stdout:Backend: cephadm 2024-09-19T06:14:22.784 INFO:teuthology.orchestra.run.smithi002.stdout:Available: Yes 2024-09-19T06:14:22.784 INFO:teuthology.orchestra.run.smithi002.stdout:Paused: No 2024-09-19T06:14:22.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.784+0000 7f6593dac640 1 -- 172.21.15.2:0/1497197088 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f65780a32d0 msgr2=0x7f65780a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:22.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.784+0000 7f6593dac640 1 --2- 172.21.15.2:0/1497197088 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f65780a32d0 0x7f65780a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f657c004770 tx=0x7f657c000bc0 comp rx=0 tx=0).stop 2024-09-19T06:14:22.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.784+0000 7f6593dac640 1 -- 172.21.15.2:0/1497197088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f658c1026a0 msgr2=0x7f658c102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:22.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.784+0000 7f6593dac640 1 --2- 172.21.15.2:0/1497197088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f658c1026a0 0x7f658c102000 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f658800c920 tx=0x7f658800cde0 comp rx=0 tx=0).stop 2024-09-19T06:14:22.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.784+0000 7f6593dac640 1 -- 172.21.15.2:0/1497197088 shutdown_connections 2024-09-19T06:14:22.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.784+0000 7f6593dac640 1 --2- 172.21.15.2:0/1497197088 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f65780a32d0 0x7f65780a5790 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:22.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.784+0000 7f6593dac640 1 --2- 172.21.15.2:0/1497197088 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f658c107900 0x7f658c100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:22.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.784+0000 7f6593dac640 1 --2- 172.21.15.2:0/1497197088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f658c104fd0 0x7f658c100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:22.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.784+0000 7f6593dac640 1 --2- 172.21.15.2:0/1497197088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f658c1026a0 0x7f658c102000 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:22.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.784+0000 7f6593dac640 1 -- 172.21.15.2:0/1497197088 >> 172.21.15.2:0/1497197088 conn(0x7f658c0fc2a0 msgr2=0x7f658c103080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:22.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.784+0000 7f6593dac640 1 -- 172.21.15.2:0/1497197088 shutdown_connections 2024-09-19T06:14:22.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:22.784+0000 7f6593dac640 1 -- 172.21.15.2:0/1497197088 wait complete. 2024-09-19T06:14:23.398 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-19T06:14:23.654 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:24.030 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:23 smithi002 ceph-mon[30982]: pgmap v316: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:24.030 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:23 smithi002 ceph-mon[30982]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:14:24.115 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:23 smithi089 ceph-mon[34160]: pgmap v316: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:24.116 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:23 smithi089 ceph-mon[34160]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:14:24.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.110+0000 7fe0310ad640 1 -- 172.21.15.2:0/58479201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe02c102690 msgr2=0x7fe02c108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:24.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.110+0000 7fe0310ad640 1 --2- 172.21.15.2:0/58479201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe02c102690 0x7fe02c108f20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe024009ca0 tx=0x7fe02402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.110+0000 7fe0310ad640 1 -- 172.21.15.2:0/58479201 shutdown_connections 2024-09-19T06:14:24.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.110+0000 7fe0310ad640 1 --2- 172.21.15.2:0/58479201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe02c102690 0x7fe02c108f20 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.110+0000 7fe0310ad640 1 --2- 172.21.15.2:0/58479201 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe02c101cd0 0x7fe02c102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.110+0000 7fe0310ad640 1 --2- 172.21.15.2:0/58479201 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe02c100ad0 0x7fe02c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.110+0000 7fe0310ad640 1 -- 172.21.15.2:0/58479201 >> 172.21.15.2:0/58479201 conn(0x7fe02c0fc280 msgr2=0x7fe02c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:24.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.110+0000 7fe0310ad640 1 -- 172.21.15.2:0/58479201 shutdown_connections 2024-09-19T06:14:24.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.110+0000 7fe0310ad640 1 -- 172.21.15.2:0/58479201 wait complete. 2024-09-19T06:14:24.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.111+0000 7fe0310ad640 1 Processor -- start 2024-09-19T06:14:24.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.111+0000 7fe0310ad640 1 -- start start 2024-09-19T06:14:24.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.112+0000 7fe0310ad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe02c100ad0 0x7fe02c196c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:24.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.112+0000 7fe0310ad640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe02c101cd0 0x7fe02c1971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:24.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.112+0000 7fe0310ad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe02c102690 0x7fe02c19e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:24.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.112+0000 7fe0310ad640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe02c10c5e0 con 0x7fe02c102690 2024-09-19T06:14:24.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.112+0000 7fe0310ad640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe02c10c460 con 0x7fe02c100ad0 2024-09-19T06:14:24.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.112+0000 7fe0310ad640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe02c10c760 con 0x7fe02c101cd0 2024-09-19T06:14:24.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.112+0000 7fe02b59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe02c102690 0x7fe02c19e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:24.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.112+0000 7fe02b59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe02c102690 0x7fe02c19e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36928/0 (socket says 172.21.15.2:36928) 2024-09-19T06:14:24.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.112+0000 7fe02b59e640 1 -- 172.21.15.2:0/4203183605 learned_addr learned my addr 172.21.15.2:0/4203183605 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:24.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.112+0000 7fe02a59c640 1 --2- 172.21.15.2:0/4203183605 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe02c101cd0 0x7fe02c1971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:24.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.112+0000 7fe02ad9d640 1 --2- 172.21.15.2:0/4203183605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe02c100ad0 0x7fe02c196c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:24.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.112+0000 7fe02b59e640 1 -- 172.21.15.2:0/4203183605 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe02c101cd0 msgr2=0x7fe02c1971d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:24.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.112+0000 7fe02b59e640 1 --2- 172.21.15.2:0/4203183605 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe02c101cd0 0x7fe02c1971d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.112+0000 7fe02b59e640 1 -- 172.21.15.2:0/4203183605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe02c100ad0 msgr2=0x7fe02c196c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:24.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.112+0000 7fe02b59e640 1 --2- 172.21.15.2:0/4203183605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe02c100ad0 0x7fe02c196c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.112+0000 7fe02b59e640 1 -- 172.21.15.2:0/4203183605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe02c19e8b0 con 0x7fe02c102690 2024-09-19T06:14:24.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.112+0000 7fe02b59e640 1 --2- 172.21.15.2:0/4203183605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe02c102690 0x7fe02c19e240 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe024009dc0 tx=0x7fe024003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:24.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.113+0000 7fe023fff640 1 -- 172.21.15.2:0/4203183605 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe024032ec0 con 0x7fe02c102690 2024-09-19T06:14:24.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.113+0000 7fe023fff640 1 -- 172.21.15.2:0/4203183605 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe0240044f0 con 0x7fe02c102690 2024-09-19T06:14:24.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.113+0000 7fe0310ad640 1 -- 172.21.15.2:0/4203183605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe02c19eb40 con 0x7fe02c102690 2024-09-19T06:14:24.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.113+0000 7fe023fff640 1 -- 172.21.15.2:0/4203183605 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe024030d40 con 0x7fe02c102690 2024-09-19T06:14:24.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.113+0000 7fe0310ad640 1 -- 172.21.15.2:0/4203183605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe02c19f080 con 0x7fe02c102690 2024-09-19T06:14:24.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.114+0000 7fe0310ad640 1 -- 172.21.15.2:0/4203183605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe02c107f20 con 0x7fe02c102690 2024-09-19T06:14:24.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.115+0000 7fe023fff640 1 -- 172.21.15.2:0/4203183605 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fe024004040 con 0x7fe02c102690 2024-09-19T06:14:24.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.116+0000 7fe023fff640 1 --2- 172.21.15.2:0/4203183605 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fe0180a3470 0x7fe0180a5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:24.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.116+0000 7fe02ad9d640 1 --2- 172.21.15.2:0/4203183605 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fe0180a3470 0x7fe0180a5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:24.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.116+0000 7fe023fff640 1 -- 172.21.15.2:0/4203183605 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7fe0240f0eb0 con 0x7fe02c102690 2024-09-19T06:14:24.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.116+0000 7fe02ad9d640 1 --2- 172.21.15.2:0/4203183605 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fe0180a3470 0x7fe0180a5930 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe02c197b70 tx=0x7fe01c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:24.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.120+0000 7fe023fff640 1 -- 172.21.15.2:0/4203183605 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe0240bdb90 con 0x7fe02c102690 2024-09-19T06:14:24.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:23 smithi090 ceph-mon[34497]: pgmap v316: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:24.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:23 smithi090 ceph-mon[34497]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:14:24.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.303+0000 7fe0310ad640 1 -- 172.21.15.2:0/4203183605 --> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fe02c062630 con 0x7fe0180a3470 2024-09-19T06:14:24.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.315+0000 7fe023fff640 1 -- 172.21.15.2:0/4203183605 <== mgr.14150 v2:172.21.15.2:6800/4180340554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7fe02c062630 con 0x7fe0180a3470 2024-09-19T06:14:24.317 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:14:24.317 INFO:teuthology.orchestra.run.smithi002.stdout:mds.a smithi002 running (94s) 16s ago 93s 16.4M - 19.1.1-361-g2f599a46 d2baa855c067 687570e27fbe 2024-09-19T06:14:24.317 INFO:teuthology.orchestra.run.smithi002.stdout:mds.b smithi089 running (91s) 25s ago 91s 25.8M - 19.1.1-361-g2f599a46 d2baa855c067 f173cf3a5456 2024-09-19T06:14:24.317 INFO:teuthology.orchestra.run.smithi002.stdout:mds.c smithi090 running (105s) 25s ago 105s 20.2M - 19.1.1-361-g2f599a46 d2baa855c067 e0f74ff4e3fe 2024-09-19T06:14:24.318 INFO:teuthology.orchestra.run.smithi002.stdout:mds.d smithi002 running (112s) 16s ago 112s 14.3M - 19.1.1-361-g2f599a46 d2baa855c067 fe9f8ad5291e 2024-09-19T06:14:24.318 INFO:teuthology.orchestra.run.smithi002.stdout:mds.e smithi089 running (110s) 25s ago 110s 16.5M - 19.1.1-361-g2f599a46 d2baa855c067 886a88d8b8ad 2024-09-19T06:14:24.318 INFO:teuthology.orchestra.run.smithi002.stdout:mds.f smithi090 running (108s) 25s ago 107s 16.7M - 19.1.1-361-g2f599a46 d2baa855c067 ec0f0937d3fc 2024-09-19T06:14:24.318 INFO:teuthology.orchestra.run.smithi002.stdout:mds.g smithi002 running (97s) 16s ago 97s 14.3M - 19.1.1-361-g2f599a46 d2baa855c067 c798fe82c2bf 2024-09-19T06:14:24.318 INFO:teuthology.orchestra.run.smithi002.stdout:mds.h smithi089 running (103s) 25s ago 102s 19.4M - 19.1.1-361-g2f599a46 d2baa855c067 e38fe5bd3cc8 2024-09-19T06:14:24.318 INFO:teuthology.orchestra.run.smithi002.stdout:mds.i smithi090 running (100s) 25s ago 100s 19.5M - 19.1.1-361-g2f599a46 d2baa855c067 1f2d0c1584a5 2024-09-19T06:14:24.318 INFO:teuthology.orchestra.run.smithi002.stdout:mds.j smithi002 running (116s) 16s ago 115s 14.1M - 19.1.1-361-g2f599a46 d2baa855c067 2ba4e9513e7a 2024-09-19T06:14:24.318 INFO:teuthology.orchestra.run.smithi002.stdout:mds.k smithi089 running (119s) 25s ago 118s 16.7M - 19.1.1-361-g2f599a46 d2baa855c067 78935390e786 2024-09-19T06:14:24.318 INFO:teuthology.orchestra.run.smithi002.stdout:mds.l smithi090 running (2m) 25s ago 2m 13.5M - 19.1.1-361-g2f599a46 d2baa855c067 776c0eda70fd 2024-09-19T06:14:24.318 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.x smithi002 *:9283,8765 running (9m) 16s ago 8m 508M - 19.1.1-361-g2f599a46 d2baa855c067 74011ddbdaee 2024-09-19T06:14:24.319 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.y smithi089 *:8443,8765 running (7m) 25s ago 7m 441M - 19.1.1-361-g2f599a46 d2baa855c067 a85a1cae896c 2024-09-19T06:14:24.319 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.z smithi090 *:8443,8765 running (7m) 25s ago 7m 444M - 19.1.1-361-g2f599a46 d2baa855c067 dbce46062315 2024-09-19T06:14:24.319 INFO:teuthology.orchestra.run.smithi002.stdout:mon.a smithi002 running (9m) 16s ago 9m 50.2M 2048M 19.1.1-361-g2f599a46 d2baa855c067 61e6476b375d 2024-09-19T06:14:24.319 INFO:teuthology.orchestra.run.smithi002.stdout:mon.b smithi089 running (7m) 25s ago 7m 43.2M 2048M 19.1.1-361-g2f599a46 d2baa855c067 10e7a033d334 2024-09-19T06:14:24.319 INFO:teuthology.orchestra.run.smithi002.stdout:mon.c smithi090 running (7m) 25s ago 7m 44.7M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ddaf5a97aa8b 2024-09-19T06:14:24.319 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (6m) 16s ago 6m 52.2M 4273M 19.1.1-361-g2f599a46 d2baa855c067 b98423a23efa 2024-09-19T06:14:24.319 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi089 running (6m) 25s ago 6m 56.3M 4271M 19.1.1-361-g2f599a46 d2baa855c067 ac406e8754bd 2024-09-19T06:14:24.320 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi090 running (6m) 25s ago 6m 50.2M 4272M 19.1.1-361-g2f599a46 d2baa855c067 cc12f0767f4a 2024-09-19T06:14:24.320 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi002 running (5m) 16s ago 5m 53.2M 4273M 19.1.1-361-g2f599a46 d2baa855c067 2f5c9b5a760b 2024-09-19T06:14:24.320 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi089 running (5m) 25s ago 5m 55.9M 4271M 19.1.1-361-g2f599a46 d2baa855c067 b269eff3a9b5 2024-09-19T06:14:24.320 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi090 running (4m) 25s ago 4m 46.4M 4272M 19.1.1-361-g2f599a46 d2baa855c067 e0e910b97d56 2024-09-19T06:14:24.320 INFO:teuthology.orchestra.run.smithi002.stdout:osd.6 smithi002 running (4m) 16s ago 4m 53.8M 4273M 19.1.1-361-g2f599a46 d2baa855c067 f0e4b3b45587 2024-09-19T06:14:24.320 INFO:teuthology.orchestra.run.smithi002.stdout:osd.7 smithi089 running (4m) 25s ago 3m 45.2M 4271M 19.1.1-361-g2f599a46 d2baa855c067 c7745e17838b 2024-09-19T06:14:24.320 INFO:teuthology.orchestra.run.smithi002.stdout:osd.8 smithi090 running (3m) 25s ago 3m 51.0M 4272M 19.1.1-361-g2f599a46 d2baa855c067 682d18ab3989 2024-09-19T06:14:24.320 INFO:teuthology.orchestra.run.smithi002.stdout:osd.9 smithi002 running (3m) 16s ago 3m 46.3M 4273M 19.1.1-361-g2f599a46 d2baa855c067 1f0fd5a2dfb9 2024-09-19T06:14:24.320 INFO:teuthology.orchestra.run.smithi002.stdout:osd.10 smithi089 running (2m) 25s ago 2m 46.9M 4271M 19.1.1-361-g2f599a46 d2baa855c067 88bfe72a4138 2024-09-19T06:14:24.321 INFO:teuthology.orchestra.run.smithi002.stdout:osd.11 smithi090 running (2m) 25s ago 2m 45.8M 4272M 19.1.1-361-g2f599a46 d2baa855c067 0b6c0b327cd6 2024-09-19T06:14:24.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.318+0000 7fe0310ad640 1 -- 172.21.15.2:0/4203183605 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fe0180a3470 msgr2=0x7fe0180a5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:24.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.318+0000 7fe0310ad640 1 --2- 172.21.15.2:0/4203183605 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fe0180a3470 0x7fe0180a5930 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe02c197b70 tx=0x7fe01c00b410 comp rx=0 tx=0).stop 2024-09-19T06:14:24.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.318+0000 7fe0310ad640 1 -- 172.21.15.2:0/4203183605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe02c102690 msgr2=0x7fe02c19e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:24.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.318+0000 7fe0310ad640 1 --2- 172.21.15.2:0/4203183605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe02c102690 0x7fe02c19e240 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe024009dc0 tx=0x7fe024003ba0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.318+0000 7fe0310ad640 1 -- 172.21.15.2:0/4203183605 shutdown_connections 2024-09-19T06:14:24.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.318+0000 7fe0310ad640 1 --2- 172.21.15.2:0/4203183605 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fe0180a3470 0x7fe0180a5930 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.318+0000 7fe0310ad640 1 --2- 172.21.15.2:0/4203183605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe02c102690 0x7fe02c19e240 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.318+0000 7fe0310ad640 1 --2- 172.21.15.2:0/4203183605 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe02c101cd0 0x7fe02c1971d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.318+0000 7fe0310ad640 1 --2- 172.21.15.2:0/4203183605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe02c100ad0 0x7fe02c196c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.318+0000 7fe0310ad640 1 -- 172.21.15.2:0/4203183605 >> 172.21.15.2:0/4203183605 conn(0x7fe02c0fc280 msgr2=0x7fe02c1050f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:24.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.318+0000 7fe0310ad640 1 -- 172.21.15.2:0/4203183605 shutdown_connections 2024-09-19T06:14:24.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:24.318+0000 7fe0310ad640 1 -- 172.21.15.2:0/4203183605 wait complete. 2024-09-19T06:14:24.929 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-19T06:14:25.186 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:25.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.644+0000 7f3b94c76640 1 -- 172.21.15.2:0/498147780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b901037c0 msgr2=0x7f3b9010a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:25.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.644+0000 7f3b94c76640 1 --2- 172.21.15.2:0/498147780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b901037c0 0x7f3b9010a050 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3b88009ca0 tx=0x7f3b8802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:14:25.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.644+0000 7f3b94c76640 1 -- 172.21.15.2:0/498147780 shutdown_connections 2024-09-19T06:14:25.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.644+0000 7f3b94c76640 1 --2- 172.21.15.2:0/498147780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b901037c0 0x7f3b9010a050 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:25.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.644+0000 7f3b94c76640 1 --2- 172.21.15.2:0/498147780 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b90102e00 0x7f3b90103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:25.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.644+0000 7f3b94c76640 1 --2- 172.21.15.2:0/498147780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b90101c00 0x7f3b90102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:25.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.644+0000 7f3b94c76640 1 -- 172.21.15.2:0/498147780 >> 172.21.15.2:0/498147780 conn(0x7f3b900fd390 msgr2=0x7f3b900ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:25.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.644+0000 7f3b94c76640 1 -- 172.21.15.2:0/498147780 shutdown_connections 2024-09-19T06:14:25.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.644+0000 7f3b94c76640 1 -- 172.21.15.2:0/498147780 wait complete. 2024-09-19T06:14:25.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.645+0000 7f3b94c76640 1 Processor -- start 2024-09-19T06:14:25.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.645+0000 7f3b94c76640 1 -- start start 2024-09-19T06:14:25.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.645+0000 7f3b94c76640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b90101c00 0x7f3b90197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:25.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.645+0000 7f3b94c76640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b90102e00 0x7f3b90198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:25.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.645+0000 7f3b94c76640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b901037c0 0x7f3b9019f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:25.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.645+0000 7f3b94c76640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3b9010d790 con 0x7f3b90102e00 2024-09-19T06:14:25.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.645+0000 7f3b94c76640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3b9010d610 con 0x7f3b90101c00 2024-09-19T06:14:25.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.645+0000 7f3b94c76640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3b9010d910 con 0x7f3b901037c0 2024-09-19T06:14:25.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.645+0000 7f3b8dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b90102e00 0x7f3b90198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:25.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.645+0000 7f3b8dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b90102e00 0x7f3b90198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50648/0 (socket says 172.21.15.2:50648) 2024-09-19T06:14:25.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.645+0000 7f3b8dd9b640 1 -- 172.21.15.2:0/2114780365 learned_addr learned my addr 172.21.15.2:0/2114780365 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:25.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.645+0000 7f3b8e59c640 1 --2- 172.21.15.2:0/2114780365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b90101c00 0x7f3b90197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:25.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.645+0000 7f3b8ed9d640 1 --2- 172.21.15.2:0/2114780365 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b901037c0 0x7f3b9019f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:25.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.646+0000 7f3b8dd9b640 1 -- 172.21.15.2:0/2114780365 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b901037c0 msgr2=0x7f3b9019f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:25.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.646+0000 7f3b8dd9b640 1 --2- 172.21.15.2:0/2114780365 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b901037c0 0x7f3b9019f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:25.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.646+0000 7f3b8dd9b640 1 -- 172.21.15.2:0/2114780365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b90101c00 msgr2=0x7f3b90197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:25.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.646+0000 7f3b8dd9b640 1 --2- 172.21.15.2:0/2114780365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b90101c00 0x7f3b90197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:25.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.646+0000 7f3b8dd9b640 1 -- 172.21.15.2:0/2114780365 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b9019fa70 con 0x7f3b90102e00 2024-09-19T06:14:25.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.646+0000 7f3b8e59c640 1 --2- 172.21.15.2:0/2114780365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b90101c00 0x7f3b90197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:14:25.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.646+0000 7f3b8dd9b640 1 --2- 172.21.15.2:0/2114780365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b90102e00 0x7f3b90198380 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3b8400b4a0 tx=0x7f3b8400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:25.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.646+0000 7f3b7f7fe640 1 -- 172.21.15.2:0/2114780365 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b84014070 con 0x7f3b90102e00 2024-09-19T06:14:25.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.646+0000 7f3b7f7fe640 1 -- 172.21.15.2:0/2114780365 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3b84010ac0 con 0x7f3b90102e00 2024-09-19T06:14:25.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.646+0000 7f3b94c76640 1 -- 172.21.15.2:0/2114780365 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b9019fd60 con 0x7f3b90102e00 2024-09-19T06:14:25.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.646+0000 7f3b7f7fe640 1 -- 172.21.15.2:0/2114780365 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b84017c30 con 0x7f3b90102e00 2024-09-19T06:14:25.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.646+0000 7f3b94c76640 1 -- 172.21.15.2:0/2114780365 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b901a0240 con 0x7f3b90102e00 2024-09-19T06:14:25.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.647+0000 7f3b94c76640 1 -- 172.21.15.2:0/2114780365 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b90109050 con 0x7f3b90102e00 2024-09-19T06:14:25.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.648+0000 7f3b7f7fe640 1 -- 172.21.15.2:0/2114780365 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f3b84017070 con 0x7f3b90102e00 2024-09-19T06:14:25.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.649+0000 7f3b7f7fe640 1 --2- 172.21.15.2:0/2114780365 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f3b780a3300 0x7f3b780a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:25.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.649+0000 7f3b8e59c640 1 --2- 172.21.15.2:0/2114780365 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f3b780a3300 0x7f3b780a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:25.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.649+0000 7f3b7f7fe640 1 -- 172.21.15.2:0/2114780365 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f3b840cf120 con 0x7f3b90102e00 2024-09-19T06:14:25.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.650+0000 7f3b8e59c640 1 --2- 172.21.15.2:0/2114780365 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f3b780a3300 0x7f3b780a57c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3b90102c60 tx=0x7f3b80005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:25.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.653+0000 7f3b7f7fe640 1 -- 172.21.15.2:0/2114780365 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3b8409bda0 con 0x7f3b90102e00 2024-09-19T06:14:25.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.836+0000 7f3b94c76640 1 -- 172.21.15.2:0/2114780365 --> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f3b90062630 con 0x7f3b780a3300 2024-09-19T06:14:25.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.842+0000 7f3b7f7fe640 1 -- 172.21.15.2:0/2114780365 <== mgr.14150 v2:172.21.15.2:6800/4180340554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f3b90062630 con 0x7f3b780a3300 2024-09-19T06:14:25.843 INFO:teuthology.orchestra.run.smithi002.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-19T06:14:25.844 INFO:teuthology.orchestra.run.smithi002.stdout:mds.all 12/12 26s ago 2m smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi089=b;smithi089=e;smithi089=h;smithi089=k;smithi090=c;smithi090=f;smithi090=i;smithi090=l;count:12 2024-09-19T06:14:25.844 INFO:teuthology.orchestra.run.smithi002.stdout:mgr 3/3 26s ago 7m smithi002=x;smithi089=y;smithi090=z;count:3 2024-09-19T06:14:25.844 INFO:teuthology.orchestra.run.smithi002.stdout:mon 3/3 26s ago 7m smithi002:172.21.15.2=a;smithi089:172.21.15.89=b;smithi090:172.21.15.90=c;count:3 2024-09-19T06:14:25.844 INFO:teuthology.orchestra.run.smithi002.stdout:osd 12 26s ago - 2024-09-19T06:14:25.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.844+0000 7f3b94c76640 1 -- 172.21.15.2:0/2114780365 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f3b780a3300 msgr2=0x7f3b780a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:25.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.844+0000 7f3b94c76640 1 --2- 172.21.15.2:0/2114780365 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f3b780a3300 0x7f3b780a57c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3b90102c60 tx=0x7f3b80005f90 comp rx=0 tx=0).stop 2024-09-19T06:14:25.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.844+0000 7f3b94c76640 1 -- 172.21.15.2:0/2114780365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b90102e00 msgr2=0x7f3b90198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:25.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.844+0000 7f3b94c76640 1 --2- 172.21.15.2:0/2114780365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b90102e00 0x7f3b90198380 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3b8400b4a0 tx=0x7f3b8400b960 comp rx=0 tx=0).stop 2024-09-19T06:14:25.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.844+0000 7f3b94c76640 1 -- 172.21.15.2:0/2114780365 shutdown_connections 2024-09-19T06:14:25.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.844+0000 7f3b94c76640 1 --2- 172.21.15.2:0/2114780365 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f3b780a3300 0x7f3b780a57c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:25.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.844+0000 7f3b94c76640 1 --2- 172.21.15.2:0/2114780365 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b901037c0 0x7f3b9019f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:25.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.844+0000 7f3b94c76640 1 --2- 172.21.15.2:0/2114780365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b90102e00 0x7f3b90198380 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:25.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.844+0000 7f3b94c76640 1 --2- 172.21.15.2:0/2114780365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b90101c00 0x7f3b90197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:25.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.844+0000 7f3b94c76640 1 -- 172.21.15.2:0/2114780365 >> 172.21.15.2:0/2114780365 conn(0x7f3b900fd390 msgr2=0x7f3b90106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:25.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.844+0000 7f3b94c76640 1 -- 172.21.15.2:0/2114780365 shutdown_connections 2024-09-19T06:14:25.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:25.844+0000 7f3b94c76640 1 -- 172.21.15.2:0/2114780365 wait complete. 2024-09-19T06:14:26.156 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:25 smithi002 ceph-mon[30982]: pgmap v317: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T06:14:26.156 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:25 smithi002 ceph-mon[30982]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:14:26.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:25 smithi090 ceph-mon[34497]: pgmap v317: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T06:14:26.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:25 smithi090 ceph-mon[34497]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:14:26.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:25 smithi089 ceph-mon[34160]: pgmap v317: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T06:14:26.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:25 smithi089 ceph-mon[34160]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:14:26.509 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-19T06:14:26.771 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:26.862 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:26 smithi002 ceph-mon[30982]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:14:27.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.218+0000 7f3970b2e640 1 -- 172.21.15.2:0/3522025409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f396c101c00 msgr2=0x7f396c102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:27.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.218+0000 7f3970b2e640 1 --2- 172.21.15.2:0/3522025409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f396c101c00 0x7f396c102000 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3954009900 tx=0x7f395402a410 comp rx=0 tx=0).stop 2024-09-19T06:14:27.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.218+0000 7f3970b2e640 1 -- 172.21.15.2:0/3522025409 shutdown_connections 2024-09-19T06:14:27.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.218+0000 7f3970b2e640 1 --2- 172.21.15.2:0/3522025409 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f396c1037c0 0x7f396c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:27.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.218+0000 7f3970b2e640 1 --2- 172.21.15.2:0/3522025409 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f396c102e00 0x7f396c103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:27.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.218+0000 7f3970b2e640 1 --2- 172.21.15.2:0/3522025409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f396c101c00 0x7f396c102000 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:27.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.218+0000 7f3970b2e640 1 -- 172.21.15.2:0/3522025409 >> 172.21.15.2:0/3522025409 conn(0x7f396c0fd390 msgr2=0x7f396c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:27.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.218+0000 7f3970b2e640 1 -- 172.21.15.2:0/3522025409 shutdown_connections 2024-09-19T06:14:27.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.218+0000 7f3970b2e640 1 -- 172.21.15.2:0/3522025409 wait complete. 2024-09-19T06:14:27.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.219+0000 7f3970b2e640 1 Processor -- start 2024-09-19T06:14:27.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.219+0000 7f3970b2e640 1 -- start start 2024-09-19T06:14:27.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.219+0000 7f3970b2e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f396c101c00 0x7f396c197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:27.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.219+0000 7f3970b2e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f396c102e00 0x7f396c198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:27.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.219+0000 7f3970b2e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f396c1037c0 0x7f396c19f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:27.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.219+0000 7f3970b2e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f396c10d710 con 0x7f396c101c00 2024-09-19T06:14:27.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.219+0000 7f3970b2e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f396c10d590 con 0x7f396c102e00 2024-09-19T06:14:27.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.219+0000 7f3970b2e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f396c10d890 con 0x7f396c1037c0 2024-09-19T06:14:27.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.220+0000 7f396a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f396c101c00 0x7f396c197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:27.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.220+0000 7f396a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f396c101c00 0x7f396c197dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50668/0 (socket says 172.21.15.2:50668) 2024-09-19T06:14:27.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.220+0000 7f396a59c640 1 -- 172.21.15.2:0/3607177070 learned_addr learned my addr 172.21.15.2:0/3607177070 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:27.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.220+0000 7f3969d9b640 1 --2- 172.21.15.2:0/3607177070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f396c102e00 0x7f396c198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:27.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.220+0000 7f396ad9d640 1 --2- 172.21.15.2:0/3607177070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f396c1037c0 0x7f396c19f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:27.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.220+0000 7f396a59c640 1 -- 172.21.15.2:0/3607177070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f396c1037c0 msgr2=0x7f396c19f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:27.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.220+0000 7f396a59c640 1 --2- 172.21.15.2:0/3607177070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f396c1037c0 0x7f396c19f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:27.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.220+0000 7f396a59c640 1 -- 172.21.15.2:0/3607177070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f396c102e00 msgr2=0x7f396c198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:27.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.220+0000 7f396a59c640 1 --2- 172.21.15.2:0/3607177070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f396c102e00 0x7f396c198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:27.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.220+0000 7f396a59c640 1 -- 172.21.15.2:0/3607177070 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f396c19fa00 con 0x7f396c101c00 2024-09-19T06:14:27.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.220+0000 7f396ad9d640 1 --2- 172.21.15.2:0/3607177070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f396c1037c0 0x7f396c19f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:14:27.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.220+0000 7f396a59c640 1 --2- 172.21.15.2:0/3607177070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f396c101c00 0x7f396c197dd0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f39540314e0 tx=0x7f39540042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:27.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.220+0000 7f39637fe640 1 -- 172.21.15.2:0/3607177070 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395403f030 con 0x7f396c101c00 2024-09-19T06:14:27.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.220+0000 7f39637fe640 1 -- 172.21.15.2:0/3607177070 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3954003cb0 con 0x7f396c101c00 2024-09-19T06:14:27.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.220+0000 7f3970b2e640 1 -- 172.21.15.2:0/3607177070 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f396c19fc90 con 0x7f396c101c00 2024-09-19T06:14:27.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.220+0000 7f39637fe640 1 -- 172.21.15.2:0/3607177070 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3954035070 con 0x7f396c101c00 2024-09-19T06:14:27.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.220+0000 7f3970b2e640 1 -- 172.21.15.2:0/3607177070 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f396c1a0170 con 0x7f396c101c00 2024-09-19T06:14:27.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.222+0000 7f3970b2e640 1 -- 172.21.15.2:0/3607177070 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f396c109020 con 0x7f396c101c00 2024-09-19T06:14:27.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.223+0000 7f39637fe640 1 -- 172.21.15.2:0/3607177070 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f3954042030 con 0x7f396c101c00 2024-09-19T06:14:27.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.224+0000 7f39637fe640 1 --2- 172.21.15.2:0/3607177070 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f39580a3300 0x7f39580a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:27.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.224+0000 7f3969d9b640 1 --2- 172.21.15.2:0/3607177070 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f39580a3300 0x7f39580a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:27.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.224+0000 7f39637fe640 1 -- 172.21.15.2:0/3607177070 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f39540effc0 con 0x7f396c101c00 2024-09-19T06:14:27.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.224+0000 7f3969d9b640 1 --2- 172.21.15.2:0/3607177070 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f39580a3300 0x7f39580a57c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f396c1992f0 tx=0x7f395c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:27.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.227+0000 7f39637fe640 1 -- 172.21.15.2:0/3607177070 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f39540bcc30 con 0x7f396c101c00 2024-09-19T06:14:27.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:26 smithi090 ceph-mon[34497]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:14:27.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:26 smithi089 ceph-mon[34160]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:14:27.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.407+0000 7f3970b2e640 1 -- 172.21.15.2:0/3607177070 --> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f396c062630 con 0x7f39580a3300 2024-09-19T06:14:27.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.409+0000 7f39637fe640 1 -- 172.21.15.2:0/3607177070 <== mgr.14150 v2:172.21.15.2:6800/4180340554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+187 (secure 0 0 0) 0x7f396c062630 con 0x7f39580a3300 2024-09-19T06:14:27.411 INFO:teuthology.orchestra.run.smithi002.stdout:HOST ADDR LABELS STATUS 2024-09-19T06:14:27.411 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002 172.21.15.2 2024-09-19T06:14:27.411 INFO:teuthology.orchestra.run.smithi002.stdout:smithi089 172.21.15.89 2024-09-19T06:14:27.411 INFO:teuthology.orchestra.run.smithi002.stdout:smithi090 172.21.15.90 2024-09-19T06:14:27.411 INFO:teuthology.orchestra.run.smithi002.stdout:3 hosts in cluster 2024-09-19T06:14:27.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.412+0000 7f3970b2e640 1 -- 172.21.15.2:0/3607177070 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f39580a3300 msgr2=0x7f39580a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:27.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.412+0000 7f3970b2e640 1 --2- 172.21.15.2:0/3607177070 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f39580a3300 0x7f39580a57c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f396c1992f0 tx=0x7f395c00b390 comp rx=0 tx=0).stop 2024-09-19T06:14:27.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.412+0000 7f3970b2e640 1 -- 172.21.15.2:0/3607177070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f396c101c00 msgr2=0x7f396c197dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:27.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.412+0000 7f3970b2e640 1 --2- 172.21.15.2:0/3607177070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f396c101c00 0x7f396c197dd0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f39540314e0 tx=0x7f39540042e0 comp rx=0 tx=0).stop 2024-09-19T06:14:27.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.412+0000 7f3970b2e640 1 -- 172.21.15.2:0/3607177070 shutdown_connections 2024-09-19T06:14:27.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.412+0000 7f3970b2e640 1 --2- 172.21.15.2:0/3607177070 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f39580a3300 0x7f39580a57c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:27.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.412+0000 7f3970b2e640 1 --2- 172.21.15.2:0/3607177070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f396c1037c0 0x7f396c19f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:27.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.412+0000 7f3970b2e640 1 --2- 172.21.15.2:0/3607177070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f396c102e00 0x7f396c198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:27.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.412+0000 7f3970b2e640 1 --2- 172.21.15.2:0/3607177070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f396c101c00 0x7f396c197dd0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:27.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.412+0000 7f3970b2e640 1 -- 172.21.15.2:0/3607177070 >> 172.21.15.2:0/3607177070 conn(0x7f396c0fd390 msgr2=0x7f396c1061f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:27.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.412+0000 7f3970b2e640 1 -- 172.21.15.2:0/3607177070 shutdown_connections 2024-09-19T06:14:27.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:27.412+0000 7f3970b2e640 1 -- 172.21.15.2:0/3607177070 wait complete. 2024-09-19T06:14:28.053 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-19T06:14:28.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:27 smithi002 ceph-mon[30982]: pgmap v318: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T06:14:28.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:27 smithi090 ceph-mon[34497]: pgmap v318: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T06:14:28.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:27 smithi089 ceph-mon[34160]: pgmap v318: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T06:14:28.311 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:28.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.766+0000 7f5988eba640 1 -- 172.21.15.2:0/1815617729 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59841037c0 msgr2=0x7f598410a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:28.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.766+0000 7f5988eba640 1 --2- 172.21.15.2:0/1815617729 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59841037c0 0x7f598410a050 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f597c009ca0 tx=0x7f597c02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:14:28.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.766+0000 7f5988eba640 1 -- 172.21.15.2:0/1815617729 shutdown_connections 2024-09-19T06:14:28.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.766+0000 7f5988eba640 1 --2- 172.21.15.2:0/1815617729 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59841037c0 0x7f598410a050 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:28.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.766+0000 7f5988eba640 1 --2- 172.21.15.2:0/1815617729 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5984102e00 0x7f5984103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:28.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.766+0000 7f5988eba640 1 --2- 172.21.15.2:0/1815617729 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5984101c00 0x7f5984102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:28.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.766+0000 7f5988eba640 1 -- 172.21.15.2:0/1815617729 >> 172.21.15.2:0/1815617729 conn(0x7f59840fd390 msgr2=0x7f59840ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:28.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.766+0000 7f5988eba640 1 -- 172.21.15.2:0/1815617729 shutdown_connections 2024-09-19T06:14:28.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.766+0000 7f5988eba640 1 -- 172.21.15.2:0/1815617729 wait complete. 2024-09-19T06:14:28.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.767+0000 7f5988eba640 1 Processor -- start 2024-09-19T06:14:28.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.767+0000 7f5988eba640 1 -- start start 2024-09-19T06:14:28.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.767+0000 7f5988eba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5984101c00 0x7f5984075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:28.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.767+0000 7f5988eba640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5984102e00 0x7f59840745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:28.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.767+0000 7f5988eba640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59841037c0 0x7f5984074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:28.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.767+0000 7f5988eba640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f598410d710 con 0x7f5984101c00 2024-09-19T06:14:28.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.767+0000 7f5988eba640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f598410d590 con 0x7f59841037c0 2024-09-19T06:14:28.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.767+0000 7f5988eba640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f598410d890 con 0x7f5984102e00 2024-09-19T06:14:28.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.767+0000 7f598259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5984101c00 0x7f5984075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:28.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.767+0000 7f598259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5984101c00 0x7f5984075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50696/0 (socket says 172.21.15.2:50696) 2024-09-19T06:14:28.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.767+0000 7f598259c640 1 -- 172.21.15.2:0/3372467576 learned_addr learned my addr 172.21.15.2:0/3372467576 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:28.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.767+0000 7f5981d9b640 1 --2- 172.21.15.2:0/3372467576 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5984102e00 0x7f59840745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:28.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.767+0000 7f5982d9d640 1 --2- 172.21.15.2:0/3372467576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59841037c0 0x7f5984074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:28.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.768+0000 7f598259c640 1 -- 172.21.15.2:0/3372467576 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5984102e00 msgr2=0x7f59840745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:28.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.768+0000 7f598259c640 1 --2- 172.21.15.2:0/3372467576 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5984102e00 0x7f59840745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:28.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.768+0000 7f598259c640 1 -- 172.21.15.2:0/3372467576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59841037c0 msgr2=0x7f5984074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:28.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.768+0000 7f598259c640 1 --2- 172.21.15.2:0/3372467576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59841037c0 0x7f5984074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:28.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.768+0000 7f598259c640 1 -- 172.21.15.2:0/3372467576 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59840753e0 con 0x7f5984101c00 2024-09-19T06:14:28.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.768+0000 7f598259c640 1 --2- 172.21.15.2:0/3372467576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5984101c00 0x7f5984075f90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f597400d950 tx=0x7f597400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:28.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.768+0000 7f597b7fe640 1 -- 172.21.15.2:0/3372467576 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5974017020 con 0x7f5984101c00 2024-09-19T06:14:28.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.768+0000 7f597b7fe640 1 -- 172.21.15.2:0/3372467576 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5974009c30 con 0x7f5984101c00 2024-09-19T06:14:28.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.768+0000 7f5988eba640 1 -- 172.21.15.2:0/3372467576 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59841a1f40 con 0x7f5984101c00 2024-09-19T06:14:28.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.768+0000 7f597b7fe640 1 -- 172.21.15.2:0/3372467576 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f597400f6b0 con 0x7f5984101c00 2024-09-19T06:14:28.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.768+0000 7f5988eba640 1 -- 172.21.15.2:0/3372467576 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59841a2330 con 0x7f5984101c00 2024-09-19T06:14:28.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.769+0000 7f5988eba640 1 -- 172.21.15.2:0/3372467576 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5984109000 con 0x7f5984101c00 2024-09-19T06:14:28.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.770+0000 7f597b7fe640 1 -- 172.21.15.2:0/3372467576 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f597401a020 con 0x7f5984101c00 2024-09-19T06:14:28.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.771+0000 7f597b7fe640 1 --2- 172.21.15.2:0/3372467576 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f59700a32d0 0x7f59700a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:28.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.771+0000 7f5981d9b640 1 --2- 172.21.15.2:0/3372467576 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f59700a32d0 0x7f59700a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:28.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.771+0000 7f597b7fe640 1 -- 172.21.15.2:0/3372467576 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f59740cf6f0 con 0x7f5984101c00 2024-09-19T06:14:28.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.771+0000 7f5981d9b640 1 --2- 172.21.15.2:0/3372467576 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f59700a32d0 0x7f59700a5790 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5984075d10 tx=0x7f596c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:28.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.775+0000 7f597b7fe640 1 -- 172.21.15.2:0/3372467576 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5974009de0 con 0x7f5984101c00 2024-09-19T06:14:28.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.963+0000 7f5988eba640 1 -- 172.21.15.2:0/3372467576 --> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f5984062630 con 0x7f59700a32d0 2024-09-19T06:14:28.965 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:28 smithi002 ceph-mon[30982]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:14:28.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.964+0000 7f597b7fe640 1 -- 172.21.15.2:0/3372467576 <== mgr.14150 v2:172.21.15.2:6800/4180340554 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f5984062630 con 0x7f59700a32d0 2024-09-19T06:14:28.966 INFO:teuthology.orchestra.run.smithi002.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-19T06:14:28.966 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300EV480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-19T06:14:28.966 INFO:teuthology.orchestra.run.smithi002.stdout:smithi089 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62040126400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-19T06:14:28.966 INFO:teuthology.orchestra.run.smithi002.stdout:smithi090 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400UK400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-19T06:14:28.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.967+0000 7f5988eba640 1 -- 172.21.15.2:0/3372467576 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f59700a32d0 msgr2=0x7f59700a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:28.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.967+0000 7f5988eba640 1 --2- 172.21.15.2:0/3372467576 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f59700a32d0 0x7f59700a5790 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5984075d10 tx=0x7f596c00b390 comp rx=0 tx=0).stop 2024-09-19T06:14:28.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.967+0000 7f5988eba640 1 -- 172.21.15.2:0/3372467576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5984101c00 msgr2=0x7f5984075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:28.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.967+0000 7f5988eba640 1 --2- 172.21.15.2:0/3372467576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5984101c00 0x7f5984075f90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f597400d950 tx=0x7f597400de10 comp rx=0 tx=0).stop 2024-09-19T06:14:28.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.967+0000 7f5988eba640 1 -- 172.21.15.2:0/3372467576 shutdown_connections 2024-09-19T06:14:28.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.967+0000 7f5988eba640 1 --2- 172.21.15.2:0/3372467576 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f59700a32d0 0x7f59700a5790 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:28.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.967+0000 7f5988eba640 1 --2- 172.21.15.2:0/3372467576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59841037c0 0x7f5984074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:28.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.967+0000 7f5988eba640 1 --2- 172.21.15.2:0/3372467576 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5984102e00 0x7f59840745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:28.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.967+0000 7f5988eba640 1 --2- 172.21.15.2:0/3372467576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5984101c00 0x7f5984075f90 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:28.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.967+0000 7f5988eba640 1 -- 172.21.15.2:0/3372467576 >> 172.21.15.2:0/3372467576 conn(0x7f59840fd390 msgr2=0x7f59841061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:28.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.967+0000 7f5988eba640 1 -- 172.21.15.2:0/3372467576 shutdown_connections 2024-09-19T06:14:28.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:28.967+0000 7f5988eba640 1 -- 172.21.15.2:0/3372467576 wait complete. 2024-09-19T06:14:29.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:28 smithi090 ceph-mon[34497]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:14:29.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:28 smithi089 ceph-mon[34160]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:14:29.509 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T06:14:29.517 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-19T06:14:29.517 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-19T06:14:29.773 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:30.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.187+0000 7f93b0f2c640 1 -- 172.21.15.2:0/1942613825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93ac107960 msgr2=0x7f93ac109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:30.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.187+0000 7f93b0f2c640 1 --2- 172.21.15.2:0/1942613825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93ac107960 0x7f93ac109d50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f93a4009ca0 tx=0x7f93a402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:14:30.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.187+0000 7f93b0f2c640 1 -- 172.21.15.2:0/1942613825 shutdown_connections 2024-09-19T06:14:30.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.187+0000 7f93b0f2c640 1 --2- 172.21.15.2:0/1942613825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93ac107960 0x7f93ac109d50 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:30.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.187+0000 7f93b0f2c640 1 --2- 172.21.15.2:0/1942613825 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93ac105030 0x7f93ac107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:30.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.187+0000 7f93b0f2c640 1 --2- 172.21.15.2:0/1942613825 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93ac102700 0x7f93ac104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:30.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.188+0000 7f93b0f2c640 1 -- 172.21.15.2:0/1942613825 >> 172.21.15.2:0/1942613825 conn(0x7f93ac0fc280 msgr2=0x7f93ac0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:30.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.188+0000 7f93b0f2c640 1 -- 172.21.15.2:0/1942613825 shutdown_connections 2024-09-19T06:14:30.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.188+0000 7f93b0f2c640 1 -- 172.21.15.2:0/1942613825 wait complete. 2024-09-19T06:14:30.193 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:29 smithi002 ceph-mon[30982]: pgmap v319: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:30.193 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:29 smithi002 ceph-mon[30982]: from='client.15036 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:14:30.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.188+0000 7f93b0f2c640 1 Processor -- start 2024-09-19T06:14:30.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.188+0000 7f93b0f2c640 1 -- start start 2024-09-19T06:14:30.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.189+0000 7f93b0f2c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93ac102700 0x7f93ac197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:30.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.189+0000 7f93b0f2c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93ac105030 0x7f93ac198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:30.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.189+0000 7f93b0f2c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93ac107960 0x7f93ac19f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:30.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.189+0000 7f93b0f2c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f93ac10d790 con 0x7f93ac107960 2024-09-19T06:14:30.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.189+0000 7f93b0f2c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f93ac10d610 con 0x7f93ac102700 2024-09-19T06:14:30.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.189+0000 7f93b0f2c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f93ac10d910 con 0x7f93ac105030 2024-09-19T06:14:30.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.189+0000 7f93aad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93ac107960 0x7f93ac19f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:30.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.189+0000 7f93aa59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93ac102700 0x7f93ac197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:30.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.189+0000 7f93aad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93ac107960 0x7f93ac19f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50726/0 (socket says 172.21.15.2:50726) 2024-09-19T06:14:30.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.189+0000 7f93aad9d640 1 -- 172.21.15.2:0/1349565169 learned_addr learned my addr 172.21.15.2:0/1349565169 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:30.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.189+0000 7f93a9d9b640 1 --2- 172.21.15.2:0/1349565169 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93ac105030 0x7f93ac198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:30.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.189+0000 7f93aa59c640 1 -- 172.21.15.2:0/1349565169 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93ac105030 msgr2=0x7f93ac198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:30.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.189+0000 7f93aa59c640 1 --2- 172.21.15.2:0/1349565169 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93ac105030 0x7f93ac198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:30.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.189+0000 7f93aa59c640 1 -- 172.21.15.2:0/1349565169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93ac107960 msgr2=0x7f93ac19f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:30.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.189+0000 7f93aa59c640 1 --2- 172.21.15.2:0/1349565169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93ac107960 0x7f93ac19f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:30.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.189+0000 7f93aa59c640 1 -- 172.21.15.2:0/1349565169 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93ac19f9f0 con 0x7f93ac102700 2024-09-19T06:14:30.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.189+0000 7f93aad9d640 1 --2- 172.21.15.2:0/1349565169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93ac107960 0x7f93ac19f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:30.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.189+0000 7f93aa59c640 1 --2- 172.21.15.2:0/1349565169 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93ac102700 0x7f93ac197dc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f939c00b3f0 tx=0x7f939c00b7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:30.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.190+0000 7f939b7fe640 1 -- 172.21.15.2:0/1349565169 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f939c015020 con 0x7f93ac102700 2024-09-19T06:14:30.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.190+0000 7f93b0f2c640 1 -- 172.21.15.2:0/1349565169 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93ac19fce0 con 0x7f93ac102700 2024-09-19T06:14:30.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.190+0000 7f939b7fe640 1 -- 172.21.15.2:0/1349565169 <== mon.2 v2:172.21.15.89:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f939c011ce0 con 0x7f93ac102700 2024-09-19T06:14:30.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.190+0000 7f939b7fe640 1 -- 172.21.15.2:0/1349565169 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f939c010d30 con 0x7f93ac102700 2024-09-19T06:14:30.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.190+0000 7f93b0f2c640 1 -- 172.21.15.2:0/1349565169 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93ac1a0170 con 0x7f93ac102700 2024-09-19T06:14:30.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.191+0000 7f93b0f2c640 1 -- 172.21.15.2:0/1349565169 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93ac0fdd70 con 0x7f93ac102700 2024-09-19T06:14:30.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.192+0000 7f939b7fe640 1 -- 172.21.15.2:0/1349565169 <== mon.2 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f939c018020 con 0x7f93ac102700 2024-09-19T06:14:30.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.193+0000 7f939b7fe640 1 --2- 172.21.15.2:0/1349565169 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f93940a3300 0x7f93940a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:30.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.193+0000 7f93a9d9b640 1 --2- 172.21.15.2:0/1349565169 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f93940a3300 0x7f93940a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:30.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.193+0000 7f939b7fe640 1 -- 172.21.15.2:0/1349565169 <== mon.2 v2:172.21.15.89:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f939c0cf720 con 0x7f93ac102700 2024-09-19T06:14:30.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.194+0000 7f93a9d9b640 1 --2- 172.21.15.2:0/1349565169 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f93940a3300 0x7f93940a57c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f93ac1992e0 tx=0x7f93a000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:30.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.196+0000 7f939b7fe640 1 -- 172.21.15.2:0/1349565169 <== mon.2 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f939c01f020 con 0x7f93ac102700 2024-09-19T06:14:30.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:29 smithi090 ceph-mon[34497]: pgmap v319: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:30.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:29 smithi090 ceph-mon[34497]: from='client.15036 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:14:30.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:29 smithi089 ceph-mon[34160]: pgmap v319: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:30.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:29 smithi089 ceph-mon[34160]: from='client.15036 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:14:30.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.406+0000 7f93b0f2c640 1 -- 172.21.15.2:0/1349565169 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f93ac02d7c0 con 0x7f93ac102700 2024-09-19T06:14:30.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.407+0000 7f939b7fe640 1 -- 172.21.15.2:0/1349565169 <== mon.2 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+3067 (secure 0 0 0) 0x7f939c09c3a0 con 0x7f93ac102700 2024-09-19T06:14:30.410 INFO:teuthology.orchestra.run.smithi002.stdout:e25 2024-09-19T06:14:30.410 INFO:teuthology.orchestra.run.smithi002.stdout:btime 2024-09-19T06:13:17:867959+0000 2024-09-19T06:14:30.410 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:14:30.410 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T06:14:30.410 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2024-09-19T06:14:30.410 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:14:30.411 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2024-09-19T06:14:30.411 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2024-09-19T06:14:30.411 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 25 2024-09-19T06:14:30.411 INFO:teuthology.orchestra.run.smithi002.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T06:14:30.411 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-19T06:13:04.348577+0000 2024-09-19T06:14:30.411 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-09-19T06:13:17.867946+0000 2024-09-19T06:14:30.411 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2024-09-19T06:14:30.411 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2024-09-19T06:14:30.411 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 300 2024-09-19T06:14:30.411 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2024-09-19T06:14:30.411 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2024-09-19T06:14:30.412 INFO:teuthology.orchestra.run.smithi002.stdout:max_xattr_size 65536 2024-09-19T06:14:30.412 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2024-09-19T06:14:30.412 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2024-09-19T06:14:30.412 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 0 2024-09-19T06:14:30.412 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T06:14:30.412 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 3 2024-09-19T06:14:30.412 INFO:teuthology.orchestra.run.smithi002.stdout:in 0,1,2 2024-09-19T06:14:30.412 INFO:teuthology.orchestra.run.smithi002.stdout:up {0=24497,1=24472,2=24470} 2024-09-19T06:14:30.412 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2024-09-19T06:14:30.412 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2024-09-19T06:14:30.412 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2024-09-19T06:14:30.412 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2024-09-19T06:14:30.413 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2024-09-19T06:14:30.413 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data disabled 2024-09-19T06:14:30.413 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2024-09-19T06:14:30.413 INFO:teuthology.orchestra.run.smithi002.stdout:bal_rank_mask -1 2024-09-19T06:14:30.413 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 0 2024-09-19T06:14:30.413 INFO:teuthology.orchestra.run.smithi002.stdout:qdb_cluster leader: 24497 members: 24497,24472,24470 2024-09-19T06:14:30.413 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.b{0:24497} state up:active seq 4 addr [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:14:30.413 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.c{0:24460} state up:standby-replay seq 1 addr [v2:172.21.15.90:6836/2402014616,v1:172.21.15.90:6837/2402014616] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:14:30.413 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.i{1:24472} state up:active seq 8 addr [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:14:30.413 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.e{1:24449} state up:standby-replay seq 1 addr [v2:172.21.15.89:6834/56684343,v1:172.21.15.89:6835/56684343] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:14:30.413 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.h{2:24470} state up:active seq 11 addr [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:14:30.413 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.f{2:24448} state up:standby-replay seq 1 addr [v2:172.21.15.90:6834/1607170353,v1:172.21.15.90:6835/1607170353] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:14:30.414 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:14:30.414 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:14:30.414 INFO:teuthology.orchestra.run.smithi002.stdout:Standby daemons: 2024-09-19T06:14:30.414 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:14:30.414 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.j{-1:14529} state up:standby seq 1 addr [v2:172.21.15.2:6834/528892925,v1:172.21.15.2:6835/528892925] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:14:30.414 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.d{-1:14541} state up:standby seq 1 addr [v2:172.21.15.2:6836/2791215527,v1:172.21.15.2:6837/2791215527] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:14:30.414 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.g{-1:14592} state up:standby seq 1 addr [v2:172.21.15.2:6838/3747228076,v1:172.21.15.2:6839/3747228076] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:14:30.414 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.a{-1:14604} state up:standby seq 1 addr [v2:172.21.15.2:6840/3902749142,v1:172.21.15.2:6841/3902749142] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:14:30.414 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.k{-1:24419} state up:standby seq 1 addr [v2:172.21.15.89:6832/2529057952,v1:172.21.15.89:6833/2529057952] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:14:30.414 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.l{-1:24421} state up:standby seq 1 addr [v2:172.21.15.90:6832/3201908791,v1:172.21.15.90:6833/3201908791] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:14:30.416 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 25 2024-09-19T06:14:30.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.409+0000 7f93b0f2c640 1 -- 172.21.15.2:0/1349565169 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f93940a3300 msgr2=0x7f93940a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:30.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.409+0000 7f93b0f2c640 1 --2- 172.21.15.2:0/1349565169 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f93940a3300 0x7f93940a57c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f93ac1992e0 tx=0x7f93a000a2d0 comp rx=0 tx=0).stop 2024-09-19T06:14:30.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.409+0000 7f93b0f2c640 1 -- 172.21.15.2:0/1349565169 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93ac102700 msgr2=0x7f93ac197dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:30.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.409+0000 7f93b0f2c640 1 --2- 172.21.15.2:0/1349565169 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93ac102700 0x7f93ac197dc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f939c00b3f0 tx=0x7f939c00b7f0 comp rx=0 tx=0).stop 2024-09-19T06:14:30.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.409+0000 7f93b0f2c640 1 -- 172.21.15.2:0/1349565169 shutdown_connections 2024-09-19T06:14:30.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.409+0000 7f93b0f2c640 1 --2- 172.21.15.2:0/1349565169 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f93940a3300 0x7f93940a57c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:30.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.409+0000 7f93b0f2c640 1 --2- 172.21.15.2:0/1349565169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93ac107960 0x7f93ac19f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:30.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.409+0000 7f93b0f2c640 1 --2- 172.21.15.2:0/1349565169 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93ac105030 0x7f93ac198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:30.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.409+0000 7f93b0f2c640 1 --2- 172.21.15.2:0/1349565169 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93ac102700 0x7f93ac197dc0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:30.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.409+0000 7f93b0f2c640 1 -- 172.21.15.2:0/1349565169 >> 172.21.15.2:0/1349565169 conn(0x7f93ac0fc280 msgr2=0x7f93ac102fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:30.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.409+0000 7f93b0f2c640 1 -- 172.21.15.2:0/1349565169 shutdown_connections 2024-09-19T06:14:30.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:30.409+0000 7f93b0f2c640 1 -- 172.21.15.2:0/1349565169 wait complete. 2024-09-19T06:14:31.109 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-19T06:14:31.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:30 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1349565169' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:14:31.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:30 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1349565169' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:14:31.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:30 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1349565169' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:14:31.366 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:31.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:31.822+0000 7fc3a4089640 1 -- 172.21.15.2:0/2893775901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc39c102e00 msgr2=0x7fc39c103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:31.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:31.822+0000 7fc3a4089640 1 --2- 172.21.15.2:0/2893775901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc39c102e00 0x7fc39c103280 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc38c009900 tx=0x7fc38c02a410 comp rx=0 tx=0).stop 2024-09-19T06:14:31.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:31.822+0000 7fc3a4089640 1 -- 172.21.15.2:0/2893775901 shutdown_connections 2024-09-19T06:14:31.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:31.822+0000 7fc3a4089640 1 --2- 172.21.15.2:0/2893775901 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc39c1037c0 0x7fc39c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:31.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:31.822+0000 7fc3a4089640 1 --2- 172.21.15.2:0/2893775901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc39c102e00 0x7fc39c103280 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:31.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:31.822+0000 7fc3a4089640 1 --2- 172.21.15.2:0/2893775901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc39c101c00 0x7fc39c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:31.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:31.822+0000 7fc3a4089640 1 -- 172.21.15.2:0/2893775901 >> 172.21.15.2:0/2893775901 conn(0x7fc39c0fd390 msgr2=0x7fc39c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:31.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:31.822+0000 7fc3a4089640 1 -- 172.21.15.2:0/2893775901 shutdown_connections 2024-09-19T06:14:31.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:31.822+0000 7fc3a4089640 1 -- 172.21.15.2:0/2893775901 wait complete. 2024-09-19T06:14:31.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:31.823+0000 7fc3a4089640 1 Processor -- start 2024-09-19T06:14:31.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:31.823+0000 7fc3a4089640 1 -- start start 2024-09-19T06:14:31.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:31.823+0000 7fc3a4089640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc39c101c00 0x7fc39c197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:31.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:31.823+0000 7fc3a4089640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc39c102e00 0x7fc39c1983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:31.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:31.823+0000 7fc3a4089640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc39c1037c0 0x7fc39c19f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:31.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:31.823+0000 7fc3a4089640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc39c10d7e0 con 0x7fc39c101c00 2024-09-19T06:14:31.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:31.823+0000 7fc3a4089640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc39c10d660 con 0x7fc39c102e00 2024-09-19T06:14:31.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:31.823+0000 7fc3a4089640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc39c10d960 con 0x7fc39c1037c0 2024-09-19T06:14:31.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:31.823+0000 7fc3a1e25640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc39c101c00 0x7fc39c197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:31.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:31.823+0000 7fc3a1e25640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc39c101c00 0x7fc39c197e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50746/0 (socket says 172.21.15.2:50746) 2024-09-19T06:14:31.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:31.823+0000 7fc3a1e25640 1 -- 172.21.15.2:0/2866057331 learned_addr learned my addr 172.21.15.2:0/2866057331 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:31.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:31.823+0000 7fc3a2626640 1 --2- 172.21.15.2:0/2866057331 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc39c1037c0 0x7fc39c19f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:31.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:31.823+0000 7fc3a1624640 1 --2- 172.21.15.2:0/2866057331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc39c102e00 0x7fc39c1983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:31.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:31.823+0000 7fc3a1e25640 1 -- 172.21.15.2:0/2866057331 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc39c1037c0 msgr2=0x7fc39c19f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:31.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:31.823+0000 7fc3a1e25640 1 --2- 172.21.15.2:0/2866057331 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc39c1037c0 0x7fc39c19f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:31.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:31.823+0000 7fc3a1e25640 1 -- 172.21.15.2:0/2866057331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc39c102e00 msgr2=0x7fc39c1983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:31.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:31.823+0000 7fc3a1e25640 1 --2- 172.21.15.2:0/2866057331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc39c102e00 0x7fc39c1983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:31.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:31.823+0000 7fc3a1e25640 1 -- 172.21.15.2:0/2866057331 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc39c19faa0 con 0x7fc39c101c00 2024-09-19T06:14:31.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:31.823+0000 7fc3a1624640 1 --2- 172.21.15.2:0/2866057331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc39c102e00 0x7fc39c1983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:14:31.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:31.824+0000 7fc3a1e25640 1 --2- 172.21.15.2:0/2866057331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc39c101c00 0x7fc39c197e70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc39800b450 tx=0x7fc39800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:31.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:31.824+0000 7fc392ffd640 1 -- 172.21.15.2:0/2866057331 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc398015020 con 0x7fc39c101c00 2024-09-19T06:14:31.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:31.824+0000 7fc392ffd640 1 -- 172.21.15.2:0/2866057331 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc398011d40 con 0x7fc39c101c00 2024-09-19T06:14:31.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:31.824+0000 7fc3a4089640 1 -- 172.21.15.2:0/2866057331 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc39c19fd90 con 0x7fc39c101c00 2024-09-19T06:14:31.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:31.824+0000 7fc392ffd640 1 -- 172.21.15.2:0/2866057331 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39800f340 con 0x7fc39c101c00 2024-09-19T06:14:31.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:31.824+0000 7fc3a4089640 1 -- 172.21.15.2:0/2866057331 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc39c1a0290 con 0x7fc39c101c00 2024-09-19T06:14:31.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:31.825+0000 7fc3a4089640 1 -- 172.21.15.2:0/2866057331 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc39c109050 con 0x7fc39c101c00 2024-09-19T06:14:31.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:31.826+0000 7fc392ffd640 1 -- 172.21.15.2:0/2866057331 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fc398018020 con 0x7fc39c101c00 2024-09-19T06:14:31.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:31.827+0000 7fc392ffd640 1 --2- 172.21.15.2:0/2866057331 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fc3880a3300 0x7fc3880a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:31.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:31.827+0000 7fc3a1624640 1 --2- 172.21.15.2:0/2866057331 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fc3880a3300 0x7fc3880a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:31.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:31.827+0000 7fc392ffd640 1 -- 172.21.15.2:0/2866057331 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7fc3980cf3d0 con 0x7fc39c101c00 2024-09-19T06:14:31.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:31.827+0000 7fc3a1624640 1 --2- 172.21.15.2:0/2866057331 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fc3880a3300 0x7fc3880a57c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc39c199390 tx=0x7fc38c032d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:31.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:31.831+0000 7fc392ffd640 1 -- 172.21.15.2:0/2866057331 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc39801f020 con 0x7fc39c101c00 2024-09-19T06:14:32.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:32.008+0000 7fc3a4089640 1 -- 172.21.15.2:0/2866057331 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fc39c02d7c0 con 0x7fc39c101c00 2024-09-19T06:14:32.011 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:31 smithi002 ceph-mon[30982]: pgmap v320: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:14:32.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:32.009+0000 7fc392ffd640 1 -- 172.21.15.2:0/2866057331 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v81) ==== 56+0+5226 (secure 0 0 0) 0x7fc39800d040 con 0x7fc39c101c00 2024-09-19T06:14:32.012 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 81 2024-09-19T06:14:32.012 INFO:teuthology.orchestra.run.smithi002.stdout:fsid 078f6612-764d-11ef-bceb-c7b262605968 2024-09-19T06:14:32.012 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-19T06:05:17.607927+0000 2024-09-19T06:14:32.012 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-09-19T06:13:13.827600+0000 2024-09-19T06:14:32.012 INFO:teuthology.orchestra.run.smithi002.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-19T06:14:32.013 INFO:teuthology.orchestra.run.smithi002.stdout:crush_version 26 2024-09-19T06:14:32.013 INFO:teuthology.orchestra.run.smithi002.stdout:full_ratio 0.95 2024-09-19T06:14:32.013 INFO:teuthology.orchestra.run.smithi002.stdout:backfillfull_ratio 0.9 2024-09-19T06:14:32.013 INFO:teuthology.orchestra.run.smithi002.stdout:nearfull_ratio 0.85 2024-09-19T06:14:32.013 INFO:teuthology.orchestra.run.smithi002.stdout:require_min_compat_client luminous 2024-09-19T06:14:32.013 INFO:teuthology.orchestra.run.smithi002.stdout:min_compat_client luminous 2024-09-19T06:14:32.013 INFO:teuthology.orchestra.run.smithi002.stdout:require_osd_release squid 2024-09-19T06:14:32.013 INFO:teuthology.orchestra.run.smithi002.stdout:stretch_mode_enabled false 2024-09-19T06:14:32.013 INFO:teuthology.orchestra.run.smithi002.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 20 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-19T06:14:32.013 INFO:teuthology.orchestra.run.smithi002.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 79 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-19T06:14:32.013 INFO:teuthology.orchestra.run.smithi002.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 79 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-19T06:14:32.013 INFO:teuthology.orchestra.run.smithi002.stdout:max_osd 12 2024-09-19T06:14:32.014 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 up in weight 1 up_from 8 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.2:6802/915165910,v1:172.21.15.2:6803/915165910] [v2:172.21.15.2:6804/915165910,v1:172.21.15.2:6805/915165910] exists,up 0de97a3d-2d27-455b-9998-ddd2319c148d 2024-09-19T06:14:32.014 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 up in weight 1 up_from 13 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.89:6800/4097264171,v1:172.21.15.89:6801/4097264171] [v2:172.21.15.89:6802/4097264171,v1:172.21.15.89:6803/4097264171] exists,up 056d229e-2de4-4902-922e-21e1a5d3f061 2024-09-19T06:14:32.014 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 up in weight 1 up_from 17 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.90:6800/1479908200,v1:172.21.15.90:6801/1479908200] [v2:172.21.15.90:6802/1479908200,v1:172.21.15.90:6803/1479908200] exists,up 2a4e7147-4125-4ee6-b5ad-85518d7066d9 2024-09-19T06:14:32.014 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 up in weight 1 up_from 24 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.2:6810/1796948193,v1:172.21.15.2:6811/1796948193] [v2:172.21.15.2:6812/1796948193,v1:172.21.15.2:6813/1796948193] exists,up 7b3da775-0f0a-4b46-a8dc-9ec822a54301 2024-09-19T06:14:32.014 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 up in weight 1 up_from 31 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.89:6808/4256848315,v1:172.21.15.89:6809/4256848315] [v2:172.21.15.89:6810/4256848315,v1:172.21.15.89:6811/4256848315] exists,up d4c8bafc-c844-4ff1-a3d8-7a53576e6b5d 2024-09-19T06:14:32.014 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 up in weight 1 up_from 36 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.90:6808/189855967,v1:172.21.15.90:6809/189855967] [v2:172.21.15.90:6810/189855967,v1:172.21.15.90:6811/189855967] exists,up 8dc9bb55-29e0-4b04-9415-3b9bb5ed05cb 2024-09-19T06:14:32.014 INFO:teuthology.orchestra.run.smithi002.stdout:osd.6 up in weight 1 up_from 43 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.2:6818/3886336279,v1:172.21.15.2:6819/3886336279] [v2:172.21.15.2:6820/3886336279,v1:172.21.15.2:6821/3886336279] exists,up 86d1443a-9b43-46de-abd7-4c95b43207f5 2024-09-19T06:14:32.014 INFO:teuthology.orchestra.run.smithi002.stdout:osd.7 up in weight 1 up_from 47 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.89:6816/508513510,v1:172.21.15.89:6817/508513510] [v2:172.21.15.89:6818/508513510,v1:172.21.15.89:6819/508513510] exists,up 1cc5554c-80d2-4e77-b29a-fd2ada68d82d 2024-09-19T06:14:32.014 INFO:teuthology.orchestra.run.smithi002.stdout:osd.8 up in weight 1 up_from 54 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.90:6816/3558544480,v1:172.21.15.90:6817/3558544480] [v2:172.21.15.90:6818/3558544480,v1:172.21.15.90:6819/3558544480] exists,up e9b2eb92-9af2-4f26-a259-fcaf972e4fd0 2024-09-19T06:14:32.014 INFO:teuthology.orchestra.run.smithi002.stdout:osd.9 up in weight 1 up_from 61 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.2:6826/2690758100,v1:172.21.15.2:6827/2690758100] [v2:172.21.15.2:6828/2690758100,v1:172.21.15.2:6829/2690758100] exists,up 194d4c64-dd29-4d35-bc54-0858c44815cd 2024-09-19T06:14:32.014 INFO:teuthology.orchestra.run.smithi002.stdout:osd.10 up in weight 1 up_from 66 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.89:6824/1141925395,v1:172.21.15.89:6825/1141925395] [v2:172.21.15.89:6826/1141925395,v1:172.21.15.89:6827/1141925395] exists,up 7695fa4a-b94e-4afc-b166-690a197ad730 2024-09-19T06:14:32.014 INFO:teuthology.orchestra.run.smithi002.stdout:osd.11 up in weight 1 up_from 73 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.90:6824/468380924,v1:172.21.15.90:6825/468380924] [v2:172.21.15.90:6826/468380924,v1:172.21.15.90:6827/468380924] exists,up 1815a999-bfdb-46b9-afcd-632ee8ba56d3 2024-09-19T06:14:32.014 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 2.b [2,1] 2024-09-19T06:14:32.015 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 2.f [8,11] 2024-09-19T06:14:32.015 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 2.1b [2,4] 2024-09-19T06:14:32.015 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 2.1d [8,11] 2024-09-19T06:14:32.015 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.6 [4,6] 2024-09-19T06:14:32.015 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.1d [5,9,4,8] 2024-09-19T06:14:32.015 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.36 [4,9] 2024-09-19T06:14:32.015 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.38 [3,9] 2024-09-19T06:14:32.015 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/874985787 expires 2024-09-20T06:06:11.912585+0000 2024-09-19T06:14:32.015 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/1280963020 expires 2024-09-20T06:06:11.912585+0000 2024-09-19T06:14:32.015 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/2976372536 expires 2024-09-20T06:06:11.912585+0000 2024-09-19T06:14:32.015 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:6801/1602650352 expires 2024-09-20T06:05:47.538477+0000 2024-09-19T06:14:32.015 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:6800/1602650352 expires 2024-09-20T06:05:47.538477+0000 2024-09-19T06:14:32.015 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:6800/1200011821 expires 2024-09-20T06:06:11.912585+0000 2024-09-19T06:14:32.016 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/3899165140 expires 2024-09-20T06:05:47.538477+0000 2024-09-19T06:14:32.016 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:6801/1200011821 expires 2024-09-20T06:06:11.912585+0000 2024-09-19T06:14:32.016 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/1361067708 expires 2024-09-20T06:05:47.538477+0000 2024-09-19T06:14:32.016 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/3763089457 expires 2024-09-20T06:05:47.538477+0000 2024-09-19T06:14:32.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:32.011+0000 7fc3a4089640 1 -- 172.21.15.2:0/2866057331 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fc3880a3300 msgr2=0x7fc3880a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:32.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:32.011+0000 7fc3a4089640 1 --2- 172.21.15.2:0/2866057331 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fc3880a3300 0x7fc3880a57c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc39c199390 tx=0x7fc38c032d20 comp rx=0 tx=0).stop 2024-09-19T06:14:32.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:32.011+0000 7fc3a4089640 1 -- 172.21.15.2:0/2866057331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc39c101c00 msgr2=0x7fc39c197e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:32.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:32.011+0000 7fc3a4089640 1 --2- 172.21.15.2:0/2866057331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc39c101c00 0x7fc39c197e70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc39800b450 tx=0x7fc39800b910 comp rx=0 tx=0).stop 2024-09-19T06:14:32.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:32.011+0000 7fc3a4089640 1 -- 172.21.15.2:0/2866057331 shutdown_connections 2024-09-19T06:14:32.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:32.011+0000 7fc3a4089640 1 --2- 172.21.15.2:0/2866057331 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fc3880a3300 0x7fc3880a57c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:32.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:32.011+0000 7fc3a4089640 1 --2- 172.21.15.2:0/2866057331 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc39c1037c0 0x7fc39c19f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:32.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:32.012+0000 7fc3a4089640 1 --2- 172.21.15.2:0/2866057331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc39c102e00 0x7fc39c1983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:32.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:32.012+0000 7fc3a4089640 1 --2- 172.21.15.2:0/2866057331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc39c101c00 0x7fc39c197e70 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:32.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:32.012+0000 7fc3a4089640 1 -- 172.21.15.2:0/2866057331 >> 172.21.15.2:0/2866057331 conn(0x7fc39c0fd390 msgr2=0x7fc39c106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:32.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:32.012+0000 7fc3a4089640 1 -- 172.21.15.2:0/2866057331 shutdown_connections 2024-09-19T06:14:32.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:32.012+0000 7fc3a4089640 1 -- 172.21.15.2:0/2866057331 wait complete. 2024-09-19T06:14:32.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:31 smithi090 ceph-mon[34497]: pgmap v320: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:14:32.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:31 smithi089 ceph-mon[34160]: pgmap v320: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:14:32.677 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-19T06:14:32.688 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:14:32.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:32 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/2866057331' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T06:14:32.984 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:33.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:32 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/2866057331' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T06:14:33.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:32 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/2866057331' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T06:14:33.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.392+0000 7effb5adf640 1 -- 172.21.15.2:0/1971442991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effb0106f10 msgr2=0x7effb010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:33.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.392+0000 7effb5adf640 1 --2- 172.21.15.2:0/1971442991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effb0106f10 0x7effb010ea90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7effa8009ca0 tx=0x7effa802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:14:33.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.392+0000 7effb5adf640 1 -- 172.21.15.2:0/1971442991 shutdown_connections 2024-09-19T06:14:33.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.392+0000 7effb5adf640 1 --2- 172.21.15.2:0/1971442991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effb0106f10 0x7effb010ea90 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:33.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.392+0000 7effb5adf640 1 --2- 172.21.15.2:0/1971442991 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effb0102790 0x7effb01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:33.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.392+0000 7effb5adf640 1 --2- 172.21.15.2:0/1971442991 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effb0101de0 0x7effb01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:33.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.392+0000 7effb5adf640 1 -- 172.21.15.2:0/1971442991 >> 172.21.15.2:0/1971442991 conn(0x7effb00fd8c0 msgr2=0x7effb00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:33.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.392+0000 7effb5adf640 1 -- 172.21.15.2:0/1971442991 shutdown_connections 2024-09-19T06:14:33.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.392+0000 7effb5adf640 1 -- 172.21.15.2:0/1971442991 wait complete. 2024-09-19T06:14:33.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.393+0000 7effb5adf640 1 Processor -- start 2024-09-19T06:14:33.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.393+0000 7effb5adf640 1 -- start start 2024-09-19T06:14:33.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.393+0000 7effb5adf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effb0101de0 0x7effb01982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:33.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.393+0000 7effb5adf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effb0102790 0x7effb01987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:33.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.393+0000 7effb5adf640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effb0106f10 0x7effb019cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:33.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.393+0000 7effb5adf640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7effb0111e20 con 0x7effb0102790 2024-09-19T06:14:33.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.393+0000 7effb5adf640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7effb0111ca0 con 0x7effb0101de0 2024-09-19T06:14:33.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.393+0000 7effb5adf640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7effb0111fa0 con 0x7effb0106f10 2024-09-19T06:14:33.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.394+0000 7effaeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effb0102790 0x7effb01987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:33.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.394+0000 7effaeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effb0102790 0x7effb01987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50762/0 (socket says 172.21.15.2:50762) 2024-09-19T06:14:33.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.394+0000 7effaeffd640 1 -- 172.21.15.2:0/3967780492 learned_addr learned my addr 172.21.15.2:0/3967780492 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:33.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.394+0000 7effaf7fe640 1 --2- 172.21.15.2:0/3967780492 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effb0101de0 0x7effb01982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:33.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.394+0000 7effaffff640 1 --2- 172.21.15.2:0/3967780492 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effb0106f10 0x7effb019cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:33.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.394+0000 7effaeffd640 1 -- 172.21.15.2:0/3967780492 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effb0106f10 msgr2=0x7effb019cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:33.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.394+0000 7effaeffd640 1 --2- 172.21.15.2:0/3967780492 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effb0106f10 0x7effb019cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:33.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.394+0000 7effaeffd640 1 -- 172.21.15.2:0/3967780492 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effb0101de0 msgr2=0x7effb01982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:33.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.394+0000 7effaeffd640 1 --2- 172.21.15.2:0/3967780492 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effb0101de0 0x7effb01982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:33.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.394+0000 7effaeffd640 1 -- 172.21.15.2:0/3967780492 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb019d250 con 0x7effb0102790 2024-09-19T06:14:33.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.394+0000 7effaeffd640 1 --2- 172.21.15.2:0/3967780492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effb0102790 0x7effb01987e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7effa400d770 tx=0x7effa400db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:33.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.394+0000 7effacff9640 1 -- 172.21.15.2:0/3967780492 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa4017070 con 0x7effb0102790 2024-09-19T06:14:33.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.394+0000 7effb5adf640 1 -- 172.21.15.2:0/3967780492 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effb019d540 con 0x7effb0102790 2024-09-19T06:14:33.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.394+0000 7effacff9640 1 -- 172.21.15.2:0/3967780492 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7effa4009820 con 0x7effb0102790 2024-09-19T06:14:33.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.394+0000 7effacff9640 1 -- 172.21.15.2:0/3967780492 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa4004ba0 con 0x7effb0102790 2024-09-19T06:14:33.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.394+0000 7effb5adf640 1 -- 172.21.15.2:0/3967780492 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effb01a4e20 con 0x7effb0102790 2024-09-19T06:14:33.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.395+0000 7effb5adf640 1 -- 172.21.15.2:0/3967780492 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effb01021c0 con 0x7effb0102790 2024-09-19T06:14:33.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.397+0000 7effacff9640 1 -- 172.21.15.2:0/3967780492 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7effa40099d0 con 0x7effb0102790 2024-09-19T06:14:33.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.397+0000 7effacff9640 1 --2- 172.21.15.2:0/3967780492 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7eff980a32d0 0x7eff980a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:33.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.398+0000 7effaf7fe640 1 --2- 172.21.15.2:0/3967780492 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7eff980a32d0 0x7eff980a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:33.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.398+0000 7effacff9640 1 -- 172.21.15.2:0/3967780492 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7effa40cf800 con 0x7effb0102790 2024-09-19T06:14:33.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.398+0000 7effaf7fe640 1 --2- 172.21.15.2:0/3967780492 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7eff980a32d0 0x7eff980a5790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7effa000abe0 tx=0x7effa000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:33.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.401+0000 7effacff9640 1 -- 172.21.15.2:0/3967780492 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7effa409c370 con 0x7effb0102790 2024-09-19T06:14:33.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.611+0000 7effb5adf640 1 -- 172.21.15.2:0/3967780492 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7effb0109b60 con 0x7effb0102790 2024-09-19T06:14:33.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.612+0000 7effacff9640 1 -- 172.21.15.2:0/3967780492 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11882 (secure 0 0 0) 0x7effa409bc70 con 0x7effb0102790 2024-09-19T06:14:33.870 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:14:33.871 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":25,"btime":"2024-09-19T06:13:17:867959+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:13:17.867946+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24472,24470]},"id":1}]} 2024-09-19T06:14:33.873 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 25 2024-09-19T06:14:33.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.614+0000 7effb5adf640 1 -- 172.21.15.2:0/3967780492 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7eff980a32d0 msgr2=0x7eff980a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:33.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.614+0000 7effb5adf640 1 --2- 172.21.15.2:0/3967780492 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7eff980a32d0 0x7eff980a5790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7effa000abe0 tx=0x7effa000a2d0 comp rx=0 tx=0).stop 2024-09-19T06:14:33.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.614+0000 7effb5adf640 1 -- 172.21.15.2:0/3967780492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effb0102790 msgr2=0x7effb01987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:33.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.614+0000 7effb5adf640 1 --2- 172.21.15.2:0/3967780492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effb0102790 0x7effb01987e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7effa400d770 tx=0x7effa400db70 comp rx=0 tx=0).stop 2024-09-19T06:14:33.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.614+0000 7effb5adf640 1 -- 172.21.15.2:0/3967780492 shutdown_connections 2024-09-19T06:14:33.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.614+0000 7effb5adf640 1 --2- 172.21.15.2:0/3967780492 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7eff980a32d0 0x7eff980a5790 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:33.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.614+0000 7effb5adf640 1 --2- 172.21.15.2:0/3967780492 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effb0106f10 0x7effb019cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:33.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.614+0000 7effb5adf640 1 --2- 172.21.15.2:0/3967780492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effb0102790 0x7effb01987e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:33.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.614+0000 7effb5adf640 1 --2- 172.21.15.2:0/3967780492 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effb0101de0 0x7effb01982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:33.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.614+0000 7effb5adf640 1 -- 172.21.15.2:0/3967780492 >> 172.21.15.2:0/3967780492 conn(0x7effb00fd8c0 msgr2=0x7effb00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:33.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.614+0000 7effb5adf640 1 -- 172.21.15.2:0/3967780492 shutdown_connections 2024-09-19T06:14:33.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:33.615+0000 7effb5adf640 1 -- 172.21.15.2:0/3967780492 wait complete. 2024-09-19T06:14:34.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:33 smithi002 ceph-mon[30982]: pgmap v321: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:34.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:33 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/3967780492' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:14:34.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:33 smithi090 ceph-mon[34497]: pgmap v321: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:34.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:33 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/3967780492' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:14:34.281 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:14:34.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:33 smithi089 ceph-mon[34160]: pgmap v321: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:34.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:33 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/3967780492' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:14:34.539 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:35.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.000+0000 7fae4ee78640 1 -- 172.21.15.2:0/3464754097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae48100a90 msgr2=0x7fae48100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.000+0000 7fae4ee78640 1 --2- 172.21.15.2:0/3464754097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae48100a90 0x7fae48100ef0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fae3c009930 tx=0x7fae3c02a420 comp rx=0 tx=0).stop 2024-09-19T06:14:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.001+0000 7fae4ee78640 1 -- 172.21.15.2:0/3464754097 shutdown_connections 2024-09-19T06:14:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.001+0000 7fae4ee78640 1 --2- 172.21.15.2:0/3464754097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae48101430 0x7fae4810d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.001+0000 7fae4ee78640 1 --2- 172.21.15.2:0/3464754097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae48100a90 0x7fae48100ef0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.001+0000 7fae4ee78640 1 --2- 172.21.15.2:0/3464754097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae48106a90 0x7fae48106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.001+0000 7fae4ee78640 1 -- 172.21.15.2:0/3464754097 >> 172.21.15.2:0/3464754097 conn(0x7fae480fc7d0 msgr2=0x7fae480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.001+0000 7fae4ee78640 1 -- 172.21.15.2:0/3464754097 shutdown_connections 2024-09-19T06:14:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.001+0000 7fae4ee78640 1 -- 172.21.15.2:0/3464754097 wait complete. 2024-09-19T06:14:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.001+0000 7fae4ee78640 1 Processor -- start 2024-09-19T06:14:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.001+0000 7fae4ee78640 1 -- start start 2024-09-19T06:14:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.001+0000 7fae4ee78640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae48100a90 0x7fae48198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.001+0000 7fae4ee78640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae48101430 0x7fae48198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:35.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.002+0000 7fae4ee78640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae48106a90 0x7fae4819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:35.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.002+0000 7fae4ee78640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fae48110d60 con 0x7fae48106a90 2024-09-19T06:14:35.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.002+0000 7fae4ee78640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fae48110be0 con 0x7fae48101430 2024-09-19T06:14:35.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.002+0000 7fae4ee78640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fae48110ee0 con 0x7fae48100a90 2024-09-19T06:14:35.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.002+0000 7fae4d415640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae48106a90 0x7fae4819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:35.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.002+0000 7fae4d415640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae48106a90 0x7fae4819cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50778/0 (socket says 172.21.15.2:50778) 2024-09-19T06:14:35.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.002+0000 7fae4d415640 1 -- 172.21.15.2:0/3796375539 learned_addr learned my addr 172.21.15.2:0/3796375539 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:35.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.002+0000 7fae4cc14640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae48100a90 0x7fae48198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:35.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.002+0000 7fae47fff640 1 --2- 172.21.15.2:0/3796375539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae48101430 0x7fae48198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:35.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.002+0000 7fae4d415640 1 -- 172.21.15.2:0/3796375539 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae48100a90 msgr2=0x7fae48198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:35.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.002+0000 7fae4d415640 1 --2- 172.21.15.2:0/3796375539 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae48100a90 0x7fae48198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:35.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.002+0000 7fae4d415640 1 -- 172.21.15.2:0/3796375539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae48101430 msgr2=0x7fae48198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.002+0000 7fae4d415640 1 --2- 172.21.15.2:0/3796375539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae48101430 0x7fae48198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.002+0000 7fae4d415640 1 -- 172.21.15.2:0/3796375539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae4819d3f0 con 0x7fae48106a90 2024-09-19T06:14:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.002+0000 7fae4d415640 1 --2- 172.21.15.2:0/3796375539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae48106a90 0x7fae4819cd10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fae4000b970 tx=0x7fae4000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.002+0000 7fae45ffb640 1 -- 172.21.15.2:0/3796375539 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae40019070 con 0x7fae48106a90 2024-09-19T06:14:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.002+0000 7fae45ffb640 1 -- 172.21.15.2:0/3796375539 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fae40014440 con 0x7fae48106a90 2024-09-19T06:14:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.002+0000 7fae4ee78640 1 -- 172.21.15.2:0/3796375539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae4819d6e0 con 0x7fae48106a90 2024-09-19T06:14:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.002+0000 7fae45ffb640 1 -- 172.21.15.2:0/3796375539 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae400075d0 con 0x7fae48106a90 2024-09-19T06:14:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.003+0000 7fae4ee78640 1 -- 172.21.15.2:0/3796375539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae481a4fc0 con 0x7fae48106a90 2024-09-19T06:14:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.004+0000 7fae4ee78640 1 -- 172.21.15.2:0/3796375539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae48100ef0 con 0x7fae48106a90 2024-09-19T06:14:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.005+0000 7fae45ffb640 1 -- 172.21.15.2:0/3796375539 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fae4001c070 con 0x7fae48106a90 2024-09-19T06:14:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.005+0000 7fae45ffb640 1 --2- 172.21.15.2:0/3796375539 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fae300a3350 0x7fae300a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.005+0000 7fae4cc14640 1 --2- 172.21.15.2:0/3796375539 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fae300a3350 0x7fae300a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.005+0000 7fae45ffb640 1 -- 172.21.15.2:0/3796375539 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7fae400cef20 con 0x7fae48106a90 2024-09-19T06:14:35.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.006+0000 7fae4cc14640 1 --2- 172.21.15.2:0/3796375539 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fae300a3350 0x7fae300a5810 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fae380058c0 tx=0x7fae3800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:35.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.009+0000 7fae45ffb640 1 -- 172.21.15.2:0/3796375539 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fae4009b550 con 0x7fae48106a90 2024-09-19T06:14:35.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.220+0000 7fae4ee78640 1 -- 172.21.15.2:0/3796375539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fae4810a060 con 0x7fae48106a90 2024-09-19T06:14:35.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.221+0000 7fae45ffb640 1 -- 172.21.15.2:0/3796375539 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11882 (secure 0 0 0) 0x7fae4009f850 con 0x7fae48106a90 2024-09-19T06:14:35.223 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:14:35.223 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":25,"btime":"2024-09-19T06:13:17:867959+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:13:17.867946+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24472,24470]},"id":1}]} 2024-09-19T06:14:35.223 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 25 2024-09-19T06:14:35.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.224+0000 7fae4ee78640 1 -- 172.21.15.2:0/3796375539 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fae300a3350 msgr2=0x7fae300a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:35.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.224+0000 7fae4ee78640 1 --2- 172.21.15.2:0/3796375539 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fae300a3350 0x7fae300a5810 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fae380058c0 tx=0x7fae3800a2d0 comp rx=0 tx=0).stop 2024-09-19T06:14:35.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.224+0000 7fae4ee78640 1 -- 172.21.15.2:0/3796375539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae48106a90 msgr2=0x7fae4819cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:35.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.224+0000 7fae4ee78640 1 --2- 172.21.15.2:0/3796375539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae48106a90 0x7fae4819cd10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fae4000b970 tx=0x7fae4000be30 comp rx=0 tx=0).stop 2024-09-19T06:14:35.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.224+0000 7fae4ee78640 1 -- 172.21.15.2:0/3796375539 shutdown_connections 2024-09-19T06:14:35.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.224+0000 7fae4ee78640 1 --2- 172.21.15.2:0/3796375539 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7fae300a3350 0x7fae300a5810 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:35.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.224+0000 7fae4ee78640 1 --2- 172.21.15.2:0/3796375539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae48106a90 0x7fae4819cd10 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:35.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.224+0000 7fae4ee78640 1 --2- 172.21.15.2:0/3796375539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae48101430 0x7fae48198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:35.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.224+0000 7fae4ee78640 1 --2- 172.21.15.2:0/3796375539 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae48100a90 0x7fae48198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:35.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.224+0000 7fae4ee78640 1 -- 172.21.15.2:0/3796375539 >> 172.21.15.2:0/3796375539 conn(0x7fae480fc7d0 msgr2=0x7fae4806aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:35.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.224+0000 7fae4ee78640 1 -- 172.21.15.2:0/3796375539 shutdown_connections 2024-09-19T06:14:35.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:35.224+0000 7fae4ee78640 1 -- 172.21.15.2:0/3796375539 wait complete. 2024-09-19T06:14:35.855 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:14:36.112 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:36.208 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:35 smithi002 ceph-mon[30982]: pgmap v322: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T06:14:36.208 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:35 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/3796375539' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:14:36.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:35 smithi090 ceph-mon[34497]: pgmap v322: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T06:14:36.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:35 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/3796375539' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:14:36.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:35 smithi089 ceph-mon[34160]: pgmap v322: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T06:14:36.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:35 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/3796375539' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:14:36.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.515+0000 7f829c0fa640 1 -- 172.21.15.2:0/3221212725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8294100e20 msgr2=0x7f8294101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:36.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.515+0000 7f829c0fa640 1 --2- 172.21.15.2:0/3221212725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8294100e20 0x7f8294101200 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8290009900 tx=0x7f829002a480 comp rx=0 tx=0).stop 2024-09-19T06:14:36.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.515+0000 7f829c0fa640 1 -- 172.21.15.2:0/3221212725 shutdown_connections 2024-09-19T06:14:36.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.515+0000 7f829c0fa640 1 --2- 172.21.15.2:0/3221212725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8294102ef0 0x7f829410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:36.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.515+0000 7f829c0fa640 1 --2- 172.21.15.2:0/3221212725 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8294102570 0x7f82941029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:36.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.515+0000 7f829c0fa640 1 --2- 172.21.15.2:0/3221212725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8294100e20 0x7f8294101200 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:36.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.515+0000 7f829c0fa640 1 -- 172.21.15.2:0/3221212725 >> 172.21.15.2:0/3221212725 conn(0x7f82940fc7d0 msgr2=0x7f82940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:36.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.515+0000 7f829c0fa640 1 -- 172.21.15.2:0/3221212725 shutdown_connections 2024-09-19T06:14:36.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.515+0000 7f829c0fa640 1 -- 172.21.15.2:0/3221212725 wait complete. 2024-09-19T06:14:36.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.515+0000 7f829c0fa640 1 Processor -- start 2024-09-19T06:14:36.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.516+0000 7f829c0fa640 1 -- start start 2024-09-19T06:14:36.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.516+0000 7f829c0fa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8294100e20 0x7f82940fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:36.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.516+0000 7f829c0fa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8294102570 0x7f82940fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:36.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.516+0000 7f829c0fa640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8294102ef0 0x7f82940fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:36.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.516+0000 7f829c0fa640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8294110e50 con 0x7f8294100e20 2024-09-19T06:14:36.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.516+0000 7f829c0fa640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8294110cd0 con 0x7f8294102570 2024-09-19T06:14:36.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.516+0000 7f829c0fa640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8294110fd0 con 0x7f8294102ef0 2024-09-19T06:14:36.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.516+0000 7f8299e96640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8294100e20 0x7f82940fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:36.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.516+0000 7f8299e96640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8294100e20 0x7f82940fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60058/0 (socket says 172.21.15.2:60058) 2024-09-19T06:14:36.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.516+0000 7f8299e96640 1 -- 172.21.15.2:0/1954091314 learned_addr learned my addr 172.21.15.2:0/1954091314 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:36.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.516+0000 7f8299695640 1 --2- 172.21.15.2:0/1954091314 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8294102570 0x7f82940fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:36.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.516+0000 7f829a697640 1 --2- 172.21.15.2:0/1954091314 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8294102ef0 0x7f82940fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:36.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.516+0000 7f8299e96640 1 -- 172.21.15.2:0/1954091314 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8294102ef0 msgr2=0x7f82940fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:36.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.516+0000 7f8299e96640 1 --2- 172.21.15.2:0/1954091314 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8294102ef0 0x7f82940fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:36.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.516+0000 7f8299e96640 1 -- 172.21.15.2:0/1954091314 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8294102570 msgr2=0x7f82940fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:36.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.516+0000 7f8299e96640 1 --2- 172.21.15.2:0/1954091314 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8294102570 0x7f82940fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:36.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.516+0000 7f8299e96640 1 -- 172.21.15.2:0/1954091314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82941a6960 con 0x7f8294100e20 2024-09-19T06:14:36.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.517+0000 7f8299e96640 1 --2- 172.21.15.2:0/1954091314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8294100e20 0x7f82940fcc80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8290006010 tx=0x7f82900042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:36.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.517+0000 7f828affd640 1 -- 172.21.15.2:0/1954091314 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f829003f030 con 0x7f8294100e20 2024-09-19T06:14:36.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.517+0000 7f829c0fa640 1 -- 172.21.15.2:0/1954091314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82941a6bf0 con 0x7f8294100e20 2024-09-19T06:14:36.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.517+0000 7f828affd640 1 -- 172.21.15.2:0/1954091314 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8290003cb0 con 0x7f8294100e20 2024-09-19T06:14:36.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.517+0000 7f828affd640 1 -- 172.21.15.2:0/1954091314 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8290035070 con 0x7f8294100e20 2024-09-19T06:14:36.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.517+0000 7f829c0fa640 1 -- 172.21.15.2:0/1954091314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82941a70d0 con 0x7f8294100e20 2024-09-19T06:14:36.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.518+0000 7f829c0fa640 1 -- 172.21.15.2:0/1954091314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8294101200 con 0x7f8294100e20 2024-09-19T06:14:36.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.519+0000 7f828affd640 1 -- 172.21.15.2:0/1954091314 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f8290042030 con 0x7f8294100e20 2024-09-19T06:14:36.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.520+0000 7f828affd640 1 --2- 172.21.15.2:0/1954091314 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f82800a32d0 0x7f82800a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:36.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.520+0000 7f8299695640 1 --2- 172.21.15.2:0/1954091314 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f82800a32d0 0x7f82800a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:36.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.520+0000 7f828affd640 1 -- 172.21.15.2:0/1954091314 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f82900f0290 con 0x7f8294100e20 2024-09-19T06:14:36.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.520+0000 7f8299695640 1 --2- 172.21.15.2:0/1954091314 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f82800a32d0 0x7f82800a5790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f82940fe710 tx=0x7f8284009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:36.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.524+0000 7f828affd640 1 -- 172.21.15.2:0/1954091314 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f82900bce60 con 0x7f8294100e20 2024-09-19T06:14:36.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.702+0000 7f829c0fa640 1 -- 172.21.15.2:0/1954091314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f829410a0a0 con 0x7f8294100e20 2024-09-19T06:14:36.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.704+0000 7f828affd640 1 -- 172.21.15.2:0/1954091314 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22577 (secure 0 0 0) 0x7f82900bc760 con 0x7f8294100e20 2024-09-19T06:14:36.706 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:14:36.706 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":81,"fsid":"078f6612-764d-11ef-bceb-c7b262605968","created":"2024-09-19T06:05:17.607927+0000","modified":"2024-09-19T06:13:13.827600+0000","last_up_change":"2024-09-19T06:12:13.856684+0000","last_in_change":"2024-09-19T06:11:49.745266+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:08:28.425566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:13:00.482789+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:13:02.768221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0de97a3d-2d27-455b-9998-ddd2319c148d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6803","nonce":915165910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6805","nonce":915165910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6809","nonce":915165910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6807","nonce":915165910}]},"public_addr":"172.21.15.2:6803/915165910","cluster_addr":"172.21.15.2:6805/915165910","heartbeat_back_addr":"172.21.15.2:6809/915165910","heartbeat_front_addr":"172.21.15.2:6807/915165910","state":["exists","up"]},{"osd":1,"uuid":"056d229e-2de4-4902-922e-21e1a5d3f061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6801","nonce":4097264171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6803","nonce":4097264171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6807","nonce":4097264171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6805","nonce":4097264171}]},"public_addr":"172.21.15.89:6801/4097264171","cluster_addr":"172.21.15.89:6803/4097264171","heartbeat_back_addr":"172.21.15.89:6807/4097264171","heartbeat_front_addr":"172.21.15.89:6805/4097264171","state":["exists","up"]},{"osd":2,"uuid":"2a4e7147-4125-4ee6-b5ad-85518d7066d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6801","nonce":1479908200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6803","nonce":1479908200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6807","nonce":1479908200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6805","nonce":1479908200}]},"public_addr":"172.21.15.90:6801/1479908200","cluster_addr":"172.21.15.90:6803/1479908200","heartbeat_back_addr":"172.21.15.90:6807/1479908200","heartbeat_front_addr":"172.21.15.90:6805/1479908200","state":["exists","up"]},{"osd":3,"uuid":"7b3da775-0f0a-4b46-a8dc-9ec822a54301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6811","nonce":1796948193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6813","nonce":1796948193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6817","nonce":1796948193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6815","nonce":1796948193}]},"public_addr":"172.21.15.2:6811/1796948193","cluster_addr":"172.21.15.2:6813/1796948193","heartbeat_back_addr":"172.21.15.2:6817/1796948193","heartbeat_front_addr":"172.21.15.2:6815/1796948193","state":["exists","up"]},{"osd":4,"uuid":"d4c8bafc-c844-4ff1-a3d8-7a53576e6b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6809","nonce":4256848315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6811","nonce":4256848315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6815","nonce":4256848315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6813","nonce":4256848315}]},"public_addr":"172.21.15.89:6809/4256848315","cluster_addr":"172.21.15.89:6811/4256848315","heartbeat_back_addr":"172.21.15.89:6815/4256848315","heartbeat_front_addr":"172.21.15.89:6813/4256848315","state":["exists","up"]},{"osd":5,"uuid":"8dc9bb55-29e0-4b04-9415-3b9bb5ed05cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6809","nonce":189855967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6811","nonce":189855967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6815","nonce":189855967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6813","nonce":189855967}]},"public_addr":"172.21.15.90:6809/189855967","cluster_addr":"172.21.15.90:6811/189855967","heartbeat_back_addr":"172.21.15.90:6815/189855967","heartbeat_front_addr":"172.21.15.90:6813/189855967","state":["exists","up"]},{"osd":6,"uuid":"86d1443a-9b43-46de-abd7-4c95b43207f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6819","nonce":3886336279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6821","nonce":3886336279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6825","nonce":3886336279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6823","nonce":3886336279}]},"public_addr":"172.21.15.2:6819/3886336279","cluster_addr":"172.21.15.2:6821/3886336279","heartbeat_back_addr":"172.21.15.2:6825/3886336279","heartbeat_front_addr":"172.21.15.2:6823/3886336279","state":["exists","up"]},{"osd":7,"uuid":"1cc5554c-80d2-4e77-b29a-fd2ada68d82d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6817","nonce":508513510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6819","nonce":508513510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6823","nonce":508513510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6821","nonce":508513510}]},"public_addr":"172.21.15.89:6817/508513510","cluster_addr":"172.21.15.89:6819/508513510","heartbeat_back_addr":"172.21.15.89:6823/508513510","heartbeat_front_addr":"172.21.15.89:6821/508513510","state":["exists","up"]},{"osd":8,"uuid":"e9b2eb92-9af2-4f26-a259-fcaf972e4fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6817","nonce":3558544480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6819","nonce":3558544480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6823","nonce":3558544480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6821","nonce":3558544480}]},"public_addr":"172.21.15.90:6817/3558544480","cluster_addr":"172.21.15.90:6819/3558544480","heartbeat_back_addr":"172.21.15.90:6823/3558544480","heartbeat_front_addr":"172.21.15.90:6821/3558544480","state":["exists","up"]},{"osd":9,"uuid":"194d4c64-dd29-4d35-bc54-0858c44815cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6827","nonce":2690758100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6829","nonce":2690758100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6833","nonce":2690758100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6831","nonce":2690758100}]},"public_addr":"172.21.15.2:6827/2690758100","cluster_addr":"172.21.15.2:6829/2690758100","heartbeat_back_addr":"172.21.15.2:6833/2690758100","heartbeat_front_addr":"172.21.15.2:6831/2690758100","state":["exists","up"]},{"osd":10,"uuid":"7695fa4a-b94e-4afc-b166-690a197ad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6825","nonce":1141925395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6827","nonce":1141925395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6831","nonce":1141925395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6829","nonce":1141925395}]},"public_addr":"172.21.15.89:6825/1141925395","cluster_addr":"172.21.15.89:6827/1141925395","heartbeat_back_addr":"172.21.15.89:6831/1141925395","heartbeat_front_addr":"172.21.15.89:6829/1141925395","state":["exists","up"]},{"osd":11,"uuid":"1815a999-bfdb-46b9-afcd-632ee8ba56d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6825","nonce":468380924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6827","nonce":468380924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6831","nonce":468380924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6829","nonce":468380924}]},"public_addr":"172.21.15.90:6825/468380924","cluster_addr":"172.21.15.90:6827/468380924","heartbeat_back_addr":"172.21.15.90:6831/468380924","heartbeat_front_addr":"172.21.15.90:6829/468380924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:07:36.125754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:01.415356+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:26.420808+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:51.722673+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:09:16.562300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:09:41.958465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:10:07.056167+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:10:32.066195+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:10:56.497875+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:11:21.973083+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:11:46.891515+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:12:11.910012+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9},{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/874985787":"2024-09-20T06:06:11.912585+0000","172.21.15.2:0/1280963020":"2024-09-20T06:06:11.912585+0000","172.21.15.2:0/2976372536":"2024-09-20T06:06:11.912585+0000","172.21.15.2:6801/1602650352":"2024-09-20T06:05:47.538477+0000","172.21.15.2:6800/1602650352":"2024-09-20T06:05:47.538477+0000","172.21.15.2:6800/1200011821":"2024-09-20T06:06:11.912585+0000","172.21.15.2:0/3899165140":"2024-09-20T06:05:47.538477+0000","172.21.15.2:6801/1200011821":"2024-09-20T06:06:11.912585+0000","172.21.15.2:0/1361067708":"2024-09-20T06:05:47.538477+0000","172.21.15.2:0/3763089457":"2024-09-20T06:05:47.538477+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:14:36.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.706+0000 7f829c0fa640 1 -- 172.21.15.2:0/1954091314 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f82800a32d0 msgr2=0x7f82800a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:36.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.706+0000 7f829c0fa640 1 --2- 172.21.15.2:0/1954091314 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f82800a32d0 0x7f82800a5790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f82940fe710 tx=0x7f8284009110 comp rx=0 tx=0).stop 2024-09-19T06:14:36.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.706+0000 7f829c0fa640 1 -- 172.21.15.2:0/1954091314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8294100e20 msgr2=0x7f82940fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:36.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.706+0000 7f829c0fa640 1 --2- 172.21.15.2:0/1954091314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8294100e20 0x7f82940fcc80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8290006010 tx=0x7f82900042f0 comp rx=0 tx=0).stop 2024-09-19T06:14:36.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.706+0000 7f829c0fa640 1 -- 172.21.15.2:0/1954091314 shutdown_connections 2024-09-19T06:14:36.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.706+0000 7f829c0fa640 1 --2- 172.21.15.2:0/1954091314 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f82800a32d0 0x7f82800a5790 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:36.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.706+0000 7f829c0fa640 1 --2- 172.21.15.2:0/1954091314 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8294102ef0 0x7f82940fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:36.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.706+0000 7f829c0fa640 1 --2- 172.21.15.2:0/1954091314 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8294102570 0x7f82940fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:36.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.706+0000 7f829c0fa640 1 --2- 172.21.15.2:0/1954091314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8294100e20 0x7f82940fcc80 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:36.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.706+0000 7f829c0fa640 1 -- 172.21.15.2:0/1954091314 >> 172.21.15.2:0/1954091314 conn(0x7f82940fc7d0 msgr2=0x7f829406a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:36.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.706+0000 7f829c0fa640 1 -- 172.21.15.2:0/1954091314 shutdown_connections 2024-09-19T06:14:36.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:36.706+0000 7f829c0fa640 1 -- 172.21.15.2:0/1954091314 wait complete. 2024-09-19T06:14:37.211 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:36 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1954091314' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:14:37.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:36 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1954091314' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:14:37.255 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T06:13:04.348577+0000', 'modified': '2024-09-19T06:13:17.867946+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24497, 'mds_1': 24472, 'mds_2': 24470}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24448': {'gid': 24448, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.90:6835/1607170353', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6834', 'nonce': 1607170353}, {'type': 'v1', 'addr': '172.21.15.90:6835', 'nonce': 1607170353}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24449': {'gid': 24449, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.89:6835/56684343', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6834', 'nonce': 56684343}, {'type': 'v1', 'addr': '172.21.15.89:6835', 'nonce': 56684343}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24460': {'gid': 24460, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.90:6837/2402014616', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6836', 'nonce': 2402014616}, {'type': 'v1', 'addr': '172.21.15.90:6837', 'nonce': 2402014616}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24470': {'gid': 24470, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.89:6837/1620064646', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6836', 'nonce': 1620064646}, {'type': 'v1', 'addr': '172.21.15.89:6837', 'nonce': 1620064646}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24472': {'gid': 24472, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.90:6839/3866538228', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6838', 'nonce': 3866538228}, {'type': 'v1', 'addr': '172.21.15.90:6839', 'nonce': 3866538228}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24497': {'gid': 24497, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.89:6839/3897636568', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6838', 'nonce': 3897636568}, {'type': 'v1', 'addr': '172.21.15.89:6839', 'nonce': 3897636568}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24497, 'qdb_cluster': [24497, 24472, 24470]} 2024-09-19T06:14:37.255 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-19T06:14:37.256 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-19T06:14:37.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:36 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1954091314' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:14:37.512 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:38.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.016+0000 7f1c8790b640 1 -- 172.21.15.2:0/3233364640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c8010e480 msgr2=0x7f1c80110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:38.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.016+0000 7f1c8790b640 1 --2- 172.21.15.2:0/3233364640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c8010e480 0x7f1c80110870 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1c78009ca0 tx=0x7f1c7802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:14:38.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.016+0000 7f1c8790b640 1 -- 172.21.15.2:0/3233364640 shutdown_connections 2024-09-19T06:14:38.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.016+0000 7f1c8790b640 1 --2- 172.21.15.2:0/3233364640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c8010e480 0x7f1c80110870 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:38.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.016+0000 7f1c8790b640 1 --2- 172.21.15.2:0/3233364640 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1c80101280 0x7f1c8010df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:38.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.016+0000 7f1c8790b640 1 --2- 172.21.15.2:0/3233364640 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c801008d0 0x7f1c80100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:38.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.016+0000 7f1c8790b640 1 -- 172.21.15.2:0/3233364640 >> 172.21.15.2:0/3233364640 conn(0x7f1c800fc7a0 msgr2=0x7f1c800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:38.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.016+0000 7f1c8790b640 1 -- 172.21.15.2:0/3233364640 shutdown_connections 2024-09-19T06:14:38.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.016+0000 7f1c8790b640 1 -- 172.21.15.2:0/3233364640 wait complete. 2024-09-19T06:14:38.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.017+0000 7f1c8790b640 1 Processor -- start 2024-09-19T06:14:38.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.017+0000 7f1c8790b640 1 -- start start 2024-09-19T06:14:38.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.017+0000 7f1c8790b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1c801008d0 0x7f1c8019a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:38.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.017+0000 7f1c8790b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c80101280 0x7f1c8019ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:38.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.017+0000 7f1c8790b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c8010e480 0x7f1c8019eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:38.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.017+0000 7f1c8790b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1c80114070 con 0x7f1c8010e480 2024-09-19T06:14:38.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.017+0000 7f1c8790b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f1c80113ef0 con 0x7f1c80101280 2024-09-19T06:14:38.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.017+0000 7f1c8790b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1c801141f0 con 0x7f1c801008d0 2024-09-19T06:14:38.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.017+0000 7f1c85ea8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c8010e480 0x7f1c8019eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:38.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.017+0000 7f1c85ea8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c8010e480 0x7f1c8019eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60084/0 (socket says 172.21.15.2:60084) 2024-09-19T06:14:38.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.017+0000 7f1c85ea8640 1 -- 172.21.15.2:0/2678229481 learned_addr learned my addr 172.21.15.2:0/2678229481 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:38.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.017+0000 7f1c856a7640 1 --2- 172.21.15.2:0/2678229481 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1c801008d0 0x7f1c8019a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:38.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.017+0000 7f1c84ea6640 1 --2- 172.21.15.2:0/2678229481 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c80101280 0x7f1c8019ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:38.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.017+0000 7f1c85ea8640 1 -- 172.21.15.2:0/2678229481 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1c801008d0 msgr2=0x7f1c8019a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:38.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.017+0000 7f1c85ea8640 1 --2- 172.21.15.2:0/2678229481 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1c801008d0 0x7f1c8019a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:38.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.017+0000 7f1c85ea8640 1 -- 172.21.15.2:0/2678229481 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c80101280 msgr2=0x7f1c8019ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:38.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.017+0000 7f1c85ea8640 1 --2- 172.21.15.2:0/2678229481 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c80101280 0x7f1c8019ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:38.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.017+0000 7f1c85ea8640 1 -- 172.21.15.2:0/2678229481 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c8019f5a0 con 0x7f1c8010e480 2024-09-19T06:14:38.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.017+0000 7f1c856a7640 1 --2- 172.21.15.2:0/2678229481 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1c801008d0 0x7f1c8019a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:14:38.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.018+0000 7f1c85ea8640 1 --2- 172.21.15.2:0/2678229481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c8010e480 0x7f1c8019eec0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1c78003ba0 tx=0x7f1c78003bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:38.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.018+0000 7f1c767fc640 1 -- 172.21.15.2:0/2678229481 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c78004040 con 0x7f1c8010e480 2024-09-19T06:14:38.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.018+0000 7f1c767fc640 1 -- 172.21.15.2:0/2678229481 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1c78004690 con 0x7f1c8010e480 2024-09-19T06:14:38.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.018+0000 7f1c8790b640 1 -- 172.21.15.2:0/2678229481 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c8019f830 con 0x7f1c8010e480 2024-09-19T06:14:38.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.018+0000 7f1c767fc640 1 -- 172.21.15.2:0/2678229481 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c78030d90 con 0x7f1c8010e480 2024-09-19T06:14:38.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.018+0000 7f1c8790b640 1 -- 172.21.15.2:0/2678229481 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c801a7170 con 0x7f1c8010e480 2024-09-19T06:14:38.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.021+0000 7f1c767fc640 1 -- 172.21.15.2:0/2678229481 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f1c780305c0 con 0x7f1c8010e480 2024-09-19T06:14:38.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.021+0000 7f1c89ce4740 1 Processor -- start 2024-09-19T06:14:38.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.021+0000 7f1c89ce4740 1 -- start start 2024-09-19T06:14:38.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.021+0000 7f1c89ce4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ed54819d0 0x564ed5481db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:38.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.021+0000 7f1c89ce4740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564ed54822f0 0x564ed548c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:38.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.021+0000 7f1c89ce4740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ed548cbb0 0x564ed548efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:38.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.021+0000 7f1c89ce4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564ed53e8090 con 0x564ed54819d0 2024-09-19T06:14:38.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.021+0000 7f1c89ce4740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x564ed538fa70 con 0x564ed548cbb0 2024-09-19T06:14:38.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.021+0000 7f1c89ce4740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x564ed53e4050 con 0x564ed54822f0 2024-09-19T06:14:38.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.021+0000 7f1c84ea6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ed54819d0 0x564ed5481db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:38.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.021+0000 7f1c84ea6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ed54819d0 0x564ed5481db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60094/0 (socket says 172.21.15.2:60094) 2024-09-19T06:14:38.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.021+0000 7f1c84ea6640 1 -- 172.21.15.2:0/1752475022 learned_addr learned my addr 172.21.15.2:0/1752475022 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:38.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.022+0000 7f1c767fc640 1 --2- 172.21.15.2:0/2678229481 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f1c6c0a32d0 0x7f1c6c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:38.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.022+0000 7f1c84ea6640 1 -- 172.21.15.2:0/1752475022 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564ed54822f0 msgr2=0x564ed548c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:38.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.022+0000 7f1c84ea6640 1 --2- 172.21.15.2:0/1752475022 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564ed54822f0 0x564ed548c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:38.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.022+0000 7f1c84ea6640 1 -- 172.21.15.2:0/1752475022 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ed548cbb0 msgr2=0x564ed548efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:38.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.022+0000 7f1c84ea6640 1 --2- 172.21.15.2:0/1752475022 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ed548cbb0 0x564ed548efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:38.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.022+0000 7f1c84ea6640 1 -- 172.21.15.2:0/1752475022 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ed539c130 con 0x564ed54819d0 2024-09-19T06:14:38.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.022+0000 7f1c85ea8640 1 --2- 172.21.15.2:0/2678229481 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f1c6c0a32d0 0x7f1c6c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:38.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.022+0000 7f1c84ea6640 1 --2- 172.21.15.2:0/1752475022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ed54819d0 0x564ed5481db0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1c70006e10 tx=0x7f1c70009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=934f467325f998e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:38.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.022+0000 7f1c767fc640 1 -- 172.21.15.2:0/2678229481 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f1c780f11e0 con 0x7f1c8010e480 2024-09-19T06:14:38.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.022+0000 7f1c6b7fe640 1 -- 172.21.15.2:0/1752475022 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c7000fa60 con 0x564ed54819d0 2024-09-19T06:14:38.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.022+0000 7f1c6b7fe640 1 -- 172.21.15.2:0/1752475022 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1c70010040 con 0x564ed54819d0 2024-09-19T06:14:38.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.022+0000 7f1c6b7fe640 1 -- 172.21.15.2:0/1752475022 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c70013390 con 0x564ed54819d0 2024-09-19T06:14:38.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.023+0000 7f1c85ea8640 1 --2- 172.21.15.2:0/2678229481 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f1c6c0a32d0 0x7f1c6c0a5790 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1c7802f3b0 tx=0x7f1c7808c4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:38.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.023+0000 7f1c89ce4740 1 -- 172.21.15.2:0/1752475022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ed54819d0 msgr2=0x564ed5481db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:38.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.023+0000 7f1c89ce4740 1 --2- 172.21.15.2:0/1752475022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ed54819d0 0x564ed5481db0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1c70006e10 tx=0x7f1c70009ea0 comp rx=0 tx=0).stop 2024-09-19T06:14:38.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.023+0000 7f1c89ce4740 1 -- 172.21.15.2:0/1752475022 shutdown_connections 2024-09-19T06:14:38.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.023+0000 7f1c89ce4740 1 --2- 172.21.15.2:0/1752475022 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ed548cbb0 0x564ed548efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:38.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.023+0000 7f1c89ce4740 1 --2- 172.21.15.2:0/1752475022 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564ed54822f0 0x564ed548c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:38.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.023+0000 7f1c89ce4740 1 --2- 172.21.15.2:0/1752475022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ed54819d0 0x564ed5481db0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:38.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.023+0000 7f1c89ce4740 1 -- 172.21.15.2:0/1752475022 >> 172.21.15.2:0/1752475022 conn(0x564ed547df60 msgr2=0x564ed547e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:38.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.023+0000 7f1c89ce4740 1 -- 172.21.15.2:0/1752475022 shutdown_connections 2024-09-19T06:14:38.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.023+0000 7f1c89ce4740 1 -- 172.21.15.2:0/1752475022 wait complete. 2024-09-19T06:14:38.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.024+0000 7f1c89ce4740 1 -- start start 2024-09-19T06:14:38.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.024+0000 7f1c89ce4740 1 Processor -- start 2024-09-19T06:14:38.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.024+0000 7f1c89ce4740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564ed54819d0 0x564ed548c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:38.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.024+0000 7f1c89ce4740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ed54822f0 0x564ed5489810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:38.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.024+0000 7f1c89ce4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ed548cbb0 0x564ed5489d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:38.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.024+0000 7f1c89ce4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564ed548f780 con 0x564ed548cbb0 2024-09-19T06:14:38.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.024+0000 7f1c89ce4740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x564ed53a2f20 con 0x564ed54822f0 2024-09-19T06:14:38.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.024+0000 7f1c89ce4740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x564ed548f900 con 0x564ed54819d0 2024-09-19T06:14:38.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.024+0000 7f1c89ce4740 10 client.0 _ll_register_callbacks cb 0x564ed536c030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:38.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.024+0000 7f1c84ea6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ed548cbb0 0x564ed5489d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:38.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.024+0000 7f1c84ea6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ed548cbb0 0x564ed5489d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60100/0 (socket says 172.21.15.2:60100) 2024-09-19T06:14:38.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.024+0000 7f1c84ea6640 1 -- 172.21.15.2:0/698789891 learned_addr learned my addr 172.21.15.2:0/698789891 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:38.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.024+0000 7f1c84ea6640 1 --2- 172.21.15.2:0/698789891 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564ed54819d0 0x564ed548c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:38.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.024+0000 7f1c856a7640 1 --2- 172.21.15.2:0/698789891 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ed54822f0 0x564ed5489810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:38.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.025+0000 7f1c84ea6640 1 -- 172.21.15.2:0/698789891 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564ed54819d0 msgr2=0x564ed548c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:38.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.025+0000 7f1c84ea6640 1 --2- 172.21.15.2:0/698789891 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564ed54819d0 0x564ed548c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:38.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.025+0000 7f1c84ea6640 1 -- 172.21.15.2:0/698789891 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ed54822f0 msgr2=0x564ed5489810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:38.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.025+0000 7f1c84ea6640 1 --2- 172.21.15.2:0/698789891 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ed54822f0 0x564ed5489810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:38.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.025+0000 7f1c84ea6640 1 -- 172.21.15.2:0/698789891 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ed51592b0 con 0x564ed548cbb0 2024-09-19T06:14:38.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.025+0000 7f1c84ea6640 1 --2- 172.21.15.2:0/698789891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ed548cbb0 0x564ed5489d50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1c70009810 tx=0x7f1c70014c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed236eb82de9ee91 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:38.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.025+0000 7f1c68ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:14:38.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.025+0000 7f1c68ff9640 1 -- 172.21.15.2:0/698789891 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c7000fdf0 con 0x564ed548cbb0 2024-09-19T06:14:38.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.025+0000 7f1c68ff9640 1 -- 172.21.15.2:0/698789891 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f1c70020440 con 0x564ed548cbb0 2024-09-19T06:14:38.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.025+0000 7f1c89ce4740 1 -- 172.21.15.2:0/698789891 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c70010040 con 0x564ed548cbb0 2024-09-19T06:14:38.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.025+0000 7f1c68ff9640 1 -- 172.21.15.2:0/698789891 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1c70020640 con 0x564ed548cbb0 2024-09-19T06:14:38.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.025+0000 7f1c89ce4740 10 client.15078 fetch_fsmap learned FSMap version 25 2024-09-19T06:14:38.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.025+0000 7f1c89ce4740 1 -- 172.21.15.2:0/698789891 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564ed549b100 con 0x564ed548cbb0 2024-09-19T06:14:38.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.025+0000 7f1c68ff9640 1 -- 172.21.15.2:0/698789891 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1c70010040 con 0x564ed548cbb0 2024-09-19T06:14:38.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.025+0000 7f1c68ff9640 1 -- 172.21.15.2:0/698789891 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1c70013070 con 0x564ed548cbb0 2024-09-19T06:14:38.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.026+0000 7f1c89ce4740 10 client.15078 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T06:14:38.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.026+0000 7f1c89ce4740 10 client.15078 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T06:14:38.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.026+0000 7f1c89ce4740 20 client.15078 populate_metadata read hostname 'smithi002' 2024-09-19T06:14:38.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.026+0000 7f1c89ce4740 1 --2- 172.21.15.2:0/698789891 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x564ed549d510 0x564ed549e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:38.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.026+0000 7f1c89ce4740 4 client.15078 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:14:38.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.026+0000 7f1c89ce4740 1 -- 172.21.15.2:0/698789891 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ed53f5600 con 0x564ed549d510 2024-09-19T06:14:38.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.026+0000 7f1c856a7640 1 --2- 172.21.15.2:0/698789891 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x564ed549d510 0x564ed549e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:38.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.026+0000 7f1c856a7640 1 --2- 172.21.15.2:0/698789891 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x564ed549d510 0x564ed549e980 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=70e41b73dbfe0793 server_cookie=5558c45e18263b50 in_seq=0 out_seq=0 2024-09-19T06:14:38.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.026+0000 7f1c68ff9640 10 client.15078 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:14:38.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.027+0000 7f1c68ff9640 1 -- 172.21.15.2:0/698789891 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564ed53f5600 con 0x564ed549d510 2024-09-19T06:14:38.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.027+0000 7f1c68ff9640 10 client.15078 handle_command_reply: tid=0 2024-09-19T06:14:38.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.027+0000 7f1c89ce4740 1 client.15078 shutdown 2024-09-19T06:14:38.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.027+0000 7f1c89ce4740 1 -- 172.21.15.2:0/698789891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ed548cbb0 msgr2=0x564ed5489d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:38.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.027+0000 7f1c89ce4740 1 --2- 172.21.15.2:0/698789891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ed548cbb0 0x564ed5489d50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1c70009810 tx=0x7f1c70014c10 comp rx=0 tx=0).stop 2024-09-19T06:14:38.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.027+0000 7f1c89ce4740 1 -- 172.21.15.2:0/698789891 shutdown_connections 2024-09-19T06:14:38.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.027+0000 7f1c89ce4740 1 --2- 172.21.15.2:0/698789891 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x564ed549d510 0x564ed549e980 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:38.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.027+0000 7f1c89ce4740 1 --2- 172.21.15.2:0/698789891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ed548cbb0 0x564ed5489d50 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:38.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.027+0000 7f1c89ce4740 1 --2- 172.21.15.2:0/698789891 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ed54822f0 0x564ed5489810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:38.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.027+0000 7f1c68ff9640 0 client.15078 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:14:38.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.027+0000 7f1c89ce4740 1 --2- 172.21.15.2:0/698789891 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564ed54819d0 0x564ed548c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:38.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.027+0000 7f1c89ce4740 1 -- 172.21.15.2:0/698789891 >> 172.21.15.2:0/698789891 conn(0x564ed547df60 msgr2=0x564ed5483c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:38.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.027+0000 7f1c89ce4740 1 -- 172.21.15.2:0/698789891 shutdown_connections 2024-09-19T06:14:38.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.027+0000 7f1c89ce4740 1 -- 172.21.15.2:0/698789891 wait complete. 2024-09-19T06:14:38.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.028+0000 7f1c89ce4740 20 client.15078 trim_cache size 0 max 16384 2024-09-19T06:14:38.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.046+0000 7f1c89ce4740 1 Processor -- start 2024-09-19T06:14:38.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.046+0000 7f1c89ce4740 1 -- start start 2024-09-19T06:14:38.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.046+0000 7f1c89ce4740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564ed54819d0 0x564ed549e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:38.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.046+0000 7f1c89ce4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ed54822f0 0x564ed5478ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:38.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.046+0000 7f1c89ce4740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ed548cbb0 0x564ed5488100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:38.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.046+0000 7f1c89ce4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564ed549ccc0 con 0x564ed54822f0 2024-09-19T06:14:38.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.046+0000 7f1c89ce4740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x564ed549d390 con 0x564ed548cbb0 2024-09-19T06:14:38.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.046+0000 7f1c89ce4740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x564ed549da60 con 0x564ed54819d0 2024-09-19T06:14:38.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.046+0000 7f1c856a7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ed54822f0 0x564ed5478ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:38.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.046+0000 7f1c856a7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ed54822f0 0x564ed5478ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60106/0 (socket says 172.21.15.2:60106) 2024-09-19T06:14:38.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.046+0000 7f1c856a7640 1 -- 172.21.15.2:0/1006893204 learned_addr learned my addr 172.21.15.2:0/1006893204 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:38.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.046+0000 7f1c84ea6640 1 --2- 172.21.15.2:0/1006893204 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ed548cbb0 0x564ed5488100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:38.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.046+0000 7f1c84ea6640 1 --2- 172.21.15.2:0/1006893204 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564ed54819d0 0x564ed549e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:38.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.046+0000 7f1c856a7640 1 -- 172.21.15.2:0/1006893204 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564ed54819d0 msgr2=0x564ed549e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:38.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.046+0000 7f1c856a7640 1 --2- 172.21.15.2:0/1006893204 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564ed54819d0 0x564ed549e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:38.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.046+0000 7f1c856a7640 1 -- 172.21.15.2:0/1006893204 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ed548cbb0 msgr2=0x564ed5488100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:38.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.046+0000 7f1c856a7640 1 --2- 172.21.15.2:0/1006893204 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ed548cbb0 0x564ed5488100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:38.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.046+0000 7f1c856a7640 1 -- 172.21.15.2:0/1006893204 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ed5485430 con 0x564ed54822f0 2024-09-19T06:14:38.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.046+0000 7f1c84ea6640 1 --2- 172.21.15.2:0/1006893204 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ed548cbb0 0x564ed5488100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:14:38.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.047+0000 7f1c856a7640 1 --2- 172.21.15.2:0/1006893204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ed54822f0 0x564ed5478ce0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c005d90 tx=0x7f1c7c005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5174f372648c16e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:38.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.047+0000 7f1c6affd640 1 -- 172.21.15.2:0/1006893204 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c005220 con 0x564ed54822f0 2024-09-19T06:14:38.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.047+0000 7f1c6affd640 1 -- 172.21.15.2:0/1006893204 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1c7c004c50 con 0x564ed54822f0 2024-09-19T06:14:38.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.047+0000 7f1c6affd640 1 -- 172.21.15.2:0/1006893204 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c01a840 con 0x564ed54822f0 2024-09-19T06:14:38.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.047+0000 7f1c89ce4740 1 -- 172.21.15.2:0/1006893204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ed54822f0 msgr2=0x564ed5478ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:38.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.047+0000 7f1c89ce4740 1 --2- 172.21.15.2:0/1006893204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ed54822f0 0x564ed5478ce0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c005d90 tx=0x7f1c7c005d20 comp rx=0 tx=0).stop 2024-09-19T06:14:38.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.047+0000 7f1c89ce4740 1 -- 172.21.15.2:0/1006893204 shutdown_connections 2024-09-19T06:14:38.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.047+0000 7f1c89ce4740 1 --2- 172.21.15.2:0/1006893204 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ed548cbb0 0x564ed5488100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:38.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.047+0000 7f1c89ce4740 1 --2- 172.21.15.2:0/1006893204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ed54822f0 0x564ed5478ce0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:38.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.047+0000 7f1c89ce4740 1 --2- 172.21.15.2:0/1006893204 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564ed54819d0 0x564ed549e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:38.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.047+0000 7f1c89ce4740 1 -- 172.21.15.2:0/1006893204 >> 172.21.15.2:0/1006893204 conn(0x564ed547df60 msgr2=0x564ed549c510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:38.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.047+0000 7f1c89ce4740 1 -- 172.21.15.2:0/1006893204 shutdown_connections 2024-09-19T06:14:38.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.047+0000 7f1c89ce4740 1 -- 172.21.15.2:0/1006893204 wait complete. 2024-09-19T06:14:38.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.048+0000 7f1c89ce4740 1 -- start start 2024-09-19T06:14:38.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.048+0000 7f1c89ce4740 1 Processor -- start 2024-09-19T06:14:38.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.048+0000 7f1c89ce4740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564ed54819d0 0x564ed54a1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:38.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.048+0000 7f1c89ce4740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ed54822f0 0x564ed54a2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:38.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.048+0000 7f1c89ce4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ed548cbb0 0x564ed54a26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:38.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.048+0000 7f1c89ce4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564ed549e800 con 0x564ed548cbb0 2024-09-19T06:14:38.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.048+0000 7f1c89ce4740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x564ed549e130 con 0x564ed54822f0 2024-09-19T06:14:38.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.048+0000 7f1c89ce4740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x564ed549eed0 con 0x564ed54819d0 2024-09-19T06:14:38.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.049+0000 7f1c89ce4740 10 client.0 _ll_register_callbacks cb 0x7f1c70009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:38.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.049+0000 7f1c84ea6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ed548cbb0 0x564ed54a26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:38.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.049+0000 7f1c84ea6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ed548cbb0 0x564ed54a26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60112/0 (socket says 172.21.15.2:60112) 2024-09-19T06:14:38.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.049+0000 7f1c84ea6640 1 -- 172.21.15.2:0/624439683 learned_addr learned my addr 172.21.15.2:0/624439683 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:38.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.049+0000 7f1c856a7640 1 --2- 172.21.15.2:0/624439683 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ed54822f0 0x564ed54a2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:38.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.049+0000 7f1c84ea6640 1 --2- 172.21.15.2:0/624439683 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564ed54819d0 0x564ed54a1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:38.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.049+0000 7f1c84ea6640 1 -- 172.21.15.2:0/624439683 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564ed54819d0 msgr2=0x564ed54a1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:38.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.049+0000 7f1c84ea6640 1 --2- 172.21.15.2:0/624439683 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564ed54819d0 0x564ed54a1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:38.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.049+0000 7f1c84ea6640 1 -- 172.21.15.2:0/624439683 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ed54822f0 msgr2=0x564ed54a2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:38.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.049+0000 7f1c84ea6640 1 --2- 172.21.15.2:0/624439683 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ed54822f0 0x564ed54a2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:38.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.049+0000 7f1c84ea6640 1 -- 172.21.15.2:0/624439683 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ed5505c10 con 0x564ed548cbb0 2024-09-19T06:14:38.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.049+0000 7f1c84ea6640 1 --2- 172.21.15.2:0/624439683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ed548cbb0 0x564ed54a26b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1c70004700 tx=0x7f1c70014c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9919d4ea799b160 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:38.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.049+0000 7f1c68ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:14:38.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.049+0000 7f1c68ff9640 1 -- 172.21.15.2:0/624439683 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c70006ca0 con 0x564ed548cbb0 2024-09-19T06:14:38.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.049+0000 7f1c68ff9640 1 -- 172.21.15.2:0/624439683 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f1c70020440 con 0x564ed548cbb0 2024-09-19T06:14:38.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.049+0000 7f1c89ce4740 1 -- 172.21.15.2:0/624439683 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c7c004c50 con 0x564ed548cbb0 2024-09-19T06:14:38.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.049+0000 7f1c68ff9640 1 -- 172.21.15.2:0/624439683 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1c700059c0 con 0x564ed548cbb0 2024-09-19T06:14:38.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.049+0000 7f1c89ce4740 10 client.15084 fetch_fsmap learned FSMap version 25 2024-09-19T06:14:38.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.049+0000 7f1c89ce4740 1 -- 172.21.15.2:0/624439683 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564ed5506e30 con 0x564ed548cbb0 2024-09-19T06:14:38.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.050+0000 7f1c68ff9640 1 -- 172.21.15.2:0/624439683 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1c7c004c50 con 0x564ed548cbb0 2024-09-19T06:14:38.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.050+0000 7f1c68ff9640 1 -- 172.21.15.2:0/624439683 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1c70013070 con 0x564ed548cbb0 2024-09-19T06:14:38.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.050+0000 7f1c89ce4740 10 client.15084 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T06:14:38.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.050+0000 7f1c89ce4740 10 client.15084 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T06:14:38.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.050+0000 7f1c89ce4740 20 client.15084 populate_metadata read hostname 'smithi002' 2024-09-19T06:14:38.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.050+0000 7f1c89ce4740 1 --2- 172.21.15.2:0/624439683 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x564ed549d510 0x564ed550a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:38.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.050+0000 7f1c89ce4740 4 client.15084 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:14:38.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.050+0000 7f1c89ce4740 1 -- 172.21.15.2:0/624439683 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "status"}) -- 0x564ed53efb10 con 0x564ed549d510 2024-09-19T06:14:38.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.050+0000 7f1c856a7640 1 --2- 172.21.15.2:0/624439683 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x564ed549d510 0x564ed550a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:38.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.050+0000 7f1c856a7640 1 --2- 172.21.15.2:0/624439683 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x564ed549d510 0x564ed550a5f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c0c3c1576488be5d server_cookie=dd4c00ca5c634d85 in_seq=0 out_seq=0 2024-09-19T06:14:38.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.050+0000 7f1c68ff9640 10 client.15084 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:14:38.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.051+0000 7f1c68ff9640 1 -- 172.21.15.2:0/624439683 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x564ed53efb10 con 0x564ed549d510 2024-09-19T06:14:38.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.051+0000 7f1c68ff9640 10 client.15084 handle_command_reply: tid=0 2024-09-19T06:14:38.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.051+0000 7f1c89ce4740 1 client.15084 shutdown 2024-09-19T06:14:38.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.051+0000 7f1c89ce4740 1 -- 172.21.15.2:0/624439683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ed548cbb0 msgr2=0x564ed54a26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:38.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.051+0000 7f1c89ce4740 1 --2- 172.21.15.2:0/624439683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ed548cbb0 0x564ed54a26b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1c70004700 tx=0x7f1c70014c10 comp rx=0 tx=0).stop 2024-09-19T06:14:38.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.051+0000 7f1c89ce4740 1 -- 172.21.15.2:0/624439683 shutdown_connections 2024-09-19T06:14:38.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.051+0000 7f1c89ce4740 1 --2- 172.21.15.2:0/624439683 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x564ed549d510 0x564ed550a5f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:38.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.051+0000 7f1c89ce4740 1 --2- 172.21.15.2:0/624439683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564ed548cbb0 0x564ed54a26b0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:38.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.051+0000 7f1c89ce4740 1 --2- 172.21.15.2:0/624439683 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ed54822f0 0x564ed54a2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:38.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.051+0000 7f1c68ff9640 0 client.15084 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:14:38.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.051+0000 7f1c89ce4740 1 --2- 172.21.15.2:0/624439683 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564ed54819d0 0x564ed54a1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:38.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.051+0000 7f1c89ce4740 1 -- 172.21.15.2:0/624439683 >> 172.21.15.2:0/624439683 conn(0x564ed547df60 msgr2=0x564ed5478ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:38.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.051+0000 7f1c89ce4740 1 -- 172.21.15.2:0/624439683 shutdown_connections 2024-09-19T06:14:38.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.051+0000 7f1c89ce4740 1 -- 172.21.15.2:0/624439683 wait complete. 2024-09-19T06:14:38.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.051+0000 7f1c89ce4740 20 client.15084 trim_cache size 0 max 16384 2024-09-19T06:14:38.060 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:14:38.060 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "078f6612-764d-11ef-bceb-c7b262605968", 2024-09-19T06:14:38.060 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 2, 2024-09-19T06:14:38.060 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24470, 2024-09-19T06:14:38.060 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-09-19T06:14:38.060 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-09-19T06:14:38.060 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-09-19T06:14:38.060 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 85.211918174000004, 2024-09-19T06:14:38.060 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 25, 2024-09-19T06:14:38.060 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 81, 2024-09-19T06:14:38.060 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 81, 2024-09-19T06:14:38.061 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 116.457930375 2024-09-19T06:14:38.061 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:14:38.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.052+0000 7f1c8790b640 1 -- 172.21.15.2:0/2678229481 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f1c6c0a32d0 msgr2=0x7f1c6c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:38.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.052+0000 7f1c8790b640 1 --2- 172.21.15.2:0/2678229481 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f1c6c0a32d0 0x7f1c6c0a5790 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1c7802f3b0 tx=0x7f1c7808c4a0 comp rx=0 tx=0).stop 2024-09-19T06:14:38.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.052+0000 7f1c8790b640 1 -- 172.21.15.2:0/2678229481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c8010e480 msgr2=0x7f1c8019eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:38.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.052+0000 7f1c8790b640 1 --2- 172.21.15.2:0/2678229481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c8010e480 0x7f1c8019eec0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1c78003ba0 tx=0x7f1c78003bd0 comp rx=0 tx=0).stop 2024-09-19T06:14:38.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.052+0000 7f1c8790b640 1 -- 172.21.15.2:0/2678229481 shutdown_connections 2024-09-19T06:14:38.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.052+0000 7f1c8790b640 1 --2- 172.21.15.2:0/2678229481 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f1c6c0a32d0 0x7f1c6c0a5790 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:38.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.052+0000 7f1c8790b640 1 --2- 172.21.15.2:0/2678229481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c8010e480 0x7f1c8019eec0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:38.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.052+0000 7f1c8790b640 1 --2- 172.21.15.2:0/2678229481 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c80101280 0x7f1c8019ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:38.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.052+0000 7f1c8790b640 1 --2- 172.21.15.2:0/2678229481 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1c801008d0 0x7f1c8019a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:38.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.052+0000 7f1c8790b640 1 -- 172.21.15.2:0/2678229481 >> 172.21.15.2:0/2678229481 conn(0x7f1c800fc7a0 msgr2=0x7f1c800feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:38.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.052+0000 7f1c8790b640 1 -- 172.21.15.2:0/2678229481 shutdown_connections 2024-09-19T06:14:38.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:38.052+0000 7f1c8790b640 1 -- 172.21.15.2:0/2678229481 wait complete. 2024-09-19T06:14:38.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:37 smithi002 ceph-mon[30982]: pgmap v323: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T06:14:38.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:37 smithi090 ceph-mon[34497]: pgmap v323: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T06:14:38.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:37 smithi089 ceph-mon[34160]: pgmap v323: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T06:14:38.883 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T06:14:39.148 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:39.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.557+0000 7f63a26a8640 1 -- 172.21.15.2:0/3616530686 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f639c100a80 msgr2=0x7f639c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:39.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.557+0000 7f63a26a8640 1 --2- 172.21.15.2:0/3616530686 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f639c100a80 0x7f639c100ee0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6390009930 tx=0x7f639002a420 comp rx=0 tx=0).stop 2024-09-19T06:14:39.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.557+0000 7f63a26a8640 1 -- 172.21.15.2:0/3616530686 shutdown_connections 2024-09-19T06:14:39.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.557+0000 7f63a26a8640 1 --2- 172.21.15.2:0/3616530686 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f639c101420 0x7f639c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:39.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.557+0000 7f63a26a8640 1 --2- 172.21.15.2:0/3616530686 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f639c100a80 0x7f639c100ee0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:39.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.557+0000 7f63a26a8640 1 --2- 172.21.15.2:0/3616530686 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f639c106a80 0x7f639c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:39.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.557+0000 7f63a26a8640 1 -- 172.21.15.2:0/3616530686 >> 172.21.15.2:0/3616530686 conn(0x7f639c0fc7a0 msgr2=0x7f639c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:39.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.557+0000 7f63a26a8640 1 -- 172.21.15.2:0/3616530686 shutdown_connections 2024-09-19T06:14:39.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.557+0000 7f63a26a8640 1 -- 172.21.15.2:0/3616530686 wait complete. 2024-09-19T06:14:39.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.558+0000 7f63a26a8640 1 Processor -- start 2024-09-19T06:14:39.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.558+0000 7f63a26a8640 1 -- start start 2024-09-19T06:14:39.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.558+0000 7f63a26a8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f639c100a80 0x7f639c19a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:39.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.558+0000 7f63a26a8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f639c101420 0x7f639c19ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:39.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.558+0000 7f63a26a8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f639c106a80 0x7f639c19eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:39.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.558+0000 7f63a26a8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f639c110da0 con 0x7f639c101420 2024-09-19T06:14:39.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.558+0000 7f63a26a8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f639c110c20 con 0x7f639c106a80 2024-09-19T06:14:39.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.558+0000 7f63a26a8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f639c110f20 con 0x7f639c100a80 2024-09-19T06:14:39.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.559+0000 7f639b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f639c101420 0x7f639c19ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:39.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.559+0000 7f639b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f639c101420 0x7f639c19ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60130/0 (socket says 172.21.15.2:60130) 2024-09-19T06:14:39.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.559+0000 7f639b7fe640 1 -- 172.21.15.2:0/3006377880 learned_addr learned my addr 172.21.15.2:0/3006377880 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:39.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.559+0000 7f63a0c45640 1 --2- 172.21.15.2:0/3006377880 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f639c106a80 0x7f639c19eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:39.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.559+0000 7f639bfff640 1 --2- 172.21.15.2:0/3006377880 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f639c100a80 0x7f639c19a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:39.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.559+0000 7f639b7fe640 1 -- 172.21.15.2:0/3006377880 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f639c100a80 msgr2=0x7f639c19a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:39.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.559+0000 7f639b7fe640 1 --2- 172.21.15.2:0/3006377880 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f639c100a80 0x7f639c19a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:39.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.559+0000 7f639b7fe640 1 -- 172.21.15.2:0/3006377880 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f639c106a80 msgr2=0x7f639c19eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:39.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.559+0000 7f639b7fe640 1 --2- 172.21.15.2:0/3006377880 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f639c106a80 0x7f639c19eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:39.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.559+0000 7f639b7fe640 1 -- 172.21.15.2:0/3006377880 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f639c19f590 con 0x7f639c101420 2024-09-19T06:14:39.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.559+0000 7f639b7fe640 1 --2- 172.21.15.2:0/3006377880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f639c101420 0x7f639c19ab20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6390005ab0 tx=0x7f6390003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:39.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.559+0000 7f63997fa640 1 -- 172.21.15.2:0/3006377880 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639003f070 con 0x7f639c101420 2024-09-19T06:14:39.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.559+0000 7f63997fa640 1 -- 172.21.15.2:0/3006377880 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6390031d60 con 0x7f639c101420 2024-09-19T06:14:39.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.559+0000 7f63a26a8640 1 -- 172.21.15.2:0/3006377880 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f639c19f820 con 0x7f639c101420 2024-09-19T06:14:39.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.559+0000 7f63997fa640 1 -- 172.21.15.2:0/3006377880 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6390035030 con 0x7f639c101420 2024-09-19T06:14:39.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.559+0000 7f63a26a8640 1 -- 172.21.15.2:0/3006377880 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f639c1a7160 con 0x7f639c101420 2024-09-19T06:14:39.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.562+0000 7f63997fa640 1 -- 172.21.15.2:0/3006377880 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f6390042070 con 0x7f639c101420 2024-09-19T06:14:39.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.562+0000 7f63a4a81740 1 Processor -- start 2024-09-19T06:14:39.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.562+0000 7f63a4a81740 1 -- start start 2024-09-19T06:14:39.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.562+0000 7f63a4a81740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e87423c9d0 0x55e87423cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:39.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.562+0000 7f63a4a81740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e87423d2f0 0x55e874247670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:39.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.562+0000 7f63a4a81740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e874247bb0 0x55e874249fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:39.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.563+0000 7f63a4a81740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e8741a3090 con 0x55e87423d2f0 2024-09-19T06:14:39.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.563+0000 7f63a4a81740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55e87414aa70 con 0x55e87423c9d0 2024-09-19T06:14:39.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.563+0000 7f63a4a81740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55e87419f050 con 0x55e874247bb0 2024-09-19T06:14:39.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.563+0000 7f63997fa640 1 --2- 172.21.15.2:0/3006377880 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f63840a3350 0x7f63840a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:39.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.563+0000 7f639bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e87423d2f0 0x55e874247670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:39.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.563+0000 7f639bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e87423d2f0 0x55e874247670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60136/0 (socket says 172.21.15.2:60136) 2024-09-19T06:14:39.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.563+0000 7f639bfff640 1 -- 172.21.15.2:0/566195775 learned_addr learned my addr 172.21.15.2:0/566195775 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:39.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.563+0000 7f639b7fe640 1 --2- 172.21.15.2:0/566195775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e874247bb0 0x55e874249fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:39.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.563+0000 7f63a0c45640 1 --2- 172.21.15.2:0/3006377880 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f63840a3350 0x7f63840a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:39.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.563+0000 7f63a0c45640 1 --2- 172.21.15.2:0/566195775 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e87423c9d0 0x55e87423cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:39.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.563+0000 7f63997fa640 1 -- 172.21.15.2:0/3006377880 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f63900f01a0 con 0x7f639c101420 2024-09-19T06:14:39.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.563+0000 7f639bfff640 1 -- 172.21.15.2:0/566195775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e874247bb0 msgr2=0x55e874249fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:39.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.563+0000 7f639bfff640 1 --2- 172.21.15.2:0/566195775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e874247bb0 0x55e874249fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:39.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.563+0000 7f639bfff640 1 -- 172.21.15.2:0/566195775 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e87423c9d0 msgr2=0x55e87423cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:39.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.563+0000 7f639bfff640 1 --2- 172.21.15.2:0/566195775 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e87423c9d0 0x55e87423cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:39.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.563+0000 7f639bfff640 1 -- 172.21.15.2:0/566195775 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e874157130 con 0x55e87423d2f0 2024-09-19T06:14:39.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.563+0000 7f639bfff640 1 --2- 172.21.15.2:0/566195775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e87423d2f0 0x55e874247670 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f638c009a70 tx=0x7f638c009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c04f86d449046f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:39.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.563+0000 7f63a0c45640 1 --2- 172.21.15.2:0/3006377880 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f63840a3350 0x7f63840a5810 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6394005fd0 tx=0x7f6394009b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:39.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.563+0000 7f63827fc640 1 -- 172.21.15.2:0/566195775 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638c017070 con 0x55e87423d2f0 2024-09-19T06:14:39.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.563+0000 7f63827fc640 1 -- 172.21.15.2:0/566195775 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f638c013470 con 0x55e87423d2f0 2024-09-19T06:14:39.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.564+0000 7f63827fc640 1 -- 172.21.15.2:0/566195775 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638c012630 con 0x55e87423d2f0 2024-09-19T06:14:39.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.564+0000 7f63a4a81740 1 -- 172.21.15.2:0/566195775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e87423d2f0 msgr2=0x55e874247670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:39.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.564+0000 7f63a4a81740 1 --2- 172.21.15.2:0/566195775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e87423d2f0 0x55e874247670 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f638c009a70 tx=0x7f638c009f30 comp rx=0 tx=0).stop 2024-09-19T06:14:39.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.564+0000 7f63a4a81740 1 -- 172.21.15.2:0/566195775 shutdown_connections 2024-09-19T06:14:39.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.564+0000 7f63a4a81740 1 --2- 172.21.15.2:0/566195775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e874247bb0 0x55e874249fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:39.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.564+0000 7f63a4a81740 1 --2- 172.21.15.2:0/566195775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e87423d2f0 0x55e874247670 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:39.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.564+0000 7f63a4a81740 1 --2- 172.21.15.2:0/566195775 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e87423c9d0 0x55e87423cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:39.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.564+0000 7f63a4a81740 1 -- 172.21.15.2:0/566195775 >> 172.21.15.2:0/566195775 conn(0x55e874238f60 msgr2=0x55e874239340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:39.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.564+0000 7f63a4a81740 1 -- 172.21.15.2:0/566195775 shutdown_connections 2024-09-19T06:14:39.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.564+0000 7f63a4a81740 1 -- 172.21.15.2:0/566195775 wait complete. 2024-09-19T06:14:39.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.565+0000 7f63a4a81740 1 -- start start 2024-09-19T06:14:39.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.565+0000 7f63a4a81740 1 Processor -- start 2024-09-19T06:14:39.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.565+0000 7f63a4a81740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e87423c9d0 0x55e8742473e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:39.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.565+0000 7f63a4a81740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e87423d2f0 0x55e874244730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:39.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.565+0000 7f63a4a81740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e874247bb0 0x55e874244c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:39.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.565+0000 7f63a4a81740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e87424a780 con 0x55e874247bb0 2024-09-19T06:14:39.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.565+0000 7f63a4a81740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55e87415df20 con 0x55e87423c9d0 2024-09-19T06:14:39.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.565+0000 7f63a4a81740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55e87424a900 con 0x55e87423d2f0 2024-09-19T06:14:39.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.565+0000 7f63a4a81740 10 client.0 _ll_register_callbacks cb 0x55e874127030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:39.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.565+0000 7f63a0c45640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e874247bb0 0x55e874244c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:39.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.565+0000 7f63a0c45640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e874247bb0 0x55e874244c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60144/0 (socket says 172.21.15.2:60144) 2024-09-19T06:14:39.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.565+0000 7f63a0c45640 1 -- 172.21.15.2:0/1131642998 learned_addr learned my addr 172.21.15.2:0/1131642998 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:39.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.566+0000 7f639bfff640 1 --2- 172.21.15.2:0/1131642998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e87423c9d0 0x55e8742473e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:39.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.566+0000 7f639b7fe640 1 --2- 172.21.15.2:0/1131642998 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e87423d2f0 0x55e874244730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:39.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.566+0000 7f63a0c45640 1 -- 172.21.15.2:0/1131642998 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e87423d2f0 msgr2=0x55e874244730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:39.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.566+0000 7f63a0c45640 1 --2- 172.21.15.2:0/1131642998 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e87423d2f0 0x55e874244730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:39.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.566+0000 7f63a0c45640 1 -- 172.21.15.2:0/1131642998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e87423c9d0 msgr2=0x55e8742473e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:39.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.566+0000 7f63a0c45640 1 --2- 172.21.15.2:0/1131642998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e87423c9d0 0x55e8742473e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:39.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.566+0000 7f63a0c45640 1 -- 172.21.15.2:0/1131642998 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e873f142b0 con 0x55e874247bb0 2024-09-19T06:14:39.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.566+0000 7f639b7fe640 1 --2- 172.21.15.2:0/1131642998 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e87423d2f0 0x55e874244730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:14:39.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.566+0000 7f63a0c45640 1 --2- 172.21.15.2:0/1131642998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e874247bb0 0x55e874244c70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6394003cf0 tx=0x7f6394004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ba55d40bc86acce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:39.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.566+0000 7f637b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:14:39.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.566+0000 7f637b7fe640 1 -- 172.21.15.2:0/1131642998 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63940045b0 con 0x55e874247bb0 2024-09-19T06:14:39.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.566+0000 7f63a4a81740 1 -- 172.21.15.2:0/1131642998 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f638c013470 con 0x55e874247bb0 2024-09-19T06:14:39.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.566+0000 7f637b7fe640 1 -- 172.21.15.2:0/1131642998 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f6394004750 con 0x55e874247bb0 2024-09-19T06:14:39.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.566+0000 7f637b7fe640 1 -- 172.21.15.2:0/1131642998 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6394031050 con 0x55e874247bb0 2024-09-19T06:14:39.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.566+0000 7f63a4a81740 10 client.15096 fetch_fsmap learned FSMap version 25 2024-09-19T06:14:39.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.566+0000 7f63a4a81740 1 -- 172.21.15.2:0/1131642998 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e8742560e0 con 0x55e874247bb0 2024-09-19T06:14:39.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.567+0000 7f637b7fe640 1 -- 172.21.15.2:0/1131642998 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f638c013470 con 0x55e874247bb0 2024-09-19T06:14:39.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.567+0000 7f637b7fe640 1 -- 172.21.15.2:0/1131642998 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f639400f040 con 0x55e874247bb0 2024-09-19T06:14:39.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.567+0000 7f63a4a81740 10 client.15096 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T06:14:39.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.567+0000 7f63a4a81740 10 client.15096 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T06:14:39.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.567+0000 7f63a4a81740 20 client.15096 populate_metadata read hostname 'smithi002' 2024-09-19T06:14:39.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.567+0000 7f63a4a81740 1 --2- 172.21.15.2:0/1131642998 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55e874258760 0x55e874259bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:39.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.567+0000 7f63a4a81740 4 client.15096 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:14:39.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.567+0000 7f63a4a81740 1 -- 172.21.15.2:0/1131642998 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e8741b0600 con 0x55e874258760 2024-09-19T06:14:39.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.567+0000 7f639bfff640 1 --2- 172.21.15.2:0/1131642998 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55e874258760 0x55e874259bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:39.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.568+0000 7f639bfff640 1 --2- 172.21.15.2:0/1131642998 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55e874258760 0x55e874259bd0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3a733c09dd0bc8b server_cookie=2b814b0b3cc7021a in_seq=0 out_seq=0 2024-09-19T06:14:39.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.568+0000 7f637b7fe640 10 client.15096 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:14:39.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.568+0000 7f637b7fe640 1 -- 172.21.15.2:0/1131642998 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e8741b0600 con 0x55e874258760 2024-09-19T06:14:39.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.568+0000 7f637b7fe640 10 client.15096 handle_command_reply: tid=0 2024-09-19T06:14:39.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.568+0000 7f63a4a81740 1 client.15096 shutdown 2024-09-19T06:14:39.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.568+0000 7f63a4a81740 1 -- 172.21.15.2:0/1131642998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e874247bb0 msgr2=0x55e874244c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:39.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.568+0000 7f63a4a81740 1 --2- 172.21.15.2:0/1131642998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e874247bb0 0x55e874244c70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6394003cf0 tx=0x7f6394004ab0 comp rx=0 tx=0).stop 2024-09-19T06:14:39.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.569+0000 7f63a4a81740 1 -- 172.21.15.2:0/1131642998 shutdown_connections 2024-09-19T06:14:39.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.569+0000 7f63a4a81740 1 --2- 172.21.15.2:0/1131642998 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55e874258760 0x55e874259bd0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:39.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.569+0000 7f637b7fe640 0 client.15096 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:14:39.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.569+0000 7f63a4a81740 1 --2- 172.21.15.2:0/1131642998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e874247bb0 0x55e874244c70 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:39.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.569+0000 7f63a4a81740 1 --2- 172.21.15.2:0/1131642998 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e87423d2f0 0x55e874244730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:39.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.569+0000 7f63a4a81740 1 --2- 172.21.15.2:0/1131642998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e87423c9d0 0x55e8742473e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:39.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.569+0000 7f63a4a81740 1 -- 172.21.15.2:0/1131642998 >> 172.21.15.2:0/1131642998 conn(0x55e874238f60 msgr2=0x55e87423ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:39.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.569+0000 7f63a4a81740 1 -- 172.21.15.2:0/1131642998 shutdown_connections 2024-09-19T06:14:39.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.569+0000 7f63a4a81740 1 -- 172.21.15.2:0/1131642998 wait complete. 2024-09-19T06:14:39.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.569+0000 7f63a4a81740 20 client.15096 trim_cache size 0 max 16384 2024-09-19T06:14:39.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.586+0000 7f63a4a81740 1 Processor -- start 2024-09-19T06:14:39.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.586+0000 7f63a4a81740 1 -- start start 2024-09-19T06:14:39.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.587+0000 7f63a4a81740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e87423c9d0 0x55e874244010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:39.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.587+0000 7f63a4a81740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e87423d2f0 0x55e874257550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:39.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.587+0000 7f63a4a81740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e874247bb0 0x55e874237ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:39.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.587+0000 7f63a4a81740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e874257f10 con 0x55e874247bb0 2024-09-19T06:14:39.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.587+0000 7f63a4a81740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55e8742585e0 con 0x55e87423d2f0 2024-09-19T06:14:39.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.587+0000 7f63a4a81740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55e874258cb0 con 0x55e87423c9d0 2024-09-19T06:14:39.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.587+0000 7f63a0c45640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e874247bb0 0x55e874237ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:39.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.587+0000 7f63a0c45640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e874247bb0 0x55e874237ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60152/0 (socket says 172.21.15.2:60152) 2024-09-19T06:14:39.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.587+0000 7f63a0c45640 1 -- 172.21.15.2:0/3440983279 learned_addr learned my addr 172.21.15.2:0/3440983279 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:39.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.587+0000 7f639b7fe640 1 --2- 172.21.15.2:0/3440983279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e87423d2f0 0x55e874257550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:39.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.587+0000 7f639bfff640 1 --2- 172.21.15.2:0/3440983279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e87423c9d0 0x55e874244010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:39.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.587+0000 7f63a0c45640 1 -- 172.21.15.2:0/3440983279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e87423c9d0 msgr2=0x55e874244010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:39.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.587+0000 7f63a0c45640 1 --2- 172.21.15.2:0/3440983279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e87423c9d0 0x55e874244010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:39.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.587+0000 7f63a0c45640 1 -- 172.21.15.2:0/3440983279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e87423d2f0 msgr2=0x55e874257550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:39.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.587+0000 7f63a0c45640 1 --2- 172.21.15.2:0/3440983279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e87423d2f0 0x55e874257550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:39.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.587+0000 7f63a0c45640 1 -- 172.21.15.2:0/3440983279 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e874242c80 con 0x55e874247bb0 2024-09-19T06:14:39.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.587+0000 7f63a0c45640 1 --2- 172.21.15.2:0/3440983279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e874247bb0 0x55e874237ef0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f63940108a0 tx=0x7f6394009e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bebbc553b843d71e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:39.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.587+0000 7f6381ffb640 1 -- 172.21.15.2:0/3440983279 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6394009970 con 0x55e874247bb0 2024-09-19T06:14:39.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.588+0000 7f6381ffb640 1 -- 172.21.15.2:0/3440983279 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6394005830 con 0x55e874247bb0 2024-09-19T06:14:39.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.588+0000 7f6381ffb640 1 -- 172.21.15.2:0/3440983279 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6394005240 con 0x55e874247bb0 2024-09-19T06:14:39.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.588+0000 7f63a4a81740 1 -- 172.21.15.2:0/3440983279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e874247bb0 msgr2=0x55e874237ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:39.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.588+0000 7f63a4a81740 1 --2- 172.21.15.2:0/3440983279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e874247bb0 0x55e874237ef0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f63940108a0 tx=0x7f6394009e40 comp rx=0 tx=0).stop 2024-09-19T06:14:39.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.588+0000 7f63a4a81740 1 -- 172.21.15.2:0/3440983279 shutdown_connections 2024-09-19T06:14:39.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.588+0000 7f63a4a81740 1 --2- 172.21.15.2:0/3440983279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e874247bb0 0x55e874237ef0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:39.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.588+0000 7f63a4a81740 1 --2- 172.21.15.2:0/3440983279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e87423d2f0 0x55e874257550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:39.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.588+0000 7f63a4a81740 1 --2- 172.21.15.2:0/3440983279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e87423c9d0 0x55e874244010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:39.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.588+0000 7f63a4a81740 1 -- 172.21.15.2:0/3440983279 >> 172.21.15.2:0/3440983279 conn(0x55e874238f60 msgr2=0x55e8742377e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:39.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.588+0000 7f63a4a81740 1 -- 172.21.15.2:0/3440983279 shutdown_connections 2024-09-19T06:14:39.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.588+0000 7f63a4a81740 1 -- 172.21.15.2:0/3440983279 wait complete. 2024-09-19T06:14:39.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.588+0000 7f63a4a81740 1 -- start start 2024-09-19T06:14:39.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.589+0000 7f63a4a81740 1 Processor -- start 2024-09-19T06:14:39.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.589+0000 7f63a4a81740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e87423c9d0 0x55e874261fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:39.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.589+0000 7f63a4a81740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e87423d2f0 0x55e874262500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:39.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.589+0000 7f63a4a81740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e874247bb0 0x55e87425b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:39.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.589+0000 7f63a4a81740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e874259a50 con 0x55e87423c9d0 2024-09-19T06:14:39.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.589+0000 7f63a4a81740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55e874259380 con 0x55e87423d2f0 2024-09-19T06:14:39.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.589+0000 7f639bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e87423c9d0 0x55e874261fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:39.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.589+0000 7f63a4a81740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55e87425a120 con 0x55e874247bb0 2024-09-19T06:14:39.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.589+0000 7f639bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e87423c9d0 0x55e874261fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60162/0 (socket says 172.21.15.2:60162) 2024-09-19T06:14:39.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.589+0000 7f639bfff640 1 -- 172.21.15.2:0/3474719603 learned_addr learned my addr 172.21.15.2:0/3474719603 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:39.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.589+0000 7f63a4a81740 10 client.0 _ll_register_callbacks cb 0x7f6394003970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:39.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.589+0000 7f639b7fe640 1 --2- 172.21.15.2:0/3474719603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e87423d2f0 0x55e874262500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:39.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.589+0000 7f63a0c45640 1 --2- 172.21.15.2:0/3474719603 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e874247bb0 0x55e87425b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:39.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.589+0000 7f639bfff640 1 -- 172.21.15.2:0/3474719603 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e874247bb0 msgr2=0x55e87425b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:39.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.589+0000 7f639bfff640 1 --2- 172.21.15.2:0/3474719603 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e874247bb0 0x55e87425b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:39.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.589+0000 7f639bfff640 1 -- 172.21.15.2:0/3474719603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e87423d2f0 msgr2=0x55e874262500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:39.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.589+0000 7f639bfff640 1 --2- 172.21.15.2:0/3474719603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e87423d2f0 0x55e874262500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:39.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.589+0000 7f639bfff640 1 -- 172.21.15.2:0/3474719603 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e87425bb00 con 0x55e87423c9d0 2024-09-19T06:14:39.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.590+0000 7f639b7fe640 1 --2- 172.21.15.2:0/3474719603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e87423d2f0 0x55e874262500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:14:39.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.590+0000 7f639bfff640 1 --2- 172.21.15.2:0/3474719603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e87423c9d0 0x55e874261fc0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f638c008010 tx=0x7f638c013dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50058e2c795d370b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:39.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.590+0000 7f637b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:14:39.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.590+0000 7f637b7fe640 1 -- 172.21.15.2:0/3474719603 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638c017040 con 0x55e87423c9d0 2024-09-19T06:14:39.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.590+0000 7f63a4a81740 1 -- 172.21.15.2:0/3474719603 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6394005830 con 0x55e87423c9d0 2024-09-19T06:14:39.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.590+0000 7f637b7fe640 1 -- 172.21.15.2:0/3474719603 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f638c0059c0 con 0x55e87423c9d0 2024-09-19T06:14:39.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.590+0000 7f637b7fe640 1 -- 172.21.15.2:0/3474719603 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f638c005bc0 con 0x55e87423c9d0 2024-09-19T06:14:39.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.590+0000 7f63a4a81740 10 client.15102 fetch_fsmap learned FSMap version 25 2024-09-19T06:14:39.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.590+0000 7f63a4a81740 1 -- 172.21.15.2:0/3474719603 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e874260520 con 0x55e87423c9d0 2024-09-19T06:14:39.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.590+0000 7f637b7fe640 1 -- 172.21.15.2:0/3474719603 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6394005830 con 0x55e87423c9d0 2024-09-19T06:14:39.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.590+0000 7f637b7fe640 1 -- 172.21.15.2:0/3474719603 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f638c006040 con 0x55e87423c9d0 2024-09-19T06:14:39.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.591+0000 7f63a4a81740 10 client.15102 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T06:14:39.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.591+0000 7f63a4a81740 10 client.15102 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T06:14:39.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.591+0000 7f63a4a81740 20 client.15102 populate_metadata read hostname 'smithi002' 2024-09-19T06:14:39.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.591+0000 7f63a4a81740 1 --2- 172.21.15.2:0/3474719603 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55e874258760 0x55e8742c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:39.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.591+0000 7f63a4a81740 4 client.15102 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:14:39.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.591+0000 7f63a4a81740 1 -- 172.21.15.2:0/3474719603 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "status"}) -- 0x55e8741aab10 con 0x55e874258760 2024-09-19T06:14:39.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.591+0000 7f639b7fe640 1 --2- 172.21.15.2:0/3474719603 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55e874258760 0x55e8742c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:39.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.591+0000 7f639b7fe640 1 --2- 172.21.15.2:0/3474719603 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55e874258760 0x55e8742c5de0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d6d4581cc27ed01 server_cookie=578130d8675b1aa in_seq=0 out_seq=0 2024-09-19T06:14:39.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.591+0000 7f637b7fe640 10 client.15102 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:14:39.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.592+0000 7f637b7fe640 1 -- 172.21.15.2:0/3474719603 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55e8741aab10 con 0x55e874258760 2024-09-19T06:14:39.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.592+0000 7f637b7fe640 10 client.15102 handle_command_reply: tid=0 2024-09-19T06:14:39.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.592+0000 7f63a4a81740 1 client.15102 shutdown 2024-09-19T06:14:39.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.592+0000 7f63a4a81740 1 -- 172.21.15.2:0/3474719603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e87423c9d0 msgr2=0x55e874261fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:39.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.592+0000 7f63a4a81740 1 --2- 172.21.15.2:0/3474719603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e87423c9d0 0x55e874261fc0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f638c008010 tx=0x7f638c013dc0 comp rx=0 tx=0).stop 2024-09-19T06:14:39.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.592+0000 7f63a4a81740 1 -- 172.21.15.2:0/3474719603 shutdown_connections 2024-09-19T06:14:39.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.592+0000 7f63a4a81740 1 --2- 172.21.15.2:0/3474719603 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55e874258760 0x55e8742c5de0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:39.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.592+0000 7f63a4a81740 1 --2- 172.21.15.2:0/3474719603 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e874247bb0 0x55e87425b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:39.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.592+0000 7f63a4a81740 1 --2- 172.21.15.2:0/3474719603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e87423d2f0 0x55e874262500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:39.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.592+0000 7f63a4a81740 1 --2- 172.21.15.2:0/3474719603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e87423c9d0 0x55e874261fc0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:39.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.592+0000 7f63a4a81740 1 -- 172.21.15.2:0/3474719603 >> 172.21.15.2:0/3474719603 conn(0x55e874238f60 msgr2=0x55e874238000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:39.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.592+0000 7f637b7fe640 0 client.15102 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:14:39.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.592+0000 7f63a4a81740 1 -- 172.21.15.2:0/3474719603 shutdown_connections 2024-09-19T06:14:39.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.592+0000 7f63a4a81740 1 -- 172.21.15.2:0/3474719603 wait complete. 2024-09-19T06:14:39.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.592+0000 7f63a4a81740 20 client.15102 trim_cache size 0 max 16384 2024-09-19T06:14:39.600 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:14:39.600 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "078f6612-764d-11ef-bceb-c7b262605968", 2024-09-19T06:14:39.600 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 1, 2024-09-19T06:14:39.600 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24472, 2024-09-19T06:14:39.600 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-09-19T06:14:39.600 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-09-19T06:14:39.600 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-09-19T06:14:39.600 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 87.768858199999997, 2024-09-19T06:14:39.601 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 25, 2024-09-19T06:14:39.601 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 81, 2024-09-19T06:14:39.601 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 81, 2024-09-19T06:14:39.601 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 115.504674384 2024-09-19T06:14:39.601 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:14:39.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.593+0000 7f63a26a8640 1 -- 172.21.15.2:0/3006377880 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f63840a3350 msgr2=0x7f63840a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:39.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.593+0000 7f63a26a8640 1 --2- 172.21.15.2:0/3006377880 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f63840a3350 0x7f63840a5810 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6394005fd0 tx=0x7f6394009b50 comp rx=0 tx=0).stop 2024-09-19T06:14:39.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.593+0000 7f63a26a8640 1 -- 172.21.15.2:0/3006377880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f639c101420 msgr2=0x7f639c19ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:39.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.593+0000 7f63a26a8640 1 --2- 172.21.15.2:0/3006377880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f639c101420 0x7f639c19ab20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6390005ab0 tx=0x7f6390003cd0 comp rx=0 tx=0).stop 2024-09-19T06:14:39.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.593+0000 7f63a26a8640 1 -- 172.21.15.2:0/3006377880 shutdown_connections 2024-09-19T06:14:39.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.593+0000 7f63a26a8640 1 --2- 172.21.15.2:0/3006377880 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f63840a3350 0x7f63840a5810 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:39.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.593+0000 7f63a26a8640 1 --2- 172.21.15.2:0/3006377880 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f639c106a80 0x7f639c19eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:39.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.593+0000 7f63a26a8640 1 --2- 172.21.15.2:0/3006377880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f639c101420 0x7f639c19ab20 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:39.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.593+0000 7f63a26a8640 1 --2- 172.21.15.2:0/3006377880 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f639c100a80 0x7f639c19a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:39.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.593+0000 7f63a26a8640 1 -- 172.21.15.2:0/3006377880 >> 172.21.15.2:0/3006377880 conn(0x7f639c0fc7a0 msgr2=0x7f639c06a810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:39.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.593+0000 7f63a26a8640 1 -- 172.21.15.2:0/3006377880 shutdown_connections 2024-09-19T06:14:39.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:39.593+0000 7f63a26a8640 1 -- 172.21.15.2:0/3006377880 wait complete. 2024-09-19T06:14:40.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:39 smithi002 ceph-mon[30982]: pgmap v324: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:40.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:39 smithi090 ceph-mon[34497]: pgmap v324: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:40.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:39 smithi089 ceph-mon[34160]: pgmap v324: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:14:40.335 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T06:14:40.602 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:41.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.083+0000 7f7a75c81640 1 -- 172.21.15.2:0/3766905922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a701082a0 msgr2=0x7f7a7010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:41.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.083+0000 7f7a75c81640 1 --2- 172.21.15.2:0/3766905922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a701082a0 0x7f7a7010ec40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7a68009cd0 tx=0x7f7a6802a910 comp rx=0 tx=0).stop 2024-09-19T06:14:41.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.083+0000 7f7a75c81640 1 -- 172.21.15.2:0/3766905922 shutdown_connections 2024-09-19T06:14:41.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.083+0000 7f7a75c81640 1 --2- 172.21.15.2:0/3766905922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a701082a0 0x7f7a7010ec40 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:41.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.083+0000 7f7a75c81640 1 --2- 172.21.15.2:0/3766905922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a701036e0 0x7f7a70107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:41.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.083+0000 7f7a75c81640 1 --2- 172.21.15.2:0/3766905922 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a70102d30 0x7f7a70103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:41.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.083+0000 7f7a75c81640 1 -- 172.21.15.2:0/3766905922 >> 172.21.15.2:0/3766905922 conn(0x7f7a700fc7d0 msgr2=0x7f7a700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:41.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.083+0000 7f7a75c81640 1 -- 172.21.15.2:0/3766905922 shutdown_connections 2024-09-19T06:14:41.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.083+0000 7f7a75c81640 1 -- 172.21.15.2:0/3766905922 wait complete. 2024-09-19T06:14:41.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.084+0000 7f7a75c81640 1 Processor -- start 2024-09-19T06:14:41.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.084+0000 7f7a75c81640 1 -- start start 2024-09-19T06:14:41.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.084+0000 7f7a75c81640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a70102d30 0x7f7a70100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:41.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.084+0000 7f7a75c81640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a701036e0 0x7f7a70100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:41.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.084+0000 7f7a75c81640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a701082a0 0x7f7a70101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:41.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.084+0000 7f7a75c81640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7a70112010 con 0x7f7a701036e0 2024-09-19T06:14:41.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.084+0000 7f7a75c81640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7a70111e90 con 0x7f7a70102d30 2024-09-19T06:14:41.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.084+0000 7f7a75c81640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7a70112190 con 0x7f7a701082a0 2024-09-19T06:14:41.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.084+0000 7f7a6effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a701036e0 0x7f7a70100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:41.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.084+0000 7f7a6effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a701036e0 0x7f7a70100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60178/0 (socket says 172.21.15.2:60178) 2024-09-19T06:14:41.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.084+0000 7f7a6effd640 1 -- 172.21.15.2:0/1249731226 learned_addr learned my addr 172.21.15.2:0/1249731226 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:41.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.084+0000 7f7a6f7fe640 1 --2- 172.21.15.2:0/1249731226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a70102d30 0x7f7a70100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:41.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.084+0000 7f7a6ffff640 1 --2- 172.21.15.2:0/1249731226 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a701082a0 0x7f7a70101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:41.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.085+0000 7f7a6effd640 1 -- 172.21.15.2:0/1249731226 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a701082a0 msgr2=0x7f7a70101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:41.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.085+0000 7f7a6effd640 1 --2- 172.21.15.2:0/1249731226 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a701082a0 0x7f7a70101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:41.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.085+0000 7f7a6effd640 1 -- 172.21.15.2:0/1249731226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a70102d30 msgr2=0x7f7a70100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:41.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.085+0000 7f7a6effd640 1 --2- 172.21.15.2:0/1249731226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a70102d30 0x7f7a70100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:41.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.085+0000 7f7a6effd640 1 -- 172.21.15.2:0/1249731226 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a701a6a90 con 0x7f7a701036e0 2024-09-19T06:14:41.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.085+0000 7f7a6effd640 1 --2- 172.21.15.2:0/1249731226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a701036e0 0x7f7a70100ed0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7a60006fd0 tx=0x7f7a6000b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:41.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.085+0000 7f7a6cff9640 1 -- 172.21.15.2:0/1249731226 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a60015020 con 0x7f7a701036e0 2024-09-19T06:14:41.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.085+0000 7f7a6cff9640 1 -- 172.21.15.2:0/1249731226 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7a60011ce0 con 0x7f7a701036e0 2024-09-19T06:14:41.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.085+0000 7f7a6cff9640 1 -- 172.21.15.2:0/1249731226 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a60010d90 con 0x7f7a701036e0 2024-09-19T06:14:41.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.085+0000 7f7a75c81640 1 -- 172.21.15.2:0/1249731226 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a701a6d80 con 0x7f7a701036e0 2024-09-19T06:14:41.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.085+0000 7f7a75c81640 1 -- 172.21.15.2:0/1249731226 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a701a7260 con 0x7f7a701036e0 2024-09-19T06:14:41.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.088+0000 7f7a6cff9640 1 -- 172.21.15.2:0/1249731226 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f7a60018020 con 0x7f7a701036e0 2024-09-19T06:14:41.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.088+0000 7f7a7805a740 1 Processor -- start 2024-09-19T06:14:41.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.088+0000 7f7a7805a740 1 -- start start 2024-09-19T06:14:41.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.088+0000 7f7a7805a740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6c122b9d0 0x55e6c122bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:41.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.088+0000 7f7a7805a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6c122c2f0 0x55e6c1236670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:41.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.088+0000 7f7a7805a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6c1236bb0 0x55e6c1238fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:41.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.089+0000 7f7a7805a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e6c1192090 con 0x55e6c1236bb0 2024-09-19T06:14:41.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.089+0000 7f7a7805a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55e6c1139a70 con 0x55e6c122c2f0 2024-09-19T06:14:41.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.089+0000 7f7a7805a740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55e6c118e050 con 0x55e6c122b9d0 2024-09-19T06:14:41.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.089+0000 7f7a6effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6c1236bb0 0x55e6c1238fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:41.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.089+0000 7f7a6effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6c1236bb0 0x55e6c1238fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60182/0 (socket says 172.21.15.2:60182) 2024-09-19T06:14:41.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.089+0000 7f7a6effd640 1 -- 172.21.15.2:0/2528967300 learned_addr learned my addr 172.21.15.2:0/2528967300 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:41.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.089+0000 7f7a6f7fe640 1 --2- 172.21.15.2:0/2528967300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6c122c2f0 0x55e6c1236670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:41.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.089+0000 7f7a6ffff640 1 --2- 172.21.15.2:0/2528967300 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6c122b9d0 0x55e6c122bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:41.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.089+0000 7f7a6effd640 1 -- 172.21.15.2:0/2528967300 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6c122b9d0 msgr2=0x55e6c122bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:41.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.089+0000 7f7a6effd640 1 --2- 172.21.15.2:0/2528967300 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6c122b9d0 0x55e6c122bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:41.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.089+0000 7f7a6effd640 1 -- 172.21.15.2:0/2528967300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6c122c2f0 msgr2=0x55e6c1236670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:41.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.089+0000 7f7a6effd640 1 --2- 172.21.15.2:0/2528967300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6c122c2f0 0x55e6c1236670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:41.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.089+0000 7f7a6effd640 1 -- 172.21.15.2:0/2528967300 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6c1146130 con 0x55e6c1236bb0 2024-09-19T06:14:41.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.089+0000 7f7a6f7fe640 1 --2- 172.21.15.2:0/2528967300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6c122c2f0 0x55e6c1236670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:41.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.089+0000 7f7a6cff9640 1 --2- 172.21.15.2:0/1249731226 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f7a5c0a3350 0x7f7a5c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:41.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.089+0000 7f7a6ffff640 1 --2- 172.21.15.2:0/1249731226 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f7a5c0a3350 0x7f7a5c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:41.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.089+0000 7f7a6cff9640 1 -- 172.21.15.2:0/1249731226 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f7a600cf1c0 con 0x7f7a701036e0 2024-09-19T06:14:41.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.089+0000 7f7a6effd640 1 --2- 172.21.15.2:0/2528967300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6c1236bb0 0x55e6c1238fa0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7a600ccbd0 tx=0x7f7a600d7910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17cbe575b75c102c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:41.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.090+0000 7f7a65ffb640 1 -- 172.21.15.2:0/2528967300 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a60097a40 con 0x55e6c1236bb0 2024-09-19T06:14:41.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.090+0000 7f7a65ffb640 1 -- 172.21.15.2:0/2528967300 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7a60010410 con 0x55e6c1236bb0 2024-09-19T06:14:41.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.090+0000 7f7a65ffb640 1 -- 172.21.15.2:0/2528967300 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6009b100 con 0x55e6c1236bb0 2024-09-19T06:14:41.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.090+0000 7f7a7805a740 1 -- 172.21.15.2:0/2528967300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6c1236bb0 msgr2=0x55e6c1238fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:41.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.090+0000 7f7a7805a740 1 --2- 172.21.15.2:0/2528967300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6c1236bb0 0x55e6c1238fa0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7a600ccbd0 tx=0x7f7a600d7910 comp rx=0 tx=0).stop 2024-09-19T06:14:41.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.090+0000 7f7a6ffff640 1 --2- 172.21.15.2:0/1249731226 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f7a5c0a3350 0x7f7a5c0a5810 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7a68009430 tx=0x7f7a68009820 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:41.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.091+0000 7f7a7805a740 1 -- 172.21.15.2:0/2528967300 shutdown_connections 2024-09-19T06:14:41.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.091+0000 7f7a7805a740 1 --2- 172.21.15.2:0/2528967300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6c1236bb0 0x55e6c1238fa0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:41.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.091+0000 7f7a7805a740 1 --2- 172.21.15.2:0/2528967300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6c122c2f0 0x55e6c1236670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:41.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.091+0000 7f7a7805a740 1 --2- 172.21.15.2:0/2528967300 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6c122b9d0 0x55e6c122bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:41.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.091+0000 7f7a7805a740 1 -- 172.21.15.2:0/2528967300 >> 172.21.15.2:0/2528967300 conn(0x55e6c1227f60 msgr2=0x55e6c1228340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:41.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.091+0000 7f7a7805a740 1 -- 172.21.15.2:0/2528967300 shutdown_connections 2024-09-19T06:14:41.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.091+0000 7f7a7805a740 1 -- 172.21.15.2:0/2528967300 wait complete. 2024-09-19T06:14:41.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.091+0000 7f7a7805a740 1 -- start start 2024-09-19T06:14:41.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.091+0000 7f7a7805a740 1 Processor -- start 2024-09-19T06:14:41.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.091+0000 7f7a7805a740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6c122b9d0 0x55e6c12363f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:41.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.091+0000 7f7a7805a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6c122c2f0 0x55e6c1233740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:41.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.091+0000 7f7a7805a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6c1236bb0 0x55e6c1233c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:41.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.091+0000 7f7a7805a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e6c1239600 con 0x55e6c1236bb0 2024-09-19T06:14:41.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.091+0000 7f7a7805a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55e6c114cf20 con 0x55e6c122c2f0 2024-09-19T06:14:41.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.091+0000 7f7a7805a740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55e6c1239780 con 0x55e6c122b9d0 2024-09-19T06:14:41.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.092+0000 7f7a7805a740 10 client.0 _ll_register_callbacks cb 0x55e6c1116030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:41.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.092+0000 7f7a6ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6c1236bb0 0x55e6c1233c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:41.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.092+0000 7f7a6ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6c1236bb0 0x55e6c1233c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60198/0 (socket says 172.21.15.2:60198) 2024-09-19T06:14:41.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.092+0000 7f7a6ffff640 1 -- 172.21.15.2:0/3588720637 learned_addr learned my addr 172.21.15.2:0/3588720637 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:41.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.092+0000 7f7a6effd640 1 --2- 172.21.15.2:0/3588720637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6c122c2f0 0x55e6c1233740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:41.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.092+0000 7f7a6f7fe640 1 --2- 172.21.15.2:0/3588720637 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6c122b9d0 0x55e6c12363f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:41.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.092+0000 7f7a6ffff640 1 -- 172.21.15.2:0/3588720637 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6c122b9d0 msgr2=0x55e6c12363f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:41.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.092+0000 7f7a6ffff640 1 --2- 172.21.15.2:0/3588720637 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6c122b9d0 0x55e6c12363f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:41.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.092+0000 7f7a6ffff640 1 -- 172.21.15.2:0/3588720637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6c122c2f0 msgr2=0x55e6c1233740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:41.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.092+0000 7f7a6ffff640 1 --2- 172.21.15.2:0/3588720637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6c122c2f0 0x55e6c1233740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:41.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.092+0000 7f7a6ffff640 1 -- 172.21.15.2:0/3588720637 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6c0f032b0 con 0x55e6c1236bb0 2024-09-19T06:14:41.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.092+0000 7f7a6f7fe640 1 --2- 172.21.15.2:0/3588720637 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6c122b9d0 0x55e6c12363f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:41.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.092+0000 7f7a6ffff640 1 --2- 172.21.15.2:0/3588720637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6c1236bb0 0x55e6c1233c80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7a68033000 tx=0x7f7a6802a910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d0f6aea2a2d01e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:41.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.092+0000 7f7a4effd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:14:41.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.092+0000 7f7a4effd640 1 -- 172.21.15.2:0/3588720637 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a68003d80 con 0x55e6c1236bb0 2024-09-19T06:14:41.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.092+0000 7f7a4effd640 1 -- 172.21.15.2:0/3588720637 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f7a68004040 con 0x55e6c1236bb0 2024-09-19T06:14:41.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.093+0000 7f7a7805a740 1 -- 172.21.15.2:0/3588720637 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e6c119f600 con 0x55e6c1236bb0 2024-09-19T06:14:41.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.093+0000 7f7a4effd640 1 -- 172.21.15.2:0/3588720637 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7a68004240 con 0x55e6c1236bb0 2024-09-19T06:14:41.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.093+0000 7f7a7805a740 10 client.15114 fetch_fsmap learned FSMap version 25 2024-09-19T06:14:41.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.093+0000 7f7a7805a740 1 -- 172.21.15.2:0/3588720637 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e6c1244ef0 con 0x55e6c1236bb0 2024-09-19T06:14:41.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.093+0000 7f7a4effd640 1 -- 172.21.15.2:0/3588720637 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55e6c119f600 con 0x55e6c1236bb0 2024-09-19T06:14:41.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.093+0000 7f7a4effd640 1 -- 172.21.15.2:0/3588720637 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7a68051070 con 0x55e6c1236bb0 2024-09-19T06:14:41.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.093+0000 7f7a7805a740 10 client.15114 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T06:14:41.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.093+0000 7f7a7805a740 10 client.15114 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T06:14:41.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.093+0000 7f7a7805a740 20 client.15114 populate_metadata read hostname 'smithi002' 2024-09-19T06:14:41.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.093+0000 7f7a7805a740 1 --2- 172.21.15.2:0/3588720637 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55e6c1247510 0x55e6c1248980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:41.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.093+0000 7f7a7805a740 4 client.15114 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:14:41.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.093+0000 7f7a7805a740 1 -- 172.21.15.2:0/3588720637 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6c1199b10 con 0x55e6c1247510 2024-09-19T06:14:41.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.094+0000 7f7a6f7fe640 1 --2- 172.21.15.2:0/3588720637 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55e6c1247510 0x55e6c1248980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:41.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.094+0000 7f7a6f7fe640 1 --2- 172.21.15.2:0/3588720637 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55e6c1247510 0x55e6c1248980 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55e54c57aa5a7825 server_cookie=5e54693c7641c858 in_seq=0 out_seq=0 2024-09-19T06:14:41.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.094+0000 7f7a4effd640 10 client.15114 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:14:41.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.095+0000 7f7a4effd640 1 -- 172.21.15.2:0/3588720637 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e6c1199b10 con 0x55e6c1247510 2024-09-19T06:14:41.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.095+0000 7f7a4effd640 10 client.15114 handle_command_reply: tid=0 2024-09-19T06:14:41.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.095+0000 7f7a7805a740 1 client.15114 shutdown 2024-09-19T06:14:41.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.095+0000 7f7a7805a740 1 -- 172.21.15.2:0/3588720637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6c1236bb0 msgr2=0x55e6c1233c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:41.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.095+0000 7f7a7805a740 1 --2- 172.21.15.2:0/3588720637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6c1236bb0 0x55e6c1233c80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7a68033000 tx=0x7f7a6802a910 comp rx=0 tx=0).stop 2024-09-19T06:14:41.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.095+0000 7f7a7805a740 1 -- 172.21.15.2:0/3588720637 shutdown_connections 2024-09-19T06:14:41.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.095+0000 7f7a7805a740 1 --2- 172.21.15.2:0/3588720637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6c1236bb0 0x55e6c1233c80 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:41.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.095+0000 7f7a7805a740 1 --2- 172.21.15.2:0/3588720637 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55e6c1247510 0x55e6c1248980 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:41.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.095+0000 7f7a7805a740 1 --2- 172.21.15.2:0/3588720637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6c122c2f0 0x55e6c1233740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:41.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.095+0000 7f7a7805a740 1 --2- 172.21.15.2:0/3588720637 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6c122b9d0 0x55e6c12363f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:41.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.095+0000 7f7a7805a740 1 -- 172.21.15.2:0/3588720637 >> 172.21.15.2:0/3588720637 conn(0x55e6c1227f60 msgr2=0x55e6c122dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:41.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.095+0000 7f7a4effd640 0 client.15114 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:14:41.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.095+0000 7f7a7805a740 1 -- 172.21.15.2:0/3588720637 shutdown_connections 2024-09-19T06:14:41.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.095+0000 7f7a7805a740 1 -- 172.21.15.2:0/3588720637 wait complete. 2024-09-19T06:14:41.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.095+0000 7f7a7805a740 20 client.15114 trim_cache size 0 max 16384 2024-09-19T06:14:41.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.113+0000 7f7a7805a740 1 Processor -- start 2024-09-19T06:14:41.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.114+0000 7f7a7805a740 1 -- start start 2024-09-19T06:14:41.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.114+0000 7f7a7805a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6c122b9d0 0x55e6c1247510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:41.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.114+0000 7f7a7805a740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6c122c2f0 0x55e6c12482b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:41.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.114+0000 7f7a7805a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6c1236bb0 0x55e6c1246e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:41.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.114+0000 7f7a7805a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e6c1246cc0 con 0x55e6c122b9d0 2024-09-19T06:14:41.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.114+0000 7f7a7805a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55e6c1247390 con 0x55e6c1236bb0 2024-09-19T06:14:41.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.114+0000 7f7a7805a740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55e6c1247a60 con 0x55e6c122c2f0 2024-09-19T06:14:41.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.114+0000 7f7a6f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6c122b9d0 0x55e6c1247510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:41.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.114+0000 7f7a6f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6c122b9d0 0x55e6c1247510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60210/0 (socket says 172.21.15.2:60210) 2024-09-19T06:14:41.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.114+0000 7f7a6f7fe640 1 -- 172.21.15.2:0/4056939130 learned_addr learned my addr 172.21.15.2:0/4056939130 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:41.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.114+0000 7f7a6effd640 1 --2- 172.21.15.2:0/4056939130 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6c122c2f0 0x55e6c12482b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:41.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.114+0000 7f7a6f7fe640 1 -- 172.21.15.2:0/4056939130 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6c122c2f0 msgr2=0x55e6c12482b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:41.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.114+0000 7f7a6f7fe640 1 --2- 172.21.15.2:0/4056939130 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6c122c2f0 0x55e6c12482b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:41.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.114+0000 7f7a6f7fe640 1 -- 172.21.15.2:0/4056939130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6c1236bb0 msgr2=0x55e6c1246e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:41.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.114+0000 7f7a6f7fe640 1 --2- 172.21.15.2:0/4056939130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6c1236bb0 0x55e6c1246e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:41.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.114+0000 7f7a6f7fe640 1 -- 172.21.15.2:0/4056939130 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6c122cee0 con 0x55e6c122b9d0 2024-09-19T06:14:41.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.114+0000 7f7a6f7fe640 1 --2- 172.21.15.2:0/4056939130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6c122b9d0 0x55e6c1247510 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7a58009f00 tx=0x7f7a580047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c02ad875792cda4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:41.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.115+0000 7f7a657fa640 1 -- 172.21.15.2:0/4056939130 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a580165b0 con 0x55e6c122b9d0 2024-09-19T06:14:41.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.115+0000 7f7a657fa640 1 -- 172.21.15.2:0/4056939130 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7a58025070 con 0x55e6c122b9d0 2024-09-19T06:14:41.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.115+0000 7f7a657fa640 1 -- 172.21.15.2:0/4056939130 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5801f9e0 con 0x55e6c122b9d0 2024-09-19T06:14:41.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.115+0000 7f7a7805a740 1 -- 172.21.15.2:0/4056939130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6c122b9d0 msgr2=0x55e6c1247510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:41.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.115+0000 7f7a7805a740 1 --2- 172.21.15.2:0/4056939130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6c122b9d0 0x55e6c1247510 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7a58009f00 tx=0x7f7a580047d0 comp rx=0 tx=0).stop 2024-09-19T06:14:41.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.115+0000 7f7a7805a740 1 -- 172.21.15.2:0/4056939130 shutdown_connections 2024-09-19T06:14:41.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.115+0000 7f7a7805a740 1 --2- 172.21.15.2:0/4056939130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6c1236bb0 0x55e6c1246e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:41.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.115+0000 7f7a7805a740 1 --2- 172.21.15.2:0/4056939130 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6c122c2f0 0x55e6c12482b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:41.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.115+0000 7f7a7805a740 1 --2- 172.21.15.2:0/4056939130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6c122b9d0 0x55e6c1247510 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:41.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.115+0000 7f7a7805a740 1 -- 172.21.15.2:0/4056939130 >> 172.21.15.2:0/4056939130 conn(0x55e6c1227f60 msgr2=0x55e6c1222ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:41.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.115+0000 7f7a7805a740 1 -- 172.21.15.2:0/4056939130 shutdown_connections 2024-09-19T06:14:41.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.115+0000 7f7a7805a740 1 -- 172.21.15.2:0/4056939130 wait complete. 2024-09-19T06:14:41.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.116+0000 7f7a7805a740 1 -- start start 2024-09-19T06:14:41.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.116+0000 7f7a7805a740 1 Processor -- start 2024-09-19T06:14:41.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.116+0000 7f7a7805a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6c122b9d0 0x55e6c12510c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:41.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.116+0000 7f7a7805a740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6c122c2f0 0x55e6c124ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:41.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.116+0000 7f7a7805a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6c1236bb0 0x55e6c124f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:41.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.116+0000 7f7a7805a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e6c1248800 con 0x55e6c1236bb0 2024-09-19T06:14:41.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.116+0000 7f7a7805a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55e6c1248130 con 0x55e6c122b9d0 2024-09-19T06:14:41.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.116+0000 7f7a7805a740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55e6c1248ed0 con 0x55e6c122c2f0 2024-09-19T06:14:41.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.116+0000 7f7a7805a740 10 client.0 _ll_register_callbacks cb 0x7f7a68009890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:41.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.116+0000 7f7a6ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6c1236bb0 0x55e6c124f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:41.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.117+0000 7f7a6ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6c1236bb0 0x55e6c124f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60214/0 (socket says 172.21.15.2:60214) 2024-09-19T06:14:41.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.117+0000 7f7a6ffff640 1 -- 172.21.15.2:0/3016023133 learned_addr learned my addr 172.21.15.2:0/3016023133 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:41.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.117+0000 7f7a6f7fe640 1 --2- 172.21.15.2:0/3016023133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6c122b9d0 0x55e6c12510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:41.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.117+0000 7f7a6effd640 1 --2- 172.21.15.2:0/3016023133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6c122c2f0 0x55e6c124ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:41.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.117+0000 7f7a6ffff640 1 -- 172.21.15.2:0/3016023133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6c122c2f0 msgr2=0x55e6c124ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:41.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.117+0000 7f7a6ffff640 1 --2- 172.21.15.2:0/3016023133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6c122c2f0 0x55e6c124ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:41.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.117+0000 7f7a6ffff640 1 -- 172.21.15.2:0/3016023133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6c122b9d0 msgr2=0x55e6c12510c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:41.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.117+0000 7f7a6ffff640 1 --2- 172.21.15.2:0/3016023133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6c122b9d0 0x55e6c12510c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:41.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.117+0000 7f7a6ffff640 1 -- 172.21.15.2:0/3016023133 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6c124f750 con 0x55e6c1236bb0 2024-09-19T06:14:41.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.117+0000 7f7a6effd640 1 --2- 172.21.15.2:0/3016023133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6c122c2f0 0x55e6c124ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:14:41.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.117+0000 7f7a6ffff640 1 --2- 172.21.15.2:0/3016023133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6c1236bb0 0x55e6c124f210 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7a68030c80 tx=0x7f7a68031f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44b59512c80d62 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:41.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.117+0000 7f7a4effd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:14:41.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.117+0000 7f7a4effd640 1 -- 172.21.15.2:0/3016023133 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a68004040 con 0x55e6c1236bb0 2024-09-19T06:14:41.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.117+0000 7f7a4effd640 1 -- 172.21.15.2:0/3016023133 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f7a68030e70 con 0x55e6c1236bb0 2024-09-19T06:14:41.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.117+0000 7f7a7805a740 1 -- 172.21.15.2:0/3016023133 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a58025070 con 0x55e6c1236bb0 2024-09-19T06:14:41.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.117+0000 7f7a4effd640 1 -- 172.21.15.2:0/3016023133 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7a680305d0 con 0x55e6c1236bb0 2024-09-19T06:14:41.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.117+0000 7f7a7805a740 10 client.15120 fetch_fsmap learned FSMap version 25 2024-09-19T06:14:41.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.117+0000 7f7a7805a740 1 -- 172.21.15.2:0/3016023133 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e6c12b0940 con 0x55e6c1236bb0 2024-09-19T06:14:41.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.118+0000 7f7a4effd640 1 -- 172.21.15.2:0/3016023133 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7a58025070 con 0x55e6c1236bb0 2024-09-19T06:14:41.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.118+0000 7f7a4effd640 1 -- 172.21.15.2:0/3016023133 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7a68051040 con 0x55e6c1236bb0 2024-09-19T06:14:41.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.118+0000 7f7a7805a740 10 client.15120 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T06:14:41.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.118+0000 7f7a7805a740 10 client.15120 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T06:14:41.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.118+0000 7f7a7805a740 20 client.15120 populate_metadata read hostname 'smithi002' 2024-09-19T06:14:41.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.118+0000 7f7a7805a740 1 --2- 172.21.15.2:0/3016023133 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55e6c12b5590 0x55e6c12b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:41.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.118+0000 7f7a7805a740 4 client.15120 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:14:41.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.118+0000 7f7a7805a740 1 -- 172.21.15.2:0/3016023133 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "status"}) -- 0x55e6c11160e0 con 0x55e6c12b5590 2024-09-19T06:14:41.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.118+0000 7f7a6f7fe640 1 --2- 172.21.15.2:0/3016023133 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55e6c12b5590 0x55e6c12b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:41.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.119+0000 7f7a6f7fe640 1 --2- 172.21.15.2:0/3016023133 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55e6c12b5590 0x55e6c12b42a0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5913f3a4f5b0470 server_cookie=9f375ef4db9b40ae in_seq=0 out_seq=0 2024-09-19T06:14:41.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.119+0000 7f7a4effd640 10 client.15120 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:14:41.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.119+0000 7f7a4effd640 1 -- 172.21.15.2:0/3016023133 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+319 (crc 0 0 0) 0x55e6c11160e0 con 0x55e6c12b5590 2024-09-19T06:14:41.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.119+0000 7f7a4effd640 10 client.15120 handle_command_reply: tid=0 2024-09-19T06:14:41.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.119+0000 7f7a7805a740 1 client.15120 shutdown 2024-09-19T06:14:41.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.119+0000 7f7a7805a740 1 -- 172.21.15.2:0/3016023133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6c1236bb0 msgr2=0x55e6c124f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:41.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.119+0000 7f7a7805a740 1 --2- 172.21.15.2:0/3016023133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6c1236bb0 0x55e6c124f210 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7a68030c80 tx=0x7f7a68031f70 comp rx=0 tx=0).stop 2024-09-19T06:14:41.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.119+0000 7f7a7805a740 1 -- 172.21.15.2:0/3016023133 shutdown_connections 2024-09-19T06:14:41.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.119+0000 7f7a7805a740 1 --2- 172.21.15.2:0/3016023133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e6c1236bb0 0x55e6c124f210 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:41.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.119+0000 7f7a7805a740 1 --2- 172.21.15.2:0/3016023133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e6c122c2f0 0x55e6c124ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:41.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.119+0000 7f7a7805a740 1 --2- 172.21.15.2:0/3016023133 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55e6c12b5590 0x55e6c12b42a0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:41.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.119+0000 7f7a7805a740 1 --2- 172.21.15.2:0/3016023133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6c122b9d0 0x55e6c12510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:41.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.119+0000 7f7a7805a740 1 -- 172.21.15.2:0/3016023133 >> 172.21.15.2:0/3016023133 conn(0x55e6c1227f60 msgr2=0x55e6c1228340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:41.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.119+0000 7f7a4effd640 0 client.15120 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:14:41.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.119+0000 7f7a7805a740 1 -- 172.21.15.2:0/3016023133 shutdown_connections 2024-09-19T06:14:41.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.119+0000 7f7a7805a740 1 -- 172.21.15.2:0/3016023133 wait complete. 2024-09-19T06:14:41.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.120+0000 7f7a7805a740 20 client.15120 trim_cache size 0 max 16384 2024-09-19T06:14:41.126 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:14:41.126 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "078f6612-764d-11ef-bceb-c7b262605968", 2024-09-19T06:14:41.126 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2024-09-19T06:14:41.126 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24497, 2024-09-19T06:14:41.126 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-09-19T06:14:41.126 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-09-19T06:14:41.127 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-09-19T06:14:41.127 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 96.33228106, 2024-09-19T06:14:41.127 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 25, 2024-09-19T06:14:41.127 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 81, 2024-09-19T06:14:41.127 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 81, 2024-09-19T06:14:41.127 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 108.13970581 2024-09-19T06:14:41.127 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:14:41.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.120+0000 7f7a75c81640 1 -- 172.21.15.2:0/1249731226 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f7a5c0a3350 msgr2=0x7f7a5c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:41.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.120+0000 7f7a75c81640 1 --2- 172.21.15.2:0/1249731226 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f7a5c0a3350 0x7f7a5c0a5810 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7a68009430 tx=0x7f7a68009820 comp rx=0 tx=0).stop 2024-09-19T06:14:41.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.120+0000 7f7a75c81640 1 -- 172.21.15.2:0/1249731226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a701036e0 msgr2=0x7f7a70100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:41.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.120+0000 7f7a75c81640 1 --2- 172.21.15.2:0/1249731226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a701036e0 0x7f7a70100ed0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7a60006fd0 tx=0x7f7a6000b820 comp rx=0 tx=0).stop 2024-09-19T06:14:41.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.120+0000 7f7a75c81640 1 -- 172.21.15.2:0/1249731226 shutdown_connections 2024-09-19T06:14:41.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.120+0000 7f7a75c81640 1 --2- 172.21.15.2:0/1249731226 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f7a5c0a3350 0x7f7a5c0a5810 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:41.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.120+0000 7f7a75c81640 1 --2- 172.21.15.2:0/1249731226 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a701082a0 0x7f7a70101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:41.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.120+0000 7f7a75c81640 1 --2- 172.21.15.2:0/1249731226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a701036e0 0x7f7a70100ed0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:41.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.120+0000 7f7a75c81640 1 --2- 172.21.15.2:0/1249731226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a70102d30 0x7f7a70100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:41.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.120+0000 7f7a75c81640 1 -- 172.21.15.2:0/1249731226 >> 172.21.15.2:0/1249731226 conn(0x7f7a700fc7d0 msgr2=0x7f7a70105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:41.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.120+0000 7f7a75c81640 1 -- 172.21.15.2:0/1249731226 shutdown_connections 2024-09-19T06:14:41.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:41.120+0000 7f7a75c81640 1 -- 172.21.15.2:0/1249731226 wait complete. 2024-09-19T06:14:41.899 INFO:teuthology.run_tasks:Running task sequential... 2024-09-19T06:14:41.908 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-19T06:14:41.908 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-19T06:14:41.909 INFO:teuthology.task.print:Enabling mgr modules 2024-09-19T06:14:41.909 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-09-19T06:14:41.910 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T06:14:41.910 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-19T06:14:41.910 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-09-19T06:14:41.934 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:41 smithi002 ceph-mon[30982]: pgmap v325: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:14:42.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.036+0000 7f4245518640 1 -- 172.21.15.2:0/4117822477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42401025f0 msgr2=0x7f42401049e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:42.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.036+0000 7f4245518640 1 --2- 172.21.15.2:0/4117822477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42401025f0 0x7f42401049e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4230009900 tx=0x7f423002a410 comp rx=0 tx=0).stop 2024-09-19T06:14:42.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.036+0000 7f4245518640 1 -- 172.21.15.2:0/4117822477 shutdown_connections 2024-09-19T06:14:42.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.036+0000 7f4245518640 1 --2- 172.21.15.2:0/4117822477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4240107850 0x7f4240109cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:42.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.036+0000 7f4245518640 1 --2- 172.21.15.2:0/4117822477 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4240104f20 0x7f4240107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:42.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.036+0000 7f4245518640 1 --2- 172.21.15.2:0/4117822477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42401025f0 0x7f42401049e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:42.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.036+0000 7f4245518640 1 -- 172.21.15.2:0/4117822477 >> 172.21.15.2:0/4117822477 conn(0x7f42400fc1f0 msgr2=0x7f42400fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:42.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.036+0000 7f4245518640 1 -- 172.21.15.2:0/4117822477 shutdown_connections 2024-09-19T06:14:42.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.036+0000 7f4245518640 1 -- 172.21.15.2:0/4117822477 wait complete. 2024-09-19T06:14:42.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.036+0000 7f4245518640 1 Processor -- start 2024-09-19T06:14:42.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.037+0000 7f4245518640 1 -- start start 2024-09-19T06:14:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.037+0000 7f4245518640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42401025f0 0x7f4240197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.037+0000 7f4245518640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4240104f20 0x7f4240198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.037+0000 7f4245518640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4240107850 0x7f424019f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.037+0000 7f4245518640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f424010d6e0 con 0x7f42401025f0 2024-09-19T06:14:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.037+0000 7f4245518640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f424010d560 con 0x7f4240107850 2024-09-19T06:14:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.037+0000 7f4245518640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f424010d860 con 0x7f4240104f20 2024-09-19T06:14:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.037+0000 7f423effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42401025f0 0x7f4240197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.037+0000 7f423effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42401025f0 0x7f4240197df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60230/0 (socket says 172.21.15.2:60230) 2024-09-19T06:14:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.037+0000 7f423effd640 1 -- 172.21.15.2:0/2547554582 learned_addr learned my addr 172.21.15.2:0/2547554582 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.037+0000 7f423e7fc640 1 --2- 172.21.15.2:0/2547554582 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4240104f20 0x7f4240198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.037+0000 7f423f7fe640 1 --2- 172.21.15.2:0/2547554582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4240107850 0x7f424019f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:42.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.037+0000 7f423effd640 1 -- 172.21.15.2:0/2547554582 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4240104f20 msgr2=0x7f4240198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.037+0000 7f423effd640 1 --2- 172.21.15.2:0/2547554582 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4240104f20 0x7f4240198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.037+0000 7f423effd640 1 -- 172.21.15.2:0/2547554582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4240107850 msgr2=0x7f424019f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.037+0000 7f423effd640 1 --2- 172.21.15.2:0/2547554582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4240107850 0x7f424019f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.037+0000 7f423effd640 1 -- 172.21.15.2:0/2547554582 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f424019fa10 con 0x7f42401025f0 2024-09-19T06:14:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.037+0000 7f423f7fe640 1 --2- 172.21.15.2:0/2547554582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4240107850 0x7f424019f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:14:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.037+0000 7f423effd640 1 --2- 172.21.15.2:0/2547554582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42401025f0 0x7f4240197df0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4230005940 tx=0x7f4230004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.038+0000 7f4227fff640 1 -- 172.21.15.2:0/2547554582 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f423003f030 con 0x7f42401025f0 2024-09-19T06:14:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.038+0000 7f4227fff640 1 -- 172.21.15.2:0/2547554582 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4230003cb0 con 0x7f42401025f0 2024-09-19T06:14:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.038+0000 7f4245518640 1 -- 172.21.15.2:0/2547554582 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f424019fca0 con 0x7f42401025f0 2024-09-19T06:14:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.038+0000 7f4227fff640 1 -- 172.21.15.2:0/2547554582 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4230035070 con 0x7f42401025f0 2024-09-19T06:14:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.038+0000 7f4245518640 1 -- 172.21.15.2:0/2547554582 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42401a0190 con 0x7f42401025f0 2024-09-19T06:14:42.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.039+0000 7f4245518640 1 -- 172.21.15.2:0/2547554582 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42400fdce0 con 0x7f42401025f0 2024-09-19T06:14:42.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.040+0000 7f4227fff640 1 -- 172.21.15.2:0/2547554582 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f4230042030 con 0x7f42401025f0 2024-09-19T06:14:42.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.040+0000 7f4227fff640 1 --2- 172.21.15.2:0/2547554582 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f42280a32d0 0x7f42280a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:42.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.041+0000 7f423e7fc640 1 --2- 172.21.15.2:0/2547554582 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f42280a32d0 0x7f42280a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:42.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.041+0000 7f4227fff640 1 -- 172.21.15.2:0/2547554582 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f42300f0440 con 0x7f42401025f0 2024-09-19T06:14:42.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.041+0000 7f423e7fc640 1 --2- 172.21.15.2:0/2547554582 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f42280a32d0 0x7f42280a5790 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4240199300 tx=0x7f423400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:42.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.045+0000 7f4227fff640 1 -- 172.21.15.2:0/2547554582 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f42300bcfb0 con 0x7f42401025f0 2024-09-19T06:14:42.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:41 smithi090 ceph-mon[34497]: pgmap v325: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:14:42.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.271+0000 7f4245518640 1 -- 172.21.15.2:0/2547554582 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7f424002da10 con 0x7f42401025f0 2024-09-19T06:14:42.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:41 smithi089 ceph-mon[34160]: pgmap v325: 97 pgs: 97 active+clean; 638 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:14:42.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.905+0000 7f4227fff640 1 -- 172.21.15.2:0/2547554582 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v18) ==== 92+0+0 (secure 0 0 0) 0x7f42300bc8b0 con 0x7f42401025f0 2024-09-19T06:14:42.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.909+0000 7f4245518640 1 -- 172.21.15.2:0/2547554582 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f42280a32d0 msgr2=0x7f42280a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:42.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.909+0000 7f4245518640 1 --2- 172.21.15.2:0/2547554582 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f42280a32d0 0x7f42280a5790 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4240199300 tx=0x7f423400b390 comp rx=0 tx=0).stop 2024-09-19T06:14:42.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.909+0000 7f4245518640 1 -- 172.21.15.2:0/2547554582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42401025f0 msgr2=0x7f4240197df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:42.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.909+0000 7f4245518640 1 --2- 172.21.15.2:0/2547554582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42401025f0 0x7f4240197df0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4230005940 tx=0x7f4230004340 comp rx=0 tx=0).stop 2024-09-19T06:14:42.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.909+0000 7f4245518640 1 -- 172.21.15.2:0/2547554582 shutdown_connections 2024-09-19T06:14:42.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.909+0000 7f4245518640 1 --2- 172.21.15.2:0/2547554582 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f42280a32d0 0x7f42280a5790 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:42.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.909+0000 7f4245518640 1 --2- 172.21.15.2:0/2547554582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4240107850 0x7f424019f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:42.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.909+0000 7f4245518640 1 --2- 172.21.15.2:0/2547554582 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4240104f20 0x7f4240198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:42.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.909+0000 7f4245518640 1 --2- 172.21.15.2:0/2547554582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42401025f0 0x7f4240197df0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:42.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.909+0000 7f4245518640 1 -- 172.21.15.2:0/2547554582 >> 172.21.15.2:0/2547554582 conn(0x7f42400fc1f0 msgr2=0x7f4240102e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:42.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.909+0000 7f4245518640 1 -- 172.21.15.2:0/2547554582 shutdown_connections 2024-09-19T06:14:42.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:42.909+0000 7f4245518640 1 -- 172.21.15.2:0/2547554582 wait complete. 2024-09-19T06:14:42.930 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-19T06:14:42.956 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-19T06:14:42.957 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-09-19T06:14:42.957 INFO:tasks.ceph_fuse:client.0 config is {'mount_subvol_num': 0} 2024-09-19T06:14:42.957 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T06:14:42.957 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T06:14:42.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:14:42.957 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-09-19T06:14:42.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:14:42.988 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link delete ceph-brx 2024-09-19T06:14:43.056 INFO:teuthology.orchestra.run.smithi002.stderr:Cannot find device "ceph-brx" 2024-09-19T06:14:43.057 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:14:43.058 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-19T06:14:43.058 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-19T06:14:43.058 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-19T06:14:43.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:42 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/2547554582' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-19T06:14:43.222 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:42 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: ignoring --setuser ceph since I am not root 2024-09-19T06:14:43.223 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:42 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: ignoring --setgroup ceph since I am not root 2024-09-19T06:14:43.223 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:43 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:14:43.067+0000 7fbd052a2040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T06:14:43.223 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:43 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:14:43.128+0000 7fbd052a2040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T06:14:43.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:42 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/2547554582' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-19T06:14:43.240 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:14:42 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: ignoring --setuser ceph since I am not root 2024-09-19T06:14:43.240 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:14:42 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: ignoring --setgroup ceph since I am not root 2024-09-19T06:14:43.240 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:14:42 smithi090 ceph-mgr[36306]: -- 172.21.15.90:0/225032790 <== mon.1 v2:172.21.15.90:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564ca96e90e0 con 0x564ca96c6800 2024-09-19T06:14:43.240 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:14:43 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:14:43.056+0000 7fb31d0e3040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T06:14:43.240 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:14:43 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:14:43.112+0000 7fb31d0e3040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T06:14:43.261 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:42 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/2547554582' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-19T06:14:43.261 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:14:42 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: ignoring --setuser ceph since I am not root 2024-09-19T06:14:43.262 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:14:42 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: ignoring --setgroup ceph since I am not root 2024-09-19T06:14:43.262 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:14:42 smithi089 ceph-mgr[35530]: -- 172.21.15.89:0/2680631661 <== mon.2 v2:172.21.15.89:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cbfcfdd0e0 con 0x55cbfcfbb400 2024-09-19T06:14:43.262 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:14:43 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:14:43.058+0000 7f9370f4f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T06:14:43.262 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:14:43 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:14:43.114+0000 7f9370f4f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T06:14:43.262 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:14:43 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:14:43.259+0000 7f9370f4f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T06:14:43.362 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:43.542 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:14:43 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:14:43.325+0000 7f9370f4f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T06:14:43.542 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:14:43 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:14:43.469+0000 7f9370f4f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:14:43.568 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:43 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:14:43.286+0000 7fbd052a2040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T06:14:43.568 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:43 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:14:43.361+0000 7fbd052a2040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T06:14:43.568 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:43 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:14:43.519+0000 7fbd052a2040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:14:43.609 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:14:43 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:14:43.259+0000 7fb31d0e3040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T06:14:43.610 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:14:43 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:14:43.324+0000 7fb31d0e3040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T06:14:43.610 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:14:43 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:14:43.469+0000 7fb31d0e3040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:14:43.907 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:14:43 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:14:43.608+0000 7f9370f4f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T06:14:43.908 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:43 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:14:43.671+0000 7fbd052a2040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T06:14:43.908 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:14:43 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:14:43.608+0000 7fb31d0e3040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T06:14:43.908 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:43 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/2547554582' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-19T06:14:43.908 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:43 smithi002 ceph-mon[30982]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T06:14:43.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:43.801+0000 7f4305bf2640 1 -- 172.21.15.2:0/2985871872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43001082a0 msgr2=0x7f430010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:43.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:43.801+0000 7f4305bf2640 1 --2- 172.21.15.2:0/2985871872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43001082a0 0x7f430010ec40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f42f8009cd0 tx=0x7f42f802a8e0 comp rx=0 tx=0).stop 2024-09-19T06:14:43.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:43.801+0000 7f4305bf2640 1 -- 172.21.15.2:0/2985871872 shutdown_connections 2024-09-19T06:14:43.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:43.801+0000 7f4305bf2640 1 --2- 172.21.15.2:0/2985871872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43001082a0 0x7f430010ec40 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:43.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:43.801+0000 7f4305bf2640 1 --2- 172.21.15.2:0/2985871872 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43001036e0 0x7f4300107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:43.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:43.801+0000 7f4305bf2640 1 --2- 172.21.15.2:0/2985871872 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4300102d30 0x7f4300103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:43.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:43.801+0000 7f4305bf2640 1 -- 172.21.15.2:0/2985871872 >> 172.21.15.2:0/2985871872 conn(0x7f43000fc7d0 msgr2=0x7f43000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:43.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:43.801+0000 7f4305bf2640 1 -- 172.21.15.2:0/2985871872 shutdown_connections 2024-09-19T06:14:43.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:43.801+0000 7f4305bf2640 1 -- 172.21.15.2:0/2985871872 wait complete. 2024-09-19T06:14:43.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:43.802+0000 7f4305bf2640 1 Processor -- start 2024-09-19T06:14:43.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:43.802+0000 7f4305bf2640 1 -- start start 2024-09-19T06:14:43.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:43.802+0000 7f4305bf2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4300102d30 0x7f4300198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:43.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:43.802+0000 7f4305bf2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43001036e0 0x7f43001989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:43.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:43.802+0000 7f4305bf2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43001082a0 0x7f430019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:43.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:43.802+0000 7f4305bf2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4300111f50 con 0x7f43001082a0 2024-09-19T06:14:43.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:43.802+0000 7f4305bf2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4300111dd0 con 0x7f4300102d30 2024-09-19T06:14:43.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:43.802+0000 7f4305bf2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f43001120d0 con 0x7f43001036e0 2024-09-19T06:14:43.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:43.802+0000 7f42fffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43001082a0 0x7f430019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:43.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:43.802+0000 7f42ff7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4300102d30 0x7f4300198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:43.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:43.802+0000 7f42fffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43001082a0 0x7f430019cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60274/0 (socket says 172.21.15.2:60274) 2024-09-19T06:14:43.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:43.802+0000 7f42fffff640 1 -- 172.21.15.2:0/3454938370 learned_addr learned my addr 172.21.15.2:0/3454938370 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:43.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:43.802+0000 7f42f6ffd640 1 --2- 172.21.15.2:0/3454938370 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43001036e0 0x7f43001989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:43.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:43.803+0000 7f42ff7fe640 1 -- 172.21.15.2:0/3454938370 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43001036e0 msgr2=0x7f43001989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:43.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:43.803+0000 7f42ff7fe640 1 --2- 172.21.15.2:0/3454938370 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43001036e0 0x7f43001989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:43.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:43.803+0000 7f42ff7fe640 1 -- 172.21.15.2:0/3454938370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43001082a0 msgr2=0x7f430019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:43.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:43.803+0000 7f42ff7fe640 1 --2- 172.21.15.2:0/3454938370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43001082a0 0x7f430019cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:43.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:43.803+0000 7f42ff7fe640 1 -- 172.21.15.2:0/3454938370 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f430019d440 con 0x7f4300102d30 2024-09-19T06:14:43.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:43.803+0000 7f42f6ffd640 1 --2- 172.21.15.2:0/3454938370 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43001036e0 0x7f43001989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:43.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:43.803+0000 7f42fffff640 1 --2- 172.21.15.2:0/3454938370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43001082a0 0x7f430019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:43.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:43.803+0000 7f42ff7fe640 1 --2- 172.21.15.2:0/3454938370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4300102d30 0x7f4300198490 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f42f0005fd0 tx=0x7f42f000dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:43.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:43.803+0000 7f42fd7fa640 1 -- 172.21.15.2:0/3454938370 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f0009c30 con 0x7f4300102d30 2024-09-19T06:14:43.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:43.803+0000 7f42fd7fa640 1 -- 172.21.15.2:0/3454938370 <== mon.2 v2:172.21.15.89:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f42f0009dd0 con 0x7f4300102d30 2024-09-19T06:14:43.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:43.803+0000 7f4305bf2640 1 -- 172.21.15.2:0/3454938370 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f430019d730 con 0x7f4300102d30 2024-09-19T06:14:43.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:43.803+0000 7f42fd7fa640 1 -- 172.21.15.2:0/3454938370 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f0003e20 con 0x7f4300102d30 2024-09-19T06:14:43.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:43.803+0000 7f4305bf2640 1 -- 172.21.15.2:0/3454938370 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43001a5010 con 0x7f4300102d30 2024-09-19T06:14:43.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:43.804+0000 7f4305bf2640 1 -- 172.21.15.2:0/3454938370 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4300103110 con 0x7f4300102d30 2024-09-19T06:14:43.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:43.806+0000 7f42fd7fa640 1 -- 172.21.15.2:0/3454938370 <== mon.2 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f42f00035f0 con 0x7f4300102d30 2024-09-19T06:14:43.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:43.807+0000 7f42fd7fa640 1 --2- 172.21.15.2:0/3454938370 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f42ec0a3290 0x7f42ec0a5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:43.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:43.807+0000 7f42f6ffd640 1 -- 172.21.15.2:0/3454938370 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f42ec0a3290 msgr2=0x7f42ec0a5750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/4180340554 2024-09-19T06:14:43.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:43.807+0000 7f42fd7fa640 1 -- 172.21.15.2:0/3454938370 <== mon.2 v2:172.21.15.89:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f42f00cf470 con 0x7f4300102d30 2024-09-19T06:14:43.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:43.807+0000 7f42f6ffd640 1 --2- 172.21.15.2:0/3454938370 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f42ec0a3290 0x7f42ec0a5750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:14:43.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:43.811+0000 7f42fd7fa640 1 -- 172.21.15.2:0/3454938370 <== mon.2 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f42f0017020 con 0x7f4300102d30 2024-09-19T06:14:44.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:44.008+0000 7f42f6ffd640 1 -- 172.21.15.2:0/3454938370 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f42ec0a3290 msgr2=0x7f42ec0a5750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/4180340554 2024-09-19T06:14:44.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:44.008+0000 7f42f6ffd640 1 --2- 172.21.15.2:0/3454938370 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f42ec0a3290 0x7f42ec0a5750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T06:14:44.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:44.025+0000 7f4305bf2640 1 -- 172.21.15.2:0/3454938370 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f430010a2b0 con 0x7f4300102d30 2024-09-19T06:14:44.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:44.025+0000 7f42fd7fa640 1 -- 172.21.15.2:0/3454938370 <== mon.2 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) ==== 53+0+73 (secure 0 0 0) 0x7f42f009baf0 con 0x7f4300102d30 2024-09-19T06:14:44.027 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T06:14:44.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:44.028+0000 7f4305bf2640 1 -- 172.21.15.2:0/3454938370 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f42ec0a3290 msgr2=0x7f42ec0a5750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:14:44.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:44.028+0000 7f4305bf2640 1 --2- 172.21.15.2:0/3454938370 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f42ec0a3290 0x7f42ec0a5750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:44.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:44.028+0000 7f4305bf2640 1 -- 172.21.15.2:0/3454938370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4300102d30 msgr2=0x7f4300198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:44.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:44.028+0000 7f4305bf2640 1 --2- 172.21.15.2:0/3454938370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4300102d30 0x7f4300198490 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f42f0005fd0 tx=0x7f42f000dde0 comp rx=0 tx=0).stop 2024-09-19T06:14:44.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:44.028+0000 7f4305bf2640 1 -- 172.21.15.2:0/3454938370 shutdown_connections 2024-09-19T06:14:44.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:44.028+0000 7f4305bf2640 1 --2- 172.21.15.2:0/3454938370 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f42ec0a3290 0x7f42ec0a5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:44.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:44.028+0000 7f4305bf2640 1 --2- 172.21.15.2:0/3454938370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43001082a0 0x7f430019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:44.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:44.028+0000 7f4305bf2640 1 --2- 172.21.15.2:0/3454938370 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43001036e0 0x7f43001989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:44.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:44.028+0000 7f4305bf2640 1 --2- 172.21.15.2:0/3454938370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4300102d30 0x7f4300198490 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:44.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:44.028+0000 7f4305bf2640 1 -- 172.21.15.2:0/3454938370 >> 172.21.15.2:0/3454938370 conn(0x7f43000fc7d0 msgr2=0x7f4300105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:44.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:44.028+0000 7f4305bf2640 1 -- 172.21.15.2:0/3454938370 shutdown_connections 2024-09-19T06:14:44.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:44.028+0000 7f4305bf2640 1 -- 172.21.15.2:0/3454938370 wait complete. 2024-09-19T06:14:44.163 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:43 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/2547554582' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-19T06:14:44.163 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:43 smithi090 ceph-mon[34497]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T06:14:44.163 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:14:43 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:14:43.919+0000 7fb31d0e3040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T06:14:44.163 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:14:43 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:14:43.979+0000 7fb31d0e3040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T06:14:44.163 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:43 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/2547554582' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-19T06:14:44.164 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:43 smithi089 ceph-mon[34160]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T06:14:44.164 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:14:43 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:14:43.919+0000 7f9370f4f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T06:14:44.164 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:14:43 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:14:43.979+0000 7f9370f4f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T06:14:44.222 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:44 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:14:44.009+0000 7fbd052a2040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T06:14:44.222 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:44 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:14:44.079+0000 7fbd052a2040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T06:14:44.490 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:14:44 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:14:44.162+0000 7fb31d0e3040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T06:14:44.542 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:14:44 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:14:44.162+0000 7f9370f4f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T06:14:44.722 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:44 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:14:44.276+0000 7fbd052a2040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T06:14:44.760 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T06:14:44.760 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T06:14:44.760 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2024-09-19T06:14:44.760 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T06:14:44.760 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T06:14:44.761 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T06:14:44.761 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T06:14:44.761 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T06:14:44.761 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T06:14:44.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:14:44.761 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2024-09-19T06:14:44.778 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T06:14:44.778 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T06:14:44.778 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T06:14:44.778 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-19T06:14:44.778 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2024-09-19T06:14:44.778 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-19T06:14:44.778 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T06:14:44.778 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2024-09-19T06:14:44.778 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f0 2024-09-19T06:14:44.778 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T06:14:44.779 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2024-09-19T06:14:44.779 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f1 2024-09-19T06:14:44.779 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T06:14:44.779 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2024-09-19T06:14:44.779 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f0 2024-09-19T06:14:44.779 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-19T06:14:44.779 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 42167sec preferred_lft 42167sec 2024-09-19T06:14:44.779 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link 2024-09-19T06:14:44.779 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-19T06:14:44.779 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T06:14:44.779 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2024-09-19T06:14:44.779 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f1 2024-09-19T06:14:44.780 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T06:14:44.780 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:14:44.780 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-19T06:14:44.780 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add name ceph-brx type bridge 2024-09-19T06:14:44.780 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr flush dev ceph-brx 2024-09-19T06:14:44.780 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set ceph-brx up 2024-09-19T06:14:44.780 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T06:14:44.780 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-19T06:14:44.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:14:44.982 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:44 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/3454938370' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T06:14:44.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:14:44.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:14:44.991 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T06:14:45.018 INFO:teuthology.orchestra.run.smithi002.stdout:1 2024-09-19T06:14:45.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:14:45.020 DEBUG:teuthology.orchestra.run.smithi002:> route 2024-09-19T06:14:45.094 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2024-09-19T06:14:45.094 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T06:14:45.095 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-19T06:14:45.095 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-19T06:14:45.095 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T06:14:45.095 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:14:45.095 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-19T06:14:45.095 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-19T06:14:45.095 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-19T06:14:45.095 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-19T06:14:45.095 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-19T06:14:45.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:14:45.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:44 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/3454938370' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T06:14:45.240 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:14:45 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:14:45.037+0000 7fb31d0e3040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T06:14:45.240 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:14:45 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:14:45.103+0000 7fb31d0e3040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T06:14:45.291 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:45 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:14:45.225+0000 7fbd052a2040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T06:14:45.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:44 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/3454938370' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T06:14:45.292 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:14:45 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:14:45.035+0000 7f9370f4f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T06:14:45.292 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:14:45 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:14:45.102+0000 7f9370f4f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T06:14:45.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:14:45.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:14:45.398 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-09-19T06:14:45.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:14:45.415 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list-id 2024-09-19T06:14:45.471 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:14:45.472 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-19T06:14:45.472 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T06:14:45.472 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-19T06:14:45.472 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-19T06:14:45.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:14:45.570 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:45 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:14:45.299+0000 7fbd052a2040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T06:14:45.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:14:45.594 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-19T06:14:45.594 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:14:45.594 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-19T06:14:45.595 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-19T06:14:45.595 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T06:14:45.595 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-19T06:14:45.595 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-19T06:14:45.595 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-19T06:14:45.595 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-19T06:14:45.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:14:45.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:14:45.730 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:14:45.730 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-19T06:14:45.730 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2024-09-19T06:14:45.730 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T06:14:45.730 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-19T06:14:45.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:14:45.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:14:45.814 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mount_subvol_num': 0} 2024-09-19T06:14:45.814 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T06:14:45.814 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T06:14:45.830 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T06:14:45.831 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T06:14:45.831 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T06:14:45.886 DEBUG:teuthology.orchestra.run.smithi002:> sudo modprobe fuse 2024-09-19T06:14:45.955 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T06:14:46.013 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2024-09-19T06:14:46.013 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2024-09-19T06:14:46.013 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2024-09-19T06:14:46.013 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2024-09-19T06:14:46.013 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2024-09-19T06:14:46.013 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2024-09-19T06:14:46.014 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2024-09-19T06:14:46.014 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2024-09-19T06:14:46.014 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2024-09-19T06:14:46.014 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2024-09-19T06:14:46.014 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2024-09-19T06:14:46.014 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/selinux 2024-09-19T06:14:46.014 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T06:14:46.014 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2024-09-19T06:14:46.014 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2024-09-19T06:14:46.015 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2024-09-19T06:14:46.015 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2024-09-19T06:14:46.015 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2024-09-19T06:14:46.015 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2024-09-19T06:14:46.015 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T06:14:46.015 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T06:14:46.015 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T06:14:46.015 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T06:14:46.015 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2024-09-19T06:14:46.015 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2024-09-19T06:14:46.016 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay 2024-09-19T06:14:46.016 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/65dbf1a097f5844f7c70d984ac7f3d6c73829d2c29b4a9ccc6cc87e0a4aa48c5/merged 2024-09-19T06:14:46.016 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/7684144dd243700e812b4c46ab895426cd78a900f91622f107dc7ed311017bef/merged 2024-09-19T06:14:46.016 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/0 2024-09-19T06:14:46.016 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T06:14:46.016 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/28500083433fd0fb1deac053e15a1fce796af917f232ad63976f581e2102cf4e/merged 2024-09-19T06:14:46.016 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/afec1fda60e67c02b48eb4d88f932034866a3aada661fb76e97db650b4822ef4/merged 2024-09-19T06:14:46.016 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/b8db89a92d3dc74df700d68df832622af01358ee83d69c1c6c05e3341e66323e/merged 2024-09-19T06:14:46.017 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/9cfc00b4014a0c489fc492117c60617eec77cfce5c01b108273238d90ac28095/merged 2024-09-19T06:14:46.017 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/cbdd398f282385e9a3394f88959cd3c2a2e80e912554d0f4c9cc6640f753a0de/merged 2024-09-19T06:14:46.017 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/7ba42a85ea0c8b45d40fc769f85b923bea04c0110220a56ad92ad45e5ec1af98/merged 2024-09-19T06:14:46.017 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/cde78ba2b77bce6ea43aaf05b3e710665daf30e817d464ccc8d93af9aa765e43/merged 2024-09-19T06:14:46.017 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/107421fc7bf603cd5f2a3ce80edc85b4faa6545c33208d78c66b4ab46c4dae82/merged 2024-09-19T06:14:46.017 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2024-09-19T06:14:46.017 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T06:14:46.017 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T06:14:46.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:14:46.018 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2024-09-19T06:14:46.064 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:14:45 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:14:45.804+0000 7f9370f4f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T06:14:46.064 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:14:45 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:14:45.920+0000 7f9370f4f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T06:14:46.065 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:14:45 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:14:45.807+0000 7fb31d0e3040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T06:14:46.065 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:14:45 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:14:45.922+0000 7fb31d0e3040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T06:14:46.070 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T06:14:46.070 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/volumes/qa/sv_0/87850fdf-e92c-40dd-b101-bfcd7e3cd2f9 --client_fs=cephfs) 2024-09-19T06:14:46.113 DEBUG:teuthology.orchestra.run.smithi002:> sudo modprobe fuse 2024-09-19T06:14:46.140 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T06:14:46.197 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2024-09-19T06:14:46.198 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2024-09-19T06:14:46.198 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2024-09-19T06:14:46.198 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2024-09-19T06:14:46.198 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2024-09-19T06:14:46.198 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2024-09-19T06:14:46.198 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2024-09-19T06:14:46.198 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2024-09-19T06:14:46.198 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2024-09-19T06:14:46.198 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2024-09-19T06:14:46.198 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2024-09-19T06:14:46.198 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/selinux 2024-09-19T06:14:46.198 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T06:14:46.199 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2024-09-19T06:14:46.199 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2024-09-19T06:14:46.199 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2024-09-19T06:14:46.199 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2024-09-19T06:14:46.199 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2024-09-19T06:14:46.199 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2024-09-19T06:14:46.199 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T06:14:46.199 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T06:14:46.199 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T06:14:46.199 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T06:14:46.199 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2024-09-19T06:14:46.199 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2024-09-19T06:14:46.199 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay 2024-09-19T06:14:46.199 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/65dbf1a097f5844f7c70d984ac7f3d6c73829d2c29b4a9ccc6cc87e0a4aa48c5/merged 2024-09-19T06:14:46.200 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/7684144dd243700e812b4c46ab895426cd78a900f91622f107dc7ed311017bef/merged 2024-09-19T06:14:46.200 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/0 2024-09-19T06:14:46.200 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T06:14:46.200 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/28500083433fd0fb1deac053e15a1fce796af917f232ad63976f581e2102cf4e/merged 2024-09-19T06:14:46.200 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/afec1fda60e67c02b48eb4d88f932034866a3aada661fb76e97db650b4822ef4/merged 2024-09-19T06:14:46.200 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/b8db89a92d3dc74df700d68df832622af01358ee83d69c1c6c05e3341e66323e/merged 2024-09-19T06:14:46.200 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/9cfc00b4014a0c489fc492117c60617eec77cfce5c01b108273238d90ac28095/merged 2024-09-19T06:14:46.200 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/cbdd398f282385e9a3394f88959cd3c2a2e80e912554d0f4c9cc6640f753a0de/merged 2024-09-19T06:14:46.200 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/7ba42a85ea0c8b45d40fc769f85b923bea04c0110220a56ad92ad45e5ec1af98/merged 2024-09-19T06:14:46.200 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/cde78ba2b77bce6ea43aaf05b3e710665daf30e817d464ccc8d93af9aa765e43/merged 2024-09-19T06:14:46.200 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/107421fc7bf603cd5f2a3ce80edc85b4faa6545c33208d78c66b4ab46c4dae82/merged 2024-09-19T06:14:46.200 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2024-09-19T06:14:46.201 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T06:14:46.201 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T06:14:46.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:14:46.201 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2024-09-19T06:14:46.205 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:46 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:14:46.077+0000 7fbd052a2040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T06:14:46.239 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:2024-09-19T06:14:46.237+0000 7f958c76d480 -1 init, newargv = 0x564551d88920 newargc=15 2024-09-19T06:14:46.239 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[81726]: starting ceph client 2024-09-19T06:14:46.253 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[81726]: starting fuse 2024-09-19T06:14:46.341 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:14:46 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:14:46.064+0000 7fb31d0e3040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:14:46.341 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:14:46 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:14:46.125+0000 7fb31d0e3040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T06:14:46.342 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:14:46 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:14:46.273+0000 7fb31d0e3040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T06:14:46.342 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:14:46 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:14:46.340+0000 7fb31d0e3040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T06:14:46.343 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:14:46 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:14:46.063+0000 7f9370f4f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:14:46.343 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:14:46 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:14:46.124+0000 7f9370f4f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T06:14:46.343 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:14:46 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:14:46.273+0000 7f9370f4f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T06:14:46.343 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:14:46 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:14:46.341+0000 7f9370f4f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T06:14:46.472 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:46 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:14:46.203+0000 7fbd052a2040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T06:14:46.472 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:46 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:14:46.367+0000 7fbd052a2040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:14:46.472 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:46 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:14:46.431+0000 7fbd052a2040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T06:14:46.622 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:14:46 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:14:46.400+0000 7fb31d0e3040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T06:14:46.622 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:14:46 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:14:46.557+0000 7fb31d0e3040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T06:14:46.624 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:14:46 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:14:46.401+0000 7f9370f4f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T06:14:46.624 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:14:46 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:14:46.558+0000 7f9370f4f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T06:14:46.886 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:14:46 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:14:46.621+0000 7fb31d0e3040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T06:14:46.886 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:14:46 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:14:46.686+0000 7fb31d0e3040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T06:14:46.886 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:14:46 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:14:46.767+0000 7fb31d0e3040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T06:14:46.886 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:14:46 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:14:46.826+0000 7fb31d0e3040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T06:14:46.886 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:14:46 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:14:46.885+0000 7fb31d0e3040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T06:14:46.887 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:14:46 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:14:46.622+0000 7f9370f4f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T06:14:46.888 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:14:46 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:14:46.688+0000 7f9370f4f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T06:14:46.888 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:14:46 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:14:46.769+0000 7f9370f4f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T06:14:46.888 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:14:46 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:14:46.828+0000 7f9370f4f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T06:14:46.888 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:14:46 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:14:46.886+0000 7f9370f4f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T06:14:46.891 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:46 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:14:46.589+0000 7fbd052a2040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T06:14:46.891 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:46 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:14:46.660+0000 7fbd052a2040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T06:14:46.891 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:46 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:14:46.723+0000 7fbd052a2040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T06:14:47.178 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:46 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:14:46.890+0000 7fbd052a2040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T06:14:47.179 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:46 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:14:46.958+0000 7fbd052a2040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T06:14:47.179 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:47 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:14:47.028+0000 7fbd052a2040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T06:14:47.179 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:47 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:14:47.115+0000 7fbd052a2040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T06:14:47.179 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:47 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:14:47.177+0000 7fbd052a2040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T06:14:47.321 DEBUG:teuthology.orchestra.run.smithi002:> sudo modprobe fuse 2024-09-19T06:14:47.349 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T06:14:47.406 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2024-09-19T06:14:47.406 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2024-09-19T06:14:47.406 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2024-09-19T06:14:47.407 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2024-09-19T06:14:47.407 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2024-09-19T06:14:47.407 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2024-09-19T06:14:47.407 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2024-09-19T06:14:47.407 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2024-09-19T06:14:47.407 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2024-09-19T06:14:47.407 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2024-09-19T06:14:47.407 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2024-09-19T06:14:47.407 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/selinux 2024-09-19T06:14:47.407 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T06:14:47.407 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2024-09-19T06:14:47.407 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2024-09-19T06:14:47.407 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2024-09-19T06:14:47.408 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2024-09-19T06:14:47.408 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2024-09-19T06:14:47.408 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2024-09-19T06:14:47.408 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T06:14:47.408 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T06:14:47.408 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T06:14:47.408 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T06:14:47.408 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2024-09-19T06:14:47.408 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2024-09-19T06:14:47.408 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay 2024-09-19T06:14:47.408 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/65dbf1a097f5844f7c70d984ac7f3d6c73829d2c29b4a9ccc6cc87e0a4aa48c5/merged 2024-09-19T06:14:47.408 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/7684144dd243700e812b4c46ab895426cd78a900f91622f107dc7ed311017bef/merged 2024-09-19T06:14:47.408 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/0 2024-09-19T06:14:47.409 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T06:14:47.409 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/28500083433fd0fb1deac053e15a1fce796af917f232ad63976f581e2102cf4e/merged 2024-09-19T06:14:47.409 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/afec1fda60e67c02b48eb4d88f932034866a3aada661fb76e97db650b4822ef4/merged 2024-09-19T06:14:47.409 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/b8db89a92d3dc74df700d68df832622af01358ee83d69c1c6c05e3341e66323e/merged 2024-09-19T06:14:47.409 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/9cfc00b4014a0c489fc492117c60617eec77cfce5c01b108273238d90ac28095/merged 2024-09-19T06:14:47.409 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/cbdd398f282385e9a3394f88959cd3c2a2e80e912554d0f4c9cc6640f753a0de/merged 2024-09-19T06:14:47.409 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/7ba42a85ea0c8b45d40fc769f85b923bea04c0110220a56ad92ad45e5ec1af98/merged 2024-09-19T06:14:47.409 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/cde78ba2b77bce6ea43aaf05b3e710665daf30e817d464ccc8d93af9aa765e43/merged 2024-09-19T06:14:47.409 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/107421fc7bf603cd5f2a3ce80edc85b4faa6545c33208d78c66b4ab46c4dae82/merged 2024-09-19T06:14:47.409 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2024-09-19T06:14:47.409 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T06:14:47.409 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T06:14:47.409 INFO:teuthology.orchestra.run.smithi002.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-19T06:14:47.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:14:47.410 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2024-09-19T06:14:47.462 INFO:teuthology.orchestra.run.smithi002.stdout:120 2024-09-19T06:14:47.463 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-19T06:14:47.463 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer -- python3 -c ' 2024-09-19T06:14:47.463 DEBUG:teuthology.orchestra.run.smithi002:> import glob 2024-09-19T06:14:47.463 DEBUG:teuthology.orchestra.run.smithi002:> import re 2024-09-19T06:14:47.463 DEBUG:teuthology.orchestra.run.smithi002:> import os 2024-09-19T06:14:47.463 DEBUG:teuthology.orchestra.run.smithi002:> import subprocess 2024-09-19T06:14:47.463 DEBUG:teuthology.orchestra.run.smithi002:> 2024-09-19T06:14:47.463 DEBUG:teuthology.orchestra.run.smithi002:> def _find_admin_socket(client_name): 2024-09-19T06:14:47.463 DEBUG:teuthology.orchestra.run.smithi002:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-19T06:14:47.463 DEBUG:teuthology.orchestra.run.smithi002:> files = glob.glob(asok_path) 2024-09-19T06:14:47.463 DEBUG:teuthology.orchestra.run.smithi002:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-19T06:14:47.463 DEBUG:teuthology.orchestra.run.smithi002:> 2024-09-19T06:14:47.464 DEBUG:teuthology.orchestra.run.smithi002:> # Given a non-glob path, it better be there 2024-09-19T06:14:47.464 DEBUG:teuthology.orchestra.run.smithi002:> if "*" not in asok_path: 2024-09-19T06:14:47.464 DEBUG:teuthology.orchestra.run.smithi002:> assert(len(files) == 1) 2024-09-19T06:14:47.464 DEBUG:teuthology.orchestra.run.smithi002:> return files[0] 2024-09-19T06:14:47.464 DEBUG:teuthology.orchestra.run.smithi002:> 2024-09-19T06:14:47.464 DEBUG:teuthology.orchestra.run.smithi002:> for f in files: 2024-09-19T06:14:47.464 DEBUG:teuthology.orchestra.run.smithi002:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T06:14:47.464 DEBUG:teuthology.orchestra.run.smithi002:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T06:14:47.464 DEBUG:teuthology.orchestra.run.smithi002:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T06:14:47.464 DEBUG:teuthology.orchestra.run.smithi002:> contents = proc_f.read() 2024-09-19T06:14:47.464 DEBUG:teuthology.orchestra.run.smithi002:> if mountpoint in contents: 2024-09-19T06:14:47.464 DEBUG:teuthology.orchestra.run.smithi002:> return f 2024-09-19T06:14:47.464 DEBUG:teuthology.orchestra.run.smithi002:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T06:14:47.464 DEBUG:teuthology.orchestra.run.smithi002:> 2024-09-19T06:14:47.465 DEBUG:teuthology.orchestra.run.smithi002:> print(_find_admin_socket("client.0")) 2024-09-19T06:14:47.465 DEBUG:teuthology.orchestra.run.smithi002:> ' 2024-09-19T06:14:47.472 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:47 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:14:47.239+0000 7fbd052a2040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T06:14:47.552 INFO:teuthology.orchestra.run.smithi002.stdout:/var/run/ceph/ceph-client.0.81726.asok 2024-09-19T06:14:47.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:14:47.563 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.81726.asok 2024-09-19T06:14:47.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:14:47.563 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.81726.asok status 2024-09-19T06:14:47.703 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:14:47.703 INFO:teuthology.orchestra.run.smithi002.stdout: "metadata": { 2024-09-19T06:14:47.703 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T06:14:47.703 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T06:14:47.703 INFO:teuthology.orchestra.run.smithi002.stdout: "entity_id": "0", 2024-09-19T06:14:47.703 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": "smithi002", 2024-09-19T06:14:47.703 INFO:teuthology.orchestra.run.smithi002.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-19T06:14:47.703 INFO:teuthology.orchestra.run.smithi002.stdout: "pid": "81726", 2024-09-19T06:14:47.703 INFO:teuthology.orchestra.run.smithi002.stdout: "root": "/volumes/qa/sv_0/87850fdf-e92c-40dd-b101-bfcd7e3cd2f9" 2024-09-19T06:14:47.703 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:14:47.703 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_count": 0, 2024-09-19T06:14:47.704 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_pinned_count": 0, 2024-09-19T06:14:47.704 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 15156, 2024-09-19T06:14:47.704 INFO:teuthology.orchestra.run.smithi002.stdout: "inst": { 2024-09-19T06:14:47.704 INFO:teuthology.orchestra.run.smithi002.stdout: "name": { 2024-09-19T06:14:47.704 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "client", 2024-09-19T06:14:47.704 INFO:teuthology.orchestra.run.smithi002.stdout: "num": 15156 2024-09-19T06:14:47.704 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:14:47.704 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2024-09-19T06:14:47.704 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2024-09-19T06:14:47.704 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.1:0", 2024-09-19T06:14:47.704 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 274451042 2024-09-19T06:14:47.704 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:14:47.704 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:14:47.705 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2024-09-19T06:14:47.705 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2024-09-19T06:14:47.705 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.1:0", 2024-09-19T06:14:47.705 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 274451042 2024-09-19T06:14:47.705 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:14:47.705 INFO:teuthology.orchestra.run.smithi002.stdout: "inst_str": "client.15156 192.168.0.1:0/274451042", 2024-09-19T06:14:47.705 INFO:teuthology.orchestra.run.smithi002.stdout: "addr_str": "192.168.0.1:0/274451042", 2024-09-19T06:14:47.705 INFO:teuthology.orchestra.run.smithi002.stdout: "inode_count": 5, 2024-09-19T06:14:47.705 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_epoch": 25, 2024-09-19T06:14:47.705 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch": 81, 2024-09-19T06:14:47.705 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch_barrier": 0, 2024-09-19T06:14:47.705 INFO:teuthology.orchestra.run.smithi002.stdout: "blocklisted": false, 2024-09-19T06:14:47.705 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs" 2024-09-19T06:14:47.705 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:14:47.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:14:47.712 DEBUG:teuthology.orchestra.run.smithi002:> stat --file-system '--printf=%T 2024-09-19T06:14:47.712 DEBUG:teuthology.orchestra.run.smithi002:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-19T06:14:47.732 INFO:teuthology.orchestra.run.smithi002.stdout:fuseblk 2024-09-19T06:14:47.732 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-19T06:14:47.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:14:47.733 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T06:14:47.796 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:47 smithi002 ceph-mon[30982]: Standby manager daemon z restarted 2024-09-19T06:14:47.796 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:47 smithi002 ceph-mon[30982]: Standby manager daemon z started 2024-09-19T06:14:47.796 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:47 smithi002 ceph-mon[30982]: from='mgr.? 172.21.15.90:0/1696336730' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T06:14:47.796 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:47 smithi002 ceph-mon[30982]: Standby manager daemon y restarted 2024-09-19T06:14:47.797 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:47 smithi002 ceph-mon[30982]: Standby manager daemon y started 2024-09-19T06:14:47.797 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:47 smithi002 ceph-mon[30982]: from='mgr.? 172.21.15.90:0/1696336730' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:14:47.797 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:47 smithi002 ceph-mon[30982]: from='mgr.? 172.21.15.90:0/1696336730' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T06:14:47.797 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:47 smithi002 ceph-mon[30982]: from='mgr.? 172.21.15.90:0/1696336730' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:14:47.797 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:47 smithi002 ceph-mon[30982]: from='mgr.? 172.21.15.89:0/3629515616' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T06:14:47.797 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:47 smithi002 ceph-mon[30982]: from='mgr.? 172.21.15.89:0/3629515616' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:14:47.797 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:47 smithi002 ceph-mon[30982]: from='mgr.? 172.21.15.89:0/3629515616' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T06:14:47.797 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:47 smithi002 ceph-mon[30982]: from='mgr.? 172.21.15.89:0/3629515616' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:14:47.802 INFO:teuthology.run_tasks:Running task exec... 2024-09-19T06:14:47.811 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T06:14:47.811 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-19T06:14:47.811 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-09-19T06:14:47.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:47.947+0000 7f5d3a3fd640 1 -- 172.21.15.2:0/3758916408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d34102680 msgr2=0x7f5d34104a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:47.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:47.947+0000 7f5d3a3fd640 1 --2- 172.21.15.2:0/3758916408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d34102680 0x7f5d34104a70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5d24009900 tx=0x7f5d2402a410 comp rx=0 tx=0).stop 2024-09-19T06:14:47.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:47.947+0000 7f5d3a3fd640 1 -- 172.21.15.2:0/3758916408 shutdown_connections 2024-09-19T06:14:47.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:47.947+0000 7f5d3a3fd640 1 --2- 172.21.15.2:0/3758916408 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d341078e0 0x7f5d34109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:47.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:47.947+0000 7f5d3a3fd640 1 --2- 172.21.15.2:0/3758916408 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d34104fb0 0x7f5d341073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:47.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:47.947+0000 7f5d3a3fd640 1 --2- 172.21.15.2:0/3758916408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d34102680 0x7f5d34104a70 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:47.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:47.947+0000 7f5d3a3fd640 1 -- 172.21.15.2:0/3758916408 >> 172.21.15.2:0/3758916408 conn(0x7f5d340fc1c0 msgr2=0x7f5d340fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:47.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:47.947+0000 7f5d3a3fd640 1 -- 172.21.15.2:0/3758916408 shutdown_connections 2024-09-19T06:14:47.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:47.947+0000 7f5d3a3fd640 1 -- 172.21.15.2:0/3758916408 wait complete. 2024-09-19T06:14:47.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:47.948+0000 7f5d3a3fd640 1 Processor -- start 2024-09-19T06:14:47.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:47.948+0000 7f5d3a3fd640 1 -- start start 2024-09-19T06:14:47.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:47.949+0000 7f5d3a3fd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d34102680 0x7f5d34197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:47.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:47.949+0000 7f5d3a3fd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d34104fb0 0x7f5d34198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:47.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:47.949+0000 7f5d3a3fd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d341078e0 0x7f5d3419f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:47.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:47.949+0000 7f5d3a3fd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3410d680 con 0x7f5d34104fb0 2024-09-19T06:14:47.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:47.949+0000 7f5d3a3fd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3410d500 con 0x7f5d34102680 2024-09-19T06:14:47.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:47.949+0000 7f5d3a3fd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3410d800 con 0x7f5d341078e0 2024-09-19T06:14:47.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:47.949+0000 7f5d337fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d34104fb0 0x7f5d34198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:47.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:47.949+0000 7f5d337fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d34104fb0 0x7f5d34198310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49556/0 (socket says 172.21.15.2:49556) 2024-09-19T06:14:47.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:47.949+0000 7f5d337fe640 1 -- 172.21.15.2:0/2704494585 learned_addr learned my addr 172.21.15.2:0/2704494585 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:47.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:47.949+0000 7f5d33fff640 1 --2- 172.21.15.2:0/2704494585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d34102680 0x7f5d34197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:47.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:47.949+0000 7f5d3899a640 1 --2- 172.21.15.2:0/2704494585 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d341078e0 0x7f5d3419f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:47.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:47.949+0000 7f5d337fe640 1 -- 172.21.15.2:0/2704494585 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d341078e0 msgr2=0x7f5d3419f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:47.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:47.949+0000 7f5d337fe640 1 --2- 172.21.15.2:0/2704494585 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d341078e0 0x7f5d3419f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:47.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:47.949+0000 7f5d337fe640 1 -- 172.21.15.2:0/2704494585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d34102680 msgr2=0x7f5d34197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:47.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:47.949+0000 7f5d337fe640 1 --2- 172.21.15.2:0/2704494585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d34102680 0x7f5d34197dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:47.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:47.949+0000 7f5d337fe640 1 -- 172.21.15.2:0/2704494585 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d3419f9f0 con 0x7f5d34104fb0 2024-09-19T06:14:47.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:47.949+0000 7f5d337fe640 1 --2- 172.21.15.2:0/2704494585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d34104fb0 0x7f5d34198310 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800e9c0 tx=0x7f5d2800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:47.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:47.949+0000 7f5d317fa640 1 -- 172.21.15.2:0/2704494585 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2800cd80 con 0x7f5d34104fb0 2024-09-19T06:14:47.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:47.949+0000 7f5d3a3fd640 1 -- 172.21.15.2:0/2704494585 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d3419fce0 con 0x7f5d34104fb0 2024-09-19T06:14:47.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:47.950+0000 7f5d317fa640 1 -- 172.21.15.2:0/2704494585 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5d280054d0 con 0x7f5d34104fb0 2024-09-19T06:14:47.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:47.950+0000 7f5d317fa640 1 -- 172.21.15.2:0/2704494585 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d28010430 con 0x7f5d34104fb0 2024-09-19T06:14:47.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:47.950+0000 7f5d3a3fd640 1 -- 172.21.15.2:0/2704494585 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d341a0220 con 0x7f5d34104fb0 2024-09-19T06:14:47.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:47.951+0000 7f5d3a3fd640 1 -- 172.21.15.2:0/2704494585 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d340fdcb0 con 0x7f5d34104fb0 2024-09-19T06:14:47.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:47.952+0000 7f5d317fa640 1 -- 172.21.15.2:0/2704494585 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) ==== 138371+0+0 (secure 0 0 0) 0x7f5d28004fd0 con 0x7f5d34104fb0 2024-09-19T06:14:47.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:47.953+0000 7f5d317fa640 1 --2- 172.21.15.2:0/2704494585 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f5d1c0a3290 0x7f5d1c0a5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:47.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:47.953+0000 7f5d33fff640 1 -- 172.21.15.2:0/2704494585 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f5d1c0a3290 msgr2=0x7f5d1c0a5750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/4180340554 2024-09-19T06:14:47.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:47.953+0000 7f5d317fa640 1 -- 172.21.15.2:0/2704494585 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8219+0+0 (secure 0 0 0) 0x7f5d280cfd50 con 0x7f5d34104fb0 2024-09-19T06:14:47.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:47.953+0000 7f5d33fff640 1 --2- 172.21.15.2:0/2704494585 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f5d1c0a3290 0x7f5d1c0a5750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:14:47.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:47.957+0000 7f5d317fa640 1 -- 172.21.15.2:0/2704494585 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5d2809ca80 con 0x7f5d34104fb0 2024-09-19T06:14:47.990 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:14:47 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z[36302]: 2024-09-19T06:14:47.666+0000 7fb31d0e3040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T06:14:47.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:47 smithi090 ceph-mon[34497]: Standby manager daemon z restarted 2024-09-19T06:14:47.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:47 smithi090 ceph-mon[34497]: Standby manager daemon z started 2024-09-19T06:14:47.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:47 smithi090 ceph-mon[34497]: from='mgr.? 172.21.15.90:0/1696336730' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T06:14:47.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:47 smithi090 ceph-mon[34497]: Standby manager daemon y restarted 2024-09-19T06:14:47.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:47 smithi090 ceph-mon[34497]: Standby manager daemon y started 2024-09-19T06:14:47.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:47 smithi090 ceph-mon[34497]: from='mgr.? 172.21.15.90:0/1696336730' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:14:47.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:47 smithi090 ceph-mon[34497]: from='mgr.? 172.21.15.90:0/1696336730' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T06:14:47.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:47 smithi090 ceph-mon[34497]: from='mgr.? 172.21.15.90:0/1696336730' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:14:47.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:47 smithi090 ceph-mon[34497]: from='mgr.? 172.21.15.89:0/3629515616' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T06:14:47.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:47 smithi090 ceph-mon[34497]: from='mgr.? 172.21.15.89:0/3629515616' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:14:47.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:47 smithi090 ceph-mon[34497]: from='mgr.? 172.21.15.89:0/3629515616' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T06:14:47.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:47 smithi090 ceph-mon[34497]: from='mgr.? 172.21.15.89:0/3629515616' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:14:48.042 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:14:47 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y[35526]: 2024-09-19T06:14:47.667+0000 7f9370f4f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T06:14:48.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:47 smithi089 ceph-mon[34160]: Standby manager daemon z restarted 2024-09-19T06:14:48.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:47 smithi089 ceph-mon[34160]: Standby manager daemon z started 2024-09-19T06:14:48.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:47 smithi089 ceph-mon[34160]: from='mgr.? 172.21.15.90:0/1696336730' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T06:14:48.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:47 smithi089 ceph-mon[34160]: Standby manager daemon y restarted 2024-09-19T06:14:48.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:47 smithi089 ceph-mon[34160]: Standby manager daemon y started 2024-09-19T06:14:48.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:47 smithi089 ceph-mon[34160]: from='mgr.? 172.21.15.90:0/1696336730' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:14:48.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:47 smithi089 ceph-mon[34160]: from='mgr.? 172.21.15.90:0/1696336730' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T06:14:48.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:47 smithi089 ceph-mon[34160]: from='mgr.? 172.21.15.90:0/1696336730' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:14:48.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:47 smithi089 ceph-mon[34160]: from='mgr.? 172.21.15.89:0/3629515616' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T06:14:48.044 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:47 smithi089 ceph-mon[34160]: from='mgr.? 172.21.15.89:0/3629515616' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:14:48.044 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:47 smithi089 ceph-mon[34160]: from='mgr.? 172.21.15.89:0/3629515616' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T06:14:48.044 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:47 smithi089 ceph-mon[34160]: from='mgr.? 172.21.15.89:0/3629515616' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:14:48.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:48.110+0000 7f5d317fa640 1 -- 172.21.15.2:0/2704494585 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 20) ==== 138040+0+0 (secure 0 0 0) 0x7f5d280989f0 con 0x7f5d34104fb0 2024-09-19T06:14:48.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:48.111+0000 7f5d317fa640 1 -- 172.21.15.2:0/2704494585 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f5d1c0a3290 msgr2=0x7f5d1c0a5750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:14:48.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:48.111+0000 7f5d317fa640 1 --2- 172.21.15.2:0/2704494585 >> [v2:172.21.15.2:6800/4180340554,v1:172.21.15.2:6801/4180340554] conn(0x7f5d1c0a3290 0x7f5d1c0a5750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:48.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:48.189+0000 7f5d3a3fd640 1 -- 172.21.15.2:0/2704494585 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7f5d34062df0 con 0x7f5d34104fb0 2024-09-19T06:14:48.387 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:14:48.096+0000 7fbd052a2040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T06:14:48.642 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:14:48.386+0000 7fbc6f079640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:14:48.642 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:14:48.386+0000 7fbc6f079640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:14:48.642 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:14:48.386+0000 7fbc6f079640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:14:48.642 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:14:48.386+0000 7fbc6f079640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:14:48.642 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:14:48.386+0000 7fbc6f079640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:14:48.642 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:14:48.387+0000 7fbc6c874640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:14:48.642 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:14:48.387+0000 7fbc6c874640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:14:48.642 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:14:48.387+0000 7fbc6c874640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:14:48.642 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:14:48.387+0000 7fbc6c874640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:14:48.642 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:14:48.387+0000 7fbc6c874640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:14:48.736 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-19T06:14:48.736 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: Active manager daemon x restarted 2024-09-19T06:14:48.736 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: Activating manager daemon x 2024-09-19T06:14:48.736 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T06:14:48.736 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: mgrmap e20: x(active, starting, since 0.0119674s), standbys: z, y 2024-09-19T06:14:48.736 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:14:48.736 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:14:48.737 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:14:48.737 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T06:14:48.737 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T06:14:48.737 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T06:14:48.737 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T06:14:48.737 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T06:14:48.737 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T06:14:48.737 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T06:14:48.737 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T06:14:48.737 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T06:14:48.737 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T06:14:48.737 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:14:48.737 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:14:48.738 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T06:14:48.738 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T06:14:48.738 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T06:14:48.738 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:14:48.738 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:14:48.738 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:14:48.738 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:14:48.738 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:14:48.738 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:14:48.738 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:14:48.738 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:14:48.738 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:14:48.738 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:14:48.739 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:14:48.739 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:14:48.739 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T06:14:48.739 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T06:14:48.739 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T06:14:48.739 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: Manager daemon x is now available 2024-09-19T06:14:48.739 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:14:48.739 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T06:14:48.739 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/2704494585' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-19T06:14:48.739 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:48 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T06:14:48.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-19T06:14:48.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: Active manager daemon x restarted 2024-09-19T06:14:48.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: Activating manager daemon x 2024-09-19T06:14:48.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T06:14:48.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: mgrmap e20: x(active, starting, since 0.0119674s), standbys: z, y 2024-09-19T06:14:48.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:14:48.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:14:48.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:14:48.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T06:14:48.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T06:14:48.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T06:14:48.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T06:14:48.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T06:14:48.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T06:14:48.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T06:14:48.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T06:14:48.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T06:14:48.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T06:14:48.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:14:48.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:14:48.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T06:14:48.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T06:14:48.975 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T06:14:48.975 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:14:48.975 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:14:48.975 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:14:48.975 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:14:48.975 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:14:48.975 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:14:48.975 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:14:48.975 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:14:48.975 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:14:48.975 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:14:48.975 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:14:48.975 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:14:48.976 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T06:14:48.976 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T06:14:48.976 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T06:14:48.976 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: Manager daemon x is now available 2024-09-19T06:14:48.976 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:14:48.976 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T06:14:48.976 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/2704494585' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-19T06:14:48.976 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:48 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T06:14:48.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-19T06:14:48.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: Active manager daemon x restarted 2024-09-19T06:14:48.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: Activating manager daemon x 2024-09-19T06:14:48.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T06:14:48.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: mgrmap e20: x(active, starting, since 0.0119674s), standbys: z, y 2024-09-19T06:14:48.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:14:48.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:14:48.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:14:48.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T06:14:48.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T06:14:48.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T06:14:48.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T06:14:48.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T06:14:48.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T06:14:48.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T06:14:48.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T06:14:48.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T06:14:48.992 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T06:14:48.992 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:14:48.992 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:14:48.992 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T06:14:48.992 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T06:14:48.992 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T06:14:48.992 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:14:48.992 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:14:48.992 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:14:48.992 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:14:48.992 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:14:48.992 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:14:48.992 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:14:48.993 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:14:48.993 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:14:48.993 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:14:48.993 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:14:48.993 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:14:48.993 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T06:14:48.993 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T06:14:48.993 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T06:14:48.993 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: Manager daemon x is now available 2024-09-19T06:14:48.993 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:14:48.993 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T06:14:48.993 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/2704494585' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-19T06:14:48.993 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:48 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T06:14:49.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.117+0000 7f5d317fa640 1 -- 172.21.15.2:0/2704494585 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7f5d280cd8b0 con 0x7f5d34104fb0 2024-09-19T06:14:49.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.118+0000 7f5d317fa640 1 --2- 172.21.15.2:0/2704494585 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f5d1c051d20 0x7f5d1c052100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:49.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.120+0000 7f5d317fa640 1 -- 172.21.15.2:0/2704494585 <== mon.0 v2:172.21.15.2:3300/0 9 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v26) ==== 118+0+0 (secure 0 0 0) 0x7f5d28056870 con 0x7f5d34104fb0 2024-09-19T06:14:49.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.121+0000 7f5d33fff640 1 --2- 172.21.15.2:0/2704494585 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f5d1c051d20 0x7f5d1c052100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:49.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.124+0000 7f5d3a3fd640 1 -- 172.21.15.2:0/2704494585 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f5d1c051d20 msgr2=0x7f5d1c052100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:49.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.124+0000 7f5d3a3fd640 1 --2- 172.21.15.2:0/2704494585 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f5d1c051d20 0x7f5d1c052100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0x7f5d24006010 tx=0x7f5d24000bc0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.124+0000 7f5d3a3fd640 1 -- 172.21.15.2:0/2704494585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d34104fb0 msgr2=0x7f5d34198310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:49.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.124+0000 7f5d3a3fd640 1 --2- 172.21.15.2:0/2704494585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d34104fb0 0x7f5d34198310 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800e9c0 tx=0x7f5d2800ee80 comp rx=0 tx=0).stop 2024-09-19T06:14:49.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.124+0000 7f5d3899a640 1 -- 172.21.15.2:0/2704494585 reap_dead start 2024-09-19T06:14:49.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.125+0000 7f5d3a3fd640 1 -- 172.21.15.2:0/2704494585 shutdown_connections 2024-09-19T06:14:49.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.125+0000 7f5d3a3fd640 1 -- 172.21.15.2:0/2704494585 >> 172.21.15.2:0/2704494585 conn(0x7f5d340fc1c0 msgr2=0x7f5d341030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:49.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.125+0000 7f5d3a3fd640 1 -- 172.21.15.2:0/2704494585 shutdown_connections 2024-09-19T06:14:49.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.125+0000 7f5d3a3fd640 1 -- 172.21.15.2:0/2704494585 wait complete. 2024-09-19T06:14:49.139 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-09-19T06:14:49.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.244+0000 7ff67dedd640 1 -- 172.21.15.2:0/1592277254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff678107820 msgr2=0x7ff678109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:49.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.244+0000 7ff67dedd640 1 --2- 172.21.15.2:0/1592277254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff678107820 0x7ff678109c90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff670009ca0 tx=0x7ff67002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.244+0000 7ff67dedd640 1 -- 172.21.15.2:0/1592277254 shutdown_connections 2024-09-19T06:14:49.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.244+0000 7ff67dedd640 1 --2- 172.21.15.2:0/1592277254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff678107820 0x7ff678109c90 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.244+0000 7ff67dedd640 1 --2- 172.21.15.2:0/1592277254 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff678104ef0 0x7ff6781072e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.244+0000 7ff67dedd640 1 --2- 172.21.15.2:0/1592277254 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6781025c0 0x7ff6781049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.244+0000 7ff67dedd640 1 -- 172.21.15.2:0/1592277254 >> 172.21.15.2:0/1592277254 conn(0x7ff6780fc1c0 msgr2=0x7ff6780fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:49.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.244+0000 7ff67dedd640 1 -- 172.21.15.2:0/1592277254 shutdown_connections 2024-09-19T06:14:49.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.244+0000 7ff67dedd640 1 -- 172.21.15.2:0/1592277254 wait complete. 2024-09-19T06:14:49.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.245+0000 7ff67dedd640 1 Processor -- start 2024-09-19T06:14:49.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.245+0000 7ff67dedd640 1 -- start start 2024-09-19T06:14:49.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.245+0000 7ff67dedd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6781025c0 0x7ff678197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:49.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.245+0000 7ff67dedd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff678104ef0 0x7ff678198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:49.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.245+0000 7ff67dedd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff678107820 0x7ff67819f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:49.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.245+0000 7ff67dedd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff67810d700 con 0x7ff678104ef0 2024-09-19T06:14:49.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.245+0000 7ff67dedd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff67810d580 con 0x7ff6781025c0 2024-09-19T06:14:49.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.245+0000 7ff67dedd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff67810d880 con 0x7ff678107820 2024-09-19T06:14:49.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.245+0000 7ff676ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff678104ef0 0x7ff678198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:49.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.245+0000 7ff676ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff678104ef0 0x7ff678198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49684/0 (socket says 172.21.15.2:49684) 2024-09-19T06:14:49.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.245+0000 7ff676ffd640 1 -- 172.21.15.2:0/2145037297 learned_addr learned my addr 172.21.15.2:0/2145037297 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:49.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.245+0000 7ff677fff640 1 --2- 172.21.15.2:0/2145037297 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff678107820 0x7ff67819f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:49.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.245+0000 7ff6777fe640 1 --2- 172.21.15.2:0/2145037297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6781025c0 0x7ff678197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:49.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.246+0000 7ff676ffd640 1 -- 172.21.15.2:0/2145037297 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff678107820 msgr2=0x7ff67819f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:49.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.246+0000 7ff676ffd640 1 --2- 172.21.15.2:0/2145037297 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff678107820 0x7ff67819f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.246+0000 7ff676ffd640 1 -- 172.21.15.2:0/2145037297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6781025c0 msgr2=0x7ff678197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:49.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.246+0000 7ff676ffd640 1 --2- 172.21.15.2:0/2145037297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6781025c0 0x7ff678197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.246+0000 7ff676ffd640 1 -- 172.21.15.2:0/2145037297 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff67819fa60 con 0x7ff678104ef0 2024-09-19T06:14:49.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.246+0000 7ff676ffd640 1 --2- 172.21.15.2:0/2145037297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff678104ef0 0x7ff678198380 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff66c00d770 tx=0x7ff66c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:49.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.246+0000 7ff674ff9640 1 -- 172.21.15.2:0/2145037297 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff66c017070 con 0x7ff678104ef0 2024-09-19T06:14:49.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.246+0000 7ff674ff9640 1 -- 172.21.15.2:0/2145037297 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff66c009c30 con 0x7ff678104ef0 2024-09-19T06:14:49.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.246+0000 7ff67dedd640 1 -- 172.21.15.2:0/2145037297 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff67819fd50 con 0x7ff678104ef0 2024-09-19T06:14:49.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.246+0000 7ff674ff9640 1 -- 172.21.15.2:0/2145037297 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff66c00f620 con 0x7ff678104ef0 2024-09-19T06:14:49.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.246+0000 7ff67dedd640 1 -- 172.21.15.2:0/2145037297 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6781a0240 con 0x7ff678104ef0 2024-09-19T06:14:49.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.247+0000 7ff67dedd640 1 -- 172.21.15.2:0/2145037297 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6780fdcb0 con 0x7ff678104ef0 2024-09-19T06:14:49.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.249+0000 7ff674ff9640 1 -- 172.21.15.2:0/2145037297 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7ff66c01a070 con 0x7ff678104ef0 2024-09-19T06:14:49.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.250+0000 7ff674ff9640 1 --2- 172.21.15.2:0/2145037297 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff6600a3030 0x7ff6600a54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:49.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.250+0000 7ff6777fe640 1 --2- 172.21.15.2:0/2145037297 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff6600a3030 0x7ff6600a54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:49.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.250+0000 7ff674ff9640 1 -- 172.21.15.2:0/2145037297 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7ff66c0cf000 con 0x7ff678104ef0 2024-09-19T06:14:49.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.251+0000 7ff6777fe640 1 --2- 172.21.15.2:0/2145037297 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff6600a3030 0x7ff6600a54f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff668005fd0 tx=0x7ff66800b390 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:49.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.253+0000 7ff674ff9640 1 -- 172.21.15.2:0/2145037297 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff66c009de0 con 0x7ff678104ef0 2024-09-19T06:14:49.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.458+0000 7ff67dedd640 1 -- 172.21.15.2:0/2145037297 --> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7ff678062790 con 0x7ff6600a3030 2024-09-19T06:14:49.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.474+0000 7ff674ff9640 1 -- 172.21.15.2:0/2145037297 <== mgr.15144 v2:172.21.15.2:6800/1594569191 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7ff678062790 con 0x7ff6600a3030 2024-09-19T06:14:49.476 INFO:teuthology.orchestra.run.smithi002.stdout:{} 2024-09-19T06:14:49.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.476+0000 7ff67dedd640 1 -- 172.21.15.2:0/2145037297 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff6600a3030 msgr2=0x7ff6600a54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:49.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.476+0000 7ff67dedd640 1 --2- 172.21.15.2:0/2145037297 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff6600a3030 0x7ff6600a54f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff668005fd0 tx=0x7ff66800b390 comp rx=0 tx=0).stop 2024-09-19T06:14:49.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.476+0000 7ff67dedd640 1 -- 172.21.15.2:0/2145037297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff678104ef0 msgr2=0x7ff678198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:49.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.476+0000 7ff67dedd640 1 --2- 172.21.15.2:0/2145037297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff678104ef0 0x7ff678198380 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff66c00d770 tx=0x7ff66c00dc30 comp rx=0 tx=0).stop 2024-09-19T06:14:49.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.476+0000 7ff67dedd640 1 -- 172.21.15.2:0/2145037297 shutdown_connections 2024-09-19T06:14:49.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.476+0000 7ff67dedd640 1 --2- 172.21.15.2:0/2145037297 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff6600a3030 0x7ff6600a54f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.476+0000 7ff67dedd640 1 --2- 172.21.15.2:0/2145037297 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff678107820 0x7ff67819f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.476+0000 7ff67dedd640 1 --2- 172.21.15.2:0/2145037297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff678104ef0 0x7ff678198380 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.476+0000 7ff67dedd640 1 --2- 172.21.15.2:0/2145037297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6781025c0 0x7ff678197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.476+0000 7ff67dedd640 1 -- 172.21.15.2:0/2145037297 >> 172.21.15.2:0/2145037297 conn(0x7ff6780fc1c0 msgr2=0x7ff678102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:49.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.476+0000 7ff67dedd640 1 -- 172.21.15.2:0/2145037297 shutdown_connections 2024-09-19T06:14:49.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.476+0000 7ff67dedd640 1 -- 172.21.15.2:0/2145037297 wait complete. 2024-09-19T06:14:49.489 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-19T06:14:49.501 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-19T06:14:49.513 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T06:14:49.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.617+0000 7f5edc01e640 1 -- 172.21.15.2:0/4047419882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ed41078d0 msgr2=0x7f5ed4109cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:49.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.617+0000 7f5edc01e640 1 --2- 172.21.15.2:0/4047419882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ed41078d0 0x7f5ed4109cc0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc009ca0 tx=0x7f5ecc02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.617+0000 7f5edc01e640 1 -- 172.21.15.2:0/4047419882 shutdown_connections 2024-09-19T06:14:49.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.617+0000 7f5edc01e640 1 --2- 172.21.15.2:0/4047419882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ed41078d0 0x7f5ed4109cc0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.617+0000 7f5edc01e640 1 --2- 172.21.15.2:0/4047419882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ed4104fa0 0x7f5ed4107390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.617+0000 7f5edc01e640 1 --2- 172.21.15.2:0/4047419882 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ed4102670 0x7f5ed4104a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.617+0000 7f5edc01e640 1 -- 172.21.15.2:0/4047419882 >> 172.21.15.2:0/4047419882 conn(0x7f5ed40fc190 msgr2=0x7f5ed40fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:49.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.618+0000 7f5edc01e640 1 -- 172.21.15.2:0/4047419882 shutdown_connections 2024-09-19T06:14:49.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.618+0000 7f5edc01e640 1 -- 172.21.15.2:0/4047419882 wait complete. 2024-09-19T06:14:49.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.618+0000 7f5edc01e640 1 Processor -- start 2024-09-19T06:14:49.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.618+0000 7f5edc01e640 1 -- start start 2024-09-19T06:14:49.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.619+0000 7f5edc01e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ed4102670 0x7f5ed4199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:49.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.619+0000 7f5edc01e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ed4104fa0 0x7f5ed419a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:49.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.619+0000 7f5edc01e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ed41078d0 0x7f5ed41a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:49.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.619+0000 7f5edc01e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed410d6c0 con 0x7f5ed41078d0 2024-09-19T06:14:49.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.619+0000 7f5edc01e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed410d540 con 0x7f5ed4102670 2024-09-19T06:14:49.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.619+0000 7f5edc01e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed410d840 con 0x7f5ed4104fa0 2024-09-19T06:14:49.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.619+0000 7f5eda5bb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ed41078d0 0x7f5ed41a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:49.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.619+0000 7f5eda5bb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ed41078d0 0x7f5ed41a1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49708/0 (socket says 172.21.15.2:49708) 2024-09-19T06:14:49.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.619+0000 7f5eda5bb640 1 -- 172.21.15.2:0/1408646490 learned_addr learned my addr 172.21.15.2:0/1408646490 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:49.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.619+0000 7f5ed9dba640 1 --2- 172.21.15.2:0/1408646490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ed4102670 0x7f5ed4199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:49.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.619+0000 7f5ed95b9640 1 --2- 172.21.15.2:0/1408646490 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ed4104fa0 0x7f5ed419a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:49.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.619+0000 7f5eda5bb640 1 -- 172.21.15.2:0/1408646490 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ed4104fa0 msgr2=0x7f5ed419a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:49.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.619+0000 7f5eda5bb640 1 --2- 172.21.15.2:0/1408646490 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ed4104fa0 0x7f5ed419a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.619+0000 7f5eda5bb640 1 -- 172.21.15.2:0/1408646490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ed4102670 msgr2=0x7f5ed4199fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:49.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.619+0000 7f5eda5bb640 1 --2- 172.21.15.2:0/1408646490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ed4102670 0x7f5ed4199fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.619+0000 7f5eda5bb640 1 -- 172.21.15.2:0/1408646490 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ed41a1be0 con 0x7f5ed41078d0 2024-09-19T06:14:49.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.619+0000 7f5ed9dba640 1 --2- 172.21.15.2:0/1408646490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ed4102670 0x7f5ed4199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:14:49.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.619+0000 7f5eda5bb640 1 --2- 172.21.15.2:0/1408646490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ed41078d0 0x7f5ed41a1570 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc031040 tx=0x7f5ecc003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:49.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.619+0000 7f5ecaffd640 1 -- 172.21.15.2:0/1408646490 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc004040 con 0x7f5ed41078d0 2024-09-19T06:14:49.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.619+0000 7f5ecaffd640 1 -- 172.21.15.2:0/1408646490 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5ecc004690 con 0x7f5ed41078d0 2024-09-19T06:14:49.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.619+0000 7f5edc01e640 1 -- 172.21.15.2:0/1408646490 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ed41a1e70 con 0x7f5ed41078d0 2024-09-19T06:14:49.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.620+0000 7f5ecaffd640 1 -- 172.21.15.2:0/1408646490 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc030bd0 con 0x7f5ed41078d0 2024-09-19T06:14:49.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.620+0000 7f5edc01e640 1 -- 172.21.15.2:0/1408646490 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ed41a2330 con 0x7f5ed41078d0 2024-09-19T06:14:49.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.620+0000 7f5edc01e640 1 -- 172.21.15.2:0/1408646490 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ed41093c0 con 0x7f5ed41078d0 2024-09-19T06:14:49.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.622+0000 7f5ecaffd640 1 -- 172.21.15.2:0/1408646490 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7f5ecc0041e0 con 0x7f5ed41078d0 2024-09-19T06:14:49.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.622+0000 7f5ecaffd640 1 --2- 172.21.15.2:0/1408646490 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f5ec00a3050 0x7f5ec00a5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:49.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.623+0000 7f5ed9dba640 1 --2- 172.21.15.2:0/1408646490 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f5ec00a3050 0x7f5ec00a5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:49.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.623+0000 7f5ecaffd640 1 -- 172.21.15.2:0/1408646490 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f5ecc0f0d50 con 0x7f5ed41078d0 2024-09-19T06:14:49.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.623+0000 7f5ed9dba640 1 --2- 172.21.15.2:0/1408646490 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f5ec00a3050 0x7f5ec00a5510 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5ed00058c0 tx=0x7f5ed0005850 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:49.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.630+0000 7f5ecaffd640 1 -- 172.21.15.2:0/1408646490 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5ecc0bdd50 con 0x7f5ed41078d0 2024-09-19T06:14:49.717 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:49 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:14:49.463+0000 7fbc6986e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:14:49.717 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:49 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:14:49.463+0000 7fbc6986e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:14:49.717 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:49 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:14:49.463+0000 7fbc6986e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:14:49.717 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:49 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:14:49.463+0000 7fbc6986e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:14:49.717 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:49 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:14:49.463+0000 7fbc6986e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:14:49.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.813+0000 7f5edc01e640 1 -- 172.21.15.2:0/1408646490 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5ed402da10 con 0x7f5ed41078d0 2024-09-19T06:14:49.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.815+0000 7f5ecaffd640 1 -- 172.21.15.2:0/1408646490 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22949 (secure 0 0 0) 0x7f5ecc0bd650 con 0x7f5ed41078d0 2024-09-19T06:14:49.816 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:14:49.817 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":82,"fsid":"078f6612-764d-11ef-bceb-c7b262605968","created":"2024-09-19T06:05:17.607927+0000","modified":"2024-09-19T06:14:48.099140+0000","last_up_change":"2024-09-19T06:12:13.856684+0000","last_in_change":"2024-09-19T06:11:49.745266+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:08:28.425566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:13:00.482789+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:13:02.768221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0de97a3d-2d27-455b-9998-ddd2319c148d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6803","nonce":915165910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6805","nonce":915165910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6809","nonce":915165910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6807","nonce":915165910}]},"public_addr":"172.21.15.2:6803/915165910","cluster_addr":"172.21.15.2:6805/915165910","heartbeat_back_addr":"172.21.15.2:6809/915165910","heartbeat_front_addr":"172.21.15.2:6807/915165910","state":["exists","up"]},{"osd":1,"uuid":"056d229e-2de4-4902-922e-21e1a5d3f061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6801","nonce":4097264171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6803","nonce":4097264171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6807","nonce":4097264171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6805","nonce":4097264171}]},"public_addr":"172.21.15.89:6801/4097264171","cluster_addr":"172.21.15.89:6803/4097264171","heartbeat_back_addr":"172.21.15.89:6807/4097264171","heartbeat_front_addr":"172.21.15.89:6805/4097264171","state":["exists","up"]},{"osd":2,"uuid":"2a4e7147-4125-4ee6-b5ad-85518d7066d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6801","nonce":1479908200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6803","nonce":1479908200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6807","nonce":1479908200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6805","nonce":1479908200}]},"public_addr":"172.21.15.90:6801/1479908200","cluster_addr":"172.21.15.90:6803/1479908200","heartbeat_back_addr":"172.21.15.90:6807/1479908200","heartbeat_front_addr":"172.21.15.90:6805/1479908200","state":["exists","up"]},{"osd":3,"uuid":"7b3da775-0f0a-4b46-a8dc-9ec822a54301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6811","nonce":1796948193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6813","nonce":1796948193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6817","nonce":1796948193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6815","nonce":1796948193}]},"public_addr":"172.21.15.2:6811/1796948193","cluster_addr":"172.21.15.2:6813/1796948193","heartbeat_back_addr":"172.21.15.2:6817/1796948193","heartbeat_front_addr":"172.21.15.2:6815/1796948193","state":["exists","up"]},{"osd":4,"uuid":"d4c8bafc-c844-4ff1-a3d8-7a53576e6b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6809","nonce":4256848315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6811","nonce":4256848315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6815","nonce":4256848315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6813","nonce":4256848315}]},"public_addr":"172.21.15.89:6809/4256848315","cluster_addr":"172.21.15.89:6811/4256848315","heartbeat_back_addr":"172.21.15.89:6815/4256848315","heartbeat_front_addr":"172.21.15.89:6813/4256848315","state":["exists","up"]},{"osd":5,"uuid":"8dc9bb55-29e0-4b04-9415-3b9bb5ed05cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6809","nonce":189855967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6811","nonce":189855967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6815","nonce":189855967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6813","nonce":189855967}]},"public_addr":"172.21.15.90:6809/189855967","cluster_addr":"172.21.15.90:6811/189855967","heartbeat_back_addr":"172.21.15.90:6815/189855967","heartbeat_front_addr":"172.21.15.90:6813/189855967","state":["exists","up"]},{"osd":6,"uuid":"86d1443a-9b43-46de-abd7-4c95b43207f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6819","nonce":3886336279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6821","nonce":3886336279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6825","nonce":3886336279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6823","nonce":3886336279}]},"public_addr":"172.21.15.2:6819/3886336279","cluster_addr":"172.21.15.2:6821/3886336279","heartbeat_back_addr":"172.21.15.2:6825/3886336279","heartbeat_front_addr":"172.21.15.2:6823/3886336279","state":["exists","up"]},{"osd":7,"uuid":"1cc5554c-80d2-4e77-b29a-fd2ada68d82d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6817","nonce":508513510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6819","nonce":508513510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6823","nonce":508513510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6821","nonce":508513510}]},"public_addr":"172.21.15.89:6817/508513510","cluster_addr":"172.21.15.89:6819/508513510","heartbeat_back_addr":"172.21.15.89:6823/508513510","heartbeat_front_addr":"172.21.15.89:6821/508513510","state":["exists","up"]},{"osd":8,"uuid":"e9b2eb92-9af2-4f26-a259-fcaf972e4fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6817","nonce":3558544480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6819","nonce":3558544480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6823","nonce":3558544480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6821","nonce":3558544480}]},"public_addr":"172.21.15.90:6817/3558544480","cluster_addr":"172.21.15.90:6819/3558544480","heartbeat_back_addr":"172.21.15.90:6823/3558544480","heartbeat_front_addr":"172.21.15.90:6821/3558544480","state":["exists","up"]},{"osd":9,"uuid":"194d4c64-dd29-4d35-bc54-0858c44815cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6827","nonce":2690758100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6829","nonce":2690758100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6833","nonce":2690758100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6831","nonce":2690758100}]},"public_addr":"172.21.15.2:6827/2690758100","cluster_addr":"172.21.15.2:6829/2690758100","heartbeat_back_addr":"172.21.15.2:6833/2690758100","heartbeat_front_addr":"172.21.15.2:6831/2690758100","state":["exists","up"]},{"osd":10,"uuid":"7695fa4a-b94e-4afc-b166-690a197ad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6825","nonce":1141925395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6827","nonce":1141925395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6831","nonce":1141925395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6829","nonce":1141925395}]},"public_addr":"172.21.15.89:6825/1141925395","cluster_addr":"172.21.15.89:6827/1141925395","heartbeat_back_addr":"172.21.15.89:6831/1141925395","heartbeat_front_addr":"172.21.15.89:6829/1141925395","state":["exists","up"]},{"osd":11,"uuid":"1815a999-bfdb-46b9-afcd-632ee8ba56d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6825","nonce":468380924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6827","nonce":468380924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6831","nonce":468380924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6829","nonce":468380924}]},"public_addr":"172.21.15.90:6825/468380924","cluster_addr":"172.21.15.90:6827/468380924","heartbeat_back_addr":"172.21.15.90:6831/468380924","heartbeat_front_addr":"172.21.15.90:6829/468380924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:07:36.125754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:01.415356+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:26.420808+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:51.722673+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:09:16.562300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:09:41.958465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:10:07.056167+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:10:32.066195+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:10:56.497875+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:11:21.973083+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:11:46.891515+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:12:11.910012+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9},{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/3813883133":"2024-09-20T06:14:48.099112+0000","172.21.15.2:0/2612001712":"2024-09-20T06:14:48.099112+0000","172.21.15.2:0/2508383651":"2024-09-20T06:14:48.099112+0000","172.21.15.2:0/3763089457":"2024-09-20T06:05:47.538477+0000","172.21.15.2:0/1361067708":"2024-09-20T06:05:47.538477+0000","172.21.15.2:6801/1200011821":"2024-09-20T06:06:11.912585+0000","172.21.15.2:0/3899165140":"2024-09-20T06:05:47.538477+0000","172.21.15.2:6800/1200011821":"2024-09-20T06:06:11.912585+0000","172.21.15.2:6800/1602650352":"2024-09-20T06:05:47.538477+0000","172.21.15.2:0/2976372536":"2024-09-20T06:06:11.912585+0000","172.21.15.2:0/1280963020":"2024-09-20T06:06:11.912585+0000","172.21.15.2:6800/4180340554":"2024-09-20T06:14:48.099112+0000","172.21.15.2:6801/1602650352":"2024-09-20T06:05:47.538477+0000","172.21.15.2:0/874985787":"2024-09-20T06:06:11.912585+0000","172.21.15.2:6801/4180340554":"2024-09-20T06:14:48.099112+0000","172.21.15.2:0/2134106196":"2024-09-20T06:14:48.099112+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:14:49.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.817+0000 7f5edc01e640 1 -- 172.21.15.2:0/1408646490 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f5ec00a3050 msgr2=0x7f5ec00a5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:49.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.817+0000 7f5edc01e640 1 --2- 172.21.15.2:0/1408646490 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f5ec00a3050 0x7f5ec00a5510 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5ed00058c0 tx=0x7f5ed0005850 comp rx=0 tx=0).stop 2024-09-19T06:14:49.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.817+0000 7f5edc01e640 1 -- 172.21.15.2:0/1408646490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ed41078d0 msgr2=0x7f5ed41a1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:49.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.817+0000 7f5edc01e640 1 --2- 172.21.15.2:0/1408646490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ed41078d0 0x7f5ed41a1570 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc031040 tx=0x7f5ecc003ba0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.817+0000 7f5edc01e640 1 -- 172.21.15.2:0/1408646490 shutdown_connections 2024-09-19T06:14:49.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.817+0000 7f5edc01e640 1 --2- 172.21.15.2:0/1408646490 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f5ec00a3050 0x7f5ec00a5510 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.817+0000 7f5edc01e640 1 --2- 172.21.15.2:0/1408646490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ed41078d0 0x7f5ed41a1570 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.817+0000 7f5edc01e640 1 --2- 172.21.15.2:0/1408646490 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ed4104fa0 0x7f5ed419a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.817+0000 7f5edc01e640 1 --2- 172.21.15.2:0/1408646490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ed4102670 0x7f5ed4199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.817+0000 7f5edc01e640 1 -- 172.21.15.2:0/1408646490 >> 172.21.15.2:0/1408646490 conn(0x7f5ed40fc190 msgr2=0x7f5ed4101db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:49.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.817+0000 7f5edc01e640 1 -- 172.21.15.2:0/1408646490 shutdown_connections 2024-09-19T06:14:49.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.817+0000 7f5edc01e640 1 -- 172.21.15.2:0/1408646490 wait complete. 2024-09-19T06:14:49.830 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T06:08:28.425566+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T06:13:00.482789+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T06:13:02.768221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T06:14:49.830 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T06:14:49.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.937+0000 7f53fc586640 1 -- 172.21.15.2:0/2548290484 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53f4100a30 msgr2=0x7f53f4100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:49.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.937+0000 7f53fc586640 1 --2- 172.21.15.2:0/2548290484 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53f4100a30 0x7f53f4100e30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f53f0009860 tx=0x7f53f002a340 comp rx=0 tx=0).stop 2024-09-19T06:14:49.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.937+0000 7f53fc586640 1 -- 172.21.15.2:0/2548290484 shutdown_connections 2024-09-19T06:14:49.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.937+0000 7f53fc586640 1 --2- 172.21.15.2:0/2548290484 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53f41025e0 0x7f53f4108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.937+0000 7f53fc586640 1 --2- 172.21.15.2:0/2548290484 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53f4101c20 0x7f53f41020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.937+0000 7f53fc586640 1 --2- 172.21.15.2:0/2548290484 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53f4100a30 0x7f53f4100e30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.937+0000 7f53fc586640 1 -- 172.21.15.2:0/2548290484 >> 172.21.15.2:0/2548290484 conn(0x7f53f40fc1b0 msgr2=0x7f53f40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:49.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.937+0000 7f53fc586640 1 -- 172.21.15.2:0/2548290484 shutdown_connections 2024-09-19T06:14:49.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.937+0000 7f53fc586640 1 -- 172.21.15.2:0/2548290484 wait complete. 2024-09-19T06:14:49.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.938+0000 7f53fc586640 1 Processor -- start 2024-09-19T06:14:49.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.938+0000 7f53fc586640 1 -- start start 2024-09-19T06:14:49.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.938+0000 7f53fc586640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53f4100a30 0x7f53f4196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:49.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.938+0000 7f53fc586640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53f4101c20 0x7f53f41971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:49.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.938+0000 7f53fc586640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53f41025e0 0x7f53f419e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:49.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.938+0000 7f53fc586640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f53f410c560 con 0x7f53f4101c20 2024-09-19T06:14:49.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.938+0000 7f53fc586640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f53f410c3e0 con 0x7f53f41025e0 2024-09-19T06:14:49.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.938+0000 7f53fc586640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f53f410c6e0 con 0x7f53f4100a30 2024-09-19T06:14:49.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.939+0000 7f53f9b21640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53f4101c20 0x7f53f41971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:49.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.939+0000 7f53f9b21640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53f4101c20 0x7f53f41971e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49728/0 (socket says 172.21.15.2:49728) 2024-09-19T06:14:49.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.939+0000 7f53f9b21640 1 -- 172.21.15.2:0/4075276771 learned_addr learned my addr 172.21.15.2:0/4075276771 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:49.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.939+0000 7f53fa322640 1 --2- 172.21.15.2:0/4075276771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53f4100a30 0x7f53f4196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:49.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.939+0000 7f53fab23640 1 --2- 172.21.15.2:0/4075276771 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53f41025e0 0x7f53f419e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:49.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.939+0000 7f53f9b21640 1 -- 172.21.15.2:0/4075276771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53f4100a30 msgr2=0x7f53f4196ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:49.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.939+0000 7f53f9b21640 1 --2- 172.21.15.2:0/4075276771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53f4100a30 0x7f53f4196ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.939+0000 7f53f9b21640 1 -- 172.21.15.2:0/4075276771 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53f41025e0 msgr2=0x7f53f419e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:49.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.939+0000 7f53f9b21640 1 --2- 172.21.15.2:0/4075276771 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53f41025e0 0x7f53f419e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.939+0000 7f53f9b21640 1 -- 172.21.15.2:0/4075276771 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53f419e8e0 con 0x7f53f4101c20 2024-09-19T06:14:49.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.939+0000 7f53f9b21640 1 --2- 172.21.15.2:0/4075276771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53f4101c20 0x7f53f41971e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f53e800e9c0 tx=0x7f53e800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:49.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.939+0000 7f53e77fe640 1 -- 172.21.15.2:0/4075276771 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e800cde0 con 0x7f53f4101c20 2024-09-19T06:14:49.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.939+0000 7f53fc586640 1 -- 172.21.15.2:0/4075276771 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53f419ebd0 con 0x7f53f4101c20 2024-09-19T06:14:49.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.939+0000 7f53e77fe640 1 -- 172.21.15.2:0/4075276771 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f53e80035f0 con 0x7f53f4101c20 2024-09-19T06:14:49.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.939+0000 7f53e77fe640 1 -- 172.21.15.2:0/4075276771 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e8010690 con 0x7f53f4101c20 2024-09-19T06:14:49.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.939+0000 7f53fc586640 1 -- 172.21.15.2:0/4075276771 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53f419f170 con 0x7f53f4101c20 2024-09-19T06:14:49.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.940+0000 7f53fc586640 1 -- 172.21.15.2:0/4075276771 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53f4107f60 con 0x7f53f4101c20 2024-09-19T06:14:49.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.942+0000 7f53e77fe640 1 -- 172.21.15.2:0/4075276771 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7f53e80037a0 con 0x7f53f4101c20 2024-09-19T06:14:49.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.942+0000 7f53e77fe640 1 --2- 172.21.15.2:0/4075276771 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f53e00a3050 0x7f53e00a5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:49.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.943+0000 7f53e77fe640 1 -- 172.21.15.2:0/4075276771 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f53e80cf9b0 con 0x7f53f4101c20 2024-09-19T06:14:49.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.943+0000 7f53fa322640 1 --2- 172.21.15.2:0/4075276771 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f53e00a3050 0x7f53e00a5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:49.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.943+0000 7f53fa322640 1 --2- 172.21.15.2:0/4075276771 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f53e00a3050 0x7f53e00a5510 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f53f0009830 tx=0x7f53f0030470 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:49.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:49.948+0000 7f53e77fe640 1 -- 172.21.15.2:0/4075276771 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f53e809c960 con 0x7f53f4101c20 2024-09-19T06:14:49.973 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:49 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:14:49.961+0000 7fbc4eab9640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:06:14:49] ENGINE Error in HTTPServer.serve 2024-09-19T06:14:49.973 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:49 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: Traceback (most recent call last): 2024-09-19T06:14:49.973 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:49 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:14:49.973 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:49 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: self._connections.run(self.expiration_interval) 2024-09-19T06:14:49.973 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:49 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:14:49.973 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:49 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: self._run(expiration_interval) 2024-09-19T06:14:49.973 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:49 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:14:49.973 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:49 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:14:49.973 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:49 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:14:49.973 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:49 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:14:49.974 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:49 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:14:49.974 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:49 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: s = self.context.wrap_socket( 2024-09-19T06:14:49.974 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:49 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:14:49.974 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:49 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: return self.sslsocket_class._create( 2024-09-19T06:14:49.974 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:49 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:14:49.974 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:49 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: self.do_handshake() 2024-09-19T06:14:49.974 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:49 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:14:49.974 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:49 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: self._sslobj.do_handshake() 2024-09-19T06:14:49.974 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:49 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:14:49.974 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:14:49 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:14:50.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.144+0000 7f53fc586640 1 -- 172.21.15.2:0/4075276771 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f53f402d9c0 con 0x7f53f4101c20 2024-09-19T06:14:50.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.145+0000 7f53e77fe640 1 -- 172.21.15.2:0/4075276771 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) ==== 93+0+10 (secure 0 0 0) 0x7f53e809c260 con 0x7f53f4101c20 2024-09-19T06:14:50.147 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-09-19T06:14:50.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.147+0000 7f53fc586640 1 -- 172.21.15.2:0/4075276771 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f53e00a3050 msgr2=0x7f53e00a5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:50.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.147+0000 7f53fc586640 1 --2- 172.21.15.2:0/4075276771 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f53e00a3050 0x7f53e00a5510 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f53f0009830 tx=0x7f53f0030470 comp rx=0 tx=0).stop 2024-09-19T06:14:50.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.147+0000 7f53fc586640 1 -- 172.21.15.2:0/4075276771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53f4101c20 msgr2=0x7f53f41971e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:50.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.147+0000 7f53fc586640 1 --2- 172.21.15.2:0/4075276771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53f4101c20 0x7f53f41971e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f53e800e9c0 tx=0x7f53e800ee80 comp rx=0 tx=0).stop 2024-09-19T06:14:50.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.147+0000 7f53fc586640 1 -- 172.21.15.2:0/4075276771 shutdown_connections 2024-09-19T06:14:50.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.147+0000 7f53fc586640 1 --2- 172.21.15.2:0/4075276771 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f53e00a3050 0x7f53e00a5510 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.147+0000 7f53fc586640 1 --2- 172.21.15.2:0/4075276771 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53f41025e0 0x7f53f419e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.147+0000 7f53fc586640 1 --2- 172.21.15.2:0/4075276771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53f4101c20 0x7f53f41971e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.147+0000 7f53fc586640 1 --2- 172.21.15.2:0/4075276771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53f4100a30 0x7f53f4196ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.147+0000 7f53fc586640 1 -- 172.21.15.2:0/4075276771 >> 172.21.15.2:0/4075276771 conn(0x7f53f40fc1b0 msgr2=0x7f53f4105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:50.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.147+0000 7f53fc586640 1 -- 172.21.15.2:0/4075276771 shutdown_connections 2024-09-19T06:14:50.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.147+0000 7f53fc586640 1 -- 172.21.15.2:0/4075276771 wait complete. 2024-09-19T06:14:50.161 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T06:14:50.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.278+0000 7fa0cec47640 1 -- 172.21.15.2:0/2724270446 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0c8102600 msgr2=0x7fa0c8108e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:50.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.278+0000 7fa0cec47640 1 --2- 172.21.15.2:0/2724270446 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0c8102600 0x7fa0c8108e90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0009be0 tx=0x7fa0c002a6c0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.278+0000 7fa0cec47640 1 -- 172.21.15.2:0/2724270446 shutdown_connections 2024-09-19T06:14:50.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.278+0000 7fa0cec47640 1 --2- 172.21.15.2:0/2724270446 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0c8102600 0x7fa0c8108e90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.278+0000 7fa0cec47640 1 --2- 172.21.15.2:0/2724270446 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0c8101c40 0x7fa0c81020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.278+0000 7fa0cec47640 1 --2- 172.21.15.2:0/2724270446 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0c8100a50 0x7fa0c8100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.278+0000 7fa0cec47640 1 -- 172.21.15.2:0/2724270446 >> 172.21.15.2:0/2724270446 conn(0x7fa0c80fc190 msgr2=0x7fa0c80fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:50.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.278+0000 7fa0cec47640 1 -- 172.21.15.2:0/2724270446 shutdown_connections 2024-09-19T06:14:50.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.278+0000 7fa0cec47640 1 -- 172.21.15.2:0/2724270446 wait complete. 2024-09-19T06:14:50.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.278+0000 7fa0cec47640 1 Processor -- start 2024-09-19T06:14:50.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.278+0000 7fa0cec47640 1 -- start start 2024-09-19T06:14:50.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.278+0000 7fa0cec47640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0c8100a50 0x7fa0c806ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:50.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.279+0000 7fa0cec47640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0c8101c40 0x7fa0c819eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:50.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.279+0000 7fa0cec47640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0c8102600 0x7fa0c81a13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:50.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.279+0000 7fa0cec47640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c810c560 con 0x7fa0c8101c40 2024-09-19T06:14:50.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.279+0000 7fa0cec47640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c810c3e0 con 0x7fa0c8100a50 2024-09-19T06:14:50.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.279+0000 7fa0cec47640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c810c6e0 con 0x7fa0c8102600 2024-09-19T06:14:50.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.279+0000 7fa0c7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0c8101c40 0x7fa0c819eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:50.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.279+0000 7fa0cc9e3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0c8100a50 0x7fa0c806ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:50.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.279+0000 7fa0c7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0c8101c40 0x7fa0c819eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49762/0 (socket says 172.21.15.2:49762) 2024-09-19T06:14:50.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.279+0000 7fa0c7fff640 1 -- 172.21.15.2:0/2306001413 learned_addr learned my addr 172.21.15.2:0/2306001413 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:50.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.279+0000 7fa0cc9e3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0c8100a50 0x7fa0c806ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:42132/0 (socket says 172.21.15.2:42132) 2024-09-19T06:14:50.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.279+0000 7fa0cd1e4640 1 --2- 172.21.15.2:0/2306001413 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0c8102600 0x7fa0c81a13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:50.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.279+0000 7fa0c7fff640 1 -- 172.21.15.2:0/2306001413 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0c8102600 msgr2=0x7fa0c81a13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:50.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.279+0000 7fa0c7fff640 1 --2- 172.21.15.2:0/2306001413 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0c8102600 0x7fa0c81a13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.279+0000 7fa0c7fff640 1 -- 172.21.15.2:0/2306001413 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0c8100a50 msgr2=0x7fa0c806ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:50.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.279+0000 7fa0c7fff640 1 --2- 172.21.15.2:0/2306001413 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0c8100a50 0x7fa0c806ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.279+0000 7fa0c7fff640 1 -- 172.21.15.2:0/2306001413 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0c81a1be0 con 0x7fa0c8101c40 2024-09-19T06:14:50.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.279+0000 7fa0cc9e3640 1 --2- 172.21.15.2:0/2306001413 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0c8100a50 0x7fa0c806ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:50.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.279+0000 7fa0c7fff640 1 --2- 172.21.15.2:0/2306001413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0c8101c40 0x7fa0c819eea0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa0b800e9f0 tx=0x7fa0b800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:50.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.279+0000 7fa0c5ffb640 1 -- 172.21.15.2:0/2306001413 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b800cd80 con 0x7fa0c8101c40 2024-09-19T06:14:50.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.280+0000 7fa0cec47640 1 -- 172.21.15.2:0/2306001413 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0c81a1e70 con 0x7fa0c8101c40 2024-09-19T06:14:50.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.280+0000 7fa0c5ffb640 1 -- 172.21.15.2:0/2306001413 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa0b80108e0 con 0x7fa0c8101c40 2024-09-19T06:14:50.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.280+0000 7fa0c5ffb640 1 -- 172.21.15.2:0/2306001413 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b8018920 con 0x7fa0c8101c40 2024-09-19T06:14:50.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.280+0000 7fa0cec47640 1 -- 172.21.15.2:0/2306001413 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0c81a2330 con 0x7fa0c8101c40 2024-09-19T06:14:50.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.281+0000 7fa0cec47640 1 -- 172.21.15.2:0/2306001413 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0c8107e90 con 0x7fa0c8101c40 2024-09-19T06:14:50.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.282+0000 7fa0c5ffb640 1 -- 172.21.15.2:0/2306001413 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7fa0b8010a90 con 0x7fa0c8101c40 2024-09-19T06:14:50.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.283+0000 7fa0c5ffb640 1 --2- 172.21.15.2:0/2306001413 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa0b40a3080 0x7fa0b40a5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:50.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.283+0000 7fa0cc9e3640 1 --2- 172.21.15.2:0/2306001413 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa0b40a3080 0x7fa0b40a5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:50.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.283+0000 7fa0c5ffb640 1 -- 172.21.15.2:0/2306001413 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fa0b80cf8d0 con 0x7fa0c8101c40 2024-09-19T06:14:50.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.284+0000 7fa0cc9e3640 1 --2- 172.21.15.2:0/2306001413 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa0b40a3080 0x7fa0b40a5540 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa0b00096c0 tx=0x7fa0b0009260 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:50.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.288+0000 7fa0c5ffb640 1 -- 172.21.15.2:0/2306001413 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa0b809c1a0 con 0x7fa0c8101c40 2024-09-19T06:14:50.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:50 smithi002 ceph-mon[30982]: mgrmap e21: x(active, since 1.01956s), standbys: z, y 2024-09-19T06:14:50.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:50 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/2704494585' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-19T06:14:50.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:50 smithi002 ceph-mon[30982]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:14:50.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:50 smithi002 ceph-mon[30982]: [19/Sep/2024:06:14:49] ENGINE Bus STARTING 2024-09-19T06:14:50.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:50 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1408646490' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:14:50.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:50 smithi002 ceph-mon[30982]: [19/Sep/2024:06:14:49] ENGINE Serving on http://172.21.15.2:8765 2024-09-19T06:14:50.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:50 smithi002 ceph-mon[30982]: [19/Sep/2024:06:14:49] ENGINE Serving on https://172.21.15.2:7150 2024-09-19T06:14:50.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:50 smithi002 ceph-mon[30982]: [19/Sep/2024:06:14:49] ENGINE Bus STARTED 2024-09-19T06:14:50.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:50 smithi002 ceph-mon[30982]: [19/Sep/2024:06:14:49] ENGINE Error in HTTPServer.serve 2024-09-19T06:14:50.473 INFO:journalctl@ceph.mon.a.smithi002.stdout: Traceback (most recent call last): 2024-09-19T06:14:50.473 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:14:50.473 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._connections.run(self.expiration_interval) 2024-09-19T06:14:50.473 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:14:50.474 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._run(expiration_interval) 2024-09-19T06:14:50.474 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:14:50.474 INFO:journalctl@ceph.mon.a.smithi002.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:14:50.474 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:14:50.474 INFO:journalctl@ceph.mon.a.smithi002.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:14:50.474 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:14:50.474 INFO:journalctl@ceph.mon.a.smithi002.stdout: s = self.context.wrap_socket( 2024-09-19T06:14:50.474 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:14:50.474 INFO:journalctl@ceph.mon.a.smithi002.stdout: return self.sslsocket_class._create( 2024-09-19T06:14:50.474 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:14:50.474 INFO:journalctl@ceph.mon.a.smithi002.stdout: self.do_handshake() 2024-09-19T06:14:50.474 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:14:50.474 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._sslobj.do_handshake() 2024-09-19T06:14:50.474 INFO:journalctl@ceph.mon.a.smithi002.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:14:50.475 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:50 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:50.475 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:50 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:50.475 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:50 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:50.475 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:50 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:50.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.477+0000 7fa0cec47640 1 -- 172.21.15.2:0/2306001413 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa0c8062df0 con 0x7fa0c8101c40 2024-09-19T06:14:50.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.477+0000 7fa0c5ffb640 1 -- 172.21.15.2:0/2306001413 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) ==== 104+0+11 (secure 0 0 0) 0x7fa0b80a04a0 con 0x7fa0c8101c40 2024-09-19T06:14:50.479 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-09-19T06:14:50.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.480+0000 7fa0cec47640 1 -- 172.21.15.2:0/2306001413 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa0b40a3080 msgr2=0x7fa0b40a5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:50.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.480+0000 7fa0cec47640 1 --2- 172.21.15.2:0/2306001413 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa0b40a3080 0x7fa0b40a5540 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa0b00096c0 tx=0x7fa0b0009260 comp rx=0 tx=0).stop 2024-09-19T06:14:50.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.480+0000 7fa0cec47640 1 -- 172.21.15.2:0/2306001413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0c8101c40 msgr2=0x7fa0c819eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:50.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.480+0000 7fa0cec47640 1 --2- 172.21.15.2:0/2306001413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0c8101c40 0x7fa0c819eea0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa0b800e9f0 tx=0x7fa0b800eeb0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.480+0000 7fa0cec47640 1 -- 172.21.15.2:0/2306001413 shutdown_connections 2024-09-19T06:14:50.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.480+0000 7fa0cec47640 1 --2- 172.21.15.2:0/2306001413 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa0b40a3080 0x7fa0b40a5540 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.480+0000 7fa0cec47640 1 --2- 172.21.15.2:0/2306001413 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0c8102600 0x7fa0c81a13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.480+0000 7fa0cec47640 1 --2- 172.21.15.2:0/2306001413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0c8101c40 0x7fa0c819eea0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.480+0000 7fa0cec47640 1 --2- 172.21.15.2:0/2306001413 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0c8100a50 0x7fa0c806ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.480+0000 7fa0cec47640 1 -- 172.21.15.2:0/2306001413 >> 172.21.15.2:0/2306001413 conn(0x7fa0c80fc190 msgr2=0x7fa0c8105060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:50.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.480+0000 7fa0cec47640 1 -- 172.21.15.2:0/2306001413 shutdown_connections 2024-09-19T06:14:50.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.480+0000 7fa0cec47640 1 -- 172.21.15.2:0/2306001413 wait complete. 2024-09-19T06:14:50.489 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:50 smithi090 ceph-mon[34497]: mgrmap e21: x(active, since 1.01956s), standbys: z, y 2024-09-19T06:14:50.489 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:50 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/2704494585' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-19T06:14:50.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:50 smithi090 ceph-mon[34497]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:14:50.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:50 smithi090 ceph-mon[34497]: [19/Sep/2024:06:14:49] ENGINE Bus STARTING 2024-09-19T06:14:50.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:50 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1408646490' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:14:50.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:50 smithi090 ceph-mon[34497]: [19/Sep/2024:06:14:49] ENGINE Serving on http://172.21.15.2:8765 2024-09-19T06:14:50.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:50 smithi090 ceph-mon[34497]: [19/Sep/2024:06:14:49] ENGINE Serving on https://172.21.15.2:7150 2024-09-19T06:14:50.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:50 smithi090 ceph-mon[34497]: [19/Sep/2024:06:14:49] ENGINE Bus STARTED 2024-09-19T06:14:50.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:50 smithi090 ceph-mon[34497]: [19/Sep/2024:06:14:49] ENGINE Error in HTTPServer.serve 2024-09-19T06:14:50.490 INFO:journalctl@ceph.mon.c.smithi090.stdout: Traceback (most recent call last): 2024-09-19T06:14:50.490 INFO:journalctl@ceph.mon.c.smithi090.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:14:50.490 INFO:journalctl@ceph.mon.c.smithi090.stdout: self._connections.run(self.expiration_interval) 2024-09-19T06:14:50.490 INFO:journalctl@ceph.mon.c.smithi090.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:14:50.490 INFO:journalctl@ceph.mon.c.smithi090.stdout: self._run(expiration_interval) 2024-09-19T06:14:50.491 INFO:journalctl@ceph.mon.c.smithi090.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:14:50.491 INFO:journalctl@ceph.mon.c.smithi090.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:14:50.491 INFO:journalctl@ceph.mon.c.smithi090.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:14:50.491 INFO:journalctl@ceph.mon.c.smithi090.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:14:50.491 INFO:journalctl@ceph.mon.c.smithi090.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:14:50.491 INFO:journalctl@ceph.mon.c.smithi090.stdout: s = self.context.wrap_socket( 2024-09-19T06:14:50.491 INFO:journalctl@ceph.mon.c.smithi090.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:14:50.491 INFO:journalctl@ceph.mon.c.smithi090.stdout: return self.sslsocket_class._create( 2024-09-19T06:14:50.491 INFO:journalctl@ceph.mon.c.smithi090.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:14:50.491 INFO:journalctl@ceph.mon.c.smithi090.stdout: self.do_handshake() 2024-09-19T06:14:50.491 INFO:journalctl@ceph.mon.c.smithi090.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:14:50.491 INFO:journalctl@ceph.mon.c.smithi090.stdout: self._sslobj.do_handshake() 2024-09-19T06:14:50.491 INFO:journalctl@ceph.mon.c.smithi090.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:14:50.492 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:50 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:50.492 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:50 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:50.492 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:50 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:50.492 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:50 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:50.493 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T06:14:50.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:50 smithi089 ceph-mon[34160]: mgrmap e21: x(active, since 1.01956s), standbys: z, y 2024-09-19T06:14:50.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:50 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/2704494585' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-19T06:14:50.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:50 smithi089 ceph-mon[34160]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:14:50.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:50 smithi089 ceph-mon[34160]: [19/Sep/2024:06:14:49] ENGINE Bus STARTING 2024-09-19T06:14:50.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:50 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1408646490' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:14:50.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:50 smithi089 ceph-mon[34160]: [19/Sep/2024:06:14:49] ENGINE Serving on http://172.21.15.2:8765 2024-09-19T06:14:50.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:50 smithi089 ceph-mon[34160]: [19/Sep/2024:06:14:49] ENGINE Serving on https://172.21.15.2:7150 2024-09-19T06:14:50.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:50 smithi089 ceph-mon[34160]: [19/Sep/2024:06:14:49] ENGINE Bus STARTED 2024-09-19T06:14:50.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:50 smithi089 ceph-mon[34160]: [19/Sep/2024:06:14:49] ENGINE Error in HTTPServer.serve 2024-09-19T06:14:50.543 INFO:journalctl@ceph.mon.b.smithi089.stdout: Traceback (most recent call last): 2024-09-19T06:14:50.543 INFO:journalctl@ceph.mon.b.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:14:50.543 INFO:journalctl@ceph.mon.b.smithi089.stdout: self._connections.run(self.expiration_interval) 2024-09-19T06:14:50.543 INFO:journalctl@ceph.mon.b.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:14:50.543 INFO:journalctl@ceph.mon.b.smithi089.stdout: self._run(expiration_interval) 2024-09-19T06:14:50.543 INFO:journalctl@ceph.mon.b.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:14:50.543 INFO:journalctl@ceph.mon.b.smithi089.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:14:50.543 INFO:journalctl@ceph.mon.b.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:14:50.543 INFO:journalctl@ceph.mon.b.smithi089.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:14:50.543 INFO:journalctl@ceph.mon.b.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:14:50.544 INFO:journalctl@ceph.mon.b.smithi089.stdout: s = self.context.wrap_socket( 2024-09-19T06:14:50.544 INFO:journalctl@ceph.mon.b.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:14:50.544 INFO:journalctl@ceph.mon.b.smithi089.stdout: return self.sslsocket_class._create( 2024-09-19T06:14:50.544 INFO:journalctl@ceph.mon.b.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:14:50.544 INFO:journalctl@ceph.mon.b.smithi089.stdout: self.do_handshake() 2024-09-19T06:14:50.544 INFO:journalctl@ceph.mon.b.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:14:50.544 INFO:journalctl@ceph.mon.b.smithi089.stdout: self._sslobj.do_handshake() 2024-09-19T06:14:50.544 INFO:journalctl@ceph.mon.b.smithi089.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:14:50.544 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:50 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:50.544 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:50 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:50.544 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:50 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:50.544 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:50 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:50.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.599+0000 7f13f0713640 1 -- 172.21.15.2:0/3422557101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13e8107810 msgr2=0x7f13e8109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:50.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.599+0000 7f13f0713640 1 --2- 172.21.15.2:0/3422557101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13e8107810 0x7f13e8109c80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f13e0009ca0 tx=0x7f13e002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.599+0000 7f13f0713640 1 -- 172.21.15.2:0/3422557101 shutdown_connections 2024-09-19T06:14:50.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.599+0000 7f13f0713640 1 --2- 172.21.15.2:0/3422557101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13e8107810 0x7f13e8109c80 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.599+0000 7f13f0713640 1 --2- 172.21.15.2:0/3422557101 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13e8104ee0 0x7f13e81072d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.599+0000 7f13f0713640 1 --2- 172.21.15.2:0/3422557101 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13e81025b0 0x7f13e81049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.599+0000 7f13f0713640 1 -- 172.21.15.2:0/3422557101 >> 172.21.15.2:0/3422557101 conn(0x7f13e80fc190 msgr2=0x7f13e80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:50.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.599+0000 7f13f0713640 1 -- 172.21.15.2:0/3422557101 shutdown_connections 2024-09-19T06:14:50.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.599+0000 7f13f0713640 1 -- 172.21.15.2:0/3422557101 wait complete. 2024-09-19T06:14:50.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.600+0000 7f13f0713640 1 Processor -- start 2024-09-19T06:14:50.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.600+0000 7f13f0713640 1 -- start start 2024-09-19T06:14:50.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.600+0000 7f13f0713640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13e81025b0 0x7f13e8197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:50.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.600+0000 7f13f0713640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13e8104ee0 0x7f13e8198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:50.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.600+0000 7f13f0713640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13e8107810 0x7f13e819f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:50.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.600+0000 7f13f0713640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f13e810d680 con 0x7f13e8107810 2024-09-19T06:14:50.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.600+0000 7f13f0713640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f13e810d500 con 0x7f13e81025b0 2024-09-19T06:14:50.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.600+0000 7f13f0713640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f13e810d800 con 0x7f13e8104ee0 2024-09-19T06:14:50.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.600+0000 7f13eecb0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13e8107810 0x7f13e819f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:50.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.600+0000 7f13eecb0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13e8107810 0x7f13e819f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49774/0 (socket says 172.21.15.2:49774) 2024-09-19T06:14:50.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.600+0000 7f13eecb0640 1 -- 172.21.15.2:0/4219247058 learned_addr learned my addr 172.21.15.2:0/4219247058 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:50.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.600+0000 7f13ee4af640 1 --2- 172.21.15.2:0/4219247058 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13e81025b0 0x7f13e8197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:50.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.600+0000 7f13edcae640 1 --2- 172.21.15.2:0/4219247058 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13e8104ee0 0x7f13e8198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:50.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.601+0000 7f13eecb0640 1 -- 172.21.15.2:0/4219247058 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13e8104ee0 msgr2=0x7f13e8198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:50.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.601+0000 7f13eecb0640 1 --2- 172.21.15.2:0/4219247058 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13e8104ee0 0x7f13e8198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.601+0000 7f13eecb0640 1 -- 172.21.15.2:0/4219247058 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13e81025b0 msgr2=0x7f13e8197dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:50.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.601+0000 7f13eecb0640 1 --2- 172.21.15.2:0/4219247058 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13e81025b0 0x7f13e8197dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.601+0000 7f13eecb0640 1 -- 172.21.15.2:0/4219247058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e819f9d0 con 0x7f13e8107810 2024-09-19T06:14:50.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.601+0000 7f13ee4af640 1 --2- 172.21.15.2:0/4219247058 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13e81025b0 0x7f13e8197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:50.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.601+0000 7f13eecb0640 1 --2- 172.21.15.2:0/4219247058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13e8107810 0x7f13e819f330 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f13e0031970 tx=0x7f13e0009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:50.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.601+0000 7f13df7fe640 1 -- 172.21.15.2:0/4219247058 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e0003c30 con 0x7f13e8107810 2024-09-19T06:14:50.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.601+0000 7f13f0713640 1 -- 172.21.15.2:0/4219247058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13e819fc60 con 0x7f13e8107810 2024-09-19T06:14:50.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.601+0000 7f13df7fe640 1 -- 172.21.15.2:0/4219247058 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f13e0003dd0 con 0x7f13e8107810 2024-09-19T06:14:50.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.601+0000 7f13df7fe640 1 -- 172.21.15.2:0/4219247058 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e0030b80 con 0x7f13e8107810 2024-09-19T06:14:50.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.601+0000 7f13f0713640 1 -- 172.21.15.2:0/4219247058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13e81a01b0 con 0x7f13e8107810 2024-09-19T06:14:50.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.602+0000 7f13f0713640 1 -- 172.21.15.2:0/4219247058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13e80fdc80 con 0x7f13e8107810 2024-09-19T06:14:50.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.604+0000 7f13df7fe640 1 -- 172.21.15.2:0/4219247058 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7f13e0004040 con 0x7f13e8107810 2024-09-19T06:14:50.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.604+0000 7f13df7fe640 1 --2- 172.21.15.2:0/4219247058 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f13d40a3050 0x7f13d40a5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:50.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.604+0000 7f13df7fe640 1 -- 172.21.15.2:0/4219247058 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f13e00f0c30 con 0x7f13e8107810 2024-09-19T06:14:50.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.604+0000 7f13ee4af640 1 --2- 172.21.15.2:0/4219247058 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f13d40a3050 0x7f13d40a5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:50.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.605+0000 7f13ee4af640 1 --2- 172.21.15.2:0/4219247058 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f13d40a3050 0x7f13d40a5510 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f13e8199290 tx=0x7f13e4005f90 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:50.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.607+0000 7f13df7fe640 1 -- 172.21.15.2:0/4219247058 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f13e00bdb50 con 0x7f13e8107810 2024-09-19T06:14:50.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.789+0000 7f13f0713640 1 -- 172.21.15.2:0/4219247058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f13e802da10 con 0x7f13e8107810 2024-09-19T06:14:50.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.790+0000 7f13df7fe640 1 -- 172.21.15.2:0/4219247058 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) ==== 100+0+11 (secure 0 0 0) 0x7f13e00bd450 con 0x7f13e8107810 2024-09-19T06:14:50.792 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2024-09-19T06:14:50.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.792+0000 7f13f0713640 1 -- 172.21.15.2:0/4219247058 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f13d40a3050 msgr2=0x7f13d40a5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:50.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.792+0000 7f13f0713640 1 --2- 172.21.15.2:0/4219247058 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f13d40a3050 0x7f13d40a5510 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f13e8199290 tx=0x7f13e4005f90 comp rx=0 tx=0).stop 2024-09-19T06:14:50.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.792+0000 7f13f0713640 1 -- 172.21.15.2:0/4219247058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13e8107810 msgr2=0x7f13e819f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:50.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.792+0000 7f13f0713640 1 --2- 172.21.15.2:0/4219247058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13e8107810 0x7f13e819f330 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f13e0031970 tx=0x7f13e0009800 comp rx=0 tx=0).stop 2024-09-19T06:14:50.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.792+0000 7f13f0713640 1 -- 172.21.15.2:0/4219247058 shutdown_connections 2024-09-19T06:14:50.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.792+0000 7f13f0713640 1 --2- 172.21.15.2:0/4219247058 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f13d40a3050 0x7f13d40a5510 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.792+0000 7f13f0713640 1 --2- 172.21.15.2:0/4219247058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13e8107810 0x7f13e819f330 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.792+0000 7f13f0713640 1 --2- 172.21.15.2:0/4219247058 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13e8104ee0 0x7f13e8198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.792+0000 7f13f0713640 1 --2- 172.21.15.2:0/4219247058 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13e81025b0 0x7f13e8197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.792+0000 7f13f0713640 1 -- 172.21.15.2:0/4219247058 >> 172.21.15.2:0/4219247058 conn(0x7f13e80fc190 msgr2=0x7f13e8102fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:50.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.793+0000 7f13f0713640 1 -- 172.21.15.2:0/4219247058 shutdown_connections 2024-09-19T06:14:50.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:50.793+0000 7f13f0713640 1 -- 172.21.15.2:0/4219247058 wait complete. 2024-09-19T06:14:50.805 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-19T06:14:50.805 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:14:51.066 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:51.377 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:51 smithi002 ceph-mon[30982]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:14:51.377 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:51 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/4075276771' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:14:51.377 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:51 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:51.377 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:51 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:51.377 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:51 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/2306001413' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T06:14:51.377 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:51 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:51.378 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:51 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:51.378 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:51 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:51.378 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:51 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:51.378 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:51 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:14:51.378 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:51 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:14:51.378 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:51 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:14:51.378 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:51 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:14:51.378 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:51 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:14:51.378 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:51 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:14:51.378 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:51 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:14:51.378 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:51 smithi002 ceph-mon[30982]: Adjusting osd_memory_target on smithi089 to 175.9M 2024-09-19T06:14:51.378 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:51 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:14:51.378 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:51 smithi002 ceph-mon[30982]: Unable to set osd_memory_target on smithi089 to 184520806: error parsing value: Value '184520806' is below minimum 939524096 2024-09-19T06:14:51.379 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:51 smithi002 ceph-mon[30982]: Adjusting osd_memory_target on smithi090 to 176.0M 2024-09-19T06:14:51.379 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:51 smithi002 ceph-mon[30982]: Unable to set osd_memory_target on smithi090 to 184555212: error parsing value: Value '184555212' is below minimum 939524096 2024-09-19T06:14:51.379 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:51 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/4219247058' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T06:14:51.379 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:51 smithi002 ceph-mon[30982]: mgrmap e22: x(active, since 2s), standbys: z, y 2024-09-19T06:14:51.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:51 smithi090 ceph-mon[34497]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:14:51.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:51 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/4075276771' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:14:51.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:51 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:51.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:51 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:51.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:51 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/2306001413' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T06:14:51.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:51 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:51.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:51 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:51.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:51 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:51.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:51 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:51.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:51 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:14:51.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:51 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:14:51.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:51 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:14:51.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:51 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:14:51.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:51 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:14:51.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:51 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:14:51.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:51 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:14:51.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:51 smithi090 ceph-mon[34497]: Adjusting osd_memory_target on smithi089 to 175.9M 2024-09-19T06:14:51.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:51 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:14:51.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:51 smithi090 ceph-mon[34497]: Unable to set osd_memory_target on smithi089 to 184520806: error parsing value: Value '184520806' is below minimum 939524096 2024-09-19T06:14:51.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:51 smithi090 ceph-mon[34497]: Adjusting osd_memory_target on smithi090 to 176.0M 2024-09-19T06:14:51.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:51 smithi090 ceph-mon[34497]: Unable to set osd_memory_target on smithi090 to 184555212: error parsing value: Value '184555212' is below minimum 939524096 2024-09-19T06:14:51.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:51 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/4219247058' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T06:14:51.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:51 smithi090 ceph-mon[34497]: mgrmap e22: x(active, since 2s), standbys: z, y 2024-09-19T06:14:51.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:51 smithi089 ceph-mon[34160]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:14:51.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:51 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/4075276771' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:14:51.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:51 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:51.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:51 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:51.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:51 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/2306001413' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T06:14:51.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:51 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:51.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:51 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:51.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:51 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:51.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:51 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:51.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:51 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:14:51.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:51 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:14:51.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:51 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:14:51.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:51 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:14:51.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:51 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:14:51.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:51 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:14:51.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:51 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:14:51.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:51 smithi089 ceph-mon[34160]: Adjusting osd_memory_target on smithi089 to 175.9M 2024-09-19T06:14:51.544 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:51 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:14:51.544 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:51 smithi089 ceph-mon[34160]: Unable to set osd_memory_target on smithi089 to 184520806: error parsing value: Value '184520806' is below minimum 939524096 2024-09-19T06:14:51.544 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:51 smithi089 ceph-mon[34160]: Adjusting osd_memory_target on smithi090 to 176.0M 2024-09-19T06:14:51.544 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:51 smithi089 ceph-mon[34160]: Unable to set osd_memory_target on smithi090 to 184555212: error parsing value: Value '184555212' is below minimum 939524096 2024-09-19T06:14:51.544 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:51 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/4219247058' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T06:14:51.544 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:51 smithi089 ceph-mon[34160]: mgrmap e22: x(active, since 2s), standbys: z, y 2024-09-19T06:14:51.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.653+0000 7f3384e1f640 1 -- 172.21.15.2:0/3951018108 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33801082a0 msgr2=0x7f338010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:51.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.653+0000 7f3384e1f640 1 --2- 172.21.15.2:0/3951018108 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33801082a0 0x7f338010ec40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3378009930 tx=0x7f337802a420 comp rx=0 tx=0).stop 2024-09-19T06:14:51.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.653+0000 7f3384e1f640 1 -- 172.21.15.2:0/3951018108 shutdown_connections 2024-09-19T06:14:51.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.653+0000 7f3384e1f640 1 --2- 172.21.15.2:0/3951018108 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33801082a0 0x7f338010ec40 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:51.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.653+0000 7f3384e1f640 1 --2- 172.21.15.2:0/3951018108 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33801036e0 0x7f3380107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:51.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.653+0000 7f3384e1f640 1 --2- 172.21.15.2:0/3951018108 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3380102d30 0x7f3380103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:51.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.653+0000 7f3384e1f640 1 -- 172.21.15.2:0/3951018108 >> 172.21.15.2:0/3951018108 conn(0x7f33800fc7d0 msgr2=0x7f33800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:51.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.653+0000 7f3384e1f640 1 -- 172.21.15.2:0/3951018108 shutdown_connections 2024-09-19T06:14:51.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.653+0000 7f3384e1f640 1 -- 172.21.15.2:0/3951018108 wait complete. 2024-09-19T06:14:51.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.654+0000 7f3384e1f640 1 Processor -- start 2024-09-19T06:14:51.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.654+0000 7f3384e1f640 1 -- start start 2024-09-19T06:14:51.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.655+0000 7f3384e1f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3380102d30 0x7f3380100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:51.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.655+0000 7f3384e1f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33801036e0 0x7f3380100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:51.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.655+0000 7f3384e1f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33801082a0 0x7f3380101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:51.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.655+0000 7f3384e1f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3380111f50 con 0x7f3380102d30 2024-09-19T06:14:51.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.655+0000 7f3384e1f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3380111dd0 con 0x7f33801082a0 2024-09-19T06:14:51.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.655+0000 7f3384e1f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f33801120d0 con 0x7f33801036e0 2024-09-19T06:14:51.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.655+0000 7f337e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3380102d30 0x7f3380100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:51.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.655+0000 7f337e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3380102d30 0x7f3380100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49788/0 (socket says 172.21.15.2:49788) 2024-09-19T06:14:51.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.655+0000 7f337e59c640 1 -- 172.21.15.2:0/3111506274 learned_addr learned my addr 172.21.15.2:0/3111506274 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:51.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.655+0000 7f337ed9d640 1 --2- 172.21.15.2:0/3111506274 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33801082a0 0x7f3380101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:51.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.655+0000 7f337dd9b640 1 --2- 172.21.15.2:0/3111506274 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33801036e0 0x7f3380100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:51.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.655+0000 7f337e59c640 1 -- 172.21.15.2:0/3111506274 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33801036e0 msgr2=0x7f3380100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:51.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.655+0000 7f337e59c640 1 --2- 172.21.15.2:0/3111506274 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33801036e0 0x7f3380100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:51.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.655+0000 7f337e59c640 1 -- 172.21.15.2:0/3111506274 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33801082a0 msgr2=0x7f3380101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:51.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.655+0000 7f337e59c640 1 --2- 172.21.15.2:0/3111506274 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33801082a0 0x7f3380101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:51.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.655+0000 7f337e59c640 1 -- 172.21.15.2:0/3111506274 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33801a6960 con 0x7f3380102d30 2024-09-19T06:14:51.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.655+0000 7f337ed9d640 1 --2- 172.21.15.2:0/3111506274 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33801082a0 0x7f3380101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:51.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.655+0000 7f337dd9b640 1 --2- 172.21.15.2:0/3111506274 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33801036e0 0x7f3380100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:51.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.655+0000 7f337e59c640 1 --2- 172.21.15.2:0/3111506274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3380102d30 0x7f3380100990 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f337000e9f0 tx=0x7f337000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:51.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.656+0000 7f336f7fe640 1 -- 172.21.15.2:0/3111506274 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337000cd80 con 0x7f3380102d30 2024-09-19T06:14:51.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.656+0000 7f336f7fe640 1 -- 172.21.15.2:0/3111506274 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f33700054d0 con 0x7f3380102d30 2024-09-19T06:14:51.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.656+0000 7f3384e1f640 1 -- 172.21.15.2:0/3111506274 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33801a6c50 con 0x7f3380102d30 2024-09-19T06:14:51.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.656+0000 7f336f7fe640 1 -- 172.21.15.2:0/3111506274 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3370010490 con 0x7f3380102d30 2024-09-19T06:14:51.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.656+0000 7f3384e1f640 1 -- 172.21.15.2:0/3111506274 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33801a7140 con 0x7f3380102d30 2024-09-19T06:14:51.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.657+0000 7f3384e1f640 1 -- 172.21.15.2:0/3111506274 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3380103110 con 0x7f3380102d30 2024-09-19T06:14:51.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.659+0000 7f336f7fe640 1 -- 172.21.15.2:0/3111506274 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 22) ==== 138525+0+0 (secure 0 0 0) 0x7f3370005000 con 0x7f3380102d30 2024-09-19T06:14:51.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.660+0000 7f336f7fe640 1 --2- 172.21.15.2:0/3111506274 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f33680a3440 0x7f33680a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:51.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.660+0000 7f337dd9b640 1 --2- 172.21.15.2:0/3111506274 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f33680a3440 0x7f33680a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:51.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.660+0000 7f336f7fe640 1 -- 172.21.15.2:0/3111506274 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f33700d03d0 con 0x7f3380102d30 2024-09-19T06:14:51.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.661+0000 7f337dd9b640 1 --2- 172.21.15.2:0/3111506274 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f33680a3440 0x7f33680a5900 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3380102420 tx=0x7f3374009500 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:51.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.663+0000 7f336f7fe640 1 -- 172.21.15.2:0/3111506274 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3370054210 con 0x7f3380102d30 2024-09-19T06:14:51.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.912+0000 7f3384e1f640 1 -- 172.21.15.2:0/3111506274 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3380101ec0 con 0x7f3380102d30 2024-09-19T06:14:51.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.913+0000 7f336f7fe640 1 -- 172.21.15.2:0/3111506274 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11882 (secure 0 0 0) 0x7f3380101ec0 con 0x7f3380102d30 2024-09-19T06:14:51.915 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:14:51.915 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-09-19T06:14:49:104280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:14:48.191083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24470,24472,24497]},"id":1}]} 2024-09-19T06:14:51.915 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-09-19T06:14:51.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.915+0000 7f3384e1f640 1 -- 172.21.15.2:0/3111506274 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f33680a3440 msgr2=0x7f33680a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:51.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.915+0000 7f3384e1f640 1 --2- 172.21.15.2:0/3111506274 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f33680a3440 0x7f33680a5900 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3380102420 tx=0x7f3374009500 comp rx=0 tx=0).stop 2024-09-19T06:14:51.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.915+0000 7f3384e1f640 1 -- 172.21.15.2:0/3111506274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3380102d30 msgr2=0x7f3380100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:51.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.915+0000 7f3384e1f640 1 --2- 172.21.15.2:0/3111506274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3380102d30 0x7f3380100990 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f337000e9f0 tx=0x7f337000edf0 comp rx=0 tx=0).stop 2024-09-19T06:14:51.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.915+0000 7f3384e1f640 1 -- 172.21.15.2:0/3111506274 shutdown_connections 2024-09-19T06:14:51.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.915+0000 7f3384e1f640 1 --2- 172.21.15.2:0/3111506274 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f33680a3440 0x7f33680a5900 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:51.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.915+0000 7f3384e1f640 1 --2- 172.21.15.2:0/3111506274 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33801082a0 0x7f3380101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:51.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.915+0000 7f3384e1f640 1 --2- 172.21.15.2:0/3111506274 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33801036e0 0x7f3380100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:51.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.915+0000 7f3384e1f640 1 --2- 172.21.15.2:0/3111506274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3380102d30 0x7f3380100990 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:51.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.915+0000 7f3384e1f640 1 -- 172.21.15.2:0/3111506274 >> 172.21.15.2:0/3111506274 conn(0x7f33800fc7d0 msgr2=0x7f3380105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:51.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.915+0000 7f3384e1f640 1 -- 172.21.15.2:0/3111506274 shutdown_connections 2024-09-19T06:14:51.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:51.915+0000 7f3384e1f640 1 -- 172.21.15.2:0/3111506274 wait complete. 2024-09-19T06:14:52.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:52 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:52.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:52 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:52.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:52 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:14:52.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:52 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:14:52.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:52 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:14:52.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:52 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:14:52.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:52 smithi002 ceph-mon[30982]: Adjusting osd_memory_target on smithi002 to 177.0M 2024-09-19T06:14:52.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:52 smithi002 ceph-mon[30982]: Unable to set osd_memory_target on smithi002 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-19T06:14:52.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:52 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:14:52.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:52 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:14:52.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:52 smithi002 ceph-mon[30982]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-19T06:14:52.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:52 smithi002 ceph-mon[30982]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-19T06:14:52.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:52 smithi002 ceph-mon[30982]: Updating smithi090:/etc/ceph/ceph.conf 2024-09-19T06:14:52.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:52 smithi002 ceph-mon[30982]: Updating smithi089:/var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:14:52.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:52 smithi002 ceph-mon[30982]: Updating smithi090:/var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:14:52.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:52 smithi002 ceph-mon[30982]: Updating smithi002:/var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:14:52.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:52 smithi002 ceph-mon[30982]: Updating smithi090:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:14:52.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:52 smithi002 ceph-mon[30982]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:14:52.224 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:52 smithi002 ceph-mon[30982]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:14:52.224 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:52 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/3111506274' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:14:52.224 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:52 smithi002 ceph-mon[30982]: Updating smithi090:/var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:14:52.224 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:52 smithi002 ceph-mon[30982]: Updating smithi089:/var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:14:52.224 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:52 smithi002 ceph-mon[30982]: Updating smithi002:/var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:14:52.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:52 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:52.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:52 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:52.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:52 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:14:52.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:52 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:14:52.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:52 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:14:52.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:52 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:14:52.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:52 smithi090 ceph-mon[34497]: Adjusting osd_memory_target on smithi002 to 177.0M 2024-09-19T06:14:52.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:52 smithi090 ceph-mon[34497]: Unable to set osd_memory_target on smithi002 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-19T06:14:52.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:52 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:14:52.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:52 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:14:52.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:52 smithi090 ceph-mon[34497]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-19T06:14:52.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:52 smithi090 ceph-mon[34497]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-19T06:14:52.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:52 smithi090 ceph-mon[34497]: Updating smithi090:/etc/ceph/ceph.conf 2024-09-19T06:14:52.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:52 smithi090 ceph-mon[34497]: Updating smithi089:/var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:14:52.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:52 smithi090 ceph-mon[34497]: Updating smithi090:/var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:14:52.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:52 smithi090 ceph-mon[34497]: Updating smithi002:/var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:14:52.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:52 smithi090 ceph-mon[34497]: Updating smithi090:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:14:52.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:52 smithi090 ceph-mon[34497]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:14:52.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:52 smithi090 ceph-mon[34497]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:14:52.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:52 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/3111506274' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:14:52.492 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:52 smithi090 ceph-mon[34497]: Updating smithi090:/var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:14:52.492 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:52 smithi090 ceph-mon[34497]: Updating smithi089:/var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:14:52.492 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:52 smithi090 ceph-mon[34497]: Updating smithi002:/var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:14:52.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:52 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:52.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:52 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:52.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:52 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:14:52.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:52 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:14:52.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:52 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:14:52.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:52 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:14:52.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:52 smithi089 ceph-mon[34160]: Adjusting osd_memory_target on smithi002 to 177.0M 2024-09-19T06:14:52.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:52 smithi089 ceph-mon[34160]: Unable to set osd_memory_target on smithi002 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-19T06:14:52.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:52 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:14:52.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:52 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:14:52.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:52 smithi089 ceph-mon[34160]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-19T06:14:52.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:52 smithi089 ceph-mon[34160]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-19T06:14:52.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:52 smithi089 ceph-mon[34160]: Updating smithi090:/etc/ceph/ceph.conf 2024-09-19T06:14:52.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:52 smithi089 ceph-mon[34160]: Updating smithi089:/var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:14:52.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:52 smithi089 ceph-mon[34160]: Updating smithi090:/var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:14:52.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:52 smithi089 ceph-mon[34160]: Updating smithi002:/var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:14:52.544 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:52 smithi089 ceph-mon[34160]: Updating smithi090:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:14:52.544 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:52 smithi089 ceph-mon[34160]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:14:52.544 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:52 smithi089 ceph-mon[34160]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:14:52.544 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:52 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/3111506274' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:14:52.544 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:52 smithi089 ceph-mon[34160]: Updating smithi090:/var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:14:52.544 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:52 smithi089 ceph-mon[34160]: Updating smithi089:/var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:14:52.544 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:52 smithi089 ceph-mon[34160]: Updating smithi002:/var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:14:52.878 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-19T06:14:52.878 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-19T06:14:52.878 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T06:14:52.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:52.984+0000 7f3ef51fd640 1 -- 172.21.15.2:0/3196933449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ef0107ac0 msgr2=0x7f3ef0107ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:52.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:52.984+0000 7f3ef51fd640 1 --2- 172.21.15.2:0/3196933449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ef0107ac0 0x7f3ef0107ea0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3ee0009cd0 tx=0x7f3ee002a8e0 comp rx=0 tx=0).stop 2024-09-19T06:14:52.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:52.984+0000 7f3ef51fd640 1 -- 172.21.15.2:0/3196933449 shutdown_connections 2024-09-19T06:14:52.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:52.984+0000 7f3ef51fd640 1 --2- 172.21.15.2:0/3196933449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ef0102450 0x7f3ef010e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:52.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:52.984+0000 7f3ef51fd640 1 --2- 172.21.15.2:0/3196933449 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ef0101ab0 0x7f3ef0101f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:52.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:52.984+0000 7f3ef51fd640 1 --2- 172.21.15.2:0/3196933449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ef0107ac0 0x7f3ef0107ea0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:52.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:52.984+0000 7f3ef51fd640 1 -- 172.21.15.2:0/3196933449 >> 172.21.15.2:0/3196933449 conn(0x7f3ef00fd7d0 msgr2=0x7f3ef00ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:52.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:52.984+0000 7f3ef51fd640 1 -- 172.21.15.2:0/3196933449 shutdown_connections 2024-09-19T06:14:52.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:52.984+0000 7f3ef51fd640 1 -- 172.21.15.2:0/3196933449 wait complete. 2024-09-19T06:14:52.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:52.985+0000 7f3ef51fd640 1 Processor -- start 2024-09-19T06:14:52.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:52.985+0000 7f3ef51fd640 1 -- start start 2024-09-19T06:14:52.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:52.985+0000 7f3ef51fd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ef0101ab0 0x7f3ef01982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:52.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:52.985+0000 7f3ef51fd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ef0102450 0x7f3ef0198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:52.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:52.985+0000 7f3ef51fd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ef0107ac0 0x7f3ef019cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:52.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:52.985+0000 7f3ef51fd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef0111db0 con 0x7f3ef0107ac0 2024-09-19T06:14:52.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:52.985+0000 7f3ef51fd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef0111c30 con 0x7f3ef0101ab0 2024-09-19T06:14:52.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:52.985+0000 7f3ef51fd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef0111f30 con 0x7f3ef0102450 2024-09-19T06:14:52.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:52.985+0000 7f3eeed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ef0101ab0 0x7f3ef01982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:52.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:52.985+0000 7f3eef59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ef0107ac0 0x7f3ef019cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:52.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:52.985+0000 7f3eee59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ef0102450 0x7f3ef0198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:52.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:52.985+0000 7f3eef59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ef0107ac0 0x7f3ef019cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49802/0 (socket says 172.21.15.2:49802) 2024-09-19T06:14:52.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:52.985+0000 7f3eee59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ef0102450 0x7f3ef0198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:53586/0 (socket says 172.21.15.2:53586) 2024-09-19T06:14:52.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:52.985+0000 7f3eeed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ef0101ab0 0x7f3ef01982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:42184/0 (socket says 172.21.15.2:42184) 2024-09-19T06:14:52.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:52.985+0000 7f3eef59e640 1 -- 172.21.15.2:0/3473951137 learned_addr learned my addr 172.21.15.2:0/3473951137 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:52.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:52.986+0000 7f3eef59e640 1 -- 172.21.15.2:0/3473951137 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ef0102450 msgr2=0x7f3ef0198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:52.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:52.986+0000 7f3eef59e640 1 --2- 172.21.15.2:0/3473951137 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ef0102450 0x7f3ef0198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:52.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:52.986+0000 7f3eef59e640 1 -- 172.21.15.2:0/3473951137 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ef0101ab0 msgr2=0x7f3ef01982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:52.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:52.986+0000 7f3eef59e640 1 --2- 172.21.15.2:0/3473951137 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ef0101ab0 0x7f3ef01982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:52.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:52.986+0000 7f3eef59e640 1 -- 172.21.15.2:0/3473951137 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ef019d2d0 con 0x7f3ef0107ac0 2024-09-19T06:14:52.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:52.986+0000 7f3eef59e640 1 --2- 172.21.15.2:0/3473951137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ef0107ac0 0x7f3ef019cba0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3ee800d750 tx=0x7f3ee800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:52.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:52.986+0000 7f3ee7fff640 1 -- 172.21.15.2:0/3473951137 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8017070 con 0x7f3ef0107ac0 2024-09-19T06:14:52.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:52.986+0000 7f3ef51fd640 1 -- 172.21.15.2:0/3473951137 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ef019d5c0 con 0x7f3ef0107ac0 2024-09-19T06:14:52.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:52.986+0000 7f3ee7fff640 1 -- 172.21.15.2:0/3473951137 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3ee80054d0 con 0x7f3ef0107ac0 2024-09-19T06:14:52.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:52.986+0000 7f3ee7fff640 1 -- 172.21.15.2:0/3473951137 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8004c60 con 0x7f3ef0107ac0 2024-09-19T06:14:52.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:52.986+0000 7f3ef51fd640 1 -- 172.21.15.2:0/3473951137 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ef0074420 con 0x7f3ef0107ac0 2024-09-19T06:14:52.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:52.987+0000 7f3ef51fd640 1 -- 172.21.15.2:0/3473951137 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ef0101f10 con 0x7f3ef0107ac0 2024-09-19T06:14:52.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:52.989+0000 7f3ee7fff640 1 -- 172.21.15.2:0/3473951137 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138581+0+0 (secure 0 0 0) 0x7f3ee8004e00 con 0x7f3ef0107ac0 2024-09-19T06:14:52.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:52.989+0000 7f3ee7fff640 1 --2- 172.21.15.2:0/3473951137 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f3edc0a34e0 0x7f3edc0a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:52.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:52.989+0000 7f3eeed9d640 1 --2- 172.21.15.2:0/3473951137 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f3edc0a34e0 0x7f3edc0a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:52.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:52.989+0000 7f3ee7fff640 1 -- 172.21.15.2:0/3473951137 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f3ee80cfd00 con 0x7f3ef0107ac0 2024-09-19T06:14:52.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:52.990+0000 7f3eeed9d640 1 --2- 172.21.15.2:0/3473951137 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f3edc0a34e0 0x7f3edc0a59a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3ee0006010 tx=0x7f3ee0031510 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:52.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:52.992+0000 7f3ee7fff640 1 -- 172.21.15.2:0/3473951137 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3ee809be10 con 0x7f3ef0107ac0 2024-09-19T06:14:53.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.166+0000 7f3ef51fd640 1 -- 172.21.15.2:0/3473951137 --> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3ef0062630 con 0x7f3edc0a34e0 2024-09-19T06:14:53.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.173+0000 7f3ee7fff640 1 -- 172.21.15.2:0/3473951137 <== mgr.15144 v2:172.21.15.2:6800/1594569191 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257871 (secure 0 0 0) 0x7f3ef0062630 con 0x7f3edc0a34e0 2024-09-19T06:14:53.177 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:14:53.178 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-19T06:14:53.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.176+0000 7f3ef51fd640 1 -- 172.21.15.2:0/3473951137 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f3edc0a34e0 msgr2=0x7f3edc0a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:53.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.176+0000 7f3ef51fd640 1 --2- 172.21.15.2:0/3473951137 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f3edc0a34e0 0x7f3edc0a59a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3ee0006010 tx=0x7f3ee0031510 comp rx=0 tx=0).stop 2024-09-19T06:14:53.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.176+0000 7f3ef51fd640 1 -- 172.21.15.2:0/3473951137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ef0107ac0 msgr2=0x7f3ef019cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:53.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.176+0000 7f3ef51fd640 1 --2- 172.21.15.2:0/3473951137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ef0107ac0 0x7f3ef019cba0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3ee800d750 tx=0x7f3ee800dc10 comp rx=0 tx=0).stop 2024-09-19T06:14:53.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.176+0000 7f3ef51fd640 1 -- 172.21.15.2:0/3473951137 shutdown_connections 2024-09-19T06:14:53.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.176+0000 7f3ef51fd640 1 --2- 172.21.15.2:0/3473951137 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f3edc0a34e0 0x7f3edc0a59a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.176+0000 7f3ef51fd640 1 --2- 172.21.15.2:0/3473951137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ef0107ac0 0x7f3ef019cba0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.176+0000 7f3ef51fd640 1 --2- 172.21.15.2:0/3473951137 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ef0102450 0x7f3ef0198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.176+0000 7f3ef51fd640 1 --2- 172.21.15.2:0/3473951137 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ef0101ab0 0x7f3ef01982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.176+0000 7f3ef51fd640 1 -- 172.21.15.2:0/3473951137 >> 172.21.15.2:0/3473951137 conn(0x7f3ef00fd7d0 msgr2=0x7f3ef00ff0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:53.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.176+0000 7f3ef51fd640 1 -- 172.21.15.2:0/3473951137 shutdown_connections 2024-09-19T06:14:53.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.176+0000 7f3ef51fd640 1 -- 172.21.15.2:0/3473951137 wait complete. 2024-09-19T06:14:53.189 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-09-19T06:14:52.117530+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1185859,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":814,"num_read_kb":566,"num_write":471,"num_write_kb":4372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1181380,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":863,"ondisk_log_size":863,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":375872,"kb_used_data":14116,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124565952,"statfs":{"total":1151940427776,"available":1151555534848,"internally_reserved":0,"allocated":14454784,"data_stored":8800297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.988811"},"pg_stats":[{"pgid":"3.3f","version":"81'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.563607+0000","last_change":"2024-09-19T06:13:03.799398+0000","last_active":"2024-09-19T06:14:48.563607+0000","last_peered":"2024-09-19T06:14:48.563607+0000","last_clean":"2024-09-19T06:14:48.563607+0000","last_became_active":"2024-09-19T06:13:03.799027+0000","last_became_peered":"2024-09-19T06:13:03.799027+0000","last_unstale":"2024-09-19T06:14:48.563607+0000","last_undegraded":"2024-09-19T06:14:48.563607+0000","last_fullsized":"2024-09-19T06:14:48.563607+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:35:45.934040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:14:41.999561+0000","last_change":"2024-09-19T06:13:03.791878+0000","last_active":"2024-09-19T06:14:41.999561+0000","last_peered":"2024-09-19T06:14:41.999561+0000","last_clean":"2024-09-19T06:14:41.999561+0000","last_became_active":"2024-09-19T06:13:03.791637+0000","last_became_peered":"2024-09-19T06:13:03.791637+0000","last_unstale":"2024-09-19T06:14:41.999561+0000","last_undegraded":"2024-09-19T06:14:41.999561+0000","last_fullsized":"2024-09-19T06:14:41.999561+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:00.078010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:14:42.020536+0000","last_change":"2024-09-19T06:13:03.798969+0000","last_active":"2024-09-19T06:14:42.020536+0000","last_peered":"2024-09-19T06:14:42.020536+0000","last_clean":"2024-09-19T06:14:42.020536+0000","last_became_active":"2024-09-19T06:13:03.798410+0000","last_became_peered":"2024-09-19T06:13:03.798410+0000","last_unstale":"2024-09-19T06:14:42.020536+0000","last_undegraded":"2024-09-19T06:14:42.020536+0000","last_fullsized":"2024-09-19T06:14:42.020536+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:48.381506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393184+0000","last_change":"2024-09-19T06:13:03.806455+0000","last_active":"2024-09-19T06:14:48.393184+0000","last_peered":"2024-09-19T06:14:48.393184+0000","last_clean":"2024-09-19T06:14:48.393184+0000","last_became_active":"2024-09-19T06:13:03.805830+0000","last_became_peered":"2024-09-19T06:13:03.805830+0000","last_unstale":"2024-09-19T06:14:48.393184+0000","last_undegraded":"2024-09-19T06:14:48.393184+0000","last_fullsized":"2024-09-19T06:14:48.393184+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:03.206791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.197090+0000","last_change":"2024-09-19T06:13:03.785009+0000","last_active":"2024-09-19T06:14:48.197090+0000","last_peered":"2024-09-19T06:14:48.197090+0000","last_clean":"2024-09-19T06:14:48.197090+0000","last_became_active":"2024-09-19T06:13:03.784638+0000","last_became_peered":"2024-09-19T06:13:03.784638+0000","last_unstale":"2024-09-19T06:14:48.197090+0000","last_undegraded":"2024-09-19T06:14:48.197090+0000","last_fullsized":"2024-09-19T06:14:48.197090+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:36:43.099492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.208699+0000","last_change":"2024-09-19T06:13:03.789006+0000","last_active":"2024-09-19T06:14:48.208699+0000","last_peered":"2024-09-19T06:14:48.208699+0000","last_clean":"2024-09-19T06:14:48.208699+0000","last_became_active":"2024-09-19T06:13:03.788639+0000","last_became_peered":"2024-09-19T06:13:03.788639+0000","last_unstale":"2024-09-19T06:14:48.208699+0000","last_undegraded":"2024-09-19T06:14:48.208699+0000","last_fullsized":"2024-09-19T06:14:48.208699+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:18.692491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.392819+0000","last_change":"2024-09-19T06:13:03.805264+0000","last_active":"2024-09-19T06:14:48.392819+0000","last_peered":"2024-09-19T06:14:48.392819+0000","last_clean":"2024-09-19T06:14:48.392819+0000","last_became_active":"2024-09-19T06:13:03.804948+0000","last_became_peered":"2024-09-19T06:13:03.804948+0000","last_unstale":"2024-09-19T06:14:48.392819+0000","last_undegraded":"2024-09-19T06:14:48.392819+0000","last_fullsized":"2024-09-19T06:14:48.392819+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:56:26.613785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.193611+0000","last_change":"2024-09-19T06:13:13.841110+0000","last_active":"2024-09-19T06:14:48.193611+0000","last_peered":"2024-09-19T06:14:48.193611+0000","last_clean":"2024-09-19T06:14:48.193611+0000","last_became_active":"2024-09-19T06:13:13.840736+0000","last_became_peered":"2024-09-19T06:13:13.840736+0000","last_unstale":"2024-09-19T06:14:48.193611+0000","last_undegraded":"2024-09-19T06:14:48.193611+0000","last_fullsized":"2024-09-19T06:14:48.193611+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:46.304692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.105840+0000","last_change":"2024-09-19T06:13:03.808432+0000","last_active":"2024-09-19T06:14:48.105840+0000","last_peered":"2024-09-19T06:14:48.105840+0000","last_clean":"2024-09-19T06:14:48.105840+0000","last_became_active":"2024-09-19T06:13:03.808120+0000","last_became_peered":"2024-09-19T06:13:03.808120+0000","last_unstale":"2024-09-19T06:14:48.105840+0000","last_undegraded":"2024-09-19T06:14:48.105840+0000","last_fullsized":"2024-09-19T06:14:48.105840+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:31.270525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.209097+0000","last_change":"2024-09-19T06:13:13.843937+0000","last_active":"2024-09-19T06:14:48.209097+0000","last_peered":"2024-09-19T06:14:48.209097+0000","last_clean":"2024-09-19T06:14:48.209097+0000","last_became_active":"2024-09-19T06:13:13.843541+0000","last_became_peered":"2024-09-19T06:13:13.843541+0000","last_unstale":"2024-09-19T06:14:48.209097+0000","last_undegraded":"2024-09-19T06:14:48.209097+0000","last_fullsized":"2024-09-19T06:14:48.209097+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:23.115055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393654+0000","last_change":"2024-09-19T06:13:03.803361+0000","last_active":"2024-09-19T06:14:48.393654+0000","last_peered":"2024-09-19T06:14:48.393654+0000","last_clean":"2024-09-19T06:14:48.393654+0000","last_became_active":"2024-09-19T06:13:03.802794+0000","last_became_peered":"2024-09-19T06:13:03.802794+0000","last_unstale":"2024-09-19T06:14:48.393654+0000","last_undegraded":"2024-09-19T06:14:48.393654+0000","last_fullsized":"2024-09-19T06:14:48.393654+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:53.126456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393335+0000","last_change":"2024-09-19T06:13:03.806163+0000","last_active":"2024-09-19T06:14:48.393335+0000","last_peered":"2024-09-19T06:14:48.393335+0000","last_clean":"2024-09-19T06:14:48.393335+0000","last_became_active":"2024-09-19T06:13:03.805406+0000","last_became_peered":"2024-09-19T06:13:03.805406+0000","last_unstale":"2024-09-19T06:14:48.393335+0000","last_undegraded":"2024-09-19T06:14:48.393335+0000","last_fullsized":"2024-09-19T06:14:48.393335+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:28:17.793408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.104212+0000","last_change":"2024-09-19T06:13:03.794617+0000","last_active":"2024-09-19T06:14:48.104212+0000","last_peered":"2024-09-19T06:14:48.104212+0000","last_clean":"2024-09-19T06:14:48.104212+0000","last_became_active":"2024-09-19T06:13:03.794264+0000","last_became_peered":"2024-09-19T06:13:03.794264+0000","last_unstale":"2024-09-19T06:14:48.104212+0000","last_undegraded":"2024-09-19T06:14:48.104212+0000","last_fullsized":"2024-09-19T06:14:48.104212+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:32.200624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:14:42.008637+0000","last_change":"2024-09-19T06:13:03.792632+0000","last_active":"2024-09-19T06:14:42.008637+0000","last_peered":"2024-09-19T06:14:42.008637+0000","last_clean":"2024-09-19T06:14:42.008637+0000","last_became_active":"2024-09-19T06:13:03.792409+0000","last_became_peered":"2024-09-19T06:13:03.792409+0000","last_unstale":"2024-09-19T06:14:42.008637+0000","last_undegraded":"2024-09-19T06:14:42.008637+0000","last_fullsized":"2024-09-19T06:14:42.008637+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:01.193404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:14:42.009044+0000","last_change":"2024-09-19T06:13:03.801784+0000","last_active":"2024-09-19T06:14:42.009044+0000","last_peered":"2024-09-19T06:14:42.009044+0000","last_clean":"2024-09-19T06:14:42.009044+0000","last_became_active":"2024-09-19T06:13:03.801350+0000","last_became_peered":"2024-09-19T06:13:03.801350+0000","last_unstale":"2024-09-19T06:14:42.009044+0000","last_undegraded":"2024-09-19T06:14:42.009044+0000","last_fullsized":"2024-09-19T06:14:42.009044+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:50:40.542264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.105234+0000","last_change":"2024-09-19T06:13:03.800069+0000","last_active":"2024-09-19T06:14:48.105234+0000","last_peered":"2024-09-19T06:14:48.105234+0000","last_clean":"2024-09-19T06:14:48.105234+0000","last_became_active":"2024-09-19T06:13:03.799690+0000","last_became_peered":"2024-09-19T06:13:03.799690+0000","last_unstale":"2024-09-19T06:14:48.105234+0000","last_undegraded":"2024-09-19T06:14:48.105234+0000","last_fullsized":"2024-09-19T06:14:48.105234+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:36:01.882849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.563640+0000","last_change":"2024-09-19T06:13:03.800180+0000","last_active":"2024-09-19T06:14:48.563640+0000","last_peered":"2024-09-19T06:14:48.563640+0000","last_clean":"2024-09-19T06:14:48.563640+0000","last_became_active":"2024-09-19T06:13:03.798981+0000","last_became_peered":"2024-09-19T06:13:03.798981+0000","last_unstale":"2024-09-19T06:14:48.563640+0000","last_undegraded":"2024-09-19T06:14:48.563640+0000","last_fullsized":"2024-09-19T06:14:48.563640+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:29.241021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.194480+0000","last_change":"2024-09-19T06:13:03.796889+0000","last_active":"2024-09-19T06:14:48.194480+0000","last_peered":"2024-09-19T06:14:48.194480+0000","last_clean":"2024-09-19T06:14:48.194480+0000","last_became_active":"2024-09-19T06:13:03.796539+0000","last_became_peered":"2024-09-19T06:13:03.796539+0000","last_unstale":"2024-09-19T06:14:48.194480+0000","last_undegraded":"2024-09-19T06:14:48.194480+0000","last_fullsized":"2024-09-19T06:14:48.194480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:10.462303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.108060+0000","last_change":"2024-09-19T06:13:03.798758+0000","last_active":"2024-09-19T06:14:48.108060+0000","last_peered":"2024-09-19T06:14:48.108060+0000","last_clean":"2024-09-19T06:14:48.108060+0000","last_became_active":"2024-09-19T06:13:03.798422+0000","last_became_peered":"2024-09-19T06:13:03.798422+0000","last_unstale":"2024-09-19T06:14:48.108060+0000","last_undegraded":"2024-09-19T06:14:48.108060+0000","last_fullsized":"2024-09-19T06:14:48.108060+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:03.712394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.563433+0000","last_change":"2024-09-19T06:13:03.800825+0000","last_active":"2024-09-19T06:14:48.563433+0000","last_peered":"2024-09-19T06:14:48.563433+0000","last_clean":"2024-09-19T06:14:48.563433+0000","last_became_active":"2024-09-19T06:13:03.800505+0000","last_became_peered":"2024-09-19T06:13:03.800505+0000","last_unstale":"2024-09-19T06:14:48.563433+0000","last_undegraded":"2024-09-19T06:14:48.563433+0000","last_fullsized":"2024-09-19T06:14:48.563433+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:15.640802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.104289+0000","last_change":"2024-09-19T06:13:03.797868+0000","last_active":"2024-09-19T06:14:48.104289+0000","last_peered":"2024-09-19T06:14:48.104289+0000","last_clean":"2024-09-19T06:14:48.104289+0000","last_became_active":"2024-09-19T06:13:03.797576+0000","last_became_peered":"2024-09-19T06:13:03.797576+0000","last_unstale":"2024-09-19T06:14:48.104289+0000","last_undegraded":"2024-09-19T06:14:48.104289+0000","last_fullsized":"2024-09-19T06:14:48.104289+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:29:18.953446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.105365+0000","last_change":"2024-09-19T06:13:03.805201+0000","last_active":"2024-09-19T06:14:48.105365+0000","last_peered":"2024-09-19T06:14:48.105365+0000","last_clean":"2024-09-19T06:14:48.105365+0000","last_became_active":"2024-09-19T06:13:03.803758+0000","last_became_peered":"2024-09-19T06:13:03.803758+0000","last_unstale":"2024-09-19T06:14:48.105365+0000","last_undegraded":"2024-09-19T06:14:48.105365+0000","last_fullsized":"2024-09-19T06:14:48.105365+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:49:26.088519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.196845+0000","last_change":"2024-09-19T06:13:03.796086+0000","last_active":"2024-09-19T06:14:48.196845+0000","last_peered":"2024-09-19T06:14:48.196845+0000","last_clean":"2024-09-19T06:14:48.196845+0000","last_became_active":"2024-09-19T06:13:03.795594+0000","last_became_peered":"2024-09-19T06:13:03.795594+0000","last_unstale":"2024-09-19T06:14:48.196845+0000","last_undegraded":"2024-09-19T06:14:48.196845+0000","last_fullsized":"2024-09-19T06:14:48.196845+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:26.374596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.205796+0000","last_change":"2024-09-19T06:13:03.796727+0000","last_active":"2024-09-19T06:14:48.205796+0000","last_peered":"2024-09-19T06:14:48.205796+0000","last_clean":"2024-09-19T06:14:48.205796+0000","last_became_active":"2024-09-19T06:13:03.796334+0000","last_became_peered":"2024-09-19T06:13:03.796334+0000","last_unstale":"2024-09-19T06:14:48.205796+0000","last_undegraded":"2024-09-19T06:14:48.205796+0000","last_fullsized":"2024-09-19T06:14:48.205796+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:47.660748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.197582+0000","last_change":"2024-09-19T06:13:03.800994+0000","last_active":"2024-09-19T06:14:48.197582+0000","last_peered":"2024-09-19T06:14:48.197582+0000","last_clean":"2024-09-19T06:14:48.197582+0000","last_became_active":"2024-09-19T06:13:03.800690+0000","last_became_peered":"2024-09-19T06:13:03.800690+0000","last_unstale":"2024-09-19T06:14:48.197582+0000","last_undegraded":"2024-09-19T06:14:48.197582+0000","last_fullsized":"2024-09-19T06:14:48.197582+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:37.204106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.108230+0000","last_change":"2024-09-19T06:13:03.797503+0000","last_active":"2024-09-19T06:14:48.108230+0000","last_peered":"2024-09-19T06:14:48.108230+0000","last_clean":"2024-09-19T06:14:48.108230+0000","last_became_active":"2024-09-19T06:13:03.797189+0000","last_became_peered":"2024-09-19T06:13:03.797189+0000","last_unstale":"2024-09-19T06:14:48.108230+0000","last_undegraded":"2024-09-19T06:14:48.108230+0000","last_fullsized":"2024-09-19T06:14:48.108230+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:16:18.036236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.563531+0000","last_change":"2024-09-19T06:13:03.795462+0000","last_active":"2024-09-19T06:14:48.563531+0000","last_peered":"2024-09-19T06:14:48.563531+0000","last_clean":"2024-09-19T06:14:48.563531+0000","last_became_active":"2024-09-19T06:13:03.793882+0000","last_became_peered":"2024-09-19T06:13:03.793882+0000","last_unstale":"2024-09-19T06:14:48.563531+0000","last_undegraded":"2024-09-19T06:14:48.563531+0000","last_fullsized":"2024-09-19T06:14:48.563531+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:04.329608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.104261+0000","last_change":"2024-09-19T06:13:03.800425+0000","last_active":"2024-09-19T06:14:48.104261+0000","last_peered":"2024-09-19T06:14:48.104261+0000","last_clean":"2024-09-19T06:14:48.104261+0000","last_became_active":"2024-09-19T06:13:03.800061+0000","last_became_peered":"2024-09-19T06:13:03.800061+0000","last_unstale":"2024-09-19T06:14:48.104261+0000","last_undegraded":"2024-09-19T06:14:48.104261+0000","last_fullsized":"2024-09-19T06:14:48.104261+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:36.454869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:14:42.006339+0000","last_change":"2024-09-19T06:13:03.801630+0000","last_active":"2024-09-19T06:14:42.006339+0000","last_peered":"2024-09-19T06:14:42.006339+0000","last_clean":"2024-09-19T06:14:42.006339+0000","last_became_active":"2024-09-19T06:13:03.801118+0000","last_became_peered":"2024-09-19T06:13:03.801118+0000","last_unstale":"2024-09-19T06:14:42.006339+0000","last_undegraded":"2024-09-19T06:14:42.006339+0000","last_fullsized":"2024-09-19T06:14:42.006339+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:52.641042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.107755+0000","last_change":"2024-09-19T06:13:03.793435+0000","last_active":"2024-09-19T06:14:48.107755+0000","last_peered":"2024-09-19T06:14:48.107755+0000","last_clean":"2024-09-19T06:14:48.107755+0000","last_became_active":"2024-09-19T06:13:03.793138+0000","last_became_peered":"2024-09-19T06:13:03.793138+0000","last_unstale":"2024-09-19T06:14:48.107755+0000","last_undegraded":"2024-09-19T06:14:48.107755+0000","last_fullsized":"2024-09-19T06:14:48.107755+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:40.967328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.107804+0000","last_change":"2024-09-19T06:13:03.800324+0000","last_active":"2024-09-19T06:14:48.107804+0000","last_peered":"2024-09-19T06:14:48.107804+0000","last_clean":"2024-09-19T06:14:48.107804+0000","last_became_active":"2024-09-19T06:13:03.799996+0000","last_became_peered":"2024-09-19T06:13:03.799996+0000","last_unstale":"2024-09-19T06:14:48.107804+0000","last_undegraded":"2024-09-19T06:14:48.107804+0000","last_fullsized":"2024-09-19T06:14:48.107804+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:04.012607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.563307+0000","last_change":"2024-09-19T06:13:03.794669+0000","last_active":"2024-09-19T06:14:48.563307+0000","last_peered":"2024-09-19T06:14:48.563307+0000","last_clean":"2024-09-19T06:14:48.563307+0000","last_became_active":"2024-09-19T06:13:03.794333+0000","last_became_peered":"2024-09-19T06:13:03.794333+0000","last_unstale":"2024-09-19T06:14:48.563307+0000","last_undegraded":"2024-09-19T06:14:48.563307+0000","last_fullsized":"2024-09-19T06:14:48.563307+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:27.690064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.197025+0000","last_change":"2024-09-19T06:13:03.794058+0000","last_active":"2024-09-19T06:14:48.197025+0000","last_peered":"2024-09-19T06:14:48.197025+0000","last_clean":"2024-09-19T06:14:48.197025+0000","last_became_active":"2024-09-19T06:13:03.793710+0000","last_became_peered":"2024-09-19T06:13:03.793710+0000","last_unstale":"2024-09-19T06:14:48.197025+0000","last_undegraded":"2024-09-19T06:14:48.197025+0000","last_fullsized":"2024-09-19T06:14:48.197025+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:56:05.395718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'8","reported_seq":140,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:49.008804+0000","last_change":"2024-09-19T06:13:13.848686+0000","last_active":"2024-09-19T06:14:49.008804+0000","last_peered":"2024-09-19T06:14:49.008804+0000","last_clean":"2024-09-19T06:14:49.008804+0000","last_became_active":"2024-09-19T06:13:13.843205+0000","last_became_peered":"2024-09-19T06:13:13.843205+0000","last_unstale":"2024-09-19T06:14:49.008804+0000","last_undegraded":"2024-09-19T06:14:49.008804+0000","last_fullsized":"2024-09-19T06:14:49.008804+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:49.016417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1903,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":4,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.205889+0000","last_change":"2024-09-19T06:13:03.801206+0000","last_active":"2024-09-19T06:14:48.205889+0000","last_peered":"2024-09-19T06:14:48.205889+0000","last_clean":"2024-09-19T06:14:48.205889+0000","last_became_active":"2024-09-19T06:13:03.800661+0000","last_became_peered":"2024-09-19T06:13:03.800661+0000","last_unstale":"2024-09-19T06:14:48.205889+0000","last_undegraded":"2024-09-19T06:14:48.205889+0000","last_fullsized":"2024-09-19T06:14:48.205889+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:28:11.187583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.208775+0000","last_change":"2024-09-19T06:13:01.656487+0000","last_active":"2024-09-19T06:14:48.208775+0000","last_peered":"2024-09-19T06:14:48.208775+0000","last_clean":"2024-09-19T06:14:48.208775+0000","last_became_active":"2024-09-19T06:13:01.656099+0000","last_became_peered":"2024-09-19T06:13:01.656099+0000","last_unstale":"2024-09-19T06:14:48.208775+0000","last_undegraded":"2024-09-19T06:14:48.208775+0000","last_fullsized":"2024-09-19T06:14:48.208775+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:01.437614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.103880+0000","last_change":"2024-09-19T06:13:01.656435+0000","last_active":"2024-09-19T06:14:48.103880+0000","last_peered":"2024-09-19T06:14:48.103880+0000","last_clean":"2024-09-19T06:14:48.103880+0000","last_became_active":"2024-09-19T06:13:01.655660+0000","last_became_peered":"2024-09-19T06:13:01.655660+0000","last_unstale":"2024-09-19T06:14:48.103880+0000","last_undegraded":"2024-09-19T06:14:48.103880+0000","last_fullsized":"2024-09-19T06:14:48.103880+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:35:06.211974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.196847+0000","last_change":"2024-09-19T06:13:03.784573+0000","last_active":"2024-09-19T06:14:48.196847+0000","last_peered":"2024-09-19T06:14:48.196847+0000","last_clean":"2024-09-19T06:14:48.196847+0000","last_became_active":"2024-09-19T06:13:03.784152+0000","last_became_peered":"2024-09-19T06:13:03.784152+0000","last_unstale":"2024-09-19T06:14:48.196847+0000","last_undegraded":"2024-09-19T06:14:48.196847+0000","last_fullsized":"2024-09-19T06:14:48.196847+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:28:39.606178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'1","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.206023+0000","last_change":"2024-09-19T06:13:01.656150+0000","last_active":"2024-09-19T06:14:48.206023+0000","last_peered":"2024-09-19T06:14:48.206023+0000","last_clean":"2024-09-19T06:14:48.206023+0000","last_became_active":"2024-09-19T06:13:01.655826+0000","last_became_peered":"2024-09-19T06:13:01.655826+0000","last_unstale":"2024-09-19T06:14:48.206023+0000","last_undegraded":"2024-09-19T06:14:48.206023+0000","last_fullsized":"2024-09-19T06:14:48.206023+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:57.782393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"81'11","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.193738+0000","last_change":"2024-09-19T06:13:03.784567+0000","last_active":"2024-09-19T06:14:48.193738+0000","last_peered":"2024-09-19T06:14:48.193738+0000","last_clean":"2024-09-19T06:14:48.193738+0000","last_became_active":"2024-09-19T06:13:03.784187+0000","last_became_peered":"2024-09-19T06:13:03.784187+0000","last_unstale":"2024-09-19T06:14:48.193738+0000","last_undegraded":"2024-09-19T06:14:48.193738+0000","last_fullsized":"2024-09-19T06:14:48.193738+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:21.037052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"81'4","reported_seq":120,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.209126+0000","last_change":"2024-09-19T06:13:01.659641+0000","last_active":"2024-09-19T06:14:48.209126+0000","last_peered":"2024-09-19T06:14:48.209126+0000","last_clean":"2024-09-19T06:14:48.209126+0000","last_became_active":"2024-09-19T06:13:01.659338+0000","last_became_peered":"2024-09-19T06:13:01.659338+0000","last_unstale":"2024-09-19T06:14:48.209126+0000","last_undegraded":"2024-09-19T06:14:48.209126+0000","last_fullsized":"2024-09-19T06:14:48.209126+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:26.230690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":92,"num_read_kb":92,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.105621+0000","last_change":"2024-09-19T06:13:03.797095+0000","last_active":"2024-09-19T06:14:48.105621+0000","last_peered":"2024-09-19T06:14:48.105621+0000","last_clean":"2024-09-19T06:14:48.105621+0000","last_became_active":"2024-09-19T06:13:03.796588+0000","last_became_peered":"2024-09-19T06:13:03.796588+0000","last_unstale":"2024-09-19T06:14:48.105621+0000","last_undegraded":"2024-09-19T06:14:48.105621+0000","last_fullsized":"2024-09-19T06:14:48.105621+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:33.705210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393064+0000","last_change":"2024-09-19T06:13:01.659995+0000","last_active":"2024-09-19T06:14:48.393064+0000","last_peered":"2024-09-19T06:14:48.393064+0000","last_clean":"2024-09-19T06:14:48.393064+0000","last_became_active":"2024-09-19T06:13:01.659621+0000","last_became_peered":"2024-09-19T06:13:01.659621+0000","last_unstale":"2024-09-19T06:14:48.393064+0000","last_undegraded":"2024-09-19T06:14:48.393064+0000","last_fullsized":"2024-09-19T06:14:48.393064+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:44.893111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:14:42.007304+0000","last_change":"2024-09-19T06:13:03.800859+0000","last_active":"2024-09-19T06:14:42.007304+0000","last_peered":"2024-09-19T06:14:42.007304+0000","last_clean":"2024-09-19T06:14:42.007304+0000","last_became_active":"2024-09-19T06:13:03.800540+0000","last_became_peered":"2024-09-19T06:13:03.800540+0000","last_unstale":"2024-09-19T06:14:42.007304+0000","last_undegraded":"2024-09-19T06:14:42.007304+0000","last_fullsized":"2024-09-19T06:14:42.007304+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:25:11.198557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'4","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.205898+0000","last_change":"2024-09-19T06:13:01.654666+0000","last_active":"2024-09-19T06:14:48.205898+0000","last_peered":"2024-09-19T06:14:48.205898+0000","last_clean":"2024-09-19T06:14:48.205898+0000","last_became_active":"2024-09-19T06:13:01.654241+0000","last_became_peered":"2024-09-19T06:13:01.654241+0000","last_unstale":"2024-09-19T06:14:48.205898+0000","last_undegraded":"2024-09-19T06:14:48.205898+0000","last_fullsized":"2024-09-19T06:14:48.205898+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:45.211100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.105541+0000","last_change":"2024-09-19T06:13:03.799906+0000","last_active":"2024-09-19T06:14:48.105541+0000","last_peered":"2024-09-19T06:14:48.105541+0000","last_clean":"2024-09-19T06:14:48.105541+0000","last_became_active":"2024-09-19T06:13:03.799566+0000","last_became_peered":"2024-09-19T06:13:03.799566+0000","last_unstale":"2024-09-19T06:14:48.105541+0000","last_undegraded":"2024-09-19T06:14:48.105541+0000","last_fullsized":"2024-09-19T06:14:48.105541+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:34.268480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'33","reported_seq":254,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:49.015635+0000","last_change":"2024-09-19T06:13:01.657204+0000","last_active":"2024-09-19T06:14:49.015635+0000","last_peered":"2024-09-19T06:14:49.015635+0000","last_clean":"2024-09-19T06:14:49.015635+0000","last_became_active":"2024-09-19T06:13:01.656886+0000","last_became_peered":"2024-09-19T06:13:01.656886+0000","last_unstale":"2024-09-19T06:14:49.015635+0000","last_undegraded":"2024-09-19T06:14:49.015635+0000","last_fullsized":"2024-09-19T06:14:49.015635+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:32:18.033428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65055,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":197,"num_read_kb":163,"num_write":34,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.197415+0000","last_change":"2024-09-19T06:13:03.798605+0000","last_active":"2024-09-19T06:14:48.197415+0000","last_peered":"2024-09-19T06:14:48.197415+0000","last_clean":"2024-09-19T06:14:48.197415+0000","last_became_active":"2024-09-19T06:13:03.798022+0000","last_became_peered":"2024-09-19T06:13:03.798022+0000","last_unstale":"2024-09-19T06:14:48.197415+0000","last_undegraded":"2024-09-19T06:14:48.197415+0000","last_fullsized":"2024-09-19T06:14:48.197415+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:10.094031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.107786+0000","last_change":"2024-09-19T06:13:01.652192+0000","last_active":"2024-09-19T06:14:48.107786+0000","last_peered":"2024-09-19T06:14:48.107786+0000","last_clean":"2024-09-19T06:14:48.107786+0000","last_became_active":"2024-09-19T06:13:01.651774+0000","last_became_peered":"2024-09-19T06:13:01.651774+0000","last_unstale":"2024-09-19T06:14:48.107786+0000","last_undegraded":"2024-09-19T06:14:48.107786+0000","last_fullsized":"2024-09-19T06:14:48.107786+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:39:47.683863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.103949+0000","last_change":"2024-09-19T06:13:03.798674+0000","last_active":"2024-09-19T06:14:48.103949+0000","last_peered":"2024-09-19T06:14:48.103949+0000","last_clean":"2024-09-19T06:14:48.103949+0000","last_became_active":"2024-09-19T06:13:03.798397+0000","last_became_peered":"2024-09-19T06:13:03.798397+0000","last_unstale":"2024-09-19T06:14:48.103949+0000","last_undegraded":"2024-09-19T06:14:48.103949+0000","last_fullsized":"2024-09-19T06:14:48.103949+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:37.155730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.205857+0000","last_change":"2024-09-19T06:13:01.655777+0000","last_active":"2024-09-19T06:14:48.205857+0000","last_peered":"2024-09-19T06:14:48.205857+0000","last_clean":"2024-09-19T06:14:48.205857+0000","last_became_active":"2024-09-19T06:13:01.655420+0000","last_became_peered":"2024-09-19T06:13:01.655420+0000","last_unstale":"2024-09-19T06:14:48.205857+0000","last_undegraded":"2024-09-19T06:14:48.205857+0000","last_fullsized":"2024-09-19T06:14:48.205857+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:02.593204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393400+0000","last_change":"2024-09-19T06:13:03.803799+0000","last_active":"2024-09-19T06:14:48.393400+0000","last_peered":"2024-09-19T06:14:48.393400+0000","last_clean":"2024-09-19T06:14:48.393400+0000","last_became_active":"2024-09-19T06:13:03.803350+0000","last_became_peered":"2024-09-19T06:13:03.803350+0000","last_unstale":"2024-09-19T06:14:48.393400+0000","last_undegraded":"2024-09-19T06:14:48.393400+0000","last_fullsized":"2024-09-19T06:14:48.393400+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:15.806363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'4","reported_seq":123,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393315+0000","last_change":"2024-09-19T06:13:01.656007+0000","last_active":"2024-09-19T06:14:48.393315+0000","last_peered":"2024-09-19T06:14:48.393315+0000","last_clean":"2024-09-19T06:14:48.393315+0000","last_became_active":"2024-09-19T06:13:01.655642+0000","last_became_peered":"2024-09-19T06:13:01.655642+0000","last_unstale":"2024-09-19T06:14:48.393315+0000","last_undegraded":"2024-09-19T06:14:48.393315+0000","last_fullsized":"2024-09-19T06:14:48.393315+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:54.391122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1083,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.392934+0000","last_change":"2024-09-19T06:13:03.804426+0000","last_active":"2024-09-19T06:14:48.392934+0000","last_peered":"2024-09-19T06:14:48.392934+0000","last_clean":"2024-09-19T06:14:48.392934+0000","last_became_active":"2024-09-19T06:13:03.804146+0000","last_became_peered":"2024-09-19T06:13:03.804146+0000","last_unstale":"2024-09-19T06:14:48.392934+0000","last_undegraded":"2024-09-19T06:14:48.392934+0000","last_fullsized":"2024-09-19T06:14:48.392934+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:56.198679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.196999+0000","last_change":"2024-09-19T06:13:01.650023+0000","last_active":"2024-09-19T06:14:48.196999+0000","last_peered":"2024-09-19T06:14:48.196999+0000","last_clean":"2024-09-19T06:14:48.196999+0000","last_became_active":"2024-09-19T06:13:01.649674+0000","last_became_peered":"2024-09-19T06:13:01.649674+0000","last_unstale":"2024-09-19T06:14:48.196999+0000","last_undegraded":"2024-09-19T06:14:48.196999+0000","last_fullsized":"2024-09-19T06:14:48.196999+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:56:11.164070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.205838+0000","last_change":"2024-09-19T06:13:03.802078+0000","last_active":"2024-09-19T06:14:48.205838+0000","last_peered":"2024-09-19T06:14:48.205838+0000","last_clean":"2024-09-19T06:14:48.205838+0000","last_became_active":"2024-09-19T06:13:03.801552+0000","last_became_peered":"2024-09-19T06:13:03.801552+0000","last_unstale":"2024-09-19T06:14:48.205838+0000","last_undegraded":"2024-09-19T06:14:48.205838+0000","last_fullsized":"2024-09-19T06:14:48.205838+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:57.025457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.563366+0000","last_change":"2024-09-19T06:13:13.843721+0000","last_active":"2024-09-19T06:14:48.563366+0000","last_peered":"2024-09-19T06:14:48.563366+0000","last_clean":"2024-09-19T06:14:48.563366+0000","last_became_active":"2024-09-19T06:13:13.838567+0000","last_became_peered":"2024-09-19T06:13:13.838567+0000","last_unstale":"2024-09-19T06:14:48.563366+0000","last_undegraded":"2024-09-19T06:14:48.563366+0000","last_fullsized":"2024-09-19T06:14:48.563366+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:44.479675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.563428+0000","last_change":"2024-09-19T06:13:03.801534+0000","last_active":"2024-09-19T06:14:48.563428+0000","last_peered":"2024-09-19T06:14:48.563428+0000","last_clean":"2024-09-19T06:14:48.563428+0000","last_became_active":"2024-09-19T06:13:03.801142+0000","last_became_peered":"2024-09-19T06:13:03.801142+0000","last_unstale":"2024-09-19T06:14:48.563428+0000","last_undegraded":"2024-09-19T06:14:48.563428+0000","last_fullsized":"2024-09-19T06:14:48.563428+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:45.029662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.104216+0000","last_change":"2024-09-19T06:13:01.655075+0000","last_active":"2024-09-19T06:14:48.104216+0000","last_peered":"2024-09-19T06:14:48.104216+0000","last_clean":"2024-09-19T06:14:48.104216+0000","last_became_active":"2024-09-19T06:13:01.649236+0000","last_became_peered":"2024-09-19T06:13:01.649236+0000","last_unstale":"2024-09-19T06:14:48.104216+0000","last_undegraded":"2024-09-19T06:14:48.104216+0000","last_fullsized":"2024-09-19T06:14:48.104216+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:06.007418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393140+0000","last_change":"2024-09-19T06:13:03.795674+0000","last_active":"2024-09-19T06:14:48.393140+0000","last_peered":"2024-09-19T06:14:48.393140+0000","last_clean":"2024-09-19T06:14:48.393140+0000","last_became_active":"2024-09-19T06:13:03.794843+0000","last_became_peered":"2024-09-19T06:13:03.794843+0000","last_unstale":"2024-09-19T06:14:48.393140+0000","last_undegraded":"2024-09-19T06:14:48.393140+0000","last_fullsized":"2024-09-19T06:14:48.393140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:41:57.669988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'39","reported_seq":71,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.337655+0000","last_change":"2024-09-19T06:13:01.656696+0000","last_active":"2024-09-19T06:14:48.337655+0000","last_peered":"2024-09-19T06:14:48.337655+0000","last_clean":"2024-09-19T06:14:48.337655+0000","last_became_active":"2024-09-19T06:13:01.655260+0000","last_became_peered":"2024-09-19T06:13:01.655260+0000","last_unstale":"2024-09-19T06:14:48.337655+0000","last_undegraded":"2024-09-19T06:14:48.337655+0000","last_fullsized":"2024-09-19T06:14:48.337655+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:50.281013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393069+0000","last_change":"2024-09-19T06:13:03.804411+0000","last_active":"2024-09-19T06:14:48.393069+0000","last_peered":"2024-09-19T06:14:48.393069+0000","last_clean":"2024-09-19T06:14:48.393069+0000","last_became_active":"2024-09-19T06:13:03.804052+0000","last_became_peered":"2024-09-19T06:13:03.804052+0000","last_unstale":"2024-09-19T06:14:48.393069+0000","last_undegraded":"2024-09-19T06:14:48.393069+0000","last_fullsized":"2024-09-19T06:14:48.393069+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:33.394141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.108014+0000","last_change":"2024-09-19T06:13:01.655164+0000","last_active":"2024-09-19T06:14:48.108014+0000","last_peered":"2024-09-19T06:14:48.108014+0000","last_clean":"2024-09-19T06:14:48.108014+0000","last_became_active":"2024-09-19T06:13:01.654297+0000","last_became_peered":"2024-09-19T06:13:01.654297+0000","last_unstale":"2024-09-19T06:14:48.108014+0000","last_undegraded":"2024-09-19T06:14:48.108014+0000","last_fullsized":"2024-09-19T06:14:48.108014+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:02:02.861982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393736+0000","last_change":"2024-09-19T06:13:03.802799+0000","last_active":"2024-09-19T06:14:48.393736+0000","last_peered":"2024-09-19T06:14:48.393736+0000","last_clean":"2024-09-19T06:14:48.393736+0000","last_became_active":"2024-09-19T06:13:03.802348+0000","last_became_peered":"2024-09-19T06:13:03.802348+0000","last_unstale":"2024-09-19T06:14:48.393736+0000","last_undegraded":"2024-09-19T06:14:48.393736+0000","last_fullsized":"2024-09-19T06:14:48.393736+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:05:52.685874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":348,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393203+0000","last_change":"2024-09-19T06:11:51.805685+0000","last_active":"2024-09-19T06:14:48.393203+0000","last_peered":"2024-09-19T06:14:48.393203+0000","last_clean":"2024-09-19T06:14:48.393203+0000","last_became_active":"2024-09-19T06:11:51.805191+0000","last_became_peered":"2024-09-19T06:11:51.805191+0000","last_unstale":"2024-09-19T06:14:48.393203+0000","last_undegraded":"2024-09-19T06:14:48.393203+0000","last_fullsized":"2024-09-19T06:14:48.393203+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:08:28.556644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:08:28.556644+0000","last_clean_scrub_stamp":"2024-09-19T06:08:28.556644+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:19.169542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393779+0000","last_change":"2024-09-19T06:13:01.656796+0000","last_active":"2024-09-19T06:14:48.393779+0000","last_peered":"2024-09-19T06:14:48.393779+0000","last_clean":"2024-09-19T06:14:48.393779+0000","last_became_active":"2024-09-19T06:13:01.656350+0000","last_became_peered":"2024-09-19T06:13:01.656350+0000","last_unstale":"2024-09-19T06:14:48.393779+0000","last_undegraded":"2024-09-19T06:14:48.393779+0000","last_fullsized":"2024-09-19T06:14:48.393779+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:19:03.820218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.198039+0000","last_change":"2024-09-19T06:13:03.793697+0000","last_active":"2024-09-19T06:14:48.198039+0000","last_peered":"2024-09-19T06:14:48.198039+0000","last_clean":"2024-09-19T06:14:48.198039+0000","last_became_active":"2024-09-19T06:13:03.793378+0000","last_became_peered":"2024-09-19T06:13:03.793378+0000","last_unstale":"2024-09-19T06:14:48.198039+0000","last_undegraded":"2024-09-19T06:14:48.198039+0000","last_fullsized":"2024-09-19T06:14:48.198039+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:29:44.236255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393147+0000","last_change":"2024-09-19T06:13:01.658035+0000","last_active":"2024-09-19T06:14:48.393147+0000","last_peered":"2024-09-19T06:14:48.393147+0000","last_clean":"2024-09-19T06:14:48.393147+0000","last_became_active":"2024-09-19T06:13:01.657602+0000","last_became_peered":"2024-09-19T06:13:01.657602+0000","last_unstale":"2024-09-19T06:14:48.393147+0000","last_undegraded":"2024-09-19T06:14:48.393147+0000","last_fullsized":"2024-09-19T06:14:48.393147+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:27.015086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.103875+0000","last_change":"2024-09-19T06:13:03.793377+0000","last_active":"2024-09-19T06:14:48.103875+0000","last_peered":"2024-09-19T06:14:48.103875+0000","last_clean":"2024-09-19T06:14:48.103875+0000","last_became_active":"2024-09-19T06:13:03.793047+0000","last_became_peered":"2024-09-19T06:13:03.793047+0000","last_unstale":"2024-09-19T06:14:48.103875+0000","last_undegraded":"2024-09-19T06:14:48.103875+0000","last_fullsized":"2024-09-19T06:14:48.103875+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:22.883358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":121,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.104089+0000","last_change":"2024-09-19T06:13:01.650179+0000","last_active":"2024-09-19T06:14:48.104089+0000","last_peered":"2024-09-19T06:14:48.104089+0000","last_clean":"2024-09-19T06:14:48.104089+0000","last_became_active":"2024-09-19T06:13:01.649889+0000","last_became_peered":"2024-09-19T06:13:01.649889+0000","last_unstale":"2024-09-19T06:14:48.104089+0000","last_undegraded":"2024-09-19T06:14:48.104089+0000","last_fullsized":"2024-09-19T06:14:48.104089+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:55:00.400406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":92,"num_read_kb":92,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.205842+0000","last_change":"2024-09-19T06:13:03.800277+0000","last_active":"2024-09-19T06:14:48.205842+0000","last_peered":"2024-09-19T06:14:48.205842+0000","last_clean":"2024-09-19T06:14:48.205842+0000","last_became_active":"2024-09-19T06:13:03.799862+0000","last_became_peered":"2024-09-19T06:13:03.799862+0000","last_unstale":"2024-09-19T06:14:48.205842+0000","last_undegraded":"2024-09-19T06:14:48.205842+0000","last_fullsized":"2024-09-19T06:14:48.205842+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:51.558276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393634+0000","last_change":"2024-09-19T06:13:01.659592+0000","last_active":"2024-09-19T06:14:48.393634+0000","last_peered":"2024-09-19T06:14:48.393634+0000","last_clean":"2024-09-19T06:14:48.393634+0000","last_became_active":"2024-09-19T06:13:01.659258+0000","last_became_peered":"2024-09-19T06:13:01.659258+0000","last_unstale":"2024-09-19T06:14:48.393634+0000","last_undegraded":"2024-09-19T06:14:48.393634+0000","last_fullsized":"2024-09-19T06:14:48.393634+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:46.097656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.208817+0000","last_change":"2024-09-19T06:13:03.793100+0000","last_active":"2024-09-19T06:14:48.208817+0000","last_peered":"2024-09-19T06:14:48.208817+0000","last_clean":"2024-09-19T06:14:48.208817+0000","last_became_active":"2024-09-19T06:13:03.792768+0000","last_became_peered":"2024-09-19T06:13:03.792768+0000","last_unstale":"2024-09-19T06:14:48.208817+0000","last_undegraded":"2024-09-19T06:14:48.208817+0000","last_fullsized":"2024-09-19T06:14:48.208817+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:11:36.122712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.194321+0000","last_change":"2024-09-19T06:13:01.650511+0000","last_active":"2024-09-19T06:14:48.194321+0000","last_peered":"2024-09-19T06:14:48.194321+0000","last_clean":"2024-09-19T06:14:48.194321+0000","last_became_active":"2024-09-19T06:13:01.650099+0000","last_became_peered":"2024-09-19T06:13:01.650099+0000","last_unstale":"2024-09-19T06:14:48.194321+0000","last_undegraded":"2024-09-19T06:14:48.194321+0000","last_fullsized":"2024-09-19T06:14:48.194321+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:16.386025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.208855+0000","last_change":"2024-09-19T06:13:03.783690+0000","last_active":"2024-09-19T06:14:48.208855+0000","last_peered":"2024-09-19T06:14:48.208855+0000","last_clean":"2024-09-19T06:14:48.208855+0000","last_became_active":"2024-09-19T06:13:03.783296+0000","last_became_peered":"2024-09-19T06:13:03.783296+0000","last_unstale":"2024-09-19T06:14:48.208855+0000","last_undegraded":"2024-09-19T06:14:48.208855+0000","last_fullsized":"2024-09-19T06:14:48.208855+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:49:19.605979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"79'1","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.197422+0000","last_change":"2024-09-19T06:13:01.648671+0000","last_active":"2024-09-19T06:14:48.197422+0000","last_peered":"2024-09-19T06:14:48.197422+0000","last_clean":"2024-09-19T06:14:48.197422+0000","last_became_active":"2024-09-19T06:13:01.647329+0000","last_became_peered":"2024-09-19T06:13:01.647329+0000","last_unstale":"2024-09-19T06:14:48.197422+0000","last_undegraded":"2024-09-19T06:14:48.197422+0000","last_fullsized":"2024-09-19T06:14:48.197422+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:31.026561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.104368+0000","last_change":"2024-09-19T06:13:03.795195+0000","last_active":"2024-09-19T06:14:48.104368+0000","last_peered":"2024-09-19T06:14:48.104368+0000","last_clean":"2024-09-19T06:14:48.104368+0000","last_became_active":"2024-09-19T06:13:03.794882+0000","last_became_peered":"2024-09-19T06:13:03.794882+0000","last_unstale":"2024-09-19T06:14:48.104368+0000","last_undegraded":"2024-09-19T06:14:48.104368+0000","last_fullsized":"2024-09-19T06:14:48.104368+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:47.290917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'48","reported_seq":95,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.343397+0000","last_change":"2024-09-19T06:13:01.652133+0000","last_active":"2024-09-19T06:14:48.343397+0000","last_peered":"2024-09-19T06:14:48.343397+0000","last_clean":"2024-09-19T06:14:48.343397+0000","last_became_active":"2024-09-19T06:13:01.651796+0000","last_became_peered":"2024-09-19T06:13:01.651796+0000","last_unstale":"2024-09-19T06:14:48.343397+0000","last_undegraded":"2024-09-19T06:14:48.343397+0000","last_fullsized":"2024-09-19T06:14:48.343397+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:01.576308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":86,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.197692+0000","last_change":"2024-09-19T06:13:03.799332+0000","last_active":"2024-09-19T06:14:48.197692+0000","last_peered":"2024-09-19T06:14:48.197692+0000","last_clean":"2024-09-19T06:14:48.197692+0000","last_became_active":"2024-09-19T06:13:03.798996+0000","last_became_peered":"2024-09-19T06:13:03.798996+0000","last_unstale":"2024-09-19T06:14:48.197692+0000","last_undegraded":"2024-09-19T06:14:48.197692+0000","last_fullsized":"2024-09-19T06:14:48.197692+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:37:32.245396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393965+0000","last_change":"2024-09-19T06:13:01.652392+0000","last_active":"2024-09-19T06:14:48.393965+0000","last_peered":"2024-09-19T06:14:48.393965+0000","last_clean":"2024-09-19T06:14:48.393965+0000","last_became_active":"2024-09-19T06:13:01.651982+0000","last_became_peered":"2024-09-19T06:13:01.651982+0000","last_unstale":"2024-09-19T06:14:48.393965+0000","last_undegraded":"2024-09-19T06:14:48.393965+0000","last_fullsized":"2024-09-19T06:14:48.393965+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:15:39.590215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:14:42.007637+0000","last_change":"2024-09-19T06:13:13.988765+0000","last_active":"2024-09-19T06:14:42.007637+0000","last_peered":"2024-09-19T06:14:42.007637+0000","last_clean":"2024-09-19T06:14:42.007637+0000","last_became_active":"2024-09-19T06:13:13.988328+0000","last_became_peered":"2024-09-19T06:13:13.988328+0000","last_unstale":"2024-09-19T06:14:42.007637+0000","last_undegraded":"2024-09-19T06:14:42.007637+0000","last_fullsized":"2024-09-19T06:14:42.007637+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:10.219202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.105312+0000","last_change":"2024-09-19T06:13:01.658954+0000","last_active":"2024-09-19T06:14:48.105312+0000","last_peered":"2024-09-19T06:14:48.105312+0000","last_clean":"2024-09-19T06:14:48.105312+0000","last_became_active":"2024-09-19T06:13:01.658453+0000","last_became_peered":"2024-09-19T06:13:01.658453+0000","last_unstale":"2024-09-19T06:14:48.105312+0000","last_undegraded":"2024-09-19T06:14:48.105312+0000","last_fullsized":"2024-09-19T06:14:48.105312+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:17.134858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.196997+0000","last_change":"2024-09-19T06:13:03.786812+0000","last_active":"2024-09-19T06:14:48.196997+0000","last_peered":"2024-09-19T06:14:48.196997+0000","last_clean":"2024-09-19T06:14:48.196997+0000","last_became_active":"2024-09-19T06:13:03.786481+0000","last_became_peered":"2024-09-19T06:13:03.786481+0000","last_unstale":"2024-09-19T06:14:48.196997+0000","last_undegraded":"2024-09-19T06:14:48.196997+0000","last_fullsized":"2024-09-19T06:14:48.196997+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:46.614073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.197141+0000","last_change":"2024-09-19T06:13:01.652062+0000","last_active":"2024-09-19T06:14:48.197141+0000","last_peered":"2024-09-19T06:14:48.197141+0000","last_clean":"2024-09-19T06:14:48.197141+0000","last_became_active":"2024-09-19T06:13:01.651718+0000","last_became_peered":"2024-09-19T06:13:01.651718+0000","last_unstale":"2024-09-19T06:14:48.197141+0000","last_undegraded":"2024-09-19T06:14:48.197141+0000","last_fullsized":"2024-09-19T06:14:48.197141+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:22.428954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.563397+0000","last_change":"2024-09-19T06:13:03.792868+0000","last_active":"2024-09-19T06:14:48.563397+0000","last_peered":"2024-09-19T06:14:48.563397+0000","last_clean":"2024-09-19T06:14:48.563397+0000","last_became_active":"2024-09-19T06:13:03.792482+0000","last_became_peered":"2024-09-19T06:13:03.792482+0000","last_unstale":"2024-09-19T06:14:48.563397+0000","last_undegraded":"2024-09-19T06:14:48.563397+0000","last_fullsized":"2024-09-19T06:14:48.563397+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:05:11.294500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.107926+0000","last_change":"2024-09-19T06:13:01.654572+0000","last_active":"2024-09-19T06:14:48.107926+0000","last_peered":"2024-09-19T06:14:48.107926+0000","last_clean":"2024-09-19T06:14:48.107926+0000","last_became_active":"2024-09-19T06:13:01.653865+0000","last_became_peered":"2024-09-19T06:13:01.653865+0000","last_unstale":"2024-09-19T06:14:48.107926+0000","last_undegraded":"2024-09-19T06:14:48.107926+0000","last_fullsized":"2024-09-19T06:14:48.107926+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:45.842230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.197289+0000","last_change":"2024-09-19T06:13:03.791077+0000","last_active":"2024-09-19T06:14:48.197289+0000","last_peered":"2024-09-19T06:14:48.197289+0000","last_clean":"2024-09-19T06:14:48.197289+0000","last_became_active":"2024-09-19T06:13:03.790710+0000","last_became_peered":"2024-09-19T06:13:03.790710+0000","last_unstale":"2024-09-19T06:14:48.197289+0000","last_undegraded":"2024-09-19T06:14:48.197289+0000","last_fullsized":"2024-09-19T06:14:48.197289+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:15:53.498311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.197119+0000","last_change":"2024-09-19T06:13:13.992222+0000","last_active":"2024-09-19T06:14:48.197119+0000","last_peered":"2024-09-19T06:14:48.197119+0000","last_clean":"2024-09-19T06:14:48.197119+0000","last_became_active":"2024-09-19T06:13:13.988046+0000","last_became_peered":"2024-09-19T06:13:13.988046+0000","last_unstale":"2024-09-19T06:14:48.197119+0000","last_undegraded":"2024-09-19T06:14:48.197119+0000","last_fullsized":"2024-09-19T06:14:48.197119+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:21:56.013401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393454+0000","last_change":"2024-09-19T06:13:03.808060+0000","last_active":"2024-09-19T06:14:48.393454+0000","last_peered":"2024-09-19T06:14:48.393454+0000","last_clean":"2024-09-19T06:14:48.393454+0000","last_became_active":"2024-09-19T06:13:03.807455+0000","last_became_peered":"2024-09-19T06:13:03.807455+0000","last_unstale":"2024-09-19T06:14:48.393454+0000","last_undegraded":"2024-09-19T06:14:48.393454+0000","last_fullsized":"2024-09-19T06:14:48.393454+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:27:19.172298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.194343+0000","last_change":"2024-09-19T06:13:13.987967+0000","last_active":"2024-09-19T06:14:48.194343+0000","last_peered":"2024-09-19T06:14:48.194343+0000","last_clean":"2024-09-19T06:14:48.194343+0000","last_became_active":"2024-09-19T06:13:13.987431+0000","last_became_peered":"2024-09-19T06:13:13.987431+0000","last_unstale":"2024-09-19T06:14:48.194343+0000","last_undegraded":"2024-09-19T06:14:48.194343+0000","last_fullsized":"2024-09-19T06:14:48.194343+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:05.785455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,1],"acting":[9,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.197310+0000","last_change":"2024-09-19T06:13:01.658264+0000","last_active":"2024-09-19T06:14:48.197310+0000","last_peered":"2024-09-19T06:14:48.197310+0000","last_clean":"2024-09-19T06:14:48.197310+0000","last_became_active":"2024-09-19T06:13:01.657912+0000","last_became_peered":"2024-09-19T06:13:01.657912+0000","last_unstale":"2024-09-19T06:14:48.197310+0000","last_undegraded":"2024-09-19T06:14:48.197310+0000","last_fullsized":"2024-09-19T06:14:48.197310+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:19.618987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.105365+0000","last_change":"2024-09-19T06:13:03.791917+0000","last_active":"2024-09-19T06:14:48.105365+0000","last_peered":"2024-09-19T06:14:48.105365+0000","last_clean":"2024-09-19T06:14:48.105365+0000","last_became_active":"2024-09-19T06:13:03.791284+0000","last_became_peered":"2024-09-19T06:13:03.791284+0000","last_unstale":"2024-09-19T06:14:48.105365+0000","last_undegraded":"2024-09-19T06:14:48.105365+0000","last_fullsized":"2024-09-19T06:14:48.105365+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:29.685827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.563410+0000","last_change":"2024-09-19T06:13:13.850753+0000","last_active":"2024-09-19T06:14:48.563410+0000","last_peered":"2024-09-19T06:14:48.563410+0000","last_clean":"2024-09-19T06:14:48.563410+0000","last_became_active":"2024-09-19T06:13:13.843601+0000","last_became_peered":"2024-09-19T06:13:13.843601+0000","last_unstale":"2024-09-19T06:14:48.563410+0000","last_undegraded":"2024-09-19T06:14:48.563410+0000","last_fullsized":"2024-09-19T06:14:48.563410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:11.452118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:14:42.020504+0000","last_change":"2024-09-19T06:13:03.798722+0000","last_active":"2024-09-19T06:14:42.020504+0000","last_peered":"2024-09-19T06:14:42.020504+0000","last_clean":"2024-09-19T06:14:42.020504+0000","last_became_active":"2024-09-19T06:13:03.798428+0000","last_became_peered":"2024-09-19T06:13:03.798428+0000","last_unstale":"2024-09-19T06:14:42.020504+0000","last_undegraded":"2024-09-19T06:14:42.020504+0000","last_fullsized":"2024-09-19T06:14:42.020504+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:11:15.179515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.197751+0000","last_change":"2024-09-19T06:13:01.651003+0000","last_active":"2024-09-19T06:14:48.197751+0000","last_peered":"2024-09-19T06:14:48.197751+0000","last_clean":"2024-09-19T06:14:48.197751+0000","last_became_active":"2024-09-19T06:13:01.650697+0000","last_became_peered":"2024-09-19T06:13:01.650697+0000","last_unstale":"2024-09-19T06:14:48.197751+0000","last_undegraded":"2024-09-19T06:14:48.197751+0000","last_fullsized":"2024-09-19T06:14:48.197751+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:47.982845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.197500+0000","last_change":"2024-09-19T06:13:03.796907+0000","last_active":"2024-09-19T06:14:48.197500+0000","last_peered":"2024-09-19T06:14:48.197500+0000","last_clean":"2024-09-19T06:14:48.197500+0000","last_became_active":"2024-09-19T06:13:03.796426+0000","last_became_peered":"2024-09-19T06:13:03.796426+0000","last_unstale":"2024-09-19T06:14:48.197500+0000","last_undegraded":"2024-09-19T06:14:48.197500+0000","last_fullsized":"2024-09-19T06:14:48.197500+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:26.455773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.194670+0000","last_change":"2024-09-19T06:13:01.654788+0000","last_active":"2024-09-19T06:14:48.194670+0000","last_peered":"2024-09-19T06:14:48.194670+0000","last_clean":"2024-09-19T06:14:48.194670+0000","last_became_active":"2024-09-19T06:13:01.654461+0000","last_became_peered":"2024-09-19T06:13:01.654461+0000","last_unstale":"2024-09-19T06:14:48.194670+0000","last_undegraded":"2024-09-19T06:14:48.194670+0000","last_fullsized":"2024-09-19T06:14:48.194670+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:41.374288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":595257,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":678,"num_read_kb":447,"num_write":288,"num_write_kb":1432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":644,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2015232,"data_stored":1785771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612641,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":897024,"data_stored":439052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841574,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28712,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716440,"statfs":{"total":95995035648,"available":95965634560,"internally_reserved":0,"allocated":1728512,"data_stored":1227661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005100,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28300,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716852,"statfs":{"total":95995035648,"available":95966056448,"internally_reserved":0,"allocated":1302528,"data_stored":832482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234033,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36616,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708536,"statfs":{"total":95995035648,"available":95957540864,"internally_reserved":0,"allocated":1298432,"data_stored":832380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462965,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28496,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716656,"statfs":{"total":95995035648,"available":95965855744,"internally_reserved":0,"allocated":1503232,"data_stored":1032501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593787,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40384,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704768,"statfs":{"total":95995035648,"available":95953682432,"internally_reserved":0,"allocated":897024,"data_stored":438655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822719,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28636,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716516,"statfs":{"total":95995035648,"available":95965712384,"internally_reserved":0,"allocated":1650688,"data_stored":1163290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986245,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":909312,"data_stored":441490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215178,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36752,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708400,"statfs":{"total":95995035648,"available":95957401600,"internally_reserved":0,"allocated":1441792,"data_stored":963782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444111,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":494510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":962560,"data_stored":503503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":430991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":65055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":65783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":525100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":134357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":393932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":241664,"data_stored":198728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:14:53.193 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T06:14:53.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.331+0000 7feddbf91640 1 -- 172.21.15.2:0/2408936307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedd41069d0 msgr2=0x7fedd4106db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:53.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.331+0000 7feddbf91640 1 --2- 172.21.15.2:0/2408936307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedd41069d0 0x7fedd4106db0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fedd0009930 tx=0x7fedd002a420 comp rx=0 tx=0).stop 2024-09-19T06:14:53.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.331+0000 7feddbf91640 1 -- 172.21.15.2:0/2408936307 shutdown_connections 2024-09-19T06:14:53.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.331+0000 7feddbf91640 1 --2- 172.21.15.2:0/2408936307 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fedd4101360 0x7fedd410d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.331+0000 7feddbf91640 1 --2- 172.21.15.2:0/2408936307 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fedd41009c0 0x7fedd4100e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.331+0000 7feddbf91640 1 --2- 172.21.15.2:0/2408936307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedd41069d0 0x7fedd4106db0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.331+0000 7feddbf91640 1 -- 172.21.15.2:0/2408936307 >> 172.21.15.2:0/2408936307 conn(0x7fedd4077a10 msgr2=0x7fedd40fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:53.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.332+0000 7feddbf91640 1 -- 172.21.15.2:0/2408936307 shutdown_connections 2024-09-19T06:14:53.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.332+0000 7feddbf91640 1 -- 172.21.15.2:0/2408936307 wait complete. 2024-09-19T06:14:53.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.332+0000 7feddbf91640 1 Processor -- start 2024-09-19T06:14:53.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.332+0000 7feddbf91640 1 -- start start 2024-09-19T06:14:53.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.332+0000 7feddbf91640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fedd41009c0 0x7fedd41982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:53.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.332+0000 7feddbf91640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedd4101360 0x7fedd4198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:53.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.332+0000 7feddbf91640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fedd41069d0 0x7fedd419cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:53.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.332+0000 7feddbf91640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fedd4110d10 con 0x7fedd4101360 2024-09-19T06:14:53.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.332+0000 7feddbf91640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fedd4110b90 con 0x7fedd41069d0 2024-09-19T06:14:53.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.332+0000 7feddbf91640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fedd4110e90 con 0x7fedd41009c0 2024-09-19T06:14:53.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.333+0000 7fedd952c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedd4101360 0x7fedd4198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:53.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.333+0000 7fedd952c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedd4101360 0x7fedd4198810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49828/0 (socket says 172.21.15.2:49828) 2024-09-19T06:14:53.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.333+0000 7fedd952c640 1 -- 172.21.15.2:0/1808171053 learned_addr learned my addr 172.21.15.2:0/1808171053 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:53.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.333+0000 7fedda52e640 1 --2- 172.21.15.2:0/1808171053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fedd41069d0 0x7fedd419cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:53.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.333+0000 7fedd9d2d640 1 --2- 172.21.15.2:0/1808171053 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fedd41009c0 0x7fedd41982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:53.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.333+0000 7fedd952c640 1 -- 172.21.15.2:0/1808171053 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fedd41009c0 msgr2=0x7fedd41982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:53.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.333+0000 7fedd952c640 1 --2- 172.21.15.2:0/1808171053 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fedd41009c0 0x7fedd41982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.333+0000 7fedd952c640 1 -- 172.21.15.2:0/1808171053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fedd41069d0 msgr2=0x7fedd419cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:53.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.333+0000 7fedd952c640 1 --2- 172.21.15.2:0/1808171053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fedd41069d0 0x7fedd419cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.333+0000 7fedd952c640 1 -- 172.21.15.2:0/1808171053 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedd419d2c0 con 0x7fedd4101360 2024-09-19T06:14:53.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.333+0000 7fedda52e640 1 --2- 172.21.15.2:0/1808171053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fedd41069d0 0x7fedd419cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:14:53.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.333+0000 7fedd9d2d640 1 --2- 172.21.15.2:0/1808171053 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fedd41009c0 0x7fedd41982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:14:53.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.333+0000 7fedd952c640 1 --2- 172.21.15.2:0/1808171053 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedd4101360 0x7fedd4198810 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fedc400d950 tx=0x7fedc400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:53.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.333+0000 7fedcaffd640 1 -- 172.21.15.2:0/1808171053 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc4017070 con 0x7fedd4101360 2024-09-19T06:14:53.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.333+0000 7fedcaffd640 1 -- 172.21.15.2:0/1808171053 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fedc4009c30 con 0x7fedd4101360 2024-09-19T06:14:53.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.333+0000 7feddbf91640 1 -- 172.21.15.2:0/1808171053 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedd419d5b0 con 0x7fedd4101360 2024-09-19T06:14:53.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.333+0000 7fedcaffd640 1 -- 172.21.15.2:0/1808171053 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc400f620 con 0x7fedd4101360 2024-09-19T06:14:53.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.333+0000 7feddbf91640 1 -- 172.21.15.2:0/1808171053 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedd41a4e40 con 0x7fedd4101360 2024-09-19T06:14:53.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.334+0000 7feddbf91640 1 -- 172.21.15.2:0/1808171053 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedd4100e20 con 0x7fedd4101360 2024-09-19T06:14:53.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.336+0000 7fedcaffd640 1 -- 172.21.15.2:0/1808171053 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138581+0+0 (secure 0 0 0) 0x7fedc40109a0 con 0x7fedd4101360 2024-09-19T06:14:53.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.336+0000 7fedcaffd640 1 --2- 172.21.15.2:0/1808171053 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fedc00a3560 0x7fedc00a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:53.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.336+0000 7fedcaffd640 1 -- 172.21.15.2:0/1808171053 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fedc40cfbc0 con 0x7fedd4101360 2024-09-19T06:14:53.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.336+0000 7fedd9d2d640 1 --2- 172.21.15.2:0/1808171053 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fedc00a3560 0x7fedc00a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:53.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.337+0000 7fedd9d2d640 1 --2- 172.21.15.2:0/1808171053 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fedc00a3560 0x7fedc00a5a20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fedd002a940 tx=0x7fedd0005fd0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:53.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.339+0000 7fedcaffd640 1 -- 172.21.15.2:0/1808171053 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fedc4009de0 con 0x7fedd4101360 2024-09-19T06:14:53.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:53 smithi002 ceph-mon[30982]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:14:53.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:53 smithi002 ceph-mon[30982]: mgrmap e23: x(active, since 4s), standbys: z, y 2024-09-19T06:14:53.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:53 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:53.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:53 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:53.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:53 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:53.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:53 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:53.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:53 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:53.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:53 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:53.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:53 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:53.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:53 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:14:53.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:53 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:14:53.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:53 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:14:53.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:53 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:53.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:53 smithi090 ceph-mon[34497]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:14:53.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:53 smithi090 ceph-mon[34497]: mgrmap e23: x(active, since 4s), standbys: z, y 2024-09-19T06:14:53.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:53 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:53.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:53 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:53.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:53 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:53.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:53 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:53.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:53 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:53.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:53 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:53.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:53 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:53.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:53 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:14:53.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:53 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:14:53.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:53 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:14:53.491 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:53 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:53.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.513+0000 7feddbf91640 1 -- 172.21.15.2:0/1808171053 --> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fedd4069ce0 con 0x7fedc00a3560 2024-09-19T06:14:53.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.520+0000 7fedcaffd640 1 -- 172.21.15.2:0/1808171053 <== mgr.15144 v2:172.21.15.2:6800/1594569191 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257871 (secure 0 0 0) 0x7fedd4069ce0 con 0x7fedc00a3560 2024-09-19T06:14:53.524 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:14:53.525 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-19T06:14:53.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.523+0000 7feddbf91640 1 -- 172.21.15.2:0/1808171053 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fedc00a3560 msgr2=0x7fedc00a5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:53.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.523+0000 7feddbf91640 1 --2- 172.21.15.2:0/1808171053 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fedc00a3560 0x7fedc00a5a20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fedd002a940 tx=0x7fedd0005fd0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.523+0000 7feddbf91640 1 -- 172.21.15.2:0/1808171053 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedd4101360 msgr2=0x7fedd4198810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:53.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.523+0000 7feddbf91640 1 --2- 172.21.15.2:0/1808171053 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedd4101360 0x7fedd4198810 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fedc400d950 tx=0x7fedc400de10 comp rx=0 tx=0).stop 2024-09-19T06:14:53.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.523+0000 7feddbf91640 1 -- 172.21.15.2:0/1808171053 shutdown_connections 2024-09-19T06:14:53.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.523+0000 7feddbf91640 1 --2- 172.21.15.2:0/1808171053 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fedc00a3560 0x7fedc00a5a20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.523+0000 7feddbf91640 1 --2- 172.21.15.2:0/1808171053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fedd41069d0 0x7fedd419cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.523+0000 7feddbf91640 1 --2- 172.21.15.2:0/1808171053 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedd4101360 0x7fedd4198810 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.523+0000 7feddbf91640 1 --2- 172.21.15.2:0/1808171053 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fedd41009c0 0x7fedd41982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.523+0000 7feddbf91640 1 -- 172.21.15.2:0/1808171053 >> 172.21.15.2:0/1808171053 conn(0x7fedd4077a10 msgr2=0x7fedd40695d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:53.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.523+0000 7feddbf91640 1 -- 172.21.15.2:0/1808171053 shutdown_connections 2024-09-19T06:14:53.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.523+0000 7feddbf91640 1 -- 172.21.15.2:0/1808171053 wait complete. 2024-09-19T06:14:53.535 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-09-19T06:14:52.117530+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1185859,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":814,"num_read_kb":566,"num_write":471,"num_write_kb":4372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1181380,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":863,"ondisk_log_size":863,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":375872,"kb_used_data":14116,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124565952,"statfs":{"total":1151940427776,"available":1151555534848,"internally_reserved":0,"allocated":14454784,"data_stored":8800297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.988811"},"pg_stats":[{"pgid":"3.3f","version":"81'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.563607+0000","last_change":"2024-09-19T06:13:03.799398+0000","last_active":"2024-09-19T06:14:48.563607+0000","last_peered":"2024-09-19T06:14:48.563607+0000","last_clean":"2024-09-19T06:14:48.563607+0000","last_became_active":"2024-09-19T06:13:03.799027+0000","last_became_peered":"2024-09-19T06:13:03.799027+0000","last_unstale":"2024-09-19T06:14:48.563607+0000","last_undegraded":"2024-09-19T06:14:48.563607+0000","last_fullsized":"2024-09-19T06:14:48.563607+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:35:45.934040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:14:41.999561+0000","last_change":"2024-09-19T06:13:03.791878+0000","last_active":"2024-09-19T06:14:41.999561+0000","last_peered":"2024-09-19T06:14:41.999561+0000","last_clean":"2024-09-19T06:14:41.999561+0000","last_became_active":"2024-09-19T06:13:03.791637+0000","last_became_peered":"2024-09-19T06:13:03.791637+0000","last_unstale":"2024-09-19T06:14:41.999561+0000","last_undegraded":"2024-09-19T06:14:41.999561+0000","last_fullsized":"2024-09-19T06:14:41.999561+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:00.078010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:14:42.020536+0000","last_change":"2024-09-19T06:13:03.798969+0000","last_active":"2024-09-19T06:14:42.020536+0000","last_peered":"2024-09-19T06:14:42.020536+0000","last_clean":"2024-09-19T06:14:42.020536+0000","last_became_active":"2024-09-19T06:13:03.798410+0000","last_became_peered":"2024-09-19T06:13:03.798410+0000","last_unstale":"2024-09-19T06:14:42.020536+0000","last_undegraded":"2024-09-19T06:14:42.020536+0000","last_fullsized":"2024-09-19T06:14:42.020536+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:48.381506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393184+0000","last_change":"2024-09-19T06:13:03.806455+0000","last_active":"2024-09-19T06:14:48.393184+0000","last_peered":"2024-09-19T06:14:48.393184+0000","last_clean":"2024-09-19T06:14:48.393184+0000","last_became_active":"2024-09-19T06:13:03.805830+0000","last_became_peered":"2024-09-19T06:13:03.805830+0000","last_unstale":"2024-09-19T06:14:48.393184+0000","last_undegraded":"2024-09-19T06:14:48.393184+0000","last_fullsized":"2024-09-19T06:14:48.393184+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:03.206791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.197090+0000","last_change":"2024-09-19T06:13:03.785009+0000","last_active":"2024-09-19T06:14:48.197090+0000","last_peered":"2024-09-19T06:14:48.197090+0000","last_clean":"2024-09-19T06:14:48.197090+0000","last_became_active":"2024-09-19T06:13:03.784638+0000","last_became_peered":"2024-09-19T06:13:03.784638+0000","last_unstale":"2024-09-19T06:14:48.197090+0000","last_undegraded":"2024-09-19T06:14:48.197090+0000","last_fullsized":"2024-09-19T06:14:48.197090+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:36:43.099492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.208699+0000","last_change":"2024-09-19T06:13:03.789006+0000","last_active":"2024-09-19T06:14:48.208699+0000","last_peered":"2024-09-19T06:14:48.208699+0000","last_clean":"2024-09-19T06:14:48.208699+0000","last_became_active":"2024-09-19T06:13:03.788639+0000","last_became_peered":"2024-09-19T06:13:03.788639+0000","last_unstale":"2024-09-19T06:14:48.208699+0000","last_undegraded":"2024-09-19T06:14:48.208699+0000","last_fullsized":"2024-09-19T06:14:48.208699+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:18.692491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.392819+0000","last_change":"2024-09-19T06:13:03.805264+0000","last_active":"2024-09-19T06:14:48.392819+0000","last_peered":"2024-09-19T06:14:48.392819+0000","last_clean":"2024-09-19T06:14:48.392819+0000","last_became_active":"2024-09-19T06:13:03.804948+0000","last_became_peered":"2024-09-19T06:13:03.804948+0000","last_unstale":"2024-09-19T06:14:48.392819+0000","last_undegraded":"2024-09-19T06:14:48.392819+0000","last_fullsized":"2024-09-19T06:14:48.392819+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:56:26.613785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.193611+0000","last_change":"2024-09-19T06:13:13.841110+0000","last_active":"2024-09-19T06:14:48.193611+0000","last_peered":"2024-09-19T06:14:48.193611+0000","last_clean":"2024-09-19T06:14:48.193611+0000","last_became_active":"2024-09-19T06:13:13.840736+0000","last_became_peered":"2024-09-19T06:13:13.840736+0000","last_unstale":"2024-09-19T06:14:48.193611+0000","last_undegraded":"2024-09-19T06:14:48.193611+0000","last_fullsized":"2024-09-19T06:14:48.193611+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:46.304692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.105840+0000","last_change":"2024-09-19T06:13:03.808432+0000","last_active":"2024-09-19T06:14:48.105840+0000","last_peered":"2024-09-19T06:14:48.105840+0000","last_clean":"2024-09-19T06:14:48.105840+0000","last_became_active":"2024-09-19T06:13:03.808120+0000","last_became_peered":"2024-09-19T06:13:03.808120+0000","last_unstale":"2024-09-19T06:14:48.105840+0000","last_undegraded":"2024-09-19T06:14:48.105840+0000","last_fullsized":"2024-09-19T06:14:48.105840+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:31.270525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.209097+0000","last_change":"2024-09-19T06:13:13.843937+0000","last_active":"2024-09-19T06:14:48.209097+0000","last_peered":"2024-09-19T06:14:48.209097+0000","last_clean":"2024-09-19T06:14:48.209097+0000","last_became_active":"2024-09-19T06:13:13.843541+0000","last_became_peered":"2024-09-19T06:13:13.843541+0000","last_unstale":"2024-09-19T06:14:48.209097+0000","last_undegraded":"2024-09-19T06:14:48.209097+0000","last_fullsized":"2024-09-19T06:14:48.209097+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:23.115055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393654+0000","last_change":"2024-09-19T06:13:03.803361+0000","last_active":"2024-09-19T06:14:48.393654+0000","last_peered":"2024-09-19T06:14:48.393654+0000","last_clean":"2024-09-19T06:14:48.393654+0000","last_became_active":"2024-09-19T06:13:03.802794+0000","last_became_peered":"2024-09-19T06:13:03.802794+0000","last_unstale":"2024-09-19T06:14:48.393654+0000","last_undegraded":"2024-09-19T06:14:48.393654+0000","last_fullsized":"2024-09-19T06:14:48.393654+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:53.126456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393335+0000","last_change":"2024-09-19T06:13:03.806163+0000","last_active":"2024-09-19T06:14:48.393335+0000","last_peered":"2024-09-19T06:14:48.393335+0000","last_clean":"2024-09-19T06:14:48.393335+0000","last_became_active":"2024-09-19T06:13:03.805406+0000","last_became_peered":"2024-09-19T06:13:03.805406+0000","last_unstale":"2024-09-19T06:14:48.393335+0000","last_undegraded":"2024-09-19T06:14:48.393335+0000","last_fullsized":"2024-09-19T06:14:48.393335+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:28:17.793408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.104212+0000","last_change":"2024-09-19T06:13:03.794617+0000","last_active":"2024-09-19T06:14:48.104212+0000","last_peered":"2024-09-19T06:14:48.104212+0000","last_clean":"2024-09-19T06:14:48.104212+0000","last_became_active":"2024-09-19T06:13:03.794264+0000","last_became_peered":"2024-09-19T06:13:03.794264+0000","last_unstale":"2024-09-19T06:14:48.104212+0000","last_undegraded":"2024-09-19T06:14:48.104212+0000","last_fullsized":"2024-09-19T06:14:48.104212+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:32.200624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:14:42.008637+0000","last_change":"2024-09-19T06:13:03.792632+0000","last_active":"2024-09-19T06:14:42.008637+0000","last_peered":"2024-09-19T06:14:42.008637+0000","last_clean":"2024-09-19T06:14:42.008637+0000","last_became_active":"2024-09-19T06:13:03.792409+0000","last_became_peered":"2024-09-19T06:13:03.792409+0000","last_unstale":"2024-09-19T06:14:42.008637+0000","last_undegraded":"2024-09-19T06:14:42.008637+0000","last_fullsized":"2024-09-19T06:14:42.008637+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:01.193404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:14:42.009044+0000","last_change":"2024-09-19T06:13:03.801784+0000","last_active":"2024-09-19T06:14:42.009044+0000","last_peered":"2024-09-19T06:14:42.009044+0000","last_clean":"2024-09-19T06:14:42.009044+0000","last_became_active":"2024-09-19T06:13:03.801350+0000","last_became_peered":"2024-09-19T06:13:03.801350+0000","last_unstale":"2024-09-19T06:14:42.009044+0000","last_undegraded":"2024-09-19T06:14:42.009044+0000","last_fullsized":"2024-09-19T06:14:42.009044+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:50:40.542264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.105234+0000","last_change":"2024-09-19T06:13:03.800069+0000","last_active":"2024-09-19T06:14:48.105234+0000","last_peered":"2024-09-19T06:14:48.105234+0000","last_clean":"2024-09-19T06:14:48.105234+0000","last_became_active":"2024-09-19T06:13:03.799690+0000","last_became_peered":"2024-09-19T06:13:03.799690+0000","last_unstale":"2024-09-19T06:14:48.105234+0000","last_undegraded":"2024-09-19T06:14:48.105234+0000","last_fullsized":"2024-09-19T06:14:48.105234+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:36:01.882849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.563640+0000","last_change":"2024-09-19T06:13:03.800180+0000","last_active":"2024-09-19T06:14:48.563640+0000","last_peered":"2024-09-19T06:14:48.563640+0000","last_clean":"2024-09-19T06:14:48.563640+0000","last_became_active":"2024-09-19T06:13:03.798981+0000","last_became_peered":"2024-09-19T06:13:03.798981+0000","last_unstale":"2024-09-19T06:14:48.563640+0000","last_undegraded":"2024-09-19T06:14:48.563640+0000","last_fullsized":"2024-09-19T06:14:48.563640+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:29.241021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.194480+0000","last_change":"2024-09-19T06:13:03.796889+0000","last_active":"2024-09-19T06:14:48.194480+0000","last_peered":"2024-09-19T06:14:48.194480+0000","last_clean":"2024-09-19T06:14:48.194480+0000","last_became_active":"2024-09-19T06:13:03.796539+0000","last_became_peered":"2024-09-19T06:13:03.796539+0000","last_unstale":"2024-09-19T06:14:48.194480+0000","last_undegraded":"2024-09-19T06:14:48.194480+0000","last_fullsized":"2024-09-19T06:14:48.194480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:10.462303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.108060+0000","last_change":"2024-09-19T06:13:03.798758+0000","last_active":"2024-09-19T06:14:48.108060+0000","last_peered":"2024-09-19T06:14:48.108060+0000","last_clean":"2024-09-19T06:14:48.108060+0000","last_became_active":"2024-09-19T06:13:03.798422+0000","last_became_peered":"2024-09-19T06:13:03.798422+0000","last_unstale":"2024-09-19T06:14:48.108060+0000","last_undegraded":"2024-09-19T06:14:48.108060+0000","last_fullsized":"2024-09-19T06:14:48.108060+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:03.712394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.563433+0000","last_change":"2024-09-19T06:13:03.800825+0000","last_active":"2024-09-19T06:14:48.563433+0000","last_peered":"2024-09-19T06:14:48.563433+0000","last_clean":"2024-09-19T06:14:48.563433+0000","last_became_active":"2024-09-19T06:13:03.800505+0000","last_became_peered":"2024-09-19T06:13:03.800505+0000","last_unstale":"2024-09-19T06:14:48.563433+0000","last_undegraded":"2024-09-19T06:14:48.563433+0000","last_fullsized":"2024-09-19T06:14:48.563433+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:15.640802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.104289+0000","last_change":"2024-09-19T06:13:03.797868+0000","last_active":"2024-09-19T06:14:48.104289+0000","last_peered":"2024-09-19T06:14:48.104289+0000","last_clean":"2024-09-19T06:14:48.104289+0000","last_became_active":"2024-09-19T06:13:03.797576+0000","last_became_peered":"2024-09-19T06:13:03.797576+0000","last_unstale":"2024-09-19T06:14:48.104289+0000","last_undegraded":"2024-09-19T06:14:48.104289+0000","last_fullsized":"2024-09-19T06:14:48.104289+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:29:18.953446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.105365+0000","last_change":"2024-09-19T06:13:03.805201+0000","last_active":"2024-09-19T06:14:48.105365+0000","last_peered":"2024-09-19T06:14:48.105365+0000","last_clean":"2024-09-19T06:14:48.105365+0000","last_became_active":"2024-09-19T06:13:03.803758+0000","last_became_peered":"2024-09-19T06:13:03.803758+0000","last_unstale":"2024-09-19T06:14:48.105365+0000","last_undegraded":"2024-09-19T06:14:48.105365+0000","last_fullsized":"2024-09-19T06:14:48.105365+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:49:26.088519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.196845+0000","last_change":"2024-09-19T06:13:03.796086+0000","last_active":"2024-09-19T06:14:48.196845+0000","last_peered":"2024-09-19T06:14:48.196845+0000","last_clean":"2024-09-19T06:14:48.196845+0000","last_became_active":"2024-09-19T06:13:03.795594+0000","last_became_peered":"2024-09-19T06:13:03.795594+0000","last_unstale":"2024-09-19T06:14:48.196845+0000","last_undegraded":"2024-09-19T06:14:48.196845+0000","last_fullsized":"2024-09-19T06:14:48.196845+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:26.374596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.205796+0000","last_change":"2024-09-19T06:13:03.796727+0000","last_active":"2024-09-19T06:14:48.205796+0000","last_peered":"2024-09-19T06:14:48.205796+0000","last_clean":"2024-09-19T06:14:48.205796+0000","last_became_active":"2024-09-19T06:13:03.796334+0000","last_became_peered":"2024-09-19T06:13:03.796334+0000","last_unstale":"2024-09-19T06:14:48.205796+0000","last_undegraded":"2024-09-19T06:14:48.205796+0000","last_fullsized":"2024-09-19T06:14:48.205796+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:47.660748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.197582+0000","last_change":"2024-09-19T06:13:03.800994+0000","last_active":"2024-09-19T06:14:48.197582+0000","last_peered":"2024-09-19T06:14:48.197582+0000","last_clean":"2024-09-19T06:14:48.197582+0000","last_became_active":"2024-09-19T06:13:03.800690+0000","last_became_peered":"2024-09-19T06:13:03.800690+0000","last_unstale":"2024-09-19T06:14:48.197582+0000","last_undegraded":"2024-09-19T06:14:48.197582+0000","last_fullsized":"2024-09-19T06:14:48.197582+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:37.204106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.108230+0000","last_change":"2024-09-19T06:13:03.797503+0000","last_active":"2024-09-19T06:14:48.108230+0000","last_peered":"2024-09-19T06:14:48.108230+0000","last_clean":"2024-09-19T06:14:48.108230+0000","last_became_active":"2024-09-19T06:13:03.797189+0000","last_became_peered":"2024-09-19T06:13:03.797189+0000","last_unstale":"2024-09-19T06:14:48.108230+0000","last_undegraded":"2024-09-19T06:14:48.108230+0000","last_fullsized":"2024-09-19T06:14:48.108230+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:16:18.036236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.563531+0000","last_change":"2024-09-19T06:13:03.795462+0000","last_active":"2024-09-19T06:14:48.563531+0000","last_peered":"2024-09-19T06:14:48.563531+0000","last_clean":"2024-09-19T06:14:48.563531+0000","last_became_active":"2024-09-19T06:13:03.793882+0000","last_became_peered":"2024-09-19T06:13:03.793882+0000","last_unstale":"2024-09-19T06:14:48.563531+0000","last_undegraded":"2024-09-19T06:14:48.563531+0000","last_fullsized":"2024-09-19T06:14:48.563531+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:04.329608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.104261+0000","last_change":"2024-09-19T06:13:03.800425+0000","last_active":"2024-09-19T06:14:48.104261+0000","last_peered":"2024-09-19T06:14:48.104261+0000","last_clean":"2024-09-19T06:14:48.104261+0000","last_became_active":"2024-09-19T06:13:03.800061+0000","last_became_peered":"2024-09-19T06:13:03.800061+0000","last_unstale":"2024-09-19T06:14:48.104261+0000","last_undegraded":"2024-09-19T06:14:48.104261+0000","last_fullsized":"2024-09-19T06:14:48.104261+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:36.454869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:14:42.006339+0000","last_change":"2024-09-19T06:13:03.801630+0000","last_active":"2024-09-19T06:14:42.006339+0000","last_peered":"2024-09-19T06:14:42.006339+0000","last_clean":"2024-09-19T06:14:42.006339+0000","last_became_active":"2024-09-19T06:13:03.801118+0000","last_became_peered":"2024-09-19T06:13:03.801118+0000","last_unstale":"2024-09-19T06:14:42.006339+0000","last_undegraded":"2024-09-19T06:14:42.006339+0000","last_fullsized":"2024-09-19T06:14:42.006339+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:52.641042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.107755+0000","last_change":"2024-09-19T06:13:03.793435+0000","last_active":"2024-09-19T06:14:48.107755+0000","last_peered":"2024-09-19T06:14:48.107755+0000","last_clean":"2024-09-19T06:14:48.107755+0000","last_became_active":"2024-09-19T06:13:03.793138+0000","last_became_peered":"2024-09-19T06:13:03.793138+0000","last_unstale":"2024-09-19T06:14:48.107755+0000","last_undegraded":"2024-09-19T06:14:48.107755+0000","last_fullsized":"2024-09-19T06:14:48.107755+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:40.967328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.107804+0000","last_change":"2024-09-19T06:13:03.800324+0000","last_active":"2024-09-19T06:14:48.107804+0000","last_peered":"2024-09-19T06:14:48.107804+0000","last_clean":"2024-09-19T06:14:48.107804+0000","last_became_active":"2024-09-19T06:13:03.799996+0000","last_became_peered":"2024-09-19T06:13:03.799996+0000","last_unstale":"2024-09-19T06:14:48.107804+0000","last_undegraded":"2024-09-19T06:14:48.107804+0000","last_fullsized":"2024-09-19T06:14:48.107804+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:04.012607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.563307+0000","last_change":"2024-09-19T06:13:03.794669+0000","last_active":"2024-09-19T06:14:48.563307+0000","last_peered":"2024-09-19T06:14:48.563307+0000","last_clean":"2024-09-19T06:14:48.563307+0000","last_became_active":"2024-09-19T06:13:03.794333+0000","last_became_peered":"2024-09-19T06:13:03.794333+0000","last_unstale":"2024-09-19T06:14:48.563307+0000","last_undegraded":"2024-09-19T06:14:48.563307+0000","last_fullsized":"2024-09-19T06:14:48.563307+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:27.690064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.197025+0000","last_change":"2024-09-19T06:13:03.794058+0000","last_active":"2024-09-19T06:14:48.197025+0000","last_peered":"2024-09-19T06:14:48.197025+0000","last_clean":"2024-09-19T06:14:48.197025+0000","last_became_active":"2024-09-19T06:13:03.793710+0000","last_became_peered":"2024-09-19T06:13:03.793710+0000","last_unstale":"2024-09-19T06:14:48.197025+0000","last_undegraded":"2024-09-19T06:14:48.197025+0000","last_fullsized":"2024-09-19T06:14:48.197025+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:56:05.395718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'8","reported_seq":140,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:49.008804+0000","last_change":"2024-09-19T06:13:13.848686+0000","last_active":"2024-09-19T06:14:49.008804+0000","last_peered":"2024-09-19T06:14:49.008804+0000","last_clean":"2024-09-19T06:14:49.008804+0000","last_became_active":"2024-09-19T06:13:13.843205+0000","last_became_peered":"2024-09-19T06:13:13.843205+0000","last_unstale":"2024-09-19T06:14:49.008804+0000","last_undegraded":"2024-09-19T06:14:49.008804+0000","last_fullsized":"2024-09-19T06:14:49.008804+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:49.016417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1903,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":4,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.205889+0000","last_change":"2024-09-19T06:13:03.801206+0000","last_active":"2024-09-19T06:14:48.205889+0000","last_peered":"2024-09-19T06:14:48.205889+0000","last_clean":"2024-09-19T06:14:48.205889+0000","last_became_active":"2024-09-19T06:13:03.800661+0000","last_became_peered":"2024-09-19T06:13:03.800661+0000","last_unstale":"2024-09-19T06:14:48.205889+0000","last_undegraded":"2024-09-19T06:14:48.205889+0000","last_fullsized":"2024-09-19T06:14:48.205889+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:28:11.187583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.208775+0000","last_change":"2024-09-19T06:13:01.656487+0000","last_active":"2024-09-19T06:14:48.208775+0000","last_peered":"2024-09-19T06:14:48.208775+0000","last_clean":"2024-09-19T06:14:48.208775+0000","last_became_active":"2024-09-19T06:13:01.656099+0000","last_became_peered":"2024-09-19T06:13:01.656099+0000","last_unstale":"2024-09-19T06:14:48.208775+0000","last_undegraded":"2024-09-19T06:14:48.208775+0000","last_fullsized":"2024-09-19T06:14:48.208775+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:01.437614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.103880+0000","last_change":"2024-09-19T06:13:01.656435+0000","last_active":"2024-09-19T06:14:48.103880+0000","last_peered":"2024-09-19T06:14:48.103880+0000","last_clean":"2024-09-19T06:14:48.103880+0000","last_became_active":"2024-09-19T06:13:01.655660+0000","last_became_peered":"2024-09-19T06:13:01.655660+0000","last_unstale":"2024-09-19T06:14:48.103880+0000","last_undegraded":"2024-09-19T06:14:48.103880+0000","last_fullsized":"2024-09-19T06:14:48.103880+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:35:06.211974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.196847+0000","last_change":"2024-09-19T06:13:03.784573+0000","last_active":"2024-09-19T06:14:48.196847+0000","last_peered":"2024-09-19T06:14:48.196847+0000","last_clean":"2024-09-19T06:14:48.196847+0000","last_became_active":"2024-09-19T06:13:03.784152+0000","last_became_peered":"2024-09-19T06:13:03.784152+0000","last_unstale":"2024-09-19T06:14:48.196847+0000","last_undegraded":"2024-09-19T06:14:48.196847+0000","last_fullsized":"2024-09-19T06:14:48.196847+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:28:39.606178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'1","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.206023+0000","last_change":"2024-09-19T06:13:01.656150+0000","last_active":"2024-09-19T06:14:48.206023+0000","last_peered":"2024-09-19T06:14:48.206023+0000","last_clean":"2024-09-19T06:14:48.206023+0000","last_became_active":"2024-09-19T06:13:01.655826+0000","last_became_peered":"2024-09-19T06:13:01.655826+0000","last_unstale":"2024-09-19T06:14:48.206023+0000","last_undegraded":"2024-09-19T06:14:48.206023+0000","last_fullsized":"2024-09-19T06:14:48.206023+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:57.782393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"81'11","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.193738+0000","last_change":"2024-09-19T06:13:03.784567+0000","last_active":"2024-09-19T06:14:48.193738+0000","last_peered":"2024-09-19T06:14:48.193738+0000","last_clean":"2024-09-19T06:14:48.193738+0000","last_became_active":"2024-09-19T06:13:03.784187+0000","last_became_peered":"2024-09-19T06:13:03.784187+0000","last_unstale":"2024-09-19T06:14:48.193738+0000","last_undegraded":"2024-09-19T06:14:48.193738+0000","last_fullsized":"2024-09-19T06:14:48.193738+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:21.037052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"81'4","reported_seq":120,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.209126+0000","last_change":"2024-09-19T06:13:01.659641+0000","last_active":"2024-09-19T06:14:48.209126+0000","last_peered":"2024-09-19T06:14:48.209126+0000","last_clean":"2024-09-19T06:14:48.209126+0000","last_became_active":"2024-09-19T06:13:01.659338+0000","last_became_peered":"2024-09-19T06:13:01.659338+0000","last_unstale":"2024-09-19T06:14:48.209126+0000","last_undegraded":"2024-09-19T06:14:48.209126+0000","last_fullsized":"2024-09-19T06:14:48.209126+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:26.230690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":92,"num_read_kb":92,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.105621+0000","last_change":"2024-09-19T06:13:03.797095+0000","last_active":"2024-09-19T06:14:48.105621+0000","last_peered":"2024-09-19T06:14:48.105621+0000","last_clean":"2024-09-19T06:14:48.105621+0000","last_became_active":"2024-09-19T06:13:03.796588+0000","last_became_peered":"2024-09-19T06:13:03.796588+0000","last_unstale":"2024-09-19T06:14:48.105621+0000","last_undegraded":"2024-09-19T06:14:48.105621+0000","last_fullsized":"2024-09-19T06:14:48.105621+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:33.705210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393064+0000","last_change":"2024-09-19T06:13:01.659995+0000","last_active":"2024-09-19T06:14:48.393064+0000","last_peered":"2024-09-19T06:14:48.393064+0000","last_clean":"2024-09-19T06:14:48.393064+0000","last_became_active":"2024-09-19T06:13:01.659621+0000","last_became_peered":"2024-09-19T06:13:01.659621+0000","last_unstale":"2024-09-19T06:14:48.393064+0000","last_undegraded":"2024-09-19T06:14:48.393064+0000","last_fullsized":"2024-09-19T06:14:48.393064+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:44.893111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:14:42.007304+0000","last_change":"2024-09-19T06:13:03.800859+0000","last_active":"2024-09-19T06:14:42.007304+0000","last_peered":"2024-09-19T06:14:42.007304+0000","last_clean":"2024-09-19T06:14:42.007304+0000","last_became_active":"2024-09-19T06:13:03.800540+0000","last_became_peered":"2024-09-19T06:13:03.800540+0000","last_unstale":"2024-09-19T06:14:42.007304+0000","last_undegraded":"2024-09-19T06:14:42.007304+0000","last_fullsized":"2024-09-19T06:14:42.007304+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:25:11.198557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'4","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.205898+0000","last_change":"2024-09-19T06:13:01.654666+0000","last_active":"2024-09-19T06:14:48.205898+0000","last_peered":"2024-09-19T06:14:48.205898+0000","last_clean":"2024-09-19T06:14:48.205898+0000","last_became_active":"2024-09-19T06:13:01.654241+0000","last_became_peered":"2024-09-19T06:13:01.654241+0000","last_unstale":"2024-09-19T06:14:48.205898+0000","last_undegraded":"2024-09-19T06:14:48.205898+0000","last_fullsized":"2024-09-19T06:14:48.205898+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:45.211100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.105541+0000","last_change":"2024-09-19T06:13:03.799906+0000","last_active":"2024-09-19T06:14:48.105541+0000","last_peered":"2024-09-19T06:14:48.105541+0000","last_clean":"2024-09-19T06:14:48.105541+0000","last_became_active":"2024-09-19T06:13:03.799566+0000","last_became_peered":"2024-09-19T06:13:03.799566+0000","last_unstale":"2024-09-19T06:14:48.105541+0000","last_undegraded":"2024-09-19T06:14:48.105541+0000","last_fullsized":"2024-09-19T06:14:48.105541+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:34.268480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'33","reported_seq":254,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:49.015635+0000","last_change":"2024-09-19T06:13:01.657204+0000","last_active":"2024-09-19T06:14:49.015635+0000","last_peered":"2024-09-19T06:14:49.015635+0000","last_clean":"2024-09-19T06:14:49.015635+0000","last_became_active":"2024-09-19T06:13:01.656886+0000","last_became_peered":"2024-09-19T06:13:01.656886+0000","last_unstale":"2024-09-19T06:14:49.015635+0000","last_undegraded":"2024-09-19T06:14:49.015635+0000","last_fullsized":"2024-09-19T06:14:49.015635+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:32:18.033428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65055,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":197,"num_read_kb":163,"num_write":34,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.197415+0000","last_change":"2024-09-19T06:13:03.798605+0000","last_active":"2024-09-19T06:14:48.197415+0000","last_peered":"2024-09-19T06:14:48.197415+0000","last_clean":"2024-09-19T06:14:48.197415+0000","last_became_active":"2024-09-19T06:13:03.798022+0000","last_became_peered":"2024-09-19T06:13:03.798022+0000","last_unstale":"2024-09-19T06:14:48.197415+0000","last_undegraded":"2024-09-19T06:14:48.197415+0000","last_fullsized":"2024-09-19T06:14:48.197415+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:10.094031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.107786+0000","last_change":"2024-09-19T06:13:01.652192+0000","last_active":"2024-09-19T06:14:48.107786+0000","last_peered":"2024-09-19T06:14:48.107786+0000","last_clean":"2024-09-19T06:14:48.107786+0000","last_became_active":"2024-09-19T06:13:01.651774+0000","last_became_peered":"2024-09-19T06:13:01.651774+0000","last_unstale":"2024-09-19T06:14:48.107786+0000","last_undegraded":"2024-09-19T06:14:48.107786+0000","last_fullsized":"2024-09-19T06:14:48.107786+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:39:47.683863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.103949+0000","last_change":"2024-09-19T06:13:03.798674+0000","last_active":"2024-09-19T06:14:48.103949+0000","last_peered":"2024-09-19T06:14:48.103949+0000","last_clean":"2024-09-19T06:14:48.103949+0000","last_became_active":"2024-09-19T06:13:03.798397+0000","last_became_peered":"2024-09-19T06:13:03.798397+0000","last_unstale":"2024-09-19T06:14:48.103949+0000","last_undegraded":"2024-09-19T06:14:48.103949+0000","last_fullsized":"2024-09-19T06:14:48.103949+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:37.155730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.205857+0000","last_change":"2024-09-19T06:13:01.655777+0000","last_active":"2024-09-19T06:14:48.205857+0000","last_peered":"2024-09-19T06:14:48.205857+0000","last_clean":"2024-09-19T06:14:48.205857+0000","last_became_active":"2024-09-19T06:13:01.655420+0000","last_became_peered":"2024-09-19T06:13:01.655420+0000","last_unstale":"2024-09-19T06:14:48.205857+0000","last_undegraded":"2024-09-19T06:14:48.205857+0000","last_fullsized":"2024-09-19T06:14:48.205857+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:02.593204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393400+0000","last_change":"2024-09-19T06:13:03.803799+0000","last_active":"2024-09-19T06:14:48.393400+0000","last_peered":"2024-09-19T06:14:48.393400+0000","last_clean":"2024-09-19T06:14:48.393400+0000","last_became_active":"2024-09-19T06:13:03.803350+0000","last_became_peered":"2024-09-19T06:13:03.803350+0000","last_unstale":"2024-09-19T06:14:48.393400+0000","last_undegraded":"2024-09-19T06:14:48.393400+0000","last_fullsized":"2024-09-19T06:14:48.393400+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:15.806363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'4","reported_seq":123,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393315+0000","last_change":"2024-09-19T06:13:01.656007+0000","last_active":"2024-09-19T06:14:48.393315+0000","last_peered":"2024-09-19T06:14:48.393315+0000","last_clean":"2024-09-19T06:14:48.393315+0000","last_became_active":"2024-09-19T06:13:01.655642+0000","last_became_peered":"2024-09-19T06:13:01.655642+0000","last_unstale":"2024-09-19T06:14:48.393315+0000","last_undegraded":"2024-09-19T06:14:48.393315+0000","last_fullsized":"2024-09-19T06:14:48.393315+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:54.391122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1083,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.392934+0000","last_change":"2024-09-19T06:13:03.804426+0000","last_active":"2024-09-19T06:14:48.392934+0000","last_peered":"2024-09-19T06:14:48.392934+0000","last_clean":"2024-09-19T06:14:48.392934+0000","last_became_active":"2024-09-19T06:13:03.804146+0000","last_became_peered":"2024-09-19T06:13:03.804146+0000","last_unstale":"2024-09-19T06:14:48.392934+0000","last_undegraded":"2024-09-19T06:14:48.392934+0000","last_fullsized":"2024-09-19T06:14:48.392934+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:56.198679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.196999+0000","last_change":"2024-09-19T06:13:01.650023+0000","last_active":"2024-09-19T06:14:48.196999+0000","last_peered":"2024-09-19T06:14:48.196999+0000","last_clean":"2024-09-19T06:14:48.196999+0000","last_became_active":"2024-09-19T06:13:01.649674+0000","last_became_peered":"2024-09-19T06:13:01.649674+0000","last_unstale":"2024-09-19T06:14:48.196999+0000","last_undegraded":"2024-09-19T06:14:48.196999+0000","last_fullsized":"2024-09-19T06:14:48.196999+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:56:11.164070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.205838+0000","last_change":"2024-09-19T06:13:03.802078+0000","last_active":"2024-09-19T06:14:48.205838+0000","last_peered":"2024-09-19T06:14:48.205838+0000","last_clean":"2024-09-19T06:14:48.205838+0000","last_became_active":"2024-09-19T06:13:03.801552+0000","last_became_peered":"2024-09-19T06:13:03.801552+0000","last_unstale":"2024-09-19T06:14:48.205838+0000","last_undegraded":"2024-09-19T06:14:48.205838+0000","last_fullsized":"2024-09-19T06:14:48.205838+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:57.025457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.563366+0000","last_change":"2024-09-19T06:13:13.843721+0000","last_active":"2024-09-19T06:14:48.563366+0000","last_peered":"2024-09-19T06:14:48.563366+0000","last_clean":"2024-09-19T06:14:48.563366+0000","last_became_active":"2024-09-19T06:13:13.838567+0000","last_became_peered":"2024-09-19T06:13:13.838567+0000","last_unstale":"2024-09-19T06:14:48.563366+0000","last_undegraded":"2024-09-19T06:14:48.563366+0000","last_fullsized":"2024-09-19T06:14:48.563366+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:44.479675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.563428+0000","last_change":"2024-09-19T06:13:03.801534+0000","last_active":"2024-09-19T06:14:48.563428+0000","last_peered":"2024-09-19T06:14:48.563428+0000","last_clean":"2024-09-19T06:14:48.563428+0000","last_became_active":"2024-09-19T06:13:03.801142+0000","last_became_peered":"2024-09-19T06:13:03.801142+0000","last_unstale":"2024-09-19T06:14:48.563428+0000","last_undegraded":"2024-09-19T06:14:48.563428+0000","last_fullsized":"2024-09-19T06:14:48.563428+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:45.029662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.104216+0000","last_change":"2024-09-19T06:13:01.655075+0000","last_active":"2024-09-19T06:14:48.104216+0000","last_peered":"2024-09-19T06:14:48.104216+0000","last_clean":"2024-09-19T06:14:48.104216+0000","last_became_active":"2024-09-19T06:13:01.649236+0000","last_became_peered":"2024-09-19T06:13:01.649236+0000","last_unstale":"2024-09-19T06:14:48.104216+0000","last_undegraded":"2024-09-19T06:14:48.104216+0000","last_fullsized":"2024-09-19T06:14:48.104216+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:06.007418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393140+0000","last_change":"2024-09-19T06:13:03.795674+0000","last_active":"2024-09-19T06:14:48.393140+0000","last_peered":"2024-09-19T06:14:48.393140+0000","last_clean":"2024-09-19T06:14:48.393140+0000","last_became_active":"2024-09-19T06:13:03.794843+0000","last_became_peered":"2024-09-19T06:13:03.794843+0000","last_unstale":"2024-09-19T06:14:48.393140+0000","last_undegraded":"2024-09-19T06:14:48.393140+0000","last_fullsized":"2024-09-19T06:14:48.393140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:41:57.669988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'39","reported_seq":71,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.337655+0000","last_change":"2024-09-19T06:13:01.656696+0000","last_active":"2024-09-19T06:14:48.337655+0000","last_peered":"2024-09-19T06:14:48.337655+0000","last_clean":"2024-09-19T06:14:48.337655+0000","last_became_active":"2024-09-19T06:13:01.655260+0000","last_became_peered":"2024-09-19T06:13:01.655260+0000","last_unstale":"2024-09-19T06:14:48.337655+0000","last_undegraded":"2024-09-19T06:14:48.337655+0000","last_fullsized":"2024-09-19T06:14:48.337655+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:50.281013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393069+0000","last_change":"2024-09-19T06:13:03.804411+0000","last_active":"2024-09-19T06:14:48.393069+0000","last_peered":"2024-09-19T06:14:48.393069+0000","last_clean":"2024-09-19T06:14:48.393069+0000","last_became_active":"2024-09-19T06:13:03.804052+0000","last_became_peered":"2024-09-19T06:13:03.804052+0000","last_unstale":"2024-09-19T06:14:48.393069+0000","last_undegraded":"2024-09-19T06:14:48.393069+0000","last_fullsized":"2024-09-19T06:14:48.393069+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:33.394141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.108014+0000","last_change":"2024-09-19T06:13:01.655164+0000","last_active":"2024-09-19T06:14:48.108014+0000","last_peered":"2024-09-19T06:14:48.108014+0000","last_clean":"2024-09-19T06:14:48.108014+0000","last_became_active":"2024-09-19T06:13:01.654297+0000","last_became_peered":"2024-09-19T06:13:01.654297+0000","last_unstale":"2024-09-19T06:14:48.108014+0000","last_undegraded":"2024-09-19T06:14:48.108014+0000","last_fullsized":"2024-09-19T06:14:48.108014+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:02:02.861982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393736+0000","last_change":"2024-09-19T06:13:03.802799+0000","last_active":"2024-09-19T06:14:48.393736+0000","last_peered":"2024-09-19T06:14:48.393736+0000","last_clean":"2024-09-19T06:14:48.393736+0000","last_became_active":"2024-09-19T06:13:03.802348+0000","last_became_peered":"2024-09-19T06:13:03.802348+0000","last_unstale":"2024-09-19T06:14:48.393736+0000","last_undegraded":"2024-09-19T06:14:48.393736+0000","last_fullsized":"2024-09-19T06:14:48.393736+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:05:52.685874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":348,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393203+0000","last_change":"2024-09-19T06:11:51.805685+0000","last_active":"2024-09-19T06:14:48.393203+0000","last_peered":"2024-09-19T06:14:48.393203+0000","last_clean":"2024-09-19T06:14:48.393203+0000","last_became_active":"2024-09-19T06:11:51.805191+0000","last_became_peered":"2024-09-19T06:11:51.805191+0000","last_unstale":"2024-09-19T06:14:48.393203+0000","last_undegraded":"2024-09-19T06:14:48.393203+0000","last_fullsized":"2024-09-19T06:14:48.393203+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:08:28.556644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:08:28.556644+0000","last_clean_scrub_stamp":"2024-09-19T06:08:28.556644+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:19.169542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393779+0000","last_change":"2024-09-19T06:13:01.656796+0000","last_active":"2024-09-19T06:14:48.393779+0000","last_peered":"2024-09-19T06:14:48.393779+0000","last_clean":"2024-09-19T06:14:48.393779+0000","last_became_active":"2024-09-19T06:13:01.656350+0000","last_became_peered":"2024-09-19T06:13:01.656350+0000","last_unstale":"2024-09-19T06:14:48.393779+0000","last_undegraded":"2024-09-19T06:14:48.393779+0000","last_fullsized":"2024-09-19T06:14:48.393779+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:19:03.820218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.198039+0000","last_change":"2024-09-19T06:13:03.793697+0000","last_active":"2024-09-19T06:14:48.198039+0000","last_peered":"2024-09-19T06:14:48.198039+0000","last_clean":"2024-09-19T06:14:48.198039+0000","last_became_active":"2024-09-19T06:13:03.793378+0000","last_became_peered":"2024-09-19T06:13:03.793378+0000","last_unstale":"2024-09-19T06:14:48.198039+0000","last_undegraded":"2024-09-19T06:14:48.198039+0000","last_fullsized":"2024-09-19T06:14:48.198039+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:29:44.236255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393147+0000","last_change":"2024-09-19T06:13:01.658035+0000","last_active":"2024-09-19T06:14:48.393147+0000","last_peered":"2024-09-19T06:14:48.393147+0000","last_clean":"2024-09-19T06:14:48.393147+0000","last_became_active":"2024-09-19T06:13:01.657602+0000","last_became_peered":"2024-09-19T06:13:01.657602+0000","last_unstale":"2024-09-19T06:14:48.393147+0000","last_undegraded":"2024-09-19T06:14:48.393147+0000","last_fullsized":"2024-09-19T06:14:48.393147+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:27.015086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.103875+0000","last_change":"2024-09-19T06:13:03.793377+0000","last_active":"2024-09-19T06:14:48.103875+0000","last_peered":"2024-09-19T06:14:48.103875+0000","last_clean":"2024-09-19T06:14:48.103875+0000","last_became_active":"2024-09-19T06:13:03.793047+0000","last_became_peered":"2024-09-19T06:13:03.793047+0000","last_unstale":"2024-09-19T06:14:48.103875+0000","last_undegraded":"2024-09-19T06:14:48.103875+0000","last_fullsized":"2024-09-19T06:14:48.103875+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:22.883358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":121,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.104089+0000","last_change":"2024-09-19T06:13:01.650179+0000","last_active":"2024-09-19T06:14:48.104089+0000","last_peered":"2024-09-19T06:14:48.104089+0000","last_clean":"2024-09-19T06:14:48.104089+0000","last_became_active":"2024-09-19T06:13:01.649889+0000","last_became_peered":"2024-09-19T06:13:01.649889+0000","last_unstale":"2024-09-19T06:14:48.104089+0000","last_undegraded":"2024-09-19T06:14:48.104089+0000","last_fullsized":"2024-09-19T06:14:48.104089+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:55:00.400406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":92,"num_read_kb":92,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.205842+0000","last_change":"2024-09-19T06:13:03.800277+0000","last_active":"2024-09-19T06:14:48.205842+0000","last_peered":"2024-09-19T06:14:48.205842+0000","last_clean":"2024-09-19T06:14:48.205842+0000","last_became_active":"2024-09-19T06:13:03.799862+0000","last_became_peered":"2024-09-19T06:13:03.799862+0000","last_unstale":"2024-09-19T06:14:48.205842+0000","last_undegraded":"2024-09-19T06:14:48.205842+0000","last_fullsized":"2024-09-19T06:14:48.205842+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:51.558276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393634+0000","last_change":"2024-09-19T06:13:01.659592+0000","last_active":"2024-09-19T06:14:48.393634+0000","last_peered":"2024-09-19T06:14:48.393634+0000","last_clean":"2024-09-19T06:14:48.393634+0000","last_became_active":"2024-09-19T06:13:01.659258+0000","last_became_peered":"2024-09-19T06:13:01.659258+0000","last_unstale":"2024-09-19T06:14:48.393634+0000","last_undegraded":"2024-09-19T06:14:48.393634+0000","last_fullsized":"2024-09-19T06:14:48.393634+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:46.097656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.208817+0000","last_change":"2024-09-19T06:13:03.793100+0000","last_active":"2024-09-19T06:14:48.208817+0000","last_peered":"2024-09-19T06:14:48.208817+0000","last_clean":"2024-09-19T06:14:48.208817+0000","last_became_active":"2024-09-19T06:13:03.792768+0000","last_became_peered":"2024-09-19T06:13:03.792768+0000","last_unstale":"2024-09-19T06:14:48.208817+0000","last_undegraded":"2024-09-19T06:14:48.208817+0000","last_fullsized":"2024-09-19T06:14:48.208817+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:11:36.122712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.194321+0000","last_change":"2024-09-19T06:13:01.650511+0000","last_active":"2024-09-19T06:14:48.194321+0000","last_peered":"2024-09-19T06:14:48.194321+0000","last_clean":"2024-09-19T06:14:48.194321+0000","last_became_active":"2024-09-19T06:13:01.650099+0000","last_became_peered":"2024-09-19T06:13:01.650099+0000","last_unstale":"2024-09-19T06:14:48.194321+0000","last_undegraded":"2024-09-19T06:14:48.194321+0000","last_fullsized":"2024-09-19T06:14:48.194321+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:16.386025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.208855+0000","last_change":"2024-09-19T06:13:03.783690+0000","last_active":"2024-09-19T06:14:48.208855+0000","last_peered":"2024-09-19T06:14:48.208855+0000","last_clean":"2024-09-19T06:14:48.208855+0000","last_became_active":"2024-09-19T06:13:03.783296+0000","last_became_peered":"2024-09-19T06:13:03.783296+0000","last_unstale":"2024-09-19T06:14:48.208855+0000","last_undegraded":"2024-09-19T06:14:48.208855+0000","last_fullsized":"2024-09-19T06:14:48.208855+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:49:19.605979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"79'1","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.197422+0000","last_change":"2024-09-19T06:13:01.648671+0000","last_active":"2024-09-19T06:14:48.197422+0000","last_peered":"2024-09-19T06:14:48.197422+0000","last_clean":"2024-09-19T06:14:48.197422+0000","last_became_active":"2024-09-19T06:13:01.647329+0000","last_became_peered":"2024-09-19T06:13:01.647329+0000","last_unstale":"2024-09-19T06:14:48.197422+0000","last_undegraded":"2024-09-19T06:14:48.197422+0000","last_fullsized":"2024-09-19T06:14:48.197422+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:31.026561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.104368+0000","last_change":"2024-09-19T06:13:03.795195+0000","last_active":"2024-09-19T06:14:48.104368+0000","last_peered":"2024-09-19T06:14:48.104368+0000","last_clean":"2024-09-19T06:14:48.104368+0000","last_became_active":"2024-09-19T06:13:03.794882+0000","last_became_peered":"2024-09-19T06:13:03.794882+0000","last_unstale":"2024-09-19T06:14:48.104368+0000","last_undegraded":"2024-09-19T06:14:48.104368+0000","last_fullsized":"2024-09-19T06:14:48.104368+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:47.290917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'48","reported_seq":95,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.343397+0000","last_change":"2024-09-19T06:13:01.652133+0000","last_active":"2024-09-19T06:14:48.343397+0000","last_peered":"2024-09-19T06:14:48.343397+0000","last_clean":"2024-09-19T06:14:48.343397+0000","last_became_active":"2024-09-19T06:13:01.651796+0000","last_became_peered":"2024-09-19T06:13:01.651796+0000","last_unstale":"2024-09-19T06:14:48.343397+0000","last_undegraded":"2024-09-19T06:14:48.343397+0000","last_fullsized":"2024-09-19T06:14:48.343397+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:01.576308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":86,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.197692+0000","last_change":"2024-09-19T06:13:03.799332+0000","last_active":"2024-09-19T06:14:48.197692+0000","last_peered":"2024-09-19T06:14:48.197692+0000","last_clean":"2024-09-19T06:14:48.197692+0000","last_became_active":"2024-09-19T06:13:03.798996+0000","last_became_peered":"2024-09-19T06:13:03.798996+0000","last_unstale":"2024-09-19T06:14:48.197692+0000","last_undegraded":"2024-09-19T06:14:48.197692+0000","last_fullsized":"2024-09-19T06:14:48.197692+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:37:32.245396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393965+0000","last_change":"2024-09-19T06:13:01.652392+0000","last_active":"2024-09-19T06:14:48.393965+0000","last_peered":"2024-09-19T06:14:48.393965+0000","last_clean":"2024-09-19T06:14:48.393965+0000","last_became_active":"2024-09-19T06:13:01.651982+0000","last_became_peered":"2024-09-19T06:13:01.651982+0000","last_unstale":"2024-09-19T06:14:48.393965+0000","last_undegraded":"2024-09-19T06:14:48.393965+0000","last_fullsized":"2024-09-19T06:14:48.393965+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:15:39.590215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:14:42.007637+0000","last_change":"2024-09-19T06:13:13.988765+0000","last_active":"2024-09-19T06:14:42.007637+0000","last_peered":"2024-09-19T06:14:42.007637+0000","last_clean":"2024-09-19T06:14:42.007637+0000","last_became_active":"2024-09-19T06:13:13.988328+0000","last_became_peered":"2024-09-19T06:13:13.988328+0000","last_unstale":"2024-09-19T06:14:42.007637+0000","last_undegraded":"2024-09-19T06:14:42.007637+0000","last_fullsized":"2024-09-19T06:14:42.007637+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:10.219202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.105312+0000","last_change":"2024-09-19T06:13:01.658954+0000","last_active":"2024-09-19T06:14:48.105312+0000","last_peered":"2024-09-19T06:14:48.105312+0000","last_clean":"2024-09-19T06:14:48.105312+0000","last_became_active":"2024-09-19T06:13:01.658453+0000","last_became_peered":"2024-09-19T06:13:01.658453+0000","last_unstale":"2024-09-19T06:14:48.105312+0000","last_undegraded":"2024-09-19T06:14:48.105312+0000","last_fullsized":"2024-09-19T06:14:48.105312+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:17.134858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.196997+0000","last_change":"2024-09-19T06:13:03.786812+0000","last_active":"2024-09-19T06:14:48.196997+0000","last_peered":"2024-09-19T06:14:48.196997+0000","last_clean":"2024-09-19T06:14:48.196997+0000","last_became_active":"2024-09-19T06:13:03.786481+0000","last_became_peered":"2024-09-19T06:13:03.786481+0000","last_unstale":"2024-09-19T06:14:48.196997+0000","last_undegraded":"2024-09-19T06:14:48.196997+0000","last_fullsized":"2024-09-19T06:14:48.196997+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:46.614073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.197141+0000","last_change":"2024-09-19T06:13:01.652062+0000","last_active":"2024-09-19T06:14:48.197141+0000","last_peered":"2024-09-19T06:14:48.197141+0000","last_clean":"2024-09-19T06:14:48.197141+0000","last_became_active":"2024-09-19T06:13:01.651718+0000","last_became_peered":"2024-09-19T06:13:01.651718+0000","last_unstale":"2024-09-19T06:14:48.197141+0000","last_undegraded":"2024-09-19T06:14:48.197141+0000","last_fullsized":"2024-09-19T06:14:48.197141+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:22.428954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.563397+0000","last_change":"2024-09-19T06:13:03.792868+0000","last_active":"2024-09-19T06:14:48.563397+0000","last_peered":"2024-09-19T06:14:48.563397+0000","last_clean":"2024-09-19T06:14:48.563397+0000","last_became_active":"2024-09-19T06:13:03.792482+0000","last_became_peered":"2024-09-19T06:13:03.792482+0000","last_unstale":"2024-09-19T06:14:48.563397+0000","last_undegraded":"2024-09-19T06:14:48.563397+0000","last_fullsized":"2024-09-19T06:14:48.563397+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:05:11.294500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.107926+0000","last_change":"2024-09-19T06:13:01.654572+0000","last_active":"2024-09-19T06:14:48.107926+0000","last_peered":"2024-09-19T06:14:48.107926+0000","last_clean":"2024-09-19T06:14:48.107926+0000","last_became_active":"2024-09-19T06:13:01.653865+0000","last_became_peered":"2024-09-19T06:13:01.653865+0000","last_unstale":"2024-09-19T06:14:48.107926+0000","last_undegraded":"2024-09-19T06:14:48.107926+0000","last_fullsized":"2024-09-19T06:14:48.107926+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:45.842230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.197289+0000","last_change":"2024-09-19T06:13:03.791077+0000","last_active":"2024-09-19T06:14:48.197289+0000","last_peered":"2024-09-19T06:14:48.197289+0000","last_clean":"2024-09-19T06:14:48.197289+0000","last_became_active":"2024-09-19T06:13:03.790710+0000","last_became_peered":"2024-09-19T06:13:03.790710+0000","last_unstale":"2024-09-19T06:14:48.197289+0000","last_undegraded":"2024-09-19T06:14:48.197289+0000","last_fullsized":"2024-09-19T06:14:48.197289+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:15:53.498311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.197119+0000","last_change":"2024-09-19T06:13:13.992222+0000","last_active":"2024-09-19T06:14:48.197119+0000","last_peered":"2024-09-19T06:14:48.197119+0000","last_clean":"2024-09-19T06:14:48.197119+0000","last_became_active":"2024-09-19T06:13:13.988046+0000","last_became_peered":"2024-09-19T06:13:13.988046+0000","last_unstale":"2024-09-19T06:14:48.197119+0000","last_undegraded":"2024-09-19T06:14:48.197119+0000","last_fullsized":"2024-09-19T06:14:48.197119+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:21:56.013401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393454+0000","last_change":"2024-09-19T06:13:03.808060+0000","last_active":"2024-09-19T06:14:48.393454+0000","last_peered":"2024-09-19T06:14:48.393454+0000","last_clean":"2024-09-19T06:14:48.393454+0000","last_became_active":"2024-09-19T06:13:03.807455+0000","last_became_peered":"2024-09-19T06:13:03.807455+0000","last_unstale":"2024-09-19T06:14:48.393454+0000","last_undegraded":"2024-09-19T06:14:48.393454+0000","last_fullsized":"2024-09-19T06:14:48.393454+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:27:19.172298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.194343+0000","last_change":"2024-09-19T06:13:13.987967+0000","last_active":"2024-09-19T06:14:48.194343+0000","last_peered":"2024-09-19T06:14:48.194343+0000","last_clean":"2024-09-19T06:14:48.194343+0000","last_became_active":"2024-09-19T06:13:13.987431+0000","last_became_peered":"2024-09-19T06:13:13.987431+0000","last_unstale":"2024-09-19T06:14:48.194343+0000","last_undegraded":"2024-09-19T06:14:48.194343+0000","last_fullsized":"2024-09-19T06:14:48.194343+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:05.785455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,1],"acting":[9,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.197310+0000","last_change":"2024-09-19T06:13:01.658264+0000","last_active":"2024-09-19T06:14:48.197310+0000","last_peered":"2024-09-19T06:14:48.197310+0000","last_clean":"2024-09-19T06:14:48.197310+0000","last_became_active":"2024-09-19T06:13:01.657912+0000","last_became_peered":"2024-09-19T06:13:01.657912+0000","last_unstale":"2024-09-19T06:14:48.197310+0000","last_undegraded":"2024-09-19T06:14:48.197310+0000","last_fullsized":"2024-09-19T06:14:48.197310+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:19.618987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.105365+0000","last_change":"2024-09-19T06:13:03.791917+0000","last_active":"2024-09-19T06:14:48.105365+0000","last_peered":"2024-09-19T06:14:48.105365+0000","last_clean":"2024-09-19T06:14:48.105365+0000","last_became_active":"2024-09-19T06:13:03.791284+0000","last_became_peered":"2024-09-19T06:13:03.791284+0000","last_unstale":"2024-09-19T06:14:48.105365+0000","last_undegraded":"2024-09-19T06:14:48.105365+0000","last_fullsized":"2024-09-19T06:14:48.105365+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:29.685827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.563410+0000","last_change":"2024-09-19T06:13:13.850753+0000","last_active":"2024-09-19T06:14:48.563410+0000","last_peered":"2024-09-19T06:14:48.563410+0000","last_clean":"2024-09-19T06:14:48.563410+0000","last_became_active":"2024-09-19T06:13:13.843601+0000","last_became_peered":"2024-09-19T06:13:13.843601+0000","last_unstale":"2024-09-19T06:14:48.563410+0000","last_undegraded":"2024-09-19T06:14:48.563410+0000","last_fullsized":"2024-09-19T06:14:48.563410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:11.452118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:14:42.020504+0000","last_change":"2024-09-19T06:13:03.798722+0000","last_active":"2024-09-19T06:14:42.020504+0000","last_peered":"2024-09-19T06:14:42.020504+0000","last_clean":"2024-09-19T06:14:42.020504+0000","last_became_active":"2024-09-19T06:13:03.798428+0000","last_became_peered":"2024-09-19T06:13:03.798428+0000","last_unstale":"2024-09-19T06:14:42.020504+0000","last_undegraded":"2024-09-19T06:14:42.020504+0000","last_fullsized":"2024-09-19T06:14:42.020504+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:11:15.179515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.197751+0000","last_change":"2024-09-19T06:13:01.651003+0000","last_active":"2024-09-19T06:14:48.197751+0000","last_peered":"2024-09-19T06:14:48.197751+0000","last_clean":"2024-09-19T06:14:48.197751+0000","last_became_active":"2024-09-19T06:13:01.650697+0000","last_became_peered":"2024-09-19T06:13:01.650697+0000","last_unstale":"2024-09-19T06:14:48.197751+0000","last_undegraded":"2024-09-19T06:14:48.197751+0000","last_fullsized":"2024-09-19T06:14:48.197751+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:47.982845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.197500+0000","last_change":"2024-09-19T06:13:03.796907+0000","last_active":"2024-09-19T06:14:48.197500+0000","last_peered":"2024-09-19T06:14:48.197500+0000","last_clean":"2024-09-19T06:14:48.197500+0000","last_became_active":"2024-09-19T06:13:03.796426+0000","last_became_peered":"2024-09-19T06:13:03.796426+0000","last_unstale":"2024-09-19T06:14:48.197500+0000","last_undegraded":"2024-09-19T06:14:48.197500+0000","last_fullsized":"2024-09-19T06:14:48.197500+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:26.455773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.194670+0000","last_change":"2024-09-19T06:13:01.654788+0000","last_active":"2024-09-19T06:14:48.194670+0000","last_peered":"2024-09-19T06:14:48.194670+0000","last_clean":"2024-09-19T06:14:48.194670+0000","last_became_active":"2024-09-19T06:13:01.654461+0000","last_became_peered":"2024-09-19T06:13:01.654461+0000","last_unstale":"2024-09-19T06:14:48.194670+0000","last_undegraded":"2024-09-19T06:14:48.194670+0000","last_fullsized":"2024-09-19T06:14:48.194670+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:41.374288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":595257,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":678,"num_read_kb":447,"num_write":288,"num_write_kb":1432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":644,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2015232,"data_stored":1785771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612641,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":897024,"data_stored":439052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841574,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28712,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716440,"statfs":{"total":95995035648,"available":95965634560,"internally_reserved":0,"allocated":1728512,"data_stored":1227661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005100,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28300,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716852,"statfs":{"total":95995035648,"available":95966056448,"internally_reserved":0,"allocated":1302528,"data_stored":832482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234033,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36616,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708536,"statfs":{"total":95995035648,"available":95957540864,"internally_reserved":0,"allocated":1298432,"data_stored":832380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462965,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28496,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716656,"statfs":{"total":95995035648,"available":95965855744,"internally_reserved":0,"allocated":1503232,"data_stored":1032501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593787,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40384,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704768,"statfs":{"total":95995035648,"available":95953682432,"internally_reserved":0,"allocated":897024,"data_stored":438655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822719,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28636,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716516,"statfs":{"total":95995035648,"available":95965712384,"internally_reserved":0,"allocated":1650688,"data_stored":1163290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986245,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":909312,"data_stored":441490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215178,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36752,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708400,"statfs":{"total":95995035648,"available":95957401600,"internally_reserved":0,"allocated":1441792,"data_stored":963782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444111,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":494510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":962560,"data_stored":503503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":430991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":65055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":65783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":525100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":134357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":393932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":241664,"data_stored":198728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:14:53.539 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-19T06:14:53.540 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T06:14:53.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:53 smithi089 ceph-mon[34160]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:14:53.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:53 smithi089 ceph-mon[34160]: mgrmap e23: x(active, since 4s), standbys: z, y 2024-09-19T06:14:53.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:53 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:53.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:53 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:53.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:53 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:53.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:53 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:53.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:53 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:53.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:53 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:53.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:53 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:53.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:53 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:14:53.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:53 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:14:53.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:53 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:14:53.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:53 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:53.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.680+0000 7fc22b1df640 1 -- 172.21.15.2:0/44055594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2241069e0 msgr2=0x7fc224106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:53.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.680+0000 7fc22b1df640 1 --2- 172.21.15.2:0/44055594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2241069e0 0x7fc224106dc0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc218009930 tx=0x7fc21802a420 comp rx=0 tx=0).stop 2024-09-19T06:14:53.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.680+0000 7fc22b1df640 1 -- 172.21.15.2:0/44055594 shutdown_connections 2024-09-19T06:14:53.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.680+0000 7fc22b1df640 1 --2- 172.21.15.2:0/44055594 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc224101370 0x7fc22410d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.680+0000 7fc22b1df640 1 --2- 172.21.15.2:0/44055594 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc2241009d0 0x7fc224100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.680+0000 7fc22b1df640 1 --2- 172.21.15.2:0/44055594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2241069e0 0x7fc224106dc0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.680+0000 7fc22b1df640 1 -- 172.21.15.2:0/44055594 >> 172.21.15.2:0/44055594 conn(0x7fc2240fc6b0 msgr2=0x7fc2240fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:53.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.680+0000 7fc22b1df640 1 -- 172.21.15.2:0/44055594 shutdown_connections 2024-09-19T06:14:53.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.680+0000 7fc22b1df640 1 -- 172.21.15.2:0/44055594 wait complete. 2024-09-19T06:14:53.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.681+0000 7fc22b1df640 1 Processor -- start 2024-09-19T06:14:53.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.681+0000 7fc22b1df640 1 -- start start 2024-09-19T06:14:53.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.681+0000 7fc22b1df640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2241009d0 0x7fc224198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:53.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.681+0000 7fc22b1df640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc224101370 0x7fc2241988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:53.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.681+0000 7fc22b1df640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2241069e0 0x7fc22419cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:53.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.681+0000 7fc22b1df640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc224110ce0 con 0x7fc2241069e0 2024-09-19T06:14:53.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.681+0000 7fc22b1df640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc224110b60 con 0x7fc224101370 2024-09-19T06:14:53.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.681+0000 7fc22b1df640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc224110e60 con 0x7fc2241009d0 2024-09-19T06:14:53.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.681+0000 7fc22977c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2241069e0 0x7fc22419cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:53.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.681+0000 7fc22977c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2241069e0 0x7fc22419cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49844/0 (socket says 172.21.15.2:49844) 2024-09-19T06:14:53.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.681+0000 7fc22977c640 1 -- 172.21.15.2:0/1118488864 learned_addr learned my addr 172.21.15.2:0/1118488864 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:53.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.681+0000 7fc223fff640 1 --2- 172.21.15.2:0/1118488864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc224101370 0x7fc2241988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:53.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.682+0000 7fc228f7b640 1 --2- 172.21.15.2:0/1118488864 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2241009d0 0x7fc224198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:53.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.682+0000 7fc22977c640 1 -- 172.21.15.2:0/1118488864 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2241009d0 msgr2=0x7fc224198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:53.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.682+0000 7fc22977c640 1 --2- 172.21.15.2:0/1118488864 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2241009d0 0x7fc224198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.682+0000 7fc22977c640 1 -- 172.21.15.2:0/1118488864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc224101370 msgr2=0x7fc2241988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:53.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.682+0000 7fc22977c640 1 --2- 172.21.15.2:0/1118488864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc224101370 0x7fc2241988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.682+0000 7fc22977c640 1 -- 172.21.15.2:0/1118488864 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc22419d350 con 0x7fc2241069e0 2024-09-19T06:14:53.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.682+0000 7fc228f7b640 1 --2- 172.21.15.2:0/1118488864 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2241009d0 0x7fc224198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:14:53.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.682+0000 7fc22977c640 1 --2- 172.21.15.2:0/1118488864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2241069e0 0x7fc22419cc20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc21c00cad0 tx=0x7fc21c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:53.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.682+0000 7fc221ffb640 1 -- 172.21.15.2:0/1118488864 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc21c00ad60 con 0x7fc2241069e0 2024-09-19T06:14:53.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.682+0000 7fc221ffb640 1 -- 172.21.15.2:0/1118488864 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc21c005020 con 0x7fc2241069e0 2024-09-19T06:14:53.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.682+0000 7fc22b1df640 1 -- 172.21.15.2:0/1118488864 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc22419d640 con 0x7fc2241069e0 2024-09-19T06:14:53.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.682+0000 7fc221ffb640 1 -- 172.21.15.2:0/1118488864 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc21c00f6b0 con 0x7fc2241069e0 2024-09-19T06:14:53.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.682+0000 7fc22b1df640 1 -- 172.21.15.2:0/1118488864 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2241a4ed0 con 0x7fc2241069e0 2024-09-19T06:14:53.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.683+0000 7fc22b1df640 1 -- 172.21.15.2:0/1118488864 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc224100e30 con 0x7fc2241069e0 2024-09-19T06:14:53.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.684+0000 7fc221ffb640 1 -- 172.21.15.2:0/1118488864 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138581+0+0 (secure 0 0 0) 0x7fc21c0051d0 con 0x7fc2241069e0 2024-09-19T06:14:53.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.685+0000 7fc221ffb640 1 --2- 172.21.15.2:0/1118488864 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc2140a34e0 0x7fc2140a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:53.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.685+0000 7fc221ffb640 1 -- 172.21.15.2:0/1118488864 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fc21c0cffe0 con 0x7fc2241069e0 2024-09-19T06:14:53.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.685+0000 7fc228f7b640 1 --2- 172.21.15.2:0/1118488864 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc2140a34e0 0x7fc2140a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:53.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.686+0000 7fc228f7b640 1 --2- 172.21.15.2:0/1118488864 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc2140a34e0 0x7fc2140a59a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc21802a940 tx=0x7fc218005fd0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:53.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.689+0000 7fc221ffb640 1 -- 172.21.15.2:0/1118488864 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc21c014030 con 0x7fc2241069e0 2024-09-19T06:14:53.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.862+0000 7fc22b1df640 1 -- 172.21.15.2:0/1118488864 --> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc2240fcd80 con 0x7fc2140a34e0 2024-09-19T06:14:53.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.868+0000 7fc221ffb640 1 -- 172.21.15.2:0/1118488864 <== mgr.15144 v2:172.21.15.2:6800/1594569191 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257871 (secure 0 0 0) 0x7fc2240fcd80 con 0x7fc2140a34e0 2024-09-19T06:14:53.872 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:14:53.873 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-19T06:14:53.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.871+0000 7fc22b1df640 1 -- 172.21.15.2:0/1118488864 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc2140a34e0 msgr2=0x7fc2140a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:53.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.871+0000 7fc22b1df640 1 --2- 172.21.15.2:0/1118488864 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc2140a34e0 0x7fc2140a59a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc21802a940 tx=0x7fc218005fd0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.871+0000 7fc22b1df640 1 -- 172.21.15.2:0/1118488864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2241069e0 msgr2=0x7fc22419cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:53.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.871+0000 7fc22b1df640 1 --2- 172.21.15.2:0/1118488864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2241069e0 0x7fc22419cc20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc21c00cad0 tx=0x7fc21c00ced0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.871+0000 7fc22b1df640 1 -- 172.21.15.2:0/1118488864 shutdown_connections 2024-09-19T06:14:53.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.871+0000 7fc22b1df640 1 --2- 172.21.15.2:0/1118488864 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc2140a34e0 0x7fc2140a59a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.871+0000 7fc22b1df640 1 --2- 172.21.15.2:0/1118488864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2241069e0 0x7fc22419cc20 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.871+0000 7fc22b1df640 1 --2- 172.21.15.2:0/1118488864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc224101370 0x7fc2241988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.871+0000 7fc22b1df640 1 --2- 172.21.15.2:0/1118488864 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2241009d0 0x7fc224198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.871+0000 7fc22b1df640 1 -- 172.21.15.2:0/1118488864 >> 172.21.15.2:0/1118488864 conn(0x7fc2240fc6b0 msgr2=0x7fc2241047e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:53.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.871+0000 7fc22b1df640 1 -- 172.21.15.2:0/1118488864 shutdown_connections 2024-09-19T06:14:53.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:53.871+0000 7fc22b1df640 1 -- 172.21.15.2:0/1118488864 wait complete. 2024-09-19T06:14:53.884 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-09-19T06:14:52.117530+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1185859,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":814,"num_read_kb":566,"num_write":471,"num_write_kb":4372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1181380,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":863,"ondisk_log_size":863,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":375872,"kb_used_data":14116,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124565952,"statfs":{"total":1151940427776,"available":1151555534848,"internally_reserved":0,"allocated":14454784,"data_stored":8800297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.988811"},"pg_stats":[{"pgid":"3.3f","version":"81'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.563607+0000","last_change":"2024-09-19T06:13:03.799398+0000","last_active":"2024-09-19T06:14:48.563607+0000","last_peered":"2024-09-19T06:14:48.563607+0000","last_clean":"2024-09-19T06:14:48.563607+0000","last_became_active":"2024-09-19T06:13:03.799027+0000","last_became_peered":"2024-09-19T06:13:03.799027+0000","last_unstale":"2024-09-19T06:14:48.563607+0000","last_undegraded":"2024-09-19T06:14:48.563607+0000","last_fullsized":"2024-09-19T06:14:48.563607+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:35:45.934040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:14:41.999561+0000","last_change":"2024-09-19T06:13:03.791878+0000","last_active":"2024-09-19T06:14:41.999561+0000","last_peered":"2024-09-19T06:14:41.999561+0000","last_clean":"2024-09-19T06:14:41.999561+0000","last_became_active":"2024-09-19T06:13:03.791637+0000","last_became_peered":"2024-09-19T06:13:03.791637+0000","last_unstale":"2024-09-19T06:14:41.999561+0000","last_undegraded":"2024-09-19T06:14:41.999561+0000","last_fullsized":"2024-09-19T06:14:41.999561+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:00.078010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:14:42.020536+0000","last_change":"2024-09-19T06:13:03.798969+0000","last_active":"2024-09-19T06:14:42.020536+0000","last_peered":"2024-09-19T06:14:42.020536+0000","last_clean":"2024-09-19T06:14:42.020536+0000","last_became_active":"2024-09-19T06:13:03.798410+0000","last_became_peered":"2024-09-19T06:13:03.798410+0000","last_unstale":"2024-09-19T06:14:42.020536+0000","last_undegraded":"2024-09-19T06:14:42.020536+0000","last_fullsized":"2024-09-19T06:14:42.020536+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:48.381506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393184+0000","last_change":"2024-09-19T06:13:03.806455+0000","last_active":"2024-09-19T06:14:48.393184+0000","last_peered":"2024-09-19T06:14:48.393184+0000","last_clean":"2024-09-19T06:14:48.393184+0000","last_became_active":"2024-09-19T06:13:03.805830+0000","last_became_peered":"2024-09-19T06:13:03.805830+0000","last_unstale":"2024-09-19T06:14:48.393184+0000","last_undegraded":"2024-09-19T06:14:48.393184+0000","last_fullsized":"2024-09-19T06:14:48.393184+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:03.206791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.197090+0000","last_change":"2024-09-19T06:13:03.785009+0000","last_active":"2024-09-19T06:14:48.197090+0000","last_peered":"2024-09-19T06:14:48.197090+0000","last_clean":"2024-09-19T06:14:48.197090+0000","last_became_active":"2024-09-19T06:13:03.784638+0000","last_became_peered":"2024-09-19T06:13:03.784638+0000","last_unstale":"2024-09-19T06:14:48.197090+0000","last_undegraded":"2024-09-19T06:14:48.197090+0000","last_fullsized":"2024-09-19T06:14:48.197090+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:36:43.099492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.208699+0000","last_change":"2024-09-19T06:13:03.789006+0000","last_active":"2024-09-19T06:14:48.208699+0000","last_peered":"2024-09-19T06:14:48.208699+0000","last_clean":"2024-09-19T06:14:48.208699+0000","last_became_active":"2024-09-19T06:13:03.788639+0000","last_became_peered":"2024-09-19T06:13:03.788639+0000","last_unstale":"2024-09-19T06:14:48.208699+0000","last_undegraded":"2024-09-19T06:14:48.208699+0000","last_fullsized":"2024-09-19T06:14:48.208699+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:18.692491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.392819+0000","last_change":"2024-09-19T06:13:03.805264+0000","last_active":"2024-09-19T06:14:48.392819+0000","last_peered":"2024-09-19T06:14:48.392819+0000","last_clean":"2024-09-19T06:14:48.392819+0000","last_became_active":"2024-09-19T06:13:03.804948+0000","last_became_peered":"2024-09-19T06:13:03.804948+0000","last_unstale":"2024-09-19T06:14:48.392819+0000","last_undegraded":"2024-09-19T06:14:48.392819+0000","last_fullsized":"2024-09-19T06:14:48.392819+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:56:26.613785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.193611+0000","last_change":"2024-09-19T06:13:13.841110+0000","last_active":"2024-09-19T06:14:48.193611+0000","last_peered":"2024-09-19T06:14:48.193611+0000","last_clean":"2024-09-19T06:14:48.193611+0000","last_became_active":"2024-09-19T06:13:13.840736+0000","last_became_peered":"2024-09-19T06:13:13.840736+0000","last_unstale":"2024-09-19T06:14:48.193611+0000","last_undegraded":"2024-09-19T06:14:48.193611+0000","last_fullsized":"2024-09-19T06:14:48.193611+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:46.304692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.105840+0000","last_change":"2024-09-19T06:13:03.808432+0000","last_active":"2024-09-19T06:14:48.105840+0000","last_peered":"2024-09-19T06:14:48.105840+0000","last_clean":"2024-09-19T06:14:48.105840+0000","last_became_active":"2024-09-19T06:13:03.808120+0000","last_became_peered":"2024-09-19T06:13:03.808120+0000","last_unstale":"2024-09-19T06:14:48.105840+0000","last_undegraded":"2024-09-19T06:14:48.105840+0000","last_fullsized":"2024-09-19T06:14:48.105840+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:31.270525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.209097+0000","last_change":"2024-09-19T06:13:13.843937+0000","last_active":"2024-09-19T06:14:48.209097+0000","last_peered":"2024-09-19T06:14:48.209097+0000","last_clean":"2024-09-19T06:14:48.209097+0000","last_became_active":"2024-09-19T06:13:13.843541+0000","last_became_peered":"2024-09-19T06:13:13.843541+0000","last_unstale":"2024-09-19T06:14:48.209097+0000","last_undegraded":"2024-09-19T06:14:48.209097+0000","last_fullsized":"2024-09-19T06:14:48.209097+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:23.115055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393654+0000","last_change":"2024-09-19T06:13:03.803361+0000","last_active":"2024-09-19T06:14:48.393654+0000","last_peered":"2024-09-19T06:14:48.393654+0000","last_clean":"2024-09-19T06:14:48.393654+0000","last_became_active":"2024-09-19T06:13:03.802794+0000","last_became_peered":"2024-09-19T06:13:03.802794+0000","last_unstale":"2024-09-19T06:14:48.393654+0000","last_undegraded":"2024-09-19T06:14:48.393654+0000","last_fullsized":"2024-09-19T06:14:48.393654+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:53.126456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393335+0000","last_change":"2024-09-19T06:13:03.806163+0000","last_active":"2024-09-19T06:14:48.393335+0000","last_peered":"2024-09-19T06:14:48.393335+0000","last_clean":"2024-09-19T06:14:48.393335+0000","last_became_active":"2024-09-19T06:13:03.805406+0000","last_became_peered":"2024-09-19T06:13:03.805406+0000","last_unstale":"2024-09-19T06:14:48.393335+0000","last_undegraded":"2024-09-19T06:14:48.393335+0000","last_fullsized":"2024-09-19T06:14:48.393335+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:28:17.793408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.104212+0000","last_change":"2024-09-19T06:13:03.794617+0000","last_active":"2024-09-19T06:14:48.104212+0000","last_peered":"2024-09-19T06:14:48.104212+0000","last_clean":"2024-09-19T06:14:48.104212+0000","last_became_active":"2024-09-19T06:13:03.794264+0000","last_became_peered":"2024-09-19T06:13:03.794264+0000","last_unstale":"2024-09-19T06:14:48.104212+0000","last_undegraded":"2024-09-19T06:14:48.104212+0000","last_fullsized":"2024-09-19T06:14:48.104212+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:32.200624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:14:42.008637+0000","last_change":"2024-09-19T06:13:03.792632+0000","last_active":"2024-09-19T06:14:42.008637+0000","last_peered":"2024-09-19T06:14:42.008637+0000","last_clean":"2024-09-19T06:14:42.008637+0000","last_became_active":"2024-09-19T06:13:03.792409+0000","last_became_peered":"2024-09-19T06:13:03.792409+0000","last_unstale":"2024-09-19T06:14:42.008637+0000","last_undegraded":"2024-09-19T06:14:42.008637+0000","last_fullsized":"2024-09-19T06:14:42.008637+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:01.193404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:14:42.009044+0000","last_change":"2024-09-19T06:13:03.801784+0000","last_active":"2024-09-19T06:14:42.009044+0000","last_peered":"2024-09-19T06:14:42.009044+0000","last_clean":"2024-09-19T06:14:42.009044+0000","last_became_active":"2024-09-19T06:13:03.801350+0000","last_became_peered":"2024-09-19T06:13:03.801350+0000","last_unstale":"2024-09-19T06:14:42.009044+0000","last_undegraded":"2024-09-19T06:14:42.009044+0000","last_fullsized":"2024-09-19T06:14:42.009044+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:50:40.542264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.105234+0000","last_change":"2024-09-19T06:13:03.800069+0000","last_active":"2024-09-19T06:14:48.105234+0000","last_peered":"2024-09-19T06:14:48.105234+0000","last_clean":"2024-09-19T06:14:48.105234+0000","last_became_active":"2024-09-19T06:13:03.799690+0000","last_became_peered":"2024-09-19T06:13:03.799690+0000","last_unstale":"2024-09-19T06:14:48.105234+0000","last_undegraded":"2024-09-19T06:14:48.105234+0000","last_fullsized":"2024-09-19T06:14:48.105234+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:36:01.882849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.563640+0000","last_change":"2024-09-19T06:13:03.800180+0000","last_active":"2024-09-19T06:14:48.563640+0000","last_peered":"2024-09-19T06:14:48.563640+0000","last_clean":"2024-09-19T06:14:48.563640+0000","last_became_active":"2024-09-19T06:13:03.798981+0000","last_became_peered":"2024-09-19T06:13:03.798981+0000","last_unstale":"2024-09-19T06:14:48.563640+0000","last_undegraded":"2024-09-19T06:14:48.563640+0000","last_fullsized":"2024-09-19T06:14:48.563640+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:29.241021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.194480+0000","last_change":"2024-09-19T06:13:03.796889+0000","last_active":"2024-09-19T06:14:48.194480+0000","last_peered":"2024-09-19T06:14:48.194480+0000","last_clean":"2024-09-19T06:14:48.194480+0000","last_became_active":"2024-09-19T06:13:03.796539+0000","last_became_peered":"2024-09-19T06:13:03.796539+0000","last_unstale":"2024-09-19T06:14:48.194480+0000","last_undegraded":"2024-09-19T06:14:48.194480+0000","last_fullsized":"2024-09-19T06:14:48.194480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:10.462303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.108060+0000","last_change":"2024-09-19T06:13:03.798758+0000","last_active":"2024-09-19T06:14:48.108060+0000","last_peered":"2024-09-19T06:14:48.108060+0000","last_clean":"2024-09-19T06:14:48.108060+0000","last_became_active":"2024-09-19T06:13:03.798422+0000","last_became_peered":"2024-09-19T06:13:03.798422+0000","last_unstale":"2024-09-19T06:14:48.108060+0000","last_undegraded":"2024-09-19T06:14:48.108060+0000","last_fullsized":"2024-09-19T06:14:48.108060+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:03.712394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.563433+0000","last_change":"2024-09-19T06:13:03.800825+0000","last_active":"2024-09-19T06:14:48.563433+0000","last_peered":"2024-09-19T06:14:48.563433+0000","last_clean":"2024-09-19T06:14:48.563433+0000","last_became_active":"2024-09-19T06:13:03.800505+0000","last_became_peered":"2024-09-19T06:13:03.800505+0000","last_unstale":"2024-09-19T06:14:48.563433+0000","last_undegraded":"2024-09-19T06:14:48.563433+0000","last_fullsized":"2024-09-19T06:14:48.563433+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:15.640802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.104289+0000","last_change":"2024-09-19T06:13:03.797868+0000","last_active":"2024-09-19T06:14:48.104289+0000","last_peered":"2024-09-19T06:14:48.104289+0000","last_clean":"2024-09-19T06:14:48.104289+0000","last_became_active":"2024-09-19T06:13:03.797576+0000","last_became_peered":"2024-09-19T06:13:03.797576+0000","last_unstale":"2024-09-19T06:14:48.104289+0000","last_undegraded":"2024-09-19T06:14:48.104289+0000","last_fullsized":"2024-09-19T06:14:48.104289+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:29:18.953446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.105365+0000","last_change":"2024-09-19T06:13:03.805201+0000","last_active":"2024-09-19T06:14:48.105365+0000","last_peered":"2024-09-19T06:14:48.105365+0000","last_clean":"2024-09-19T06:14:48.105365+0000","last_became_active":"2024-09-19T06:13:03.803758+0000","last_became_peered":"2024-09-19T06:13:03.803758+0000","last_unstale":"2024-09-19T06:14:48.105365+0000","last_undegraded":"2024-09-19T06:14:48.105365+0000","last_fullsized":"2024-09-19T06:14:48.105365+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:49:26.088519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.196845+0000","last_change":"2024-09-19T06:13:03.796086+0000","last_active":"2024-09-19T06:14:48.196845+0000","last_peered":"2024-09-19T06:14:48.196845+0000","last_clean":"2024-09-19T06:14:48.196845+0000","last_became_active":"2024-09-19T06:13:03.795594+0000","last_became_peered":"2024-09-19T06:13:03.795594+0000","last_unstale":"2024-09-19T06:14:48.196845+0000","last_undegraded":"2024-09-19T06:14:48.196845+0000","last_fullsized":"2024-09-19T06:14:48.196845+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:26.374596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.205796+0000","last_change":"2024-09-19T06:13:03.796727+0000","last_active":"2024-09-19T06:14:48.205796+0000","last_peered":"2024-09-19T06:14:48.205796+0000","last_clean":"2024-09-19T06:14:48.205796+0000","last_became_active":"2024-09-19T06:13:03.796334+0000","last_became_peered":"2024-09-19T06:13:03.796334+0000","last_unstale":"2024-09-19T06:14:48.205796+0000","last_undegraded":"2024-09-19T06:14:48.205796+0000","last_fullsized":"2024-09-19T06:14:48.205796+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:47.660748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.197582+0000","last_change":"2024-09-19T06:13:03.800994+0000","last_active":"2024-09-19T06:14:48.197582+0000","last_peered":"2024-09-19T06:14:48.197582+0000","last_clean":"2024-09-19T06:14:48.197582+0000","last_became_active":"2024-09-19T06:13:03.800690+0000","last_became_peered":"2024-09-19T06:13:03.800690+0000","last_unstale":"2024-09-19T06:14:48.197582+0000","last_undegraded":"2024-09-19T06:14:48.197582+0000","last_fullsized":"2024-09-19T06:14:48.197582+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:37.204106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.108230+0000","last_change":"2024-09-19T06:13:03.797503+0000","last_active":"2024-09-19T06:14:48.108230+0000","last_peered":"2024-09-19T06:14:48.108230+0000","last_clean":"2024-09-19T06:14:48.108230+0000","last_became_active":"2024-09-19T06:13:03.797189+0000","last_became_peered":"2024-09-19T06:13:03.797189+0000","last_unstale":"2024-09-19T06:14:48.108230+0000","last_undegraded":"2024-09-19T06:14:48.108230+0000","last_fullsized":"2024-09-19T06:14:48.108230+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:16:18.036236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.563531+0000","last_change":"2024-09-19T06:13:03.795462+0000","last_active":"2024-09-19T06:14:48.563531+0000","last_peered":"2024-09-19T06:14:48.563531+0000","last_clean":"2024-09-19T06:14:48.563531+0000","last_became_active":"2024-09-19T06:13:03.793882+0000","last_became_peered":"2024-09-19T06:13:03.793882+0000","last_unstale":"2024-09-19T06:14:48.563531+0000","last_undegraded":"2024-09-19T06:14:48.563531+0000","last_fullsized":"2024-09-19T06:14:48.563531+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:04.329608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.104261+0000","last_change":"2024-09-19T06:13:03.800425+0000","last_active":"2024-09-19T06:14:48.104261+0000","last_peered":"2024-09-19T06:14:48.104261+0000","last_clean":"2024-09-19T06:14:48.104261+0000","last_became_active":"2024-09-19T06:13:03.800061+0000","last_became_peered":"2024-09-19T06:13:03.800061+0000","last_unstale":"2024-09-19T06:14:48.104261+0000","last_undegraded":"2024-09-19T06:14:48.104261+0000","last_fullsized":"2024-09-19T06:14:48.104261+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:36.454869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:14:42.006339+0000","last_change":"2024-09-19T06:13:03.801630+0000","last_active":"2024-09-19T06:14:42.006339+0000","last_peered":"2024-09-19T06:14:42.006339+0000","last_clean":"2024-09-19T06:14:42.006339+0000","last_became_active":"2024-09-19T06:13:03.801118+0000","last_became_peered":"2024-09-19T06:13:03.801118+0000","last_unstale":"2024-09-19T06:14:42.006339+0000","last_undegraded":"2024-09-19T06:14:42.006339+0000","last_fullsized":"2024-09-19T06:14:42.006339+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:52.641042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.107755+0000","last_change":"2024-09-19T06:13:03.793435+0000","last_active":"2024-09-19T06:14:48.107755+0000","last_peered":"2024-09-19T06:14:48.107755+0000","last_clean":"2024-09-19T06:14:48.107755+0000","last_became_active":"2024-09-19T06:13:03.793138+0000","last_became_peered":"2024-09-19T06:13:03.793138+0000","last_unstale":"2024-09-19T06:14:48.107755+0000","last_undegraded":"2024-09-19T06:14:48.107755+0000","last_fullsized":"2024-09-19T06:14:48.107755+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:40.967328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.107804+0000","last_change":"2024-09-19T06:13:03.800324+0000","last_active":"2024-09-19T06:14:48.107804+0000","last_peered":"2024-09-19T06:14:48.107804+0000","last_clean":"2024-09-19T06:14:48.107804+0000","last_became_active":"2024-09-19T06:13:03.799996+0000","last_became_peered":"2024-09-19T06:13:03.799996+0000","last_unstale":"2024-09-19T06:14:48.107804+0000","last_undegraded":"2024-09-19T06:14:48.107804+0000","last_fullsized":"2024-09-19T06:14:48.107804+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:04.012607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.563307+0000","last_change":"2024-09-19T06:13:03.794669+0000","last_active":"2024-09-19T06:14:48.563307+0000","last_peered":"2024-09-19T06:14:48.563307+0000","last_clean":"2024-09-19T06:14:48.563307+0000","last_became_active":"2024-09-19T06:13:03.794333+0000","last_became_peered":"2024-09-19T06:13:03.794333+0000","last_unstale":"2024-09-19T06:14:48.563307+0000","last_undegraded":"2024-09-19T06:14:48.563307+0000","last_fullsized":"2024-09-19T06:14:48.563307+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:27.690064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.197025+0000","last_change":"2024-09-19T06:13:03.794058+0000","last_active":"2024-09-19T06:14:48.197025+0000","last_peered":"2024-09-19T06:14:48.197025+0000","last_clean":"2024-09-19T06:14:48.197025+0000","last_became_active":"2024-09-19T06:13:03.793710+0000","last_became_peered":"2024-09-19T06:13:03.793710+0000","last_unstale":"2024-09-19T06:14:48.197025+0000","last_undegraded":"2024-09-19T06:14:48.197025+0000","last_fullsized":"2024-09-19T06:14:48.197025+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:56:05.395718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'8","reported_seq":140,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:49.008804+0000","last_change":"2024-09-19T06:13:13.848686+0000","last_active":"2024-09-19T06:14:49.008804+0000","last_peered":"2024-09-19T06:14:49.008804+0000","last_clean":"2024-09-19T06:14:49.008804+0000","last_became_active":"2024-09-19T06:13:13.843205+0000","last_became_peered":"2024-09-19T06:13:13.843205+0000","last_unstale":"2024-09-19T06:14:49.008804+0000","last_undegraded":"2024-09-19T06:14:49.008804+0000","last_fullsized":"2024-09-19T06:14:49.008804+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:49.016417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1903,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":4,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.205889+0000","last_change":"2024-09-19T06:13:03.801206+0000","last_active":"2024-09-19T06:14:48.205889+0000","last_peered":"2024-09-19T06:14:48.205889+0000","last_clean":"2024-09-19T06:14:48.205889+0000","last_became_active":"2024-09-19T06:13:03.800661+0000","last_became_peered":"2024-09-19T06:13:03.800661+0000","last_unstale":"2024-09-19T06:14:48.205889+0000","last_undegraded":"2024-09-19T06:14:48.205889+0000","last_fullsized":"2024-09-19T06:14:48.205889+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:28:11.187583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.208775+0000","last_change":"2024-09-19T06:13:01.656487+0000","last_active":"2024-09-19T06:14:48.208775+0000","last_peered":"2024-09-19T06:14:48.208775+0000","last_clean":"2024-09-19T06:14:48.208775+0000","last_became_active":"2024-09-19T06:13:01.656099+0000","last_became_peered":"2024-09-19T06:13:01.656099+0000","last_unstale":"2024-09-19T06:14:48.208775+0000","last_undegraded":"2024-09-19T06:14:48.208775+0000","last_fullsized":"2024-09-19T06:14:48.208775+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:01.437614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.103880+0000","last_change":"2024-09-19T06:13:01.656435+0000","last_active":"2024-09-19T06:14:48.103880+0000","last_peered":"2024-09-19T06:14:48.103880+0000","last_clean":"2024-09-19T06:14:48.103880+0000","last_became_active":"2024-09-19T06:13:01.655660+0000","last_became_peered":"2024-09-19T06:13:01.655660+0000","last_unstale":"2024-09-19T06:14:48.103880+0000","last_undegraded":"2024-09-19T06:14:48.103880+0000","last_fullsized":"2024-09-19T06:14:48.103880+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:35:06.211974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.196847+0000","last_change":"2024-09-19T06:13:03.784573+0000","last_active":"2024-09-19T06:14:48.196847+0000","last_peered":"2024-09-19T06:14:48.196847+0000","last_clean":"2024-09-19T06:14:48.196847+0000","last_became_active":"2024-09-19T06:13:03.784152+0000","last_became_peered":"2024-09-19T06:13:03.784152+0000","last_unstale":"2024-09-19T06:14:48.196847+0000","last_undegraded":"2024-09-19T06:14:48.196847+0000","last_fullsized":"2024-09-19T06:14:48.196847+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:28:39.606178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'1","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.206023+0000","last_change":"2024-09-19T06:13:01.656150+0000","last_active":"2024-09-19T06:14:48.206023+0000","last_peered":"2024-09-19T06:14:48.206023+0000","last_clean":"2024-09-19T06:14:48.206023+0000","last_became_active":"2024-09-19T06:13:01.655826+0000","last_became_peered":"2024-09-19T06:13:01.655826+0000","last_unstale":"2024-09-19T06:14:48.206023+0000","last_undegraded":"2024-09-19T06:14:48.206023+0000","last_fullsized":"2024-09-19T06:14:48.206023+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:57.782393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"81'11","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.193738+0000","last_change":"2024-09-19T06:13:03.784567+0000","last_active":"2024-09-19T06:14:48.193738+0000","last_peered":"2024-09-19T06:14:48.193738+0000","last_clean":"2024-09-19T06:14:48.193738+0000","last_became_active":"2024-09-19T06:13:03.784187+0000","last_became_peered":"2024-09-19T06:13:03.784187+0000","last_unstale":"2024-09-19T06:14:48.193738+0000","last_undegraded":"2024-09-19T06:14:48.193738+0000","last_fullsized":"2024-09-19T06:14:48.193738+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:21.037052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"81'4","reported_seq":120,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.209126+0000","last_change":"2024-09-19T06:13:01.659641+0000","last_active":"2024-09-19T06:14:48.209126+0000","last_peered":"2024-09-19T06:14:48.209126+0000","last_clean":"2024-09-19T06:14:48.209126+0000","last_became_active":"2024-09-19T06:13:01.659338+0000","last_became_peered":"2024-09-19T06:13:01.659338+0000","last_unstale":"2024-09-19T06:14:48.209126+0000","last_undegraded":"2024-09-19T06:14:48.209126+0000","last_fullsized":"2024-09-19T06:14:48.209126+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:26.230690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":92,"num_read_kb":92,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.105621+0000","last_change":"2024-09-19T06:13:03.797095+0000","last_active":"2024-09-19T06:14:48.105621+0000","last_peered":"2024-09-19T06:14:48.105621+0000","last_clean":"2024-09-19T06:14:48.105621+0000","last_became_active":"2024-09-19T06:13:03.796588+0000","last_became_peered":"2024-09-19T06:13:03.796588+0000","last_unstale":"2024-09-19T06:14:48.105621+0000","last_undegraded":"2024-09-19T06:14:48.105621+0000","last_fullsized":"2024-09-19T06:14:48.105621+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:33.705210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393064+0000","last_change":"2024-09-19T06:13:01.659995+0000","last_active":"2024-09-19T06:14:48.393064+0000","last_peered":"2024-09-19T06:14:48.393064+0000","last_clean":"2024-09-19T06:14:48.393064+0000","last_became_active":"2024-09-19T06:13:01.659621+0000","last_became_peered":"2024-09-19T06:13:01.659621+0000","last_unstale":"2024-09-19T06:14:48.393064+0000","last_undegraded":"2024-09-19T06:14:48.393064+0000","last_fullsized":"2024-09-19T06:14:48.393064+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:44.893111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:14:42.007304+0000","last_change":"2024-09-19T06:13:03.800859+0000","last_active":"2024-09-19T06:14:42.007304+0000","last_peered":"2024-09-19T06:14:42.007304+0000","last_clean":"2024-09-19T06:14:42.007304+0000","last_became_active":"2024-09-19T06:13:03.800540+0000","last_became_peered":"2024-09-19T06:13:03.800540+0000","last_unstale":"2024-09-19T06:14:42.007304+0000","last_undegraded":"2024-09-19T06:14:42.007304+0000","last_fullsized":"2024-09-19T06:14:42.007304+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:25:11.198557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'4","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.205898+0000","last_change":"2024-09-19T06:13:01.654666+0000","last_active":"2024-09-19T06:14:48.205898+0000","last_peered":"2024-09-19T06:14:48.205898+0000","last_clean":"2024-09-19T06:14:48.205898+0000","last_became_active":"2024-09-19T06:13:01.654241+0000","last_became_peered":"2024-09-19T06:13:01.654241+0000","last_unstale":"2024-09-19T06:14:48.205898+0000","last_undegraded":"2024-09-19T06:14:48.205898+0000","last_fullsized":"2024-09-19T06:14:48.205898+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:45.211100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.105541+0000","last_change":"2024-09-19T06:13:03.799906+0000","last_active":"2024-09-19T06:14:48.105541+0000","last_peered":"2024-09-19T06:14:48.105541+0000","last_clean":"2024-09-19T06:14:48.105541+0000","last_became_active":"2024-09-19T06:13:03.799566+0000","last_became_peered":"2024-09-19T06:13:03.799566+0000","last_unstale":"2024-09-19T06:14:48.105541+0000","last_undegraded":"2024-09-19T06:14:48.105541+0000","last_fullsized":"2024-09-19T06:14:48.105541+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:34.268480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'33","reported_seq":254,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:49.015635+0000","last_change":"2024-09-19T06:13:01.657204+0000","last_active":"2024-09-19T06:14:49.015635+0000","last_peered":"2024-09-19T06:14:49.015635+0000","last_clean":"2024-09-19T06:14:49.015635+0000","last_became_active":"2024-09-19T06:13:01.656886+0000","last_became_peered":"2024-09-19T06:13:01.656886+0000","last_unstale":"2024-09-19T06:14:49.015635+0000","last_undegraded":"2024-09-19T06:14:49.015635+0000","last_fullsized":"2024-09-19T06:14:49.015635+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:32:18.033428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65055,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":197,"num_read_kb":163,"num_write":34,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.197415+0000","last_change":"2024-09-19T06:13:03.798605+0000","last_active":"2024-09-19T06:14:48.197415+0000","last_peered":"2024-09-19T06:14:48.197415+0000","last_clean":"2024-09-19T06:14:48.197415+0000","last_became_active":"2024-09-19T06:13:03.798022+0000","last_became_peered":"2024-09-19T06:13:03.798022+0000","last_unstale":"2024-09-19T06:14:48.197415+0000","last_undegraded":"2024-09-19T06:14:48.197415+0000","last_fullsized":"2024-09-19T06:14:48.197415+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:10.094031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.107786+0000","last_change":"2024-09-19T06:13:01.652192+0000","last_active":"2024-09-19T06:14:48.107786+0000","last_peered":"2024-09-19T06:14:48.107786+0000","last_clean":"2024-09-19T06:14:48.107786+0000","last_became_active":"2024-09-19T06:13:01.651774+0000","last_became_peered":"2024-09-19T06:13:01.651774+0000","last_unstale":"2024-09-19T06:14:48.107786+0000","last_undegraded":"2024-09-19T06:14:48.107786+0000","last_fullsized":"2024-09-19T06:14:48.107786+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:39:47.683863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.103949+0000","last_change":"2024-09-19T06:13:03.798674+0000","last_active":"2024-09-19T06:14:48.103949+0000","last_peered":"2024-09-19T06:14:48.103949+0000","last_clean":"2024-09-19T06:14:48.103949+0000","last_became_active":"2024-09-19T06:13:03.798397+0000","last_became_peered":"2024-09-19T06:13:03.798397+0000","last_unstale":"2024-09-19T06:14:48.103949+0000","last_undegraded":"2024-09-19T06:14:48.103949+0000","last_fullsized":"2024-09-19T06:14:48.103949+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:37.155730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.205857+0000","last_change":"2024-09-19T06:13:01.655777+0000","last_active":"2024-09-19T06:14:48.205857+0000","last_peered":"2024-09-19T06:14:48.205857+0000","last_clean":"2024-09-19T06:14:48.205857+0000","last_became_active":"2024-09-19T06:13:01.655420+0000","last_became_peered":"2024-09-19T06:13:01.655420+0000","last_unstale":"2024-09-19T06:14:48.205857+0000","last_undegraded":"2024-09-19T06:14:48.205857+0000","last_fullsized":"2024-09-19T06:14:48.205857+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:02.593204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393400+0000","last_change":"2024-09-19T06:13:03.803799+0000","last_active":"2024-09-19T06:14:48.393400+0000","last_peered":"2024-09-19T06:14:48.393400+0000","last_clean":"2024-09-19T06:14:48.393400+0000","last_became_active":"2024-09-19T06:13:03.803350+0000","last_became_peered":"2024-09-19T06:13:03.803350+0000","last_unstale":"2024-09-19T06:14:48.393400+0000","last_undegraded":"2024-09-19T06:14:48.393400+0000","last_fullsized":"2024-09-19T06:14:48.393400+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:15.806363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'4","reported_seq":123,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393315+0000","last_change":"2024-09-19T06:13:01.656007+0000","last_active":"2024-09-19T06:14:48.393315+0000","last_peered":"2024-09-19T06:14:48.393315+0000","last_clean":"2024-09-19T06:14:48.393315+0000","last_became_active":"2024-09-19T06:13:01.655642+0000","last_became_peered":"2024-09-19T06:13:01.655642+0000","last_unstale":"2024-09-19T06:14:48.393315+0000","last_undegraded":"2024-09-19T06:14:48.393315+0000","last_fullsized":"2024-09-19T06:14:48.393315+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:54.391122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1083,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.392934+0000","last_change":"2024-09-19T06:13:03.804426+0000","last_active":"2024-09-19T06:14:48.392934+0000","last_peered":"2024-09-19T06:14:48.392934+0000","last_clean":"2024-09-19T06:14:48.392934+0000","last_became_active":"2024-09-19T06:13:03.804146+0000","last_became_peered":"2024-09-19T06:13:03.804146+0000","last_unstale":"2024-09-19T06:14:48.392934+0000","last_undegraded":"2024-09-19T06:14:48.392934+0000","last_fullsized":"2024-09-19T06:14:48.392934+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:56.198679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.196999+0000","last_change":"2024-09-19T06:13:01.650023+0000","last_active":"2024-09-19T06:14:48.196999+0000","last_peered":"2024-09-19T06:14:48.196999+0000","last_clean":"2024-09-19T06:14:48.196999+0000","last_became_active":"2024-09-19T06:13:01.649674+0000","last_became_peered":"2024-09-19T06:13:01.649674+0000","last_unstale":"2024-09-19T06:14:48.196999+0000","last_undegraded":"2024-09-19T06:14:48.196999+0000","last_fullsized":"2024-09-19T06:14:48.196999+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:56:11.164070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.205838+0000","last_change":"2024-09-19T06:13:03.802078+0000","last_active":"2024-09-19T06:14:48.205838+0000","last_peered":"2024-09-19T06:14:48.205838+0000","last_clean":"2024-09-19T06:14:48.205838+0000","last_became_active":"2024-09-19T06:13:03.801552+0000","last_became_peered":"2024-09-19T06:13:03.801552+0000","last_unstale":"2024-09-19T06:14:48.205838+0000","last_undegraded":"2024-09-19T06:14:48.205838+0000","last_fullsized":"2024-09-19T06:14:48.205838+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:57.025457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.563366+0000","last_change":"2024-09-19T06:13:13.843721+0000","last_active":"2024-09-19T06:14:48.563366+0000","last_peered":"2024-09-19T06:14:48.563366+0000","last_clean":"2024-09-19T06:14:48.563366+0000","last_became_active":"2024-09-19T06:13:13.838567+0000","last_became_peered":"2024-09-19T06:13:13.838567+0000","last_unstale":"2024-09-19T06:14:48.563366+0000","last_undegraded":"2024-09-19T06:14:48.563366+0000","last_fullsized":"2024-09-19T06:14:48.563366+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:44.479675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.563428+0000","last_change":"2024-09-19T06:13:03.801534+0000","last_active":"2024-09-19T06:14:48.563428+0000","last_peered":"2024-09-19T06:14:48.563428+0000","last_clean":"2024-09-19T06:14:48.563428+0000","last_became_active":"2024-09-19T06:13:03.801142+0000","last_became_peered":"2024-09-19T06:13:03.801142+0000","last_unstale":"2024-09-19T06:14:48.563428+0000","last_undegraded":"2024-09-19T06:14:48.563428+0000","last_fullsized":"2024-09-19T06:14:48.563428+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:45.029662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.104216+0000","last_change":"2024-09-19T06:13:01.655075+0000","last_active":"2024-09-19T06:14:48.104216+0000","last_peered":"2024-09-19T06:14:48.104216+0000","last_clean":"2024-09-19T06:14:48.104216+0000","last_became_active":"2024-09-19T06:13:01.649236+0000","last_became_peered":"2024-09-19T06:13:01.649236+0000","last_unstale":"2024-09-19T06:14:48.104216+0000","last_undegraded":"2024-09-19T06:14:48.104216+0000","last_fullsized":"2024-09-19T06:14:48.104216+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:06.007418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393140+0000","last_change":"2024-09-19T06:13:03.795674+0000","last_active":"2024-09-19T06:14:48.393140+0000","last_peered":"2024-09-19T06:14:48.393140+0000","last_clean":"2024-09-19T06:14:48.393140+0000","last_became_active":"2024-09-19T06:13:03.794843+0000","last_became_peered":"2024-09-19T06:13:03.794843+0000","last_unstale":"2024-09-19T06:14:48.393140+0000","last_undegraded":"2024-09-19T06:14:48.393140+0000","last_fullsized":"2024-09-19T06:14:48.393140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:41:57.669988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'39","reported_seq":71,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.337655+0000","last_change":"2024-09-19T06:13:01.656696+0000","last_active":"2024-09-19T06:14:48.337655+0000","last_peered":"2024-09-19T06:14:48.337655+0000","last_clean":"2024-09-19T06:14:48.337655+0000","last_became_active":"2024-09-19T06:13:01.655260+0000","last_became_peered":"2024-09-19T06:13:01.655260+0000","last_unstale":"2024-09-19T06:14:48.337655+0000","last_undegraded":"2024-09-19T06:14:48.337655+0000","last_fullsized":"2024-09-19T06:14:48.337655+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:50.281013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393069+0000","last_change":"2024-09-19T06:13:03.804411+0000","last_active":"2024-09-19T06:14:48.393069+0000","last_peered":"2024-09-19T06:14:48.393069+0000","last_clean":"2024-09-19T06:14:48.393069+0000","last_became_active":"2024-09-19T06:13:03.804052+0000","last_became_peered":"2024-09-19T06:13:03.804052+0000","last_unstale":"2024-09-19T06:14:48.393069+0000","last_undegraded":"2024-09-19T06:14:48.393069+0000","last_fullsized":"2024-09-19T06:14:48.393069+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:33.394141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.108014+0000","last_change":"2024-09-19T06:13:01.655164+0000","last_active":"2024-09-19T06:14:48.108014+0000","last_peered":"2024-09-19T06:14:48.108014+0000","last_clean":"2024-09-19T06:14:48.108014+0000","last_became_active":"2024-09-19T06:13:01.654297+0000","last_became_peered":"2024-09-19T06:13:01.654297+0000","last_unstale":"2024-09-19T06:14:48.108014+0000","last_undegraded":"2024-09-19T06:14:48.108014+0000","last_fullsized":"2024-09-19T06:14:48.108014+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:02:02.861982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393736+0000","last_change":"2024-09-19T06:13:03.802799+0000","last_active":"2024-09-19T06:14:48.393736+0000","last_peered":"2024-09-19T06:14:48.393736+0000","last_clean":"2024-09-19T06:14:48.393736+0000","last_became_active":"2024-09-19T06:13:03.802348+0000","last_became_peered":"2024-09-19T06:13:03.802348+0000","last_unstale":"2024-09-19T06:14:48.393736+0000","last_undegraded":"2024-09-19T06:14:48.393736+0000","last_fullsized":"2024-09-19T06:14:48.393736+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:05:52.685874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":348,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393203+0000","last_change":"2024-09-19T06:11:51.805685+0000","last_active":"2024-09-19T06:14:48.393203+0000","last_peered":"2024-09-19T06:14:48.393203+0000","last_clean":"2024-09-19T06:14:48.393203+0000","last_became_active":"2024-09-19T06:11:51.805191+0000","last_became_peered":"2024-09-19T06:11:51.805191+0000","last_unstale":"2024-09-19T06:14:48.393203+0000","last_undegraded":"2024-09-19T06:14:48.393203+0000","last_fullsized":"2024-09-19T06:14:48.393203+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:08:28.556644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:08:28.556644+0000","last_clean_scrub_stamp":"2024-09-19T06:08:28.556644+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:19.169542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393779+0000","last_change":"2024-09-19T06:13:01.656796+0000","last_active":"2024-09-19T06:14:48.393779+0000","last_peered":"2024-09-19T06:14:48.393779+0000","last_clean":"2024-09-19T06:14:48.393779+0000","last_became_active":"2024-09-19T06:13:01.656350+0000","last_became_peered":"2024-09-19T06:13:01.656350+0000","last_unstale":"2024-09-19T06:14:48.393779+0000","last_undegraded":"2024-09-19T06:14:48.393779+0000","last_fullsized":"2024-09-19T06:14:48.393779+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:19:03.820218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.198039+0000","last_change":"2024-09-19T06:13:03.793697+0000","last_active":"2024-09-19T06:14:48.198039+0000","last_peered":"2024-09-19T06:14:48.198039+0000","last_clean":"2024-09-19T06:14:48.198039+0000","last_became_active":"2024-09-19T06:13:03.793378+0000","last_became_peered":"2024-09-19T06:13:03.793378+0000","last_unstale":"2024-09-19T06:14:48.198039+0000","last_undegraded":"2024-09-19T06:14:48.198039+0000","last_fullsized":"2024-09-19T06:14:48.198039+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:29:44.236255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393147+0000","last_change":"2024-09-19T06:13:01.658035+0000","last_active":"2024-09-19T06:14:48.393147+0000","last_peered":"2024-09-19T06:14:48.393147+0000","last_clean":"2024-09-19T06:14:48.393147+0000","last_became_active":"2024-09-19T06:13:01.657602+0000","last_became_peered":"2024-09-19T06:13:01.657602+0000","last_unstale":"2024-09-19T06:14:48.393147+0000","last_undegraded":"2024-09-19T06:14:48.393147+0000","last_fullsized":"2024-09-19T06:14:48.393147+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:27.015086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.103875+0000","last_change":"2024-09-19T06:13:03.793377+0000","last_active":"2024-09-19T06:14:48.103875+0000","last_peered":"2024-09-19T06:14:48.103875+0000","last_clean":"2024-09-19T06:14:48.103875+0000","last_became_active":"2024-09-19T06:13:03.793047+0000","last_became_peered":"2024-09-19T06:13:03.793047+0000","last_unstale":"2024-09-19T06:14:48.103875+0000","last_undegraded":"2024-09-19T06:14:48.103875+0000","last_fullsized":"2024-09-19T06:14:48.103875+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:22.883358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":121,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.104089+0000","last_change":"2024-09-19T06:13:01.650179+0000","last_active":"2024-09-19T06:14:48.104089+0000","last_peered":"2024-09-19T06:14:48.104089+0000","last_clean":"2024-09-19T06:14:48.104089+0000","last_became_active":"2024-09-19T06:13:01.649889+0000","last_became_peered":"2024-09-19T06:13:01.649889+0000","last_unstale":"2024-09-19T06:14:48.104089+0000","last_undegraded":"2024-09-19T06:14:48.104089+0000","last_fullsized":"2024-09-19T06:14:48.104089+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:55:00.400406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":92,"num_read_kb":92,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.205842+0000","last_change":"2024-09-19T06:13:03.800277+0000","last_active":"2024-09-19T06:14:48.205842+0000","last_peered":"2024-09-19T06:14:48.205842+0000","last_clean":"2024-09-19T06:14:48.205842+0000","last_became_active":"2024-09-19T06:13:03.799862+0000","last_became_peered":"2024-09-19T06:13:03.799862+0000","last_unstale":"2024-09-19T06:14:48.205842+0000","last_undegraded":"2024-09-19T06:14:48.205842+0000","last_fullsized":"2024-09-19T06:14:48.205842+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:51.558276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393634+0000","last_change":"2024-09-19T06:13:01.659592+0000","last_active":"2024-09-19T06:14:48.393634+0000","last_peered":"2024-09-19T06:14:48.393634+0000","last_clean":"2024-09-19T06:14:48.393634+0000","last_became_active":"2024-09-19T06:13:01.659258+0000","last_became_peered":"2024-09-19T06:13:01.659258+0000","last_unstale":"2024-09-19T06:14:48.393634+0000","last_undegraded":"2024-09-19T06:14:48.393634+0000","last_fullsized":"2024-09-19T06:14:48.393634+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:46.097656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.208817+0000","last_change":"2024-09-19T06:13:03.793100+0000","last_active":"2024-09-19T06:14:48.208817+0000","last_peered":"2024-09-19T06:14:48.208817+0000","last_clean":"2024-09-19T06:14:48.208817+0000","last_became_active":"2024-09-19T06:13:03.792768+0000","last_became_peered":"2024-09-19T06:13:03.792768+0000","last_unstale":"2024-09-19T06:14:48.208817+0000","last_undegraded":"2024-09-19T06:14:48.208817+0000","last_fullsized":"2024-09-19T06:14:48.208817+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:11:36.122712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.194321+0000","last_change":"2024-09-19T06:13:01.650511+0000","last_active":"2024-09-19T06:14:48.194321+0000","last_peered":"2024-09-19T06:14:48.194321+0000","last_clean":"2024-09-19T06:14:48.194321+0000","last_became_active":"2024-09-19T06:13:01.650099+0000","last_became_peered":"2024-09-19T06:13:01.650099+0000","last_unstale":"2024-09-19T06:14:48.194321+0000","last_undegraded":"2024-09-19T06:14:48.194321+0000","last_fullsized":"2024-09-19T06:14:48.194321+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:16.386025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.208855+0000","last_change":"2024-09-19T06:13:03.783690+0000","last_active":"2024-09-19T06:14:48.208855+0000","last_peered":"2024-09-19T06:14:48.208855+0000","last_clean":"2024-09-19T06:14:48.208855+0000","last_became_active":"2024-09-19T06:13:03.783296+0000","last_became_peered":"2024-09-19T06:13:03.783296+0000","last_unstale":"2024-09-19T06:14:48.208855+0000","last_undegraded":"2024-09-19T06:14:48.208855+0000","last_fullsized":"2024-09-19T06:14:48.208855+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:49:19.605979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"79'1","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.197422+0000","last_change":"2024-09-19T06:13:01.648671+0000","last_active":"2024-09-19T06:14:48.197422+0000","last_peered":"2024-09-19T06:14:48.197422+0000","last_clean":"2024-09-19T06:14:48.197422+0000","last_became_active":"2024-09-19T06:13:01.647329+0000","last_became_peered":"2024-09-19T06:13:01.647329+0000","last_unstale":"2024-09-19T06:14:48.197422+0000","last_undegraded":"2024-09-19T06:14:48.197422+0000","last_fullsized":"2024-09-19T06:14:48.197422+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:31.026561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.104368+0000","last_change":"2024-09-19T06:13:03.795195+0000","last_active":"2024-09-19T06:14:48.104368+0000","last_peered":"2024-09-19T06:14:48.104368+0000","last_clean":"2024-09-19T06:14:48.104368+0000","last_became_active":"2024-09-19T06:13:03.794882+0000","last_became_peered":"2024-09-19T06:13:03.794882+0000","last_unstale":"2024-09-19T06:14:48.104368+0000","last_undegraded":"2024-09-19T06:14:48.104368+0000","last_fullsized":"2024-09-19T06:14:48.104368+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:47.290917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'48","reported_seq":95,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.343397+0000","last_change":"2024-09-19T06:13:01.652133+0000","last_active":"2024-09-19T06:14:48.343397+0000","last_peered":"2024-09-19T06:14:48.343397+0000","last_clean":"2024-09-19T06:14:48.343397+0000","last_became_active":"2024-09-19T06:13:01.651796+0000","last_became_peered":"2024-09-19T06:13:01.651796+0000","last_unstale":"2024-09-19T06:14:48.343397+0000","last_undegraded":"2024-09-19T06:14:48.343397+0000","last_fullsized":"2024-09-19T06:14:48.343397+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:01.576308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":86,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.197692+0000","last_change":"2024-09-19T06:13:03.799332+0000","last_active":"2024-09-19T06:14:48.197692+0000","last_peered":"2024-09-19T06:14:48.197692+0000","last_clean":"2024-09-19T06:14:48.197692+0000","last_became_active":"2024-09-19T06:13:03.798996+0000","last_became_peered":"2024-09-19T06:13:03.798996+0000","last_unstale":"2024-09-19T06:14:48.197692+0000","last_undegraded":"2024-09-19T06:14:48.197692+0000","last_fullsized":"2024-09-19T06:14:48.197692+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:37:32.245396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393965+0000","last_change":"2024-09-19T06:13:01.652392+0000","last_active":"2024-09-19T06:14:48.393965+0000","last_peered":"2024-09-19T06:14:48.393965+0000","last_clean":"2024-09-19T06:14:48.393965+0000","last_became_active":"2024-09-19T06:13:01.651982+0000","last_became_peered":"2024-09-19T06:13:01.651982+0000","last_unstale":"2024-09-19T06:14:48.393965+0000","last_undegraded":"2024-09-19T06:14:48.393965+0000","last_fullsized":"2024-09-19T06:14:48.393965+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:15:39.590215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:14:42.007637+0000","last_change":"2024-09-19T06:13:13.988765+0000","last_active":"2024-09-19T06:14:42.007637+0000","last_peered":"2024-09-19T06:14:42.007637+0000","last_clean":"2024-09-19T06:14:42.007637+0000","last_became_active":"2024-09-19T06:13:13.988328+0000","last_became_peered":"2024-09-19T06:13:13.988328+0000","last_unstale":"2024-09-19T06:14:42.007637+0000","last_undegraded":"2024-09-19T06:14:42.007637+0000","last_fullsized":"2024-09-19T06:14:42.007637+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:10.219202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.105312+0000","last_change":"2024-09-19T06:13:01.658954+0000","last_active":"2024-09-19T06:14:48.105312+0000","last_peered":"2024-09-19T06:14:48.105312+0000","last_clean":"2024-09-19T06:14:48.105312+0000","last_became_active":"2024-09-19T06:13:01.658453+0000","last_became_peered":"2024-09-19T06:13:01.658453+0000","last_unstale":"2024-09-19T06:14:48.105312+0000","last_undegraded":"2024-09-19T06:14:48.105312+0000","last_fullsized":"2024-09-19T06:14:48.105312+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:17.134858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.196997+0000","last_change":"2024-09-19T06:13:03.786812+0000","last_active":"2024-09-19T06:14:48.196997+0000","last_peered":"2024-09-19T06:14:48.196997+0000","last_clean":"2024-09-19T06:14:48.196997+0000","last_became_active":"2024-09-19T06:13:03.786481+0000","last_became_peered":"2024-09-19T06:13:03.786481+0000","last_unstale":"2024-09-19T06:14:48.196997+0000","last_undegraded":"2024-09-19T06:14:48.196997+0000","last_fullsized":"2024-09-19T06:14:48.196997+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:46.614073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.197141+0000","last_change":"2024-09-19T06:13:01.652062+0000","last_active":"2024-09-19T06:14:48.197141+0000","last_peered":"2024-09-19T06:14:48.197141+0000","last_clean":"2024-09-19T06:14:48.197141+0000","last_became_active":"2024-09-19T06:13:01.651718+0000","last_became_peered":"2024-09-19T06:13:01.651718+0000","last_unstale":"2024-09-19T06:14:48.197141+0000","last_undegraded":"2024-09-19T06:14:48.197141+0000","last_fullsized":"2024-09-19T06:14:48.197141+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:22.428954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.563397+0000","last_change":"2024-09-19T06:13:03.792868+0000","last_active":"2024-09-19T06:14:48.563397+0000","last_peered":"2024-09-19T06:14:48.563397+0000","last_clean":"2024-09-19T06:14:48.563397+0000","last_became_active":"2024-09-19T06:13:03.792482+0000","last_became_peered":"2024-09-19T06:13:03.792482+0000","last_unstale":"2024-09-19T06:14:48.563397+0000","last_undegraded":"2024-09-19T06:14:48.563397+0000","last_fullsized":"2024-09-19T06:14:48.563397+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:05:11.294500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.107926+0000","last_change":"2024-09-19T06:13:01.654572+0000","last_active":"2024-09-19T06:14:48.107926+0000","last_peered":"2024-09-19T06:14:48.107926+0000","last_clean":"2024-09-19T06:14:48.107926+0000","last_became_active":"2024-09-19T06:13:01.653865+0000","last_became_peered":"2024-09-19T06:13:01.653865+0000","last_unstale":"2024-09-19T06:14:48.107926+0000","last_undegraded":"2024-09-19T06:14:48.107926+0000","last_fullsized":"2024-09-19T06:14:48.107926+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:45.842230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.197289+0000","last_change":"2024-09-19T06:13:03.791077+0000","last_active":"2024-09-19T06:14:48.197289+0000","last_peered":"2024-09-19T06:14:48.197289+0000","last_clean":"2024-09-19T06:14:48.197289+0000","last_became_active":"2024-09-19T06:13:03.790710+0000","last_became_peered":"2024-09-19T06:13:03.790710+0000","last_unstale":"2024-09-19T06:14:48.197289+0000","last_undegraded":"2024-09-19T06:14:48.197289+0000","last_fullsized":"2024-09-19T06:14:48.197289+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:15:53.498311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.197119+0000","last_change":"2024-09-19T06:13:13.992222+0000","last_active":"2024-09-19T06:14:48.197119+0000","last_peered":"2024-09-19T06:14:48.197119+0000","last_clean":"2024-09-19T06:14:48.197119+0000","last_became_active":"2024-09-19T06:13:13.988046+0000","last_became_peered":"2024-09-19T06:13:13.988046+0000","last_unstale":"2024-09-19T06:14:48.197119+0000","last_undegraded":"2024-09-19T06:14:48.197119+0000","last_fullsized":"2024-09-19T06:14:48.197119+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:21:56.013401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.393454+0000","last_change":"2024-09-19T06:13:03.808060+0000","last_active":"2024-09-19T06:14:48.393454+0000","last_peered":"2024-09-19T06:14:48.393454+0000","last_clean":"2024-09-19T06:14:48.393454+0000","last_became_active":"2024-09-19T06:13:03.807455+0000","last_became_peered":"2024-09-19T06:13:03.807455+0000","last_unstale":"2024-09-19T06:14:48.393454+0000","last_undegraded":"2024-09-19T06:14:48.393454+0000","last_fullsized":"2024-09-19T06:14:48.393454+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:27:19.172298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.194343+0000","last_change":"2024-09-19T06:13:13.987967+0000","last_active":"2024-09-19T06:14:48.194343+0000","last_peered":"2024-09-19T06:14:48.194343+0000","last_clean":"2024-09-19T06:14:48.194343+0000","last_became_active":"2024-09-19T06:13:13.987431+0000","last_became_peered":"2024-09-19T06:13:13.987431+0000","last_unstale":"2024-09-19T06:14:48.194343+0000","last_undegraded":"2024-09-19T06:14:48.194343+0000","last_fullsized":"2024-09-19T06:14:48.194343+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:05.785455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,1],"acting":[9,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.197310+0000","last_change":"2024-09-19T06:13:01.658264+0000","last_active":"2024-09-19T06:14:48.197310+0000","last_peered":"2024-09-19T06:14:48.197310+0000","last_clean":"2024-09-19T06:14:48.197310+0000","last_became_active":"2024-09-19T06:13:01.657912+0000","last_became_peered":"2024-09-19T06:13:01.657912+0000","last_unstale":"2024-09-19T06:14:48.197310+0000","last_undegraded":"2024-09-19T06:14:48.197310+0000","last_fullsized":"2024-09-19T06:14:48.197310+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:19.618987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.105365+0000","last_change":"2024-09-19T06:13:03.791917+0000","last_active":"2024-09-19T06:14:48.105365+0000","last_peered":"2024-09-19T06:14:48.105365+0000","last_clean":"2024-09-19T06:14:48.105365+0000","last_became_active":"2024-09-19T06:13:03.791284+0000","last_became_peered":"2024-09-19T06:13:03.791284+0000","last_unstale":"2024-09-19T06:14:48.105365+0000","last_undegraded":"2024-09-19T06:14:48.105365+0000","last_fullsized":"2024-09-19T06:14:48.105365+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:29.685827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.563410+0000","last_change":"2024-09-19T06:13:13.850753+0000","last_active":"2024-09-19T06:14:48.563410+0000","last_peered":"2024-09-19T06:14:48.563410+0000","last_clean":"2024-09-19T06:14:48.563410+0000","last_became_active":"2024-09-19T06:13:13.843601+0000","last_became_peered":"2024-09-19T06:13:13.843601+0000","last_unstale":"2024-09-19T06:14:48.563410+0000","last_undegraded":"2024-09-19T06:14:48.563410+0000","last_fullsized":"2024-09-19T06:14:48.563410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:11.452118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T06:14:42.020504+0000","last_change":"2024-09-19T06:13:03.798722+0000","last_active":"2024-09-19T06:14:42.020504+0000","last_peered":"2024-09-19T06:14:42.020504+0000","last_clean":"2024-09-19T06:14:42.020504+0000","last_became_active":"2024-09-19T06:13:03.798428+0000","last_became_peered":"2024-09-19T06:13:03.798428+0000","last_unstale":"2024-09-19T06:14:42.020504+0000","last_undegraded":"2024-09-19T06:14:42.020504+0000","last_fullsized":"2024-09-19T06:14:42.020504+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:11:15.179515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.197751+0000","last_change":"2024-09-19T06:13:01.651003+0000","last_active":"2024-09-19T06:14:48.197751+0000","last_peered":"2024-09-19T06:14:48.197751+0000","last_clean":"2024-09-19T06:14:48.197751+0000","last_became_active":"2024-09-19T06:13:01.650697+0000","last_became_peered":"2024-09-19T06:13:01.650697+0000","last_unstale":"2024-09-19T06:14:48.197751+0000","last_undegraded":"2024-09-19T06:14:48.197751+0000","last_fullsized":"2024-09-19T06:14:48.197751+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:47.982845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.197500+0000","last_change":"2024-09-19T06:13:03.796907+0000","last_active":"2024-09-19T06:14:48.197500+0000","last_peered":"2024-09-19T06:14:48.197500+0000","last_clean":"2024-09-19T06:14:48.197500+0000","last_became_active":"2024-09-19T06:13:03.796426+0000","last_became_peered":"2024-09-19T06:13:03.796426+0000","last_unstale":"2024-09-19T06:14:48.197500+0000","last_undegraded":"2024-09-19T06:14:48.197500+0000","last_fullsized":"2024-09-19T06:14:48.197500+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:02.768695+0000","last_clean_scrub_stamp":"2024-09-19T06:13:02.768695+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:26.455773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T06:14:48.194670+0000","last_change":"2024-09-19T06:13:01.654788+0000","last_active":"2024-09-19T06:14:48.194670+0000","last_peered":"2024-09-19T06:14:48.194670+0000","last_clean":"2024-09-19T06:14:48.194670+0000","last_became_active":"2024-09-19T06:13:01.654461+0000","last_became_peered":"2024-09-19T06:13:01.654461+0000","last_unstale":"2024-09-19T06:14:48.194670+0000","last_undegraded":"2024-09-19T06:14:48.194670+0000","last_fullsized":"2024-09-19T06:14:48.194670+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:13:00.632821+0000","last_clean_scrub_stamp":"2024-09-19T06:13:00.632821+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:41.374288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":595257,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":678,"num_read_kb":447,"num_write":288,"num_write_kb":1432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":644,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2015232,"data_stored":1785771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612641,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":897024,"data_stored":439052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841574,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28712,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716440,"statfs":{"total":95995035648,"available":95965634560,"internally_reserved":0,"allocated":1728512,"data_stored":1227661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005100,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28300,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716852,"statfs":{"total":95995035648,"available":95966056448,"internally_reserved":0,"allocated":1302528,"data_stored":832482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234033,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36616,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708536,"statfs":{"total":95995035648,"available":95957540864,"internally_reserved":0,"allocated":1298432,"data_stored":832380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462965,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28496,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716656,"statfs":{"total":95995035648,"available":95965855744,"internally_reserved":0,"allocated":1503232,"data_stored":1032501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593787,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40384,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704768,"statfs":{"total":95995035648,"available":95953682432,"internally_reserved":0,"allocated":897024,"data_stored":438655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822719,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28636,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716516,"statfs":{"total":95995035648,"available":95965712384,"internally_reserved":0,"allocated":1650688,"data_stored":1163290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986245,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":909312,"data_stored":441490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215178,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36752,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708400,"statfs":{"total":95995035648,"available":95957401600,"internally_reserved":0,"allocated":1441792,"data_stored":963782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444111,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":494510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":962560,"data_stored":503503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":430991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":65055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":65783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":525100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":134357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":393932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":241664,"data_stored":198728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:14:53.888 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:14:54.185 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:54.411 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:54 smithi090 ceph-mon[34497]: from='client.15249 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:14:54.411 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:54 smithi090 ceph-mon[34497]: from='client.15255 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:14:54.412 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:54 smithi090 ceph-mon[34497]: from='client.15261 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:14:54.443 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:54 smithi089 ceph-mon[34160]: from='client.15249 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:14:54.444 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:54 smithi089 ceph-mon[34160]: from='client.15255 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:14:54.444 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:54 smithi089 ceph-mon[34160]: from='client.15261 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:14:54.447 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:54 smithi002 ceph-mon[30982]: from='client.15249 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:14:54.447 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:54 smithi002 ceph-mon[30982]: from='client.15255 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:14:54.447 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:54 smithi002 ceph-mon[30982]: from='client.15261 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:14:54.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.667+0000 7f8bc9ffa640 1 -- 172.21.15.2:0/2066471393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bc4100a90 msgr2=0x7f8bc4100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:54.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.667+0000 7f8bc9ffa640 1 --2- 172.21.15.2:0/2066471393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bc4100a90 0x7f8bc4100ef0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8009930 tx=0x7f8bb802a420 comp rx=0 tx=0).stop 2024-09-19T06:14:54.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.667+0000 7f8bc9ffa640 1 -- 172.21.15.2:0/2066471393 shutdown_connections 2024-09-19T06:14:54.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.667+0000 7f8bc9ffa640 1 --2- 172.21.15.2:0/2066471393 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8bc4101430 0x7f8bc410d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:54.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.667+0000 7f8bc9ffa640 1 --2- 172.21.15.2:0/2066471393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bc4100a90 0x7f8bc4100ef0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:54.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.667+0000 7f8bc9ffa640 1 --2- 172.21.15.2:0/2066471393 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bc4106a90 0x7f8bc4106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:54.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.667+0000 7f8bc9ffa640 1 -- 172.21.15.2:0/2066471393 >> 172.21.15.2:0/2066471393 conn(0x7f8bc40fc7d0 msgr2=0x7f8bc40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:54.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.667+0000 7f8bc9ffa640 1 -- 172.21.15.2:0/2066471393 shutdown_connections 2024-09-19T06:14:54.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.667+0000 7f8bc9ffa640 1 -- 172.21.15.2:0/2066471393 wait complete. 2024-09-19T06:14:54.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.667+0000 7f8bc9ffa640 1 Processor -- start 2024-09-19T06:14:54.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.668+0000 7f8bc9ffa640 1 -- start start 2024-09-19T06:14:54.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.668+0000 7f8bc9ffa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bc4100a90 0x7f8bc410e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:54.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.668+0000 7f8bc9ffa640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bc4101430 0x7f8bc410e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:54.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.668+0000 7f8bc9ffa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8bc4106a90 0x7f8bc410ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:54.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.668+0000 7f8bc9ffa640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc4111e60 con 0x7f8bc4100a90 2024-09-19T06:14:54.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.668+0000 7f8bc9ffa640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc4111ce0 con 0x7f8bc4106a90 2024-09-19T06:14:54.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.668+0000 7f8bc9ffa640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc4111fe0 con 0x7f8bc4101430 2024-09-19T06:14:54.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.668+0000 7f8bc37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bc4100a90 0x7f8bc410e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:54.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.668+0000 7f8bc37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bc4100a90 0x7f8bc410e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49852/0 (socket says 172.21.15.2:49852) 2024-09-19T06:14:54.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.668+0000 7f8bc37fe640 1 -- 172.21.15.2:0/817126766 learned_addr learned my addr 172.21.15.2:0/817126766 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:54.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.668+0000 7f8bc2ffd640 1 --2- 172.21.15.2:0/817126766 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bc4101430 0x7f8bc410e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:54.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.668+0000 7f8bc3fff640 1 --2- 172.21.15.2:0/817126766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8bc4106a90 0x7f8bc410ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:54.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.668+0000 7f8bc37fe640 1 -- 172.21.15.2:0/817126766 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bc4101430 msgr2=0x7f8bc410e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:54.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.668+0000 7f8bc37fe640 1 --2- 172.21.15.2:0/817126766 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bc4101430 0x7f8bc410e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:54.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.668+0000 7f8bc37fe640 1 -- 172.21.15.2:0/817126766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8bc4106a90 msgr2=0x7f8bc410ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:54.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.668+0000 7f8bc37fe640 1 --2- 172.21.15.2:0/817126766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8bc4106a90 0x7f8bc410ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:54.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.668+0000 7f8bc37fe640 1 -- 172.21.15.2:0/817126766 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bc41a6880 con 0x7f8bc4100a90 2024-09-19T06:14:54.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.668+0000 7f8bc37fe640 1 --2- 172.21.15.2:0/817126766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bc4100a90 0x7f8bc410e3f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8bb400e9f0 tx=0x7f8bb400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:54.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.669+0000 7f8bc0ff9640 1 -- 172.21.15.2:0/817126766 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb400cd80 con 0x7f8bc4100a90 2024-09-19T06:14:54.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.669+0000 7f8bc9ffa640 1 -- 172.21.15.2:0/817126766 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bc41a6b70 con 0x7f8bc4100a90 2024-09-19T06:14:54.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.669+0000 7f8bc0ff9640 1 -- 172.21.15.2:0/817126766 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8bb40054d0 con 0x7f8bc4100a90 2024-09-19T06:14:54.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.669+0000 7f8bc0ff9640 1 -- 172.21.15.2:0/817126766 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb4010490 con 0x7f8bc4100a90 2024-09-19T06:14:54.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.669+0000 7f8bc9ffa640 1 -- 172.21.15.2:0/817126766 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bc41a7030 con 0x7f8bc4100a90 2024-09-19T06:14:54.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.670+0000 7f8bc9ffa640 1 -- 172.21.15.2:0/817126766 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bc4100ef0 con 0x7f8bc4100a90 2024-09-19T06:14:54.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.671+0000 7f8bc0ff9640 1 -- 172.21.15.2:0/817126766 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138581+0+0 (secure 0 0 0) 0x7f8bb4005020 con 0x7f8bc4100a90 2024-09-19T06:14:54.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.672+0000 7f8bc0ff9640 1 --2- 172.21.15.2:0/817126766 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f8bac0a34d0 0x7f8bac0a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:54.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.672+0000 7f8bc2ffd640 1 --2- 172.21.15.2:0/817126766 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f8bac0a34d0 0x7f8bac0a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:54.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.672+0000 7f8bc0ff9640 1 -- 172.21.15.2:0/817126766 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f8bb40d0270 con 0x7f8bc4100a90 2024-09-19T06:14:54.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.672+0000 7f8bc2ffd640 1 --2- 172.21.15.2:0/817126766 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f8bac0a34d0 0x7f8bac0a5990 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8009900 tx=0x7f8bb8000bc0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:54.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.676+0000 7f8bc0ff9640 1 -- 172.21.15.2:0/817126766 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8bb409ca30 con 0x7f8bc4100a90 2024-09-19T06:14:54.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.890+0000 7f8bc9ffa640 1 -- 172.21.15.2:0/817126766 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8bc402d7c0 con 0x7f8bc4100a90 2024-09-19T06:14:54.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.891+0000 7f8bc0ff9640 1 -- 172.21.15.2:0/817126766 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11882 (secure 0 0 0) 0x7f8bb409c330 con 0x7f8bc4100a90 2024-09-19T06:14:54.892 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:14:54.892 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-09-19T06:14:49:104280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:14:48.191083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24470,24472,24497]},"id":1}]} 2024-09-19T06:14:54.893 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-09-19T06:14:54.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.893+0000 7f8bc9ffa640 1 -- 172.21.15.2:0/817126766 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f8bac0a34d0 msgr2=0x7f8bac0a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:54.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.893+0000 7f8bc9ffa640 1 --2- 172.21.15.2:0/817126766 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f8bac0a34d0 0x7f8bac0a5990 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8009900 tx=0x7f8bb8000bc0 comp rx=0 tx=0).stop 2024-09-19T06:14:54.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.893+0000 7f8bc9ffa640 1 -- 172.21.15.2:0/817126766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bc4100a90 msgr2=0x7f8bc410e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:54.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.893+0000 7f8bc9ffa640 1 --2- 172.21.15.2:0/817126766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bc4100a90 0x7f8bc410e3f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8bb400e9f0 tx=0x7f8bb400edf0 comp rx=0 tx=0).stop 2024-09-19T06:14:54.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.893+0000 7f8bc9ffa640 1 -- 172.21.15.2:0/817126766 shutdown_connections 2024-09-19T06:14:54.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.893+0000 7f8bc9ffa640 1 --2- 172.21.15.2:0/817126766 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f8bac0a34d0 0x7f8bac0a5990 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:54.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.893+0000 7f8bc9ffa640 1 --2- 172.21.15.2:0/817126766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8bc4106a90 0x7f8bc410ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:54.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.893+0000 7f8bc9ffa640 1 --2- 172.21.15.2:0/817126766 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bc4101430 0x7f8bc410e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:54.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.893+0000 7f8bc9ffa640 1 --2- 172.21.15.2:0/817126766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bc4100a90 0x7f8bc410e3f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:54.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.893+0000 7f8bc9ffa640 1 -- 172.21.15.2:0/817126766 >> 172.21.15.2:0/817126766 conn(0x7f8bc40fc7d0 msgr2=0x7f8bc40fd0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:54.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.893+0000 7f8bc9ffa640 1 -- 172.21.15.2:0/817126766 shutdown_connections 2024-09-19T06:14:54.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:54.893+0000 7f8bc9ffa640 1 -- 172.21.15.2:0/817126766 wait complete. 2024-09-19T06:14:55.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:55 smithi002 ceph-mon[30982]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:14:55.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:55 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/817126766' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:14:55.489 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:55 smithi090 ceph-mon[34497]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:14:55.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:55 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/817126766' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:14:55.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:55 smithi089 ceph-mon[34160]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:14:55.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:55 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/817126766' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:14:55.583 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:14:55.848 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:56.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.268+0000 7f4509b1d640 1 -- 172.21.15.2:0/2056388766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4504103660 msgr2=0x7f450410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:56.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.268+0000 7f4509b1d640 1 --2- 172.21.15.2:0/2056388766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4504103660 0x7f450410bb50 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f44f8009900 tx=0x7f44f802a480 comp rx=0 tx=0).stop 2024-09-19T06:14:56.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.268+0000 7f4509b1d640 1 -- 172.21.15.2:0/2056388766 shutdown_connections 2024-09-19T06:14:56.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.268+0000 7f4509b1d640 1 --2- 172.21.15.2:0/2056388766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f450410c170 0x7f450410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:56.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.268+0000 7f4509b1d640 1 --2- 172.21.15.2:0/2056388766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4504103660 0x7f450410bb50 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:56.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.268+0000 7f4509b1d640 1 --2- 172.21.15.2:0/2056388766 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4504102d40 0x7f4504103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:56.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.268+0000 7f4509b1d640 1 -- 172.21.15.2:0/2056388766 >> 172.21.15.2:0/2056388766 conn(0x7f45040fc7a0 msgr2=0x7f45040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:56.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.268+0000 7f4509b1d640 1 -- 172.21.15.2:0/2056388766 shutdown_connections 2024-09-19T06:14:56.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.268+0000 7f4509b1d640 1 -- 172.21.15.2:0/2056388766 wait complete. 2024-09-19T06:14:56.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.268+0000 7f4509b1d640 1 Processor -- start 2024-09-19T06:14:56.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.269+0000 7f4509b1d640 1 -- start start 2024-09-19T06:14:56.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.269+0000 7f4509b1d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4504102d40 0x7f4504198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:56.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.269+0000 7f4509b1d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4504103660 0x7f4504198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:56.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.269+0000 7f4509b1d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f450410c170 0x7f450419cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:56.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.269+0000 7f4509b1d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4504111e20 con 0x7f4504103660 2024-09-19T06:14:56.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.269+0000 7f4509b1d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4504111ca0 con 0x7f450410c170 2024-09-19T06:14:56.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.269+0000 7f4509b1d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4504111fa0 con 0x7f4504102d40 2024-09-19T06:14:56.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.269+0000 7f4502ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4504103660 0x7f4504198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:56.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.269+0000 7f4502ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4504103660 0x7f4504198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46100/0 (socket says 172.21.15.2:46100) 2024-09-19T06:14:56.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.269+0000 7f4502ffd640 1 -- 172.21.15.2:0/3918858782 learned_addr learned my addr 172.21.15.2:0/3918858782 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:56.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.269+0000 7f45037fe640 1 --2- 172.21.15.2:0/3918858782 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4504102d40 0x7f4504198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:56.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.269+0000 7f4503fff640 1 --2- 172.21.15.2:0/3918858782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f450410c170 0x7f450419cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:56.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.269+0000 7f4502ffd640 1 -- 172.21.15.2:0/3918858782 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4504102d40 msgr2=0x7f4504198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:56.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.269+0000 7f4502ffd640 1 --2- 172.21.15.2:0/3918858782 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4504102d40 0x7f4504198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:56.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.269+0000 7f4502ffd640 1 -- 172.21.15.2:0/3918858782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f450410c170 msgr2=0x7f450419cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:56.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.269+0000 7f4502ffd640 1 --2- 172.21.15.2:0/3918858782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f450410c170 0x7f450419cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:56.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.269+0000 7f4502ffd640 1 -- 172.21.15.2:0/3918858782 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f450419d2b0 con 0x7f4504103660 2024-09-19T06:14:56.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.269+0000 7f45037fe640 1 --2- 172.21.15.2:0/3918858782 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4504102d40 0x7f4504198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:56.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.269+0000 7f4502ffd640 1 --2- 172.21.15.2:0/3918858782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4504103660 0x7f4504198840 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f44f8005940 tx=0x7f44f80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:56.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.270+0000 7f4500ff9640 1 -- 172.21.15.2:0/3918858782 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f803f030 con 0x7f4504103660 2024-09-19T06:14:56.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.270+0000 7f4500ff9640 1 -- 172.21.15.2:0/3918858782 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f44f8003cb0 con 0x7f4504103660 2024-09-19T06:14:56.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.270+0000 7f4509b1d640 1 -- 172.21.15.2:0/3918858782 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f450419d540 con 0x7f4504103660 2024-09-19T06:14:56.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.270+0000 7f4500ff9640 1 -- 172.21.15.2:0/3918858782 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f8035070 con 0x7f4504103660 2024-09-19T06:14:56.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.270+0000 7f4509b1d640 1 -- 172.21.15.2:0/3918858782 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45041a4e80 con 0x7f4504103660 2024-09-19T06:14:56.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.271+0000 7f4509b1d640 1 -- 172.21.15.2:0/3918858782 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f450406b070 con 0x7f4504103660 2024-09-19T06:14:56.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.272+0000 7f4500ff9640 1 -- 172.21.15.2:0/3918858782 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138581+0+0 (secure 0 0 0) 0x7f44f8042030 con 0x7f4504103660 2024-09-19T06:14:56.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.273+0000 7f4500ff9640 1 --2- 172.21.15.2:0/3918858782 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f44ec0a3550 0x7f44ec0a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:56.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.273+0000 7f45037fe640 1 --2- 172.21.15.2:0/3918858782 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f44ec0a3550 0x7f44ec0a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:56.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.273+0000 7f4500ff9640 1 -- 172.21.15.2:0/3918858782 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f44f80f0650 con 0x7f4504103660 2024-09-19T06:14:56.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.273+0000 7f45037fe640 1 --2- 172.21.15.2:0/3918858782 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f44ec0a3550 0x7f44ec0a5a10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f44f4009fd0 tx=0x7f44f4009680 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:56.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.277+0000 7f4500ff9640 1 -- 172.21.15.2:0/3918858782 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f44f80bc830 con 0x7f4504103660 2024-09-19T06:14:56.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.455+0000 7f4509b1d640 1 -- 172.21.15.2:0/3918858782 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4504106c50 con 0x7f4504103660 2024-09-19T06:14:56.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.456+0000 7f4500ff9640 1 -- 172.21.15.2:0/3918858782 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22949 (secure 0 0 0) 0x7f44f80c0b30 con 0x7f4504103660 2024-09-19T06:14:56.458 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:14:56.459 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":82,"fsid":"078f6612-764d-11ef-bceb-c7b262605968","created":"2024-09-19T06:05:17.607927+0000","modified":"2024-09-19T06:14:48.099140+0000","last_up_change":"2024-09-19T06:12:13.856684+0000","last_in_change":"2024-09-19T06:11:49.745266+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:08:28.425566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:13:00.482789+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:13:02.768221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0de97a3d-2d27-455b-9998-ddd2319c148d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6803","nonce":915165910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6805","nonce":915165910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6809","nonce":915165910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6807","nonce":915165910}]},"public_addr":"172.21.15.2:6803/915165910","cluster_addr":"172.21.15.2:6805/915165910","heartbeat_back_addr":"172.21.15.2:6809/915165910","heartbeat_front_addr":"172.21.15.2:6807/915165910","state":["exists","up"]},{"osd":1,"uuid":"056d229e-2de4-4902-922e-21e1a5d3f061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6801","nonce":4097264171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6803","nonce":4097264171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6807","nonce":4097264171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6805","nonce":4097264171}]},"public_addr":"172.21.15.89:6801/4097264171","cluster_addr":"172.21.15.89:6803/4097264171","heartbeat_back_addr":"172.21.15.89:6807/4097264171","heartbeat_front_addr":"172.21.15.89:6805/4097264171","state":["exists","up"]},{"osd":2,"uuid":"2a4e7147-4125-4ee6-b5ad-85518d7066d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6801","nonce":1479908200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6803","nonce":1479908200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6807","nonce":1479908200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6805","nonce":1479908200}]},"public_addr":"172.21.15.90:6801/1479908200","cluster_addr":"172.21.15.90:6803/1479908200","heartbeat_back_addr":"172.21.15.90:6807/1479908200","heartbeat_front_addr":"172.21.15.90:6805/1479908200","state":["exists","up"]},{"osd":3,"uuid":"7b3da775-0f0a-4b46-a8dc-9ec822a54301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6811","nonce":1796948193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6813","nonce":1796948193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6817","nonce":1796948193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6815","nonce":1796948193}]},"public_addr":"172.21.15.2:6811/1796948193","cluster_addr":"172.21.15.2:6813/1796948193","heartbeat_back_addr":"172.21.15.2:6817/1796948193","heartbeat_front_addr":"172.21.15.2:6815/1796948193","state":["exists","up"]},{"osd":4,"uuid":"d4c8bafc-c844-4ff1-a3d8-7a53576e6b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6809","nonce":4256848315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6811","nonce":4256848315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6815","nonce":4256848315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6813","nonce":4256848315}]},"public_addr":"172.21.15.89:6809/4256848315","cluster_addr":"172.21.15.89:6811/4256848315","heartbeat_back_addr":"172.21.15.89:6815/4256848315","heartbeat_front_addr":"172.21.15.89:6813/4256848315","state":["exists","up"]},{"osd":5,"uuid":"8dc9bb55-29e0-4b04-9415-3b9bb5ed05cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6809","nonce":189855967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6811","nonce":189855967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6815","nonce":189855967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6813","nonce":189855967}]},"public_addr":"172.21.15.90:6809/189855967","cluster_addr":"172.21.15.90:6811/189855967","heartbeat_back_addr":"172.21.15.90:6815/189855967","heartbeat_front_addr":"172.21.15.90:6813/189855967","state":["exists","up"]},{"osd":6,"uuid":"86d1443a-9b43-46de-abd7-4c95b43207f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6819","nonce":3886336279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6821","nonce":3886336279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6825","nonce":3886336279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6823","nonce":3886336279}]},"public_addr":"172.21.15.2:6819/3886336279","cluster_addr":"172.21.15.2:6821/3886336279","heartbeat_back_addr":"172.21.15.2:6825/3886336279","heartbeat_front_addr":"172.21.15.2:6823/3886336279","state":["exists","up"]},{"osd":7,"uuid":"1cc5554c-80d2-4e77-b29a-fd2ada68d82d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6817","nonce":508513510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6819","nonce":508513510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6823","nonce":508513510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6821","nonce":508513510}]},"public_addr":"172.21.15.89:6817/508513510","cluster_addr":"172.21.15.89:6819/508513510","heartbeat_back_addr":"172.21.15.89:6823/508513510","heartbeat_front_addr":"172.21.15.89:6821/508513510","state":["exists","up"]},{"osd":8,"uuid":"e9b2eb92-9af2-4f26-a259-fcaf972e4fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6817","nonce":3558544480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6819","nonce":3558544480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6823","nonce":3558544480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6821","nonce":3558544480}]},"public_addr":"172.21.15.90:6817/3558544480","cluster_addr":"172.21.15.90:6819/3558544480","heartbeat_back_addr":"172.21.15.90:6823/3558544480","heartbeat_front_addr":"172.21.15.90:6821/3558544480","state":["exists","up"]},{"osd":9,"uuid":"194d4c64-dd29-4d35-bc54-0858c44815cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6827","nonce":2690758100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6829","nonce":2690758100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6833","nonce":2690758100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6831","nonce":2690758100}]},"public_addr":"172.21.15.2:6827/2690758100","cluster_addr":"172.21.15.2:6829/2690758100","heartbeat_back_addr":"172.21.15.2:6833/2690758100","heartbeat_front_addr":"172.21.15.2:6831/2690758100","state":["exists","up"]},{"osd":10,"uuid":"7695fa4a-b94e-4afc-b166-690a197ad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6825","nonce":1141925395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6827","nonce":1141925395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6831","nonce":1141925395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6829","nonce":1141925395}]},"public_addr":"172.21.15.89:6825/1141925395","cluster_addr":"172.21.15.89:6827/1141925395","heartbeat_back_addr":"172.21.15.89:6831/1141925395","heartbeat_front_addr":"172.21.15.89:6829/1141925395","state":["exists","up"]},{"osd":11,"uuid":"1815a999-bfdb-46b9-afcd-632ee8ba56d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6825","nonce":468380924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6827","nonce":468380924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6831","nonce":468380924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6829","nonce":468380924}]},"public_addr":"172.21.15.90:6825/468380924","cluster_addr":"172.21.15.90:6827/468380924","heartbeat_back_addr":"172.21.15.90:6831/468380924","heartbeat_front_addr":"172.21.15.90:6829/468380924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:07:36.125754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:01.415356+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:26.420808+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:51.722673+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:09:16.562300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:09:41.958465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:10:07.056167+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:10:32.066195+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:10:56.497875+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:11:21.973083+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:11:46.891515+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:12:11.910012+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9},{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/3813883133":"2024-09-20T06:14:48.099112+0000","172.21.15.2:0/2612001712":"2024-09-20T06:14:48.099112+0000","172.21.15.2:0/2508383651":"2024-09-20T06:14:48.099112+0000","172.21.15.2:0/3763089457":"2024-09-20T06:05:47.538477+0000","172.21.15.2:0/1361067708":"2024-09-20T06:05:47.538477+0000","172.21.15.2:6801/1200011821":"2024-09-20T06:06:11.912585+0000","172.21.15.2:0/3899165140":"2024-09-20T06:05:47.538477+0000","172.21.15.2:6800/1200011821":"2024-09-20T06:06:11.912585+0000","172.21.15.2:6800/1602650352":"2024-09-20T06:05:47.538477+0000","172.21.15.2:0/2976372536":"2024-09-20T06:06:11.912585+0000","172.21.15.2:0/1280963020":"2024-09-20T06:06:11.912585+0000","172.21.15.2:6800/4180340554":"2024-09-20T06:14:48.099112+0000","172.21.15.2:6801/1602650352":"2024-09-20T06:05:47.538477+0000","172.21.15.2:0/874985787":"2024-09-20T06:06:11.912585+0000","172.21.15.2:6801/4180340554":"2024-09-20T06:14:48.099112+0000","172.21.15.2:0/2134106196":"2024-09-20T06:14:48.099112+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:14:56.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.459+0000 7f4509b1d640 1 -- 172.21.15.2:0/3918858782 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f44ec0a3550 msgr2=0x7f44ec0a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:56.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.459+0000 7f4509b1d640 1 --2- 172.21.15.2:0/3918858782 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f44ec0a3550 0x7f44ec0a5a10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f44f4009fd0 tx=0x7f44f4009680 comp rx=0 tx=0).stop 2024-09-19T06:14:56.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.459+0000 7f4509b1d640 1 -- 172.21.15.2:0/3918858782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4504103660 msgr2=0x7f4504198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:56.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.459+0000 7f4509b1d640 1 --2- 172.21.15.2:0/3918858782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4504103660 0x7f4504198840 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f44f8005940 tx=0x7f44f80042f0 comp rx=0 tx=0).stop 2024-09-19T06:14:56.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.459+0000 7f4509b1d640 1 -- 172.21.15.2:0/3918858782 shutdown_connections 2024-09-19T06:14:56.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.459+0000 7f4509b1d640 1 --2- 172.21.15.2:0/3918858782 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f44ec0a3550 0x7f44ec0a5a10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:56.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.459+0000 7f4509b1d640 1 --2- 172.21.15.2:0/3918858782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f450410c170 0x7f450419cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:56.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.459+0000 7f4509b1d640 1 --2- 172.21.15.2:0/3918858782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4504103660 0x7f4504198840 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:56.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.459+0000 7f4509b1d640 1 --2- 172.21.15.2:0/3918858782 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4504102d40 0x7f4504198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:56.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.459+0000 7f4509b1d640 1 -- 172.21.15.2:0/3918858782 >> 172.21.15.2:0/3918858782 conn(0x7f45040fc7a0 msgr2=0x7f45040fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:56.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.459+0000 7f4509b1d640 1 -- 172.21.15.2:0/3918858782 shutdown_connections 2024-09-19T06:14:56.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:56.459+0000 7f4509b1d640 1 -- 172.21.15.2:0/3918858782 wait complete. 2024-09-19T06:14:57.063 DEBUG:tasks.fwd_scrub:Yielding 2024-09-19T06:14:57.063 INFO:teuthology.run_tasks:Running task exec... 2024-09-19T06:14:57.073 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T06:14:57.073 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-19T06:14:57.073 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-09-19T06:14:57.074 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-19T06:14:57.074 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:14:57.074 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:14:57.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.184+0000 7fc96719f640 1 -- 172.21.15.2:0/2606604061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9601011b0 msgr2=0x7fc96010d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:57.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.184+0000 7fc96719f640 1 --2- 172.21.15.2:0/2606604061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9601011b0 0x7fc96010d6e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc958009930 tx=0x7fc95802a420 comp rx=0 tx=0).stop 2024-09-19T06:14:57.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.184+0000 7fc96719f640 1 -- 172.21.15.2:0/2606604061 shutdown_connections 2024-09-19T06:14:57.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.184+0000 7fc96719f640 1 --2- 172.21.15.2:0/2606604061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9601011b0 0x7fc96010d6e0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.184+0000 7fc96719f640 1 --2- 172.21.15.2:0/2606604061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc960100810 0x7fc960100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.184+0000 7fc96719f640 1 --2- 172.21.15.2:0/2606604061 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc960106820 0x7fc960106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.184+0000 7fc96719f640 1 -- 172.21.15.2:0/2606604061 >> 172.21.15.2:0/2606604061 conn(0x7fc9600777f0 msgr2=0x7fc9600feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:57.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.184+0000 7fc96719f640 1 -- 172.21.15.2:0/2606604061 shutdown_connections 2024-09-19T06:14:57.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.184+0000 7fc96719f640 1 -- 172.21.15.2:0/2606604061 wait complete. 2024-09-19T06:14:57.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.185+0000 7fc96719f640 1 Processor -- start 2024-09-19T06:14:57.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.185+0000 7fc96719f640 1 -- start start 2024-09-19T06:14:57.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.185+0000 7fc96719f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc960100810 0x7fc96019a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:57.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.185+0000 7fc96719f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9601011b0 0x7fc96019a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:57.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.185+0000 7fc96719f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc960106820 0x7fc96019eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:57.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.185+0000 7fc96719f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc960110b10 con 0x7fc960106820 2024-09-19T06:14:57.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.185+0000 7fc96719f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc960110990 con 0x7fc9601011b0 2024-09-19T06:14:57.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.185+0000 7fc96719f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc960110c90 con 0x7fc960100810 2024-09-19T06:14:57.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.185+0000 7fc96699e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc960106820 0x7fc96019eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:57.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.185+0000 7fc96699e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc960106820 0x7fc96019eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46120/0 (socket says 172.21.15.2:46120) 2024-09-19T06:14:57.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.185+0000 7fc96699e640 1 -- 172.21.15.2:0/3941870317 learned_addr learned my addr 172.21.15.2:0/3941870317 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:57.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.185+0000 7fc96619d640 1 --2- 172.21.15.2:0/3941870317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc960100810 0x7fc96019a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:57.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.185+0000 7fc96599c640 1 --2- 172.21.15.2:0/3941870317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9601011b0 0x7fc96019a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:57.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.185+0000 7fc96699e640 1 -- 172.21.15.2:0/3941870317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc960100810 msgr2=0x7fc96019a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:57.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.185+0000 7fc96699e640 1 --2- 172.21.15.2:0/3941870317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc960100810 0x7fc96019a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.185+0000 7fc96699e640 1 -- 172.21.15.2:0/3941870317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9601011b0 msgr2=0x7fc96019a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:57.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.185+0000 7fc96699e640 1 --2- 172.21.15.2:0/3941870317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9601011b0 0x7fc96019a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.185+0000 7fc96699e640 1 -- 172.21.15.2:0/3941870317 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc96019f2c0 con 0x7fc960106820 2024-09-19T06:14:57.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.186+0000 7fc96699e640 1 --2- 172.21.15.2:0/3941870317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc960106820 0x7fc96019eb90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc958005940 tx=0x7fc958004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:57.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.186+0000 7fc95f7fe640 1 -- 172.21.15.2:0/3941870317 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc95803f030 con 0x7fc960106820 2024-09-19T06:14:57.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.186+0000 7fc96719f640 1 -- 172.21.15.2:0/3941870317 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc96019f550 con 0x7fc960106820 2024-09-19T06:14:57.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.186+0000 7fc95f7fe640 1 -- 172.21.15.2:0/3941870317 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc958003aa0 con 0x7fc960106820 2024-09-19T06:14:57.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.186+0000 7fc95f7fe640 1 -- 172.21.15.2:0/3941870317 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc958035070 con 0x7fc960106820 2024-09-19T06:14:57.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.186+0000 7fc96719f640 1 -- 172.21.15.2:0/3941870317 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9601a6e40 con 0x7fc960106820 2024-09-19T06:14:57.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.187+0000 7fc96719f640 1 -- 172.21.15.2:0/3941870317 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc960100c70 con 0x7fc960106820 2024-09-19T06:14:57.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.188+0000 7fc95f7fe640 1 -- 172.21.15.2:0/3941870317 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138581+0+0 (secure 0 0 0) 0x7fc958042030 con 0x7fc960106820 2024-09-19T06:14:57.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.189+0000 7fc95f7fe640 1 --2- 172.21.15.2:0/3941870317 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc9480a34c0 0x7fc9480a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:57.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.189+0000 7fc95f7fe640 1 -- 172.21.15.2:0/3941870317 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fc9580f0a00 con 0x7fc960106820 2024-09-19T06:14:57.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.189+0000 7fc96619d640 1 --2- 172.21.15.2:0/3941870317 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc9480a34c0 0x7fc9480a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:57.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.189+0000 7fc96619d640 1 --2- 172.21.15.2:0/3941870317 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc9480a34c0 0x7fc9480a5980 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc950005fd0 tx=0x7fc950009680 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:57.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.192+0000 7fc95f7fe640 1 -- 172.21.15.2:0/3941870317 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc9580bd290 con 0x7fc960106820 2024-09-19T06:14:57.344 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:57.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.382+0000 7fc96719f640 1 -- 172.21.15.2:0/3941870317 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7fc9600fdcf0 con 0x7fc960106820 2024-09-19T06:14:57.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.386+0000 7fc95f7fe640 1 -- 172.21.15.2:0/3941870317 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v28)=0 v28) ==== 129+0+0 (secure 0 0 0) 0x7fc9580bcb90 con 0x7fc960106820 2024-09-19T06:14:57.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.389+0000 7fc96719f640 1 -- 172.21.15.2:0/3941870317 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc9480a34c0 msgr2=0x7fc9480a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:57.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.389+0000 7fc96719f640 1 --2- 172.21.15.2:0/3941870317 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc9480a34c0 0x7fc9480a5980 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc950005fd0 tx=0x7fc950009680 comp rx=0 tx=0).stop 2024-09-19T06:14:57.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.389+0000 7fc96719f640 1 -- 172.21.15.2:0/3941870317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc960106820 msgr2=0x7fc96019eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:57.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.389+0000 7fc96719f640 1 --2- 172.21.15.2:0/3941870317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc960106820 0x7fc96019eb90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc958005940 tx=0x7fc958004270 comp rx=0 tx=0).stop 2024-09-19T06:14:57.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.389+0000 7fc96719f640 1 -- 172.21.15.2:0/3941870317 shutdown_connections 2024-09-19T06:14:57.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.389+0000 7fc96719f640 1 --2- 172.21.15.2:0/3941870317 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc9480a34c0 0x7fc9480a5980 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.389+0000 7fc96719f640 1 --2- 172.21.15.2:0/3941870317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc960106820 0x7fc96019eb90 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.389+0000 7fc96719f640 1 --2- 172.21.15.2:0/3941870317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9601011b0 0x7fc96019a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.389+0000 7fc96719f640 1 --2- 172.21.15.2:0/3941870317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc960100810 0x7fc96019a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.389+0000 7fc96719f640 1 -- 172.21.15.2:0/3941870317 >> 172.21.15.2:0/3941870317 conn(0x7fc9600777f0 msgr2=0x7fc960069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:57.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.389+0000 7fc96719f640 1 -- 172.21.15.2:0/3941870317 shutdown_connections 2024-09-19T06:14:57.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.389+0000 7fc96719f640 1 -- 172.21.15.2:0/3941870317 wait complete. 2024-09-19T06:14:57.403 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:57 smithi002 ceph-mon[30982]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 879 B/s wr, 22 op/s 2024-09-19T06:14:57.403 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:57 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/3918858782' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:14:57.404 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-09-19T06:14:57.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:57 smithi090 ceph-mon[34497]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 879 B/s wr, 22 op/s 2024-09-19T06:14:57.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:57 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/3918858782' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:14:57.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.509+0000 7f2025bc4640 1 -- 172.21.15.2:0/2570067132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2020101340 msgr2=0x7f202010d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:57.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.509+0000 7f2025bc4640 1 --2- 172.21.15.2:0/2570067132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2020101340 0x7f202010d870 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2018009cd0 tx=0x7f201802a8e0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.509+0000 7f2025bc4640 1 -- 172.21.15.2:0/2570067132 shutdown_connections 2024-09-19T06:14:57.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.509+0000 7f2025bc4640 1 --2- 172.21.15.2:0/2570067132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2020101340 0x7f202010d870 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.509+0000 7f2025bc4640 1 --2- 172.21.15.2:0/2570067132 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20201009a0 0x7f2020100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.509+0000 7f2025bc4640 1 --2- 172.21.15.2:0/2570067132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20201069b0 0x7f2020106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.509+0000 7f2025bc4640 1 -- 172.21.15.2:0/2570067132 >> 172.21.15.2:0/2570067132 conn(0x7f20200779a0 msgr2=0x7f20200fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:57.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.509+0000 7f2025bc4640 1 -- 172.21.15.2:0/2570067132 shutdown_connections 2024-09-19T06:14:57.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.509+0000 7f2025bc4640 1 -- 172.21.15.2:0/2570067132 wait complete. 2024-09-19T06:14:57.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.509+0000 7f2025bc4640 1 Processor -- start 2024-09-19T06:14:57.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.510+0000 7f2025bc4640 1 -- start start 2024-09-19T06:14:57.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.510+0000 7f2025bc4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20201009a0 0x7f20201982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:57.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.510+0000 7f2025bc4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2020101340 0x7f2020198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:57.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.510+0000 7f2025bc4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20201069b0 0x7f202019cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:57.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.510+0000 7f2025bc4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2020110cf0 con 0x7f20201009a0 2024-09-19T06:14:57.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.510+0000 7f2025bc4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2020110b70 con 0x7f2020101340 2024-09-19T06:14:57.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.510+0000 7f2025bc4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2020110e70 con 0x7f20201069b0 2024-09-19T06:14:57.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.510+0000 7f201f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20201009a0 0x7f20201982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:57.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.510+0000 7f201f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20201009a0 0x7f20201982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46142/0 (socket says 172.21.15.2:46142) 2024-09-19T06:14:57.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.510+0000 7f201f7fe640 1 -- 172.21.15.2:0/2203460921 learned_addr learned my addr 172.21.15.2:0/2203460921 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:57.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.510+0000 7f201ffff640 1 --2- 172.21.15.2:0/2203460921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20201069b0 0x7f202019cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:57.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.510+0000 7f201effd640 1 --2- 172.21.15.2:0/2203460921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2020101340 0x7f2020198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:57.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.510+0000 7f201f7fe640 1 -- 172.21.15.2:0/2203460921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20201069b0 msgr2=0x7f202019cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:57.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.510+0000 7f201f7fe640 1 --2- 172.21.15.2:0/2203460921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20201069b0 0x7f202019cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.510+0000 7f201f7fe640 1 -- 172.21.15.2:0/2203460921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2020101340 msgr2=0x7f2020198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:57.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.510+0000 7f201f7fe640 1 --2- 172.21.15.2:0/2203460921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2020101340 0x7f2020198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.510+0000 7f201f7fe640 1 -- 172.21.15.2:0/2203460921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f202019d2e0 con 0x7f20201009a0 2024-09-19T06:14:57.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.510+0000 7f201effd640 1 --2- 172.21.15.2:0/2203460921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2020101340 0x7f2020198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:14:57.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.510+0000 7f201f7fe640 1 --2- 172.21.15.2:0/2203460921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20201009a0 0x7f20201982f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f201000e9f0 tx=0x7f201000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:57.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.511+0000 7f201cff9640 1 -- 172.21.15.2:0/2203460921 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201000cd80 con 0x7f20201009a0 2024-09-19T06:14:57.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.511+0000 7f201cff9640 1 -- 172.21.15.2:0/2203460921 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f20100108e0 con 0x7f20201009a0 2024-09-19T06:14:57.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.511+0000 7f201cff9640 1 -- 172.21.15.2:0/2203460921 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2010018920 con 0x7f20201009a0 2024-09-19T06:14:57.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.511+0000 7f2025bc4640 1 -- 172.21.15.2:0/2203460921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f202019d5d0 con 0x7f20201009a0 2024-09-19T06:14:57.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.511+0000 7f2025bc4640 1 -- 172.21.15.2:0/2203460921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20201a4e60 con 0x7f20201009a0 2024-09-19T06:14:57.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.512+0000 7f2025bc4640 1 -- 172.21.15.2:0/2203460921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20201020e0 con 0x7f20201009a0 2024-09-19T06:14:57.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.513+0000 7f201cff9640 1 -- 172.21.15.2:0/2203460921 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138581+0+0 (secure 0 0 0) 0x7f2010010a90 con 0x7f20201009a0 2024-09-19T06:14:57.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.514+0000 7f201cff9640 1 --2- 172.21.15.2:0/2203460921 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f20080a34d0 0x7f20080a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:57.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.514+0000 7f201effd640 1 --2- 172.21.15.2:0/2203460921 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f20080a34d0 0x7f20080a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:57.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.514+0000 7f201cff9640 1 -- 172.21.15.2:0/2203460921 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f20100d02e0 con 0x7f20201009a0 2024-09-19T06:14:57.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.514+0000 7f201effd640 1 --2- 172.21.15.2:0/2203460921 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f20080a34d0 0x7f20080a5990 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2020105420 tx=0x7f2014005f90 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:57.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.518+0000 7f201cff9640 1 -- 172.21.15.2:0/2203460921 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f201009caa0 con 0x7f20201009a0 2024-09-19T06:14:57.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:57 smithi089 ceph-mon[34160]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 879 B/s wr, 22 op/s 2024-09-19T06:14:57.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:57 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/3918858782' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:14:57.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.700+0000 7f2025bc4640 1 -- 172.21.15.2:0/2203460921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f2020100e00 con 0x7f20201009a0 2024-09-19T06:14:57.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.704+0000 7f201cff9640 1 -- 172.21.15.2:0/2203460921 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v29)=0 v29) ==== 138+0+0 (secure 0 0 0) 0x7f201009c3a0 con 0x7f20201009a0 2024-09-19T06:14:57.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.706+0000 7f2025bc4640 1 -- 172.21.15.2:0/2203460921 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f20080a34d0 msgr2=0x7f20080a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:57.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.706+0000 7f2025bc4640 1 --2- 172.21.15.2:0/2203460921 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f20080a34d0 0x7f20080a5990 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2020105420 tx=0x7f2014005f90 comp rx=0 tx=0).stop 2024-09-19T06:14:57.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.706+0000 7f2025bc4640 1 -- 172.21.15.2:0/2203460921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20201009a0 msgr2=0x7f20201982f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:57.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.706+0000 7f2025bc4640 1 --2- 172.21.15.2:0/2203460921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20201009a0 0x7f20201982f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f201000e9f0 tx=0x7f201000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.707+0000 7f2025bc4640 1 -- 172.21.15.2:0/2203460921 shutdown_connections 2024-09-19T06:14:57.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.707+0000 7f2025bc4640 1 --2- 172.21.15.2:0/2203460921 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f20080a34d0 0x7f20080a5990 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.707+0000 7f2025bc4640 1 --2- 172.21.15.2:0/2203460921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20201069b0 0x7f202019cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.707+0000 7f2025bc4640 1 --2- 172.21.15.2:0/2203460921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2020101340 0x7f2020198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.707+0000 7f2025bc4640 1 --2- 172.21.15.2:0/2203460921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20201009a0 0x7f20201982f0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.707+0000 7f2025bc4640 1 -- 172.21.15.2:0/2203460921 >> 172.21.15.2:0/2203460921 conn(0x7f20200779a0 msgr2=0x7f2020069cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:57.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.707+0000 7f2025bc4640 1 -- 172.21.15.2:0/2203460921 shutdown_connections 2024-09-19T06:14:57.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.707+0000 7f2025bc4640 1 -- 172.21.15.2:0/2203460921 wait complete. 2024-09-19T06:14:57.720 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-09-19T06:14:57.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.827+0000 7f9af4de8640 1 -- 172.21.15.2:0/1234249003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9af0103620 msgr2=0x7f9af010bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:57.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.827+0000 7f9af4de8640 1 --2- 172.21.15.2:0/1234249003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9af0103620 0x7f9af010bb00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8009900 tx=0x7f9ad802a480 comp rx=0 tx=0).stop 2024-09-19T06:14:57.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.827+0000 7f9af4de8640 1 -- 172.21.15.2:0/1234249003 shutdown_connections 2024-09-19T06:14:57.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.827+0000 7f9af4de8640 1 --2- 172.21.15.2:0/1234249003 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9af010c0d0 0x7f9af010e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.827+0000 7f9af4de8640 1 --2- 172.21.15.2:0/1234249003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9af0103620 0x7f9af010bb00 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.827+0000 7f9af4de8640 1 --2- 172.21.15.2:0/1234249003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9af0102d00 0x7f9af01030e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.827+0000 7f9af4de8640 1 -- 172.21.15.2:0/1234249003 >> 172.21.15.2:0/1234249003 conn(0x7f9af00779a0 msgr2=0x7f9af00fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:57.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.827+0000 7f9af4de8640 1 -- 172.21.15.2:0/1234249003 shutdown_connections 2024-09-19T06:14:57.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.827+0000 7f9af4de8640 1 -- 172.21.15.2:0/1234249003 wait complete. 2024-09-19T06:14:57.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.828+0000 7f9af4de8640 1 Processor -- start 2024-09-19T06:14:57.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.828+0000 7f9af4de8640 1 -- start start 2024-09-19T06:14:57.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.828+0000 7f9af4de8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9af0102d00 0x7f9af0198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:57.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.828+0000 7f9af4de8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9af0103620 0x7f9af0198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:57.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.828+0000 7f9af4de8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9af010c0d0 0x7f9af019cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:57.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.828+0000 7f9af4de8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9af0111da0 con 0x7f9af0102d00 2024-09-19T06:14:57.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.828+0000 7f9af4de8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9af0111c20 con 0x7f9af0103620 2024-09-19T06:14:57.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.828+0000 7f9af4de8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9af0111f20 con 0x7f9af010c0d0 2024-09-19T06:14:57.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.828+0000 7f9aee59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9af0102d00 0x7f9af0198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:57.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.828+0000 7f9aee59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9af0102d00 0x7f9af0198350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46158/0 (socket says 172.21.15.2:46158) 2024-09-19T06:14:57.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.828+0000 7f9aee59c640 1 -- 172.21.15.2:0/2152291920 learned_addr learned my addr 172.21.15.2:0/2152291920 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:57.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.828+0000 7f9aeed9d640 1 --2- 172.21.15.2:0/2152291920 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9af010c0d0 0x7f9af019cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:57.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.828+0000 7f9aedd9b640 1 --2- 172.21.15.2:0/2152291920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9af0103620 0x7f9af0198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:57.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.828+0000 7f9aee59c640 1 -- 172.21.15.2:0/2152291920 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9af010c0d0 msgr2=0x7f9af019cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:57.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.828+0000 7f9aee59c640 1 --2- 172.21.15.2:0/2152291920 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9af010c0d0 0x7f9af019cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.828+0000 7f9aee59c640 1 -- 172.21.15.2:0/2152291920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9af0103620 msgr2=0x7f9af0198890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:57.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.828+0000 7f9aee59c640 1 --2- 172.21.15.2:0/2152291920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9af0103620 0x7f9af0198890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.828+0000 7f9aee59c640 1 -- 172.21.15.2:0/2152291920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af019d340 con 0x7f9af0102d00 2024-09-19T06:14:57.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.828+0000 7f9aedd9b640 1 --2- 172.21.15.2:0/2152291920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9af0103620 0x7f9af0198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:14:57.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.828+0000 7f9aee59c640 1 --2- 172.21.15.2:0/2152291920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9af0102d00 0x7f9af0198350 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9ae000d950 tx=0x7f9ae000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:57.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.829+0000 7f9ae77fe640 1 -- 172.21.15.2:0/2152291920 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae0017030 con 0x7f9af0102d00 2024-09-19T06:14:57.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.829+0000 7f9ae77fe640 1 -- 172.21.15.2:0/2152291920 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9ae0004020 con 0x7f9af0102d00 2024-09-19T06:14:57.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.829+0000 7f9af4de8640 1 -- 172.21.15.2:0/2152291920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9af019d630 con 0x7f9af0102d00 2024-09-19T06:14:57.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.829+0000 7f9ae77fe640 1 -- 172.21.15.2:0/2152291920 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae00047a0 con 0x7f9af0102d00 2024-09-19T06:14:57.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.829+0000 7f9af4de8640 1 -- 172.21.15.2:0/2152291920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9af01a4ec0 con 0x7f9af0102d00 2024-09-19T06:14:57.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.830+0000 7f9af4de8640 1 -- 172.21.15.2:0/2152291920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9af006a260 con 0x7f9af0102d00 2024-09-19T06:14:57.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.831+0000 7f9ae77fe640 1 -- 172.21.15.2:0/2152291920 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138581+0+0 (secure 0 0 0) 0x7f9ae00041d0 con 0x7f9af0102d00 2024-09-19T06:14:57.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.831+0000 7f9ae77fe640 1 --2- 172.21.15.2:0/2152291920 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9adc0a3550 0x7f9adc0a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:57.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.832+0000 7f9aedd9b640 1 --2- 172.21.15.2:0/2152291920 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9adc0a3550 0x7f9adc0a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:57.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.832+0000 7f9ae77fe640 1 -- 172.21.15.2:0/2152291920 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f9ae00cf9f0 con 0x7f9af0102d00 2024-09-19T06:14:57.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.832+0000 7f9aedd9b640 1 --2- 172.21.15.2:0/2152291920 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9adc0a3550 0x7f9adc0a5a10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8005ab0 tx=0x7f9ad8000bc0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:57.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:57.836+0000 7f9ae77fe640 1 -- 172.21.15.2:0/2152291920 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9ae009c150 con 0x7f9af0102d00 2024-09-19T06:14:58.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.015+0000 7f9af4de8640 1 -- 172.21.15.2:0/2152291920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f9af0106b90 con 0x7f9af0102d00 2024-09-19T06:14:58.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.020+0000 7f9ae77fe640 1 -- 172.21.15.2:0/2152291920 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v30)=0 v30) ==== 133+0+0 (secure 0 0 0) 0x7f9ae009ba50 con 0x7f9af0102d00 2024-09-19T06:14:58.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.022+0000 7f9af4de8640 1 -- 172.21.15.2:0/2152291920 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9adc0a3550 msgr2=0x7f9adc0a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:58.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.022+0000 7f9af4de8640 1 --2- 172.21.15.2:0/2152291920 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9adc0a3550 0x7f9adc0a5a10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8005ab0 tx=0x7f9ad8000bc0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.022+0000 7f9af4de8640 1 -- 172.21.15.2:0/2152291920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9af0102d00 msgr2=0x7f9af0198350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:58.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.022+0000 7f9af4de8640 1 --2- 172.21.15.2:0/2152291920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9af0102d00 0x7f9af0198350 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9ae000d950 tx=0x7f9ae000de10 comp rx=0 tx=0).stop 2024-09-19T06:14:58.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.022+0000 7f9af4de8640 1 -- 172.21.15.2:0/2152291920 shutdown_connections 2024-09-19T06:14:58.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.022+0000 7f9af4de8640 1 --2- 172.21.15.2:0/2152291920 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9adc0a3550 0x7f9adc0a5a10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.022+0000 7f9af4de8640 1 --2- 172.21.15.2:0/2152291920 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9af010c0d0 0x7f9af019cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.022+0000 7f9af4de8640 1 --2- 172.21.15.2:0/2152291920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9af0103620 0x7f9af0198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.022+0000 7f9af4de8640 1 --2- 172.21.15.2:0/2152291920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9af0102d00 0x7f9af0198350 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.022+0000 7f9af4de8640 1 -- 172.21.15.2:0/2152291920 >> 172.21.15.2:0/2152291920 conn(0x7f9af00779a0 msgr2=0x7f9af00fd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:58.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.023+0000 7f9af4de8640 1 -- 172.21.15.2:0/2152291920 shutdown_connections 2024-09-19T06:14:58.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.023+0000 7f9af4de8640 1 -- 172.21.15.2:0/2152291920 wait complete. 2024-09-19T06:14:58.037 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-19T06:14:58.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.042+0000 7fda31a46640 1 -- 172.21.15.2:0/1300509693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda2c100940 msgr2=0x7fda2c100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:58.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.042+0000 7fda31a46640 1 --2- 172.21.15.2:0/1300509693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda2c100940 0x7fda2c100d20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fda1c009900 tx=0x7fda1c02a3f0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.042+0000 7fda31a46640 1 -- 172.21.15.2:0/1300509693 shutdown_connections 2024-09-19T06:14:58.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.042+0000 7fda31a46640 1 --2- 172.21.15.2:0/1300509693 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda2c10e4f0 0x7fda2c1108e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.042+0000 7fda31a46640 1 --2- 172.21.15.2:0/1300509693 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda2c1012f0 0x7fda2c10dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.042+0000 7fda31a46640 1 --2- 172.21.15.2:0/1300509693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda2c100940 0x7fda2c100d20 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.042+0000 7fda31a46640 1 -- 172.21.15.2:0/1300509693 >> 172.21.15.2:0/1300509693 conn(0x7fda2c0fc7d0 msgr2=0x7fda2c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:58.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.042+0000 7fda31a46640 1 -- 172.21.15.2:0/1300509693 shutdown_connections 2024-09-19T06:14:58.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.042+0000 7fda31a46640 1 -- 172.21.15.2:0/1300509693 wait complete. 2024-09-19T06:14:58.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.043+0000 7fda31a46640 1 Processor -- start 2024-09-19T06:14:58.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.043+0000 7fda31a46640 1 -- start start 2024-09-19T06:14:58.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.043+0000 7fda31a46640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda2c100940 0x7fda2c19a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:58.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.043+0000 7fda31a46640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda2c1012f0 0x7fda2c19aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:58.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.043+0000 7fda31a46640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda2c10e4f0 0x7fda2c19ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:58.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.043+0000 7fda31a46640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fda2c114050 con 0x7fda2c1012f0 2024-09-19T06:14:58.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.043+0000 7fda31a46640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fda2c113ed0 con 0x7fda2c100940 2024-09-19T06:14:58.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.043+0000 7fda31a46640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fda2c1141d0 con 0x7fda2c10e4f0 2024-09-19T06:14:58.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.043+0000 7fda2a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda2c1012f0 0x7fda2c19aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:58.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.043+0000 7fda2a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda2c1012f0 0x7fda2c19aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46178/0 (socket says 172.21.15.2:46178) 2024-09-19T06:14:58.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.043+0000 7fda2a7fc640 1 -- 172.21.15.2:0/3906277359 learned_addr learned my addr 172.21.15.2:0/3906277359 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:58.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.043+0000 7fda2affd640 1 --2- 172.21.15.2:0/3906277359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda2c100940 0x7fda2c19a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:58.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.043+0000 7fda2b7fe640 1 --2- 172.21.15.2:0/3906277359 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda2c10e4f0 0x7fda2c19ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:58.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.044+0000 7fda2a7fc640 1 -- 172.21.15.2:0/3906277359 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda2c10e4f0 msgr2=0x7fda2c19ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:58.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.044+0000 7fda2a7fc640 1 --2- 172.21.15.2:0/3906277359 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda2c10e4f0 0x7fda2c19ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.044+0000 7fda2a7fc640 1 -- 172.21.15.2:0/3906277359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda2c100940 msgr2=0x7fda2c19a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:58.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.044+0000 7fda2a7fc640 1 --2- 172.21.15.2:0/3906277359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda2c100940 0x7fda2c19a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.044+0000 7fda2a7fc640 1 -- 172.21.15.2:0/3906277359 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda2c19f540 con 0x7fda2c1012f0 2024-09-19T06:14:58.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.044+0000 7fda2a7fc640 1 --2- 172.21.15.2:0/3906277359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda2c1012f0 0x7fda2c19aad0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fda2000c970 tx=0x7fda2000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:58.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.044+0000 7fda30a44640 1 -- 172.21.15.2:0/3906277359 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda20007bb0 con 0x7fda2c1012f0 2024-09-19T06:14:58.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.044+0000 7fda30a44640 1 -- 172.21.15.2:0/3906277359 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fda20007d50 con 0x7fda2c1012f0 2024-09-19T06:14:58.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.044+0000 7fda31a46640 1 -- 172.21.15.2:0/3906277359 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda2c19f830 con 0x7fda2c1012f0 2024-09-19T06:14:58.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.044+0000 7fda30a44640 1 -- 172.21.15.2:0/3906277359 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2000f450 con 0x7fda2c1012f0 2024-09-19T06:14:58.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.044+0000 7fda31a46640 1 -- 172.21.15.2:0/3906277359 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda2c1a7110 con 0x7fda2c1012f0 2024-09-19T06:14:58.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.047+0000 7fda33e1f740 1 Processor -- start 2024-09-19T06:14:58.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.047+0000 7fda33e1f740 1 -- start start 2024-09-19T06:14:58.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.048+0000 7fda33e1f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619d8ea4b60 0x5619d8ea4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:58.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.048+0000 7fda33e1f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619d8ea5480 0x5619d8eaf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:58.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.048+0000 7fda33e1f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5619d8eafd40 0x5619d8eb2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:58.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.048+0000 7fda33e1f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5619d8e0a280 con 0x5619d8ea5480 2024-09-19T06:14:58.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.048+0000 7fda33e1f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5619d8db1b10 con 0x5619d8eafd40 2024-09-19T06:14:58.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.048+0000 7fda33e1f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5619d8e06240 con 0x5619d8ea4b60 2024-09-19T06:14:58.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.048+0000 7fda30a44640 1 -- 172.21.15.2:0/3906277359 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138581+0+0 (secure 0 0 0) 0x7fda20004f60 con 0x7fda2c1012f0 2024-09-19T06:14:58.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.048+0000 7fda2affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619d8ea5480 0x5619d8eaf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:58.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.048+0000 7fda2affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619d8ea5480 0x5619d8eaf800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46184/0 (socket says 172.21.15.2:46184) 2024-09-19T06:14:58.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.048+0000 7fda2affd640 1 -- 172.21.15.2:0/3484192012 learned_addr learned my addr 172.21.15.2:0/3484192012 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:58.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.048+0000 7fda2b7fe640 1 --2- 172.21.15.2:0/3484192012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619d8ea4b60 0x5619d8ea4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:58.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.048+0000 7fda2a7fc640 1 --2- 172.21.15.2:0/3484192012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5619d8eafd40 0x5619d8eb2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:58.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.048+0000 7fda2affd640 1 -- 172.21.15.2:0/3484192012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619d8ea4b60 msgr2=0x5619d8ea4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:58.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.048+0000 7fda2affd640 1 --2- 172.21.15.2:0/3484192012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619d8ea4b60 0x5619d8ea4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.048+0000 7fda2affd640 1 -- 172.21.15.2:0/3484192012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5619d8eafd40 msgr2=0x5619d8eb2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:58.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.048+0000 7fda2affd640 1 --2- 172.21.15.2:0/3484192012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5619d8eafd40 0x5619d8eb2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.048+0000 7fda2affd640 1 -- 172.21.15.2:0/3484192012 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619d8dbe1f0 con 0x5619d8ea5480 2024-09-19T06:14:58.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.048+0000 7fda2b7fe640 1 --2- 172.21.15.2:0/3484192012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619d8ea4b60 0x5619d8ea4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:58.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.049+0000 7fda2affd640 1 --2- 172.21.15.2:0/3484192012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619d8ea5480 0x5619d8eaf800 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fda1c009900 tx=0x7fda1c032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ec3cbd475fe0e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:58.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.049+0000 7fda11ffb640 1 -- 172.21.15.2:0/3484192012 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda1c040070 con 0x5619d8ea5480 2024-09-19T06:14:58.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.049+0000 7fda11ffb640 1 -- 172.21.15.2:0/3484192012 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fda1c0316a0 con 0x5619d8ea5480 2024-09-19T06:14:58.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.049+0000 7fda30a44640 1 --2- 172.21.15.2:0/3906277359 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fda140a34d0 0x7fda140a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:58.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.049+0000 7fda2b7fe640 1 --2- 172.21.15.2:0/3906277359 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fda140a34d0 0x7fda140a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:58.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.049+0000 7fda30a44640 1 -- 172.21.15.2:0/3906277359 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fda200cfc90 con 0x7fda2c1012f0 2024-09-19T06:14:58.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.049+0000 7fda11ffb640 1 -- 172.21.15.2:0/3484192012 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda1c035040 con 0x5619d8ea5480 2024-09-19T06:14:58.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.050+0000 7fda33e1f740 1 -- 172.21.15.2:0/3484192012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619d8ea5480 msgr2=0x5619d8eaf800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:58.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.050+0000 7fda33e1f740 1 --2- 172.21.15.2:0/3484192012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619d8ea5480 0x5619d8eaf800 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fda1c009900 tx=0x7fda1c032e40 comp rx=0 tx=0).stop 2024-09-19T06:14:58.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.050+0000 7fda2b7fe640 1 --2- 172.21.15.2:0/3906277359 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fda140a34d0 0x7fda140a5990 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fda2c102b20 tx=0x7fda24009600 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:58.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.050+0000 7fda33e1f740 1 -- 172.21.15.2:0/3484192012 shutdown_connections 2024-09-19T06:14:58.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.050+0000 7fda33e1f740 1 --2- 172.21.15.2:0/3484192012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5619d8eafd40 0x5619d8eb2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.050+0000 7fda33e1f740 1 --2- 172.21.15.2:0/3484192012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619d8ea5480 0x5619d8eaf800 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.050+0000 7fda33e1f740 1 --2- 172.21.15.2:0/3484192012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619d8ea4b60 0x5619d8ea4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.050+0000 7fda33e1f740 1 -- 172.21.15.2:0/3484192012 >> 172.21.15.2:0/3484192012 conn(0x5619d8ea10f0 msgr2=0x5619d8ea14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:58.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.050+0000 7fda33e1f740 1 -- 172.21.15.2:0/3484192012 shutdown_connections 2024-09-19T06:14:58.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.050+0000 7fda33e1f740 1 -- 172.21.15.2:0/3484192012 wait complete. 2024-09-19T06:14:58.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.050+0000 7fda33e1f740 1 -- start start 2024-09-19T06:14:58.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.051+0000 7fda33e1f740 1 Processor -- start 2024-09-19T06:14:58.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.051+0000 7fda33e1f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619d8ea4b60 0x5619d8eaf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:58.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.051+0000 7fda33e1f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619d8ea5480 0x5619d8eacb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:58.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.051+0000 7fda33e1f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5619d8eafd40 0x5619d8ead2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:58.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.051+0000 7fda33e1f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5619d8eb29b0 con 0x5619d8ea4b60 2024-09-19T06:14:58.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.051+0000 7fda33e1f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5619d8dc4f10 con 0x5619d8eafd40 2024-09-19T06:14:58.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.051+0000 7fda33e1f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5619d8eb2b30 con 0x5619d8ea5480 2024-09-19T06:14:58.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.051+0000 7fda33e1f740 10 client.0 _ll_register_callbacks cb 0x5619d8d8da40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:58.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.051+0000 7fda2affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619d8ea4b60 0x5619d8eaf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:58.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.051+0000 7fda2affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619d8ea4b60 0x5619d8eaf800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46188/0 (socket says 172.21.15.2:46188) 2024-09-19T06:14:58.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.051+0000 7fda2affd640 1 -- 172.21.15.2:0/1609232364 learned_addr learned my addr 172.21.15.2:0/1609232364 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:58.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.052+0000 7fda2a7fc640 1 --2- 172.21.15.2:0/1609232364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619d8ea5480 0x5619d8eacb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:58.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.052+0000 7fda2b7fe640 1 --2- 172.21.15.2:0/1609232364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5619d8eafd40 0x5619d8ead2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:58.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.052+0000 7fda2affd640 1 -- 172.21.15.2:0/1609232364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619d8ea5480 msgr2=0x5619d8eacb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:58.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.052+0000 7fda2affd640 1 --2- 172.21.15.2:0/1609232364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619d8ea5480 0x5619d8eacb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.052+0000 7fda2affd640 1 -- 172.21.15.2:0/1609232364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5619d8eafd40 msgr2=0x5619d8ead2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:58.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.052+0000 7fda2affd640 1 --2- 172.21.15.2:0/1609232364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5619d8eafd40 0x5619d8ead2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.052+0000 7fda2affd640 1 -- 172.21.15.2:0/1609232364 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619d8b7b6a0 con 0x5619d8ea4b60 2024-09-19T06:14:58.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.052+0000 7fda2b7fe640 1 --2- 172.21.15.2:0/1609232364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5619d8eafd40 0x5619d8ead2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:14:58.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.052+0000 7fda2affd640 1 --2- 172.21.15.2:0/1609232364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619d8ea4b60 0x5619d8eaf800 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fda1c032fd0 tx=0x7fda1c031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bc407461663ee7c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:58.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.052+0000 7fda0affd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:14:58.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.052+0000 7fda0affd640 1 -- 172.21.15.2:0/1609232364 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda1c035070 con 0x5619d8ea4b60 2024-09-19T06:14:58.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.052+0000 7fda0affd640 1 -- 172.21.15.2:0/1609232364 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fda1c031cf0 con 0x5619d8ea4b60 2024-09-19T06:14:58.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.052+0000 7fda33e1f740 1 -- 172.21.15.2:0/1609232364 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda1c0316a0 con 0x5619d8ea4b60 2024-09-19T06:14:58.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.053+0000 7fda0affd640 1 -- 172.21.15.2:0/1609232364 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fda1c055050 con 0x5619d8ea4b60 2024-09-19T06:14:58.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.053+0000 7fda33e1f740 10 client.15303 fetch_fsmap learned FSMap version 26 2024-09-19T06:14:58.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.053+0000 7fda33e1f740 1 -- 172.21.15.2:0/1609232364 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5619d8ec6d40 con 0x5619d8ea4b60 2024-09-19T06:14:58.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.053+0000 7fda0affd640 1 -- 172.21.15.2:0/1609232364 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fda1c04c070 con 0x5619d8ea4b60 2024-09-19T06:14:58.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.053+0000 7fda0affd640 1 -- 172.21.15.2:0/1609232364 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fda1c03c440 con 0x5619d8ea4b60 2024-09-19T06:14:58.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.053+0000 7fda33e1f740 10 client.15303 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:14:58.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.053+0000 7fda33e1f740 10 client.15303 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:14:58.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.053+0000 7fda33e1f740 20 client.15303 populate_metadata read hostname 'smithi002' 2024-09-19T06:14:58.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.053+0000 7fda33e1f740 1 --2- 172.21.15.2:0/1609232364 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5619d8ec8090 0x5619d8eca480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:58.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.053+0000 7fda33e1f740 4 client.15303 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:14:58.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.053+0000 7fda33e1f740 1 -- 172.21.15.2:0/1609232364 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fda1c0316a0 con 0x5619d8ec8090 2024-09-19T06:14:58.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.054+0000 7fda2a7fc640 1 --2- 172.21.15.2:0/1609232364 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5619d8ec8090 0x5619d8eca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:58.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.054+0000 7fda0affd640 10 client.15303 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:14:58.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.054+0000 7fda2a7fc640 1 --2- 172.21.15.2:0/1609232364 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5619d8ec8090 0x5619d8eca480 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d5cfb17d15e9f2e server_cookie=f6287ad2de9148a0 in_seq=0 out_seq=0 2024-09-19T06:14:58.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.055+0000 7fda0affd640 1 -- 172.21.15.2:0/1609232364 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fda1c0316a0 con 0x5619d8ec8090 2024-09-19T06:14:58.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.055+0000 7fda0affd640 10 client.15303 handle_command_reply: tid=0 2024-09-19T06:14:58.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.055+0000 7fda33e1f740 1 client.15303 shutdown 2024-09-19T06:14:58.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.055+0000 7fda33e1f740 1 -- 172.21.15.2:0/1609232364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619d8ea4b60 msgr2=0x5619d8eaf800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:58.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.055+0000 7fda33e1f740 1 --2- 172.21.15.2:0/1609232364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619d8ea4b60 0x5619d8eaf800 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fda1c032fd0 tx=0x7fda1c031400 comp rx=0 tx=0).stop 2024-09-19T06:14:58.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.055+0000 7fda33e1f740 1 -- 172.21.15.2:0/1609232364 shutdown_connections 2024-09-19T06:14:58.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.055+0000 7fda33e1f740 1 --2- 172.21.15.2:0/1609232364 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5619d8ec8090 0x5619d8eca480 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.055+0000 7fda33e1f740 1 --2- 172.21.15.2:0/1609232364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5619d8eafd40 0x5619d8ead2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.055+0000 7fda33e1f740 1 --2- 172.21.15.2:0/1609232364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619d8ea5480 0x5619d8eacb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.055+0000 7fda33e1f740 1 --2- 172.21.15.2:0/1609232364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619d8ea4b60 0x5619d8eaf800 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.055+0000 7fda0affd640 0 client.15303 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:14:58.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.055+0000 7fda33e1f740 1 -- 172.21.15.2:0/1609232364 >> 172.21.15.2:0/1609232364 conn(0x5619d8ea10f0 msgr2=0x5619d8ea0270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:58.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.056+0000 7fda33e1f740 1 -- 172.21.15.2:0/1609232364 shutdown_connections 2024-09-19T06:14:58.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.056+0000 7fda33e1f740 1 -- 172.21.15.2:0/1609232364 wait complete. 2024-09-19T06:14:58.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.056+0000 7fda33e1f740 20 client.15303 trim_cache size 0 max 16384 2024-09-19T06:14:58.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.079+0000 7fda33e1f740 1 Processor -- start 2024-09-19T06:14:58.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.079+0000 7fda33e1f740 1 -- start start 2024-09-19T06:14:58.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.079+0000 7fda33e1f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619d8ea4b60 0x5619d8ea75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:58.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.079+0000 7fda33e1f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619d8ea5480 0x5619d8ecd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:58.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.079+0000 7fda33e1f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5619d8eafd40 0x5619d8ecd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:58.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.079+0000 7fda33e1f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fda2c1ade30 con 0x5619d8ea5480 2024-09-19T06:14:58.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.079+0000 7fda33e1f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fda2c1ab700 con 0x5619d8eafd40 2024-09-19T06:14:58.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.079+0000 7fda33e1f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fda2c1a9550 con 0x5619d8ea4b60 2024-09-19T06:14:58.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.080+0000 7fda2a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619d8ea5480 0x5619d8ecd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:58.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.080+0000 7fda2a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619d8ea5480 0x5619d8ecd4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46194/0 (socket says 172.21.15.2:46194) 2024-09-19T06:14:58.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.080+0000 7fda2a7fc640 1 -- 172.21.15.2:0/2857960940 learned_addr learned my addr 172.21.15.2:0/2857960940 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:58.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.080+0000 7fda2affd640 1 --2- 172.21.15.2:0/2857960940 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619d8ea4b60 0x5619d8ea75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:58.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.080+0000 7fda2b7fe640 1 --2- 172.21.15.2:0/2857960940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5619d8eafd40 0x5619d8ecd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:58.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.080+0000 7fda2a7fc640 1 -- 172.21.15.2:0/2857960940 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619d8ea4b60 msgr2=0x5619d8ea75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:58.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.080+0000 7fda2a7fc640 1 --2- 172.21.15.2:0/2857960940 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619d8ea4b60 0x5619d8ea75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.080+0000 7fda2a7fc640 1 -- 172.21.15.2:0/2857960940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5619d8eafd40 msgr2=0x5619d8ecd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:58.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.080+0000 7fda2a7fc640 1 --2- 172.21.15.2:0/2857960940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5619d8eafd40 0x5619d8ecd9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.080+0000 7fda2a7fc640 1 -- 172.21.15.2:0/2857960940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619d8ea0b90 con 0x5619d8ea5480 2024-09-19T06:14:58.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.080+0000 7fda2a7fc640 1 --2- 172.21.15.2:0/2857960940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619d8ea5480 0x5619d8ecd4a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fda2009bb00 tx=0x7fda200d34b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=941a49a1c349924a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:58.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.080+0000 7fda117fa640 1 -- 172.21.15.2:0/2857960940 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2001d040 con 0x5619d8ea5480 2024-09-19T06:14:58.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.081+0000 7fda117fa640 1 -- 172.21.15.2:0/2857960940 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fda200a0100 con 0x5619d8ea5480 2024-09-19T06:14:58.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.081+0000 7fda117fa640 1 -- 172.21.15.2:0/2857960940 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda200a4530 con 0x5619d8ea5480 2024-09-19T06:14:58.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.081+0000 7fda33e1f740 1 -- 172.21.15.2:0/2857960940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619d8ea5480 msgr2=0x5619d8ecd4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:58.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.081+0000 7fda33e1f740 1 --2- 172.21.15.2:0/2857960940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619d8ea5480 0x5619d8ecd4a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fda2009bb00 tx=0x7fda200d34b0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.081+0000 7fda33e1f740 1 -- 172.21.15.2:0/2857960940 shutdown_connections 2024-09-19T06:14:58.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.081+0000 7fda33e1f740 1 --2- 172.21.15.2:0/2857960940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5619d8eafd40 0x5619d8ecd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.081+0000 7fda33e1f740 1 --2- 172.21.15.2:0/2857960940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619d8ea5480 0x5619d8ecd4a0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.081+0000 7fda33e1f740 1 --2- 172.21.15.2:0/2857960940 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619d8ea4b60 0x5619d8ea75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.081+0000 7fda33e1f740 1 -- 172.21.15.2:0/2857960940 >> 172.21.15.2:0/2857960940 conn(0x5619d8ea10f0 msgr2=0x5619d8eabc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:58.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.081+0000 7fda33e1f740 1 -- 172.21.15.2:0/2857960940 shutdown_connections 2024-09-19T06:14:58.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.082+0000 7fda33e1f740 1 -- 172.21.15.2:0/2857960940 wait complete. 2024-09-19T06:14:58.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.082+0000 7fda33e1f740 1 -- start start 2024-09-19T06:14:58.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.082+0000 7fda33e1f740 1 Processor -- start 2024-09-19T06:14:58.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.083+0000 7fda33e1f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619d8ea4b60 0x5619d8ecbad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:58.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.083+0000 7fda33e1f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5619d8ea5480 0x5619d8ecc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:58.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.083+0000 7fda33e1f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619d8eafd40 0x5619d8f2ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:58.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.083+0000 7fda33e1f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fda2c1a9bc0 con 0x5619d8ea4b60 2024-09-19T06:14:58.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.083+0000 7fda2affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619d8ea4b60 0x5619d8ecbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:58.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.083+0000 7fda33e1f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fda2c1ab030 con 0x5619d8ea5480 2024-09-19T06:14:58.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.083+0000 7fda33e1f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fda2c1aa290 con 0x5619d8eafd40 2024-09-19T06:14:58.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.083+0000 7fda2affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619d8ea4b60 0x5619d8ecbad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46200/0 (socket says 172.21.15.2:46200) 2024-09-19T06:14:58.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.083+0000 7fda2affd640 1 -- 172.21.15.2:0/3961414665 learned_addr learned my addr 172.21.15.2:0/3961414665 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:58.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.083+0000 7fda2b7fe640 1 --2- 172.21.15.2:0/3961414665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619d8eafd40 0x5619d8f2ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:58.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.083+0000 7fda2a7fc640 1 --2- 172.21.15.2:0/3961414665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5619d8ea5480 0x5619d8ecc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:58.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.083+0000 7fda33e1f740 10 client.0 _ll_register_callbacks cb 0x7fda24009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:58.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.083+0000 7fda2affd640 1 -- 172.21.15.2:0/3961414665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619d8eafd40 msgr2=0x5619d8f2ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:58.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.083+0000 7fda2affd640 1 --2- 172.21.15.2:0/3961414665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619d8eafd40 0x5619d8f2ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.083+0000 7fda2affd640 1 -- 172.21.15.2:0/3961414665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5619d8ea5480 msgr2=0x5619d8ecc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:58.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.083+0000 7fda2affd640 1 --2- 172.21.15.2:0/3961414665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5619d8ea5480 0x5619d8ecc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.083+0000 7fda2affd640 1 -- 172.21.15.2:0/3961414665 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619d8f2c000 con 0x5619d8ea4b60 2024-09-19T06:14:58.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.084+0000 7fda2a7fc640 1 --2- 172.21.15.2:0/3961414665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5619d8ea5480 0x5619d8ecc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:14:58.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.084+0000 7fda33e1f740 1 -- 172.21.15.2:0/3961414665 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda200a0100 con 0x5619d8ea4b60 2024-09-19T06:14:58.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.084+0000 7fda2affd640 1 --2- 172.21.15.2:0/3961414665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619d8ea4b60 0x5619d8ecbad0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fda1c0096c0 tx=0x7fda1c032d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed56c3e301558e34 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:58.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.084+0000 7fda0affd640 10 client.15309 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:14:58.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.084+0000 7fda0affd640 1 -- 172.21.15.2:0/3961414665 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda1c05e060 con 0x5619d8ea4b60 2024-09-19T06:14:58.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.084+0000 7fda0affd640 1 -- 172.21.15.2:0/3961414665 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fda1c03ca30 con 0x5619d8ea4b60 2024-09-19T06:14:58.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.084+0000 7fda0affd640 1 -- 172.21.15.2:0/3961414665 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fda1c035070 con 0x5619d8ea4b60 2024-09-19T06:14:58.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.084+0000 7fda33e1f740 10 client.15309 fetch_fsmap learned FSMap version 26 2024-09-19T06:14:58.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.084+0000 7fda33e1f740 1 -- 172.21.15.2:0/3961414665 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({fsmap=26}) -- 0x5619d8f332a0 con 0x5619d8ea4b60 2024-09-19T06:14:58.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.085+0000 7fda0affd640 1 -- 172.21.15.2:0/3961414665 <== mon.0 v2:172.21.15.2:3300/0 4 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fda1c03ccb0 con 0x5619d8ea4b60 2024-09-19T06:14:58.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.085+0000 7fda33e1f740 10 client.15309 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:14:58.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.085+0000 7fda33e1f740 10 client.15309 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:14:58.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.085+0000 7fda33e1f740 20 client.15309 populate_metadata read hostname 'smithi002' 2024-09-19T06:14:58.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.085+0000 7fda33e1f740 1 --2- 172.21.15.2:0/3961414665 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5619d8f338b0 0x5619d8f35cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:58.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.085+0000 7fda33e1f740 4 client.15309 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:14:58.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.085+0000 7fda33e1f740 1 -- 172.21.15.2:0/3961414665 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5619d8e177f0 con 0x5619d8f338b0 2024-09-19T06:14:58.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.085+0000 7fda2a7fc640 1 --2- 172.21.15.2:0/3961414665 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5619d8f338b0 0x5619d8f35cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:58.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.085+0000 7fda2a7fc640 1 --2- 172.21.15.2:0/3961414665 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5619d8f338b0 0x5619d8f35cf0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98fa5c155580072d server_cookie=159cadeeec4bebe8 in_seq=0 out_seq=0 2024-09-19T06:14:58.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.085+0000 7fda0affd640 10 client.15309 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:14:58.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.087+0000 7fda0affd640 1 -- 172.21.15.2:0/3961414665 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5619d8e177f0 con 0x5619d8f338b0 2024-09-19T06:14:58.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.087+0000 7fda0affd640 10 client.15309 handle_command_reply: tid=0 2024-09-19T06:14:58.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.087+0000 7fda33e1f740 1 client.15309 shutdown 2024-09-19T06:14:58.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.087+0000 7fda33e1f740 1 -- 172.21.15.2:0/3961414665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619d8ea4b60 msgr2=0x5619d8ecbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:58.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.087+0000 7fda33e1f740 1 --2- 172.21.15.2:0/3961414665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619d8ea4b60 0x5619d8ecbad0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fda1c0096c0 tx=0x7fda1c032d20 comp rx=0 tx=0).stop 2024-09-19T06:14:58.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.087+0000 7fda33e1f740 1 -- 172.21.15.2:0/3961414665 shutdown_connections 2024-09-19T06:14:58.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.087+0000 7fda33e1f740 1 --2- 172.21.15.2:0/3961414665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5619d8eafd40 0x5619d8f2ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.087+0000 7fda33e1f740 1 --2- 172.21.15.2:0/3961414665 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5619d8f338b0 0x5619d8f35cf0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.087+0000 7fda33e1f740 1 --2- 172.21.15.2:0/3961414665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5619d8ea5480 0x5619d8ecc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.087+0000 7fda33e1f740 1 --2- 172.21.15.2:0/3961414665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5619d8ea4b60 0x5619d8ecbad0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.087+0000 7fda33e1f740 1 -- 172.21.15.2:0/3961414665 >> 172.21.15.2:0/3961414665 conn(0x5619d8ea10f0 msgr2=0x5619d8e9fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:58.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.087+0000 7fda0affd640 0 client.15309 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:14:58.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.087+0000 7fda33e1f740 1 -- 172.21.15.2:0/3961414665 shutdown_connections 2024-09-19T06:14:58.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.087+0000 7fda33e1f740 1 -- 172.21.15.2:0/3961414665 wait complete. 2024-09-19T06:14:58.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.087+0000 7fda33e1f740 20 client.15309 trim_cache size 0 max 16384 2024-09-19T06:14:58.093 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:14:58.093 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T06:14:58.093 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "1502ec3f-65c6-4c54-bb6d-030b8199073b", 2024-09-19T06:14:58.093 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T06:14:58.093 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:14:58.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.088+0000 7fda31a46640 1 -- 172.21.15.2:0/3906277359 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fda140a34d0 msgr2=0x7fda140a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:58.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.088+0000 7fda31a46640 1 --2- 172.21.15.2:0/3906277359 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fda140a34d0 0x7fda140a5990 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fda2c102b20 tx=0x7fda24009600 comp rx=0 tx=0).stop 2024-09-19T06:14:58.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.088+0000 7fda31a46640 1 -- 172.21.15.2:0/3906277359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda2c1012f0 msgr2=0x7fda2c19aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:58.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.088+0000 7fda31a46640 1 --2- 172.21.15.2:0/3906277359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda2c1012f0 0x7fda2c19aad0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fda2000c970 tx=0x7fda2000ce30 comp rx=0 tx=0).stop 2024-09-19T06:14:58.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.088+0000 7fda31a46640 1 -- 172.21.15.2:0/3906277359 shutdown_connections 2024-09-19T06:14:58.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.088+0000 7fda31a46640 1 --2- 172.21.15.2:0/3906277359 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fda140a34d0 0x7fda140a5990 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.088+0000 7fda31a46640 1 --2- 172.21.15.2:0/3906277359 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda2c10e4f0 0x7fda2c19ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.088+0000 7fda31a46640 1 --2- 172.21.15.2:0/3906277359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda2c1012f0 0x7fda2c19aad0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.088+0000 7fda31a46640 1 --2- 172.21.15.2:0/3906277359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda2c100940 0x7fda2c19a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.088+0000 7fda31a46640 1 -- 172.21.15.2:0/3906277359 >> 172.21.15.2:0/3906277359 conn(0x7fda2c0fc7d0 msgr2=0x7fda2c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:58.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.088+0000 7fda31a46640 1 -- 172.21.15.2:0/3906277359 shutdown_connections 2024-09-19T06:14:58.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.088+0000 7fda31a46640 1 -- 172.21.15.2:0/3906277359 wait complete. 2024-09-19T06:14:58.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.154+0000 7f9d2a880640 1 -- 172.21.15.2:0/1497021324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d24107ad0 msgr2=0x7f9d24107eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:58.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.154+0000 7f9d2a880640 1 --2- 172.21.15.2:0/1497021324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d24107ad0 0x7f9d24107eb0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9d14009930 tx=0x7f9d1402a420 comp rx=0 tx=0).stop 2024-09-19T06:14:58.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.154+0000 7f9d2a880640 1 -- 172.21.15.2:0/1497021324 shutdown_connections 2024-09-19T06:14:58.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.154+0000 7f9d2a880640 1 --2- 172.21.15.2:0/1497021324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d24102460 0x7f9d2410e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.154+0000 7f9d2a880640 1 --2- 172.21.15.2:0/1497021324 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d24101ac0 0x7f9d24101f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.154+0000 7f9d2a880640 1 --2- 172.21.15.2:0/1497021324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d24107ad0 0x7f9d24107eb0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.154+0000 7f9d2a880640 1 -- 172.21.15.2:0/1497021324 >> 172.21.15.2:0/1497021324 conn(0x7f9d240fd7a0 msgr2=0x7f9d240ffbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:58.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.154+0000 7f9d2a880640 1 -- 172.21.15.2:0/1497021324 shutdown_connections 2024-09-19T06:14:58.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.154+0000 7f9d2a880640 1 -- 172.21.15.2:0/1497021324 wait complete. 2024-09-19T06:14:58.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.154+0000 7f9d2a880640 1 Processor -- start 2024-09-19T06:14:58.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.155+0000 7f9d2a880640 1 -- start start 2024-09-19T06:14:58.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.155+0000 7f9d2a880640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d24101ac0 0x7f9d24198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:58.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.155+0000 7f9d2a880640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d24102460 0x7f9d241988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:58.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.155+0000 7f9d2a880640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d24107ad0 0x7f9d2419cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:58.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.155+0000 7f9d2a880640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9d24111dc0 con 0x7f9d24102460 2024-09-19T06:14:58.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.155+0000 7f9d2a880640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9d24111c40 con 0x7f9d24107ad0 2024-09-19T06:14:58.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.155+0000 7f9d2a880640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9d24111f40 con 0x7f9d24101ac0 2024-09-19T06:14:58.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.155+0000 7f9d237fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d24102460 0x7f9d241988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:58.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.155+0000 7f9d237fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d24102460 0x7f9d241988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46214/0 (socket says 172.21.15.2:46214) 2024-09-19T06:14:58.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.155+0000 7f9d237fe640 1 -- 172.21.15.2:0/639524940 learned_addr learned my addr 172.21.15.2:0/639524940 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:58.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.155+0000 7f9d23fff640 1 --2- 172.21.15.2:0/639524940 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d24101ac0 0x7f9d24198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:58.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.155+0000 7f9d28e1d640 1 --2- 172.21.15.2:0/639524940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d24107ad0 0x7f9d2419cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:58.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.155+0000 7f9d237fe640 1 -- 172.21.15.2:0/639524940 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d24101ac0 msgr2=0x7f9d24198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:58.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.155+0000 7f9d237fe640 1 --2- 172.21.15.2:0/639524940 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d24101ac0 0x7f9d24198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.155+0000 7f9d237fe640 1 -- 172.21.15.2:0/639524940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d24107ad0 msgr2=0x7f9d2419cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:58.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.155+0000 7f9d237fe640 1 --2- 172.21.15.2:0/639524940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d24107ad0 0x7f9d2419cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.155+0000 7f9d237fe640 1 -- 172.21.15.2:0/639524940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d2419d360 con 0x7f9d24102460 2024-09-19T06:14:58.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.156+0000 7f9d237fe640 1 --2- 172.21.15.2:0/639524940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d24102460 0x7f9d241988b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9d1800d950 tx=0x7f9d1800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:58.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.156+0000 7f9d217fa640 1 -- 172.21.15.2:0/639524940 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d18017070 con 0x7f9d24102460 2024-09-19T06:14:58.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.156+0000 7f9d217fa640 1 -- 172.21.15.2:0/639524940 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9d18009c30 con 0x7f9d24102460 2024-09-19T06:14:58.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.156+0000 7f9d217fa640 1 -- 172.21.15.2:0/639524940 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1800f620 con 0x7f9d24102460 2024-09-19T06:14:58.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.156+0000 7f9d2a880640 1 -- 172.21.15.2:0/639524940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d2419d650 con 0x7f9d24102460 2024-09-19T06:14:58.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.156+0000 7f9d2a880640 1 -- 172.21.15.2:0/639524940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d241a4ee0 con 0x7f9d24102460 2024-09-19T06:14:58.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.157+0000 7f9d2a880640 1 -- 172.21.15.2:0/639524940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d24101f20 con 0x7f9d24102460 2024-09-19T06:14:58.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.158+0000 7f9d217fa640 1 -- 172.21.15.2:0/639524940 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138581+0+0 (secure 0 0 0) 0x7f9d180109a0 con 0x7f9d24102460 2024-09-19T06:14:58.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.159+0000 7f9d217fa640 1 --2- 172.21.15.2:0/639524940 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9d0c0a34d0 0x7f9d0c0a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:58.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.159+0000 7f9d23fff640 1 --2- 172.21.15.2:0/639524940 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9d0c0a34d0 0x7f9d0c0a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:58.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.159+0000 7f9d217fa640 1 -- 172.21.15.2:0/639524940 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f9d180cfb80 con 0x7f9d24102460 2024-09-19T06:14:58.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.159+0000 7f9d23fff640 1 --2- 172.21.15.2:0/639524940 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9d0c0a34d0 0x7f9d0c0a5990 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9d14009900 tx=0x7f9d14000bc0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:58.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.163+0000 7f9d217fa640 1 -- 172.21.15.2:0/639524940 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9d18009de0 con 0x7f9d24102460 2024-09-19T06:14:58.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.365+0000 7f9d2a880640 1 -- 172.21.15.2:0/639524940 --> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f9d24062630 con 0x7f9d0c0a34d0 2024-09-19T06:14:58.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.433+0000 7f9d217fa640 1 -- 172.21.15.2:0/639524940 <== mgr.15144 v2:172.21.15.2:6800/1594569191 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f9d24062630 con 0x7f9d0c0a34d0 2024-09-19T06:14:58.434 INFO:teuthology.orchestra.run.smithi002.stdout:Schedule set for path / 2024-09-19T06:14:58.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.435+0000 7f9d2a880640 1 -- 172.21.15.2:0/639524940 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9d0c0a34d0 msgr2=0x7f9d0c0a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:58.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.435+0000 7f9d2a880640 1 --2- 172.21.15.2:0/639524940 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9d0c0a34d0 0x7f9d0c0a5990 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9d14009900 tx=0x7f9d14000bc0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.435+0000 7f9d2a880640 1 -- 172.21.15.2:0/639524940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d24102460 msgr2=0x7f9d241988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:58.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.435+0000 7f9d2a880640 1 --2- 172.21.15.2:0/639524940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d24102460 0x7f9d241988b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9d1800d950 tx=0x7f9d1800de10 comp rx=0 tx=0).stop 2024-09-19T06:14:58.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.435+0000 7f9d2a880640 1 -- 172.21.15.2:0/639524940 shutdown_connections 2024-09-19T06:14:58.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.435+0000 7f9d2a880640 1 --2- 172.21.15.2:0/639524940 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9d0c0a34d0 0x7f9d0c0a5990 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.435+0000 7f9d2a880640 1 --2- 172.21.15.2:0/639524940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d24107ad0 0x7f9d2419cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.435+0000 7f9d2a880640 1 --2- 172.21.15.2:0/639524940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d24102460 0x7f9d241988b0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.435+0000 7f9d2a880640 1 --2- 172.21.15.2:0/639524940 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d24101ac0 0x7f9d24198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.435+0000 7f9d2a880640 1 -- 172.21.15.2:0/639524940 >> 172.21.15.2:0/639524940 conn(0x7f9d240fd7a0 msgr2=0x7f9d240ff250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:58.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.435+0000 7f9d2a880640 1 -- 172.21.15.2:0/639524940 shutdown_connections 2024-09-19T06:14:58.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.435+0000 7f9d2a880640 1 -- 172.21.15.2:0/639524940 wait complete. 2024-09-19T06:14:58.447 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-19T06:14:58.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.593+0000 7fee77531640 1 -- 172.21.15.2:0/1523885116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee70101340 msgr2=0x7fee7010d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:58.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.593+0000 7fee77531640 1 --2- 172.21.15.2:0/1523885116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee70101340 0x7fee7010d870 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fee68009cd0 tx=0x7fee6802a8e0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.593+0000 7fee77531640 1 -- 172.21.15.2:0/1523885116 shutdown_connections 2024-09-19T06:14:58.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.593+0000 7fee77531640 1 --2- 172.21.15.2:0/1523885116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee70101340 0x7fee7010d870 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.593+0000 7fee77531640 1 --2- 172.21.15.2:0/1523885116 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee701009a0 0x7fee70100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.593+0000 7fee77531640 1 --2- 172.21.15.2:0/1523885116 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee701069b0 0x7fee70106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.593+0000 7fee77531640 1 -- 172.21.15.2:0/1523885116 >> 172.21.15.2:0/1523885116 conn(0x7fee700779a0 msgr2=0x7fee700fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:58.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.593+0000 7fee77531640 1 -- 172.21.15.2:0/1523885116 shutdown_connections 2024-09-19T06:14:58.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.593+0000 7fee77531640 1 -- 172.21.15.2:0/1523885116 wait complete. 2024-09-19T06:14:58.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.593+0000 7fee77531640 1 Processor -- start 2024-09-19T06:14:58.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.593+0000 7fee77531640 1 -- start start 2024-09-19T06:14:58.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.594+0000 7fee77531640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee701009a0 0x7fee7019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:58.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.594+0000 7fee77531640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee70101340 0x7fee7019aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:58.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.594+0000 7fee77531640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee701069b0 0x7fee7019eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:58.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.594+0000 7fee77531640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fee70110cf0 con 0x7fee701009a0 2024-09-19T06:14:58.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.594+0000 7fee77531640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fee70110b70 con 0x7fee70101340 2024-09-19T06:14:58.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.594+0000 7fee77531640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fee70110e70 con 0x7fee701069b0 2024-09-19T06:14:58.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.594+0000 7fee752cd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee701009a0 0x7fee7019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:58.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.594+0000 7fee752cd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee701009a0 0x7fee7019a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46236/0 (socket says 172.21.15.2:46236) 2024-09-19T06:14:58.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.594+0000 7fee752cd640 1 -- 172.21.15.2:0/1041360078 learned_addr learned my addr 172.21.15.2:0/1041360078 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:58.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.594+0000 7fee74acc640 1 --2- 172.21.15.2:0/1041360078 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee70101340 0x7fee7019aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:58.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.594+0000 7fee75ace640 1 --2- 172.21.15.2:0/1041360078 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee701069b0 0x7fee7019eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:58.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.594+0000 7fee752cd640 1 -- 172.21.15.2:0/1041360078 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee701069b0 msgr2=0x7fee7019eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:58.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.594+0000 7fee752cd640 1 --2- 172.21.15.2:0/1041360078 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee701069b0 0x7fee7019eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.594+0000 7fee752cd640 1 -- 172.21.15.2:0/1041360078 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee70101340 msgr2=0x7fee7019aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:58.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.594+0000 7fee752cd640 1 --2- 172.21.15.2:0/1041360078 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee70101340 0x7fee7019aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.594+0000 7fee752cd640 1 -- 172.21.15.2:0/1041360078 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee7019f4d0 con 0x7fee701009a0 2024-09-19T06:14:58.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.594+0000 7fee75ace640 1 --2- 172.21.15.2:0/1041360078 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee701069b0 0x7fee7019eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:14:58.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.594+0000 7fee752cd640 1 --2- 172.21.15.2:0/1041360078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee701009a0 0x7fee7019a4e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fee6c00c890 tx=0x7fee6c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:58.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.594+0000 7fee667fc640 1 -- 172.21.15.2:0/1041360078 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee6c004220 con 0x7fee701009a0 2024-09-19T06:14:58.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.594+0000 7fee667fc640 1 -- 172.21.15.2:0/1041360078 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fee6c0043c0 con 0x7fee701009a0 2024-09-19T06:14:58.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.594+0000 7fee77531640 1 -- 172.21.15.2:0/1041360078 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee7019f7c0 con 0x7fee701009a0 2024-09-19T06:14:58.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.594+0000 7fee667fc640 1 -- 172.21.15.2:0/1041360078 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee6c004a00 con 0x7fee701009a0 2024-09-19T06:14:58.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.594+0000 7fee77531640 1 -- 172.21.15.2:0/1041360078 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee701a7050 con 0x7fee701009a0 2024-09-19T06:14:58.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.595+0000 7fee77531640 1 -- 172.21.15.2:0/1041360078 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee701020e0 con 0x7fee701009a0 2024-09-19T06:14:58.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.597+0000 7fee667fc640 1 -- 172.21.15.2:0/1041360078 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138581+0+0 (secure 0 0 0) 0x7fee6c004ba0 con 0x7fee701009a0 2024-09-19T06:14:58.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.597+0000 7fee667fc640 1 --2- 172.21.15.2:0/1041360078 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fee5c0a34d0 0x7fee5c0a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:58.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.598+0000 7fee74acc640 1 --2- 172.21.15.2:0/1041360078 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fee5c0a34d0 0x7fee5c0a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:58.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.598+0000 7fee667fc640 1 -- 172.21.15.2:0/1041360078 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fee6c0d0010 con 0x7fee701009a0 2024-09-19T06:14:58.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.598+0000 7fee74acc640 1 --2- 172.21.15.2:0/1041360078 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fee5c0a34d0 0x7fee5c0a5990 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fee70105470 tx=0x7fee6000b390 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:58.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.601+0000 7fee667fc640 1 -- 172.21.15.2:0/1041360078 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fee6c014030 con 0x7fee701009a0 2024-09-19T06:14:58.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:58 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/3941870317' entity='client.admin' 2024-09-19T06:14:58.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:58 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:14:58.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:58 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:14:58.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:58 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:14:58.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:58 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:58.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:58 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/2203460921' entity='client.admin' 2024-09-19T06:14:58.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:58 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:14:58.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:58 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:14:58.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:58 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:14:58.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:58 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:58.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:58 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/2152291920' entity='client.admin' 2024-09-19T06:14:58.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:58 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:14:58.724 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:58 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:14:58.724 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:58 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:14:58.724 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:58 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:58.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:58 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/3941870317' entity='client.admin' 2024-09-19T06:14:58.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:58 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:14:58.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:58 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:14:58.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:58 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:14:58.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:58 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:58.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:58 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/2203460921' entity='client.admin' 2024-09-19T06:14:58.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:58 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:14:58.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:58 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:14:58.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:58 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:14:58.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:58 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:58.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:58 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/2152291920' entity='client.admin' 2024-09-19T06:14:58.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:58 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:14:58.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:58 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:14:58.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:58 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:14:58.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:58 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:58.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:58 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/3941870317' entity='client.admin' 2024-09-19T06:14:58.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:58 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:14:58.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:58 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:14:58.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:58 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:14:58.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:58 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:58.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:58 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/2203460921' entity='client.admin' 2024-09-19T06:14:58.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:58 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:14:58.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:58 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:14:58.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:58 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:14:58.794 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:58 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:58.794 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:58 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/2152291920' entity='client.admin' 2024-09-19T06:14:58.794 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:58 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:14:58.794 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:58 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:14:58.794 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:58 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:14:58.794 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:58 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:14:58.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.800+0000 7fee77531640 1 -- 172.21.15.2:0/1041360078 --> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7fee700fee70 con 0x7fee5c0a34d0 2024-09-19T06:14:58.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.863+0000 7fee667fc640 1 -- 172.21.15.2:0/1041360078 <== mgr.15144 v2:172.21.15.2:6800/1594569191 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7fee700fee70 con 0x7fee5c0a34d0 2024-09-19T06:14:58.865 INFO:teuthology.orchestra.run.smithi002.stdout:Retention added to path / 2024-09-19T06:14:58.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.865+0000 7fee77531640 1 -- 172.21.15.2:0/1041360078 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fee5c0a34d0 msgr2=0x7fee5c0a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:58.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.865+0000 7fee77531640 1 --2- 172.21.15.2:0/1041360078 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fee5c0a34d0 0x7fee5c0a5990 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fee70105470 tx=0x7fee6000b390 comp rx=0 tx=0).stop 2024-09-19T06:14:58.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.865+0000 7fee77531640 1 -- 172.21.15.2:0/1041360078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee701009a0 msgr2=0x7fee7019a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:58.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.865+0000 7fee77531640 1 --2- 172.21.15.2:0/1041360078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee701009a0 0x7fee7019a4e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fee6c00c890 tx=0x7fee6c00cd50 comp rx=0 tx=0).stop 2024-09-19T06:14:58.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.865+0000 7fee77531640 1 -- 172.21.15.2:0/1041360078 shutdown_connections 2024-09-19T06:14:58.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.865+0000 7fee77531640 1 --2- 172.21.15.2:0/1041360078 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fee5c0a34d0 0x7fee5c0a5990 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.865+0000 7fee77531640 1 --2- 172.21.15.2:0/1041360078 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee701069b0 0x7fee7019eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.865+0000 7fee77531640 1 --2- 172.21.15.2:0/1041360078 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee70101340 0x7fee7019aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.865+0000 7fee77531640 1 --2- 172.21.15.2:0/1041360078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee701009a0 0x7fee7019a4e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.865+0000 7fee77531640 1 -- 172.21.15.2:0/1041360078 >> 172.21.15.2:0/1041360078 conn(0x7fee700779a0 msgr2=0x7fee70069f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:58.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.865+0000 7fee77531640 1 -- 172.21.15.2:0/1041360078 shutdown_connections 2024-09-19T06:14:58.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.865+0000 7fee77531640 1 -- 172.21.15.2:0/1041360078 wait complete. 2024-09-19T06:14:58.877 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-19T06:14:58.940 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:14:58.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.982+0000 7f82f114b640 1 -- 172.21.15.2:0/82646837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82ec10c0d0 msgr2=0x7f82ec10e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:58.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.982+0000 7f82f114b640 1 --2- 172.21.15.2:0/82646837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82ec10c0d0 0x7f82ec10e540 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f82e4009ca0 tx=0x7f82e402a950 comp rx=0 tx=0).stop 2024-09-19T06:14:58.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.982+0000 7f82f114b640 1 -- 172.21.15.2:0/82646837 shutdown_connections 2024-09-19T06:14:58.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.982+0000 7f82f114b640 1 --2- 172.21.15.2:0/82646837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82ec10c0d0 0x7f82ec10e540 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.982+0000 7f82f114b640 1 --2- 172.21.15.2:0/82646837 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82ec103620 0x7f82ec10bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.982+0000 7f82f114b640 1 --2- 172.21.15.2:0/82646837 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82ec102d00 0x7f82ec1030e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.982+0000 7f82f114b640 1 -- 172.21.15.2:0/82646837 >> 172.21.15.2:0/82646837 conn(0x7f82ec0779a0 msgr2=0x7f82ec0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:58.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.982+0000 7f82f114b640 1 -- 172.21.15.2:0/82646837 shutdown_connections 2024-09-19T06:14:58.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.982+0000 7f82f114b640 1 -- 172.21.15.2:0/82646837 wait complete. 2024-09-19T06:14:58.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.983+0000 7f82f114b640 1 Processor -- start 2024-09-19T06:14:58.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.983+0000 7f82f114b640 1 -- start start 2024-09-19T06:14:58.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.983+0000 7f82f114b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82ec102d00 0x7f82ec100950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:58.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.983+0000 7f82f114b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82ec103620 0x7f82ec100e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:58.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.983+0000 7f82f114b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82ec10c0d0 0x7f82ec1013d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:58.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.983+0000 7f82f114b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f82ec111da0 con 0x7f82ec10c0d0 2024-09-19T06:14:58.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.983+0000 7f82f114b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f82ec111c20 con 0x7f82ec103620 2024-09-19T06:14:58.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.983+0000 7f82f114b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f82ec111f20 con 0x7f82ec102d00 2024-09-19T06:14:58.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.983+0000 7f82eb59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82ec10c0d0 0x7f82ec1013d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:58.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.983+0000 7f82eb59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82ec10c0d0 0x7f82ec1013d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46250/0 (socket says 172.21.15.2:46250) 2024-09-19T06:14:58.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.983+0000 7f82eb59e640 1 -- 172.21.15.2:0/786308570 learned_addr learned my addr 172.21.15.2:0/786308570 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:58.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.984+0000 7f82ead9d640 1 --2- 172.21.15.2:0/786308570 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82ec102d00 0x7f82ec100950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:58.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.984+0000 7f82ea59c640 1 --2- 172.21.15.2:0/786308570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82ec103620 0x7f82ec100e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:58.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.984+0000 7f82eb59e640 1 -- 172.21.15.2:0/786308570 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82ec102d00 msgr2=0x7f82ec100950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:58.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.984+0000 7f82eb59e640 1 --2- 172.21.15.2:0/786308570 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82ec102d00 0x7f82ec100950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.984+0000 7f82eb59e640 1 -- 172.21.15.2:0/786308570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82ec103620 msgr2=0x7f82ec100e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:58.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.984+0000 7f82eb59e640 1 --2- 172.21.15.2:0/786308570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82ec103620 0x7f82ec100e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:58.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.984+0000 7f82eb59e640 1 -- 172.21.15.2:0/786308570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82ec1a66d0 con 0x7f82ec10c0d0 2024-09-19T06:14:58.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.984+0000 7f82ea59c640 1 --2- 172.21.15.2:0/786308570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82ec103620 0x7f82ec100e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:14:58.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.984+0000 7f82eb59e640 1 --2- 172.21.15.2:0/786308570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82ec10c0d0 0x7f82ec1013d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f82e4009dc0 tx=0x7f82e4003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:58.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.984+0000 7f82d3fff640 1 -- 172.21.15.2:0/786308570 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e4034040 con 0x7f82ec10c0d0 2024-09-19T06:14:58.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.984+0000 7f82f114b640 1 -- 172.21.15.2:0/786308570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82ec1a6960 con 0x7f82ec10c0d0 2024-09-19T06:14:58.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.984+0000 7f82d3fff640 1 -- 172.21.15.2:0/786308570 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f82e4030850 con 0x7f82ec10c0d0 2024-09-19T06:14:58.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.984+0000 7f82d3fff640 1 -- 172.21.15.2:0/786308570 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e4004670 con 0x7f82ec10c0d0 2024-09-19T06:14:58.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.984+0000 7f82f114b640 1 -- 172.21.15.2:0/786308570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82ec1a6ea0 con 0x7f82ec10c0d0 2024-09-19T06:14:58.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.986+0000 7f82f114b640 1 -- 172.21.15.2:0/786308570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82ec1030e0 con 0x7f82ec10c0d0 2024-09-19T06:14:58.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.987+0000 7f82d3fff640 1 -- 172.21.15.2:0/786308570 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138581+0+0 (secure 0 0 0) 0x7f82e4037020 con 0x7f82ec10c0d0 2024-09-19T06:14:58.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.987+0000 7f82d3fff640 1 --2- 172.21.15.2:0/786308570 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f82d40a34d0 0x7f82d40a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:58.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.987+0000 7f82d3fff640 1 -- 172.21.15.2:0/786308570 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f82e40f0da0 con 0x7f82ec10c0d0 2024-09-19T06:14:58.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.987+0000 7f82ead9d640 1 --2- 172.21.15.2:0/786308570 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f82d40a34d0 0x7f82d40a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:58.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.988+0000 7f82ead9d640 1 --2- 172.21.15.2:0/786308570 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f82d40a34d0 0x7f82d40a5990 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f82dc009b60 tx=0x7f82dc005f90 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:58.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:58.992+0000 7f82d3fff640 1 -- 172.21.15.2:0/786308570 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f82e40bd670 con 0x7f82ec10c0d0 2024-09-19T06:14:59.223 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:59.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.227+0000 7f82f114b640 1 -- 172.21.15.2:0/786308570 --> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f82ec1071f0 con 0x7f82d40a34d0 2024-09-19T06:14:59.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.234+0000 7f82d3fff640 1 -- 172.21.15.2:0/786308570 <== mgr.15144 v2:172.21.15.2:6800/1594569191 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f82dc011be0 con 0x7f82d40a34d0 2024-09-19T06:14:59.236 INFO:teuthology.orchestra.run.smithi002.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-19T00:00:00", "created": "2024-09-19T06:14:58", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-19T06:14:59.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.237+0000 7f82f114b640 1 -- 172.21.15.2:0/786308570 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f82d40a34d0 msgr2=0x7f82d40a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:59.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.237+0000 7f82f114b640 1 --2- 172.21.15.2:0/786308570 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f82d40a34d0 0x7f82d40a5990 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f82dc009b60 tx=0x7f82dc005f90 comp rx=0 tx=0).stop 2024-09-19T06:14:59.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.237+0000 7f82f114b640 1 -- 172.21.15.2:0/786308570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82ec10c0d0 msgr2=0x7f82ec1013d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:59.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.237+0000 7f82f114b640 1 --2- 172.21.15.2:0/786308570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82ec10c0d0 0x7f82ec1013d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f82e4009dc0 tx=0x7f82e4003f10 comp rx=0 tx=0).stop 2024-09-19T06:14:59.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.237+0000 7f82f114b640 1 -- 172.21.15.2:0/786308570 shutdown_connections 2024-09-19T06:14:59.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.237+0000 7f82f114b640 1 --2- 172.21.15.2:0/786308570 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f82d40a34d0 0x7f82d40a5990 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.237+0000 7f82f114b640 1 --2- 172.21.15.2:0/786308570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82ec10c0d0 0x7f82ec1013d0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.237+0000 7f82f114b640 1 --2- 172.21.15.2:0/786308570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82ec103620 0x7f82ec100e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.237+0000 7f82f114b640 1 --2- 172.21.15.2:0/786308570 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82ec102d00 0x7f82ec100950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.237+0000 7f82f114b640 1 -- 172.21.15.2:0/786308570 >> 172.21.15.2:0/786308570 conn(0x7f82ec0779a0 msgr2=0x7f82ec0fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:59.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.237+0000 7f82f114b640 1 -- 172.21.15.2:0/786308570 shutdown_connections 2024-09-19T06:14:59.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.237+0000 7f82f114b640 1 -- 172.21.15.2:0/786308570 wait complete. 2024-09-19T06:14:59.250 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-19T06:14:59.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.397+0000 7fe0cb55b640 1 -- 172.21.15.2:0/2794180238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0c4107b70 msgr2=0x7fe0c4107f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:59.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.397+0000 7fe0cb55b640 1 --2- 172.21.15.2:0/2794180238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0c4107b70 0x7fe0c4107f50 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0009930 tx=0x7fe0c002a420 comp rx=0 tx=0).stop 2024-09-19T06:14:59.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.397+0000 7fe0cb55b640 1 -- 172.21.15.2:0/2794180238 shutdown_connections 2024-09-19T06:14:59.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.397+0000 7fe0cb55b640 1 --2- 172.21.15.2:0/2794180238 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0c4102470 0x7fe0c410e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.397+0000 7fe0cb55b640 1 --2- 172.21.15.2:0/2794180238 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0c4101ad0 0x7fe0c4101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.397+0000 7fe0cb55b640 1 --2- 172.21.15.2:0/2794180238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0c4107b70 0x7fe0c4107f50 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.397+0000 7fe0cb55b640 1 -- 172.21.15.2:0/2794180238 >> 172.21.15.2:0/2794180238 conn(0x7fe0c40fd7d0 msgr2=0x7fe0c40ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:59.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.397+0000 7fe0cb55b640 1 -- 172.21.15.2:0/2794180238 shutdown_connections 2024-09-19T06:14:59.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.397+0000 7fe0cb55b640 1 -- 172.21.15.2:0/2794180238 wait complete. 2024-09-19T06:14:59.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.397+0000 7fe0cb55b640 1 Processor -- start 2024-09-19T06:14:59.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.397+0000 7fe0cb55b640 1 -- start start 2024-09-19T06:14:59.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.397+0000 7fe0cb55b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0c4101ad0 0x7fe0c4198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:59.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.397+0000 7fe0cb55b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0c4102470 0x7fe0c41988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:59.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.398+0000 7fe0cb55b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0c4107b70 0x7fe0c419cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:59.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.398+0000 7fe0cb55b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c4111dd0 con 0x7fe0c4107b70 2024-09-19T06:14:59.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.398+0000 7fe0cb55b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c4111c50 con 0x7fe0c4102470 2024-09-19T06:14:59.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.398+0000 7fe0cb55b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c4111f50 con 0x7fe0c4101ad0 2024-09-19T06:14:59.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.398+0000 7fe0c9af8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0c4107b70 0x7fe0c419cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:59.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.398+0000 7fe0c9af8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0c4107b70 0x7fe0c419cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46260/0 (socket says 172.21.15.2:46260) 2024-09-19T06:14:59.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.398+0000 7fe0c9af8640 1 -- 172.21.15.2:0/1488906424 learned_addr learned my addr 172.21.15.2:0/1488906424 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:59.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.398+0000 7fe0c92f7640 1 --2- 172.21.15.2:0/1488906424 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0c4101ad0 0x7fe0c4198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:59.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.398+0000 7fe0c8af6640 1 --2- 172.21.15.2:0/1488906424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0c4102470 0x7fe0c41988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:59.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.398+0000 7fe0c9af8640 1 -- 172.21.15.2:0/1488906424 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0c4101ad0 msgr2=0x7fe0c4198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:59.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.398+0000 7fe0c9af8640 1 --2- 172.21.15.2:0/1488906424 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0c4101ad0 0x7fe0c4198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.398+0000 7fe0c9af8640 1 -- 172.21.15.2:0/1488906424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0c4102470 msgr2=0x7fe0c41988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:59.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.398+0000 7fe0c9af8640 1 --2- 172.21.15.2:0/1488906424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0c4102470 0x7fe0c41988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.398+0000 7fe0c9af8640 1 -- 172.21.15.2:0/1488906424 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c419d370 con 0x7fe0c4107b70 2024-09-19T06:14:59.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.398+0000 7fe0c92f7640 1 --2- 172.21.15.2:0/1488906424 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0c4101ad0 0x7fe0c4198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:14:59.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.398+0000 7fe0c8af6640 1 --2- 172.21.15.2:0/1488906424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0c4102470 0x7fe0c41988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:14:59.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.398+0000 7fe0c9af8640 1 --2- 172.21.15.2:0/1488906424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0c4107b70 0x7fe0c419cc40 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc00eb10 tx=0x7fe0bc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:59.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.398+0000 7fe0ba7fc640 1 -- 172.21.15.2:0/1488906424 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc004b20 con 0x7fe0c4107b70 2024-09-19T06:14:59.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.398+0000 7fe0cb55b640 1 -- 172.21.15.2:0/1488906424 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0c419d660 con 0x7fe0c4107b70 2024-09-19T06:14:59.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.398+0000 7fe0ba7fc640 1 -- 172.21.15.2:0/1488906424 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe0bc004cc0 con 0x7fe0c4107b70 2024-09-19T06:14:59.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.398+0000 7fe0ba7fc640 1 -- 172.21.15.2:0/1488906424 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc010690 con 0x7fe0c4107b70 2024-09-19T06:14:59.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.398+0000 7fe0cb55b640 1 -- 172.21.15.2:0/1488906424 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0c41a4ef0 con 0x7fe0c4107b70 2024-09-19T06:14:59.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.399+0000 7fe0cb55b640 1 -- 172.21.15.2:0/1488906424 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0c4101f30 con 0x7fe0c4107b70 2024-09-19T06:14:59.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.401+0000 7fe0ba7fc640 1 -- 172.21.15.2:0/1488906424 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138581+0+0 (secure 0 0 0) 0x7fe0bc005020 con 0x7fe0c4107b70 2024-09-19T06:14:59.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.401+0000 7fe0ba7fc640 1 --2- 172.21.15.2:0/1488906424 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe0b00a34d0 0x7fe0b00a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:59.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.401+0000 7fe0c92f7640 1 --2- 172.21.15.2:0/1488906424 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe0b00a34d0 0x7fe0b00a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:59.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.401+0000 7fe0ba7fc640 1 -- 172.21.15.2:0/1488906424 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fe0bc0d0650 con 0x7fe0c4107b70 2024-09-19T06:14:59.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.402+0000 7fe0c92f7640 1 --2- 172.21.15.2:0/1488906424 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe0b00a34d0 0x7fe0b00a5990 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0000c00 tx=0x7fe0c0009610 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:59.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.405+0000 7fe0ba7fc640 1 -- 172.21.15.2:0/1488906424 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe0bc09ce10 con 0x7fe0c4107b70 2024-09-19T06:14:59.501 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:59 smithi002 ceph-mon[30982]: scrub queued for path: / 2024-09-19T06:14:59.502 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:59 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:14:59.502 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:59 smithi002 ceph-mon[30982]: scrub summary: active paths [/] 2024-09-19T06:14:59.502 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:59 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:14:59.502 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:59 smithi002 ceph-mon[30982]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 683 B/s wr, 17 op/s 2024-09-19T06:14:59.502 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:59 smithi002 ceph-mon[30982]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:14:59.502 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:14:59 smithi002 ceph-mon[30982]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:14:59.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.608+0000 7fe0cb55b640 1 -- 172.21.15.2:0/1488906424 --> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fe0c4062630 con 0x7fe0b00a34d0 2024-09-19T06:14:59.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.615+0000 7fe0ba7fc640 1 -- 172.21.15.2:0/1488906424 <== mgr.15144 v2:172.21.15.2:6800/1594569191 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fe0c4062630 con 0x7fe0b00a34d0 2024-09-19T06:14:59.617 INFO:teuthology.orchestra.run.smithi002.stdout:/ 1m 6m3h 2024-09-19T06:14:59.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.617+0000 7fe0cb55b640 1 -- 172.21.15.2:0/1488906424 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe0b00a34d0 msgr2=0x7fe0b00a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:59.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.617+0000 7fe0cb55b640 1 --2- 172.21.15.2:0/1488906424 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe0b00a34d0 0x7fe0b00a5990 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0000c00 tx=0x7fe0c0009610 comp rx=0 tx=0).stop 2024-09-19T06:14:59.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.617+0000 7fe0cb55b640 1 -- 172.21.15.2:0/1488906424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0c4107b70 msgr2=0x7fe0c419cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:59.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.617+0000 7fe0cb55b640 1 --2- 172.21.15.2:0/1488906424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0c4107b70 0x7fe0c419cc40 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc00eb10 tx=0x7fe0bc00c2d0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.617+0000 7fe0cb55b640 1 -- 172.21.15.2:0/1488906424 shutdown_connections 2024-09-19T06:14:59.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.617+0000 7fe0cb55b640 1 --2- 172.21.15.2:0/1488906424 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe0b00a34d0 0x7fe0b00a5990 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.617+0000 7fe0cb55b640 1 --2- 172.21.15.2:0/1488906424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0c4107b70 0x7fe0c419cc40 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.617+0000 7fe0cb55b640 1 --2- 172.21.15.2:0/1488906424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0c4102470 0x7fe0c41988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.617+0000 7fe0cb55b640 1 --2- 172.21.15.2:0/1488906424 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe0c4101ad0 0x7fe0c4198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.617+0000 7fe0cb55b640 1 -- 172.21.15.2:0/1488906424 >> 172.21.15.2:0/1488906424 conn(0x7fe0c40fd7d0 msgr2=0x7fe0c40fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:59.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.618+0000 7fe0cb55b640 1 -- 172.21.15.2:0/1488906424 shutdown_connections 2024-09-19T06:14:59.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.618+0000 7fe0cb55b640 1 -- 172.21.15.2:0/1488906424 wait complete. 2024-09-19T06:14:59.630 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-19T06:14:59.658 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-19T06:14:59.669 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-19T06:14:59.695 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-19T06:14:59.696 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-19T06:14:59.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.667+0000 7fe4c5432640 1 -- 172.21.15.2:0/2076071011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4c0106a80 msgr2=0x7fe4c0106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:59.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.667+0000 7fe4c5432640 1 --2- 172.21.15.2:0/2076071011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4c0106a80 0x7fe4c0106e60 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0009cd0 tx=0x7fe4b002a8e0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.667+0000 7fe4c5432640 1 -- 172.21.15.2:0/2076071011 shutdown_connections 2024-09-19T06:14:59.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.667+0000 7fe4c5432640 1 --2- 172.21.15.2:0/2076071011 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe4c0101420 0x7fe4c010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.667+0000 7fe4c5432640 1 --2- 172.21.15.2:0/2076071011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4c0100a80 0x7fe4c0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.667+0000 7fe4c5432640 1 --2- 172.21.15.2:0/2076071011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4c0106a80 0x7fe4c0106e60 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.667+0000 7fe4c5432640 1 -- 172.21.15.2:0/2076071011 >> 172.21.15.2:0/2076071011 conn(0x7fe4c00fc7a0 msgr2=0x7fe4c00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:59.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.667+0000 7fe4c5432640 1 -- 172.21.15.2:0/2076071011 shutdown_connections 2024-09-19T06:14:59.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.667+0000 7fe4c5432640 1 -- 172.21.15.2:0/2076071011 wait complete. 2024-09-19T06:14:59.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.667+0000 7fe4c5432640 1 Processor -- start 2024-09-19T06:14:59.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.668+0000 7fe4c5432640 1 -- start start 2024-09-19T06:14:59.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.668+0000 7fe4c5432640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4c0100a80 0x7fe4c0102ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:59.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.668+0000 7fe4c5432640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe4c0101420 0x7fe4c0103000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:59.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.668+0000 7fe4c5432640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4c0106a80 0x7fe4c0103540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:59.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.668+0000 7fe4c5432640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c0110d30 con 0x7fe4c0106a80 2024-09-19T06:14:59.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.668+0000 7fe4c5432640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c0110bb0 con 0x7fe4c0100a80 2024-09-19T06:14:59.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.668+0000 7fe4c5432640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c0110eb0 con 0x7fe4c0101420 2024-09-19T06:14:59.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.668+0000 7fe4bf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4c0106a80 0x7fe4c0103540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:59.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.668+0000 7fe4bf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4c0106a80 0x7fe4c0103540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46282/0 (socket says 172.21.15.2:46282) 2024-09-19T06:14:59.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.668+0000 7fe4bf7fe640 1 -- 172.21.15.2:0/1262610565 learned_addr learned my addr 172.21.15.2:0/1262610565 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:59.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.668+0000 7fe4be7fc640 1 --2- 172.21.15.2:0/1262610565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe4c0101420 0x7fe4c0103000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:59.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.668+0000 7fe4beffd640 1 --2- 172.21.15.2:0/1262610565 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4c0100a80 0x7fe4c0102ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:59.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.668+0000 7fe4bf7fe640 1 -- 172.21.15.2:0/1262610565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe4c0101420 msgr2=0x7fe4c0103000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:59.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.668+0000 7fe4bf7fe640 1 --2- 172.21.15.2:0/1262610565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe4c0101420 0x7fe4c0103000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.668+0000 7fe4bf7fe640 1 -- 172.21.15.2:0/1262610565 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4c0100a80 msgr2=0x7fe4c0102ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:59.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.668+0000 7fe4bf7fe640 1 --2- 172.21.15.2:0/1262610565 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4c0100a80 0x7fe4c0102ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.668+0000 7fe4bf7fe640 1 -- 172.21.15.2:0/1262610565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4c01a6800 con 0x7fe4c0106a80 2024-09-19T06:14:59.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.668+0000 7fe4beffd640 1 --2- 172.21.15.2:0/1262610565 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4c0100a80 0x7fe4c0102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:14:59.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.669+0000 7fe4bf7fe640 1 --2- 172.21.15.2:0/1262610565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4c0106a80 0x7fe4c0103540 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe4b800d750 tx=0x7fe4b800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:59.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.669+0000 7fe4a7fff640 1 -- 172.21.15.2:0/1262610565 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b8017070 con 0x7fe4c0106a80 2024-09-19T06:14:59.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.669+0000 7fe4a7fff640 1 -- 172.21.15.2:0/1262610565 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe4b80054d0 con 0x7fe4c0106a80 2024-09-19T06:14:59.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.669+0000 7fe4c5432640 1 -- 172.21.15.2:0/1262610565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4c01a6af0 con 0x7fe4c0106a80 2024-09-19T06:14:59.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.669+0000 7fe4a7fff640 1 -- 172.21.15.2:0/1262610565 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b8004c60 con 0x7fe4c0106a80 2024-09-19T06:14:59.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.669+0000 7fe4c5432640 1 -- 172.21.15.2:0/1262610565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4c01a7030 con 0x7fe4c0106a80 2024-09-19T06:14:59.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.671+0000 7fe4a7fff640 1 -- 172.21.15.2:0/1262610565 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 23) ==== 138581+0+0 (secure 0 0 0) 0x7fe4b8004e00 con 0x7fe4c0106a80 2024-09-19T06:14:59.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.672+0000 7fe4c780b740 1 Processor -- start 2024-09-19T06:14:59.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.672+0000 7fe4c780b740 1 -- start start 2024-09-19T06:14:59.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.672+0000 7fe4c780b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6ccb2f4a0 0x55a6ccb2f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:59.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.672+0000 7fe4c780b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a6ccb2fdc0 0x55a6ccb3a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:59.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.672+0000 7fe4c780b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a6ccb3a680 0x55a6ccb3ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:59.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.672+0000 7fe4c780b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a6cca952e0 con 0x55a6ccb2f4a0 2024-09-19T06:14:59.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.672+0000 7fe4c780b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55a6cca3cce0 con 0x55a6ccb2fdc0 2024-09-19T06:14:59.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.672+0000 7fe4c780b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55a6cca912a0 con 0x55a6ccb3a680 2024-09-19T06:14:59.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.672+0000 7fe4be7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6ccb2f4a0 0x55a6ccb2f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:59.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.672+0000 7fe4be7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6ccb2f4a0 0x55a6ccb2f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46294/0 (socket says 172.21.15.2:46294) 2024-09-19T06:14:59.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.672+0000 7fe4be7fc640 1 -- 172.21.15.2:0/519047098 learned_addr learned my addr 172.21.15.2:0/519047098 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:59.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.672+0000 7fe4beffd640 1 --2- 172.21.15.2:0/519047098 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a6ccb2fdc0 0x55a6ccb3a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:59.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.672+0000 7fe4a7fff640 1 --2- 172.21.15.2:0/1262610565 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe4a80a34d0 0x7fe4a80a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:59.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.672+0000 7fe4be7fc640 1 --2- 172.21.15.2:0/519047098 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a6ccb3a680 0x55a6ccb3ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:59.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.672+0000 7fe4beffd640 1 -- 172.21.15.2:0/519047098 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a6ccb3a680 msgr2=0x55a6ccb3ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:59.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.672+0000 7fe4beffd640 1 --2- 172.21.15.2:0/519047098 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a6ccb3a680 0x55a6ccb3ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.672+0000 7fe4beffd640 1 -- 172.21.15.2:0/519047098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6ccb2f4a0 msgr2=0x55a6ccb2f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:59.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.672+0000 7fe4beffd640 1 --2- 172.21.15.2:0/519047098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6ccb2f4a0 0x55a6ccb2f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.673+0000 7fe4beffd640 1 -- 172.21.15.2:0/519047098 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6cca21440 con 0x55a6ccb2fdc0 2024-09-19T06:14:59.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.673+0000 7fe4a7fff640 1 -- 172.21.15.2:0/1262610565 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fe4b80cf8e0 con 0x7fe4c0106a80 2024-09-19T06:14:59.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.673+0000 7fe4bf7fe640 1 --2- 172.21.15.2:0/1262610565 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe4a80a34d0 0x7fe4a80a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:59.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.673+0000 7fe4be7fc640 1 --2- 172.21.15.2:0/519047098 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a6ccb3a680 0x55a6ccb3ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:14:59.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.673+0000 7fe4beffd640 1 --2- 172.21.15.2:0/519047098 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a6ccb2fdc0 0x55a6ccb3a140 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0006010 tx=0x7fe4b0009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef1795b3ae6fe7c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:59.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.673+0000 7fe4bf7fe640 1 --2- 172.21.15.2:0/1262610565 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe4a80a34d0 0x7fe4a80a5990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe4b80ccf40 tx=0x7fe4b8086040 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:59.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.673+0000 7fe4a57fa640 1 -- 172.21.15.2:0/519047098 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b0031a50 con 0x55a6ccb2fdc0 2024-09-19T06:14:59.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.673+0000 7fe4a57fa640 1 -- 172.21.15.2:0/519047098 <== mon.2 v2:172.21.15.89:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe4b0036040 con 0x55a6ccb2fdc0 2024-09-19T06:14:59.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.673+0000 7fe4a57fa640 1 -- 172.21.15.2:0/519047098 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b00045b0 con 0x55a6ccb2fdc0 2024-09-19T06:14:59.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.674+0000 7fe4c780b740 1 -- 172.21.15.2:0/519047098 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a6ccb2fdc0 msgr2=0x55a6ccb3a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:59.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.674+0000 7fe4c780b740 1 --2- 172.21.15.2:0/519047098 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a6ccb2fdc0 0x55a6ccb3a140 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0006010 tx=0x7fe4b0009a20 comp rx=0 tx=0).stop 2024-09-19T06:14:59.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.674+0000 7fe4c780b740 1 -- 172.21.15.2:0/519047098 shutdown_connections 2024-09-19T06:14:59.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.674+0000 7fe4c780b740 1 --2- 172.21.15.2:0/519047098 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a6ccb3a680 0x55a6ccb3ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.674+0000 7fe4c780b740 1 --2- 172.21.15.2:0/519047098 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a6ccb2fdc0 0x55a6ccb3a140 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.674+0000 7fe4c780b740 1 --2- 172.21.15.2:0/519047098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6ccb2f4a0 0x55a6ccb2f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.674+0000 7fe4c780b740 1 -- 172.21.15.2:0/519047098 >> 172.21.15.2:0/519047098 conn(0x55a6ccb2ba30 msgr2=0x55a6ccb2be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:59.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.674+0000 7fe4c780b740 1 -- 172.21.15.2:0/519047098 shutdown_connections 2024-09-19T06:14:59.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.674+0000 7fe4c780b740 1 -- 172.21.15.2:0/519047098 wait complete. 2024-09-19T06:14:59.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.674+0000 7fe4c780b740 1 -- start start 2024-09-19T06:14:59.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.674+0000 7fe4c780b740 1 Processor -- start 2024-09-19T06:14:59.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.675+0000 7fe4c780b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6ccb2f4a0 0x55a6ccb39f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:59.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.675+0000 7fe4c780b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a6ccb2fdc0 0x55a6ccb371e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:59.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.675+0000 7fe4c780b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a6ccb3a680 0x55a6ccb37720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:59.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.675+0000 7fe4c780b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a6ccb3d250 con 0x55a6ccb2f4a0 2024-09-19T06:14:59.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.675+0000 7fe4c780b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55a6cca50050 con 0x55a6ccb2fdc0 2024-09-19T06:14:59.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.675+0000 7fe4c780b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55a6ccb3d3d0 con 0x55a6ccb3a680 2024-09-19T06:14:59.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.675+0000 7fe4c780b740 10 client.0 _ll_register_callbacks cb 0x55a6cca90160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:59.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.675+0000 7fe4be7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6ccb2f4a0 0x55a6ccb39f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:59.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.675+0000 7fe4be7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6ccb2f4a0 0x55a6ccb39f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46304/0 (socket says 172.21.15.2:46304) 2024-09-19T06:14:59.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.675+0000 7fe4be7fc640 1 -- 172.21.15.2:0/970385639 learned_addr learned my addr 172.21.15.2:0/970385639 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:59.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.675+0000 7fe4beffd640 1 --2- 172.21.15.2:0/970385639 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a6ccb2fdc0 0x55a6ccb371e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:59.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.675+0000 7fe4be7fc640 1 --2- 172.21.15.2:0/970385639 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a6ccb3a680 0x55a6ccb37720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:59.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.675+0000 7fe4be7fc640 1 -- 172.21.15.2:0/970385639 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a6ccb3a680 msgr2=0x55a6ccb37720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:59.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.675+0000 7fe4be7fc640 1 --2- 172.21.15.2:0/970385639 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a6ccb3a680 0x55a6ccb37720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.675+0000 7fe4be7fc640 1 -- 172.21.15.2:0/970385639 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a6ccb2fdc0 msgr2=0x55a6ccb371e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:59.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.675+0000 7fe4be7fc640 1 --2- 172.21.15.2:0/970385639 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a6ccb2fdc0 0x55a6ccb371e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.675+0000 7fe4be7fc640 1 -- 172.21.15.2:0/970385639 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6cc8063c0 con 0x55a6ccb2f4a0 2024-09-19T06:14:59.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.675+0000 7fe4be7fc640 1 --2- 172.21.15.2:0/970385639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6ccb2f4a0 0x55a6ccb39f30 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe4b400bfc0 tx=0x7fe4b400b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c50e07c927962e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:59.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.675+0000 7fe4a2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:14:59.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.675+0000 7fe4a2ff5640 1 -- 172.21.15.2:0/970385639 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4014170 con 0x55a6ccb2f4a0 2024-09-19T06:14:59.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.676+0000 7fe4a2ff5640 1 -- 172.21.15.2:0/970385639 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fe4b4010c20 con 0x55a6ccb2f4a0 2024-09-19T06:14:59.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.676+0000 7fe4c780b740 1 -- 172.21.15.2:0/970385639 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4b0036040 con 0x55a6ccb2f4a0 2024-09-19T06:14:59.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.676+0000 7fe4a2ff5640 1 -- 172.21.15.2:0/970385639 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe4b4010e20 con 0x55a6ccb2f4a0 2024-09-19T06:14:59.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.676+0000 7fe4c780b740 10 client.15345 fetch_fsmap learned FSMap version 26 2024-09-19T06:14:59.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.676+0000 7fe4c780b740 1 -- 172.21.15.2:0/970385639 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a6ccb48b70 con 0x55a6ccb2f4a0 2024-09-19T06:14:59.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.676+0000 7fe4a2ff5640 1 -- 172.21.15.2:0/970385639 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe4b0036040 con 0x55a6ccb2f4a0 2024-09-19T06:14:59.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.676+0000 7fe4a2ff5640 1 -- 172.21.15.2:0/970385639 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fe4b4003b10 con 0x55a6ccb2f4a0 2024-09-19T06:14:59.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.676+0000 7fe4c780b740 10 client.15345 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:14:59.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.676+0000 7fe4c780b740 10 client.15345 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:14:59.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.676+0000 7fe4c780b740 20 client.15345 populate_metadata read hostname 'smithi002' 2024-09-19T06:14:59.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.676+0000 7fe4c780b740 1 --2- 172.21.15.2:0/970385639 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a6ccb4a030 0x55a6ccb4c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:59.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.676+0000 7fe4c780b740 4 client.15345 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:14:59.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.676+0000 7fe4c780b740 1 -- 172.21.15.2:0/970385639 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a6ccaa2850 con 0x55a6ccb4a030 2024-09-19T06:14:59.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.676+0000 7fe4beffd640 1 --2- 172.21.15.2:0/970385639 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a6ccb4a030 0x55a6ccb4c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:59.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.677+0000 7fe4beffd640 1 --2- 172.21.15.2:0/970385639 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a6ccb4a030 0x55a6ccb4c420 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=529c790af32cf984 server_cookie=ee41a97578b5e2fe in_seq=0 out_seq=0 2024-09-19T06:14:59.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.677+0000 7fe4a2ff5640 10 client.15345 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:14:59.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.678+0000 7fe4a2ff5640 1 -- 172.21.15.2:0/970385639 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a6ccaa2850 con 0x55a6ccb4a030 2024-09-19T06:14:59.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.678+0000 7fe4a2ff5640 10 client.15345 handle_command_reply: tid=0 2024-09-19T06:14:59.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.678+0000 7fe4c780b740 1 client.15345 shutdown 2024-09-19T06:14:59.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.678+0000 7fe4c780b740 1 -- 172.21.15.2:0/970385639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6ccb2f4a0 msgr2=0x55a6ccb39f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:59.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.678+0000 7fe4c780b740 1 --2- 172.21.15.2:0/970385639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6ccb2f4a0 0x55a6ccb39f30 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe4b400bfc0 tx=0x7fe4b400b390 comp rx=0 tx=0).stop 2024-09-19T06:14:59.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.678+0000 7fe4c780b740 1 -- 172.21.15.2:0/970385639 shutdown_connections 2024-09-19T06:14:59.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.678+0000 7fe4c780b740 1 --2- 172.21.15.2:0/970385639 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a6ccb3a680 0x55a6ccb37720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.678+0000 7fe4c780b740 1 --2- 172.21.15.2:0/970385639 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a6ccb4a030 0x55a6ccb4c420 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.678+0000 7fe4c780b740 1 --2- 172.21.15.2:0/970385639 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a6ccb2fdc0 0x55a6ccb371e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.678+0000 7fe4c780b740 1 --2- 172.21.15.2:0/970385639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6ccb2f4a0 0x55a6ccb39f30 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.678+0000 7fe4c780b740 1 -- 172.21.15.2:0/970385639 >> 172.21.15.2:0/970385639 conn(0x55a6ccb2ba30 msgr2=0x55a6ccb2ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:59.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.678+0000 7fe4a2ff5640 0 client.15345 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:14:59.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.678+0000 7fe4c780b740 1 -- 172.21.15.2:0/970385639 shutdown_connections 2024-09-19T06:14:59.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.678+0000 7fe4c780b740 1 -- 172.21.15.2:0/970385639 wait complete. 2024-09-19T06:14:59.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.678+0000 7fe4c780b740 20 client.15345 trim_cache size 0 max 16384 2024-09-19T06:14:59.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.695+0000 7fe4c780b740 1 Processor -- start 2024-09-19T06:14:59.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.695+0000 7fe4c780b740 1 -- start start 2024-09-19T06:14:59.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.695+0000 7fe4c780b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a6ccb2f4a0 0x55a6ccb464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:59.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.695+0000 7fe4c780b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a6ccb2fdc0 0x55a6ccb2be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:59.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.695+0000 7fe4c780b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6ccb3a680 0x55a6ccb51ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:59.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.695+0000 7fe4c780b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c01b21a0 con 0x55a6ccb3a680 2024-09-19T06:14:59.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.695+0000 7fe4c780b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c01afa70 con 0x55a6ccb2f4a0 2024-09-19T06:14:59.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.695+0000 7fe4c780b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c01ad8c0 con 0x55a6ccb2fdc0 2024-09-19T06:14:59.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.695+0000 7fe4be7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6ccb3a680 0x55a6ccb51ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:59.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.695+0000 7fe4be7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6ccb3a680 0x55a6ccb51ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46314/0 (socket says 172.21.15.2:46314) 2024-09-19T06:14:59.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.695+0000 7fe4be7fc640 1 -- 172.21.15.2:0/1260914378 learned_addr learned my addr 172.21.15.2:0/1260914378 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:59.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.695+0000 7fe4be7fc640 1 --2- 172.21.15.2:0/1260914378 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a6ccb2f4a0 0x55a6ccb464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:59.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.696+0000 7fe4be7fc640 1 -- 172.21.15.2:0/1260914378 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a6ccb2fdc0 msgr2=0x55a6ccb2be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:59.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.696+0000 7fe4be7fc640 1 --2- 172.21.15.2:0/1260914378 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a6ccb2fdc0 0x55a6ccb2be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.696+0000 7fe4be7fc640 1 -- 172.21.15.2:0/1260914378 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a6ccb2f4a0 msgr2=0x55a6ccb464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:59.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.696+0000 7fe4be7fc640 1 --2- 172.21.15.2:0/1260914378 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a6ccb2f4a0 0x55a6ccb464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.696+0000 7fe4be7fc640 1 -- 172.21.15.2:0/1260914378 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6ccb3a2a0 con 0x55a6ccb3a680 2024-09-19T06:14:59.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.696+0000 7fe4be7fc640 1 --2- 172.21.15.2:0/1260914378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6ccb3a680 0x55a6ccb51ca0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fe4b40145c0 tx=0x7fe4b4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fe6d0aed58241f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:59.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.696+0000 7fe4a4ff9640 1 -- 172.21.15.2:0/1260914378 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b402b020 con 0x55a6ccb3a680 2024-09-19T06:14:59.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.696+0000 7fe4a4ff9640 1 -- 172.21.15.2:0/1260914378 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe4b402c040 con 0x55a6ccb3a680 2024-09-19T06:14:59.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.696+0000 7fe4a4ff9640 1 -- 172.21.15.2:0/1260914378 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4004260 con 0x55a6ccb3a680 2024-09-19T06:14:59.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.697+0000 7fe4c780b740 1 -- 172.21.15.2:0/1260914378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6ccb3a680 msgr2=0x55a6ccb51ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:59.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.697+0000 7fe4c780b740 1 --2- 172.21.15.2:0/1260914378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6ccb3a680 0x55a6ccb51ca0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fe4b40145c0 tx=0x7fe4b4000bc0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.697+0000 7fe4c780b740 1 -- 172.21.15.2:0/1260914378 shutdown_connections 2024-09-19T06:14:59.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.697+0000 7fe4c780b740 1 --2- 172.21.15.2:0/1260914378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6ccb3a680 0x55a6ccb51ca0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.697+0000 7fe4c780b740 1 --2- 172.21.15.2:0/1260914378 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a6ccb2fdc0 0x55a6ccb2be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.697+0000 7fe4c780b740 1 --2- 172.21.15.2:0/1260914378 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a6ccb2f4a0 0x55a6ccb464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.697+0000 7fe4c780b740 1 -- 172.21.15.2:0/1260914378 >> 172.21.15.2:0/1260914378 conn(0x55a6ccb2ba30 msgr2=0x55a6ccb371a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:59.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.697+0000 7fe4c780b740 1 -- 172.21.15.2:0/1260914378 shutdown_connections 2024-09-19T06:14:59.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.697+0000 7fe4c780b740 1 -- 172.21.15.2:0/1260914378 wait complete. 2024-09-19T06:14:59.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.697+0000 7fe4c780b740 1 -- start start 2024-09-19T06:14:59.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.697+0000 7fe4c780b740 1 Processor -- start 2024-09-19T06:14:59.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.697+0000 7fe4c780b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a6ccb2f4a0 0x55a6ccb3fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:59.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.697+0000 7fe4c780b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6ccb2fdc0 0x55a6ccb40430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:59.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.697+0000 7fe4c780b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a6ccb3a680 0x55a6ccbabc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:59.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.697+0000 7fe4c780b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c01adf30 con 0x55a6ccb2fdc0 2024-09-19T06:14:59.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.697+0000 7fe4c780b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c01af3a0 con 0x55a6ccb3a680 2024-09-19T06:14:59.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.697+0000 7fe4c780b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c01ae600 con 0x55a6ccb2f4a0 2024-09-19T06:14:59.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.697+0000 7fe4c780b740 10 client.0 _ll_register_callbacks cb 0x7fe4b400b910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:59.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.698+0000 7fe4beffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6ccb2fdc0 0x55a6ccb40430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:59.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.698+0000 7fe4beffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6ccb2fdc0 0x55a6ccb40430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46316/0 (socket says 172.21.15.2:46316) 2024-09-19T06:14:59.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.698+0000 7fe4beffd640 1 -- 172.21.15.2:0/2030000999 learned_addr learned my addr 172.21.15.2:0/2030000999 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:14:59.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.698+0000 7fe4be7fc640 1 --2- 172.21.15.2:0/2030000999 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a6ccb2f4a0 0x55a6ccb3fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:59.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.698+0000 7fe4be7fc640 1 --2- 172.21.15.2:0/2030000999 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a6ccb3a680 0x55a6ccbabc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:59.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.698+0000 7fe4beffd640 1 -- 172.21.15.2:0/2030000999 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a6ccb2f4a0 msgr2=0x55a6ccb3fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:59.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.698+0000 7fe4beffd640 1 --2- 172.21.15.2:0/2030000999 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a6ccb2f4a0 0x55a6ccb3fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.698+0000 7fe4beffd640 1 -- 172.21.15.2:0/2030000999 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a6ccb3a680 msgr2=0x55a6ccbabc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:59.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.698+0000 7fe4beffd640 1 --2- 172.21.15.2:0/2030000999 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a6ccb3a680 0x55a6ccbabc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.698+0000 7fe4beffd640 1 -- 172.21.15.2:0/2030000999 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6ccbac2d0 con 0x55a6ccb2fdc0 2024-09-19T06:14:59.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.698+0000 7fe4be7fc640 1 --2- 172.21.15.2:0/2030000999 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a6ccb3a680 0x55a6ccbabc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:14:59.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.698+0000 7fe4beffd640 1 --2- 172.21.15.2:0/2030000999 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6ccb2fdc0 0x55a6ccb40430 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0006010 tx=0x7fe4b0009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5db84b2965bd5d3a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:59.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.698+0000 7fe4a2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:14:59.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.698+0000 7fe4a2ff5640 1 -- 172.21.15.2:0/2030000999 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b0009b20 con 0x55a6ccb2fdc0 2024-09-19T06:14:59.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.698+0000 7fe4a2ff5640 1 -- 172.21.15.2:0/2030000999 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fe4b0031a60 con 0x55a6ccb2fdc0 2024-09-19T06:14:59.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.698+0000 7fe4c780b740 1 -- 172.21.15.2:0/2030000999 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4b402c040 con 0x55a6ccb2fdc0 2024-09-19T06:14:59.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.698+0000 7fe4a2ff5640 1 -- 172.21.15.2:0/2030000999 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe4b0061050 con 0x55a6ccb2fdc0 2024-09-19T06:14:59.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.698+0000 7fe4c780b740 10 client.15351 fetch_fsmap learned FSMap version 26 2024-09-19T06:14:59.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.698+0000 7fe4c780b740 1 -- 172.21.15.2:0/2030000999 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a6ccbb4850 con 0x55a6ccb2fdc0 2024-09-19T06:14:59.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.699+0000 7fe4a2ff5640 1 -- 172.21.15.2:0/2030000999 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe4b402c040 con 0x55a6ccb2fdc0 2024-09-19T06:14:59.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.699+0000 7fe4a2ff5640 1 -- 172.21.15.2:0/2030000999 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fe4b0030070 con 0x55a6ccb2fdc0 2024-09-19T06:14:59.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.699+0000 7fe4c780b740 10 client.15351 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:14:59.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.699+0000 7fe4c780b740 10 client.15351 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:14:59.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.699+0000 7fe4c780b740 20 client.15351 populate_metadata read hostname 'smithi002' 2024-09-19T06:14:59.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.699+0000 7fe4c780b740 1 --2- 172.21.15.2:0/2030000999 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a6ccbb4b50 0x55a6ccbb6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:59.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.699+0000 7fe4c780b740 4 client.15351 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:14:59.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.699+0000 7fe4c780b740 1 -- 172.21.15.2:0/2030000999 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a6cca9cd60 con 0x55a6ccbb4b50 2024-09-19T06:14:59.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.699+0000 7fe4be7fc640 1 --2- 172.21.15.2:0/2030000999 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a6ccbb4b50 0x55a6ccbb6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:59.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.700+0000 7fe4be7fc640 1 --2- 172.21.15.2:0/2030000999 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a6ccbb4b50 0x55a6ccbb6f70 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5721af186c57868e server_cookie=ce7b6ff659fce50b in_seq=0 out_seq=0 2024-09-19T06:14:59.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.700+0000 7fe4a2ff5640 10 client.15351 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:14:59.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.700+0000 7fe4a2ff5640 1 -- 172.21.15.2:0/2030000999 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55a6cca9cd60 con 0x55a6ccbb4b50 2024-09-19T06:14:59.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.700+0000 7fe4a2ff5640 10 client.15351 handle_command_reply: tid=0 2024-09-19T06:14:59.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.700+0000 7fe4c780b740 1 client.15351 shutdown 2024-09-19T06:14:59.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.700+0000 7fe4c780b740 1 -- 172.21.15.2:0/2030000999 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6ccb2fdc0 msgr2=0x55a6ccb40430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:59.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.700+0000 7fe4c780b740 1 --2- 172.21.15.2:0/2030000999 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6ccb2fdc0 0x55a6ccb40430 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0006010 tx=0x7fe4b0009920 comp rx=0 tx=0).stop 2024-09-19T06:14:59.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.700+0000 7fe4c780b740 1 -- 172.21.15.2:0/2030000999 shutdown_connections 2024-09-19T06:14:59.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.700+0000 7fe4c780b740 1 --2- 172.21.15.2:0/2030000999 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a6ccbb4b50 0x55a6ccbb6f70 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.700+0000 7fe4c780b740 1 --2- 172.21.15.2:0/2030000999 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a6ccb3a680 0x55a6ccbabc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.700+0000 7fe4c780b740 1 --2- 172.21.15.2:0/2030000999 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6ccb2fdc0 0x55a6ccb40430 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.700+0000 7fe4a2ff5640 0 client.15351 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:14:59.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.700+0000 7fe4c780b740 1 --2- 172.21.15.2:0/2030000999 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a6ccb2f4a0 0x55a6ccb3fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.700+0000 7fe4c780b740 1 -- 172.21.15.2:0/2030000999 >> 172.21.15.2:0/2030000999 conn(0x55a6ccb2ba30 msgr2=0x55a6ccb2a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:59.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.700+0000 7fe4c780b740 1 -- 172.21.15.2:0/2030000999 shutdown_connections 2024-09-19T06:14:59.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.700+0000 7fe4c780b740 1 -- 172.21.15.2:0/2030000999 wait complete. 2024-09-19T06:14:59.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.700+0000 7fe4c780b740 20 client.15351 trim_cache size 0 max 16384 2024-09-19T06:14:59.728 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:14:59.728 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:14:59.728 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-19T06:14:59.728 INFO:teuthology.orchestra.run.smithi002.stdout: "1502ec3f-65c6-4c54-bb6d-030b8199073b": { 2024-09-19T06:14:59.728 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-19T06:14:59.728 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "1502ec3f-65c6-4c54-bb6d-030b8199073b", 2024-09-19T06:14:59.729 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-19T06:14:59.729 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:14:59.729 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:14:59.729 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:14:59.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.701+0000 7fe4c5432640 1 -- 172.21.15.2:0/1262610565 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe4a80a34d0 msgr2=0x7fe4a80a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:59.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.701+0000 7fe4c5432640 1 --2- 172.21.15.2:0/1262610565 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe4a80a34d0 0x7fe4a80a5990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe4b80ccf40 tx=0x7fe4b8086040 comp rx=0 tx=0).stop 2024-09-19T06:14:59.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.701+0000 7fe4c5432640 1 -- 172.21.15.2:0/1262610565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4c0106a80 msgr2=0x7fe4c0103540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:59.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.701+0000 7fe4c5432640 1 --2- 172.21.15.2:0/1262610565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4c0106a80 0x7fe4c0103540 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe4b800d750 tx=0x7fe4b800dc10 comp rx=0 tx=0).stop 2024-09-19T06:14:59.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.701+0000 7fe4c5432640 1 -- 172.21.15.2:0/1262610565 shutdown_connections 2024-09-19T06:14:59.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.701+0000 7fe4c5432640 1 --2- 172.21.15.2:0/1262610565 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe4a80a34d0 0x7fe4a80a5990 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.701+0000 7fe4c5432640 1 --2- 172.21.15.2:0/1262610565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4c0106a80 0x7fe4c0103540 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.701+0000 7fe4c5432640 1 --2- 172.21.15.2:0/1262610565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe4c0101420 0x7fe4c0103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.701+0000 7fe4c5432640 1 --2- 172.21.15.2:0/1262610565 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4c0100a80 0x7fe4c0102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.701+0000 7fe4c5432640 1 -- 172.21.15.2:0/1262610565 >> 172.21.15.2:0/1262610565 conn(0x7fe4c00fc7a0 msgr2=0x7fe4c0104de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:59.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.701+0000 7fe4c5432640 1 -- 172.21.15.2:0/1262610565 shutdown_connections 2024-09-19T06:14:59.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:14:59.701+0000 7fe4c5432640 1 -- 172.21.15.2:0/1262610565 wait complete. 2024-09-19T06:14:59.731 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T06:14:59.748 INFO:tasks.workunit:Pulling workunits from ref 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T06:14:59.748 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T06:14:59.749 INFO:tasks.workunit:timeout=3h 2024-09-19T06:14:59.749 INFO:tasks.workunit:cleanup=True 2024-09-19T06:14:59.749 DEBUG:teuthology.orchestra.run.smithi002:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T06:14:59.750 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:59 smithi090 ceph-mon[34497]: scrub queued for path: / 2024-09-19T06:14:59.750 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:59 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:14:59.750 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:59 smithi090 ceph-mon[34497]: scrub summary: active paths [/] 2024-09-19T06:14:59.750 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:59 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:14:59.750 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:59 smithi090 ceph-mon[34497]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 683 B/s wr, 17 op/s 2024-09-19T06:14:59.750 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:59 smithi090 ceph-mon[34497]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:14:59.750 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:14:59 smithi090 ceph-mon[34497]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:14:59.766 INFO:teuthology.orchestra.run.smithi002.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-19T06:14:59.766 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-19T06:14:59.766 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 78h/120d Inode: 1 Links: 2 2024-09-19T06:14:59.766 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:14:59.767 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-19T06:14:59.767 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-19 06:13:19.500780538 +0000 2024-09-19T06:14:59.767 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-19 06:13:19.500780538 +0000 2024-09-19T06:14:59.767 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-19 06:14:47.799105584 +0000 2024-09-19T06:14:59.767 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: - 2024-09-19T06:14:59.767 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-19T06:14:59.767 DEBUG:teuthology.orchestra.run.smithi002:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-19T06:14:59.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:59 smithi089 ceph-mon[34160]: scrub queued for path: / 2024-09-19T06:14:59.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:59 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:14:59.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:59 smithi089 ceph-mon[34160]: scrub summary: active paths [/] 2024-09-19T06:14:59.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:59 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:14:59.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:59 smithi089 ceph-mon[34160]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 683 B/s wr, 17 op/s 2024-09-19T06:14:59.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:59 smithi089 ceph-mon[34160]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:14:59.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:14:59 smithi089 ceph-mon[34160]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:14:59.839 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T06:14:59.897 INFO:tasks.workunit.client.0.smithi002.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T06:15:00.603 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:00 smithi002 ceph-mon[30982]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:15:00.604 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:00 smithi002 ceph-mon[30982]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:15:00.635 INFO:tasks.cephfs.filesystem:scrub status for tag:1502ec3f-65c6-4c54-bb6d-030b8199073b - {'path': '/', 'tag': '1502ec3f-65c6-4c54-bb6d-030b8199073b', 'options': 'recursive,force'} 2024-09-19T06:15:00.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:00 smithi090 ceph-mon[34497]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:15:00.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:00 smithi090 ceph-mon[34497]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:15:00.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:00 smithi089 ceph-mon[34160]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:15:00.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:00 smithi089 ceph-mon[34160]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:15:01.222 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:15:00 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:15:00.872+0000 7fbc44965640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:15:01.222 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:15:00 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:15:00.872+0000 7fbc44965640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:15:01.222 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:15:00 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:15:00.872+0000 7fbc44965640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:15:01.223 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:15:00 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:15:00.872+0000 7fbc44965640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:15:01.223 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:15:00 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:15:00.872+0000 7fbc44965640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:15:01.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:01 smithi002 ceph-mon[30982]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 84 KiB/s wr, 49 op/s 2024-09-19T06:15:01.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:01 smithi090 ceph-mon[34497]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 84 KiB/s wr, 49 op/s 2024-09-19T06:15:01.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:01 smithi089 ceph-mon[34160]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 84 KiB/s wr, 49 op/s 2024-09-19T06:15:03.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:03 smithi002 ceph-mon[30982]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 77 KiB/s wr, 45 op/s 2024-09-19T06:15:03.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:03 smithi002 ceph-mon[30982]: mgrmap e24: x(active, since 14s), standbys: z, y 2024-09-19T06:15:03.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:03 smithi090 ceph-mon[34497]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 77 KiB/s wr, 45 op/s 2024-09-19T06:15:03.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:03 smithi090 ceph-mon[34497]: mgrmap e24: x(active, since 14s), standbys: z, y 2024-09-19T06:15:03.794 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:03 smithi089 ceph-mon[34160]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 77 KiB/s wr, 45 op/s 2024-09-19T06:15:03.794 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:03 smithi089 ceph-mon[34160]: mgrmap e24: x(active, since 14s), standbys: z, y 2024-09-19T06:15:05.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:05 smithi089 ceph-mon[34160]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 77 KiB/s wr, 45 op/s 2024-09-19T06:15:05.689 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:05 smithi090 ceph-mon[34497]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 77 KiB/s wr, 45 op/s 2024-09-19T06:15:05.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:05 smithi002 ceph-mon[30982]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 77 KiB/s wr, 45 op/s 2024-09-19T06:15:07.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:07 smithi002 ceph-mon[30982]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 100 KiB/s wr, 65 op/s 2024-09-19T06:15:07.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:07 smithi090 ceph-mon[34497]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 100 KiB/s wr, 65 op/s 2024-09-19T06:15:07.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:07 smithi089 ceph-mon[34160]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 100 KiB/s wr, 65 op/s 2024-09-19T06:15:09.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:09 smithi002 ceph-mon[30982]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 100 KiB/s wr, 52 op/s 2024-09-19T06:15:09.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:09 smithi090 ceph-mon[34497]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 100 KiB/s wr, 52 op/s 2024-09-19T06:15:09.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:09 smithi089 ceph-mon[34160]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 100 KiB/s wr, 52 op/s 2024-09-19T06:15:11.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:11 smithi002 ceph-mon[30982]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 100 KiB/s wr, 55 op/s 2024-09-19T06:15:11.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:11 smithi090 ceph-mon[34497]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 100 KiB/s wr, 55 op/s 2024-09-19T06:15:11.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:11 smithi089 ceph-mon[34160]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 100 KiB/s wr, 55 op/s 2024-09-19T06:15:12.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.851+0000 7f4181191640 1 -- 172.21.15.2:0/125202884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f417c102470 msgr2=0x7f417c10e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:12.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.851+0000 7f4181191640 1 --2- 172.21.15.2:0/125202884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f417c102470 0x7f417c10e9a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4174009cd0 tx=0x7f417402a8e0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.851+0000 7f4181191640 1 -- 172.21.15.2:0/125202884 shutdown_connections 2024-09-19T06:15:12.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.851+0000 7f4181191640 1 --2- 172.21.15.2:0/125202884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f417c102470 0x7f417c10e9a0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.851+0000 7f4181191640 1 --2- 172.21.15.2:0/125202884 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f417c101ad0 0x7f417c101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.851+0000 7f4181191640 1 --2- 172.21.15.2:0/125202884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f417c107b70 0x7f417c107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.851+0000 7f4181191640 1 -- 172.21.15.2:0/125202884 >> 172.21.15.2:0/125202884 conn(0x7f417c0fd7d0 msgr2=0x7f417c0ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:12.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.851+0000 7f4181191640 1 -- 172.21.15.2:0/125202884 shutdown_connections 2024-09-19T06:15:12.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.851+0000 7f4181191640 1 -- 172.21.15.2:0/125202884 wait complete. 2024-09-19T06:15:12.855 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.851+0000 7f4181191640 1 Processor -- start 2024-09-19T06:15:12.855 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.852+0000 7f4181191640 1 -- start start 2024-09-19T06:15:12.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.852+0000 7f4181191640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f417c101ad0 0x7f417c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:12.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.852+0000 7f4181191640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f417c102470 0x7f417c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:12.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.852+0000 7f4181191640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f417c107b70 0x7f417c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:12.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.852+0000 7f4181191640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f417c111dd0 con 0x7f417c102470 2024-09-19T06:15:12.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.852+0000 7f4181191640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f417c111c50 con 0x7f417c101ad0 2024-09-19T06:15:12.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.852+0000 7f4181191640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f417c111f50 con 0x7f417c107b70 2024-09-19T06:15:12.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.852+0000 7f417a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f417c102470 0x7f417c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:12.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.852+0000 7f417a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f417c102470 0x7f417c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40640/0 (socket says 172.21.15.2:40640) 2024-09-19T06:15:12.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.852+0000 7f417a59c640 1 -- 172.21.15.2:0/1463935711 learned_addr learned my addr 172.21.15.2:0/1463935711 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:12.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.852+0000 7f417ad9d640 1 --2- 172.21.15.2:0/1463935711 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f417c101ad0 0x7f417c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:12.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.852+0000 7f417b59e640 1 --2- 172.21.15.2:0/1463935711 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f417c107b70 0x7f417c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:12.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.853+0000 7f417a59c640 1 -- 172.21.15.2:0/1463935711 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f417c107b70 msgr2=0x7f417c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:12.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.853+0000 7f417a59c640 1 --2- 172.21.15.2:0/1463935711 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f417c107b70 0x7f417c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.853+0000 7f417a59c640 1 -- 172.21.15.2:0/1463935711 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f417c101ad0 msgr2=0x7f417c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:12.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.853+0000 7f417a59c640 1 --2- 172.21.15.2:0/1463935711 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f417c101ad0 0x7f417c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.853+0000 7f417a59c640 1 -- 172.21.15.2:0/1463935711 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f417c1a6840 con 0x7f417c102470 2024-09-19T06:15:12.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.853+0000 7f417a59c640 1 --2- 172.21.15.2:0/1463935711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f417c102470 0x7f417c074a30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f417000c890 tx=0x7f417000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:12.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.853+0000 7f4163fff640 1 -- 172.21.15.2:0/1463935711 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4170004220 con 0x7f417c102470 2024-09-19T06:15:12.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.853+0000 7f4181191640 1 -- 172.21.15.2:0/1463935711 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f417c1a6b30 con 0x7f417c102470 2024-09-19T06:15:12.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.853+0000 7f4163fff640 1 -- 172.21.15.2:0/1463935711 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f41700043c0 con 0x7f417c102470 2024-09-19T06:15:12.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.853+0000 7f4163fff640 1 -- 172.21.15.2:0/1463935711 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4170004a00 con 0x7f417c102470 2024-09-19T06:15:12.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.853+0000 7f4181191640 1 -- 172.21.15.2:0/1463935711 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f417c1a7080 con 0x7f417c102470 2024-09-19T06:15:12.863 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.855+0000 7f4163fff640 1 -- 172.21.15.2:0/1463935711 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 24) ==== 138638+0+0 (secure 0 0 0) 0x7f4170004ba0 con 0x7f417c102470 2024-09-19T06:15:12.863 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.856+0000 7f418400d740 1 Processor -- start 2024-09-19T06:15:12.863 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.856+0000 7f418400d740 1 -- start start 2024-09-19T06:15:12.863 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.856+0000 7f418400d740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f1d2c86af0 0x55f1d2c86ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:12.863 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.856+0000 7f418400d740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f1d2c87410 0x55f1d2c91770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:12.863 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.856+0000 7f418400d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1d2c91cb0 0x55f1d2c940a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:12.863 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.856+0000 7f4163fff640 1 --2- 172.21.15.2:0/1463935711 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f41640a3560 0x7f41640a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:12.863 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.856+0000 7f418400d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f1d2beb2f0 con 0x55f1d2c91cb0 2024-09-19T06:15:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.856+0000 7f418400d740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55f1d2b93270 con 0x55f1d2c86af0 2024-09-19T06:15:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.856+0000 7f418400d740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f1d2be72b0 con 0x55f1d2c87410 2024-09-19T06:15:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.856+0000 7f417b59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1d2c91cb0 0x55f1d2c940a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.856+0000 7f417a59c640 1 --2- 172.21.15.2:0/1463935711 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f41640a3560 0x7f41640a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.856+0000 7f417b59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1d2c91cb0 0x55f1d2c940a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40644/0 (socket says 172.21.15.2:40644) 2024-09-19T06:15:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.856+0000 7f417b59e640 1 -- 172.21.15.2:0/3608786140 learned_addr learned my addr 172.21.15.2:0/3608786140 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.857+0000 7f4163fff640 1 -- 172.21.15.2:0/1463935711 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f41700cfc80 con 0x7f417c102470 2024-09-19T06:15:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.857+0000 7f417ad9d640 1 --2- 172.21.15.2:0/3608786140 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f1d2c87410 0x55f1d2c91770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.857+0000 7f417b59e640 1 --2- 172.21.15.2:0/3608786140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f1d2c86af0 0x55f1d2c86ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.857+0000 7f417ad9d640 1 -- 172.21.15.2:0/3608786140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f1d2c86af0 msgr2=0x55f1d2c86ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.857+0000 7f417ad9d640 1 --2- 172.21.15.2:0/3608786140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f1d2c86af0 0x55f1d2c86ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.857+0000 7f417ad9d640 1 -- 172.21.15.2:0/3608786140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1d2c91cb0 msgr2=0x55f1d2c940a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:12.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.857+0000 7f417ad9d640 1 --2- 172.21.15.2:0/3608786140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1d2c91cb0 0x55f1d2c940a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.857+0000 7f417ad9d640 1 -- 172.21.15.2:0/3608786140 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1d2b92340 con 0x55f1d2c87410 2024-09-19T06:15:12.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.857+0000 7f417a59c640 1 --2- 172.21.15.2:0/1463935711 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f41640a3560 0x7f41640a5a20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f41700cd220 tx=0x7f417006dad0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:12.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.857+0000 7f417ad9d640 1 --2- 172.21.15.2:0/3608786140 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f1d2c87410 0x55f1d2c91770 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f416c009c20 tx=0x7f416c011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1274ee312bb041bf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:12.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.857+0000 7f41617fa640 1 -- 172.21.15.2:0/3608786140 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416c004050 con 0x55f1d2c87410 2024-09-19T06:15:12.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.857+0000 7f41617fa640 1 -- 172.21.15.2:0/3608786140 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f416c0054d0 con 0x55f1d2c87410 2024-09-19T06:15:12.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.857+0000 7f41617fa640 1 -- 172.21.15.2:0/3608786140 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416c004b20 con 0x55f1d2c87410 2024-09-19T06:15:12.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.858+0000 7f418400d740 1 -- 172.21.15.2:0/3608786140 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f1d2c87410 msgr2=0x55f1d2c91770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:12.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.858+0000 7f418400d740 1 --2- 172.21.15.2:0/3608786140 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f1d2c87410 0x55f1d2c91770 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f416c009c20 tx=0x7f416c011810 comp rx=0 tx=0).stop 2024-09-19T06:15:12.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.858+0000 7f418400d740 1 -- 172.21.15.2:0/3608786140 shutdown_connections 2024-09-19T06:15:12.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.858+0000 7f418400d740 1 --2- 172.21.15.2:0/3608786140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1d2c91cb0 0x55f1d2c940a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.858+0000 7f418400d740 1 --2- 172.21.15.2:0/3608786140 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f1d2c87410 0x55f1d2c91770 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.858+0000 7f418400d740 1 --2- 172.21.15.2:0/3608786140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f1d2c86af0 0x55f1d2c86ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.858+0000 7f418400d740 1 -- 172.21.15.2:0/3608786140 >> 172.21.15.2:0/3608786140 conn(0x55f1d2c83060 msgr2=0x55f1d2c83440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:12.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.858+0000 7f418400d740 1 -- 172.21.15.2:0/3608786140 shutdown_connections 2024-09-19T06:15:12.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.858+0000 7f418400d740 1 -- 172.21.15.2:0/3608786140 wait complete. 2024-09-19T06:15:12.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.859+0000 7f418400d740 1 -- start start 2024-09-19T06:15:12.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.859+0000 7f418400d740 1 Processor -- start 2024-09-19T06:15:12.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.859+0000 7f418400d740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f1d2c86af0 0x55f1d2c8eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:12.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.859+0000 7f418400d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1d2c87410 0x55f1d2c8f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:12.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.859+0000 7f418400d740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f1d2c91cb0 0x55f1d2c8f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:12.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.859+0000 7f418400d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f1d2c94880 con 0x55f1d2c87410 2024-09-19T06:15:12.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.859+0000 7f418400d740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55f1d2b74290 con 0x55f1d2c86af0 2024-09-19T06:15:12.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.859+0000 7f418400d740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f1d2c94a00 con 0x55f1d2c91cb0 2024-09-19T06:15:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.859+0000 7f418400d740 10 client.0 _ll_register_callbacks cb 0x55f1d2ba5140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.859+0000 7f417ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1d2c87410 0x55f1d2c8f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.859+0000 7f417ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1d2c87410 0x55f1d2c8f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40656/0 (socket says 172.21.15.2:40656) 2024-09-19T06:15:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.859+0000 7f417ad9d640 1 -- 172.21.15.2:0/3155073915 learned_addr learned my addr 172.21.15.2:0/3155073915 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.859+0000 7f417b59e640 1 --2- 172.21.15.2:0/3155073915 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f1d2c86af0 0x55f1d2c8eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.859+0000 7f417b59e640 1 --2- 172.21.15.2:0/3155073915 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f1d2c91cb0 0x55f1d2c8f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.859+0000 7f417ad9d640 1 -- 172.21.15.2:0/3155073915 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f1d2c91cb0 msgr2=0x55f1d2c8f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.859+0000 7f417ad9d640 1 --2- 172.21.15.2:0/3155073915 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f1d2c91cb0 0x55f1d2c8f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.859+0000 7f417ad9d640 1 -- 172.21.15.2:0/3155073915 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f1d2c86af0 msgr2=0x55f1d2c8eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.859+0000 7f417ad9d640 1 --2- 172.21.15.2:0/3155073915 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f1d2c86af0 0x55f1d2c8eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.859+0000 7f417ad9d640 1 -- 172.21.15.2:0/3155073915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1d28fe210 con 0x55f1d2c87410 2024-09-19T06:15:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.859+0000 7f417b59e640 1 --2- 172.21.15.2:0/3155073915 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f1d2c86af0 0x55f1d2c8eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:15:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.860+0000 7f417ad9d640 1 --2- 172.21.15.2:0/3155073915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1d2c87410 0x55f1d2c8f050 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f416c01b040 tx=0x7f416c003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c5ac6c305f49249 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.860+0000 7f415eff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:15:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.860+0000 7f415eff5640 1 -- 172.21.15.2:0/3155073915 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416c029070 con 0x55f1d2c87410 2024-09-19T06:15:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.860+0000 7f415eff5640 1 -- 172.21.15.2:0/3155073915 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f416c003c50 con 0x55f1d2c87410 2024-09-19T06:15:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.860+0000 7f418400d740 1 -- 172.21.15.2:0/3155073915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f416c0054d0 con 0x55f1d2c87410 2024-09-19T06:15:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.860+0000 7f415eff5640 1 -- 172.21.15.2:0/3155073915 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f416c035050 con 0x55f1d2c87410 2024-09-19T06:15:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.860+0000 7f418400d740 10 client.15369 fetch_fsmap learned FSMap version 26 2024-09-19T06:15:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.860+0000 7f418400d740 1 -- 172.21.15.2:0/3155073915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f1d29ca620 con 0x55f1d2c87410 2024-09-19T06:15:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.860+0000 7f415eff5640 1 -- 172.21.15.2:0/3155073915 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f416c0054d0 con 0x55f1d2c87410 2024-09-19T06:15:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.860+0000 7f415eff5640 1 -- 172.21.15.2:0/3155073915 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f416c019430 con 0x55f1d2c87410 2024-09-19T06:15:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.860+0000 7f418400d740 10 client.15369 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:15:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.860+0000 7f418400d740 10 client.15369 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:15:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.861+0000 7f418400d740 20 client.15369 populate_metadata read hostname 'smithi002' 2024-09-19T06:15:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.861+0000 7f418400d740 1 --2- 172.21.15.2:0/3155073915 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55f1d2ca1ac0 0x55f1d2ca3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.861+0000 7f418400d740 4 client.15369 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:15:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.861+0000 7f418400d740 1 -- 172.21.15.2:0/3155073915 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1d2bf8a20 con 0x55f1d2ca1ac0 2024-09-19T06:15:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.861+0000 7f417b59e640 1 --2- 172.21.15.2:0/3155073915 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55f1d2ca1ac0 0x55f1d2ca3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.861+0000 7f415eff5640 10 client.15369 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:15:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.861+0000 7f417b59e640 1 --2- 172.21.15.2:0/3155073915 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55f1d2ca1ac0 0x55f1d2ca3eb0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=625ddcf2773948 server_cookie=6a7905c2b4f1712 in_seq=0 out_seq=0 2024-09-19T06:15:12.871 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.862+0000 7f415eff5640 1 -- 172.21.15.2:0/3155073915 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f1d2bf8a20 con 0x55f1d2ca1ac0 2024-09-19T06:15:12.871 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.862+0000 7f415eff5640 10 client.15369 handle_command_reply: tid=0 2024-09-19T06:15:12.871 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.862+0000 7f418400d740 1 client.15369 shutdown 2024-09-19T06:15:12.871 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.862+0000 7f418400d740 1 -- 172.21.15.2:0/3155073915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1d2c87410 msgr2=0x55f1d2c8f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:12.871 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.862+0000 7f418400d740 1 --2- 172.21.15.2:0/3155073915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1d2c87410 0x55f1d2c8f050 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f416c01b040 tx=0x7f416c003820 comp rx=0 tx=0).stop 2024-09-19T06:15:12.871 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.862+0000 7f418400d740 1 -- 172.21.15.2:0/3155073915 shutdown_connections 2024-09-19T06:15:12.871 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.862+0000 7f418400d740 1 --2- 172.21.15.2:0/3155073915 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f1d2c91cb0 0x55f1d2c8f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.871 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.862+0000 7f418400d740 1 --2- 172.21.15.2:0/3155073915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1d2c87410 0x55f1d2c8f050 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.871 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.862+0000 7f418400d740 1 --2- 172.21.15.2:0/3155073915 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55f1d2ca1ac0 0x55f1d2ca3eb0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.872 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.862+0000 7f418400d740 1 --2- 172.21.15.2:0/3155073915 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f1d2c86af0 0x55f1d2c8eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.872 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.862+0000 7f415eff5640 0 client.15369 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:15:12.872 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.862+0000 7f418400d740 1 -- 172.21.15.2:0/3155073915 >> 172.21.15.2:0/3155073915 conn(0x55f1d2c83060 msgr2=0x55f1d2c88d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:12.872 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.862+0000 7f418400d740 1 -- 172.21.15.2:0/3155073915 shutdown_connections 2024-09-19T06:15:12.872 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.862+0000 7f418400d740 1 -- 172.21.15.2:0/3155073915 wait complete. 2024-09-19T06:15:12.872 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.862+0000 7f418400d740 20 client.15369 trim_cache size 0 max 16384 2024-09-19T06:15:12.883 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.877+0000 7f418400d740 1 Processor -- start 2024-09-19T06:15:12.883 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.877+0000 7f418400d740 1 -- start start 2024-09-19T06:15:12.884 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.877+0000 7f418400d740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f1d2c86af0 0x55f1d2c8f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:12.884 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.877+0000 7f418400d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1d2c87410 0x55f1d2c90a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:12.884 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.877+0000 7f418400d740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f1d2c91cb0 0x55f1d2ca9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:12.884 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.877+0000 7f418400d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f417c1b2260 con 0x55f1d2c87410 2024-09-19T06:15:12.884 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.877+0000 7f418400d740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f417c1afb30 con 0x55f1d2c91cb0 2024-09-19T06:15:12.884 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.877+0000 7f418400d740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f417c1ad980 con 0x55f1d2c86af0 2024-09-19T06:15:12.884 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.877+0000 7f417ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1d2c87410 0x55f1d2c90a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:12.884 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.877+0000 7f417ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1d2c87410 0x55f1d2c90a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40658/0 (socket says 172.21.15.2:40658) 2024-09-19T06:15:12.884 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.877+0000 7f417ad9d640 1 -- 172.21.15.2:0/3824800102 learned_addr learned my addr 172.21.15.2:0/3824800102 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:12.885 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.877+0000 7f417b59e640 1 --2- 172.21.15.2:0/3824800102 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f1d2c91cb0 0x55f1d2ca9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:12.885 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.877+0000 7f417b59e640 1 --2- 172.21.15.2:0/3824800102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f1d2c86af0 0x55f1d2c8f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:12.885 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.877+0000 7f417ad9d640 1 -- 172.21.15.2:0/3824800102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f1d2c86af0 msgr2=0x55f1d2c8f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:12.885 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.877+0000 7f417ad9d640 1 --2- 172.21.15.2:0/3824800102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f1d2c86af0 0x55f1d2c8f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.885 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.877+0000 7f417ad9d640 1 -- 172.21.15.2:0/3824800102 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f1d2c91cb0 msgr2=0x55f1d2ca9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:12.885 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.877+0000 7f417ad9d640 1 --2- 172.21.15.2:0/3824800102 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f1d2c91cb0 0x55f1d2ca9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.885 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.877+0000 7f417ad9d640 1 -- 172.21.15.2:0/3824800102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1d2c94440 con 0x55f1d2c87410 2024-09-19T06:15:12.885 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.877+0000 7f417b59e640 1 --2- 172.21.15.2:0/3824800102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f1d2c86af0 0x55f1d2c8f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:15:12.885 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.878+0000 7f417ad9d640 1 --2- 172.21.15.2:0/3824800102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1d2c87410 0x55f1d2c90a80 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f416c000c00 tx=0x7f416c009af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=231cc25f5dc773c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:12.885 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.878+0000 7f4160ff9640 1 -- 172.21.15.2:0/3824800102 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416c029070 con 0x55f1d2c87410 2024-09-19T06:15:12.885 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.878+0000 7f4160ff9640 1 -- 172.21.15.2:0/3824800102 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f416c009dd0 con 0x55f1d2c87410 2024-09-19T06:15:12.885 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.878+0000 7f4160ff9640 1 -- 172.21.15.2:0/3824800102 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416c003c50 con 0x55f1d2c87410 2024-09-19T06:15:12.886 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.878+0000 7f418400d740 1 -- 172.21.15.2:0/3824800102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1d2c87410 msgr2=0x55f1d2c90a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:12.886 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.878+0000 7f418400d740 1 --2- 172.21.15.2:0/3824800102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1d2c87410 0x55f1d2c90a80 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f416c000c00 tx=0x7f416c009af0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.886 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.878+0000 7f418400d740 1 -- 172.21.15.2:0/3824800102 shutdown_connections 2024-09-19T06:15:12.886 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.878+0000 7f418400d740 1 --2- 172.21.15.2:0/3824800102 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f1d2c91cb0 0x55f1d2ca9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.886 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.878+0000 7f418400d740 1 --2- 172.21.15.2:0/3824800102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1d2c87410 0x55f1d2c90a80 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.886 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.878+0000 7f418400d740 1 --2- 172.21.15.2:0/3824800102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f1d2c86af0 0x55f1d2c8f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.886 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.878+0000 7f418400d740 1 -- 172.21.15.2:0/3824800102 >> 172.21.15.2:0/3824800102 conn(0x55f1d2c83060 msgr2=0x55f1d2c90370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:12.886 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.878+0000 7f418400d740 1 -- 172.21.15.2:0/3824800102 shutdown_connections 2024-09-19T06:15:12.886 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.878+0000 7f418400d740 1 -- 172.21.15.2:0/3824800102 wait complete. 2024-09-19T06:15:12.886 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.879+0000 7f418400d740 1 -- start start 2024-09-19T06:15:12.886 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.879+0000 7f418400d740 1 Processor -- start 2024-09-19T06:15:12.886 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.879+0000 7f418400d740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f1d2c86af0 0x55f1d2c95540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:12.886 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.879+0000 7f418400d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1d2c87410 0x55f1d2c95a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:12.886 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.879+0000 7f418400d740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f1d2c91cb0 0x55f1d2c99b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:12.887 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.879+0000 7f418400d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f417c1adff0 con 0x55f1d2c87410 2024-09-19T06:15:12.887 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.879+0000 7f418400d740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f417c1af460 con 0x55f1d2c86af0 2024-09-19T06:15:12.887 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.879+0000 7f418400d740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f417c1ae6c0 con 0x55f1d2c91cb0 2024-09-19T06:15:12.887 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.879+0000 7f418400d740 10 client.0 _ll_register_callbacks cb 0x7f416c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:12.887 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.879+0000 7f417ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1d2c87410 0x55f1d2c95a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:12.887 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.879+0000 7f417ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1d2c87410 0x55f1d2c95a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40674/0 (socket says 172.21.15.2:40674) 2024-09-19T06:15:12.887 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.879+0000 7f417ad9d640 1 -- 172.21.15.2:0/509152842 learned_addr learned my addr 172.21.15.2:0/509152842 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:12.887 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.879+0000 7f417b59e640 1 --2- 172.21.15.2:0/509152842 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f1d2c91cb0 0x55f1d2c99b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:12.887 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.879+0000 7f417b59e640 1 --2- 172.21.15.2:0/509152842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f1d2c86af0 0x55f1d2c95540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:12.887 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.880+0000 7f417ad9d640 1 -- 172.21.15.2:0/509152842 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f1d2c91cb0 msgr2=0x55f1d2c99b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:12.887 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.880+0000 7f417ad9d640 1 --2- 172.21.15.2:0/509152842 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f1d2c91cb0 0x55f1d2c99b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.887 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.880+0000 7f417ad9d640 1 -- 172.21.15.2:0/509152842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f1d2c86af0 msgr2=0x55f1d2c95540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:12.887 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.880+0000 7f417ad9d640 1 --2- 172.21.15.2:0/509152842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f1d2c86af0 0x55f1d2c95540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.888 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.880+0000 7f417ad9d640 1 -- 172.21.15.2:0/509152842 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1d2c9a180 con 0x55f1d2c87410 2024-09-19T06:15:12.888 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.880+0000 7f417b59e640 1 --2- 172.21.15.2:0/509152842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f1d2c86af0 0x55f1d2c95540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:15:12.888 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.880+0000 7f417ad9d640 1 --2- 172.21.15.2:0/509152842 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1d2c87410 0x55f1d2c95a80 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f416c0043c0 tx=0x7f416c005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1edc6dbbb81255c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:12.888 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.880+0000 7f415eff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:15:12.888 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.880+0000 7f415eff5640 1 -- 172.21.15.2:0/509152842 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416c029040 con 0x55f1d2c87410 2024-09-19T06:15:12.888 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.880+0000 7f415eff5640 1 -- 172.21.15.2:0/509152842 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f416c003c50 con 0x55f1d2c87410 2024-09-19T06:15:12.888 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.880+0000 7f418400d740 1 -- 172.21.15.2:0/509152842 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f416c009dd0 con 0x55f1d2c87410 2024-09-19T06:15:12.888 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.880+0000 7f415eff5640 1 -- 172.21.15.2:0/509152842 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f416c049050 con 0x55f1d2c87410 2024-09-19T06:15:12.888 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.880+0000 7f418400d740 10 client.15375 fetch_fsmap learned FSMap version 26 2024-09-19T06:15:12.888 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.880+0000 7f418400d740 1 -- 172.21.15.2:0/509152842 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f1d2d0c0b0 con 0x55f1d2c87410 2024-09-19T06:15:12.888 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.880+0000 7f415eff5640 1 -- 172.21.15.2:0/509152842 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f416c009dd0 con 0x55f1d2c87410 2024-09-19T06:15:12.888 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.880+0000 7f415eff5640 1 -- 172.21.15.2:0/509152842 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f416c02e8f0 con 0x55f1d2c87410 2024-09-19T06:15:12.889 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.880+0000 7f418400d740 10 client.15375 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:15:12.889 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.880+0000 7f418400d740 10 client.15375 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:15:12.889 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.880+0000 7f418400d740 20 client.15375 populate_metadata read hostname 'smithi002' 2024-09-19T06:15:12.889 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.881+0000 7f418400d740 1 --2- 172.21.15.2:0/509152842 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55f1d2d0c6e0 0x55f1d2d0eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:12.889 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.881+0000 7f418400d740 4 client.15375 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:15:12.889 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.881+0000 7f418400d740 1 -- 172.21.15.2:0/509152842 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f1d2bf2d70 con 0x55f1d2d0c6e0 2024-09-19T06:15:12.889 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.881+0000 7f417b59e640 1 --2- 172.21.15.2:0/509152842 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55f1d2d0c6e0 0x55f1d2d0eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:12.889 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.881+0000 7f415eff5640 10 client.15375 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:15:12.889 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.881+0000 7f417b59e640 1 --2- 172.21.15.2:0/509152842 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55f1d2d0c6e0 0x55f1d2d0eb00 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f5c987eb6a6a server_cookie=e02e3d33f6b2c379 in_seq=0 out_seq=0 2024-09-19T06:15:12.895 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.892+0000 7f415eff5640 1 -- 172.21.15.2:0/509152842 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f1d2bf2d70 con 0x55f1d2d0c6e0 2024-09-19T06:15:12.895 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.892+0000 7f415eff5640 10 client.15375 handle_command_reply: tid=0 2024-09-19T06:15:12.895 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.893+0000 7f418400d740 1 client.15375 shutdown 2024-09-19T06:15:12.895 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.893+0000 7f418400d740 1 -- 172.21.15.2:0/509152842 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1d2c87410 msgr2=0x55f1d2c95a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:12.895 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.893+0000 7f418400d740 1 --2- 172.21.15.2:0/509152842 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1d2c87410 0x55f1d2c95a80 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f416c0043c0 tx=0x7f416c005f10 comp rx=0 tx=0).stop 2024-09-19T06:15:12.895 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.893+0000 7f418400d740 1 -- 172.21.15.2:0/509152842 shutdown_connections 2024-09-19T06:15:12.895 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.893+0000 7f418400d740 1 --2- 172.21.15.2:0/509152842 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f1d2c91cb0 0x55f1d2c99b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.895 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.893+0000 7f418400d740 1 --2- 172.21.15.2:0/509152842 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1d2c87410 0x55f1d2c95a80 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.895 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.893+0000 7f418400d740 1 --2- 172.21.15.2:0/509152842 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55f1d2d0c6e0 0x55f1d2d0eb00 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.895 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.893+0000 7f418400d740 1 --2- 172.21.15.2:0/509152842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f1d2c86af0 0x55f1d2c95540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.895 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.893+0000 7f415eff5640 0 client.15375 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:15:12.896 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.893+0000 7f418400d740 1 -- 172.21.15.2:0/509152842 >> 172.21.15.2:0/509152842 conn(0x55f1d2c83060 msgr2=0x55f1d2c821c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:12.896 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.893+0000 7f418400d740 1 -- 172.21.15.2:0/509152842 shutdown_connections 2024-09-19T06:15:12.896 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.893+0000 7f418400d740 1 -- 172.21.15.2:0/509152842 wait complete. 2024-09-19T06:15:12.896 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.893+0000 7f418400d740 20 client.15375 trim_cache size 0 max 16384 2024-09-19T06:15:12.897 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-19T06:15:12.897 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-19T06:15:12.897 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-19T06:15:12.897 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-19T06:15:12.898 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.893+0000 7f4181191640 1 -- 172.21.15.2:0/1463935711 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f41640a3560 msgr2=0x7f41640a5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:12.898 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.893+0000 7f4181191640 1 --2- 172.21.15.2:0/1463935711 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f41640a3560 0x7f41640a5a20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f41700cd220 tx=0x7f417006dad0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.898 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.893+0000 7f4181191640 1 -- 172.21.15.2:0/1463935711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f417c102470 msgr2=0x7f417c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:12.898 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.893+0000 7f4181191640 1 --2- 172.21.15.2:0/1463935711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f417c102470 0x7f417c074a30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f417000c890 tx=0x7f417000cd50 comp rx=0 tx=0).stop 2024-09-19T06:15:12.898 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.894+0000 7f4181191640 1 -- 172.21.15.2:0/1463935711 shutdown_connections 2024-09-19T06:15:12.898 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.894+0000 7f4181191640 1 --2- 172.21.15.2:0/1463935711 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f41640a3560 0x7f41640a5a20 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.898 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.894+0000 7f4181191640 1 --2- 172.21.15.2:0/1463935711 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f417c107b70 0x7f417c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.899 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.894+0000 7f4181191640 1 --2- 172.21.15.2:0/1463935711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f417c102470 0x7f417c074a30 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.899 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.894+0000 7f4181191640 1 --2- 172.21.15.2:0/1463935711 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f417c101ad0 0x7f417c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.899 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.894+0000 7f4181191640 1 -- 172.21.15.2:0/1463935711 >> 172.21.15.2:0/1463935711 conn(0x7f417c0fd7d0 msgr2=0x7f417c0ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:12.899 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.894+0000 7f4181191640 1 -- 172.21.15.2:0/1463935711 shutdown_connections 2024-09-19T06:15:12.899 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:12.894+0000 7f4181191640 1 -- 172.21.15.2:0/1463935711 wait complete. 2024-09-19T06:15:13.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:13 smithi002 ceph-mon[30982]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 23 op/s 2024-09-19T06:15:13.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:13 smithi002 ceph-mon[30982]: scrub summary: idle 2024-09-19T06:15:13.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:13 smithi090 ceph-mon[34497]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 23 op/s 2024-09-19T06:15:13.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:13 smithi090 ceph-mon[34497]: scrub summary: idle 2024-09-19T06:15:13.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:13 smithi089 ceph-mon[34160]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 23 op/s 2024-09-19T06:15:13.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:13 smithi089 ceph-mon[34160]: scrub summary: idle 2024-09-19T06:15:15.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:15 smithi002 ceph-mon[30982]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 25 op/s 2024-09-19T06:15:15.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:15 smithi090 ceph-mon[34497]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 25 op/s 2024-09-19T06:15:15.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:15 smithi089 ceph-mon[34160]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 25 op/s 2024-09-19T06:15:17.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:17 smithi002 ceph-mon[30982]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 26 KiB/s wr, 30 op/s 2024-09-19T06:15:17.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:17 smithi090 ceph-mon[34497]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 26 KiB/s wr, 30 op/s 2024-09-19T06:15:17.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:17 smithi089 ceph-mon[34160]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 26 KiB/s wr, 30 op/s 2024-09-19T06:15:19.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:19 smithi002 ceph-mon[30982]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-09-19T06:15:19.489 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:19 smithi090 ceph-mon[34497]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-09-19T06:15:19.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:19 smithi089 ceph-mon[34160]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-09-19T06:15:21.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:21 smithi002 ceph-mon[30982]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-09-19T06:15:21.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:21 smithi090 ceph-mon[34497]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-09-19T06:15:21.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:21 smithi089 ceph-mon[34160]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-09-19T06:15:23.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:23 smithi002 ceph-mon[30982]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-09-19T06:15:23.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:23 smithi090 ceph-mon[34497]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-09-19T06:15:23.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:23 smithi089 ceph-mon[34160]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-09-19T06:15:25.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:25 smithi002 ceph-mon[30982]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-09-19T06:15:25.489 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:25 smithi090 ceph-mon[34497]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-09-19T06:15:25.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:25 smithi089 ceph-mon[34160]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-09-19T06:15:25.987 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.983+0000 7f9967123640 1 -- 172.21.15.2:0/2150454515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9960101340 msgr2=0x7f996010d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:25.987 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.983+0000 7f9967123640 1 --2- 172.21.15.2:0/2150454515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9960101340 0x7f996010d870 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9958009cd0 tx=0x7f995802a8e0 comp rx=0 tx=0).stop 2024-09-19T06:15:25.987 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.983+0000 7f9967123640 1 -- 172.21.15.2:0/2150454515 shutdown_connections 2024-09-19T06:15:25.987 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.983+0000 7f9967123640 1 --2- 172.21.15.2:0/2150454515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9960101340 0x7f996010d870 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:25.987 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.983+0000 7f9967123640 1 --2- 172.21.15.2:0/2150454515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99601009a0 0x7f9960100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:25.988 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.983+0000 7f9967123640 1 --2- 172.21.15.2:0/2150454515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99601069b0 0x7f9960106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:25.988 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.983+0000 7f9967123640 1 -- 172.21.15.2:0/2150454515 >> 172.21.15.2:0/2150454515 conn(0x7f99600779a0 msgr2=0x7f99600fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:25.988 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.983+0000 7f9967123640 1 -- 172.21.15.2:0/2150454515 shutdown_connections 2024-09-19T06:15:25.988 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.983+0000 7f9967123640 1 -- 172.21.15.2:0/2150454515 wait complete. 2024-09-19T06:15:25.988 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.984+0000 7f9967123640 1 Processor -- start 2024-09-19T06:15:25.988 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.984+0000 7f9967123640 1 -- start start 2024-09-19T06:15:25.988 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.984+0000 7f9967123640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99601009a0 0x7f9960198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:25.989 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.984+0000 7f9967123640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9960101340 0x7f9960198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:25.989 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.984+0000 7f9967123640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99601069b0 0x7f996019cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:25.989 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.984+0000 7f9967123640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9960110cf0 con 0x7f9960101340 2024-09-19T06:15:25.989 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.984+0000 7f9967123640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9960110b70 con 0x7f99601009a0 2024-09-19T06:15:25.989 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.984+0000 7f9967123640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9960110e70 con 0x7f99601069b0 2024-09-19T06:15:25.989 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.984+0000 7f995ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9960101340 0x7f9960198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:25.989 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.984+0000 7f995ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9960101340 0x7f9960198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50644/0 (socket says 172.21.15.2:50644) 2024-09-19T06:15:25.989 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.984+0000 7f995ffff640 1 -- 172.21.15.2:0/3604196747 learned_addr learned my addr 172.21.15.2:0/3604196747 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:25.989 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.984+0000 7f99656c0640 1 --2- 172.21.15.2:0/3604196747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99601069b0 0x7f996019cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:25.989 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.985+0000 7f9964ebf640 1 --2- 172.21.15.2:0/3604196747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99601009a0 0x7f9960198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:25.989 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.985+0000 7f995ffff640 1 -- 172.21.15.2:0/3604196747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99601069b0 msgr2=0x7f996019cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:25.989 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.985+0000 7f995ffff640 1 --2- 172.21.15.2:0/3604196747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99601069b0 0x7f996019cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.985+0000 7f995ffff640 1 -- 172.21.15.2:0/3604196747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99601009a0 msgr2=0x7f9960198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.985+0000 7f995ffff640 1 --2- 172.21.15.2:0/3604196747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99601009a0 0x7f9960198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.985+0000 7f995ffff640 1 -- 172.21.15.2:0/3604196747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f996019d2f0 con 0x7f9960101340 2024-09-19T06:15:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.985+0000 7f9964ebf640 1 --2- 172.21.15.2:0/3604196747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99601009a0 0x7f9960198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:15:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.985+0000 7f995ffff640 1 --2- 172.21.15.2:0/3604196747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9960101340 0x7f9960198840 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f994c00e9f0 tx=0x7f994c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.985+0000 7f995dffb640 1 -- 172.21.15.2:0/3604196747 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994c00cd80 con 0x7f9960101340 2024-09-19T06:15:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.985+0000 7f9967123640 1 -- 172.21.15.2:0/3604196747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f996019d5e0 con 0x7f9960101340 2024-09-19T06:15:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.985+0000 7f995dffb640 1 -- 172.21.15.2:0/3604196747 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f994c0054d0 con 0x7f9960101340 2024-09-19T06:15:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.985+0000 7f995dffb640 1 -- 172.21.15.2:0/3604196747 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994c010490 con 0x7f9960101340 2024-09-19T06:15:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.985+0000 7f9967123640 1 -- 172.21.15.2:0/3604196747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99601a4e70 con 0x7f9960101340 2024-09-19T06:15:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.988+0000 7f995dffb640 1 -- 172.21.15.2:0/3604196747 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 24) ==== 138638+0+0 (secure 0 0 0) 0x7f994c005020 con 0x7f9960101340 2024-09-19T06:15:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.988+0000 7f9969eba740 1 Processor -- start 2024-09-19T06:15:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.988+0000 7f9969eba740 1 -- start start 2024-09-19T06:15:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.988+0000 7f9969eba740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636d6315af0 0x5636d6315ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.988+0000 7f9969eba740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636d6316410 0x5636d6320770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.988+0000 7f9969eba740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5636d6320cb0 0x5636d63230a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.988+0000 7f9969eba740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5636d627a2f0 con 0x5636d6315af0 2024-09-19T06:15:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.988+0000 7f9969eba740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5636d6222270 con 0x5636d6316410 2024-09-19T06:15:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.988+0000 7f9969eba740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5636d62762b0 con 0x5636d6320cb0 2024-09-19T06:15:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.988+0000 7f99656c0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636d6315af0 0x5636d6315ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.988+0000 7f995dffb640 1 --2- 172.21.15.2:0/3604196747 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f99500a3560 0x7f99500a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.988+0000 7f99656c0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636d6315af0 0x5636d6315ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50650/0 (socket says 172.21.15.2:50650) 2024-09-19T06:15:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.988+0000 7f99656c0640 1 -- 172.21.15.2:0/1479707474 learned_addr learned my addr 172.21.15.2:0/1479707474 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.988+0000 7f995ffff640 1 --2- 172.21.15.2:0/1479707474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5636d6320cb0 0x5636d63230a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.989+0000 7f9964ebf640 1 --2- 172.21.15.2:0/1479707474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636d6316410 0x5636d6320770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.989+0000 7f99656c0640 1 --2- 172.21.15.2:0/3604196747 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f99500a3560 0x7f99500a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.989+0000 7f995dffb640 1 -- 172.21.15.2:0/3604196747 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f994c0d03d0 con 0x7f9960101340 2024-09-19T06:15:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.989+0000 7f995ffff640 1 -- 172.21.15.2:0/1479707474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636d6316410 msgr2=0x5636d6320770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.989+0000 7f995ffff640 1 --2- 172.21.15.2:0/1479707474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636d6316410 0x5636d6320770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.989+0000 7f995ffff640 1 -- 172.21.15.2:0/1479707474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636d6315af0 msgr2=0x5636d6315ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.989+0000 7f995ffff640 1 --2- 172.21.15.2:0/1479707474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636d6315af0 0x5636d6315ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.989+0000 7f995ffff640 1 -- 172.21.15.2:0/1479707474 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636d6221340 con 0x5636d6320cb0 2024-09-19T06:15:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.989+0000 7f99656c0640 1 --2- 172.21.15.2:0/1479707474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636d6315af0 0x5636d6315ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.989+0000 7f995ffff640 1 --2- 172.21.15.2:0/1479707474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5636d6320cb0 0x5636d63230a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f994c0cd910 tx=0x7f994c00cf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e17c84ab65e593db server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.989+0000 7f99656c0640 1 --2- 172.21.15.2:0/3604196747 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f99500a3560 0x7f99500a5a20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9958009430 tx=0x7f995802a8e0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:25.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.989+0000 7f994affd640 1 -- 172.21.15.2:0/1479707474 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994c005310 con 0x5636d6320cb0 2024-09-19T06:15:25.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.989+0000 7f994affd640 1 -- 172.21.15.2:0/1479707474 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f994c005680 con 0x5636d6320cb0 2024-09-19T06:15:25.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.989+0000 7f994affd640 1 -- 172.21.15.2:0/1479707474 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994c09c700 con 0x5636d6320cb0 2024-09-19T06:15:25.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.990+0000 7f9969eba740 1 -- 172.21.15.2:0/1479707474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5636d6320cb0 msgr2=0x5636d63230a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:25.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.990+0000 7f9969eba740 1 --2- 172.21.15.2:0/1479707474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5636d6320cb0 0x5636d63230a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f994c0cd910 tx=0x7f994c00cf20 comp rx=0 tx=0).stop 2024-09-19T06:15:25.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.990+0000 7f9969eba740 1 -- 172.21.15.2:0/1479707474 shutdown_connections 2024-09-19T06:15:25.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.990+0000 7f9969eba740 1 --2- 172.21.15.2:0/1479707474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5636d6320cb0 0x5636d63230a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:25.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.990+0000 7f9969eba740 1 --2- 172.21.15.2:0/1479707474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636d6316410 0x5636d6320770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:25.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.990+0000 7f9969eba740 1 --2- 172.21.15.2:0/1479707474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636d6315af0 0x5636d6315ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:25.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.990+0000 7f9969eba740 1 -- 172.21.15.2:0/1479707474 >> 172.21.15.2:0/1479707474 conn(0x5636d6312060 msgr2=0x5636d6312440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:26.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.990+0000 7f9969eba740 1 -- 172.21.15.2:0/1479707474 shutdown_connections 2024-09-19T06:15:26.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.990+0000 7f9969eba740 1 -- 172.21.15.2:0/1479707474 wait complete. 2024-09-19T06:15:26.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.990+0000 7f9969eba740 1 -- start start 2024-09-19T06:15:26.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.991+0000 7f9969eba740 1 Processor -- start 2024-09-19T06:15:26.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.991+0000 7f9969eba740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636d6315af0 0x5636d631daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:26.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.991+0000 7f9969eba740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636d6316410 0x5636d631e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:26.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.991+0000 7f9969eba740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5636d6320cb0 0x5636d631e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:26.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.991+0000 7f9969eba740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5636d6323880 con 0x5636d6316410 2024-09-19T06:15:26.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.991+0000 7f9969eba740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5636d6203290 con 0x5636d6315af0 2024-09-19T06:15:26.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.991+0000 7f9969eba740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5636d6323a00 con 0x5636d6320cb0 2024-09-19T06:15:26.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.991+0000 7f9969eba740 10 client.0 _ll_register_callbacks cb 0x5636d6234140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:26.001 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.991+0000 7f995ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636d6316410 0x5636d631e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:26.001 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.991+0000 7f995ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636d6316410 0x5636d631e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50652/0 (socket says 172.21.15.2:50652) 2024-09-19T06:15:26.001 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.991+0000 7f995ffff640 1 -- 172.21.15.2:0/2389154631 learned_addr learned my addr 172.21.15.2:0/2389154631 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:26.001 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.991+0000 7f99656c0640 1 --2- 172.21.15.2:0/2389154631 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5636d6320cb0 0x5636d631e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:26.001 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.991+0000 7f9964ebf640 1 --2- 172.21.15.2:0/2389154631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636d6315af0 0x5636d631daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:26.001 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.991+0000 7f99656c0640 1 -- 172.21.15.2:0/2389154631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636d6315af0 msgr2=0x5636d631daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:26.001 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.991+0000 7f99656c0640 1 --2- 172.21.15.2:0/2389154631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636d6315af0 0x5636d631daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:26.001 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.991+0000 7f99656c0640 1 -- 172.21.15.2:0/2389154631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636d6316410 msgr2=0x5636d631e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:26.001 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.992+0000 7f99656c0640 1 --2- 172.21.15.2:0/2389154631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636d6316410 0x5636d631e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:26.001 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.992+0000 7f99656c0640 1 -- 172.21.15.2:0/2389154631 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636d5f8d210 con 0x5636d6320cb0 2024-09-19T06:15:26.001 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.992+0000 7f995ffff640 1 --2- 172.21.15.2:0/2389154631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636d6316410 0x5636d631e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:26.001 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.992+0000 7f99656c0640 1 --2- 172.21.15.2:0/2389154631 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5636d6320cb0 0x5636d631e570 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f995802ae00 tx=0x7f99580095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88eb0429d712c87b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:26.002 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.992+0000 7f993ffff640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-19T06:15:26.002 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.992+0000 7f993ffff640 1 -- 172.21.15.2:0/2389154631 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995804e070 con 0x5636d6320cb0 2024-09-19T06:15:26.002 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.992+0000 7f9969eba740 1 -- 172.21.15.2:0/2389154631 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f994c005680 con 0x5636d6320cb0 2024-09-19T06:15:26.002 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.992+0000 7f993ffff640 1 -- 172.21.15.2:0/2389154631 <== mon.1 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f9958004720 con 0x5636d6320cb0 2024-09-19T06:15:26.002 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.992+0000 7f993ffff640 1 -- 172.21.15.2:0/2389154631 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f995805a050 con 0x5636d6320cb0 2024-09-19T06:15:26.002 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.992+0000 7f9969eba740 10 client.25042 fetch_fsmap learned FSMap version 26 2024-09-19T06:15:26.002 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.992+0000 7f9969eba740 1 -- 172.21.15.2:0/2389154631 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5636d6059620 con 0x5636d6320cb0 2024-09-19T06:15:26.002 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.992+0000 7f993ffff640 1 -- 172.21.15.2:0/2389154631 <== mon.1 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f994c005680 con 0x5636d6320cb0 2024-09-19T06:15:26.002 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.993+0000 7f993ffff640 1 -- 172.21.15.2:0/2389154631 <== mon.1 v2:172.21.15.90:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f9958030070 con 0x5636d6320cb0 2024-09-19T06:15:26.002 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.993+0000 7f9969eba740 10 client.25042 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:15:26.002 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.993+0000 7f9969eba740 10 client.25042 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:15:26.002 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.993+0000 7f9969eba740 20 client.25042 populate_metadata read hostname 'smithi002' 2024-09-19T06:15:26.002 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.993+0000 7f9969eba740 1 --2- 172.21.15.2:0/2389154631 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5636d6330b50 0x5636d6332f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:26.003 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.993+0000 7f9969eba740 4 client.25042 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:15:26.003 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.993+0000 7f9969eba740 1 -- 172.21.15.2:0/2389154631 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5636d6287a20 con 0x5636d6330b50 2024-09-19T06:15:26.003 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.993+0000 7f9964ebf640 1 --2- 172.21.15.2:0/2389154631 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5636d6330b50 0x5636d6332f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:26.003 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.993+0000 7f993ffff640 10 client.25042 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:15:26.003 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.993+0000 7f9964ebf640 1 --2- 172.21.15.2:0/2389154631 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5636d6330b50 0x5636d6332f40 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=674f4b9cf09ee499 server_cookie=a577900d83494352 in_seq=0 out_seq=0 2024-09-19T06:15:26.003 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.994+0000 7f993ffff640 1 -- 172.21.15.2:0/2389154631 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5636d6287a20 con 0x5636d6330b50 2024-09-19T06:15:26.003 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.994+0000 7f993ffff640 10 client.25042 handle_command_reply: tid=0 2024-09-19T06:15:26.003 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.994+0000 7f9969eba740 1 client.25042 shutdown 2024-09-19T06:15:26.003 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.994+0000 7f9969eba740 1 -- 172.21.15.2:0/2389154631 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5636d6320cb0 msgr2=0x5636d631e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:26.003 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.994+0000 7f9969eba740 1 --2- 172.21.15.2:0/2389154631 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5636d6320cb0 0x5636d631e570 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f995802ae00 tx=0x7f99580095c0 comp rx=0 tx=0).stop 2024-09-19T06:15:26.003 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.994+0000 7f9969eba740 1 -- 172.21.15.2:0/2389154631 shutdown_connections 2024-09-19T06:15:26.004 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.994+0000 7f9969eba740 1 --2- 172.21.15.2:0/2389154631 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5636d6320cb0 0x5636d631e570 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:26.004 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.994+0000 7f9969eba740 1 --2- 172.21.15.2:0/2389154631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636d6316410 0x5636d631e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:26.004 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.994+0000 7f9969eba740 1 --2- 172.21.15.2:0/2389154631 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5636d6330b50 0x5636d6332f40 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:26.004 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.994+0000 7f9969eba740 1 --2- 172.21.15.2:0/2389154631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636d6315af0 0x5636d631daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:26.004 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.994+0000 7f993ffff640 0 client.25042 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:15:26.004 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.994+0000 7f9969eba740 1 -- 172.21.15.2:0/2389154631 >> 172.21.15.2:0/2389154631 conn(0x5636d6312060 msgr2=0x5636d63111c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:26.004 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.994+0000 7f9969eba740 1 -- 172.21.15.2:0/2389154631 shutdown_connections 2024-09-19T06:15:26.004 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.994+0000 7f9969eba740 1 -- 172.21.15.2:0/2389154631 wait complete. 2024-09-19T06:15:26.004 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:25.995+0000 7f9969eba740 20 client.25042 trim_cache size 0 max 16384 2024-09-19T06:15:26.012 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.009+0000 7f9969eba740 1 Processor -- start 2024-09-19T06:15:26.012 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.009+0000 7f9969eba740 1 -- start start 2024-09-19T06:15:26.012 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.009+0000 7f9969eba740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636d6315af0 0x5636d631e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:26.012 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.009+0000 7f9969eba740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636d6316410 0x5636d6338830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:26.012 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.009+0000 7f9969eba740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5636d6320cb0 0x5636d6338d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:26.012 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.009+0000 7f9969eba740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f99601b0010 con 0x5636d6315af0 2024-09-19T06:15:26.012 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.009+0000 7f9969eba740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f99601ad8e0 con 0x5636d6316410 2024-09-19T06:15:26.012 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.009+0000 7f9969eba740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f99601ab730 con 0x5636d6320cb0 2024-09-19T06:15:26.012 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.009+0000 7f9964ebf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636d6315af0 0x5636d631e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:26.013 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.009+0000 7f9964ebf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636d6315af0 0x5636d631e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50658/0 (socket says 172.21.15.2:50658) 2024-09-19T06:15:26.013 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.009+0000 7f9964ebf640 1 -- 172.21.15.2:0/422793985 learned_addr learned my addr 172.21.15.2:0/422793985 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:26.013 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.010+0000 7f99656c0640 1 --2- 172.21.15.2:0/422793985 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5636d6320cb0 0x5636d6338d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:26.013 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.010+0000 7f995ffff640 1 --2- 172.21.15.2:0/422793985 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636d6316410 0x5636d6338830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:26.013 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.010+0000 7f9964ebf640 1 -- 172.21.15.2:0/422793985 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5636d6320cb0 msgr2=0x5636d6338d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:26.013 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.010+0000 7f9964ebf640 1 --2- 172.21.15.2:0/422793985 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5636d6320cb0 0x5636d6338d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:26.013 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.010+0000 7f9964ebf640 1 -- 172.21.15.2:0/422793985 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636d6316410 msgr2=0x5636d6338830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:26.013 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.010+0000 7f9964ebf640 1 --2- 172.21.15.2:0/422793985 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636d6316410 0x5636d6338830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:26.013 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.010+0000 7f9964ebf640 1 -- 172.21.15.2:0/422793985 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636d63335a0 con 0x5636d6315af0 2024-09-19T06:15:26.013 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.010+0000 7f9964ebf640 1 --2- 172.21.15.2:0/422793985 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636d6315af0 0x5636d631e3a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x5636d63337a0 tx=0x7f9954014840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98f8a672750f1d0d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:26.014 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.010+0000 7f994a7fc640 1 -- 172.21.15.2:0/422793985 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99540140d0 con 0x5636d6315af0 2024-09-19T06:15:26.014 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.010+0000 7f994a7fc640 1 -- 172.21.15.2:0/422793985 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9954014270 con 0x5636d6315af0 2024-09-19T06:15:26.014 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.010+0000 7f994a7fc640 1 -- 172.21.15.2:0/422793985 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9954004e40 con 0x5636d6315af0 2024-09-19T06:15:26.018 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.011+0000 7f9969eba740 1 -- 172.21.15.2:0/422793985 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636d6315af0 msgr2=0x5636d631e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:26.018 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.011+0000 7f9969eba740 1 --2- 172.21.15.2:0/422793985 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636d6315af0 0x5636d631e3a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x5636d63337a0 tx=0x7f9954014840 comp rx=0 tx=0).stop 2024-09-19T06:15:26.018 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.011+0000 7f9969eba740 1 -- 172.21.15.2:0/422793985 shutdown_connections 2024-09-19T06:15:26.018 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.011+0000 7f9969eba740 1 --2- 172.21.15.2:0/422793985 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5636d6320cb0 0x5636d6338d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:26.018 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.011+0000 7f9969eba740 1 --2- 172.21.15.2:0/422793985 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636d6316410 0x5636d6338830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:26.018 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.011+0000 7f9969eba740 1 --2- 172.21.15.2:0/422793985 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636d6315af0 0x5636d631e3a0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:26.018 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.011+0000 7f9969eba740 1 -- 172.21.15.2:0/422793985 >> 172.21.15.2:0/422793985 conn(0x5636d6312060 msgr2=0x5636d631fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:26.018 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.011+0000 7f9969eba740 1 -- 172.21.15.2:0/422793985 shutdown_connections 2024-09-19T06:15:26.018 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.011+0000 7f9969eba740 1 -- 172.21.15.2:0/422793985 wait complete. 2024-09-19T06:15:26.018 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.011+0000 7f9969eba740 1 -- start start 2024-09-19T06:15:26.018 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.011+0000 7f9969eba740 1 Processor -- start 2024-09-19T06:15:26.018 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.012+0000 7f9969eba740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5636d6315af0 0x5636d63291a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.012+0000 7f9969eba740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636d6316410 0x5636d631a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.012+0000 7f9969eba740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636d6320cb0 0x5636d631aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.012+0000 7f9969eba740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f99601abda0 con 0x5636d6316410 2024-09-19T06:15:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.012+0000 7f9969eba740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f99601ad210 con 0x5636d6320cb0 2024-09-19T06:15:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.012+0000 7f9969eba740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f99601ac470 con 0x5636d6315af0 2024-09-19T06:15:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.012+0000 7f9969eba740 10 client.0 _ll_register_callbacks cb 0x7f9958009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.012+0000 7f995ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636d6316410 0x5636d631a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.012+0000 7f9964ebf640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5636d6315af0 0x5636d63291a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.012+0000 7f995ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636d6316410 0x5636d631a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50662/0 (socket says 172.21.15.2:50662) 2024-09-19T06:15:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.012+0000 7f995ffff640 1 -- 172.21.15.2:0/2773844598 learned_addr learned my addr 172.21.15.2:0/2773844598 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.012+0000 7f9964ebf640 1 -- 172.21.15.2:0/2773844598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636d6320cb0 msgr2=0x5636d631aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.012+0000 7f99656c0640 1 --2- 172.21.15.2:0/2773844598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636d6320cb0 0x5636d631aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:26.020 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.012+0000 7f9964ebf640 1 --2- 172.21.15.2:0/2773844598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636d6320cb0 0x5636d631aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:26.020 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.012+0000 7f9964ebf640 1 -- 172.21.15.2:0/2773844598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636d6316410 msgr2=0x5636d631a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:26.020 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.012+0000 7f9964ebf640 1 --2- 172.21.15.2:0/2773844598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636d6316410 0x5636d631a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:26.020 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.012+0000 7f9964ebf640 1 -- 172.21.15.2:0/2773844598 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636d631b030 con 0x5636d6315af0 2024-09-19T06:15:26.020 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.012+0000 7f995ffff640 1 --2- 172.21.15.2:0/2773844598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636d6316410 0x5636d631a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:26.020 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.012+0000 7f99656c0640 1 --2- 172.21.15.2:0/2773844598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636d6320cb0 0x5636d631aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:15:26.020 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.013+0000 7f9964ebf640 1 --2- 172.21.15.2:0/2773844598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5636d6315af0 0x5636d63291a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9954014440 tx=0x7f9954009d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37f617b59b4577aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:26.020 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.013+0000 7f993ffff640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-19T06:15:26.020 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.013+0000 7f993ffff640 1 -- 172.21.15.2:0/2773844598 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9954012450 con 0x5636d6315af0 2024-09-19T06:15:26.020 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.013+0000 7f993ffff640 1 -- 172.21.15.2:0/2773844598 <== mon.1 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f9954022070 con 0x5636d6315af0 2024-09-19T06:15:26.020 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.013+0000 7f9969eba740 1 -- 172.21.15.2:0/2773844598 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9954014270 con 0x5636d6315af0 2024-09-19T06:15:26.020 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.013+0000 7f993ffff640 1 -- 172.21.15.2:0/2773844598 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f99540125f0 con 0x5636d6315af0 2024-09-19T06:15:26.020 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.013+0000 7f9969eba740 10 client.25048 fetch_fsmap learned FSMap version 26 2024-09-19T06:15:26.021 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.013+0000 7f9969eba740 1 -- 172.21.15.2:0/2773844598 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5636d6327a60 con 0x5636d6315af0 2024-09-19T06:15:26.021 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.013+0000 7f993ffff640 1 -- 172.21.15.2:0/2773844598 <== mon.1 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9954014270 con 0x5636d6315af0 2024-09-19T06:15:26.021 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.013+0000 7f993ffff640 1 -- 172.21.15.2:0/2773844598 <== mon.1 v2:172.21.15.90:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f995400f040 con 0x5636d6315af0 2024-09-19T06:15:26.021 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.013+0000 7f9969eba740 10 client.25048 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:15:26.021 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.013+0000 7f9969eba740 10 client.25048 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:15:26.021 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.013+0000 7f9969eba740 20 client.25048 populate_metadata read hostname 'smithi002' 2024-09-19T06:15:26.021 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.013+0000 7f9969eba740 1 --2- 172.21.15.2:0/2773844598 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5636d639bc60 0x5636d639e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:26.021 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.013+0000 7f9969eba740 4 client.25048 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:15:26.021 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.013+0000 7f9969eba740 1 -- 172.21.15.2:0/2773844598 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5636d6281d70 con 0x5636d639bc60 2024-09-19T06:15:26.021 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.014+0000 7f995ffff640 1 --2- 172.21.15.2:0/2773844598 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5636d639bc60 0x5636d639e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:26.021 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.014+0000 7f995ffff640 1 --2- 172.21.15.2:0/2773844598 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5636d639bc60 0x5636d639e080 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=490e7bec879b2966 server_cookie=9034f4e648a31d98 in_seq=0 out_seq=0 2024-09-19T06:15:26.021 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.014+0000 7f993ffff640 10 client.25048 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:15:26.023 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.020+0000 7f993ffff640 1 -- 172.21.15.2:0/2773844598 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5636d6281d70 con 0x5636d639bc60 2024-09-19T06:15:26.023 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.020+0000 7f993ffff640 10 client.25048 handle_command_reply: tid=0 2024-09-19T06:15:26.023 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.020+0000 7f9969eba740 1 client.25048 shutdown 2024-09-19T06:15:26.023 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.020+0000 7f9969eba740 1 -- 172.21.15.2:0/2773844598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5636d6315af0 msgr2=0x5636d63291a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:26.023 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.020+0000 7f9969eba740 1 --2- 172.21.15.2:0/2773844598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5636d6315af0 0x5636d63291a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9954014440 tx=0x7f9954009d30 comp rx=0 tx=0).stop 2024-09-19T06:15:26.023 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.020+0000 7f9969eba740 1 -- 172.21.15.2:0/2773844598 shutdown_connections 2024-09-19T06:15:26.023 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.020+0000 7f9969eba740 1 --2- 172.21.15.2:0/2773844598 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5636d639bc60 0x5636d639e080 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:26.023 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.020+0000 7f9969eba740 1 --2- 172.21.15.2:0/2773844598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636d6320cb0 0x5636d631aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:26.023 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.020+0000 7f9969eba740 1 --2- 172.21.15.2:0/2773844598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636d6316410 0x5636d631a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:26.023 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.020+0000 7f9969eba740 1 --2- 172.21.15.2:0/2773844598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5636d6315af0 0x5636d63291a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:26.023 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.020+0000 7f993ffff640 0 client.25048 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:15:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.020+0000 7f9969eba740 1 -- 172.21.15.2:0/2773844598 >> 172.21.15.2:0/2773844598 conn(0x5636d6312060 msgr2=0x5636d63109a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.020+0000 7f9969eba740 1 -- 172.21.15.2:0/2773844598 shutdown_connections 2024-09-19T06:15:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.020+0000 7f9969eba740 1 -- 172.21.15.2:0/2773844598 wait complete. 2024-09-19T06:15:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.020+0000 7f9969eba740 20 client.25048 trim_cache size 0 max 16384 2024-09-19T06:15:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-19T06:15:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-19T06:15:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-19T06:15:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-19T06:15:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.021+0000 7f9967123640 1 -- 172.21.15.2:0/3604196747 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f99500a3560 msgr2=0x7f99500a5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.021+0000 7f9967123640 1 --2- 172.21.15.2:0/3604196747 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f99500a3560 0x7f99500a5a20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9958009430 tx=0x7f995802a8e0 comp rx=0 tx=0).stop 2024-09-19T06:15:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.021+0000 7f9967123640 1 -- 172.21.15.2:0/3604196747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9960101340 msgr2=0x7f9960198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.021+0000 7f9967123640 1 --2- 172.21.15.2:0/3604196747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9960101340 0x7f9960198840 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f994c00e9f0 tx=0x7f994c00edf0 comp rx=0 tx=0).stop 2024-09-19T06:15:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.021+0000 7f9967123640 1 -- 172.21.15.2:0/3604196747 shutdown_connections 2024-09-19T06:15:26.026 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.021+0000 7f9967123640 1 --2- 172.21.15.2:0/3604196747 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f99500a3560 0x7f99500a5a20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:26.026 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.021+0000 7f9967123640 1 --2- 172.21.15.2:0/3604196747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99601069b0 0x7f996019cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:26.026 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.021+0000 7f9967123640 1 --2- 172.21.15.2:0/3604196747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9960101340 0x7f9960198840 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:26.026 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.021+0000 7f9967123640 1 --2- 172.21.15.2:0/3604196747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99601009a0 0x7f9960198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:26.026 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.021+0000 7f9967123640 1 -- 172.21.15.2:0/3604196747 >> 172.21.15.2:0/3604196747 conn(0x7f99600779a0 msgr2=0x7f9960102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:26.026 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.021+0000 7f9967123640 1 -- 172.21.15.2:0/3604196747 shutdown_connections 2024-09-19T06:15:26.026 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:26.021+0000 7f9967123640 1 -- 172.21.15.2:0/3604196747 wait complete. 2024-09-19T06:15:27.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:27 smithi002 ceph-mon[30982]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-19T06:15:27.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:27 smithi090 ceph-mon[34497]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-19T06:15:27.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:27 smithi089 ceph-mon[34160]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-19T06:15:29.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:29 smithi002 ceph-mon[30982]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:15:29.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:29 smithi090 ceph-mon[34497]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:15:29.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:29 smithi089 ceph-mon[34160]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:15:30.637 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:15:30.961 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:15:31.345 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:31 smithi002 ceph-mon[30982]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-19T06:15:31.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:31 smithi090 ceph-mon[34497]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-19T06:15:31.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.517+0000 7f7e92ece640 1 -- 172.21.15.2:0/2493341784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e8c100e20 msgr2=0x7f7e8c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:31.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.517+0000 7f7e92ece640 1 --2- 172.21.15.2:0/2493341784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e8c100e20 0x7f7e8c101200 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f7e80009900 tx=0x7f7e8002a480 comp rx=0 tx=0).stop 2024-09-19T06:15:31.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.517+0000 7f7e92ece640 1 -- 172.21.15.2:0/2493341784 shutdown_connections 2024-09-19T06:15:31.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.517+0000 7f7e92ece640 1 --2- 172.21.15.2:0/2493341784 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e8c102ef0 0x7f7e8c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:31.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.517+0000 7f7e92ece640 1 --2- 172.21.15.2:0/2493341784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e8c102570 0x7f7e8c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:31.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.518+0000 7f7e92ece640 1 --2- 172.21.15.2:0/2493341784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e8c100e20 0x7f7e8c101200 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:31.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.518+0000 7f7e92ece640 1 -- 172.21.15.2:0/2493341784 >> 172.21.15.2:0/2493341784 conn(0x7f7e8c0fc7d0 msgr2=0x7f7e8c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:31.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.518+0000 7f7e92ece640 1 -- 172.21.15.2:0/2493341784 shutdown_connections 2024-09-19T06:15:31.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.518+0000 7f7e92ece640 1 -- 172.21.15.2:0/2493341784 wait complete. 2024-09-19T06:15:31.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.519+0000 7f7e92ece640 1 Processor -- start 2024-09-19T06:15:31.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.519+0000 7f7e92ece640 1 -- start start 2024-09-19T06:15:31.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.520+0000 7f7e92ece640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e8c100e20 0x7f7e8c197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:31.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.520+0000 7f7e92ece640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e8c102570 0x7f7e8c197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:31.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.520+0000 7f7e92ece640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e8c102ef0 0x7f7e8c19bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:31.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.520+0000 7f7e92ece640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8c110e00 con 0x7f7e8c100e20 2024-09-19T06:15:31.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.520+0000 7f7e92ece640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8c110c80 con 0x7f7e8c102570 2024-09-19T06:15:31.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.520+0000 7f7e92ece640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8c110f80 con 0x7f7e8c102ef0 2024-09-19T06:15:31.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.520+0000 7f7e9146b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e8c102ef0 0x7f7e8c19bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:31.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.520+0000 7f7e9146b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e8c102ef0 0x7f7e8c19bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:55066/0 (socket says 172.21.15.2:55066) 2024-09-19T06:15:31.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.520+0000 7f7e9146b640 1 -- 172.21.15.2:0/2124733473 learned_addr learned my addr 172.21.15.2:0/2124733473 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:31.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.520+0000 7f7e90c6a640 1 --2- 172.21.15.2:0/2124733473 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e8c100e20 0x7f7e8c197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:31.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.520+0000 7f7e8bfff640 1 --2- 172.21.15.2:0/2124733473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e8c102570 0x7f7e8c197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:31.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.520+0000 7f7e9146b640 1 -- 172.21.15.2:0/2124733473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e8c102570 msgr2=0x7f7e8c197840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:31.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.520+0000 7f7e9146b640 1 --2- 172.21.15.2:0/2124733473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e8c102570 0x7f7e8c197840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:31.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.520+0000 7f7e9146b640 1 -- 172.21.15.2:0/2124733473 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e8c100e20 msgr2=0x7f7e8c197300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:31.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.520+0000 7f7e9146b640 1 --2- 172.21.15.2:0/2124733473 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e8c100e20 0x7f7e8c197300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:31.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.520+0000 7f7e9146b640 1 -- 172.21.15.2:0/2124733473 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e8c19c2b0 con 0x7f7e8c102ef0 2024-09-19T06:15:31.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.521+0000 7f7e9146b640 1 --2- 172.21.15.2:0/2124733473 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e8c102ef0 0x7f7e8c19bbd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7e84009fd0 tx=0x7f7e8400b260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:31.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.521+0000 7f7e89ffb640 1 -- 172.21.15.2:0/2124733473 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e84017070 con 0x7f7e8c102ef0 2024-09-19T06:15:31.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.521+0000 7f7e92ece640 1 -- 172.21.15.2:0/2124733473 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e8c19c5a0 con 0x7f7e8c102ef0 2024-09-19T06:15:31.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.521+0000 7f7e89ffb640 1 -- 172.21.15.2:0/2124733473 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7e84003e20 con 0x7f7e8c102ef0 2024-09-19T06:15:31.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.521+0000 7f7e89ffb640 1 -- 172.21.15.2:0/2124733473 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e840106c0 con 0x7f7e8c102ef0 2024-09-19T06:15:31.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.521+0000 7f7e92ece640 1 -- 172.21.15.2:0/2124733473 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e8c069f70 con 0x7f7e8c102ef0 2024-09-19T06:15:31.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.523+0000 7f7e89ffb640 1 -- 172.21.15.2:0/2124733473 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 24) ==== 138638+0+0 (secure 0 0 0) 0x7f7e84003970 con 0x7f7e8c102ef0 2024-09-19T06:15:31.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.524+0000 7f7e952a7740 1 Processor -- start 2024-09-19T06:15:31.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.524+0000 7f7e952a7740 1 -- start start 2024-09-19T06:15:31.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.524+0000 7f7e89ffb640 1 --2- 172.21.15.2:0/2124733473 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f7e7c0a3560 0x7f7e7c0a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:31.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.525+0000 7f7e89ffb640 1 -- 172.21.15.2:0/2124733473 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f7e840cff00 con 0x7f7e8c102ef0 2024-09-19T06:15:31.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.525+0000 7f7e8bfff640 1 --2- 172.21.15.2:0/2124733473 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f7e7c0a3560 0x7f7e7c0a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:31.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.525+0000 7f7e952a7740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae6563a4a0 0x55ae6563a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:31.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.525+0000 7f7e952a7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae6563adc0 0x55ae65645140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:31.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.525+0000 7f7e952a7740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ae65645680 0x55ae65647a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:31.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.525+0000 7f7e8bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae6563adc0 0x55ae65645140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:31.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.525+0000 7f7e8bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae6563adc0 0x55ae65645140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50688/0 (socket says 172.21.15.2:50688) 2024-09-19T06:15:31.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.525+0000 7f7e8bfff640 1 -- 172.21.15.2:0/2801891527 learned_addr learned my addr 172.21.15.2:0/2801891527 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:31.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.525+0000 7f7e952a7740 1 -- 172.21.15.2:0/2801891527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ae655a02e0 con 0x55ae6563adc0 2024-09-19T06:15:31.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.525+0000 7f7e952a7740 1 -- 172.21.15.2:0/2801891527 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55ae65547ce0 con 0x55ae65645680 2024-09-19T06:15:31.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.525+0000 7f7e952a7740 1 -- 172.21.15.2:0/2801891527 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55ae6559c2a0 con 0x55ae6563a4a0 2024-09-19T06:15:31.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.525+0000 7f7e9146b640 1 --2- 172.21.15.2:0/2801891527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ae65645680 0x55ae65647a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:31.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.526+0000 7f7e90c6a640 1 --2- 172.21.15.2:0/2801891527 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae6563a4a0 0x55ae6563a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:31.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.526+0000 7f7e9146b640 1 -- 172.21.15.2:0/2801891527 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae6563a4a0 msgr2=0x55ae6563a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:31.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.526+0000 7f7e9146b640 1 --2- 172.21.15.2:0/2801891527 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae6563a4a0 0x55ae6563a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:31.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.526+0000 7f7e9146b640 1 -- 172.21.15.2:0/2801891527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae6563adc0 msgr2=0x55ae65645140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:31.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.526+0000 7f7e9146b640 1 --2- 172.21.15.2:0/2801891527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae6563adc0 0x55ae65645140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:31.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.526+0000 7f7e9146b640 1 -- 172.21.15.2:0/2801891527 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae6552c440 con 0x55ae65645680 2024-09-19T06:15:31.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.526+0000 7f7e8bfff640 1 --2- 172.21.15.2:0/2801891527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae6563adc0 0x55ae65645140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:31.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.526+0000 7f7e90c6a640 1 --2- 172.21.15.2:0/2801891527 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae6563a4a0 0x55ae6563a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:15:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.526+0000 7f7e8bfff640 1 --2- 172.21.15.2:0/2124733473 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f7e7c0a3560 0x7f7e7c0a5a20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c0ffdf0 tx=0x7f7e780107a0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.526+0000 7f7e9146b640 1 --2- 172.21.15.2:0/2801891527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ae65645680 0x55ae65647a70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7e840cd440 tx=0x7f7e84003c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63ddd8ea64222052 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.526+0000 7f7e76ffd640 1 -- 172.21.15.2:0/2801891527 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e84020040 con 0x55ae65645680 2024-09-19T06:15:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.527+0000 7f7e76ffd640 1 -- 172.21.15.2:0/2801891527 <== mon.2 v2:172.21.15.89:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7e840a0380 con 0x55ae65645680 2024-09-19T06:15:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.527+0000 7f7e76ffd640 1 -- 172.21.15.2:0/2801891527 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e840a4a10 con 0x55ae65645680 2024-09-19T06:15:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.527+0000 7f7e952a7740 1 -- 172.21.15.2:0/2801891527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ae65645680 msgr2=0x55ae65647a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.527+0000 7f7e952a7740 1 --2- 172.21.15.2:0/2801891527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ae65645680 0x55ae65647a70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7e840cd440 tx=0x7f7e84003c60 comp rx=0 tx=0).stop 2024-09-19T06:15:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.528+0000 7f7e952a7740 1 -- 172.21.15.2:0/2801891527 shutdown_connections 2024-09-19T06:15:31.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.528+0000 7f7e952a7740 1 --2- 172.21.15.2:0/2801891527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ae65645680 0x55ae65647a70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:31.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.528+0000 7f7e952a7740 1 --2- 172.21.15.2:0/2801891527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae6563adc0 0x55ae65645140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:31.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.528+0000 7f7e952a7740 1 --2- 172.21.15.2:0/2801891527 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae6563a4a0 0x55ae6563a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:31.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.528+0000 7f7e952a7740 1 -- 172.21.15.2:0/2801891527 >> 172.21.15.2:0/2801891527 conn(0x55ae65636a30 msgr2=0x55ae65636e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:31.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.528+0000 7f7e952a7740 1 -- 172.21.15.2:0/2801891527 shutdown_connections 2024-09-19T06:15:31.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.528+0000 7f7e952a7740 1 -- 172.21.15.2:0/2801891527 wait complete. 2024-09-19T06:15:31.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.528+0000 7f7e952a7740 1 -- start start 2024-09-19T06:15:31.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.529+0000 7f7e952a7740 1 Processor -- start 2024-09-19T06:15:31.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.529+0000 7f7e952a7740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ae6563a4a0 0x55ae65645010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:31.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.530+0000 7f7e952a7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae6563adc0 0x55ae656422c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:31.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.530+0000 7f7e952a7740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae65645680 0x55ae65642840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:31.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.530+0000 7f7e90c6a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ae6563a4a0 0x55ae65645010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:31.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.530+0000 7f7e90c6a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ae6563a4a0 0x55ae65645010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:43276/0 (socket says 172.21.15.2:43276) 2024-09-19T06:15:31.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.530+0000 7f7e90c6a640 1 -- 172.21.15.2:0/3228007230 learned_addr learned my addr 172.21.15.2:0/3228007230 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:31.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.530+0000 7f7e8bfff640 1 --2- 172.21.15.2:0/3228007230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae6563adc0 0x55ae656422c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:31.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.530+0000 7f7e952a7740 1 -- 172.21.15.2:0/3228007230 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ae65648250 con 0x55ae6563adc0 2024-09-19T06:15:31.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.530+0000 7f7e952a7740 1 -- 172.21.15.2:0/3228007230 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55ae6555b050 con 0x55ae6563a4a0 2024-09-19T06:15:31.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.530+0000 7f7e952a7740 1 -- 172.21.15.2:0/3228007230 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55ae656483d0 con 0x55ae65645680 2024-09-19T06:15:31.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.530+0000 7f7e952a7740 10 client.0 _ll_register_callbacks cb 0x55ae6559b160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:31.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.530+0000 7f7e9146b640 1 --2- 172.21.15.2:0/3228007230 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae65645680 0x55ae65642840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:31.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.530+0000 7f7e8bfff640 1 -- 172.21.15.2:0/3228007230 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae65645680 msgr2=0x55ae65642840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:31.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.530+0000 7f7e8bfff640 1 --2- 172.21.15.2:0/3228007230 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae65645680 0x55ae65642840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:31.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.530+0000 7f7e8bfff640 1 -- 172.21.15.2:0/3228007230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ae6563a4a0 msgr2=0x55ae65645010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:31.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.530+0000 7f7e8bfff640 1 --2- 172.21.15.2:0/3228007230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ae6563a4a0 0x55ae65645010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:31.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.530+0000 7f7e8bfff640 1 -- 172.21.15.2:0/3228007230 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae653113c0 con 0x55ae6563adc0 2024-09-19T06:15:31.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.531+0000 7f7e8bfff640 1 --2- 172.21.15.2:0/3228007230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae6563adc0 0x55ae656422c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7e7800baa0 tx=0x7f7e78004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae4c83598984e82 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:31.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.531+0000 7f7e6bfff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:15:31.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.531+0000 7f7e6bfff640 1 -- 172.21.15.2:0/3228007230 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e780213a0 con 0x55ae6563adc0 2024-09-19T06:15:31.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.531+0000 7f7e6bfff640 1 -- 172.21.15.2:0/3228007230 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f7e78011910 con 0x55ae6563adc0 2024-09-19T06:15:31.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.531+0000 7f7e952a7740 1 -- 172.21.15.2:0/3228007230 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e840a0380 con 0x55ae6563adc0 2024-09-19T06:15:31.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.531+0000 7f7e6bfff640 1 -- 172.21.15.2:0/3228007230 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7e78011b10 con 0x55ae6563adc0 2024-09-19T06:15:31.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.531+0000 7f7e952a7740 10 client.15405 fetch_fsmap learned FSMap version 26 2024-09-19T06:15:31.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.531+0000 7f7e952a7740 1 -- 172.21.15.2:0/3228007230 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ae65653b90 con 0x55ae6563adc0 2024-09-19T06:15:31.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.531+0000 7f7e6bfff640 1 -- 172.21.15.2:0/3228007230 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7e840a0380 con 0x55ae6563adc0 2024-09-19T06:15:31.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.532+0000 7f7e6bfff640 1 -- 172.21.15.2:0/3228007230 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f7e7802a400 con 0x55ae6563adc0 2024-09-19T06:15:31.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.532+0000 7f7e952a7740 10 client.15405 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:15:31.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.532+0000 7f7e952a7740 10 client.15405 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:15:31.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.532+0000 7f7e952a7740 20 client.15405 populate_metadata read hostname 'smithi002' 2024-09-19T06:15:31.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.532+0000 7f7e952a7740 1 --2- 172.21.15.2:0/3228007230 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ae656550a0 0x55ae656574e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:31.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.532+0000 7f7e952a7740 4 client.15405 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:15:31.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.532+0000 7f7e952a7740 1 -- 172.21.15.2:0/3228007230 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae655ad850 con 0x55ae656550a0 2024-09-19T06:15:31.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.532+0000 7f7e90c6a640 1 --2- 172.21.15.2:0/3228007230 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ae656550a0 0x55ae656574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:31.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.533+0000 7f7e90c6a640 1 --2- 172.21.15.2:0/3228007230 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ae656550a0 0x55ae656574e0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cae8725399cb76b server_cookie=d1ad787560cc5a08 in_seq=0 out_seq=0 2024-09-19T06:15:31.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.533+0000 7f7e6bfff640 10 client.15405 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:15:31.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.534+0000 7f7e6bfff640 1 -- 172.21.15.2:0/3228007230 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ae655ad850 con 0x55ae656550a0 2024-09-19T06:15:31.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.534+0000 7f7e6bfff640 10 client.15405 handle_command_reply: tid=0 2024-09-19T06:15:31.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.534+0000 7f7e952a7740 1 client.15405 shutdown 2024-09-19T06:15:31.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.534+0000 7f7e952a7740 1 -- 172.21.15.2:0/3228007230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae6563adc0 msgr2=0x55ae656422c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:31.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.534+0000 7f7e952a7740 1 --2- 172.21.15.2:0/3228007230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae6563adc0 0x55ae656422c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7e7800baa0 tx=0x7f7e78004730 comp rx=0 tx=0).stop 2024-09-19T06:15:31.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.534+0000 7f7e952a7740 1 -- 172.21.15.2:0/3228007230 shutdown_connections 2024-09-19T06:15:31.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.534+0000 7f7e952a7740 1 --2- 172.21.15.2:0/3228007230 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae65645680 0x55ae65642840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:31.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.534+0000 7f7e952a7740 1 --2- 172.21.15.2:0/3228007230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae6563adc0 0x55ae656422c0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:31.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.534+0000 7f7e952a7740 1 --2- 172.21.15.2:0/3228007230 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ae656550a0 0x55ae656574e0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:31.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.534+0000 7f7e952a7740 1 --2- 172.21.15.2:0/3228007230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ae6563a4a0 0x55ae65645010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:31.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.534+0000 7f7e952a7740 1 -- 172.21.15.2:0/3228007230 >> 172.21.15.2:0/3228007230 conn(0x55ae65636a30 msgr2=0x55ae6563c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:31.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.534+0000 7f7e6bfff640 0 client.15405 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:15:31.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.534+0000 7f7e952a7740 1 -- 172.21.15.2:0/3228007230 shutdown_connections 2024-09-19T06:15:31.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.534+0000 7f7e952a7740 1 -- 172.21.15.2:0/3228007230 wait complete. 2024-09-19T06:15:31.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.534+0000 7f7e952a7740 20 client.15405 trim_cache size 0 max 16384 2024-09-19T06:15:31.548 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:31 smithi089 ceph-mon[34160]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-19T06:15:31.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.551+0000 7f7e952a7740 1 Processor -- start 2024-09-19T06:15:31.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.552+0000 7f7e952a7740 1 -- start start 2024-09-19T06:15:31.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.552+0000 7f7e952a7740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ae6563a4a0 0x55ae656514b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:31.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.552+0000 7f7e952a7740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae6563adc0 0x55ae6565cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:31.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.552+0000 7f7e952a7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae65645680 0x55ae6565d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:31.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.552+0000 7f7e952a7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8c1adde0 con 0x55ae65645680 2024-09-19T06:15:31.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.552+0000 7f7e952a7740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8c1ab6b0 con 0x55ae6563a4a0 2024-09-19T06:15:31.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.552+0000 7f7e952a7740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8c1a9500 con 0x55ae6563adc0 2024-09-19T06:15:31.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.552+0000 7f7e9146b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae65645680 0x55ae6565d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:31.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.552+0000 7f7e9146b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae65645680 0x55ae6565d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50704/0 (socket says 172.21.15.2:50704) 2024-09-19T06:15:31.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.552+0000 7f7e9146b640 1 -- 172.21.15.2:0/3897398101 learned_addr learned my addr 172.21.15.2:0/3897398101 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:31.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.552+0000 7f7e8bfff640 1 --2- 172.21.15.2:0/3897398101 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae6563adc0 0x55ae6565cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:31.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.552+0000 7f7e90c6a640 1 --2- 172.21.15.2:0/3897398101 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ae6563a4a0 0x55ae656514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:31.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.552+0000 7f7e8bfff640 1 -- 172.21.15.2:0/3897398101 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ae6563a4a0 msgr2=0x55ae656514b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:31.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.552+0000 7f7e8bfff640 1 --2- 172.21.15.2:0/3897398101 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ae6563a4a0 0x55ae656514b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:31.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.552+0000 7f7e8bfff640 1 -- 172.21.15.2:0/3897398101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae65645680 msgr2=0x55ae6565d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:31.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.552+0000 7f7e8bfff640 1 --2- 172.21.15.2:0/3897398101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae65645680 0x55ae6565d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:31.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.553+0000 7f7e8bfff640 1 -- 172.21.15.2:0/3897398101 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae65642b90 con 0x55ae6563adc0 2024-09-19T06:15:31.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.553+0000 7f7e9146b640 1 --2- 172.21.15.2:0/3897398101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae65645680 0x55ae6565d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:31.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.553+0000 7f7e8bfff640 1 --2- 172.21.15.2:0/3897398101 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae6563adc0 0x55ae6565cdb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7e7802aa10 tx=0x7f7e780217f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4785df45adf46a8d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:31.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.553+0000 7f7e767fc640 1 -- 172.21.15.2:0/3897398101 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e78037070 con 0x55ae6563adc0 2024-09-19T06:15:31.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.553+0000 7f7e767fc640 1 -- 172.21.15.2:0/3897398101 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7e7802aa90 con 0x55ae6563adc0 2024-09-19T06:15:31.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.553+0000 7f7e767fc640 1 -- 172.21.15.2:0/3897398101 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7802a660 con 0x55ae6563adc0 2024-09-19T06:15:31.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.554+0000 7f7e952a7740 1 -- 172.21.15.2:0/3897398101 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae6563adc0 msgr2=0x55ae6565cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:31.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.554+0000 7f7e952a7740 1 --2- 172.21.15.2:0/3897398101 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae6563adc0 0x55ae6565cdb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7e7802aa10 tx=0x7f7e780217f0 comp rx=0 tx=0).stop 2024-09-19T06:15:31.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.554+0000 7f7e952a7740 1 -- 172.21.15.2:0/3897398101 shutdown_connections 2024-09-19T06:15:31.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.554+0000 7f7e952a7740 1 --2- 172.21.15.2:0/3897398101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae65645680 0x55ae6565d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:31.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.554+0000 7f7e952a7740 1 --2- 172.21.15.2:0/3897398101 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae6563adc0 0x55ae6565cdb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:31.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.554+0000 7f7e952a7740 1 --2- 172.21.15.2:0/3897398101 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ae6563a4a0 0x55ae656514b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:31.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.554+0000 7f7e952a7740 1 -- 172.21.15.2:0/3897398101 >> 172.21.15.2:0/3897398101 conn(0x55ae65636a30 msgr2=0x55ae65644340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:31.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.554+0000 7f7e952a7740 1 -- 172.21.15.2:0/3897398101 shutdown_connections 2024-09-19T06:15:31.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.554+0000 7f7e952a7740 1 -- 172.21.15.2:0/3897398101 wait complete. 2024-09-19T06:15:31.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.554+0000 7f7e952a7740 1 -- start start 2024-09-19T06:15:31.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.555+0000 7f7e952a7740 1 Processor -- start 2024-09-19T06:15:31.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.555+0000 7f7e952a7740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae6563a4a0 0x55ae656497c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:31.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.555+0000 7f7e952a7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae6563adc0 0x55ae65649d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:31.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.555+0000 7f7e952a7740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ae65645680 0x55ae656bed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:31.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.555+0000 7f7e952a7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8c1a9b70 con 0x55ae6563adc0 2024-09-19T06:15:31.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.555+0000 7f7e952a7740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8c1aafe0 con 0x55ae65645680 2024-09-19T06:15:31.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.555+0000 7f7e952a7740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8c1aa240 con 0x55ae6563a4a0 2024-09-19T06:15:31.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.555+0000 7f7e952a7740 10 client.0 _ll_register_callbacks cb 0x7f7e7800bd50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:31.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.555+0000 7f7e8bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae6563adc0 0x55ae65649d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:31.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.555+0000 7f7e90c6a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae6563a4a0 0x55ae656497c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:31.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.555+0000 7f7e90c6a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae6563a4a0 0x55ae656497c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:55106/0 (socket says 172.21.15.2:55106) 2024-09-19T06:15:31.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.555+0000 7f7e90c6a640 1 -- 172.21.15.2:0/2695081501 learned_addr learned my addr 172.21.15.2:0/2695081501 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:31.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.556+0000 7f7e9146b640 1 --2- 172.21.15.2:0/2695081501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ae65645680 0x55ae656bed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:31.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.556+0000 7f7e90c6a640 1 -- 172.21.15.2:0/2695081501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ae65645680 msgr2=0x55ae656bed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:31.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.556+0000 7f7e90c6a640 1 --2- 172.21.15.2:0/2695081501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ae65645680 0x55ae656bed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:31.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.556+0000 7f7e90c6a640 1 -- 172.21.15.2:0/2695081501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae6563adc0 msgr2=0x55ae65649d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:31.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.556+0000 7f7e90c6a640 1 --2- 172.21.15.2:0/2695081501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae6563adc0 0x55ae65649d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:31.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.556+0000 7f7e90c6a640 1 -- 172.21.15.2:0/2695081501 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae656bf2c0 con 0x55ae6563a4a0 2024-09-19T06:15:31.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.556+0000 7f7e8bfff640 1 --2- 172.21.15.2:0/2695081501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae6563adc0 0x55ae65649d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:31.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.556+0000 7f7e90c6a640 1 --2- 172.21.15.2:0/2695081501 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae6563a4a0 0x55ae656497c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7e8002ac70 tx=0x7f7e80004220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5cfde142cbe1b3c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:31.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.556+0000 7f7e6bfff640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-19T06:15:31.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.556+0000 7f7e6bfff640 1 -- 172.21.15.2:0/2695081501 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e80031e60 con 0x55ae6563a4a0 2024-09-19T06:15:31.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.556+0000 7f7e952a7740 1 -- 172.21.15.2:0/2695081501 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e7802aa90 con 0x55ae6563a4a0 2024-09-19T06:15:31.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.556+0000 7f7e6bfff640 1 -- 172.21.15.2:0/2695081501 <== mon.1 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f7e80031630 con 0x55ae6563a4a0 2024-09-19T06:15:31.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.557+0000 7f7e6bfff640 1 -- 172.21.15.2:0/2695081501 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7e80035040 con 0x55ae6563a4a0 2024-09-19T06:15:31.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.557+0000 7f7e952a7740 10 client.25063 fetch_fsmap learned FSMap version 26 2024-09-19T06:15:31.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.557+0000 7f7e952a7740 1 -- 172.21.15.2:0/2695081501 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ae656c0510 con 0x55ae6563a4a0 2024-09-19T06:15:31.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.557+0000 7f7e6bfff640 1 -- 172.21.15.2:0/2695081501 <== mon.1 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7e80048070 con 0x55ae6563a4a0 2024-09-19T06:15:31.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.557+0000 7f7e6bfff640 1 -- 172.21.15.2:0/2695081501 <== mon.1 v2:172.21.15.90:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f7e8003d4e0 con 0x55ae6563a4a0 2024-09-19T06:15:31.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.557+0000 7f7e952a7740 10 client.25063 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:15:31.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.557+0000 7f7e952a7740 10 client.25063 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:15:31.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.557+0000 7f7e952a7740 20 client.25063 populate_metadata read hostname 'smithi002' 2024-09-19T06:15:31.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.557+0000 7f7e952a7740 1 --2- 172.21.15.2:0/2695081501 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ae656c0c60 0x55ae656c3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:31.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.557+0000 7f7e952a7740 4 client.25063 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:15:31.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.557+0000 7f7e952a7740 1 -- 172.21.15.2:0/2695081501 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f7e7802aa90 con 0x55ae656c0c60 2024-09-19T06:15:31.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.557+0000 7f7e8bfff640 1 --2- 172.21.15.2:0/2695081501 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ae656c0c60 0x55ae656c3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:31.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.558+0000 7f7e6bfff640 10 client.25063 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:15:31.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.558+0000 7f7e8bfff640 1 --2- 172.21.15.2:0/2695081501 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ae656c0c60 0x55ae656c3080 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be0f703456e41cd2 server_cookie=f6fde952d3ceba7b in_seq=0 out_seq=0 2024-09-19T06:15:31.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.558+0000 7f7e6bfff640 1 -- 172.21.15.2:0/2695081501 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f7e7802aa90 con 0x55ae656c0c60 2024-09-19T06:15:31.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.558+0000 7f7e6bfff640 10 client.25063 handle_command_reply: tid=0 2024-09-19T06:15:31.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.558+0000 7f7e952a7740 1 client.25063 shutdown 2024-09-19T06:15:31.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.559+0000 7f7e952a7740 1 -- 172.21.15.2:0/2695081501 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae6563a4a0 msgr2=0x55ae656497c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:31.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.559+0000 7f7e952a7740 1 --2- 172.21.15.2:0/2695081501 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae6563a4a0 0x55ae656497c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7e8002ac70 tx=0x7f7e80004220 comp rx=0 tx=0).stop 2024-09-19T06:15:31.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.559+0000 7f7e952a7740 1 -- 172.21.15.2:0/2695081501 shutdown_connections 2024-09-19T06:15:31.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.559+0000 7f7e952a7740 1 --2- 172.21.15.2:0/2695081501 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ae656c0c60 0x55ae656c3080 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:31.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.559+0000 7f7e952a7740 1 --2- 172.21.15.2:0/2695081501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ae65645680 0x55ae656bed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:31.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.559+0000 7f7e952a7740 1 --2- 172.21.15.2:0/2695081501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ae6563adc0 0x55ae65649d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:31.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.559+0000 7f7e6bfff640 0 client.25063 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:15:31.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.559+0000 7f7e952a7740 1 --2- 172.21.15.2:0/2695081501 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae6563a4a0 0x55ae656497c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:31.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.559+0000 7f7e952a7740 1 -- 172.21.15.2:0/2695081501 >> 172.21.15.2:0/2695081501 conn(0x55ae65636a30 msgr2=0x55ae65635370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:31.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.559+0000 7f7e952a7740 1 -- 172.21.15.2:0/2695081501 shutdown_connections 2024-09-19T06:15:31.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.559+0000 7f7e952a7740 1 -- 172.21.15.2:0/2695081501 wait complete. 2024-09-19T06:15:31.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.559+0000 7f7e952a7740 20 client.25063 trim_cache size 0 max 16384 2024-09-19T06:15:31.570 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:15:31.570 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T06:15:31.570 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T06:15:31.570 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:15:31.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.560+0000 7f7e92ece640 1 -- 172.21.15.2:0/2124733473 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f7e7c0a3560 msgr2=0x7f7e7c0a5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:31.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.560+0000 7f7e92ece640 1 --2- 172.21.15.2:0/2124733473 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f7e7c0a3560 0x7f7e7c0a5a20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c0ffdf0 tx=0x7f7e780107a0 comp rx=0 tx=0).stop 2024-09-19T06:15:31.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.560+0000 7f7e92ece640 1 -- 172.21.15.2:0/2124733473 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e8c102ef0 msgr2=0x7f7e8c19bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:31.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.560+0000 7f7e92ece640 1 --2- 172.21.15.2:0/2124733473 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e8c102ef0 0x7f7e8c19bbd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7e84009fd0 tx=0x7f7e8400b260 comp rx=0 tx=0).stop 2024-09-19T06:15:31.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.560+0000 7f7e92ece640 1 -- 172.21.15.2:0/2124733473 shutdown_connections 2024-09-19T06:15:31.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.560+0000 7f7e92ece640 1 --2- 172.21.15.2:0/2124733473 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f7e7c0a3560 0x7f7e7c0a5a20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:31.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.560+0000 7f7e92ece640 1 --2- 172.21.15.2:0/2124733473 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e8c102ef0 0x7f7e8c19bbd0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:31.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.560+0000 7f7e92ece640 1 --2- 172.21.15.2:0/2124733473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e8c102570 0x7f7e8c197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:31.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.560+0000 7f7e92ece640 1 --2- 172.21.15.2:0/2124733473 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e8c100e20 0x7f7e8c197300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:31.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.560+0000 7f7e92ece640 1 -- 172.21.15.2:0/2124733473 >> 172.21.15.2:0/2124733473 conn(0x7f7e8c0fc7d0 msgr2=0x7f7e8c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:31.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.560+0000 7f7e92ece640 1 -- 172.21.15.2:0/2124733473 shutdown_connections 2024-09-19T06:15:31.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:31.560+0000 7f7e92ece640 1 -- 172.21.15.2:0/2124733473 wait complete. 2024-09-19T06:15:32.350 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:15:32.350 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:15:32.672 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:15:33.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.170+0000 7f92def12640 1 -- 172.21.15.2:0/3132220626 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92d8106f20 msgr2=0x7f92d810eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:33.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.170+0000 7f92def12640 1 --2- 172.21.15.2:0/3132220626 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92d8106f20 0x7f92d810eaa0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f92d0009ca0 tx=0x7f92d002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:15:33.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.170+0000 7f92def12640 1 -- 172.21.15.2:0/3132220626 shutdown_connections 2024-09-19T06:15:33.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.170+0000 7f92def12640 1 --2- 172.21.15.2:0/3132220626 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92d8106f20 0x7f92d810eaa0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:33.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.170+0000 7f92def12640 1 --2- 172.21.15.2:0/3132220626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92d81027a0 0x7f92d81067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:33.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.170+0000 7f92def12640 1 --2- 172.21.15.2:0/3132220626 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92d8101df0 0x7f92d81021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:33.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.170+0000 7f92def12640 1 -- 172.21.15.2:0/3132220626 >> 172.21.15.2:0/3132220626 conn(0x7f92d80fd8f0 msgr2=0x7f92d80ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:33.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.171+0000 7f92def12640 1 -- 172.21.15.2:0/3132220626 shutdown_connections 2024-09-19T06:15:33.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.171+0000 7f92def12640 1 -- 172.21.15.2:0/3132220626 wait complete. 2024-09-19T06:15:33.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.171+0000 7f92def12640 1 Processor -- start 2024-09-19T06:15:33.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.172+0000 7f92def12640 1 -- start start 2024-09-19T06:15:33.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.172+0000 7f92def12640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92d8101df0 0x7f92d80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:33.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.172+0000 7f92def12640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92d81027a0 0x7f92d8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:33.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.172+0000 7f92def12640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92d8106f20 0x7f92d8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:33.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.172+0000 7f92def12640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f92d8111e30 con 0x7f92d8106f20 2024-09-19T06:15:33.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.172+0000 7f92def12640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f92d8111cb0 con 0x7f92d8101df0 2024-09-19T06:15:33.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.172+0000 7f92def12640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f92d8111fb0 con 0x7f92d81027a0 2024-09-19T06:15:33.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.172+0000 7f92dd4af640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92d8106f20 0x7f92d8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:33.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.172+0000 7f92dd4af640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92d8106f20 0x7f92d8074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50724/0 (socket says 172.21.15.2:50724) 2024-09-19T06:15:33.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.172+0000 7f92dd4af640 1 -- 172.21.15.2:0/2159126047 learned_addr learned my addr 172.21.15.2:0/2159126047 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:33.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.172+0000 7f92d7fff640 1 --2- 172.21.15.2:0/2159126047 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92d81027a0 0x7f92d8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:33.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.172+0000 7f92dccae640 1 --2- 172.21.15.2:0/2159126047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92d8101df0 0x7f92d80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:33.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.173+0000 7f92d7fff640 1 -- 172.21.15.2:0/2159126047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92d8101df0 msgr2=0x7f92d80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:33.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.173+0000 7f92d7fff640 1 --2- 172.21.15.2:0/2159126047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92d8101df0 0x7f92d80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:33.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.173+0000 7f92d7fff640 1 -- 172.21.15.2:0/2159126047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92d8106f20 msgr2=0x7f92d8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:33.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.173+0000 7f92d7fff640 1 --2- 172.21.15.2:0/2159126047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92d8106f20 0x7f92d8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:33.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.173+0000 7f92d7fff640 1 -- 172.21.15.2:0/2159126047 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92d81a6810 con 0x7f92d81027a0 2024-09-19T06:15:33.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.173+0000 7f92d7fff640 1 --2- 172.21.15.2:0/2159126047 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92d81027a0 0x7f92d8074a30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f92c400e9f0 tx=0x7f92c400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:33.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.173+0000 7f92d5ffb640 1 -- 172.21.15.2:0/2159126047 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c400ccc0 con 0x7f92d81027a0 2024-09-19T06:15:33.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.173+0000 7f92d5ffb640 1 -- 172.21.15.2:0/2159126047 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f92c40108e0 con 0x7f92d81027a0 2024-09-19T06:15:33.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.173+0000 7f92d5ffb640 1 -- 172.21.15.2:0/2159126047 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c4018880 con 0x7f92d81027a0 2024-09-19T06:15:33.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.173+0000 7f92def12640 1 -- 172.21.15.2:0/2159126047 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92d81a6b00 con 0x7f92d81027a0 2024-09-19T06:15:33.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.174+0000 7f92def12640 1 -- 172.21.15.2:0/2159126047 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92d81a6fd0 con 0x7f92d81027a0 2024-09-19T06:15:33.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.175+0000 7f92def12640 1 -- 172.21.15.2:0/2159126047 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92d81021d0 con 0x7f92d81027a0 2024-09-19T06:15:33.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.176+0000 7f92d5ffb640 1 -- 172.21.15.2:0/2159126047 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 24) ==== 138638+0+0 (secure 0 0 0) 0x7f92c4010a90 con 0x7f92d81027a0 2024-09-19T06:15:33.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.177+0000 7f92d5ffb640 1 --2- 172.21.15.2:0/2159126047 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f92c80a35e0 0x7f92c80a5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:33.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.177+0000 7f92dccae640 1 --2- 172.21.15.2:0/2159126047 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f92c80a35e0 0x7f92c80a5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:33.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.177+0000 7f92d5ffb640 1 -- 172.21.15.2:0/2159126047 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f92c40d0200 con 0x7f92d81027a0 2024-09-19T06:15:33.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.178+0000 7f92dccae640 1 --2- 172.21.15.2:0/2159126047 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f92c80a35e0 0x7f92c80a5aa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f92cc00bbe0 tx=0x7f92cc00b390 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:33.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.180+0000 7f92d5ffb640 1 -- 172.21.15.2:0/2159126047 <== mon.1 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f92c409c380 con 0x7f92d81027a0 2024-09-19T06:15:33.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.426+0000 7f92def12640 1 -- 172.21.15.2:0/2159126047 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f92d810a100 con 0x7f92d81027a0 2024-09-19T06:15:33.428 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:33 smithi002 ceph-mon[30982]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-19T06:15:33.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.427+0000 7f92d5ffb640 1 -- 172.21.15.2:0/2159126047 <== mon.1 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11882 (secure 0 0 0) 0x7f92c40a0680 con 0x7f92d81027a0 2024-09-19T06:15:33.429 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:15:33.430 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-09-19T06:14:49:104280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:14:48.191083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24470,24472,24497]},"id":1}]} 2024-09-19T06:15:33.430 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-09-19T06:15:33.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.430+0000 7f92def12640 1 -- 172.21.15.2:0/2159126047 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f92c80a35e0 msgr2=0x7f92c80a5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:33.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.430+0000 7f92def12640 1 --2- 172.21.15.2:0/2159126047 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f92c80a35e0 0x7f92c80a5aa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f92cc00bbe0 tx=0x7f92cc00b390 comp rx=0 tx=0).stop 2024-09-19T06:15:33.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.430+0000 7f92def12640 1 -- 172.21.15.2:0/2159126047 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92d81027a0 msgr2=0x7f92d8074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:33.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.430+0000 7f92def12640 1 --2- 172.21.15.2:0/2159126047 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92d81027a0 0x7f92d8074a30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f92c400e9f0 tx=0x7f92c400eeb0 comp rx=0 tx=0).stop 2024-09-19T06:15:33.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.430+0000 7f92def12640 1 -- 172.21.15.2:0/2159126047 shutdown_connections 2024-09-19T06:15:33.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.430+0000 7f92def12640 1 --2- 172.21.15.2:0/2159126047 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f92c80a35e0 0x7f92c80a5aa0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:33.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.430+0000 7f92def12640 1 --2- 172.21.15.2:0/2159126047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92d8106f20 0x7f92d8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:33.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.430+0000 7f92def12640 1 --2- 172.21.15.2:0/2159126047 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92d81027a0 0x7f92d8074a30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:33.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.430+0000 7f92def12640 1 --2- 172.21.15.2:0/2159126047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92d8101df0 0x7f92d80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:33.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.430+0000 7f92def12640 1 -- 172.21.15.2:0/2159126047 >> 172.21.15.2:0/2159126047 conn(0x7f92d80fd8f0 msgr2=0x7f92d80feda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:33.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.430+0000 7f92def12640 1 -- 172.21.15.2:0/2159126047 shutdown_connections 2024-09-19T06:15:33.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:33.430+0000 7f92def12640 1 -- 172.21.15.2:0/2159126047 wait complete. 2024-09-19T06:15:33.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:33 smithi090 ceph-mon[34497]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-19T06:15:33.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:33 smithi089 ceph-mon[34160]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-19T06:15:34.052 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:15:34.351 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:15:34.471 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:34 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/2159126047' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:15:34.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:34 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/2159126047' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:15:34.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:34 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/2159126047' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:15:34.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.851+0000 7f791ee31640 1 -- 172.21.15.2:0/1105369323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f791810c160 msgr2=0x7f791810e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:34.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.851+0000 7f791ee31640 1 --2- 172.21.15.2:0/1105369323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f791810c160 0x7f791810e5f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f7910009ca0 tx=0x7f791002a950 comp rx=0 tx=0).stop 2024-09-19T06:15:34.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.851+0000 7f791ee31640 1 -- 172.21.15.2:0/1105369323 shutdown_connections 2024-09-19T06:15:34.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.851+0000 7f791ee31640 1 --2- 172.21.15.2:0/1105369323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f791810c160 0x7f791810e5f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:34.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.851+0000 7f791ee31640 1 --2- 172.21.15.2:0/1105369323 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79181036e0 0x7f791810bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:34.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.851+0000 7f791ee31640 1 --2- 172.21.15.2:0/1105369323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7918102dc0 0x7f79181031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:34.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.851+0000 7f791ee31640 1 -- 172.21.15.2:0/1105369323 >> 172.21.15.2:0/1105369323 conn(0x7f79180fc780 msgr2=0x7f79180feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:34.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.852+0000 7f791ee31640 1 -- 172.21.15.2:0/1105369323 shutdown_connections 2024-09-19T06:15:34.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.852+0000 7f791ee31640 1 -- 172.21.15.2:0/1105369323 wait complete. 2024-09-19T06:15:34.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.852+0000 7f791ee31640 1 Processor -- start 2024-09-19T06:15:34.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.852+0000 7f791ee31640 1 -- start start 2024-09-19T06:15:34.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.853+0000 7f791ee31640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7918102dc0 0x7f7918198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:34.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.853+0000 7f791ee31640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79181036e0 0x7f79181987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:34.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.853+0000 7f791ee31640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f791810c160 0x7f791819cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:34.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.853+0000 7f7917fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79181036e0 0x7f79181987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:34.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.853+0000 7f791ee31640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7918111dc0 con 0x7f79181036e0 2024-09-19T06:15:34.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.853+0000 7f7917fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79181036e0 0x7f79181987b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50738/0 (socket says 172.21.15.2:50738) 2024-09-19T06:15:34.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.853+0000 7f7917fff640 1 -- 172.21.15.2:0/393214547 learned_addr learned my addr 172.21.15.2:0/393214547 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:34.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.853+0000 7f791ee31640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7918111c40 con 0x7f791810c160 2024-09-19T06:15:34.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.853+0000 7f791ee31640 1 -- 172.21.15.2:0/393214547 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7918111f40 con 0x7f7918102dc0 2024-09-19T06:15:34.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.853+0000 7f791cbcd640 1 --2- 172.21.15.2:0/393214547 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7918102dc0 0x7f7918198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:34.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.853+0000 7f791d3ce640 1 --2- 172.21.15.2:0/393214547 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f791810c160 0x7f791819cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:34.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.853+0000 7f791cbcd640 1 -- 172.21.15.2:0/393214547 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f791810c160 msgr2=0x7f791819cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:34.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.853+0000 7f791cbcd640 1 --2- 172.21.15.2:0/393214547 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f791810c160 0x7f791819cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:34.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.853+0000 7f791cbcd640 1 -- 172.21.15.2:0/393214547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79181036e0 msgr2=0x7f79181987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:34.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.853+0000 7f791cbcd640 1 --2- 172.21.15.2:0/393214547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79181036e0 0x7f79181987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:34.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.853+0000 7f791cbcd640 1 -- 172.21.15.2:0/393214547 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f791819d220 con 0x7f7918102dc0 2024-09-19T06:15:34.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.854+0000 7f7917fff640 1 --2- 172.21.15.2:0/393214547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79181036e0 0x7f79181987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:34.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.854+0000 7f791d3ce640 1 --2- 172.21.15.2:0/393214547 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f791810c160 0x7f791819cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:15:34.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.854+0000 7f791cbcd640 1 --2- 172.21.15.2:0/393214547 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7918102dc0 0x7f7918198270 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f790c00c970 tx=0x7f790c00ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:34.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.854+0000 7f7915ffb640 1 -- 172.21.15.2:0/393214547 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790c007bb0 con 0x7f7918102dc0 2024-09-19T06:15:34.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.854+0000 7f791ee31640 1 -- 172.21.15.2:0/393214547 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f791819d510 con 0x7f7918102dc0 2024-09-19T06:15:34.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.854+0000 7f7915ffb640 1 -- 172.21.15.2:0/393214547 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f790c007d50 con 0x7f7918102dc0 2024-09-19T06:15:34.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.854+0000 7f7915ffb640 1 -- 172.21.15.2:0/393214547 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790c018780 con 0x7f7918102dc0 2024-09-19T06:15:34.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.854+0000 7f791ee31640 1 -- 172.21.15.2:0/393214547 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7918100950 con 0x7f7918102dc0 2024-09-19T06:15:34.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.857+0000 7f7915ffb640 1 -- 172.21.15.2:0/393214547 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 24) ==== 138638+0+0 (secure 0 0 0) 0x7f790c00f450 con 0x7f7918102dc0 2024-09-19T06:15:34.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.858+0000 7f792120a740 1 Processor -- start 2024-09-19T06:15:34.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.858+0000 7f792120a740 1 -- start start 2024-09-19T06:15:34.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.858+0000 7f792120a740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561f5c211b40 0x561f5c210090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:34.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.858+0000 7f792120a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f5c2105d0 0x561f5c210a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:34.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.858+0000 7f7915ffb640 1 --2- 172.21.15.2:0/393214547 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f79080a35e0 0x7f79080a5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:34.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.858+0000 7f792120a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561f5c21b370 0x561f5c21d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:34.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.858+0000 7f792120a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561f5c1762f0 con 0x561f5c2105d0 2024-09-19T06:15:34.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.858+0000 7f792120a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x561f5c11dcf0 con 0x561f5c21b370 2024-09-19T06:15:34.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.859+0000 7f792120a740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x561f5c1722b0 con 0x561f5c211b40 2024-09-19T06:15:34.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.859+0000 7f7915ffb640 1 -- 172.21.15.2:0/393214547 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f790c0d0010 con 0x7f7918102dc0 2024-09-19T06:15:34.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.859+0000 7f791d3ce640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561f5c21b370 0x561f5c21d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:34.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.859+0000 7f791cbcd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f5c2105d0 0x561f5c210a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:34.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.859+0000 7f791d3ce640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561f5c21b370 0x561f5c21d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:43338/0 (socket says 172.21.15.2:43338) 2024-09-19T06:15:34.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.859+0000 7f791d3ce640 1 -- 172.21.15.2:0/1163351322 learned_addr learned my addr 172.21.15.2:0/1163351322 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:34.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.859+0000 7f791cbcd640 1 -- 172.21.15.2:0/1163351322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561f5c211b40 msgr2=0x561f5c210090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:34.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.859+0000 7f791cbcd640 1 --2- 172.21.15.2:0/1163351322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561f5c211b40 0x561f5c210090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:34.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.859+0000 7f791cbcd640 1 -- 172.21.15.2:0/1163351322 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561f5c21b370 msgr2=0x561f5c21d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:34.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.859+0000 7f7917fff640 1 --2- 172.21.15.2:0/393214547 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f79080a35e0 0x7f79080a5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:34.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.859+0000 7f791cbcd640 1 --2- 172.21.15.2:0/1163351322 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561f5c21b370 0x561f5c21d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:34.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.859+0000 7f791cbcd640 1 -- 172.21.15.2:0/1163351322 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f5c1023a0 con 0x561f5c2105d0 2024-09-19T06:15:34.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.860+0000 7f791cbcd640 1 --2- 172.21.15.2:0/1163351322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f5c2105d0 0x561f5c210a10 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f790c0cd550 tx=0x7f790c09bb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8acb19cc0ceb32e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:34.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.860+0000 7f7902ffd640 1 -- 172.21.15.2:0/1163351322 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790c09c0e0 con 0x561f5c2105d0 2024-09-19T06:15:34.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.860+0000 7f7902ffd640 1 -- 172.21.15.2:0/1163351322 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f790c0a0490 con 0x561f5c2105d0 2024-09-19T06:15:34.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.860+0000 7f7902ffd640 1 -- 172.21.15.2:0/1163351322 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790c0a48c0 con 0x561f5c2105d0 2024-09-19T06:15:34.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.861+0000 7f792120a740 1 -- 172.21.15.2:0/1163351322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f5c2105d0 msgr2=0x561f5c210a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:34.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.860+0000 7f7917fff640 1 --2- 172.21.15.2:0/393214547 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f79080a35e0 0x7f79080a5aa0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f79180fedf0 tx=0x7f790400f8b0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:34.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.861+0000 7f792120a740 1 --2- 172.21.15.2:0/1163351322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f5c2105d0 0x561f5c210a10 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f790c0cd550 tx=0x7f790c09bb00 comp rx=0 tx=0).stop 2024-09-19T06:15:34.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.861+0000 7f792120a740 1 -- 172.21.15.2:0/1163351322 shutdown_connections 2024-09-19T06:15:34.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.861+0000 7f792120a740 1 --2- 172.21.15.2:0/1163351322 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561f5c21b370 0x561f5c21d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:34.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.861+0000 7f792120a740 1 --2- 172.21.15.2:0/1163351322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f5c2105d0 0x561f5c210a10 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:34.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.861+0000 7f792120a740 1 --2- 172.21.15.2:0/1163351322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561f5c211b40 0x561f5c210090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:34.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.861+0000 7f792120a740 1 -- 172.21.15.2:0/1163351322 >> 172.21.15.2:0/1163351322 conn(0x561f5c1d9310 msgr2=0x561f5c20cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:34.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.861+0000 7f792120a740 1 -- 172.21.15.2:0/1163351322 shutdown_connections 2024-09-19T06:15:34.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.861+0000 7f792120a740 1 -- 172.21.15.2:0/1163351322 wait complete. 2024-09-19T06:15:34.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.862+0000 7f792120a740 1 -- start start 2024-09-19T06:15:34.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.862+0000 7f792120a740 1 Processor -- start 2024-09-19T06:15:34.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.862+0000 7f792120a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f5c2105d0 0x561f5c21adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:34.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.862+0000 7f792120a740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561f5c211b40 0x561f5c218070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:34.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.862+0000 7f792120a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561f5c21b370 0x561f5c218800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:34.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.862+0000 7f792120a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561f5c226880 con 0x561f5c2105d0 2024-09-19T06:15:34.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.862+0000 7f792120a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x561f5c131060 con 0x561f5c21b370 2024-09-19T06:15:34.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.862+0000 7f792120a740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x561f5c226a00 con 0x561f5c211b40 2024-09-19T06:15:34.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.862+0000 7f792120a740 10 client.0 _ll_register_callbacks cb 0x561f5be848c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:34.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.862+0000 7f791cbcd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f5c2105d0 0x561f5c21adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:34.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.863+0000 7f791cbcd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f5c2105d0 0x561f5c21adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50760/0 (socket says 172.21.15.2:50760) 2024-09-19T06:15:34.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.863+0000 7f791cbcd640 1 -- 172.21.15.2:0/1924575809 learned_addr learned my addr 172.21.15.2:0/1924575809 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:34.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.863+0000 7f791d3ce640 1 --2- 172.21.15.2:0/1924575809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561f5c21b370 0x561f5c218800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:34.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.863+0000 7f7917fff640 1 --2- 172.21.15.2:0/1924575809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561f5c211b40 0x561f5c218070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:34.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.863+0000 7f791cbcd640 1 -- 172.21.15.2:0/1924575809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561f5c211b40 msgr2=0x561f5c218070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:34.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.863+0000 7f791cbcd640 1 --2- 172.21.15.2:0/1924575809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561f5c211b40 0x561f5c218070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:34.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.863+0000 7f791cbcd640 1 -- 172.21.15.2:0/1924575809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561f5c21b370 msgr2=0x561f5c218800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:34.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.863+0000 7f791cbcd640 1 --2- 172.21.15.2:0/1924575809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561f5c21b370 0x561f5c218800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:34.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.863+0000 7f791cbcd640 1 -- 172.21.15.2:0/1924575809 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f5bee73c0 con 0x561f5c2105d0 2024-09-19T06:15:34.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.863+0000 7f7917fff640 1 --2- 172.21.15.2:0/1924575809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561f5c211b40 0x561f5c218070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:15:34.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.863+0000 7f791d3ce640 1 --2- 172.21.15.2:0/1924575809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561f5c21b370 0x561f5c218800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:34.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.863+0000 7f791cbcd640 1 --2- 172.21.15.2:0/1924575809 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f5c2105d0 0x561f5c21adc0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f790c09c070 tx=0x7f790c0a4dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de7b98118e8f234 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:34.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.863+0000 7f78f7fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:15:34.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.864+0000 7f78f7fff640 1 -- 172.21.15.2:0/1924575809 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790c09c0e0 con 0x561f5c2105d0 2024-09-19T06:15:34.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.864+0000 7f78f7fff640 1 -- 172.21.15.2:0/1924575809 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f790c0a0160 con 0x561f5c2105d0 2024-09-19T06:15:34.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.864+0000 7f792120a740 1 -- 172.21.15.2:0/1924575809 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f790c0a0490 con 0x561f5c2105d0 2024-09-19T06:15:34.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.864+0000 7f78f7fff640 1 -- 172.21.15.2:0/1924575809 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f790c0a48c0 con 0x561f5c2105d0 2024-09-19T06:15:34.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.864+0000 7f792120a740 10 client.15429 fetch_fsmap learned FSMap version 26 2024-09-19T06:15:34.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.864+0000 7f792120a740 1 -- 172.21.15.2:0/1924575809 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561f5c232390 con 0x561f5c2105d0 2024-09-19T06:15:34.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.864+0000 7f78f7fff640 1 -- 172.21.15.2:0/1924575809 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f790c0a0490 con 0x561f5c2105d0 2024-09-19T06:15:34.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.864+0000 7f78f7fff640 1 -- 172.21.15.2:0/1924575809 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f790c0c8070 con 0x561f5c2105d0 2024-09-19T06:15:34.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.864+0000 7f792120a740 10 client.15429 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:15:34.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.864+0000 7f792120a740 10 client.15429 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:15:34.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.864+0000 7f792120a740 20 client.15429 populate_metadata read hostname 'smithi002' 2024-09-19T06:15:34.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.864+0000 7f792120a740 1 --2- 172.21.15.2:0/1924575809 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x561f5c2336e0 0x561f5c235ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:34.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.864+0000 7f792120a740 4 client.15429 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:15:34.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.864+0000 7f792120a740 1 -- 172.21.15.2:0/1924575809 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561f5c183860 con 0x561f5c2336e0 2024-09-19T06:15:34.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.865+0000 7f7917fff640 1 --2- 172.21.15.2:0/1924575809 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x561f5c2336e0 0x561f5c235ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:34.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.865+0000 7f7917fff640 1 --2- 172.21.15.2:0/1924575809 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x561f5c2336e0 0x561f5c235ad0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=97a15fab689d548 server_cookie=35259b201b40f110 in_seq=0 out_seq=0 2024-09-19T06:15:34.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.865+0000 7f78f7fff640 10 client.15429 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:15:34.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.866+0000 7f78f7fff640 1 -- 172.21.15.2:0/1924575809 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561f5c183860 con 0x561f5c2336e0 2024-09-19T06:15:34.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.866+0000 7f78f7fff640 10 client.15429 handle_command_reply: tid=0 2024-09-19T06:15:34.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.866+0000 7f792120a740 1 client.15429 shutdown 2024-09-19T06:15:34.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.866+0000 7f792120a740 1 -- 172.21.15.2:0/1924575809 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f5c2105d0 msgr2=0x561f5c21adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:34.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.866+0000 7f792120a740 1 --2- 172.21.15.2:0/1924575809 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f5c2105d0 0x561f5c21adc0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f790c09c070 tx=0x7f790c0a4dc0 comp rx=0 tx=0).stop 2024-09-19T06:15:34.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.866+0000 7f792120a740 1 -- 172.21.15.2:0/1924575809 shutdown_connections 2024-09-19T06:15:34.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.866+0000 7f792120a740 1 --2- 172.21.15.2:0/1924575809 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x561f5c2336e0 0x561f5c235ad0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:34.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.866+0000 7f78f7fff640 0 client.15429 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:15:34.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.866+0000 7f792120a740 1 --2- 172.21.15.2:0/1924575809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561f5c21b370 0x561f5c218800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:34.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.866+0000 7f792120a740 1 --2- 172.21.15.2:0/1924575809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561f5c211b40 0x561f5c218070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:34.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.866+0000 7f792120a740 1 --2- 172.21.15.2:0/1924575809 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f5c2105d0 0x561f5c21adc0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:34.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.866+0000 7f792120a740 1 -- 172.21.15.2:0/1924575809 >> 172.21.15.2:0/1924575809 conn(0x561f5c1d9310 msgr2=0x561f5c212990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:34.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.867+0000 7f792120a740 1 -- 172.21.15.2:0/1924575809 shutdown_connections 2024-09-19T06:15:34.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.867+0000 7f792120a740 1 -- 172.21.15.2:0/1924575809 wait complete. 2024-09-19T06:15:34.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.867+0000 7f792120a740 20 client.15429 trim_cache size 0 max 16384 2024-09-19T06:15:34.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.880+0000 7f792120a740 1 Processor -- start 2024-09-19T06:15:34.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.880+0000 7f792120a740 1 -- start start 2024-09-19T06:15:34.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.880+0000 7f792120a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561f5c2105d0 0x561f5c217050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:34.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.880+0000 7f792120a740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561f5c211b40 0x561f5c213120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:34.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.880+0000 7f792120a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f5c21b370 0x561f5c213660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:34.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.880+0000 7f792120a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f79181addd0 con 0x561f5c21b370 2024-09-19T06:15:34.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.880+0000 7f792120a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f79181ab6a0 con 0x561f5c2105d0 2024-09-19T06:15:34.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.880+0000 7f792120a740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f79181a94f0 con 0x561f5c211b40 2024-09-19T06:15:34.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.880+0000 7f791d3ce640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f5c21b370 0x561f5c213660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:34.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.880+0000 7f791cbcd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561f5c2105d0 0x561f5c217050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:34.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.880+0000 7f791d3ce640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f5c21b370 0x561f5c213660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50774/0 (socket says 172.21.15.2:50774) 2024-09-19T06:15:34.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.880+0000 7f791d3ce640 1 -- 172.21.15.2:0/1009714857 learned_addr learned my addr 172.21.15.2:0/1009714857 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:34.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.880+0000 7f7917fff640 1 --2- 172.21.15.2:0/1009714857 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561f5c211b40 0x561f5c213120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:34.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.881+0000 7f791d3ce640 1 -- 172.21.15.2:0/1009714857 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561f5c211b40 msgr2=0x561f5c213120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:34.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.881+0000 7f791d3ce640 1 --2- 172.21.15.2:0/1009714857 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561f5c211b40 0x561f5c213120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:34.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.881+0000 7f791d3ce640 1 -- 172.21.15.2:0/1009714857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561f5c2105d0 msgr2=0x561f5c217050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:34.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.881+0000 7f791d3ce640 1 --2- 172.21.15.2:0/1009714857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561f5c2105d0 0x561f5c217050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:34.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.881+0000 7f791d3ce640 1 -- 172.21.15.2:0/1009714857 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f5c2165c0 con 0x561f5c21b370 2024-09-19T06:15:34.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.881+0000 7f791d3ce640 1 --2- 172.21.15.2:0/1009714857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f5c21b370 0x561f5c213660 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f791002fb70 tx=0x7f7910005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3a72184d47932db server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:34.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.881+0000 7f79027fc640 1 -- 172.21.15.2:0/1009714857 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7910049070 con 0x561f5c21b370 2024-09-19T06:15:34.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.881+0000 7f79027fc640 1 -- 172.21.15.2:0/1009714857 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7910003e20 con 0x561f5c21b370 2024-09-19T06:15:34.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.881+0000 7f79027fc640 1 -- 172.21.15.2:0/1009714857 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7910034040 con 0x561f5c21b370 2024-09-19T06:15:34.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.882+0000 7f792120a740 1 -- 172.21.15.2:0/1009714857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f5c21b370 msgr2=0x561f5c213660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:34.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.882+0000 7f792120a740 1 --2- 172.21.15.2:0/1009714857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f5c21b370 0x561f5c213660 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f791002fb70 tx=0x7f7910005ef0 comp rx=0 tx=0).stop 2024-09-19T06:15:34.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.882+0000 7f792120a740 1 -- 172.21.15.2:0/1009714857 shutdown_connections 2024-09-19T06:15:34.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.882+0000 7f792120a740 1 --2- 172.21.15.2:0/1009714857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f5c21b370 0x561f5c213660 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:34.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.882+0000 7f792120a740 1 --2- 172.21.15.2:0/1009714857 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561f5c211b40 0x561f5c213120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:34.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.882+0000 7f792120a740 1 --2- 172.21.15.2:0/1009714857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561f5c2105d0 0x561f5c217050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:34.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.882+0000 7f792120a740 1 -- 172.21.15.2:0/1009714857 >> 172.21.15.2:0/1009714857 conn(0x561f5c1d9310 msgr2=0x561f5c216940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:34.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.882+0000 7f792120a740 1 -- 172.21.15.2:0/1009714857 shutdown_connections 2024-09-19T06:15:34.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.882+0000 7f792120a740 1 -- 172.21.15.2:0/1009714857 wait complete. 2024-09-19T06:15:34.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.882+0000 7f792120a740 1 -- start start 2024-09-19T06:15:34.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.883+0000 7f792120a740 1 Processor -- start 2024-09-19T06:15:34.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.883+0000 7f792120a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561f5c2105d0 0x561f5c235b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:34.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.883+0000 7f792120a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f5c211b40 0x561f5c236050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:34.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.883+0000 7f792120a740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561f5c21b370 0x561f5c236590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:34.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.883+0000 7f792120a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f79181a9b60 con 0x561f5c211b40 2024-09-19T06:15:34.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.883+0000 7f792120a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f79181aafd0 con 0x561f5c2105d0 2024-09-19T06:15:34.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.883+0000 7f792120a740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f79181aa230 con 0x561f5c21b370 2024-09-19T06:15:34.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.883+0000 7f7917fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f5c211b40 0x561f5c236050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:34.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.883+0000 7f792120a740 10 client.0 _ll_register_callbacks cb 0x7f790c09bc40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:34.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.883+0000 7f7917fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f5c211b40 0x561f5c236050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50776/0 (socket says 172.21.15.2:50776) 2024-09-19T06:15:34.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.883+0000 7f7917fff640 1 -- 172.21.15.2:0/151548553 learned_addr learned my addr 172.21.15.2:0/151548553 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:34.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.883+0000 7f791d3ce640 1 --2- 172.21.15.2:0/151548553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561f5c21b370 0x561f5c236590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:34.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.884+0000 7f7917fff640 1 -- 172.21.15.2:0/151548553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561f5c21b370 msgr2=0x561f5c236590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:34.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.884+0000 7f7917fff640 1 --2- 172.21.15.2:0/151548553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561f5c21b370 0x561f5c236590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:34.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.884+0000 7f7917fff640 1 -- 172.21.15.2:0/151548553 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561f5c2105d0 msgr2=0x561f5c235b10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:15:34.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.884+0000 7f7917fff640 1 --2- 172.21.15.2:0/151548553 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561f5c2105d0 0x561f5c235b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:34.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.884+0000 7f7917fff640 1 -- 172.21.15.2:0/151548553 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f5c29c2b0 con 0x561f5c211b40 2024-09-19T06:15:34.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.884+0000 7f7917fff640 1 --2- 172.21.15.2:0/151548553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f5c211b40 0x561f5c236050 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x561f5c2196b0 tx=0x7f7904013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbe7db9876695ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:34.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.884+0000 7f78f7fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:15:34.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.884+0000 7f78f7fff640 1 -- 172.21.15.2:0/151548553 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7904016070 con 0x561f5c211b40 2024-09-19T06:15:34.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.884+0000 7f78f7fff640 1 -- 172.21.15.2:0/151548553 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f790400d490 con 0x561f5c211b40 2024-09-19T06:15:34.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.884+0000 7f792120a740 1 -- 172.21.15.2:0/151548553 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7910003e20 con 0x561f5c211b40 2024-09-19T06:15:34.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.884+0000 7f78f7fff640 1 -- 172.21.15.2:0/151548553 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7904003e50 con 0x561f5c211b40 2024-09-19T06:15:34.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.884+0000 7f792120a740 10 client.15435 fetch_fsmap learned FSMap version 26 2024-09-19T06:15:34.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.884+0000 7f792120a740 1 -- 172.21.15.2:0/151548553 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561f5c29d5f0 con 0x561f5c211b40 2024-09-19T06:15:34.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.885+0000 7f78f7fff640 1 -- 172.21.15.2:0/151548553 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7910003e20 con 0x561f5c211b40 2024-09-19T06:15:34.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.885+0000 7f78f7fff640 1 -- 172.21.15.2:0/151548553 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f79040387d0 con 0x561f5c211b40 2024-09-19T06:15:34.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.885+0000 7f792120a740 10 client.15435 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:15:34.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.885+0000 7f792120a740 10 client.15435 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:15:34.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.885+0000 7f792120a740 20 client.15435 populate_metadata read hostname 'smithi002' 2024-09-19T06:15:34.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.885+0000 7f792120a740 1 --2- 172.21.15.2:0/151548553 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x561f5c29dcc0 0x561f5c2a00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:34.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.885+0000 7f792120a740 4 client.15435 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:15:34.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.885+0000 7f792120a740 1 -- 172.21.15.2:0/151548553 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561f5c17dd70 con 0x561f5c29dcc0 2024-09-19T06:15:34.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.885+0000 7f791cbcd640 1 --2- 172.21.15.2:0/151548553 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x561f5c29dcc0 0x561f5c2a00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:34.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.886+0000 7f791cbcd640 1 --2- 172.21.15.2:0/151548553 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x561f5c29dcc0 0x561f5c2a00e0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b715a35bfedc1595 server_cookie=7dda22d700e3e07c in_seq=0 out_seq=0 2024-09-19T06:15:34.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.886+0000 7f78f7fff640 10 client.15435 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:15:34.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.886+0000 7f78f7fff640 1 -- 172.21.15.2:0/151548553 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561f5c17dd70 con 0x561f5c29dcc0 2024-09-19T06:15:34.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.886+0000 7f78f7fff640 10 client.15435 handle_command_reply: tid=0 2024-09-19T06:15:34.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.886+0000 7f792120a740 1 client.15435 shutdown 2024-09-19T06:15:34.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.886+0000 7f792120a740 1 -- 172.21.15.2:0/151548553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f5c211b40 msgr2=0x561f5c236050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:34.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.886+0000 7f792120a740 1 --2- 172.21.15.2:0/151548553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f5c211b40 0x561f5c236050 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x561f5c2196b0 tx=0x7f7904013000 comp rx=0 tx=0).stop 2024-09-19T06:15:34.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.886+0000 7f792120a740 1 -- 172.21.15.2:0/151548553 shutdown_connections 2024-09-19T06:15:34.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.886+0000 7f792120a740 1 --2- 172.21.15.2:0/151548553 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x561f5c29dcc0 0x561f5c2a00e0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:34.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.886+0000 7f792120a740 1 --2- 172.21.15.2:0/151548553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561f5c21b370 0x561f5c236590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:34.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.886+0000 7f792120a740 1 --2- 172.21.15.2:0/151548553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f5c211b40 0x561f5c236050 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:34.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.886+0000 7f792120a740 1 --2- 172.21.15.2:0/151548553 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561f5c2105d0 0x561f5c235b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:34.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.886+0000 7f792120a740 1 -- 172.21.15.2:0/151548553 >> 172.21.15.2:0/151548553 conn(0x561f5c1d9310 msgr2=0x561f5c217160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:34.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.886+0000 7f78f7fff640 0 client.15435 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:15:34.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.887+0000 7f792120a740 1 -- 172.21.15.2:0/151548553 shutdown_connections 2024-09-19T06:15:34.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.887+0000 7f792120a740 1 -- 172.21.15.2:0/151548553 wait complete. 2024-09-19T06:15:34.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.887+0000 7f792120a740 20 client.15435 trim_cache size 0 max 16384 2024-09-19T06:15:34.893 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:15:34.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.887+0000 7f791ee31640 1 -- 172.21.15.2:0/393214547 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f79080a35e0 msgr2=0x7f79080a5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:34.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.887+0000 7f791ee31640 1 --2- 172.21.15.2:0/393214547 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f79080a35e0 0x7f79080a5aa0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f79180fedf0 tx=0x7f790400f8b0 comp rx=0 tx=0).stop 2024-09-19T06:15:34.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.887+0000 7f791ee31640 1 -- 172.21.15.2:0/393214547 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7918102dc0 msgr2=0x7f7918198270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:34.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.887+0000 7f791ee31640 1 --2- 172.21.15.2:0/393214547 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7918102dc0 0x7f7918198270 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f790c00c970 tx=0x7f790c00ce30 comp rx=0 tx=0).stop 2024-09-19T06:15:34.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.888+0000 7f791ee31640 1 -- 172.21.15.2:0/393214547 shutdown_connections 2024-09-19T06:15:34.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.888+0000 7f791ee31640 1 --2- 172.21.15.2:0/393214547 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f79080a35e0 0x7f79080a5aa0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:34.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.888+0000 7f791ee31640 1 --2- 172.21.15.2:0/393214547 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f791810c160 0x7f791819cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:34.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.888+0000 7f791ee31640 1 --2- 172.21.15.2:0/393214547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79181036e0 0x7f79181987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:34.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.888+0000 7f791ee31640 1 --2- 172.21.15.2:0/393214547 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7918102dc0 0x7f7918198270 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:34.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.888+0000 7f791ee31640 1 -- 172.21.15.2:0/393214547 >> 172.21.15.2:0/393214547 conn(0x7f79180fc780 msgr2=0x7f79180fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:34.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.888+0000 7f791ee31640 1 -- 172.21.15.2:0/393214547 shutdown_connections 2024-09-19T06:15:34.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:34.888+0000 7f791ee31640 1 -- 172.21.15.2:0/393214547 wait complete. 2024-09-19T06:15:35.199 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:35 smithi002 ceph-mon[30982]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-19T06:15:35.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:35 smithi090 ceph-mon[34497]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-19T06:15:35.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:35 smithi089 ceph-mon[34160]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-19T06:15:35.636 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:15:35.938 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:15:36.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.527+0000 7fedad40e640 1 -- 172.21.15.2:0/2891872661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feda8100e20 msgr2=0x7feda8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:36.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.527+0000 7fedad40e640 1 --2- 172.21.15.2:0/2891872661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feda8100e20 0x7feda8101200 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fed98009900 tx=0x7fed9802a480 comp rx=0 tx=0).stop 2024-09-19T06:15:36.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.528+0000 7fedad40e640 1 -- 172.21.15.2:0/2891872661 shutdown_connections 2024-09-19T06:15:36.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.528+0000 7fedad40e640 1 --2- 172.21.15.2:0/2891872661 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feda8102ef0 0x7feda810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:36.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.528+0000 7fedad40e640 1 --2- 172.21.15.2:0/2891872661 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feda8102570 0x7feda81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:36.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.528+0000 7fedad40e640 1 --2- 172.21.15.2:0/2891872661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feda8100e20 0x7feda8101200 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:36.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.528+0000 7fedad40e640 1 -- 172.21.15.2:0/2891872661 >> 172.21.15.2:0/2891872661 conn(0x7feda80fc7d0 msgr2=0x7feda80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:36.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.528+0000 7fedad40e640 1 -- 172.21.15.2:0/2891872661 shutdown_connections 2024-09-19T06:15:36.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.528+0000 7fedad40e640 1 -- 172.21.15.2:0/2891872661 wait complete. 2024-09-19T06:15:36.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.528+0000 7fedad40e640 1 Processor -- start 2024-09-19T06:15:36.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.529+0000 7fedad40e640 1 -- start start 2024-09-19T06:15:36.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.529+0000 7fedad40e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feda8100e20 0x7feda80739e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:36.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.529+0000 7fedad40e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feda8102570 0x7feda806ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:36.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.529+0000 7fedad40e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feda8102ef0 0x7feda806cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.529+0000 7fedad40e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7feda8110e30 con 0x7feda8102570 2024-09-19T06:15:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.529+0000 7fedad40e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7feda8110cb0 con 0x7feda8102ef0 2024-09-19T06:15:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.529+0000 7fedad40e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7feda8110fb0 con 0x7feda8100e20 2024-09-19T06:15:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.529+0000 7feda77fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feda8102ef0 0x7feda806cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.529+0000 7feda6ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feda8100e20 0x7feda80739e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.529+0000 7feda77fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feda8102ef0 0x7feda806cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:39098/0 (socket says 172.21.15.2:39098) 2024-09-19T06:15:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.529+0000 7feda77fe640 1 -- 172.21.15.2:0/3114397957 learned_addr learned my addr 172.21.15.2:0/3114397957 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.529+0000 7feda67fc640 1 --2- 172.21.15.2:0/3114397957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feda8102570 0x7feda806ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.529+0000 7feda6ffd640 1 -- 172.21.15.2:0/3114397957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feda8102ef0 msgr2=0x7feda806cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.529+0000 7feda6ffd640 1 --2- 172.21.15.2:0/3114397957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feda8102ef0 0x7feda806cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.529+0000 7feda6ffd640 1 -- 172.21.15.2:0/3114397957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feda8102570 msgr2=0x7feda806ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.529+0000 7feda6ffd640 1 --2- 172.21.15.2:0/3114397957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feda8102570 0x7feda806ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.529+0000 7feda6ffd640 1 -- 172.21.15.2:0/3114397957 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda806d570 con 0x7feda8100e20 2024-09-19T06:15:36.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.529+0000 7feda77fe640 1 --2- 172.21.15.2:0/3114397957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feda8102ef0 0x7feda806cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:36.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.530+0000 7feda6ffd640 1 --2- 172.21.15.2:0/3114397957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feda8100e20 0x7feda80739e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fed98005940 tx=0x7fed980040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:36.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.530+0000 7fed8ffff640 1 -- 172.21.15.2:0/3114397957 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed98035070 con 0x7feda8100e20 2024-09-19T06:15:36.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.530+0000 7fedad40e640 1 -- 172.21.15.2:0/3114397957 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feda806d800 con 0x7feda8100e20 2024-09-19T06:15:36.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.530+0000 7fed8ffff640 1 -- 172.21.15.2:0/3114397957 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fed980044b0 con 0x7feda8100e20 2024-09-19T06:15:36.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.530+0000 7fed8ffff640 1 -- 172.21.15.2:0/3114397957 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed98003d40 con 0x7feda8100e20 2024-09-19T06:15:36.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.530+0000 7fedad40e640 1 -- 172.21.15.2:0/3114397957 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feda80716e0 con 0x7feda8100e20 2024-09-19T06:15:36.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.533+0000 7fed8ffff640 1 -- 172.21.15.2:0/3114397957 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 24) ==== 138638+0+0 (secure 0 0 0) 0x7fed9803d760 con 0x7feda8100e20 2024-09-19T06:15:36.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.534+0000 7fedaf7e7740 1 Processor -- start 2024-09-19T06:15:36.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.534+0000 7fedaf7e7740 1 -- start start 2024-09-19T06:15:36.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.534+0000 7fedaf7e7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565242bcab40 0x565242bc9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:36.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.534+0000 7fedaf7e7740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565242bc95d0 0x565242bc9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:36.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.534+0000 7fedaf7e7740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565242bd4370 0x565242bd6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:36.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.534+0000 7fedaf7e7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x565242b2f2f0 con 0x565242bcab40 2024-09-19T06:15:36.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.534+0000 7fedaf7e7740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x565242ad6cf0 con 0x565242bd4370 2024-09-19T06:15:36.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.534+0000 7fedaf7e7740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x565242b2b2b0 con 0x565242bc95d0 2024-09-19T06:15:36.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.534+0000 7feda77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565242bcab40 0x565242bc9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:36.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.534+0000 7feda77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565242bcab40 0x565242bc9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39802/0 (socket says 172.21.15.2:39802) 2024-09-19T06:15:36.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.534+0000 7feda77fe640 1 -- 172.21.15.2:0/4057075285 learned_addr learned my addr 172.21.15.2:0/4057075285 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:36.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.534+0000 7feda6ffd640 1 --2- 172.21.15.2:0/4057075285 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565242bc95d0 0x565242bc9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:36.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.535+0000 7feda67fc640 1 --2- 172.21.15.2:0/4057075285 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565242bd4370 0x565242bd6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:36.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.535+0000 7feda77fe640 1 -- 172.21.15.2:0/4057075285 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565242bc95d0 msgr2=0x565242bc9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:36.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.535+0000 7feda77fe640 1 --2- 172.21.15.2:0/4057075285 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565242bc95d0 0x565242bc9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:36.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.535+0000 7feda77fe640 1 -- 172.21.15.2:0/4057075285 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565242bd4370 msgr2=0x565242bd6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:36.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.535+0000 7feda77fe640 1 --2- 172.21.15.2:0/4057075285 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565242bd4370 0x565242bd6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:36.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.535+0000 7feda77fe640 1 -- 172.21.15.2:0/4057075285 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565242abb3a0 con 0x565242bcab40 2024-09-19T06:15:36.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.535+0000 7feda67fc640 1 --2- 172.21.15.2:0/4057075285 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565242bd4370 0x565242bd6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:15:36.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.535+0000 7fed8ffff640 1 --2- 172.21.15.2:0/3114397957 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fed900a3660 0x7fed900a5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:36.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.535+0000 7feda77fe640 1 --2- 172.21.15.2:0/4057075285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565242bcab40 0x565242bc9090 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7feda0011850 tx=0x7feda0011d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=624134a1c4c98836 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:36.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.535+0000 7fed8ffff640 1 -- 172.21.15.2:0/3114397957 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fed980f48c0 con 0x7feda8100e20 2024-09-19T06:15:36.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.535+0000 7fed8d7fa640 1 -- 172.21.15.2:0/4057075285 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda0011330 con 0x565242bcab40 2024-09-19T06:15:36.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.536+0000 7fed8d7fa640 1 -- 172.21.15.2:0/4057075285 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feda000fe50 con 0x565242bcab40 2024-09-19T06:15:36.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.536+0000 7fed8d7fa640 1 -- 172.21.15.2:0/4057075285 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda00193e0 con 0x565242bcab40 2024-09-19T06:15:36.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.536+0000 7feda6ffd640 1 --2- 172.21.15.2:0/3114397957 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fed900a3660 0x7fed900a5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:36.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.536+0000 7fedaf7e7740 1 -- 172.21.15.2:0/4057075285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565242bcab40 msgr2=0x565242bc9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:36.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.536+0000 7fedaf7e7740 1 --2- 172.21.15.2:0/4057075285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565242bcab40 0x565242bc9090 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7feda0011850 tx=0x7feda0011d10 comp rx=0 tx=0).stop 2024-09-19T06:15:36.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.536+0000 7fedaf7e7740 1 -- 172.21.15.2:0/4057075285 shutdown_connections 2024-09-19T06:15:36.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.536+0000 7fedaf7e7740 1 --2- 172.21.15.2:0/4057075285 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565242bd4370 0x565242bd6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:36.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.536+0000 7fedaf7e7740 1 --2- 172.21.15.2:0/4057075285 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565242bc95d0 0x565242bc9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:36.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.536+0000 7fedaf7e7740 1 --2- 172.21.15.2:0/4057075285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565242bcab40 0x565242bc9090 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:36.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.536+0000 7fedaf7e7740 1 -- 172.21.15.2:0/4057075285 >> 172.21.15.2:0/4057075285 conn(0x565242b92310 msgr2=0x565242bc5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:36.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.537+0000 7fedaf7e7740 1 -- 172.21.15.2:0/4057075285 shutdown_connections 2024-09-19T06:15:36.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.537+0000 7fedaf7e7740 1 -- 172.21.15.2:0/4057075285 wait complete. 2024-09-19T06:15:36.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.537+0000 7feda6ffd640 1 --2- 172.21.15.2:0/3114397957 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fed900a3660 0x7fed900a5b20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fed980f1f70 tx=0x7fed98000bc0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:36.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.537+0000 7fedaf7e7740 1 -- start start 2024-09-19T06:15:36.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.537+0000 7fedaf7e7740 1 Processor -- start 2024-09-19T06:15:36.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.538+0000 7fedaf7e7740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565242bc95d0 0x565242bd3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:36.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.538+0000 7fedaf7e7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565242bcab40 0x565242bd0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:36.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.538+0000 7fedaf7e7740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565242bd4370 0x565242bd14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:36.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.538+0000 7fedaf7e7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x565242bdf880 con 0x565242bcab40 2024-09-19T06:15:36.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.538+0000 7fedaf7e7740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x565242aea060 con 0x565242bc95d0 2024-09-19T06:15:36.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.538+0000 7fedaf7e7740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x565242bdfa00 con 0x565242bd4370 2024-09-19T06:15:36.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.538+0000 7feda67fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565242bcab40 0x565242bd0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:36.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.538+0000 7feda67fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565242bcab40 0x565242bd0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39804/0 (socket says 172.21.15.2:39804) 2024-09-19T06:15:36.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.538+0000 7feda77fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565242bc95d0 0x565242bd3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:36.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.538+0000 7fedaf7e7740 10 client.0 _ll_register_callbacks cb 0x56524283d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:36.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.538+0000 7feda67fc640 1 -- 172.21.15.2:0/3918443391 learned_addr learned my addr 172.21.15.2:0/3918443391 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:36.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.538+0000 7feda77fe640 1 --2- 172.21.15.2:0/3918443391 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565242bd4370 0x565242bd14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:36.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.538+0000 7feda77fe640 1 -- 172.21.15.2:0/3918443391 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565242bd4370 msgr2=0x565242bd14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:36.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.538+0000 7feda77fe640 1 --2- 172.21.15.2:0/3918443391 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565242bd4370 0x565242bd14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:36.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.538+0000 7feda77fe640 1 -- 172.21.15.2:0/3918443391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565242bcab40 msgr2=0x565242bd0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:36.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.538+0000 7feda77fe640 1 --2- 172.21.15.2:0/3918443391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565242bcab40 0x565242bd0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:36.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.538+0000 7feda77fe640 1 -- 172.21.15.2:0/3918443391 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652428a03c0 con 0x565242bc95d0 2024-09-19T06:15:36.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.538+0000 7feda67fc640 1 --2- 172.21.15.2:0/3918443391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565242bcab40 0x565242bd0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:36.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.539+0000 7feda77fe640 1 --2- 172.21.15.2:0/3918443391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565242bc95d0 0x565242bd3cd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7feda000f790 tx=0x7feda0010b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9dbeefd94df00eb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:36.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.539+0000 7fed8aff5640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-09-19T06:15:36.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.539+0000 7fed8aff5640 1 -- 172.21.15.2:0/3918443391 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda0010700 con 0x565242bc95d0 2024-09-19T06:15:36.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.539+0000 7fedaf7e7740 1 -- 172.21.15.2:0/3918443391 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feda000fe50 con 0x565242bc95d0 2024-09-19T06:15:36.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.539+0000 7fed8aff5640 1 -- 172.21.15.2:0/3918443391 <== mon.2 v2:172.21.15.89:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7feda001f070 con 0x565242bc95d0 2024-09-19T06:15:36.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.539+0000 7fed8aff5640 1 -- 172.21.15.2:0/3918443391 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7feda00108a0 con 0x565242bc95d0 2024-09-19T06:15:36.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.539+0000 7fedaf7e7740 10 client.25154 fetch_fsmap learned FSMap version 26 2024-09-19T06:15:36.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.539+0000 7fedaf7e7740 1 -- 172.21.15.2:0/3918443391 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x565242beb1e0 con 0x565242bc95d0 2024-09-19T06:15:36.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.540+0000 7fed8aff5640 1 -- 172.21.15.2:0/3918443391 <== mon.2 v2:172.21.15.89:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feda000fe50 con 0x565242bc95d0 2024-09-19T06:15:36.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.540+0000 7fed8aff5640 1 -- 172.21.15.2:0/3918443391 <== mon.2 v2:172.21.15.89:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7feda0018070 con 0x565242bc95d0 2024-09-19T06:15:36.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.540+0000 7fedaf7e7740 10 client.25154 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:15:36.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.540+0000 7fedaf7e7740 10 client.25154 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:15:36.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.540+0000 7fedaf7e7740 20 client.25154 populate_metadata read hostname 'smithi002' 2024-09-19T06:15:36.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.540+0000 7fedaf7e7740 1 --2- 172.21.15.2:0/3918443391 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x565242bec5f0 0x565242bee9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:36.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.540+0000 7fedaf7e7740 4 client.25154 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:15:36.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.540+0000 7fedaf7e7740 1 -- 172.21.15.2:0/3918443391 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565242b3c860 con 0x565242bec5f0 2024-09-19T06:15:36.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.540+0000 7feda67fc640 1 --2- 172.21.15.2:0/3918443391 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x565242bec5f0 0x565242bee9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:36.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.541+0000 7fed8aff5640 10 client.25154 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:15:36.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.541+0000 7feda67fc640 1 --2- 172.21.15.2:0/3918443391 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x565242bec5f0 0x565242bee9e0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=727201596ba8fb4 server_cookie=2a672b008cd45e70 in_seq=0 out_seq=0 2024-09-19T06:15:36.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.542+0000 7fed8aff5640 1 -- 172.21.15.2:0/3918443391 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x565242b3c860 con 0x565242bec5f0 2024-09-19T06:15:36.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.542+0000 7fed8aff5640 10 client.25154 handle_command_reply: tid=0 2024-09-19T06:15:36.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.542+0000 7fedaf7e7740 1 client.25154 shutdown 2024-09-19T06:15:36.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.542+0000 7fedaf7e7740 1 -- 172.21.15.2:0/3918443391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565242bc95d0 msgr2=0x565242bd3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:36.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.542+0000 7fedaf7e7740 1 --2- 172.21.15.2:0/3918443391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565242bc95d0 0x565242bd3cd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7feda000f790 tx=0x7feda0010b00 comp rx=0 tx=0).stop 2024-09-19T06:15:36.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.542+0000 7fedaf7e7740 1 -- 172.21.15.2:0/3918443391 shutdown_connections 2024-09-19T06:15:36.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.542+0000 7fedaf7e7740 1 --2- 172.21.15.2:0/3918443391 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x565242bec5f0 0x565242bee9e0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:36.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.542+0000 7fed8aff5640 0 client.25154 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:15:36.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.542+0000 7fedaf7e7740 1 --2- 172.21.15.2:0/3918443391 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565242bd4370 0x565242bd14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:36.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.542+0000 7fedaf7e7740 1 --2- 172.21.15.2:0/3918443391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565242bcab40 0x565242bd0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:36.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.542+0000 7fedaf7e7740 1 --2- 172.21.15.2:0/3918443391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565242bc95d0 0x565242bd3cd0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:36.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.542+0000 7fedaf7e7740 1 -- 172.21.15.2:0/3918443391 >> 172.21.15.2:0/3918443391 conn(0x565242b92310 msgr2=0x565242bcb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:36.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.542+0000 7fedaf7e7740 1 -- 172.21.15.2:0/3918443391 shutdown_connections 2024-09-19T06:15:36.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.542+0000 7fedaf7e7740 1 -- 172.21.15.2:0/3918443391 wait complete. 2024-09-19T06:15:36.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.542+0000 7fedaf7e7740 20 client.25154 trim_cache size 0 max 16384 2024-09-19T06:15:36.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.555+0000 7fedaf7e7740 1 Processor -- start 2024-09-19T06:15:36.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.555+0000 7fedaf7e7740 1 -- start start 2024-09-19T06:15:36.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.556+0000 7fedaf7e7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565242bc95d0 0x565242be8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:36.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.556+0000 7fedaf7e7740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565242bcab40 0x565242bc4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:36.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.556+0000 7fedaf7e7740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565242bd4370 0x565242bf4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:36.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.556+0000 7fedaf7e7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7feda81b6650 con 0x565242bc95d0 2024-09-19T06:15:36.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.556+0000 7feda77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565242bc95d0 0x565242be8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:36.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.556+0000 7feda77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565242bc95d0 0x565242be8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39820/0 (socket says 172.21.15.2:39820) 2024-09-19T06:15:36.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.556+0000 7feda77fe640 1 -- 172.21.15.2:0/3538827606 learned_addr learned my addr 172.21.15.2:0/3538827606 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:36.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.556+0000 7fedaf7e7740 1 -- 172.21.15.2:0/3538827606 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7feda81b3f20 con 0x565242bcab40 2024-09-19T06:15:36.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.556+0000 7fedaf7e7740 1 -- 172.21.15.2:0/3538827606 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7feda81b1d70 con 0x565242bd4370 2024-09-19T06:15:36.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.556+0000 7feda67fc640 1 --2- 172.21.15.2:0/3538827606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565242bcab40 0x565242bc4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:36.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.556+0000 7feda77fe640 1 -- 172.21.15.2:0/3538827606 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565242bd4370 msgr2=0x565242bf4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:36.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.556+0000 7feda77fe640 1 --2- 172.21.15.2:0/3538827606 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565242bd4370 0x565242bf4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:36.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.556+0000 7feda77fe640 1 -- 172.21.15.2:0/3538827606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565242bcab40 msgr2=0x565242bc4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:36.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.556+0000 7feda77fe640 1 --2- 172.21.15.2:0/3538827606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565242bcab40 0x565242bc4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:36.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.556+0000 7feda77fe640 1 -- 172.21.15.2:0/3538827606 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565242bc6960 con 0x565242bc95d0 2024-09-19T06:15:36.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.557+0000 7feda77fe640 1 --2- 172.21.15.2:0/3538827606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565242bc95d0 0x565242be8b20 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7feda0011d50 tx=0x7feda00117d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=325cdb34130539f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:36.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.557+0000 7fed8cff9640 1 -- 172.21.15.2:0/3538827606 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda0010700 con 0x565242bc95d0 2024-09-19T06:15:36.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.557+0000 7fed8cff9640 1 -- 172.21.15.2:0/3538827606 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feda0011400 con 0x565242bc95d0 2024-09-19T06:15:36.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.557+0000 7fed8cff9640 1 -- 172.21.15.2:0/3538827606 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda0025670 con 0x565242bc95d0 2024-09-19T06:15:36.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.557+0000 7fedaf7e7740 1 -- 172.21.15.2:0/3538827606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565242bc95d0 msgr2=0x565242be8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:36.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.558+0000 7fedaf7e7740 1 --2- 172.21.15.2:0/3538827606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565242bc95d0 0x565242be8b20 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7feda0011d50 tx=0x7feda00117d0 comp rx=0 tx=0).stop 2024-09-19T06:15:36.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.558+0000 7fedaf7e7740 1 -- 172.21.15.2:0/3538827606 shutdown_connections 2024-09-19T06:15:36.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.558+0000 7fedaf7e7740 1 --2- 172.21.15.2:0/3538827606 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565242bd4370 0x565242bf4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:36.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.558+0000 7fedaf7e7740 1 --2- 172.21.15.2:0/3538827606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565242bcab40 0x565242bc4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:36.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.558+0000 7fedaf7e7740 1 --2- 172.21.15.2:0/3538827606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565242bc95d0 0x565242be8b20 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:36.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.558+0000 7fedaf7e7740 1 -- 172.21.15.2:0/3538827606 >> 172.21.15.2:0/3538827606 conn(0x565242b92310 msgr2=0x565242bc44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:36.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.558+0000 7fedaf7e7740 1 -- 172.21.15.2:0/3538827606 shutdown_connections 2024-09-19T06:15:36.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.558+0000 7fedaf7e7740 1 -- 172.21.15.2:0/3538827606 wait complete. 2024-09-19T06:15:36.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.558+0000 7fedaf7e7740 1 -- start start 2024-09-19T06:15:36.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.558+0000 7fedaf7e7740 1 Processor -- start 2024-09-19T06:15:36.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.559+0000 7fedaf7e7740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565242bc95d0 0x565242be4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:36.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.559+0000 7fedaf7e7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565242bcab40 0x565242be5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:36.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.559+0000 7fedaf7e7740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565242bd4370 0x565242be05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:36.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.559+0000 7fedaf7e7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7feda81b23e0 con 0x565242bcab40 2024-09-19T06:15:36.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.559+0000 7fedaf7e7740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7feda81b3850 con 0x565242bd4370 2024-09-19T06:15:36.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.559+0000 7fedaf7e7740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7feda81b2ab0 con 0x565242bc95d0 2024-09-19T06:15:36.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.559+0000 7fedaf7e7740 10 client.0 _ll_register_callbacks cb 0x7feda000fae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:36.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.559+0000 7feda67fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565242bcab40 0x565242be5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:36.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.559+0000 7feda77fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565242bc95d0 0x565242be4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:36.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.559+0000 7feda77fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565242bc95d0 0x565242be4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:49600/0 (socket says 172.21.15.2:49600) 2024-09-19T06:15:36.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.559+0000 7feda77fe640 1 -- 172.21.15.2:0/2485695440 learned_addr learned my addr 172.21.15.2:0/2485695440 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:36.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.559+0000 7feda77fe640 1 --2- 172.21.15.2:0/2485695440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565242bd4370 0x565242be05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:36.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.559+0000 7feda77fe640 1 -- 172.21.15.2:0/2485695440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565242bd4370 msgr2=0x565242be05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:36.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.559+0000 7feda77fe640 1 --2- 172.21.15.2:0/2485695440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565242bd4370 0x565242be05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:36.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.559+0000 7feda77fe640 1 -- 172.21.15.2:0/2485695440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565242bcab40 msgr2=0x565242be5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:36.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.559+0000 7feda77fe640 1 --2- 172.21.15.2:0/2485695440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565242bcab40 0x565242be5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:36.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.559+0000 7feda77fe640 1 -- 172.21.15.2:0/2485695440 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565242be0df0 con 0x565242bc95d0 2024-09-19T06:15:36.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.559+0000 7feda67fc640 1 --2- 172.21.15.2:0/2485695440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565242bcab40 0x565242be5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:15:36.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.560+0000 7feda77fe640 1 --2- 172.21.15.2:0/2485695440 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565242bc95d0 0x565242be4ff0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7feda00094f0 tx=0x7feda0009a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ab6bd91bbd4df42 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:36.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.560+0000 7fed8aff5640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-19T06:15:36.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.560+0000 7fed8aff5640 1 -- 172.21.15.2:0/2485695440 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda00049d0 con 0x565242bc95d0 2024-09-19T06:15:36.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.560+0000 7fed8aff5640 1 -- 172.21.15.2:0/2485695440 <== mon.1 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7feda0004b70 con 0x565242bc95d0 2024-09-19T06:15:36.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.560+0000 7fedaf7e7740 1 -- 172.21.15.2:0/2485695440 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feda0011400 con 0x565242bc95d0 2024-09-19T06:15:36.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.560+0000 7fed8aff5640 1 -- 172.21.15.2:0/2485695440 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7feda004a050 con 0x565242bc95d0 2024-09-19T06:15:36.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.560+0000 7fedaf7e7740 10 client.25096 fetch_fsmap learned FSMap version 26 2024-09-19T06:15:36.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.560+0000 7fedaf7e7740 1 -- 172.21.15.2:0/2485695440 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x565242c56d40 con 0x565242bc95d0 2024-09-19T06:15:36.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.560+0000 7fed8aff5640 1 -- 172.21.15.2:0/2485695440 <== mon.1 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feda0025e40 con 0x565242bc95d0 2024-09-19T06:15:36.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.560+0000 7fed8aff5640 1 -- 172.21.15.2:0/2485695440 <== mon.1 v2:172.21.15.90:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7feda0018040 con 0x565242bc95d0 2024-09-19T06:15:36.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.561+0000 7fedaf7e7740 10 client.25096 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:15:36.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.561+0000 7fedaf7e7740 10 client.25096 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:15:36.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.561+0000 7fedaf7e7740 20 client.25096 populate_metadata read hostname 'smithi002' 2024-09-19T06:15:36.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.561+0000 7fedaf7e7740 1 --2- 172.21.15.2:0/2485695440 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x565242c57320 0x565242c59740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:36.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.561+0000 7fedaf7e7740 4 client.25096 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:15:36.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.561+0000 7fedaf7e7740 1 -- 172.21.15.2:0/2485695440 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7feda0011400 con 0x565242c57320 2024-09-19T06:15:36.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.561+0000 7feda67fc640 1 --2- 172.21.15.2:0/2485695440 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x565242c57320 0x565242c59740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:36.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.562+0000 7feda67fc640 1 --2- 172.21.15.2:0/2485695440 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x565242c57320 0x565242c59740 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=eda964ea619ef14 server_cookie=b0752f437911f634 in_seq=0 out_seq=0 2024-09-19T06:15:36.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.562+0000 7fed8aff5640 10 client.25096 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:15:36.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.562+0000 7fed8aff5640 1 -- 172.21.15.2:0/2485695440 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7feda0011400 con 0x565242c57320 2024-09-19T06:15:36.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.562+0000 7fed8aff5640 10 client.25096 handle_command_reply: tid=0 2024-09-19T06:15:36.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.562+0000 7fedaf7e7740 1 client.25096 shutdown 2024-09-19T06:15:36.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.562+0000 7fedaf7e7740 1 -- 172.21.15.2:0/2485695440 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565242bc95d0 msgr2=0x565242be4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:36.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.562+0000 7fedaf7e7740 1 --2- 172.21.15.2:0/2485695440 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565242bc95d0 0x565242be4ff0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7feda00094f0 tx=0x7feda0009a30 comp rx=0 tx=0).stop 2024-09-19T06:15:36.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.563+0000 7fedaf7e7740 1 -- 172.21.15.2:0/2485695440 shutdown_connections 2024-09-19T06:15:36.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.563+0000 7fedaf7e7740 1 --2- 172.21.15.2:0/2485695440 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x565242c57320 0x565242c59740 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:36.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.563+0000 7fedaf7e7740 1 --2- 172.21.15.2:0/2485695440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565242bd4370 0x565242be05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:36.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.563+0000 7fedaf7e7740 1 --2- 172.21.15.2:0/2485695440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565242bcab40 0x565242be5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:36.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.563+0000 7fedaf7e7740 1 --2- 172.21.15.2:0/2485695440 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565242bc95d0 0x565242be4ff0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:36.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.563+0000 7fedaf7e7740 1 -- 172.21.15.2:0/2485695440 >> 172.21.15.2:0/2485695440 conn(0x565242b92310 msgr2=0x565242bc4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:36.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.563+0000 7fed8aff5640 0 client.25096 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:15:36.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.563+0000 7fedaf7e7740 1 -- 172.21.15.2:0/2485695440 shutdown_connections 2024-09-19T06:15:36.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.563+0000 7fedaf7e7740 1 -- 172.21.15.2:0/2485695440 wait complete. 2024-09-19T06:15:36.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.563+0000 7fedaf7e7740 20 client.25096 trim_cache size 0 max 16384 2024-09-19T06:15:36.594 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:15:36.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.564+0000 7fedad40e640 1 -- 172.21.15.2:0/3114397957 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fed900a3660 msgr2=0x7fed900a5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:36.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.564+0000 7fedad40e640 1 --2- 172.21.15.2:0/3114397957 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fed900a3660 0x7fed900a5b20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fed980f1f70 tx=0x7fed98000bc0 comp rx=0 tx=0).stop 2024-09-19T06:15:36.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.564+0000 7fedad40e640 1 -- 172.21.15.2:0/3114397957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feda8100e20 msgr2=0x7feda80739e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:36.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.564+0000 7fedad40e640 1 --2- 172.21.15.2:0/3114397957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feda8100e20 0x7feda80739e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fed98005940 tx=0x7fed980040c0 comp rx=0 tx=0).stop 2024-09-19T06:15:36.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.564+0000 7fedad40e640 1 -- 172.21.15.2:0/3114397957 shutdown_connections 2024-09-19T06:15:36.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.564+0000 7fedad40e640 1 --2- 172.21.15.2:0/3114397957 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fed900a3660 0x7fed900a5b20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:36.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.564+0000 7fedad40e640 1 --2- 172.21.15.2:0/3114397957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feda8102ef0 0x7feda806cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:36.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.564+0000 7fedad40e640 1 --2- 172.21.15.2:0/3114397957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feda8102570 0x7feda806ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:36.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.564+0000 7fedad40e640 1 --2- 172.21.15.2:0/3114397957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feda8100e20 0x7feda80739e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:36.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.564+0000 7fedad40e640 1 -- 172.21.15.2:0/3114397957 >> 172.21.15.2:0/3114397957 conn(0x7feda80fc7d0 msgr2=0x7feda80fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:36.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.564+0000 7fedad40e640 1 -- 172.21.15.2:0/3114397957 shutdown_connections 2024-09-19T06:15:36.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:36.564+0000 7fedad40e640 1 -- 172.21.15.2:0/3114397957 wait complete. 2024-09-19T06:15:37.188 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:15:37.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:37 smithi002 ceph-mon[30982]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-19T06:15:37.475 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:15:37.489 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:37 smithi090 ceph-mon[34497]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-19T06:15:37.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:37 smithi089 ceph-mon[34160]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-19T06:15:38.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.009+0000 7f8925eb5640 1 -- 172.21.15.2:0/3966159005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89201036e0 msgr2=0x7f8920107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:38.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.009+0000 7f8925eb5640 1 --2- 172.21.15.2:0/3966159005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89201036e0 0x7f8920107b90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f8914009930 tx=0x7f891402a420 comp rx=0 tx=0).stop 2024-09-19T06:15:38.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.009+0000 7f8925eb5640 1 -- 172.21.15.2:0/3966159005 shutdown_connections 2024-09-19T06:15:38.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.009+0000 7f8925eb5640 1 --2- 172.21.15.2:0/3966159005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89201082a0 0x7f892010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:38.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.009+0000 7f8925eb5640 1 --2- 172.21.15.2:0/3966159005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89201036e0 0x7f8920107b90 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:38.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.009+0000 7f8925eb5640 1 --2- 172.21.15.2:0/3966159005 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8920102d30 0x7f8920103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:38.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.009+0000 7f8925eb5640 1 -- 172.21.15.2:0/3966159005 >> 172.21.15.2:0/3966159005 conn(0x7f89200fc7d0 msgr2=0x7f89200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:38.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.009+0000 7f8925eb5640 1 -- 172.21.15.2:0/3966159005 shutdown_connections 2024-09-19T06:15:38.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.009+0000 7f8925eb5640 1 -- 172.21.15.2:0/3966159005 wait complete. 2024-09-19T06:15:38.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.010+0000 7f8925eb5640 1 Processor -- start 2024-09-19T06:15:38.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.011+0000 7f8925eb5640 1 -- start start 2024-09-19T06:15:38.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.011+0000 7f8925eb5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8920102d30 0x7f8920073b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:38.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.011+0000 7f8925eb5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89201036e0 0x7f892006cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:38.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.011+0000 7f8925eb5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89201082a0 0x7f892006d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:38.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.011+0000 7f8925eb5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8920111f50 con 0x7f89201082a0 2024-09-19T06:15:38.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.011+0000 7f8925eb5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8920111dd0 con 0x7f89201036e0 2024-09-19T06:15:38.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.011+0000 7f8925eb5640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f89201120d0 con 0x7f8920102d30 2024-09-19T06:15:38.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.011+0000 7f891f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8920102d30 0x7f8920073b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:38.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.011+0000 7f891f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8920102d30 0x7f8920073b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:49620/0 (socket says 172.21.15.2:49620) 2024-09-19T06:15:38.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.011+0000 7f891f7fe640 1 -- 172.21.15.2:0/4126297642 learned_addr learned my addr 172.21.15.2:0/4126297642 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:38.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.011+0000 7f891effd640 1 --2- 172.21.15.2:0/4126297642 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89201036e0 0x7f892006cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:38.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.012+0000 7f891ffff640 1 --2- 172.21.15.2:0/4126297642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89201082a0 0x7f892006d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:38.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.012+0000 7f891f7fe640 1 -- 172.21.15.2:0/4126297642 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89201036e0 msgr2=0x7f892006cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:38.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.012+0000 7f891f7fe640 1 --2- 172.21.15.2:0/4126297642 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89201036e0 0x7f892006cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:38.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.012+0000 7f891f7fe640 1 -- 172.21.15.2:0/4126297642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89201082a0 msgr2=0x7f892006d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:38.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.012+0000 7f891f7fe640 1 --2- 172.21.15.2:0/4126297642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89201082a0 0x7f892006d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:38.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.012+0000 7f891f7fe640 1 -- 172.21.15.2:0/4126297642 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f892006d850 con 0x7f8920102d30 2024-09-19T06:15:38.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.012+0000 7f891f7fe640 1 --2- 172.21.15.2:0/4126297642 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8920102d30 0x7f8920073b50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8910009c40 tx=0x7f891000b690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:38.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.012+0000 7f891cff9640 1 -- 172.21.15.2:0/4126297642 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8910005020 con 0x7f8920102d30 2024-09-19T06:15:38.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.012+0000 7f8925eb5640 1 -- 172.21.15.2:0/4126297642 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8920071680 con 0x7f8920102d30 2024-09-19T06:15:38.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.012+0000 7f8925eb5640 1 -- 172.21.15.2:0/4126297642 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8920071b90 con 0x7f8920102d30 2024-09-19T06:15:38.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.012+0000 7f891cff9640 1 -- 172.21.15.2:0/4126297642 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8910005670 con 0x7f8920102d30 2024-09-19T06:15:38.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.012+0000 7f891cff9640 1 -- 172.21.15.2:0/4126297642 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8910019670 con 0x7f8920102d30 2024-09-19T06:15:38.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.016+0000 7f892828e740 1 Processor -- start 2024-09-19T06:15:38.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.016+0000 7f891cff9640 1 -- 172.21.15.2:0/4126297642 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 24) ==== 138638+0+0 (secure 0 0 0) 0x7f89100051c0 con 0x7f8920102d30 2024-09-19T06:15:38.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.016+0000 7f892828e740 1 -- start start 2024-09-19T06:15:38.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.016+0000 7f892828e740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a80f93b40 0x560a80f92090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:38.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.016+0000 7f892828e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a80f925d0 0x560a80f92a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:38.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.016+0000 7f892828e740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a80f9d370 0x560a80f9f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:38.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.016+0000 7f892828e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560a80ef82f0 con 0x560a80f925d0 2024-09-19T06:15:38.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.016+0000 7f892828e740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x560a80e9fcf0 con 0x560a80f93b40 2024-09-19T06:15:38.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.016+0000 7f892828e740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560a80ef42b0 con 0x560a80f9d370 2024-09-19T06:15:38.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.016+0000 7f891f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a80f925d0 0x560a80f92a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:38.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.017+0000 7f891f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a80f925d0 0x560a80f92a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39850/0 (socket says 172.21.15.2:39850) 2024-09-19T06:15:38.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.017+0000 7f891f7fe640 1 -- 172.21.15.2:0/2102562397 learned_addr learned my addr 172.21.15.2:0/2102562397 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:38.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.017+0000 7f891effd640 1 --2- 172.21.15.2:0/2102562397 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a80f9d370 0x560a80f9f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:38.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.017+0000 7f891ffff640 1 --2- 172.21.15.2:0/2102562397 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a80f93b40 0x560a80f92090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:38.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.017+0000 7f891f7fe640 1 -- 172.21.15.2:0/2102562397 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a80f9d370 msgr2=0x560a80f9f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:38.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.017+0000 7f891f7fe640 1 --2- 172.21.15.2:0/2102562397 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a80f9d370 0x560a80f9f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:38.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.017+0000 7f891f7fe640 1 -- 172.21.15.2:0/2102562397 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a80f93b40 msgr2=0x560a80f92090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:38.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.017+0000 7f891f7fe640 1 --2- 172.21.15.2:0/2102562397 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a80f93b40 0x560a80f92090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:38.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.017+0000 7f891f7fe640 1 -- 172.21.15.2:0/2102562397 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a80e843a0 con 0x560a80f925d0 2024-09-19T06:15:38.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.017+0000 7f891ffff640 1 --2- 172.21.15.2:0/2102562397 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a80f93b40 0x560a80f92090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:15:38.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.017+0000 7f891f7fe640 1 --2- 172.21.15.2:0/2102562397 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a80f925d0 0x560a80f92a10 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f89100cc910 tx=0x7f89100d5cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5df0391c14ab7eb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:38.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.018+0000 7f891cff9640 1 --2- 172.21.15.2:0/4126297642 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f89080abdf0 0x7f89080ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:38.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.018+0000 7f891ffff640 1 --2- 172.21.15.2:0/4126297642 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f89080abdf0 0x7f89080ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:38.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.018+0000 7f891cff9640 1 -- 172.21.15.2:0/4126297642 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f89100cf430 con 0x7f8920102d30 2024-09-19T06:15:38.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.018+0000 7f8905ffb640 1 -- 172.21.15.2:0/2102562397 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89100e2070 con 0x560a80f925d0 2024-09-19T06:15:38.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.019+0000 7f891ffff640 1 --2- 172.21.15.2:0/4126297642 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f89080abdf0 0x7f89080ae2b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8918008e30 tx=0x7f89180087c0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:38.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.019+0000 7f8905ffb640 1 -- 172.21.15.2:0/2102562397 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f891009f8b0 con 0x560a80f925d0 2024-09-19T06:15:38.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.020+0000 7f892828e740 1 -- 172.21.15.2:0/2102562397 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a80f925d0 msgr2=0x560a80f92a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:38.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.020+0000 7f892828e740 1 --2- 172.21.15.2:0/2102562397 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a80f925d0 0x560a80f92a10 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f89100cc910 tx=0x7f89100d5cb0 comp rx=0 tx=0).stop 2024-09-19T06:15:38.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.020+0000 7f892828e740 1 -- 172.21.15.2:0/2102562397 shutdown_connections 2024-09-19T06:15:38.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.020+0000 7f892828e740 1 --2- 172.21.15.2:0/2102562397 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a80f9d370 0x560a80f9f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:38.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.020+0000 7f892828e740 1 --2- 172.21.15.2:0/2102562397 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a80f925d0 0x560a80f92a10 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:38.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.020+0000 7f892828e740 1 --2- 172.21.15.2:0/2102562397 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a80f93b40 0x560a80f92090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:38.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.020+0000 7f892828e740 1 -- 172.21.15.2:0/2102562397 >> 172.21.15.2:0/2102562397 conn(0x560a80f5b310 msgr2=0x560a80f8ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:38.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.020+0000 7f892828e740 1 -- 172.21.15.2:0/2102562397 shutdown_connections 2024-09-19T06:15:38.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.020+0000 7f892828e740 1 -- 172.21.15.2:0/2102562397 wait complete. 2024-09-19T06:15:38.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.020+0000 7f892828e740 1 -- start start 2024-09-19T06:15:38.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.021+0000 7f892828e740 1 Processor -- start 2024-09-19T06:15:38.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.021+0000 7f892828e740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a80f925d0 0x560a80f9cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:38.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.021+0000 7f892828e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a80f93b40 0x560a80f99e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:38.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.021+0000 7f892828e740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a80f9d370 0x560a80f9a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:38.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.021+0000 7f892828e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560a80fa0110 con 0x560a80f93b40 2024-09-19T06:15:38.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.021+0000 7f892828e740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x560a80eb3060 con 0x560a80f925d0 2024-09-19T06:15:38.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.021+0000 7f892828e740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560a80fa0290 con 0x560a80f9d370 2024-09-19T06:15:38.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.021+0000 7f892828e740 10 client.0 _ll_register_callbacks cb 0x560a80c068c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:38.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.021+0000 7f891f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a80f925d0 0x560a80f9cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:38.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.021+0000 7f891ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a80f9d370 0x560a80f9a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:38.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.021+0000 7f891f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a80f925d0 0x560a80f9cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:39174/0 (socket says 172.21.15.2:39174) 2024-09-19T06:15:38.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.021+0000 7f891f7fe640 1 -- 172.21.15.2:0/233405325 learned_addr learned my addr 172.21.15.2:0/233405325 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:38.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.021+0000 7f891effd640 1 --2- 172.21.15.2:0/233405325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a80f93b40 0x560a80f99e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:38.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.022+0000 7f891f7fe640 1 -- 172.21.15.2:0/233405325 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a80f9d370 msgr2=0x560a80f9a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:38.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.022+0000 7f891f7fe640 1 --2- 172.21.15.2:0/233405325 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a80f9d370 0x560a80f9a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:38.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.022+0000 7f891f7fe640 1 -- 172.21.15.2:0/233405325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a80f93b40 msgr2=0x560a80f99e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:38.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.022+0000 7f891f7fe640 1 --2- 172.21.15.2:0/233405325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a80f93b40 0x560a80f99e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:38.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.022+0000 7f891f7fe640 1 -- 172.21.15.2:0/233405325 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a80c693c0 con 0x560a80f925d0 2024-09-19T06:15:38.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.022+0000 7f891effd640 1 --2- 172.21.15.2:0/233405325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a80f93b40 0x560a80f99e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:38.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.022+0000 7f891f7fe640 1 --2- 172.21.15.2:0/233405325 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a80f925d0 0x560a80f9cbc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f891009b490 tx=0x7f8910009f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5992d1de06132bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:38.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.022+0000 7f88feffd640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-09-19T06:15:38.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.022+0000 7f88feffd640 1 -- 172.21.15.2:0/233405325 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891009ca60 con 0x560a80f925d0 2024-09-19T06:15:38.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.022+0000 7f88feffd640 1 -- 172.21.15.2:0/233405325 <== mon.2 v2:172.21.15.89:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f891009b960 con 0x560a80f925d0 2024-09-19T06:15:38.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.022+0000 7f892828e740 1 -- 172.21.15.2:0/233405325 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f891009f8b0 con 0x560a80f925d0 2024-09-19T06:15:38.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.023+0000 7f88feffd640 1 -- 172.21.15.2:0/233405325 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f891009cc90 con 0x560a80f925d0 2024-09-19T06:15:38.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.023+0000 7f892828e740 10 client.25169 fetch_fsmap learned FSMap version 26 2024-09-19T06:15:38.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.023+0000 7f892828e740 1 -- 172.21.15.2:0/233405325 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560a80fa0110 con 0x560a80f925d0 2024-09-19T06:15:38.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.023+0000 7f88feffd640 1 -- 172.21.15.2:0/233405325 <== mon.2 v2:172.21.15.89:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f891009f8b0 con 0x560a80f925d0 2024-09-19T06:15:38.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.023+0000 7f88feffd640 1 -- 172.21.15.2:0/233405325 <== mon.2 v2:172.21.15.89:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f89100a3ce0 con 0x560a80f925d0 2024-09-19T06:15:38.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.023+0000 7f892828e740 10 client.25169 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:15:38.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.023+0000 7f892828e740 10 client.25169 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:15:38.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.023+0000 7f892828e740 20 client.25169 populate_metadata read hostname 'smithi002' 2024-09-19T06:15:38.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.023+0000 7f892828e740 1 --2- 172.21.15.2:0/233405325 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560a80fcec60 0x560a80fd1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:38.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.023+0000 7f892828e740 4 client.25169 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:15:38.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.023+0000 7f892828e740 1 -- 172.21.15.2:0/233405325 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560a80f05860 con 0x560a80fcec60 2024-09-19T06:15:38.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.023+0000 7f891effd640 1 --2- 172.21.15.2:0/233405325 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560a80fcec60 0x560a80fd1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:38.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.024+0000 7f891effd640 1 --2- 172.21.15.2:0/233405325 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560a80fcec60 0x560a80fd1050 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbbd0d39c26df2a7 server_cookie=2ee69d92914c3741 in_seq=0 out_seq=0 2024-09-19T06:15:38.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.024+0000 7f88feffd640 10 client.25169 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:15:38.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.025+0000 7f88feffd640 1 -- 172.21.15.2:0/233405325 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560a80f05860 con 0x560a80fcec60 2024-09-19T06:15:38.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.025+0000 7f88feffd640 10 client.25169 handle_command_reply: tid=0 2024-09-19T06:15:38.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.025+0000 7f892828e740 1 client.25169 shutdown 2024-09-19T06:15:38.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.025+0000 7f892828e740 1 -- 172.21.15.2:0/233405325 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a80f925d0 msgr2=0x560a80f9cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:38.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.025+0000 7f892828e740 1 --2- 172.21.15.2:0/233405325 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a80f925d0 0x560a80f9cbc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f891009b490 tx=0x7f8910009f40 comp rx=0 tx=0).stop 2024-09-19T06:15:38.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.025+0000 7f892828e740 1 -- 172.21.15.2:0/233405325 shutdown_connections 2024-09-19T06:15:38.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.025+0000 7f892828e740 1 --2- 172.21.15.2:0/233405325 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a80f9d370 0x560a80f9a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:38.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.025+0000 7f892828e740 1 --2- 172.21.15.2:0/233405325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a80f93b40 0x560a80f99e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:38.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.025+0000 7f892828e740 1 --2- 172.21.15.2:0/233405325 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560a80fcec60 0x560a80fd1050 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:38.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.025+0000 7f892828e740 1 --2- 172.21.15.2:0/233405325 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a80f925d0 0x560a80f9cbc0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:38.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.025+0000 7f892828e740 1 -- 172.21.15.2:0/233405325 >> 172.21.15.2:0/233405325 conn(0x560a80f5b310 msgr2=0x560a80f94930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:38.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.025+0000 7f88feffd640 0 client.25169 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:15:38.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.025+0000 7f892828e740 1 -- 172.21.15.2:0/233405325 shutdown_connections 2024-09-19T06:15:38.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.025+0000 7f892828e740 1 -- 172.21.15.2:0/233405325 wait complete. 2024-09-19T06:15:38.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.025+0000 7f892828e740 20 client.25169 trim_cache size 0 max 16384 2024-09-19T06:15:38.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.051+0000 7f892828e740 1 Processor -- start 2024-09-19T06:15:38.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.051+0000 7f892828e740 1 -- start start 2024-09-19T06:15:38.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.051+0000 7f892828e740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a80f925d0 0x560a80f98d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:38.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.052+0000 7f892828e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a80f93b40 0x560a80f9e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:38.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.052+0000 7f892828e740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a80f9d370 0x560a80f9eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:38.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.052+0000 7f892828e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f890c021ff0 con 0x560a80f93b40 2024-09-19T06:15:38.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.052+0000 7f892828e740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f890c01f8c0 con 0x560a80f9d370 2024-09-19T06:15:38.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.052+0000 7f892828e740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f890c01d710 con 0x560a80f925d0 2024-09-19T06:15:38.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.052+0000 7f891f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a80f925d0 0x560a80f98d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:38.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.052+0000 7f891f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a80f925d0 0x560a80f98d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:49642/0 (socket says 172.21.15.2:49642) 2024-09-19T06:15:38.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.052+0000 7f891f7fe640 1 -- 172.21.15.2:0/520997195 learned_addr learned my addr 172.21.15.2:0/520997195 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:38.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.052+0000 7f891ffff640 1 --2- 172.21.15.2:0/520997195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a80f9d370 0x560a80f9eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:38.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.052+0000 7f891f7fe640 1 -- 172.21.15.2:0/520997195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a80f9d370 msgr2=0x560a80f9eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:38.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.052+0000 7f891f7fe640 1 --2- 172.21.15.2:0/520997195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a80f9d370 0x560a80f9eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:38.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.052+0000 7f891f7fe640 1 -- 172.21.15.2:0/520997195 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a80f93b40 msgr2=0x560a80f9e760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:15:38.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.052+0000 7f891f7fe640 1 --2- 172.21.15.2:0/520997195 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a80f93b40 0x560a80f9e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:38.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.052+0000 7f891f7fe640 1 -- 172.21.15.2:0/520997195 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a80f8eed0 con 0x560a80f925d0 2024-09-19T06:15:38.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.052+0000 7f891ffff640 1 --2- 172.21.15.2:0/520997195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a80f9d370 0x560a80f9eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:15:38.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.053+0000 7f891f7fe640 1 --2- 172.21.15.2:0/520997195 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a80f925d0 0x560a80f98d20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8910097960 tx=0x7f89100d5cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c50cea3e919d0c2e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:38.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.053+0000 7f89057fa640 1 -- 172.21.15.2:0/520997195 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891009cef0 con 0x560a80f925d0 2024-09-19T06:15:38.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.053+0000 7f89057fa640 1 -- 172.21.15.2:0/520997195 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f891009f8b0 con 0x560a80f925d0 2024-09-19T06:15:38.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.053+0000 7f89057fa640 1 -- 172.21.15.2:0/520997195 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891009d140 con 0x560a80f925d0 2024-09-19T06:15:38.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.054+0000 7f892828e740 1 -- 172.21.15.2:0/520997195 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a80f925d0 msgr2=0x560a80f98d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:38.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.054+0000 7f892828e740 1 --2- 172.21.15.2:0/520997195 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a80f925d0 0x560a80f98d20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8910097960 tx=0x7f89100d5cb0 comp rx=0 tx=0).stop 2024-09-19T06:15:38.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.054+0000 7f892828e740 1 -- 172.21.15.2:0/520997195 shutdown_connections 2024-09-19T06:15:38.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.054+0000 7f892828e740 1 --2- 172.21.15.2:0/520997195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a80f9d370 0x560a80f9eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:38.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.054+0000 7f892828e740 1 --2- 172.21.15.2:0/520997195 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a80f93b40 0x560a80f9e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:38.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.055+0000 7f892828e740 1 --2- 172.21.15.2:0/520997195 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a80f925d0 0x560a80f98d20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:38.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.055+0000 7f892828e740 1 -- 172.21.15.2:0/520997195 >> 172.21.15.2:0/520997195 conn(0x560a80f5b310 msgr2=0x560a80f98610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:38.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.055+0000 7f892828e740 1 -- 172.21.15.2:0/520997195 shutdown_connections 2024-09-19T06:15:38.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.055+0000 7f892828e740 1 -- 172.21.15.2:0/520997195 wait complete. 2024-09-19T06:15:38.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.055+0000 7f892828e740 1 -- start start 2024-09-19T06:15:38.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.056+0000 7f892828e740 1 Processor -- start 2024-09-19T06:15:38.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.056+0000 7f892828e740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a80f925d0 0x560a80fa59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:38.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.056+0000 7f892828e740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a80f93b40 0x560a80f9de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:38.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.056+0000 7f892828e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a80f9d370 0x560a80f9e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:38.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.056+0000 7f892828e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f890c01dd80 con 0x560a80f9d370 2024-09-19T06:15:38.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.056+0000 7f891effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a80f93b40 0x560a80f9de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:38.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.057+0000 7f892828e740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f890c01f1f0 con 0x560a80f93b40 2024-09-19T06:15:38.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.057+0000 7f892828e740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f890c01e450 con 0x560a80f925d0 2024-09-19T06:15:38.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.057+0000 7f891effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a80f93b40 0x560a80f9de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:39188/0 (socket says 172.21.15.2:39188) 2024-09-19T06:15:38.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.057+0000 7f891effd640 1 -- 172.21.15.2:0/3987987992 learned_addr learned my addr 172.21.15.2:0/3987987992 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:38.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.057+0000 7f892828e740 10 client.0 _ll_register_callbacks cb 0x7f89100e0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:38.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.057+0000 7f891effd640 1 -- 172.21.15.2:0/3987987992 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a80f925d0 msgr2=0x560a80fa59e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:15:38.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.057+0000 7f891effd640 1 --2- 172.21.15.2:0/3987987992 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a80f925d0 0x560a80fa59e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:38.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.057+0000 7f891effd640 1 -- 172.21.15.2:0/3987987992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a80f9d370 msgr2=0x560a80f9e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:38.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.057+0000 7f891effd640 1 --2- 172.21.15.2:0/3987987992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a80f9d370 0x560a80f9e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:38.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.057+0000 7f891effd640 1 -- 172.21.15.2:0/3987987992 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a80f9e880 con 0x560a80f93b40 2024-09-19T06:15:38.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.057+0000 7f891effd640 1 --2- 172.21.15.2:0/3987987992 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a80f93b40 0x560a80f9de00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8914009900 tx=0x7f8914004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39191ca05aec7b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:38.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.057+0000 7f88feffd640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-09-19T06:15:38.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.057+0000 7f88feffd640 1 -- 172.21.15.2:0/3987987992 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8914035040 con 0x560a80f93b40 2024-09-19T06:15:38.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.057+0000 7f88feffd640 1 -- 172.21.15.2:0/3987987992 <== mon.2 v2:172.21.15.89:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f8914004400 con 0x560a80f93b40 2024-09-19T06:15:38.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.058+0000 7f892828e740 1 -- 172.21.15.2:0/3987987992 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f891009f8b0 con 0x560a80f93b40 2024-09-19T06:15:38.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.058+0000 7f88feffd640 1 -- 172.21.15.2:0/3987987992 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8914005040 con 0x560a80f93b40 2024-09-19T06:15:38.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.058+0000 7f892828e740 10 client.25175 fetch_fsmap learned FSMap version 26 2024-09-19T06:15:38.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.058+0000 7f892828e740 1 -- 172.21.15.2:0/3987987992 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560a80fa42e0 con 0x560a80f93b40 2024-09-19T06:15:38.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.058+0000 7f88feffd640 1 -- 172.21.15.2:0/3987987992 <== mon.2 v2:172.21.15.89:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8914004770 con 0x560a80f93b40 2024-09-19T06:15:38.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.058+0000 7f88feffd640 1 -- 172.21.15.2:0/3987987992 <== mon.2 v2:172.21.15.89:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f89140035f0 con 0x560a80f93b40 2024-09-19T06:15:38.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.058+0000 7f892828e740 10 client.25175 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:15:38.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.058+0000 7f892828e740 10 client.25175 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:15:38.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.058+0000 7f892828e740 20 client.25175 populate_metadata read hostname 'smithi002' 2024-09-19T06:15:38.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.058+0000 7f892828e740 1 --2- 172.21.15.2:0/3987987992 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560a8105bc60 0x560a8105e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:38.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.058+0000 7f892828e740 4 client.25175 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:15:38.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.058+0000 7f892828e740 1 -- 172.21.15.2:0/3987987992 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f891009f8b0 con 0x560a8105bc60 2024-09-19T06:15:38.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.059+0000 7f891f7fe640 1 --2- 172.21.15.2:0/3987987992 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560a8105bc60 0x560a8105e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:38.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.059+0000 7f88feffd640 10 client.25175 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:15:38.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.059+0000 7f891f7fe640 1 --2- 172.21.15.2:0/3987987992 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560a8105bc60 0x560a8105e080 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=507cdf772a73d68e server_cookie=8b3b6f3ca91c7759 in_seq=0 out_seq=0 2024-09-19T06:15:38.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.059+0000 7f88feffd640 1 -- 172.21.15.2:0/3987987992 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f891009f8b0 con 0x560a8105bc60 2024-09-19T06:15:38.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.059+0000 7f88feffd640 10 client.25175 handle_command_reply: tid=0 2024-09-19T06:15:38.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.059+0000 7f892828e740 1 client.25175 shutdown 2024-09-19T06:15:38.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.060+0000 7f892828e740 1 -- 172.21.15.2:0/3987987992 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a80f93b40 msgr2=0x560a80f9de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:38.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.060+0000 7f892828e740 1 --2- 172.21.15.2:0/3987987992 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a80f93b40 0x560a80f9de00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8914009900 tx=0x7f8914004040 comp rx=0 tx=0).stop 2024-09-19T06:15:38.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.060+0000 7f892828e740 1 -- 172.21.15.2:0/3987987992 shutdown_connections 2024-09-19T06:15:38.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.060+0000 7f892828e740 1 --2- 172.21.15.2:0/3987987992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a80f9d370 0x560a80f9e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:38.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.060+0000 7f892828e740 1 --2- 172.21.15.2:0/3987987992 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560a8105bc60 0x560a8105e080 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:38.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.060+0000 7f892828e740 1 --2- 172.21.15.2:0/3987987992 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a80f93b40 0x560a80f9de00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:38.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.060+0000 7f892828e740 1 --2- 172.21.15.2:0/3987987992 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a80f925d0 0x560a80fa59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:38.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.060+0000 7f88feffd640 0 client.25175 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:15:38.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.060+0000 7f892828e740 1 -- 172.21.15.2:0/3987987992 >> 172.21.15.2:0/3987987992 conn(0x560a80f5b310 msgr2=0x560a80f8dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:38.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.060+0000 7f892828e740 1 -- 172.21.15.2:0/3987987992 shutdown_connections 2024-09-19T06:15:38.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.060+0000 7f892828e740 1 -- 172.21.15.2:0/3987987992 wait complete. 2024-09-19T06:15:38.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.060+0000 7f892828e740 20 client.25175 trim_cache size 0 max 16384 2024-09-19T06:15:38.065 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:15:38.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.061+0000 7f8925eb5640 1 -- 172.21.15.2:0/4126297642 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f89080abdf0 msgr2=0x7f89080ae2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:38.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.061+0000 7f8925eb5640 1 --2- 172.21.15.2:0/4126297642 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f89080abdf0 0x7f89080ae2b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8918008e30 tx=0x7f89180087c0 comp rx=0 tx=0).stop 2024-09-19T06:15:38.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.061+0000 7f8925eb5640 1 -- 172.21.15.2:0/4126297642 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8920102d30 msgr2=0x7f8920073b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:38.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.061+0000 7f8925eb5640 1 --2- 172.21.15.2:0/4126297642 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8920102d30 0x7f8920073b50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8910009c40 tx=0x7f891000b690 comp rx=0 tx=0).stop 2024-09-19T06:15:38.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.061+0000 7f8925eb5640 1 -- 172.21.15.2:0/4126297642 shutdown_connections 2024-09-19T06:15:38.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.061+0000 7f8925eb5640 1 --2- 172.21.15.2:0/4126297642 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f89080abdf0 0x7f89080ae2b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:38.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.061+0000 7f8925eb5640 1 --2- 172.21.15.2:0/4126297642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89201082a0 0x7f892006d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:38.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.061+0000 7f8925eb5640 1 --2- 172.21.15.2:0/4126297642 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89201036e0 0x7f892006cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:38.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.061+0000 7f8925eb5640 1 --2- 172.21.15.2:0/4126297642 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8920102d30 0x7f8920073b50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:38.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.061+0000 7f8925eb5640 1 -- 172.21.15.2:0/4126297642 >> 172.21.15.2:0/4126297642 conn(0x7f89200fc7d0 msgr2=0x7f8920105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:38.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.061+0000 7f8925eb5640 1 -- 172.21.15.2:0/4126297642 shutdown_connections 2024-09-19T06:15:38.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:38.061+0000 7f8925eb5640 1 -- 172.21.15.2:0/4126297642 wait complete. 2024-09-19T06:15:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.150+0000 7f9417a42640 1 -- 172.21.15.2:0/205917097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9410101ac0 msgr2=0x7f9410101f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.150+0000 7f9417a42640 1 --2- 172.21.15.2:0/205917097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9410101ac0 0x7f9410101f20 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9400009930 tx=0x7f940002a420 comp rx=0 tx=0).stop 2024-09-19T06:15:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.150+0000 7f9417a42640 1 -- 172.21.15.2:0/205917097 shutdown_connections 2024-09-19T06:15:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.150+0000 7f9417a42640 1 --2- 172.21.15.2:0/205917097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9410102460 0x7f941010e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.150+0000 7f9417a42640 1 --2- 172.21.15.2:0/205917097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9410101ac0 0x7f9410101f20 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.150+0000 7f9417a42640 1 --2- 172.21.15.2:0/205917097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9410107ad0 0x7f9410107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.150+0000 7f9417a42640 1 -- 172.21.15.2:0/205917097 >> 172.21.15.2:0/205917097 conn(0x7f94100fd7e0 msgr2=0x7f94100ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.150+0000 7f9417a42640 1 -- 172.21.15.2:0/205917097 shutdown_connections 2024-09-19T06:15:39.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.150+0000 7f9417a42640 1 -- 172.21.15.2:0/205917097 wait complete. 2024-09-19T06:15:39.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.150+0000 7f9417a42640 1 Processor -- start 2024-09-19T06:15:39.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.151+0000 7f9417a42640 1 -- start start 2024-09-19T06:15:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.151+0000 7f9417a42640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9410101ac0 0x7f94100744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.151+0000 7f9417a42640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9410102460 0x7f9410074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.151+0000 7f9417a42640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9410107ad0 0x7f9410074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.151+0000 7f9417a42640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9410111dc0 con 0x7f9410101ac0 2024-09-19T06:15:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.151+0000 7f9417a42640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9410111c40 con 0x7f9410107ad0 2024-09-19T06:15:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.151+0000 7f9417a42640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9410111f40 con 0x7f9410102460 2024-09-19T06:15:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.151+0000 7f94157de640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9410101ac0 0x7f94100744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.151+0000 7f94157de640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9410101ac0 0x7f94100744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39906/0 (socket says 172.21.15.2:39906) 2024-09-19T06:15:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.151+0000 7f94157de640 1 -- 172.21.15.2:0/1238993492 learned_addr learned my addr 172.21.15.2:0/1238993492 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.151+0000 7f9414fdd640 1 --2- 172.21.15.2:0/1238993492 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9410102460 0x7f9410074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.151+0000 7f9415fdf640 1 --2- 172.21.15.2:0/1238993492 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9410107ad0 0x7f9410074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.151+0000 7f94157de640 1 -- 172.21.15.2:0/1238993492 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9410102460 msgr2=0x7f9410074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.151+0000 7f94157de640 1 --2- 172.21.15.2:0/1238993492 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9410102460 0x7f9410074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.151+0000 7f94157de640 1 -- 172.21.15.2:0/1238993492 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9410107ad0 msgr2=0x7f9410074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.151+0000 7f94157de640 1 --2- 172.21.15.2:0/1238993492 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9410107ad0 0x7f9410074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.151+0000 7f94157de640 1 -- 172.21.15.2:0/1238993492 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94101a68b0 con 0x7f9410101ac0 2024-09-19T06:15:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.152+0000 7f94157de640 1 --2- 172.21.15.2:0/1238993492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9410101ac0 0x7f94100744f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f940c00e9f0 tx=0x7f940c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.152+0000 7f94067fc640 1 -- 172.21.15.2:0/1238993492 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f940c00cd80 con 0x7f9410101ac0 2024-09-19T06:15:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.152+0000 7f9417a42640 1 -- 172.21.15.2:0/1238993492 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94101a6ba0 con 0x7f9410101ac0 2024-09-19T06:15:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.152+0000 7f9417a42640 1 -- 172.21.15.2:0/1238993492 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94101a7110 con 0x7f9410101ac0 2024-09-19T06:15:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.152+0000 7f94067fc640 1 -- 172.21.15.2:0/1238993492 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f940c0108e0 con 0x7f9410101ac0 2024-09-19T06:15:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.152+0000 7f94067fc640 1 -- 172.21.15.2:0/1238993492 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f940c0188e0 con 0x7f9410101ac0 2024-09-19T06:15:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.155+0000 7f94067fc640 1 -- 172.21.15.2:0/1238993492 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 24) ==== 138638+0+0 (secure 0 0 0) 0x7f940c010a90 con 0x7f9410101ac0 2024-09-19T06:15:39.157 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.155+0000 7f94067fc640 1 --2- 172.21.15.2:0/1238993492 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f93fc0a3560 0x7f93fc0a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:39.157 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.156+0000 7f941a7d1740 1 Processor -- start 2024-09-19T06:15:39.158 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.156+0000 7f941a7d1740 1 -- start start 2024-09-19T06:15:39.158 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.156+0000 7f94067fc640 1 -- 172.21.15.2:0/1238993492 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f940c0d0230 con 0x7f9410101ac0 2024-09-19T06:15:39.158 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.156+0000 7f9414fdd640 1 --2- 172.21.15.2:0/1238993492 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f93fc0a3560 0x7f93fc0a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:39.158 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.156+0000 7f941a7d1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560893ab5a10 0x560893ab5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:39.159 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.156+0000 7f941a7d1740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560893ab6330 0x560893ac8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:39.159 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.156+0000 7f941a7d1740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560893ac94c0 0x560893acb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:39.159 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.156+0000 7f941a7d1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560893a1a2f0 con 0x560893ab5a10 2024-09-19T06:15:39.159 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.156+0000 7f941a7d1740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5608939c2270 con 0x560893ab6330 2024-09-19T06:15:39.159 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.156+0000 7f941a7d1740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560893a162b0 con 0x560893ac94c0 2024-09-19T06:15:39.159 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.156+0000 7f94157de640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560893ab5a10 0x560893ab5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:39.159 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.156+0000 7f94157de640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560893ab5a10 0x560893ab5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39908/0 (socket says 172.21.15.2:39908) 2024-09-19T06:15:39.159 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.156+0000 7f94157de640 1 -- 172.21.15.2:0/2787789426 learned_addr learned my addr 172.21.15.2:0/2787789426 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:39.159 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.156+0000 7f9415fdf640 1 --2- 172.21.15.2:0/2787789426 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560893ac94c0 0x560893acb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:39.159 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.156+0000 7f94157de640 1 -- 172.21.15.2:0/2787789426 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560893ac94c0 msgr2=0x560893acb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:39.159 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.156+0000 7f94157de640 1 --2- 172.21.15.2:0/2787789426 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560893ac94c0 0x560893acb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:39.159 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.156+0000 7f94157de640 1 -- 172.21.15.2:0/2787789426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560893ab6330 msgr2=0x560893ac8f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:15:39.160 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.156+0000 7f94157de640 1 --2- 172.21.15.2:0/2787789426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560893ab6330 0x560893ac8f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:39.160 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.156+0000 7f94157de640 1 -- 172.21.15.2:0/2787789426 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608939c1340 con 0x560893ab5a10 2024-09-19T06:15:39.160 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.156+0000 7f9415fdf640 1 --2- 172.21.15.2:0/2787789426 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560893ac94c0 0x560893acb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:15:39.160 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.157+0000 7f9414fdd640 1 --2- 172.21.15.2:0/1238993492 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f93fc0a3560 0x7f93fc0a5a20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9400009900 tx=0x7f9400000bc0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:39.160 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.157+0000 7f94157de640 1 --2- 172.21.15.2:0/2787789426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560893ab5a10 0x560893ab5df0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f940c0a4a80 tx=0x7f940c010e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=483f77ae5c97f300 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:39.160 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.157+0000 7f93fb7fe640 1 -- 172.21.15.2:0/2787789426 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f940c0b5070 con 0x560893ab5a10 2024-09-19T06:15:39.160 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.157+0000 7f93fb7fe640 1 -- 172.21.15.2:0/2787789426 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f940c0a4fb0 con 0x560893ab5a10 2024-09-19T06:15:39.160 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.157+0000 7f93fb7fe640 1 -- 172.21.15.2:0/2787789426 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f940c0cdac0 con 0x560893ab5a10 2024-09-19T06:15:39.165 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.158+0000 7f941a7d1740 1 -- 172.21.15.2:0/2787789426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560893ab5a10 msgr2=0x560893ab5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:39.165 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.158+0000 7f941a7d1740 1 --2- 172.21.15.2:0/2787789426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560893ab5a10 0x560893ab5df0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f940c0a4a80 tx=0x7f940c010e00 comp rx=0 tx=0).stop 2024-09-19T06:15:39.166 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.158+0000 7f941a7d1740 1 -- 172.21.15.2:0/2787789426 shutdown_connections 2024-09-19T06:15:39.166 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.158+0000 7f941a7d1740 1 --2- 172.21.15.2:0/2787789426 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560893ac94c0 0x560893acb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:39.166 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.158+0000 7f941a7d1740 1 --2- 172.21.15.2:0/2787789426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560893ab6330 0x560893ac8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:39.166 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.158+0000 7f941a7d1740 1 --2- 172.21.15.2:0/2787789426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560893ab5a10 0x560893ab5df0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:39.166 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.158+0000 7f941a7d1740 1 -- 172.21.15.2:0/2787789426 >> 172.21.15.2:0/2787789426 conn(0x560893ab2060 msgr2=0x560893ab2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:39.166 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.158+0000 7f941a7d1740 1 -- 172.21.15.2:0/2787789426 shutdown_connections 2024-09-19T06:15:39.166 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.158+0000 7f941a7d1740 1 -- 172.21.15.2:0/2787789426 wait complete. 2024-09-19T06:15:39.166 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.158+0000 7f941a7d1740 1 -- start start 2024-09-19T06:15:39.166 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.158+0000 7f941a7d1740 1 Processor -- start 2024-09-19T06:15:39.166 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.159+0000 7f941a7d1740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560893ab5a10 0x560893ac3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:39.166 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.159+0000 7f941a7d1740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560893ab6330 0x560893ac3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:39.166 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.159+0000 7f941a7d1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560893ac94c0 0x560893ac8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.159+0000 7f941a7d1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560893ab89b0 con 0x560893ac94c0 2024-09-19T06:15:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.159+0000 7f941a7d1740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5608939a3290 con 0x560893ab5a10 2024-09-19T06:15:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.159+0000 7f941a7d1740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560893ab8b30 con 0x560893ab6330 2024-09-19T06:15:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.159+0000 7f9415fdf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560893ac94c0 0x560893ac8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.159+0000 7f9415fdf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560893ac94c0 0x560893ac8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39922/0 (socket says 172.21.15.2:39922) 2024-09-19T06:15:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.159+0000 7f9415fdf640 1 -- 172.21.15.2:0/2384902804 learned_addr learned my addr 172.21.15.2:0/2384902804 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.159+0000 7f941a7d1740 10 client.0 _ll_register_callbacks cb 0x5608939d4140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.159+0000 7f94157de640 1 --2- 172.21.15.2:0/2384902804 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560893ab5a10 0x560893ac3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.159+0000 7f9414fdd640 1 --2- 172.21.15.2:0/2384902804 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560893ab6330 0x560893ac3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.159+0000 7f9415fdf640 1 -- 172.21.15.2:0/2384902804 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560893ab6330 msgr2=0x560893ac3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.159+0000 7f9415fdf640 1 --2- 172.21.15.2:0/2384902804 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560893ab6330 0x560893ac3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.159+0000 7f9415fdf640 1 -- 172.21.15.2:0/2384902804 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560893ab5a10 msgr2=0x560893ac3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.159+0000 7f9415fdf640 1 --2- 172.21.15.2:0/2384902804 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560893ab5a10 0x560893ac3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:39.168 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.159+0000 7f9415fdf640 1 -- 172.21.15.2:0/2384902804 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56089372d210 con 0x560893ac94c0 2024-09-19T06:15:39.168 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.159+0000 7f9415fdf640 1 --2- 172.21.15.2:0/2384902804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560893ac94c0 0x560893ac8d40 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9408003c20 tx=0x7f9408004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8031785fdee7f924 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:39.168 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.159+0000 7f93f8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:15:39.168 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.160+0000 7f93f8ff9640 1 -- 172.21.15.2:0/2384902804 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9408004d20 con 0x560893ac94c0 2024-09-19T06:15:39.168 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.160+0000 7f93f8ff9640 1 -- 172.21.15.2:0/2384902804 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f9408011650 con 0x560893ac94c0 2024-09-19T06:15:39.168 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.160+0000 7f941a7d1740 1 -- 172.21.15.2:0/2384902804 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f940c0a4fb0 con 0x560893ac94c0 2024-09-19T06:15:39.168 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.160+0000 7f93f8ff9640 1 -- 172.21.15.2:0/2384902804 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9408011850 con 0x560893ac94c0 2024-09-19T06:15:39.168 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.160+0000 7f941a7d1740 10 client.15474 fetch_fsmap learned FSMap version 26 2024-09-19T06:15:39.168 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.160+0000 7f941a7d1740 1 -- 172.21.15.2:0/2384902804 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5608937f9620 con 0x560893ac94c0 2024-09-19T06:15:39.168 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.161+0000 7f93f8ff9640 1 -- 172.21.15.2:0/2384902804 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f940c0a4fb0 con 0x560893ac94c0 2024-09-19T06:15:39.168 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.161+0000 7f93f8ff9640 1 -- 172.21.15.2:0/2384902804 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f9408019030 con 0x560893ac94c0 2024-09-19T06:15:39.168 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.161+0000 7f941a7d1740 10 client.15474 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:15:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.161+0000 7f941a7d1740 10 client.15474 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:15:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.161+0000 7f941a7d1740 20 client.15474 populate_metadata read hostname 'smithi002' 2024-09-19T06:15:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.161+0000 7f941a7d1740 1 --2- 172.21.15.2:0/2384902804 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560893ae1d30 0x560893ae4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.161+0000 7f941a7d1740 4 client.15474 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:15:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.161+0000 7f941a7d1740 1 -- 172.21.15.2:0/2384902804 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560893a27a20 con 0x560893ae1d30 2024-09-19T06:15:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.162+0000 7f94157de640 1 --2- 172.21.15.2:0/2384902804 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560893ae1d30 0x560893ae4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.162+0000 7f93f8ff9640 10 client.15474 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:15:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.162+0000 7f94157de640 1 --2- 172.21.15.2:0/2384902804 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560893ae1d30 0x560893ae4120 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbe6d6a9b0967d32 server_cookie=a414aba881d38db4 in_seq=0 out_seq=0 2024-09-19T06:15:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.163+0000 7f93f8ff9640 1 -- 172.21.15.2:0/2384902804 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560893a27a20 con 0x560893ae1d30 2024-09-19T06:15:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.163+0000 7f93f8ff9640 10 client.15474 handle_command_reply: tid=0 2024-09-19T06:15:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.163+0000 7f941a7d1740 1 client.15474 shutdown 2024-09-19T06:15:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.163+0000 7f941a7d1740 1 -- 172.21.15.2:0/2384902804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560893ac94c0 msgr2=0x560893ac8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:39.170 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.163+0000 7f941a7d1740 1 --2- 172.21.15.2:0/2384902804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560893ac94c0 0x560893ac8d40 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9408003c20 tx=0x7f9408004410 comp rx=0 tx=0).stop 2024-09-19T06:15:39.170 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.163+0000 7f941a7d1740 1 -- 172.21.15.2:0/2384902804 shutdown_connections 2024-09-19T06:15:39.170 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.163+0000 7f941a7d1740 1 --2- 172.21.15.2:0/2384902804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560893ac94c0 0x560893ac8d40 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:39.170 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.163+0000 7f941a7d1740 1 --2- 172.21.15.2:0/2384902804 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560893ab6330 0x560893ac3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:39.170 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.163+0000 7f941a7d1740 1 --2- 172.21.15.2:0/2384902804 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560893ae1d30 0x560893ae4120 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:39.170 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.163+0000 7f93f8ff9640 0 client.15474 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:15:39.170 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.163+0000 7f941a7d1740 1 --2- 172.21.15.2:0/2384902804 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560893ab5a10 0x560893ac3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:39.170 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.163+0000 7f941a7d1740 1 -- 172.21.15.2:0/2384902804 >> 172.21.15.2:0/2384902804 conn(0x560893ab2060 msgr2=0x560893ab7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:39.170 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.164+0000 7f941a7d1740 1 -- 172.21.15.2:0/2384902804 shutdown_connections 2024-09-19T06:15:39.170 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.164+0000 7f941a7d1740 1 -- 172.21.15.2:0/2384902804 wait complete. 2024-09-19T06:15:39.170 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.164+0000 7f941a7d1740 20 client.15474 trim_cache size 0 max 16384 2024-09-19T06:15:39.181 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.178+0000 7f941a7d1740 1 Processor -- start 2024-09-19T06:15:39.181 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.178+0000 7f941a7d1740 1 -- start start 2024-09-19T06:15:39.181 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.178+0000 7f941a7d1740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560893ab5a10 0x560893ac8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:39.181 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.178+0000 7f941a7d1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560893ab6330 0x560893ae9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:39.182 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.178+0000 7f941a7d1740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560893ac94c0 0x560893ae9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:39.182 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.179+0000 7f941a7d1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f94101ade80 con 0x560893ab6330 2024-09-19T06:15:39.182 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.179+0000 7f941a7d1740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f94101ab750 con 0x560893ab5a10 2024-09-19T06:15:39.182 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.179+0000 7f941a7d1740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f94101a95a0 con 0x560893ac94c0 2024-09-19T06:15:39.182 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.179+0000 7f9414fdd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560893ab6330 0x560893ae9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:39.182 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.179+0000 7f9414fdd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560893ab6330 0x560893ae9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39930/0 (socket says 172.21.15.2:39930) 2024-09-19T06:15:39.182 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.179+0000 7f9414fdd640 1 -- 172.21.15.2:0/2333512106 learned_addr learned my addr 172.21.15.2:0/2333512106 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:39.182 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.179+0000 7f94157de640 1 --2- 172.21.15.2:0/2333512106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560893ab5a10 0x560893ac8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:39.182 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.179+0000 7f9415fdf640 1 --2- 172.21.15.2:0/2333512106 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560893ac94c0 0x560893ae9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:39.182 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.179+0000 7f9414fdd640 1 -- 172.21.15.2:0/2333512106 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560893ac94c0 msgr2=0x560893ae9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:39.182 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.179+0000 7f9414fdd640 1 --2- 172.21.15.2:0/2333512106 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560893ac94c0 0x560893ae9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:39.182 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.179+0000 7f9414fdd640 1 -- 172.21.15.2:0/2333512106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560893ab5a10 msgr2=0x560893ac8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:39.182 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.179+0000 7f9414fdd640 1 --2- 172.21.15.2:0/2333512106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560893ab5a10 0x560893ac8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:39.183 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.179+0000 7f9414fdd640 1 -- 172.21.15.2:0/2333512106 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560893ab6160 con 0x560893ab6330 2024-09-19T06:15:39.183 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.179+0000 7f9415fdf640 1 --2- 172.21.15.2:0/2333512106 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560893ac94c0 0x560893ae9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:15:39.183 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.179+0000 7f9414fdd640 1 --2- 172.21.15.2:0/2333512106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560893ab6330 0x560893ae9990 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9400009930 tx=0x7f940003d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27944a4c52e309dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:39.183 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.180+0000 7f93faffd640 1 -- 172.21.15.2:0/2333512106 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9400035040 con 0x560893ab6330 2024-09-19T06:15:39.183 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.180+0000 7f93faffd640 1 -- 172.21.15.2:0/2333512106 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f94000317d0 con 0x560893ab6330 2024-09-19T06:15:39.183 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.180+0000 7f93faffd640 1 -- 172.21.15.2:0/2333512106 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9400035040 con 0x560893ab6330 2024-09-19T06:15:39.186 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.180+0000 7f941a7d1740 1 -- 172.21.15.2:0/2333512106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560893ab6330 msgr2=0x560893ae9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:39.186 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.180+0000 7f941a7d1740 1 --2- 172.21.15.2:0/2333512106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560893ab6330 0x560893ae9990 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9400009930 tx=0x7f940003d000 comp rx=0 tx=0).stop 2024-09-19T06:15:39.186 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.180+0000 7f941a7d1740 1 -- 172.21.15.2:0/2333512106 shutdown_connections 2024-09-19T06:15:39.186 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.180+0000 7f941a7d1740 1 --2- 172.21.15.2:0/2333512106 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560893ac94c0 0x560893ae9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:39.186 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.180+0000 7f941a7d1740 1 --2- 172.21.15.2:0/2333512106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560893ab6330 0x560893ae9990 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:39.186 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.180+0000 7f941a7d1740 1 --2- 172.21.15.2:0/2333512106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560893ab5a10 0x560893ac8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:39.187 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.180+0000 7f941a7d1740 1 -- 172.21.15.2:0/2333512106 >> 172.21.15.2:0/2333512106 conn(0x560893ab2060 msgr2=0x560893abd420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:39.187 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.181+0000 7f941a7d1740 1 -- 172.21.15.2:0/2333512106 shutdown_connections 2024-09-19T06:15:39.187 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.181+0000 7f941a7d1740 1 -- 172.21.15.2:0/2333512106 wait complete. 2024-09-19T06:15:39.187 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.181+0000 7f941a7d1740 1 -- start start 2024-09-19T06:15:39.187 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.181+0000 7f941a7d1740 1 Processor -- start 2024-09-19T06:15:39.187 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.182+0000 7f941a7d1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560893ab5a10 0x560893af1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:39.187 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.182+0000 7f94157de640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560893ab5a10 0x560893af1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:39.187 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.182+0000 7f94157de640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560893ab5a10 0x560893af1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39944/0 (socket says 172.21.15.2:39944) 2024-09-19T06:15:39.187 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.182+0000 7f94157de640 1 -- 172.21.15.2:0/261275798 learned_addr learned my addr 172.21.15.2:0/261275798 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:39.187 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.182+0000 7f941a7d1740 1 --2- 172.21.15.2:0/261275798 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560893ac94c0 0x560893af1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:39.187 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.182+0000 7f941a7d1740 1 --2- 172.21.15.2:0/261275798 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560893af1ff0 0x560893b4b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:39.187 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.182+0000 7f941a7d1740 1 -- 172.21.15.2:0/261275798 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f94101a9c10 con 0x560893ab5a10 2024-09-19T06:15:39.187 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.182+0000 7f941a7d1740 1 -- 172.21.15.2:0/261275798 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f94101ab080 con 0x560893ac94c0 2024-09-19T06:15:39.188 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.182+0000 7f941a7d1740 1 -- 172.21.15.2:0/261275798 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f94101aa2e0 con 0x560893af1ff0 2024-09-19T06:15:39.188 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.182+0000 7f9415fdf640 1 --2- 172.21.15.2:0/261275798 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560893af1ff0 0x560893b4b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:39.188 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.182+0000 7f94157de640 1 -- 172.21.15.2:0/261275798 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560893af1ff0 msgr2=0x560893b4b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:39.188 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.182+0000 7f94157de640 1 --2- 172.21.15.2:0/261275798 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560893af1ff0 0x560893b4b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:39.188 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.182+0000 7f94157de640 1 -- 172.21.15.2:0/261275798 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560893ac94c0 msgr2=0x560893af1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:39.188 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.182+0000 7f94157de640 1 --2- 172.21.15.2:0/261275798 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560893ac94c0 0x560893af1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:39.188 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.182+0000 7f94157de640 1 -- 172.21.15.2:0/261275798 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560893b4bd50 con 0x560893ab5a10 2024-09-19T06:15:39.188 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.183+0000 7f94157de640 1 --2- 172.21.15.2:0/261275798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560893ab5a10 0x560893af1570 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f940c09c5b0 tx=0x7f940c09bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e68fe4ba4b4488 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:39.188 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.183+0000 7f941a7d1740 10 client.0 _ll_register_callbacks cb 0x7f9408009ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:39.188 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.183+0000 7f941a7d1740 1 -- 172.21.15.2:0/261275798 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94000317d0 con 0x560893ab5a10 2024-09-19T06:15:39.188 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.183+0000 7f93f8ff9640 10 client.15480 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:15:39.188 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.183+0000 7f93f8ff9640 1 -- 172.21.15.2:0/261275798 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f940c0b5040 con 0x560893ab5a10 2024-09-19T06:15:39.188 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.183+0000 7f93f8ff9640 1 -- 172.21.15.2:0/261275798 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f940c010430 con 0x560893ab5a10 2024-09-19T06:15:39.189 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.183+0000 7f93f8ff9640 1 -- 172.21.15.2:0/261275798 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f940c010670 con 0x560893ab5a10 2024-09-19T06:15:39.189 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.183+0000 7f941a7d1740 10 client.15480 fetch_fsmap learned FSMap version 26 2024-09-19T06:15:39.189 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.183+0000 7f941a7d1740 1 -- 172.21.15.2:0/261275798 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({fsmap=26}) -- 0x560893b4cd80 con 0x560893ab5a10 2024-09-19T06:15:39.189 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.183+0000 7f93f8ff9640 1 -- 172.21.15.2:0/261275798 <== mon.0 v2:172.21.15.2:3300/0 4 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f940c09b840 con 0x560893ab5a10 2024-09-19T06:15:39.189 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.183+0000 7f941a7d1740 10 client.15480 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:15:39.189 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.183+0000 7f941a7d1740 10 client.15480 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:15:39.189 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.183+0000 7f941a7d1740 20 client.15480 populate_metadata read hostname 'smithi002' 2024-09-19T06:15:39.189 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.183+0000 7f941a7d1740 1 --2- 172.21.15.2:0/261275798 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560893b4cfc0 0x560893b4f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:39.189 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.184+0000 7f941a7d1740 4 client.15480 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:15:39.189 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.184+0000 7f941a7d1740 1 -- 172.21.15.2:0/261275798 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560893a21d70 con 0x560893b4cfc0 2024-09-19T06:15:39.189 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.184+0000 7f9414fdd640 1 --2- 172.21.15.2:0/261275798 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560893b4cfc0 0x560893b4f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:39.189 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.184+0000 7f93f8ff9640 10 client.15480 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:15:39.189 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.184+0000 7f9414fdd640 1 --2- 172.21.15.2:0/261275798 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560893b4cfc0 0x560893b4f430 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4991ba71568909b9 server_cookie=1d27df1954b0e96e in_seq=0 out_seq=0 2024-09-19T06:15:39.191 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.187+0000 7f93f8ff9640 1 -- 172.21.15.2:0/261275798 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560893a21d70 con 0x560893b4cfc0 2024-09-19T06:15:39.191 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.187+0000 7f93f8ff9640 10 client.15480 handle_command_reply: tid=0 2024-09-19T06:15:39.191 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.188+0000 7f941a7d1740 1 client.15480 shutdown 2024-09-19T06:15:39.191 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.188+0000 7f941a7d1740 1 -- 172.21.15.2:0/261275798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560893ab5a10 msgr2=0x560893af1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:39.191 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.188+0000 7f941a7d1740 1 --2- 172.21.15.2:0/261275798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560893ab5a10 0x560893af1570 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f940c09c5b0 tx=0x7f940c09bd50 comp rx=0 tx=0).stop 2024-09-19T06:15:39.191 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.188+0000 7f941a7d1740 1 -- 172.21.15.2:0/261275798 shutdown_connections 2024-09-19T06:15:39.191 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.188+0000 7f941a7d1740 1 --2- 172.21.15.2:0/261275798 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560893af1ff0 0x560893b4b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:39.191 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.188+0000 7f941a7d1740 1 --2- 172.21.15.2:0/261275798 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560893b4cfc0 0x560893b4f430 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:39.192 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.188+0000 7f941a7d1740 1 --2- 172.21.15.2:0/261275798 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560893ac94c0 0x560893af1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:39.192 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.188+0000 7f941a7d1740 1 --2- 172.21.15.2:0/261275798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560893ab5a10 0x560893af1570 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:39.192 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.188+0000 7f941a7d1740 1 -- 172.21.15.2:0/261275798 >> 172.21.15.2:0/261275798 conn(0x560893ab2060 msgr2=0x560893ab09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:39.192 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.188+0000 7f93f8ff9640 0 client.15480 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:15:39.192 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.188+0000 7f941a7d1740 1 -- 172.21.15.2:0/261275798 shutdown_connections 2024-09-19T06:15:39.192 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.188+0000 7f941a7d1740 1 -- 172.21.15.2:0/261275798 wait complete. 2024-09-19T06:15:39.192 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.188+0000 7f941a7d1740 20 client.15480 trim_cache size 0 max 16384 2024-09-19T06:15:39.192 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-19T06:15:39.192 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-19T06:15:39.192 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-19T06:15:39.193 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-19T06:15:39.193 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.189+0000 7f9417a42640 1 -- 172.21.15.2:0/1238993492 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f93fc0a3560 msgr2=0x7f93fc0a5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:39.193 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.189+0000 7f9417a42640 1 --2- 172.21.15.2:0/1238993492 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f93fc0a3560 0x7f93fc0a5a20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9400009900 tx=0x7f9400000bc0 comp rx=0 tx=0).stop 2024-09-19T06:15:39.193 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.189+0000 7f9417a42640 1 -- 172.21.15.2:0/1238993492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9410101ac0 msgr2=0x7f94100744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:39.193 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.189+0000 7f9417a42640 1 --2- 172.21.15.2:0/1238993492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9410101ac0 0x7f94100744f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f940c00e9f0 tx=0x7f940c00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:15:39.194 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.189+0000 7f9417a42640 1 -- 172.21.15.2:0/1238993492 shutdown_connections 2024-09-19T06:15:39.194 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.189+0000 7f9417a42640 1 --2- 172.21.15.2:0/1238993492 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f93fc0a3560 0x7f93fc0a5a20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:39.194 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.189+0000 7f9417a42640 1 --2- 172.21.15.2:0/1238993492 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9410107ad0 0x7f9410074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:39.194 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.189+0000 7f9417a42640 1 --2- 172.21.15.2:0/1238993492 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9410102460 0x7f9410074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:39.194 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.189+0000 7f9417a42640 1 --2- 172.21.15.2:0/1238993492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9410101ac0 0x7f94100744f0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:39.194 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.189+0000 7f9417a42640 1 -- 172.21.15.2:0/1238993492 >> 172.21.15.2:0/1238993492 conn(0x7f94100fd7e0 msgr2=0x7f94100fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:39.194 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.189+0000 7f9417a42640 1 -- 172.21.15.2:0/1238993492 shutdown_connections 2024-09-19T06:15:39.194 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:39.189+0000 7f9417a42640 1 -- 172.21.15.2:0/1238993492 wait complete. 2024-09-19T06:15:39.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:39 smithi002 ceph-mon[30982]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-19T06:15:39.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:39 smithi090 ceph-mon[34497]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-19T06:15:39.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:39 smithi089 ceph-mon[34160]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-19T06:15:39.669 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:15:39.669 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:15:39.950 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:15:40.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.484+0000 7fb4222a6640 1 -- 172.21.15.2:0/2455066611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb41c102db0 msgr2=0x7fb41c103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:40.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.484+0000 7fb4222a6640 1 --2- 172.21.15.2:0/2455066611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb41c102db0 0x7fb41c103190 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb40c009900 tx=0x7fb40c02a480 comp rx=0 tx=0).stop 2024-09-19T06:15:40.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.484+0000 7fb4222a6640 1 -- 172.21.15.2:0/2455066611 shutdown_connections 2024-09-19T06:15:40.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.484+0000 7fb4222a6640 1 --2- 172.21.15.2:0/2455066611 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb41c10c190 0x7fb41c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:40.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.484+0000 7fb4222a6640 1 --2- 172.21.15.2:0/2455066611 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb41c1036d0 0x7fb41c10bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:40.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.484+0000 7fb4222a6640 1 --2- 172.21.15.2:0/2455066611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb41c102db0 0x7fb41c103190 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:40.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.484+0000 7fb4222a6640 1 -- 172.21.15.2:0/2455066611 >> 172.21.15.2:0/2455066611 conn(0x7fb41c0fc7d0 msgr2=0x7fb41c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:40.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.484+0000 7fb4222a6640 1 -- 172.21.15.2:0/2455066611 shutdown_connections 2024-09-19T06:15:40.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.484+0000 7fb4222a6640 1 -- 172.21.15.2:0/2455066611 wait complete. 2024-09-19T06:15:40.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.485+0000 7fb4222a6640 1 Processor -- start 2024-09-19T06:15:40.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.485+0000 7fb4222a6640 1 -- start start 2024-09-19T06:15:40.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.486+0000 7fb4222a6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb41c102db0 0x7fb41c198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:40.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.486+0000 7fb4222a6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb41c1036d0 0x7fb41c198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:40.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.486+0000 7fb4222a6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb41c10c190 0x7fb41c19cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:40.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.486+0000 7fb4222a6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb41c111e20 con 0x7fb41c10c190 2024-09-19T06:15:40.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.486+0000 7fb4222a6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb41c111ca0 con 0x7fb41c1036d0 2024-09-19T06:15:40.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.486+0000 7fb4222a6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb41c111fa0 con 0x7fb41c102db0 2024-09-19T06:15:40.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.486+0000 7fb420843640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb41c10c190 0x7fb41c19cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:40.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.486+0000 7fb41bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb41c102db0 0x7fb41c198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:40.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.486+0000 7fb420843640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb41c10c190 0x7fb41c19cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39962/0 (socket says 172.21.15.2:39962) 2024-09-19T06:15:40.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.486+0000 7fb420843640 1 -- 172.21.15.2:0/4165672090 learned_addr learned my addr 172.21.15.2:0/4165672090 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:40.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.486+0000 7fb41b7fe640 1 --2- 172.21.15.2:0/4165672090 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb41c1036d0 0x7fb41c198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:40.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.486+0000 7fb420843640 1 -- 172.21.15.2:0/4165672090 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb41c102db0 msgr2=0x7fb41c198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:40.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.486+0000 7fb420843640 1 --2- 172.21.15.2:0/4165672090 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb41c102db0 0x7fb41c198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:40.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.486+0000 7fb420843640 1 -- 172.21.15.2:0/4165672090 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb41c1036d0 msgr2=0x7fb41c198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:40.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.486+0000 7fb420843640 1 --2- 172.21.15.2:0/4165672090 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb41c1036d0 0x7fb41c198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:40.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.486+0000 7fb420843640 1 -- 172.21.15.2:0/4165672090 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb41c19d2e0 con 0x7fb41c10c190 2024-09-19T06:15:40.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.487+0000 7fb420843640 1 --2- 172.21.15.2:0/4165672090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb41c10c190 0x7fb41c19cc00 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb41400eaa0 tx=0x7fb41400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:40.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.487+0000 7fb4197fa640 1 -- 172.21.15.2:0/4165672090 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41400cdb0 con 0x7fb41c10c190 2024-09-19T06:15:40.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.487+0000 7fb4222a6640 1 -- 172.21.15.2:0/4165672090 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb41c19d5d0 con 0x7fb41c10c190 2024-09-19T06:15:40.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.487+0000 7fb4197fa640 1 -- 172.21.15.2:0/4165672090 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb414005020 con 0x7fb41c10c190 2024-09-19T06:15:40.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.487+0000 7fb4197fa640 1 -- 172.21.15.2:0/4165672090 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4140116d0 con 0x7fb41c10c190 2024-09-19T06:15:40.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.487+0000 7fb4222a6640 1 -- 172.21.15.2:0/4165672090 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb41c1a4eb0 con 0x7fb41c10c190 2024-09-19T06:15:40.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.490+0000 7fb4197fa640 1 -- 172.21.15.2:0/4165672090 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 24) ==== 138638+0+0 (secure 0 0 0) 0x7fb4140051d0 con 0x7fb41c10c190 2024-09-19T06:15:40.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.491+0000 7fb42467f740 1 Processor -- start 2024-09-19T06:15:40.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.491+0000 7fb4197fa640 1 --2- 172.21.15.2:0/4165672090 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb4040a35e0 0x7fb4040a5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:40.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.491+0000 7fb42467f740 1 -- start start 2024-09-19T06:15:40.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.491+0000 7fb4197fa640 1 -- 172.21.15.2:0/4165672090 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fb4140cffb0 con 0x7fb41c10c190 2024-09-19T06:15:40.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.491+0000 7fb41b7fe640 1 --2- 172.21.15.2:0/4165672090 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb4040a35e0 0x7fb4040a5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:40.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.492+0000 7fb42467f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc0558a80 0x563fc0558e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:40.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.492+0000 7fb42467f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563fc05593a0 0x563fc0567c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:40.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.492+0000 7fb42467f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fc0568150 0x563fc056a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:40.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.492+0000 7fb42467f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563fc04be280 con 0x563fc0568150 2024-09-19T06:15:40.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.492+0000 7fb42467f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563fc0465b10 con 0x563fc0558a80 2024-09-19T06:15:40.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.492+0000 7fb42467f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x563fc04ba240 con 0x563fc05593a0 2024-09-19T06:15:40.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.492+0000 7fb41b7fe640 1 --2- 172.21.15.2:0/4165672090 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb4040a35e0 0x7fb4040a5aa0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb41c0fee40 tx=0x7fb41000b390 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:40.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.492+0000 7fb420843640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fc0568150 0x563fc056a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:40.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.492+0000 7fb420843640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fc0568150 0x563fc056a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39964/0 (socket says 172.21.15.2:39964) 2024-09-19T06:15:40.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.492+0000 7fb420843640 1 -- 172.21.15.2:0/1548476120 learned_addr learned my addr 172.21.15.2:0/1548476120 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:40.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.492+0000 7fb41bfff640 1 --2- 172.21.15.2:0/1548476120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc0558a80 0x563fc0558e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:40.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.492+0000 7fb41b7fe640 1 --2- 172.21.15.2:0/1548476120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563fc05593a0 0x563fc0567c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:40.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.492+0000 7fb420843640 1 -- 172.21.15.2:0/1548476120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563fc05593a0 msgr2=0x563fc0567c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:40.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.492+0000 7fb420843640 1 --2- 172.21.15.2:0/1548476120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563fc05593a0 0x563fc0567c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:40.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.492+0000 7fb420843640 1 -- 172.21.15.2:0/1548476120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc0558a80 msgr2=0x563fc0558e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:40.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.492+0000 7fb420843640 1 --2- 172.21.15.2:0/1548476120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc0558a80 0x563fc0558e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:40.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.492+0000 7fb420843640 1 -- 172.21.15.2:0/1548476120 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fc04721f0 con 0x563fc0568150 2024-09-19T06:15:40.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.492+0000 7fb41bfff640 1 --2- 172.21.15.2:0/1548476120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc0558a80 0x563fc0558e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:15:40.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.493+0000 7fb420843640 1 --2- 172.21.15.2:0/1548476120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fc0568150 0x563fc056a540 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb41409c0c0 tx=0x7fb41409bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83137640d9258223 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:40.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.493+0000 7fb4027fc640 1 -- 172.21.15.2:0/1548476120 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41401f030 con 0x563fc0568150 2024-09-19T06:15:40.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.493+0000 7fb4027fc640 1 -- 172.21.15.2:0/1548476120 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb4140bc070 con 0x563fc0568150 2024-09-19T06:15:40.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.493+0000 7fb4027fc640 1 -- 172.21.15.2:0/1548476120 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb414098940 con 0x563fc0568150 2024-09-19T06:15:40.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.494+0000 7fb42467f740 1 -- 172.21.15.2:0/1548476120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fc0568150 msgr2=0x563fc056a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:40.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.494+0000 7fb42467f740 1 --2- 172.21.15.2:0/1548476120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fc0568150 0x563fc056a540 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb41409c0c0 tx=0x7fb41409bd80 comp rx=0 tx=0).stop 2024-09-19T06:15:40.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.494+0000 7fb42467f740 1 -- 172.21.15.2:0/1548476120 shutdown_connections 2024-09-19T06:15:40.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.494+0000 7fb42467f740 1 --2- 172.21.15.2:0/1548476120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fc0568150 0x563fc056a540 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:40.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.494+0000 7fb42467f740 1 --2- 172.21.15.2:0/1548476120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563fc05593a0 0x563fc0567c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:40.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.494+0000 7fb42467f740 1 --2- 172.21.15.2:0/1548476120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc0558a80 0x563fc0558e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:40.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.494+0000 7fb42467f740 1 -- 172.21.15.2:0/1548476120 >> 172.21.15.2:0/1548476120 conn(0x563fc05550f0 msgr2=0x563fc05554d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:40.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.494+0000 7fb42467f740 1 -- 172.21.15.2:0/1548476120 shutdown_connections 2024-09-19T06:15:40.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.494+0000 7fb42467f740 1 -- 172.21.15.2:0/1548476120 wait complete. 2024-09-19T06:15:40.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.494+0000 7fb42467f740 1 -- start start 2024-09-19T06:15:40.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.495+0000 7fb42467f740 1 Processor -- start 2024-09-19T06:15:40.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.495+0000 7fb42467f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc0558a80 0x563fc0567a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:40.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.495+0000 7fb42467f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fc05593a0 0x563fc0560d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:40.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.495+0000 7fb42467f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563fc0568150 0x563fc05612a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:40.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.495+0000 7fb41b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fc05593a0 0x563fc0560d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:40.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.495+0000 7fb41b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fc05593a0 0x563fc0560d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39974/0 (socket says 172.21.15.2:39974) 2024-09-19T06:15:40.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.495+0000 7fb42467f740 1 -- 172.21.15.2:0/2641050774 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563fc056ac60 con 0x563fc05593a0 2024-09-19T06:15:40.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.495+0000 7fb41b7fe640 1 -- 172.21.15.2:0/2641050774 learned_addr learned my addr 172.21.15.2:0/2641050774 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:40.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.495+0000 7fb42467f740 1 -- 172.21.15.2:0/2641050774 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563fc0478f10 con 0x563fc0558a80 2024-09-19T06:15:40.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.495+0000 7fb42467f740 1 -- 172.21.15.2:0/2641050774 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x563fc056ade0 con 0x563fc0568150 2024-09-19T06:15:40.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.495+0000 7fb42467f740 10 client.0 _ll_register_callbacks cb 0x563fc0441a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:40.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.496+0000 7fb41bfff640 1 --2- 172.21.15.2:0/2641050774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc0558a80 0x563fc0567a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:40.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.496+0000 7fb420843640 1 --2- 172.21.15.2:0/2641050774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563fc0568150 0x563fc05612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:40.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.496+0000 7fb41b7fe640 1 -- 172.21.15.2:0/2641050774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563fc0568150 msgr2=0x563fc05612a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:40.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.496+0000 7fb41b7fe640 1 --2- 172.21.15.2:0/2641050774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563fc0568150 0x563fc05612a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:40.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.496+0000 7fb41b7fe640 1 -- 172.21.15.2:0/2641050774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc0558a80 msgr2=0x563fc0567a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:40.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.496+0000 7fb41b7fe640 1 --2- 172.21.15.2:0/2641050774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc0558a80 0x563fc0567a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:40.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.496+0000 7fb41b7fe640 1 -- 172.21.15.2:0/2641050774 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fc022f6a0 con 0x563fc05593a0 2024-09-19T06:15:40.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.496+0000 7fb420843640 1 --2- 172.21.15.2:0/2641050774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563fc0568150 0x563fc05612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:15:40.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.496+0000 7fb41b7fe640 1 --2- 172.21.15.2:0/2641050774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fc05593a0 0x563fc0560d60 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb410011710 tx=0x7fb410004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b36e80db69e45731 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:40.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.496+0000 7fb3fb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:15:40.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.496+0000 7fb3fb7fe640 1 -- 172.21.15.2:0/2641050774 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41001e800 con 0x563fc05593a0 2024-09-19T06:15:40.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.497+0000 7fb3fb7fe640 1 -- 172.21.15.2:0/2641050774 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fb41001e9a0 con 0x563fc05593a0 2024-09-19T06:15:40.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.497+0000 7fb42467f740 1 -- 172.21.15.2:0/2641050774 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb4140bc070 con 0x563fc05593a0 2024-09-19T06:15:40.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.497+0000 7fb3fb7fe640 1 -- 172.21.15.2:0/2641050774 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb41001eba0 con 0x563fc05593a0 2024-09-19T06:15:40.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.497+0000 7fb42467f740 10 client.15492 fetch_fsmap learned FSMap version 26 2024-09-19T06:15:40.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.497+0000 7fb42467f740 1 -- 172.21.15.2:0/2641050774 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563fc0566390 con 0x563fc05593a0 2024-09-19T06:15:40.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.497+0000 7fb3fb7fe640 1 -- 172.21.15.2:0/2641050774 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb41001ed40 con 0x563fc05593a0 2024-09-19T06:15:40.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.497+0000 7fb3fb7fe640 1 -- 172.21.15.2:0/2641050774 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fb410030460 con 0x563fc05593a0 2024-09-19T06:15:40.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.497+0000 7fb42467f740 10 client.15492 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:15:40.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.497+0000 7fb42467f740 10 client.15492 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:15:40.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.497+0000 7fb42467f740 20 client.15492 populate_metadata read hostname 'smithi002' 2024-09-19T06:15:40.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.497+0000 7fb42467f740 1 --2- 172.21.15.2:0/2641050774 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563fc05728a0 0x563fc0572cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:40.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.498+0000 7fb42467f740 4 client.15492 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:15:40.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.498+0000 7fb42467f740 1 -- 172.21.15.2:0/2641050774 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fb4140bc070 con 0x563fc05728a0 2024-09-19T06:15:40.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.498+0000 7fb41bfff640 1 --2- 172.21.15.2:0/2641050774 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563fc05728a0 0x563fc0572cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:40.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.498+0000 7fb3fb7fe640 10 client.15492 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:15:40.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.498+0000 7fb41bfff640 1 --2- 172.21.15.2:0/2641050774 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563fc05728a0 0x563fc0572cf0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b5b7c8d7930302e server_cookie=924f52b8e244f619 in_seq=0 out_seq=0 2024-09-19T06:15:40.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.499+0000 7fb3fb7fe640 1 -- 172.21.15.2:0/2641050774 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fb4140bc070 con 0x563fc05728a0 2024-09-19T06:15:40.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.499+0000 7fb3fb7fe640 10 client.15492 handle_command_reply: tid=0 2024-09-19T06:15:40.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.499+0000 7fb42467f740 1 client.15492 shutdown 2024-09-19T06:15:40.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.499+0000 7fb42467f740 1 -- 172.21.15.2:0/2641050774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fc05593a0 msgr2=0x563fc0560d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:40.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.499+0000 7fb42467f740 1 --2- 172.21.15.2:0/2641050774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fc05593a0 0x563fc0560d60 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb410011710 tx=0x7fb410004730 comp rx=0 tx=0).stop 2024-09-19T06:15:40.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.499+0000 7fb42467f740 1 -- 172.21.15.2:0/2641050774 shutdown_connections 2024-09-19T06:15:40.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.499+0000 7fb42467f740 1 --2- 172.21.15.2:0/2641050774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563fc0568150 0x563fc05612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:40.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.499+0000 7fb42467f740 1 --2- 172.21.15.2:0/2641050774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fc05593a0 0x563fc0560d60 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:40.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.499+0000 7fb42467f740 1 --2- 172.21.15.2:0/2641050774 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563fc05728a0 0x563fc0572cf0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:40.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.499+0000 7fb42467f740 1 --2- 172.21.15.2:0/2641050774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc0558a80 0x563fc0567a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:40.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.499+0000 7fb42467f740 1 -- 172.21.15.2:0/2641050774 >> 172.21.15.2:0/2641050774 conn(0x563fc05550f0 msgr2=0x563fc055ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:40.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.499+0000 7fb3fb7fe640 0 client.15492 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:15:40.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.499+0000 7fb42467f740 1 -- 172.21.15.2:0/2641050774 shutdown_connections 2024-09-19T06:15:40.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.499+0000 7fb42467f740 1 -- 172.21.15.2:0/2641050774 wait complete. 2024-09-19T06:15:40.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.500+0000 7fb42467f740 20 client.15492 trim_cache size 0 max 16384 2024-09-19T06:15:40.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.517+0000 7fb42467f740 1 Processor -- start 2024-09-19T06:15:40.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.517+0000 7fb42467f740 1 -- start start 2024-09-19T06:15:40.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.517+0000 7fb42467f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563fc0558a80 0x563fc055ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:40.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.517+0000 7fb42467f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fc05593a0 0x563fc058ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:40.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.517+0000 7fb42467f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc0568150 0x563fc058cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:40.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.517+0000 7fb42467f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb41c1adf10 con 0x563fc05593a0 2024-09-19T06:15:40.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.517+0000 7fb42467f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb41c1ab7e0 con 0x563fc0568150 2024-09-19T06:15:40.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.517+0000 7fb42467f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb41c1a9630 con 0x563fc0558a80 2024-09-19T06:15:40.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.517+0000 7fb41b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fc05593a0 0x563fc058ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:40.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.517+0000 7fb41b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fc05593a0 0x563fc058ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39986/0 (socket says 172.21.15.2:39986) 2024-09-19T06:15:40.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.517+0000 7fb41b7fe640 1 -- 172.21.15.2:0/4293443865 learned_addr learned my addr 172.21.15.2:0/4293443865 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:40.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.517+0000 7fb41bfff640 1 --2- 172.21.15.2:0/4293443865 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563fc0558a80 0x563fc055ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:40.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.518+0000 7fb420843640 1 --2- 172.21.15.2:0/4293443865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc0568150 0x563fc058cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:40.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.518+0000 7fb41b7fe640 1 -- 172.21.15.2:0/4293443865 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563fc0558a80 msgr2=0x563fc055ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:40.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.518+0000 7fb41b7fe640 1 --2- 172.21.15.2:0/4293443865 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563fc0558a80 0x563fc055ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:40.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.518+0000 7fb41b7fe640 1 -- 172.21.15.2:0/4293443865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc0568150 msgr2=0x563fc058cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:40.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.518+0000 7fb41b7fe640 1 --2- 172.21.15.2:0/4293443865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc0568150 0x563fc058cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:40.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.518+0000 7fb41b7fe640 1 -- 172.21.15.2:0/4293443865 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fc055fd10 con 0x563fc05593a0 2024-09-19T06:15:40.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.518+0000 7fb420843640 1 --2- 172.21.15.2:0/4293443865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc0568150 0x563fc058cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:15:40.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.518+0000 7fb41b7fe640 1 --2- 172.21.15.2:0/4293443865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fc05593a0 0x563fc058ca90 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb410030ac0 tx=0x7fb41001ef80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8da4e8a254b8c34f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:40.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.518+0000 7fb401ffb640 1 -- 172.21.15.2:0/4293443865 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41003e070 con 0x563fc05593a0 2024-09-19T06:15:40.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.518+0000 7fb401ffb640 1 -- 172.21.15.2:0/4293443865 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb41001e600 con 0x563fc05593a0 2024-09-19T06:15:40.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.518+0000 7fb401ffb640 1 -- 172.21.15.2:0/4293443865 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb410035040 con 0x563fc05593a0 2024-09-19T06:15:40.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.519+0000 7fb42467f740 1 -- 172.21.15.2:0/4293443865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fc05593a0 msgr2=0x563fc058ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:40.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.519+0000 7fb42467f740 1 --2- 172.21.15.2:0/4293443865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fc05593a0 0x563fc058ca90 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb410030ac0 tx=0x7fb41001ef80 comp rx=0 tx=0).stop 2024-09-19T06:15:40.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.519+0000 7fb42467f740 1 -- 172.21.15.2:0/4293443865 shutdown_connections 2024-09-19T06:15:40.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.519+0000 7fb42467f740 1 --2- 172.21.15.2:0/4293443865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc0568150 0x563fc058cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:40.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.519+0000 7fb42467f740 1 --2- 172.21.15.2:0/4293443865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fc05593a0 0x563fc058ca90 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:40.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.519+0000 7fb42467f740 1 --2- 172.21.15.2:0/4293443865 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563fc0558a80 0x563fc055ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:40.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.519+0000 7fb42467f740 1 -- 172.21.15.2:0/4293443865 >> 172.21.15.2:0/4293443865 conn(0x563fc05550f0 msgr2=0x563fc055a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:40.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.519+0000 7fb42467f740 1 -- 172.21.15.2:0/4293443865 shutdown_connections 2024-09-19T06:15:40.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.519+0000 7fb42467f740 1 -- 172.21.15.2:0/4293443865 wait complete. 2024-09-19T06:15:40.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.519+0000 7fb42467f740 1 -- start start 2024-09-19T06:15:40.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.520+0000 7fb42467f740 1 Processor -- start 2024-09-19T06:15:40.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.520+0000 7fb42467f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563fc0558a80 0x563fc056c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:40.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.520+0000 7fb42467f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc05593a0 0x563fc056ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:40.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.520+0000 7fb42467f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fc0568150 0x563fc05e8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:40.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.520+0000 7fb42467f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb41c1a9ca0 con 0x563fc0568150 2024-09-19T06:15:40.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.520+0000 7fb42467f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb41c1ab110 con 0x563fc05593a0 2024-09-19T06:15:40.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.520+0000 7fb42467f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb41c1aa370 con 0x563fc0558a80 2024-09-19T06:15:40.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.520+0000 7fb42467f740 10 client.0 _ll_register_callbacks cb 0x7fb410010c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:40.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.520+0000 7fb420843640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fc0568150 0x563fc05e8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:40.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.520+0000 7fb420843640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fc0568150 0x563fc05e8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39988/0 (socket says 172.21.15.2:39988) 2024-09-19T06:15:40.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.520+0000 7fb420843640 1 -- 172.21.15.2:0/3544156522 learned_addr learned my addr 172.21.15.2:0/3544156522 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:40.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.520+0000 7fb41bfff640 1 --2- 172.21.15.2:0/3544156522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563fc0558a80 0x563fc056c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:40.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.520+0000 7fb41b7fe640 1 --2- 172.21.15.2:0/3544156522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc05593a0 0x563fc056ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:40.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.521+0000 7fb420843640 1 -- 172.21.15.2:0/3544156522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563fc0558a80 msgr2=0x563fc056c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:40.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.521+0000 7fb420843640 1 --2- 172.21.15.2:0/3544156522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563fc0558a80 0x563fc056c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:40.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.521+0000 7fb420843640 1 -- 172.21.15.2:0/3544156522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc05593a0 msgr2=0x563fc056ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:40.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.521+0000 7fb420843640 1 --2- 172.21.15.2:0/3544156522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc05593a0 0x563fc056ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:40.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.521+0000 7fb420843640 1 -- 172.21.15.2:0/3544156522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fc05e9140 con 0x563fc0568150 2024-09-19T06:15:40.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.521+0000 7fb420843640 1 --2- 172.21.15.2:0/3544156522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fc0568150 0x563fc05e8aa0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb41400cfd0 tx=0x7fb41409c030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=784759f7c7abad4f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:40.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.521+0000 7fb3fb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:15:40.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.521+0000 7fb3fb7fe640 1 -- 172.21.15.2:0/3544156522 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41401f040 con 0x563fc0568150 2024-09-19T06:15:40.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.521+0000 7fb3fb7fe640 1 -- 172.21.15.2:0/3544156522 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fb41409b780 con 0x563fc0568150 2024-09-19T06:15:40.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.521+0000 7fb42467f740 1 -- 172.21.15.2:0/3544156522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb41001e600 con 0x563fc0568150 2024-09-19T06:15:40.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.521+0000 7fb41b7fe640 1 --2- 172.21.15.2:0/3544156522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc05593a0 0x563fc056ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:15:40.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.522+0000 7fb3fb7fe640 1 -- 172.21.15.2:0/3544156522 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb414082050 con 0x563fc0568150 2024-09-19T06:15:40.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.522+0000 7fb42467f740 10 client.15498 fetch_fsmap learned FSMap version 26 2024-09-19T06:15:40.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.522+0000 7fb42467f740 1 -- 172.21.15.2:0/3544156522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563fc05f0510 con 0x563fc0568150 2024-09-19T06:15:40.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.522+0000 7fb3fb7fe640 1 -- 172.21.15.2:0/3544156522 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb41001e600 con 0x563fc0568150 2024-09-19T06:15:40.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.522+0000 7fb3fb7fe640 1 -- 172.21.15.2:0/3544156522 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fb41400f040 con 0x563fc0568150 2024-09-19T06:15:40.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.522+0000 7fb42467f740 10 client.15498 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:15:40.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.522+0000 7fb42467f740 10 client.15498 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:15:40.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.522+0000 7fb42467f740 20 client.15498 populate_metadata read hostname 'smithi002' 2024-09-19T06:15:40.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.522+0000 7fb42467f740 1 --2- 172.21.15.2:0/3544156522 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563fc05f07a0 0x563fc05f2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:40.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.522+0000 7fb42467f740 4 client.15498 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:15:40.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.522+0000 7fb42467f740 1 -- 172.21.15.2:0/3544156522 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563fc04cb7f0 con 0x563fc05f07a0 2024-09-19T06:15:40.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.523+0000 7fb41bfff640 1 --2- 172.21.15.2:0/3544156522 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563fc05f07a0 0x563fc05f2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:40.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.523+0000 7fb41bfff640 1 --2- 172.21.15.2:0/3544156522 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563fc05f07a0 0x563fc05f2b90 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab9bb43b483f0745 server_cookie=f6743b45b7f1c32c in_seq=0 out_seq=0 2024-09-19T06:15:40.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.523+0000 7fb3fb7fe640 10 client.15498 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:15:40.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.524+0000 7fb3fb7fe640 1 -- 172.21.15.2:0/3544156522 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563fc04cb7f0 con 0x563fc05f07a0 2024-09-19T06:15:40.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.524+0000 7fb3fb7fe640 10 client.15498 handle_command_reply: tid=0 2024-09-19T06:15:40.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.524+0000 7fb42467f740 1 client.15498 shutdown 2024-09-19T06:15:40.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.524+0000 7fb42467f740 1 -- 172.21.15.2:0/3544156522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fc0568150 msgr2=0x563fc05e8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:40.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.524+0000 7fb42467f740 1 --2- 172.21.15.2:0/3544156522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fc0568150 0x563fc05e8aa0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb41400cfd0 tx=0x7fb41409c030 comp rx=0 tx=0).stop 2024-09-19T06:15:40.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.524+0000 7fb42467f740 1 -- 172.21.15.2:0/3544156522 shutdown_connections 2024-09-19T06:15:40.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.524+0000 7fb42467f740 1 --2- 172.21.15.2:0/3544156522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563fc0568150 0x563fc05e8aa0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:40.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.524+0000 7fb42467f740 1 --2- 172.21.15.2:0/3544156522 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563fc05f07a0 0x563fc05f2b90 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:40.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.524+0000 7fb42467f740 1 --2- 172.21.15.2:0/3544156522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc05593a0 0x563fc056ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:40.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.524+0000 7fb42467f740 1 --2- 172.21.15.2:0/3544156522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563fc0558a80 0x563fc056c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:40.532 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:15:40.532 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T06:15:40.532 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "b840d08c-de8c-4637-9d69-d64b18f9ebc5", 2024-09-19T06:15:40.532 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T06:15:40.532 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:15:40.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.524+0000 7fb42467f740 1 -- 172.21.15.2:0/3544156522 >> 172.21.15.2:0/3544156522 conn(0x563fc05550f0 msgr2=0x563fc0554270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:40.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.524+0000 7fb3fb7fe640 0 client.15498 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:15:40.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.525+0000 7fb42467f740 1 -- 172.21.15.2:0/3544156522 shutdown_connections 2024-09-19T06:15:40.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.525+0000 7fb42467f740 1 -- 172.21.15.2:0/3544156522 wait complete. 2024-09-19T06:15:40.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.525+0000 7fb42467f740 20 client.15498 trim_cache size 0 max 16384 2024-09-19T06:15:40.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.525+0000 7fb4222a6640 1 -- 172.21.15.2:0/4165672090 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb4040a35e0 msgr2=0x7fb4040a5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:40.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.525+0000 7fb4222a6640 1 --2- 172.21.15.2:0/4165672090 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb4040a35e0 0x7fb4040a5aa0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb41c0fee40 tx=0x7fb41000b390 comp rx=0 tx=0).stop 2024-09-19T06:15:40.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.525+0000 7fb4222a6640 1 -- 172.21.15.2:0/4165672090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb41c10c190 msgr2=0x7fb41c19cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:40.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.525+0000 7fb4222a6640 1 --2- 172.21.15.2:0/4165672090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb41c10c190 0x7fb41c19cc00 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb41400eaa0 tx=0x7fb41400ef60 comp rx=0 tx=0).stop 2024-09-19T06:15:40.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.526+0000 7fb4222a6640 1 -- 172.21.15.2:0/4165672090 shutdown_connections 2024-09-19T06:15:40.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.526+0000 7fb4222a6640 1 --2- 172.21.15.2:0/4165672090 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb4040a35e0 0x7fb4040a5aa0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:40.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.526+0000 7fb4222a6640 1 --2- 172.21.15.2:0/4165672090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb41c10c190 0x7fb41c19cc00 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:40.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.526+0000 7fb4222a6640 1 --2- 172.21.15.2:0/4165672090 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb41c1036d0 0x7fb41c198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:40.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.526+0000 7fb4222a6640 1 --2- 172.21.15.2:0/4165672090 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb41c102db0 0x7fb41c198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:40.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.526+0000 7fb4222a6640 1 -- 172.21.15.2:0/4165672090 >> 172.21.15.2:0/4165672090 conn(0x7fb41c0fc7d0 msgr2=0x7fb41c0fe070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:40.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.526+0000 7fb4222a6640 1 -- 172.21.15.2:0/4165672090 shutdown_connections 2024-09-19T06:15:40.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:40.526+0000 7fb4222a6640 1 -- 172.21.15.2:0/4165672090 wait complete. 2024-09-19T06:15:41.210 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:15:41.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:41 smithi002 ceph-mon[30982]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-19T06:15:41.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:41 smithi002 ceph-mon[30982]: scrub queued for path: / 2024-09-19T06:15:41.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:41 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:15:41.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:41 smithi002 ceph-mon[30982]: scrub summary: active paths [/] 2024-09-19T06:15:41.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:41 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:15:41.489 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:41 smithi090 ceph-mon[34497]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-19T06:15:41.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:41 smithi090 ceph-mon[34497]: scrub queued for path: / 2024-09-19T06:15:41.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:41 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:15:41.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:41 smithi090 ceph-mon[34497]: scrub summary: active paths [/] 2024-09-19T06:15:41.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:41 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:15:41.497 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:15:41.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:41 smithi089 ceph-mon[34160]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-19T06:15:41.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:41 smithi089 ceph-mon[34160]: scrub queued for path: / 2024-09-19T06:15:41.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:41 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:15:41.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:41 smithi089 ceph-mon[34160]: scrub summary: active paths [/] 2024-09-19T06:15:41.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:41 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:15:42.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.129+0000 7fa8452e2640 1 -- 172.21.15.2:0/3878852069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa840106b80 msgr2=0x7fa840106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:42.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.129+0000 7fa8452e2640 1 --2- 172.21.15.2:0/3878852069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa840106b80 0x7fa840106f60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa830009900 tx=0x7fa83002a3f0 comp rx=0 tx=0).stop 2024-09-19T06:15:42.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.129+0000 7fa8452e2640 1 -- 172.21.15.2:0/3878852069 shutdown_connections 2024-09-19T06:15:42.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.129+0000 7fa8452e2640 1 --2- 172.21.15.2:0/3878852069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa840100aa0 0x7fa84010ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:42.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.129+0000 7fa8452e2640 1 --2- 172.21.15.2:0/3878852069 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa840100100 0x7fa840100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:42.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.129+0000 7fa8452e2640 1 --2- 172.21.15.2:0/3878852069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa840106b80 0x7fa840106f60 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:42.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.129+0000 7fa8452e2640 1 -- 172.21.15.2:0/3878852069 >> 172.21.15.2:0/3878852069 conn(0x7fa840077230 msgr2=0x7fa8400fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:42.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.129+0000 7fa8452e2640 1 -- 172.21.15.2:0/3878852069 shutdown_connections 2024-09-19T06:15:42.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.129+0000 7fa8452e2640 1 -- 172.21.15.2:0/3878852069 wait complete. 2024-09-19T06:15:42.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.130+0000 7fa8452e2640 1 Processor -- start 2024-09-19T06:15:42.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.130+0000 7fa8452e2640 1 -- start start 2024-09-19T06:15:42.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.131+0000 7fa8452e2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa840100100 0x7fa840198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:42.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.131+0000 7fa8452e2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa840100aa0 0x7fa840198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:42.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.131+0000 7fa83e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa840100aa0 0x7fa840198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:42.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.131+0000 7fa83e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa840100aa0 0x7fa840198850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40006/0 (socket says 172.21.15.2:40006) 2024-09-19T06:15:42.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.131+0000 7fa83e7fc640 1 -- 172.21.15.2:0/582327081 learned_addr learned my addr 172.21.15.2:0/582327081 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:42.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.131+0000 7fa8452e2640 1 --2- 172.21.15.2:0/582327081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa840106b80 0x7fa84019cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:42.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.131+0000 7fa8452e2640 1 -- 172.21.15.2:0/582327081 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa840111f50 con 0x7fa840100aa0 2024-09-19T06:15:42.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.131+0000 7fa8452e2640 1 -- 172.21.15.2:0/582327081 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa840111dd0 con 0x7fa840106b80 2024-09-19T06:15:42.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.131+0000 7fa83effd640 1 --2- 172.21.15.2:0/582327081 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa840100100 0x7fa840198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:42.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.131+0000 7fa8452e2640 1 -- 172.21.15.2:0/582327081 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa8401120d0 con 0x7fa840100100 2024-09-19T06:15:42.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.131+0000 7fa83f7fe640 1 --2- 172.21.15.2:0/582327081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa840106b80 0x7fa84019cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:42.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.132+0000 7fa83effd640 1 -- 172.21.15.2:0/582327081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa840106b80 msgr2=0x7fa84019cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:42.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.132+0000 7fa83effd640 1 --2- 172.21.15.2:0/582327081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa840106b80 0x7fa84019cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:42.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.132+0000 7fa83effd640 1 -- 172.21.15.2:0/582327081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa840100aa0 msgr2=0x7fa840198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:42.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.132+0000 7fa83effd640 1 --2- 172.21.15.2:0/582327081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa840100aa0 0x7fa840198850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:42.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.132+0000 7fa83effd640 1 -- 172.21.15.2:0/582327081 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa84019d2c0 con 0x7fa840100100 2024-09-19T06:15:42.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.132+0000 7fa83f7fe640 1 --2- 172.21.15.2:0/582327081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa840106b80 0x7fa84019cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:15:42.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.132+0000 7fa83e7fc640 1 --2- 172.21.15.2:0/582327081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa840100aa0 0x7fa840198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:42.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.132+0000 7fa83effd640 1 --2- 172.21.15.2:0/582327081 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa840100100 0x7fa840198310 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa83002a9e0 tx=0x7fa830003d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:42.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.132+0000 7fa827fff640 1 -- 172.21.15.2:0/582327081 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa83003f070 con 0x7fa840100100 2024-09-19T06:15:42.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.132+0000 7fa8452e2640 1 -- 172.21.15.2:0/582327081 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa84019d550 con 0x7fa840100100 2024-09-19T06:15:42.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.132+0000 7fa8452e2640 1 -- 172.21.15.2:0/582327081 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8401a4e90 con 0x7fa840100100 2024-09-19T06:15:42.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.133+0000 7fa827fff640 1 -- 172.21.15.2:0/582327081 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa830031d60 con 0x7fa840100100 2024-09-19T06:15:42.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.133+0000 7fa827fff640 1 -- 172.21.15.2:0/582327081 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa830035030 con 0x7fa840100100 2024-09-19T06:15:42.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.136+0000 7fa827fff640 1 -- 172.21.15.2:0/582327081 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 24) ==== 138638+0+0 (secure 0 0 0) 0x7fa830042070 con 0x7fa840100100 2024-09-19T06:15:42.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.136+0000 7fa8476bb740 1 Processor -- start 2024-09-19T06:15:42.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.136+0000 7fa8476bb740 1 -- start start 2024-09-19T06:15:42.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.136+0000 7fa8476bb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652709864a0 0x565270986880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:42.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.136+0000 7fa8476bb740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565270986dc0 0x565270991140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:42.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.136+0000 7fa8476bb740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565270991680 0x565270993a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:42.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.136+0000 7fa8476bb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5652708ec2e0 con 0x5652709864a0 2024-09-19T06:15:42.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.136+0000 7fa8476bb740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x565270893ce0 con 0x565270991680 2024-09-19T06:15:42.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.136+0000 7fa8476bb740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5652708e82a0 con 0x565270986dc0 2024-09-19T06:15:42.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.137+0000 7fa83f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652709864a0 0x565270986880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:42.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.137+0000 7fa83e7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565270991680 0x565270993a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:42.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.137+0000 7fa83f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652709864a0 0x565270986880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40014/0 (socket says 172.21.15.2:40014) 2024-09-19T06:15:42.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.137+0000 7fa83f7fe640 1 -- 172.21.15.2:0/2769001759 learned_addr learned my addr 172.21.15.2:0/2769001759 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:42.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.137+0000 7fa83effd640 1 --2- 172.21.15.2:0/2769001759 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565270986dc0 0x565270991140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:42.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.137+0000 7fa827fff640 1 --2- 172.21.15.2:0/582327081 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa8280a79f0 0x7fa8280a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:42.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.137+0000 7fa83f7fe640 1 -- 172.21.15.2:0/2769001759 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565270986dc0 msgr2=0x565270991140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:42.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.137+0000 7fa83f7fe640 1 --2- 172.21.15.2:0/2769001759 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565270986dc0 0x565270991140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:42.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.137+0000 7fa83f7fe640 1 -- 172.21.15.2:0/2769001759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565270991680 msgr2=0x565270993a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:42.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.137+0000 7fa83f7fe640 1 --2- 172.21.15.2:0/2769001759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565270991680 0x565270993a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:42.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.137+0000 7fa83f7fe640 1 -- 172.21.15.2:0/2769001759 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565270878440 con 0x5652709864a0 2024-09-19T06:15:42.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.138+0000 7fa827fff640 1 -- 172.21.15.2:0/582327081 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fa8300f0780 con 0x7fa840100100 2024-09-19T06:15:42.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.138+0000 7fa83f7fe640 1 --2- 172.21.15.2:0/2769001759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652709864a0 0x565270986880 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa838007ef0 tx=0x7fa83800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=997e5560043736bd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:42.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.138+0000 7fa83f7fe640 1 --2- 172.21.15.2:0/582327081 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa8280a79f0 0x7fa8280a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:42.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.138+0000 7fa8257fa640 1 -- 172.21.15.2:0/2769001759 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa838014070 con 0x5652709864a0 2024-09-19T06:15:42.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.138+0000 7fa8257fa640 1 -- 172.21.15.2:0/2769001759 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa838010af0 con 0x5652709864a0 2024-09-19T06:15:42.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.139+0000 7fa8257fa640 1 -- 172.21.15.2:0/2769001759 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa838019410 con 0x5652709864a0 2024-09-19T06:15:42.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.139+0000 7fa8476bb740 1 -- 172.21.15.2:0/2769001759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652709864a0 msgr2=0x565270986880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:42.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.139+0000 7fa83f7fe640 1 --2- 172.21.15.2:0/582327081 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa8280a79f0 0x7fa8280a9eb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa83800f010 tx=0x7fa838019a60 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:42.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.139+0000 7fa8476bb740 1 --2- 172.21.15.2:0/2769001759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652709864a0 0x565270986880 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa838007ef0 tx=0x7fa83800e720 comp rx=0 tx=0).stop 2024-09-19T06:15:42.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.139+0000 7fa8476bb740 1 -- 172.21.15.2:0/2769001759 shutdown_connections 2024-09-19T06:15:42.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.139+0000 7fa8476bb740 1 --2- 172.21.15.2:0/2769001759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565270991680 0x565270993a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:42.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.139+0000 7fa8476bb740 1 --2- 172.21.15.2:0/2769001759 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565270986dc0 0x565270991140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:42.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.139+0000 7fa8476bb740 1 --2- 172.21.15.2:0/2769001759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652709864a0 0x565270986880 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:42.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.139+0000 7fa8476bb740 1 -- 172.21.15.2:0/2769001759 >> 172.21.15.2:0/2769001759 conn(0x565270982a30 msgr2=0x565270982e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:42.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.139+0000 7fa8476bb740 1 -- 172.21.15.2:0/2769001759 shutdown_connections 2024-09-19T06:15:42.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.140+0000 7fa8476bb740 1 -- 172.21.15.2:0/2769001759 wait complete. 2024-09-19T06:15:42.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.140+0000 7fa8476bb740 1 -- start start 2024-09-19T06:15:42.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.140+0000 7fa8476bb740 1 Processor -- start 2024-09-19T06:15:42.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.141+0000 7fa8476bb740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652709864a0 0x565270990fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:42.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.141+0000 7fa8476bb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565270986dc0 0x56527098e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:42.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.141+0000 7fa8476bb740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565270991680 0x56527098e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:42.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.141+0000 7fa8476bb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5652709942a0 con 0x565270986dc0 2024-09-19T06:15:42.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.141+0000 7fa83effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652709864a0 0x565270990fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:42.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.142+0000 7fa83e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565270986dc0 0x56527098e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:42.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.142+0000 7fa83effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652709864a0 0x565270990fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:49810/0 (socket says 172.21.15.2:49810) 2024-09-19T06:15:42.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.142+0000 7fa83effd640 1 -- 172.21.15.2:0/1723348150 learned_addr learned my addr 172.21.15.2:0/1723348150 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:42.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.142+0000 7fa83f7fe640 1 --2- 172.21.15.2:0/1723348150 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565270991680 0x56527098e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:42.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.142+0000 7fa8476bb740 1 -- 172.21.15.2:0/1723348150 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5652708a7050 con 0x565270991680 2024-09-19T06:15:42.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.142+0000 7fa8476bb740 1 -- 172.21.15.2:0/1723348150 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x565270994420 con 0x5652709864a0 2024-09-19T06:15:42.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.142+0000 7fa83e7fc640 1 -- 172.21.15.2:0/1723348150 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652709864a0 msgr2=0x565270990fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:42.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.142+0000 7fa83e7fc640 1 --2- 172.21.15.2:0/1723348150 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652709864a0 0x565270990fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:42.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.142+0000 7fa83e7fc640 1 -- 172.21.15.2:0/1723348150 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565270991680 msgr2=0x56527098e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:42.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.142+0000 7fa83e7fc640 1 --2- 172.21.15.2:0/1723348150 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565270991680 0x56527098e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:42.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.142+0000 7fa83e7fc640 1 -- 172.21.15.2:0/1723348150 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56527065d3c0 con 0x565270986dc0 2024-09-19T06:15:42.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.142+0000 7fa83f7fe640 1 --2- 172.21.15.2:0/1723348150 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565270991680 0x56527098e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:42.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.143+0000 7fa83e7fc640 1 --2- 172.21.15.2:0/1723348150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565270986dc0 0x56527098e270 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fa8400ff780 tx=0x7fa83400f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c83ad07af9b2926e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:42.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.143+0000 7fa8476bb740 10 client.0 _ll_register_callbacks cb 0x5652708e7160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:42.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.143+0000 7fa8476bb740 1 -- 172.21.15.2:0/1723348150 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa838010af0 con 0x565270986dc0 2024-09-19T06:15:42.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.143+0000 7fa822ff5640 10 client.15510 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:15:42.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.143+0000 7fa822ff5640 1 -- 172.21.15.2:0/1723348150 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa83401bad0 con 0x565270986dc0 2024-09-19T06:15:42.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.143+0000 7fa822ff5640 1 -- 172.21.15.2:0/1723348150 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fa83401bc70 con 0x565270986dc0 2024-09-19T06:15:42.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.143+0000 7fa822ff5640 1 -- 172.21.15.2:0/1723348150 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa834005020 con 0x565270986dc0 2024-09-19T06:15:42.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.143+0000 7fa8476bb740 10 client.15510 fetch_fsmap learned FSMap version 26 2024-09-19T06:15:42.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.143+0000 7fa8476bb740 1 -- 172.21.15.2:0/1723348150 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({fsmap=26}) -- 0x56527099fc00 con 0x565270986dc0 2024-09-19T06:15:42.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.144+0000 7fa822ff5640 1 -- 172.21.15.2:0/1723348150 <== mon.0 v2:172.21.15.2:3300/0 4 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fa8340051c0 con 0x565270986dc0 2024-09-19T06:15:42.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.144+0000 7fa8476bb740 10 client.15510 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:15:42.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.144+0000 7fa8476bb740 10 client.15510 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:15:42.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.144+0000 7fa8476bb740 20 client.15510 populate_metadata read hostname 'smithi002' 2024-09-19T06:15:42.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.144+0000 7fa8476bb740 1 --2- 172.21.15.2:0/1723348150 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5652709a0fb0 0x5652709a33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:42.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.144+0000 7fa8476bb740 4 client.15510 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:15:42.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.144+0000 7fa8476bb740 1 -- 172.21.15.2:0/1723348150 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5652708f9850 con 0x5652709a0fb0 2024-09-19T06:15:42.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.144+0000 7fa83effd640 1 --2- 172.21.15.2:0/1723348150 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5652709a0fb0 0x5652709a33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:42.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.145+0000 7fa83effd640 1 --2- 172.21.15.2:0/1723348150 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5652709a0fb0 0x5652709a33c0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a323511c3ab97a9f server_cookie=2d8e5072fe4ecc45 in_seq=0 out_seq=0 2024-09-19T06:15:42.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.145+0000 7fa822ff5640 10 client.15510 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:15:42.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.145+0000 7fa822ff5640 1 -- 172.21.15.2:0/1723348150 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5652708f9850 con 0x5652709a0fb0 2024-09-19T06:15:42.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.145+0000 7fa822ff5640 10 client.15510 handle_command_reply: tid=0 2024-09-19T06:15:42.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.146+0000 7fa8476bb740 1 client.15510 shutdown 2024-09-19T06:15:42.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.146+0000 7fa8476bb740 1 -- 172.21.15.2:0/1723348150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565270986dc0 msgr2=0x56527098e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:42.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.146+0000 7fa8476bb740 1 --2- 172.21.15.2:0/1723348150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565270986dc0 0x56527098e270 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fa8400ff780 tx=0x7fa83400f7f0 comp rx=0 tx=0).stop 2024-09-19T06:15:42.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.146+0000 7fa8476bb740 1 -- 172.21.15.2:0/1723348150 shutdown_connections 2024-09-19T06:15:42.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.146+0000 7fa8476bb740 1 --2- 172.21.15.2:0/1723348150 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5652709a0fb0 0x5652709a33c0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:42.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.146+0000 7fa822ff5640 0 client.15510 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:15:42.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.146+0000 7fa8476bb740 1 --2- 172.21.15.2:0/1723348150 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565270991680 0x56527098e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:42.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.146+0000 7fa8476bb740 1 --2- 172.21.15.2:0/1723348150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565270986dc0 0x56527098e270 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:42.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.146+0000 7fa8476bb740 1 --2- 172.21.15.2:0/1723348150 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652709864a0 0x565270990fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:42.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.147+0000 7fa8476bb740 1 -- 172.21.15.2:0/1723348150 >> 172.21.15.2:0/1723348150 conn(0x565270982a30 msgr2=0x565270988710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:42.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.147+0000 7fa8476bb740 1 -- 172.21.15.2:0/1723348150 shutdown_connections 2024-09-19T06:15:42.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.147+0000 7fa8476bb740 1 -- 172.21.15.2:0/1723348150 wait complete. 2024-09-19T06:15:42.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.147+0000 7fa8476bb740 20 client.15510 trim_cache size 0 max 16384 2024-09-19T06:15:42.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.182+0000 7fa8476bb740 1 Processor -- start 2024-09-19T06:15:42.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.182+0000 7fa8476bb740 1 -- start start 2024-09-19T06:15:42.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.182+0000 7fa8476bb740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5652709864a0 0x56527098fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:42.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.182+0000 7fa8476bb740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565270986dc0 0x5652709a8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:42.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.183+0000 7fa8476bb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565270991680 0x5652709a91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:42.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.183+0000 7fa8476bb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa8401add60 con 0x565270991680 2024-09-19T06:15:42.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.183+0000 7fa8476bb740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa8401ab630 con 0x5652709864a0 2024-09-19T06:15:42.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.183+0000 7fa8476bb740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa8401a9480 con 0x565270986dc0 2024-09-19T06:15:42.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.183+0000 7fa83e7fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565270986dc0 0x5652709a8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:42.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.183+0000 7fa83f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565270991680 0x5652709a91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:42.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.183+0000 7fa83f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565270991680 0x5652709a91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40018/0 (socket says 172.21.15.2:40018) 2024-09-19T06:15:42.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.183+0000 7fa83f7fe640 1 -- 172.21.15.2:0/814667527 learned_addr learned my addr 172.21.15.2:0/814667527 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:42.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.183+0000 7fa83f7fe640 1 -- 172.21.15.2:0/814667527 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565270986dc0 msgr2=0x5652709a8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:42.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.183+0000 7fa83f7fe640 1 --2- 172.21.15.2:0/814667527 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565270986dc0 0x5652709a8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:42.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.183+0000 7fa83f7fe640 1 -- 172.21.15.2:0/814667527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5652709864a0 msgr2=0x56527098fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:42.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.183+0000 7fa83effd640 1 --2- 172.21.15.2:0/814667527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5652709864a0 0x56527098fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:42.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.183+0000 7fa83f7fe640 1 --2- 172.21.15.2:0/814667527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5652709864a0 0x56527098fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:42.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.183+0000 7fa83f7fe640 1 -- 172.21.15.2:0/814667527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56527098d220 con 0x565270991680 2024-09-19T06:15:42.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.184+0000 7fa83effd640 1 --2- 172.21.15.2:0/814667527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5652709864a0 0x56527098fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:15:42.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.184+0000 7fa83f7fe640 1 --2- 172.21.15.2:0/814667527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565270991680 0x5652709a91a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa838007e10 tx=0x7fa838024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a03c714142a3ca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:42.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.184+0000 7fa824ff9640 1 -- 172.21.15.2:0/814667527 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa838035070 con 0x565270991680 2024-09-19T06:15:42.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.184+0000 7fa824ff9640 1 -- 172.21.15.2:0/814667527 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa838003cf0 con 0x565270991680 2024-09-19T06:15:42.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.184+0000 7fa824ff9640 1 -- 172.21.15.2:0/814667527 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa838014070 con 0x565270991680 2024-09-19T06:15:42.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.185+0000 7fa8476bb740 1 -- 172.21.15.2:0/814667527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565270991680 msgr2=0x5652709a91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:42.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.185+0000 7fa8476bb740 1 --2- 172.21.15.2:0/814667527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565270991680 0x5652709a91a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa838007e10 tx=0x7fa838024000 comp rx=0 tx=0).stop 2024-09-19T06:15:42.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.185+0000 7fa8476bb740 1 -- 172.21.15.2:0/814667527 shutdown_connections 2024-09-19T06:15:42.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.185+0000 7fa8476bb740 1 --2- 172.21.15.2:0/814667527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565270991680 0x5652709a91a0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:42.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.185+0000 7fa8476bb740 1 --2- 172.21.15.2:0/814667527 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565270986dc0 0x5652709a8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:42.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.185+0000 7fa8476bb740 1 --2- 172.21.15.2:0/814667527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5652709864a0 0x56527098fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:42.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.185+0000 7fa8476bb740 1 -- 172.21.15.2:0/814667527 >> 172.21.15.2:0/814667527 conn(0x565270982a30 msgr2=0x565270981b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:42.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.185+0000 7fa8476bb740 1 -- 172.21.15.2:0/814667527 shutdown_connections 2024-09-19T06:15:42.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.185+0000 7fa8476bb740 1 -- 172.21.15.2:0/814667527 wait complete. 2024-09-19T06:15:42.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.186+0000 7fa8476bb740 1 -- start start 2024-09-19T06:15:42.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.186+0000 7fa8476bb740 1 Processor -- start 2024-09-19T06:15:42.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.186+0000 7fa8476bb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652709864a0 0x565270999fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:42.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.186+0000 7fa8476bb740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565270986dc0 0x565270997300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:42.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.186+0000 7fa8476bb740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565270991680 0x565270997a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:42.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.186+0000 7fa8476bb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa8401a9af0 con 0x5652709864a0 2024-09-19T06:15:42.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.186+0000 7fa8476bb740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa8401aaf60 con 0x565270991680 2024-09-19T06:15:42.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.186+0000 7fa8476bb740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa8401aa1c0 con 0x565270986dc0 2024-09-19T06:15:42.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.186+0000 7fa8476bb740 10 client.0 _ll_register_callbacks cb 0x7fa83400aca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:42.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.186+0000 7fa83effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652709864a0 0x565270999fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:42.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.186+0000 7fa83effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652709864a0 0x565270999fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40032/0 (socket says 172.21.15.2:40032) 2024-09-19T06:15:42.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.186+0000 7fa83effd640 1 -- 172.21.15.2:0/2655205786 learned_addr learned my addr 172.21.15.2:0/2655205786 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:42.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.187+0000 7fa83effd640 1 -- 172.21.15.2:0/2655205786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565270986dc0 msgr2=0x565270997300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:42.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.187+0000 7fa83f7fe640 1 --2- 172.21.15.2:0/2655205786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565270991680 0x565270997a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:42.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.187+0000 7fa83e7fc640 1 --2- 172.21.15.2:0/2655205786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565270986dc0 0x565270997300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:42.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.187+0000 7fa83effd640 1 --2- 172.21.15.2:0/2655205786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565270986dc0 0x565270997300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:42.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.187+0000 7fa83effd640 1 -- 172.21.15.2:0/2655205786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565270991680 msgr2=0x565270997a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:42.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.187+0000 7fa83effd640 1 --2- 172.21.15.2:0/2655205786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565270991680 0x565270997a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:42.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.187+0000 7fa83effd640 1 -- 172.21.15.2:0/2655205786 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565270a0ac40 con 0x5652709864a0 2024-09-19T06:15:42.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.187+0000 7fa83effd640 1 --2- 172.21.15.2:0/2655205786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652709864a0 0x565270999fb0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fa8300b8cb0 tx=0x7fa830031f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b444228cf9885a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:42.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.187+0000 7fa83f7fe640 1 --2- 172.21.15.2:0/2655205786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565270991680 0x565270997a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:15:42.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.187+0000 7fa822ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:15:42.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.187+0000 7fa83e7fc640 1 --2- 172.21.15.2:0/2655205786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565270986dc0 0x565270997300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:15:42.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.187+0000 7fa822ff5640 1 -- 172.21.15.2:0/2655205786 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa830049040 con 0x5652709864a0 2024-09-19T06:15:42.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.187+0000 7fa8476bb740 1 -- 172.21.15.2:0/2655205786 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa838003cf0 con 0x5652709864a0 2024-09-19T06:15:42.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.187+0000 7fa822ff5640 1 -- 172.21.15.2:0/2655205786 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fa83003b5f0 con 0x5652709864a0 2024-09-19T06:15:42.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.188+0000 7fa822ff5640 1 -- 172.21.15.2:0/2655205786 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa8300bc390 con 0x5652709864a0 2024-09-19T06:15:42.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.188+0000 7fa8476bb740 10 client.15516 fetch_fsmap learned FSMap version 26 2024-09-19T06:15:42.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.188+0000 7fa8476bb740 1 -- 172.21.15.2:0/2655205786 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x565270a0bdc0 con 0x5652709864a0 2024-09-19T06:15:42.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.188+0000 7fa822ff5640 1 -- 172.21.15.2:0/2655205786 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa838003cf0 con 0x5652709864a0 2024-09-19T06:15:42.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.188+0000 7fa822ff5640 1 -- 172.21.15.2:0/2655205786 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fa8300c5030 con 0x5652709864a0 2024-09-19T06:15:42.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.188+0000 7fa8476bb740 10 client.15516 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:15:42.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.188+0000 7fa8476bb740 10 client.15516 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:15:42.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.188+0000 7fa8476bb740 20 client.15516 populate_metadata read hostname 'smithi002' 2024-09-19T06:15:42.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.188+0000 7fa8476bb740 1 --2- 172.21.15.2:0/2655205786 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5652709a0fb0 0x565270a0e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:42.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.188+0000 7fa8476bb740 4 client.15516 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:15:42.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.188+0000 7fa8476bb740 1 -- 172.21.15.2:0/2655205786 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5652708f3d60 con 0x5652709a0fb0 2024-09-19T06:15:42.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.189+0000 7fa83e7fc640 1 --2- 172.21.15.2:0/2655205786 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5652709a0fb0 0x565270a0e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:42.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.189+0000 7fa822ff5640 10 client.15516 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:15:42.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.189+0000 7fa83e7fc640 1 --2- 172.21.15.2:0/2655205786 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5652709a0fb0 0x565270a0e590 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c61d2beb31eb4ea2 server_cookie=e1083d9fc3ee2791 in_seq=0 out_seq=0 2024-09-19T06:15:42.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.189+0000 7fa822ff5640 1 -- 172.21.15.2:0/2655205786 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5652708f3d60 con 0x5652709a0fb0 2024-09-19T06:15:42.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.189+0000 7fa822ff5640 10 client.15516 handle_command_reply: tid=0 2024-09-19T06:15:42.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.189+0000 7fa8476bb740 1 client.15516 shutdown 2024-09-19T06:15:42.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.190+0000 7fa8476bb740 1 -- 172.21.15.2:0/2655205786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652709864a0 msgr2=0x565270999fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:42.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.190+0000 7fa8476bb740 1 --2- 172.21.15.2:0/2655205786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652709864a0 0x565270999fb0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fa8300b8cb0 tx=0x7fa830031f10 comp rx=0 tx=0).stop 2024-09-19T06:15:42.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.190+0000 7fa8476bb740 1 -- 172.21.15.2:0/2655205786 shutdown_connections 2024-09-19T06:15:42.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.190+0000 7fa8476bb740 1 --2- 172.21.15.2:0/2655205786 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5652709a0fb0 0x565270a0e590 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:42.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.190+0000 7fa8476bb740 1 --2- 172.21.15.2:0/2655205786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565270991680 0x565270997a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:42.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.190+0000 7fa8476bb740 1 --2- 172.21.15.2:0/2655205786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565270986dc0 0x565270997300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:42.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.190+0000 7fa822ff5640 0 client.15516 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:15:42.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.190+0000 7fa8476bb740 1 --2- 172.21.15.2:0/2655205786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5652709864a0 0x565270999fb0 secure :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fa8300b8cb0 tx=0x7fa830031f10 comp rx=0 tx=0).stop 2024-09-19T06:15:42.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.190+0000 7fa8476bb740 1 -- 172.21.15.2:0/2655205786 >> 172.21.15.2:0/2655205786 conn(0x565270982a30 msgr2=0x56527098db30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:42.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.190+0000 7fa8476bb740 1 -- 172.21.15.2:0/2655205786 shutdown_connections 2024-09-19T06:15:42.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.190+0000 7fa8476bb740 1 -- 172.21.15.2:0/2655205786 wait complete. 2024-09-19T06:15:42.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.190+0000 7fa8476bb740 20 client.15516 trim_cache size 0 max 16384 2024-09-19T06:15:42.196 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:15:42.197 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:15:42.197 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-19T06:15:42.197 INFO:teuthology.orchestra.run.smithi002.stdout: "b840d08c-de8c-4637-9d69-d64b18f9ebc5": { 2024-09-19T06:15:42.197 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-19T06:15:42.197 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "b840d08c-de8c-4637-9d69-d64b18f9ebc5", 2024-09-19T06:15:42.197 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-19T06:15:42.198 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:15:42.198 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:15:42.198 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:15:42.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.191+0000 7fa8452e2640 1 -- 172.21.15.2:0/582327081 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa8280a79f0 msgr2=0x7fa8280a9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:42.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.191+0000 7fa8452e2640 1 --2- 172.21.15.2:0/582327081 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa8280a79f0 0x7fa8280a9eb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa83800f010 tx=0x7fa838019a60 comp rx=0 tx=0).stop 2024-09-19T06:15:42.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.191+0000 7fa8452e2640 1 -- 172.21.15.2:0/582327081 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa840100100 msgr2=0x7fa840198310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:42.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.191+0000 7fa8452e2640 1 --2- 172.21.15.2:0/582327081 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa840100100 0x7fa840198310 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa83002a9e0 tx=0x7fa830003d50 comp rx=0 tx=0).stop 2024-09-19T06:15:42.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.191+0000 7fa8452e2640 1 -- 172.21.15.2:0/582327081 shutdown_connections 2024-09-19T06:15:42.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.191+0000 7fa8452e2640 1 --2- 172.21.15.2:0/582327081 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa8280a79f0 0x7fa8280a9eb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:42.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.191+0000 7fa8452e2640 1 --2- 172.21.15.2:0/582327081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa840106b80 0x7fa84019cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:42.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.191+0000 7fa8452e2640 1 --2- 172.21.15.2:0/582327081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa840100aa0 0x7fa840198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:42.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.191+0000 7fa8452e2640 1 --2- 172.21.15.2:0/582327081 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa840100100 0x7fa840198310 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:42.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.191+0000 7fa8452e2640 1 -- 172.21.15.2:0/582327081 >> 172.21.15.2:0/582327081 conn(0x7fa840077230 msgr2=0x7fa840104b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:42.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.192+0000 7fa8452e2640 1 -- 172.21.15.2:0/582327081 shutdown_connections 2024-09-19T06:15:42.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:15:42.192+0000 7fa8452e2640 1 -- 172.21.15.2:0/582327081 wait complete. 2024-09-19T06:15:42.774 INFO:tasks.cephfs.filesystem:scrub status for tag:b840d08c-de8c-4637-9d69-d64b18f9ebc5 - {'path': '/', 'tag': 'b840d08c-de8c-4637-9d69-d64b18f9ebc5', 'options': 'recursive,force'} 2024-09-19T06:15:43.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:43 smithi002 ceph-mon[30982]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:15:43.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:43 smithi002 ceph-mon[30982]: scrub summary: idle 2024-09-19T06:15:43.489 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:43 smithi090 ceph-mon[34497]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:15:43.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:43 smithi090 ceph-mon[34497]: scrub summary: idle 2024-09-19T06:15:43.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:43 smithi089 ceph-mon[34160]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:15:43.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:43 smithi089 ceph-mon[34160]: scrub summary: idle 2024-09-19T06:15:45.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:45 smithi002 ceph-mon[30982]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-19T06:15:45.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:45 smithi090 ceph-mon[34497]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-19T06:15:45.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:45 smithi089 ceph-mon[34160]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-19T06:15:47.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:47 smithi002 ceph-mon[30982]: pgmap v32: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-19T06:15:47.489 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:47 smithi090 ceph-mon[34497]: pgmap v32: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-19T06:15:47.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:47 smithi089 ceph-mon[34160]: pgmap v32: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-19T06:15:49.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:49 smithi002 ceph-mon[30982]: pgmap v33: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T06:15:49.489 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:49 smithi090 ceph-mon[34497]: pgmap v33: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T06:15:49.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:49 smithi089 ceph-mon[34160]: pgmap v33: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T06:15:51.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:51 smithi002 ceph-mon[30982]: pgmap v34: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-19T06:15:51.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:51 smithi090 ceph-mon[34497]: pgmap v34: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-19T06:15:51.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:51 smithi089 ceph-mon[34160]: pgmap v34: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-19T06:15:52.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.302+0000 7f189f59e640 1 -- 172.21.15.2:0/2474798527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18a0106820 msgr2=0x7f18a0106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:52.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.302+0000 7f189f59e640 1 --2- 172.21.15.2:0/2474798527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18a0106820 0x7f18a0106c00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1890009900 tx=0x7f189002a3f0 comp rx=0 tx=0).stop 2024-09-19T06:15:52.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.302+0000 7f189f59e640 1 -- 172.21.15.2:0/2474798527 shutdown_connections 2024-09-19T06:15:52.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.302+0000 7f189f59e640 1 --2- 172.21.15.2:0/2474798527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18a01011b0 0x7f18a010d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:52.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.302+0000 7f189f59e640 1 --2- 172.21.15.2:0/2474798527 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18a0100810 0x7f18a0100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:52.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.302+0000 7f189f59e640 1 --2- 172.21.15.2:0/2474798527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18a0106820 0x7f18a0106c00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:52.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.302+0000 7f189f59e640 1 -- 172.21.15.2:0/2474798527 >> 172.21.15.2:0/2474798527 conn(0x7f18a00777f0 msgr2=0x7f18a00feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:52.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.302+0000 7f189f59e640 1 -- 172.21.15.2:0/2474798527 shutdown_connections 2024-09-19T06:15:52.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.302+0000 7f189f59e640 1 -- 172.21.15.2:0/2474798527 wait complete. 2024-09-19T06:15:52.307 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.303+0000 7f189f59e640 1 Processor -- start 2024-09-19T06:15:52.308 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.303+0000 7f189f59e640 1 -- start start 2024-09-19T06:15:52.308 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.304+0000 7f189f59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18a0100810 0x7f18a019a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:52.308 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.304+0000 7f189f59e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18a01011b0 0x7f18a019a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:52.308 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.304+0000 7f189f59e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18a0106820 0x7f18a019eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:52.308 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.304+0000 7f189f59e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f18a010fa10 con 0x7f18a0100810 2024-09-19T06:15:52.308 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.304+0000 7f189f59e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f18a010f890 con 0x7f18a0106820 2024-09-19T06:15:52.308 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.304+0000 7f189f59e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f18a010fb90 con 0x7f18a01011b0 2024-09-19T06:15:52.308 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.304+0000 7f189e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18a0100810 0x7f18a019a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:52.309 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.304+0000 7f189e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18a0100810 0x7f18a019a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40576/0 (socket says 172.21.15.2:40576) 2024-09-19T06:15:52.309 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.304+0000 7f189e59c640 1 -- 172.21.15.2:0/1681810686 learned_addr learned my addr 172.21.15.2:0/1681810686 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:52.309 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.304+0000 7f1897fff640 1 --2- 172.21.15.2:0/1681810686 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18a01011b0 0x7f18a019a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:52.309 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.304+0000 7f189ed9d640 1 --2- 172.21.15.2:0/1681810686 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18a0106820 0x7f18a019eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:52.309 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.304+0000 7f189e59c640 1 -- 172.21.15.2:0/1681810686 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18a01011b0 msgr2=0x7f18a019a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:52.309 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.304+0000 7f189e59c640 1 --2- 172.21.15.2:0/1681810686 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18a01011b0 0x7f18a019a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:52.309 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.304+0000 7f189e59c640 1 -- 172.21.15.2:0/1681810686 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18a0106820 msgr2=0x7f18a019eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:52.309 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.304+0000 7f189e59c640 1 --2- 172.21.15.2:0/1681810686 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18a0106820 0x7f18a019eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:52.309 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.304+0000 7f189e59c640 1 -- 172.21.15.2:0/1681810686 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a019f3d0 con 0x7f18a0100810 2024-09-19T06:15:52.310 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.304+0000 7f1897fff640 1 --2- 172.21.15.2:0/1681810686 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18a01011b0 0x7f18a019a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:52.310 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.304+0000 7f189ed9d640 1 --2- 172.21.15.2:0/1681810686 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18a0106820 0x7f18a019eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:52.310 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.305+0000 7f189e59c640 1 --2- 172.21.15.2:0/1681810686 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18a0100810 0x7f18a019a3e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1890006010 tx=0x7f18900040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:52.310 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.305+0000 7f18977fe640 1 -- 172.21.15.2:0/1681810686 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f189003f030 con 0x7f18a0100810 2024-09-19T06:15:52.310 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.305+0000 7f189f59e640 1 -- 172.21.15.2:0/1681810686 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18a019f660 con 0x7f18a0100810 2024-09-19T06:15:52.310 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.305+0000 7f18977fe640 1 -- 172.21.15.2:0/1681810686 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f18900044c0 con 0x7f18a0100810 2024-09-19T06:15:52.310 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.305+0000 7f18977fe640 1 -- 172.21.15.2:0/1681810686 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1890035070 con 0x7f18a0100810 2024-09-19T06:15:52.310 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.305+0000 7f189f59e640 1 -- 172.21.15.2:0/1681810686 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18a01a6f50 con 0x7f18a0100810 2024-09-19T06:15:52.312 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.308+0000 7f18977fe640 1 -- 172.21.15.2:0/1681810686 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 24) ==== 138638+0+0 (secure 0 0 0) 0x7f1890042030 con 0x7f18a0100810 2024-09-19T06:15:52.312 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.308+0000 7f18977fe640 1 --2- 172.21.15.2:0/1681810686 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f188c0a3550 0x7f188c0a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:52.312 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.308+0000 7f18a7679740 1 Processor -- start 2024-09-19T06:15:52.312 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.309+0000 7f18977fe640 1 -- 172.21.15.2:0/1681810686 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f18900f0220 con 0x7f18a0100810 2024-09-19T06:15:52.312 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.309+0000 7f1897fff640 1 --2- 172.21.15.2:0/1681810686 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f188c0a3550 0x7f188c0a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:52.312 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.309+0000 7f18a7679740 1 -- start start 2024-09-19T06:15:52.313 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.309+0000 7f18a7679740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614dbdf2cc0 0x5614dbdf30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:52.313 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.309+0000 7f18a7679740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5614dbdf35e0 0x5614dbdfd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:52.313 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.309+0000 7f18a7679740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614dbdfde80 0x5614dbe00270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:52.313 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.309+0000 7f18a7679740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5614dbd572f0 con 0x5614dbdf2cc0 2024-09-19T06:15:52.313 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.309+0000 7f18a7679740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5614dbcff270 con 0x5614dbdf35e0 2024-09-19T06:15:52.313 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.309+0000 7f18a7679740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5614dbd532b0 con 0x5614dbdfde80 2024-09-19T06:15:52.313 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.309+0000 7f189e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614dbdf2cc0 0x5614dbdf30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:52.316 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.309+0000 7f189e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614dbdf2cc0 0x5614dbdf30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40584/0 (socket says 172.21.15.2:40584) 2024-09-19T06:15:52.316 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.309+0000 7f189e59c640 1 -- 172.21.15.2:0/3614729885 learned_addr learned my addr 172.21.15.2:0/3614729885 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.309+0000 7f189ed9d640 1 --2- 172.21.15.2:0/3614729885 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614dbdfde80 0x5614dbe00270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.309+0000 7f1897fff640 1 --2- 172.21.15.2:0/1681810686 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f188c0a3550 0x7f188c0a5a10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f18a010cf40 tx=0x7f1888005f90 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.310+0000 7f189e59c640 1 -- 172.21.15.2:0/3614729885 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614dbdfde80 msgr2=0x5614dbe00270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.310+0000 7f189e59c640 1 --2- 172.21.15.2:0/3614729885 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614dbdfde80 0x5614dbe00270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.310+0000 7f189e59c640 1 -- 172.21.15.2:0/3614729885 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5614dbdf35e0 msgr2=0x5614dbdfd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.310+0000 7f189e59c640 1 --2- 172.21.15.2:0/3614729885 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5614dbdf35e0 0x5614dbdfd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.310+0000 7f189e59c640 1 -- 172.21.15.2:0/3614729885 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614dbcfe340 con 0x5614dbdf2cc0 2024-09-19T06:15:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.310+0000 7f189e59c640 1 --2- 172.21.15.2:0/3614729885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614dbdf2cc0 0x5614dbdf30a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f18900ed890 tx=0x7f1890005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e11ce5e5dc029de2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.310+0000 7f1894ff9640 1 -- 172.21.15.2:0/3614729885 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1890049050 con 0x5614dbdf2cc0 2024-09-19T06:15:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.310+0000 7f1894ff9640 1 -- 172.21.15.2:0/3614729885 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f18900c06e0 con 0x5614dbdf2cc0 2024-09-19T06:15:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.310+0000 7f1894ff9640 1 -- 172.21.15.2:0/3614729885 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18900c4d70 con 0x5614dbdf2cc0 2024-09-19T06:15:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.311+0000 7f18a7679740 1 -- 172.21.15.2:0/3614729885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614dbdf2cc0 msgr2=0x5614dbdf30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.311+0000 7f18a7679740 1 --2- 172.21.15.2:0/3614729885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614dbdf2cc0 0x5614dbdf30a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f18900ed890 tx=0x7f1890005c00 comp rx=0 tx=0).stop 2024-09-19T06:15:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.311+0000 7f18a7679740 1 -- 172.21.15.2:0/3614729885 shutdown_connections 2024-09-19T06:15:52.322 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.311+0000 7f18a7679740 1 --2- 172.21.15.2:0/3614729885 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614dbdfde80 0x5614dbe00270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:52.322 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.311+0000 7f18a7679740 1 --2- 172.21.15.2:0/3614729885 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5614dbdf35e0 0x5614dbdfd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:52.322 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.311+0000 7f18a7679740 1 --2- 172.21.15.2:0/3614729885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614dbdf2cc0 0x5614dbdf30a0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:52.322 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.311+0000 7f18a7679740 1 -- 172.21.15.2:0/3614729885 >> 172.21.15.2:0/3614729885 conn(0x5614dbdef230 msgr2=0x5614dbdef610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:52.322 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.311+0000 7f18a7679740 1 -- 172.21.15.2:0/3614729885 shutdown_connections 2024-09-19T06:15:52.322 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.311+0000 7f18a7679740 1 -- 172.21.15.2:0/3614729885 wait complete. 2024-09-19T06:15:52.322 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.312+0000 7f18a7679740 1 -- start start 2024-09-19T06:15:52.322 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.312+0000 7f18a7679740 1 Processor -- start 2024-09-19T06:15:52.322 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.312+0000 7f18a7679740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614dbdf2cc0 0x5614dbdfadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:52.322 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.312+0000 7f18a7679740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5614dbdf35e0 0x5614dbdfb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:52.322 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.312+0000 7f18a7679740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614dbdfde80 0x5614dbdfb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:52.322 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.312+0000 7f18a7679740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5614dbe00810 con 0x5614dbdfde80 2024-09-19T06:15:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.312+0000 7f18a7679740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5614dbce0290 con 0x5614dbdf35e0 2024-09-19T06:15:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.312+0000 7f18a7679740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5614dbe00990 con 0x5614dbdf2cc0 2024-09-19T06:15:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.312+0000 7f18a7679740 10 client.0 _ll_register_callbacks cb 0x5614dbd11140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.312+0000 7f189ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614dbdfde80 0x5614dbdfb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.312+0000 7f1897fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5614dbdf35e0 0x5614dbdfb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.312+0000 7f189ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614dbdfde80 0x5614dbdfb840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40600/0 (socket says 172.21.15.2:40600) 2024-09-19T06:15:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.312+0000 7f189ed9d640 1 -- 172.21.15.2:0/2440882404 learned_addr learned my addr 172.21.15.2:0/2440882404 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.313+0000 7f189e59c640 1 --2- 172.21.15.2:0/2440882404 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614dbdf2cc0 0x5614dbdfadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.313+0000 7f1897fff640 1 -- 172.21.15.2:0/2440882404 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614dbdf2cc0 msgr2=0x5614dbdfadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.313+0000 7f1897fff640 1 --2- 172.21.15.2:0/2440882404 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614dbdf2cc0 0x5614dbdfadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.313+0000 7f1897fff640 1 -- 172.21.15.2:0/2440882404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614dbdfde80 msgr2=0x5614dbdfb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.313+0000 7f1897fff640 1 --2- 172.21.15.2:0/2440882404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614dbdfde80 0x5614dbdfb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.313+0000 7f1897fff640 1 -- 172.21.15.2:0/2440882404 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614dba6a210 con 0x5614dbdf35e0 2024-09-19T06:15:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.313+0000 7f189ed9d640 1 --2- 172.21.15.2:0/2440882404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614dbdfde80 0x5614dbdfb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.313+0000 7f1897fff640 1 --2- 172.21.15.2:0/2440882404 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5614dbdf35e0 0x5614dbdfb300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1888011ca0 tx=0x7f18880046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0dbfa6510bac263 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.313+0000 7f1885ffb640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-09-19T06:15:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.313+0000 7f1885ffb640 1 -- 172.21.15.2:0/2440882404 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f188800f740 con 0x5614dbdf35e0 2024-09-19T06:15:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.313+0000 7f18a7679740 1 -- 172.21.15.2:0/2440882404 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18900c06e0 con 0x5614dbdf35e0 2024-09-19T06:15:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.313+0000 7f1885ffb640 1 -- 172.21.15.2:0/2440882404 <== mon.2 v2:172.21.15.89:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f188800f8e0 con 0x5614dbdf35e0 2024-09-19T06:15:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.314+0000 7f1885ffb640 1 -- 172.21.15.2:0/2440882404 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f188800fae0 con 0x5614dbdf35e0 2024-09-19T06:15:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.314+0000 7f18a7679740 10 client.25220 fetch_fsmap learned FSMap version 26 2024-09-19T06:15:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.314+0000 7f18a7679740 1 -- 172.21.15.2:0/2440882404 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5614dbb36620 con 0x5614dbdf35e0 2024-09-19T06:15:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.314+0000 7f1885ffb640 1 -- 172.21.15.2:0/2440882404 <== mon.2 v2:172.21.15.89:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f18900c06e0 con 0x5614dbdf35e0 2024-09-19T06:15:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.314+0000 7f1885ffb640 1 -- 172.21.15.2:0/2440882404 <== mon.2 v2:172.21.15.89:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f188801a070 con 0x5614dbdf35e0 2024-09-19T06:15:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.315+0000 7f18a7679740 10 client.25220 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:15:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.315+0000 7f18a7679740 10 client.25220 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:15:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.315+0000 7f18a7679740 20 client.25220 populate_metadata read hostname 'smithi002' 2024-09-19T06:15:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.315+0000 7f18a7679740 1 --2- 172.21.15.2:0/2440882404 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5614dbe0dc50 0x5614dbe10040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.315+0000 7f18a7679740 4 client.25220 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:15:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.315+0000 7f18a7679740 1 -- 172.21.15.2:0/2440882404 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5614dbd64a20 con 0x5614dbe0dc50 2024-09-19T06:15:52.326 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.315+0000 7f189e59c640 1 --2- 172.21.15.2:0/2440882404 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5614dbe0dc50 0x5614dbe10040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:52.326 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.315+0000 7f189e59c640 1 --2- 172.21.15.2:0/2440882404 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5614dbe0dc50 0x5614dbe10040 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33e2607bd6d19a5 server_cookie=e46334bbc8aced1a in_seq=0 out_seq=0 2024-09-19T06:15:52.326 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.315+0000 7f1885ffb640 10 client.25220 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:15:52.326 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.316+0000 7f1885ffb640 1 -- 172.21.15.2:0/2440882404 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5614dbd64a20 con 0x5614dbe0dc50 2024-09-19T06:15:52.326 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.316+0000 7f1885ffb640 10 client.25220 handle_command_reply: tid=0 2024-09-19T06:15:52.326 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.316+0000 7f18a7679740 1 client.25220 shutdown 2024-09-19T06:15:52.326 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.316+0000 7f18a7679740 1 -- 172.21.15.2:0/2440882404 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5614dbdf35e0 msgr2=0x5614dbdfb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:52.326 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.316+0000 7f18a7679740 1 --2- 172.21.15.2:0/2440882404 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5614dbdf35e0 0x5614dbdfb300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1888011ca0 tx=0x7f18880046c0 comp rx=0 tx=0).stop 2024-09-19T06:15:52.326 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.316+0000 7f18a7679740 1 -- 172.21.15.2:0/2440882404 shutdown_connections 2024-09-19T06:15:52.326 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.316+0000 7f18a7679740 1 --2- 172.21.15.2:0/2440882404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614dbdfde80 0x5614dbdfb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:52.326 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.316+0000 7f18a7679740 1 --2- 172.21.15.2:0/2440882404 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5614dbe0dc50 0x5614dbe10040 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:52.326 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.316+0000 7f1885ffb640 0 client.25220 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:15:52.327 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.316+0000 7f18a7679740 1 --2- 172.21.15.2:0/2440882404 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5614dbdf35e0 0x5614dbdfb300 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:52.327 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.316+0000 7f18a7679740 1 --2- 172.21.15.2:0/2440882404 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614dbdf2cc0 0x5614dbdfadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:52.327 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.316+0000 7f18a7679740 1 -- 172.21.15.2:0/2440882404 >> 172.21.15.2:0/2440882404 conn(0x5614dbdef230 msgr2=0x5614dbdf4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:52.327 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.316+0000 7f18a7679740 1 -- 172.21.15.2:0/2440882404 shutdown_connections 2024-09-19T06:15:52.327 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.316+0000 7f18a7679740 1 -- 172.21.15.2:0/2440882404 wait complete. 2024-09-19T06:15:52.327 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.316+0000 7f18a7679740 20 client.25220 trim_cache size 0 max 16384 2024-09-19T06:15:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.345+0000 7f18a7679740 1 Processor -- start 2024-09-19T06:15:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.345+0000 7f18a7679740 1 -- start start 2024-09-19T06:15:52.349 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.346+0000 7f18a7679740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614dbdf2cc0 0x5614dbde9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:52.349 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.346+0000 7f18a7679740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5614dbdf35e0 0x5614dbdfb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:52.349 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.346+0000 7f18a7679740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614dbdfde80 0x5614dbe158e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:52.349 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.346+0000 7f18a7679740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f18a01b1fe0 con 0x5614dbdfde80 2024-09-19T06:15:52.349 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.346+0000 7f18a7679740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f18a01af8b0 con 0x5614dbdf35e0 2024-09-19T06:15:52.349 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.346+0000 7f18a7679740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f18a01ad700 con 0x5614dbdf2cc0 2024-09-19T06:15:52.349 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.346+0000 7f189ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614dbdfde80 0x5614dbe158e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:52.349 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.346+0000 7f189ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614dbdfde80 0x5614dbe158e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40604/0 (socket says 172.21.15.2:40604) 2024-09-19T06:15:52.349 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.346+0000 7f189ed9d640 1 -- 172.21.15.2:0/1931408079 learned_addr learned my addr 172.21.15.2:0/1931408079 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:52.349 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.346+0000 7f1897fff640 1 --2- 172.21.15.2:0/1931408079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5614dbdf35e0 0x5614dbdfb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:52.349 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.346+0000 7f189e59c640 1 --2- 172.21.15.2:0/1931408079 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614dbdf2cc0 0x5614dbde9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:52.350 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.346+0000 7f1897fff640 1 -- 172.21.15.2:0/1931408079 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614dbdf2cc0 msgr2=0x5614dbde9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:52.350 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.346+0000 7f1897fff640 1 --2- 172.21.15.2:0/1931408079 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614dbdf2cc0 0x5614dbde9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:52.350 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.346+0000 7f1897fff640 1 -- 172.21.15.2:0/1931408079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614dbdfde80 msgr2=0x5614dbe158e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:52.350 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.346+0000 7f1897fff640 1 --2- 172.21.15.2:0/1931408079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614dbdfde80 0x5614dbe158e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:52.350 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.346+0000 7f1897fff640 1 -- 172.21.15.2:0/1931408079 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614dbdf9d50 con 0x5614dbdf35e0 2024-09-19T06:15:52.350 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.346+0000 7f189ed9d640 1 --2- 172.21.15.2:0/1931408079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614dbdfde80 0x5614dbe158e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:52.350 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.347+0000 7f1897fff640 1 --2- 172.21.15.2:0/1931408079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5614dbdf35e0 0x5614dbdfb670 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f188802f4a0 tx=0x7f18880091e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8930c7859e35555b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:52.350 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.347+0000 7f1887fff640 1 -- 172.21.15.2:0/1931408079 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18880043d0 con 0x5614dbdf35e0 2024-09-19T06:15:52.350 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.347+0000 7f1887fff640 1 -- 172.21.15.2:0/1931408079 <== mon.2 v2:172.21.15.89:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1888034070 con 0x5614dbdf35e0 2024-09-19T06:15:52.350 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.347+0000 7f1887fff640 1 -- 172.21.15.2:0/1931408079 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f188802fd20 con 0x5614dbdf35e0 2024-09-19T06:15:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.348+0000 7f18a7679740 1 -- 172.21.15.2:0/1931408079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5614dbdf35e0 msgr2=0x5614dbdfb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.348+0000 7f18a7679740 1 --2- 172.21.15.2:0/1931408079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5614dbdf35e0 0x5614dbdfb670 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f188802f4a0 tx=0x7f18880091e0 comp rx=0 tx=0).stop 2024-09-19T06:15:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.348+0000 7f18a7679740 1 -- 172.21.15.2:0/1931408079 shutdown_connections 2024-09-19T06:15:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.348+0000 7f18a7679740 1 --2- 172.21.15.2:0/1931408079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614dbdfde80 0x5614dbe158e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.348+0000 7f18a7679740 1 --2- 172.21.15.2:0/1931408079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5614dbdf35e0 0x5614dbdfb670 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.348+0000 7f18a7679740 1 --2- 172.21.15.2:0/1931408079 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614dbdf2cc0 0x5614dbde9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.348+0000 7f18a7679740 1 -- 172.21.15.2:0/1931408079 >> 172.21.15.2:0/1931408079 conn(0x5614dbdef230 msgr2=0x5614dbdfce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.348+0000 7f18a7679740 1 -- 172.21.15.2:0/1931408079 shutdown_connections 2024-09-19T06:15:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.348+0000 7f18a7679740 1 -- 172.21.15.2:0/1931408079 wait complete. 2024-09-19T06:15:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.348+0000 7f18a7679740 1 -- start start 2024-09-19T06:15:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.348+0000 7f18a7679740 1 Processor -- start 2024-09-19T06:15:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.349+0000 7f18a7679740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5614dbdf2cc0 0x5614dbe06180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.349+0000 7f18a7679740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614dbdf35e0 0x5614dbdf7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.349+0000 7f18a7679740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614dbdfde80 0x5614dbdf7e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.349+0000 7f18a7679740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f18a01add70 con 0x5614dbdf35e0 2024-09-19T06:15:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.349+0000 7f18a7679740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f18a01af1e0 con 0x5614dbdf2cc0 2024-09-19T06:15:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.349+0000 7f18a7679740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f18a01ae440 con 0x5614dbdfde80 2024-09-19T06:15:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.349+0000 7f18a7679740 10 client.0 _ll_register_callbacks cb 0x7f1888009db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.349+0000 7f1897fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614dbdf35e0 0x5614dbdf7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.349+0000 7f1897fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614dbdf35e0 0x5614dbdf7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40618/0 (socket says 172.21.15.2:40618) 2024-09-19T06:15:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.349+0000 7f1897fff640 1 -- 172.21.15.2:0/669315997 learned_addr learned my addr 172.21.15.2:0/669315997 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:15:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.349+0000 7f189e59c640 1 --2- 172.21.15.2:0/669315997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5614dbdf2cc0 0x5614dbe06180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.349+0000 7f189ed9d640 1 --2- 172.21.15.2:0/669315997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614dbdfde80 0x5614dbdf7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.349+0000 7f1897fff640 1 -- 172.21.15.2:0/669315997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614dbdfde80 msgr2=0x5614dbdf7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.349+0000 7f1897fff640 1 --2- 172.21.15.2:0/669315997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614dbdfde80 0x5614dbdf7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.349+0000 7f1897fff640 1 -- 172.21.15.2:0/669315997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5614dbdf2cc0 msgr2=0x5614dbe06180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.349+0000 7f1897fff640 1 --2- 172.21.15.2:0/669315997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5614dbdf2cc0 0x5614dbe06180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.349+0000 7f1897fff640 1 -- 172.21.15.2:0/669315997 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614dbdf3410 con 0x5614dbdf35e0 2024-09-19T06:15:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.349+0000 7f1897fff640 1 --2- 172.21.15.2:0/669315997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614dbdf35e0 0x5614dbdf7930 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1888011fd0 tx=0x7f188800fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff46916d66d4ea23 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.349+0000 7f1885ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:15:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.350+0000 7f1885ffb640 1 -- 172.21.15.2:0/669315997 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f188800f750 con 0x5614dbdf35e0 2024-09-19T06:15:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.350+0000 7f1885ffb640 1 -- 172.21.15.2:0/669315997 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f1888005040 con 0x5614dbdf35e0 2024-09-19T06:15:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.350+0000 7f18a7679740 1 -- 172.21.15.2:0/669315997 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1888034070 con 0x5614dbdf35e0 2024-09-19T06:15:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.350+0000 7f1885ffb640 1 -- 172.21.15.2:0/669315997 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f188800f8f0 con 0x5614dbdf35e0 2024-09-19T06:15:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.350+0000 7f18a7679740 10 client.15534 fetch_fsmap learned FSMap version 26 2024-09-19T06:15:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.350+0000 7f18a7679740 1 -- 172.21.15.2:0/669315997 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5614dbe78480 con 0x5614dbdf35e0 2024-09-19T06:15:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.350+0000 7f1885ffb640 1 -- 172.21.15.2:0/669315997 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1888034070 con 0x5614dbdf35e0 2024-09-19T06:15:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.350+0000 7f1885ffb640 1 -- 172.21.15.2:0/669315997 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f188801a040 con 0x5614dbdf35e0 2024-09-19T06:15:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.350+0000 7f18a7679740 10 client.15534 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:15:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.350+0000 7f18a7679740 10 client.15534 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:15:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.351+0000 7f18a7679740 20 client.15534 populate_metadata read hostname 'smithi002' 2024-09-19T06:15:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.351+0000 7f18a7679740 1 --2- 172.21.15.2:0/669315997 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5614dbe0dc50 0x5614dbe7aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.351+0000 7f18a7679740 4 client.15534 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:15:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.351+0000 7f18a7679740 1 -- 172.21.15.2:0/669315997 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5614dbd5ed70 con 0x5614dbe0dc50 2024-09-19T06:15:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.351+0000 7f189e59c640 1 --2- 172.21.15.2:0/669315997 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5614dbe0dc50 0x5614dbe7aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.351+0000 7f1885ffb640 10 client.15534 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:15:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.351+0000 7f189e59c640 1 --2- 172.21.15.2:0/669315997 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5614dbe0dc50 0x5614dbe7aaf0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2169b1da3e909c96 server_cookie=2128568939f4d7c in_seq=0 out_seq=0 2024-09-19T06:15:52.358 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.354+0000 7f1885ffb640 1 -- 172.21.15.2:0/669315997 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5614dbd5ed70 con 0x5614dbe0dc50 2024-09-19T06:15:52.358 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.354+0000 7f1885ffb640 10 client.15534 handle_command_reply: tid=0 2024-09-19T06:15:52.358 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.354+0000 7f18a7679740 1 client.15534 shutdown 2024-09-19T06:15:52.358 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.355+0000 7f18a7679740 1 -- 172.21.15.2:0/669315997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614dbdf35e0 msgr2=0x5614dbdf7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:52.358 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.355+0000 7f18a7679740 1 --2- 172.21.15.2:0/669315997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614dbdf35e0 0x5614dbdf7930 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1888011fd0 tx=0x7f188800fc80 comp rx=0 tx=0).stop 2024-09-19T06:15:52.358 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.355+0000 7f18a7679740 1 -- 172.21.15.2:0/669315997 shutdown_connections 2024-09-19T06:15:52.358 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.355+0000 7f18a7679740 1 --2- 172.21.15.2:0/669315997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5614dbdfde80 0x5614dbdf7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:52.358 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.355+0000 7f18a7679740 1 --2- 172.21.15.2:0/669315997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5614dbdf35e0 0x5614dbdf7930 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:52.359 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.355+0000 7f18a7679740 1 --2- 172.21.15.2:0/669315997 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5614dbe0dc50 0x5614dbe7aaf0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:52.359 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.355+0000 7f1885ffb640 0 client.15534 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:15:52.359 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.355+0000 7f18a7679740 1 --2- 172.21.15.2:0/669315997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5614dbdf2cc0 0x5614dbe06180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:52.359 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.355+0000 7f18a7679740 1 -- 172.21.15.2:0/669315997 >> 172.21.15.2:0/669315997 conn(0x5614dbdef230 msgr2=0x5614dbdf4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:52.359 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.355+0000 7f18a7679740 1 -- 172.21.15.2:0/669315997 shutdown_connections 2024-09-19T06:15:52.359 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.355+0000 7f18a7679740 1 -- 172.21.15.2:0/669315997 wait complete. 2024-09-19T06:15:52.359 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.355+0000 7f18a7679740 20 client.15534 trim_cache size 0 max 16384 2024-09-19T06:15:52.359 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-19T06:15:52.359 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-19T06:15:52.359 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-19T06:15:52.360 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-19T06:15:52.360 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.355+0000 7f189f59e640 1 -- 172.21.15.2:0/1681810686 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f188c0a3550 msgr2=0x7f188c0a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:52.360 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.355+0000 7f189f59e640 1 --2- 172.21.15.2:0/1681810686 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f188c0a3550 0x7f188c0a5a10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f18a010cf40 tx=0x7f1888005f90 comp rx=0 tx=0).stop 2024-09-19T06:15:52.360 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.356+0000 7f189f59e640 1 -- 172.21.15.2:0/1681810686 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18a0100810 msgr2=0x7f18a019a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.356+0000 7f189f59e640 1 --2- 172.21.15.2:0/1681810686 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18a0100810 0x7f18a019a3e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1890006010 tx=0x7f18900040c0 comp rx=0 tx=0).stop 2024-09-19T06:15:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.356+0000 7f189f59e640 1 -- 172.21.15.2:0/1681810686 shutdown_connections 2024-09-19T06:15:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.356+0000 7f189f59e640 1 --2- 172.21.15.2:0/1681810686 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f188c0a3550 0x7f188c0a5a10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.356+0000 7f189f59e640 1 --2- 172.21.15.2:0/1681810686 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18a0106820 0x7f18a019eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.356+0000 7f189f59e640 1 --2- 172.21.15.2:0/1681810686 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18a01011b0 0x7f18a019a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.356+0000 7f189f59e640 1 --2- 172.21.15.2:0/1681810686 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18a0100810 0x7f18a019a3e0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.356+0000 7f189f59e640 1 -- 172.21.15.2:0/1681810686 >> 172.21.15.2:0/1681810686 conn(0x7f18a00777f0 msgr2=0x7f18a010bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.356+0000 7f189f59e640 1 -- 172.21.15.2:0/1681810686 shutdown_connections 2024-09-19T06:15:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:15:52.356+0000 7f189f59e640 1 -- 172.21.15.2:0/1681810686 wait complete. 2024-09-19T06:15:53.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:53 smithi090 ceph-mon[34497]: pgmap v35: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T06:15:53.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:53 smithi089 ceph-mon[34160]: pgmap v35: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T06:15:53.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:53 smithi002 ceph-mon[30982]: pgmap v35: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T06:15:55.489 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:55 smithi090 ceph-mon[34497]: pgmap v36: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-19T06:15:55.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:55 smithi089 ceph-mon[34160]: pgmap v36: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-19T06:15:55.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:55 smithi002 ceph-mon[30982]: pgmap v36: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-19T06:15:57.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:57 smithi090 ceph-mon[34497]: pgmap v37: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-19T06:15:57.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:57 smithi089 ceph-mon[34160]: pgmap v37: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-19T06:15:57.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:57 smithi002 ceph-mon[30982]: pgmap v37: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-19T06:15:58.489 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:58 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:15:58.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:58 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:15:58.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:58 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:15:59.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:59 smithi090 ceph-mon[34497]: pgmap v38: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T06:15:59.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:59 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:15:59.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:59 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:15:59.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:15:59 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:15:59.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:59 smithi089 ceph-mon[34160]: pgmap v38: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T06:15:59.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:59 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:15:59.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:59 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:15:59.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:15:59 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:15:59.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:59 smithi002 ceph-mon[30982]: pgmap v38: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T06:15:59.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:59 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:15:59.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:59 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:15:59.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:15:59 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:15:59.776 INFO:tasks.workunit.client.0.smithi002.stderr:Updating files: 95% (12254/12896) Updating files: 96% (12381/12896) Updating files: 97% (12510/12896) Updating files: 98% (12639/12896) Updating files: 99% (12768/12896) Updating files: 100% (12896/12896) Updating files: 100% (12896/12896), done. 2024-09-19T06:16:00.678 INFO:tasks.workunit.client.0.smithi002.stderr:Note: switching to '6fad5dd73c93545e52f57f681e140a9c3529c11e'. 2024-09-19T06:16:00.678 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-19T06:16:00.678 INFO:tasks.workunit.client.0.smithi002.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T06:16:00.678 INFO:tasks.workunit.client.0.smithi002.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T06:16:00.678 INFO:tasks.workunit.client.0.smithi002.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T06:16:00.678 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-19T06:16:00.678 INFO:tasks.workunit.client.0.smithi002.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T06:16:00.679 INFO:tasks.workunit.client.0.smithi002.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T06:16:00.679 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-19T06:16:00.679 INFO:tasks.workunit.client.0.smithi002.stderr: git switch -c 2024-09-19T06:16:00.679 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-19T06:16:00.679 INFO:tasks.workunit.client.0.smithi002.stderr:Or undo this operation with: 2024-09-19T06:16:00.679 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-19T06:16:00.679 INFO:tasks.workunit.client.0.smithi002.stderr: git switch - 2024-09-19T06:16:00.679 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-19T06:16:00.679 INFO:tasks.workunit.client.0.smithi002.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T06:16:00.679 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-19T06:16:00.679 INFO:tasks.workunit.client.0.smithi002.stderr:HEAD is now at 6fad5dd73c9 Merge pull request #59812 from neha-ojha/wip-rtd-squid 2024-09-19T06:16:00.684 DEBUG:teuthology.orchestra.run.smithi002:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T06:16:00.710 INFO:tasks.workunit.client.0.smithi002.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T06:16:00.713 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T06:16:00.713 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T06:16:01.345 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T06:16:01.415 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T06:16:01.455 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T06:16:01.457 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T06:16:01.457 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T06:16:01.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:01 smithi090 ceph-mon[34497]: pgmap v39: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T06:16:01.497 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T06:16:01.501 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-19T06:16:01.501 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T06:16:01.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:01 smithi089 ceph-mon[34160]: pgmap v39: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T06:16:01.558 INFO:tasks.workunit:Running workunits matching suites/iozone.sh on client.0... 2024-09-19T06:16:01.560 INFO:tasks.workunit:Running workunit suites/iozone.sh... 2024-09-19T06:16:01.560 DEBUG:teuthology.orchestra.run.smithi002:workunit test suites/iozone.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iozone.sh 2024-09-19T06:16:01.624 INFO:tasks.workunit.client.0.smithi002.stderr:+ iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-09-19T06:16:01.699 INFO:tasks.workunit.client.0.smithi002.stdout: Iozone: Performance Test of File I/O 2024-09-19T06:16:01.699 INFO:tasks.workunit.client.0.smithi002.stdout: Version $Revision: 3.494 $ 2024-09-19T06:16:01.699 INFO:tasks.workunit.client.0.smithi002.stdout: Compiled for 64 bit mode. 2024-09-19T06:16:01.700 INFO:tasks.workunit.client.0.smithi002.stdout: Build: linux-AMD64 2024-09-19T06:16:01.700 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-19T06:16:01.700 INFO:tasks.workunit.client.0.smithi002.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-09-19T06:16:01.700 INFO:tasks.workunit.client.0.smithi002.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-09-19T06:16:01.700 INFO:tasks.workunit.client.0.smithi002.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-09-19T06:16:01.700 INFO:tasks.workunit.client.0.smithi002.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-09-19T06:16:01.700 INFO:tasks.workunit.client.0.smithi002.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-09-19T06:16:01.700 INFO:tasks.workunit.client.0.smithi002.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-09-19T06:16:01.700 INFO:tasks.workunit.client.0.smithi002.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-09-19T06:16:01.700 INFO:tasks.workunit.client.0.smithi002.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-09-19T06:16:01.700 INFO:tasks.workunit.client.0.smithi002.stdout: Alexey Skidanov, Sudhir Kumar. 2024-09-19T06:16:01.700 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-19T06:16:01.700 INFO:tasks.workunit.client.0.smithi002.stdout: Run began: Thu Sep 19 06:16:01 2024 2024-09-19T06:16:01.701 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-19T06:16:01.701 INFO:tasks.workunit.client.0.smithi002.stdout: Include close in write timing 2024-09-19T06:16:01.701 INFO:tasks.workunit.client.0.smithi002.stdout: Include fsync in write timing 2024-09-19T06:16:01.701 INFO:tasks.workunit.client.0.smithi002.stdout: File size set to 1048576 kB 2024-09-19T06:16:01.701 INFO:tasks.workunit.client.0.smithi002.stdout: Record Size 16 kB 2024-09-19T06:16:01.701 INFO:tasks.workunit.client.0.smithi002.stdout: Command line used: iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-09-19T06:16:01.701 INFO:tasks.workunit.client.0.smithi002.stdout: Output is in kBytes/sec 2024-09-19T06:16:01.701 INFO:tasks.workunit.client.0.smithi002.stdout: Time Resolution = 0.000001 seconds. 2024-09-19T06:16:01.701 INFO:tasks.workunit.client.0.smithi002.stdout: Processor cache size set to 1024 kBytes. 2024-09-19T06:16:01.701 INFO:tasks.workunit.client.0.smithi002.stdout: Processor cache line size set to 32 bytes. 2024-09-19T06:16:01.701 INFO:tasks.workunit.client.0.smithi002.stdout: File stride size set to 17 * record size. 2024-09-19T06:16:01.701 INFO:tasks.workunit.client.0.smithi002.stdout: Throughput test with 1 process 2024-09-19T06:16:01.701 INFO:tasks.workunit.client.0.smithi002.stdout: Each process writes a 1048576 kByte file in 16 kByte records 2024-09-19T06:16:01.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:01 smithi002 ceph-mon[30982]: pgmap v39: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T06:16:03.489 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:03 smithi090 ceph-mon[34497]: pgmap v40: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T06:16:03.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:03 smithi089 ceph-mon[34160]: pgmap v40: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T06:16:03.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:03 smithi002 ceph-mon[30982]: pgmap v40: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T06:16:05.462 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.457+0000 7f97a7dbd640 1 -- 172.21.15.2:0/954133387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97a01035d0 msgr2=0x7f97a010bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:05.462 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.457+0000 7f97a7dbd640 1 --2- 172.21.15.2:0/954133387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97a01035d0 0x7f97a010bab0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9790009900 tx=0x7f979002a480 comp rx=0 tx=0).stop 2024-09-19T06:16:05.462 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.457+0000 7f97a7dbd640 1 -- 172.21.15.2:0/954133387 shutdown_connections 2024-09-19T06:16:05.462 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.457+0000 7f97a7dbd640 1 --2- 172.21.15.2:0/954133387 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97a010c100 0x7f97a010e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.463 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.457+0000 7f97a7dbd640 1 --2- 172.21.15.2:0/954133387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97a01035d0 0x7f97a010bab0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.463 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.457+0000 7f97a7dbd640 1 --2- 172.21.15.2:0/954133387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97a0102cb0 0x7f97a0103090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.463 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.457+0000 7f97a7dbd640 1 -- 172.21.15.2:0/954133387 >> 172.21.15.2:0/954133387 conn(0x7f97a00fc6e0 msgr2=0x7f97a00feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:05.463 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.457+0000 7f97a7dbd640 1 -- 172.21.15.2:0/954133387 shutdown_connections 2024-09-19T06:16:05.463 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.457+0000 7f97a7dbd640 1 -- 172.21.15.2:0/954133387 wait complete. 2024-09-19T06:16:05.463 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.458+0000 7f97a7dbd640 1 Processor -- start 2024-09-19T06:16:05.463 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.458+0000 7f97a7dbd640 1 -- start start 2024-09-19T06:16:05.463 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.458+0000 7f97a7dbd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97a0102cb0 0x7f97a0198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:05.463 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.458+0000 7f97a7dbd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97a01035d0 0x7f97a0198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:05.463 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.458+0000 7f97a7dbd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97a010c100 0x7f97a019ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:05.464 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.458+0000 7f97a7dbd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f97a0111dd0 con 0x7f97a010c100 2024-09-19T06:16:05.464 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.458+0000 7f97a7dbd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f97a0111c50 con 0x7f97a01035d0 2024-09-19T06:16:05.464 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.458+0000 7f97a7dbd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f97a0111f50 con 0x7f97a0102cb0 2024-09-19T06:16:05.464 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.458+0000 7f97a635a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97a010c100 0x7f97a019ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:05.464 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.458+0000 7f97a5b59640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97a0102cb0 0x7f97a0198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:05.465 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.458+0000 7f97a635a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97a010c100 0x7f97a019ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51018/0 (socket says 172.21.15.2:51018) 2024-09-19T06:16:05.465 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.458+0000 7f97a5b59640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97a0102cb0 0x7f97a0198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:51282/0 (socket says 172.21.15.2:51282) 2024-09-19T06:16:05.465 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.458+0000 7f97a635a640 1 -- 172.21.15.2:0/2124966822 learned_addr learned my addr 172.21.15.2:0/2124966822 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:05.465 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.458+0000 7f97a5358640 1 --2- 172.21.15.2:0/2124966822 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97a01035d0 0x7f97a0198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:05.465 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.458+0000 7f97a635a640 1 -- 172.21.15.2:0/2124966822 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97a0102cb0 msgr2=0x7f97a0198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:05.465 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.458+0000 7f97a635a640 1 --2- 172.21.15.2:0/2124966822 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97a0102cb0 0x7f97a0198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.465 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.458+0000 7f97a635a640 1 -- 172.21.15.2:0/2124966822 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97a01035d0 msgr2=0x7f97a0198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:05.465 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.458+0000 7f97a635a640 1 --2- 172.21.15.2:0/2124966822 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97a01035d0 0x7f97a0198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.466 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.458+0000 7f97a635a640 1 -- 172.21.15.2:0/2124966822 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97a019d400 con 0x7f97a010c100 2024-09-19T06:16:05.466 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.459+0000 7f97a635a640 1 --2- 172.21.15.2:0/2124966822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97a010c100 0x7f97a019ccd0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f979800eaa0 tx=0x7f979800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:05.466 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.459+0000 7f9796ffd640 1 -- 172.21.15.2:0/2124966822 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9798004d20 con 0x7f97a010c100 2024-09-19T06:16:05.466 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.459+0000 7f9796ffd640 1 -- 172.21.15.2:0/2124966822 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9798005020 con 0x7f97a010c100 2024-09-19T06:16:05.466 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.459+0000 7f97a7dbd640 1 -- 172.21.15.2:0/2124966822 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97a019d6f0 con 0x7f97a010c100 2024-09-19T06:16:05.466 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.459+0000 7f9796ffd640 1 -- 172.21.15.2:0/2124966822 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97980116b0 con 0x7f97a010c100 2024-09-19T06:16:05.466 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.459+0000 7f97a7dbd640 1 -- 172.21.15.2:0/2124966822 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97a01a4f80 con 0x7f97a010c100 2024-09-19T06:16:05.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.462+0000 7f97aac33740 1 Processor -- start 2024-09-19T06:16:05.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.462+0000 7f9796ffd640 1 -- 172.21.15.2:0/2124966822 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 24) ==== 138638+0+0 (secure 0 0 0) 0x7f97980051d0 con 0x7f97a010c100 2024-09-19T06:16:05.474 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.463+0000 7f97aac33740 1 -- start start 2024-09-19T06:16:05.474 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.463+0000 7f97aac33740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c84259caf0 0x55c84259ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:05.474 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.463+0000 7f97aac33740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c84259d410 0x55c8425a7770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:05.474 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.463+0000 7f97aac33740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c8425a7cb0 0x55c8425aa0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:05.474 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.463+0000 7f97aac33740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c8425012f0 con 0x55c8425a7cb0 2024-09-19T06:16:05.474 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.463+0000 7f97aac33740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55c8424a9270 con 0x55c84259d410 2024-09-19T06:16:05.474 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.463+0000 7f97aac33740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55c8424fd2b0 con 0x55c84259caf0 2024-09-19T06:16:05.474 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.463+0000 7f97a5358640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c8425a7cb0 0x55c8425aa0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:05.474 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.463+0000 7f97a5358640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c8425a7cb0 0x55c8425aa0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51026/0 (socket says 172.21.15.2:51026) 2024-09-19T06:16:05.474 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.463+0000 7f97a5358640 1 -- 172.21.15.2:0/3143156550 learned_addr learned my addr 172.21.15.2:0/3143156550 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:05.474 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.463+0000 7f97a5358640 1 --2- 172.21.15.2:0/3143156550 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c84259caf0 0x55c84259ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:05.474 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.463+0000 7f97a5b59640 1 --2- 172.21.15.2:0/3143156550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c84259d410 0x55c8425a7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:05.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.463+0000 7f97a5358640 1 -- 172.21.15.2:0/3143156550 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c84259caf0 msgr2=0x55c84259ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:05.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.463+0000 7f97a5358640 1 --2- 172.21.15.2:0/3143156550 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c84259caf0 0x55c84259ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.463+0000 7f97a5358640 1 -- 172.21.15.2:0/3143156550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c84259d410 msgr2=0x55c8425a7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:05.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.463+0000 7f97a5358640 1 --2- 172.21.15.2:0/3143156550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c84259d410 0x55c8425a7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.463+0000 7f97a5358640 1 -- 172.21.15.2:0/3143156550 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8424a8340 con 0x55c8425a7cb0 2024-09-19T06:16:05.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.463+0000 7f97a5b59640 1 --2- 172.21.15.2:0/3143156550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c84259d410 0x55c8425a7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:05.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.464+0000 7f9796ffd640 1 --2- 172.21.15.2:0/2124966822 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f978c0a3560 0x7f978c0a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:05.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.464+0000 7f97a5358640 1 --2- 172.21.15.2:0/3143156550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c8425a7cb0 0x55c8425aa0a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9790032fd0 tx=0x7f9790005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec679b06da4b29a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:05.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.464+0000 7f97a5b59640 1 --2- 172.21.15.2:0/2124966822 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f978c0a3560 0x7f978c0a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:05.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.464+0000 7f9796ffd640 1 -- 172.21.15.2:0/2124966822 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f97980d00b0 con 0x7f97a010c100 2024-09-19T06:16:05.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.464+0000 7f978bfff640 1 -- 172.21.15.2:0/3143156550 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9790035070 con 0x55c8425a7cb0 2024-09-19T06:16:05.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.464+0000 7f978bfff640 1 -- 172.21.15.2:0/3143156550 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9790041860 con 0x55c8425a7cb0 2024-09-19T06:16:05.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.464+0000 7f978bfff640 1 -- 172.21.15.2:0/3143156550 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97900044e0 con 0x55c8425a7cb0 2024-09-19T06:16:05.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.465+0000 7f97aac33740 1 -- 172.21.15.2:0/3143156550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c8425a7cb0 msgr2=0x55c8425aa0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:05.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.465+0000 7f97a5b59640 1 --2- 172.21.15.2:0/2124966822 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f978c0a3560 0x7f978c0a5a20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x55c842599ec0 tx=0x7f979c009110 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:05.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.465+0000 7f97aac33740 1 --2- 172.21.15.2:0/3143156550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c8425a7cb0 0x55c8425aa0a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9790032fd0 tx=0x7f9790005db0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.465+0000 7f97aac33740 1 -- 172.21.15.2:0/3143156550 shutdown_connections 2024-09-19T06:16:05.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.465+0000 7f97aac33740 1 --2- 172.21.15.2:0/3143156550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c8425a7cb0 0x55c8425aa0a0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.465+0000 7f97aac33740 1 --2- 172.21.15.2:0/3143156550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c84259d410 0x55c8425a7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.465+0000 7f97aac33740 1 --2- 172.21.15.2:0/3143156550 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c84259caf0 0x55c84259ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.465+0000 7f97aac33740 1 -- 172.21.15.2:0/3143156550 >> 172.21.15.2:0/3143156550 conn(0x55c842599060 msgr2=0x55c842599440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:05.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.465+0000 7f97aac33740 1 -- 172.21.15.2:0/3143156550 shutdown_connections 2024-09-19T06:16:05.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.465+0000 7f97aac33740 1 -- 172.21.15.2:0/3143156550 wait complete. 2024-09-19T06:16:05.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.465+0000 7f97aac33740 1 -- start start 2024-09-19T06:16:05.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.465+0000 7f97aac33740 1 Processor -- start 2024-09-19T06:16:05.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.466+0000 7f97aac33740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c84259caf0 0x55c8425a4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:05.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.466+0000 7f97aac33740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c84259d410 0x55c8425a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:05.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.466+0000 7f97aac33740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c8425a7cb0 0x55c8425a5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:05.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.466+0000 7f97aac33740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c8425aa880 con 0x55c84259caf0 2024-09-19T06:16:05.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.466+0000 7f97aac33740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55c84248a290 con 0x55c8425a7cb0 2024-09-19T06:16:05.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.466+0000 7f97aac33740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55c8425aaa00 con 0x55c84259d410 2024-09-19T06:16:05.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.466+0000 7f97aac33740 10 client.0 _ll_register_callbacks cb 0x55c8424bb140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:05.478 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.466+0000 7f97a5358640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c84259d410 0x55c8425a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:05.478 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.466+0000 7f97a5358640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c84259d410 0x55c8425a50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:51294/0 (socket says 172.21.15.2:51294) 2024-09-19T06:16:05.478 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.466+0000 7f97a5358640 1 -- 172.21.15.2:0/345677065 learned_addr learned my addr 172.21.15.2:0/345677065 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:05.478 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.466+0000 7f97a5b59640 1 --2- 172.21.15.2:0/345677065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c84259caf0 0x55c8425a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:05.478 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.466+0000 7f97a635a640 1 --2- 172.21.15.2:0/345677065 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c8425a7cb0 0x55c8425a5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:05.478 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.466+0000 7f97a5358640 1 -- 172.21.15.2:0/345677065 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c8425a7cb0 msgr2=0x55c8425a5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:05.478 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.466+0000 7f97a5358640 1 --2- 172.21.15.2:0/345677065 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c8425a7cb0 0x55c8425a5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.478 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.466+0000 7f97a5358640 1 -- 172.21.15.2:0/345677065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c84259caf0 msgr2=0x55c8425a4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:05.478 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.466+0000 7f97a5358640 1 --2- 172.21.15.2:0/345677065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c84259caf0 0x55c8425a4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.478 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.466+0000 7f97a5358640 1 -- 172.21.15.2:0/345677065 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c842214210 con 0x55c84259d410 2024-09-19T06:16:05.478 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.466+0000 7f97a635a640 1 --2- 172.21.15.2:0/345677065 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c8425a7cb0 0x55c8425a5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:16:05.478 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.467+0000 7f97a5358640 1 --2- 172.21.15.2:0/345677065 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c84259d410 0x55c8425a50e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9790031980 tx=0x7f9790005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f0819971d725af7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:05.479 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.467+0000 7f97897fa640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-19T06:16:05.479 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.467+0000 7f97897fa640 1 -- 172.21.15.2:0/345677065 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9790052030 con 0x55c84259d410 2024-09-19T06:16:05.479 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.467+0000 7f97897fa640 1 -- 172.21.15.2:0/345677065 <== mon.1 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f9790031af0 con 0x55c84259d410 2024-09-19T06:16:05.479 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.467+0000 7f97aac33740 1 -- 172.21.15.2:0/345677065 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9790041860 con 0x55c84259d410 2024-09-19T06:16:05.479 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.467+0000 7f97897fa640 1 -- 172.21.15.2:0/345677065 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f979005c050 con 0x55c84259d410 2024-09-19T06:16:05.479 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.467+0000 7f97aac33740 10 client.25183 fetch_fsmap learned FSMap version 26 2024-09-19T06:16:05.479 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.467+0000 7f97aac33740 1 -- 172.21.15.2:0/345677065 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c8422e0620 con 0x55c84259d410 2024-09-19T06:16:05.479 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.467+0000 7f97897fa640 1 -- 172.21.15.2:0/345677065 <== mon.1 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9790041860 con 0x55c84259d410 2024-09-19T06:16:05.479 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.467+0000 7f97897fa640 1 -- 172.21.15.2:0/345677065 <== mon.1 v2:172.21.15.90:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f9790004750 con 0x55c84259d410 2024-09-19T06:16:05.479 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.467+0000 7f97aac33740 10 client.25183 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:16:05.479 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.467+0000 7f97aac33740 10 client.25183 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:05.479 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.467+0000 7f97aac33740 20 client.25183 populate_metadata read hostname 'smithi002' 2024-09-19T06:16:05.479 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.467+0000 7f97aac33740 1 --2- 172.21.15.2:0/345677065 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55c8425b7af0 0x55c8425b9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:05.479 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.467+0000 7f97aac33740 4 client.25183 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:16:05.480 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.467+0000 7f97aac33740 1 -- 172.21.15.2:0/345677065 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c84250ea20 con 0x55c8425b7af0 2024-09-19T06:16:05.480 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.468+0000 7f97a5b59640 1 --2- 172.21.15.2:0/345677065 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55c8425b7af0 0x55c8425b9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:05.480 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.468+0000 7f97897fa640 10 client.25183 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:05.480 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.468+0000 7f97a5b59640 1 --2- 172.21.15.2:0/345677065 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55c8425b7af0 0x55c8425b9ee0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e110978d8c5cf066 server_cookie=78f9733d9e15ce42 in_seq=0 out_seq=0 2024-09-19T06:16:05.480 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.469+0000 7f97897fa640 1 -- 172.21.15.2:0/345677065 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c84250ea20 con 0x55c8425b7af0 2024-09-19T06:16:05.480 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.469+0000 7f97897fa640 10 client.25183 handle_command_reply: tid=0 2024-09-19T06:16:05.480 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.469+0000 7f97aac33740 1 client.25183 shutdown 2024-09-19T06:16:05.480 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.469+0000 7f97aac33740 1 -- 172.21.15.2:0/345677065 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c84259d410 msgr2=0x55c8425a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:05.480 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.469+0000 7f97aac33740 1 --2- 172.21.15.2:0/345677065 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c84259d410 0x55c8425a50e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9790031980 tx=0x7f9790005fd0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.480 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.469+0000 7f97aac33740 1 -- 172.21.15.2:0/345677065 shutdown_connections 2024-09-19T06:16:05.480 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.469+0000 7f97aac33740 1 --2- 172.21.15.2:0/345677065 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55c8425b7af0 0x55c8425b9ee0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.480 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.469+0000 7f97aac33740 1 --2- 172.21.15.2:0/345677065 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c8425a7cb0 0x55c8425a5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.481 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.469+0000 7f97aac33740 1 --2- 172.21.15.2:0/345677065 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c84259d410 0x55c8425a50e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.481 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.469+0000 7f97897fa640 0 client.25183 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:05.481 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.469+0000 7f97aac33740 1 --2- 172.21.15.2:0/345677065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c84259caf0 0x55c8425a4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.481 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.469+0000 7f97aac33740 1 -- 172.21.15.2:0/345677065 >> 172.21.15.2:0/345677065 conn(0x55c842599060 msgr2=0x55c84259ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:05.481 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.469+0000 7f97aac33740 1 -- 172.21.15.2:0/345677065 shutdown_connections 2024-09-19T06:16:05.481 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.469+0000 7f97aac33740 1 -- 172.21.15.2:0/345677065 wait complete. 2024-09-19T06:16:05.481 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.469+0000 7f97aac33740 20 client.25183 trim_cache size 0 max 16384 2024-09-19T06:16:05.495 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.491+0000 7f97aac33740 1 Processor -- start 2024-09-19T06:16:05.495 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.491+0000 7f97aac33740 1 -- start start 2024-09-19T06:16:05.495 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.491+0000 7f97aac33740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c842599060 0x55c8425a3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:05.495 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.491+0000 7f97aac33740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c84259caf0 0x55c8425a5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:05.495 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.491+0000 7f97aac33740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c84259d410 0x55c8425bf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:05.495 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.491+0000 7f97aac33740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f97a01add10 con 0x55c84259caf0 2024-09-19T06:16:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.491+0000 7f97aac33740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f97a01ab5e0 con 0x55c84259d410 2024-09-19T06:16:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.491+0000 7f97aac33740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f97a01a9430 con 0x55c842599060 2024-09-19T06:16:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.491+0000 7f97a5358640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c84259caf0 0x55c8425a5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.491+0000 7f97a5358640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c84259caf0 0x55c8425a5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51046/0 (socket says 172.21.15.2:51046) 2024-09-19T06:16:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.491+0000 7f97a5358640 1 -- 172.21.15.2:0/540928061 learned_addr learned my addr 172.21.15.2:0/540928061 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.492+0000 7f97a5b59640 1 --2- 172.21.15.2:0/540928061 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c842599060 0x55c8425a3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.492+0000 7f97a635a640 1 --2- 172.21.15.2:0/540928061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c84259d410 0x55c8425bf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.492+0000 7f97a5358640 1 -- 172.21.15.2:0/540928061 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c842599060 msgr2=0x55c8425a3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.492+0000 7f97a5358640 1 --2- 172.21.15.2:0/540928061 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c842599060 0x55c8425a3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.492+0000 7f97a5358640 1 -- 172.21.15.2:0/540928061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c84259d410 msgr2=0x55c8425bf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.492+0000 7f97a5358640 1 --2- 172.21.15.2:0/540928061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c84259d410 0x55c8425bf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.492+0000 7f97a5358640 1 -- 172.21.15.2:0/540928061 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c84259d240 con 0x55c84259caf0 2024-09-19T06:16:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.492+0000 7f97a635a640 1 --2- 172.21.15.2:0/540928061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c84259d410 0x55c8425bf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:16:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.492+0000 7f97a5358640 1 --2- 172.21.15.2:0/540928061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c84259caf0 0x55c8425a5450 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f979002a9a0 tx=0x7f9790005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fec76f1f33871515 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.492+0000 7f978b7fe640 1 -- 172.21.15.2:0/540928061 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9790065070 con 0x55c84259caf0 2024-09-19T06:16:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.492+0000 7f978b7fe640 1 -- 172.21.15.2:0/540928061 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f97900048c0 con 0x55c84259caf0 2024-09-19T06:16:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.492+0000 7f978b7fe640 1 -- 172.21.15.2:0/540928061 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9790052040 con 0x55c84259caf0 2024-09-19T06:16:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.493+0000 7f97aac33740 1 -- 172.21.15.2:0/540928061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c84259caf0 msgr2=0x55c8425a5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.493+0000 7f97aac33740 1 --2- 172.21.15.2:0/540928061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c84259caf0 0x55c8425a5450 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f979002a9a0 tx=0x7f9790005db0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.493+0000 7f97aac33740 1 -- 172.21.15.2:0/540928061 shutdown_connections 2024-09-19T06:16:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.493+0000 7f97aac33740 1 --2- 172.21.15.2:0/540928061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c84259d410 0x55c8425bf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.493+0000 7f97aac33740 1 --2- 172.21.15.2:0/540928061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c84259caf0 0x55c8425a5450 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.498 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.493+0000 7f97aac33740 1 --2- 172.21.15.2:0/540928061 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c842599060 0x55c8425a3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.498 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.493+0000 7f97aac33740 1 -- 172.21.15.2:0/540928061 >> 172.21.15.2:0/540928061 conn(0x55c8425a7030 msgr2=0x55c8425981c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:05.498 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.493+0000 7f97aac33740 1 -- 172.21.15.2:0/540928061 shutdown_connections 2024-09-19T06:16:05.498 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.493+0000 7f97aac33740 1 -- 172.21.15.2:0/540928061 wait complete. 2024-09-19T06:16:05.498 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.494+0000 7f97aac33740 1 -- start start 2024-09-19T06:16:05.498 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.494+0000 7f97aac33740 1 Processor -- start 2024-09-19T06:16:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.494+0000 7f97aac33740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c842599060 0x55c8425a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.494+0000 7f97aac33740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c84259caf0 0x55c8425a2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.494+0000 7f97aac33740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c84259d410 0x55c8425a2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.494+0000 7f97aac33740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f97a01a9aa0 con 0x55c84259d410 2024-09-19T06:16:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.494+0000 7f97aac33740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f97a01aaf10 con 0x55c842599060 2024-09-19T06:16:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.494+0000 7f97aac33740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f97a01aa170 con 0x55c84259caf0 2024-09-19T06:16:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.494+0000 7f97aac33740 10 client.0 _ll_register_callbacks cb 0x7f979c0093c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.494+0000 7f97a635a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c84259d410 0x55c8425a2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:05.504 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.494+0000 7f97a635a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c84259d410 0x55c8425a2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51056/0 (socket says 172.21.15.2:51056) 2024-09-19T06:16:05.504 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.494+0000 7f97a635a640 1 -- 172.21.15.2:0/82061752 learned_addr learned my addr 172.21.15.2:0/82061752 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:05.504 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.494+0000 7f97a5358640 1 --2- 172.21.15.2:0/82061752 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c84259caf0 0x55c8425a2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:05.504 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.495+0000 7f97a5b59640 1 --2- 172.21.15.2:0/82061752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c842599060 0x55c8425a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:05.504 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.495+0000 7f97a635a640 1 -- 172.21.15.2:0/82061752 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c84259caf0 msgr2=0x55c8425a2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:05.504 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.495+0000 7f97a635a640 1 --2- 172.21.15.2:0/82061752 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c84259caf0 0x55c8425a2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.504 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.495+0000 7f97a635a640 1 -- 172.21.15.2:0/82061752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c842599060 msgr2=0x55c8425a1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:05.505 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.495+0000 7f97a635a640 1 --2- 172.21.15.2:0/82061752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c842599060 0x55c8425a1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.505 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.495+0000 7f97a635a640 1 -- 172.21.15.2:0/82061752 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8426214b0 con 0x55c84259d410 2024-09-19T06:16:05.505 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.495+0000 7f97a635a640 1 --2- 172.21.15.2:0/82061752 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c84259d410 0x55c8425a2570 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f97980cd780 tx=0x7f979809be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79d5401fd776ae77 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:05.505 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.495+0000 7f97897fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:16:05.505 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.495+0000 7f97897fa640 1 -- 172.21.15.2:0/82061752 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97980b4020 con 0x55c84259d410 2024-09-19T06:16:05.505 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.495+0000 7f97897fa640 1 -- 172.21.15.2:0/82061752 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f97980a00d0 con 0x55c84259d410 2024-09-19T06:16:05.505 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.495+0000 7f97aac33740 1 -- 172.21.15.2:0/82061752 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97900048c0 con 0x55c84259d410 2024-09-19T06:16:05.505 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.496+0000 7f97897fa640 1 -- 172.21.15.2:0/82061752 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f979801f040 con 0x55c84259d410 2024-09-19T06:16:05.506 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.496+0000 7f97aac33740 10 client.15552 fetch_fsmap learned FSMap version 26 2024-09-19T06:16:05.506 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.496+0000 7f97aac33740 1 -- 172.21.15.2:0/82061752 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c8426227d0 con 0x55c84259d410 2024-09-19T06:16:05.506 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.496+0000 7f97897fa640 1 -- 172.21.15.2:0/82061752 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f97900048c0 con 0x55c84259d410 2024-09-19T06:16:05.506 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.496+0000 7f97897fa640 1 -- 172.21.15.2:0/82061752 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f979800f040 con 0x55c84259d410 2024-09-19T06:16:05.506 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.496+0000 7f97aac33740 10 client.15552 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:16:05.506 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.496+0000 7f97aac33740 10 client.15552 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:05.506 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.496+0000 7f97aac33740 20 client.15552 populate_metadata read hostname 'smithi002' 2024-09-19T06:16:05.506 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.496+0000 7f97aac33740 1 --2- 172.21.15.2:0/82061752 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55c8425a7cb0 0x55c842624f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:05.506 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.496+0000 7f97aac33740 4 client.15552 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:16:05.506 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.496+0000 7f97aac33740 1 -- 172.21.15.2:0/82061752 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c842508d70 con 0x55c8425a7cb0 2024-09-19T06:16:05.506 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.497+0000 7f97a5b59640 1 --2- 172.21.15.2:0/82061752 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55c8425a7cb0 0x55c842624f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:05.507 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.497+0000 7f97a5b59640 1 --2- 172.21.15.2:0/82061752 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55c8425a7cb0 0x55c842624f80 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9279e90ab9a81f8 server_cookie=53663619e93c4da9 in_seq=0 out_seq=0 2024-09-19T06:16:05.507 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.497+0000 7f97897fa640 10 client.15552 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:05.512 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.510+0000 7f97897fa640 1 -- 172.21.15.2:0/82061752 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c842508d70 con 0x55c8425a7cb0 2024-09-19T06:16:05.512 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.510+0000 7f97897fa640 10 client.15552 handle_command_reply: tid=0 2024-09-19T06:16:05.513 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.510+0000 7f97aac33740 1 client.15552 shutdown 2024-09-19T06:16:05.513 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.510+0000 7f97aac33740 1 -- 172.21.15.2:0/82061752 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c84259d410 msgr2=0x55c8425a2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:05.513 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.510+0000 7f97aac33740 1 --2- 172.21.15.2:0/82061752 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c84259d410 0x55c8425a2570 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f97980cd780 tx=0x7f979809be70 comp rx=0 tx=0).stop 2024-09-19T06:16:05.513 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.510+0000 7f97aac33740 1 -- 172.21.15.2:0/82061752 shutdown_connections 2024-09-19T06:16:05.513 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.510+0000 7f97aac33740 1 --2- 172.21.15.2:0/82061752 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c84259d410 0x55c8425a2570 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.513 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.510+0000 7f97aac33740 1 --2- 172.21.15.2:0/82061752 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c84259caf0 0x55c8425a2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.513 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.510+0000 7f97aac33740 1 --2- 172.21.15.2:0/82061752 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55c8425a7cb0 0x55c842624f80 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.513 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.510+0000 7f97aac33740 1 --2- 172.21.15.2:0/82061752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c842599060 0x55c8425a1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.513 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.510+0000 7f97897fa640 0 client.15552 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:05.513 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.510+0000 7f97aac33740 1 -- 172.21.15.2:0/82061752 >> 172.21.15.2:0/82061752 conn(0x55c8425a7030 msgr2=0x55c8425979a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:05.513 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.511+0000 7f97aac33740 1 -- 172.21.15.2:0/82061752 shutdown_connections 2024-09-19T06:16:05.513 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.511+0000 7f97aac33740 1 -- 172.21.15.2:0/82061752 wait complete. 2024-09-19T06:16:05.514 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.511+0000 7f97aac33740 20 client.15552 trim_cache size 0 max 16384 2024-09-19T06:16:05.514 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-19T06:16:05.514 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-19T06:16:05.514 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-19T06:16:05.514 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-19T06:16:05.515 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.511+0000 7f97a7dbd640 1 -- 172.21.15.2:0/2124966822 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f978c0a3560 msgr2=0x7f978c0a5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:05.515 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.511+0000 7f97a7dbd640 1 --2- 172.21.15.2:0/2124966822 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f978c0a3560 0x7f978c0a5a20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x55c842599ec0 tx=0x7f979c009110 comp rx=0 tx=0).stop 2024-09-19T06:16:05.515 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.511+0000 7f97a7dbd640 1 -- 172.21.15.2:0/2124966822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97a010c100 msgr2=0x7f97a019ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:05.515 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.511+0000 7f97a7dbd640 1 --2- 172.21.15.2:0/2124966822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97a010c100 0x7f97a019ccd0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f979800eaa0 tx=0x7f979800eea0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.515 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.511+0000 7f97a7dbd640 1 -- 172.21.15.2:0/2124966822 shutdown_connections 2024-09-19T06:16:05.515 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.511+0000 7f97a7dbd640 1 --2- 172.21.15.2:0/2124966822 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f978c0a3560 0x7f978c0a5a20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.515 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.511+0000 7f97a7dbd640 1 --2- 172.21.15.2:0/2124966822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97a010c100 0x7f97a019ccd0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.515 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.511+0000 7f97a7dbd640 1 --2- 172.21.15.2:0/2124966822 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97a01035d0 0x7f97a0198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.515 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.511+0000 7f97a7dbd640 1 --2- 172.21.15.2:0/2124966822 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97a0102cb0 0x7f97a0198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.515 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.511+0000 7f97a7dbd640 1 -- 172.21.15.2:0/2124966822 >> 172.21.15.2:0/2124966822 conn(0x7f97a00fc6e0 msgr2=0x7f97a00fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:05.515 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.512+0000 7f97a7dbd640 1 -- 172.21.15.2:0/2124966822 shutdown_connections 2024-09-19T06:16:05.516 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:05.512+0000 7f97a7dbd640 1 -- 172.21.15.2:0/2124966822 wait complete. 2024-09-19T06:16:05.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:05 smithi089 ceph-mon[34160]: pgmap v41: 97 pgs: 97 active+clean; 217 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 28 op/s 2024-09-19T06:16:05.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:05 smithi002 ceph-mon[30982]: pgmap v41: 97 pgs: 97 active+clean; 217 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 28 op/s 2024-09-19T06:16:05.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:05 smithi090 ceph-mon[34497]: pgmap v41: 97 pgs: 97 active+clean; 217 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 28 op/s 2024-09-19T06:16:07.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:07 smithi089 ceph-mon[34160]: pgmap v42: 97 pgs: 97 active+clean; 225 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 26 op/s 2024-09-19T06:16:07.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:07 smithi002 ceph-mon[30982]: pgmap v42: 97 pgs: 97 active+clean; 225 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 26 op/s 2024-09-19T06:16:07.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:07 smithi090 ceph-mon[34497]: pgmap v42: 97 pgs: 97 active+clean; 225 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 26 op/s 2024-09-19T06:16:09.523 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:09 smithi002 ceph-mon[30982]: pgmap v43: 97 pgs: 97 active+clean; 225 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 25 op/s 2024-09-19T06:16:09.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:09 smithi089 ceph-mon[34160]: pgmap v43: 97 pgs: 97 active+clean; 225 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 25 op/s 2024-09-19T06:16:09.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:09 smithi090 ceph-mon[34497]: pgmap v43: 97 pgs: 97 active+clean; 225 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 25 op/s 2024-09-19T06:16:11.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:11 smithi002 ceph-mon[30982]: pgmap v44: 97 pgs: 97 active+clean; 753 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 63 MiB/s wr, 42 op/s 2024-09-19T06:16:11.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:11 smithi089 ceph-mon[34160]: pgmap v44: 97 pgs: 97 active+clean; 753 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 63 MiB/s wr, 42 op/s 2024-09-19T06:16:11.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:11 smithi090 ceph-mon[34497]: pgmap v44: 97 pgs: 97 active+clean; 753 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 63 MiB/s wr, 42 op/s 2024-09-19T06:16:11.785 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-19T06:16:11.785 INFO:tasks.workunit.client.0.smithi002.stdout: Children see throughput for 1 initial writers = 103995.34 kB/sec 2024-09-19T06:16:11.785 INFO:tasks.workunit.client.0.smithi002.stdout: Parent sees throughput for 1 initial writers = 103993.24 kB/sec 2024-09-19T06:16:11.785 INFO:tasks.workunit.client.0.smithi002.stdout: Min throughput per process = 103995.34 kB/sec 2024-09-19T06:16:11.785 INFO:tasks.workunit.client.0.smithi002.stdout: Max throughput per process = 103995.34 kB/sec 2024-09-19T06:16:11.785 INFO:tasks.workunit.client.0.smithi002.stdout: Avg throughput per process = 103995.34 kB/sec 2024-09-19T06:16:11.785 INFO:tasks.workunit.client.0.smithi002.stdout: Min xfer = 1048576.00 kB 2024-09-19T06:16:12.776 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:16:13.047 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:16:13.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:13 smithi002 ceph-mon[30982]: pgmap v45: 97 pgs: 97 active+clean; 753 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 63 MiB/s wr, 40 op/s 2024-09-19T06:16:13.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:13 smithi089 ceph-mon[34160]: pgmap v45: 97 pgs: 97 active+clean; 753 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 63 MiB/s wr, 40 op/s 2024-09-19T06:16:13.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:13 smithi090 ceph-mon[34497]: pgmap v45: 97 pgs: 97 active+clean; 753 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 63 MiB/s wr, 40 op/s 2024-09-19T06:16:15.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:15 smithi089 ceph-mon[34160]: pgmap v46: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 85 MiB/s wr, 48 op/s 2024-09-19T06:16:15.636 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:15 smithi002 ceph-mon[30982]: pgmap v46: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 85 MiB/s wr, 48 op/s 2024-09-19T06:16:15.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:15 smithi090 ceph-mon[34497]: pgmap v46: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 85 MiB/s wr, 48 op/s 2024-09-19T06:16:15.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.847+0000 7fdc16649640 1 -- 172.21.15.2:0/3186033363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc10106f10 msgr2=0x7fdc1010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:15.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.847+0000 7fdc16649640 1 --2- 172.21.15.2:0/3186033363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc10106f10 0x7fdc1010ea90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fdc08009ca0 tx=0x7fdc0802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:16:15.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.847+0000 7fdc16649640 1 -- 172.21.15.2:0/3186033363 shutdown_connections 2024-09-19T06:16:15.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.847+0000 7fdc16649640 1 --2- 172.21.15.2:0/3186033363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc10106f10 0x7fdc1010ea90 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:15.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.847+0000 7fdc16649640 1 --2- 172.21.15.2:0/3186033363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc10102790 0x7fdc101067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:15.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.847+0000 7fdc16649640 1 --2- 172.21.15.2:0/3186033363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc10101de0 0x7fdc101021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:15.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.847+0000 7fdc16649640 1 -- 172.21.15.2:0/3186033363 >> 172.21.15.2:0/3186033363 conn(0x7fdc100fd8c0 msgr2=0x7fdc100ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:15.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.847+0000 7fdc16649640 1 -- 172.21.15.2:0/3186033363 shutdown_connections 2024-09-19T06:16:15.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.847+0000 7fdc16649640 1 -- 172.21.15.2:0/3186033363 wait complete. 2024-09-19T06:16:15.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.848+0000 7fdc16649640 1 Processor -- start 2024-09-19T06:16:15.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.848+0000 7fdc16649640 1 -- start start 2024-09-19T06:16:15.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.848+0000 7fdc16649640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc10101de0 0x7fdc101a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:15.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.848+0000 7fdc16649640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc10102790 0x7fdc101a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:15.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.848+0000 7fdc16649640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc10106f10 0x7fdc1019e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:15.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.848+0000 7fdc16649640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdc10076350 con 0x7fdc10102790 2024-09-19T06:16:15.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.848+0000 7fdc16649640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fdc100761d0 con 0x7fdc10101de0 2024-09-19T06:16:15.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.848+0000 7fdc16649640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdc10118720 con 0x7fdc10106f10 2024-09-19T06:16:15.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.848+0000 7fdc0f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc10102790 0x7fdc101a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:15.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.849+0000 7fdc0f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc10102790 0x7fdc101a4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37074/0 (socket says 172.21.15.2:37074) 2024-09-19T06:16:15.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.849+0000 7fdc0f7fe640 1 -- 172.21.15.2:0/2614962997 learned_addr learned my addr 172.21.15.2:0/2614962997 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:15.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.849+0000 7fdc0ffff640 1 --2- 172.21.15.2:0/2614962997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc10101de0 0x7fdc101a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:15.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.849+0000 7fdc14be6640 1 --2- 172.21.15.2:0/2614962997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc10106f10 0x7fdc1019e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:15.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.849+0000 7fdc0f7fe640 1 -- 172.21.15.2:0/2614962997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc10106f10 msgr2=0x7fdc1019e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:15.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.849+0000 7fdc0f7fe640 1 --2- 172.21.15.2:0/2614962997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc10106f10 0x7fdc1019e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:15.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.849+0000 7fdc0f7fe640 1 -- 172.21.15.2:0/2614962997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc10101de0 msgr2=0x7fdc101a46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:15.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.849+0000 7fdc0f7fe640 1 --2- 172.21.15.2:0/2614962997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc10101de0 0x7fdc101a46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:15.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.849+0000 7fdc0f7fe640 1 -- 172.21.15.2:0/2614962997 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc1019efd0 con 0x7fdc10102790 2024-09-19T06:16:15.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.849+0000 7fdc0f7fe640 1 --2- 172.21.15.2:0/2614962997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc10102790 0x7fdc101a4bf0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fdc0400c890 tx=0x7fdc0400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:15.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.849+0000 7fdc0d7fa640 1 -- 172.21.15.2:0/2614962997 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc04004220 con 0x7fdc10102790 2024-09-19T06:16:15.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.849+0000 7fdc0d7fa640 1 -- 172.21.15.2:0/2614962997 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdc040043c0 con 0x7fdc10102790 2024-09-19T06:16:15.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.849+0000 7fdc16649640 1 -- 172.21.15.2:0/2614962997 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc1019f2c0 con 0x7fdc10102790 2024-09-19T06:16:15.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.849+0000 7fdc0d7fa640 1 -- 172.21.15.2:0/2614962997 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc04004a00 con 0x7fdc10102790 2024-09-19T06:16:15.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.849+0000 7fdc16649640 1 -- 172.21.15.2:0/2614962997 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc101ab510 con 0x7fdc10102790 2024-09-19T06:16:15.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.852+0000 7fdc0d7fa640 1 -- 172.21.15.2:0/2614962997 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 24) ==== 138638+0+0 (secure 0 0 0) 0x7fdc040079b0 con 0x7fdc10102790 2024-09-19T06:16:15.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.852+0000 7fdc18a22740 1 Processor -- start 2024-09-19T06:16:15.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.852+0000 7fdc18a22740 1 -- start start 2024-09-19T06:16:15.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.852+0000 7fdc18a22740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562cde9e14a0 0x562cde9e1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:15.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.852+0000 7fdc18a22740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562cde9e1dc0 0x562cde9ec140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:15.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.852+0000 7fdc18a22740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cde9ec680 0x562cde9eea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:15.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.852+0000 7fdc18a22740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562cde9472e0 con 0x562cde9e1dc0 2024-09-19T06:16:15.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.852+0000 7fdc18a22740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562cde8eece0 con 0x562cde9e14a0 2024-09-19T06:16:15.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.852+0000 7fdc18a22740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562cde9432a0 con 0x562cde9ec680 2024-09-19T06:16:15.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.852+0000 7fdc0ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562cde9e1dc0 0x562cde9ec140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:15.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.853+0000 7fdc0ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562cde9e1dc0 0x562cde9ec140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37078/0 (socket says 172.21.15.2:37078) 2024-09-19T06:16:15.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.853+0000 7fdc0ffff640 1 -- 172.21.15.2:0/2432384390 learned_addr learned my addr 172.21.15.2:0/2432384390 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:15.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.853+0000 7fdc0d7fa640 1 --2- 172.21.15.2:0/2614962997 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fdbf80a35d0 0x7fdbf80a5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:15.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.853+0000 7fdc14be6640 1 --2- 172.21.15.2:0/2432384390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562cde9e14a0 0x562cde9e1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:15.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.853+0000 7fdc14be6640 1 --2- 172.21.15.2:0/2614962997 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fdbf80a35d0 0x7fdbf80a5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:15.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.853+0000 7fdc0ffff640 1 -- 172.21.15.2:0/2432384390 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cde9ec680 msgr2=0x562cde9eea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:15.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.853+0000 7fdc0f7fe640 1 --2- 172.21.15.2:0/2432384390 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cde9ec680 0x562cde9eea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:15.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.853+0000 7fdc0d7fa640 1 -- 172.21.15.2:0/2614962997 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fdc040cfb40 con 0x7fdc10102790 2024-09-19T06:16:15.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.853+0000 7fdc0ffff640 1 --2- 172.21.15.2:0/2432384390 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cde9ec680 0x562cde9eea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:15.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.853+0000 7fdc0ffff640 1 -- 172.21.15.2:0/2432384390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562cde9e14a0 msgr2=0x562cde9e1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:15.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.853+0000 7fdc0ffff640 1 --2- 172.21.15.2:0/2432384390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562cde9e14a0 0x562cde9e1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:15.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.853+0000 7fdc0ffff640 1 -- 172.21.15.2:0/2432384390 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cde8d3440 con 0x562cde9e1dc0 2024-09-19T06:16:15.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.853+0000 7fdc0f7fe640 1 --2- 172.21.15.2:0/2432384390 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cde9ec680 0x562cde9eea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:16:15.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.853+0000 7fdc14be6640 1 --2- 172.21.15.2:0/2432384390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562cde9e14a0 0x562cde9e1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:16:15.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.853+0000 7fdc0ffff640 1 --2- 172.21.15.2:0/2432384390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562cde9e1dc0 0x562cde9ec140 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fdc00009a70 tx=0x7fdc00009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f10cd80943a646 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:15.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.853+0000 7fdc14be6640 1 --2- 172.21.15.2:0/2614962997 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fdbf80a35d0 0x7fdbf80a5a90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdc08005fe0 tx=0x7fdc08009360 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:15.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.853+0000 7fdbf67fc640 1 -- 172.21.15.2:0/2432384390 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc00017070 con 0x562cde9e1dc0 2024-09-19T06:16:15.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.854+0000 7fdbf67fc640 1 -- 172.21.15.2:0/2432384390 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdc00013470 con 0x562cde9e1dc0 2024-09-19T06:16:15.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.854+0000 7fdbf67fc640 1 -- 172.21.15.2:0/2432384390 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc00012630 con 0x562cde9e1dc0 2024-09-19T06:16:15.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.854+0000 7fdc18a22740 1 -- 172.21.15.2:0/2432384390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562cde9e1dc0 msgr2=0x562cde9ec140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:15.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.854+0000 7fdc18a22740 1 --2- 172.21.15.2:0/2432384390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562cde9e1dc0 0x562cde9ec140 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fdc00009a70 tx=0x7fdc00009f30 comp rx=0 tx=0).stop 2024-09-19T06:16:15.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.855+0000 7fdc18a22740 1 -- 172.21.15.2:0/2432384390 shutdown_connections 2024-09-19T06:16:15.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.855+0000 7fdc18a22740 1 --2- 172.21.15.2:0/2432384390 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cde9ec680 0x562cde9eea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:15.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.855+0000 7fdc18a22740 1 --2- 172.21.15.2:0/2432384390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562cde9e1dc0 0x562cde9ec140 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:15.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.855+0000 7fdc18a22740 1 --2- 172.21.15.2:0/2432384390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562cde9e14a0 0x562cde9e1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:15.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.855+0000 7fdc18a22740 1 -- 172.21.15.2:0/2432384390 >> 172.21.15.2:0/2432384390 conn(0x562cde9dda30 msgr2=0x562cde9dde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:15.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.855+0000 7fdc18a22740 1 -- 172.21.15.2:0/2432384390 shutdown_connections 2024-09-19T06:16:15.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.855+0000 7fdc18a22740 1 -- 172.21.15.2:0/2432384390 wait complete. 2024-09-19T06:16:15.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.855+0000 7fdc18a22740 1 -- start start 2024-09-19T06:16:15.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.855+0000 7fdc18a22740 1 Processor -- start 2024-09-19T06:16:15.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.855+0000 7fdc18a22740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562cde9e14a0 0x562cde9ebed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:15.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.855+0000 7fdc18a22740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cde9e1dc0 0x562cde9e9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:15.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.855+0000 7fdc18a22740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562cde9ec680 0x562cde9e96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:15.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.855+0000 7fdc18a22740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562cde9ef250 con 0x562cde9e14a0 2024-09-19T06:16:15.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.855+0000 7fdc18a22740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562cde902050 con 0x562cde9ec680 2024-09-19T06:16:15.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.855+0000 7fdc18a22740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562cde9ef3d0 con 0x562cde9e1dc0 2024-09-19T06:16:15.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.856+0000 7fdc18a22740 10 client.0 _ll_register_callbacks cb 0x562cde942160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:15.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.856+0000 7fdc0ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562cde9e14a0 0x562cde9ebed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:15.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.856+0000 7fdc0ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562cde9e14a0 0x562cde9ebed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37080/0 (socket says 172.21.15.2:37080) 2024-09-19T06:16:15.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.856+0000 7fdc0ffff640 1 -- 172.21.15.2:0/803243772 learned_addr learned my addr 172.21.15.2:0/803243772 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:15.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.856+0000 7fdc14be6640 1 --2- 172.21.15.2:0/803243772 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562cde9ec680 0x562cde9e96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:15.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.856+0000 7fdc0f7fe640 1 --2- 172.21.15.2:0/803243772 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cde9e1dc0 0x562cde9e9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:15.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.856+0000 7fdc0ffff640 1 -- 172.21.15.2:0/803243772 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cde9e1dc0 msgr2=0x562cde9e9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:15.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.856+0000 7fdc0ffff640 1 --2- 172.21.15.2:0/803243772 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cde9e1dc0 0x562cde9e9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:15.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.856+0000 7fdc0ffff640 1 -- 172.21.15.2:0/803243772 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562cde9ec680 msgr2=0x562cde9e96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:15.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.856+0000 7fdc0ffff640 1 --2- 172.21.15.2:0/803243772 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562cde9ec680 0x562cde9e96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:15.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.856+0000 7fdc0ffff640 1 -- 172.21.15.2:0/803243772 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cde6b83c0 con 0x562cde9e14a0 2024-09-19T06:16:15.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.856+0000 7fdc0f7fe640 1 --2- 172.21.15.2:0/803243772 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cde9e1dc0 0x562cde9e9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:16:15.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.856+0000 7fdc0ffff640 1 --2- 172.21.15.2:0/803243772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562cde9e14a0 0x562cde9ebed0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fdc00004810 tx=0x7fdc0000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=306c379a5fbcd721 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:15.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.856+0000 7fdbef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:16:15.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.856+0000 7fdbef7fe640 1 -- 172.21.15.2:0/803243772 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc00017050 con 0x562cde9e14a0 2024-09-19T06:16:15.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.856+0000 7fdbef7fe640 1 -- 172.21.15.2:0/803243772 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fdc0001c450 con 0x562cde9e14a0 2024-09-19T06:16:15.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.856+0000 7fdc18a22740 1 -- 172.21.15.2:0/803243772 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc00013470 con 0x562cde9e14a0 2024-09-19T06:16:15.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.857+0000 7fdbef7fe640 1 -- 172.21.15.2:0/803243772 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdc0001c650 con 0x562cde9e14a0 2024-09-19T06:16:15.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.857+0000 7fdc18a22740 10 client.15564 fetch_fsmap learned FSMap version 26 2024-09-19T06:16:15.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.857+0000 7fdc18a22740 1 -- 172.21.15.2:0/803243772 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562cde9faac0 con 0x562cde9e14a0 2024-09-19T06:16:15.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.857+0000 7fdbef7fe640 1 -- 172.21.15.2:0/803243772 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdc00013470 con 0x562cde9e14a0 2024-09-19T06:16:15.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.857+0000 7fdbef7fe640 1 -- 172.21.15.2:0/803243772 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fdc0002e840 con 0x562cde9e14a0 2024-09-19T06:16:15.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.857+0000 7fdc18a22740 10 client.15564 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:16:15.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.857+0000 7fdc18a22740 10 client.15564 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:15.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.857+0000 7fdc18a22740 20 client.15564 populate_metadata read hostname 'smithi002' 2024-09-19T06:16:15.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.857+0000 7fdc18a22740 1 --2- 172.21.15.2:0/803243772 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562cde9fbf80 0x562cde9fe370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:15.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.857+0000 7fdc18a22740 4 client.15564 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:16:15.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.857+0000 7fdc18a22740 1 -- 172.21.15.2:0/803243772 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562cde954850 con 0x562cde9fbf80 2024-09-19T06:16:15.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.858+0000 7fdc0f7fe640 1 --2- 172.21.15.2:0/803243772 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562cde9fbf80 0x562cde9fe370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:15.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.858+0000 7fdbef7fe640 10 client.15564 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:15.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.858+0000 7fdc0f7fe640 1 --2- 172.21.15.2:0/803243772 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562cde9fbf80 0x562cde9fe370 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e7725cd26ca2b57 server_cookie=cb07030b4698e2ec in_seq=0 out_seq=0 2024-09-19T06:16:15.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.859+0000 7fdbef7fe640 1 -- 172.21.15.2:0/803243772 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562cde954850 con 0x562cde9fbf80 2024-09-19T06:16:15.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.859+0000 7fdbef7fe640 10 client.15564 handle_command_reply: tid=0 2024-09-19T06:16:15.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.859+0000 7fdc18a22740 1 client.15564 shutdown 2024-09-19T06:16:15.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.859+0000 7fdc18a22740 1 -- 172.21.15.2:0/803243772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562cde9e14a0 msgr2=0x562cde9ebed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:15.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.859+0000 7fdc18a22740 1 --2- 172.21.15.2:0/803243772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562cde9e14a0 0x562cde9ebed0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fdc00004810 tx=0x7fdc0000ed70 comp rx=0 tx=0).stop 2024-09-19T06:16:15.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.859+0000 7fdc18a22740 1 -- 172.21.15.2:0/803243772 shutdown_connections 2024-09-19T06:16:15.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.859+0000 7fdc18a22740 1 --2- 172.21.15.2:0/803243772 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562cde9fbf80 0x562cde9fe370 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:15.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.859+0000 7fdc18a22740 1 --2- 172.21.15.2:0/803243772 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562cde9ec680 0x562cde9e96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:15.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.859+0000 7fdc18a22740 1 --2- 172.21.15.2:0/803243772 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cde9e1dc0 0x562cde9e9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:15.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.859+0000 7fdbef7fe640 0 client.15564 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:15.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.859+0000 7fdc18a22740 1 --2- 172.21.15.2:0/803243772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562cde9e14a0 0x562cde9ebed0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:15.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.859+0000 7fdc18a22740 1 -- 172.21.15.2:0/803243772 >> 172.21.15.2:0/803243772 conn(0x562cde9dda30 msgr2=0x562cde9dcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:15.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.859+0000 7fdc18a22740 1 -- 172.21.15.2:0/803243772 shutdown_connections 2024-09-19T06:16:15.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.859+0000 7fdc18a22740 1 -- 172.21.15.2:0/803243772 wait complete. 2024-09-19T06:16:15.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.859+0000 7fdc18a22740 20 client.15564 trim_cache size 0 max 16384 2024-09-19T06:16:15.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.876+0000 7fdc18a22740 1 Processor -- start 2024-09-19T06:16:15.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.876+0000 7fdc18a22740 1 -- start start 2024-09-19T06:16:15.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.877+0000 7fdc18a22740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562cde9e14a0 0x562cde9f84e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:15.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.877+0000 7fdc18a22740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cde9e1dc0 0x562cde9e8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:15.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.877+0000 7fdc18a22740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562cde9ec680 0x562cdea039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:15.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.877+0000 7fdc18a22740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdc101b66c0 con 0x562cde9ec680 2024-09-19T06:16:15.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.877+0000 7fdc18a22740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fdc101b3f90 con 0x562cde9e14a0 2024-09-19T06:16:15.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.877+0000 7fdc18a22740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdc101b1de0 con 0x562cde9e1dc0 2024-09-19T06:16:15.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.877+0000 7fdc14be6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562cde9ec680 0x562cdea039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:15.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.877+0000 7fdc14be6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562cde9ec680 0x562cdea039a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37084/0 (socket says 172.21.15.2:37084) 2024-09-19T06:16:15.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.877+0000 7fdc14be6640 1 -- 172.21.15.2:0/1260917765 learned_addr learned my addr 172.21.15.2:0/1260917765 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:15.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.877+0000 7fdc0ffff640 1 --2- 172.21.15.2:0/1260917765 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562cde9e14a0 0x562cde9f84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:15.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.877+0000 7fdc0f7fe640 1 --2- 172.21.15.2:0/1260917765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cde9e1dc0 0x562cde9e8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:15.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.877+0000 7fdc14be6640 1 -- 172.21.15.2:0/1260917765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cde9e1dc0 msgr2=0x562cde9e8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:15.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.877+0000 7fdc14be6640 1 --2- 172.21.15.2:0/1260917765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cde9e1dc0 0x562cde9e8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:15.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.877+0000 7fdc14be6640 1 -- 172.21.15.2:0/1260917765 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562cde9e14a0 msgr2=0x562cde9f84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:15.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.877+0000 7fdc14be6640 1 --2- 172.21.15.2:0/1260917765 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562cde9e14a0 0x562cde9f84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:15.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.877+0000 7fdc14be6640 1 -- 172.21.15.2:0/1260917765 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cde9dd860 con 0x562cde9ec680 2024-09-19T06:16:15.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.877+0000 7fdc14be6640 1 --2- 172.21.15.2:0/1260917765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562cde9ec680 0x562cdea039a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fdc08009ca0 tx=0x7fdc080093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=930f573bdc154dbc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:15.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.877+0000 7fdbf5ffb640 1 -- 172.21.15.2:0/1260917765 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc08050070 con 0x562cde9ec680 2024-09-19T06:16:15.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.877+0000 7fdbf5ffb640 1 -- 172.21.15.2:0/1260917765 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdc08036070 con 0x562cde9ec680 2024-09-19T06:16:15.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.877+0000 7fdbf5ffb640 1 -- 172.21.15.2:0/1260917765 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc08030a90 con 0x562cde9ec680 2024-09-19T06:16:15.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.878+0000 7fdc18a22740 1 -- 172.21.15.2:0/1260917765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562cde9ec680 msgr2=0x562cdea039a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:15.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.878+0000 7fdc18a22740 1 --2- 172.21.15.2:0/1260917765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562cde9ec680 0x562cdea039a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fdc08009ca0 tx=0x7fdc080093d0 comp rx=0 tx=0).stop 2024-09-19T06:16:15.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.878+0000 7fdc18a22740 1 -- 172.21.15.2:0/1260917765 shutdown_connections 2024-09-19T06:16:15.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.878+0000 7fdc18a22740 1 --2- 172.21.15.2:0/1260917765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562cde9ec680 0x562cdea039a0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:15.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.878+0000 7fdc18a22740 1 --2- 172.21.15.2:0/1260917765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cde9e1dc0 0x562cde9e8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:15.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.878+0000 7fdc18a22740 1 --2- 172.21.15.2:0/1260917765 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562cde9e14a0 0x562cde9f84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:15.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.878+0000 7fdc18a22740 1 -- 172.21.15.2:0/1260917765 >> 172.21.15.2:0/1260917765 conn(0x562cde9dda30 msgr2=0x562cde9e4750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:15.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.878+0000 7fdc18a22740 1 -- 172.21.15.2:0/1260917765 shutdown_connections 2024-09-19T06:16:15.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.878+0000 7fdc18a22740 1 -- 172.21.15.2:0/1260917765 wait complete. 2024-09-19T06:16:15.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.878+0000 7fdc18a22740 1 -- start start 2024-09-19T06:16:15.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.879+0000 7fdc18a22740 1 Processor -- start 2024-09-19T06:16:15.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.879+0000 7fdc18a22740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cde9e14a0 0x562cde9f4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:15.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.879+0000 7fdc18a22740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562cde9e1dc0 0x562cde9f0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:15.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.879+0000 7fdc18a22740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562cde9ec680 0x562cde9f0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:15.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.879+0000 7fdc18a22740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdc101b2450 con 0x562cde9ec680 2024-09-19T06:16:15.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.879+0000 7fdc18a22740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fdc101b38c0 con 0x562cde9e1dc0 2024-09-19T06:16:15.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.879+0000 7fdc18a22740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdc101b2b20 con 0x562cde9e14a0 2024-09-19T06:16:15.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.879+0000 7fdc18a22740 10 client.0 _ll_register_callbacks cb 0x7fdc000098f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:15.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.879+0000 7fdc14be6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562cde9ec680 0x562cde9f0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:15.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.879+0000 7fdc14be6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562cde9ec680 0x562cde9f0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37100/0 (socket says 172.21.15.2:37100) 2024-09-19T06:16:15.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.879+0000 7fdc14be6640 1 -- 172.21.15.2:0/3329961726 learned_addr learned my addr 172.21.15.2:0/3329961726 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:15.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.879+0000 7fdc0ffff640 1 --2- 172.21.15.2:0/3329961726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cde9e14a0 0x562cde9f4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:15.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.879+0000 7fdc0f7fe640 1 --2- 172.21.15.2:0/3329961726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562cde9e1dc0 0x562cde9f0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:15.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.879+0000 7fdc14be6640 1 -- 172.21.15.2:0/3329961726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cde9e14a0 msgr2=0x562cde9f4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:15.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.879+0000 7fdc14be6640 1 --2- 172.21.15.2:0/3329961726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cde9e14a0 0x562cde9f4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:15.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.879+0000 7fdc14be6640 1 -- 172.21.15.2:0/3329961726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562cde9e1dc0 msgr2=0x562cde9f0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:15.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.879+0000 7fdc14be6640 1 --2- 172.21.15.2:0/3329961726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562cde9e1dc0 0x562cde9f0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:15.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.879+0000 7fdc14be6640 1 -- 172.21.15.2:0/3329961726 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cde9f0d90 con 0x562cde9ec680 2024-09-19T06:16:15.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.879+0000 7fdc0ffff640 1 --2- 172.21.15.2:0/3329961726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cde9e14a0 0x562cde9f4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:15.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.880+0000 7fdc14be6640 1 --2- 172.21.15.2:0/3329961726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562cde9ec680 0x562cde9f0560 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fdc0802ade0 tx=0x7fdc08005f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11f877c5571d03ad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:15.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.880+0000 7fdbef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:16:15.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.880+0000 7fdbef7fe640 1 -- 172.21.15.2:0/3329961726 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc0805c060 con 0x562cde9ec680 2024-09-19T06:16:15.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.880+0000 7fdbef7fe640 1 -- 172.21.15.2:0/3329961726 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fdc08004040 con 0x562cde9ec680 2024-09-19T06:16:15.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.880+0000 7fdc18a22740 1 -- 172.21.15.2:0/3329961726 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc08036070 con 0x562cde9ec680 2024-09-19T06:16:15.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.880+0000 7fdbef7fe640 1 -- 172.21.15.2:0/3329961726 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdc08050030 con 0x562cde9ec680 2024-09-19T06:16:15.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.880+0000 7fdc18a22740 10 client.15570 fetch_fsmap learned FSMap version 26 2024-09-19T06:16:15.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.880+0000 7fdc18a22740 1 -- 172.21.15.2:0/3329961726 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562cdea66880 con 0x562cde9ec680 2024-09-19T06:16:15.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.880+0000 7fdbef7fe640 1 -- 172.21.15.2:0/3329961726 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdc08036070 con 0x562cde9ec680 2024-09-19T06:16:15.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.880+0000 7fdbef7fe640 1 -- 172.21.15.2:0/3329961726 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fdc08049040 con 0x562cde9ec680 2024-09-19T06:16:15.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.880+0000 7fdc18a22740 10 client.15570 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:16:15.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.880+0000 7fdc18a22740 10 client.15570 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:15.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.881+0000 7fdc18a22740 20 client.15570 populate_metadata read hostname 'smithi002' 2024-09-19T06:16:15.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.881+0000 7fdc18a22740 1 --2- 172.21.15.2:0/3329961726 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562cde9fbf80 0x562cdea68ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:15.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.881+0000 7fdc18a22740 4 client.15570 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:16:15.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.881+0000 7fdc18a22740 1 -- 172.21.15.2:0/3329961726 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562cde94ed60 con 0x562cde9fbf80 2024-09-19T06:16:15.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.881+0000 7fdc0ffff640 1 --2- 172.21.15.2:0/3329961726 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562cde9fbf80 0x562cdea68ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:15.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.881+0000 7fdbef7fe640 10 client.15570 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:15.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.881+0000 7fdc0ffff640 1 --2- 172.21.15.2:0/3329961726 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562cde9fbf80 0x562cdea68ed0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b54c7e838cdca3ab server_cookie=98d8f108320f6e49 in_seq=0 out_seq=0 2024-09-19T06:16:15.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.881+0000 7fdbef7fe640 1 -- 172.21.15.2:0/3329961726 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x562cde94ed60 con 0x562cde9fbf80 2024-09-19T06:16:15.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.881+0000 7fdbef7fe640 10 client.15570 handle_command_reply: tid=0 2024-09-19T06:16:15.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.881+0000 7fdc18a22740 1 client.15570 shutdown 2024-09-19T06:16:15.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.881+0000 7fdc18a22740 1 -- 172.21.15.2:0/3329961726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562cde9ec680 msgr2=0x562cde9f0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:15.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.881+0000 7fdc18a22740 1 --2- 172.21.15.2:0/3329961726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562cde9ec680 0x562cde9f0560 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fdc0802ade0 tx=0x7fdc08005f50 comp rx=0 tx=0).stop 2024-09-19T06:16:15.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.882+0000 7fdc18a22740 1 -- 172.21.15.2:0/3329961726 shutdown_connections 2024-09-19T06:16:15.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.882+0000 7fdc18a22740 1 --2- 172.21.15.2:0/3329961726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562cde9ec680 0x562cde9f0560 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:15.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.882+0000 7fdc18a22740 1 --2- 172.21.15.2:0/3329961726 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562cde9fbf80 0x562cdea68ed0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:15.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.882+0000 7fdc18a22740 1 --2- 172.21.15.2:0/3329961726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562cde9e1dc0 0x562cde9f0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:15.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.882+0000 7fdc18a22740 1 --2- 172.21.15.2:0/3329961726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562cde9e14a0 0x562cde9f4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:15.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.882+0000 7fdc18a22740 1 -- 172.21.15.2:0/3329961726 >> 172.21.15.2:0/3329961726 conn(0x562cde9dda30 msgr2=0x562cde9e8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:15.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.882+0000 7fdbef7fe640 0 client.15570 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:15.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.882+0000 7fdc18a22740 1 -- 172.21.15.2:0/3329961726 shutdown_connections 2024-09-19T06:16:15.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.882+0000 7fdc18a22740 1 -- 172.21.15.2:0/3329961726 wait complete. 2024-09-19T06:16:15.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.882+0000 7fdc18a22740 20 client.15570 trim_cache size 0 max 16384 2024-09-19T06:16:15.923 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:16:15.923 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T06:16:15.923 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T06:16:15.923 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:16:15.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.882+0000 7fdc16649640 1 -- 172.21.15.2:0/2614962997 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fdbf80a35d0 msgr2=0x7fdbf80a5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:15.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.882+0000 7fdc16649640 1 --2- 172.21.15.2:0/2614962997 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fdbf80a35d0 0x7fdbf80a5a90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdc08005fe0 tx=0x7fdc08009360 comp rx=0 tx=0).stop 2024-09-19T06:16:15.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.882+0000 7fdc16649640 1 -- 172.21.15.2:0/2614962997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc10102790 msgr2=0x7fdc101a4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:15.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.882+0000 7fdc16649640 1 --2- 172.21.15.2:0/2614962997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc10102790 0x7fdc101a4bf0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fdc0400c890 tx=0x7fdc0400cc90 comp rx=0 tx=0).stop 2024-09-19T06:16:15.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.882+0000 7fdc16649640 1 -- 172.21.15.2:0/2614962997 shutdown_connections 2024-09-19T06:16:15.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.882+0000 7fdc16649640 1 --2- 172.21.15.2:0/2614962997 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fdbf80a35d0 0x7fdbf80a5a90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:15.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.882+0000 7fdc16649640 1 --2- 172.21.15.2:0/2614962997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc10106f10 0x7fdc1019e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:15.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.882+0000 7fdc16649640 1 --2- 172.21.15.2:0/2614962997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc10102790 0x7fdc101a4bf0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:15.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.882+0000 7fdc16649640 1 --2- 172.21.15.2:0/2614962997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc10101de0 0x7fdc101a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:15.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.882+0000 7fdc16649640 1 -- 172.21.15.2:0/2614962997 >> 172.21.15.2:0/2614962997 conn(0x7fdc100fd8c0 msgr2=0x7fdc100fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:15.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.883+0000 7fdc16649640 1 -- 172.21.15.2:0/2614962997 shutdown_connections 2024-09-19T06:16:15.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:15.883+0000 7fdc16649640 1 -- 172.21.15.2:0/2614962997 wait complete. 2024-09-19T06:16:16.724 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:16:16.724 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:16:16.985 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:16:17.373 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:17 smithi002 ceph-mon[30982]: pgmap v47: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 67 MiB/s wr, 25 op/s 2024-09-19T06:16:17.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.453+0000 7f92f4f39640 1 -- 172.21.15.2:0/2401711983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92f0106f70 msgr2=0x7f92f010eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:17.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.453+0000 7f92f4f39640 1 --2- 172.21.15.2:0/2401711983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92f0106f70 0x7f92f010eab0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f92e8009ca0 tx=0x7f92e802a8e0 comp rx=0 tx=0).stop 2024-09-19T06:16:17.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.454+0000 7f92f4f39640 1 -- 172.21.15.2:0/2401711983 shutdown_connections 2024-09-19T06:16:17.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.454+0000 7f92f4f39640 1 --2- 172.21.15.2:0/2401711983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92f0106f70 0x7f92f010eab0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:17.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.454+0000 7f92f4f39640 1 --2- 172.21.15.2:0/2401711983 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92f0100eb0 0x7f92f0106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:17.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.454+0000 7f92f4f39640 1 --2- 172.21.15.2:0/2401711983 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92f0100500 0x7f92f01008e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:17.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.454+0000 7f92f4f39640 1 -- 172.21.15.2:0/2401711983 >> 172.21.15.2:0/2401711983 conn(0x7f92f00fc5c0 msgr2=0x7f92f00fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:17.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.454+0000 7f92f4f39640 1 -- 172.21.15.2:0/2401711983 shutdown_connections 2024-09-19T06:16:17.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.454+0000 7f92f4f39640 1 -- 172.21.15.2:0/2401711983 wait complete. 2024-09-19T06:16:17.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.454+0000 7f92f4f39640 1 Processor -- start 2024-09-19T06:16:17.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.455+0000 7f92f4f39640 1 -- start start 2024-09-19T06:16:17.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.455+0000 7f92f4f39640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92f0100500 0x7f92f01984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:17.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.455+0000 7f92f4f39640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92f0100eb0 0x7f92f0198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:17.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.455+0000 7f92f4f39640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92f0106f70 0x7f92f019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:17.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.455+0000 7f92f4f39640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f92f0111f20 con 0x7f92f0106f70 2024-09-19T06:16:17.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.455+0000 7f92f4f39640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f92f0111da0 con 0x7f92f0100eb0 2024-09-19T06:16:17.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.455+0000 7f92f4f39640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f92f01120a0 con 0x7f92f0100500 2024-09-19T06:16:17.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.455+0000 7f92eed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92f0106f70 0x7f92f019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:17.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.455+0000 7f92eed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92f0106f70 0x7f92f019cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37114/0 (socket says 172.21.15.2:37114) 2024-09-19T06:16:17.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.455+0000 7f92eed9d640 1 -- 172.21.15.2:0/3690100458 learned_addr learned my addr 172.21.15.2:0/3690100458 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:17.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.455+0000 7f92edd9b640 1 --2- 172.21.15.2:0/3690100458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92f0100eb0 0x7f92f0198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:17.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.455+0000 7f92ee59c640 1 --2- 172.21.15.2:0/3690100458 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92f0100500 0x7f92f01984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:17.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.455+0000 7f92eed9d640 1 -- 172.21.15.2:0/3690100458 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92f0100500 msgr2=0x7f92f01984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:17.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.455+0000 7f92eed9d640 1 --2- 172.21.15.2:0/3690100458 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92f0100500 0x7f92f01984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:17.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.455+0000 7f92eed9d640 1 -- 172.21.15.2:0/3690100458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92f0100eb0 msgr2=0x7f92f0198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:17.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.455+0000 7f92eed9d640 1 --2- 172.21.15.2:0/3690100458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92f0100eb0 0x7f92f0198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:17.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.455+0000 7f92eed9d640 1 -- 172.21.15.2:0/3690100458 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92f019d470 con 0x7f92f0106f70 2024-09-19T06:16:17.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.456+0000 7f92eed9d640 1 --2- 172.21.15.2:0/3690100458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92f0106f70 0x7f92f019cd90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f92e8033040 tx=0x7f92e8003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:17.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.456+0000 7f92df7fe640 1 -- 172.21.15.2:0/3690100458 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e8004240 con 0x7f92f0106f70 2024-09-19T06:16:17.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.456+0000 7f92f4f39640 1 -- 172.21.15.2:0/3690100458 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92f019d700 con 0x7f92f0106f70 2024-09-19T06:16:17.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.456+0000 7f92df7fe640 1 -- 172.21.15.2:0/3690100458 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f92e8003e10 con 0x7f92f0106f70 2024-09-19T06:16:17.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.456+0000 7f92df7fe640 1 -- 172.21.15.2:0/3690100458 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e8030e10 con 0x7f92f0106f70 2024-09-19T06:16:17.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.456+0000 7f92f4f39640 1 -- 172.21.15.2:0/3690100458 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92f01a5040 con 0x7f92f0106f70 2024-09-19T06:16:17.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.457+0000 7f92f4f39640 1 -- 172.21.15.2:0/3690100458 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92f0100960 con 0x7f92f0106f70 2024-09-19T06:16:17.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.458+0000 7f92df7fe640 1 -- 172.21.15.2:0/3690100458 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 24) ==== 138638+0+0 (secure 0 0 0) 0x7f92e80305e0 con 0x7f92f0106f70 2024-09-19T06:16:17.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.459+0000 7f92df7fe640 1 --2- 172.21.15.2:0/3690100458 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f92d80a35e0 0x7f92d80a5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:17.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.460+0000 7f92df7fe640 1 -- 172.21.15.2:0/3690100458 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f92e80f13f0 con 0x7f92f0106f70 2024-09-19T06:16:17.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.460+0000 7f92ee59c640 1 --2- 172.21.15.2:0/3690100458 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f92d80a35e0 0x7f92d80a5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:17.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.460+0000 7f92ee59c640 1 --2- 172.21.15.2:0/3690100458 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f92d80a35e0 0x7f92d80a5aa0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f92f0069fc0 tx=0x7f92e0009110 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:17.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.462+0000 7f92df7fe640 1 -- 172.21.15.2:0/3690100458 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f92e80bdcd0 con 0x7f92f0106f70 2024-09-19T06:16:17.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:17 smithi089 ceph-mon[34160]: pgmap v47: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 67 MiB/s wr, 25 op/s 2024-09-19T06:16:17.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.705+0000 7f92f4f39640 1 -- 172.21.15.2:0/3690100458 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f92f010a140 con 0x7f92f0106f70 2024-09-19T06:16:17.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.705+0000 7f92df7fe640 1 -- 172.21.15.2:0/3690100458 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11882 (secure 0 0 0) 0x7f92e80bd5d0 con 0x7f92f0106f70 2024-09-19T06:16:17.707 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:16:17.707 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-09-19T06:14:49:104280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:14:48.191083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24470,24472,24497]},"id":1}]} 2024-09-19T06:16:17.707 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-09-19T06:16:17.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.708+0000 7f92f4f39640 1 -- 172.21.15.2:0/3690100458 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f92d80a35e0 msgr2=0x7f92d80a5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:17.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.708+0000 7f92f4f39640 1 --2- 172.21.15.2:0/3690100458 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f92d80a35e0 0x7f92d80a5aa0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f92f0069fc0 tx=0x7f92e0009110 comp rx=0 tx=0).stop 2024-09-19T06:16:17.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.708+0000 7f92f4f39640 1 -- 172.21.15.2:0/3690100458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92f0106f70 msgr2=0x7f92f019cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:17.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.708+0000 7f92f4f39640 1 --2- 172.21.15.2:0/3690100458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92f0106f70 0x7f92f019cd90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f92e8033040 tx=0x7f92e8003c20 comp rx=0 tx=0).stop 2024-09-19T06:16:17.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.708+0000 7f92f4f39640 1 -- 172.21.15.2:0/3690100458 shutdown_connections 2024-09-19T06:16:17.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.708+0000 7f92f4f39640 1 --2- 172.21.15.2:0/3690100458 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f92d80a35e0 0x7f92d80a5aa0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:17.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.708+0000 7f92f4f39640 1 --2- 172.21.15.2:0/3690100458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92f0106f70 0x7f92f019cd90 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:17.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.708+0000 7f92f4f39640 1 --2- 172.21.15.2:0/3690100458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92f0100eb0 0x7f92f0198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:17.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.708+0000 7f92f4f39640 1 --2- 172.21.15.2:0/3690100458 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92f0100500 0x7f92f01984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:17.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.708+0000 7f92f4f39640 1 -- 172.21.15.2:0/3690100458 >> 172.21.15.2:0/3690100458 conn(0x7f92f00fc5c0 msgr2=0x7f92f0105390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:17.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.708+0000 7f92f4f39640 1 -- 172.21.15.2:0/3690100458 shutdown_connections 2024-09-19T06:16:17.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:17.709+0000 7f92f4f39640 1 -- 172.21.15.2:0/3690100458 wait complete. 2024-09-19T06:16:17.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:17 smithi090 ceph-mon[34497]: pgmap v47: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 67 MiB/s wr, 25 op/s 2024-09-19T06:16:18.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:18 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/3690100458' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:16:18.627 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.626+0000 7fb2d21b0640 1 -- 172.21.15.2:0/3237861901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2cc100810 msgr2=0x7fb2cc100bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:18.628 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.626+0000 7fb2d21b0640 1 --2- 172.21.15.2:0/3237861901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2cc100810 0x7fb2cc100bf0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc009900 tx=0x7fb2bc02a410 comp rx=0 tx=0).stop 2024-09-19T06:16:18.628 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.626+0000 7fb2d21b0640 1 -- 172.21.15.2:0/3237861901 shutdown_connections 2024-09-19T06:16:18.628 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.626+0000 7fb2d21b0640 1 --2- 172.21.15.2:0/3237861901 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2cc105500 0x7fb2cc10d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:18.628 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.626+0000 7fb2d21b0640 1 --2- 172.21.15.2:0/3237861901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2cc1011c0 0x7fb2cc104da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:18.628 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.626+0000 7fb2d21b0640 1 --2- 172.21.15.2:0/3237861901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2cc100810 0x7fb2cc100bf0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:18.628 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.626+0000 7fb2d21b0640 1 -- 172.21.15.2:0/3237861901 >> 172.21.15.2:0/3237861901 conn(0x7fb2cc075eb0 msgr2=0x7fb2cc0762c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:18.628 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.626+0000 7fb2d21b0640 1 -- 172.21.15.2:0/3237861901 shutdown_connections 2024-09-19T06:16:18.628 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.626+0000 7fb2d21b0640 1 -- 172.21.15.2:0/3237861901 wait complete. 2024-09-19T06:16:18.630 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.626+0000 7fb2d21b0640 1 Processor -- start 2024-09-19T06:16:18.630 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.627+0000 7fb2d21b0640 1 -- start start 2024-09-19T06:16:18.630 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.627+0000 7fb2d21b0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2cc100810 0x7fb2cc198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:18.630 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.627+0000 7fb2d21b0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2cc105500 0x7fb2cc1988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:18.630 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.627+0000 7fb2d21b0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2cc19cc20 0x7fb2cc19d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:18.630 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.627+0000 7fb2d21b0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb2cc111df0 con 0x7fb2cc100810 2024-09-19T06:16:18.631 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.627+0000 7fb2d21b0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb2cc111c70 con 0x7fb2cc105500 2024-09-19T06:16:18.631 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.627+0000 7fb2d21b0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb2cc111f70 con 0x7fb2cc19cc20 2024-09-19T06:16:18.631 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.627+0000 7fb2cb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2cc100810 0x7fb2cc198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:18.631 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.627+0000 7fb2cb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2cc100810 0x7fb2cc198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37140/0 (socket says 172.21.15.2:37140) 2024-09-19T06:16:18.631 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.627+0000 7fb2cbfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2cc19cc20 0x7fb2cc19d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:18.631 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.627+0000 7fb2cb7fe640 1 -- 172.21.15.2:0/3471341251 learned_addr learned my addr 172.21.15.2:0/3471341251 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:18.631 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.627+0000 7fb2caffd640 1 --2- 172.21.15.2:0/3471341251 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2cc105500 0x7fb2cc1988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:18.631 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.627+0000 7fb2cbfff640 1 -- 172.21.15.2:0/3471341251 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2cc105500 msgr2=0x7fb2cc1988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:18.631 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.627+0000 7fb2cbfff640 1 --2- 172.21.15.2:0/3471341251 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2cc105500 0x7fb2cc1988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:18.631 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.627+0000 7fb2cbfff640 1 -- 172.21.15.2:0/3471341251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2cc100810 msgr2=0x7fb2cc198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:18.631 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.627+0000 7fb2cbfff640 1 --2- 172.21.15.2:0/3471341251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2cc100810 0x7fb2cc198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:18.631 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.627+0000 7fb2cbfff640 1 -- 172.21.15.2:0/3471341251 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2cc19d710 con 0x7fb2cc19cc20 2024-09-19T06:16:18.631 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.628+0000 7fb2cbfff640 1 --2- 172.21.15.2:0/3471341251 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2cc19cc20 0x7fb2cc19d0d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb2c4009fd0 tx=0x7fb2c400ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:18.632 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.628+0000 7fb2c8ff9640 1 -- 172.21.15.2:0/3471341251 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c400ce20 con 0x7fb2cc19cc20 2024-09-19T06:16:18.632 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.628+0000 7fb2d21b0640 1 -- 172.21.15.2:0/3471341251 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2cc19da00 con 0x7fb2cc19cc20 2024-09-19T06:16:18.632 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.628+0000 7fb2c8ff9640 1 -- 172.21.15.2:0/3471341251 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb2c4005020 con 0x7fb2cc19cc20 2024-09-19T06:16:18.632 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.628+0000 7fb2d21b0640 1 -- 172.21.15.2:0/3471341251 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2cc1a5240 con 0x7fb2cc19cc20 2024-09-19T06:16:18.632 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.628+0000 7fb2c8ff9640 1 -- 172.21.15.2:0/3471341251 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c4010690 con 0x7fb2cc19cc20 2024-09-19T06:16:18.633 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.630+0000 7fb2c8ff9640 1 -- 172.21.15.2:0/3471341251 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 24) ==== 138638+0+0 (secure 0 0 0) 0x7fb2c40051d0 con 0x7fb2cc19cc20 2024-09-19T06:16:18.633 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.631+0000 7fb2c8ff9640 1 --2- 172.21.15.2:0/3471341251 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb2b40a35e0 0x7fb2b40a5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:18.633 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.631+0000 7fb2d5025740 1 Processor -- start 2024-09-19T06:16:18.634 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.631+0000 7fb2d5025740 1 -- start start 2024-09-19T06:16:18.634 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.631+0000 7fb2cb7fe640 1 --2- 172.21.15.2:0/3471341251 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb2b40a35e0 0x7fb2b40a5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:18.634 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.631+0000 7fb2c8ff9640 1 -- 172.21.15.2:0/3471341251 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fb2c40d0550 con 0x7fb2cc19cc20 2024-09-19T06:16:18.634 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.632+0000 7fb2d5025740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b8f3beaf0 0x562b8f3beed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:18.634 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.632+0000 7fb2d5025740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b8f3bf410 0x562b8f3c9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:18.634 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.632+0000 7fb2d5025740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b8f3c9cb0 0x562b8f3cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:18.634 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.632+0000 7fb2d5025740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562b8f3232f0 con 0x562b8f3c9cb0 2024-09-19T06:16:18.634 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.632+0000 7fb2d5025740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562b8f2cb270 con 0x562b8f3beaf0 2024-09-19T06:16:18.634 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.632+0000 7fb2d5025740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562b8f31f2b0 con 0x562b8f3bf410 2024-09-19T06:16:18.634 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.632+0000 7fb2cbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b8f3c9cb0 0x562b8f3cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:18.634 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.632+0000 7fb2cb7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b8f3beaf0 0x562b8f3beed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:18.634 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.632+0000 7fb2caffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b8f3bf410 0x562b8f3c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:18.634 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.632+0000 7fb2cbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b8f3c9cb0 0x562b8f3cc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37144/0 (socket says 172.21.15.2:37144) 2024-09-19T06:16:18.635 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.632+0000 7fb2cbfff640 1 -- 172.21.15.2:0/54876684 learned_addr learned my addr 172.21.15.2:0/54876684 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:18.638 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.632+0000 7fb2cb7fe640 1 --2- 172.21.15.2:0/3471341251 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb2b40a35e0 0x7fb2b40a5aa0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc0096c0 tx=0x7fb2bc004120 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:18.638 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.632+0000 7fb2cbfff640 1 -- 172.21.15.2:0/54876684 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b8f3bf410 msgr2=0x562b8f3c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:18.639 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.632+0000 7fb2cbfff640 1 --2- 172.21.15.2:0/54876684 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b8f3bf410 0x562b8f3c9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:18.639 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.632+0000 7fb2cbfff640 1 -- 172.21.15.2:0/54876684 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b8f3beaf0 msgr2=0x562b8f3beed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:18.639 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.632+0000 7fb2cbfff640 1 --2- 172.21.15.2:0/54876684 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b8f3beaf0 0x562b8f3beed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:18.639 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.632+0000 7fb2cbfff640 1 -- 172.21.15.2:0/54876684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b8f2ca340 con 0x562b8f3c9cb0 2024-09-19T06:16:18.639 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.633+0000 7fb2cbfff640 1 --2- 172.21.15.2:0/54876684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b8f3c9cb0 0x562b8f3cc0a0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb2c409c5b0 tx=0x7fb2c409c0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=741743c27667dd0c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:18.639 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.633+0000 7fb2b1ffb640 1 -- 172.21.15.2:0/54876684 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c40c0020 con 0x562b8f3c9cb0 2024-09-19T06:16:18.639 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.633+0000 7fb2b1ffb640 1 -- 172.21.15.2:0/54876684 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb2c40a5290 con 0x562b8f3c9cb0 2024-09-19T06:16:18.639 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.633+0000 7fb2b1ffb640 1 -- 172.21.15.2:0/54876684 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c40a5060 con 0x562b8f3c9cb0 2024-09-19T06:16:18.639 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.634+0000 7fb2d5025740 1 -- 172.21.15.2:0/54876684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b8f3c9cb0 msgr2=0x562b8f3cc0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:18.639 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.634+0000 7fb2d5025740 1 --2- 172.21.15.2:0/54876684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b8f3c9cb0 0x562b8f3cc0a0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb2c409c5b0 tx=0x7fb2c409c0b0 comp rx=0 tx=0).stop 2024-09-19T06:16:18.639 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.634+0000 7fb2d5025740 1 -- 172.21.15.2:0/54876684 shutdown_connections 2024-09-19T06:16:18.640 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.634+0000 7fb2d5025740 1 --2- 172.21.15.2:0/54876684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b8f3c9cb0 0x562b8f3cc0a0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:18.640 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.634+0000 7fb2d5025740 1 --2- 172.21.15.2:0/54876684 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b8f3bf410 0x562b8f3c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:18.640 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.634+0000 7fb2d5025740 1 --2- 172.21.15.2:0/54876684 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b8f3beaf0 0x562b8f3beed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:18.640 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.634+0000 7fb2d5025740 1 -- 172.21.15.2:0/54876684 >> 172.21.15.2:0/54876684 conn(0x562b8f3bb060 msgr2=0x562b8f3bb440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:18.640 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.634+0000 7fb2d5025740 1 -- 172.21.15.2:0/54876684 shutdown_connections 2024-09-19T06:16:18.640 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.634+0000 7fb2d5025740 1 -- 172.21.15.2:0/54876684 wait complete. 2024-09-19T06:16:18.640 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.634+0000 7fb2d5025740 1 -- start start 2024-09-19T06:16:18.640 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.635+0000 7fb2d5025740 1 Processor -- start 2024-09-19T06:16:18.640 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.635+0000 7fb2d5025740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b8f3beaf0 0x562b8f3c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:18.640 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.635+0000 7fb2d5025740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b8f3bf410 0x562b8f3c70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:18.641 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.635+0000 7fb2d5025740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b8f3c9cb0 0x562b8f3c7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:18.641 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.635+0000 7fb2d5025740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562b8f3cc880 con 0x562b8f3bf410 2024-09-19T06:16:18.641 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.635+0000 7fb2d5025740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562b8f2ac290 con 0x562b8f3c9cb0 2024-09-19T06:16:18.641 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.635+0000 7fb2d5025740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562b8f3cca00 con 0x562b8f3beaf0 2024-09-19T06:16:18.641 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.635+0000 7fb2d5025740 10 client.0 _ll_register_callbacks cb 0x562b8f2dd140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:18.641 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.635+0000 7fb2caffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b8f3bf410 0x562b8f3c70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:18.641 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.635+0000 7fb2cb7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b8f3beaf0 0x562b8f3c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:18.641 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.635+0000 7fb2caffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b8f3bf410 0x562b8f3c70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37152/0 (socket says 172.21.15.2:37152) 2024-09-19T06:16:18.641 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.635+0000 7fb2caffd640 1 -- 172.21.15.2:0/3686775059 learned_addr learned my addr 172.21.15.2:0/3686775059 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:18.641 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.635+0000 7fb2cbfff640 1 --2- 172.21.15.2:0/3686775059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b8f3c9cb0 0x562b8f3c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:18.641 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.635+0000 7fb2cb7fe640 1 -- 172.21.15.2:0/3686775059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b8f3c9cb0 msgr2=0x562b8f3c7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:18.641 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.635+0000 7fb2cb7fe640 1 --2- 172.21.15.2:0/3686775059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b8f3c9cb0 0x562b8f3c7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:18.641 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.635+0000 7fb2cb7fe640 1 -- 172.21.15.2:0/3686775059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b8f3bf410 msgr2=0x562b8f3c70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.635+0000 7fb2cb7fe640 1 --2- 172.21.15.2:0/3686775059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b8f3bf410 0x562b8f3c70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.635+0000 7fb2cb7fe640 1 -- 172.21.15.2:0/3686775059 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b8f036210 con 0x562b8f3beaf0 2024-09-19T06:16:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.635+0000 7fb2cbfff640 1 --2- 172.21.15.2:0/3686775059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b8f3c9cb0 0x562b8f3c7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.636+0000 7fb2cb7fe640 1 --2- 172.21.15.2:0/3686775059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b8f3beaf0 0x562b8f3c6bb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc031440 tx=0x7fb2bc02a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbbfb8aa60ed6e8f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.636+0000 7fb2aaffd640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-19T06:16:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.636+0000 7fb2aaffd640 1 -- 172.21.15.2:0/3686775059 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc035040 con 0x562b8f3beaf0 2024-09-19T06:16:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.636+0000 7fb2aaffd640 1 -- 172.21.15.2:0/3686775059 <== mon.1 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fb2bc0038c0 con 0x562b8f3beaf0 2024-09-19T06:16:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.636+0000 7fb2d5025740 1 -- 172.21.15.2:0/3686775059 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2c40a5290 con 0x562b8f3beaf0 2024-09-19T06:16:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.636+0000 7fb2aaffd640 1 -- 172.21.15.2:0/3686775059 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb2bc003ac0 con 0x562b8f3beaf0 2024-09-19T06:16:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.636+0000 7fb2d5025740 10 client.25216 fetch_fsmap learned FSMap version 26 2024-09-19T06:16:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.636+0000 7fb2d5025740 1 -- 172.21.15.2:0/3686775059 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562b8f102620 con 0x562b8f3beaf0 2024-09-19T06:16:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.636+0000 7fb2aaffd640 1 -- 172.21.15.2:0/3686775059 <== mon.1 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb2c40a5290 con 0x562b8f3beaf0 2024-09-19T06:16:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.636+0000 7fb2aaffd640 1 -- 172.21.15.2:0/3686775059 <== mon.1 v2:172.21.15.90:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fb2bc03c450 con 0x562b8f3beaf0 2024-09-19T06:16:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.636+0000 7fb2d5025740 10 client.25216 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:16:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.637+0000 7fb2d5025740 10 client.25216 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.637+0000 7fb2d5025740 20 client.25216 populate_metadata read hostname 'smithi002' 2024-09-19T06:16:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.637+0000 7fb2d5025740 1 --2- 172.21.15.2:0/3686775059 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562b8f3d9c20 0x562b8f3dc030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.637+0000 7fb2d5025740 4 client.25216 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:16:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.637+0000 7fb2d5025740 1 -- 172.21.15.2:0/3686775059 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b8f330a20 con 0x562b8f3d9c20 2024-09-19T06:16:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.637+0000 7fb2caffd640 1 --2- 172.21.15.2:0/3686775059 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562b8f3d9c20 0x562b8f3dc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.637+0000 7fb2caffd640 1 --2- 172.21.15.2:0/3686775059 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562b8f3d9c20 0x562b8f3dc030 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2ae9a753f862f10 server_cookie=3ce6b6afaa2da0a5 in_seq=0 out_seq=0 2024-09-19T06:16:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.637+0000 7fb2aaffd640 10 client.25216 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.638+0000 7fb2aaffd640 1 -- 172.21.15.2:0/3686775059 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562b8f330a20 con 0x562b8f3d9c20 2024-09-19T06:16:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.638+0000 7fb2aaffd640 10 client.25216 handle_command_reply: tid=0 2024-09-19T06:16:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.638+0000 7fb2d5025740 1 client.25216 shutdown 2024-09-19T06:16:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.638+0000 7fb2d5025740 1 -- 172.21.15.2:0/3686775059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b8f3beaf0 msgr2=0x562b8f3c6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.638+0000 7fb2d5025740 1 --2- 172.21.15.2:0/3686775059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b8f3beaf0 0x562b8f3c6bb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc031440 tx=0x7fb2bc02a410 comp rx=0 tx=0).stop 2024-09-19T06:16:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.638+0000 7fb2d5025740 1 -- 172.21.15.2:0/3686775059 shutdown_connections 2024-09-19T06:16:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.638+0000 7fb2d5025740 1 --2- 172.21.15.2:0/3686775059 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562b8f3d9c20 0x562b8f3dc030 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.638+0000 7fb2d5025740 1 --2- 172.21.15.2:0/3686775059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b8f3c9cb0 0x562b8f3c7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.638+0000 7fb2d5025740 1 --2- 172.21.15.2:0/3686775059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b8f3bf410 0x562b8f3c70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.638+0000 7fb2d5025740 1 --2- 172.21.15.2:0/3686775059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b8f3beaf0 0x562b8f3c6bb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.638+0000 7fb2aaffd640 0 client.25216 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.638+0000 7fb2d5025740 1 -- 172.21.15.2:0/3686775059 >> 172.21.15.2:0/3686775059 conn(0x562b8f3bb060 msgr2=0x562b8f3c0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:18.646 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.638+0000 7fb2d5025740 1 -- 172.21.15.2:0/3686775059 shutdown_connections 2024-09-19T06:16:18.646 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.638+0000 7fb2d5025740 1 -- 172.21.15.2:0/3686775059 wait complete. 2024-09-19T06:16:18.646 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.638+0000 7fb2d5025740 20 client.25216 trim_cache size 0 max 16384 2024-09-19T06:16:18.654 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:16:18.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.659+0000 7fb2d5025740 1 Processor -- start 2024-09-19T06:16:18.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.659+0000 7fb2d5025740 1 -- start start 2024-09-19T06:16:18.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.660+0000 7fb2d5025740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b8f3beaf0 0x562b8f3c7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:18.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.660+0000 7fb2d5025740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b8f3bf410 0x562b8f3e1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:18.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.660+0000 7fb2d5025740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b8f3c9cb0 0x562b8f3e1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:18.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.660+0000 7fb2d5025740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb2cc1adec0 con 0x562b8f3bf410 2024-09-19T06:16:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.660+0000 7fb2d5025740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb2cc1ab790 con 0x562b8f3beaf0 2024-09-19T06:16:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.660+0000 7fb2d5025740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb2cc1a9600 con 0x562b8f3c9cb0 2024-09-19T06:16:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.660+0000 7fb2caffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b8f3bf410 0x562b8f3e1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.660+0000 7fb2caffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b8f3bf410 0x562b8f3e1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37166/0 (socket says 172.21.15.2:37166) 2024-09-19T06:16:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.660+0000 7fb2caffd640 1 -- 172.21.15.2:0/4256801795 learned_addr learned my addr 172.21.15.2:0/4256801795 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.660+0000 7fb2cb7fe640 1 --2- 172.21.15.2:0/4256801795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b8f3beaf0 0x562b8f3c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.660+0000 7fb2cbfff640 1 --2- 172.21.15.2:0/4256801795 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b8f3c9cb0 0x562b8f3e1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.660+0000 7fb2caffd640 1 -- 172.21.15.2:0/4256801795 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b8f3c9cb0 msgr2=0x562b8f3e1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.660+0000 7fb2caffd640 1 --2- 172.21.15.2:0/4256801795 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b8f3c9cb0 0x562b8f3e1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.660+0000 7fb2caffd640 1 -- 172.21.15.2:0/4256801795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b8f3beaf0 msgr2=0x562b8f3c7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.660+0000 7fb2caffd640 1 --2- 172.21.15.2:0/4256801795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b8f3beaf0 0x562b8f3c7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.660+0000 7fb2caffd640 1 -- 172.21.15.2:0/4256801795 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b8f3dc6b0 con 0x562b8f3bf410 2024-09-19T06:16:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.660+0000 7fb2caffd640 1 --2- 172.21.15.2:0/4256801795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b8f3bf410 0x562b8f3e1940 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x562b8f3dc8e0 tx=0x7fb2c0005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7af57ac528ca53f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.661+0000 7fb2b17fa640 1 -- 172.21.15.2:0/4256801795 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c0004110 con 0x562b8f3bf410 2024-09-19T06:16:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.661+0000 7fb2b17fa640 1 -- 172.21.15.2:0/4256801795 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb2c00042b0 con 0x562b8f3bf410 2024-09-19T06:16:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.661+0000 7fb2b17fa640 1 -- 172.21.15.2:0/4256801795 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c001e710 con 0x562b8f3bf410 2024-09-19T06:16:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.661+0000 7fb2d5025740 1 -- 172.21.15.2:0/4256801795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b8f3bf410 msgr2=0x562b8f3e1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.661+0000 7fb2d5025740 1 --2- 172.21.15.2:0/4256801795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b8f3bf410 0x562b8f3e1940 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x562b8f3dc8e0 tx=0x7fb2c0005f90 comp rx=0 tx=0).stop 2024-09-19T06:16:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.662+0000 7fb2d5025740 1 -- 172.21.15.2:0/4256801795 shutdown_connections 2024-09-19T06:16:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.662+0000 7fb2d5025740 1 --2- 172.21.15.2:0/4256801795 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b8f3c9cb0 0x562b8f3e1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.662+0000 7fb2d5025740 1 --2- 172.21.15.2:0/4256801795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b8f3bf410 0x562b8f3e1940 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.662+0000 7fb2d5025740 1 --2- 172.21.15.2:0/4256801795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b8f3beaf0 0x562b8f3c7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.662+0000 7fb2d5025740 1 -- 172.21.15.2:0/4256801795 >> 172.21.15.2:0/4256801795 conn(0x562b8f3bb060 msgr2=0x562b8f3c8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.662+0000 7fb2d5025740 1 -- 172.21.15.2:0/4256801795 shutdown_connections 2024-09-19T06:16:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.662+0000 7fb2d5025740 1 -- 172.21.15.2:0/4256801795 wait complete. 2024-09-19T06:16:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.662+0000 7fb2d5025740 1 -- start start 2024-09-19T06:16:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.662+0000 7fb2d5025740 1 Processor -- start 2024-09-19T06:16:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.663+0000 7fb2d5025740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b8f3beaf0 0x562b8f3cda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.663+0000 7fb2d5025740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b8f3bf410 0x562b8f3cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.663+0000 7fb2d5025740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b8f3c9cb0 0x562b8f3ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.663+0000 7fb2d5025740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb2cc1a9c50 con 0x562b8f3beaf0 2024-09-19T06:16:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.663+0000 7fb2d5025740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb2cc1ab0c0 con 0x562b8f3c9cb0 2024-09-19T06:16:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.663+0000 7fb2d5025740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb2cc1aa320 con 0x562b8f3bf410 2024-09-19T06:16:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.663+0000 7fb2cb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b8f3beaf0 0x562b8f3cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.663+0000 7fb2d5025740 10 client.0 _ll_register_callbacks cb 0x7fb2bc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.663+0000 7fb2cb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b8f3beaf0 0x562b8f3cda50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37170/0 (socket says 172.21.15.2:37170) 2024-09-19T06:16:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.663+0000 7fb2caffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b8f3bf410 0x562b8f3cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.663+0000 7fb2cb7fe640 1 -- 172.21.15.2:0/1737205817 learned_addr learned my addr 172.21.15.2:0/1737205817 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.663+0000 7fb2cbfff640 1 --2- 172.21.15.2:0/1737205817 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b8f3c9cb0 0x562b8f3ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.663+0000 7fb2caffd640 1 -- 172.21.15.2:0/1737205817 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b8f3c9cb0 msgr2=0x562b8f3ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.663+0000 7fb2caffd640 1 --2- 172.21.15.2:0/1737205817 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b8f3c9cb0 0x562b8f3ce4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.663+0000 7fb2caffd640 1 -- 172.21.15.2:0/1737205817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b8f3beaf0 msgr2=0x562b8f3cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.663+0000 7fb2caffd640 1 --2- 172.21.15.2:0/1737205817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b8f3beaf0 0x562b8f3cda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.663+0000 7fb2caffd640 1 -- 172.21.15.2:0/1737205817 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b8f3bae90 con 0x562b8f3bf410 2024-09-19T06:16:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.663+0000 7fb2cbfff640 1 --2- 172.21.15.2:0/1737205817 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b8f3c9cb0 0x562b8f3ce4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:16:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.663+0000 7fb2caffd640 1 --2- 172.21.15.2:0/1737205817 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b8f3bf410 0x562b8f3cdf90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x562b8f3bbdd0 tx=0x7fb2c0004110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75f284c4320caf88 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.663+0000 7fb2aaffd640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-19T06:16:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.664+0000 7fb2aaffd640 1 -- 172.21.15.2:0/1737205817 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c0005230 con 0x562b8f3bf410 2024-09-19T06:16:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.664+0000 7fb2d5025740 1 -- 172.21.15.2:0/1737205817 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2c00042b0 con 0x562b8f3bf410 2024-09-19T06:16:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.664+0000 7fb2aaffd640 1 -- 172.21.15.2:0/1737205817 <== mon.1 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fb2c00053d0 con 0x562b8f3bf410 2024-09-19T06:16:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.664+0000 7fb2aaffd640 1 -- 172.21.15.2:0/1737205817 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb2c0038050 con 0x562b8f3bf410 2024-09-19T06:16:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.664+0000 7fb2d5025740 10 client.25222 fetch_fsmap learned FSMap version 26 2024-09-19T06:16:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.664+0000 7fb2d5025740 1 -- 172.21.15.2:0/1737205817 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562b8f444a70 con 0x562b8f3bf410 2024-09-19T06:16:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.664+0000 7fb2aaffd640 1 -- 172.21.15.2:0/1737205817 <== mon.1 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb2c00042b0 con 0x562b8f3bf410 2024-09-19T06:16:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.664+0000 7fb2aaffd640 1 -- 172.21.15.2:0/1737205817 <== mon.1 v2:172.21.15.90:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fb2c0003b50 con 0x562b8f3bf410 2024-09-19T06:16:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.664+0000 7fb2d5025740 10 client.25222 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:16:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.664+0000 7fb2d5025740 10 client.25222 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.664+0000 7fb2d5025740 20 client.25222 populate_metadata read hostname 'smithi002' 2024-09-19T06:16:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.664+0000 7fb2d5025740 1 --2- 172.21.15.2:0/1737205817 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562b8f445170 0x562b8f447590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.664+0000 7fb2d5025740 4 client.25222 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:16:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.664+0000 7fb2d5025740 1 -- 172.21.15.2:0/1737205817 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562b8f32ad70 con 0x562b8f445170 2024-09-19T06:16:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.665+0000 7fb2cb7fe640 1 --2- 172.21.15.2:0/1737205817 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562b8f445170 0x562b8f447590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.665+0000 7fb2cb7fe640 1 --2- 172.21.15.2:0/1737205817 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562b8f445170 0x562b8f447590 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c3d0ddd67bfbfbd server_cookie=c8db351e3b8f1330 in_seq=0 out_seq=0 2024-09-19T06:16:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.665+0000 7fb2aaffd640 10 client.25222 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:18.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.672+0000 7fb2aaffd640 1 -- 172.21.15.2:0/1737205817 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562b8f32ad70 con 0x562b8f445170 2024-09-19T06:16:18.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.672+0000 7fb2aaffd640 10 client.25222 handle_command_reply: tid=0 2024-09-19T06:16:18.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.672+0000 7fb2d5025740 1 client.25222 shutdown 2024-09-19T06:16:18.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.672+0000 7fb2d5025740 1 -- 172.21.15.2:0/1737205817 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b8f3bf410 msgr2=0x562b8f3cdf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:18.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.672+0000 7fb2d5025740 1 --2- 172.21.15.2:0/1737205817 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b8f3bf410 0x562b8f3cdf90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x562b8f3bbdd0 tx=0x7fb2c0004110 comp rx=0 tx=0).stop 2024-09-19T06:16:18.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.672+0000 7fb2d5025740 1 -- 172.21.15.2:0/1737205817 shutdown_connections 2024-09-19T06:16:18.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.672+0000 7fb2d5025740 1 --2- 172.21.15.2:0/1737205817 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562b8f445170 0x562b8f447590 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:18.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.672+0000 7fb2d5025740 1 --2- 172.21.15.2:0/1737205817 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b8f3c9cb0 0x562b8f3ce4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:18.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.672+0000 7fb2d5025740 1 --2- 172.21.15.2:0/1737205817 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b8f3bf410 0x562b8f3cdf90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:18.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.672+0000 7fb2aaffd640 0 client.25222 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:18.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.672+0000 7fb2d5025740 1 --2- 172.21.15.2:0/1737205817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b8f3beaf0 0x562b8f3cda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:18.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.672+0000 7fb2d5025740 1 -- 172.21.15.2:0/1737205817 >> 172.21.15.2:0/1737205817 conn(0x562b8f3bb060 msgr2=0x562b8f3c8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:18.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.672+0000 7fb2d5025740 1 -- 172.21.15.2:0/1737205817 shutdown_connections 2024-09-19T06:16:18.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.672+0000 7fb2d5025740 1 -- 172.21.15.2:0/1737205817 wait complete. 2024-09-19T06:16:18.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.673+0000 7fb2d5025740 20 client.25222 trim_cache size 0 max 16384 2024-09-19T06:16:18.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-19T06:16:18.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-19T06:16:18.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-19T06:16:18.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-19T06:16:18.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.673+0000 7fb2d21b0640 1 -- 172.21.15.2:0/3471341251 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb2b40a35e0 msgr2=0x7fb2b40a5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:18.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.673+0000 7fb2d21b0640 1 --2- 172.21.15.2:0/3471341251 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb2b40a35e0 0x7fb2b40a5aa0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc0096c0 tx=0x7fb2bc004120 comp rx=0 tx=0).stop 2024-09-19T06:16:18.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.673+0000 7fb2d21b0640 1 -- 172.21.15.2:0/3471341251 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2cc19cc20 msgr2=0x7fb2cc19d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:18.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.673+0000 7fb2d21b0640 1 --2- 172.21.15.2:0/3471341251 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2cc19cc20 0x7fb2cc19d0d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb2c4009fd0 tx=0x7fb2c400ef10 comp rx=0 tx=0).stop 2024-09-19T06:16:18.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.673+0000 7fb2d21b0640 1 -- 172.21.15.2:0/3471341251 shutdown_connections 2024-09-19T06:16:18.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.673+0000 7fb2d21b0640 1 --2- 172.21.15.2:0/3471341251 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb2b40a35e0 0x7fb2b40a5aa0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:18.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.673+0000 7fb2d21b0640 1 --2- 172.21.15.2:0/3471341251 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2cc19cc20 0x7fb2cc19d0d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:18.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.673+0000 7fb2d21b0640 1 --2- 172.21.15.2:0/3471341251 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2cc105500 0x7fb2cc1988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:18.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.673+0000 7fb2d21b0640 1 --2- 172.21.15.2:0/3471341251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2cc100810 0x7fb2cc198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:18.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.673+0000 7fb2d21b0640 1 -- 172.21.15.2:0/3471341251 >> 172.21.15.2:0/3471341251 conn(0x7fb2cc075eb0 msgr2=0x7fb2cc0fe9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:18.679 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.673+0000 7fb2d21b0640 1 -- 172.21.15.2:0/3471341251 shutdown_connections 2024-09-19T06:16:18.679 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:18.673+0000 7fb2d21b0640 1 -- 172.21.15.2:0/3471341251 wait complete. 2024-09-19T06:16:18.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:18 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/3690100458' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:16:18.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:18 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/3690100458' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:16:18.953 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:16:19.341 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:19 smithi002 ceph-mon[30982]: pgmap v48: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 67 MiB/s wr, 25 op/s 2024-09-19T06:16:19.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.440+0000 7f569593b640 1 -- 172.21.15.2:0/3196411433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5690100e20 msgr2=0x7f5690101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:19.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.440+0000 7f569593b640 1 --2- 172.21.15.2:0/3196411433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5690100e20 0x7f5690101200 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5680009900 tx=0x7f568002a480 comp rx=0 tx=0).stop 2024-09-19T06:16:19.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.440+0000 7f569593b640 1 -- 172.21.15.2:0/3196411433 shutdown_connections 2024-09-19T06:16:19.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.440+0000 7f569593b640 1 --2- 172.21.15.2:0/3196411433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5690102ef0 0x7f569010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:19.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.440+0000 7f569593b640 1 --2- 172.21.15.2:0/3196411433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5690102570 0x7f56901029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:19.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.440+0000 7f569593b640 1 --2- 172.21.15.2:0/3196411433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5690100e20 0x7f5690101200 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:19.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.440+0000 7f569593b640 1 -- 172.21.15.2:0/3196411433 >> 172.21.15.2:0/3196411433 conn(0x7f56900fc7d0 msgr2=0x7f56900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:19.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.441+0000 7f569593b640 1 -- 172.21.15.2:0/3196411433 shutdown_connections 2024-09-19T06:16:19.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.441+0000 7f569593b640 1 -- 172.21.15.2:0/3196411433 wait complete. 2024-09-19T06:16:19.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.441+0000 7f569593b640 1 Processor -- start 2024-09-19T06:16:19.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.441+0000 7f569593b640 1 -- start start 2024-09-19T06:16:19.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.441+0000 7f569593b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5690100e20 0x7f5690107ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:19.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.441+0000 7f569593b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5690102570 0x7f5690108020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:19.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.441+0000 7f569593b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5690102ef0 0x7f5690108560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:19.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.442+0000 7f569593b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5690110e80 con 0x7f5690102ef0 2024-09-19T06:16:19.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.442+0000 7f569593b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f5690110d00 con 0x7f5690102570 2024-09-19T06:16:19.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.442+0000 7f569593b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5690111000 con 0x7f5690100e20 2024-09-19T06:16:19.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.442+0000 7f568f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5690102ef0 0x7f5690108560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:19.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.442+0000 7f568f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5690102ef0 0x7f5690108560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37186/0 (socket says 172.21.15.2:37186) 2024-09-19T06:16:19.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.442+0000 7f568f7fe640 1 -- 172.21.15.2:0/3707734795 learned_addr learned my addr 172.21.15.2:0/3707734795 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:19.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.442+0000 7f568effd640 1 --2- 172.21.15.2:0/3707734795 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5690100e20 0x7f5690107ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:19.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.442+0000 7f5687fff640 1 --2- 172.21.15.2:0/3707734795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5690102570 0x7f5690108020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:19.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.442+0000 7f568f7fe640 1 -- 172.21.15.2:0/3707734795 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5690100e20 msgr2=0x7f5690107ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:19.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.442+0000 7f568f7fe640 1 --2- 172.21.15.2:0/3707734795 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5690100e20 0x7f5690107ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:19.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.442+0000 7f568f7fe640 1 -- 172.21.15.2:0/3707734795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5690102570 msgr2=0x7f5690108020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:19.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.442+0000 7f568f7fe640 1 --2- 172.21.15.2:0/3707734795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5690102570 0x7f5690108020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:19.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.442+0000 7f568f7fe640 1 -- 172.21.15.2:0/3707734795 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56901a68d0 con 0x7f5690102ef0 2024-09-19T06:16:19.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.442+0000 7f568f7fe640 1 --2- 172.21.15.2:0/3707734795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5690102ef0 0x7f5690108560 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5688009fd0 tx=0x7f568800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:19.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.442+0000 7f5694939640 1 -- 172.21.15.2:0/3707734795 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5688017070 con 0x7f5690102ef0 2024-09-19T06:16:19.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.442+0000 7f569593b640 1 -- 172.21.15.2:0/3707734795 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56901a6bc0 con 0x7f5690102ef0 2024-09-19T06:16:19.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.442+0000 7f5694939640 1 -- 172.21.15.2:0/3707734795 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5688003e20 con 0x7f5690102ef0 2024-09-19T06:16:19.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.443+0000 7f5694939640 1 -- 172.21.15.2:0/3707734795 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5688010460 con 0x7f5690102ef0 2024-09-19T06:16:19.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.443+0000 7f569593b640 1 -- 172.21.15.2:0/3707734795 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56901a70b0 con 0x7f5690102ef0 2024-09-19T06:16:19.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.445+0000 7f5694939640 1 -- 172.21.15.2:0/3707734795 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 24) ==== 138638+0+0 (secure 0 0 0) 0x7f5688003970 con 0x7f5690102ef0 2024-09-19T06:16:19.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.445+0000 7f5697d14740 1 Processor -- start 2024-09-19T06:16:19.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.446+0000 7f5697d14740 1 -- start start 2024-09-19T06:16:19.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.446+0000 7f5697d14740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55817b226b40 0x55817b225090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:19.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.446+0000 7f5697d14740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55817b2255d0 0x55817b225a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:19.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.446+0000 7f5697d14740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55817b230370 0x55817b232760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:19.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.446+0000 7f5697d14740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55817b18b2f0 con 0x55817b2255d0 2024-09-19T06:16:19.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.446+0000 7f5697d14740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55817b132cf0 con 0x55817b230370 2024-09-19T06:16:19.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.446+0000 7f5697d14740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55817b1872b0 con 0x55817b226b40 2024-09-19T06:16:19.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.446+0000 7f568effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55817b2255d0 0x55817b225a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:19.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.446+0000 7f568effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55817b2255d0 0x55817b225a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37192/0 (socket says 172.21.15.2:37192) 2024-09-19T06:16:19.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.446+0000 7f568effd640 1 -- 172.21.15.2:0/3740119049 learned_addr learned my addr 172.21.15.2:0/3740119049 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:19.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.446+0000 7f5687fff640 1 --2- 172.21.15.2:0/3740119049 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55817b226b40 0x55817b225090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:19.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.446+0000 7f5687fff640 1 --2- 172.21.15.2:0/3740119049 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55817b230370 0x55817b232760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:19.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.446+0000 7f568effd640 1 -- 172.21.15.2:0/3740119049 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55817b226b40 msgr2=0x55817b225090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:19.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.446+0000 7f568effd640 1 --2- 172.21.15.2:0/3740119049 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55817b226b40 0x55817b225090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:19.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.446+0000 7f568effd640 1 -- 172.21.15.2:0/3740119049 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55817b230370 msgr2=0x55817b232760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:19.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.446+0000 7f568effd640 1 --2- 172.21.15.2:0/3740119049 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55817b230370 0x55817b232760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:19.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.446+0000 7f568effd640 1 -- 172.21.15.2:0/3740119049 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55817b1173a0 con 0x55817b2255d0 2024-09-19T06:16:19.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.447+0000 7f5687fff640 1 --2- 172.21.15.2:0/3740119049 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55817b226b40 0x55817b225090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:16:19.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.447+0000 7f5694939640 1 --2- 172.21.15.2:0/3707734795 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f567c0a3560 0x7f567c0a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:19.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.447+0000 7f568effd640 1 --2- 172.21.15.2:0/3740119049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55817b2255d0 0x55817b225a10 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5680009900 tx=0x7f5680004180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a09d822887250b26 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:19.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.447+0000 7f5687fff640 1 --2- 172.21.15.2:0/3707734795 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f567c0a3560 0x7f567c0a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:19.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.447+0000 7f5694939640 1 -- 172.21.15.2:0/3707734795 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f56880cfd10 con 0x7f5690102ef0 2024-09-19T06:16:19.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.447+0000 7f5685ffb640 1 -- 172.21.15.2:0/3740119049 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5680035040 con 0x55817b2255d0 2024-09-19T06:16:19.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.447+0000 7f5685ffb640 1 -- 172.21.15.2:0/3740119049 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f56800054f0 con 0x55817b2255d0 2024-09-19T06:16:19.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.447+0000 7f5685ffb640 1 -- 172.21.15.2:0/3740119049 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5680003850 con 0x55817b2255d0 2024-09-19T06:16:19.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.448+0000 7f5697d14740 1 -- 172.21.15.2:0/3740119049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55817b2255d0 msgr2=0x55817b225a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:19.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.448+0000 7f5697d14740 1 --2- 172.21.15.2:0/3740119049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55817b2255d0 0x55817b225a10 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5680009900 tx=0x7f5680004180 comp rx=0 tx=0).stop 2024-09-19T06:16:19.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.448+0000 7f5687fff640 1 --2- 172.21.15.2:0/3707734795 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f567c0a3560 0x7f567c0a5a20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x55817b226070 tx=0x7f5678005f90 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:19.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.448+0000 7f5697d14740 1 -- 172.21.15.2:0/3740119049 shutdown_connections 2024-09-19T06:16:19.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.448+0000 7f5697d14740 1 --2- 172.21.15.2:0/3740119049 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55817b230370 0x55817b232760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:19.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.448+0000 7f5697d14740 1 --2- 172.21.15.2:0/3740119049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55817b2255d0 0x55817b225a10 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:19.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.448+0000 7f5697d14740 1 --2- 172.21.15.2:0/3740119049 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55817b226b40 0x55817b225090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:19.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.448+0000 7f5697d14740 1 -- 172.21.15.2:0/3740119049 >> 172.21.15.2:0/3740119049 conn(0x55817b1ee310 msgr2=0x55817b221c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:19.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.448+0000 7f5697d14740 1 -- 172.21.15.2:0/3740119049 shutdown_connections 2024-09-19T06:16:19.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.448+0000 7f5697d14740 1 -- 172.21.15.2:0/3740119049 wait complete. 2024-09-19T06:16:19.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.449+0000 7f5697d14740 1 -- start start 2024-09-19T06:16:19.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.449+0000 7f5697d14740 1 Processor -- start 2024-09-19T06:16:19.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.450+0000 7f5697d14740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55817b2255d0 0x55817b22fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:19.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.450+0000 7f5697d14740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55817b226b40 0x55817b22d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:19.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.450+0000 7f5697d14740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55817b230370 0x55817b22d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:19.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.450+0000 7f5697d14740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55817b233010 con 0x55817b230370 2024-09-19T06:16:19.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.450+0000 7f5697d14740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55817b146060 con 0x55817b2255d0 2024-09-19T06:16:19.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.450+0000 7f5697d14740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55817b233190 con 0x55817b226b40 2024-09-19T06:16:19.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.450+0000 7f5697d14740 10 client.0 _ll_register_callbacks cb 0x55817ae998c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:19.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.450+0000 7f568f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55817b230370 0x55817b22d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:19.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.450+0000 7f568effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55817b2255d0 0x55817b22fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:19.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.450+0000 7f568f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55817b230370 0x55817b22d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37194/0 (socket says 172.21.15.2:37194) 2024-09-19T06:16:19.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.450+0000 7f568f7fe640 1 -- 172.21.15.2:0/1574849480 learned_addr learned my addr 172.21.15.2:0/1574849480 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:19.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.450+0000 7f568effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55817b2255d0 0x55817b22fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:56162/0 (socket says 172.21.15.2:56162) 2024-09-19T06:16:19.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.450+0000 7f5687fff640 1 --2- 172.21.15.2:0/1574849480 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55817b226b40 0x55817b22d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:19.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.450+0000 7f568effd640 1 -- 172.21.15.2:0/1574849480 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55817b226b40 msgr2=0x55817b22d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:19.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.450+0000 7f568effd640 1 --2- 172.21.15.2:0/1574849480 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55817b226b40 0x55817b22d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:19.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.450+0000 7f568effd640 1 -- 172.21.15.2:0/1574849480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55817b230370 msgr2=0x55817b22d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:19.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.450+0000 7f568effd640 1 --2- 172.21.15.2:0/1574849480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55817b230370 0x55817b22d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:19.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.450+0000 7f568effd640 1 -- 172.21.15.2:0/1574849480 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55817aefc3c0 con 0x55817b2255d0 2024-09-19T06:16:19.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.450+0000 7f568f7fe640 1 --2- 172.21.15.2:0/1574849480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55817b230370 0x55817b22d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:19.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.451+0000 7f568effd640 1 --2- 172.21.15.2:0/1574849480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55817b2255d0 0x55817b22fdb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f568002a9a0 tx=0x7f56800045e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37b27270ea25a418 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:19.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.451+0000 7f566effd640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-09-19T06:16:19.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.451+0000 7f566effd640 1 -- 172.21.15.2:0/1574849480 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5680052060 con 0x55817b2255d0 2024-09-19T06:16:19.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.451+0000 7f566effd640 1 -- 172.21.15.2:0/1574849480 <== mon.2 v2:172.21.15.89:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f5680004e60 con 0x55817b2255d0 2024-09-19T06:16:19.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.451+0000 7f5697d14740 1 -- 172.21.15.2:0/1574849480 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56800054f0 con 0x55817b2255d0 2024-09-19T06:16:19.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.451+0000 7f566effd640 1 -- 172.21.15.2:0/1574849480 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5680035070 con 0x55817b2255d0 2024-09-19T06:16:19.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.451+0000 7f5697d14740 10 client.25292 fetch_fsmap learned FSMap version 26 2024-09-19T06:16:19.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.451+0000 7f5697d14740 1 -- 172.21.15.2:0/1574849480 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55817b23eb00 con 0x55817b2255d0 2024-09-19T06:16:19.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.451+0000 7f566effd640 1 -- 172.21.15.2:0/1574849480 <== mon.2 v2:172.21.15.89:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f56800054f0 con 0x55817b2255d0 2024-09-19T06:16:19.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.452+0000 7f566effd640 1 -- 172.21.15.2:0/1574849480 <== mon.2 v2:172.21.15.89:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f5680003b30 con 0x55817b2255d0 2024-09-19T06:16:19.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.452+0000 7f5697d14740 10 client.25292 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:16:19.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.452+0000 7f5697d14740 10 client.25292 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:16:19.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.452+0000 7f5697d14740 20 client.25292 populate_metadata read hostname 'smithi002' 2024-09-19T06:16:19.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.452+0000 7f5697d14740 1 --2- 172.21.15.2:0/1574849480 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55817b23fe50 0x55817b242240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:19.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.452+0000 7f5697d14740 4 client.25292 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:16:19.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.452+0000 7f5697d14740 1 -- 172.21.15.2:0/1574849480 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55817b198860 con 0x55817b23fe50 2024-09-19T06:16:19.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.452+0000 7f5687fff640 1 --2- 172.21.15.2:0/1574849480 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55817b23fe50 0x55817b242240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:19.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.453+0000 7f566effd640 10 client.25292 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:16:19.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.453+0000 7f5687fff640 1 --2- 172.21.15.2:0/1574849480 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55817b23fe50 0x55817b242240 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a028aa011ac258c3 server_cookie=d5e45e4ab0470e92 in_seq=0 out_seq=0 2024-09-19T06:16:19.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.453+0000 7f566effd640 1 -- 172.21.15.2:0/1574849480 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55817b198860 con 0x55817b23fe50 2024-09-19T06:16:19.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.453+0000 7f566effd640 10 client.25292 handle_command_reply: tid=0 2024-09-19T06:16:19.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.453+0000 7f5697d14740 1 client.25292 shutdown 2024-09-19T06:16:19.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.453+0000 7f5697d14740 1 -- 172.21.15.2:0/1574849480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55817b2255d0 msgr2=0x55817b22fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:19.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.453+0000 7f5697d14740 1 --2- 172.21.15.2:0/1574849480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55817b2255d0 0x55817b22fdb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f568002a9a0 tx=0x7f56800045e0 comp rx=0 tx=0).stop 2024-09-19T06:16:19.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.454+0000 7f5697d14740 1 -- 172.21.15.2:0/1574849480 shutdown_connections 2024-09-19T06:16:19.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.454+0000 7f5697d14740 1 --2- 172.21.15.2:0/1574849480 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55817b23fe50 0x55817b242240 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:19.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.454+0000 7f5697d14740 1 --2- 172.21.15.2:0/1574849480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55817b230370 0x55817b22d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:19.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.454+0000 7f5697d14740 1 --2- 172.21.15.2:0/1574849480 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55817b226b40 0x55817b22d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:19.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.454+0000 7f5697d14740 1 --2- 172.21.15.2:0/1574849480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55817b2255d0 0x55817b22fdb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:19.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.454+0000 7f566effd640 0 client.25292 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:16:19.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.454+0000 7f5697d14740 1 -- 172.21.15.2:0/1574849480 >> 172.21.15.2:0/1574849480 conn(0x55817b1ee310 msgr2=0x55817b227960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:19.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.454+0000 7f5697d14740 1 -- 172.21.15.2:0/1574849480 shutdown_connections 2024-09-19T06:16:19.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.454+0000 7f5697d14740 1 -- 172.21.15.2:0/1574849480 wait complete. 2024-09-19T06:16:19.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.454+0000 7f5697d14740 20 client.25292 trim_cache size 0 max 16384 2024-09-19T06:16:19.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.475+0000 7f5697d14740 1 Processor -- start 2024-09-19T06:16:19.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.475+0000 7f5697d14740 1 -- start start 2024-09-19T06:16:19.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.476+0000 7f5697d14740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55817b2255d0 0x55817b226410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:19.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.476+0000 7f5697d14740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55817b226b40 0x55817b22c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:19.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.476+0000 7f5697d14740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55817b230370 0x55817b245260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:19.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.476+0000 7f5697d14740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f56901b2140 con 0x55817b230370 2024-09-19T06:16:19.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.476+0000 7f5697d14740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f56901afa10 con 0x55817b226b40 2024-09-19T06:16:19.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.476+0000 7f5697d14740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f56901ad860 con 0x55817b2255d0 2024-09-19T06:16:19.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.476+0000 7f568f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55817b230370 0x55817b245260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:19.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.476+0000 7f568effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55817b2255d0 0x55817b226410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:19.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.476+0000 7f568f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55817b230370 0x55817b245260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37200/0 (socket says 172.21.15.2:37200) 2024-09-19T06:16:19.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.476+0000 7f568f7fe640 1 -- 172.21.15.2:0/3124252165 learned_addr learned my addr 172.21.15.2:0/3124252165 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:19.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.476+0000 7f568effd640 1 --2- 172.21.15.2:0/3124252165 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55817b2255d0 0x55817b226410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:55896/0 (socket says 172.21.15.2:55896) 2024-09-19T06:16:19.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.476+0000 7f5687fff640 1 --2- 172.21.15.2:0/3124252165 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55817b226b40 0x55817b22c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:19.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.476+0000 7f568f7fe640 1 -- 172.21.15.2:0/3124252165 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55817b2255d0 msgr2=0x55817b226410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:19.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.476+0000 7f568f7fe640 1 --2- 172.21.15.2:0/3124252165 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55817b2255d0 0x55817b226410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:19.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.476+0000 7f568f7fe640 1 -- 172.21.15.2:0/3124252165 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55817b226b40 msgr2=0x55817b22c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:19.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.476+0000 7f568f7fe640 1 --2- 172.21.15.2:0/3124252165 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55817b226b40 0x55817b22c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:19.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.476+0000 7f568f7fe640 1 -- 172.21.15.2:0/3124252165 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55817b222960 con 0x55817b230370 2024-09-19T06:16:19.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.477+0000 7f568f7fe640 1 --2- 172.21.15.2:0/3124252165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55817b230370 0x55817b245260 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f56880cd390 tx=0x7f5688003d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d87ef8038db7398 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:19.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.477+0000 7f56857fa640 1 -- 172.21.15.2:0/3124252165 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5688020040 con 0x55817b230370 2024-09-19T06:16:19.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.477+0000 7f56857fa640 1 -- 172.21.15.2:0/3124252165 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f56880a4a50 con 0x55817b230370 2024-09-19T06:16:19.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.477+0000 7f56857fa640 1 -- 172.21.15.2:0/3124252165 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56880cd560 con 0x55817b230370 2024-09-19T06:16:19.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.478+0000 7f5697d14740 1 -- 172.21.15.2:0/3124252165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55817b230370 msgr2=0x55817b245260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:19.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.478+0000 7f5697d14740 1 --2- 172.21.15.2:0/3124252165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55817b230370 0x55817b245260 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f56880cd390 tx=0x7f5688003d70 comp rx=0 tx=0).stop 2024-09-19T06:16:19.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.478+0000 7f5697d14740 1 -- 172.21.15.2:0/3124252165 shutdown_connections 2024-09-19T06:16:19.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.478+0000 7f5697d14740 1 --2- 172.21.15.2:0/3124252165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55817b230370 0x55817b245260 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:19.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.478+0000 7f5697d14740 1 --2- 172.21.15.2:0/3124252165 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55817b226b40 0x55817b22c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:19.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.478+0000 7f5697d14740 1 --2- 172.21.15.2:0/3124252165 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55817b2255d0 0x55817b226410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:19.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.478+0000 7f5697d14740 1 -- 172.21.15.2:0/3124252165 >> 172.21.15.2:0/3124252165 conn(0x55817b1ee310 msgr2=0x55817b22b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:19.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.478+0000 7f5697d14740 1 -- 172.21.15.2:0/3124252165 shutdown_connections 2024-09-19T06:16:19.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.478+0000 7f5697d14740 1 -- 172.21.15.2:0/3124252165 wait complete. 2024-09-19T06:16:19.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.478+0000 7f5697d14740 1 -- start start 2024-09-19T06:16:19.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.478+0000 7f5697d14740 1 Processor -- start 2024-09-19T06:16:19.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.479+0000 7f5697d14740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55817b2255d0 0x55817b245860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:19.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.479+0000 7f5697d14740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55817b226b40 0x55817b242bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:19.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.479+0000 7f5697d14740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55817b230370 0x55817b2430f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:19.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.479+0000 7f5697d14740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f56901aded0 con 0x55817b230370 2024-09-19T06:16:19.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.479+0000 7f5697d14740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f56901af340 con 0x55817b2255d0 2024-09-19T06:16:19.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.479+0000 7f5697d14740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f56901ae5a0 con 0x55817b226b40 2024-09-19T06:16:19.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.479+0000 7f5697d14740 10 client.0 _ll_register_callbacks cb 0x7f56800040d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:19.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.479+0000 7f5687fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55817b226b40 0x55817b242bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:19.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.479+0000 7f568effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55817b2255d0 0x55817b245860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:19.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.479+0000 7f568f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55817b230370 0x55817b2430f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:19.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.479+0000 7f568effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55817b2255d0 0x55817b245860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:56182/0 (socket says 172.21.15.2:56182) 2024-09-19T06:16:19.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.479+0000 7f568f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55817b230370 0x55817b2430f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37204/0 (socket says 172.21.15.2:37204) 2024-09-19T06:16:19.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.479+0000 7f568effd640 1 -- 172.21.15.2:0/423702584 learned_addr learned my addr 172.21.15.2:0/423702584 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:19.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.479+0000 7f568effd640 1 -- 172.21.15.2:0/423702584 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55817b226b40 msgr2=0x55817b242bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:19.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.479+0000 7f568effd640 1 --2- 172.21.15.2:0/423702584 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55817b226b40 0x55817b242bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:19.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.479+0000 7f568effd640 1 -- 172.21.15.2:0/423702584 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55817b230370 msgr2=0x55817b2430f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:19.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.479+0000 7f568effd640 1 --2- 172.21.15.2:0/423702584 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55817b230370 0x55817b2430f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:19.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.479+0000 7f568effd640 1 -- 172.21.15.2:0/423702584 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55817b243790 con 0x55817b2255d0 2024-09-19T06:16:19.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.479+0000 7f5687fff640 1 --2- 172.21.15.2:0/423702584 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55817b226b40 0x55817b242bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:19.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.480+0000 7f568effd640 1 --2- 172.21.15.2:0/423702584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55817b2255d0 0x55817b245860 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f568002a9a0 tx=0x7f5680003820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aac2980b7010922c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:19.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.480+0000 7f566effd640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-09-19T06:16:19.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.480+0000 7f566effd640 1 -- 172.21.15.2:0/423702584 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5680052040 con 0x55817b2255d0 2024-09-19T06:16:19.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.480+0000 7f5697d14740 1 -- 172.21.15.2:0/423702584 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56880a4a50 con 0x55817b2255d0 2024-09-19T06:16:19.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.480+0000 7f566effd640 1 -- 172.21.15.2:0/423702584 <== mon.2 v2:172.21.15.89:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f5680059e50 con 0x55817b2255d0 2024-09-19T06:16:19.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.480+0000 7f566effd640 1 -- 172.21.15.2:0/423702584 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f568005c080 con 0x55817b2255d0 2024-09-19T06:16:19.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.480+0000 7f5697d14740 10 client.25298 fetch_fsmap learned FSMap version 26 2024-09-19T06:16:19.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.480+0000 7f5697d14740 1 -- 172.21.15.2:0/423702584 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55817b2aa620 con 0x55817b2255d0 2024-09-19T06:16:19.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.480+0000 7f566effd640 1 -- 172.21.15.2:0/423702584 <== mon.2 v2:172.21.15.89:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f56880a4a50 con 0x55817b2255d0 2024-09-19T06:16:19.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.480+0000 7f566effd640 1 -- 172.21.15.2:0/423702584 <== mon.2 v2:172.21.15.89:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f5680059110 con 0x55817b2255d0 2024-09-19T06:16:19.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.480+0000 7f5697d14740 10 client.25298 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:16:19.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.480+0000 7f5697d14740 10 client.25298 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:16:19.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.480+0000 7f5697d14740 20 client.25298 populate_metadata read hostname 'smithi002' 2024-09-19T06:16:19.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.480+0000 7f5697d14740 1 --2- 172.21.15.2:0/423702584 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55817b2aace0 0x55817b2ad100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:19.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.481+0000 7f5697d14740 4 client.25298 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:16:19.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.481+0000 7f5697d14740 1 -- 172.21.15.2:0/423702584 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55817b192d70 con 0x55817b2aace0 2024-09-19T06:16:19.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.481+0000 7f5687fff640 1 --2- 172.21.15.2:0/423702584 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55817b2aace0 0x55817b2ad100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:19.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.481+0000 7f5687fff640 1 --2- 172.21.15.2:0/423702584 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55817b2aace0 0x55817b2ad100 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1f6604dfc7fc6a9c server_cookie=abfe5e14e1ae2b7 in_seq=0 out_seq=0 2024-09-19T06:16:19.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.481+0000 7f566effd640 10 client.25298 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:16:19.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.481+0000 7f566effd640 1 -- 172.21.15.2:0/423702584 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55817b192d70 con 0x55817b2aace0 2024-09-19T06:16:19.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.481+0000 7f566effd640 10 client.25298 handle_command_reply: tid=0 2024-09-19T06:16:19.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.481+0000 7f5697d14740 1 client.25298 shutdown 2024-09-19T06:16:19.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.482+0000 7f5697d14740 1 -- 172.21.15.2:0/423702584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55817b2255d0 msgr2=0x55817b245860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:19.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.482+0000 7f5697d14740 1 --2- 172.21.15.2:0/423702584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55817b2255d0 0x55817b245860 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f568002a9a0 tx=0x7f5680003820 comp rx=0 tx=0).stop 2024-09-19T06:16:19.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.482+0000 7f5697d14740 1 -- 172.21.15.2:0/423702584 shutdown_connections 2024-09-19T06:16:19.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.482+0000 7f5697d14740 1 --2- 172.21.15.2:0/423702584 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55817b2aace0 0x55817b2ad100 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:19.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.482+0000 7f566effd640 0 client.25298 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:16:19.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.482+0000 7f5697d14740 1 --2- 172.21.15.2:0/423702584 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55817b230370 0x55817b2430f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:19.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.482+0000 7f5697d14740 1 --2- 172.21.15.2:0/423702584 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55817b226b40 0x55817b242bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:19.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.482+0000 7f5697d14740 1 --2- 172.21.15.2:0/423702584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55817b2255d0 0x55817b245860 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:19.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.482+0000 7f5697d14740 1 -- 172.21.15.2:0/423702584 >> 172.21.15.2:0/423702584 conn(0x55817b1ee310 msgr2=0x55817b22c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:19.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.482+0000 7f5697d14740 1 -- 172.21.15.2:0/423702584 shutdown_connections 2024-09-19T06:16:19.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.482+0000 7f5697d14740 1 -- 172.21.15.2:0/423702584 wait complete. 2024-09-19T06:16:19.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.482+0000 7f5697d14740 20 client.25298 trim_cache size 0 max 16384 2024-09-19T06:16:19.489 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:16:19.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.483+0000 7f569593b640 1 -- 172.21.15.2:0/3707734795 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f567c0a3560 msgr2=0x7f567c0a5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:19.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.483+0000 7f569593b640 1 --2- 172.21.15.2:0/3707734795 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f567c0a3560 0x7f567c0a5a20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x55817b226070 tx=0x7f5678005f90 comp rx=0 tx=0).stop 2024-09-19T06:16:19.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.483+0000 7f569593b640 1 -- 172.21.15.2:0/3707734795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5690102ef0 msgr2=0x7f5690108560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:19.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.483+0000 7f569593b640 1 --2- 172.21.15.2:0/3707734795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5690102ef0 0x7f5690108560 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5688009fd0 tx=0x7f568800b260 comp rx=0 tx=0).stop 2024-09-19T06:16:19.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.483+0000 7f569593b640 1 -- 172.21.15.2:0/3707734795 shutdown_connections 2024-09-19T06:16:19.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.483+0000 7f569593b640 1 --2- 172.21.15.2:0/3707734795 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f567c0a3560 0x7f567c0a5a20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:19.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.483+0000 7f569593b640 1 --2- 172.21.15.2:0/3707734795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5690102ef0 0x7f5690108560 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:19.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.483+0000 7f569593b640 1 --2- 172.21.15.2:0/3707734795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5690102570 0x7f5690108020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:19.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.483+0000 7f569593b640 1 --2- 172.21.15.2:0/3707734795 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5690100e20 0x7f5690107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:19.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.483+0000 7f569593b640 1 -- 172.21.15.2:0/3707734795 >> 172.21.15.2:0/3707734795 conn(0x7f56900fc7d0 msgr2=0x7f56900fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:19.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.483+0000 7f569593b640 1 -- 172.21.15.2:0/3707734795 shutdown_connections 2024-09-19T06:16:19.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:19.483+0000 7f569593b640 1 -- 172.21.15.2:0/3707734795 wait complete. 2024-09-19T06:16:19.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:19 smithi090 ceph-mon[34497]: pgmap v48: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 67 MiB/s wr, 25 op/s 2024-09-19T06:16:19.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:19 smithi089 ceph-mon[34160]: pgmap v48: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 67 MiB/s wr, 25 op/s 2024-09-19T06:16:20.271 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:16:20.621 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:16:21.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.219+0000 7f7f8507a640 1 -- 172.21.15.2:0/2248171123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f8010e4d0 msgr2=0x7f7f801108e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:21.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.219+0000 7f7f8507a640 1 --2- 172.21.15.2:0/2248171123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f8010e4d0 0x7f7f801108e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7f78009ca0 tx=0x7f7f7802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:16:21.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.219+0000 7f7f8507a640 1 -- 172.21.15.2:0/2248171123 shutdown_connections 2024-09-19T06:16:21.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.219+0000 7f7f8507a640 1 --2- 172.21.15.2:0/2248171123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f8010e4d0 0x7f7f801108e0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:21.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.219+0000 7f7f8507a640 1 --2- 172.21.15.2:0/2248171123 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f80101360 0x7f7f8010df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:21.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.219+0000 7f7f8507a640 1 --2- 172.21.15.2:0/2248171123 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f801009b0 0x7f7f80100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:21.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.219+0000 7f7f8507a640 1 -- 172.21.15.2:0/2248171123 >> 172.21.15.2:0/2248171123 conn(0x7f7f800fc7d0 msgr2=0x7f7f800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:21.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.219+0000 7f7f8507a640 1 -- 172.21.15.2:0/2248171123 shutdown_connections 2024-09-19T06:16:21.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.219+0000 7f7f8507a640 1 -- 172.21.15.2:0/2248171123 wait complete. 2024-09-19T06:16:21.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.220+0000 7f7f8507a640 1 Processor -- start 2024-09-19T06:16:21.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.220+0000 7f7f8507a640 1 -- start start 2024-09-19T06:16:21.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.220+0000 7f7f8507a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f801009b0 0x7f7f8019a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:21.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.220+0000 7f7f8507a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f80101360 0x7f7f8019abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:21.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.220+0000 7f7f8507a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f8010e4d0 0x7f7f8019ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:21.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.220+0000 7f7f8507a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7f801140b0 con 0x7f7f8010e4d0 2024-09-19T06:16:21.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.220+0000 7f7f8507a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7f80113f30 con 0x7f7f801009b0 2024-09-19T06:16:21.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.220+0000 7f7f8507a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7f80114230 con 0x7f7f80101360 2024-09-19T06:16:21.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.221+0000 7f7f7f59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f8010e4d0 0x7f7f8019ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:21.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.221+0000 7f7f7f59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f8010e4d0 0x7f7f8019ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37214/0 (socket says 172.21.15.2:37214) 2024-09-19T06:16:21.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.221+0000 7f7f7f59e640 1 -- 172.21.15.2:0/1024712001 learned_addr learned my addr 172.21.15.2:0/1024712001 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:21.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.221+0000 7f7f7ed9d640 1 --2- 172.21.15.2:0/1024712001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f801009b0 0x7f7f8019a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:21.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.221+0000 7f7f7e59c640 1 --2- 172.21.15.2:0/1024712001 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f80101360 0x7f7f8019abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:21.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.221+0000 7f7f7e59c640 1 -- 172.21.15.2:0/1024712001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f801009b0 msgr2=0x7f7f8019a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:21.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.221+0000 7f7f7e59c640 1 --2- 172.21.15.2:0/1024712001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f801009b0 0x7f7f8019a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:21.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.221+0000 7f7f7e59c640 1 -- 172.21.15.2:0/1024712001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f8010e4d0 msgr2=0x7f7f8019ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:21.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.221+0000 7f7f7e59c640 1 --2- 172.21.15.2:0/1024712001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f8010e4d0 0x7f7f8019ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:21.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.221+0000 7f7f7e59c640 1 -- 172.21.15.2:0/1024712001 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f8019f660 con 0x7f7f80101360 2024-09-19T06:16:21.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.221+0000 7f7f7f59e640 1 --2- 172.21.15.2:0/1024712001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f8010e4d0 0x7f7f8019ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:21.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.221+0000 7f7f7e59c640 1 --2- 172.21.15.2:0/1024712001 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f80101360 0x7f7f8019abf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400e9f0 tx=0x7f7f7400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:21.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.222+0000 7f7f67fff640 1 -- 172.21.15.2:0/1024712001 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7400ccc0 con 0x7f7f80101360 2024-09-19T06:16:21.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.222+0000 7f7f67fff640 1 -- 172.21.15.2:0/1024712001 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7f740108e0 con 0x7f7f80101360 2024-09-19T06:16:21.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.222+0000 7f7f8507a640 1 -- 172.21.15.2:0/1024712001 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f8019f950 con 0x7f7f80101360 2024-09-19T06:16:21.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.222+0000 7f7f67fff640 1 -- 172.21.15.2:0/1024712001 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f74018880 con 0x7f7f80101360 2024-09-19T06:16:21.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.222+0000 7f7f8507a640 1 -- 172.21.15.2:0/1024712001 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f801a7230 con 0x7f7f80101360 2024-09-19T06:16:21.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.225+0000 7f7f67fff640 1 -- 172.21.15.2:0/1024712001 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f7f74010a90 con 0x7f7f80101360 2024-09-19T06:16:21.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.225+0000 7f7f67fff640 1 --2- 172.21.15.2:0/1024712001 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f7f680a3430 0x7f7f680a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:21.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.225+0000 7f7f87453740 1 Processor -- start 2024-09-19T06:16:21.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.225+0000 7f7f87453740 1 -- start start 2024-09-19T06:16:21.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.226+0000 7f7f7ed9d640 1 --2- 172.21.15.2:0/1024712001 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f7f680a3430 0x7f7f680a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:21.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.226+0000 7f7f67fff640 1 -- 172.21.15.2:0/1024712001 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f7f740cff20 con 0x7f7f80101360 2024-09-19T06:16:21.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.226+0000 7f7f87453740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b948df7b40 0x55b948df6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:21.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.226+0000 7f7f87453740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b948df65d0 0x55b948df6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:21.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.226+0000 7f7f87453740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b948e01370 0x55b948e03760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:21.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.226+0000 7f7f87453740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b948d5c2f0 con 0x55b948df65d0 2024-09-19T06:16:21.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.226+0000 7f7f87453740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55b948d03cf0 con 0x55b948df7b40 2024-09-19T06:16:21.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.226+0000 7f7f87453740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55b948d582b0 con 0x55b948e01370 2024-09-19T06:16:21.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.226+0000 7f7f7e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b948df65d0 0x55b948df6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:21.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.226+0000 7f7f7e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b948df65d0 0x55b948df6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37222/0 (socket says 172.21.15.2:37222) 2024-09-19T06:16:21.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.226+0000 7f7f7e59c640 1 -- 172.21.15.2:0/3313422304 learned_addr learned my addr 172.21.15.2:0/3313422304 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:21.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.226+0000 7f7f7ed9d640 1 --2- 172.21.15.2:0/3313422304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b948df7b40 0x55b948df6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:21.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.226+0000 7f7f7e59c640 1 -- 172.21.15.2:0/3313422304 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b948e01370 msgr2=0x55b948e03760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:16:21.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.226+0000 7f7f7e59c640 1 --2- 172.21.15.2:0/3313422304 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b948e01370 0x55b948e03760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:21.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.226+0000 7f7f7e59c640 1 -- 172.21.15.2:0/3313422304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b948df7b40 msgr2=0x55b948df6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:21.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.226+0000 7f7f7e59c640 1 --2- 172.21.15.2:0/3313422304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b948df7b40 0x55b948df6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:21.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.226+0000 7f7f7e59c640 1 -- 172.21.15.2:0/3313422304 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b948ce83a0 con 0x55b948df65d0 2024-09-19T06:16:21.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.226+0000 7f7f7ed9d640 1 --2- 172.21.15.2:0/3313422304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b948df7b40 0x55b948df6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:16:21.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.226+0000 7f7f7ed9d640 1 --2- 172.21.15.2:0/1024712001 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f7f680a3430 0x7f7f680a58f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7f70009c20 tx=0x7f7f70005f90 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:21.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.227+0000 7f7f7e59c640 1 --2- 172.21.15.2:0/3313422304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b948df65d0 0x55b948df6a10 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f7f74098cb0 tx=0x7f7f74010e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af59081c3ee56d25 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:21.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.227+0000 7f7f657fa640 1 -- 172.21.15.2:0/3313422304 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f740a4ea0 con 0x55b948df65d0 2024-09-19T06:16:21.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.227+0000 7f7f657fa640 1 -- 172.21.15.2:0/3313422304 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7f7409a5e0 con 0x55b948df65d0 2024-09-19T06:16:21.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.227+0000 7f7f657fa640 1 -- 172.21.15.2:0/3313422304 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f740bc320 con 0x55b948df65d0 2024-09-19T06:16:21.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.228+0000 7f7f87453740 1 -- 172.21.15.2:0/3313422304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b948df65d0 msgr2=0x55b948df6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:21.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.228+0000 7f7f87453740 1 --2- 172.21.15.2:0/3313422304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b948df65d0 0x55b948df6a10 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f7f74098cb0 tx=0x7f7f74010e00 comp rx=0 tx=0).stop 2024-09-19T06:16:21.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.228+0000 7f7f87453740 1 -- 172.21.15.2:0/3313422304 shutdown_connections 2024-09-19T06:16:21.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.228+0000 7f7f87453740 1 --2- 172.21.15.2:0/3313422304 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b948e01370 0x55b948e03760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:21.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.228+0000 7f7f87453740 1 --2- 172.21.15.2:0/3313422304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b948df65d0 0x55b948df6a10 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:21.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.228+0000 7f7f87453740 1 --2- 172.21.15.2:0/3313422304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b948df7b40 0x55b948df6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:21.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.228+0000 7f7f87453740 1 -- 172.21.15.2:0/3313422304 >> 172.21.15.2:0/3313422304 conn(0x55b948dbf310 msgr2=0x55b948df2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:21.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.228+0000 7f7f87453740 1 -- 172.21.15.2:0/3313422304 shutdown_connections 2024-09-19T06:16:21.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.228+0000 7f7f87453740 1 -- 172.21.15.2:0/3313422304 wait complete. 2024-09-19T06:16:21.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.228+0000 7f7f87453740 1 -- start start 2024-09-19T06:16:21.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.228+0000 7f7f87453740 1 Processor -- start 2024-09-19T06:16:21.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.229+0000 7f7f87453740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b948df65d0 0x55b948e00d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:21.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.229+0000 7f7f87453740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b948df7b40 0x55b948dfe020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:21.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.229+0000 7f7f7e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b948df7b40 0x55b948dfe020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:21.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.229+0000 7f7f87453740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b948e01370 0x55b948dfe610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:21.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.229+0000 7f7f87453740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b948e04010 con 0x55b948df7b40 2024-09-19T06:16:21.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.229+0000 7f7f87453740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55b948d17060 con 0x55b948df65d0 2024-09-19T06:16:21.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.229+0000 7f7f7e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b948df7b40 0x55b948dfe020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37230/0 (socket says 172.21.15.2:37230) 2024-09-19T06:16:21.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.229+0000 7f7f87453740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55b948e04190 con 0x55b948e01370 2024-09-19T06:16:21.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.229+0000 7f7f7e59c640 1 -- 172.21.15.2:0/104147379 learned_addr learned my addr 172.21.15.2:0/104147379 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:21.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.229+0000 7f7f7ed9d640 1 --2- 172.21.15.2:0/104147379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b948df65d0 0x55b948e00d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:21.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.229+0000 7f7f87453740 10 client.0 _ll_register_callbacks cb 0x55b948a6a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:21.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.229+0000 7f7f7f59e640 1 --2- 172.21.15.2:0/104147379 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b948e01370 0x55b948dfe610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:21.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.229+0000 7f7f7ed9d640 1 -- 172.21.15.2:0/104147379 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b948e01370 msgr2=0x55b948dfe610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:21.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.229+0000 7f7f7ed9d640 1 --2- 172.21.15.2:0/104147379 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b948e01370 0x55b948dfe610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:21.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.229+0000 7f7f7ed9d640 1 -- 172.21.15.2:0/104147379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b948df7b40 msgr2=0x55b948dfe020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:21.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.229+0000 7f7f7ed9d640 1 --2- 172.21.15.2:0/104147379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b948df7b40 0x55b948dfe020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:21.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.229+0000 7f7f7ed9d640 1 -- 172.21.15.2:0/104147379 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b948acd3c0 con 0x55b948df65d0 2024-09-19T06:16:21.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.229+0000 7f7f7e59c640 1 --2- 172.21.15.2:0/104147379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b948df7b40 0x55b948dfe020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:21.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.230+0000 7f7f7ed9d640 1 --2- 172.21.15.2:0/104147379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b948df65d0 0x55b948e00d70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7f7001b970 tx=0x7f7f70004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e72b0a4e58baa3cd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:21.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.230+0000 7f7f62ff5640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-09-19T06:16:21.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.230+0000 7f7f62ff5640 1 -- 172.21.15.2:0/104147379 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f70009da0 con 0x55b948df65d0 2024-09-19T06:16:21.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.230+0000 7f7f62ff5640 1 -- 172.21.15.2:0/104147379 <== mon.2 v2:172.21.15.89:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f7f7001a8c0 con 0x55b948df65d0 2024-09-19T06:16:21.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.230+0000 7f7f87453740 1 -- 172.21.15.2:0/104147379 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f7409a5e0 con 0x55b948df65d0 2024-09-19T06:16:21.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.230+0000 7f7f62ff5640 1 -- 172.21.15.2:0/104147379 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7f7001aac0 con 0x55b948df65d0 2024-09-19T06:16:21.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.230+0000 7f7f87453740 10 client.25307 fetch_fsmap learned FSMap version 26 2024-09-19T06:16:21.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.230+0000 7f7f87453740 1 -- 172.21.15.2:0/104147379 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b948e0fad0 con 0x55b948df65d0 2024-09-19T06:16:21.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.230+0000 7f7f62ff5640 1 -- 172.21.15.2:0/104147379 <== mon.2 v2:172.21.15.89:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7f7409a5e0 con 0x55b948df65d0 2024-09-19T06:16:21.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.230+0000 7f7f62ff5640 1 -- 172.21.15.2:0/104147379 <== mon.2 v2:172.21.15.89:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f7f700049a0 con 0x55b948df65d0 2024-09-19T06:16:21.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.230+0000 7f7f87453740 10 client.25307 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:16:21.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.230+0000 7f7f87453740 10 client.25307 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:16:21.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.230+0000 7f7f87453740 20 client.25307 populate_metadata read hostname 'smithi002' 2024-09-19T06:16:21.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.231+0000 7f7f87453740 1 --2- 172.21.15.2:0/104147379 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55b948e10f90 0x55b948e13380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:21.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.231+0000 7f7f87453740 4 client.25307 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:16:21.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.231+0000 7f7f87453740 1 -- 172.21.15.2:0/104147379 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b948d69860 con 0x55b948e10f90 2024-09-19T06:16:21.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.231+0000 7f7f7e59c640 1 --2- 172.21.15.2:0/104147379 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55b948e10f90 0x55b948e13380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:21.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.231+0000 7f7f62ff5640 10 client.25307 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:16:21.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.231+0000 7f7f7e59c640 1 --2- 172.21.15.2:0/104147379 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55b948e10f90 0x55b948e13380 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a59e76a3f686ee7b server_cookie=308ab6e303afbbb5 in_seq=0 out_seq=0 2024-09-19T06:16:21.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.232+0000 7f7f62ff5640 1 -- 172.21.15.2:0/104147379 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b948d69860 con 0x55b948e10f90 2024-09-19T06:16:21.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.232+0000 7f7f62ff5640 10 client.25307 handle_command_reply: tid=0 2024-09-19T06:16:21.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.232+0000 7f7f87453740 1 client.25307 shutdown 2024-09-19T06:16:21.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.232+0000 7f7f87453740 1 -- 172.21.15.2:0/104147379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b948df65d0 msgr2=0x55b948e00d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:21.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.232+0000 7f7f87453740 1 --2- 172.21.15.2:0/104147379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b948df65d0 0x55b948e00d70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7f7001b970 tx=0x7f7f70004730 comp rx=0 tx=0).stop 2024-09-19T06:16:21.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.232+0000 7f7f87453740 1 -- 172.21.15.2:0/104147379 shutdown_connections 2024-09-19T06:16:21.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.232+0000 7f7f87453740 1 --2- 172.21.15.2:0/104147379 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55b948e10f90 0x55b948e13380 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:21.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.232+0000 7f7f87453740 1 --2- 172.21.15.2:0/104147379 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b948e01370 0x55b948dfe610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:21.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.232+0000 7f7f62ff5640 0 client.25307 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:16:21.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.232+0000 7f7f87453740 1 --2- 172.21.15.2:0/104147379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b948df7b40 0x55b948dfe020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:21.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.232+0000 7f7f87453740 1 --2- 172.21.15.2:0/104147379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b948df65d0 0x55b948e00d70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:21.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.232+0000 7f7f87453740 1 -- 172.21.15.2:0/104147379 >> 172.21.15.2:0/104147379 conn(0x55b948dbf310 msgr2=0x55b948df8990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:21.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.233+0000 7f7f87453740 1 -- 172.21.15.2:0/104147379 shutdown_connections 2024-09-19T06:16:21.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.233+0000 7f7f87453740 1 -- 172.21.15.2:0/104147379 wait complete. 2024-09-19T06:16:21.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.233+0000 7f7f87453740 20 client.25307 trim_cache size 0 max 16384 2024-09-19T06:16:21.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.252+0000 7f7f87453740 1 Processor -- start 2024-09-19T06:16:21.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.252+0000 7f7f87453740 1 -- start start 2024-09-19T06:16:21.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.252+0000 7f7f87453740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b948df65d0 0x55b948df7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:21.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.252+0000 7f7f87453740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b948df7b40 0x55b948e0d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:21.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.252+0000 7f7f87453740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b948e01370 0x55b948dfd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:21.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.252+0000 7f7f87453740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7f801b2230 con 0x55b948df7b40 2024-09-19T06:16:21.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.252+0000 7f7f87453740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7f801afb00 con 0x55b948df65d0 2024-09-19T06:16:21.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.252+0000 7f7f87453740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7f801ad950 con 0x55b948e01370 2024-09-19T06:16:21.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.252+0000 7f7f7e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b948df7b40 0x55b948e0d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:21.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.252+0000 7f7f7e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b948df7b40 0x55b948e0d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37234/0 (socket says 172.21.15.2:37234) 2024-09-19T06:16:21.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.252+0000 7f7f7e59c640 1 -- 172.21.15.2:0/711743315 learned_addr learned my addr 172.21.15.2:0/711743315 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:21.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.252+0000 7f7f7f59e640 1 --2- 172.21.15.2:0/711743315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b948e01370 0x55b948dfd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:21.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.252+0000 7f7f7ed9d640 1 --2- 172.21.15.2:0/711743315 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b948df65d0 0x55b948df7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:21.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.253+0000 7f7f7f59e640 1 -- 172.21.15.2:0/711743315 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b948df65d0 msgr2=0x55b948df7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:21.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.253+0000 7f7f7f59e640 1 --2- 172.21.15.2:0/711743315 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b948df65d0 0x55b948df7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:21.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.253+0000 7f7f7f59e640 1 -- 172.21.15.2:0/711743315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b948df7b40 msgr2=0x55b948e0d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:21.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.253+0000 7f7f7f59e640 1 --2- 172.21.15.2:0/711743315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b948df7b40 0x55b948e0d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:21.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.253+0000 7f7f7f59e640 1 -- 172.21.15.2:0/711743315 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b948df3960 con 0x55b948e01370 2024-09-19T06:16:21.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.253+0000 7f7f7e59c640 1 --2- 172.21.15.2:0/711743315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b948df7b40 0x55b948e0d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:21.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.253+0000 7f7f7f59e640 1 --2- 172.21.15.2:0/711743315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b948e01370 0x55b948dfd8e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7f78005e30 tx=0x7f7f78005f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65304f8578a9fd21 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:21.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.253+0000 7f7f64ff9640 1 -- 172.21.15.2:0/711743315 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f78031a40 con 0x55b948e01370 2024-09-19T06:16:21.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.253+0000 7f7f64ff9640 1 -- 172.21.15.2:0/711743315 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7f78036040 con 0x55b948e01370 2024-09-19T06:16:21.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.253+0000 7f7f64ff9640 1 -- 172.21.15.2:0/711743315 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f78004630 con 0x55b948e01370 2024-09-19T06:16:21.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.254+0000 7f7f87453740 1 -- 172.21.15.2:0/711743315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b948e01370 msgr2=0x55b948dfd8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:21.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.254+0000 7f7f87453740 1 --2- 172.21.15.2:0/711743315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b948e01370 0x55b948dfd8e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7f78005e30 tx=0x7f7f78005f80 comp rx=0 tx=0).stop 2024-09-19T06:16:21.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.254+0000 7f7f87453740 1 -- 172.21.15.2:0/711743315 shutdown_connections 2024-09-19T06:16:21.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.254+0000 7f7f87453740 1 --2- 172.21.15.2:0/711743315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b948e01370 0x55b948dfd8e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:21.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.254+0000 7f7f87453740 1 --2- 172.21.15.2:0/711743315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b948df7b40 0x55b948e0d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:21.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.254+0000 7f7f87453740 1 --2- 172.21.15.2:0/711743315 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b948df65d0 0x55b948df7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:21.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.254+0000 7f7f87453740 1 -- 172.21.15.2:0/711743315 >> 172.21.15.2:0/711743315 conn(0x55b948dbf310 msgr2=0x55b948dfc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:21.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.254+0000 7f7f87453740 1 -- 172.21.15.2:0/711743315 shutdown_connections 2024-09-19T06:16:21.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.254+0000 7f7f87453740 1 -- 172.21.15.2:0/711743315 wait complete. 2024-09-19T06:16:21.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.255+0000 7f7f87453740 1 -- start start 2024-09-19T06:16:21.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.255+0000 7f7f87453740 1 Processor -- start 2024-09-19T06:16:21.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.255+0000 7f7f87453740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b948df65d0 0x55b948e04980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:21.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.255+0000 7f7f87453740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b948df7b40 0x55b948e04ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:21.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.255+0000 7f7f87453740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b948e01370 0x55b948e79bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:21.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.255+0000 7f7f87453740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7f801adfc0 con 0x55b948e01370 2024-09-19T06:16:21.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.255+0000 7f7f87453740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7f801af430 con 0x55b948df65d0 2024-09-19T06:16:21.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.255+0000 7f7f87453740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7f801ae690 con 0x55b948df7b40 2024-09-19T06:16:21.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.255+0000 7f7f87453740 10 client.0 _ll_register_callbacks cb 0x7f7f700099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:21.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.255+0000 7f7f7f59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b948e01370 0x55b948e79bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:21.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.255+0000 7f7f7e59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b948df7b40 0x55b948e04ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:21.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.255+0000 7f7f7e59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b948df7b40 0x55b948e04ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:55968/0 (socket says 172.21.15.2:55968) 2024-09-19T06:16:21.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.255+0000 7f7f7ed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b948df65d0 0x55b948e04980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:21.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.255+0000 7f7f7e59c640 1 -- 172.21.15.2:0/107992934 learned_addr learned my addr 172.21.15.2:0/107992934 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:21.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.255+0000 7f7f7f59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b948e01370 0x55b948e79bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37246/0 (socket says 172.21.15.2:37246) 2024-09-19T06:16:21.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.256+0000 7f7f7e59c640 1 -- 172.21.15.2:0/107992934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b948df65d0 msgr2=0x55b948e04980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:21.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.256+0000 7f7f7e59c640 1 --2- 172.21.15.2:0/107992934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b948df65d0 0x55b948e04980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:21.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.256+0000 7f7f7e59c640 1 -- 172.21.15.2:0/107992934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b948e01370 msgr2=0x55b948e79bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:21.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.256+0000 7f7f7e59c640 1 --2- 172.21.15.2:0/107992934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b948e01370 0x55b948e79bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:21.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.256+0000 7f7f7e59c640 1 -- 172.21.15.2:0/107992934 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b948e7a130 con 0x55b948df7b40 2024-09-19T06:16:21.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.256+0000 7f7f7e59c640 1 --2- 172.21.15.2:0/107992934 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b948df7b40 0x55b948e04ec0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7f740a4970 tx=0x7f7f74005f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f23b05a638f7a03c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:21.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.256+0000 7f7f62ff5640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-19T06:16:21.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.256+0000 7f7f62ff5640 1 -- 172.21.15.2:0/107992934 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f740bc0b0 con 0x55b948df7b40 2024-09-19T06:16:21.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.256+0000 7f7f62ff5640 1 -- 172.21.15.2:0/107992934 <== mon.1 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f7f740bc250 con 0x55b948df7b40 2024-09-19T06:16:21.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.256+0000 7f7f87453740 1 -- 172.21.15.2:0/107992934 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f78036040 con 0x55b948df7b40 2024-09-19T06:16:21.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.256+0000 7f7f62ff5640 1 -- 172.21.15.2:0/107992934 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7f740a0120 con 0x55b948df7b40 2024-09-19T06:16:21.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.256+0000 7f7f87453740 10 client.25252 fetch_fsmap learned FSMap version 26 2024-09-19T06:16:21.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.256+0000 7f7f87453740 1 -- 172.21.15.2:0/107992934 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b948e7b3d0 con 0x55b948df7b40 2024-09-19T06:16:21.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.257+0000 7f7f62ff5640 1 -- 172.21.15.2:0/107992934 <== mon.1 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7f78036040 con 0x55b948df7b40 2024-09-19T06:16:21.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.257+0000 7f7f62ff5640 1 -- 172.21.15.2:0/107992934 <== mon.1 v2:172.21.15.90:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f7f7409b8b0 con 0x55b948df7b40 2024-09-19T06:16:21.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.257+0000 7f7f87453740 10 client.25252 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:16:21.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.257+0000 7f7f87453740 10 client.25252 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:16:21.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.257+0000 7f7f87453740 20 client.25252 populate_metadata read hostname 'smithi002' 2024-09-19T06:16:21.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.257+0000 7f7f87453740 1 --2- 172.21.15.2:0/107992934 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55b948e10f90 0x55b948e7d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:21.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.257+0000 7f7f87453740 4 client.25252 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:16:21.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.257+0000 7f7f87453740 1 -- 172.21.15.2:0/107992934 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b948d63d70 con 0x55b948e10f90 2024-09-19T06:16:21.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.257+0000 7f7f7ed9d640 1 --2- 172.21.15.2:0/107992934 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55b948e10f90 0x55b948e7d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:21.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.257+0000 7f7f7ed9d640 1 --2- 172.21.15.2:0/107992934 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55b948e10f90 0x55b948e7d720 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1e73a45b7a88b5d6 server_cookie=3a1fe84ba118c8e4 in_seq=0 out_seq=0 2024-09-19T06:16:21.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.257+0000 7f7f62ff5640 10 client.25252 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:16:21.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.257+0000 7f7f62ff5640 1 -- 172.21.15.2:0/107992934 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b948d63d70 con 0x55b948e10f90 2024-09-19T06:16:21.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.258+0000 7f7f62ff5640 10 client.25252 handle_command_reply: tid=0 2024-09-19T06:16:21.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.258+0000 7f7f87453740 1 client.25252 shutdown 2024-09-19T06:16:21.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.258+0000 7f7f87453740 1 -- 172.21.15.2:0/107992934 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b948df7b40 msgr2=0x55b948e04ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:21.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.258+0000 7f7f87453740 1 --2- 172.21.15.2:0/107992934 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b948df7b40 0x55b948e04ec0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7f740a4970 tx=0x7f7f74005f10 comp rx=0 tx=0).stop 2024-09-19T06:16:21.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.258+0000 7f7f87453740 1 -- 172.21.15.2:0/107992934 shutdown_connections 2024-09-19T06:16:21.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.258+0000 7f7f87453740 1 --2- 172.21.15.2:0/107992934 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55b948e10f90 0x55b948e7d720 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:21.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.258+0000 7f7f87453740 1 --2- 172.21.15.2:0/107992934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b948e01370 0x55b948e79bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:21.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.258+0000 7f7f87453740 1 --2- 172.21.15.2:0/107992934 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b948df7b40 0x55b948e04ec0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:21.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.258+0000 7f7f87453740 1 --2- 172.21.15.2:0/107992934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b948df65d0 0x55b948e04980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:21.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.258+0000 7f7f87453740 1 -- 172.21.15.2:0/107992934 >> 172.21.15.2:0/107992934 conn(0x55b948dbf310 msgr2=0x55b948dfc530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:21.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.258+0000 7f7f62ff5640 0 client.25252 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:16:21.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.258+0000 7f7f87453740 1 -- 172.21.15.2:0/107992934 shutdown_connections 2024-09-19T06:16:21.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.258+0000 7f7f87453740 1 -- 172.21.15.2:0/107992934 wait complete. 2024-09-19T06:16:21.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.258+0000 7f7f87453740 20 client.25252 trim_cache size 0 max 16384 2024-09-19T06:16:21.268 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:16:21.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.259+0000 7f7f8507a640 1 -- 172.21.15.2:0/1024712001 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f7f680a3430 msgr2=0x7f7f680a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:21.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.259+0000 7f7f8507a640 1 --2- 172.21.15.2:0/1024712001 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f7f680a3430 0x7f7f680a58f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7f70009c20 tx=0x7f7f70005f90 comp rx=0 tx=0).stop 2024-09-19T06:16:21.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.259+0000 7f7f8507a640 1 -- 172.21.15.2:0/1024712001 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f80101360 msgr2=0x7f7f8019abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:21.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.259+0000 7f7f8507a640 1 --2- 172.21.15.2:0/1024712001 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f80101360 0x7f7f8019abf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400e9f0 tx=0x7f7f7400eeb0 comp rx=0 tx=0).stop 2024-09-19T06:16:21.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.259+0000 7f7f8507a640 1 -- 172.21.15.2:0/1024712001 shutdown_connections 2024-09-19T06:16:21.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.259+0000 7f7f8507a640 1 --2- 172.21.15.2:0/1024712001 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f7f680a3430 0x7f7f680a58f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:21.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.259+0000 7f7f8507a640 1 --2- 172.21.15.2:0/1024712001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f8010e4d0 0x7f7f8019ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:21.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.259+0000 7f7f8507a640 1 --2- 172.21.15.2:0/1024712001 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f80101360 0x7f7f8019abf0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:21.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.259+0000 7f7f8507a640 1 --2- 172.21.15.2:0/1024712001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f801009b0 0x7f7f8019a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:21.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.259+0000 7f7f8507a640 1 -- 172.21.15.2:0/1024712001 >> 172.21.15.2:0/1024712001 conn(0x7f7f800fc7d0 msgr2=0x7f7f800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:21.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.259+0000 7f7f8507a640 1 -- 172.21.15.2:0/1024712001 shutdown_connections 2024-09-19T06:16:21.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:21.259+0000 7f7f8507a640 1 -- 172.21.15.2:0/1024712001 wait complete. 2024-09-19T06:16:21.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:21 smithi002 ceph-mon[30982]: pgmap v49: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 81 MiB/s wr, 34 op/s 2024-09-19T06:16:21.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:21 smithi002 ceph-mon[30982]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-09-19T06:16:21.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:21 smithi090 ceph-mon[34497]: pgmap v49: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 81 MiB/s wr, 34 op/s 2024-09-19T06:16:21.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:21 smithi090 ceph-mon[34497]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-09-19T06:16:21.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:21 smithi089 ceph-mon[34160]: pgmap v49: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 81 MiB/s wr, 34 op/s 2024-09-19T06:16:21.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:21 smithi089 ceph-mon[34160]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-09-19T06:16:22.023 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:16:22.340 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:16:22.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.835+0000 7f16b63f3640 1 -- 172.21.15.2:0/480156881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16b0102d30 msgr2=0x7f16b0103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:22.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.835+0000 7f16b63f3640 1 --2- 172.21.15.2:0/480156881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16b0102d30 0x7f16b0103110 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f16a0009930 tx=0x7f16a002a420 comp rx=0 tx=0).stop 2024-09-19T06:16:22.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.836+0000 7f16b63f3640 1 -- 172.21.15.2:0/480156881 shutdown_connections 2024-09-19T06:16:22.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.836+0000 7f16b63f3640 1 --2- 172.21.15.2:0/480156881 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16b01082a0 0x7f16b010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.836+0000 7f16b63f3640 1 --2- 172.21.15.2:0/480156881 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16b01036e0 0x7f16b0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.836+0000 7f16b63f3640 1 --2- 172.21.15.2:0/480156881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16b0102d30 0x7f16b0103110 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.836+0000 7f16b63f3640 1 -- 172.21.15.2:0/480156881 >> 172.21.15.2:0/480156881 conn(0x7f16b00fc7d0 msgr2=0x7f16b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:22.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.836+0000 7f16b63f3640 1 -- 172.21.15.2:0/480156881 shutdown_connections 2024-09-19T06:16:22.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.836+0000 7f16b63f3640 1 -- 172.21.15.2:0/480156881 wait complete. 2024-09-19T06:16:22.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.836+0000 7f16b63f3640 1 Processor -- start 2024-09-19T06:16:22.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.836+0000 7f16b63f3640 1 -- start start 2024-09-19T06:16:22.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.837+0000 7f16b63f3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16b0102d30 0x7f16b0198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:22.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.837+0000 7f16b63f3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16b01036e0 0x7f16b01989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:22.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.837+0000 7f16b63f3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16b01082a0 0x7f16b019cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:22.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.837+0000 7f16b63f3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f16b0111f50 con 0x7f16b0102d30 2024-09-19T06:16:22.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.837+0000 7f16b63f3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f16b0111dd0 con 0x7f16b01036e0 2024-09-19T06:16:22.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.837+0000 7f16b63f3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f16b01120d0 con 0x7f16b01082a0 2024-09-19T06:16:22.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.837+0000 7f16b4990640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16b01082a0 0x7f16b019cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:22.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.837+0000 7f16b4990640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16b01082a0 0x7f16b019cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:55984/0 (socket says 172.21.15.2:55984) 2024-09-19T06:16:22.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.837+0000 7f16b4990640 1 -- 172.21.15.2:0/2134900725 learned_addr learned my addr 172.21.15.2:0/2134900725 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:22.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.837+0000 7f16affff640 1 --2- 172.21.15.2:0/2134900725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16b0102d30 0x7f16b0198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:22.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.837+0000 7f16af7fe640 1 --2- 172.21.15.2:0/2134900725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16b01036e0 0x7f16b01989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:22.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.837+0000 7f16b4990640 1 -- 172.21.15.2:0/2134900725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16b01036e0 msgr2=0x7f16b01989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:22.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.838+0000 7f16b4990640 1 --2- 172.21.15.2:0/2134900725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16b01036e0 0x7f16b01989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.838+0000 7f16b4990640 1 -- 172.21.15.2:0/2134900725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16b0102d30 msgr2=0x7f16b0198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:22.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.838+0000 7f16b4990640 1 --2- 172.21.15.2:0/2134900725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16b0102d30 0x7f16b0198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.838+0000 7f16b4990640 1 -- 172.21.15.2:0/2134900725 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16b019d420 con 0x7f16b01082a0 2024-09-19T06:16:22.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.838+0000 7f16affff640 1 --2- 172.21.15.2:0/2134900725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16b0102d30 0x7f16b0198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:22.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.838+0000 7f16af7fe640 1 --2- 172.21.15.2:0/2134900725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16b01036e0 0x7f16b01989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:16:22.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.838+0000 7f16b4990640 1 --2- 172.21.15.2:0/2134900725 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16b01082a0 0x7f16b019cd40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f16a8007f30 tx=0x7f16a800a620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:22.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.838+0000 7f16ad7fa640 1 -- 172.21.15.2:0/2134900725 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a801e070 con 0x7f16b01082a0 2024-09-19T06:16:22.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.838+0000 7f16b63f3640 1 -- 172.21.15.2:0/2134900725 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16b019d710 con 0x7f16b01082a0 2024-09-19T06:16:22.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.838+0000 7f16ad7fa640 1 -- 172.21.15.2:0/2134900725 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f16a8011c00 con 0x7f16b01082a0 2024-09-19T06:16:22.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.838+0000 7f16b63f3640 1 -- 172.21.15.2:0/2134900725 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16b01008c0 con 0x7f16b01082a0 2024-09-19T06:16:22.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.838+0000 7f16ad7fa640 1 -- 172.21.15.2:0/2134900725 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a8019c70 con 0x7f16b01082a0 2024-09-19T06:16:22.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.841+0000 7f16ad7fa640 1 -- 172.21.15.2:0/2134900725 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f16a8021070 con 0x7f16b01082a0 2024-09-19T06:16:22.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.841+0000 7f16b87cc740 1 Processor -- start 2024-09-19T06:16:22.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.842+0000 7f16b87cc740 1 -- start start 2024-09-19T06:16:22.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.842+0000 7f16b87cc740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f527711b40 0x55f527710090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:22.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.842+0000 7f16b87cc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5277105d0 0x55f527710a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:22.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.842+0000 7f16b87cc740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f52771b370 0x55f52771d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:22.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.842+0000 7f16b87cc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f5276762f0 con 0x55f5277105d0 2024-09-19T06:16:22.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.842+0000 7f16b87cc740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55f52761dcf0 con 0x55f527711b40 2024-09-19T06:16:22.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.842+0000 7f16b87cc740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f5276722b0 con 0x55f52771b370 2024-09-19T06:16:22.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.842+0000 7f16affff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5277105d0 0x55f527710a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:22.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.842+0000 7f16affff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5277105d0 0x55f527710a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37272/0 (socket says 172.21.15.2:37272) 2024-09-19T06:16:22.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.842+0000 7f16affff640 1 -- 172.21.15.2:0/3320784506 learned_addr learned my addr 172.21.15.2:0/3320784506 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:22.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.842+0000 7f16af7fe640 1 --2- 172.21.15.2:0/3320784506 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f52771b370 0x55f52771d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:22.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.842+0000 7f16affff640 1 -- 172.21.15.2:0/3320784506 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f52771b370 msgr2=0x55f52771d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:22.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.842+0000 7f16affff640 1 --2- 172.21.15.2:0/3320784506 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f52771b370 0x55f52771d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.842+0000 7f16affff640 1 -- 172.21.15.2:0/3320784506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f527711b40 msgr2=0x55f527710090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:22.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.842+0000 7f16affff640 1 --2- 172.21.15.2:0/3320784506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f527711b40 0x55f527710090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.842+0000 7f16affff640 1 -- 172.21.15.2:0/3320784506 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5276023a0 con 0x55f5277105d0 2024-09-19T06:16:22.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.843+0000 7f16af7fe640 1 --2- 172.21.15.2:0/3320784506 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f52771b370 0x55f52771d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:16:22.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.843+0000 7f16affff640 1 --2- 172.21.15.2:0/3320784506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5277105d0 0x55f527710a10 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f16a002a940 tx=0x7f16a0031550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f55750269ce810 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:22.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.843+0000 7f16967fc640 1 -- 172.21.15.2:0/3320784506 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a0035040 con 0x55f5277105d0 2024-09-19T06:16:22.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.843+0000 7f16967fc640 1 -- 172.21.15.2:0/3320784506 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f16a0005020 con 0x55f5277105d0 2024-09-19T06:16:22.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.843+0000 7f16ad7fa640 1 --2- 172.21.15.2:0/2134900725 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f16980a33b0 0x7f16980a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:22.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.843+0000 7f16967fc640 1 -- 172.21.15.2:0/3320784506 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a0004a00 con 0x55f5277105d0 2024-09-19T06:16:22.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.843+0000 7f16ad7fa640 1 -- 172.21.15.2:0/2134900725 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f16a80d3c90 con 0x7f16b01082a0 2024-09-19T06:16:22.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.843+0000 7f16af7fe640 1 --2- 172.21.15.2:0/2134900725 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f16980a33b0 0x7f16980a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:22.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.844+0000 7f16b87cc740 1 -- 172.21.15.2:0/3320784506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5277105d0 msgr2=0x55f527710a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:22.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.844+0000 7f16af7fe640 1 --2- 172.21.15.2:0/2134900725 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f16980a33b0 0x7f16980a5870 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f16a4005fd0 tx=0x7f16a400b360 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:22.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.844+0000 7f16b87cc740 1 --2- 172.21.15.2:0/3320784506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5277105d0 0x55f527710a10 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f16a002a940 tx=0x7f16a0031550 comp rx=0 tx=0).stop 2024-09-19T06:16:22.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.844+0000 7f16b87cc740 1 -- 172.21.15.2:0/3320784506 shutdown_connections 2024-09-19T06:16:22.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.844+0000 7f16b87cc740 1 --2- 172.21.15.2:0/3320784506 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f52771b370 0x55f52771d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.844+0000 7f16b87cc740 1 --2- 172.21.15.2:0/3320784506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5277105d0 0x55f527710a10 secure :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f16a002a940 tx=0x7f16a0031550 comp rx=0 tx=0).stop 2024-09-19T06:16:22.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.844+0000 7f16b87cc740 1 --2- 172.21.15.2:0/3320784506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f527711b40 0x55f527710090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.844+0000 7f16b87cc740 1 -- 172.21.15.2:0/3320784506 >> 172.21.15.2:0/3320784506 conn(0x55f5276d9310 msgr2=0x55f52770cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:22.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.844+0000 7f16b87cc740 1 -- 172.21.15.2:0/3320784506 shutdown_connections 2024-09-19T06:16:22.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.845+0000 7f16b87cc740 1 -- 172.21.15.2:0/3320784506 wait complete. 2024-09-19T06:16:22.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.845+0000 7f16b87cc740 1 -- start start 2024-09-19T06:16:22.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.845+0000 7f16b87cc740 1 Processor -- start 2024-09-19T06:16:22.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.845+0000 7f16b87cc740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f527711b40 0x55f5277182a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:22.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.845+0000 7f16b87cc740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f52771b370 0x55f5277187e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:22.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.845+0000 7f16b87cc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f527718d20 0x55f5277274f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:22.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.846+0000 7f16b87cc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f52771e010 con 0x55f527718d20 2024-09-19T06:16:22.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.846+0000 7f16b87cc740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55f527631060 con 0x55f527711b40 2024-09-19T06:16:22.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.846+0000 7f16b87cc740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f52771e190 con 0x55f52771b370 2024-09-19T06:16:22.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.846+0000 7f16b87cc740 10 client.0 _ll_register_callbacks cb 0x55f5273848c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:22.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.846+0000 7f16affff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f527711b40 0x55f5277182a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:22.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.846+0000 7f16b4990640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f527718d20 0x55f5277274f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:22.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.846+0000 7f16affff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f527711b40 0x55f5277182a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:56292/0 (socket says 172.21.15.2:56292) 2024-09-19T06:16:22.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.846+0000 7f16affff640 1 -- 172.21.15.2:0/1136320333 learned_addr learned my addr 172.21.15.2:0/1136320333 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:22.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.846+0000 7f16af7fe640 1 --2- 172.21.15.2:0/1136320333 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f52771b370 0x55f5277187e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:22.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.846+0000 7f16affff640 1 -- 172.21.15.2:0/1136320333 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f52771b370 msgr2=0x55f5277187e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:22.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.846+0000 7f16affff640 1 --2- 172.21.15.2:0/1136320333 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f52771b370 0x55f5277187e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.846+0000 7f16affff640 1 -- 172.21.15.2:0/1136320333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f527718d20 msgr2=0x55f5277274f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:22.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.846+0000 7f16affff640 1 --2- 172.21.15.2:0/1136320333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f527718d20 0x55f5277274f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.846+0000 7f16affff640 1 -- 172.21.15.2:0/1136320333 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5273e73c0 con 0x55f527711b40 2024-09-19T06:16:22.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.846+0000 7f16af7fe640 1 --2- 172.21.15.2:0/1136320333 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f52771b370 0x55f5277187e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:16:22.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.846+0000 7f16b4990640 1 --2- 172.21.15.2:0/1136320333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f527718d20 0x55f5277274f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:22.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.846+0000 7f16affff640 1 --2- 172.21.15.2:0/1136320333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f527711b40 0x55f5277182a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f16a0031a70 tx=0x7f16a0005400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=420d1ba74cf1bd9f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:22.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.846+0000 7f168f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-09-19T06:16:22.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.846+0000 7f168f7fe640 1 -- 172.21.15.2:0/1136320333 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a0035070 con 0x55f527711b40 2024-09-19T06:16:22.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.847+0000 7f16b87cc740 1 -- 172.21.15.2:0/1136320333 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16a0005020 con 0x55f527711b40 2024-09-19T06:16:22.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.847+0000 7f168f7fe640 1 -- 172.21.15.2:0/1136320333 <== mon.2 v2:172.21.15.89:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f16a0004770 con 0x55f527711b40 2024-09-19T06:16:22.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.847+0000 7f168f7fe640 1 -- 172.21.15.2:0/1136320333 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f16a0004970 con 0x55f527711b40 2024-09-19T06:16:22.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.847+0000 7f16b87cc740 10 client.25316 fetch_fsmap learned FSMap version 26 2024-09-19T06:16:22.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.847+0000 7f16b87cc740 1 -- 172.21.15.2:0/1136320333 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f52772a0a0 con 0x55f527711b40 2024-09-19T06:16:22.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.847+0000 7f168f7fe640 1 -- 172.21.15.2:0/1136320333 <== mon.2 v2:172.21.15.89:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f16a0059450 con 0x55f527711b40 2024-09-19T06:16:22.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.847+0000 7f168f7fe640 1 -- 172.21.15.2:0/1136320333 <== mon.2 v2:172.21.15.89:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f16a0046450 con 0x55f527711b40 2024-09-19T06:16:22.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.847+0000 7f16b87cc740 10 client.25316 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:16:22.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.847+0000 7f16b87cc740 10 client.25316 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:22.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.847+0000 7f16b87cc740 20 client.25316 populate_metadata read hostname 'smithi002' 2024-09-19T06:16:22.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.847+0000 7f16b87cc740 1 --2- 172.21.15.2:0/1136320333 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55f52772b3f0 0x55f52772d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:22.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.847+0000 7f16b87cc740 4 client.25316 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:16:22.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.847+0000 7f16b87cc740 1 -- 172.21.15.2:0/1136320333 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f16a0005020 con 0x55f52772b3f0 2024-09-19T06:16:22.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.848+0000 7f16af7fe640 1 --2- 172.21.15.2:0/1136320333 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55f52772b3f0 0x55f52772d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:22.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.848+0000 7f168f7fe640 10 client.25316 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:22.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.848+0000 7f16af7fe640 1 --2- 172.21.15.2:0/1136320333 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55f52772b3f0 0x55f52772d7e0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=991b62674547d103 server_cookie=550278de5692299d in_seq=0 out_seq=0 2024-09-19T06:16:22.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.849+0000 7f168f7fe640 1 -- 172.21.15.2:0/1136320333 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f16a0005020 con 0x55f52772b3f0 2024-09-19T06:16:22.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.849+0000 7f168f7fe640 10 client.25316 handle_command_reply: tid=0 2024-09-19T06:16:22.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.849+0000 7f16b87cc740 1 client.25316 shutdown 2024-09-19T06:16:22.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.849+0000 7f16b87cc740 1 -- 172.21.15.2:0/1136320333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f527711b40 msgr2=0x55f5277182a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:22.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.849+0000 7f16b87cc740 1 --2- 172.21.15.2:0/1136320333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f527711b40 0x55f5277182a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f16a0031a70 tx=0x7f16a0005400 comp rx=0 tx=0).stop 2024-09-19T06:16:22.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.849+0000 7f16b87cc740 1 -- 172.21.15.2:0/1136320333 shutdown_connections 2024-09-19T06:16:22.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.849+0000 7f16b87cc740 1 --2- 172.21.15.2:0/1136320333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f527718d20 0x55f5277274f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.849+0000 7f16b87cc740 1 --2- 172.21.15.2:0/1136320333 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f52771b370 0x55f5277187e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.849+0000 7f16b87cc740 1 --2- 172.21.15.2:0/1136320333 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55f52772b3f0 0x55f52772d7e0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.849+0000 7f16b87cc740 1 --2- 172.21.15.2:0/1136320333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f527711b40 0x55f5277182a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.849+0000 7f16b87cc740 1 -- 172.21.15.2:0/1136320333 >> 172.21.15.2:0/1136320333 conn(0x55f5276d9310 msgr2=0x55f527712930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:22.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.849+0000 7f168f7fe640 0 client.25316 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:22.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.849+0000 7f16b87cc740 1 -- 172.21.15.2:0/1136320333 shutdown_connections 2024-09-19T06:16:22.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.849+0000 7f16b87cc740 1 -- 172.21.15.2:0/1136320333 wait complete. 2024-09-19T06:16:22.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.849+0000 7f16b87cc740 20 client.25316 trim_cache size 0 max 16384 2024-09-19T06:16:22.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.862+0000 7f16b87cc740 1 Processor -- start 2024-09-19T06:16:22.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.862+0000 7f16b87cc740 1 -- start start 2024-09-19T06:16:22.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.863+0000 7f16b87cc740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f527711b40 0x55f527712110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:22.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.863+0000 7f16b87cc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f527718d20 0x55f52771c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:22.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.863+0000 7f16b87cc740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f52771b370 0x55f52771cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:22.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.863+0000 7f16b87cc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f16b01ade10 con 0x55f527718d20 2024-09-19T06:16:22.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.863+0000 7f16b87cc740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f16b01ab6e0 con 0x55f527711b40 2024-09-19T06:16:22.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.863+0000 7f16b87cc740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f16b01a9530 con 0x55f52771b370 2024-09-19T06:16:22.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.863+0000 7f16af7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f527718d20 0x55f52771c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:22.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.863+0000 7f16af7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f527718d20 0x55f52771c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37292/0 (socket says 172.21.15.2:37292) 2024-09-19T06:16:22.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.863+0000 7f16af7fe640 1 -- 172.21.15.2:0/3816463335 learned_addr learned my addr 172.21.15.2:0/3816463335 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:22.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.863+0000 7f16affff640 1 --2- 172.21.15.2:0/3816463335 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f527711b40 0x55f527712110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:22.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.863+0000 7f16b4990640 1 --2- 172.21.15.2:0/3816463335 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f52771b370 0x55f52771cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:22.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.863+0000 7f16affff640 1 -- 172.21.15.2:0/3816463335 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f52771b370 msgr2=0x55f52771cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:22.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.863+0000 7f16affff640 1 --2- 172.21.15.2:0/3816463335 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f52771b370 0x55f52771cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.863+0000 7f16affff640 1 -- 172.21.15.2:0/3816463335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f527718d20 msgr2=0x55f52771c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:22.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.863+0000 7f16affff640 1 --2- 172.21.15.2:0/3816463335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f527718d20 0x55f52771c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.863+0000 7f16affff640 1 -- 172.21.15.2:0/3816463335 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5277167f0 con 0x55f527711b40 2024-09-19T06:16:22.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.863+0000 7f16af7fe640 1 --2- 172.21.15.2:0/3816463335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f527718d20 0x55f52771c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:22.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.863+0000 7f16affff640 1 --2- 172.21.15.2:0/3816463335 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f527711b40 0x55f527712110 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f16a0046820 tx=0x7f16a0005e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ffe61de0b9d98b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:22.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.864+0000 7f1695ffb640 1 -- 172.21.15.2:0/3816463335 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a0035070 con 0x55f527711b40 2024-09-19T06:16:22.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.864+0000 7f1695ffb640 1 -- 172.21.15.2:0/3816463335 <== mon.2 v2:172.21.15.89:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f16a00044d0 con 0x55f527711b40 2024-09-19T06:16:22.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.864+0000 7f1695ffb640 1 -- 172.21.15.2:0/3816463335 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a0004b10 con 0x55f527711b40 2024-09-19T06:16:22.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.865+0000 7f16b87cc740 1 -- 172.21.15.2:0/3816463335 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f527711b40 msgr2=0x55f527712110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:22.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.865+0000 7f16b87cc740 1 --2- 172.21.15.2:0/3816463335 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f527711b40 0x55f527712110 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f16a0046820 tx=0x7f16a0005e50 comp rx=0 tx=0).stop 2024-09-19T06:16:22.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.865+0000 7f16b87cc740 1 -- 172.21.15.2:0/3816463335 shutdown_connections 2024-09-19T06:16:22.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.865+0000 7f16b87cc740 1 --2- 172.21.15.2:0/3816463335 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f52771b370 0x55f52771cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.865+0000 7f16b87cc740 1 --2- 172.21.15.2:0/3816463335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f527718d20 0x55f52771c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.865+0000 7f16b87cc740 1 --2- 172.21.15.2:0/3816463335 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f527711b40 0x55f527712110 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.865+0000 7f16b87cc740 1 -- 172.21.15.2:0/3816463335 >> 172.21.15.2:0/3816463335 conn(0x55f5276d9310 msgr2=0x55f52771a320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:22.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.865+0000 7f16b87cc740 1 -- 172.21.15.2:0/3816463335 shutdown_connections 2024-09-19T06:16:22.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.865+0000 7f16b87cc740 1 -- 172.21.15.2:0/3816463335 wait complete. 2024-09-19T06:16:22.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.865+0000 7f16b87cc740 1 -- start start 2024-09-19T06:16:22.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.865+0000 7f16b87cc740 1 Processor -- start 2024-09-19T06:16:22.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.866+0000 7f16b87cc740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f527711b40 0x55f5277308e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:22.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.866+0000 7f16b87cc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f527718d20 0x55f52772bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:22.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.866+0000 7f16b87cc740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f52771b370 0x55f52772c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:22.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.866+0000 7f16b87cc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f16b01a9ba0 con 0x55f527718d20 2024-09-19T06:16:22.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.866+0000 7f16b87cc740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f16b01ab010 con 0x55f527711b40 2024-09-19T06:16:22.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.866+0000 7f16b87cc740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f16b01aa270 con 0x55f52771b370 2024-09-19T06:16:22.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.866+0000 7f16b87cc740 10 client.0 _ll_register_callbacks cb 0x7f16a0040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:22.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.866+0000 7f16b4990640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f52771b370 0x55f52772c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:22.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.866+0000 7f16af7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f527718d20 0x55f52772bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:22.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.866+0000 7f16b4990640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f52771b370 0x55f52772c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:56030/0 (socket says 172.21.15.2:56030) 2024-09-19T06:16:22.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.866+0000 7f16b4990640 1 -- 172.21.15.2:0/2860776375 learned_addr learned my addr 172.21.15.2:0/2860776375 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:22.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.866+0000 7f16affff640 1 --2- 172.21.15.2:0/2860776375 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f527711b40 0x55f5277308e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:22.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.866+0000 7f16af7fe640 1 -- 172.21.15.2:0/2860776375 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f52771b370 msgr2=0x55f52772c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:22.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.866+0000 7f16af7fe640 1 --2- 172.21.15.2:0/2860776375 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f52771b370 0x55f52772c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.866+0000 7f16af7fe640 1 -- 172.21.15.2:0/2860776375 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f527711b40 msgr2=0x55f5277308e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:22.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.866+0000 7f16af7fe640 1 --2- 172.21.15.2:0/2860776375 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f527711b40 0x55f5277308e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.866+0000 7f16af7fe640 1 -- 172.21.15.2:0/2860776375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f52772c6c0 con 0x55f527718d20 2024-09-19T06:16:22.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.867+0000 7f16af7fe640 1 --2- 172.21.15.2:0/2860776375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f527718d20 0x55f52772bc10 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f16b00fee60 tx=0x7f16a4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eceafa5aba1193d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:22.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.867+0000 7f168f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:16:22.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.867+0000 7f168f7fe640 1 -- 172.21.15.2:0/2860776375 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a4011e60 con 0x55f527718d20 2024-09-19T06:16:22.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.867+0000 7f16b87cc740 1 -- 172.21.15.2:0/2860776375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16a00044d0 con 0x55f527718d20 2024-09-19T06:16:22.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.867+0000 7f168f7fe640 1 -- 172.21.15.2:0/2860776375 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f16a4005220 con 0x55f527718d20 2024-09-19T06:16:22.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.867+0000 7f168f7fe640 1 -- 172.21.15.2:0/2860776375 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f16a4035050 con 0x55f527718d20 2024-09-19T06:16:22.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.867+0000 7f16b87cc740 10 client.15648 fetch_fsmap learned FSMap version 26 2024-09-19T06:16:22.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.867+0000 7f16b87cc740 1 -- 172.21.15.2:0/2860776375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f52779e320 con 0x55f527718d20 2024-09-19T06:16:22.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.867+0000 7f168f7fe640 1 -- 172.21.15.2:0/2860776375 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f16a00044d0 con 0x55f527718d20 2024-09-19T06:16:22.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.867+0000 7f168f7fe640 1 -- 172.21.15.2:0/2860776375 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f16a402d020 con 0x55f527718d20 2024-09-19T06:16:22.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.867+0000 7f16b87cc740 10 client.15648 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:16:22.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.867+0000 7f16b87cc740 10 client.15648 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:22.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.867+0000 7f16b87cc740 20 client.15648 populate_metadata read hostname 'smithi002' 2024-09-19T06:16:22.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.868+0000 7f16b87cc740 1 --2- 172.21.15.2:0/2860776375 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55f52779eaa0 0x55f5277a0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:22.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.868+0000 7f16b87cc740 4 client.15648 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:16:22.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.868+0000 7f16b87cc740 1 -- 172.21.15.2:0/2860776375 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f527683860 con 0x55f52779eaa0 2024-09-19T06:16:22.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.868+0000 7f16affff640 1 --2- 172.21.15.2:0/2860776375 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55f52779eaa0 0x55f5277a0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:22.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.868+0000 7f168f7fe640 10 client.15648 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:22.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.868+0000 7f16affff640 1 --2- 172.21.15.2:0/2860776375 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55f52779eaa0 0x55f5277a0ec0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17d093951dd04226 server_cookie=21ecb289edc89e57 in_seq=0 out_seq=0 2024-09-19T06:16:22.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.868+0000 7f168f7fe640 1 -- 172.21.15.2:0/2860776375 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f527683860 con 0x55f52779eaa0 2024-09-19T06:16:22.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.868+0000 7f168f7fe640 10 client.15648 handle_command_reply: tid=0 2024-09-19T06:16:22.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.868+0000 7f16b87cc740 1 client.15648 shutdown 2024-09-19T06:16:22.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.869+0000 7f16b87cc740 1 -- 172.21.15.2:0/2860776375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f527718d20 msgr2=0x55f52772bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:22.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.869+0000 7f16b87cc740 1 --2- 172.21.15.2:0/2860776375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f527718d20 0x55f52772bc10 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f16b00fee60 tx=0x7f16a4012000 comp rx=0 tx=0).stop 2024-09-19T06:16:22.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.869+0000 7f16b87cc740 1 -- 172.21.15.2:0/2860776375 shutdown_connections 2024-09-19T06:16:22.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.869+0000 7f16b87cc740 1 --2- 172.21.15.2:0/2860776375 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f52771b370 0x55f52772c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.869+0000 7f16b87cc740 1 --2- 172.21.15.2:0/2860776375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f527718d20 0x55f52772bc10 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.869+0000 7f16b87cc740 1 --2- 172.21.15.2:0/2860776375 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55f52779eaa0 0x55f5277a0ec0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.869+0000 7f16b87cc740 1 --2- 172.21.15.2:0/2860776375 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f527711b40 0x55f5277308e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.869+0000 7f168f7fe640 0 client.15648 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:22.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.869+0000 7f16b87cc740 1 -- 172.21.15.2:0/2860776375 >> 172.21.15.2:0/2860776375 conn(0x55f5276d9310 msgr2=0x55f5277177e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:22.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.869+0000 7f16b87cc740 1 -- 172.21.15.2:0/2860776375 shutdown_connections 2024-09-19T06:16:22.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.869+0000 7f16b87cc740 1 -- 172.21.15.2:0/2860776375 wait complete. 2024-09-19T06:16:22.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.869+0000 7f16b87cc740 20 client.15648 trim_cache size 0 max 16384 2024-09-19T06:16:22.877 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:16:22.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.870+0000 7f16b63f3640 1 -- 172.21.15.2:0/2134900725 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f16980a33b0 msgr2=0x7f16980a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:22.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.870+0000 7f16b63f3640 1 --2- 172.21.15.2:0/2134900725 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f16980a33b0 0x7f16980a5870 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f16a4005fd0 tx=0x7f16a400b360 comp rx=0 tx=0).stop 2024-09-19T06:16:22.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.870+0000 7f16b63f3640 1 -- 172.21.15.2:0/2134900725 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16b01082a0 msgr2=0x7f16b019cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:22.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.870+0000 7f16b63f3640 1 --2- 172.21.15.2:0/2134900725 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16b01082a0 0x7f16b019cd40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f16a8007f30 tx=0x7f16a800a620 comp rx=0 tx=0).stop 2024-09-19T06:16:22.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.870+0000 7f16b63f3640 1 -- 172.21.15.2:0/2134900725 shutdown_connections 2024-09-19T06:16:22.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.870+0000 7f16b63f3640 1 --2- 172.21.15.2:0/2134900725 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f16980a33b0 0x7f16980a5870 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.870+0000 7f16b63f3640 1 --2- 172.21.15.2:0/2134900725 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16b01082a0 0x7f16b019cd40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.870+0000 7f16b63f3640 1 --2- 172.21.15.2:0/2134900725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16b01036e0 0x7f16b01989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.870+0000 7f16b63f3640 1 --2- 172.21.15.2:0/2134900725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16b0102d30 0x7f16b0198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.870+0000 7f16b63f3640 1 -- 172.21.15.2:0/2134900725 >> 172.21.15.2:0/2134900725 conn(0x7f16b00fc7d0 msgr2=0x7f16b0105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:22.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.870+0000 7f16b63f3640 1 -- 172.21.15.2:0/2134900725 shutdown_connections 2024-09-19T06:16:22.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:22.870+0000 7f16b63f3640 1 -- 172.21.15.2:0/2134900725 wait complete. 2024-09-19T06:16:23.663 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:23 smithi002 ceph-mon[30982]: pgmap v50: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 37 MiB/s wr, 18 op/s 2024-09-19T06:16:23.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:23 smithi090 ceph-mon[34497]: pgmap v50: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 37 MiB/s wr, 18 op/s 2024-09-19T06:16:23.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:23 smithi089 ceph-mon[34160]: pgmap v50: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 37 MiB/s wr, 18 op/s 2024-09-19T06:16:24.695 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:16:24.696 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:16:24.991 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:16:25.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:25 smithi002 ceph-mon[30982]: pgmap v51: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 79 MiB/s wr, 30 op/s 2024-09-19T06:16:25.593 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:25 smithi089 ceph-mon[34160]: pgmap v51: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 79 MiB/s wr, 30 op/s 2024-09-19T06:16:25.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.617+0000 7f831f988640 1 -- 172.21.15.2:0/4290278068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83181009b0 msgr2=0x7f8318100d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:25.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.617+0000 7f831f988640 1 --2- 172.21.15.2:0/4290278068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83181009b0 0x7f8318100d90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f8314009900 tx=0x7f831402a410 comp rx=0 tx=0).stop 2024-09-19T06:16:25.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.617+0000 7f831f988640 1 -- 172.21.15.2:0/4290278068 shutdown_connections 2024-09-19T06:16:25.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.617+0000 7f831f988640 1 --2- 172.21.15.2:0/4290278068 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f831810e4d0 0x7f83181108e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:25.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.617+0000 7f831f988640 1 --2- 172.21.15.2:0/4290278068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8318101360 0x7f831810df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:25.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.617+0000 7f831f988640 1 --2- 172.21.15.2:0/4290278068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83181009b0 0x7f8318100d90 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:25.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.617+0000 7f831f988640 1 -- 172.21.15.2:0/4290278068 >> 172.21.15.2:0/4290278068 conn(0x7f83180fc7d0 msgr2=0x7f83180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:25.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.617+0000 7f831f988640 1 -- 172.21.15.2:0/4290278068 shutdown_connections 2024-09-19T06:16:25.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.617+0000 7f831f988640 1 -- 172.21.15.2:0/4290278068 wait complete. 2024-09-19T06:16:25.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.618+0000 7f831f988640 1 Processor -- start 2024-09-19T06:16:25.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.618+0000 7f831f988640 1 -- start start 2024-09-19T06:16:25.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.618+0000 7f831f988640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83181009b0 0x7f831819a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:25.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.618+0000 7f831f988640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8318101360 0x7f831819ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:25.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.618+0000 7f831f988640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f831810e4d0 0x7f831819ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:25.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.618+0000 7f831f988640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8318114130 con 0x7f83181009b0 2024-09-19T06:16:25.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.618+0000 7f831f988640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8318113fb0 con 0x7f831810e4d0 2024-09-19T06:16:25.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.618+0000 7f831f988640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f83181142b0 con 0x7f8318101360 2024-09-19T06:16:25.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.618+0000 7f831d724640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83181009b0 0x7f831819a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:25.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.618+0000 7f831d724640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83181009b0 0x7f831819a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45328/0 (socket says 172.21.15.2:45328) 2024-09-19T06:16:25.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.618+0000 7f831d724640 1 -- 172.21.15.2:0/3458755874 learned_addr learned my addr 172.21.15.2:0/3458755874 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:25.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.618+0000 7f831df25640 1 --2- 172.21.15.2:0/3458755874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f831810e4d0 0x7f831819ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:25.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.618+0000 7f831cf23640 1 --2- 172.21.15.2:0/3458755874 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8318101360 0x7f831819ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:25.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.618+0000 7f831d724640 1 -- 172.21.15.2:0/3458755874 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8318101360 msgr2=0x7f831819ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:25.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.618+0000 7f831d724640 1 --2- 172.21.15.2:0/3458755874 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8318101360 0x7f831819ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:25.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.618+0000 7f831d724640 1 -- 172.21.15.2:0/3458755874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f831810e4d0 msgr2=0x7f831819ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:25.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.618+0000 7f831d724640 1 --2- 172.21.15.2:0/3458755874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f831810e4d0 0x7f831819ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:25.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.618+0000 7f831d724640 1 -- 172.21.15.2:0/3458755874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f831819f600 con 0x7f83181009b0 2024-09-19T06:16:25.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.619+0000 7f831d724640 1 --2- 172.21.15.2:0/3458755874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83181009b0 0x7f831819a650 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f8314005ab0 tx=0x7f8314003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:25.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.619+0000 7f830e7fc640 1 -- 172.21.15.2:0/3458755874 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f831403f070 con 0x7f83181009b0 2024-09-19T06:16:25.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.619+0000 7f830e7fc640 1 -- 172.21.15.2:0/3458755874 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8314031d60 con 0x7f83181009b0 2024-09-19T06:16:25.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.619+0000 7f831f988640 1 -- 172.21.15.2:0/3458755874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f831819f890 con 0x7f83181009b0 2024-09-19T06:16:25.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.619+0000 7f830e7fc640 1 -- 172.21.15.2:0/3458755874 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8314035030 con 0x7f83181009b0 2024-09-19T06:16:25.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.619+0000 7f831f988640 1 -- 172.21.15.2:0/3458755874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83181a71d0 con 0x7f83181009b0 2024-09-19T06:16:25.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.622+0000 7f830e7fc640 1 -- 172.21.15.2:0/3458755874 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f8314042070 con 0x7f83181009b0 2024-09-19T06:16:25.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.623+0000 7f8321d61740 1 Processor -- start 2024-09-19T06:16:25.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.623+0000 7f8321d61740 1 -- start start 2024-09-19T06:16:25.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.623+0000 7f830e7fc640 1 --2- 172.21.15.2:0/3458755874 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f83040a3430 0x7f83040a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:25.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.623+0000 7f8321d61740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ed5977b60 0x557ed5977f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:25.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.623+0000 7f8321d61740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ed5978480 0x557ed5982800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:25.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.623+0000 7f8321d61740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557ed5982d40 0x557ed5985130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:25.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.623+0000 7f8321d61740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557ed58dd280 con 0x557ed5978480 2024-09-19T06:16:25.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.623+0000 7f8321d61740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x557ed5884b10 con 0x557ed5977b60 2024-09-19T06:16:25.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.623+0000 7f8321d61740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x557ed58d9240 con 0x557ed5982d40 2024-09-19T06:16:25.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.624+0000 7f831df25640 1 --2- 172.21.15.2:0/3458755874 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f83040a3430 0x7f83040a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:25.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.624+0000 7f831df25640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557ed5982d40 0x557ed5985130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:25.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.624+0000 7f830e7fc640 1 -- 172.21.15.2:0/3458755874 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f83140f0400 con 0x7f83181009b0 2024-09-19T06:16:25.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.624+0000 7f831df25640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557ed5982d40 0x557ed5985130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:49706/0 (socket says 172.21.15.2:49706) 2024-09-19T06:16:25.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.624+0000 7f831df25640 1 -- 172.21.15.2:0/3969701057 learned_addr learned my addr 172.21.15.2:0/3969701057 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:25.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.624+0000 7f831cf23640 1 --2- 172.21.15.2:0/3969701057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ed5978480 0x557ed5982800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:25.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.625+0000 7f831d724640 1 --2- 172.21.15.2:0/3969701057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ed5977b60 0x557ed5977f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:25.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.625+0000 7f831df25640 1 --2- 172.21.15.2:0/3458755874 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f83040a3430 0x7f83040a58f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8310009fd0 tx=0x7f8310009f40 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:25.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.625+0000 7f831df25640 1 -- 172.21.15.2:0/3969701057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ed5977b60 msgr2=0x557ed5977f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:25.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.625+0000 7f831df25640 1 --2- 172.21.15.2:0/3969701057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ed5977b60 0x557ed5977f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:25.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.625+0000 7f831df25640 1 -- 172.21.15.2:0/3969701057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ed5978480 msgr2=0x557ed5982800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:25.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.625+0000 7f831df25640 1 --2- 172.21.15.2:0/3969701057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ed5978480 0x557ed5982800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:25.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.625+0000 7f831df25640 1 -- 172.21.15.2:0/3969701057 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ed58911f0 con 0x557ed5982d40 2024-09-19T06:16:25.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.625+0000 7f831cf23640 1 --2- 172.21.15.2:0/3969701057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ed5978480 0x557ed5982800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:25.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.626+0000 7f831df25640 1 --2- 172.21.15.2:0/3969701057 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557ed5982d40 0x557ed5985130 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f831000f720 tx=0x7f8310027000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b60c6c307af6df72 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:25.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.626+0000 7f83037fe640 1 -- 172.21.15.2:0/3969701057 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8310004d20 con 0x557ed5982d40 2024-09-19T06:16:25.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.626+0000 7f83037fe640 1 -- 172.21.15.2:0/3969701057 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f831002e030 con 0x557ed5982d40 2024-09-19T06:16:25.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.626+0000 7f83037fe640 1 -- 172.21.15.2:0/3969701057 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f831001e680 con 0x557ed5982d40 2024-09-19T06:16:25.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.627+0000 7f8321d61740 1 -- 172.21.15.2:0/3969701057 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557ed5982d40 msgr2=0x557ed5985130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:25.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.627+0000 7f8321d61740 1 --2- 172.21.15.2:0/3969701057 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557ed5982d40 0x557ed5985130 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f831000f720 tx=0x7f8310027000 comp rx=0 tx=0).stop 2024-09-19T06:16:25.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.627+0000 7f8321d61740 1 -- 172.21.15.2:0/3969701057 shutdown_connections 2024-09-19T06:16:25.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.627+0000 7f8321d61740 1 --2- 172.21.15.2:0/3969701057 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557ed5982d40 0x557ed5985130 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:25.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.627+0000 7f8321d61740 1 --2- 172.21.15.2:0/3969701057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ed5978480 0x557ed5982800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:25.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.627+0000 7f8321d61740 1 --2- 172.21.15.2:0/3969701057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ed5977b60 0x557ed5977f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:25.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.627+0000 7f8321d61740 1 -- 172.21.15.2:0/3969701057 >> 172.21.15.2:0/3969701057 conn(0x557ed59740f0 msgr2=0x557ed59744d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:25.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.627+0000 7f8321d61740 1 -- 172.21.15.2:0/3969701057 shutdown_connections 2024-09-19T06:16:25.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.627+0000 7f8321d61740 1 -- 172.21.15.2:0/3969701057 wait complete. 2024-09-19T06:16:25.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.628+0000 7f8321d61740 1 -- start start 2024-09-19T06:16:25.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.628+0000 7f8321d61740 1 Processor -- start 2024-09-19T06:16:25.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.628+0000 7f8321d61740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ed5977b60 0x557ed597fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:25.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.628+0000 7f8321d61740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ed5978480 0x557ed5980170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:25.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.628+0000 7f8321d61740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557ed5982d40 0x557ed59806b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:25.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.629+0000 7f8321d61740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557ed5985910 con 0x557ed5978480 2024-09-19T06:16:25.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.629+0000 7f8321d61740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x557ed5897f10 con 0x557ed5977b60 2024-09-19T06:16:25.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.629+0000 7f8321d61740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x557ed5985a90 con 0x557ed5982d40 2024-09-19T06:16:25.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.629+0000 7f8321d61740 10 client.0 _ll_register_callbacks cb 0x557ed5860a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:25.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.629+0000 7f831cf23640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ed5978480 0x557ed5980170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:25.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.629+0000 7f831cf23640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ed5978480 0x557ed5980170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45352/0 (socket says 172.21.15.2:45352) 2024-09-19T06:16:25.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.629+0000 7f831cf23640 1 -- 172.21.15.2:0/1939632376 learned_addr learned my addr 172.21.15.2:0/1939632376 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:25.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.629+0000 7f831df25640 1 --2- 172.21.15.2:0/1939632376 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557ed5982d40 0x557ed59806b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:25.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.629+0000 7f831d724640 1 --2- 172.21.15.2:0/1939632376 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ed5977b60 0x557ed597fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:25.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.629+0000 7f831cf23640 1 -- 172.21.15.2:0/1939632376 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557ed5982d40 msgr2=0x557ed59806b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:25.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.629+0000 7f831cf23640 1 --2- 172.21.15.2:0/1939632376 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557ed5982d40 0x557ed59806b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:25.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.629+0000 7f831cf23640 1 -- 172.21.15.2:0/1939632376 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ed5977b60 msgr2=0x557ed597fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:25.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.629+0000 7f831cf23640 1 --2- 172.21.15.2:0/1939632376 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ed5977b60 0x557ed597fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:25.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.629+0000 7f831cf23640 1 -- 172.21.15.2:0/1939632376 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ed564e6a0 con 0x557ed5978480 2024-09-19T06:16:25.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.629+0000 7f831d724640 1 --2- 172.21.15.2:0/1939632376 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ed5977b60 0x557ed597fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:16:25.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.630+0000 7f831cf23640 1 --2- 172.21.15.2:0/1939632376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ed5978480 0x557ed5980170 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f830800bb00 tx=0x7f8308004580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d63b7e525ee090d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:25.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.630+0000 7f8300ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:16:25.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.630+0000 7f8300ff9640 1 -- 172.21.15.2:0/1939632376 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8308011440 con 0x557ed5978480 2024-09-19T06:16:25.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.630+0000 7f8321d61740 1 -- 172.21.15.2:0/1939632376 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f831002e030 con 0x557ed5978480 2024-09-19T06:16:25.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.630+0000 7f8300ff9640 1 -- 172.21.15.2:0/1939632376 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f83080115e0 con 0x557ed5978480 2024-09-19T06:16:25.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.630+0000 7f8300ff9640 1 -- 172.21.15.2:0/1939632376 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f83080117e0 con 0x557ed5978480 2024-09-19T06:16:25.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.630+0000 7f8321d61740 10 client.15660 fetch_fsmap learned FSMap version 26 2024-09-19T06:16:25.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.630+0000 7f8321d61740 1 -- 172.21.15.2:0/1939632376 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557ed59915d0 con 0x557ed5978480 2024-09-19T06:16:25.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.630+0000 7f8300ff9640 1 -- 172.21.15.2:0/1939632376 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f831002e030 con 0x557ed5978480 2024-09-19T06:16:25.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.631+0000 7f8300ff9640 1 -- 172.21.15.2:0/1939632376 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f830801b920 con 0x557ed5978480 2024-09-19T06:16:25.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.631+0000 7f8321d61740 10 client.15660 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:16:25.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.631+0000 7f8321d61740 10 client.15660 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:25.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.631+0000 7f8321d61740 20 client.15660 populate_metadata read hostname 'smithi002' 2024-09-19T06:16:25.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.631+0000 7f8321d61740 1 --2- 172.21.15.2:0/1939632376 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x557ed59929e0 0x557ed5994e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:25.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.631+0000 7f8321d61740 4 client.15660 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:16:25.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.631+0000 7f8321d61740 1 -- 172.21.15.2:0/1939632376 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557ed58ea7f0 con 0x557ed59929e0 2024-09-19T06:16:25.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.631+0000 7f831d724640 1 --2- 172.21.15.2:0/1939632376 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x557ed59929e0 0x557ed5994e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:25.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.631+0000 7f831d724640 1 --2- 172.21.15.2:0/1939632376 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x557ed59929e0 0x557ed5994e60 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f640a8c1c50fdccf server_cookie=766917ea819faafd in_seq=0 out_seq=0 2024-09-19T06:16:25.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.631+0000 7f8300ff9640 10 client.15660 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:25.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.632+0000 7f8300ff9640 1 -- 172.21.15.2:0/1939632376 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557ed58ea7f0 con 0x557ed59929e0 2024-09-19T06:16:25.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.632+0000 7f8300ff9640 10 client.15660 handle_command_reply: tid=0 2024-09-19T06:16:25.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.632+0000 7f8321d61740 1 client.15660 shutdown 2024-09-19T06:16:25.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.633+0000 7f8321d61740 1 -- 172.21.15.2:0/1939632376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ed5978480 msgr2=0x557ed5980170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:25.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.633+0000 7f8321d61740 1 --2- 172.21.15.2:0/1939632376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ed5978480 0x557ed5980170 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f830800bb00 tx=0x7f8308004580 comp rx=0 tx=0).stop 2024-09-19T06:16:25.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.633+0000 7f8321d61740 1 -- 172.21.15.2:0/1939632376 shutdown_connections 2024-09-19T06:16:25.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.633+0000 7f8321d61740 1 --2- 172.21.15.2:0/1939632376 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557ed5982d40 0x557ed59806b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:25.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.633+0000 7f8321d61740 1 --2- 172.21.15.2:0/1939632376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ed5978480 0x557ed5980170 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:25.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.633+0000 7f8321d61740 1 --2- 172.21.15.2:0/1939632376 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x557ed59929e0 0x557ed5994e60 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:25.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.633+0000 7f8300ff9640 0 client.15660 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:25.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.633+0000 7f8321d61740 1 --2- 172.21.15.2:0/1939632376 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ed5977b60 0x557ed597fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:25.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.633+0000 7f8321d61740 1 -- 172.21.15.2:0/1939632376 >> 172.21.15.2:0/1939632376 conn(0x557ed59740f0 msgr2=0x557ed5979e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:25.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.633+0000 7f8321d61740 1 -- 172.21.15.2:0/1939632376 shutdown_connections 2024-09-19T06:16:25.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.633+0000 7f8321d61740 1 -- 172.21.15.2:0/1939632376 wait complete. 2024-09-19T06:16:25.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.633+0000 7f8321d61740 20 client.15660 trim_cache size 0 max 16384 2024-09-19T06:16:25.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.652+0000 7f8321d61740 1 Processor -- start 2024-09-19T06:16:25.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.652+0000 7f8321d61740 1 -- start start 2024-09-19T06:16:25.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.652+0000 7f8321d61740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ed5977b60 0x557ed599a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:25.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.652+0000 7f8321d61740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557ed5982d40 0x557ed599ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:25.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.652+0000 7f8321d61740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ed597ceb0 0x557ed597d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:25.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.652+0000 7f8321d61740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f83181ade00 con 0x557ed5977b60 2024-09-19T06:16:25.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.652+0000 7f8321d61740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f83181ab6d0 con 0x557ed597ceb0 2024-09-19T06:16:25.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.652+0000 7f8321d61740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f83181a9520 con 0x557ed5982d40 2024-09-19T06:16:25.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.652+0000 7f831d724640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ed5977b60 0x557ed599a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:25.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.652+0000 7f831d724640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ed5977b60 0x557ed599a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45362/0 (socket says 172.21.15.2:45362) 2024-09-19T06:16:25.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.652+0000 7f831d724640 1 -- 172.21.15.2:0/1876397986 learned_addr learned my addr 172.21.15.2:0/1876397986 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:25.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.652+0000 7f831cf23640 1 --2- 172.21.15.2:0/1876397986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557ed5982d40 0x557ed599ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:25.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.652+0000 7f831df25640 1 --2- 172.21.15.2:0/1876397986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ed597ceb0 0x557ed597d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:25.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.653+0000 7f831cf23640 1 -- 172.21.15.2:0/1876397986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ed597ceb0 msgr2=0x557ed597d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:25.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.653+0000 7f831cf23640 1 --2- 172.21.15.2:0/1876397986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ed597ceb0 0x557ed597d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:25.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.653+0000 7f831cf23640 1 -- 172.21.15.2:0/1876397986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ed5977b60 msgr2=0x557ed599a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:25.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.653+0000 7f831cf23640 1 --2- 172.21.15.2:0/1876397986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ed5977b60 0x557ed599a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:25.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.653+0000 7f831cf23640 1 -- 172.21.15.2:0/1876397986 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ed5973b90 con 0x557ed5982d40 2024-09-19T06:16:25.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.653+0000 7f831d724640 1 --2- 172.21.15.2:0/1876397986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ed5977b60 0x557ed599a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:25.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.653+0000 7f831cf23640 1 --2- 172.21.15.2:0/1876397986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557ed5982d40 0x557ed599ac70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x557ed5980d20 tx=0x7f83080044c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adf5c3af8c301edc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:25.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.653+0000 7f8302ffd640 1 -- 172.21.15.2:0/1876397986 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8308028070 con 0x557ed5982d40 2024-09-19T06:16:25.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.653+0000 7f8302ffd640 1 -- 172.21.15.2:0/1876397986 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8308010440 con 0x557ed5982d40 2024-09-19T06:16:25.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.653+0000 7f8302ffd640 1 -- 172.21.15.2:0/1876397986 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83080109f0 con 0x557ed5982d40 2024-09-19T06:16:25.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.654+0000 7f8321d61740 1 -- 172.21.15.2:0/1876397986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557ed5982d40 msgr2=0x557ed599ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:25.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.654+0000 7f8321d61740 1 --2- 172.21.15.2:0/1876397986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557ed5982d40 0x557ed599ac70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x557ed5980d20 tx=0x7f83080044c0 comp rx=0 tx=0).stop 2024-09-19T06:16:25.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.654+0000 7f8321d61740 1 -- 172.21.15.2:0/1876397986 shutdown_connections 2024-09-19T06:16:25.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.654+0000 7f8321d61740 1 --2- 172.21.15.2:0/1876397986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ed597ceb0 0x557ed597d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:25.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.654+0000 7f8321d61740 1 --2- 172.21.15.2:0/1876397986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557ed5982d40 0x557ed599ac70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:25.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.654+0000 7f8321d61740 1 --2- 172.21.15.2:0/1876397986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ed5977b60 0x557ed599a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:25.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.654+0000 7f8321d61740 1 -- 172.21.15.2:0/1876397986 >> 172.21.15.2:0/1876397986 conn(0x557ed59740f0 msgr2=0x557ed5979e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:25.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.654+0000 7f8321d61740 1 -- 172.21.15.2:0/1876397986 shutdown_connections 2024-09-19T06:16:25.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.654+0000 7f8321d61740 1 -- 172.21.15.2:0/1876397986 wait complete. 2024-09-19T06:16:25.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.654+0000 7f8321d61740 1 -- start start 2024-09-19T06:16:25.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.655+0000 7f8321d61740 1 Processor -- start 2024-09-19T06:16:25.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.655+0000 7f8321d61740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ed5977b60 0x557ed598b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:25.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.655+0000 7f8321d61740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ed597ceb0 0x557ed598b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:25.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.655+0000 7f8321d61740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557ed5982d40 0x557ed5987eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:25.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.655+0000 7f8321d61740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f83181a9b90 con 0x557ed597ceb0 2024-09-19T06:16:25.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.655+0000 7f8321d61740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f83181ab000 con 0x557ed5977b60 2024-09-19T06:16:25.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.655+0000 7f8321d61740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f83181aa260 con 0x557ed5982d40 2024-09-19T06:16:25.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.655+0000 7f831d724640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ed5977b60 0x557ed598b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:25.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.655+0000 7f831d724640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ed5977b60 0x557ed598b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:39566/0 (socket says 172.21.15.2:39566) 2024-09-19T06:16:25.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.655+0000 7f831d724640 1 -- 172.21.15.2:0/3244473028 learned_addr learned my addr 172.21.15.2:0/3244473028 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:25.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.655+0000 7f8321d61740 10 client.0 _ll_register_callbacks cb 0x7f8308004060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:25.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.655+0000 7f831cf23640 1 --2- 172.21.15.2:0/3244473028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ed597ceb0 0x557ed598b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:25.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.655+0000 7f831d724640 1 -- 172.21.15.2:0/3244473028 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557ed5982d40 msgr2=0x557ed5987eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:25.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.655+0000 7f831d724640 1 --2- 172.21.15.2:0/3244473028 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557ed5982d40 0x557ed5987eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:25.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.656+0000 7f831d724640 1 -- 172.21.15.2:0/3244473028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ed597ceb0 msgr2=0x557ed598b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:25.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.656+0000 7f831d724640 1 --2- 172.21.15.2:0/3244473028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ed597ceb0 0x557ed598b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:25.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.656+0000 7f831d724640 1 -- 172.21.15.2:0/3244473028 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ed59886e0 con 0x557ed5977b60 2024-09-19T06:16:25.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.656+0000 7f831d724640 1 --2- 172.21.15.2:0/3244473028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ed5977b60 0x557ed598b090 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f83140b9190 tx=0x7f831402a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=338e97c95ee4b4ee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:25.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.656+0000 7f8300ff9640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-09-19T06:16:25.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.656+0000 7f8300ff9640 1 -- 172.21.15.2:0/3244473028 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8314049040 con 0x557ed5977b60 2024-09-19T06:16:25.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.656+0000 7f8300ff9640 1 -- 172.21.15.2:0/3244473028 <== mon.2 v2:172.21.15.89:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f83140b8e30 con 0x557ed5977b60 2024-09-19T06:16:25.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.656+0000 7f8321d61740 1 -- 172.21.15.2:0/3244473028 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8308010440 con 0x557ed5977b60 2024-09-19T06:16:25.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.656+0000 7f8300ff9640 1 -- 172.21.15.2:0/3244473028 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f831403b560 con 0x557ed5977b60 2024-09-19T06:16:25.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.656+0000 7f8321d61740 10 client.25337 fetch_fsmap learned FSMap version 26 2024-09-19T06:16:25.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.656+0000 7f8321d61740 1 -- 172.21.15.2:0/3244473028 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557ed59fe4a0 con 0x557ed5977b60 2024-09-19T06:16:25.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.656+0000 7f8300ff9640 1 -- 172.21.15.2:0/3244473028 <== mon.2 v2:172.21.15.89:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8308010440 con 0x557ed5977b60 2024-09-19T06:16:25.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.657+0000 7f8300ff9640 1 -- 172.21.15.2:0/3244473028 <== mon.2 v2:172.21.15.89:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f83140c4ef0 con 0x557ed5977b60 2024-09-19T06:16:25.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.657+0000 7f8321d61740 10 client.25337 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:16:25.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.657+0000 7f8321d61740 10 client.25337 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:25.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.657+0000 7f8321d61740 20 client.25337 populate_metadata read hostname 'smithi002' 2024-09-19T06:16:25.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.657+0000 7f8321d61740 1 --2- 172.21.15.2:0/3244473028 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x557ed59febf0 0x557ed5a01030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:25.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.657+0000 7f8321d61740 4 client.25337 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:16:25.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.657+0000 7f8321d61740 1 -- 172.21.15.2:0/3244473028 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557ed58e4d00 con 0x557ed59febf0 2024-09-19T06:16:25.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.657+0000 7f831cf23640 1 --2- 172.21.15.2:0/3244473028 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x557ed59febf0 0x557ed5a01030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:25.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.657+0000 7f8300ff9640 10 client.25337 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:25.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.657+0000 7f831cf23640 1 --2- 172.21.15.2:0/3244473028 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x557ed59febf0 0x557ed5a01030 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef3d2e697673b1e server_cookie=cf0c3ff71e494744 in_seq=0 out_seq=0 2024-09-19T06:16:25.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.658+0000 7f8300ff9640 1 -- 172.21.15.2:0/3244473028 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557ed58e4d00 con 0x557ed59febf0 2024-09-19T06:16:25.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.658+0000 7f8300ff9640 10 client.25337 handle_command_reply: tid=0 2024-09-19T06:16:25.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.658+0000 7f8321d61740 1 client.25337 shutdown 2024-09-19T06:16:25.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.658+0000 7f8321d61740 1 -- 172.21.15.2:0/3244473028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ed5977b60 msgr2=0x557ed598b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:25.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.658+0000 7f8321d61740 1 --2- 172.21.15.2:0/3244473028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ed5977b60 0x557ed598b090 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f83140b9190 tx=0x7f831402a410 comp rx=0 tx=0).stop 2024-09-19T06:16:25.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.659+0000 7f8321d61740 1 -- 172.21.15.2:0/3244473028 shutdown_connections 2024-09-19T06:16:25.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.659+0000 7f8321d61740 1 --2- 172.21.15.2:0/3244473028 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557ed5982d40 0x557ed5987eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:25.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.659+0000 7f8321d61740 1 --2- 172.21.15.2:0/3244473028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ed597ceb0 0x557ed598b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:25.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.659+0000 7f8321d61740 1 --2- 172.21.15.2:0/3244473028 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x557ed59febf0 0x557ed5a01030 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:25.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.659+0000 7f8321d61740 1 --2- 172.21.15.2:0/3244473028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ed5977b60 0x557ed598b090 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:25.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.659+0000 7f8300ff9640 0 client.25337 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:25.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.659+0000 7f8321d61740 1 -- 172.21.15.2:0/3244473028 >> 172.21.15.2:0/3244473028 conn(0x557ed59740f0 msgr2=0x557ed5979e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:25.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.659+0000 7f8321d61740 1 -- 172.21.15.2:0/3244473028 shutdown_connections 2024-09-19T06:16:25.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.659+0000 7f8321d61740 1 -- 172.21.15.2:0/3244473028 wait complete. 2024-09-19T06:16:25.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.659+0000 7f8321d61740 20 client.25337 trim_cache size 0 max 16384 2024-09-19T06:16:25.665 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:16:25.665 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T06:16:25.665 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "b9a5abd9-46e5-4db0-825a-62ed965aaa22", 2024-09-19T06:16:25.665 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T06:16:25.665 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:16:25.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.660+0000 7f831f988640 1 -- 172.21.15.2:0/3458755874 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f83040a3430 msgr2=0x7f83040a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:25.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.660+0000 7f831f988640 1 --2- 172.21.15.2:0/3458755874 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f83040a3430 0x7f83040a58f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8310009fd0 tx=0x7f8310009f40 comp rx=0 tx=0).stop 2024-09-19T06:16:25.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.660+0000 7f831f988640 1 -- 172.21.15.2:0/3458755874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83181009b0 msgr2=0x7f831819a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:25.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.660+0000 7f831f988640 1 --2- 172.21.15.2:0/3458755874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83181009b0 0x7f831819a650 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f8314005ab0 tx=0x7f8314003c80 comp rx=0 tx=0).stop 2024-09-19T06:16:25.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.660+0000 7f831f988640 1 -- 172.21.15.2:0/3458755874 shutdown_connections 2024-09-19T06:16:25.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.660+0000 7f831f988640 1 --2- 172.21.15.2:0/3458755874 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f83040a3430 0x7f83040a58f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:25.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.660+0000 7f831f988640 1 --2- 172.21.15.2:0/3458755874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f831810e4d0 0x7f831819ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:25.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.660+0000 7f831f988640 1 --2- 172.21.15.2:0/3458755874 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8318101360 0x7f831819ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:25.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.660+0000 7f831f988640 1 --2- 172.21.15.2:0/3458755874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83181009b0 0x7f831819a650 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:25.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.660+0000 7f831f988640 1 -- 172.21.15.2:0/3458755874 >> 172.21.15.2:0/3458755874 conn(0x7f83180fc7d0 msgr2=0x7f83180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:25.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.660+0000 7f831f988640 1 -- 172.21.15.2:0/3458755874 shutdown_connections 2024-09-19T06:16:25.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:25.660+0000 7f831f988640 1 -- 172.21.15.2:0/3458755874 wait complete. 2024-09-19T06:16:25.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:25 smithi090 ceph-mon[34497]: pgmap v51: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 79 MiB/s wr, 30 op/s 2024-09-19T06:16:26.382 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:16:26.695 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:16:26.704 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-19T06:16:26.704 INFO:tasks.workunit.client.0.smithi002.stdout: Children see throughput for 1 rewriters = 113420.61 kB/sec 2024-09-19T06:16:26.704 INFO:tasks.workunit.client.0.smithi002.stdout: Parent sees throughput for 1 rewriters = 113418.79 kB/sec 2024-09-19T06:16:26.704 INFO:tasks.workunit.client.0.smithi002.stdout: Min throughput per process = 113420.61 kB/sec 2024-09-19T06:16:26.704 INFO:tasks.workunit.client.0.smithi002.stdout: Max throughput per process = 113420.61 kB/sec 2024-09-19T06:16:26.704 INFO:tasks.workunit.client.0.smithi002.stdout: Avg throughput per process = 113420.61 kB/sec 2024-09-19T06:16:26.705 INFO:tasks.workunit.client.0.smithi002.stdout: Min xfer = 1048576.00 kB 2024-09-19T06:16:26.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:26 smithi002 ceph-mon[30982]: scrub queued for path: / 2024-09-19T06:16:26.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:26 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:16:26.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:26 smithi002 ceph-mon[30982]: scrub summary: active paths [/] 2024-09-19T06:16:26.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:26 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:16:26.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:26 smithi090 ceph-mon[34497]: scrub queued for path: / 2024-09-19T06:16:26.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:26 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:16:26.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:26 smithi090 ceph-mon[34497]: scrub summary: active paths [/] 2024-09-19T06:16:26.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:26 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:16:26.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:26 smithi089 ceph-mon[34160]: scrub queued for path: / 2024-09-19T06:16:26.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:26 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:16:26.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:26 smithi089 ceph-mon[34160]: scrub summary: active paths [/] 2024-09-19T06:16:26.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:26 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:16:27.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:27 smithi002 ceph-mon[30982]: pgmap v52: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 61 MiB/s wr, 23 op/s 2024-09-19T06:16:27.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:27 smithi090 ceph-mon[34497]: pgmap v52: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 61 MiB/s wr, 23 op/s 2024-09-19T06:16:27.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:27 smithi089 ceph-mon[34160]: pgmap v52: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 61 MiB/s wr, 23 op/s 2024-09-19T06:16:28.468 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:28 smithi002 ceph-mon[30982]: scrub summary: idle 2024-09-19T06:16:28.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.709+0000 7fc0e1ebe640 1 -- 172.21.15.2:0/3813259417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0dc101de0 msgr2=0x7fc0dc1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:28.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.709+0000 7fc0e1ebe640 1 --2- 172.21.15.2:0/3813259417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0dc101de0 0x7fc0dc1021c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc009900 tx=0x7fc0cc02a410 comp rx=0 tx=0).stop 2024-09-19T06:16:28.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.709+0000 7fc0e1ebe640 1 -- 172.21.15.2:0/3813259417 shutdown_connections 2024-09-19T06:16:28.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.709+0000 7fc0e1ebe640 1 --2- 172.21.15.2:0/3813259417 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0dc106f10 0x7fc0dc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:28.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.709+0000 7fc0e1ebe640 1 --2- 172.21.15.2:0/3813259417 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0dc102790 0x7fc0dc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:28.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.710+0000 7fc0e1ebe640 1 --2- 172.21.15.2:0/3813259417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0dc101de0 0x7fc0dc1021c0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:28.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.710+0000 7fc0e1ebe640 1 -- 172.21.15.2:0/3813259417 >> 172.21.15.2:0/3813259417 conn(0x7fc0dc0fd8c0 msgr2=0x7fc0dc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:28.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.710+0000 7fc0e1ebe640 1 -- 172.21.15.2:0/3813259417 shutdown_connections 2024-09-19T06:16:28.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.710+0000 7fc0e1ebe640 1 -- 172.21.15.2:0/3813259417 wait complete. 2024-09-19T06:16:28.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.710+0000 7fc0e1ebe640 1 Processor -- start 2024-09-19T06:16:28.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.710+0000 7fc0e1ebe640 1 -- start start 2024-09-19T06:16:28.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.710+0000 7fc0e1ebe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0dc101de0 0x7fc0dc198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:28.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.710+0000 7fc0e1ebe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0dc102790 0x7fc0dc1988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:28.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.710+0000 7fc0e1ebe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0dc106f10 0x7fc0dc19cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:28.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.710+0000 7fc0e1ebe640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc0dc111de0 con 0x7fc0dc102790 2024-09-19T06:16:28.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.710+0000 7fc0e1ebe640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc0dc111c60 con 0x7fc0dc106f10 2024-09-19T06:16:28.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.711+0000 7fc0e1ebe640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc0dc111f60 con 0x7fc0dc101de0 2024-09-19T06:16:28.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.711+0000 7fc0d3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0dc102790 0x7fc0dc1988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:28.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.711+0000 7fc0d3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0dc102790 0x7fc0dc1988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45398/0 (socket says 172.21.15.2:45398) 2024-09-19T06:16:28.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.711+0000 7fc0d3fff640 1 -- 172.21.15.2:0/276410347 learned_addr learned my addr 172.21.15.2:0/276410347 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:28.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.711+0000 7fc0dbfff640 1 --2- 172.21.15.2:0/276410347 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0dc106f10 0x7fc0dc19cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:28.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.711+0000 7fc0db7fe640 1 --2- 172.21.15.2:0/276410347 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0dc101de0 0x7fc0dc198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:28.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.711+0000 7fc0d3fff640 1 -- 172.21.15.2:0/276410347 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0dc101de0 msgr2=0x7fc0dc198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:28.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.711+0000 7fc0d3fff640 1 --2- 172.21.15.2:0/276410347 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0dc101de0 0x7fc0dc198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:28.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.711+0000 7fc0d3fff640 1 -- 172.21.15.2:0/276410347 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0dc106f10 msgr2=0x7fc0dc19cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:28.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.711+0000 7fc0d3fff640 1 --2- 172.21.15.2:0/276410347 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0dc106f10 0x7fc0dc19cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:28.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.711+0000 7fc0d3fff640 1 -- 172.21.15.2:0/276410347 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0dc19d320 con 0x7fc0dc102790 2024-09-19T06:16:28.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.711+0000 7fc0d3fff640 1 --2- 172.21.15.2:0/276410347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0dc102790 0x7fc0dc1988b0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc0c400d950 tx=0x7fc0c400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:28.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.711+0000 7fc0d97fa640 1 -- 172.21.15.2:0/276410347 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c4017030 con 0x7fc0dc102790 2024-09-19T06:16:28.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.711+0000 7fc0d97fa640 1 -- 172.21.15.2:0/276410347 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc0c4004020 con 0x7fc0dc102790 2024-09-19T06:16:28.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.711+0000 7fc0e1ebe640 1 -- 172.21.15.2:0/276410347 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0dc19d610 con 0x7fc0dc102790 2024-09-19T06:16:28.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.712+0000 7fc0d97fa640 1 -- 172.21.15.2:0/276410347 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c40047a0 con 0x7fc0dc102790 2024-09-19T06:16:28.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.712+0000 7fc0e1ebe640 1 -- 172.21.15.2:0/276410347 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0dc1a4ef0 con 0x7fc0dc102790 2024-09-19T06:16:28.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.714+0000 7fc0d97fa640 1 -- 172.21.15.2:0/276410347 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fc0c40041d0 con 0x7fc0dc102790 2024-09-19T06:16:28.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.714+0000 7fc0d97fa640 1 --2- 172.21.15.2:0/276410347 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc0c80a3430 0x7fc0c80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:28.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.715+0000 7fc0e4297740 1 Processor -- start 2024-09-19T06:16:28.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.715+0000 7fc0db7fe640 1 --2- 172.21.15.2:0/276410347 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc0c80a3430 0x7fc0c80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:28.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.715+0000 7fc0d97fa640 1 -- 172.21.15.2:0/276410347 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fc0c40cf7b0 con 0x7fc0dc102790 2024-09-19T06:16:28.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.715+0000 7fc0e4297740 1 -- start start 2024-09-19T06:16:28.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.715+0000 7fc0e4297740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8a95e63a0 0x55a8a95e6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:28.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.715+0000 7fc0e4297740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8a95e6cc0 0x55a8a95f5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:28.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.715+0000 7fc0e4297740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a8a95f5a90 0x55a8a95f7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:28.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.715+0000 7fc0e4297740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a8a954c2e0 con 0x55a8a95e63a0 2024-09-19T06:16:28.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.715+0000 7fc0e4297740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55a8a94f3ce0 con 0x55a8a95e6cc0 2024-09-19T06:16:28.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.715+0000 7fc0e4297740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55a8a95482a0 con 0x55a8a95f5a90 2024-09-19T06:16:28.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.715+0000 7fc0db7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8a95e63a0 0x55a8a95e6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:28.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.715+0000 7fc0db7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8a95e63a0 0x55a8a95e6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45412/0 (socket says 172.21.15.2:45412) 2024-09-19T06:16:28.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.715+0000 7fc0db7fe640 1 -- 172.21.15.2:0/3038936184 learned_addr learned my addr 172.21.15.2:0/3038936184 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:28.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.715+0000 7fc0db7fe640 1 --2- 172.21.15.2:0/276410347 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc0c80a3430 0x7fc0c80a58f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc031440 tx=0x7fc0cc0095f0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:28.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.715+0000 7fc0dbfff640 1 --2- 172.21.15.2:0/3038936184 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a8a95f5a90 0x55a8a95f7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:28.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.715+0000 7fc0d3fff640 1 --2- 172.21.15.2:0/3038936184 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8a95e6cc0 0x55a8a95f5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:28.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.716+0000 7fc0db7fe640 1 -- 172.21.15.2:0/3038936184 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a8a95f5a90 msgr2=0x55a8a95f7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:28.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.716+0000 7fc0db7fe640 1 --2- 172.21.15.2:0/3038936184 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a8a95f5a90 0x55a8a95f7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:28.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.716+0000 7fc0db7fe640 1 -- 172.21.15.2:0/3038936184 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8a95e6cc0 msgr2=0x55a8a95f5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:28.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.716+0000 7fc0db7fe640 1 --2- 172.21.15.2:0/3038936184 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8a95e6cc0 0x55a8a95f5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:28.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.716+0000 7fc0db7fe640 1 -- 172.21.15.2:0/3038936184 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8a94d8440 con 0x55a8a95e63a0 2024-09-19T06:16:28.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.716+0000 7fc0dbfff640 1 --2- 172.21.15.2:0/3038936184 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a8a95f5a90 0x55a8a95f7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:16:28.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.716+0000 7fc0db7fe640 1 --2- 172.21.15.2:0/3038936184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8a95e63a0 0x55a8a95e6780 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc033000 tx=0x7fc0cc03c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61654a6b7c5e31b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:28.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.716+0000 7fc0d1ffb640 1 -- 172.21.15.2:0/3038936184 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc04c070 con 0x55a8a95e63a0 2024-09-19T06:16:28.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.716+0000 7fc0d1ffb640 1 -- 172.21.15.2:0/3038936184 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc0cc005040 con 0x55a8a95e63a0 2024-09-19T06:16:28.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.716+0000 7fc0d1ffb640 1 -- 172.21.15.2:0/3038936184 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc035050 con 0x55a8a95e63a0 2024-09-19T06:16:28.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.717+0000 7fc0e4297740 1 -- 172.21.15.2:0/3038936184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8a95e63a0 msgr2=0x55a8a95e6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:28.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.717+0000 7fc0e4297740 1 --2- 172.21.15.2:0/3038936184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8a95e63a0 0x55a8a95e6780 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc033000 tx=0x7fc0cc03c000 comp rx=0 tx=0).stop 2024-09-19T06:16:28.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.717+0000 7fc0e4297740 1 -- 172.21.15.2:0/3038936184 shutdown_connections 2024-09-19T06:16:28.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.717+0000 7fc0e4297740 1 --2- 172.21.15.2:0/3038936184 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a8a95f5a90 0x55a8a95f7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:28.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.717+0000 7fc0e4297740 1 --2- 172.21.15.2:0/3038936184 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8a95e6cc0 0x55a8a95f5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:28.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.717+0000 7fc0e4297740 1 --2- 172.21.15.2:0/3038936184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8a95e63a0 0x55a8a95e6780 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:28.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.717+0000 7fc0e4297740 1 -- 172.21.15.2:0/3038936184 >> 172.21.15.2:0/3038936184 conn(0x55a8a95e2a30 msgr2=0x55a8a95e2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:28.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.717+0000 7fc0e4297740 1 -- 172.21.15.2:0/3038936184 shutdown_connections 2024-09-19T06:16:28.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.717+0000 7fc0e4297740 1 -- 172.21.15.2:0/3038936184 wait complete. 2024-09-19T06:16:28.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.717+0000 7fc0e4297740 1 -- start start 2024-09-19T06:16:28.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.718+0000 7fc0e4297740 1 Processor -- start 2024-09-19T06:16:28.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.718+0000 7fc0e4297740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a8a95e63a0 0x55a8a95f5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:28.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.718+0000 7fc0e4297740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8a95e6cc0 0x55a8a95f2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:28.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.718+0000 7fc0e4297740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8a95f5a90 0x55a8a95f2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:28.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.718+0000 7fc0e4297740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a8a95f8660 con 0x55a8a95f5a90 2024-09-19T06:16:28.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.718+0000 7fc0e4297740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55a8a9507050 con 0x55a8a95e6cc0 2024-09-19T06:16:28.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.718+0000 7fc0e4297740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55a8a95f87e0 con 0x55a8a95e63a0 2024-09-19T06:16:28.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.718+0000 7fc0e4297740 10 client.0 _ll_register_callbacks cb 0x55a8a9547160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:28.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.718+0000 7fc0dbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8a95f5a90 0x55a8a95f2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:28.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.718+0000 7fc0dbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8a95f5a90 0x55a8a95f2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45420/0 (socket says 172.21.15.2:45420) 2024-09-19T06:16:28.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.718+0000 7fc0dbfff640 1 -- 172.21.15.2:0/2378091077 learned_addr learned my addr 172.21.15.2:0/2378091077 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:28.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.718+0000 7fc0d3fff640 1 --2- 172.21.15.2:0/2378091077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8a95e6cc0 0x55a8a95f2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:28.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.718+0000 7fc0db7fe640 1 --2- 172.21.15.2:0/2378091077 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a8a95e63a0 0x55a8a95f5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:28.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.719+0000 7fc0dbfff640 1 -- 172.21.15.2:0/2378091077 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a8a95e63a0 msgr2=0x55a8a95f5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:28.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.719+0000 7fc0dbfff640 1 --2- 172.21.15.2:0/2378091077 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a8a95e63a0 0x55a8a95f5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:28.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.719+0000 7fc0dbfff640 1 -- 172.21.15.2:0/2378091077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8a95e6cc0 msgr2=0x55a8a95f2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:28.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.719+0000 7fc0dbfff640 1 --2- 172.21.15.2:0/2378091077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8a95e6cc0 0x55a8a95f2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:28.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.719+0000 7fc0dbfff640 1 -- 172.21.15.2:0/2378091077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8a92bd3c0 con 0x55a8a95f5a90 2024-09-19T06:16:28.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.719+0000 7fc0dbfff640 1 --2- 172.21.15.2:0/2378091077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8a95f5a90 0x55a8a95f2d10 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4011500 tx=0x7fc0d40119c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b97b5911be8770 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:28.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.719+0000 7fc0baffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:16:28.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.719+0000 7fc0baffd640 1 -- 172.21.15.2:0/2378091077 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d4004d20 con 0x55a8a95f5a90 2024-09-19T06:16:28.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.719+0000 7fc0baffd640 1 -- 172.21.15.2:0/2378091077 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fc0d4012780 con 0x55a8a95f5a90 2024-09-19T06:16:28.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.719+0000 7fc0e4297740 1 -- 172.21.15.2:0/2378091077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0cc005040 con 0x55a8a95f5a90 2024-09-19T06:16:28.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.719+0000 7fc0baffd640 1 -- 172.21.15.2:0/2378091077 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc0d4012980 con 0x55a8a95f5a90 2024-09-19T06:16:28.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.719+0000 7fc0e4297740 10 client.15678 fetch_fsmap learned FSMap version 26 2024-09-19T06:16:28.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.719+0000 7fc0e4297740 1 -- 172.21.15.2:0/2378091077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a8a9604110 con 0x55a8a95f5a90 2024-09-19T06:16:28.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.720+0000 7fc0baffd640 1 -- 172.21.15.2:0/2378091077 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc0cc005040 con 0x55a8a95f5a90 2024-09-19T06:16:28.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.720+0000 7fc0baffd640 1 -- 172.21.15.2:0/2378091077 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fc0d401c430 con 0x55a8a95f5a90 2024-09-19T06:16:28.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.720+0000 7fc0e4297740 10 client.15678 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:16:28.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.720+0000 7fc0e4297740 10 client.15678 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:28.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.720+0000 7fc0e4297740 20 client.15678 populate_metadata read hostname 'smithi002' 2024-09-19T06:16:28.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.720+0000 7fc0e4297740 1 --2- 172.21.15.2:0/2378091077 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a8a9605520 0x55a8a9607910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:28.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.720+0000 7fc0e4297740 4 client.15678 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:16:28.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.720+0000 7fc0e4297740 1 -- 172.21.15.2:0/2378091077 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a8a9559850 con 0x55a8a9605520 2024-09-19T06:16:28.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.720+0000 7fc0db7fe640 1 --2- 172.21.15.2:0/2378091077 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a8a9605520 0x55a8a9607910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:28.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.721+0000 7fc0db7fe640 1 --2- 172.21.15.2:0/2378091077 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a8a9605520 0x55a8a9607910 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=346b316f0148d027 server_cookie=15f5d7b4a6720fda in_seq=0 out_seq=0 2024-09-19T06:16:28.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.721+0000 7fc0baffd640 10 client.15678 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:28.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.721+0000 7fc0baffd640 1 -- 172.21.15.2:0/2378091077 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a8a9559850 con 0x55a8a9605520 2024-09-19T06:16:28.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.721+0000 7fc0baffd640 10 client.15678 handle_command_reply: tid=0 2024-09-19T06:16:28.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.721+0000 7fc0e4297740 1 client.15678 shutdown 2024-09-19T06:16:28.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.721+0000 7fc0e4297740 1 -- 172.21.15.2:0/2378091077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8a95f5a90 msgr2=0x55a8a95f2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:28.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.722+0000 7fc0e4297740 1 --2- 172.21.15.2:0/2378091077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8a95f5a90 0x55a8a95f2d10 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4011500 tx=0x7fc0d40119c0 comp rx=0 tx=0).stop 2024-09-19T06:16:28.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.722+0000 7fc0e4297740 1 -- 172.21.15.2:0/2378091077 shutdown_connections 2024-09-19T06:16:28.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.722+0000 7fc0e4297740 1 --2- 172.21.15.2:0/2378091077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8a95f5a90 0x55a8a95f2d10 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:28.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.722+0000 7fc0e4297740 1 --2- 172.21.15.2:0/2378091077 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a8a9605520 0x55a8a9607910 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:28.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.722+0000 7fc0e4297740 1 --2- 172.21.15.2:0/2378091077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8a95e6cc0 0x55a8a95f2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:28.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.722+0000 7fc0e4297740 1 --2- 172.21.15.2:0/2378091077 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a8a95e63a0 0x55a8a95f5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:28.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.722+0000 7fc0baffd640 0 client.15678 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:28.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.722+0000 7fc0e4297740 1 -- 172.21.15.2:0/2378091077 >> 172.21.15.2:0/2378091077 conn(0x55a8a95e2a30 msgr2=0x55a8a95e8790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:28.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.722+0000 7fc0e4297740 1 -- 172.21.15.2:0/2378091077 shutdown_connections 2024-09-19T06:16:28.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.722+0000 7fc0e4297740 1 -- 172.21.15.2:0/2378091077 wait complete. 2024-09-19T06:16:28.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.722+0000 7fc0e4297740 20 client.15678 trim_cache size 0 max 16384 2024-09-19T06:16:28.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:28 smithi090 ceph-mon[34497]: scrub summary: idle 2024-09-19T06:16:28.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.739+0000 7fc0e4297740 1 Processor -- start 2024-09-19T06:16:28.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.739+0000 7fc0e4297740 1 -- start start 2024-09-19T06:16:28.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.739+0000 7fc0e4297740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8a95e63a0 0x55a8a95f4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:28.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.739+0000 7fc0e4297740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a8a95e6cc0 0x55a8a9601900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:28.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.739+0000 7fc0e4297740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8a95f5a90 0x55a8a960d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:28.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.739+0000 7fc0e4297740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc0dc1ade60 con 0x55a8a95e63a0 2024-09-19T06:16:28.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.740+0000 7fc0e4297740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc0dc1ab730 con 0x55a8a95f5a90 2024-09-19T06:16:28.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.740+0000 7fc0e4297740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc0dc1a9580 con 0x55a8a95e6cc0 2024-09-19T06:16:28.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.740+0000 7fc0db7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8a95e63a0 0x55a8a95f4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:28.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.740+0000 7fc0db7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8a95e63a0 0x55a8a95f4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45428/0 (socket says 172.21.15.2:45428) 2024-09-19T06:16:28.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.740+0000 7fc0db7fe640 1 -- 172.21.15.2:0/2038131368 learned_addr learned my addr 172.21.15.2:0/2038131368 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:28.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.740+0000 7fc0dbfff640 1 --2- 172.21.15.2:0/2038131368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8a95f5a90 0x55a8a960d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:28.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.740+0000 7fc0d3fff640 1 --2- 172.21.15.2:0/2038131368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a8a95e6cc0 0x55a8a9601900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:28.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.740+0000 7fc0db7fe640 1 -- 172.21.15.2:0/2038131368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a8a95e6cc0 msgr2=0x55a8a9601900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:28.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.740+0000 7fc0db7fe640 1 --2- 172.21.15.2:0/2038131368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a8a95e6cc0 0x55a8a9601900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:28.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.740+0000 7fc0db7fe640 1 -- 172.21.15.2:0/2038131368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8a95f5a90 msgr2=0x55a8a960d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:28.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.740+0000 7fc0db7fe640 1 --2- 172.21.15.2:0/2038131368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8a95f5a90 0x55a8a960d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:28.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.740+0000 7fc0db7fe640 1 -- 172.21.15.2:0/2038131368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8a95f5770 con 0x55a8a95e63a0 2024-09-19T06:16:28.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.740+0000 7fc0db7fe640 1 --2- 172.21.15.2:0/2038131368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8a95e63a0 0x55a8a95f4a30 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc005920 tx=0x7fc0cc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ddce351ea2fff0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:28.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.740+0000 7fc0d17fa640 1 -- 172.21.15.2:0/2038131368 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc03f070 con 0x55a8a95e63a0 2024-09-19T06:16:28.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.740+0000 7fc0d17fa640 1 -- 172.21.15.2:0/2038131368 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc0cc0054f0 con 0x55a8a95e63a0 2024-09-19T06:16:28.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.740+0000 7fc0d17fa640 1 -- 172.21.15.2:0/2038131368 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc04c040 con 0x55a8a95e63a0 2024-09-19T06:16:28.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.741+0000 7fc0e4297740 1 -- 172.21.15.2:0/2038131368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8a95e63a0 msgr2=0x55a8a95f4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:28.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.741+0000 7fc0e4297740 1 --2- 172.21.15.2:0/2038131368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8a95e63a0 0x55a8a95f4a30 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc005920 tx=0x7fc0cc000bc0 comp rx=0 tx=0).stop 2024-09-19T06:16:28.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.741+0000 7fc0e4297740 1 -- 172.21.15.2:0/2038131368 shutdown_connections 2024-09-19T06:16:28.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.741+0000 7fc0e4297740 1 --2- 172.21.15.2:0/2038131368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8a95f5a90 0x55a8a960d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:28.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.741+0000 7fc0e4297740 1 --2- 172.21.15.2:0/2038131368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a8a95e6cc0 0x55a8a9601900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:28.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.741+0000 7fc0e4297740 1 --2- 172.21.15.2:0/2038131368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8a95e63a0 0x55a8a95f4a30 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:28.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.741+0000 7fc0e4297740 1 -- 172.21.15.2:0/2038131368 >> 172.21.15.2:0/2038131368 conn(0x55a8a95e2a30 msgr2=0x55a8a95e86f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:28.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.741+0000 7fc0e4297740 1 -- 172.21.15.2:0/2038131368 shutdown_connections 2024-09-19T06:16:28.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.741+0000 7fc0e4297740 1 -- 172.21.15.2:0/2038131368 wait complete. 2024-09-19T06:16:28.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.741+0000 7fc0e4297740 1 -- start start 2024-09-19T06:16:28.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.742+0000 7fc0e4297740 1 Processor -- start 2024-09-19T06:16:28.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.742+0000 7fc0e4297740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a8a95e63a0 0x55a8a95f9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:28.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.742+0000 7fc0e4297740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8a95e6cc0 0x55a8a95f9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:28.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.742+0000 7fc0e4297740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8a95f5a90 0x55a8a95fa480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:28.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.742+0000 7fc0e4297740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc0dc1a9bf0 con 0x55a8a95f5a90 2024-09-19T06:16:28.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.742+0000 7fc0e4297740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc0dc1ab060 con 0x55a8a95e6cc0 2024-09-19T06:16:28.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.742+0000 7fc0e4297740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc0dc1aa2c0 con 0x55a8a95e63a0 2024-09-19T06:16:28.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.742+0000 7fc0e4297740 10 client.0 _ll_register_callbacks cb 0x7fc0d4009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:28.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.742+0000 7fc0dbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8a95f5a90 0x55a8a95fa480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:28.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.742+0000 7fc0d3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8a95e6cc0 0x55a8a95f9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:28.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.742+0000 7fc0dbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8a95f5a90 0x55a8a95fa480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45440/0 (socket says 172.21.15.2:45440) 2024-09-19T06:16:28.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.742+0000 7fc0dbfff640 1 -- 172.21.15.2:0/2513789912 learned_addr learned my addr 172.21.15.2:0/2513789912 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:28.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.742+0000 7fc0db7fe640 1 --2- 172.21.15.2:0/2513789912 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a8a95e63a0 0x55a8a95f9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:28.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.742+0000 7fc0d3fff640 1 -- 172.21.15.2:0/2513789912 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a8a95e63a0 msgr2=0x55a8a95f9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:28.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.742+0000 7fc0d3fff640 1 --2- 172.21.15.2:0/2513789912 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a8a95e63a0 0x55a8a95f9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:28.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.742+0000 7fc0d3fff640 1 -- 172.21.15.2:0/2513789912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8a95f5a90 msgr2=0x55a8a95fa480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:28.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.742+0000 7fc0d3fff640 1 --2- 172.21.15.2:0/2513789912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8a95f5a90 0x55a8a95fa480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:28.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.743+0000 7fc0d3fff640 1 -- 172.21.15.2:0/2513789912 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8a966f400 con 0x55a8a95e6cc0 2024-09-19T06:16:28.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.743+0000 7fc0dbfff640 1 --2- 172.21.15.2:0/2513789912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8a95f5a90 0x55a8a95fa480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:28.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.743+0000 7fc0d3fff640 1 --2- 172.21.15.2:0/2513789912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8a95e6cc0 0x55a8a95f9f40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc0c40ccf30 tx=0x7fc0c409c320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae4db07ea3c8800c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:28.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.743+0000 7fc0baffd640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-09-19T06:16:28.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.743+0000 7fc0baffd640 1 -- 172.21.15.2:0/2513789912 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c40b3020 con 0x55a8a95e6cc0 2024-09-19T06:16:28.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.743+0000 7fc0baffd640 1 -- 172.21.15.2:0/2513789912 <== mon.2 v2:172.21.15.89:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fc0c4098130 con 0x55a8a95e6cc0 2024-09-19T06:16:28.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.743+0000 7fc0e4297740 1 -- 172.21.15.2:0/2513789912 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0cc0054f0 con 0x55a8a95e6cc0 2024-09-19T06:16:28.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.743+0000 7fc0baffd640 1 -- 172.21.15.2:0/2513789912 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc0c40a4730 con 0x55a8a95e6cc0 2024-09-19T06:16:28.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.743+0000 7fc0e4297740 10 client.25355 fetch_fsmap learned FSMap version 26 2024-09-19T06:16:28.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.743+0000 7fc0e4297740 1 -- 172.21.15.2:0/2513789912 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a8a96706d0 con 0x55a8a95e6cc0 2024-09-19T06:16:28.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.743+0000 7fc0baffd640 1 -- 172.21.15.2:0/2513789912 <== mon.2 v2:172.21.15.89:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc0cc0054f0 con 0x55a8a95e6cc0 2024-09-19T06:16:28.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.744+0000 7fc0baffd640 1 -- 172.21.15.2:0/2513789912 <== mon.2 v2:172.21.15.89:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fc0c40a42a0 con 0x55a8a95e6cc0 2024-09-19T06:16:28.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.744+0000 7fc0e4297740 10 client.25355 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:16:28.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.744+0000 7fc0e4297740 10 client.25355 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:28.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.744+0000 7fc0e4297740 20 client.25355 populate_metadata read hostname 'smithi002' 2024-09-19T06:16:28.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.744+0000 7fc0e4297740 1 --2- 172.21.15.2:0/2513789912 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a8a9670ed0 0x55a8a96732c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:28.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.744+0000 7fc0e4297740 4 client.25355 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:16:28.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.744+0000 7fc0e4297740 1 -- 172.21.15.2:0/2513789912 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a8a9553d60 con 0x55a8a9670ed0 2024-09-19T06:16:28.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.744+0000 7fc0db7fe640 1 --2- 172.21.15.2:0/2513789912 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a8a9670ed0 0x55a8a96732c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:28.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.744+0000 7fc0baffd640 10 client.25355 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:28.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.744+0000 7fc0db7fe640 1 --2- 172.21.15.2:0/2513789912 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a8a9670ed0 0x55a8a96732c0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53cdec3e996ba220 server_cookie=2d4c5955a9c944fa in_seq=0 out_seq=0 2024-09-19T06:16:28.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.745+0000 7fc0baffd640 1 -- 172.21.15.2:0/2513789912 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a8a9553d60 con 0x55a8a9670ed0 2024-09-19T06:16:28.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.745+0000 7fc0baffd640 10 client.25355 handle_command_reply: tid=0 2024-09-19T06:16:28.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.745+0000 7fc0e4297740 1 client.25355 shutdown 2024-09-19T06:16:28.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.745+0000 7fc0e4297740 1 -- 172.21.15.2:0/2513789912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8a95e6cc0 msgr2=0x55a8a95f9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:28.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.745+0000 7fc0e4297740 1 --2- 172.21.15.2:0/2513789912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8a95e6cc0 0x55a8a95f9f40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc0c40ccf30 tx=0x7fc0c409c320 comp rx=0 tx=0).stop 2024-09-19T06:16:28.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.745+0000 7fc0e4297740 1 -- 172.21.15.2:0/2513789912 shutdown_connections 2024-09-19T06:16:28.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.745+0000 7fc0e4297740 1 --2- 172.21.15.2:0/2513789912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a8a95f5a90 0x55a8a95fa480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:28.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.745+0000 7fc0e4297740 1 --2- 172.21.15.2:0/2513789912 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a8a9670ed0 0x55a8a96732c0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:28.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.745+0000 7fc0e4297740 1 --2- 172.21.15.2:0/2513789912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a8a95e6cc0 0x55a8a95f9f40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:28.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.745+0000 7fc0e4297740 1 --2- 172.21.15.2:0/2513789912 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a8a95e63a0 0x55a8a95f9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:28.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.745+0000 7fc0baffd640 0 client.25355 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:28.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.745+0000 7fc0e4297740 1 -- 172.21.15.2:0/2513789912 >> 172.21.15.2:0/2513789912 conn(0x55a8a95e2a30 msgr2=0x55a8a95e7ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:28.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.745+0000 7fc0e4297740 1 -- 172.21.15.2:0/2513789912 shutdown_connections 2024-09-19T06:16:28.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.745+0000 7fc0e4297740 1 -- 172.21.15.2:0/2513789912 wait complete. 2024-09-19T06:16:28.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.745+0000 7fc0e4297740 20 client.25355 trim_cache size 0 max 16384 2024-09-19T06:16:28.755 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:16:28.755 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T06:16:28.755 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T06:16:28.755 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:16:28.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.746+0000 7fc0e1ebe640 1 -- 172.21.15.2:0/276410347 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc0c80a3430 msgr2=0x7fc0c80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:28.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.746+0000 7fc0e1ebe640 1 --2- 172.21.15.2:0/276410347 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc0c80a3430 0x7fc0c80a58f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc031440 tx=0x7fc0cc0095f0 comp rx=0 tx=0).stop 2024-09-19T06:16:28.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.746+0000 7fc0e1ebe640 1 -- 172.21.15.2:0/276410347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0dc102790 msgr2=0x7fc0dc1988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:28.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.746+0000 7fc0e1ebe640 1 --2- 172.21.15.2:0/276410347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0dc102790 0x7fc0dc1988b0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc0c400d950 tx=0x7fc0c400de10 comp rx=0 tx=0).stop 2024-09-19T06:16:28.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.746+0000 7fc0e1ebe640 1 -- 172.21.15.2:0/276410347 shutdown_connections 2024-09-19T06:16:28.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.746+0000 7fc0e1ebe640 1 --2- 172.21.15.2:0/276410347 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc0c80a3430 0x7fc0c80a58f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:28.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.746+0000 7fc0e1ebe640 1 --2- 172.21.15.2:0/276410347 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0dc106f10 0x7fc0dc19cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:28.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.746+0000 7fc0e1ebe640 1 --2- 172.21.15.2:0/276410347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0dc102790 0x7fc0dc1988b0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:28.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.746+0000 7fc0e1ebe640 1 --2- 172.21.15.2:0/276410347 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0dc101de0 0x7fc0dc198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:28.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.746+0000 7fc0e1ebe640 1 -- 172.21.15.2:0/276410347 >> 172.21.15.2:0/276410347 conn(0x7fc0dc0fd8c0 msgr2=0x7fc0dc0fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:28.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.746+0000 7fc0e1ebe640 1 -- 172.21.15.2:0/276410347 shutdown_connections 2024-09-19T06:16:28.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:28.746+0000 7fc0e1ebe640 1 -- 172.21.15.2:0/276410347 wait complete. 2024-09-19T06:16:28.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:28 smithi089 ceph-mon[34160]: scrub summary: idle 2024-09-19T06:16:29.318 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:16:29.318 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:16:29.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:29 smithi002 ceph-mon[30982]: pgmap v53: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 61 MiB/s wr, 23 op/s 2024-09-19T06:16:29.573 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:16:29.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:29 smithi090 ceph-mon[34497]: pgmap v53: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 61 MiB/s wr, 23 op/s 2024-09-19T06:16:29.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:29 smithi089 ceph-mon[34160]: pgmap v53: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 61 MiB/s wr, 23 op/s 2024-09-19T06:16:30.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.015+0000 7f20f5f72640 1 -- 172.21.15.2:0/2400897015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20f0101de0 msgr2=0x7f20f01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:30.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.015+0000 7f20f5f72640 1 --2- 172.21.15.2:0/2400897015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20f0101de0 0x7f20f01021c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f20e0009900 tx=0x7f20e002a410 comp rx=0 tx=0).stop 2024-09-19T06:16:30.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.016+0000 7f20f5f72640 1 -- 172.21.15.2:0/2400897015 shutdown_connections 2024-09-19T06:16:30.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.016+0000 7f20f5f72640 1 --2- 172.21.15.2:0/2400897015 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20f0106f10 0x7f20f010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:30.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.016+0000 7f20f5f72640 1 --2- 172.21.15.2:0/2400897015 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20f0102790 0x7f20f01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:30.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.016+0000 7f20f5f72640 1 --2- 172.21.15.2:0/2400897015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20f0101de0 0x7f20f01021c0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:30.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.016+0000 7f20f5f72640 1 -- 172.21.15.2:0/2400897015 >> 172.21.15.2:0/2400897015 conn(0x7f20f00fd8c0 msgr2=0x7f20f00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:30.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.016+0000 7f20f5f72640 1 -- 172.21.15.2:0/2400897015 shutdown_connections 2024-09-19T06:16:30.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.016+0000 7f20f5f72640 1 -- 172.21.15.2:0/2400897015 wait complete. 2024-09-19T06:16:30.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.016+0000 7f20f5f72640 1 Processor -- start 2024-09-19T06:16:30.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.016+0000 7f20f5f72640 1 -- start start 2024-09-19T06:16:30.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.017+0000 7f20f5f72640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20f0101de0 0x7f20f0198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:30.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.017+0000 7f20f5f72640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20f0102790 0x7f20f0198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:30.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.017+0000 7f20f5f72640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20f0106f10 0x7f20f019cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:30.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.017+0000 7f20f5f72640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f20f0111ec0 con 0x7f20f0106f10 2024-09-19T06:16:30.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.017+0000 7f20f5f72640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f20f0111d40 con 0x7f20f0102790 2024-09-19T06:16:30.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.017+0000 7f20f5f72640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f20f0112040 con 0x7f20f0101de0 2024-09-19T06:16:30.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.017+0000 7f20effff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20f0106f10 0x7f20f019cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:30.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.017+0000 7f20effff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20f0106f10 0x7f20f019cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45454/0 (socket says 172.21.15.2:45454) 2024-09-19T06:16:30.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.017+0000 7f20effff640 1 -- 172.21.15.2:0/2142531578 learned_addr learned my addr 172.21.15.2:0/2142531578 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:30.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.017+0000 7f20ef7fe640 1 --2- 172.21.15.2:0/2142531578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20f0101de0 0x7f20f0198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:30.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.017+0000 7f20e6ffd640 1 --2- 172.21.15.2:0/2142531578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20f0102790 0x7f20f0198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:30.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.017+0000 7f20effff640 1 -- 172.21.15.2:0/2142531578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20f0101de0 msgr2=0x7f20f0198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:30.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.017+0000 7f20effff640 1 --2- 172.21.15.2:0/2142531578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20f0101de0 0x7f20f0198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:30.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.017+0000 7f20effff640 1 -- 172.21.15.2:0/2142531578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20f0102790 msgr2=0x7f20f0198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:30.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.017+0000 7f20effff640 1 --2- 172.21.15.2:0/2142531578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20f0102790 0x7f20f0198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:30.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.017+0000 7f20effff640 1 -- 172.21.15.2:0/2142531578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f019d4d0 con 0x7f20f0106f10 2024-09-19T06:16:30.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.017+0000 7f20e6ffd640 1 --2- 172.21.15.2:0/2142531578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20f0102790 0x7f20f0198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:16:30.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.017+0000 7f20ef7fe640 1 --2- 172.21.15.2:0/2142531578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20f0101de0 0x7f20f0198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:16:30.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.017+0000 7f20effff640 1 --2- 172.21.15.2:0/2142531578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20f0106f10 0x7f20f019cdf0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f20e800b970 tx=0x7f20e800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:30.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.017+0000 7f20ed7fa640 1 -- 172.21.15.2:0/2142531578 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e8019070 con 0x7f20f0106f10 2024-09-19T06:16:30.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.018+0000 7f20ed7fa640 1 -- 172.21.15.2:0/2142531578 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f20e8014440 con 0x7f20f0106f10 2024-09-19T06:16:30.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.018+0000 7f20f5f72640 1 -- 172.21.15.2:0/2142531578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20f019d7c0 con 0x7f20f0106f10 2024-09-19T06:16:30.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.018+0000 7f20ed7fa640 1 -- 172.21.15.2:0/2142531578 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e80075d0 con 0x7f20f0106f10 2024-09-19T06:16:30.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.018+0000 7f20f5f72640 1 -- 172.21.15.2:0/2142531578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20f01a50a0 con 0x7f20f0106f10 2024-09-19T06:16:30.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.019+0000 7f20f5f72640 1 -- 172.21.15.2:0/2142531578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20f0102240 con 0x7f20f0106f10 2024-09-19T06:16:30.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.020+0000 7f20ed7fa640 1 -- 172.21.15.2:0/2142531578 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f20e801c070 con 0x7f20f0106f10 2024-09-19T06:16:30.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.021+0000 7f20ed7fa640 1 --2- 172.21.15.2:0/2142531578 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f20dc0a3430 0x7f20dc0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:30.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.021+0000 7f20ef7fe640 1 --2- 172.21.15.2:0/2142531578 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f20dc0a3430 0x7f20dc0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:30.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.021+0000 7f20ed7fa640 1 -- 172.21.15.2:0/2142531578 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f20e80cf1d0 con 0x7f20f0106f10 2024-09-19T06:16:30.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.021+0000 7f20ef7fe640 1 --2- 172.21.15.2:0/2142531578 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f20dc0a3430 0x7f20dc0a58f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f20e0031440 tx=0x7f20e00095f0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:30.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.025+0000 7f20ed7fa640 1 -- 172.21.15.2:0/2142531578 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f20e809bcf0 con 0x7f20f0106f10 2024-09-19T06:16:30.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.236+0000 7f20f5f72640 1 -- 172.21.15.2:0/2142531578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f20f002d7c0 con 0x7f20f0106f10 2024-09-19T06:16:30.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.237+0000 7f20ed7fa640 1 -- 172.21.15.2:0/2142531578 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11882 (secure 0 0 0) 0x7f20e809b5f0 con 0x7f20f0106f10 2024-09-19T06:16:30.239 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:16:30.239 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-09-19T06:14:49:104280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:14:48.191083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24470,24472,24497]},"id":1}]} 2024-09-19T06:16:30.239 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-09-19T06:16:30.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.239+0000 7f20f5f72640 1 -- 172.21.15.2:0/2142531578 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f20dc0a3430 msgr2=0x7f20dc0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:30.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.239+0000 7f20f5f72640 1 --2- 172.21.15.2:0/2142531578 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f20dc0a3430 0x7f20dc0a58f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f20e0031440 tx=0x7f20e00095f0 comp rx=0 tx=0).stop 2024-09-19T06:16:30.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.239+0000 7f20f5f72640 1 -- 172.21.15.2:0/2142531578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20f0106f10 msgr2=0x7f20f019cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:30.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.239+0000 7f20f5f72640 1 --2- 172.21.15.2:0/2142531578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20f0106f10 0x7f20f019cdf0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f20e800b970 tx=0x7f20e800be30 comp rx=0 tx=0).stop 2024-09-19T06:16:30.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.239+0000 7f20f5f72640 1 -- 172.21.15.2:0/2142531578 shutdown_connections 2024-09-19T06:16:30.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.239+0000 7f20f5f72640 1 --2- 172.21.15.2:0/2142531578 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f20dc0a3430 0x7f20dc0a58f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:30.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.239+0000 7f20f5f72640 1 --2- 172.21.15.2:0/2142531578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20f0106f10 0x7f20f019cdf0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:30.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.239+0000 7f20f5f72640 1 --2- 172.21.15.2:0/2142531578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20f0102790 0x7f20f0198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:30.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.239+0000 7f20f5f72640 1 --2- 172.21.15.2:0/2142531578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20f0101de0 0x7f20f0198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:30.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.239+0000 7f20f5f72640 1 -- 172.21.15.2:0/2142531578 >> 172.21.15.2:0/2142531578 conn(0x7f20f00fd8c0 msgr2=0x7f20f00fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:30.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.239+0000 7f20f5f72640 1 -- 172.21.15.2:0/2142531578 shutdown_connections 2024-09-19T06:16:30.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:30.239+0000 7f20f5f72640 1 -- 172.21.15.2:0/2142531578 wait complete. 2024-09-19T06:16:30.455 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-19T06:16:30.455 INFO:tasks.workunit.client.0.smithi002.stdout: Children see throughput for 1 readers = 7824789.00 kB/sec 2024-09-19T06:16:30.456 INFO:tasks.workunit.client.0.smithi002.stdout: Parent sees throughput for 1 readers = 7814473.19 kB/sec 2024-09-19T06:16:30.456 INFO:tasks.workunit.client.0.smithi002.stdout: Min throughput per process = 7824789.00 kB/sec 2024-09-19T06:16:30.456 INFO:tasks.workunit.client.0.smithi002.stdout: Max throughput per process = 7824789.00 kB/sec 2024-09-19T06:16:30.456 INFO:tasks.workunit.client.0.smithi002.stdout: Avg throughput per process = 7824789.00 kB/sec 2024-09-19T06:16:30.456 INFO:tasks.workunit.client.0.smithi002.stdout: Min xfer = 1048576.00 kB 2024-09-19T06:16:30.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:30 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/2142531578' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:16:30.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:30 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/2142531578' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:16:30.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:30 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/2142531578' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:16:31.227 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:16:31.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:31 smithi002 ceph-mon[30982]: pgmap v54: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 85 MiB/s wr, 33 op/s 2024-09-19T06:16:31.491 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:16:31.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:31 smithi090 ceph-mon[34497]: pgmap v54: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 85 MiB/s wr, 33 op/s 2024-09-19T06:16:31.772 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.768+0000 7f639a453640 1 -- 172.21.15.2:0/2472300620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6394102c80 msgr2=0x7f6394103060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:31.772 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.768+0000 7f639a453640 1 --2- 172.21.15.2:0/2472300620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6394102c80 0x7f6394103060 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f6384009900 tx=0x7f638402a480 comp rx=0 tx=0).stop 2024-09-19T06:16:31.772 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.768+0000 7f639a453640 1 -- 172.21.15.2:0/2472300620 shutdown_connections 2024-09-19T06:16:31.772 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.768+0000 7f639a453640 1 --2- 172.21.15.2:0/2472300620 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f639410c0a0 0x7f639410e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.772 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.768+0000 7f639a453640 1 --2- 172.21.15.2:0/2472300620 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63941035a0 0x7f639410ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.772 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.768+0000 7f639a453640 1 --2- 172.21.15.2:0/2472300620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6394102c80 0x7f6394103060 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.772 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.768+0000 7f639a453640 1 -- 172.21.15.2:0/2472300620 >> 172.21.15.2:0/2472300620 conn(0x7f63940779a0 msgr2=0x7f63940fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:31.772 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.768+0000 7f639a453640 1 -- 172.21.15.2:0/2472300620 shutdown_connections 2024-09-19T06:16:31.772 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.768+0000 7f639a453640 1 -- 172.21.15.2:0/2472300620 wait complete. 2024-09-19T06:16:31.772 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.769+0000 7f639a453640 1 Processor -- start 2024-09-19T06:16:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.769+0000 7f639a453640 1 -- start start 2024-09-19T06:16:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.769+0000 7f639a453640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6394102c80 0x7f639419a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.769+0000 7f639a453640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63941035a0 0x7f639419aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.769+0000 7f639a453640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f639410c0a0 0x7f639419ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.769+0000 7f639a453640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6394111d50 con 0x7f6394102c80 2024-09-19T06:16:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.769+0000 7f639a453640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6394111bd0 con 0x7f63941035a0 2024-09-19T06:16:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.769+0000 7f639a453640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6394111ed0 con 0x7f639410c0a0 2024-09-19T06:16:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.769+0000 7f6393fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6394102c80 0x7f639419a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.769+0000 7f6393fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6394102c80 0x7f639419a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45480/0 (socket says 172.21.15.2:45480) 2024-09-19T06:16:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.769+0000 7f6393fff640 1 -- 172.21.15.2:0/3241312077 learned_addr learned my addr 172.21.15.2:0/3241312077 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.769+0000 7f63989f0640 1 --2- 172.21.15.2:0/3241312077 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f639410c0a0 0x7f639419ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.769+0000 7f638bfff640 1 --2- 172.21.15.2:0/3241312077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63941035a0 0x7f639419aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:31.774 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.770+0000 7f6393fff640 1 -- 172.21.15.2:0/3241312077 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f639410c0a0 msgr2=0x7f639419ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:31.774 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.770+0000 7f6393fff640 1 --2- 172.21.15.2:0/3241312077 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f639410c0a0 0x7f639419ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.774 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.770+0000 7f6393fff640 1 -- 172.21.15.2:0/3241312077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63941035a0 msgr2=0x7f639419aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:31.774 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.770+0000 7f6393fff640 1 --2- 172.21.15.2:0/3241312077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63941035a0 0x7f639419aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.774 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.770+0000 7f6393fff640 1 -- 172.21.15.2:0/3241312077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f639419f4c0 con 0x7f6394102c80 2024-09-19T06:16:31.774 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.770+0000 7f6393fff640 1 --2- 172.21.15.2:0/3241312077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6394102c80 0x7f639419a4d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f6384005940 tx=0x7f63840042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:31.774 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.770+0000 7f6391ffb640 1 -- 172.21.15.2:0/3241312077 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638403f030 con 0x7f6394102c80 2024-09-19T06:16:31.774 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.770+0000 7f6391ffb640 1 -- 172.21.15.2:0/3241312077 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6384003cb0 con 0x7f6394102c80 2024-09-19T06:16:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.770+0000 7f639a453640 1 -- 172.21.15.2:0/3241312077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f639419f750 con 0x7f6394102c80 2024-09-19T06:16:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.770+0000 7f6391ffb640 1 -- 172.21.15.2:0/3241312077 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6384035070 con 0x7f6394102c80 2024-09-19T06:16:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.770+0000 7f639a453640 1 -- 172.21.15.2:0/3241312077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63941a7040 con 0x7f6394102c80 2024-09-19T06:16:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.772+0000 7f6391ffb640 1 -- 172.21.15.2:0/3241312077 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f6384042030 con 0x7f6394102c80 2024-09-19T06:16:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.773+0000 7f6391ffb640 1 --2- 172.21.15.2:0/3241312077 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f63800a33b0 0x7f63800a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.773+0000 7f638bfff640 1 --2- 172.21.15.2:0/3241312077 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f63800a33b0 0x7f63800a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.773+0000 7f639d1f2740 1 Processor -- start 2024-09-19T06:16:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.773+0000 7f6391ffb640 1 -- 172.21.15.2:0/3241312077 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f63840f04c0 con 0x7f6394102c80 2024-09-19T06:16:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.773+0000 7f639d1f2740 1 -- start start 2024-09-19T06:16:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.774+0000 7f639d1f2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aecee57af0 0x55aecee57ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.774+0000 7f639d1f2740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aecee58410 0x55aecee62770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:31.778 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.774+0000 7f639d1f2740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55aecee62cb0 0x55aecee650a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:31.778 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.774+0000 7f639d1f2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55aecedbc2f0 con 0x55aecee57af0 2024-09-19T06:16:31.778 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.774+0000 7f639d1f2740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55aeced64270 con 0x55aecee62cb0 2024-09-19T06:16:31.778 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.774+0000 7f639d1f2740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55aecedb82b0 con 0x55aecee58410 2024-09-19T06:16:31.778 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.774+0000 7f638bfff640 1 --2- 172.21.15.2:0/3241312077 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f63800a33b0 0x7f63800a5870 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6394102860 tx=0x7f637c00b390 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:31.778 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.774+0000 7f6393fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aecee57af0 0x55aecee57ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:31.778 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.774+0000 7f6393fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aecee57af0 0x55aecee57ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45482/0 (socket says 172.21.15.2:45482) 2024-09-19T06:16:31.778 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.774+0000 7f6393fff640 1 -- 172.21.15.2:0/93807118 learned_addr learned my addr 172.21.15.2:0/93807118 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:31.778 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.774+0000 7f63989f0640 1 --2- 172.21.15.2:0/93807118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55aecee62cb0 0x55aecee650a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:31.778 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.774+0000 7f638bfff640 1 --2- 172.21.15.2:0/93807118 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aecee58410 0x55aecee62770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:31.778 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.774+0000 7f6393fff640 1 -- 172.21.15.2:0/93807118 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aecee58410 msgr2=0x55aecee62770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:31.778 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.774+0000 7f6393fff640 1 --2- 172.21.15.2:0/93807118 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aecee58410 0x55aecee62770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.779 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.774+0000 7f6393fff640 1 -- 172.21.15.2:0/93807118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55aecee62cb0 msgr2=0x55aecee650a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:31.779 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.774+0000 7f6393fff640 1 --2- 172.21.15.2:0/93807118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55aecee62cb0 0x55aecee650a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.779 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.774+0000 7f6393fff640 1 -- 172.21.15.2:0/93807118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aeced63340 con 0x55aecee57af0 2024-09-19T06:16:31.779 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.774+0000 7f63989f0640 1 --2- 172.21.15.2:0/93807118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55aecee62cb0 0x55aecee650a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:16:31.779 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.774+0000 7f638bfff640 1 --2- 172.21.15.2:0/93807118 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aecee58410 0x55aecee62770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:16:31.779 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.774+0000 7f6393fff640 1 --2- 172.21.15.2:0/93807118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aecee57af0 0x55aecee57ed0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f63840b8ce0 tx=0x7f6384005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57c7bf5196a562b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:31.783 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.774+0000 7f638a7fc640 1 -- 172.21.15.2:0/93807118 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6384049040 con 0x55aecee57af0 2024-09-19T06:16:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.774+0000 7f638a7fc640 1 -- 172.21.15.2:0/93807118 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f63840c0b80 con 0x55aecee57af0 2024-09-19T06:16:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.774+0000 7f638a7fc640 1 -- 172.21.15.2:0/93807118 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63840bcae0 con 0x55aecee57af0 2024-09-19T06:16:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.775+0000 7f639d1f2740 1 -- 172.21.15.2:0/93807118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aecee57af0 msgr2=0x55aecee57ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.775+0000 7f639d1f2740 1 --2- 172.21.15.2:0/93807118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aecee57af0 0x55aecee57ed0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f63840b8ce0 tx=0x7f6384005c00 comp rx=0 tx=0).stop 2024-09-19T06:16:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.775+0000 7f639d1f2740 1 -- 172.21.15.2:0/93807118 shutdown_connections 2024-09-19T06:16:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.775+0000 7f639d1f2740 1 --2- 172.21.15.2:0/93807118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55aecee62cb0 0x55aecee650a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.775+0000 7f639d1f2740 1 --2- 172.21.15.2:0/93807118 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aecee58410 0x55aecee62770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.775+0000 7f639d1f2740 1 --2- 172.21.15.2:0/93807118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aecee57af0 0x55aecee57ed0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.775+0000 7f639d1f2740 1 -- 172.21.15.2:0/93807118 >> 172.21.15.2:0/93807118 conn(0x55aecee54060 msgr2=0x55aecee54440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.775+0000 7f639d1f2740 1 -- 172.21.15.2:0/93807118 shutdown_connections 2024-09-19T06:16:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.775+0000 7f639d1f2740 1 -- 172.21.15.2:0/93807118 wait complete. 2024-09-19T06:16:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.775+0000 7f639d1f2740 1 -- start start 2024-09-19T06:16:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.776+0000 7f639d1f2740 1 Processor -- start 2024-09-19T06:16:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.776+0000 7f639d1f2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aecee57af0 0x55aecee5fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.776+0000 7f639d1f2740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aecee58410 0x55aecee60110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.776+0000 7f639d1f2740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55aecee62cb0 0x55aecee60650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.776+0000 7f639d1f2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55aecee65640 con 0x55aecee57af0 2024-09-19T06:16:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.776+0000 7f639d1f2740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55aeced45290 con 0x55aecee62cb0 2024-09-19T06:16:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.776+0000 7f639d1f2740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55aecee657c0 con 0x55aecee58410 2024-09-19T06:16:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.776+0000 7f639d1f2740 10 client.0 _ll_register_callbacks cb 0x55aeced76140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.776+0000 7f6393fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aecee57af0 0x55aecee5fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.776+0000 7f6393fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aecee57af0 0x55aecee5fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45494/0 (socket says 172.21.15.2:45494) 2024-09-19T06:16:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.776+0000 7f6393fff640 1 -- 172.21.15.2:0/3956847908 learned_addr learned my addr 172.21.15.2:0/3956847908 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.776+0000 7f63989f0640 1 --2- 172.21.15.2:0/3956847908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55aecee62cb0 0x55aecee60650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.776+0000 7f6393fff640 1 -- 172.21.15.2:0/3956847908 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aecee58410 msgr2=0x55aecee60110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:31.786 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.776+0000 7f638bfff640 1 --2- 172.21.15.2:0/3956847908 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aecee58410 0x55aecee60110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:31.786 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.776+0000 7f6393fff640 1 --2- 172.21.15.2:0/3956847908 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aecee58410 0x55aecee60110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.786 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.776+0000 7f6393fff640 1 -- 172.21.15.2:0/3956847908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55aecee62cb0 msgr2=0x55aecee60650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:31.786 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.776+0000 7f6393fff640 1 --2- 172.21.15.2:0/3956847908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55aecee62cb0 0x55aecee60650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.786 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.777+0000 7f6393fff640 1 -- 172.21.15.2:0/3956847908 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aeceacf210 con 0x55aecee57af0 2024-09-19T06:16:31.786 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.777+0000 7f63989f0640 1 --2- 172.21.15.2:0/3956847908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55aecee62cb0 0x55aecee60650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:16:31.786 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.777+0000 7f638bfff640 1 --2- 172.21.15.2:0/3956847908 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aecee58410 0x55aecee60110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:16:31.786 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.777+0000 7f6393fff640 1 --2- 172.21.15.2:0/3956847908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aecee57af0 0x55aecee5fbd0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f63840c4f10 tx=0x7f638403b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e27f979ac38f272 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:31.786 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.777+0000 7f63737fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:16:31.786 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.777+0000 7f63737fe640 1 -- 172.21.15.2:0/3956847908 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6384049030 con 0x55aecee57af0 2024-09-19T06:16:31.786 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.777+0000 7f63737fe640 1 -- 172.21.15.2:0/3956847908 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f63840bab80 con 0x55aecee57af0 2024-09-19T06:16:31.786 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.777+0000 7f639d1f2740 1 -- 172.21.15.2:0/3956847908 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63840c0b80 con 0x55aecee57af0 2024-09-19T06:16:31.786 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.777+0000 7f63737fe640 1 -- 172.21.15.2:0/3956847908 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f63840bcae0 con 0x55aecee57af0 2024-09-19T06:16:31.787 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.777+0000 7f639d1f2740 10 client.15702 fetch_fsmap learned FSMap version 26 2024-09-19T06:16:31.787 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.777+0000 7f639d1f2740 1 -- 172.21.15.2:0/3956847908 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55aeceb9b620 con 0x55aecee57af0 2024-09-19T06:16:31.787 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.777+0000 7f63737fe640 1 -- 172.21.15.2:0/3956847908 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f63840c0b80 con 0x55aecee57af0 2024-09-19T06:16:31.787 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.777+0000 7f63737fe640 1 -- 172.21.15.2:0/3956847908 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f63840a5b80 con 0x55aecee57af0 2024-09-19T06:16:31.787 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.777+0000 7f639d1f2740 10 client.15702 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:16:31.787 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.777+0000 7f639d1f2740 10 client.15702 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:31.787 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.777+0000 7f639d1f2740 20 client.15702 populate_metadata read hostname 'smithi002' 2024-09-19T06:16:31.787 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.777+0000 7f639d1f2740 1 --2- 172.21.15.2:0/3956847908 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55aecee72740 0x55aecee74b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:31.787 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.777+0000 7f639d1f2740 4 client.15702 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:16:31.787 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.777+0000 7f639d1f2740 1 -- 172.21.15.2:0/3956847908 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aecedc9a20 con 0x55aecee72740 2024-09-19T06:16:31.787 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.778+0000 7f638bfff640 1 --2- 172.21.15.2:0/3956847908 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55aecee72740 0x55aecee74b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:31.787 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.778+0000 7f638bfff640 1 --2- 172.21.15.2:0/3956847908 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55aecee72740 0x55aecee74b30 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5ceece4710c2f3b server_cookie=60cd9ba3b215534d in_seq=0 out_seq=0 2024-09-19T06:16:31.788 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.778+0000 7f63737fe640 10 client.15702 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:31.788 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.779+0000 7f63737fe640 1 -- 172.21.15.2:0/3956847908 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55aecedc9a20 con 0x55aecee72740 2024-09-19T06:16:31.788 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.779+0000 7f63737fe640 10 client.15702 handle_command_reply: tid=0 2024-09-19T06:16:31.788 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.779+0000 7f639d1f2740 1 client.15702 shutdown 2024-09-19T06:16:31.788 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.779+0000 7f639d1f2740 1 -- 172.21.15.2:0/3956847908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aecee57af0 msgr2=0x55aecee5fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:31.788 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.779+0000 7f639d1f2740 1 --2- 172.21.15.2:0/3956847908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aecee57af0 0x55aecee5fbd0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f63840c4f10 tx=0x7f638403b670 comp rx=0 tx=0).stop 2024-09-19T06:16:31.788 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.779+0000 7f639d1f2740 1 -- 172.21.15.2:0/3956847908 shutdown_connections 2024-09-19T06:16:31.788 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.779+0000 7f639d1f2740 1 --2- 172.21.15.2:0/3956847908 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55aecee72740 0x55aecee74b30 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.788 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.779+0000 7f639d1f2740 1 --2- 172.21.15.2:0/3956847908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55aecee62cb0 0x55aecee60650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.788 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.779+0000 7f639d1f2740 1 --2- 172.21.15.2:0/3956847908 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aecee58410 0x55aecee60110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.788 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.779+0000 7f639d1f2740 1 --2- 172.21.15.2:0/3956847908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aecee57af0 0x55aecee5fbd0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.788 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.779+0000 7f63737fe640 0 client.15702 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.779+0000 7f639d1f2740 1 -- 172.21.15.2:0/3956847908 >> 172.21.15.2:0/3956847908 conn(0x55aecee54060 msgr2=0x55aecee59d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.779+0000 7f639d1f2740 1 -- 172.21.15.2:0/3956847908 shutdown_connections 2024-09-19T06:16:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.779+0000 7f639d1f2740 1 -- 172.21.15.2:0/3956847908 wait complete. 2024-09-19T06:16:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.779+0000 7f639d1f2740 20 client.15702 trim_cache size 0 max 16384 2024-09-19T06:16:31.791 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:31 smithi089 ceph-mon[34160]: pgmap v54: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 85 MiB/s wr, 33 op/s 2024-09-19T06:16:31.797 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.794+0000 7f639d1f2740 1 Processor -- start 2024-09-19T06:16:31.797 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.794+0000 7f639d1f2740 1 -- start start 2024-09-19T06:16:31.797 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.794+0000 7f639d1f2740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55aecee57af0 0x55aecee60480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:31.797 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.794+0000 7f639d1f2740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aecee58410 0x55aecee7a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:31.797 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.795+0000 7f639d1f2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aecee62cb0 0x55aecee7a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:31.797 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.795+0000 7f639d1f2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f63941b21b0 con 0x55aecee62cb0 2024-09-19T06:16:31.797 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.795+0000 7f639d1f2740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f63941afa80 con 0x55aecee57af0 2024-09-19T06:16:31.798 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.795+0000 7f639d1f2740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f63941ad8d0 con 0x55aecee58410 2024-09-19T06:16:31.798 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.795+0000 7f6393fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55aecee57af0 0x55aecee60480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:31.798 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.795+0000 7f63989f0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aecee62cb0 0x55aecee7a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:31.798 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.795+0000 7f6393fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55aecee57af0 0x55aecee60480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:39700/0 (socket says 172.21.15.2:39700) 2024-09-19T06:16:31.798 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.795+0000 7f638bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aecee58410 0x55aecee7a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:31.798 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.795+0000 7f6393fff640 1 -- 172.21.15.2:0/288336678 learned_addr learned my addr 172.21.15.2:0/288336678 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:31.798 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.795+0000 7f6393fff640 1 -- 172.21.15.2:0/288336678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aecee58410 msgr2=0x55aecee7a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:31.798 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.795+0000 7f6393fff640 1 --2- 172.21.15.2:0/288336678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aecee58410 0x55aecee7a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.798 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.795+0000 7f6393fff640 1 -- 172.21.15.2:0/288336678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aecee62cb0 msgr2=0x55aecee7a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:31.798 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.795+0000 7f6393fff640 1 --2- 172.21.15.2:0/288336678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aecee62cb0 0x55aecee7a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.798 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.795+0000 7f6393fff640 1 -- 172.21.15.2:0/288336678 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aecee53d30 con 0x55aecee57af0 2024-09-19T06:16:31.799 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.795+0000 7f63989f0640 1 --2- 172.21.15.2:0/288336678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aecee62cb0 0x55aecee7a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:31.799 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.795+0000 7f6393fff640 1 --2- 172.21.15.2:0/288336678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55aecee57af0 0x55aecee60480 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f63840bc810 tx=0x7f63840db2b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17344a41771d54e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:31.799 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.796+0000 7f6389ffb640 1 -- 172.21.15.2:0/288336678 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6384049070 con 0x55aecee57af0 2024-09-19T06:16:31.799 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.796+0000 7f6389ffb640 1 -- 172.21.15.2:0/288336678 <== mon.2 v2:172.21.15.89:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f63840ee030 con 0x55aecee57af0 2024-09-19T06:16:31.799 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.796+0000 7f6389ffb640 1 -- 172.21.15.2:0/288336678 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63840bcc80 con 0x55aecee57af0 2024-09-19T06:16:31.802 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.796+0000 7f639d1f2740 1 -- 172.21.15.2:0/288336678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55aecee57af0 msgr2=0x55aecee60480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:31.802 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.796+0000 7f639d1f2740 1 --2- 172.21.15.2:0/288336678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55aecee57af0 0x55aecee60480 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f63840bc810 tx=0x7f63840db2b0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.802 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.796+0000 7f639d1f2740 1 -- 172.21.15.2:0/288336678 shutdown_connections 2024-09-19T06:16:31.802 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.796+0000 7f639d1f2740 1 --2- 172.21.15.2:0/288336678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aecee62cb0 0x55aecee7a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.802 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.796+0000 7f639d1f2740 1 --2- 172.21.15.2:0/288336678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aecee58410 0x55aecee7a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.802 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.796+0000 7f639d1f2740 1 --2- 172.21.15.2:0/288336678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55aecee57af0 0x55aecee60480 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.802 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.796+0000 7f639d1f2740 1 -- 172.21.15.2:0/288336678 >> 172.21.15.2:0/288336678 conn(0x55aecee54060 msgr2=0x55aecee61c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:31.802 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.797+0000 7f639d1f2740 1 -- 172.21.15.2:0/288336678 shutdown_connections 2024-09-19T06:16:31.802 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.797+0000 7f639d1f2740 1 -- 172.21.15.2:0/288336678 wait complete. 2024-09-19T06:16:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.797+0000 7f639d1f2740 1 -- start start 2024-09-19T06:16:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.797+0000 7f639d1f2740 1 Processor -- start 2024-09-19T06:16:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.797+0000 7f639d1f2740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55aecee57af0 0x55aecee5cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.797+0000 7f639d1f2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aecee58410 0x55aecee5d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.797+0000 7f639d1f2740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aecee62cb0 0x55aecee5d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.797+0000 7f639d1f2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f63941adf40 con 0x55aecee58410 2024-09-19T06:16:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.797+0000 7f639d1f2740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f63941af3b0 con 0x55aecee57af0 2024-09-19T06:16:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.797+0000 7f639d1f2740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f63941ae610 con 0x55aecee62cb0 2024-09-19T06:16:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.798+0000 7f639d1f2740 10 client.0 _ll_register_callbacks cb 0x7f63840b8b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.798+0000 7f638bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aecee58410 0x55aecee5d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.798+0000 7f638bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aecee58410 0x55aecee5d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45518/0 (socket says 172.21.15.2:45518) 2024-09-19T06:16:31.803 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.798+0000 7f6393fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55aecee57af0 0x55aecee5cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.798+0000 7f63989f0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aecee62cb0 0x55aecee5d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.798+0000 7f638bfff640 1 -- 172.21.15.2:0/1509270708 learned_addr learned my addr 172.21.15.2:0/1509270708 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.798+0000 7f638bfff640 1 -- 172.21.15.2:0/1509270708 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aecee62cb0 msgr2=0x55aecee5d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.798+0000 7f638bfff640 1 --2- 172.21.15.2:0/1509270708 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aecee62cb0 0x55aecee5d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.798+0000 7f638bfff640 1 -- 172.21.15.2:0/1509270708 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55aecee57af0 msgr2=0x55aecee5cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.798+0000 7f638bfff640 1 --2- 172.21.15.2:0/1509270708 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55aecee57af0 0x55aecee5cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.798+0000 7f638bfff640 1 -- 172.21.15.2:0/1509270708 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aeceedc290 con 0x55aecee58410 2024-09-19T06:16:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.798+0000 7f6393fff640 1 --2- 172.21.15.2:0/1509270708 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55aecee57af0 0x55aecee5cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.798+0000 7f638bfff640 1 --2- 172.21.15.2:0/1509270708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aecee58410 0x55aecee5d2b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f637c003d10 tx=0x7f637c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1bb050493a48ae4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.798+0000 7f63737fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:16:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.798+0000 7f63737fe640 1 -- 172.21.15.2:0/1509270708 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f637c011dc0 con 0x55aecee58410 2024-09-19T06:16:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.798+0000 7f63737fe640 1 -- 172.21.15.2:0/1509270708 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f637c005050 con 0x55aecee58410 2024-09-19T06:16:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.798+0000 7f639d1f2740 1 -- 172.21.15.2:0/1509270708 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55aecedc3d70 con 0x55aecee58410 2024-09-19T06:16:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.799+0000 7f63737fe640 1 -- 172.21.15.2:0/1509270708 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f637c035050 con 0x55aecee58410 2024-09-19T06:16:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.799+0000 7f639d1f2740 10 client.15708 fetch_fsmap learned FSMap version 26 2024-09-19T06:16:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.799+0000 7f639d1f2740 1 -- 172.21.15.2:0/1509270708 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55aeceedd5e0 con 0x55aecee58410 2024-09-19T06:16:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.799+0000 7f63737fe640 1 -- 172.21.15.2:0/1509270708 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55aecedc3d70 con 0x55aecee58410 2024-09-19T06:16:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.799+0000 7f63737fe640 1 -- 172.21.15.2:0/1509270708 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f637c01d410 con 0x55aecee58410 2024-09-19T06:16:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.799+0000 7f639d1f2740 10 client.15708 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:16:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.799+0000 7f639d1f2740 10 client.15708 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.799+0000 7f639d1f2740 20 client.15708 populate_metadata read hostname 'smithi002' 2024-09-19T06:16:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.799+0000 7f639d1f2740 1 --2- 172.21.15.2:0/1509270708 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55aeceeddd30 0x55aeceee0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.799+0000 7f639d1f2740 4 client.15708 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:16:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.799+0000 7f639d1f2740 1 -- 172.21.15.2:0/1509270708 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55aeced40900 con 0x55aeceeddd30 2024-09-19T06:16:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.799+0000 7f6393fff640 1 --2- 172.21.15.2:0/1509270708 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55aeceeddd30 0x55aeceee0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.800+0000 7f6393fff640 1 --2- 172.21.15.2:0/1509270708 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55aeceeddd30 0x55aeceee0150 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4548a6bab452ef13 server_cookie=3fab951e34e87aed in_seq=0 out_seq=0 2024-09-19T06:16:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.800+0000 7f63737fe640 10 client.15708 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.808+0000 7f63737fe640 1 -- 172.21.15.2:0/1509270708 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55aeced40900 con 0x55aeceeddd30 2024-09-19T06:16:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.808+0000 7f63737fe640 10 client.15708 handle_command_reply: tid=0 2024-09-19T06:16:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.808+0000 7f639d1f2740 1 client.15708 shutdown 2024-09-19T06:16:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.808+0000 7f639d1f2740 1 -- 172.21.15.2:0/1509270708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aecee58410 msgr2=0x55aecee5d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.808+0000 7f639d1f2740 1 --2- 172.21.15.2:0/1509270708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aecee58410 0x55aecee5d2b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f637c003d10 tx=0x7f637c004730 comp rx=0 tx=0).stop 2024-09-19T06:16:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.808+0000 7f639d1f2740 1 -- 172.21.15.2:0/1509270708 shutdown_connections 2024-09-19T06:16:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.808+0000 7f639d1f2740 1 --2- 172.21.15.2:0/1509270708 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55aecee62cb0 0x55aecee5d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.808+0000 7f639d1f2740 1 --2- 172.21.15.2:0/1509270708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aecee58410 0x55aecee5d2b0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.808+0000 7f639d1f2740 1 --2- 172.21.15.2:0/1509270708 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55aeceeddd30 0x55aeceee0150 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.808+0000 7f639d1f2740 1 --2- 172.21.15.2:0/1509270708 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55aecee57af0 0x55aecee5cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.808+0000 7f63737fe640 0 client.15708 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.808+0000 7f639d1f2740 1 -- 172.21.15.2:0/1509270708 >> 172.21.15.2:0/1509270708 conn(0x55aecee54060 msgr2=0x55aecee59550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.809+0000 7f639d1f2740 1 -- 172.21.15.2:0/1509270708 shutdown_connections 2024-09-19T06:16:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.809+0000 7f639d1f2740 1 -- 172.21.15.2:0/1509270708 wait complete. 2024-09-19T06:16:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.809+0000 7f639d1f2740 20 client.15708 trim_cache size 0 max 16384 2024-09-19T06:16:31.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-19T06:16:31.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-19T06:16:31.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-19T06:16:31.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-19T06:16:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.809+0000 7f639a453640 1 -- 172.21.15.2:0/3241312077 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f63800a33b0 msgr2=0x7f63800a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.809+0000 7f639a453640 1 --2- 172.21.15.2:0/3241312077 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f63800a33b0 0x7f63800a5870 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6394102860 tx=0x7f637c00b390 comp rx=0 tx=0).stop 2024-09-19T06:16:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.809+0000 7f639a453640 1 -- 172.21.15.2:0/3241312077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6394102c80 msgr2=0x7f639419a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.809+0000 7f639a453640 1 --2- 172.21.15.2:0/3241312077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6394102c80 0x7f639419a4d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f6384005940 tx=0x7f63840042f0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.809+0000 7f639a453640 1 -- 172.21.15.2:0/3241312077 shutdown_connections 2024-09-19T06:16:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.809+0000 7f639a453640 1 --2- 172.21.15.2:0/3241312077 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f63800a33b0 0x7f63800a5870 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.809+0000 7f639a453640 1 --2- 172.21.15.2:0/3241312077 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f639410c0a0 0x7f639419ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.809+0000 7f639a453640 1 --2- 172.21.15.2:0/3241312077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63941035a0 0x7f639419aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.809+0000 7f639a453640 1 --2- 172.21.15.2:0/3241312077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6394102c80 0x7f639419a4d0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.809+0000 7f639a453640 1 -- 172.21.15.2:0/3241312077 >> 172.21.15.2:0/3241312077 conn(0x7f63940779a0 msgr2=0x7f63940fcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.809+0000 7f639a453640 1 -- 172.21.15.2:0/3241312077 shutdown_connections 2024-09-19T06:16:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:31.809+0000 7f639a453640 1 -- 172.21.15.2:0/3241312077 wait complete. 2024-09-19T06:16:31.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.908+0000 7efe93c1f640 1 -- 172.21.15.2:0/2802908765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe8c101de0 msgr2=0x7efe8c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:31.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.908+0000 7efe93c1f640 1 --2- 172.21.15.2:0/2802908765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe8c101de0 0x7efe8c1021c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7efe88009900 tx=0x7efe8802a410 comp rx=0 tx=0).stop 2024-09-19T06:16:31.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.908+0000 7efe93c1f640 1 -- 172.21.15.2:0/2802908765 shutdown_connections 2024-09-19T06:16:31.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.908+0000 7efe93c1f640 1 --2- 172.21.15.2:0/2802908765 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe8c106f10 0x7efe8c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.908+0000 7efe93c1f640 1 --2- 172.21.15.2:0/2802908765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe8c102790 0x7efe8c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.908+0000 7efe93c1f640 1 --2- 172.21.15.2:0/2802908765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe8c101de0 0x7efe8c1021c0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.908+0000 7efe93c1f640 1 -- 172.21.15.2:0/2802908765 >> 172.21.15.2:0/2802908765 conn(0x7efe8c0fd8c0 msgr2=0x7efe8c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:31.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.908+0000 7efe93c1f640 1 -- 172.21.15.2:0/2802908765 shutdown_connections 2024-09-19T06:16:31.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.908+0000 7efe93c1f640 1 -- 172.21.15.2:0/2802908765 wait complete. 2024-09-19T06:16:31.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.909+0000 7efe93c1f640 1 Processor -- start 2024-09-19T06:16:31.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.909+0000 7efe93c1f640 1 -- start start 2024-09-19T06:16:31.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.909+0000 7efe93c1f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe8c101de0 0x7efe8c198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:31.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.909+0000 7efe93c1f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe8c102790 0x7efe8c1988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:31.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.909+0000 7efe93c1f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe8c106f10 0x7efe8c19cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:31.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.909+0000 7efe93c1f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efe8c111e20 con 0x7efe8c102790 2024-09-19T06:16:31.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.909+0000 7efe93c1f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7efe8c111ca0 con 0x7efe8c106f10 2024-09-19T06:16:31.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.909+0000 7efe93c1f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efe8c111fa0 con 0x7efe8c101de0 2024-09-19T06:16:31.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.910+0000 7efe911ba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe8c102790 0x7efe8c1988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:31.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.910+0000 7efe911ba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe8c102790 0x7efe8c1988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45532/0 (socket says 172.21.15.2:45532) 2024-09-19T06:16:31.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.910+0000 7efe911ba640 1 -- 172.21.15.2:0/3970919144 learned_addr learned my addr 172.21.15.2:0/3970919144 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:31.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.910+0000 7efe919bb640 1 --2- 172.21.15.2:0/3970919144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe8c101de0 0x7efe8c198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:31.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.910+0000 7efe921bc640 1 --2- 172.21.15.2:0/3970919144 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe8c106f10 0x7efe8c19cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:31.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.910+0000 7efe911ba640 1 -- 172.21.15.2:0/3970919144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe8c101de0 msgr2=0x7efe8c198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:31.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.910+0000 7efe911ba640 1 --2- 172.21.15.2:0/3970919144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe8c101de0 0x7efe8c198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.910+0000 7efe911ba640 1 -- 172.21.15.2:0/3970919144 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe8c106f10 msgr2=0x7efe8c19cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:31.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.910+0000 7efe911ba640 1 --2- 172.21.15.2:0/3970919144 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe8c106f10 0x7efe8c19cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.910+0000 7efe911ba640 1 -- 172.21.15.2:0/3970919144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe8c19d330 con 0x7efe8c102790 2024-09-19T06:16:31.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.910+0000 7efe921bc640 1 --2- 172.21.15.2:0/3970919144 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe8c106f10 0x7efe8c19cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:16:31.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.910+0000 7efe911ba640 1 --2- 172.21.15.2:0/3970919144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe8c102790 0x7efe8c1988c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7efe7c00d950 tx=0x7efe7c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:31.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.910+0000 7efe82ffd640 1 -- 172.21.15.2:0/3970919144 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7c017070 con 0x7efe8c102790 2024-09-19T06:16:31.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.910+0000 7efe82ffd640 1 -- 172.21.15.2:0/3970919144 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efe7c009c30 con 0x7efe8c102790 2024-09-19T06:16:31.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.910+0000 7efe93c1f640 1 -- 172.21.15.2:0/3970919144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe8c19d620 con 0x7efe8c102790 2024-09-19T06:16:31.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.910+0000 7efe82ffd640 1 -- 172.21.15.2:0/3970919144 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7c00f620 con 0x7efe8c102790 2024-09-19T06:16:31.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.911+0000 7efe93c1f640 1 -- 172.21.15.2:0/3970919144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe8c1a4f00 con 0x7efe8c102790 2024-09-19T06:16:31.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.913+0000 7efe82ffd640 1 -- 172.21.15.2:0/3970919144 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7efe7c0109a0 con 0x7efe8c102790 2024-09-19T06:16:31.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.914+0000 7efe95ff8740 1 Processor -- start 2024-09-19T06:16:31.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.914+0000 7efe95ff8740 1 -- start start 2024-09-19T06:16:31.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.914+0000 7efe95ff8740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5569c4e6bb40 0x5569c4e6a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:31.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.914+0000 7efe95ff8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569c4e6a5d0 0x5569c4e6aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:31.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.914+0000 7efe95ff8740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5569c4e79780 0x5569c4e7bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:31.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.914+0000 7efe95ff8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5569c4dd02f0 con 0x5569c4e6a5d0 2024-09-19T06:16:31.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.914+0000 7efe95ff8740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5569c4d77cf0 con 0x5569c4e79780 2024-09-19T06:16:31.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.914+0000 7efe95ff8740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5569c4dcc2b0 con 0x5569c4e6bb40 2024-09-19T06:16:31.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.914+0000 7efe919bb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569c4e6a5d0 0x5569c4e6aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:31.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.914+0000 7efe919bb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569c4e6a5d0 0x5569c4e6aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45540/0 (socket says 172.21.15.2:45540) 2024-09-19T06:16:31.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.914+0000 7efe919bb640 1 -- 172.21.15.2:0/220903025 learned_addr learned my addr 172.21.15.2:0/220903025 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:31.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.915+0000 7efe921bc640 1 --2- 172.21.15.2:0/220903025 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5569c4e6bb40 0x5569c4e6a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:31.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.915+0000 7efe82ffd640 1 --2- 172.21.15.2:0/3970919144 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7efe780a33b0 0x7efe780a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:31.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.915+0000 7efe911ba640 1 --2- 172.21.15.2:0/220903025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5569c4e79780 0x5569c4e7bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:31.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.915+0000 7efe921bc640 1 --2- 172.21.15.2:0/3970919144 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7efe780a33b0 0x7efe780a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:31.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.915+0000 7efe919bb640 1 -- 172.21.15.2:0/220903025 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5569c4e6bb40 msgr2=0x5569c4e6a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:31.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.915+0000 7efe919bb640 1 --2- 172.21.15.2:0/220903025 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5569c4e6bb40 0x5569c4e6a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.915+0000 7efe919bb640 1 -- 172.21.15.2:0/220903025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5569c4e79780 msgr2=0x5569c4e7bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:31.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.915+0000 7efe919bb640 1 --2- 172.21.15.2:0/220903025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5569c4e79780 0x5569c4e7bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.915+0000 7efe919bb640 1 -- 172.21.15.2:0/220903025 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569c4d5c3a0 con 0x5569c4e6a5d0 2024-09-19T06:16:31.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.915+0000 7efe82ffd640 1 -- 172.21.15.2:0/3970919144 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7efe7c0cf940 con 0x7efe8c102790 2024-09-19T06:16:31.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.915+0000 7efe919bb640 1 --2- 172.21.15.2:0/220903025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569c4e6a5d0 0x5569c4e6aa10 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7efe88009900 tx=0x7efe88032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a1a0ae75f1e0708 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:31.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.915+0000 7efe921bc640 1 --2- 172.21.15.2:0/3970919144 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7efe780a33b0 0x7efe780a5870 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efe840127b0 tx=0x7efe84004ab0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:31.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.915+0000 7efe77fff640 1 -- 172.21.15.2:0/220903025 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe88040070 con 0x5569c4e6a5d0 2024-09-19T06:16:31.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.915+0000 7efe77fff640 1 -- 172.21.15.2:0/220903025 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efe880316a0 con 0x5569c4e6a5d0 2024-09-19T06:16:31.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.915+0000 7efe77fff640 1 -- 172.21.15.2:0/220903025 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe88035040 con 0x5569c4e6a5d0 2024-09-19T06:16:31.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.916+0000 7efe95ff8740 1 -- 172.21.15.2:0/220903025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569c4e6a5d0 msgr2=0x5569c4e6aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:31.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.916+0000 7efe95ff8740 1 --2- 172.21.15.2:0/220903025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569c4e6a5d0 0x5569c4e6aa10 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7efe88009900 tx=0x7efe88032e40 comp rx=0 tx=0).stop 2024-09-19T06:16:31.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.916+0000 7efe95ff8740 1 -- 172.21.15.2:0/220903025 shutdown_connections 2024-09-19T06:16:31.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.916+0000 7efe95ff8740 1 --2- 172.21.15.2:0/220903025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5569c4e79780 0x5569c4e7bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.916+0000 7efe95ff8740 1 --2- 172.21.15.2:0/220903025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569c4e6a5d0 0x5569c4e6aa10 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.916+0000 7efe95ff8740 1 --2- 172.21.15.2:0/220903025 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5569c4e6bb40 0x5569c4e6a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.916+0000 7efe95ff8740 1 -- 172.21.15.2:0/220903025 >> 172.21.15.2:0/220903025 conn(0x5569c4e33310 msgr2=0x5569c4e66c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:31.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.916+0000 7efe95ff8740 1 -- 172.21.15.2:0/220903025 shutdown_connections 2024-09-19T06:16:31.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.916+0000 7efe95ff8740 1 -- 172.21.15.2:0/220903025 wait complete. 2024-09-19T06:16:31.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.917+0000 7efe95ff8740 1 -- start start 2024-09-19T06:16:31.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.917+0000 7efe95ff8740 1 Processor -- start 2024-09-19T06:16:31.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.917+0000 7efe95ff8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569c4e6a5d0 0x5569c4e79170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:31.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.917+0000 7efe95ff8740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5569c4e6bb40 0x5569c4e76420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:31.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.917+0000 7efe95ff8740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5569c4e79780 0x5569c4e76a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:31.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.917+0000 7efe95ff8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5569c4e7c420 con 0x5569c4e6a5d0 2024-09-19T06:16:31.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.917+0000 7efe95ff8740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5569c4d8b060 con 0x5569c4e79780 2024-09-19T06:16:31.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.917+0000 7efe95ff8740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5569c4e7c5a0 con 0x5569c4e6bb40 2024-09-19T06:16:31.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.917+0000 7efe95ff8740 10 client.0 _ll_register_callbacks cb 0x5569c4ade8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:31.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.917+0000 7efe919bb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569c4e6a5d0 0x5569c4e79170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:31.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.917+0000 7efe919bb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569c4e6a5d0 0x5569c4e79170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45544/0 (socket says 172.21.15.2:45544) 2024-09-19T06:16:31.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.917+0000 7efe919bb640 1 -- 172.21.15.2:0/3962860138 learned_addr learned my addr 172.21.15.2:0/3962860138 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:31.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.917+0000 7efe911ba640 1 --2- 172.21.15.2:0/3962860138 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5569c4e6bb40 0x5569c4e76420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:31.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.918+0000 7efe921bc640 1 --2- 172.21.15.2:0/3962860138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5569c4e79780 0x5569c4e76a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:31.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.918+0000 7efe919bb640 1 -- 172.21.15.2:0/3962860138 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5569c4e6bb40 msgr2=0x5569c4e76420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:31.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.918+0000 7efe919bb640 1 --2- 172.21.15.2:0/3962860138 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5569c4e6bb40 0x5569c4e76420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.918+0000 7efe919bb640 1 -- 172.21.15.2:0/3962860138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5569c4e79780 msgr2=0x5569c4e76a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:31.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.918+0000 7efe919bb640 1 --2- 172.21.15.2:0/3962860138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5569c4e79780 0x5569c4e76a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.918+0000 7efe919bb640 1 -- 172.21.15.2:0/3962860138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569c4b413c0 con 0x5569c4e6a5d0 2024-09-19T06:16:31.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.918+0000 7efe919bb640 1 --2- 172.21.15.2:0/3962860138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569c4e6a5d0 0x5569c4e79170 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7efe8802abb0 tx=0x7efe88005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d96a15f821fda4a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:31.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.918+0000 7efe757fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:16:31.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.918+0000 7efe757fa640 1 -- 172.21.15.2:0/3962860138 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe8804b020 con 0x5569c4e6a5d0 2024-09-19T06:16:31.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.918+0000 7efe95ff8740 1 -- 172.21.15.2:0/3962860138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe880316a0 con 0x5569c4e6a5d0 2024-09-19T06:16:31.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.918+0000 7efe757fa640 1 -- 172.21.15.2:0/3962860138 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7efe88004750 con 0x5569c4e6a5d0 2024-09-19T06:16:31.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.918+0000 7efe757fa640 1 -- 172.21.15.2:0/3962860138 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7efe88056050 con 0x5569c4e6a5d0 2024-09-19T06:16:31.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.918+0000 7efe95ff8740 10 client.15720 fetch_fsmap learned FSMap version 26 2024-09-19T06:16:31.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.918+0000 7efe95ff8740 1 -- 172.21.15.2:0/3962860138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5569c4e87ec0 con 0x5569c4e6a5d0 2024-09-19T06:16:31.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.919+0000 7efe757fa640 1 -- 172.21.15.2:0/3962860138 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efe880316a0 con 0x5569c4e6a5d0 2024-09-19T06:16:31.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.919+0000 7efe757fa640 1 -- 172.21.15.2:0/3962860138 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7efe8803c870 con 0x5569c4e6a5d0 2024-09-19T06:16:31.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.919+0000 7efe95ff8740 10 client.15720 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:16:31.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.919+0000 7efe95ff8740 10 client.15720 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:16:31.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.919+0000 7efe95ff8740 20 client.15720 populate_metadata read hostname 'smithi002' 2024-09-19T06:16:31.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.919+0000 7efe95ff8740 1 --2- 172.21.15.2:0/3962860138 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x5569c4e89210 0x5569c4e8b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:31.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.919+0000 7efe95ff8740 4 client.15720 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:16:31.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.919+0000 7efe95ff8740 1 -- 172.21.15.2:0/3962860138 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569c4ddd860 con 0x5569c4e89210 2024-09-19T06:16:31.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.919+0000 7efe911ba640 1 --2- 172.21.15.2:0/3962860138 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x5569c4e89210 0x5569c4e8b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:31.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.920+0000 7efe911ba640 1 --2- 172.21.15.2:0/3962860138 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x5569c4e89210 0x5569c4e8b600 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7f87596e1fe53080 server_cookie=b76f3767ef830569 in_seq=0 out_seq=0 2024-09-19T06:16:31.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.920+0000 7efe757fa640 10 client.15720 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:16:31.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.920+0000 7efe757fa640 1 -- 172.21.15.2:0/3962860138 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5569c4ddd860 con 0x5569c4e89210 2024-09-19T06:16:31.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.920+0000 7efe757fa640 10 client.15720 handle_command_reply: tid=0 2024-09-19T06:16:31.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.920+0000 7efe95ff8740 1 client.15720 shutdown 2024-09-19T06:16:31.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.920+0000 7efe95ff8740 1 -- 172.21.15.2:0/3962860138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569c4e6a5d0 msgr2=0x5569c4e79170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:31.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.920+0000 7efe95ff8740 1 --2- 172.21.15.2:0/3962860138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569c4e6a5d0 0x5569c4e79170 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7efe8802abb0 tx=0x7efe88005fd0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.921+0000 7efe95ff8740 1 -- 172.21.15.2:0/3962860138 shutdown_connections 2024-09-19T06:16:31.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.921+0000 7efe95ff8740 1 --2- 172.21.15.2:0/3962860138 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x5569c4e89210 0x5569c4e8b600 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.921+0000 7efe95ff8740 1 --2- 172.21.15.2:0/3962860138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5569c4e79780 0x5569c4e76a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.921+0000 7efe95ff8740 1 --2- 172.21.15.2:0/3962860138 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5569c4e6bb40 0x5569c4e76420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.921+0000 7efe95ff8740 1 --2- 172.21.15.2:0/3962860138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569c4e6a5d0 0x5569c4e79170 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.921+0000 7efe95ff8740 1 -- 172.21.15.2:0/3962860138 >> 172.21.15.2:0/3962860138 conn(0x5569c4e33310 msgr2=0x5569c4e6c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:31.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.921+0000 7efe757fa640 0 client.15720 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:16:31.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.921+0000 7efe95ff8740 1 -- 172.21.15.2:0/3962860138 shutdown_connections 2024-09-19T06:16:31.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.921+0000 7efe95ff8740 1 -- 172.21.15.2:0/3962860138 wait complete. 2024-09-19T06:16:31.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.921+0000 7efe95ff8740 20 client.15720 trim_cache size 0 max 16384 2024-09-19T06:16:31.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.934+0000 7efe95ff8740 1 Processor -- start 2024-09-19T06:16:31.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.934+0000 7efe95ff8740 1 -- start start 2024-09-19T06:16:31.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.934+0000 7efe95ff8740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5569c4e6a5d0 0x5569c4e856c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:31.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.934+0000 7efe95ff8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569c4e6bb40 0x5569c4e90ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:31.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.934+0000 7efe95ff8740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5569c4e79780 0x5569c4e910e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:31.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.934+0000 7efe95ff8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efe8c1adca0 con 0x5569c4e6bb40 2024-09-19T06:16:31.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.934+0000 7efe95ff8740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7efe8c1ab570 con 0x5569c4e79780 2024-09-19T06:16:31.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.934+0000 7efe95ff8740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efe8c1a93c0 con 0x5569c4e6a5d0 2024-09-19T06:16:31.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.934+0000 7efe911ba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569c4e6bb40 0x5569c4e90ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:31.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.934+0000 7efe911ba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569c4e6bb40 0x5569c4e90ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45546/0 (socket says 172.21.15.2:45546) 2024-09-19T06:16:31.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.934+0000 7efe911ba640 1 -- 172.21.15.2:0/2786700810 learned_addr learned my addr 172.21.15.2:0/2786700810 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:31.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.935+0000 7efe921bc640 1 --2- 172.21.15.2:0/2786700810 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5569c4e79780 0x5569c4e910e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:31.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.935+0000 7efe919bb640 1 --2- 172.21.15.2:0/2786700810 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5569c4e6a5d0 0x5569c4e856c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:31.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.935+0000 7efe911ba640 1 -- 172.21.15.2:0/2786700810 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5569c4e6a5d0 msgr2=0x5569c4e856c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:31.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.935+0000 7efe911ba640 1 --2- 172.21.15.2:0/2786700810 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5569c4e6a5d0 0x5569c4e856c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.935+0000 7efe911ba640 1 -- 172.21.15.2:0/2786700810 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5569c4e79780 msgr2=0x5569c4e910e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:31.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.935+0000 7efe911ba640 1 --2- 172.21.15.2:0/2786700810 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5569c4e79780 0x5569c4e910e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.935+0000 7efe911ba640 1 -- 172.21.15.2:0/2786700810 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569c4e76d40 con 0x5569c4e6bb40 2024-09-19T06:16:31.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.935+0000 7efe921bc640 1 --2- 172.21.15.2:0/2786700810 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5569c4e79780 0x5569c4e910e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:16:31.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.935+0000 7efe911ba640 1 --2- 172.21.15.2:0/2786700810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569c4e6bb40 0x5569c4e90ba0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7efe7c000c00 tx=0x7efe7c06ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f47a8a23601fe5ac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:31.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.935+0000 7efe777fe640 1 -- 172.21.15.2:0/2786700810 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7c020040 con 0x5569c4e6bb40 2024-09-19T06:16:31.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.935+0000 7efe777fe640 1 -- 172.21.15.2:0/2786700810 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efe7c0a48c0 con 0x5569c4e6bb40 2024-09-19T06:16:31.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.935+0000 7efe777fe640 1 -- 172.21.15.2:0/2786700810 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7c0860b0 con 0x5569c4e6bb40 2024-09-19T06:16:31.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.936+0000 7efe95ff8740 1 -- 172.21.15.2:0/2786700810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569c4e6bb40 msgr2=0x5569c4e90ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:31.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.936+0000 7efe95ff8740 1 --2- 172.21.15.2:0/2786700810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569c4e6bb40 0x5569c4e90ba0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7efe7c000c00 tx=0x7efe7c06ea80 comp rx=0 tx=0).stop 2024-09-19T06:16:31.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.936+0000 7efe95ff8740 1 -- 172.21.15.2:0/2786700810 shutdown_connections 2024-09-19T06:16:31.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.936+0000 7efe95ff8740 1 --2- 172.21.15.2:0/2786700810 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5569c4e79780 0x5569c4e910e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.936+0000 7efe95ff8740 1 --2- 172.21.15.2:0/2786700810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569c4e6bb40 0x5569c4e90ba0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.936+0000 7efe95ff8740 1 --2- 172.21.15.2:0/2786700810 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5569c4e6a5d0 0x5569c4e856c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.936+0000 7efe95ff8740 1 -- 172.21.15.2:0/2786700810 >> 172.21.15.2:0/2786700810 conn(0x5569c4e33310 msgr2=0x5569c4e61a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:31.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.936+0000 7efe95ff8740 1 -- 172.21.15.2:0/2786700810 shutdown_connections 2024-09-19T06:16:31.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.936+0000 7efe95ff8740 1 -- 172.21.15.2:0/2786700810 wait complete. 2024-09-19T06:16:31.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.936+0000 7efe95ff8740 1 -- start start 2024-09-19T06:16:31.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.936+0000 7efe95ff8740 1 Processor -- start 2024-09-19T06:16:31.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.937+0000 7efe95ff8740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5569c4e6a5d0 0x5569c4e72c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:31.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.937+0000 7efe95ff8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569c4e6bb40 0x5569c4e73190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:31.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.937+0000 7efe95ff8740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5569c4e79780 0x5569c4e736d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:31.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.937+0000 7efe95ff8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efe8c1a9a30 con 0x5569c4e6bb40 2024-09-19T06:16:31.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.937+0000 7efe95ff8740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7efe8c1aaea0 con 0x5569c4e6a5d0 2024-09-19T06:16:31.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.937+0000 7efe95ff8740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efe8c1aa100 con 0x5569c4e79780 2024-09-19T06:16:31.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.937+0000 7efe95ff8740 10 client.0 _ll_register_callbacks cb 0x7efe84007600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:31.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.937+0000 7efe911ba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569c4e6bb40 0x5569c4e73190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:31.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.937+0000 7efe911ba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569c4e6bb40 0x5569c4e73190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45558/0 (socket says 172.21.15.2:45558) 2024-09-19T06:16:31.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.937+0000 7efe911ba640 1 -- 172.21.15.2:0/1814960521 learned_addr learned my addr 172.21.15.2:0/1814960521 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:31.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.937+0000 7efe919bb640 1 --2- 172.21.15.2:0/1814960521 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5569c4e6a5d0 0x5569c4e72c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:31.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.937+0000 7efe921bc640 1 --2- 172.21.15.2:0/1814960521 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5569c4e79780 0x5569c4e736d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:31.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.937+0000 7efe911ba640 1 -- 172.21.15.2:0/1814960521 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5569c4e79780 msgr2=0x5569c4e736d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:31.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.937+0000 7efe911ba640 1 --2- 172.21.15.2:0/1814960521 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5569c4e79780 0x5569c4e736d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.937+0000 7efe911ba640 1 -- 172.21.15.2:0/1814960521 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5569c4e6a5d0 msgr2=0x5569c4e72c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:31.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.937+0000 7efe911ba640 1 --2- 172.21.15.2:0/1814960521 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5569c4e6a5d0 0x5569c4e72c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.937+0000 7efe911ba640 1 -- 172.21.15.2:0/1814960521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569c4e80aa0 con 0x5569c4e6bb40 2024-09-19T06:16:31.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.937+0000 7efe911ba640 1 --2- 172.21.15.2:0/1814960521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569c4e6bb40 0x5569c4e73190 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7efe7c00bfa0 tx=0x7efe7c0cd090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e0bfdc492659eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:31.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.937+0000 7efe757fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:16:31.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.938+0000 7efe757fa640 1 -- 172.21.15.2:0/1814960521 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7c0b1020 con 0x5569c4e6bb40 2024-09-19T06:16:31.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.938+0000 7efe757fa640 1 -- 172.21.15.2:0/1814960521 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7efe7c099cf0 con 0x5569c4e6bb40 2024-09-19T06:16:31.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.938+0000 7efe95ff8740 1 -- 172.21.15.2:0/1814960521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe7c0a48c0 con 0x5569c4e6bb40 2024-09-19T06:16:31.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.938+0000 7efe757fa640 1 -- 172.21.15.2:0/1814960521 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7efe7c0b9050 con 0x5569c4e6bb40 2024-09-19T06:16:31.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.938+0000 7efe95ff8740 10 client.15726 fetch_fsmap learned FSMap version 26 2024-09-19T06:16:31.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.938+0000 7efe95ff8740 1 -- 172.21.15.2:0/1814960521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5569c4e81d10 con 0x5569c4e6bb40 2024-09-19T06:16:31.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.938+0000 7efe757fa640 1 -- 172.21.15.2:0/1814960521 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efe7c0a48c0 con 0x5569c4e6bb40 2024-09-19T06:16:31.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.938+0000 7efe757fa640 1 -- 172.21.15.2:0/1814960521 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7efe7c010460 con 0x5569c4e6bb40 2024-09-19T06:16:31.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.938+0000 7efe95ff8740 10 client.15726 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:16:31.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.938+0000 7efe95ff8740 10 client.15726 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:16:31.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.938+0000 7efe95ff8740 20 client.15726 populate_metadata read hostname 'smithi002' 2024-09-19T06:16:31.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.938+0000 7efe95ff8740 1 --2- 172.21.15.2:0/1814960521 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x5569c4ef8360 0x5569c4efa750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:31.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.938+0000 7efe95ff8740 4 client.15726 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:16:31.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.938+0000 7efe95ff8740 1 -- 172.21.15.2:0/1814960521 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5569c4dd7d70 con 0x5569c4ef8360 2024-09-19T06:16:31.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.938+0000 7efe919bb640 1 --2- 172.21.15.2:0/1814960521 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x5569c4ef8360 0x5569c4efa750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:31.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.939+0000 7efe757fa640 10 client.15726 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:16:31.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.939+0000 7efe919bb640 1 --2- 172.21.15.2:0/1814960521 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x5569c4ef8360 0x5569c4efa750 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ae4f85f1948a0c4c server_cookie=5f512cd097674fc9 in_seq=0 out_seq=0 2024-09-19T06:16:31.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.939+0000 7efe757fa640 1 -- 172.21.15.2:0/1814960521 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5569c4dd7d70 con 0x5569c4ef8360 2024-09-19T06:16:31.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.939+0000 7efe757fa640 10 client.15726 handle_command_reply: tid=0 2024-09-19T06:16:31.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.939+0000 7efe95ff8740 1 client.15726 shutdown 2024-09-19T06:16:31.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.939+0000 7efe95ff8740 1 -- 172.21.15.2:0/1814960521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569c4e6bb40 msgr2=0x5569c4e73190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:31.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.939+0000 7efe95ff8740 1 --2- 172.21.15.2:0/1814960521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569c4e6bb40 0x5569c4e73190 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7efe7c00bfa0 tx=0x7efe7c0cd090 comp rx=0 tx=0).stop 2024-09-19T06:16:31.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.939+0000 7efe95ff8740 1 -- 172.21.15.2:0/1814960521 shutdown_connections 2024-09-19T06:16:31.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.939+0000 7efe95ff8740 1 --2- 172.21.15.2:0/1814960521 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x5569c4ef8360 0x5569c4efa750 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.939+0000 7efe95ff8740 1 --2- 172.21.15.2:0/1814960521 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5569c4e79780 0x5569c4e736d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.939+0000 7efe95ff8740 1 --2- 172.21.15.2:0/1814960521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5569c4e6bb40 0x5569c4e73190 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.939+0000 7efe95ff8740 1 --2- 172.21.15.2:0/1814960521 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5569c4e6a5d0 0x5569c4e72c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.939+0000 7efe757fa640 0 client.15726 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:16:31.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.939+0000 7efe95ff8740 1 -- 172.21.15.2:0/1814960521 >> 172.21.15.2:0/1814960521 conn(0x5569c4e33310 msgr2=0x5569c4e74bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:31.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.939+0000 7efe95ff8740 1 -- 172.21.15.2:0/1814960521 shutdown_connections 2024-09-19T06:16:31.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.939+0000 7efe95ff8740 1 -- 172.21.15.2:0/1814960521 wait complete. 2024-09-19T06:16:31.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.940+0000 7efe95ff8740 20 client.15726 trim_cache size 0 max 16384 2024-09-19T06:16:31.947 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:16:31.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.940+0000 7efe93c1f640 1 -- 172.21.15.2:0/3970919144 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7efe780a33b0 msgr2=0x7efe780a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:31.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.940+0000 7efe93c1f640 1 --2- 172.21.15.2:0/3970919144 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7efe780a33b0 0x7efe780a5870 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efe840127b0 tx=0x7efe84004ab0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.940+0000 7efe93c1f640 1 -- 172.21.15.2:0/3970919144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe8c102790 msgr2=0x7efe8c1988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:31.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.940+0000 7efe93c1f640 1 --2- 172.21.15.2:0/3970919144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe8c102790 0x7efe8c1988c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7efe7c00d950 tx=0x7efe7c00de10 comp rx=0 tx=0).stop 2024-09-19T06:16:31.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.940+0000 7efe93c1f640 1 -- 172.21.15.2:0/3970919144 shutdown_connections 2024-09-19T06:16:31.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.940+0000 7efe93c1f640 1 --2- 172.21.15.2:0/3970919144 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7efe780a33b0 0x7efe780a5870 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.940+0000 7efe93c1f640 1 --2- 172.21.15.2:0/3970919144 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe8c106f10 0x7efe8c19cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.940+0000 7efe93c1f640 1 --2- 172.21.15.2:0/3970919144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe8c102790 0x7efe8c1988c0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.940+0000 7efe93c1f640 1 --2- 172.21.15.2:0/3970919144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe8c101de0 0x7efe8c198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:31.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.940+0000 7efe93c1f640 1 -- 172.21.15.2:0/3970919144 >> 172.21.15.2:0/3970919144 conn(0x7efe8c0fd8c0 msgr2=0x7efe8c0fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:31.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.940+0000 7efe93c1f640 1 -- 172.21.15.2:0/3970919144 shutdown_connections 2024-09-19T06:16:31.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:31.940+0000 7efe93c1f640 1 -- 172.21.15.2:0/3970919144 wait complete. 2024-09-19T06:16:32.628 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:16:32.874 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-19T06:16:32.875 INFO:tasks.workunit.client.0.smithi002.stdout: Children see throughput for 1 re-readers = 7459148.00 kB/sec 2024-09-19T06:16:32.875 INFO:tasks.workunit.client.0.smithi002.stdout: Parent sees throughput for 1 re-readers = 7449861.28 kB/sec 2024-09-19T06:16:32.875 INFO:tasks.workunit.client.0.smithi002.stdout: Min throughput per process = 7459148.00 kB/sec 2024-09-19T06:16:32.875 INFO:tasks.workunit.client.0.smithi002.stdout: Max throughput per process = 7459148.00 kB/sec 2024-09-19T06:16:32.875 INFO:tasks.workunit.client.0.smithi002.stdout: Avg throughput per process = 7459148.00 kB/sec 2024-09-19T06:16:32.875 INFO:tasks.workunit.client.0.smithi002.stdout: Min xfer = 1048576.00 kB 2024-09-19T06:16:32.905 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:16:33.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.527+0000 7f296bdbf640 1 -- 172.21.15.2:0/1667799049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f296410c170 msgr2=0x7f296410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:33.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.527+0000 7f296bdbf640 1 --2- 172.21.15.2:0/1667799049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f296410c170 0x7f296410e610 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f295c009ca0 tx=0x7f295c02a950 comp rx=0 tx=0).stop 2024-09-19T06:16:33.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.527+0000 7f296bdbf640 1 -- 172.21.15.2:0/1667799049 shutdown_connections 2024-09-19T06:16:33.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.527+0000 7f296bdbf640 1 --2- 172.21.15.2:0/1667799049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f296410c170 0x7f296410e610 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:33.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.527+0000 7f296bdbf640 1 --2- 172.21.15.2:0/1667799049 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2964103660 0x7f296410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:33.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.527+0000 7f296bdbf640 1 --2- 172.21.15.2:0/1667799049 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2964102d40 0x7f2964103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:33.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.527+0000 7f296bdbf640 1 -- 172.21.15.2:0/1667799049 >> 172.21.15.2:0/1667799049 conn(0x7f29640fc7a0 msgr2=0x7f29640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:33.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.527+0000 7f296bdbf640 1 -- 172.21.15.2:0/1667799049 shutdown_connections 2024-09-19T06:16:33.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.527+0000 7f296bdbf640 1 -- 172.21.15.2:0/1667799049 wait complete. 2024-09-19T06:16:33.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.528+0000 7f296bdbf640 1 Processor -- start 2024-09-19T06:16:33.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.528+0000 7f296bdbf640 1 -- start start 2024-09-19T06:16:33.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.528+0000 7f296bdbf640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2964102d40 0x7f29641009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:33.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.528+0000 7f296bdbf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2964103660 0x7f2964100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:33.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.528+0000 7f296bdbf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f296410c170 0x7f2964101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:33.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.528+0000 7f296bdbf640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2964111e20 con 0x7f2964103660 2024-09-19T06:16:33.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.528+0000 7f296bdbf640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2964111ca0 con 0x7f296410c170 2024-09-19T06:16:33.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.528+0000 7f296bdbf640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2964111fa0 con 0x7f2964102d40 2024-09-19T06:16:33.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.528+0000 7f296935a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2964103660 0x7f2964100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:33.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.528+0000 7f296935a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2964103660 0x7f2964100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45570/0 (socket says 172.21.15.2:45570) 2024-09-19T06:16:33.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.528+0000 7f296935a640 1 -- 172.21.15.2:0/3645932504 learned_addr learned my addr 172.21.15.2:0/3645932504 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:33.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.529+0000 7f2969b5b640 1 --2- 172.21.15.2:0/3645932504 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2964102d40 0x7f29641009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:33.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.529+0000 7f296a35c640 1 --2- 172.21.15.2:0/3645932504 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f296410c170 0x7f2964101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:33.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.529+0000 7f296935a640 1 -- 172.21.15.2:0/3645932504 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2964102d40 msgr2=0x7f29641009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:33.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.529+0000 7f296935a640 1 --2- 172.21.15.2:0/3645932504 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2964102d40 0x7f29641009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:33.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.529+0000 7f296935a640 1 -- 172.21.15.2:0/3645932504 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f296410c170 msgr2=0x7f2964101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:33.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.529+0000 7f296935a640 1 --2- 172.21.15.2:0/3645932504 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f296410c170 0x7f2964101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:33.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.529+0000 7f296935a640 1 -- 172.21.15.2:0/3645932504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29641a6800 con 0x7f2964103660 2024-09-19T06:16:33.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.529+0000 7f296a35c640 1 --2- 172.21.15.2:0/3645932504 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f296410c170 0x7f2964101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:16:33.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.529+0000 7f296935a640 1 --2- 172.21.15.2:0/3645932504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2964103660 0x7f2964100ee0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f295400c970 tx=0x7f295400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:33.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.529+0000 7f295affd640 1 -- 172.21.15.2:0/3645932504 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2954007bb0 con 0x7f2964103660 2024-09-19T06:16:33.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.529+0000 7f296bdbf640 1 -- 172.21.15.2:0/3645932504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29641a6af0 con 0x7f2964103660 2024-09-19T06:16:33.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.529+0000 7f295affd640 1 -- 172.21.15.2:0/3645932504 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2954007d50 con 0x7f2964103660 2024-09-19T06:16:33.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.529+0000 7f295affd640 1 -- 172.21.15.2:0/3645932504 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2954004e10 con 0x7f2964103660 2024-09-19T06:16:33.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.529+0000 7f296bdbf640 1 -- 172.21.15.2:0/3645932504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29641a6fe0 con 0x7f2964103660 2024-09-19T06:16:33.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.531+0000 7f295affd640 1 -- 172.21.15.2:0/3645932504 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f2954005020 con 0x7f2964103660 2024-09-19T06:16:33.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.532+0000 7f296e198740 1 Processor -- start 2024-09-19T06:16:33.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.532+0000 7f296e198740 1 -- start start 2024-09-19T06:16:33.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.532+0000 7f296e198740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557164770b40 0x55716476f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:33.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.532+0000 7f296e198740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55716476f5d0 0x55716476fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:33.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.532+0000 7f296e198740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55716477a370 0x55716477c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:33.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.532+0000 7f295affd640 1 --2- 172.21.15.2:0/3645932504 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f29500a33b0 0x7f29500a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:33.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.532+0000 7f296e198740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5571646d52f0 con 0x557164770b40 2024-09-19T06:16:33.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.532+0000 7f296e198740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55716467ccf0 con 0x55716476f5d0 2024-09-19T06:16:33.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.532+0000 7f296e198740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5571646d12b0 con 0x55716477a370 2024-09-19T06:16:33.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.533+0000 7f296a35c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557164770b40 0x55716476f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:33.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.533+0000 7f296a35c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557164770b40 0x55716476f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45576/0 (socket says 172.21.15.2:45576) 2024-09-19T06:16:33.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.533+0000 7f296a35c640 1 -- 172.21.15.2:0/2033116233 learned_addr learned my addr 172.21.15.2:0/2033116233 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:33.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.533+0000 7f296935a640 1 --2- 172.21.15.2:0/3645932504 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f29500a33b0 0x7f29500a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:33.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.533+0000 7f2969b5b640 1 --2- 172.21.15.2:0/2033116233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55716476f5d0 0x55716476fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:33.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.533+0000 7f295affd640 1 -- 172.21.15.2:0/3645932504 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f29540cfa40 con 0x7f2964103660 2024-09-19T06:16:33.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.533+0000 7f296a35c640 1 --2- 172.21.15.2:0/2033116233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55716477a370 0x55716477c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:33.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.533+0000 7f2969b5b640 1 -- 172.21.15.2:0/2033116233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55716477a370 msgr2=0x55716477c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:33.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.533+0000 7f2969b5b640 1 --2- 172.21.15.2:0/2033116233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55716477a370 0x55716477c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:33.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.533+0000 7f2969b5b640 1 -- 172.21.15.2:0/2033116233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557164770b40 msgr2=0x55716476f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:33.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.533+0000 7f2969b5b640 1 --2- 172.21.15.2:0/2033116233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557164770b40 0x55716476f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:33.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.533+0000 7f2969b5b640 1 -- 172.21.15.2:0/2033116233 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571646613a0 con 0x55716476f5d0 2024-09-19T06:16:33.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.533+0000 7f296a35c640 1 --2- 172.21.15.2:0/2033116233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557164770b40 0x55716476f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:33.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.533+0000 7f296935a640 1 --2- 172.21.15.2:0/3645932504 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f29500a33b0 0x7f29500a5870 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f29540cd270 tx=0x7f2954097950 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:33.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.533+0000 7f2969b5b640 1 --2- 172.21.15.2:0/2033116233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55716476f5d0 0x55716476fa10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2960009c00 tx=0x7f2960011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d87db78ce947a450 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:33.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.533+0000 7f294ffff640 1 -- 172.21.15.2:0/2033116233 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2960004230 con 0x55716476f5d0 2024-09-19T06:16:33.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.534+0000 7f294ffff640 1 -- 172.21.15.2:0/2033116233 <== mon.2 v2:172.21.15.89:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f29600043d0 con 0x55716476f5d0 2024-09-19T06:16:33.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.534+0000 7f294ffff640 1 -- 172.21.15.2:0/2033116233 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2960004c60 con 0x55716476f5d0 2024-09-19T06:16:33.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.534+0000 7f296e198740 1 -- 172.21.15.2:0/2033116233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55716476f5d0 msgr2=0x55716476fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:33.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.534+0000 7f296e198740 1 --2- 172.21.15.2:0/2033116233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55716476f5d0 0x55716476fa10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2960009c00 tx=0x7f2960011810 comp rx=0 tx=0).stop 2024-09-19T06:16:33.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.534+0000 7f296e198740 1 -- 172.21.15.2:0/2033116233 shutdown_connections 2024-09-19T06:16:33.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.534+0000 7f296e198740 1 --2- 172.21.15.2:0/2033116233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55716477a370 0x55716477c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:33.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.534+0000 7f296e198740 1 --2- 172.21.15.2:0/2033116233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55716476f5d0 0x55716476fa10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:33.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.534+0000 7f296e198740 1 --2- 172.21.15.2:0/2033116233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557164770b40 0x55716476f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:33.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.534+0000 7f296e198740 1 -- 172.21.15.2:0/2033116233 >> 172.21.15.2:0/2033116233 conn(0x557164738310 msgr2=0x55716476bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:33.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.534+0000 7f296e198740 1 -- 172.21.15.2:0/2033116233 shutdown_connections 2024-09-19T06:16:33.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.534+0000 7f296e198740 1 -- 172.21.15.2:0/2033116233 wait complete. 2024-09-19T06:16:33.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.535+0000 7f296e198740 1 -- start start 2024-09-19T06:16:33.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.535+0000 7f296e198740 1 Processor -- start 2024-09-19T06:16:33.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.535+0000 7f296e198740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55716476f5d0 0x557164779ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:33.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.535+0000 7f296e198740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557164770b40 0x557164776f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:33.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.535+0000 7f296e198740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55716477a370 0x557164777490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:33.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.535+0000 7f296e198740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55716477d070 con 0x55716477a370 2024-09-19T06:16:33.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.535+0000 7f296e198740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x557164690060 con 0x557164770b40 2024-09-19T06:16:33.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.535+0000 7f296e198740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55716477d1f0 con 0x55716476f5d0 2024-09-19T06:16:33.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.535+0000 7f296e198740 10 client.0 _ll_register_callbacks cb 0x5571643e38c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:33.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.535+0000 7f296a35c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55716477a370 0x557164777490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:33.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.535+0000 7f296a35c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55716477a370 0x557164777490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45592/0 (socket says 172.21.15.2:45592) 2024-09-19T06:16:33.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.535+0000 7f296a35c640 1 -- 172.21.15.2:0/924450034 learned_addr learned my addr 172.21.15.2:0/924450034 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:33.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.535+0000 7f296a35c640 1 --2- 172.21.15.2:0/924450034 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55716476f5d0 0x557164779ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:33.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.536+0000 7f2969b5b640 1 --2- 172.21.15.2:0/924450034 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557164770b40 0x557164776f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:33.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.536+0000 7f296a35c640 1 -- 172.21.15.2:0/924450034 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55716476f5d0 msgr2=0x557164779ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:33.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.536+0000 7f296a35c640 1 --2- 172.21.15.2:0/924450034 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55716476f5d0 0x557164779ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:33.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.536+0000 7f296a35c640 1 -- 172.21.15.2:0/924450034 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557164770b40 msgr2=0x557164776f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:33.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.536+0000 7f296a35c640 1 --2- 172.21.15.2:0/924450034 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557164770b40 0x557164776f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:33.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.536+0000 7f296a35c640 1 -- 172.21.15.2:0/924450034 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571644463c0 con 0x55716477a370 2024-09-19T06:16:33.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.536+0000 7f296a35c640 1 --2- 172.21.15.2:0/924450034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55716477a370 0x557164777490 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f295c02f7f0 tx=0x7f295c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2683ffb62e02b76a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:33.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.536+0000 7f294d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:16:33.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.536+0000 7f294d7fa640 1 -- 172.21.15.2:0/924450034 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f295c034070 con 0x55716477a370 2024-09-19T06:16:33.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.536+0000 7f294d7fa640 1 -- 172.21.15.2:0/924450034 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f295c004040 con 0x55716477a370 2024-09-19T06:16:33.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.536+0000 7f296e198740 1 -- 172.21.15.2:0/924450034 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29600043d0 con 0x55716477a370 2024-09-19T06:16:33.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.536+0000 7f294d7fa640 1 -- 172.21.15.2:0/924450034 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f295c043070 con 0x55716477a370 2024-09-19T06:16:33.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.536+0000 7f296e198740 10 client.15738 fetch_fsmap learned FSMap version 26 2024-09-19T06:16:33.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.536+0000 7f296e198740 1 -- 172.21.15.2:0/924450034 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557164788a90 con 0x55716477a370 2024-09-19T06:16:33.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.537+0000 7f294d7fa640 1 -- 172.21.15.2:0/924450034 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f29600043d0 con 0x55716477a370 2024-09-19T06:16:33.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.537+0000 7f294d7fa640 1 -- 172.21.15.2:0/924450034 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f295c049070 con 0x55716477a370 2024-09-19T06:16:33.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.537+0000 7f296e198740 10 client.15738 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:16:33.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.537+0000 7f296e198740 10 client.15738 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:16:33.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.537+0000 7f296e198740 20 client.15738 populate_metadata read hostname 'smithi002' 2024-09-19T06:16:33.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.537+0000 7f296e198740 1 --2- 172.21.15.2:0/924450034 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x557164789ea0 0x55716478c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:33.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.537+0000 7f296e198740 4 client.15738 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:16:33.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.537+0000 7f296e198740 1 -- 172.21.15.2:0/924450034 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5571646e2860 con 0x557164789ea0 2024-09-19T06:16:33.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.537+0000 7f2969b5b640 1 --2- 172.21.15.2:0/924450034 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x557164789ea0 0x55716478c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:33.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.538+0000 7f2969b5b640 1 --2- 172.21.15.2:0/924450034 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x557164789ea0 0x55716478c290 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ccc21dfd8578c64c server_cookie=5cf7890c0ab0276d in_seq=0 out_seq=0 2024-09-19T06:16:33.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.538+0000 7f294d7fa640 10 client.15738 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:16:33.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.538+0000 7f294d7fa640 1 -- 172.21.15.2:0/924450034 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5571646e2860 con 0x557164789ea0 2024-09-19T06:16:33.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.538+0000 7f294d7fa640 10 client.15738 handle_command_reply: tid=0 2024-09-19T06:16:33.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.538+0000 7f296e198740 1 client.15738 shutdown 2024-09-19T06:16:33.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.539+0000 7f296e198740 1 -- 172.21.15.2:0/924450034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55716477a370 msgr2=0x557164777490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:33.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.539+0000 7f296e198740 1 --2- 172.21.15.2:0/924450034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55716477a370 0x557164777490 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f295c02f7f0 tx=0x7f295c004a40 comp rx=0 tx=0).stop 2024-09-19T06:16:33.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.539+0000 7f296e198740 1 -- 172.21.15.2:0/924450034 shutdown_connections 2024-09-19T06:16:33.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.539+0000 7f296e198740 1 --2- 172.21.15.2:0/924450034 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x557164789ea0 0x55716478c290 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:33.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.539+0000 7f296e198740 1 --2- 172.21.15.2:0/924450034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55716477a370 0x557164777490 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:33.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.539+0000 7f296e198740 1 --2- 172.21.15.2:0/924450034 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557164770b40 0x557164776f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:33.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.539+0000 7f296e198740 1 --2- 172.21.15.2:0/924450034 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55716476f5d0 0x557164779ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:33.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.539+0000 7f294d7fa640 0 client.15738 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:16:33.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.539+0000 7f296e198740 1 -- 172.21.15.2:0/924450034 >> 172.21.15.2:0/924450034 conn(0x557164738310 msgr2=0x557164771930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:33.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.539+0000 7f296e198740 1 -- 172.21.15.2:0/924450034 shutdown_connections 2024-09-19T06:16:33.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.539+0000 7f296e198740 1 -- 172.21.15.2:0/924450034 wait complete. 2024-09-19T06:16:33.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.539+0000 7f296e198740 20 client.15738 trim_cache size 0 max 16384 2024-09-19T06:16:33.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.552+0000 7f296e198740 1 Processor -- start 2024-09-19T06:16:33.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.552+0000 7f296e198740 1 -- start start 2024-09-19T06:16:33.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.552+0000 7f296e198740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55716476f5d0 0x557164786340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:33.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.552+0000 7f296e198740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557164770b40 0x55716477c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:33.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.552+0000 7f296e198740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55716477a370 0x55716477b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:33.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.552+0000 7f296e198740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f29641b2210 con 0x557164770b40 2024-09-19T06:16:33.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.552+0000 7f296e198740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f29641afae0 con 0x55716477a370 2024-09-19T06:16:33.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.552+0000 7f296e198740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f29641ad930 con 0x55716476f5d0 2024-09-19T06:16:33.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.552+0000 7f2969b5b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557164770b40 0x55716477c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:33.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.552+0000 7f2969b5b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557164770b40 0x55716477c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45608/0 (socket says 172.21.15.2:45608) 2024-09-19T06:16:33.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.552+0000 7f2969b5b640 1 -- 172.21.15.2:0/558662486 learned_addr learned my addr 172.21.15.2:0/558662486 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:33.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.552+0000 7f296a35c640 1 --2- 172.21.15.2:0/558662486 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55716476f5d0 0x557164786340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:33.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.552+0000 7f296a35c640 1 --2- 172.21.15.2:0/558662486 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55716477a370 0x55716477b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:33.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.552+0000 7f2969b5b640 1 -- 172.21.15.2:0/558662486 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55716476f5d0 msgr2=0x557164786340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:33.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.552+0000 7f2969b5b640 1 --2- 172.21.15.2:0/558662486 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55716476f5d0 0x557164786340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:33.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.552+0000 7f2969b5b640 1 -- 172.21.15.2:0/558662486 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55716477a370 msgr2=0x55716477b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:33.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.552+0000 7f2969b5b640 1 --2- 172.21.15.2:0/558662486 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55716477a370 0x55716477b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:33.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.552+0000 7f2969b5b640 1 -- 172.21.15.2:0/558662486 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55716478c8f0 con 0x557164770b40 2024-09-19T06:16:33.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.553+0000 7f2969b5b640 1 --2- 172.21.15.2:0/558662486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557164770b40 0x55716477c3d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f2960011d10 tx=0x7f29600045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c1a00958dd262d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:33.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.553+0000 7f294f7fe640 1 -- 172.21.15.2:0/558662486 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f296001e040 con 0x557164770b40 2024-09-19T06:16:33.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.553+0000 7f294f7fe640 1 -- 172.21.15.2:0/558662486 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f296001f040 con 0x557164770b40 2024-09-19T06:16:33.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.553+0000 7f294f7fe640 1 -- 172.21.15.2:0/558662486 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2960019760 con 0x557164770b40 2024-09-19T06:16:33.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.553+0000 7f296e198740 1 -- 172.21.15.2:0/558662486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557164770b40 msgr2=0x55716477c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:33.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.553+0000 7f296e198740 1 --2- 172.21.15.2:0/558662486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557164770b40 0x55716477c3d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f2960011d10 tx=0x7f29600045e0 comp rx=0 tx=0).stop 2024-09-19T06:16:33.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.553+0000 7f296e198740 1 -- 172.21.15.2:0/558662486 shutdown_connections 2024-09-19T06:16:33.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.553+0000 7f296e198740 1 --2- 172.21.15.2:0/558662486 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55716477a370 0x55716477b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:33.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.553+0000 7f296e198740 1 --2- 172.21.15.2:0/558662486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557164770b40 0x55716477c3d0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:33.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.553+0000 7f296e198740 1 --2- 172.21.15.2:0/558662486 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55716476f5d0 0x557164786340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:33.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.553+0000 7f296e198740 1 -- 172.21.15.2:0/558662486 >> 172.21.15.2:0/558662486 conn(0x557164738310 msgr2=0x557164776f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:33.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.554+0000 7f296e198740 1 -- 172.21.15.2:0/558662486 shutdown_connections 2024-09-19T06:16:33.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.554+0000 7f296e198740 1 -- 172.21.15.2:0/558662486 wait complete. 2024-09-19T06:16:33.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.554+0000 7f296e198740 1 -- start start 2024-09-19T06:16:33.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.554+0000 7f296e198740 1 Processor -- start 2024-09-19T06:16:33.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.554+0000 7f296e198740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55716476f5d0 0x557164782b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:33.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.554+0000 7f296e198740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557164770b40 0x557164780660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:33.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.554+0000 7f296e198740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55716477a370 0x557164780ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:33.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.554+0000 7f296e198740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f29641adfa0 con 0x557164770b40 2024-09-19T06:16:33.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.554+0000 7f296e198740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f29641af410 con 0x55716477a370 2024-09-19T06:16:33.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.554+0000 7f296e198740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f29641ae670 con 0x55716476f5d0 2024-09-19T06:16:33.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.554+0000 7f296e198740 10 client.0 _ll_register_callbacks cb 0x7f295c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:33.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.554+0000 7f2969b5b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557164770b40 0x557164780660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:33.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.555+0000 7f2969b5b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557164770b40 0x557164780660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45618/0 (socket says 172.21.15.2:45618) 2024-09-19T06:16:33.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.555+0000 7f2969b5b640 1 -- 172.21.15.2:0/2001154844 learned_addr learned my addr 172.21.15.2:0/2001154844 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:33.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.555+0000 7f296a35c640 1 --2- 172.21.15.2:0/2001154844 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55716477a370 0x557164780ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:33.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.555+0000 7f296a35c640 1 --2- 172.21.15.2:0/2001154844 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55716476f5d0 0x557164782b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:33.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.555+0000 7f2969b5b640 1 -- 172.21.15.2:0/2001154844 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55716476f5d0 msgr2=0x557164782b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:33.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.555+0000 7f2969b5b640 1 --2- 172.21.15.2:0/2001154844 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55716476f5d0 0x557164782b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:33.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.555+0000 7f2969b5b640 1 -- 172.21.15.2:0/2001154844 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55716477a370 msgr2=0x557164780ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:33.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.555+0000 7f2969b5b640 1 --2- 172.21.15.2:0/2001154844 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55716477a370 0x557164780ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:33.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.555+0000 7f2969b5b640 1 -- 172.21.15.2:0/2001154844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571647813d0 con 0x557164770b40 2024-09-19T06:16:33.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.555+0000 7f296a35c640 1 --2- 172.21.15.2:0/2001154844 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55716476f5d0 0x557164782b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:16:33.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.555+0000 7f2969b5b640 1 --2- 172.21.15.2:0/2001154844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557164770b40 0x557164780660 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2960009bd0 tx=0x7f2960005b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee8c26e42c6db0bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:33.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.555+0000 7f294d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:16:33.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.555+0000 7f294d7fa640 1 -- 172.21.15.2:0/2001154844 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2960004850 con 0x557164770b40 2024-09-19T06:16:33.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.555+0000 7f294d7fa640 1 -- 172.21.15.2:0/2001154844 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f29600049f0 con 0x557164770b40 2024-09-19T06:16:33.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.555+0000 7f296e198740 1 -- 172.21.15.2:0/2001154844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f296001f040 con 0x557164770b40 2024-09-19T06:16:33.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.555+0000 7f294d7fa640 1 -- 172.21.15.2:0/2001154844 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2960004c10 con 0x557164770b40 2024-09-19T06:16:33.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.555+0000 7f296e198740 10 client.15744 fetch_fsmap learned FSMap version 26 2024-09-19T06:16:33.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.555+0000 7f296e198740 1 -- 172.21.15.2:0/2001154844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5571647f4af0 con 0x557164770b40 2024-09-19T06:16:33.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.556+0000 7f294d7fa640 1 -- 172.21.15.2:0/2001154844 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f296001f040 con 0x557164770b40 2024-09-19T06:16:33.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.556+0000 7f294d7fa640 1 -- 172.21.15.2:0/2001154844 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f2960024040 con 0x557164770b40 2024-09-19T06:16:33.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.556+0000 7f296e198740 10 client.15744 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:16:33.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.556+0000 7f296e198740 10 client.15744 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:16:33.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.556+0000 7f296e198740 20 client.15744 populate_metadata read hostname 'smithi002' 2024-09-19T06:16:33.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.556+0000 7f296e198740 1 --2- 172.21.15.2:0/2001154844 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5571647f4f60 0x5571647f7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:33.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.556+0000 7f296e198740 4 client.15744 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:16:33.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.556+0000 7f296e198740 1 -- 172.21.15.2:0/2001154844 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5571646dcd70 con 0x5571647f4f60 2024-09-19T06:16:33.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.556+0000 7f296a35c640 1 --2- 172.21.15.2:0/2001154844 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5571647f4f60 0x5571647f7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:33.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.557+0000 7f296a35c640 1 --2- 172.21.15.2:0/2001154844 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5571647f4f60 0x5571647f7350 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=499a8cea5cca0d62 server_cookie=5d29a3163c7f0e2a in_seq=0 out_seq=0 2024-09-19T06:16:33.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.557+0000 7f294d7fa640 10 client.15744 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:16:33.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.557+0000 7f294d7fa640 1 -- 172.21.15.2:0/2001154844 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5571646dcd70 con 0x5571647f4f60 2024-09-19T06:16:33.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.557+0000 7f294d7fa640 10 client.15744 handle_command_reply: tid=0 2024-09-19T06:16:33.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.557+0000 7f296e198740 1 client.15744 shutdown 2024-09-19T06:16:33.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.557+0000 7f296e198740 1 -- 172.21.15.2:0/2001154844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557164770b40 msgr2=0x557164780660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:33.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.557+0000 7f296e198740 1 --2- 172.21.15.2:0/2001154844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557164770b40 0x557164780660 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2960009bd0 tx=0x7f2960005b40 comp rx=0 tx=0).stop 2024-09-19T06:16:33.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.557+0000 7f296e198740 1 -- 172.21.15.2:0/2001154844 shutdown_connections 2024-09-19T06:16:33.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.557+0000 7f296e198740 1 --2- 172.21.15.2:0/2001154844 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5571647f4f60 0x5571647f7350 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:33.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.557+0000 7f296e198740 1 --2- 172.21.15.2:0/2001154844 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55716477a370 0x557164780ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:33.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.557+0000 7f296e198740 1 --2- 172.21.15.2:0/2001154844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557164770b40 0x557164780660 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:33.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.557+0000 7f294d7fa640 0 client.15744 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:16:33.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.557+0000 7f296e198740 1 --2- 172.21.15.2:0/2001154844 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55716476f5d0 0x557164782b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:33.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.557+0000 7f296e198740 1 -- 172.21.15.2:0/2001154844 >> 172.21.15.2:0/2001154844 conn(0x557164738310 msgr2=0x5571647756b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:33.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.557+0000 7f296e198740 1 -- 172.21.15.2:0/2001154844 shutdown_connections 2024-09-19T06:16:33.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.557+0000 7f296e198740 1 -- 172.21.15.2:0/2001154844 wait complete. 2024-09-19T06:16:33.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.557+0000 7f296e198740 20 client.15744 trim_cache size 0 max 16384 2024-09-19T06:16:33.565 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:16:33.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.558+0000 7f296bdbf640 1 -- 172.21.15.2:0/3645932504 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f29500a33b0 msgr2=0x7f29500a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:33.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.558+0000 7f296bdbf640 1 --2- 172.21.15.2:0/3645932504 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f29500a33b0 0x7f29500a5870 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f29540cd270 tx=0x7f2954097950 comp rx=0 tx=0).stop 2024-09-19T06:16:33.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.558+0000 7f296bdbf640 1 -- 172.21.15.2:0/3645932504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2964103660 msgr2=0x7f2964100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:33.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.558+0000 7f296bdbf640 1 --2- 172.21.15.2:0/3645932504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2964103660 0x7f2964100ee0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f295400c970 tx=0x7f295400ce30 comp rx=0 tx=0).stop 2024-09-19T06:16:33.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.558+0000 7f296bdbf640 1 -- 172.21.15.2:0/3645932504 shutdown_connections 2024-09-19T06:16:33.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.558+0000 7f296bdbf640 1 --2- 172.21.15.2:0/3645932504 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f29500a33b0 0x7f29500a5870 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:33.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.558+0000 7f296bdbf640 1 --2- 172.21.15.2:0/3645932504 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f296410c170 0x7f2964101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:33.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.558+0000 7f296bdbf640 1 --2- 172.21.15.2:0/3645932504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2964103660 0x7f2964100ee0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:33.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.558+0000 7f296bdbf640 1 --2- 172.21.15.2:0/3645932504 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2964102d40 0x7f29641009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:33.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.558+0000 7f296bdbf640 1 -- 172.21.15.2:0/3645932504 >> 172.21.15.2:0/3645932504 conn(0x7f29640fc7a0 msgr2=0x7f29640fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:33.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.558+0000 7f296bdbf640 1 -- 172.21.15.2:0/3645932504 shutdown_connections 2024-09-19T06:16:33.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:33.558+0000 7f296bdbf640 1 -- 172.21.15.2:0/3645932504 wait complete. 2024-09-19T06:16:33.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:33 smithi002 ceph-mon[30982]: pgmap v55: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 71 MiB/s wr, 24 op/s 2024-09-19T06:16:33.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:33 smithi090 ceph-mon[34497]: pgmap v55: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 71 MiB/s wr, 24 op/s 2024-09-19T06:16:33.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:33 smithi089 ceph-mon[34160]: pgmap v55: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 71 MiB/s wr, 24 op/s 2024-09-19T06:16:34.154 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:16:34.413 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:16:34.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.867+0000 7f5765e18640 1 -- 172.21.15.2:0/2969391457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5760106f10 msgr2=0x7f576010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:34.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.867+0000 7f5765e18640 1 --2- 172.21.15.2:0/2969391457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5760106f10 0x7f576010ea90 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f5758009ca0 tx=0x7f575802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:16:34.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.867+0000 7f5765e18640 1 -- 172.21.15.2:0/2969391457 shutdown_connections 2024-09-19T06:16:34.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.867+0000 7f5765e18640 1 --2- 172.21.15.2:0/2969391457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5760106f10 0x7f576010ea90 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:34.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.867+0000 7f5765e18640 1 --2- 172.21.15.2:0/2969391457 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5760102790 0x7f57601067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:34.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.867+0000 7f5765e18640 1 --2- 172.21.15.2:0/2969391457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5760101de0 0x7f57601021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:34.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.867+0000 7f5765e18640 1 -- 172.21.15.2:0/2969391457 >> 172.21.15.2:0/2969391457 conn(0x7f57600fd8c0 msgr2=0x7f57600ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:34.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.867+0000 7f5765e18640 1 -- 172.21.15.2:0/2969391457 shutdown_connections 2024-09-19T06:16:34.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.867+0000 7f5765e18640 1 -- 172.21.15.2:0/2969391457 wait complete. 2024-09-19T06:16:34.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.868+0000 7f5765e18640 1 Processor -- start 2024-09-19T06:16:34.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.868+0000 7f5765e18640 1 -- start start 2024-09-19T06:16:34.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.868+0000 7f5765e18640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5760101de0 0x7f576019a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:34.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.868+0000 7f5765e18640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5760102790 0x7f576019aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:34.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.868+0000 7f5765e18640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5760106f10 0x7f576019ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:34.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.868+0000 7f5765e18640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5760111e70 con 0x7f5760102790 2024-09-19T06:16:34.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.868+0000 7f5765e18640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f5760111cf0 con 0x7f5760101de0 2024-09-19T06:16:34.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.868+0000 7f5765e18640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5760111ff0 con 0x7f5760106f10 2024-09-19T06:16:34.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.868+0000 7f575effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5760102790 0x7f576019aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:34.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.868+0000 7f575effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5760102790 0x7f576019aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45634/0 (socket says 172.21.15.2:45634) 2024-09-19T06:16:34.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.868+0000 7f575effd640 1 -- 172.21.15.2:0/2696346809 learned_addr learned my addr 172.21.15.2:0/2696346809 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:34.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.869+0000 7f575ffff640 1 --2- 172.21.15.2:0/2696346809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5760106f10 0x7f576019ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:34.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.869+0000 7f575f7fe640 1 --2- 172.21.15.2:0/2696346809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5760101de0 0x7f576019a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:34.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.869+0000 7f575effd640 1 -- 172.21.15.2:0/2696346809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5760106f10 msgr2=0x7f576019ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:34.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.869+0000 7f575effd640 1 --2- 172.21.15.2:0/2696346809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5760106f10 0x7f576019ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:34.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.869+0000 7f575effd640 1 -- 172.21.15.2:0/2696346809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5760101de0 msgr2=0x7f576019a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:34.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.869+0000 7f575effd640 1 --2- 172.21.15.2:0/2696346809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5760101de0 0x7f576019a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:34.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.869+0000 7f575effd640 1 -- 172.21.15.2:0/2696346809 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f576019f4c0 con 0x7f5760102790 2024-09-19T06:16:34.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.869+0000 7f575f7fe640 1 --2- 172.21.15.2:0/2696346809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5760101de0 0x7f576019a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:16:34.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.869+0000 7f575effd640 1 --2- 172.21.15.2:0/2696346809 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5760102790 0x7f576019aa50 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f575400d770 tx=0x7f575400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:34.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.869+0000 7f575cff9640 1 -- 172.21.15.2:0/2696346809 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5754017070 con 0x7f5760102790 2024-09-19T06:16:34.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.869+0000 7f575cff9640 1 -- 172.21.15.2:0/2696346809 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f57540054d0 con 0x7f5760102790 2024-09-19T06:16:34.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.869+0000 7f5765e18640 1 -- 172.21.15.2:0/2696346809 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f576019f7b0 con 0x7f5760102790 2024-09-19T06:16:34.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.869+0000 7f575cff9640 1 -- 172.21.15.2:0/2696346809 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5754004cf0 con 0x7f5760102790 2024-09-19T06:16:34.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.869+0000 7f5765e18640 1 -- 172.21.15.2:0/2696346809 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57601a7090 con 0x7f5760102790 2024-09-19T06:16:34.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.871+0000 7f575cff9640 1 -- 172.21.15.2:0/2696346809 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f5754004e90 con 0x7f5760102790 2024-09-19T06:16:34.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.872+0000 7f57681f1740 1 Processor -- start 2024-09-19T06:16:34.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.872+0000 7f57681f1740 1 -- start start 2024-09-19T06:16:34.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.872+0000 7f57681f1740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653ac273b40 0x5653ac272090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:34.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.872+0000 7f57681f1740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5653ac2725d0 0x5653ac272a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:34.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.872+0000 7f57681f1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653ac27d370 0x5653ac27f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:34.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.872+0000 7f57681f1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5653ac1d82f0 con 0x5653ac27d370 2024-09-19T06:16:34.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.872+0000 7f57681f1740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5653ac17fcf0 con 0x5653ac273b40 2024-09-19T06:16:34.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.872+0000 7f57681f1740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5653ac1d42b0 con 0x5653ac2725d0 2024-09-19T06:16:34.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.872+0000 7f575cff9640 1 --2- 172.21.15.2:0/2696346809 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f57480a33b0 0x7f57480a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:34.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.872+0000 7f575effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653ac27d370 0x5653ac27f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:34.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.872+0000 7f575effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653ac27d370 0x5653ac27f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45644/0 (socket says 172.21.15.2:45644) 2024-09-19T06:16:34.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.872+0000 7f575effd640 1 -- 172.21.15.2:0/2023551569 learned_addr learned my addr 172.21.15.2:0/2023551569 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:34.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.872+0000 7f575f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5653ac2725d0 0x5653ac272a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:34.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.872+0000 7f575ffff640 1 --2- 172.21.15.2:0/2023551569 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653ac273b40 0x5653ac272090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:34.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.872+0000 7f575ffff640 1 --2- 172.21.15.2:0/2696346809 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f57480a33b0 0x7f57480a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:34.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.873+0000 7f575cff9640 1 -- 172.21.15.2:0/2696346809 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f57540cf6c0 con 0x7f5760102790 2024-09-19T06:16:34.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.873+0000 7f575f7fe640 1 -- 172.21.15.2:0/2023551569 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653ac273b40 msgr2=0x5653ac272090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:34.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.873+0000 7f575f7fe640 1 --2- 172.21.15.2:0/2023551569 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653ac273b40 0x5653ac272090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:34.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.873+0000 7f575f7fe640 1 -- 172.21.15.2:0/2023551569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653ac27d370 msgr2=0x5653ac27f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:34.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.873+0000 7f575f7fe640 1 --2- 172.21.15.2:0/2023551569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653ac27d370 0x5653ac27f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:34.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.873+0000 7f575f7fe640 1 -- 172.21.15.2:0/2023551569 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653ac1643a0 con 0x5653ac2725d0 2024-09-19T06:16:34.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.873+0000 7f575f7fe640 1 --2- 172.21.15.2:0/2023551569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5653ac2725d0 0x5653ac272a10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5750008b80 tx=0x7f575000e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d909b8e8b688ae9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:34.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.873+0000 7f575ffff640 1 --2- 172.21.15.2:0/2696346809 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f57480a33b0 0x7f57480a5870 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5758006010 tx=0x7f5758004a60 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:34.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.873+0000 7f5745ffb640 1 -- 172.21.15.2:0/2023551569 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5750014070 con 0x5653ac2725d0 2024-09-19T06:16:34.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.873+0000 7f5745ffb640 1 -- 172.21.15.2:0/2023551569 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f57500047a0 con 0x5653ac2725d0 2024-09-19T06:16:34.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.873+0000 7f5745ffb640 1 -- 172.21.15.2:0/2023551569 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5750010670 con 0x5653ac2725d0 2024-09-19T06:16:34.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.874+0000 7f57681f1740 1 -- 172.21.15.2:0/2023551569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5653ac2725d0 msgr2=0x5653ac272a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:34.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.874+0000 7f57681f1740 1 --2- 172.21.15.2:0/2023551569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5653ac2725d0 0x5653ac272a10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5750008b80 tx=0x7f575000e720 comp rx=0 tx=0).stop 2024-09-19T06:16:34.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.874+0000 7f57681f1740 1 -- 172.21.15.2:0/2023551569 shutdown_connections 2024-09-19T06:16:34.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.874+0000 7f57681f1740 1 --2- 172.21.15.2:0/2023551569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653ac27d370 0x5653ac27f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:34.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.874+0000 7f57681f1740 1 --2- 172.21.15.2:0/2023551569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5653ac2725d0 0x5653ac272a10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:34.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.874+0000 7f57681f1740 1 --2- 172.21.15.2:0/2023551569 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653ac273b40 0x5653ac272090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:34.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.874+0000 7f57681f1740 1 -- 172.21.15.2:0/2023551569 >> 172.21.15.2:0/2023551569 conn(0x5653ac23b310 msgr2=0x5653ac26ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:34.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.874+0000 7f57681f1740 1 -- 172.21.15.2:0/2023551569 shutdown_connections 2024-09-19T06:16:34.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.874+0000 7f57681f1740 1 -- 172.21.15.2:0/2023551569 wait complete. 2024-09-19T06:16:34.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.874+0000 7f57681f1740 1 -- start start 2024-09-19T06:16:34.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.875+0000 7f57681f1740 1 Processor -- start 2024-09-19T06:16:34.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.875+0000 7f57681f1740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5653ac2725d0 0x5653ac27cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:34.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.875+0000 7f57681f1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653ac273b40 0x5653ac279f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:34.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.875+0000 7f57681f1740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653ac27d370 0x5653ac27a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:34.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.875+0000 7f57681f1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5653ac280070 con 0x5653ac273b40 2024-09-19T06:16:34.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.875+0000 7f57681f1740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5653ac193060 con 0x5653ac27d370 2024-09-19T06:16:34.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.875+0000 7f57681f1740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5653ac2801f0 con 0x5653ac2725d0 2024-09-19T06:16:34.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.875+0000 7f57681f1740 10 client.0 _ll_register_callbacks cb 0x5653abee68c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:34.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.875+0000 7f575effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653ac273b40 0x5653ac279f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:34.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.875+0000 7f575effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653ac273b40 0x5653ac279f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45652/0 (socket says 172.21.15.2:45652) 2024-09-19T06:16:34.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.875+0000 7f575effd640 1 -- 172.21.15.2:0/1538579245 learned_addr learned my addr 172.21.15.2:0/1538579245 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:34.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.875+0000 7f575ffff640 1 --2- 172.21.15.2:0/1538579245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653ac27d370 0x5653ac27a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:34.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.875+0000 7f575f7fe640 1 --2- 172.21.15.2:0/1538579245 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5653ac2725d0 0x5653ac27cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:34.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.875+0000 7f575effd640 1 -- 172.21.15.2:0/1538579245 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5653ac2725d0 msgr2=0x5653ac27cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:34.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.875+0000 7f575effd640 1 --2- 172.21.15.2:0/1538579245 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5653ac2725d0 0x5653ac27cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:34.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.875+0000 7f575effd640 1 -- 172.21.15.2:0/1538579245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653ac27d370 msgr2=0x5653ac27a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:34.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.875+0000 7f575effd640 1 --2- 172.21.15.2:0/1538579245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653ac27d370 0x5653ac27a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:34.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.875+0000 7f575effd640 1 -- 172.21.15.2:0/1538579245 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653abf493c0 con 0x5653ac273b40 2024-09-19T06:16:34.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.876+0000 7f575effd640 1 --2- 172.21.15.2:0/1538579245 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653ac273b40 0x5653ac279f90 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f575409b960 tx=0x7f5754005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=add6829784d805cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:34.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.876+0000 7f573effd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:16:34.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.876+0000 7f573effd640 1 -- 172.21.15.2:0/1538579245 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5754020040 con 0x5653ac273b40 2024-09-19T06:16:34.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.876+0000 7f573effd640 1 -- 172.21.15.2:0/1538579245 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f5754098040 con 0x5653ac273b40 2024-09-19T06:16:34.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.876+0000 7f57681f1740 1 -- 172.21.15.2:0/1538579245 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57500047a0 con 0x5653ac273b40 2024-09-19T06:16:34.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.876+0000 7f573effd640 1 -- 172.21.15.2:0/1538579245 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5754005180 con 0x5653ac273b40 2024-09-19T06:16:34.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.876+0000 7f57681f1740 10 client.15756 fetch_fsmap learned FSMap version 26 2024-09-19T06:16:34.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.876+0000 7f57681f1740 1 -- 172.21.15.2:0/1538579245 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5653ac28bad0 con 0x5653ac273b40 2024-09-19T06:16:34.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.876+0000 7f573effd640 1 -- 172.21.15.2:0/1538579245 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f57500047a0 con 0x5653ac273b40 2024-09-19T06:16:34.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.876+0000 7f573effd640 1 -- 172.21.15.2:0/1538579245 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f57540cfb70 con 0x5653ac273b40 2024-09-19T06:16:34.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.876+0000 7f57681f1740 10 client.15756 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:16:34.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.876+0000 7f57681f1740 10 client.15756 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:34.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.876+0000 7f57681f1740 20 client.15756 populate_metadata read hostname 'smithi002' 2024-09-19T06:16:34.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.876+0000 7f57681f1740 1 --2- 172.21.15.2:0/1538579245 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5653ac28cfe0 0x5653ac28f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:34.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.876+0000 7f57681f1740 4 client.15756 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:16:34.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.876+0000 7f57681f1740 1 -- 172.21.15.2:0/1538579245 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5653ac1e5860 con 0x5653ac28cfe0 2024-09-19T06:16:34.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.877+0000 7f575f7fe640 1 --2- 172.21.15.2:0/1538579245 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5653ac28cfe0 0x5653ac28f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:34.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.877+0000 7f575f7fe640 1 --2- 172.21.15.2:0/1538579245 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5653ac28cfe0 0x5653ac28f3f0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=892c0763ae846582 server_cookie=c7aea0a894b40785 in_seq=0 out_seq=0 2024-09-19T06:16:34.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.877+0000 7f573effd640 10 client.15756 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:34.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.878+0000 7f573effd640 1 -- 172.21.15.2:0/1538579245 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5653ac1e5860 con 0x5653ac28cfe0 2024-09-19T06:16:34.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.878+0000 7f573effd640 10 client.15756 handle_command_reply: tid=0 2024-09-19T06:16:34.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.878+0000 7f57681f1740 1 client.15756 shutdown 2024-09-19T06:16:34.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.878+0000 7f57681f1740 1 -- 172.21.15.2:0/1538579245 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653ac273b40 msgr2=0x5653ac279f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:34.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.878+0000 7f57681f1740 1 --2- 172.21.15.2:0/1538579245 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653ac273b40 0x5653ac279f90 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f575409b960 tx=0x7f5754005740 comp rx=0 tx=0).stop 2024-09-19T06:16:34.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.878+0000 7f57681f1740 1 -- 172.21.15.2:0/1538579245 shutdown_connections 2024-09-19T06:16:34.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.878+0000 7f57681f1740 1 --2- 172.21.15.2:0/1538579245 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5653ac28cfe0 0x5653ac28f3f0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:34.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.878+0000 7f57681f1740 1 --2- 172.21.15.2:0/1538579245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653ac27d370 0x5653ac27a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:34.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.878+0000 7f573effd640 0 client.15756 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:34.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.878+0000 7f57681f1740 1 --2- 172.21.15.2:0/1538579245 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653ac273b40 0x5653ac279f90 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:34.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.878+0000 7f57681f1740 1 --2- 172.21.15.2:0/1538579245 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5653ac2725d0 0x5653ac27cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:34.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.878+0000 7f57681f1740 1 -- 172.21.15.2:0/1538579245 >> 172.21.15.2:0/1538579245 conn(0x5653ac23b310 msgr2=0x5653ac274960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:34.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.878+0000 7f57681f1740 1 -- 172.21.15.2:0/1538579245 shutdown_connections 2024-09-19T06:16:34.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.878+0000 7f57681f1740 1 -- 172.21.15.2:0/1538579245 wait complete. 2024-09-19T06:16:34.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.878+0000 7f57681f1740 20 client.15756 trim_cache size 0 max 16384 2024-09-19T06:16:34.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.891+0000 7f57681f1740 1 Processor -- start 2024-09-19T06:16:34.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.891+0000 7f57681f1740 1 -- start start 2024-09-19T06:16:34.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.891+0000 7f57681f1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653ac2725d0 0x5653ac289310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:34.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.891+0000 7f57681f1740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653ac273b40 0x5653ac26e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:34.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.891+0000 7f57681f1740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5653ac27d370 0x5653ac27e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:34.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.891+0000 7f57681f1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f57601b20b0 con 0x5653ac2725d0 2024-09-19T06:16:34.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.891+0000 7f57681f1740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f57601af980 con 0x5653ac273b40 2024-09-19T06:16:34.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.891+0000 7f57681f1740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f57601ad7d0 con 0x5653ac27d370 2024-09-19T06:16:34.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.891+0000 7f575f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653ac2725d0 0x5653ac289310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:34.920 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:16:34.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.891+0000 7f575f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653ac2725d0 0x5653ac289310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45660/0 (socket says 172.21.15.2:45660) 2024-09-19T06:16:34.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.891+0000 7f575f7fe640 1 -- 172.21.15.2:0/1828751360 learned_addr learned my addr 172.21.15.2:0/1828751360 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:34.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.891+0000 7f575f7fe640 1 -- 172.21.15.2:0/1828751360 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5653ac27d370 msgr2=0x5653ac27e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:34.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.891+0000 7f575f7fe640 1 --2- 172.21.15.2:0/1828751360 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5653ac27d370 0x5653ac27e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:34.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.891+0000 7f575f7fe640 1 -- 172.21.15.2:0/1828751360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653ac273b40 msgr2=0x5653ac26e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:34.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.891+0000 7f575f7fe640 1 --2- 172.21.15.2:0/1828751360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653ac273b40 0x5653ac26e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:34.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.891+0000 7f575f7fe640 1 -- 172.21.15.2:0/1828751360 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653ac26eed0 con 0x5653ac2725d0 2024-09-19T06:16:34.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.892+0000 7f575f7fe640 1 --2- 172.21.15.2:0/1828751360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653ac2725d0 0x5653ac289310 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f575000f010 tx=0x7f57500084c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f726789520d6e9b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:34.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.892+0000 7f57457fa640 1 -- 172.21.15.2:0/1828751360 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5750028070 con 0x5653ac2725d0 2024-09-19T06:16:34.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.892+0000 7f57457fa640 1 -- 172.21.15.2:0/1828751360 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5750004680 con 0x5653ac2725d0 2024-09-19T06:16:34.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.892+0000 7f57457fa640 1 -- 172.21.15.2:0/1828751360 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5750014050 con 0x5653ac2725d0 2024-09-19T06:16:34.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.892+0000 7f57681f1740 1 -- 172.21.15.2:0/1828751360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653ac2725d0 msgr2=0x5653ac289310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:34.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.892+0000 7f57681f1740 1 --2- 172.21.15.2:0/1828751360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653ac2725d0 0x5653ac289310 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f575000f010 tx=0x7f57500084c0 comp rx=0 tx=0).stop 2024-09-19T06:16:34.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.892+0000 7f57681f1740 1 -- 172.21.15.2:0/1828751360 shutdown_connections 2024-09-19T06:16:34.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.892+0000 7f57681f1740 1 --2- 172.21.15.2:0/1828751360 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5653ac27d370 0x5653ac27e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:34.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.892+0000 7f57681f1740 1 --2- 172.21.15.2:0/1828751360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653ac273b40 0x5653ac26e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:34.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.892+0000 7f57681f1740 1 --2- 172.21.15.2:0/1828751360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653ac2725d0 0x5653ac289310 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:34.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.892+0000 7f57681f1740 1 -- 172.21.15.2:0/1828751360 >> 172.21.15.2:0/1828751360 conn(0x5653ac23b310 msgr2=0x5653ac278860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:34.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.892+0000 7f57681f1740 1 -- 172.21.15.2:0/1828751360 shutdown_connections 2024-09-19T06:16:34.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.892+0000 7f57681f1740 1 -- 172.21.15.2:0/1828751360 wait complete. 2024-09-19T06:16:34.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.893+0000 7f57681f1740 1 -- start start 2024-09-19T06:16:34.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.893+0000 7f57681f1740 1 Processor -- start 2024-09-19T06:16:34.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.893+0000 7f57681f1740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653ac2725d0 0x5653ac285480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:34.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.893+0000 7f57681f1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653ac273b40 0x5653ac2859c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:34.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.893+0000 7f57681f1740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5653ac27d370 0x5653ac2949e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:34.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.893+0000 7f57681f1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f57601ade40 con 0x5653ac273b40 2024-09-19T06:16:34.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.893+0000 7f57681f1740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f57601af2b0 con 0x5653ac2725d0 2024-09-19T06:16:34.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.893+0000 7f57681f1740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f57601ae510 con 0x5653ac27d370 2024-09-19T06:16:34.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.893+0000 7f57681f1740 10 client.0 _ll_register_callbacks cb 0x7f575400d6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:34.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.893+0000 7f575effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653ac273b40 0x5653ac2859c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:34.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.893+0000 7f575effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653ac273b40 0x5653ac2859c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45664/0 (socket says 172.21.15.2:45664) 2024-09-19T06:16:34.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.893+0000 7f575effd640 1 -- 172.21.15.2:0/2262960872 learned_addr learned my addr 172.21.15.2:0/2262960872 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:34.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.894+0000 7f575f7fe640 1 --2- 172.21.15.2:0/2262960872 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653ac2725d0 0x5653ac285480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:34.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.894+0000 7f575ffff640 1 --2- 172.21.15.2:0/2262960872 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5653ac27d370 0x5653ac2949e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:34.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.894+0000 7f575effd640 1 -- 172.21.15.2:0/2262960872 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5653ac27d370 msgr2=0x5653ac2949e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:34.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.894+0000 7f575effd640 1 --2- 172.21.15.2:0/2262960872 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5653ac27d370 0x5653ac2949e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:34.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.894+0000 7f575effd640 1 -- 172.21.15.2:0/2262960872 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653ac2725d0 msgr2=0x5653ac285480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:34.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.894+0000 7f575effd640 1 --2- 172.21.15.2:0/2262960872 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653ac2725d0 0x5653ac285480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:34.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.894+0000 7f575effd640 1 -- 172.21.15.2:0/2262960872 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653ac277e00 con 0x5653ac273b40 2024-09-19T06:16:34.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.894+0000 7f575f7fe640 1 --2- 172.21.15.2:0/2262960872 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653ac2725d0 0x5653ac285480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:16:34.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.894+0000 7f575effd640 1 --2- 172.21.15.2:0/2262960872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653ac273b40 0x5653ac2859c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f575409b6d0 tx=0x7f575409b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a29e4de403bc95f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:34.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.894+0000 7f573effd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:16:34.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.894+0000 7f573effd640 1 -- 172.21.15.2:0/2262960872 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5754020070 con 0x5653ac273b40 2024-09-19T06:16:34.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.894+0000 7f573effd640 1 -- 172.21.15.2:0/2262960872 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f5754097a30 con 0x5653ac273b40 2024-09-19T06:16:34.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.894+0000 7f57681f1740 1 -- 172.21.15.2:0/2262960872 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5750004680 con 0x5653ac273b40 2024-09-19T06:16:34.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.894+0000 7f573effd640 1 -- 172.21.15.2:0/2262960872 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5754097c70 con 0x5653ac273b40 2024-09-19T06:16:34.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.894+0000 7f57681f1740 10 client.15762 fetch_fsmap learned FSMap version 26 2024-09-19T06:16:34.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.894+0000 7f57681f1740 1 -- 172.21.15.2:0/2262960872 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5653ac2f8080 con 0x5653ac273b40 2024-09-19T06:16:34.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.894+0000 7f573effd640 1 -- 172.21.15.2:0/2262960872 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5750004680 con 0x5653ac273b40 2024-09-19T06:16:34.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.895+0000 7f573effd640 1 -- 172.21.15.2:0/2262960872 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f57540b4bd0 con 0x5653ac273b40 2024-09-19T06:16:34.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.895+0000 7f57681f1740 10 client.15762 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:16:34.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.895+0000 7f57681f1740 10 client.15762 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:34.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.895+0000 7f57681f1740 20 client.15762 populate_metadata read hostname 'smithi002' 2024-09-19T06:16:34.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.895+0000 7f57681f1740 1 --2- 172.21.15.2:0/2262960872 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5653ac28cfe0 0x5653ac2fa870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:34.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.895+0000 7f57681f1740 4 client.15762 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:16:34.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.895+0000 7f57681f1740 1 -- 172.21.15.2:0/2262960872 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5653ac1dfd70 con 0x5653ac28cfe0 2024-09-19T06:16:34.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.895+0000 7f575f7fe640 1 --2- 172.21.15.2:0/2262960872 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5653ac28cfe0 0x5653ac2fa870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:34.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.895+0000 7f573effd640 10 client.15762 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:34.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.895+0000 7f575f7fe640 1 --2- 172.21.15.2:0/2262960872 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5653ac28cfe0 0x5653ac2fa870 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64fe9f12fd026455 server_cookie=59e2c6e1075402d6 in_seq=0 out_seq=0 2024-09-19T06:16:34.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.895+0000 7f573effd640 1 -- 172.21.15.2:0/2262960872 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5653ac1dfd70 con 0x5653ac28cfe0 2024-09-19T06:16:34.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.895+0000 7f573effd640 10 client.15762 handle_command_reply: tid=0 2024-09-19T06:16:34.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.895+0000 7f57681f1740 1 client.15762 shutdown 2024-09-19T06:16:34.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.896+0000 7f57681f1740 1 -- 172.21.15.2:0/2262960872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653ac273b40 msgr2=0x5653ac2859c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:34.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.896+0000 7f57681f1740 1 --2- 172.21.15.2:0/2262960872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653ac273b40 0x5653ac2859c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f575409b6d0 tx=0x7f575409b460 comp rx=0 tx=0).stop 2024-09-19T06:16:34.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.896+0000 7f57681f1740 1 -- 172.21.15.2:0/2262960872 shutdown_connections 2024-09-19T06:16:34.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.896+0000 7f57681f1740 1 --2- 172.21.15.2:0/2262960872 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5653ac27d370 0x5653ac2949e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:34.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.896+0000 7f57681f1740 1 --2- 172.21.15.2:0/2262960872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5653ac273b40 0x5653ac2859c0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:34.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.896+0000 7f57681f1740 1 --2- 172.21.15.2:0/2262960872 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5653ac28cfe0 0x5653ac2fa870 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:34.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.896+0000 7f57681f1740 1 --2- 172.21.15.2:0/2262960872 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5653ac2725d0 0x5653ac285480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:34.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.896+0000 7f573effd640 0 client.15762 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:34.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.896+0000 7f57681f1740 1 -- 172.21.15.2:0/2262960872 >> 172.21.15.2:0/2262960872 conn(0x5653ac23b310 msgr2=0x5653ac27b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:34.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.896+0000 7f57681f1740 1 -- 172.21.15.2:0/2262960872 shutdown_connections 2024-09-19T06:16:34.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.896+0000 7f57681f1740 1 -- 172.21.15.2:0/2262960872 wait complete. 2024-09-19T06:16:34.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.896+0000 7f57681f1740 20 client.15762 trim_cache size 0 max 16384 2024-09-19T06:16:34.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.896+0000 7f5765e18640 1 -- 172.21.15.2:0/2696346809 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f57480a33b0 msgr2=0x7f57480a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:34.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.896+0000 7f5765e18640 1 --2- 172.21.15.2:0/2696346809 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f57480a33b0 0x7f57480a5870 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5758006010 tx=0x7f5758004a60 comp rx=0 tx=0).stop 2024-09-19T06:16:34.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.897+0000 7f5765e18640 1 -- 172.21.15.2:0/2696346809 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5760102790 msgr2=0x7f576019aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:34.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.897+0000 7f5765e18640 1 --2- 172.21.15.2:0/2696346809 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5760102790 0x7f576019aa50 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f575400d770 tx=0x7f575400dc30 comp rx=0 tx=0).stop 2024-09-19T06:16:34.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.897+0000 7f5765e18640 1 -- 172.21.15.2:0/2696346809 shutdown_connections 2024-09-19T06:16:34.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.897+0000 7f5765e18640 1 --2- 172.21.15.2:0/2696346809 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f57480a33b0 0x7f57480a5870 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:34.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.897+0000 7f5765e18640 1 --2- 172.21.15.2:0/2696346809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5760106f10 0x7f576019ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:34.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.897+0000 7f5765e18640 1 --2- 172.21.15.2:0/2696346809 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5760102790 0x7f576019aa50 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:34.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.897+0000 7f5765e18640 1 --2- 172.21.15.2:0/2696346809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5760101de0 0x7f576019a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:34.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.897+0000 7f5765e18640 1 -- 172.21.15.2:0/2696346809 >> 172.21.15.2:0/2696346809 conn(0x7f57600fd8c0 msgr2=0x7f57600fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:34.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.897+0000 7f5765e18640 1 -- 172.21.15.2:0/2696346809 shutdown_connections 2024-09-19T06:16:34.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:34.897+0000 7f5765e18640 1 -- 172.21.15.2:0/2696346809 wait complete. 2024-09-19T06:16:35.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:35 smithi002 ceph-mon[30982]: pgmap v56: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 71 MiB/s wr, 29 op/s 2024-09-19T06:16:35.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:35 smithi090 ceph-mon[34497]: pgmap v56: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 71 MiB/s wr, 29 op/s 2024-09-19T06:16:35.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:35 smithi089 ceph-mon[34160]: pgmap v56: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 71 MiB/s wr, 29 op/s 2024-09-19T06:16:36.571 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:16:36.571 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:16:36.842 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:16:37.642 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:37 smithi002 ceph-mon[30982]: pgmap v57: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 29 MiB/s wr, 16 op/s 2024-09-19T06:16:37.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.675+0000 7f0c0986b640 1 -- 172.21.15.2:0/1769581441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c04101420 msgr2=0x7f0c0410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:37.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.675+0000 7f0c0986b640 1 --2- 172.21.15.2:0/1769581441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c04101420 0x7f0c0410d950 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc009cd0 tx=0x7f0bfc02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:16:37.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.675+0000 7f0c0986b640 1 -- 172.21.15.2:0/1769581441 shutdown_connections 2024-09-19T06:16:37.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.675+0000 7f0c0986b640 1 --2- 172.21.15.2:0/1769581441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c04101420 0x7f0c0410d950 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:37.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.675+0000 7f0c0986b640 1 --2- 172.21.15.2:0/1769581441 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c04100a80 0x7f0c04100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:37.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.675+0000 7f0c0986b640 1 --2- 172.21.15.2:0/1769581441 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c04106a80 0x7f0c04106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:37.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.675+0000 7f0c0986b640 1 -- 172.21.15.2:0/1769581441 >> 172.21.15.2:0/1769581441 conn(0x7f0c040fc7a0 msgr2=0x7f0c040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:37.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.675+0000 7f0c0986b640 1 -- 172.21.15.2:0/1769581441 shutdown_connections 2024-09-19T06:16:37.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.675+0000 7f0c0986b640 1 -- 172.21.15.2:0/1769581441 wait complete. 2024-09-19T06:16:37.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.676+0000 7f0c0986b640 1 Processor -- start 2024-09-19T06:16:37.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.676+0000 7f0c0986b640 1 -- start start 2024-09-19T06:16:37.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.676+0000 7f0c0986b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c04100a80 0x7f0c041982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:37.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.676+0000 7f0c0986b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c04101420 0x7f0c041987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:37.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.676+0000 7f0c0986b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c04106a80 0x7f0c0419cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:37.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.676+0000 7f0c0986b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0c04110d30 con 0x7f0c04101420 2024-09-19T06:16:37.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.676+0000 7f0c0986b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0c04110bb0 con 0x7f0c04106a80 2024-09-19T06:16:37.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.676+0000 7f0c0986b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0c04110eb0 con 0x7f0c04100a80 2024-09-19T06:16:37.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.676+0000 7f0c027fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c04101420 0x7f0c041987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:37.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.676+0000 7f0c027fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c04101420 0x7f0c041987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53336/0 (socket says 172.21.15.2:53336) 2024-09-19T06:16:37.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.676+0000 7f0c027fc640 1 -- 172.21.15.2:0/1310695645 learned_addr learned my addr 172.21.15.2:0/1310695645 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:37.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.676+0000 7f0c02ffd640 1 --2- 172.21.15.2:0/1310695645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c04100a80 0x7f0c041982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:37.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.676+0000 7f0c037fe640 1 --2- 172.21.15.2:0/1310695645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c04106a80 0x7f0c0419cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:37.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.677+0000 7f0c027fc640 1 -- 172.21.15.2:0/1310695645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c04100a80 msgr2=0x7f0c041982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:37.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.677+0000 7f0c027fc640 1 --2- 172.21.15.2:0/1310695645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c04100a80 0x7f0c041982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:37.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.677+0000 7f0c027fc640 1 -- 172.21.15.2:0/1310695645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c04106a80 msgr2=0x7f0c0419cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:37.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.677+0000 7f0c027fc640 1 --2- 172.21.15.2:0/1310695645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c04106a80 0x7f0c0419cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:37.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.677+0000 7f0c027fc640 1 -- 172.21.15.2:0/1310695645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c0419d250 con 0x7f0c04101420 2024-09-19T06:16:37.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.677+0000 7f0c02ffd640 1 --2- 172.21.15.2:0/1310695645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c04100a80 0x7f0c041982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:16:37.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.677+0000 7f0c027fc640 1 --2- 172.21.15.2:0/1310695645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c04101420 0x7f0c041987e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f0bf800e9f0 tx=0x7f0bf800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:37.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.677+0000 7f0c08869640 1 -- 172.21.15.2:0/1310695645 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf800cd80 con 0x7f0c04101420 2024-09-19T06:16:37.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.677+0000 7f0c08869640 1 -- 172.21.15.2:0/1310695645 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0bf80054d0 con 0x7f0c04101420 2024-09-19T06:16:37.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.677+0000 7f0c0986b640 1 -- 172.21.15.2:0/1310695645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c0419d540 con 0x7f0c04101420 2024-09-19T06:16:37.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.677+0000 7f0c08869640 1 -- 172.21.15.2:0/1310695645 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf8010490 con 0x7f0c04101420 2024-09-19T06:16:37.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.677+0000 7f0c0986b640 1 -- 172.21.15.2:0/1310695645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c041a4e20 con 0x7f0c04101420 2024-09-19T06:16:37.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.679+0000 7f0c08869640 1 -- 172.21.15.2:0/1310695645 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f0bf8005020 con 0x7f0c04101420 2024-09-19T06:16:37.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.680+0000 7f0c0bc44740 1 Processor -- start 2024-09-19T06:16:37.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.680+0000 7f0c0bc44740 1 -- start start 2024-09-19T06:16:37.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.680+0000 7f0c0bc44740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b235bd7b60 0x55b235bd7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:37.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.680+0000 7f0c0bc44740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b235bd8480 0x55b235be2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:37.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.680+0000 7f0c0bc44740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b235be2d40 0x55b235be5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:37.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.680+0000 7f0c0bc44740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b235b3d280 con 0x55b235bd8480 2024-09-19T06:16:37.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.680+0000 7f0c0bc44740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55b235ae4b10 con 0x55b235bd7b60 2024-09-19T06:16:37.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.680+0000 7f0c0bc44740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55b235b39240 con 0x55b235be2d40 2024-09-19T06:16:37.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.680+0000 7f0c02ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b235bd8480 0x55b235be2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:37.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.680+0000 7f0c08869640 1 --2- 172.21.15.2:0/1310695645 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f0bec0a3430 0x7f0bec0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:37.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.680+0000 7f0c02ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b235bd8480 0x55b235be2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53346/0 (socket says 172.21.15.2:53346) 2024-09-19T06:16:37.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.680+0000 7f0c02ffd640 1 -- 172.21.15.2:0/2395588899 learned_addr learned my addr 172.21.15.2:0/2395588899 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:37.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.680+0000 7f0c037fe640 1 --2- 172.21.15.2:0/1310695645 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f0bec0a3430 0x7f0bec0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:37.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.680+0000 7f0c08869640 1 -- 172.21.15.2:0/1310695645 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f0bf80d0090 con 0x7f0c04101420 2024-09-19T06:16:37.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.680+0000 7f0c037fe640 1 --2- 172.21.15.2:0/2395588899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b235bd7b60 0x55b235bd7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:37.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.680+0000 7f0c027fc640 1 --2- 172.21.15.2:0/2395588899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b235be2d40 0x55b235be5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:37.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.680+0000 7f0c02ffd640 1 -- 172.21.15.2:0/2395588899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b235be2d40 msgr2=0x55b235be5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:37.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.681+0000 7f0c02ffd640 1 --2- 172.21.15.2:0/2395588899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b235be2d40 0x55b235be5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:37.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.681+0000 7f0c02ffd640 1 -- 172.21.15.2:0/2395588899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b235bd7b60 msgr2=0x55b235bd7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:37.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.681+0000 7f0c02ffd640 1 --2- 172.21.15.2:0/2395588899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b235bd7b60 0x55b235bd7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:37.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.681+0000 7f0c02ffd640 1 -- 172.21.15.2:0/2395588899 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b235af11f0 con 0x55b235bd8480 2024-09-19T06:16:37.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.681+0000 7f0c037fe640 1 --2- 172.21.15.2:0/2395588899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b235bd7b60 0x55b235bd7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:16:37.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.681+0000 7f0c027fc640 1 --2- 172.21.15.2:0/2395588899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b235be2d40 0x55b235be5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:16:37.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.681+0000 7f0c02ffd640 1 --2- 172.21.15.2:0/2395588899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b235bd8480 0x55b235be2800 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f0bf4008be0 tx=0x7f0bf400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2458dae3f9b4247 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:37.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.681+0000 7f0be9ffb640 1 -- 172.21.15.2:0/2395588899 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf4014070 con 0x55b235bd8480 2024-09-19T06:16:37.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.681+0000 7f0be9ffb640 1 -- 172.21.15.2:0/2395588899 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0bf40047a0 con 0x55b235bd8480 2024-09-19T06:16:37.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.681+0000 7f0be9ffb640 1 -- 172.21.15.2:0/2395588899 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf4010690 con 0x55b235bd8480 2024-09-19T06:16:37.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.682+0000 7f0c0bc44740 1 -- 172.21.15.2:0/2395588899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b235bd8480 msgr2=0x55b235be2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:37.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.682+0000 7f0c0bc44740 1 --2- 172.21.15.2:0/2395588899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b235bd8480 0x55b235be2800 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f0bf4008be0 tx=0x7f0bf400e720 comp rx=0 tx=0).stop 2024-09-19T06:16:37.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.682+0000 7f0c037fe640 1 --2- 172.21.15.2:0/1310695645 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f0bec0a3430 0x7f0bec0a58f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc005fe0 tx=0x7f0bfc0095c0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:37.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.682+0000 7f0c0bc44740 1 -- 172.21.15.2:0/2395588899 shutdown_connections 2024-09-19T06:16:37.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.682+0000 7f0c0bc44740 1 --2- 172.21.15.2:0/2395588899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b235be2d40 0x55b235be5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:37.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.682+0000 7f0c0bc44740 1 --2- 172.21.15.2:0/2395588899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b235bd8480 0x55b235be2800 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:37.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.682+0000 7f0c0bc44740 1 --2- 172.21.15.2:0/2395588899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b235bd7b60 0x55b235bd7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:37.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.682+0000 7f0c0bc44740 1 -- 172.21.15.2:0/2395588899 >> 172.21.15.2:0/2395588899 conn(0x55b235bd40f0 msgr2=0x55b235bd44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:37.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.682+0000 7f0c0bc44740 1 -- 172.21.15.2:0/2395588899 shutdown_connections 2024-09-19T06:16:37.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.682+0000 7f0c0bc44740 1 -- 172.21.15.2:0/2395588899 wait complete. 2024-09-19T06:16:37.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.682+0000 7f0c0bc44740 1 -- start start 2024-09-19T06:16:37.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.682+0000 7f0c0bc44740 1 Processor -- start 2024-09-19T06:16:37.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.683+0000 7f0c0bc44740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b235bd7b60 0x55b235be2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:37.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.683+0000 7f0c0bc44740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b235bd8480 0x55b235bdfb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:37.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.683+0000 7f0c0bc44740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b235be2d40 0x55b235be02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:37.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.683+0000 7f0c0bc44740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b235be9d20 con 0x55b235be2d40 2024-09-19T06:16:37.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.683+0000 7f0c0bc44740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55b235af7f10 con 0x55b235bd7b60 2024-09-19T06:16:37.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.683+0000 7f0c0bc44740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55b235be9ea0 con 0x55b235bd8480 2024-09-19T06:16:37.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.683+0000 7f0c0bc44740 10 client.0 _ll_register_callbacks cb 0x55b235ac0a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:37.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.683+0000 7f0c037fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b235be2d40 0x55b235be02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:37.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.683+0000 7f0c027fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b235bd8480 0x55b235bdfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:37.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.683+0000 7f0c037fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b235be2d40 0x55b235be02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53358/0 (socket says 172.21.15.2:53358) 2024-09-19T06:16:37.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.683+0000 7f0c037fe640 1 -- 172.21.15.2:0/3310689819 learned_addr learned my addr 172.21.15.2:0/3310689819 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:37.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.683+0000 7f0c02ffd640 1 --2- 172.21.15.2:0/3310689819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b235bd7b60 0x55b235be2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:37.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.683+0000 7f0c027fc640 1 -- 172.21.15.2:0/3310689819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b235bd7b60 msgr2=0x55b235be2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:37.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.683+0000 7f0c027fc640 1 --2- 172.21.15.2:0/3310689819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b235bd7b60 0x55b235be2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:37.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.683+0000 7f0c027fc640 1 -- 172.21.15.2:0/3310689819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b235be2d40 msgr2=0x55b235be02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:37.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.683+0000 7f0c027fc640 1 --2- 172.21.15.2:0/3310689819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b235be2d40 0x55b235be02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:37.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.683+0000 7f0c027fc640 1 -- 172.21.15.2:0/3310689819 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2358ae6a0 con 0x55b235bd8480 2024-09-19T06:16:37.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.683+0000 7f0c027fc640 1 --2- 172.21.15.2:0/3310689819 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b235bd8480 0x55b235bdfb50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0bf80cd8b0 tx=0x7f0bf809be60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=823c3e2e793e1613 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:37.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.683+0000 7f0be2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-19T06:16:37.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.684+0000 7f0be2ffd640 1 -- 172.21.15.2:0/3310689819 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf809cb40 con 0x55b235bd8480 2024-09-19T06:16:37.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.684+0000 7f0c0bc44740 1 -- 172.21.15.2:0/3310689819 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0bf40047a0 con 0x55b235bd8480 2024-09-19T06:16:37.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.684+0000 7f0be2ffd640 1 -- 172.21.15.2:0/3310689819 <== mon.1 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f0bf8016db0 con 0x55b235bd8480 2024-09-19T06:16:37.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.684+0000 7f0be2ffd640 1 -- 172.21.15.2:0/3310689819 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0bf80a07f0 con 0x55b235bd8480 2024-09-19T06:16:37.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.684+0000 7f0c0bc44740 10 client.25366 fetch_fsmap learned FSMap version 26 2024-09-19T06:16:37.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.684+0000 7f0c0bc44740 1 -- 172.21.15.2:0/3310689819 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b235bf5820 con 0x55b235bd8480 2024-09-19T06:16:37.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.684+0000 7f0be2ffd640 1 -- 172.21.15.2:0/3310689819 <== mon.1 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0bf40047a0 con 0x55b235bd8480 2024-09-19T06:16:37.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.684+0000 7f0be2ffd640 1 -- 172.21.15.2:0/3310689819 <== mon.1 v2:172.21.15.90:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f0bf80a4c20 con 0x55b235bd8480 2024-09-19T06:16:37.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.684+0000 7f0c0bc44740 10 client.25366 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:16:37.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.684+0000 7f0c0bc44740 10 client.25366 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:37.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.684+0000 7f0c0bc44740 20 client.25366 populate_metadata read hostname 'smithi002' 2024-09-19T06:16:37.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.684+0000 7f0c0bc44740 1 --2- 172.21.15.2:0/3310689819 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55b235bf6d30 0x55b235bf9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:37.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.684+0000 7f0c0bc44740 4 client.25366 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:16:37.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.684+0000 7f0c0bc44740 1 -- 172.21.15.2:0/3310689819 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b235b4a7f0 con 0x55b235bf6d30 2024-09-19T06:16:37.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.685+0000 7f0c02ffd640 1 --2- 172.21.15.2:0/3310689819 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55b235bf6d30 0x55b235bf9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:37.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.685+0000 7f0be2ffd640 10 client.25366 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:37.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.685+0000 7f0c02ffd640 1 --2- 172.21.15.2:0/3310689819 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55b235bf6d30 0x55b235bf9120 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90a1016cb2474ec2 server_cookie=4eaba79a146397cf in_seq=0 out_seq=0 2024-09-19T06:16:37.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.686+0000 7f0be2ffd640 1 -- 172.21.15.2:0/3310689819 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b235b4a7f0 con 0x55b235bf6d30 2024-09-19T06:16:37.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.686+0000 7f0be2ffd640 10 client.25366 handle_command_reply: tid=0 2024-09-19T06:16:37.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.686+0000 7f0c0bc44740 1 client.25366 shutdown 2024-09-19T06:16:37.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.686+0000 7f0c0bc44740 1 -- 172.21.15.2:0/3310689819 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b235bd8480 msgr2=0x55b235bdfb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:37.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.686+0000 7f0c0bc44740 1 --2- 172.21.15.2:0/3310689819 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b235bd8480 0x55b235bdfb50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0bf80cd8b0 tx=0x7f0bf809be60 comp rx=0 tx=0).stop 2024-09-19T06:16:37.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.686+0000 7f0c0bc44740 1 -- 172.21.15.2:0/3310689819 shutdown_connections 2024-09-19T06:16:37.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.686+0000 7f0c0bc44740 1 --2- 172.21.15.2:0/3310689819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b235be2d40 0x55b235be02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:37.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.686+0000 7f0c0bc44740 1 --2- 172.21.15.2:0/3310689819 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b235bd8480 0x55b235bdfb50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:37.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.686+0000 7f0c0bc44740 1 --2- 172.21.15.2:0/3310689819 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55b235bf6d30 0x55b235bf9120 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:37.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.686+0000 7f0c0bc44740 1 --2- 172.21.15.2:0/3310689819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b235bd7b60 0x55b235be2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:37.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.686+0000 7f0c0bc44740 1 -- 172.21.15.2:0/3310689819 >> 172.21.15.2:0/3310689819 conn(0x55b235bd40f0 msgr2=0x55b235bd9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:37.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.686+0000 7f0be2ffd640 0 client.25366 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:37.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.686+0000 7f0c0bc44740 1 -- 172.21.15.2:0/3310689819 shutdown_connections 2024-09-19T06:16:37.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.686+0000 7f0c0bc44740 1 -- 172.21.15.2:0/3310689819 wait complete. 2024-09-19T06:16:37.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.686+0000 7f0c0bc44740 20 client.25366 trim_cache size 0 max 16384 2024-09-19T06:16:37.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.704+0000 7f0c0bc44740 1 Processor -- start 2024-09-19T06:16:37.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.704+0000 7f0c0bc44740 1 -- start start 2024-09-19T06:16:37.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.704+0000 7f0c0bc44740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b235bd7b60 0x55b235bfe9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:37.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.704+0000 7f0c0bc44740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b235bd8480 0x55b235bfeee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:37.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.704+0000 7f0c0bc44740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b235be2d40 0x55b235bdcdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:37.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.704+0000 7f0c0bc44740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0c041adcc0 con 0x55b235bd8480 2024-09-19T06:16:37.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.704+0000 7f0c0bc44740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0c041ab590 con 0x55b235bd7b60 2024-09-19T06:16:37.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.704+0000 7f0c0bc44740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0c041a9400 con 0x55b235be2d40 2024-09-19T06:16:37.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.704+0000 7f0c027fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b235bd8480 0x55b235bfeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:37.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.704+0000 7f0c027fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b235bd8480 0x55b235bfeee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53372/0 (socket says 172.21.15.2:53372) 2024-09-19T06:16:37.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.704+0000 7f0c027fc640 1 -- 172.21.15.2:0/1755048227 learned_addr learned my addr 172.21.15.2:0/1755048227 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:37.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.704+0000 7f0c02ffd640 1 --2- 172.21.15.2:0/1755048227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b235bd7b60 0x55b235bfe9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:37.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.704+0000 7f0c027fc640 1 -- 172.21.15.2:0/1755048227 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b235be2d40 msgr2=0x55b235bdcdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:37.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.704+0000 7f0c027fc640 1 --2- 172.21.15.2:0/1755048227 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b235be2d40 0x55b235bdcdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:37.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.704+0000 7f0c027fc640 1 -- 172.21.15.2:0/1755048227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b235bd7b60 msgr2=0x55b235bfe9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:37.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.704+0000 7f0c027fc640 1 --2- 172.21.15.2:0/1755048227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b235bd7b60 0x55b235bfe9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:37.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.704+0000 7f0c027fc640 1 -- 172.21.15.2:0/1755048227 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b235bd82b0 con 0x55b235bd8480 2024-09-19T06:16:37.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.705+0000 7f0c027fc640 1 --2- 172.21.15.2:0/1755048227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b235bd8480 0x55b235bfeee0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f0bf80d04b0 tx=0x7f0bf8009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5b7521196001944 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:37.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.705+0000 7f0be97fa640 1 -- 172.21.15.2:0/1755048227 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf809cb40 con 0x55b235bd8480 2024-09-19T06:16:37.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.705+0000 7f0be97fa640 1 -- 172.21.15.2:0/1755048227 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0bf809c440 con 0x55b235bd8480 2024-09-19T06:16:37.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.705+0000 7f0be97fa640 1 -- 172.21.15.2:0/1755048227 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf80a4c20 con 0x55b235bd8480 2024-09-19T06:16:37.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.705+0000 7f0c0bc44740 1 -- 172.21.15.2:0/1755048227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b235bd8480 msgr2=0x55b235bfeee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:37.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.705+0000 7f0c0bc44740 1 --2- 172.21.15.2:0/1755048227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b235bd8480 0x55b235bfeee0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f0bf80d04b0 tx=0x7f0bf8009310 comp rx=0 tx=0).stop 2024-09-19T06:16:37.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.705+0000 7f0c0bc44740 1 -- 172.21.15.2:0/1755048227 shutdown_connections 2024-09-19T06:16:37.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.705+0000 7f0c0bc44740 1 --2- 172.21.15.2:0/1755048227 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b235be2d40 0x55b235bdcdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:37.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.705+0000 7f0c0bc44740 1 --2- 172.21.15.2:0/1755048227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b235bd8480 0x55b235bfeee0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:37.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.705+0000 7f0c0bc44740 1 --2- 172.21.15.2:0/1755048227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b235bd7b60 0x55b235bfe9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:37.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.705+0000 7f0c0bc44740 1 -- 172.21.15.2:0/1755048227 >> 172.21.15.2:0/1755048227 conn(0x55b235bd40f0 msgr2=0x55b235bde420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:37.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.706+0000 7f0c0bc44740 1 -- 172.21.15.2:0/1755048227 shutdown_connections 2024-09-19T06:16:37.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.706+0000 7f0c0bc44740 1 -- 172.21.15.2:0/1755048227 wait complete. 2024-09-19T06:16:37.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.706+0000 7f0c0bc44740 1 -- start start 2024-09-19T06:16:37.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.706+0000 7f0c0bc44740 1 Processor -- start 2024-09-19T06:16:37.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.706+0000 7f0c0bc44740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b235bd7b60 0x55b235beb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:37.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.706+0000 7f0c0bc44740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b235bd8480 0x55b235beb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:37.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.706+0000 7f0c0bc44740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b235be2d40 0x55b235bebc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:37.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.707+0000 7f0c0bc44740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0c041a9a50 con 0x55b235be2d40 2024-09-19T06:16:37.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.707+0000 7f0c0bc44740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0c041aaec0 con 0x55b235bd7b60 2024-09-19T06:16:37.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.707+0000 7f0c0bc44740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0c041aa120 con 0x55b235bd8480 2024-09-19T06:16:37.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.707+0000 7f0c0bc44740 10 client.0 _ll_register_callbacks cb 0x7f0bf80bc040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:37.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.707+0000 7f0c037fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b235be2d40 0x55b235bebc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:37.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.707+0000 7f0c037fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b235be2d40 0x55b235bebc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53374/0 (socket says 172.21.15.2:53374) 2024-09-19T06:16:37.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.707+0000 7f0c037fe640 1 -- 172.21.15.2:0/3786745649 learned_addr learned my addr 172.21.15.2:0/3786745649 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:37.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.707+0000 7f0c02ffd640 1 --2- 172.21.15.2:0/3786745649 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b235bd7b60 0x55b235beb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:37.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.707+0000 7f0c027fc640 1 --2- 172.21.15.2:0/3786745649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b235bd8480 0x55b235beb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:37.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.707+0000 7f0c037fe640 1 -- 172.21.15.2:0/3786745649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b235bd8480 msgr2=0x55b235beb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:37.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.707+0000 7f0c037fe640 1 --2- 172.21.15.2:0/3786745649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b235bd8480 0x55b235beb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:37.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.707+0000 7f0c037fe640 1 -- 172.21.15.2:0/3786745649 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b235bd7b60 msgr2=0x55b235beb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:37.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.707+0000 7f0c037fe640 1 --2- 172.21.15.2:0/3786745649 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b235bd7b60 0x55b235beb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:37.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.707+0000 7f0c037fe640 1 -- 172.21.15.2:0/3786745649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b235c60c40 con 0x55b235be2d40 2024-09-19T06:16:37.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.707+0000 7f0c037fe640 1 --2- 172.21.15.2:0/3786745649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b235be2d40 0x55b235bebc10 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc003c20 tx=0x7f0bfc003c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=717b83d3022c18f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:37.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.707+0000 7f0be2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:16:37.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.707+0000 7f0be2ffd640 1 -- 172.21.15.2:0/3786745649 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bfc056060 con 0x55b235be2d40 2024-09-19T06:16:37.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.707+0000 7f0be2ffd640 1 -- 172.21.15.2:0/3786745649 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f0bfc004440 con 0x55b235be2d40 2024-09-19T06:16:37.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.707+0000 7f0c0bc44740 1 -- 172.21.15.2:0/3786745649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0bf809c440 con 0x55b235be2d40 2024-09-19T06:16:37.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.708+0000 7f0be2ffd640 1 -- 172.21.15.2:0/3786745649 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0bfc031660 con 0x55b235be2d40 2024-09-19T06:16:37.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.708+0000 7f0c0bc44740 10 client.15780 fetch_fsmap learned FSMap version 26 2024-09-19T06:16:37.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.708+0000 7f0c0bc44740 1 -- 172.21.15.2:0/3786745649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b235c61f80 con 0x55b235be2d40 2024-09-19T06:16:37.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.708+0000 7f0be2ffd640 1 -- 172.21.15.2:0/3786745649 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0bf809c440 con 0x55b235be2d40 2024-09-19T06:16:37.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.708+0000 7f0be2ffd640 1 -- 172.21.15.2:0/3786745649 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f0bfc030070 con 0x55b235be2d40 2024-09-19T06:16:37.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.708+0000 7f0c0bc44740 10 client.15780 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:16:37.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.708+0000 7f0c0bc44740 10 client.15780 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:37.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.708+0000 7f0c0bc44740 20 client.15780 populate_metadata read hostname 'smithi002' 2024-09-19T06:16:37.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.708+0000 7f0c0bc44740 1 --2- 172.21.15.2:0/3786745649 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55b235c626d0 0x55b235c64af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:37.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.708+0000 7f0c0bc44740 4 client.15780 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:16:37.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.708+0000 7f0c0bc44740 1 -- 172.21.15.2:0/3786745649 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b235b44d00 con 0x55b235c626d0 2024-09-19T06:16:37.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.708+0000 7f0c02ffd640 1 --2- 172.21.15.2:0/3786745649 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55b235c626d0 0x55b235c64af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:37.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.709+0000 7f0c02ffd640 1 --2- 172.21.15.2:0/3786745649 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55b235c626d0 0x55b235c64af0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=814d768c84107a4a server_cookie=90138492a27da92d in_seq=0 out_seq=0 2024-09-19T06:16:37.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.709+0000 7f0be2ffd640 10 client.15780 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:37.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.710+0000 7f0be2ffd640 1 -- 172.21.15.2:0/3786745649 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b235b44d00 con 0x55b235c626d0 2024-09-19T06:16:37.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.710+0000 7f0be2ffd640 10 client.15780 handle_command_reply: tid=0 2024-09-19T06:16:37.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.710+0000 7f0c0bc44740 1 client.15780 shutdown 2024-09-19T06:16:37.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.710+0000 7f0c0bc44740 1 -- 172.21.15.2:0/3786745649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b235be2d40 msgr2=0x55b235bebc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:37.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.710+0000 7f0c0bc44740 1 --2- 172.21.15.2:0/3786745649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b235be2d40 0x55b235bebc10 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc003c20 tx=0x7f0bfc003c50 comp rx=0 tx=0).stop 2024-09-19T06:16:37.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.710+0000 7f0c0bc44740 1 -- 172.21.15.2:0/3786745649 shutdown_connections 2024-09-19T06:16:37.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.710+0000 7f0c0bc44740 1 --2- 172.21.15.2:0/3786745649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b235be2d40 0x55b235bebc10 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:37.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.710+0000 7f0c0bc44740 1 --2- 172.21.15.2:0/3786745649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b235bd8480 0x55b235beb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:37.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.710+0000 7f0c0bc44740 1 --2- 172.21.15.2:0/3786745649 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55b235c626d0 0x55b235c64af0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:37.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.710+0000 7f0c0bc44740 1 --2- 172.21.15.2:0/3786745649 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b235bd7b60 0x55b235beb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:37.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.710+0000 7f0c0bc44740 1 -- 172.21.15.2:0/3786745649 >> 172.21.15.2:0/3786745649 conn(0x55b235bd40f0 msgr2=0x55b235bd9600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:37.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.710+0000 7f0be2ffd640 0 client.15780 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:37.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.710+0000 7f0c0bc44740 1 -- 172.21.15.2:0/3786745649 shutdown_connections 2024-09-19T06:16:37.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.710+0000 7f0c0bc44740 1 -- 172.21.15.2:0/3786745649 wait complete. 2024-09-19T06:16:37.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.710+0000 7f0c0bc44740 20 client.15780 trim_cache size 0 max 16384 2024-09-19T06:16:37.721 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:16:37.721 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T06:16:37.721 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "fd6c5c31-d21a-468d-bbc7-99b5618ae5b7", 2024-09-19T06:16:37.721 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T06:16:37.721 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:16:37.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.711+0000 7f0c0986b640 1 -- 172.21.15.2:0/1310695645 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f0bec0a3430 msgr2=0x7f0bec0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:37.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.711+0000 7f0c0986b640 1 --2- 172.21.15.2:0/1310695645 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f0bec0a3430 0x7f0bec0a58f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc005fe0 tx=0x7f0bfc0095c0 comp rx=0 tx=0).stop 2024-09-19T06:16:37.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.711+0000 7f0c0986b640 1 -- 172.21.15.2:0/1310695645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c04101420 msgr2=0x7f0c041987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:37.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.711+0000 7f0c0986b640 1 --2- 172.21.15.2:0/1310695645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c04101420 0x7f0c041987e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f0bf800e9f0 tx=0x7f0bf800edf0 comp rx=0 tx=0).stop 2024-09-19T06:16:37.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.711+0000 7f0c0986b640 1 -- 172.21.15.2:0/1310695645 shutdown_connections 2024-09-19T06:16:37.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.711+0000 7f0c0986b640 1 --2- 172.21.15.2:0/1310695645 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f0bec0a3430 0x7f0bec0a58f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:37.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.711+0000 7f0c0986b640 1 --2- 172.21.15.2:0/1310695645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c04106a80 0x7f0c0419cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:37.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.711+0000 7f0c0986b640 1 --2- 172.21.15.2:0/1310695645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c04101420 0x7f0c041987e0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:37.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.711+0000 7f0c0986b640 1 --2- 172.21.15.2:0/1310695645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c04100a80 0x7f0c041982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:37.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.711+0000 7f0c0986b640 1 -- 172.21.15.2:0/1310695645 >> 172.21.15.2:0/1310695645 conn(0x7f0c040fc7a0 msgr2=0x7f0c041047f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:37.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.711+0000 7f0c0986b640 1 -- 172.21.15.2:0/1310695645 shutdown_connections 2024-09-19T06:16:37.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:37.711+0000 7f0c0986b640 1 -- 172.21.15.2:0/1310695645 wait complete. 2024-09-19T06:16:37.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:37 smithi090 ceph-mon[34497]: pgmap v57: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 29 MiB/s wr, 16 op/s 2024-09-19T06:16:37.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:37 smithi089 ceph-mon[34160]: pgmap v57: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 29 MiB/s wr, 16 op/s 2024-09-19T06:16:38.384 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:16:38.639 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:16:38.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:38 smithi002 ceph-mon[30982]: scrub queued for path: / 2024-09-19T06:16:38.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:38 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:16:38.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:38 smithi002 ceph-mon[30982]: scrub summary: active paths [/] 2024-09-19T06:16:38.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:38 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:16:38.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:38 smithi002 ceph-mon[30982]: scrub summary: idle 2024-09-19T06:16:38.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:38 smithi090 ceph-mon[34497]: scrub queued for path: / 2024-09-19T06:16:38.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:38 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:16:38.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:38 smithi090 ceph-mon[34497]: scrub summary: active paths [/] 2024-09-19T06:16:38.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:38 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:16:38.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:38 smithi090 ceph-mon[34497]: scrub summary: idle 2024-09-19T06:16:38.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:38 smithi089 ceph-mon[34160]: scrub queued for path: / 2024-09-19T06:16:38.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:38 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:16:38.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:38 smithi089 ceph-mon[34160]: scrub summary: active paths [/] 2024-09-19T06:16:38.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:38 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:16:38.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:38 smithi089 ceph-mon[34160]: scrub summary: idle 2024-09-19T06:16:39.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.058+0000 7f06580fb640 1 -- 172.21.15.2:0/2557153477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0650102ef0 msgr2=0x7f065010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:39.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.058+0000 7f06580fb640 1 --2- 172.21.15.2:0/2557153477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0650102ef0 0x7f065010da40 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f0640009900 tx=0x7f064002a480 comp rx=0 tx=0).stop 2024-09-19T06:16:39.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.058+0000 7f06580fb640 1 -- 172.21.15.2:0/2557153477 shutdown_connections 2024-09-19T06:16:39.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.058+0000 7f06580fb640 1 --2- 172.21.15.2:0/2557153477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0650102ef0 0x7f065010da40 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:39.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.059+0000 7f06580fb640 1 --2- 172.21.15.2:0/2557153477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0650102570 0x7f06501029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:39.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.059+0000 7f06580fb640 1 --2- 172.21.15.2:0/2557153477 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0650100e20 0x7f0650101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:39.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.059+0000 7f06580fb640 1 -- 172.21.15.2:0/2557153477 >> 172.21.15.2:0/2557153477 conn(0x7f06500fc7d0 msgr2=0x7f06500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:39.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.059+0000 7f06580fb640 1 -- 172.21.15.2:0/2557153477 shutdown_connections 2024-09-19T06:16:39.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.059+0000 7f06580fb640 1 -- 172.21.15.2:0/2557153477 wait complete. 2024-09-19T06:16:39.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.059+0000 7f06580fb640 1 Processor -- start 2024-09-19T06:16:39.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.059+0000 7f06580fb640 1 -- start start 2024-09-19T06:16:39.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.060+0000 7f06580fb640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0650100e20 0x7f06501982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:39.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.060+0000 7f06580fb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0650102570 0x7f0650198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:39.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.060+0000 7f06580fb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0650102ef0 0x7f065019cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:39.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.060+0000 7f06580fb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0650110e80 con 0x7f0650102ef0 2024-09-19T06:16:39.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.060+0000 7f06580fb640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0650110d00 con 0x7f0650102570 2024-09-19T06:16:39.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.060+0000 7f06580fb640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0650111000 con 0x7f0650100e20 2024-09-19T06:16:39.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.060+0000 7f0656698640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0650102ef0 0x7f065019cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:39.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.060+0000 7f0656698640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0650102ef0 0x7f065019cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53400/0 (socket says 172.21.15.2:53400) 2024-09-19T06:16:39.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.060+0000 7f0656698640 1 -- 172.21.15.2:0/2818056850 learned_addr learned my addr 172.21.15.2:0/2818056850 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:39.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.060+0000 7f0655696640 1 --2- 172.21.15.2:0/2818056850 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0650102570 0x7f0650198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:39.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.060+0000 7f0655e97640 1 --2- 172.21.15.2:0/2818056850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0650100e20 0x7f06501982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:39.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.060+0000 7f0656698640 1 -- 172.21.15.2:0/2818056850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0650100e20 msgr2=0x7f06501982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:39.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.060+0000 7f0656698640 1 --2- 172.21.15.2:0/2818056850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0650100e20 0x7f06501982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:39.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.060+0000 7f0656698640 1 -- 172.21.15.2:0/2818056850 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0650102570 msgr2=0x7f0650198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:39.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.060+0000 7f0656698640 1 --2- 172.21.15.2:0/2818056850 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0650102570 0x7f0650198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:39.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.060+0000 7f0656698640 1 -- 172.21.15.2:0/2818056850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f065019d2a0 con 0x7f0650102ef0 2024-09-19T06:16:39.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.060+0000 7f0655696640 1 --2- 172.21.15.2:0/2818056850 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0650102570 0x7f0650198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:39.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.060+0000 7f0656698640 1 --2- 172.21.15.2:0/2818056850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0650102ef0 0x7f065019cbc0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f0640003cb0 tx=0x7f0640003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:39.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.061+0000 7f064effd640 1 -- 172.21.15.2:0/2818056850 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f064003f070 con 0x7f0650102ef0 2024-09-19T06:16:39.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.061+0000 7f064effd640 1 -- 172.21.15.2:0/2818056850 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f064003bd20 con 0x7f0650102ef0 2024-09-19T06:16:39.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.061+0000 7f06580fb640 1 -- 172.21.15.2:0/2818056850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f065019d530 con 0x7f0650102ef0 2024-09-19T06:16:39.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.061+0000 7f064effd640 1 -- 172.21.15.2:0/2818056850 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0640035030 con 0x7f0650102ef0 2024-09-19T06:16:39.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.061+0000 7f06580fb640 1 -- 172.21.15.2:0/2818056850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06501a4e70 con 0x7f0650102ef0 2024-09-19T06:16:39.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.063+0000 7f064effd640 1 -- 172.21.15.2:0/2818056850 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f0640042070 con 0x7f0650102ef0 2024-09-19T06:16:39.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.063+0000 7f065a4d4740 1 Processor -- start 2024-09-19T06:16:39.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.063+0000 7f065a4d4740 1 -- start start 2024-09-19T06:16:39.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.064+0000 7f065a4d4740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563509c114a0 0x563509c11880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:39.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.064+0000 7f065a4d4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563509c11dc0 0x563509c1c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:39.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.064+0000 7f065a4d4740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563509c1c680 0x563509c1ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:39.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.064+0000 7f065a4d4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563509b772e0 con 0x563509c11dc0 2024-09-19T06:16:39.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.064+0000 7f065a4d4740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563509b1ece0 con 0x563509c114a0 2024-09-19T06:16:39.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.064+0000 7f065a4d4740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x563509b732a0 con 0x563509c1c680 2024-09-19T06:16:39.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.064+0000 7f0655e97640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563509c11dc0 0x563509c1c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:39.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.064+0000 7f064effd640 1 --2- 172.21.15.2:0/2818056850 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f06380a33b0 0x7f06380a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:39.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.064+0000 7f0655e97640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563509c11dc0 0x563509c1c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53404/0 (socket says 172.21.15.2:53404) 2024-09-19T06:16:39.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.064+0000 7f0655e97640 1 -- 172.21.15.2:0/1011710401 learned_addr learned my addr 172.21.15.2:0/1011710401 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:39.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.064+0000 7f0655696640 1 --2- 172.21.15.2:0/1011710401 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563509c1c680 0x563509c1ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:39.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.064+0000 7f0656698640 1 --2- 172.21.15.2:0/2818056850 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f06380a33b0 0x7f06380a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:39.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.064+0000 7f0655696640 1 --2- 172.21.15.2:0/1011710401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563509c114a0 0x563509c11880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:39.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.064+0000 7f0655e97640 1 -- 172.21.15.2:0/1011710401 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563509c1c680 msgr2=0x563509c1ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:39.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.064+0000 7f0655e97640 1 --2- 172.21.15.2:0/1011710401 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563509c1c680 0x563509c1ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:39.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.064+0000 7f0655e97640 1 -- 172.21.15.2:0/1011710401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563509c114a0 msgr2=0x563509c11880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:39.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.064+0000 7f0655e97640 1 --2- 172.21.15.2:0/1011710401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563509c114a0 0x563509c11880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:39.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.064+0000 7f0655e97640 1 -- 172.21.15.2:0/1011710401 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563509b03440 con 0x563509c11dc0 2024-09-19T06:16:39.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.064+0000 7f064effd640 1 -- 172.21.15.2:0/2818056850 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f06400f0560 con 0x7f0650102ef0 2024-09-19T06:16:39.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.065+0000 7f0655e97640 1 --2- 172.21.15.2:0/1011710401 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563509c11dc0 0x563509c1c140 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f064800af30 tx=0x7f064800f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a329687d5abc38 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:39.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.065+0000 7f0656698640 1 --2- 172.21.15.2:0/2818056850 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f06380a33b0 0x7f06380a5870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f064008f610 tx=0x7f064008f640 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:39.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.065+0000 7f0637fff640 1 -- 172.21.15.2:0/1011710401 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0648010900 con 0x563509c11dc0 2024-09-19T06:16:39.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.065+0000 7f0637fff640 1 -- 172.21.15.2:0/1011710401 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0648018430 con 0x563509c11dc0 2024-09-19T06:16:39.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.065+0000 7f0637fff640 1 -- 172.21.15.2:0/1011710401 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0648017640 con 0x563509c11dc0 2024-09-19T06:16:39.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.065+0000 7f065a4d4740 1 -- 172.21.15.2:0/1011710401 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563509c11dc0 msgr2=0x563509c1c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:39.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.065+0000 7f065a4d4740 1 --2- 172.21.15.2:0/1011710401 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563509c11dc0 0x563509c1c140 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f064800af30 tx=0x7f064800f850 comp rx=0 tx=0).stop 2024-09-19T06:16:39.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.066+0000 7f065a4d4740 1 -- 172.21.15.2:0/1011710401 shutdown_connections 2024-09-19T06:16:39.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.066+0000 7f065a4d4740 1 --2- 172.21.15.2:0/1011710401 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563509c1c680 0x563509c1ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:39.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.066+0000 7f065a4d4740 1 --2- 172.21.15.2:0/1011710401 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563509c11dc0 0x563509c1c140 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:39.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.066+0000 7f065a4d4740 1 --2- 172.21.15.2:0/1011710401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563509c114a0 0x563509c11880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:39.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.066+0000 7f065a4d4740 1 -- 172.21.15.2:0/1011710401 >> 172.21.15.2:0/1011710401 conn(0x563509c0da30 msgr2=0x563509c0de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:39.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.066+0000 7f065a4d4740 1 -- 172.21.15.2:0/1011710401 shutdown_connections 2024-09-19T06:16:39.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.066+0000 7f065a4d4740 1 -- 172.21.15.2:0/1011710401 wait complete. 2024-09-19T06:16:39.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.066+0000 7f065a4d4740 1 -- start start 2024-09-19T06:16:39.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.066+0000 7f065a4d4740 1 Processor -- start 2024-09-19T06:16:39.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.067+0000 7f065a4d4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563509c114a0 0x563509c1bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:39.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.067+0000 7f065a4d4740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563509c11dc0 0x563509c19220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:39.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.067+0000 7f065a4d4740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563509c1c680 0x563509c19760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:39.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.067+0000 7f065a4d4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563509c23660 con 0x563509c114a0 2024-09-19T06:16:39.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.067+0000 7f065a4d4740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563509b32050 con 0x563509c11dc0 2024-09-19T06:16:39.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.067+0000 7f065a4d4740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x563509c237e0 con 0x563509c1c680 2024-09-19T06:16:39.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.067+0000 7f0655696640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563509c114a0 0x563509c1bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:39.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.067+0000 7f065a4d4740 10 client.0 _ll_register_callbacks cb 0x563509b72160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:39.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.067+0000 7f0655696640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563509c114a0 0x563509c1bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53406/0 (socket says 172.21.15.2:53406) 2024-09-19T06:16:39.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.067+0000 7f0655696640 1 -- 172.21.15.2:0/1535930494 learned_addr learned my addr 172.21.15.2:0/1535930494 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:39.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.067+0000 7f0655696640 1 --2- 172.21.15.2:0/1535930494 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563509c1c680 0x563509c19760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:39.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.067+0000 7f0655e97640 1 --2- 172.21.15.2:0/1535930494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563509c11dc0 0x563509c19220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:39.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.067+0000 7f0655696640 1 -- 172.21.15.2:0/1535930494 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563509c1c680 msgr2=0x563509c19760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:39.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.067+0000 7f0655696640 1 --2- 172.21.15.2:0/1535930494 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563509c1c680 0x563509c19760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:39.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.067+0000 7f0655696640 1 -- 172.21.15.2:0/1535930494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563509c11dc0 msgr2=0x563509c19220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:39.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.067+0000 7f0655696640 1 --2- 172.21.15.2:0/1535930494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563509c11dc0 0x563509c19220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:39.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.067+0000 7f0655696640 1 -- 172.21.15.2:0/1535930494 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635098e83c0 con 0x563509c114a0 2024-09-19T06:16:39.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.067+0000 7f0655696640 1 --2- 172.21.15.2:0/1535930494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563509c114a0 0x563509c1bf70 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f064400f550 tx=0x7f0644004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7981ed621c09cadb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:39.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.067+0000 7f06357fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:16:39.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.067+0000 7f06357fa640 1 -- 172.21.15.2:0/1535930494 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0644012220 con 0x563509c114a0 2024-09-19T06:16:39.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.067+0000 7f06357fa640 1 -- 172.21.15.2:0/1535930494 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f0644005020 con 0x563509c114a0 2024-09-19T06:16:39.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.067+0000 7f065a4d4740 1 -- 172.21.15.2:0/1535930494 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0648018430 con 0x563509c114a0 2024-09-19T06:16:39.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.068+0000 7f06357fa640 1 -- 172.21.15.2:0/1535930494 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0644005220 con 0x563509c114a0 2024-09-19T06:16:39.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.068+0000 7f065a4d4740 10 client.15792 fetch_fsmap learned FSMap version 26 2024-09-19T06:16:39.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.068+0000 7f065a4d4740 1 -- 172.21.15.2:0/1535930494 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563509c2f080 con 0x563509c114a0 2024-09-19T06:16:39.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.068+0000 7f06357fa640 1 -- 172.21.15.2:0/1535930494 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0648018430 con 0x563509c114a0 2024-09-19T06:16:39.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.068+0000 7f06357fa640 1 -- 172.21.15.2:0/1535930494 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f064401d070 con 0x563509c114a0 2024-09-19T06:16:39.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.068+0000 7f065a4d4740 10 client.15792 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:16:39.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.068+0000 7f065a4d4740 10 client.15792 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:39.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.068+0000 7f065a4d4740 20 client.15792 populate_metadata read hostname 'smithi002' 2024-09-19T06:16:39.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.068+0000 7f065a4d4740 1 --2- 172.21.15.2:0/1535930494 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563509c30540 0x563509c32970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:39.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.068+0000 7f065a4d4740 4 client.15792 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:16:39.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.068+0000 7f065a4d4740 1 -- 172.21.15.2:0/1535930494 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563509b84850 con 0x563509c30540 2024-09-19T06:16:39.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.068+0000 7f0655e97640 1 --2- 172.21.15.2:0/1535930494 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563509c30540 0x563509c32970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:39.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.069+0000 7f0655e97640 1 --2- 172.21.15.2:0/1535930494 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563509c30540 0x563509c32970 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32b669fd80f81318 server_cookie=71b78d09cc3c9fc8 in_seq=0 out_seq=0 2024-09-19T06:16:39.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.069+0000 7f06357fa640 10 client.15792 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:39.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.069+0000 7f06357fa640 1 -- 172.21.15.2:0/1535930494 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563509b84850 con 0x563509c30540 2024-09-19T06:16:39.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.069+0000 7f06357fa640 10 client.15792 handle_command_reply: tid=0 2024-09-19T06:16:39.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.069+0000 7f065a4d4740 1 client.15792 shutdown 2024-09-19T06:16:39.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.070+0000 7f065a4d4740 1 -- 172.21.15.2:0/1535930494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563509c114a0 msgr2=0x563509c1bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:39.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.070+0000 7f065a4d4740 1 --2- 172.21.15.2:0/1535930494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563509c114a0 0x563509c1bf70 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f064400f550 tx=0x7f0644004730 comp rx=0 tx=0).stop 2024-09-19T06:16:39.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.070+0000 7f065a4d4740 1 -- 172.21.15.2:0/1535930494 shutdown_connections 2024-09-19T06:16:39.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.070+0000 7f065a4d4740 1 --2- 172.21.15.2:0/1535930494 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563509c1c680 0x563509c19760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:39.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.070+0000 7f065a4d4740 1 --2- 172.21.15.2:0/1535930494 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563509c30540 0x563509c32970 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:39.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.070+0000 7f065a4d4740 1 --2- 172.21.15.2:0/1535930494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563509c11dc0 0x563509c19220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:39.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.070+0000 7f065a4d4740 1 --2- 172.21.15.2:0/1535930494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563509c114a0 0x563509c1bf70 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:39.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.070+0000 7f065a4d4740 1 -- 172.21.15.2:0/1535930494 >> 172.21.15.2:0/1535930494 conn(0x563509c0da30 msgr2=0x563509c0cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:39.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.070+0000 7f06357fa640 0 client.15792 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:39.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.070+0000 7f065a4d4740 1 -- 172.21.15.2:0/1535930494 shutdown_connections 2024-09-19T06:16:39.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.070+0000 7f065a4d4740 1 -- 172.21.15.2:0/1535930494 wait complete. 2024-09-19T06:16:39.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.070+0000 7f065a4d4740 20 client.15792 trim_cache size 0 max 16384 2024-09-19T06:16:39.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.087+0000 7f065a4d4740 1 Processor -- start 2024-09-19T06:16:39.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.087+0000 7f065a4d4740 1 -- start start 2024-09-19T06:16:39.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.087+0000 7f065a4d4740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563509c114a0 0x563509c19fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:39.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.087+0000 7f065a4d4740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563509c11dc0 0x563509c2c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:39.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.087+0000 7f065a4d4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563509c1c680 0x563509c38240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:39.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.087+0000 7f065a4d4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f06501adbe0 con 0x563509c1c680 2024-09-19T06:16:39.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.087+0000 7f065a4d4740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f06501ab4b0 con 0x563509c11dc0 2024-09-19T06:16:39.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.087+0000 7f065a4d4740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f06501a9320 con 0x563509c114a0 2024-09-19T06:16:39.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.088+0000 7f0655696640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563509c1c680 0x563509c38240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:39.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.088+0000 7f0655696640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563509c1c680 0x563509c38240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53414/0 (socket says 172.21.15.2:53414) 2024-09-19T06:16:39.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.088+0000 7f0655696640 1 -- 172.21.15.2:0/1756246447 learned_addr learned my addr 172.21.15.2:0/1756246447 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:39.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.088+0000 7f0655696640 1 --2- 172.21.15.2:0/1756246447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563509c114a0 0x563509c19fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:39.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.088+0000 7f0655e97640 1 --2- 172.21.15.2:0/1756246447 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563509c11dc0 0x563509c2c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:39.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.088+0000 7f0655696640 1 -- 172.21.15.2:0/1756246447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563509c114a0 msgr2=0x563509c19fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:39.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.088+0000 7f0655696640 1 --2- 172.21.15.2:0/1756246447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563509c114a0 0x563509c19fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:39.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.088+0000 7f0655696640 1 -- 172.21.15.2:0/1756246447 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563509c11dc0 msgr2=0x563509c2c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:39.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.088+0000 7f0655696640 1 --2- 172.21.15.2:0/1756246447 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563509c11dc0 0x563509c2c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:39.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.088+0000 7f0655696640 1 -- 172.21.15.2:0/1756246447 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563509c32ff0 con 0x563509c1c680 2024-09-19T06:16:39.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.088+0000 7f0655696640 1 --2- 172.21.15.2:0/1756246447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563509c1c680 0x563509c38240 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f064400a330 tx=0x7f06440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74601c04d2206810 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:39.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.088+0000 7f06377fe640 1 -- 172.21.15.2:0/1756246447 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06440122c0 con 0x563509c1c680 2024-09-19T06:16:39.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.088+0000 7f06377fe640 1 -- 172.21.15.2:0/1756246447 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0644005530 con 0x563509c1c680 2024-09-19T06:16:39.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.088+0000 7f06377fe640 1 -- 172.21.15.2:0/1756246447 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0644004de0 con 0x563509c1c680 2024-09-19T06:16:39.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.089+0000 7f065a4d4740 1 -- 172.21.15.2:0/1756246447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563509c1c680 msgr2=0x563509c38240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:39.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.089+0000 7f065a4d4740 1 --2- 172.21.15.2:0/1756246447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563509c1c680 0x563509c38240 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f064400a330 tx=0x7f06440046c0 comp rx=0 tx=0).stop 2024-09-19T06:16:39.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.089+0000 7f065a4d4740 1 -- 172.21.15.2:0/1756246447 shutdown_connections 2024-09-19T06:16:39.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.089+0000 7f065a4d4740 1 --2- 172.21.15.2:0/1756246447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563509c1c680 0x563509c38240 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:39.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.089+0000 7f065a4d4740 1 --2- 172.21.15.2:0/1756246447 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563509c11dc0 0x563509c2c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:39.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.089+0000 7f065a4d4740 1 --2- 172.21.15.2:0/1756246447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563509c114a0 0x563509c19fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:39.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.089+0000 7f065a4d4740 1 -- 172.21.15.2:0/1756246447 >> 172.21.15.2:0/1756246447 conn(0x563509c0da30 msgr2=0x563509c17af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:39.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.089+0000 7f065a4d4740 1 -- 172.21.15.2:0/1756246447 shutdown_connections 2024-09-19T06:16:39.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.089+0000 7f065a4d4740 1 -- 172.21.15.2:0/1756246447 wait complete. 2024-09-19T06:16:39.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.089+0000 7f065a4d4740 1 -- start start 2024-09-19T06:16:39.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.090+0000 7f065a4d4740 1 Processor -- start 2024-09-19T06:16:39.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.090+0000 7f065a4d4740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563509c114a0 0x563509c29200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:39.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.090+0000 7f065a4d4740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563509c11dc0 0x563509c24580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:39.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.090+0000 7f065a4d4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563509c1c680 0x563509c24ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:39.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.090+0000 7f065a4d4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f06501a9970 con 0x563509c1c680 2024-09-19T06:16:39.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.090+0000 7f065a4d4740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f06501aade0 con 0x563509c114a0 2024-09-19T06:16:39.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.090+0000 7f065a4d4740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f06501aa040 con 0x563509c11dc0 2024-09-19T06:16:39.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.090+0000 7f065a4d4740 10 client.0 _ll_register_callbacks cb 0x7f064400f420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:39.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.090+0000 7f0655696640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563509c1c680 0x563509c24ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:39.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.090+0000 7f0655696640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563509c114a0 0x563509c29200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:39.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.090+0000 7f0655696640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563509c114a0 0x563509c29200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:49336/0 (socket says 172.21.15.2:49336) 2024-09-19T06:16:39.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.090+0000 7f0655696640 1 -- 172.21.15.2:0/322294543 learned_addr learned my addr 172.21.15.2:0/322294543 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:39.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.090+0000 7f0655e97640 1 --2- 172.21.15.2:0/322294543 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563509c11dc0 0x563509c24580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:39.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.091+0000 7f0655696640 1 -- 172.21.15.2:0/322294543 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563509c11dc0 msgr2=0x563509c24580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:39.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.091+0000 7f0655696640 1 --2- 172.21.15.2:0/322294543 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563509c11dc0 0x563509c24580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:39.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.091+0000 7f0655696640 1 -- 172.21.15.2:0/322294543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563509c1c680 msgr2=0x563509c24ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:39.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.091+0000 7f0655696640 1 --2- 172.21.15.2:0/322294543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563509c1c680 0x563509c24ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:39.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.091+0000 7f0655696640 1 -- 172.21.15.2:0/322294543 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563509c25310 con 0x563509c114a0 2024-09-19T06:16:39.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.091+0000 7f0655696640 1 --2- 172.21.15.2:0/322294543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563509c114a0 0x563509c29200 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f064400af50 tx=0x7f0644012d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae7b6e6b19316c18 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:39.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.091+0000 7f06357fa640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-09-19T06:16:39.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.091+0000 7f06357fa640 1 -- 172.21.15.2:0/322294543 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06440122f0 con 0x563509c114a0 2024-09-19T06:16:39.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.091+0000 7f06357fa640 1 -- 172.21.15.2:0/322294543 <== mon.2 v2:172.21.15.89:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f064400ea50 con 0x563509c114a0 2024-09-19T06:16:39.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.091+0000 7f065a4d4740 1 -- 172.21.15.2:0/322294543 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563509c19af0 con 0x563509c114a0 2024-09-19T06:16:39.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.091+0000 7f06357fa640 1 -- 172.21.15.2:0/322294543 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f064400ec50 con 0x563509c114a0 2024-09-19T06:16:39.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.092+0000 7f065a4d4740 10 client.25430 fetch_fsmap learned FSMap version 26 2024-09-19T06:16:39.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.092+0000 7f065a4d4740 1 -- 172.21.15.2:0/322294543 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563509c9b2b0 con 0x563509c114a0 2024-09-19T06:16:39.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.092+0000 7f06357fa640 1 -- 172.21.15.2:0/322294543 <== mon.2 v2:172.21.15.89:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x563509c19af0 con 0x563509c114a0 2024-09-19T06:16:39.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.092+0000 7f06357fa640 1 -- 172.21.15.2:0/322294543 <== mon.2 v2:172.21.15.89:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f064401d070 con 0x563509c114a0 2024-09-19T06:16:39.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.092+0000 7f065a4d4740 10 client.25430 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:16:39.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.092+0000 7f065a4d4740 10 client.25430 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:39.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.092+0000 7f065a4d4740 20 client.25430 populate_metadata read hostname 'smithi002' 2024-09-19T06:16:39.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.092+0000 7f065a4d4740 1 --2- 172.21.15.2:0/322294543 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563509c9b8c0 0x563509c9dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:39.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.092+0000 7f065a4d4740 4 client.25430 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:16:39.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.092+0000 7f065a4d4740 1 -- 172.21.15.2:0/322294543 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563509b7ed60 con 0x563509c9b8c0 2024-09-19T06:16:39.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.092+0000 7f0655e97640 1 --2- 172.21.15.2:0/322294543 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563509c9b8c0 0x563509c9dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:39.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.093+0000 7f0655e97640 1 --2- 172.21.15.2:0/322294543 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563509c9b8c0 0x563509c9dcb0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91d72639c0c31be8 server_cookie=91374d58c693473a in_seq=0 out_seq=0 2024-09-19T06:16:39.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.093+0000 7f06357fa640 10 client.25430 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:39.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.093+0000 7f06357fa640 1 -- 172.21.15.2:0/322294543 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x563509b7ed60 con 0x563509c9b8c0 2024-09-19T06:16:39.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.093+0000 7f06357fa640 10 client.25430 handle_command_reply: tid=0 2024-09-19T06:16:39.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.093+0000 7f065a4d4740 1 client.25430 shutdown 2024-09-19T06:16:39.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.093+0000 7f065a4d4740 1 -- 172.21.15.2:0/322294543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563509c114a0 msgr2=0x563509c29200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:39.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.093+0000 7f065a4d4740 1 --2- 172.21.15.2:0/322294543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563509c114a0 0x563509c29200 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f064400af50 tx=0x7f0644012d20 comp rx=0 tx=0).stop 2024-09-19T06:16:39.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.093+0000 7f065a4d4740 1 -- 172.21.15.2:0/322294543 shutdown_connections 2024-09-19T06:16:39.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.093+0000 7f065a4d4740 1 --2- 172.21.15.2:0/322294543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563509c1c680 0x563509c24ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:39.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.093+0000 7f065a4d4740 1 --2- 172.21.15.2:0/322294543 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563509c11dc0 0x563509c24580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:39.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.093+0000 7f065a4d4740 1 --2- 172.21.15.2:0/322294543 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563509c9b8c0 0x563509c9dcb0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:39.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.093+0000 7f065a4d4740 1 --2- 172.21.15.2:0/322294543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563509c114a0 0x563509c29200 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:39.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.093+0000 7f065a4d4740 1 -- 172.21.15.2:0/322294543 >> 172.21.15.2:0/322294543 conn(0x563509c0da30 msgr2=0x563509c13760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:39.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.093+0000 7f06357fa640 0 client.25430 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:39.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.093+0000 7f065a4d4740 1 -- 172.21.15.2:0/322294543 shutdown_connections 2024-09-19T06:16:39.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.093+0000 7f065a4d4740 1 -- 172.21.15.2:0/322294543 wait complete. 2024-09-19T06:16:39.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.093+0000 7f065a4d4740 20 client.25430 trim_cache size 0 max 16384 2024-09-19T06:16:39.100 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:16:39.100 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T06:16:39.100 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T06:16:39.100 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:16:39.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.094+0000 7f06580fb640 1 -- 172.21.15.2:0/2818056850 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f06380a33b0 msgr2=0x7f06380a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:39.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.094+0000 7f06580fb640 1 --2- 172.21.15.2:0/2818056850 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f06380a33b0 0x7f06380a5870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f064008f610 tx=0x7f064008f640 comp rx=0 tx=0).stop 2024-09-19T06:16:39.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.094+0000 7f06580fb640 1 -- 172.21.15.2:0/2818056850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0650102ef0 msgr2=0x7f065019cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:39.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.094+0000 7f06580fb640 1 --2- 172.21.15.2:0/2818056850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0650102ef0 0x7f065019cbc0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f0640003cb0 tx=0x7f0640003ce0 comp rx=0 tx=0).stop 2024-09-19T06:16:39.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.094+0000 7f06580fb640 1 -- 172.21.15.2:0/2818056850 shutdown_connections 2024-09-19T06:16:39.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.094+0000 7f06580fb640 1 --2- 172.21.15.2:0/2818056850 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f06380a33b0 0x7f06380a5870 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:39.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.094+0000 7f06580fb640 1 --2- 172.21.15.2:0/2818056850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0650102ef0 0x7f065019cbc0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:39.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.094+0000 7f06580fb640 1 --2- 172.21.15.2:0/2818056850 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0650102570 0x7f0650198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:39.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.094+0000 7f06580fb640 1 --2- 172.21.15.2:0/2818056850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0650100e20 0x7f06501982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:39.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.094+0000 7f06580fb640 1 -- 172.21.15.2:0/2818056850 >> 172.21.15.2:0/2818056850 conn(0x7f06500fc7d0 msgr2=0x7f065006a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:39.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.094+0000 7f06580fb640 1 -- 172.21.15.2:0/2818056850 shutdown_connections 2024-09-19T06:16:39.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:39.094+0000 7f06580fb640 1 -- 172.21.15.2:0/2818056850 wait complete. 2024-09-19T06:16:39.613 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:39 smithi002 ceph-mon[30982]: pgmap v58: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 24 MiB/s wr, 14 op/s 2024-09-19T06:16:39.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:39 smithi090 ceph-mon[34497]: pgmap v58: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 24 MiB/s wr, 14 op/s 2024-09-19T06:16:39.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:39 smithi089 ceph-mon[34160]: pgmap v58: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 24 MiB/s wr, 14 op/s 2024-09-19T06:16:39.819 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-19T06:16:39.819 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-19T06:16:39.819 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-19T06:16:39.819 INFO:tasks.workunit.client.0.smithi002.stdout:iozone test complete. 2024-09-19T06:16:39.820 INFO:tasks.workunit.client.0.smithi002.stderr:+ iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-09-19T06:16:39.886 INFO:tasks.workunit.client.0.smithi002.stdout: Iozone: Performance Test of File I/O 2024-09-19T06:16:39.886 INFO:tasks.workunit.client.0.smithi002.stdout: Version $Revision: 3.494 $ 2024-09-19T06:16:39.886 INFO:tasks.workunit.client.0.smithi002.stdout: Compiled for 64 bit mode. 2024-09-19T06:16:39.886 INFO:tasks.workunit.client.0.smithi002.stdout: Build: linux-AMD64 2024-09-19T06:16:39.886 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-19T06:16:39.886 INFO:tasks.workunit.client.0.smithi002.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-09-19T06:16:39.886 INFO:tasks.workunit.client.0.smithi002.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-09-19T06:16:39.887 INFO:tasks.workunit.client.0.smithi002.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-09-19T06:16:39.887 INFO:tasks.workunit.client.0.smithi002.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-09-19T06:16:39.887 INFO:tasks.workunit.client.0.smithi002.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-09-19T06:16:39.887 INFO:tasks.workunit.client.0.smithi002.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-09-19T06:16:39.887 INFO:tasks.workunit.client.0.smithi002.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-09-19T06:16:39.887 INFO:tasks.workunit.client.0.smithi002.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-09-19T06:16:39.887 INFO:tasks.workunit.client.0.smithi002.stdout: Alexey Skidanov, Sudhir Kumar. 2024-09-19T06:16:39.887 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-19T06:16:39.887 INFO:tasks.workunit.client.0.smithi002.stdout: Run began: Thu Sep 19 06:16:39 2024 2024-09-19T06:16:39.887 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-19T06:16:39.887 INFO:tasks.workunit.client.0.smithi002.stdout: Include close in write timing 2024-09-19T06:16:39.887 INFO:tasks.workunit.client.0.smithi002.stdout: Include fsync in write timing 2024-09-19T06:16:39.887 INFO:tasks.workunit.client.0.smithi002.stdout: File size set to 1048576 kB 2024-09-19T06:16:39.887 INFO:tasks.workunit.client.0.smithi002.stdout: Record Size 1024 kB 2024-09-19T06:16:39.888 INFO:tasks.workunit.client.0.smithi002.stdout: Command line used: iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-09-19T06:16:39.888 INFO:tasks.workunit.client.0.smithi002.stdout: Output is in kBytes/sec 2024-09-19T06:16:39.888 INFO:tasks.workunit.client.0.smithi002.stdout: Time Resolution = 0.000001 seconds. 2024-09-19T06:16:39.888 INFO:tasks.workunit.client.0.smithi002.stdout: Processor cache size set to 1024 kBytes. 2024-09-19T06:16:39.888 INFO:tasks.workunit.client.0.smithi002.stdout: Processor cache line size set to 32 bytes. 2024-09-19T06:16:39.888 INFO:tasks.workunit.client.0.smithi002.stdout: File stride size set to 17 * record size. 2024-09-19T06:16:39.888 INFO:tasks.workunit.client.0.smithi002.stdout: Throughput test with 1 process 2024-09-19T06:16:39.888 INFO:tasks.workunit.client.0.smithi002.stdout: Each process writes a 1048576 kByte file in 1024 kByte records 2024-09-19T06:16:40.081 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:16:40.082 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:16:40.511 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:16:41.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.094+0000 7f9d9e843640 1 -- 172.21.15.2:0/1389986619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d98077040 msgr2=0x7f9d98112510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:41.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.094+0000 7f9d9e843640 1 --2- 172.21.15.2:0/1389986619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d98077040 0x7f9d98112510 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c009900 tx=0x7f9d8c02a3f0 comp rx=0 tx=0).stop 2024-09-19T06:16:41.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.095+0000 7f9d9e843640 1 -- 172.21.15.2:0/1389986619 shutdown_connections 2024-09-19T06:16:41.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.095+0000 7f9d9e843640 1 --2- 172.21.15.2:0/1389986619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d98112a50 0x7f9d98114e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:41.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.095+0000 7f9d9e843640 1 --2- 172.21.15.2:0/1389986619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d98077040 0x7f9d98112510 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:41.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.095+0000 7f9d9e843640 1 --2- 172.21.15.2:0/1389986619 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d98076720 0x7f9d98076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:41.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.095+0000 7f9d9e843640 1 -- 172.21.15.2:0/1389986619 >> 172.21.15.2:0/1389986619 conn(0x7f9d980ffa50 msgr2=0x7f9d98101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:41.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.095+0000 7f9d9e843640 1 -- 172.21.15.2:0/1389986619 shutdown_connections 2024-09-19T06:16:41.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.095+0000 7f9d9e843640 1 -- 172.21.15.2:0/1389986619 wait complete. 2024-09-19T06:16:41.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.096+0000 7f9d9e843640 1 Processor -- start 2024-09-19T06:16:41.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.096+0000 7f9d9e843640 1 -- start start 2024-09-19T06:16:41.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.097+0000 7f9d9e843640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d98076720 0x7f9d981a4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:41.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.097+0000 7f9d9e843640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d98077040 0x7f9d981a4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:41.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.097+0000 7f9d9e843640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d98112a50 0x7f9d9819e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:41.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.097+0000 7f9d977fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d98077040 0x7f9d981a4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:41.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.097+0000 7f9d9e843640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9d98118470 con 0x7f9d98077040 2024-09-19T06:16:41.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.097+0000 7f9d97fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d98076720 0x7f9d981a4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:41.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.097+0000 7f9d977fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d98077040 0x7f9d981a4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53422/0 (socket says 172.21.15.2:53422) 2024-09-19T06:16:41.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.097+0000 7f9d977fe640 1 -- 172.21.15.2:0/1160127958 learned_addr learned my addr 172.21.15.2:0/1160127958 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:41.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.097+0000 7f9d9e843640 1 -- 172.21.15.2:0/1160127958 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9d981182f0 con 0x7f9d98112a50 2024-09-19T06:16:41.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.097+0000 7f9d9e843640 1 -- 172.21.15.2:0/1160127958 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9d981185f0 con 0x7f9d98076720 2024-09-19T06:16:41.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.097+0000 7f9d9cde0640 1 --2- 172.21.15.2:0/1160127958 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d98112a50 0x7f9d9819e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:41.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.098+0000 7f9d9cde0640 1 -- 172.21.15.2:0/1160127958 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d98076720 msgr2=0x7f9d981a4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:41.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.098+0000 7f9d9cde0640 1 --2- 172.21.15.2:0/1160127958 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d98076720 0x7f9d981a4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:41.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.098+0000 7f9d9cde0640 1 -- 172.21.15.2:0/1160127958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d98077040 msgr2=0x7f9d981a4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:41.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.098+0000 7f9d9cde0640 1 --2- 172.21.15.2:0/1160127958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d98077040 0x7f9d981a4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:41.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.098+0000 7f9d9cde0640 1 -- 172.21.15.2:0/1160127958 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d9819ef40 con 0x7f9d98112a50 2024-09-19T06:16:41.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.098+0000 7f9d9cde0640 1 --2- 172.21.15.2:0/1160127958 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d98112a50 0x7f9d9819e7a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9d9807aa10 tx=0x7f9d9000cdd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:41.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.098+0000 7f9d957fa640 1 -- 172.21.15.2:0/1160127958 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d90004d20 con 0x7f9d98112a50 2024-09-19T06:16:41.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.098+0000 7f9d957fa640 1 -- 172.21.15.2:0/1160127958 <== mon.2 v2:172.21.15.89:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9d90005020 con 0x7f9d98112a50 2024-09-19T06:16:41.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.098+0000 7f9d957fa640 1 -- 172.21.15.2:0/1160127958 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d9000f690 con 0x7f9d98112a50 2024-09-19T06:16:41.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.098+0000 7f9d9e843640 1 -- 172.21.15.2:0/1160127958 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d9819f230 con 0x7f9d98112a50 2024-09-19T06:16:41.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.099+0000 7f9d9e843640 1 -- 172.21.15.2:0/1160127958 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d981ab480 con 0x7f9d98112a50 2024-09-19T06:16:41.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.100+0000 7f9d7effd640 1 -- 172.21.15.2:0/1160127958 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d98077e60 con 0x7f9d98112a50 2024-09-19T06:16:41.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.101+0000 7f9d957fa640 1 -- 172.21.15.2:0/1160127958 <== mon.2 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f9d900051d0 con 0x7f9d98112a50 2024-09-19T06:16:41.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.102+0000 7f9d957fa640 1 --2- 172.21.15.2:0/1160127958 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9d800a3430 0x7f9d800a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:41.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.102+0000 7f9d957fa640 1 -- 172.21.15.2:0/1160127958 <== mon.2 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f9d900cff90 con 0x7f9d98112a50 2024-09-19T06:16:41.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.102+0000 7f9d97fff640 1 --2- 172.21.15.2:0/1160127958 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9d800a3430 0x7f9d800a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:41.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.103+0000 7f9d97fff640 1 --2- 172.21.15.2:0/1160127958 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9d800a3430 0x7f9d800a58f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9d8800abe0 tx=0x7f9d8800a2d0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:41.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.106+0000 7f9d957fa640 1 -- 172.21.15.2:0/1160127958 <== mon.2 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9d90014070 con 0x7f9d98112a50 2024-09-19T06:16:41.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.455+0000 7f9d7effd640 1 -- 172.21.15.2:0/1160127958 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d98076b00 con 0x7f9d98112a50 2024-09-19T06:16:41.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.457+0000 7f9d957fa640 1 -- 172.21.15.2:0/1160127958 <== mon.2 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11882 (secure 0 0 0) 0x7f9d9009ca20 con 0x7f9d98112a50 2024-09-19T06:16:41.459 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:16:41.459 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-09-19T06:14:49:104280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:14:48.191083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24470,24472,24497]},"id":1}]} 2024-09-19T06:16:41.459 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-09-19T06:16:41.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.459+0000 7f9d7effd640 1 -- 172.21.15.2:0/1160127958 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9d800a3430 msgr2=0x7f9d800a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:41.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.459+0000 7f9d7effd640 1 --2- 172.21.15.2:0/1160127958 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9d800a3430 0x7f9d800a58f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9d8800abe0 tx=0x7f9d8800a2d0 comp rx=0 tx=0).stop 2024-09-19T06:16:41.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.459+0000 7f9d7effd640 1 -- 172.21.15.2:0/1160127958 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d98112a50 msgr2=0x7f9d9819e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:41.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.459+0000 7f9d7effd640 1 --2- 172.21.15.2:0/1160127958 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d98112a50 0x7f9d9819e7a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9d9807aa10 tx=0x7f9d9000cdd0 comp rx=0 tx=0).stop 2024-09-19T06:16:41.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.460+0000 7f9d7effd640 1 -- 172.21.15.2:0/1160127958 shutdown_connections 2024-09-19T06:16:41.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.460+0000 7f9d7effd640 1 --2- 172.21.15.2:0/1160127958 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9d800a3430 0x7f9d800a58f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:41.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.460+0000 7f9d7effd640 1 --2- 172.21.15.2:0/1160127958 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d98112a50 0x7f9d9819e7a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:41.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.460+0000 7f9d7effd640 1 --2- 172.21.15.2:0/1160127958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d98077040 0x7f9d981a4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:41.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.460+0000 7f9d7effd640 1 --2- 172.21.15.2:0/1160127958 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d98076720 0x7f9d981a4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:41.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.460+0000 7f9d7effd640 1 -- 172.21.15.2:0/1160127958 >> 172.21.15.2:0/1160127958 conn(0x7f9d980ffa50 msgr2=0x7f9d98101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:41.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.460+0000 7f9d7effd640 1 -- 172.21.15.2:0/1160127958 shutdown_connections 2024-09-19T06:16:41.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:41.460+0000 7f9d7effd640 1 -- 172.21.15.2:0/1160127958 wait complete. 2024-09-19T06:16:41.692 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-19T06:16:41.692 INFO:tasks.workunit.client.0.smithi002.stdout: Children see throughput for 1 initial writers = 593808.69 kB/sec 2024-09-19T06:16:41.692 INFO:tasks.workunit.client.0.smithi002.stdout: Parent sees throughput for 1 initial writers = 593741.86 kB/sec 2024-09-19T06:16:41.693 INFO:tasks.workunit.client.0.smithi002.stdout: Min throughput per process = 593808.69 kB/sec 2024-09-19T06:16:41.693 INFO:tasks.workunit.client.0.smithi002.stdout: Max throughput per process = 593808.69 kB/sec 2024-09-19T06:16:41.693 INFO:tasks.workunit.client.0.smithi002.stdout: Avg throughput per process = 593808.69 kB/sec 2024-09-19T06:16:41.693 INFO:tasks.workunit.client.0.smithi002.stdout: Min xfer = 1048576.00 kB 2024-09-19T06:16:41.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:41 smithi002 ceph-mon[30982]: pgmap v59: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 24 MiB/s wr, 18 op/s 2024-09-19T06:16:41.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:41 smithi090 ceph-mon[34497]: pgmap v59: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 24 MiB/s wr, 18 op/s 2024-09-19T06:16:41.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:41 smithi089 ceph-mon[34160]: pgmap v59: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 24 MiB/s wr, 18 op/s 2024-09-19T06:16:42.617 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:42 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1160127958' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:16:42.619 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:16:42.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:42 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1160127958' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:16:42.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:42 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1160127958' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:16:42.884 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:16:43.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.294+0000 7f6e84517640 1 -- 172.21.15.2:0/590776030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e7c103780 msgr2=0x7f6e7c107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:43.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.294+0000 7f6e84517640 1 --2- 172.21.15.2:0/590776030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e7c103780 0x7f6e7c107bc0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c009930 tx=0x7f6e6c02a420 comp rx=0 tx=0).stop 2024-09-19T06:16:43.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.294+0000 7f6e84517640 1 -- 172.21.15.2:0/590776030 shutdown_connections 2024-09-19T06:16:43.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.294+0000 7f6e84517640 1 --2- 172.21.15.2:0/590776030 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e7c108300 0x7f6e7c10ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:43.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.294+0000 7f6e84517640 1 --2- 172.21.15.2:0/590776030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e7c103780 0x7f6e7c107bc0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:43.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.294+0000 7f6e84517640 1 --2- 172.21.15.2:0/590776030 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e7c102dd0 0x7f6e7c1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:43.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.294+0000 7f6e84517640 1 -- 172.21.15.2:0/590776030 >> 172.21.15.2:0/590776030 conn(0x7f6e7c0fc7d0 msgr2=0x7f6e7c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:43.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.294+0000 7f6e84517640 1 -- 172.21.15.2:0/590776030 shutdown_connections 2024-09-19T06:16:43.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.294+0000 7f6e84517640 1 -- 172.21.15.2:0/590776030 wait complete. 2024-09-19T06:16:43.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.295+0000 7f6e84517640 1 Processor -- start 2024-09-19T06:16:43.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.295+0000 7f6e84517640 1 -- start start 2024-09-19T06:16:43.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.295+0000 7f6e84517640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e7c102dd0 0x7f6e7c100a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:43.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.295+0000 7f6e84517640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e7c103780 0x7f6e7c100f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:43.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.295+0000 7f6e84517640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e7c108300 0x7f6e7c1014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:43.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.295+0000 7f6e84517640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7c111f20 con 0x7f6e7c103780 2024-09-19T06:16:43.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.295+0000 7f6e84517640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7c111da0 con 0x7f6e7c102dd0 2024-09-19T06:16:43.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.295+0000 7f6e84517640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7c1120a0 con 0x7f6e7c108300 2024-09-19T06:16:43.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.295+0000 7f6e81ab2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e7c103780 0x7f6e7c100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:43.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.295+0000 7f6e81ab2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e7c103780 0x7f6e7c100f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53426/0 (socket says 172.21.15.2:53426) 2024-09-19T06:16:43.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.295+0000 7f6e81ab2640 1 -- 172.21.15.2:0/3635270460 learned_addr learned my addr 172.21.15.2:0/3635270460 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:43.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.295+0000 7f6e822b3640 1 --2- 172.21.15.2:0/3635270460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e7c102dd0 0x7f6e7c100a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:43.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.295+0000 7f6e82ab4640 1 --2- 172.21.15.2:0/3635270460 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e7c108300 0x7f6e7c1014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:43.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.296+0000 7f6e822b3640 1 -- 172.21.15.2:0/3635270460 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e7c108300 msgr2=0x7f6e7c1014b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:43.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.296+0000 7f6e822b3640 1 --2- 172.21.15.2:0/3635270460 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e7c108300 0x7f6e7c1014b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:43.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.296+0000 7f6e822b3640 1 -- 172.21.15.2:0/3635270460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e7c103780 msgr2=0x7f6e7c100f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:43.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.296+0000 7f6e822b3640 1 --2- 172.21.15.2:0/3635270460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e7c103780 0x7f6e7c100f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:43.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.296+0000 7f6e822b3640 1 -- 172.21.15.2:0/3635270460 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e7c1a69e0 con 0x7f6e7c102dd0 2024-09-19T06:16:43.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.296+0000 7f6e81ab2640 1 --2- 172.21.15.2:0/3635270460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e7c103780 0x7f6e7c100f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:43.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.296+0000 7f6e822b3640 1 --2- 172.21.15.2:0/3635270460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e7c102dd0 0x7f6e7c100a30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6e78009fd0 tx=0x7f6e7800ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:43.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.296+0000 7f6e737fe640 1 -- 172.21.15.2:0/3635270460 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e78004b20 con 0x7f6e7c102dd0 2024-09-19T06:16:43.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.296+0000 7f6e84517640 1 -- 172.21.15.2:0/3635270460 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e7c1a6cd0 con 0x7f6e7c102dd0 2024-09-19T06:16:43.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.296+0000 7f6e737fe640 1 -- 172.21.15.2:0/3635270460 <== mon.2 v2:172.21.15.89:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6e78004cc0 con 0x7f6e7c102dd0 2024-09-19T06:16:43.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.296+0000 7f6e737fe640 1 -- 172.21.15.2:0/3635270460 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e78010720 con 0x7f6e7c102dd0 2024-09-19T06:16:43.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.296+0000 7f6e84517640 1 -- 172.21.15.2:0/3635270460 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e7c1a7190 con 0x7f6e7c102dd0 2024-09-19T06:16:43.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.299+0000 7f6e868f0740 1 Processor -- start 2024-09-19T06:16:43.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.299+0000 7f6e868f0740 1 -- start start 2024-09-19T06:16:43.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.299+0000 7f6e868f0740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55767d873b40 0x55767d872090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:43.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.299+0000 7f6e868f0740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55767d8725d0 0x55767d872a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:43.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.300+0000 7f6e868f0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55767d87d370 0x55767d87f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:43.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.300+0000 7f6e868f0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55767d7d82f0 con 0x55767d87d370 2024-09-19T06:16:43.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.300+0000 7f6e868f0740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55767d77fcf0 con 0x55767d8725d0 2024-09-19T06:16:43.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.300+0000 7f6e868f0740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55767d7d42b0 con 0x55767d873b40 2024-09-19T06:16:43.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.300+0000 7f6e737fe640 1 -- 172.21.15.2:0/3635270460 <== mon.2 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f6e78005020 con 0x7f6e7c102dd0 2024-09-19T06:16:43.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.300+0000 7f6e81ab2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55767d87d370 0x55767d87f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:43.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.300+0000 7f6e81ab2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55767d87d370 0x55767d87f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53430/0 (socket says 172.21.15.2:53430) 2024-09-19T06:16:43.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.300+0000 7f6e81ab2640 1 -- 172.21.15.2:0/414021624 learned_addr learned my addr 172.21.15.2:0/414021624 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:43.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.300+0000 7f6e82ab4640 1 --2- 172.21.15.2:0/414021624 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55767d873b40 0x55767d872090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:43.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.300+0000 7f6e822b3640 1 --2- 172.21.15.2:0/414021624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55767d8725d0 0x55767d872a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:43.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.300+0000 7f6e81ab2640 1 -- 172.21.15.2:0/414021624 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55767d873b40 msgr2=0x55767d872090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:43.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.300+0000 7f6e81ab2640 1 --2- 172.21.15.2:0/414021624 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55767d873b40 0x55767d872090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:43.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.300+0000 7f6e81ab2640 1 -- 172.21.15.2:0/414021624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55767d8725d0 msgr2=0x55767d872a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:43.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.300+0000 7f6e81ab2640 1 --2- 172.21.15.2:0/414021624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55767d8725d0 0x55767d872a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:43.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.300+0000 7f6e81ab2640 1 -- 172.21.15.2:0/414021624 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55767d7643a0 con 0x55767d87d370 2024-09-19T06:16:43.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.300+0000 7f6e81ab2640 1 --2- 172.21.15.2:0/414021624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55767d87d370 0x55767d87f760 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c009230 tx=0x7f6e6c032f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48ff4ce73e27c13f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:43.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.301+0000 7f6e70ff9640 1 -- 172.21.15.2:0/414021624 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c035040 con 0x55767d87d370 2024-09-19T06:16:43.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.301+0000 7f6e70ff9640 1 -- 172.21.15.2:0/414021624 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6e6c0317a0 con 0x55767d87d370 2024-09-19T06:16:43.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.301+0000 7f6e70ff9640 1 -- 172.21.15.2:0/414021624 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c004a00 con 0x55767d87d370 2024-09-19T06:16:43.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.301+0000 7f6e737fe640 1 --2- 172.21.15.2:0/3635270460 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f6e680a33b0 0x7f6e680a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:43.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.301+0000 7f6e82ab4640 1 --2- 172.21.15.2:0/3635270460 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f6e680a33b0 0x7f6e680a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:43.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.301+0000 7f6e737fe640 1 -- 172.21.15.2:0/3635270460 <== mon.2 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f6e780d0500 con 0x7f6e7c102dd0 2024-09-19T06:16:43.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.301+0000 7f6e868f0740 1 -- 172.21.15.2:0/414021624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55767d87d370 msgr2=0x55767d87f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:43.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.301+0000 7f6e82ab4640 1 --2- 172.21.15.2:0/3635270460 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f6e680a33b0 0x7f6e680a5870 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6e74009c70 tx=0x7f6e74005f90 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:43.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.301+0000 7f6e868f0740 1 --2- 172.21.15.2:0/414021624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55767d87d370 0x55767d87f760 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c009230 tx=0x7f6e6c032f20 comp rx=0 tx=0).stop 2024-09-19T06:16:43.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.301+0000 7f6e868f0740 1 -- 172.21.15.2:0/414021624 shutdown_connections 2024-09-19T06:16:43.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.301+0000 7f6e868f0740 1 --2- 172.21.15.2:0/414021624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55767d87d370 0x55767d87f760 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:43.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.301+0000 7f6e868f0740 1 --2- 172.21.15.2:0/414021624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55767d8725d0 0x55767d872a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:43.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.301+0000 7f6e868f0740 1 --2- 172.21.15.2:0/414021624 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55767d873b40 0x55767d872090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:43.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.301+0000 7f6e868f0740 1 -- 172.21.15.2:0/414021624 >> 172.21.15.2:0/414021624 conn(0x55767d83b310 msgr2=0x55767d86ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:43.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.301+0000 7f6e868f0740 1 -- 172.21.15.2:0/414021624 shutdown_connections 2024-09-19T06:16:43.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.302+0000 7f6e868f0740 1 -- 172.21.15.2:0/414021624 wait complete. 2024-09-19T06:16:43.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.302+0000 7f6e868f0740 1 -- start start 2024-09-19T06:16:43.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.302+0000 7f6e868f0740 1 Processor -- start 2024-09-19T06:16:43.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.302+0000 7f6e868f0740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55767d8725d0 0x55767d87cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:43.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.302+0000 7f6e868f0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55767d873b40 0x55767d879fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:43.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.302+0000 7f6e868f0740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55767d87d370 0x55767d87a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:43.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.302+0000 7f6e868f0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55767d880010 con 0x55767d873b40 2024-09-19T06:16:43.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.302+0000 7f6e868f0740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55767d793060 con 0x55767d8725d0 2024-09-19T06:16:43.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.302+0000 7f6e868f0740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55767d880190 con 0x55767d87d370 2024-09-19T06:16:43.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.302+0000 7f6e868f0740 10 client.0 _ll_register_callbacks cb 0x55767d4e68c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:43.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.302+0000 7f6e81ab2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55767d873b40 0x55767d879fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:43.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.302+0000 7f6e81ab2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55767d873b40 0x55767d879fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53438/0 (socket says 172.21.15.2:53438) 2024-09-19T06:16:43.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.302+0000 7f6e81ab2640 1 -- 172.21.15.2:0/3957008311 learned_addr learned my addr 172.21.15.2:0/3957008311 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:43.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.302+0000 7f6e82ab4640 1 --2- 172.21.15.2:0/3957008311 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55767d87d370 0x55767d87a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:43.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.303+0000 7f6e822b3640 1 --2- 172.21.15.2:0/3957008311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55767d8725d0 0x55767d87cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:43.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.303+0000 7f6e81ab2640 1 -- 172.21.15.2:0/3957008311 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55767d87d370 msgr2=0x55767d87a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:43.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.303+0000 7f6e81ab2640 1 --2- 172.21.15.2:0/3957008311 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55767d87d370 0x55767d87a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:43.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.303+0000 7f6e81ab2640 1 -- 172.21.15.2:0/3957008311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55767d8725d0 msgr2=0x55767d87cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:43.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.303+0000 7f6e81ab2640 1 --2- 172.21.15.2:0/3957008311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55767d8725d0 0x55767d87cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:43.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.303+0000 7f6e81ab2640 1 -- 172.21.15.2:0/3957008311 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55767d5493c0 con 0x55767d873b40 2024-09-19T06:16:43.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.303+0000 7f6e822b3640 1 --2- 172.21.15.2:0/3957008311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55767d8725d0 0x55767d87cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:16:43.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.303+0000 7f6e81ab2640 1 --2- 172.21.15.2:0/3957008311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55767d873b40 0x55767d879fe0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c02ab40 tx=0x7f6e6c02ab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca7ca91e52969cdc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:43.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.303+0000 7f6e65ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:16:43.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.303+0000 7f6e65ffb640 1 -- 172.21.15.2:0/3957008311 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c04e070 con 0x55767d873b40 2024-09-19T06:16:43.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.303+0000 7f6e65ffb640 1 -- 172.21.15.2:0/3957008311 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f6e6c004250 con 0x55767d873b40 2024-09-19T06:16:43.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.303+0000 7f6e868f0740 1 -- 172.21.15.2:0/3957008311 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e6c0317a0 con 0x55767d873b40 2024-09-19T06:16:43.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.303+0000 7f6e65ffb640 1 -- 172.21.15.2:0/3957008311 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6e6c05a050 con 0x55767d873b40 2024-09-19T06:16:43.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.303+0000 7f6e868f0740 10 client.15816 fetch_fsmap learned FSMap version 26 2024-09-19T06:16:43.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.303+0000 7f6e868f0740 1 -- 172.21.15.2:0/3957008311 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55767d88ba70 con 0x55767d873b40 2024-09-19T06:16:43.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.303+0000 7f6e65ffb640 1 -- 172.21.15.2:0/3957008311 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6e6c0317a0 con 0x55767d873b40 2024-09-19T06:16:43.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.304+0000 7f6e65ffb640 1 -- 172.21.15.2:0/3957008311 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f6e6c0035f0 con 0x55767d873b40 2024-09-19T06:16:43.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.304+0000 7f6e868f0740 10 client.15816 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:16:43.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.304+0000 7f6e868f0740 10 client.15816 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:16:43.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.304+0000 7f6e868f0740 20 client.15816 populate_metadata read hostname 'smithi002' 2024-09-19T06:16:43.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.304+0000 7f6e868f0740 1 --2- 172.21.15.2:0/3957008311 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55767d88ce10 0x55767d88f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:43.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.304+0000 7f6e868f0740 4 client.15816 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:16:43.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.304+0000 7f6e868f0740 1 -- 172.21.15.2:0/3957008311 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55767d7e5860 con 0x55767d88ce10 2024-09-19T06:16:43.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.304+0000 7f6e822b3640 1 --2- 172.21.15.2:0/3957008311 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55767d88ce10 0x55767d88f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:43.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.304+0000 7f6e822b3640 1 --2- 172.21.15.2:0/3957008311 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55767d88ce10 0x55767d88f200 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8853f1b05cf34441 server_cookie=48c76b3c15860498 in_seq=0 out_seq=0 2024-09-19T06:16:43.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.304+0000 7f6e65ffb640 10 client.15816 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:16:43.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.305+0000 7f6e65ffb640 1 -- 172.21.15.2:0/3957008311 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55767d7e5860 con 0x55767d88ce10 2024-09-19T06:16:43.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.305+0000 7f6e65ffb640 10 client.15816 handle_command_reply: tid=0 2024-09-19T06:16:43.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.305+0000 7f6e868f0740 1 client.15816 shutdown 2024-09-19T06:16:43.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.305+0000 7f6e868f0740 1 -- 172.21.15.2:0/3957008311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55767d873b40 msgr2=0x55767d879fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:43.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.305+0000 7f6e868f0740 1 --2- 172.21.15.2:0/3957008311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55767d873b40 0x55767d879fe0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c02ab40 tx=0x7f6e6c02ab70 comp rx=0 tx=0).stop 2024-09-19T06:16:43.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.305+0000 7f6e868f0740 1 -- 172.21.15.2:0/3957008311 shutdown_connections 2024-09-19T06:16:43.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.305+0000 7f6e868f0740 1 --2- 172.21.15.2:0/3957008311 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55767d88ce10 0x55767d88f200 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:43.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.305+0000 7f6e868f0740 1 --2- 172.21.15.2:0/3957008311 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55767d87d370 0x55767d87a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:43.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.305+0000 7f6e868f0740 1 --2- 172.21.15.2:0/3957008311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55767d873b40 0x55767d879fe0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:43.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.305+0000 7f6e65ffb640 0 client.15816 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:16:43.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.305+0000 7f6e868f0740 1 --2- 172.21.15.2:0/3957008311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55767d8725d0 0x55767d87cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:43.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.305+0000 7f6e868f0740 1 -- 172.21.15.2:0/3957008311 >> 172.21.15.2:0/3957008311 conn(0x55767d83b310 msgr2=0x55767d874960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:43.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.305+0000 7f6e868f0740 1 -- 172.21.15.2:0/3957008311 shutdown_connections 2024-09-19T06:16:43.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.305+0000 7f6e868f0740 1 -- 172.21.15.2:0/3957008311 wait complete. 2024-09-19T06:16:43.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.306+0000 7f6e868f0740 20 client.15816 trim_cache size 0 max 16384 2024-09-19T06:16:43.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.318+0000 7f6e868f0740 1 Processor -- start 2024-09-19T06:16:43.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.318+0000 7f6e868f0740 1 -- start start 2024-09-19T06:16:43.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.319+0000 7f6e868f0740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55767d8725d0 0x55767d8798a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:43.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.319+0000 7f6e868f0740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55767d873b40 0x55767d87bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:43.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.319+0000 7f6e868f0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55767d87d370 0x55767d874fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:43.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.319+0000 7f6e868f0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7c1b21a0 con 0x55767d87d370 2024-09-19T06:16:43.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.319+0000 7f6e868f0740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7c1afa70 con 0x55767d873b40 2024-09-19T06:16:43.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.319+0000 7f6e868f0740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7c1ad8c0 con 0x55767d8725d0 2024-09-19T06:16:43.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.319+0000 7f6e82ab4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55767d87d370 0x55767d874fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:43.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.319+0000 7f6e82ab4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55767d87d370 0x55767d874fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53448/0 (socket says 172.21.15.2:53448) 2024-09-19T06:16:43.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.319+0000 7f6e82ab4640 1 -- 172.21.15.2:0/3638514579 learned_addr learned my addr 172.21.15.2:0/3638514579 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:43.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.319+0000 7f6e822b3640 1 --2- 172.21.15.2:0/3638514579 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55767d8725d0 0x55767d8798a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:43.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.319+0000 7f6e81ab2640 1 --2- 172.21.15.2:0/3638514579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55767d873b40 0x55767d87bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:43.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.319+0000 7f6e82ab4640 1 -- 172.21.15.2:0/3638514579 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55767d8725d0 msgr2=0x55767d8798a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:43.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.319+0000 7f6e82ab4640 1 --2- 172.21.15.2:0/3638514579 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55767d8725d0 0x55767d8798a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:43.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.319+0000 7f6e82ab4640 1 -- 172.21.15.2:0/3638514579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55767d873b40 msgr2=0x55767d87bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:43.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.319+0000 7f6e82ab4640 1 --2- 172.21.15.2:0/3638514579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55767d873b40 0x55767d87bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:43.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.319+0000 7f6e82ab4640 1 -- 172.21.15.2:0/3638514579 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55767d878530 con 0x55767d87d370 2024-09-19T06:16:43.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.319+0000 7f6e82ab4640 1 --2- 172.21.15.2:0/3638514579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55767d87d370 0x55767d874fc0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f6e7401f450 tx=0x7f6e7401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccf6870b66614e8e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:43.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.319+0000 7f6e67fff640 1 -- 172.21.15.2:0/3638514579 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e74004110 con 0x55767d87d370 2024-09-19T06:16:43.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.319+0000 7f6e67fff640 1 -- 172.21.15.2:0/3638514579 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6e740042b0 con 0x55767d87d370 2024-09-19T06:16:43.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.320+0000 7f6e67fff640 1 -- 172.21.15.2:0/3638514579 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7401d830 con 0x55767d87d370 2024-09-19T06:16:43.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.320+0000 7f6e868f0740 1 -- 172.21.15.2:0/3638514579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55767d87d370 msgr2=0x55767d874fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:43.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.320+0000 7f6e868f0740 1 --2- 172.21.15.2:0/3638514579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55767d87d370 0x55767d874fc0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f6e7401f450 tx=0x7f6e7401a000 comp rx=0 tx=0).stop 2024-09-19T06:16:43.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.320+0000 7f6e868f0740 1 -- 172.21.15.2:0/3638514579 shutdown_connections 2024-09-19T06:16:43.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.320+0000 7f6e868f0740 1 --2- 172.21.15.2:0/3638514579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55767d87d370 0x55767d874fc0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:43.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.320+0000 7f6e868f0740 1 --2- 172.21.15.2:0/3638514579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55767d873b40 0x55767d87bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:43.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.320+0000 7f6e868f0740 1 --2- 172.21.15.2:0/3638514579 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55767d8725d0 0x55767d8798a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:43.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.320+0000 7f6e868f0740 1 -- 172.21.15.2:0/3638514579 >> 172.21.15.2:0/3638514579 conn(0x55767d83b310 msgr2=0x55767d87b840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:43.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.320+0000 7f6e868f0740 1 -- 172.21.15.2:0/3638514579 shutdown_connections 2024-09-19T06:16:43.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.320+0000 7f6e868f0740 1 -- 172.21.15.2:0/3638514579 wait complete. 2024-09-19T06:16:43.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.320+0000 7f6e868f0740 1 -- start start 2024-09-19T06:16:43.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.320+0000 7f6e868f0740 1 Processor -- start 2024-09-19T06:16:43.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.321+0000 7f6e868f0740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55767d8725d0 0x55767d881480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:43.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.321+0000 7f6e868f0740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55767d873b40 0x55767d8819c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:43.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.321+0000 7f6e868f0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55767d87d370 0x55767d881f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:43.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.321+0000 7f6e868f0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7c1adf30 con 0x55767d87d370 2024-09-19T06:16:43.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.321+0000 7f6e868f0740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7c1af3a0 con 0x55767d873b40 2024-09-19T06:16:43.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.321+0000 7f6e868f0740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7c1ae600 con 0x55767d8725d0 2024-09-19T06:16:43.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.321+0000 7f6e868f0740 10 client.0 _ll_register_callbacks cb 0x7f6e6c040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:43.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.321+0000 7f6e82ab4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55767d87d370 0x55767d881f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:43.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.321+0000 7f6e822b3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55767d8725d0 0x55767d881480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:43.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.321+0000 7f6e82ab4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55767d87d370 0x55767d881f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53452/0 (socket says 172.21.15.2:53452) 2024-09-19T06:16:43.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.321+0000 7f6e822b3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55767d8725d0 0x55767d881480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:39944/0 (socket says 172.21.15.2:39944) 2024-09-19T06:16:43.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.321+0000 7f6e82ab4640 1 -- 172.21.15.2:0/545886731 learned_addr learned my addr 172.21.15.2:0/545886731 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:43.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.321+0000 7f6e81ab2640 1 --2- 172.21.15.2:0/545886731 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55767d873b40 0x55767d8819c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:43.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.321+0000 7f6e822b3640 1 -- 172.21.15.2:0/545886731 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55767d873b40 msgr2=0x55767d8819c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:43.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.321+0000 7f6e822b3640 1 --2- 172.21.15.2:0/545886731 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55767d873b40 0x55767d8819c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:43.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.321+0000 7f6e822b3640 1 -- 172.21.15.2:0/545886731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55767d87d370 msgr2=0x55767d881f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:43.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.321+0000 7f6e822b3640 1 --2- 172.21.15.2:0/545886731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55767d87d370 0x55767d881f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:43.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.321+0000 7f6e822b3640 1 -- 172.21.15.2:0/545886731 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55767d8f6a60 con 0x55767d8725d0 2024-09-19T06:16:43.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.321+0000 7f6e82ab4640 1 --2- 172.21.15.2:0/545886731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55767d87d370 0x55767d881f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:43.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.321+0000 7f6e822b3640 1 --2- 172.21.15.2:0/545886731 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55767d8725d0 0x55767d881480 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6e780cdc80 tx=0x7f6e7800ea80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e8f4a0b2850b16b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:43.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.321+0000 7f6e65ffb640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-19T06:16:43.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.322+0000 7f6e65ffb640 1 -- 172.21.15.2:0/545886731 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7809c170 con 0x55767d8725d0 2024-09-19T06:16:43.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.322+0000 7f6e65ffb640 1 -- 172.21.15.2:0/545886731 <== mon.1 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f6e780d3ce0 con 0x55767d8725d0 2024-09-19T06:16:43.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.322+0000 7f6e868f0740 1 -- 172.21.15.2:0/545886731 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e740042b0 con 0x55767d8725d0 2024-09-19T06:16:43.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.322+0000 7f6e65ffb640 1 -- 172.21.15.2:0/545886731 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6e78005560 con 0x55767d8725d0 2024-09-19T06:16:43.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.322+0000 7f6e868f0740 10 client.25405 fetch_fsmap learned FSMap version 26 2024-09-19T06:16:43.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.322+0000 7f6e868f0740 1 -- 172.21.15.2:0/545886731 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55767d8f7dc0 con 0x55767d8725d0 2024-09-19T06:16:43.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.322+0000 7f6e65ffb640 1 -- 172.21.15.2:0/545886731 <== mon.1 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6e740042b0 con 0x55767d8725d0 2024-09-19T06:16:43.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.322+0000 7f6e65ffb640 1 -- 172.21.15.2:0/545886731 <== mon.1 v2:172.21.15.90:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f6e780cdf00 con 0x55767d8725d0 2024-09-19T06:16:43.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.322+0000 7f6e868f0740 10 client.25405 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:16:43.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.322+0000 7f6e868f0740 10 client.25405 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:16:43.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.322+0000 7f6e868f0740 20 client.25405 populate_metadata read hostname 'smithi002' 2024-09-19T06:16:43.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.322+0000 7f6e868f0740 1 --2- 172.21.15.2:0/545886731 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55767d8f8530 0x55767d8fa920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:43.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.322+0000 7f6e868f0740 4 client.25405 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:16:43.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.322+0000 7f6e868f0740 1 -- 172.21.15.2:0/545886731 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55767d7dfd70 con 0x55767d8f8530 2024-09-19T06:16:43.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.322+0000 7f6e81ab2640 1 --2- 172.21.15.2:0/545886731 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55767d8f8530 0x55767d8fa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:43.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.323+0000 7f6e81ab2640 1 --2- 172.21.15.2:0/545886731 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55767d8f8530 0x55767d8fa920 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=10940e480e1b4b78 server_cookie=d678f5ede4d5ddd in_seq=0 out_seq=0 2024-09-19T06:16:43.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.323+0000 7f6e65ffb640 10 client.25405 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:16:43.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.323+0000 7f6e65ffb640 1 -- 172.21.15.2:0/545886731 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55767d7dfd70 con 0x55767d8f8530 2024-09-19T06:16:43.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.323+0000 7f6e65ffb640 10 client.25405 handle_command_reply: tid=0 2024-09-19T06:16:43.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.323+0000 7f6e868f0740 1 client.25405 shutdown 2024-09-19T06:16:43.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.323+0000 7f6e868f0740 1 -- 172.21.15.2:0/545886731 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55767d8725d0 msgr2=0x55767d881480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:43.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.323+0000 7f6e868f0740 1 --2- 172.21.15.2:0/545886731 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55767d8725d0 0x55767d881480 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6e780cdc80 tx=0x7f6e7800ea80 comp rx=0 tx=0).stop 2024-09-19T06:16:43.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.323+0000 7f6e868f0740 1 -- 172.21.15.2:0/545886731 shutdown_connections 2024-09-19T06:16:43.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.323+0000 7f6e868f0740 1 --2- 172.21.15.2:0/545886731 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55767d8f8530 0x55767d8fa920 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:43.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.323+0000 7f6e868f0740 1 --2- 172.21.15.2:0/545886731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55767d87d370 0x55767d881f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:43.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.323+0000 7f6e868f0740 1 --2- 172.21.15.2:0/545886731 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55767d873b40 0x55767d8819c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:43.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.323+0000 7f6e65ffb640 0 client.25405 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:16:43.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.323+0000 7f6e868f0740 1 --2- 172.21.15.2:0/545886731 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55767d8725d0 0x55767d881480 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:43.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.323+0000 7f6e868f0740 1 -- 172.21.15.2:0/545886731 >> 172.21.15.2:0/545886731 conn(0x55767d83b310 msgr2=0x55767d87c060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:43.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.323+0000 7f6e868f0740 1 -- 172.21.15.2:0/545886731 shutdown_connections 2024-09-19T06:16:43.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.323+0000 7f6e868f0740 1 -- 172.21.15.2:0/545886731 wait complete. 2024-09-19T06:16:43.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.323+0000 7f6e868f0740 20 client.25405 trim_cache size 0 max 16384 2024-09-19T06:16:43.333 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:16:43.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.324+0000 7f6e84517640 1 -- 172.21.15.2:0/3635270460 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f6e680a33b0 msgr2=0x7f6e680a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:43.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.324+0000 7f6e84517640 1 --2- 172.21.15.2:0/3635270460 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f6e680a33b0 0x7f6e680a5870 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6e74009c70 tx=0x7f6e74005f90 comp rx=0 tx=0).stop 2024-09-19T06:16:43.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.324+0000 7f6e84517640 1 -- 172.21.15.2:0/3635270460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e7c102dd0 msgr2=0x7f6e7c100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:43.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.324+0000 7f6e84517640 1 --2- 172.21.15.2:0/3635270460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e7c102dd0 0x7f6e7c100a30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6e78009fd0 tx=0x7f6e7800ef90 comp rx=0 tx=0).stop 2024-09-19T06:16:43.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.324+0000 7f6e84517640 1 -- 172.21.15.2:0/3635270460 shutdown_connections 2024-09-19T06:16:43.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.324+0000 7f6e84517640 1 --2- 172.21.15.2:0/3635270460 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f6e680a33b0 0x7f6e680a5870 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:43.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.324+0000 7f6e84517640 1 --2- 172.21.15.2:0/3635270460 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e7c108300 0x7f6e7c1014b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:43.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.324+0000 7f6e84517640 1 --2- 172.21.15.2:0/3635270460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e7c103780 0x7f6e7c100f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:43.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.324+0000 7f6e84517640 1 --2- 172.21.15.2:0/3635270460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e7c102dd0 0x7f6e7c100a30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:43.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.324+0000 7f6e84517640 1 -- 172.21.15.2:0/3635270460 >> 172.21.15.2:0/3635270460 conn(0x7f6e7c0fc7d0 msgr2=0x7f6e7c105f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:43.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.324+0000 7f6e84517640 1 -- 172.21.15.2:0/3635270460 shutdown_connections 2024-09-19T06:16:43.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:43.324+0000 7f6e84517640 1 -- 172.21.15.2:0/3635270460 wait complete. 2024-09-19T06:16:43.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:43 smithi002 ceph-mon[30982]: pgmap v60: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.0 KiB/s wr, 8 op/s 2024-09-19T06:16:43.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:43 smithi090 ceph-mon[34497]: pgmap v60: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.0 KiB/s wr, 8 op/s 2024-09-19T06:16:43.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:43 smithi089 ceph-mon[34160]: pgmap v60: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.0 KiB/s wr, 8 op/s 2024-09-19T06:16:44.061 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:16:44.340 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:16:44.970 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.966+0000 7fd48f99f640 1 -- 172.21.15.2:0/4170490791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd488101230 msgr2=0x7fd48810def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:44.970 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.966+0000 7fd48f99f640 1 --2- 172.21.15.2:0/4170490791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd488101230 0x7fd48810def0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd484009860 tx=0x7fd48402a340 comp rx=0 tx=0).stop 2024-09-19T06:16:44.970 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.966+0000 7fd48f99f640 1 -- 172.21.15.2:0/4170490791 shutdown_connections 2024-09-19T06:16:44.970 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.966+0000 7fd48f99f640 1 --2- 172.21.15.2:0/4170490791 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd48810e430 0x7fd488110820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.970 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.966+0000 7fd48f99f640 1 --2- 172.21.15.2:0/4170490791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd488101230 0x7fd48810def0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.970 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.966+0000 7fd48f99f640 1 --2- 172.21.15.2:0/4170490791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd488100880 0x7fd488100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.970 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.966+0000 7fd48f99f640 1 -- 172.21.15.2:0/4170490791 >> 172.21.15.2:0/4170490791 conn(0x7fd4880779a0 msgr2=0x7fd4880fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:44.970 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.966+0000 7fd48f99f640 1 -- 172.21.15.2:0/4170490791 shutdown_connections 2024-09-19T06:16:44.971 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.967+0000 7fd48f99f640 1 -- 172.21.15.2:0/4170490791 wait complete. 2024-09-19T06:16:44.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.966+0000 7fe61ecbb640 1 -- 172.21.15.2:0/331514607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe618100e20 msgr2=0x7fe618101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:44.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.966+0000 7fe61ecbb640 1 --2- 172.21.15.2:0/331514607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe618100e20 0x7fe618101200 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe60c009930 tx=0x7fe60c02a4d0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.967+0000 7fe61ecbb640 1 -- 172.21.15.2:0/331514607 shutdown_connections 2024-09-19T06:16:44.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.967+0000 7fe61ecbb640 1 --2- 172.21.15.2:0/331514607 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe618102ef0 0x7fe61810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.967+0000 7fe61ecbb640 1 --2- 172.21.15.2:0/331514607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe618102570 0x7fe6181029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.967+0000 7fe61ecbb640 1 --2- 172.21.15.2:0/331514607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe618100e20 0x7fe618101200 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.967+0000 7fe61ecbb640 1 -- 172.21.15.2:0/331514607 >> 172.21.15.2:0/331514607 conn(0x7fe6180fc7d0 msgr2=0x7fe6180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:44.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.968+0000 7fe61ecbb640 1 -- 172.21.15.2:0/331514607 shutdown_connections 2024-09-19T06:16:44.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.968+0000 7fe61ecbb640 1 -- 172.21.15.2:0/331514607 wait complete. 2024-09-19T06:16:44.972 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.968+0000 7fd48f99f640 1 Processor -- start 2024-09-19T06:16:44.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.968+0000 7fe61ecbb640 1 Processor -- start 2024-09-19T06:16:44.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.969+0000 7fe61ecbb640 1 -- start start 2024-09-19T06:16:44.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.969+0000 7fe61ecbb640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe618100e20 0x7fe618073c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:44.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.969+0000 7fe61ecbb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe618102570 0x7fe61806ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:44.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.969+0000 7fe61ecbb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe618102ef0 0x7fe61806f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:44.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.969+0000 7fe61ecbb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe618111f80 con 0x7fe618102ef0 2024-09-19T06:16:44.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.969+0000 7fe61ecbb640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe618111e00 con 0x7fe618102570 2024-09-19T06:16:44.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.969+0000 7fe61ecbb640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe618112100 con 0x7fe618100e20 2024-09-19T06:16:44.974 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.968+0000 7fd48f99f640 1 -- start start 2024-09-19T06:16:44.974 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.968+0000 7fd48f99f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd488100880 0x7fd48810afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:44.974 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.969+0000 7fd48f99f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd488101230 0x7fd48810b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:44.975 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.969+0000 7fd48f99f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd48810e430 0x7fd48810ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:44.975 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.969+0000 7fd48f99f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd488113f60 con 0x7fd48810e430 2024-09-19T06:16:44.975 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.969+0000 7fd48f99f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd488113de0 con 0x7fd488100880 2024-09-19T06:16:44.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.969+0000 7fe617fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe618102570 0x7fe61806ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:44.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.970+0000 7fe61ca57640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe618100e20 0x7fe618073c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:44.975 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.969+0000 7fd48f99f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd4881140e0 con 0x7fd488101230 2024-09-19T06:16:44.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.970+0000 7fe617fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe618102570 0x7fe61806ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:49456/0 (socket says 172.21.15.2:49456) 2024-09-19T06:16:44.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.970+0000 7fe617fff640 1 -- 172.21.15.2:0/360302349 learned_addr learned my addr 172.21.15.2:0/360302349 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:44.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.970+0000 7fe617fff640 1 -- 172.21.15.2:0/360302349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe618100e20 msgr2=0x7fe618073c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:44.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.969+0000 7fd48d73b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd488100880 0x7fd48810afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:44.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.970+0000 7fe617fff640 1 --2- 172.21.15.2:0/360302349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe618100e20 0x7fe618073c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.970+0000 7fe617fff640 1 -- 172.21.15.2:0/360302349 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe618102ef0 msgr2=0x7fe61806f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:44.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.970+0000 7fe617fff640 1 --2- 172.21.15.2:0/360302349 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe618102ef0 0x7fe61806f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.970+0000 7fe617fff640 1 -- 172.21.15.2:0/360302349 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe61806f950 con 0x7fe618102570 2024-09-19T06:16:44.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.970+0000 7fe61ca57640 1 --2- 172.21.15.2:0/360302349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe618100e20 0x7fe618073c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:16:44.978 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.969+0000 7fd48df3c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd48810e430 0x7fd48810ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:44.978 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.969+0000 7fd48d73b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd488100880 0x7fd48810afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:49452/0 (socket says 172.21.15.2:49452) 2024-09-19T06:16:44.978 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.969+0000 7fd48d73b640 1 -- 172.21.15.2:0/1718269108 learned_addr learned my addr 172.21.15.2:0/1718269108 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:44.978 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.970+0000 7fd48d73b640 1 -- 172.21.15.2:0/1718269108 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd488101230 msgr2=0x7fd48810b4e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:16:44.979 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.970+0000 7fd48d73b640 1 --2- 172.21.15.2:0/1718269108 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd488101230 0x7fd48810b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.979 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.970+0000 7fd48d73b640 1 -- 172.21.15.2:0/1718269108 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd48810e430 msgr2=0x7fd48810ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:44.979 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.970+0000 7fd48d73b640 1 --2- 172.21.15.2:0/1718269108 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd48810e430 0x7fd48810ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.979 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.970+0000 7fd48d73b640 1 -- 172.21.15.2:0/1718269108 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd488199430 con 0x7fd488100880 2024-09-19T06:16:44.979 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.970+0000 7fd48df3c640 1 --2- 172.21.15.2:0/1718269108 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd48810e430 0x7fd48810ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:44.979 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.970+0000 7fd48d73b640 1 --2- 172.21.15.2:0/1718269108 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd488100880 0x7fd48810afa0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd47800e9c0 tx=0x7fd47800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:44.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.971+0000 7fe617fff640 1 --2- 172.21.15.2:0/360302349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe618102570 0x7fe61806ec90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe60400ea60 tx=0x7fe60400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:44.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.972+0000 7fe615ffb640 1 -- 172.21.15.2:0/360302349 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60400cde0 con 0x7fe618102570 2024-09-19T06:16:44.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.972+0000 7fe615ffb640 1 -- 172.21.15.2:0/360302349 <== mon.2 v2:172.21.15.89:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe6040035f0 con 0x7fe618102570 2024-09-19T06:16:44.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.972+0000 7fe615ffb640 1 -- 172.21.15.2:0/360302349 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe604010690 con 0x7fe618102570 2024-09-19T06:16:44.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.972+0000 7fe61ecbb640 1 -- 172.21.15.2:0/360302349 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe61819d440 con 0x7fe618102570 2024-09-19T06:16:44.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.972+0000 7fe61ecbb640 1 -- 172.21.15.2:0/360302349 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe618107cd0 con 0x7fe618102570 2024-09-19T06:16:44.980 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.970+0000 7fd47e7fc640 1 -- 172.21.15.2:0/1718269108 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47800cde0 con 0x7fd488100880 2024-09-19T06:16:44.980 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.971+0000 7fd47e7fc640 1 -- 172.21.15.2:0/1718269108 <== mon.2 v2:172.21.15.89:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd4780035f0 con 0x7fd488100880 2024-09-19T06:16:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.971+0000 7fd47e7fc640 1 -- 172.21.15.2:0/1718269108 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd478010690 con 0x7fd488100880 2024-09-19T06:16:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.971+0000 7fd48f99f640 1 -- 172.21.15.2:0/1718269108 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd488199720 con 0x7fd488100880 2024-09-19T06:16:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.971+0000 7fd48f99f640 1 -- 172.21.15.2:0/1718269108 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd488199bc0 con 0x7fd488100880 2024-09-19T06:16:44.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.976+0000 7fe621094740 1 Processor -- start 2024-09-19T06:16:44.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.977+0000 7fe621094740 1 -- start start 2024-09-19T06:16:44.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.977+0000 7fe621094740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641f4b9fb40 0x5641f4b9e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:44.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.977+0000 7fe621094740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641f4b9e5d0 0x5641f4b9ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:44.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.977+0000 7fe621094740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5641f4ba9370 0x5641f4bab760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:44.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.977+0000 7fe621094740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5641f4b042f0 con 0x5641f4b9fb40 2024-09-19T06:16:44.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.977+0000 7fe621094740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5641f4aabcf0 con 0x5641f4ba9370 2024-09-19T06:16:44.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.978+0000 7fe621094740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5641f4b002b0 con 0x5641f4b9e5d0 2024-09-19T06:16:44.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.978+0000 7fe61ca57640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641f4b9e5d0 0x5641f4b9ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:44.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.978+0000 7fe61d258640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641f4b9fb40 0x5641f4b9e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:44.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.978+0000 7fe61d258640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641f4b9fb40 0x5641f4b9e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53480/0 (socket says 172.21.15.2:53480) 2024-09-19T06:16:44.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.978+0000 7fe61d258640 1 -- 172.21.15.2:0/4042562699 learned_addr learned my addr 172.21.15.2:0/4042562699 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:44.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.978+0000 7fe61ca57640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641f4b9e5d0 0x5641f4b9ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:39974/0 (socket says 172.21.15.2:39974) 2024-09-19T06:16:44.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.979+0000 7fe61d258640 1 -- 172.21.15.2:0/4042562699 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641f4b9e5d0 msgr2=0x5641f4b9ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:44.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.979+0000 7fe61d258640 1 --2- 172.21.15.2:0/4042562699 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641f4b9e5d0 0x5641f4b9ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.979+0000 7fe61d258640 1 -- 172.21.15.2:0/4042562699 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5641f4ba9370 msgr2=0x5641f4bab760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:16:44.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.979+0000 7fe61d258640 1 --2- 172.21.15.2:0/4042562699 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5641f4ba9370 0x5641f4bab760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.979+0000 7fe61d258640 1 -- 172.21.15.2:0/4042562699 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641f4a903a0 con 0x5641f4b9fb40 2024-09-19T06:16:44.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.979+0000 7fe61d258640 1 --2- 172.21.15.2:0/4042562699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641f4b9fb40 0x5641f4b9e090 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe610009cd0 tx=0x7fe61000e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fde77af2d8d7b9d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:44.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.980+0000 7fe602ffd640 1 -- 172.21.15.2:0/4042562699 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe610038070 con 0x5641f4b9fb40 2024-09-19T06:16:44.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.980+0000 7fe615ffb640 1 -- 172.21.15.2:0/360302349 <== mon.2 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fe6040037a0 con 0x7fe618102570 2024-09-19T06:16:44.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.980+0000 7fe602ffd640 1 -- 172.21.15.2:0/4042562699 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe610005020 con 0x5641f4b9fb40 2024-09-19T06:16:44.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.980+0000 7fe602ffd640 1 -- 172.21.15.2:0/4042562699 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6100336e0 con 0x5641f4b9fb40 2024-09-19T06:16:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.977+0000 7fd49281a740 1 Processor -- start 2024-09-19T06:16:44.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.981+0000 7fe615ffb640 1 --2- 172.21.15.2:0/360302349 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe6080a34b0 0x7fe6080a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:44.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.982+0000 7fe615ffb640 1 -- 172.21.15.2:0/360302349 <== mon.2 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fe6040d00f0 con 0x7fe618102570 2024-09-19T06:16:44.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.982+0000 7fe621094740 1 -- 172.21.15.2:0/4042562699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641f4b9fb40 msgr2=0x5641f4b9e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:44.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.982+0000 7fe621094740 1 --2- 172.21.15.2:0/4042562699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641f4b9fb40 0x5641f4b9e090 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe610009cd0 tx=0x7fe61000e6c0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.982+0000 7fe61ca57640 1 --2- 172.21.15.2:0/360302349 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe6080a34b0 0x7fe6080a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:44.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.983+0000 7fe621094740 1 -- 172.21.15.2:0/4042562699 shutdown_connections 2024-09-19T06:16:44.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.983+0000 7fe621094740 1 --2- 172.21.15.2:0/4042562699 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5641f4ba9370 0x5641f4bab760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.983+0000 7fe621094740 1 --2- 172.21.15.2:0/4042562699 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641f4b9e5d0 0x5641f4b9ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.983+0000 7fe621094740 1 --2- 172.21.15.2:0/4042562699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641f4b9fb40 0x5641f4b9e090 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.983+0000 7fe621094740 1 -- 172.21.15.2:0/4042562699 >> 172.21.15.2:0/4042562699 conn(0x5641f4b67310 msgr2=0x5641f4b9ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:44.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.984+0000 7fe621094740 1 -- 172.21.15.2:0/4042562699 shutdown_connections 2024-09-19T06:16:44.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.984+0000 7fe621094740 1 -- 172.21.15.2:0/4042562699 wait complete. 2024-09-19T06:16:44.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.984+0000 7fe61ca57640 1 --2- 172.21.15.2:0/360302349 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe6080a34b0 0x7fe6080a5970 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe60c006010 tx=0x7fe60c005b50 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.978+0000 7fd49281a740 1 -- start start 2024-09-19T06:16:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.978+0000 7fd49281a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ea33f3af0 0x557ea33f3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.978+0000 7fd49281a740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557ea33f4410 0x557ea33fe770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.978+0000 7fd49281a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ea33fecb0 0x557ea34010a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.978+0000 7fd49281a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557ea33582f0 con 0x557ea33f3af0 2024-09-19T06:16:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.978+0000 7fd49281a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x557ea3300270 con 0x557ea33fecb0 2024-09-19T06:16:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.978+0000 7fd49281a740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x557ea33542b0 con 0x557ea33f4410 2024-09-19T06:16:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.978+0000 7fd48df3c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ea33f3af0 0x557ea33f3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.978+0000 7fd48df3c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ea33f3af0 0x557ea33f3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53490/0 (socket says 172.21.15.2:53490) 2024-09-19T06:16:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.978+0000 7fd48df3c640 1 -- 172.21.15.2:0/1060826807 learned_addr learned my addr 172.21.15.2:0/1060826807 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.979+0000 7fd48df3c640 1 -- 172.21.15.2:0/1060826807 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557ea33f4410 msgr2=0x557ea33fe770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:16:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.979+0000 7fd48df3c640 1 --2- 172.21.15.2:0/1060826807 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557ea33f4410 0x557ea33fe770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.979+0000 7fd48df3c640 1 -- 172.21.15.2:0/1060826807 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ea33fecb0 msgr2=0x557ea34010a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:16:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.979+0000 7fd48df3c640 1 --2- 172.21.15.2:0/1060826807 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ea33fecb0 0x557ea34010a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.979+0000 7fd48df3c640 1 -- 172.21.15.2:0/1060826807 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ea32ff340 con 0x557ea33f3af0 2024-09-19T06:16:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.981+0000 7fd48df3c640 1 --2- 172.21.15.2:0/1060826807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ea33f3af0 0x557ea33f3ed0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd480010740 tx=0x7fd480010b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cf73c2fc34509c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.982+0000 7fd4737fe640 1 -- 172.21.15.2:0/1060826807 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd48000e8d0 con 0x557ea33f3af0 2024-09-19T06:16:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.982+0000 7fd4737fe640 1 -- 172.21.15.2:0/1060826807 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd480012450 con 0x557ea33f3af0 2024-09-19T06:16:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.982+0000 7fd4737fe640 1 -- 172.21.15.2:0/1060826807 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd480011640 con 0x557ea33f3af0 2024-09-19T06:16:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.983+0000 7fd49281a740 1 -- 172.21.15.2:0/1060826807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ea33f3af0 msgr2=0x557ea33f3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.984+0000 7fd49281a740 1 --2- 172.21.15.2:0/1060826807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ea33f3af0 0x557ea33f3ed0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd480010740 tx=0x7fd480010b40 comp rx=0 tx=0).stop 2024-09-19T06:16:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.985+0000 7fd47e7fc640 1 -- 172.21.15.2:0/1718269108 <== mon.2 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fd478010830 con 0x7fd488100880 2024-09-19T06:16:44.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.985+0000 7fe621094740 1 -- start start 2024-09-19T06:16:44.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.985+0000 7fe621094740 1 Processor -- start 2024-09-19T06:16:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.985+0000 7fd49281a740 1 -- 172.21.15.2:0/1060826807 shutdown_connections 2024-09-19T06:16:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.985+0000 7fd49281a740 1 --2- 172.21.15.2:0/1060826807 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ea33fecb0 0x557ea34010a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.985+0000 7fd49281a740 1 --2- 172.21.15.2:0/1060826807 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557ea33f4410 0x557ea33fe770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.985+0000 7fd49281a740 1 --2- 172.21.15.2:0/1060826807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ea33f3af0 0x557ea33f3ed0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.985+0000 7fd49281a740 1 -- 172.21.15.2:0/1060826807 >> 172.21.15.2:0/1060826807 conn(0x557ea33f0060 msgr2=0x557ea33f0440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.986+0000 7fd49281a740 1 -- 172.21.15.2:0/1060826807 shutdown_connections 2024-09-19T06:16:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.986+0000 7fd49281a740 1 -- 172.21.15.2:0/1060826807 wait complete. 2024-09-19T06:16:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.986+0000 7fd47e7fc640 1 --2- 172.21.15.2:0/1718269108 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fd4740a3490 0x7fd4740a5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.986+0000 7fd49281a740 1 -- start start 2024-09-19T06:16:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.986+0000 7fd49281a740 1 Processor -- start 2024-09-19T06:16:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.986+0000 7fd47e7fc640 1 -- 172.21.15.2:0/1718269108 <== mon.2 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fd4780d0010 con 0x7fd488100880 2024-09-19T06:16:44.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.986+0000 7fe621094740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5641f4b9e5d0 0x5641f4ba8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:44.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.986+0000 7fe621094740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641f4b9fb40 0x5641f4ba5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:44.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.986+0000 7fe621094740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641f4ba9370 0x5641f4ba6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:44.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.986+0000 7fe621094740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5641f4babe80 con 0x5641f4ba9370 2024-09-19T06:16:44.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.986+0000 7fe621094740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5641f4abf060 con 0x5641f4b9e5d0 2024-09-19T06:16:44.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.986+0000 7fe621094740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5641f4bac000 con 0x5641f4b9fb40 2024-09-19T06:16:44.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.986+0000 7fe621094740 10 client.0 _ll_register_callbacks cb 0x5641f48128c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:44.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.986+0000 7fe61d258640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641f4ba9370 0x5641f4ba6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:44.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.986+0000 7fe61d258640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641f4ba9370 0x5641f4ba6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53498/0 (socket says 172.21.15.2:53498) 2024-09-19T06:16:44.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.986+0000 7fe61d258640 1 -- 172.21.15.2:0/1345775508 learned_addr learned my addr 172.21.15.2:0/1345775508 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.987+0000 7fd48df3c640 1 --2- 172.21.15.2:0/1718269108 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fd4740a3490 0x7fd4740a5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:44.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.987+0000 7fe61ca57640 1 --2- 172.21.15.2:0/1345775508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5641f4b9e5d0 0x5641f4ba8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:44.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.987+0000 7fe617fff640 1 --2- 172.21.15.2:0/1345775508 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641f4b9fb40 0x5641f4ba5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.988+0000 7fd48df3c640 1 --2- 172.21.15.2:0/1718269108 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fd4740a3490 0x7fd4740a5950 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd480012d90 tx=0x7fd480012df0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:44.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.988+0000 7fe61d258640 1 -- 172.21.15.2:0/1345775508 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641f4b9fb40 msgr2=0x5641f4ba5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:44.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.988+0000 7fe61d258640 1 --2- 172.21.15.2:0/1345775508 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641f4b9fb40 0x5641f4ba5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.988+0000 7fe61d258640 1 -- 172.21.15.2:0/1345775508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5641f4b9e5d0 msgr2=0x5641f4ba8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:44.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.988+0000 7fe61d258640 1 --2- 172.21.15.2:0/1345775508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5641f4b9e5d0 0x5641f4ba8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.988+0000 7fe61d258640 1 -- 172.21.15.2:0/1345775508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641f48753c0 con 0x5641f4ba9370 2024-09-19T06:16:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.989+0000 7fd49281a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ea33f3af0 0x557ea33fbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.989+0000 7fd49281a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ea33f4410 0x557ea33fc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.989+0000 7fd49281a740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557ea33fecb0 0x557ea33fc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.989+0000 7fd49281a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557ea34018d0 con 0x557ea33f3af0 2024-09-19T06:16:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.989+0000 7fd49281a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x557ea32e1290 con 0x557ea33f4410 2024-09-19T06:16:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.989+0000 7fd49281a740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x557ea3401a50 con 0x557ea33fecb0 2024-09-19T06:16:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.989+0000 7fd49281a740 10 client.0 _ll_register_callbacks cb 0x557ea3312140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.990+0000 7fd48cf3a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ea33f4410 0x557ea33fc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.990+0000 7fd48cf3a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ea33f4410 0x557ea33fc050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:49482/0 (socket says 172.21.15.2:49482) 2024-09-19T06:16:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.990+0000 7fd48cf3a640 1 -- 172.21.15.2:0/2162786786 learned_addr learned my addr 172.21.15.2:0/2162786786 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.990+0000 7fd48df3c640 1 --2- 172.21.15.2:0/2162786786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557ea33fecb0 0x557ea33fc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.990+0000 7fd48cf3a640 1 -- 172.21.15.2:0/2162786786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557ea33fecb0 msgr2=0x557ea33fc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.990+0000 7fd48cf3a640 1 --2- 172.21.15.2:0/2162786786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557ea33fecb0 0x557ea33fc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.990+0000 7fd48cf3a640 1 -- 172.21.15.2:0/2162786786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ea33f3af0 msgr2=0x557ea33fbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.990+0000 7fd48cf3a640 1 --2- 172.21.15.2:0/2162786786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ea33f3af0 0x557ea33fbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.990+0000 7fd48cf3a640 1 -- 172.21.15.2:0/2162786786 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ea306b210 con 0x557ea33f4410 2024-09-19T06:16:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.990+0000 7fd48cf3a640 1 --2- 172.21.15.2:0/2162786786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ea33f4410 0x557ea33fc050 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd484009830 tx=0x7fd484004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b5761c11e48a422 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.990+0000 7fd470ff9640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-09-19T06:16:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.991+0000 7fd470ff9640 1 -- 172.21.15.2:0/2162786786 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd48403f020 con 0x557ea33f4410 2024-09-19T06:16:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.991+0000 7fd470ff9640 1 -- 172.21.15.2:0/2162786786 <== mon.2 v2:172.21.15.89:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fd4840035f0 con 0x557ea33f4410 2024-09-19T06:16:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.991+0000 7fd49281a740 1 -- 172.21.15.2:0/2162786786 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd480012450 con 0x557ea33f4410 2024-09-19T06:16:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.992+0000 7fd470ff9640 1 -- 172.21.15.2:0/2162786786 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd484037040 con 0x557ea33f4410 2024-09-19T06:16:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.992+0000 7fd49281a740 10 client.25463 fetch_fsmap learned FSMap version 26 2024-09-19T06:16:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.992+0000 7fd49281a740 1 -- 172.21.15.2:0/2162786786 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557ea3137620 con 0x557ea33f4410 2024-09-19T06:16:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.992+0000 7fd470ff9640 1 -- 172.21.15.2:0/2162786786 <== mon.2 v2:172.21.15.89:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd480012450 con 0x557ea33f4410 2024-09-19T06:16:44.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.992+0000 7fe61d258640 1 --2- 172.21.15.2:0/1345775508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641f4ba9370 0x5641f4ba6560 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fe610009240 tx=0x7fe610005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6a7199bce6c0a3c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:44.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.992+0000 7fe5f7fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:16:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.992+0000 7fd470ff9640 1 -- 172.21.15.2:0/2162786786 <== mon.2 v2:172.21.15.89:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fd48403a030 con 0x557ea33f4410 2024-09-19T06:16:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.993+0000 7fd49281a740 10 client.25463 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:16:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.993+0000 7fd49281a740 10 client.25463 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.993+0000 7fd49281a740 20 client.25463 populate_metadata read hostname 'smithi002' 2024-09-19T06:16:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.993+0000 7fd49281a740 1 --2- 172.21.15.2:0/2162786786 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x557ea340ec20 0x557ea3411050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.993+0000 7fd49281a740 4 client.25463 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:16:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.993+0000 7fd49281a740 1 -- 172.21.15.2:0/2162786786 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557ea3365a20 con 0x557ea340ec20 2024-09-19T06:16:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.993+0000 7fd48d73b640 1 --2- 172.21.15.2:0/2162786786 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x557ea340ec20 0x557ea3411050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:45.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.993+0000 7fe5f7fff640 1 -- 172.21.15.2:0/1345775508 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe610038050 con 0x5641f4ba9370 2024-09-19T06:16:45.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.993+0000 7fe5f7fff640 1 -- 172.21.15.2:0/1345775508 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fe6100051d0 con 0x5641f4ba9370 2024-09-19T06:16:45.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.993+0000 7fe621094740 1 -- 172.21.15.2:0/1345775508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe610005020 con 0x5641f4ba9370 2024-09-19T06:16:45.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.994+0000 7fe5f7fff640 1 -- 172.21.15.2:0/1345775508 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe610005450 con 0x5641f4ba9370 2024-09-19T06:16:45.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.994+0000 7fe621094740 10 client.15840 fetch_fsmap learned FSMap version 26 2024-09-19T06:16:45.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.994+0000 7fe621094740 1 -- 172.21.15.2:0/1345775508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5641f4bb7900 con 0x5641f4ba9370 2024-09-19T06:16:45.002 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.995+0000 7fd48d73b640 1 --2- 172.21.15.2:0/2162786786 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x557ea340ec20 0x557ea3411050 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7d8c46c712f0639 server_cookie=2ab414967e97a61b in_seq=0 out_seq=0 2024-09-19T06:16:45.002 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.995+0000 7fd470ff9640 10 client.25463 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:45.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.995+0000 7fe5f7fff640 1 -- 172.21.15.2:0/1345775508 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe6100055f0 con 0x5641f4ba9370 2024-09-19T06:16:45.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.995+0000 7fe5f7fff640 1 -- 172.21.15.2:0/1345775508 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fe61000f040 con 0x5641f4ba9370 2024-09-19T06:16:45.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.995+0000 7fe621094740 10 client.15840 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:16:45.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.995+0000 7fe621094740 10 client.15840 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:16:45.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.995+0000 7fe621094740 20 client.15840 populate_metadata read hostname 'smithi002' 2024-09-19T06:16:45.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.995+0000 7fe621094740 1 --2- 172.21.15.2:0/1345775508 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5641f4bb8cb0 0x5641f4bbb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:45.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.995+0000 7fe621094740 4 client.15840 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:16:45.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.995+0000 7fe621094740 1 -- 172.21.15.2:0/1345775508 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fe610005020 con 0x5641f4bb8cb0 2024-09-19T06:16:45.004 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.996+0000 7fd470ff9640 1 -- 172.21.15.2:0/2162786786 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fd4780abe80 con 0x557ea340ec20 2024-09-19T06:16:45.004 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.996+0000 7fd470ff9640 10 client.25463 handle_command_reply: tid=0 2024-09-19T06:16:45.004 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.996+0000 7fd49281a740 1 client.25463 shutdown 2024-09-19T06:16:45.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.996+0000 7fe61ca57640 1 --2- 172.21.15.2:0/1345775508 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5641f4bb8cb0 0x5641f4bbb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:45.005 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.997+0000 7fd49281a740 1 -- 172.21.15.2:0/2162786786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ea33f4410 msgr2=0x557ea33fc050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:45.005 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.997+0000 7fd49281a740 1 --2- 172.21.15.2:0/2162786786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ea33f4410 0x557ea33fc050 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd484009830 tx=0x7fd484004270 comp rx=0 tx=0).stop 2024-09-19T06:16:45.005 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.997+0000 7fd49281a740 1 -- 172.21.15.2:0/2162786786 shutdown_connections 2024-09-19T06:16:45.005 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.997+0000 7fd49281a740 1 --2- 172.21.15.2:0/2162786786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557ea33fecb0 0x557ea33fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:45.005 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.997+0000 7fd49281a740 1 --2- 172.21.15.2:0/2162786786 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x557ea340ec20 0x557ea3411050 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:45.005 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.997+0000 7fd49281a740 1 --2- 172.21.15.2:0/2162786786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ea33f4410 0x557ea33fc050 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:45.005 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.997+0000 7fd49281a740 1 --2- 172.21.15.2:0/2162786786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ea33f3af0 0x557ea33fbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:45.005 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.997+0000 7fd49281a740 1 -- 172.21.15.2:0/2162786786 >> 172.21.15.2:0/2162786786 conn(0x557ea33f0060 msgr2=0x557ea33f5dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:45.005 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.997+0000 7fd470ff9640 0 client.25463 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:45.006 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.997+0000 7fd49281a740 1 -- 172.21.15.2:0/2162786786 shutdown_connections 2024-09-19T06:16:45.006 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.997+0000 7fd49281a740 1 -- 172.21.15.2:0/2162786786 wait complete. 2024-09-19T06:16:45.006 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:44.997+0000 7fd49281a740 20 client.25463 trim_cache size 0 max 16384 2024-09-19T06:16:45.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.997+0000 7fe61ca57640 1 --2- 172.21.15.2:0/1345775508 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5641f4bb8cb0 0x5641f4bbb0a0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4405c07c9b2aa5dc server_cookie=7ec81f688ded99a5 in_seq=0 out_seq=0 2024-09-19T06:16:45.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.997+0000 7fe5f7fff640 10 client.15840 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:16:45.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.998+0000 7fe5f7fff640 1 -- 172.21.15.2:0/1345775508 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fe610005020 con 0x5641f4bb8cb0 2024-09-19T06:16:45.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.998+0000 7fe5f7fff640 10 client.15840 handle_command_reply: tid=0 2024-09-19T06:16:45.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.998+0000 7fe621094740 1 client.15840 shutdown 2024-09-19T06:16:45.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.999+0000 7fe621094740 1 -- 172.21.15.2:0/1345775508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641f4ba9370 msgr2=0x5641f4ba6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:45.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.999+0000 7fe621094740 1 --2- 172.21.15.2:0/1345775508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641f4ba9370 0x5641f4ba6560 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fe610009240 tx=0x7fe610005fd0 comp rx=0 tx=0).stop 2024-09-19T06:16:45.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.999+0000 7fe621094740 1 -- 172.21.15.2:0/1345775508 shutdown_connections 2024-09-19T06:16:45.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.999+0000 7fe621094740 1 --2- 172.21.15.2:0/1345775508 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5641f4bb8cb0 0x5641f4bbb0a0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:45.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.999+0000 7fe621094740 1 --2- 172.21.15.2:0/1345775508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641f4ba9370 0x5641f4ba6560 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:45.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.999+0000 7fe621094740 1 --2- 172.21.15.2:0/1345775508 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641f4b9fb40 0x5641f4ba5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:45.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.999+0000 7fe621094740 1 --2- 172.21.15.2:0/1345775508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5641f4b9e5d0 0x5641f4ba8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:45.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.999+0000 7fe621094740 1 -- 172.21.15.2:0/1345775508 >> 172.21.15.2:0/1345775508 conn(0x5641f4b67310 msgr2=0x5641f4ba0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:45.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.999+0000 7fe5f7fff640 0 client.15840 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:16:45.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:44.999+0000 7fe621094740 1 -- 172.21.15.2:0/1345775508 shutdown_connections 2024-09-19T06:16:45.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.000+0000 7fe621094740 1 -- 172.21.15.2:0/1345775508 wait complete. 2024-09-19T06:16:45.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.000+0000 7fe621094740 20 client.15840 trim_cache size 0 max 16384 2024-09-19T06:16:45.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.022+0000 7fd49281a740 1 Processor -- start 2024-09-19T06:16:45.025 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.022+0000 7fd49281a740 1 -- start start 2024-09-19T06:16:45.025 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.022+0000 7fd49281a740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557ea33f3af0 0x557ea33f6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:45.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.022+0000 7fe621094740 1 Processor -- start 2024-09-19T06:16:45.026 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.022+0000 7fd49281a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ea33f4410 0x557ea33fc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:45.026 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.022+0000 7fd49281a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ea33fecb0 0x557ea3416960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:45.026 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.022+0000 7fd49281a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd4881ade50 con 0x557ea33f4410 2024-09-19T06:16:45.026 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.022+0000 7fd49281a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd4881ab720 con 0x557ea33fecb0 2024-09-19T06:16:45.026 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.023+0000 7fd49281a740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd4881a0510 con 0x557ea33f3af0 2024-09-19T06:16:45.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.022+0000 7fe621094740 1 -- start start 2024-09-19T06:16:45.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.023+0000 7fe621094740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5641f4b9e5d0 0x5641f4ba1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:45.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.023+0000 7fe621094740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641f4b9fb40 0x5641f4ba1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:45.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.023+0000 7fe621094740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641f4ba9370 0x5641f4bc1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:45.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.023+0000 7fe621094740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe6181a4750 con 0x5641f4b9fb40 2024-09-19T06:16:45.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.023+0000 7fe621094740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe6181a2020 con 0x5641f4b9e5d0 2024-09-19T06:16:45.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.023+0000 7fe621094740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe61819fe70 con 0x5641f4ba9370 2024-09-19T06:16:45.028 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.023+0000 7fd48df3c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ea33fecb0 0x557ea3416960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:45.028 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.023+0000 7fd48cf3a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ea33f4410 0x557ea33fc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:45.028 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.023+0000 7fd48df3c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ea33fecb0 0x557ea3416960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:49498/0 (socket says 172.21.15.2:49498) 2024-09-19T06:16:45.028 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.023+0000 7fd48df3c640 1 -- 172.21.15.2:0/2068095122 learned_addr learned my addr 172.21.15.2:0/2068095122 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:45.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.023+0000 7fe617fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641f4b9fb40 0x5641f4ba1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:45.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.023+0000 7fe61ca57640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5641f4b9e5d0 0x5641f4ba1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:45.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.023+0000 7fe617fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641f4b9fb40 0x5641f4ba1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53530/0 (socket says 172.21.15.2:53530) 2024-09-19T06:16:45.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.024+0000 7fe617fff640 1 -- 172.21.15.2:0/1077296624 learned_addr learned my addr 172.21.15.2:0/1077296624 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:45.030 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.024+0000 7fd48cf3a640 1 -- 172.21.15.2:0/2068095122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557ea33f3af0 msgr2=0x557ea33f6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:45.030 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.024+0000 7fd48cf3a640 1 --2- 172.21.15.2:0/2068095122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557ea33f3af0 0x557ea33f6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:45.030 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.024+0000 7fd48cf3a640 1 -- 172.21.15.2:0/2068095122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ea33fecb0 msgr2=0x557ea3416960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:45.030 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.024+0000 7fd48cf3a640 1 --2- 172.21.15.2:0/2068095122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ea33fecb0 0x557ea3416960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:45.030 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.024+0000 7fd48cf3a640 1 -- 172.21.15.2:0/2068095122 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ea33efe90 con 0x557ea33f4410 2024-09-19T06:16:45.030 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.024+0000 7fd48cf3a640 1 --2- 172.21.15.2:0/2068095122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ea33f4410 0x557ea33fc400 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x557ea33fd0c0 tx=0x7fd484005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e0c27c1c7de2154 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:45.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.024+0000 7fe61d258640 1 --2- 172.21.15.2:0/1077296624 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641f4ba9370 0x5641f4bc1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:45.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.024+0000 7fd472ffd640 1 -- 172.21.15.2:0/2068095122 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd48403f070 con 0x557ea33f4410 2024-09-19T06:16:45.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.024+0000 7fe617fff640 1 -- 172.21.15.2:0/1077296624 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641f4ba9370 msgr2=0x5641f4bc1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:45.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.024+0000 7fe617fff640 1 --2- 172.21.15.2:0/1077296624 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641f4ba9370 0x5641f4bc1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:45.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.025+0000 7fe617fff640 1 -- 172.21.15.2:0/1077296624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5641f4b9e5d0 msgr2=0x5641f4ba1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:45.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.025+0000 7fe617fff640 1 --2- 172.21.15.2:0/1077296624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5641f4b9e5d0 0x5641f4ba1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:45.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.025+0000 7fe617fff640 1 -- 172.21.15.2:0/1077296624 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641f4b9aed0 con 0x5641f4b9fb40 2024-09-19T06:16:45.032 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.025+0000 7fd472ffd640 1 -- 172.21.15.2:0/2068095122 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd484032b70 con 0x557ea33f4410 2024-09-19T06:16:45.032 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.025+0000 7fd472ffd640 1 -- 172.21.15.2:0/2068095122 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd484044440 con 0x557ea33f4410 2024-09-19T06:16:45.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.025+0000 7fe617fff640 1 --2- 172.21.15.2:0/1077296624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641f4b9fb40 0x5641f4ba1660 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fe604098800 tx=0x7fe60409c170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=709e7e35a86797ba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:45.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.025+0000 7fe6027fc640 1 -- 172.21.15.2:0/1077296624 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe604003b30 con 0x5641f4b9fb40 2024-09-19T06:16:45.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.025+0000 7fe6027fc640 1 -- 172.21.15.2:0/1077296624 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe60409caa0 con 0x5641f4b9fb40 2024-09-19T06:16:45.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.025+0000 7fe6027fc640 1 -- 172.21.15.2:0/1077296624 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6040cda90 con 0x5641f4b9fb40 2024-09-19T06:16:45.034 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.026+0000 7fd49281a740 1 -- 172.21.15.2:0/2068095122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ea33f4410 msgr2=0x557ea33fc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:45.034 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.026+0000 7fd49281a740 1 --2- 172.21.15.2:0/2068095122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ea33f4410 0x557ea33fc400 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x557ea33fd0c0 tx=0x7fd484005f90 comp rx=0 tx=0).stop 2024-09-19T06:16:45.034 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.026+0000 7fd49281a740 1 -- 172.21.15.2:0/2068095122 shutdown_connections 2024-09-19T06:16:45.034 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.026+0000 7fd49281a740 1 --2- 172.21.15.2:0/2068095122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ea33fecb0 0x557ea3416960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:45.034 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.026+0000 7fd49281a740 1 --2- 172.21.15.2:0/2068095122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ea33f4410 0x557ea33fc400 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:45.034 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.026+0000 7fd49281a740 1 --2- 172.21.15.2:0/2068095122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557ea33f3af0 0x557ea33f6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:45.034 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.026+0000 7fd49281a740 1 -- 172.21.15.2:0/2068095122 >> 172.21.15.2:0/2068095122 conn(0x557ea33f0060 msgr2=0x557ea33fdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:45.034 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.026+0000 7fd49281a740 1 -- 172.21.15.2:0/2068095122 shutdown_connections 2024-09-19T06:16:45.034 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.026+0000 7fd49281a740 1 -- 172.21.15.2:0/2068095122 wait complete. 2024-09-19T06:16:45.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.027+0000 7fe621094740 1 -- 172.21.15.2:0/1077296624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641f4b9fb40 msgr2=0x5641f4ba1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:45.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.027+0000 7fe621094740 1 --2- 172.21.15.2:0/1077296624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641f4b9fb40 0x5641f4ba1660 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fe604098800 tx=0x7fe60409c170 comp rx=0 tx=0).stop 2024-09-19T06:16:45.035 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.027+0000 7fd49281a740 1 -- start start 2024-09-19T06:16:45.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.027+0000 7fe621094740 1 -- 172.21.15.2:0/1077296624 shutdown_connections 2024-09-19T06:16:45.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.027+0000 7fe621094740 1 --2- 172.21.15.2:0/1077296624 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641f4ba9370 0x5641f4bc1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:45.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.027+0000 7fe621094740 1 --2- 172.21.15.2:0/1077296624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641f4b9fb40 0x5641f4ba1660 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:45.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.027+0000 7fe621094740 1 --2- 172.21.15.2:0/1077296624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5641f4b9e5d0 0x5641f4ba1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:45.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.027+0000 7fe621094740 1 -- 172.21.15.2:0/1077296624 >> 172.21.15.2:0/1077296624 conn(0x5641f4b67310 msgr2=0x5641f4bb4140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:45.036 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.027+0000 7fd49281a740 1 Processor -- start 2024-09-19T06:16:45.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.027+0000 7fe621094740 1 -- 172.21.15.2:0/1077296624 shutdown_connections 2024-09-19T06:16:45.037 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.028+0000 7fd49281a740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557ea33f3af0 0x557ea3406d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:45.037 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.028+0000 7fd49281a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ea33f4410 0x557ea3407290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:45.037 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.028+0000 7fd49281a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ea33fecb0 0x557ea3401d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:45.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.028+0000 7fe621094740 1 -- 172.21.15.2:0/1077296624 wait complete. 2024-09-19T06:16:45.038 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.028+0000 7fd48cf3a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ea33f4410 0x557ea3407290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:45.038 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.028+0000 7fd48cf3a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ea33f4410 0x557ea3407290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:49520/0 (socket says 172.21.15.2:49520) 2024-09-19T06:16:45.038 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.028+0000 7fd48df3c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ea33fecb0 0x557ea3401d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:45.038 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.029+0000 7fd48df3c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ea33fecb0 0x557ea3401d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53534/0 (socket says 172.21.15.2:53534) 2024-09-19T06:16:45.038 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.029+0000 7fd48cf3a640 1 -- 172.21.15.2:0/977437103 learned_addr learned my addr 172.21.15.2:0/977437103 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:45.038 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.029+0000 7fd49281a740 1 -- 172.21.15.2:0/977437103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd4881a0b80 con 0x557ea33fecb0 2024-09-19T06:16:45.039 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.029+0000 7fd49281a740 1 -- 172.21.15.2:0/977437103 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd4881ab050 con 0x557ea33f4410 2024-09-19T06:16:45.039 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.029+0000 7fd49281a740 1 -- 172.21.15.2:0/977437103 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd4881a1250 con 0x557ea33f3af0 2024-09-19T06:16:45.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.028+0000 7fe621094740 1 -- start start 2024-09-19T06:16:45.039 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.029+0000 7fd49281a740 10 client.0 _ll_register_callbacks cb 0x7fd484035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:45.039 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.029+0000 7fd48d73b640 1 --2- 172.21.15.2:0/977437103 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557ea33f3af0 0x557ea3406d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:45.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.028+0000 7fe621094740 1 Processor -- start 2024-09-19T06:16:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.029+0000 7fd48df3c640 1 -- 172.21.15.2:0/977437103 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557ea33f3af0 msgr2=0x557ea3406d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.029+0000 7fd48df3c640 1 --2- 172.21.15.2:0/977437103 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557ea33f3af0 0x557ea3406d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.029+0000 7fd48df3c640 1 -- 172.21.15.2:0/977437103 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ea33f4410 msgr2=0x557ea3407290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.029+0000 7fd48df3c640 1 --2- 172.21.15.2:0/977437103 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ea33f4410 0x557ea3407290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:45.041 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.029+0000 7fd48df3c640 1 -- 172.21.15.2:0/977437103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ea33eb2d0 con 0x557ea33fecb0 2024-09-19T06:16:45.041 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.029+0000 7fd48df3c640 1 --2- 172.21.15.2:0/977437103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ea33fecb0 0x557ea3401d00 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x557ea33fd010 tx=0x7fd480010b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e6c61f6a177d263 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:45.041 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.030+0000 7fd470ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:16:45.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.030+0000 7fe621094740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641f4b9e5d0 0x5641f4bad250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:45.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.030+0000 7fe621094740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641f4b9fb40 0x5641f4bad790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:45.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.030+0000 7fe621094740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5641f4ba9370 0x5641f4badcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:45.042 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.030+0000 7fd470ff9640 1 -- 172.21.15.2:0/977437103 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd480038060 con 0x557ea33fecb0 2024-09-19T06:16:45.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.030+0000 7fe621094740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe6181a04e0 con 0x5641f4b9fb40 2024-09-19T06:16:45.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.030+0000 7fe621094740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe6181a1950 con 0x5641f4ba9370 2024-09-19T06:16:45.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.030+0000 7fe621094740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe6181a0bb0 con 0x5641f4b9e5d0 2024-09-19T06:16:45.042 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.030+0000 7fd470ff9640 1 -- 172.21.15.2:0/977437103 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fd480029420 con 0x557ea33fecb0 2024-09-19T06:16:45.043 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.031+0000 7fd49281a740 1 -- 172.21.15.2:0/977437103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd484032b70 con 0x557ea33fecb0 2024-09-19T06:16:45.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.030+0000 7fe61ca57640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641f4b9e5d0 0x5641f4bad250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:45.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.030+0000 7fe61ca57640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641f4b9e5d0 0x5641f4bad250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:40024/0 (socket says 172.21.15.2:40024) 2024-09-19T06:16:45.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.030+0000 7fe621094740 10 client.0 _ll_register_callbacks cb 0x7fe604005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:45.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.030+0000 7fe61ca57640 1 -- 172.21.15.2:0/784868813 learned_addr learned my addr 172.21.15.2:0/784868813 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:45.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.030+0000 7fe61d258640 1 --2- 172.21.15.2:0/784868813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5641f4ba9370 0x5641f4badcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:45.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.031+0000 7fe617fff640 1 --2- 172.21.15.2:0/784868813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641f4b9fb40 0x5641f4bad790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:45.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.031+0000 7fd470ff9640 1 -- 172.21.15.2:0/977437103 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd480029620 con 0x557ea33fecb0 2024-09-19T06:16:45.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.031+0000 7fd49281a740 10 client.15849 fetch_fsmap learned FSMap version 26 2024-09-19T06:16:45.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.031+0000 7fd49281a740 1 -- 172.21.15.2:0/977437103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557ea3479e20 con 0x557ea33fecb0 2024-09-19T06:16:45.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.031+0000 7fe61d258640 1 -- 172.21.15.2:0/784868813 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641f4b9e5d0 msgr2=0x5641f4bad250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:45.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.031+0000 7fe61d258640 1 --2- 172.21.15.2:0/784868813 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641f4b9e5d0 0x5641f4bad250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:45.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.031+0000 7fe61d258640 1 -- 172.21.15.2:0/784868813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641f4b9fb40 msgr2=0x5641f4bad790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:45.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.031+0000 7fe61d258640 1 --2- 172.21.15.2:0/784868813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641f4b9fb40 0x5641f4bad790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:45.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.031+0000 7fe61d258640 1 -- 172.21.15.2:0/784868813 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641f4c22080 con 0x5641f4ba9370 2024-09-19T06:16:45.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.032+0000 7fe61d258640 1 --2- 172.21.15.2:0/784868813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5641f4ba9370 0x5641f4badcd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe610009cd0 tx=0x7fe6100055f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcd4ebf3ca4d838a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:45.045 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.032+0000 7fd470ff9640 1 -- 172.21.15.2:0/977437103 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd480029c70 con 0x557ea33fecb0 2024-09-19T06:16:45.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.032+0000 7fe5f7fff640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-09-19T06:16:45.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.032+0000 7fe5f7fff640 1 -- 172.21.15.2:0/784868813 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe610034e60 con 0x5641f4ba9370 2024-09-19T06:16:45.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.032+0000 7fe5f7fff640 1 -- 172.21.15.2:0/784868813 <== mon.2 v2:172.21.15.89:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fe610004e30 con 0x5641f4ba9370 2024-09-19T06:16:45.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.032+0000 7fe621094740 1 -- 172.21.15.2:0/784868813 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe60409caa0 con 0x5641f4ba9370 2024-09-19T06:16:45.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.032+0000 7fd470ff9640 1 -- 172.21.15.2:0/977437103 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fd480032070 con 0x557ea33fecb0 2024-09-19T06:16:45.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.032+0000 7fd49281a740 10 client.15849 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:16:45.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.032+0000 7fd49281a740 10 client.15849 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:45.047 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.032+0000 7fd49281a740 20 client.15849 populate_metadata read hostname 'smithi002' 2024-09-19T06:16:45.047 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.032+0000 7fd49281a740 1 --2- 172.21.15.2:0/977437103 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x557ea347a2a0 0x557ea347c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:45.047 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.032+0000 7fd49281a740 4 client.15849 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:16:45.047 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.032+0000 7fd49281a740 1 -- 172.21.15.2:0/977437103 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fd484032b70 con 0x557ea347a2a0 2024-09-19T06:16:45.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.033+0000 7fe5f7fff640 1 -- 172.21.15.2:0/784868813 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe610038040 con 0x5641f4ba9370 2024-09-19T06:16:45.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.033+0000 7fe621094740 10 client.25475 fetch_fsmap learned FSMap version 26 2024-09-19T06:16:45.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.033+0000 7fe621094740 1 -- 172.21.15.2:0/784868813 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5641f4c23340 con 0x5641f4ba9370 2024-09-19T06:16:45.048 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.033+0000 7fd48d73b640 1 --2- 172.21.15.2:0/977437103 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x557ea347a2a0 0x557ea347c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:45.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.033+0000 7fe5f7fff640 1 -- 172.21.15.2:0/784868813 <== mon.2 v2:172.21.15.89:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe60409caa0 con 0x5641f4ba9370 2024-09-19T06:16:45.048 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.033+0000 7fd470ff9640 10 client.15849 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:45.048 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.033+0000 7fd48d73b640 1 --2- 172.21.15.2:0/977437103 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x557ea347a2a0 0x557ea347c6c0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8575069676353f71 server_cookie=efea8280da958485 in_seq=0 out_seq=0 2024-09-19T06:16:45.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.033+0000 7fe5f7fff640 1 -- 172.21.15.2:0/784868813 <== mon.2 v2:172.21.15.89:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fe610054070 con 0x5641f4ba9370 2024-09-19T06:16:45.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.033+0000 7fe621094740 10 client.25475 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:16:45.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.033+0000 7fe621094740 10 client.25475 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:16:45.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.033+0000 7fe621094740 20 client.25475 populate_metadata read hostname 'smithi002' 2024-09-19T06:16:45.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.034+0000 7fe621094740 1 --2- 172.21.15.2:0/784868813 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5641f4c23a00 0x5641f4c25df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:45.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.034+0000 7fe621094740 4 client.25475 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:16:45.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.034+0000 7fe621094740 1 -- 172.21.15.2:0/784868813 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5641f4b11860 con 0x5641f4c23a00 2024-09-19T06:16:45.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.034+0000 7fe61ca57640 1 --2- 172.21.15.2:0/784868813 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5641f4c23a00 0x5641f4c25df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:45.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.035+0000 7fe61ca57640 1 --2- 172.21.15.2:0/784868813 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5641f4c23a00 0x5641f4c25df0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e92a9cda3498a652 server_cookie=625886773a677085 in_seq=0 out_seq=0 2024-09-19T06:16:45.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.035+0000 7fe5f7fff640 10 client.25475 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:16:45.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.036+0000 7fe5f7fff640 1 -- 172.21.15.2:0/784868813 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5641f4b11860 con 0x5641f4c23a00 2024-09-19T06:16:45.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.037+0000 7fe5f7fff640 10 client.25475 handle_command_reply: tid=0 2024-09-19T06:16:45.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.037+0000 7fe621094740 1 client.25475 shutdown 2024-09-19T06:16:45.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.037+0000 7fe621094740 1 -- 172.21.15.2:0/784868813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5641f4ba9370 msgr2=0x5641f4badcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:45.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.037+0000 7fe621094740 1 --2- 172.21.15.2:0/784868813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5641f4ba9370 0x5641f4badcd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe610009cd0 tx=0x7fe6100055f0 comp rx=0 tx=0).stop 2024-09-19T06:16:45.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.037+0000 7fe621094740 1 -- 172.21.15.2:0/784868813 shutdown_connections 2024-09-19T06:16:45.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.037+0000 7fe621094740 1 --2- 172.21.15.2:0/784868813 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5641f4c23a00 0x5641f4c25df0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:45.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.037+0000 7fe5f7fff640 0 client.25475 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:16:45.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.037+0000 7fe621094740 1 --2- 172.21.15.2:0/784868813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5641f4ba9370 0x5641f4badcd0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:45.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.037+0000 7fe621094740 1 --2- 172.21.15.2:0/784868813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5641f4b9fb40 0x5641f4bad790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:45.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.037+0000 7fe621094740 1 --2- 172.21.15.2:0/784868813 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5641f4b9e5d0 0x5641f4bad250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:45.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.037+0000 7fe621094740 1 -- 172.21.15.2:0/784868813 >> 172.21.15.2:0/784868813 conn(0x5641f4b67310 msgr2=0x5641f4bb4960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:45.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.038+0000 7fe621094740 1 -- 172.21.15.2:0/784868813 shutdown_connections 2024-09-19T06:16:45.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.038+0000 7fe621094740 1 -- 172.21.15.2:0/784868813 wait complete. 2024-09-19T06:16:45.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.038+0000 7fe621094740 20 client.25475 trim_cache size 0 max 16384 2024-09-19T06:16:45.052 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:16:45.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.039+0000 7fe61ecbb640 1 -- 172.21.15.2:0/360302349 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe6080a34b0 msgr2=0x7fe6080a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:45.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.039+0000 7fe61ecbb640 1 --2- 172.21.15.2:0/360302349 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe6080a34b0 0x7fe6080a5970 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe60c006010 tx=0x7fe60c005b50 comp rx=0 tx=0).stop 2024-09-19T06:16:45.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.039+0000 7fe61ecbb640 1 -- 172.21.15.2:0/360302349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe618102570 msgr2=0x7fe61806ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:45.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.039+0000 7fe61ecbb640 1 --2- 172.21.15.2:0/360302349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe618102570 0x7fe61806ec90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe60400ea60 tx=0x7fe60400ef20 comp rx=0 tx=0).stop 2024-09-19T06:16:45.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.039+0000 7fe61ecbb640 1 -- 172.21.15.2:0/360302349 shutdown_connections 2024-09-19T06:16:45.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.039+0000 7fe61ecbb640 1 --2- 172.21.15.2:0/360302349 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe6080a34b0 0x7fe6080a5970 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:45.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.039+0000 7fe61ecbb640 1 --2- 172.21.15.2:0/360302349 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe618102ef0 0x7fe61806f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:45.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.039+0000 7fe61ecbb640 1 --2- 172.21.15.2:0/360302349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe618102570 0x7fe61806ec90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:45.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.039+0000 7fe61ecbb640 1 --2- 172.21.15.2:0/360302349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe618100e20 0x7fe618073c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:45.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.039+0000 7fe61ecbb640 1 -- 172.21.15.2:0/360302349 >> 172.21.15.2:0/360302349 conn(0x7fe6180fc7d0 msgr2=0x7fe61810e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:45.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.039+0000 7fe61ecbb640 1 -- 172.21.15.2:0/360302349 shutdown_connections 2024-09-19T06:16:45.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:45.040+0000 7fe61ecbb640 1 -- 172.21.15.2:0/360302349 wait complete. 2024-09-19T06:16:45.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.096+0000 7fd470ff9640 1 -- 172.21.15.2:0/977437103 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fd484032b70 con 0x557ea347a2a0 2024-09-19T06:16:45.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.096+0000 7fd470ff9640 10 client.15849 handle_command_reply: tid=0 2024-09-19T06:16:45.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.096+0000 7fd49281a740 1 client.15849 shutdown 2024-09-19T06:16:45.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.096+0000 7fd49281a740 1 -- 172.21.15.2:0/977437103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ea33fecb0 msgr2=0x557ea3401d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:45.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.096+0000 7fd49281a740 1 --2- 172.21.15.2:0/977437103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ea33fecb0 0x557ea3401d00 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x557ea33fd010 tx=0x7fd480010b40 comp rx=0 tx=0).stop 2024-09-19T06:16:45.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.096+0000 7fd49281a740 1 -- 172.21.15.2:0/977437103 shutdown_connections 2024-09-19T06:16:45.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.096+0000 7fd49281a740 1 --2- 172.21.15.2:0/977437103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557ea33fecb0 0x557ea3401d00 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:45.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.096+0000 7fd49281a740 1 --2- 172.21.15.2:0/977437103 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x557ea347a2a0 0x557ea347c6c0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:45.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.096+0000 7fd49281a740 1 --2- 172.21.15.2:0/977437103 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557ea33f4410 0x557ea3407290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:45.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.096+0000 7fd49281a740 1 --2- 172.21.15.2:0/977437103 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557ea33f3af0 0x557ea3406d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:45.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.096+0000 7fd49281a740 1 -- 172.21.15.2:0/977437103 >> 172.21.15.2:0/977437103 conn(0x557ea33f0060 msgr2=0x557ea33ee9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:45.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.096+0000 7fd470ff9640 0 client.15849 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:45.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.097+0000 7fd49281a740 1 -- 172.21.15.2:0/977437103 shutdown_connections 2024-09-19T06:16:45.101 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.097+0000 7fd49281a740 1 -- 172.21.15.2:0/977437103 wait complete. 2024-09-19T06:16:45.101 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.097+0000 7fd49281a740 20 client.15849 trim_cache size 0 max 16384 2024-09-19T06:16:45.101 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-19T06:16:45.101 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-19T06:16:45.101 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-19T06:16:45.101 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-19T06:16:45.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.097+0000 7fd48f99f640 1 -- 172.21.15.2:0/1718269108 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fd4740a3490 msgr2=0x7fd4740a5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:45.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.097+0000 7fd48f99f640 1 --2- 172.21.15.2:0/1718269108 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fd4740a3490 0x7fd4740a5950 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd480012d90 tx=0x7fd480012df0 comp rx=0 tx=0).stop 2024-09-19T06:16:45.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.097+0000 7fd48f99f640 1 -- 172.21.15.2:0/1718269108 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd488100880 msgr2=0x7fd48810afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:45.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.097+0000 7fd48f99f640 1 --2- 172.21.15.2:0/1718269108 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd488100880 0x7fd48810afa0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd47800e9c0 tx=0x7fd47800ee80 comp rx=0 tx=0).stop 2024-09-19T06:16:45.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.097+0000 7fd48f99f640 1 -- 172.21.15.2:0/1718269108 shutdown_connections 2024-09-19T06:16:45.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.097+0000 7fd48f99f640 1 --2- 172.21.15.2:0/1718269108 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fd4740a3490 0x7fd4740a5950 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:45.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.097+0000 7fd48f99f640 1 --2- 172.21.15.2:0/1718269108 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd48810e430 0x7fd48810ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:45.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.097+0000 7fd48f99f640 1 --2- 172.21.15.2:0/1718269108 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd488101230 0x7fd48810b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:45.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.097+0000 7fd48f99f640 1 --2- 172.21.15.2:0/1718269108 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd488100880 0x7fd48810afa0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:45.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.097+0000 7fd48f99f640 1 -- 172.21.15.2:0/1718269108 >> 172.21.15.2:0/1718269108 conn(0x7fd4880779a0 msgr2=0x7fd4880ff680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:45.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.098+0000 7fd48f99f640 1 -- 172.21.15.2:0/1718269108 shutdown_connections 2024-09-19T06:16:45.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:45.098+0000 7fd48f99f640 1 -- 172.21.15.2:0/1718269108 wait complete. 2024-09-19T06:16:45.704 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:45 smithi002 ceph-mon[30982]: pgmap v61: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 85 MiB/s wr, 56 op/s 2024-09-19T06:16:45.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:45 smithi090 ceph-mon[34497]: pgmap v61: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 85 MiB/s wr, 56 op/s 2024-09-19T06:16:45.767 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:16:45.775 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-19T06:16:45.775 INFO:tasks.workunit.client.0.smithi002.stdout: Children see throughput for 1 rewriters = 700627.56 kB/sec 2024-09-19T06:16:45.775 INFO:tasks.workunit.client.0.smithi002.stdout: Parent sees throughput for 1 rewriters = 700557.37 kB/sec 2024-09-19T06:16:45.775 INFO:tasks.workunit.client.0.smithi002.stdout: Min throughput per process = 700627.56 kB/sec 2024-09-19T06:16:45.775 INFO:tasks.workunit.client.0.smithi002.stdout: Max throughput per process = 700627.56 kB/sec 2024-09-19T06:16:45.775 INFO:tasks.workunit.client.0.smithi002.stdout: Avg throughput per process = 700627.56 kB/sec 2024-09-19T06:16:45.775 INFO:tasks.workunit.client.0.smithi002.stdout: Min xfer = 1048576.00 kB 2024-09-19T06:16:45.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:45 smithi089 ceph-mon[34160]: pgmap v61: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 85 MiB/s wr, 56 op/s 2024-09-19T06:16:46.022 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:16:46.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.590+0000 7f37793bf640 1 -- 172.21.15.2:0/2390061584 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3774100480 msgr2=0x7f3774100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:46.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.590+0000 7f37793bf640 1 --2- 172.21.15.2:0/2390061584 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3774100480 0x7f3774100860 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f3764009900 tx=0x7f376402a410 comp rx=0 tx=0).stop 2024-09-19T06:16:46.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.590+0000 7f37793bf640 1 -- 172.21.15.2:0/2390061584 shutdown_connections 2024-09-19T06:16:46.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.590+0000 7f37793bf640 1 --2- 172.21.15.2:0/2390061584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37741055b0 0x7f377410d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:46.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.590+0000 7f37793bf640 1 --2- 172.21.15.2:0/2390061584 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3774100e30 0x7f3774104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:46.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.590+0000 7f37793bf640 1 --2- 172.21.15.2:0/2390061584 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3774100480 0x7f3774100860 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:46.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.590+0000 7f37793bf640 1 -- 172.21.15.2:0/2390061584 >> 172.21.15.2:0/2390061584 conn(0x7f3774077210 msgr2=0x7f37740fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:46.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.590+0000 7f37793bf640 1 -- 172.21.15.2:0/2390061584 shutdown_connections 2024-09-19T06:16:46.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.590+0000 7f37793bf640 1 -- 172.21.15.2:0/2390061584 wait complete. 2024-09-19T06:16:46.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.590+0000 7f37793bf640 1 Processor -- start 2024-09-19T06:16:46.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.591+0000 7f37793bf640 1 -- start start 2024-09-19T06:16:46.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.591+0000 7f37793bf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3774100480 0x7f37741983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:46.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.591+0000 7f37793bf640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3774100e30 0x7f3774198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:46.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.591+0000 7f37793bf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37741055b0 0x7f377419cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:46.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.591+0000 7f37793bf640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f377410fc60 con 0x7f37741055b0 2024-09-19T06:16:46.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.591+0000 7f37793bf640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f377410fae0 con 0x7f3774100480 2024-09-19T06:16:46.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.591+0000 7f37793bf640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f377410fde0 con 0x7f3774100e30 2024-09-19T06:16:46.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.591+0000 7f37737fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37741055b0 0x7f377419cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:46.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.591+0000 7f37737fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37741055b0 0x7f377419cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44762/0 (socket says 172.21.15.2:44762) 2024-09-19T06:16:46.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.591+0000 7f37737fe640 1 -- 172.21.15.2:0/4198446967 learned_addr learned my addr 172.21.15.2:0/4198446967 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:46.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.591+0000 7f37727fc640 1 --2- 172.21.15.2:0/4198446967 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3774100e30 0x7f3774198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:46.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.591+0000 7f3772ffd640 1 --2- 172.21.15.2:0/4198446967 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3774100480 0x7f37741983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:46.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.591+0000 7f37737fe640 1 -- 172.21.15.2:0/4198446967 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3774100e30 msgr2=0x7f3774198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:46.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.591+0000 7f37737fe640 1 --2- 172.21.15.2:0/4198446967 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3774100e30 0x7f3774198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:46.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.591+0000 7f37737fe640 1 -- 172.21.15.2:0/4198446967 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3774100480 msgr2=0x7f37741983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:46.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.591+0000 7f37737fe640 1 --2- 172.21.15.2:0/4198446967 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3774100480 0x7f37741983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:46.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.591+0000 7f37737fe640 1 -- 172.21.15.2:0/4198446967 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f377419d370 con 0x7f37741055b0 2024-09-19T06:16:46.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.592+0000 7f37737fe640 1 --2- 172.21.15.2:0/4198446967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37741055b0 0x7f377419cc90 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f376c00b970 tx=0x7f376c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:46.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.592+0000 7f375bfff640 1 -- 172.21.15.2:0/4198446967 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f376c019070 con 0x7f37741055b0 2024-09-19T06:16:46.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.592+0000 7f37793bf640 1 -- 172.21.15.2:0/4198446967 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f377419d660 con 0x7f37741055b0 2024-09-19T06:16:46.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.592+0000 7f375bfff640 1 -- 172.21.15.2:0/4198446967 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f376c014440 con 0x7f37741055b0 2024-09-19T06:16:46.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.592+0000 7f375bfff640 1 -- 172.21.15.2:0/4198446967 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f376c0075d0 con 0x7f37741055b0 2024-09-19T06:16:46.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.592+0000 7f37793bf640 1 -- 172.21.15.2:0/4198446967 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37741a4f40 con 0x7f37741055b0 2024-09-19T06:16:46.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.594+0000 7f375bfff640 1 -- 172.21.15.2:0/4198446967 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f376c01c070 con 0x7f37741055b0 2024-09-19T06:16:46.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.594+0000 7f377b798740 1 Processor -- start 2024-09-19T06:16:46.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.594+0000 7f377b798740 1 -- start start 2024-09-19T06:16:46.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.595+0000 7f377b798740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556e71556b40 0x556e71555090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:46.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.595+0000 7f377b798740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e715555d0 0x556e71555a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:46.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.595+0000 7f377b798740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556e71560370 0x556e71562760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:46.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.595+0000 7f377b798740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556e714bb2f0 con 0x556e715555d0 2024-09-19T06:16:46.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.595+0000 7f377b798740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x556e71462cf0 con 0x556e71560370 2024-09-19T06:16:46.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.595+0000 7f377b798740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556e714b72b0 con 0x556e71556b40 2024-09-19T06:16:46.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.595+0000 7f3772ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e715555d0 0x556e71555a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:46.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.595+0000 7f3772ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e715555d0 0x556e71555a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44768/0 (socket says 172.21.15.2:44768) 2024-09-19T06:16:46.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.595+0000 7f3772ffd640 1 -- 172.21.15.2:0/1176933560 learned_addr learned my addr 172.21.15.2:0/1176933560 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:46.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.595+0000 7f37727fc640 1 --2- 172.21.15.2:0/1176933560 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556e71556b40 0x556e71555090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:46.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.595+0000 7f375bfff640 1 --2- 172.21.15.2:0/4198446967 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f375c0a33b0 0x7f375c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:46.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.595+0000 7f37727fc640 1 --2- 172.21.15.2:0/1176933560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556e71560370 0x556e71562760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:46.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.595+0000 7f3772ffd640 1 -- 172.21.15.2:0/1176933560 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556e71556b40 msgr2=0x556e71555090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:46.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.595+0000 7f3772ffd640 1 --2- 172.21.15.2:0/1176933560 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556e71556b40 0x556e71555090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:46.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.595+0000 7f3772ffd640 1 -- 172.21.15.2:0/1176933560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556e71560370 msgr2=0x556e71562760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:46.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.595+0000 7f3772ffd640 1 --2- 172.21.15.2:0/1176933560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556e71560370 0x556e71562760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:46.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.595+0000 7f3772ffd640 1 -- 172.21.15.2:0/1176933560 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e714473a0 con 0x556e715555d0 2024-09-19T06:16:46.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.595+0000 7f37727fc640 1 --2- 172.21.15.2:0/1176933560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556e71560370 0x556e71562760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:16:46.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.595+0000 7f375bfff640 1 -- 172.21.15.2:0/4198446967 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f376c0cf1b0 con 0x7f37741055b0 2024-09-19T06:16:46.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.595+0000 7f37737fe640 1 --2- 172.21.15.2:0/4198446967 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f375c0a33b0 0x7f375c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:46.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.596+0000 7f3772ffd640 1 --2- 172.21.15.2:0/1176933560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e715555d0 0x556e71555a10 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f3764009900 tx=0x7f3764032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f6141f7d6f39dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:46.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.596+0000 7f37597fa640 1 -- 172.21.15.2:0/1176933560 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3764040070 con 0x556e715555d0 2024-09-19T06:16:46.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.596+0000 7f37597fa640 1 -- 172.21.15.2:0/1176933560 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f37640316a0 con 0x556e715555d0 2024-09-19T06:16:46.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.596+0000 7f37597fa640 1 -- 172.21.15.2:0/1176933560 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3764035040 con 0x556e715555d0 2024-09-19T06:16:46.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.596+0000 7f377b798740 1 -- 172.21.15.2:0/1176933560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e715555d0 msgr2=0x556e71555a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:46.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.596+0000 7f37737fe640 1 --2- 172.21.15.2:0/4198446967 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f375c0a33b0 0x7f375c0a5870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f376c098050 tx=0x7f376c014b50 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:46.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.596+0000 7f377b798740 1 --2- 172.21.15.2:0/1176933560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e715555d0 0x556e71555a10 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f3764009900 tx=0x7f3764032e40 comp rx=0 tx=0).stop 2024-09-19T06:16:46.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.597+0000 7f377b798740 1 -- 172.21.15.2:0/1176933560 shutdown_connections 2024-09-19T06:16:46.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.597+0000 7f377b798740 1 --2- 172.21.15.2:0/1176933560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556e71560370 0x556e71562760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:46.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.597+0000 7f377b798740 1 --2- 172.21.15.2:0/1176933560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e715555d0 0x556e71555a10 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:46.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.597+0000 7f377b798740 1 --2- 172.21.15.2:0/1176933560 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556e71556b40 0x556e71555090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:46.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.597+0000 7f377b798740 1 -- 172.21.15.2:0/1176933560 >> 172.21.15.2:0/1176933560 conn(0x556e7151e310 msgr2=0x556e71551c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:46.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.597+0000 7f377b798740 1 -- 172.21.15.2:0/1176933560 shutdown_connections 2024-09-19T06:16:46.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.597+0000 7f377b798740 1 -- 172.21.15.2:0/1176933560 wait complete. 2024-09-19T06:16:46.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.597+0000 7f377b798740 1 -- start start 2024-09-19T06:16:46.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.597+0000 7f377b798740 1 Processor -- start 2024-09-19T06:16:46.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.597+0000 7f377b798740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556e715555d0 0x556e7155fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:46.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.597+0000 7f377b798740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556e71556b40 0x556e7155d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:46.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.597+0000 7f377b798740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e71560370 0x556e7155d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:46.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.597+0000 7f377b798740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556e71563010 con 0x556e71560370 2024-09-19T06:16:46.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.597+0000 7f377b798740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x556e71476060 con 0x556e715555d0 2024-09-19T06:16:46.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.597+0000 7f377b798740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556e71563190 con 0x556e71556b40 2024-09-19T06:16:46.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.597+0000 7f377b798740 10 client.0 _ll_register_callbacks cb 0x556e711c98c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:46.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.597+0000 7f37727fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e71560370 0x556e7155d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:46.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.597+0000 7f37727fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e71560370 0x556e7155d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44778/0 (socket says 172.21.15.2:44778) 2024-09-19T06:16:46.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.597+0000 7f37727fc640 1 -- 172.21.15.2:0/2159293899 learned_addr learned my addr 172.21.15.2:0/2159293899 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:46.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.598+0000 7f3772ffd640 1 --2- 172.21.15.2:0/2159293899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556e71556b40 0x556e7155d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:46.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.598+0000 7f37727fc640 1 --2- 172.21.15.2:0/2159293899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556e715555d0 0x556e7155fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:46.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.598+0000 7f37727fc640 1 -- 172.21.15.2:0/2159293899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556e71556b40 msgr2=0x556e7155d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:46.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.598+0000 7f37727fc640 1 --2- 172.21.15.2:0/2159293899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556e71556b40 0x556e7155d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:46.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.598+0000 7f37727fc640 1 -- 172.21.15.2:0/2159293899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556e715555d0 msgr2=0x556e7155fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:46.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.598+0000 7f37727fc640 1 --2- 172.21.15.2:0/2159293899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556e715555d0 0x556e7155fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:46.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.598+0000 7f37727fc640 1 -- 172.21.15.2:0/2159293899 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e7122c3c0 con 0x556e71560370 2024-09-19T06:16:46.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.598+0000 7f37727fc640 1 --2- 172.21.15.2:0/2159293899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e71560370 0x556e7155d810 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f376800fe90 tx=0x7f376800bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=442e138ac952d211 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:46.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.598+0000 7f3756ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:16:46.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.598+0000 7f3756ff5640 1 -- 172.21.15.2:0/2159293899 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f376800f050 con 0x556e71560370 2024-09-19T06:16:46.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.598+0000 7f3756ff5640 1 -- 172.21.15.2:0/2159293899 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f376800f1f0 con 0x556e71560370 2024-09-19T06:16:46.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.598+0000 7f377b798740 1 -- 172.21.15.2:0/2159293899 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37640316a0 con 0x556e71560370 2024-09-19T06:16:46.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.598+0000 7f3756ff5640 1 -- 172.21.15.2:0/2159293899 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3768005020 con 0x556e71560370 2024-09-19T06:16:46.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.598+0000 7f377b798740 10 client.15864 fetch_fsmap learned FSMap version 26 2024-09-19T06:16:46.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.598+0000 7f377b798740 1 -- 172.21.15.2:0/2159293899 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556e7156eb90 con 0x556e71560370 2024-09-19T06:16:46.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.599+0000 7f3756ff5640 1 -- 172.21.15.2:0/2159293899 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f37640316a0 con 0x556e71560370 2024-09-19T06:16:46.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.599+0000 7f3756ff5640 1 -- 172.21.15.2:0/2159293899 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f376801c030 con 0x556e71560370 2024-09-19T06:16:46.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.599+0000 7f377b798740 10 client.15864 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:16:46.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.599+0000 7f377b798740 10 client.15864 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:46.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.599+0000 7f377b798740 20 client.15864 populate_metadata read hostname 'smithi002' 2024-09-19T06:16:46.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.599+0000 7f377b798740 1 --2- 172.21.15.2:0/2159293899 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556e7156ffa0 0x556e71572390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:46.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.599+0000 7f377b798740 4 client.15864 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:16:46.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.599+0000 7f377b798740 1 -- 172.21.15.2:0/2159293899 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556e714c8860 con 0x556e7156ffa0 2024-09-19T06:16:46.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.599+0000 7f3772ffd640 1 --2- 172.21.15.2:0/2159293899 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556e7156ffa0 0x556e71572390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:46.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.600+0000 7f3756ff5640 10 client.15864 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:46.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.600+0000 7f3772ffd640 1 --2- 172.21.15.2:0/2159293899 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556e7156ffa0 0x556e71572390 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69e9dda14a07775 server_cookie=a0e8a92411d102a6 in_seq=0 out_seq=0 2024-09-19T06:16:46.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.600+0000 7f3756ff5640 1 -- 172.21.15.2:0/2159293899 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556e714c8860 con 0x556e7156ffa0 2024-09-19T06:16:46.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.600+0000 7f3756ff5640 10 client.15864 handle_command_reply: tid=0 2024-09-19T06:16:46.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.600+0000 7f377b798740 1 client.15864 shutdown 2024-09-19T06:16:46.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.600+0000 7f377b798740 1 -- 172.21.15.2:0/2159293899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e71560370 msgr2=0x556e7155d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:46.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.600+0000 7f377b798740 1 --2- 172.21.15.2:0/2159293899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e71560370 0x556e7155d810 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f376800fe90 tx=0x7f376800bc30 comp rx=0 tx=0).stop 2024-09-19T06:16:46.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.600+0000 7f377b798740 1 -- 172.21.15.2:0/2159293899 shutdown_connections 2024-09-19T06:16:46.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.600+0000 7f377b798740 1 --2- 172.21.15.2:0/2159293899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e71560370 0x556e7155d810 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:46.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.600+0000 7f377b798740 1 --2- 172.21.15.2:0/2159293899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556e71556b40 0x556e7155d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:46.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.600+0000 7f377b798740 1 --2- 172.21.15.2:0/2159293899 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556e7156ffa0 0x556e71572390 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:46.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.600+0000 7f377b798740 1 --2- 172.21.15.2:0/2159293899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556e715555d0 0x556e7155fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:46.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.600+0000 7f377b798740 1 -- 172.21.15.2:0/2159293899 >> 172.21.15.2:0/2159293899 conn(0x556e7151e310 msgr2=0x556e71557960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:46.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.600+0000 7f3756ff5640 0 client.15864 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:46.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.601+0000 7f377b798740 1 -- 172.21.15.2:0/2159293899 shutdown_connections 2024-09-19T06:16:46.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.601+0000 7f377b798740 1 -- 172.21.15.2:0/2159293899 wait complete. 2024-09-19T06:16:46.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.601+0000 7f377b798740 20 client.15864 trim_cache size 0 max 16384 2024-09-19T06:16:46.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.613+0000 7f377b798740 1 Processor -- start 2024-09-19T06:16:46.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.614+0000 7f377b798740 1 -- start start 2024-09-19T06:16:46.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.614+0000 7f377b798740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556e715555d0 0x556e7154cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:46.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.614+0000 7f377b798740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e71556b40 0x556e7155eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:46.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.614+0000 7f377b798740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556e71560370 0x556e71558120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:46.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.614+0000 7f377b798740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f37741b0060 con 0x556e71556b40 2024-09-19T06:16:46.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.614+0000 7f377b798740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f37741ad930 con 0x556e71560370 2024-09-19T06:16:46.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.614+0000 7f377b798740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f37741ab780 con 0x556e715555d0 2024-09-19T06:16:46.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.614+0000 7f3772ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e71556b40 0x556e7155eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:46.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.614+0000 7f3772ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e71556b40 0x556e7155eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44792/0 (socket says 172.21.15.2:44792) 2024-09-19T06:16:46.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.614+0000 7f3772ffd640 1 -- 172.21.15.2:0/3627507969 learned_addr learned my addr 172.21.15.2:0/3627507969 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:46.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.614+0000 7f37727fc640 1 --2- 172.21.15.2:0/3627507969 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556e715555d0 0x556e7154cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:46.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.614+0000 7f37727fc640 1 --2- 172.21.15.2:0/3627507969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556e71560370 0x556e71558120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:46.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.614+0000 7f3772ffd640 1 -- 172.21.15.2:0/3627507969 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556e715555d0 msgr2=0x556e7154cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:46.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.614+0000 7f3772ffd640 1 --2- 172.21.15.2:0/3627507969 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556e715555d0 0x556e7154cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:46.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.614+0000 7f3772ffd640 1 -- 172.21.15.2:0/3627507969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556e71560370 msgr2=0x556e71558120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:46.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.614+0000 7f3772ffd640 1 --2- 172.21.15.2:0/3627507969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556e71560370 0x556e71558120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:46.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.614+0000 7f3772ffd640 1 -- 172.21.15.2:0/3627507969 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e7155c050 con 0x556e71556b40 2024-09-19T06:16:46.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.614+0000 7f3772ffd640 1 --2- 172.21.15.2:0/3627507969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e71556b40 0x556e7155eff0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f3764009900 tx=0x7f376402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18e970faa84b74c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:46.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.614+0000 7f3758ff9640 1 -- 172.21.15.2:0/3627507969 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3764053070 con 0x556e71556b40 2024-09-19T06:16:46.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.615+0000 7f3758ff9640 1 -- 172.21.15.2:0/3627507969 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3764005550 con 0x556e71556b40 2024-09-19T06:16:46.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.615+0000 7f3758ff9640 1 -- 172.21.15.2:0/3627507969 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3764035040 con 0x556e71556b40 2024-09-19T06:16:46.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.615+0000 7f377b798740 1 -- 172.21.15.2:0/3627507969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e71556b40 msgr2=0x556e7155eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:46.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.615+0000 7f377b798740 1 --2- 172.21.15.2:0/3627507969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e71556b40 0x556e7155eff0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f3764009900 tx=0x7f376402a410 comp rx=0 tx=0).stop 2024-09-19T06:16:46.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.615+0000 7f377b798740 1 -- 172.21.15.2:0/3627507969 shutdown_connections 2024-09-19T06:16:46.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.615+0000 7f377b798740 1 --2- 172.21.15.2:0/3627507969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556e71560370 0x556e71558120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:46.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.615+0000 7f377b798740 1 --2- 172.21.15.2:0/3627507969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e71556b40 0x556e7155eff0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:46.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.615+0000 7f377b798740 1 --2- 172.21.15.2:0/3627507969 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556e715555d0 0x556e7154cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:46.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.615+0000 7f377b798740 1 -- 172.21.15.2:0/3627507969 >> 172.21.15.2:0/3627507969 conn(0x556e7151e310 msgr2=0x556e7155e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:46.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.615+0000 7f377b798740 1 -- 172.21.15.2:0/3627507969 shutdown_connections 2024-09-19T06:16:46.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.615+0000 7f377b798740 1 -- 172.21.15.2:0/3627507969 wait complete. 2024-09-19T06:16:46.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.616+0000 7f377b798740 1 -- start start 2024-09-19T06:16:46.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.616+0000 7f377b798740 1 Processor -- start 2024-09-19T06:16:46.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.616+0000 7f377b798740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556e715555d0 0x556e715689a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:46.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.616+0000 7f377b798740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556e71556b40 0x556e71559bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:46.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.616+0000 7f377b798740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e71560370 0x556e7155a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:46.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.616+0000 7f377b798740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f37741abdf0 con 0x556e71560370 2024-09-19T06:16:46.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.616+0000 7f377b798740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f37741ad260 con 0x556e71556b40 2024-09-19T06:16:46.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.616+0000 7f377b798740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f37741ac4c0 con 0x556e715555d0 2024-09-19T06:16:46.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.616+0000 7f377b798740 10 client.0 _ll_register_callbacks cb 0x7f376800fad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:46.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.616+0000 7f37727fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e71560370 0x556e7155a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:46.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.616+0000 7f37727fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e71560370 0x556e7155a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44798/0 (socket says 172.21.15.2:44798) 2024-09-19T06:16:46.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.616+0000 7f37727fc640 1 -- 172.21.15.2:0/2368290269 learned_addr learned my addr 172.21.15.2:0/2368290269 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:46.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.616+0000 7f3772ffd640 1 --2- 172.21.15.2:0/2368290269 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556e71556b40 0x556e71559bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:46.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.616+0000 7f37727fc640 1 --2- 172.21.15.2:0/2368290269 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556e715555d0 0x556e715689a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:46.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.616+0000 7f37727fc640 1 -- 172.21.15.2:0/2368290269 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556e715555d0 msgr2=0x556e715689a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:46.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.616+0000 7f37727fc640 1 --2- 172.21.15.2:0/2368290269 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556e715555d0 0x556e715689a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:46.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.616+0000 7f37727fc640 1 -- 172.21.15.2:0/2368290269 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556e71556b40 msgr2=0x556e71559bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:46.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.616+0000 7f37727fc640 1 --2- 172.21.15.2:0/2368290269 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556e71556b40 0x556e71559bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:46.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.616+0000 7f37727fc640 1 -- 172.21.15.2:0/2368290269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e7155a6e0 con 0x556e71560370 2024-09-19T06:16:46.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.617+0000 7f37727fc640 1 --2- 172.21.15.2:0/2368290269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e71560370 0x556e7155a0f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f376800ab90 tx=0x7f376802d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22dda5bb7fe181c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:46.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.617+0000 7f3756ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:16:46.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.617+0000 7f3756ff5640 1 -- 172.21.15.2:0/2368290269 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f376800f030 con 0x556e71560370 2024-09-19T06:16:46.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.617+0000 7f3756ff5640 1 -- 172.21.15.2:0/2368290269 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f3768019040 con 0x556e71560370 2024-09-19T06:16:46.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.617+0000 7f377b798740 1 -- 172.21.15.2:0/2368290269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3764005550 con 0x556e71560370 2024-09-19T06:16:46.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.617+0000 7f3756ff5640 1 -- 172.21.15.2:0/2368290269 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f376800f1d0 con 0x556e71560370 2024-09-19T06:16:46.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.617+0000 7f377b798740 10 client.15870 fetch_fsmap learned FSMap version 26 2024-09-19T06:16:46.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.617+0000 7f377b798740 1 -- 172.21.15.2:0/2368290269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556e715da990 con 0x556e71560370 2024-09-19T06:16:46.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.617+0000 7f3756ff5640 1 -- 172.21.15.2:0/2368290269 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3764005550 con 0x556e71560370 2024-09-19T06:16:46.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.617+0000 7f3756ff5640 1 -- 172.21.15.2:0/2368290269 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f376801c040 con 0x556e71560370 2024-09-19T06:16:46.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.617+0000 7f377b798740 10 client.15870 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:16:46.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.617+0000 7f377b798740 10 client.15870 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:46.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.617+0000 7f377b798740 20 client.15870 populate_metadata read hostname 'smithi002' 2024-09-19T06:16:46.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.617+0000 7f377b798740 1 --2- 172.21.15.2:0/2368290269 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556e715db0b0 0x556e715dd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:46.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.617+0000 7f377b798740 4 client.15870 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:16:46.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.617+0000 7f377b798740 1 -- 172.21.15.2:0/2368290269 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556e714c2d70 con 0x556e715db0b0 2024-09-19T06:16:46.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.618+0000 7f3772ffd640 1 --2- 172.21.15.2:0/2368290269 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556e715db0b0 0x556e715dd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:46.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.618+0000 7f3772ffd640 1 --2- 172.21.15.2:0/2368290269 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556e715db0b0 0x556e715dd4d0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2defd5b781b15ff6 server_cookie=dc0ba7ab122eac47 in_seq=0 out_seq=0 2024-09-19T06:16:46.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.618+0000 7f3756ff5640 10 client.15870 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:46.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.618+0000 7f3756ff5640 1 -- 172.21.15.2:0/2368290269 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556e714c2d70 con 0x556e715db0b0 2024-09-19T06:16:46.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.618+0000 7f3756ff5640 10 client.15870 handle_command_reply: tid=0 2024-09-19T06:16:46.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.618+0000 7f377b798740 1 client.15870 shutdown 2024-09-19T06:16:46.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.618+0000 7f377b798740 1 -- 172.21.15.2:0/2368290269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e71560370 msgr2=0x556e7155a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:46.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.618+0000 7f377b798740 1 --2- 172.21.15.2:0/2368290269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e71560370 0x556e7155a0f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f376800ab90 tx=0x7f376802d040 comp rx=0 tx=0).stop 2024-09-19T06:16:46.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.618+0000 7f377b798740 1 -- 172.21.15.2:0/2368290269 shutdown_connections 2024-09-19T06:16:46.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.618+0000 7f377b798740 1 --2- 172.21.15.2:0/2368290269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e71560370 0x556e7155a0f0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:46.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.618+0000 7f377b798740 1 --2- 172.21.15.2:0/2368290269 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556e715db0b0 0x556e715dd4d0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:46.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.618+0000 7f377b798740 1 --2- 172.21.15.2:0/2368290269 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556e71556b40 0x556e71559bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:46.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.618+0000 7f377b798740 1 --2- 172.21.15.2:0/2368290269 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556e715555d0 0x556e715689a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:46.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.618+0000 7f3756ff5640 0 client.15870 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:46.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.618+0000 7f377b798740 1 -- 172.21.15.2:0/2368290269 >> 172.21.15.2:0/2368290269 conn(0x556e7151e310 msgr2=0x556e7155e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:46.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.619+0000 7f377b798740 1 -- 172.21.15.2:0/2368290269 shutdown_connections 2024-09-19T06:16:46.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.619+0000 7f377b798740 1 -- 172.21.15.2:0/2368290269 wait complete. 2024-09-19T06:16:46.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.619+0000 7f377b798740 20 client.15870 trim_cache size 0 max 16384 2024-09-19T06:16:46.627 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:16:46.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.619+0000 7f37793bf640 1 -- 172.21.15.2:0/4198446967 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f375c0a33b0 msgr2=0x7f375c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:46.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.619+0000 7f37793bf640 1 --2- 172.21.15.2:0/4198446967 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f375c0a33b0 0x7f375c0a5870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f376c098050 tx=0x7f376c014b50 comp rx=0 tx=0).stop 2024-09-19T06:16:46.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.619+0000 7f37793bf640 1 -- 172.21.15.2:0/4198446967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37741055b0 msgr2=0x7f377419cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:46.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.619+0000 7f37793bf640 1 --2- 172.21.15.2:0/4198446967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37741055b0 0x7f377419cc90 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f376c00b970 tx=0x7f376c00be30 comp rx=0 tx=0).stop 2024-09-19T06:16:46.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.619+0000 7f37793bf640 1 -- 172.21.15.2:0/4198446967 shutdown_connections 2024-09-19T06:16:46.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.619+0000 7f37793bf640 1 --2- 172.21.15.2:0/4198446967 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f375c0a33b0 0x7f375c0a5870 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:46.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.619+0000 7f37793bf640 1 --2- 172.21.15.2:0/4198446967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37741055b0 0x7f377419cc90 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:46.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.619+0000 7f37793bf640 1 --2- 172.21.15.2:0/4198446967 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3774100e30 0x7f3774198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:46.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.619+0000 7f37793bf640 1 --2- 172.21.15.2:0/4198446967 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3774100480 0x7f37741983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:46.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.619+0000 7f37793bf640 1 -- 172.21.15.2:0/4198446967 >> 172.21.15.2:0/4198446967 conn(0x7f3774077210 msgr2=0x7f37741038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:46.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.619+0000 7f37793bf640 1 -- 172.21.15.2:0/4198446967 shutdown_connections 2024-09-19T06:16:46.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:46.619+0000 7f37793bf640 1 -- 172.21.15.2:0/4198446967 wait complete. 2024-09-19T06:16:47.725 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:47 smithi002 ceph-mon[30982]: pgmap v62: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 85 MiB/s wr, 51 op/s 2024-09-19T06:16:47.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:47 smithi090 ceph-mon[34497]: pgmap v62: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 85 MiB/s wr, 51 op/s 2024-09-19T06:16:47.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:47 smithi089 ceph-mon[34160]: pgmap v62: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 85 MiB/s wr, 51 op/s 2024-09-19T06:16:48.198 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-19T06:16:48.198 INFO:tasks.workunit.client.0.smithi002.stdout: Children see throughput for 1 readers = 7665536.50 kB/sec 2024-09-19T06:16:48.198 INFO:tasks.workunit.client.0.smithi002.stdout: Parent sees throughput for 1 readers = 7651653.49 kB/sec 2024-09-19T06:16:48.198 INFO:tasks.workunit.client.0.smithi002.stdout: Min throughput per process = 7665536.50 kB/sec 2024-09-19T06:16:48.198 INFO:tasks.workunit.client.0.smithi002.stdout: Max throughput per process = 7665536.50 kB/sec 2024-09-19T06:16:48.198 INFO:tasks.workunit.client.0.smithi002.stdout: Avg throughput per process = 7665536.50 kB/sec 2024-09-19T06:16:48.198 INFO:tasks.workunit.client.0.smithi002.stdout: Min xfer = 1048576.00 kB 2024-09-19T06:16:48.426 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:16:48.427 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:16:48.685 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:16:49.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.109+0000 7feea27bc640 1 -- 172.21.15.2:0/1269050733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee9c102d30 msgr2=0x7fee9c103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:49.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.109+0000 7feea27bc640 1 --2- 172.21.15.2:0/1269050733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee9c102d30 0x7fee9c103110 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fee8c009930 tx=0x7fee8c02a440 comp rx=0 tx=0).stop 2024-09-19T06:16:49.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.109+0000 7feea27bc640 1 -- 172.21.15.2:0/1269050733 shutdown_connections 2024-09-19T06:16:49.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.109+0000 7feea27bc640 1 --2- 172.21.15.2:0/1269050733 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee9c1082a0 0x7fee9c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.109+0000 7feea27bc640 1 --2- 172.21.15.2:0/1269050733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee9c1036e0 0x7fee9c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.109+0000 7feea27bc640 1 --2- 172.21.15.2:0/1269050733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee9c102d30 0x7fee9c103110 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.109+0000 7feea27bc640 1 -- 172.21.15.2:0/1269050733 >> 172.21.15.2:0/1269050733 conn(0x7fee9c0fc7d0 msgr2=0x7fee9c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:49.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.109+0000 7feea27bc640 1 -- 172.21.15.2:0/1269050733 shutdown_connections 2024-09-19T06:16:49.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.109+0000 7feea27bc640 1 -- 172.21.15.2:0/1269050733 wait complete. 2024-09-19T06:16:49.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.110+0000 7feea27bc640 1 Processor -- start 2024-09-19T06:16:49.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.110+0000 7feea27bc640 1 -- start start 2024-09-19T06:16:49.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.111+0000 7feea27bc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee9c102d30 0x7fee9c198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.111+0000 7feea27bc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee9c1036e0 0x7fee9c198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.111+0000 7feea27bc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee9c1082a0 0x7fee9c19cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.111+0000 7feea27bc640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fee9c112010 con 0x7fee9c102d30 2024-09-19T06:16:49.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.111+0000 7feea27bc640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fee9c111e90 con 0x7fee9c1082a0 2024-09-19T06:16:49.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.111+0000 7feea27bc640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fee9c112190 con 0x7fee9c1036e0 2024-09-19T06:16:49.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.111+0000 7fee9bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee9c102d30 0x7fee9c198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.111+0000 7fee9bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee9c102d30 0x7fee9c198640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44808/0 (socket says 172.21.15.2:44808) 2024-09-19T06:16:49.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.111+0000 7fee9bfff640 1 -- 172.21.15.2:0/932555225 learned_addr learned my addr 172.21.15.2:0/932555225 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:49.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.111+0000 7fee9b7fe640 1 --2- 172.21.15.2:0/932555225 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee9c1036e0 0x7fee9c198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.111+0000 7feea0d59640 1 --2- 172.21.15.2:0/932555225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee9c1082a0 0x7fee9c19cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.111+0000 7fee9bfff640 1 -- 172.21.15.2:0/932555225 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee9c1036e0 msgr2=0x7fee9c198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:49.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.111+0000 7fee9bfff640 1 --2- 172.21.15.2:0/932555225 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee9c1036e0 0x7fee9c198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.111+0000 7fee9bfff640 1 -- 172.21.15.2:0/932555225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee9c1082a0 msgr2=0x7fee9c19cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:49.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.111+0000 7fee9bfff640 1 --2- 172.21.15.2:0/932555225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee9c1082a0 0x7fee9c19cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.111+0000 7fee9bfff640 1 -- 172.21.15.2:0/932555225 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee9c19d5f0 con 0x7fee9c102d30 2024-09-19T06:16:49.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.112+0000 7fee9bfff640 1 --2- 172.21.15.2:0/932555225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee9c102d30 0x7fee9c198640 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fee8c005940 tx=0x7fee8c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:49.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.112+0000 7fee997fa640 1 -- 172.21.15.2:0/932555225 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee8c03f030 con 0x7fee9c102d30 2024-09-19T06:16:49.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.112+0000 7feea27bc640 1 -- 172.21.15.2:0/932555225 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee9c19d880 con 0x7fee9c102d30 2024-09-19T06:16:49.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.112+0000 7fee997fa640 1 -- 172.21.15.2:0/932555225 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fee8c003cb0 con 0x7fee9c102d30 2024-09-19T06:16:49.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.112+0000 7fee997fa640 1 -- 172.21.15.2:0/932555225 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee8c035070 con 0x7fee9c102d30 2024-09-19T06:16:49.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.112+0000 7feea27bc640 1 -- 172.21.15.2:0/932555225 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee9c1a51c0 con 0x7fee9c102d30 2024-09-19T06:16:49.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.114+0000 7fee997fa640 1 -- 172.21.15.2:0/932555225 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fee8c042030 con 0x7fee9c102d30 2024-09-19T06:16:49.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.115+0000 7feea4b95740 1 Processor -- start 2024-09-19T06:16:49.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.115+0000 7feea4b95740 1 -- start start 2024-09-19T06:16:49.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.115+0000 7feea4b95740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a3f5b5b60 0x555a3f5b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.115+0000 7feea4b95740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a3f5b6480 0x555a3f5c0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.115+0000 7feea4b95740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a3f5c0d40 0x555a3f5c3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.115+0000 7feea4b95740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555a3f51b280 con 0x555a3f5b6480 2024-09-19T06:16:49.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.115+0000 7feea4b95740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x555a3f4c2b10 con 0x555a3f5c0d40 2024-09-19T06:16:49.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.115+0000 7feea4b95740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x555a3f517240 con 0x555a3f5b5b60 2024-09-19T06:16:49.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.115+0000 7fee997fa640 1 --2- 172.21.15.2:0/932555225 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fee840a33b0 0x7fee840a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.115+0000 7fee9bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a3f5b6480 0x555a3f5c0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.115+0000 7feea0d59640 1 --2- 172.21.15.2:0/932555225 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fee840a33b0 0x7fee840a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.115+0000 7fee9bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a3f5b6480 0x555a3f5c0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44822/0 (socket says 172.21.15.2:44822) 2024-09-19T06:16:49.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.115+0000 7fee9bfff640 1 -- 172.21.15.2:0/36617951 learned_addr learned my addr 172.21.15.2:0/36617951 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:49.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.115+0000 7fee9b7fe640 1 --2- 172.21.15.2:0/36617951 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a3f5c0d40 0x555a3f5c3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.115+0000 7fee997fa640 1 -- 172.21.15.2:0/932555225 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fee8c0f0280 con 0x7fee9c102d30 2024-09-19T06:16:49.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.115+0000 7feea0d59640 1 --2- 172.21.15.2:0/36617951 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a3f5b5b60 0x555a3f5b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.116+0000 7fee9bfff640 1 -- 172.21.15.2:0/36617951 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a3f5b5b60 msgr2=0x555a3f5b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:49.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.116+0000 7fee9bfff640 1 --2- 172.21.15.2:0/36617951 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a3f5b5b60 0x555a3f5b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.116+0000 7fee9bfff640 1 -- 172.21.15.2:0/36617951 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a3f5c0d40 msgr2=0x555a3f5c3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:49.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.116+0000 7fee9bfff640 1 --2- 172.21.15.2:0/36617951 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a3f5c0d40 0x555a3f5c3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.116+0000 7fee9bfff640 1 -- 172.21.15.2:0/36617951 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a3f4cf1f0 con 0x555a3f5b6480 2024-09-19T06:16:49.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.116+0000 7fee9bfff640 1 --2- 172.21.15.2:0/36617951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a3f5b6480 0x555a3f5c0800 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fee8c08f330 tx=0x7fee8c08f360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=506429227e03b02 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:49.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.116+0000 7feea0d59640 1 --2- 172.21.15.2:0/932555225 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fee840a33b0 0x7fee840a5870 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fee94009fd0 tx=0x7fee94009540 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:49.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.116+0000 7fee827fc640 1 -- 172.21.15.2:0/36617951 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee8c049070 con 0x555a3f5b6480 2024-09-19T06:16:49.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.116+0000 7fee827fc640 1 -- 172.21.15.2:0/36617951 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fee8c087380 con 0x555a3f5b6480 2024-09-19T06:16:49.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.116+0000 7fee827fc640 1 -- 172.21.15.2:0/36617951 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee8c0dc070 con 0x555a3f5b6480 2024-09-19T06:16:49.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.117+0000 7feea4b95740 1 -- 172.21.15.2:0/36617951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a3f5b6480 msgr2=0x555a3f5c0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:49.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.117+0000 7feea4b95740 1 --2- 172.21.15.2:0/36617951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a3f5b6480 0x555a3f5c0800 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fee8c08f330 tx=0x7fee8c08f360 comp rx=0 tx=0).stop 2024-09-19T06:16:49.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.117+0000 7feea4b95740 1 -- 172.21.15.2:0/36617951 shutdown_connections 2024-09-19T06:16:49.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.117+0000 7feea4b95740 1 --2- 172.21.15.2:0/36617951 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a3f5c0d40 0x555a3f5c3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.117+0000 7feea4b95740 1 --2- 172.21.15.2:0/36617951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a3f5b6480 0x555a3f5c0800 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.117+0000 7feea4b95740 1 --2- 172.21.15.2:0/36617951 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a3f5b5b60 0x555a3f5b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.117+0000 7feea4b95740 1 -- 172.21.15.2:0/36617951 >> 172.21.15.2:0/36617951 conn(0x555a3f5b20f0 msgr2=0x555a3f5b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:49.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.117+0000 7feea4b95740 1 -- 172.21.15.2:0/36617951 shutdown_connections 2024-09-19T06:16:49.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.117+0000 7feea4b95740 1 -- 172.21.15.2:0/36617951 wait complete. 2024-09-19T06:16:49.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.117+0000 7feea4b95740 1 -- start start 2024-09-19T06:16:49.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.118+0000 7feea4b95740 1 Processor -- start 2024-09-19T06:16:49.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.118+0000 7feea4b95740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a3f5b5b60 0x555a3f5bdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.118+0000 7feea4b95740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a3f5b6480 0x555a3f5be100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.118+0000 7feea4b95740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a3f5c0d40 0x555a3f5be640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.118+0000 7feea4b95740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555a3f5c36d0 con 0x555a3f5b6480 2024-09-19T06:16:49.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.118+0000 7feea4b95740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x555a3f4d5f10 con 0x555a3f5b5b60 2024-09-19T06:16:49.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.118+0000 7feea4b95740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x555a3f5c3850 con 0x555a3f5c0d40 2024-09-19T06:16:49.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.118+0000 7feea4b95740 10 client.0 _ll_register_callbacks cb 0x555a3f49ea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:49.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.118+0000 7fee9b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a3f5b6480 0x555a3f5be100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.118+0000 7fee9b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a3f5b6480 0x555a3f5be100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44836/0 (socket says 172.21.15.2:44836) 2024-09-19T06:16:49.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.118+0000 7fee9b7fe640 1 -- 172.21.15.2:0/1853340756 learned_addr learned my addr 172.21.15.2:0/1853340756 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:49.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.118+0000 7feea0d59640 1 --2- 172.21.15.2:0/1853340756 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a3f5c0d40 0x555a3f5be640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.118+0000 7fee9bfff640 1 --2- 172.21.15.2:0/1853340756 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a3f5b5b60 0x555a3f5bdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.118+0000 7fee9b7fe640 1 -- 172.21.15.2:0/1853340756 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a3f5c0d40 msgr2=0x555a3f5be640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:49.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.118+0000 7fee9b7fe640 1 --2- 172.21.15.2:0/1853340756 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a3f5c0d40 0x555a3f5be640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.118+0000 7fee9b7fe640 1 -- 172.21.15.2:0/1853340756 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a3f5b5b60 msgr2=0x555a3f5bdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:49.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.118+0000 7fee9b7fe640 1 --2- 172.21.15.2:0/1853340756 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a3f5b5b60 0x555a3f5bdbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.118+0000 7fee9b7fe640 1 -- 172.21.15.2:0/1853340756 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a3f28c6a0 con 0x555a3f5b6480 2024-09-19T06:16:49.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.118+0000 7feea0d59640 1 --2- 172.21.15.2:0/1853340756 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a3f5c0d40 0x555a3f5be640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:49.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.119+0000 7fee9b7fe640 1 --2- 172.21.15.2:0/1853340756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a3f5b6480 0x555a3f5be100 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fee90011570 tx=0x7fee90011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e9c7bdecca1494a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:49.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.119+0000 7fee7b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:16:49.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.119+0000 7fee7b7fe640 1 -- 172.21.15.2:0/1853340756 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee90013670 con 0x555a3f5b6480 2024-09-19T06:16:49.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.119+0000 7fee7b7fe640 1 -- 172.21.15.2:0/1853340756 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fee90013810 con 0x555a3f5b6480 2024-09-19T06:16:49.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.119+0000 7feea4b95740 1 -- 172.21.15.2:0/1853340756 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee8c087380 con 0x555a3f5b6480 2024-09-19T06:16:49.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.119+0000 7fee7b7fe640 1 -- 172.21.15.2:0/1853340756 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fee90013a10 con 0x555a3f5b6480 2024-09-19T06:16:49.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.119+0000 7feea4b95740 10 client.15882 fetch_fsmap learned FSMap version 26 2024-09-19T06:16:49.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.119+0000 7feea4b95740 1 -- 172.21.15.2:0/1853340756 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555a3f5cf250 con 0x555a3f5b6480 2024-09-19T06:16:49.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.119+0000 7fee7b7fe640 1 -- 172.21.15.2:0/1853340756 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fee8c087380 con 0x555a3f5b6480 2024-09-19T06:16:49.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.119+0000 7fee7b7fe640 1 -- 172.21.15.2:0/1853340756 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fee9001d400 con 0x555a3f5b6480 2024-09-19T06:16:49.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.119+0000 7feea4b95740 10 client.15882 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:16:49.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.119+0000 7feea4b95740 10 client.15882 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:49.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.119+0000 7feea4b95740 20 client.15882 populate_metadata read hostname 'smithi002' 2024-09-19T06:16:49.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.120+0000 7feea4b95740 1 --2- 172.21.15.2:0/1853340756 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x555a3f5d07b0 0x555a3f5d2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.120+0000 7feea4b95740 4 client.15882 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:16:49.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.120+0000 7feea4b95740 1 -- 172.21.15.2:0/1853340756 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555a3f5287f0 con 0x555a3f5d07b0 2024-09-19T06:16:49.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.120+0000 7fee9bfff640 1 --2- 172.21.15.2:0/1853340756 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x555a3f5d07b0 0x555a3f5d2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.120+0000 7fee9bfff640 1 --2- 172.21.15.2:0/1853340756 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x555a3f5d07b0 0x555a3f5d2bf0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc02e625549f8bfa server_cookie=8ffbba2bef0ab3f4 in_seq=0 out_seq=0 2024-09-19T06:16:49.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.120+0000 7fee7b7fe640 10 client.15882 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:49.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.121+0000 7fee7b7fe640 1 -- 172.21.15.2:0/1853340756 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555a3f5287f0 con 0x555a3f5d07b0 2024-09-19T06:16:49.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.121+0000 7fee7b7fe640 10 client.15882 handle_command_reply: tid=0 2024-09-19T06:16:49.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.121+0000 7feea4b95740 1 client.15882 shutdown 2024-09-19T06:16:49.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.121+0000 7feea4b95740 1 -- 172.21.15.2:0/1853340756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a3f5b6480 msgr2=0x555a3f5be100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:49.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.121+0000 7feea4b95740 1 --2- 172.21.15.2:0/1853340756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a3f5b6480 0x555a3f5be100 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fee90011570 tx=0x7fee90011970 comp rx=0 tx=0).stop 2024-09-19T06:16:49.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.121+0000 7feea4b95740 1 -- 172.21.15.2:0/1853340756 shutdown_connections 2024-09-19T06:16:49.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.121+0000 7feea4b95740 1 --2- 172.21.15.2:0/1853340756 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a3f5c0d40 0x555a3f5be640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.121+0000 7feea4b95740 1 --2- 172.21.15.2:0/1853340756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a3f5b6480 0x555a3f5be100 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.121+0000 7feea4b95740 1 --2- 172.21.15.2:0/1853340756 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x555a3f5d07b0 0x555a3f5d2bf0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.121+0000 7feea4b95740 1 --2- 172.21.15.2:0/1853340756 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a3f5b5b60 0x555a3f5bdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.121+0000 7feea4b95740 1 -- 172.21.15.2:0/1853340756 >> 172.21.15.2:0/1853340756 conn(0x555a3f5b20f0 msgr2=0x555a3f5b1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:49.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.121+0000 7fee7b7fe640 0 client.15882 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:49.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.121+0000 7feea4b95740 1 -- 172.21.15.2:0/1853340756 shutdown_connections 2024-09-19T06:16:49.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.121+0000 7feea4b95740 1 -- 172.21.15.2:0/1853340756 wait complete. 2024-09-19T06:16:49.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.121+0000 7feea4b95740 20 client.15882 trim_cache size 0 max 16384 2024-09-19T06:16:49.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.140+0000 7feea4b95740 1 Processor -- start 2024-09-19T06:16:49.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.140+0000 7feea4b95740 1 -- start start 2024-09-19T06:16:49.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.140+0000 7feea4b95740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a3f5b5b60 0x555a3f5b85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.140+0000 7feea4b95740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a3f5b6480 0x555a3f5bca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.140+0000 7feea4b95740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a3f5c0d40 0x555a3f5d84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.140+0000 7feea4b95740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fee9c1b2310 con 0x555a3f5c0d40 2024-09-19T06:16:49.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.140+0000 7feea4b95740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fee9c1afbe0 con 0x555a3f5b5b60 2024-09-19T06:16:49.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.140+0000 7feea4b95740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fee9c1ada30 con 0x555a3f5b6480 2024-09-19T06:16:49.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.140+0000 7feea0d59640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a3f5c0d40 0x555a3f5d84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.140+0000 7feea0d59640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a3f5c0d40 0x555a3f5d84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44842/0 (socket says 172.21.15.2:44842) 2024-09-19T06:16:49.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.140+0000 7feea0d59640 1 -- 172.21.15.2:0/3833965285 learned_addr learned my addr 172.21.15.2:0/3833965285 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:49.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.140+0000 7fee9b7fe640 1 --2- 172.21.15.2:0/3833965285 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a3f5b6480 0x555a3f5bca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.140+0000 7fee9bfff640 1 --2- 172.21.15.2:0/3833965285 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a3f5b5b60 0x555a3f5b85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.141+0000 7feea0d59640 1 -- 172.21.15.2:0/3833965285 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a3f5b6480 msgr2=0x555a3f5bca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:49.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.141+0000 7feea0d59640 1 --2- 172.21.15.2:0/3833965285 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a3f5b6480 0x555a3f5bca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.141+0000 7feea0d59640 1 -- 172.21.15.2:0/3833965285 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a3f5b5b60 msgr2=0x555a3f5b85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:49.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.141+0000 7feea0d59640 1 --2- 172.21.15.2:0/3833965285 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a3f5b5b60 0x555a3f5b85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.141+0000 7feea0d59640 1 -- 172.21.15.2:0/3833965285 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a3f5ad830 con 0x555a3f5c0d40 2024-09-19T06:16:49.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.141+0000 7feea0d59640 1 --2- 172.21.15.2:0/3833965285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a3f5c0d40 0x555a3f5d84c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fee9400af90 tx=0x7fee9400f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d296b28c7cf0ea9d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:49.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.141+0000 7fee81ffb640 1 -- 172.21.15.2:0/3833965285 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee94013040 con 0x555a3f5c0d40 2024-09-19T06:16:49.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.141+0000 7fee81ffb640 1 -- 172.21.15.2:0/3833965285 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fee9402a070 con 0x555a3f5c0d40 2024-09-19T06:16:49.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.141+0000 7fee81ffb640 1 -- 172.21.15.2:0/3833965285 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee94025dc0 con 0x555a3f5c0d40 2024-09-19T06:16:49.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.142+0000 7feea4b95740 1 -- 172.21.15.2:0/3833965285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a3f5c0d40 msgr2=0x555a3f5d84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:49.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.142+0000 7feea4b95740 1 --2- 172.21.15.2:0/3833965285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a3f5c0d40 0x555a3f5d84c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fee9400af90 tx=0x7fee9400f000 comp rx=0 tx=0).stop 2024-09-19T06:16:49.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.142+0000 7feea4b95740 1 -- 172.21.15.2:0/3833965285 shutdown_connections 2024-09-19T06:16:49.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.142+0000 7feea4b95740 1 --2- 172.21.15.2:0/3833965285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a3f5c0d40 0x555a3f5d84c0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.142+0000 7feea4b95740 1 --2- 172.21.15.2:0/3833965285 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a3f5b6480 0x555a3f5bca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.142+0000 7feea4b95740 1 --2- 172.21.15.2:0/3833965285 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a3f5b5b60 0x555a3f5b85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.142+0000 7feea4b95740 1 -- 172.21.15.2:0/3833965285 >> 172.21.15.2:0/3833965285 conn(0x555a3f5b20f0 msgr2=0x555a3f5bc360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:49.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.142+0000 7feea4b95740 1 -- 172.21.15.2:0/3833965285 shutdown_connections 2024-09-19T06:16:49.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.142+0000 7feea4b95740 1 -- 172.21.15.2:0/3833965285 wait complete. 2024-09-19T06:16:49.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.142+0000 7feea4b95740 1 -- start start 2024-09-19T06:16:49.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.142+0000 7feea4b95740 1 Processor -- start 2024-09-19T06:16:49.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.143+0000 7feea4b95740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a3f5b5b60 0x555a3f5c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.143+0000 7feea4b95740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a3f5b6480 0x555a3f5c9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.143+0000 7feea4b95740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a3f5c0d40 0x555a3f5ba820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.143+0000 7feea4b95740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fee9c1ae0a0 con 0x555a3f5b5b60 2024-09-19T06:16:49.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.143+0000 7feea4b95740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fee9c1af510 con 0x555a3f5c0d40 2024-09-19T06:16:49.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.143+0000 7feea4b95740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fee9c1ae770 con 0x555a3f5b6480 2024-09-19T06:16:49.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.143+0000 7feea4b95740 10 client.0 _ll_register_callbacks cb 0x7fee900094f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:49.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.143+0000 7fee9bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a3f5b5b60 0x555a3f5c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.143+0000 7fee9bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a3f5b5b60 0x555a3f5c8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44844/0 (socket says 172.21.15.2:44844) 2024-09-19T06:16:49.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.143+0000 7fee9bfff640 1 -- 172.21.15.2:0/110134979 learned_addr learned my addr 172.21.15.2:0/110134979 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:49.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.143+0000 7fee9b7fe640 1 --2- 172.21.15.2:0/110134979 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a3f5b6480 0x555a3f5c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.143+0000 7feea0d59640 1 --2- 172.21.15.2:0/110134979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a3f5c0d40 0x555a3f5ba820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.143+0000 7fee9bfff640 1 -- 172.21.15.2:0/110134979 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a3f5b6480 msgr2=0x555a3f5c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:49.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.143+0000 7fee9bfff640 1 --2- 172.21.15.2:0/110134979 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a3f5b6480 0x555a3f5c9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.143+0000 7fee9bfff640 1 -- 172.21.15.2:0/110134979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a3f5c0d40 msgr2=0x555a3f5ba820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:49.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.143+0000 7fee9bfff640 1 --2- 172.21.15.2:0/110134979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a3f5c0d40 0x555a3f5ba820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.143+0000 7fee9bfff640 1 -- 172.21.15.2:0/110134979 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a3f5bb050 con 0x555a3f5b5b60 2024-09-19T06:16:49.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.143+0000 7fee9b7fe640 1 --2- 172.21.15.2:0/110134979 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a3f5b6480 0x555a3f5c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:16:49.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.143+0000 7feea0d59640 1 --2- 172.21.15.2:0/110134979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a3f5c0d40 0x555a3f5ba820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:16:49.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.143+0000 7fee9bfff640 1 --2- 172.21.15.2:0/110134979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a3f5b5b60 0x555a3f5c8d20 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fee8c0bc4c0 tx=0x7fee8c043000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a7490d1ebce018d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:49.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.143+0000 7fee7b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:16:49.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.144+0000 7fee7b7fe640 1 -- 172.21.15.2:0/110134979 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee8c049040 con 0x555a3f5b5b60 2024-09-19T06:16:49.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.144+0000 7fee7b7fe640 1 -- 172.21.15.2:0/110134979 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fee8c0872b0 con 0x555a3f5b5b60 2024-09-19T06:16:49.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.144+0000 7feea4b95740 1 -- 172.21.15.2:0/110134979 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee9402a070 con 0x555a3f5b5b60 2024-09-19T06:16:49.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.144+0000 7fee7b7fe640 1 -- 172.21.15.2:0/110134979 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fee8c0dc040 con 0x555a3f5b5b60 2024-09-19T06:16:49.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.144+0000 7feea4b95740 10 client.15888 fetch_fsmap learned FSMap version 26 2024-09-19T06:16:49.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.144+0000 7feea4b95740 1 -- 172.21.15.2:0/110134979 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555a3f63b1a0 con 0x555a3f5b5b60 2024-09-19T06:16:49.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.144+0000 7fee7b7fe640 1 -- 172.21.15.2:0/110134979 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fee9402a070 con 0x555a3f5b5b60 2024-09-19T06:16:49.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.144+0000 7fee7b7fe640 1 -- 172.21.15.2:0/110134979 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fee8c0b8ba0 con 0x555a3f5b5b60 2024-09-19T06:16:49.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.144+0000 7feea4b95740 10 client.15888 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:16:49.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.144+0000 7feea4b95740 10 client.15888 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:49.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.144+0000 7feea4b95740 20 client.15888 populate_metadata read hostname 'smithi002' 2024-09-19T06:16:49.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.144+0000 7feea4b95740 1 --2- 172.21.15.2:0/110134979 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x555a3f63b6d0 0x555a3f63dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.144+0000 7feea4b95740 4 client.15888 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:16:49.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.144+0000 7feea4b95740 1 -- 172.21.15.2:0/110134979 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x555a3f522d00 con 0x555a3f63b6d0 2024-09-19T06:16:49.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.145+0000 7fee9b7fe640 1 --2- 172.21.15.2:0/110134979 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x555a3f63b6d0 0x555a3f63dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.145+0000 7fee9b7fe640 1 --2- 172.21.15.2:0/110134979 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x555a3f63b6d0 0x555a3f63dac0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=890ab38b16fa5f4b server_cookie=238a43a20696ab2 in_seq=0 out_seq=0 2024-09-19T06:16:49.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.145+0000 7fee7b7fe640 10 client.15888 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:49.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.146+0000 7fee7b7fe640 1 -- 172.21.15.2:0/110134979 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555a3f522d00 con 0x555a3f63b6d0 2024-09-19T06:16:49.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.146+0000 7fee7b7fe640 10 client.15888 handle_command_reply: tid=0 2024-09-19T06:16:49.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.146+0000 7feea4b95740 1 client.15888 shutdown 2024-09-19T06:16:49.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.146+0000 7feea4b95740 1 -- 172.21.15.2:0/110134979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a3f5b5b60 msgr2=0x555a3f5c8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:49.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.146+0000 7feea4b95740 1 --2- 172.21.15.2:0/110134979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a3f5b5b60 0x555a3f5c8d20 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fee8c0bc4c0 tx=0x7fee8c043000 comp rx=0 tx=0).stop 2024-09-19T06:16:49.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.146+0000 7feea4b95740 1 -- 172.21.15.2:0/110134979 shutdown_connections 2024-09-19T06:16:49.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.146+0000 7feea4b95740 1 --2- 172.21.15.2:0/110134979 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x555a3f63b6d0 0x555a3f63dac0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.146+0000 7feea4b95740 1 --2- 172.21.15.2:0/110134979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a3f5c0d40 0x555a3f5ba820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.146+0000 7feea4b95740 1 --2- 172.21.15.2:0/110134979 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a3f5b6480 0x555a3f5c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.146+0000 7feea4b95740 1 --2- 172.21.15.2:0/110134979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a3f5b5b60 0x555a3f5c8d20 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.146+0000 7feea4b95740 1 -- 172.21.15.2:0/110134979 >> 172.21.15.2:0/110134979 conn(0x555a3f5b20f0 msgr2=0x555a3f5b1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:49.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.146+0000 7fee7b7fe640 0 client.15888 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:49.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.146+0000 7feea4b95740 1 -- 172.21.15.2:0/110134979 shutdown_connections 2024-09-19T06:16:49.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.146+0000 7feea4b95740 1 -- 172.21.15.2:0/110134979 wait complete. 2024-09-19T06:16:49.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.146+0000 7feea4b95740 20 client.15888 trim_cache size 0 max 16384 2024-09-19T06:16:49.162 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:16:49.162 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T06:16:49.162 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "3487c683-dce7-4b45-9270-22272f03bf71", 2024-09-19T06:16:49.162 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T06:16:49.162 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:16:49.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.147+0000 7feea27bc640 1 -- 172.21.15.2:0/932555225 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fee840a33b0 msgr2=0x7fee840a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:49.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.147+0000 7feea27bc640 1 --2- 172.21.15.2:0/932555225 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fee840a33b0 0x7fee840a5870 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fee94009fd0 tx=0x7fee94009540 comp rx=0 tx=0).stop 2024-09-19T06:16:49.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.147+0000 7feea27bc640 1 -- 172.21.15.2:0/932555225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee9c102d30 msgr2=0x7fee9c198640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:49.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.147+0000 7feea27bc640 1 --2- 172.21.15.2:0/932555225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee9c102d30 0x7fee9c198640 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fee8c005940 tx=0x7fee8c0042f0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.147+0000 7feea27bc640 1 -- 172.21.15.2:0/932555225 shutdown_connections 2024-09-19T06:16:49.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.147+0000 7feea27bc640 1 --2- 172.21.15.2:0/932555225 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fee840a33b0 0x7fee840a5870 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.147+0000 7feea27bc640 1 --2- 172.21.15.2:0/932555225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee9c1082a0 0x7fee9c19cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.147+0000 7feea27bc640 1 --2- 172.21.15.2:0/932555225 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee9c1036e0 0x7fee9c198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.147+0000 7feea27bc640 1 --2- 172.21.15.2:0/932555225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee9c102d30 0x7fee9c198640 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.147+0000 7feea27bc640 1 -- 172.21.15.2:0/932555225 >> 172.21.15.2:0/932555225 conn(0x7fee9c0fc7d0 msgr2=0x7fee9c105e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:49.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.147+0000 7feea27bc640 1 -- 172.21.15.2:0/932555225 shutdown_connections 2024-09-19T06:16:49.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:49.147+0000 7feea27bc640 1 -- 172.21.15.2:0/932555225 wait complete. 2024-09-19T06:16:49.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:49 smithi002 ceph-mon[30982]: pgmap v63: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 85 MiB/s wr, 51 op/s 2024-09-19T06:16:49.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:49 smithi090 ceph-mon[34497]: pgmap v63: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 85 MiB/s wr, 51 op/s 2024-09-19T06:16:49.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:49 smithi089 ceph-mon[34160]: pgmap v63: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 85 MiB/s wr, 51 op/s 2024-09-19T06:16:49.828 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:16:50.086 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:16:50.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:50 smithi002 ceph-mon[30982]: scrub queued for path: / 2024-09-19T06:16:50.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:50 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:16:50.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:50 smithi002 ceph-mon[30982]: scrub summary: active paths [/] 2024-09-19T06:16:50.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:50 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:16:50.501 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-19T06:16:50.501 INFO:tasks.workunit.client.0.smithi002.stdout: Children see throughput for 1 re-readers = 8884282.00 kB/sec 2024-09-19T06:16:50.501 INFO:tasks.workunit.client.0.smithi002.stdout: Parent sees throughput for 1 re-readers = 8866853.96 kB/sec 2024-09-19T06:16:50.501 INFO:tasks.workunit.client.0.smithi002.stdout: Min throughput per process = 8884282.00 kB/sec 2024-09-19T06:16:50.501 INFO:tasks.workunit.client.0.smithi002.stdout: Max throughput per process = 8884282.00 kB/sec 2024-09-19T06:16:50.502 INFO:tasks.workunit.client.0.smithi002.stdout: Avg throughput per process = 8884282.00 kB/sec 2024-09-19T06:16:50.502 INFO:tasks.workunit.client.0.smithi002.stdout: Min xfer = 1048576.00 kB 2024-09-19T06:16:50.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:50 smithi090 ceph-mon[34497]: scrub queued for path: / 2024-09-19T06:16:50.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:50 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:16:50.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:50 smithi090 ceph-mon[34497]: scrub summary: active paths [/] 2024-09-19T06:16:50.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:50 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:16:50.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.661+0000 7f264f9c4640 1 -- 172.21.15.2:0/3354405017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2648105f40 msgr2=0x7f26481063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:50.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.661+0000 7f264f9c4640 1 --2- 172.21.15.2:0/3354405017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2648105f40 0x7f26481063d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f2640009ca0 tx=0x7f264002a940 comp rx=0 tx=0).stop 2024-09-19T06:16:50.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.661+0000 7f264f9c4640 1 -- 172.21.15.2:0/3354405017 shutdown_connections 2024-09-19T06:16:50.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.661+0000 7f264f9c4640 1 --2- 172.21.15.2:0/3354405017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2648105f40 0x7f26481063d0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:50.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.661+0000 7f264f9c4640 1 --2- 172.21.15.2:0/3354405017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2648101450 0x7f2648105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:50.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.661+0000 7f264f9c4640 1 --2- 172.21.15.2:0/3354405017 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2648100b30 0x7f2648100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:50.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.661+0000 7f264f9c4640 1 -- 172.21.15.2:0/3354405017 >> 172.21.15.2:0/3354405017 conn(0x7f26480fc7a0 msgr2=0x7f26480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:50.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.661+0000 7f264f9c4640 1 -- 172.21.15.2:0/3354405017 shutdown_connections 2024-09-19T06:16:50.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.661+0000 7f264f9c4640 1 -- 172.21.15.2:0/3354405017 wait complete. 2024-09-19T06:16:50.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.662+0000 7f264f9c4640 1 Processor -- start 2024-09-19T06:16:50.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.662+0000 7f264f9c4640 1 -- start start 2024-09-19T06:16:50.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.662+0000 7f264f9c4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2648100b30 0x7f26481a4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:50.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.662+0000 7f264f9c4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2648101450 0x7f26481a4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:50.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.662+0000 7f264f9c4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2648105f40 0x7f264819e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:50.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.662+0000 7f264f9c4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2648118420 con 0x7f2648101450 2024-09-19T06:16:50.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.662+0000 7f264f9c4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f26481182a0 con 0x7f2648100b30 2024-09-19T06:16:50.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.662+0000 7f264f9c4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f26481185a0 con 0x7f2648105f40 2024-09-19T06:16:50.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.662+0000 7f264cf5f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2648101450 0x7f26481a4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:50.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.662+0000 7f264cf5f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2648101450 0x7f26481a4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44850/0 (socket says 172.21.15.2:44850) 2024-09-19T06:16:50.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.662+0000 7f264cf5f640 1 -- 172.21.15.2:0/2285881241 learned_addr learned my addr 172.21.15.2:0/2285881241 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:50.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.662+0000 7f264d760640 1 --2- 172.21.15.2:0/2285881241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2648100b30 0x7f26481a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:50.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.662+0000 7f264df61640 1 --2- 172.21.15.2:0/2285881241 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2648105f40 0x7f264819e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:50.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.663+0000 7f264cf5f640 1 -- 172.21.15.2:0/2285881241 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2648105f40 msgr2=0x7f264819e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:50.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.663+0000 7f264cf5f640 1 --2- 172.21.15.2:0/2285881241 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2648105f40 0x7f264819e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:50.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.663+0000 7f264cf5f640 1 -- 172.21.15.2:0/2285881241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2648100b30 msgr2=0x7f26481a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:50.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.663+0000 7f264cf5f640 1 --2- 172.21.15.2:0/2285881241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2648100b30 0x7f26481a4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:50.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.663+0000 7f264cf5f640 1 -- 172.21.15.2:0/2285881241 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f264819ef40 con 0x7f2648101450 2024-09-19T06:16:50.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.663+0000 7f264cf5f640 1 --2- 172.21.15.2:0/2285881241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2648101450 0x7f26481a4b40 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f263800c970 tx=0x7f263800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:50.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.663+0000 7f263e7fc640 1 -- 172.21.15.2:0/2285881241 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2638007bb0 con 0x7f2648101450 2024-09-19T06:16:50.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.663+0000 7f263e7fc640 1 -- 172.21.15.2:0/2285881241 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2638007d50 con 0x7f2648101450 2024-09-19T06:16:50.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.663+0000 7f264f9c4640 1 -- 172.21.15.2:0/2285881241 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f264819f230 con 0x7f2648101450 2024-09-19T06:16:50.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.663+0000 7f263e7fc640 1 -- 172.21.15.2:0/2285881241 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2638018780 con 0x7f2648101450 2024-09-19T06:16:50.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.663+0000 7f264f9c4640 1 -- 172.21.15.2:0/2285881241 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26481ab580 con 0x7f2648101450 2024-09-19T06:16:50.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.665+0000 7f263e7fc640 1 -- 172.21.15.2:0/2285881241 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f263800f450 con 0x7f2648101450 2024-09-19T06:16:50.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.666+0000 7f2651d9d740 1 Processor -- start 2024-09-19T06:16:50.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.666+0000 7f2651d9d740 1 -- start start 2024-09-19T06:16:50.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.666+0000 7f2651d9d740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564a4927e4a0 0x564a4927e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:50.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.666+0000 7f2651d9d740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564a4927edc0 0x564a49289140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:50.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.666+0000 7f2651d9d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a49289680 0x564a4928ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:50.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.666+0000 7f2651d9d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564a491e42e0 con 0x564a49289680 2024-09-19T06:16:50.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.666+0000 7f2651d9d740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x564a4918bce0 con 0x564a4927edc0 2024-09-19T06:16:50.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.666+0000 7f2651d9d740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x564a491e02a0 con 0x564a4927e4a0 2024-09-19T06:16:50.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.666+0000 7f263e7fc640 1 --2- 172.21.15.2:0/2285881241 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f26340a33b0 0x7f26340a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:50.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.666+0000 7f264cf5f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a49289680 0x564a4928ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:50.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.666+0000 7f264df61640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564a4927e4a0 0x564a4927e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:50.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.666+0000 7f264cf5f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a49289680 0x564a4928ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44864/0 (socket says 172.21.15.2:44864) 2024-09-19T06:16:50.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.666+0000 7f264cf5f640 1 -- 172.21.15.2:0/2197958044 learned_addr learned my addr 172.21.15.2:0/2197958044 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:50.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.666+0000 7f264d760640 1 --2- 172.21.15.2:0/2197958044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564a4927edc0 0x564a49289140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:50.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.666+0000 7f264df61640 1 --2- 172.21.15.2:0/2285881241 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f26340a33b0 0x7f26340a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:50.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.667+0000 7f263e7fc640 1 -- 172.21.15.2:0/2285881241 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f26380cfdb0 con 0x7f2648101450 2024-09-19T06:16:50.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.667+0000 7f264cf5f640 1 -- 172.21.15.2:0/2197958044 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564a4927e4a0 msgr2=0x564a4927e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:50.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.667+0000 7f264cf5f640 1 --2- 172.21.15.2:0/2197958044 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564a4927e4a0 0x564a4927e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:50.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.667+0000 7f264cf5f640 1 -- 172.21.15.2:0/2197958044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564a4927edc0 msgr2=0x564a49289140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:50.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.667+0000 7f264cf5f640 1 --2- 172.21.15.2:0/2197958044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564a4927edc0 0x564a49289140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:50.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.667+0000 7f264cf5f640 1 -- 172.21.15.2:0/2197958044 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a49170440 con 0x564a49289680 2024-09-19T06:16:50.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.667+0000 7f264df61640 1 --2- 172.21.15.2:0/2197958044 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564a4927e4a0 0x564a4927e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:50.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.667+0000 7f264cf5f640 1 --2- 172.21.15.2:0/2197958044 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a49289680 0x564a4928ba70 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f2638098520 tx=0x7f2638007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ea109fa82a8d573 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:50.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.667+0000 7f264df61640 1 --2- 172.21.15.2:0/2285881241 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f26340a33b0 0x7f26340a5870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f264002f800 tx=0x7f26400095c0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:50.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.667+0000 7f26337fe640 1 -- 172.21.15.2:0/2197958044 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263809ba20 con 0x564a49289680 2024-09-19T06:16:50.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.667+0000 7f26337fe640 1 -- 172.21.15.2:0/2197958044 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f263800fa90 con 0x564a49289680 2024-09-19T06:16:50.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.667+0000 7f26337fe640 1 -- 172.21.15.2:0/2197958044 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26380a4d30 con 0x564a49289680 2024-09-19T06:16:50.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.668+0000 7f2651d9d740 1 -- 172.21.15.2:0/2197958044 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a49289680 msgr2=0x564a4928ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:50.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.668+0000 7f2651d9d740 1 --2- 172.21.15.2:0/2197958044 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a49289680 0x564a4928ba70 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f2638098520 tx=0x7f2638007f00 comp rx=0 tx=0).stop 2024-09-19T06:16:50.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.668+0000 7f2651d9d740 1 -- 172.21.15.2:0/2197958044 shutdown_connections 2024-09-19T06:16:50.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.668+0000 7f2651d9d740 1 --2- 172.21.15.2:0/2197958044 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a49289680 0x564a4928ba70 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:50.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.668+0000 7f2651d9d740 1 --2- 172.21.15.2:0/2197958044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564a4927edc0 0x564a49289140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:50.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.668+0000 7f2651d9d740 1 --2- 172.21.15.2:0/2197958044 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564a4927e4a0 0x564a4927e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:50.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.668+0000 7f2651d9d740 1 -- 172.21.15.2:0/2197958044 >> 172.21.15.2:0/2197958044 conn(0x564a4927aa30 msgr2=0x564a4927ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:50.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.668+0000 7f2651d9d740 1 -- 172.21.15.2:0/2197958044 shutdown_connections 2024-09-19T06:16:50.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.668+0000 7f2651d9d740 1 -- 172.21.15.2:0/2197958044 wait complete. 2024-09-19T06:16:50.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.668+0000 7f2651d9d740 1 -- start start 2024-09-19T06:16:50.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.668+0000 7f2651d9d740 1 Processor -- start 2024-09-19T06:16:50.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.669+0000 7f2651d9d740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564a4927e4a0 0x564a49289020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:50.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.669+0000 7f2651d9d740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564a4927edc0 0x564a49286320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:50.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.669+0000 7f2651d9d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a49289680 0x564a49286930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:50.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.669+0000 7f2651d9d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564a4928c250 con 0x564a49289680 2024-09-19T06:16:50.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.669+0000 7f2651d9d740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x564a4919f050 con 0x564a4927e4a0 2024-09-19T06:16:50.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.669+0000 7f2651d9d740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x564a4928c3d0 con 0x564a4927edc0 2024-09-19T06:16:50.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.669+0000 7f2651d9d740 10 client.0 _ll_register_callbacks cb 0x564a491df160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:50.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.669+0000 7f264df61640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a49289680 0x564a49286930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:50.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.669+0000 7f264df61640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a49289680 0x564a49286930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44880/0 (socket says 172.21.15.2:44880) 2024-09-19T06:16:50.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.669+0000 7f264df61640 1 -- 172.21.15.2:0/3690553234 learned_addr learned my addr 172.21.15.2:0/3690553234 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:50.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.669+0000 7f264d760640 1 --2- 172.21.15.2:0/3690553234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564a4927e4a0 0x564a49289020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:50.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.669+0000 7f264cf5f640 1 --2- 172.21.15.2:0/3690553234 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564a4927edc0 0x564a49286320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:50.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.669+0000 7f264df61640 1 -- 172.21.15.2:0/3690553234 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564a4927edc0 msgr2=0x564a49286320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:50.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.669+0000 7f264df61640 1 --2- 172.21.15.2:0/3690553234 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564a4927edc0 0x564a49286320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:50.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.669+0000 7f264df61640 1 -- 172.21.15.2:0/3690553234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564a4927e4a0 msgr2=0x564a49289020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:50.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.669+0000 7f264df61640 1 --2- 172.21.15.2:0/3690553234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564a4927e4a0 0x564a49289020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:50.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.669+0000 7f264df61640 1 -- 172.21.15.2:0/3690553234 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a48f553c0 con 0x564a49289680 2024-09-19T06:16:50.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.669+0000 7f2630ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:16:50.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.669+0000 7f264df61640 1 --2- 172.21.15.2:0/3690553234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a49289680 0x564a49286930 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f264002f3d0 tx=0x7f264002a940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23c27239d6a91919 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:50.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.670+0000 7f2630ff9640 1 -- 172.21.15.2:0/3690553234 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2640050070 con 0x564a49289680 2024-09-19T06:16:50.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.670+0000 7f2630ff9640 1 -- 172.21.15.2:0/3690553234 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f26400047d0 con 0x564a49289680 2024-09-19T06:16:50.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.670+0000 7f2651d9d740 1 -- 172.21.15.2:0/3690553234 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564a491f1850 con 0x564a49289680 2024-09-19T06:16:50.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.670+0000 7f2630ff9640 1 -- 172.21.15.2:0/3690553234 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2640034040 con 0x564a49289680 2024-09-19T06:16:50.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.670+0000 7f2651d9d740 10 client.15900 fetch_fsmap learned FSMap version 26 2024-09-19T06:16:50.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.670+0000 7f2651d9d740 1 -- 172.21.15.2:0/3690553234 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564a49297ca0 con 0x564a49289680 2024-09-19T06:16:50.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.670+0000 7f2630ff9640 1 -- 172.21.15.2:0/3690553234 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x564a491f1850 con 0x564a49289680 2024-09-19T06:16:50.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.670+0000 7f2630ff9640 1 -- 172.21.15.2:0/3690553234 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f264004a040 con 0x564a49289680 2024-09-19T06:16:50.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.670+0000 7f2651d9d740 10 client.15900 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:16:50.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.670+0000 7f2651d9d740 10 client.15900 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:50.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.670+0000 7f2651d9d740 20 client.15900 populate_metadata read hostname 'smithi002' 2024-09-19T06:16:50.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.670+0000 7f2651d9d740 1 --2- 172.21.15.2:0/3690553234 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x564a49299100 0x564a4929b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:50.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.670+0000 7f2651d9d740 4 client.15900 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:16:50.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.670+0000 7f2651d9d740 1 -- 172.21.15.2:0/3690553234 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a491ebd60 con 0x564a49299100 2024-09-19T06:16:50.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.671+0000 7f264d760640 1 --2- 172.21.15.2:0/3690553234 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x564a49299100 0x564a4929b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:50.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.671+0000 7f2630ff9640 10 client.15900 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:50.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.671+0000 7f264d760640 1 --2- 172.21.15.2:0/3690553234 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x564a49299100 0x564a4929b570 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be28268583910b server_cookie=87d9aeb8a95741b9 in_seq=0 out_seq=0 2024-09-19T06:16:50.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.672+0000 7f2630ff9640 1 -- 172.21.15.2:0/3690553234 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564a491ebd60 con 0x564a49299100 2024-09-19T06:16:50.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.672+0000 7f2630ff9640 10 client.15900 handle_command_reply: tid=0 2024-09-19T06:16:50.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.672+0000 7f2651d9d740 1 client.15900 shutdown 2024-09-19T06:16:50.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.672+0000 7f2651d9d740 1 -- 172.21.15.2:0/3690553234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a49289680 msgr2=0x564a49286930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:50.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.672+0000 7f2651d9d740 1 --2- 172.21.15.2:0/3690553234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a49289680 0x564a49286930 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f264002f3d0 tx=0x7f264002a940 comp rx=0 tx=0).stop 2024-09-19T06:16:50.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.672+0000 7f2651d9d740 1 -- 172.21.15.2:0/3690553234 shutdown_connections 2024-09-19T06:16:50.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.672+0000 7f2651d9d740 1 --2- 172.21.15.2:0/3690553234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a49289680 0x564a49286930 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:50.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.672+0000 7f2651d9d740 1 --2- 172.21.15.2:0/3690553234 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564a4927edc0 0x564a49286320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:50.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.672+0000 7f2651d9d740 1 --2- 172.21.15.2:0/3690553234 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x564a49299100 0x564a4929b570 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:50.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.672+0000 7f2651d9d740 1 --2- 172.21.15.2:0/3690553234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564a4927e4a0 0x564a49289020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:50.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.672+0000 7f2651d9d740 1 -- 172.21.15.2:0/3690553234 >> 172.21.15.2:0/3690553234 conn(0x564a4927aa30 msgr2=0x564a49280710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:50.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.672+0000 7f2630ff9640 0 client.15900 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:50.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.672+0000 7f2651d9d740 1 -- 172.21.15.2:0/3690553234 shutdown_connections 2024-09-19T06:16:50.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.672+0000 7f2651d9d740 1 -- 172.21.15.2:0/3690553234 wait complete. 2024-09-19T06:16:50.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.672+0000 7f2651d9d740 20 client.15900 trim_cache size 0 max 16384 2024-09-19T06:16:50.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.689+0000 7f2651d9d740 1 Processor -- start 2024-09-19T06:16:50.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.689+0000 7f2651d9d740 1 -- start start 2024-09-19T06:16:50.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.690+0000 7f2651d9d740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564a4927e4a0 0x564a492954b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:50.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.690+0000 7f2651d9d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a4927edc0 0x564a492a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:50.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.690+0000 7f2651d9d740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564a49289680 0x564a492a1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:50.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.690+0000 7f2651d9d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f26481b6590 con 0x564a4927edc0 2024-09-19T06:16:50.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.690+0000 7f2651d9d740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f26481b3e60 con 0x564a49289680 2024-09-19T06:16:50.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.690+0000 7f2651d9d740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f26481b1cb0 con 0x564a4927e4a0 2024-09-19T06:16:50.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.690+0000 7f264cf5f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a4927edc0 0x564a492a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:50.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.690+0000 7f264cf5f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a4927edc0 0x564a492a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44890/0 (socket says 172.21.15.2:44890) 2024-09-19T06:16:50.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.690+0000 7f264cf5f640 1 -- 172.21.15.2:0/2930900073 learned_addr learned my addr 172.21.15.2:0/2930900073 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:50.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.690+0000 7f264d760640 1 --2- 172.21.15.2:0/2930900073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564a4927e4a0 0x564a492954b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:50.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.690+0000 7f264df61640 1 --2- 172.21.15.2:0/2930900073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564a49289680 0x564a492a1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:50.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.690+0000 7f264cf5f640 1 -- 172.21.15.2:0/2930900073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564a4927e4a0 msgr2=0x564a492954b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:50.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.690+0000 7f264cf5f640 1 --2- 172.21.15.2:0/2930900073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564a4927e4a0 0x564a492954b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:50.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.690+0000 7f264cf5f640 1 -- 172.21.15.2:0/2930900073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564a49289680 msgr2=0x564a492a1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:50.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.690+0000 7f264cf5f640 1 --2- 172.21.15.2:0/2930900073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564a49289680 0x564a492a1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:50.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.690+0000 7f264cf5f640 1 -- 172.21.15.2:0/2930900073 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a4927ebf0 con 0x564a4927edc0 2024-09-19T06:16:50.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.690+0000 7f264cf5f640 1 --2- 172.21.15.2:0/2930900073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a4927edc0 0x564a492a0e40 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f26380cdb30 tx=0x7f263809c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1beb8c429add32a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:50.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.690+0000 7f2632ffd640 1 -- 172.21.15.2:0/2930900073 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263809c7c0 con 0x564a4927edc0 2024-09-19T06:16:50.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.690+0000 7f2632ffd640 1 -- 172.21.15.2:0/2930900073 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f263800de20 con 0x564a4927edc0 2024-09-19T06:16:50.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.690+0000 7f2632ffd640 1 -- 172.21.15.2:0/2930900073 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263800f740 con 0x564a4927edc0 2024-09-19T06:16:50.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.691+0000 7f2651d9d740 1 -- 172.21.15.2:0/2930900073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a4927edc0 msgr2=0x564a492a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:50.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.691+0000 7f2651d9d740 1 --2- 172.21.15.2:0/2930900073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a4927edc0 0x564a492a0e40 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f26380cdb30 tx=0x7f263809c0c0 comp rx=0 tx=0).stop 2024-09-19T06:16:50.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.691+0000 7f2651d9d740 1 -- 172.21.15.2:0/2930900073 shutdown_connections 2024-09-19T06:16:50.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.691+0000 7f2651d9d740 1 --2- 172.21.15.2:0/2930900073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564a49289680 0x564a492a1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:50.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.691+0000 7f2651d9d740 1 --2- 172.21.15.2:0/2930900073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a4927edc0 0x564a492a0e40 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:50.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.691+0000 7f2651d9d740 1 --2- 172.21.15.2:0/2930900073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564a4927e4a0 0x564a492954b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:50.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.691+0000 7f2651d9d740 1 -- 172.21.15.2:0/2930900073 >> 172.21.15.2:0/2930900073 conn(0x564a4927aa30 msgr2=0x564a49285410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:50.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.691+0000 7f2651d9d740 1 -- 172.21.15.2:0/2930900073 shutdown_connections 2024-09-19T06:16:50.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.691+0000 7f2651d9d740 1 -- 172.21.15.2:0/2930900073 wait complete. 2024-09-19T06:16:50.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.691+0000 7f2651d9d740 1 -- start start 2024-09-19T06:16:50.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.691+0000 7f2651d9d740 1 Processor -- start 2024-09-19T06:16:50.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.692+0000 7f2651d9d740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564a4927e4a0 0x564a49291be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:50.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.692+0000 7f2651d9d740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564a4927edc0 0x564a4928cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:50.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.692+0000 7f2651d9d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a49289680 0x564a4928d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:50.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.692+0000 7f2651d9d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f26481b2320 con 0x564a49289680 2024-09-19T06:16:50.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.692+0000 7f2651d9d740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f26481b3790 con 0x564a4927edc0 2024-09-19T06:16:50.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.692+0000 7f2651d9d740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f26481b29f0 con 0x564a4927e4a0 2024-09-19T06:16:50.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.692+0000 7f2651d9d740 10 client.0 _ll_register_callbacks cb 0x7f264002fdd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:50.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.692+0000 7f264df61640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a49289680 0x564a4928d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:50.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.692+0000 7f264df61640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a49289680 0x564a4928d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44896/0 (socket says 172.21.15.2:44896) 2024-09-19T06:16:50.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.692+0000 7f264df61640 1 -- 172.21.15.2:0/3680347691 learned_addr learned my addr 172.21.15.2:0/3680347691 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:50.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.692+0000 7f264d760640 1 --2- 172.21.15.2:0/3680347691 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564a4927e4a0 0x564a49291be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:50.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.692+0000 7f264cf5f640 1 --2- 172.21.15.2:0/3680347691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564a4927edc0 0x564a4928cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:50.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.692+0000 7f264df61640 1 -- 172.21.15.2:0/3680347691 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564a4927e4a0 msgr2=0x564a49291be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:50.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.692+0000 7f264df61640 1 --2- 172.21.15.2:0/3680347691 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564a4927e4a0 0x564a49291be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:50.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.692+0000 7f264df61640 1 -- 172.21.15.2:0/3680347691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564a4927edc0 msgr2=0x564a4928cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:50.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.692+0000 7f264df61640 1 --2- 172.21.15.2:0/3680347691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564a4927edc0 0x564a4928cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:50.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.692+0000 7f264df61640 1 -- 172.21.15.2:0/3680347691 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a4928dac0 con 0x564a49289680 2024-09-19T06:16:50.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.692+0000 7f264cf5f640 1 --2- 172.21.15.2:0/3680347691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564a4927edc0 0x564a4928cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:16:50.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.693+0000 7f264df61640 1 --2- 172.21.15.2:0/3680347691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a49289680 0x564a4928d450 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f2640006010 tx=0x7f264002f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a06281e844f5f6c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:50.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.693+0000 7f2630ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:16:50.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.693+0000 7f2630ff9640 1 -- 172.21.15.2:0/3680347691 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2640050040 con 0x564a49289680 2024-09-19T06:16:50.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.693+0000 7f2630ff9640 1 -- 172.21.15.2:0/3680347691 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f264004c9c0 con 0x564a49289680 2024-09-19T06:16:50.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.693+0000 7f2651d9d740 1 -- 172.21.15.2:0/3680347691 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f263800de20 con 0x564a49289680 2024-09-19T06:16:50.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.693+0000 7f2630ff9640 1 -- 172.21.15.2:0/3680347691 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2640004410 con 0x564a49289680 2024-09-19T06:16:50.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.693+0000 7f2651d9d740 10 client.15906 fetch_fsmap learned FSMap version 26 2024-09-19T06:16:50.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.693+0000 7f2651d9d740 1 -- 172.21.15.2:0/3680347691 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564a49303c90 con 0x564a49289680 2024-09-19T06:16:50.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.693+0000 7f2630ff9640 1 -- 172.21.15.2:0/3680347691 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f263800de20 con 0x564a49289680 2024-09-19T06:16:50.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.693+0000 7f2630ff9640 1 -- 172.21.15.2:0/3680347691 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f264002f070 con 0x564a49289680 2024-09-19T06:16:50.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.693+0000 7f2651d9d740 10 client.15906 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:16:50.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.693+0000 7f2651d9d740 10 client.15906 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:50.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.693+0000 7f2651d9d740 20 client.15906 populate_metadata read hostname 'smithi002' 2024-09-19T06:16:50.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.693+0000 7f2651d9d740 1 --2- 172.21.15.2:0/3680347691 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x564a493043a0 0x564a493067c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:50.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.693+0000 7f2651d9d740 4 client.15906 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:16:50.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.693+0000 7f2651d9d740 1 -- 172.21.15.2:0/3680347691 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564a49168210 con 0x564a493043a0 2024-09-19T06:16:50.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.694+0000 7f264d760640 1 --2- 172.21.15.2:0/3680347691 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x564a493043a0 0x564a493067c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:50.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.694+0000 7f264d760640 1 --2- 172.21.15.2:0/3680347691 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x564a493043a0 0x564a493067c0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2a9d76ece597baa server_cookie=77f5a110de6e0535 in_seq=0 out_seq=0 2024-09-19T06:16:50.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.694+0000 7f2630ff9640 10 client.15906 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:50.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.694+0000 7f2630ff9640 1 -- 172.21.15.2:0/3680347691 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x564a49168210 con 0x564a493043a0 2024-09-19T06:16:50.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.694+0000 7f2630ff9640 10 client.15906 handle_command_reply: tid=0 2024-09-19T06:16:50.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.694+0000 7f2651d9d740 1 client.15906 shutdown 2024-09-19T06:16:50.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.694+0000 7f2651d9d740 1 -- 172.21.15.2:0/3680347691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a49289680 msgr2=0x564a4928d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:50.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.694+0000 7f2651d9d740 1 --2- 172.21.15.2:0/3680347691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a49289680 0x564a4928d450 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f2640006010 tx=0x7f264002f920 comp rx=0 tx=0).stop 2024-09-19T06:16:50.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.694+0000 7f2651d9d740 1 -- 172.21.15.2:0/3680347691 shutdown_connections 2024-09-19T06:16:50.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.694+0000 7f2651d9d740 1 --2- 172.21.15.2:0/3680347691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564a49289680 0x564a4928d450 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:50.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.694+0000 7f2651d9d740 1 --2- 172.21.15.2:0/3680347691 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x564a493043a0 0x564a493067c0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:50.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.694+0000 7f2651d9d740 1 --2- 172.21.15.2:0/3680347691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564a4927edc0 0x564a4928cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:50.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.694+0000 7f2651d9d740 1 --2- 172.21.15.2:0/3680347691 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564a4927e4a0 0x564a49291be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:50.769 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:16:50.769 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:16:50.769 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-19T06:16:50.769 INFO:teuthology.orchestra.run.smithi002.stdout: "3487c683-dce7-4b45-9270-22272f03bf71": { 2024-09-19T06:16:50.769 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-19T06:16:50.769 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "3487c683-dce7-4b45-9270-22272f03bf71", 2024-09-19T06:16:50.769 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-19T06:16:50.769 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:16:50.769 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:16:50.769 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:16:50.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.694+0000 7f2630ff9640 0 client.15906 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:50.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.694+0000 7f2651d9d740 1 -- 172.21.15.2:0/3680347691 >> 172.21.15.2:0/3680347691 conn(0x564a4927aa30 msgr2=0x564a49279350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:50.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.694+0000 7f2651d9d740 1 -- 172.21.15.2:0/3680347691 shutdown_connections 2024-09-19T06:16:50.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.695+0000 7f2651d9d740 1 -- 172.21.15.2:0/3680347691 wait complete. 2024-09-19T06:16:50.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.695+0000 7f2651d9d740 20 client.15906 trim_cache size 0 max 16384 2024-09-19T06:16:50.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.695+0000 7f264f9c4640 1 -- 172.21.15.2:0/2285881241 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f26340a33b0 msgr2=0x7f26340a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:50.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.695+0000 7f264f9c4640 1 --2- 172.21.15.2:0/2285881241 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f26340a33b0 0x7f26340a5870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f264002f800 tx=0x7f26400095c0 comp rx=0 tx=0).stop 2024-09-19T06:16:50.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.695+0000 7f264f9c4640 1 -- 172.21.15.2:0/2285881241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2648101450 msgr2=0x7f26481a4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:50.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.695+0000 7f264f9c4640 1 --2- 172.21.15.2:0/2285881241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2648101450 0x7f26481a4b40 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f263800c970 tx=0x7f263800ce30 comp rx=0 tx=0).stop 2024-09-19T06:16:50.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.695+0000 7f264f9c4640 1 -- 172.21.15.2:0/2285881241 shutdown_connections 2024-09-19T06:16:50.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.695+0000 7f264f9c4640 1 --2- 172.21.15.2:0/2285881241 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f26340a33b0 0x7f26340a5870 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:50.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.695+0000 7f264f9c4640 1 --2- 172.21.15.2:0/2285881241 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2648105f40 0x7f264819e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:50.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.695+0000 7f264f9c4640 1 --2- 172.21.15.2:0/2285881241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2648101450 0x7f26481a4b40 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:50.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.695+0000 7f264f9c4640 1 --2- 172.21.15.2:0/2285881241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2648100b30 0x7f26481a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:50.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.695+0000 7f264f9c4640 1 -- 172.21.15.2:0/2285881241 >> 172.21.15.2:0/2285881241 conn(0x7f26480fc7a0 msgr2=0x7f26481038f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:50.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.695+0000 7f264f9c4640 1 -- 172.21.15.2:0/2285881241 shutdown_connections 2024-09-19T06:16:50.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:16:50.695+0000 7f264f9c4640 1 -- 172.21.15.2:0/2285881241 wait complete. 2024-09-19T06:16:50.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:50 smithi089 ceph-mon[34160]: scrub queued for path: / 2024-09-19T06:16:50.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:50 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:16:50.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:50 smithi089 ceph-mon[34160]: scrub summary: active paths [/] 2024-09-19T06:16:50.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:50 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:16:51.505 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:51 smithi002 ceph-mon[30982]: pgmap v64: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 171 MiB/s wr, 79 op/s 2024-09-19T06:16:51.538 INFO:tasks.cephfs.filesystem:scrub status for tag:3487c683-dce7-4b45-9270-22272f03bf71 - {'path': '/', 'tag': '3487c683-dce7-4b45-9270-22272f03bf71', 'options': 'recursive,force'} 2024-09-19T06:16:51.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:51 smithi090 ceph-mon[34497]: pgmap v64: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 171 MiB/s wr, 79 op/s 2024-09-19T06:16:51.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:51 smithi089 ceph-mon[34160]: pgmap v64: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 171 MiB/s wr, 79 op/s 2024-09-19T06:16:53.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:53 smithi002 ceph-mon[30982]: pgmap v65: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 171 MiB/s wr, 75 op/s 2024-09-19T06:16:53.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:53 smithi002 ceph-mon[30982]: scrub summary: idle 2024-09-19T06:16:53.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:53 smithi090 ceph-mon[34497]: pgmap v65: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 171 MiB/s wr, 75 op/s 2024-09-19T06:16:53.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:53 smithi090 ceph-mon[34497]: scrub summary: idle 2024-09-19T06:16:53.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:53 smithi089 ceph-mon[34160]: pgmap v65: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 171 MiB/s wr, 75 op/s 2024-09-19T06:16:53.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:53 smithi089 ceph-mon[34160]: scrub summary: idle 2024-09-19T06:16:55.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:55 smithi002 ceph-mon[30982]: pgmap v66: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 171 MiB/s wr, 79 op/s 2024-09-19T06:16:55.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:55 smithi090 ceph-mon[34497]: pgmap v66: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 171 MiB/s wr, 79 op/s 2024-09-19T06:16:55.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:55 smithi089 ceph-mon[34160]: pgmap v66: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 171 MiB/s wr, 79 op/s 2024-09-19T06:16:56.992 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-19T06:16:56.992 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-19T06:16:56.992 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-19T06:16:56.992 INFO:tasks.workunit.client.0.smithi002.stdout:iozone test complete. 2024-09-19T06:16:56.992 INFO:tasks.workunit.client.0.smithi002.stderr:+ iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-09-19T06:16:57.059 INFO:tasks.workunit.client.0.smithi002.stdout: Iozone: Performance Test of File I/O 2024-09-19T06:16:57.059 INFO:tasks.workunit.client.0.smithi002.stdout: Version $Revision: 3.494 $ 2024-09-19T06:16:57.060 INFO:tasks.workunit.client.0.smithi002.stdout: Compiled for 64 bit mode. 2024-09-19T06:16:57.060 INFO:tasks.workunit.client.0.smithi002.stdout: Build: linux-AMD64 2024-09-19T06:16:57.060 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-19T06:16:57.060 INFO:tasks.workunit.client.0.smithi002.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-09-19T06:16:57.060 INFO:tasks.workunit.client.0.smithi002.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-09-19T06:16:57.060 INFO:tasks.workunit.client.0.smithi002.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-09-19T06:16:57.060 INFO:tasks.workunit.client.0.smithi002.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-09-19T06:16:57.060 INFO:tasks.workunit.client.0.smithi002.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-09-19T06:16:57.060 INFO:tasks.workunit.client.0.smithi002.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-09-19T06:16:57.060 INFO:tasks.workunit.client.0.smithi002.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-09-19T06:16:57.060 INFO:tasks.workunit.client.0.smithi002.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-09-19T06:16:57.061 INFO:tasks.workunit.client.0.smithi002.stdout: Alexey Skidanov, Sudhir Kumar. 2024-09-19T06:16:57.061 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-19T06:16:57.061 INFO:tasks.workunit.client.0.smithi002.stdout: Run began: Thu Sep 19 06:16:56 2024 2024-09-19T06:16:57.061 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-19T06:16:57.061 INFO:tasks.workunit.client.0.smithi002.stdout: Include close in write timing 2024-09-19T06:16:57.061 INFO:tasks.workunit.client.0.smithi002.stdout: Include fsync in write timing 2024-09-19T06:16:57.061 INFO:tasks.workunit.client.0.smithi002.stdout: File size set to 10485760 kB 2024-09-19T06:16:57.061 INFO:tasks.workunit.client.0.smithi002.stdout: Record Size 1024 kB 2024-09-19T06:16:57.061 INFO:tasks.workunit.client.0.smithi002.stdout: Command line used: iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-09-19T06:16:57.061 INFO:tasks.workunit.client.0.smithi002.stdout: Output is in kBytes/sec 2024-09-19T06:16:57.061 INFO:tasks.workunit.client.0.smithi002.stdout: Time Resolution = 0.000001 seconds. 2024-09-19T06:16:57.061 INFO:tasks.workunit.client.0.smithi002.stdout: Processor cache size set to 1024 kBytes. 2024-09-19T06:16:57.062 INFO:tasks.workunit.client.0.smithi002.stdout: Processor cache line size set to 32 bytes. 2024-09-19T06:16:57.062 INFO:tasks.workunit.client.0.smithi002.stdout: File stride size set to 17 * record size. 2024-09-19T06:16:57.062 INFO:tasks.workunit.client.0.smithi002.stdout: Throughput test with 1 process 2024-09-19T06:16:57.062 INFO:tasks.workunit.client.0.smithi002.stdout: Each process writes a 10485760 kByte file in 1024 kByte records 2024-09-19T06:16:57.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:57 smithi002 ceph-mon[30982]: pgmap v67: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 85 MiB/s wr, 31 op/s 2024-09-19T06:16:57.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:57 smithi090 ceph-mon[34497]: pgmap v67: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 85 MiB/s wr, 31 op/s 2024-09-19T06:16:57.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:57 smithi089 ceph-mon[34160]: pgmap v67: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 85 MiB/s wr, 31 op/s 2024-09-19T06:16:58.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.248+0000 7f04b0fc4640 1 -- 172.21.15.2:0/329275772 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04ac101230 msgr2=0x7f04ac107970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:58.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.248+0000 7f04b0fc4640 1 --2- 172.21.15.2:0/329275772 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04ac101230 0x7f04ac107970 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0494009900 tx=0x7f049402a410 comp rx=0 tx=0).stop 2024-09-19T06:16:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.248+0000 7f04b0fc4640 1 -- 172.21.15.2:0/329275772 shutdown_connections 2024-09-19T06:16:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.248+0000 7f04b0fc4640 1 --2- 172.21.15.2:0/329275772 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04ac1080d0 0x7f04ac10ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.248+0000 7f04b0fc4640 1 --2- 172.21.15.2:0/329275772 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04ac101230 0x7f04ac107970 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.248+0000 7f04b0fc4640 1 --2- 172.21.15.2:0/329275772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04ac100880 0x7f04ac100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.248+0000 7f04b0fc4640 1 -- 172.21.15.2:0/329275772 >> 172.21.15.2:0/329275772 conn(0x7f04ac075ec0 msgr2=0x7f04ac0762d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:58.251 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.248+0000 7f04b0fc4640 1 -- 172.21.15.2:0/329275772 shutdown_connections 2024-09-19T06:16:58.251 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.248+0000 7f04b0fc4640 1 -- 172.21.15.2:0/329275772 wait complete. 2024-09-19T06:16:58.251 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.250+0000 7f04b0fc4640 1 Processor -- start 2024-09-19T06:16:58.251 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.250+0000 7f04b0fc4640 1 -- start start 2024-09-19T06:16:58.252 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.250+0000 7f04b0fc4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04ac100880 0x7f04ac198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:58.253 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.251+0000 7f04b0fc4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04ac1080d0 0x7f04ac1988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:58.253 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.251+0000 7f04b0fc4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04ac19cc20 0x7f04ac19d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:58.253 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.251+0000 7f04b0fc4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f04ac111df0 con 0x7f04ac19cc20 2024-09-19T06:16:58.253 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.251+0000 7f04b0fc4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f04ac111c70 con 0x7f04ac1080d0 2024-09-19T06:16:58.253 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.251+0000 7f04b0fc4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f04ac111f70 con 0x7f04ac100880 2024-09-19T06:16:58.253 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.251+0000 7f04aad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04ac19cc20 0x7f04ac19d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:58.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.251+0000 7f04aad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04ac19cc20 0x7f04ac19d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46030/0 (socket says 172.21.15.2:46030) 2024-09-19T06:16:58.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.251+0000 7f04aad9d640 1 -- 172.21.15.2:0/2855433476 learned_addr learned my addr 172.21.15.2:0/2855433476 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:58.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.251+0000 7f04aa59c640 1 --2- 172.21.15.2:0/2855433476 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04ac100880 0x7f04ac198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:58.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.251+0000 7f04aad9d640 1 -- 172.21.15.2:0/2855433476 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04ac100880 msgr2=0x7f04ac198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:58.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.251+0000 7f04aad9d640 1 --2- 172.21.15.2:0/2855433476 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04ac100880 0x7f04ac198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.251+0000 7f04aad9d640 1 -- 172.21.15.2:0/2855433476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04ac1080d0 msgr2=0x7f04ac1988a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:16:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.251+0000 7f04aad9d640 1 --2- 172.21.15.2:0/2855433476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04ac1080d0 0x7f04ac1988a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.251+0000 7f04aad9d640 1 -- 172.21.15.2:0/2855433476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04ac19d710 con 0x7f04ac19cc20 2024-09-19T06:16:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.252+0000 7f04aa59c640 1 --2- 172.21.15.2:0/2855433476 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04ac100880 0x7f04ac198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:16:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.252+0000 7f04aad9d640 1 --2- 172.21.15.2:0/2855433476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04ac19cc20 0x7f04ac19d0d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f04a4009f60 tx=0x7f04a4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.252+0000 7f04a37fe640 1 -- 172.21.15.2:0/2855433476 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a400cd80 con 0x7f04ac19cc20 2024-09-19T06:16:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.252+0000 7f04a37fe640 1 -- 172.21.15.2:0/2855433476 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f04a4013770 con 0x7f04ac19cc20 2024-09-19T06:16:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.252+0000 7f04a37fe640 1 -- 172.21.15.2:0/2855433476 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a4005440 con 0x7f04ac19cc20 2024-09-19T06:16:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.252+0000 7f04b0fc4640 1 -- 172.21.15.2:0/2855433476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04ac19da00 con 0x7f04ac19cc20 2024-09-19T06:16:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.252+0000 7f04b0fc4640 1 -- 172.21.15.2:0/2855433476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04ac101a40 con 0x7f04ac19cc20 2024-09-19T06:16:58.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.256+0000 7f04a37fe640 1 -- 172.21.15.2:0/2855433476 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f04a4013920 con 0x7f04ac19cc20 2024-09-19T06:16:58.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.256+0000 7f04b3e38740 1 Processor -- start 2024-09-19T06:16:58.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.256+0000 7f04b3e38740 1 -- start start 2024-09-19T06:16:58.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.256+0000 7f04b3e38740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a0dc98baf0 0x55a0dc98bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.256+0000 7f04b3e38740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0dc98c410 0x55a0dc996770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.256+0000 7f04b3e38740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0dc996cb0 0x55a0dc9990a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.256+0000 7f04b3e38740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a0dc8f02f0 con 0x55a0dc98c410 2024-09-19T06:16:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.256+0000 7f04b3e38740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55a0dc898270 con 0x55a0dc98baf0 2024-09-19T06:16:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.256+0000 7f04b3e38740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55a0dc8ec2b0 con 0x55a0dc996cb0 2024-09-19T06:16:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.257+0000 7f04aa59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0dc98c410 0x55a0dc996770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.257+0000 7f04aa59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0dc98c410 0x55a0dc996770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46032/0 (socket says 172.21.15.2:46032) 2024-09-19T06:16:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.257+0000 7f04aa59c640 1 -- 172.21.15.2:0/3452686866 learned_addr learned my addr 172.21.15.2:0/3452686866 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:58.264 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.257+0000 7f04a3fff640 1 --2- 172.21.15.2:0/3452686866 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0dc996cb0 0x55a0dc9990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:58.264 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.257+0000 7f04a3fff640 1 --2- 172.21.15.2:0/3452686866 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a0dc98baf0 0x55a0dc98bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:58.264 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.257+0000 7f04aa59c640 1 -- 172.21.15.2:0/3452686866 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0dc996cb0 msgr2=0x55a0dc9990a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.257+0000 7f04aa59c640 1 --2- 172.21.15.2:0/3452686866 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0dc996cb0 0x55a0dc9990a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.257+0000 7f04a37fe640 1 --2- 172.21.15.2:0/2855433476 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f04980a3430 0x7f04980a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.257+0000 7f04aa59c640 1 -- 172.21.15.2:0/3452686866 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a0dc98baf0 msgr2=0x55a0dc98bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.257+0000 7f04aa59c640 1 --2- 172.21.15.2:0/3452686866 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a0dc98baf0 0x55a0dc98bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.257+0000 7f04aa59c640 1 -- 172.21.15.2:0/3452686866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0dc897340 con 0x55a0dc98c410 2024-09-19T06:16:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.257+0000 7f04a37fe640 1 -- 172.21.15.2:0/2855433476 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f04a40d3ec0 con 0x7f04ac19cc20 2024-09-19T06:16:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.257+0000 7f04aa59c640 1 --2- 172.21.15.2:0/3452686866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0dc98c410 0x55a0dc996770 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f049c009d50 tx=0x7f049c0117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fe78bd1b57e989 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.257+0000 7f04aad9d640 1 --2- 172.21.15.2:0/2855433476 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f04980a3430 0x7f04980a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.258+0000 7f04a0ff9640 1 -- 172.21.15.2:0/3452686866 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f049c012650 con 0x55a0dc98c410 2024-09-19T06:16:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.258+0000 7f04a0ff9640 1 -- 172.21.15.2:0/3452686866 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f049c009e40 con 0x55a0dc98c410 2024-09-19T06:16:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.258+0000 7f04a0ff9640 1 -- 172.21.15.2:0/3452686866 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f049c00fc90 con 0x55a0dc98c410 2024-09-19T06:16:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.259+0000 7f04b3e38740 1 -- 172.21.15.2:0/3452686866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0dc98c410 msgr2=0x55a0dc996770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.259+0000 7f04b3e38740 1 --2- 172.21.15.2:0/3452686866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0dc98c410 0x55a0dc996770 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f049c009d50 tx=0x7f049c0117b0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.259+0000 7f04aad9d640 1 --2- 172.21.15.2:0/2855433476 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f04980a3430 0x7f04980a58f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f04a409c740 tx=0x7f04a4009270 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.259+0000 7f04b3e38740 1 -- 172.21.15.2:0/3452686866 shutdown_connections 2024-09-19T06:16:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.259+0000 7f04b3e38740 1 --2- 172.21.15.2:0/3452686866 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0dc996cb0 0x55a0dc9990a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.259+0000 7f04b3e38740 1 --2- 172.21.15.2:0/3452686866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0dc98c410 0x55a0dc996770 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.259+0000 7f04b3e38740 1 --2- 172.21.15.2:0/3452686866 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a0dc98baf0 0x55a0dc98bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.259+0000 7f04b3e38740 1 -- 172.21.15.2:0/3452686866 >> 172.21.15.2:0/3452686866 conn(0x55a0dc988060 msgr2=0x55a0dc988440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.259+0000 7f04b3e38740 1 -- 172.21.15.2:0/3452686866 shutdown_connections 2024-09-19T06:16:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.259+0000 7f04b3e38740 1 -- 172.21.15.2:0/3452686866 wait complete. 2024-09-19T06:16:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.259+0000 7f04b3e38740 1 -- start start 2024-09-19T06:16:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.260+0000 7f04b3e38740 1 Processor -- start 2024-09-19T06:16:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.260+0000 7f04b3e38740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a0dc98baf0 0x55a0dc993c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.260+0000 7f04b3e38740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0dc98c410 0x55a0dc994150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.260+0000 7f04b3e38740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0dc996cb0 0x55a0dc994690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.260+0000 7f04b3e38740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a0dc999880 con 0x55a0dc996cb0 2024-09-19T06:16:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.260+0000 7f04b3e38740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55a0dc879290 con 0x55a0dc98baf0 2024-09-19T06:16:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.260+0000 7f04b3e38740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55a0dc999a00 con 0x55a0dc98c410 2024-09-19T06:16:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.260+0000 7f04b3e38740 10 client.0 _ll_register_callbacks cb 0x55a0dc8aa140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.260+0000 7f04a3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0dc996cb0 0x55a0dc994690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.260+0000 7f04a3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0dc996cb0 0x55a0dc994690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46036/0 (socket says 172.21.15.2:46036) 2024-09-19T06:16:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.260+0000 7f04a3fff640 1 -- 172.21.15.2:0/1193299865 learned_addr learned my addr 172.21.15.2:0/1193299865 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.260+0000 7f04a3fff640 1 -- 172.21.15.2:0/1193299865 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0dc98c410 msgr2=0x55a0dc994150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.260+0000 7f04aa59c640 1 --2- 172.21.15.2:0/1193299865 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0dc98c410 0x55a0dc994150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.260+0000 7f04a3fff640 1 --2- 172.21.15.2:0/1193299865 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0dc98c410 0x55a0dc994150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.260+0000 7f04a3fff640 1 -- 172.21.15.2:0/1193299865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a0dc98baf0 msgr2=0x55a0dc993c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.260+0000 7f04a3fff640 1 --2- 172.21.15.2:0/1193299865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a0dc98baf0 0x55a0dc993c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.261+0000 7f04a3fff640 1 -- 172.21.15.2:0/1193299865 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0dc603210 con 0x55a0dc996cb0 2024-09-19T06:16:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.261+0000 7f04aa59c640 1 --2- 172.21.15.2:0/1193299865 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0dc98c410 0x55a0dc994150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:16:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.261+0000 7f04a3fff640 1 --2- 172.21.15.2:0/1193299865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0dc996cb0 0x55a0dc994690 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f0494009900 tx=0x7f0494005bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=854f32e10ff02c53 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.261+0000 7f0491ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:16:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.261+0000 7f0491ffb640 1 -- 172.21.15.2:0/1193299865 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0494041030 con 0x55a0dc996cb0 2024-09-19T06:16:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.261+0000 7f0491ffb640 1 -- 172.21.15.2:0/1193299865 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f0494004020 con 0x55a0dc996cb0 2024-09-19T06:16:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.261+0000 7f04b3e38740 1 -- 172.21.15.2:0/1193299865 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a0dc8fda20 con 0x55a0dc996cb0 2024-09-19T06:16:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.261+0000 7f0491ffb640 1 -- 172.21.15.2:0/1193299865 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f049404b050 con 0x55a0dc996cb0 2024-09-19T06:16:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.261+0000 7f04b3e38740 10 client.15918 fetch_fsmap learned FSMap version 26 2024-09-19T06:16:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.261+0000 7f04b3e38740 1 -- 172.21.15.2:0/1193299865 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a0dc6cf620 con 0x55a0dc996cb0 2024-09-19T06:16:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.261+0000 7f0491ffb640 1 -- 172.21.15.2:0/1193299865 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55a0dc8fda20 con 0x55a0dc996cb0 2024-09-19T06:16:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.262+0000 7f0491ffb640 1 -- 172.21.15.2:0/1193299865 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f04940037b0 con 0x55a0dc996cb0 2024-09-19T06:16:58.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.262+0000 7f04b3e38740 10 client.15918 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:16:58.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.262+0000 7f04b3e38740 10 client.15918 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:58.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.262+0000 7f04b3e38740 20 client.15918 populate_metadata read hostname 'smithi002' 2024-09-19T06:16:58.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.262+0000 7f04b3e38740 1 --2- 172.21.15.2:0/1193299865 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a0dc9a6cc0 0x55a0dc9a90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:58.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.262+0000 7f04b3e38740 4 client.15918 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:16:58.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.262+0000 7f04b3e38740 1 -- 172.21.15.2:0/1193299865 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0dc8f7d70 con 0x55a0dc9a6cc0 2024-09-19T06:16:58.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.262+0000 7f04aa59c640 1 --2- 172.21.15.2:0/1193299865 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a0dc9a6cc0 0x55a0dc9a90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:58.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.263+0000 7f0491ffb640 10 client.15918 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.263+0000 7f04aa59c640 1 --2- 172.21.15.2:0/1193299865 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a0dc9a6cc0 0x55a0dc9a90f0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58d75c7c6295d337 server_cookie=7037f805141a3d8 in_seq=0 out_seq=0 2024-09-19T06:16:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.265+0000 7f0491ffb640 1 -- 172.21.15.2:0/1193299865 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a0dc8f7d70 con 0x55a0dc9a6cc0 2024-09-19T06:16:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.265+0000 7f0491ffb640 10 client.15918 handle_command_reply: tid=0 2024-09-19T06:16:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.265+0000 7f04b3e38740 1 client.15918 shutdown 2024-09-19T06:16:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.265+0000 7f04b3e38740 1 -- 172.21.15.2:0/1193299865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0dc996cb0 msgr2=0x55a0dc994690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.265+0000 7f04b3e38740 1 --2- 172.21.15.2:0/1193299865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0dc996cb0 0x55a0dc994690 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f0494009900 tx=0x7f0494005bb0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.265+0000 7f04b3e38740 1 -- 172.21.15.2:0/1193299865 shutdown_connections 2024-09-19T06:16:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.265+0000 7f04b3e38740 1 --2- 172.21.15.2:0/1193299865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0dc996cb0 0x55a0dc994690 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.265+0000 7f04b3e38740 1 --2- 172.21.15.2:0/1193299865 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0dc98c410 0x55a0dc994150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.265+0000 7f04b3e38740 1 --2- 172.21.15.2:0/1193299865 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a0dc9a6cc0 0x55a0dc9a90f0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.265+0000 7f04b3e38740 1 --2- 172.21.15.2:0/1193299865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a0dc98baf0 0x55a0dc993c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.265+0000 7f04b3e38740 1 -- 172.21.15.2:0/1193299865 >> 172.21.15.2:0/1193299865 conn(0x55a0dc988060 msgr2=0x55a0dc98ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.265+0000 7f0491ffb640 0 client.15918 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.265+0000 7f04b3e38740 1 -- 172.21.15.2:0/1193299865 shutdown_connections 2024-09-19T06:16:58.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.265+0000 7f04b3e38740 1 -- 172.21.15.2:0/1193299865 wait complete. 2024-09-19T06:16:58.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.265+0000 7f04b3e38740 20 client.15918 trim_cache size 0 max 16384 2024-09-19T06:16:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.292+0000 7f04b3e38740 1 Processor -- start 2024-09-19T06:16:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.292+0000 7f04b3e38740 1 -- start start 2024-09-19T06:16:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.293+0000 7f04b3e38740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0dc98baf0 0x55a0dc98e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.293+0000 7f04b3e38740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0dc98c410 0x55a0dc9944c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.293+0000 7f04b3e38740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a0dc9aea00 0x55a0dc9aee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.293+0000 7f04b3e38740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f04ac1add60 con 0x55a0dc98c410 2024-09-19T06:16:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.293+0000 7f04b3e38740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f04ac1ab630 con 0x55a0dc9aea00 2024-09-19T06:16:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.293+0000 7f04b3e38740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f04ac1a94a0 con 0x55a0dc98baf0 2024-09-19T06:16:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.293+0000 7f04aa59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0dc98c410 0x55a0dc9944c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.293+0000 7f04aa59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0dc98c410 0x55a0dc9944c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46040/0 (socket says 172.21.15.2:46040) 2024-09-19T06:16:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.293+0000 7f04aa59c640 1 -- 172.21.15.2:0/2508619007 learned_addr learned my addr 172.21.15.2:0/2508619007 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.293+0000 7f04a3fff640 1 --2- 172.21.15.2:0/2508619007 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0dc98baf0 0x55a0dc98e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.293+0000 7f04a3fff640 1 --2- 172.21.15.2:0/2508619007 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a0dc9aea00 0x55a0dc9aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.293+0000 7f04aa59c640 1 -- 172.21.15.2:0/2508619007 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0dc98baf0 msgr2=0x55a0dc98e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.293+0000 7f04aa59c640 1 --2- 172.21.15.2:0/2508619007 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0dc98baf0 0x55a0dc98e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.293+0000 7f04aa59c640 1 -- 172.21.15.2:0/2508619007 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a0dc9aea00 msgr2=0x55a0dc9aee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.293+0000 7f04aa59c640 1 --2- 172.21.15.2:0/2508619007 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a0dc9aea00 0x55a0dc9aee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.293+0000 7f04aa59c640 1 -- 172.21.15.2:0/2508619007 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0dc992140 con 0x55a0dc98c410 2024-09-19T06:16:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.293+0000 7f04aa59c640 1 --2- 172.21.15.2:0/2508619007 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0dc98c410 0x55a0dc9944c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f049c011cb0 tx=0x7f049c005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=616ed9fee399eb40 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:58.299 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.294+0000 7f0493fff640 1 -- 172.21.15.2:0/2508619007 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f049c00f640 con 0x55a0dc98c410 2024-09-19T06:16:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.294+0000 7f0493fff640 1 -- 172.21.15.2:0/2508619007 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f049c00fe50 con 0x55a0dc98c410 2024-09-19T06:16:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.294+0000 7f0493fff640 1 -- 172.21.15.2:0/2508619007 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f049c005630 con 0x55a0dc98c410 2024-09-19T06:16:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.295+0000 7f04b3e38740 1 -- 172.21.15.2:0/2508619007 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0dc98c410 msgr2=0x55a0dc9944c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.295+0000 7f04b3e38740 1 --2- 172.21.15.2:0/2508619007 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0dc98c410 0x55a0dc9944c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f049c011cb0 tx=0x7f049c005040 comp rx=0 tx=0).stop 2024-09-19T06:16:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.295+0000 7f04b3e38740 1 -- 172.21.15.2:0/2508619007 shutdown_connections 2024-09-19T06:16:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.295+0000 7f04b3e38740 1 --2- 172.21.15.2:0/2508619007 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a0dc9aea00 0x55a0dc9aee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.295+0000 7f04b3e38740 1 --2- 172.21.15.2:0/2508619007 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0dc98c410 0x55a0dc9944c0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.295+0000 7f04b3e38740 1 --2- 172.21.15.2:0/2508619007 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0dc98baf0 0x55a0dc98e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.295+0000 7f04b3e38740 1 -- 172.21.15.2:0/2508619007 >> 172.21.15.2:0/2508619007 conn(0x55a0dc988060 msgr2=0x55a0dc995c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.295+0000 7f04b3e38740 1 -- 172.21.15.2:0/2508619007 shutdown_connections 2024-09-19T06:16:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.295+0000 7f04b3e38740 1 -- 172.21.15.2:0/2508619007 wait complete. 2024-09-19T06:16:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.295+0000 7f04b3e38740 1 -- start start 2024-09-19T06:16:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.295+0000 7f04b3e38740 1 Processor -- start 2024-09-19T06:16:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.296+0000 7f04b3e38740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0dc98baf0 0x55a0dc99ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.296+0000 7f04a3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0dc98baf0 0x55a0dc99ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.296+0000 7f04a3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0dc98baf0 0x55a0dc99ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46050/0 (socket says 172.21.15.2:46050) 2024-09-19T06:16:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.296+0000 7f04a3fff640 1 -- 172.21.15.2:0/4042521531 learned_addr learned my addr 172.21.15.2:0/4042521531 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:16:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.296+0000 7f04b3e38740 1 --2- 172.21.15.2:0/4042521531 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a0dc98c410 0x55a0dc99f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.296+0000 7f04b3e38740 1 --2- 172.21.15.2:0/4042521531 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0dc9aea00 0x55a0dc99bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.296+0000 7f04b3e38740 1 -- 172.21.15.2:0/4042521531 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f04ac1a9af0 con 0x55a0dc98baf0 2024-09-19T06:16:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.296+0000 7f04b3e38740 1 -- 172.21.15.2:0/4042521531 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f04ac1aaf60 con 0x55a0dc98c410 2024-09-19T06:16:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.296+0000 7f04b3e38740 1 -- 172.21.15.2:0/4042521531 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f04ac1aa1c0 con 0x55a0dc9aea00 2024-09-19T06:16:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.297+0000 7f04a3fff640 1 --2- 172.21.15.2:0/4042521531 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0dc9aea00 0x55a0dc99bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.297+0000 7f04a3fff640 1 -- 172.21.15.2:0/4042521531 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0dc9aea00 msgr2=0x55a0dc99bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.297+0000 7f04a3fff640 1 --2- 172.21.15.2:0/4042521531 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0dc9aea00 0x55a0dc99bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.297+0000 7f04a3fff640 1 -- 172.21.15.2:0/4042521531 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a0dc98c410 msgr2=0x55a0dc99f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.297+0000 7f04aa59c640 1 --2- 172.21.15.2:0/4042521531 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a0dc98c410 0x55a0dc99f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.297+0000 7f04a3fff640 1 --2- 172.21.15.2:0/4042521531 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a0dc98c410 0x55a0dc99f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.297+0000 7f04a3fff640 1 -- 172.21.15.2:0/4042521531 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0dc99c2d0 con 0x55a0dc98baf0 2024-09-19T06:16:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.297+0000 7f04a3fff640 1 --2- 172.21.15.2:0/4042521531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0dc98baf0 0x55a0dc99ec90 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f049402aa00 tx=0x7f0494005bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23c1ce36828c273b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.297+0000 7f0491ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:16:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.297+0000 7f04b3e38740 10 client.0 _ll_register_callbacks cb 0x7f049c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.297+0000 7f0491ffb640 1 -- 172.21.15.2:0/4042521531 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0494041040 con 0x55a0dc98baf0 2024-09-19T06:16:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.298+0000 7f0491ffb640 1 -- 172.21.15.2:0/4042521531 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f0494004b50 con 0x55a0dc98baf0 2024-09-19T06:16:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.298+0000 7f04b3e38740 1 -- 172.21.15.2:0/4042521531 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f049c00fe50 con 0x55a0dc98baf0 2024-09-19T06:16:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.298+0000 7f0491ffb640 1 -- 172.21.15.2:0/4042521531 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0494063050 con 0x55a0dc98baf0 2024-09-19T06:16:58.303 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.298+0000 7f04b3e38740 10 client.15924 fetch_fsmap learned FSMap version 26 2024-09-19T06:16:58.303 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.298+0000 7f04b3e38740 1 -- 172.21.15.2:0/4042521531 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55a0dca120b0 con 0x55a0dc98baf0 2024-09-19T06:16:58.303 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.299+0000 7f0491ffb640 1 -- 172.21.15.2:0/4042521531 <== mon.0 v2:172.21.15.2:3300/0 4 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f0494003da0 con 0x55a0dc98baf0 2024-09-19T06:16:58.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.299+0000 7f04b3e38740 10 client.15924 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:16:58.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.299+0000 7f04b3e38740 10 client.15924 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:58.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.299+0000 7f04b3e38740 20 client.15924 populate_metadata read hostname 'smithi002' 2024-09-19T06:16:58.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.299+0000 7f04b3e38740 1 --2- 172.21.15.2:0/4042521531 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a0dca126c0 0x55a0dca14b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:58.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.299+0000 7f04b3e38740 4 client.15924 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:16:58.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.299+0000 7f04b3e38740 1 -- 172.21.15.2:0/4042521531 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f049c00fe50 con 0x55a0dca126c0 2024-09-19T06:16:58.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.300+0000 7f04aa59c640 1 --2- 172.21.15.2:0/4042521531 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a0dca126c0 0x55a0dca14b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:58.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.301+0000 7f0491ffb640 10 client.15924 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:58.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.301+0000 7f04aa59c640 1 --2- 172.21.15.2:0/4042521531 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a0dca126c0 0x55a0dca14b00 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1c56a61a8840c58 server_cookie=25c99a0496177cdc in_seq=0 out_seq=0 2024-09-19T06:16:58.320 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.319+0000 7f0491ffb640 1 -- 172.21.15.2:0/4042521531 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f049c00fe50 con 0x55a0dca126c0 2024-09-19T06:16:58.320 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.319+0000 7f0491ffb640 10 client.15924 handle_command_reply: tid=0 2024-09-19T06:16:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.319+0000 7f04b3e38740 1 client.15924 shutdown 2024-09-19T06:16:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.319+0000 7f04b3e38740 1 -- 172.21.15.2:0/4042521531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0dc98baf0 msgr2=0x55a0dc99ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.319+0000 7f04b3e38740 1 --2- 172.21.15.2:0/4042521531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0dc98baf0 0x55a0dc99ec90 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f049402aa00 tx=0x7f0494005bb0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.319+0000 7f04b3e38740 1 -- 172.21.15.2:0/4042521531 shutdown_connections 2024-09-19T06:16:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.319+0000 7f04b3e38740 1 --2- 172.21.15.2:0/4042521531 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a0dc9aea00 0x55a0dc99bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.319+0000 7f04b3e38740 1 --2- 172.21.15.2:0/4042521531 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a0dca126c0 0x55a0dca14b00 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.319+0000 7f04b3e38740 1 --2- 172.21.15.2:0/4042521531 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a0dc98c410 0x55a0dc99f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.319+0000 7f04b3e38740 1 --2- 172.21.15.2:0/4042521531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0dc98baf0 0x55a0dc99ec90 secure :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f049402aa00 tx=0x7f0494005bb0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.319+0000 7f04b3e38740 1 -- 172.21.15.2:0/4042521531 >> 172.21.15.2:0/4042521531 conn(0x55a0dc988060 msgr2=0x55a0dc995c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.319+0000 7f0491ffb640 0 client.15924 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:16:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.320+0000 7f04b3e38740 1 -- 172.21.15.2:0/4042521531 shutdown_connections 2024-09-19T06:16:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.320+0000 7f04b3e38740 1 -- 172.21.15.2:0/4042521531 wait complete. 2024-09-19T06:16:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.320+0000 7f04b3e38740 20 client.15924 trim_cache size 0 max 16384 2024-09-19T06:16:58.323 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-19T06:16:58.323 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-19T06:16:58.323 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-19T06:16:58.323 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-19T06:16:58.323 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.321+0000 7f04b0fc4640 1 -- 172.21.15.2:0/2855433476 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f04980a3430 msgr2=0x7f04980a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:58.324 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.321+0000 7f04b0fc4640 1 --2- 172.21.15.2:0/2855433476 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f04980a3430 0x7f04980a58f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f04a409c740 tx=0x7f04a4009270 comp rx=0 tx=0).stop 2024-09-19T06:16:58.324 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.321+0000 7f04b0fc4640 1 -- 172.21.15.2:0/2855433476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04ac19cc20 msgr2=0x7f04ac19d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:58.324 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.321+0000 7f04b0fc4640 1 --2- 172.21.15.2:0/2855433476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04ac19cc20 0x7f04ac19d0d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f04a4009f60 tx=0x7f04a4009f90 comp rx=0 tx=0).stop 2024-09-19T06:16:58.324 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.321+0000 7f04b0fc4640 1 -- 172.21.15.2:0/2855433476 shutdown_connections 2024-09-19T06:16:58.324 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.321+0000 7f04b0fc4640 1 --2- 172.21.15.2:0/2855433476 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f04980a3430 0x7f04980a58f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.324 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.321+0000 7f04b0fc4640 1 --2- 172.21.15.2:0/2855433476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04ac19cc20 0x7f04ac19d0d0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.324 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.321+0000 7f04b0fc4640 1 --2- 172.21.15.2:0/2855433476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04ac1080d0 0x7f04ac1988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.324 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.321+0000 7f04b0fc4640 1 --2- 172.21.15.2:0/2855433476 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04ac100880 0x7f04ac198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.324 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.321+0000 7f04b0fc4640 1 -- 172.21.15.2:0/2855433476 >> 172.21.15.2:0/2855433476 conn(0x7f04ac075ec0 msgr2=0x7f04ac105b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:58.324 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.321+0000 7f04b0fc4640 1 -- 172.21.15.2:0/2855433476 shutdown_connections 2024-09-19T06:16:58.324 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:16:58.321+0000 7f04b0fc4640 1 -- 172.21.15.2:0/2855433476 wait complete. 2024-09-19T06:16:59.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:59 smithi002 ceph-mon[30982]: pgmap v68: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 85 MiB/s wr, 31 op/s 2024-09-19T06:16:59.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:59 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:16:59.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:59 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:16:59.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:59 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:16:59.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:59 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:16:59.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:59 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:16:59.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:59 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:16:59.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:16:59 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:16:59.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:59 smithi090 ceph-mon[34497]: pgmap v68: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 85 MiB/s wr, 31 op/s 2024-09-19T06:16:59.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:59 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:16:59.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:59 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:16:59.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:59 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:16:59.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:59 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:16:59.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:59 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:16:59.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:59 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:16:59.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:16:59 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:16:59.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:59 smithi089 ceph-mon[34160]: pgmap v68: 97 pgs: 97 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 85 MiB/s wr, 31 op/s 2024-09-19T06:16:59.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:59 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:16:59.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:59 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:16:59.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:59 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:16:59.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:59 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:16:59.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:59 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:16:59.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:59 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:16:59.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:16:59 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:17:00.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:17:00 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:17:00.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:17:00 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:17:00.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:17:00 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:17:00.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:17:00 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:17:00.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:17:00 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:17:00.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:17:00 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:17:00.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:17:00 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:17:00.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:17:00 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:17:00.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:17:00 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:17:02.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:17:01 smithi090 ceph-mon[34497]: pgmap v69: 97 pgs: 97 active+clean; 1.2 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 187 MiB/s wr, 86 op/s 2024-09-19T06:17:02.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:17:01 smithi089 ceph-mon[34160]: pgmap v69: 97 pgs: 97 active+clean; 1.2 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 187 MiB/s wr, 86 op/s 2024-09-19T06:17:02.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:17:01 smithi002 ceph-mon[30982]: pgmap v69: 97 pgs: 97 active+clean; 1.2 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 187 MiB/s wr, 86 op/s 2024-09-19T06:17:04.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:17:03 smithi089 ceph-mon[34160]: pgmap v70: 97 pgs: 97 active+clean; 1.2 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 102 MiB/s wr, 58 op/s 2024-09-19T06:17:04.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:17:03 smithi002 ceph-mon[30982]: pgmap v70: 97 pgs: 97 active+clean; 1.2 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 102 MiB/s wr, 58 op/s 2024-09-19T06:17:04.489 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:17:04 smithi090 ceph-mon[34497]: pgmap v70: 97 pgs: 97 active+clean; 1.2 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 102 MiB/s wr, 58 op/s 2024-09-19T06:17:05.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:17:05 smithi089 ceph-mon[34160]: pgmap v71: 97 pgs: 97 active+clean; 4.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 363 MiB/s wr, 142 op/s 2024-09-19T06:17:05.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:17:05 smithi002 ceph-mon[30982]: pgmap v71: 97 pgs: 97 active+clean; 4.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 363 MiB/s wr, 142 op/s 2024-09-19T06:17:05.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:17:05 smithi090 ceph-mon[34497]: pgmap v71: 97 pgs: 97 active+clean; 4.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 363 MiB/s wr, 142 op/s 2024-09-19T06:17:07.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:17:07 smithi002 ceph-mon[30982]: pgmap v72: 97 pgs: 97 active+clean; 4.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 363 MiB/s wr, 138 op/s 2024-09-19T06:17:07.489 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:17:07 smithi090 ceph-mon[34497]: pgmap v72: 97 pgs: 97 active+clean; 4.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 363 MiB/s wr, 138 op/s 2024-09-19T06:17:07.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:17:07 smithi089 ceph-mon[34160]: pgmap v72: 97 pgs: 97 active+clean; 4.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 363 MiB/s wr, 138 op/s 2024-09-19T06:17:09.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:17:09 smithi002 ceph-mon[30982]: pgmap v73: 97 pgs: 97 active+clean; 4.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 363 MiB/s wr, 138 op/s 2024-09-19T06:17:09.489 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:17:09 smithi090 ceph-mon[34497]: pgmap v73: 97 pgs: 97 active+clean; 4.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 363 MiB/s wr, 138 op/s 2024-09-19T06:17:09.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:17:09 smithi089 ceph-mon[34160]: pgmap v73: 97 pgs: 97 active+clean; 4.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 363 MiB/s wr, 138 op/s 2024-09-19T06:17:11.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:17:11 smithi002 ceph-mon[30982]: pgmap v74: 97 pgs: 97 active+clean; 7.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 635 MiB/s wr, 209 op/s 2024-09-19T06:17:11.474 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.471+0000 7f869b198640 1 -- 172.21.15.2:0/1771299377 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8694106a00 msgr2=0x7f8694106de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:11.474 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.471+0000 7f869b198640 1 --2- 172.21.15.2:0/1771299377 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8694106a00 0x7f8694106de0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8688009930 tx=0x7f868802a420 comp rx=0 tx=0).stop 2024-09-19T06:17:11.474 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.471+0000 7f869b198640 1 -- 172.21.15.2:0/1771299377 shutdown_connections 2024-09-19T06:17:11.474 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.471+0000 7f869b198640 1 --2- 172.21.15.2:0/1771299377 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8694101390 0x7f869410d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:11.474 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.471+0000 7f869b198640 1 --2- 172.21.15.2:0/1771299377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86941009f0 0x7f8694100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:11.474 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.471+0000 7f869b198640 1 --2- 172.21.15.2:0/1771299377 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8694106a00 0x7f8694106de0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:11.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.471+0000 7f869b198640 1 -- 172.21.15.2:0/1771299377 >> 172.21.15.2:0/1771299377 conn(0x7f86940fc6b0 msgr2=0x7f86940fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:11.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.471+0000 7f869b198640 1 -- 172.21.15.2:0/1771299377 shutdown_connections 2024-09-19T06:17:11.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.471+0000 7f869b198640 1 -- 172.21.15.2:0/1771299377 wait complete. 2024-09-19T06:17:11.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.472+0000 7f869b198640 1 Processor -- start 2024-09-19T06:17:11.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.472+0000 7f869b198640 1 -- start start 2024-09-19T06:17:11.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.472+0000 7f869b198640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86941009f0 0x7f8694198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:11.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.472+0000 7f869b198640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8694101390 0x7f8694198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:11.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.472+0000 7f869b198640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8694106a00 0x7f869419cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:11.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.472+0000 7f869b198640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8694111de0 con 0x7f86941009f0 2024-09-19T06:17:11.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.472+0000 7f869b198640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8694111c60 con 0x7f8694106a00 2024-09-19T06:17:11.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.472+0000 7f869b198640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8694111f60 con 0x7f8694101390 2024-09-19T06:17:11.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.473+0000 7f8698f34640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86941009f0 0x7f8694198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:11.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.473+0000 7f8698f34640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86941009f0 0x7f8694198710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51828/0 (socket says 172.21.15.2:51828) 2024-09-19T06:17:11.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.473+0000 7f8698f34640 1 -- 172.21.15.2:0/4141024284 learned_addr learned my addr 172.21.15.2:0/4141024284 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:11.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.473+0000 7f8693fff640 1 --2- 172.21.15.2:0/4141024284 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8694101390 0x7f8694198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:11.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.473+0000 7f8698f34640 1 -- 172.21.15.2:0/4141024284 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8694101390 msgr2=0x7f8694198c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:11.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.473+0000 7f8698f34640 1 --2- 172.21.15.2:0/4141024284 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8694101390 0x7f8694198c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:11.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.473+0000 7f8698f34640 1 -- 172.21.15.2:0/4141024284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8694106a00 msgr2=0x7f869419cfd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:17:11.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.473+0000 7f8698f34640 1 --2- 172.21.15.2:0/4141024284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8694106a00 0x7f869419cfd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:11.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.473+0000 7f8698f34640 1 -- 172.21.15.2:0/4141024284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f869419d700 con 0x7f86941009f0 2024-09-19T06:17:11.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.473+0000 7f8698f34640 1 --2- 172.21.15.2:0/4141024284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86941009f0 0x7f8694198710 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f8688005940 tx=0x7f86880042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:11.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.474+0000 7f8691ffb640 1 -- 172.21.15.2:0/4141024284 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f868803f030 con 0x7f86941009f0 2024-09-19T06:17:11.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.474+0000 7f869b198640 1 -- 172.21.15.2:0/4141024284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f869419d990 con 0x7f86941009f0 2024-09-19T06:17:11.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.474+0000 7f869b198640 1 -- 172.21.15.2:0/4141024284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86941a5280 con 0x7f86941009f0 2024-09-19T06:17:11.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.474+0000 7f8691ffb640 1 -- 172.21.15.2:0/4141024284 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f86880318a0 con 0x7f86941009f0 2024-09-19T06:17:11.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.474+0000 7f8691ffb640 1 -- 172.21.15.2:0/4141024284 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8688049060 con 0x7f86941009f0 2024-09-19T06:17:11.479 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.478+0000 7f8691ffb640 1 -- 172.21.15.2:0/4141024284 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f8688042030 con 0x7f86941009f0 2024-09-19T06:17:11.480 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.478+0000 7f869e012740 1 Processor -- start 2024-09-19T06:17:11.480 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.478+0000 7f869e012740 1 -- start start 2024-09-19T06:17:11.480 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.478+0000 7f869e012740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e382d529d0 0x55e382d52db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:11.480 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.478+0000 7f869e012740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e382d532f0 0x55e382d61b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:11.481 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.479+0000 7f869e012740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e382d620c0 0x55e382d644b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:11.481 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.479+0000 7f869e012740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e382cb72f0 con 0x55e382d529d0 2024-09-19T06:17:11.481 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.479+0000 7f869e012740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55e382c5f270 con 0x55e382d620c0 2024-09-19T06:17:11.481 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.479+0000 7f869e012740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55e382cb32b0 con 0x55e382d532f0 2024-09-19T06:17:11.481 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.479+0000 7f8699735640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e382d529d0 0x55e382d52db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:11.481 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.479+0000 7f8699735640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e382d529d0 0x55e382d52db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51838/0 (socket says 172.21.15.2:51838) 2024-09-19T06:17:11.481 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.479+0000 7f8699735640 1 -- 172.21.15.2:0/2593324582 learned_addr learned my addr 172.21.15.2:0/2593324582 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:11.481 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.479+0000 7f8691ffb640 1 --2- 172.21.15.2:0/4141024284 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f86840a33b0 0x7f86840a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:11.482 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.479+0000 7f8699735640 1 --2- 172.21.15.2:0/4141024284 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f86840a33b0 0x7f86840a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:11.482 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.479+0000 7f8693fff640 1 --2- 172.21.15.2:0/2593324582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e382d620c0 0x55e382d644b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:11.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.479+0000 7f8691ffb640 1 -- 172.21.15.2:0/4141024284 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f86880efd90 con 0x7f86941009f0 2024-09-19T06:17:11.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.479+0000 7f8699735640 1 -- 172.21.15.2:0/2593324582 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e382d532f0 msgr2=0x55e382d61b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:11.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.479+0000 7f8699735640 1 --2- 172.21.15.2:0/2593324582 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e382d532f0 0x55e382d61b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:11.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.479+0000 7f8699735640 1 -- 172.21.15.2:0/2593324582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e382d620c0 msgr2=0x55e382d644b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:11.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.479+0000 7f8699735640 1 --2- 172.21.15.2:0/2593324582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e382d620c0 0x55e382d644b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:11.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.479+0000 7f8699735640 1 -- 172.21.15.2:0/2593324582 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e382c5e340 con 0x55e382d529d0 2024-09-19T06:17:11.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.480+0000 7f8699735640 1 --2- 172.21.15.2:0/2593324582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e382d529d0 0x55e382d52db0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f868c015870 tx=0x7f868c015d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13177d860a062ff8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:11.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.480+0000 7f867effd640 1 -- 172.21.15.2:0/2593324582 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f868c022070 con 0x55e382d529d0 2024-09-19T06:17:11.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.480+0000 7f867effd640 1 -- 172.21.15.2:0/2593324582 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f868c009e20 con 0x55e382d529d0 2024-09-19T06:17:11.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.480+0000 7f867effd640 1 -- 172.21.15.2:0/2593324582 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f868c010bf0 con 0x55e382d529d0 2024-09-19T06:17:11.490 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.481+0000 7f869e012740 1 -- 172.21.15.2:0/2593324582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e382d529d0 msgr2=0x55e382d52db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:11.490 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.481+0000 7f869e012740 1 --2- 172.21.15.2:0/2593324582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e382d529d0 0x55e382d52db0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f868c015870 tx=0x7f868c015d30 comp rx=0 tx=0).stop 2024-09-19T06:17:11.490 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.481+0000 7f8699735640 1 --2- 172.21.15.2:0/4141024284 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f86840a33b0 0x7f86840a5870 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f868c01f000 tx=0x7f868c01a000 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:11.490 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.481+0000 7f869e012740 1 -- 172.21.15.2:0/2593324582 shutdown_connections 2024-09-19T06:17:11.490 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.481+0000 7f869e012740 1 --2- 172.21.15.2:0/2593324582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e382d620c0 0x55e382d644b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:11.491 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.481+0000 7f869e012740 1 --2- 172.21.15.2:0/2593324582 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e382d532f0 0x55e382d61b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:11.491 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.481+0000 7f869e012740 1 --2- 172.21.15.2:0/2593324582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e382d529d0 0x55e382d52db0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:11.491 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.481+0000 7f869e012740 1 -- 172.21.15.2:0/2593324582 >> 172.21.15.2:0/2593324582 conn(0x55e382d4f060 msgr2=0x55e382d4f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:11.491 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.481+0000 7f869e012740 1 -- 172.21.15.2:0/2593324582 shutdown_connections 2024-09-19T06:17:11.491 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.481+0000 7f869e012740 1 -- 172.21.15.2:0/2593324582 wait complete. 2024-09-19T06:17:11.491 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.482+0000 7f869e012740 1 -- start start 2024-09-19T06:17:11.491 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.482+0000 7f869e012740 1 Processor -- start 2024-09-19T06:17:11.491 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.483+0000 7f869e012740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e382d529d0 0x55e382d5f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:11.491 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.483+0000 7f869e012740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e382d532f0 0x55e382d5f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:11.491 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.483+0000 7f869e012740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e382d620c0 0x55e382d5fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:11.491 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.483+0000 7f869e012740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e382d64cf0 con 0x55e382d620c0 2024-09-19T06:17:11.491 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.484+0000 7f869e012740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55e382c40290 con 0x55e382d529d0 2024-09-19T06:17:11.492 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.484+0000 7f869e012740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55e382d64e70 con 0x55e382d532f0 2024-09-19T06:17:11.492 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.484+0000 7f8698f34640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e382d529d0 0x55e382d5f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:11.492 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.484+0000 7f8698f34640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e382d529d0 0x55e382d5f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:41330/0 (socket says 172.21.15.2:41330) 2024-09-19T06:17:11.492 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.484+0000 7f8698f34640 1 -- 172.21.15.2:0/582281614 learned_addr learned my addr 172.21.15.2:0/582281614 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:11.492 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.484+0000 7f8699735640 1 --2- 172.21.15.2:0/582281614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e382d620c0 0x55e382d5fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:11.492 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.484+0000 7f8698f34640 1 -- 172.21.15.2:0/582281614 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e382d532f0 msgr2=0x55e382d5f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:11.492 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.484+0000 7f8698f34640 1 --2- 172.21.15.2:0/582281614 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e382d532f0 0x55e382d5f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:11.492 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.484+0000 7f8698f34640 1 -- 172.21.15.2:0/582281614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e382d620c0 msgr2=0x55e382d5fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:11.492 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.484+0000 7f8698f34640 1 --2- 172.21.15.2:0/582281614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e382d620c0 0x55e382d5fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:11.492 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.484+0000 7f8698f34640 1 -- 172.21.15.2:0/582281614 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3829ca210 con 0x55e382d529d0 2024-09-19T06:17:11.492 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.484+0000 7f8699735640 1 --2- 172.21.15.2:0/582281614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e382d620c0 0x55e382d5fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:17:11.493 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.485+0000 7f8698f34640 1 --2- 172.21.15.2:0/582281614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e382d529d0 0x55e382d5f0a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f86880edb10 tx=0x7f86880bbca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6994ae029a0748c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:11.493 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.485+0000 7f8673fff640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-09-19T06:17:11.493 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.484+0000 7f869e012740 10 client.0 _ll_register_callbacks cb 0x55e382c71140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:11.493 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.485+0000 7f869e012740 1 -- 172.21.15.2:0/582281614 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e382cc4a20 con 0x55e382d529d0 2024-09-19T06:17:11.493 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.485+0000 7f8673fff640 1 -- 172.21.15.2:0/582281614 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8688035040 con 0x55e382d529d0 2024-09-19T06:17:11.493 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.485+0000 7f8673fff640 1 -- 172.21.15.2:0/582281614 <== mon.2 v2:172.21.15.89:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f86880ed790 con 0x55e382d529d0 2024-09-19T06:17:11.493 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.485+0000 7f8673fff640 1 -- 172.21.15.2:0/582281614 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f868803b460 con 0x55e382d529d0 2024-09-19T06:17:11.493 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.485+0000 7f869e012740 10 client.25526 fetch_fsmap learned FSMap version 26 2024-09-19T06:17:11.493 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.486+0000 7f869e012740 1 -- 172.21.15.2:0/582281614 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55e382a96620 con 0x55e382d529d0 2024-09-19T06:17:11.493 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.486+0000 7f8673fff640 1 -- 172.21.15.2:0/582281614 <== mon.2 v2:172.21.15.89:3300/0 4 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f86880dace0 con 0x55e382d529d0 2024-09-19T06:17:11.493 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.486+0000 7f869e012740 10 client.25526 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:17:11.493 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.486+0000 7f869e012740 10 client.25526 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:17:11.494 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.486+0000 7f869e012740 20 client.25526 populate_metadata read hostname 'smithi002' 2024-09-19T06:17:11.494 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.486+0000 7f869e012740 1 --2- 172.21.15.2:0/582281614 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55e382d71f60 0x55e382d743f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:11.494 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.486+0000 7f869e012740 4 client.25526 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:17:11.494 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.487+0000 7f869e012740 1 -- 172.21.15.2:0/582281614 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e382cbed70 con 0x55e382d71f60 2024-09-19T06:17:11.494 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.487+0000 7f8693fff640 1 --2- 172.21.15.2:0/582281614 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55e382d71f60 0x55e382d743f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:11.494 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.487+0000 7f8673fff640 10 client.25526 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:17:11.494 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.487+0000 7f8693fff640 1 --2- 172.21.15.2:0/582281614 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55e382d71f60 0x55e382d743f0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5915611c30e109b7 server_cookie=81db2d6ab19af107 in_seq=0 out_seq=0 2024-09-19T06:17:11.494 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.488+0000 7f8673fff640 1 -- 172.21.15.2:0/582281614 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e382cbed70 con 0x55e382d71f60 2024-09-19T06:17:11.494 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.488+0000 7f8673fff640 10 client.25526 handle_command_reply: tid=0 2024-09-19T06:17:11.494 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.488+0000 7f869e012740 1 client.25526 shutdown 2024-09-19T06:17:11.494 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.488+0000 7f869e012740 1 -- 172.21.15.2:0/582281614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e382d529d0 msgr2=0x55e382d5f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:11.494 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.488+0000 7f869e012740 1 --2- 172.21.15.2:0/582281614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e382d529d0 0x55e382d5f0a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f86880edb10 tx=0x7f86880bbca0 comp rx=0 tx=0).stop 2024-09-19T06:17:11.494 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.488+0000 7f869e012740 1 -- 172.21.15.2:0/582281614 shutdown_connections 2024-09-19T06:17:11.495 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.488+0000 7f869e012740 1 --2- 172.21.15.2:0/582281614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e382d620c0 0x55e382d5fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:11.495 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.488+0000 7f869e012740 1 --2- 172.21.15.2:0/582281614 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e382d532f0 0x55e382d5f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:11.495 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.488+0000 7f869e012740 1 --2- 172.21.15.2:0/582281614 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55e382d71f60 0x55e382d743f0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:11.495 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.488+0000 7f8673fff640 0 client.25526 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:17:11.495 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.488+0000 7f869e012740 1 --2- 172.21.15.2:0/582281614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e382d529d0 0x55e382d5f0a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:11.495 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.488+0000 7f869e012740 1 -- 172.21.15.2:0/582281614 >> 172.21.15.2:0/582281614 conn(0x55e382d4f060 msgr2=0x55e382d54dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:11.495 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.489+0000 7f869e012740 1 -- 172.21.15.2:0/582281614 shutdown_connections 2024-09-19T06:17:11.495 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.489+0000 7f869e012740 1 -- 172.21.15.2:0/582281614 wait complete. 2024-09-19T06:17:11.495 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.489+0000 7f869e012740 20 client.25526 trim_cache size 0 max 16384 2024-09-19T06:17:11.518 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.514+0000 7f869e012740 1 Processor -- start 2024-09-19T06:17:11.519 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.514+0000 7f869e012740 1 -- start start 2024-09-19T06:17:11.519 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.514+0000 7f869e012740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e382d529d0 0x55e382d4e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:11.519 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.514+0000 7f869e012740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e382d532f0 0x55e382d79d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:11.519 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.514+0000 7f869e012740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e382d620c0 0x55e382d7a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:11.519 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.514+0000 7f869e012740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8678010e60 con 0x55e382d532f0 2024-09-19T06:17:11.520 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.514+0000 7f869e012740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f867800e730 con 0x55e382d620c0 2024-09-19T06:17:11.520 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.514+0000 7f869e012740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f867800c580 con 0x55e382d529d0 2024-09-19T06:17:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.514+0000 7f8693fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e382d532f0 0x55e382d79d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.515+0000 7f8693fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e382d532f0 0x55e382d79d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51862/0 (socket says 172.21.15.2:51862) 2024-09-19T06:17:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.515+0000 7f8693fff640 1 -- 172.21.15.2:0/3719108352 learned_addr learned my addr 172.21.15.2:0/3719108352 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.515+0000 7f8698f34640 1 --2- 172.21.15.2:0/3719108352 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e382d529d0 0x55e382d4e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.515+0000 7f8699735640 1 --2- 172.21.15.2:0/3719108352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e382d620c0 0x55e382d7a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.515+0000 7f8693fff640 1 -- 172.21.15.2:0/3719108352 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e382d529d0 msgr2=0x55e382d4e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.515+0000 7f8693fff640 1 --2- 172.21.15.2:0/3719108352 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e382d529d0 0x55e382d4e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.515+0000 7f8693fff640 1 -- 172.21.15.2:0/3719108352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e382d620c0 msgr2=0x55e382d7a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.515+0000 7f8693fff640 1 --2- 172.21.15.2:0/3719108352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e382d620c0 0x55e382d7a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.515+0000 7f8693fff640 1 -- 172.21.15.2:0/3719108352 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e382d74a70 con 0x55e382d532f0 2024-09-19T06:17:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.515+0000 7f8698f34640 1 --2- 172.21.15.2:0/3719108352 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e382d529d0 0x55e382d4e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.515+0000 7f8693fff640 1 --2- 172.21.15.2:0/3719108352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e382d532f0 0x55e382d79d00 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f86800058c0 tx=0x7f8680005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bda04b5156e349c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.516+0000 7f867e7fc640 1 -- 172.21.15.2:0/3719108352 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f868001f070 con 0x55e382d532f0 2024-09-19T06:17:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.517+0000 7f867e7fc640 1 -- 172.21.15.2:0/3719108352 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8680012e10 con 0x55e382d532f0 2024-09-19T06:17:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.517+0000 7f867e7fc640 1 -- 172.21.15.2:0/3719108352 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86800119d0 con 0x55e382d532f0 2024-09-19T06:17:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.518+0000 7f869e012740 1 -- 172.21.15.2:0/3719108352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e382d532f0 msgr2=0x55e382d79d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.518+0000 7f869e012740 1 --2- 172.21.15.2:0/3719108352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e382d532f0 0x55e382d79d00 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f86800058c0 tx=0x7f8680005850 comp rx=0 tx=0).stop 2024-09-19T06:17:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.518+0000 7f869e012740 1 -- 172.21.15.2:0/3719108352 shutdown_connections 2024-09-19T06:17:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.518+0000 7f869e012740 1 --2- 172.21.15.2:0/3719108352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e382d620c0 0x55e382d7a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.518+0000 7f869e012740 1 --2- 172.21.15.2:0/3719108352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e382d532f0 0x55e382d79d00 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.518+0000 7f869e012740 1 --2- 172.21.15.2:0/3719108352 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e382d529d0 0x55e382d4e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.518+0000 7f869e012740 1 -- 172.21.15.2:0/3719108352 >> 172.21.15.2:0/3719108352 conn(0x55e382d4f060 msgr2=0x55e382d4d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.518+0000 7f869e012740 1 -- 172.21.15.2:0/3719108352 shutdown_connections 2024-09-19T06:17:11.531 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.519+0000 7f869e012740 1 -- 172.21.15.2:0/3719108352 wait complete. 2024-09-19T06:17:11.531 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.519+0000 7f869e012740 1 -- start start 2024-09-19T06:17:11.531 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.519+0000 7f869e012740 1 Processor -- start 2024-09-19T06:17:11.531 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.520+0000 7f869e012740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e382d529d0 0x55e382d65e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:11.531 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.520+0000 7f869e012740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e382d532f0 0x55e382d66350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:11.531 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.520+0000 7f869e012740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e382d620c0 0x55e382d66890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.520+0000 7f869e012740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f867800cbf0 con 0x55e382d620c0 2024-09-19T06:17:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.520+0000 7f869e012740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f867800e060 con 0x55e382d529d0 2024-09-19T06:17:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.520+0000 7f869e012740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f867800d2c0 con 0x55e382d532f0 2024-09-19T06:17:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.520+0000 7f869e012740 10 client.0 _ll_register_callbacks cb 0x7f8688009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.520+0000 7f8699735640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e382d620c0 0x55e382d66890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.520+0000 7f8699735640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e382d620c0 0x55e382d66890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51876/0 (socket says 172.21.15.2:51876) 2024-09-19T06:17:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.520+0000 7f8699735640 1 -- 172.21.15.2:0/1221440939 learned_addr learned my addr 172.21.15.2:0/1221440939 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.520+0000 7f8698f34640 1 --2- 172.21.15.2:0/1221440939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e382d529d0 0x55e382d65e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.520+0000 7f8693fff640 1 --2- 172.21.15.2:0/1221440939 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e382d532f0 0x55e382d66350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.520+0000 7f8699735640 1 -- 172.21.15.2:0/1221440939 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e382d532f0 msgr2=0x55e382d66350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:11.534 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.520+0000 7f8699735640 1 --2- 172.21.15.2:0/1221440939 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e382d532f0 0x55e382d66350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:11.534 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.521+0000 7f8699735640 1 -- 172.21.15.2:0/1221440939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e382d529d0 msgr2=0x55e382d65e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:11.534 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.521+0000 7f8699735640 1 --2- 172.21.15.2:0/1221440939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e382d529d0 0x55e382d65e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:11.534 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.521+0000 7f8699735640 1 -- 172.21.15.2:0/1221440939 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e382ddbcd0 con 0x55e382d620c0 2024-09-19T06:17:11.534 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.521+0000 7f8698f34640 1 --2- 172.21.15.2:0/1221440939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e382d529d0 0x55e382d65e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:17:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.521+0000 7f8699735640 1 --2- 172.21.15.2:0/1221440939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e382d620c0 0x55e382d66890 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f868c015710 tx=0x7f868c004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1693c344a3a2d81c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.521+0000 7f8673fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:17:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.521+0000 7f8673fff640 1 -- 172.21.15.2:0/1221440939 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f868c034060 con 0x55e382d620c0 2024-09-19T06:17:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.521+0000 7f8673fff640 1 -- 172.21.15.2:0/1221440939 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f868c015250 con 0x55e382d620c0 2024-09-19T06:17:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.521+0000 7f869e012740 1 -- 172.21.15.2:0/1221440939 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8680012e10 con 0x55e382d620c0 2024-09-19T06:17:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.521+0000 7f8673fff640 1 -- 172.21.15.2:0/1221440939 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f868c022040 con 0x55e382d620c0 2024-09-19T06:17:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.522+0000 7f869e012740 10 client.15942 fetch_fsmap learned FSMap version 26 2024-09-19T06:17:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.522+0000 7f869e012740 1 -- 172.21.15.2:0/1221440939 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55e382d55710 con 0x55e382d620c0 2024-09-19T06:17:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.522+0000 7f8673fff640 1 -- 172.21.15.2:0/1221440939 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8680012e10 con 0x55e382d620c0 2024-09-19T06:17:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.522+0000 7f8673fff640 1 -- 172.21.15.2:0/1221440939 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f868c010380 con 0x55e382d620c0 2024-09-19T06:17:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.522+0000 7f869e012740 10 client.15942 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:17:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.522+0000 7f869e012740 10 client.15942 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:17:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.522+0000 7f869e012740 20 client.15942 populate_metadata read hostname 'smithi002' 2024-09-19T06:17:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.522+0000 7f869e012740 1 --2- 172.21.15.2:0/1221440939 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55e382d55ca0 0x55e382d580c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.522+0000 7f869e012740 4 client.15942 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:17:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.522+0000 7f869e012740 1 -- 172.21.15.2:0/1221440939 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e382c3b900 con 0x55e382d55ca0 2024-09-19T06:17:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.523+0000 7f8698f34640 1 --2- 172.21.15.2:0/1221440939 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55e382d55ca0 0x55e382d580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.524+0000 7f8698f34640 1 --2- 172.21.15.2:0/1221440939 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55e382d55ca0 0x55e382d580c0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f946366efc2c268 server_cookie=711023037096a5bb in_seq=0 out_seq=0 2024-09-19T06:17:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.524+0000 7f8673fff640 10 client.15942 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:17:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.534+0000 7f8673fff640 1 -- 172.21.15.2:0/1221440939 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e382c3b900 con 0x55e382d55ca0 2024-09-19T06:17:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.534+0000 7f8673fff640 10 client.15942 handle_command_reply: tid=0 2024-09-19T06:17:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.534+0000 7f869e012740 1 client.15942 shutdown 2024-09-19T06:17:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.535+0000 7f869e012740 1 -- 172.21.15.2:0/1221440939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e382d620c0 msgr2=0x55e382d66890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.535+0000 7f869e012740 1 --2- 172.21.15.2:0/1221440939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e382d620c0 0x55e382d66890 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f868c015710 tx=0x7f868c004bb0 comp rx=0 tx=0).stop 2024-09-19T06:17:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.535+0000 7f869e012740 1 -- 172.21.15.2:0/1221440939 shutdown_connections 2024-09-19T06:17:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.535+0000 7f869e012740 1 --2- 172.21.15.2:0/1221440939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e382d620c0 0x55e382d66890 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.535+0000 7f869e012740 1 --2- 172.21.15.2:0/1221440939 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e382d532f0 0x55e382d66350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.535+0000 7f869e012740 1 --2- 172.21.15.2:0/1221440939 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55e382d55ca0 0x55e382d580c0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.535+0000 7f869e012740 1 --2- 172.21.15.2:0/1221440939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e382d529d0 0x55e382d65e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.535+0000 7f8673fff640 0 client.15942 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:17:11.543 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.535+0000 7f869e012740 1 -- 172.21.15.2:0/1221440939 >> 172.21.15.2:0/1221440939 conn(0x55e382d4f060 msgr2=0x55e382d4e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:11.543 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.535+0000 7f869e012740 1 -- 172.21.15.2:0/1221440939 shutdown_connections 2024-09-19T06:17:11.543 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.535+0000 7f869e012740 1 -- 172.21.15.2:0/1221440939 wait complete. 2024-09-19T06:17:11.543 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.535+0000 7f869e012740 20 client.15942 trim_cache size 0 max 16384 2024-09-19T06:17:11.543 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-19T06:17:11.543 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-19T06:17:11.543 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-19T06:17:11.543 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-19T06:17:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.536+0000 7f869b198640 1 -- 172.21.15.2:0/4141024284 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f86840a33b0 msgr2=0x7f86840a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.536+0000 7f869b198640 1 --2- 172.21.15.2:0/4141024284 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f86840a33b0 0x7f86840a5870 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f868c01f000 tx=0x7f868c01a000 comp rx=0 tx=0).stop 2024-09-19T06:17:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.536+0000 7f869b198640 1 -- 172.21.15.2:0/4141024284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86941009f0 msgr2=0x7f8694198710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.536+0000 7f869b198640 1 --2- 172.21.15.2:0/4141024284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86941009f0 0x7f8694198710 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f8688005940 tx=0x7f86880042f0 comp rx=0 tx=0).stop 2024-09-19T06:17:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.536+0000 7f869b198640 1 -- 172.21.15.2:0/4141024284 shutdown_connections 2024-09-19T06:17:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.536+0000 7f869b198640 1 --2- 172.21.15.2:0/4141024284 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f86840a33b0 0x7f86840a5870 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.536+0000 7f869b198640 1 --2- 172.21.15.2:0/4141024284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8694106a00 0x7f869419cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.536+0000 7f869b198640 1 --2- 172.21.15.2:0/4141024284 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8694101390 0x7f8694198c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.536+0000 7f869b198640 1 --2- 172.21.15.2:0/4141024284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86941009f0 0x7f8694198710 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.536+0000 7f869b198640 1 -- 172.21.15.2:0/4141024284 >> 172.21.15.2:0/4141024284 conn(0x7f86940fc6b0 msgr2=0x7f86940fe2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.536+0000 7f869b198640 1 -- 172.21.15.2:0/4141024284 shutdown_connections 2024-09-19T06:17:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:11.536+0000 7f869b198640 1 -- 172.21.15.2:0/4141024284 wait complete. 2024-09-19T06:17:11.545 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:17:11 smithi089 ceph-mon[34160]: pgmap v74: 97 pgs: 97 active+clean; 7.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 635 MiB/s wr, 209 op/s 2024-09-19T06:17:11.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:17:11 smithi090 ceph-mon[34497]: pgmap v74: 97 pgs: 97 active+clean; 7.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 635 MiB/s wr, 209 op/s 2024-09-19T06:17:13.366 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-19T06:17:13.367 INFO:tasks.workunit.client.0.smithi002.stdout: Children see throughput for 1 initial writers = 644433.44 kB/sec 2024-09-19T06:17:13.367 INFO:tasks.workunit.client.0.smithi002.stdout: Parent sees throughput for 1 initial writers = 644424.20 kB/sec 2024-09-19T06:17:13.367 INFO:tasks.workunit.client.0.smithi002.stdout: Min throughput per process = 644433.44 kB/sec 2024-09-19T06:17:13.367 INFO:tasks.workunit.client.0.smithi002.stdout: Max throughput per process = 644433.44 kB/sec 2024-09-19T06:17:13.367 INFO:tasks.workunit.client.0.smithi002.stdout: Avg throughput per process = 644433.44 kB/sec 2024-09-19T06:17:13.367 INFO:tasks.workunit.client.0.smithi002.stdout: Min xfer = 10485760.00 kB 2024-09-19T06:17:13.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:17:13 smithi089 ceph-mon[34160]: pgmap v75: 97 pgs: 97 active+clean; 7.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 533 MiB/s wr, 154 op/s 2024-09-19T06:17:13.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:17:13 smithi002 ceph-mon[30982]: pgmap v75: 97 pgs: 97 active+clean; 7.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 533 MiB/s wr, 154 op/s 2024-09-19T06:17:13.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:17:13 smithi090 ceph-mon[34497]: pgmap v75: 97 pgs: 97 active+clean; 7.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 533 MiB/s wr, 154 op/s 2024-09-19T06:17:15.546 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:17:15 smithi089 ceph-mon[34160]: pgmap v76: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 751 MiB/s wr, 214 op/s 2024-09-19T06:17:15.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:17:15 smithi002 ceph-mon[30982]: pgmap v76: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 751 MiB/s wr, 214 op/s 2024-09-19T06:17:15.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:17:15 smithi090 ceph-mon[34497]: pgmap v76: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 751 MiB/s wr, 214 op/s 2024-09-19T06:17:17.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:17:17 smithi089 ceph-mon[34160]: pgmap v77: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 490 MiB/s wr, 131 op/s 2024-09-19T06:17:17.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:17:17 smithi002 ceph-mon[30982]: pgmap v77: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 490 MiB/s wr, 131 op/s 2024-09-19T06:17:17.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:17:17 smithi090 ceph-mon[34497]: pgmap v77: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 490 MiB/s wr, 131 op/s 2024-09-19T06:17:19.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:17:19 smithi002 ceph-mon[30982]: pgmap v78: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 490 MiB/s wr, 131 op/s 2024-09-19T06:17:19.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:17:19 smithi090 ceph-mon[34497]: pgmap v78: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 490 MiB/s wr, 131 op/s 2024-09-19T06:17:19.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:17:19 smithi089 ceph-mon[34160]: pgmap v78: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 490 MiB/s wr, 131 op/s 2024-09-19T06:17:21.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:17:21 smithi002 ceph-mon[30982]: pgmap v79: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 607 MiB/s wr, 163 op/s 2024-09-19T06:17:21.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:17:21 smithi090 ceph-mon[34497]: pgmap v79: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 607 MiB/s wr, 163 op/s 2024-09-19T06:17:21.539 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:17:21.541 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:17:21 smithi089 ceph-mon[34160]: pgmap v79: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 607 MiB/s wr, 163 op/s 2024-09-19T06:17:22.000 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:17:22.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.649+0000 7f2afea4b640 1 -- 172.21.15.2:0/3967204035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2af8106a80 msgr2=0x7f2af8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:22.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.649+0000 7f2afea4b640 1 --2- 172.21.15.2:0/3967204035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2af8106a80 0x7f2af8106e60 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f2ae80099b0 tx=0x7f2ae802c650 comp rx=0 tx=0).stop 2024-09-19T06:17:22.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.649+0000 7f2afea4b640 1 -- 172.21.15.2:0/3967204035 shutdown_connections 2024-09-19T06:17:22.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.649+0000 7f2afea4b640 1 --2- 172.21.15.2:0/3967204035 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2af8101420 0x7f2af810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:22.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.649+0000 7f2afea4b640 1 --2- 172.21.15.2:0/3967204035 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2af8100a80 0x7f2af8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:22.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.649+0000 7f2afea4b640 1 --2- 172.21.15.2:0/3967204035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2af8106a80 0x7f2af8106e60 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:22.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.649+0000 7f2afea4b640 1 -- 172.21.15.2:0/3967204035 >> 172.21.15.2:0/3967204035 conn(0x7f2af80fc7a0 msgr2=0x7f2af80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:22.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.649+0000 7f2afea4b640 1 -- 172.21.15.2:0/3967204035 shutdown_connections 2024-09-19T06:17:22.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.649+0000 7f2afea4b640 1 -- 172.21.15.2:0/3967204035 wait complete. 2024-09-19T06:17:22.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.650+0000 7f2afea4b640 1 Processor -- start 2024-09-19T06:17:22.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.650+0000 7f2afea4b640 1 -- start start 2024-09-19T06:17:22.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.651+0000 7f2afea4b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2af8100a80 0x7f2af8196250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:22.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.651+0000 7f2afea4b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2af8101420 0x7f2af8196790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:22.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.651+0000 7f2afea4b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2af8106a80 0x7f2af819ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:22.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.651+0000 7f2afea4b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2af810fca0 con 0x7f2af8101420 2024-09-19T06:17:22.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.651+0000 7f2afea4b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2af810fb20 con 0x7f2af8100a80 2024-09-19T06:17:22.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.651+0000 7f2afea4b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2af810fe20 con 0x7f2af8106a80 2024-09-19T06:17:22.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.651+0000 7f2aeffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2af8101420 0x7f2af8196790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:22.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.651+0000 7f2aeffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2af8101420 0x7f2af8196790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56958/0 (socket says 172.21.15.2:56958) 2024-09-19T06:17:22.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.651+0000 7f2aeffff640 1 -- 172.21.15.2:0/1601015725 learned_addr learned my addr 172.21.15.2:0/1601015725 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:22.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.652+0000 7f2af7fff640 1 --2- 172.21.15.2:0/1601015725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2af8100a80 0x7f2af8196250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:22.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.652+0000 7f2aeffff640 1 -- 172.21.15.2:0/1601015725 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2af8106a80 msgr2=0x7f2af819ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:22.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.652+0000 7f2aeffff640 1 --2- 172.21.15.2:0/1601015725 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2af8106a80 0x7f2af819ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:22.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.652+0000 7f2aeffff640 1 -- 172.21.15.2:0/1601015725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2af8100a80 msgr2=0x7f2af8196250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:22.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.652+0000 7f2aeffff640 1 --2- 172.21.15.2:0/1601015725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2af8100a80 0x7f2af8196250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:22.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.652+0000 7f2aeffff640 1 -- 172.21.15.2:0/1601015725 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2af819b200 con 0x7f2af8101420 2024-09-19T06:17:22.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.653+0000 7f2aeffff640 1 --2- 172.21.15.2:0/1601015725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2af8101420 0x7f2af8196790 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f2ae000b4a0 tx=0x7f2ae000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:22.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.653+0000 7f2af5ffb640 1 -- 172.21.15.2:0/1601015725 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae0014070 con 0x7f2af8101420 2024-09-19T06:17:22.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.653+0000 7f2afea4b640 1 -- 172.21.15.2:0/1601015725 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2af819b4f0 con 0x7f2af8101420 2024-09-19T06:17:22.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.653+0000 7f2afea4b640 1 -- 172.21.15.2:0/1601015725 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2af81a2dd0 con 0x7f2af8101420 2024-09-19T06:17:22.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.653+0000 7f2af5ffb640 1 -- 172.21.15.2:0/1601015725 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2ae0010ac0 con 0x7f2af8101420 2024-09-19T06:17:22.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.653+0000 7f2af5ffb640 1 -- 172.21.15.2:0/1601015725 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae001e060 con 0x7f2af8101420 2024-09-19T06:17:22.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.657+0000 7f2b00e24740 1 Processor -- start 2024-09-19T06:17:22.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.657+0000 7f2b00e24740 1 -- start start 2024-09-19T06:17:22.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.657+0000 7f2af5ffb640 1 -- 172.21.15.2:0/1601015725 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f2ae0017070 con 0x7f2af8101420 2024-09-19T06:17:22.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.657+0000 7f2b00e24740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc651514a0 0x55dc65151880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:22.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.657+0000 7f2b00e24740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc65151dc0 0x55dc6515c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:22.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.658+0000 7f2b00e24740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dc6515c680 0x55dc6515ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:22.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.658+0000 7f2b00e24740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55dc650b72e0 con 0x55dc651514a0 2024-09-19T06:17:22.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.658+0000 7f2b00e24740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55dc6505ece0 con 0x55dc6515c680 2024-09-19T06:17:22.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.658+0000 7f2b00e24740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55dc650b32a0 con 0x55dc65151dc0 2024-09-19T06:17:22.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.659+0000 7f2afcfe8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc651514a0 0x55dc65151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:22.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.659+0000 7f2af5ffb640 1 --2- 172.21.15.2:0/1601015725 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f2ae40a35b0 0x7f2ae40a5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:22.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.659+0000 7f2afcfe8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc651514a0 0x55dc65151880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56968/0 (socket says 172.21.15.2:56968) 2024-09-19T06:17:22.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.659+0000 7f2afcfe8640 1 -- 172.21.15.2:0/4274865913 learned_addr learned my addr 172.21.15.2:0/4274865913 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:22.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.659+0000 7f2af7fff640 1 --2- 172.21.15.2:0/4274865913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc65151dc0 0x55dc6515c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:22.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.660+0000 7f2afcfe8640 1 --2- 172.21.15.2:0/1601015725 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f2ae40a35b0 0x7f2ae40a5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:22.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.660+0000 7f2af5ffb640 1 -- 172.21.15.2:0/1601015725 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f2ae00ceb70 con 0x7f2af8101420 2024-09-19T06:17:22.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.660+0000 7f2aeffff640 1 --2- 172.21.15.2:0/4274865913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dc6515c680 0x55dc6515ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:22.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.660+0000 7f2af7fff640 1 -- 172.21.15.2:0/4274865913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dc6515c680 msgr2=0x55dc6515ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:22.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.660+0000 7f2af7fff640 1 --2- 172.21.15.2:0/4274865913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dc6515c680 0x55dc6515ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:22.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.660+0000 7f2af7fff640 1 -- 172.21.15.2:0/4274865913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc651514a0 msgr2=0x55dc65151880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:22.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.660+0000 7f2af7fff640 1 --2- 172.21.15.2:0/4274865913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc651514a0 0x55dc65151880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:22.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.661+0000 7f2af7fff640 1 -- 172.21.15.2:0/4274865913 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc65043440 con 0x55dc65151dc0 2024-09-19T06:17:22.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.661+0000 7f2afcfe8640 1 --2- 172.21.15.2:0/4274865913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc651514a0 0x55dc65151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:22.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.661+0000 7f2afcfe8640 1 --2- 172.21.15.2:0/1601015725 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f2ae40a35b0 0x7f2ae40a5a70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2af0005c40 tx=0x7f2af0009960 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:22.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.661+0000 7f2af7fff640 1 --2- 172.21.15.2:0/4274865913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc65151dc0 0x55dc6515c140 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2ae802cb70 tx=0x7f2ae8004390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f8e27cc9d762cc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:22.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.662+0000 7f2aee7fc640 1 -- 172.21.15.2:0/4274865913 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae8037030 con 0x55dc65151dc0 2024-09-19T06:17:22.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.662+0000 7f2aee7fc640 1 -- 172.21.15.2:0/4274865913 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2ae80046c0 con 0x55dc65151dc0 2024-09-19T06:17:22.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.662+0000 7f2aee7fc640 1 -- 172.21.15.2:0/4274865913 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae8005d50 con 0x55dc65151dc0 2024-09-19T06:17:22.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.663+0000 7f2b00e24740 1 -- 172.21.15.2:0/4274865913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc65151dc0 msgr2=0x55dc6515c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:22.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.663+0000 7f2b00e24740 1 --2- 172.21.15.2:0/4274865913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc65151dc0 0x55dc6515c140 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2ae802cb70 tx=0x7f2ae8004390 comp rx=0 tx=0).stop 2024-09-19T06:17:22.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.663+0000 7f2b00e24740 1 -- 172.21.15.2:0/4274865913 shutdown_connections 2024-09-19T06:17:22.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.663+0000 7f2b00e24740 1 --2- 172.21.15.2:0/4274865913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dc6515c680 0x55dc6515ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:22.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.663+0000 7f2b00e24740 1 --2- 172.21.15.2:0/4274865913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc65151dc0 0x55dc6515c140 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:22.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.663+0000 7f2b00e24740 1 --2- 172.21.15.2:0/4274865913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc651514a0 0x55dc65151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:22.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.663+0000 7f2b00e24740 1 -- 172.21.15.2:0/4274865913 >> 172.21.15.2:0/4274865913 conn(0x55dc6514da30 msgr2=0x55dc6514de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:22.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.663+0000 7f2b00e24740 1 -- 172.21.15.2:0/4274865913 shutdown_connections 2024-09-19T06:17:22.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.663+0000 7f2b00e24740 1 -- 172.21.15.2:0/4274865913 wait complete. 2024-09-19T06:17:22.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.664+0000 7f2b00e24740 1 -- start start 2024-09-19T06:17:22.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.665+0000 7f2b00e24740 1 Processor -- start 2024-09-19T06:17:22.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.665+0000 7f2b00e24740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc651514a0 0x55dc65160870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:22.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.665+0000 7f2b00e24740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dc65151dc0 0x55dc65160db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:22.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.665+0000 7f2b00e24740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc6515c680 0x55dc65164f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:22.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.665+0000 7f2b00e24740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55dc6515f2a0 con 0x55dc6515c680 2024-09-19T06:17:22.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.665+0000 7f2b00e24740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55dc65072050 con 0x55dc65151dc0 2024-09-19T06:17:22.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.665+0000 7f2b00e24740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55dc6515f420 con 0x55dc651514a0 2024-09-19T06:17:22.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.665+0000 7f2b00e24740 10 client.0 _ll_register_callbacks cb 0x55dc650b2160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:22.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.666+0000 7f2afcfe8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc6515c680 0x55dc65164f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:22.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.666+0000 7f2afcfe8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc6515c680 0x55dc65164f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56976/0 (socket says 172.21.15.2:56976) 2024-09-19T06:17:22.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.666+0000 7f2afcfe8640 1 -- 172.21.15.2:0/2718958941 learned_addr learned my addr 172.21.15.2:0/2718958941 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:22.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.666+0000 7f2af7fff640 1 --2- 172.21.15.2:0/2718958941 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc651514a0 0x55dc65160870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:22.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.666+0000 7f2afcfe8640 1 -- 172.21.15.2:0/2718958941 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc651514a0 msgr2=0x55dc65160870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:22.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.666+0000 7f2afcfe8640 1 --2- 172.21.15.2:0/2718958941 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc651514a0 0x55dc65160870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:22.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.666+0000 7f2afcfe8640 1 -- 172.21.15.2:0/2718958941 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dc65151dc0 msgr2=0x55dc65160db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:22.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.666+0000 7f2afcfe8640 1 --2- 172.21.15.2:0/2718958941 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dc65151dc0 0x55dc65160db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:22.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.666+0000 7f2afcfe8640 1 -- 172.21.15.2:0/2718958941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc64e283c0 con 0x55dc6515c680 2024-09-19T06:17:22.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.666+0000 7f2afcfe8640 1 --2- 172.21.15.2:0/2718958941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc6515c680 0x55dc65164f20 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f2af0006010 tx=0x7f2af00096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33ba070b25616289 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:22.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.666+0000 7f2ad77fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:17:22.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.667+0000 7f2ad77fe640 1 -- 172.21.15.2:0/2718958941 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af0025070 con 0x55dc6515c680 2024-09-19T06:17:22.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.667+0000 7f2ad77fe640 1 -- 172.21.15.2:0/2718958941 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f2af001f470 con 0x55dc6515c680 2024-09-19T06:17:22.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.667+0000 7f2b00e24740 1 -- 172.21.15.2:0/2718958941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ae80046c0 con 0x55dc6515c680 2024-09-19T06:17:22.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.667+0000 7f2ad77fe640 1 -- 172.21.15.2:0/2718958941 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2af000ee20 con 0x55dc6515c680 2024-09-19T06:17:22.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.667+0000 7f2b00e24740 10 client.15954 fetch_fsmap learned FSMap version 26 2024-09-19T06:17:22.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.667+0000 7f2b00e24740 1 -- 172.21.15.2:0/2718958941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55dc6516f020 con 0x55dc6515c680 2024-09-19T06:17:22.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.668+0000 7f2ad77fe640 1 -- 172.21.15.2:0/2718958941 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2ae80046c0 con 0x55dc6515c680 2024-09-19T06:17:22.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.668+0000 7f2ad77fe640 1 -- 172.21.15.2:0/2718958941 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f2af001d040 con 0x55dc6515c680 2024-09-19T06:17:22.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.668+0000 7f2b00e24740 10 client.15954 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:17:22.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.668+0000 7f2b00e24740 10 client.15954 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:17:22.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.668+0000 7f2b00e24740 20 client.15954 populate_metadata read hostname 'smithi002' 2024-09-19T06:17:22.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.668+0000 7f2b00e24740 1 --2- 172.21.15.2:0/2718958941 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55dc65170580 0x55dc65172a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:22.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.668+0000 7f2b00e24740 4 client.15954 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:17:22.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.668+0000 7f2b00e24740 1 -- 172.21.15.2:0/2718958941 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc650c4850 con 0x55dc65170580 2024-09-19T06:17:22.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.669+0000 7f2af7fff640 1 --2- 172.21.15.2:0/2718958941 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55dc65170580 0x55dc65172a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:22.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.670+0000 7f2ad77fe640 10 client.15954 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:17:22.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.670+0000 7f2af7fff640 1 --2- 172.21.15.2:0/2718958941 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55dc65170580 0x55dc65172a20 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ceead49ffab54b8 server_cookie=4cee10180f0e4472 in_seq=0 out_seq=0 2024-09-19T06:17:22.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.672+0000 7f2ad77fe640 1 -- 172.21.15.2:0/2718958941 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dc650c4850 con 0x55dc65170580 2024-09-19T06:17:22.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.672+0000 7f2ad77fe640 10 client.15954 handle_command_reply: tid=0 2024-09-19T06:17:22.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.672+0000 7f2b00e24740 1 client.15954 shutdown 2024-09-19T06:17:22.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.673+0000 7f2b00e24740 1 -- 172.21.15.2:0/2718958941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc6515c680 msgr2=0x55dc65164f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:22.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.673+0000 7f2b00e24740 1 --2- 172.21.15.2:0/2718958941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc6515c680 0x55dc65164f20 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f2af0006010 tx=0x7f2af00096c0 comp rx=0 tx=0).stop 2024-09-19T06:17:22.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.673+0000 7f2b00e24740 1 -- 172.21.15.2:0/2718958941 shutdown_connections 2024-09-19T06:17:22.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.673+0000 7f2b00e24740 1 --2- 172.21.15.2:0/2718958941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc6515c680 0x55dc65164f20 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:22.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.673+0000 7f2b00e24740 1 --2- 172.21.15.2:0/2718958941 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55dc65170580 0x55dc65172a20 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:22.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.673+0000 7f2ad77fe640 0 client.15954 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:17:22.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.673+0000 7f2b00e24740 1 --2- 172.21.15.2:0/2718958941 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dc65151dc0 0x55dc65160db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:22.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.673+0000 7f2b00e24740 1 --2- 172.21.15.2:0/2718958941 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc651514a0 0x55dc65160870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:22.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.673+0000 7f2b00e24740 1 -- 172.21.15.2:0/2718958941 >> 172.21.15.2:0/2718958941 conn(0x55dc6514da30 msgr2=0x55dc65153760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:22.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.673+0000 7f2b00e24740 1 -- 172.21.15.2:0/2718958941 shutdown_connections 2024-09-19T06:17:22.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.674+0000 7f2b00e24740 1 -- 172.21.15.2:0/2718958941 wait complete. 2024-09-19T06:17:22.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.674+0000 7f2b00e24740 20 client.15954 trim_cache size 0 max 16384 2024-09-19T06:17:22.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.706+0000 7f2b00e24740 1 Processor -- start 2024-09-19T06:17:22.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.706+0000 7f2b00e24740 1 -- start start 2024-09-19T06:17:22.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.706+0000 7f2b00e24740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dc651514a0 0x55dc65164f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:22.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.706+0000 7f2b00e24740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc65151dc0 0x55dc651782f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:22.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.706+0000 7f2b00e24740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc6515c680 0x55dc65178830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:22.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.706+0000 7f2b00e24740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad8010f40 con 0x55dc65151dc0 2024-09-19T06:17:22.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.706+0000 7f2b00e24740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad800e810 con 0x55dc651514a0 2024-09-19T06:17:22.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.706+0000 7f2b00e24740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad800c660 con 0x55dc6515c680 2024-09-19T06:17:22.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.706+0000 7f2aeffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc65151dc0 0x55dc651782f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:22.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.707+0000 7f2aeffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc65151dc0 0x55dc651782f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56984/0 (socket says 172.21.15.2:56984) 2024-09-19T06:17:22.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.707+0000 7f2aeffff640 1 -- 172.21.15.2:0/677083354 learned_addr learned my addr 172.21.15.2:0/677083354 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:22.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.707+0000 7f2af7fff640 1 --2- 172.21.15.2:0/677083354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dc651514a0 0x55dc65164f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:22.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.707+0000 7f2afcfe8640 1 --2- 172.21.15.2:0/677083354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc6515c680 0x55dc65178830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:22.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.707+0000 7f2aeffff640 1 -- 172.21.15.2:0/677083354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc6515c680 msgr2=0x55dc65178830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:22.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.707+0000 7f2aeffff640 1 --2- 172.21.15.2:0/677083354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc6515c680 0x55dc65178830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:22.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.707+0000 7f2aeffff640 1 -- 172.21.15.2:0/677083354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dc651514a0 msgr2=0x55dc65164f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:22.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.707+0000 7f2aeffff640 1 --2- 172.21.15.2:0/677083354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dc651514a0 0x55dc65164f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:22.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.707+0000 7f2aeffff640 1 -- 172.21.15.2:0/677083354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc6514d860 con 0x55dc65151dc0 2024-09-19T06:17:22.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.707+0000 7f2aeffff640 1 --2- 172.21.15.2:0/677083354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc65151dc0 0x55dc651782f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f2ae00cc8f0 tx=0x7f2ae000bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fab81f79b1585a94 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:22.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.707+0000 7f2aedffb640 1 -- 172.21.15.2:0/677083354 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae0014040 con 0x55dc65151dc0 2024-09-19T06:17:22.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.708+0000 7f2aedffb640 1 -- 172.21.15.2:0/677083354 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2ae009f340 con 0x55dc65151dc0 2024-09-19T06:17:22.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.708+0000 7f2aedffb640 1 -- 172.21.15.2:0/677083354 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae00a3770 con 0x55dc65151dc0 2024-09-19T06:17:22.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.708+0000 7f2b00e24740 1 -- 172.21.15.2:0/677083354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc65151dc0 msgr2=0x55dc651782f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:22.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.708+0000 7f2b00e24740 1 --2- 172.21.15.2:0/677083354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc65151dc0 0x55dc651782f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f2ae00cc8f0 tx=0x7f2ae000bf90 comp rx=0 tx=0).stop 2024-09-19T06:17:22.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.708+0000 7f2b00e24740 1 -- 172.21.15.2:0/677083354 shutdown_connections 2024-09-19T06:17:22.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.708+0000 7f2b00e24740 1 --2- 172.21.15.2:0/677083354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc6515c680 0x55dc65178830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:22.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.708+0000 7f2b00e24740 1 --2- 172.21.15.2:0/677083354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc65151dc0 0x55dc651782f0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:22.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.708+0000 7f2b00e24740 1 --2- 172.21.15.2:0/677083354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dc651514a0 0x55dc65164f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:22.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.708+0000 7f2b00e24740 1 -- 172.21.15.2:0/677083354 >> 172.21.15.2:0/677083354 conn(0x55dc6514da30 msgr2=0x55dc6514cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:22.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.709+0000 7f2b00e24740 1 -- 172.21.15.2:0/677083354 shutdown_connections 2024-09-19T06:17:22.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.709+0000 7f2b00e24740 1 -- 172.21.15.2:0/677083354 wait complete. 2024-09-19T06:17:22.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.709+0000 7f2b00e24740 1 -- start start 2024-09-19T06:17:22.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.710+0000 7f2b00e24740 1 Processor -- start 2024-09-19T06:17:22.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.712+0000 7f2b00e24740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dc651514a0 0x55dc6516cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:22.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.712+0000 7f2b00e24740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc65151dc0 0x55dc65168f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:22.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.712+0000 7f2b00e24740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc6515c680 0x55dc651694b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:22.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.712+0000 7f2b00e24740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad800ccd0 con 0x55dc6515c680 2024-09-19T06:17:22.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.712+0000 7f2b00e24740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad800e140 con 0x55dc651514a0 2024-09-19T06:17:22.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.712+0000 7f2b00e24740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad800d3a0 con 0x55dc65151dc0 2024-09-19T06:17:22.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.712+0000 7f2b00e24740 10 client.0 _ll_register_callbacks cb 0x7f2af0009520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:22.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.712+0000 7f2af7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dc651514a0 0x55dc6516cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:22.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.713+0000 7f2af7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dc651514a0 0x55dc6516cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:56504/0 (socket says 172.21.15.2:56504) 2024-09-19T06:17:22.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.712+0000 7f2afcfe8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc6515c680 0x55dc651694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:22.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.713+0000 7f2af7fff640 1 -- 172.21.15.2:0/207142888 learned_addr learned my addr 172.21.15.2:0/207142888 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:22.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.713+0000 7f2aeffff640 1 --2- 172.21.15.2:0/207142888 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc65151dc0 0x55dc65168f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:22.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.713+0000 7f2afcfe8640 1 -- 172.21.15.2:0/207142888 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc65151dc0 msgr2=0x55dc65168f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:22.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.713+0000 7f2afcfe8640 1 --2- 172.21.15.2:0/207142888 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc65151dc0 0x55dc65168f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:22.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.713+0000 7f2afcfe8640 1 -- 172.21.15.2:0/207142888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dc651514a0 msgr2=0x55dc6516cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:22.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.713+0000 7f2afcfe8640 1 --2- 172.21.15.2:0/207142888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dc651514a0 0x55dc6516cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:22.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.713+0000 7f2afcfe8640 1 -- 172.21.15.2:0/207142888 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc65161120 con 0x55dc6515c680 2024-09-19T06:17:22.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.713+0000 7f2aeffff640 1 --2- 172.21.15.2:0/207142888 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc65151dc0 0x55dc65168f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:22.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.714+0000 7f2afcfe8640 1 --2- 172.21.15.2:0/207142888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc6515c680 0x55dc651694b0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f2af000e3e0 tx=0x7f2af0004230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98f13007a14e62bd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:22.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.714+0000 7f2ad77fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:17:22.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.714+0000 7f2ad77fe640 1 -- 172.21.15.2:0/207142888 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af0039060 con 0x55dc6515c680 2024-09-19T06:17:22.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.714+0000 7f2ad77fe640 1 -- 172.21.15.2:0/207142888 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f2af0003d80 con 0x55dc6515c680 2024-09-19T06:17:22.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.715+0000 7f2b00e24740 1 -- 172.21.15.2:0/207142888 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ae009f340 con 0x55dc6515c680 2024-09-19T06:17:22.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.715+0000 7f2ad77fe640 1 -- 172.21.15.2:0/207142888 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2af0025040 con 0x55dc6515c680 2024-09-19T06:17:22.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.715+0000 7f2b00e24740 10 client.15960 fetch_fsmap learned FSMap version 26 2024-09-19T06:17:22.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.715+0000 7f2b00e24740 1 -- 172.21.15.2:0/207142888 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55dc651dbf00 con 0x55dc6515c680 2024-09-19T06:17:22.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.716+0000 7f2ad77fe640 1 -- 172.21.15.2:0/207142888 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2ae009f340 con 0x55dc6515c680 2024-09-19T06:17:22.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.716+0000 7f2ad77fe640 1 -- 172.21.15.2:0/207142888 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f2af002a440 con 0x55dc6515c680 2024-09-19T06:17:22.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.716+0000 7f2b00e24740 10 client.15960 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:17:22.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.716+0000 7f2b00e24740 10 client.15960 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:17:22.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.716+0000 7f2b00e24740 20 client.15960 populate_metadata read hostname 'smithi002' 2024-09-19T06:17:22.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.716+0000 7f2b00e24740 1 --2- 172.21.15.2:0/207142888 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55dc65170580 0x55dc651de580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:22.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.716+0000 7f2b00e24740 4 client.15960 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:17:22.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.716+0000 7f2b00e24740 1 -- 172.21.15.2:0/207142888 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55dc650bed60 con 0x55dc65170580 2024-09-19T06:17:22.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.718+0000 7f2af7fff640 1 --2- 172.21.15.2:0/207142888 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55dc65170580 0x55dc651de580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:22.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.720+0000 7f2af7fff640 1 --2- 172.21.15.2:0/207142888 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55dc65170580 0x55dc651de580 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48dcf869a2ff1c55 server_cookie=e45d1d27a8d9604c in_seq=0 out_seq=0 2024-09-19T06:17:22.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.720+0000 7f2ad77fe640 10 client.15960 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:17:22.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.720+0000 7f2ad77fe640 1 -- 172.21.15.2:0/207142888 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55dc650bed60 con 0x55dc65170580 2024-09-19T06:17:22.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.720+0000 7f2ad77fe640 10 client.15960 handle_command_reply: tid=0 2024-09-19T06:17:22.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.720+0000 7f2b00e24740 1 client.15960 shutdown 2024-09-19T06:17:22.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.721+0000 7f2b00e24740 1 -- 172.21.15.2:0/207142888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc6515c680 msgr2=0x55dc651694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:22.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.721+0000 7f2b00e24740 1 --2- 172.21.15.2:0/207142888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc6515c680 0x55dc651694b0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f2af000e3e0 tx=0x7f2af0004230 comp rx=0 tx=0).stop 2024-09-19T06:17:22.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.721+0000 7f2b00e24740 1 -- 172.21.15.2:0/207142888 shutdown_connections 2024-09-19T06:17:22.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.721+0000 7f2b00e24740 1 --2- 172.21.15.2:0/207142888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc6515c680 0x55dc651694b0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:22.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.721+0000 7f2b00e24740 1 --2- 172.21.15.2:0/207142888 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc65151dc0 0x55dc65168f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:22.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.721+0000 7f2b00e24740 1 --2- 172.21.15.2:0/207142888 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55dc65170580 0x55dc651de580 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:22.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.721+0000 7f2ad77fe640 0 client.15960 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:17:22.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.721+0000 7f2b00e24740 1 --2- 172.21.15.2:0/207142888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dc651514a0 0x55dc6516cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:22.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.721+0000 7f2b00e24740 1 -- 172.21.15.2:0/207142888 >> 172.21.15.2:0/207142888 conn(0x55dc6514da30 msgr2=0x55dc65152ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:22.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.721+0000 7f2b00e24740 1 -- 172.21.15.2:0/207142888 shutdown_connections 2024-09-19T06:17:22.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.722+0000 7f2b00e24740 1 -- 172.21.15.2:0/207142888 wait complete. 2024-09-19T06:17:22.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.722+0000 7f2b00e24740 20 client.15960 trim_cache size 0 max 16384 2024-09-19T06:17:22.727 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:17:22.727 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T06:17:22.727 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T06:17:22.727 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:17:22.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.723+0000 7f2afea4b640 1 -- 172.21.15.2:0/1601015725 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f2ae40a35b0 msgr2=0x7f2ae40a5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:22.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.723+0000 7f2afea4b640 1 --2- 172.21.15.2:0/1601015725 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f2ae40a35b0 0x7f2ae40a5a70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2af0005c40 tx=0x7f2af0009960 comp rx=0 tx=0).stop 2024-09-19T06:17:22.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.723+0000 7f2afea4b640 1 -- 172.21.15.2:0/1601015725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2af8101420 msgr2=0x7f2af8196790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:22.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.723+0000 7f2afea4b640 1 --2- 172.21.15.2:0/1601015725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2af8101420 0x7f2af8196790 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f2ae000b4a0 tx=0x7f2ae000b960 comp rx=0 tx=0).stop 2024-09-19T06:17:22.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.723+0000 7f2afea4b640 1 -- 172.21.15.2:0/1601015725 shutdown_connections 2024-09-19T06:17:22.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.723+0000 7f2afea4b640 1 --2- 172.21.15.2:0/1601015725 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f2ae40a35b0 0x7f2ae40a5a70 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:22.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.723+0000 7f2afea4b640 1 --2- 172.21.15.2:0/1601015725 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2af8106a80 0x7f2af819ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:22.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.723+0000 7f2afea4b640 1 --2- 172.21.15.2:0/1601015725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2af8101420 0x7f2af8196790 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:22.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.723+0000 7f2afea4b640 1 --2- 172.21.15.2:0/1601015725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2af8100a80 0x7f2af8196250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:22.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.723+0000 7f2afea4b640 1 -- 172.21.15.2:0/1601015725 >> 172.21.15.2:0/1601015725 conn(0x7f2af80fc7a0 msgr2=0x7f2af80fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:22.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.724+0000 7f2afea4b640 1 -- 172.21.15.2:0/1601015725 shutdown_connections 2024-09-19T06:17:22.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:22.724+0000 7f2afea4b640 1 -- 172.21.15.2:0/1601015725 wait complete. 2024-09-19T06:17:23.473 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:17:23 smithi002 ceph-mon[30982]: pgmap v80: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 336 MiB/s wr, 92 op/s 2024-09-19T06:17:23.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:17:23 smithi089 ceph-mon[34160]: pgmap v80: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 336 MiB/s wr, 92 op/s 2024-09-19T06:17:23.612 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:17:23.612 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:17:23.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:17:23 smithi090 ceph-mon[34497]: pgmap v80: 97 pgs: 97 active+clean; 11 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 336 MiB/s wr, 92 op/s 2024-09-19T06:17:24.071 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:17:24.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:24.672+0000 7fa38d53d640 1 -- 172.21.15.2:0/1977441997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa388102570 msgr2=0x7fa3881029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:24.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:24.672+0000 7fa38d53d640 1 --2- 172.21.15.2:0/1977441997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa388102570 0x7fa3881029b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fa37c009900 tx=0x7fa37c02a480 comp rx=0 tx=0).stop 2024-09-19T06:17:24.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:24.672+0000 7fa38d53d640 1 -- 172.21.15.2:0/1977441997 shutdown_connections 2024-09-19T06:17:24.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:24.672+0000 7fa38d53d640 1 --2- 172.21.15.2:0/1977441997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa388102ef0 0x7fa38810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:24.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:24.672+0000 7fa38d53d640 1 --2- 172.21.15.2:0/1977441997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa388102570 0x7fa3881029b0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:24.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:24.672+0000 7fa38d53d640 1 --2- 172.21.15.2:0/1977441997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa388100e20 0x7fa388101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:24.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:24.672+0000 7fa38d53d640 1 -- 172.21.15.2:0/1977441997 >> 172.21.15.2:0/1977441997 conn(0x7fa3880fc7d0 msgr2=0x7fa3880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:24.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:24.673+0000 7fa38d53d640 1 -- 172.21.15.2:0/1977441997 shutdown_connections 2024-09-19T06:17:24.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:24.673+0000 7fa38d53d640 1 -- 172.21.15.2:0/1977441997 wait complete. 2024-09-19T06:17:24.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:24.674+0000 7fa38d53d640 1 Processor -- start 2024-09-19T06:17:24.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:24.675+0000 7fa38d53d640 1 -- start start 2024-09-19T06:17:24.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:24.675+0000 7fa38d53d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa388100e20 0x7fa3880fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:24.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:24.675+0000 7fa38d53d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa388102570 0x7fa3880fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:24.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:24.675+0000 7fa38d53d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa388102ef0 0x7fa3880fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:24.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:24.675+0000 7fa38d53d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa388110ea0 con 0x7fa388102570 2024-09-19T06:17:24.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:24.675+0000 7fa38d53d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa388110d20 con 0x7fa388102ef0 2024-09-19T06:17:24.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:24.675+0000 7fa38d53d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa388111020 con 0x7fa388100e20 2024-09-19T06:17:24.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:24.676+0000 7fa3877fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa388102ef0 0x7fa3880fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:24.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:24.676+0000 7fa3877fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa388102ef0 0x7fa3880fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:56520/0 (socket says 172.21.15.2:56520) 2024-09-19T06:17:24.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:24.676+0000 7fa3877fe640 1 -- 172.21.15.2:0/1999511502 learned_addr learned my addr 172.21.15.2:0/1999511502 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:24.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:24.676+0000 7fa3867fc640 1 --2- 172.21.15.2:0/1999511502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa388102570 0x7fa3880fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:24.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:24.676+0000 7fa3877fe640 1 -- 172.21.15.2:0/1999511502 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa388100e20 msgr2=0x7fa3880fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:24.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:24.676+0000 7fa3877fe640 1 --2- 172.21.15.2:0/1999511502 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa388100e20 0x7fa3880fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:24.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:24.676+0000 7fa3877fe640 1 -- 172.21.15.2:0/1999511502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa388102570 msgr2=0x7fa3880fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:24.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:24.676+0000 7fa3877fe640 1 --2- 172.21.15.2:0/1999511502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa388102570 0x7fa3880fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:24.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:24.676+0000 7fa3877fe640 1 -- 172.21.15.2:0/1999511502 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3881aadb0 con 0x7fa388102ef0 2024-09-19T06:17:24.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:24.677+0000 7fa3867fc640 1 --2- 172.21.15.2:0/1999511502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa388102570 0x7fa3880fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:17:24.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:24.677+0000 7fa3877fe640 1 --2- 172.21.15.2:0/1999511502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa388102ef0 0x7fa3880fd700 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa38000cce0 tx=0x7fa38000a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:24.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:24.677+0000 7fa36ffff640 1 -- 172.21.15.2:0/1999511502 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38000f450 con 0x7fa388102ef0 2024-09-19T06:17:24.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:24.677+0000 7fa38d53d640 1 -- 172.21.15.2:0/1999511502 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3881aafe0 con 0x7fa388102ef0 2024-09-19T06:17:24.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:24.677+0000 7fa36ffff640 1 -- 172.21.15.2:0/1999511502 <== mon.2 v2:172.21.15.89:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa38000faa0 con 0x7fa388102ef0 2024-09-19T06:17:24.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:24.677+0000 7fa36ffff640 1 -- 172.21.15.2:0/1999511502 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa380018be0 con 0x7fa388102ef0 2024-09-19T06:17:24.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:24.677+0000 7fa38d53d640 1 -- 172.21.15.2:0/1999511502 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3881ab440 con 0x7fa388102ef0 2024-09-19T06:17:24.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:24.679+0000 7fa38d53d640 1 -- 172.21.15.2:0/1999511502 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3881021b0 con 0x7fa388102ef0 2024-09-19T06:17:24.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:24.681+0000 7fa36ffff640 1 -- 172.21.15.2:0/1999511502 <== mon.2 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fa38000fc50 con 0x7fa388102ef0 2024-09-19T06:17:24.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:24.682+0000 7fa36ffff640 1 --2- 172.21.15.2:0/1999511502 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa3700a3430 0x7fa3700a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:24.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:24.682+0000 7fa36ffff640 1 -- 172.21.15.2:0/1999511502 <== mon.2 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fa3800d0450 con 0x7fa388102ef0 2024-09-19T06:17:24.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:24.683+0000 7fa386ffd640 1 --2- 172.21.15.2:0/1999511502 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa3700a3430 0x7fa3700a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:24.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:24.683+0000 7fa386ffd640 1 --2- 172.21.15.2:0/1999511502 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa3700a3430 0x7fa3700a58f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa378009710 tx=0x7fa378006c90 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:24.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:24.685+0000 7fa36ffff640 1 -- 172.21.15.2:0/1999511502 <== mon.2 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa380014030 con 0x7fa388102ef0 2024-09-19T06:17:24.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.702+0000 7fd732cb7640 1 -- 172.21.15.2:0/2062128275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd72c108360 msgr2=0x7fd72c108740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:24.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.702+0000 7fd732cb7640 1 --2- 172.21.15.2:0/2062128275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd72c108360 0x7fd72c108740 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fd728009900 tx=0x7fd72802a3f0 comp rx=0 tx=0).stop 2024-09-19T06:17:24.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.702+0000 7fd732cb7640 1 -- 172.21.15.2:0/2062128275 shutdown_connections 2024-09-19T06:17:24.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.702+0000 7fd732cb7640 1 --2- 172.21.15.2:0/2062128275 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd72c10d4b0 0x7fd72c115000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:24.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.702+0000 7fd732cb7640 1 --2- 172.21.15.2:0/2062128275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd72c108d10 0x7fd72c10cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:24.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.702+0000 7fd732cb7640 1 --2- 172.21.15.2:0/2062128275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd72c108360 0x7fd72c108740 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:24.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.702+0000 7fd732cb7640 1 -- 172.21.15.2:0/2062128275 >> 172.21.15.2:0/2062128275 conn(0x7fd72c077ad0 msgr2=0x7fd72c079ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:24.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.702+0000 7fd732cb7640 1 -- 172.21.15.2:0/2062128275 shutdown_connections 2024-09-19T06:17:24.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.702+0000 7fd732cb7640 1 -- 172.21.15.2:0/2062128275 wait complete. 2024-09-19T06:17:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.704+0000 7fd732cb7640 1 Processor -- start 2024-09-19T06:17:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.704+0000 7fd732cb7640 1 -- start start 2024-09-19T06:17:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.705+0000 7fd732cb7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd72c108360 0x7fd72c1a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.705+0000 7fd732cb7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd72c10d4b0 0x7fd72c1a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.705+0000 7fd732cb7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd72c19e820 0x7fd72c19ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.705+0000 7fd732cb7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd72c118450 con 0x7fd72c10d4b0 2024-09-19T06:17:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.705+0000 7fd732cb7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd72c1182d0 con 0x7fd72c19e820 2024-09-19T06:17:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.705+0000 7fd732cb7640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd72c1185d0 con 0x7fd72c108360 2024-09-19T06:17:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.705+0000 7fd723fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd72c10d4b0 0x7fd72c1a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.705+0000 7fd723fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd72c10d4b0 0x7fd72c1a4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57024/0 (socket says 172.21.15.2:57024) 2024-09-19T06:17:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.705+0000 7fd723fff640 1 -- 172.21.15.2:0/2926105363 learned_addr learned my addr 172.21.15.2:0/2926105363 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.705+0000 7fd730a53640 1 --2- 172.21.15.2:0/2926105363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd72c108360 0x7fd72c1a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:24.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.705+0000 7fd723fff640 1 -- 172.21.15.2:0/2926105363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd72c108360 msgr2=0x7fd72c1a46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:24.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.705+0000 7fd723fff640 1 --2- 172.21.15.2:0/2926105363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd72c108360 0x7fd72c1a46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:24.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.705+0000 7fd723fff640 1 -- 172.21.15.2:0/2926105363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd72c19e820 msgr2=0x7fd72c19ecd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:17:24.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.705+0000 7fd723fff640 1 --2- 172.21.15.2:0/2926105363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd72c19e820 0x7fd72c19ecd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:24.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.705+0000 7fd723fff640 1 -- 172.21.15.2:0/2926105363 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd72c19f3b0 con 0x7fd72c10d4b0 2024-09-19T06:17:24.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.706+0000 7fd723fff640 1 --2- 172.21.15.2:0/2926105363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd72c10d4b0 0x7fd72c1a4bf0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fd71c00d770 tx=0x7fd71c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:24.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.706+0000 7fd721ffb640 1 -- 172.21.15.2:0/2926105363 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd71c017070 con 0x7fd72c10d4b0 2024-09-19T06:17:24.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.706+0000 7fd732cb7640 1 -- 172.21.15.2:0/2926105363 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd72c19f6a0 con 0x7fd72c10d4b0 2024-09-19T06:17:24.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.706+0000 7fd732cb7640 1 -- 172.21.15.2:0/2926105363 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd72c1ab8d0 con 0x7fd72c10d4b0 2024-09-19T06:17:24.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.706+0000 7fd721ffb640 1 -- 172.21.15.2:0/2926105363 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd71c009c30 con 0x7fd72c10d4b0 2024-09-19T06:17:24.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.706+0000 7fd721ffb640 1 -- 172.21.15.2:0/2926105363 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd71c021060 con 0x7fd72c10d4b0 2024-09-19T06:17:24.712 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.710+0000 7fd735a50740 1 Processor -- start 2024-09-19T06:17:24.712 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.710+0000 7fd721ffb640 1 -- 172.21.15.2:0/2926105363 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fd71c01a070 con 0x7fd72c10d4b0 2024-09-19T06:17:24.712 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.710+0000 7fd735a50740 1 -- start start 2024-09-19T06:17:24.713 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.711+0000 7fd735a50740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56380061aaf0 0x56380061aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:24.713 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.711+0000 7fd735a50740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56380061b410 0x563800625770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:24.713 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.711+0000 7fd735a50740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563800625cb0 0x5638006280a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:24.713 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.711+0000 7fd735a50740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56380057f2f0 con 0x56380061b410 2024-09-19T06:17:24.713 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.711+0000 7fd735a50740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563800527270 con 0x56380061aaf0 2024-09-19T06:17:24.713 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.711+0000 7fd735a50740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56380057b2b0 con 0x563800625cb0 2024-09-19T06:17:24.713 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.711+0000 7fd730a53640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56380061b410 0x563800625770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:24.713 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.711+0000 7fd730a53640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56380061b410 0x563800625770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57032/0 (socket says 172.21.15.2:57032) 2024-09-19T06:17:24.713 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.711+0000 7fd723fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563800625cb0 0x5638006280a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:24.713 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.711+0000 7fd730a53640 1 -- 172.21.15.2:0/702907336 learned_addr learned my addr 172.21.15.2:0/702907336 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:24.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.712+0000 7fd731254640 1 --2- 172.21.15.2:0/702907336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56380061aaf0 0x56380061aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:24.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.712+0000 7fd730a53640 1 -- 172.21.15.2:0/702907336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563800625cb0 msgr2=0x5638006280a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:24.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.712+0000 7fd730a53640 1 --2- 172.21.15.2:0/702907336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563800625cb0 0x5638006280a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:24.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.712+0000 7fd721ffb640 1 --2- 172.21.15.2:0/2926105363 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fd7140a33b0 0x7fd7140a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:24.715 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.712+0000 7fd730a53640 1 -- 172.21.15.2:0/702907336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56380061aaf0 msgr2=0x56380061aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:24.715 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.712+0000 7fd730a53640 1 --2- 172.21.15.2:0/702907336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56380061aaf0 0x56380061aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:24.715 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.712+0000 7fd730a53640 1 -- 172.21.15.2:0/702907336 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563800526340 con 0x56380061b410 2024-09-19T06:17:24.715 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.712+0000 7fd731254640 1 --2- 172.21.15.2:0/2926105363 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fd7140a33b0 0x7fd7140a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:24.715 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.712+0000 7fd721ffb640 1 -- 172.21.15.2:0/2926105363 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fd71c0cf860 con 0x7fd72c10d4b0 2024-09-19T06:17:24.715 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.713+0000 7fd730a53640 1 --2- 172.21.15.2:0/702907336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56380061b410 0x563800625770 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd728009230 tx=0x7fd728004390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c92935263c384f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:24.715 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.713+0000 7fd731254640 1 --2- 172.21.15.2:0/2926105363 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fd7140a33b0 0x7fd7140a5870 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd724002040 tx=0x7fd724009040 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:24.715 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.714+0000 7fd712ffd640 1 -- 172.21.15.2:0/702907336 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd728035030 con 0x56380061b410 2024-09-19T06:17:24.716 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.714+0000 7fd712ffd640 1 -- 172.21.15.2:0/702907336 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd7280046c0 con 0x56380061b410 2024-09-19T06:17:24.716 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.714+0000 7fd712ffd640 1 -- 172.21.15.2:0/702907336 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd728003850 con 0x56380061b410 2024-09-19T06:17:24.716 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.715+0000 7fd735a50740 1 -- 172.21.15.2:0/702907336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56380061b410 msgr2=0x563800625770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.715+0000 7fd735a50740 1 --2- 172.21.15.2:0/702907336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56380061b410 0x563800625770 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd728009230 tx=0x7fd728004390 comp rx=0 tx=0).stop 2024-09-19T06:17:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.715+0000 7fd735a50740 1 -- 172.21.15.2:0/702907336 shutdown_connections 2024-09-19T06:17:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.715+0000 7fd735a50740 1 --2- 172.21.15.2:0/702907336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563800625cb0 0x5638006280a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.715+0000 7fd735a50740 1 --2- 172.21.15.2:0/702907336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56380061b410 0x563800625770 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.715+0000 7fd735a50740 1 --2- 172.21.15.2:0/702907336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56380061aaf0 0x56380061aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.715+0000 7fd735a50740 1 -- 172.21.15.2:0/702907336 >> 172.21.15.2:0/702907336 conn(0x563800617060 msgr2=0x563800617440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.715+0000 7fd735a50740 1 -- 172.21.15.2:0/702907336 shutdown_connections 2024-09-19T06:17:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.715+0000 7fd735a50740 1 -- 172.21.15.2:0/702907336 wait complete. 2024-09-19T06:17:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.715+0000 7fd735a50740 1 -- start start 2024-09-19T06:17:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.715+0000 7fd735a50740 1 Processor -- start 2024-09-19T06:17:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.716+0000 7fd735a50740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56380061aaf0 0x563800622ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.716+0000 7fd735a50740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56380061b410 0x5638006230e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.716+0000 7fd735a50740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563800625cb0 0x563800623620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.716+0000 7fd735a50740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563800628880 con 0x563800625cb0 2024-09-19T06:17:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.716+0000 7fd735a50740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563800508290 con 0x56380061aaf0 2024-09-19T06:17:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.716+0000 7fd735a50740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x563800628a00 con 0x56380061b410 2024-09-19T06:17:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.716+0000 7fd735a50740 10 client.0 _ll_register_callbacks cb 0x563800539140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.716+0000 7fd731254640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563800625cb0 0x563800623620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.716+0000 7fd731254640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563800625cb0 0x563800623620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57036/0 (socket says 172.21.15.2:57036) 2024-09-19T06:17:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.716+0000 7fd731254640 1 -- 172.21.15.2:0/673248738 learned_addr learned my addr 172.21.15.2:0/673248738 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.717+0000 7fd730a53640 1 --2- 172.21.15.2:0/673248738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56380061aaf0 0x563800622ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.717+0000 7fd731254640 1 -- 172.21.15.2:0/673248738 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56380061b410 msgr2=0x5638006230e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.717+0000 7fd731254640 1 --2- 172.21.15.2:0/673248738 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56380061b410 0x5638006230e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.717+0000 7fd731254640 1 -- 172.21.15.2:0/673248738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56380061aaf0 msgr2=0x563800622ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.717+0000 7fd731254640 1 --2- 172.21.15.2:0/673248738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56380061aaf0 0x563800622ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.717+0000 7fd731254640 1 -- 172.21.15.2:0/673248738 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563800292210 con 0x563800625cb0 2024-09-19T06:17:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.717+0000 7fd730a53640 1 --2- 172.21.15.2:0/673248738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56380061aaf0 0x563800622ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:17:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.717+0000 7fd731254640 1 --2- 172.21.15.2:0/673248738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563800625cb0 0x563800623620 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd724001930 tx=0x7fd724001890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57ffc45451675eca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.717+0000 7fd70bfff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:17:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.717+0000 7fd70bfff640 1 -- 172.21.15.2:0/673248738 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd724025060 con 0x563800625cb0 2024-09-19T06:17:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.718+0000 7fd735a50740 1 -- 172.21.15.2:0/673248738 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7280046c0 con 0x563800625cb0 2024-09-19T06:17:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.718+0000 7fd70bfff640 1 -- 172.21.15.2:0/673248738 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fd724020410 con 0x563800625cb0 2024-09-19T06:17:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.718+0000 7fd70bfff640 1 -- 172.21.15.2:0/673248738 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd724010040 con 0x563800625cb0 2024-09-19T06:17:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.718+0000 7fd735a50740 10 client.15978 fetch_fsmap learned FSMap version 26 2024-09-19T06:17:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.718+0000 7fd735a50740 1 -- 172.21.15.2:0/673248738 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56380035e620 con 0x563800625cb0 2024-09-19T06:17:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.718+0000 7fd70bfff640 1 -- 172.21.15.2:0/673248738 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd7280046c0 con 0x563800625cb0 2024-09-19T06:17:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.718+0000 7fd70bfff640 1 -- 172.21.15.2:0/673248738 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fd72401f6a0 con 0x563800625cb0 2024-09-19T06:17:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.719+0000 7fd735a50740 10 client.15978 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:17:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.719+0000 7fd735a50740 10 client.15978 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:17:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.719+0000 7fd735a50740 20 client.15978 populate_metadata read hostname 'smithi002' 2024-09-19T06:17:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.719+0000 7fd735a50740 1 --2- 172.21.15.2:0/673248738 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563800635d00 0x563800638190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.719+0000 7fd735a50740 4 client.15978 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:17:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.719+0000 7fd735a50740 1 -- 172.21.15.2:0/673248738 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56380058ca20 con 0x563800635d00 2024-09-19T06:17:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.720+0000 7fd730a53640 1 --2- 172.21.15.2:0/673248738 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563800635d00 0x563800638190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.721+0000 7fd70bfff640 10 client.15978 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:17:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.721+0000 7fd730a53640 1 --2- 172.21.15.2:0/673248738 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563800635d00 0x563800638190 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c708b9b27f8f61bf server_cookie=8a407e83776435de in_seq=0 out_seq=0 2024-09-19T06:17:24.724 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.722+0000 7fd70bfff640 1 -- 172.21.15.2:0/673248738 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56380058ca20 con 0x563800635d00 2024-09-19T06:17:24.724 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.722+0000 7fd70bfff640 10 client.15978 handle_command_reply: tid=0 2024-09-19T06:17:24.724 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.722+0000 7fd735a50740 1 client.15978 shutdown 2024-09-19T06:17:24.724 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.723+0000 7fd735a50740 1 -- 172.21.15.2:0/673248738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563800625cb0 msgr2=0x563800623620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:24.724 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.723+0000 7fd735a50740 1 --2- 172.21.15.2:0/673248738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563800625cb0 0x563800623620 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd724001930 tx=0x7fd724001890 comp rx=0 tx=0).stop 2024-09-19T06:17:24.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.724+0000 7fd735a50740 1 -- 172.21.15.2:0/673248738 shutdown_connections 2024-09-19T06:17:24.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.724+0000 7fd735a50740 1 --2- 172.21.15.2:0/673248738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563800625cb0 0x563800623620 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:24.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.724+0000 7fd735a50740 1 --2- 172.21.15.2:0/673248738 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56380061b410 0x5638006230e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:24.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.724+0000 7fd735a50740 1 --2- 172.21.15.2:0/673248738 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563800635d00 0x563800638190 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:24.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.724+0000 7fd70bfff640 0 client.15978 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:17:24.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.724+0000 7fd735a50740 1 --2- 172.21.15.2:0/673248738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56380061aaf0 0x563800622ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:24.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.724+0000 7fd735a50740 1 -- 172.21.15.2:0/673248738 >> 172.21.15.2:0/673248738 conn(0x563800617060 msgr2=0x56380061cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.725+0000 7fd735a50740 1 -- 172.21.15.2:0/673248738 shutdown_connections 2024-09-19T06:17:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.725+0000 7fd735a50740 1 -- 172.21.15.2:0/673248738 wait complete. 2024-09-19T06:17:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.725+0000 7fd735a50740 20 client.15978 trim_cache size 0 max 16384 2024-09-19T06:17:24.761 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.759+0000 7fd735a50740 1 Processor -- start 2024-09-19T06:17:24.761 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.759+0000 7fd735a50740 1 -- start start 2024-09-19T06:17:24.762 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.760+0000 7fd735a50740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56380061aaf0 0x56380061d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:24.762 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.761+0000 7fd735a50740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56380061b410 0x563800623450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:24.763 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.761+0000 7fd735a50740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563800625cb0 0x56380063daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:24.763 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.761+0000 7fd735a50740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd718010f90 con 0x563800625cb0 2024-09-19T06:17:24.763 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.761+0000 7fd730a53640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56380061aaf0 0x56380061d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:24.763 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.761+0000 7fd730a53640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56380061aaf0 0x56380061d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:56556/0 (socket says 172.21.15.2:56556) 2024-09-19T06:17:24.763 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.761+0000 7fd730a53640 1 -- 172.21.15.2:0/557937034 learned_addr learned my addr 172.21.15.2:0/557937034 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:24.763 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.761+0000 7fd735a50740 1 -- 172.21.15.2:0/557937034 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd71800e860 con 0x56380061aaf0 2024-09-19T06:17:24.764 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.761+0000 7fd735a50740 1 -- 172.21.15.2:0/557937034 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd71800c6b0 con 0x56380061b410 2024-09-19T06:17:24.764 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.762+0000 7fd731254640 1 --2- 172.21.15.2:0/557937034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563800625cb0 0x56380063daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:24.764 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.762+0000 7fd723fff640 1 --2- 172.21.15.2:0/557937034 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56380061b410 0x563800623450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:24.764 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.762+0000 7fd730a53640 1 -- 172.21.15.2:0/557937034 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56380061b410 msgr2=0x563800623450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:24.765 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.762+0000 7fd730a53640 1 --2- 172.21.15.2:0/557937034 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56380061b410 0x563800623450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:24.765 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.762+0000 7fd730a53640 1 -- 172.21.15.2:0/557937034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563800625cb0 msgr2=0x56380063daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:24.765 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.762+0000 7fd730a53640 1 --2- 172.21.15.2:0/557937034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563800625cb0 0x56380063daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:24.765 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.762+0000 7fd730a53640 1 -- 172.21.15.2:0/557937034 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56380061b240 con 0x56380061aaf0 2024-09-19T06:17:24.765 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.763+0000 7fd730a53640 1 --2- 172.21.15.2:0/557937034 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56380061aaf0 0x56380061d5b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd72802a9e0 tx=0x7fd728004580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d8eb96e74263a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:24.766 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.764+0000 7fd7127fc640 1 -- 172.21.15.2:0/557937034 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd728035040 con 0x56380061aaf0 2024-09-19T06:17:24.766 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.764+0000 7fd7127fc640 1 -- 172.21.15.2:0/557937034 <== mon.2 v2:172.21.15.89:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd728005450 con 0x56380061aaf0 2024-09-19T06:17:24.766 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.764+0000 7fd7127fc640 1 -- 172.21.15.2:0/557937034 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd728031820 con 0x56380061aaf0 2024-09-19T06:17:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.765+0000 7fd735a50740 1 -- 172.21.15.2:0/557937034 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56380061aaf0 msgr2=0x56380061d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.765+0000 7fd735a50740 1 --2- 172.21.15.2:0/557937034 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56380061aaf0 0x56380061d5b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd72802a9e0 tx=0x7fd728004580 comp rx=0 tx=0).stop 2024-09-19T06:17:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.765+0000 7fd735a50740 1 -- 172.21.15.2:0/557937034 shutdown_connections 2024-09-19T06:17:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.765+0000 7fd735a50740 1 --2- 172.21.15.2:0/557937034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563800625cb0 0x56380063daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.765+0000 7fd735a50740 1 --2- 172.21.15.2:0/557937034 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56380061b410 0x563800623450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.765+0000 7fd735a50740 1 --2- 172.21.15.2:0/557937034 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56380061aaf0 0x56380061d5b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.765+0000 7fd735a50740 1 -- 172.21.15.2:0/557937034 >> 172.21.15.2:0/557937034 conn(0x563800617060 msgr2=0x563800624c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.766+0000 7fd735a50740 1 -- 172.21.15.2:0/557937034 shutdown_connections 2024-09-19T06:17:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.766+0000 7fd735a50740 1 -- 172.21.15.2:0/557937034 wait complete. 2024-09-19T06:17:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.766+0000 7fd735a50740 1 -- start start 2024-09-19T06:17:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.766+0000 7fd735a50740 1 Processor -- start 2024-09-19T06:17:24.770 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.767+0000 7fd735a50740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56380061aaf0 0x56380062e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:24.770 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.768+0000 7fd735a50740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56380061b410 0x5638006295e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:24.770 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.768+0000 7fd735a50740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563800625cb0 0x563800629b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.768+0000 7fd735a50740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd71800cd20 con 0x563800625cb0 2024-09-19T06:17:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.768+0000 7fd723fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56380061b410 0x5638006295e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.768+0000 7fd723fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56380061b410 0x5638006295e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:56560/0 (socket says 172.21.15.2:56560) 2024-09-19T06:17:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.768+0000 7fd723fff640 1 -- 172.21.15.2:0/3402700494 learned_addr learned my addr 172.21.15.2:0/3402700494 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.769+0000 7fd735a50740 1 -- 172.21.15.2:0/3402700494 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd71800e190 con 0x56380061b410 2024-09-19T06:17:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.769+0000 7fd730a53640 1 --2- 172.21.15.2:0/3402700494 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56380061aaf0 0x56380062e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.769+0000 7fd735a50740 1 -- 172.21.15.2:0/3402700494 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd71800d3f0 con 0x56380061aaf0 2024-09-19T06:17:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.769+0000 7fd731254640 1 --2- 172.21.15.2:0/3402700494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563800625cb0 0x563800629b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.769+0000 7fd735a50740 10 client.0 _ll_register_callbacks cb 0x7fd724017040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.770+0000 7fd731254640 1 -- 172.21.15.2:0/3402700494 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56380061aaf0 msgr2=0x56380062e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.770+0000 7fd731254640 1 --2- 172.21.15.2:0/3402700494 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56380061aaf0 0x56380062e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.770+0000 7fd731254640 1 -- 172.21.15.2:0/3402700494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56380061b410 msgr2=0x5638006295e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.770+0000 7fd731254640 1 --2- 172.21.15.2:0/3402700494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56380061b410 0x5638006295e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.770+0000 7fd731254640 1 -- 172.21.15.2:0/3402700494 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56380062a210 con 0x563800625cb0 2024-09-19T06:17:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.770+0000 7fd730a53640 1 --2- 172.21.15.2:0/3402700494 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56380061aaf0 0x56380062e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:17:24.773 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.771+0000 7fd731254640 1 --2- 172.21.15.2:0/3402700494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563800625cb0 0x563800629b20 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x5638006280e0 tx=0x7fd72401f5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c1e61624c9dfce1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:24.773 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.771+0000 7fd70bfff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:17:24.773 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.772+0000 7fd70bfff640 1 -- 172.21.15.2:0/3402700494 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd724036020 con 0x563800625cb0 2024-09-19T06:17:24.773 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.772+0000 7fd70bfff640 1 -- 172.21.15.2:0/3402700494 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fd724013760 con 0x563800625cb0 2024-09-19T06:17:24.774 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.772+0000 7fd735a50740 1 -- 172.21.15.2:0/3402700494 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd728005450 con 0x563800625cb0 2024-09-19T06:17:24.775 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.772+0000 7fd70bfff640 1 -- 172.21.15.2:0/3402700494 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd724001960 con 0x563800625cb0 2024-09-19T06:17:24.775 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.772+0000 7fd735a50740 10 client.15984 fetch_fsmap learned FSMap version 26 2024-09-19T06:17:24.775 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.772+0000 7fd735a50740 1 -- 172.21.15.2:0/3402700494 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5638006a0900 con 0x563800625cb0 2024-09-19T06:17:24.775 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.772+0000 7fd70bfff640 1 -- 172.21.15.2:0/3402700494 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd728005450 con 0x563800625cb0 2024-09-19T06:17:24.775 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.773+0000 7fd70bfff640 1 -- 172.21.15.2:0/3402700494 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fd72402a9e0 con 0x563800625cb0 2024-09-19T06:17:24.775 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.773+0000 7fd735a50740 10 client.15984 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:17:24.776 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.773+0000 7fd735a50740 10 client.15984 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:17:24.776 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.773+0000 7fd735a50740 20 client.15984 populate_metadata read hostname 'smithi002' 2024-09-19T06:17:24.776 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.773+0000 7fd735a50740 1 --2- 172.21.15.2:0/3402700494 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563800635d00 0x5638006a2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:24.776 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.773+0000 7fd735a50740 4 client.15984 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:17:24.776 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.773+0000 7fd735a50740 1 -- 172.21.15.2:0/3402700494 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563800586d70 con 0x563800635d00 2024-09-19T06:17:24.776 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.773+0000 7fd730a53640 1 --2- 172.21.15.2:0/3402700494 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563800635d00 0x5638006a2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:24.776 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.774+0000 7fd70bfff640 10 client.15984 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:17:24.776 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.774+0000 7fd730a53640 1 --2- 172.21.15.2:0/3402700494 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563800635d00 0x5638006a2ff0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66c3cc59662c9007 server_cookie=a5b63afc26deb9 in_seq=0 out_seq=0 2024-09-19T06:17:24.800 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.798+0000 7fd70bfff640 1 -- 172.21.15.2:0/3402700494 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563800586d70 con 0x563800635d00 2024-09-19T06:17:24.800 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.798+0000 7fd70bfff640 10 client.15984 handle_command_reply: tid=0 2024-09-19T06:17:24.800 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.798+0000 7fd735a50740 1 client.15984 shutdown 2024-09-19T06:17:24.801 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.799+0000 7fd735a50740 1 -- 172.21.15.2:0/3402700494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563800625cb0 msgr2=0x563800629b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:24.801 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.799+0000 7fd735a50740 1 --2- 172.21.15.2:0/3402700494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563800625cb0 0x563800629b20 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x5638006280e0 tx=0x7fd72401f5e0 comp rx=0 tx=0).stop 2024-09-19T06:17:24.801 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.799+0000 7fd735a50740 1 -- 172.21.15.2:0/3402700494 shutdown_connections 2024-09-19T06:17:24.801 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.799+0000 7fd735a50740 1 --2- 172.21.15.2:0/3402700494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563800625cb0 0x563800629b20 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:24.801 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.799+0000 7fd735a50740 1 --2- 172.21.15.2:0/3402700494 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563800635d00 0x5638006a2ff0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:24.801 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.799+0000 7fd735a50740 1 --2- 172.21.15.2:0/3402700494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56380061b410 0x5638006295e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:24.801 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.799+0000 7fd735a50740 1 --2- 172.21.15.2:0/3402700494 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56380061aaf0 0x56380062e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:24.801 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.799+0000 7fd735a50740 1 -- 172.21.15.2:0/3402700494 >> 172.21.15.2:0/3402700494 conn(0x563800617060 msgr2=0x5638006159a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:24.801 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.799+0000 7fd70bfff640 0 client.15984 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:17:24.802 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.799+0000 7fd735a50740 1 -- 172.21.15.2:0/3402700494 shutdown_connections 2024-09-19T06:17:24.802 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.799+0000 7fd735a50740 1 -- 172.21.15.2:0/3402700494 wait complete. 2024-09-19T06:17:24.802 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.799+0000 7fd735a50740 20 client.15984 trim_cache size 0 max 16384 2024-09-19T06:17:24.802 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-19T06:17:24.802 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-19T06:17:24.802 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-19T06:17:24.803 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-19T06:17:24.803 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.800+0000 7fd732cb7640 1 -- 172.21.15.2:0/2926105363 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fd7140a33b0 msgr2=0x7fd7140a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.800+0000 7fd732cb7640 1 --2- 172.21.15.2:0/2926105363 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fd7140a33b0 0x7fd7140a5870 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd724002040 tx=0x7fd724009040 comp rx=0 tx=0).stop 2024-09-19T06:17:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.800+0000 7fd732cb7640 1 -- 172.21.15.2:0/2926105363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd72c10d4b0 msgr2=0x7fd72c1a4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.800+0000 7fd732cb7640 1 --2- 172.21.15.2:0/2926105363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd72c10d4b0 0x7fd72c1a4bf0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fd71c00d770 tx=0x7fd71c00dc30 comp rx=0 tx=0).stop 2024-09-19T06:17:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.800+0000 7fd732cb7640 1 -- 172.21.15.2:0/2926105363 shutdown_connections 2024-09-19T06:17:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.800+0000 7fd732cb7640 1 --2- 172.21.15.2:0/2926105363 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fd7140a33b0 0x7fd7140a5870 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.800+0000 7fd732cb7640 1 --2- 172.21.15.2:0/2926105363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd72c19e820 0x7fd72c19ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.800+0000 7fd732cb7640 1 --2- 172.21.15.2:0/2926105363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd72c10d4b0 0x7fd72c1a4bf0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.800+0000 7fd732cb7640 1 --2- 172.21.15.2:0/2926105363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd72c108360 0x7fd72c1a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.800+0000 7fd732cb7640 1 -- 172.21.15.2:0/2926105363 >> 172.21.15.2:0/2926105363 conn(0x7fd72c077ad0 msgr2=0x7fd72c078df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.801+0000 7fd732cb7640 1 -- 172.21.15.2:0/2926105363 shutdown_connections 2024-09-19T06:17:24.805 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:24.801+0000 7fd732cb7640 1 -- 172.21.15.2:0/2926105363 wait complete. 2024-09-19T06:17:25.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:25.062+0000 7fa38d53d640 1 -- 172.21.15.2:0/1999511502 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa388101200 con 0x7fa388102ef0 2024-09-19T06:17:25.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:25.064+0000 7fa36ffff640 1 -- 172.21.15.2:0/1999511502 <== mon.2 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11882 (secure 0 0 0) 0x7fa388101200 con 0x7fa388102ef0 2024-09-19T06:17:25.066 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:17:25.067 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-09-19T06:14:49:104280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:14:48.191083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24470,24472,24497]},"id":1}]} 2024-09-19T06:17:25.067 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-09-19T06:17:25.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:25.070+0000 7fa38d53d640 1 -- 172.21.15.2:0/1999511502 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa3700a3430 msgr2=0x7fa3700a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:25.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:25.070+0000 7fa38d53d640 1 --2- 172.21.15.2:0/1999511502 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa3700a3430 0x7fa3700a58f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa378009710 tx=0x7fa378006c90 comp rx=0 tx=0).stop 2024-09-19T06:17:25.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:25.070+0000 7fa38d53d640 1 -- 172.21.15.2:0/1999511502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa388102ef0 msgr2=0x7fa3880fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:25.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:25.070+0000 7fa38d53d640 1 --2- 172.21.15.2:0/1999511502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa388102ef0 0x7fa3880fd700 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa38000cce0 tx=0x7fa38000a620 comp rx=0 tx=0).stop 2024-09-19T06:17:25.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:25.070+0000 7fa38d53d640 1 -- 172.21.15.2:0/1999511502 shutdown_connections 2024-09-19T06:17:25.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:25.070+0000 7fa38d53d640 1 --2- 172.21.15.2:0/1999511502 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa3700a3430 0x7fa3700a58f0 secure :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa378009710 tx=0x7fa378006c90 comp rx=0 tx=0).stop 2024-09-19T06:17:25.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:25.070+0000 7fa38d53d640 1 --2- 172.21.15.2:0/1999511502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa388102ef0 0x7fa3880fd700 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:25.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:25.070+0000 7fa38d53d640 1 --2- 172.21.15.2:0/1999511502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa388102570 0x7fa3880fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:25.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:25.070+0000 7fa38d53d640 1 --2- 172.21.15.2:0/1999511502 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa388100e20 0x7fa3880fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:25.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:25.070+0000 7fa38d53d640 1 -- 172.21.15.2:0/1999511502 >> 172.21.15.2:0/1999511502 conn(0x7fa3880fc7d0 msgr2=0x7fa38806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:25.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:25.070+0000 7fa38d53d640 1 -- 172.21.15.2:0/1999511502 shutdown_connections 2024-09-19T06:17:25.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:25.071+0000 7fa38d53d640 1 -- 172.21.15.2:0/1999511502 wait complete. 2024-09-19T06:17:25.409 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:17:25 smithi002 ceph-mon[30982]: pgmap v81: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 628 MiB/s wr, 168 op/s 2024-09-19T06:17:25.409 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:17:25 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1999511502' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:17:25.541 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:17:25 smithi090 ceph-mon[34497]: pgmap v81: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 628 MiB/s wr, 168 op/s 2024-09-19T06:17:25.542 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:17:25 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1999511502' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:17:25.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:17:25 smithi089 ceph-mon[34160]: pgmap v81: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 628 MiB/s wr, 168 op/s 2024-09-19T06:17:25.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:17:25 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1999511502' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:17:25.901 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:17:26.371 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:17:26.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.953+0000 7ff4210c5640 1 -- 172.21.15.2:0/4207417707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff41c100e20 msgr2=0x7ff41c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:26.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.953+0000 7ff4210c5640 1 --2- 172.21.15.2:0/4207417707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff41c100e20 0x7ff41c101200 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7ff410009900 tx=0x7ff41002a480 comp rx=0 tx=0).stop 2024-09-19T06:17:26.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.953+0000 7ff4210c5640 1 -- 172.21.15.2:0/4207417707 shutdown_connections 2024-09-19T06:17:26.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.953+0000 7ff4210c5640 1 --2- 172.21.15.2:0/4207417707 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff41c102ef0 0x7ff41c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:26.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.953+0000 7ff4210c5640 1 --2- 172.21.15.2:0/4207417707 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff41c102570 0x7ff41c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:26.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.953+0000 7ff4210c5640 1 --2- 172.21.15.2:0/4207417707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff41c100e20 0x7ff41c101200 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:26.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.953+0000 7ff4210c5640 1 -- 172.21.15.2:0/4207417707 >> 172.21.15.2:0/4207417707 conn(0x7ff41c0fc7d0 msgr2=0x7ff41c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:26.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.953+0000 7ff4210c5640 1 -- 172.21.15.2:0/4207417707 shutdown_connections 2024-09-19T06:17:26.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.954+0000 7ff4210c5640 1 -- 172.21.15.2:0/4207417707 wait complete. 2024-09-19T06:17:26.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.956+0000 7ff4210c5640 1 Processor -- start 2024-09-19T06:17:26.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.956+0000 7ff4210c5640 1 -- start start 2024-09-19T06:17:26.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.957+0000 7ff4210c5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff41c100e20 0x7ff41c198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:26.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.957+0000 7ff4210c5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff41c102570 0x7ff41c198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:26.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.957+0000 7ff4210c5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff41c102ef0 0x7ff41c19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:26.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.957+0000 7ff4210c5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff41c111f90 con 0x7ff41c102ef0 2024-09-19T06:17:26.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.958+0000 7ff4210c5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff41c111e10 con 0x7ff41c102570 2024-09-19T06:17:26.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.958+0000 7ff4210c5640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff41c112110 con 0x7ff41c100e20 2024-09-19T06:17:26.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.958+0000 7ff41b59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff41c102ef0 0x7ff41c19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:26.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.958+0000 7ff41ad9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff41c100e20 0x7ff41c198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:26.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.958+0000 7ff41b59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff41c102ef0 0x7ff41c19cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45698/0 (socket says 172.21.15.2:45698) 2024-09-19T06:17:26.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.958+0000 7ff41b59e640 1 -- 172.21.15.2:0/2184286692 learned_addr learned my addr 172.21.15.2:0/2184286692 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:26.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.958+0000 7ff41a59c640 1 --2- 172.21.15.2:0/2184286692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff41c102570 0x7ff41c198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:26.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.958+0000 7ff41b59e640 1 -- 172.21.15.2:0/2184286692 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff41c100e20 msgr2=0x7ff41c198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:26.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.958+0000 7ff41b59e640 1 --2- 172.21.15.2:0/2184286692 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff41c100e20 0x7ff41c198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:26.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.958+0000 7ff41b59e640 1 -- 172.21.15.2:0/2184286692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff41c102570 msgr2=0x7ff41c198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:26.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.958+0000 7ff41b59e640 1 --2- 172.21.15.2:0/2184286692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff41c102570 0x7ff41c198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:26.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.958+0000 7ff41b59e640 1 -- 172.21.15.2:0/2184286692 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff41c19d400 con 0x7ff41c102ef0 2024-09-19T06:17:26.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.959+0000 7ff41b59e640 1 --2- 172.21.15.2:0/2184286692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff41c102ef0 0x7ff41c19cd20 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7ff41400eb10 tx=0x7ff41400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:26.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.959+0000 7ff403fff640 1 -- 172.21.15.2:0/2184286692 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff414004b20 con 0x7ff41c102ef0 2024-09-19T06:17:26.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.959+0000 7ff403fff640 1 -- 172.21.15.2:0/2184286692 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff414004cc0 con 0x7ff41c102ef0 2024-09-19T06:17:26.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.959+0000 7ff4210c5640 1 -- 172.21.15.2:0/2184286692 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff41c19d6f0 con 0x7ff41c102ef0 2024-09-19T06:17:26.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.960+0000 7ff403fff640 1 -- 172.21.15.2:0/2184286692 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff414005570 con 0x7ff41c102ef0 2024-09-19T06:17:26.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.960+0000 7ff4210c5640 1 -- 172.21.15.2:0/2184286692 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff41c10e100 con 0x7ff41c102ef0 2024-09-19T06:17:26.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.963+0000 7ff403fff640 1 -- 172.21.15.2:0/2184286692 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7ff414005710 con 0x7ff41c102ef0 2024-09-19T06:17:26.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.963+0000 7ff42349e740 1 Processor -- start 2024-09-19T06:17:26.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.963+0000 7ff42349e740 1 -- start start 2024-09-19T06:17:26.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.964+0000 7ff42349e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc5e2c1b40 0x55dc5e2c0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:26.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.964+0000 7ff42349e740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc5e2c05d0 0x55dc5e2c0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:26.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.964+0000 7ff42349e740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dc5e2cb370 0x55dc5e2cd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:26.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.964+0000 7ff42349e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55dc5e2262f0 con 0x55dc5e2c1b40 2024-09-19T06:17:26.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.964+0000 7ff42349e740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55dc5e1cdcf0 con 0x55dc5e2cb370 2024-09-19T06:17:26.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.964+0000 7ff42349e740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55dc5e2222b0 con 0x55dc5e2c05d0 2024-09-19T06:17:26.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.964+0000 7ff41a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc5e2c1b40 0x55dc5e2c0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:26.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.964+0000 7ff41a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc5e2c1b40 0x55dc5e2c0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45710/0 (socket says 172.21.15.2:45710) 2024-09-19T06:17:26.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.964+0000 7ff41a59c640 1 -- 172.21.15.2:0/3771939458 learned_addr learned my addr 172.21.15.2:0/3771939458 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:26.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.964+0000 7ff403fff640 1 --2- 172.21.15.2:0/2184286692 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff4040a3430 0x7ff4040a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:26.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.964+0000 7ff41ad9d640 1 --2- 172.21.15.2:0/3771939458 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc5e2c05d0 0x55dc5e2c0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:26.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.964+0000 7ff41a59c640 1 -- 172.21.15.2:0/3771939458 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc5e2c05d0 msgr2=0x55dc5e2c0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:26.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.964+0000 7ff41a59c640 1 --2- 172.21.15.2:0/3771939458 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc5e2c05d0 0x55dc5e2c0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:26.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.964+0000 7ff41a59c640 1 -- 172.21.15.2:0/3771939458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dc5e2cb370 msgr2=0x55dc5e2cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:26.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.964+0000 7ff41a59c640 1 --2- 172.21.15.2:0/3771939458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dc5e2cb370 0x55dc5e2cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:26.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.964+0000 7ff41a59c640 1 -- 172.21.15.2:0/3771939458 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc5e1b23a0 con 0x55dc5e2c1b40 2024-09-19T06:17:26.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.964+0000 7ff403fff640 1 -- 172.21.15.2:0/2184286692 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7ff4140d4120 con 0x7ff41c102ef0 2024-09-19T06:17:26.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.965+0000 7ff41b59e640 1 --2- 172.21.15.2:0/2184286692 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff4040a3430 0x7ff4040a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:26.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.965+0000 7ff41a59c640 1 --2- 172.21.15.2:0/3771939458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc5e2c1b40 0x55dc5e2c0090 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ff40c005bc0 tx=0x7ff40c013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28c73759bb1d883 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:26.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.965+0000 7ff41b59e640 1 --2- 172.21.15.2:0/2184286692 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff4040a3430 0x7ff4040a58f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff4140d19b0 tx=0x7ff414015040 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:26.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.965+0000 7ff4017fa640 1 -- 172.21.15.2:0/3771939458 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff40c01c470 con 0x55dc5e2c1b40 2024-09-19T06:17:26.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.965+0000 7ff4017fa640 1 -- 172.21.15.2:0/3771939458 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff40c017070 con 0x55dc5e2c1b40 2024-09-19T06:17:26.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.965+0000 7ff4017fa640 1 -- 172.21.15.2:0/3771939458 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff40c00f600 con 0x55dc5e2c1b40 2024-09-19T06:17:26.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.966+0000 7ff42349e740 1 -- 172.21.15.2:0/3771939458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc5e2c1b40 msgr2=0x55dc5e2c0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:26.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.966+0000 7ff42349e740 1 --2- 172.21.15.2:0/3771939458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc5e2c1b40 0x55dc5e2c0090 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ff40c005bc0 tx=0x7ff40c013830 comp rx=0 tx=0).stop 2024-09-19T06:17:26.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.966+0000 7ff42349e740 1 -- 172.21.15.2:0/3771939458 shutdown_connections 2024-09-19T06:17:26.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.966+0000 7ff42349e740 1 --2- 172.21.15.2:0/3771939458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dc5e2cb370 0x55dc5e2cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:26.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.966+0000 7ff42349e740 1 --2- 172.21.15.2:0/3771939458 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc5e2c05d0 0x55dc5e2c0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:26.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.966+0000 7ff42349e740 1 --2- 172.21.15.2:0/3771939458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc5e2c1b40 0x55dc5e2c0090 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:26.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.966+0000 7ff42349e740 1 -- 172.21.15.2:0/3771939458 >> 172.21.15.2:0/3771939458 conn(0x55dc5e289310 msgr2=0x55dc5e2bcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:26.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.966+0000 7ff42349e740 1 -- 172.21.15.2:0/3771939458 shutdown_connections 2024-09-19T06:17:26.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.966+0000 7ff42349e740 1 -- 172.21.15.2:0/3771939458 wait complete. 2024-09-19T06:17:26.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.967+0000 7ff42349e740 1 -- start start 2024-09-19T06:17:26.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.967+0000 7ff42349e740 1 Processor -- start 2024-09-19T06:17:26.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.967+0000 7ff42349e740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dc5e2c05d0 0x55dc5e2cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:26.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.967+0000 7ff42349e740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc5e2c1b40 0x55dc5e2c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:26.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.967+0000 7ff42349e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc5e2cb370 0x55dc5e2c8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:26.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.967+0000 7ff42349e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55dc5e2ce070 con 0x55dc5e2cb370 2024-09-19T06:17:26.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.967+0000 7ff42349e740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55dc5e1e1060 con 0x55dc5e2c05d0 2024-09-19T06:17:26.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.967+0000 7ff42349e740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55dc5e2ce1f0 con 0x55dc5e2c1b40 2024-09-19T06:17:26.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.968+0000 7ff42349e740 10 client.0 _ll_register_callbacks cb 0x55dc5df348c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:26.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.968+0000 7ff41a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc5e2cb370 0x55dc5e2c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:26.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.968+0000 7ff41a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc5e2cb370 0x55dc5e2c8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45726/0 (socket says 172.21.15.2:45726) 2024-09-19T06:17:26.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.968+0000 7ff41a59c640 1 -- 172.21.15.2:0/1574333872 learned_addr learned my addr 172.21.15.2:0/1574333872 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:26.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.968+0000 7ff41a59c640 1 --2- 172.21.15.2:0/1574333872 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dc5e2c05d0 0x55dc5e2cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:26.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.968+0000 7ff41a59c640 1 -- 172.21.15.2:0/1574333872 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc5e2c1b40 msgr2=0x55dc5e2c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:26.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.968+0000 7ff41ad9d640 1 --2- 172.21.15.2:0/1574333872 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc5e2c1b40 0x55dc5e2c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:26.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.968+0000 7ff41a59c640 1 --2- 172.21.15.2:0/1574333872 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc5e2c1b40 0x55dc5e2c80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:26.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.968+0000 7ff41a59c640 1 -- 172.21.15.2:0/1574333872 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dc5e2c05d0 msgr2=0x55dc5e2cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:26.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.968+0000 7ff41a59c640 1 --2- 172.21.15.2:0/1574333872 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dc5e2c05d0 0x55dc5e2cadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:26.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.968+0000 7ff41a59c640 1 -- 172.21.15.2:0/1574333872 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc5df973c0 con 0x55dc5e2cb370 2024-09-19T06:17:26.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.968+0000 7ff41a59c640 1 --2- 172.21.15.2:0/1574333872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc5e2cb370 0x55dc5e2c8880 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ff40c010fd0 tx=0x7ff40c010e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d1e51402e5946bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:26.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.968+0000 7ff3feff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:17:26.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.968+0000 7ff3feff5640 1 -- 172.21.15.2:0/1574333872 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff40c004030 con 0x55dc5e2cb370 2024-09-19T06:17:26.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.968+0000 7ff42349e740 1 -- 172.21.15.2:0/1574333872 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff40c017070 con 0x55dc5e2cb370 2024-09-19T06:17:26.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.969+0000 7ff3feff5640 1 -- 172.21.15.2:0/1574333872 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7ff40c0041d0 con 0x55dc5e2cb370 2024-09-19T06:17:26.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.969+0000 7ff3feff5640 1 -- 172.21.15.2:0/1574333872 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff40c030050 con 0x55dc5e2cb370 2024-09-19T06:17:26.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.969+0000 7ff42349e740 10 client.15996 fetch_fsmap learned FSMap version 26 2024-09-19T06:17:26.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.969+0000 7ff42349e740 1 -- 172.21.15.2:0/1574333872 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55dc5e2d9bc0 con 0x55dc5e2cb370 2024-09-19T06:17:26.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.969+0000 7ff3feff5640 1 -- 172.21.15.2:0/1574333872 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff40c017070 con 0x55dc5e2cb370 2024-09-19T06:17:26.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.969+0000 7ff3feff5640 1 -- 172.21.15.2:0/1574333872 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7ff40c004750 con 0x55dc5e2cb370 2024-09-19T06:17:26.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.970+0000 7ff42349e740 10 client.15996 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:17:26.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.970+0000 7ff42349e740 10 client.15996 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:17:26.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.970+0000 7ff42349e740 20 client.15996 populate_metadata read hostname 'smithi002' 2024-09-19T06:17:26.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.970+0000 7ff42349e740 1 --2- 172.21.15.2:0/1574333872 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55dc5e2daf70 0x55dc5e2dd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:26.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.970+0000 7ff42349e740 4 client.15996 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:17:26.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.970+0000 7ff42349e740 1 -- 172.21.15.2:0/1574333872 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc5e233860 con 0x55dc5e2daf70 2024-09-19T06:17:26.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.970+0000 7ff41ad9d640 1 --2- 172.21.15.2:0/1574333872 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55dc5e2daf70 0x55dc5e2dd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:26.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.971+0000 7ff41ad9d640 1 --2- 172.21.15.2:0/1574333872 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55dc5e2daf70 0x55dc5e2dd360 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=178a8993327298f0 server_cookie=c882199d88ba5e30 in_seq=0 out_seq=0 2024-09-19T06:17:26.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.971+0000 7ff3feff5640 10 client.15996 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:17:26.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.972+0000 7ff3feff5640 1 -- 172.21.15.2:0/1574333872 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dc5e233860 con 0x55dc5e2daf70 2024-09-19T06:17:26.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.972+0000 7ff3feff5640 10 client.15996 handle_command_reply: tid=0 2024-09-19T06:17:26.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.972+0000 7ff42349e740 1 client.15996 shutdown 2024-09-19T06:17:26.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.972+0000 7ff42349e740 1 -- 172.21.15.2:0/1574333872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc5e2cb370 msgr2=0x55dc5e2c8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:26.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.972+0000 7ff42349e740 1 --2- 172.21.15.2:0/1574333872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc5e2cb370 0x55dc5e2c8880 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ff40c010fd0 tx=0x7ff40c010e10 comp rx=0 tx=0).stop 2024-09-19T06:17:26.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.972+0000 7ff42349e740 1 -- 172.21.15.2:0/1574333872 shutdown_connections 2024-09-19T06:17:26.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.972+0000 7ff42349e740 1 --2- 172.21.15.2:0/1574333872 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55dc5e2daf70 0x55dc5e2dd360 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:26.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.972+0000 7ff42349e740 1 --2- 172.21.15.2:0/1574333872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc5e2cb370 0x55dc5e2c8880 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:26.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.972+0000 7ff42349e740 1 --2- 172.21.15.2:0/1574333872 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc5e2c1b40 0x55dc5e2c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:26.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.972+0000 7ff3feff5640 0 client.15996 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:17:26.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.972+0000 7ff42349e740 1 --2- 172.21.15.2:0/1574333872 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dc5e2c05d0 0x55dc5e2cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:26.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.972+0000 7ff42349e740 1 -- 172.21.15.2:0/1574333872 >> 172.21.15.2:0/1574333872 conn(0x55dc5e289310 msgr2=0x55dc5e2c2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:26.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.973+0000 7ff42349e740 1 -- 172.21.15.2:0/1574333872 shutdown_connections 2024-09-19T06:17:26.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.973+0000 7ff42349e740 1 -- 172.21.15.2:0/1574333872 wait complete. 2024-09-19T06:17:26.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.973+0000 7ff42349e740 20 client.15996 trim_cache size 0 max 16384 2024-09-19T06:17:27.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.999+0000 7ff42349e740 1 Processor -- start 2024-09-19T06:17:27.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:26.999+0000 7ff42349e740 1 -- start start 2024-09-19T06:17:27.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.000+0000 7ff42349e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc5e2c05d0 0x55dc5e2bbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:27.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.000+0000 7ff42349e740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc5e2c1b40 0x55dc5e2c3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:27.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.000+0000 7ff42349e740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dc5e2cb370 0x55dc5e2c3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:27.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.000+0000 7ff42349e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff41c1adeb0 con 0x55dc5e2c05d0 2024-09-19T06:17:27.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.000+0000 7ff42349e740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff41c1ab780 con 0x55dc5e2cb370 2024-09-19T06:17:27.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.000+0000 7ff42349e740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff41c1a95f0 con 0x55dc5e2c1b40 2024-09-19T06:17:27.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.000+0000 7ff41a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc5e2c05d0 0x55dc5e2bbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:27.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.000+0000 7ff41a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc5e2c05d0 0x55dc5e2bbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45732/0 (socket says 172.21.15.2:45732) 2024-09-19T06:17:27.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.000+0000 7ff41a59c640 1 -- 172.21.15.2:0/35733470 learned_addr learned my addr 172.21.15.2:0/35733470 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:27.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.001+0000 7ff41ad9d640 1 --2- 172.21.15.2:0/35733470 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc5e2c1b40 0x55dc5e2c3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:27.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.001+0000 7ff41a59c640 1 -- 172.21.15.2:0/35733470 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc5e2c1b40 msgr2=0x55dc5e2c3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:27.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.001+0000 7ff41a59c640 1 --2- 172.21.15.2:0/35733470 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc5e2c1b40 0x55dc5e2c3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:27.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.001+0000 7ff41a59c640 1 -- 172.21.15.2:0/35733470 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dc5e2cb370 msgr2=0x55dc5e2c3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:27.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.001+0000 7ff41a59c640 1 --2- 172.21.15.2:0/35733470 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dc5e2cb370 0x55dc5e2c3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:27.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.001+0000 7ff41a59c640 1 -- 172.21.15.2:0/35733470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc5e2ca9f0 con 0x55dc5e2c05d0 2024-09-19T06:17:27.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.001+0000 7ff41a59c640 1 --2- 172.21.15.2:0/35733470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc5e2c05d0 0x55dc5e2bbfb0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ff40c0107c0 tx=0x7ff40c0108e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67d9df62824bacbe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:27.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.001+0000 7ff400ff9640 1 -- 172.21.15.2:0/35733470 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff40c013d30 con 0x55dc5e2c05d0 2024-09-19T06:17:27.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.001+0000 7ff400ff9640 1 -- 172.21.15.2:0/35733470 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff40c017070 con 0x55dc5e2c05d0 2024-09-19T06:17:27.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.001+0000 7ff400ff9640 1 -- 172.21.15.2:0/35733470 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff40c004f60 con 0x55dc5e2c05d0 2024-09-19T06:17:27.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.002+0000 7ff42349e740 1 -- 172.21.15.2:0/35733470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc5e2c05d0 msgr2=0x55dc5e2bbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:27.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.002+0000 7ff42349e740 1 --2- 172.21.15.2:0/35733470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc5e2c05d0 0x55dc5e2bbfb0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ff40c0107c0 tx=0x7ff40c0108e0 comp rx=0 tx=0).stop 2024-09-19T06:17:27.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.003+0000 7ff42349e740 1 -- 172.21.15.2:0/35733470 shutdown_connections 2024-09-19T06:17:27.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.003+0000 7ff42349e740 1 --2- 172.21.15.2:0/35733470 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dc5e2cb370 0x55dc5e2c3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:27.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.003+0000 7ff42349e740 1 --2- 172.21.15.2:0/35733470 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc5e2c1b40 0x55dc5e2c3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:27.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.003+0000 7ff42349e740 1 --2- 172.21.15.2:0/35733470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc5e2c05d0 0x55dc5e2bbfb0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:27.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.003+0000 7ff42349e740 1 -- 172.21.15.2:0/35733470 >> 172.21.15.2:0/35733470 conn(0x55dc5e289310 msgr2=0x55dc5e2ca170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:27.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.003+0000 7ff42349e740 1 -- 172.21.15.2:0/35733470 shutdown_connections 2024-09-19T06:17:27.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.003+0000 7ff42349e740 1 -- 172.21.15.2:0/35733470 wait complete. 2024-09-19T06:17:27.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.003+0000 7ff42349e740 1 -- start start 2024-09-19T06:17:27.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.003+0000 7ff42349e740 1 Processor -- start 2024-09-19T06:17:27.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.004+0000 7ff42349e740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dc5e2c05d0 0x55dc5e2d3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:27.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.004+0000 7ff42349e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc5e2c1b40 0x55dc5e2c4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:27.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.004+0000 7ff42349e740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc5e2cb370 0x55dc5e2c54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:27.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.004+0000 7ff42349e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff41c1a9c40 con 0x55dc5e2c1b40 2024-09-19T06:17:27.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.004+0000 7ff42349e740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff41c1ab0b0 con 0x55dc5e2c05d0 2024-09-19T06:17:27.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.004+0000 7ff42349e740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff41c1aa310 con 0x55dc5e2cb370 2024-09-19T06:17:27.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.004+0000 7ff42349e740 10 client.0 _ll_register_callbacks cb 0x7ff40c009c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:27.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.004+0000 7ff41a59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dc5e2c05d0 0x55dc5e2d3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:27.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.004+0000 7ff41a59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dc5e2c05d0 0x55dc5e2d3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:42202/0 (socket says 172.21.15.2:42202) 2024-09-19T06:17:27.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.004+0000 7ff41a59c640 1 -- 172.21.15.2:0/1194952958 learned_addr learned my addr 172.21.15.2:0/1194952958 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:27.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.004+0000 7ff41ad9d640 1 --2- 172.21.15.2:0/1194952958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc5e2c1b40 0x55dc5e2c4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:27.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.004+0000 7ff41a59c640 1 --2- 172.21.15.2:0/1194952958 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc5e2cb370 0x55dc5e2c54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:27.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.005+0000 7ff41ad9d640 1 -- 172.21.15.2:0/1194952958 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc5e2cb370 msgr2=0x55dc5e2c54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:27.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.005+0000 7ff41ad9d640 1 --2- 172.21.15.2:0/1194952958 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc5e2cb370 0x55dc5e2c54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:27.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.005+0000 7ff41ad9d640 1 -- 172.21.15.2:0/1194952958 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dc5e2c05d0 msgr2=0x55dc5e2d3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:27.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.005+0000 7ff41ad9d640 1 --2- 172.21.15.2:0/1194952958 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dc5e2c05d0 0x55dc5e2d3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:27.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.005+0000 7ff41ad9d640 1 -- 172.21.15.2:0/1194952958 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc5e2c5cd0 con 0x55dc5e2c1b40 2024-09-19T06:17:27.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.005+0000 7ff41a59c640 1 --2- 172.21.15.2:0/1194952958 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc5e2cb370 0x55dc5e2c54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:17:27.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.005+0000 7ff41ad9d640 1 --2- 172.21.15.2:0/1194952958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc5e2c1b40 0x55dc5e2c4f00 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ff41002aa70 tx=0x7ff410004400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc03146d0c5b1043 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:27.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.005+0000 7ff3feff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:17:27.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.006+0000 7ff3feff5640 1 -- 172.21.15.2:0/1194952958 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff410035040 con 0x55dc5e2c1b40 2024-09-19T06:17:27.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.006+0000 7ff3feff5640 1 -- 172.21.15.2:0/1194952958 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7ff410005450 con 0x55dc5e2c1b40 2024-09-19T06:17:27.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.006+0000 7ff42349e740 1 -- 172.21.15.2:0/1194952958 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff40c017070 con 0x55dc5e2c1b40 2024-09-19T06:17:27.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.006+0000 7ff3feff5640 1 -- 172.21.15.2:0/1194952958 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff410005650 con 0x55dc5e2c1b40 2024-09-19T06:17:27.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.006+0000 7ff42349e740 10 client.16002 fetch_fsmap learned FSMap version 26 2024-09-19T06:17:27.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.006+0000 7ff42349e740 1 -- 172.21.15.2:0/1194952958 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55dc5e3459d0 con 0x55dc5e2c1b40 2024-09-19T06:17:27.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.006+0000 7ff3feff5640 1 -- 172.21.15.2:0/1194952958 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff40c017070 con 0x55dc5e2c1b40 2024-09-19T06:17:27.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.006+0000 7ff3feff5640 1 -- 172.21.15.2:0/1194952958 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7ff4100546e0 con 0x55dc5e2c1b40 2024-09-19T06:17:27.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.006+0000 7ff42349e740 10 client.16002 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:17:27.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.006+0000 7ff42349e740 10 client.16002 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:17:27.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.006+0000 7ff42349e740 20 client.16002 populate_metadata read hostname 'smithi002' 2024-09-19T06:17:27.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.007+0000 7ff42349e740 1 --2- 172.21.15.2:0/1194952958 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55dc5e3460b0 0x55dc5e3484d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:27.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.007+0000 7ff42349e740 4 client.16002 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:17:27.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.007+0000 7ff42349e740 1 -- 172.21.15.2:0/1194952958 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dc5e22dd70 con 0x55dc5e3460b0 2024-09-19T06:17:27.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.007+0000 7ff41a59c640 1 --2- 172.21.15.2:0/1194952958 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55dc5e3460b0 0x55dc5e3484d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:27.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.008+0000 7ff3feff5640 10 client.16002 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:17:27.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.008+0000 7ff41a59c640 1 --2- 172.21.15.2:0/1194952958 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55dc5e3460b0 0x55dc5e3484d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d4cb65ae97d71ab4 server_cookie=fa2bb4b52e1eefb7 in_seq=0 out_seq=0 2024-09-19T06:17:27.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.008+0000 7ff3feff5640 1 -- 172.21.15.2:0/1194952958 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55dc5e22dd70 con 0x55dc5e3460b0 2024-09-19T06:17:27.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.008+0000 7ff3feff5640 10 client.16002 handle_command_reply: tid=0 2024-09-19T06:17:27.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.008+0000 7ff42349e740 1 client.16002 shutdown 2024-09-19T06:17:27.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.008+0000 7ff42349e740 1 -- 172.21.15.2:0/1194952958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc5e2c1b40 msgr2=0x55dc5e2c4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:27.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.008+0000 7ff42349e740 1 --2- 172.21.15.2:0/1194952958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc5e2c1b40 0x55dc5e2c4f00 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ff41002aa70 tx=0x7ff410004400 comp rx=0 tx=0).stop 2024-09-19T06:17:27.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.008+0000 7ff42349e740 1 -- 172.21.15.2:0/1194952958 shutdown_connections 2024-09-19T06:17:27.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.008+0000 7ff42349e740 1 --2- 172.21.15.2:0/1194952958 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55dc5e3460b0 0x55dc5e3484d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:27.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.008+0000 7ff42349e740 1 --2- 172.21.15.2:0/1194952958 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc5e2cb370 0x55dc5e2c54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:27.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.008+0000 7ff3feff5640 0 client.16002 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:17:27.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.008+0000 7ff42349e740 1 --2- 172.21.15.2:0/1194952958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dc5e2c1b40 0x55dc5e2c4f00 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:27.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.008+0000 7ff42349e740 1 --2- 172.21.15.2:0/1194952958 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dc5e2c05d0 0x55dc5e2d3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:27.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.008+0000 7ff42349e740 1 -- 172.21.15.2:0/1194952958 >> 172.21.15.2:0/1194952958 conn(0x55dc5e289310 msgr2=0x55dc5e2d6300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:27.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.008+0000 7ff42349e740 1 -- 172.21.15.2:0/1194952958 shutdown_connections 2024-09-19T06:17:27.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.009+0000 7ff42349e740 1 -- 172.21.15.2:0/1194952958 wait complete. 2024-09-19T06:17:27.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.009+0000 7ff42349e740 20 client.16002 trim_cache size 0 max 16384 2024-09-19T06:17:27.015 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:17:27.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.009+0000 7ff4210c5640 1 -- 172.21.15.2:0/2184286692 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff4040a3430 msgr2=0x7ff4040a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:27.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.009+0000 7ff4210c5640 1 --2- 172.21.15.2:0/2184286692 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff4040a3430 0x7ff4040a58f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff4140d19b0 tx=0x7ff414015040 comp rx=0 tx=0).stop 2024-09-19T06:17:27.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.009+0000 7ff4210c5640 1 -- 172.21.15.2:0/2184286692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff41c102ef0 msgr2=0x7ff41c19cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:27.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.009+0000 7ff4210c5640 1 --2- 172.21.15.2:0/2184286692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff41c102ef0 0x7ff41c19cd20 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7ff41400eb10 tx=0x7ff41400c2d0 comp rx=0 tx=0).stop 2024-09-19T06:17:27.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.010+0000 7ff4210c5640 1 -- 172.21.15.2:0/2184286692 shutdown_connections 2024-09-19T06:17:27.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.010+0000 7ff4210c5640 1 --2- 172.21.15.2:0/2184286692 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff4040a3430 0x7ff4040a58f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:27.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.010+0000 7ff4210c5640 1 --2- 172.21.15.2:0/2184286692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff41c102ef0 0x7ff41c19cd20 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:27.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.010+0000 7ff4210c5640 1 --2- 172.21.15.2:0/2184286692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff41c102570 0x7ff41c198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:27.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.010+0000 7ff4210c5640 1 --2- 172.21.15.2:0/2184286692 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff41c100e20 0x7ff41c198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:27.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.010+0000 7ff4210c5640 1 -- 172.21.15.2:0/2184286692 >> 172.21.15.2:0/2184286692 conn(0x7ff41c0fc7d0 msgr2=0x7ff41c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:27.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.010+0000 7ff4210c5640 1 -- 172.21.15.2:0/2184286692 shutdown_connections 2024-09-19T06:17:27.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:27.010+0000 7ff4210c5640 1 -- 172.21.15.2:0/2184286692 wait complete. 2024-09-19T06:17:27.724 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:17:27 smithi002 ceph-mon[30982]: pgmap v82: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 410 MiB/s wr, 107 op/s 2024-09-19T06:17:27.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:17:27 smithi090 ceph-mon[34497]: pgmap v82: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 410 MiB/s wr, 107 op/s 2024-09-19T06:17:27.791 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:17:27 smithi089 ceph-mon[34160]: pgmap v82: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 410 MiB/s wr, 107 op/s 2024-09-19T06:17:27.882 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:17:28.337 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:17:28.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.938+0000 7f9f119e3640 1 -- 172.21.15.2:0/1792161669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f0c102780 msgr2=0x7f9f0c1067d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:28.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.938+0000 7f9f119e3640 1 --2- 172.21.15.2:0/1792161669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f0c102780 0x7f9f0c1067d0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9f00009900 tx=0x7f9f0002a410 comp rx=0 tx=0).stop 2024-09-19T06:17:28.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.938+0000 7f9f119e3640 1 -- 172.21.15.2:0/1792161669 shutdown_connections 2024-09-19T06:17:28.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.938+0000 7f9f119e3640 1 --2- 172.21.15.2:0/1792161669 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f0c106f00 0x7f9f0c10ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.938+0000 7f9f119e3640 1 --2- 172.21.15.2:0/1792161669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f0c102780 0x7f9f0c1067d0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.938+0000 7f9f119e3640 1 --2- 172.21.15.2:0/1792161669 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f0c101dd0 0x7f9f0c1021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.938+0000 7f9f119e3640 1 -- 172.21.15.2:0/1792161669 >> 172.21.15.2:0/1792161669 conn(0x7f9f0c0fd8b0 msgr2=0x7f9f0c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:28.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.938+0000 7f9f119e3640 1 -- 172.21.15.2:0/1792161669 shutdown_connections 2024-09-19T06:17:28.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.938+0000 7f9f119e3640 1 -- 172.21.15.2:0/1792161669 wait complete. 2024-09-19T06:17:28.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.939+0000 7f9f119e3640 1 Processor -- start 2024-09-19T06:17:28.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.939+0000 7f9f119e3640 1 -- start start 2024-09-19T06:17:28.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.940+0000 7f9f119e3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f0c101dd0 0x7f9f0c198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:28.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.940+0000 7f9f119e3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f0c102780 0x7f9f0c198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:28.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.940+0000 7f9f119e3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f0c106f00 0x7f9f0c19ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:28.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.940+0000 7f9f119e3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c111f20 con 0x7f9f0c102780 2024-09-19T06:17:28.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.940+0000 7f9f119e3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c111da0 con 0x7f9f0c101dd0 2024-09-19T06:17:28.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.940+0000 7f9f119e3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c1120a0 con 0x7f9f0c106f00 2024-09-19T06:17:28.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.940+0000 7f9f0a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f0c102780 0x7f9f0c198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:28.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.940+0000 7f9f0a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f0c102780 0x7f9f0c198a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45750/0 (socket says 172.21.15.2:45750) 2024-09-19T06:17:28.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.940+0000 7f9f0a7fc640 1 -- 172.21.15.2:0/4286922099 learned_addr learned my addr 172.21.15.2:0/4286922099 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:28.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.941+0000 7f9f0a7fc640 1 -- 172.21.15.2:0/4286922099 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f0c106f00 msgr2=0x7f9f0c19ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:28.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.941+0000 7f9f0a7fc640 1 --2- 172.21.15.2:0/4286922099 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f0c106f00 0x7f9f0c19ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.941+0000 7f9f0a7fc640 1 -- 172.21.15.2:0/4286922099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f0c101dd0 msgr2=0x7f9f0c198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:28.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.941+0000 7f9f0a7fc640 1 --2- 172.21.15.2:0/4286922099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f0c101dd0 0x7f9f0c198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.941+0000 7f9f0a7fc640 1 -- 172.21.15.2:0/4286922099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f0c19d4f0 con 0x7f9f0c102780 2024-09-19T06:17:28.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.941+0000 7f9f0a7fc640 1 --2- 172.21.15.2:0/4286922099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f0c102780 0x7f9f0c198a80 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9f00005ab0 tx=0x7f9f00003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:28.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.941+0000 7f9f109e1640 1 -- 172.21.15.2:0/4286922099 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0003f070 con 0x7f9f0c102780 2024-09-19T06:17:28.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.941+0000 7f9f109e1640 1 -- 172.21.15.2:0/4286922099 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9f00031d60 con 0x7f9f0c102780 2024-09-19T06:17:28.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.942+0000 7f9f119e3640 1 -- 172.21.15.2:0/4286922099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f0c19d780 con 0x7f9f0c102780 2024-09-19T06:17:28.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.942+0000 7f9f109e1640 1 -- 172.21.15.2:0/4286922099 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f00035030 con 0x7f9f0c102780 2024-09-19T06:17:28.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.942+0000 7f9f119e3640 1 -- 172.21.15.2:0/4286922099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f0c1a50c0 con 0x7f9f0c102780 2024-09-19T06:17:28.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.946+0000 7f9f13dbc740 1 Processor -- start 2024-09-19T06:17:28.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.946+0000 7f9f109e1640 1 -- 172.21.15.2:0/4286922099 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f9f00042070 con 0x7f9f0c102780 2024-09-19T06:17:28.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.946+0000 7f9f13dbc740 1 -- start start 2024-09-19T06:17:28.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.947+0000 7f9f13dbc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2c1838840 0x55c2c1838c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:28.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.947+0000 7f9f13dbc740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c2c1837120 0x55c2c1837560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:28.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.947+0000 7f9f13dbc740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c2c1837b80 0x55c2c184cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:28.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.947+0000 7f9f13dbc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c2c179d2f0 con 0x55c2c1838840 2024-09-19T06:17:28.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.947+0000 7f9f13dbc740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55c2c1744cf0 con 0x55c2c1837b80 2024-09-19T06:17:28.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.947+0000 7f9f13dbc740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55c2c17992b0 con 0x55c2c1837120 2024-09-19T06:17:28.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.947+0000 7f9f0b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2c1838840 0x55c2c1838c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:28.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.947+0000 7f9f0b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2c1838840 0x55c2c1838c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45758/0 (socket says 172.21.15.2:45758) 2024-09-19T06:17:28.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.947+0000 7f9f0b7fe640 1 -- 172.21.15.2:0/3605810979 learned_addr learned my addr 172.21.15.2:0/3605810979 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:28.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.947+0000 7f9f0b7fe640 1 -- 172.21.15.2:0/3605810979 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c2c1837120 msgr2=0x55c2c1837560 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:17:28.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.947+0000 7f9f0b7fe640 1 --2- 172.21.15.2:0/3605810979 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c2c1837120 0x55c2c1837560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.947+0000 7f9f0b7fe640 1 -- 172.21.15.2:0/3605810979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c2c1837b80 msgr2=0x55c2c184cf60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:17:28.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.947+0000 7f9f0b7fe640 1 --2- 172.21.15.2:0/3605810979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c2c1837b80 0x55c2c184cf60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.947+0000 7f9f0b7fe640 1 -- 172.21.15.2:0/3605810979 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2c17293a0 con 0x55c2c1838840 2024-09-19T06:17:28.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.948+0000 7f9f109e1640 1 --2- 172.21.15.2:0/4286922099 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9ef40a3430 0x7f9ef40a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:28.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.948+0000 7f9f0b7fe640 1 --2- 172.21.15.2:0/3605810979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2c1838840 0x55c2c1838c20 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f9f04009d00 tx=0x7f9f0400b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13c4d5106fed5e33 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:28.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.948+0000 7f9ef1ffb640 1 -- 172.21.15.2:0/3605810979 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0400bd40 con 0x55c2c1838840 2024-09-19T06:17:28.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.948+0000 7f9ef1ffb640 1 -- 172.21.15.2:0/3605810979 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9f04017070 con 0x55c2c1838840 2024-09-19T06:17:28.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.948+0000 7f9f109e1640 1 -- 172.21.15.2:0/4286922099 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f9f000f0710 con 0x7f9f0c102780 2024-09-19T06:17:28.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.948+0000 7f9ef1ffb640 1 -- 172.21.15.2:0/3605810979 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f040115f0 con 0x55c2c1838840 2024-09-19T06:17:28.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.948+0000 7f9f0affd640 1 --2- 172.21.15.2:0/4286922099 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9ef40a3430 0x7f9ef40a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:28.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.949+0000 7f9f13dbc740 1 -- 172.21.15.2:0/3605810979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2c1838840 msgr2=0x55c2c1838c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:28.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.949+0000 7f9f13dbc740 1 --2- 172.21.15.2:0/3605810979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2c1838840 0x55c2c1838c20 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f9f04009d00 tx=0x7f9f0400b420 comp rx=0 tx=0).stop 2024-09-19T06:17:28.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.949+0000 7f9f0affd640 1 --2- 172.21.15.2:0/4286922099 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9ef40a3430 0x7f9ef40a58f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9efc006fd0 tx=0x7f9efc006c40 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:28.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.950+0000 7f9f13dbc740 1 -- 172.21.15.2:0/3605810979 shutdown_connections 2024-09-19T06:17:28.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.950+0000 7f9f13dbc740 1 --2- 172.21.15.2:0/3605810979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c2c1837b80 0x55c2c184cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.950+0000 7f9f13dbc740 1 --2- 172.21.15.2:0/3605810979 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c2c1837120 0x55c2c1837560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.950+0000 7f9f13dbc740 1 --2- 172.21.15.2:0/3605810979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2c1838840 0x55c2c1838c20 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.950+0000 7f9f13dbc740 1 -- 172.21.15.2:0/3605810979 >> 172.21.15.2:0/3605810979 conn(0x55c2c1800310 msgr2=0x55c2c1833c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:28.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.950+0000 7f9f13dbc740 1 -- 172.21.15.2:0/3605810979 shutdown_connections 2024-09-19T06:17:28.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.950+0000 7f9f13dbc740 1 -- 172.21.15.2:0/3605810979 wait complete. 2024-09-19T06:17:28.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.950+0000 7f9f13dbc740 1 -- start start 2024-09-19T06:17:28.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.951+0000 7f9f13dbc740 1 Processor -- start 2024-09-19T06:17:28.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.952+0000 7f9f13dbc740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c2c1837120 0x55c2c1846e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:28.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.952+0000 7f9f13dbc740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c2c1837b80 0x55c2c1847390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:28.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.952+0000 7f9f13dbc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2c1838840 0x55c2c184cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:28.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.952+0000 7f9f13dbc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c2c183eb20 con 0x55c2c1838840 2024-09-19T06:17:28.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.952+0000 7f9f13dbc740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55c2c1758060 con 0x55c2c1837b80 2024-09-19T06:17:28.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.952+0000 7f9f13dbc740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55c2c183eca0 con 0x55c2c1837120 2024-09-19T06:17:28.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.952+0000 7f9f13dbc740 10 client.0 _ll_register_callbacks cb 0x55c2c14ab8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:28.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.952+0000 7f9f0b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2c1838840 0x55c2c184cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:28.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.952+0000 7f9f0b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2c1838840 0x55c2c184cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45772/0 (socket says 172.21.15.2:45772) 2024-09-19T06:17:28.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.952+0000 7f9f0b7fe640 1 -- 172.21.15.2:0/536923839 learned_addr learned my addr 172.21.15.2:0/536923839 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:28.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.953+0000 7f9f0b7fe640 1 -- 172.21.15.2:0/536923839 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c2c1837120 msgr2=0x55c2c1846e50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:17:28.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.953+0000 7f9f0b7fe640 1 --2- 172.21.15.2:0/536923839 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c2c1837120 0x55c2c1846e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.953+0000 7f9f0b7fe640 1 -- 172.21.15.2:0/536923839 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c2c1837b80 msgr2=0x55c2c1847390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:28.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.953+0000 7f9f0b7fe640 1 --2- 172.21.15.2:0/536923839 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c2c1837b80 0x55c2c1847390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.953+0000 7f9f0b7fe640 1 -- 172.21.15.2:0/536923839 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2c150e3c0 con 0x55c2c1838840 2024-09-19T06:17:28.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.953+0000 7f9f0b7fe640 1 --2- 172.21.15.2:0/536923839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2c1838840 0x55c2c184cb80 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f9f04012e70 tx=0x7f9f04012ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6df10ce4a1486091 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:28.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.953+0000 7f9eeaffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:17:28.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.953+0000 7f9eeaffd640 1 -- 172.21.15.2:0/536923839 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f04021070 con 0x55c2c1838840 2024-09-19T06:17:28.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.954+0000 7f9eeaffd640 1 -- 172.21.15.2:0/536923839 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f9f0401b800 con 0x55c2c1838840 2024-09-19T06:17:28.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.954+0000 7f9f13dbc740 1 -- 172.21.15.2:0/536923839 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f04017070 con 0x55c2c1838840 2024-09-19T06:17:28.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.954+0000 7f9eeaffd640 1 -- 172.21.15.2:0/536923839 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9f0401ba00 con 0x55c2c1838840 2024-09-19T06:17:28.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.954+0000 7f9f13dbc740 10 client.16014 fetch_fsmap learned FSMap version 26 2024-09-19T06:17:28.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.954+0000 7f9f13dbc740 1 -- 172.21.15.2:0/536923839 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c2c1861c60 con 0x55c2c1838840 2024-09-19T06:17:28.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.954+0000 7f9eeaffd640 1 -- 172.21.15.2:0/536923839 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9f0401bba0 con 0x55c2c1838840 2024-09-19T06:17:28.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.955+0000 7f9eeaffd640 1 -- 172.21.15.2:0/536923839 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f9f04011070 con 0x55c2c1838840 2024-09-19T06:17:28.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.955+0000 7f9f13dbc740 10 client.16014 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:17:28.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.955+0000 7f9f13dbc740 10 client.16014 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:17:28.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.955+0000 7f9f13dbc740 20 client.16014 populate_metadata read hostname 'smithi002' 2024-09-19T06:17:28.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.955+0000 7f9f13dbc740 1 --2- 172.21.15.2:0/536923839 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55c2c18630c0 0x55c2c18654b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:28.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.955+0000 7f9f13dbc740 4 client.16014 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:17:28.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.955+0000 7f9f13dbc740 1 -- 172.21.15.2:0/536923839 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f9f04017070 con 0x55c2c18630c0 2024-09-19T06:17:28.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.957+0000 7f9f0affd640 1 --2- 172.21.15.2:0/536923839 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55c2c18630c0 0x55c2c18654b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:28.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.959+0000 7f9eeaffd640 10 client.16014 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:17:28.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.959+0000 7f9f0affd640 1 --2- 172.21.15.2:0/536923839 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55c2c18630c0 0x55c2c18654b0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=be8a5df6e2175f09 server_cookie=d28da330577665fc in_seq=0 out_seq=0 2024-09-19T06:17:28.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.960+0000 7f9eeaffd640 1 -- 172.21.15.2:0/536923839 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f9f04017070 con 0x55c2c18630c0 2024-09-19T06:17:28.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.961+0000 7f9eeaffd640 10 client.16014 handle_command_reply: tid=0 2024-09-19T06:17:28.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.961+0000 7f9f13dbc740 1 client.16014 shutdown 2024-09-19T06:17:28.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.961+0000 7f9f13dbc740 1 -- 172.21.15.2:0/536923839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2c1838840 msgr2=0x55c2c184cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:28.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.962+0000 7f9f13dbc740 1 --2- 172.21.15.2:0/536923839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2c1838840 0x55c2c184cb80 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f9f04012e70 tx=0x7f9f04012ea0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.962+0000 7f9f13dbc740 1 -- 172.21.15.2:0/536923839 shutdown_connections 2024-09-19T06:17:28.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.962+0000 7f9f13dbc740 1 --2- 172.21.15.2:0/536923839 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55c2c18630c0 0x55c2c18654b0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.962+0000 7f9f13dbc740 1 --2- 172.21.15.2:0/536923839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2c1838840 0x55c2c184cb80 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.962+0000 7f9f13dbc740 1 --2- 172.21.15.2:0/536923839 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c2c1837b80 0x55c2c1847390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.962+0000 7f9f13dbc740 1 --2- 172.21.15.2:0/536923839 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c2c1837120 0x55c2c1846e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.962+0000 7f9f13dbc740 1 -- 172.21.15.2:0/536923839 >> 172.21.15.2:0/536923839 conn(0x55c2c1800310 msgr2=0x55c2c18399a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:28.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.962+0000 7f9eeaffd640 0 client.16014 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:17:28.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.965+0000 7f9f13dbc740 1 -- 172.21.15.2:0/536923839 shutdown_connections 2024-09-19T06:17:28.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.965+0000 7f9f13dbc740 1 -- 172.21.15.2:0/536923839 wait complete. 2024-09-19T06:17:28.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.965+0000 7f9f13dbc740 20 client.16014 trim_cache size 0 max 16384 2024-09-19T06:17:28.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.993+0000 7f9f13dbc740 1 Processor -- start 2024-09-19T06:17:28.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.993+0000 7f9f13dbc740 1 -- start start 2024-09-19T06:17:28.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.993+0000 7f9f13dbc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2c1837120 0x55c2c184cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:28.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.993+0000 7f9f13dbc740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c2c1837b80 0x55c2c183e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:28.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.993+0000 7f9f13dbc740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c2c1838840 0x55c2c1832c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:28.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.993+0000 7f9f13dbc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c1ae050 con 0x55c2c1837120 2024-09-19T06:17:28.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.993+0000 7f9f13dbc740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c1ab920 con 0x55c2c1837b80 2024-09-19T06:17:28.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.993+0000 7f9f13dbc740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c1a9770 con 0x55c2c1838840 2024-09-19T06:17:28.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.994+0000 7f9f0affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2c1837120 0x55c2c184cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:28.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.994+0000 7f9f0affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2c1837120 0x55c2c184cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45782/0 (socket says 172.21.15.2:45782) 2024-09-19T06:17:28.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.994+0000 7f9f0affd640 1 -- 172.21.15.2:0/1301769860 learned_addr learned my addr 172.21.15.2:0/1301769860 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:28.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.994+0000 7f9f0affd640 1 -- 172.21.15.2:0/1301769860 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c2c1838840 msgr2=0x55c2c1832c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:28.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.994+0000 7f9f0affd640 1 --2- 172.21.15.2:0/1301769860 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c2c1838840 0x55c2c1832c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.994+0000 7f9f0a7fc640 1 --2- 172.21.15.2:0/1301769860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c2c1837b80 0x55c2c183e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:28.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.994+0000 7f9f0affd640 1 -- 172.21.15.2:0/1301769860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c2c1837b80 msgr2=0x55c2c183e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:28.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.994+0000 7f9f0affd640 1 --2- 172.21.15.2:0/1301769860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c2c1837b80 0x55c2c183e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.994+0000 7f9f0affd640 1 -- 172.21.15.2:0/1301769860 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2c1847700 con 0x55c2c1837120 2024-09-19T06:17:28.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.994+0000 7f9f0a7fc640 1 --2- 172.21.15.2:0/1301769860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c2c1837b80 0x55c2c183e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:17:28.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.994+0000 7f9f0affd640 1 --2- 172.21.15.2:0/1301769860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2c1837120 0x55c2c184cad0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x55c2c1865b40 tx=0x7f9efc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f77fb9ade6f5d53 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:28.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.995+0000 7f9ef17fa640 1 -- 172.21.15.2:0/1301769860 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9efc02c070 con 0x55c2c1837120 2024-09-19T06:17:28.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.995+0000 7f9ef17fa640 1 -- 172.21.15.2:0/1301769860 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9efc012d40 con 0x55c2c1837120 2024-09-19T06:17:28.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.995+0000 7f9ef17fa640 1 -- 172.21.15.2:0/1301769860 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9efc027e00 con 0x55c2c1837120 2024-09-19T06:17:29.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.996+0000 7f9f13dbc740 1 -- 172.21.15.2:0/1301769860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2c1837120 msgr2=0x55c2c184cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:29.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.996+0000 7f9f13dbc740 1 --2- 172.21.15.2:0/1301769860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2c1837120 0x55c2c184cad0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x55c2c1865b40 tx=0x7f9efc012000 comp rx=0 tx=0).stop 2024-09-19T06:17:29.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.996+0000 7f9f13dbc740 1 -- 172.21.15.2:0/1301769860 shutdown_connections 2024-09-19T06:17:29.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.996+0000 7f9f13dbc740 1 --2- 172.21.15.2:0/1301769860 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c2c1838840 0x55c2c1832c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:29.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.996+0000 7f9f13dbc740 1 --2- 172.21.15.2:0/1301769860 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c2c1837b80 0x55c2c183e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:29.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.996+0000 7f9f13dbc740 1 --2- 172.21.15.2:0/1301769860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2c1837120 0x55c2c184cad0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:29.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.996+0000 7f9f13dbc740 1 -- 172.21.15.2:0/1301769860 >> 172.21.15.2:0/1301769860 conn(0x55c2c1800310 msgr2=0x55c2c1832500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:29.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.996+0000 7f9f13dbc740 1 -- 172.21.15.2:0/1301769860 shutdown_connections 2024-09-19T06:17:29.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.996+0000 7f9f13dbc740 1 -- 172.21.15.2:0/1301769860 wait complete. 2024-09-19T06:17:29.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.997+0000 7f9f13dbc740 1 -- start start 2024-09-19T06:17:29.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.997+0000 7f9f13dbc740 1 Processor -- start 2024-09-19T06:17:29.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.997+0000 7f9f13dbc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2c1837120 0x55c2c18746c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:29.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.997+0000 7f9f13dbc740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c2c1837b80 0x55c2c1874c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:29.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.997+0000 7f9f13dbc740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c2c1838840 0x55c2c1875140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:29.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.997+0000 7f9f13dbc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c1a9de0 con 0x55c2c1837120 2024-09-19T06:17:29.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.997+0000 7f9f13dbc740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c1ab250 con 0x55c2c1837b80 2024-09-19T06:17:29.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.997+0000 7f9f13dbc740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c1aa4b0 con 0x55c2c1838840 2024-09-19T06:17:29.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.997+0000 7f9f13dbc740 10 client.0 _ll_register_callbacks cb 0x7f9f04009bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:29.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.998+0000 7f9f0affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2c1837120 0x55c2c18746c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:29.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.998+0000 7f9f0affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2c1837120 0x55c2c18746c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45788/0 (socket says 172.21.15.2:45788) 2024-09-19T06:17:29.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.998+0000 7f9f0affd640 1 -- 172.21.15.2:0/2713820510 learned_addr learned my addr 172.21.15.2:0/2713820510 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:29.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.998+0000 7f9f0b7fe640 1 --2- 172.21.15.2:0/2713820510 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c2c1838840 0x55c2c1875140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:29.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.998+0000 7f9f0a7fc640 1 --2- 172.21.15.2:0/2713820510 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c2c1837b80 0x55c2c1874c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:29.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.998+0000 7f9f0affd640 1 -- 172.21.15.2:0/2713820510 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c2c1838840 msgr2=0x55c2c1875140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:29.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.998+0000 7f9f0affd640 1 --2- 172.21.15.2:0/2713820510 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c2c1838840 0x55c2c1875140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:29.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.998+0000 7f9f0affd640 1 -- 172.21.15.2:0/2713820510 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c2c1837b80 msgr2=0x55c2c1874c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:29.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.998+0000 7f9f0affd640 1 --2- 172.21.15.2:0/2713820510 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c2c1837b80 0x55c2c1874c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:29.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.998+0000 7f9f0affd640 1 -- 172.21.15.2:0/2713820510 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2c1865910 con 0x55c2c1837120 2024-09-19T06:17:29.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.998+0000 7f9f0a7fc640 1 --2- 172.21.15.2:0/2713820510 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c2c1837b80 0x55c2c1874c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:17:29.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.998+0000 7f9f0affd640 1 --2- 172.21.15.2:0/2713820510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2c1837120 0x55c2c18746c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f9efc02a040 tx=0x7f9efc0094d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad070f9121047196 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:29.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.998+0000 7f9eeaffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:17:29.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.999+0000 7f9eeaffd640 1 -- 172.21.15.2:0/2713820510 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9efc037060 con 0x55c2c1837120 2024-09-19T06:17:29.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.999+0000 7f9eeaffd640 1 -- 172.21.15.2:0/2713820510 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f9efc012a90 con 0x55c2c1837120 2024-09-19T06:17:29.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.999+0000 7f9f13dbc740 1 -- 172.21.15.2:0/2713820510 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9efc012d40 con 0x55c2c1837120 2024-09-19T06:17:29.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.999+0000 7f9eeaffd640 1 -- 172.21.15.2:0/2713820510 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9efc02c040 con 0x55c2c1837120 2024-09-19T06:17:29.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.999+0000 7f9f13dbc740 10 client.16020 fetch_fsmap learned FSMap version 26 2024-09-19T06:17:29.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.999+0000 7f9f13dbc740 1 -- 172.21.15.2:0/2713820510 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c2c18cdb00 con 0x55c2c1837120 2024-09-19T06:17:29.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:28.999+0000 7f9eeaffd640 1 -- 172.21.15.2:0/2713820510 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9efc012d40 con 0x55c2c1837120 2024-09-19T06:17:29.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:29.000+0000 7f9eeaffd640 1 -- 172.21.15.2:0/2713820510 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f9efc026030 con 0x55c2c1837120 2024-09-19T06:17:29.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:29.000+0000 7f9f13dbc740 10 client.16020 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:17:29.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:29.000+0000 7f9f13dbc740 10 client.16020 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:17:29.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:29.000+0000 7f9f13dbc740 20 client.16020 populate_metadata read hostname 'smithi002' 2024-09-19T06:17:29.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:29.000+0000 7f9f13dbc740 1 --2- 172.21.15.2:0/2713820510 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55c2c18ce160 0x55c2c18d0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:29.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:29.000+0000 7f9f13dbc740 4 client.16020 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:17:29.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:29.000+0000 7f9f13dbc740 1 -- 172.21.15.2:0/2713820510 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c2c17aa860 con 0x55c2c18ce160 2024-09-19T06:17:29.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:29.000+0000 7f9f0a7fc640 1 --2- 172.21.15.2:0/2713820510 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55c2c18ce160 0x55c2c18d0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:29.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:29.001+0000 7f9eeaffd640 10 client.16020 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:17:29.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:29.001+0000 7f9f0a7fc640 1 --2- 172.21.15.2:0/2713820510 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55c2c18ce160 0x55c2c18d0580 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bfd7fd4bfb0fedf1 server_cookie=fe0e278dae58efc8 in_seq=0 out_seq=0 2024-09-19T06:17:29.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:29.002+0000 7f9eeaffd640 1 -- 172.21.15.2:0/2713820510 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c2c17aa860 con 0x55c2c18ce160 2024-09-19T06:17:29.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:29.002+0000 7f9eeaffd640 10 client.16020 handle_command_reply: tid=0 2024-09-19T06:17:29.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:29.002+0000 7f9f13dbc740 1 client.16020 shutdown 2024-09-19T06:17:29.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:29.002+0000 7f9f13dbc740 1 -- 172.21.15.2:0/2713820510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2c1837120 msgr2=0x55c2c18746c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:29.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:29.002+0000 7f9f13dbc740 1 --2- 172.21.15.2:0/2713820510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2c1837120 0x55c2c18746c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f9efc02a040 tx=0x7f9efc0094d0 comp rx=0 tx=0).stop 2024-09-19T06:17:29.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:29.002+0000 7f9f13dbc740 1 -- 172.21.15.2:0/2713820510 shutdown_connections 2024-09-19T06:17:29.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:29.002+0000 7f9f13dbc740 1 --2- 172.21.15.2:0/2713820510 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55c2c18ce160 0x55c2c18d0580 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:29.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:29.002+0000 7f9f13dbc740 1 --2- 172.21.15.2:0/2713820510 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c2c1838840 0x55c2c1875140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:29.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:29.002+0000 7f9f13dbc740 1 --2- 172.21.15.2:0/2713820510 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c2c1837b80 0x55c2c1874c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:29.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:29.002+0000 7f9f13dbc740 1 --2- 172.21.15.2:0/2713820510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2c1837120 0x55c2c18746c0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:29.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:29.002+0000 7f9f13dbc740 1 -- 172.21.15.2:0/2713820510 >> 172.21.15.2:0/2713820510 conn(0x55c2c1800310 msgr2=0x55c2c1832d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:29.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:29.002+0000 7f9eeaffd640 0 client.16020 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:17:29.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:29.002+0000 7f9f13dbc740 1 -- 172.21.15.2:0/2713820510 shutdown_connections 2024-09-19T06:17:29.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:29.002+0000 7f9f13dbc740 1 -- 172.21.15.2:0/2713820510 wait complete. 2024-09-19T06:17:29.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:29.003+0000 7f9f13dbc740 20 client.16020 trim_cache size 0 max 16384 2024-09-19T06:17:29.009 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:17:29.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:29.003+0000 7f9f119e3640 1 -- 172.21.15.2:0/4286922099 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9ef40a3430 msgr2=0x7f9ef40a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:29.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:29.003+0000 7f9f119e3640 1 --2- 172.21.15.2:0/4286922099 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9ef40a3430 0x7f9ef40a58f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9efc006fd0 tx=0x7f9efc006c40 comp rx=0 tx=0).stop 2024-09-19T06:17:29.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:29.003+0000 7f9f119e3640 1 -- 172.21.15.2:0/4286922099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f0c102780 msgr2=0x7f9f0c198a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:29.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:29.003+0000 7f9f119e3640 1 --2- 172.21.15.2:0/4286922099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f0c102780 0x7f9f0c198a80 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9f00005ab0 tx=0x7f9f00003d50 comp rx=0 tx=0).stop 2024-09-19T06:17:29.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:29.003+0000 7f9f119e3640 1 -- 172.21.15.2:0/4286922099 shutdown_connections 2024-09-19T06:17:29.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:29.003+0000 7f9f119e3640 1 --2- 172.21.15.2:0/4286922099 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9ef40a3430 0x7f9ef40a58f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:29.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:29.004+0000 7f9f119e3640 1 --2- 172.21.15.2:0/4286922099 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f0c106f00 0x7f9f0c19ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:29.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:29.004+0000 7f9f119e3640 1 --2- 172.21.15.2:0/4286922099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f0c102780 0x7f9f0c198a80 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:29.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:29.004+0000 7f9f119e3640 1 --2- 172.21.15.2:0/4286922099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f0c101dd0 0x7f9f0c198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:29.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:29.004+0000 7f9f119e3640 1 -- 172.21.15.2:0/4286922099 >> 172.21.15.2:0/4286922099 conn(0x7f9f0c0fd8b0 msgr2=0x7f9f0c0fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:29.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:29.004+0000 7f9f119e3640 1 -- 172.21.15.2:0/4286922099 shutdown_connections 2024-09-19T06:17:29.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:29.004+0000 7f9f119e3640 1 -- 172.21.15.2:0/4286922099 wait complete. 2024-09-19T06:17:29.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:17:29 smithi002 ceph-mon[30982]: pgmap v83: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 410 MiB/s wr, 107 op/s 2024-09-19T06:17:29.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:17:29 smithi090 ceph-mon[34497]: pgmap v83: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 410 MiB/s wr, 107 op/s 2024-09-19T06:17:29.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:17:29 smithi089 ceph-mon[34160]: pgmap v83: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 410 MiB/s wr, 107 op/s 2024-09-19T06:17:29.971 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:17:30.417 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:17:31.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.017+0000 7ff83d02c640 1 -- 172.21.15.2:0/3011062834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff838103740 msgr2=0x7ff838107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:31.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.017+0000 7ff83d02c640 1 --2- 172.21.15.2:0/3011062834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff838103740 0x7ff838107b80 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7ff82c009930 tx=0x7ff82c02a420 comp rx=0 tx=0).stop 2024-09-19T06:17:31.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.018+0000 7ff83d02c640 1 -- 172.21.15.2:0/3011062834 shutdown_connections 2024-09-19T06:17:31.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.018+0000 7ff83d02c640 1 --2- 172.21.15.2:0/3011062834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff838108290 0x7ff83810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.018+0000 7ff83d02c640 1 --2- 172.21.15.2:0/3011062834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff838103740 0x7ff838107b80 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.018+0000 7ff83d02c640 1 --2- 172.21.15.2:0/3011062834 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff838102d90 0x7ff838103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.018+0000 7ff83d02c640 1 -- 172.21.15.2:0/3011062834 >> 172.21.15.2:0/3011062834 conn(0x7ff8380fc7d0 msgr2=0x7ff8380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:31.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.018+0000 7ff83d02c640 1 -- 172.21.15.2:0/3011062834 shutdown_connections 2024-09-19T06:17:31.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.018+0000 7ff83d02c640 1 -- 172.21.15.2:0/3011062834 wait complete. 2024-09-19T06:17:31.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.019+0000 7ff83d02c640 1 Processor -- start 2024-09-19T06:17:31.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.020+0000 7ff83d02c640 1 -- start start 2024-09-19T06:17:31.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.020+0000 7ff83d02c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff838102d90 0x7ff838198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:31.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.020+0000 7ff83d02c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff838103740 0x7ff838198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:31.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.020+0000 7ff83d02c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff838108290 0x7ff83819cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:31.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.020+0000 7ff83d02c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff838112030 con 0x7ff838103740 2024-09-19T06:17:31.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.020+0000 7ff83d02c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff838111eb0 con 0x7ff838102d90 2024-09-19T06:17:31.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.020+0000 7ff83d02c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff8381121b0 con 0x7ff838108290 2024-09-19T06:17:31.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.021+0000 7ff83659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff838103740 0x7ff838198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:31.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.021+0000 7ff83659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff838103740 0x7ff838198b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45800/0 (socket says 172.21.15.2:45800) 2024-09-19T06:17:31.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.021+0000 7ff83659c640 1 -- 172.21.15.2:0/1617331191 learned_addr learned my addr 172.21.15.2:0/1617331191 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:31.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.021+0000 7ff836d9d640 1 --2- 172.21.15.2:0/1617331191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff838102d90 0x7ff838198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:31.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.021+0000 7ff83659c640 1 -- 172.21.15.2:0/1617331191 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff838108290 msgr2=0x7ff83819cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:31.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.021+0000 7ff83759e640 1 --2- 172.21.15.2:0/1617331191 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff838108290 0x7ff83819cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:31.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.022+0000 7ff83659c640 1 --2- 172.21.15.2:0/1617331191 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff838108290 0x7ff83819cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.023+0000 7ff83659c640 1 -- 172.21.15.2:0/1617331191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff838102d90 msgr2=0x7ff838198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:31.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.023+0000 7ff83659c640 1 --2- 172.21.15.2:0/1617331191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff838102d90 0x7ff838198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.023+0000 7ff83659c640 1 -- 172.21.15.2:0/1617331191 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff83819d5f0 con 0x7ff838103740 2024-09-19T06:17:31.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.023+0000 7ff83759e640 1 --2- 172.21.15.2:0/1617331191 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff838108290 0x7ff83819cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:17:31.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.024+0000 7ff836d9d640 1 --2- 172.21.15.2:0/1617331191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff838102d90 0x7ff838198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:31.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.024+0000 7ff83659c640 1 --2- 172.21.15.2:0/1617331191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff838103740 0x7ff838198b80 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7ff82c031440 tx=0x7ff82c003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:31.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.024+0000 7ff81ffff640 1 -- 172.21.15.2:0/1617331191 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff82c03f070 con 0x7ff838103740 2024-09-19T06:17:31.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.024+0000 7ff83d02c640 1 -- 172.21.15.2:0/1617331191 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff83819d880 con 0x7ff838103740 2024-09-19T06:17:31.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.024+0000 7ff81ffff640 1 -- 172.21.15.2:0/1617331191 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff82c031d60 con 0x7ff838103740 2024-09-19T06:17:31.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.025+0000 7ff83d02c640 1 -- 172.21.15.2:0/1617331191 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8381a51c0 con 0x7ff838103740 2024-09-19T06:17:31.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.025+0000 7ff81ffff640 1 -- 172.21.15.2:0/1617331191 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff82c03f070 con 0x7ff838103740 2024-09-19T06:17:31.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.030+0000 7ff81ffff640 1 -- 172.21.15.2:0/1617331191 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7ff82c042070 con 0x7ff838103740 2024-09-19T06:17:31.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.031+0000 7ff83f405740 1 Processor -- start 2024-09-19T06:17:31.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.031+0000 7ff83f405740 1 -- start start 2024-09-19T06:17:31.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.032+0000 7ff81ffff640 1 --2- 172.21.15.2:0/1617331191 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff8200a35b0 0x7ff8200a5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:31.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.032+0000 7ff81ffff640 1 -- 172.21.15.2:0/1617331191 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7ff82c0f04b0 con 0x7ff838103740 2024-09-19T06:17:31.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.032+0000 7ff83759e640 1 --2- 172.21.15.2:0/1617331191 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff8200a35b0 0x7ff8200a5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:31.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.032+0000 7ff83f405740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c8e4b2f840 0x55c8e4b2fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:31.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.032+0000 7ff83f405740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c8e4b2e120 0x55c8e4b2e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:31.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.033+0000 7ff83f405740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c8e4b2eb80 0x55c8e4b43f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:31.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.033+0000 7ff83f405740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c8e4a942f0 con 0x55c8e4b2eb80 2024-09-19T06:17:31.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.033+0000 7ff83f405740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55c8e4a3bcf0 con 0x55c8e4b2f840 2024-09-19T06:17:31.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.033+0000 7ff83f405740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55c8e4a902b0 con 0x55c8e4b2e120 2024-09-19T06:17:31.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.033+0000 7ff83659c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c8e4b2e120 0x55c8e4b2e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:31.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.033+0000 7ff83659c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c8e4b2e120 0x55c8e4b2e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:60030/0 (socket says 172.21.15.2:60030) 2024-09-19T06:17:31.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.033+0000 7ff83659c640 1 -- 172.21.15.2:0/886693875 learned_addr learned my addr 172.21.15.2:0/886693875 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:31.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.033+0000 7ff83759e640 1 --2- 172.21.15.2:0/886693875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c8e4b2eb80 0x55c8e4b43f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:31.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.033+0000 7ff83659c640 1 -- 172.21.15.2:0/886693875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c8e4b2f840 msgr2=0x55c8e4b2fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:31.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.033+0000 7ff83659c640 1 --2- 172.21.15.2:0/886693875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c8e4b2f840 0x55c8e4b2fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.033+0000 7ff83659c640 1 -- 172.21.15.2:0/886693875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c8e4b2eb80 msgr2=0x55c8e4b43f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:31.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.033+0000 7ff83659c640 1 --2- 172.21.15.2:0/886693875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c8e4b2eb80 0x55c8e4b43f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.033+0000 7ff83659c640 1 -- 172.21.15.2:0/886693875 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8e4a203a0 con 0x55c8e4b2e120 2024-09-19T06:17:31.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.033+0000 7ff83759e640 1 --2- 172.21.15.2:0/1617331191 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff8200a35b0 0x7ff8200a5a70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff830007e30 tx=0x7ff830007340 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:31.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.034+0000 7ff83659c640 1 --2- 172.21.15.2:0/886693875 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c8e4b2e120 0x55c8e4b2e560 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff82c000c00 tx=0x7ff82c003f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2706df2ccc30f3b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:31.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.034+0000 7ff81d7fa640 1 -- 172.21.15.2:0/886693875 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff82c0bc7c0 con 0x55c8e4b2e120 2024-09-19T06:17:31.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.034+0000 7ff81d7fa640 1 -- 172.21.15.2:0/886693875 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff82c0c0b70 con 0x55c8e4b2e120 2024-09-19T06:17:31.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.035+0000 7ff81d7fa640 1 -- 172.21.15.2:0/886693875 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff82c0c4fa0 con 0x55c8e4b2e120 2024-09-19T06:17:31.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.036+0000 7ff83f405740 1 -- 172.21.15.2:0/886693875 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c8e4b2e120 msgr2=0x55c8e4b2e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:31.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.036+0000 7ff83f405740 1 --2- 172.21.15.2:0/886693875 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c8e4b2e120 0x55c8e4b2e560 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff82c000c00 tx=0x7ff82c003f40 comp rx=0 tx=0).stop 2024-09-19T06:17:31.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.036+0000 7ff83f405740 1 -- 172.21.15.2:0/886693875 shutdown_connections 2024-09-19T06:17:31.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.036+0000 7ff83f405740 1 --2- 172.21.15.2:0/886693875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c8e4b2eb80 0x55c8e4b43f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.036+0000 7ff83f405740 1 --2- 172.21.15.2:0/886693875 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c8e4b2e120 0x55c8e4b2e560 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.036+0000 7ff83f405740 1 --2- 172.21.15.2:0/886693875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c8e4b2f840 0x55c8e4b2fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.036+0000 7ff83f405740 1 -- 172.21.15.2:0/886693875 >> 172.21.15.2:0/886693875 conn(0x55c8e4af7310 msgr2=0x55c8e4b2ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:31.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.036+0000 7ff83f405740 1 -- 172.21.15.2:0/886693875 shutdown_connections 2024-09-19T06:17:31.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.037+0000 7ff83f405740 1 -- 172.21.15.2:0/886693875 wait complete. 2024-09-19T06:17:31.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.037+0000 7ff83f405740 1 -- start start 2024-09-19T06:17:31.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.037+0000 7ff83f405740 1 Processor -- start 2024-09-19T06:17:31.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.037+0000 7ff83f405740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c8e4b2e120 0x55c8e4b43ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:31.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.038+0000 7ff83f405740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c8e4b2eb80 0x55c8e4b41170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:31.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.038+0000 7ff83f405740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c8e4b2f840 0x55c8e4b41780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:31.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.038+0000 7ff83759e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c8e4b2f840 0x55c8e4b41780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:31.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.038+0000 7ff83759e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c8e4b2f840 0x55c8e4b41780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45814/0 (socket says 172.21.15.2:45814) 2024-09-19T06:17:31.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.038+0000 7ff83659c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c8e4b2eb80 0x55c8e4b41170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:31.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.038+0000 7ff83659c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c8e4b2eb80 0x55c8e4b41170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:42292/0 (socket says 172.21.15.2:42292) 2024-09-19T06:17:31.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.038+0000 7ff83759e640 1 -- 172.21.15.2:0/2903681789 learned_addr learned my addr 172.21.15.2:0/2903681789 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:31.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.038+0000 7ff83f405740 1 -- 172.21.15.2:0/2903681789 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c8e4b446f0 con 0x55c8e4b2f840 2024-09-19T06:17:31.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.038+0000 7ff83f405740 1 -- 172.21.15.2:0/2903681789 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55c8e4a4f060 con 0x55c8e4b2eb80 2024-09-19T06:17:31.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.038+0000 7ff83f405740 1 -- 172.21.15.2:0/2903681789 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55c8e4b44870 con 0x55c8e4b2e120 2024-09-19T06:17:31.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.039+0000 7ff836d9d640 1 --2- 172.21.15.2:0/2903681789 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c8e4b2e120 0x55c8e4b43ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:31.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.039+0000 7ff83f405740 10 client.0 _ll_register_callbacks cb 0x55c8e47a28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:31.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.039+0000 7ff83759e640 1 -- 172.21.15.2:0/2903681789 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c8e4b2e120 msgr2=0x55c8e4b43ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:31.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.039+0000 7ff83759e640 1 --2- 172.21.15.2:0/2903681789 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c8e4b2e120 0x55c8e4b43ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.039+0000 7ff83759e640 1 -- 172.21.15.2:0/2903681789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c8e4b2eb80 msgr2=0x55c8e4b41170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:31.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.039+0000 7ff83759e640 1 --2- 172.21.15.2:0/2903681789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c8e4b2eb80 0x55c8e4b41170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.039+0000 7ff83759e640 1 -- 172.21.15.2:0/2903681789 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8e48053c0 con 0x55c8e4b2f840 2024-09-19T06:17:31.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.039+0000 7ff83759e640 1 --2- 172.21.15.2:0/2903681789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c8e4b2f840 0x55c8e4b41780 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7ff830007c10 tx=0x7ff830004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb4495703a67f48 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:31.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.039+0000 7ff81aff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:17:31.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.040+0000 7ff81aff5640 1 -- 172.21.15.2:0/2903681789 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83000ebe0 con 0x55c8e4b2f840 2024-09-19T06:17:31.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.040+0000 7ff83f405740 1 -- 172.21.15.2:0/2903681789 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff82c0c0b70 con 0x55c8e4b2f840 2024-09-19T06:17:31.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.040+0000 7ff81aff5640 1 -- 172.21.15.2:0/2903681789 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7ff83000ed80 con 0x55c8e4b2f840 2024-09-19T06:17:31.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.040+0000 7ff81aff5640 1 -- 172.21.15.2:0/2903681789 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff830024400 con 0x55c8e4b2f840 2024-09-19T06:17:31.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.040+0000 7ff83f405740 10 client.16032 fetch_fsmap learned FSMap version 26 2024-09-19T06:17:31.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.041+0000 7ff83f405740 1 -- 172.21.15.2:0/2903681789 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c8e4b50240 con 0x55c8e4b2f840 2024-09-19T06:17:31.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.041+0000 7ff81aff5640 1 -- 172.21.15.2:0/2903681789 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff82c0c0b70 con 0x55c8e4b2f840 2024-09-19T06:17:31.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.041+0000 7ff81aff5640 1 -- 172.21.15.2:0/2903681789 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7ff83001c850 con 0x55c8e4b2f840 2024-09-19T06:17:31.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.041+0000 7ff83f405740 10 client.16032 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:17:31.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.042+0000 7ff83f405740 10 client.16032 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:17:31.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.042+0000 7ff83f405740 20 client.16032 populate_metadata read hostname 'smithi002' 2024-09-19T06:17:31.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.042+0000 7ff83f405740 1 --2- 172.21.15.2:0/2903681789 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55c8e4b51990 0x55c8e4b53de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:31.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.042+0000 7ff83f405740 4 client.16032 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:17:31.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.042+0000 7ff83f405740 1 -- 172.21.15.2:0/2903681789 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c8e4aa1860 con 0x55c8e4b51990 2024-09-19T06:17:31.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.043+0000 7ff836d9d640 1 --2- 172.21.15.2:0/2903681789 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55c8e4b51990 0x55c8e4b53de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:31.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.044+0000 7ff836d9d640 1 --2- 172.21.15.2:0/2903681789 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55c8e4b51990 0x55c8e4b53de0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2934befee6fc6047 server_cookie=c79152730d360b70 in_seq=0 out_seq=0 2024-09-19T06:17:31.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.044+0000 7ff81aff5640 10 client.16032 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:17:31.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.045+0000 7ff81aff5640 1 -- 172.21.15.2:0/2903681789 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c8e4aa1860 con 0x55c8e4b51990 2024-09-19T06:17:31.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.045+0000 7ff81aff5640 10 client.16032 handle_command_reply: tid=0 2024-09-19T06:17:31.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.045+0000 7ff83f405740 1 client.16032 shutdown 2024-09-19T06:17:31.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.046+0000 7ff83f405740 1 -- 172.21.15.2:0/2903681789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c8e4b2f840 msgr2=0x55c8e4b41780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:31.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.046+0000 7ff83f405740 1 --2- 172.21.15.2:0/2903681789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c8e4b2f840 0x55c8e4b41780 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7ff830007c10 tx=0x7ff830004b50 comp rx=0 tx=0).stop 2024-09-19T06:17:31.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.046+0000 7ff83f405740 1 -- 172.21.15.2:0/2903681789 shutdown_connections 2024-09-19T06:17:31.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.046+0000 7ff83f405740 1 --2- 172.21.15.2:0/2903681789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c8e4b2f840 0x55c8e4b41780 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.046+0000 7ff83f405740 1 --2- 172.21.15.2:0/2903681789 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55c8e4b51990 0x55c8e4b53de0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.046+0000 7ff83f405740 1 --2- 172.21.15.2:0/2903681789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c8e4b2eb80 0x55c8e4b41170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.046+0000 7ff83f405740 1 --2- 172.21.15.2:0/2903681789 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c8e4b2e120 0x55c8e4b43ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.046+0000 7ff83f405740 1 -- 172.21.15.2:0/2903681789 >> 172.21.15.2:0/2903681789 conn(0x55c8e4af7310 msgr2=0x55c8e4b309a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:31.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.046+0000 7ff81aff5640 0 client.16032 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:17:31.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.046+0000 7ff83f405740 1 -- 172.21.15.2:0/2903681789 shutdown_connections 2024-09-19T06:17:31.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.046+0000 7ff83f405740 1 -- 172.21.15.2:0/2903681789 wait complete. 2024-09-19T06:17:31.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.047+0000 7ff83f405740 20 client.16032 trim_cache size 0 max 16384 2024-09-19T06:17:31.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.070+0000 7ff83f405740 1 Processor -- start 2024-09-19T06:17:31.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.070+0000 7ff83f405740 1 -- start start 2024-09-19T06:17:31.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.070+0000 7ff83f405740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c8e4b2e120 0x55c8e4b2ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:31.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.070+0000 7ff83f405740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c8e4b2eb80 0x55c8e4b4d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:31.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.070+0000 7ff83f405740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c8e4b2f840 0x55c8e4b596f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:31.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.070+0000 7ff83f405740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff8381ae010 con 0x55c8e4b2e120 2024-09-19T06:17:31.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.070+0000 7ff83f405740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff8381ab8e0 con 0x55c8e4b2f840 2024-09-19T06:17:31.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.070+0000 7ff83f405740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff8381a9730 con 0x55c8e4b2eb80 2024-09-19T06:17:31.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.071+0000 7ff836d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c8e4b2e120 0x55c8e4b2ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:31.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.071+0000 7ff836d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c8e4b2e120 0x55c8e4b2ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45826/0 (socket says 172.21.15.2:45826) 2024-09-19T06:17:31.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.071+0000 7ff836d9d640 1 -- 172.21.15.2:0/2519303835 learned_addr learned my addr 172.21.15.2:0/2519303835 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:31.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.071+0000 7ff83659c640 1 --2- 172.21.15.2:0/2519303835 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c8e4b2eb80 0x55c8e4b4d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:31.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.071+0000 7ff83759e640 1 --2- 172.21.15.2:0/2519303835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c8e4b2f840 0x55c8e4b596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:31.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.071+0000 7ff836d9d640 1 -- 172.21.15.2:0/2519303835 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c8e4b2eb80 msgr2=0x55c8e4b4d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:31.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.071+0000 7ff836d9d640 1 --2- 172.21.15.2:0/2519303835 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c8e4b2eb80 0x55c8e4b4d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.071+0000 7ff836d9d640 1 -- 172.21.15.2:0/2519303835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c8e4b2f840 msgr2=0x55c8e4b596f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:31.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.071+0000 7ff836d9d640 1 --2- 172.21.15.2:0/2519303835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c8e4b2f840 0x55c8e4b596f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.071+0000 7ff836d9d640 1 -- 172.21.15.2:0/2519303835 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8e4aa7e70 con 0x55c8e4b2e120 2024-09-19T06:17:31.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.072+0000 7ff836d9d640 1 --2- 172.21.15.2:0/2519303835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c8e4b2e120 0x55c8e4b2ae10 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff828009d20 tx=0x7ff828016800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee0f6ae0b42fb45 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:31.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.072+0000 7ff81cff9640 1 -- 172.21.15.2:0/2519303835 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8280059c0 con 0x55c8e4b2e120 2024-09-19T06:17:31.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.072+0000 7ff81cff9640 1 -- 172.21.15.2:0/2519303835 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff82801f030 con 0x55c8e4b2e120 2024-09-19T06:17:31.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.072+0000 7ff81cff9640 1 -- 172.21.15.2:0/2519303835 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff828023630 con 0x55c8e4b2e120 2024-09-19T06:17:31.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.073+0000 7ff83f405740 1 -- 172.21.15.2:0/2519303835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c8e4b2e120 msgr2=0x55c8e4b2ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:31.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.073+0000 7ff83f405740 1 --2- 172.21.15.2:0/2519303835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c8e4b2e120 0x55c8e4b2ae10 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff828009d20 tx=0x7ff828016800 comp rx=0 tx=0).stop 2024-09-19T06:17:31.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.073+0000 7ff83f405740 1 -- 172.21.15.2:0/2519303835 shutdown_connections 2024-09-19T06:17:31.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.073+0000 7ff83f405740 1 --2- 172.21.15.2:0/2519303835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c8e4b2f840 0x55c8e4b596f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.073+0000 7ff83f405740 1 --2- 172.21.15.2:0/2519303835 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c8e4b2eb80 0x55c8e4b4d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.073+0000 7ff83f405740 1 --2- 172.21.15.2:0/2519303835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c8e4b2e120 0x55c8e4b2ae10 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.073+0000 7ff83f405740 1 -- 172.21.15.2:0/2519303835 >> 172.21.15.2:0/2519303835 conn(0x55c8e4af7310 msgr2=0x55c8e4b2a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:31.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.073+0000 7ff83f405740 1 -- 172.21.15.2:0/2519303835 shutdown_connections 2024-09-19T06:17:31.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.073+0000 7ff83f405740 1 -- 172.21.15.2:0/2519303835 wait complete. 2024-09-19T06:17:31.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.074+0000 7ff83f405740 1 -- start start 2024-09-19T06:17:31.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.074+0000 7ff83f405740 1 Processor -- start 2024-09-19T06:17:31.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.076+0000 7ff83f405740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c8e4b2eb80 0x55c8e4b4a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:31.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.076+0000 7ff83f405740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c8e4b2f840 0x55c8e4b47390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:31.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.076+0000 7ff83f405740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c8e4b478d0 0x55c8e4b47d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:31.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.076+0000 7ff83f405740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff8381a9da0 con 0x55c8e4b478d0 2024-09-19T06:17:31.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.076+0000 7ff83f405740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff8381ab210 con 0x55c8e4b2eb80 2024-09-19T06:17:31.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.076+0000 7ff83f405740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff8381aa470 con 0x55c8e4b2f840 2024-09-19T06:17:31.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.076+0000 7ff83f405740 10 client.0 _ll_register_callbacks cb 0x7ff830014040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:31.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.076+0000 7ff83759e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c8e4b478d0 0x55c8e4b47d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:31.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.076+0000 7ff83759e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c8e4b478d0 0x55c8e4b47d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45832/0 (socket says 172.21.15.2:45832) 2024-09-19T06:17:31.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.076+0000 7ff83759e640 1 -- 172.21.15.2:0/3619673598 learned_addr learned my addr 172.21.15.2:0/3619673598 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:31.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.076+0000 7ff836d9d640 1 --2- 172.21.15.2:0/3619673598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c8e4b2eb80 0x55c8e4b4a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:31.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.076+0000 7ff83659c640 1 --2- 172.21.15.2:0/3619673598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c8e4b2f840 0x55c8e4b47390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:31.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.077+0000 7ff83759e640 1 -- 172.21.15.2:0/3619673598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c8e4b2f840 msgr2=0x55c8e4b47390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:31.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.077+0000 7ff83759e640 1 --2- 172.21.15.2:0/3619673598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c8e4b2f840 0x55c8e4b47390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.077+0000 7ff83759e640 1 -- 172.21.15.2:0/3619673598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c8e4b2eb80 msgr2=0x55c8e4b4a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:31.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.077+0000 7ff83759e640 1 --2- 172.21.15.2:0/3619673598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c8e4b2eb80 0x55c8e4b4a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.077+0000 7ff83759e640 1 -- 172.21.15.2:0/3619673598 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8e4bbb6d0 con 0x55c8e4b478d0 2024-09-19T06:17:31.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.077+0000 7ff83759e640 1 --2- 172.21.15.2:0/3619673598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c8e4b478d0 0x55c8e4b47d50 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff83000cef0 tx=0x7ff83001c6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87e94db3ac362ab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:31.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.077+0000 7ff81aff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:17:31.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.077+0000 7ff81aff5640 1 -- 172.21.15.2:0/3619673598 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83003a020 con 0x55c8e4b478d0 2024-09-19T06:17:31.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.077+0000 7ff81aff5640 1 -- 172.21.15.2:0/3619673598 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7ff83001b660 con 0x55c8e4b478d0 2024-09-19T06:17:31.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.078+0000 7ff83f405740 1 -- 172.21.15.2:0/3619673598 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff82801f030 con 0x55c8e4b478d0 2024-09-19T06:17:31.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.078+0000 7ff81aff5640 1 -- 172.21.15.2:0/3619673598 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff830031050 con 0x55c8e4b478d0 2024-09-19T06:17:31.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.078+0000 7ff83f405740 10 client.16038 fetch_fsmap learned FSMap version 26 2024-09-19T06:17:31.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.078+0000 7ff83f405740 1 -- 172.21.15.2:0/3619673598 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c8e4bbc880 con 0x55c8e4b478d0 2024-09-19T06:17:31.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.078+0000 7ff81aff5640 1 -- 172.21.15.2:0/3619673598 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff82801f030 con 0x55c8e4b478d0 2024-09-19T06:17:31.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.078+0000 7ff81aff5640 1 -- 172.21.15.2:0/3619673598 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7ff8300245a0 con 0x55c8e4b478d0 2024-09-19T06:17:31.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.078+0000 7ff83f405740 10 client.16038 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:17:31.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.078+0000 7ff83f405740 10 client.16038 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:17:31.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.079+0000 7ff83f405740 20 client.16038 populate_metadata read hostname 'smithi002' 2024-09-19T06:17:31.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.079+0000 7ff83f405740 1 --2- 172.21.15.2:0/3619673598 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55c8e4bbcf40 0x55c8e4bbf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:31.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.079+0000 7ff83f405740 4 client.16038 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:17:31.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.079+0000 7ff83f405740 1 -- 172.21.15.2:0/3619673598 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c8e4a9bd70 con 0x55c8e4bbcf40 2024-09-19T06:17:31.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.079+0000 7ff836d9d640 1 --2- 172.21.15.2:0/3619673598 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55c8e4bbcf40 0x55c8e4bbf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:31.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.080+0000 7ff836d9d640 1 --2- 172.21.15.2:0/3619673598 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55c8e4bbcf40 0x55c8e4bbf360 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=838418731cb43cb0 server_cookie=582ae4d1ef7efbbd in_seq=0 out_seq=0 2024-09-19T06:17:31.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.080+0000 7ff81aff5640 10 client.16038 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:17:31.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.081+0000 7ff81aff5640 1 -- 172.21.15.2:0/3619673598 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c8e4a9bd70 con 0x55c8e4bbcf40 2024-09-19T06:17:31.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.081+0000 7ff81aff5640 10 client.16038 handle_command_reply: tid=0 2024-09-19T06:17:31.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.081+0000 7ff83f405740 1 client.16038 shutdown 2024-09-19T06:17:31.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.081+0000 7ff83f405740 1 -- 172.21.15.2:0/3619673598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c8e4b478d0 msgr2=0x55c8e4b47d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:31.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.081+0000 7ff83f405740 1 --2- 172.21.15.2:0/3619673598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c8e4b478d0 0x55c8e4b47d50 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff83000cef0 tx=0x7ff83001c6b0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.081+0000 7ff83f405740 1 -- 172.21.15.2:0/3619673598 shutdown_connections 2024-09-19T06:17:31.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.081+0000 7ff83f405740 1 --2- 172.21.15.2:0/3619673598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c8e4b478d0 0x55c8e4b47d50 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.081+0000 7ff83f405740 1 --2- 172.21.15.2:0/3619673598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c8e4b2f840 0x55c8e4b47390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.081+0000 7ff83f405740 1 --2- 172.21.15.2:0/3619673598 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55c8e4bbcf40 0x55c8e4bbf360 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.081+0000 7ff83f405740 1 --2- 172.21.15.2:0/3619673598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c8e4b2eb80 0x55c8e4b4a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.081+0000 7ff83f405740 1 -- 172.21.15.2:0/3619673598 >> 172.21.15.2:0/3619673598 conn(0x55c8e4af7310 msgr2=0x55c8e4b429d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:31.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.082+0000 7ff81aff5640 0 client.16038 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:17:31.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.082+0000 7ff83f405740 1 -- 172.21.15.2:0/3619673598 shutdown_connections 2024-09-19T06:17:31.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.082+0000 7ff83f405740 1 -- 172.21.15.2:0/3619673598 wait complete. 2024-09-19T06:17:31.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.082+0000 7ff83f405740 20 client.16038 trim_cache size 0 max 16384 2024-09-19T06:17:31.085 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:17:31.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.083+0000 7ff83d02c640 1 -- 172.21.15.2:0/1617331191 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff8200a35b0 msgr2=0x7ff8200a5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:31.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.083+0000 7ff83d02c640 1 --2- 172.21.15.2:0/1617331191 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff8200a35b0 0x7ff8200a5a70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff830007e30 tx=0x7ff830007340 comp rx=0 tx=0).stop 2024-09-19T06:17:31.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.083+0000 7ff83d02c640 1 -- 172.21.15.2:0/1617331191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff838103740 msgr2=0x7ff838198b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:31.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.083+0000 7ff83d02c640 1 --2- 172.21.15.2:0/1617331191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff838103740 0x7ff838198b80 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7ff82c031440 tx=0x7ff82c003d50 comp rx=0 tx=0).stop 2024-09-19T06:17:31.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.083+0000 7ff83d02c640 1 -- 172.21.15.2:0/1617331191 shutdown_connections 2024-09-19T06:17:31.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.083+0000 7ff83d02c640 1 --2- 172.21.15.2:0/1617331191 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff8200a35b0 0x7ff8200a5a70 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.083+0000 7ff83d02c640 1 --2- 172.21.15.2:0/1617331191 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff838108290 0x7ff83819cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.083+0000 7ff83d02c640 1 --2- 172.21.15.2:0/1617331191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff838103740 0x7ff838198b80 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.083+0000 7ff83d02c640 1 --2- 172.21.15.2:0/1617331191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff838102d90 0x7ff838198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:31.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.083+0000 7ff83d02c640 1 -- 172.21.15.2:0/1617331191 >> 172.21.15.2:0/1617331191 conn(0x7ff8380fc7d0 msgr2=0x7ff838105e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:31.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.083+0000 7ff83d02c640 1 -- 172.21.15.2:0/1617331191 shutdown_connections 2024-09-19T06:17:31.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:31.083+0000 7ff83d02c640 1 -- 172.21.15.2:0/1617331191 wait complete. 2024-09-19T06:17:31.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:17:31 smithi002 ceph-mon[30982]: pgmap v84: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 698 MiB/s wr, 184 op/s 2024-09-19T06:17:31.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:17:31 smithi090 ceph-mon[34497]: pgmap v84: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 698 MiB/s wr, 184 op/s 2024-09-19T06:17:31.775 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-19T06:17:31.776 INFO:tasks.workunit.client.0.smithi002.stdout: Children see throughput for 1 rewriters = 714071.50 kB/sec 2024-09-19T06:17:31.776 INFO:tasks.workunit.client.0.smithi002.stdout: Parent sees throughput for 1 rewriters = 714060.02 kB/sec 2024-09-19T06:17:31.776 INFO:tasks.workunit.client.0.smithi002.stdout: Min throughput per process = 714071.50 kB/sec 2024-09-19T06:17:31.776 INFO:tasks.workunit.client.0.smithi002.stdout: Max throughput per process = 714071.50 kB/sec 2024-09-19T06:17:31.776 INFO:tasks.workunit.client.0.smithi002.stdout: Avg throughput per process = 714071.50 kB/sec 2024-09-19T06:17:31.776 INFO:tasks.workunit.client.0.smithi002.stdout: Min xfer = 10485760.00 kB 2024-09-19T06:17:31.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:17:31 smithi089 ceph-mon[34160]: pgmap v84: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 698 MiB/s wr, 184 op/s 2024-09-19T06:17:33.633 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:17:33 smithi002 ceph-mon[30982]: pgmap v85: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 581 MiB/s wr, 152 op/s 2024-09-19T06:17:33.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:17:33 smithi090 ceph-mon[34497]: pgmap v85: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 581 MiB/s wr, 152 op/s 2024-09-19T06:17:33.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:17:33 smithi089 ceph-mon[34160]: pgmap v85: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 581 MiB/s wr, 152 op/s 2024-09-19T06:17:34.672 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:17:34.672 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:17:34.944 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:17:35.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.422+0000 7f67b4450640 1 -- 172.21.15.2:0/297788394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67ac102790 msgr2=0x7f67ac1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:35.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.422+0000 7f67b4450640 1 --2- 172.21.15.2:0/297788394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67ac102790 0x7f67ac1067e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f679c009900 tx=0x7f679c02a410 comp rx=0 tx=0).stop 2024-09-19T06:17:35.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.422+0000 7f67b4450640 1 -- 172.21.15.2:0/297788394 shutdown_connections 2024-09-19T06:17:35.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.422+0000 7f67b4450640 1 --2- 172.21.15.2:0/297788394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67ac106f10 0x7f67ac10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.423+0000 7f67b4450640 1 --2- 172.21.15.2:0/297788394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67ac102790 0x7f67ac1067e0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.423+0000 7f67b4450640 1 --2- 172.21.15.2:0/297788394 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f67ac101de0 0x7f67ac1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.423+0000 7f67b4450640 1 -- 172.21.15.2:0/297788394 >> 172.21.15.2:0/297788394 conn(0x7f67ac0fd8c0 msgr2=0x7f67ac0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:35.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.423+0000 7f67b4450640 1 -- 172.21.15.2:0/297788394 shutdown_connections 2024-09-19T06:17:35.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.423+0000 7f67b4450640 1 -- 172.21.15.2:0/297788394 wait complete. 2024-09-19T06:17:35.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.423+0000 7f67b4450640 1 Processor -- start 2024-09-19T06:17:35.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.423+0000 7f67b4450640 1 -- start start 2024-09-19T06:17:35.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.423+0000 7f67b4450640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f67ac101de0 0x7f67ac198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:35.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.423+0000 7f67b4450640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67ac102790 0x7f67ac198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:35.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.423+0000 7f67b4450640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67ac106f10 0x7f67ac19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:35.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.423+0000 7f67b4450640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f67ac111e70 con 0x7f67ac102790 2024-09-19T06:17:35.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.423+0000 7f67b4450640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f67ac111cf0 con 0x7f67ac106f10 2024-09-19T06:17:35.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.423+0000 7f67b4450640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f67ac111ff0 con 0x7f67ac101de0 2024-09-19T06:17:35.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.423+0000 7f67b19eb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67ac102790 0x7f67ac198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:35.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.424+0000 7f67b19eb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67ac102790 0x7f67ac198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32848/0 (socket says 172.21.15.2:32848) 2024-09-19T06:17:35.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.424+0000 7f67b19eb640 1 -- 172.21.15.2:0/2316732208 learned_addr learned my addr 172.21.15.2:0/2316732208 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:35.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.424+0000 7f67b29ed640 1 --2- 172.21.15.2:0/2316732208 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67ac106f10 0x7f67ac19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:35.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.424+0000 7f67b21ec640 1 --2- 172.21.15.2:0/2316732208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f67ac101de0 0x7f67ac198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:35.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.424+0000 7f67b19eb640 1 -- 172.21.15.2:0/2316732208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f67ac101de0 msgr2=0x7f67ac198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:35.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.424+0000 7f67b19eb640 1 --2- 172.21.15.2:0/2316732208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f67ac101de0 0x7f67ac198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.424+0000 7f67b19eb640 1 -- 172.21.15.2:0/2316732208 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67ac106f10 msgr2=0x7f67ac19cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:35.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.424+0000 7f67b19eb640 1 --2- 172.21.15.2:0/2316732208 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67ac106f10 0x7f67ac19cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.424+0000 7f67b19eb640 1 -- 172.21.15.2:0/2316732208 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67ac19d3e0 con 0x7f67ac102790 2024-09-19T06:17:35.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.424+0000 7f67b21ec640 1 --2- 172.21.15.2:0/2316732208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f67ac101de0 0x7f67ac198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:17:35.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.424+0000 7f67b19eb640 1 --2- 172.21.15.2:0/2316732208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67ac102790 0x7f67ac198970 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f679c005ab0 tx=0x7f679c003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:35.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.424+0000 7f67a37fe640 1 -- 172.21.15.2:0/2316732208 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f679c03f070 con 0x7f67ac102790 2024-09-19T06:17:35.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.424+0000 7f67a37fe640 1 -- 172.21.15.2:0/2316732208 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f679c031d60 con 0x7f67ac102790 2024-09-19T06:17:35.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.424+0000 7f67b4450640 1 -- 172.21.15.2:0/2316732208 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67ac19d670 con 0x7f67ac102790 2024-09-19T06:17:35.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.424+0000 7f67a37fe640 1 -- 172.21.15.2:0/2316732208 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f679c035030 con 0x7f67ac102790 2024-09-19T06:17:35.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.424+0000 7f67b4450640 1 -- 172.21.15.2:0/2316732208 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67ac1a4fb0 con 0x7f67ac102790 2024-09-19T06:17:35.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.426+0000 7f67a37fe640 1 -- 172.21.15.2:0/2316732208 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f679c042070 con 0x7f67ac102790 2024-09-19T06:17:35.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.427+0000 7f67b6829740 1 Processor -- start 2024-09-19T06:17:35.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.427+0000 7f67b6829740 1 -- start start 2024-09-19T06:17:35.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.427+0000 7f67b6829740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de8a674a40 0x55de8a674e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:35.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.427+0000 7f67b6829740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de8a675360 0x55de8a683c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:35.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.427+0000 7f67b6829740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de8a684150 0x55de8a686540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:35.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.427+0000 7f67b6829740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55de8a5da280 con 0x55de8a674a40 2024-09-19T06:17:35.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.427+0000 7f67b6829740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55de8a581b10 con 0x55de8a684150 2024-09-19T06:17:35.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.427+0000 7f67b6829740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55de8a5d6240 con 0x55de8a675360 2024-09-19T06:17:35.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.427+0000 7f67a37fe640 1 --2- 172.21.15.2:0/2316732208 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f67980a3430 0x7f67980a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:35.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.427+0000 7f67b29ed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de8a674a40 0x55de8a674e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:35.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.427+0000 7f67b29ed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de8a674a40 0x55de8a674e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32862/0 (socket says 172.21.15.2:32862) 2024-09-19T06:17:35.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.427+0000 7f67b29ed640 1 -- 172.21.15.2:0/3642091477 learned_addr learned my addr 172.21.15.2:0/3642091477 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:35.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.427+0000 7f67b29ed640 1 --2- 172.21.15.2:0/2316732208 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f67980a3430 0x7f67980a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:35.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.428+0000 7f67b21ec640 1 --2- 172.21.15.2:0/3642091477 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de8a675360 0x55de8a683c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:35.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.428+0000 7f67b19eb640 1 --2- 172.21.15.2:0/3642091477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de8a684150 0x55de8a686540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:35.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.428+0000 7f67a37fe640 1 -- 172.21.15.2:0/2316732208 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f679c0f05b0 con 0x7f67ac102790 2024-09-19T06:17:35.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.428+0000 7f67b29ed640 1 -- 172.21.15.2:0/3642091477 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de8a675360 msgr2=0x55de8a683c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:35.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.428+0000 7f67b29ed640 1 --2- 172.21.15.2:0/3642091477 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de8a675360 0x55de8a683c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.428+0000 7f67b29ed640 1 -- 172.21.15.2:0/3642091477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de8a684150 msgr2=0x55de8a686540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:35.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.428+0000 7f67b29ed640 1 --2- 172.21.15.2:0/3642091477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de8a684150 0x55de8a686540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.428+0000 7f67b29ed640 1 -- 172.21.15.2:0/3642091477 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de8a58e1f0 con 0x55de8a674a40 2024-09-19T06:17:35.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.428+0000 7f67b19eb640 1 --2- 172.21.15.2:0/3642091477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de8a684150 0x55de8a686540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:17:35.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.428+0000 7f67b29ed640 1 --2- 172.21.15.2:0/3642091477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de8a674a40 0x55de8a674e20 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f67a4012d00 tx=0x7f67a4010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30866842ce352171 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:35.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.428+0000 7f67b29ed640 1 --2- 172.21.15.2:0/2316732208 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f67980a3430 0x7f67980a58f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f67a4010c40 tx=0x7f67a4017000 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:35.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.428+0000 7f67a0dea640 1 -- 172.21.15.2:0/3642091477 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a4024070 con 0x55de8a674a40 2024-09-19T06:17:35.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.428+0000 7f67a0dea640 1 -- 172.21.15.2:0/3642091477 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f67a4012520 con 0x55de8a674a40 2024-09-19T06:17:35.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.428+0000 7f67a0dea640 1 -- 172.21.15.2:0/3642091477 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a4005080 con 0x55de8a674a40 2024-09-19T06:17:35.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.429+0000 7f67b6829740 1 -- 172.21.15.2:0/3642091477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de8a674a40 msgr2=0x55de8a674e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:35.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.429+0000 7f67b6829740 1 --2- 172.21.15.2:0/3642091477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de8a674a40 0x55de8a674e20 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f67a4012d00 tx=0x7f67a4010740 comp rx=0 tx=0).stop 2024-09-19T06:17:35.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.429+0000 7f67b6829740 1 -- 172.21.15.2:0/3642091477 shutdown_connections 2024-09-19T06:17:35.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.429+0000 7f67b6829740 1 --2- 172.21.15.2:0/3642091477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de8a684150 0x55de8a686540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.429+0000 7f67b6829740 1 --2- 172.21.15.2:0/3642091477 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de8a675360 0x55de8a683c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.429+0000 7f67b6829740 1 --2- 172.21.15.2:0/3642091477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de8a674a40 0x55de8a674e20 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.429+0000 7f67b6829740 1 -- 172.21.15.2:0/3642091477 >> 172.21.15.2:0/3642091477 conn(0x55de8a6710f0 msgr2=0x55de8a6714d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:35.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.429+0000 7f67b6829740 1 -- 172.21.15.2:0/3642091477 shutdown_connections 2024-09-19T06:17:35.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.429+0000 7f67b6829740 1 -- 172.21.15.2:0/3642091477 wait complete. 2024-09-19T06:17:35.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.429+0000 7f67b6829740 1 -- start start 2024-09-19T06:17:35.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.429+0000 7f67b6829740 1 Processor -- start 2024-09-19T06:17:35.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.430+0000 7f67b6829740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de8a674a40 0x55de8a6810b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:35.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.430+0000 7f67b6829740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de8a675360 0x55de8a6815f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:35.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.430+0000 7f67b6829740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de8a684150 0x55de8a681b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:35.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.430+0000 7f67b6829740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55de8a686d20 con 0x55de8a675360 2024-09-19T06:17:35.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.430+0000 7f67b6829740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55de8a594f10 con 0x55de8a684150 2024-09-19T06:17:35.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.430+0000 7f67b6829740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55de8a686ea0 con 0x55de8a674a40 2024-09-19T06:17:35.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.430+0000 7f67b6829740 10 client.0 _ll_register_callbacks cb 0x55de8a55da40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:35.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.430+0000 7f67b19eb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de8a675360 0x55de8a6815f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:35.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.430+0000 7f67b19eb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de8a675360 0x55de8a6815f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32878/0 (socket says 172.21.15.2:32878) 2024-09-19T06:17:35.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.430+0000 7f67b19eb640 1 -- 172.21.15.2:0/4123057292 learned_addr learned my addr 172.21.15.2:0/4123057292 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:35.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.430+0000 7f67b21ec640 1 --2- 172.21.15.2:0/4123057292 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de8a674a40 0x55de8a6810b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:35.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.430+0000 7f67b29ed640 1 --2- 172.21.15.2:0/4123057292 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de8a684150 0x55de8a681b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:35.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.430+0000 7f67b19eb640 1 -- 172.21.15.2:0/4123057292 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de8a674a40 msgr2=0x55de8a6810b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:35.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.430+0000 7f67b19eb640 1 --2- 172.21.15.2:0/4123057292 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de8a674a40 0x55de8a6810b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.430+0000 7f67b19eb640 1 -- 172.21.15.2:0/4123057292 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de8a684150 msgr2=0x55de8a681b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:35.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.430+0000 7f67b19eb640 1 --2- 172.21.15.2:0/4123057292 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de8a684150 0x55de8a681b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.430+0000 7f67b19eb640 1 -- 172.21.15.2:0/4123057292 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de8a34b6a0 con 0x55de8a675360 2024-09-19T06:17:35.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.430+0000 7f67b29ed640 1 --2- 172.21.15.2:0/4123057292 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de8a684150 0x55de8a681b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:17:35.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.430+0000 7f67b19eb640 1 --2- 172.21.15.2:0/4123057292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de8a675360 0x55de8a6815f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f679c0b9230 tx=0x7f679c0bc6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9edd9f7fd4b10980 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:35.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.430+0000 7f6795ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:17:35.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.430+0000 7f6795ffb640 1 -- 172.21.15.2:0/4123057292 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f679c049040 con 0x55de8a675360 2024-09-19T06:17:35.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.431+0000 7f67b6829740 1 -- 172.21.15.2:0/4123057292 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67a4012520 con 0x55de8a675360 2024-09-19T06:17:35.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.431+0000 7f6795ffb640 1 -- 172.21.15.2:0/4123057292 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f679c0edf50 con 0x55de8a675360 2024-09-19T06:17:35.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.431+0000 7f6795ffb640 1 -- 172.21.15.2:0/4123057292 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f679c0bcf60 con 0x55de8a675360 2024-09-19T06:17:35.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.431+0000 7f67b6829740 10 client.16050 fetch_fsmap learned FSMap version 26 2024-09-19T06:17:35.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.431+0000 7f67b6829740 1 -- 172.21.15.2:0/4123057292 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55de8a692930 con 0x55de8a675360 2024-09-19T06:17:35.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.431+0000 7f6795ffb640 1 -- 172.21.15.2:0/4123057292 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f67a4012520 con 0x55de8a675360 2024-09-19T06:17:35.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.431+0000 7f6795ffb640 1 -- 172.21.15.2:0/4123057292 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f679c0bcac0 con 0x55de8a675360 2024-09-19T06:17:35.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.431+0000 7f67b6829740 10 client.16050 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:17:35.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.431+0000 7f67b6829740 10 client.16050 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:17:35.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.431+0000 7f67b6829740 20 client.16050 populate_metadata read hostname 'smithi002' 2024-09-19T06:17:35.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.431+0000 7f67b6829740 1 --2- 172.21.15.2:0/4123057292 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55de8a693dc0 0x55de8a6961d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:35.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.431+0000 7f67b6829740 4 client.16050 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:17:35.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.431+0000 7f67b6829740 1 -- 172.21.15.2:0/4123057292 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de8a5e77f0 con 0x55de8a693dc0 2024-09-19T06:17:35.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.431+0000 7f67b21ec640 1 --2- 172.21.15.2:0/4123057292 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55de8a693dc0 0x55de8a6961d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:35.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.432+0000 7f67b21ec640 1 --2- 172.21.15.2:0/4123057292 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55de8a693dc0 0x55de8a6961d0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e40ae72d7f7a6ed server_cookie=644517b2d71ae031 in_seq=0 out_seq=0 2024-09-19T06:17:35.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.432+0000 7f6795ffb640 10 client.16050 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:17:35.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.433+0000 7f6795ffb640 1 -- 172.21.15.2:0/4123057292 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55de8a5e77f0 con 0x55de8a693dc0 2024-09-19T06:17:35.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.433+0000 7f6795ffb640 10 client.16050 handle_command_reply: tid=0 2024-09-19T06:17:35.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.433+0000 7f67b6829740 1 client.16050 shutdown 2024-09-19T06:17:35.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.433+0000 7f67b6829740 1 -- 172.21.15.2:0/4123057292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de8a675360 msgr2=0x55de8a6815f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:35.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.433+0000 7f67b6829740 1 --2- 172.21.15.2:0/4123057292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de8a675360 0x55de8a6815f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f679c0b9230 tx=0x7f679c0bc6f0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.433+0000 7f67b6829740 1 -- 172.21.15.2:0/4123057292 shutdown_connections 2024-09-19T06:17:35.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.433+0000 7f67b6829740 1 --2- 172.21.15.2:0/4123057292 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55de8a693dc0 0x55de8a6961d0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.433+0000 7f67b6829740 1 --2- 172.21.15.2:0/4123057292 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de8a684150 0x55de8a681b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.433+0000 7f67b6829740 1 --2- 172.21.15.2:0/4123057292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de8a675360 0x55de8a6815f0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.433+0000 7f6795ffb640 0 client.16050 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:17:35.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.433+0000 7f67b6829740 1 --2- 172.21.15.2:0/4123057292 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de8a674a40 0x55de8a6810b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.433+0000 7f67b6829740 1 -- 172.21.15.2:0/4123057292 >> 172.21.15.2:0/4123057292 conn(0x55de8a6710f0 msgr2=0x55de8a676e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:35.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.433+0000 7f67b6829740 1 -- 172.21.15.2:0/4123057292 shutdown_connections 2024-09-19T06:17:35.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.433+0000 7f67b6829740 1 -- 172.21.15.2:0/4123057292 wait complete. 2024-09-19T06:17:35.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.433+0000 7f67b6829740 20 client.16050 trim_cache size 0 max 16384 2024-09-19T06:17:35.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.451+0000 7f67b6829740 1 Processor -- start 2024-09-19T06:17:35.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.451+0000 7f67b6829740 1 -- start start 2024-09-19T06:17:35.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.451+0000 7f67b6829740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de8a674a40 0x55de8a69baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:35.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.451+0000 7f67b6829740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de8a675360 0x55de8a69bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:35.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.451+0000 7f67b6829740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de8a684150 0x55de8a67e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:35.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.451+0000 7f67b6829740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f67ac1add40 con 0x55de8a684150 2024-09-19T06:17:35.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.451+0000 7f67b6829740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f67ac1ab610 con 0x55de8a675360 2024-09-19T06:17:35.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.451+0000 7f67b6829740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f67ac1a9460 con 0x55de8a674a40 2024-09-19T06:17:35.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.451+0000 7f67b29ed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de8a684150 0x55de8a67e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:35.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.451+0000 7f67b29ed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de8a684150 0x55de8a67e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32882/0 (socket says 172.21.15.2:32882) 2024-09-19T06:17:35.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.451+0000 7f67b29ed640 1 -- 172.21.15.2:0/386041544 learned_addr learned my addr 172.21.15.2:0/386041544 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:35.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.451+0000 7f67b21ec640 1 --2- 172.21.15.2:0/386041544 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de8a674a40 0x55de8a69baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:35.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.451+0000 7f67b19eb640 1 --2- 172.21.15.2:0/386041544 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de8a675360 0x55de8a69bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:35.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.451+0000 7f67b29ed640 1 -- 172.21.15.2:0/386041544 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de8a674a40 msgr2=0x55de8a69baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:35.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.451+0000 7f67b29ed640 1 --2- 172.21.15.2:0/386041544 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de8a674a40 0x55de8a69baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.451+0000 7f67b29ed640 1 -- 172.21.15.2:0/386041544 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de8a675360 msgr2=0x55de8a69bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:35.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.451+0000 7f67b29ed640 1 --2- 172.21.15.2:0/386041544 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de8a675360 0x55de8a69bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.451+0000 7f67b29ed640 1 -- 172.21.15.2:0/386041544 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de8a675190 con 0x55de8a684150 2024-09-19T06:17:35.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.452+0000 7f67b29ed640 1 --2- 172.21.15.2:0/386041544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de8a684150 0x55de8a67e330 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f67a4006010 tx=0x7f67a4012520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a035d2a1da6bea8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:35.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.452+0000 7f6797fff640 1 -- 172.21.15.2:0/386041544 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a4024040 con 0x55de8a684150 2024-09-19T06:17:35.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.452+0000 7f6797fff640 1 -- 172.21.15.2:0/386041544 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f67a4012890 con 0x55de8a684150 2024-09-19T06:17:35.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.452+0000 7f6797fff640 1 -- 172.21.15.2:0/386041544 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a4004a00 con 0x55de8a684150 2024-09-19T06:17:35.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.452+0000 7f67b6829740 1 -- 172.21.15.2:0/386041544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de8a684150 msgr2=0x55de8a67e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:35.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.452+0000 7f67b6829740 1 --2- 172.21.15.2:0/386041544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de8a684150 0x55de8a67e330 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f67a4006010 tx=0x7f67a4012520 comp rx=0 tx=0).stop 2024-09-19T06:17:35.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.452+0000 7f67b6829740 1 -- 172.21.15.2:0/386041544 shutdown_connections 2024-09-19T06:17:35.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.452+0000 7f67b6829740 1 --2- 172.21.15.2:0/386041544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de8a684150 0x55de8a67e330 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.452+0000 7f67b6829740 1 --2- 172.21.15.2:0/386041544 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de8a675360 0x55de8a69bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.452+0000 7f67b6829740 1 --2- 172.21.15.2:0/386041544 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de8a674a40 0x55de8a69baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.452+0000 7f67b6829740 1 -- 172.21.15.2:0/386041544 >> 172.21.15.2:0/386041544 conn(0x55de8a6710f0 msgr2=0x55de8a683020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:35.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.452+0000 7f67b6829740 1 -- 172.21.15.2:0/386041544 shutdown_connections 2024-09-19T06:17:35.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.452+0000 7f67b6829740 1 -- 172.21.15.2:0/386041544 wait complete. 2024-09-19T06:17:35.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.453+0000 7f67b6829740 1 -- start start 2024-09-19T06:17:35.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.453+0000 7f67b6829740 1 Processor -- start 2024-09-19T06:17:35.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.453+0000 7f67b6829740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de8a674a40 0x55de8a68c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:35.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.453+0000 7f67b6829740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de8a675360 0x55de8a68c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:35.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.453+0000 7f67b6829740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de8a684150 0x55de8a689100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:35.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.453+0000 7f67b6829740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f67ac1a9ad0 con 0x55de8a675360 2024-09-19T06:17:35.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.453+0000 7f67b6829740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f67ac1aaf40 con 0x55de8a684150 2024-09-19T06:17:35.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.453+0000 7f67b6829740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f67ac1aa1a0 con 0x55de8a674a40 2024-09-19T06:17:35.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.453+0000 7f67b6829740 10 client.0 _ll_register_callbacks cb 0x7f679c005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:35.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.453+0000 7f67b19eb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de8a675360 0x55de8a68c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:35.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.453+0000 7f67b21ec640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de8a674a40 0x55de8a68c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:35.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.453+0000 7f67b21ec640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de8a674a40 0x55de8a68c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:39244/0 (socket says 172.21.15.2:39244) 2024-09-19T06:17:35.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.453+0000 7f67b19eb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de8a675360 0x55de8a68c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32892/0 (socket says 172.21.15.2:32892) 2024-09-19T06:17:35.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.453+0000 7f67b21ec640 1 -- 172.21.15.2:0/3080222123 learned_addr learned my addr 172.21.15.2:0/3080222123 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:35.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.453+0000 7f67b29ed640 1 --2- 172.21.15.2:0/3080222123 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de8a684150 0x55de8a689100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:35.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.454+0000 7f67b21ec640 1 -- 172.21.15.2:0/3080222123 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de8a684150 msgr2=0x55de8a689100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:35.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.454+0000 7f67b21ec640 1 --2- 172.21.15.2:0/3080222123 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de8a684150 0x55de8a689100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.454+0000 7f67b21ec640 1 -- 172.21.15.2:0/3080222123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de8a675360 msgr2=0x55de8a68c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:35.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.454+0000 7f67b21ec640 1 --2- 172.21.15.2:0/3080222123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de8a675360 0x55de8a68c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.454+0000 7f67b21ec640 1 -- 172.21.15.2:0/3080222123 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de8a689640 con 0x55de8a674a40 2024-09-19T06:17:35.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.454+0000 7f67b19eb640 1 --2- 172.21.15.2:0/3080222123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de8a675360 0x55de8a68c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:35.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.454+0000 7f67b21ec640 1 --2- 172.21.15.2:0/3080222123 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de8a674a40 0x55de8a68c130 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x55de8a696a40 tx=0x7f67a8014840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c303428489fe6053 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:35.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.454+0000 7f6795ffb640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-19T06:17:35.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.454+0000 7f6795ffb640 1 -- 172.21.15.2:0/3080222123 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a8004220 con 0x55de8a674a40 2024-09-19T06:17:35.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.454+0000 7f6795ffb640 1 -- 172.21.15.2:0/3080222123 <== mon.1 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f67a80043c0 con 0x55de8a674a40 2024-09-19T06:17:35.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.454+0000 7f67b6829740 1 -- 172.21.15.2:0/3080222123 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67a4012890 con 0x55de8a674a40 2024-09-19T06:17:35.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.454+0000 7f6795ffb640 1 -- 172.21.15.2:0/3080222123 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f67a80035f0 con 0x55de8a674a40 2024-09-19T06:17:35.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.454+0000 7f67b6829740 10 client.25570 fetch_fsmap learned FSMap version 26 2024-09-19T06:17:35.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.454+0000 7f67b6829740 1 -- 172.21.15.2:0/3080222123 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55de8a6ff320 con 0x55de8a674a40 2024-09-19T06:17:35.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.455+0000 7f6795ffb640 1 -- 172.21.15.2:0/3080222123 <== mon.1 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f67a4012890 con 0x55de8a674a40 2024-09-19T06:17:35.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.455+0000 7f6795ffb640 1 -- 172.21.15.2:0/3080222123 <== mon.1 v2:172.21.15.90:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f67a8022070 con 0x55de8a674a40 2024-09-19T06:17:35.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.455+0000 7f67b6829740 10 client.25570 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:17:35.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.455+0000 7f67b6829740 10 client.25570 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:17:35.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.455+0000 7f67b6829740 20 client.25570 populate_metadata read hostname 'smithi002' 2024-09-19T06:17:35.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.455+0000 7f67b6829740 1 --2- 172.21.15.2:0/3080222123 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55de8a6ffad0 0x55de8a701ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:35.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.455+0000 7f67b6829740 4 client.25570 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:17:35.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.455+0000 7f67b6829740 1 -- 172.21.15.2:0/3080222123 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55de8a5e1d00 con 0x55de8a6ffad0 2024-09-19T06:17:35.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.455+0000 7f67b19eb640 1 --2- 172.21.15.2:0/3080222123 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55de8a6ffad0 0x55de8a701ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:35.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.455+0000 7f67b19eb640 1 --2- 172.21.15.2:0/3080222123 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55de8a6ffad0 0x55de8a701ef0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98d8968983a64892 server_cookie=a21913b13055f7a0 in_seq=0 out_seq=0 2024-09-19T06:17:35.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.455+0000 7f6795ffb640 10 client.25570 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:17:35.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.456+0000 7f6795ffb640 1 -- 172.21.15.2:0/3080222123 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55de8a5e1d00 con 0x55de8a6ffad0 2024-09-19T06:17:35.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.456+0000 7f6795ffb640 10 client.25570 handle_command_reply: tid=0 2024-09-19T06:17:35.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.456+0000 7f67b6829740 1 client.25570 shutdown 2024-09-19T06:17:35.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.457+0000 7f67b6829740 1 -- 172.21.15.2:0/3080222123 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de8a674a40 msgr2=0x55de8a68c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:35.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.457+0000 7f67b6829740 1 --2- 172.21.15.2:0/3080222123 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de8a674a40 0x55de8a68c130 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x55de8a696a40 tx=0x7f67a8014840 comp rx=0 tx=0).stop 2024-09-19T06:17:35.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.457+0000 7f67b6829740 1 -- 172.21.15.2:0/3080222123 shutdown_connections 2024-09-19T06:17:35.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.457+0000 7f67b6829740 1 --2- 172.21.15.2:0/3080222123 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55de8a6ffad0 0x55de8a701ef0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.457+0000 7f67b6829740 1 --2- 172.21.15.2:0/3080222123 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de8a684150 0x55de8a689100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.457+0000 7f67b6829740 1 --2- 172.21.15.2:0/3080222123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de8a675360 0x55de8a68c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.457+0000 7f67b6829740 1 --2- 172.21.15.2:0/3080222123 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de8a674a40 0x55de8a68c130 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.457+0000 7f6795ffb640 0 client.25570 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:17:35.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.457+0000 7f67b6829740 1 -- 172.21.15.2:0/3080222123 >> 172.21.15.2:0/3080222123 conn(0x55de8a6710f0 msgr2=0x55de8a6826f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:35.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.457+0000 7f67b6829740 1 -- 172.21.15.2:0/3080222123 shutdown_connections 2024-09-19T06:17:35.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.457+0000 7f67b6829740 1 -- 172.21.15.2:0/3080222123 wait complete. 2024-09-19T06:17:35.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.457+0000 7f67b6829740 20 client.25570 trim_cache size 0 max 16384 2024-09-19T06:17:35.464 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:17:35.464 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T06:17:35.464 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "4de7ca85-f6ec-43ae-a2df-f7aad702a8e3", 2024-09-19T06:17:35.464 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T06:17:35.464 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:17:35.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.457+0000 7f67b4450640 1 -- 172.21.15.2:0/2316732208 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f67980a3430 msgr2=0x7f67980a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:35.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.457+0000 7f67b4450640 1 --2- 172.21.15.2:0/2316732208 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f67980a3430 0x7f67980a58f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f67a4010c40 tx=0x7f67a4017000 comp rx=0 tx=0).stop 2024-09-19T06:17:35.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.457+0000 7f67b4450640 1 -- 172.21.15.2:0/2316732208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67ac102790 msgr2=0x7f67ac198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:35.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.457+0000 7f67b4450640 1 --2- 172.21.15.2:0/2316732208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67ac102790 0x7f67ac198970 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f679c005ab0 tx=0x7f679c003cd0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.457+0000 7f67b4450640 1 -- 172.21.15.2:0/2316732208 shutdown_connections 2024-09-19T06:17:35.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.457+0000 7f67b4450640 1 --2- 172.21.15.2:0/2316732208 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f67980a3430 0x7f67980a58f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.457+0000 7f67b4450640 1 --2- 172.21.15.2:0/2316732208 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67ac106f10 0x7f67ac19cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.457+0000 7f67b4450640 1 --2- 172.21.15.2:0/2316732208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67ac102790 0x7f67ac198970 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.457+0000 7f67b4450640 1 --2- 172.21.15.2:0/2316732208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f67ac101de0 0x7f67ac198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.458+0000 7f67b4450640 1 -- 172.21.15.2:0/2316732208 >> 172.21.15.2:0/2316732208 conn(0x7f67ac0fd8c0 msgr2=0x7f67ac0fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:35.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.458+0000 7f67b4450640 1 -- 172.21.15.2:0/2316732208 shutdown_connections 2024-09-19T06:17:35.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:35.458+0000 7f67b4450640 1 -- 172.21.15.2:0/2316732208 wait complete. 2024-09-19T06:17:35.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:17:35 smithi002 ceph-mon[30982]: pgmap v86: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 736 MiB/s wr, 194 op/s 2024-09-19T06:17:35.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:17:35 smithi090 ceph-mon[34497]: pgmap v86: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 736 MiB/s wr, 194 op/s 2024-09-19T06:17:35.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:17:35 smithi089 ceph-mon[34160]: pgmap v86: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 736 MiB/s wr, 194 op/s 2024-09-19T06:17:36.208 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:17:36.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:17:36 smithi002 ceph-mon[30982]: scrub queued for path: / 2024-09-19T06:17:36.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:17:36 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:17:36.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:17:36 smithi002 ceph-mon[30982]: scrub summary: active paths [/] 2024-09-19T06:17:36.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:17:36 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:17:36.505 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:17:36.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:17:36 smithi090 ceph-mon[34497]: scrub queued for path: / 2024-09-19T06:17:36.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:17:36 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:17:36.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:17:36 smithi090 ceph-mon[34497]: scrub summary: active paths [/] 2024-09-19T06:17:36.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:17:36 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:17:36.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:17:36 smithi089 ceph-mon[34160]: scrub queued for path: / 2024-09-19T06:17:36.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:17:36 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:17:36.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:17:36 smithi089 ceph-mon[34160]: scrub summary: active paths [/] 2024-09-19T06:17:36.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:17:36 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:17:36.828 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-19T06:17:36.828 INFO:tasks.workunit.client.0.smithi002.stdout: Children see throughput for 1 readers = 8939869.00 kB/sec 2024-09-19T06:17:36.828 INFO:tasks.workunit.client.0.smithi002.stdout: Parent sees throughput for 1 readers = 8937666.00 kB/sec 2024-09-19T06:17:36.828 INFO:tasks.workunit.client.0.smithi002.stdout: Min throughput per process = 8939869.00 kB/sec 2024-09-19T06:17:36.829 INFO:tasks.workunit.client.0.smithi002.stdout: Max throughput per process = 8939869.00 kB/sec 2024-09-19T06:17:36.829 INFO:tasks.workunit.client.0.smithi002.stdout: Avg throughput per process = 8939869.00 kB/sec 2024-09-19T06:17:36.829 INFO:tasks.workunit.client.0.smithi002.stdout: Min xfer = 10485760.00 kB 2024-09-19T06:17:37.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.330+0000 7ff5e67d0640 1 -- 172.21.15.2:0/1580450884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5e0106f10 msgr2=0x7ff5e010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:37.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.330+0000 7ff5e67d0640 1 --2- 172.21.15.2:0/1580450884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5e0106f10 0x7ff5e010ea90 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8009ca0 tx=0x7ff5d802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.331+0000 7ff5e67d0640 1 -- 172.21.15.2:0/1580450884 shutdown_connections 2024-09-19T06:17:37.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.331+0000 7ff5e67d0640 1 --2- 172.21.15.2:0/1580450884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5e0106f10 0x7ff5e010ea90 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.331+0000 7ff5e67d0640 1 --2- 172.21.15.2:0/1580450884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5e0102790 0x7ff5e01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.331+0000 7ff5e67d0640 1 --2- 172.21.15.2:0/1580450884 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5e0101de0 0x7ff5e01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.331+0000 7ff5e67d0640 1 -- 172.21.15.2:0/1580450884 >> 172.21.15.2:0/1580450884 conn(0x7ff5e00fd8c0 msgr2=0x7ff5e00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:37.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.331+0000 7ff5e67d0640 1 -- 172.21.15.2:0/1580450884 shutdown_connections 2024-09-19T06:17:37.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.331+0000 7ff5e67d0640 1 -- 172.21.15.2:0/1580450884 wait complete. 2024-09-19T06:17:37.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.331+0000 7ff5e67d0640 1 Processor -- start 2024-09-19T06:17:37.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.331+0000 7ff5e67d0640 1 -- start start 2024-09-19T06:17:37.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.332+0000 7ff5e67d0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5e0101de0 0x7ff5e00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:37.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.332+0000 7ff5e67d0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5e0102790 0x7ff5e0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:37.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.332+0000 7ff5e67d0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5e0106f10 0x7ff5e0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:37.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.332+0000 7ff5e67d0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e0111e20 con 0x7ff5e0106f10 2024-09-19T06:17:37.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.332+0000 7ff5e67d0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e0111ca0 con 0x7ff5e0101de0 2024-09-19T06:17:37.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.332+0000 7ff5e67d0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e0111fa0 con 0x7ff5e0102790 2024-09-19T06:17:37.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.332+0000 7ff5e4d6d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5e0106f10 0x7ff5e0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:37.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.332+0000 7ff5e4d6d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5e0106f10 0x7ff5e0074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32908/0 (socket says 172.21.15.2:32908) 2024-09-19T06:17:37.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.332+0000 7ff5e4d6d640 1 -- 172.21.15.2:0/2424525856 learned_addr learned my addr 172.21.15.2:0/2424525856 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:37.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.332+0000 7ff5df7fe640 1 --2- 172.21.15.2:0/2424525856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5e0102790 0x7ff5e0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:37.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.332+0000 7ff5dffff640 1 --2- 172.21.15.2:0/2424525856 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5e0101de0 0x7ff5e00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:37.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.332+0000 7ff5e4d6d640 1 -- 172.21.15.2:0/2424525856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5e0102790 msgr2=0x7ff5e0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:37.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.332+0000 7ff5e4d6d640 1 --2- 172.21.15.2:0/2424525856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5e0102790 0x7ff5e0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.332+0000 7ff5e4d6d640 1 -- 172.21.15.2:0/2424525856 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5e0101de0 msgr2=0x7ff5e00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:37.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.332+0000 7ff5e4d6d640 1 --2- 172.21.15.2:0/2424525856 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5e0101de0 0x7ff5e00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.332+0000 7ff5e4d6d640 1 -- 172.21.15.2:0/2424525856 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5e01a6800 con 0x7ff5e0106f10 2024-09-19T06:17:37.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.332+0000 7ff5df7fe640 1 --2- 172.21.15.2:0/2424525856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5e0102790 0x7ff5e0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:37.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.332+0000 7ff5e4d6d640 1 --2- 172.21.15.2:0/2424525856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5e0106f10 0x7ff5e0074f70 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8009dc0 tx=0x7ff5d8032ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:37.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.333+0000 7ff5dd7fa640 1 -- 172.21.15.2:0/2424525856 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d8003cf0 con 0x7ff5e0106f10 2024-09-19T06:17:37.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.333+0000 7ff5dd7fa640 1 -- 172.21.15.2:0/2424525856 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff5d80044f0 con 0x7ff5e0106f10 2024-09-19T06:17:37.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.333+0000 7ff5e67d0640 1 -- 172.21.15.2:0/2424525856 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5e01a6a90 con 0x7ff5e0106f10 2024-09-19T06:17:37.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.333+0000 7ff5dd7fa640 1 -- 172.21.15.2:0/2424525856 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d8030bf0 con 0x7ff5e0106f10 2024-09-19T06:17:37.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.333+0000 7ff5e67d0640 1 -- 172.21.15.2:0/2424525856 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5e01a6fd0 con 0x7ff5e0106f10 2024-09-19T06:17:37.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.335+0000 7ff5dd7fa640 1 -- 172.21.15.2:0/2424525856 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7ff5d8004040 con 0x7ff5e0106f10 2024-09-19T06:17:37.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.335+0000 7ff5e8ba9740 1 Processor -- start 2024-09-19T06:17:37.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.335+0000 7ff5e8ba9740 1 -- start start 2024-09-19T06:17:37.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.336+0000 7ff5e8ba9740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555c41cd34a0 0x555c41cd3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:37.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.336+0000 7ff5e8ba9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c41cd3dc0 0x555c41cde140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:37.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.336+0000 7ff5e8ba9740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c41cde680 0x555c41ce0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:37.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.336+0000 7ff5e8ba9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555c41c392e0 con 0x555c41cd3dc0 2024-09-19T06:17:37.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.336+0000 7ff5e8ba9740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x555c41be0ce0 con 0x555c41cde680 2024-09-19T06:17:37.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.336+0000 7ff5e8ba9740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x555c41c352a0 con 0x555c41cd34a0 2024-09-19T06:17:37.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.336+0000 7ff5dd7fa640 1 --2- 172.21.15.2:0/2424525856 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff5c80a33b0 0x7ff5c80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:37.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.336+0000 7ff5dffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c41cd3dc0 0x555c41cde140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:37.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.336+0000 7ff5dffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c41cd3dc0 0x555c41cde140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32912/0 (socket says 172.21.15.2:32912) 2024-09-19T06:17:37.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.336+0000 7ff5dffff640 1 -- 172.21.15.2:0/4261697885 learned_addr learned my addr 172.21.15.2:0/4261697885 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:37.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.336+0000 7ff5e4d6d640 1 --2- 172.21.15.2:0/2424525856 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff5c80a33b0 0x7ff5c80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:37.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.336+0000 7ff5df7fe640 1 --2- 172.21.15.2:0/4261697885 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555c41cd34a0 0x555c41cd3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:37.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.336+0000 7ff5df7fe640 1 --2- 172.21.15.2:0/4261697885 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c41cde680 0x555c41ce0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:37.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.336+0000 7ff5dd7fa640 1 -- 172.21.15.2:0/2424525856 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7ff5d80f1190 con 0x7ff5e0106f10 2024-09-19T06:17:37.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.336+0000 7ff5dffff640 1 -- 172.21.15.2:0/4261697885 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555c41cd34a0 msgr2=0x555c41cd3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:37.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.336+0000 7ff5dffff640 1 --2- 172.21.15.2:0/4261697885 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555c41cd34a0 0x555c41cd3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.336+0000 7ff5dffff640 1 -- 172.21.15.2:0/4261697885 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c41cde680 msgr2=0x555c41ce0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:37.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.336+0000 7ff5dffff640 1 --2- 172.21.15.2:0/4261697885 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c41cde680 0x555c41ce0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.336+0000 7ff5dffff640 1 -- 172.21.15.2:0/4261697885 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c41bc5440 con 0x555c41cd3dc0 2024-09-19T06:17:37.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.336+0000 7ff5df7fe640 1 --2- 172.21.15.2:0/4261697885 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c41cde680 0x555c41ce0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:37.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.336+0000 7ff5e4d6d640 1 --2- 172.21.15.2:0/2424525856 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff5c80a33b0 0x7ff5c80a5870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff5d80eef10 tx=0x7ff5d802a8c0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:37.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.336+0000 7ff5dffff640 1 --2- 172.21.15.2:0/4261697885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c41cd3dc0 0x555c41cde140 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7ff5d000b760 tx=0x7ff5d000bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c5078385cca15b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:37.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.337+0000 7ff5c67fc640 1 -- 172.21.15.2:0/4261697885 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d0003dd0 con 0x555c41cd3dc0 2024-09-19T06:17:37.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.337+0000 7ff5c67fc640 1 -- 172.21.15.2:0/4261697885 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff5d0015070 con 0x555c41cd3dc0 2024-09-19T06:17:37.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.337+0000 7ff5c67fc640 1 -- 172.21.15.2:0/4261697885 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d0004d40 con 0x555c41cd3dc0 2024-09-19T06:17:37.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.337+0000 7ff5e8ba9740 1 -- 172.21.15.2:0/4261697885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c41cd3dc0 msgr2=0x555c41cde140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:37.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.337+0000 7ff5e8ba9740 1 --2- 172.21.15.2:0/4261697885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c41cd3dc0 0x555c41cde140 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7ff5d000b760 tx=0x7ff5d000bc20 comp rx=0 tx=0).stop 2024-09-19T06:17:37.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.337+0000 7ff5e8ba9740 1 -- 172.21.15.2:0/4261697885 shutdown_connections 2024-09-19T06:17:37.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.337+0000 7ff5e8ba9740 1 --2- 172.21.15.2:0/4261697885 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c41cde680 0x555c41ce0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.337+0000 7ff5e8ba9740 1 --2- 172.21.15.2:0/4261697885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c41cd3dc0 0x555c41cde140 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.337+0000 7ff5e8ba9740 1 --2- 172.21.15.2:0/4261697885 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555c41cd34a0 0x555c41cd3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.337+0000 7ff5e8ba9740 1 -- 172.21.15.2:0/4261697885 >> 172.21.15.2:0/4261697885 conn(0x555c41ccfa30 msgr2=0x555c41ccfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:37.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.337+0000 7ff5e8ba9740 1 -- 172.21.15.2:0/4261697885 shutdown_connections 2024-09-19T06:17:37.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.337+0000 7ff5e8ba9740 1 -- 172.21.15.2:0/4261697885 wait complete. 2024-09-19T06:17:37.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.338+0000 7ff5e8ba9740 1 -- start start 2024-09-19T06:17:37.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.338+0000 7ff5e8ba9740 1 Processor -- start 2024-09-19T06:17:37.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.338+0000 7ff5e8ba9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c41cd34a0 0x555c41cddf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:37.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.338+0000 7ff5e8ba9740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c41cd3dc0 0x555c41cdb210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:37.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.338+0000 7ff5e8ba9740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555c41cde680 0x555c41cdb750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:37.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.338+0000 7ff5e8ba9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555c41ce1250 con 0x555c41cd34a0 2024-09-19T06:17:37.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.338+0000 7ff5e8ba9740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x555c41bf4050 con 0x555c41cd3dc0 2024-09-19T06:17:37.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.338+0000 7ff5e8ba9740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x555c41ce13d0 con 0x555c41cde680 2024-09-19T06:17:37.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.338+0000 7ff5e8ba9740 10 client.0 _ll_register_callbacks cb 0x555c41c34160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:37.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.338+0000 7ff5df7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c41cd34a0 0x555c41cddf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:37.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.339+0000 7ff5df7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c41cd34a0 0x555c41cddf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32918/0 (socket says 172.21.15.2:32918) 2024-09-19T06:17:37.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.339+0000 7ff5df7fe640 1 -- 172.21.15.2:0/963090775 learned_addr learned my addr 172.21.15.2:0/963090775 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:37.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.339+0000 7ff5dffff640 1 --2- 172.21.15.2:0/963090775 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c41cd3dc0 0x555c41cdb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:37.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.339+0000 7ff5df7fe640 1 -- 172.21.15.2:0/963090775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555c41cde680 msgr2=0x555c41cdb750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:37.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.339+0000 7ff5df7fe640 1 --2- 172.21.15.2:0/963090775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555c41cde680 0x555c41cdb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.339+0000 7ff5df7fe640 1 -- 172.21.15.2:0/963090775 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c41cd3dc0 msgr2=0x555c41cdb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:37.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.339+0000 7ff5df7fe640 1 --2- 172.21.15.2:0/963090775 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c41cd3dc0 0x555c41cdb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.339+0000 7ff5df7fe640 1 -- 172.21.15.2:0/963090775 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c419aa3c0 con 0x555c41cd34a0 2024-09-19T06:17:37.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.339+0000 7ff5df7fe640 1 --2- 172.21.15.2:0/963090775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c41cd34a0 0x555c41cddf60 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7ff5d400b430 tx=0x7ff5d4010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=553b68d189d0df15 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:37.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.339+0000 7ff5bf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:17:37.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.339+0000 7ff5bf7fe640 1 -- 172.21.15.2:0/963090775 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d4004220 con 0x555c41cd34a0 2024-09-19T06:17:37.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.339+0000 7ff5bf7fe640 1 -- 172.21.15.2:0/963090775 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7ff5d40043c0 con 0x555c41cd34a0 2024-09-19T06:17:37.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.339+0000 7ff5e8ba9740 1 -- 172.21.15.2:0/963090775 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5d0015070 con 0x555c41cd34a0 2024-09-19T06:17:37.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.339+0000 7ff5bf7fe640 1 -- 172.21.15.2:0/963090775 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff5d4028050 con 0x555c41cd34a0 2024-09-19T06:17:37.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.339+0000 7ff5e8ba9740 10 client.16068 fetch_fsmap learned FSMap version 26 2024-09-19T06:17:37.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.339+0000 7ff5e8ba9740 1 -- 172.21.15.2:0/963090775 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555c41cecc50 con 0x555c41cd34a0 2024-09-19T06:17:37.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.340+0000 7ff5bf7fe640 1 -- 172.21.15.2:0/963090775 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff5d0015070 con 0x555c41cd34a0 2024-09-19T06:17:37.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.340+0000 7ff5bf7fe640 1 -- 172.21.15.2:0/963090775 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7ff5d40035f0 con 0x555c41cd34a0 2024-09-19T06:17:37.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.340+0000 7ff5e8ba9740 10 client.16068 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:17:37.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.340+0000 7ff5e8ba9740 10 client.16068 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:17:37.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.340+0000 7ff5e8ba9740 20 client.16068 populate_metadata read hostname 'smithi002' 2024-09-19T06:17:37.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.340+0000 7ff5e8ba9740 1 --2- 172.21.15.2:0/963090775 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x555c41cee060 0x555c41cf04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:37.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.340+0000 7ff5e8ba9740 4 client.16068 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:17:37.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.340+0000 7ff5e8ba9740 1 -- 172.21.15.2:0/963090775 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c41c46850 con 0x555c41cee060 2024-09-19T06:17:37.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.340+0000 7ff5dffff640 1 --2- 172.21.15.2:0/963090775 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x555c41cee060 0x555c41cf04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:37.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.341+0000 7ff5dffff640 1 --2- 172.21.15.2:0/963090775 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x555c41cee060 0x555c41cf04b0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bdb2c79951e5c07 server_cookie=f15db9ecbb3fcf3a in_seq=0 out_seq=0 2024-09-19T06:17:37.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.341+0000 7ff5bf7fe640 10 client.16068 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:17:37.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.341+0000 7ff5bf7fe640 1 -- 172.21.15.2:0/963090775 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555c41c46850 con 0x555c41cee060 2024-09-19T06:17:37.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.341+0000 7ff5bf7fe640 10 client.16068 handle_command_reply: tid=0 2024-09-19T06:17:37.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.341+0000 7ff5e8ba9740 1 client.16068 shutdown 2024-09-19T06:17:37.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.342+0000 7ff5e8ba9740 1 -- 172.21.15.2:0/963090775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c41cd34a0 msgr2=0x555c41cddf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:37.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.342+0000 7ff5e8ba9740 1 --2- 172.21.15.2:0/963090775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c41cd34a0 0x555c41cddf60 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7ff5d400b430 tx=0x7ff5d4010c20 comp rx=0 tx=0).stop 2024-09-19T06:17:37.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.342+0000 7ff5e8ba9740 1 -- 172.21.15.2:0/963090775 shutdown_connections 2024-09-19T06:17:37.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.342+0000 7ff5e8ba9740 1 --2- 172.21.15.2:0/963090775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555c41cde680 0x555c41cdb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.342+0000 7ff5e8ba9740 1 --2- 172.21.15.2:0/963090775 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x555c41cee060 0x555c41cf04b0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.342+0000 7ff5e8ba9740 1 --2- 172.21.15.2:0/963090775 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c41cd3dc0 0x555c41cdb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.342+0000 7ff5e8ba9740 1 --2- 172.21.15.2:0/963090775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c41cd34a0 0x555c41cddf60 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.342+0000 7ff5e8ba9740 1 -- 172.21.15.2:0/963090775 >> 172.21.15.2:0/963090775 conn(0x555c41ccfa30 msgr2=0x555c41cd5710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:37.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.342+0000 7ff5bf7fe640 0 client.16068 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:17:37.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.342+0000 7ff5e8ba9740 1 -- 172.21.15.2:0/963090775 shutdown_connections 2024-09-19T06:17:37.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.342+0000 7ff5e8ba9740 1 -- 172.21.15.2:0/963090775 wait complete. 2024-09-19T06:17:37.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.342+0000 7ff5e8ba9740 20 client.16068 trim_cache size 0 max 16384 2024-09-19T06:17:37.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.359+0000 7ff5e8ba9740 1 Processor -- start 2024-09-19T06:17:37.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.359+0000 7ff5e8ba9740 1 -- start start 2024-09-19T06:17:37.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.360+0000 7ff5e8ba9740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555c41cd34a0 0x555c41cea4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:37.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.360+0000 7ff5e8ba9740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c41cd3dc0 0x555c41cf5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:37.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.360+0000 7ff5e8ba9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c41cde680 0x555c41cf62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:37.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.360+0000 7ff5e8ba9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e01b21d0 con 0x555c41cde680 2024-09-19T06:17:37.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.360+0000 7ff5e8ba9740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e01afaa0 con 0x555c41cd3dc0 2024-09-19T06:17:37.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.360+0000 7ff5e8ba9740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e01ad8f0 con 0x555c41cd34a0 2024-09-19T06:17:37.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.360+0000 7ff5df7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c41cde680 0x555c41cf62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:37.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.360+0000 7ff5df7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c41cde680 0x555c41cf62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32924/0 (socket says 172.21.15.2:32924) 2024-09-19T06:17:37.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.360+0000 7ff5df7fe640 1 -- 172.21.15.2:0/1125431906 learned_addr learned my addr 172.21.15.2:0/1125431906 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:37.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.360+0000 7ff5dffff640 1 --2- 172.21.15.2:0/1125431906 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c41cd3dc0 0x555c41cf5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:37.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.360+0000 7ff5df7fe640 1 --2- 172.21.15.2:0/1125431906 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555c41cd34a0 0x555c41cea4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:37.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.360+0000 7ff5df7fe640 1 -- 172.21.15.2:0/1125431906 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555c41cd34a0 msgr2=0x555c41cea4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:37.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.360+0000 7ff5df7fe640 1 --2- 172.21.15.2:0/1125431906 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555c41cd34a0 0x555c41cea4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.360+0000 7ff5df7fe640 1 -- 172.21.15.2:0/1125431906 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c41cd3dc0 msgr2=0x555c41cf5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:37.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.360+0000 7ff5df7fe640 1 --2- 172.21.15.2:0/1125431906 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c41cd3dc0 0x555c41cf5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.360+0000 7ff5df7fe640 1 -- 172.21.15.2:0/1125431906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c41cde2d0 con 0x555c41cde680 2024-09-19T06:17:37.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.360+0000 7ff5df7fe640 1 --2- 172.21.15.2:0/1125431906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c41cde680 0x555c41cf62c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7ff5d400b400 tx=0x7ff5d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d74c8f9ae9a14123 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:37.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.360+0000 7ff5c5ffb640 1 -- 172.21.15.2:0/1125431906 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d40037f0 con 0x555c41cde680 2024-09-19T06:17:37.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.360+0000 7ff5c5ffb640 1 -- 172.21.15.2:0/1125431906 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff5d4016070 con 0x555c41cde680 2024-09-19T06:17:37.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.360+0000 7ff5c5ffb640 1 -- 172.21.15.2:0/1125431906 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d400f9f0 con 0x555c41cde680 2024-09-19T06:17:37.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.361+0000 7ff5e8ba9740 1 -- 172.21.15.2:0/1125431906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c41cde680 msgr2=0x555c41cf62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:37.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.361+0000 7ff5e8ba9740 1 --2- 172.21.15.2:0/1125431906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c41cde680 0x555c41cf62c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7ff5d400b400 tx=0x7ff5d40046c0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.361+0000 7ff5e8ba9740 1 -- 172.21.15.2:0/1125431906 shutdown_connections 2024-09-19T06:17:37.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.361+0000 7ff5e8ba9740 1 --2- 172.21.15.2:0/1125431906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c41cde680 0x555c41cf62c0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.361+0000 7ff5e8ba9740 1 --2- 172.21.15.2:0/1125431906 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c41cd3dc0 0x555c41cf5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.361+0000 7ff5e8ba9740 1 --2- 172.21.15.2:0/1125431906 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555c41cd34a0 0x555c41cea4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.361+0000 7ff5e8ba9740 1 -- 172.21.15.2:0/1125431906 >> 172.21.15.2:0/1125431906 conn(0x555c41ccfa30 msgr2=0x555c41cd9ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:37.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.361+0000 7ff5e8ba9740 1 -- 172.21.15.2:0/1125431906 shutdown_connections 2024-09-19T06:17:37.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.361+0000 7ff5e8ba9740 1 -- 172.21.15.2:0/1125431906 wait complete. 2024-09-19T06:17:37.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.361+0000 7ff5e8ba9740 1 -- start start 2024-09-19T06:17:37.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.362+0000 7ff5e8ba9740 1 Processor -- start 2024-09-19T06:17:37.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.362+0000 7ff5e8ba9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c41cd34a0 0x555c41ce1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:37.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.362+0000 7ff5e8ba9740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555c41cd3dc0 0x555c41ce2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:37.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.362+0000 7ff5e8ba9740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c41cde680 0x555c41ce6470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:37.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.362+0000 7ff5e8ba9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e01adf60 con 0x555c41cd34a0 2024-09-19T06:17:37.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.362+0000 7ff5e8ba9740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e01af3d0 con 0x555c41cde680 2024-09-19T06:17:37.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.362+0000 7ff5e8ba9740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e01ae630 con 0x555c41cd3dc0 2024-09-19T06:17:37.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.362+0000 7ff5e8ba9740 10 client.0 _ll_register_callbacks cb 0x7ff5d40103d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:37.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.362+0000 7ff5df7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c41cd34a0 0x555c41ce1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:37.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.362+0000 7ff5df7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c41cd34a0 0x555c41ce1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32934/0 (socket says 172.21.15.2:32934) 2024-09-19T06:17:37.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.362+0000 7ff5df7fe640 1 -- 172.21.15.2:0/995624011 learned_addr learned my addr 172.21.15.2:0/995624011 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:37.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.362+0000 7ff5dffff640 1 --2- 172.21.15.2:0/995624011 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555c41cd3dc0 0x555c41ce2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:37.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.362+0000 7ff5df7fe640 1 --2- 172.21.15.2:0/995624011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c41cde680 0x555c41ce6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:37.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.362+0000 7ff5df7fe640 1 -- 172.21.15.2:0/995624011 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555c41cd3dc0 msgr2=0x555c41ce2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:37.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.362+0000 7ff5df7fe640 1 --2- 172.21.15.2:0/995624011 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555c41cd3dc0 0x555c41ce2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.362+0000 7ff5df7fe640 1 -- 172.21.15.2:0/995624011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c41cde680 msgr2=0x555c41ce6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:37.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.362+0000 7ff5df7fe640 1 --2- 172.21.15.2:0/995624011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c41cde680 0x555c41ce6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.362+0000 7ff5df7fe640 1 -- 172.21.15.2:0/995624011 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c41ce6ae0 con 0x555c41cd34a0 2024-09-19T06:17:37.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.363+0000 7ff5df7fe640 1 --2- 172.21.15.2:0/995624011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c41cd34a0 0x555c41ce1e40 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4003b60 tx=0x7ff5d4012db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6002c1f92a1027b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:37.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.363+0000 7ff5bf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:17:37.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.363+0000 7ff5bf7fe640 1 -- 172.21.15.2:0/995624011 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d40037f0 con 0x555c41cd34a0 2024-09-19T06:17:37.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.363+0000 7ff5bf7fe640 1 -- 172.21.15.2:0/995624011 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7ff5d4003f70 con 0x555c41cd34a0 2024-09-19T06:17:37.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.363+0000 7ff5e8ba9740 1 -- 172.21.15.2:0/995624011 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5d4016070 con 0x555c41cd34a0 2024-09-19T06:17:37.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.363+0000 7ff5bf7fe640 1 -- 172.21.15.2:0/995624011 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff5d4004170 con 0x555c41cd34a0 2024-09-19T06:17:37.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.363+0000 7ff5e8ba9740 10 client.16074 fetch_fsmap learned FSMap version 26 2024-09-19T06:17:37.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.363+0000 7ff5e8ba9740 1 -- 172.21.15.2:0/995624011 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555c41d58880 con 0x555c41cd34a0 2024-09-19T06:17:37.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.363+0000 7ff5bf7fe640 1 -- 172.21.15.2:0/995624011 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff5d4016070 con 0x555c41cd34a0 2024-09-19T06:17:37.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.363+0000 7ff5bf7fe640 1 -- 172.21.15.2:0/995624011 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7ff5d4039020 con 0x555c41cd34a0 2024-09-19T06:17:37.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.363+0000 7ff5e8ba9740 10 client.16074 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:17:37.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.363+0000 7ff5e8ba9740 10 client.16074 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:17:37.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.363+0000 7ff5e8ba9740 20 client.16074 populate_metadata read hostname 'smithi002' 2024-09-19T06:17:37.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.363+0000 7ff5e8ba9740 1 --2- 172.21.15.2:0/995624011 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x555c41d58f50 0x555c41d5b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:37.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.363+0000 7ff5e8ba9740 4 client.16074 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:17:37.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.363+0000 7ff5e8ba9740 1 -- 172.21.15.2:0/995624011 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555c41cdbae0 con 0x555c41d58f50 2024-09-19T06:17:37.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.364+0000 7ff5dffff640 1 --2- 172.21.15.2:0/995624011 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x555c41d58f50 0x555c41d5b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:37.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.364+0000 7ff5dffff640 1 --2- 172.21.15.2:0/995624011 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x555c41d58f50 0x555c41d5b370 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c14930c85321c890 server_cookie=e41bb1ed9c11b345 in_seq=0 out_seq=0 2024-09-19T06:17:37.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.364+0000 7ff5bf7fe640 10 client.16074 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:17:37.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.364+0000 7ff5bf7fe640 1 -- 172.21.15.2:0/995624011 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x555c41cdbae0 con 0x555c41d58f50 2024-09-19T06:17:37.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.364+0000 7ff5bf7fe640 10 client.16074 handle_command_reply: tid=0 2024-09-19T06:17:37.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.364+0000 7ff5e8ba9740 1 client.16074 shutdown 2024-09-19T06:17:37.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.365+0000 7ff5e8ba9740 1 -- 172.21.15.2:0/995624011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c41cd34a0 msgr2=0x555c41ce1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:37.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.365+0000 7ff5e8ba9740 1 --2- 172.21.15.2:0/995624011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c41cd34a0 0x555c41ce1e40 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4003b60 tx=0x7ff5d4012db0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.365+0000 7ff5e8ba9740 1 -- 172.21.15.2:0/995624011 shutdown_connections 2024-09-19T06:17:37.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.365+0000 7ff5e8ba9740 1 --2- 172.21.15.2:0/995624011 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x555c41d58f50 0x555c41d5b370 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.365+0000 7ff5e8ba9740 1 --2- 172.21.15.2:0/995624011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c41cde680 0x555c41ce6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.365+0000 7ff5e8ba9740 1 --2- 172.21.15.2:0/995624011 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555c41cd3dc0 0x555c41ce2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.365+0000 7ff5e8ba9740 1 --2- 172.21.15.2:0/995624011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555c41cd34a0 0x555c41ce1e40 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.365+0000 7ff5e8ba9740 1 -- 172.21.15.2:0/995624011 >> 172.21.15.2:0/995624011 conn(0x555c41ccfa30 msgr2=0x555c41cce350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:37.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.365+0000 7ff5bf7fe640 0 client.16074 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:17:37.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.365+0000 7ff5e8ba9740 1 -- 172.21.15.2:0/995624011 shutdown_connections 2024-09-19T06:17:37.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.365+0000 7ff5e8ba9740 1 -- 172.21.15.2:0/995624011 wait complete. 2024-09-19T06:17:37.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.365+0000 7ff5e8ba9740 20 client.16074 trim_cache size 0 max 16384 2024-09-19T06:17:37.372 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:17:37.372 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:17:37.373 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-19T06:17:37.373 INFO:teuthology.orchestra.run.smithi002.stdout: "4de7ca85-f6ec-43ae-a2df-f7aad702a8e3": { 2024-09-19T06:17:37.373 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-19T06:17:37.373 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "4de7ca85-f6ec-43ae-a2df-f7aad702a8e3", 2024-09-19T06:17:37.373 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-19T06:17:37.373 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:17:37.373 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:17:37.373 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:17:37.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.365+0000 7ff5e67d0640 1 -- 172.21.15.2:0/2424525856 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff5c80a33b0 msgr2=0x7ff5c80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:37.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.365+0000 7ff5e67d0640 1 --2- 172.21.15.2:0/2424525856 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff5c80a33b0 0x7ff5c80a5870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff5d80eef10 tx=0x7ff5d802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.365+0000 7ff5e67d0640 1 -- 172.21.15.2:0/2424525856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5e0106f10 msgr2=0x7ff5e0074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:37.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.365+0000 7ff5e67d0640 1 --2- 172.21.15.2:0/2424525856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5e0106f10 0x7ff5e0074f70 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8009dc0 tx=0x7ff5d8032ff0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.366+0000 7ff5e67d0640 1 -- 172.21.15.2:0/2424525856 shutdown_connections 2024-09-19T06:17:37.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.366+0000 7ff5e67d0640 1 --2- 172.21.15.2:0/2424525856 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff5c80a33b0 0x7ff5c80a5870 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.366+0000 7ff5e67d0640 1 --2- 172.21.15.2:0/2424525856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5e0106f10 0x7ff5e0074f70 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.366+0000 7ff5e67d0640 1 --2- 172.21.15.2:0/2424525856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5e0102790 0x7ff5e0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.366+0000 7ff5e67d0640 1 --2- 172.21.15.2:0/2424525856 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5e0101de0 0x7ff5e00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.366+0000 7ff5e67d0640 1 -- 172.21.15.2:0/2424525856 >> 172.21.15.2:0/2424525856 conn(0x7ff5e00fd8c0 msgr2=0x7ff5e00fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:37.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.366+0000 7ff5e67d0640 1 -- 172.21.15.2:0/2424525856 shutdown_connections 2024-09-19T06:17:37.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:17:37.366+0000 7ff5e67d0640 1 -- 172.21.15.2:0/2424525856 wait complete. 2024-09-19T06:17:37.665 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:17:37 smithi002 ceph-mon[30982]: pgmap v87: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 443 MiB/s wr, 118 op/s 2024-09-19T06:17:37.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:17:37 smithi090 ceph-mon[34497]: pgmap v87: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 443 MiB/s wr, 118 op/s 2024-09-19T06:17:37.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:17:37 smithi089 ceph-mon[34160]: pgmap v87: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 443 MiB/s wr, 118 op/s 2024-09-19T06:17:37.908 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.905+0000 7fa4905f1640 1 -- 172.21.15.2:0/542938371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa488101370 msgr2=0x7fa48810d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:37.908 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.905+0000 7fa4905f1640 1 --2- 172.21.15.2:0/542938371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa488101370 0x7fa48810d8a0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fa480009cd0 tx=0x7fa48002a8e0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.908 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.905+0000 7fa4905f1640 1 -- 172.21.15.2:0/542938371 shutdown_connections 2024-09-19T06:17:37.908 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.905+0000 7fa4905f1640 1 --2- 172.21.15.2:0/542938371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa488101370 0x7fa48810d8a0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.908 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.905+0000 7fa4905f1640 1 --2- 172.21.15.2:0/542938371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4881009d0 0x7fa488100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.908 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.905+0000 7fa4905f1640 1 --2- 172.21.15.2:0/542938371 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4881069e0 0x7fa488106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.908 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.905+0000 7fa4905f1640 1 -- 172.21.15.2:0/542938371 >> 172.21.15.2:0/542938371 conn(0x7fa4880fc6b0 msgr2=0x7fa4880fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:37.908 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.905+0000 7fa4905f1640 1 -- 172.21.15.2:0/542938371 shutdown_connections 2024-09-19T06:17:37.909 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.905+0000 7fa4905f1640 1 -- 172.21.15.2:0/542938371 wait complete. 2024-09-19T06:17:37.909 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.906+0000 7fa4905f1640 1 Processor -- start 2024-09-19T06:17:37.909 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.906+0000 7fa4905f1640 1 -- start start 2024-09-19T06:17:37.909 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.906+0000 7fa4905f1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4881009d0 0x7fa488198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:37.909 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.906+0000 7fa4905f1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa488101370 0x7fa488198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:37.909 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.906+0000 7fa4905f1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4881069e0 0x7fa48819cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:37.909 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.906+0000 7fa4905f1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa488110cd0 con 0x7fa4881069e0 2024-09-19T06:17:37.909 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.906+0000 7fa4905f1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa488110b50 con 0x7fa4881009d0 2024-09-19T06:17:37.909 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.906+0000 7fa4905f1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa488110e50 con 0x7fa488101370 2024-09-19T06:17:37.909 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.906+0000 7fa48eb8e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4881069e0 0x7fa48819cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:37.909 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.906+0000 7fa48db8c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa488101370 0x7fa488198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:37.909 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.906+0000 7fa48eb8e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4881069e0 0x7fa48819cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32950/0 (socket says 172.21.15.2:32950) 2024-09-19T06:17:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.906+0000 7fa48eb8e640 1 -- 172.21.15.2:0/516020651 learned_addr learned my addr 172.21.15.2:0/516020651 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.906+0000 7fa48e38d640 1 --2- 172.21.15.2:0/516020651 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4881009d0 0x7fa488198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.906+0000 7fa48eb8e640 1 -- 172.21.15.2:0/516020651 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa488101370 msgr2=0x7fa488198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.906+0000 7fa48eb8e640 1 --2- 172.21.15.2:0/516020651 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa488101370 0x7fa488198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.906+0000 7fa48eb8e640 1 -- 172.21.15.2:0/516020651 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4881009d0 msgr2=0x7fa488198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.906+0000 7fa48eb8e640 1 --2- 172.21.15.2:0/516020651 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4881009d0 0x7fa488198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.906+0000 7fa48eb8e640 1 -- 172.21.15.2:0/516020651 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa48819d310 con 0x7fa4881069e0 2024-09-19T06:17:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.907+0000 7fa48eb8e640 1 --2- 172.21.15.2:0/516020651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4881069e0 0x7fa48819cbe0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fa480005cc0 tx=0x7fa480003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.907+0000 7fa47f7fe640 1 -- 172.21.15.2:0/516020651 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa480004450 con 0x7fa4881069e0 2024-09-19T06:17:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.907+0000 7fa47f7fe640 1 -- 172.21.15.2:0/516020651 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa480031c90 con 0x7fa4881069e0 2024-09-19T06:17:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.907+0000 7fa4905f1640 1 -- 172.21.15.2:0/516020651 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa48819d5a0 con 0x7fa4881069e0 2024-09-19T06:17:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.907+0000 7fa47f7fe640 1 -- 172.21.15.2:0/516020651 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48003b400 con 0x7fa4881069e0 2024-09-19T06:17:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.907+0000 7fa4905f1640 1 -- 172.21.15.2:0/516020651 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4881a4e90 con 0x7fa4881069e0 2024-09-19T06:17:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.909+0000 7fa47f7fe640 1 -- 172.21.15.2:0/516020651 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fa480004680 con 0x7fa4881069e0 2024-09-19T06:17:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.909+0000 7fa493463740 1 Processor -- start 2024-09-19T06:17:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.910+0000 7fa493463740 1 -- start start 2024-09-19T06:17:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.910+0000 7fa493463740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0cfeb9af0 0x55f0cfeb9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.910+0000 7fa493463740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0cfeba410 0x55f0cfec4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.910+0000 7fa493463740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f0cfec4cb0 0x55f0cfec70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.910+0000 7fa493463740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f0cfe1e2f0 con 0x55f0cfeba410 2024-09-19T06:17:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.910+0000 7fa493463740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55f0cfdc6270 con 0x55f0cfeb9af0 2024-09-19T06:17:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.910+0000 7fa493463740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f0cfe1a2b0 con 0x55f0cfec4cb0 2024-09-19T06:17:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.910+0000 7fa48e38d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0cfeba410 0x55f0cfec4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.910+0000 7fa47f7fe640 1 --2- 172.21.15.2:0/516020651 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa4740a3430 0x7fa4740a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.910+0000 7fa48e38d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0cfeba410 0x55f0cfec4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32960/0 (socket says 172.21.15.2:32960) 2024-09-19T06:17:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.910+0000 7fa48e38d640 1 -- 172.21.15.2:0/3767409577 learned_addr learned my addr 172.21.15.2:0/3767409577 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.910+0000 7fa48db8c640 1 --2- 172.21.15.2:0/3767409577 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0cfeb9af0 0x55f0cfeb9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.910+0000 7fa48eb8e640 1 --2- 172.21.15.2:0/516020651 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa4740a3430 0x7fa4740a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.910+0000 7fa48db8c640 1 --2- 172.21.15.2:0/3767409577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f0cfec4cb0 0x55f0cfec70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.910+0000 7fa48e38d640 1 -- 172.21.15.2:0/3767409577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f0cfec4cb0 msgr2=0x55f0cfec70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.910+0000 7fa48e38d640 1 --2- 172.21.15.2:0/3767409577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f0cfec4cb0 0x55f0cfec70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.910+0000 7fa48e38d640 1 -- 172.21.15.2:0/3767409577 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0cfeb9af0 msgr2=0x55f0cfeb9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.910+0000 7fa48e38d640 1 --2- 172.21.15.2:0/3767409577 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0cfeb9af0 0x55f0cfeb9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.910+0000 7fa48e38d640 1 -- 172.21.15.2:0/3767409577 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0cfdc5340 con 0x55f0cfeba410 2024-09-19T06:17:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.910+0000 7fa47f7fe640 1 -- 172.21.15.2:0/516020651 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fa48002e030 con 0x7fa4881069e0 2024-09-19T06:17:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.911+0000 7fa48e38d640 1 --2- 172.21.15.2:0/3767409577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0cfeba410 0x55f0cfec4770 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fa48400bc20 tx=0x7fa48400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9016510411ead67f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.911+0000 7fa48eb8e640 1 --2- 172.21.15.2:0/516020651 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa4740a3430 0x7fa4740a58f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa48008ff30 tx=0x7fa48008ff60 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.911+0000 7fa47cbfe640 1 -- 172.21.15.2:0/3767409577 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa484015070 con 0x55f0cfeba410 2024-09-19T06:17:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.911+0000 7fa47cbfe640 1 -- 172.21.15.2:0/3767409577 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa4840054d0 con 0x55f0cfeba410 2024-09-19T06:17:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.911+0000 7fa47cbfe640 1 -- 172.21.15.2:0/3767409577 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4840116a0 con 0x55f0cfeba410 2024-09-19T06:17:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.911+0000 7fa493463740 1 -- 172.21.15.2:0/3767409577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0cfeba410 msgr2=0x55f0cfec4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.911+0000 7fa493463740 1 --2- 172.21.15.2:0/3767409577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0cfeba410 0x55f0cfec4770 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fa48400bc20 tx=0x7fa48400f730 comp rx=0 tx=0).stop 2024-09-19T06:17:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.912+0000 7fa493463740 1 -- 172.21.15.2:0/3767409577 shutdown_connections 2024-09-19T06:17:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.912+0000 7fa493463740 1 --2- 172.21.15.2:0/3767409577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f0cfec4cb0 0x55f0cfec70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.912+0000 7fa493463740 1 --2- 172.21.15.2:0/3767409577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0cfeba410 0x55f0cfec4770 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.912+0000 7fa493463740 1 --2- 172.21.15.2:0/3767409577 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0cfeb9af0 0x55f0cfeb9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.912+0000 7fa493463740 1 -- 172.21.15.2:0/3767409577 >> 172.21.15.2:0/3767409577 conn(0x55f0cfeb6060 msgr2=0x55f0cfeb6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.912+0000 7fa493463740 1 -- 172.21.15.2:0/3767409577 shutdown_connections 2024-09-19T06:17:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.912+0000 7fa493463740 1 -- 172.21.15.2:0/3767409577 wait complete. 2024-09-19T06:17:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.912+0000 7fa493463740 1 -- start start 2024-09-19T06:17:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.912+0000 7fa493463740 1 Processor -- start 2024-09-19T06:17:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.912+0000 7fa493463740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0cfeb9af0 0x55f0cfec1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.912+0000 7fa493463740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0cfeba410 0x55f0cfec20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.912+0000 7fa493463740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f0cfec4cb0 0x55f0cfec2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.912+0000 7fa493463740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f0cfec7880 con 0x55f0cfeba410 2024-09-19T06:17:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.912+0000 7fa493463740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55f0cfda7290 con 0x55f0cfeb9af0 2024-09-19T06:17:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.912+0000 7fa493463740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f0cfec7a00 con 0x55f0cfec4cb0 2024-09-19T06:17:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.912+0000 7fa493463740 10 client.0 _ll_register_callbacks cb 0x55f0cfdd8140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.912+0000 7fa48e38d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0cfeba410 0x55f0cfec20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.912+0000 7fa48e38d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0cfeba410 0x55f0cfec20d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32968/0 (socket says 172.21.15.2:32968) 2024-09-19T06:17:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.912+0000 7fa48e38d640 1 -- 172.21.15.2:0/737515047 learned_addr learned my addr 172.21.15.2:0/737515047 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.913+0000 7fa48db8c640 1 --2- 172.21.15.2:0/737515047 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f0cfec4cb0 0x55f0cfec2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.913+0000 7fa48db8c640 1 --2- 172.21.15.2:0/737515047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0cfeb9af0 0x55f0cfec1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.913+0000 7fa48e38d640 1 -- 172.21.15.2:0/737515047 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f0cfec4cb0 msgr2=0x55f0cfec2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.913+0000 7fa48e38d640 1 --2- 172.21.15.2:0/737515047 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f0cfec4cb0 0x55f0cfec2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.913+0000 7fa48e38d640 1 -- 172.21.15.2:0/737515047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0cfeb9af0 msgr2=0x55f0cfec1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.913+0000 7fa48e38d640 1 --2- 172.21.15.2:0/737515047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0cfeb9af0 0x55f0cfec1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.913+0000 7fa48e38d640 1 -- 172.21.15.2:0/737515047 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0cfb31210 con 0x55f0cfeba410 2024-09-19T06:17:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.913+0000 7fa48db8c640 1 --2- 172.21.15.2:0/737515047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0cfeb9af0 0x55f0cfec1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:17:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.913+0000 7fa48e38d640 1 --2- 172.21.15.2:0/737515047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0cfeba410 0x55f0cfec20d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fa48400bf40 tx=0x7fa484004a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bf5de01e5af9e19 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.913+0000 7fa471ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:17:37.921 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.913+0000 7fa471ffb640 1 -- 172.21.15.2:0/737515047 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa484015070 con 0x55f0cfeba410 2024-09-19T06:17:37.921 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.913+0000 7fa471ffb640 1 -- 172.21.15.2:0/737515047 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fa484004dc0 con 0x55f0cfeba410 2024-09-19T06:17:37.921 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.913+0000 7fa493463740 1 -- 172.21.15.2:0/737515047 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4840054d0 con 0x55f0cfeba410 2024-09-19T06:17:37.921 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.913+0000 7fa471ffb640 1 -- 172.21.15.2:0/737515047 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa48400b830 con 0x55f0cfeba410 2024-09-19T06:17:37.921 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.913+0000 7fa493463740 10 client.16086 fetch_fsmap learned FSMap version 26 2024-09-19T06:17:37.921 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.913+0000 7fa493463740 1 -- 172.21.15.2:0/737515047 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f0cfbfd620 con 0x55f0cfeba410 2024-09-19T06:17:37.921 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.913+0000 7fa471ffb640 1 -- 172.21.15.2:0/737515047 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa4840054d0 con 0x55f0cfeba410 2024-09-19T06:17:37.921 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.914+0000 7fa471ffb640 1 -- 172.21.15.2:0/737515047 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fa48402db20 con 0x55f0cfeba410 2024-09-19T06:17:37.921 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.914+0000 7fa493463740 10 client.16086 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:17:37.921 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.914+0000 7fa493463740 10 client.16086 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:17:37.921 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.914+0000 7fa493463740 20 client.16086 populate_metadata read hostname 'smithi002' 2024-09-19T06:17:37.921 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.914+0000 7fa493463740 1 --2- 172.21.15.2:0/737515047 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55f0cfed4bd0 0x55f0cfed6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:37.921 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.914+0000 7fa493463740 4 client.16086 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:17:37.922 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.914+0000 7fa493463740 1 -- 172.21.15.2:0/737515047 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f0cfe2ba20 con 0x55f0cfed4bd0 2024-09-19T06:17:37.922 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.914+0000 7fa48db8c640 1 --2- 172.21.15.2:0/737515047 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55f0cfed4bd0 0x55f0cfed6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:37.922 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.914+0000 7fa471ffb640 10 client.16086 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:17:37.922 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.914+0000 7fa48db8c640 1 --2- 172.21.15.2:0/737515047 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55f0cfed4bd0 0x55f0cfed6fc0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b647c8436c3d77e server_cookie=781a340f2038be6c in_seq=0 out_seq=0 2024-09-19T06:17:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.915+0000 7fa471ffb640 1 -- 172.21.15.2:0/737515047 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f0cfe2ba20 con 0x55f0cfed4bd0 2024-09-19T06:17:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.915+0000 7fa471ffb640 10 client.16086 handle_command_reply: tid=0 2024-09-19T06:17:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.915+0000 7fa493463740 1 client.16086 shutdown 2024-09-19T06:17:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.915+0000 7fa493463740 1 -- 172.21.15.2:0/737515047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0cfeba410 msgr2=0x55f0cfec20d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.915+0000 7fa493463740 1 --2- 172.21.15.2:0/737515047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0cfeba410 0x55f0cfec20d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fa48400bf40 tx=0x7fa484004a00 comp rx=0 tx=0).stop 2024-09-19T06:17:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.915+0000 7fa493463740 1 -- 172.21.15.2:0/737515047 shutdown_connections 2024-09-19T06:17:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.915+0000 7fa493463740 1 --2- 172.21.15.2:0/737515047 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f0cfec4cb0 0x55f0cfec2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.915+0000 7fa493463740 1 --2- 172.21.15.2:0/737515047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0cfeba410 0x55f0cfec20d0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.915+0000 7fa493463740 1 --2- 172.21.15.2:0/737515047 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55f0cfed4bd0 0x55f0cfed6fc0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.915+0000 7fa493463740 1 --2- 172.21.15.2:0/737515047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0cfeb9af0 0x55f0cfec1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.915+0000 7fa471ffb640 0 client.16086 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:17:37.924 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.915+0000 7fa493463740 1 -- 172.21.15.2:0/737515047 >> 172.21.15.2:0/737515047 conn(0x55f0cfeb6060 msgr2=0x55f0cfebbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:37.924 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.915+0000 7fa493463740 1 -- 172.21.15.2:0/737515047 shutdown_connections 2024-09-19T06:17:37.924 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.915+0000 7fa493463740 1 -- 172.21.15.2:0/737515047 wait complete. 2024-09-19T06:17:37.924 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.915+0000 7fa493463740 20 client.16086 trim_cache size 0 max 16384 2024-09-19T06:17:37.936 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.930+0000 7fa493463740 1 Processor -- start 2024-09-19T06:17:37.936 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.930+0000 7fa493463740 1 -- start start 2024-09-19T06:17:37.936 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.930+0000 7fa493463740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0cfeb9af0 0x55f0cfec2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:37.936 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.930+0000 7fa493463740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f0cfeba410 0x55f0cfedc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:37.936 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.930+0000 7fa493463740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0cfec4cb0 0x55f0cfedcb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:37.936 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.930+0000 7fa493463740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa4881aff50 con 0x55f0cfeb9af0 2024-09-19T06:17:37.936 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.930+0000 7fa493463740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa4881ad820 con 0x55f0cfec4cb0 2024-09-19T06:17:37.936 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.930+0000 7fa493463740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa4881ab670 con 0x55f0cfeba410 2024-09-19T06:17:37.936 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.930+0000 7fa48db8c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0cfeb9af0 0x55f0cfec2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:37.937 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.930+0000 7fa48db8c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0cfeb9af0 0x55f0cfec2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32980/0 (socket says 172.21.15.2:32980) 2024-09-19T06:17:37.937 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.930+0000 7fa48db8c640 1 -- 172.21.15.2:0/2530784012 learned_addr learned my addr 172.21.15.2:0/2530784012 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:37.937 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.930+0000 7fa48db8c640 1 --2- 172.21.15.2:0/2530784012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0cfec4cb0 0x55f0cfedcb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:37.937 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.930+0000 7fa48e38d640 1 --2- 172.21.15.2:0/2530784012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f0cfeba410 0x55f0cfedc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:37.937 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.931+0000 7fa48db8c640 1 -- 172.21.15.2:0/2530784012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f0cfeba410 msgr2=0x55f0cfedc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:37.937 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.931+0000 7fa48db8c640 1 --2- 172.21.15.2:0/2530784012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f0cfeba410 0x55f0cfedc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.937 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.931+0000 7fa48db8c640 1 -- 172.21.15.2:0/2530784012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0cfec4cb0 msgr2=0x55f0cfedcb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:37.937 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.931+0000 7fa48db8c640 1 --2- 172.21.15.2:0/2530784012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0cfec4cb0 0x55f0cfedcb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.937 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.931+0000 7fa48db8c640 1 -- 172.21.15.2:0/2530784012 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0cfeb5e90 con 0x55f0cfeb9af0 2024-09-19T06:17:37.937 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.931+0000 7fa48db8c640 1 --2- 172.21.15.2:0/2530784012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0cfeb9af0 0x55f0cfec2440 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x55f0cfebc690 tx=0x7fa4780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e423b3e8b765b6db server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:37.937 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.931+0000 7fa473fff640 1 -- 172.21.15.2:0/2530784012 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4780036b0 con 0x55f0cfeb9af0 2024-09-19T06:17:37.937 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.931+0000 7fa473fff640 1 -- 172.21.15.2:0/2530784012 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa478003d00 con 0x55f0cfeb9af0 2024-09-19T06:17:37.937 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.931+0000 7fa473fff640 1 -- 172.21.15.2:0/2530784012 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa478012ba0 con 0x55f0cfeb9af0 2024-09-19T06:17:37.938 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.932+0000 7fa493463740 1 -- 172.21.15.2:0/2530784012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0cfeb9af0 msgr2=0x55f0cfec2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:37.938 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.932+0000 7fa493463740 1 --2- 172.21.15.2:0/2530784012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0cfeb9af0 0x55f0cfec2440 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x55f0cfebc690 tx=0x7fa4780046c0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.938 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.932+0000 7fa493463740 1 -- 172.21.15.2:0/2530784012 shutdown_connections 2024-09-19T06:17:37.938 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.932+0000 7fa493463740 1 --2- 172.21.15.2:0/2530784012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0cfec4cb0 0x55f0cfedcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.938 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.932+0000 7fa493463740 1 --2- 172.21.15.2:0/2530784012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f0cfeba410 0x55f0cfedc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.938 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.932+0000 7fa493463740 1 --2- 172.21.15.2:0/2530784012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0cfeb9af0 0x55f0cfec2440 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.938 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.932+0000 7fa493463740 1 -- 172.21.15.2:0/2530784012 >> 172.21.15.2:0/2530784012 conn(0x55f0cfeb6060 msgr2=0x55f0cfec3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:37.938 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.932+0000 7fa493463740 1 -- 172.21.15.2:0/2530784012 shutdown_connections 2024-09-19T06:17:37.938 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.932+0000 7fa493463740 1 -- 172.21.15.2:0/2530784012 wait complete. 2024-09-19T06:17:37.938 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.932+0000 7fa493463740 1 -- start start 2024-09-19T06:17:37.938 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.932+0000 7fa493463740 1 Processor -- start 2024-09-19T06:17:37.938 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.932+0000 7fa493463740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f0cfeb9af0 0x55f0cfecd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:37.938 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.932+0000 7fa493463740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0cfeba410 0x55f0cfec8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.932+0000 7fa493463740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0cfec4cb0 0x55f0cfec8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.932+0000 7fa493463740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa4881abce0 con 0x55f0cfec4cb0 2024-09-19T06:17:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.932+0000 7fa493463740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa4881ad150 con 0x55f0cfeba410 2024-09-19T06:17:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.932+0000 7fa493463740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa4881ac3b0 con 0x55f0cfeb9af0 2024-09-19T06:17:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.932+0000 7fa493463740 10 client.0 _ll_register_callbacks cb 0x7fa47800b7c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.932+0000 7fa48db8c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0cfec4cb0 0x55f0cfec8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.932+0000 7fa48db8c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0cfec4cb0 0x55f0cfec8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32982/0 (socket says 172.21.15.2:32982) 2024-09-19T06:17:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.932+0000 7fa48db8c640 1 -- 172.21.15.2:0/2753263442 learned_addr learned my addr 172.21.15.2:0/2753263442 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:17:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.933+0000 7fa48db8c640 1 --2- 172.21.15.2:0/2753263442 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f0cfeb9af0 0x55f0cfecd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.933+0000 7fa48e38d640 1 --2- 172.21.15.2:0/2753263442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0cfeba410 0x55f0cfec8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.933+0000 7fa48db8c640 1 -- 172.21.15.2:0/2753263442 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f0cfeb9af0 msgr2=0x55f0cfecd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.933+0000 7fa48db8c640 1 --2- 172.21.15.2:0/2753263442 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f0cfeb9af0 0x55f0cfecd200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.933+0000 7fa48db8c640 1 -- 172.21.15.2:0/2753263442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0cfeba410 msgr2=0x55f0cfec8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:37.940 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.933+0000 7fa48db8c640 1 --2- 172.21.15.2:0/2753263442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0cfeba410 0x55f0cfec8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.940 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.933+0000 7fa48db8c640 1 -- 172.21.15.2:0/2753263442 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0cfec9050 con 0x55f0cfec4cb0 2024-09-19T06:17:37.940 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.933+0000 7fa48e38d640 1 --2- 172.21.15.2:0/2753263442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0cfeba410 0x55f0cfec8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:37.940 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.933+0000 7fa48db8c640 1 --2- 172.21.15.2:0/2753263442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0cfec4cb0 0x55f0cfec8a60 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa478012880 tx=0x7fa4780045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d44362e5d73e1cd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:37.940 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.933+0000 7fa471ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:17:37.940 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.933+0000 7fa471ffb640 1 -- 172.21.15.2:0/2753263442 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4780036b0 con 0x55f0cfec4cb0 2024-09-19T06:17:37.940 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.933+0000 7fa471ffb640 1 -- 172.21.15.2:0/2753263442 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fa478003850 con 0x55f0cfec4cb0 2024-09-19T06:17:37.940 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.933+0000 7fa493463740 1 -- 172.21.15.2:0/2753263442 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa478003d00 con 0x55f0cfec4cb0 2024-09-19T06:17:37.940 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.933+0000 7fa471ffb640 1 -- 172.21.15.2:0/2753263442 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa47803f050 con 0x55f0cfec4cb0 2024-09-19T06:17:37.940 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.933+0000 7fa493463740 10 client.16092 fetch_fsmap learned FSMap version 26 2024-09-19T06:17:37.940 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.933+0000 7fa493463740 1 -- 172.21.15.2:0/2753263442 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f0cff3f400 con 0x55f0cfec4cb0 2024-09-19T06:17:37.940 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.934+0000 7fa471ffb640 1 -- 172.21.15.2:0/2753263442 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa478003d00 con 0x55f0cfec4cb0 2024-09-19T06:17:37.940 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.934+0000 7fa471ffb640 1 -- 172.21.15.2:0/2753263442 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fa478037020 con 0x55f0cfec4cb0 2024-09-19T06:17:37.941 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.934+0000 7fa493463740 10 client.16092 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:17:37.941 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.934+0000 7fa493463740 10 client.16092 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:17:37.941 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.934+0000 7fa493463740 20 client.16092 populate_metadata read hostname 'smithi002' 2024-09-19T06:17:37.941 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.934+0000 7fa493463740 1 --2- 172.21.15.2:0/2753263442 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55f0cff3fa70 0x55f0cff41e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:37.941 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.934+0000 7fa493463740 4 client.16092 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:17:37.941 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.934+0000 7fa493463740 1 -- 172.21.15.2:0/2753263442 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f0cfe25d70 con 0x55f0cff3fa70 2024-09-19T06:17:37.941 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.934+0000 7fa48e38d640 1 --2- 172.21.15.2:0/2753263442 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55f0cff3fa70 0x55f0cff41e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:37.941 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.934+0000 7fa48e38d640 1 --2- 172.21.15.2:0/2753263442 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55f0cff3fa70 0x55f0cff41e60 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b307a7eaab7a2a server_cookie=37f5e103ff38d3db in_seq=0 out_seq=0 2024-09-19T06:17:37.941 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.934+0000 7fa471ffb640 10 client.16092 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:17:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.942+0000 7fa471ffb640 1 -- 172.21.15.2:0/2753263442 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f0cfe25d70 con 0x55f0cff3fa70 2024-09-19T06:17:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.942+0000 7fa471ffb640 10 client.16092 handle_command_reply: tid=0 2024-09-19T06:17:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.942+0000 7fa493463740 1 client.16092 shutdown 2024-09-19T06:17:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.942+0000 7fa493463740 1 -- 172.21.15.2:0/2753263442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0cfec4cb0 msgr2=0x55f0cfec8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.942+0000 7fa493463740 1 --2- 172.21.15.2:0/2753263442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0cfec4cb0 0x55f0cfec8a60 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa478012880 tx=0x7fa4780045d0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.942+0000 7fa493463740 1 -- 172.21.15.2:0/2753263442 shutdown_connections 2024-09-19T06:17:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.942+0000 7fa493463740 1 --2- 172.21.15.2:0/2753263442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0cfec4cb0 0x55f0cfec8a60 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.942+0000 7fa493463740 1 --2- 172.21.15.2:0/2753263442 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55f0cff3fa70 0x55f0cff41e60 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.942+0000 7fa493463740 1 --2- 172.21.15.2:0/2753263442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f0cfeba410 0x55f0cfec8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.942+0000 7fa493463740 1 --2- 172.21.15.2:0/2753263442 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f0cfeb9af0 0x55f0cfecd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.946 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.942+0000 7fa471ffb640 0 client.16092 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:17:37.946 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.942+0000 7fa493463740 1 -- 172.21.15.2:0/2753263442 >> 172.21.15.2:0/2753263442 conn(0x55f0cfeb6060 msgr2=0x55f0cfeb49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:37.946 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.942+0000 7fa493463740 1 -- 172.21.15.2:0/2753263442 shutdown_connections 2024-09-19T06:17:37.946 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.942+0000 7fa493463740 1 -- 172.21.15.2:0/2753263442 wait complete. 2024-09-19T06:17:37.946 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.942+0000 7fa493463740 20 client.16092 trim_cache size 0 max 16384 2024-09-19T06:17:37.946 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-09-19T06:17:37.946 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "message": "", 2024-09-19T06:17:37.946 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-09-19T06:17:37.946 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-09-19T06:17:37.947 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.943+0000 7fa4905f1640 1 -- 172.21.15.2:0/516020651 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa4740a3430 msgr2=0x7fa4740a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:37.947 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.943+0000 7fa4905f1640 1 --2- 172.21.15.2:0/516020651 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa4740a3430 0x7fa4740a58f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa48008ff30 tx=0x7fa48008ff60 comp rx=0 tx=0).stop 2024-09-19T06:17:37.947 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.943+0000 7fa4905f1640 1 -- 172.21.15.2:0/516020651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4881069e0 msgr2=0x7fa48819cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:37.948 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.943+0000 7fa4905f1640 1 --2- 172.21.15.2:0/516020651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4881069e0 0x7fa48819cbe0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fa480005cc0 tx=0x7fa480003c20 comp rx=0 tx=0).stop 2024-09-19T06:17:37.948 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.943+0000 7fa4905f1640 1 -- 172.21.15.2:0/516020651 shutdown_connections 2024-09-19T06:17:37.948 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.943+0000 7fa4905f1640 1 --2- 172.21.15.2:0/516020651 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa4740a3430 0x7fa4740a58f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.948 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.943+0000 7fa4905f1640 1 --2- 172.21.15.2:0/516020651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4881069e0 0x7fa48819cbe0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.948 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.943+0000 7fa4905f1640 1 --2- 172.21.15.2:0/516020651 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa488101370 0x7fa488198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.948 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.943+0000 7fa4905f1640 1 --2- 172.21.15.2:0/516020651 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4881009d0 0x7fa488198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.948 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.943+0000 7fa4905f1640 1 -- 172.21.15.2:0/516020651 >> 172.21.15.2:0/516020651 conn(0x7fa4880fc6b0 msgr2=0x7fa48806a660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:37.948 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.943+0000 7fa4905f1640 1 -- 172.21.15.2:0/516020651 shutdown_connections 2024-09-19T06:17:37.948 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-09-19T06:17:37.943+0000 7fa4905f1640 1 -- 172.21.15.2:0/516020651 wait complete. 2024-09-19T06:17:38.138 INFO:tasks.cephfs.filesystem:scrub status for tag:4de7ca85-f6ec-43ae-a2df-f7aad702a8e3 - {'path': '/', 'tag': '4de7ca85-f6ec-43ae-a2df-f7aad702a8e3', 'options': 'recursive,force'} 2024-09-19T06:17:38.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:17:38 smithi002 ceph-mon[30982]: scrub summary: idle 2024-09-19T06:17:38.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:17:38 smithi090 ceph-mon[34497]: scrub summary: idle 2024-09-19T06:17:38.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:17:38 smithi089 ceph-mon[34160]: scrub summary: idle 2024-09-19T06:17:39.649 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:17:39 smithi002 ceph-mon[30982]: pgmap v88: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 443 MiB/s wr, 118 op/s 2024-09-19T06:17:39.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:17:39 smithi090 ceph-mon[34497]: pgmap v88: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 443 MiB/s wr, 118 op/s 2024-09-19T06:17:39.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:17:39 smithi089 ceph-mon[34160]: pgmap v88: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 443 MiB/s wr, 118 op/s 2024-09-19T06:17:40.318 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-19T06:17:40.319 INFO:tasks.workunit.client.0.smithi002.stdout: Children see throughput for 1 re-readers = 8839806.00 kB/sec 2024-09-19T06:17:40.319 INFO:tasks.workunit.client.0.smithi002.stdout: Parent sees throughput for 1 re-readers = 8837951.67 kB/sec 2024-09-19T06:17:40.319 INFO:tasks.workunit.client.0.smithi002.stdout: Min throughput per process = 8839806.00 kB/sec 2024-09-19T06:17:40.319 INFO:tasks.workunit.client.0.smithi002.stdout: Max throughput per process = 8839806.00 kB/sec 2024-09-19T06:17:40.319 INFO:tasks.workunit.client.0.smithi002.stdout: Avg throughput per process = 8839806.00 kB/sec 2024-09-19T06:17:40.319 INFO:tasks.workunit.client.0.smithi002.stdout: Min xfer = 10485760.00 kB 2024-09-19T06:17:41.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:17:41 smithi002 ceph-mon[30982]: pgmap v89: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 443 MiB/s wr, 124 op/s 2024-09-19T06:17:41.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:17:41 smithi090 ceph-mon[34497]: pgmap v89: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 443 MiB/s wr, 124 op/s 2024-09-19T06:17:41.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:17:41 smithi089 ceph-mon[34160]: pgmap v89: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 443 MiB/s wr, 124 op/s 2024-09-19T06:17:43.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:17:43 smithi002 ceph-mon[30982]: pgmap v90: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 155 MiB/s wr, 47 op/s 2024-09-19T06:17:43.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:17:43 smithi090 ceph-mon[34497]: pgmap v90: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 155 MiB/s wr, 47 op/s 2024-09-19T06:17:43.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:17:43 smithi089 ceph-mon[34160]: pgmap v90: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 155 MiB/s wr, 47 op/s 2024-09-19T06:17:45.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:17:45 smithi002 ceph-mon[30982]: pgmap v91: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 155 MiB/s wr, 49 op/s 2024-09-19T06:17:45.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:17:45 smithi090 ceph-mon[34497]: pgmap v91: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 155 MiB/s wr, 49 op/s 2024-09-19T06:17:45.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:17:45 smithi089 ceph-mon[34160]: pgmap v91: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 155 MiB/s wr, 49 op/s 2024-09-19T06:17:47.254 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-19T06:17:47.254 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-19T06:17:47.254 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-19T06:17:47.254 INFO:tasks.workunit.client.0.smithi002.stdout:iozone test complete. 2024-09-19T06:17:47.255 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T06:17:47.255 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T06:17:47.300 INFO:tasks.workunit:Stopping ['suites/iozone.sh'] on client.0... 2024-09-19T06:17:47.300 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T06:17:47.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:17:47 smithi002 ceph-mon[30982]: pgmap v92: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-19T06:17:47.613 DEBUG:teuthology.parallel:result is None 2024-09-19T06:17:47.613 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T06:17:47.648 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T06:17:47.649 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-19T06:17:47.660 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi002.front.sepia.ceph.com 2024-09-19T06:17:47.696 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-19T06:17:47.706 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-19T06:17:47.706 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T06:17:47.706 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-19T06:17:47.707 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-19T06:17:47.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:17:47 smithi090 ceph-mon[34497]: pgmap v92: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-19T06:17:47.763 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-19T06:17:47.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:17:47 smithi089 ceph-mon[34160]: pgmap v92: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-19T06:17:49.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:17:49 smithi002 ceph-mon[30982]: pgmap v93: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-19T06:17:49.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:17:49 smithi090 ceph-mon[34497]: pgmap v93: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-19T06:17:49.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:17:49 smithi089 ceph-mon[34160]: pgmap v93: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-19T06:17:51.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:17:51 smithi002 ceph-mon[30982]: pgmap v94: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.7 KiB/s wr, 12 op/s 2024-09-19T06:17:51.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:17:51 smithi090 ceph-mon[34497]: pgmap v94: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.7 KiB/s wr, 12 op/s 2024-09-19T06:17:51.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:17:51 smithi089 ceph-mon[34160]: pgmap v94: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.7 KiB/s wr, 12 op/s 2024-09-19T06:17:53.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:17:53 smithi002 ceph-mon[30982]: pgmap v95: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.1 KiB/s wr, 5 op/s 2024-09-19T06:17:53.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:17:53 smithi090 ceph-mon[34497]: pgmap v95: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.1 KiB/s wr, 5 op/s 2024-09-19T06:17:53.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:17:53 smithi089 ceph-mon[34160]: pgmap v95: 97 pgs: 97 active+clean; 12 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.1 KiB/s wr, 5 op/s 2024-09-19T06:17:55.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:17:55 smithi002 ceph-mon[30982]: pgmap v96: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.4 KiB/s wr, 222 op/s 2024-09-19T06:17:55.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:17:55 smithi090 ceph-mon[34497]: pgmap v96: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.4 KiB/s wr, 222 op/s 2024-09-19T06:17:55.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:17:55 smithi089 ceph-mon[34160]: pgmap v96: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.4 KiB/s wr, 222 op/s 2024-09-19T06:17:57.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:17:57 smithi002 ceph-mon[30982]: pgmap v97: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.4 KiB/s wr, 220 op/s 2024-09-19T06:17:57.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:17:57 smithi090 ceph-mon[34497]: pgmap v97: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.4 KiB/s wr, 220 op/s 2024-09-19T06:17:57.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:17:57 smithi089 ceph-mon[34160]: pgmap v97: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.4 KiB/s wr, 220 op/s 2024-09-19T06:17:59.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:17:59 smithi002 ceph-mon[30982]: pgmap v98: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.4 KiB/s wr, 220 op/s 2024-09-19T06:17:59.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:17:59 smithi090 ceph-mon[34497]: pgmap v98: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.4 KiB/s wr, 220 op/s 2024-09-19T06:17:59.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:17:59 smithi089 ceph-mon[34160]: pgmap v98: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.4 KiB/s wr, 220 op/s 2024-09-19T06:18:00.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:00 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:18:00.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:00 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:18:00.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:00 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:18:01.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:01 smithi002 ceph-mon[30982]: pgmap v99: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.4 KiB/s wr, 222 op/s 2024-09-19T06:18:01.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:01 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:18:01.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:01 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:18:01.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:01 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:18:01.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:01 smithi090 ceph-mon[34497]: pgmap v99: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.4 KiB/s wr, 222 op/s 2024-09-19T06:18:01.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:01 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:18:01.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:01 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:18:01.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:01 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:18:01.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:01 smithi089 ceph-mon[34160]: pgmap v99: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.4 KiB/s wr, 222 op/s 2024-09-19T06:18:01.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:01 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:18:01.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:01 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:18:01.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:01 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:18:03.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:03 smithi002 ceph-mon[30982]: pgmap v100: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.3 KiB/s wr, 219 op/s 2024-09-19T06:18:03.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:03 smithi090 ceph-mon[34497]: pgmap v100: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.3 KiB/s wr, 219 op/s 2024-09-19T06:18:03.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:03 smithi089 ceph-mon[34160]: pgmap v100: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.3 KiB/s wr, 219 op/s 2024-09-19T06:18:05.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:05 smithi002 ceph-mon[30982]: pgmap v101: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 236 op/s 2024-09-19T06:18:05.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:05 smithi090 ceph-mon[34497]: pgmap v101: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 236 op/s 2024-09-19T06:18:05.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:05 smithi089 ceph-mon[34160]: pgmap v101: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 236 op/s 2024-09-19T06:18:07.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:07 smithi002 ceph-mon[30982]: pgmap v102: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-19T06:18:07.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:07 smithi090 ceph-mon[34497]: pgmap v102: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-19T06:18:07.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:07 smithi089 ceph-mon[34160]: pgmap v102: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-19T06:18:08.140 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:18:08.411 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:18:08.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.902+0000 7fc24b9db640 1 -- 172.21.15.2:0/4081188908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc244106a80 msgr2=0x7fc244106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:08.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.902+0000 7fc24b9db640 1 --2- 172.21.15.2:0/4081188908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc244106a80 0x7fc244106e60 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fc240009930 tx=0x7fc24002a420 comp rx=0 tx=0).stop 2024-09-19T06:18:08.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.902+0000 7fc24b9db640 1 -- 172.21.15.2:0/4081188908 shutdown_connections 2024-09-19T06:18:08.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.902+0000 7fc24b9db640 1 --2- 172.21.15.2:0/4081188908 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc244101420 0x7fc24410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.902+0000 7fc24b9db640 1 --2- 172.21.15.2:0/4081188908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc244100a80 0x7fc244100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.902+0000 7fc24b9db640 1 --2- 172.21.15.2:0/4081188908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc244106a80 0x7fc244106e60 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.902+0000 7fc24b9db640 1 -- 172.21.15.2:0/4081188908 >> 172.21.15.2:0/4081188908 conn(0x7fc2440fc7a0 msgr2=0x7fc2440febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:08.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.902+0000 7fc24b9db640 1 -- 172.21.15.2:0/4081188908 shutdown_connections 2024-09-19T06:18:08.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.902+0000 7fc24b9db640 1 -- 172.21.15.2:0/4081188908 wait complete. 2024-09-19T06:18:08.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.902+0000 7fc24b9db640 1 Processor -- start 2024-09-19T06:18:08.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.902+0000 7fc24b9db640 1 -- start start 2024-09-19T06:18:08.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.903+0000 7fc24b9db640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc244100a80 0x7fc244197020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:08.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.903+0000 7fc24b9db640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc244101420 0x7fc244197560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:08.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.903+0000 7fc24b9db640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc244106a80 0x7fc244197aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:08.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.903+0000 7fc24b9db640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc244110d80 con 0x7fc244106a80 2024-09-19T06:18:08.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.903+0000 7fc24b9db640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc244110c00 con 0x7fc244101420 2024-09-19T06:18:08.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.903+0000 7fc24b9db640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc244110f00 con 0x7fc244100a80 2024-09-19T06:18:08.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.903+0000 7fc249f78640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc244106a80 0x7fc244197aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:08.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.903+0000 7fc249f78640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc244106a80 0x7fc244197aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39214/0 (socket says 172.21.15.2:39214) 2024-09-19T06:18:08.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.903+0000 7fc249f78640 1 -- 172.21.15.2:0/4039071188 learned_addr learned my addr 172.21.15.2:0/4039071188 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:08.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.903+0000 7fc249777640 1 --2- 172.21.15.2:0/4039071188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc244100a80 0x7fc244197020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:08.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.903+0000 7fc248f76640 1 --2- 172.21.15.2:0/4039071188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc244101420 0x7fc244197560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:08.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.903+0000 7fc249f78640 1 -- 172.21.15.2:0/4039071188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc244100a80 msgr2=0x7fc244197020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:08.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.903+0000 7fc249f78640 1 --2- 172.21.15.2:0/4039071188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc244100a80 0x7fc244197020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.903+0000 7fc249f78640 1 -- 172.21.15.2:0/4039071188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc244101420 msgr2=0x7fc244197560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:08.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.903+0000 7fc249f78640 1 --2- 172.21.15.2:0/4039071188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc244101420 0x7fc244197560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.903+0000 7fc249f78640 1 -- 172.21.15.2:0/4039071188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2441a6890 con 0x7fc244106a80 2024-09-19T06:18:08.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.903+0000 7fc249f78640 1 --2- 172.21.15.2:0/4039071188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc244106a80 0x7fc244197aa0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fc23c00cad0 tx=0x7fc23c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:08.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.904+0000 7fc23a7fc640 1 -- 172.21.15.2:0/4039071188 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23c00ae20 con 0x7fc244106a80 2024-09-19T06:18:08.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.904+0000 7fc23a7fc640 1 -- 172.21.15.2:0/4039071188 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc23c005020 con 0x7fc244106a80 2024-09-19T06:18:08.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.904+0000 7fc24b9db640 1 -- 172.21.15.2:0/4039071188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2441a6b80 con 0x7fc244106a80 2024-09-19T06:18:08.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.904+0000 7fc23a7fc640 1 -- 172.21.15.2:0/4039071188 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23c00f6b0 con 0x7fc244106a80 2024-09-19T06:18:08.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.904+0000 7fc24b9db640 1 -- 172.21.15.2:0/4039071188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2441a7110 con 0x7fc244106a80 2024-09-19T06:18:08.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.906+0000 7fc23a7fc640 1 -- 172.21.15.2:0/4039071188 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fc23c0051d0 con 0x7fc244106a80 2024-09-19T06:18:08.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.907+0000 7fc23a7fc640 1 --2- 172.21.15.2:0/4039071188 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc2300a3430 0x7fc2300a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:08.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.907+0000 7fc249777640 1 --2- 172.21.15.2:0/4039071188 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc2300a3430 0x7fc2300a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:08.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.907+0000 7fc23a7fc640 1 -- 172.21.15.2:0/4039071188 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fc23c0cfc50 con 0x7fc244106a80 2024-09-19T06:18:08.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.907+0000 7fc249777640 1 --2- 172.21.15.2:0/4039071188 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc2300a3430 0x7fc2300a58f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc240031440 tx=0x7fc240005a20 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:08.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.907+0000 7fc24ddb4740 1 Processor -- start 2024-09-19T06:18:08.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.908+0000 7fc24ddb4740 1 -- start start 2024-09-19T06:18:08.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.908+0000 7fc24ddb4740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d042d94a0 0x558d042d9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:08.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.908+0000 7fc24ddb4740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d042d9dc0 0x558d042e4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:08.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.908+0000 7fc24ddb4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d042e4680 0x558d042e6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:08.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.908+0000 7fc24ddb4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558d0423f2e0 con 0x558d042e4680 2024-09-19T06:18:08.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.908+0000 7fc24ddb4740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x558d041e6ce0 con 0x558d042d9dc0 2024-09-19T06:18:08.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.908+0000 7fc24ddb4740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x558d0423b2a0 con 0x558d042d94a0 2024-09-19T06:18:08.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.908+0000 7fc249f78640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d042e4680 0x558d042e6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:08.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.908+0000 7fc249777640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d042d94a0 0x558d042d9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:08.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.908+0000 7fc249f78640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d042e4680 0x558d042e6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39226/0 (socket says 172.21.15.2:39226) 2024-09-19T06:18:08.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.908+0000 7fc249f78640 1 -- 172.21.15.2:0/2155689774 learned_addr learned my addr 172.21.15.2:0/2155689774 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:08.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.908+0000 7fc248f76640 1 --2- 172.21.15.2:0/2155689774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d042d9dc0 0x558d042e4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:08.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.908+0000 7fc249f78640 1 -- 172.21.15.2:0/2155689774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d042d94a0 msgr2=0x558d042d9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:08.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.908+0000 7fc249f78640 1 --2- 172.21.15.2:0/2155689774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d042d94a0 0x558d042d9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.908+0000 7fc249f78640 1 -- 172.21.15.2:0/2155689774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d042d9dc0 msgr2=0x558d042e4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:08.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.908+0000 7fc249f78640 1 --2- 172.21.15.2:0/2155689774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d042d9dc0 0x558d042e4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.908+0000 7fc249f78640 1 -- 172.21.15.2:0/2155689774 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d041cb440 con 0x558d042e4680 2024-09-19T06:18:08.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.908+0000 7fc248f76640 1 --2- 172.21.15.2:0/2155689774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d042d9dc0 0x558d042e4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:18:08.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.909+0000 7fc249f78640 1 --2- 172.21.15.2:0/2155689774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d042e4680 0x558d042e6a70 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fc23c00a6e0 tx=0x7fc23c09bfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3a6765efcb4901c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:08.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.909+0000 7fc22f7fe640 1 -- 172.21.15.2:0/2155689774 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23c01d040 con 0x558d042e4680 2024-09-19T06:18:08.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.909+0000 7fc22f7fe640 1 -- 172.21.15.2:0/2155689774 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc23c005560 con 0x558d042e4680 2024-09-19T06:18:08.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.909+0000 7fc22f7fe640 1 -- 172.21.15.2:0/2155689774 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23c09b5b0 con 0x558d042e4680 2024-09-19T06:18:08.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.910+0000 7fc24ddb4740 1 -- 172.21.15.2:0/2155689774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d042e4680 msgr2=0x558d042e6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:08.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.910+0000 7fc24ddb4740 1 --2- 172.21.15.2:0/2155689774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d042e4680 0x558d042e6a70 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fc23c00a6e0 tx=0x7fc23c09bfc0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.910+0000 7fc24ddb4740 1 -- 172.21.15.2:0/2155689774 shutdown_connections 2024-09-19T06:18:08.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.910+0000 7fc24ddb4740 1 --2- 172.21.15.2:0/2155689774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d042e4680 0x558d042e6a70 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.910+0000 7fc24ddb4740 1 --2- 172.21.15.2:0/2155689774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d042d9dc0 0x558d042e4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.910+0000 7fc24ddb4740 1 --2- 172.21.15.2:0/2155689774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d042d94a0 0x558d042d9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.910+0000 7fc24ddb4740 1 -- 172.21.15.2:0/2155689774 >> 172.21.15.2:0/2155689774 conn(0x558d042d5a30 msgr2=0x558d042d5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:08.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.910+0000 7fc24ddb4740 1 -- 172.21.15.2:0/2155689774 shutdown_connections 2024-09-19T06:18:08.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.910+0000 7fc24ddb4740 1 -- 172.21.15.2:0/2155689774 wait complete. 2024-09-19T06:18:08.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.910+0000 7fc24ddb4740 1 -- start start 2024-09-19T06:18:08.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.910+0000 7fc24ddb4740 1 Processor -- start 2024-09-19T06:18:08.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.911+0000 7fc24ddb4740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d042d94a0 0x558d042e3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:08.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.911+0000 7fc24ddb4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d042d9dc0 0x558d042e1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:08.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.911+0000 7fc24ddb4740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d042e4680 0x558d042e17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:08.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.911+0000 7fc24ddb4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558d042e7250 con 0x558d042d9dc0 2024-09-19T06:18:08.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.911+0000 7fc24ddb4740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x558d041fa050 con 0x558d042e4680 2024-09-19T06:18:08.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.911+0000 7fc24ddb4740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x558d042e73d0 con 0x558d042d94a0 2024-09-19T06:18:08.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.911+0000 7fc24ddb4740 10 client.0 _ll_register_callbacks cb 0x558d0423a160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:08.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.911+0000 7fc248f76640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d042d9dc0 0x558d042e1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:08.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.911+0000 7fc248f76640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d042d9dc0 0x558d042e1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39238/0 (socket says 172.21.15.2:39238) 2024-09-19T06:18:08.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.911+0000 7fc248f76640 1 -- 172.21.15.2:0/3607246696 learned_addr learned my addr 172.21.15.2:0/3607246696 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:08.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.911+0000 7fc249777640 1 --2- 172.21.15.2:0/3607246696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d042d94a0 0x558d042e3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:08.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.911+0000 7fc249f78640 1 --2- 172.21.15.2:0/3607246696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d042e4680 0x558d042e17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:08.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.911+0000 7fc248f76640 1 -- 172.21.15.2:0/3607246696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d042d94a0 msgr2=0x558d042e3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:08.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.911+0000 7fc248f76640 1 --2- 172.21.15.2:0/3607246696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d042d94a0 0x558d042e3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.911+0000 7fc248f76640 1 -- 172.21.15.2:0/3607246696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d042e4680 msgr2=0x558d042e17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:08.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.911+0000 7fc248f76640 1 --2- 172.21.15.2:0/3607246696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d042e4680 0x558d042e17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.911+0000 7fc248f76640 1 -- 172.21.15.2:0/3607246696 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d03fb03c0 con 0x558d042d9dc0 2024-09-19T06:18:08.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.911+0000 7fc249f78640 1 --2- 172.21.15.2:0/3607246696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d042e4680 0x558d042e17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:18:08.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.911+0000 7fc248f76640 1 --2- 172.21.15.2:0/3607246696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d042d9dc0 0x558d042e1270 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fc23400dee0 tx=0x7fc2340117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1662d9918de8b12c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:08.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.911+0000 7fc22cff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:18:08.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.912+0000 7fc22cff9640 1 -- 172.21.15.2:0/3607246696 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc234012650 con 0x558d042d9dc0 2024-09-19T06:18:08.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.912+0000 7fc22cff9640 1 -- 172.21.15.2:0/3607246696 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fc2340127f0 con 0x558d042d9dc0 2024-09-19T06:18:08.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.912+0000 7fc24ddb4740 1 -- 172.21.15.2:0/3607246696 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc23c005560 con 0x558d042d9dc0 2024-09-19T06:18:08.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.912+0000 7fc22cff9640 1 -- 172.21.15.2:0/3607246696 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc2340129f0 con 0x558d042d9dc0 2024-09-19T06:18:08.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.912+0000 7fc24ddb4740 10 client.16104 fetch_fsmap learned FSMap version 26 2024-09-19T06:18:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.912+0000 7fc24ddb4740 1 -- 172.21.15.2:0/3607246696 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x558d042f2c90 con 0x558d042d9dc0 2024-09-19T06:18:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.912+0000 7fc22cff9640 1 -- 172.21.15.2:0/3607246696 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc23c005560 con 0x558d042d9dc0 2024-09-19T06:18:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.912+0000 7fc22cff9640 1 -- 172.21.15.2:0/3607246696 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fc2340233d0 con 0x558d042d9dc0 2024-09-19T06:18:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.912+0000 7fc24ddb4740 10 client.16104 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:18:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.912+0000 7fc24ddb4740 10 client.16104 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:18:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.912+0000 7fc24ddb4740 20 client.16104 populate_metadata read hostname 'smithi002' 2024-09-19T06:18:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.912+0000 7fc24ddb4740 1 --2- 172.21.15.2:0/3607246696 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558d042f41f0 0x558d042f6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.912+0000 7fc24ddb4740 4 client.16104 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:18:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.912+0000 7fc24ddb4740 1 -- 172.21.15.2:0/3607246696 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d0424c850 con 0x558d042f41f0 2024-09-19T06:18:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.913+0000 7fc249777640 1 --2- 172.21.15.2:0/3607246696 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558d042f41f0 0x558d042f6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.913+0000 7fc22cff9640 10 client.16104 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:18:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.913+0000 7fc249777640 1 --2- 172.21.15.2:0/3607246696 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558d042f41f0 0x558d042f6610 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7920eb2edbdecd14 server_cookie=4776cf1774523332 in_seq=0 out_seq=0 2024-09-19T06:18:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.914+0000 7fc22cff9640 1 -- 172.21.15.2:0/3607246696 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558d0424c850 con 0x558d042f41f0 2024-09-19T06:18:08.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.914+0000 7fc22cff9640 10 client.16104 handle_command_reply: tid=0 2024-09-19T06:18:08.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.914+0000 7fc24ddb4740 1 client.16104 shutdown 2024-09-19T06:18:08.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.914+0000 7fc24ddb4740 1 -- 172.21.15.2:0/3607246696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d042d9dc0 msgr2=0x558d042e1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:08.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.914+0000 7fc24ddb4740 1 --2- 172.21.15.2:0/3607246696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d042d9dc0 0x558d042e1270 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fc23400dee0 tx=0x7fc2340117b0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.914+0000 7fc24ddb4740 1 -- 172.21.15.2:0/3607246696 shutdown_connections 2024-09-19T06:18:08.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.914+0000 7fc24ddb4740 1 --2- 172.21.15.2:0/3607246696 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558d042f41f0 0x558d042f6610 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.914+0000 7fc24ddb4740 1 --2- 172.21.15.2:0/3607246696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d042e4680 0x558d042e17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.914+0000 7fc24ddb4740 1 --2- 172.21.15.2:0/3607246696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d042d9dc0 0x558d042e1270 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.914+0000 7fc22cff9640 0 client.16104 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:18:08.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.914+0000 7fc24ddb4740 1 --2- 172.21.15.2:0/3607246696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d042d94a0 0x558d042e3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.914+0000 7fc24ddb4740 1 -- 172.21.15.2:0/3607246696 >> 172.21.15.2:0/3607246696 conn(0x558d042d5a30 msgr2=0x558d042db710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:08.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.914+0000 7fc24ddb4740 1 -- 172.21.15.2:0/3607246696 shutdown_connections 2024-09-19T06:18:08.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.914+0000 7fc24ddb4740 1 -- 172.21.15.2:0/3607246696 wait complete. 2024-09-19T06:18:08.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.915+0000 7fc24ddb4740 20 client.16104 trim_cache size 0 max 16384 2024-09-19T06:18:08.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.932+0000 7fc24ddb4740 1 Processor -- start 2024-09-19T06:18:08.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.932+0000 7fc24ddb4740 1 -- start start 2024-09-19T06:18:08.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.932+0000 7fc24ddb4740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d042d94a0 0x558d042f04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:08.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.932+0000 7fc24ddb4740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d042d9dc0 0x558d042dc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:08.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.932+0000 7fc24ddb4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d042e4680 0x558d042fbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:08.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.932+0000 7fc24ddb4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc2441b2350 con 0x558d042e4680 2024-09-19T06:18:08.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.932+0000 7fc24ddb4740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc2441afc20 con 0x558d042d94a0 2024-09-19T06:18:08.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.932+0000 7fc24ddb4740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc2441ada70 con 0x558d042d9dc0 2024-09-19T06:18:08.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.932+0000 7fc249f78640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d042e4680 0x558d042fbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:08.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.932+0000 7fc248f76640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d042d9dc0 0x558d042dc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:08.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.932+0000 7fc249f78640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d042e4680 0x558d042fbec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39244/0 (socket says 172.21.15.2:39244) 2024-09-19T06:18:08.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.932+0000 7fc249f78640 1 -- 172.21.15.2:0/1505886645 learned_addr learned my addr 172.21.15.2:0/1505886645 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:08.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.932+0000 7fc248f76640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d042d9dc0 0x558d042dc0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:41970/0 (socket says 172.21.15.2:41970) 2024-09-19T06:18:08.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.932+0000 7fc249777640 1 --2- 172.21.15.2:0/1505886645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d042d94a0 0x558d042f04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:08.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.933+0000 7fc248f76640 1 -- 172.21.15.2:0/1505886645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d042d94a0 msgr2=0x558d042f04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:08.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.933+0000 7fc248f76640 1 --2- 172.21.15.2:0/1505886645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d042d94a0 0x558d042f04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.933+0000 7fc248f76640 1 -- 172.21.15.2:0/1505886645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d042e4680 msgr2=0x558d042fbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:08.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.933+0000 7fc248f76640 1 --2- 172.21.15.2:0/1505886645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d042e4680 0x558d042fbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.933+0000 7fc248f76640 1 -- 172.21.15.2:0/1505886645 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d042d92d0 con 0x558d042d9dc0 2024-09-19T06:18:08.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.933+0000 7fc249777640 1 --2- 172.21.15.2:0/1505886645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d042d94a0 0x558d042f04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:18:08.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.933+0000 7fc249f78640 1 --2- 172.21.15.2:0/1505886645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d042e4680 0x558d042fbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:18:08.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.933+0000 7fc248f76640 1 --2- 172.21.15.2:0/1505886645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d042d9dc0 0x558d042dc0e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc2340238c0 tx=0x7fc23400d970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa86799d9b1d7c22 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:08.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.933+0000 7fc22effd640 1 -- 172.21.15.2:0/1505886645 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc234028040 con 0x558d042d9dc0 2024-09-19T06:18:08.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.933+0000 7fc22effd640 1 -- 172.21.15.2:0/1505886645 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc234023cb0 con 0x558d042d9dc0 2024-09-19T06:18:08.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.933+0000 7fc22effd640 1 -- 172.21.15.2:0/1505886645 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc234005040 con 0x558d042d9dc0 2024-09-19T06:18:08.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.934+0000 7fc24ddb4740 1 -- 172.21.15.2:0/1505886645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d042d9dc0 msgr2=0x558d042dc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:08.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.934+0000 7fc24ddb4740 1 --2- 172.21.15.2:0/1505886645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d042d9dc0 0x558d042dc0e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc2340238c0 tx=0x7fc23400d970 comp rx=0 tx=0).stop 2024-09-19T06:18:08.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.934+0000 7fc24ddb4740 1 -- 172.21.15.2:0/1505886645 shutdown_connections 2024-09-19T06:18:08.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.934+0000 7fc24ddb4740 1 --2- 172.21.15.2:0/1505886645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d042e4680 0x558d042fbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.934+0000 7fc24ddb4740 1 --2- 172.21.15.2:0/1505886645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d042d9dc0 0x558d042dc0e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.934+0000 7fc24ddb4740 1 --2- 172.21.15.2:0/1505886645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d042d94a0 0x558d042f04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.934+0000 7fc24ddb4740 1 -- 172.21.15.2:0/1505886645 >> 172.21.15.2:0/1505886645 conn(0x558d042d5a30 msgr2=0x558d042e32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:08.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.934+0000 7fc24ddb4740 1 -- 172.21.15.2:0/1505886645 shutdown_connections 2024-09-19T06:18:08.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.934+0000 7fc24ddb4740 1 -- 172.21.15.2:0/1505886645 wait complete. 2024-09-19T06:18:08.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.935+0000 7fc24ddb4740 1 -- start start 2024-09-19T06:18:08.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.935+0000 7fc24ddb4740 1 Processor -- start 2024-09-19T06:18:08.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.935+0000 7fc24ddb4740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d042d94a0 0x558d042e8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:08.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.935+0000 7fc24ddb4740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d042d9dc0 0x558d042e8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:08.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.935+0000 7fc24ddb4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d042e4680 0x558d0435de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:08.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.936+0000 7fc24ddb4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc2441ae0e0 con 0x558d042e4680 2024-09-19T06:18:08.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.936+0000 7fc24ddb4740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc2441af550 con 0x558d042d9dc0 2024-09-19T06:18:08.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.936+0000 7fc24ddb4740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc2441ae7b0 con 0x558d042d94a0 2024-09-19T06:18:08.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.936+0000 7fc249f78640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d042e4680 0x558d0435de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:08.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.936+0000 7fc249777640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d042d94a0 0x558d042e8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:08.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.936+0000 7fc249f78640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d042e4680 0x558d0435de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39248/0 (socket says 172.21.15.2:39248) 2024-09-19T06:18:08.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.936+0000 7fc24ddb4740 10 client.0 _ll_register_callbacks cb 0x7fc23400d420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:08.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.936+0000 7fc249f78640 1 -- 172.21.15.2:0/3831056549 learned_addr learned my addr 172.21.15.2:0/3831056549 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:08.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.936+0000 7fc248f76640 1 --2- 172.21.15.2:0/3831056549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d042d9dc0 0x558d042e8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:08.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.936+0000 7fc249777640 1 -- 172.21.15.2:0/3831056549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d042d9dc0 msgr2=0x558d042e8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:08.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.936+0000 7fc249777640 1 --2- 172.21.15.2:0/3831056549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d042d9dc0 0x558d042e8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.936+0000 7fc249777640 1 -- 172.21.15.2:0/3831056549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d042e4680 msgr2=0x558d0435de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:08.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.936+0000 7fc249777640 1 --2- 172.21.15.2:0/3831056549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d042e4680 0x558d0435de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.936+0000 7fc249777640 1 -- 172.21.15.2:0/3831056549 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d042e22b0 con 0x558d042d94a0 2024-09-19T06:18:08.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.936+0000 7fc249f78640 1 --2- 172.21.15.2:0/3831056549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d042e4680 0x558d0435de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:18:08.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.936+0000 7fc249777640 1 --2- 172.21.15.2:0/3831056549 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d042d94a0 0x558d042e8a20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc24002a940 tx=0x7fc24002a420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d20154c4e2c6b7d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:08.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.936+0000 7fc22cff9640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-19T06:18:08.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.936+0000 7fc22cff9640 1 -- 172.21.15.2:0/3831056549 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc240057070 con 0x558d042d94a0 2024-09-19T06:18:08.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.936+0000 7fc22cff9640 1 -- 172.21.15.2:0/3831056549 <== mon.1 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fc2400055b0 con 0x558d042d94a0 2024-09-19T06:18:08.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.936+0000 7fc24ddb4740 1 -- 172.21.15.2:0/3831056549 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc234023cb0 con 0x558d042d94a0 2024-09-19T06:18:08.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.937+0000 7fc22cff9640 1 -- 172.21.15.2:0/3831056549 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc240035040 con 0x558d042d94a0 2024-09-19T06:18:08.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.937+0000 7fc24ddb4740 10 client.25618 fetch_fsmap learned FSMap version 26 2024-09-19T06:18:08.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.937+0000 7fc24ddb4740 1 -- 172.21.15.2:0/3831056549 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x558d0435f4b0 con 0x558d042d94a0 2024-09-19T06:18:08.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.937+0000 7fc22cff9640 1 -- 172.21.15.2:0/3831056549 <== mon.1 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc234023cb0 con 0x558d042d94a0 2024-09-19T06:18:08.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.937+0000 7fc22cff9640 1 -- 172.21.15.2:0/3831056549 <== mon.1 v2:172.21.15.90:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fc2400324b0 con 0x558d042d94a0 2024-09-19T06:18:08.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.937+0000 7fc24ddb4740 10 client.25618 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:18:08.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.937+0000 7fc24ddb4740 10 client.25618 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:18:08.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.937+0000 7fc24ddb4740 20 client.25618 populate_metadata read hostname 'smithi002' 2024-09-19T06:18:08.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.937+0000 7fc24ddb4740 1 --2- 172.21.15.2:0/3831056549 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558d0435fb30 0x558d04361f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:08.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.937+0000 7fc24ddb4740 4 client.25618 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:18:08.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.937+0000 7fc24ddb4740 1 -- 172.21.15.2:0/3831056549 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558d04246d60 con 0x558d0435fb30 2024-09-19T06:18:08.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.938+0000 7fc248f76640 1 --2- 172.21.15.2:0/3831056549 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558d0435fb30 0x558d04361f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:08.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.938+0000 7fc248f76640 1 --2- 172.21.15.2:0/3831056549 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558d0435fb30 0x558d04361f20 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25c2198bbd2e6eda server_cookie=f814d6465fafd47c in_seq=0 out_seq=0 2024-09-19T06:18:08.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.938+0000 7fc22cff9640 10 client.25618 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:18:08.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.938+0000 7fc22cff9640 1 -- 172.21.15.2:0/3831056549 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x558d04246d60 con 0x558d0435fb30 2024-09-19T06:18:08.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.938+0000 7fc22cff9640 10 client.25618 handle_command_reply: tid=0 2024-09-19T06:18:08.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.938+0000 7fc24ddb4740 1 client.25618 shutdown 2024-09-19T06:18:08.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.938+0000 7fc24ddb4740 1 -- 172.21.15.2:0/3831056549 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d042d94a0 msgr2=0x558d042e8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:08.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.938+0000 7fc24ddb4740 1 --2- 172.21.15.2:0/3831056549 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d042d94a0 0x558d042e8a20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc24002a940 tx=0x7fc24002a420 comp rx=0 tx=0).stop 2024-09-19T06:18:08.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.938+0000 7fc24ddb4740 1 -- 172.21.15.2:0/3831056549 shutdown_connections 2024-09-19T06:18:08.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.938+0000 7fc24ddb4740 1 --2- 172.21.15.2:0/3831056549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558d042e4680 0x558d0435de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.938+0000 7fc24ddb4740 1 --2- 172.21.15.2:0/3831056549 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558d0435fb30 0x558d04361f20 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.938+0000 7fc24ddb4740 1 --2- 172.21.15.2:0/3831056549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d042d9dc0 0x558d042e8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.938+0000 7fc24ddb4740 1 --2- 172.21.15.2:0/3831056549 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558d042d94a0 0x558d042e8a20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.938+0000 7fc24ddb4740 1 -- 172.21.15.2:0/3831056549 >> 172.21.15.2:0/3831056549 conn(0x558d042d5a30 msgr2=0x558d042e32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:08.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.939+0000 7fc22cff9640 0 client.25618 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:18:08.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.939+0000 7fc24ddb4740 1 -- 172.21.15.2:0/3831056549 shutdown_connections 2024-09-19T06:18:08.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.939+0000 7fc24ddb4740 1 -- 172.21.15.2:0/3831056549 wait complete. 2024-09-19T06:18:08.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.939+0000 7fc24ddb4740 20 client.25618 trim_cache size 0 max 16384 2024-09-19T06:18:08.946 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:18:08.946 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T06:18:08.946 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T06:18:08.946 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:18:08.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.939+0000 7fc24b9db640 1 -- 172.21.15.2:0/4039071188 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc2300a3430 msgr2=0x7fc2300a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:08.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.939+0000 7fc24b9db640 1 --2- 172.21.15.2:0/4039071188 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc2300a3430 0x7fc2300a58f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc240031440 tx=0x7fc240005a20 comp rx=0 tx=0).stop 2024-09-19T06:18:08.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.939+0000 7fc24b9db640 1 -- 172.21.15.2:0/4039071188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc244106a80 msgr2=0x7fc244197aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:08.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.939+0000 7fc24b9db640 1 --2- 172.21.15.2:0/4039071188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc244106a80 0x7fc244197aa0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fc23c00cad0 tx=0x7fc23c00cf90 comp rx=0 tx=0).stop 2024-09-19T06:18:08.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.939+0000 7fc24b9db640 1 -- 172.21.15.2:0/4039071188 shutdown_connections 2024-09-19T06:18:08.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.939+0000 7fc24b9db640 1 --2- 172.21.15.2:0/4039071188 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc2300a3430 0x7fc2300a58f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.939+0000 7fc24b9db640 1 --2- 172.21.15.2:0/4039071188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc244106a80 0x7fc244197aa0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.939+0000 7fc24b9db640 1 --2- 172.21.15.2:0/4039071188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc244101420 0x7fc244197560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.939+0000 7fc24b9db640 1 --2- 172.21.15.2:0/4039071188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc244100a80 0x7fc244197020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.939+0000 7fc24b9db640 1 -- 172.21.15.2:0/4039071188 >> 172.21.15.2:0/4039071188 conn(0x7fc2440fc7a0 msgr2=0x7fc2440fd140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:08.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.940+0000 7fc24b9db640 1 -- 172.21.15.2:0/4039071188 shutdown_connections 2024-09-19T06:18:08.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:08.940+0000 7fc24b9db640 1 -- 172.21.15.2:0/4039071188 wait complete. 2024-09-19T06:18:09.648 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:18:09.648 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:18:09.674 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:09 smithi002 ceph-mon[30982]: pgmap v103: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-19T06:18:09.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:09 smithi090 ceph-mon[34497]: pgmap v103: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-19T06:18:09.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:09 smithi089 ceph-mon[34160]: pgmap v103: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-19T06:18:09.910 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:18:10.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.357+0000 7fe7c676d640 1 -- 172.21.15.2:0/1786031542 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7c010e3c0 msgr2=0x7fe7c0110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:10.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.357+0000 7fe7c676d640 1 --2- 172.21.15.2:0/1786031542 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7c010e3c0 0x7fe7c0110810 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fe7b8009ca0 tx=0x7fe7b802a950 comp rx=0 tx=0).stop 2024-09-19T06:18:10.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.357+0000 7fe7c676d640 1 -- 172.21.15.2:0/1786031542 shutdown_connections 2024-09-19T06:18:10.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.357+0000 7fe7c676d640 1 --2- 172.21.15.2:0/1786031542 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7c010e3c0 0x7fe7c0110810 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:10.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.357+0000 7fe7c676d640 1 --2- 172.21.15.2:0/1786031542 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7c0074f40 0x7fe7c010de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:10.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.357+0000 7fe7c676d640 1 --2- 172.21.15.2:0/1786031542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7c0074620 0x7fe7c0074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:10.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.357+0000 7fe7c676d640 1 -- 172.21.15.2:0/1786031542 >> 172.21.15.2:0/1786031542 conn(0x7fe7c00fd8c0 msgr2=0x7fe7c00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:10.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.357+0000 7fe7c676d640 1 -- 172.21.15.2:0/1786031542 shutdown_connections 2024-09-19T06:18:10.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.357+0000 7fe7c676d640 1 -- 172.21.15.2:0/1786031542 wait complete. 2024-09-19T06:18:10.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.357+0000 7fe7c676d640 1 Processor -- start 2024-09-19T06:18:10.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.357+0000 7fe7c676d640 1 -- start start 2024-09-19T06:18:10.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.358+0000 7fe7c676d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7c0074620 0x7fe7c019a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:10.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.358+0000 7fe7c676d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7c0074f40 0x7fe7c019aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:10.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.358+0000 7fe7c676d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7c010e3c0 0x7fe7c019ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:10.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.358+0000 7fe7c676d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c0114050 con 0x7fe7c0074620 2024-09-19T06:18:10.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.358+0000 7fe7c676d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c0113ed0 con 0x7fe7c0074f40 2024-09-19T06:18:10.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.358+0000 7fe7c676d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c01141d0 con 0x7fe7c010e3c0 2024-09-19T06:18:10.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.358+0000 7fe7bffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7c0074620 0x7fe7c019a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:10.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.358+0000 7fe7bffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7c0074620 0x7fe7c019a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39264/0 (socket says 172.21.15.2:39264) 2024-09-19T06:18:10.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.358+0000 7fe7bffff640 1 -- 172.21.15.2:0/975311409 learned_addr learned my addr 172.21.15.2:0/975311409 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:10.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.358+0000 7fe7c4d0a640 1 --2- 172.21.15.2:0/975311409 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7c010e3c0 0x7fe7c019ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:10.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.358+0000 7fe7bf7fe640 1 --2- 172.21.15.2:0/975311409 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7c0074f40 0x7fe7c019aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:10.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.358+0000 7fe7bffff640 1 -- 172.21.15.2:0/975311409 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7c010e3c0 msgr2=0x7fe7c019ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:10.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.358+0000 7fe7bffff640 1 --2- 172.21.15.2:0/975311409 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7c010e3c0 0x7fe7c019ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:10.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.358+0000 7fe7bffff640 1 -- 172.21.15.2:0/975311409 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7c0074f40 msgr2=0x7fe7c019aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:10.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.358+0000 7fe7bffff640 1 --2- 172.21.15.2:0/975311409 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7c0074f40 0x7fe7c019aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:10.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.358+0000 7fe7bffff640 1 -- 172.21.15.2:0/975311409 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7c019f4e0 con 0x7fe7c0074620 2024-09-19T06:18:10.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.358+0000 7fe7c4d0a640 1 --2- 172.21.15.2:0/975311409 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7c010e3c0 0x7fe7c019ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:18:10.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.358+0000 7fe7bf7fe640 1 --2- 172.21.15.2:0/975311409 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7c0074f40 0x7fe7c019aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:18:10.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.359+0000 7fe7bffff640 1 --2- 172.21.15.2:0/975311409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7c0074620 0x7fe7c019a530 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fe7b000e9f0 tx=0x7fe7b000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:10.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.359+0000 7fe7bd7fa640 1 -- 172.21.15.2:0/975311409 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b000cd80 con 0x7fe7c0074620 2024-09-19T06:18:10.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.359+0000 7fe7c676d640 1 -- 172.21.15.2:0/975311409 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7c019f7d0 con 0x7fe7c0074620 2024-09-19T06:18:10.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.359+0000 7fe7bd7fa640 1 -- 172.21.15.2:0/975311409 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe7b00108e0 con 0x7fe7c0074620 2024-09-19T06:18:10.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.359+0000 7fe7bd7fa640 1 -- 172.21.15.2:0/975311409 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0018920 con 0x7fe7c0074620 2024-09-19T06:18:10.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.359+0000 7fe7c676d640 1 -- 172.21.15.2:0/975311409 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7c01a70b0 con 0x7fe7c0074620 2024-09-19T06:18:10.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.360+0000 7fe7c676d640 1 -- 172.21.15.2:0/975311409 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7c0074a00 con 0x7fe7c0074620 2024-09-19T06:18:10.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.361+0000 7fe7bd7fa640 1 -- 172.21.15.2:0/975311409 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fe7b0010a90 con 0x7fe7c0074620 2024-09-19T06:18:10.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.362+0000 7fe7bd7fa640 1 --2- 172.21.15.2:0/975311409 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe7a80a3430 0x7fe7a80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:10.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.362+0000 7fe7bf7fe640 1 --2- 172.21.15.2:0/975311409 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe7a80a3430 0x7fe7a80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:10.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.362+0000 7fe7bd7fa640 1 -- 172.21.15.2:0/975311409 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fe7b00d00d0 con 0x7fe7c0074620 2024-09-19T06:18:10.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.362+0000 7fe7bf7fe640 1 --2- 172.21.15.2:0/975311409 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe7a80a3430 0x7fe7a80a58f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe7c00ffec0 tx=0x7fe7b4005f90 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:10.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.366+0000 7fe7bd7fa640 1 -- 172.21.15.2:0/975311409 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe7b009cae0 con 0x7fe7c0074620 2024-09-19T06:18:10.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.581+0000 7fe7c676d640 1 -- 172.21.15.2:0/975311409 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe7c01095a0 con 0x7fe7c0074620 2024-09-19T06:18:10.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.581+0000 7fe7bd7fa640 1 -- 172.21.15.2:0/975311409 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11882 (secure 0 0 0) 0x7fe7b009c3e0 con 0x7fe7c0074620 2024-09-19T06:18:10.583 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:18:10.583 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-09-19T06:14:49:104280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:14:48.191083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24470,24472,24497]},"id":1}]} 2024-09-19T06:18:10.584 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-09-19T06:18:10.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.584+0000 7fe7c676d640 1 -- 172.21.15.2:0/975311409 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe7a80a3430 msgr2=0x7fe7a80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:10.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.584+0000 7fe7c676d640 1 --2- 172.21.15.2:0/975311409 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe7a80a3430 0x7fe7a80a58f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe7c00ffec0 tx=0x7fe7b4005f90 comp rx=0 tx=0).stop 2024-09-19T06:18:10.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.584+0000 7fe7c676d640 1 -- 172.21.15.2:0/975311409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7c0074620 msgr2=0x7fe7c019a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:10.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.584+0000 7fe7c676d640 1 --2- 172.21.15.2:0/975311409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7c0074620 0x7fe7c019a530 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fe7b000e9f0 tx=0x7fe7b000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:18:10.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.584+0000 7fe7c676d640 1 -- 172.21.15.2:0/975311409 shutdown_connections 2024-09-19T06:18:10.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.584+0000 7fe7c676d640 1 --2- 172.21.15.2:0/975311409 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe7a80a3430 0x7fe7a80a58f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:10.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.584+0000 7fe7c676d640 1 --2- 172.21.15.2:0/975311409 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7c010e3c0 0x7fe7c019ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:10.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.584+0000 7fe7c676d640 1 --2- 172.21.15.2:0/975311409 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7c0074f40 0x7fe7c019aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:10.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.584+0000 7fe7c676d640 1 --2- 172.21.15.2:0/975311409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7c0074620 0x7fe7c019a530 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:10.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.584+0000 7fe7c676d640 1 -- 172.21.15.2:0/975311409 >> 172.21.15.2:0/975311409 conn(0x7fe7c00fd8c0 msgr2=0x7fe7c00fefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:10.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.584+0000 7fe7c676d640 1 -- 172.21.15.2:0/975311409 shutdown_connections 2024-09-19T06:18:10.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:10.584+0000 7fe7c676d640 1 -- 172.21.15.2:0/975311409 wait complete. 2024-09-19T06:18:11.277 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:18:11.578 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:18:11.679 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:11 smithi002 ceph-mon[30982]: pgmap v104: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T06:18:11.679 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:11 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/975311409' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:18:11.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:11 smithi090 ceph-mon[34497]: pgmap v104: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T06:18:11.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:11 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/975311409' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:18:11.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:11 smithi089 ceph-mon[34160]: pgmap v104: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T06:18:11.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:11 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/975311409' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:18:11.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:11.996+0000 7f4ca28b2640 1 -- 172.21.15.2:0/1820442988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c9c103ff0 msgr2=0x7f4c9c1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:12.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:11.996+0000 7f4ca28b2640 1 --2- 172.21.15.2:0/1820442988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c9c103ff0 0x7f4c9c1043d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c009900 tx=0x7f4c8c02a410 comp rx=0 tx=0).stop 2024-09-19T06:18:12.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:11.996+0000 7f4ca28b2640 1 -- 172.21.15.2:0/1820442988 shutdown_connections 2024-09-19T06:18:12.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:11.996+0000 7f4ca28b2640 1 --2- 172.21.15.2:0/1820442988 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c9c109120 0x7f4c9c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:12.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:11.996+0000 7f4ca28b2640 1 --2- 172.21.15.2:0/1820442988 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c9c1049a0 0x7f4c9c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:12.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:11.996+0000 7f4ca28b2640 1 --2- 172.21.15.2:0/1820442988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c9c103ff0 0x7f4c9c1043d0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:12.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:11.996+0000 7f4ca28b2640 1 -- 172.21.15.2:0/1820442988 >> 172.21.15.2:0/1820442988 conn(0x7f4c9c0ffab0 msgr2=0x7f4c9c101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:12.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:11.996+0000 7f4ca28b2640 1 -- 172.21.15.2:0/1820442988 shutdown_connections 2024-09-19T06:18:12.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:11.996+0000 7f4ca28b2640 1 -- 172.21.15.2:0/1820442988 wait complete. 2024-09-19T06:18:12.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:11.997+0000 7f4ca28b2640 1 Processor -- start 2024-09-19T06:18:12.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:11.997+0000 7f4ca28b2640 1 -- start start 2024-09-19T06:18:12.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:11.997+0000 7f4ca28b2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c9c103ff0 0x7f4c9c19a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:12.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:11.997+0000 7f4ca28b2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c9c1049a0 0x7f4c9c19aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:12.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:11.997+0000 7f4ca28b2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c9c109120 0x7f4c9c19ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:12.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:11.997+0000 7f4ca28b2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4c9c113ff0 con 0x7f4c9c1049a0 2024-09-19T06:18:12.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:11.997+0000 7f4ca28b2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4c9c113e70 con 0x7f4c9c103ff0 2024-09-19T06:18:12.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:11.997+0000 7f4ca28b2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4c9c114170 con 0x7f4c9c109120 2024-09-19T06:18:12.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:11.997+0000 7f4c9b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c9c1049a0 0x7f4c9c19aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:12.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:11.998+0000 7f4c9b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c9c1049a0 0x7f4c9c19aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39282/0 (socket says 172.21.15.2:39282) 2024-09-19T06:18:12.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:11.998+0000 7f4c9b7fe640 1 -- 172.21.15.2:0/4095153604 learned_addr learned my addr 172.21.15.2:0/4095153604 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:12.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:11.998+0000 7f4c9bfff640 1 --2- 172.21.15.2:0/4095153604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c9c103ff0 0x7f4c9c19a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:12.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:11.998+0000 7f4ca0e4f640 1 --2- 172.21.15.2:0/4095153604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c9c109120 0x7f4c9c19ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:12.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:11.998+0000 7f4c9b7fe640 1 -- 172.21.15.2:0/4095153604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c9c109120 msgr2=0x7f4c9c19ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:12.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:11.998+0000 7f4c9b7fe640 1 --2- 172.21.15.2:0/4095153604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c9c109120 0x7f4c9c19ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:12.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:11.998+0000 7f4c9b7fe640 1 -- 172.21.15.2:0/4095153604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c9c103ff0 msgr2=0x7f4c9c19a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:12.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:11.998+0000 7f4c9b7fe640 1 --2- 172.21.15.2:0/4095153604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c9c103ff0 0x7f4c9c19a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:12.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:11.998+0000 7f4c9b7fe640 1 -- 172.21.15.2:0/4095153604 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c9c19f4c0 con 0x7f4c9c1049a0 2024-09-19T06:18:12.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:11.998+0000 7f4c9b7fe640 1 --2- 172.21.15.2:0/4095153604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c9c1049a0 0x7f4c9c19aa50 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f4c9000d770 tx=0x7f4c9000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:12.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:11.998+0000 7f4c997fa640 1 -- 172.21.15.2:0/4095153604 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c90017070 con 0x7f4c9c1049a0 2024-09-19T06:18:12.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:11.998+0000 7f4c997fa640 1 -- 172.21.15.2:0/4095153604 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4c900054d0 con 0x7f4c9c1049a0 2024-09-19T06:18:12.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:11.998+0000 7f4ca28b2640 1 -- 172.21.15.2:0/4095153604 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c9c19f7b0 con 0x7f4c9c1049a0 2024-09-19T06:18:12.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:11.998+0000 7f4c997fa640 1 -- 172.21.15.2:0/4095153604 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c90004cf0 con 0x7f4c9c1049a0 2024-09-19T06:18:12.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:11.998+0000 7f4ca28b2640 1 -- 172.21.15.2:0/4095153604 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c9c1a7090 con 0x7f4c9c1049a0 2024-09-19T06:18:12.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.001+0000 7f4c997fa640 1 -- 172.21.15.2:0/4095153604 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f4c90004e90 con 0x7f4c9c1049a0 2024-09-19T06:18:12.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.001+0000 7f4ca4c8b740 1 Processor -- start 2024-09-19T06:18:12.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.001+0000 7f4ca4c8b740 1 -- start start 2024-09-19T06:18:12.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.001+0000 7f4ca4c8b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557824a73b40 0x557824a72090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:12.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.001+0000 7f4ca4c8b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557824a725d0 0x557824a72a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:12.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.001+0000 7f4ca4c8b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557824a7d370 0x557824a7f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:12.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.001+0000 7f4ca4c8b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5578249d82f0 con 0x557824a7d370 2024-09-19T06:18:12.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.001+0000 7f4ca4c8b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55782497fcf0 con 0x557824a725d0 2024-09-19T06:18:12.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.001+0000 7f4ca4c8b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5578249d42b0 con 0x557824a73b40 2024-09-19T06:18:12.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.001+0000 7f4c9b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557824a7d370 0x557824a7f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:12.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.001+0000 7f4c9b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557824a7d370 0x557824a7f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39298/0 (socket says 172.21.15.2:39298) 2024-09-19T06:18:12.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.001+0000 7f4c9b7fe640 1 -- 172.21.15.2:0/1736748301 learned_addr learned my addr 172.21.15.2:0/1736748301 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:12.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.001+0000 7f4c997fa640 1 --2- 172.21.15.2:0/4095153604 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4c840a3430 0x7f4c840a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:12.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.001+0000 7f4c9bfff640 1 --2- 172.21.15.2:0/1736748301 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557824a725d0 0x557824a72a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:12.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.001+0000 7f4ca0e4f640 1 --2- 172.21.15.2:0/1736748301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557824a73b40 0x557824a72090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:12.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.002+0000 7f4ca0e4f640 1 --2- 172.21.15.2:0/4095153604 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4c840a3430 0x7f4c840a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:12.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.002+0000 7f4c997fa640 1 -- 172.21.15.2:0/4095153604 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f4c900cf630 con 0x7f4c9c1049a0 2024-09-19T06:18:12.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.002+0000 7f4c9b7fe640 1 -- 172.21.15.2:0/1736748301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557824a73b40 msgr2=0x557824a72090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:12.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.002+0000 7f4c9b7fe640 1 --2- 172.21.15.2:0/1736748301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557824a73b40 0x557824a72090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:12.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.002+0000 7f4c9b7fe640 1 -- 172.21.15.2:0/1736748301 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557824a725d0 msgr2=0x557824a72a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:12.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.002+0000 7f4c9b7fe640 1 --2- 172.21.15.2:0/1736748301 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557824a725d0 0x557824a72a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:12.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.002+0000 7f4c9b7fe640 1 -- 172.21.15.2:0/1736748301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578249643a0 con 0x557824a7d370 2024-09-19T06:18:12.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.002+0000 7f4c9b7fe640 1 --2- 172.21.15.2:0/1736748301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557824a7d370 0x557824a7f760 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f4c90097e50 tx=0x7f4c90005680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7e1ed91e3e3bfb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:12.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.002+0000 7f4c827fc640 1 -- 172.21.15.2:0/1736748301 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c90020050 con 0x557824a7d370 2024-09-19T06:18:12.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.002+0000 7f4c827fc640 1 -- 172.21.15.2:0/1736748301 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4c90009c30 con 0x557824a7d370 2024-09-19T06:18:12.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.002+0000 7f4ca0e4f640 1 --2- 172.21.15.2:0/4095153604 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4c840a3430 0x7f4c840a58f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4c94005fd0 tx=0x7f4c94004ab0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:12.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.002+0000 7f4c827fc640 1 -- 172.21.15.2:0/1736748301 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c900cd030 con 0x557824a7d370 2024-09-19T06:18:12.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.003+0000 7f4ca4c8b740 1 -- 172.21.15.2:0/1736748301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557824a7d370 msgr2=0x557824a7f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:12.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.003+0000 7f4ca4c8b740 1 --2- 172.21.15.2:0/1736748301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557824a7d370 0x557824a7f760 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f4c90097e50 tx=0x7f4c90005680 comp rx=0 tx=0).stop 2024-09-19T06:18:12.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.003+0000 7f4ca4c8b740 1 -- 172.21.15.2:0/1736748301 shutdown_connections 2024-09-19T06:18:12.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.003+0000 7f4ca4c8b740 1 --2- 172.21.15.2:0/1736748301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557824a7d370 0x557824a7f760 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:12.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.003+0000 7f4ca4c8b740 1 --2- 172.21.15.2:0/1736748301 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557824a725d0 0x557824a72a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:12.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.003+0000 7f4ca4c8b740 1 --2- 172.21.15.2:0/1736748301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557824a73b40 0x557824a72090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:12.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.003+0000 7f4ca4c8b740 1 -- 172.21.15.2:0/1736748301 >> 172.21.15.2:0/1736748301 conn(0x557824a3b310 msgr2=0x557824a6ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:12.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.003+0000 7f4ca4c8b740 1 -- 172.21.15.2:0/1736748301 shutdown_connections 2024-09-19T06:18:12.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.003+0000 7f4ca4c8b740 1 -- 172.21.15.2:0/1736748301 wait complete. 2024-09-19T06:18:12.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.003+0000 7f4ca4c8b740 1 -- start start 2024-09-19T06:18:12.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.004+0000 7f4ca4c8b740 1 Processor -- start 2024-09-19T06:18:12.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.004+0000 7f4ca4c8b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557824a725d0 0x557824a7cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:12.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.004+0000 7f4ca4c8b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557824a73b40 0x557824a7a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:12.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.004+0000 7f4ca4c8b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557824a7d370 0x557824a7a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:12.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.004+0000 7f4ca4c8b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557824a80010 con 0x557824a7d370 2024-09-19T06:18:12.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.004+0000 7f4ca4c8b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x557824993060 con 0x557824a725d0 2024-09-19T06:18:12.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.004+0000 7f4ca4c8b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x557824a80190 con 0x557824a73b40 2024-09-19T06:18:12.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.004+0000 7f4ca4c8b740 10 client.0 _ll_register_callbacks cb 0x5578246e68c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:12.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.004+0000 7f4ca0e4f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557824a7d370 0x557824a7a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:12.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.004+0000 7f4ca0e4f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557824a7d370 0x557824a7a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39302/0 (socket says 172.21.15.2:39302) 2024-09-19T06:18:12.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.004+0000 7f4ca0e4f640 1 -- 172.21.15.2:0/2180017199 learned_addr learned my addr 172.21.15.2:0/2180017199 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:12.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.004+0000 7f4c9b7fe640 1 --2- 172.21.15.2:0/2180017199 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557824a73b40 0x557824a7a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:12.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.004+0000 7f4c9bfff640 1 --2- 172.21.15.2:0/2180017199 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557824a725d0 0x557824a7cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:12.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.004+0000 7f4ca0e4f640 1 -- 172.21.15.2:0/2180017199 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557824a73b40 msgr2=0x557824a7a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:12.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.004+0000 7f4ca0e4f640 1 --2- 172.21.15.2:0/2180017199 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557824a73b40 0x557824a7a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:12.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.004+0000 7f4ca0e4f640 1 -- 172.21.15.2:0/2180017199 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557824a725d0 msgr2=0x557824a7cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:12.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.004+0000 7f4ca0e4f640 1 --2- 172.21.15.2:0/2180017199 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557824a725d0 0x557824a7cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:12.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.004+0000 7f4ca0e4f640 1 -- 172.21.15.2:0/2180017199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578247493c0 con 0x557824a7d370 2024-09-19T06:18:12.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.004+0000 7f4c9bfff640 1 --2- 172.21.15.2:0/2180017199 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557824a725d0 0x557824a7cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:18:12.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.005+0000 7f4ca0e4f640 1 --2- 172.21.15.2:0/2180017199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557824a7d370 0x557824a7a7f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f4c9400fd30 tx=0x7f4c94004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a6eb5778ae1331 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:12.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.005+0000 7f4c7b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:18:12.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.005+0000 7f4c7b7fe640 1 -- 172.21.15.2:0/2180017199 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c94019070 con 0x557824a7d370 2024-09-19T06:18:12.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.005+0000 7f4c7b7fe640 1 -- 172.21.15.2:0/2180017199 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f4c9401e420 con 0x557824a7d370 2024-09-19T06:18:12.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.005+0000 7f4ca4c8b740 1 -- 172.21.15.2:0/2180017199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5578249e5860 con 0x557824a7d370 2024-09-19T06:18:12.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.005+0000 7f4c7b7fe640 1 -- 172.21.15.2:0/2180017199 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4c9401e620 con 0x557824a7d370 2024-09-19T06:18:12.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.005+0000 7f4ca4c8b740 10 client.16128 fetch_fsmap learned FSMap version 26 2024-09-19T06:18:12.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.005+0000 7f4ca4c8b740 1 -- 172.21.15.2:0/2180017199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557824a8bb60 con 0x557824a7d370 2024-09-19T06:18:12.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.005+0000 7f4c7b7fe640 1 -- 172.21.15.2:0/2180017199 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x5578249e5860 con 0x557824a7d370 2024-09-19T06:18:12.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.005+0000 7f4c7b7fe640 1 -- 172.21.15.2:0/2180017199 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f4c94028890 con 0x557824a7d370 2024-09-19T06:18:12.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.005+0000 7f4ca4c8b740 10 client.16128 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:18:12.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.005+0000 7f4ca4c8b740 10 client.16128 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:18:12.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.006+0000 7f4ca4c8b740 20 client.16128 populate_metadata read hostname 'smithi002' 2024-09-19T06:18:12.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.006+0000 7f4ca4c8b740 1 --2- 172.21.15.2:0/2180017199 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x557824a8d020 0x557824a8f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:12.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.006+0000 7f4ca4c8b740 4 client.16128 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:18:12.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.006+0000 7f4ca4c8b740 1 -- 172.21.15.2:0/2180017199 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5578249dfd70 con 0x557824a8d020 2024-09-19T06:18:12.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.006+0000 7f4c9bfff640 1 --2- 172.21.15.2:0/2180017199 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x557824a8d020 0x557824a8f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:12.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.006+0000 7f4c9bfff640 1 --2- 172.21.15.2:0/2180017199 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x557824a8d020 0x557824a8f450 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c264359ff86bb823 server_cookie=7b2e9a5c7477bad6 in_seq=0 out_seq=0 2024-09-19T06:18:12.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.006+0000 7f4c7b7fe640 10 client.16128 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:18:12.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.007+0000 7f4c7b7fe640 1 -- 172.21.15.2:0/2180017199 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5578249dfd70 con 0x557824a8d020 2024-09-19T06:18:12.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.007+0000 7f4c7b7fe640 10 client.16128 handle_command_reply: tid=0 2024-09-19T06:18:12.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.007+0000 7f4ca4c8b740 1 client.16128 shutdown 2024-09-19T06:18:12.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.007+0000 7f4ca4c8b740 1 -- 172.21.15.2:0/2180017199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557824a7d370 msgr2=0x557824a7a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:12.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.007+0000 7f4ca4c8b740 1 --2- 172.21.15.2:0/2180017199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557824a7d370 0x557824a7a7f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f4c9400fd30 tx=0x7f4c94004a40 comp rx=0 tx=0).stop 2024-09-19T06:18:12.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.007+0000 7f4ca4c8b740 1 -- 172.21.15.2:0/2180017199 shutdown_connections 2024-09-19T06:18:12.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.007+0000 7f4ca4c8b740 1 --2- 172.21.15.2:0/2180017199 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x557824a8d020 0x557824a8f450 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:12.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.007+0000 7f4ca4c8b740 1 --2- 172.21.15.2:0/2180017199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557824a7d370 0x557824a7a7f0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:12.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.007+0000 7f4ca4c8b740 1 --2- 172.21.15.2:0/2180017199 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557824a73b40 0x557824a7a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:12.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.007+0000 7f4ca4c8b740 1 --2- 172.21.15.2:0/2180017199 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557824a725d0 0x557824a7cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:12.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.007+0000 7f4ca4c8b740 1 -- 172.21.15.2:0/2180017199 >> 172.21.15.2:0/2180017199 conn(0x557824a3b310 msgr2=0x557824a74960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:12.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.007+0000 7f4c7b7fe640 0 client.16128 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:18:12.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.007+0000 7f4ca4c8b740 1 -- 172.21.15.2:0/2180017199 shutdown_connections 2024-09-19T06:18:12.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.007+0000 7f4ca4c8b740 1 -- 172.21.15.2:0/2180017199 wait complete. 2024-09-19T06:18:12.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.007+0000 7f4ca4c8b740 20 client.16128 trim_cache size 0 max 16384 2024-09-19T06:18:12.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.020+0000 7f4ca4c8b740 1 Processor -- start 2024-09-19T06:18:12.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.021+0000 7f4ca4c8b740 1 -- start start 2024-09-19T06:18:12.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.021+0000 7f4ca4c8b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557824a725d0 0x557824a78fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:12.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.021+0000 7f4ca4c8b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557824a73b40 0x557824a7bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:12.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.021+0000 7f4ca4c8b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557824a7d370 0x557824a75120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:12.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.021+0000 7f4ca4c8b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4c9c1b2210 con 0x557824a7d370 2024-09-19T06:18:12.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.021+0000 7f4ca4c8b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4c9c1afae0 con 0x557824a73b40 2024-09-19T06:18:12.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.021+0000 7f4ca4c8b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4c9c1ad930 con 0x557824a725d0 2024-09-19T06:18:12.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.021+0000 7f4ca0e4f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557824a7d370 0x557824a75120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:12.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.021+0000 7f4ca0e4f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557824a7d370 0x557824a75120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39308/0 (socket says 172.21.15.2:39308) 2024-09-19T06:18:12.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.021+0000 7f4ca0e4f640 1 -- 172.21.15.2:0/1195527084 learned_addr learned my addr 172.21.15.2:0/1195527084 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:12.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.021+0000 7f4c9bfff640 1 --2- 172.21.15.2:0/1195527084 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557824a725d0 0x557824a78fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:12.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.021+0000 7f4c9b7fe640 1 --2- 172.21.15.2:0/1195527084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557824a73b40 0x557824a7bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:12.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.021+0000 7f4ca0e4f640 1 -- 172.21.15.2:0/1195527084 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557824a725d0 msgr2=0x557824a78fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:12.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.021+0000 7f4ca0e4f640 1 --2- 172.21.15.2:0/1195527084 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557824a725d0 0x557824a78fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:12.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.021+0000 7f4ca0e4f640 1 -- 172.21.15.2:0/1195527084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557824a73b40 msgr2=0x557824a7bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:12.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.021+0000 7f4ca0e4f640 1 --2- 172.21.15.2:0/1195527084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557824a73b40 0x557824a7bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:12.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.021+0000 7f4ca0e4f640 1 -- 172.21.15.2:0/1195527084 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557824a785b0 con 0x557824a7d370 2024-09-19T06:18:12.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.021+0000 7f4c9b7fe640 1 --2- 172.21.15.2:0/1195527084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557824a73b40 0x557824a7bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:18:12.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.021+0000 7f4ca0e4f640 1 --2- 172.21.15.2:0/1195527084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557824a7d370 0x557824a75120 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f4c94028ef0 tx=0x7f4c94009d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5616485649768b68 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:12.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.022+0000 7f4c81ffb640 1 -- 172.21.15.2:0/1195527084 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c94019070 con 0x557824a7d370 2024-09-19T06:18:12.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.022+0000 7f4c81ffb640 1 -- 172.21.15.2:0/1195527084 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4c94010c90 con 0x557824a7d370 2024-09-19T06:18:12.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.022+0000 7f4c81ffb640 1 -- 172.21.15.2:0/1195527084 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c94035070 con 0x557824a7d370 2024-09-19T06:18:12.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.022+0000 7f4ca4c8b740 1 -- 172.21.15.2:0/1195527084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557824a7d370 msgr2=0x557824a75120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:12.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.022+0000 7f4ca4c8b740 1 --2- 172.21.15.2:0/1195527084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557824a7d370 0x557824a75120 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f4c94028ef0 tx=0x7f4c94009d10 comp rx=0 tx=0).stop 2024-09-19T06:18:12.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.022+0000 7f4ca4c8b740 1 -- 172.21.15.2:0/1195527084 shutdown_connections 2024-09-19T06:18:12.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.022+0000 7f4ca4c8b740 1 --2- 172.21.15.2:0/1195527084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557824a7d370 0x557824a75120 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:12.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.022+0000 7f4ca4c8b740 1 --2- 172.21.15.2:0/1195527084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557824a73b40 0x557824a7bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:12.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.022+0000 7f4ca4c8b740 1 --2- 172.21.15.2:0/1195527084 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557824a725d0 0x557824a78fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:12.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.022+0000 7f4ca4c8b740 1 -- 172.21.15.2:0/1195527084 >> 172.21.15.2:0/1195527084 conn(0x557824a3b310 msgr2=0x557824a7b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:12.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.022+0000 7f4ca4c8b740 1 -- 172.21.15.2:0/1195527084 shutdown_connections 2024-09-19T06:18:12.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.022+0000 7f4ca4c8b740 1 -- 172.21.15.2:0/1195527084 wait complete. 2024-09-19T06:18:12.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.023+0000 7f4ca4c8b740 1 -- start start 2024-09-19T06:18:12.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.023+0000 7f4ca4c8b740 1 Processor -- start 2024-09-19T06:18:12.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.023+0000 7f4ca4c8b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557824a725d0 0x557824a859a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:12.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.023+0000 7f4ca4c8b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557824a73b40 0x557824a80cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:12.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.023+0000 7f4ca4c8b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557824a7d370 0x557824a81210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:12.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.023+0000 7f4ca4c8b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4c9c1adfa0 con 0x557824a725d0 2024-09-19T06:18:12.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.023+0000 7f4ca4c8b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4c9c1af410 con 0x557824a73b40 2024-09-19T06:18:12.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.023+0000 7f4ca4c8b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4c9c1ae670 con 0x557824a7d370 2024-09-19T06:18:12.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.023+0000 7f4ca4c8b740 10 client.0 _ll_register_callbacks cb 0x7f4c94009be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:12.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.023+0000 7f4c9bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557824a725d0 0x557824a859a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:12.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.023+0000 7f4c9bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557824a725d0 0x557824a859a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39316/0 (socket says 172.21.15.2:39316) 2024-09-19T06:18:12.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.023+0000 7f4c9bfff640 1 -- 172.21.15.2:0/139018897 learned_addr learned my addr 172.21.15.2:0/139018897 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:12.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.024+0000 7f4ca0e4f640 1 --2- 172.21.15.2:0/139018897 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557824a7d370 0x557824a81210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:12.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.024+0000 7f4c9b7fe640 1 --2- 172.21.15.2:0/139018897 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557824a73b40 0x557824a80cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:12.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.024+0000 7f4c9bfff640 1 -- 172.21.15.2:0/139018897 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557824a7d370 msgr2=0x557824a81210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:12.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.024+0000 7f4c9bfff640 1 --2- 172.21.15.2:0/139018897 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557824a7d370 0x557824a81210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:12.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.024+0000 7f4c9bfff640 1 -- 172.21.15.2:0/139018897 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557824a73b40 msgr2=0x557824a80cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:12.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.024+0000 7f4c9bfff640 1 --2- 172.21.15.2:0/139018897 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557824a73b40 0x557824a80cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:12.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.024+0000 7f4c9bfff640 1 -- 172.21.15.2:0/139018897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557824a81850 con 0x557824a725d0 2024-09-19T06:18:12.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.024+0000 7f4c9b7fe640 1 --2- 172.21.15.2:0/139018897 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557824a73b40 0x557824a80cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:18:12.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.024+0000 7f4c9bfff640 1 --2- 172.21.15.2:0/139018897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557824a725d0 0x557824a859a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c02a930 tx=0x7f4c8c031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb0c459cf92ed726 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:12.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.024+0000 7f4c7b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:18:12.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.024+0000 7f4c7b7fe640 1 -- 172.21.15.2:0/139018897 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c035040 con 0x557824a725d0 2024-09-19T06:18:12.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.024+0000 7f4c7b7fe640 1 -- 172.21.15.2:0/139018897 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f4c8c005240 con 0x557824a725d0 2024-09-19T06:18:12.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.024+0000 7f4ca4c8b740 1 -- 172.21.15.2:0/139018897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c94010c90 con 0x557824a725d0 2024-09-19T06:18:12.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.024+0000 7f4c7b7fe640 1 -- 172.21.15.2:0/139018897 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4c8c0044d0 con 0x557824a725d0 2024-09-19T06:18:12.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.025+0000 7f4ca4c8b740 10 client.16134 fetch_fsmap learned FSMap version 26 2024-09-19T06:18:12.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.025+0000 7f4ca4c8b740 1 -- 172.21.15.2:0/139018897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557824af7b50 con 0x557824a725d0 2024-09-19T06:18:12.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.025+0000 7f4c7b7fe640 1 -- 172.21.15.2:0/139018897 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4c94010c90 con 0x557824a725d0 2024-09-19T06:18:12.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.025+0000 7f4c7b7fe640 1 -- 172.21.15.2:0/139018897 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f4c8c003680 con 0x557824a725d0 2024-09-19T06:18:12.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.025+0000 7f4ca4c8b740 10 client.16134 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:18:12.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.025+0000 7f4ca4c8b740 10 client.16134 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:18:12.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.025+0000 7f4ca4c8b740 20 client.16134 populate_metadata read hostname 'smithi002' 2024-09-19T06:18:12.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.025+0000 7f4ca4c8b740 1 --2- 172.21.15.2:0/139018897 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x557824af82d0 0x557824afa6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:12.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.025+0000 7f4ca4c8b740 4 client.16134 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:18:12.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.025+0000 7f4ca4c8b740 1 -- 172.21.15.2:0/139018897 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55782495c170 con 0x557824af82d0 2024-09-19T06:18:12.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.025+0000 7f4c9b7fe640 1 --2- 172.21.15.2:0/139018897 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x557824af82d0 0x557824afa6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:12.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.026+0000 7f4c9b7fe640 1 --2- 172.21.15.2:0/139018897 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x557824af82d0 0x557824afa6f0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e22542d26ffac28 server_cookie=513565444c42ad33 in_seq=0 out_seq=0 2024-09-19T06:18:12.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.026+0000 7f4c7b7fe640 10 client.16134 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:18:12.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.026+0000 7f4c7b7fe640 1 -- 172.21.15.2:0/139018897 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55782495c170 con 0x557824af82d0 2024-09-19T06:18:12.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.026+0000 7f4c7b7fe640 10 client.16134 handle_command_reply: tid=0 2024-09-19T06:18:12.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.026+0000 7f4ca4c8b740 1 client.16134 shutdown 2024-09-19T06:18:12.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.026+0000 7f4ca4c8b740 1 -- 172.21.15.2:0/139018897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557824a725d0 msgr2=0x557824a859a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:12.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.026+0000 7f4ca4c8b740 1 --2- 172.21.15.2:0/139018897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557824a725d0 0x557824a859a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c02a930 tx=0x7f4c8c031400 comp rx=0 tx=0).stop 2024-09-19T06:18:12.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.026+0000 7f4ca4c8b740 1 -- 172.21.15.2:0/139018897 shutdown_connections 2024-09-19T06:18:12.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.026+0000 7f4ca4c8b740 1 --2- 172.21.15.2:0/139018897 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x557824af82d0 0x557824afa6f0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:12.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.026+0000 7f4ca4c8b740 1 --2- 172.21.15.2:0/139018897 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557824a7d370 0x557824a81210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:12.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.026+0000 7f4ca4c8b740 1 --2- 172.21.15.2:0/139018897 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557824a73b40 0x557824a80cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:12.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.026+0000 7f4ca4c8b740 1 --2- 172.21.15.2:0/139018897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557824a725d0 0x557824a859a0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:12.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.026+0000 7f4ca4c8b740 1 -- 172.21.15.2:0/139018897 >> 172.21.15.2:0/139018897 conn(0x557824a3b310 msgr2=0x557824a882a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:12.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.026+0000 7f4c7b7fe640 0 client.16134 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:18:12.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.026+0000 7f4ca4c8b740 1 -- 172.21.15.2:0/139018897 shutdown_connections 2024-09-19T06:18:12.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.026+0000 7f4ca4c8b740 1 -- 172.21.15.2:0/139018897 wait complete. 2024-09-19T06:18:12.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.026+0000 7f4ca4c8b740 20 client.16134 trim_cache size 0 max 16384 2024-09-19T06:18:12.035 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:18:12.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.027+0000 7f4ca28b2640 1 -- 172.21.15.2:0/4095153604 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4c840a3430 msgr2=0x7f4c840a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:12.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.027+0000 7f4ca28b2640 1 --2- 172.21.15.2:0/4095153604 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4c840a3430 0x7f4c840a58f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4c94005fd0 tx=0x7f4c94004ab0 comp rx=0 tx=0).stop 2024-09-19T06:18:12.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.027+0000 7f4ca28b2640 1 -- 172.21.15.2:0/4095153604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c9c1049a0 msgr2=0x7f4c9c19aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:12.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.027+0000 7f4ca28b2640 1 --2- 172.21.15.2:0/4095153604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c9c1049a0 0x7f4c9c19aa50 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f4c9000d770 tx=0x7f4c9000dc30 comp rx=0 tx=0).stop 2024-09-19T06:18:12.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.027+0000 7f4ca28b2640 1 -- 172.21.15.2:0/4095153604 shutdown_connections 2024-09-19T06:18:12.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.027+0000 7f4ca28b2640 1 --2- 172.21.15.2:0/4095153604 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4c840a3430 0x7f4c840a58f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:12.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.027+0000 7f4ca28b2640 1 --2- 172.21.15.2:0/4095153604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c9c109120 0x7f4c9c19ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:12.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.027+0000 7f4ca28b2640 1 --2- 172.21.15.2:0/4095153604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c9c1049a0 0x7f4c9c19aa50 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:12.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.027+0000 7f4ca28b2640 1 --2- 172.21.15.2:0/4095153604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c9c103ff0 0x7f4c9c19a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:12.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.027+0000 7f4ca28b2640 1 -- 172.21.15.2:0/4095153604 >> 172.21.15.2:0/4095153604 conn(0x7f4c9c0ffab0 msgr2=0x7f4c9c100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:12.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.028+0000 7f4ca28b2640 1 -- 172.21.15.2:0/4095153604 shutdown_connections 2024-09-19T06:18:12.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:12.028+0000 7f4ca28b2640 1 -- 172.21.15.2:0/4095153604 wait complete. 2024-09-19T06:18:12.772 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:18:13.036 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:18:13.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.513+0000 7fa833ff0640 1 -- 172.21.15.2:0/2937438974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa82c101280 msgr2=0x7fa82c10df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:13.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.513+0000 7fa833ff0640 1 --2- 172.21.15.2:0/2937438974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa82c101280 0x7fa82c10df40 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fa81c009900 tx=0x7fa81c02a410 comp rx=0 tx=0).stop 2024-09-19T06:18:13.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.513+0000 7fa833ff0640 1 -- 172.21.15.2:0/2937438974 shutdown_connections 2024-09-19T06:18:13.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.513+0000 7fa833ff0640 1 --2- 172.21.15.2:0/2937438974 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa82c10e480 0x7fa82c110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:13.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.514+0000 7fa833ff0640 1 --2- 172.21.15.2:0/2937438974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa82c101280 0x7fa82c10df40 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:13.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.514+0000 7fa833ff0640 1 --2- 172.21.15.2:0/2937438974 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa82c1008d0 0x7fa82c100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:13.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.514+0000 7fa833ff0640 1 -- 172.21.15.2:0/2937438974 >> 172.21.15.2:0/2937438974 conn(0x7fa82c0fc7a0 msgr2=0x7fa82c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:13.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.514+0000 7fa833ff0640 1 -- 172.21.15.2:0/2937438974 shutdown_connections 2024-09-19T06:18:13.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.514+0000 7fa833ff0640 1 -- 172.21.15.2:0/2937438974 wait complete. 2024-09-19T06:18:13.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.514+0000 7fa833ff0640 1 Processor -- start 2024-09-19T06:18:13.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.514+0000 7fa833ff0640 1 -- start start 2024-09-19T06:18:13.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.515+0000 7fa833ff0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa82c1008d0 0x7fa82c19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:13.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.515+0000 7fa833ff0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa82c101280 0x7fa82c19ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:13.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.515+0000 7fa833ff0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa82c10e480 0x7fa82c19eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:13.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.515+0000 7fa833ff0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c114090 con 0x7fa82c1008d0 2024-09-19T06:18:13.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.515+0000 7fa833ff0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c113f10 con 0x7fa82c101280 2024-09-19T06:18:13.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.515+0000 7fa833ff0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c114210 con 0x7fa82c10e480 2024-09-19T06:18:13.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.515+0000 7fa831d8c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa82c1008d0 0x7fa82c19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:13.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.515+0000 7fa831d8c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa82c1008d0 0x7fa82c19a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39330/0 (socket says 172.21.15.2:39330) 2024-09-19T06:18:13.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.515+0000 7fa831d8c640 1 -- 172.21.15.2:0/94854455 learned_addr learned my addr 172.21.15.2:0/94854455 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:13.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.515+0000 7fa83258d640 1 --2- 172.21.15.2:0/94854455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa82c10e480 0x7fa82c19eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:13.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.515+0000 7fa83158b640 1 --2- 172.21.15.2:0/94854455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa82c101280 0x7fa82c19ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:13.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.515+0000 7fa831d8c640 1 -- 172.21.15.2:0/94854455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa82c10e480 msgr2=0x7fa82c19eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:13.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.515+0000 7fa831d8c640 1 --2- 172.21.15.2:0/94854455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa82c10e480 0x7fa82c19eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:13.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.515+0000 7fa831d8c640 1 -- 172.21.15.2:0/94854455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa82c101280 msgr2=0x7fa82c19ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:13.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.515+0000 7fa831d8c640 1 --2- 172.21.15.2:0/94854455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa82c101280 0x7fa82c19ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:13.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.515+0000 7fa831d8c640 1 -- 172.21.15.2:0/94854455 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa82c19f5c0 con 0x7fa82c1008d0 2024-09-19T06:18:13.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.515+0000 7fa83158b640 1 --2- 172.21.15.2:0/94854455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa82c101280 0x7fa82c19ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:18:13.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.515+0000 7fa831d8c640 1 --2- 172.21.15.2:0/94854455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa82c1008d0 0x7fa82c19a610 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fa82800e9f0 tx=0x7fa82800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:13.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.515+0000 7fa822ffd640 1 -- 172.21.15.2:0/94854455 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82800cd80 con 0x7fa82c1008d0 2024-09-19T06:18:13.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.516+0000 7fa822ffd640 1 -- 172.21.15.2:0/94854455 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa8280108e0 con 0x7fa82c1008d0 2024-09-19T06:18:13.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.516+0000 7fa833ff0640 1 -- 172.21.15.2:0/94854455 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa82c19f8b0 con 0x7fa82c1008d0 2024-09-19T06:18:13.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.516+0000 7fa822ffd640 1 -- 172.21.15.2:0/94854455 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa828018920 con 0x7fa82c1008d0 2024-09-19T06:18:13.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.516+0000 7fa833ff0640 1 -- 172.21.15.2:0/94854455 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa82c1a7190 con 0x7fa82c1008d0 2024-09-19T06:18:13.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.518+0000 7fa822ffd640 1 -- 172.21.15.2:0/94854455 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fa828010a90 con 0x7fa82c1008d0 2024-09-19T06:18:13.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.518+0000 7fa8363c9740 1 Processor -- start 2024-09-19T06:18:13.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.518+0000 7fa8363c9740 1 -- start start 2024-09-19T06:18:13.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.519+0000 7fa8363c9740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8a9d25b40 0x55e8a9d24090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:13.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.519+0000 7fa8363c9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e8a9d245d0 0x55e8a9d24a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:13.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.519+0000 7fa8363c9740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e8a9d2f370 0x55e8a9d31760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:13.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.519+0000 7fa8363c9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e8a9c8a2f0 con 0x55e8a9d245d0 2024-09-19T06:18:13.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.519+0000 7fa8363c9740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55e8a9c31cf0 con 0x55e8a9d2f370 2024-09-19T06:18:13.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.519+0000 7fa8363c9740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55e8a9c862b0 con 0x55e8a9d25b40 2024-09-19T06:18:13.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.519+0000 7fa831d8c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e8a9d245d0 0x55e8a9d24a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:13.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.519+0000 7fa831d8c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e8a9d245d0 0x55e8a9d24a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39334/0 (socket says 172.21.15.2:39334) 2024-09-19T06:18:13.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.519+0000 7fa831d8c640 1 -- 172.21.15.2:0/476357952 learned_addr learned my addr 172.21.15.2:0/476357952 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:13.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.519+0000 7fa83158b640 1 --2- 172.21.15.2:0/476357952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e8a9d2f370 0x55e8a9d31760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:13.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.519+0000 7fa83258d640 1 --2- 172.21.15.2:0/476357952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8a9d25b40 0x55e8a9d24090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:13.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.519+0000 7fa831d8c640 1 -- 172.21.15.2:0/476357952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8a9d25b40 msgr2=0x55e8a9d24090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:13.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.519+0000 7fa831d8c640 1 --2- 172.21.15.2:0/476357952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8a9d25b40 0x55e8a9d24090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:13.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.519+0000 7fa831d8c640 1 -- 172.21.15.2:0/476357952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e8a9d2f370 msgr2=0x55e8a9d31760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:13.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.519+0000 7fa822ffd640 1 --2- 172.21.15.2:0/94854455 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa8180a3430 0x7fa8180a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:13.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.519+0000 7fa831d8c640 1 --2- 172.21.15.2:0/476357952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e8a9d2f370 0x55e8a9d31760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:13.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.519+0000 7fa831d8c640 1 -- 172.21.15.2:0/476357952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8a9c163a0 con 0x55e8a9d245d0 2024-09-19T06:18:13.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.519+0000 7fa83258d640 1 --2- 172.21.15.2:0/94854455 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa8180a3430 0x7fa8180a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:13.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.520+0000 7fa831d8c640 1 --2- 172.21.15.2:0/476357952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e8a9d245d0 0x55e8a9d24a10 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fa8280cd6e0 tx=0x7fa828098690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56a6a5c553015b12 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:13.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.520+0000 7fa822ffd640 1 -- 172.21.15.2:0/94854455 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fa8280d0080 con 0x7fa82c1008d0 2024-09-19T06:18:13.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.520+0000 7fa817fff640 1 -- 172.21.15.2:0/476357952 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa828026030 con 0x55e8a9d245d0 2024-09-19T06:18:13.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.520+0000 7fa817fff640 1 -- 172.21.15.2:0/476357952 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa828010de0 con 0x55e8a9d245d0 2024-09-19T06:18:13.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.520+0000 7fa817fff640 1 -- 172.21.15.2:0/476357952 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82809bc90 con 0x55e8a9d245d0 2024-09-19T06:18:13.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.521+0000 7fa8363c9740 1 -- 172.21.15.2:0/476357952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e8a9d245d0 msgr2=0x55e8a9d24a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:13.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.521+0000 7fa83258d640 1 --2- 172.21.15.2:0/94854455 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa8180a3430 0x7fa8180a58f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa82c06a0f0 tx=0x7fa82400a4d0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:13.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.521+0000 7fa8363c9740 1 --2- 172.21.15.2:0/476357952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e8a9d245d0 0x55e8a9d24a10 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fa8280cd6e0 tx=0x7fa828098690 comp rx=0 tx=0).stop 2024-09-19T06:18:13.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.521+0000 7fa8363c9740 1 -- 172.21.15.2:0/476357952 shutdown_connections 2024-09-19T06:18:13.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.521+0000 7fa8363c9740 1 --2- 172.21.15.2:0/476357952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e8a9d2f370 0x55e8a9d31760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:13.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.521+0000 7fa8363c9740 1 --2- 172.21.15.2:0/476357952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e8a9d245d0 0x55e8a9d24a10 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:13.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.521+0000 7fa8363c9740 1 --2- 172.21.15.2:0/476357952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8a9d25b40 0x55e8a9d24090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:13.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.521+0000 7fa8363c9740 1 -- 172.21.15.2:0/476357952 >> 172.21.15.2:0/476357952 conn(0x55e8a9ced310 msgr2=0x55e8a9d20c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:13.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.521+0000 7fa8363c9740 1 -- 172.21.15.2:0/476357952 shutdown_connections 2024-09-19T06:18:13.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.521+0000 7fa8363c9740 1 -- 172.21.15.2:0/476357952 wait complete. 2024-09-19T06:18:13.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.521+0000 7fa8363c9740 1 -- start start 2024-09-19T06:18:13.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.521+0000 7fa8363c9740 1 Processor -- start 2024-09-19T06:18:13.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.522+0000 7fa8363c9740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e8a9d245d0 0x55e8a9d2ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:13.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.522+0000 7fa8363c9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e8a9d25b40 0x55e8a9d2bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:13.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.522+0000 7fa8363c9740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8a9d2f370 0x55e8a9d2c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:13.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.522+0000 7fa8363c9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e8a9d32010 con 0x55e8a9d25b40 2024-09-19T06:18:13.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.522+0000 7fa8363c9740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55e8a9c45060 con 0x55e8a9d245d0 2024-09-19T06:18:13.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.522+0000 7fa8363c9740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55e8a9d32190 con 0x55e8a9d2f370 2024-09-19T06:18:13.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.522+0000 7fa8363c9740 10 client.0 _ll_register_callbacks cb 0x55e8a99988c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:13.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.522+0000 7fa83158b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e8a9d25b40 0x55e8a9d2bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:13.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.522+0000 7fa83158b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e8a9d25b40 0x55e8a9d2bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39344/0 (socket says 172.21.15.2:39344) 2024-09-19T06:18:13.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.522+0000 7fa83158b640 1 -- 172.21.15.2:0/4263858822 learned_addr learned my addr 172.21.15.2:0/4263858822 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:13.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.522+0000 7fa83258d640 1 --2- 172.21.15.2:0/4263858822 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8a9d2f370 0x55e8a9d2c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:13.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.522+0000 7fa831d8c640 1 --2- 172.21.15.2:0/4263858822 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e8a9d245d0 0x55e8a9d2ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:13.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.522+0000 7fa83158b640 1 -- 172.21.15.2:0/4263858822 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8a9d2f370 msgr2=0x55e8a9d2c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:13.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.522+0000 7fa83158b640 1 --2- 172.21.15.2:0/4263858822 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8a9d2f370 0x55e8a9d2c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:13.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.522+0000 7fa83158b640 1 -- 172.21.15.2:0/4263858822 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e8a9d245d0 msgr2=0x55e8a9d2ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:13.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.522+0000 7fa83158b640 1 --2- 172.21.15.2:0/4263858822 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e8a9d245d0 0x55e8a9d2ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:13.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.522+0000 7fa83158b640 1 -- 172.21.15.2:0/4263858822 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8a99fb3c0 con 0x55e8a9d25b40 2024-09-19T06:18:13.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.522+0000 7fa83158b640 1 --2- 172.21.15.2:0/4263858822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e8a9d25b40 0x55e8a9d2bff0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fa81c009230 tx=0x7fa81c0052e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8c23107a73bbcf6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:13.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.522+0000 7fa8157fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:18:13.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.522+0000 7fa8157fa640 1 -- 172.21.15.2:0/4263858822 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa81c035040 con 0x55e8a9d25b40 2024-09-19T06:18:13.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.522+0000 7fa8157fa640 1 -- 172.21.15.2:0/4263858822 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fa81c0048c0 con 0x55e8a9d25b40 2024-09-19T06:18:13.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.523+0000 7fa8363c9740 1 -- 172.21.15.2:0/4263858822 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e8a9c97860 con 0x55e8a9d25b40 2024-09-19T06:18:13.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.523+0000 7fa8157fa640 1 -- 172.21.15.2:0/4263858822 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa81c004ac0 con 0x55e8a9d25b40 2024-09-19T06:18:13.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.523+0000 7fa8363c9740 10 client.16146 fetch_fsmap learned FSMap version 26 2024-09-19T06:18:13.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.523+0000 7fa8363c9740 1 -- 172.21.15.2:0/4263858822 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55e8a9d3dad0 con 0x55e8a9d25b40 2024-09-19T06:18:13.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.523+0000 7fa8157fa640 1 -- 172.21.15.2:0/4263858822 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55e8a9c97860 con 0x55e8a9d25b40 2024-09-19T06:18:13.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.523+0000 7fa8157fa640 1 -- 172.21.15.2:0/4263858822 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fa81c0314a0 con 0x55e8a9d25b40 2024-09-19T06:18:13.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.523+0000 7fa8363c9740 10 client.16146 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:18:13.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.523+0000 7fa8363c9740 10 client.16146 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:18:13.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.523+0000 7fa8363c9740 20 client.16146 populate_metadata read hostname 'smithi002' 2024-09-19T06:18:13.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.523+0000 7fa8363c9740 1 --2- 172.21.15.2:0/4263858822 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55e8a9d3ef90 0x55e8a9d413f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:13.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.523+0000 7fa8363c9740 4 client.16146 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:18:13.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.523+0000 7fa8363c9740 1 -- 172.21.15.2:0/4263858822 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e8a9c91d70 con 0x55e8a9d3ef90 2024-09-19T06:18:13.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.523+0000 7fa831d8c640 1 --2- 172.21.15.2:0/4263858822 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55e8a9d3ef90 0x55e8a9d413f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:13.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.524+0000 7fa831d8c640 1 --2- 172.21.15.2:0/4263858822 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55e8a9d3ef90 0x55e8a9d413f0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=23037f09e9053c75 server_cookie=76fe53028a000886 in_seq=0 out_seq=0 2024-09-19T06:18:13.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.524+0000 7fa8157fa640 10 client.16146 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:18:13.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.524+0000 7fa8157fa640 1 -- 172.21.15.2:0/4263858822 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e8a9c91d70 con 0x55e8a9d3ef90 2024-09-19T06:18:13.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.524+0000 7fa8157fa640 10 client.16146 handle_command_reply: tid=0 2024-09-19T06:18:13.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.524+0000 7fa8363c9740 1 client.16146 shutdown 2024-09-19T06:18:13.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.525+0000 7fa8363c9740 1 -- 172.21.15.2:0/4263858822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e8a9d25b40 msgr2=0x55e8a9d2bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:13.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.525+0000 7fa8363c9740 1 --2- 172.21.15.2:0/4263858822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e8a9d25b40 0x55e8a9d2bff0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fa81c009230 tx=0x7fa81c0052e0 comp rx=0 tx=0).stop 2024-09-19T06:18:13.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.525+0000 7fa8363c9740 1 -- 172.21.15.2:0/4263858822 shutdown_connections 2024-09-19T06:18:13.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.525+0000 7fa8363c9740 1 --2- 172.21.15.2:0/4263858822 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55e8a9d3ef90 0x55e8a9d413f0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:13.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.525+0000 7fa8363c9740 1 --2- 172.21.15.2:0/4263858822 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8a9d2f370 0x55e8a9d2c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:13.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.525+0000 7fa8363c9740 1 --2- 172.21.15.2:0/4263858822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e8a9d25b40 0x55e8a9d2bff0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:13.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.525+0000 7fa8363c9740 1 --2- 172.21.15.2:0/4263858822 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e8a9d245d0 0x55e8a9d2ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:13.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.525+0000 7fa8363c9740 1 -- 172.21.15.2:0/4263858822 >> 172.21.15.2:0/4263858822 conn(0x55e8a9ced310 msgr2=0x55e8a9d26990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:13.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.525+0000 7fa8157fa640 0 client.16146 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:18:13.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.525+0000 7fa8363c9740 1 -- 172.21.15.2:0/4263858822 shutdown_connections 2024-09-19T06:18:13.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.525+0000 7fa8363c9740 1 -- 172.21.15.2:0/4263858822 wait complete. 2024-09-19T06:18:13.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.525+0000 7fa8363c9740 20 client.16146 trim_cache size 0 max 16384 2024-09-19T06:18:13.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.538+0000 7fa8363c9740 1 Processor -- start 2024-09-19T06:18:13.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.538+0000 7fa8363c9740 1 -- start start 2024-09-19T06:18:13.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.538+0000 7fa8363c9740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e8a9d245d0 0x55e8a9d2a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:13.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.538+0000 7fa8363c9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e8a9d25b40 0x55e8a9d2df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:13.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.538+0000 7fa8363c9740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8a9d2f370 0x55e8a9d27120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:13.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.538+0000 7fa8363c9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c1b2260 con 0x55e8a9d25b40 2024-09-19T06:18:13.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.538+0000 7fa8363c9740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c1afb30 con 0x55e8a9d245d0 2024-09-19T06:18:13.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.538+0000 7fa8363c9740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c1ad980 con 0x55e8a9d2f370 2024-09-19T06:18:13.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.538+0000 7fa83158b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e8a9d25b40 0x55e8a9d2df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:13.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.538+0000 7fa83158b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e8a9d25b40 0x55e8a9d2df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39356/0 (socket says 172.21.15.2:39356) 2024-09-19T06:18:13.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.538+0000 7fa83158b640 1 -- 172.21.15.2:0/1556128642 learned_addr learned my addr 172.21.15.2:0/1556128642 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:13.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.538+0000 7fa831d8c640 1 --2- 172.21.15.2:0/1556128642 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e8a9d245d0 0x55e8a9d2a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:13.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.538+0000 7fa83158b640 1 -- 172.21.15.2:0/1556128642 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8a9d2f370 msgr2=0x55e8a9d27120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:13.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.538+0000 7fa83158b640 1 --2- 172.21.15.2:0/1556128642 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8a9d2f370 0x55e8a9d27120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:13.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.538+0000 7fa83158b640 1 -- 172.21.15.2:0/1556128642 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e8a9d245d0 msgr2=0x55e8a9d2a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:13.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.538+0000 7fa83158b640 1 --2- 172.21.15.2:0/1556128642 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e8a9d245d0 0x55e8a9d2a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:13.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.538+0000 7fa83158b640 1 -- 172.21.15.2:0/1556128642 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8a9d2afa0 con 0x55e8a9d25b40 2024-09-19T06:18:13.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.538+0000 7fa831d8c640 1 --2- 172.21.15.2:0/1556128642 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e8a9d245d0 0x55e8a9d2a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:18:13.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.538+0000 7fa83158b640 1 --2- 172.21.15.2:0/1556128642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e8a9d25b40 0x55e8a9d2df60 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fa81c0319c0 tx=0x7fa81c005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42b2a0412fa4e0cd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:13.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.539+0000 7fa8177fe640 1 -- 172.21.15.2:0/1556128642 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa81c052070 con 0x55e8a9d25b40 2024-09-19T06:18:13.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.539+0000 7fa8177fe640 1 -- 172.21.15.2:0/1556128642 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa81c040070 con 0x55e8a9d25b40 2024-09-19T06:18:13.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.539+0000 7fa8177fe640 1 -- 172.21.15.2:0/1556128642 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa81c035040 con 0x55e8a9d25b40 2024-09-19T06:18:13.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.539+0000 7fa8363c9740 1 -- 172.21.15.2:0/1556128642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e8a9d25b40 msgr2=0x55e8a9d2df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:13.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.539+0000 7fa8363c9740 1 --2- 172.21.15.2:0/1556128642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e8a9d25b40 0x55e8a9d2df60 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fa81c0319c0 tx=0x7fa81c005a20 comp rx=0 tx=0).stop 2024-09-19T06:18:13.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.539+0000 7fa8363c9740 1 -- 172.21.15.2:0/1556128642 shutdown_connections 2024-09-19T06:18:13.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.539+0000 7fa8363c9740 1 --2- 172.21.15.2:0/1556128642 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8a9d2f370 0x55e8a9d27120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:13.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.539+0000 7fa8363c9740 1 --2- 172.21.15.2:0/1556128642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e8a9d25b40 0x55e8a9d2df60 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:13.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.539+0000 7fa8363c9740 1 --2- 172.21.15.2:0/1556128642 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e8a9d245d0 0x55e8a9d2a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:13.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.539+0000 7fa8363c9740 1 -- 172.21.15.2:0/1556128642 >> 172.21.15.2:0/1556128642 conn(0x55e8a9ced310 msgr2=0x55e8a9d2d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:13.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.539+0000 7fa8363c9740 1 -- 172.21.15.2:0/1556128642 shutdown_connections 2024-09-19T06:18:13.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.539+0000 7fa8363c9740 1 -- 172.21.15.2:0/1556128642 wait complete. 2024-09-19T06:18:13.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.540+0000 7fa8363c9740 1 -- start start 2024-09-19T06:18:13.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.540+0000 7fa8363c9740 1 Processor -- start 2024-09-19T06:18:13.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.540+0000 7fa8363c9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e8a9d245d0 0x55e8a9d37b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:13.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.540+0000 7fa8363c9740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e8a9d25b40 0x55e8a9d32ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:13.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.540+0000 7fa8363c9740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8a9d2f370 0x55e8a9d33400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:13.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.540+0000 7fa8363c9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c1adff0 con 0x55e8a9d245d0 2024-09-19T06:18:13.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.540+0000 7fa8363c9740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c1af460 con 0x55e8a9d25b40 2024-09-19T06:18:13.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.540+0000 7fa8363c9740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c1ae6c0 con 0x55e8a9d2f370 2024-09-19T06:18:13.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.540+0000 7fa8363c9740 10 client.0 _ll_register_callbacks cb 0x7fa81c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:13.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.540+0000 7fa831d8c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e8a9d245d0 0x55e8a9d37b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:13.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.540+0000 7fa831d8c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e8a9d245d0 0x55e8a9d37b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39358/0 (socket says 172.21.15.2:39358) 2024-09-19T06:18:13.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.540+0000 7fa831d8c640 1 -- 172.21.15.2:0/1344522895 learned_addr learned my addr 172.21.15.2:0/1344522895 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:13.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.540+0000 7fa83158b640 1 --2- 172.21.15.2:0/1344522895 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e8a9d25b40 0x55e8a9d32ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:13.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.541+0000 7fa83258d640 1 --2- 172.21.15.2:0/1344522895 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8a9d2f370 0x55e8a9d33400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:13.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.541+0000 7fa831d8c640 1 -- 172.21.15.2:0/1344522895 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8a9d2f370 msgr2=0x55e8a9d33400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:13.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.541+0000 7fa831d8c640 1 --2- 172.21.15.2:0/1344522895 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8a9d2f370 0x55e8a9d33400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:13.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.541+0000 7fa831d8c640 1 -- 172.21.15.2:0/1344522895 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e8a9d25b40 msgr2=0x55e8a9d32ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:13.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.541+0000 7fa831d8c640 1 --2- 172.21.15.2:0/1344522895 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e8a9d25b40 0x55e8a9d32ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:13.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.541+0000 7fa831d8c640 1 -- 172.21.15.2:0/1344522895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8a9d33c50 con 0x55e8a9d245d0 2024-09-19T06:18:13.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.541+0000 7fa831d8c640 1 --2- 172.21.15.2:0/1344522895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e8a9d245d0 0x55e8a9d37b90 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fa82809c030 tx=0x7fa828098700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3afd7deac4b666bd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:13.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.541+0000 7fa8157fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:18:13.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.541+0000 7fa8157fa640 1 -- 172.21.15.2:0/1344522895 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82809bc90 con 0x55e8a9d245d0 2024-09-19T06:18:13.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.541+0000 7fa8157fa640 1 -- 172.21.15.2:0/1344522895 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fa8280d3c20 con 0x55e8a9d245d0 2024-09-19T06:18:13.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.541+0000 7fa8363c9740 1 -- 172.21.15.2:0/1344522895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa81c040070 con 0x55e8a9d245d0 2024-09-19T06:18:13.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.541+0000 7fa8157fa640 1 -- 172.21.15.2:0/1344522895 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa8280b5050 con 0x55e8a9d245d0 2024-09-19T06:18:13.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.541+0000 7fa8363c9740 10 client.16152 fetch_fsmap learned FSMap version 26 2024-09-19T06:18:13.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.541+0000 7fa8363c9740 1 -- 172.21.15.2:0/1344522895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55e8a9da9c30 con 0x55e8a9d245d0 2024-09-19T06:18:13.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.541+0000 7fa8157fa640 1 -- 172.21.15.2:0/1344522895 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa8280af020 con 0x55e8a9d245d0 2024-09-19T06:18:13.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.542+0000 7fa8157fa640 1 -- 172.21.15.2:0/1344522895 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fa8280989a0 con 0x55e8a9d245d0 2024-09-19T06:18:13.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.542+0000 7fa8363c9740 10 client.16152 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:18:13.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.542+0000 7fa8363c9740 10 client.16152 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:18:13.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.542+0000 7fa8363c9740 20 client.16152 populate_metadata read hostname 'smithi002' 2024-09-19T06:18:13.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.542+0000 7fa8363c9740 1 --2- 172.21.15.2:0/1344522895 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55e8a9da9f20 0x55e8a9dac310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:13.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.542+0000 7fa8363c9740 4 client.16152 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:18:13.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.542+0000 7fa8363c9740 1 -- 172.21.15.2:0/1344522895 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e8a9c0e170 con 0x55e8a9da9f20 2024-09-19T06:18:13.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.542+0000 7fa83158b640 1 --2- 172.21.15.2:0/1344522895 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55e8a9da9f20 0x55e8a9dac310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:13.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.542+0000 7fa83158b640 1 --2- 172.21.15.2:0/1344522895 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55e8a9da9f20 0x55e8a9dac310 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4013b9ec9dd90c30 server_cookie=cfd839c53a13e7a1 in_seq=0 out_seq=0 2024-09-19T06:18:13.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.542+0000 7fa8157fa640 10 client.16152 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:18:13.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.543+0000 7fa8157fa640 1 -- 172.21.15.2:0/1344522895 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e8a9c0e170 con 0x55e8a9da9f20 2024-09-19T06:18:13.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.543+0000 7fa8157fa640 10 client.16152 handle_command_reply: tid=0 2024-09-19T06:18:13.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.543+0000 7fa8363c9740 1 client.16152 shutdown 2024-09-19T06:18:13.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.543+0000 7fa8363c9740 1 -- 172.21.15.2:0/1344522895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e8a9d245d0 msgr2=0x55e8a9d37b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:13.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.543+0000 7fa8363c9740 1 --2- 172.21.15.2:0/1344522895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e8a9d245d0 0x55e8a9d37b90 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fa82809c030 tx=0x7fa828098700 comp rx=0 tx=0).stop 2024-09-19T06:18:13.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.543+0000 7fa8363c9740 1 -- 172.21.15.2:0/1344522895 shutdown_connections 2024-09-19T06:18:13.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.543+0000 7fa8363c9740 1 --2- 172.21.15.2:0/1344522895 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55e8a9da9f20 0x55e8a9dac310 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:13.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.543+0000 7fa8363c9740 1 --2- 172.21.15.2:0/1344522895 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e8a9d2f370 0x55e8a9d33400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:13.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.543+0000 7fa8363c9740 1 --2- 172.21.15.2:0/1344522895 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e8a9d25b40 0x55e8a9d32ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:13.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.543+0000 7fa8363c9740 1 --2- 172.21.15.2:0/1344522895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e8a9d245d0 0x55e8a9d37b90 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:13.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.543+0000 7fa8157fa640 0 client.16152 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:18:13.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.543+0000 7fa8363c9740 1 -- 172.21.15.2:0/1344522895 >> 172.21.15.2:0/1344522895 conn(0x55e8a9ced310 msgr2=0x55e8a9d2d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:13.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.543+0000 7fa8363c9740 1 -- 172.21.15.2:0/1344522895 shutdown_connections 2024-09-19T06:18:13.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.543+0000 7fa8363c9740 1 -- 172.21.15.2:0/1344522895 wait complete. 2024-09-19T06:18:13.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.543+0000 7fa8363c9740 20 client.16152 trim_cache size 0 max 16384 2024-09-19T06:18:13.551 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:18:13.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.544+0000 7fa833ff0640 1 -- 172.21.15.2:0/94854455 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa8180a3430 msgr2=0x7fa8180a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:13.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.544+0000 7fa833ff0640 1 --2- 172.21.15.2:0/94854455 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa8180a3430 0x7fa8180a58f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa82c06a0f0 tx=0x7fa82400a4d0 comp rx=0 tx=0).stop 2024-09-19T06:18:13.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.544+0000 7fa833ff0640 1 -- 172.21.15.2:0/94854455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa82c1008d0 msgr2=0x7fa82c19a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:13.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.544+0000 7fa833ff0640 1 --2- 172.21.15.2:0/94854455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa82c1008d0 0x7fa82c19a610 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fa82800e9f0 tx=0x7fa82800eeb0 comp rx=0 tx=0).stop 2024-09-19T06:18:13.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.544+0000 7fa833ff0640 1 -- 172.21.15.2:0/94854455 shutdown_connections 2024-09-19T06:18:13.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.544+0000 7fa833ff0640 1 --2- 172.21.15.2:0/94854455 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa8180a3430 0x7fa8180a58f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:13.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.544+0000 7fa833ff0640 1 --2- 172.21.15.2:0/94854455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa82c10e480 0x7fa82c19eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:13.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.544+0000 7fa833ff0640 1 --2- 172.21.15.2:0/94854455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa82c101280 0x7fa82c19ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:13.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.544+0000 7fa833ff0640 1 --2- 172.21.15.2:0/94854455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa82c1008d0 0x7fa82c19a610 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:13.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.544+0000 7fa833ff0640 1 -- 172.21.15.2:0/94854455 >> 172.21.15.2:0/94854455 conn(0x7fa82c0fc7a0 msgr2=0x7fa82c0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:13.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.544+0000 7fa833ff0640 1 -- 172.21.15.2:0/94854455 shutdown_connections 2024-09-19T06:18:13.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:13.544+0000 7fa833ff0640 1 -- 172.21.15.2:0/94854455 wait complete. 2024-09-19T06:18:13.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:13 smithi002 ceph-mon[30982]: pgmap v105: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T06:18:13.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:13 smithi090 ceph-mon[34497]: pgmap v105: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T06:18:13.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:13 smithi089 ceph-mon[34160]: pgmap v105: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T06:18:14.407 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:18:14.670 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:18:15.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.103+0000 7fa5f4076640 1 -- 172.21.15.2:0/3405856493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5ec101450 msgr2=0x7fa5ec105920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:15.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.103+0000 7fa5f4076640 1 --2- 172.21.15.2:0/3405856493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5ec101450 0x7fa5ec105920 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc009900 tx=0x7fa5dc02a470 comp rx=0 tx=0).stop 2024-09-19T06:18:15.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.103+0000 7fa5f4076640 1 -- 172.21.15.2:0/3405856493 shutdown_connections 2024-09-19T06:18:15.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.103+0000 7fa5f4076640 1 --2- 172.21.15.2:0/3405856493 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5ec105f40 0x7fa5ec1063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:15.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.103+0000 7fa5f4076640 1 --2- 172.21.15.2:0/3405856493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5ec101450 0x7fa5ec105920 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:15.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.103+0000 7fa5f4076640 1 --2- 172.21.15.2:0/3405856493 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5ec100b30 0x7fa5ec100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:15.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.103+0000 7fa5f4076640 1 -- 172.21.15.2:0/3405856493 >> 172.21.15.2:0/3405856493 conn(0x7fa5ec0fc7a0 msgr2=0x7fa5ec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:15.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.103+0000 7fa5f4076640 1 -- 172.21.15.2:0/3405856493 shutdown_connections 2024-09-19T06:18:15.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.103+0000 7fa5f4076640 1 -- 172.21.15.2:0/3405856493 wait complete. 2024-09-19T06:18:15.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.104+0000 7fa5f4076640 1 Processor -- start 2024-09-19T06:18:15.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.104+0000 7fa5f4076640 1 -- start start 2024-09-19T06:18:15.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.104+0000 7fa5f4076640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5ec100b30 0x7fa5ec1a4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:15.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.105+0000 7fa5f4076640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5ec101450 0x7fa5ec1a4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:15.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.105+0000 7fa5f4076640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5ec105f40 0x7fa5ec19e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:15.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.105+0000 7fa5f4076640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ec1183f0 con 0x7fa5ec105f40 2024-09-19T06:18:15.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.105+0000 7fa5f4076640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ec118270 con 0x7fa5ec100b30 2024-09-19T06:18:15.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.105+0000 7fa5f4076640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ec118570 con 0x7fa5ec101450 2024-09-19T06:18:15.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.105+0000 7fa5f1e12640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5ec100b30 0x7fa5ec1a4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:15.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.105+0000 7fa5f1e12640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5ec100b30 0x7fa5ec1a4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:54986/0 (socket says 172.21.15.2:54986) 2024-09-19T06:18:15.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.105+0000 7fa5f1e12640 1 -- 172.21.15.2:0/3157309237 learned_addr learned my addr 172.21.15.2:0/3157309237 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:15.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.105+0000 7fa5f2613640 1 --2- 172.21.15.2:0/3157309237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5ec105f40 0x7fa5ec19e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:15.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.105+0000 7fa5f1611640 1 --2- 172.21.15.2:0/3157309237 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5ec101450 0x7fa5ec1a4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:15.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.105+0000 7fa5f2613640 1 -- 172.21.15.2:0/3157309237 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5ec101450 msgr2=0x7fa5ec1a4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:15.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.105+0000 7fa5f2613640 1 --2- 172.21.15.2:0/3157309237 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5ec101450 0x7fa5ec1a4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:15.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.105+0000 7fa5f2613640 1 -- 172.21.15.2:0/3157309237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5ec100b30 msgr2=0x7fa5ec1a4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:15.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.105+0000 7fa5f2613640 1 --2- 172.21.15.2:0/3157309237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5ec100b30 0x7fa5ec1a4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:15.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.105+0000 7fa5f2613640 1 -- 172.21.15.2:0/3157309237 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5ec19efb0 con 0x7fa5ec105f40 2024-09-19T06:18:15.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.105+0000 7fa5f1e12640 1 --2- 172.21.15.2:0/3157309237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5ec100b30 0x7fa5ec1a4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:18:15.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.105+0000 7fa5f2613640 1 --2- 172.21.15.2:0/3157309237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5ec105f40 0x7fa5ec19e740 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fa5e400cab0 tx=0x7fa5e400cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:15.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.106+0000 7fa5e2ffd640 1 -- 172.21.15.2:0/3157309237 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e400ae20 con 0x7fa5ec105f40 2024-09-19T06:18:15.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.106+0000 7fa5e2ffd640 1 -- 172.21.15.2:0/3157309237 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa5e400f900 con 0x7fa5ec105f40 2024-09-19T06:18:15.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.106+0000 7fa5f4076640 1 -- 172.21.15.2:0/3157309237 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5ec19f2a0 con 0x7fa5ec105f40 2024-09-19T06:18:15.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.106+0000 7fa5e2ffd640 1 -- 172.21.15.2:0/3157309237 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e4018a00 con 0x7fa5ec105f40 2024-09-19T06:18:15.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.106+0000 7fa5f4076640 1 -- 172.21.15.2:0/3157309237 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5ec1ab5f0 con 0x7fa5ec105f40 2024-09-19T06:18:15.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.108+0000 7fa5e2ffd640 1 -- 172.21.15.2:0/3157309237 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fa5e400fab0 con 0x7fa5ec105f40 2024-09-19T06:18:15.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.108+0000 7fa5f644f740 1 Processor -- start 2024-09-19T06:18:15.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.109+0000 7fa5f644f740 1 -- start start 2024-09-19T06:18:15.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.109+0000 7fa5f644f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55767621ab40 0x557676219090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:15.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.109+0000 7fa5f644f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5576762195d0 0x557676219a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:15.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.109+0000 7fa5f644f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557676224370 0x557676226760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:15.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.109+0000 7fa5f644f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55767617f2f0 con 0x55767621ab40 2024-09-19T06:18:15.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.109+0000 7fa5f644f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x557676126cf0 con 0x5576762195d0 2024-09-19T06:18:15.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.109+0000 7fa5f644f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55767617b2b0 con 0x557676224370 2024-09-19T06:18:15.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.109+0000 7fa5f1611640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55767621ab40 0x557676219090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:15.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.109+0000 7fa5f1611640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55767621ab40 0x557676219090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39382/0 (socket says 172.21.15.2:39382) 2024-09-19T06:18:15.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.109+0000 7fa5f1611640 1 -- 172.21.15.2:0/3841303368 learned_addr learned my addr 172.21.15.2:0/3841303368 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:15.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.109+0000 7fa5f1e12640 1 --2- 172.21.15.2:0/3841303368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5576762195d0 0x557676219a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:15.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.109+0000 7fa5f1611640 1 --2- 172.21.15.2:0/3841303368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557676224370 0x557676226760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:15.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.109+0000 7fa5e2ffd640 1 --2- 172.21.15.2:0/3157309237 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa5d80a3430 0x7fa5d80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:15.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.110+0000 7fa5f2613640 1 --2- 172.21.15.2:0/3157309237 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa5d80a3430 0x7fa5d80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:15.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.110+0000 7fa5f1611640 1 -- 172.21.15.2:0/3841303368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557676224370 msgr2=0x557676226760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:15.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.110+0000 7fa5f1611640 1 --2- 172.21.15.2:0/3841303368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557676224370 0x557676226760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:15.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.110+0000 7fa5f1611640 1 -- 172.21.15.2:0/3841303368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5576762195d0 msgr2=0x557676219a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:15.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.110+0000 7fa5f1611640 1 --2- 172.21.15.2:0/3841303368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5576762195d0 0x557676219a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:15.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.110+0000 7fa5f1611640 1 -- 172.21.15.2:0/3841303368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55767610b3a0 con 0x55767621ab40 2024-09-19T06:18:15.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.110+0000 7fa5e2ffd640 1 -- 172.21.15.2:0/3157309237 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fa5e40d0310 con 0x7fa5ec105f40 2024-09-19T06:18:15.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.110+0000 7fa5f1611640 1 --2- 172.21.15.2:0/3841303368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55767621ab40 0x557676219090 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x55767621a070 tx=0x7fa5dc009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8751794bcecda78 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:15.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.110+0000 7fa5d7fff640 1 -- 172.21.15.2:0/3841303368 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc035070 con 0x55767621ab40 2024-09-19T06:18:15.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.110+0000 7fa5f2613640 1 --2- 172.21.15.2:0/3157309237 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa5d80a3430 0x7fa5d80a58f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa5e409c320 tx=0x7fa5e406e3a0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:15.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.110+0000 7fa5d7fff640 1 -- 172.21.15.2:0/3841303368 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa5dc005020 con 0x55767621ab40 2024-09-19T06:18:15.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.110+0000 7fa5d7fff640 1 -- 172.21.15.2:0/3841303368 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc004a00 con 0x55767621ab40 2024-09-19T06:18:15.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.111+0000 7fa5f644f740 1 -- 172.21.15.2:0/3841303368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55767621ab40 msgr2=0x557676219090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:15.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.111+0000 7fa5f644f740 1 --2- 172.21.15.2:0/3841303368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55767621ab40 0x557676219090 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x55767621a070 tx=0x7fa5dc009560 comp rx=0 tx=0).stop 2024-09-19T06:18:15.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.111+0000 7fa5f644f740 1 -- 172.21.15.2:0/3841303368 shutdown_connections 2024-09-19T06:18:15.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.111+0000 7fa5f644f740 1 --2- 172.21.15.2:0/3841303368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557676224370 0x557676226760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:15.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.111+0000 7fa5f644f740 1 --2- 172.21.15.2:0/3841303368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5576762195d0 0x557676219a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:15.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.111+0000 7fa5f644f740 1 --2- 172.21.15.2:0/3841303368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55767621ab40 0x557676219090 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:15.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.111+0000 7fa5f644f740 1 -- 172.21.15.2:0/3841303368 >> 172.21.15.2:0/3841303368 conn(0x5576761e2310 msgr2=0x557676215c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:15.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.111+0000 7fa5f644f740 1 -- 172.21.15.2:0/3841303368 shutdown_connections 2024-09-19T06:18:15.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.111+0000 7fa5f644f740 1 -- 172.21.15.2:0/3841303368 wait complete. 2024-09-19T06:18:15.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.112+0000 7fa5f644f740 1 -- start start 2024-09-19T06:18:15.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.112+0000 7fa5f644f740 1 Processor -- start 2024-09-19T06:18:15.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.112+0000 7fa5f644f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5576762195d0 0x557676223dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:15.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.112+0000 7fa5f644f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55767621ab40 0x557676221080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:15.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.112+0000 7fa5f644f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557676224370 0x557676221810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:15.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.112+0000 7fa5f644f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557676226fb0 con 0x55767621ab40 2024-09-19T06:18:15.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.112+0000 7fa5f644f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55767613a060 con 0x557676224370 2024-09-19T06:18:15.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.112+0000 7fa5f644f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x557676227130 con 0x5576762195d0 2024-09-19T06:18:15.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.112+0000 7fa5f644f740 10 client.0 _ll_register_callbacks cb 0x557675e8d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:15.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.112+0000 7fa5f1e12640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55767621ab40 0x557676221080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:15.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.112+0000 7fa5f1e12640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55767621ab40 0x557676221080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39396/0 (socket says 172.21.15.2:39396) 2024-09-19T06:18:15.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.112+0000 7fa5f1e12640 1 -- 172.21.15.2:0/3634458139 learned_addr learned my addr 172.21.15.2:0/3634458139 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:15.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.112+0000 7fa5f1611640 1 --2- 172.21.15.2:0/3634458139 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5576762195d0 0x557676223dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:15.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.113+0000 7fa5f1e12640 1 -- 172.21.15.2:0/3634458139 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5576762195d0 msgr2=0x557676223dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:15.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.113+0000 7fa5f1e12640 1 --2- 172.21.15.2:0/3634458139 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5576762195d0 0x557676223dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:15.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.113+0000 7fa5f1611640 1 --2- 172.21.15.2:0/3634458139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557676224370 0x557676221810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:15.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.113+0000 7fa5f1e12640 1 -- 172.21.15.2:0/3634458139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557676224370 msgr2=0x557676221810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:15.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.113+0000 7fa5f1e12640 1 --2- 172.21.15.2:0/3634458139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557676224370 0x557676221810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:15.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.113+0000 7fa5f1e12640 1 -- 172.21.15.2:0/3634458139 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557675ef03c0 con 0x55767621ab40 2024-09-19T06:18:15.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.113+0000 7fa5f1611640 1 --2- 172.21.15.2:0/3634458139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557676224370 0x557676221810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:18:15.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.113+0000 7fa5f1e12640 1 --2- 172.21.15.2:0/3634458139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55767621ab40 0x557676221080 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8010f10 tx=0x7fa5e800f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=190583698dd75450 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:15.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.113+0000 7fa5d57fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:18:15.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.113+0000 7fa5d57fa640 1 -- 172.21.15.2:0/3634458139 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e800fe80 con 0x55767621ab40 2024-09-19T06:18:15.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.113+0000 7fa5d57fa640 1 -- 172.21.15.2:0/3634458139 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fa5e8005020 con 0x55767621ab40 2024-09-19T06:18:15.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.113+0000 7fa5f644f740 1 -- 172.21.15.2:0/3634458139 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5dc005020 con 0x55767621ab40 2024-09-19T06:18:15.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.113+0000 7fa5d57fa640 1 -- 172.21.15.2:0/3634458139 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa5e8005220 con 0x55767621ab40 2024-09-19T06:18:15.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.113+0000 7fa5f644f740 10 client.16164 fetch_fsmap learned FSMap version 26 2024-09-19T06:18:15.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.113+0000 7fa5f644f740 1 -- 172.21.15.2:0/3634458139 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557676232b60 con 0x55767621ab40 2024-09-19T06:18:15.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.113+0000 7fa5d57fa640 1 -- 172.21.15.2:0/3634458139 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa5dc005020 con 0x55767621ab40 2024-09-19T06:18:15.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.114+0000 7fa5d57fa640 1 -- 172.21.15.2:0/3634458139 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fa5e800e650 con 0x55767621ab40 2024-09-19T06:18:15.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.114+0000 7fa5f644f740 10 client.16164 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:18:15.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.114+0000 7fa5f644f740 10 client.16164 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:18:15.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.114+0000 7fa5f644f740 20 client.16164 populate_metadata read hostname 'smithi002' 2024-09-19T06:18:15.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.114+0000 7fa5f644f740 1 --2- 172.21.15.2:0/3634458139 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5576762340c0 0x557676236500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:15.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.114+0000 7fa5f644f740 4 client.16164 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:18:15.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.114+0000 7fa5f644f740 1 -- 172.21.15.2:0/3634458139 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55767618c860 con 0x5576762340c0 2024-09-19T06:18:15.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.114+0000 7fa5f1611640 1 --2- 172.21.15.2:0/3634458139 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5576762340c0 0x557676236500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:15.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.114+0000 7fa5f1611640 1 --2- 172.21.15.2:0/3634458139 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5576762340c0 0x557676236500 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50db4ee018c2c649 server_cookie=356c53efe044cd79 in_seq=0 out_seq=0 2024-09-19T06:18:15.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.114+0000 7fa5d57fa640 10 client.16164 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:18:15.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.115+0000 7fa5d57fa640 1 -- 172.21.15.2:0/3634458139 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55767618c860 con 0x5576762340c0 2024-09-19T06:18:15.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.115+0000 7fa5d57fa640 10 client.16164 handle_command_reply: tid=0 2024-09-19T06:18:15.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.115+0000 7fa5f644f740 1 client.16164 shutdown 2024-09-19T06:18:15.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.115+0000 7fa5f644f740 1 -- 172.21.15.2:0/3634458139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55767621ab40 msgr2=0x557676221080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:15.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.115+0000 7fa5f644f740 1 --2- 172.21.15.2:0/3634458139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55767621ab40 0x557676221080 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8010f10 tx=0x7fa5e800f7f0 comp rx=0 tx=0).stop 2024-09-19T06:18:15.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.116+0000 7fa5f644f740 1 -- 172.21.15.2:0/3634458139 shutdown_connections 2024-09-19T06:18:15.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.116+0000 7fa5f644f740 1 --2- 172.21.15.2:0/3634458139 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5576762340c0 0x557676236500 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:15.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.116+0000 7fa5f644f740 1 --2- 172.21.15.2:0/3634458139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557676224370 0x557676221810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:15.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.116+0000 7fa5f644f740 1 --2- 172.21.15.2:0/3634458139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55767621ab40 0x557676221080 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:15.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.116+0000 7fa5d57fa640 0 client.16164 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:18:15.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.116+0000 7fa5f644f740 1 --2- 172.21.15.2:0/3634458139 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5576762195d0 0x557676223dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:15.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.116+0000 7fa5f644f740 1 -- 172.21.15.2:0/3634458139 >> 172.21.15.2:0/3634458139 conn(0x5576761e2310 msgr2=0x55767621b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:15.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.116+0000 7fa5f644f740 1 -- 172.21.15.2:0/3634458139 shutdown_connections 2024-09-19T06:18:15.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.116+0000 7fa5f644f740 1 -- 172.21.15.2:0/3634458139 wait complete. 2024-09-19T06:18:15.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.116+0000 7fa5f644f740 20 client.16164 trim_cache size 0 max 16384 2024-09-19T06:18:15.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.129+0000 7fa5f644f740 1 Processor -- start 2024-09-19T06:18:15.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.129+0000 7fa5f644f740 1 -- start start 2024-09-19T06:18:15.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.129+0000 7fa5f644f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5576762195d0 0x557676220940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:15.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.129+0000 7fa5f644f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55767621ab40 0x55767621c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:15.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.129+0000 7fa5f644f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557676224370 0x55767621c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:15.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.129+0000 7fa5f644f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ec1b64e0 con 0x557676224370 2024-09-19T06:18:15.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.129+0000 7fa5f644f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ec1b3db0 con 0x55767621ab40 2024-09-19T06:18:15.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.129+0000 7fa5f644f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ec1b1c00 con 0x5576762195d0 2024-09-19T06:18:15.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.129+0000 7fa5f1611640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557676224370 0x55767621c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:15.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.129+0000 7fa5f1611640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557676224370 0x55767621c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39410/0 (socket says 172.21.15.2:39410) 2024-09-19T06:18:15.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.129+0000 7fa5f1611640 1 -- 172.21.15.2:0/1314786587 learned_addr learned my addr 172.21.15.2:0/1314786587 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:15.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.129+0000 7fa5f1611640 1 --2- 172.21.15.2:0/1314786587 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5576762195d0 0x557676220940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:15.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.130+0000 7fa5f1e12640 1 --2- 172.21.15.2:0/1314786587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55767621ab40 0x55767621c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:15.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.130+0000 7fa5f1611640 1 -- 172.21.15.2:0/1314786587 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5576762195d0 msgr2=0x557676220940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:15.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.130+0000 7fa5f1611640 1 --2- 172.21.15.2:0/1314786587 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5576762195d0 0x557676220940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:15.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.130+0000 7fa5f1611640 1 -- 172.21.15.2:0/1314786587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55767621ab40 msgr2=0x55767621c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:15.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.130+0000 7fa5f1611640 1 --2- 172.21.15.2:0/1314786587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55767621ab40 0x55767621c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:15.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.130+0000 7fa5f1611640 1 -- 172.21.15.2:0/1314786587 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557676221b80 con 0x557676224370 2024-09-19T06:18:15.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.130+0000 7fa5f1611640 1 --2- 172.21.15.2:0/1314786587 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557676224370 0x55767621c660 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc02a990 tx=0x7fa5dc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0541a5381cb18b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:15.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.130+0000 7fa5d77fe640 1 -- 172.21.15.2:0/1314786587 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc035040 con 0x557676224370 2024-09-19T06:18:15.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.130+0000 7fa5d77fe640 1 -- 172.21.15.2:0/1314786587 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa5dc0054d0 con 0x557676224370 2024-09-19T06:18:15.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.130+0000 7fa5d77fe640 1 -- 172.21.15.2:0/1314786587 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc004b70 con 0x557676224370 2024-09-19T06:18:15.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.131+0000 7fa5f644f740 1 -- 172.21.15.2:0/1314786587 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557676224370 msgr2=0x55767621c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:15.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.131+0000 7fa5f644f740 1 --2- 172.21.15.2:0/1314786587 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557676224370 0x55767621c660 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc02a990 tx=0x7fa5dc000bc0 comp rx=0 tx=0).stop 2024-09-19T06:18:15.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.131+0000 7fa5f644f740 1 -- 172.21.15.2:0/1314786587 shutdown_connections 2024-09-19T06:18:15.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.131+0000 7fa5f644f740 1 --2- 172.21.15.2:0/1314786587 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557676224370 0x55767621c660 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:15.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.131+0000 7fa5f644f740 1 --2- 172.21.15.2:0/1314786587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55767621ab40 0x55767621c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:15.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.131+0000 7fa5f644f740 1 --2- 172.21.15.2:0/1314786587 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5576762195d0 0x557676220940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:15.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.131+0000 7fa5f644f740 1 -- 172.21.15.2:0/1314786587 >> 172.21.15.2:0/1314786587 conn(0x5576761e2310 msgr2=0x557676220170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:15.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.131+0000 7fa5f644f740 1 -- 172.21.15.2:0/1314786587 shutdown_connections 2024-09-19T06:18:15.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.131+0000 7fa5f644f740 1 -- 172.21.15.2:0/1314786587 wait complete. 2024-09-19T06:18:15.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.131+0000 7fa5f644f740 1 -- start start 2024-09-19T06:18:15.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.131+0000 7fa5f644f740 1 Processor -- start 2024-09-19T06:18:15.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.131+0000 7fa5f644f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5576762195d0 0x55767622ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:15.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.131+0000 7fa5f644f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55767621ab40 0x557676227d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:15.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.131+0000 7fa5f644f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576762340c0 0x557676228260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:15.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.132+0000 7fa5f644f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ec1b2270 con 0x5576762340c0 2024-09-19T06:18:15.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.132+0000 7fa5f644f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ec1b36e0 con 0x5576762195d0 2024-09-19T06:18:15.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.132+0000 7fa5f644f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ec1b2940 con 0x55767621ab40 2024-09-19T06:18:15.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.132+0000 7fa5f644f740 10 client.0 _ll_register_callbacks cb 0x7fa5e800aca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:15.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.132+0000 7fa5f1611640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5576762195d0 0x55767622ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:15.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.132+0000 7fa5f1611640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5576762195d0 0x55767622ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:55016/0 (socket says 172.21.15.2:55016) 2024-09-19T06:18:15.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.132+0000 7fa5f1611640 1 -- 172.21.15.2:0/3051632502 learned_addr learned my addr 172.21.15.2:0/3051632502 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:15.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.132+0000 7fa5f1611640 1 --2- 172.21.15.2:0/3051632502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576762340c0 0x557676228260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:15.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.132+0000 7fa5f1e12640 1 --2- 172.21.15.2:0/3051632502 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55767621ab40 0x557676227d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:15.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.132+0000 7fa5f1611640 1 -- 172.21.15.2:0/3051632502 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55767621ab40 msgr2=0x557676227d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:15.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.132+0000 7fa5f1611640 1 --2- 172.21.15.2:0/3051632502 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55767621ab40 0x557676227d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:15.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.132+0000 7fa5f1611640 1 -- 172.21.15.2:0/3051632502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576762340c0 msgr2=0x557676228260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:15.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.132+0000 7fa5f1611640 1 --2- 172.21.15.2:0/3051632502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576762340c0 0x557676228260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:15.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.132+0000 7fa5f1611640 1 -- 172.21.15.2:0/3051632502 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557676228a90 con 0x5576762195d0 2024-09-19T06:18:15.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.132+0000 7fa5f1611640 1 --2- 172.21.15.2:0/3051632502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5576762195d0 0x55767622ca40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc02a990 tx=0x7fa5dc02a470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74aef7dbc36af987 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:15.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.132+0000 7fa5d57fa640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-09-19T06:18:15.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.132+0000 7fa5d57fa640 1 -- 172.21.15.2:0/3051632502 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc035040 con 0x5576762195d0 2024-09-19T06:18:15.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.132+0000 7fa5f644f740 1 -- 172.21.15.2:0/3051632502 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5dc0054d0 con 0x5576762195d0 2024-09-19T06:18:15.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.132+0000 7fa5d57fa640 1 -- 172.21.15.2:0/3051632502 <== mon.2 v2:172.21.15.89:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fa5dc005110 con 0x5576762195d0 2024-09-19T06:18:15.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.133+0000 7fa5d57fa640 1 -- 172.21.15.2:0/3051632502 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa5dc005310 con 0x5576762195d0 2024-09-19T06:18:15.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.133+0000 7fa5f644f740 10 client.25694 fetch_fsmap learned FSMap version 26 2024-09-19T06:18:15.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.133+0000 7fa5f644f740 1 -- 172.21.15.2:0/3051632502 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55767629eca0 con 0x5576762195d0 2024-09-19T06:18:15.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.133+0000 7fa5d57fa640 1 -- 172.21.15.2:0/3051632502 <== mon.2 v2:172.21.15.89:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa5dc0054d0 con 0x5576762195d0 2024-09-19T06:18:15.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.133+0000 7fa5d57fa640 1 -- 172.21.15.2:0/3051632502 <== mon.2 v2:172.21.15.89:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fa5dc0035f0 con 0x5576762195d0 2024-09-19T06:18:15.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.133+0000 7fa5f644f740 10 client.25694 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:18:15.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.133+0000 7fa5f644f740 10 client.25694 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:18:15.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.133+0000 7fa5f644f740 20 client.25694 populate_metadata read hostname 'smithi002' 2024-09-19T06:18:15.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.133+0000 7fa5f644f740 1 --2- 172.21.15.2:0/3051632502 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55767629eed0 0x5576762a12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:15.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.133+0000 7fa5f644f740 4 client.25694 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:18:15.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.133+0000 7fa5f644f740 1 -- 172.21.15.2:0/3051632502 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557676186d70 con 0x55767629eed0 2024-09-19T06:18:15.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.133+0000 7fa5f1e12640 1 --2- 172.21.15.2:0/3051632502 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55767629eed0 0x5576762a12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:15.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.134+0000 7fa5d57fa640 10 client.25694 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:18:15.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.134+0000 7fa5f1e12640 1 --2- 172.21.15.2:0/3051632502 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55767629eed0 0x5576762a12c0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=302d7a94b2e02124 server_cookie=5addfb3f5bbd82a9 in_seq=0 out_seq=0 2024-09-19T06:18:15.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.134+0000 7fa5d57fa640 1 -- 172.21.15.2:0/3051632502 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557676186d70 con 0x55767629eed0 2024-09-19T06:18:15.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.134+0000 7fa5d57fa640 10 client.25694 handle_command_reply: tid=0 2024-09-19T06:18:15.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.134+0000 7fa5f644f740 1 client.25694 shutdown 2024-09-19T06:18:15.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.134+0000 7fa5f644f740 1 -- 172.21.15.2:0/3051632502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5576762195d0 msgr2=0x55767622ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:15.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.134+0000 7fa5f644f740 1 --2- 172.21.15.2:0/3051632502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5576762195d0 0x55767622ca40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc02a990 tx=0x7fa5dc02a470 comp rx=0 tx=0).stop 2024-09-19T06:18:15.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.134+0000 7fa5f644f740 1 -- 172.21.15.2:0/3051632502 shutdown_connections 2024-09-19T06:18:15.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.134+0000 7fa5f644f740 1 --2- 172.21.15.2:0/3051632502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576762340c0 0x557676228260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:15.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.134+0000 7fa5f644f740 1 --2- 172.21.15.2:0/3051632502 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55767621ab40 0x557676227d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:15.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.134+0000 7fa5f644f740 1 --2- 172.21.15.2:0/3051632502 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55767629eed0 0x5576762a12c0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:15.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.134+0000 7fa5f644f740 1 --2- 172.21.15.2:0/3051632502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5576762195d0 0x55767622ca40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:15.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.134+0000 7fa5d57fa640 0 client.25694 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:18:15.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.134+0000 7fa5f644f740 1 -- 172.21.15.2:0/3051632502 >> 172.21.15.2:0/3051632502 conn(0x5576761e2310 msgr2=0x5576762228e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:15.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.134+0000 7fa5f644f740 1 -- 172.21.15.2:0/3051632502 shutdown_connections 2024-09-19T06:18:15.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.134+0000 7fa5f644f740 1 -- 172.21.15.2:0/3051632502 wait complete. 2024-09-19T06:18:15.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.134+0000 7fa5f644f740 20 client.25694 trim_cache size 0 max 16384 2024-09-19T06:18:15.143 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:18:15.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.135+0000 7fa5f4076640 1 -- 172.21.15.2:0/3157309237 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa5d80a3430 msgr2=0x7fa5d80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:15.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.135+0000 7fa5f4076640 1 --2- 172.21.15.2:0/3157309237 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa5d80a3430 0x7fa5d80a58f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa5e409c320 tx=0x7fa5e406e3a0 comp rx=0 tx=0).stop 2024-09-19T06:18:15.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.135+0000 7fa5f4076640 1 -- 172.21.15.2:0/3157309237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5ec105f40 msgr2=0x7fa5ec19e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:15.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.135+0000 7fa5f4076640 1 --2- 172.21.15.2:0/3157309237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5ec105f40 0x7fa5ec19e740 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fa5e400cab0 tx=0x7fa5e400cf70 comp rx=0 tx=0).stop 2024-09-19T06:18:15.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.135+0000 7fa5f4076640 1 -- 172.21.15.2:0/3157309237 shutdown_connections 2024-09-19T06:18:15.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.135+0000 7fa5f4076640 1 --2- 172.21.15.2:0/3157309237 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa5d80a3430 0x7fa5d80a58f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:15.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.135+0000 7fa5f4076640 1 --2- 172.21.15.2:0/3157309237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5ec105f40 0x7fa5ec19e740 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:15.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.135+0000 7fa5f4076640 1 --2- 172.21.15.2:0/3157309237 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5ec101450 0x7fa5ec1a4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:15.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.135+0000 7fa5f4076640 1 --2- 172.21.15.2:0/3157309237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5ec100b30 0x7fa5ec1a4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:15.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.135+0000 7fa5f4076640 1 -- 172.21.15.2:0/3157309237 >> 172.21.15.2:0/3157309237 conn(0x7fa5ec0fc7a0 msgr2=0x7fa5ec1038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:15.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.135+0000 7fa5f4076640 1 -- 172.21.15.2:0/3157309237 shutdown_connections 2024-09-19T06:18:15.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:15.135+0000 7fa5f4076640 1 -- 172.21.15.2:0/3157309237 wait complete. 2024-09-19T06:18:15.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:15 smithi002 ceph-mon[30982]: pgmap v106: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T06:18:15.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:15 smithi090 ceph-mon[34497]: pgmap v106: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T06:18:15.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:15 smithi089 ceph-mon[34160]: pgmap v106: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T06:18:16.935 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:18:16.936 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:18:17.204 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:18:17.652 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:17 smithi002 ceph-mon[30982]: pgmap v107: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T06:18:17.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.649+0000 7fa54e0cc640 1 -- 172.21.15.2:0/1311119333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa548102d40 msgr2=0x7fa548103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:17.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.649+0000 7fa54e0cc640 1 --2- 172.21.15.2:0/1311119333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa548102d40 0x7fa548103120 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa538009900 tx=0x7fa53802a480 comp rx=0 tx=0).stop 2024-09-19T06:18:17.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.649+0000 7fa54e0cc640 1 -- 172.21.15.2:0/1311119333 shutdown_connections 2024-09-19T06:18:17.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.649+0000 7fa54e0cc640 1 --2- 172.21.15.2:0/1311119333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa54810c170 0x7fa54810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:17.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.649+0000 7fa54e0cc640 1 --2- 172.21.15.2:0/1311119333 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa548103660 0x7fa54810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:17.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.649+0000 7fa54e0cc640 1 --2- 172.21.15.2:0/1311119333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa548102d40 0x7fa548103120 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:17.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.649+0000 7fa54e0cc640 1 -- 172.21.15.2:0/1311119333 >> 172.21.15.2:0/1311119333 conn(0x7fa5480fc7a0 msgr2=0x7fa5480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:17.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.649+0000 7fa54e0cc640 1 -- 172.21.15.2:0/1311119333 shutdown_connections 2024-09-19T06:18:17.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.649+0000 7fa54e0cc640 1 -- 172.21.15.2:0/1311119333 wait complete. 2024-09-19T06:18:17.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.650+0000 7fa54e0cc640 1 Processor -- start 2024-09-19T06:18:17.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.650+0000 7fa54e0cc640 1 -- start start 2024-09-19T06:18:17.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.650+0000 7fa54e0cc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa548102d40 0x7fa5481009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:17.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.650+0000 7fa54e0cc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa548103660 0x7fa548100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:17.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.650+0000 7fa54e0cc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa54810c170 0x7fa548101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:17.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.650+0000 7fa54e0cc640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa548111e20 con 0x7fa548102d40 2024-09-19T06:18:17.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.650+0000 7fa54e0cc640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa548111ca0 con 0x7fa548103660 2024-09-19T06:18:17.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.650+0000 7fa54e0cc640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa548111fa0 con 0x7fa54810c170 2024-09-19T06:18:17.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.651+0000 7fa5477fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa548102d40 0x7fa5481009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:17.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.651+0000 7fa5477fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa548102d40 0x7fa5481009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45330/0 (socket says 172.21.15.2:45330) 2024-09-19T06:18:17.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.651+0000 7fa5477fe640 1 -- 172.21.15.2:0/3787071381 learned_addr learned my addr 172.21.15.2:0/3787071381 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:17.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.651+0000 7fa547fff640 1 --2- 172.21.15.2:0/3787071381 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa54810c170 0x7fa548101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:17.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.651+0000 7fa546ffd640 1 --2- 172.21.15.2:0/3787071381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa548103660 0x7fa548100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:17.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.651+0000 7fa5477fe640 1 -- 172.21.15.2:0/3787071381 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa54810c170 msgr2=0x7fa548101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:17.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.651+0000 7fa5477fe640 1 --2- 172.21.15.2:0/3787071381 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa54810c170 0x7fa548101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:17.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.651+0000 7fa5477fe640 1 -- 172.21.15.2:0/3787071381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa548103660 msgr2=0x7fa548100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:17.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.651+0000 7fa5477fe640 1 --2- 172.21.15.2:0/3787071381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa548103660 0x7fa548100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:17.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.651+0000 7fa5477fe640 1 -- 172.21.15.2:0/3787071381 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5481a6860 con 0x7fa548102d40 2024-09-19T06:18:17.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.651+0000 7fa5477fe640 1 --2- 172.21.15.2:0/3787071381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa548102d40 0x7fa5481009a0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fa538005940 tx=0x7fa538004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:17.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.651+0000 7fa544ff9640 1 -- 172.21.15.2:0/3787071381 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53803f030 con 0x7fa548102d40 2024-09-19T06:18:17.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.651+0000 7fa544ff9640 1 -- 172.21.15.2:0/3787071381 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa538003aa0 con 0x7fa548102d40 2024-09-19T06:18:17.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.651+0000 7fa54e0cc640 1 -- 172.21.15.2:0/3787071381 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5481a6af0 con 0x7fa548102d40 2024-09-19T06:18:17.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.651+0000 7fa544ff9640 1 -- 172.21.15.2:0/3787071381 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa538035070 con 0x7fa548102d40 2024-09-19T06:18:17.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.651+0000 7fa54e0cc640 1 -- 172.21.15.2:0/3787071381 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5481a6fd0 con 0x7fa548102d40 2024-09-19T06:18:17.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.653+0000 7fa544ff9640 1 -- 172.21.15.2:0/3787071381 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fa538042030 con 0x7fa548102d40 2024-09-19T06:18:17.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.654+0000 7fa5504a5740 1 Processor -- start 2024-09-19T06:18:17.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.654+0000 7fa5504a5740 1 -- start start 2024-09-19T06:18:17.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.654+0000 7fa5504a5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6bfe6bb60 0x55f6bfe6bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:17.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.654+0000 7fa5504a5740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f6bfe6c480 0x55f6bfe76800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:17.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.654+0000 7fa5504a5740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6bfe76d40 0x55f6bfe79130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:17.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.654+0000 7fa5504a5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f6bfdd1280 con 0x55f6bfe6bb60 2024-09-19T06:18:17.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.654+0000 7fa5504a5740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55f6bfd78b10 con 0x55f6bfe6c480 2024-09-19T06:18:17.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.654+0000 7fa5504a5740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f6bfdcd240 con 0x55f6bfe76d40 2024-09-19T06:18:17.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.654+0000 7fa547fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6bfe6bb60 0x55f6bfe6bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:17.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.654+0000 7fa544ff9640 1 --2- 172.21.15.2:0/3787071381 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa5300a33b0 0x7fa5300a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:17.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.654+0000 7fa547fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6bfe6bb60 0x55f6bfe6bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45334/0 (socket says 172.21.15.2:45334) 2024-09-19T06:18:17.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.654+0000 7fa547fff640 1 -- 172.21.15.2:0/1078720579 learned_addr learned my addr 172.21.15.2:0/1078720579 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:17.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.655+0000 7fa546ffd640 1 --2- 172.21.15.2:0/1078720579 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6bfe76d40 0x55f6bfe79130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:17.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.655+0000 7fa5477fe640 1 --2- 172.21.15.2:0/1078720579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f6bfe6c480 0x55f6bfe76800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:17.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.655+0000 7fa547fff640 1 --2- 172.21.15.2:0/3787071381 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa5300a33b0 0x7fa5300a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:17.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.655+0000 7fa547fff640 1 -- 172.21.15.2:0/1078720579 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6bfe76d40 msgr2=0x55f6bfe79130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:17.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.655+0000 7fa547fff640 1 --2- 172.21.15.2:0/1078720579 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6bfe76d40 0x55f6bfe79130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:17.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.655+0000 7fa547fff640 1 -- 172.21.15.2:0/1078720579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f6bfe6c480 msgr2=0x55f6bfe76800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:17.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.655+0000 7fa547fff640 1 --2- 172.21.15.2:0/1078720579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f6bfe6c480 0x55f6bfe76800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:17.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.655+0000 7fa547fff640 1 -- 172.21.15.2:0/1078720579 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6bfd851f0 con 0x55f6bfe6bb60 2024-09-19T06:18:17.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.655+0000 7fa5477fe640 1 --2- 172.21.15.2:0/1078720579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f6bfe6c480 0x55f6bfe76800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:18:17.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.655+0000 7fa544ff9640 1 -- 172.21.15.2:0/3787071381 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fa5380f0450 con 0x7fa548102d40 2024-09-19T06:18:17.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.655+0000 7fa547fff640 1 --2- 172.21.15.2:0/1078720579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6bfe6bb60 0x55f6bfe6bf40 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa540014a60 tx=0x7fa540014f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bcec695796497f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:17.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.655+0000 7fa52dffb640 1 -- 172.21.15.2:0/1078720579 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54001ec50 con 0x55f6bfe6bb60 2024-09-19T06:18:17.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.655+0000 7fa52dffb640 1 -- 172.21.15.2:0/1078720579 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa540023070 con 0x55f6bfe6bb60 2024-09-19T06:18:17.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.655+0000 7fa52dffb640 1 -- 172.21.15.2:0/1078720579 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa540005540 con 0x55f6bfe6bb60 2024-09-19T06:18:17.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.656+0000 7fa5504a5740 1 -- 172.21.15.2:0/1078720579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6bfe6bb60 msgr2=0x55f6bfe6bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:17.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.656+0000 7fa547fff640 1 --2- 172.21.15.2:0/3787071381 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa5300a33b0 0x7fa5300a5870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa540022000 tx=0x7fa54001e000 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:17.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.656+0000 7fa5504a5740 1 --2- 172.21.15.2:0/1078720579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6bfe6bb60 0x55f6bfe6bf40 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa540014a60 tx=0x7fa540014f20 comp rx=0 tx=0).stop 2024-09-19T06:18:17.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.656+0000 7fa5504a5740 1 -- 172.21.15.2:0/1078720579 shutdown_connections 2024-09-19T06:18:17.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.656+0000 7fa5504a5740 1 --2- 172.21.15.2:0/1078720579 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6bfe76d40 0x55f6bfe79130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:17.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.656+0000 7fa5504a5740 1 --2- 172.21.15.2:0/1078720579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f6bfe6c480 0x55f6bfe76800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:17.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.656+0000 7fa5504a5740 1 --2- 172.21.15.2:0/1078720579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6bfe6bb60 0x55f6bfe6bf40 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:17.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.656+0000 7fa5504a5740 1 -- 172.21.15.2:0/1078720579 >> 172.21.15.2:0/1078720579 conn(0x55f6bfe680f0 msgr2=0x55f6bfe684d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:17.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.656+0000 7fa5504a5740 1 -- 172.21.15.2:0/1078720579 shutdown_connections 2024-09-19T06:18:17.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.656+0000 7fa5504a5740 1 -- 172.21.15.2:0/1078720579 wait complete. 2024-09-19T06:18:17.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.657+0000 7fa5504a5740 1 -- start start 2024-09-19T06:18:17.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.657+0000 7fa5504a5740 1 Processor -- start 2024-09-19T06:18:17.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.657+0000 7fa5504a5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6bfe6bb60 0x55f6bfe73c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:17.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.657+0000 7fa5504a5740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f6bfe6c480 0x55f6bfe74150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:17.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.657+0000 7fa5504a5740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6bfe76d40 0x55f6bfe74690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:17.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.657+0000 7fa5504a5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f6bfe79910 con 0x55f6bfe6bb60 2024-09-19T06:18:17.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.657+0000 7fa5504a5740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55f6bfd8bf10 con 0x55f6bfe6c480 2024-09-19T06:18:17.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.657+0000 7fa5504a5740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f6bfe79a90 con 0x55f6bfe76d40 2024-09-19T06:18:17.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.657+0000 7fa5504a5740 10 client.0 _ll_register_callbacks cb 0x55f6bfd54a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:17.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.657+0000 7fa5477fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6bfe6bb60 0x55f6bfe73c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:17.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.657+0000 7fa5477fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6bfe6bb60 0x55f6bfe73c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45336/0 (socket says 172.21.15.2:45336) 2024-09-19T06:18:17.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.657+0000 7fa5477fe640 1 -- 172.21.15.2:0/306010304 learned_addr learned my addr 172.21.15.2:0/306010304 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:17.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.657+0000 7fa547fff640 1 --2- 172.21.15.2:0/306010304 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6bfe76d40 0x55f6bfe74690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:17.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.657+0000 7fa546ffd640 1 --2- 172.21.15.2:0/306010304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f6bfe6c480 0x55f6bfe74150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:17.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.658+0000 7fa5477fe640 1 -- 172.21.15.2:0/306010304 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6bfe76d40 msgr2=0x55f6bfe74690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:17.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.658+0000 7fa5477fe640 1 --2- 172.21.15.2:0/306010304 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6bfe76d40 0x55f6bfe74690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:17.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.658+0000 7fa5477fe640 1 -- 172.21.15.2:0/306010304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f6bfe6c480 msgr2=0x55f6bfe74150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:17.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.658+0000 7fa5477fe640 1 --2- 172.21.15.2:0/306010304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f6bfe6c480 0x55f6bfe74150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:17.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.658+0000 7fa5477fe640 1 -- 172.21.15.2:0/306010304 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6bfb426a0 con 0x55f6bfe6bb60 2024-09-19T06:18:17.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.658+0000 7fa546ffd640 1 --2- 172.21.15.2:0/306010304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f6bfe6c480 0x55f6bfe74150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:18:17.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.658+0000 7fa5477fe640 1 --2- 172.21.15.2:0/306010304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6bfe6bb60 0x55f6bfe73c10 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fa5380b8c10 tx=0x7fa53808b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4d8e6d284d3db2a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:17.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.658+0000 7fa526ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:18:17.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.658+0000 7fa526ffd640 1 -- 172.21.15.2:0/306010304 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa538049070 con 0x55f6bfe6bb60 2024-09-19T06:18:17.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.658+0000 7fa526ffd640 1 -- 172.21.15.2:0/306010304 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fa538003c50 con 0x55f6bfe6bb60 2024-09-19T06:18:17.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.658+0000 7fa5504a5740 1 -- 172.21.15.2:0/306010304 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa540023070 con 0x55f6bfe6bb60 2024-09-19T06:18:17.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.658+0000 7fa526ffd640 1 -- 172.21.15.2:0/306010304 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa5380b70b0 con 0x55f6bfe6bb60 2024-09-19T06:18:17.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.658+0000 7fa5504a5740 10 client.16182 fetch_fsmap learned FSMap version 26 2024-09-19T06:18:17.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.658+0000 7fa5504a5740 1 -- 172.21.15.2:0/306010304 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f6bfe85510 con 0x55f6bfe6bb60 2024-09-19T06:18:17.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.658+0000 7fa526ffd640 1 -- 172.21.15.2:0/306010304 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa540023070 con 0x55f6bfe6bb60 2024-09-19T06:18:17.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.658+0000 7fa526ffd640 1 -- 172.21.15.2:0/306010304 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fa5380b8e20 con 0x55f6bfe6bb60 2024-09-19T06:18:17.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.658+0000 7fa5504a5740 10 client.16182 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:18:17.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.658+0000 7fa5504a5740 10 client.16182 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:18:17.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.658+0000 7fa5504a5740 20 client.16182 populate_metadata read hostname 'smithi002' 2024-09-19T06:18:17.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.658+0000 7fa5504a5740 1 --2- 172.21.15.2:0/306010304 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55f6bfe86900 0x55f6bfe88d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:17.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.659+0000 7fa5504a5740 4 client.16182 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:18:17.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.659+0000 7fa5504a5740 1 -- 172.21.15.2:0/306010304 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f6bfdde7f0 con 0x55f6bfe86900 2024-09-19T06:18:17.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.659+0000 7fa546ffd640 1 --2- 172.21.15.2:0/306010304 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55f6bfe86900 0x55f6bfe88d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:17.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.659+0000 7fa526ffd640 10 client.16182 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:18:17.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.659+0000 7fa546ffd640 1 --2- 172.21.15.2:0/306010304 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55f6bfe86900 0x55f6bfe88d50 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a612b967969e98 server_cookie=1b755d07fe885a21 in_seq=0 out_seq=0 2024-09-19T06:18:17.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.660+0000 7fa526ffd640 1 -- 172.21.15.2:0/306010304 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f6bfdde7f0 con 0x55f6bfe86900 2024-09-19T06:18:17.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.660+0000 7fa526ffd640 10 client.16182 handle_command_reply: tid=0 2024-09-19T06:18:17.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.660+0000 7fa5504a5740 1 client.16182 shutdown 2024-09-19T06:18:17.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.660+0000 7fa5504a5740 1 -- 172.21.15.2:0/306010304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6bfe6bb60 msgr2=0x55f6bfe73c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:17.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.660+0000 7fa5504a5740 1 --2- 172.21.15.2:0/306010304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6bfe6bb60 0x55f6bfe73c10 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fa5380b8c10 tx=0x7fa53808b4a0 comp rx=0 tx=0).stop 2024-09-19T06:18:17.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.661+0000 7fa5504a5740 1 -- 172.21.15.2:0/306010304 shutdown_connections 2024-09-19T06:18:17.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.661+0000 7fa5504a5740 1 --2- 172.21.15.2:0/306010304 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6bfe76d40 0x55f6bfe74690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:17.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.661+0000 7fa5504a5740 1 --2- 172.21.15.2:0/306010304 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55f6bfe86900 0x55f6bfe88d50 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:17.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.661+0000 7fa5504a5740 1 --2- 172.21.15.2:0/306010304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f6bfe6c480 0x55f6bfe74150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:17.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.661+0000 7fa5504a5740 1 --2- 172.21.15.2:0/306010304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6bfe6bb60 0x55f6bfe73c10 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:17.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.661+0000 7fa526ffd640 0 client.16182 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:18:17.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.661+0000 7fa5504a5740 1 -- 172.21.15.2:0/306010304 >> 172.21.15.2:0/306010304 conn(0x55f6bfe680f0 msgr2=0x55f6bfe67270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:17.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.661+0000 7fa5504a5740 1 -- 172.21.15.2:0/306010304 shutdown_connections 2024-09-19T06:18:17.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.661+0000 7fa5504a5740 1 -- 172.21.15.2:0/306010304 wait complete. 2024-09-19T06:18:17.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.661+0000 7fa5504a5740 20 client.16182 trim_cache size 0 max 16384 2024-09-19T06:18:17.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.678+0000 7fa5504a5740 1 Processor -- start 2024-09-19T06:18:17.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.678+0000 7fa5504a5740 1 -- start start 2024-09-19T06:18:17.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.678+0000 7fa5504a5740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6bfe6bb60 0x55f6bfe8e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:17.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.678+0000 7fa5504a5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6bfe6c480 0x55f6bfe8eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:17.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.678+0000 7fa5504a5740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f6bfe76d40 0x55f6bfe6d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:17.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.678+0000 7fa5504a5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa5481b2170 con 0x55f6bfe6c480 2024-09-19T06:18:17.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.678+0000 7fa5504a5740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa5481afa40 con 0x55f6bfe76d40 2024-09-19T06:18:17.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.678+0000 7fa5504a5740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa5481ad890 con 0x55f6bfe6bb60 2024-09-19T06:18:17.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.679+0000 7fa546ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6bfe6c480 0x55f6bfe8eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:17.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.679+0000 7fa546ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6bfe6c480 0x55f6bfe8eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45350/0 (socket says 172.21.15.2:45350) 2024-09-19T06:18:17.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.679+0000 7fa546ffd640 1 -- 172.21.15.2:0/1750817934 learned_addr learned my addr 172.21.15.2:0/1750817934 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:17.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.679+0000 7fa547fff640 1 --2- 172.21.15.2:0/1750817934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f6bfe76d40 0x55f6bfe6d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:17.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.679+0000 7fa5477fe640 1 --2- 172.21.15.2:0/1750817934 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6bfe6bb60 0x55f6bfe8e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:17.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.679+0000 7fa546ffd640 1 -- 172.21.15.2:0/1750817934 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6bfe6bb60 msgr2=0x55f6bfe8e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:17.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.679+0000 7fa546ffd640 1 --2- 172.21.15.2:0/1750817934 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6bfe6bb60 0x55f6bfe8e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:17.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.679+0000 7fa546ffd640 1 -- 172.21.15.2:0/1750817934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f6bfe76d40 msgr2=0x55f6bfe6d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:17.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.679+0000 7fa546ffd640 1 --2- 172.21.15.2:0/1750817934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f6bfe76d40 0x55f6bfe6d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:17.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.679+0000 7fa546ffd640 1 -- 172.21.15.2:0/1750817934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6bfe67f20 con 0x55f6bfe6c480 2024-09-19T06:18:17.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.679+0000 7fa5477fe640 1 --2- 172.21.15.2:0/1750817934 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6bfe6bb60 0x55f6bfe8e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:18:17.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.679+0000 7fa547fff640 1 --2- 172.21.15.2:0/1750817934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f6bfe76d40 0x55f6bfe6d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:18:17.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.679+0000 7fa546ffd640 1 --2- 172.21.15.2:0/1750817934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6bfe6c480 0x55f6bfe8eb60 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fa548102430 tx=0x7fa53c00b2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6781b48bcae3453d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:17.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.679+0000 7fa52d7fa640 1 -- 172.21.15.2:0/1750817934 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53c003ea0 con 0x55f6bfe6c480 2024-09-19T06:18:17.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.679+0000 7fa52d7fa640 1 -- 172.21.15.2:0/1750817934 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa53c0054d0 con 0x55f6bfe6c480 2024-09-19T06:18:17.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.679+0000 7fa52d7fa640 1 -- 172.21.15.2:0/1750817934 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53c0116a0 con 0x55f6bfe6c480 2024-09-19T06:18:17.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.680+0000 7fa5504a5740 1 -- 172.21.15.2:0/1750817934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6bfe6c480 msgr2=0x55f6bfe8eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:17.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.680+0000 7fa5504a5740 1 --2- 172.21.15.2:0/1750817934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6bfe6c480 0x55f6bfe8eb60 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fa548102430 tx=0x7fa53c00b2e0 comp rx=0 tx=0).stop 2024-09-19T06:18:17.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.680+0000 7fa5504a5740 1 -- 172.21.15.2:0/1750817934 shutdown_connections 2024-09-19T06:18:17.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.680+0000 7fa5504a5740 1 --2- 172.21.15.2:0/1750817934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f6bfe76d40 0x55f6bfe6d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:17.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.680+0000 7fa5504a5740 1 --2- 172.21.15.2:0/1750817934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6bfe6c480 0x55f6bfe8eb60 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:17.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.680+0000 7fa5504a5740 1 --2- 172.21.15.2:0/1750817934 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6bfe6bb60 0x55f6bfe8e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:17.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.680+0000 7fa5504a5740 1 -- 172.21.15.2:0/1750817934 >> 172.21.15.2:0/1750817934 conn(0x55f6bfe680f0 msgr2=0x55f6bfe72d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:17.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.680+0000 7fa5504a5740 1 -- 172.21.15.2:0/1750817934 shutdown_connections 2024-09-19T06:18:17.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.680+0000 7fa5504a5740 1 -- 172.21.15.2:0/1750817934 wait complete. 2024-09-19T06:18:17.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.681+0000 7fa5504a5740 1 -- start start 2024-09-19T06:18:17.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.681+0000 7fa5504a5740 1 Processor -- start 2024-09-19T06:18:17.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.681+0000 7fa5504a5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6bfe6bb60 0x55f6bfe7f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:17.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.681+0000 7fa5504a5740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6bfe6c480 0x55f6bfe7a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:17.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.681+0000 7fa5504a5740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f6bfe76d40 0x55f6bfe7af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:17.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.681+0000 7fa5504a5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa5481adf00 con 0x55f6bfe6bb60 2024-09-19T06:18:17.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.681+0000 7fa5504a5740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa5481af370 con 0x55f6bfe76d40 2024-09-19T06:18:17.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.681+0000 7fa5504a5740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa5481ae5d0 con 0x55f6bfe6c480 2024-09-19T06:18:17.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.681+0000 7fa5477fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6bfe6bb60 0x55f6bfe7f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:17.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.681+0000 7fa5477fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6bfe6bb60 0x55f6bfe7f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45352/0 (socket says 172.21.15.2:45352) 2024-09-19T06:18:17.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.681+0000 7fa5477fe640 1 -- 172.21.15.2:0/3990231755 learned_addr learned my addr 172.21.15.2:0/3990231755 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:17.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.681+0000 7fa5504a5740 10 client.0 _ll_register_callbacks cb 0x7fa5380b83f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:17.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.682+0000 7fa547fff640 1 --2- 172.21.15.2:0/3990231755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f6bfe76d40 0x55f6bfe7af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:17.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.682+0000 7fa546ffd640 1 --2- 172.21.15.2:0/3990231755 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6bfe6c480 0x55f6bfe7a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:17.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.682+0000 7fa5477fe640 1 -- 172.21.15.2:0/3990231755 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6bfe6c480 msgr2=0x55f6bfe7a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:17.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.682+0000 7fa5477fe640 1 --2- 172.21.15.2:0/3990231755 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6bfe6c480 0x55f6bfe7a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:17.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.682+0000 7fa5477fe640 1 -- 172.21.15.2:0/3990231755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f6bfe76d40 msgr2=0x55f6bfe7af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:17.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.682+0000 7fa5477fe640 1 --2- 172.21.15.2:0/3990231755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f6bfe76d40 0x55f6bfe7af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:17.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.682+0000 7fa5477fe640 1 -- 172.21.15.2:0/3990231755 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6bfe62680 con 0x55f6bfe6bb60 2024-09-19T06:18:17.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.682+0000 7fa5477fe640 1 --2- 172.21.15.2:0/3990231755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6bfe6bb60 0x55f6bfe7f550 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fa5380bc4b0 tx=0x7fa538009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27afb3d2e1cfa000 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:17.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.682+0000 7fa526ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:18:17.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.682+0000 7fa526ffd640 1 -- 172.21.15.2:0/3990231755 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa538049040 con 0x55f6bfe6bb60 2024-09-19T06:18:17.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.682+0000 7fa526ffd640 1 -- 172.21.15.2:0/3990231755 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fa5380b8e20 con 0x55f6bfe6bb60 2024-09-19T06:18:17.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.682+0000 7fa5504a5740 1 -- 172.21.15.2:0/3990231755 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa53c0054d0 con 0x55f6bfe6bb60 2024-09-19T06:18:17.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.682+0000 7fa526ffd640 1 -- 172.21.15.2:0/3990231755 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa5380b8a50 con 0x55f6bfe6bb60 2024-09-19T06:18:17.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.682+0000 7fa5504a5740 10 client.16188 fetch_fsmap learned FSMap version 26 2024-09-19T06:18:17.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.682+0000 7fa5504a5740 1 -- 172.21.15.2:0/3990231755 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f6bfef14e0 con 0x55f6bfe6bb60 2024-09-19T06:18:17.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.683+0000 7fa526ffd640 1 -- 172.21.15.2:0/3990231755 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa53c0054d0 con 0x55f6bfe6bb60 2024-09-19T06:18:17.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.683+0000 7fa526ffd640 1 -- 172.21.15.2:0/3990231755 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fa5380bbc00 con 0x55f6bfe6bb60 2024-09-19T06:18:17.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.683+0000 7fa5504a5740 10 client.16188 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:18:17.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.683+0000 7fa5504a5740 10 client.16188 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:18:17.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.683+0000 7fa5504a5740 20 client.16188 populate_metadata read hostname 'smithi002' 2024-09-19T06:18:17.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.683+0000 7fa5504a5740 1 --2- 172.21.15.2:0/3990231755 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55f6bfef1a70 0x55f6bfef3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:17.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.683+0000 7fa5504a5740 4 client.16188 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:18:17.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.683+0000 7fa5504a5740 1 -- 172.21.15.2:0/3990231755 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f6bfdd8d00 con 0x55f6bfef1a70 2024-09-19T06:18:17.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.683+0000 7fa546ffd640 1 --2- 172.21.15.2:0/3990231755 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55f6bfef1a70 0x55f6bfef3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:17.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.684+0000 7fa546ffd640 1 --2- 172.21.15.2:0/3990231755 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55f6bfef1a70 0x55f6bfef3e60 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1f942f89f55dcca server_cookie=26d07ed8e92e60d7 in_seq=0 out_seq=0 2024-09-19T06:18:17.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.684+0000 7fa526ffd640 10 client.16188 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:18:17.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.685+0000 7fa526ffd640 1 -- 172.21.15.2:0/3990231755 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f6bfdd8d00 con 0x55f6bfef1a70 2024-09-19T06:18:17.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.685+0000 7fa526ffd640 10 client.16188 handle_command_reply: tid=0 2024-09-19T06:18:17.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.685+0000 7fa5504a5740 1 client.16188 shutdown 2024-09-19T06:18:17.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.685+0000 7fa5504a5740 1 -- 172.21.15.2:0/3990231755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6bfe6bb60 msgr2=0x55f6bfe7f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:17.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.685+0000 7fa5504a5740 1 --2- 172.21.15.2:0/3990231755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6bfe6bb60 0x55f6bfe7f550 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fa5380bc4b0 tx=0x7fa538009300 comp rx=0 tx=0).stop 2024-09-19T06:18:17.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.685+0000 7fa5504a5740 1 -- 172.21.15.2:0/3990231755 shutdown_connections 2024-09-19T06:18:17.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.685+0000 7fa5504a5740 1 --2- 172.21.15.2:0/3990231755 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55f6bfef1a70 0x55f6bfef3e60 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:17.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.685+0000 7fa5504a5740 1 --2- 172.21.15.2:0/3990231755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f6bfe76d40 0x55f6bfe7af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:17.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.685+0000 7fa5504a5740 1 --2- 172.21.15.2:0/3990231755 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f6bfe6c480 0x55f6bfe7a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:17.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.685+0000 7fa5504a5740 1 --2- 172.21.15.2:0/3990231755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f6bfe6bb60 0x55f6bfe7f550 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:17.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.685+0000 7fa526ffd640 0 client.16188 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:18:17.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.685+0000 7fa5504a5740 1 -- 172.21.15.2:0/3990231755 >> 172.21.15.2:0/3990231755 conn(0x55f6bfe680f0 msgr2=0x55f6bfe6d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:17.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.685+0000 7fa5504a5740 1 -- 172.21.15.2:0/3990231755 shutdown_connections 2024-09-19T06:18:17.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.685+0000 7fa5504a5740 1 -- 172.21.15.2:0/3990231755 wait complete. 2024-09-19T06:18:17.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.685+0000 7fa5504a5740 20 client.16188 trim_cache size 0 max 16384 2024-09-19T06:18:17.698 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:18:17.698 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T06:18:17.698 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "1396d934-4e76-47fe-8d2d-ef18f539b2a4", 2024-09-19T06:18:17.698 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T06:18:17.698 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:18:17.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.686+0000 7fa54e0cc640 1 -- 172.21.15.2:0/3787071381 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa5300a33b0 msgr2=0x7fa5300a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:17.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.686+0000 7fa54e0cc640 1 --2- 172.21.15.2:0/3787071381 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa5300a33b0 0x7fa5300a5870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa540022000 tx=0x7fa54001e000 comp rx=0 tx=0).stop 2024-09-19T06:18:17.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.686+0000 7fa54e0cc640 1 -- 172.21.15.2:0/3787071381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa548102d40 msgr2=0x7fa5481009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:17.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.686+0000 7fa54e0cc640 1 --2- 172.21.15.2:0/3787071381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa548102d40 0x7fa5481009a0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fa538005940 tx=0x7fa538004270 comp rx=0 tx=0).stop 2024-09-19T06:18:17.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.686+0000 7fa54e0cc640 1 -- 172.21.15.2:0/3787071381 shutdown_connections 2024-09-19T06:18:17.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.686+0000 7fa54e0cc640 1 --2- 172.21.15.2:0/3787071381 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa5300a33b0 0x7fa5300a5870 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:17.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.686+0000 7fa54e0cc640 1 --2- 172.21.15.2:0/3787071381 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa54810c170 0x7fa548101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:17.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.686+0000 7fa54e0cc640 1 --2- 172.21.15.2:0/3787071381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa548103660 0x7fa548100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:17.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.686+0000 7fa54e0cc640 1 --2- 172.21.15.2:0/3787071381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa548102d40 0x7fa5481009a0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:17.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.686+0000 7fa54e0cc640 1 -- 172.21.15.2:0/3787071381 >> 172.21.15.2:0/3787071381 conn(0x7fa5480fc7a0 msgr2=0x7fa5480fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:17.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.686+0000 7fa54e0cc640 1 -- 172.21.15.2:0/3787071381 shutdown_connections 2024-09-19T06:18:17.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:17.686+0000 7fa54e0cc640 1 -- 172.21.15.2:0/3787071381 wait complete. 2024-09-19T06:18:17.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:17 smithi090 ceph-mon[34497]: pgmap v107: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T06:18:17.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:17 smithi089 ceph-mon[34160]: pgmap v107: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T06:18:18.588 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:18:18.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:18 smithi002 ceph-mon[30982]: scrub queued for path: / 2024-09-19T06:18:18.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:18 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:18:18.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:18 smithi002 ceph-mon[30982]: scrub summary: active paths [/] 2024-09-19T06:18:18.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:18 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:18:18.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:18 smithi002 ceph-mon[30982]: scrub summary: idle 2024-09-19T06:18:18.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:18 smithi090 ceph-mon[34497]: scrub queued for path: / 2024-09-19T06:18:18.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:18 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:18:18.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:18 smithi090 ceph-mon[34497]: scrub summary: active paths [/] 2024-09-19T06:18:18.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:18 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:18:18.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:18 smithi090 ceph-mon[34497]: scrub summary: idle 2024-09-19T06:18:18.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:18 smithi089 ceph-mon[34160]: scrub queued for path: / 2024-09-19T06:18:18.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:18 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:18:18.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:18 smithi089 ceph-mon[34160]: scrub summary: active paths [/] 2024-09-19T06:18:18.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:18 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:18:18.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:18 smithi089 ceph-mon[34160]: scrub summary: idle 2024-09-19T06:18:18.847 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:18:19.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.332+0000 7fbcbe9f5640 1 -- 172.21.15.2:0/2276751581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcb8102790 msgr2=0x7fbcb81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:19.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.332+0000 7fbcbe9f5640 1 --2- 172.21.15.2:0/2276751581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcb8102790 0x7fbcb81067e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fbcac009900 tx=0x7fbcac02a3f0 comp rx=0 tx=0).stop 2024-09-19T06:18:19.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.332+0000 7fbcbe9f5640 1 -- 172.21.15.2:0/2276751581 shutdown_connections 2024-09-19T06:18:19.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.332+0000 7fbcbe9f5640 1 --2- 172.21.15.2:0/2276751581 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcb8106f10 0x7fbcb810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:19.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.332+0000 7fbcbe9f5640 1 --2- 172.21.15.2:0/2276751581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcb8102790 0x7fbcb81067e0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:19.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.332+0000 7fbcbe9f5640 1 --2- 172.21.15.2:0/2276751581 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbcb8101de0 0x7fbcb81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:19.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.332+0000 7fbcbe9f5640 1 -- 172.21.15.2:0/2276751581 >> 172.21.15.2:0/2276751581 conn(0x7fbcb80fd8c0 msgr2=0x7fbcb80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:19.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.332+0000 7fbcbe9f5640 1 -- 172.21.15.2:0/2276751581 shutdown_connections 2024-09-19T06:18:19.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.332+0000 7fbcbe9f5640 1 -- 172.21.15.2:0/2276751581 wait complete. 2024-09-19T06:18:19.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.332+0000 7fbcbe9f5640 1 Processor -- start 2024-09-19T06:18:19.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.333+0000 7fbcbe9f5640 1 -- start start 2024-09-19T06:18:19.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.333+0000 7fbcbe9f5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcb8101de0 0x7fbcb80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:19.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.333+0000 7fbcbe9f5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbcb8102790 0x7fbcb8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:19.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.333+0000 7fbcbe9f5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcb8106f10 0x7fbcb8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:19.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.333+0000 7fbcbe9f5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb8111e20 con 0x7fbcb8101de0 2024-09-19T06:18:19.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.333+0000 7fbcbe9f5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb8111ca0 con 0x7fbcb8106f10 2024-09-19T06:18:19.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.333+0000 7fbcbe9f5640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb8111fa0 con 0x7fbcb8102790 2024-09-19T06:18:19.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.333+0000 7fbcb7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcb8101de0 0x7fbcb80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:19.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.333+0000 7fbcb7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcb8101de0 0x7fbcb80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45366/0 (socket says 172.21.15.2:45366) 2024-09-19T06:18:19.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.333+0000 7fbcb7fff640 1 -- 172.21.15.2:0/1401749185 learned_addr learned my addr 172.21.15.2:0/1401749185 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:19.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.333+0000 7fbcb77fe640 1 --2- 172.21.15.2:0/1401749185 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbcb8102790 0x7fbcb8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:19.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.333+0000 7fbcbcf92640 1 --2- 172.21.15.2:0/1401749185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcb8106f10 0x7fbcb8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:19.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.333+0000 7fbcb7fff640 1 -- 172.21.15.2:0/1401749185 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbcb8102790 msgr2=0x7fbcb8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:19.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.333+0000 7fbcb7fff640 1 --2- 172.21.15.2:0/1401749185 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbcb8102790 0x7fbcb8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:19.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.333+0000 7fbcb7fff640 1 -- 172.21.15.2:0/1401749185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcb8106f10 msgr2=0x7fbcb8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:19.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.333+0000 7fbcb7fff640 1 --2- 172.21.15.2:0/1401749185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcb8106f10 0x7fbcb8074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:19.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.333+0000 7fbcb7fff640 1 -- 172.21.15.2:0/1401749185 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcb81a67e0 con 0x7fbcb8101de0 2024-09-19T06:18:19.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.334+0000 7fbcb7fff640 1 --2- 172.21.15.2:0/1401749185 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcb8101de0 0x7fbcb80744f0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fbca800c920 tx=0x7fbca800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:19.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.334+0000 7fbcb57fa640 1 -- 172.21.15.2:0/1401749185 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca8007c70 con 0x7fbcb8101de0 2024-09-19T06:18:19.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.334+0000 7fbcb57fa640 1 -- 172.21.15.2:0/1401749185 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbca8007e10 con 0x7fbcb8101de0 2024-09-19T06:18:19.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.334+0000 7fbcbe9f5640 1 -- 172.21.15.2:0/1401749185 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcb81a6ad0 con 0x7fbcb8101de0 2024-09-19T06:18:19.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.334+0000 7fbcb57fa640 1 -- 172.21.15.2:0/1401749185 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca8018820 con 0x7fbcb8101de0 2024-09-19T06:18:19.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.334+0000 7fbcbe9f5640 1 -- 172.21.15.2:0/1401749185 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcb81a6fe0 con 0x7fbcb8101de0 2024-09-19T06:18:19.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.337+0000 7fbcb57fa640 1 -- 172.21.15.2:0/1401749185 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fbca80189c0 con 0x7fbcb8101de0 2024-09-19T06:18:19.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.337+0000 7fbcc0dce740 1 Processor -- start 2024-09-19T06:18:19.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.337+0000 7fbcc0dce740 1 -- start start 2024-09-19T06:18:19.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.337+0000 7fbcc0dce740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847164a4a0 0x55847164a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:19.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.337+0000 7fbcc0dce740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55847164adc0 0x558471655140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:19.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.337+0000 7fbcc0dce740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558471655680 0x558471657a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:19.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.337+0000 7fbcc0dce740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5584715b02e0 con 0x55847164a4a0 2024-09-19T06:18:19.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.337+0000 7fbcc0dce740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x558471557ce0 con 0x558471655680 2024-09-19T06:18:19.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.337+0000 7fbcc0dce740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5584715ac2a0 con 0x55847164adc0 2024-09-19T06:18:19.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.338+0000 7fbcbcf92640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847164a4a0 0x55847164a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:19.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.338+0000 7fbcbcf92640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847164a4a0 0x55847164a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45374/0 (socket says 172.21.15.2:45374) 2024-09-19T06:18:19.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.338+0000 7fbcbcf92640 1 -- 172.21.15.2:0/3933628478 learned_addr learned my addr 172.21.15.2:0/3933628478 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:19.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.338+0000 7fbcb7fff640 1 --2- 172.21.15.2:0/3933628478 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55847164adc0 0x558471655140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:19.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.338+0000 7fbcb77fe640 1 --2- 172.21.15.2:0/3933628478 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558471655680 0x558471657a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:19.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.338+0000 7fbcbcf92640 1 -- 172.21.15.2:0/3933628478 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55847164adc0 msgr2=0x558471655140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:19.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.338+0000 7fbcbcf92640 1 --2- 172.21.15.2:0/3933628478 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55847164adc0 0x558471655140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:19.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.338+0000 7fbcbcf92640 1 -- 172.21.15.2:0/3933628478 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558471655680 msgr2=0x558471657a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:19.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.338+0000 7fbcbcf92640 1 --2- 172.21.15.2:0/3933628478 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558471655680 0x558471657a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:19.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.338+0000 7fbcbcf92640 1 -- 172.21.15.2:0/3933628478 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55847153c440 con 0x55847164a4a0 2024-09-19T06:18:19.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.338+0000 7fbcb57fa640 1 --2- 172.21.15.2:0/1401749185 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fbca00a33b0 0x7fbca00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:19.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.338+0000 7fbcb7fff640 1 --2- 172.21.15.2:0/1401749185 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fbca00a33b0 0x7fbca00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:19.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.338+0000 7fbcbcf92640 1 --2- 172.21.15.2:0/3933628478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847164a4a0 0x55847164a880 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0009df0 tx=0x7fbcb000e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c20324fdb0d9c146 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:19.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.338+0000 7fbcb57fa640 1 -- 172.21.15.2:0/1401749185 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fbca80cfe20 con 0x7fbcb8101de0 2024-09-19T06:18:19.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.339+0000 7fbc9e7fc640 1 -- 172.21.15.2:0/3933628478 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb0016070 con 0x55847164a4a0 2024-09-19T06:18:19.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.339+0000 7fbc9e7fc640 1 -- 172.21.15.2:0/3933628478 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbcb0005020 con 0x55847164a4a0 2024-09-19T06:18:19.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.339+0000 7fbc9e7fc640 1 -- 172.21.15.2:0/3933628478 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb00116d0 con 0x55847164a4a0 2024-09-19T06:18:19.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.339+0000 7fbcc0dce740 1 -- 172.21.15.2:0/3933628478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847164a4a0 msgr2=0x55847164a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:19.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.339+0000 7fbcb7fff640 1 --2- 172.21.15.2:0/1401749185 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fbca00a33b0 0x7fbca00a5870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbca80cd650 tx=0x7fbca80d3970 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:19.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.339+0000 7fbcc0dce740 1 --2- 172.21.15.2:0/3933628478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847164a4a0 0x55847164a880 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0009df0 tx=0x7fbcb000e6c0 comp rx=0 tx=0).stop 2024-09-19T06:18:19.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.339+0000 7fbcc0dce740 1 -- 172.21.15.2:0/3933628478 shutdown_connections 2024-09-19T06:18:19.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.339+0000 7fbcc0dce740 1 --2- 172.21.15.2:0/3933628478 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558471655680 0x558471657a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:19.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.339+0000 7fbcc0dce740 1 --2- 172.21.15.2:0/3933628478 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55847164adc0 0x558471655140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:19.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.339+0000 7fbcc0dce740 1 --2- 172.21.15.2:0/3933628478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847164a4a0 0x55847164a880 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:19.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.339+0000 7fbcc0dce740 1 -- 172.21.15.2:0/3933628478 >> 172.21.15.2:0/3933628478 conn(0x558471646a30 msgr2=0x558471646e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:19.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.339+0000 7fbcc0dce740 1 -- 172.21.15.2:0/3933628478 shutdown_connections 2024-09-19T06:18:19.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.339+0000 7fbcc0dce740 1 -- 172.21.15.2:0/3933628478 wait complete. 2024-09-19T06:18:19.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.340+0000 7fbcc0dce740 1 -- start start 2024-09-19T06:18:19.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.340+0000 7fbcc0dce740 1 Processor -- start 2024-09-19T06:18:19.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.340+0000 7fbcc0dce740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55847164a4a0 0x558471654f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:19.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.340+0000 7fbcc0dce740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847164adc0 0x558471652210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:19.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.340+0000 7fbcc0dce740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558471655680 0x558471652750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:19.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.340+0000 7fbcc0dce740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558471658250 con 0x55847164adc0 2024-09-19T06:18:19.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.340+0000 7fbcc0dce740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55847156b050 con 0x558471655680 2024-09-19T06:18:19.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.340+0000 7fbcc0dce740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5584716583d0 con 0x55847164a4a0 2024-09-19T06:18:19.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.340+0000 7fbcc0dce740 10 client.0 _ll_register_callbacks cb 0x5584715ab160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:19.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.340+0000 7fbcb77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847164adc0 0x558471652210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:19.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.341+0000 7fbcb77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847164adc0 0x558471652210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45384/0 (socket says 172.21.15.2:45384) 2024-09-19T06:18:19.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.341+0000 7fbcb77fe640 1 -- 172.21.15.2:0/1057263933 learned_addr learned my addr 172.21.15.2:0/1057263933 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:19.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.341+0000 7fbcbcf92640 1 --2- 172.21.15.2:0/1057263933 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558471655680 0x558471652750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:19.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.341+0000 7fbcbcf92640 1 --2- 172.21.15.2:0/1057263933 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55847164a4a0 0x558471654f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:19.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.341+0000 7fbcb77fe640 1 -- 172.21.15.2:0/1057263933 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55847164a4a0 msgr2=0x558471654f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:19.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.341+0000 7fbcb77fe640 1 --2- 172.21.15.2:0/1057263933 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55847164a4a0 0x558471654f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:19.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.341+0000 7fbcb77fe640 1 -- 172.21.15.2:0/1057263933 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558471655680 msgr2=0x558471652750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:19.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.341+0000 7fbcb77fe640 1 --2- 172.21.15.2:0/1057263933 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558471655680 0x558471652750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:19.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.341+0000 7fbcb77fe640 1 -- 172.21.15.2:0/1057263933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584713213c0 con 0x55847164adc0 2024-09-19T06:18:19.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.341+0000 7fbcbcf92640 1 --2- 172.21.15.2:0/1057263933 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558471655680 0x558471652750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:18:19.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.341+0000 7fbcb77fe640 1 --2- 172.21.15.2:0/1057263933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847164adc0 0x558471652210 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fbcac009900 tx=0x7fbcac0316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f1948f2cda5cd92 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:19.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.341+0000 7fbc977fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:18:19.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.341+0000 7fbc977fe640 1 -- 172.21.15.2:0/1057263933 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcac035040 con 0x55847164adc0 2024-09-19T06:18:19.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.341+0000 7fbc977fe640 1 -- 172.21.15.2:0/1057263933 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fbcac031cf0 con 0x55847164adc0 2024-09-19T06:18:19.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.341+0000 7fbcc0dce740 1 -- 172.21.15.2:0/1057263933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcb0005020 con 0x55847164adc0 2024-09-19T06:18:19.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.341+0000 7fbc977fe640 1 -- 172.21.15.2:0/1057263933 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fbcac004040 con 0x55847164adc0 2024-09-19T06:18:19.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.342+0000 7fbcc0dce740 10 client.16200 fetch_fsmap learned FSMap version 26 2024-09-19T06:18:19.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.342+0000 7fbcc0dce740 1 -- 172.21.15.2:0/1057263933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x558471663c10 con 0x55847164adc0 2024-09-19T06:18:19.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.342+0000 7fbc977fe640 1 -- 172.21.15.2:0/1057263933 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbcb0005020 con 0x55847164adc0 2024-09-19T06:18:19.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.342+0000 7fbc977fe640 1 -- 172.21.15.2:0/1057263933 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fbcac004750 con 0x55847164adc0 2024-09-19T06:18:19.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.342+0000 7fbcc0dce740 10 client.16200 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:18:19.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.342+0000 7fbcc0dce740 10 client.16200 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:18:19.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.342+0000 7fbcc0dce740 20 client.16200 populate_metadata read hostname 'smithi002' 2024-09-19T06:18:19.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.342+0000 7fbcc0dce740 1 --2- 172.21.15.2:0/1057263933 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5584716650d0 0x5584716674c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:19.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.342+0000 7fbcc0dce740 4 client.16200 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:18:19.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.342+0000 7fbcc0dce740 1 -- 172.21.15.2:0/1057263933 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5584715bd850 con 0x5584716650d0 2024-09-19T06:18:19.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.342+0000 7fbcbcf92640 1 --2- 172.21.15.2:0/1057263933 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5584716650d0 0x5584716674c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:19.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.343+0000 7fbc977fe640 10 client.16200 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:18:19.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.343+0000 7fbcbcf92640 1 --2- 172.21.15.2:0/1057263933 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5584716650d0 0x5584716674c0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48ea4f5afa57d2b2 server_cookie=4f6178ddd307e24 in_seq=0 out_seq=0 2024-09-19T06:18:19.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.343+0000 7fbc977fe640 1 -- 172.21.15.2:0/1057263933 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5584715bd850 con 0x5584716650d0 2024-09-19T06:18:19.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.343+0000 7fbc977fe640 10 client.16200 handle_command_reply: tid=0 2024-09-19T06:18:19.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.343+0000 7fbcc0dce740 1 client.16200 shutdown 2024-09-19T06:18:19.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.344+0000 7fbcc0dce740 1 -- 172.21.15.2:0/1057263933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847164adc0 msgr2=0x558471652210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:19.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.344+0000 7fbcc0dce740 1 --2- 172.21.15.2:0/1057263933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847164adc0 0x558471652210 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fbcac009900 tx=0x7fbcac0316d0 comp rx=0 tx=0).stop 2024-09-19T06:18:19.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.344+0000 7fbcc0dce740 1 -- 172.21.15.2:0/1057263933 shutdown_connections 2024-09-19T06:18:19.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.344+0000 7fbcc0dce740 1 --2- 172.21.15.2:0/1057263933 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5584716650d0 0x5584716674c0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:19.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.344+0000 7fbcc0dce740 1 --2- 172.21.15.2:0/1057263933 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558471655680 0x558471652750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:19.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.344+0000 7fbcc0dce740 1 --2- 172.21.15.2:0/1057263933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847164adc0 0x558471652210 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:19.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.344+0000 7fbcc0dce740 1 --2- 172.21.15.2:0/1057263933 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55847164a4a0 0x558471654f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:19.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.344+0000 7fbcc0dce740 1 -- 172.21.15.2:0/1057263933 >> 172.21.15.2:0/1057263933 conn(0x558471646a30 msgr2=0x55847164c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:19.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.344+0000 7fbc977fe640 0 client.16200 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:18:19.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.344+0000 7fbcc0dce740 1 -- 172.21.15.2:0/1057263933 shutdown_connections 2024-09-19T06:18:19.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.344+0000 7fbcc0dce740 1 -- 172.21.15.2:0/1057263933 wait complete. 2024-09-19T06:18:19.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.344+0000 7fbcc0dce740 20 client.16200 trim_cache size 0 max 16384 2024-09-19T06:18:19.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.361+0000 7fbcc0dce740 1 Processor -- start 2024-09-19T06:18:19.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.361+0000 7fbcc0dce740 1 -- start start 2024-09-19T06:18:19.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.361+0000 7fbcc0dce740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55847164a4a0 0x5584716614b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:19.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.361+0000 7fbcc0dce740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55847164adc0 0x55847166cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:19.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.361+0000 7fbcc0dce740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558471655680 0x55847166d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:19.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.361+0000 7fbcc0dce740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb81b2100 con 0x558471655680 2024-09-19T06:18:19.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.361+0000 7fbcc0dce740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb81af9d0 con 0x55847164adc0 2024-09-19T06:18:19.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.361+0000 7fbcc0dce740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb81ad820 con 0x55847164a4a0 2024-09-19T06:18:19.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.362+0000 7fbcbcf92640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558471655680 0x55847166d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:19.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.362+0000 7fbcbcf92640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558471655680 0x55847166d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45392/0 (socket says 172.21.15.2:45392) 2024-09-19T06:18:19.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.362+0000 7fbcbcf92640 1 -- 172.21.15.2:0/2721221574 learned_addr learned my addr 172.21.15.2:0/2721221574 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:19.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.362+0000 7fbcb77fe640 1 --2- 172.21.15.2:0/2721221574 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55847164adc0 0x55847166cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:19.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.362+0000 7fbcbcf92640 1 --2- 172.21.15.2:0/2721221574 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55847164a4a0 0x5584716614b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:19.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.362+0000 7fbcbcf92640 1 -- 172.21.15.2:0/2721221574 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55847164a4a0 msgr2=0x5584716614b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:19.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.362+0000 7fbcbcf92640 1 --2- 172.21.15.2:0/2721221574 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55847164a4a0 0x5584716614b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:19.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.362+0000 7fbcbcf92640 1 -- 172.21.15.2:0/2721221574 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55847164adc0 msgr2=0x55847166cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:19.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.362+0000 7fbcbcf92640 1 --2- 172.21.15.2:0/2721221574 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55847164adc0 0x55847166cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:19.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.362+0000 7fbcbcf92640 1 -- 172.21.15.2:0/2721221574 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558471650760 con 0x558471655680 2024-09-19T06:18:19.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.362+0000 7fbcb77fe640 1 --2- 172.21.15.2:0/2721221574 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55847164adc0 0x55847166cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:18:19.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.362+0000 7fbcbcf92640 1 --2- 172.21.15.2:0/2721221574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558471655680 0x55847166d2d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0005fd0 tx=0x7fbcb000e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56c85b9e9ccdf6ee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:19.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.362+0000 7fbc9dffb640 1 -- 172.21.15.2:0/2721221574 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb0016030 con 0x558471655680 2024-09-19T06:18:19.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.362+0000 7fbc9dffb640 1 -- 172.21.15.2:0/2721221574 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbcb0005bd0 con 0x558471655680 2024-09-19T06:18:19.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.362+0000 7fbc9dffb640 1 -- 172.21.15.2:0/2721221574 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb0011730 con 0x558471655680 2024-09-19T06:18:19.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.363+0000 7fbcc0dce740 1 -- 172.21.15.2:0/2721221574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558471655680 msgr2=0x55847166d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:19.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.363+0000 7fbcc0dce740 1 --2- 172.21.15.2:0/2721221574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558471655680 0x55847166d2d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0005fd0 tx=0x7fbcb000e6c0 comp rx=0 tx=0).stop 2024-09-19T06:18:19.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.363+0000 7fbcc0dce740 1 -- 172.21.15.2:0/2721221574 shutdown_connections 2024-09-19T06:18:19.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.363+0000 7fbcc0dce740 1 --2- 172.21.15.2:0/2721221574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558471655680 0x55847166d2d0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:19.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.363+0000 7fbcc0dce740 1 --2- 172.21.15.2:0/2721221574 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55847164adc0 0x55847166cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:19.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.363+0000 7fbcc0dce740 1 --2- 172.21.15.2:0/2721221574 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55847164a4a0 0x5584716614b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:19.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.363+0000 7fbcc0dce740 1 -- 172.21.15.2:0/2721221574 >> 172.21.15.2:0/2721221574 conn(0x558471646a30 msgr2=0x558471654290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:19.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.363+0000 7fbcc0dce740 1 -- 172.21.15.2:0/2721221574 shutdown_connections 2024-09-19T06:18:19.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.363+0000 7fbcc0dce740 1 -- 172.21.15.2:0/2721221574 wait complete. 2024-09-19T06:18:19.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.364+0000 7fbcc0dce740 1 -- start start 2024-09-19T06:18:19.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.364+0000 7fbcc0dce740 1 Processor -- start 2024-09-19T06:18:19.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.364+0000 7fbcc0dce740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847164a4a0 0x55847165de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:19.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.364+0000 7fbcc0dce740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55847164adc0 0x5584716591a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:19.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.364+0000 7fbcc0dce740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558471655680 0x558471659770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:19.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.364+0000 7fbcc0dce740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb81ade90 con 0x55847164a4a0 2024-09-19T06:18:19.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.364+0000 7fbcc0dce740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb81af300 con 0x55847164adc0 2024-09-19T06:18:19.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.364+0000 7fbcc0dce740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb81ae560 con 0x558471655680 2024-09-19T06:18:19.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.364+0000 7fbcc0dce740 10 client.0 _ll_register_callbacks cb 0x7fbcac009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:19.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.364+0000 7fbcbcf92640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847164a4a0 0x55847165de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:19.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.364+0000 7fbcbcf92640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847164a4a0 0x55847165de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45406/0 (socket says 172.21.15.2:45406) 2024-09-19T06:18:19.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.364+0000 7fbcbcf92640 1 -- 172.21.15.2:0/3977710138 learned_addr learned my addr 172.21.15.2:0/3977710138 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:19.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.364+0000 7fbcb77fe640 1 --2- 172.21.15.2:0/3977710138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55847164adc0 0x5584716591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:19.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.365+0000 7fbcbcf92640 1 -- 172.21.15.2:0/3977710138 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558471655680 msgr2=0x558471659770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:19.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.365+0000 7fbcbcf92640 1 --2- 172.21.15.2:0/3977710138 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558471655680 0x558471659770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:19.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.365+0000 7fbcbcf92640 1 -- 172.21.15.2:0/3977710138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55847164adc0 msgr2=0x5584716591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:19.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.365+0000 7fbcbcf92640 1 --2- 172.21.15.2:0/3977710138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55847164adc0 0x5584716591a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:19.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.365+0000 7fbcbcf92640 1 -- 172.21.15.2:0/3977710138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558471659fa0 con 0x55847164a4a0 2024-09-19T06:18:19.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.365+0000 7fbcb77fe640 1 --2- 172.21.15.2:0/3977710138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55847164adc0 0x5584716591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:18:19.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.365+0000 7fbcbcf92640 1 --2- 172.21.15.2:0/3977710138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847164a4a0 0x55847165de70 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0005a60 tx=0x7fbcb00116f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b151bc2314e90e31 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:19.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.365+0000 7fbc977fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:18:19.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.365+0000 7fbc977fe640 1 -- 172.21.15.2:0/3977710138 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb0035070 con 0x55847164a4a0 2024-09-19T06:18:19.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.365+0000 7fbcc0dce740 1 -- 172.21.15.2:0/3977710138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcb0005bd0 con 0x55847164a4a0 2024-09-19T06:18:19.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.365+0000 7fbc977fe640 1 -- 172.21.15.2:0/3977710138 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fbcb0011b20 con 0x55847164a4a0 2024-09-19T06:18:19.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.365+0000 7fbc977fe640 1 -- 172.21.15.2:0/3977710138 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fbcb0040050 con 0x55847164a4a0 2024-09-19T06:18:19.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.365+0000 7fbcc0dce740 10 client.16206 fetch_fsmap learned FSMap version 26 2024-09-19T06:18:19.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.365+0000 7fbcc0dce740 1 -- 172.21.15.2:0/3977710138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5584716cfe70 con 0x55847164a4a0 2024-09-19T06:18:19.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.365+0000 7fbc977fe640 1 -- 172.21.15.2:0/3977710138 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbcb0005bd0 con 0x55847164a4a0 2024-09-19T06:18:19.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.366+0000 7fbc977fe640 1 -- 172.21.15.2:0/3977710138 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fbcb000f040 con 0x55847164a4a0 2024-09-19T06:18:19.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.366+0000 7fbcc0dce740 10 client.16206 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:18:19.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.366+0000 7fbcc0dce740 10 client.16206 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:18:19.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.366+0000 7fbcc0dce740 20 client.16206 populate_metadata read hostname 'smithi002' 2024-09-19T06:18:19.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.366+0000 7fbcc0dce740 1 --2- 172.21.15.2:0/3977710138 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5584716d0290 0x5584716d2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:19.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.366+0000 7fbcc0dce740 4 client.16206 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:18:19.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.366+0000 7fbcc0dce740 1 -- 172.21.15.2:0/3977710138 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5584715b7d60 con 0x5584716d0290 2024-09-19T06:18:19.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.366+0000 7fbcb77fe640 1 --2- 172.21.15.2:0/3977710138 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5584716d0290 0x5584716d2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:19.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.366+0000 7fbcb77fe640 1 --2- 172.21.15.2:0/3977710138 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5584716d0290 0x5584716d2680 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdca45087dceb189 server_cookie=eca121e9daf25080 in_seq=0 out_seq=0 2024-09-19T06:18:19.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.366+0000 7fbc977fe640 10 client.16206 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:18:19.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.366+0000 7fbc977fe640 1 -- 172.21.15.2:0/3977710138 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5584715b7d60 con 0x5584716d0290 2024-09-19T06:18:19.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.366+0000 7fbc977fe640 10 client.16206 handle_command_reply: tid=0 2024-09-19T06:18:19.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.366+0000 7fbcc0dce740 1 client.16206 shutdown 2024-09-19T06:18:19.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.367+0000 7fbcc0dce740 1 -- 172.21.15.2:0/3977710138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847164a4a0 msgr2=0x55847165de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:19.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.367+0000 7fbcc0dce740 1 --2- 172.21.15.2:0/3977710138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847164a4a0 0x55847165de70 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0005a60 tx=0x7fbcb00116f0 comp rx=0 tx=0).stop 2024-09-19T06:18:19.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.367+0000 7fbcc0dce740 1 -- 172.21.15.2:0/3977710138 shutdown_connections 2024-09-19T06:18:19.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.367+0000 7fbcc0dce740 1 --2- 172.21.15.2:0/3977710138 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558471655680 0x558471659770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:19.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.367+0000 7fbcc0dce740 1 --2- 172.21.15.2:0/3977710138 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5584716d0290 0x5584716d2680 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:19.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.367+0000 7fbcc0dce740 1 --2- 172.21.15.2:0/3977710138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55847164adc0 0x5584716591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:19.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.367+0000 7fbcc0dce740 1 --2- 172.21.15.2:0/3977710138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55847164a4a0 0x55847165de70 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:19.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.367+0000 7fbcc0dce740 1 -- 172.21.15.2:0/3977710138 >> 172.21.15.2:0/3977710138 conn(0x558471646a30 msgr2=0x558471645350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:19.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.367+0000 7fbc977fe640 0 client.16206 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:18:19.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.367+0000 7fbcc0dce740 1 -- 172.21.15.2:0/3977710138 shutdown_connections 2024-09-19T06:18:19.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.367+0000 7fbcc0dce740 1 -- 172.21.15.2:0/3977710138 wait complete. 2024-09-19T06:18:19.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.367+0000 7fbcc0dce740 20 client.16206 trim_cache size 0 max 16384 2024-09-19T06:18:19.377 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:18:19.377 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T06:18:19.377 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T06:18:19.377 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:18:19.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.367+0000 7fbcbe9f5640 1 -- 172.21.15.2:0/1401749185 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fbca00a33b0 msgr2=0x7fbca00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:19.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.367+0000 7fbcbe9f5640 1 --2- 172.21.15.2:0/1401749185 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fbca00a33b0 0x7fbca00a5870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbca80cd650 tx=0x7fbca80d3970 comp rx=0 tx=0).stop 2024-09-19T06:18:19.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.367+0000 7fbcbe9f5640 1 -- 172.21.15.2:0/1401749185 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcb8101de0 msgr2=0x7fbcb80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:19.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.367+0000 7fbcbe9f5640 1 --2- 172.21.15.2:0/1401749185 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcb8101de0 0x7fbcb80744f0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fbca800c920 tx=0x7fbca800cde0 comp rx=0 tx=0).stop 2024-09-19T06:18:19.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.368+0000 7fbcbe9f5640 1 -- 172.21.15.2:0/1401749185 shutdown_connections 2024-09-19T06:18:19.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.368+0000 7fbcbe9f5640 1 --2- 172.21.15.2:0/1401749185 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fbca00a33b0 0x7fbca00a5870 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:19.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.368+0000 7fbcbe9f5640 1 --2- 172.21.15.2:0/1401749185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcb8106f10 0x7fbcb8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:19.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.368+0000 7fbcbe9f5640 1 --2- 172.21.15.2:0/1401749185 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbcb8102790 0x7fbcb8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:19.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.368+0000 7fbcbe9f5640 1 --2- 172.21.15.2:0/1401749185 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcb8101de0 0x7fbcb80744f0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:19.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.368+0000 7fbcbe9f5640 1 -- 172.21.15.2:0/1401749185 >> 172.21.15.2:0/1401749185 conn(0x7fbcb80fd8c0 msgr2=0x7fbcb80fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:19.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.368+0000 7fbcbe9f5640 1 -- 172.21.15.2:0/1401749185 shutdown_connections 2024-09-19T06:18:19.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:19.368+0000 7fbcbe9f5640 1 -- 172.21.15.2:0/1401749185 wait complete. 2024-09-19T06:18:19.607 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:19 smithi002 ceph-mon[30982]: pgmap v108: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T06:18:19.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:19 smithi090 ceph-mon[34497]: pgmap v108: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T06:18:19.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:19 smithi089 ceph-mon[34160]: pgmap v108: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T06:18:20.160 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:18:20.161 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:18:20.422 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:18:20.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:20.847+0000 7f7f708c1640 1 -- 172.21.15.2:0/1051830846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f6c106f10 msgr2=0x7f7f6c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:20.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:20.847+0000 7f7f708c1640 1 --2- 172.21.15.2:0/1051830846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f6c106f10 0x7f7f6c10ea90 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f7f64009900 tx=0x7f7f6402a3f0 comp rx=0 tx=0).stop 2024-09-19T06:18:20.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:20.847+0000 7f7f708c1640 1 -- 172.21.15.2:0/1051830846 shutdown_connections 2024-09-19T06:18:20.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:20.847+0000 7f7f708c1640 1 --2- 172.21.15.2:0/1051830846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f6c106f10 0x7f7f6c10ea90 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:20.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:20.847+0000 7f7f708c1640 1 --2- 172.21.15.2:0/1051830846 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f6c102790 0x7f7f6c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:20.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:20.847+0000 7f7f708c1640 1 --2- 172.21.15.2:0/1051830846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f6c101de0 0x7f7f6c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:20.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:20.847+0000 7f7f708c1640 1 -- 172.21.15.2:0/1051830846 >> 172.21.15.2:0/1051830846 conn(0x7f7f6c0fd8c0 msgr2=0x7f7f6c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:20.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:20.847+0000 7f7f708c1640 1 -- 172.21.15.2:0/1051830846 shutdown_connections 2024-09-19T06:18:20.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:20.847+0000 7f7f708c1640 1 -- 172.21.15.2:0/1051830846 wait complete. 2024-09-19T06:18:20.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:20.848+0000 7f7f708c1640 1 Processor -- start 2024-09-19T06:18:20.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:20.848+0000 7f7f708c1640 1 -- start start 2024-09-19T06:18:20.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:20.848+0000 7f7f708c1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f6c101de0 0x7f7f6c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:20.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:20.848+0000 7f7f708c1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f6c102790 0x7f7f6c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:20.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:20.848+0000 7f7f708c1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f6c106f10 0x7f7f6c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:20.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:20.848+0000 7f7f708c1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6c111e20 con 0x7f7f6c101de0 2024-09-19T06:18:20.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:20.848+0000 7f7f708c1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6c111ca0 con 0x7f7f6c106f10 2024-09-19T06:18:20.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:20.848+0000 7f7f708c1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6c111fa0 con 0x7f7f6c102790 2024-09-19T06:18:20.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:20.849+0000 7f7f6a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f6c101de0 0x7f7f6c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:20.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:20.849+0000 7f7f6a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f6c101de0 0x7f7f6c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45418/0 (socket says 172.21.15.2:45418) 2024-09-19T06:18:20.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:20.849+0000 7f7f6a59c640 1 -- 172.21.15.2:0/3812414265 learned_addr learned my addr 172.21.15.2:0/3812414265 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:20.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:20.849+0000 7f7f6ad9d640 1 --2- 172.21.15.2:0/3812414265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f6c106f10 0x7f7f6c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:20.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:20.849+0000 7f7f69d9b640 1 --2- 172.21.15.2:0/3812414265 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f6c102790 0x7f7f6c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:20.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:20.849+0000 7f7f6a59c640 1 -- 172.21.15.2:0/3812414265 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f6c102790 msgr2=0x7f7f6c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:20.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:20.849+0000 7f7f6a59c640 1 --2- 172.21.15.2:0/3812414265 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f6c102790 0x7f7f6c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:20.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:20.849+0000 7f7f6a59c640 1 -- 172.21.15.2:0/3812414265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f6c106f10 msgr2=0x7f7f6c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:20.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:20.849+0000 7f7f6a59c640 1 --2- 172.21.15.2:0/3812414265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f6c106f10 0x7f7f6c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:20.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:20.849+0000 7f7f6a59c640 1 -- 172.21.15.2:0/3812414265 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f6c1a6680 con 0x7f7f6c101de0 2024-09-19T06:18:20.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:20.849+0000 7f7f6ad9d640 1 --2- 172.21.15.2:0/3812414265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f6c106f10 0x7f7f6c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:18:20.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:20.849+0000 7f7f6a59c640 1 --2- 172.21.15.2:0/3812414265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f6c101de0 0x7f7f6c0744f0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c00cce0 tx=0x7f7f5c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:20.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:20.849+0000 7f7f5b7fe640 1 -- 172.21.15.2:0/3812414265 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c00f650 con 0x7f7f6c101de0 2024-09-19T06:18:20.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:20.849+0000 7f7f5b7fe640 1 -- 172.21.15.2:0/3812414265 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7f5c00fca0 con 0x7f7f6c101de0 2024-09-19T06:18:20.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:20.849+0000 7f7f708c1640 1 -- 172.21.15.2:0/3812414265 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f6c1a6970 con 0x7f7f6c101de0 2024-09-19T06:18:20.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:20.849+0000 7f7f5b7fe640 1 -- 172.21.15.2:0/3812414265 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c018b90 con 0x7f7f6c101de0 2024-09-19T06:18:20.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:20.849+0000 7f7f708c1640 1 -- 172.21.15.2:0/3812414265 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f6c1a6f00 con 0x7f7f6c101de0 2024-09-19T06:18:20.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:20.851+0000 7f7f708c1640 1 -- 172.21.15.2:0/3812414265 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f6c1021c0 con 0x7f7f6c101de0 2024-09-19T06:18:20.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:20.852+0000 7f7f5b7fe640 1 -- 172.21.15.2:0/3812414265 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f7f5c00f7f0 con 0x7f7f6c101de0 2024-09-19T06:18:20.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:20.853+0000 7f7f5b7fe640 1 --2- 172.21.15.2:0/3812414265 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f7f540a3430 0x7f7f540a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:20.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:20.853+0000 7f7f69d9b640 1 --2- 172.21.15.2:0/3812414265 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f7f540a3430 0x7f7f540a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:20.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:20.853+0000 7f7f5b7fe640 1 -- 172.21.15.2:0/3812414265 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f7f5c0d01d0 con 0x7f7f6c101de0 2024-09-19T06:18:20.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:20.853+0000 7f7f69d9b640 1 --2- 172.21.15.2:0/3812414265 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f7f540a3430 0x7f7f540a58f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c075f80 tx=0x7f7f60005c50 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:20.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:20.857+0000 7f7f5b7fe640 1 -- 172.21.15.2:0/3812414265 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7f5c014030 con 0x7f7f6c101de0 2024-09-19T06:18:21.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:21.069+0000 7f7f708c1640 1 -- 172.21.15.2:0/3812414265 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7f6c075a20 con 0x7f7f6c101de0 2024-09-19T06:18:21.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:21.069+0000 7f7f5b7fe640 1 -- 172.21.15.2:0/3812414265 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11882 (secure 0 0 0) 0x7f7f5c09cbe0 con 0x7f7f6c101de0 2024-09-19T06:18:21.071 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:18:21.071 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-09-19T06:14:49:104280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:14:48.191083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24470,24472,24497]},"id":1}]} 2024-09-19T06:18:21.072 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-09-19T06:18:21.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:21.071+0000 7f7f708c1640 1 -- 172.21.15.2:0/3812414265 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f7f540a3430 msgr2=0x7f7f540a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:21.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:21.071+0000 7f7f708c1640 1 --2- 172.21.15.2:0/3812414265 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f7f540a3430 0x7f7f540a58f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c075f80 tx=0x7f7f60005c50 comp rx=0 tx=0).stop 2024-09-19T06:18:21.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:21.071+0000 7f7f708c1640 1 -- 172.21.15.2:0/3812414265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f6c101de0 msgr2=0x7f7f6c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:21.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:21.071+0000 7f7f708c1640 1 --2- 172.21.15.2:0/3812414265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f6c101de0 0x7f7f6c0744f0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c00cce0 tx=0x7f7f5c00a620 comp rx=0 tx=0).stop 2024-09-19T06:18:21.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:21.071+0000 7f7f708c1640 1 -- 172.21.15.2:0/3812414265 shutdown_connections 2024-09-19T06:18:21.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:21.071+0000 7f7f708c1640 1 --2- 172.21.15.2:0/3812414265 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f7f540a3430 0x7f7f540a58f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:21.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:21.071+0000 7f7f708c1640 1 --2- 172.21.15.2:0/3812414265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f6c106f10 0x7f7f6c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:21.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:21.071+0000 7f7f708c1640 1 --2- 172.21.15.2:0/3812414265 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f6c102790 0x7f7f6c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:21.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:21.071+0000 7f7f708c1640 1 --2- 172.21.15.2:0/3812414265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f6c101de0 0x7f7f6c0744f0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:21.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:21.071+0000 7f7f708c1640 1 -- 172.21.15.2:0/3812414265 >> 172.21.15.2:0/3812414265 conn(0x7f7f6c0fd8c0 msgr2=0x7f7f6c0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:21.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:21.071+0000 7f7f708c1640 1 -- 172.21.15.2:0/3812414265 shutdown_connections 2024-09-19T06:18:21.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:21.071+0000 7f7f708c1640 1 -- 172.21.15.2:0/3812414265 wait complete. 2024-09-19T06:18:21.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:21 smithi002 ceph-mon[30982]: pgmap v109: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-19T06:18:21.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:21 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/3812414265' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:18:21.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:21 smithi090 ceph-mon[34497]: pgmap v109: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-19T06:18:21.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:21 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/3812414265' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:18:21.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:21 smithi089 ceph-mon[34160]: pgmap v109: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-19T06:18:21.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:21 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/3812414265' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:18:21.796 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:18:22.054 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:18:22.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.650+0000 7fa8cf862640 1 -- 172.21.15.2:0/3575822829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8c810cf30 msgr2=0x7fa8c8119410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:22.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.650+0000 7fa8cf862640 1 --2- 172.21.15.2:0/3575822829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8c810cf30 0x7fa8c8119410 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0009ca0 tx=0x7fa8c002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:18:22.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.650+0000 7fa8cf862640 1 -- 172.21.15.2:0/3575822829 shutdown_connections 2024-09-19T06:18:22.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.650+0000 7fa8cf862640 1 --2- 172.21.15.2:0/3575822829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8c810cf30 0x7fa8c8119410 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:22.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.650+0000 7fa8cf862640 1 --2- 172.21.15.2:0/3575822829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8c810c590 0x7fa8c810c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:22.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.650+0000 7fa8cf862640 1 --2- 172.21.15.2:0/3575822829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8c8112640 0x7fa8c8112a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:22.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.650+0000 7fa8cf862640 1 -- 172.21.15.2:0/3575822829 >> 172.21.15.2:0/3575822829 conn(0x7fa8c806cdc0 msgr2=0x7fa8c806d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:22.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.650+0000 7fa8cf862640 1 -- 172.21.15.2:0/3575822829 shutdown_connections 2024-09-19T06:18:22.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.650+0000 7fa8cf862640 1 -- 172.21.15.2:0/3575822829 wait complete. 2024-09-19T06:18:22.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.651+0000 7fa8cf862640 1 Processor -- start 2024-09-19T06:18:22.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.651+0000 7fa8cf862640 1 -- start start 2024-09-19T06:18:22.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.651+0000 7fa8cf862640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8c810c590 0x7fa8c81a87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:22.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.651+0000 7fa8cf862640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8c810cf30 0x7fa8c81a8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:22.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.651+0000 7fa8cf862640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8c8112640 0x7fa8c81a2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:22.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.651+0000 7fa8cf862640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c811c850 con 0x7fa8c810c590 2024-09-19T06:18:22.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.651+0000 7fa8cf862640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c811c6d0 con 0x7fa8c8112640 2024-09-19T06:18:22.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.651+0000 7fa8cf862640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c811c9d0 con 0x7fa8c810cf30 2024-09-19T06:18:22.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.651+0000 7fa8cd5fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8c810c590 0x7fa8c81a87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:22.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.651+0000 7fa8cd5fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8c810c590 0x7fa8c81a87a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45446/0 (socket says 172.21.15.2:45446) 2024-09-19T06:18:22.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.651+0000 7fa8cd5fe640 1 -- 172.21.15.2:0/660758303 learned_addr learned my addr 172.21.15.2:0/660758303 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:22.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.651+0000 7fa8cd5fe640 1 -- 172.21.15.2:0/660758303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8c810cf30 msgr2=0x7fa8c81a8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:22.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.651+0000 7fa8cd5fe640 1 --2- 172.21.15.2:0/660758303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8c810cf30 0x7fa8c81a8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:22.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.651+0000 7fa8cd5fe640 1 -- 172.21.15.2:0/660758303 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8c8112640 msgr2=0x7fa8c81a2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:22.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.651+0000 7fa8cd5fe640 1 --2- 172.21.15.2:0/660758303 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8c8112640 0x7fa8c81a2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:22.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.651+0000 7fa8cd5fe640 1 -- 172.21.15.2:0/660758303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c81a3090 con 0x7fa8c810c590 2024-09-19T06:18:22.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.652+0000 7fa8cd5fe640 1 --2- 172.21.15.2:0/660758303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8c810c590 0x7fa8c81a87a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fa8c400c920 tx=0x7fa8c400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:22.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.652+0000 7fa8be7fc640 1 -- 172.21.15.2:0/660758303 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4007c70 con 0x7fa8c810c590 2024-09-19T06:18:22.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.652+0000 7fa8be7fc640 1 -- 172.21.15.2:0/660758303 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa8c4007e10 con 0x7fa8c810c590 2024-09-19T06:18:22.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.652+0000 7fa8be7fc640 1 -- 172.21.15.2:0/660758303 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4018820 con 0x7fa8c810c590 2024-09-19T06:18:22.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.652+0000 7fa8cf862640 1 -- 172.21.15.2:0/660758303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8c81a3380 con 0x7fa8c810c590 2024-09-19T06:18:22.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.652+0000 7fa8cf862640 1 -- 172.21.15.2:0/660758303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8c81af670 con 0x7fa8c810c590 2024-09-19T06:18:22.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.654+0000 7fa8be7fc640 1 -- 172.21.15.2:0/660758303 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fa8c40189c0 con 0x7fa8c810c590 2024-09-19T06:18:22.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.655+0000 7fa8d1c3b740 1 Processor -- start 2024-09-19T06:18:22.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.655+0000 7fa8d1c3b740 1 -- start start 2024-09-19T06:18:22.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.655+0000 7fa8d1c3b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4cd6dab40 0x55f4cd6d9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:22.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.655+0000 7fa8be7fc640 1 --2- 172.21.15.2:0/660758303 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa8b40a33b0 0x7fa8b40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:22.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.655+0000 7fa8d1c3b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4cd6d95d0 0x55f4cd6d9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:22.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.655+0000 7fa8d1c3b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f4cd6e4370 0x55f4cd6e6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:22.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.655+0000 7fa8d1c3b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f4cd63f2f0 con 0x55f4cd6dab40 2024-09-19T06:18:22.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.655+0000 7fa8d1c3b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55f4cd5e6cf0 con 0x55f4cd6d95d0 2024-09-19T06:18:22.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.655+0000 7fa8d1c3b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f4cd63b2b0 con 0x55f4cd6e4370 2024-09-19T06:18:22.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.655+0000 7fa8cddff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4cd6dab40 0x55f4cd6d9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:22.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.655+0000 7fa8cddff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4cd6dab40 0x55f4cd6d9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45450/0 (socket says 172.21.15.2:45450) 2024-09-19T06:18:22.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.655+0000 7fa8cddff640 1 -- 172.21.15.2:0/3367605272 learned_addr learned my addr 172.21.15.2:0/3367605272 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:22.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.656+0000 7fa8be7fc640 1 -- 172.21.15.2:0/660758303 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fa8c40cff70 con 0x7fa8c810c590 2024-09-19T06:18:22.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.656+0000 7fa8cd5fe640 1 --2- 172.21.15.2:0/660758303 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa8b40a33b0 0x7fa8b40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:22.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.656+0000 7fa8ccdfd640 1 --2- 172.21.15.2:0/3367605272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4cd6d95d0 0x55f4cd6d9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:22.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.656+0000 7fa8cddff640 1 --2- 172.21.15.2:0/3367605272 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f4cd6e4370 0x55f4cd6e6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:22.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.656+0000 7fa8cddff640 1 -- 172.21.15.2:0/3367605272 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f4cd6e4370 msgr2=0x55f4cd6e6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:22.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.656+0000 7fa8cddff640 1 --2- 172.21.15.2:0/3367605272 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f4cd6e4370 0x55f4cd6e6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:22.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.656+0000 7fa8cddff640 1 -- 172.21.15.2:0/3367605272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4cd6d95d0 msgr2=0x55f4cd6d9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:22.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.656+0000 7fa8cddff640 1 --2- 172.21.15.2:0/3367605272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4cd6d95d0 0x55f4cd6d9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:22.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.656+0000 7fa8cddff640 1 -- 172.21.15.2:0/3367605272 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4cd5cb3a0 con 0x55f4cd6dab40 2024-09-19T06:18:22.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.656+0000 7fa8ccdfd640 1 --2- 172.21.15.2:0/3367605272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4cd6d95d0 0x55f4cd6d9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:18:22.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.656+0000 7fa8cddff640 1 --2- 172.21.15.2:0/3367605272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4cd6dab40 0x55f4cd6d9090 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0009430 tx=0x7fa8c00093a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca40dc50277fff13 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:22.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.656+0000 7fa8cd5fe640 1 --2- 172.21.15.2:0/660758303 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa8b40a33b0 0x7fa8b40a5870 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa8c400cfd0 tx=0x7fa8c400fe70 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:22.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.656+0000 7fa8b37fe640 1 -- 172.21.15.2:0/3367605272 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c0044020 con 0x55f4cd6dab40 2024-09-19T06:18:22.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.656+0000 7fa8b37fe640 1 -- 172.21.15.2:0/3367605272 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa8c0036070 con 0x55f4cd6dab40 2024-09-19T06:18:22.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.656+0000 7fa8b37fe640 1 -- 172.21.15.2:0/3367605272 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c0004280 con 0x55f4cd6dab40 2024-09-19T06:18:22.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.657+0000 7fa8d1c3b740 1 -- 172.21.15.2:0/3367605272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4cd6dab40 msgr2=0x55f4cd6d9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:22.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.657+0000 7fa8d1c3b740 1 --2- 172.21.15.2:0/3367605272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4cd6dab40 0x55f4cd6d9090 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0009430 tx=0x7fa8c00093a0 comp rx=0 tx=0).stop 2024-09-19T06:18:22.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.657+0000 7fa8d1c3b740 1 -- 172.21.15.2:0/3367605272 shutdown_connections 2024-09-19T06:18:22.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.657+0000 7fa8d1c3b740 1 --2- 172.21.15.2:0/3367605272 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f4cd6e4370 0x55f4cd6e6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:22.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.657+0000 7fa8d1c3b740 1 --2- 172.21.15.2:0/3367605272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4cd6d95d0 0x55f4cd6d9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:22.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.657+0000 7fa8d1c3b740 1 --2- 172.21.15.2:0/3367605272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4cd6dab40 0x55f4cd6d9090 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:22.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.657+0000 7fa8d1c3b740 1 -- 172.21.15.2:0/3367605272 >> 172.21.15.2:0/3367605272 conn(0x55f4cd6a2310 msgr2=0x55f4cd6d5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:22.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.657+0000 7fa8d1c3b740 1 -- 172.21.15.2:0/3367605272 shutdown_connections 2024-09-19T06:18:22.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.657+0000 7fa8d1c3b740 1 -- 172.21.15.2:0/3367605272 wait complete. 2024-09-19T06:18:22.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.657+0000 7fa8d1c3b740 1 -- start start 2024-09-19T06:18:22.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.658+0000 7fa8d1c3b740 1 Processor -- start 2024-09-19T06:18:22.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.658+0000 7fa8d1c3b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4cd6d95d0 0x55f4cd6e3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:22.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.658+0000 7fa8d1c3b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f4cd6dab40 0x55f4cd6e0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:22.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.658+0000 7fa8d1c3b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4cd6e4370 0x55f4cd6e1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:22.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.658+0000 7fa8d1c3b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f4cd6e7010 con 0x55f4cd6e4370 2024-09-19T06:18:22.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.658+0000 7fa8d1c3b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55f4cd5fa060 con 0x55f4cd6d95d0 2024-09-19T06:18:22.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.658+0000 7fa8d1c3b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f4cd6e7190 con 0x55f4cd6dab40 2024-09-19T06:18:22.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.658+0000 7fa8d1c3b740 10 client.0 _ll_register_callbacks cb 0x55f4cd34d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:22.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.658+0000 7fa8cddff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4cd6e4370 0x55f4cd6e1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:22.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.658+0000 7fa8cddff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4cd6e4370 0x55f4cd6e1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45454/0 (socket says 172.21.15.2:45454) 2024-09-19T06:18:22.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.658+0000 7fa8cddff640 1 -- 172.21.15.2:0/1042747961 learned_addr learned my addr 172.21.15.2:0/1042747961 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:22.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.658+0000 7fa8cddff640 1 --2- 172.21.15.2:0/1042747961 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4cd6d95d0 0x55f4cd6e3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:22.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.658+0000 7fa8ccdfd640 1 --2- 172.21.15.2:0/1042747961 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f4cd6dab40 0x55f4cd6e0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:22.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.659+0000 7fa8cddff640 1 -- 172.21.15.2:0/1042747961 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f4cd6dab40 msgr2=0x55f4cd6e0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:22.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.659+0000 7fa8cddff640 1 --2- 172.21.15.2:0/1042747961 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f4cd6dab40 0x55f4cd6e0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:22.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.659+0000 7fa8cddff640 1 -- 172.21.15.2:0/1042747961 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4cd6d95d0 msgr2=0x55f4cd6e3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:22.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.659+0000 7fa8cddff640 1 --2- 172.21.15.2:0/1042747961 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4cd6d95d0 0x55f4cd6e3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:22.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.659+0000 7fa8cddff640 1 -- 172.21.15.2:0/1042747961 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4cd3b03c0 con 0x55f4cd6e4370 2024-09-19T06:18:22.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.659+0000 7fa8cddff640 1 --2- 172.21.15.2:0/1042747961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4cd6e4370 0x55f4cd6e1530 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0009ca0 tx=0x7fa8c0031e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfe83f5b719188b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:22.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.659+0000 7fa8b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:18:22.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.659+0000 7fa8b0ff9640 1 -- 172.21.15.2:0/1042747961 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c0044070 con 0x55f4cd6e4370 2024-09-19T06:18:22.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.659+0000 7fa8d1c3b740 1 -- 172.21.15.2:0/1042747961 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8c0036070 con 0x55f4cd6e4370 2024-09-19T06:18:22.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.659+0000 7fa8b0ff9640 1 -- 172.21.15.2:0/1042747961 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fa8c0003e20 con 0x55f4cd6e4370 2024-09-19T06:18:22.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.659+0000 7fa8b0ff9640 1 -- 172.21.15.2:0/1042747961 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa8c0004250 con 0x55f4cd6e4370 2024-09-19T06:18:22.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.659+0000 7fa8d1c3b740 10 client.16224 fetch_fsmap learned FSMap version 26 2024-09-19T06:18:22.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.659+0000 7fa8d1c3b740 1 -- 172.21.15.2:0/1042747961 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f4cd6e7010 con 0x55f4cd6e4370 2024-09-19T06:18:22.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.659+0000 7fa8b0ff9640 1 -- 172.21.15.2:0/1042747961 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa8c0036070 con 0x55f4cd6e4370 2024-09-19T06:18:22.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.660+0000 7fa8b0ff9640 1 -- 172.21.15.2:0/1042747961 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fa8c0030b90 con 0x55f4cd6e4370 2024-09-19T06:18:22.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.660+0000 7fa8d1c3b740 10 client.16224 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:18:22.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.660+0000 7fa8d1c3b740 10 client.16224 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:18:22.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.660+0000 7fa8d1c3b740 20 client.16224 populate_metadata read hostname 'smithi002' 2024-09-19T06:18:22.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.660+0000 7fa8d1c3b740 1 --2- 172.21.15.2:0/1042747961 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55f4cd6f3ba0 0x55f4cd6f5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:22.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.660+0000 7fa8d1c3b740 4 client.16224 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:18:22.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.660+0000 7fa8d1c3b740 1 -- 172.21.15.2:0/1042747961 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f4cd64c860 con 0x55f4cd6f3ba0 2024-09-19T06:18:22.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.660+0000 7fa8ccdfd640 1 --2- 172.21.15.2:0/1042747961 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55f4cd6f3ba0 0x55f4cd6f5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:22.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.660+0000 7fa8ccdfd640 1 --2- 172.21.15.2:0/1042747961 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55f4cd6f3ba0 0x55f4cd6f5f90 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5aa2bb96f909e237 server_cookie=c9104ab174f1ca8a in_seq=0 out_seq=0 2024-09-19T06:18:22.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.660+0000 7fa8b0ff9640 10 client.16224 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:18:22.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.661+0000 7fa8b0ff9640 1 -- 172.21.15.2:0/1042747961 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f4cd64c860 con 0x55f4cd6f3ba0 2024-09-19T06:18:22.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.661+0000 7fa8b0ff9640 10 client.16224 handle_command_reply: tid=0 2024-09-19T06:18:22.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.661+0000 7fa8d1c3b740 1 client.16224 shutdown 2024-09-19T06:18:22.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.661+0000 7fa8d1c3b740 1 -- 172.21.15.2:0/1042747961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4cd6e4370 msgr2=0x55f4cd6e1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:22.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.661+0000 7fa8d1c3b740 1 --2- 172.21.15.2:0/1042747961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4cd6e4370 0x55f4cd6e1530 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0009ca0 tx=0x7fa8c0031e50 comp rx=0 tx=0).stop 2024-09-19T06:18:22.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.661+0000 7fa8d1c3b740 1 -- 172.21.15.2:0/1042747961 shutdown_connections 2024-09-19T06:18:22.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.661+0000 7fa8d1c3b740 1 --2- 172.21.15.2:0/1042747961 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55f4cd6f3ba0 0x55f4cd6f5f90 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:22.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.661+0000 7fa8d1c3b740 1 --2- 172.21.15.2:0/1042747961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4cd6e4370 0x55f4cd6e1530 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:22.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.661+0000 7fa8d1c3b740 1 --2- 172.21.15.2:0/1042747961 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f4cd6dab40 0x55f4cd6e0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:22.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.661+0000 7fa8d1c3b740 1 --2- 172.21.15.2:0/1042747961 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4cd6d95d0 0x55f4cd6e3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:22.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.661+0000 7fa8d1c3b740 1 -- 172.21.15.2:0/1042747961 >> 172.21.15.2:0/1042747961 conn(0x55f4cd6a2310 msgr2=0x55f4cd6db930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:22.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.661+0000 7fa8b0ff9640 0 client.16224 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:18:22.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.662+0000 7fa8d1c3b740 1 -- 172.21.15.2:0/1042747961 shutdown_connections 2024-09-19T06:18:22.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.662+0000 7fa8d1c3b740 1 -- 172.21.15.2:0/1042747961 wait complete. 2024-09-19T06:18:22.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.662+0000 7fa8d1c3b740 20 client.16224 trim_cache size 0 max 16384 2024-09-19T06:18:22.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.675+0000 7fa8d1c3b740 1 Processor -- start 2024-09-19T06:18:22.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.675+0000 7fa8d1c3b740 1 -- start start 2024-09-19T06:18:22.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.675+0000 7fa8d1c3b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4cd6d95d0 0x55f4cd6f02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:22.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.675+0000 7fa8d1c3b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4cd6dab40 0x55f4cd6dc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:22.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.675+0000 7fa8d1c3b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f4cd6e4370 0x55f4cd6dc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:22.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.675+0000 7fa8d1c3b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c81ba8c0 con 0x55f4cd6d95d0 2024-09-19T06:18:22.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.675+0000 7fa8d1c3b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c81b8190 con 0x55f4cd6dab40 2024-09-19T06:18:22.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.675+0000 7fa8d1c3b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c81b5fe0 con 0x55f4cd6e4370 2024-09-19T06:18:22.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.675+0000 7fa8cddff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4cd6d95d0 0x55f4cd6f02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:22.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.675+0000 7fa8cddff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4cd6d95d0 0x55f4cd6f02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45464/0 (socket says 172.21.15.2:45464) 2024-09-19T06:18:22.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.675+0000 7fa8cddff640 1 -- 172.21.15.2:0/3710766701 learned_addr learned my addr 172.21.15.2:0/3710766701 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:22.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.675+0000 7fa8ccdfd640 1 --2- 172.21.15.2:0/3710766701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4cd6dab40 0x55f4cd6dc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:22.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.675+0000 7fa8cddff640 1 -- 172.21.15.2:0/3710766701 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f4cd6e4370 msgr2=0x55f4cd6dc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:22.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.675+0000 7fa8cddff640 1 --2- 172.21.15.2:0/3710766701 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f4cd6e4370 0x55f4cd6dc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:22.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.675+0000 7fa8cddff640 1 -- 172.21.15.2:0/3710766701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4cd6dab40 msgr2=0x55f4cd6dc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:22.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.675+0000 7fa8cddff640 1 --2- 172.21.15.2:0/3710766701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4cd6dab40 0x55f4cd6dc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:22.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.675+0000 7fa8cddff640 1 -- 172.21.15.2:0/3710766701 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4cd6dcba0 con 0x55f4cd6d95d0 2024-09-19T06:18:22.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.675+0000 7fa8cddff640 1 --2- 172.21.15.2:0/3710766701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4cd6d95d0 0x55f4cd6f02b0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0031e20 tx=0x7fa8c002f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c1fd6906c0055c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:22.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.676+0000 7fa8b2ffd640 1 -- 172.21.15.2:0/3710766701 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c0044070 con 0x55f4cd6d95d0 2024-09-19T06:18:22.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.676+0000 7fa8b2ffd640 1 -- 172.21.15.2:0/3710766701 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa8c0036070 con 0x55f4cd6d95d0 2024-09-19T06:18:22.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.676+0000 7fa8b2ffd640 1 -- 172.21.15.2:0/3710766701 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c0003e00 con 0x55f4cd6d95d0 2024-09-19T06:18:22.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.676+0000 7fa8d1c3b740 1 -- 172.21.15.2:0/3710766701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4cd6d95d0 msgr2=0x55f4cd6f02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:22.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.676+0000 7fa8d1c3b740 1 --2- 172.21.15.2:0/3710766701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4cd6d95d0 0x55f4cd6f02b0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0031e20 tx=0x7fa8c002f7f0 comp rx=0 tx=0).stop 2024-09-19T06:18:22.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.676+0000 7fa8d1c3b740 1 -- 172.21.15.2:0/3710766701 shutdown_connections 2024-09-19T06:18:22.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.676+0000 7fa8d1c3b740 1 --2- 172.21.15.2:0/3710766701 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f4cd6e4370 0x55f4cd6dc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:22.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.676+0000 7fa8d1c3b740 1 --2- 172.21.15.2:0/3710766701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4cd6dab40 0x55f4cd6dc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:22.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.676+0000 7fa8d1c3b740 1 --2- 172.21.15.2:0/3710766701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4cd6d95d0 0x55f4cd6f02b0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:22.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.676+0000 7fa8d1c3b740 1 -- 172.21.15.2:0/3710766701 >> 172.21.15.2:0/3710766701 conn(0x55f4cd6a2310 msgr2=0x55f4cd6e00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:22.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.676+0000 7fa8d1c3b740 1 -- 172.21.15.2:0/3710766701 shutdown_connections 2024-09-19T06:18:22.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.676+0000 7fa8d1c3b740 1 -- 172.21.15.2:0/3710766701 wait complete. 2024-09-19T06:18:22.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.677+0000 7fa8d1c3b740 1 -- start start 2024-09-19T06:18:22.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.677+0000 7fa8d1c3b740 1 Processor -- start 2024-09-19T06:18:22.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.677+0000 7fa8d1c3b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4cd6d95d0 0x55f4cd6ec910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:22.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.677+0000 7fa8d1c3b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4cd6dab40 0x55f4cd6e7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:22.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.677+0000 7fa8d1c3b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f4cd6e4370 0x55f4cd6e8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:22.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.677+0000 7fa8d1c3b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c81b6650 con 0x55f4cd6dab40 2024-09-19T06:18:22.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.677+0000 7fa8d1c3b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c81b7ac0 con 0x55f4cd6d95d0 2024-09-19T06:18:22.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.677+0000 7fa8d1c3b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c81b6d20 con 0x55f4cd6e4370 2024-09-19T06:18:22.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.677+0000 7fa8d1c3b740 10 client.0 _ll_register_callbacks cb 0x7fa8c0031670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:22.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.677+0000 7fa8ccdfd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4cd6dab40 0x55f4cd6e7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:22.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.677+0000 7fa8ccdfd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4cd6dab40 0x55f4cd6e7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45480/0 (socket says 172.21.15.2:45480) 2024-09-19T06:18:22.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.677+0000 7fa8ccdfd640 1 -- 172.21.15.2:0/3601940480 learned_addr learned my addr 172.21.15.2:0/3601940480 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:22.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.678+0000 7fa8cddff640 1 --2- 172.21.15.2:0/3601940480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4cd6d95d0 0x55f4cd6ec910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:22.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.678+0000 7fa8cddff640 1 --2- 172.21.15.2:0/3601940480 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f4cd6e4370 0x55f4cd6e8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:22.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.678+0000 7fa8ccdfd640 1 -- 172.21.15.2:0/3601940480 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f4cd6e4370 msgr2=0x55f4cd6e8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:22.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.678+0000 7fa8ccdfd640 1 --2- 172.21.15.2:0/3601940480 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f4cd6e4370 0x55f4cd6e8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:22.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.678+0000 7fa8ccdfd640 1 -- 172.21.15.2:0/3601940480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4cd6d95d0 msgr2=0x55f4cd6ec910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:22.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.678+0000 7fa8ccdfd640 1 --2- 172.21.15.2:0/3601940480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4cd6d95d0 0x55f4cd6ec910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:22.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.678+0000 7fa8ccdfd640 1 -- 172.21.15.2:0/3601940480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4cd6e8740 con 0x55f4cd6dab40 2024-09-19T06:18:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.678+0000 7fa8cddff640 1 --2- 172.21.15.2:0/3601940480 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f4cd6e4370 0x55f4cd6e8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:18:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.678+0000 7fa8ccdfd640 1 --2- 172.21.15.2:0/3601940480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4cd6dab40 0x55f4cd6e7c40 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x55f4cd6d6ac0 tx=0x7fa8b8010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58514d1a21f63a5a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.678+0000 7fa8b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:18:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.678+0000 7fa8b0ff9640 1 -- 172.21.15.2:0/3601940480 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b8004020 con 0x55f4cd6dab40 2024-09-19T06:18:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.678+0000 7fa8b0ff9640 1 -- 172.21.15.2:0/3601940480 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fa8b80041c0 con 0x55f4cd6dab40 2024-09-19T06:18:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.678+0000 7fa8d1c3b740 1 -- 172.21.15.2:0/3601940480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8c0036070 con 0x55f4cd6dab40 2024-09-19T06:18:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.678+0000 7fa8b0ff9640 1 -- 172.21.15.2:0/3601940480 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa8b80043c0 con 0x55f4cd6dab40 2024-09-19T06:18:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.678+0000 7fa8d1c3b740 10 client.16230 fetch_fsmap learned FSMap version 26 2024-09-19T06:18:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.678+0000 7fa8d1c3b740 1 -- 172.21.15.2:0/3601940480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f4cd75e410 con 0x55f4cd6dab40 2024-09-19T06:18:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.679+0000 7fa8b0ff9640 1 -- 172.21.15.2:0/3601940480 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa8c0036070 con 0x55f4cd6dab40 2024-09-19T06:18:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.679+0000 7fa8b0ff9640 1 -- 172.21.15.2:0/3601940480 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fa8b8022820 con 0x55f4cd6dab40 2024-09-19T06:18:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.679+0000 7fa8d1c3b740 10 client.16230 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:18:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.679+0000 7fa8d1c3b740 10 client.16230 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:18:22.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.679+0000 7fa8d1c3b740 20 client.16230 populate_metadata read hostname 'smithi002' 2024-09-19T06:18:22.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.679+0000 7fa8d1c3b740 1 --2- 172.21.15.2:0/3601940480 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55f4cd75eb70 0x55f4cd760f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:22.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.679+0000 7fa8d1c3b740 4 client.16230 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:18:22.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.679+0000 7fa8d1c3b740 1 -- 172.21.15.2:0/3601940480 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f4cd646d70 con 0x55f4cd75eb70 2024-09-19T06:18:22.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.679+0000 7fa8cddff640 1 --2- 172.21.15.2:0/3601940480 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55f4cd75eb70 0x55f4cd760f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:22.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.680+0000 7fa8cddff640 1 --2- 172.21.15.2:0/3601940480 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55f4cd75eb70 0x55f4cd760f90 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ff2593c07b7c0eff server_cookie=d1642f834b496dc9 in_seq=0 out_seq=0 2024-09-19T06:18:22.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.680+0000 7fa8b0ff9640 10 client.16230 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:18:22.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.680+0000 7fa8b0ff9640 1 -- 172.21.15.2:0/3601940480 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f4cd646d70 con 0x55f4cd75eb70 2024-09-19T06:18:22.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.680+0000 7fa8b0ff9640 10 client.16230 handle_command_reply: tid=0 2024-09-19T06:18:22.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.680+0000 7fa8d1c3b740 1 client.16230 shutdown 2024-09-19T06:18:22.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.680+0000 7fa8d1c3b740 1 -- 172.21.15.2:0/3601940480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4cd6dab40 msgr2=0x55f4cd6e7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:22.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.680+0000 7fa8d1c3b740 1 --2- 172.21.15.2:0/3601940480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4cd6dab40 0x55f4cd6e7c40 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x55f4cd6d6ac0 tx=0x7fa8b8010800 comp rx=0 tx=0).stop 2024-09-19T06:18:22.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.680+0000 7fa8d1c3b740 1 -- 172.21.15.2:0/3601940480 shutdown_connections 2024-09-19T06:18:22.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.680+0000 7fa8d1c3b740 1 --2- 172.21.15.2:0/3601940480 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55f4cd75eb70 0x55f4cd760f90 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:22.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.680+0000 7fa8d1c3b740 1 --2- 172.21.15.2:0/3601940480 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f4cd6e4370 0x55f4cd6e8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:22.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.680+0000 7fa8d1c3b740 1 --2- 172.21.15.2:0/3601940480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4cd6dab40 0x55f4cd6e7c40 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:22.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.680+0000 7fa8d1c3b740 1 --2- 172.21.15.2:0/3601940480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4cd6d95d0 0x55f4cd6ec910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:22.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.680+0000 7fa8d1c3b740 1 -- 172.21.15.2:0/3601940480 >> 172.21.15.2:0/3601940480 conn(0x55f4cd6a2310 msgr2=0x55f4cd6e2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:22.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.680+0000 7fa8b0ff9640 0 client.16230 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:18:22.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.680+0000 7fa8d1c3b740 1 -- 172.21.15.2:0/3601940480 shutdown_connections 2024-09-19T06:18:22.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.680+0000 7fa8d1c3b740 1 -- 172.21.15.2:0/3601940480 wait complete. 2024-09-19T06:18:22.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.680+0000 7fa8d1c3b740 20 client.16230 trim_cache size 0 max 16384 2024-09-19T06:18:22.689 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:18:22.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.681+0000 7fa8cf862640 1 -- 172.21.15.2:0/660758303 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa8b40a33b0 msgr2=0x7fa8b40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:22.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.681+0000 7fa8cf862640 1 --2- 172.21.15.2:0/660758303 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa8b40a33b0 0x7fa8b40a5870 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa8c400cfd0 tx=0x7fa8c400fe70 comp rx=0 tx=0).stop 2024-09-19T06:18:22.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.681+0000 7fa8cf862640 1 -- 172.21.15.2:0/660758303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8c810c590 msgr2=0x7fa8c81a87a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:22.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.681+0000 7fa8cf862640 1 --2- 172.21.15.2:0/660758303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8c810c590 0x7fa8c81a87a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fa8c400c920 tx=0x7fa8c400cde0 comp rx=0 tx=0).stop 2024-09-19T06:18:22.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.681+0000 7fa8cf862640 1 -- 172.21.15.2:0/660758303 shutdown_connections 2024-09-19T06:18:22.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.681+0000 7fa8cf862640 1 --2- 172.21.15.2:0/660758303 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa8b40a33b0 0x7fa8b40a5870 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:22.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.681+0000 7fa8cf862640 1 --2- 172.21.15.2:0/660758303 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8c8112640 0x7fa8c81a2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:22.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.681+0000 7fa8cf862640 1 --2- 172.21.15.2:0/660758303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8c810cf30 0x7fa8c81a8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:22.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.681+0000 7fa8cf862640 1 --2- 172.21.15.2:0/660758303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8c810c590 0x7fa8c81a87a0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:22.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.681+0000 7fa8cf862640 1 -- 172.21.15.2:0/660758303 >> 172.21.15.2:0/660758303 conn(0x7fa8c806cdc0 msgr2=0x7fa8c810ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:22.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.681+0000 7fa8cf862640 1 -- 172.21.15.2:0/660758303 shutdown_connections 2024-09-19T06:18:22.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:22.681+0000 7fa8cf862640 1 -- 172.21.15.2:0/660758303 wait complete. 2024-09-19T06:18:23.524 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:18:23.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:23 smithi002 ceph-mon[30982]: pgmap v110: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:18:23.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:23 smithi090 ceph-mon[34497]: pgmap v110: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:18:23.786 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:18:23.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:23 smithi089 ceph-mon[34160]: pgmap v110: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:18:24.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.283+0000 7f560dd08640 1 -- 172.21.15.2:0/3022369577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5608103660 msgr2=0x7f560810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:24.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.283+0000 7f560dd08640 1 --2- 172.21.15.2:0/3022369577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5608103660 0x7f560810bb50 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f55fc009900 tx=0x7f55fc02a480 comp rx=0 tx=0).stop 2024-09-19T06:18:24.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.284+0000 7f560dd08640 1 -- 172.21.15.2:0/3022369577 shutdown_connections 2024-09-19T06:18:24.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.284+0000 7f560dd08640 1 --2- 172.21.15.2:0/3022369577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f560810c170 0x7f560810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.284+0000 7f560dd08640 1 --2- 172.21.15.2:0/3022369577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5608103660 0x7f560810bb50 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.284+0000 7f560dd08640 1 --2- 172.21.15.2:0/3022369577 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5608102d40 0x7f5608103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.284+0000 7f560dd08640 1 -- 172.21.15.2:0/3022369577 >> 172.21.15.2:0/3022369577 conn(0x7f56080fc7a0 msgr2=0x7f56080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:24.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.284+0000 7f560dd08640 1 -- 172.21.15.2:0/3022369577 shutdown_connections 2024-09-19T06:18:24.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.284+0000 7f560dd08640 1 -- 172.21.15.2:0/3022369577 wait complete. 2024-09-19T06:18:24.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.284+0000 7f560dd08640 1 Processor -- start 2024-09-19T06:18:24.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.284+0000 7f560dd08640 1 -- start start 2024-09-19T06:18:24.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.285+0000 7f560dd08640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5608102d40 0x7f5608198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:24.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.285+0000 7f560dd08640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5608103660 0x7f56081988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:24.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.285+0000 7f560dd08640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f560810c170 0x7f560819cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:24.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.285+0000 7f560dd08640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5608111e20 con 0x7f5608103660 2024-09-19T06:18:24.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.285+0000 7f560dd08640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f5608111ca0 con 0x7f560810c170 2024-09-19T06:18:24.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.285+0000 7f560dd08640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5608111fa0 con 0x7f5608102d40 2024-09-19T06:18:24.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.285+0000 7f5606ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5608103660 0x7f56081988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:24.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.285+0000 7f5606ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5608103660 0x7f56081988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45508/0 (socket says 172.21.15.2:45508) 2024-09-19T06:18:24.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.285+0000 7f5606ffd640 1 -- 172.21.15.2:0/999649495 learned_addr learned my addr 172.21.15.2:0/999649495 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:24.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.285+0000 7f56077fe640 1 --2- 172.21.15.2:0/999649495 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5608102d40 0x7f5608198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:24.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.285+0000 7f5607fff640 1 --2- 172.21.15.2:0/999649495 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f560810c170 0x7f560819cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:24.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.285+0000 7f5606ffd640 1 -- 172.21.15.2:0/999649495 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5608102d40 msgr2=0x7f5608198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:24.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.285+0000 7f5606ffd640 1 --2- 172.21.15.2:0/999649495 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5608102d40 0x7f5608198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.285+0000 7f5606ffd640 1 -- 172.21.15.2:0/999649495 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f560810c170 msgr2=0x7f560819cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:24.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.285+0000 7f5606ffd640 1 --2- 172.21.15.2:0/999649495 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f560810c170 0x7f560819cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.285+0000 7f5606ffd640 1 -- 172.21.15.2:0/999649495 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f560819d320 con 0x7f5608103660 2024-09-19T06:18:24.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.285+0000 7f5606ffd640 1 --2- 172.21.15.2:0/999649495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5608103660 0x7f56081988b0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f55fc005940 tx=0x7f55fc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:24.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.286+0000 7f5604ff9640 1 -- 172.21.15.2:0/999649495 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55fc03f030 con 0x7f5608103660 2024-09-19T06:18:24.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.286+0000 7f5604ff9640 1 -- 172.21.15.2:0/999649495 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f55fc003cb0 con 0x7f5608103660 2024-09-19T06:18:24.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.286+0000 7f560dd08640 1 -- 172.21.15.2:0/999649495 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f560819d5b0 con 0x7f5608103660 2024-09-19T06:18:24.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.286+0000 7f5604ff9640 1 -- 172.21.15.2:0/999649495 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55fc035070 con 0x7f5608103660 2024-09-19T06:18:24.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.286+0000 7f560dd08640 1 -- 172.21.15.2:0/999649495 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56081a4ef0 con 0x7f5608103660 2024-09-19T06:18:24.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.288+0000 7f5604ff9640 1 -- 172.21.15.2:0/999649495 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f55fc042030 con 0x7f5608103660 2024-09-19T06:18:24.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.288+0000 7f56100e1740 1 Processor -- start 2024-09-19T06:18:24.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.288+0000 7f56100e1740 1 -- start start 2024-09-19T06:18:24.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.288+0000 7f56100e1740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ddd5c7b40 0x562ddd5c6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:24.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.288+0000 7f56100e1740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ddd5c65d0 0x562ddd5c6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:24.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.289+0000 7f56100e1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ddd5d1370 0x562ddd5d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:24.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.289+0000 7f56100e1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562ddd52c2f0 con 0x562ddd5d1370 2024-09-19T06:18:24.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.289+0000 7f56100e1740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562ddd4d3cf0 con 0x562ddd5c7b40 2024-09-19T06:18:24.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.289+0000 7f56100e1740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562ddd5282b0 con 0x562ddd5c65d0 2024-09-19T06:18:24.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.289+0000 7f5606ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ddd5d1370 0x562ddd5d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:24.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.289+0000 7f5604ff9640 1 --2- 172.21.15.2:0/999649495 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f55f00a33b0 0x7f55f00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:24.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.289+0000 7f5606ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ddd5d1370 0x562ddd5d3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45516/0 (socket says 172.21.15.2:45516) 2024-09-19T06:18:24.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.289+0000 7f5606ffd640 1 -- 172.21.15.2:0/2982819833 learned_addr learned my addr 172.21.15.2:0/2982819833 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:24.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.289+0000 7f5607fff640 1 --2- 172.21.15.2:0/2982819833 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ddd5c7b40 0x562ddd5c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:24.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.289+0000 7f56077fe640 1 --2- 172.21.15.2:0/2982819833 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ddd5c65d0 0x562ddd5c6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:24.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.289+0000 7f5607fff640 1 --2- 172.21.15.2:0/999649495 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f55f00a33b0 0x7f55f00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:24.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.289+0000 7f5604ff9640 1 -- 172.21.15.2:0/999649495 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f55fc0f0460 con 0x7f5608103660 2024-09-19T06:18:24.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.289+0000 7f5606ffd640 1 -- 172.21.15.2:0/2982819833 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ddd5c65d0 msgr2=0x562ddd5c6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:24.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.289+0000 7f5606ffd640 1 --2- 172.21.15.2:0/2982819833 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ddd5c65d0 0x562ddd5c6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.289+0000 7f5606ffd640 1 -- 172.21.15.2:0/2982819833 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ddd5c7b40 msgr2=0x562ddd5c6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:24.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.289+0000 7f5606ffd640 1 --2- 172.21.15.2:0/2982819833 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ddd5c7b40 0x562ddd5c6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.289+0000 7f5606ffd640 1 -- 172.21.15.2:0/2982819833 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ddd4b83a0 con 0x562ddd5d1370 2024-09-19T06:18:24.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.289+0000 7f56077fe640 1 --2- 172.21.15.2:0/2982819833 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ddd5c65d0 0x562ddd5c6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:18:24.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.289+0000 7f5606ffd640 1 --2- 172.21.15.2:0/2982819833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ddd5d1370 0x562ddd5d3760 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f55fc0bc520 tx=0x7f55fc02a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=499a220aa5fa88a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:24.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.289+0000 7f5607fff640 1 --2- 172.21.15.2:0/999649495 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f55f00a33b0 0x7f55f00a5870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5600009fd0 tx=0x7f5600009600 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:24.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.290+0000 7f55edffb640 1 -- 172.21.15.2:0/2982819833 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55fc049070 con 0x562ddd5d1370 2024-09-19T06:18:24.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.290+0000 7f55edffb640 1 -- 172.21.15.2:0/2982819833 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f55fc03b460 con 0x562ddd5d1370 2024-09-19T06:18:24.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.290+0000 7f55edffb640 1 -- 172.21.15.2:0/2982819833 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55fc0c0b20 con 0x562ddd5d1370 2024-09-19T06:18:24.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.290+0000 7f56100e1740 1 -- 172.21.15.2:0/2982819833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ddd5d1370 msgr2=0x562ddd5d3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:24.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.290+0000 7f56100e1740 1 --2- 172.21.15.2:0/2982819833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ddd5d1370 0x562ddd5d3760 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f55fc0bc520 tx=0x7f55fc02a480 comp rx=0 tx=0).stop 2024-09-19T06:18:24.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.290+0000 7f56100e1740 1 -- 172.21.15.2:0/2982819833 shutdown_connections 2024-09-19T06:18:24.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.290+0000 7f56100e1740 1 --2- 172.21.15.2:0/2982819833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ddd5d1370 0x562ddd5d3760 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.290+0000 7f56100e1740 1 --2- 172.21.15.2:0/2982819833 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ddd5c65d0 0x562ddd5c6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.290+0000 7f56100e1740 1 --2- 172.21.15.2:0/2982819833 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ddd5c7b40 0x562ddd5c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.290+0000 7f56100e1740 1 -- 172.21.15.2:0/2982819833 >> 172.21.15.2:0/2982819833 conn(0x562ddd58f310 msgr2=0x562ddd5c2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:24.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.290+0000 7f56100e1740 1 -- 172.21.15.2:0/2982819833 shutdown_connections 2024-09-19T06:18:24.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.290+0000 7f56100e1740 1 -- 172.21.15.2:0/2982819833 wait complete. 2024-09-19T06:18:24.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.291+0000 7f56100e1740 1 -- start start 2024-09-19T06:18:24.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.291+0000 7f56100e1740 1 Processor -- start 2024-09-19T06:18:24.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.291+0000 7f56100e1740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ddd5c65d0 0x562ddd5d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:24.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.291+0000 7f56100e1740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ddd5c7b40 0x562ddd5ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:24.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.291+0000 7f56100e1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ddd5d1370 0x562ddd5ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:24.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.291+0000 7f56100e1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562ddd5d3e30 con 0x562ddd5d1370 2024-09-19T06:18:24.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.291+0000 7f56100e1740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562ddd4e7060 con 0x562ddd5c7b40 2024-09-19T06:18:24.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.291+0000 7f56100e1740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562ddd5d3fb0 con 0x562ddd5c65d0 2024-09-19T06:18:24.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.291+0000 7f56100e1740 10 client.0 _ll_register_callbacks cb 0x562ddd23a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:24.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.291+0000 7f5607fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ddd5d1370 0x562ddd5ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:24.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.291+0000 7f5607fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ddd5d1370 0x562ddd5ce7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45526/0 (socket says 172.21.15.2:45526) 2024-09-19T06:18:24.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.291+0000 7f5607fff640 1 -- 172.21.15.2:0/1496547518 learned_addr learned my addr 172.21.15.2:0/1496547518 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:24.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.291+0000 7f5606ffd640 1 --2- 172.21.15.2:0/1496547518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ddd5c7b40 0x562ddd5ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:24.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.292+0000 7f56077fe640 1 --2- 172.21.15.2:0/1496547518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ddd5c65d0 0x562ddd5d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:24.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.292+0000 7f5607fff640 1 -- 172.21.15.2:0/1496547518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ddd5c65d0 msgr2=0x562ddd5d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:24.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.292+0000 7f5607fff640 1 --2- 172.21.15.2:0/1496547518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ddd5c65d0 0x562ddd5d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.292+0000 7f5607fff640 1 -- 172.21.15.2:0/1496547518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ddd5c7b40 msgr2=0x562ddd5ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:24.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.292+0000 7f5607fff640 1 --2- 172.21.15.2:0/1496547518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ddd5c7b40 0x562ddd5ce0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.292+0000 7f5607fff640 1 -- 172.21.15.2:0/1496547518 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ddd29d3c0 con 0x562ddd5d1370 2024-09-19T06:18:24.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.292+0000 7f56077fe640 1 --2- 172.21.15.2:0/1496547518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ddd5c65d0 0x562ddd5d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:18:24.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.292+0000 7f5607fff640 1 --2- 172.21.15.2:0/1496547518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ddd5d1370 0x562ddd5ce7e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f560000ab90 tx=0x7f5600004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d2f7bf4fc408d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:24.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.292+0000 7f55e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:18:24.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.292+0000 7f55e6ffd640 1 -- 172.21.15.2:0/1496547518 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560001ebb0 con 0x562ddd5d1370 2024-09-19T06:18:24.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.292+0000 7f55e6ffd640 1 -- 172.21.15.2:0/1496547518 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f560001ed50 con 0x562ddd5d1370 2024-09-19T06:18:24.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.292+0000 7f56100e1740 1 -- 172.21.15.2:0/1496547518 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562ddd539860 con 0x562ddd5d1370 2024-09-19T06:18:24.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.292+0000 7f55e6ffd640 1 -- 172.21.15.2:0/1496547518 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5600004b20 con 0x562ddd5d1370 2024-09-19T06:18:24.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.292+0000 7f56100e1740 10 client.16242 fetch_fsmap learned FSMap version 26 2024-09-19T06:18:24.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.292+0000 7f56100e1740 1 -- 172.21.15.2:0/1496547518 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562ddd5df7c0 con 0x562ddd5d1370 2024-09-19T06:18:24.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.293+0000 7f55e6ffd640 1 -- 172.21.15.2:0/1496547518 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x562ddd539860 con 0x562ddd5d1370 2024-09-19T06:18:24.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.293+0000 7f55e6ffd640 1 -- 172.21.15.2:0/1496547518 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f560000f040 con 0x562ddd5d1370 2024-09-19T06:18:24.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.293+0000 7f56100e1740 10 client.16242 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:18:24.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.293+0000 7f56100e1740 10 client.16242 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:18:24.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.293+0000 7f56100e1740 20 client.16242 populate_metadata read hostname 'smithi002' 2024-09-19T06:18:24.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.293+0000 7f56100e1740 1 --2- 172.21.15.2:0/1496547518 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x562ddd5e0cd0 0x562ddd5e3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:24.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.293+0000 7f56100e1740 4 client.16242 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:18:24.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.293+0000 7f56100e1740 1 -- 172.21.15.2:0/1496547518 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ddd533d70 con 0x562ddd5e0cd0 2024-09-19T06:18:24.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.293+0000 7f56077fe640 1 --2- 172.21.15.2:0/1496547518 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x562ddd5e0cd0 0x562ddd5e3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:24.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.293+0000 7f55e6ffd640 10 client.16242 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:18:24.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.293+0000 7f56077fe640 1 --2- 172.21.15.2:0/1496547518 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x562ddd5e0cd0 0x562ddd5e3140 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ab9aba0547ed11a8 server_cookie=e18f1f59706d543a in_seq=0 out_seq=0 2024-09-19T06:18:24.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.294+0000 7f55e6ffd640 1 -- 172.21.15.2:0/1496547518 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562ddd533d70 con 0x562ddd5e0cd0 2024-09-19T06:18:24.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.294+0000 7f55e6ffd640 10 client.16242 handle_command_reply: tid=0 2024-09-19T06:18:24.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.294+0000 7f56100e1740 1 client.16242 shutdown 2024-09-19T06:18:24.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.294+0000 7f56100e1740 1 -- 172.21.15.2:0/1496547518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ddd5d1370 msgr2=0x562ddd5ce7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:24.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.294+0000 7f56100e1740 1 --2- 172.21.15.2:0/1496547518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ddd5d1370 0x562ddd5ce7e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f560000ab90 tx=0x7f5600004a40 comp rx=0 tx=0).stop 2024-09-19T06:18:24.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.294+0000 7f56100e1740 1 -- 172.21.15.2:0/1496547518 shutdown_connections 2024-09-19T06:18:24.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.294+0000 7f56100e1740 1 --2- 172.21.15.2:0/1496547518 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x562ddd5e0cd0 0x562ddd5e3140 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.294+0000 7f56100e1740 1 --2- 172.21.15.2:0/1496547518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ddd5d1370 0x562ddd5ce7e0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.294+0000 7f56100e1740 1 --2- 172.21.15.2:0/1496547518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ddd5c7b40 0x562ddd5ce0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.294+0000 7f55e6ffd640 0 client.16242 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:18:24.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.294+0000 7f56100e1740 1 --2- 172.21.15.2:0/1496547518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ddd5c65d0 0x562ddd5d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.294+0000 7f56100e1740 1 -- 172.21.15.2:0/1496547518 >> 172.21.15.2:0/1496547518 conn(0x562ddd58f310 msgr2=0x562ddd5c8990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:24.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.295+0000 7f56100e1740 1 -- 172.21.15.2:0/1496547518 shutdown_connections 2024-09-19T06:18:24.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.295+0000 7f56100e1740 1 -- 172.21.15.2:0/1496547518 wait complete. 2024-09-19T06:18:24.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.295+0000 7f56100e1740 20 client.16242 trim_cache size 0 max 16384 2024-09-19T06:18:24.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.308+0000 7f56100e1740 1 Processor -- start 2024-09-19T06:18:24.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.308+0000 7f56100e1740 1 -- start start 2024-09-19T06:18:24.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.308+0000 7f56100e1740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ddd5c65d0 0x562ddd5dd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:24.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.308+0000 7f56100e1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ddd5c7b40 0x562ddd5c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:24.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.308+0000 7f56100e1740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ddd5d1370 0x562ddd5c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:24.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.308+0000 7f56100e1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f56081b0020 con 0x562ddd5c7b40 2024-09-19T06:18:24.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.308+0000 7f56100e1740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f56081ad8f0 con 0x562ddd5c65d0 2024-09-19T06:18:24.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.308+0000 7f56100e1740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f56081ab740 con 0x562ddd5d1370 2024-09-19T06:18:24.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.308+0000 7f5606ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ddd5c7b40 0x562ddd5c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:24.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.308+0000 7f5606ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ddd5c7b40 0x562ddd5c9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45540/0 (socket says 172.21.15.2:45540) 2024-09-19T06:18:24.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.308+0000 7f5606ffd640 1 -- 172.21.15.2:0/2925210469 learned_addr learned my addr 172.21.15.2:0/2925210469 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:24.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.309+0000 7f5607fff640 1 --2- 172.21.15.2:0/2925210469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ddd5d1370 0x562ddd5c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:24.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.309+0000 7f56077fe640 1 --2- 172.21.15.2:0/2925210469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ddd5c65d0 0x562ddd5dd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:24.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.309+0000 7f5606ffd640 1 -- 172.21.15.2:0/2925210469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ddd5d1370 msgr2=0x562ddd5c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:24.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.309+0000 7f5606ffd640 1 --2- 172.21.15.2:0/2925210469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ddd5d1370 0x562ddd5c96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.309+0000 7f5606ffd640 1 -- 172.21.15.2:0/2925210469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ddd5c65d0 msgr2=0x562ddd5dd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:24.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.309+0000 7f5606ffd640 1 --2- 172.21.15.2:0/2925210469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ddd5c65d0 0x562ddd5dd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.309+0000 7f5606ffd640 1 -- 172.21.15.2:0/2925210469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ddd5d3dd0 con 0x562ddd5c7b40 2024-09-19T06:18:24.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.309+0000 7f56077fe640 1 --2- 172.21.15.2:0/2925210469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ddd5c65d0 0x562ddd5dd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:18:24.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.309+0000 7f5606ffd640 1 --2- 172.21.15.2:0/2925210469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ddd5c7b40 0x562ddd5c9180 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f55fc0b91f0 tx=0x7f55fc0f0760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e588a2aa44bfc0b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:24.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.309+0000 7f55ed7fa640 1 -- 172.21.15.2:0/2925210469 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55fc049070 con 0x562ddd5c7b40 2024-09-19T06:18:24.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.309+0000 7f55ed7fa640 1 -- 172.21.15.2:0/2925210469 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f55fc0c53e0 con 0x562ddd5c7b40 2024-09-19T06:18:24.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.309+0000 7f55ed7fa640 1 -- 172.21.15.2:0/2925210469 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55fc0b8ac0 con 0x562ddd5c7b40 2024-09-19T06:18:24.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.310+0000 7f56100e1740 1 -- 172.21.15.2:0/2925210469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ddd5c7b40 msgr2=0x562ddd5c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:24.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.310+0000 7f56100e1740 1 --2- 172.21.15.2:0/2925210469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ddd5c7b40 0x562ddd5c9180 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f55fc0b91f0 tx=0x7f55fc0f0760 comp rx=0 tx=0).stop 2024-09-19T06:18:24.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.310+0000 7f56100e1740 1 -- 172.21.15.2:0/2925210469 shutdown_connections 2024-09-19T06:18:24.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.310+0000 7f56100e1740 1 --2- 172.21.15.2:0/2925210469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ddd5d1370 0x562ddd5c96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.310+0000 7f56100e1740 1 --2- 172.21.15.2:0/2925210469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ddd5c7b40 0x562ddd5c9180 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.310+0000 7f56100e1740 1 --2- 172.21.15.2:0/2925210469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ddd5c65d0 0x562ddd5dd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.310+0000 7f56100e1740 1 -- 172.21.15.2:0/2925210469 >> 172.21.15.2:0/2925210469 conn(0x562ddd58f310 msgr2=0x562ddd5d0120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.310+0000 7f56100e1740 1 -- 172.21.15.2:0/2925210469 shutdown_connections 2024-09-19T06:18:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.310+0000 7f56100e1740 1 -- 172.21.15.2:0/2925210469 wait complete. 2024-09-19T06:18:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.310+0000 7f56100e1740 1 -- start start 2024-09-19T06:18:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.310+0000 7f56100e1740 1 Processor -- start 2024-09-19T06:18:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.311+0000 7f56100e1740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ddd5c65d0 0x562ddd5d99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.311+0000 7f56100e1740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ddd5c7b40 0x562ddd5d4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.311+0000 7f56100e1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ddd5d1370 0x562ddd5d5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.311+0000 7f56100e1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f56081abdb0 con 0x562ddd5d1370 2024-09-19T06:18:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.311+0000 7f56100e1740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f56081ad220 con 0x562ddd5c65d0 2024-09-19T06:18:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.311+0000 7f56100e1740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f56081ac480 con 0x562ddd5c7b40 2024-09-19T06:18:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.311+0000 7f56100e1740 10 client.0 _ll_register_callbacks cb 0x7f5600012760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:24.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.311+0000 7f5607fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ddd5d1370 0x562ddd5d5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:24.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.311+0000 7f5607fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ddd5d1370 0x562ddd5d5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45542/0 (socket says 172.21.15.2:45542) 2024-09-19T06:18:24.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.311+0000 7f5607fff640 1 -- 172.21.15.2:0/1251874354 learned_addr learned my addr 172.21.15.2:0/1251874354 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:24.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.311+0000 7f5606ffd640 1 --2- 172.21.15.2:0/1251874354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ddd5c7b40 0x562ddd5d4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:24.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.311+0000 7f56077fe640 1 --2- 172.21.15.2:0/1251874354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ddd5c65d0 0x562ddd5d99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:24.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.311+0000 7f5607fff640 1 -- 172.21.15.2:0/1251874354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ddd5c7b40 msgr2=0x562ddd5d4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:24.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.311+0000 7f5607fff640 1 --2- 172.21.15.2:0/1251874354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ddd5c7b40 0x562ddd5d4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.311+0000 7f5607fff640 1 -- 172.21.15.2:0/1251874354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ddd5c65d0 msgr2=0x562ddd5d99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:24.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.311+0000 7f5607fff640 1 --2- 172.21.15.2:0/1251874354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ddd5c65d0 0x562ddd5d99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.311+0000 7f5607fff640 1 -- 172.21.15.2:0/1251874354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ddd5d5b60 con 0x562ddd5d1370 2024-09-19T06:18:24.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.311+0000 7f56077fe640 1 --2- 172.21.15.2:0/1251874354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ddd5c65d0 0x562ddd5d99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:18:24.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.311+0000 7f5607fff640 1 --2- 172.21.15.2:0/1251874354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ddd5d1370 0x562ddd5d5330 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f5600006010 tx=0x7f5600005a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3230d4dfff0cdf88 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:24.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.311+0000 7f55e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:18:24.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.311+0000 7f55e6ffd640 1 -- 172.21.15.2:0/1251874354 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560001e880 con 0x562ddd5d1370 2024-09-19T06:18:24.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.312+0000 7f55e6ffd640 1 -- 172.21.15.2:0/1251874354 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f560001ebb0 con 0x562ddd5d1370 2024-09-19T06:18:24.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.312+0000 7f56100e1740 1 -- 172.21.15.2:0/1251874354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55fc0c53e0 con 0x562ddd5d1370 2024-09-19T06:18:24.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.312+0000 7f55e6ffd640 1 -- 172.21.15.2:0/1251874354 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f560001edb0 con 0x562ddd5d1370 2024-09-19T06:18:24.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.312+0000 7f56100e1740 10 client.16248 fetch_fsmap learned FSMap version 26 2024-09-19T06:18:24.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.312+0000 7f56100e1740 1 -- 172.21.15.2:0/1251874354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562ddd64fe90 con 0x562ddd5d1370 2024-09-19T06:18:24.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.312+0000 7f55e6ffd640 1 -- 172.21.15.2:0/1251874354 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f55fc0c53e0 con 0x562ddd5d1370 2024-09-19T06:18:24.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.312+0000 7f55e6ffd640 1 -- 172.21.15.2:0/1251874354 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f5600039030 con 0x562ddd5d1370 2024-09-19T06:18:24.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.312+0000 7f56100e1740 10 client.16248 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:18:24.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.312+0000 7f56100e1740 10 client.16248 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:18:24.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.312+0000 7f56100e1740 20 client.16248 populate_metadata read hostname 'smithi002' 2024-09-19T06:18:24.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.312+0000 7f56100e1740 1 --2- 172.21.15.2:0/1251874354 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x562ddd650560 0x562ddd652980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:24.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.312+0000 7f56100e1740 4 client.16248 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:18:24.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.312+0000 7f56100e1740 1 -- 172.21.15.2:0/1251874354 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562ddd4b0170 con 0x562ddd650560 2024-09-19T06:18:24.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.312+0000 7f56077fe640 1 --2- 172.21.15.2:0/1251874354 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x562ddd650560 0x562ddd652980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:24.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.313+0000 7f56077fe640 1 --2- 172.21.15.2:0/1251874354 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x562ddd650560 0x562ddd652980 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=93f0818ed5d6d5d server_cookie=226197d760e98fb6 in_seq=0 out_seq=0 2024-09-19T06:18:24.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.313+0000 7f55e6ffd640 10 client.16248 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:18:24.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.313+0000 7f55e6ffd640 1 -- 172.21.15.2:0/1251874354 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562ddd4b0170 con 0x562ddd650560 2024-09-19T06:18:24.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.313+0000 7f55e6ffd640 10 client.16248 handle_command_reply: tid=0 2024-09-19T06:18:24.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.313+0000 7f56100e1740 1 client.16248 shutdown 2024-09-19T06:18:24.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.313+0000 7f56100e1740 1 -- 172.21.15.2:0/1251874354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ddd5d1370 msgr2=0x562ddd5d5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:24.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.313+0000 7f56100e1740 1 --2- 172.21.15.2:0/1251874354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ddd5d1370 0x562ddd5d5330 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f5600006010 tx=0x7f5600005a40 comp rx=0 tx=0).stop 2024-09-19T06:18:24.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.313+0000 7f56100e1740 1 -- 172.21.15.2:0/1251874354 shutdown_connections 2024-09-19T06:18:24.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.313+0000 7f56100e1740 1 --2- 172.21.15.2:0/1251874354 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x562ddd650560 0x562ddd652980 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.313+0000 7f56100e1740 1 --2- 172.21.15.2:0/1251874354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ddd5d1370 0x562ddd5d5330 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.313+0000 7f56100e1740 1 --2- 172.21.15.2:0/1251874354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ddd5c7b40 0x562ddd5d4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.313+0000 7f55e6ffd640 0 client.16248 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:18:24.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.313+0000 7f56100e1740 1 --2- 172.21.15.2:0/1251874354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ddd5c65d0 0x562ddd5d99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.313+0000 7f56100e1740 1 -- 172.21.15.2:0/1251874354 >> 172.21.15.2:0/1251874354 conn(0x562ddd58f310 msgr2=0x562ddd5cc840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:24.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.313+0000 7f56100e1740 1 -- 172.21.15.2:0/1251874354 shutdown_connections 2024-09-19T06:18:24.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.313+0000 7f56100e1740 1 -- 172.21.15.2:0/1251874354 wait complete. 2024-09-19T06:18:24.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.313+0000 7f56100e1740 20 client.16248 trim_cache size 0 max 16384 2024-09-19T06:18:24.322 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:18:24.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.314+0000 7f560dd08640 1 -- 172.21.15.2:0/999649495 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f55f00a33b0 msgr2=0x7f55f00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:24.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.314+0000 7f560dd08640 1 --2- 172.21.15.2:0/999649495 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f55f00a33b0 0x7f55f00a5870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5600009fd0 tx=0x7f5600009600 comp rx=0 tx=0).stop 2024-09-19T06:18:24.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.314+0000 7f560dd08640 1 -- 172.21.15.2:0/999649495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5608103660 msgr2=0x7f56081988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:24.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.314+0000 7f560dd08640 1 --2- 172.21.15.2:0/999649495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5608103660 0x7f56081988b0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f55fc005940 tx=0x7f55fc0042f0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.314+0000 7f560dd08640 1 -- 172.21.15.2:0/999649495 shutdown_connections 2024-09-19T06:18:24.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.314+0000 7f560dd08640 1 --2- 172.21.15.2:0/999649495 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f55f00a33b0 0x7f55f00a5870 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.314+0000 7f560dd08640 1 --2- 172.21.15.2:0/999649495 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f560810c170 0x7f560819cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.314+0000 7f560dd08640 1 --2- 172.21.15.2:0/999649495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5608103660 0x7f56081988b0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.314+0000 7f560dd08640 1 --2- 172.21.15.2:0/999649495 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5608102d40 0x7f5608198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.314+0000 7f560dd08640 1 -- 172.21.15.2:0/999649495 >> 172.21.15.2:0/999649495 conn(0x7f56080fc7a0 msgr2=0x7f56080fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:24.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.314+0000 7f560dd08640 1 -- 172.21.15.2:0/999649495 shutdown_connections 2024-09-19T06:18:24.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:24.314+0000 7f560dd08640 1 -- 172.21.15.2:0/999649495 wait complete. 2024-09-19T06:18:24.986 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:18:25.243 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:18:25.658 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:25 smithi002 ceph-mon[30982]: pgmap v111: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:18:25.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:25 smithi090 ceph-mon[34497]: pgmap v111: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:18:25.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.742+0000 7f67cbeda640 1 -- 172.21.15.2:0/2220683357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67c41036e0 msgr2=0x7f67c4107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:25.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.742+0000 7f67cbeda640 1 --2- 172.21.15.2:0/2220683357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67c41036e0 0x7f67c4107b90 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f67b4009930 tx=0x7f67b402a420 comp rx=0 tx=0).stop 2024-09-19T06:18:25.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.742+0000 7f67cbeda640 1 -- 172.21.15.2:0/2220683357 shutdown_connections 2024-09-19T06:18:25.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.742+0000 7f67cbeda640 1 --2- 172.21.15.2:0/2220683357 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f67c41082a0 0x7f67c410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:25.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.742+0000 7f67cbeda640 1 --2- 172.21.15.2:0/2220683357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67c41036e0 0x7f67c4107b90 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:25.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.742+0000 7f67cbeda640 1 --2- 172.21.15.2:0/2220683357 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67c4102d30 0x7f67c4103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:25.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.742+0000 7f67cbeda640 1 -- 172.21.15.2:0/2220683357 >> 172.21.15.2:0/2220683357 conn(0x7f67c40fc7d0 msgr2=0x7f67c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:25.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.742+0000 7f67cbeda640 1 -- 172.21.15.2:0/2220683357 shutdown_connections 2024-09-19T06:18:25.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.742+0000 7f67cbeda640 1 -- 172.21.15.2:0/2220683357 wait complete. 2024-09-19T06:18:25.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.742+0000 7f67cbeda640 1 Processor -- start 2024-09-19T06:18:25.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.743+0000 7f67cbeda640 1 -- start start 2024-09-19T06:18:25.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.743+0000 7f67cbeda640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f67c4102d30 0x7f67c4100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:25.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.743+0000 7f67cbeda640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67c41036e0 0x7f67c4100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:25.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.743+0000 7f67cbeda640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67c41082a0 0x7f67c4101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:25.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.743+0000 7f67cbeda640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f67c4111f90 con 0x7f67c41082a0 2024-09-19T06:18:25.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.743+0000 7f67cbeda640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f67c4111e10 con 0x7f67c41036e0 2024-09-19T06:18:25.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.743+0000 7f67cbeda640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f67c4112110 con 0x7f67c4102d30 2024-09-19T06:18:25.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.743+0000 7f67ca477640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67c41082a0 0x7f67c4101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:25.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.743+0000 7f67ca477640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67c41082a0 0x7f67c4101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38446/0 (socket says 172.21.15.2:38446) 2024-09-19T06:18:25.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.743+0000 7f67ca477640 1 -- 172.21.15.2:0/2416033280 learned_addr learned my addr 172.21.15.2:0/2416033280 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:25.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.743+0000 7f67c9c76640 1 --2- 172.21.15.2:0/2416033280 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f67c4102d30 0x7f67c4100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:25.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.743+0000 7f67c9475640 1 --2- 172.21.15.2:0/2416033280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67c41036e0 0x7f67c4100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:25.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.743+0000 7f67ca477640 1 -- 172.21.15.2:0/2416033280 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f67c4102d30 msgr2=0x7f67c4100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:25.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.743+0000 7f67ca477640 1 --2- 172.21.15.2:0/2416033280 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f67c4102d30 0x7f67c4100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:25.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.743+0000 7f67ca477640 1 -- 172.21.15.2:0/2416033280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67c41036e0 msgr2=0x7f67c4100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:25.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.743+0000 7f67ca477640 1 --2- 172.21.15.2:0/2416033280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67c41036e0 0x7f67c4100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:25.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.743+0000 7f67ca477640 1 -- 172.21.15.2:0/2416033280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67c41a6a10 con 0x7f67c41082a0 2024-09-19T06:18:25.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.743+0000 7f67c9475640 1 --2- 172.21.15.2:0/2416033280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67c41036e0 0x7f67c4100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:18:25.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.743+0000 7f67ca477640 1 --2- 172.21.15.2:0/2416033280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67c41082a0 0x7f67c4101410 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f67bc00eaa0 tx=0x7f67bc00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:25.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.744+0000 7f67baffd640 1 -- 172.21.15.2:0/2416033280 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67bc004d20 con 0x7f67c41082a0 2024-09-19T06:18:25.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.744+0000 7f67baffd640 1 -- 172.21.15.2:0/2416033280 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f67bc005020 con 0x7f67c41082a0 2024-09-19T06:18:25.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.744+0000 7f67cbeda640 1 -- 172.21.15.2:0/2416033280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67c41a6d00 con 0x7f67c41082a0 2024-09-19T06:18:25.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.744+0000 7f67baffd640 1 -- 172.21.15.2:0/2416033280 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67bc0116b0 con 0x7f67c41082a0 2024-09-19T06:18:25.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.744+0000 7f67cbeda640 1 -- 172.21.15.2:0/2416033280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67c41a7290 con 0x7f67c41082a0 2024-09-19T06:18:25.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.746+0000 7f67baffd640 1 -- 172.21.15.2:0/2416033280 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f67bc0051d0 con 0x7f67c41082a0 2024-09-19T06:18:25.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.746+0000 7f67ce2b3740 1 Processor -- start 2024-09-19T06:18:25.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.746+0000 7f67ce2b3740 1 -- start start 2024-09-19T06:18:25.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.747+0000 7f67ce2b3740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56518eb53b40 0x56518eb52090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:25.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.747+0000 7f67ce2b3740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56518eb525d0 0x56518eb52a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:25.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.747+0000 7f67ce2b3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56518eb5d370 0x56518eb5f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:25.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.747+0000 7f67ce2b3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56518eab82f0 con 0x56518eb5d370 2024-09-19T06:18:25.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.747+0000 7f67ce2b3740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56518ea5fcf0 con 0x56518eb53b40 2024-09-19T06:18:25.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.747+0000 7f67ce2b3740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56518eab42b0 con 0x56518eb525d0 2024-09-19T06:18:25.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.747+0000 7f67c9475640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56518eb5d370 0x56518eb5f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:25.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.747+0000 7f67c9475640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56518eb5d370 0x56518eb5f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38456/0 (socket says 172.21.15.2:38456) 2024-09-19T06:18:25.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.747+0000 7f67c9475640 1 -- 172.21.15.2:0/776664739 learned_addr learned my addr 172.21.15.2:0/776664739 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:25.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.747+0000 7f67c9475640 1 --2- 172.21.15.2:0/776664739 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56518eb53b40 0x56518eb52090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:25.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.747+0000 7f67c9c76640 1 --2- 172.21.15.2:0/776664739 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56518eb525d0 0x56518eb52a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:25.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.747+0000 7f67c9475640 1 -- 172.21.15.2:0/776664739 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56518eb525d0 msgr2=0x56518eb52a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:25.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.747+0000 7f67c9475640 1 --2- 172.21.15.2:0/776664739 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56518eb525d0 0x56518eb52a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:25.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.747+0000 7f67c9475640 1 -- 172.21.15.2:0/776664739 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56518eb53b40 msgr2=0x56518eb52090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:25.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.747+0000 7f67c9475640 1 --2- 172.21.15.2:0/776664739 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56518eb53b40 0x56518eb52090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:25.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.747+0000 7f67c9475640 1 -- 172.21.15.2:0/776664739 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56518ea443a0 con 0x56518eb5d370 2024-09-19T06:18:25.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.747+0000 7f67baffd640 1 --2- 172.21.15.2:0/2416033280 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f67b00a3430 0x7f67b00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:25.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.747+0000 7f67c9475640 1 --2- 172.21.15.2:0/776664739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56518eb5d370 0x56518eb5f760 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f67b4032fd0 tx=0x7f67b4031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18c460c3a6489fb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:25.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.747+0000 7f67c9c76640 1 --2- 172.21.15.2:0/2416033280 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f67b00a3430 0x7f67b00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:25.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.748+0000 7f67baffd640 1 -- 172.21.15.2:0/2416033280 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f67bc0cfb30 con 0x7f67c41082a0 2024-09-19T06:18:25.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.748+0000 7f67affff640 1 -- 172.21.15.2:0/776664739 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b4045070 con 0x56518eb5d370 2024-09-19T06:18:25.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.748+0000 7f67affff640 1 -- 172.21.15.2:0/776664739 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f67b40035f0 con 0x56518eb5d370 2024-09-19T06:18:25.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.748+0000 7f67affff640 1 -- 172.21.15.2:0/776664739 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b4035040 con 0x56518eb5d370 2024-09-19T06:18:25.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.748+0000 7f67ce2b3740 1 -- 172.21.15.2:0/776664739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56518eb5d370 msgr2=0x56518eb5f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:25.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.748+0000 7f67c9c76640 1 --2- 172.21.15.2:0/2416033280 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f67b00a3430 0x7f67b00a58f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x56518eb4fac0 tx=0x7f67c0009110 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:25.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.748+0000 7f67ce2b3740 1 --2- 172.21.15.2:0/776664739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56518eb5d370 0x56518eb5f760 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f67b4032fd0 tx=0x7f67b4031400 comp rx=0 tx=0).stop 2024-09-19T06:18:25.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.749+0000 7f67ce2b3740 1 -- 172.21.15.2:0/776664739 shutdown_connections 2024-09-19T06:18:25.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.749+0000 7f67ce2b3740 1 --2- 172.21.15.2:0/776664739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56518eb5d370 0x56518eb5f760 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:25.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.749+0000 7f67ce2b3740 1 --2- 172.21.15.2:0/776664739 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56518eb525d0 0x56518eb52a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:25.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.749+0000 7f67ce2b3740 1 --2- 172.21.15.2:0/776664739 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56518eb53b40 0x56518eb52090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:25.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.749+0000 7f67ce2b3740 1 -- 172.21.15.2:0/776664739 >> 172.21.15.2:0/776664739 conn(0x56518eb1b310 msgr2=0x56518eb4ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:25.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.749+0000 7f67ce2b3740 1 -- 172.21.15.2:0/776664739 shutdown_connections 2024-09-19T06:18:25.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.749+0000 7f67ce2b3740 1 -- 172.21.15.2:0/776664739 wait complete. 2024-09-19T06:18:25.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.749+0000 7f67ce2b3740 1 -- start start 2024-09-19T06:18:25.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.749+0000 7f67ce2b3740 1 Processor -- start 2024-09-19T06:18:25.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.749+0000 7f67ce2b3740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56518eb525d0 0x56518eb5cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:25.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.749+0000 7f67ce2b3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56518eb53b40 0x56518eb59fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:25.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.749+0000 7f67ce2b3740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56518eb5d370 0x56518eb5a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:25.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.749+0000 7f67ce2b3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56518eb60010 con 0x56518eb53b40 2024-09-19T06:18:25.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.749+0000 7f67ce2b3740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56518ea73060 con 0x56518eb5d370 2024-09-19T06:18:25.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.750+0000 7f67ce2b3740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56518eb60190 con 0x56518eb525d0 2024-09-19T06:18:25.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.750+0000 7f67ce2b3740 10 client.0 _ll_register_callbacks cb 0x56518e7c68c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:25.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.750+0000 7f67c9475640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56518eb53b40 0x56518eb59fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:25.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.750+0000 7f67c9475640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56518eb53b40 0x56518eb59fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38466/0 (socket says 172.21.15.2:38466) 2024-09-19T06:18:25.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.750+0000 7f67c9475640 1 -- 172.21.15.2:0/3899796936 learned_addr learned my addr 172.21.15.2:0/3899796936 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:25.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.750+0000 7f67c9c76640 1 --2- 172.21.15.2:0/3899796936 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56518eb525d0 0x56518eb5cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:25.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.750+0000 7f67ca477640 1 --2- 172.21.15.2:0/3899796936 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56518eb5d370 0x56518eb5a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:25.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.750+0000 7f67c9475640 1 -- 172.21.15.2:0/3899796936 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56518eb525d0 msgr2=0x56518eb5cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:25.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.750+0000 7f67c9475640 1 --2- 172.21.15.2:0/3899796936 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56518eb525d0 0x56518eb5cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:25.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.750+0000 7f67c9475640 1 -- 172.21.15.2:0/3899796936 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56518eb5d370 msgr2=0x56518eb5a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:25.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.750+0000 7f67c9475640 1 --2- 172.21.15.2:0/3899796936 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56518eb5d370 0x56518eb5a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:25.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.750+0000 7f67c9475640 1 -- 172.21.15.2:0/3899796936 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56518e8293c0 con 0x56518eb53b40 2024-09-19T06:18:25.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.750+0000 7f67c9475640 1 --2- 172.21.15.2:0/3899796936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56518eb53b40 0x56518eb59fe0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f67b4006010 tx=0x7f67b4004210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd5adbc77ad14d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:25.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.750+0000 7f67ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:18:25.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.750+0000 7f67ad7fa640 1 -- 172.21.15.2:0/3899796936 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b404d020 con 0x56518eb53b40 2024-09-19T06:18:25.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.750+0000 7f67ad7fa640 1 -- 172.21.15.2:0/3899796936 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f67b40039a0 con 0x56518eb53b40 2024-09-19T06:18:25.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.750+0000 7f67ce2b3740 1 -- 172.21.15.2:0/3899796936 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67b40035f0 con 0x56518eb53b40 2024-09-19T06:18:25.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.751+0000 7f67ad7fa640 1 -- 172.21.15.2:0/3899796936 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f67b4058050 con 0x56518eb53b40 2024-09-19T06:18:25.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.751+0000 7f67ce2b3740 10 client.16260 fetch_fsmap learned FSMap version 26 2024-09-19T06:18:25.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.751+0000 7f67ce2b3740 1 -- 172.21.15.2:0/3899796936 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56518eb6baa0 con 0x56518eb53b40 2024-09-19T06:18:25.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.751+0000 7f67ad7fa640 1 -- 172.21.15.2:0/3899796936 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f67b40035f0 con 0x56518eb53b40 2024-09-19T06:18:25.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.751+0000 7f67ad7fa640 1 -- 172.21.15.2:0/3899796936 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f67b403a040 con 0x56518eb53b40 2024-09-19T06:18:25.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.751+0000 7f67ce2b3740 10 client.16260 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:18:25.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.751+0000 7f67ce2b3740 10 client.16260 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:18:25.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.751+0000 7f67ce2b3740 20 client.16260 populate_metadata read hostname 'smithi002' 2024-09-19T06:18:25.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.751+0000 7f67ce2b3740 1 --2- 172.21.15.2:0/3899796936 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x56518eb6cdf0 0x56518eb6f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:25.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.751+0000 7f67ce2b3740 4 client.16260 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:18:25.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.751+0000 7f67ce2b3740 1 -- 172.21.15.2:0/3899796936 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56518eac5860 con 0x56518eb6cdf0 2024-09-19T06:18:25.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.751+0000 7f67c9c76640 1 --2- 172.21.15.2:0/3899796936 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x56518eb6cdf0 0x56518eb6f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:25.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.752+0000 7f67c9c76640 1 --2- 172.21.15.2:0/3899796936 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x56518eb6cdf0 0x56518eb6f1e0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e16873f49b8b5b86 server_cookie=73fe73113c70f6c9 in_seq=0 out_seq=0 2024-09-19T06:18:25.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.752+0000 7f67ad7fa640 10 client.16260 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:18:25.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.752+0000 7f67ad7fa640 1 -- 172.21.15.2:0/3899796936 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56518eac5860 con 0x56518eb6cdf0 2024-09-19T06:18:25.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.752+0000 7f67ad7fa640 10 client.16260 handle_command_reply: tid=0 2024-09-19T06:18:25.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.752+0000 7f67ce2b3740 1 client.16260 shutdown 2024-09-19T06:18:25.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.753+0000 7f67ce2b3740 1 -- 172.21.15.2:0/3899796936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56518eb53b40 msgr2=0x56518eb59fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:25.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.753+0000 7f67ce2b3740 1 --2- 172.21.15.2:0/3899796936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56518eb53b40 0x56518eb59fe0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f67b4006010 tx=0x7f67b4004210 comp rx=0 tx=0).stop 2024-09-19T06:18:25.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.753+0000 7f67ce2b3740 1 -- 172.21.15.2:0/3899796936 shutdown_connections 2024-09-19T06:18:25.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.753+0000 7f67ce2b3740 1 --2- 172.21.15.2:0/3899796936 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x56518eb6cdf0 0x56518eb6f1e0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:25.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.753+0000 7f67ce2b3740 1 --2- 172.21.15.2:0/3899796936 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56518eb5d370 0x56518eb5a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:25.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.753+0000 7f67ce2b3740 1 --2- 172.21.15.2:0/3899796936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56518eb53b40 0x56518eb59fe0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:25.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.753+0000 7f67ad7fa640 0 client.16260 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:18:25.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.753+0000 7f67ce2b3740 1 --2- 172.21.15.2:0/3899796936 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56518eb525d0 0x56518eb5cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:25.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.753+0000 7f67ce2b3740 1 -- 172.21.15.2:0/3899796936 >> 172.21.15.2:0/3899796936 conn(0x56518eb1b310 msgr2=0x56518eb54960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:25.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.753+0000 7f67ce2b3740 1 -- 172.21.15.2:0/3899796936 shutdown_connections 2024-09-19T06:18:25.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.753+0000 7f67ce2b3740 1 -- 172.21.15.2:0/3899796936 wait complete. 2024-09-19T06:18:25.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.753+0000 7f67ce2b3740 20 client.16260 trim_cache size 0 max 16384 2024-09-19T06:18:25.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.766+0000 7f67ce2b3740 1 Processor -- start 2024-09-19T06:18:25.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.766+0000 7f67ce2b3740 1 -- start start 2024-09-19T06:18:25.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.766+0000 7f67ce2b3740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56518eb525d0 0x56518eb4ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:25.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.766+0000 7f67ce2b3740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56518eb53b40 0x56518eb58fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:25.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.766+0000 7f67ce2b3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56518eb5d370 0x56518eb72200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:25.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.766+0000 7f67ce2b3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f67c41b2330 con 0x56518eb5d370 2024-09-19T06:18:25.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.766+0000 7f67ce2b3740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f67c41afc00 con 0x56518eb53b40 2024-09-19T06:18:25.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.766+0000 7f67ce2b3740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f67c41ada50 con 0x56518eb525d0 2024-09-19T06:18:25.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.766+0000 7f67ca477640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56518eb5d370 0x56518eb72200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:25.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.766+0000 7f67ca477640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56518eb5d370 0x56518eb72200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38468/0 (socket says 172.21.15.2:38468) 2024-09-19T06:18:25.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.766+0000 7f67ca477640 1 -- 172.21.15.2:0/4267916612 learned_addr learned my addr 172.21.15.2:0/4267916612 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:25.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.766+0000 7f67c9c76640 1 --2- 172.21.15.2:0/4267916612 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56518eb525d0 0x56518eb4ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:25.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.766+0000 7f67c9475640 1 --2- 172.21.15.2:0/4267916612 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56518eb53b40 0x56518eb58fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:25.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.767+0000 7f67ca477640 1 -- 172.21.15.2:0/4267916612 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56518eb525d0 msgr2=0x56518eb4ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:25.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.767+0000 7f67ca477640 1 --2- 172.21.15.2:0/4267916612 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56518eb525d0 0x56518eb4ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:25.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.767+0000 7f67ca477640 1 -- 172.21.15.2:0/4267916612 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56518eb53b40 msgr2=0x56518eb58fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:25.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.767+0000 7f67ca477640 1 --2- 172.21.15.2:0/4267916612 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56518eb53b40 0x56518eb58fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:25.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.767+0000 7f67ca477640 1 -- 172.21.15.2:0/4267916612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56518eb5c950 con 0x56518eb5d370 2024-09-19T06:18:25.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.767+0000 7f67ca477640 1 --2- 172.21.15.2:0/4267916612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56518eb5d370 0x56518eb72200 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f67bc0cd310 tx=0x7f67bc005560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c4dbe2cb6cac12a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:25.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.767+0000 7f67af7fe640 1 -- 172.21.15.2:0/4267916612 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67bc0ba070 con 0x56518eb5d370 2024-09-19T06:18:25.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.767+0000 7f67af7fe640 1 -- 172.21.15.2:0/4267916612 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f67bc09be40 con 0x56518eb5d370 2024-09-19T06:18:25.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.767+0000 7f67af7fe640 1 -- 172.21.15.2:0/4267916612 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67bc09e070 con 0x56518eb5d370 2024-09-19T06:18:25.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.767+0000 7f67ce2b3740 1 -- 172.21.15.2:0/4267916612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56518eb5d370 msgr2=0x56518eb72200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:25.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.767+0000 7f67ce2b3740 1 --2- 172.21.15.2:0/4267916612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56518eb5d370 0x56518eb72200 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f67bc0cd310 tx=0x7f67bc005560 comp rx=0 tx=0).stop 2024-09-19T06:18:25.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.768+0000 7f67ce2b3740 1 -- 172.21.15.2:0/4267916612 shutdown_connections 2024-09-19T06:18:25.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.768+0000 7f67ce2b3740 1 --2- 172.21.15.2:0/4267916612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56518eb5d370 0x56518eb72200 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:25.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.768+0000 7f67ce2b3740 1 --2- 172.21.15.2:0/4267916612 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56518eb53b40 0x56518eb58fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:25.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.768+0000 7f67ce2b3740 1 --2- 172.21.15.2:0/4267916612 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56518eb525d0 0x56518eb4ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:25.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.768+0000 7f67ce2b3740 1 -- 172.21.15.2:0/4267916612 >> 172.21.15.2:0/4267916612 conn(0x56518eb1b310 msgr2=0x56518eb588d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:25.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.768+0000 7f67ce2b3740 1 -- 172.21.15.2:0/4267916612 shutdown_connections 2024-09-19T06:18:25.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.768+0000 7f67ce2b3740 1 -- 172.21.15.2:0/4267916612 wait complete. 2024-09-19T06:18:25.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.768+0000 7f67ce2b3740 1 -- start start 2024-09-19T06:18:25.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.768+0000 7f67ce2b3740 1 Processor -- start 2024-09-19T06:18:25.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.768+0000 7f67ce2b3740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56518eb525d0 0x56518eb72810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:25.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.768+0000 7f67ce2b3740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56518eb53b40 0x56518eb6fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:25.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.768+0000 7f67ce2b3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56518eb5d370 0x56518eb700a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:25.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.768+0000 7f67ce2b3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f67c41ae0c0 con 0x56518eb5d370 2024-09-19T06:18:25.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.768+0000 7f67ce2b3740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f67c41af530 con 0x56518eb53b40 2024-09-19T06:18:25.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.768+0000 7f67ce2b3740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f67c41ae790 con 0x56518eb525d0 2024-09-19T06:18:25.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.768+0000 7f67ce2b3740 10 client.0 _ll_register_callbacks cb 0x7f67b4032cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:25.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.769+0000 7f67ca477640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56518eb5d370 0x56518eb700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:25.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.769+0000 7f67c9c76640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56518eb525d0 0x56518eb72810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:25.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.769+0000 7f67ca477640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56518eb5d370 0x56518eb700a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38482/0 (socket says 172.21.15.2:38482) 2024-09-19T06:18:25.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.769+0000 7f67ca477640 1 -- 172.21.15.2:0/3579752247 learned_addr learned my addr 172.21.15.2:0/3579752247 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:25.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.769+0000 7f67c9475640 1 --2- 172.21.15.2:0/3579752247 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56518eb53b40 0x56518eb6fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:25.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.769+0000 7f67ca477640 1 -- 172.21.15.2:0/3579752247 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56518eb525d0 msgr2=0x56518eb72810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:25.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.769+0000 7f67ca477640 1 --2- 172.21.15.2:0/3579752247 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56518eb525d0 0x56518eb72810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:25.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.769+0000 7f67ca477640 1 -- 172.21.15.2:0/3579752247 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56518eb53b40 msgr2=0x56518eb6fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:25.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.769+0000 7f67ca477640 1 --2- 172.21.15.2:0/3579752247 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56518eb53b40 0x56518eb6fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:25.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.769+0000 7f67ca477640 1 -- 172.21.15.2:0/3579752247 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56518eb70790 con 0x56518eb5d370 2024-09-19T06:18:25.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.769+0000 7f67c9c76640 1 --2- 172.21.15.2:0/3579752247 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56518eb525d0 0x56518eb72810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:18:25.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.769+0000 7f67ca477640 1 --2- 172.21.15.2:0/3579752247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56518eb5d370 0x56518eb700a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f67bc00efd0 tx=0x7f67bc0a0270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daf7fc3ab1c48b27 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:25.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.769+0000 7f67ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:18:25.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.769+0000 7f67ad7fa640 1 -- 172.21.15.2:0/3579752247 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67bc0a9060 con 0x56518eb5d370 2024-09-19T06:18:25.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.769+0000 7f67ce2b3740 1 -- 172.21.15.2:0/3579752247 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67bc09be40 con 0x56518eb5d370 2024-09-19T06:18:25.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.769+0000 7f67ad7fa640 1 -- 172.21.15.2:0/3579752247 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f67bc00caf0 con 0x56518eb5d370 2024-09-19T06:18:25.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.770+0000 7f67ad7fa640 1 -- 172.21.15.2:0/3579752247 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f67bc09e070 con 0x56518eb5d370 2024-09-19T06:18:25.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.770+0000 7f67ce2b3740 10 client.16266 fetch_fsmap learned FSMap version 26 2024-09-19T06:18:25.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.770+0000 7f67ce2b3740 1 -- 172.21.15.2:0/3579752247 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56518ebd7620 con 0x56518eb5d370 2024-09-19T06:18:25.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.770+0000 7f67ad7fa640 1 -- 172.21.15.2:0/3579752247 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f67bc09be40 con 0x56518eb5d370 2024-09-19T06:18:25.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.770+0000 7f67ad7fa640 1 -- 172.21.15.2:0/3579752247 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f67bc022060 con 0x56518eb5d370 2024-09-19T06:18:25.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.770+0000 7f67ce2b3740 10 client.16266 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:18:25.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.770+0000 7f67ce2b3740 10 client.16266 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:18:25.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.770+0000 7f67ce2b3740 20 client.16266 populate_metadata read hostname 'smithi002' 2024-09-19T06:18:25.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.770+0000 7f67ce2b3740 1 --2- 172.21.15.2:0/3579752247 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x56518ebd7ca0 0x56518ebda090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:25.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.770+0000 7f67ce2b3740 4 client.16266 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:18:25.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.770+0000 7f67ce2b3740 1 -- 172.21.15.2:0/3579752247 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56518eabfd70 con 0x56518ebd7ca0 2024-09-19T06:18:25.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.770+0000 7f67c9c76640 1 --2- 172.21.15.2:0/3579752247 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x56518ebd7ca0 0x56518ebda090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:25.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.771+0000 7f67c9c76640 1 --2- 172.21.15.2:0/3579752247 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x56518ebd7ca0 0x56518ebda090 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=255e607018a1da01 server_cookie=a2f244a9932d49d4 in_seq=0 out_seq=0 2024-09-19T06:18:25.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.771+0000 7f67ad7fa640 10 client.16266 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:18:25.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.771+0000 7f67ad7fa640 1 -- 172.21.15.2:0/3579752247 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56518eabfd70 con 0x56518ebd7ca0 2024-09-19T06:18:25.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.771+0000 7f67ad7fa640 10 client.16266 handle_command_reply: tid=0 2024-09-19T06:18:25.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.771+0000 7f67ce2b3740 1 client.16266 shutdown 2024-09-19T06:18:25.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.771+0000 7f67ce2b3740 1 -- 172.21.15.2:0/3579752247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56518eb5d370 msgr2=0x56518eb700a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:25.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.771+0000 7f67ce2b3740 1 --2- 172.21.15.2:0/3579752247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56518eb5d370 0x56518eb700a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f67bc00efd0 tx=0x7f67bc0a0270 comp rx=0 tx=0).stop 2024-09-19T06:18:25.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.771+0000 7f67ce2b3740 1 -- 172.21.15.2:0/3579752247 shutdown_connections 2024-09-19T06:18:25.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.771+0000 7f67ce2b3740 1 --2- 172.21.15.2:0/3579752247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56518eb5d370 0x56518eb700a0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:25.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.771+0000 7f67ce2b3740 1 --2- 172.21.15.2:0/3579752247 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x56518ebd7ca0 0x56518ebda090 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:25.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.771+0000 7f67ce2b3740 1 --2- 172.21.15.2:0/3579752247 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56518eb53b40 0x56518eb6fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:25.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.771+0000 7f67ce2b3740 1 --2- 172.21.15.2:0/3579752247 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56518eb525d0 0x56518eb72810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:25.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.771+0000 7f67ce2b3740 1 -- 172.21.15.2:0/3579752247 >> 172.21.15.2:0/3579752247 conn(0x56518eb1b310 msgr2=0x56518eb590f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:25.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.771+0000 7f67ad7fa640 0 client.16266 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:18:25.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.771+0000 7f67ce2b3740 1 -- 172.21.15.2:0/3579752247 shutdown_connections 2024-09-19T06:18:25.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.771+0000 7f67ce2b3740 1 -- 172.21.15.2:0/3579752247 wait complete. 2024-09-19T06:18:25.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.771+0000 7f67ce2b3740 20 client.16266 trim_cache size 0 max 16384 2024-09-19T06:18:25.779 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:18:25.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.772+0000 7f67cbeda640 1 -- 172.21.15.2:0/2416033280 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f67b00a3430 msgr2=0x7f67b00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:25.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.772+0000 7f67cbeda640 1 --2- 172.21.15.2:0/2416033280 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f67b00a3430 0x7f67b00a58f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x56518eb4fac0 tx=0x7f67c0009110 comp rx=0 tx=0).stop 2024-09-19T06:18:25.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.772+0000 7f67cbeda640 1 -- 172.21.15.2:0/2416033280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67c41082a0 msgr2=0x7f67c4101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:25.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.772+0000 7f67cbeda640 1 --2- 172.21.15.2:0/2416033280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67c41082a0 0x7f67c4101410 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f67bc00eaa0 tx=0x7f67bc00eea0 comp rx=0 tx=0).stop 2024-09-19T06:18:25.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.772+0000 7f67cbeda640 1 -- 172.21.15.2:0/2416033280 shutdown_connections 2024-09-19T06:18:25.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.772+0000 7f67cbeda640 1 --2- 172.21.15.2:0/2416033280 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f67b00a3430 0x7f67b00a58f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:25.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.772+0000 7f67cbeda640 1 --2- 172.21.15.2:0/2416033280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67c41082a0 0x7f67c4101410 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:25.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.772+0000 7f67cbeda640 1 --2- 172.21.15.2:0/2416033280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67c41036e0 0x7f67c4100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:25.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.772+0000 7f67cbeda640 1 --2- 172.21.15.2:0/2416033280 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f67c4102d30 0x7f67c4100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:25.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.772+0000 7f67cbeda640 1 -- 172.21.15.2:0/2416033280 >> 172.21.15.2:0/2416033280 conn(0x7f67c40fc7d0 msgr2=0x7f67c4105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:25.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.772+0000 7f67cbeda640 1 -- 172.21.15.2:0/2416033280 shutdown_connections 2024-09-19T06:18:25.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:25.772+0000 7f67cbeda640 1 -- 172.21.15.2:0/2416033280 wait complete. 2024-09-19T06:18:25.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:25 smithi089 ceph-mon[34160]: pgmap v111: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:18:27.506 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:18:27.506 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:18:27.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:27 smithi002 ceph-mon[30982]: pgmap v112: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:18:27.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:27 smithi090 ceph-mon[34497]: pgmap v112: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:18:27.779 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:18:27.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:27 smithi089 ceph-mon[34160]: pgmap v112: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:18:28.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.243+0000 7fe7a17e4640 1 -- 172.21.15.2:0/52466890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe79c101420 msgr2=0x7fe79c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:28.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.243+0000 7fe7a17e4640 1 --2- 172.21.15.2:0/52466890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe79c101420 0x7fe79c10d950 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fe794009cd0 tx=0x7fe79402a8e0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.243+0000 7fe7a17e4640 1 -- 172.21.15.2:0/52466890 shutdown_connections 2024-09-19T06:18:28.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.243+0000 7fe7a17e4640 1 --2- 172.21.15.2:0/52466890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe79c101420 0x7fe79c10d950 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.243+0000 7fe7a17e4640 1 --2- 172.21.15.2:0/52466890 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe79c100a80 0x7fe79c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.243+0000 7fe7a17e4640 1 --2- 172.21.15.2:0/52466890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe79c106a80 0x7fe79c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.243+0000 7fe7a17e4640 1 -- 172.21.15.2:0/52466890 >> 172.21.15.2:0/52466890 conn(0x7fe79c0fc7a0 msgr2=0x7fe79c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:28.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.243+0000 7fe7a17e4640 1 -- 172.21.15.2:0/52466890 shutdown_connections 2024-09-19T06:18:28.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.243+0000 7fe7a17e4640 1 -- 172.21.15.2:0/52466890 wait complete. 2024-09-19T06:18:28.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.244+0000 7fe7a17e4640 1 Processor -- start 2024-09-19T06:18:28.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.244+0000 7fe7a17e4640 1 -- start start 2024-09-19T06:18:28.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.244+0000 7fe7a17e4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe79c100a80 0x7fe79c1982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:28.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.244+0000 7fe7a17e4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe79c101420 0x7fe79c198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:28.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.244+0000 7fe7a17e4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe79c106a80 0x7fe79c19cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:28.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.244+0000 7fe7a17e4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c111e50 con 0x7fe79c106a80 2024-09-19T06:18:28.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.244+0000 7fe7a17e4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c111cd0 con 0x7fe79c101420 2024-09-19T06:18:28.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.244+0000 7fe7a17e4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c111fd0 con 0x7fe79c100a80 2024-09-19T06:18:28.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.244+0000 7fe79b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe79c106a80 0x7fe79c19cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:28.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.244+0000 7fe79b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe79c106a80 0x7fe79c19cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38512/0 (socket says 172.21.15.2:38512) 2024-09-19T06:18:28.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.244+0000 7fe79b7fe640 1 -- 172.21.15.2:0/1074068626 learned_addr learned my addr 172.21.15.2:0/1074068626 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:28.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.245+0000 7fe7927fc640 1 --2- 172.21.15.2:0/1074068626 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe79c101420 0x7fe79c198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:28.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.245+0000 7fe79affd640 1 --2- 172.21.15.2:0/1074068626 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe79c100a80 0x7fe79c1982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:28.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.245+0000 7fe79b7fe640 1 -- 172.21.15.2:0/1074068626 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe79c100a80 msgr2=0x7fe79c1982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:28.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.245+0000 7fe79b7fe640 1 --2- 172.21.15.2:0/1074068626 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe79c100a80 0x7fe79c1982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.245+0000 7fe79b7fe640 1 -- 172.21.15.2:0/1074068626 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe79c101420 msgr2=0x7fe79c198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:28.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.245+0000 7fe79b7fe640 1 --2- 172.21.15.2:0/1074068626 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe79c101420 0x7fe79c198810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.245+0000 7fe79b7fe640 1 -- 172.21.15.2:0/1074068626 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe79c19d280 con 0x7fe79c106a80 2024-09-19T06:18:28.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.245+0000 7fe79b7fe640 1 --2- 172.21.15.2:0/1074068626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe79c106a80 0x7fe79c19cba0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fe794005cc0 tx=0x7fe794003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:28.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.245+0000 7fe798ff9640 1 -- 172.21.15.2:0/1074068626 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe794004450 con 0x7fe79c106a80 2024-09-19T06:18:28.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.245+0000 7fe798ff9640 1 -- 172.21.15.2:0/1074068626 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe794031c90 con 0x7fe79c106a80 2024-09-19T06:18:28.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.245+0000 7fe7a17e4640 1 -- 172.21.15.2:0/1074068626 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe79c19d510 con 0x7fe79c106a80 2024-09-19T06:18:28.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.245+0000 7fe798ff9640 1 -- 172.21.15.2:0/1074068626 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe794030e70 con 0x7fe79c106a80 2024-09-19T06:18:28.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.245+0000 7fe7a17e4640 1 -- 172.21.15.2:0/1074068626 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe79c1a4e50 con 0x7fe79c106a80 2024-09-19T06:18:28.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.247+0000 7fe798ff9640 1 -- 172.21.15.2:0/1074068626 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fe7940045f0 con 0x7fe79c106a80 2024-09-19T06:18:28.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.248+0000 7fe7a3bbd740 1 Processor -- start 2024-09-19T06:18:28.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.248+0000 7fe7a3bbd740 1 -- start start 2024-09-19T06:18:28.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.248+0000 7fe7a3bbd740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a95e4fda60 0x55a95e4fde40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:28.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.248+0000 7fe7a3bbd740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a95e4fe380 0x55a95e50cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:28.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.248+0000 7fe7a3bbd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a95e50d150 0x55a95e50f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:28.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.248+0000 7fe7a3bbd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a95e463280 con 0x55a95e50d150 2024-09-19T06:18:28.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.248+0000 7fe7a3bbd740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55a95e40ab10 con 0x55a95e4fe380 2024-09-19T06:18:28.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.248+0000 7fe7a3bbd740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55a95e45f240 con 0x55a95e4fda60 2024-09-19T06:18:28.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.248+0000 7fe7927fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a95e50d150 0x55a95e50f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:28.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.248+0000 7fe7927fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a95e50d150 0x55a95e50f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38518/0 (socket says 172.21.15.2:38518) 2024-09-19T06:18:28.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.248+0000 7fe7927fc640 1 -- 172.21.15.2:0/2304676273 learned_addr learned my addr 172.21.15.2:0/2304676273 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:28.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.248+0000 7fe79affd640 1 --2- 172.21.15.2:0/2304676273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a95e4fe380 0x55a95e50cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:28.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.248+0000 7fe798ff9640 1 --2- 172.21.15.2:0/1074068626 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe7880a3430 0x7fe7880a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:28.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.249+0000 7fe7927fc640 1 --2- 172.21.15.2:0/2304676273 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a95e4fda60 0x55a95e4fde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:28.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.249+0000 7fe79b7fe640 1 --2- 172.21.15.2:0/1074068626 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe7880a3430 0x7fe7880a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:28.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.249+0000 7fe79affd640 1 -- 172.21.15.2:0/2304676273 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a95e4fda60 msgr2=0x55a95e4fde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:28.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.249+0000 7fe79affd640 1 --2- 172.21.15.2:0/2304676273 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a95e4fda60 0x55a95e4fde40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.249+0000 7fe79affd640 1 -- 172.21.15.2:0/2304676273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a95e50d150 msgr2=0x55a95e50f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:28.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.249+0000 7fe79affd640 1 --2- 172.21.15.2:0/2304676273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a95e50d150 0x55a95e50f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.249+0000 7fe79affd640 1 -- 172.21.15.2:0/2304676273 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a95e4171f0 con 0x55a95e4fe380 2024-09-19T06:18:28.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.249+0000 7fe798ff9640 1 -- 172.21.15.2:0/1074068626 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fe79402e030 con 0x7fe79c106a80 2024-09-19T06:18:28.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.249+0000 7fe79affd640 1 --2- 172.21.15.2:0/2304676273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a95e4fe380 0x55a95e50cc10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe78c00ab70 tx=0x7fe78c00f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c13a373525176b03 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:28.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.249+0000 7fe79b7fe640 1 --2- 172.21.15.2:0/1074068626 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe7880a3430 0x7fe7880a58f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe7940bd000 tx=0x7fe79408f080 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:28.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.249+0000 7fe7917fa640 1 -- 172.21.15.2:0/2304676273 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78c005220 con 0x55a95e4fe380 2024-09-19T06:18:28.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.249+0000 7fe7917fa640 1 -- 172.21.15.2:0/2304676273 <== mon.2 v2:172.21.15.89:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe78c0047a0 con 0x55a95e4fe380 2024-09-19T06:18:28.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.249+0000 7fe7917fa640 1 -- 172.21.15.2:0/2304676273 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78c018770 con 0x55a95e4fe380 2024-09-19T06:18:28.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.250+0000 7fe7a3bbd740 1 -- 172.21.15.2:0/2304676273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a95e4fe380 msgr2=0x55a95e50cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:28.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.250+0000 7fe7a3bbd740 1 --2- 172.21.15.2:0/2304676273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a95e4fe380 0x55a95e50cc10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe78c00ab70 tx=0x7fe78c00f790 comp rx=0 tx=0).stop 2024-09-19T06:18:28.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.250+0000 7fe7a3bbd740 1 -- 172.21.15.2:0/2304676273 shutdown_connections 2024-09-19T06:18:28.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.250+0000 7fe7a3bbd740 1 --2- 172.21.15.2:0/2304676273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a95e50d150 0x55a95e50f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.250+0000 7fe7a3bbd740 1 --2- 172.21.15.2:0/2304676273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a95e4fe380 0x55a95e50cc10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.250+0000 7fe7a3bbd740 1 --2- 172.21.15.2:0/2304676273 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a95e4fda60 0x55a95e4fde40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.250+0000 7fe7a3bbd740 1 -- 172.21.15.2:0/2304676273 >> 172.21.15.2:0/2304676273 conn(0x55a95e4fa0f0 msgr2=0x55a95e4fa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:28.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.250+0000 7fe7a3bbd740 1 -- 172.21.15.2:0/2304676273 shutdown_connections 2024-09-19T06:18:28.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.250+0000 7fe7a3bbd740 1 -- 172.21.15.2:0/2304676273 wait complete. 2024-09-19T06:18:28.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.250+0000 7fe7a3bbd740 1 -- start start 2024-09-19T06:18:28.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.251+0000 7fe7a3bbd740 1 Processor -- start 2024-09-19T06:18:28.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.251+0000 7fe7a3bbd740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a95e4fda60 0x55a95e50a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:28.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.251+0000 7fe7a3bbd740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a95e4fe380 0x55a95e50a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:28.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.251+0000 7fe7a3bbd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a95e50d150 0x55a95e50aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:28.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.251+0000 7fe7a3bbd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a95e50fd80 con 0x55a95e50d150 2024-09-19T06:18:28.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.251+0000 7fe7a3bbd740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55a95e41df10 con 0x55a95e4fe380 2024-09-19T06:18:28.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.251+0000 7fe7a3bbd740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55a95e50ff00 con 0x55a95e4fda60 2024-09-19T06:18:28.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.251+0000 7fe7a3bbd740 10 client.0 _ll_register_callbacks cb 0x55a95e3e6a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:28.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.251+0000 7fe7927fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a95e50d150 0x55a95e50aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:28.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.251+0000 7fe7927fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a95e50d150 0x55a95e50aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38524/0 (socket says 172.21.15.2:38524) 2024-09-19T06:18:28.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.251+0000 7fe7927fc640 1 -- 172.21.15.2:0/2370984648 learned_addr learned my addr 172.21.15.2:0/2370984648 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:28.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.251+0000 7fe7927fc640 1 --2- 172.21.15.2:0/2370984648 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a95e4fda60 0x55a95e50a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:28.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.251+0000 7fe79affd640 1 --2- 172.21.15.2:0/2370984648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a95e4fe380 0x55a95e50a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:28.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.251+0000 7fe7927fc640 1 -- 172.21.15.2:0/2370984648 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a95e4fda60 msgr2=0x55a95e50a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:28.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.251+0000 7fe7927fc640 1 --2- 172.21.15.2:0/2370984648 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a95e4fda60 0x55a95e50a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.251+0000 7fe7927fc640 1 -- 172.21.15.2:0/2370984648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a95e4fe380 msgr2=0x55a95e50a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:28.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.251+0000 7fe7927fc640 1 --2- 172.21.15.2:0/2370984648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a95e4fe380 0x55a95e50a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.251+0000 7fe7927fc640 1 -- 172.21.15.2:0/2370984648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a95e1d46a0 con 0x55a95e50d150 2024-09-19T06:18:28.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.251+0000 7fe7927fc640 1 --2- 172.21.15.2:0/2370984648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a95e50d150 0x55a95e50aa90 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fe784005880 tx=0x7fe784004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6e8cf3f415e9f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:28.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.252+0000 7fe7827fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:18:28.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.252+0000 7fe7827fc640 1 -- 172.21.15.2:0/2370984648 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78400ebe0 con 0x55a95e50d150 2024-09-19T06:18:28.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.252+0000 7fe7a3bbd740 1 -- 172.21.15.2:0/2370984648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe78c0047a0 con 0x55a95e50d150 2024-09-19T06:18:28.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.252+0000 7fe7827fc640 1 -- 172.21.15.2:0/2370984648 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fe78400ed80 con 0x55a95e50d150 2024-09-19T06:18:28.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.252+0000 7fe7827fc640 1 -- 172.21.15.2:0/2370984648 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe784004020 con 0x55a95e50d150 2024-09-19T06:18:28.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.252+0000 7fe7a3bbd740 10 client.16278 fetch_fsmap learned FSMap version 26 2024-09-19T06:18:28.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.252+0000 7fe7a3bbd740 1 -- 172.21.15.2:0/2370984648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a95e51b9a0 con 0x55a95e50d150 2024-09-19T06:18:28.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.252+0000 7fe7827fc640 1 -- 172.21.15.2:0/2370984648 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe78c0047a0 con 0x55a95e50d150 2024-09-19T06:18:28.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.252+0000 7fe7827fc640 1 -- 172.21.15.2:0/2370984648 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fe784003c60 con 0x55a95e50d150 2024-09-19T06:18:28.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.252+0000 7fe7a3bbd740 10 client.16278 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:18:28.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.252+0000 7fe7a3bbd740 10 client.16278 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:18:28.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.252+0000 7fe7a3bbd740 20 client.16278 populate_metadata read hostname 'smithi002' 2024-09-19T06:18:28.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.252+0000 7fe7a3bbd740 1 --2- 172.21.15.2:0/2370984648 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a95e51ce60 0x55a95e51f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:28.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.252+0000 7fe7a3bbd740 4 client.16278 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:18:28.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.252+0000 7fe7a3bbd740 1 -- 172.21.15.2:0/2370984648 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a95e4707f0 con 0x55a95e51ce60 2024-09-19T06:18:28.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.253+0000 7fe79affd640 1 --2- 172.21.15.2:0/2370984648 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a95e51ce60 0x55a95e51f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:28.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.253+0000 7fe7827fc640 10 client.16278 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:18:28.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.253+0000 7fe79affd640 1 --2- 172.21.15.2:0/2370984648 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a95e51ce60 0x55a95e51f270 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3233cd990564c6f server_cookie=88a6cef85c231366 in_seq=0 out_seq=0 2024-09-19T06:18:28.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.254+0000 7fe7827fc640 1 -- 172.21.15.2:0/2370984648 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a95e4707f0 con 0x55a95e51ce60 2024-09-19T06:18:28.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.254+0000 7fe7827fc640 10 client.16278 handle_command_reply: tid=0 2024-09-19T06:18:28.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.254+0000 7fe7a3bbd740 1 client.16278 shutdown 2024-09-19T06:18:28.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.254+0000 7fe7a3bbd740 1 -- 172.21.15.2:0/2370984648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a95e50d150 msgr2=0x55a95e50aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:28.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.254+0000 7fe7a3bbd740 1 --2- 172.21.15.2:0/2370984648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a95e50d150 0x55a95e50aa90 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fe784005880 tx=0x7fe784004730 comp rx=0 tx=0).stop 2024-09-19T06:18:28.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.254+0000 7fe7a3bbd740 1 -- 172.21.15.2:0/2370984648 shutdown_connections 2024-09-19T06:18:28.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.254+0000 7fe7a3bbd740 1 --2- 172.21.15.2:0/2370984648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a95e50d150 0x55a95e50aa90 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.254+0000 7fe7a3bbd740 1 --2- 172.21.15.2:0/2370984648 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a95e51ce60 0x55a95e51f270 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.254+0000 7fe7a3bbd740 1 --2- 172.21.15.2:0/2370984648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a95e4fe380 0x55a95e50a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.254+0000 7fe7a3bbd740 1 --2- 172.21.15.2:0/2370984648 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a95e4fda60 0x55a95e50a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.254+0000 7fe7827fc640 0 client.16278 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:18:28.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.254+0000 7fe7a3bbd740 1 -- 172.21.15.2:0/2370984648 >> 172.21.15.2:0/2370984648 conn(0x55a95e4fa0f0 msgr2=0x55a95e4ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:28.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.254+0000 7fe7a3bbd740 1 -- 172.21.15.2:0/2370984648 shutdown_connections 2024-09-19T06:18:28.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.254+0000 7fe7a3bbd740 1 -- 172.21.15.2:0/2370984648 wait complete. 2024-09-19T06:18:28.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.254+0000 7fe7a3bbd740 20 client.16278 trim_cache size 0 max 16384 2024-09-19T06:18:28.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.272+0000 7fe7a3bbd740 1 Processor -- start 2024-09-19T06:18:28.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.272+0000 7fe7a3bbd740 1 -- start start 2024-09-19T06:18:28.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.272+0000 7fe7a3bbd740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a95e4fda60 0x55a95e50be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:28.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.272+0000 7fe7a3bbd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a95e4fe380 0x55a95e524b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:28.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.272+0000 7fe7a3bbd740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a95e50d150 0x55a95e525080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:28.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.272+0000 7fe7a3bbd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c1add00 con 0x55a95e4fe380 2024-09-19T06:18:28.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.272+0000 7fe7a3bbd740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c1ab5d0 con 0x55a95e50d150 2024-09-19T06:18:28.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.272+0000 7fe7a3bbd740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c1a9420 con 0x55a95e4fda60 2024-09-19T06:18:28.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.272+0000 7fe79affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a95e4fe380 0x55a95e524b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:28.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.272+0000 7fe79affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a95e4fe380 0x55a95e524b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38528/0 (socket says 172.21.15.2:38528) 2024-09-19T06:18:28.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.272+0000 7fe79affd640 1 -- 172.21.15.2:0/3857073901 learned_addr learned my addr 172.21.15.2:0/3857073901 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:28.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.272+0000 7fe7927fc640 1 --2- 172.21.15.2:0/3857073901 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a95e4fda60 0x55a95e50be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:28.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.272+0000 7fe7927fc640 1 --2- 172.21.15.2:0/3857073901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a95e50d150 0x55a95e525080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:28.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.272+0000 7fe79affd640 1 -- 172.21.15.2:0/3857073901 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a95e4fda60 msgr2=0x55a95e50be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:28.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.272+0000 7fe79affd640 1 --2- 172.21.15.2:0/3857073901 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a95e4fda60 0x55a95e50be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.272+0000 7fe79affd640 1 -- 172.21.15.2:0/3857073901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a95e50d150 msgr2=0x55a95e525080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:28.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.272+0000 7fe79affd640 1 --2- 172.21.15.2:0/3857073901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a95e50d150 0x55a95e525080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.272+0000 7fe79affd640 1 -- 172.21.15.2:0/3857073901 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a95e4fe1b0 con 0x55a95e4fe380 2024-09-19T06:18:28.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.272+0000 7fe7927fc640 1 --2- 172.21.15.2:0/3857073901 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a95e4fda60 0x55a95e50be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:18:28.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.273+0000 7fe79affd640 1 --2- 172.21.15.2:0/3857073901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a95e4fe380 0x55a95e524b40 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fe78c00aa90 tx=0x7fe78c00a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66cf0aaaaa50067c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:28.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.273+0000 7fe790ff9640 1 -- 172.21.15.2:0/3857073901 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78c004780 con 0x55a95e4fe380 2024-09-19T06:18:28.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.273+0000 7fe790ff9640 1 -- 172.21.15.2:0/3857073901 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe78c02e030 con 0x55a95e4fe380 2024-09-19T06:18:28.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.273+0000 7fe790ff9640 1 -- 172.21.15.2:0/3857073901 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78c010430 con 0x55a95e4fe380 2024-09-19T06:18:28.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.274+0000 7fe7a3bbd740 1 -- 172.21.15.2:0/3857073901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a95e4fe380 msgr2=0x55a95e524b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:28.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.274+0000 7fe7a3bbd740 1 --2- 172.21.15.2:0/3857073901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a95e4fe380 0x55a95e524b40 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fe78c00aa90 tx=0x7fe78c00a530 comp rx=0 tx=0).stop 2024-09-19T06:18:28.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.274+0000 7fe7a3bbd740 1 -- 172.21.15.2:0/3857073901 shutdown_connections 2024-09-19T06:18:28.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.274+0000 7fe7a3bbd740 1 --2- 172.21.15.2:0/3857073901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a95e50d150 0x55a95e525080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.274+0000 7fe7a3bbd740 1 --2- 172.21.15.2:0/3857073901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a95e4fe380 0x55a95e524b40 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.274+0000 7fe7a3bbd740 1 --2- 172.21.15.2:0/3857073901 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a95e4fda60 0x55a95e50be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.274+0000 7fe7a3bbd740 1 -- 172.21.15.2:0/3857073901 >> 172.21.15.2:0/3857073901 conn(0x55a95e4fa0f0 msgr2=0x55a95e50b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:28.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.274+0000 7fe7a3bbd740 1 -- 172.21.15.2:0/3857073901 shutdown_connections 2024-09-19T06:18:28.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.274+0000 7fe7a3bbd740 1 -- 172.21.15.2:0/3857073901 wait complete. 2024-09-19T06:18:28.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.274+0000 7fe7a3bbd740 1 -- start start 2024-09-19T06:18:28.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.274+0000 7fe7a3bbd740 1 Processor -- start 2024-09-19T06:18:28.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.274+0000 7fe7a3bbd740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a95e4fda60 0x55a95e510f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:28.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.274+0000 7fe7a3bbd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a95e4fe380 0x55a95e5114b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:28.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.274+0000 7fe7a3bbd740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a95e50d150 0x55a95e5119f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:28.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.275+0000 7fe7a3bbd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c1a9a90 con 0x55a95e4fe380 2024-09-19T06:18:28.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.275+0000 7fe7a3bbd740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c1aaf00 con 0x55a95e50d150 2024-09-19T06:18:28.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.275+0000 7fe7a3bbd740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c1aa160 con 0x55a95e4fda60 2024-09-19T06:18:28.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.275+0000 7fe7a3bbd740 10 client.0 _ll_register_callbacks cb 0x7fe78400bd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:28.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.275+0000 7fe79affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a95e4fe380 0x55a95e5114b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:28.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.275+0000 7fe79affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a95e4fe380 0x55a95e5114b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38536/0 (socket says 172.21.15.2:38536) 2024-09-19T06:18:28.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.275+0000 7fe79affd640 1 -- 172.21.15.2:0/871709663 learned_addr learned my addr 172.21.15.2:0/871709663 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:28.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.275+0000 7fe7927fc640 1 --2- 172.21.15.2:0/871709663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a95e50d150 0x55a95e5119f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:28.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.275+0000 7fe7927fc640 1 --2- 172.21.15.2:0/871709663 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a95e4fda60 0x55a95e510f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:28.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.275+0000 7fe79affd640 1 -- 172.21.15.2:0/871709663 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a95e4fda60 msgr2=0x55a95e510f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:28.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.275+0000 7fe79affd640 1 --2- 172.21.15.2:0/871709663 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a95e4fda60 0x55a95e510f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.275+0000 7fe79affd640 1 -- 172.21.15.2:0/871709663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a95e50d150 msgr2=0x55a95e5119f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:28.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.275+0000 7fe79affd640 1 --2- 172.21.15.2:0/871709663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a95e50d150 0x55a95e5119f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.275+0000 7fe79affd640 1 -- 172.21.15.2:0/871709663 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a95e586b60 con 0x55a95e4fe380 2024-09-19T06:18:28.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.275+0000 7fe7927fc640 1 --2- 172.21.15.2:0/871709663 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a95e4fda60 0x55a95e510f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:18:28.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.275+0000 7fe79affd640 1 --2- 172.21.15.2:0/871709663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a95e4fe380 0x55a95e5114b0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fe78c01a040 tx=0x7fe78c018ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca5d22aa27ac6334 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:28.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.275+0000 7fe7827fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:18:28.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.275+0000 7fe7827fc640 1 -- 172.21.15.2:0/871709663 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78c018780 con 0x55a95e4fe380 2024-09-19T06:18:28.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.275+0000 7fe7827fc640 1 -- 172.21.15.2:0/871709663 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fe78c018920 con 0x55a95e4fe380 2024-09-19T06:18:28.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.275+0000 7fe7a3bbd740 1 -- 172.21.15.2:0/871709663 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe78c02e030 con 0x55a95e4fe380 2024-09-19T06:18:28.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.276+0000 7fe7827fc640 1 -- 172.21.15.2:0/871709663 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe78c010430 con 0x55a95e4fe380 2024-09-19T06:18:28.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.276+0000 7fe7a3bbd740 10 client.16284 fetch_fsmap learned FSMap version 26 2024-09-19T06:18:28.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.276+0000 7fe7a3bbd740 1 -- 172.21.15.2:0/871709663 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a95e587dd0 con 0x55a95e4fe380 2024-09-19T06:18:28.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.276+0000 7fe7827fc640 1 -- 172.21.15.2:0/871709663 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe78c02e030 con 0x55a95e4fe380 2024-09-19T06:18:28.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.276+0000 7fe7827fc640 1 -- 172.21.15.2:0/871709663 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fe78c033620 con 0x55a95e4fe380 2024-09-19T06:18:28.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.276+0000 7fe7a3bbd740 10 client.16284 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:18:28.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.276+0000 7fe7a3bbd740 10 client.16284 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:18:28.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.276+0000 7fe7a3bbd740 20 client.16284 populate_metadata read hostname 'smithi002' 2024-09-19T06:18:28.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.276+0000 7fe7a3bbd740 1 --2- 172.21.15.2:0/871709663 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a95e588310 0x55a95e58a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:28.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.276+0000 7fe7a3bbd740 4 client.16284 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:18:28.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.276+0000 7fe7a3bbd740 1 -- 172.21.15.2:0/871709663 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a95e46ad00 con 0x55a95e588310 2024-09-19T06:18:28.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.276+0000 7fe7927fc640 1 --2- 172.21.15.2:0/871709663 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a95e588310 0x55a95e58a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:28.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.277+0000 7fe7827fc640 10 client.16284 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:18:28.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.277+0000 7fe7927fc640 1 --2- 172.21.15.2:0/871709663 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a95e588310 0x55a95e58a730 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71123afa0374b67e server_cookie=15801f6fc71fbe15 in_seq=0 out_seq=0 2024-09-19T06:18:28.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.278+0000 7fe7827fc640 1 -- 172.21.15.2:0/871709663 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a95e46ad00 con 0x55a95e588310 2024-09-19T06:18:28.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.278+0000 7fe7827fc640 10 client.16284 handle_command_reply: tid=0 2024-09-19T06:18:28.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.278+0000 7fe7a3bbd740 1 client.16284 shutdown 2024-09-19T06:18:28.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.278+0000 7fe7a3bbd740 1 -- 172.21.15.2:0/871709663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a95e4fe380 msgr2=0x55a95e5114b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:28.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.278+0000 7fe7a3bbd740 1 --2- 172.21.15.2:0/871709663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a95e4fe380 0x55a95e5114b0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fe78c01a040 tx=0x7fe78c018ed0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.278+0000 7fe7a3bbd740 1 -- 172.21.15.2:0/871709663 shutdown_connections 2024-09-19T06:18:28.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.278+0000 7fe7a3bbd740 1 --2- 172.21.15.2:0/871709663 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a95e588310 0x55a95e58a730 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.278+0000 7fe7a3bbd740 1 --2- 172.21.15.2:0/871709663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a95e50d150 0x55a95e5119f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.278+0000 7fe7a3bbd740 1 --2- 172.21.15.2:0/871709663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a95e4fe380 0x55a95e5114b0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.278+0000 7fe7a3bbd740 1 --2- 172.21.15.2:0/871709663 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a95e4fda60 0x55a95e510f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.278+0000 7fe7827fc640 0 client.16284 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:18:28.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.278+0000 7fe7a3bbd740 1 -- 172.21.15.2:0/871709663 >> 172.21.15.2:0/871709663 conn(0x55a95e4fa0f0 msgr2=0x55a95e4f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:28.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.278+0000 7fe7a3bbd740 1 -- 172.21.15.2:0/871709663 shutdown_connections 2024-09-19T06:18:28.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.278+0000 7fe7a3bbd740 1 -- 172.21.15.2:0/871709663 wait complete. 2024-09-19T06:18:28.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.278+0000 7fe7a3bbd740 20 client.16284 trim_cache size 0 max 16384 2024-09-19T06:18:28.286 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:18:28.286 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T06:18:28.287 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "08761767-dc14-435c-88ed-9f8c7ec8e5da", 2024-09-19T06:18:28.287 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T06:18:28.287 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:18:28.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.279+0000 7fe7a17e4640 1 -- 172.21.15.2:0/1074068626 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe7880a3430 msgr2=0x7fe7880a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:28.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.279+0000 7fe7a17e4640 1 --2- 172.21.15.2:0/1074068626 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe7880a3430 0x7fe7880a58f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe7940bd000 tx=0x7fe79408f080 comp rx=0 tx=0).stop 2024-09-19T06:18:28.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.279+0000 7fe7a17e4640 1 -- 172.21.15.2:0/1074068626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe79c106a80 msgr2=0x7fe79c19cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:28.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.279+0000 7fe7a17e4640 1 --2- 172.21.15.2:0/1074068626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe79c106a80 0x7fe79c19cba0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fe794005cc0 tx=0x7fe794003c20 comp rx=0 tx=0).stop 2024-09-19T06:18:28.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.279+0000 7fe7a17e4640 1 -- 172.21.15.2:0/1074068626 shutdown_connections 2024-09-19T06:18:28.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.279+0000 7fe7a17e4640 1 --2- 172.21.15.2:0/1074068626 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe7880a3430 0x7fe7880a58f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.279+0000 7fe7a17e4640 1 --2- 172.21.15.2:0/1074068626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe79c106a80 0x7fe79c19cba0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.279+0000 7fe7a17e4640 1 --2- 172.21.15.2:0/1074068626 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe79c101420 0x7fe79c198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.279+0000 7fe7a17e4640 1 --2- 172.21.15.2:0/1074068626 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe79c100a80 0x7fe79c1982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.279+0000 7fe7a17e4640 1 -- 172.21.15.2:0/1074068626 >> 172.21.15.2:0/1074068626 conn(0x7fe79c0fc7a0 msgr2=0x7fe79c0fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:28.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.279+0000 7fe7a17e4640 1 -- 172.21.15.2:0/1074068626 shutdown_connections 2024-09-19T06:18:28.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:28.279+0000 7fe7a17e4640 1 -- 172.21.15.2:0/1074068626 wait complete. 2024-09-19T06:18:28.975 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:18:29.231 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:18:29.657 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:29 smithi002 ceph-mon[30982]: pgmap v113: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:18:29.658 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:29 smithi002 ceph-mon[30982]: scrub queued for path: / 2024-09-19T06:18:29.658 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:29 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:18:29.658 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:29 smithi002 ceph-mon[30982]: scrub summary: active paths [/] 2024-09-19T06:18:29.658 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:29 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:18:29.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:29 smithi090 ceph-mon[34497]: pgmap v113: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:18:29.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:29 smithi090 ceph-mon[34497]: scrub queued for path: / 2024-09-19T06:18:29.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:29 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:18:29.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:29 smithi090 ceph-mon[34497]: scrub summary: active paths [/] 2024-09-19T06:18:29.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:29 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:18:29.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.741+0000 7f0ea2187640 1 -- 172.21.15.2:0/4060053897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e9c101420 msgr2=0x7f0e9c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:29.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.741+0000 7f0ea2187640 1 --2- 172.21.15.2:0/4060053897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e9c101420 0x7f0e9c10d950 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f0e94009cd0 tx=0x7f0e9402a8e0 comp rx=0 tx=0).stop 2024-09-19T06:18:29.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.741+0000 7f0ea2187640 1 -- 172.21.15.2:0/4060053897 shutdown_connections 2024-09-19T06:18:29.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.741+0000 7f0ea2187640 1 --2- 172.21.15.2:0/4060053897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e9c101420 0x7f0e9c10d950 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:29.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.741+0000 7f0ea2187640 1 --2- 172.21.15.2:0/4060053897 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e9c100a80 0x7f0e9c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:29.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.741+0000 7f0ea2187640 1 --2- 172.21.15.2:0/4060053897 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e9c106a80 0x7f0e9c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:29.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.741+0000 7f0ea2187640 1 -- 172.21.15.2:0/4060053897 >> 172.21.15.2:0/4060053897 conn(0x7f0e9c0fc7a0 msgr2=0x7f0e9c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:29.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.741+0000 7f0ea2187640 1 -- 172.21.15.2:0/4060053897 shutdown_connections 2024-09-19T06:18:29.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.741+0000 7f0ea2187640 1 -- 172.21.15.2:0/4060053897 wait complete. 2024-09-19T06:18:29.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.742+0000 7f0ea2187640 1 Processor -- start 2024-09-19T06:18:29.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.742+0000 7f0ea2187640 1 -- start start 2024-09-19T06:18:29.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.742+0000 7f0ea2187640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e9c100a80 0x7f0e9c1990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:29.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.742+0000 7f0ea2187640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e9c101420 0x7f0e9c199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:29.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.742+0000 7f0ea2187640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e9c106a80 0x7f0e9c1a4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:29.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.742+0000 7f0ea2187640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9c110d30 con 0x7f0e9c101420 2024-09-19T06:18:29.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.742+0000 7f0ea2187640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9c110bb0 con 0x7f0e9c106a80 2024-09-19T06:18:29.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.742+0000 7f0ea2187640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9c110eb0 con 0x7f0e9c100a80 2024-09-19T06:18:29.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.743+0000 7f0e9affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e9c101420 0x7f0e9c199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:29.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.743+0000 7f0e9affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e9c101420 0x7f0e9c199600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38558/0 (socket says 172.21.15.2:38558) 2024-09-19T06:18:29.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.743+0000 7f0e9affd640 1 -- 172.21.15.2:0/4138292625 learned_addr learned my addr 172.21.15.2:0/4138292625 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:29.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.743+0000 7f0e9b7fe640 1 --2- 172.21.15.2:0/4138292625 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e9c100a80 0x7f0e9c1990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:29.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.743+0000 7f0e9bfff640 1 --2- 172.21.15.2:0/4138292625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e9c106a80 0x7f0e9c1a4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:29.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.743+0000 7f0e9affd640 1 -- 172.21.15.2:0/4138292625 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e9c100a80 msgr2=0x7f0e9c1990c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:29.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.743+0000 7f0e9affd640 1 --2- 172.21.15.2:0/4138292625 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e9c100a80 0x7f0e9c1990c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:29.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.743+0000 7f0e9affd640 1 -- 172.21.15.2:0/4138292625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e9c106a80 msgr2=0x7f0e9c1a4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:29.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.743+0000 7f0e9affd640 1 --2- 172.21.15.2:0/4138292625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e9c106a80 0x7f0e9c1a4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:29.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.743+0000 7f0e9affd640 1 -- 172.21.15.2:0/4138292625 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e9c1a4680 con 0x7f0e9c101420 2024-09-19T06:18:29.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.743+0000 7f0e9affd640 1 --2- 172.21.15.2:0/4138292625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e9c101420 0x7f0e9c199600 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f0e9000d950 tx=0x7f0e9000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:29.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.743+0000 7f0e98ff9640 1 -- 172.21.15.2:0/4138292625 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e90017030 con 0x7f0e9c101420 2024-09-19T06:18:29.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.743+0000 7f0e98ff9640 1 -- 172.21.15.2:0/4138292625 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0e90004020 con 0x7f0e9c101420 2024-09-19T06:18:29.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.743+0000 7f0e98ff9640 1 -- 172.21.15.2:0/4138292625 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e900047a0 con 0x7f0e9c101420 2024-09-19T06:18:29.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.743+0000 7f0ea2187640 1 -- 172.21.15.2:0/4138292625 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e9c1a4850 con 0x7f0e9c101420 2024-09-19T06:18:29.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.743+0000 7f0ea2187640 1 -- 172.21.15.2:0/4138292625 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e9c1a4de0 con 0x7f0e9c101420 2024-09-19T06:18:29.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.746+0000 7f0e98ff9640 1 -- 172.21.15.2:0/4138292625 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f0e900041d0 con 0x7f0e9c101420 2024-09-19T06:18:29.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.746+0000 7f0ea4560740 1 Processor -- start 2024-09-19T06:18:29.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.746+0000 7f0ea4560740 1 -- start start 2024-09-19T06:18:29.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.746+0000 7f0ea4560740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563afa2d9380 0x563afa2d9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:29.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.746+0000 7f0ea4560740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563afa2d9ca0 0x563afa2e8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:29.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.746+0000 7f0ea4560740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563afa2e8a90 0x563afa2eae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:29.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.746+0000 7f0ea4560740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563afa23f2e0 con 0x563afa2d9ca0 2024-09-19T06:18:29.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.746+0000 7f0ea4560740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563afa1e6ce0 con 0x563afa2e8a90 2024-09-19T06:18:29.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.746+0000 7f0ea4560740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x563afa23b2a0 con 0x563afa2d9380 2024-09-19T06:18:29.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.746+0000 7f0e98ff9640 1 --2- 172.21.15.2:0/4138292625 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f0e840a3430 0x7f0e840a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:29.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.746+0000 7f0e9b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563afa2d9ca0 0x563afa2e8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:29.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.746+0000 7f0e9b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563afa2d9ca0 0x563afa2e8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38574/0 (socket says 172.21.15.2:38574) 2024-09-19T06:18:29.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.746+0000 7f0e9b7fe640 1 -- 172.21.15.2:0/3975929179 learned_addr learned my addr 172.21.15.2:0/3975929179 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:29.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.746+0000 7f0e9bfff640 1 --2- 172.21.15.2:0/3975929179 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563afa2d9380 0x563afa2d9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:29.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.746+0000 7f0e9bfff640 1 --2- 172.21.15.2:0/4138292625 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f0e840a3430 0x7f0e840a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:29.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.747+0000 7f0e98ff9640 1 -- 172.21.15.2:0/4138292625 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f0e900cf790 con 0x7f0e9c101420 2024-09-19T06:18:29.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.747+0000 7f0e9affd640 1 --2- 172.21.15.2:0/3975929179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563afa2e8a90 0x563afa2eae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:29.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.747+0000 7f0e9b7fe640 1 -- 172.21.15.2:0/3975929179 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563afa2d9380 msgr2=0x563afa2d9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:29.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.747+0000 7f0e9b7fe640 1 --2- 172.21.15.2:0/3975929179 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563afa2d9380 0x563afa2d9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:29.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.747+0000 7f0e9b7fe640 1 -- 172.21.15.2:0/3975929179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563afa2e8a90 msgr2=0x563afa2eae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:29.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.747+0000 7f0e9b7fe640 1 --2- 172.21.15.2:0/3975929179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563afa2e8a90 0x563afa2eae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:29.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.747+0000 7f0e9b7fe640 1 -- 172.21.15.2:0/3975929179 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563afa1cb440 con 0x563afa2d9ca0 2024-09-19T06:18:29.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.747+0000 7f0e9affd640 1 --2- 172.21.15.2:0/3975929179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563afa2e8a90 0x563afa2eae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:18:29.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.747+0000 7f0e9b7fe640 1 --2- 172.21.15.2:0/3975929179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563afa2d9ca0 0x563afa2e8550 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c00cbe0 tx=0x7f0e8c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92c644ffe2a15419 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:29.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.747+0000 7f0e9bfff640 1 --2- 172.21.15.2:0/4138292625 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f0e840a3430 0x7f0e840a58f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0e94033040 tx=0x7f0e940095c0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:29.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.747+0000 7f0e81ffb640 1 -- 172.21.15.2:0/3975929179 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c005220 con 0x563afa2d9ca0 2024-09-19T06:18:29.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.747+0000 7f0e81ffb640 1 -- 172.21.15.2:0/3975929179 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0e8c004c50 con 0x563afa2d9ca0 2024-09-19T06:18:29.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.747+0000 7f0e81ffb640 1 -- 172.21.15.2:0/3975929179 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c010750 con 0x563afa2d9ca0 2024-09-19T06:18:29.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.748+0000 7f0ea4560740 1 -- 172.21.15.2:0/3975929179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563afa2d9ca0 msgr2=0x563afa2e8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:29.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.748+0000 7f0ea4560740 1 --2- 172.21.15.2:0/3975929179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563afa2d9ca0 0x563afa2e8550 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c00cbe0 tx=0x7f0e8c00e720 comp rx=0 tx=0).stop 2024-09-19T06:18:29.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.748+0000 7f0ea4560740 1 -- 172.21.15.2:0/3975929179 shutdown_connections 2024-09-19T06:18:29.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.748+0000 7f0ea4560740 1 --2- 172.21.15.2:0/3975929179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563afa2e8a90 0x563afa2eae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:29.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.748+0000 7f0ea4560740 1 --2- 172.21.15.2:0/3975929179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563afa2d9ca0 0x563afa2e8550 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:29.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.748+0000 7f0ea4560740 1 --2- 172.21.15.2:0/3975929179 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563afa2d9380 0x563afa2d9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:29.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.748+0000 7f0ea4560740 1 -- 172.21.15.2:0/3975929179 >> 172.21.15.2:0/3975929179 conn(0x563afa2d5a30 msgr2=0x563afa2d5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:29.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.748+0000 7f0ea4560740 1 -- 172.21.15.2:0/3975929179 shutdown_connections 2024-09-19T06:18:29.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.748+0000 7f0ea4560740 1 -- 172.21.15.2:0/3975929179 wait complete. 2024-09-19T06:18:29.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.748+0000 7f0ea4560740 1 -- start start 2024-09-19T06:18:29.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.749+0000 7f0ea4560740 1 Processor -- start 2024-09-19T06:18:29.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.749+0000 7f0ea4560740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563afa2d9380 0x563afa2e83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:29.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.749+0000 7f0ea4560740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563afa2d9ca0 0x563afa2e5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:29.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.749+0000 7f0ea4560740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563afa2e8a90 0x563afa2e5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:29.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.749+0000 7f0ea4560740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563afa2eb660 con 0x563afa2d9ca0 2024-09-19T06:18:29.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.749+0000 7f0ea4560740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563afa1fa050 con 0x563afa2d9380 2024-09-19T06:18:29.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.749+0000 7f0ea4560740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x563afa2eb7e0 con 0x563afa2e8a90 2024-09-19T06:18:29.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.749+0000 7f0ea4560740 10 client.0 _ll_register_callbacks cb 0x563afa23a160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:29.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.749+0000 7f0e9affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563afa2d9ca0 0x563afa2e5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:29.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.749+0000 7f0e9affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563afa2d9ca0 0x563afa2e5660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38588/0 (socket says 172.21.15.2:38588) 2024-09-19T06:18:29.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.749+0000 7f0e9affd640 1 -- 172.21.15.2:0/2792818921 learned_addr learned my addr 172.21.15.2:0/2792818921 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:29.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.749+0000 7f0e9bfff640 1 --2- 172.21.15.2:0/2792818921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563afa2e8a90 0x563afa2e5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:29.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.749+0000 7f0e9b7fe640 1 --2- 172.21.15.2:0/2792818921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563afa2d9380 0x563afa2e83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:29.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.749+0000 7f0e9affd640 1 -- 172.21.15.2:0/2792818921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563afa2e8a90 msgr2=0x563afa2e5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:29.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.749+0000 7f0e9affd640 1 --2- 172.21.15.2:0/2792818921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563afa2e8a90 0x563afa2e5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:29.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.749+0000 7f0e9affd640 1 -- 172.21.15.2:0/2792818921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563afa2d9380 msgr2=0x563afa2e83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:29.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.749+0000 7f0e9affd640 1 --2- 172.21.15.2:0/2792818921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563afa2d9380 0x563afa2e83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:29.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.749+0000 7f0e9affd640 1 -- 172.21.15.2:0/2792818921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563af9fb03c0 con 0x563afa2d9ca0 2024-09-19T06:18:29.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.750+0000 7f0e9affd640 1 --2- 172.21.15.2:0/2792818921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563afa2d9ca0 0x563afa2e5660 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f0e90097f00 tx=0x7f0e9009b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf29f234591445aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:29.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.750+0000 7f0e7affd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:18:29.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.750+0000 7f0e7affd640 1 -- 172.21.15.2:0/2792818921 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e900b3020 con 0x563afa2d9ca0 2024-09-19T06:18:29.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.750+0000 7f0e7affd640 1 -- 172.21.15.2:0/2792818921 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f0e900860b0 con 0x563afa2d9ca0 2024-09-19T06:18:29.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.750+0000 7f0ea4560740 1 -- 172.21.15.2:0/2792818921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e8c004c50 con 0x563afa2d9ca0 2024-09-19T06:18:29.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.750+0000 7f0e7affd640 1 -- 172.21.15.2:0/2792818921 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0e9009fe50 con 0x563afa2d9ca0 2024-09-19T06:18:29.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.750+0000 7f0ea4560740 10 client.16296 fetch_fsmap learned FSMap version 26 2024-09-19T06:18:29.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.750+0000 7f0ea4560740 1 -- 172.21.15.2:0/2792818921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563afa2f6fe0 con 0x563afa2d9ca0 2024-09-19T06:18:29.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.750+0000 7f0e7affd640 1 -- 172.21.15.2:0/2792818921 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0e8c004c50 con 0x563afa2d9ca0 2024-09-19T06:18:29.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.750+0000 7f0e7affd640 1 -- 172.21.15.2:0/2792818921 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f0e900a4280 con 0x563afa2d9ca0 2024-09-19T06:18:29.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.750+0000 7f0ea4560740 10 client.16296 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:18:29.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.750+0000 7f0ea4560740 10 client.16296 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:18:29.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.750+0000 7f0ea4560740 20 client.16296 populate_metadata read hostname 'smithi002' 2024-09-19T06:18:29.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.750+0000 7f0ea4560740 1 --2- 172.21.15.2:0/2792818921 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563afa2f84a0 0x563afa2fa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:29.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.750+0000 7f0ea4560740 4 client.16296 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:18:29.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.750+0000 7f0ea4560740 1 -- 172.21.15.2:0/2792818921 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563afa24c850 con 0x563afa2f84a0 2024-09-19T06:18:29.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.751+0000 7f0e9b7fe640 1 --2- 172.21.15.2:0/2792818921 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563afa2f84a0 0x563afa2fa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:29.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.751+0000 7f0e9b7fe640 1 --2- 172.21.15.2:0/2792818921 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563afa2f84a0 0x563afa2fa8d0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74d6ab619fc22ec6 server_cookie=4864ae23f2381343 in_seq=0 out_seq=0 2024-09-19T06:18:29.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.751+0000 7f0e7affd640 10 client.16296 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:18:29.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.752+0000 7f0e7affd640 1 -- 172.21.15.2:0/2792818921 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563afa24c850 con 0x563afa2f84a0 2024-09-19T06:18:29.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.752+0000 7f0e7affd640 10 client.16296 handle_command_reply: tid=0 2024-09-19T06:18:29.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.752+0000 7f0ea4560740 1 client.16296 shutdown 2024-09-19T06:18:29.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.752+0000 7f0ea4560740 1 -- 172.21.15.2:0/2792818921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563afa2d9ca0 msgr2=0x563afa2e5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:29.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.752+0000 7f0ea4560740 1 --2- 172.21.15.2:0/2792818921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563afa2d9ca0 0x563afa2e5660 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f0e90097f00 tx=0x7f0e9009b990 comp rx=0 tx=0).stop 2024-09-19T06:18:29.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.752+0000 7f0ea4560740 1 -- 172.21.15.2:0/2792818921 shutdown_connections 2024-09-19T06:18:29.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.752+0000 7f0ea4560740 1 --2- 172.21.15.2:0/2792818921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563afa2e8a90 0x563afa2e5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:29.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.752+0000 7f0ea4560740 1 --2- 172.21.15.2:0/2792818921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563afa2d9ca0 0x563afa2e5660 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:29.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.752+0000 7f0ea4560740 1 --2- 172.21.15.2:0/2792818921 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563afa2f84a0 0x563afa2fa8d0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:29.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.752+0000 7f0ea4560740 1 --2- 172.21.15.2:0/2792818921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563afa2d9380 0x563afa2e83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:29.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.752+0000 7f0e7affd640 0 client.16296 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:18:29.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.752+0000 7f0ea4560740 1 -- 172.21.15.2:0/2792818921 >> 172.21.15.2:0/2792818921 conn(0x563afa2d5a30 msgr2=0x563afa2db790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:29.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.752+0000 7f0ea4560740 1 -- 172.21.15.2:0/2792818921 shutdown_connections 2024-09-19T06:18:29.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.752+0000 7f0ea4560740 1 -- 172.21.15.2:0/2792818921 wait complete. 2024-09-19T06:18:29.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.752+0000 7f0ea4560740 20 client.16296 trim_cache size 0 max 16384 2024-09-19T06:18:29.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.769+0000 7f0ea4560740 1 Processor -- start 2024-09-19T06:18:29.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.769+0000 7f0ea4560740 1 -- start start 2024-09-19T06:18:29.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.770+0000 7f0ea4560740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563afa2d9380 0x563afa2f4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:29.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.770+0000 7f0ea4560740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563afa2d9ca0 0x563afa300150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:29.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.770+0000 7f0ea4560740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563afa2e8a90 0x563afa300690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:29.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.770+0000 7f0ea4560740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9c1addc0 con 0x563afa2d9ca0 2024-09-19T06:18:29.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.770+0000 7f0ea4560740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9c1ab690 con 0x563afa2e8a90 2024-09-19T06:18:29.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.770+0000 7f0ea4560740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9c1a94e0 con 0x563afa2d9380 2024-09-19T06:18:29.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.770+0000 7f0e9affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563afa2d9ca0 0x563afa300150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:29.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.770+0000 7f0e9affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563afa2d9ca0 0x563afa300150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38600/0 (socket says 172.21.15.2:38600) 2024-09-19T06:18:29.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.770+0000 7f0e9affd640 1 -- 172.21.15.2:0/120507206 learned_addr learned my addr 172.21.15.2:0/120507206 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:29.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.770+0000 7f0e9b7fe640 1 --2- 172.21.15.2:0/120507206 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563afa2d9380 0x563afa2f4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:29.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.770+0000 7f0e9affd640 1 -- 172.21.15.2:0/120507206 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563afa2d9380 msgr2=0x563afa2f4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:29.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.770+0000 7f0e9affd640 1 --2- 172.21.15.2:0/120507206 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563afa2d9380 0x563afa2f4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:29.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.770+0000 7f0e9affd640 1 -- 172.21.15.2:0/120507206 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563afa2e8a90 msgr2=0x563afa300690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:29.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.770+0000 7f0e9affd640 1 --2- 172.21.15.2:0/120507206 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563afa2e8a90 0x563afa300690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:29.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.770+0000 7f0e9affd640 1 -- 172.21.15.2:0/120507206 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563afa2dbea0 con 0x563afa2d9ca0 2024-09-19T06:18:29.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.770+0000 7f0e9b7fe640 1 --2- 172.21.15.2:0/120507206 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563afa2d9380 0x563afa2f4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:18:29.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.770+0000 7f0e9affd640 1 --2- 172.21.15.2:0/120507206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563afa2d9ca0 0x563afa300150 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f0e90005fd0 tx=0x7f0e900cfb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d034ba7daaaf86d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:29.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.770+0000 7f0e817fa640 1 -- 172.21.15.2:0/120507206 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e900b3070 con 0x563afa2d9ca0 2024-09-19T06:18:29.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.770+0000 7f0e817fa640 1 -- 172.21.15.2:0/120507206 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0e900a4710 con 0x563afa2d9ca0 2024-09-19T06:18:29.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.770+0000 7f0e817fa640 1 -- 172.21.15.2:0/120507206 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e90098110 con 0x563afa2d9ca0 2024-09-19T06:18:29.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.771+0000 7f0ea4560740 1 -- 172.21.15.2:0/120507206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563afa2d9ca0 msgr2=0x563afa300150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:29.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.771+0000 7f0ea4560740 1 --2- 172.21.15.2:0/120507206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563afa2d9ca0 0x563afa300150 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f0e90005fd0 tx=0x7f0e900cfb20 comp rx=0 tx=0).stop 2024-09-19T06:18:29.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.771+0000 7f0ea4560740 1 -- 172.21.15.2:0/120507206 shutdown_connections 2024-09-19T06:18:29.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.771+0000 7f0ea4560740 1 --2- 172.21.15.2:0/120507206 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563afa2e8a90 0x563afa300690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:29.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.771+0000 7f0ea4560740 1 --2- 172.21.15.2:0/120507206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563afa2d9ca0 0x563afa300150 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:29.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.771+0000 7f0ea4560740 1 --2- 172.21.15.2:0/120507206 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563afa2d9380 0x563afa2f4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:29.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.771+0000 7f0ea4560740 1 -- 172.21.15.2:0/120507206 >> 172.21.15.2:0/120507206 conn(0x563afa2d5a30 msgr2=0x563afa2e4750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:29.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.771+0000 7f0ea4560740 1 -- 172.21.15.2:0/120507206 shutdown_connections 2024-09-19T06:18:29.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.771+0000 7f0ea4560740 1 -- 172.21.15.2:0/120507206 wait complete. 2024-09-19T06:18:29.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.772+0000 7f0ea4560740 1 -- start start 2024-09-19T06:18:29.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.772+0000 7f0ea4560740 1 Processor -- start 2024-09-19T06:18:29.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.772+0000 7f0ea4560740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563afa2d9380 0x563afa2eceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:29.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.772+0000 7f0ea4560740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563afa2d9ca0 0x563afa2ed3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:29.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.772+0000 7f0ea4560740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563afa2e8a90 0x563afa362120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:29.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.772+0000 7f0ea4560740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9c1a9b50 con 0x563afa2d9ca0 2024-09-19T06:18:29.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.772+0000 7f0ea4560740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9c1aafc0 con 0x563afa2e8a90 2024-09-19T06:18:29.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.772+0000 7f0ea4560740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9c1aa220 con 0x563afa2d9380 2024-09-19T06:18:29.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.772+0000 7f0ea4560740 10 client.0 _ll_register_callbacks cb 0x7f0e900046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:29.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.772+0000 7f0e9affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563afa2d9ca0 0x563afa2ed3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:29.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.772+0000 7f0e9affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563afa2d9ca0 0x563afa2ed3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38610/0 (socket says 172.21.15.2:38610) 2024-09-19T06:18:29.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.772+0000 7f0e9affd640 1 -- 172.21.15.2:0/941514032 learned_addr learned my addr 172.21.15.2:0/941514032 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:18:29.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.772+0000 7f0e9bfff640 1 --2- 172.21.15.2:0/941514032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563afa2e8a90 0x563afa362120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:29.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.773+0000 7f0e9b7fe640 1 --2- 172.21.15.2:0/941514032 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563afa2d9380 0x563afa2eceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:29.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.773+0000 7f0e9affd640 1 -- 172.21.15.2:0/941514032 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563afa2d9380 msgr2=0x563afa2eceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:29.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.773+0000 7f0e9affd640 1 --2- 172.21.15.2:0/941514032 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563afa2d9380 0x563afa2eceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:29.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.773+0000 7f0e9affd640 1 -- 172.21.15.2:0/941514032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563afa2e8a90 msgr2=0x563afa362120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:29.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.773+0000 7f0e9affd640 1 --2- 172.21.15.2:0/941514032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563afa2e8a90 0x563afa362120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:29.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.773+0000 7f0e9affd640 1 -- 172.21.15.2:0/941514032 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563afa362660 con 0x563afa2d9ca0 2024-09-19T06:18:29.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.773+0000 7f0e9bfff640 1 --2- 172.21.15.2:0/941514032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563afa2e8a90 0x563afa362120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:18:29.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.773+0000 7f0e9b7fe640 1 --2- 172.21.15.2:0/941514032 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563afa2d9380 0x563afa2eceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:18:29.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.773+0000 7f0e9affd640 1 --2- 172.21.15.2:0/941514032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563afa2d9ca0 0x563afa2ed3f0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f0e900ba5b0 tx=0x7f0e9009c220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f41fdb0ce2086b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:29.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.773+0000 7f0e7affd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:18:29.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.773+0000 7f0e7affd640 1 -- 172.21.15.2:0/941514032 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e900b3070 con 0x563afa2d9ca0 2024-09-19T06:18:29.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.773+0000 7f0e7affd640 1 -- 172.21.15.2:0/941514032 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f0e90009b50 con 0x563afa2d9ca0 2024-09-19T06:18:29.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.773+0000 7f0ea4560740 1 -- 172.21.15.2:0/941514032 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e900a4710 con 0x563afa2d9ca0 2024-09-19T06:18:29.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.773+0000 7f0e7affd640 1 -- 172.21.15.2:0/941514032 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0e90009d50 con 0x563afa2d9ca0 2024-09-19T06:18:29.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.773+0000 7f0ea4560740 10 client.16302 fetch_fsmap learned FSMap version 26 2024-09-19T06:18:29.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.773+0000 7f0ea4560740 1 -- 172.21.15.2:0/941514032 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563afa363910 con 0x563afa2d9ca0 2024-09-19T06:18:29.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.773+0000 7f0e7affd640 1 -- 172.21.15.2:0/941514032 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0e900a4710 con 0x563afa2d9ca0 2024-09-19T06:18:29.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.774+0000 7f0e7affd640 1 -- 172.21.15.2:0/941514032 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f0e9009a9f0 con 0x563afa2d9ca0 2024-09-19T06:18:29.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.774+0000 7f0ea4560740 10 client.16302 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:18:29.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.774+0000 7f0ea4560740 10 client.16302 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:18:29.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.774+0000 7f0ea4560740 20 client.16302 populate_metadata read hostname 'smithi002' 2024-09-19T06:18:29.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.774+0000 7f0ea4560740 1 --2- 172.21.15.2:0/941514032 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563afa363e60 0x563afa366280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:29.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.774+0000 7f0ea4560740 4 client.16302 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:18:29.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.774+0000 7f0ea4560740 1 -- 172.21.15.2:0/941514032 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563afa246d60 con 0x563afa363e60 2024-09-19T06:18:29.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.774+0000 7f0e9b7fe640 1 --2- 172.21.15.2:0/941514032 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563afa363e60 0x563afa366280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:29.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.774+0000 7f0e9b7fe640 1 --2- 172.21.15.2:0/941514032 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563afa363e60 0x563afa366280 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25eaf183af80c4b4 server_cookie=7bb1e0eec7871936 in_seq=0 out_seq=0 2024-09-19T06:18:29.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.774+0000 7f0e7affd640 10 client.16302 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:18:29.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.775+0000 7f0e7affd640 1 -- 172.21.15.2:0/941514032 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x563afa246d60 con 0x563afa363e60 2024-09-19T06:18:29.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.775+0000 7f0e7affd640 10 client.16302 handle_command_reply: tid=0 2024-09-19T06:18:29.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.775+0000 7f0ea4560740 1 client.16302 shutdown 2024-09-19T06:18:29.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.775+0000 7f0ea4560740 1 -- 172.21.15.2:0/941514032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563afa2d9ca0 msgr2=0x563afa2ed3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:29.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.775+0000 7f0ea4560740 1 --2- 172.21.15.2:0/941514032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563afa2d9ca0 0x563afa2ed3f0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f0e900ba5b0 tx=0x7f0e9009c220 comp rx=0 tx=0).stop 2024-09-19T06:18:29.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.775+0000 7f0ea4560740 1 -- 172.21.15.2:0/941514032 shutdown_connections 2024-09-19T06:18:29.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.775+0000 7f0ea4560740 1 --2- 172.21.15.2:0/941514032 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563afa363e60 0x563afa366280 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:29.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.775+0000 7f0ea4560740 1 --2- 172.21.15.2:0/941514032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563afa2e8a90 0x563afa362120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:29.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.775+0000 7f0ea4560740 1 --2- 172.21.15.2:0/941514032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563afa2d9ca0 0x563afa2ed3f0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:29.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.775+0000 7f0e7affd640 0 client.16302 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:18:29.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.775+0000 7f0ea4560740 1 --2- 172.21.15.2:0/941514032 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563afa2d9380 0x563afa2eceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:29.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.775+0000 7f0ea4560740 1 -- 172.21.15.2:0/941514032 >> 172.21.15.2:0/941514032 conn(0x563afa2d5a30 msgr2=0x563afa2e6ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:29.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.775+0000 7f0ea4560740 1 -- 172.21.15.2:0/941514032 shutdown_connections 2024-09-19T06:18:29.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.775+0000 7f0ea4560740 1 -- 172.21.15.2:0/941514032 wait complete. 2024-09-19T06:18:29.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.775+0000 7f0ea4560740 20 client.16302 trim_cache size 0 max 16384 2024-09-19T06:18:29.782 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:18:29.782 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:18:29.783 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-19T06:18:29.783 INFO:teuthology.orchestra.run.smithi002.stdout: "08761767-dc14-435c-88ed-9f8c7ec8e5da": { 2024-09-19T06:18:29.783 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-19T06:18:29.783 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "08761767-dc14-435c-88ed-9f8c7ec8e5da", 2024-09-19T06:18:29.783 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-19T06:18:29.783 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:18:29.783 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:18:29.783 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:18:29.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.776+0000 7f0ea2187640 1 -- 172.21.15.2:0/4138292625 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f0e840a3430 msgr2=0x7f0e840a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:29.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.776+0000 7f0ea2187640 1 --2- 172.21.15.2:0/4138292625 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f0e840a3430 0x7f0e840a58f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0e94033040 tx=0x7f0e940095c0 comp rx=0 tx=0).stop 2024-09-19T06:18:29.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.776+0000 7f0ea2187640 1 -- 172.21.15.2:0/4138292625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e9c101420 msgr2=0x7f0e9c199600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:29.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.776+0000 7f0ea2187640 1 --2- 172.21.15.2:0/4138292625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e9c101420 0x7f0e9c199600 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f0e9000d950 tx=0x7f0e9000de10 comp rx=0 tx=0).stop 2024-09-19T06:18:29.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.776+0000 7f0ea2187640 1 -- 172.21.15.2:0/4138292625 shutdown_connections 2024-09-19T06:18:29.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.776+0000 7f0ea2187640 1 --2- 172.21.15.2:0/4138292625 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f0e840a3430 0x7f0e840a58f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:29.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.776+0000 7f0ea2187640 1 --2- 172.21.15.2:0/4138292625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e9c106a80 0x7f0e9c1a4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:29.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.776+0000 7f0ea2187640 1 --2- 172.21.15.2:0/4138292625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e9c101420 0x7f0e9c199600 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:29.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.776+0000 7f0ea2187640 1 --2- 172.21.15.2:0/4138292625 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e9c100a80 0x7f0e9c1990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:29.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.776+0000 7f0ea2187640 1 -- 172.21.15.2:0/4138292625 >> 172.21.15.2:0/4138292625 conn(0x7f0e9c0fc7a0 msgr2=0x7f0e9c0fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:29.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.776+0000 7f0ea2187640 1 -- 172.21.15.2:0/4138292625 shutdown_connections 2024-09-19T06:18:29.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:18:29.776+0000 7f0ea2187640 1 -- 172.21.15.2:0/4138292625 wait complete. 2024-09-19T06:18:29.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:29 smithi089 ceph-mon[34160]: pgmap v113: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:18:29.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:29 smithi089 ceph-mon[34160]: scrub queued for path: / 2024-09-19T06:18:29.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:29 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:18:29.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:29 smithi089 ceph-mon[34160]: scrub summary: active paths [/] 2024-09-19T06:18:29.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:29 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:18:30.493 INFO:tasks.cephfs.filesystem:scrub status for tag:08761767-dc14-435c-88ed-9f8c7ec8e5da - {'path': '/', 'tag': '08761767-dc14-435c-88ed-9f8c7ec8e5da', 'options': 'recursive,force'} 2024-09-19T06:18:31.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:31 smithi002 ceph-mon[30982]: pgmap v114: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2024-09-19T06:18:31.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:31 smithi090 ceph-mon[34497]: pgmap v114: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2024-09-19T06:18:31.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:31 smithi089 ceph-mon[34160]: pgmap v114: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2024-09-19T06:18:33.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:33 smithi002 ceph-mon[30982]: pgmap v115: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:18:33.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:33 smithi002 ceph-mon[30982]: scrub summary: idle 2024-09-19T06:18:33.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:33 smithi090 ceph-mon[34497]: pgmap v115: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:18:33.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:33 smithi090 ceph-mon[34497]: scrub summary: idle 2024-09-19T06:18:33.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:33 smithi089 ceph-mon[34160]: pgmap v115: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:18:33.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:33 smithi089 ceph-mon[34160]: scrub summary: idle 2024-09-19T06:18:35.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:35 smithi002 ceph-mon[30982]: pgmap v116: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:18:35.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:35 smithi090 ceph-mon[34497]: pgmap v116: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:18:35.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:35 smithi089 ceph-mon[34160]: pgmap v116: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:18:37.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:37 smithi002 ceph-mon[30982]: pgmap v117: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:18:37.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:37 smithi090 ceph-mon[34497]: pgmap v117: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:18:37.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:37 smithi089 ceph-mon[34160]: pgmap v117: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:18:39.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:39 smithi002 ceph-mon[30982]: pgmap v118: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:18:39.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:39 smithi090 ceph-mon[34497]: pgmap v118: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:18:39.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:39 smithi089 ceph-mon[34160]: pgmap v118: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:18:41.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:41 smithi090 ceph-mon[34497]: pgmap v119: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:18:41.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:41 smithi089 ceph-mon[34160]: pgmap v119: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:18:41.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:41 smithi002 ceph-mon[30982]: pgmap v119: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:18:43.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:43 smithi090 ceph-mon[34497]: pgmap v120: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:18:43.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:43 smithi089 ceph-mon[34160]: pgmap v120: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:18:43.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:43 smithi002 ceph-mon[30982]: pgmap v120: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:18:45.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:45 smithi090 ceph-mon[34497]: pgmap v121: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:18:45.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:45 smithi089 ceph-mon[34160]: pgmap v121: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:18:45.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:45 smithi002 ceph-mon[30982]: pgmap v121: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:18:47.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:47 smithi090 ceph-mon[34497]: pgmap v122: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:18:47.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:47 smithi089 ceph-mon[34160]: pgmap v122: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:18:47.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:47 smithi002 ceph-mon[30982]: pgmap v122: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:18:49.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:49 smithi090 ceph-mon[34497]: pgmap v123: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:18:49.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:49 smithi089 ceph-mon[34160]: pgmap v123: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:18:49.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:49 smithi002 ceph-mon[30982]: pgmap v123: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:18:51.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:51 smithi090 ceph-mon[34497]: pgmap v124: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:18:51.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:51 smithi089 ceph-mon[34160]: pgmap v124: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:18:51.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:51 smithi002 ceph-mon[30982]: pgmap v124: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:18:53.774 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:53 smithi002 ceph-mon[30982]: pgmap v125: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:18:53.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:53 smithi089 ceph-mon[34160]: pgmap v125: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:18:53.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:53 smithi090 ceph-mon[34497]: pgmap v125: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:18:55.792 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:55 smithi090 ceph-mon[34497]: pgmap v126: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:18:55.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:55 smithi089 ceph-mon[34160]: pgmap v126: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:18:55.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:55 smithi002 ceph-mon[30982]: pgmap v126: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:18:57.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:57 smithi089 ceph-mon[34160]: pgmap v127: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:18:57.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:57 smithi002 ceph-mon[30982]: pgmap v127: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:18:57.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:57 smithi090 ceph-mon[34497]: pgmap v127: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:18:59.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:18:59 smithi089 ceph-mon[34160]: pgmap v128: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:18:59.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:18:59 smithi002 ceph-mon[30982]: pgmap v128: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:18:59.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:18:59 smithi090 ceph-mon[34497]: pgmap v128: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:19:00.496 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:19:00.776 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:19:01.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.389+0000 7f0e3e6ba640 1 -- 172.21.15.2:0/1501036337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e381027a0 msgr2=0x7f0e381067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:01.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.389+0000 7f0e3e6ba640 1 --2- 172.21.15.2:0/1501036337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e381027a0 0x7f0e381067f0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f0e20009900 tx=0x7f0e2002a410 comp rx=0 tx=0).stop 2024-09-19T06:19:01.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.389+0000 7f0e3e6ba640 1 -- 172.21.15.2:0/1501036337 shutdown_connections 2024-09-19T06:19:01.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.389+0000 7f0e3e6ba640 1 --2- 172.21.15.2:0/1501036337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e38106f20 0x7f0e3810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:01.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.389+0000 7f0e3e6ba640 1 --2- 172.21.15.2:0/1501036337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e381027a0 0x7f0e381067f0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:01.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.389+0000 7f0e3e6ba640 1 --2- 172.21.15.2:0/1501036337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e38101df0 0x7f0e381021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:01.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.389+0000 7f0e3e6ba640 1 -- 172.21.15.2:0/1501036337 >> 172.21.15.2:0/1501036337 conn(0x7f0e380fd8b0 msgr2=0x7f0e380ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:01.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.389+0000 7f0e3e6ba640 1 -- 172.21.15.2:0/1501036337 shutdown_connections 2024-09-19T06:19:01.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.389+0000 7f0e3e6ba640 1 -- 172.21.15.2:0/1501036337 wait complete. 2024-09-19T06:19:01.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.390+0000 7f0e3e6ba640 1 Processor -- start 2024-09-19T06:19:01.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.390+0000 7f0e3e6ba640 1 -- start start 2024-09-19T06:19:01.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.390+0000 7f0e3e6ba640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e38101df0 0x7f0e380744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:01.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.390+0000 7f0e3e6ba640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e381027a0 0x7f0e38074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:01.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.390+0000 7f0e3e6ba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e38106f20 0x7f0e38074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:01.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.390+0000 7f0e3e6ba640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0e38111e30 con 0x7f0e38106f20 2024-09-19T06:19:01.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.390+0000 7f0e3e6ba640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0e38111cb0 con 0x7f0e38101df0 2024-09-19T06:19:01.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.390+0000 7f0e3e6ba640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0e38111fb0 con 0x7f0e381027a0 2024-09-19T06:19:01.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.390+0000 7f0e37fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e38101df0 0x7f0e380744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:01.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.390+0000 7f0e3cc57640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e38106f20 0x7f0e38074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:01.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.390+0000 7f0e37fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e38101df0 0x7f0e380744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:33102/0 (socket says 172.21.15.2:33102) 2024-09-19T06:19:01.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.390+0000 7f0e37fff640 1 -- 172.21.15.2:0/3246362942 learned_addr learned my addr 172.21.15.2:0/3246362942 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:01.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.390+0000 7f0e3cc57640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e38106f20 0x7f0e38074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41002/0 (socket says 172.21.15.2:41002) 2024-09-19T06:19:01.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.390+0000 7f0e377fe640 1 --2- 172.21.15.2:0/3246362942 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e381027a0 0x7f0e38074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:01.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.391+0000 7f0e37fff640 1 -- 172.21.15.2:0/3246362942 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e381027a0 msgr2=0x7f0e38074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:01.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.391+0000 7f0e37fff640 1 --2- 172.21.15.2:0/3246362942 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e381027a0 0x7f0e38074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:01.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.391+0000 7f0e37fff640 1 -- 172.21.15.2:0/3246362942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e38106f20 msgr2=0x7f0e38074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:01.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.391+0000 7f0e37fff640 1 --2- 172.21.15.2:0/3246362942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e38106f20 0x7f0e38074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:01.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.391+0000 7f0e37fff640 1 -- 172.21.15.2:0/3246362942 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e381a6810 con 0x7f0e38101df0 2024-09-19T06:19:01.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.391+0000 7f0e37fff640 1 --2- 172.21.15.2:0/3246362942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e38101df0 0x7f0e380744f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0e2800e9f0 tx=0x7f0e2800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:01.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.391+0000 7f0e357fa640 1 -- 172.21.15.2:0/3246362942 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e2800cd80 con 0x7f0e38101df0 2024-09-19T06:19:01.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.391+0000 7f0e3e6ba640 1 -- 172.21.15.2:0/3246362942 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e381a6b00 con 0x7f0e38101df0 2024-09-19T06:19:01.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.391+0000 7f0e357fa640 1 -- 172.21.15.2:0/3246362942 <== mon.2 v2:172.21.15.89:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0e280108e0 con 0x7f0e38101df0 2024-09-19T06:19:01.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.391+0000 7f0e357fa640 1 -- 172.21.15.2:0/3246362942 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e28018920 con 0x7f0e38101df0 2024-09-19T06:19:01.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.391+0000 7f0e3e6ba640 1 -- 172.21.15.2:0/3246362942 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e381a7060 con 0x7f0e38101df0 2024-09-19T06:19:01.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.393+0000 7f0e40a93740 1 Processor -- start 2024-09-19T06:19:01.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.394+0000 7f0e40a93740 1 -- start start 2024-09-19T06:19:01.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.394+0000 7f0e40a93740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d73af5c4a0 0x55d73af5c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:01.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.394+0000 7f0e40a93740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d73af5cdc0 0x55d73af67140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:01.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.394+0000 7f0e40a93740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d73af67680 0x55d73af69a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:01.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.394+0000 7f0e40a93740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d73aec22e0 con 0x55d73af5c4a0 2024-09-19T06:19:01.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.394+0000 7f0e40a93740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55d73ae69ce0 con 0x55d73af5cdc0 2024-09-19T06:19:01.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.394+0000 7f0e40a93740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55d73aebe2a0 con 0x55d73af67680 2024-09-19T06:19:01.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.394+0000 7f0e357fa640 1 -- 172.21.15.2:0/3246362942 <== mon.2 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f0e28010a90 con 0x7f0e38101df0 2024-09-19T06:19:01.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.394+0000 7f0e3cc57640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d73af5c4a0 0x55d73af5c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:01.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.394+0000 7f0e3cc57640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d73af5c4a0 0x55d73af5c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41006/0 (socket says 172.21.15.2:41006) 2024-09-19T06:19:01.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.394+0000 7f0e3cc57640 1 -- 172.21.15.2:0/1483122699 learned_addr learned my addr 172.21.15.2:0/1483122699 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:01.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.394+0000 7f0e37fff640 1 --2- 172.21.15.2:0/1483122699 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d73af5cdc0 0x55d73af67140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:01.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.394+0000 7f0e377fe640 1 --2- 172.21.15.2:0/1483122699 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d73af67680 0x55d73af69a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:01.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.394+0000 7f0e3cc57640 1 -- 172.21.15.2:0/1483122699 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d73af67680 msgr2=0x55d73af69a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:01.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.394+0000 7f0e3cc57640 1 --2- 172.21.15.2:0/1483122699 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d73af67680 0x55d73af69a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:01.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.394+0000 7f0e3cc57640 1 -- 172.21.15.2:0/1483122699 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d73af5cdc0 msgr2=0x55d73af67140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:01.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.394+0000 7f0e3cc57640 1 --2- 172.21.15.2:0/1483122699 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d73af5cdc0 0x55d73af67140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:01.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.394+0000 7f0e3cc57640 1 -- 172.21.15.2:0/1483122699 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d73ae4e440 con 0x55d73af5c4a0 2024-09-19T06:19:01.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.394+0000 7f0e37fff640 1 --2- 172.21.15.2:0/1483122699 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d73af5cdc0 0x55d73af67140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:19:01.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.395+0000 7f0e3cc57640 1 --2- 172.21.15.2:0/1483122699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d73af5c4a0 0x55d73af5c880 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f0e30009f50 tx=0x7f0e300118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bf04f508c0d7d14 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:01.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.395+0000 7f0e2e7fc640 1 -- 172.21.15.2:0/1483122699 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e30004d20 con 0x55d73af5c4a0 2024-09-19T06:19:01.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.395+0000 7f0e2e7fc640 1 -- 172.21.15.2:0/1483122699 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0e30004050 con 0x55d73af5c4a0 2024-09-19T06:19:01.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.395+0000 7f0e357fa640 1 --2- 172.21.15.2:0/3246362942 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f0e240a33b0 0x7f0e240a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:01.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.395+0000 7f0e2e7fc640 1 -- 172.21.15.2:0/1483122699 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e30005280 con 0x55d73af5c4a0 2024-09-19T06:19:01.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.395+0000 7f0e357fa640 1 -- 172.21.15.2:0/3246362942 <== mon.2 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f0e280d0070 con 0x7f0e38101df0 2024-09-19T06:19:01.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.395+0000 7f0e37fff640 1 --2- 172.21.15.2:0/3246362942 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f0e240a33b0 0x7f0e240a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:01.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.396+0000 7f0e40a93740 1 -- 172.21.15.2:0/1483122699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d73af5c4a0 msgr2=0x55d73af5c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:01.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.396+0000 7f0e37fff640 1 --2- 172.21.15.2:0/3246362942 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f0e240a33b0 0x7f0e240a5870 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0e280cd8a0 tx=0x7f0e28000bc0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:01.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.396+0000 7f0e40a93740 1 --2- 172.21.15.2:0/1483122699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d73af5c4a0 0x55d73af5c880 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f0e30009f50 tx=0x7f0e300118d0 comp rx=0 tx=0).stop 2024-09-19T06:19:01.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.396+0000 7f0e40a93740 1 -- 172.21.15.2:0/1483122699 shutdown_connections 2024-09-19T06:19:01.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.396+0000 7f0e40a93740 1 --2- 172.21.15.2:0/1483122699 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d73af67680 0x55d73af69a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:01.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.396+0000 7f0e40a93740 1 --2- 172.21.15.2:0/1483122699 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d73af5cdc0 0x55d73af67140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:01.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.396+0000 7f0e40a93740 1 --2- 172.21.15.2:0/1483122699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d73af5c4a0 0x55d73af5c880 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:01.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.396+0000 7f0e40a93740 1 -- 172.21.15.2:0/1483122699 >> 172.21.15.2:0/1483122699 conn(0x55d73af58a30 msgr2=0x55d73af58e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:01.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.396+0000 7f0e40a93740 1 -- 172.21.15.2:0/1483122699 shutdown_connections 2024-09-19T06:19:01.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.396+0000 7f0e40a93740 1 -- 172.21.15.2:0/1483122699 wait complete. 2024-09-19T06:19:01.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.396+0000 7f0e40a93740 1 -- start start 2024-09-19T06:19:01.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.396+0000 7f0e40a93740 1 Processor -- start 2024-09-19T06:19:01.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.397+0000 7f0e40a93740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d73af5c4a0 0x55d73af67010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:01.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.397+0000 7f0e40a93740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d73af5cdc0 0x55d73af642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:01.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.397+0000 7f0e40a93740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d73af67680 0x55d73af64840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:01.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.397+0000 7f0e40a93740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d73af6a250 con 0x55d73af5c4a0 2024-09-19T06:19:01.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.397+0000 7f0e40a93740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55d73ae7d050 con 0x55d73af5cdc0 2024-09-19T06:19:01.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.397+0000 7f0e40a93740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55d73af6a3d0 con 0x55d73af67680 2024-09-19T06:19:01.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.397+0000 7f0e40a93740 10 client.0 _ll_register_callbacks cb 0x55d73aebd160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:01.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.397+0000 7f0e377fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d73af5cdc0 0x55d73af642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:01.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.397+0000 7f0e3cc57640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d73af5c4a0 0x55d73af67010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:01.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.397+0000 7f0e377fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d73af5cdc0 0x55d73af642c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:33130/0 (socket says 172.21.15.2:33130) 2024-09-19T06:19:01.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.397+0000 7f0e377fe640 1 -- 172.21.15.2:0/2264812873 learned_addr learned my addr 172.21.15.2:0/2264812873 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:01.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.397+0000 7f0e3cc57640 1 --2- 172.21.15.2:0/2264812873 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d73af67680 0x55d73af64840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:01.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.397+0000 7f0e377fe640 1 -- 172.21.15.2:0/2264812873 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d73af67680 msgr2=0x55d73af64840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:01.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.397+0000 7f0e377fe640 1 --2- 172.21.15.2:0/2264812873 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d73af67680 0x55d73af64840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:01.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.397+0000 7f0e377fe640 1 -- 172.21.15.2:0/2264812873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d73af5c4a0 msgr2=0x55d73af67010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:01.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.397+0000 7f0e377fe640 1 --2- 172.21.15.2:0/2264812873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d73af5c4a0 0x55d73af67010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:01.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.397+0000 7f0e377fe640 1 -- 172.21.15.2:0/2264812873 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d73ac333c0 con 0x55d73af5cdc0 2024-09-19T06:19:01.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.397+0000 7f0e377fe640 1 --2- 172.21.15.2:0/2264812873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d73af5cdc0 0x55d73af642c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0e2002a930 tx=0x7f0e200316b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c380bcf56410444 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:01.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.397+0000 7f0e177fe640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-09-19T06:19:01.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.398+0000 7f0e177fe640 1 -- 172.21.15.2:0/2264812873 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e20035070 con 0x55d73af5cdc0 2024-09-19T06:19:01.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.398+0000 7f0e177fe640 1 -- 172.21.15.2:0/2264812873 <== mon.2 v2:172.21.15.89:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f0e20004040 con 0x55d73af5cdc0 2024-09-19T06:19:01.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.398+0000 7f0e40a93740 1 -- 172.21.15.2:0/2264812873 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e30004050 con 0x55d73af5cdc0 2024-09-19T06:19:01.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.398+0000 7f0e177fe640 1 -- 172.21.15.2:0/2264812873 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0e20005d50 con 0x55d73af5cdc0 2024-09-19T06:19:01.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.398+0000 7f0e40a93740 10 client.25799 fetch_fsmap learned FSMap version 26 2024-09-19T06:19:01.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.398+0000 7f0e40a93740 1 -- 172.21.15.2:0/2264812873 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55d73af75c40 con 0x55d73af5cdc0 2024-09-19T06:19:01.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.398+0000 7f0e177fe640 1 -- 172.21.15.2:0/2264812873 <== mon.2 v2:172.21.15.89:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0e30004050 con 0x55d73af5cdc0 2024-09-19T06:19:01.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.398+0000 7f0e177fe640 1 -- 172.21.15.2:0/2264812873 <== mon.2 v2:172.21.15.89:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f0e20004830 con 0x55d73af5cdc0 2024-09-19T06:19:01.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.398+0000 7f0e40a93740 10 client.25799 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:19:01.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.398+0000 7f0e40a93740 10 client.25799 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:19:01.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.398+0000 7f0e40a93740 20 client.25799 populate_metadata read hostname 'smithi002' 2024-09-19T06:19:01.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.398+0000 7f0e40a93740 1 --2- 172.21.15.2:0/2264812873 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55d73af77050 0x55d73af79470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:01.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.398+0000 7f0e40a93740 4 client.25799 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:19:01.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.398+0000 7f0e40a93740 1 -- 172.21.15.2:0/2264812873 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d73aecf850 con 0x55d73af77050 2024-09-19T06:19:01.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.399+0000 7f0e3cc57640 1 --2- 172.21.15.2:0/2264812873 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55d73af77050 0x55d73af79470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:01.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.399+0000 7f0e3cc57640 1 --2- 172.21.15.2:0/2264812873 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55d73af77050 0x55d73af79470 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d686df3f0761189 server_cookie=d70356bcdc5d36ac in_seq=0 out_seq=0 2024-09-19T06:19:01.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.399+0000 7f0e177fe640 10 client.25799 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:19:01.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.400+0000 7f0e177fe640 1 -- 172.21.15.2:0/2264812873 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d73aecf850 con 0x55d73af77050 2024-09-19T06:19:01.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.400+0000 7f0e177fe640 10 client.25799 handle_command_reply: tid=0 2024-09-19T06:19:01.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.400+0000 7f0e40a93740 1 client.25799 shutdown 2024-09-19T06:19:01.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.400+0000 7f0e40a93740 1 -- 172.21.15.2:0/2264812873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d73af5cdc0 msgr2=0x55d73af642c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:01.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.400+0000 7f0e40a93740 1 --2- 172.21.15.2:0/2264812873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d73af5cdc0 0x55d73af642c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0e2002a930 tx=0x7f0e200316b0 comp rx=0 tx=0).stop 2024-09-19T06:19:01.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.400+0000 7f0e40a93740 1 -- 172.21.15.2:0/2264812873 shutdown_connections 2024-09-19T06:19:01.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.400+0000 7f0e40a93740 1 --2- 172.21.15.2:0/2264812873 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d73af67680 0x55d73af64840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:01.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.400+0000 7f0e40a93740 1 --2- 172.21.15.2:0/2264812873 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55d73af77050 0x55d73af79470 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:01.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.400+0000 7f0e40a93740 1 --2- 172.21.15.2:0/2264812873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d73af5cdc0 0x55d73af642c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:01.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.400+0000 7f0e177fe640 0 client.25799 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:19:01.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.400+0000 7f0e40a93740 1 --2- 172.21.15.2:0/2264812873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d73af5c4a0 0x55d73af67010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:01.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.400+0000 7f0e40a93740 1 -- 172.21.15.2:0/2264812873 >> 172.21.15.2:0/2264812873 conn(0x55d73af58a30 msgr2=0x55d73af57b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:01.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.400+0000 7f0e40a93740 1 -- 172.21.15.2:0/2264812873 shutdown_connections 2024-09-19T06:19:01.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.400+0000 7f0e40a93740 1 -- 172.21.15.2:0/2264812873 wait complete. 2024-09-19T06:19:01.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.400+0000 7f0e40a93740 20 client.25799 trim_cache size 0 max 16384 2024-09-19T06:19:01.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.417+0000 7f0e40a93740 1 Processor -- start 2024-09-19T06:19:01.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.417+0000 7f0e40a93740 1 -- start start 2024-09-19T06:19:01.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.417+0000 7f0e40a93740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d73af5c4a0 0x55d73af734b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:01.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.417+0000 7f0e40a93740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d73af5cdc0 0x55d73af62b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:01.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.417+0000 7f0e40a93740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d73af67680 0x55d73af7ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:01.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.418+0000 7f0e40a93740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0e381b21d0 con 0x55d73af5cdc0 2024-09-19T06:19:01.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.418+0000 7f0e40a93740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0e381afaa0 con 0x55d73af5c4a0 2024-09-19T06:19:01.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.418+0000 7f0e40a93740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0e381ad8f0 con 0x55d73af67680 2024-09-19T06:19:01.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.418+0000 7f0e377fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d73af5cdc0 0x55d73af62b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:01.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.418+0000 7f0e377fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d73af5cdc0 0x55d73af62b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41026/0 (socket says 172.21.15.2:41026) 2024-09-19T06:19:01.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.418+0000 7f0e377fe640 1 -- 172.21.15.2:0/3743683445 learned_addr learned my addr 172.21.15.2:0/3743683445 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:01.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.418+0000 7f0e3cc57640 1 --2- 172.21.15.2:0/3743683445 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d73af67680 0x55d73af7ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:01.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.418+0000 7f0e3cc57640 1 --2- 172.21.15.2:0/3743683445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d73af5c4a0 0x55d73af734b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:01.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.418+0000 7f0e377fe640 1 -- 172.21.15.2:0/3743683445 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d73af67680 msgr2=0x55d73af7ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:01.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.418+0000 7f0e377fe640 1 --2- 172.21.15.2:0/3743683445 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d73af67680 0x55d73af7ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:01.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.418+0000 7f0e377fe640 1 -- 172.21.15.2:0/3743683445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d73af5c4a0 msgr2=0x55d73af734b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:01.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.418+0000 7f0e377fe640 1 --2- 172.21.15.2:0/3743683445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d73af5c4a0 0x55d73af734b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:01.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.418+0000 7f0e377fe640 1 -- 172.21.15.2:0/3743683445 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d73af67380 con 0x55d73af5cdc0 2024-09-19T06:19:01.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.418+0000 7f0e3cc57640 1 --2- 172.21.15.2:0/3743683445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d73af5c4a0 0x55d73af734b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:19:01.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.418+0000 7f0e377fe640 1 --2- 172.21.15.2:0/3743683445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d73af5cdc0 0x55d73af62b90 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f0e2002a450 tx=0x7f0e200318b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3018b12289cadf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:01.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.418+0000 7f0e2dffb640 1 -- 172.21.15.2:0/3743683445 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e20035070 con 0x55d73af5cdc0 2024-09-19T06:19:01.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.418+0000 7f0e2dffb640 1 -- 172.21.15.2:0/3743683445 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0e200048c0 con 0x55d73af5cdc0 2024-09-19T06:19:01.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.418+0000 7f0e2dffb640 1 -- 172.21.15.2:0/3743683445 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e20044470 con 0x55d73af5cdc0 2024-09-19T06:19:01.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.419+0000 7f0e40a93740 1 -- 172.21.15.2:0/3743683445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d73af5cdc0 msgr2=0x55d73af62b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:01.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.419+0000 7f0e40a93740 1 --2- 172.21.15.2:0/3743683445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d73af5cdc0 0x55d73af62b90 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f0e2002a450 tx=0x7f0e200318b0 comp rx=0 tx=0).stop 2024-09-19T06:19:01.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.419+0000 7f0e40a93740 1 -- 172.21.15.2:0/3743683445 shutdown_connections 2024-09-19T06:19:01.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.419+0000 7f0e40a93740 1 --2- 172.21.15.2:0/3743683445 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d73af67680 0x55d73af7ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:01.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.419+0000 7f0e40a93740 1 --2- 172.21.15.2:0/3743683445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d73af5cdc0 0x55d73af62b90 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:01.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.419+0000 7f0e40a93740 1 --2- 172.21.15.2:0/3743683445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d73af5c4a0 0x55d73af734b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:01.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.419+0000 7f0e40a93740 1 -- 172.21.15.2:0/3743683445 >> 172.21.15.2:0/3743683445 conn(0x55d73af58a30 msgr2=0x55d73af66340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:01.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.419+0000 7f0e40a93740 1 -- 172.21.15.2:0/3743683445 shutdown_connections 2024-09-19T06:19:01.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.419+0000 7f0e40a93740 1 -- 172.21.15.2:0/3743683445 wait complete. 2024-09-19T06:19:01.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.419+0000 7f0e40a93740 1 -- start start 2024-09-19T06:19:01.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.420+0000 7f0e40a93740 1 Processor -- start 2024-09-19T06:19:01.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.420+0000 7f0e40a93740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d73af5c4a0 0x55d73af6b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:01.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.420+0000 7f0e40a93740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d73af5cdc0 0x55d73af6bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:01.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.420+0000 7f0e40a93740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d73af67680 0x55d73afe0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:01.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.420+0000 7f0e40a93740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0e381adf60 con 0x55d73af5cdc0 2024-09-19T06:19:01.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.420+0000 7f0e40a93740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0e381af3d0 con 0x55d73af5c4a0 2024-09-19T06:19:01.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.420+0000 7f0e40a93740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0e381ae630 con 0x55d73af67680 2024-09-19T06:19:01.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.420+0000 7f0e40a93740 10 client.0 _ll_register_callbacks cb 0x7f0e28005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:01.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.420+0000 7f0e377fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d73af5cdc0 0x55d73af6bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:01.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.420+0000 7f0e377fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d73af5cdc0 0x55d73af6bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41028/0 (socket says 172.21.15.2:41028) 2024-09-19T06:19:01.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.420+0000 7f0e377fe640 1 -- 172.21.15.2:0/690109175 learned_addr learned my addr 172.21.15.2:0/690109175 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:01.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.420+0000 7f0e3cc57640 1 --2- 172.21.15.2:0/690109175 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d73af67680 0x55d73afe0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:01.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.420+0000 7f0e3cc57640 1 --2- 172.21.15.2:0/690109175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d73af5c4a0 0x55d73af6b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:01.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.420+0000 7f0e377fe640 1 -- 172.21.15.2:0/690109175 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d73af67680 msgr2=0x55d73afe0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:01.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.420+0000 7f0e377fe640 1 --2- 172.21.15.2:0/690109175 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d73af67680 0x55d73afe0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:01.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.420+0000 7f0e377fe640 1 -- 172.21.15.2:0/690109175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d73af5c4a0 msgr2=0x55d73af6b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:01.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.420+0000 7f0e377fe640 1 --2- 172.21.15.2:0/690109175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d73af5c4a0 0x55d73af6b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:01.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.420+0000 7f0e377fe640 1 -- 172.21.15.2:0/690109175 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d73afe1250 con 0x55d73af5cdc0 2024-09-19T06:19:01.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.420+0000 7f0e3cc57640 1 --2- 172.21.15.2:0/690109175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d73af5c4a0 0x55d73af6b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:19:01.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.421+0000 7f0e377fe640 1 --2- 172.21.15.2:0/690109175 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d73af5cdc0 0x55d73af6bc80 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f0e20005bd0 tx=0x7f0e20005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2b9e70e4afd00ce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:01.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.421+0000 7f0e177fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:19:01.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.421+0000 7f0e177fe640 1 -- 172.21.15.2:0/690109175 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e20035030 con 0x55d73af5cdc0 2024-09-19T06:19:01.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.421+0000 7f0e40a93740 1 -- 172.21.15.2:0/690109175 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e200048c0 con 0x55d73af5cdc0 2024-09-19T06:19:01.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.421+0000 7f0e177fe640 1 -- 172.21.15.2:0/690109175 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f0e200316b0 con 0x55d73af5cdc0 2024-09-19T06:19:01.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.421+0000 7f0e177fe640 1 -- 172.21.15.2:0/690109175 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0e20066050 con 0x55d73af5cdc0 2024-09-19T06:19:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.421+0000 7f0e40a93740 10 client.16320 fetch_fsmap learned FSMap version 26 2024-09-19T06:19:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.421+0000 7f0e40a93740 1 -- 172.21.15.2:0/690109175 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55d73afe23c0 con 0x55d73af5cdc0 2024-09-19T06:19:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.421+0000 7f0e177fe640 1 -- 172.21.15.2:0/690109175 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0e200048c0 con 0x55d73af5cdc0 2024-09-19T06:19:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.421+0000 7f0e177fe640 1 -- 172.21.15.2:0/690109175 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f0e2005f060 con 0x55d73af5cdc0 2024-09-19T06:19:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.421+0000 7f0e40a93740 10 client.16320 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:19:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.421+0000 7f0e40a93740 10 client.16320 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:19:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.421+0000 7f0e40a93740 20 client.16320 populate_metadata read hostname 'smithi002' 2024-09-19T06:19:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.422+0000 7f0e40a93740 1 --2- 172.21.15.2:0/690109175 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55d73afe2a20 0x55d73afe4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.422+0000 7f0e40a93740 4 client.16320 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:19:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.422+0000 7f0e40a93740 1 -- 172.21.15.2:0/690109175 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d73aec9d60 con 0x55d73afe2a20 2024-09-19T06:19:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.422+0000 7f0e3cc57640 1 --2- 172.21.15.2:0/690109175 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55d73afe2a20 0x55d73afe4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.422+0000 7f0e3cc57640 1 --2- 172.21.15.2:0/690109175 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55d73afe2a20 0x55d73afe4e40 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d8dfa15b205f984 server_cookie=e743ec9c9bba3a18 in_seq=0 out_seq=0 2024-09-19T06:19:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.422+0000 7f0e177fe640 10 client.16320 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:19:01.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.422+0000 7f0e177fe640 1 -- 172.21.15.2:0/690109175 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55d73aec9d60 con 0x55d73afe2a20 2024-09-19T06:19:01.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.422+0000 7f0e177fe640 10 client.16320 handle_command_reply: tid=0 2024-09-19T06:19:01.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.422+0000 7f0e40a93740 1 client.16320 shutdown 2024-09-19T06:19:01.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.423+0000 7f0e40a93740 1 -- 172.21.15.2:0/690109175 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d73af5cdc0 msgr2=0x55d73af6bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:01.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.423+0000 7f0e40a93740 1 --2- 172.21.15.2:0/690109175 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d73af5cdc0 0x55d73af6bc80 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f0e20005bd0 tx=0x7f0e20005c00 comp rx=0 tx=0).stop 2024-09-19T06:19:01.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.423+0000 7f0e40a93740 1 -- 172.21.15.2:0/690109175 shutdown_connections 2024-09-19T06:19:01.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.423+0000 7f0e40a93740 1 --2- 172.21.15.2:0/690109175 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d73af67680 0x55d73afe0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:01.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.423+0000 7f0e40a93740 1 --2- 172.21.15.2:0/690109175 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d73af5cdc0 0x55d73af6bc80 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:01.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.423+0000 7f0e40a93740 1 --2- 172.21.15.2:0/690109175 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55d73afe2a20 0x55d73afe4e40 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:01.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.423+0000 7f0e40a93740 1 --2- 172.21.15.2:0/690109175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d73af5c4a0 0x55d73af6b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:01.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.423+0000 7f0e177fe640 0 client.16320 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:19:01.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.423+0000 7f0e40a93740 1 -- 172.21.15.2:0/690109175 >> 172.21.15.2:0/690109175 conn(0x55d73af58a30 msgr2=0x55d73af57350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:01.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.423+0000 7f0e40a93740 1 -- 172.21.15.2:0/690109175 shutdown_connections 2024-09-19T06:19:01.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.423+0000 7f0e40a93740 1 -- 172.21.15.2:0/690109175 wait complete. 2024-09-19T06:19:01.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.423+0000 7f0e40a93740 20 client.16320 trim_cache size 0 max 16384 2024-09-19T06:19:01.430 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:19:01.430 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T06:19:01.430 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T06:19:01.430 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:19:01.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.423+0000 7f0e3e6ba640 1 -- 172.21.15.2:0/3246362942 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f0e240a33b0 msgr2=0x7f0e240a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:01.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.423+0000 7f0e3e6ba640 1 --2- 172.21.15.2:0/3246362942 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f0e240a33b0 0x7f0e240a5870 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0e280cd8a0 tx=0x7f0e28000bc0 comp rx=0 tx=0).stop 2024-09-19T06:19:01.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.423+0000 7f0e3e6ba640 1 -- 172.21.15.2:0/3246362942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e38101df0 msgr2=0x7f0e380744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:01.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.423+0000 7f0e3e6ba640 1 --2- 172.21.15.2:0/3246362942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e38101df0 0x7f0e380744f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0e2800e9f0 tx=0x7f0e2800eeb0 comp rx=0 tx=0).stop 2024-09-19T06:19:01.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.423+0000 7f0e3e6ba640 1 -- 172.21.15.2:0/3246362942 shutdown_connections 2024-09-19T06:19:01.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.423+0000 7f0e3e6ba640 1 --2- 172.21.15.2:0/3246362942 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f0e240a33b0 0x7f0e240a5870 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:01.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.423+0000 7f0e3e6ba640 1 --2- 172.21.15.2:0/3246362942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e38106f20 0x7f0e38074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:01.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.423+0000 7f0e3e6ba640 1 --2- 172.21.15.2:0/3246362942 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e381027a0 0x7f0e38074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:01.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.423+0000 7f0e3e6ba640 1 --2- 172.21.15.2:0/3246362942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e38101df0 0x7f0e380744f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:01.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.423+0000 7f0e3e6ba640 1 -- 172.21.15.2:0/3246362942 >> 172.21.15.2:0/3246362942 conn(0x7f0e380fd8b0 msgr2=0x7f0e380fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:01.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.424+0000 7f0e3e6ba640 1 -- 172.21.15.2:0/3246362942 shutdown_connections 2024-09-19T06:19:01.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:01.424+0000 7f0e3e6ba640 1 -- 172.21.15.2:0/3246362942 wait complete. 2024-09-19T06:19:01.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:01 smithi002 ceph-mon[30982]: pgmap v129: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:19:01.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:01 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:19:01.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:01 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:19:01.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:01 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:19:01.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:01 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:19:01.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:01 smithi089 ceph-mon[34160]: pgmap v129: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:19:01.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:01 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:19:01.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:01 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:19:01.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:01 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:19:01.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:01 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:19:01.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:01 smithi090 ceph-mon[34497]: pgmap v129: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:19:01.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:01 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:19:01.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:01 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:19:01.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:01 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:19:01.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:01 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:19:02.262 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:19:02.262 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:19:02.523 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:19:03.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:02.979+0000 7fda86a0a640 1 -- 172.21.15.2:0/2668741589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda80102d40 msgr2=0x7fda80103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:03.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:02.979+0000 7fda86a0a640 1 --2- 172.21.15.2:0/2668741589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda80102d40 0x7fda80103120 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fda70009900 tx=0x7fda7002a480 comp rx=0 tx=0).stop 2024-09-19T06:19:03.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:02.979+0000 7fda86a0a640 1 -- 172.21.15.2:0/2668741589 shutdown_connections 2024-09-19T06:19:03.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:02.979+0000 7fda86a0a640 1 --2- 172.21.15.2:0/2668741589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda8010c170 0x7fda8010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:03.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:02.979+0000 7fda86a0a640 1 --2- 172.21.15.2:0/2668741589 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda80103660 0x7fda8010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:03.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:02.979+0000 7fda86a0a640 1 --2- 172.21.15.2:0/2668741589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda80102d40 0x7fda80103120 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:03.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:02.979+0000 7fda86a0a640 1 -- 172.21.15.2:0/2668741589 >> 172.21.15.2:0/2668741589 conn(0x7fda800fc7a0 msgr2=0x7fda800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:03.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:02.979+0000 7fda86a0a640 1 -- 172.21.15.2:0/2668741589 shutdown_connections 2024-09-19T06:19:03.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:02.979+0000 7fda86a0a640 1 -- 172.21.15.2:0/2668741589 wait complete. 2024-09-19T06:19:03.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:02.980+0000 7fda86a0a640 1 Processor -- start 2024-09-19T06:19:03.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:02.980+0000 7fda86a0a640 1 -- start start 2024-09-19T06:19:03.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:02.980+0000 7fda86a0a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda80102d40 0x7fda801009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:03.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:02.980+0000 7fda86a0a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda80103660 0x7fda80100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:03.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:02.980+0000 7fda86a0a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda8010c170 0x7fda80101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:03.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:02.981+0000 7fda86a0a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fda80111e20 con 0x7fda8010c170 2024-09-19T06:19:03.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:02.981+0000 7fda86a0a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fda80111ca0 con 0x7fda80103660 2024-09-19T06:19:03.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:02.981+0000 7fda86a0a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fda80111fa0 con 0x7fda80102d40 2024-09-19T06:19:03.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:02.981+0000 7fda84fa7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda8010c170 0x7fda80101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:03.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:02.981+0000 7fda7ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda80102d40 0x7fda801009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:03.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:02.981+0000 7fda84fa7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda8010c170 0x7fda80101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41056/0 (socket says 172.21.15.2:41056) 2024-09-19T06:19:03.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:02.981+0000 7fda84fa7640 1 -- 172.21.15.2:0/1163698444 learned_addr learned my addr 172.21.15.2:0/1163698444 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:03.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:02.981+0000 7fda7f7fe640 1 --2- 172.21.15.2:0/1163698444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda80103660 0x7fda80100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:03.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:02.981+0000 7fda84fa7640 1 -- 172.21.15.2:0/1163698444 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda80102d40 msgr2=0x7fda801009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:03.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:02.981+0000 7fda84fa7640 1 --2- 172.21.15.2:0/1163698444 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda80102d40 0x7fda801009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:03.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:02.981+0000 7fda84fa7640 1 -- 172.21.15.2:0/1163698444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda80103660 msgr2=0x7fda80100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:03.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:02.981+0000 7fda84fa7640 1 --2- 172.21.15.2:0/1163698444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda80103660 0x7fda80100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:03.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:02.981+0000 7fda84fa7640 1 -- 172.21.15.2:0/1163698444 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda801a68c0 con 0x7fda8010c170 2024-09-19T06:19:03.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:02.981+0000 7fda7f7fe640 1 --2- 172.21.15.2:0/1163698444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda80103660 0x7fda80100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:19:03.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:02.981+0000 7fda84fa7640 1 --2- 172.21.15.2:0/1163698444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda8010c170 0x7fda80101420 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fda7800eaa0 tx=0x7fda7800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:03.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:02.981+0000 7fda7d7fa640 1 -- 172.21.15.2:0/1163698444 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda7800cdb0 con 0x7fda8010c170 2024-09-19T06:19:03.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:02.981+0000 7fda7d7fa640 1 -- 172.21.15.2:0/1163698444 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fda78005020 con 0x7fda8010c170 2024-09-19T06:19:03.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:02.981+0000 7fda86a0a640 1 -- 172.21.15.2:0/1163698444 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda801a6bb0 con 0x7fda8010c170 2024-09-19T06:19:03.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:02.981+0000 7fda7d7fa640 1 -- 172.21.15.2:0/1163698444 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda780116d0 con 0x7fda8010c170 2024-09-19T06:19:03.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:02.981+0000 7fda86a0a640 1 -- 172.21.15.2:0/1163698444 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda801a70f0 con 0x7fda8010c170 2024-09-19T06:19:03.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:02.983+0000 7fda86a0a640 1 -- 172.21.15.2:0/1163698444 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda80103120 con 0x7fda8010c170 2024-09-19T06:19:03.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:02.984+0000 7fda7d7fa640 1 -- 172.21.15.2:0/1163698444 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fda780051d0 con 0x7fda8010c170 2024-09-19T06:19:03.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:02.984+0000 7fda7d7fa640 1 --2- 172.21.15.2:0/1163698444 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fda680a33b0 0x7fda680a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:03.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:02.985+0000 7fda7ffff640 1 --2- 172.21.15.2:0/1163698444 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fda680a33b0 0x7fda680a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:03.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:02.985+0000 7fda7d7fa640 1 -- 172.21.15.2:0/1163698444 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fda780cfe50 con 0x7fda8010c170 2024-09-19T06:19:03.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:02.985+0000 7fda7ffff640 1 --2- 172.21.15.2:0/1163698444 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fda680a33b0 0x7fda680a5870 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fda70031440 tx=0x7fda70005b50 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:03.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:02.989+0000 7fda7d7fa640 1 -- 172.21.15.2:0/1163698444 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fda78016030 con 0x7fda8010c170 2024-09-19T06:19:03.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:03.205+0000 7fda86a0a640 1 -- 172.21.15.2:0/1163698444 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fda80107210 con 0x7fda8010c170 2024-09-19T06:19:03.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:03.206+0000 7fda7d7fa640 1 -- 172.21.15.2:0/1163698444 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11882 (secure 0 0 0) 0x7fda7809c860 con 0x7fda8010c170 2024-09-19T06:19:03.207 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:19:03.207 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-09-19T06:14:49:104280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:14:48.191083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24470,24472,24497]},"id":1}]} 2024-09-19T06:19:03.208 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-09-19T06:19:03.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:03.209+0000 7fda86a0a640 1 -- 172.21.15.2:0/1163698444 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fda680a33b0 msgr2=0x7fda680a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:03.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:03.209+0000 7fda86a0a640 1 --2- 172.21.15.2:0/1163698444 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fda680a33b0 0x7fda680a5870 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fda70031440 tx=0x7fda70005b50 comp rx=0 tx=0).stop 2024-09-19T06:19:03.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:03.209+0000 7fda86a0a640 1 -- 172.21.15.2:0/1163698444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda8010c170 msgr2=0x7fda80101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:03.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:03.209+0000 7fda86a0a640 1 --2- 172.21.15.2:0/1163698444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda8010c170 0x7fda80101420 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fda7800eaa0 tx=0x7fda7800ef60 comp rx=0 tx=0).stop 2024-09-19T06:19:03.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:03.209+0000 7fda86a0a640 1 -- 172.21.15.2:0/1163698444 shutdown_connections 2024-09-19T06:19:03.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:03.209+0000 7fda86a0a640 1 --2- 172.21.15.2:0/1163698444 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fda680a33b0 0x7fda680a5870 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:03.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:03.209+0000 7fda86a0a640 1 --2- 172.21.15.2:0/1163698444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda8010c170 0x7fda80101420 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:03.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:03.209+0000 7fda86a0a640 1 --2- 172.21.15.2:0/1163698444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda80103660 0x7fda80100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:03.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:03.209+0000 7fda86a0a640 1 --2- 172.21.15.2:0/1163698444 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda80102d40 0x7fda801009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:03.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:03.209+0000 7fda86a0a640 1 -- 172.21.15.2:0/1163698444 >> 172.21.15.2:0/1163698444 conn(0x7fda800fc7a0 msgr2=0x7fda800fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:03.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:03.209+0000 7fda86a0a640 1 -- 172.21.15.2:0/1163698444 shutdown_connections 2024-09-19T06:19:03.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:03.209+0000 7fda86a0a640 1 -- 172.21.15.2:0/1163698444 wait complete. 2024-09-19T06:19:03.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:03 smithi089 ceph-mon[34160]: pgmap v130: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:19:03.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:03 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1163698444' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:19:03.849 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:03 smithi002 ceph-mon[30982]: pgmap v130: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:19:03.849 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:03 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1163698444' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:19:03.879 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:19:03.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:03 smithi090 ceph-mon[34497]: pgmap v130: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:19:03.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:03 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1163698444' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:19:04.137 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:19:04.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.571+0000 7ff3efbd9640 1 -- 172.21.15.2:0/3306968468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3e810c170 msgr2=0x7ff3e810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:04.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.571+0000 7ff3efbd9640 1 --2- 172.21.15.2:0/3306968468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3e810c170 0x7ff3e810e610 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0009ca0 tx=0x7ff3e002a950 comp rx=0 tx=0).stop 2024-09-19T06:19:04.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.571+0000 7ff3efbd9640 1 -- 172.21.15.2:0/3306968468 shutdown_connections 2024-09-19T06:19:04.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.571+0000 7ff3efbd9640 1 --2- 172.21.15.2:0/3306968468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3e810c170 0x7ff3e810e610 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:04.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.571+0000 7ff3efbd9640 1 --2- 172.21.15.2:0/3306968468 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3e8103660 0x7ff3e810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:04.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.571+0000 7ff3efbd9640 1 --2- 172.21.15.2:0/3306968468 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3e8102d40 0x7ff3e8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:04.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.571+0000 7ff3efbd9640 1 -- 172.21.15.2:0/3306968468 >> 172.21.15.2:0/3306968468 conn(0x7ff3e80fc7a0 msgr2=0x7ff3e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:04.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.571+0000 7ff3efbd9640 1 -- 172.21.15.2:0/3306968468 shutdown_connections 2024-09-19T06:19:04.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.571+0000 7ff3efbd9640 1 -- 172.21.15.2:0/3306968468 wait complete. 2024-09-19T06:19:04.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.571+0000 7ff3efbd9640 1 Processor -- start 2024-09-19T06:19:04.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.571+0000 7ff3efbd9640 1 -- start start 2024-09-19T06:19:04.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.572+0000 7ff3efbd9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3e8102d40 0x7ff3e8198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:04.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.572+0000 7ff3efbd9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3e8103660 0x7ff3e81988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:04.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.572+0000 7ff3efbd9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3e810c170 0x7ff3e819cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:04.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.572+0000 7ff3efbd9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e8111e60 con 0x7ff3e810c170 2024-09-19T06:19:04.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.572+0000 7ff3efbd9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e8111ce0 con 0x7ff3e8103660 2024-09-19T06:19:04.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.572+0000 7ff3efbd9640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e8111fe0 con 0x7ff3e8102d40 2024-09-19T06:19:04.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.572+0000 7ff3ee176640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3e810c170 0x7ff3e819cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:04.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.572+0000 7ff3ee176640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3e810c170 0x7ff3e819cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41078/0 (socket says 172.21.15.2:41078) 2024-09-19T06:19:04.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.572+0000 7ff3ee176640 1 -- 172.21.15.2:0/420696787 learned_addr learned my addr 172.21.15.2:0/420696787 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:04.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.572+0000 7ff3ed975640 1 --2- 172.21.15.2:0/420696787 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3e8102d40 0x7ff3e8198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:04.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.572+0000 7ff3ed174640 1 --2- 172.21.15.2:0/420696787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3e8103660 0x7ff3e81988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:04.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.572+0000 7ff3ee176640 1 -- 172.21.15.2:0/420696787 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3e8102d40 msgr2=0x7ff3e8198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:04.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.572+0000 7ff3ee176640 1 --2- 172.21.15.2:0/420696787 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3e8102d40 0x7ff3e8198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:04.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.572+0000 7ff3ee176640 1 -- 172.21.15.2:0/420696787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3e8103660 msgr2=0x7ff3e81988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:04.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.572+0000 7ff3ee176640 1 --2- 172.21.15.2:0/420696787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3e8103660 0x7ff3e81988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:04.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.572+0000 7ff3ee176640 1 -- 172.21.15.2:0/420696787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3e819d330 con 0x7ff3e810c170 2024-09-19T06:19:04.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.573+0000 7ff3ee176640 1 --2- 172.21.15.2:0/420696787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3e810c170 0x7ff3e819cc50 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7ff3e002ae70 tx=0x7ff3e002f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:04.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.573+0000 7ff3deffd640 1 -- 172.21.15.2:0/420696787 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0034040 con 0x7ff3e810c170 2024-09-19T06:19:04.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.573+0000 7ff3deffd640 1 -- 172.21.15.2:0/420696787 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff3e00308f0 con 0x7ff3e810c170 2024-09-19T06:19:04.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.573+0000 7ff3efbd9640 1 -- 172.21.15.2:0/420696787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3e819d5c0 con 0x7ff3e810c170 2024-09-19T06:19:04.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.573+0000 7ff3deffd640 1 -- 172.21.15.2:0/420696787 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0004750 con 0x7ff3e810c170 2024-09-19T06:19:04.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.573+0000 7ff3efbd9640 1 -- 172.21.15.2:0/420696787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3e81a4f00 con 0x7ff3e810c170 2024-09-19T06:19:04.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.576+0000 7ff3deffd640 1 -- 172.21.15.2:0/420696787 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7ff3e0037020 con 0x7ff3e810c170 2024-09-19T06:19:04.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.576+0000 7ff3f1fb2740 1 Processor -- start 2024-09-19T06:19:04.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.576+0000 7ff3f1fb2740 1 -- start start 2024-09-19T06:19:04.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.576+0000 7ff3f1fb2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560c5be9b40 0x5560c5be8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:04.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.576+0000 7ff3f1fb2740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5560c5be85d0 0x5560c5be8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:04.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.576+0000 7ff3f1fb2740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5560c5bf7780 0x5560c5bf9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:04.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.576+0000 7ff3f1fb2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5560c5b4e2f0 con 0x5560c5be9b40 2024-09-19T06:19:04.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.576+0000 7ff3f1fb2740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5560c5af5cf0 con 0x5560c5bf7780 2024-09-19T06:19:04.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.576+0000 7ff3f1fb2740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5560c5b4a2b0 con 0x5560c5be85d0 2024-09-19T06:19:04.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.576+0000 7ff3ed174640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560c5be9b40 0x5560c5be8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:04.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.577+0000 7ff3ed174640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560c5be9b40 0x5560c5be8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41082/0 (socket says 172.21.15.2:41082) 2024-09-19T06:19:04.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.577+0000 7ff3ed174640 1 -- 172.21.15.2:0/2016455909 learned_addr learned my addr 172.21.15.2:0/2016455909 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:04.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.577+0000 7ff3ed174640 1 --2- 172.21.15.2:0/2016455909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5560c5bf7780 0x5560c5bf9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:04.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.577+0000 7ff3ed975640 1 --2- 172.21.15.2:0/2016455909 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5560c5be85d0 0x5560c5be8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:04.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.577+0000 7ff3ed174640 1 -- 172.21.15.2:0/2016455909 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5560c5be85d0 msgr2=0x5560c5be8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:04.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.577+0000 7ff3ed174640 1 --2- 172.21.15.2:0/2016455909 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5560c5be85d0 0x5560c5be8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:04.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.577+0000 7ff3ed174640 1 -- 172.21.15.2:0/2016455909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5560c5bf7780 msgr2=0x5560c5bf9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:04.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.577+0000 7ff3ed174640 1 --2- 172.21.15.2:0/2016455909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5560c5bf7780 0x5560c5bf9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:04.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.577+0000 7ff3ed174640 1 -- 172.21.15.2:0/2016455909 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560c5ada3a0 con 0x5560c5be9b40 2024-09-19T06:19:04.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.577+0000 7ff3deffd640 1 --2- 172.21.15.2:0/420696787 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff3d40a33b0 0x7ff3d40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:04.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.577+0000 7ff3ed174640 1 --2- 172.21.15.2:0/2016455909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560c5be9b40 0x5560c5be8090 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ff3d800bfd0 tx=0x7ff3d800b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ea95f9548dfe54a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:04.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.577+0000 7ff3ed975640 1 --2- 172.21.15.2:0/420696787 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff3d40a33b0 0x7ff3d40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:04.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.577+0000 7ff3deffd640 1 -- 172.21.15.2:0/420696787 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7ff3e00f0b70 con 0x7ff3e810c170 2024-09-19T06:19:04.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.577+0000 7ff3d3fff640 1 -- 172.21.15.2:0/2016455909 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d8019030 con 0x5560c5be9b40 2024-09-19T06:19:04.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.577+0000 7ff3d3fff640 1 -- 172.21.15.2:0/2016455909 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff3d80118f0 con 0x5560c5be9b40 2024-09-19T06:19:04.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.577+0000 7ff3d3fff640 1 -- 172.21.15.2:0/2016455909 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d801d740 con 0x5560c5be9b40 2024-09-19T06:19:04.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.578+0000 7ff3f1fb2740 1 -- 172.21.15.2:0/2016455909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560c5be9b40 msgr2=0x5560c5be8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:04.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.578+0000 7ff3ed975640 1 --2- 172.21.15.2:0/420696787 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff3d40a33b0 0x7ff3d40a5870 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x5560c5be5ac0 tx=0x7ff3e4008040 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:04.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.578+0000 7ff3f1fb2740 1 --2- 172.21.15.2:0/2016455909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560c5be9b40 0x5560c5be8090 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ff3d800bfd0 tx=0x7ff3d800b6a0 comp rx=0 tx=0).stop 2024-09-19T06:19:04.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.578+0000 7ff3f1fb2740 1 -- 172.21.15.2:0/2016455909 shutdown_connections 2024-09-19T06:19:04.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.578+0000 7ff3f1fb2740 1 --2- 172.21.15.2:0/2016455909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5560c5bf7780 0x5560c5bf9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:04.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.578+0000 7ff3f1fb2740 1 --2- 172.21.15.2:0/2016455909 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5560c5be85d0 0x5560c5be8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:04.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.578+0000 7ff3f1fb2740 1 --2- 172.21.15.2:0/2016455909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560c5be9b40 0x5560c5be8090 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:04.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.578+0000 7ff3f1fb2740 1 -- 172.21.15.2:0/2016455909 >> 172.21.15.2:0/2016455909 conn(0x5560c5bb1310 msgr2=0x5560c5be4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:04.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.578+0000 7ff3f1fb2740 1 -- 172.21.15.2:0/2016455909 shutdown_connections 2024-09-19T06:19:04.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.578+0000 7ff3f1fb2740 1 -- 172.21.15.2:0/2016455909 wait complete. 2024-09-19T06:19:04.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.579+0000 7ff3f1fb2740 1 -- start start 2024-09-19T06:19:04.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.579+0000 7ff3f1fb2740 1 Processor -- start 2024-09-19T06:19:04.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.579+0000 7ff3f1fb2740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5560c5be85d0 0x5560c5bf71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:04.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.579+0000 7ff3f1fb2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560c5be9b40 0x5560c5bf4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:04.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.579+0000 7ff3f1fb2740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5560c5bf7780 0x5560c5bf4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:04.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.579+0000 7ff3f1fb2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5560c5bfa480 con 0x5560c5be9b40 2024-09-19T06:19:04.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.579+0000 7ff3f1fb2740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5560c5b09060 con 0x5560c5bf7780 2024-09-19T06:19:04.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.579+0000 7ff3f1fb2740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5560c5bfa600 con 0x5560c5be85d0 2024-09-19T06:19:04.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.579+0000 7ff3f1fb2740 10 client.0 _ll_register_callbacks cb 0x5560c585c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:04.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.579+0000 7ff3ed174640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560c5be9b40 0x5560c5bf4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:04.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.579+0000 7ff3ed174640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560c5be9b40 0x5560c5bf4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41086/0 (socket says 172.21.15.2:41086) 2024-09-19T06:19:04.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.579+0000 7ff3ed174640 1 -- 172.21.15.2:0/501542863 learned_addr learned my addr 172.21.15.2:0/501542863 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:04.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.580+0000 7ff3ed975640 1 --2- 172.21.15.2:0/501542863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5560c5be85d0 0x5560c5bf71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:04.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.580+0000 7ff3ee176640 1 --2- 172.21.15.2:0/501542863 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5560c5bf7780 0x5560c5bf4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:04.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.580+0000 7ff3ed174640 1 -- 172.21.15.2:0/501542863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5560c5be85d0 msgr2=0x5560c5bf71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:04.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.580+0000 7ff3ed174640 1 --2- 172.21.15.2:0/501542863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5560c5be85d0 0x5560c5bf71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:04.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.580+0000 7ff3ed174640 1 -- 172.21.15.2:0/501542863 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5560c5bf7780 msgr2=0x5560c5bf4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:04.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.580+0000 7ff3ed174640 1 --2- 172.21.15.2:0/501542863 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5560c5bf7780 0x5560c5bf4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:04.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.580+0000 7ff3ed174640 1 -- 172.21.15.2:0/501542863 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560c58bf3c0 con 0x5560c5be9b40 2024-09-19T06:19:04.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.580+0000 7ff3ed174640 1 --2- 172.21.15.2:0/501542863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560c5be9b40 0x5560c5bf4460 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8005d00 tx=0x7ff3d80116d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb1629da6bd5b5c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:04.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.580+0000 7ff3d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:19:04.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.580+0000 7ff3d17fa640 1 -- 172.21.15.2:0/501542863 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d8019040 con 0x5560c5be9b40 2024-09-19T06:19:04.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.580+0000 7ff3d17fa640 1 -- 172.21.15.2:0/501542863 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7ff3d8011ca0 con 0x5560c5be9b40 2024-09-19T06:19:04.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.580+0000 7ff3f1fb2740 1 -- 172.21.15.2:0/501542863 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3d80118f0 con 0x5560c5be9b40 2024-09-19T06:19:04.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.580+0000 7ff3d17fa640 1 -- 172.21.15.2:0/501542863 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff3d8011ea0 con 0x5560c5be9b40 2024-09-19T06:19:04.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.580+0000 7ff3f1fb2740 10 client.16338 fetch_fsmap learned FSMap version 26 2024-09-19T06:19:04.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.581+0000 7ff3f1fb2740 1 -- 172.21.15.2:0/501542863 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5560c5c05f60 con 0x5560c5be9b40 2024-09-19T06:19:04.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.581+0000 7ff3d17fa640 1 -- 172.21.15.2:0/501542863 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff3d80118f0 con 0x5560c5be9b40 2024-09-19T06:19:04.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.581+0000 7ff3d17fa640 1 -- 172.21.15.2:0/501542863 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7ff3d801d4c0 con 0x5560c5be9b40 2024-09-19T06:19:04.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.581+0000 7ff3f1fb2740 10 client.16338 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:19:04.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.581+0000 7ff3f1fb2740 10 client.16338 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:19:04.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.581+0000 7ff3f1fb2740 20 client.16338 populate_metadata read hostname 'smithi002' 2024-09-19T06:19:04.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.581+0000 7ff3f1fb2740 1 --2- 172.21.15.2:0/501542863 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x5560c5c07310 0x5560c5c09700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:04.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.581+0000 7ff3f1fb2740 4 client.16338 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:19:04.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.581+0000 7ff3f1fb2740 1 -- 172.21.15.2:0/501542863 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5560c5b5b860 con 0x5560c5c07310 2024-09-19T06:19:04.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.581+0000 7ff3ed975640 1 --2- 172.21.15.2:0/501542863 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x5560c5c07310 0x5560c5c09700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:04.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.582+0000 7ff3d17fa640 10 client.16338 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:19:04.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.582+0000 7ff3ed975640 1 --2- 172.21.15.2:0/501542863 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x5560c5c07310 0x5560c5c09700 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e6914255faf2ed80 server_cookie=d6a71c530fd015a9 in_seq=0 out_seq=0 2024-09-19T06:19:04.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.582+0000 7ff3d17fa640 1 -- 172.21.15.2:0/501542863 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5560c5b5b860 con 0x5560c5c07310 2024-09-19T06:19:04.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.582+0000 7ff3d17fa640 10 client.16338 handle_command_reply: tid=0 2024-09-19T06:19:04.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.583+0000 7ff3f1fb2740 1 client.16338 shutdown 2024-09-19T06:19:04.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.583+0000 7ff3f1fb2740 1 -- 172.21.15.2:0/501542863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560c5be9b40 msgr2=0x5560c5bf4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:04.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.583+0000 7ff3f1fb2740 1 --2- 172.21.15.2:0/501542863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560c5be9b40 0x5560c5bf4460 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8005d00 tx=0x7ff3d80116d0 comp rx=0 tx=0).stop 2024-09-19T06:19:04.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.583+0000 7ff3f1fb2740 1 -- 172.21.15.2:0/501542863 shutdown_connections 2024-09-19T06:19:04.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.583+0000 7ff3f1fb2740 1 --2- 172.21.15.2:0/501542863 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x5560c5c07310 0x5560c5c09700 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:04.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.583+0000 7ff3f1fb2740 1 --2- 172.21.15.2:0/501542863 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5560c5bf7780 0x5560c5bf4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:04.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.583+0000 7ff3f1fb2740 1 --2- 172.21.15.2:0/501542863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560c5be9b40 0x5560c5bf4460 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:04.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.583+0000 7ff3f1fb2740 1 --2- 172.21.15.2:0/501542863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5560c5be85d0 0x5560c5bf71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:04.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.583+0000 7ff3d17fa640 0 client.16338 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:19:04.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.583+0000 7ff3f1fb2740 1 -- 172.21.15.2:0/501542863 >> 172.21.15.2:0/501542863 conn(0x5560c5bb1310 msgr2=0x5560c5bea960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:04.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.583+0000 7ff3f1fb2740 1 -- 172.21.15.2:0/501542863 shutdown_connections 2024-09-19T06:19:04.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.583+0000 7ff3f1fb2740 1 -- 172.21.15.2:0/501542863 wait complete. 2024-09-19T06:19:04.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.583+0000 7ff3f1fb2740 20 client.16338 trim_cache size 0 max 16384 2024-09-19T06:19:04.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.596+0000 7ff3f1fb2740 1 Processor -- start 2024-09-19T06:19:04.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.596+0000 7ff3f1fb2740 1 -- start start 2024-09-19T06:19:04.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.596+0000 7ff3f1fb2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560c5be85d0 0x5560c5c09700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:04.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.596+0000 7ff3f1fb2740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5560c5be9b40 0x5560c5be4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:04.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.596+0000 7ff3f1fb2740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5560c5bf7780 0x5560c5be4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:04.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.596+0000 7ff3f1fb2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e81add60 con 0x5560c5be85d0 2024-09-19T06:19:04.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.596+0000 7ff3f1fb2740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e81ab630 con 0x5560c5be9b40 2024-09-19T06:19:04.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.596+0000 7ff3f1fb2740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e81a9480 con 0x5560c5bf7780 2024-09-19T06:19:04.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.596+0000 7ff3ed975640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560c5be85d0 0x5560c5c09700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:04.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.596+0000 7ff3ed975640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560c5be85d0 0x5560c5c09700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41102/0 (socket says 172.21.15.2:41102) 2024-09-19T06:19:04.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.596+0000 7ff3ed975640 1 -- 172.21.15.2:0/76624771 learned_addr learned my addr 172.21.15.2:0/76624771 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:04.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.597+0000 7ff3ee176640 1 --2- 172.21.15.2:0/76624771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5560c5bf7780 0x5560c5be4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:04.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.597+0000 7ff3ed174640 1 --2- 172.21.15.2:0/76624771 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5560c5be9b40 0x5560c5be4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:04.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.597+0000 7ff3ed975640 1 -- 172.21.15.2:0/76624771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5560c5bf7780 msgr2=0x5560c5be4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:04.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.597+0000 7ff3ed975640 1 --2- 172.21.15.2:0/76624771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5560c5bf7780 0x5560c5be4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:04.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.597+0000 7ff3ed975640 1 -- 172.21.15.2:0/76624771 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5560c5be9b40 msgr2=0x5560c5be4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:04.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.597+0000 7ff3ed975640 1 --2- 172.21.15.2:0/76624771 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5560c5be9b40 0x5560c5be4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:04.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.597+0000 7ff3ed975640 1 -- 172.21.15.2:0/76624771 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560c5c03c00 con 0x5560c5be85d0 2024-09-19T06:19:04.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.597+0000 7ff3ee176640 1 --2- 172.21.15.2:0/76624771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5560c5bf7780 0x5560c5be4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:19:04.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.597+0000 7ff3ed975640 1 --2- 172.21.15.2:0/76624771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560c5be85d0 0x5560c5c09700 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x5560c5c09d90 tx=0x7ff3e4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d69ee1e057869908 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:04.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.597+0000 7ff3d37fe640 1 -- 172.21.15.2:0/76624771 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e4015da0 con 0x5560c5be85d0 2024-09-19T06:19:04.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.597+0000 7ff3d37fe640 1 -- 172.21.15.2:0/76624771 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff3e402e070 con 0x5560c5be85d0 2024-09-19T06:19:04.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.597+0000 7ff3d37fe640 1 -- 172.21.15.2:0/76624771 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e4022650 con 0x5560c5be85d0 2024-09-19T06:19:04.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.598+0000 7ff3f1fb2740 1 -- 172.21.15.2:0/76624771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560c5be85d0 msgr2=0x5560c5c09700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:04.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.598+0000 7ff3f1fb2740 1 --2- 172.21.15.2:0/76624771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560c5be85d0 0x5560c5c09700 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x5560c5c09d90 tx=0x7ff3e4017000 comp rx=0 tx=0).stop 2024-09-19T06:19:04.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.598+0000 7ff3f1fb2740 1 -- 172.21.15.2:0/76624771 shutdown_connections 2024-09-19T06:19:04.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.598+0000 7ff3f1fb2740 1 --2- 172.21.15.2:0/76624771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5560c5bf7780 0x5560c5be4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:04.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.598+0000 7ff3f1fb2740 1 --2- 172.21.15.2:0/76624771 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5560c5be9b40 0x5560c5be4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:04.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.598+0000 7ff3f1fb2740 1 --2- 172.21.15.2:0/76624771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560c5be85d0 0x5560c5c09700 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:04.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.598+0000 7ff3f1fb2740 1 -- 172.21.15.2:0/76624771 >> 172.21.15.2:0/76624771 conn(0x5560c5bb1310 msgr2=0x5560c5bdfa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:04.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.598+0000 7ff3f1fb2740 1 -- 172.21.15.2:0/76624771 shutdown_connections 2024-09-19T06:19:04.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.598+0000 7ff3f1fb2740 1 -- 172.21.15.2:0/76624771 wait complete. 2024-09-19T06:19:04.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.598+0000 7ff3f1fb2740 1 -- start start 2024-09-19T06:19:04.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.598+0000 7ff3f1fb2740 1 Processor -- start 2024-09-19T06:19:04.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.599+0000 7ff3f1fb2740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5560c5be85d0 0x5560c5bffb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:04.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.599+0000 7ff3f1fb2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560c5be9b40 0x5560c5c000c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:04.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.599+0000 7ff3f1fb2740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5560c5bf7780 0x5560c5bfaf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:04.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.599+0000 7ff3f1fb2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e81a9af0 con 0x5560c5be9b40 2024-09-19T06:19:04.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.599+0000 7ff3f1fb2740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e81aaf60 con 0x5560c5be85d0 2024-09-19T06:19:04.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.599+0000 7ff3f1fb2740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e81aa1c0 con 0x5560c5bf7780 2024-09-19T06:19:04.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.599+0000 7ff3f1fb2740 10 client.0 _ll_register_callbacks cb 0x7ff3d8013400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:04.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.599+0000 7ff3ed174640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560c5be9b40 0x5560c5c000c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:04.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.599+0000 7ff3ed174640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560c5be9b40 0x5560c5c000c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41118/0 (socket says 172.21.15.2:41118) 2024-09-19T06:19:04.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.599+0000 7ff3ed174640 1 -- 172.21.15.2:0/3326517 learned_addr learned my addr 172.21.15.2:0/3326517 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:04.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.599+0000 7ff3ee176640 1 --2- 172.21.15.2:0/3326517 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5560c5bf7780 0x5560c5bfaf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:04.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.599+0000 7ff3ed975640 1 --2- 172.21.15.2:0/3326517 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5560c5be85d0 0x5560c5bffb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:04.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.599+0000 7ff3ed174640 1 -- 172.21.15.2:0/3326517 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5560c5bf7780 msgr2=0x5560c5bfaf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:04.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.599+0000 7ff3ed174640 1 --2- 172.21.15.2:0/3326517 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5560c5bf7780 0x5560c5bfaf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:04.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.599+0000 7ff3ed174640 1 -- 172.21.15.2:0/3326517 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5560c5be85d0 msgr2=0x5560c5bffb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:04.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.599+0000 7ff3ed174640 1 --2- 172.21.15.2:0/3326517 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5560c5be85d0 0x5560c5bffb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:04.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.599+0000 7ff3ed174640 1 -- 172.21.15.2:0/3326517 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560c5bfb790 con 0x5560c5be9b40 2024-09-19T06:19:04.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.599+0000 7ff3ed174640 1 --2- 172.21.15.2:0/3326517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560c5be9b40 0x5560c5c000c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x5560c5bf5aa0 tx=0x7ff3d800bb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83260cc8e18c9d86 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:04.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.599+0000 7ff3d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:19:04.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.600+0000 7ff3d17fa640 1 -- 172.21.15.2:0/3326517 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d8035030 con 0x5560c5be9b40 2024-09-19T06:19:04.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.600+0000 7ff3d17fa640 1 -- 172.21.15.2:0/3326517 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7ff3d801dab0 con 0x5560c5be9b40 2024-09-19T06:19:04.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.600+0000 7ff3f1fb2740 1 -- 172.21.15.2:0/3326517 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3e402e070 con 0x5560c5be9b40 2024-09-19T06:19:04.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.600+0000 7ff3d17fa640 1 -- 172.21.15.2:0/3326517 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff3d803f050 con 0x5560c5be9b40 2024-09-19T06:19:04.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.600+0000 7ff3f1fb2740 10 client.16344 fetch_fsmap learned FSMap version 26 2024-09-19T06:19:04.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.600+0000 7ff3f1fb2740 1 -- 172.21.15.2:0/3326517 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5560c5c71900 con 0x5560c5be9b40 2024-09-19T06:19:04.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.600+0000 7ff3d17fa640 1 -- 172.21.15.2:0/3326517 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff3e402e070 con 0x5560c5be9b40 2024-09-19T06:19:04.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.600+0000 7ff3d17fa640 1 -- 172.21.15.2:0/3326517 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7ff3d8011b80 con 0x5560c5be9b40 2024-09-19T06:19:04.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.600+0000 7ff3f1fb2740 10 client.16344 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:19:04.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.600+0000 7ff3f1fb2740 10 client.16344 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:19:04.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.600+0000 7ff3f1fb2740 20 client.16344 populate_metadata read hostname 'smithi002' 2024-09-19T06:19:04.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.600+0000 7ff3f1fb2740 1 --2- 172.21.15.2:0/3326517 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x5560c5c720a0 0x5560c5c744c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:04.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.600+0000 7ff3f1fb2740 4 client.16344 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:19:04.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.600+0000 7ff3f1fb2740 1 -- 172.21.15.2:0/3326517 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5560c5b55d70 con 0x5560c5c720a0 2024-09-19T06:19:04.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.601+0000 7ff3ed975640 1 --2- 172.21.15.2:0/3326517 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x5560c5c720a0 0x5560c5c744c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:04.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.601+0000 7ff3ed975640 1 --2- 172.21.15.2:0/3326517 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x5560c5c720a0 0x5560c5c744c0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=59ad4fec1c008273 server_cookie=f553736e1e347593 in_seq=0 out_seq=0 2024-09-19T06:19:04.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.601+0000 7ff3d17fa640 10 client.16344 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:19:04.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.602+0000 7ff3d17fa640 1 -- 172.21.15.2:0/3326517 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5560c5b55d70 con 0x5560c5c720a0 2024-09-19T06:19:04.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.602+0000 7ff3d17fa640 10 client.16344 handle_command_reply: tid=0 2024-09-19T06:19:04.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.602+0000 7ff3f1fb2740 1 client.16344 shutdown 2024-09-19T06:19:04.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.602+0000 7ff3f1fb2740 1 -- 172.21.15.2:0/3326517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560c5be9b40 msgr2=0x5560c5c000c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:04.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.602+0000 7ff3f1fb2740 1 --2- 172.21.15.2:0/3326517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560c5be9b40 0x5560c5c000c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x5560c5bf5aa0 tx=0x7ff3d800bb80 comp rx=0 tx=0).stop 2024-09-19T06:19:04.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.602+0000 7ff3f1fb2740 1 -- 172.21.15.2:0/3326517 shutdown_connections 2024-09-19T06:19:04.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.602+0000 7ff3f1fb2740 1 --2- 172.21.15.2:0/3326517 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x5560c5c720a0 0x5560c5c744c0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:04.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.602+0000 7ff3f1fb2740 1 --2- 172.21.15.2:0/3326517 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5560c5bf7780 0x5560c5bfaf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:04.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.602+0000 7ff3f1fb2740 1 --2- 172.21.15.2:0/3326517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5560c5be9b40 0x5560c5c000c0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:04.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.602+0000 7ff3d17fa640 0 client.16344 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:19:04.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.602+0000 7ff3f1fb2740 1 --2- 172.21.15.2:0/3326517 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5560c5be85d0 0x5560c5bffb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:04.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.602+0000 7ff3f1fb2740 1 -- 172.21.15.2:0/3326517 >> 172.21.15.2:0/3326517 conn(0x5560c5bb1310 msgr2=0x5560c5bf5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:04.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.602+0000 7ff3f1fb2740 1 -- 172.21.15.2:0/3326517 shutdown_connections 2024-09-19T06:19:04.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.602+0000 7ff3f1fb2740 1 -- 172.21.15.2:0/3326517 wait complete. 2024-09-19T06:19:04.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.602+0000 7ff3f1fb2740 20 client.16344 trim_cache size 0 max 16384 2024-09-19T06:19:04.609 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:19:04.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.603+0000 7ff3efbd9640 1 -- 172.21.15.2:0/420696787 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff3d40a33b0 msgr2=0x7ff3d40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:04.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.603+0000 7ff3efbd9640 1 --2- 172.21.15.2:0/420696787 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff3d40a33b0 0x7ff3d40a5870 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x5560c5be5ac0 tx=0x7ff3e4008040 comp rx=0 tx=0).stop 2024-09-19T06:19:04.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.603+0000 7ff3efbd9640 1 -- 172.21.15.2:0/420696787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3e810c170 msgr2=0x7ff3e819cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:04.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.603+0000 7ff3efbd9640 1 --2- 172.21.15.2:0/420696787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3e810c170 0x7ff3e819cc50 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7ff3e002ae70 tx=0x7ff3e002f5d0 comp rx=0 tx=0).stop 2024-09-19T06:19:04.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.603+0000 7ff3efbd9640 1 -- 172.21.15.2:0/420696787 shutdown_connections 2024-09-19T06:19:04.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.603+0000 7ff3efbd9640 1 --2- 172.21.15.2:0/420696787 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff3d40a33b0 0x7ff3d40a5870 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:04.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.603+0000 7ff3efbd9640 1 --2- 172.21.15.2:0/420696787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3e810c170 0x7ff3e819cc50 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:04.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.603+0000 7ff3efbd9640 1 --2- 172.21.15.2:0/420696787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3e8103660 0x7ff3e81988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:04.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.603+0000 7ff3efbd9640 1 --2- 172.21.15.2:0/420696787 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3e8102d40 0x7ff3e8198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:04.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.603+0000 7ff3efbd9640 1 -- 172.21.15.2:0/420696787 >> 172.21.15.2:0/420696787 conn(0x7ff3e80fc7a0 msgr2=0x7ff3e80fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:04.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.603+0000 7ff3efbd9640 1 -- 172.21.15.2:0/420696787 shutdown_connections 2024-09-19T06:19:04.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:04.603+0000 7ff3efbd9640 1 -- 172.21.15.2:0/420696787 wait complete. 2024-09-19T06:19:05.340 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:19:05.597 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:19:05.718 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:05 smithi002 ceph-mon[30982]: pgmap v131: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T06:19:05.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:05 smithi089 ceph-mon[34160]: pgmap v131: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T06:19:05.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:05 smithi090 ceph-mon[34497]: pgmap v131: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T06:19:06.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.182+0000 7f12a2f8f640 1 -- 172.21.15.2:0/2548575328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f129c10c160 msgr2=0x7f129c10e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:06.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.182+0000 7f12a2f8f640 1 --2- 172.21.15.2:0/2548575328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f129c10c160 0x7f129c10e600 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f1294009ca0 tx=0x7f129402a950 comp rx=0 tx=0).stop 2024-09-19T06:19:06.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.182+0000 7f12a2f8f640 1 -- 172.21.15.2:0/2548575328 shutdown_connections 2024-09-19T06:19:06.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.182+0000 7f12a2f8f640 1 --2- 172.21.15.2:0/2548575328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f129c10c160 0x7f129c10e600 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:06.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.182+0000 7f12a2f8f640 1 --2- 172.21.15.2:0/2548575328 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f129c103650 0x7f129c10bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:06.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.182+0000 7f12a2f8f640 1 --2- 172.21.15.2:0/2548575328 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f129c102d30 0x7f129c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:06.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.182+0000 7f12a2f8f640 1 -- 172.21.15.2:0/2548575328 >> 172.21.15.2:0/2548575328 conn(0x7f129c0fc7d0 msgr2=0x7f129c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:06.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.182+0000 7f12a2f8f640 1 -- 172.21.15.2:0/2548575328 shutdown_connections 2024-09-19T06:19:06.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.182+0000 7f12a2f8f640 1 -- 172.21.15.2:0/2548575328 wait complete. 2024-09-19T06:19:06.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.183+0000 7f12a2f8f640 1 Processor -- start 2024-09-19T06:19:06.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.183+0000 7f12a2f8f640 1 -- start start 2024-09-19T06:19:06.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.183+0000 7f12a2f8f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f129c102d30 0x7f129c19a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:06.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.183+0000 7f12a2f8f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f129c103650 0x7f129c19aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:06.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.183+0000 7f12a2f8f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f129c10c160 0x7f129c19ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:06.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.183+0000 7f12a2f8f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f129c111df0 con 0x7f129c102d30 2024-09-19T06:19:06.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.183+0000 7f12a2f8f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f129c111c70 con 0x7f129c10c160 2024-09-19T06:19:06.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.183+0000 7f12a2f8f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f129c111f70 con 0x7f129c103650 2024-09-19T06:19:06.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.183+0000 7f12a0d2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f129c102d30 0x7f129c19a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:06.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.183+0000 7f12a0d2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f129c102d30 0x7f129c19a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50564/0 (socket says 172.21.15.2:50564) 2024-09-19T06:19:06.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.183+0000 7f12a0d2b640 1 -- 172.21.15.2:0/2878791688 learned_addr learned my addr 172.21.15.2:0/2878791688 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:06.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.183+0000 7f129bfff640 1 --2- 172.21.15.2:0/2878791688 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f129c103650 0x7f129c19aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:06.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.184+0000 7f12a152c640 1 --2- 172.21.15.2:0/2878791688 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f129c10c160 0x7f129c19ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:06.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.184+0000 7f12a0d2b640 1 -- 172.21.15.2:0/2878791688 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f129c103650 msgr2=0x7f129c19aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:06.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.184+0000 7f12a0d2b640 1 --2- 172.21.15.2:0/2878791688 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f129c103650 0x7f129c19aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:06.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.184+0000 7f12a0d2b640 1 -- 172.21.15.2:0/2878791688 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f129c10c160 msgr2=0x7f129c19ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:06.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.184+0000 7f12a0d2b640 1 --2- 172.21.15.2:0/2878791688 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f129c10c160 0x7f129c19ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:06.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.184+0000 7f12a0d2b640 1 -- 172.21.15.2:0/2878791688 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f129c19f520 con 0x7f129c102d30 2024-09-19T06:19:06.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.184+0000 7f129bfff640 1 --2- 172.21.15.2:0/2878791688 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f129c103650 0x7f129c19aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:19:06.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.184+0000 7f12a152c640 1 --2- 172.21.15.2:0/2878791688 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f129c10c160 0x7f129c19ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:19:06.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.184+0000 7f12a0d2b640 1 --2- 172.21.15.2:0/2878791688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f129c102d30 0x7f129c19a570 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f129000c890 tx=0x7f129000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:06.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.184+0000 7f1299ffb640 1 -- 172.21.15.2:0/2878791688 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1290004220 con 0x7f129c102d30 2024-09-19T06:19:06.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.184+0000 7f1299ffb640 1 -- 172.21.15.2:0/2878791688 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f12900043c0 con 0x7f129c102d30 2024-09-19T06:19:06.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.184+0000 7f12a2f8f640 1 -- 172.21.15.2:0/2878791688 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f129c19f810 con 0x7f129c102d30 2024-09-19T06:19:06.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.184+0000 7f1299ffb640 1 -- 172.21.15.2:0/2878791688 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1290004a00 con 0x7f129c102d30 2024-09-19T06:19:06.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.184+0000 7f12a2f8f640 1 -- 172.21.15.2:0/2878791688 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f129c1a70f0 con 0x7f129c102d30 2024-09-19T06:19:06.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.186+0000 7f1299ffb640 1 -- 172.21.15.2:0/2878791688 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f1290004ba0 con 0x7f129c102d30 2024-09-19T06:19:06.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.187+0000 7f12a5368740 1 Processor -- start 2024-09-19T06:19:06.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.187+0000 7f12a5368740 1 -- start start 2024-09-19T06:19:06.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.187+0000 7f12a5368740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55937d0e1b40 0x55937d0e0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:06.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.187+0000 7f12a5368740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55937d0e05d0 0x55937d0e0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:06.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.187+0000 7f12a5368740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55937d0eb370 0x55937d0ed760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:06.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.187+0000 7f12a5368740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55937d0462f0 con 0x55937d0eb370 2024-09-19T06:19:06.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.187+0000 7f12a5368740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55937cfedcf0 con 0x55937d0e05d0 2024-09-19T06:19:06.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.187+0000 7f12a5368740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55937d0422b0 con 0x55937d0e1b40 2024-09-19T06:19:06.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.187+0000 7f129bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55937d0eb370 0x55937d0ed760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:06.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.187+0000 7f1299ffb640 1 --2- 172.21.15.2:0/2878791688 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f128c0a33b0 0x7f128c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:06.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.187+0000 7f129bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55937d0eb370 0x55937d0ed760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50570/0 (socket says 172.21.15.2:50570) 2024-09-19T06:19:06.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.187+0000 7f129bfff640 1 -- 172.21.15.2:0/3073957975 learned_addr learned my addr 172.21.15.2:0/3073957975 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:06.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.188+0000 7f12a0d2b640 1 --2- 172.21.15.2:0/3073957975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55937d0e05d0 0x55937d0e0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:06.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.188+0000 7f12a152c640 1 --2- 172.21.15.2:0/3073957975 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55937d0e1b40 0x55937d0e0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:06.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.188+0000 7f12a152c640 1 --2- 172.21.15.2:0/2878791688 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f128c0a33b0 0x7f128c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:06.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.188+0000 7f1299ffb640 1 -- 172.21.15.2:0/2878791688 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f12900cfac0 con 0x7f129c102d30 2024-09-19T06:19:06.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.188+0000 7f129bfff640 1 -- 172.21.15.2:0/3073957975 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55937d0e1b40 msgr2=0x55937d0e0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:06.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.188+0000 7f129bfff640 1 --2- 172.21.15.2:0/3073957975 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55937d0e1b40 0x55937d0e0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:06.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.188+0000 7f129bfff640 1 -- 172.21.15.2:0/3073957975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55937d0e05d0 msgr2=0x55937d0e0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:06.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.188+0000 7f129bfff640 1 --2- 172.21.15.2:0/3073957975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55937d0e05d0 0x55937d0e0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:06.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.188+0000 7f129bfff640 1 -- 172.21.15.2:0/3073957975 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55937cfd23a0 con 0x55937d0eb370 2024-09-19T06:19:06.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.188+0000 7f129bfff640 1 --2- 172.21.15.2:0/3073957975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55937d0eb370 0x55937d0ed760 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f128800bab0 tx=0x7f128800bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd4b68d8ceae522 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:06.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.188+0000 7f12a152c640 1 --2- 172.21.15.2:0/2878791688 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f128c0a33b0 0x7f128c0a5870 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1294009ca0 tx=0x7f12940095c0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:06.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.188+0000 7f1286ffd640 1 -- 172.21.15.2:0/3073957975 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1288017420 con 0x55937d0eb370 2024-09-19T06:19:06.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.188+0000 7f1286ffd640 1 -- 172.21.15.2:0/3073957975 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1288017a70 con 0x55937d0eb370 2024-09-19T06:19:06.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.188+0000 7f1286ffd640 1 -- 172.21.15.2:0/3073957975 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f128800f9d0 con 0x55937d0eb370 2024-09-19T06:19:06.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.189+0000 7f12a5368740 1 -- 172.21.15.2:0/3073957975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55937d0eb370 msgr2=0x55937d0ed760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:06.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.189+0000 7f12a5368740 1 --2- 172.21.15.2:0/3073957975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55937d0eb370 0x55937d0ed760 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f128800bab0 tx=0x7f128800bf70 comp rx=0 tx=0).stop 2024-09-19T06:19:06.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.189+0000 7f12a5368740 1 -- 172.21.15.2:0/3073957975 shutdown_connections 2024-09-19T06:19:06.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.189+0000 7f12a5368740 1 --2- 172.21.15.2:0/3073957975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55937d0eb370 0x55937d0ed760 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:06.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.189+0000 7f12a5368740 1 --2- 172.21.15.2:0/3073957975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55937d0e05d0 0x55937d0e0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:06.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.189+0000 7f12a5368740 1 --2- 172.21.15.2:0/3073957975 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55937d0e1b40 0x55937d0e0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:06.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.189+0000 7f12a5368740 1 -- 172.21.15.2:0/3073957975 >> 172.21.15.2:0/3073957975 conn(0x55937d0a9310 msgr2=0x55937d0dcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:06.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.189+0000 7f12a5368740 1 -- 172.21.15.2:0/3073957975 shutdown_connections 2024-09-19T06:19:06.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.189+0000 7f12a5368740 1 -- 172.21.15.2:0/3073957975 wait complete. 2024-09-19T06:19:06.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.189+0000 7f12a5368740 1 -- start start 2024-09-19T06:19:06.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.189+0000 7f12a5368740 1 Processor -- start 2024-09-19T06:19:06.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.190+0000 7f12a5368740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55937d0e05d0 0x55937d0ead30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:06.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.190+0000 7f12a5368740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55937d0e1b40 0x55937d0e7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:06.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.190+0000 7f12a5368740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55937d0eb370 0x55937d0e85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:06.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.190+0000 7f12a5368740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55937d0ee070 con 0x55937d0e05d0 2024-09-19T06:19:06.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.190+0000 7f12a5368740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55937d001060 con 0x55937d0e1b40 2024-09-19T06:19:06.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.190+0000 7f12a5368740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55937d0ee1f0 con 0x55937d0eb370 2024-09-19T06:19:06.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.190+0000 7f12a5368740 10 client.0 _ll_register_callbacks cb 0x55937cd548c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:06.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.190+0000 7f12a0d2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55937d0e05d0 0x55937d0ead30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:06.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.190+0000 7f12a0d2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55937d0e05d0 0x55937d0ead30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50582/0 (socket says 172.21.15.2:50582) 2024-09-19T06:19:06.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.190+0000 7f12a0d2b640 1 -- 172.21.15.2:0/1674579973 learned_addr learned my addr 172.21.15.2:0/1674579973 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:06.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.190+0000 7f12a152c640 1 --2- 172.21.15.2:0/1674579973 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55937d0eb370 0x55937d0e85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:06.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.190+0000 7f129bfff640 1 --2- 172.21.15.2:0/1674579973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55937d0e1b40 0x55937d0e7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:06.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.190+0000 7f12a0d2b640 1 -- 172.21.15.2:0/1674579973 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55937d0eb370 msgr2=0x55937d0e85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:06.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.190+0000 7f12a0d2b640 1 --2- 172.21.15.2:0/1674579973 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55937d0eb370 0x55937d0e85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:06.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.190+0000 7f12a0d2b640 1 -- 172.21.15.2:0/1674579973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55937d0e1b40 msgr2=0x55937d0e7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:06.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.190+0000 7f12a0d2b640 1 --2- 172.21.15.2:0/1674579973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55937d0e1b40 0x55937d0e7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:06.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.190+0000 7f12a0d2b640 1 -- 172.21.15.2:0/1674579973 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55937cdb73c0 con 0x55937d0e05d0 2024-09-19T06:19:06.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.191+0000 7f12a0d2b640 1 --2- 172.21.15.2:0/1674579973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55937d0e05d0 0x55937d0ead30 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f129009ba70 tx=0x7f129006b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1e83775c1853462 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:06.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.191+0000 7f127bfff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:19:06.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.191+0000 7f127bfff640 1 -- 172.21.15.2:0/1674579973 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129001d070 con 0x55937d0e05d0 2024-09-19T06:19:06.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.191+0000 7f127bfff640 1 -- 172.21.15.2:0/1674579973 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f12900cd460 con 0x55937d0e05d0 2024-09-19T06:19:06.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.191+0000 7f12a5368740 1 -- 172.21.15.2:0/1674579973 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1288017a70 con 0x55937d0e05d0 2024-09-19T06:19:06.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.191+0000 7f127bfff640 1 -- 172.21.15.2:0/1674579973 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f12900cd660 con 0x55937d0e05d0 2024-09-19T06:19:06.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.191+0000 7f12a5368740 10 client.16356 fetch_fsmap learned FSMap version 26 2024-09-19T06:19:06.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.191+0000 7f12a5368740 1 -- 172.21.15.2:0/1674579973 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55937d0f9ad0 con 0x55937d0e05d0 2024-09-19T06:19:06.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.191+0000 7f127bfff640 1 -- 172.21.15.2:0/1674579973 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1288017a70 con 0x55937d0e05d0 2024-09-19T06:19:06.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.191+0000 7f127bfff640 1 -- 172.21.15.2:0/1674579973 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f1290097b50 con 0x55937d0e05d0 2024-09-19T06:19:06.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.191+0000 7f12a5368740 10 client.16356 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:19:06.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.191+0000 7f12a5368740 10 client.16356 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:19:06.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.191+0000 7f12a5368740 20 client.16356 populate_metadata read hostname 'smithi002' 2024-09-19T06:19:06.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.191+0000 7f12a5368740 1 --2- 172.21.15.2:0/1674579973 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55937d0faf90 0x55937d0fd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:06.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.191+0000 7f12a5368740 4 client.16356 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:19:06.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.191+0000 7f12a5368740 1 -- 172.21.15.2:0/1674579973 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55937d053860 con 0x55937d0faf90 2024-09-19T06:19:06.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.192+0000 7f129bfff640 1 --2- 172.21.15.2:0/1674579973 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55937d0faf90 0x55937d0fd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:06.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.192+0000 7f129bfff640 1 --2- 172.21.15.2:0/1674579973 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55937d0faf90 0x55937d0fd400 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=722f3fe5af5ca635 server_cookie=dc215de7b4b64f5a in_seq=0 out_seq=0 2024-09-19T06:19:06.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.192+0000 7f127bfff640 10 client.16356 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:19:06.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.193+0000 7f127bfff640 1 -- 172.21.15.2:0/1674579973 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55937d053860 con 0x55937d0faf90 2024-09-19T06:19:06.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.193+0000 7f127bfff640 10 client.16356 handle_command_reply: tid=0 2024-09-19T06:19:06.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.193+0000 7f12a5368740 1 client.16356 shutdown 2024-09-19T06:19:06.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.193+0000 7f12a5368740 1 -- 172.21.15.2:0/1674579973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55937d0e05d0 msgr2=0x55937d0ead30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:06.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.193+0000 7f12a5368740 1 --2- 172.21.15.2:0/1674579973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55937d0e05d0 0x55937d0ead30 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f129009ba70 tx=0x7f129006b990 comp rx=0 tx=0).stop 2024-09-19T06:19:06.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.193+0000 7f12a5368740 1 -- 172.21.15.2:0/1674579973 shutdown_connections 2024-09-19T06:19:06.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.193+0000 7f12a5368740 1 --2- 172.21.15.2:0/1674579973 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55937d0faf90 0x55937d0fd400 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:06.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.193+0000 7f12a5368740 1 --2- 172.21.15.2:0/1674579973 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55937d0eb370 0x55937d0e85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:06.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.193+0000 7f127bfff640 0 client.16356 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:19:06.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.193+0000 7f12a5368740 1 --2- 172.21.15.2:0/1674579973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55937d0e1b40 0x55937d0e7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:06.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.193+0000 7f12a5368740 1 --2- 172.21.15.2:0/1674579973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55937d0e05d0 0x55937d0ead30 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:06.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.194+0000 7f12a5368740 1 -- 172.21.15.2:0/1674579973 >> 172.21.15.2:0/1674579973 conn(0x55937d0a9310 msgr2=0x55937d0e2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:06.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.194+0000 7f12a5368740 1 -- 172.21.15.2:0/1674579973 shutdown_connections 2024-09-19T06:19:06.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.194+0000 7f12a5368740 1 -- 172.21.15.2:0/1674579973 wait complete. 2024-09-19T06:19:06.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.194+0000 7f12a5368740 20 client.16356 trim_cache size 0 max 16384 2024-09-19T06:19:06.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.213+0000 7f12a5368740 1 Processor -- start 2024-09-19T06:19:06.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.213+0000 7f12a5368740 1 -- start start 2024-09-19T06:19:06.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.213+0000 7f12a5368740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55937d0e05d0 0x55937d0f7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:06.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.213+0000 7f12a5368740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55937d0e1b40 0x55937d0dbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:06.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.213+0000 7f12a5368740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55937d0eb370 0x55937d102cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:06.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.213+0000 7f12a5368740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f129c1b2250 con 0x55937d0e05d0 2024-09-19T06:19:06.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.213+0000 7f12a5368740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f129c1afb20 con 0x55937d0e1b40 2024-09-19T06:19:06.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.213+0000 7f12a5368740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f129c1ad970 con 0x55937d0eb370 2024-09-19T06:19:06.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.213+0000 7f12a0d2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55937d0e05d0 0x55937d0f7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:06.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.213+0000 7f12a0d2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55937d0e05d0 0x55937d0f7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50598/0 (socket says 172.21.15.2:50598) 2024-09-19T06:19:06.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.213+0000 7f12a0d2b640 1 -- 172.21.15.2:0/3711617331 learned_addr learned my addr 172.21.15.2:0/3711617331 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:06.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.213+0000 7f12a0d2b640 1 -- 172.21.15.2:0/3711617331 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55937d0eb370 msgr2=0x55937d102cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:06.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.213+0000 7f12a0d2b640 1 --2- 172.21.15.2:0/3711617331 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55937d0eb370 0x55937d102cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:06.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.213+0000 7f12a0d2b640 1 -- 172.21.15.2:0/3711617331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55937d0e1b40 msgr2=0x55937d0dbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:06.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.213+0000 7f129bfff640 1 --2- 172.21.15.2:0/3711617331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55937d0e1b40 0x55937d0dbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:06.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.213+0000 7f12a0d2b640 1 --2- 172.21.15.2:0/3711617331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55937d0e1b40 0x55937d0dbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:06.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.213+0000 7f12a0d2b640 1 -- 172.21.15.2:0/3711617331 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55937d0e6530 con 0x55937d0e05d0 2024-09-19T06:19:06.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.213+0000 7f129bfff640 1 --2- 172.21.15.2:0/3711617331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55937d0e1b40 0x55937d0dbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:19:06.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.213+0000 7f12a0d2b640 1 --2- 172.21.15.2:0/3711617331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55937d0e05d0 0x55937d0f7310 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f129009bd00 tx=0x7f129000a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8743fb5ee359bf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:06.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.214+0000 7f12867fc640 1 -- 172.21.15.2:0/3711617331 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12900a0120 con 0x55937d0e05d0 2024-09-19T06:19:06.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.214+0000 7f12867fc640 1 -- 172.21.15.2:0/3711617331 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1290066e50 con 0x55937d0e05d0 2024-09-19T06:19:06.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.214+0000 7f12867fc640 1 -- 172.21.15.2:0/3711617331 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12900a12b0 con 0x55937d0e05d0 2024-09-19T06:19:06.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.214+0000 7f12a5368740 1 -- 172.21.15.2:0/3711617331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55937d0e05d0 msgr2=0x55937d0f7310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:06.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.214+0000 7f12a5368740 1 --2- 172.21.15.2:0/3711617331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55937d0e05d0 0x55937d0f7310 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f129009bd00 tx=0x7f129000a410 comp rx=0 tx=0).stop 2024-09-19T06:19:06.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.214+0000 7f12a5368740 1 -- 172.21.15.2:0/3711617331 shutdown_connections 2024-09-19T06:19:06.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.214+0000 7f12a5368740 1 --2- 172.21.15.2:0/3711617331 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55937d0eb370 0x55937d102cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:06.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.214+0000 7f12a5368740 1 --2- 172.21.15.2:0/3711617331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55937d0e1b40 0x55937d0dbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:06.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.214+0000 7f12a5368740 1 --2- 172.21.15.2:0/3711617331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55937d0e05d0 0x55937d0f7310 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:06.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.214+0000 7f12a5368740 1 -- 172.21.15.2:0/3711617331 >> 172.21.15.2:0/3711617331 conn(0x55937d0a9310 msgr2=0x55937d0db4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:06.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.214+0000 7f12a5368740 1 -- 172.21.15.2:0/3711617331 shutdown_connections 2024-09-19T06:19:06.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.214+0000 7f12a5368740 1 -- 172.21.15.2:0/3711617331 wait complete. 2024-09-19T06:19:06.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.215+0000 7f12a5368740 1 -- start start 2024-09-19T06:19:06.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.215+0000 7f12a5368740 1 Processor -- start 2024-09-19T06:19:06.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.215+0000 7f12a5368740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55937d0e05d0 0x55937d0ef310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:06.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.215+0000 7f12a5368740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55937d0e1b40 0x55937d0ef850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:06.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.215+0000 7f12a5368740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55937d0eb370 0x55937d0efd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:06.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.215+0000 7f12a5368740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f129c1adfe0 con 0x55937d0e1b40 2024-09-19T06:19:06.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.215+0000 7f12a5368740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f129c1af450 con 0x55937d0eb370 2024-09-19T06:19:06.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.215+0000 7f12a5368740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f129c1ae6b0 con 0x55937d0e05d0 2024-09-19T06:19:06.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.215+0000 7f12a5368740 10 client.0 _ll_register_callbacks cb 0x7f129009b8b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:06.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.215+0000 7f129bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55937d0e1b40 0x55937d0ef850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:06.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.215+0000 7f129bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55937d0e1b40 0x55937d0ef850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50614/0 (socket says 172.21.15.2:50614) 2024-09-19T06:19:06.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.215+0000 7f129bfff640 1 -- 172.21.15.2:0/4124982067 learned_addr learned my addr 172.21.15.2:0/4124982067 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:06.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.216+0000 7f12a0d2b640 1 --2- 172.21.15.2:0/4124982067 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55937d0e05d0 0x55937d0ef310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:06.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.216+0000 7f12a152c640 1 --2- 172.21.15.2:0/4124982067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55937d0eb370 0x55937d0efd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:06.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.216+0000 7f129bfff640 1 -- 172.21.15.2:0/4124982067 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55937d0e05d0 msgr2=0x55937d0ef310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:06.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.216+0000 7f129bfff640 1 --2- 172.21.15.2:0/4124982067 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55937d0e05d0 0x55937d0ef310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:06.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.216+0000 7f129bfff640 1 -- 172.21.15.2:0/4124982067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55937d0eb370 msgr2=0x55937d0efd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:06.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.216+0000 7f129bfff640 1 --2- 172.21.15.2:0/4124982067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55937d0eb370 0x55937d0efd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:06.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.216+0000 7f129bfff640 1 -- 172.21.15.2:0/4124982067 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55937d164e00 con 0x55937d0e1b40 2024-09-19T06:19:06.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.216+0000 7f129bfff640 1 --2- 172.21.15.2:0/4124982067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55937d0e1b40 0x55937d0ef850 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f1288019040 tx=0x7f128800b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9c5f0975d57cda1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:06.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.216+0000 7f127bfff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:19:06.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.216+0000 7f127bfff640 1 -- 172.21.15.2:0/4124982067 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1288031060 con 0x55937d0e1b40 2024-09-19T06:19:06.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.216+0000 7f127bfff640 1 -- 172.21.15.2:0/4124982067 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f128800f830 con 0x55937d0e1b40 2024-09-19T06:19:06.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.216+0000 7f12a5368740 1 -- 172.21.15.2:0/4124982067 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1290066e50 con 0x55937d0e1b40 2024-09-19T06:19:06.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.216+0000 7f127bfff640 1 -- 172.21.15.2:0/4124982067 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f128800fa70 con 0x55937d0e1b40 2024-09-19T06:19:06.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.216+0000 7f12a5368740 10 client.16362 fetch_fsmap learned FSMap version 26 2024-09-19T06:19:06.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.216+0000 7f12a5368740 1 -- 172.21.15.2:0/4124982067 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55937d166010 con 0x55937d0e1b40 2024-09-19T06:19:06.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.217+0000 7f127bfff640 1 -- 172.21.15.2:0/4124982067 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1290066e50 con 0x55937d0e1b40 2024-09-19T06:19:06.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.217+0000 7f127bfff640 1 -- 172.21.15.2:0/4124982067 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f1288036c80 con 0x55937d0e1b40 2024-09-19T06:19:06.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.217+0000 7f12a5368740 10 client.16362 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:19:06.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.217+0000 7f12a5368740 10 client.16362 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:19:06.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.217+0000 7f12a5368740 20 client.16362 populate_metadata read hostname 'smithi002' 2024-09-19T06:19:06.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.217+0000 7f12a5368740 1 --2- 172.21.15.2:0/4124982067 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55937d0faf90 0x55937d168610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:06.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.217+0000 7f12a5368740 4 client.16362 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:19:06.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.217+0000 7f12a5368740 1 -- 172.21.15.2:0/4124982067 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55937d04dd70 con 0x55937d0faf90 2024-09-19T06:19:06.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.217+0000 7f12a0d2b640 1 --2- 172.21.15.2:0/4124982067 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55937d0faf90 0x55937d168610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:06.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.217+0000 7f12a0d2b640 1 --2- 172.21.15.2:0/4124982067 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55937d0faf90 0x55937d168610 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fd844f3e7ccfb9bf server_cookie=c6ba5797ccb334a0 in_seq=0 out_seq=0 2024-09-19T06:19:06.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.217+0000 7f127bfff640 10 client.16362 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:19:06.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.218+0000 7f127bfff640 1 -- 172.21.15.2:0/4124982067 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55937d04dd70 con 0x55937d0faf90 2024-09-19T06:19:06.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.218+0000 7f127bfff640 10 client.16362 handle_command_reply: tid=0 2024-09-19T06:19:06.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.218+0000 7f12a5368740 1 client.16362 shutdown 2024-09-19T06:19:06.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.218+0000 7f12a5368740 1 -- 172.21.15.2:0/4124982067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55937d0e1b40 msgr2=0x55937d0ef850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:06.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.218+0000 7f12a5368740 1 --2- 172.21.15.2:0/4124982067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55937d0e1b40 0x55937d0ef850 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f1288019040 tx=0x7f128800b9b0 comp rx=0 tx=0).stop 2024-09-19T06:19:06.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.218+0000 7f12a5368740 1 -- 172.21.15.2:0/4124982067 shutdown_connections 2024-09-19T06:19:06.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.218+0000 7f12a5368740 1 --2- 172.21.15.2:0/4124982067 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55937d0faf90 0x55937d168610 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:06.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.218+0000 7f12a5368740 1 --2- 172.21.15.2:0/4124982067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55937d0eb370 0x55937d0efd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:06.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.218+0000 7f12a5368740 1 --2- 172.21.15.2:0/4124982067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55937d0e1b40 0x55937d0ef850 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:06.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.218+0000 7f12a5368740 1 --2- 172.21.15.2:0/4124982067 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55937d0e05d0 0x55937d0ef310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:06.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.218+0000 7f12a5368740 1 -- 172.21.15.2:0/4124982067 >> 172.21.15.2:0/4124982067 conn(0x55937d0a9310 msgr2=0x55937d0e2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:06.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.218+0000 7f127bfff640 0 client.16362 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:19:06.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.218+0000 7f12a5368740 1 -- 172.21.15.2:0/4124982067 shutdown_connections 2024-09-19T06:19:06.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.218+0000 7f12a5368740 1 -- 172.21.15.2:0/4124982067 wait complete. 2024-09-19T06:19:06.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.218+0000 7f12a5368740 20 client.16362 trim_cache size 0 max 16384 2024-09-19T06:19:06.225 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:19:06.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.219+0000 7f12a2f8f640 1 -- 172.21.15.2:0/2878791688 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f128c0a33b0 msgr2=0x7f128c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:06.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.219+0000 7f12a2f8f640 1 --2- 172.21.15.2:0/2878791688 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f128c0a33b0 0x7f128c0a5870 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1294009ca0 tx=0x7f12940095c0 comp rx=0 tx=0).stop 2024-09-19T06:19:06.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.219+0000 7f12a2f8f640 1 -- 172.21.15.2:0/2878791688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f129c102d30 msgr2=0x7f129c19a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:06.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.219+0000 7f12a2f8f640 1 --2- 172.21.15.2:0/2878791688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f129c102d30 0x7f129c19a570 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f129000c890 tx=0x7f129000cd50 comp rx=0 tx=0).stop 2024-09-19T06:19:06.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.219+0000 7f12a2f8f640 1 -- 172.21.15.2:0/2878791688 shutdown_connections 2024-09-19T06:19:06.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.219+0000 7f12a2f8f640 1 --2- 172.21.15.2:0/2878791688 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f128c0a33b0 0x7f128c0a5870 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:06.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.219+0000 7f12a2f8f640 1 --2- 172.21.15.2:0/2878791688 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f129c10c160 0x7f129c19ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:06.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.219+0000 7f12a2f8f640 1 --2- 172.21.15.2:0/2878791688 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f129c103650 0x7f129c19aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:06.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.219+0000 7f12a2f8f640 1 --2- 172.21.15.2:0/2878791688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f129c102d30 0x7f129c19a570 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:06.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.219+0000 7f12a2f8f640 1 -- 172.21.15.2:0/2878791688 >> 172.21.15.2:0/2878791688 conn(0x7f129c0fc7d0 msgr2=0x7f129c101a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:06.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.219+0000 7f12a2f8f640 1 -- 172.21.15.2:0/2878791688 shutdown_connections 2024-09-19T06:19:06.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:06.219+0000 7f12a2f8f640 1 -- 172.21.15.2:0/2878791688 wait complete. 2024-09-19T06:19:06.858 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:19:07.117 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:19:07.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.628+0000 7fb404789640 1 -- 172.21.15.2:0/795521565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3fc106f10 msgr2=0x7fb3fc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:07.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.628+0000 7fb404789640 1 --2- 172.21.15.2:0/795521565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3fc106f10 0x7fb3fc10ea90 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4009ca0 tx=0x7fb3f402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:19:07.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.628+0000 7fb404789640 1 -- 172.21.15.2:0/795521565 shutdown_connections 2024-09-19T06:19:07.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.629+0000 7fb404789640 1 --2- 172.21.15.2:0/795521565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3fc106f10 0x7fb3fc10ea90 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:07.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.629+0000 7fb404789640 1 --2- 172.21.15.2:0/795521565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3fc102790 0x7fb3fc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:07.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.629+0000 7fb404789640 1 --2- 172.21.15.2:0/795521565 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3fc101de0 0x7fb3fc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:07.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.629+0000 7fb404789640 1 -- 172.21.15.2:0/795521565 >> 172.21.15.2:0/795521565 conn(0x7fb3fc0fd8c0 msgr2=0x7fb3fc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:07.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.629+0000 7fb404789640 1 -- 172.21.15.2:0/795521565 shutdown_connections 2024-09-19T06:19:07.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.629+0000 7fb404789640 1 -- 172.21.15.2:0/795521565 wait complete. 2024-09-19T06:19:07.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.629+0000 7fb404789640 1 Processor -- start 2024-09-19T06:19:07.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.629+0000 7fb404789640 1 -- start start 2024-09-19T06:19:07.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.629+0000 7fb404789640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3fc101de0 0x7fb3fc198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:07.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.629+0000 7fb404789640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3fc102790 0x7fb3fc198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:07.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.629+0000 7fb404789640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3fc106f10 0x7fb3fc19ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:07.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.629+0000 7fb404789640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb3fc111e40 con 0x7fb3fc102790 2024-09-19T06:19:07.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.629+0000 7fb404789640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb3fc111cc0 con 0x7fb3fc101de0 2024-09-19T06:19:07.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.629+0000 7fb404789640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb3fc111fc0 con 0x7fb3fc106f10 2024-09-19T06:19:07.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.629+0000 7fb401d24640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3fc102790 0x7fb3fc198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:07.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.630+0000 7fb401d24640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3fc102790 0x7fb3fc198940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50634/0 (socket says 172.21.15.2:50634) 2024-09-19T06:19:07.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.630+0000 7fb401d24640 1 -- 172.21.15.2:0/3986690779 learned_addr learned my addr 172.21.15.2:0/3986690779 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:07.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.630+0000 7fb402525640 1 --2- 172.21.15.2:0/3986690779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3fc101de0 0x7fb3fc198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:07.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.630+0000 7fb402d26640 1 --2- 172.21.15.2:0/3986690779 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3fc106f10 0x7fb3fc19ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:07.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.630+0000 7fb401d24640 1 -- 172.21.15.2:0/3986690779 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3fc106f10 msgr2=0x7fb3fc19ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:07.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.630+0000 7fb401d24640 1 --2- 172.21.15.2:0/3986690779 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3fc106f10 0x7fb3fc19ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:07.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.630+0000 7fb401d24640 1 -- 172.21.15.2:0/3986690779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3fc101de0 msgr2=0x7fb3fc198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:07.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.630+0000 7fb401d24640 1 --2- 172.21.15.2:0/3986690779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3fc101de0 0x7fb3fc198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:07.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.630+0000 7fb401d24640 1 -- 172.21.15.2:0/3986690779 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3fc19d3b0 con 0x7fb3fc102790 2024-09-19T06:19:07.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.630+0000 7fb401d24640 1 --2- 172.21.15.2:0/3986690779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3fc102790 0x7fb3fc198940 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec00b4a0 tx=0x7fb3ec00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:07.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.630+0000 7fb3f37fe640 1 -- 172.21.15.2:0/3986690779 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec014070 con 0x7fb3fc102790 2024-09-19T06:19:07.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.630+0000 7fb3f37fe640 1 -- 172.21.15.2:0/3986690779 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb3ec010ac0 con 0x7fb3fc102790 2024-09-19T06:19:07.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.630+0000 7fb404789640 1 -- 172.21.15.2:0/3986690779 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3fc19d6a0 con 0x7fb3fc102790 2024-09-19T06:19:07.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.630+0000 7fb3f37fe640 1 -- 172.21.15.2:0/3986690779 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec017c30 con 0x7fb3fc102790 2024-09-19T06:19:07.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.630+0000 7fb404789640 1 -- 172.21.15.2:0/3986690779 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3fc1a4f80 con 0x7fb3fc102790 2024-09-19T06:19:07.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.633+0000 7fb406b62740 1 Processor -- start 2024-09-19T06:19:07.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.633+0000 7fb3f37fe640 1 -- 172.21.15.2:0/3986690779 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fb3ec017070 con 0x7fb3fc102790 2024-09-19T06:19:07.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.633+0000 7fb406b62740 1 -- start start 2024-09-19T06:19:07.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.633+0000 7fb406b62740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d026cbeb40 0x55d026cbd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:07.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.633+0000 7fb406b62740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d026cbd5d0 0x55d026cbda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:07.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.633+0000 7fb406b62740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d026cc8370 0x55d026cca760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:07.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.633+0000 7fb406b62740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d026c232f0 con 0x55d026cbeb40 2024-09-19T06:19:07.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.633+0000 7fb406b62740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55d026bcacf0 con 0x55d026cc8370 2024-09-19T06:19:07.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.633+0000 7fb406b62740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55d026c1f2b0 con 0x55d026cbd5d0 2024-09-19T06:19:07.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.633+0000 7fb402d26640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d026cbeb40 0x55d026cbd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:07.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.634+0000 7fb402d26640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d026cbeb40 0x55d026cbd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50640/0 (socket says 172.21.15.2:50640) 2024-09-19T06:19:07.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.634+0000 7fb402d26640 1 -- 172.21.15.2:0/2300659337 learned_addr learned my addr 172.21.15.2:0/2300659337 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:07.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.634+0000 7fb402525640 1 --2- 172.21.15.2:0/2300659337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d026cbd5d0 0x55d026cbda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:07.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.634+0000 7fb401d24640 1 --2- 172.21.15.2:0/2300659337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d026cc8370 0x55d026cca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:07.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.634+0000 7fb3f37fe640 1 --2- 172.21.15.2:0/3986690779 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb3e80a33b0 0x7fb3e80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:07.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.634+0000 7fb402d26640 1 -- 172.21.15.2:0/2300659337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d026cbd5d0 msgr2=0x55d026cbda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:07.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.634+0000 7fb402d26640 1 --2- 172.21.15.2:0/2300659337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d026cbd5d0 0x55d026cbda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:07.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.634+0000 7fb402d26640 1 -- 172.21.15.2:0/2300659337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d026cc8370 msgr2=0x55d026cca760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:07.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.634+0000 7fb402d26640 1 --2- 172.21.15.2:0/2300659337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d026cc8370 0x55d026cca760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:07.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.634+0000 7fb402d26640 1 -- 172.21.15.2:0/2300659337 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d026baf3a0 con 0x55d026cbeb40 2024-09-19T06:19:07.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.634+0000 7fb401d24640 1 --2- 172.21.15.2:0/2300659337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d026cc8370 0x55d026cca760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:19:07.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.634+0000 7fb3f37fe640 1 -- 172.21.15.2:0/3986690779 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fb3ec0cf2b0 con 0x7fb3fc102790 2024-09-19T06:19:07.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.634+0000 7fb402d26640 1 --2- 172.21.15.2:0/3986690779 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb3e80a33b0 0x7fb3e80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:07.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.634+0000 7fb402d26640 1 --2- 172.21.15.2:0/2300659337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d026cbeb40 0x55d026cbd090 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4035000 tx=0x7fb3f4031af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd8e65f9e992bcd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:07.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.634+0000 7fb3f0ff9640 1 -- 172.21.15.2:0/2300659337 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f404d070 con 0x55d026cbeb40 2024-09-19T06:19:07.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.635+0000 7fb3f0ff9640 1 -- 172.21.15.2:0/2300659337 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb3f4036040 con 0x55d026cbeb40 2024-09-19T06:19:07.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.635+0000 7fb3f0ff9640 1 -- 172.21.15.2:0/2300659337 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f4030830 con 0x55d026cbeb40 2024-09-19T06:19:07.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.635+0000 7fb406b62740 1 -- 172.21.15.2:0/2300659337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d026cbeb40 msgr2=0x55d026cbd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:07.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.635+0000 7fb402d26640 1 --2- 172.21.15.2:0/3986690779 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb3e80a33b0 0x7fb3e80a5870 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb3f404a000 tx=0x7fb3f404b000 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:07.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.635+0000 7fb406b62740 1 --2- 172.21.15.2:0/2300659337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d026cbeb40 0x55d026cbd090 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4035000 tx=0x7fb3f4031af0 comp rx=0 tx=0).stop 2024-09-19T06:19:07.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.635+0000 7fb406b62740 1 -- 172.21.15.2:0/2300659337 shutdown_connections 2024-09-19T06:19:07.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.635+0000 7fb406b62740 1 --2- 172.21.15.2:0/2300659337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d026cc8370 0x55d026cca760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:07.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.635+0000 7fb406b62740 1 --2- 172.21.15.2:0/2300659337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d026cbd5d0 0x55d026cbda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:07.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.635+0000 7fb406b62740 1 --2- 172.21.15.2:0/2300659337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d026cbeb40 0x55d026cbd090 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:07.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.635+0000 7fb406b62740 1 -- 172.21.15.2:0/2300659337 >> 172.21.15.2:0/2300659337 conn(0x55d026c86310 msgr2=0x55d026cb9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:07.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.635+0000 7fb406b62740 1 -- 172.21.15.2:0/2300659337 shutdown_connections 2024-09-19T06:19:07.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.635+0000 7fb406b62740 1 -- 172.21.15.2:0/2300659337 wait complete. 2024-09-19T06:19:07.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.636+0000 7fb406b62740 1 -- start start 2024-09-19T06:19:07.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.636+0000 7fb406b62740 1 Processor -- start 2024-09-19T06:19:07.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.636+0000 7fb406b62740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d026cbd5d0 0x55d026cc7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:07.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.636+0000 7fb406b62740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d026cbeb40 0x55d026cc5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:07.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.636+0000 7fb406b62740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d026cc8370 0x55d026cc5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:07.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.636+0000 7fb406b62740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d026ccb070 con 0x55d026cc8370 2024-09-19T06:19:07.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.636+0000 7fb406b62740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55d026bde060 con 0x55d026cbeb40 2024-09-19T06:19:07.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.636+0000 7fb406b62740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55d026ccb1f0 con 0x55d026cbd5d0 2024-09-19T06:19:07.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.636+0000 7fb406b62740 10 client.0 _ll_register_callbacks cb 0x55d0269318c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:07.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.636+0000 7fb402d26640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d026cc8370 0x55d026cc5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:07.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.636+0000 7fb402525640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d026cbd5d0 0x55d026cc7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:07.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.636+0000 7fb402525640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d026cbd5d0 0x55d026cc7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:33822/0 (socket says 172.21.15.2:33822) 2024-09-19T06:19:07.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.636+0000 7fb402d26640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d026cc8370 0x55d026cc5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50654/0 (socket says 172.21.15.2:50654) 2024-09-19T06:19:07.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.636+0000 7fb402525640 1 -- 172.21.15.2:0/656398302 learned_addr learned my addr 172.21.15.2:0/656398302 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:07.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.636+0000 7fb401d24640 1 --2- 172.21.15.2:0/656398302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d026cbeb40 0x55d026cc5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:07.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.637+0000 7fb402525640 1 -- 172.21.15.2:0/656398302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d026cbeb40 msgr2=0x55d026cc5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:07.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.637+0000 7fb402525640 1 --2- 172.21.15.2:0/656398302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d026cbeb40 0x55d026cc5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:07.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.637+0000 7fb402525640 1 -- 172.21.15.2:0/656398302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d026cc8370 msgr2=0x55d026cc5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:07.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.637+0000 7fb402525640 1 --2- 172.21.15.2:0/656398302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d026cc8370 0x55d026cc5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:07.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.637+0000 7fb402525640 1 -- 172.21.15.2:0/656398302 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0269943c0 con 0x55d026cbd5d0 2024-09-19T06:19:07.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.637+0000 7fb402d26640 1 --2- 172.21.15.2:0/656398302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d026cc8370 0x55d026cc5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:07.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.637+0000 7fb402525640 1 --2- 172.21.15.2:0/656398302 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d026cbd5d0 0x55d026cc7d80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8004540 tx=0x7fb3f800bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43a98a2ad0b6fbc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:07.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.637+0000 7fb3e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-19T06:19:07.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.637+0000 7fb3e5ffb640 1 -- 172.21.15.2:0/656398302 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f8005220 con 0x55d026cbd5d0 2024-09-19T06:19:07.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.637+0000 7fb406b62740 1 -- 172.21.15.2:0/656398302 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3f4036040 con 0x55d026cbd5d0 2024-09-19T06:19:07.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.637+0000 7fb3e5ffb640 1 -- 172.21.15.2:0/656398302 <== mon.1 v2:172.21.15.90:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fb3f80053c0 con 0x55d026cbd5d0 2024-09-19T06:19:07.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.637+0000 7fb3e5ffb640 1 -- 172.21.15.2:0/656398302 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb3f8028050 con 0x55d026cbd5d0 2024-09-19T06:19:07.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.637+0000 7fb406b62740 10 client.25816 fetch_fsmap learned FSMap version 26 2024-09-19T06:19:07.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.637+0000 7fb406b62740 1 -- 172.21.15.2:0/656398302 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55d026cd6b60 con 0x55d026cbd5d0 2024-09-19T06:19:07.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.638+0000 7fb3e5ffb640 1 -- 172.21.15.2:0/656398302 <== mon.1 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb3f4036040 con 0x55d026cbd5d0 2024-09-19T06:19:07.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.638+0000 7fb3e5ffb640 1 -- 172.21.15.2:0/656398302 <== mon.1 v2:172.21.15.90:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fb3f8018660 con 0x55d026cbd5d0 2024-09-19T06:19:07.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.638+0000 7fb406b62740 10 client.25816 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:19:07.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.638+0000 7fb406b62740 10 client.25816 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:19:07.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.638+0000 7fb406b62740 20 client.25816 populate_metadata read hostname 'smithi002' 2024-09-19T06:19:07.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.638+0000 7fb406b62740 1 --2- 172.21.15.2:0/656398302 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55d026cd7f70 0x55d026cda3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:07.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.638+0000 7fb406b62740 4 client.25816 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:19:07.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.638+0000 7fb406b62740 1 -- 172.21.15.2:0/656398302 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d026c30860 con 0x55d026cd7f70 2024-09-19T06:19:07.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.638+0000 7fb401d24640 1 --2- 172.21.15.2:0/656398302 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55d026cd7f70 0x55d026cda3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:07.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.639+0000 7fb401d24640 1 --2- 172.21.15.2:0/656398302 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55d026cd7f70 0x55d026cda3a0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b47a2870ae040855 server_cookie=c21d3a2e113bb2e6 in_seq=0 out_seq=0 2024-09-19T06:19:07.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.639+0000 7fb3e5ffb640 10 client.25816 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:19:07.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.639+0000 7fb3e5ffb640 1 -- 172.21.15.2:0/656398302 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d026c30860 con 0x55d026cd7f70 2024-09-19T06:19:07.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.639+0000 7fb3e5ffb640 10 client.25816 handle_command_reply: tid=0 2024-09-19T06:19:07.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.639+0000 7fb406b62740 1 client.25816 shutdown 2024-09-19T06:19:07.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.640+0000 7fb406b62740 1 -- 172.21.15.2:0/656398302 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d026cbd5d0 msgr2=0x55d026cc7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:07.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.640+0000 7fb406b62740 1 --2- 172.21.15.2:0/656398302 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d026cbd5d0 0x55d026cc7d80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8004540 tx=0x7fb3f800bea0 comp rx=0 tx=0).stop 2024-09-19T06:19:07.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.640+0000 7fb406b62740 1 -- 172.21.15.2:0/656398302 shutdown_connections 2024-09-19T06:19:07.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.640+0000 7fb406b62740 1 --2- 172.21.15.2:0/656398302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d026cc8370 0x55d026cc5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:07.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.640+0000 7fb406b62740 1 --2- 172.21.15.2:0/656398302 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55d026cd7f70 0x55d026cda3a0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:07.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.640+0000 7fb406b62740 1 --2- 172.21.15.2:0/656398302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d026cbeb40 0x55d026cc5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:07.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.640+0000 7fb3e5ffb640 0 client.25816 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:19:07.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.640+0000 7fb406b62740 1 --2- 172.21.15.2:0/656398302 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d026cbd5d0 0x55d026cc7d80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:07.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.640+0000 7fb406b62740 1 -- 172.21.15.2:0/656398302 >> 172.21.15.2:0/656398302 conn(0x55d026c86310 msgr2=0x55d026cbf960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:07.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.640+0000 7fb406b62740 1 -- 172.21.15.2:0/656398302 shutdown_connections 2024-09-19T06:19:07.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.640+0000 7fb406b62740 1 -- 172.21.15.2:0/656398302 wait complete. 2024-09-19T06:19:07.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.640+0000 7fb406b62740 20 client.25816 trim_cache size 0 max 16384 2024-09-19T06:19:07.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.653+0000 7fb406b62740 1 Processor -- start 2024-09-19T06:19:07.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.653+0000 7fb406b62740 1 -- start start 2024-09-19T06:19:07.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.653+0000 7fb406b62740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d026cbd5d0 0x55d026cb8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:07.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.653+0000 7fb406b62740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d026cbeb40 0x55d026cb9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:07.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.653+0000 7fb406b62740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d026cc8370 0x55d026cc0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:07.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.653+0000 7fb406b62740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb3fc1adee0 con 0x55d026cbd5d0 2024-09-19T06:19:07.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.653+0000 7fb406b62740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb3fc1ab7b0 con 0x55d026cc8370 2024-09-19T06:19:07.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.653+0000 7fb406b62740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb3fc1a9600 con 0x55d026cbeb40 2024-09-19T06:19:07.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.653+0000 7fb402525640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d026cbd5d0 0x55d026cb8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:07.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.653+0000 7fb402525640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d026cbd5d0 0x55d026cb8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50658/0 (socket says 172.21.15.2:50658) 2024-09-19T06:19:07.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.653+0000 7fb402525640 1 -- 172.21.15.2:0/4112279801 learned_addr learned my addr 172.21.15.2:0/4112279801 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:07.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.654+0000 7fb402525640 1 -- 172.21.15.2:0/4112279801 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d026cbeb40 msgr2=0x55d026cb9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:07.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.654+0000 7fb402525640 1 --2- 172.21.15.2:0/4112279801 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d026cbeb40 0x55d026cb9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:07.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.654+0000 7fb402525640 1 -- 172.21.15.2:0/4112279801 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d026cc8370 msgr2=0x55d026cc0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:07.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.654+0000 7fb402525640 1 --2- 172.21.15.2:0/4112279801 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d026cc8370 0x55d026cc0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:07.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.654+0000 7fb402525640 1 -- 172.21.15.2:0/4112279801 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d026cbd2d0 con 0x55d026cbd5d0 2024-09-19T06:19:07.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.654+0000 7fb402525640 1 --2- 172.21.15.2:0/4112279801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d026cbd5d0 0x55d026cb8bf0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8003fe0 tx=0x7fb3f8004460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d02411f2a20557 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:07.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.654+0000 7fb3e7fff640 1 -- 172.21.15.2:0/4112279801 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f80184d0 con 0x55d026cbd5d0 2024-09-19T06:19:07.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.654+0000 7fb3e7fff640 1 -- 172.21.15.2:0/4112279801 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb3f801c030 con 0x55d026cbd5d0 2024-09-19T06:19:07.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.654+0000 7fb3e7fff640 1 -- 172.21.15.2:0/4112279801 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f8004890 con 0x55d026cbd5d0 2024-09-19T06:19:07.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.654+0000 7fb406b62740 1 -- 172.21.15.2:0/4112279801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d026cbd5d0 msgr2=0x55d026cb8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:07.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.654+0000 7fb406b62740 1 --2- 172.21.15.2:0/4112279801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d026cbd5d0 0x55d026cb8bf0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8003fe0 tx=0x7fb3f8004460 comp rx=0 tx=0).stop 2024-09-19T06:19:07.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.655+0000 7fb406b62740 1 -- 172.21.15.2:0/4112279801 shutdown_connections 2024-09-19T06:19:07.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.655+0000 7fb406b62740 1 --2- 172.21.15.2:0/4112279801 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d026cc8370 0x55d026cc0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:07.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.655+0000 7fb406b62740 1 --2- 172.21.15.2:0/4112279801 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d026cbeb40 0x55d026cb9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:07.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.655+0000 7fb406b62740 1 --2- 172.21.15.2:0/4112279801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d026cbd5d0 0x55d026cb8bf0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:07.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.655+0000 7fb406b62740 1 -- 172.21.15.2:0/4112279801 >> 172.21.15.2:0/4112279801 conn(0x55d026c86310 msgr2=0x55d026cb84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:07.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.655+0000 7fb406b62740 1 -- 172.21.15.2:0/4112279801 shutdown_connections 2024-09-19T06:19:07.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.655+0000 7fb406b62740 1 -- 172.21.15.2:0/4112279801 wait complete. 2024-09-19T06:19:07.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.655+0000 7fb406b62740 1 -- start start 2024-09-19T06:19:07.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.655+0000 7fb406b62740 1 Processor -- start 2024-09-19T06:19:07.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.655+0000 7fb406b62740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d026cbd5d0 0x55d026cc1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:07.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.655+0000 7fb406b62740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d026cbeb40 0x55d026cc2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:07.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.655+0000 7fb406b62740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d026cc8370 0x55d026cc2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:07.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.655+0000 7fb406b62740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb3fc1a9c70 con 0x55d026cbd5d0 2024-09-19T06:19:07.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.655+0000 7fb406b62740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb3fc1ab0e0 con 0x55d026cc8370 2024-09-19T06:19:07.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.655+0000 7fb406b62740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb3fc1aa340 con 0x55d026cbeb40 2024-09-19T06:19:07.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.655+0000 7fb406b62740 10 client.0 _ll_register_callbacks cb 0x7fb3f8004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:07.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.655+0000 7fb402525640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d026cbd5d0 0x55d026cc1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:07.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.655+0000 7fb402525640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d026cbd5d0 0x55d026cc1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50662/0 (socket says 172.21.15.2:50662) 2024-09-19T06:19:07.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.655+0000 7fb402525640 1 -- 172.21.15.2:0/1983132993 learned_addr learned my addr 172.21.15.2:0/1983132993 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:07.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.656+0000 7fb401d24640 1 --2- 172.21.15.2:0/1983132993 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d026cbeb40 0x55d026cc2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:07.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.656+0000 7fb402d26640 1 --2- 172.21.15.2:0/1983132993 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d026cc8370 0x55d026cc2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:07.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.656+0000 7fb402525640 1 -- 172.21.15.2:0/1983132993 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d026cbeb40 msgr2=0x55d026cc2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:07.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.656+0000 7fb402525640 1 --2- 172.21.15.2:0/1983132993 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d026cbeb40 0x55d026cc2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:07.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.656+0000 7fb402525640 1 -- 172.21.15.2:0/1983132993 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d026cc8370 msgr2=0x55d026cc2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:07.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.656+0000 7fb402525640 1 --2- 172.21.15.2:0/1983132993 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d026cc8370 0x55d026cc2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:07.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.656+0000 7fb402525640 1 -- 172.21.15.2:0/1983132993 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d026cc5fd0 con 0x55d026cbd5d0 2024-09-19T06:19:07.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.656+0000 7fb402525640 1 --2- 172.21.15.2:0/1983132993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d026cbd5d0 0x55d026cc1fc0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fb3f800b520 tx=0x7fb3f8005550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaad1a126a64c3c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:07.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.656+0000 7fb3e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:19:07.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.656+0000 7fb3e5ffb640 1 -- 172.21.15.2:0/1983132993 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f80184d0 con 0x55d026cbd5d0 2024-09-19T06:19:07.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.656+0000 7fb406b62740 1 -- 172.21.15.2:0/1983132993 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3f801c030 con 0x55d026cbd5d0 2024-09-19T06:19:07.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.656+0000 7fb3e5ffb640 1 -- 172.21.15.2:0/1983132993 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fb3f8018670 con 0x55d026cbd5d0 2024-09-19T06:19:07.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.656+0000 7fb3e5ffb640 1 -- 172.21.15.2:0/1983132993 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb3f8045050 con 0x55d026cbd5d0 2024-09-19T06:19:07.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.656+0000 7fb406b62740 10 client.16380 fetch_fsmap learned FSMap version 26 2024-09-19T06:19:07.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.656+0000 7fb406b62740 1 -- 172.21.15.2:0/1983132993 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55d026d42cb0 con 0x55d026cbd5d0 2024-09-19T06:19:07.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.657+0000 7fb3e5ffb640 1 -- 172.21.15.2:0/1983132993 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb3f801c030 con 0x55d026cbd5d0 2024-09-19T06:19:07.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.657+0000 7fb3e5ffb640 1 -- 172.21.15.2:0/1983132993 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fb3f80414b0 con 0x55d026cbd5d0 2024-09-19T06:19:07.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.657+0000 7fb406b62740 10 client.16380 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:19:07.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.657+0000 7fb406b62740 10 client.16380 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:19:07.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.657+0000 7fb406b62740 20 client.16380 populate_metadata read hostname 'smithi002' 2024-09-19T06:19:07.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.657+0000 7fb406b62740 1 --2- 172.21.15.2:0/1983132993 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55d026d43360 0x55d026d45780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:07.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.657+0000 7fb406b62740 4 client.16380 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:19:07.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.657+0000 7fb406b62740 1 -- 172.21.15.2:0/1983132993 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d026c2ad70 con 0x55d026d43360 2024-09-19T06:19:07.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.657+0000 7fb401d24640 1 --2- 172.21.15.2:0/1983132993 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55d026d43360 0x55d026d45780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:07.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.657+0000 7fb3e5ffb640 10 client.16380 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:19:07.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.657+0000 7fb401d24640 1 --2- 172.21.15.2:0/1983132993 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55d026d43360 0x55d026d45780 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e223310b604d67a server_cookie=7b0210c81d3139e1 in_seq=0 out_seq=0 2024-09-19T06:19:07.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.658+0000 7fb3e5ffb640 1 -- 172.21.15.2:0/1983132993 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d026c2ad70 con 0x55d026d43360 2024-09-19T06:19:07.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.658+0000 7fb3e5ffb640 10 client.16380 handle_command_reply: tid=0 2024-09-19T06:19:07.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.658+0000 7fb406b62740 1 client.16380 shutdown 2024-09-19T06:19:07.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.658+0000 7fb406b62740 1 -- 172.21.15.2:0/1983132993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d026cbd5d0 msgr2=0x55d026cc1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:07.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.658+0000 7fb406b62740 1 --2- 172.21.15.2:0/1983132993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d026cbd5d0 0x55d026cc1fc0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fb3f800b520 tx=0x7fb3f8005550 comp rx=0 tx=0).stop 2024-09-19T06:19:07.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.658+0000 7fb406b62740 1 -- 172.21.15.2:0/1983132993 shutdown_connections 2024-09-19T06:19:07.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.658+0000 7fb406b62740 1 --2- 172.21.15.2:0/1983132993 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55d026d43360 0x55d026d45780 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:07.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.658+0000 7fb406b62740 1 --2- 172.21.15.2:0/1983132993 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d026cc8370 0x55d026cc2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:07.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.658+0000 7fb406b62740 1 --2- 172.21.15.2:0/1983132993 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d026cbeb40 0x55d026cc2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:07.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.658+0000 7fb406b62740 1 --2- 172.21.15.2:0/1983132993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d026cbd5d0 0x55d026cc1fc0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:07.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.658+0000 7fb406b62740 1 -- 172.21.15.2:0/1983132993 >> 172.21.15.2:0/1983132993 conn(0x55d026c86310 msgr2=0x55d026cb8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:07.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.658+0000 7fb3e5ffb640 0 client.16380 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:19:07.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.658+0000 7fb406b62740 1 -- 172.21.15.2:0/1983132993 shutdown_connections 2024-09-19T06:19:07.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.658+0000 7fb406b62740 1 -- 172.21.15.2:0/1983132993 wait complete. 2024-09-19T06:19:07.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.658+0000 7fb406b62740 20 client.16380 trim_cache size 0 max 16384 2024-09-19T06:19:07.665 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:19:07.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.658+0000 7fb404789640 1 -- 172.21.15.2:0/3986690779 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb3e80a33b0 msgr2=0x7fb3e80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:07.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.658+0000 7fb404789640 1 --2- 172.21.15.2:0/3986690779 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb3e80a33b0 0x7fb3e80a5870 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb3f404a000 tx=0x7fb3f404b000 comp rx=0 tx=0).stop 2024-09-19T06:19:07.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.659+0000 7fb404789640 1 -- 172.21.15.2:0/3986690779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3fc102790 msgr2=0x7fb3fc198940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:07.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.659+0000 7fb404789640 1 --2- 172.21.15.2:0/3986690779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3fc102790 0x7fb3fc198940 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec00b4a0 tx=0x7fb3ec00b960 comp rx=0 tx=0).stop 2024-09-19T06:19:07.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.659+0000 7fb404789640 1 -- 172.21.15.2:0/3986690779 shutdown_connections 2024-09-19T06:19:07.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.659+0000 7fb404789640 1 --2- 172.21.15.2:0/3986690779 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb3e80a33b0 0x7fb3e80a5870 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:07.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.659+0000 7fb404789640 1 --2- 172.21.15.2:0/3986690779 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3fc106f10 0x7fb3fc19ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:07.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.659+0000 7fb404789640 1 --2- 172.21.15.2:0/3986690779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3fc102790 0x7fb3fc198940 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:07.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.659+0000 7fb404789640 1 --2- 172.21.15.2:0/3986690779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3fc101de0 0x7fb3fc198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:07.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.659+0000 7fb404789640 1 -- 172.21.15.2:0/3986690779 >> 172.21.15.2:0/3986690779 conn(0x7fb3fc0fd8c0 msgr2=0x7fb3fc0fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:07.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.659+0000 7fb404789640 1 -- 172.21.15.2:0/3986690779 shutdown_connections 2024-09-19T06:19:07.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:07.659+0000 7fb404789640 1 -- 172.21.15.2:0/3986690779 wait complete. 2024-09-19T06:19:07.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:07 smithi089 ceph-mon[34160]: pgmap v132: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T06:19:07.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:07 smithi002 ceph-mon[30982]: pgmap v132: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T06:19:07.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:07 smithi090 ceph-mon[34497]: pgmap v132: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T06:19:09.503 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:19:09.504 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:19:09.776 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:19:09.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:09 smithi089 ceph-mon[34160]: pgmap v133: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T06:19:09.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:09 smithi002 ceph-mon[30982]: pgmap v133: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T06:19:09.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:09 smithi090 ceph-mon[34497]: pgmap v133: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T06:19:10.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.205+0000 7fb78fb99640 1 -- 172.21.15.2:0/1002364717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7881082e0 msgr2=0x7fb78810ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:10.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.205+0000 7fb78fb99640 1 --2- 172.21.15.2:0/1002364717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7881082e0 0x7fb78810ec50 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fb780009930 tx=0x7fb78002a420 comp rx=0 tx=0).stop 2024-09-19T06:19:10.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.205+0000 7fb78fb99640 1 -- 172.21.15.2:0/1002364717 shutdown_connections 2024-09-19T06:19:10.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.205+0000 7fb78fb99640 1 --2- 172.21.15.2:0/1002364717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7881082e0 0x7fb78810ec50 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:10.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.205+0000 7fb78fb99640 1 --2- 172.21.15.2:0/1002364717 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb788103760 0x7fb788107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:10.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.205+0000 7fb78fb99640 1 --2- 172.21.15.2:0/1002364717 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb788102db0 0x7fb788103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:10.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.205+0000 7fb78fb99640 1 -- 172.21.15.2:0/1002364717 >> 172.21.15.2:0/1002364717 conn(0x7fb7880fc7d0 msgr2=0x7fb7880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:10.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.205+0000 7fb78fb99640 1 -- 172.21.15.2:0/1002364717 shutdown_connections 2024-09-19T06:19:10.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.205+0000 7fb78fb99640 1 -- 172.21.15.2:0/1002364717 wait complete. 2024-09-19T06:19:10.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.205+0000 7fb78fb99640 1 Processor -- start 2024-09-19T06:19:10.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.206+0000 7fb78fb99640 1 -- start start 2024-09-19T06:19:10.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.206+0000 7fb78fb99640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb788102db0 0x7fb788198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:10.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.206+0000 7fb78fb99640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb788103760 0x7fb788198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:10.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.206+0000 7fb78fb99640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7881082e0 0x7fb78819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:10.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.206+0000 7fb78fb99640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb788111f60 con 0x7fb788102db0 2024-09-19T06:19:10.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.206+0000 7fb78fb99640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb788111de0 con 0x7fb7881082e0 2024-09-19T06:19:10.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.206+0000 7fb78fb99640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb7881120e0 con 0x7fb788103760 2024-09-19T06:19:10.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.206+0000 7fb78d935640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb788102db0 0x7fb788198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:10.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.206+0000 7fb78d935640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb788102db0 0x7fb788198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50682/0 (socket says 172.21.15.2:50682) 2024-09-19T06:19:10.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.206+0000 7fb78d935640 1 -- 172.21.15.2:0/3032432382 learned_addr learned my addr 172.21.15.2:0/3032432382 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:10.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.206+0000 7fb78d134640 1 --2- 172.21.15.2:0/3032432382 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb788103760 0x7fb788198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:10.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.206+0000 7fb78e136640 1 --2- 172.21.15.2:0/3032432382 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7881082e0 0x7fb78819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:10.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.206+0000 7fb78d935640 1 -- 172.21.15.2:0/3032432382 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb788103760 msgr2=0x7fb788198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:10.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.206+0000 7fb78d935640 1 --2- 172.21.15.2:0/3032432382 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb788103760 0x7fb788198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:10.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.206+0000 7fb78d935640 1 -- 172.21.15.2:0/3032432382 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7881082e0 msgr2=0x7fb78819cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:10.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.206+0000 7fb78d935640 1 --2- 172.21.15.2:0/3032432382 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7881082e0 0x7fb78819cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:10.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.206+0000 7fb78d935640 1 -- 172.21.15.2:0/3032432382 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb78819d3f0 con 0x7fb788102db0 2024-09-19T06:19:10.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.207+0000 7fb78d935640 1 --2- 172.21.15.2:0/3032432382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb788102db0 0x7fb788198440 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb77800eab0 tx=0x7fb77800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:10.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.207+0000 7fb786ffd640 1 -- 172.21.15.2:0/3032432382 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77800cd80 con 0x7fb788102db0 2024-09-19T06:19:10.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.207+0000 7fb78fb99640 1 -- 172.21.15.2:0/3032432382 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb78819d6e0 con 0x7fb788102db0 2024-09-19T06:19:10.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.207+0000 7fb786ffd640 1 -- 172.21.15.2:0/3032432382 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb778011920 con 0x7fb788102db0 2024-09-19T06:19:10.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.207+0000 7fb786ffd640 1 -- 172.21.15.2:0/3032432382 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb778010940 con 0x7fb788102db0 2024-09-19T06:19:10.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.207+0000 7fb78fb99640 1 -- 172.21.15.2:0/3032432382 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7881a4fc0 con 0x7fb788102db0 2024-09-19T06:19:10.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.209+0000 7fb786ffd640 1 -- 172.21.15.2:0/3032432382 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fb778011ad0 con 0x7fb788102db0 2024-09-19T06:19:10.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.209+0000 7fb791f72740 1 Processor -- start 2024-09-19T06:19:10.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.210+0000 7fb791f72740 1 -- start start 2024-09-19T06:19:10.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.210+0000 7fb791f72740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fd973f1b60 0x55fd973f1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:10.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.210+0000 7fb791f72740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd973f2480 0x55fd973fc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:10.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.210+0000 7fb791f72740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd973fcd40 0x55fd973ff130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:10.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.210+0000 7fb791f72740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fd97357280 con 0x55fd973fcd40 2024-09-19T06:19:10.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.210+0000 7fb791f72740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55fd972feb10 con 0x55fd973f2480 2024-09-19T06:19:10.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.210+0000 7fb791f72740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55fd97353240 con 0x55fd973f1b60 2024-09-19T06:19:10.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.210+0000 7fb78d134640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd973fcd40 0x55fd973ff130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:10.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.210+0000 7fb78d134640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd973fcd40 0x55fd973ff130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50686/0 (socket says 172.21.15.2:50686) 2024-09-19T06:19:10.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.210+0000 7fb78d134640 1 -- 172.21.15.2:0/423792622 learned_addr learned my addr 172.21.15.2:0/423792622 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:10.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.210+0000 7fb78e136640 1 --2- 172.21.15.2:0/423792622 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fd973f1b60 0x55fd973f1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:10.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.210+0000 7fb786ffd640 1 --2- 172.21.15.2:0/3032432382 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb7700a33b0 0x7fb7700a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:10.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.210+0000 7fb78d935640 1 --2- 172.21.15.2:0/423792622 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd973f2480 0x55fd973fc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:10.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.210+0000 7fb78e136640 1 --2- 172.21.15.2:0/3032432382 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb7700a33b0 0x7fb7700a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:10.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.211+0000 7fb78d134640 1 -- 172.21.15.2:0/423792622 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fd973f1b60 msgr2=0x55fd973f1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:10.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.211+0000 7fb78d134640 1 --2- 172.21.15.2:0/423792622 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fd973f1b60 0x55fd973f1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:10.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.211+0000 7fb78d134640 1 -- 172.21.15.2:0/423792622 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd973f2480 msgr2=0x55fd973fc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:10.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.211+0000 7fb78d134640 1 --2- 172.21.15.2:0/423792622 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd973f2480 0x55fd973fc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:10.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.211+0000 7fb78d134640 1 -- 172.21.15.2:0/423792622 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd9730b1f0 con 0x55fd973fcd40 2024-09-19T06:19:10.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.211+0000 7fb786ffd640 1 -- 172.21.15.2:0/3032432382 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fb7780d02c0 con 0x7fb788102db0 2024-09-19T06:19:10.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.211+0000 7fb78e136640 1 --2- 172.21.15.2:0/3032432382 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb7700a33b0 0x7fb7700a5870 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb780006010 tx=0x7fb78002a420 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:10.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.211+0000 7fb78d134640 1 --2- 172.21.15.2:0/423792622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd973fcd40 0x55fd973ff130 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb77c00abb0 tx=0x7fb77c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd9ff727abb9b943 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:10.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.211+0000 7fb76ffff640 1 -- 172.21.15.2:0/423792622 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77c01d070 con 0x55fd973fcd40 2024-09-19T06:19:10.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.212+0000 7fb76ffff640 1 -- 172.21.15.2:0/423792622 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb77c018af0 con 0x55fd973fcd40 2024-09-19T06:19:10.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.212+0000 7fb76ffff640 1 -- 172.21.15.2:0/423792622 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77c010a10 con 0x55fd973fcd40 2024-09-19T06:19:10.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.212+0000 7fb791f72740 1 -- 172.21.15.2:0/423792622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd973fcd40 msgr2=0x55fd973ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:10.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.212+0000 7fb791f72740 1 --2- 172.21.15.2:0/423792622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd973fcd40 0x55fd973ff130 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb77c00abb0 tx=0x7fb77c00f790 comp rx=0 tx=0).stop 2024-09-19T06:19:10.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.213+0000 7fb791f72740 1 -- 172.21.15.2:0/423792622 shutdown_connections 2024-09-19T06:19:10.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.213+0000 7fb791f72740 1 --2- 172.21.15.2:0/423792622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd973fcd40 0x55fd973ff130 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:10.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.213+0000 7fb791f72740 1 --2- 172.21.15.2:0/423792622 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd973f2480 0x55fd973fc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:10.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.213+0000 7fb791f72740 1 --2- 172.21.15.2:0/423792622 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fd973f1b60 0x55fd973f1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:10.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.213+0000 7fb791f72740 1 -- 172.21.15.2:0/423792622 >> 172.21.15.2:0/423792622 conn(0x55fd973ee0f0 msgr2=0x55fd973ee4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:10.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.213+0000 7fb791f72740 1 -- 172.21.15.2:0/423792622 shutdown_connections 2024-09-19T06:19:10.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.213+0000 7fb791f72740 1 -- 172.21.15.2:0/423792622 wait complete. 2024-09-19T06:19:10.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.213+0000 7fb791f72740 1 -- start start 2024-09-19T06:19:10.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.213+0000 7fb791f72740 1 Processor -- start 2024-09-19T06:19:10.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.214+0000 7fb791f72740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd973f1b60 0x55fd973f9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:10.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.214+0000 7fb791f72740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fd973f2480 0x55fd973fa190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:10.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.214+0000 7fb791f72740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd973fcd40 0x55fd973fa6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:10.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.214+0000 7fb791f72740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fd973ff910 con 0x55fd973f1b60 2024-09-19T06:19:10.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.214+0000 7fb791f72740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55fd97311f10 con 0x55fd973fcd40 2024-09-19T06:19:10.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.214+0000 7fb791f72740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55fd973ffa90 con 0x55fd973f2480 2024-09-19T06:19:10.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.214+0000 7fb791f72740 10 client.0 _ll_register_callbacks cb 0x55fd972daa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:10.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.214+0000 7fb78d935640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd973f1b60 0x55fd973f9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:10.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.214+0000 7fb78d935640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd973f1b60 0x55fd973f9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50696/0 (socket says 172.21.15.2:50696) 2024-09-19T06:19:10.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.214+0000 7fb78d935640 1 -- 172.21.15.2:0/2007000870 learned_addr learned my addr 172.21.15.2:0/2007000870 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:10.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.214+0000 7fb78d134640 1 --2- 172.21.15.2:0/2007000870 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fd973f2480 0x55fd973fa190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:10.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.214+0000 7fb78e136640 1 --2- 172.21.15.2:0/2007000870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd973fcd40 0x55fd973fa6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:10.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.214+0000 7fb78d935640 1 -- 172.21.15.2:0/2007000870 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fd973f2480 msgr2=0x55fd973fa190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:10.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.214+0000 7fb78d935640 1 --2- 172.21.15.2:0/2007000870 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fd973f2480 0x55fd973fa190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:10.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.214+0000 7fb78d935640 1 -- 172.21.15.2:0/2007000870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd973fcd40 msgr2=0x55fd973fa6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:10.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.214+0000 7fb78d935640 1 --2- 172.21.15.2:0/2007000870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd973fcd40 0x55fd973fa6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:10.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.214+0000 7fb78d935640 1 -- 172.21.15.2:0/2007000870 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd970c86a0 con 0x55fd973f1b60 2024-09-19T06:19:10.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.214+0000 7fb78d134640 1 --2- 172.21.15.2:0/2007000870 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fd973f2480 0x55fd973fa190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:10.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.214+0000 7fb78e136640 1 --2- 172.21.15.2:0/2007000870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd973fcd40 0x55fd973fa6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:19:10.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.214+0000 7fb78d935640 1 --2- 172.21.15.2:0/2007000870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd973f1b60 0x55fd973f9c50 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb77800ea80 tx=0x7fb7780094a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b293a34f2b5566d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:10.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.214+0000 7fb76d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:19:10.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.215+0000 7fb76d7fa640 1 -- 172.21.15.2:0/2007000870 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7780cde70 con 0x55fd973f1b60 2024-09-19T06:19:10.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.215+0000 7fb76d7fa640 1 -- 172.21.15.2:0/2007000870 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fb7780a4f50 con 0x55fd973f1b60 2024-09-19T06:19:10.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.215+0000 7fb791f72740 1 -- 172.21.15.2:0/2007000870 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb77c018af0 con 0x55fd973f1b60 2024-09-19T06:19:10.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.215+0000 7fb76d7fa640 1 -- 172.21.15.2:0/2007000870 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb7780a0920 con 0x55fd973f1b60 2024-09-19T06:19:10.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.215+0000 7fb791f72740 10 client.16392 fetch_fsmap learned FSMap version 26 2024-09-19T06:19:10.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.215+0000 7fb791f72740 1 -- 172.21.15.2:0/2007000870 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55fd9740b5a0 con 0x55fd973f1b60 2024-09-19T06:19:10.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.215+0000 7fb76d7fa640 1 -- 172.21.15.2:0/2007000870 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb77c018af0 con 0x55fd973f1b60 2024-09-19T06:19:10.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.215+0000 7fb76d7fa640 1 -- 172.21.15.2:0/2007000870 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fb77800f040 con 0x55fd973f1b60 2024-09-19T06:19:10.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.215+0000 7fb791f72740 10 client.16392 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:19:10.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.215+0000 7fb791f72740 10 client.16392 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:19:10.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.215+0000 7fb791f72740 20 client.16392 populate_metadata read hostname 'smithi002' 2024-09-19T06:19:10.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.215+0000 7fb791f72740 1 --2- 172.21.15.2:0/2007000870 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55fd9740c9b0 0x55fd9740ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:10.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.215+0000 7fb791f72740 4 client.16392 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:19:10.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.215+0000 7fb791f72740 1 -- 172.21.15.2:0/2007000870 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd973647f0 con 0x55fd9740c9b0 2024-09-19T06:19:10.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.216+0000 7fb78d134640 1 --2- 172.21.15.2:0/2007000870 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55fd9740c9b0 0x55fd9740ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:10.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.216+0000 7fb78d134640 1 --2- 172.21.15.2:0/2007000870 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55fd9740c9b0 0x55fd9740ee20 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a77e92b32faab9bd server_cookie=6617afb821c5a427 in_seq=0 out_seq=0 2024-09-19T06:19:10.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.216+0000 7fb76d7fa640 10 client.16392 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:19:10.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.217+0000 7fb76d7fa640 1 -- 172.21.15.2:0/2007000870 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fd973647f0 con 0x55fd9740c9b0 2024-09-19T06:19:10.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.217+0000 7fb76d7fa640 10 client.16392 handle_command_reply: tid=0 2024-09-19T06:19:10.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.217+0000 7fb791f72740 1 client.16392 shutdown 2024-09-19T06:19:10.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.217+0000 7fb791f72740 1 -- 172.21.15.2:0/2007000870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd973f1b60 msgr2=0x55fd973f9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:10.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.217+0000 7fb791f72740 1 --2- 172.21.15.2:0/2007000870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd973f1b60 0x55fd973f9c50 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb77800ea80 tx=0x7fb7780094a0 comp rx=0 tx=0).stop 2024-09-19T06:19:10.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.217+0000 7fb791f72740 1 -- 172.21.15.2:0/2007000870 shutdown_connections 2024-09-19T06:19:10.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.217+0000 7fb791f72740 1 --2- 172.21.15.2:0/2007000870 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55fd9740c9b0 0x55fd9740ee20 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:10.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.217+0000 7fb791f72740 1 --2- 172.21.15.2:0/2007000870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd973fcd40 0x55fd973fa6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:10.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.217+0000 7fb791f72740 1 --2- 172.21.15.2:0/2007000870 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fd973f2480 0x55fd973fa190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:10.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.217+0000 7fb791f72740 1 --2- 172.21.15.2:0/2007000870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd973f1b60 0x55fd973f9c50 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:10.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.217+0000 7fb76d7fa640 0 client.16392 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:19:10.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.217+0000 7fb791f72740 1 -- 172.21.15.2:0/2007000870 >> 172.21.15.2:0/2007000870 conn(0x55fd973ee0f0 msgr2=0x55fd973f3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:10.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.217+0000 7fb791f72740 1 -- 172.21.15.2:0/2007000870 shutdown_connections 2024-09-19T06:19:10.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.217+0000 7fb791f72740 1 -- 172.21.15.2:0/2007000870 wait complete. 2024-09-19T06:19:10.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.217+0000 7fb791f72740 20 client.16392 trim_cache size 0 max 16384 2024-09-19T06:19:10.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.235+0000 7fb791f72740 1 Processor -- start 2024-09-19T06:19:10.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.235+0000 7fb791f72740 1 -- start start 2024-09-19T06:19:10.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.235+0000 7fb791f72740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd973f1b60 0x55fd97414710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:10.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.235+0000 7fb791f72740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd973f2480 0x55fd97414c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:10.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.235+0000 7fb791f72740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fd973fcd40 0x55fd973f6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:10.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.235+0000 7fb791f72740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb7881b0010 con 0x55fd973f2480 2024-09-19T06:19:10.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.235+0000 7fb791f72740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb7881ad8e0 con 0x55fd973f1b60 2024-09-19T06:19:10.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.235+0000 7fb791f72740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb7881ab730 con 0x55fd973fcd40 2024-09-19T06:19:10.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.236+0000 7fb78d134640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd973f2480 0x55fd97414c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:10.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.236+0000 7fb78d134640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd973f2480 0x55fd97414c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50706/0 (socket says 172.21.15.2:50706) 2024-09-19T06:19:10.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.236+0000 7fb78d134640 1 -- 172.21.15.2:0/1000746232 learned_addr learned my addr 172.21.15.2:0/1000746232 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:10.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.236+0000 7fb78d935640 1 --2- 172.21.15.2:0/1000746232 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd973f1b60 0x55fd97414710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:10.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.236+0000 7fb78e136640 1 --2- 172.21.15.2:0/1000746232 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fd973fcd40 0x55fd973f6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:10.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.236+0000 7fb78d134640 1 -- 172.21.15.2:0/1000746232 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fd973fcd40 msgr2=0x55fd973f6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:10.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.236+0000 7fb78d134640 1 --2- 172.21.15.2:0/1000746232 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fd973fcd40 0x55fd973f6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:10.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.236+0000 7fb78d134640 1 -- 172.21.15.2:0/1000746232 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd973f1b60 msgr2=0x55fd97414710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:10.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.236+0000 7fb78d134640 1 --2- 172.21.15.2:0/1000746232 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd973f1b60 0x55fd97414710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:10.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.236+0000 7fb78d134640 1 -- 172.21.15.2:0/1000746232 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd973ff490 con 0x55fd973f2480 2024-09-19T06:19:10.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.236+0000 7fb78d935640 1 --2- 172.21.15.2:0/1000746232 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd973f1b60 0x55fd97414710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:19:10.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.236+0000 7fb78d134640 1 --2- 172.21.15.2:0/1000746232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd973f2480 0x55fd97414c50 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fb77c00abb0 tx=0x7fb77c005e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cc91d44fc1e8d30 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:10.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.236+0000 7fb76f7fe640 1 -- 172.21.15.2:0/1000746232 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77c01d040 con 0x55fd973f2480 2024-09-19T06:19:10.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.236+0000 7fb76f7fe640 1 -- 172.21.15.2:0/1000746232 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb77c02b070 con 0x55fd973f2480 2024-09-19T06:19:10.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.236+0000 7fb76f7fe640 1 -- 172.21.15.2:0/1000746232 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77c004ce0 con 0x55fd973f2480 2024-09-19T06:19:10.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.237+0000 7fb791f72740 1 -- 172.21.15.2:0/1000746232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd973f2480 msgr2=0x55fd97414c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:10.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.237+0000 7fb791f72740 1 --2- 172.21.15.2:0/1000746232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd973f2480 0x55fd97414c50 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fb77c00abb0 tx=0x7fb77c005e40 comp rx=0 tx=0).stop 2024-09-19T06:19:10.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.237+0000 7fb791f72740 1 -- 172.21.15.2:0/1000746232 shutdown_connections 2024-09-19T06:19:10.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.237+0000 7fb791f72740 1 --2- 172.21.15.2:0/1000746232 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fd973fcd40 0x55fd973f6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:10.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.237+0000 7fb791f72740 1 --2- 172.21.15.2:0/1000746232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd973f2480 0x55fd97414c50 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:10.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.237+0000 7fb791f72740 1 --2- 172.21.15.2:0/1000746232 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd973f1b60 0x55fd97414710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:10.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.237+0000 7fb791f72740 1 -- 172.21.15.2:0/1000746232 >> 172.21.15.2:0/1000746232 conn(0x55fd973ee0f0 msgr2=0x55fd973f3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:10.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.237+0000 7fb791f72740 1 -- 172.21.15.2:0/1000746232 shutdown_connections 2024-09-19T06:19:10.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.237+0000 7fb791f72740 1 -- 172.21.15.2:0/1000746232 wait complete. 2024-09-19T06:19:10.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.237+0000 7fb791f72740 1 -- start start 2024-09-19T06:19:10.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.238+0000 7fb791f72740 1 Processor -- start 2024-09-19T06:19:10.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.238+0000 7fb791f72740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fd973f1b60 0x55fd97404cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:10.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.238+0000 7fb791f72740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd973f2480 0x55fd97405230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:10.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.238+0000 7fb791f72740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd973fcd40 0x55fd974011a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:10.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.238+0000 7fb791f72740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb7881abda0 con 0x55fd973f2480 2024-09-19T06:19:10.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.238+0000 7fb791f72740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb7881ad210 con 0x55fd973fcd40 2024-09-19T06:19:10.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.238+0000 7fb791f72740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb7881ac470 con 0x55fd973f1b60 2024-09-19T06:19:10.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.238+0000 7fb791f72740 10 client.0 _ll_register_callbacks cb 0x7fb7780981d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:10.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.238+0000 7fb78d134640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd973f2480 0x55fd97405230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:10.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.238+0000 7fb78d134640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd973f2480 0x55fd97405230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50718/0 (socket says 172.21.15.2:50718) 2024-09-19T06:19:10.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.238+0000 7fb78d134640 1 -- 172.21.15.2:0/2717377648 learned_addr learned my addr 172.21.15.2:0/2717377648 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:10.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.238+0000 7fb78d935640 1 --2- 172.21.15.2:0/2717377648 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fd973f1b60 0x55fd97404cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:10.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.238+0000 7fb78e136640 1 --2- 172.21.15.2:0/2717377648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd973fcd40 0x55fd974011a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:10.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.238+0000 7fb78d134640 1 -- 172.21.15.2:0/2717377648 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fd973f1b60 msgr2=0x55fd97404cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:10.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.238+0000 7fb78d134640 1 --2- 172.21.15.2:0/2717377648 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fd973f1b60 0x55fd97404cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:10.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.238+0000 7fb78d134640 1 -- 172.21.15.2:0/2717377648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd973fcd40 msgr2=0x55fd974011a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:10.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.238+0000 7fb78d134640 1 --2- 172.21.15.2:0/2717377648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd973fcd40 0x55fd974011a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:10.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.238+0000 7fb78d134640 1 -- 172.21.15.2:0/2717377648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd974019a0 con 0x55fd973f2480 2024-09-19T06:19:10.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.238+0000 7fb78d935640 1 --2- 172.21.15.2:0/2717377648 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fd973f1b60 0x55fd97404cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:19:10.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.238+0000 7fb78e136640 1 --2- 172.21.15.2:0/2717377648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd973fcd40 0x55fd974011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:19:10.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.239+0000 7fb78d134640 1 --2- 172.21.15.2:0/2717377648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd973f2480 0x55fd97405230 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fb77c00f7d0 tx=0x7fb77c004660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac3e79a4c25114eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:10.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.239+0000 7fb76d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:19:10.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.239+0000 7fb76d7fa640 1 -- 172.21.15.2:0/2717377648 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77c03d060 con 0x55fd973f2480 2024-09-19T06:19:10.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.239+0000 7fb76d7fa640 1 -- 172.21.15.2:0/2717377648 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fb77c005040 con 0x55fd973f2480 2024-09-19T06:19:10.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.239+0000 7fb791f72740 1 -- 172.21.15.2:0/2717377648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb77c02b070 con 0x55fd973f2480 2024-09-19T06:19:10.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.239+0000 7fb76d7fa640 1 -- 172.21.15.2:0/2717377648 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb77c01d070 con 0x55fd973f2480 2024-09-19T06:19:10.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.239+0000 7fb791f72740 10 client.16398 fetch_fsmap learned FSMap version 26 2024-09-19T06:19:10.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.239+0000 7fb791f72740 1 -- 172.21.15.2:0/2717377648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55fd97478170 con 0x55fd973f2480 2024-09-19T06:19:10.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.239+0000 7fb76d7fa640 1 -- 172.21.15.2:0/2717377648 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb77c02b070 con 0x55fd973f2480 2024-09-19T06:19:10.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.239+0000 7fb76d7fa640 1 -- 172.21.15.2:0/2717377648 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fb77c02e070 con 0x55fd973f2480 2024-09-19T06:19:10.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.240+0000 7fb791f72740 10 client.16398 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:19:10.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.240+0000 7fb791f72740 10 client.16398 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:19:10.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.240+0000 7fb791f72740 20 client.16398 populate_metadata read hostname 'smithi002' 2024-09-19T06:19:10.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.240+0000 7fb791f72740 1 --2- 172.21.15.2:0/2717377648 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55fd97478610 0x55fd9747aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:10.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.240+0000 7fb791f72740 4 client.16398 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:19:10.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.240+0000 7fb791f72740 1 -- 172.21.15.2:0/2717377648 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55fd9735ed00 con 0x55fd97478610 2024-09-19T06:19:10.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.240+0000 7fb78d935640 1 --2- 172.21.15.2:0/2717377648 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55fd97478610 0x55fd9747aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:10.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.240+0000 7fb78d935640 1 --2- 172.21.15.2:0/2717377648 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55fd97478610 0x55fd9747aa30 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b4208506b595f72 server_cookie=4f9b069a5732506a in_seq=0 out_seq=0 2024-09-19T06:19:10.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.240+0000 7fb76d7fa640 10 client.16398 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:19:10.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.241+0000 7fb76d7fa640 1 -- 172.21.15.2:0/2717377648 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55fd9735ed00 con 0x55fd97478610 2024-09-19T06:19:10.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.241+0000 7fb76d7fa640 10 client.16398 handle_command_reply: tid=0 2024-09-19T06:19:10.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.241+0000 7fb791f72740 1 client.16398 shutdown 2024-09-19T06:19:10.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.241+0000 7fb791f72740 1 -- 172.21.15.2:0/2717377648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd973f2480 msgr2=0x55fd97405230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:10.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.241+0000 7fb791f72740 1 --2- 172.21.15.2:0/2717377648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd973f2480 0x55fd97405230 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fb77c00f7d0 tx=0x7fb77c004660 comp rx=0 tx=0).stop 2024-09-19T06:19:10.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.241+0000 7fb791f72740 1 -- 172.21.15.2:0/2717377648 shutdown_connections 2024-09-19T06:19:10.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.241+0000 7fb791f72740 1 --2- 172.21.15.2:0/2717377648 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55fd97478610 0x55fd9747aa30 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:10.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.241+0000 7fb791f72740 1 --2- 172.21.15.2:0/2717377648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd973fcd40 0x55fd974011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:10.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.241+0000 7fb791f72740 1 --2- 172.21.15.2:0/2717377648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd973f2480 0x55fd97405230 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:10.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.241+0000 7fb791f72740 1 --2- 172.21.15.2:0/2717377648 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fd973f1b60 0x55fd97404cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:10.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.241+0000 7fb791f72740 1 -- 172.21.15.2:0/2717377648 >> 172.21.15.2:0/2717377648 conn(0x55fd973ee0f0 msgr2=0x55fd973eca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:10.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.241+0000 7fb76d7fa640 0 client.16398 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:19:10.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.242+0000 7fb791f72740 1 -- 172.21.15.2:0/2717377648 shutdown_connections 2024-09-19T06:19:10.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.242+0000 7fb791f72740 1 -- 172.21.15.2:0/2717377648 wait complete. 2024-09-19T06:19:10.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.242+0000 7fb791f72740 20 client.16398 trim_cache size 0 max 16384 2024-09-19T06:19:10.252 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:19:10.252 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T06:19:10.253 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "1e79b134-09a7-49bd-8fbc-9c7901b5b69e", 2024-09-19T06:19:10.253 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T06:19:10.253 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:19:10.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.242+0000 7fb78fb99640 1 -- 172.21.15.2:0/3032432382 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb7700a33b0 msgr2=0x7fb7700a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:10.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.242+0000 7fb78fb99640 1 --2- 172.21.15.2:0/3032432382 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb7700a33b0 0x7fb7700a5870 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb780006010 tx=0x7fb78002a420 comp rx=0 tx=0).stop 2024-09-19T06:19:10.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.242+0000 7fb78fb99640 1 -- 172.21.15.2:0/3032432382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb788102db0 msgr2=0x7fb788198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:10.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.242+0000 7fb78fb99640 1 --2- 172.21.15.2:0/3032432382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb788102db0 0x7fb788198440 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb77800eab0 tx=0x7fb77800eeb0 comp rx=0 tx=0).stop 2024-09-19T06:19:10.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.242+0000 7fb78fb99640 1 -- 172.21.15.2:0/3032432382 shutdown_connections 2024-09-19T06:19:10.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.242+0000 7fb78fb99640 1 --2- 172.21.15.2:0/3032432382 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb7700a33b0 0x7fb7700a5870 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:10.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.242+0000 7fb78fb99640 1 --2- 172.21.15.2:0/3032432382 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7881082e0 0x7fb78819cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:10.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.242+0000 7fb78fb99640 1 --2- 172.21.15.2:0/3032432382 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb788103760 0x7fb788198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:10.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.242+0000 7fb78fb99640 1 --2- 172.21.15.2:0/3032432382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb788102db0 0x7fb788198440 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:10.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.242+0000 7fb78fb99640 1 -- 172.21.15.2:0/3032432382 >> 172.21.15.2:0/3032432382 conn(0x7fb7880fc7d0 msgr2=0x7fb788106390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:10.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.242+0000 7fb78fb99640 1 -- 172.21.15.2:0/3032432382 shutdown_connections 2024-09-19T06:19:10.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:10.242+0000 7fb78fb99640 1 -- 172.21.15.2:0/3032432382 wait complete. 2024-09-19T06:19:11.037 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:19:11.305 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:19:11.759 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:11 smithi002 ceph-mon[30982]: pgmap v134: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T06:19:11.759 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:11 smithi002 ceph-mon[30982]: scrub queued for path: / 2024-09-19T06:19:11.759 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:11 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:19:11.759 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:11 smithi002 ceph-mon[30982]: scrub summary: active paths [/] 2024-09-19T06:19:11.759 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:11 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:19:11.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:11 smithi089 ceph-mon[34160]: pgmap v134: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T06:19:11.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:11 smithi089 ceph-mon[34160]: scrub queued for path: / 2024-09-19T06:19:11.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:11 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:19:11.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:11 smithi089 ceph-mon[34160]: scrub summary: active paths [/] 2024-09-19T06:19:11.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:11 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:19:11.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.839+0000 7f8f56149640 1 -- 172.21.15.2:0/218706186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f50101de0 msgr2=0x7f8f501021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:11.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.839+0000 7f8f56149640 1 --2- 172.21.15.2:0/218706186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f50101de0 0x7f8f501021c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f8f40009900 tx=0x7f8f4002a410 comp rx=0 tx=0).stop 2024-09-19T06:19:11.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.840+0000 7f8f56149640 1 -- 172.21.15.2:0/218706186 shutdown_connections 2024-09-19T06:19:11.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.840+0000 7f8f56149640 1 --2- 172.21.15.2:0/218706186 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f50106f10 0x7f8f5010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:11.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.840+0000 7f8f56149640 1 --2- 172.21.15.2:0/218706186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f50102790 0x7f8f501067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:11.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.840+0000 7f8f56149640 1 --2- 172.21.15.2:0/218706186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f50101de0 0x7f8f501021c0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:11.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.840+0000 7f8f56149640 1 -- 172.21.15.2:0/218706186 >> 172.21.15.2:0/218706186 conn(0x7f8f500fd8e0 msgr2=0x7f8f500ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:11.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.840+0000 7f8f56149640 1 -- 172.21.15.2:0/218706186 shutdown_connections 2024-09-19T06:19:11.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.840+0000 7f8f56149640 1 -- 172.21.15.2:0/218706186 wait complete. 2024-09-19T06:19:11.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.840+0000 7f8f56149640 1 Processor -- start 2024-09-19T06:19:11.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.840+0000 7f8f56149640 1 -- start start 2024-09-19T06:19:11.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.841+0000 7f8f56149640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f50101de0 0x7f8f501983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:11.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.841+0000 7f8f56149640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f50102790 0x7f8f50198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:11.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.841+0000 7f8f56149640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f50106f10 0x7f8f5019ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:11.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.841+0000 7f8f56149640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8f50111e20 con 0x7f8f50101de0 2024-09-19T06:19:11.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.841+0000 7f8f56149640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8f50111ca0 con 0x7f8f50106f10 2024-09-19T06:19:11.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.841+0000 7f8f56149640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8f50111fa0 con 0x7f8f50102790 2024-09-19T06:19:11.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.841+0000 7f8f4f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f50101de0 0x7f8f501983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:11.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.841+0000 7f8f4f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f50101de0 0x7f8f501983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50734/0 (socket says 172.21.15.2:50734) 2024-09-19T06:19:11.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.841+0000 7f8f4f7fe640 1 -- 172.21.15.2:0/1202810649 learned_addr learned my addr 172.21.15.2:0/1202810649 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:11.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.841+0000 7f8f4effd640 1 --2- 172.21.15.2:0/1202810649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f50102790 0x7f8f50198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:11.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.841+0000 7f8f4ffff640 1 --2- 172.21.15.2:0/1202810649 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f50106f10 0x7f8f5019ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:11.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.841+0000 7f8f4f7fe640 1 -- 172.21.15.2:0/1202810649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f50102790 msgr2=0x7f8f50198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:11.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.841+0000 7f8f4f7fe640 1 --2- 172.21.15.2:0/1202810649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f50102790 0x7f8f50198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:11.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.841+0000 7f8f4f7fe640 1 -- 172.21.15.2:0/1202810649 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f50106f10 msgr2=0x7f8f5019ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:11.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.841+0000 7f8f4f7fe640 1 --2- 172.21.15.2:0/1202810649 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f50106f10 0x7f8f5019ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:11.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.841+0000 7f8f4f7fe640 1 -- 172.21.15.2:0/1202810649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f5019d390 con 0x7f8f50101de0 2024-09-19T06:19:11.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.841+0000 7f8f4ffff640 1 --2- 172.21.15.2:0/1202810649 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f50106f10 0x7f8f5019ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:19:11.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.841+0000 7f8f4f7fe640 1 --2- 172.21.15.2:0/1202810649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f50101de0 0x7f8f501983e0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f8f40005940 tx=0x7f8f40004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:11.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.841+0000 7f8f4cff9640 1 -- 172.21.15.2:0/1202810649 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f4003f030 con 0x7f8f50101de0 2024-09-19T06:19:11.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.842+0000 7f8f4cff9640 1 -- 172.21.15.2:0/1202810649 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8f40003aa0 con 0x7f8f50101de0 2024-09-19T06:19:11.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.842+0000 7f8f56149640 1 -- 172.21.15.2:0/1202810649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f5019d620 con 0x7f8f50101de0 2024-09-19T06:19:11.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.842+0000 7f8f4cff9640 1 -- 172.21.15.2:0/1202810649 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f40035070 con 0x7f8f50101de0 2024-09-19T06:19:11.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.842+0000 7f8f56149640 1 -- 172.21.15.2:0/1202810649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f501a4f60 con 0x7f8f50101de0 2024-09-19T06:19:11.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.844+0000 7f8f4cff9640 1 -- 172.21.15.2:0/1202810649 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f8f40042030 con 0x7f8f50101de0 2024-09-19T06:19:11.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.844+0000 7f8f58522740 1 Processor -- start 2024-09-19T06:19:11.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.844+0000 7f8f58522740 1 -- start start 2024-09-19T06:19:11.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.844+0000 7f8f58522740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ab2fd354a0 0x55ab2fd35880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:11.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.844+0000 7f8f58522740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ab2fd35dc0 0x55ab2fd40140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:11.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.844+0000 7f8f58522740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab2fd40680 0x55ab2fd42a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:11.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.844+0000 7f8f58522740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ab2fc9b2e0 con 0x55ab2fd354a0 2024-09-19T06:19:11.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.844+0000 7f8f58522740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55ab2fc42ce0 con 0x55ab2fd40680 2024-09-19T06:19:11.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.844+0000 7f8f58522740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55ab2fc972a0 con 0x55ab2fd35dc0 2024-09-19T06:19:11.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.844+0000 7f8f4ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ab2fd354a0 0x55ab2fd35880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:11.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.844+0000 7f8f4ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ab2fd354a0 0x55ab2fd35880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50750/0 (socket says 172.21.15.2:50750) 2024-09-19T06:19:11.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.845+0000 7f8f4ffff640 1 -- 172.21.15.2:0/2786333760 learned_addr learned my addr 172.21.15.2:0/2786333760 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:11.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.845+0000 7f8f4cff9640 1 --2- 172.21.15.2:0/1202810649 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f8f3c0a33b0 0x7f8f3c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:11.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.845+0000 7f8f4f7fe640 1 --2- 172.21.15.2:0/2786333760 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ab2fd35dc0 0x55ab2fd40140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:11.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.845+0000 7f8f4effd640 1 --2- 172.21.15.2:0/2786333760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab2fd40680 0x55ab2fd42a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:11.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.845+0000 7f8f4ffff640 1 -- 172.21.15.2:0/2786333760 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ab2fd35dc0 msgr2=0x55ab2fd40140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:11.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.845+0000 7f8f4ffff640 1 --2- 172.21.15.2:0/2786333760 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ab2fd35dc0 0x55ab2fd40140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:11.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.845+0000 7f8f4ffff640 1 -- 172.21.15.2:0/2786333760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab2fd40680 msgr2=0x55ab2fd42a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:11.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.845+0000 7f8f4ffff640 1 --2- 172.21.15.2:0/2786333760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab2fd40680 0x55ab2fd42a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:11.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.845+0000 7f8f4ffff640 1 -- 172.21.15.2:0/2786333760 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab2fc27440 con 0x55ab2fd354a0 2024-09-19T06:19:11.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.845+0000 7f8f4cff9640 1 -- 172.21.15.2:0/1202810649 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f8f400f0550 con 0x7f8f50101de0 2024-09-19T06:19:11.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.845+0000 7f8f4ffff640 1 --2- 172.21.15.2:0/1202810649 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f8f3c0a33b0 0x7f8f3c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:11.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.845+0000 7f8f4ffff640 1 --2- 172.21.15.2:0/2786333760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ab2fd354a0 0x55ab2fd35880 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f8f48009580 tx=0x7f8f4800e780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=433a62dd4f78f670 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:11.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.845+0000 7f8f45ffb640 1 -- 172.21.15.2:0/2786333760 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f4801c870 con 0x55ab2fd354a0 2024-09-19T06:19:11.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.845+0000 7f8f45ffb640 1 -- 172.21.15.2:0/2786333760 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8f4801d410 con 0x55ab2fd354a0 2024-09-19T06:19:11.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.845+0000 7f8f45ffb640 1 -- 172.21.15.2:0/2786333760 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f480275c0 con 0x55ab2fd354a0 2024-09-19T06:19:11.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.846+0000 7f8f58522740 1 -- 172.21.15.2:0/2786333760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ab2fd354a0 msgr2=0x55ab2fd35880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:11.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.846+0000 7f8f4ffff640 1 --2- 172.21.15.2:0/1202810649 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f8f3c0a33b0 0x7f8f3c0a5870 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8f48023000 tx=0x7f8f48020000 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:11.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.846+0000 7f8f58522740 1 --2- 172.21.15.2:0/2786333760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ab2fd354a0 0x55ab2fd35880 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f8f48009580 tx=0x7f8f4800e780 comp rx=0 tx=0).stop 2024-09-19T06:19:11.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.846+0000 7f8f58522740 1 -- 172.21.15.2:0/2786333760 shutdown_connections 2024-09-19T06:19:11.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.846+0000 7f8f58522740 1 --2- 172.21.15.2:0/2786333760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab2fd40680 0x55ab2fd42a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:11.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.846+0000 7f8f58522740 1 --2- 172.21.15.2:0/2786333760 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ab2fd35dc0 0x55ab2fd40140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:11.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.846+0000 7f8f58522740 1 --2- 172.21.15.2:0/2786333760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ab2fd354a0 0x55ab2fd35880 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:11.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.846+0000 7f8f58522740 1 -- 172.21.15.2:0/2786333760 >> 172.21.15.2:0/2786333760 conn(0x55ab2fd31a30 msgr2=0x55ab2fd31e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:11.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.846+0000 7f8f58522740 1 -- 172.21.15.2:0/2786333760 shutdown_connections 2024-09-19T06:19:11.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.846+0000 7f8f58522740 1 -- 172.21.15.2:0/2786333760 wait complete. 2024-09-19T06:19:11.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.846+0000 7f8f58522740 1 -- start start 2024-09-19T06:19:11.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.847+0000 7f8f58522740 1 Processor -- start 2024-09-19T06:19:11.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.847+0000 7f8f58522740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab2fd354a0 0x55ab2fd3ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:11.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.847+0000 7f8f58522740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ab2fd35dc0 0x55ab2fd3d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:11.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.847+0000 7f8f58522740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ab2fd40680 0x55ab2fd3d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:11.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.847+0000 7f8f58522740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ab2fd43250 con 0x55ab2fd35dc0 2024-09-19T06:19:11.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.847+0000 7f8f58522740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55ab2fc56050 con 0x55ab2fd354a0 2024-09-19T06:19:11.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.847+0000 7f8f58522740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55ab2fd433d0 con 0x55ab2fd40680 2024-09-19T06:19:11.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.847+0000 7f8f58522740 10 client.0 _ll_register_callbacks cb 0x55ab2fc96160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:11.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.847+0000 7f8f4effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ab2fd35dc0 0x55ab2fd3d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:11.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.847+0000 7f8f4effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ab2fd35dc0 0x55ab2fd3d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50760/0 (socket says 172.21.15.2:50760) 2024-09-19T06:19:11.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.847+0000 7f8f4effd640 1 -- 172.21.15.2:0/3934090352 learned_addr learned my addr 172.21.15.2:0/3934090352 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:11.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.847+0000 7f8f4ffff640 1 --2- 172.21.15.2:0/3934090352 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ab2fd40680 0x55ab2fd3d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:11.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.847+0000 7f8f4f7fe640 1 --2- 172.21.15.2:0/3934090352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab2fd354a0 0x55ab2fd3ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:11.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.848+0000 7f8f4effd640 1 -- 172.21.15.2:0/3934090352 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ab2fd40680 msgr2=0x55ab2fd3d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:11.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.848+0000 7f8f4effd640 1 --2- 172.21.15.2:0/3934090352 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ab2fd40680 0x55ab2fd3d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:11.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.848+0000 7f8f4effd640 1 -- 172.21.15.2:0/3934090352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab2fd354a0 msgr2=0x55ab2fd3ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:11.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.848+0000 7f8f4effd640 1 --2- 172.21.15.2:0/3934090352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab2fd354a0 0x55ab2fd3ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:11.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.848+0000 7f8f4effd640 1 -- 172.21.15.2:0/3934090352 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab2fa0c3c0 con 0x55ab2fd35dc0 2024-09-19T06:19:11.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.848+0000 7f8f4f7fe640 1 --2- 172.21.15.2:0/3934090352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab2fd354a0 0x55ab2fd3ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:19:11.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.848+0000 7f8f4effd640 1 --2- 172.21.15.2:0/3934090352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ab2fd35dc0 0x55ab2fd3d270 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f8f3800bea0 tx=0x7f8f3800bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35cbff5e70a5e74c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:11.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.848+0000 7f8f2effd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:19:11.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.848+0000 7f8f2effd640 1 -- 172.21.15.2:0/3934090352 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f38004230 con 0x55ab2fd35dc0 2024-09-19T06:19:11.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.848+0000 7f8f2effd640 1 -- 172.21.15.2:0/3934090352 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f8f380043d0 con 0x55ab2fd35dc0 2024-09-19T06:19:11.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.848+0000 7f8f58522740 1 -- 172.21.15.2:0/3934090352 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f4801d410 con 0x55ab2fd35dc0 2024-09-19T06:19:11.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.848+0000 7f8f2effd640 1 -- 172.21.15.2:0/3934090352 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8f380035f0 con 0x55ab2fd35dc0 2024-09-19T06:19:11.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.848+0000 7f8f58522740 10 client.16410 fetch_fsmap learned FSMap version 26 2024-09-19T06:19:11.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.848+0000 7f8f58522740 1 -- 172.21.15.2:0/3934090352 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ab2fd4ec60 con 0x55ab2fd35dc0 2024-09-19T06:19:11.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.848+0000 7f8f2effd640 1 -- 172.21.15.2:0/3934090352 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8f4801d410 con 0x55ab2fd35dc0 2024-09-19T06:19:11.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.849+0000 7f8f2effd640 1 -- 172.21.15.2:0/3934090352 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f8f3801b8f0 con 0x55ab2fd35dc0 2024-09-19T06:19:11.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.849+0000 7f8f58522740 10 client.16410 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:19:11.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.849+0000 7f8f58522740 10 client.16410 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:19:11.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.849+0000 7f8f58522740 20 client.16410 populate_metadata read hostname 'smithi002' 2024-09-19T06:19:11.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.849+0000 7f8f58522740 1 --2- 172.21.15.2:0/3934090352 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ab2fd50070 0x55ab2fd52480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:11.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.849+0000 7f8f58522740 4 client.16410 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:19:11.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.849+0000 7f8f58522740 1 -- 172.21.15.2:0/3934090352 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab2fca8850 con 0x55ab2fd50070 2024-09-19T06:19:11.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.849+0000 7f8f4f7fe640 1 --2- 172.21.15.2:0/3934090352 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ab2fd50070 0x55ab2fd52480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:11.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.849+0000 7f8f2effd640 10 client.16410 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:19:11.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.849+0000 7f8f4f7fe640 1 --2- 172.21.15.2:0/3934090352 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ab2fd50070 0x55ab2fd52480 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9f6f5764101b5c3 server_cookie=c8dfc0ba905083f2 in_seq=0 out_seq=0 2024-09-19T06:19:11.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.850+0000 7f8f2effd640 1 -- 172.21.15.2:0/3934090352 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ab2fca8850 con 0x55ab2fd50070 2024-09-19T06:19:11.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.850+0000 7f8f2effd640 10 client.16410 handle_command_reply: tid=0 2024-09-19T06:19:11.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.850+0000 7f8f58522740 1 client.16410 shutdown 2024-09-19T06:19:11.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.850+0000 7f8f58522740 1 -- 172.21.15.2:0/3934090352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ab2fd35dc0 msgr2=0x55ab2fd3d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:11.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.850+0000 7f8f58522740 1 --2- 172.21.15.2:0/3934090352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ab2fd35dc0 0x55ab2fd3d270 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f8f3800bea0 tx=0x7f8f3800bf90 comp rx=0 tx=0).stop 2024-09-19T06:19:11.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.850+0000 7f8f58522740 1 -- 172.21.15.2:0/3934090352 shutdown_connections 2024-09-19T06:19:11.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.850+0000 7f8f58522740 1 --2- 172.21.15.2:0/3934090352 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ab2fd40680 0x55ab2fd3d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:11.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.850+0000 7f8f58522740 1 --2- 172.21.15.2:0/3934090352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ab2fd35dc0 0x55ab2fd3d270 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:11.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.850+0000 7f8f58522740 1 --2- 172.21.15.2:0/3934090352 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ab2fd50070 0x55ab2fd52480 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:11.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.850+0000 7f8f2effd640 0 client.16410 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:19:11.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.850+0000 7f8f58522740 1 --2- 172.21.15.2:0/3934090352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab2fd354a0 0x55ab2fd3ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:11.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.850+0000 7f8f58522740 1 -- 172.21.15.2:0/3934090352 >> 172.21.15.2:0/3934090352 conn(0x55ab2fd31a30 msgr2=0x55ab2fd37710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:11.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.850+0000 7f8f58522740 1 -- 172.21.15.2:0/3934090352 shutdown_connections 2024-09-19T06:19:11.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.850+0000 7f8f58522740 1 -- 172.21.15.2:0/3934090352 wait complete. 2024-09-19T06:19:11.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.850+0000 7f8f58522740 20 client.16410 trim_cache size 0 max 16384 2024-09-19T06:19:11.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.868+0000 7f8f58522740 1 Processor -- start 2024-09-19T06:19:11.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.868+0000 7f8f58522740 1 -- start start 2024-09-19T06:19:11.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.868+0000 7f8f58522740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab2fd354a0 0x55ab2fd3f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:11.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.868+0000 7f8f58522740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ab2fd35dc0 0x55ab2fd57d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:11.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.868+0000 7f8f58522740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ab2fd40680 0x55ab2fd58290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:11.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.868+0000 7f8f58522740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8f501adde0 con 0x55ab2fd35dc0 2024-09-19T06:19:11.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.868+0000 7f8f58522740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8f501ab6b0 con 0x55ab2fd354a0 2024-09-19T06:19:11.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.868+0000 7f8f58522740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8f501a9500 con 0x55ab2fd40680 2024-09-19T06:19:11.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.868+0000 7f8f4effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ab2fd35dc0 0x55ab2fd57d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:11.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.868+0000 7f8f4effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ab2fd35dc0 0x55ab2fd57d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50764/0 (socket says 172.21.15.2:50764) 2024-09-19T06:19:11.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.868+0000 7f8f4effd640 1 -- 172.21.15.2:0/4080364573 learned_addr learned my addr 172.21.15.2:0/4080364573 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:11.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.868+0000 7f8f4f7fe640 1 --2- 172.21.15.2:0/4080364573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab2fd354a0 0x55ab2fd3f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:11.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.868+0000 7f8f4ffff640 1 --2- 172.21.15.2:0/4080364573 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ab2fd40680 0x55ab2fd58290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:11.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.868+0000 7f8f4effd640 1 -- 172.21.15.2:0/4080364573 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ab2fd40680 msgr2=0x55ab2fd58290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:11.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.868+0000 7f8f4effd640 1 --2- 172.21.15.2:0/4080364573 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ab2fd40680 0x55ab2fd58290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:11.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.868+0000 7f8f4effd640 1 -- 172.21.15.2:0/4080364573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab2fd354a0 msgr2=0x55ab2fd3f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:11.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.868+0000 7f8f4effd640 1 --2- 172.21.15.2:0/4080364573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab2fd354a0 0x55ab2fd3f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:11.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.868+0000 7f8f4effd640 1 -- 172.21.15.2:0/4080364573 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab2fd42db0 con 0x55ab2fd35dc0 2024-09-19T06:19:11.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.868+0000 7f8f4f7fe640 1 --2- 172.21.15.2:0/4080364573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab2fd354a0 0x55ab2fd3f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:19:11.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.868+0000 7f8f4ffff640 1 --2- 172.21.15.2:0/4080364573 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ab2fd40680 0x55ab2fd58290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:19:11.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.869+0000 7f8f4effd640 1 --2- 172.21.15.2:0/4080364573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ab2fd35dc0 0x55ab2fd57d50 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f8f3801bcc0 tx=0x7f8f38005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38db56faacea532d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:11.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.869+0000 7f8f457fa640 1 -- 172.21.15.2:0/4080364573 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3802a040 con 0x55ab2fd35dc0 2024-09-19T06:19:11.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.869+0000 7f8f457fa640 1 -- 172.21.15.2:0/4080364573 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8f3801b470 con 0x55ab2fd35dc0 2024-09-19T06:19:11.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.869+0000 7f8f457fa640 1 -- 172.21.15.2:0/4080364573 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f38004aa0 con 0x55ab2fd35dc0 2024-09-19T06:19:11.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.869+0000 7f8f58522740 1 -- 172.21.15.2:0/4080364573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ab2fd35dc0 msgr2=0x55ab2fd57d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:11.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.869+0000 7f8f58522740 1 --2- 172.21.15.2:0/4080364573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ab2fd35dc0 0x55ab2fd57d50 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f8f3801bcc0 tx=0x7f8f38005fd0 comp rx=0 tx=0).stop 2024-09-19T06:19:11.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.869+0000 7f8f58522740 1 -- 172.21.15.2:0/4080364573 shutdown_connections 2024-09-19T06:19:11.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.869+0000 7f8f58522740 1 --2- 172.21.15.2:0/4080364573 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ab2fd40680 0x55ab2fd58290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:11.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.869+0000 7f8f58522740 1 --2- 172.21.15.2:0/4080364573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ab2fd35dc0 0x55ab2fd57d50 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:11.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.869+0000 7f8f58522740 1 --2- 172.21.15.2:0/4080364573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab2fd354a0 0x55ab2fd3f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:11.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.869+0000 7f8f58522740 1 -- 172.21.15.2:0/4080364573 >> 172.21.15.2:0/4080364573 conn(0x55ab2fd31a30 msgr2=0x55ab2fd3ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:11.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.870+0000 7f8f58522740 1 -- 172.21.15.2:0/4080364573 shutdown_connections 2024-09-19T06:19:11.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.870+0000 7f8f58522740 1 -- 172.21.15.2:0/4080364573 wait complete. 2024-09-19T06:19:11.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.870+0000 7f8f58522740 1 -- start start 2024-09-19T06:19:11.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.870+0000 7f8f58522740 1 Processor -- start 2024-09-19T06:19:11.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.870+0000 7f8f58522740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ab2fd354a0 0x55ab2fd48e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:11.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.870+0000 7f8f58522740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab2fd35dc0 0x55ab2fd461b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:11.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.870+0000 7f8f58522740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ab2fd40680 0x55ab2fd467a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:11.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.870+0000 7f8f58522740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8f501a9b70 con 0x55ab2fd354a0 2024-09-19T06:19:11.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.870+0000 7f8f58522740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8f501aafe0 con 0x55ab2fd35dc0 2024-09-19T06:19:11.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.870+0000 7f8f58522740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8f501aa240 con 0x55ab2fd40680 2024-09-19T06:19:11.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.870+0000 7f8f58522740 10 client.0 _ll_register_callbacks cb 0x7f8f3800b3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:11.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.870+0000 7f8f4f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ab2fd354a0 0x55ab2fd48e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:11.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.870+0000 7f8f4f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ab2fd354a0 0x55ab2fd48e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50776/0 (socket says 172.21.15.2:50776) 2024-09-19T06:19:11.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.870+0000 7f8f4f7fe640 1 -- 172.21.15.2:0/1691358793 learned_addr learned my addr 172.21.15.2:0/1691358793 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:11.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.871+0000 7f8f4ffff640 1 --2- 172.21.15.2:0/1691358793 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ab2fd40680 0x55ab2fd467a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:11.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.871+0000 7f8f4effd640 1 --2- 172.21.15.2:0/1691358793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab2fd35dc0 0x55ab2fd461b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:11.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.871+0000 7f8f4f7fe640 1 -- 172.21.15.2:0/1691358793 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ab2fd40680 msgr2=0x55ab2fd467a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:11.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.871+0000 7f8f4f7fe640 1 --2- 172.21.15.2:0/1691358793 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ab2fd40680 0x55ab2fd467a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:11.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.871+0000 7f8f4f7fe640 1 -- 172.21.15.2:0/1691358793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab2fd35dc0 msgr2=0x55ab2fd461b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:11.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.871+0000 7f8f4f7fe640 1 --2- 172.21.15.2:0/1691358793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab2fd35dc0 0x55ab2fd461b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:11.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.871+0000 7f8f4f7fe640 1 -- 172.21.15.2:0/1691358793 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab2fd46fa0 con 0x55ab2fd354a0 2024-09-19T06:19:11.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.871+0000 7f8f4f7fe640 1 --2- 172.21.15.2:0/1691358793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ab2fd354a0 0x55ab2fd48e60 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f8f40006010 tx=0x7f8f4002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7155c8b5a8bf268 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:11.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.871+0000 7f8f2effd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:19:11.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.871+0000 7f8f2effd640 1 -- 172.21.15.2:0/1691358793 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f40049040 con 0x55ab2fd354a0 2024-09-19T06:19:11.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.871+0000 7f8f2effd640 1 -- 172.21.15.2:0/1691358793 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f8f4009b0b0 con 0x55ab2fd354a0 2024-09-19T06:19:11.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.871+0000 7f8f58522740 1 -- 172.21.15.2:0/1691358793 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f3801b470 con 0x55ab2fd354a0 2024-09-19T06:19:11.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.871+0000 7f8f2effd640 1 -- 172.21.15.2:0/1691358793 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8f400bc860 con 0x55ab2fd354a0 2024-09-19T06:19:11.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.871+0000 7f8f58522740 10 client.16416 fetch_fsmap learned FSMap version 26 2024-09-19T06:19:11.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.871+0000 7f8f58522740 1 -- 172.21.15.2:0/1691358793 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ab2fdbae80 con 0x55ab2fd354a0 2024-09-19T06:19:11.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.871+0000 7f8f2effd640 1 -- 172.21.15.2:0/1691358793 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8f3801b470 con 0x55ab2fd354a0 2024-09-19T06:19:11.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.872+0000 7f8f2effd640 1 -- 172.21.15.2:0/1691358793 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f8f400b8ed0 con 0x55ab2fd354a0 2024-09-19T06:19:11.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.872+0000 7f8f58522740 10 client.16416 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:19:11.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.872+0000 7f8f58522740 10 client.16416 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:19:11.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.872+0000 7f8f58522740 20 client.16416 populate_metadata read hostname 'smithi002' 2024-09-19T06:19:11.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.872+0000 7f8f58522740 1 --2- 172.21.15.2:0/1691358793 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ab2fd50070 0x55ab2fdbd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:11.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.872+0000 7f8f58522740 4 client.16416 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:19:11.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.872+0000 7f8f58522740 1 -- 172.21.15.2:0/1691358793 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ab2fd3db40 con 0x55ab2fd50070 2024-09-19T06:19:11.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.872+0000 7f8f4effd640 1 --2- 172.21.15.2:0/1691358793 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ab2fd50070 0x55ab2fdbd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:11.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.872+0000 7f8f4effd640 1 --2- 172.21.15.2:0/1691358793 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ab2fd50070 0x55ab2fdbd560 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f16eba5b737781f server_cookie=a3e59080d9503bf3 in_seq=0 out_seq=0 2024-09-19T06:19:11.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.872+0000 7f8f2effd640 10 client.16416 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:19:11.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.873+0000 7f8f2effd640 1 -- 172.21.15.2:0/1691358793 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55ab2fd3db40 con 0x55ab2fd50070 2024-09-19T06:19:11.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.873+0000 7f8f2effd640 10 client.16416 handle_command_reply: tid=0 2024-09-19T06:19:11.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.873+0000 7f8f58522740 1 client.16416 shutdown 2024-09-19T06:19:11.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.873+0000 7f8f58522740 1 -- 172.21.15.2:0/1691358793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ab2fd354a0 msgr2=0x55ab2fd48e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:11.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.873+0000 7f8f58522740 1 --2- 172.21.15.2:0/1691358793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ab2fd354a0 0x55ab2fd48e60 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f8f40006010 tx=0x7f8f4002a410 comp rx=0 tx=0).stop 2024-09-19T06:19:11.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.873+0000 7f8f58522740 1 -- 172.21.15.2:0/1691358793 shutdown_connections 2024-09-19T06:19:11.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.873+0000 7f8f58522740 1 --2- 172.21.15.2:0/1691358793 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ab2fd40680 0x55ab2fd467a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:11.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.873+0000 7f8f58522740 1 --2- 172.21.15.2:0/1691358793 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ab2fd50070 0x55ab2fdbd560 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:11.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.873+0000 7f8f58522740 1 --2- 172.21.15.2:0/1691358793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab2fd35dc0 0x55ab2fd461b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:11.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.873+0000 7f8f2effd640 0 client.16416 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:19:11.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.873+0000 7f8f58522740 1 --2- 172.21.15.2:0/1691358793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ab2fd354a0 0x55ab2fd48e60 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:11.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.873+0000 7f8f58522740 1 -- 172.21.15.2:0/1691358793 >> 172.21.15.2:0/1691358793 conn(0x55ab2fd31a30 msgr2=0x55ab2fd3f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:11.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.873+0000 7f8f58522740 1 -- 172.21.15.2:0/1691358793 shutdown_connections 2024-09-19T06:19:11.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.873+0000 7f8f58522740 1 -- 172.21.15.2:0/1691358793 wait complete. 2024-09-19T06:19:11.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.873+0000 7f8f58522740 20 client.16416 trim_cache size 0 max 16384 2024-09-19T06:19:11.885 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:19:11.885 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:19:11.885 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-19T06:19:11.885 INFO:teuthology.orchestra.run.smithi002.stdout: "1e79b134-09a7-49bd-8fbc-9c7901b5b69e": { 2024-09-19T06:19:11.885 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-19T06:19:11.885 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "1e79b134-09a7-49bd-8fbc-9c7901b5b69e", 2024-09-19T06:19:11.885 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-19T06:19:11.886 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:19:11.886 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:19:11.886 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:19:11.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.873+0000 7f8f56149640 1 -- 172.21.15.2:0/1202810649 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f8f3c0a33b0 msgr2=0x7f8f3c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:11.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.873+0000 7f8f56149640 1 --2- 172.21.15.2:0/1202810649 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f8f3c0a33b0 0x7f8f3c0a5870 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8f48023000 tx=0x7f8f48020000 comp rx=0 tx=0).stop 2024-09-19T06:19:11.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.873+0000 7f8f56149640 1 -- 172.21.15.2:0/1202810649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f50101de0 msgr2=0x7f8f501983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:11.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.873+0000 7f8f56149640 1 --2- 172.21.15.2:0/1202810649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f50101de0 0x7f8f501983e0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f8f40005940 tx=0x7f8f40004270 comp rx=0 tx=0).stop 2024-09-19T06:19:11.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.874+0000 7f8f56149640 1 -- 172.21.15.2:0/1202810649 shutdown_connections 2024-09-19T06:19:11.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.874+0000 7f8f56149640 1 --2- 172.21.15.2:0/1202810649 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f8f3c0a33b0 0x7f8f3c0a5870 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:11.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.874+0000 7f8f56149640 1 --2- 172.21.15.2:0/1202810649 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f50106f10 0x7f8f5019ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:11.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.874+0000 7f8f56149640 1 --2- 172.21.15.2:0/1202810649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f50102790 0x7f8f50198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:11.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.874+0000 7f8f56149640 1 --2- 172.21.15.2:0/1202810649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f50101de0 0x7f8f501983e0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:11.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.874+0000 7f8f56149640 1 -- 172.21.15.2:0/1202810649 >> 172.21.15.2:0/1202810649 conn(0x7f8f500fd8e0 msgr2=0x7f8f500feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:11.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.874+0000 7f8f56149640 1 -- 172.21.15.2:0/1202810649 shutdown_connections 2024-09-19T06:19:11.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:11.874+0000 7f8f56149640 1 -- 172.21.15.2:0/1202810649 wait complete. 2024-09-19T06:19:11.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:11 smithi090 ceph-mon[34497]: pgmap v134: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T06:19:11.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:11 smithi090 ceph-mon[34497]: scrub queued for path: / 2024-09-19T06:19:11.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:11 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:19:11.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:11 smithi090 ceph-mon[34497]: scrub summary: active paths [/] 2024-09-19T06:19:11.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:11 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:19:12.730 INFO:tasks.cephfs.filesystem:scrub status for tag:1e79b134-09a7-49bd-8fbc-9c7901b5b69e - {'path': '/', 'tag': '1e79b134-09a7-49bd-8fbc-9c7901b5b69e', 'options': 'recursive,force'} 2024-09-19T06:19:13.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:13 smithi089 ceph-mon[34160]: pgmap v135: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T06:19:13.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:13 smithi089 ceph-mon[34160]: scrub summary: idle 2024-09-19T06:19:13.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:13 smithi002 ceph-mon[30982]: pgmap v135: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T06:19:13.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:13 smithi002 ceph-mon[30982]: scrub summary: idle 2024-09-19T06:19:13.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:13 smithi090 ceph-mon[34497]: pgmap v135: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T06:19:13.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:13 smithi090 ceph-mon[34497]: scrub summary: idle 2024-09-19T06:19:15.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:15 smithi089 ceph-mon[34160]: pgmap v136: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-19T06:19:15.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:15 smithi002 ceph-mon[30982]: pgmap v136: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-19T06:19:15.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:15 smithi090 ceph-mon[34497]: pgmap v136: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-19T06:19:17.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:17 smithi089 ceph-mon[34160]: pgmap v137: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-19T06:19:17.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:17 smithi002 ceph-mon[30982]: pgmap v137: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-19T06:19:17.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:17 smithi090 ceph-mon[34497]: pgmap v137: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-19T06:19:19.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:19 smithi089 ceph-mon[34160]: pgmap v138: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-19T06:19:19.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:19 smithi002 ceph-mon[30982]: pgmap v138: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-19T06:19:19.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:19 smithi090 ceph-mon[34497]: pgmap v138: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-19T06:19:21.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:21 smithi089 ceph-mon[34160]: pgmap v139: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-19T06:19:21.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:21 smithi002 ceph-mon[30982]: pgmap v139: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-19T06:19:21.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:21 smithi090 ceph-mon[34497]: pgmap v139: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-19T06:19:23.789 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:23 smithi002 ceph-mon[30982]: pgmap v140: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:19:23.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:23 smithi089 ceph-mon[34160]: pgmap v140: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:19:23.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:23 smithi090 ceph-mon[34497]: pgmap v140: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:19:25.792 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:25 smithi090 ceph-mon[34497]: pgmap v141: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:19:25.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:25 smithi089 ceph-mon[34160]: pgmap v141: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:19:25.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:25 smithi002 ceph-mon[30982]: pgmap v141: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:19:27.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:27 smithi089 ceph-mon[34160]: pgmap v142: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:19:27.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:27 smithi002 ceph-mon[30982]: pgmap v142: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:19:27.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:27 smithi090 ceph-mon[34497]: pgmap v142: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:19:29.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:29 smithi002 ceph-mon[30982]: pgmap v143: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:19:29.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:29 smithi090 ceph-mon[34497]: pgmap v143: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:19:30.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:29 smithi089 ceph-mon[34160]: pgmap v143: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:19:31.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:31 smithi002 ceph-mon[30982]: pgmap v144: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:19:31.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:31 smithi090 ceph-mon[34497]: pgmap v144: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:19:32.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:31 smithi089 ceph-mon[34160]: pgmap v144: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:19:33.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:33 smithi002 ceph-mon[30982]: pgmap v145: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:19:33.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:33 smithi090 ceph-mon[34497]: pgmap v145: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:19:34.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:33 smithi089 ceph-mon[34160]: pgmap v145: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:19:35.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:35 smithi002 ceph-mon[30982]: pgmap v146: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:19:35.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:35 smithi090 ceph-mon[34497]: pgmap v146: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:19:36.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:35 smithi089 ceph-mon[34160]: pgmap v146: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:19:37.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:37 smithi002 ceph-mon[30982]: pgmap v147: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:19:37.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:37 smithi090 ceph-mon[34497]: pgmap v147: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:19:38.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:37 smithi089 ceph-mon[34160]: pgmap v147: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:19:39.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:39 smithi002 ceph-mon[30982]: pgmap v148: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:19:39.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:39 smithi090 ceph-mon[34497]: pgmap v148: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:19:40.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:39 smithi089 ceph-mon[34160]: pgmap v148: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:19:41.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:41 smithi002 ceph-mon[30982]: pgmap v149: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:19:41.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:41 smithi090 ceph-mon[34497]: pgmap v149: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:19:42.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:41 smithi089 ceph-mon[34160]: pgmap v149: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:19:42.732 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:19:43.005 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:19:43.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.454+0000 7f30f7afa640 1 -- 172.21.15.2:0/1105536387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30f0106f10 msgr2=0x7f30f010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:43.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.454+0000 7f30f7afa640 1 --2- 172.21.15.2:0/1105536387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30f0106f10 0x7f30f010ea90 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f30e8009ca0 tx=0x7f30e802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.454+0000 7f30f7afa640 1 -- 172.21.15.2:0/1105536387 shutdown_connections 2024-09-19T06:19:43.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.454+0000 7f30f7afa640 1 --2- 172.21.15.2:0/1105536387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30f0106f10 0x7f30f010ea90 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.454+0000 7f30f7afa640 1 --2- 172.21.15.2:0/1105536387 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30f0102790 0x7f30f01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.454+0000 7f30f7afa640 1 --2- 172.21.15.2:0/1105536387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30f0101de0 0x7f30f01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.454+0000 7f30f7afa640 1 -- 172.21.15.2:0/1105536387 >> 172.21.15.2:0/1105536387 conn(0x7f30f00fd8c0 msgr2=0x7f30f00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:43.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.454+0000 7f30f7afa640 1 -- 172.21.15.2:0/1105536387 shutdown_connections 2024-09-19T06:19:43.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.454+0000 7f30f7afa640 1 -- 172.21.15.2:0/1105536387 wait complete. 2024-09-19T06:19:43.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.454+0000 7f30f7afa640 1 Processor -- start 2024-09-19T06:19:43.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.455+0000 7f30f7afa640 1 -- start start 2024-09-19T06:19:43.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.455+0000 7f30f7afa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30f0101de0 0x7f30f019a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:43.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.455+0000 7f30f7afa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30f0102790 0x7f30f019aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:43.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.455+0000 7f30f7afa640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30f0106f10 0x7f30f019ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:43.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.455+0000 7f30f7afa640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f30f0111e20 con 0x7f30f0101de0 2024-09-19T06:19:43.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.455+0000 7f30f7afa640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f30f0111ca0 con 0x7f30f0102790 2024-09-19T06:19:43.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.455+0000 7f30f7afa640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f30f0111fa0 con 0x7f30f0106f10 2024-09-19T06:19:43.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.455+0000 7f30f5896640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30f0101de0 0x7f30f019a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:43.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.455+0000 7f30f5896640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30f0101de0 0x7f30f019a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59774/0 (socket says 172.21.15.2:59774) 2024-09-19T06:19:43.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.455+0000 7f30f5896640 1 -- 172.21.15.2:0/2307683256 learned_addr learned my addr 172.21.15.2:0/2307683256 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:43.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.455+0000 7f30f5095640 1 --2- 172.21.15.2:0/2307683256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30f0102790 0x7f30f019aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:43.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.455+0000 7f30f6097640 1 --2- 172.21.15.2:0/2307683256 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30f0106f10 0x7f30f019ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:43.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.455+0000 7f30f5896640 1 -- 172.21.15.2:0/2307683256 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30f0106f10 msgr2=0x7f30f019ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:43.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.455+0000 7f30f5896640 1 --2- 172.21.15.2:0/2307683256 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30f0106f10 0x7f30f019ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.455+0000 7f30f5896640 1 -- 172.21.15.2:0/2307683256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30f0102790 msgr2=0x7f30f019aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:43.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.455+0000 7f30f5896640 1 --2- 172.21.15.2:0/2307683256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30f0102790 0x7f30f019aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.455+0000 7f30f5896640 1 -- 172.21.15.2:0/2307683256 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f019f500 con 0x7f30f0101de0 2024-09-19T06:19:43.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.455+0000 7f30f6097640 1 --2- 172.21.15.2:0/2307683256 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30f0106f10 0x7f30f019ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:19:43.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.455+0000 7f30f5095640 1 --2- 172.21.15.2:0/2307683256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30f0102790 0x7f30f019aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:43.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.455+0000 7f30f5896640 1 --2- 172.21.15.2:0/2307683256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30f0101de0 0x7f30f019a550 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f30ec00e9f0 tx=0x7f30ec00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:43.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.456+0000 7f30e6ffd640 1 -- 172.21.15.2:0/2307683256 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec00cd80 con 0x7f30f0101de0 2024-09-19T06:19:43.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.456+0000 7f30e6ffd640 1 -- 172.21.15.2:0/2307683256 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f30ec0108e0 con 0x7f30f0101de0 2024-09-19T06:19:43.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.456+0000 7f30e6ffd640 1 -- 172.21.15.2:0/2307683256 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec018920 con 0x7f30f0101de0 2024-09-19T06:19:43.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.456+0000 7f30f7afa640 1 -- 172.21.15.2:0/2307683256 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30f019f7f0 con 0x7f30f0101de0 2024-09-19T06:19:43.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.456+0000 7f30f7afa640 1 -- 172.21.15.2:0/2307683256 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30f01a70d0 con 0x7f30f0101de0 2024-09-19T06:19:43.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.458+0000 7f30e6ffd640 1 -- 172.21.15.2:0/2307683256 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f30ec010a90 con 0x7f30f0101de0 2024-09-19T06:19:43.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.458+0000 7f30f9ed3740 1 Processor -- start 2024-09-19T06:19:43.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.458+0000 7f30f9ed3740 1 -- start start 2024-09-19T06:19:43.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.459+0000 7f30f9ed3740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b0f5acb4a0 0x55b0f5acb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:43.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.459+0000 7f30f9ed3740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b0f5acbdc0 0x55b0f5ad6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:43.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.459+0000 7f30f9ed3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0f5ad6680 0x55b0f5ad8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:43.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.459+0000 7f30f9ed3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b0f5a312e0 con 0x55b0f5ad6680 2024-09-19T06:19:43.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.459+0000 7f30f9ed3740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55b0f59d8ce0 con 0x55b0f5acb4a0 2024-09-19T06:19:43.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.459+0000 7f30f9ed3740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55b0f5a2d2a0 con 0x55b0f5acbdc0 2024-09-19T06:19:43.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.459+0000 7f30f5095640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0f5ad6680 0x55b0f5ad8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:43.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.459+0000 7f30f5095640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0f5ad6680 0x55b0f5ad8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59780/0 (socket says 172.21.15.2:59780) 2024-09-19T06:19:43.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.459+0000 7f30f5095640 1 -- 172.21.15.2:0/891561913 learned_addr learned my addr 172.21.15.2:0/891561913 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:43.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.459+0000 7f30f5896640 1 --2- 172.21.15.2:0/891561913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b0f5acbdc0 0x55b0f5ad6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:43.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.459+0000 7f30f6097640 1 --2- 172.21.15.2:0/891561913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b0f5acb4a0 0x55b0f5acb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:43.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.459+0000 7f30f5095640 1 -- 172.21.15.2:0/891561913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b0f5acbdc0 msgr2=0x55b0f5ad6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:43.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.459+0000 7f30f5095640 1 --2- 172.21.15.2:0/891561913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b0f5acbdc0 0x55b0f5ad6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.459+0000 7f30f5095640 1 -- 172.21.15.2:0/891561913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b0f5acb4a0 msgr2=0x55b0f5acb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:43.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.459+0000 7f30f5095640 1 --2- 172.21.15.2:0/891561913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b0f5acb4a0 0x55b0f5acb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.459+0000 7f30f5095640 1 -- 172.21.15.2:0/891561913 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0f59bd440 con 0x55b0f5ad6680 2024-09-19T06:19:43.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.459+0000 7f30f6097640 1 --2- 172.21.15.2:0/891561913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b0f5acb4a0 0x55b0f5acb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:43.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.459+0000 7f30e6ffd640 1 --2- 172.21.15.2:0/2307683256 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f30dc0a3430 0x7f30dc0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:43.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.460+0000 7f30f5095640 1 --2- 172.21.15.2:0/891561913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0f5ad6680 0x55b0f5ad8a70 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f30e0011470 tx=0x7f30e0011930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=911ee2ebc10ebc9f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:43.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.460+0000 7f30f6097640 1 --2- 172.21.15.2:0/2307683256 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f30dc0a3430 0x7f30dc0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:43.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.460+0000 7f30e6ffd640 1 -- 172.21.15.2:0/2307683256 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f30ec0d0020 con 0x7f30f0101de0 2024-09-19T06:19:43.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.460+0000 7f30dbfff640 1 -- 172.21.15.2:0/891561913 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e001e070 con 0x55b0f5ad6680 2024-09-19T06:19:43.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.460+0000 7f30dbfff640 1 -- 172.21.15.2:0/891561913 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f30e00035f0 con 0x55b0f5ad6680 2024-09-19T06:19:43.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.460+0000 7f30dbfff640 1 -- 172.21.15.2:0/891561913 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e000f860 con 0x55b0f5ad6680 2024-09-19T06:19:43.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.461+0000 7f30f9ed3740 1 -- 172.21.15.2:0/891561913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0f5ad6680 msgr2=0x55b0f5ad8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:43.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.461+0000 7f30f9ed3740 1 --2- 172.21.15.2:0/891561913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0f5ad6680 0x55b0f5ad8a70 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f30e0011470 tx=0x7f30e0011930 comp rx=0 tx=0).stop 2024-09-19T06:19:43.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.461+0000 7f30f6097640 1 --2- 172.21.15.2:0/2307683256 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f30dc0a3430 0x7f30dc0a58f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f30e8004af0 tx=0x7f30e8005f80 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:43.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.461+0000 7f30f9ed3740 1 -- 172.21.15.2:0/891561913 shutdown_connections 2024-09-19T06:19:43.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.461+0000 7f30f9ed3740 1 --2- 172.21.15.2:0/891561913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0f5ad6680 0x55b0f5ad8a70 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.461+0000 7f30f9ed3740 1 --2- 172.21.15.2:0/891561913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b0f5acbdc0 0x55b0f5ad6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.461+0000 7f30f9ed3740 1 --2- 172.21.15.2:0/891561913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b0f5acb4a0 0x55b0f5acb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.461+0000 7f30f9ed3740 1 -- 172.21.15.2:0/891561913 >> 172.21.15.2:0/891561913 conn(0x55b0f5ac7a30 msgr2=0x55b0f5ac7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:43.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.461+0000 7f30f9ed3740 1 -- 172.21.15.2:0/891561913 shutdown_connections 2024-09-19T06:19:43.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.461+0000 7f30f9ed3740 1 -- 172.21.15.2:0/891561913 wait complete. 2024-09-19T06:19:43.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.461+0000 7f30f9ed3740 1 -- start start 2024-09-19T06:19:43.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.461+0000 7f30f9ed3740 1 Processor -- start 2024-09-19T06:19:43.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.462+0000 7f30f9ed3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0f5acb4a0 0x55b0f5ad5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:43.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.462+0000 7f30f9ed3740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b0f5acbdc0 0x55b0f5ad3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:43.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.462+0000 7f30f9ed3740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b0f5ad6680 0x55b0f5ad3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:43.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.462+0000 7f30f9ed3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b0f5ad9250 con 0x55b0f5acb4a0 2024-09-19T06:19:43.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.462+0000 7f30f9ed3740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55b0f59ec050 con 0x55b0f5acbdc0 2024-09-19T06:19:43.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.462+0000 7f30f9ed3740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55b0f5ad93d0 con 0x55b0f5ad6680 2024-09-19T06:19:43.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.462+0000 7f30f9ed3740 10 client.0 _ll_register_callbacks cb 0x55b0f5a2c160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:43.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.462+0000 7f30f5896640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0f5acb4a0 0x55b0f5ad5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:43.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.462+0000 7f30f5896640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0f5acb4a0 0x55b0f5ad5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59786/0 (socket says 172.21.15.2:59786) 2024-09-19T06:19:43.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.462+0000 7f30f5896640 1 -- 172.21.15.2:0/2137934339 learned_addr learned my addr 172.21.15.2:0/2137934339 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:43.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.462+0000 7f30f6097640 1 --2- 172.21.15.2:0/2137934339 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b0f5ad6680 0x55b0f5ad3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:43.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.462+0000 7f30f5095640 1 --2- 172.21.15.2:0/2137934339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b0f5acbdc0 0x55b0f5ad3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:43.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.462+0000 7f30f5896640 1 -- 172.21.15.2:0/2137934339 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b0f5ad6680 msgr2=0x55b0f5ad3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:43.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.462+0000 7f30f5896640 1 --2- 172.21.15.2:0/2137934339 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b0f5ad6680 0x55b0f5ad3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.462+0000 7f30f5896640 1 -- 172.21.15.2:0/2137934339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b0f5acbdc0 msgr2=0x55b0f5ad3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:43.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.462+0000 7f30f5896640 1 --2- 172.21.15.2:0/2137934339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b0f5acbdc0 0x55b0f5ad3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.462+0000 7f30f5896640 1 -- 172.21.15.2:0/2137934339 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0f57a23c0 con 0x55b0f5acb4a0 2024-09-19T06:19:43.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.462+0000 7f30f5095640 1 --2- 172.21.15.2:0/2137934339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b0f5acbdc0 0x55b0f5ad3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:19:43.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.462+0000 7f30f5896640 1 --2- 172.21.15.2:0/2137934339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0f5acb4a0 0x55b0f5ad5f70 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f30ec00c6a0 tx=0x7f30ec009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d91721c096f8b250 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:43.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.462+0000 7f30d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:19:43.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.462+0000 7f30d97fa640 1 -- 172.21.15.2:0/2137934339 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec09bc90 con 0x55b0f5acb4a0 2024-09-19T06:19:43.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.462+0000 7f30d97fa640 1 -- 172.21.15.2:0/2137934339 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f30ec0d20f0 con 0x55b0f5acb4a0 2024-09-19T06:19:43.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.463+0000 7f30f9ed3740 1 -- 172.21.15.2:0/2137934339 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30e00035f0 con 0x55b0f5acb4a0 2024-09-19T06:19:43.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.463+0000 7f30d97fa640 1 -- 172.21.15.2:0/2137934339 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f30ec010de0 con 0x55b0f5acb4a0 2024-09-19T06:19:43.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.463+0000 7f30f9ed3740 10 client.16428 fetch_fsmap learned FSMap version 26 2024-09-19T06:19:43.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.463+0000 7f30f9ed3740 1 -- 172.21.15.2:0/2137934339 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b0f5ae4bc0 con 0x55b0f5acb4a0 2024-09-19T06:19:43.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.463+0000 7f30d97fa640 1 -- 172.21.15.2:0/2137934339 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f30e00035f0 con 0x55b0f5acb4a0 2024-09-19T06:19:43.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.463+0000 7f30d97fa640 1 -- 172.21.15.2:0/2137934339 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f30ec09b780 con 0x55b0f5acb4a0 2024-09-19T06:19:43.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.463+0000 7f30f9ed3740 10 client.16428 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:19:43.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.463+0000 7f30f9ed3740 10 client.16428 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:19:43.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.463+0000 7f30f9ed3740 20 client.16428 populate_metadata read hostname 'smithi002' 2024-09-19T06:19:43.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.463+0000 7f30f9ed3740 1 --2- 172.21.15.2:0/2137934339 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55b0f5ae5fd0 0x55b0f5ae8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:43.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.463+0000 7f30f9ed3740 4 client.16428 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:19:43.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.463+0000 7f30f9ed3740 1 -- 172.21.15.2:0/2137934339 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b0f5a3e850 con 0x55b0f5ae5fd0 2024-09-19T06:19:43.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.463+0000 7f30f5095640 1 --2- 172.21.15.2:0/2137934339 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55b0f5ae5fd0 0x55b0f5ae8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:43.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.464+0000 7f30d97fa640 10 client.16428 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:19:43.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.464+0000 7f30f5095640 1 --2- 172.21.15.2:0/2137934339 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55b0f5ae5fd0 0x55b0f5ae8420 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba832f528b25b1da server_cookie=879038657c8e9470 in_seq=0 out_seq=0 2024-09-19T06:19:43.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.464+0000 7f30d97fa640 1 -- 172.21.15.2:0/2137934339 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b0f5a3e850 con 0x55b0f5ae5fd0 2024-09-19T06:19:43.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.464+0000 7f30d97fa640 10 client.16428 handle_command_reply: tid=0 2024-09-19T06:19:43.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.465+0000 7f30f9ed3740 1 client.16428 shutdown 2024-09-19T06:19:43.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.465+0000 7f30f9ed3740 1 -- 172.21.15.2:0/2137934339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0f5acb4a0 msgr2=0x55b0f5ad5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:43.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.465+0000 7f30f9ed3740 1 --2- 172.21.15.2:0/2137934339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0f5acb4a0 0x55b0f5ad5f70 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f30ec00c6a0 tx=0x7f30ec009310 comp rx=0 tx=0).stop 2024-09-19T06:19:43.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.465+0000 7f30f9ed3740 1 -- 172.21.15.2:0/2137934339 shutdown_connections 2024-09-19T06:19:43.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.465+0000 7f30f9ed3740 1 --2- 172.21.15.2:0/2137934339 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b0f5ad6680 0x55b0f5ad3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.465+0000 7f30f9ed3740 1 --2- 172.21.15.2:0/2137934339 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55b0f5ae5fd0 0x55b0f5ae8420 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.465+0000 7f30f9ed3740 1 --2- 172.21.15.2:0/2137934339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b0f5acbdc0 0x55b0f5ad3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.465+0000 7f30f9ed3740 1 --2- 172.21.15.2:0/2137934339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0f5acb4a0 0x55b0f5ad5f70 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.465+0000 7f30f9ed3740 1 -- 172.21.15.2:0/2137934339 >> 172.21.15.2:0/2137934339 conn(0x55b0f5ac7a30 msgr2=0x55b0f5acd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:43.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.465+0000 7f30d97fa640 0 client.16428 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:19:43.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.465+0000 7f30f9ed3740 1 -- 172.21.15.2:0/2137934339 shutdown_connections 2024-09-19T06:19:43.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.465+0000 7f30f9ed3740 1 -- 172.21.15.2:0/2137934339 wait complete. 2024-09-19T06:19:43.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.465+0000 7f30f9ed3740 20 client.16428 trim_cache size 0 max 16384 2024-09-19T06:19:43.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.482+0000 7f30f9ed3740 1 Processor -- start 2024-09-19T06:19:43.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.482+0000 7f30f9ed3740 1 -- start start 2024-09-19T06:19:43.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.482+0000 7f30f9ed3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0f5acb4a0 0x55b0f5ae24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:43.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.482+0000 7f30f9ed3740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b0f5acbdc0 0x55b0f5aedc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:43.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.482+0000 7f30f9ed3740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b0f5ad6680 0x55b0f5aee1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:43.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.482+0000 7f30f9ed3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f30f01b2300 con 0x55b0f5acb4a0 2024-09-19T06:19:43.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.482+0000 7f30f9ed3740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f30f01afbd0 con 0x55b0f5acbdc0 2024-09-19T06:19:43.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.482+0000 7f30f9ed3740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f30f01ada20 con 0x55b0f5ad6680 2024-09-19T06:19:43.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.482+0000 7f30f5896640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0f5acb4a0 0x55b0f5ae24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:43.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.482+0000 7f30f5896640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0f5acb4a0 0x55b0f5ae24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59794/0 (socket says 172.21.15.2:59794) 2024-09-19T06:19:43.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.482+0000 7f30f5896640 1 -- 172.21.15.2:0/3689034519 learned_addr learned my addr 172.21.15.2:0/3689034519 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:43.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.482+0000 7f30f5896640 1 -- 172.21.15.2:0/3689034519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b0f5ad6680 msgr2=0x55b0f5aee1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:43.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.482+0000 7f30f5896640 1 --2- 172.21.15.2:0/3689034519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b0f5ad6680 0x55b0f5aee1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.482+0000 7f30f5896640 1 -- 172.21.15.2:0/3689034519 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b0f5acbdc0 msgr2=0x55b0f5aedc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:43.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.482+0000 7f30f5896640 1 --2- 172.21.15.2:0/3689034519 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b0f5acbdc0 0x55b0f5aedc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.483+0000 7f30f5896640 1 -- 172.21.15.2:0/3689034519 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0f5ad62e0 con 0x55b0f5acb4a0 2024-09-19T06:19:43.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.483+0000 7f30f5896640 1 --2- 172.21.15.2:0/3689034519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0f5acb4a0 0x55b0f5ae24b0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f30ec09c2c0 tx=0x7f30ec09bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0fe40cca4ab1989 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:43.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.483+0000 7f30db7fe640 1 -- 172.21.15.2:0/3689034519 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec09c100 con 0x55b0f5acb4a0 2024-09-19T06:19:43.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.483+0000 7f30db7fe640 1 -- 172.21.15.2:0/3689034519 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f30ec09ca30 con 0x55b0f5acb4a0 2024-09-19T06:19:43.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.483+0000 7f30db7fe640 1 -- 172.21.15.2:0/3689034519 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec09b780 con 0x55b0f5acb4a0 2024-09-19T06:19:43.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.483+0000 7f30f9ed3740 1 -- 172.21.15.2:0/3689034519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0f5acb4a0 msgr2=0x55b0f5ae24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:43.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.483+0000 7f30f9ed3740 1 --2- 172.21.15.2:0/3689034519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0f5acb4a0 0x55b0f5ae24b0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f30ec09c2c0 tx=0x7f30ec09bbe0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.483+0000 7f30f9ed3740 1 -- 172.21.15.2:0/3689034519 shutdown_connections 2024-09-19T06:19:43.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.483+0000 7f30f9ed3740 1 --2- 172.21.15.2:0/3689034519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b0f5ad6680 0x55b0f5aee1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.483+0000 7f30f9ed3740 1 --2- 172.21.15.2:0/3689034519 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b0f5acbdc0 0x55b0f5aedc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.483+0000 7f30f9ed3740 1 --2- 172.21.15.2:0/3689034519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0f5acb4a0 0x55b0f5ae24b0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.483+0000 7f30f9ed3740 1 -- 172.21.15.2:0/3689034519 >> 172.21.15.2:0/3689034519 conn(0x55b0f5ac7a30 msgr2=0x55b0f5ad1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:43.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.483+0000 7f30f9ed3740 1 -- 172.21.15.2:0/3689034519 shutdown_connections 2024-09-19T06:19:43.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.484+0000 7f30f9ed3740 1 -- 172.21.15.2:0/3689034519 wait complete. 2024-09-19T06:19:43.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.484+0000 7f30f9ed3740 1 -- start start 2024-09-19T06:19:43.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.484+0000 7f30f9ed3740 1 Processor -- start 2024-09-19T06:19:43.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.484+0000 7f30f9ed3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0f5acb4a0 0x55b0f5ada320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:43.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.484+0000 7f30f9ed3740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b0f5acbdc0 0x55b0f5ada860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:43.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.484+0000 7f30f9ed3740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b0f5ad6680 0x55b0f5adada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:43.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.484+0000 7f30f9ed3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f30f01ae090 con 0x55b0f5acb4a0 2024-09-19T06:19:43.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.484+0000 7f30f9ed3740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f30f01af500 con 0x55b0f5ad6680 2024-09-19T06:19:43.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.484+0000 7f30f9ed3740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f30f01ae760 con 0x55b0f5acbdc0 2024-09-19T06:19:43.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.484+0000 7f30f9ed3740 10 client.0 _ll_register_callbacks cb 0x7f30ec0d3860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:43.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.484+0000 7f30f5896640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0f5acb4a0 0x55b0f5ada320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:43.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.484+0000 7f30f5896640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0f5acb4a0 0x55b0f5ada320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59810/0 (socket says 172.21.15.2:59810) 2024-09-19T06:19:43.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.484+0000 7f30f5896640 1 -- 172.21.15.2:0/12747222 learned_addr learned my addr 172.21.15.2:0/12747222 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:43.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.485+0000 7f30f6097640 1 --2- 172.21.15.2:0/12747222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b0f5ad6680 0x55b0f5adada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:43.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.485+0000 7f30f5095640 1 --2- 172.21.15.2:0/12747222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b0f5acbdc0 0x55b0f5ada860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:43.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.485+0000 7f30f5896640 1 -- 172.21.15.2:0/12747222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b0f5acbdc0 msgr2=0x55b0f5ada860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:43.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.485+0000 7f30f5896640 1 --2- 172.21.15.2:0/12747222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b0f5acbdc0 0x55b0f5ada860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.485+0000 7f30f5896640 1 -- 172.21.15.2:0/12747222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b0f5ad6680 msgr2=0x55b0f5adada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:43.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.485+0000 7f30f5896640 1 --2- 172.21.15.2:0/12747222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b0f5ad6680 0x55b0f5adada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.485+0000 7f30f5896640 1 -- 172.21.15.2:0/12747222 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0f5b4fc60 con 0x55b0f5acb4a0 2024-09-19T06:19:43.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.485+0000 7f30f6097640 1 --2- 172.21.15.2:0/12747222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b0f5ad6680 0x55b0f5adada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:19:43.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.485+0000 7f30f5896640 1 --2- 172.21.15.2:0/12747222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0f5acb4a0 0x55b0f5ada320 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f30ec0097b0 tx=0x7f30ec0d3610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f80522b252412fa4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:43.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.485+0000 7f30d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:19:43.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.485+0000 7f30d97fa640 1 -- 172.21.15.2:0/12747222 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec09c100 con 0x55b0f5acb4a0 2024-09-19T06:19:43.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.485+0000 7f30d97fa640 1 -- 172.21.15.2:0/12747222 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f30ec010430 con 0x55b0f5acb4a0 2024-09-19T06:19:43.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.485+0000 7f30f9ed3740 1 -- 172.21.15.2:0/12747222 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30ec09ca30 con 0x55b0f5acb4a0 2024-09-19T06:19:43.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.485+0000 7f30d97fa640 1 -- 172.21.15.2:0/12747222 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f30ec0bc420 con 0x55b0f5acb4a0 2024-09-19T06:19:43.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.485+0000 7f30f9ed3740 10 client.16434 fetch_fsmap learned FSMap version 26 2024-09-19T06:19:43.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.485+0000 7f30f9ed3740 1 -- 172.21.15.2:0/12747222 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b0f5b50ef0 con 0x55b0f5acb4a0 2024-09-19T06:19:43.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.485+0000 7f30d97fa640 1 -- 172.21.15.2:0/12747222 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f30ec09ca30 con 0x55b0f5acb4a0 2024-09-19T06:19:43.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.486+0000 7f30d97fa640 1 -- 172.21.15.2:0/12747222 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f30ec018ac0 con 0x55b0f5acb4a0 2024-09-19T06:19:43.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.486+0000 7f30f9ed3740 10 client.16434 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:19:43.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.486+0000 7f30f9ed3740 10 client.16434 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:19:43.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.486+0000 7f30f9ed3740 20 client.16434 populate_metadata read hostname 'smithi002' 2024-09-19T06:19:43.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.486+0000 7f30f9ed3740 1 --2- 172.21.15.2:0/12747222 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55b0f5b51320 0x55b0f5b53710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:43.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.486+0000 7f30f9ed3740 4 client.16434 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:19:43.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.486+0000 7f30f9ed3740 1 -- 172.21.15.2:0/12747222 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b0f5a38d60 con 0x55b0f5b51320 2024-09-19T06:19:43.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.486+0000 7f30f5095640 1 --2- 172.21.15.2:0/12747222 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55b0f5b51320 0x55b0f5b53710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:43.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.486+0000 7f30f5095640 1 --2- 172.21.15.2:0/12747222 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55b0f5b51320 0x55b0f5b53710 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90c4c53a09d010ce server_cookie=68a40e8db2e050fb in_seq=0 out_seq=0 2024-09-19T06:19:43.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.486+0000 7f30d97fa640 10 client.16434 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:19:43.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.486+0000 7f30d97fa640 1 -- 172.21.15.2:0/12747222 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55b0f5a38d60 con 0x55b0f5b51320 2024-09-19T06:19:43.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.486+0000 7f30d97fa640 10 client.16434 handle_command_reply: tid=0 2024-09-19T06:19:43.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.487+0000 7f30f9ed3740 1 client.16434 shutdown 2024-09-19T06:19:43.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.487+0000 7f30f9ed3740 1 -- 172.21.15.2:0/12747222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0f5acb4a0 msgr2=0x55b0f5ada320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:43.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.487+0000 7f30f9ed3740 1 --2- 172.21.15.2:0/12747222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0f5acb4a0 0x55b0f5ada320 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f30ec0097b0 tx=0x7f30ec0d3610 comp rx=0 tx=0).stop 2024-09-19T06:19:43.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.487+0000 7f30f9ed3740 1 -- 172.21.15.2:0/12747222 shutdown_connections 2024-09-19T06:19:43.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.487+0000 7f30f9ed3740 1 --2- 172.21.15.2:0/12747222 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55b0f5b51320 0x55b0f5b53710 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.487+0000 7f30f9ed3740 1 --2- 172.21.15.2:0/12747222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b0f5ad6680 0x55b0f5adada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.487+0000 7f30f9ed3740 1 --2- 172.21.15.2:0/12747222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b0f5acbdc0 0x55b0f5ada860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.487+0000 7f30f9ed3740 1 --2- 172.21.15.2:0/12747222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b0f5acb4a0 0x55b0f5ada320 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.487+0000 7f30d97fa640 0 client.16434 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:19:43.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.487+0000 7f30f9ed3740 1 -- 172.21.15.2:0/12747222 >> 172.21.15.2:0/12747222 conn(0x55b0f5ac7a30 msgr2=0x55b0f5ac6350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:43.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.487+0000 7f30f9ed3740 1 -- 172.21.15.2:0/12747222 shutdown_connections 2024-09-19T06:19:43.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.487+0000 7f30f9ed3740 1 -- 172.21.15.2:0/12747222 wait complete. 2024-09-19T06:19:43.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.487+0000 7f30f9ed3740 20 client.16434 trim_cache size 0 max 16384 2024-09-19T06:19:43.495 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:19:43.495 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T06:19:43.495 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T06:19:43.495 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:19:43.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.487+0000 7f30f7afa640 1 -- 172.21.15.2:0/2307683256 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f30dc0a3430 msgr2=0x7f30dc0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:43.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.487+0000 7f30f7afa640 1 --2- 172.21.15.2:0/2307683256 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f30dc0a3430 0x7f30dc0a58f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f30e8004af0 tx=0x7f30e8005f80 comp rx=0 tx=0).stop 2024-09-19T06:19:43.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.487+0000 7f30f7afa640 1 -- 172.21.15.2:0/2307683256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30f0101de0 msgr2=0x7f30f019a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:43.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.487+0000 7f30f7afa640 1 --2- 172.21.15.2:0/2307683256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30f0101de0 0x7f30f019a550 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f30ec00e9f0 tx=0x7f30ec00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.488+0000 7f30f7afa640 1 -- 172.21.15.2:0/2307683256 shutdown_connections 2024-09-19T06:19:43.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.488+0000 7f30f7afa640 1 --2- 172.21.15.2:0/2307683256 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f30dc0a3430 0x7f30dc0a58f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.488+0000 7f30f7afa640 1 --2- 172.21.15.2:0/2307683256 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30f0106f10 0x7f30f019ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.488+0000 7f30f7afa640 1 --2- 172.21.15.2:0/2307683256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30f0102790 0x7f30f019aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.488+0000 7f30f7afa640 1 --2- 172.21.15.2:0/2307683256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30f0101de0 0x7f30f019a550 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.488+0000 7f30f7afa640 1 -- 172.21.15.2:0/2307683256 >> 172.21.15.2:0/2307683256 conn(0x7f30f00fd8c0 msgr2=0x7f30f00fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:43.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.488+0000 7f30f7afa640 1 -- 172.21.15.2:0/2307683256 shutdown_connections 2024-09-19T06:19:43.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:43.488+0000 7f30f7afa640 1 -- 172.21.15.2:0/2307683256 wait complete. 2024-09-19T06:19:43.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:43 smithi002 ceph-mon[30982]: pgmap v150: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:19:43.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:43 smithi090 ceph-mon[34497]: pgmap v150: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:19:44.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:43 smithi089 ceph-mon[34160]: pgmap v150: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:19:44.375 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:19:44.375 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:19:44.636 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:19:45.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.128+0000 7fb9c228a640 1 -- 172.21.15.2:0/4213268153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9bc103660 msgr2=0x7fb9bc10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:45.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.128+0000 7fb9c228a640 1 --2- 172.21.15.2:0/4213268153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9bc103660 0x7fb9bc10bb50 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0009900 tx=0x7fb9b002a480 comp rx=0 tx=0).stop 2024-09-19T06:19:45.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.128+0000 7fb9c228a640 1 -- 172.21.15.2:0/4213268153 shutdown_connections 2024-09-19T06:19:45.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.128+0000 7fb9c228a640 1 --2- 172.21.15.2:0/4213268153 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9bc10c170 0x7fb9bc10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.128+0000 7fb9c228a640 1 --2- 172.21.15.2:0/4213268153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9bc103660 0x7fb9bc10bb50 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.128+0000 7fb9c228a640 1 --2- 172.21.15.2:0/4213268153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9bc102d40 0x7fb9bc103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.128+0000 7fb9c228a640 1 -- 172.21.15.2:0/4213268153 >> 172.21.15.2:0/4213268153 conn(0x7fb9bc0fc7a0 msgr2=0x7fb9bc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:45.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.128+0000 7fb9c228a640 1 -- 172.21.15.2:0/4213268153 shutdown_connections 2024-09-19T06:19:45.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.128+0000 7fb9c228a640 1 -- 172.21.15.2:0/4213268153 wait complete. 2024-09-19T06:19:45.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.129+0000 7fb9c228a640 1 Processor -- start 2024-09-19T06:19:45.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.129+0000 7fb9c228a640 1 -- start start 2024-09-19T06:19:45.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.129+0000 7fb9c228a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9bc102d40 0x7fb9bc19a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:45.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.129+0000 7fb9c228a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9bc103660 0x7fb9bc19ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:45.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.129+0000 7fb9c228a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9bc10c170 0x7fb9bc19eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:45.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.129+0000 7fb9c228a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb9bc111e20 con 0x7fb9bc102d40 2024-09-19T06:19:45.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.129+0000 7fb9c228a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb9bc111ca0 con 0x7fb9bc103660 2024-09-19T06:19:45.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.129+0000 7fb9c228a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb9bc111fa0 con 0x7fb9bc10c170 2024-09-19T06:19:45.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.129+0000 7fb9bbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9bc102d40 0x7fb9bc19a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:45.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.129+0000 7fb9bbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9bc102d40 0x7fb9bc19a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59826/0 (socket says 172.21.15.2:59826) 2024-09-19T06:19:45.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.129+0000 7fb9bbfff640 1 -- 172.21.15.2:0/2093413421 learned_addr learned my addr 172.21.15.2:0/2093413421 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:45.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.129+0000 7fb9bb7fe640 1 --2- 172.21.15.2:0/2093413421 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9bc103660 0x7fb9bc19ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:45.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.129+0000 7fb9c0827640 1 --2- 172.21.15.2:0/2093413421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9bc10c170 0x7fb9bc19eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:45.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.130+0000 7fb9bbfff640 1 -- 172.21.15.2:0/2093413421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9bc10c170 msgr2=0x7fb9bc19eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:45.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.130+0000 7fb9bbfff640 1 --2- 172.21.15.2:0/2093413421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9bc10c170 0x7fb9bc19eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.130+0000 7fb9bbfff640 1 -- 172.21.15.2:0/2093413421 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9bc103660 msgr2=0x7fb9bc19ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:45.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.130+0000 7fb9bbfff640 1 --2- 172.21.15.2:0/2093413421 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9bc103660 0x7fb9bc19ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.130+0000 7fb9bbfff640 1 -- 172.21.15.2:0/2093413421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9bc19f590 con 0x7fb9bc102d40 2024-09-19T06:19:45.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.130+0000 7fb9bbfff640 1 --2- 172.21.15.2:0/2093413421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9bc102d40 0x7fb9bc19a5e0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac00e9f0 tx=0x7fb9ac00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:45.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.130+0000 7fb9b97fa640 1 -- 172.21.15.2:0/2093413421 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac00cd80 con 0x7fb9bc102d40 2024-09-19T06:19:45.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.130+0000 7fb9c228a640 1 -- 172.21.15.2:0/2093413421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9bc19f880 con 0x7fb9bc102d40 2024-09-19T06:19:45.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.130+0000 7fb9b97fa640 1 -- 172.21.15.2:0/2093413421 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb9ac0108e0 con 0x7fb9bc102d40 2024-09-19T06:19:45.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.130+0000 7fb9b97fa640 1 -- 172.21.15.2:0/2093413421 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac018920 con 0x7fb9bc102d40 2024-09-19T06:19:45.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.130+0000 7fb9c228a640 1 -- 172.21.15.2:0/2093413421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9bc1a7160 con 0x7fb9bc102d40 2024-09-19T06:19:45.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.131+0000 7fb9c228a640 1 -- 172.21.15.2:0/2093413421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9bc103120 con 0x7fb9bc102d40 2024-09-19T06:19:45.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.133+0000 7fb9b97fa640 1 -- 172.21.15.2:0/2093413421 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fb9ac010a90 con 0x7fb9bc102d40 2024-09-19T06:19:45.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.133+0000 7fb9b97fa640 1 --2- 172.21.15.2:0/2093413421 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb9a40a33b0 0x7fb9a40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:45.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.133+0000 7fb9b97fa640 1 -- 172.21.15.2:0/2093413421 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fb9ac0d04a0 con 0x7fb9bc102d40 2024-09-19T06:19:45.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.133+0000 7fb9bb7fe640 1 --2- 172.21.15.2:0/2093413421 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb9a40a33b0 0x7fb9a40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:45.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.134+0000 7fb9bb7fe640 1 --2- 172.21.15.2:0/2093413421 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb9a40a33b0 0x7fb9a40a5870 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0031440 tx=0x7fb9b0005b50 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:45.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.137+0000 7fb9b97fa640 1 -- 172.21.15.2:0/2093413421 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb9ac09c860 con 0x7fb9bc102d40 2024-09-19T06:19:45.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.349+0000 7fb9c228a640 1 -- 172.21.15.2:0/2093413421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb9bc1a73d0 con 0x7fb9bc102d40 2024-09-19T06:19:45.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.350+0000 7fb9b97fa640 1 -- 172.21.15.2:0/2093413421 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11882 (secure 0 0 0) 0x7fb9ac0a0b60 con 0x7fb9bc102d40 2024-09-19T06:19:45.352 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:19:45.352 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-09-19T06:14:49:104280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:14:48.191083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24470,24472,24497]},"id":1}]} 2024-09-19T06:19:45.353 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-09-19T06:19:45.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.353+0000 7fb9c228a640 1 -- 172.21.15.2:0/2093413421 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb9a40a33b0 msgr2=0x7fb9a40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:45.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.353+0000 7fb9c228a640 1 --2- 172.21.15.2:0/2093413421 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb9a40a33b0 0x7fb9a40a5870 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0031440 tx=0x7fb9b0005b50 comp rx=0 tx=0).stop 2024-09-19T06:19:45.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.353+0000 7fb9c228a640 1 -- 172.21.15.2:0/2093413421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9bc102d40 msgr2=0x7fb9bc19a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:45.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.353+0000 7fb9c228a640 1 --2- 172.21.15.2:0/2093413421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9bc102d40 0x7fb9bc19a5e0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac00e9f0 tx=0x7fb9ac00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.353+0000 7fb9c228a640 1 -- 172.21.15.2:0/2093413421 shutdown_connections 2024-09-19T06:19:45.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.353+0000 7fb9c228a640 1 --2- 172.21.15.2:0/2093413421 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb9a40a33b0 0x7fb9a40a5870 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.353+0000 7fb9c228a640 1 --2- 172.21.15.2:0/2093413421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9bc10c170 0x7fb9bc19eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.353+0000 7fb9c228a640 1 --2- 172.21.15.2:0/2093413421 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9bc103660 0x7fb9bc19ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.353+0000 7fb9c228a640 1 --2- 172.21.15.2:0/2093413421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9bc102d40 0x7fb9bc19a5e0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.353+0000 7fb9c228a640 1 -- 172.21.15.2:0/2093413421 >> 172.21.15.2:0/2093413421 conn(0x7fb9bc0fc7a0 msgr2=0x7fb9bc101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:45.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.353+0000 7fb9c228a640 1 -- 172.21.15.2:0/2093413421 shutdown_connections 2024-09-19T06:19:45.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:45.353+0000 7fb9c228a640 1 -- 172.21.15.2:0/2093413421 wait complete. 2024-09-19T06:19:45.674 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:45 smithi002 ceph-mon[30982]: pgmap v151: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:19:45.674 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:45 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/2093413421' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:19:45.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:45 smithi090 ceph-mon[34497]: pgmap v151: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:19:45.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:45 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/2093413421' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:19:46.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:45 smithi089 ceph-mon[34160]: pgmap v151: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:19:46.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:45 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/2093413421' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:19:46.110 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:19:46.371 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:19:46.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.794+0000 7f9f223f2640 1 -- 172.21.15.2:0/903610968 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f1c06a370 msgr2=0x7f9f1c1009c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:46.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.794+0000 7f9f223f2640 1 --2- 172.21.15.2:0/903610968 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f1c06a370 0x7f9f1c1009c0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f9f10009900 tx=0x7f9f1002a410 comp rx=0 tx=0).stop 2024-09-19T06:19:46.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.794+0000 7f9f223f2640 1 -- 172.21.15.2:0/903610968 shutdown_connections 2024-09-19T06:19:46.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.794+0000 7f9f223f2640 1 --2- 172.21.15.2:0/903610968 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f1c104e80 0x7f9f1c105330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:46.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.794+0000 7f9f223f2640 1 --2- 172.21.15.2:0/903610968 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f1c06a370 0x7f9f1c1009c0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:46.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.794+0000 7f9f223f2640 1 --2- 172.21.15.2:0/903610968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f1c069f00 0x7f9f1c100480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:46.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.794+0000 7f9f223f2640 1 -- 172.21.15.2:0/903610968 >> 172.21.15.2:0/903610968 conn(0x7f9f1c077210 msgr2=0x7f9f1c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:46.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.794+0000 7f9f223f2640 1 -- 172.21.15.2:0/903610968 shutdown_connections 2024-09-19T06:19:46.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.794+0000 7f9f223f2640 1 -- 172.21.15.2:0/903610968 wait complete. 2024-09-19T06:19:46.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.795+0000 7f9f223f2640 1 Processor -- start 2024-09-19T06:19:46.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.795+0000 7f9f223f2640 1 -- start start 2024-09-19T06:19:46.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.795+0000 7f9f223f2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f1c069f00 0x7f9f1c196fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:46.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.795+0000 7f9f223f2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f1c06a370 0x7f9f1c197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:46.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.795+0000 7f9f223f2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f1c104e80 0x7f9f1c197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:46.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.795+0000 7f9f223f2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1c110d60 con 0x7f9f1c104e80 2024-09-19T06:19:46.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.795+0000 7f9f223f2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1c110be0 con 0x7f9f1c06a370 2024-09-19T06:19:46.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.795+0000 7f9f223f2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1c110ee0 con 0x7f9f1c069f00 2024-09-19T06:19:46.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.795+0000 7f9f2098f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f1c104e80 0x7f9f1c197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:46.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.795+0000 7f9f2098f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f1c104e80 0x7f9f1c197a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53342/0 (socket says 172.21.15.2:53342) 2024-09-19T06:19:46.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.795+0000 7f9f2098f640 1 -- 172.21.15.2:0/3944023913 learned_addr learned my addr 172.21.15.2:0/3944023913 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:46.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.795+0000 7f9f1bfff640 1 --2- 172.21.15.2:0/3944023913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f1c069f00 0x7f9f1c196fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:46.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.796+0000 7f9f1b7fe640 1 --2- 172.21.15.2:0/3944023913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f1c06a370 0x7f9f1c197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:46.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.796+0000 7f9f2098f640 1 -- 172.21.15.2:0/3944023913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f1c069f00 msgr2=0x7f9f1c196fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:46.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.796+0000 7f9f2098f640 1 --2- 172.21.15.2:0/3944023913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f1c069f00 0x7f9f1c196fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:46.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.796+0000 7f9f2098f640 1 -- 172.21.15.2:0/3944023913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f1c06a370 msgr2=0x7f9f1c197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:46.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.796+0000 7f9f2098f640 1 --2- 172.21.15.2:0/3944023913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f1c06a370 0x7f9f1c197500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:46.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.796+0000 7f9f2098f640 1 -- 172.21.15.2:0/3944023913 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f1c1a6830 con 0x7f9f1c104e80 2024-09-19T06:19:46.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.796+0000 7f9f2098f640 1 --2- 172.21.15.2:0/3944023913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f1c104e80 0x7f9f1c197a40 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f9f1400eaa0 tx=0x7f9f1400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:46.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.796+0000 7f9f197fa640 1 -- 172.21.15.2:0/3944023913 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1400cdb0 con 0x7f9f1c104e80 2024-09-19T06:19:46.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.796+0000 7f9f223f2640 1 -- 172.21.15.2:0/3944023913 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f1c1a6b20 con 0x7f9f1c104e80 2024-09-19T06:19:46.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.796+0000 7f9f197fa640 1 -- 172.21.15.2:0/3944023913 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9f14005020 con 0x7f9f1c104e80 2024-09-19T06:19:46.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.796+0000 7f9f197fa640 1 -- 172.21.15.2:0/3944023913 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f140116d0 con 0x7f9f1c104e80 2024-09-19T06:19:46.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.796+0000 7f9f223f2640 1 -- 172.21.15.2:0/3944023913 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f1c1a7080 con 0x7f9f1c104e80 2024-09-19T06:19:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.799+0000 7f9f197fa640 1 -- 172.21.15.2:0/3944023913 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f9f140051d0 con 0x7f9f1c104e80 2024-09-19T06:19:46.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.799+0000 7f9f247cb740 1 Processor -- start 2024-09-19T06:19:46.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.799+0000 7f9f247cb740 1 -- start start 2024-09-19T06:19:46.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.799+0000 7f9f247cb740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557948c2fb40 0x557948c2e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:46.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.799+0000 7f9f247cb740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557948c2e5d0 0x557948c2ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:46.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.799+0000 7f9f247cb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557948c39370 0x557948c3b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:46.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.799+0000 7f9f247cb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557948b942f0 con 0x557948c39370 2024-09-19T06:19:46.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.799+0000 7f9f247cb740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x557948b3bcf0 con 0x557948c2fb40 2024-09-19T06:19:46.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.799+0000 7f9f247cb740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x557948b902b0 con 0x557948c2e5d0 2024-09-19T06:19:46.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.800+0000 7f9f1b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557948c39370 0x557948c3b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:46.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.800+0000 7f9f197fa640 1 --2- 172.21.15.2:0/3944023913 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9f040a33b0 0x7f9f040a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:46.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.800+0000 7f9f1b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557948c39370 0x557948c3b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53350/0 (socket says 172.21.15.2:53350) 2024-09-19T06:19:46.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.800+0000 7f9f1b7fe640 1 -- 172.21.15.2:0/3111422011 learned_addr learned my addr 172.21.15.2:0/3111422011 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:46.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.800+0000 7f9f1bfff640 1 --2- 172.21.15.2:0/3111422011 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557948c2e5d0 0x557948c2ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:46.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.800+0000 7f9f1b7fe640 1 --2- 172.21.15.2:0/3111422011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557948c2fb40 0x557948c2e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:46.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.800+0000 7f9f2098f640 1 --2- 172.21.15.2:0/3944023913 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9f040a33b0 0x7f9f040a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:46.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.800+0000 7f9f197fa640 1 -- 172.21.15.2:0/3944023913 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f9f140cfd50 con 0x7f9f1c104e80 2024-09-19T06:19:46.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.800+0000 7f9f1bfff640 1 -- 172.21.15.2:0/3111422011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557948c2fb40 msgr2=0x557948c2e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:46.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.800+0000 7f9f1bfff640 1 --2- 172.21.15.2:0/3111422011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557948c2fb40 0x557948c2e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:46.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.800+0000 7f9f1bfff640 1 -- 172.21.15.2:0/3111422011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557948c39370 msgr2=0x557948c3b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:46.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.800+0000 7f9f1bfff640 1 --2- 172.21.15.2:0/3111422011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557948c39370 0x557948c3b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:46.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.800+0000 7f9f1bfff640 1 -- 172.21.15.2:0/3111422011 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557948b203a0 con 0x557948c2e5d0 2024-09-19T06:19:46.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.800+0000 7f9f1b7fe640 1 --2- 172.21.15.2:0/3111422011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557948c2fb40 0x557948c2e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:19:46.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.800+0000 7f9f1bfff640 1 --2- 172.21.15.2:0/3111422011 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557948c2e5d0 0x557948c2ea10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c00bbf0 tx=0x7f9f0c0107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a9fd9f99ec1643c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:46.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.800+0000 7f9f2098f640 1 --2- 172.21.15.2:0/3944023913 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9f040a33b0 0x7f9f040a5870 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9f140cd580 tx=0x7f9f1406ef40 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:46.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.800+0000 7f9f027fc640 1 -- 172.21.15.2:0/3111422011 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c004030 con 0x557948c2e5d0 2024-09-19T06:19:46.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.801+0000 7f9f027fc640 1 -- 172.21.15.2:0/3111422011 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9f0c0035f0 con 0x557948c2e5d0 2024-09-19T06:19:46.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.801+0000 7f9f027fc640 1 -- 172.21.15.2:0/3111422011 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c0116a0 con 0x557948c2e5d0 2024-09-19T06:19:46.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.801+0000 7f9f247cb740 1 -- 172.21.15.2:0/3111422011 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557948c2e5d0 msgr2=0x557948c2ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:46.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.801+0000 7f9f247cb740 1 --2- 172.21.15.2:0/3111422011 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557948c2e5d0 0x557948c2ea10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c00bbf0 tx=0x7f9f0c0107a0 comp rx=0 tx=0).stop 2024-09-19T06:19:46.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.801+0000 7f9f247cb740 1 -- 172.21.15.2:0/3111422011 shutdown_connections 2024-09-19T06:19:46.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.801+0000 7f9f247cb740 1 --2- 172.21.15.2:0/3111422011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557948c39370 0x557948c3b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:46.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.801+0000 7f9f247cb740 1 --2- 172.21.15.2:0/3111422011 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557948c2e5d0 0x557948c2ea10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:46.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.801+0000 7f9f247cb740 1 --2- 172.21.15.2:0/3111422011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557948c2fb40 0x557948c2e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:46.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.801+0000 7f9f247cb740 1 -- 172.21.15.2:0/3111422011 >> 172.21.15.2:0/3111422011 conn(0x557948bf7310 msgr2=0x557948c2ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:46.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.801+0000 7f9f247cb740 1 -- 172.21.15.2:0/3111422011 shutdown_connections 2024-09-19T06:19:46.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.801+0000 7f9f247cb740 1 -- 172.21.15.2:0/3111422011 wait complete. 2024-09-19T06:19:46.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.802+0000 7f9f247cb740 1 -- start start 2024-09-19T06:19:46.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.802+0000 7f9f247cb740 1 Processor -- start 2024-09-19T06:19:46.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.802+0000 7f9f247cb740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557948c2e5d0 0x557948c38d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:46.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.802+0000 7f9f247cb740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557948c2fb40 0x557948c35ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:46.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.802+0000 7f9f247cb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557948c39370 0x557948c365e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:46.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.802+0000 7f9f247cb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557948c3c070 con 0x557948c39370 2024-09-19T06:19:46.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.802+0000 7f9f247cb740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x557948b4f060 con 0x557948c2fb40 2024-09-19T06:19:46.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.802+0000 7f9f247cb740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x557948c3c1f0 con 0x557948c2e5d0 2024-09-19T06:19:46.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.802+0000 7f9f247cb740 10 client.0 _ll_register_callbacks cb 0x5579488a28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:46.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.802+0000 7f9f1b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557948c39370 0x557948c365e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:46.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.802+0000 7f9f1b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557948c39370 0x557948c365e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53362/0 (socket says 172.21.15.2:53362) 2024-09-19T06:19:46.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.802+0000 7f9f1b7fe640 1 -- 172.21.15.2:0/3902269775 learned_addr learned my addr 172.21.15.2:0/3902269775 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:46.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.803+0000 7f9f1b7fe640 1 --2- 172.21.15.2:0/3902269775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557948c2e5d0 0x557948c38d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:46.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.803+0000 7f9f1bfff640 1 --2- 172.21.15.2:0/3902269775 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557948c2fb40 0x557948c35ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:46.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.803+0000 7f9f1b7fe640 1 -- 172.21.15.2:0/3902269775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557948c2e5d0 msgr2=0x557948c38d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:46.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.803+0000 7f9f1b7fe640 1 --2- 172.21.15.2:0/3902269775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557948c2e5d0 0x557948c38d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:46.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.803+0000 7f9f1b7fe640 1 -- 172.21.15.2:0/3902269775 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557948c2fb40 msgr2=0x557948c35ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.803+0000 7f9f1b7fe640 1 --2- 172.21.15.2:0/3902269775 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557948c2fb40 0x557948c35ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.803+0000 7f9f1b7fe640 1 -- 172.21.15.2:0/3902269775 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579489053c0 con 0x557948c39370 2024-09-19T06:19:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.803+0000 7f9f1b7fe640 1 --2- 172.21.15.2:0/3902269775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557948c39370 0x557948c365e0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f9f10000c00 tx=0x7f9f10041040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18a07f083f666cdf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.803+0000 7f9efb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:19:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.803+0000 7f9efb7fe640 1 -- 172.21.15.2:0/3902269775 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f10035070 con 0x557948c39370 2024-09-19T06:19:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.803+0000 7f9f247cb740 1 -- 172.21.15.2:0/3902269775 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f0c0035f0 con 0x557948c39370 2024-09-19T06:19:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.803+0000 7f9efb7fe640 1 -- 172.21.15.2:0/3902269775 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f9f10031d00 con 0x557948c39370 2024-09-19T06:19:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.803+0000 7f9efb7fe640 1 -- 172.21.15.2:0/3902269775 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9f10005850 con 0x557948c39370 2024-09-19T06:19:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.803+0000 7f9f247cb740 10 client.16452 fetch_fsmap learned FSMap version 26 2024-09-19T06:19:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.803+0000 7f9f247cb740 1 -- 172.21.15.2:0/3902269775 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557948c47b60 con 0x557948c39370 2024-09-19T06:19:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.804+0000 7f9efb7fe640 1 -- 172.21.15.2:0/3902269775 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9f0c0035f0 con 0x557948c39370 2024-09-19T06:19:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.804+0000 7f9efb7fe640 1 -- 172.21.15.2:0/3902269775 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f9f10003b50 con 0x557948c39370 2024-09-19T06:19:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.804+0000 7f9f247cb740 10 client.16452 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:19:46.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.804+0000 7f9f247cb740 10 client.16452 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:19:46.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.804+0000 7f9f247cb740 20 client.16452 populate_metadata read hostname 'smithi002' 2024-09-19T06:19:46.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.804+0000 7f9f247cb740 1 --2- 172.21.15.2:0/3902269775 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x557948c48f70 0x557948c4b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:46.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.804+0000 7f9f247cb740 4 client.16452 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:19:46.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.804+0000 7f9f247cb740 1 -- 172.21.15.2:0/3902269775 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557948ba1860 con 0x557948c48f70 2024-09-19T06:19:46.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.804+0000 7f9f1bfff640 1 --2- 172.21.15.2:0/3902269775 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x557948c48f70 0x557948c4b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:46.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.805+0000 7f9efb7fe640 10 client.16452 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:19:46.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.805+0000 7f9f1bfff640 1 --2- 172.21.15.2:0/3902269775 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x557948c48f70 0x557948c4b360 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2fc3924ae2655ef9 server_cookie=85b750217500a2e3 in_seq=0 out_seq=0 2024-09-19T06:19:46.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.805+0000 7f9efb7fe640 1 -- 172.21.15.2:0/3902269775 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557948ba1860 con 0x557948c48f70 2024-09-19T06:19:46.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.805+0000 7f9efb7fe640 10 client.16452 handle_command_reply: tid=0 2024-09-19T06:19:46.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.805+0000 7f9f247cb740 1 client.16452 shutdown 2024-09-19T06:19:46.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.806+0000 7f9f247cb740 1 -- 172.21.15.2:0/3902269775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557948c39370 msgr2=0x557948c365e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:46.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.806+0000 7f9f247cb740 1 --2- 172.21.15.2:0/3902269775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557948c39370 0x557948c365e0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f9f10000c00 tx=0x7f9f10041040 comp rx=0 tx=0).stop 2024-09-19T06:19:46.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.806+0000 7f9f247cb740 1 -- 172.21.15.2:0/3902269775 shutdown_connections 2024-09-19T06:19:46.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.806+0000 7f9f247cb740 1 --2- 172.21.15.2:0/3902269775 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x557948c48f70 0x557948c4b360 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:46.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.806+0000 7f9efb7fe640 0 client.16452 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:19:46.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.806+0000 7f9f247cb740 1 --2- 172.21.15.2:0/3902269775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557948c39370 0x557948c365e0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:46.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.806+0000 7f9f247cb740 1 --2- 172.21.15.2:0/3902269775 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557948c2fb40 0x557948c35ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:46.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.806+0000 7f9f247cb740 1 --2- 172.21.15.2:0/3902269775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557948c2e5d0 0x557948c38d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:46.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.806+0000 7f9f247cb740 1 -- 172.21.15.2:0/3902269775 >> 172.21.15.2:0/3902269775 conn(0x557948bf7310 msgr2=0x557948c30960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:46.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.806+0000 7f9f247cb740 1 -- 172.21.15.2:0/3902269775 shutdown_connections 2024-09-19T06:19:46.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.806+0000 7f9f247cb740 1 -- 172.21.15.2:0/3902269775 wait complete. 2024-09-19T06:19:46.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.806+0000 7f9f247cb740 20 client.16452 trim_cache size 0 max 16384 2024-09-19T06:19:46.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.819+0000 7f9f247cb740 1 Processor -- start 2024-09-19T06:19:46.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.819+0000 7f9f247cb740 1 -- start start 2024-09-19T06:19:46.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.819+0000 7f9f247cb740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557948c2e5d0 0x557948c37f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:46.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.819+0000 7f9f247cb740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557948c2fb40 0x557948c31120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:46.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.819+0000 7f9f247cb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557948c39370 0x557948c31660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:46.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.819+0000 7f9f247cb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1c1b2270 con 0x557948c39370 2024-09-19T06:19:46.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.819+0000 7f9f247cb740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1c1afb40 con 0x557948c2fb40 2024-09-19T06:19:46.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.819+0000 7f9f247cb740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1c1ad990 con 0x557948c2e5d0 2024-09-19T06:19:46.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.819+0000 7f9f1b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557948c39370 0x557948c31660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:46.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.819+0000 7f9f1b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557948c39370 0x557948c31660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53372/0 (socket says 172.21.15.2:53372) 2024-09-19T06:19:46.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.819+0000 7f9f1b7fe640 1 -- 172.21.15.2:0/685382885 learned_addr learned my addr 172.21.15.2:0/685382885 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:46.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.819+0000 7f9f1bfff640 1 --2- 172.21.15.2:0/685382885 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557948c2fb40 0x557948c31120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:46.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.819+0000 7f9f1b7fe640 1 -- 172.21.15.2:0/685382885 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557948c2e5d0 msgr2=0x557948c37f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:46.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.819+0000 7f9f1b7fe640 1 --2- 172.21.15.2:0/685382885 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557948c2e5d0 0x557948c37f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:46.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.819+0000 7f9f1b7fe640 1 -- 172.21.15.2:0/685382885 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557948c2fb40 msgr2=0x557948c31120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:46.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.819+0000 7f9f1b7fe640 1 --2- 172.21.15.2:0/685382885 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557948c2fb40 0x557948c31120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:46.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.819+0000 7f9f1b7fe640 1 -- 172.21.15.2:0/685382885 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557948c34540 con 0x557948c39370 2024-09-19T06:19:46.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.820+0000 7f9f1b7fe640 1 --2- 172.21.15.2:0/685382885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557948c39370 0x557948c31660 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f9f100323f0 tx=0x7f9f10005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7a4256f54a01a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:46.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.820+0000 7f9f01ffb640 1 -- 172.21.15.2:0/685382885 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1005b070 con 0x557948c39370 2024-09-19T06:19:46.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.820+0000 7f9f01ffb640 1 -- 172.21.15.2:0/685382885 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9f10004480 con 0x557948c39370 2024-09-19T06:19:46.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.820+0000 7f9f01ffb640 1 -- 172.21.15.2:0/685382885 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f10032850 con 0x557948c39370 2024-09-19T06:19:46.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.820+0000 7f9f247cb740 1 -- 172.21.15.2:0/685382885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557948c39370 msgr2=0x557948c31660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:46.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.820+0000 7f9f247cb740 1 --2- 172.21.15.2:0/685382885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557948c39370 0x557948c31660 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f9f100323f0 tx=0x7f9f10005fd0 comp rx=0 tx=0).stop 2024-09-19T06:19:46.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.821+0000 7f9f247cb740 1 -- 172.21.15.2:0/685382885 shutdown_connections 2024-09-19T06:19:46.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.821+0000 7f9f247cb740 1 --2- 172.21.15.2:0/685382885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557948c39370 0x557948c31660 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:46.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.821+0000 7f9f247cb740 1 --2- 172.21.15.2:0/685382885 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557948c2fb40 0x557948c31120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:46.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.821+0000 7f9f247cb740 1 --2- 172.21.15.2:0/685382885 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557948c2e5d0 0x557948c37f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:46.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.821+0000 7f9f247cb740 1 -- 172.21.15.2:0/685382885 >> 172.21.15.2:0/685382885 conn(0x557948bf7310 msgr2=0x557948c37850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:46.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.821+0000 7f9f247cb740 1 -- 172.21.15.2:0/685382885 shutdown_connections 2024-09-19T06:19:46.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.821+0000 7f9f247cb740 1 -- 172.21.15.2:0/685382885 wait complete. 2024-09-19T06:19:46.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.821+0000 7f9f247cb740 1 -- start start 2024-09-19T06:19:46.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.821+0000 7f9f247cb740 1 Processor -- start 2024-09-19T06:19:46.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.821+0000 7f9f247cb740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557948c2e5d0 0x557948c41c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.821+0000 7f9f247cb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557948c2fb40 0x557948c32df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.821+0000 7f9f247cb740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557948c39370 0x557948c33350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.821+0000 7f9f247cb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1c1ae000 con 0x557948c2fb40 2024-09-19T06:19:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.821+0000 7f9f247cb740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1c1af470 con 0x557948c39370 2024-09-19T06:19:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.821+0000 7f9f247cb740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1c1ae6d0 con 0x557948c2e5d0 2024-09-19T06:19:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.821+0000 7f9f247cb740 10 client.0 _ll_register_callbacks cb 0x7f9f10032df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.822+0000 7f9f1bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557948c2fb40 0x557948c32df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.822+0000 7f9f1bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557948c2fb40 0x557948c32df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53378/0 (socket says 172.21.15.2:53378) 2024-09-19T06:19:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.822+0000 7f9f1bfff640 1 -- 172.21.15.2:0/2916603103 learned_addr learned my addr 172.21.15.2:0/2916603103 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.822+0000 7f9f1b7fe640 1 --2- 172.21.15.2:0/2916603103 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557948c39370 0x557948c33350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.822+0000 7f9f1b7fe640 1 --2- 172.21.15.2:0/2916603103 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557948c2e5d0 0x557948c41c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.822+0000 7f9f1bfff640 1 -- 172.21.15.2:0/2916603103 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557948c2e5d0 msgr2=0x557948c41c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:46.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.822+0000 7f9f1bfff640 1 --2- 172.21.15.2:0/2916603103 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557948c2e5d0 0x557948c41c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:46.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.822+0000 7f9f1bfff640 1 -- 172.21.15.2:0/2916603103 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557948c39370 msgr2=0x557948c33350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:46.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.822+0000 7f9f1bfff640 1 --2- 172.21.15.2:0/2916603103 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557948c39370 0x557948c33350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:46.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.822+0000 7f9f1bfff640 1 -- 172.21.15.2:0/2916603103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557948c33b80 con 0x557948c2fb40 2024-09-19T06:19:46.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.822+0000 7f9f1bfff640 1 --2- 172.21.15.2:0/2916603103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557948c2fb40 0x557948c32df0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x557948c2bac0 tx=0x7f9f0c010fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=639c5a2c4d584323 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:46.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.822+0000 7f9efb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:19:46.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.822+0000 7f9efb7fe640 1 -- 172.21.15.2:0/2916603103 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c02c020 con 0x557948c2fb40 2024-09-19T06:19:46.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.822+0000 7f9efb7fe640 1 -- 172.21.15.2:0/2916603103 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f9f0c005240 con 0x557948c2fb40 2024-09-19T06:19:46.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.822+0000 7f9f247cb740 1 -- 172.21.15.2:0/2916603103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f10004480 con 0x557948c2fb40 2024-09-19T06:19:46.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.822+0000 7f9efb7fe640 1 -- 172.21.15.2:0/2916603103 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9f0c037050 con 0x557948c2fb40 2024-09-19T06:19:46.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.823+0000 7f9f247cb740 10 client.16458 fetch_fsmap learned FSMap version 26 2024-09-19T06:19:46.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.823+0000 7f9f247cb740 1 -- 172.21.15.2:0/2916603103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557948cb3bf0 con 0x557948c2fb40 2024-09-19T06:19:46.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.823+0000 7f9efb7fe640 1 -- 172.21.15.2:0/2916603103 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9f10004480 con 0x557948c2fb40 2024-09-19T06:19:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.823+0000 7f9efb7fe640 1 -- 172.21.15.2:0/2916603103 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f9f0c029430 con 0x557948c2fb40 2024-09-19T06:19:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.823+0000 7f9f247cb740 10 client.16458 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:19:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.823+0000 7f9f247cb740 10 client.16458 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:19:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.823+0000 7f9f247cb740 20 client.16458 populate_metadata read hostname 'smithi002' 2024-09-19T06:19:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.823+0000 7f9f247cb740 1 --2- 172.21.15.2:0/2916603103 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x557948c48f70 0x557948cb6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.823+0000 7f9f247cb740 4 client.16458 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:19:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.823+0000 7f9f247cb740 1 -- 172.21.15.2:0/2916603103 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557948b9bd70 con 0x557948c48f70 2024-09-19T06:19:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.823+0000 7f9f1b7fe640 1 --2- 172.21.15.2:0/2916603103 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x557948c48f70 0x557948cb6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.824+0000 7f9f1b7fe640 1 --2- 172.21.15.2:0/2916603103 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x557948c48f70 0x557948cb6180 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=57f08ee884aba982 server_cookie=11b8281e5bc38825 in_seq=0 out_seq=0 2024-09-19T06:19:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.824+0000 7f9efb7fe640 10 client.16458 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:19:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.824+0000 7f9efb7fe640 1 -- 172.21.15.2:0/2916603103 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557948b9bd70 con 0x557948c48f70 2024-09-19T06:19:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.824+0000 7f9efb7fe640 10 client.16458 handle_command_reply: tid=0 2024-09-19T06:19:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.824+0000 7f9f247cb740 1 client.16458 shutdown 2024-09-19T06:19:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.824+0000 7f9f247cb740 1 -- 172.21.15.2:0/2916603103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557948c2fb40 msgr2=0x557948c32df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:46.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.824+0000 7f9f247cb740 1 --2- 172.21.15.2:0/2916603103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557948c2fb40 0x557948c32df0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x557948c2bac0 tx=0x7f9f0c010fd0 comp rx=0 tx=0).stop 2024-09-19T06:19:46.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.824+0000 7f9f247cb740 1 -- 172.21.15.2:0/2916603103 shutdown_connections 2024-09-19T06:19:46.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.824+0000 7f9f247cb740 1 --2- 172.21.15.2:0/2916603103 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x557948c48f70 0x557948cb6180 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:46.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.824+0000 7f9f247cb740 1 --2- 172.21.15.2:0/2916603103 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557948c39370 0x557948c33350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:46.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.824+0000 7f9f247cb740 1 --2- 172.21.15.2:0/2916603103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557948c2fb40 0x557948c32df0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:46.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.824+0000 7f9efb7fe640 0 client.16458 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:19:46.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.824+0000 7f9f247cb740 1 --2- 172.21.15.2:0/2916603103 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557948c2e5d0 0x557948c41c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:46.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.824+0000 7f9f247cb740 1 -- 172.21.15.2:0/2916603103 >> 172.21.15.2:0/2916603103 conn(0x557948bf7310 msgr2=0x557948c38070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:46.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.824+0000 7f9f247cb740 1 -- 172.21.15.2:0/2916603103 shutdown_connections 2024-09-19T06:19:46.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.824+0000 7f9f247cb740 1 -- 172.21.15.2:0/2916603103 wait complete. 2024-09-19T06:19:46.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.825+0000 7f9f247cb740 20 client.16458 trim_cache size 0 max 16384 2024-09-19T06:19:46.831 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:19:46.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.825+0000 7f9f223f2640 1 -- 172.21.15.2:0/3944023913 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9f040a33b0 msgr2=0x7f9f040a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:46.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.825+0000 7f9f223f2640 1 --2- 172.21.15.2:0/3944023913 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9f040a33b0 0x7f9f040a5870 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9f140cd580 tx=0x7f9f1406ef40 comp rx=0 tx=0).stop 2024-09-19T06:19:46.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.825+0000 7f9f223f2640 1 -- 172.21.15.2:0/3944023913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f1c104e80 msgr2=0x7f9f1c197a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:46.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.825+0000 7f9f223f2640 1 --2- 172.21.15.2:0/3944023913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f1c104e80 0x7f9f1c197a40 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f9f1400eaa0 tx=0x7f9f1400ef60 comp rx=0 tx=0).stop 2024-09-19T06:19:46.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.825+0000 7f9f223f2640 1 -- 172.21.15.2:0/3944023913 shutdown_connections 2024-09-19T06:19:46.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.825+0000 7f9f223f2640 1 --2- 172.21.15.2:0/3944023913 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9f040a33b0 0x7f9f040a5870 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:46.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.825+0000 7f9f223f2640 1 --2- 172.21.15.2:0/3944023913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f1c104e80 0x7f9f1c197a40 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:46.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.825+0000 7f9f223f2640 1 --2- 172.21.15.2:0/3944023913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f1c06a370 0x7f9f1c197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:46.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.825+0000 7f9f223f2640 1 --2- 172.21.15.2:0/3944023913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f1c069f00 0x7f9f1c196fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:46.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.825+0000 7f9f223f2640 1 -- 172.21.15.2:0/3944023913 >> 172.21.15.2:0/3944023913 conn(0x7f9f1c077210 msgr2=0x7f9f1c102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:46.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.825+0000 7f9f223f2640 1 -- 172.21.15.2:0/3944023913 shutdown_connections 2024-09-19T06:19:46.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:46.825+0000 7f9f223f2640 1 -- 172.21.15.2:0/3944023913 wait complete. 2024-09-19T06:19:47.531 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:19:47.789 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:19:47.911 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:47 smithi002 ceph-mon[30982]: pgmap v152: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:19:47.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:47 smithi090 ceph-mon[34497]: pgmap v152: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:19:48.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:47 smithi089 ceph-mon[34160]: pgmap v152: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:19:48.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.261+0000 7f6a14b4c640 1 -- 172.21.15.2:0/3925525445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a1010c180 msgr2=0x7f6a1010e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:48.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.261+0000 7f6a14b4c640 1 --2- 172.21.15.2:0/3925525445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a1010c180 0x7f6a1010e600 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f6a08009ca0 tx=0x7f6a0802a950 comp rx=0 tx=0).stop 2024-09-19T06:19:48.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.261+0000 7f6a14b4c640 1 -- 172.21.15.2:0/3925525445 shutdown_connections 2024-09-19T06:19:48.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.261+0000 7f6a14b4c640 1 --2- 172.21.15.2:0/3925525445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a1010c180 0x7f6a1010e600 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:48.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.261+0000 7f6a14b4c640 1 --2- 172.21.15.2:0/3925525445 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a101036c0 0x7f6a1010bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:48.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.261+0000 7f6a14b4c640 1 --2- 172.21.15.2:0/3925525445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a10102da0 0x7f6a10103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:48.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.261+0000 7f6a14b4c640 1 -- 172.21.15.2:0/3925525445 >> 172.21.15.2:0/3925525445 conn(0x7f6a100fc7a0 msgr2=0x7f6a100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:48.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.261+0000 7f6a14b4c640 1 -- 172.21.15.2:0/3925525445 shutdown_connections 2024-09-19T06:19:48.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.261+0000 7f6a14b4c640 1 -- 172.21.15.2:0/3925525445 wait complete. 2024-09-19T06:19:48.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.262+0000 7f6a14b4c640 1 Processor -- start 2024-09-19T06:19:48.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.262+0000 7f6a14b4c640 1 -- start start 2024-09-19T06:19:48.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.262+0000 7f6a14b4c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a10102da0 0x7f6a10100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:48.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.262+0000 7f6a14b4c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a101036c0 0x7f6a10100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:48.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.262+0000 7f6a14b4c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a1010c180 0x7f6a10101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:48.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.262+0000 7f6a14b4c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6a10111e10 con 0x7f6a1010c180 2024-09-19T06:19:48.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.262+0000 7f6a14b4c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6a10111c90 con 0x7f6a10102da0 2024-09-19T06:19:48.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.262+0000 7f6a14b4c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6a10111f90 con 0x7f6a101036c0 2024-09-19T06:19:48.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.262+0000 7f6a0ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a1010c180 0x7f6a10101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:48.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.262+0000 7f6a0ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a1010c180 0x7f6a10101480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53396/0 (socket says 172.21.15.2:53396) 2024-09-19T06:19:48.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.262+0000 7f6a0ed9d640 1 -- 172.21.15.2:0/2930861926 learned_addr learned my addr 172.21.15.2:0/2930861926 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:48.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.262+0000 7f6a0e59c640 1 --2- 172.21.15.2:0/2930861926 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a10102da0 0x7f6a10100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:48.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.262+0000 7f6a0dd9b640 1 --2- 172.21.15.2:0/2930861926 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a101036c0 0x7f6a10100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:48.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.262+0000 7f6a0ed9d640 1 -- 172.21.15.2:0/2930861926 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a101036c0 msgr2=0x7f6a10100f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:48.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.262+0000 7f6a0ed9d640 1 --2- 172.21.15.2:0/2930861926 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a101036c0 0x7f6a10100f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:48.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.262+0000 7f6a0ed9d640 1 -- 172.21.15.2:0/2930861926 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a10102da0 msgr2=0x7f6a10100a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:48.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.262+0000 7f6a0ed9d640 1 --2- 172.21.15.2:0/2930861926 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a10102da0 0x7f6a10100a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:48.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.262+0000 7f6a0ed9d640 1 -- 172.21.15.2:0/2930861926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a101a6730 con 0x7f6a1010c180 2024-09-19T06:19:48.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.263+0000 7f6a0ed9d640 1 --2- 172.21.15.2:0/2930861926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a1010c180 0x7f6a10101480 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f6a0802ae70 tx=0x7f6a0802f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:48.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.263+0000 7f6a077fe640 1 -- 172.21.15.2:0/2930861926 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a08034040 con 0x7f6a1010c180 2024-09-19T06:19:48.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.263+0000 7f6a14b4c640 1 -- 172.21.15.2:0/2930861926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a101a69c0 con 0x7f6a1010c180 2024-09-19T06:19:48.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.263+0000 7f6a077fe640 1 -- 172.21.15.2:0/2930861926 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6a080308f0 con 0x7f6a1010c180 2024-09-19T06:19:48.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.263+0000 7f6a077fe640 1 -- 172.21.15.2:0/2930861926 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a080047f0 con 0x7f6a1010c180 2024-09-19T06:19:48.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.263+0000 7f6a14b4c640 1 -- 172.21.15.2:0/2930861926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a101a6ef0 con 0x7f6a1010c180 2024-09-19T06:19:48.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.265+0000 7f6a077fe640 1 -- 172.21.15.2:0/2930861926 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f6a08037020 con 0x7f6a1010c180 2024-09-19T06:19:48.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.266+0000 7f6a16f25740 1 Processor -- start 2024-09-19T06:19:48.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.266+0000 7f6a16f25740 1 -- start start 2024-09-19T06:19:48.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.266+0000 7f6a16f25740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595a5526b40 0x5595a5525090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:48.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.266+0000 7f6a16f25740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a55255d0 0x5595a5525a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:48.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.266+0000 7f6a077fe640 1 --2- 172.21.15.2:0/2930861926 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f69fc0a33b0 0x7f69fc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:48.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.266+0000 7f6a16f25740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595a5530370 0x5595a5532760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:48.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.266+0000 7f6a16f25740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5595a548b2f0 con 0x5595a55255d0 2024-09-19T06:19:48.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.266+0000 7f6a16f25740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5595a5432cf0 con 0x5595a5530370 2024-09-19T06:19:48.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.266+0000 7f6a16f25740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5595a54872b0 con 0x5595a5526b40 2024-09-19T06:19:48.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.266+0000 7f6a0e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a55255d0 0x5595a5525a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:48.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.266+0000 7f6a0e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a55255d0 0x5595a5525a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53404/0 (socket says 172.21.15.2:53404) 2024-09-19T06:19:48.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.266+0000 7f6a0e59c640 1 -- 172.21.15.2:0/4281821181 learned_addr learned my addr 172.21.15.2:0/4281821181 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:48.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.266+0000 7f6a0dd9b640 1 --2- 172.21.15.2:0/2930861926 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f69fc0a33b0 0x7f69fc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:48.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.266+0000 7f6a077fe640 1 -- 172.21.15.2:0/2930861926 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f6a080f0c10 con 0x7f6a1010c180 2024-09-19T06:19:48.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.266+0000 7f6a0dd9b640 1 --2- 172.21.15.2:0/4281821181 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595a5526b40 0x5595a5525090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:48.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.266+0000 7f6a0ed9d640 1 --2- 172.21.15.2:0/4281821181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595a5530370 0x5595a5532760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:48.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.267+0000 7f6a0e59c640 1 -- 172.21.15.2:0/4281821181 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595a5526b40 msgr2=0x5595a5525090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:48.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.267+0000 7f6a0e59c640 1 --2- 172.21.15.2:0/4281821181 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595a5526b40 0x5595a5525090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:48.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.267+0000 7f6a0e59c640 1 -- 172.21.15.2:0/4281821181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595a5530370 msgr2=0x5595a5532760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:48.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.267+0000 7f6a0e59c640 1 --2- 172.21.15.2:0/4281821181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595a5530370 0x5595a5532760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:48.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.267+0000 7f6a0e59c640 1 -- 172.21.15.2:0/4281821181 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595a54173a0 con 0x5595a55255d0 2024-09-19T06:19:48.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.267+0000 7f6a0ed9d640 1 --2- 172.21.15.2:0/4281821181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595a5530370 0x5595a5532760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:19:48.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.267+0000 7f6a0dd9b640 1 --2- 172.21.15.2:0/2930861926 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f69fc0a33b0 0x7f69fc0a5870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6a10102490 tx=0x7f6a0000b6f0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:48.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.267+0000 7f6a0e59c640 1 --2- 172.21.15.2:0/4281821181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a55255d0 0x5595a5525a10 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f69f800bd10 tx=0x7f69f80107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc6e553c0d85b987 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:48.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.267+0000 7f6a04ff9640 1 -- 172.21.15.2:0/4281821181 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f8004030 con 0x5595a55255d0 2024-09-19T06:19:48.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.267+0000 7f6a04ff9640 1 -- 172.21.15.2:0/4281821181 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f69f80035f0 con 0x5595a55255d0 2024-09-19T06:19:48.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.267+0000 7f6a04ff9640 1 -- 172.21.15.2:0/4281821181 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f80116a0 con 0x5595a55255d0 2024-09-19T06:19:48.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.268+0000 7f6a16f25740 1 -- 172.21.15.2:0/4281821181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a55255d0 msgr2=0x5595a5525a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:48.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.268+0000 7f6a16f25740 1 --2- 172.21.15.2:0/4281821181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a55255d0 0x5595a5525a10 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f69f800bd10 tx=0x7f69f80107a0 comp rx=0 tx=0).stop 2024-09-19T06:19:48.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.268+0000 7f6a16f25740 1 -- 172.21.15.2:0/4281821181 shutdown_connections 2024-09-19T06:19:48.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.268+0000 7f6a16f25740 1 --2- 172.21.15.2:0/4281821181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595a5530370 0x5595a5532760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:48.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.268+0000 7f6a16f25740 1 --2- 172.21.15.2:0/4281821181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a55255d0 0x5595a5525a10 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:48.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.268+0000 7f6a16f25740 1 --2- 172.21.15.2:0/4281821181 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595a5526b40 0x5595a5525090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:48.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.268+0000 7f6a16f25740 1 -- 172.21.15.2:0/4281821181 >> 172.21.15.2:0/4281821181 conn(0x5595a54ee310 msgr2=0x5595a5521c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:48.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.268+0000 7f6a16f25740 1 -- 172.21.15.2:0/4281821181 shutdown_connections 2024-09-19T06:19:48.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.268+0000 7f6a16f25740 1 -- 172.21.15.2:0/4281821181 wait complete. 2024-09-19T06:19:48.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.268+0000 7f6a16f25740 1 -- start start 2024-09-19T06:19:48.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.268+0000 7f6a16f25740 1 Processor -- start 2024-09-19T06:19:48.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.269+0000 7f6a16f25740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595a55255d0 0x5595a552fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:48.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.269+0000 7f6a16f25740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a5526b40 0x5595a552cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:48.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.269+0000 7f6a16f25740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595a5530370 0x5595a552d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:48.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.269+0000 7f6a16f25740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5595a5533070 con 0x5595a5526b40 2024-09-19T06:19:48.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.269+0000 7f6a16f25740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5595a5446060 con 0x5595a55255d0 2024-09-19T06:19:48.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.269+0000 7f6a16f25740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5595a55331f0 con 0x5595a5530370 2024-09-19T06:19:48.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.269+0000 7f6a16f25740 10 client.0 _ll_register_callbacks cb 0x5595a51998c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:48.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.269+0000 7f6a0dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a5526b40 0x5595a552cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:48.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.269+0000 7f6a0dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a5526b40 0x5595a552cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53414/0 (socket says 172.21.15.2:53414) 2024-09-19T06:19:48.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.269+0000 7f6a0dd9b640 1 -- 172.21.15.2:0/3656677687 learned_addr learned my addr 172.21.15.2:0/3656677687 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:48.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.269+0000 7f6a0ed9d640 1 --2- 172.21.15.2:0/3656677687 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595a5530370 0x5595a552d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:48.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.269+0000 7f6a0e59c640 1 --2- 172.21.15.2:0/3656677687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595a55255d0 0x5595a552fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:48.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.269+0000 7f6a0dd9b640 1 -- 172.21.15.2:0/3656677687 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595a5530370 msgr2=0x5595a552d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:48.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.269+0000 7f6a0dd9b640 1 --2- 172.21.15.2:0/3656677687 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595a5530370 0x5595a552d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:48.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.269+0000 7f6a0dd9b640 1 -- 172.21.15.2:0/3656677687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595a55255d0 msgr2=0x5595a552fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:48.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.269+0000 7f6a0dd9b640 1 --2- 172.21.15.2:0/3656677687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595a55255d0 0x5595a552fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:48.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.269+0000 7f6a0dd9b640 1 -- 172.21.15.2:0/3656677687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595a51fc3c0 con 0x5595a5526b40 2024-09-19T06:19:48.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.269+0000 7f6a0ed9d640 1 --2- 172.21.15.2:0/3656677687 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595a5530370 0x5595a552d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:19:48.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.269+0000 7f6a0dd9b640 1 --2- 172.21.15.2:0/3656677687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a5526b40 0x5595a552cfe0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f6a00010c50 tx=0x7f6a00018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f171c25081552691 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:48.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.269+0000 7f69f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:19:48.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.269+0000 7f69f5ffb640 1 -- 172.21.15.2:0/3656677687 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a00024070 con 0x5595a5526b40 2024-09-19T06:19:48.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.270+0000 7f69f5ffb640 1 -- 172.21.15.2:0/3656677687 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f6a00004220 con 0x5595a5526b40 2024-09-19T06:19:48.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.270+0000 7f6a16f25740 1 -- 172.21.15.2:0/3656677687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69f80035f0 con 0x5595a5526b40 2024-09-19T06:19:48.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.270+0000 7f69f5ffb640 1 -- 172.21.15.2:0/3656677687 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6a0002f050 con 0x5595a5526b40 2024-09-19T06:19:48.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.270+0000 7f6a16f25740 10 client.16470 fetch_fsmap learned FSMap version 26 2024-09-19T06:19:48.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.270+0000 7f6a16f25740 1 -- 172.21.15.2:0/3656677687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5595a553ead0 con 0x5595a5526b40 2024-09-19T06:19:48.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.270+0000 7f69f5ffb640 1 -- 172.21.15.2:0/3656677687 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f69f80035f0 con 0x5595a5526b40 2024-09-19T06:19:48.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.270+0000 7f69f5ffb640 1 -- 172.21.15.2:0/3656677687 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f6a0001e450 con 0x5595a5526b40 2024-09-19T06:19:48.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.270+0000 7f6a16f25740 10 client.16470 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:19:48.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.270+0000 7f6a16f25740 10 client.16470 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:19:48.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.270+0000 7f6a16f25740 20 client.16470 populate_metadata read hostname 'smithi002' 2024-09-19T06:19:48.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.270+0000 7f6a16f25740 1 --2- 172.21.15.2:0/3656677687 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5595a553ffa0 0x5595a55423e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:48.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.270+0000 7f6a16f25740 4 client.16470 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:19:48.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.270+0000 7f6a16f25740 1 -- 172.21.15.2:0/3656677687 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5595a5498860 con 0x5595a553ffa0 2024-09-19T06:19:48.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.270+0000 7f6a0e59c640 1 --2- 172.21.15.2:0/3656677687 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5595a553ffa0 0x5595a55423e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:48.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.271+0000 7f6a0e59c640 1 --2- 172.21.15.2:0/3656677687 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5595a553ffa0 0x5595a55423e0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f31509fe8835ea8b server_cookie=cdd9d61cf98c1f06 in_seq=0 out_seq=0 2024-09-19T06:19:48.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.271+0000 7f69f5ffb640 10 client.16470 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:19:48.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.271+0000 7f69f5ffb640 1 -- 172.21.15.2:0/3656677687 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5595a5498860 con 0x5595a553ffa0 2024-09-19T06:19:48.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.271+0000 7f69f5ffb640 10 client.16470 handle_command_reply: tid=0 2024-09-19T06:19:48.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.271+0000 7f6a16f25740 1 client.16470 shutdown 2024-09-19T06:19:48.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.272+0000 7f6a16f25740 1 -- 172.21.15.2:0/3656677687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a5526b40 msgr2=0x5595a552cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:48.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.272+0000 7f6a16f25740 1 --2- 172.21.15.2:0/3656677687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a5526b40 0x5595a552cfe0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f6a00010c50 tx=0x7f6a00018000 comp rx=0 tx=0).stop 2024-09-19T06:19:48.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.272+0000 7f6a16f25740 1 -- 172.21.15.2:0/3656677687 shutdown_connections 2024-09-19T06:19:48.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.272+0000 7f6a16f25740 1 --2- 172.21.15.2:0/3656677687 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5595a553ffa0 0x5595a55423e0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:48.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.272+0000 7f6a16f25740 1 --2- 172.21.15.2:0/3656677687 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595a5530370 0x5595a552d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:48.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.272+0000 7f6a16f25740 1 --2- 172.21.15.2:0/3656677687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a5526b40 0x5595a552cfe0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:48.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.272+0000 7f6a16f25740 1 --2- 172.21.15.2:0/3656677687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595a55255d0 0x5595a552fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:48.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.272+0000 7f6a16f25740 1 -- 172.21.15.2:0/3656677687 >> 172.21.15.2:0/3656677687 conn(0x5595a54ee310 msgr2=0x5595a5527960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:48.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.272+0000 7f69f5ffb640 0 client.16470 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:19:48.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.272+0000 7f6a16f25740 1 -- 172.21.15.2:0/3656677687 shutdown_connections 2024-09-19T06:19:48.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.272+0000 7f6a16f25740 1 -- 172.21.15.2:0/3656677687 wait complete. 2024-09-19T06:19:48.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.272+0000 7f6a16f25740 20 client.16470 trim_cache size 0 max 16384 2024-09-19T06:19:48.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.285+0000 7f6a16f25740 1 Processor -- start 2024-09-19T06:19:48.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.285+0000 7f6a16f25740 1 -- start start 2024-09-19T06:19:48.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.285+0000 7f6a16f25740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595a55255d0 0x5595a5521e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:48.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.285+0000 7f6a16f25740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a5526b40 0x5595a553c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:48.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.285+0000 7f6a16f25740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595a5530370 0x5595a552c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:48.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.285+0000 7f6a16f25740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6a101b20c0 con 0x5595a5526b40 2024-09-19T06:19:48.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.285+0000 7f6a16f25740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6a101af990 con 0x5595a55255d0 2024-09-19T06:19:48.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.285+0000 7f6a16f25740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6a101ad7e0 con 0x5595a5530370 2024-09-19T06:19:48.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.285+0000 7f6a0dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a5526b40 0x5595a553c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:48.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.285+0000 7f6a0dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a5526b40 0x5595a553c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53424/0 (socket says 172.21.15.2:53424) 2024-09-19T06:19:48.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.285+0000 7f6a0dd9b640 1 -- 172.21.15.2:0/4053373336 learned_addr learned my addr 172.21.15.2:0/4053373336 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:48.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.285+0000 7f6a0ed9d640 1 --2- 172.21.15.2:0/4053373336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595a5530370 0x5595a552c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:48.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.285+0000 7f6a0e59c640 1 --2- 172.21.15.2:0/4053373336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595a55255d0 0x5595a5521e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:48.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.285+0000 7f6a0dd9b640 1 -- 172.21.15.2:0/4053373336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595a5530370 msgr2=0x5595a552c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:48.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.285+0000 7f6a0dd9b640 1 --2- 172.21.15.2:0/4053373336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595a5530370 0x5595a552c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:48.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.285+0000 7f6a0dd9b640 1 -- 172.21.15.2:0/4053373336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595a55255d0 msgr2=0x5595a5521e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:48.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.285+0000 7f6a0dd9b640 1 --2- 172.21.15.2:0/4053373336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595a55255d0 0x5595a5521e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:48.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.286+0000 7f6a0dd9b640 1 -- 172.21.15.2:0/4053373336 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595a5528120 con 0x5595a5526b40 2024-09-19T06:19:48.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.286+0000 7f6a0dd9b640 1 --2- 172.21.15.2:0/4053373336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a5526b40 0x5595a553c310 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f6a0001ea10 tx=0x7f6a0000b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed8a4e3e70085f5c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:48.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.286+0000 7f69f7fff640 1 -- 172.21.15.2:0/4053373336 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a00024070 con 0x5595a5526b40 2024-09-19T06:19:48.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.286+0000 7f69f7fff640 1 -- 172.21.15.2:0/4053373336 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6a00010e90 con 0x5595a5526b40 2024-09-19T06:19:48.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.286+0000 7f69f7fff640 1 -- 172.21.15.2:0/4053373336 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a00005020 con 0x5595a5526b40 2024-09-19T06:19:48.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.286+0000 7f6a16f25740 1 -- 172.21.15.2:0/4053373336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a5526b40 msgr2=0x5595a553c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:48.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.286+0000 7f6a16f25740 1 --2- 172.21.15.2:0/4053373336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a5526b40 0x5595a553c310 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f6a0001ea10 tx=0x7f6a0000b940 comp rx=0 tx=0).stop 2024-09-19T06:19:48.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.286+0000 7f6a16f25740 1 -- 172.21.15.2:0/4053373336 shutdown_connections 2024-09-19T06:19:48.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.286+0000 7f6a16f25740 1 --2- 172.21.15.2:0/4053373336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595a5530370 0x5595a552c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:48.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.286+0000 7f6a16f25740 1 --2- 172.21.15.2:0/4053373336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a5526b40 0x5595a553c310 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:48.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.286+0000 7f6a16f25740 1 --2- 172.21.15.2:0/4053373336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595a55255d0 0x5595a5521e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:48.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.287+0000 7f6a16f25740 1 -- 172.21.15.2:0/4053373336 >> 172.21.15.2:0/4053373336 conn(0x5595a54ee310 msgr2=0x5595a5521700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:48.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.287+0000 7f6a16f25740 1 -- 172.21.15.2:0/4053373336 shutdown_connections 2024-09-19T06:19:48.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.287+0000 7f6a16f25740 1 -- 172.21.15.2:0/4053373336 wait complete. 2024-09-19T06:19:48.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.287+0000 7f6a16f25740 1 -- start start 2024-09-19T06:19:48.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.287+0000 7f6a16f25740 1 Processor -- start 2024-09-19T06:19:48.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.287+0000 7f6a16f25740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595a55255d0 0x5595a5533440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:48.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.287+0000 7f6a16f25740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a5526b40 0x5595a5533980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:48.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.287+0000 7f6a16f25740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595a5530370 0x5595a5533ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:48.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.287+0000 7f6a16f25740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6a101ade50 con 0x5595a5526b40 2024-09-19T06:19:48.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.287+0000 7f6a16f25740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6a101af2c0 con 0x5595a55255d0 2024-09-19T06:19:48.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.287+0000 7f6a16f25740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6a101ae520 con 0x5595a5530370 2024-09-19T06:19:48.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.287+0000 7f6a16f25740 10 client.0 _ll_register_callbacks cb 0x7f6a0000ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:48.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.287+0000 7f6a0dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a5526b40 0x5595a5533980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:48.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.288+0000 7f6a0dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a5526b40 0x5595a5533980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53432/0 (socket says 172.21.15.2:53432) 2024-09-19T06:19:48.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.288+0000 7f6a0dd9b640 1 -- 172.21.15.2:0/2769823153 learned_addr learned my addr 172.21.15.2:0/2769823153 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:48.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.288+0000 7f6a0ed9d640 1 --2- 172.21.15.2:0/2769823153 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595a5530370 0x5595a5533ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:48.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.288+0000 7f6a0e59c640 1 --2- 172.21.15.2:0/2769823153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595a55255d0 0x5595a5533440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:48.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.288+0000 7f6a0dd9b640 1 -- 172.21.15.2:0/2769823153 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595a5530370 msgr2=0x5595a5533ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:48.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.288+0000 7f6a0dd9b640 1 --2- 172.21.15.2:0/2769823153 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595a5530370 0x5595a5533ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:48.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.288+0000 7f6a0dd9b640 1 -- 172.21.15.2:0/2769823153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595a55255d0 msgr2=0x5595a5533440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:48.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.288+0000 7f6a0dd9b640 1 --2- 172.21.15.2:0/2769823153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595a55255d0 0x5595a5533440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:48.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.288+0000 7f6a0dd9b640 1 -- 172.21.15.2:0/2769823153 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595a55a8e70 con 0x5595a5526b40 2024-09-19T06:19:48.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.288+0000 7f6a0dd9b640 1 --2- 172.21.15.2:0/2769823153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a5526b40 0x5595a5533980 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f6a00010c50 tx=0x7f6a0001e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=144e06bccc01001d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:48.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.288+0000 7f69f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:19:48.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.288+0000 7f69f5ffb640 1 -- 172.21.15.2:0/2769823153 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a00040060 con 0x5595a5526b40 2024-09-19T06:19:48.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.288+0000 7f69f5ffb640 1 -- 172.21.15.2:0/2769823153 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f6a0001ec40 con 0x5595a5526b40 2024-09-19T06:19:48.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.288+0000 7f6a16f25740 1 -- 172.21.15.2:0/2769823153 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a00010e90 con 0x5595a5526b40 2024-09-19T06:19:48.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.288+0000 7f69f5ffb640 1 -- 172.21.15.2:0/2769823153 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6a00024050 con 0x5595a5526b40 2024-09-19T06:19:48.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.288+0000 7f6a16f25740 10 client.16476 fetch_fsmap learned FSMap version 26 2024-09-19T06:19:48.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.288+0000 7f6a16f25740 1 -- 172.21.15.2:0/2769823153 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5595a55aa150 con 0x5595a5526b40 2024-09-19T06:19:48.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.289+0000 7f69f5ffb640 1 -- 172.21.15.2:0/2769823153 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6a00010e90 con 0x5595a5526b40 2024-09-19T06:19:48.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.289+0000 7f69f5ffb640 1 -- 172.21.15.2:0/2769823153 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f6a0003a070 con 0x5595a5526b40 2024-09-19T06:19:48.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.289+0000 7f6a16f25740 10 client.16476 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:19:48.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.289+0000 7f6a16f25740 10 client.16476 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:19:48.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.289+0000 7f6a16f25740 20 client.16476 populate_metadata read hostname 'smithi002' 2024-09-19T06:19:48.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.289+0000 7f6a16f25740 1 --2- 172.21.15.2:0/2769823153 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5595a55aa7b0 0x5595a55acbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:48.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.289+0000 7f6a16f25740 4 client.16476 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:19:48.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.289+0000 7f6a16f25740 1 -- 172.21.15.2:0/2769823153 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5595a5492d70 con 0x5595a55aa7b0 2024-09-19T06:19:48.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.289+0000 7f6a0e59c640 1 --2- 172.21.15.2:0/2769823153 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5595a55aa7b0 0x5595a55acbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:48.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.289+0000 7f69f5ffb640 10 client.16476 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:19:48.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.289+0000 7f6a0e59c640 1 --2- 172.21.15.2:0/2769823153 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5595a55aa7b0 0x5595a55acbd0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9018c53854174b2f server_cookie=875e1ed24afcb519 in_seq=0 out_seq=0 2024-09-19T06:19:48.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.290+0000 7f69f5ffb640 1 -- 172.21.15.2:0/2769823153 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5595a5492d70 con 0x5595a55aa7b0 2024-09-19T06:19:48.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.290+0000 7f69f5ffb640 10 client.16476 handle_command_reply: tid=0 2024-09-19T06:19:48.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.290+0000 7f6a16f25740 1 client.16476 shutdown 2024-09-19T06:19:48.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.290+0000 7f6a16f25740 1 -- 172.21.15.2:0/2769823153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a5526b40 msgr2=0x5595a5533980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:48.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.290+0000 7f6a16f25740 1 --2- 172.21.15.2:0/2769823153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a5526b40 0x5595a5533980 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f6a00010c50 tx=0x7f6a0001e4d0 comp rx=0 tx=0).stop 2024-09-19T06:19:48.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.290+0000 7f6a16f25740 1 -- 172.21.15.2:0/2769823153 shutdown_connections 2024-09-19T06:19:48.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.290+0000 7f6a16f25740 1 --2- 172.21.15.2:0/2769823153 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5595a55aa7b0 0x5595a55acbd0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:48.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.290+0000 7f6a16f25740 1 --2- 172.21.15.2:0/2769823153 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5595a5530370 0x5595a5533ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:48.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.290+0000 7f6a16f25740 1 --2- 172.21.15.2:0/2769823153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595a5526b40 0x5595a5533980 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:48.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.290+0000 7f6a16f25740 1 --2- 172.21.15.2:0/2769823153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595a55255d0 0x5595a5533440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:48.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.290+0000 7f6a16f25740 1 -- 172.21.15.2:0/2769823153 >> 172.21.15.2:0/2769823153 conn(0x5595a54ee310 msgr2=0x5595a552e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:48.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.290+0000 7f69f5ffb640 0 client.16476 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:19:48.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.290+0000 7f6a16f25740 1 -- 172.21.15.2:0/2769823153 shutdown_connections 2024-09-19T06:19:48.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.290+0000 7f6a16f25740 1 -- 172.21.15.2:0/2769823153 wait complete. 2024-09-19T06:19:48.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.290+0000 7f6a16f25740 20 client.16476 trim_cache size 0 max 16384 2024-09-19T06:19:48.300 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:19:48.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.291+0000 7f6a14b4c640 1 -- 172.21.15.2:0/2930861926 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f69fc0a33b0 msgr2=0x7f69fc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:48.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.291+0000 7f6a14b4c640 1 --2- 172.21.15.2:0/2930861926 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f69fc0a33b0 0x7f69fc0a5870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6a10102490 tx=0x7f6a0000b6f0 comp rx=0 tx=0).stop 2024-09-19T06:19:48.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.291+0000 7f6a14b4c640 1 -- 172.21.15.2:0/2930861926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a1010c180 msgr2=0x7f6a10101480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:48.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.291+0000 7f6a14b4c640 1 --2- 172.21.15.2:0/2930861926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a1010c180 0x7f6a10101480 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f6a0802ae70 tx=0x7f6a0802f5d0 comp rx=0 tx=0).stop 2024-09-19T06:19:48.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.291+0000 7f6a14b4c640 1 -- 172.21.15.2:0/2930861926 shutdown_connections 2024-09-19T06:19:48.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.291+0000 7f6a14b4c640 1 --2- 172.21.15.2:0/2930861926 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f69fc0a33b0 0x7f69fc0a5870 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:48.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.291+0000 7f6a14b4c640 1 --2- 172.21.15.2:0/2930861926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a1010c180 0x7f6a10101480 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:48.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.291+0000 7f6a14b4c640 1 --2- 172.21.15.2:0/2930861926 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a101036c0 0x7f6a10100f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:48.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.291+0000 7f6a14b4c640 1 --2- 172.21.15.2:0/2930861926 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a10102da0 0x7f6a10100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:48.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.291+0000 7f6a14b4c640 1 -- 172.21.15.2:0/2930861926 >> 172.21.15.2:0/2930861926 conn(0x7f6a100fc7a0 msgr2=0x7f6a100fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:48.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.291+0000 7f6a14b4c640 1 -- 172.21.15.2:0/2930861926 shutdown_connections 2024-09-19T06:19:48.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:48.291+0000 7f6a14b4c640 1 -- 172.21.15.2:0/2930861926 wait complete. 2024-09-19T06:19:48.962 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:19:49.219 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:19:49.694 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:49 smithi002 ceph-mon[30982]: pgmap v153: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:19:49.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.776+0000 7f44bd547640 1 -- 172.21.15.2:0/2955590275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44b8100a80 msgr2=0x7f44b8100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:49.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.776+0000 7f44bd547640 1 --2- 172.21.15.2:0/2955590275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44b8100a80 0x7f44b8100ee0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f44ac009cd0 tx=0x7f44ac02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.776+0000 7f44bd547640 1 -- 172.21.15.2:0/2955590275 shutdown_connections 2024-09-19T06:19:49.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.776+0000 7f44bd547640 1 --2- 172.21.15.2:0/2955590275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44b8101420 0x7f44b810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.776+0000 7f44bd547640 1 --2- 172.21.15.2:0/2955590275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44b8100a80 0x7f44b8100ee0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.776+0000 7f44bd547640 1 --2- 172.21.15.2:0/2955590275 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44b8106a80 0x7f44b8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.776+0000 7f44bd547640 1 -- 172.21.15.2:0/2955590275 >> 172.21.15.2:0/2955590275 conn(0x7f44b80fc7a0 msgr2=0x7f44b80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:49.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.776+0000 7f44bd547640 1 -- 172.21.15.2:0/2955590275 shutdown_connections 2024-09-19T06:19:49.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.776+0000 7f44bd547640 1 -- 172.21.15.2:0/2955590275 wait complete. 2024-09-19T06:19:49.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.777+0000 7f44bd547640 1 Processor -- start 2024-09-19T06:19:49.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.777+0000 7f44bd547640 1 -- start start 2024-09-19T06:19:49.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.777+0000 7f44bd547640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44b8100a80 0x7f44b8198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:49.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.777+0000 7f44bd547640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44b8101420 0x7f44b81988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:49.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.777+0000 7f44bd547640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44b8106a80 0x7f44b819cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:49.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.777+0000 7f44bd547640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f44b8110d80 con 0x7f44b8100a80 2024-09-19T06:19:49.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.777+0000 7f44bd547640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f44b8110c00 con 0x7f44b8101420 2024-09-19T06:19:49.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.777+0000 7f44bd547640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f44b8110f00 con 0x7f44b8106a80 2024-09-19T06:19:49.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.777+0000 7f44b6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44b8100a80 0x7f44b8198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:49.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.777+0000 7f44b6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44b8100a80 0x7f44b8198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53462/0 (socket says 172.21.15.2:53462) 2024-09-19T06:19:49.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.777+0000 7f44b6ffd640 1 -- 172.21.15.2:0/1564752387 learned_addr learned my addr 172.21.15.2:0/1564752387 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:49.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.778+0000 7f44b77fe640 1 --2- 172.21.15.2:0/1564752387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44b8106a80 0x7f44b819cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:49.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.778+0000 7f44b67fc640 1 --2- 172.21.15.2:0/1564752387 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44b8101420 0x7f44b81988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:49.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.778+0000 7f44b6ffd640 1 -- 172.21.15.2:0/1564752387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44b8106a80 msgr2=0x7f44b819cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:49.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.778+0000 7f44b6ffd640 1 --2- 172.21.15.2:0/1564752387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44b8106a80 0x7f44b819cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.778+0000 7f44b6ffd640 1 -- 172.21.15.2:0/1564752387 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44b8101420 msgr2=0x7f44b81988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:49.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.778+0000 7f44b6ffd640 1 --2- 172.21.15.2:0/1564752387 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44b8101420 0x7f44b81988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.778+0000 7f44b6ffd640 1 -- 172.21.15.2:0/1564752387 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44b819d310 con 0x7f44b8100a80 2024-09-19T06:19:49.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.778+0000 7f44b6ffd640 1 --2- 172.21.15.2:0/1564752387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44b8100a80 0x7f44b8198360 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f44a800d770 tx=0x7f44a800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:49.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.778+0000 7f449ffff640 1 -- 172.21.15.2:0/1564752387 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a8017070 con 0x7f44b8100a80 2024-09-19T06:19:49.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.778+0000 7f44bd547640 1 -- 172.21.15.2:0/1564752387 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44b819d600 con 0x7f44b8100a80 2024-09-19T06:19:49.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.778+0000 7f44bd547640 1 -- 172.21.15.2:0/1564752387 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44b81a4ee0 con 0x7f44b8100a80 2024-09-19T06:19:49.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.778+0000 7f449ffff640 1 -- 172.21.15.2:0/1564752387 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f44a80054d0 con 0x7f44b8100a80 2024-09-19T06:19:49.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.778+0000 7f449ffff640 1 -- 172.21.15.2:0/1564752387 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a8004cf0 con 0x7f44b8100a80 2024-09-19T06:19:49.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.781+0000 7f449ffff640 1 -- 172.21.15.2:0/1564752387 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f44a8004e90 con 0x7f44b8100a80 2024-09-19T06:19:49.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.781+0000 7f44bf920740 1 Processor -- start 2024-09-19T06:19:49.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.781+0000 7f44bf920740 1 -- start start 2024-09-19T06:19:49.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.781+0000 7f44bf920740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b54c1eb40 0x562b54c1d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:49.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.781+0000 7f44bf920740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b54c1d5d0 0x562b54c1da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:49.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.781+0000 7f44bf920740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b54c28370 0x562b54c2a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:49.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.781+0000 7f44bf920740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562b54b832f0 con 0x562b54c28370 2024-09-19T06:19:49.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.781+0000 7f44bf920740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562b54b2acf0 con 0x562b54c1d5d0 2024-09-19T06:19:49.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.781+0000 7f44bf920740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562b54b7f2b0 con 0x562b54c1eb40 2024-09-19T06:19:49.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.781+0000 7f449ffff640 1 --2- 172.21.15.2:0/1564752387 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f44a00a3430 0x7f44a00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:49.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.782+0000 7f44b67fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b54c28370 0x562b54c2a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:49.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.782+0000 7f44b67fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b54c28370 0x562b54c2a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53468/0 (socket says 172.21.15.2:53468) 2024-09-19T06:19:49.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.782+0000 7f44b67fc640 1 -- 172.21.15.2:0/2635010512 learned_addr learned my addr 172.21.15.2:0/2635010512 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:49.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.782+0000 7f44b6ffd640 1 --2- 172.21.15.2:0/2635010512 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b54c1d5d0 0x562b54c1da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:49.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.782+0000 7f44b77fe640 1 --2- 172.21.15.2:0/1564752387 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f44a00a3430 0x7f44a00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:49.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.782+0000 7f449ffff640 1 -- 172.21.15.2:0/1564752387 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f44a80cf2c0 con 0x7f44b8100a80 2024-09-19T06:19:49.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.782+0000 7f44b77fe640 1 --2- 172.21.15.2:0/2635010512 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b54c1eb40 0x562b54c1d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:49.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.782+0000 7f44b67fc640 1 -- 172.21.15.2:0/2635010512 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b54c1eb40 msgr2=0x562b54c1d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:49.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.782+0000 7f44b67fc640 1 --2- 172.21.15.2:0/2635010512 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b54c1eb40 0x562b54c1d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.782+0000 7f44b67fc640 1 -- 172.21.15.2:0/2635010512 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b54c1d5d0 msgr2=0x562b54c1da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:49.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.782+0000 7f44b67fc640 1 --2- 172.21.15.2:0/2635010512 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b54c1d5d0 0x562b54c1da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.782+0000 7f44b67fc640 1 -- 172.21.15.2:0/2635010512 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b54b0f3a0 con 0x562b54c28370 2024-09-19T06:19:49.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.782+0000 7f44b6ffd640 1 --2- 172.21.15.2:0/2635010512 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b54c1d5d0 0x562b54c1da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:19:49.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.782+0000 7f44b77fe640 1 --2- 172.21.15.2:0/2635010512 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b54c1eb40 0x562b54c1d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:19:49.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.782+0000 7f44b67fc640 1 --2- 172.21.15.2:0/2635010512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b54c28370 0x562b54c2a760 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f44ac02ae00 tx=0x7f44ac005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f98fa1aca35750d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:49.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.782+0000 7f44b77fe640 1 --2- 172.21.15.2:0/1564752387 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f44a00a3430 0x7f44a00a58f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f44b0009710 tx=0x7f44b0013040 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:49.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.782+0000 7f449d7fa640 1 -- 172.21.15.2:0/2635010512 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ac048070 con 0x562b54c28370 2024-09-19T06:19:49.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.782+0000 7f449d7fa640 1 -- 172.21.15.2:0/2635010512 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f44ac036070 con 0x562b54c28370 2024-09-19T06:19:49.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.782+0000 7f449d7fa640 1 -- 172.21.15.2:0/2635010512 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ac004260 con 0x562b54c28370 2024-09-19T06:19:49.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.783+0000 7f44bf920740 1 -- 172.21.15.2:0/2635010512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b54c28370 msgr2=0x562b54c2a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:49.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.783+0000 7f44bf920740 1 --2- 172.21.15.2:0/2635010512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b54c28370 0x562b54c2a760 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f44ac02ae00 tx=0x7f44ac005f30 comp rx=0 tx=0).stop 2024-09-19T06:19:49.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.783+0000 7f44bf920740 1 -- 172.21.15.2:0/2635010512 shutdown_connections 2024-09-19T06:19:49.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.783+0000 7f44bf920740 1 --2- 172.21.15.2:0/2635010512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b54c28370 0x562b54c2a760 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.783+0000 7f44bf920740 1 --2- 172.21.15.2:0/2635010512 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b54c1d5d0 0x562b54c1da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.783+0000 7f44bf920740 1 --2- 172.21.15.2:0/2635010512 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b54c1eb40 0x562b54c1d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.783+0000 7f44bf920740 1 -- 172.21.15.2:0/2635010512 >> 172.21.15.2:0/2635010512 conn(0x562b54be6310 msgr2=0x562b54c19c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:49.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.783+0000 7f44bf920740 1 -- 172.21.15.2:0/2635010512 shutdown_connections 2024-09-19T06:19:49.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.783+0000 7f44bf920740 1 -- 172.21.15.2:0/2635010512 wait complete. 2024-09-19T06:19:49.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.784+0000 7f44bf920740 1 -- start start 2024-09-19T06:19:49.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.784+0000 7f44bf920740 1 Processor -- start 2024-09-19T06:19:49.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.784+0000 7f44bf920740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b54c1d5d0 0x562b54c27d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:49.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.784+0000 7f44bf920740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b54c1eb40 0x562b54c24fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:49.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.784+0000 7f44bf920740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b54c28370 0x562b54c255d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:49.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.784+0000 7f44bf920740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562b54c2b010 con 0x562b54c1eb40 2024-09-19T06:19:49.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.784+0000 7f44bf920740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562b54b3e060 con 0x562b54c28370 2024-09-19T06:19:49.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.784+0000 7f44bf920740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562b54c2b190 con 0x562b54c1d5d0 2024-09-19T06:19:49.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.784+0000 7f44bf920740 10 client.0 _ll_register_callbacks cb 0x562b548918c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:49.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.784+0000 7f44b67fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b54c1eb40 0x562b54c24fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:49.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.784+0000 7f44b67fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b54c1eb40 0x562b54c24fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53480/0 (socket says 172.21.15.2:53480) 2024-09-19T06:19:49.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.784+0000 7f44b67fc640 1 -- 172.21.15.2:0/3474246749 learned_addr learned my addr 172.21.15.2:0/3474246749 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:49.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.784+0000 7f44b6ffd640 1 --2- 172.21.15.2:0/3474246749 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b54c1d5d0 0x562b54c27d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:49.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.784+0000 7f44b77fe640 1 --2- 172.21.15.2:0/3474246749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b54c28370 0x562b54c255d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:49.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.784+0000 7f44b67fc640 1 -- 172.21.15.2:0/3474246749 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b54c1d5d0 msgr2=0x562b54c27d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:49.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.784+0000 7f44b67fc640 1 --2- 172.21.15.2:0/3474246749 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b54c1d5d0 0x562b54c27d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.784+0000 7f44b67fc640 1 -- 172.21.15.2:0/3474246749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b54c28370 msgr2=0x562b54c255d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:49.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.784+0000 7f44b67fc640 1 --2- 172.21.15.2:0/3474246749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b54c28370 0x562b54c255d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.784+0000 7f44b67fc640 1 -- 172.21.15.2:0/3474246749 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b548f43c0 con 0x562b54c1eb40 2024-09-19T06:19:49.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.784+0000 7f44b77fe640 1 --2- 172.21.15.2:0/3474246749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b54c28370 0x562b54c255d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:19:49.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.785+0000 7f44b67fc640 1 --2- 172.21.15.2:0/3474246749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b54c1eb40 0x562b54c24fe0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f44ac004af0 tx=0x7f44ac003dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9bd29675ce33a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:49.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.785+0000 7f449aff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:19:49.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.785+0000 7f449aff5640 1 -- 172.21.15.2:0/3474246749 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ac048040 con 0x562b54c1eb40 2024-09-19T06:19:49.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.785+0000 7f44bf920740 1 -- 172.21.15.2:0/3474246749 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44ac036070 con 0x562b54c1eb40 2024-09-19T06:19:49.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.785+0000 7f449aff5640 1 -- 172.21.15.2:0/3474246749 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f44ac031850 con 0x562b54c1eb40 2024-09-19T06:19:49.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.785+0000 7f449aff5640 1 -- 172.21.15.2:0/3474246749 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f44ac05c050 con 0x562b54c1eb40 2024-09-19T06:19:49.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.785+0000 7f44bf920740 10 client.16488 fetch_fsmap learned FSMap version 26 2024-09-19T06:19:49.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.785+0000 7f44bf920740 1 -- 172.21.15.2:0/3474246749 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562b54c2b010 con 0x562b54c1eb40 2024-09-19T06:19:49.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.785+0000 7f449aff5640 1 -- 172.21.15.2:0/3474246749 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f44ac036070 con 0x562b54c1eb40 2024-09-19T06:19:49.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.785+0000 7f449aff5640 1 -- 172.21.15.2:0/3474246749 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f44ac04b030 con 0x562b54c1eb40 2024-09-19T06:19:49.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.786+0000 7f44bf920740 10 client.16488 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:19:49.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.786+0000 7f44bf920740 10 client.16488 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:19:49.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.786+0000 7f44bf920740 20 client.16488 populate_metadata read hostname 'smithi002' 2024-09-19T06:19:49.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.786+0000 7f44bf920740 1 --2- 172.21.15.2:0/3474246749 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562b54c37c00 0x562b54c39ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:49.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.786+0000 7f44bf920740 4 client.16488 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:19:49.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.786+0000 7f44bf920740 1 -- 172.21.15.2:0/3474246749 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b54b90860 con 0x562b54c37c00 2024-09-19T06:19:49.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.786+0000 7f44b6ffd640 1 --2- 172.21.15.2:0/3474246749 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562b54c37c00 0x562b54c39ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:49.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.786+0000 7f449aff5640 10 client.16488 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:19:49.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.786+0000 7f44b6ffd640 1 --2- 172.21.15.2:0/3474246749 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562b54c37c00 0x562b54c39ff0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1c5dca7c31ed62b server_cookie=e4da4ad05b65cd01 in_seq=0 out_seq=0 2024-09-19T06:19:49.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.787+0000 7f449aff5640 1 -- 172.21.15.2:0/3474246749 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562b54b90860 con 0x562b54c37c00 2024-09-19T06:19:49.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.787+0000 7f449aff5640 10 client.16488 handle_command_reply: tid=0 2024-09-19T06:19:49.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.787+0000 7f44bf920740 1 client.16488 shutdown 2024-09-19T06:19:49.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.787+0000 7f44bf920740 1 -- 172.21.15.2:0/3474246749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b54c1eb40 msgr2=0x562b54c24fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:49.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.787+0000 7f44bf920740 1 --2- 172.21.15.2:0/3474246749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b54c1eb40 0x562b54c24fe0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f44ac004af0 tx=0x7f44ac003dd0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.787+0000 7f44bf920740 1 -- 172.21.15.2:0/3474246749 shutdown_connections 2024-09-19T06:19:49.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.787+0000 7f44bf920740 1 --2- 172.21.15.2:0/3474246749 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562b54c37c00 0x562b54c39ff0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.787+0000 7f44bf920740 1 --2- 172.21.15.2:0/3474246749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b54c28370 0x562b54c255d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.787+0000 7f44bf920740 1 --2- 172.21.15.2:0/3474246749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b54c1eb40 0x562b54c24fe0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.787+0000 7f449aff5640 0 client.16488 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:19:49.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.787+0000 7f44bf920740 1 --2- 172.21.15.2:0/3474246749 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b54c1d5d0 0x562b54c27d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.787+0000 7f44bf920740 1 -- 172.21.15.2:0/3474246749 >> 172.21.15.2:0/3474246749 conn(0x562b54be6310 msgr2=0x562b54c1f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:49.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.787+0000 7f44bf920740 1 -- 172.21.15.2:0/3474246749 shutdown_connections 2024-09-19T06:19:49.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.787+0000 7f44bf920740 1 -- 172.21.15.2:0/3474246749 wait complete. 2024-09-19T06:19:49.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.788+0000 7f44bf920740 20 client.16488 trim_cache size 0 max 16384 2024-09-19T06:19:49.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.800+0000 7f44bf920740 1 Processor -- start 2024-09-19T06:19:49.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.800+0000 7f44bf920740 1 -- start start 2024-09-19T06:19:49.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.801+0000 7f44bf920740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b54c1d5d0 0x562b54c342b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:49.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.801+0000 7f44bf920740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b54c1eb40 0x562b54c1ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:49.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.801+0000 7f44bf920740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b54c28370 0x562b54c20500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:49.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.801+0000 7f44bf920740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f44b81afec0 con 0x562b54c1d5d0 2024-09-19T06:19:49.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.801+0000 7f44bf920740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f44b81ad790 con 0x562b54c1eb40 2024-09-19T06:19:49.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.801+0000 7f44bf920740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f44b81ab5e0 con 0x562b54c28370 2024-09-19T06:19:49.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.801+0000 7f44b6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b54c1d5d0 0x562b54c342b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:49.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.801+0000 7f44b6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b54c1d5d0 0x562b54c342b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53496/0 (socket says 172.21.15.2:53496) 2024-09-19T06:19:49.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.801+0000 7f44b6ffd640 1 -- 172.21.15.2:0/302302242 learned_addr learned my addr 172.21.15.2:0/302302242 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:49.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.801+0000 7f44b67fc640 1 --2- 172.21.15.2:0/302302242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b54c1eb40 0x562b54c1ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:49.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.801+0000 7f44b77fe640 1 --2- 172.21.15.2:0/302302242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b54c28370 0x562b54c20500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:49.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.801+0000 7f44b6ffd640 1 -- 172.21.15.2:0/302302242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b54c28370 msgr2=0x562b54c20500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:49.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.801+0000 7f44b6ffd640 1 --2- 172.21.15.2:0/302302242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b54c28370 0x562b54c20500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.801+0000 7f44b6ffd640 1 -- 172.21.15.2:0/302302242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b54c1eb40 msgr2=0x562b54c1ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:49.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.801+0000 7f44b6ffd640 1 --2- 172.21.15.2:0/302302242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b54c1eb40 0x562b54c1ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.801+0000 7f44b6ffd640 1 -- 172.21.15.2:0/302302242 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b54c23530 con 0x562b54c1d5d0 2024-09-19T06:19:49.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.801+0000 7f44b67fc640 1 --2- 172.21.15.2:0/302302242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b54c1eb40 0x562b54c1ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:19:49.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.801+0000 7f44b6ffd640 1 --2- 172.21.15.2:0/302302242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b54c1d5d0 0x562b54c342b0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f44a8009610 tx=0x7f44a806e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54f7f48171cc4fb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:49.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.801+0000 7f449cff9640 1 -- 172.21.15.2:0/302302242 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a8020040 con 0x562b54c1d5d0 2024-09-19T06:19:49.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.802+0000 7f449cff9640 1 -- 172.21.15.2:0/302302242 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f44a8009c30 con 0x562b54c1d5d0 2024-09-19T06:19:49.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.802+0000 7f449cff9640 1 -- 172.21.15.2:0/302302242 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a8099a10 con 0x562b54c1d5d0 2024-09-19T06:19:49.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.802+0000 7f44bf920740 1 -- 172.21.15.2:0/302302242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b54c1d5d0 msgr2=0x562b54c342b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:49.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.802+0000 7f44bf920740 1 --2- 172.21.15.2:0/302302242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b54c1d5d0 0x562b54c342b0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f44a8009610 tx=0x7f44a806e530 comp rx=0 tx=0).stop 2024-09-19T06:19:49.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.802+0000 7f44bf920740 1 -- 172.21.15.2:0/302302242 shutdown_connections 2024-09-19T06:19:49.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.802+0000 7f44bf920740 1 --2- 172.21.15.2:0/302302242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b54c28370 0x562b54c20500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.802+0000 7f44bf920740 1 --2- 172.21.15.2:0/302302242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b54c1eb40 0x562b54c1ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.802+0000 7f44bf920740 1 --2- 172.21.15.2:0/302302242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b54c1d5d0 0x562b54c342b0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.802+0000 7f44bf920740 1 -- 172.21.15.2:0/302302242 >> 172.21.15.2:0/302302242 conn(0x562b54be6310 msgr2=0x562b54c240d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:49.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.802+0000 7f44bf920740 1 -- 172.21.15.2:0/302302242 shutdown_connections 2024-09-19T06:19:49.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.802+0000 7f44bf920740 1 -- 172.21.15.2:0/302302242 wait complete. 2024-09-19T06:19:49.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.802+0000 7f44bf920740 1 -- start start 2024-09-19T06:19:49.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.803+0000 7f44bf920740 1 Processor -- start 2024-09-19T06:19:49.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.803+0000 7f44bf920740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b54c1d5d0 0x562b54c30a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:49.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.803+0000 7f44bf920740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b54c1eb40 0x562b54c2bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:49.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.803+0000 7f44bf920740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b54c28370 0x562b54c2c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:49.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.803+0000 7f44bf920740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f44b81abc50 con 0x562b54c1eb40 2024-09-19T06:19:49.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.803+0000 7f44bf920740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f44b81ad0c0 con 0x562b54c1d5d0 2024-09-19T06:19:49.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.803+0000 7f44bf920740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f44b81ac320 con 0x562b54c28370 2024-09-19T06:19:49.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.803+0000 7f44bf920740 10 client.0 _ll_register_callbacks cb 0x7f44ac046070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:49.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.803+0000 7f44b67fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b54c1eb40 0x562b54c2bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:49.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.803+0000 7f44b67fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b54c1eb40 0x562b54c2bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53508/0 (socket says 172.21.15.2:53508) 2024-09-19T06:19:49.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.803+0000 7f44b67fc640 1 -- 172.21.15.2:0/1879270920 learned_addr learned my addr 172.21.15.2:0/1879270920 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:49.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.803+0000 7f44b77fe640 1 --2- 172.21.15.2:0/1879270920 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b54c28370 0x562b54c2c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:49.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.803+0000 7f44b6ffd640 1 --2- 172.21.15.2:0/1879270920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b54c1d5d0 0x562b54c30a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:49.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.803+0000 7f44b67fc640 1 -- 172.21.15.2:0/1879270920 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b54c28370 msgr2=0x562b54c2c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:49.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.803+0000 7f44b67fc640 1 --2- 172.21.15.2:0/1879270920 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b54c28370 0x562b54c2c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.803+0000 7f44b67fc640 1 -- 172.21.15.2:0/1879270920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b54c1d5d0 msgr2=0x562b54c30a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:49.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.803+0000 7f44b67fc640 1 --2- 172.21.15.2:0/1879270920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b54c1d5d0 0x562b54c30a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.803+0000 7f44b67fc640 1 -- 172.21.15.2:0/1879270920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b54c2c9d0 con 0x562b54c1eb40 2024-09-19T06:19:49.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.803+0000 7f44b67fc640 1 --2- 172.21.15.2:0/1879270920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b54c1eb40 0x562b54c2bda0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f44ac030760 tx=0x7f44ac030a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11cdfa4e8ca0da1b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:49.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.803+0000 7f449aff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:19:49.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.804+0000 7f449aff5640 1 -- 172.21.15.2:0/1879270920 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ac048070 con 0x562b54c1eb40 2024-09-19T06:19:49.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.804+0000 7f449aff5640 1 -- 172.21.15.2:0/1879270920 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f44ac004b40 con 0x562b54c1eb40 2024-09-19T06:19:49.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.804+0000 7f44bf920740 1 -- 172.21.15.2:0/1879270920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562b54b8ad70 con 0x562b54c1eb40 2024-09-19T06:19:49.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.804+0000 7f449aff5640 1 -- 172.21.15.2:0/1879270920 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f44ac067050 con 0x562b54c1eb40 2024-09-19T06:19:49.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.804+0000 7f44bf920740 10 client.16494 fetch_fsmap learned FSMap version 26 2024-09-19T06:19:49.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.804+0000 7f44bf920740 1 -- 172.21.15.2:0/1879270920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562b54ca25a0 con 0x562b54c1eb40 2024-09-19T06:19:49.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.804+0000 7f449aff5640 1 -- 172.21.15.2:0/1879270920 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x562b54b8ad70 con 0x562b54c1eb40 2024-09-19T06:19:49.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.804+0000 7f449aff5640 1 -- 172.21.15.2:0/1879270920 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f44ac04b070 con 0x562b54c1eb40 2024-09-19T06:19:49.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.804+0000 7f44bf920740 10 client.16494 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:19:49.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.804+0000 7f44bf920740 10 client.16494 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:19:49.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.804+0000 7f44bf920740 20 client.16494 populate_metadata read hostname 'smithi002' 2024-09-19T06:19:49.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.804+0000 7f44bf920740 1 --2- 172.21.15.2:0/1879270920 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562b54ca2c00 0x562b54ca4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:49.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.804+0000 7f44bf920740 4 client.16494 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:19:49.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.804+0000 7f44bf920740 1 -- 172.21.15.2:0/1879270920 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562b54b07170 con 0x562b54ca2c00 2024-09-19T06:19:49.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.805+0000 7f44b6ffd640 1 --2- 172.21.15.2:0/1879270920 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562b54ca2c00 0x562b54ca4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:49.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.805+0000 7f44b6ffd640 1 --2- 172.21.15.2:0/1879270920 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562b54ca2c00 0x562b54ca4ff0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78ab0213e38099cd server_cookie=e2db7e34650ad1dd in_seq=0 out_seq=0 2024-09-19T06:19:49.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.805+0000 7f449aff5640 10 client.16494 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:19:49.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.805+0000 7f449aff5640 1 -- 172.21.15.2:0/1879270920 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562b54b07170 con 0x562b54ca2c00 2024-09-19T06:19:49.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.805+0000 7f449aff5640 10 client.16494 handle_command_reply: tid=0 2024-09-19T06:19:49.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.805+0000 7f44bf920740 1 client.16494 shutdown 2024-09-19T06:19:49.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.805+0000 7f44bf920740 1 -- 172.21.15.2:0/1879270920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b54c1eb40 msgr2=0x562b54c2bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:49.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.805+0000 7f44bf920740 1 --2- 172.21.15.2:0/1879270920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b54c1eb40 0x562b54c2bda0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f44ac030760 tx=0x7f44ac030a90 comp rx=0 tx=0).stop 2024-09-19T06:19:49.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.805+0000 7f44bf920740 1 -- 172.21.15.2:0/1879270920 shutdown_connections 2024-09-19T06:19:49.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.805+0000 7f44bf920740 1 --2- 172.21.15.2:0/1879270920 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b54c28370 0x562b54c2c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.805+0000 7f44bf920740 1 --2- 172.21.15.2:0/1879270920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b54c1eb40 0x562b54c2bda0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.805+0000 7f44bf920740 1 --2- 172.21.15.2:0/1879270920 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562b54ca2c00 0x562b54ca4ff0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.805+0000 7f44bf920740 1 --2- 172.21.15.2:0/1879270920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b54c1d5d0 0x562b54c30a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.805+0000 7f44bf920740 1 -- 172.21.15.2:0/1879270920 >> 172.21.15.2:0/1879270920 conn(0x562b54be6310 msgr2=0x562b54c26840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:49.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.805+0000 7f449aff5640 0 client.16494 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:19:49.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.805+0000 7f44bf920740 1 -- 172.21.15.2:0/1879270920 shutdown_connections 2024-09-19T06:19:49.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.805+0000 7f44bf920740 1 -- 172.21.15.2:0/1879270920 wait complete. 2024-09-19T06:19:49.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.806+0000 7f44bf920740 20 client.16494 trim_cache size 0 max 16384 2024-09-19T06:19:49.825 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:19:49.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.806+0000 7f44bd547640 1 -- 172.21.15.2:0/1564752387 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f44a00a3430 msgr2=0x7f44a00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:49.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.806+0000 7f44bd547640 1 --2- 172.21.15.2:0/1564752387 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f44a00a3430 0x7f44a00a58f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f44b0009710 tx=0x7f44b0013040 comp rx=0 tx=0).stop 2024-09-19T06:19:49.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.806+0000 7f44bd547640 1 -- 172.21.15.2:0/1564752387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44b8100a80 msgr2=0x7f44b8198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:49.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.806+0000 7f44bd547640 1 --2- 172.21.15.2:0/1564752387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44b8100a80 0x7f44b8198360 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f44a800d770 tx=0x7f44a800dc30 comp rx=0 tx=0).stop 2024-09-19T06:19:49.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.806+0000 7f44bd547640 1 -- 172.21.15.2:0/1564752387 shutdown_connections 2024-09-19T06:19:49.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.806+0000 7f44bd547640 1 --2- 172.21.15.2:0/1564752387 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f44a00a3430 0x7f44a00a58f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.806+0000 7f44bd547640 1 --2- 172.21.15.2:0/1564752387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44b8106a80 0x7f44b819cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.806+0000 7f44bd547640 1 --2- 172.21.15.2:0/1564752387 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44b8101420 0x7f44b81988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.806+0000 7f44bd547640 1 --2- 172.21.15.2:0/1564752387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44b8100a80 0x7f44b8198360 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.806+0000 7f44bd547640 1 -- 172.21.15.2:0/1564752387 >> 172.21.15.2:0/1564752387 conn(0x7f44b80fc7a0 msgr2=0x7f44b806aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:49.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.806+0000 7f44bd547640 1 -- 172.21.15.2:0/1564752387 shutdown_connections 2024-09-19T06:19:49.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:49.806+0000 7f44bd547640 1 -- 172.21.15.2:0/1564752387 wait complete. 2024-09-19T06:19:49.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:49 smithi090 ceph-mon[34497]: pgmap v153: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:19:50.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:49 smithi089 ceph-mon[34160]: pgmap v153: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:19:51.429 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:19:51.430 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:19:51.701 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:19:51.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:51 smithi002 ceph-mon[30982]: pgmap v154: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:19:51.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:51 smithi090 ceph-mon[34497]: pgmap v154: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:19:52.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:51 smithi089 ceph-mon[34160]: pgmap v154: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:19:52.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.177+0000 7f2777079640 1 -- 172.21.15.2:0/2298978781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27701082a0 msgr2=0x7f277010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:52.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.177+0000 7f2777079640 1 --2- 172.21.15.2:0/2298978781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27701082a0 0x7f277010ec40 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f2768009cd0 tx=0x7f276802a8e0 comp rx=0 tx=0).stop 2024-09-19T06:19:52.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.177+0000 7f2777079640 1 -- 172.21.15.2:0/2298978781 shutdown_connections 2024-09-19T06:19:52.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.177+0000 7f2777079640 1 --2- 172.21.15.2:0/2298978781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27701082a0 0x7f277010ec40 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:52.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.177+0000 7f2777079640 1 --2- 172.21.15.2:0/2298978781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27701036e0 0x7f2770107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:52.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.177+0000 7f2777079640 1 --2- 172.21.15.2:0/2298978781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2770102d30 0x7f2770103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:52.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.177+0000 7f2777079640 1 -- 172.21.15.2:0/2298978781 >> 172.21.15.2:0/2298978781 conn(0x7f27700fc7d0 msgr2=0x7f27700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:52.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.177+0000 7f2777079640 1 -- 172.21.15.2:0/2298978781 shutdown_connections 2024-09-19T06:19:52.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.177+0000 7f2777079640 1 -- 172.21.15.2:0/2298978781 wait complete. 2024-09-19T06:19:52.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.177+0000 7f2777079640 1 Processor -- start 2024-09-19T06:19:52.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.177+0000 7f2777079640 1 -- start start 2024-09-19T06:19:52.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.177+0000 7f2777079640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2770102d30 0x7f27701983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:52.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.177+0000 7f2777079640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27701036e0 0x7f2770198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:52.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.177+0000 7f2777079640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27701082a0 0x7f277019ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:52.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.177+0000 7f2777079640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2770111f50 con 0x7f27701082a0 2024-09-19T06:19:52.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.177+0000 7f2777079640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2770111dd0 con 0x7f2770102d30 2024-09-19T06:19:52.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.177+0000 7f2777079640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f27701120d0 con 0x7f27701036e0 2024-09-19T06:19:52.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.178+0000 7f2775616640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27701082a0 0x7f277019ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:52.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.178+0000 7f2775616640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27701082a0 0x7f277019ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53536/0 (socket says 172.21.15.2:53536) 2024-09-19T06:19:52.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.178+0000 7f2775616640 1 -- 172.21.15.2:0/66696184 learned_addr learned my addr 172.21.15.2:0/66696184 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:52.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.178+0000 7f2774e15640 1 --2- 172.21.15.2:0/66696184 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2770102d30 0x7f27701983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:52.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.178+0000 7f276ffff640 1 --2- 172.21.15.2:0/66696184 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27701036e0 0x7f2770198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:52.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.178+0000 7f2775616640 1 -- 172.21.15.2:0/66696184 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27701036e0 msgr2=0x7f2770198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:52.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.178+0000 7f2775616640 1 --2- 172.21.15.2:0/66696184 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27701036e0 0x7f2770198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:52.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.178+0000 7f2775616640 1 -- 172.21.15.2:0/66696184 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2770102d30 msgr2=0x7f27701983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:52.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.178+0000 7f2775616640 1 --2- 172.21.15.2:0/66696184 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2770102d30 0x7f27701983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:52.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.178+0000 7f2775616640 1 -- 172.21.15.2:0/66696184 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f277019d390 con 0x7f27701082a0 2024-09-19T06:19:52.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.178+0000 7f276ffff640 1 --2- 172.21.15.2:0/66696184 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27701036e0 0x7f2770198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:19:52.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.178+0000 7f2775616640 1 --2- 172.21.15.2:0/66696184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27701082a0 0x7f277019ccb0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f2768005cc0 tx=0x7f2768003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:52.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.178+0000 7f276dffb640 1 -- 172.21.15.2:0/66696184 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2768004240 con 0x7f27701082a0 2024-09-19T06:19:52.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.178+0000 7f276dffb640 1 -- 172.21.15.2:0/66696184 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f27680305a0 con 0x7f27701082a0 2024-09-19T06:19:52.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.178+0000 7f2777079640 1 -- 172.21.15.2:0/66696184 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f277019d620 con 0x7f27701082a0 2024-09-19T06:19:52.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.178+0000 7f276dffb640 1 -- 172.21.15.2:0/66696184 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27680466c0 con 0x7f27701082a0 2024-09-19T06:19:52.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.179+0000 7f2777079640 1 -- 172.21.15.2:0/66696184 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27701a4f60 con 0x7f27701082a0 2024-09-19T06:19:52.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.181+0000 7f276dffb640 1 -- 172.21.15.2:0/66696184 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f2768030ac0 con 0x7f27701082a0 2024-09-19T06:19:52.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.181+0000 7f2779452740 1 Processor -- start 2024-09-19T06:19:52.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.181+0000 7f2779452740 1 -- start start 2024-09-19T06:19:52.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.181+0000 7f2779452740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41acccb60 0x55a41acccf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:52.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.181+0000 7f2779452740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a41accd480 0x55a41acd7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:52.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.181+0000 7f2779452740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a41acd7d40 0x55a41acda130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:52.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.181+0000 7f2779452740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a41ac32280 con 0x55a41acccb60 2024-09-19T06:19:52.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.181+0000 7f2779452740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55a41abd9b10 con 0x55a41acd7d40 2024-09-19T06:19:52.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.181+0000 7f2779452740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55a41ac2e240 con 0x55a41accd480 2024-09-19T06:19:52.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.181+0000 7f276ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41acccb60 0x55a41acccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:52.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.181+0000 7f276ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41acccb60 0x55a41acccf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53550/0 (socket says 172.21.15.2:53550) 2024-09-19T06:19:52.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.181+0000 7f276ffff640 1 -- 172.21.15.2:0/1448520025 learned_addr learned my addr 172.21.15.2:0/1448520025 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:52.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.182+0000 7f276ffff640 1 --2- 172.21.15.2:0/1448520025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a41acd7d40 0x55a41acda130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:52.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.182+0000 7f276dffb640 1 --2- 172.21.15.2:0/66696184 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f27580a33b0 0x7f27580a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.182+0000 7f2774e15640 1 --2- 172.21.15.2:0/1448520025 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a41accd480 0x55a41acd7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.182+0000 7f2775616640 1 --2- 172.21.15.2:0/66696184 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f27580a33b0 0x7f27580a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.182+0000 7f276ffff640 1 -- 172.21.15.2:0/1448520025 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a41accd480 msgr2=0x55a41acd7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.182+0000 7f276ffff640 1 --2- 172.21.15.2:0/1448520025 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a41accd480 0x55a41acd7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.182+0000 7f276ffff640 1 -- 172.21.15.2:0/1448520025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a41acd7d40 msgr2=0x55a41acda130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.182+0000 7f276ffff640 1 --2- 172.21.15.2:0/1448520025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a41acd7d40 0x55a41acda130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.182+0000 7f276ffff640 1 -- 172.21.15.2:0/1448520025 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a41abe61f0 con 0x55a41acccb60 2024-09-19T06:19:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.182+0000 7f276dffb640 1 -- 172.21.15.2:0/66696184 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f276802e030 con 0x7f27701082a0 2024-09-19T06:19:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.182+0000 7f276ffff640 1 --2- 172.21.15.2:0/1448520025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41acccb60 0x55a41acccf40 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f2764012710 tx=0x7f276400d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25169489c689f596 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.182+0000 7f2756ffd640 1 -- 172.21.15.2:0/1448520025 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2764008830 con 0x55a41acccb60 2024-09-19T06:19:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.182+0000 7f2756ffd640 1 -- 172.21.15.2:0/1448520025 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f27640103d0 con 0x55a41acccb60 2024-09-19T06:19:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.182+0000 7f2756ffd640 1 -- 172.21.15.2:0/1448520025 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276400f620 con 0x55a41acccb60 2024-09-19T06:19:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.183+0000 7f2779452740 1 -- 172.21.15.2:0/1448520025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41acccb60 msgr2=0x55a41acccf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:52.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.183+0000 7f2779452740 1 --2- 172.21.15.2:0/1448520025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41acccb60 0x55a41acccf40 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f2764012710 tx=0x7f276400d2e0 comp rx=0 tx=0).stop 2024-09-19T06:19:52.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.183+0000 7f2775616640 1 --2- 172.21.15.2:0/66696184 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f27580a33b0 0x7f27580a5870 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f27680bd660 tx=0x7f27680ee040 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:52.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.183+0000 7f2779452740 1 -- 172.21.15.2:0/1448520025 shutdown_connections 2024-09-19T06:19:52.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.183+0000 7f2779452740 1 --2- 172.21.15.2:0/1448520025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a41acd7d40 0x55a41acda130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:52.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.183+0000 7f2779452740 1 --2- 172.21.15.2:0/1448520025 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a41accd480 0x55a41acd7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:52.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.183+0000 7f2779452740 1 --2- 172.21.15.2:0/1448520025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41acccb60 0x55a41acccf40 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:52.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.183+0000 7f2779452740 1 -- 172.21.15.2:0/1448520025 >> 172.21.15.2:0/1448520025 conn(0x55a41acc90f0 msgr2=0x55a41acc94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:52.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.183+0000 7f2779452740 1 -- 172.21.15.2:0/1448520025 shutdown_connections 2024-09-19T06:19:52.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.183+0000 7f2779452740 1 -- 172.21.15.2:0/1448520025 wait complete. 2024-09-19T06:19:52.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.183+0000 7f2779452740 1 -- start start 2024-09-19T06:19:52.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.183+0000 7f2779452740 1 Processor -- start 2024-09-19T06:19:52.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.184+0000 7f2779452740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41acccb60 0x55a41acd4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:52.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.184+0000 7f2779452740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a41accd480 0x55a41acd5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:52.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.184+0000 7f2779452740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a41acd7d40 0x55a41acd5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:52.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.184+0000 7f2779452740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a41acda910 con 0x55a41acccb60 2024-09-19T06:19:52.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.184+0000 7f2779452740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55a41abecf10 con 0x55a41acd7d40 2024-09-19T06:19:52.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.184+0000 7f2779452740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55a41acdaa90 con 0x55a41accd480 2024-09-19T06:19:52.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.184+0000 7f2779452740 10 client.0 _ll_register_callbacks cb 0x55a41abb5a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:52.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.184+0000 7f276ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41acccb60 0x55a41acd4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:52.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.184+0000 7f276ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41acccb60 0x55a41acd4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53564/0 (socket says 172.21.15.2:53564) 2024-09-19T06:19:52.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.184+0000 7f276ffff640 1 -- 172.21.15.2:0/4143068526 learned_addr learned my addr 172.21.15.2:0/4143068526 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:52.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.184+0000 7f2774e15640 1 --2- 172.21.15.2:0/4143068526 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a41accd480 0x55a41acd5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:52.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.184+0000 7f276ffff640 1 --2- 172.21.15.2:0/4143068526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a41acd7d40 0x55a41acd5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:52.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.184+0000 7f276ffff640 1 -- 172.21.15.2:0/4143068526 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a41accd480 msgr2=0x55a41acd5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:52.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.184+0000 7f276ffff640 1 --2- 172.21.15.2:0/4143068526 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a41accd480 0x55a41acd5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:52.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.184+0000 7f276ffff640 1 -- 172.21.15.2:0/4143068526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a41acd7d40 msgr2=0x55a41acd5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:52.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.184+0000 7f276ffff640 1 --2- 172.21.15.2:0/4143068526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a41acd7d40 0x55a41acd5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:52.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.184+0000 7f276ffff640 1 -- 172.21.15.2:0/4143068526 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a41a9a36a0 con 0x55a41acccb60 2024-09-19T06:19:52.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.185+0000 7f276ffff640 1 --2- 172.21.15.2:0/4143068526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41acccb60 0x55a41acd4be0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f2764005ba0 tx=0x7f276400d6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d7fea24fbcafd9b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:52.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.185+0000 7f274ffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:19:52.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.185+0000 7f274ffff640 1 -- 172.21.15.2:0/4143068526 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2764005ea0 con 0x55a41acccb60 2024-09-19T06:19:52.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.185+0000 7f274ffff640 1 -- 172.21.15.2:0/4143068526 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f2764010780 con 0x55a41acccb60 2024-09-19T06:19:52.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.185+0000 7f2779452740 1 -- 172.21.15.2:0/4143068526 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27640103d0 con 0x55a41acccb60 2024-09-19T06:19:52.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.185+0000 7f274ffff640 1 -- 172.21.15.2:0/4143068526 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2764033050 con 0x55a41acccb60 2024-09-19T06:19:52.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.185+0000 7f2779452740 10 client.16506 fetch_fsmap learned FSMap version 26 2024-09-19T06:19:52.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.185+0000 7f2779452740 1 -- 172.21.15.2:0/4143068526 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a41ace6510 con 0x55a41acccb60 2024-09-19T06:19:52.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.185+0000 7f274ffff640 1 -- 172.21.15.2:0/4143068526 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f27640103d0 con 0x55a41acccb60 2024-09-19T06:19:52.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.185+0000 7f274ffff640 1 -- 172.21.15.2:0/4143068526 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f276401c070 con 0x55a41acccb60 2024-09-19T06:19:52.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.185+0000 7f2779452740 10 client.16506 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:19:52.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.185+0000 7f2779452740 10 client.16506 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:19:52.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.185+0000 7f2779452740 20 client.16506 populate_metadata read hostname 'smithi002' 2024-09-19T06:19:52.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.186+0000 7f2779452740 1 --2- 172.21.15.2:0/4143068526 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a41ace7860 0x55a41ace9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:52.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.186+0000 7f2779452740 4 client.16506 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:19:52.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.186+0000 7f2779452740 1 -- 172.21.15.2:0/4143068526 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a41ac3f7f0 con 0x55a41ace7860 2024-09-19T06:19:52.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.186+0000 7f2774e15640 1 --2- 172.21.15.2:0/4143068526 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a41ace7860 0x55a41ace9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:52.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.186+0000 7f2774e15640 1 --2- 172.21.15.2:0/4143068526 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a41ace7860 0x55a41ace9c50 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0b8cb61a5807125 server_cookie=3b61478e71bd5ae6 in_seq=0 out_seq=0 2024-09-19T06:19:52.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.186+0000 7f274ffff640 10 client.16506 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:19:52.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.187+0000 7f274ffff640 1 -- 172.21.15.2:0/4143068526 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a41ac3f7f0 con 0x55a41ace7860 2024-09-19T06:19:52.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.187+0000 7f274ffff640 10 client.16506 handle_command_reply: tid=0 2024-09-19T06:19:52.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.187+0000 7f2779452740 1 client.16506 shutdown 2024-09-19T06:19:52.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.187+0000 7f2779452740 1 -- 172.21.15.2:0/4143068526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41acccb60 msgr2=0x55a41acd4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:52.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.187+0000 7f2779452740 1 --2- 172.21.15.2:0/4143068526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41acccb60 0x55a41acd4be0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f2764005ba0 tx=0x7f276400d6e0 comp rx=0 tx=0).stop 2024-09-19T06:19:52.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.187+0000 7f2779452740 1 -- 172.21.15.2:0/4143068526 shutdown_connections 2024-09-19T06:19:52.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.187+0000 7f2779452740 1 --2- 172.21.15.2:0/4143068526 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a41ace7860 0x55a41ace9c50 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:52.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.187+0000 7f2779452740 1 --2- 172.21.15.2:0/4143068526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a41acd7d40 0x55a41acd5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:52.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.187+0000 7f2779452740 1 --2- 172.21.15.2:0/4143068526 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a41accd480 0x55a41acd5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:52.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.187+0000 7f2779452740 1 --2- 172.21.15.2:0/4143068526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41acccb60 0x55a41acd4be0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:52.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.187+0000 7f2779452740 1 -- 172.21.15.2:0/4143068526 >> 172.21.15.2:0/4143068526 conn(0x55a41acc90f0 msgr2=0x55a41accee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:52.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.187+0000 7f274ffff640 0 client.16506 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:19:52.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.187+0000 7f2779452740 1 -- 172.21.15.2:0/4143068526 shutdown_connections 2024-09-19T06:19:52.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.187+0000 7f2779452740 1 -- 172.21.15.2:0/4143068526 wait complete. 2024-09-19T06:19:52.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.187+0000 7f2779452740 20 client.16506 trim_cache size 0 max 16384 2024-09-19T06:19:52.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.204+0000 7f2779452740 1 Processor -- start 2024-09-19T06:19:52.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.204+0000 7f2779452740 1 -- start start 2024-09-19T06:19:52.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.205+0000 7f2779452740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a41accd480 0x55a41acef310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:52.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.205+0000 7f2779452740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41acd7d40 0x55a41acef850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:52.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.205+0000 7f2779452740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a41acd4ba0 0x55a41acd4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:52.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.205+0000 7f2779452740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f27701afef0 con 0x55a41acd7d40 2024-09-19T06:19:52.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.205+0000 7f2779452740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f27701ad7c0 con 0x55a41accd480 2024-09-19T06:19:52.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.205+0000 7f2779452740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f27701ab630 con 0x55a41acd4ba0 2024-09-19T06:19:52.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.205+0000 7f2774e15640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41acd7d40 0x55a41acef850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:52.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.205+0000 7f2774e15640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41acd7d40 0x55a41acef850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53578/0 (socket says 172.21.15.2:53578) 2024-09-19T06:19:52.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.205+0000 7f2774e15640 1 -- 172.21.15.2:0/3464151279 learned_addr learned my addr 172.21.15.2:0/3464151279 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:52.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.205+0000 7f276ffff640 1 --2- 172.21.15.2:0/3464151279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a41acd4ba0 0x55a41acd4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:52.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.205+0000 7f2774e15640 1 -- 172.21.15.2:0/3464151279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a41acd4ba0 msgr2=0x55a41acd4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:52.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.205+0000 7f2774e15640 1 --2- 172.21.15.2:0/3464151279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a41acd4ba0 0x55a41acd4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:52.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.205+0000 7f2774e15640 1 -- 172.21.15.2:0/3464151279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a41accd480 msgr2=0x55a41acef310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:52.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.205+0000 7f276ffff640 1 --2- 172.21.15.2:0/3464151279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a41accd480 0x55a41acef310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:52.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.205+0000 7f2774e15640 1 --2- 172.21.15.2:0/3464151279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a41accd480 0x55a41acef310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:52.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.205+0000 7f2774e15640 1 -- 172.21.15.2:0/3464151279 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a41acd3130 con 0x55a41acd7d40 2024-09-19T06:19:52.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.205+0000 7f276ffff640 1 --2- 172.21.15.2:0/3464151279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a41accd480 0x55a41acef310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:19:52.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.205+0000 7f2774e15640 1 --2- 172.21.15.2:0/3464151279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41acd7d40 0x55a41acef850 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f2760000c00 tx=0x7f276000eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2a6397db37a9b37 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:52.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.206+0000 7f27567fc640 1 -- 172.21.15.2:0/3464151279 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2760003d00 con 0x55a41acd7d40 2024-09-19T06:19:52.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.206+0000 7f27567fc640 1 -- 172.21.15.2:0/3464151279 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2760003ea0 con 0x55a41acd7d40 2024-09-19T06:19:52.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.206+0000 7f27567fc640 1 -- 172.21.15.2:0/3464151279 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2760011730 con 0x55a41acd7d40 2024-09-19T06:19:52.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.206+0000 7f2779452740 1 -- 172.21.15.2:0/3464151279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41acd7d40 msgr2=0x55a41acef850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:52.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.206+0000 7f2779452740 1 --2- 172.21.15.2:0/3464151279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41acd7d40 0x55a41acef850 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f2760000c00 tx=0x7f276000eed0 comp rx=0 tx=0).stop 2024-09-19T06:19:52.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.206+0000 7f2779452740 1 -- 172.21.15.2:0/3464151279 shutdown_connections 2024-09-19T06:19:52.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.206+0000 7f2779452740 1 --2- 172.21.15.2:0/3464151279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a41acd4ba0 0x55a41acd4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:52.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.206+0000 7f2779452740 1 --2- 172.21.15.2:0/3464151279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41acd7d40 0x55a41acef850 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:52.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.206+0000 7f2779452740 1 --2- 172.21.15.2:0/3464151279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a41accd480 0x55a41acef310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:52.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.206+0000 7f2779452740 1 -- 172.21.15.2:0/3464151279 >> 172.21.15.2:0/3464151279 conn(0x55a41acc90f0 msgr2=0x55a41acd6b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:52.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.206+0000 7f2779452740 1 -- 172.21.15.2:0/3464151279 shutdown_connections 2024-09-19T06:19:52.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.206+0000 7f2779452740 1 -- 172.21.15.2:0/3464151279 wait complete. 2024-09-19T06:19:52.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.207+0000 7f2779452740 1 -- start start 2024-09-19T06:19:52.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.207+0000 7f2779452740 1 Processor -- start 2024-09-19T06:19:52.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.207+0000 7f2779452740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a41accd480 0x55a41acdbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:52.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.207+0000 7f2779452740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a41acd4ba0 0x55a41acdc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:52.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.207+0000 7f2779452740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41acd7d40 0x55a41acdc740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.207+0000 7f2779452740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f27701abc80 con 0x55a41acd7d40 2024-09-19T06:19:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.207+0000 7f2779452740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f27701ad0f0 con 0x55a41acd4ba0 2024-09-19T06:19:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.207+0000 7f2779452740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f27701ac350 con 0x55a41accd480 2024-09-19T06:19:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.207+0000 7f2779452740 10 client.0 _ll_register_callbacks cb 0x7f276400dd00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.207+0000 7f276ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41acd7d40 0x55a41acdc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.207+0000 7f276ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41acd7d40 0x55a41acdc740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53588/0 (socket says 172.21.15.2:53588) 2024-09-19T06:19:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.207+0000 7f276ffff640 1 -- 172.21.15.2:0/3699377596 learned_addr learned my addr 172.21.15.2:0/3699377596 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.207+0000 7f276ffff640 1 --2- 172.21.15.2:0/3699377596 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a41accd480 0x55a41acdbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.207+0000 7f2774e15640 1 --2- 172.21.15.2:0/3699377596 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a41acd4ba0 0x55a41acdc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.208+0000 7f276ffff640 1 -- 172.21.15.2:0/3699377596 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a41accd480 msgr2=0x55a41acdbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.208+0000 7f276ffff640 1 --2- 172.21.15.2:0/3699377596 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a41accd480 0x55a41acdbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.208+0000 7f276ffff640 1 -- 172.21.15.2:0/3699377596 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a41acd4ba0 msgr2=0x55a41acdc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.208+0000 7f276ffff640 1 --2- 172.21.15.2:0/3699377596 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a41acd4ba0 0x55a41acdc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.208+0000 7f276ffff640 1 -- 172.21.15.2:0/3699377596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a41ad51530 con 0x55a41acd7d40 2024-09-19T06:19:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.208+0000 7f2774e15640 1 --2- 172.21.15.2:0/3699377596 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a41acd4ba0 0x55a41acdc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:19:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.208+0000 7f276ffff640 1 --2- 172.21.15.2:0/3699377596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41acd7d40 0x55a41acdc740 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f2764001eb0 tx=0x7f276400d6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a319a757c60eda48 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.208+0000 7f274ffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:19:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.208+0000 7f274ffff640 1 -- 172.21.15.2:0/3699377596 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2764022040 con 0x55a41acd7d40 2024-09-19T06:19:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.208+0000 7f274ffff640 1 -- 172.21.15.2:0/3699377596 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f2764005230 con 0x55a41acd7d40 2024-09-19T06:19:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.208+0000 7f2779452740 1 -- 172.21.15.2:0/3699377596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2760003ea0 con 0x55a41acd7d40 2024-09-19T06:19:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.208+0000 7f274ffff640 1 -- 172.21.15.2:0/3699377596 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2764005430 con 0x55a41acd7d40 2024-09-19T06:19:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.208+0000 7f2779452740 10 client.16512 fetch_fsmap learned FSMap version 26 2024-09-19T06:19:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.208+0000 7f2779452740 1 -- 172.21.15.2:0/3699377596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a41ad527c0 con 0x55a41acd7d40 2024-09-19T06:19:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.208+0000 7f274ffff640 1 -- 172.21.15.2:0/3699377596 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2760003ea0 con 0x55a41acd7d40 2024-09-19T06:19:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.208+0000 7f274ffff640 1 -- 172.21.15.2:0/3699377596 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f276401c070 con 0x55a41acd7d40 2024-09-19T06:19:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.209+0000 7f2779452740 10 client.16512 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:19:52.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.209+0000 7f2779452740 10 client.16512 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:19:52.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.209+0000 7f2779452740 20 client.16512 populate_metadata read hostname 'smithi002' 2024-09-19T06:19:52.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.209+0000 7f2779452740 1 --2- 172.21.15.2:0/3699377596 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a41ad52e50 0x55a41ad55270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:52.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.209+0000 7f2779452740 4 client.16512 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:19:52.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.209+0000 7f2779452740 1 -- 172.21.15.2:0/3699377596 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a41ac39d00 con 0x55a41ad52e50 2024-09-19T06:19:52.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.209+0000 7f2774e15640 1 --2- 172.21.15.2:0/3699377596 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a41ad52e50 0x55a41ad55270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:52.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.209+0000 7f2774e15640 1 --2- 172.21.15.2:0/3699377596 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a41ad52e50 0x55a41ad55270 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=501946c99688eb81 server_cookie=15fcbd9230111c0e in_seq=0 out_seq=0 2024-09-19T06:19:52.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.209+0000 7f274ffff640 10 client.16512 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:19:52.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.210+0000 7f274ffff640 1 -- 172.21.15.2:0/3699377596 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a41ac39d00 con 0x55a41ad52e50 2024-09-19T06:19:52.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.210+0000 7f274ffff640 10 client.16512 handle_command_reply: tid=0 2024-09-19T06:19:52.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.210+0000 7f2779452740 1 client.16512 shutdown 2024-09-19T06:19:52.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.210+0000 7f2779452740 1 -- 172.21.15.2:0/3699377596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41acd7d40 msgr2=0x55a41acdc740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:52.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.210+0000 7f2779452740 1 --2- 172.21.15.2:0/3699377596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41acd7d40 0x55a41acdc740 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f2764001eb0 tx=0x7f276400d6e0 comp rx=0 tx=0).stop 2024-09-19T06:19:52.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.210+0000 7f2779452740 1 -- 172.21.15.2:0/3699377596 shutdown_connections 2024-09-19T06:19:52.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.210+0000 7f2779452740 1 --2- 172.21.15.2:0/3699377596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a41acd7d40 0x55a41acdc740 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:52.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.210+0000 7f2779452740 1 --2- 172.21.15.2:0/3699377596 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a41ad52e50 0x55a41ad55270 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:52.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.211+0000 7f2779452740 1 --2- 172.21.15.2:0/3699377596 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a41acd4ba0 0x55a41acdc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:52.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.211+0000 7f2779452740 1 --2- 172.21.15.2:0/3699377596 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a41accd480 0x55a41acdbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:52.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.211+0000 7f2779452740 1 -- 172.21.15.2:0/3699377596 >> 172.21.15.2:0/3699377596 conn(0x55a41acc90f0 msgr2=0x55a41acd3ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:52.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.211+0000 7f274ffff640 0 client.16512 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:19:52.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.211+0000 7f2779452740 1 -- 172.21.15.2:0/3699377596 shutdown_connections 2024-09-19T06:19:52.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.211+0000 7f2779452740 1 -- 172.21.15.2:0/3699377596 wait complete. 2024-09-19T06:19:52.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.211+0000 7f2779452740 20 client.16512 trim_cache size 0 max 16384 2024-09-19T06:19:52.217 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:19:52.217 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T06:19:52.217 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "e1852f35-e31f-4292-b274-95517ec48718", 2024-09-19T06:19:52.218 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T06:19:52.218 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:19:52.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.211+0000 7f2777079640 1 -- 172.21.15.2:0/66696184 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f27580a33b0 msgr2=0x7f27580a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:52.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.211+0000 7f2777079640 1 --2- 172.21.15.2:0/66696184 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f27580a33b0 0x7f27580a5870 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f27680bd660 tx=0x7f27680ee040 comp rx=0 tx=0).stop 2024-09-19T06:19:52.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.211+0000 7f2777079640 1 -- 172.21.15.2:0/66696184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27701082a0 msgr2=0x7f277019ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:52.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.211+0000 7f2777079640 1 --2- 172.21.15.2:0/66696184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27701082a0 0x7f277019ccb0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f2768005cc0 tx=0x7f2768003ba0 comp rx=0 tx=0).stop 2024-09-19T06:19:52.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.211+0000 7f2777079640 1 -- 172.21.15.2:0/66696184 shutdown_connections 2024-09-19T06:19:52.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.211+0000 7f2777079640 1 --2- 172.21.15.2:0/66696184 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f27580a33b0 0x7f27580a5870 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:52.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.211+0000 7f2777079640 1 --2- 172.21.15.2:0/66696184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27701082a0 0x7f277019ccb0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:52.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.211+0000 7f2777079640 1 --2- 172.21.15.2:0/66696184 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27701036e0 0x7f2770198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:52.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.211+0000 7f2777079640 1 --2- 172.21.15.2:0/66696184 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2770102d30 0x7f27701983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:52.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.211+0000 7f2777079640 1 -- 172.21.15.2:0/66696184 >> 172.21.15.2:0/66696184 conn(0x7f27700fc7d0 msgr2=0x7f2770105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:52.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.212+0000 7f2777079640 1 -- 172.21.15.2:0/66696184 shutdown_connections 2024-09-19T06:19:52.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:52.212+0000 7f2777079640 1 -- 172.21.15.2:0/66696184 wait complete. 2024-09-19T06:19:53.018 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:19:53.278 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:19:53.717 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:53 smithi002 ceph-mon[30982]: pgmap v155: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:19:53.718 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:53 smithi002 ceph-mon[30982]: scrub queued for path: / 2024-09-19T06:19:53.718 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:53 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:19:53.718 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:53 smithi002 ceph-mon[30982]: scrub summary: active paths [/] 2024-09-19T06:19:53.718 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:53 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:19:53.718 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:53 smithi002 ceph-mon[30982]: scrub summary: idle 2024-09-19T06:19:53.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.718+0000 7f4abbeff640 1 -- 172.21.15.2:0/3924133816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ab410e810 msgr2=0x7f4ab4110c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:53.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.718+0000 7f4abbeff640 1 --2- 172.21.15.2:0/3924133816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ab410e810 0x7f4ab4110c00 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f4aac009ca0 tx=0x7f4aac02a8b0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.718+0000 7f4abbeff640 1 -- 172.21.15.2:0/3924133816 shutdown_connections 2024-09-19T06:19:53.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.718+0000 7f4abbeff640 1 --2- 172.21.15.2:0/3924133816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ab410e810 0x7f4ab4110c00 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.718+0000 7f4abbeff640 1 --2- 172.21.15.2:0/3924133816 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ab4102fc0 0x7f4ab41005d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.718+0000 7f4abbeff640 1 --2- 172.21.15.2:0/3924133816 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ab4102b50 0x7f4ab4100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.718+0000 7f4abbeff640 1 -- 172.21.15.2:0/3924133816 >> 172.21.15.2:0/3924133816 conn(0x7f4ab4077210 msgr2=0x7f4ab40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:53.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.718+0000 7f4abbeff640 1 -- 172.21.15.2:0/3924133816 shutdown_connections 2024-09-19T06:19:53.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.718+0000 7f4abbeff640 1 -- 172.21.15.2:0/3924133816 wait complete. 2024-09-19T06:19:53.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.719+0000 7f4abbeff640 1 Processor -- start 2024-09-19T06:19:53.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.719+0000 7f4abbeff640 1 -- start start 2024-09-19T06:19:53.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.719+0000 7f4abbeff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ab4102b50 0x7f4ab419a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.720+0000 7f4abbeff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ab410e810 0x7f4ab419aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.720+0000 7f4abbeff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ab419edf0 0x7f4ab419f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.720+0000 7f4abbeff640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab4114080 con 0x7f4ab410e810 2024-09-19T06:19:53.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.720+0000 7f4abbeff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab4113f00 con 0x7f4ab4102b50 2024-09-19T06:19:53.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.720+0000 7f4abbeff640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab4114200 con 0x7f4ab419edf0 2024-09-19T06:19:53.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.720+0000 7f4ab949a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ab410e810 0x7f4ab419aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.720+0000 7f4ab949a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ab410e810 0x7f4ab419aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53604/0 (socket says 172.21.15.2:53604) 2024-09-19T06:19:53.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.720+0000 7f4ab949a640 1 -- 172.21.15.2:0/1410086968 learned_addr learned my addr 172.21.15.2:0/1410086968 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:53.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.720+0000 7f4ab9c9b640 1 --2- 172.21.15.2:0/1410086968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ab4102b50 0x7f4ab419a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.720+0000 7f4aba49c640 1 --2- 172.21.15.2:0/1410086968 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ab419edf0 0x7f4ab419f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.720+0000 7f4ab949a640 1 -- 172.21.15.2:0/1410086968 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ab419edf0 msgr2=0x7f4ab419f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:53.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.720+0000 7f4ab949a640 1 --2- 172.21.15.2:0/1410086968 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ab419edf0 0x7f4ab419f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.720+0000 7f4ab949a640 1 -- 172.21.15.2:0/1410086968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ab4102b50 msgr2=0x7f4ab419a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:53.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.720+0000 7f4ab949a640 1 --2- 172.21.15.2:0/1410086968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ab4102b50 0x7f4ab419a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.720+0000 7f4ab949a640 1 -- 172.21.15.2:0/1410086968 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ab419f8b0 con 0x7f4ab410e810 2024-09-19T06:19:53.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.720+0000 7f4ab949a640 1 --2- 172.21.15.2:0/1410086968 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ab410e810 0x7f4ab419aa60 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f4aa400e9c0 tx=0x7f4aa400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:53.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.720+0000 7f4aaaffd640 1 -- 172.21.15.2:0/1410086968 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa400ccc0 con 0x7f4ab410e810 2024-09-19T06:19:53.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.720+0000 7f4aaaffd640 1 -- 172.21.15.2:0/1410086968 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4aa40054d0 con 0x7f4ab410e810 2024-09-19T06:19:53.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.720+0000 7f4abbeff640 1 -- 172.21.15.2:0/1410086968 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ab419fba0 con 0x7f4ab410e810 2024-09-19T06:19:53.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.721+0000 7f4aaaffd640 1 -- 172.21.15.2:0/1410086968 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa4010430 con 0x7f4ab410e810 2024-09-19T06:19:53.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.721+0000 7f4abbeff640 1 -- 172.21.15.2:0/1410086968 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ab41a7330 con 0x7f4ab410e810 2024-09-19T06:19:53.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.724+0000 7f4aaaffd640 1 -- 172.21.15.2:0/1410086968 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f4aa4005020 con 0x7f4ab410e810 2024-09-19T06:19:53.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.724+0000 7f4abe2d8740 1 Processor -- start 2024-09-19T06:19:53.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.724+0000 7f4abe2d8740 1 -- start start 2024-09-19T06:19:53.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.724+0000 7f4abe2d8740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f5acde4a0 0x560f5acde880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.724+0000 7f4abe2d8740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f5acdedc0 0x560f5ace9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.724+0000 7f4abe2d8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f5ace9680 0x560f5aceba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.724+0000 7f4abe2d8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560f5ac442e0 con 0x560f5ace9680 2024-09-19T06:19:53.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.724+0000 7f4abe2d8740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x560f5abebce0 con 0x560f5acde4a0 2024-09-19T06:19:53.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.724+0000 7f4abe2d8740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560f5ac402a0 con 0x560f5acdedc0 2024-09-19T06:19:53.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.724+0000 7f4ab949a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f5ace9680 0x560f5aceba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.724+0000 7f4ab949a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f5ace9680 0x560f5aceba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53616/0 (socket says 172.21.15.2:53616) 2024-09-19T06:19:53.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.724+0000 7f4ab949a640 1 -- 172.21.15.2:0/84153764 learned_addr learned my addr 172.21.15.2:0/84153764 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:53.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.724+0000 7f4aba49c640 1 --2- 172.21.15.2:0/84153764 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f5acde4a0 0x560f5acde880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.725+0000 7f4aaaffd640 1 --2- 172.21.15.2:0/1410086968 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4aa00a33b0 0x7f4aa00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.725+0000 7f4ab9c9b640 1 --2- 172.21.15.2:0/84153764 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f5acdedc0 0x560f5ace9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.725+0000 7f4aba49c640 1 --2- 172.21.15.2:0/1410086968 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4aa00a33b0 0x7f4aa00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.725+0000 7f4aaaffd640 1 -- 172.21.15.2:0/1410086968 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f4aa40d0320 con 0x7f4ab410e810 2024-09-19T06:19:53.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.725+0000 7f4ab949a640 1 -- 172.21.15.2:0/84153764 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f5acdedc0 msgr2=0x560f5ace9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:53.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.725+0000 7f4ab949a640 1 --2- 172.21.15.2:0/84153764 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f5acdedc0 0x560f5ace9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.725+0000 7f4ab949a640 1 -- 172.21.15.2:0/84153764 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f5acde4a0 msgr2=0x560f5acde880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:53.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.725+0000 7f4ab949a640 1 --2- 172.21.15.2:0/84153764 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f5acde4a0 0x560f5acde880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.725+0000 7f4ab949a640 1 -- 172.21.15.2:0/84153764 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f5abd0440 con 0x560f5ace9680 2024-09-19T06:19:53.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.725+0000 7f4ab949a640 1 --2- 172.21.15.2:0/84153764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f5ace9680 0x560f5aceba70 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f4aa40cd9b0 tx=0x7f4aa4004840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=168e03dab1068718 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:53.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.725+0000 7f4aba49c640 1 --2- 172.21.15.2:0/1410086968 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4aa00a33b0 0x7f4aa00a5870 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4aac005e30 tx=0x7f4aac02a8b0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:53.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.725+0000 7f4a9ffff640 1 -- 172.21.15.2:0/84153764 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa409bf30 con 0x560f5ace9680 2024-09-19T06:19:53.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.725+0000 7f4a9ffff640 1 -- 172.21.15.2:0/84153764 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4aa4005310 con 0x560f5ace9680 2024-09-19T06:19:53.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.725+0000 7f4a9ffff640 1 -- 172.21.15.2:0/84153764 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa400ce60 con 0x560f5ace9680 2024-09-19T06:19:53.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.726+0000 7f4abe2d8740 1 -- 172.21.15.2:0/84153764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f5ace9680 msgr2=0x560f5aceba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:53.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.726+0000 7f4abe2d8740 1 --2- 172.21.15.2:0/84153764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f5ace9680 0x560f5aceba70 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f4aa40cd9b0 tx=0x7f4aa4004840 comp rx=0 tx=0).stop 2024-09-19T06:19:53.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.726+0000 7f4abe2d8740 1 -- 172.21.15.2:0/84153764 shutdown_connections 2024-09-19T06:19:53.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.726+0000 7f4abe2d8740 1 --2- 172.21.15.2:0/84153764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f5ace9680 0x560f5aceba70 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.726+0000 7f4abe2d8740 1 --2- 172.21.15.2:0/84153764 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f5acdedc0 0x560f5ace9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.726+0000 7f4abe2d8740 1 --2- 172.21.15.2:0/84153764 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f5acde4a0 0x560f5acde880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.726+0000 7f4abe2d8740 1 -- 172.21.15.2:0/84153764 >> 172.21.15.2:0/84153764 conn(0x560f5acdaa30 msgr2=0x560f5acdae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:53.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.726+0000 7f4abe2d8740 1 -- 172.21.15.2:0/84153764 shutdown_connections 2024-09-19T06:19:53.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.726+0000 7f4abe2d8740 1 -- 172.21.15.2:0/84153764 wait complete. 2024-09-19T06:19:53.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.727+0000 7f4abe2d8740 1 -- start start 2024-09-19T06:19:53.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.727+0000 7f4abe2d8740 1 Processor -- start 2024-09-19T06:19:53.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.727+0000 7f4abe2d8740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f5acde4a0 0x560f5ace8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.727+0000 7f4abe2d8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f5acdedc0 0x560f5ace6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.727+0000 7f4abe2d8740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f5ace9680 0x560f5ace6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.727+0000 7f4abe2d8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560f5acec1f0 con 0x560f5acdedc0 2024-09-19T06:19:53.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.727+0000 7f4abe2d8740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x560f5abff050 con 0x560f5acde4a0 2024-09-19T06:19:53.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.727+0000 7f4abe2d8740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560f5acec370 con 0x560f5ace9680 2024-09-19T06:19:53.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.727+0000 7f4abe2d8740 10 client.0 _ll_register_callbacks cb 0x560f5ac3f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:53.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.727+0000 7f4ab9c9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f5acde4a0 0x560f5ace8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.727+0000 7f4ab9c9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f5acde4a0 0x560f5ace8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:38398/0 (socket says 172.21.15.2:38398) 2024-09-19T06:19:53.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.727+0000 7f4ab9c9b640 1 -- 172.21.15.2:0/2588876296 learned_addr learned my addr 172.21.15.2:0/2588876296 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:53.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.727+0000 7f4ab949a640 1 --2- 172.21.15.2:0/2588876296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f5acdedc0 0x560f5ace6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.728+0000 7f4aba49c640 1 --2- 172.21.15.2:0/2588876296 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f5ace9680 0x560f5ace6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.728+0000 7f4ab9c9b640 1 -- 172.21.15.2:0/2588876296 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f5ace9680 msgr2=0x560f5ace6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:53.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.728+0000 7f4ab9c9b640 1 --2- 172.21.15.2:0/2588876296 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f5ace9680 0x560f5ace6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.728+0000 7f4ab9c9b640 1 -- 172.21.15.2:0/2588876296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f5acdedc0 msgr2=0x560f5ace6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:53.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.728+0000 7f4ab9c9b640 1 --2- 172.21.15.2:0/2588876296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f5acdedc0 0x560f5ace6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.728+0000 7f4ab9c9b640 1 -- 172.21.15.2:0/2588876296 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f5a9b53c0 con 0x560f5acde4a0 2024-09-19T06:19:53.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.728+0000 7f4aba49c640 1 --2- 172.21.15.2:0/2588876296 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f5ace9680 0x560f5ace6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:19:53.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.728+0000 7f4ab949a640 1 --2- 172.21.15.2:0/2588876296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f5acdedc0 0x560f5ace6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:53.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.728+0000 7f4ab9c9b640 1 --2- 172.21.15.2:0/2588876296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f5acde4a0 0x560f5ace8f60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4ab000bad0 tx=0x7f4ab000bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d8e64f1e8d163ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:53.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.728+0000 7f4a9d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-09-19T06:19:53.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.728+0000 7f4a9d7fa640 1 -- 172.21.15.2:0/2588876296 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab0005020 con 0x560f5acde4a0 2024-09-19T06:19:53.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.728+0000 7f4abe2d8740 1 -- 172.21.15.2:0/2588876296 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560f5ac51850 con 0x560f5acde4a0 2024-09-19T06:19:53.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.728+0000 7f4a9d7fa640 1 -- 172.21.15.2:0/2588876296 <== mon.2 v2:172.21.15.89:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f4ab00051c0 con 0x560f5acde4a0 2024-09-19T06:19:53.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.728+0000 7f4a9d7fa640 1 -- 172.21.15.2:0/2588876296 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4ab0005400 con 0x560f5acde4a0 2024-09-19T06:19:53.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.728+0000 7f4abe2d8740 10 client.25967 fetch_fsmap learned FSMap version 26 2024-09-19T06:19:53.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.728+0000 7f4abe2d8740 1 -- 172.21.15.2:0/2588876296 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560f5acf7bc0 con 0x560f5acde4a0 2024-09-19T06:19:53.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.729+0000 7f4a9d7fa640 1 -- 172.21.15.2:0/2588876296 <== mon.2 v2:172.21.15.89:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x560f5ac51850 con 0x560f5acde4a0 2024-09-19T06:19:53.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.729+0000 7f4a9d7fa640 1 -- 172.21.15.2:0/2588876296 <== mon.2 v2:172.21.15.89:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f4ab001b590 con 0x560f5acde4a0 2024-09-19T06:19:53.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.729+0000 7f4abe2d8740 10 client.25967 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:19:53.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.729+0000 7f4abe2d8740 10 client.25967 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:19:53.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.729+0000 7f4abe2d8740 20 client.25967 populate_metadata read hostname 'smithi002' 2024-09-19T06:19:53.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.729+0000 7f4abe2d8740 1 --2- 172.21.15.2:0/2588876296 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560f5acf8fd0 0x560f5acfb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.729+0000 7f4abe2d8740 4 client.25967 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:19:53.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.729+0000 7f4abe2d8740 1 -- 172.21.15.2:0/2588876296 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560f5ac4bd60 con 0x560f5acf8fd0 2024-09-19T06:19:53.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.729+0000 7f4ab949a640 1 --2- 172.21.15.2:0/2588876296 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560f5acf8fd0 0x560f5acfb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.730+0000 7f4ab949a640 1 --2- 172.21.15.2:0/2588876296 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560f5acf8fd0 0x560f5acfb3e0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c513485dd5b7816 server_cookie=a74d90cc0d86f7c5 in_seq=0 out_seq=0 2024-09-19T06:19:53.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.730+0000 7f4a9d7fa640 10 client.25967 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:19:53.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.730+0000 7f4a9d7fa640 1 -- 172.21.15.2:0/2588876296 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560f5ac4bd60 con 0x560f5acf8fd0 2024-09-19T06:19:53.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.730+0000 7f4a9d7fa640 10 client.25967 handle_command_reply: tid=0 2024-09-19T06:19:53.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.730+0000 7f4abe2d8740 1 client.25967 shutdown 2024-09-19T06:19:53.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.730+0000 7f4abe2d8740 1 -- 172.21.15.2:0/2588876296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f5acde4a0 msgr2=0x560f5ace8f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:53.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.730+0000 7f4abe2d8740 1 --2- 172.21.15.2:0/2588876296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f5acde4a0 0x560f5ace8f60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4ab000bad0 tx=0x7f4ab000bed0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.731+0000 7f4abe2d8740 1 -- 172.21.15.2:0/2588876296 shutdown_connections 2024-09-19T06:19:53.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.731+0000 7f4abe2d8740 1 --2- 172.21.15.2:0/2588876296 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f5ace9680 0x560f5ace6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.731+0000 7f4abe2d8740 1 --2- 172.21.15.2:0/2588876296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f5acdedc0 0x560f5ace6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.731+0000 7f4abe2d8740 1 --2- 172.21.15.2:0/2588876296 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560f5acf8fd0 0x560f5acfb3e0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.731+0000 7f4abe2d8740 1 --2- 172.21.15.2:0/2588876296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f5acde4a0 0x560f5ace8f60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.731+0000 7f4abe2d8740 1 -- 172.21.15.2:0/2588876296 >> 172.21.15.2:0/2588876296 conn(0x560f5acdaa30 msgr2=0x560f5ace0710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:53.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.731+0000 7f4a9d7fa640 0 client.25967 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:19:53.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.731+0000 7f4abe2d8740 1 -- 172.21.15.2:0/2588876296 shutdown_connections 2024-09-19T06:19:53.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.731+0000 7f4abe2d8740 1 -- 172.21.15.2:0/2588876296 wait complete. 2024-09-19T06:19:53.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.731+0000 7f4abe2d8740 20 client.25967 trim_cache size 0 max 16384 2024-09-19T06:19:53.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.748+0000 7f4abe2d8740 1 Processor -- start 2024-09-19T06:19:53.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.748+0000 7f4abe2d8740 1 -- start start 2024-09-19T06:19:53.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.748+0000 7f4abe2d8740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f5acdaa30 0x560f5acf5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.748+0000 7f4abe2d8740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f5acde4a0 0x560f5ad00cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.748+0000 7f4abe2d8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f5acdedc0 0x560f5ad011f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.748+0000 7f4abe2d8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab41b2230 con 0x560f5acdedc0 2024-09-19T06:19:53.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.748+0000 7f4abe2d8740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab41afb00 con 0x560f5acde4a0 2024-09-19T06:19:53.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.748+0000 7f4abe2d8740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab41ad950 con 0x560f5acdaa30 2024-09-19T06:19:53.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.748+0000 7f4aba49c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f5acdedc0 0x560f5ad011f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.748+0000 7f4aba49c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f5acdedc0 0x560f5ad011f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53646/0 (socket says 172.21.15.2:53646) 2024-09-19T06:19:53.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.748+0000 7f4aba49c640 1 -- 172.21.15.2:0/950880152 learned_addr learned my addr 172.21.15.2:0/950880152 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:53.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.748+0000 7f4ab9c9b640 1 --2- 172.21.15.2:0/950880152 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f5acdaa30 0x560f5acf5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.748+0000 7f4ab949a640 1 --2- 172.21.15.2:0/950880152 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f5acde4a0 0x560f5ad00cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.748+0000 7f4aba49c640 1 -- 172.21.15.2:0/950880152 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f5acdaa30 msgr2=0x560f5acf5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:53.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.748+0000 7f4aba49c640 1 --2- 172.21.15.2:0/950880152 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f5acdaa30 0x560f5acf5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.748+0000 7f4aba49c640 1 -- 172.21.15.2:0/950880152 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f5acde4a0 msgr2=0x560f5ad00cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:53.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.748+0000 7f4aba49c640 1 --2- 172.21.15.2:0/950880152 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f5acde4a0 0x560f5ad00cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.748+0000 7f4aba49c640 1 -- 172.21.15.2:0/950880152 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f5acdfa20 con 0x560f5acdedc0 2024-09-19T06:19:53.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.749+0000 7f4aba49c640 1 --2- 172.21.15.2:0/950880152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f5acdedc0 0x560f5ad011f0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f4aac035000 tx=0x7f4aac005c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26044bef3019ea7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:53.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.749+0000 7f4a9f7fe640 1 -- 172.21.15.2:0/950880152 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aac045070 con 0x560f5acdedc0 2024-09-19T06:19:53.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.749+0000 7f4a9f7fe640 1 -- 172.21.15.2:0/950880152 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4aac051070 con 0x560f5acdedc0 2024-09-19T06:19:53.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.749+0000 7f4a9f7fe640 1 -- 172.21.15.2:0/950880152 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aac056470 con 0x560f5acdedc0 2024-09-19T06:19:53.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.749+0000 7f4abe2d8740 1 -- 172.21.15.2:0/950880152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f5acdedc0 msgr2=0x560f5ad011f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:53.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.749+0000 7f4abe2d8740 1 --2- 172.21.15.2:0/950880152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f5acdedc0 0x560f5ad011f0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f4aac035000 tx=0x7f4aac005c30 comp rx=0 tx=0).stop 2024-09-19T06:19:53.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.749+0000 7f4abe2d8740 1 -- 172.21.15.2:0/950880152 shutdown_connections 2024-09-19T06:19:53.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.749+0000 7f4abe2d8740 1 --2- 172.21.15.2:0/950880152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f5acdedc0 0x560f5ad011f0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.749+0000 7f4abe2d8740 1 --2- 172.21.15.2:0/950880152 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f5acde4a0 0x560f5ad00cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.749+0000 7f4abe2d8740 1 --2- 172.21.15.2:0/950880152 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f5acdaa30 0x560f5acf5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.749+0000 7f4abe2d8740 1 -- 172.21.15.2:0/950880152 >> 172.21.15.2:0/950880152 conn(0x560f5ace68b0 msgr2=0x560f5ace4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:53.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.749+0000 7f4abe2d8740 1 -- 172.21.15.2:0/950880152 shutdown_connections 2024-09-19T06:19:53.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.750+0000 7f4abe2d8740 1 -- 172.21.15.2:0/950880152 wait complete. 2024-09-19T06:19:53.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.750+0000 7f4abe2d8740 1 -- start start 2024-09-19T06:19:53.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.750+0000 7f4abe2d8740 1 Processor -- start 2024-09-19T06:19:53.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.750+0000 7f4abe2d8740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f5acdaa30 0x560f5acf1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.750+0000 7f4abe2d8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f5acde4a0 0x560f5aced020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.750+0000 7f4abe2d8740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f5acdedc0 0x560f5aced560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.750+0000 7f4abe2d8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab41adfc0 con 0x560f5acde4a0 2024-09-19T06:19:53.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.750+0000 7f4abe2d8740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab41af430 con 0x560f5acdaa30 2024-09-19T06:19:53.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.750+0000 7f4abe2d8740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab41ae690 con 0x560f5acdedc0 2024-09-19T06:19:53.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.750+0000 7f4abe2d8740 10 client.0 _ll_register_callbacks cb 0x7f4ab00040a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:53.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.750+0000 7f4ab949a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f5acde4a0 0x560f5aced020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.750+0000 7f4ab949a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f5acde4a0 0x560f5aced020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53656/0 (socket says 172.21.15.2:53656) 2024-09-19T06:19:53.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.750+0000 7f4ab949a640 1 -- 172.21.15.2:0/1713590986 learned_addr learned my addr 172.21.15.2:0/1713590986 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:53.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.751+0000 7f4ab9c9b640 1 --2- 172.21.15.2:0/1713590986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f5acdaa30 0x560f5acf1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.751+0000 7f4aba49c640 1 --2- 172.21.15.2:0/1713590986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f5acdedc0 0x560f5aced560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.751+0000 7f4ab949a640 1 -- 172.21.15.2:0/1713590986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f5acdedc0 msgr2=0x560f5aced560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:53.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.751+0000 7f4ab949a640 1 --2- 172.21.15.2:0/1713590986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f5acdedc0 0x560f5aced560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.751+0000 7f4ab949a640 1 -- 172.21.15.2:0/1713590986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f5acdaa30 msgr2=0x560f5acf1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:53.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.751+0000 7f4ab949a640 1 --2- 172.21.15.2:0/1713590986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f5acdaa30 0x560f5acf1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.751+0000 7f4ab949a640 1 -- 172.21.15.2:0/1713590986 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f5acedd90 con 0x560f5acde4a0 2024-09-19T06:19:53.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.751+0000 7f4ab9c9b640 1 --2- 172.21.15.2:0/1713590986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f5acdaa30 0x560f5acf1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:19:53.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.751+0000 7f4ab949a640 1 --2- 172.21.15.2:0/1713590986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f5acde4a0 0x560f5aced020 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4098f50 tx=0x7f4aa40cda50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4717d811c076b914 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:53.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.751+0000 7f4a9d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:19:53.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.751+0000 7f4a9d7fa640 1 -- 172.21.15.2:0/1713590986 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa409bf30 con 0x560f5acde4a0 2024-09-19T06:19:53.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.751+0000 7f4a9d7fa640 1 -- 172.21.15.2:0/1713590986 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f4aa409ba20 con 0x560f5acde4a0 2024-09-19T06:19:53.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.751+0000 7f4abe2d8740 1 -- 172.21.15.2:0/1713590986 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4aac051070 con 0x560f5acde4a0 2024-09-19T06:19:53.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.751+0000 7f4a9d7fa640 1 -- 172.21.15.2:0/1713590986 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4aa40cded0 con 0x560f5acde4a0 2024-09-19T06:19:53.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.751+0000 7f4abe2d8740 10 client.16530 fetch_fsmap learned FSMap version 26 2024-09-19T06:19:53.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.751+0000 7f4abe2d8740 1 -- 172.21.15.2:0/1713590986 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560f5ad63c20 con 0x560f5acde4a0 2024-09-19T06:19:53.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.752+0000 7f4a9d7fa640 1 -- 172.21.15.2:0/1713590986 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4aac051070 con 0x560f5acde4a0 2024-09-19T06:19:53.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.752+0000 7f4a9d7fa640 1 -- 172.21.15.2:0/1713590986 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f4aa40b2ba0 con 0x560f5acde4a0 2024-09-19T06:19:53.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.752+0000 7f4abe2d8740 10 client.16530 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:19:53.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.752+0000 7f4abe2d8740 10 client.16530 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:19:53.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.752+0000 7f4abe2d8740 20 client.16530 populate_metadata read hostname 'smithi002' 2024-09-19T06:19:53.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.752+0000 7f4abe2d8740 1 --2- 172.21.15.2:0/1713590986 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560f5ace9680 0x560f5ad65f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.752+0000 7f4abe2d8740 4 client.16530 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:19:53.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.752+0000 7f4abe2d8740 1 -- 172.21.15.2:0/1713590986 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560f5abc8210 con 0x560f5ace9680 2024-09-19T06:19:53.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.752+0000 7f4ab9c9b640 1 --2- 172.21.15.2:0/1713590986 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560f5ace9680 0x560f5ad65f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.752+0000 7f4ab9c9b640 1 --2- 172.21.15.2:0/1713590986 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560f5ace9680 0x560f5ad65f10 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a93534bd2360b063 server_cookie=b8da6a15b36eb72a in_seq=0 out_seq=0 2024-09-19T06:19:53.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.752+0000 7f4a9d7fa640 10 client.16530 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:19:53.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.753+0000 7f4a9d7fa640 1 -- 172.21.15.2:0/1713590986 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x560f5abc8210 con 0x560f5ace9680 2024-09-19T06:19:53.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.753+0000 7f4a9d7fa640 10 client.16530 handle_command_reply: tid=0 2024-09-19T06:19:53.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.753+0000 7f4abe2d8740 1 client.16530 shutdown 2024-09-19T06:19:53.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.753+0000 7f4abe2d8740 1 -- 172.21.15.2:0/1713590986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f5acde4a0 msgr2=0x560f5aced020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:53.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.753+0000 7f4abe2d8740 1 --2- 172.21.15.2:0/1713590986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f5acde4a0 0x560f5aced020 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4098f50 tx=0x7f4aa40cda50 comp rx=0 tx=0).stop 2024-09-19T06:19:53.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.753+0000 7f4abe2d8740 1 -- 172.21.15.2:0/1713590986 shutdown_connections 2024-09-19T06:19:53.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.753+0000 7f4abe2d8740 1 --2- 172.21.15.2:0/1713590986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f5acdedc0 0x560f5aced560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.753+0000 7f4abe2d8740 1 --2- 172.21.15.2:0/1713590986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f5acde4a0 0x560f5aced020 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.753+0000 7f4abe2d8740 1 --2- 172.21.15.2:0/1713590986 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560f5ace9680 0x560f5ad65f10 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.753+0000 7f4abe2d8740 1 --2- 172.21.15.2:0/1713590986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f5acdaa30 0x560f5acf1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.753+0000 7f4a9d7fa640 0 client.16530 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:19:53.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.753+0000 7f4abe2d8740 1 -- 172.21.15.2:0/1713590986 >> 172.21.15.2:0/1713590986 conn(0x560f5ace68b0 msgr2=0x560f5acd9350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:53.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.753+0000 7f4abe2d8740 1 -- 172.21.15.2:0/1713590986 shutdown_connections 2024-09-19T06:19:53.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.753+0000 7f4abe2d8740 1 -- 172.21.15.2:0/1713590986 wait complete. 2024-09-19T06:19:53.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.753+0000 7f4abe2d8740 20 client.16530 trim_cache size 0 max 16384 2024-09-19T06:19:53.760 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:19:53.760 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T06:19:53.760 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T06:19:53.760 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:19:53.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.754+0000 7f4abbeff640 1 -- 172.21.15.2:0/1410086968 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4aa00a33b0 msgr2=0x7f4aa00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:53.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.754+0000 7f4abbeff640 1 --2- 172.21.15.2:0/1410086968 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4aa00a33b0 0x7f4aa00a5870 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4aac005e30 tx=0x7f4aac02a8b0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.754+0000 7f4abbeff640 1 -- 172.21.15.2:0/1410086968 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ab410e810 msgr2=0x7f4ab419aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:53.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.754+0000 7f4abbeff640 1 --2- 172.21.15.2:0/1410086968 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ab410e810 0x7f4ab419aa60 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f4aa400e9c0 tx=0x7f4aa400ee80 comp rx=0 tx=0).stop 2024-09-19T06:19:53.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.754+0000 7f4abbeff640 1 -- 172.21.15.2:0/1410086968 shutdown_connections 2024-09-19T06:19:53.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.754+0000 7f4abbeff640 1 --2- 172.21.15.2:0/1410086968 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4aa00a33b0 0x7f4aa00a5870 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.754+0000 7f4abbeff640 1 --2- 172.21.15.2:0/1410086968 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ab419edf0 0x7f4ab419f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.754+0000 7f4abbeff640 1 --2- 172.21.15.2:0/1410086968 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ab410e810 0x7f4ab419aa60 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.754+0000 7f4abbeff640 1 --2- 172.21.15.2:0/1410086968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ab4102b50 0x7f4ab419a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.754+0000 7f4abbeff640 1 -- 172.21.15.2:0/1410086968 >> 172.21.15.2:0/1410086968 conn(0x7f4ab4077210 msgr2=0x7f4ab410fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:53.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.754+0000 7f4abbeff640 1 -- 172.21.15.2:0/1410086968 shutdown_connections 2024-09-19T06:19:53.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:53.754+0000 7f4abbeff640 1 -- 172.21.15.2:0/1410086968 wait complete. 2024-09-19T06:19:53.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:53 smithi090 ceph-mon[34497]: pgmap v155: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:19:53.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:53 smithi090 ceph-mon[34497]: scrub queued for path: / 2024-09-19T06:19:53.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:53 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:19:53.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:53 smithi090 ceph-mon[34497]: scrub summary: active paths [/] 2024-09-19T06:19:53.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:53 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:19:53.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:53 smithi090 ceph-mon[34497]: scrub summary: idle 2024-09-19T06:19:54.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:53 smithi089 ceph-mon[34160]: pgmap v155: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:19:54.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:53 smithi089 ceph-mon[34160]: scrub queued for path: / 2024-09-19T06:19:54.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:53 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:19:54.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:53 smithi089 ceph-mon[34160]: scrub summary: active paths [/] 2024-09-19T06:19:54.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:53 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:19:54.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:53 smithi089 ceph-mon[34160]: scrub summary: idle 2024-09-19T06:19:54.534 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:19:54.535 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:19:54.797 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:19:55.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.306+0000 7ff2ab9b2640 1 -- 172.21.15.2:0/3783279098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2a410e480 msgr2=0x7ff2a4110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:55.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.306+0000 7ff2ab9b2640 1 --2- 172.21.15.2:0/3783279098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2a410e480 0x7ff2a4110870 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7ff29c009ca0 tx=0x7ff29c02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.306+0000 7ff2ab9b2640 1 -- 172.21.15.2:0/3783279098 shutdown_connections 2024-09-19T06:19:55.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.306+0000 7ff2ab9b2640 1 --2- 172.21.15.2:0/3783279098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2a410e480 0x7ff2a4110870 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.306+0000 7ff2ab9b2640 1 --2- 172.21.15.2:0/3783279098 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2a4101280 0x7ff2a410df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.306+0000 7ff2ab9b2640 1 --2- 172.21.15.2:0/3783279098 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2a41008d0 0x7ff2a4100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.306+0000 7ff2ab9b2640 1 -- 172.21.15.2:0/3783279098 >> 172.21.15.2:0/3783279098 conn(0x7ff2a40fc7a0 msgr2=0x7ff2a40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:55.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.306+0000 7ff2ab9b2640 1 -- 172.21.15.2:0/3783279098 shutdown_connections 2024-09-19T06:19:55.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.306+0000 7ff2ab9b2640 1 -- 172.21.15.2:0/3783279098 wait complete. 2024-09-19T06:19:55.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.306+0000 7ff2ab9b2640 1 Processor -- start 2024-09-19T06:19:55.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.307+0000 7ff2ab9b2640 1 -- start start 2024-09-19T06:19:55.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.307+0000 7ff2ab9b2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2a41008d0 0x7ff2a419a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:55.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.307+0000 7ff2ab9b2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2a4101280 0x7ff2a419ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:55.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.307+0000 7ff2ab9b2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2a410e480 0x7ff2a419eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:55.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.307+0000 7ff2ab9b2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a4114080 con 0x7ff2a41008d0 2024-09-19T06:19:55.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.307+0000 7ff2ab9b2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a4113f00 con 0x7ff2a4101280 2024-09-19T06:19:55.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.307+0000 7ff2ab9b2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a4114200 con 0x7ff2a410e480 2024-09-19T06:19:55.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.307+0000 7ff2a974e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2a41008d0 0x7ff2a419a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:55.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.307+0000 7ff2a974e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2a41008d0 0x7ff2a419a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53678/0 (socket says 172.21.15.2:53678) 2024-09-19T06:19:55.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.307+0000 7ff2a974e640 1 -- 172.21.15.2:0/1569296928 learned_addr learned my addr 172.21.15.2:0/1569296928 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:55.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.307+0000 7ff2a9f4f640 1 --2- 172.21.15.2:0/1569296928 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2a410e480 0x7ff2a419eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:55.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.307+0000 7ff2a974e640 1 -- 172.21.15.2:0/1569296928 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2a410e480 msgr2=0x7ff2a419eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:55.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.307+0000 7ff2a974e640 1 --2- 172.21.15.2:0/1569296928 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2a410e480 0x7ff2a419eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.308+0000 7ff2a974e640 1 -- 172.21.15.2:0/1569296928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2a4101280 msgr2=0x7ff2a419ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:55.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.308+0000 7ff2a974e640 1 --2- 172.21.15.2:0/1569296928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2a4101280 0x7ff2a419ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.308+0000 7ff2a974e640 1 -- 172.21.15.2:0/1569296928 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2a419f5b0 con 0x7ff2a41008d0 2024-09-19T06:19:55.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.308+0000 7ff2a974e640 1 --2- 172.21.15.2:0/1569296928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2a41008d0 0x7ff2a419a600 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7ff2a000b4a0 tx=0x7ff2a000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:55.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.308+0000 7ff29a7fc640 1 -- 172.21.15.2:0/1569296928 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a0014070 con 0x7ff2a41008d0 2024-09-19T06:19:55.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.308+0000 7ff29a7fc640 1 -- 172.21.15.2:0/1569296928 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff2a0010ac0 con 0x7ff2a41008d0 2024-09-19T06:19:55.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.308+0000 7ff2ab9b2640 1 -- 172.21.15.2:0/1569296928 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2a419f8a0 con 0x7ff2a41008d0 2024-09-19T06:19:55.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.308+0000 7ff29a7fc640 1 -- 172.21.15.2:0/1569296928 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a0017be0 con 0x7ff2a41008d0 2024-09-19T06:19:55.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.308+0000 7ff2ab9b2640 1 -- 172.21.15.2:0/1569296928 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2a41a7180 con 0x7ff2a41008d0 2024-09-19T06:19:55.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.309+0000 7ff2ab9b2640 1 -- 172.21.15.2:0/1569296928 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2a4100cb0 con 0x7ff2a41008d0 2024-09-19T06:19:55.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.310+0000 7ff29a7fc640 1 -- 172.21.15.2:0/1569296928 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7ff2a0017070 con 0x7ff2a41008d0 2024-09-19T06:19:55.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.311+0000 7ff29a7fc640 1 --2- 172.21.15.2:0/1569296928 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff2900a3430 0x7ff2900a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:55.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.311+0000 7ff29a7fc640 1 -- 172.21.15.2:0/1569296928 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7ff2a00cef80 con 0x7ff2a41008d0 2024-09-19T06:19:55.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.311+0000 7ff2a8f4d640 1 --2- 172.21.15.2:0/1569296928 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff2900a3430 0x7ff2900a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:55.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.312+0000 7ff2a8f4d640 1 --2- 172.21.15.2:0/1569296928 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff2900a3430 0x7ff2900a58f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff294005fd0 tx=0x7ff294005850 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:55.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.316+0000 7ff29a7fc640 1 -- 172.21.15.2:0/1569296928 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff2a009baa0 con 0x7ff2a41008d0 2024-09-19T06:19:55.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.529+0000 7ff2ab9b2640 1 -- 172.21.15.2:0/1569296928 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff2a4109080 con 0x7ff2a41008d0 2024-09-19T06:19:55.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.530+0000 7ff29a7fc640 1 -- 172.21.15.2:0/1569296928 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11882 (secure 0 0 0) 0x7ff2a009b3a0 con 0x7ff2a41008d0 2024-09-19T06:19:55.532 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:19:55.532 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-09-19T06:14:49:104280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:14:48.191083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24470,24472,24497]},"id":1}]} 2024-09-19T06:19:55.533 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-09-19T06:19:55.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.533+0000 7ff2ab9b2640 1 -- 172.21.15.2:0/1569296928 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff2900a3430 msgr2=0x7ff2900a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:55.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.533+0000 7ff2ab9b2640 1 --2- 172.21.15.2:0/1569296928 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff2900a3430 0x7ff2900a58f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff294005fd0 tx=0x7ff294005850 comp rx=0 tx=0).stop 2024-09-19T06:19:55.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.533+0000 7ff2ab9b2640 1 -- 172.21.15.2:0/1569296928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2a41008d0 msgr2=0x7ff2a419a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:55.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.533+0000 7ff2ab9b2640 1 --2- 172.21.15.2:0/1569296928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2a41008d0 0x7ff2a419a600 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7ff2a000b4a0 tx=0x7ff2a000b960 comp rx=0 tx=0).stop 2024-09-19T06:19:55.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.533+0000 7ff2ab9b2640 1 -- 172.21.15.2:0/1569296928 shutdown_connections 2024-09-19T06:19:55.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.533+0000 7ff2ab9b2640 1 --2- 172.21.15.2:0/1569296928 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff2900a3430 0x7ff2900a58f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.533+0000 7ff2ab9b2640 1 --2- 172.21.15.2:0/1569296928 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2a410e480 0x7ff2a419eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.533+0000 7ff2ab9b2640 1 --2- 172.21.15.2:0/1569296928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2a4101280 0x7ff2a419ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.533+0000 7ff2ab9b2640 1 --2- 172.21.15.2:0/1569296928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2a41008d0 0x7ff2a419a600 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.533+0000 7ff2ab9b2640 1 -- 172.21.15.2:0/1569296928 >> 172.21.15.2:0/1569296928 conn(0x7ff2a40fc7a0 msgr2=0x7ff2a40feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:55.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.533+0000 7ff2ab9b2640 1 -- 172.21.15.2:0/1569296928 shutdown_connections 2024-09-19T06:19:55.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:55.533+0000 7ff2ab9b2640 1 -- 172.21.15.2:0/1569296928 wait complete. 2024-09-19T06:19:55.844 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:55 smithi089 ceph-mon[34160]: pgmap v156: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:19:55.844 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:55 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1569296928' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:19:55.846 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:55 smithi002 ceph-mon[30982]: pgmap v156: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:19:55.846 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:55 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1569296928' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:19:55.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:55 smithi090 ceph-mon[34497]: pgmap v156: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:19:55.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:55 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1569296928' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:19:56.145 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:19:56.406 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:19:56.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.867+0000 7fe6b3510640 1 -- 172.21.15.2:0/3862404870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6ac102dd0 msgr2=0x7fe6ac1031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:56.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.867+0000 7fe6b3510640 1 --2- 172.21.15.2:0/3862404870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6ac102dd0 0x7fe6ac1031b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4009930 tx=0x7fe6a402a420 comp rx=0 tx=0).stop 2024-09-19T06:19:56.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.867+0000 7fe6b3510640 1 -- 172.21.15.2:0/3862404870 shutdown_connections 2024-09-19T06:19:56.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.867+0000 7fe6b3510640 1 --2- 172.21.15.2:0/3862404870 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe6ac108300 0x7fe6ac10ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:56.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.867+0000 7fe6b3510640 1 --2- 172.21.15.2:0/3862404870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6ac103780 0x7fe6ac107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:56.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.867+0000 7fe6b3510640 1 --2- 172.21.15.2:0/3862404870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6ac102dd0 0x7fe6ac1031b0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:56.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.867+0000 7fe6b3510640 1 -- 172.21.15.2:0/3862404870 >> 172.21.15.2:0/3862404870 conn(0x7fe6ac0fc7d0 msgr2=0x7fe6ac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:56.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.867+0000 7fe6b3510640 1 -- 172.21.15.2:0/3862404870 shutdown_connections 2024-09-19T06:19:56.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.867+0000 7fe6b3510640 1 -- 172.21.15.2:0/3862404870 wait complete. 2024-09-19T06:19:56.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.867+0000 7fe6b3510640 1 Processor -- start 2024-09-19T06:19:56.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.868+0000 7fe6b3510640 1 -- start start 2024-09-19T06:19:56.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.868+0000 7fe6b3510640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6ac102dd0 0x7fe6ac198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:56.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.868+0000 7fe6b3510640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6ac103780 0x7fe6ac1989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:56.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.868+0000 7fe6b3510640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe6ac108300 0x7fe6ac19cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:56.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.868+0000 7fe6b3510640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ac111f60 con 0x7fe6ac102dd0 2024-09-19T06:19:56.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.868+0000 7fe6b3510640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ac111de0 con 0x7fe6ac103780 2024-09-19T06:19:56.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.868+0000 7fe6b3510640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ac1120e0 con 0x7fe6ac108300 2024-09-19T06:19:56.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.868+0000 7fe6b12ac640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6ac102dd0 0x7fe6ac198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:56.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.868+0000 7fe6b12ac640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6ac102dd0 0x7fe6ac198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35760/0 (socket says 172.21.15.2:35760) 2024-09-19T06:19:56.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.868+0000 7fe6b12ac640 1 -- 172.21.15.2:0/2633114847 learned_addr learned my addr 172.21.15.2:0/2633114847 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:56.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.868+0000 7fe6b1aad640 1 --2- 172.21.15.2:0/2633114847 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe6ac108300 0x7fe6ac19cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:56.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.868+0000 7fe6b0aab640 1 --2- 172.21.15.2:0/2633114847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6ac103780 0x7fe6ac1989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:56.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.868+0000 7fe6b12ac640 1 -- 172.21.15.2:0/2633114847 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe6ac108300 msgr2=0x7fe6ac19cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:56.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.868+0000 7fe6b12ac640 1 --2- 172.21.15.2:0/2633114847 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe6ac108300 0x7fe6ac19cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:56.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.868+0000 7fe6b12ac640 1 -- 172.21.15.2:0/2633114847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6ac103780 msgr2=0x7fe6ac1989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:56.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.868+0000 7fe6b12ac640 1 --2- 172.21.15.2:0/2633114847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6ac103780 0x7fe6ac1989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:56.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.868+0000 7fe6b12ac640 1 -- 172.21.15.2:0/2633114847 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ac19d430 con 0x7fe6ac102dd0 2024-09-19T06:19:56.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.868+0000 7fe6b0aab640 1 --2- 172.21.15.2:0/2633114847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6ac103780 0x7fe6ac1989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:19:56.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.868+0000 7fe6b12ac640 1 --2- 172.21.15.2:0/2633114847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6ac102dd0 0x7fe6ac198480 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4004770 tx=0x7fe6a40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:56.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.869+0000 7fe6aa7fc640 1 -- 172.21.15.2:0/2633114847 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a403f070 con 0x7fe6ac102dd0 2024-09-19T06:19:56.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.869+0000 7fe6aa7fc640 1 -- 172.21.15.2:0/2633114847 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe6a403b460 con 0x7fe6ac102dd0 2024-09-19T06:19:56.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.869+0000 7fe6b3510640 1 -- 172.21.15.2:0/2633114847 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6ac19d6c0 con 0x7fe6ac102dd0 2024-09-19T06:19:56.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.869+0000 7fe6aa7fc640 1 -- 172.21.15.2:0/2633114847 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a4035070 con 0x7fe6ac102dd0 2024-09-19T06:19:56.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.869+0000 7fe6b3510640 1 -- 172.21.15.2:0/2633114847 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6ac1a5000 con 0x7fe6ac102dd0 2024-09-19T06:19:56.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.871+0000 7fe6aa7fc640 1 -- 172.21.15.2:0/2633114847 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fe6a403b610 con 0x7fe6ac102dd0 2024-09-19T06:19:56.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.871+0000 7fe6b58e9740 1 Processor -- start 2024-09-19T06:19:56.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.871+0000 7fe6b58e9740 1 -- start start 2024-09-19T06:19:56.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.872+0000 7fe6b58e9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56210a956b40 0x56210a955090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:56.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.872+0000 7fe6b58e9740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56210a9555d0 0x56210a955a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:56.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.872+0000 7fe6b58e9740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56210a960370 0x56210a962760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:56.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.872+0000 7fe6b58e9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56210a8bb2f0 con 0x56210a956b40 2024-09-19T06:19:56.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.872+0000 7fe6b58e9740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56210a862cf0 con 0x56210a9555d0 2024-09-19T06:19:56.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.872+0000 7fe6b58e9740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56210a8b72b0 con 0x56210a960370 2024-09-19T06:19:56.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.872+0000 7fe6b1aad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56210a956b40 0x56210a955090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:56.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.872+0000 7fe6b1aad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56210a956b40 0x56210a955090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35766/0 (socket says 172.21.15.2:35766) 2024-09-19T06:19:56.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.872+0000 7fe6b1aad640 1 -- 172.21.15.2:0/2162093004 learned_addr learned my addr 172.21.15.2:0/2162093004 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:56.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.872+0000 7fe6b12ac640 1 --2- 172.21.15.2:0/2162093004 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56210a9555d0 0x56210a955a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:56.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.872+0000 7fe6b0aab640 1 --2- 172.21.15.2:0/2162093004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56210a960370 0x56210a962760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:56.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.872+0000 7fe6b1aad640 1 -- 172.21.15.2:0/2162093004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56210a960370 msgr2=0x56210a962760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:56.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.872+0000 7fe6b1aad640 1 --2- 172.21.15.2:0/2162093004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56210a960370 0x56210a962760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:56.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.872+0000 7fe6b1aad640 1 -- 172.21.15.2:0/2162093004 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56210a9555d0 msgr2=0x56210a955a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:56.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.872+0000 7fe6b1aad640 1 --2- 172.21.15.2:0/2162093004 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56210a9555d0 0x56210a955a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:56.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.872+0000 7fe6aa7fc640 1 --2- 172.21.15.2:0/2633114847 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe6940a33b0 0x7fe6940a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:56.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.872+0000 7fe6b1aad640 1 -- 172.21.15.2:0/2162093004 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56210a8473a0 con 0x56210a956b40 2024-09-19T06:19:56.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.872+0000 7fe6b0aab640 1 --2- 172.21.15.2:0/2633114847 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe6940a33b0 0x7fe6940a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:56.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.872+0000 7fe6aa7fc640 1 -- 172.21.15.2:0/2633114847 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fe6a40f0110 con 0x7fe6ac102dd0 2024-09-19T06:19:56.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.872+0000 7fe6b1aad640 1 --2- 172.21.15.2:0/2162093004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56210a956b40 0x56210a955090 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fe69c009f70 tx=0x7fe69c010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a04c1675457e8b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:56.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.873+0000 7fe6937fe640 1 -- 172.21.15.2:0/2162093004 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69c016070 con 0x56210a956b40 2024-09-19T06:19:56.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.873+0000 7fe6937fe640 1 -- 172.21.15.2:0/2162093004 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe69c004d20 con 0x56210a956b40 2024-09-19T06:19:56.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.873+0000 7fe6937fe640 1 -- 172.21.15.2:0/2162093004 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69c0127b0 con 0x56210a956b40 2024-09-19T06:19:56.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.873+0000 7fe6b58e9740 1 -- 172.21.15.2:0/2162093004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56210a956b40 msgr2=0x56210a955090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:56.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.873+0000 7fe6b58e9740 1 --2- 172.21.15.2:0/2162093004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56210a956b40 0x56210a955090 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fe69c009f70 tx=0x7fe69c010800 comp rx=0 tx=0).stop 2024-09-19T06:19:56.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.873+0000 7fe6b0aab640 1 --2- 172.21.15.2:0/2633114847 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe6940a33b0 0x7fe6940a5870 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0005fd0 tx=0x7fe6a0005850 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:56.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.873+0000 7fe6b58e9740 1 -- 172.21.15.2:0/2162093004 shutdown_connections 2024-09-19T06:19:56.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.873+0000 7fe6b58e9740 1 --2- 172.21.15.2:0/2162093004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56210a960370 0x56210a962760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:56.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.873+0000 7fe6b58e9740 1 --2- 172.21.15.2:0/2162093004 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56210a9555d0 0x56210a955a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:56.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.873+0000 7fe6b58e9740 1 --2- 172.21.15.2:0/2162093004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56210a956b40 0x56210a955090 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:56.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.873+0000 7fe6b58e9740 1 -- 172.21.15.2:0/2162093004 >> 172.21.15.2:0/2162093004 conn(0x56210a91e310 msgr2=0x56210a951c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:56.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.873+0000 7fe6b58e9740 1 -- 172.21.15.2:0/2162093004 shutdown_connections 2024-09-19T06:19:56.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.873+0000 7fe6b58e9740 1 -- 172.21.15.2:0/2162093004 wait complete. 2024-09-19T06:19:56.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.874+0000 7fe6b58e9740 1 -- start start 2024-09-19T06:19:56.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.874+0000 7fe6b58e9740 1 Processor -- start 2024-09-19T06:19:56.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.874+0000 7fe6b58e9740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56210a9555d0 0x56210a95fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:56.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.874+0000 7fe6b58e9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56210a956b40 0x56210a95cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:56.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.874+0000 7fe6b58e9740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56210a960370 0x56210a95d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:56.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.874+0000 7fe6b58e9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56210a963070 con 0x56210a956b40 2024-09-19T06:19:56.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.874+0000 7fe6b58e9740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56210a876060 con 0x56210a960370 2024-09-19T06:19:56.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.874+0000 7fe6b58e9740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56210a9631f0 con 0x56210a9555d0 2024-09-19T06:19:56.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.875+0000 7fe6b58e9740 10 client.0 _ll_register_callbacks cb 0x56210a5c98c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:56.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.875+0000 7fe6b0aab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56210a956b40 0x56210a95cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:56.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.875+0000 7fe6b0aab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56210a956b40 0x56210a95cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35774/0 (socket says 172.21.15.2:35774) 2024-09-19T06:19:56.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.875+0000 7fe6b0aab640 1 -- 172.21.15.2:0/2988946383 learned_addr learned my addr 172.21.15.2:0/2988946383 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:56.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.875+0000 7fe6b1aad640 1 --2- 172.21.15.2:0/2988946383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56210a960370 0x56210a95d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:56.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.875+0000 7fe6b12ac640 1 --2- 172.21.15.2:0/2988946383 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56210a9555d0 0x56210a95fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:56.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.875+0000 7fe6b0aab640 1 -- 172.21.15.2:0/2988946383 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56210a9555d0 msgr2=0x56210a95fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:56.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.875+0000 7fe6b0aab640 1 --2- 172.21.15.2:0/2988946383 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56210a9555d0 0x56210a95fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:56.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.875+0000 7fe6b0aab640 1 -- 172.21.15.2:0/2988946383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56210a960370 msgr2=0x56210a95d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:56.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.875+0000 7fe6b0aab640 1 --2- 172.21.15.2:0/2988946383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56210a960370 0x56210a95d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:56.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.875+0000 7fe6b0aab640 1 -- 172.21.15.2:0/2988946383 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56210a62c3c0 con 0x56210a956b40 2024-09-19T06:19:56.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.875+0000 7fe6b12ac640 1 --2- 172.21.15.2:0/2988946383 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56210a9555d0 0x56210a95fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:19:56.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.875+0000 7fe6b0aab640 1 --2- 172.21.15.2:0/2988946383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56210a956b40 0x56210a95cff0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac0697d0 tx=0x7fe6a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7209b556ee9bad5e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:56.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.875+0000 7fe690ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:19:56.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.875+0000 7fe690ff9640 1 -- 172.21.15.2:0/2988946383 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a001d420 con 0x56210a956b40 2024-09-19T06:19:56.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.875+0000 7fe690ff9640 1 -- 172.21.15.2:0/2988946383 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fe6a001d5c0 con 0x56210a956b40 2024-09-19T06:19:56.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.875+0000 7fe6b58e9740 1 -- 172.21.15.2:0/2988946383 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe69c004d20 con 0x56210a956b40 2024-09-19T06:19:56.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.875+0000 7fe690ff9640 1 -- 172.21.15.2:0/2988946383 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe6a001d7c0 con 0x56210a956b40 2024-09-19T06:19:56.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.875+0000 7fe6b58e9740 10 client.16548 fetch_fsmap learned FSMap version 26 2024-09-19T06:19:56.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.875+0000 7fe6b58e9740 1 -- 172.21.15.2:0/2988946383 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56210a96eb40 con 0x56210a956b40 2024-09-19T06:19:56.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.876+0000 7fe690ff9640 1 -- 172.21.15.2:0/2988946383 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe69c004d20 con 0x56210a956b40 2024-09-19T06:19:56.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.876+0000 7fe690ff9640 1 -- 172.21.15.2:0/2988946383 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fe6a002e880 con 0x56210a956b40 2024-09-19T06:19:56.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.876+0000 7fe6b58e9740 10 client.16548 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:19:56.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.876+0000 7fe6b58e9740 10 client.16548 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:19:56.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.876+0000 7fe6b58e9740 20 client.16548 populate_metadata read hostname 'smithi002' 2024-09-19T06:19:56.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.876+0000 7fe6b58e9740 1 --2- 172.21.15.2:0/2988946383 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x56210a96ffa0 0x56210a9723e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:56.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.876+0000 7fe6b58e9740 4 client.16548 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:19:56.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.876+0000 7fe6b58e9740 1 -- 172.21.15.2:0/2988946383 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56210a8c8860 con 0x56210a96ffa0 2024-09-19T06:19:56.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.876+0000 7fe6b12ac640 1 --2- 172.21.15.2:0/2988946383 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x56210a96ffa0 0x56210a9723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:56.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.877+0000 7fe690ff9640 10 client.16548 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:19:56.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.877+0000 7fe6b12ac640 1 --2- 172.21.15.2:0/2988946383 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x56210a96ffa0 0x56210a9723e0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=250d9ed82e391bbe server_cookie=9b9b61907dd9906d in_seq=0 out_seq=0 2024-09-19T06:19:56.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.877+0000 7fe690ff9640 1 -- 172.21.15.2:0/2988946383 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56210a8c8860 con 0x56210a96ffa0 2024-09-19T06:19:56.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.877+0000 7fe690ff9640 10 client.16548 handle_command_reply: tid=0 2024-09-19T06:19:56.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.877+0000 7fe6b58e9740 1 client.16548 shutdown 2024-09-19T06:19:56.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.877+0000 7fe6b58e9740 1 -- 172.21.15.2:0/2988946383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56210a956b40 msgr2=0x56210a95cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:56.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.877+0000 7fe6b58e9740 1 --2- 172.21.15.2:0/2988946383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56210a956b40 0x56210a95cff0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac0697d0 tx=0x7fe6a00046c0 comp rx=0 tx=0).stop 2024-09-19T06:19:56.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.877+0000 7fe6b58e9740 1 -- 172.21.15.2:0/2988946383 shutdown_connections 2024-09-19T06:19:56.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.877+0000 7fe6b58e9740 1 --2- 172.21.15.2:0/2988946383 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x56210a96ffa0 0x56210a9723e0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:56.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.877+0000 7fe6b58e9740 1 --2- 172.21.15.2:0/2988946383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56210a960370 0x56210a95d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:56.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.877+0000 7fe690ff9640 0 client.16548 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:19:56.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.877+0000 7fe6b58e9740 1 --2- 172.21.15.2:0/2988946383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56210a956b40 0x56210a95cff0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:56.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.877+0000 7fe6b58e9740 1 --2- 172.21.15.2:0/2988946383 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56210a9555d0 0x56210a95fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:56.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.878+0000 7fe6b58e9740 1 -- 172.21.15.2:0/2988946383 >> 172.21.15.2:0/2988946383 conn(0x56210a91e310 msgr2=0x56210a957930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:56.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.878+0000 7fe6b58e9740 1 -- 172.21.15.2:0/2988946383 shutdown_connections 2024-09-19T06:19:56.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.878+0000 7fe6b58e9740 1 -- 172.21.15.2:0/2988946383 wait complete. 2024-09-19T06:19:56.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.878+0000 7fe6b58e9740 20 client.16548 trim_cache size 0 max 16384 2024-09-19T06:19:56.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.891+0000 7fe6b58e9740 1 Processor -- start 2024-09-19T06:19:56.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.891+0000 7fe6b58e9740 1 -- start start 2024-09-19T06:19:56.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.892+0000 7fe6b58e9740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56210a9555d0 0x56210a95ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:56.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.892+0000 7fe6b58e9740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56210a956b40 0x56210a958120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:56.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.892+0000 7fe6b58e9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56210a960370 0x56210a958660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:56.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.892+0000 7fe6b58e9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ac1b0000 con 0x56210a960370 2024-09-19T06:19:56.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.892+0000 7fe6b58e9740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ac1ad8d0 con 0x56210a9555d0 2024-09-19T06:19:56.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.892+0000 7fe6b58e9740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ac1ab720 con 0x56210a956b40 2024-09-19T06:19:56.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.892+0000 7fe6b1aad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56210a960370 0x56210a958660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:56.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.892+0000 7fe6b1aad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56210a960370 0x56210a958660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35780/0 (socket says 172.21.15.2:35780) 2024-09-19T06:19:56.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.892+0000 7fe6b1aad640 1 -- 172.21.15.2:0/3185959975 learned_addr learned my addr 172.21.15.2:0/3185959975 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:56.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.892+0000 7fe6b0aab640 1 --2- 172.21.15.2:0/3185959975 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56210a956b40 0x56210a958120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:56.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.892+0000 7fe6b12ac640 1 --2- 172.21.15.2:0/3185959975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56210a9555d0 0x56210a95ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:56.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.892+0000 7fe6b1aad640 1 -- 172.21.15.2:0/3185959975 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56210a956b40 msgr2=0x56210a958120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:56.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.892+0000 7fe6b1aad640 1 --2- 172.21.15.2:0/3185959975 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56210a956b40 0x56210a958120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:56.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.892+0000 7fe6b1aad640 1 -- 172.21.15.2:0/3185959975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56210a9555d0 msgr2=0x56210a95ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:56.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.892+0000 7fe6b1aad640 1 --2- 172.21.15.2:0/3185959975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56210a9555d0 0x56210a95ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:56.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.892+0000 7fe6b1aad640 1 -- 172.21.15.2:0/3185959975 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56210a956780 con 0x56210a960370 2024-09-19T06:19:56.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.892+0000 7fe6b12ac640 1 --2- 172.21.15.2:0/3185959975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56210a9555d0 0x56210a95ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:19:56.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.892+0000 7fe6b1aad640 1 --2- 172.21.15.2:0/3185959975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56210a960370 0x56210a958660 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fe69c019000 tx=0x7fe69c009f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfcd593b4608b3c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:56.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.893+0000 7fe692ffd640 1 -- 172.21.15.2:0/3185959975 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69c02a070 con 0x56210a960370 2024-09-19T06:19:56.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.893+0000 7fe692ffd640 1 -- 172.21.15.2:0/3185959975 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe69c012970 con 0x56210a960370 2024-09-19T06:19:56.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.893+0000 7fe692ffd640 1 -- 172.21.15.2:0/3185959975 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69c016050 con 0x56210a960370 2024-09-19T06:19:56.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.893+0000 7fe6b58e9740 1 -- 172.21.15.2:0/3185959975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56210a960370 msgr2=0x56210a958660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:56.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.893+0000 7fe6b58e9740 1 --2- 172.21.15.2:0/3185959975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56210a960370 0x56210a958660 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fe69c019000 tx=0x7fe69c009f00 comp rx=0 tx=0).stop 2024-09-19T06:19:56.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.893+0000 7fe6b58e9740 1 -- 172.21.15.2:0/3185959975 shutdown_connections 2024-09-19T06:19:56.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.893+0000 7fe6b58e9740 1 --2- 172.21.15.2:0/3185959975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56210a960370 0x56210a958660 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:56.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.893+0000 7fe6b58e9740 1 --2- 172.21.15.2:0/3185959975 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56210a956b40 0x56210a958120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:56.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.893+0000 7fe6b58e9740 1 --2- 172.21.15.2:0/3185959975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56210a9555d0 0x56210a95ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:56.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.893+0000 7fe6b58e9740 1 -- 172.21.15.2:0/3185959975 >> 172.21.15.2:0/3185959975 conn(0x56210a91e310 msgr2=0x56210a95e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:56.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.893+0000 7fe6b58e9740 1 -- 172.21.15.2:0/3185959975 shutdown_connections 2024-09-19T06:19:56.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.893+0000 7fe6b58e9740 1 -- 172.21.15.2:0/3185959975 wait complete. 2024-09-19T06:19:56.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.894+0000 7fe6b58e9740 1 -- start start 2024-09-19T06:19:56.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.894+0000 7fe6b58e9740 1 Processor -- start 2024-09-19T06:19:56.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.894+0000 7fe6b58e9740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56210a9555d0 0x56210a95a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:56.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.894+0000 7fe6b58e9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56210a956b40 0x56210a95a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:56.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.894+0000 7fe6b58e9740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56210a960370 0x56210a95aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:56.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.894+0000 7fe6b58e9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ac1abd90 con 0x56210a956b40 2024-09-19T06:19:56.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.894+0000 7fe6b58e9740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ac1ad200 con 0x56210a9555d0 2024-09-19T06:19:56.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.894+0000 7fe6b58e9740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ac1ac460 con 0x56210a960370 2024-09-19T06:19:56.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.894+0000 7fe6b58e9740 10 client.0 _ll_register_callbacks cb 0x7fe6a000b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:56.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.895+0000 7fe6b0aab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56210a956b40 0x56210a95a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:56.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.895+0000 7fe6b0aab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56210a956b40 0x56210a95a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35788/0 (socket says 172.21.15.2:35788) 2024-09-19T06:19:56.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.895+0000 7fe6b0aab640 1 -- 172.21.15.2:0/2884266261 learned_addr learned my addr 172.21.15.2:0/2884266261 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:56.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.895+0000 7fe6b1aad640 1 --2- 172.21.15.2:0/2884266261 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56210a960370 0x56210a95aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:56.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.895+0000 7fe6b12ac640 1 --2- 172.21.15.2:0/2884266261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56210a9555d0 0x56210a95a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:56.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.895+0000 7fe6b0aab640 1 -- 172.21.15.2:0/2884266261 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56210a960370 msgr2=0x56210a95aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:56.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.895+0000 7fe6b0aab640 1 --2- 172.21.15.2:0/2884266261 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56210a960370 0x56210a95aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:56.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.895+0000 7fe6b0aab640 1 -- 172.21.15.2:0/2884266261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56210a9555d0 msgr2=0x56210a95a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:56.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.895+0000 7fe6b0aab640 1 --2- 172.21.15.2:0/2884266261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56210a9555d0 0x56210a95a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:56.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.895+0000 7fe6b0aab640 1 -- 172.21.15.2:0/2884266261 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56210a9d9cd0 con 0x56210a956b40 2024-09-19T06:19:56.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.895+0000 7fe6b0aab640 1 --2- 172.21.15.2:0/2884266261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56210a956b40 0x56210a95a5b0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0000c00 tx=0x7fe6a000b3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6341934bbf55e461 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:56.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.895+0000 7fe690ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:19:56.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.895+0000 7fe690ff9640 1 -- 172.21.15.2:0/2884266261 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a0034070 con 0x56210a956b40 2024-09-19T06:19:56.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.895+0000 7fe690ff9640 1 -- 172.21.15.2:0/2884266261 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fe6a000de10 con 0x56210a956b40 2024-09-19T06:19:56.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.895+0000 7fe6b58e9740 1 -- 172.21.15.2:0/2884266261 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe69c012970 con 0x56210a956b40 2024-09-19T06:19:56.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.895+0000 7fe690ff9640 1 -- 172.21.15.2:0/2884266261 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe6a001d960 con 0x56210a956b40 2024-09-19T06:19:56.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.895+0000 7fe6b58e9740 10 client.16554 fetch_fsmap learned FSMap version 26 2024-09-19T06:19:56.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.895+0000 7fe6b58e9740 1 -- 172.21.15.2:0/2884266261 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56210a9dafd0 con 0x56210a956b40 2024-09-19T06:19:56.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.896+0000 7fe690ff9640 1 -- 172.21.15.2:0/2884266261 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe69c012970 con 0x56210a956b40 2024-09-19T06:19:56.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.896+0000 7fe690ff9640 1 -- 172.21.15.2:0/2884266261 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fe6a0005030 con 0x56210a956b40 2024-09-19T06:19:56.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.896+0000 7fe6b58e9740 10 client.16554 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:19:56.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.896+0000 7fe6b58e9740 10 client.16554 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:19:56.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.896+0000 7fe6b58e9740 20 client.16554 populate_metadata read hostname 'smithi002' 2024-09-19T06:19:56.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.896+0000 7fe6b58e9740 1 --2- 172.21.15.2:0/2884266261 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x56210a96ffa0 0x56210a9dd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:56.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.896+0000 7fe6b58e9740 4 client.16554 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:19:56.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.896+0000 7fe6b58e9740 1 -- 172.21.15.2:0/2884266261 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56210a8c2d70 con 0x56210a96ffa0 2024-09-19T06:19:56.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.896+0000 7fe6b12ac640 1 --2- 172.21.15.2:0/2884266261 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x56210a96ffa0 0x56210a9dd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:56.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.896+0000 7fe690ff9640 10 client.16554 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:19:56.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.896+0000 7fe6b12ac640 1 --2- 172.21.15.2:0/2884266261 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x56210a96ffa0 0x56210a9dd770 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5863d49322a44e67 server_cookie=42a4f9e7af92fe60 in_seq=0 out_seq=0 2024-09-19T06:19:56.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.897+0000 7fe690ff9640 1 -- 172.21.15.2:0/2884266261 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56210a8c2d70 con 0x56210a96ffa0 2024-09-19T06:19:56.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.897+0000 7fe690ff9640 10 client.16554 handle_command_reply: tid=0 2024-09-19T06:19:56.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.897+0000 7fe6b58e9740 1 client.16554 shutdown 2024-09-19T06:19:56.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.897+0000 7fe6b58e9740 1 -- 172.21.15.2:0/2884266261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56210a956b40 msgr2=0x56210a95a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:56.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.897+0000 7fe6b58e9740 1 --2- 172.21.15.2:0/2884266261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56210a956b40 0x56210a95a5b0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0000c00 tx=0x7fe6a000b3c0 comp rx=0 tx=0).stop 2024-09-19T06:19:56.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.897+0000 7fe6b58e9740 1 -- 172.21.15.2:0/2884266261 shutdown_connections 2024-09-19T06:19:56.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.897+0000 7fe6b58e9740 1 --2- 172.21.15.2:0/2884266261 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x56210a96ffa0 0x56210a9dd770 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:56.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.897+0000 7fe6b58e9740 1 --2- 172.21.15.2:0/2884266261 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56210a960370 0x56210a95aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:56.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.897+0000 7fe6b58e9740 1 --2- 172.21.15.2:0/2884266261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56210a956b40 0x56210a95a5b0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:56.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.897+0000 7fe690ff9640 0 client.16554 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:19:56.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.897+0000 7fe6b58e9740 1 --2- 172.21.15.2:0/2884266261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56210a9555d0 0x56210a95a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:56.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.897+0000 7fe6b58e9740 1 -- 172.21.15.2:0/2884266261 >> 172.21.15.2:0/2884266261 conn(0x56210a91e310 msgr2=0x56210a95f070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:56.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.897+0000 7fe6b58e9740 1 -- 172.21.15.2:0/2884266261 shutdown_connections 2024-09-19T06:19:56.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.897+0000 7fe6b58e9740 1 -- 172.21.15.2:0/2884266261 wait complete. 2024-09-19T06:19:56.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.897+0000 7fe6b58e9740 20 client.16554 trim_cache size 0 max 16384 2024-09-19T06:19:56.915 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:19:56.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.898+0000 7fe6b3510640 1 -- 172.21.15.2:0/2633114847 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe6940a33b0 msgr2=0x7fe6940a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:56.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.898+0000 7fe6b3510640 1 --2- 172.21.15.2:0/2633114847 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe6940a33b0 0x7fe6940a5870 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0005fd0 tx=0x7fe6a0005850 comp rx=0 tx=0).stop 2024-09-19T06:19:56.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.898+0000 7fe6b3510640 1 -- 172.21.15.2:0/2633114847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6ac102dd0 msgr2=0x7fe6ac198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:56.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.898+0000 7fe6b3510640 1 --2- 172.21.15.2:0/2633114847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6ac102dd0 0x7fe6ac198480 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4004770 tx=0x7fe6a40042f0 comp rx=0 tx=0).stop 2024-09-19T06:19:56.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.898+0000 7fe6b3510640 1 -- 172.21.15.2:0/2633114847 shutdown_connections 2024-09-19T06:19:56.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.898+0000 7fe6b3510640 1 --2- 172.21.15.2:0/2633114847 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe6940a33b0 0x7fe6940a5870 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:56.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.898+0000 7fe6b3510640 1 --2- 172.21.15.2:0/2633114847 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe6ac108300 0x7fe6ac19cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:56.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.898+0000 7fe6b3510640 1 --2- 172.21.15.2:0/2633114847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6ac103780 0x7fe6ac1989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:56.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.898+0000 7fe6b3510640 1 --2- 172.21.15.2:0/2633114847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6ac102dd0 0x7fe6ac198480 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:56.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.898+0000 7fe6b3510640 1 -- 172.21.15.2:0/2633114847 >> 172.21.15.2:0/2633114847 conn(0x7fe6ac0fc7d0 msgr2=0x7fe6ac105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:56.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.898+0000 7fe6b3510640 1 -- 172.21.15.2:0/2633114847 shutdown_connections 2024-09-19T06:19:56.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:56.898+0000 7fe6b3510640 1 -- 172.21.15.2:0/2633114847 wait complete. 2024-09-19T06:19:57.612 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:19:57.868 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:19:57.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:57 smithi002 ceph-mon[30982]: pgmap v157: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:19:57.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:57 smithi090 ceph-mon[34497]: pgmap v157: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:19:58.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:57 smithi089 ceph-mon[34160]: pgmap v157: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:19:58.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.340+0000 7f4737d23640 1 -- 172.21.15.2:0/2858797354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f473010c180 msgr2=0x7f473010e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:58.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.340+0000 7f4737d23640 1 --2- 172.21.15.2:0/2858797354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f473010c180 0x7f473010e600 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f4728009ca0 tx=0x7f472802a950 comp rx=0 tx=0).stop 2024-09-19T06:19:58.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.340+0000 7f4737d23640 1 -- 172.21.15.2:0/2858797354 shutdown_connections 2024-09-19T06:19:58.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.340+0000 7f4737d23640 1 --2- 172.21.15.2:0/2858797354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f473010c180 0x7f473010e600 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:58.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.340+0000 7f4737d23640 1 --2- 172.21.15.2:0/2858797354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47301036c0 0x7f473010bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:58.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.340+0000 7f4737d23640 1 --2- 172.21.15.2:0/2858797354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4730102da0 0x7f4730103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:58.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.340+0000 7f4737d23640 1 -- 172.21.15.2:0/2858797354 >> 172.21.15.2:0/2858797354 conn(0x7f47300fc7a0 msgr2=0x7f47300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:58.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.340+0000 7f4737d23640 1 -- 172.21.15.2:0/2858797354 shutdown_connections 2024-09-19T06:19:58.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.340+0000 7f4737d23640 1 -- 172.21.15.2:0/2858797354 wait complete. 2024-09-19T06:19:58.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.341+0000 7f4737d23640 1 Processor -- start 2024-09-19T06:19:58.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.341+0000 7f4737d23640 1 -- start start 2024-09-19T06:19:58.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.341+0000 7f4737d23640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4730102da0 0x7f4730198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:58.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.341+0000 7f4737d23640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47301036c0 0x7f47301989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:58.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.341+0000 7f4737d23640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f473010c180 0x7f473019cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:58.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.341+0000 7f4737d23640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4730111e50 con 0x7f473010c180 2024-09-19T06:19:58.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.341+0000 7f4737d23640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4730111cd0 con 0x7f47301036c0 2024-09-19T06:19:58.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.341+0000 7f4737d23640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4730111fd0 con 0x7f4730102da0 2024-09-19T06:19:58.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.341+0000 7f47362c0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f473010c180 0x7f473019cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:58.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.341+0000 7f47362c0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f473010c180 0x7f473019cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35806/0 (socket says 172.21.15.2:35806) 2024-09-19T06:19:58.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.341+0000 7f47362c0640 1 -- 172.21.15.2:0/2632485376 learned_addr learned my addr 172.21.15.2:0/2632485376 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:58.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.341+0000 7f47352be640 1 --2- 172.21.15.2:0/2632485376 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47301036c0 0x7f47301989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:58.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.342+0000 7f4735abf640 1 --2- 172.21.15.2:0/2632485376 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4730102da0 0x7f4730198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:58.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.342+0000 7f47362c0640 1 -- 172.21.15.2:0/2632485376 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4730102da0 msgr2=0x7f4730198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:58.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.342+0000 7f47362c0640 1 --2- 172.21.15.2:0/2632485376 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4730102da0 0x7f4730198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:58.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.342+0000 7f47362c0640 1 -- 172.21.15.2:0/2632485376 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47301036c0 msgr2=0x7f47301989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:58.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.342+0000 7f47362c0640 1 --2- 172.21.15.2:0/2632485376 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47301036c0 0x7f47301989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:58.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.342+0000 7f47362c0640 1 -- 172.21.15.2:0/2632485376 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f473019d430 con 0x7f473010c180 2024-09-19T06:19:58.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.342+0000 7f47362c0640 1 --2- 172.21.15.2:0/2632485376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f473010c180 0x7f473019cd50 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f472802ae70 tx=0x7f472802f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:58.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.342+0000 7f4726ffd640 1 -- 172.21.15.2:0/2632485376 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4728034040 con 0x7f473010c180 2024-09-19T06:19:58.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.342+0000 7f4726ffd640 1 -- 172.21.15.2:0/2632485376 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f47280308f0 con 0x7f473010c180 2024-09-19T06:19:58.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.342+0000 7f4737d23640 1 -- 172.21.15.2:0/2632485376 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f473019d6c0 con 0x7f473010c180 2024-09-19T06:19:58.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.342+0000 7f4726ffd640 1 -- 172.21.15.2:0/2632485376 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47280047f0 con 0x7f473010c180 2024-09-19T06:19:58.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.342+0000 7f4737d23640 1 -- 172.21.15.2:0/2632485376 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47301a5000 con 0x7f473010c180 2024-09-19T06:19:58.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.344+0000 7f4726ffd640 1 -- 172.21.15.2:0/2632485376 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f4728037020 con 0x7f473010c180 2024-09-19T06:19:58.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.345+0000 7f473a0fc740 1 Processor -- start 2024-09-19T06:19:58.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.345+0000 7f473a0fc740 1 -- start start 2024-09-19T06:19:58.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.345+0000 7f473a0fc740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9c572bb40 0x55c9c572a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:58.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.345+0000 7f473a0fc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9c572a5d0 0x55c9c572aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:58.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.345+0000 7f473a0fc740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9c5739780 0x55c9c573bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:58.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.345+0000 7f473a0fc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c9c56902f0 con 0x55c9c572a5d0 2024-09-19T06:19:58.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.345+0000 7f473a0fc740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55c9c5637cf0 con 0x55c9c572bb40 2024-09-19T06:19:58.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.345+0000 7f473a0fc740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55c9c568c2b0 con 0x55c9c5739780 2024-09-19T06:19:58.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.345+0000 7f4735abf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9c572a5d0 0x55c9c572aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:58.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.345+0000 7f4726ffd640 1 --2- 172.21.15.2:0/2632485376 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f471c0a33b0 0x7f471c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:58.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.345+0000 7f4735abf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9c572a5d0 0x55c9c572aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35816/0 (socket says 172.21.15.2:35816) 2024-09-19T06:19:58.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.345+0000 7f4735abf640 1 -- 172.21.15.2:0/2148357614 learned_addr learned my addr 172.21.15.2:0/2148357614 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:58.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.346+0000 7f47362c0640 1 --2- 172.21.15.2:0/2632485376 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f471c0a33b0 0x7f471c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:58.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.346+0000 7f47352be640 1 --2- 172.21.15.2:0/2148357614 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9c5739780 0x55c9c573bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:58.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.346+0000 7f47352be640 1 --2- 172.21.15.2:0/2148357614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9c572bb40 0x55c9c572a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:58.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.346+0000 7f4735abf640 1 -- 172.21.15.2:0/2148357614 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9c5739780 msgr2=0x55c9c573bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:58.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.346+0000 7f4735abf640 1 --2- 172.21.15.2:0/2148357614 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9c5739780 0x55c9c573bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:58.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.346+0000 7f4735abf640 1 -- 172.21.15.2:0/2148357614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9c572bb40 msgr2=0x55c9c572a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:58.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.346+0000 7f4735abf640 1 --2- 172.21.15.2:0/2148357614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9c572bb40 0x55c9c572a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:58.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.346+0000 7f4735abf640 1 -- 172.21.15.2:0/2148357614 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9c561c3a0 con 0x55c9c572a5d0 2024-09-19T06:19:58.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.346+0000 7f47352be640 1 --2- 172.21.15.2:0/2148357614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9c572bb40 0x55c9c572a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:19:58.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.346+0000 7f4726ffd640 1 -- 172.21.15.2:0/2632485376 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f47280f0c30 con 0x7f473010c180 2024-09-19T06:19:58.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.346+0000 7f4735abf640 1 --2- 172.21.15.2:0/2148357614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9c572a5d0 0x55c9c572aa10 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f472c00b820 tx=0x7f472c00bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77a9db3f824ca1d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:58.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.346+0000 7f47362c0640 1 --2- 172.21.15.2:0/2632485376 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f471c0a33b0 0x7f471c0a5870 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f47280c5730 tx=0x7f472808ed70 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:58.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.346+0000 7f471bfff640 1 -- 172.21.15.2:0/2148357614 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472c00d950 con 0x55c9c572a5d0 2024-09-19T06:19:58.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.346+0000 7f471bfff640 1 -- 172.21.15.2:0/2148357614 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f472c019070 con 0x55c9c572a5d0 2024-09-19T06:19:58.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.346+0000 7f471bfff640 1 -- 172.21.15.2:0/2148357614 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472c0123e0 con 0x55c9c572a5d0 2024-09-19T06:19:58.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.347+0000 7f473a0fc740 1 -- 172.21.15.2:0/2148357614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9c572a5d0 msgr2=0x55c9c572aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:58.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.347+0000 7f473a0fc740 1 --2- 172.21.15.2:0/2148357614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9c572a5d0 0x55c9c572aa10 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f472c00b820 tx=0x7f472c00bce0 comp rx=0 tx=0).stop 2024-09-19T06:19:58.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.347+0000 7f473a0fc740 1 -- 172.21.15.2:0/2148357614 shutdown_connections 2024-09-19T06:19:58.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.347+0000 7f473a0fc740 1 --2- 172.21.15.2:0/2148357614 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9c5739780 0x55c9c573bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:58.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.347+0000 7f473a0fc740 1 --2- 172.21.15.2:0/2148357614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9c572a5d0 0x55c9c572aa10 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:58.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.347+0000 7f473a0fc740 1 --2- 172.21.15.2:0/2148357614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9c572bb40 0x55c9c572a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:58.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.347+0000 7f473a0fc740 1 -- 172.21.15.2:0/2148357614 >> 172.21.15.2:0/2148357614 conn(0x55c9c56f3310 msgr2=0x55c9c5726c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:58.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.347+0000 7f473a0fc740 1 -- 172.21.15.2:0/2148357614 shutdown_connections 2024-09-19T06:19:58.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.347+0000 7f473a0fc740 1 -- 172.21.15.2:0/2148357614 wait complete. 2024-09-19T06:19:58.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.347+0000 7f473a0fc740 1 -- start start 2024-09-19T06:19:58.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.348+0000 7f473a0fc740 1 Processor -- start 2024-09-19T06:19:58.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.348+0000 7f473a0fc740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9c572a5d0 0x55c9c57390f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:58.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.348+0000 7f473a0fc740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9c572bb40 0x55c9c57363a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:58.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.348+0000 7f473a0fc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9c5739780 0x55c9c5736900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:58.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.348+0000 7f473a0fc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c9c573c480 con 0x55c9c5739780 2024-09-19T06:19:58.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.348+0000 7f473a0fc740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55c9c564b060 con 0x55c9c572a5d0 2024-09-19T06:19:58.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.348+0000 7f473a0fc740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55c9c573c600 con 0x55c9c572bb40 2024-09-19T06:19:58.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.348+0000 7f473a0fc740 10 client.0 _ll_register_callbacks cb 0x55c9c539e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:58.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.348+0000 7f47352be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9c5739780 0x55c9c5736900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:58.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.348+0000 7f47352be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9c5739780 0x55c9c5736900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35820/0 (socket says 172.21.15.2:35820) 2024-09-19T06:19:58.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.348+0000 7f47352be640 1 -- 172.21.15.2:0/1155664719 learned_addr learned my addr 172.21.15.2:0/1155664719 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:58.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.348+0000 7f47352be640 1 --2- 172.21.15.2:0/1155664719 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9c572a5d0 0x55c9c57390f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:58.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.348+0000 7f4735abf640 1 --2- 172.21.15.2:0/1155664719 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9c572bb40 0x55c9c57363a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:58.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.348+0000 7f47352be640 1 -- 172.21.15.2:0/1155664719 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9c572bb40 msgr2=0x55c9c57363a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:58.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.349+0000 7f47352be640 1 --2- 172.21.15.2:0/1155664719 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9c572bb40 0x55c9c57363a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:58.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.349+0000 7f47352be640 1 -- 172.21.15.2:0/1155664719 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9c572a5d0 msgr2=0x55c9c57390f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:58.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.349+0000 7f47352be640 1 --2- 172.21.15.2:0/1155664719 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9c572a5d0 0x55c9c57390f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:58.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.349+0000 7f47352be640 1 -- 172.21.15.2:0/1155664719 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9c54013c0 con 0x55c9c5739780 2024-09-19T06:19:58.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.349+0000 7f47352be640 1 --2- 172.21.15.2:0/1155664719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9c5739780 0x55c9c5736900 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f47200138c0 tx=0x7f4720004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e38d1497785535d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:58.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.349+0000 7f47197fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:19:58.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.349+0000 7f47197fa640 1 -- 172.21.15.2:0/1155664719 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4720011cf0 con 0x55c9c5739780 2024-09-19T06:19:58.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.349+0000 7f47197fa640 1 -- 172.21.15.2:0/1155664719 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f4720004030 con 0x55c9c5739780 2024-09-19T06:19:58.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.349+0000 7f473a0fc740 1 -- 172.21.15.2:0/1155664719 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f472c019070 con 0x55c9c5739780 2024-09-19T06:19:58.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.349+0000 7f47197fa640 1 -- 172.21.15.2:0/1155664719 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4720011e90 con 0x55c9c5739780 2024-09-19T06:19:58.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.349+0000 7f473a0fc740 10 client.16566 fetch_fsmap learned FSMap version 26 2024-09-19T06:19:58.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.349+0000 7f473a0fc740 1 -- 172.21.15.2:0/1155664719 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c9c5747ef0 con 0x55c9c5739780 2024-09-19T06:19:58.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.349+0000 7f47197fa640 1 -- 172.21.15.2:0/1155664719 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f472c019070 con 0x55c9c5739780 2024-09-19T06:19:58.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.350+0000 7f47197fa640 1 -- 172.21.15.2:0/1155664719 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f472001e020 con 0x55c9c5739780 2024-09-19T06:19:58.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.350+0000 7f473a0fc740 10 client.16566 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:19:58.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.350+0000 7f473a0fc740 10 client.16566 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:19:58.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.350+0000 7f473a0fc740 20 client.16566 populate_metadata read hostname 'smithi002' 2024-09-19T06:19:58.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.350+0000 7f473a0fc740 1 --2- 172.21.15.2:0/1155664719 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55c9c5749300 0x55c9c574b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:58.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.350+0000 7f473a0fc740 4 client.16566 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:19:58.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.350+0000 7f473a0fc740 1 -- 172.21.15.2:0/1155664719 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c9c569d860 con 0x55c9c5749300 2024-09-19T06:19:58.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.350+0000 7f4735abf640 1 --2- 172.21.15.2:0/1155664719 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55c9c5749300 0x55c9c574b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:58.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.350+0000 7f4735abf640 1 --2- 172.21.15.2:0/1155664719 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55c9c5749300 0x55c9c574b6f0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a4e44dcd7dd15c3b server_cookie=fc66eb6ea03db020 in_seq=0 out_seq=0 2024-09-19T06:19:58.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.350+0000 7f47197fa640 10 client.16566 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:19:58.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.351+0000 7f47197fa640 1 -- 172.21.15.2:0/1155664719 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c9c569d860 con 0x55c9c5749300 2024-09-19T06:19:58.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.351+0000 7f47197fa640 10 client.16566 handle_command_reply: tid=0 2024-09-19T06:19:58.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.351+0000 7f473a0fc740 1 client.16566 shutdown 2024-09-19T06:19:58.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.351+0000 7f473a0fc740 1 -- 172.21.15.2:0/1155664719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9c5739780 msgr2=0x55c9c5736900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:58.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.351+0000 7f473a0fc740 1 --2- 172.21.15.2:0/1155664719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9c5739780 0x55c9c5736900 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f47200138c0 tx=0x7f4720004730 comp rx=0 tx=0).stop 2024-09-19T06:19:58.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.351+0000 7f473a0fc740 1 -- 172.21.15.2:0/1155664719 shutdown_connections 2024-09-19T06:19:58.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.351+0000 7f473a0fc740 1 --2- 172.21.15.2:0/1155664719 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55c9c5749300 0x55c9c574b6f0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:58.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.351+0000 7f473a0fc740 1 --2- 172.21.15.2:0/1155664719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9c5739780 0x55c9c5736900 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:58.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.351+0000 7f473a0fc740 1 --2- 172.21.15.2:0/1155664719 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9c572bb40 0x55c9c57363a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:58.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.351+0000 7f47197fa640 0 client.16566 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:19:58.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.351+0000 7f473a0fc740 1 --2- 172.21.15.2:0/1155664719 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9c572a5d0 0x55c9c57390f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:58.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.351+0000 7f473a0fc740 1 -- 172.21.15.2:0/1155664719 >> 172.21.15.2:0/1155664719 conn(0x55c9c56f3310 msgr2=0x55c9c572c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:58.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.351+0000 7f473a0fc740 1 -- 172.21.15.2:0/1155664719 shutdown_connections 2024-09-19T06:19:58.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.351+0000 7f473a0fc740 1 -- 172.21.15.2:0/1155664719 wait complete. 2024-09-19T06:19:58.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.351+0000 7f473a0fc740 20 client.16566 trim_cache size 0 max 16384 2024-09-19T06:19:58.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.365+0000 7f473a0fc740 1 Processor -- start 2024-09-19T06:19:58.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.365+0000 7f473a0fc740 1 -- start start 2024-09-19T06:19:58.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.365+0000 7f473a0fc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9c572a5d0 0x55c9c5726e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:58.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.365+0000 7f473a0fc740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9c572bb40 0x55c9c5745720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:58.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.365+0000 7f473a0fc740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9c5739780 0x55c9c5735c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:58.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.365+0000 7f473a0fc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f47301adda0 con 0x55c9c572a5d0 2024-09-19T06:19:58.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.365+0000 7f473a0fc740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f47301ab670 con 0x55c9c572bb40 2024-09-19T06:19:58.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.365+0000 7f473a0fc740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f47301a94e0 con 0x55c9c5739780 2024-09-19T06:19:58.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.366+0000 7f47352be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9c572a5d0 0x55c9c5726e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:58.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.366+0000 7f47352be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9c572a5d0 0x55c9c5726e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35822/0 (socket says 172.21.15.2:35822) 2024-09-19T06:19:58.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.366+0000 7f47352be640 1 -- 172.21.15.2:0/2228591949 learned_addr learned my addr 172.21.15.2:0/2228591949 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:58.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.366+0000 7f4735abf640 1 --2- 172.21.15.2:0/2228591949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9c572bb40 0x55c9c5745720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:58.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.366+0000 7f47352be640 1 -- 172.21.15.2:0/2228591949 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9c5739780 msgr2=0x55c9c5735c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:58.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.366+0000 7f47352be640 1 --2- 172.21.15.2:0/2228591949 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9c5739780 0x55c9c5735c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:58.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.366+0000 7f47352be640 1 -- 172.21.15.2:0/2228591949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9c572bb40 msgr2=0x55c9c5745720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:58.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.366+0000 7f47352be640 1 --2- 172.21.15.2:0/2228591949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9c572bb40 0x55c9c5745720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:58.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.366+0000 7f47352be640 1 -- 172.21.15.2:0/2228591949 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9c57348f0 con 0x55c9c572a5d0 2024-09-19T06:19:58.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.366+0000 7f4735abf640 1 --2- 172.21.15.2:0/2228591949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9c572bb40 0x55c9c5745720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:19:58.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.366+0000 7f47352be640 1 --2- 172.21.15.2:0/2228591949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9c572a5d0 0x55c9c5726e10 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f4720011830 tx=0x7f4720011860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=346d8b733608ee9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:58.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.366+0000 7f471b7fe640 1 -- 172.21.15.2:0/2228591949 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472002e030 con 0x55c9c572a5d0 2024-09-19T06:19:58.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.366+0000 7f471b7fe640 1 -- 172.21.15.2:0/2228591949 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4720029dd0 con 0x55c9c572a5d0 2024-09-19T06:19:58.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.366+0000 7f471b7fe640 1 -- 172.21.15.2:0/2228591949 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4720004230 con 0x55c9c572a5d0 2024-09-19T06:19:58.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.367+0000 7f473a0fc740 1 -- 172.21.15.2:0/2228591949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9c572a5d0 msgr2=0x55c9c5726e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:58.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.367+0000 7f473a0fc740 1 --2- 172.21.15.2:0/2228591949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9c572a5d0 0x55c9c5726e10 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f4720011830 tx=0x7f4720011860 comp rx=0 tx=0).stop 2024-09-19T06:19:58.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.367+0000 7f473a0fc740 1 -- 172.21.15.2:0/2228591949 shutdown_connections 2024-09-19T06:19:58.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.367+0000 7f473a0fc740 1 --2- 172.21.15.2:0/2228591949 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9c5739780 0x55c9c5735c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:58.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.367+0000 7f473a0fc740 1 --2- 172.21.15.2:0/2228591949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9c572bb40 0x55c9c5745720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:58.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.367+0000 7f473a0fc740 1 --2- 172.21.15.2:0/2228591949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9c572a5d0 0x55c9c5726e10 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:58.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.367+0000 7f473a0fc740 1 -- 172.21.15.2:0/2228591949 >> 172.21.15.2:0/2228591949 conn(0x55c9c56f3310 msgr2=0x55c9c5726700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:58.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.367+0000 7f473a0fc740 1 -- 172.21.15.2:0/2228591949 shutdown_connections 2024-09-19T06:19:58.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.367+0000 7f473a0fc740 1 -- 172.21.15.2:0/2228591949 wait complete. 2024-09-19T06:19:58.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.367+0000 7f473a0fc740 1 -- start start 2024-09-19T06:19:58.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.367+0000 7f473a0fc740 1 Processor -- start 2024-09-19T06:19:58.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.368+0000 7f473a0fc740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9c572a5d0 0x55c9c57420c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:58.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.368+0000 7f473a0fc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9c572bb40 0x55c9c57331a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:58.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.368+0000 7f473a0fc740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9c5739780 0x55c9c5733790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:58.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.368+0000 7f473a0fc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f47301a9b30 con 0x55c9c572bb40 2024-09-19T06:19:58.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.368+0000 7f473a0fc740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f47301aafa0 con 0x55c9c5739780 2024-09-19T06:19:58.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.368+0000 7f473a0fc740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f47301aa200 con 0x55c9c572a5d0 2024-09-19T06:19:58.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.368+0000 7f473a0fc740 10 client.0 _ll_register_callbacks cb 0x7f472000bd00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:58.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.368+0000 7f4735abf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9c572bb40 0x55c9c57331a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:58.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.368+0000 7f4735abf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9c572bb40 0x55c9c57331a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35830/0 (socket says 172.21.15.2:35830) 2024-09-19T06:19:58.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.368+0000 7f4735abf640 1 -- 172.21.15.2:0/2430457837 learned_addr learned my addr 172.21.15.2:0/2430457837 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:19:58.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.368+0000 7f47352be640 1 --2- 172.21.15.2:0/2430457837 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9c572a5d0 0x55c9c57420c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:58.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.368+0000 7f47352be640 1 --2- 172.21.15.2:0/2430457837 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9c5739780 0x55c9c5733790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:58.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.368+0000 7f4735abf640 1 -- 172.21.15.2:0/2430457837 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9c572a5d0 msgr2=0x55c9c57420c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:58.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.368+0000 7f4735abf640 1 --2- 172.21.15.2:0/2430457837 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9c572a5d0 0x55c9c57420c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:58.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.368+0000 7f4735abf640 1 -- 172.21.15.2:0/2430457837 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9c5739780 msgr2=0x55c9c5733790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:58.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.368+0000 7f4735abf640 1 --2- 172.21.15.2:0/2430457837 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9c5739780 0x55c9c5733790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:58.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.368+0000 7f4735abf640 1 -- 172.21.15.2:0/2430457837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9c5733fc0 con 0x55c9c572bb40 2024-09-19T06:19:58.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.368+0000 7f4735abf640 1 --2- 172.21.15.2:0/2430457837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9c572bb40 0x55c9c57331a0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f472c00b820 tx=0x7f472c014a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5da4f8397cb693c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:58.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.368+0000 7f47197fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:19:58.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.369+0000 7f47197fa640 1 -- 172.21.15.2:0/2430457837 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472c023070 con 0x55c9c572bb40 2024-09-19T06:19:58.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.369+0000 7f47197fa640 1 -- 172.21.15.2:0/2430457837 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f472c014d00 con 0x55c9c572bb40 2024-09-19T06:19:58.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.369+0000 7f473a0fc740 1 -- 172.21.15.2:0/2430457837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4720029dd0 con 0x55c9c572bb40 2024-09-19T06:19:58.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.369+0000 7f47197fa640 1 -- 172.21.15.2:0/2430457837 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f472c0148b0 con 0x55c9c572bb40 2024-09-19T06:19:58.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.369+0000 7f473a0fc740 10 client.16572 fetch_fsmap learned FSMap version 26 2024-09-19T06:19:58.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.369+0000 7f473a0fc740 1 -- 172.21.15.2:0/2430457837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c9c57b3f70 con 0x55c9c572bb40 2024-09-19T06:19:58.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.369+0000 7f47197fa640 1 -- 172.21.15.2:0/2430457837 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4720029dd0 con 0x55c9c572bb40 2024-09-19T06:19:58.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.369+0000 7f47197fa640 1 -- 172.21.15.2:0/2430457837 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f472c013070 con 0x55c9c572bb40 2024-09-19T06:19:58.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.369+0000 7f473a0fc740 10 client.16572 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:19:58.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.369+0000 7f473a0fc740 10 client.16572 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:19:58.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.369+0000 7f473a0fc740 20 client.16572 populate_metadata read hostname 'smithi002' 2024-09-19T06:19:58.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.369+0000 7f473a0fc740 1 --2- 172.21.15.2:0/2430457837 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55c9c57b44a0 0x55c9c57b68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:58.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.369+0000 7f473a0fc740 4 client.16572 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:19:58.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.369+0000 7f473a0fc740 1 -- 172.21.15.2:0/2430457837 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c9c5697d70 con 0x55c9c57b44a0 2024-09-19T06:19:58.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.370+0000 7f47352be640 1 --2- 172.21.15.2:0/2430457837 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55c9c57b44a0 0x55c9c57b68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:58.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.370+0000 7f47352be640 1 --2- 172.21.15.2:0/2430457837 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55c9c57b44a0 0x55c9c57b68c0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1e4f53cadacf7a6c server_cookie=d86ebc4d3a618566 in_seq=0 out_seq=0 2024-09-19T06:19:58.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.370+0000 7f47197fa640 10 client.16572 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:19:58.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.370+0000 7f47197fa640 1 -- 172.21.15.2:0/2430457837 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c9c5697d70 con 0x55c9c57b44a0 2024-09-19T06:19:58.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.370+0000 7f47197fa640 10 client.16572 handle_command_reply: tid=0 2024-09-19T06:19:58.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.370+0000 7f473a0fc740 1 client.16572 shutdown 2024-09-19T06:19:58.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.370+0000 7f473a0fc740 1 -- 172.21.15.2:0/2430457837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9c572bb40 msgr2=0x55c9c57331a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:58.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.370+0000 7f473a0fc740 1 --2- 172.21.15.2:0/2430457837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9c572bb40 0x55c9c57331a0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f472c00b820 tx=0x7f472c014a90 comp rx=0 tx=0).stop 2024-09-19T06:19:58.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.370+0000 7f473a0fc740 1 -- 172.21.15.2:0/2430457837 shutdown_connections 2024-09-19T06:19:58.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.370+0000 7f473a0fc740 1 --2- 172.21.15.2:0/2430457837 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55c9c57b44a0 0x55c9c57b68c0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:58.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.371+0000 7f473a0fc740 1 --2- 172.21.15.2:0/2430457837 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9c5739780 0x55c9c5733790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:58.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.371+0000 7f473a0fc740 1 --2- 172.21.15.2:0/2430457837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9c572bb40 0x55c9c57331a0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:58.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.371+0000 7f47197fa640 0 client.16572 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:19:58.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.371+0000 7f473a0fc740 1 --2- 172.21.15.2:0/2430457837 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9c572a5d0 0x55c9c57420c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:58.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.371+0000 7f473a0fc740 1 -- 172.21.15.2:0/2430457837 >> 172.21.15.2:0/2430457837 conn(0x55c9c56f3310 msgr2=0x55c9c57254e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:58.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.371+0000 7f473a0fc740 1 -- 172.21.15.2:0/2430457837 shutdown_connections 2024-09-19T06:19:58.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.371+0000 7f473a0fc740 1 -- 172.21.15.2:0/2430457837 wait complete. 2024-09-19T06:19:58.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.371+0000 7f473a0fc740 20 client.16572 trim_cache size 0 max 16384 2024-09-19T06:19:58.379 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:19:58.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.371+0000 7f4737d23640 1 -- 172.21.15.2:0/2632485376 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f471c0a33b0 msgr2=0x7f471c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:58.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.371+0000 7f4737d23640 1 --2- 172.21.15.2:0/2632485376 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f471c0a33b0 0x7f471c0a5870 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f47280c5730 tx=0x7f472808ed70 comp rx=0 tx=0).stop 2024-09-19T06:19:58.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.371+0000 7f4737d23640 1 -- 172.21.15.2:0/2632485376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f473010c180 msgr2=0x7f473019cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:58.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.371+0000 7f4737d23640 1 --2- 172.21.15.2:0/2632485376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f473010c180 0x7f473019cd50 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f472802ae70 tx=0x7f472802f5d0 comp rx=0 tx=0).stop 2024-09-19T06:19:58.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.371+0000 7f4737d23640 1 -- 172.21.15.2:0/2632485376 shutdown_connections 2024-09-19T06:19:58.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.371+0000 7f4737d23640 1 --2- 172.21.15.2:0/2632485376 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f471c0a33b0 0x7f471c0a5870 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:58.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.371+0000 7f4737d23640 1 --2- 172.21.15.2:0/2632485376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f473010c180 0x7f473019cd50 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:58.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.371+0000 7f4737d23640 1 --2- 172.21.15.2:0/2632485376 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47301036c0 0x7f47301989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:58.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.371+0000 7f4737d23640 1 --2- 172.21.15.2:0/2632485376 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4730102da0 0x7f4730198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:58.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.371+0000 7f4737d23640 1 -- 172.21.15.2:0/2632485376 >> 172.21.15.2:0/2632485376 conn(0x7f47300fc7a0 msgr2=0x7f47300fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:58.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.371+0000 7f4737d23640 1 -- 172.21.15.2:0/2632485376 shutdown_connections 2024-09-19T06:19:58.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:58.371+0000 7f4737d23640 1 -- 172.21.15.2:0/2632485376 wait complete. 2024-09-19T06:19:59.261 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:19:59.518 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:19:59.909 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:19:59 smithi002 ceph-mon[30982]: pgmap v158: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:19:59.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:19:59 smithi090 ceph-mon[34497]: pgmap v158: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:20:00.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.991+0000 7f9452a65640 1 -- 172.21.15.2:0/1401035414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f944c100a80 msgr2=0x7f944c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:00.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.991+0000 7f9452a65640 1 --2- 172.21.15.2:0/1401035414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f944c100a80 0x7f944c100ee0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f9440009930 tx=0x7f944002a440 comp rx=0 tx=0).stop 2024-09-19T06:20:00.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.992+0000 7f9452a65640 1 -- 172.21.15.2:0/1401035414 shutdown_connections 2024-09-19T06:20:00.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.992+0000 7f9452a65640 1 --2- 172.21.15.2:0/1401035414 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f944c101420 0x7f944c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.992+0000 7f9452a65640 1 --2- 172.21.15.2:0/1401035414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f944c100a80 0x7f944c100ee0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.992+0000 7f9452a65640 1 --2- 172.21.15.2:0/1401035414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f944c106a80 0x7f944c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.992+0000 7f9452a65640 1 -- 172.21.15.2:0/1401035414 >> 172.21.15.2:0/1401035414 conn(0x7f944c0fc7a0 msgr2=0x7f944c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:00.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.992+0000 7f9452a65640 1 -- 172.21.15.2:0/1401035414 shutdown_connections 2024-09-19T06:20:00.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.992+0000 7f9452a65640 1 -- 172.21.15.2:0/1401035414 wait complete. 2024-09-19T06:20:00.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.992+0000 7f9452a65640 1 Processor -- start 2024-09-19T06:20:00.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.992+0000 7f9452a65640 1 -- start start 2024-09-19T06:20:00.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.992+0000 7f9452a65640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f944c100a80 0x7f944c199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:00.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.992+0000 7f9452a65640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f944c101420 0x7f944c199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:00.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.992+0000 7f9452a65640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f944c106a80 0x7f944c1a41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:00.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.992+0000 7f9452a65640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f944c110d30 con 0x7f944c101420 2024-09-19T06:20:00.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.992+0000 7f9452a65640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f944c110bb0 con 0x7f944c100a80 2024-09-19T06:20:00.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.992+0000 7f9452a65640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f944c110eb0 con 0x7f944c106a80 2024-09-19T06:20:00.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.993+0000 7f944bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f944c101420 0x7f944c199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:00.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.993+0000 7f944bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f944c101420 0x7f944c199660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35856/0 (socket says 172.21.15.2:35856) 2024-09-19T06:20:00.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.993+0000 7f944bfff640 1 -- 172.21.15.2:0/2237433658 learned_addr learned my addr 172.21.15.2:0/2237433658 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:00.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.993+0000 7f9450801640 1 --2- 172.21.15.2:0/2237433658 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f944c100a80 0x7f944c199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:00.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.993+0000 7f9451002640 1 --2- 172.21.15.2:0/2237433658 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f944c106a80 0x7f944c1a41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:00.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.993+0000 7f944bfff640 1 -- 172.21.15.2:0/2237433658 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f944c106a80 msgr2=0x7f944c1a41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:00.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.993+0000 7f944bfff640 1 --2- 172.21.15.2:0/2237433658 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f944c106a80 0x7f944c1a41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.993+0000 7f944bfff640 1 -- 172.21.15.2:0/2237433658 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f944c100a80 msgr2=0x7f944c199120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:00.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.993+0000 7f944bfff640 1 --2- 172.21.15.2:0/2237433658 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f944c100a80 0x7f944c199120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.993+0000 7f944bfff640 1 -- 172.21.15.2:0/2237433658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f944c1a46e0 con 0x7f944c101420 2024-09-19T06:20:00.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.993+0000 7f944bfff640 1 --2- 172.21.15.2:0/2237433658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f944c101420 0x7f944c199660 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f9440005940 tx=0x7f94400042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:00.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.993+0000 7f9449ffb640 1 -- 172.21.15.2:0/2237433658 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f944003f030 con 0x7f944c101420 2024-09-19T06:20:00.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.993+0000 7f9452a65640 1 -- 172.21.15.2:0/2237433658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f944c1a48b0 con 0x7f944c101420 2024-09-19T06:20:00.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.993+0000 7f9449ffb640 1 -- 172.21.15.2:0/2237433658 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9440003cb0 con 0x7f944c101420 2024-09-19T06:20:00.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.993+0000 7f9449ffb640 1 -- 172.21.15.2:0/2237433658 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9440035070 con 0x7f944c101420 2024-09-19T06:20:00.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.994+0000 7f9452a65640 1 -- 172.21.15.2:0/2237433658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f944c1a4d90 con 0x7f944c101420 2024-09-19T06:20:00.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.997+0000 7f9449ffb640 1 -- 172.21.15.2:0/2237433658 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f9440042030 con 0x7f944c101420 2024-09-19T06:20:00.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.997+0000 7f9454e3e740 1 Processor -- start 2024-09-19T06:20:00.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.997+0000 7f9454e3e740 1 -- start start 2024-09-19T06:20:00.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.997+0000 7f9454e3e740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b7755ab40 0x556b77559090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:00.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.997+0000 7f9454e3e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b775595d0 0x556b77559a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:00.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.997+0000 7f9454e3e740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b77564370 0x556b77566760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:00.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.997+0000 7f9454e3e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556b774bf2f0 con 0x556b775595d0 2024-09-19T06:20:00.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.997+0000 7f9454e3e740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x556b77466cf0 con 0x556b7755ab40 2024-09-19T06:20:00.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.997+0000 7f9454e3e740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556b774bb2b0 con 0x556b77564370 2024-09-19T06:20:00.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.997+0000 7f9450801640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b775595d0 0x556b77559a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:00.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.997+0000 7f9450801640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b775595d0 0x556b77559a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35860/0 (socket says 172.21.15.2:35860) 2024-09-19T06:20:00.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.997+0000 7f9450801640 1 -- 172.21.15.2:0/2516216653 learned_addr learned my addr 172.21.15.2:0/2516216653 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:00.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.997+0000 7f9451002640 1 --2- 172.21.15.2:0/2516216653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b7755ab40 0x556b77559090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:00.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.997+0000 7f944bfff640 1 --2- 172.21.15.2:0/2516216653 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b77564370 0x556b77566760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:00.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.997+0000 7f9449ffb640 1 --2- 172.21.15.2:0/2237433658 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f94340a33b0 0x7f94340a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:00.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.997+0000 7f9450801640 1 -- 172.21.15.2:0/2516216653 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b77564370 msgr2=0x556b77566760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:00.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.997+0000 7f9450801640 1 --2- 172.21.15.2:0/2516216653 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b77564370 0x556b77566760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.998+0000 7f9450801640 1 -- 172.21.15.2:0/2516216653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b7755ab40 msgr2=0x556b77559090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:00.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.998+0000 7f9450801640 1 --2- 172.21.15.2:0/2516216653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b7755ab40 0x556b77559090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.998+0000 7f9450801640 1 -- 172.21.15.2:0/2516216653 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b7744b3a0 con 0x556b775595d0 2024-09-19T06:20:00.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.998+0000 7f944bfff640 1 --2- 172.21.15.2:0/2516216653 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b77564370 0x556b77566760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:20:00.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.998+0000 7f9451002640 1 --2- 172.21.15.2:0/2237433658 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f94340a33b0 0x7f94340a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:00.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.998+0000 7f9449ffb640 1 -- 172.21.15.2:0/2237433658 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f94400f0210 con 0x7f944c101420 2024-09-19T06:20:00.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.998+0000 7f9450801640 1 --2- 172.21.15.2:0/2516216653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b775595d0 0x556b77559a10 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f943c00ac90 tx=0x7f943c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cc25573c1e97bdf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:00.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.998+0000 7f9432ffd640 1 -- 172.21.15.2:0/2516216653 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943c01d070 con 0x556b775595d0 2024-09-19T06:20:00.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.998+0000 7f9432ffd640 1 -- 172.21.15.2:0/2516216653 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f943c018af0 con 0x556b775595d0 2024-09-19T06:20:00.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.998+0000 7f9432ffd640 1 -- 172.21.15.2:0/2516216653 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943c010ac0 con 0x556b775595d0 2024-09-19T06:20:00.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.999+0000 7f9454e3e740 1 -- 172.21.15.2:0/2516216653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b775595d0 msgr2=0x556b77559a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:00.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.999+0000 7f9451002640 1 --2- 172.21.15.2:0/2237433658 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f94340a33b0 0x7f94340a5870 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9444007e50 tx=0x7f9444004a40 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:00.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.999+0000 7f9454e3e740 1 --2- 172.21.15.2:0/2516216653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b775595d0 0x556b77559a10 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f943c00ac90 tx=0x7f943c00f790 comp rx=0 tx=0).stop 2024-09-19T06:20:00.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.999+0000 7f9454e3e740 1 -- 172.21.15.2:0/2516216653 shutdown_connections 2024-09-19T06:20:00.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.999+0000 7f9454e3e740 1 --2- 172.21.15.2:0/2516216653 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b77564370 0x556b77566760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.999+0000 7f9454e3e740 1 --2- 172.21.15.2:0/2516216653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b775595d0 0x556b77559a10 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.999+0000 7f9454e3e740 1 --2- 172.21.15.2:0/2516216653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b7755ab40 0x556b77559090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.999+0000 7f9454e3e740 1 -- 172.21.15.2:0/2516216653 >> 172.21.15.2:0/2516216653 conn(0x556b77522310 msgr2=0x556b77555c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:00.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.999+0000 7f9454e3e740 1 -- 172.21.15.2:0/2516216653 shutdown_connections 2024-09-19T06:20:00.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.999+0000 7f9454e3e740 1 -- 172.21.15.2:0/2516216653 wait complete. 2024-09-19T06:20:00.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.999+0000 7f9454e3e740 1 -- start start 2024-09-19T06:20:00.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:19:59.999+0000 7f9454e3e740 1 Processor -- start 2024-09-19T06:20:00.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.000+0000 7f9454e3e740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b775595d0 0x556b77563d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:00.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.000+0000 7f9454e3e740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b7755ab40 0x556b77560fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:00.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.000+0000 7f9454e3e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b77564370 0x556b77561560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:00.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.000+0000 7f9454e3e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556b77567070 con 0x556b77564370 2024-09-19T06:20:00.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.000+0000 7f9454e3e740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x556b7747a060 con 0x556b775595d0 2024-09-19T06:20:00.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.000+0000 7f9454e3e740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556b775671f0 con 0x556b7755ab40 2024-09-19T06:20:00.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.000+0000 7f9454e3e740 10 client.0 _ll_register_callbacks cb 0x556b771cd8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:00.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.000+0000 7f9451002640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b77564370 0x556b77561560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:00.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.000+0000 7f9451002640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b77564370 0x556b77561560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35862/0 (socket says 172.21.15.2:35862) 2024-09-19T06:20:00.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.000+0000 7f9451002640 1 -- 172.21.15.2:0/3249864037 learned_addr learned my addr 172.21.15.2:0/3249864037 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:00.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.000+0000 7f9450801640 1 --2- 172.21.15.2:0/3249864037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b775595d0 0x556b77563d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:00.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.000+0000 7f944bfff640 1 --2- 172.21.15.2:0/3249864037 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b7755ab40 0x556b77560fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:00.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.000+0000 7f9451002640 1 -- 172.21.15.2:0/3249864037 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b7755ab40 msgr2=0x556b77560fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:00.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.000+0000 7f9451002640 1 --2- 172.21.15.2:0/3249864037 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b7755ab40 0x556b77560fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.000+0000 7f9451002640 1 -- 172.21.15.2:0/3249864037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b775595d0 msgr2=0x556b77563d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:00.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.000+0000 7f9451002640 1 --2- 172.21.15.2:0/3249864037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b775595d0 0x556b77563d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.000+0000 7f9451002640 1 -- 172.21.15.2:0/3249864037 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b772303c0 con 0x556b77564370 2024-09-19T06:20:00.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.000+0000 7f944bfff640 1 --2- 172.21.15.2:0/3249864037 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b7755ab40 0x556b77560fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:00.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.000+0000 7f9451002640 1 --2- 172.21.15.2:0/3249864037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b77564370 0x556b77561560 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f9444007aa0 tx=0x7f94440074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c0d98a151098415 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:00.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.000+0000 7f942bfff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:00.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.001+0000 7f942bfff640 1 -- 172.21.15.2:0/3249864037 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f944401dd50 con 0x556b77564370 2024-09-19T06:20:00.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.001+0000 7f942bfff640 1 -- 172.21.15.2:0/3249864037 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f944401b450 con 0x556b77564370 2024-09-19T06:20:00.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.001+0000 7f9454e3e740 1 -- 172.21.15.2:0/3249864037 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f943c018af0 con 0x556b77564370 2024-09-19T06:20:00.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.001+0000 7f942bfff640 1 -- 172.21.15.2:0/3249864037 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f944401b650 con 0x556b77564370 2024-09-19T06:20:00.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.001+0000 7f9454e3e740 10 client.16584 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:00.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.001+0000 7f9454e3e740 1 -- 172.21.15.2:0/3249864037 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556b77572a90 con 0x556b77564370 2024-09-19T06:20:00.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.001+0000 7f942bfff640 1 -- 172.21.15.2:0/3249864037 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f943c018af0 con 0x556b77564370 2024-09-19T06:20:00.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.001+0000 7f942bfff640 1 -- 172.21.15.2:0/3249864037 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f9444024070 con 0x556b77564370 2024-09-19T06:20:00.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.001+0000 7f9454e3e740 10 client.16584 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:00.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.001+0000 7f9454e3e740 10 client.16584 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:00.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.001+0000 7f9454e3e740 20 client.16584 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:00.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.001+0000 7f9454e3e740 1 --2- 172.21.15.2:0/3249864037 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556b77573f50 0x556b775763f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:00.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.001+0000 7f9454e3e740 4 client.16584 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:00.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.001+0000 7f9454e3e740 1 -- 172.21.15.2:0/3249864037 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b774cc860 con 0x556b77573f50 2024-09-19T06:20:00.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.001+0000 7f9450801640 1 --2- 172.21.15.2:0/3249864037 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556b77573f50 0x556b775763f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:00.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.002+0000 7f9450801640 1 --2- 172.21.15.2:0/3249864037 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556b77573f50 0x556b775763f0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9ba7012f741e060 server_cookie=d4b0797a49303791 in_seq=0 out_seq=0 2024-09-19T06:20:00.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.002+0000 7f942bfff640 10 client.16584 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:00.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.003+0000 7f942bfff640 1 -- 172.21.15.2:0/3249864037 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556b774cc860 con 0x556b77573f50 2024-09-19T06:20:00.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.003+0000 7f942bfff640 10 client.16584 handle_command_reply: tid=0 2024-09-19T06:20:00.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.003+0000 7f9454e3e740 1 client.16584 shutdown 2024-09-19T06:20:00.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.003+0000 7f9454e3e740 1 -- 172.21.15.2:0/3249864037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b77564370 msgr2=0x556b77561560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:00.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.003+0000 7f9454e3e740 1 --2- 172.21.15.2:0/3249864037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b77564370 0x556b77561560 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f9444007aa0 tx=0x7f94440074f0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.003+0000 7f9454e3e740 1 -- 172.21.15.2:0/3249864037 shutdown_connections 2024-09-19T06:20:00.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.003+0000 7f9454e3e740 1 --2- 172.21.15.2:0/3249864037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b77564370 0x556b77561560 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.003+0000 7f9454e3e740 1 --2- 172.21.15.2:0/3249864037 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b7755ab40 0x556b77560fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.003+0000 7f9454e3e740 1 --2- 172.21.15.2:0/3249864037 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556b77573f50 0x556b775763f0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.003+0000 7f942bfff640 0 client.16584 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:00.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.003+0000 7f9454e3e740 1 --2- 172.21.15.2:0/3249864037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b775595d0 0x556b77563d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.003+0000 7f9454e3e740 1 -- 172.21.15.2:0/3249864037 >> 172.21.15.2:0/3249864037 conn(0x556b77522310 msgr2=0x556b7755b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:00.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.003+0000 7f9454e3e740 1 -- 172.21.15.2:0/3249864037 shutdown_connections 2024-09-19T06:20:00.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.003+0000 7f9454e3e740 1 -- 172.21.15.2:0/3249864037 wait complete. 2024-09-19T06:20:00.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.003+0000 7f9454e3e740 20 client.16584 trim_cache size 0 max 16384 2024-09-19T06:20:00.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.016+0000 7f9454e3e740 1 Processor -- start 2024-09-19T06:20:00.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.016+0000 7f9454e3e740 1 -- start start 2024-09-19T06:20:00.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.016+0000 7f9454e3e740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b775595d0 0x556b77570310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:00.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.016+0000 7f9454e3e740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b7755ab40 0x556b77555700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:00.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.016+0000 7f9454e3e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b77564370 0x556b77555c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:00.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.016+0000 7f9454e3e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f944c1b0000 con 0x556b77564370 2024-09-19T06:20:00.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.016+0000 7f9454e3e740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f944c1ad8d0 con 0x556b775595d0 2024-09-19T06:20:00.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.016+0000 7f9454e3e740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f944c1ab720 con 0x556b7755ab40 2024-09-19T06:20:00.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.016+0000 7f9451002640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b77564370 0x556b77555c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:00.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.016+0000 7f9451002640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b77564370 0x556b77555c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35868/0 (socket says 172.21.15.2:35868) 2024-09-19T06:20:00.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.016+0000 7f9451002640 1 -- 172.21.15.2:0/3078109759 learned_addr learned my addr 172.21.15.2:0/3078109759 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:00.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.017+0000 7f9450801640 1 --2- 172.21.15.2:0/3078109759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b775595d0 0x556b77570310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:00.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.017+0000 7f944bfff640 1 --2- 172.21.15.2:0/3078109759 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b7755ab40 0x556b77555700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:00.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.017+0000 7f9451002640 1 -- 172.21.15.2:0/3078109759 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b7755ab40 msgr2=0x556b77555700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:00.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.017+0000 7f9451002640 1 --2- 172.21.15.2:0/3078109759 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b7755ab40 0x556b77555700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.017+0000 7f9451002640 1 -- 172.21.15.2:0/3078109759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b775595d0 msgr2=0x556b77570310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:00.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.017+0000 7f9451002640 1 --2- 172.21.15.2:0/3078109759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b775595d0 0x556b77570310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.017+0000 7f9451002640 1 -- 172.21.15.2:0/3078109759 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b77564080 con 0x556b77564370 2024-09-19T06:20:00.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.017+0000 7f9451002640 1 --2- 172.21.15.2:0/3078109759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b77564370 0x556b77555c40 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f94440268d0 tx=0x7f9444005f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18fc3f4acd4e07f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:00.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.017+0000 7f94327fc640 1 -- 172.21.15.2:0/3078109759 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9444033040 con 0x556b77564370 2024-09-19T06:20:00.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.017+0000 7f94327fc640 1 -- 172.21.15.2:0/3078109759 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f944401d0c0 con 0x556b77564370 2024-09-19T06:20:00.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.017+0000 7f94327fc640 1 -- 172.21.15.2:0/3078109759 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f944401b7f0 con 0x556b77564370 2024-09-19T06:20:00.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.018+0000 7f9454e3e740 1 -- 172.21.15.2:0/3078109759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b77564370 msgr2=0x556b77555c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:00.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.018+0000 7f9454e3e740 1 --2- 172.21.15.2:0/3078109759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b77564370 0x556b77555c40 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f94440268d0 tx=0x7f9444005f60 comp rx=0 tx=0).stop 2024-09-19T06:20:00.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.018+0000 7f9454e3e740 1 -- 172.21.15.2:0/3078109759 shutdown_connections 2024-09-19T06:20:00.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.018+0000 7f9454e3e740 1 --2- 172.21.15.2:0/3078109759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b77564370 0x556b77555c40 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.018+0000 7f9454e3e740 1 --2- 172.21.15.2:0/3078109759 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b7755ab40 0x556b77555700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.018+0000 7f9454e3e740 1 --2- 172.21.15.2:0/3078109759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b775595d0 0x556b77570310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.018+0000 7f9454e3e740 1 -- 172.21.15.2:0/3078109759 >> 172.21.15.2:0/3078109759 conn(0x556b77522310 msgr2=0x556b77560f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:00.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.018+0000 7f9454e3e740 1 -- 172.21.15.2:0/3078109759 shutdown_connections 2024-09-19T06:20:00.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.018+0000 7f9454e3e740 1 -- 172.21.15.2:0/3078109759 wait complete. 2024-09-19T06:20:00.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.018+0000 7f9454e3e740 1 -- start start 2024-09-19T06:20:00.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.018+0000 7f9454e3e740 1 Processor -- start 2024-09-19T06:20:00.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.019+0000 7f9454e3e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b775595d0 0x556b7756ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:00.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.019+0000 7f9454e3e740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b7755ab40 0x556b77568020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:00.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.019+0000 7f9454e3e740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b77564370 0x556b77568610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:00.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.019+0000 7f9454e3e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f944c1abd90 con 0x556b775595d0 2024-09-19T06:20:00.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.019+0000 7f9454e3e740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f944c1ad200 con 0x556b7755ab40 2024-09-19T06:20:00.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.019+0000 7f9454e3e740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f944c1ac460 con 0x556b77564370 2024-09-19T06:20:00.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.019+0000 7f9454e3e740 10 client.0 _ll_register_callbacks cb 0x7f9444007b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:00.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.019+0000 7f9450801640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b775595d0 0x556b7756ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:00.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.019+0000 7f9450801640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b775595d0 0x556b7756ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35874/0 (socket says 172.21.15.2:35874) 2024-09-19T06:20:00.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.019+0000 7f9450801640 1 -- 172.21.15.2:0/2005868084 learned_addr learned my addr 172.21.15.2:0/2005868084 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:00.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.019+0000 7f944bfff640 1 --2- 172.21.15.2:0/2005868084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b7755ab40 0x556b77568020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:00.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.019+0000 7f9451002640 1 --2- 172.21.15.2:0/2005868084 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b77564370 0x556b77568610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:00.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.019+0000 7f9450801640 1 -- 172.21.15.2:0/2005868084 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b77564370 msgr2=0x556b77568610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:00.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.019+0000 7f9450801640 1 --2- 172.21.15.2:0/2005868084 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b77564370 0x556b77568610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.019+0000 7f9450801640 1 -- 172.21.15.2:0/2005868084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b7755ab40 msgr2=0x556b77568020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:00.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.019+0000 7f9450801640 1 --2- 172.21.15.2:0/2005868084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b7755ab40 0x556b77568020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.019+0000 7f9450801640 1 -- 172.21.15.2:0/2005868084 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b77568e40 con 0x556b775595d0 2024-09-19T06:20:00.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.019+0000 7f944bfff640 1 --2- 172.21.15.2:0/2005868084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b7755ab40 0x556b77568020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:20:00.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.019+0000 7f9450801640 1 --2- 172.21.15.2:0/2005868084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b775595d0 0x556b7756ccf0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f943c00a730 tx=0x7f943c005da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6766a7756b5f3ac6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:00.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.019+0000 7f942bfff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:00.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.020+0000 7f942bfff640 1 -- 172.21.15.2:0/2005868084 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943c01d040 con 0x556b775595d0 2024-09-19T06:20:00.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.020+0000 7f9454e3e740 1 -- 172.21.15.2:0/2005868084 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f944401d0c0 con 0x556b775595d0 2024-09-19T06:20:00.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.020+0000 7f942bfff640 1 -- 172.21.15.2:0/2005868084 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f943c018880 con 0x556b775595d0 2024-09-19T06:20:00.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.020+0000 7f942bfff640 1 -- 172.21.15.2:0/2005868084 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f943c03a050 con 0x556b775595d0 2024-09-19T06:20:00.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.020+0000 7f9454e3e740 10 client.16590 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:00.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.020+0000 7f9454e3e740 1 -- 172.21.15.2:0/2005868084 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556b775dedf0 con 0x556b775595d0 2024-09-19T06:20:00.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.020+0000 7f942bfff640 1 -- 172.21.15.2:0/2005868084 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f944401d0c0 con 0x556b775595d0 2024-09-19T06:20:00.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.020+0000 7f942bfff640 1 -- 172.21.15.2:0/2005868084 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f943c010a30 con 0x556b775595d0 2024-09-19T06:20:00.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.020+0000 7f9454e3e740 10 client.16590 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:00.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.020+0000 7f9454e3e740 10 client.16590 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:00.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.020+0000 7f9454e3e740 20 client.16590 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:00.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.020+0000 7f9454e3e740 1 --2- 172.21.15.2:0/2005868084 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556b775df370 0x556b775e1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:00.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.020+0000 7f9454e3e740 4 client.16590 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:20:00.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.020+0000 7f9454e3e740 1 -- 172.21.15.2:0/2005868084 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556b774c6d70 con 0x556b775df370 2024-09-19T06:20:00.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.021+0000 7f944bfff640 1 --2- 172.21.15.2:0/2005868084 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556b775df370 0x556b775e1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:00.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.021+0000 7f944bfff640 1 --2- 172.21.15.2:0/2005868084 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556b775df370 0x556b775e1760 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e33776290f82de0e server_cookie=a612b5b2946594a3 in_seq=0 out_seq=0 2024-09-19T06:20:00.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.021+0000 7f942bfff640 10 client.16590 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:00.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.021+0000 7f942bfff640 1 -- 172.21.15.2:0/2005868084 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556b774c6d70 con 0x556b775df370 2024-09-19T06:20:00.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.021+0000 7f942bfff640 10 client.16590 handle_command_reply: tid=0 2024-09-19T06:20:00.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.021+0000 7f9454e3e740 1 client.16590 shutdown 2024-09-19T06:20:00.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.021+0000 7f9454e3e740 1 -- 172.21.15.2:0/2005868084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b775595d0 msgr2=0x556b7756ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:00.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.021+0000 7f9454e3e740 1 --2- 172.21.15.2:0/2005868084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b775595d0 0x556b7756ccf0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f943c00a730 tx=0x7f943c005da0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.021+0000 7f9454e3e740 1 -- 172.21.15.2:0/2005868084 shutdown_connections 2024-09-19T06:20:00.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.021+0000 7f9454e3e740 1 --2- 172.21.15.2:0/2005868084 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b77564370 0x556b77568610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.021+0000 7f9454e3e740 1 --2- 172.21.15.2:0/2005868084 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556b775df370 0x556b775e1760 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.021+0000 7f9454e3e740 1 --2- 172.21.15.2:0/2005868084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b7755ab40 0x556b77568020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.021+0000 7f9454e3e740 1 --2- 172.21.15.2:0/2005868084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b775595d0 0x556b7756ccf0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.021+0000 7f9454e3e740 1 -- 172.21.15.2:0/2005868084 >> 172.21.15.2:0/2005868084 conn(0x556b77522310 msgr2=0x556b77555560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:00.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.021+0000 7f942bfff640 0 client.16590 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:00.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.022+0000 7f9454e3e740 1 -- 172.21.15.2:0/2005868084 shutdown_connections 2024-09-19T06:20:00.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.022+0000 7f9454e3e740 1 -- 172.21.15.2:0/2005868084 wait complete. 2024-09-19T06:20:00.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.022+0000 7f9454e3e740 20 client.16590 trim_cache size 0 max 16384 2024-09-19T06:20:00.038 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:20:00.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.022+0000 7f9452a65640 1 -- 172.21.15.2:0/2237433658 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f94340a33b0 msgr2=0x7f94340a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:00.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.022+0000 7f9452a65640 1 --2- 172.21.15.2:0/2237433658 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f94340a33b0 0x7f94340a5870 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9444007e50 tx=0x7f9444004a40 comp rx=0 tx=0).stop 2024-09-19T06:20:00.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.022+0000 7f9452a65640 1 -- 172.21.15.2:0/2237433658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f944c101420 msgr2=0x7f944c199660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:00.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.022+0000 7f9452a65640 1 --2- 172.21.15.2:0/2237433658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f944c101420 0x7f944c199660 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f9440005940 tx=0x7f94400042f0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.022+0000 7f9452a65640 1 -- 172.21.15.2:0/2237433658 shutdown_connections 2024-09-19T06:20:00.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.022+0000 7f9452a65640 1 --2- 172.21.15.2:0/2237433658 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f94340a33b0 0x7f94340a5870 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.022+0000 7f9452a65640 1 --2- 172.21.15.2:0/2237433658 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f944c106a80 0x7f944c1a41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.022+0000 7f9452a65640 1 --2- 172.21.15.2:0/2237433658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f944c101420 0x7f944c199660 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.022+0000 7f9452a65640 1 --2- 172.21.15.2:0/2237433658 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f944c100a80 0x7f944c199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.022+0000 7f9452a65640 1 -- 172.21.15.2:0/2237433658 >> 172.21.15.2:0/2237433658 conn(0x7f944c0fc7a0 msgr2=0x7f944c0fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:00.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.022+0000 7f9452a65640 1 -- 172.21.15.2:0/2237433658 shutdown_connections 2024-09-19T06:20:00.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:00.022+0000 7f9452a65640 1 -- 172.21.15.2:0/2237433658 wait complete. 2024-09-19T06:20:00.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:19:59 smithi089 ceph-mon[34160]: pgmap v158: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:20:00.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:00 smithi002 ceph-mon[30982]: overall HEALTH_OK 2024-09-19T06:20:00.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:00 smithi090 ceph-mon[34497]: overall HEALTH_OK 2024-09-19T06:20:01.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:00 smithi089 ceph-mon[34160]: overall HEALTH_OK 2024-09-19T06:20:01.869 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:20:01.869 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:20:01.892 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:01 smithi002 ceph-mon[30982]: pgmap v159: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:20:01.892 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:01 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:20:01.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:01 smithi090 ceph-mon[34497]: pgmap v159: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:20:01.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:01 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:20:02.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:01 smithi089 ceph-mon[34160]: pgmap v159: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:20:02.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:01 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:20:02.131 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:02.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.587+0000 7f57bf070640 1 -- 172.21.15.2:0/160893898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57b8106f10 msgr2=0x7f57b810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:02.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.587+0000 7f57bf070640 1 --2- 172.21.15.2:0/160893898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57b8106f10 0x7f57b810ea90 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f57a8009900 tx=0x7f57a802a410 comp rx=0 tx=0).stop 2024-09-19T06:20:02.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.587+0000 7f57bf070640 1 -- 172.21.15.2:0/160893898 shutdown_connections 2024-09-19T06:20:02.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.587+0000 7f57bf070640 1 --2- 172.21.15.2:0/160893898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57b8106f10 0x7f57b810ea90 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.587+0000 7f57bf070640 1 --2- 172.21.15.2:0/160893898 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57b8102790 0x7f57b81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.587+0000 7f57bf070640 1 --2- 172.21.15.2:0/160893898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57b8101de0 0x7f57b81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.587+0000 7f57bf070640 1 -- 172.21.15.2:0/160893898 >> 172.21.15.2:0/160893898 conn(0x7f57b80fd8c0 msgr2=0x7f57b80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:02.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.587+0000 7f57bf070640 1 -- 172.21.15.2:0/160893898 shutdown_connections 2024-09-19T06:20:02.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.587+0000 7f57bf070640 1 -- 172.21.15.2:0/160893898 wait complete. 2024-09-19T06:20:02.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.587+0000 7f57bf070640 1 Processor -- start 2024-09-19T06:20:02.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.587+0000 7f57bf070640 1 -- start start 2024-09-19T06:20:02.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.588+0000 7f57bf070640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57b8101de0 0x7f57b8198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:02.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.588+0000 7f57bf070640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57b8102790 0x7f57b8198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:02.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.588+0000 7f57bf070640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57b8106f10 0x7f57b819cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:02.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.588+0000 7f57bf070640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f57b8111e20 con 0x7f57b8101de0 2024-09-19T06:20:02.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.588+0000 7f57bf070640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f57b8111ca0 con 0x7f57b8106f10 2024-09-19T06:20:02.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.588+0000 7f57bf070640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f57b8111fa0 con 0x7f57b8102790 2024-09-19T06:20:02.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.588+0000 7f57bce0c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57b8101de0 0x7f57b8198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:02.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.588+0000 7f57bce0c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57b8101de0 0x7f57b8198240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35890/0 (socket says 172.21.15.2:35890) 2024-09-19T06:20:02.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.588+0000 7f57bce0c640 1 -- 172.21.15.2:0/174915967 learned_addr learned my addr 172.21.15.2:0/174915967 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:02.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.588+0000 7f57b7fff640 1 --2- 172.21.15.2:0/174915967 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57b8102790 0x7f57b8198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:02.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.588+0000 7f57bd60d640 1 --2- 172.21.15.2:0/174915967 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57b8106f10 0x7f57b819cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:02.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.588+0000 7f57bce0c640 1 -- 172.21.15.2:0/174915967 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57b8102790 msgr2=0x7f57b8198780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:02.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.588+0000 7f57bce0c640 1 --2- 172.21.15.2:0/174915967 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57b8102790 0x7f57b8198780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.588+0000 7f57bce0c640 1 -- 172.21.15.2:0/174915967 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57b8106f10 msgr2=0x7f57b819cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:02.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.588+0000 7f57bce0c640 1 --2- 172.21.15.2:0/174915967 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57b8106f10 0x7f57b819cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.588+0000 7f57bce0c640 1 -- 172.21.15.2:0/174915967 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b819d1f0 con 0x7f57b8101de0 2024-09-19T06:20:02.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.588+0000 7f57bce0c640 1 --2- 172.21.15.2:0/174915967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57b8101de0 0x7f57b8198240 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f57b000cce0 tx=0x7f57b000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:02.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.588+0000 7f57b5ffb640 1 -- 172.21.15.2:0/174915967 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57b000f650 con 0x7f57b8101de0 2024-09-19T06:20:02.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.588+0000 7f57b5ffb640 1 -- 172.21.15.2:0/174915967 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f57b000fca0 con 0x7f57b8101de0 2024-09-19T06:20:02.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.588+0000 7f57bf070640 1 -- 172.21.15.2:0/174915967 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57b819d4e0 con 0x7f57b8101de0 2024-09-19T06:20:02.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.588+0000 7f57b5ffb640 1 -- 172.21.15.2:0/174915967 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57b0018b90 con 0x7f57b8101de0 2024-09-19T06:20:02.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.589+0000 7f57bf070640 1 -- 172.21.15.2:0/174915967 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57b81a4dc0 con 0x7f57b8101de0 2024-09-19T06:20:02.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.591+0000 7f57b5ffb640 1 -- 172.21.15.2:0/174915967 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f57b000f7f0 con 0x7f57b8101de0 2024-09-19T06:20:02.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.591+0000 7f57c1449740 1 Processor -- start 2024-09-19T06:20:02.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.591+0000 7f57c1449740 1 -- start start 2024-09-19T06:20:02.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.591+0000 7f57c1449740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5586e89f0b60 0x5586e89f0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:02.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.591+0000 7f57c1449740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586e89f1480 0x5586e89fb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:02.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.591+0000 7f57c1449740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5586e89fbd40 0x5586e89fe130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:02.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.591+0000 7f57c1449740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5586e8956280 con 0x5586e89fbd40 2024-09-19T06:20:02.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.591+0000 7f57c1449740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5586e88fdb10 con 0x5586e89f1480 2024-09-19T06:20:02.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.591+0000 7f57c1449740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5586e8952240 con 0x5586e89f0b60 2024-09-19T06:20:02.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.591+0000 7f57b5ffb640 1 --2- 172.21.15.2:0/174915967 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f57a00a33b0 0x7f57a00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:02.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.592+0000 7f57bce0c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586e89f1480 0x5586e89fb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:02.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.592+0000 7f57b7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5586e89fbd40 0x5586e89fe130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:02.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.592+0000 7f57b7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5586e89fbd40 0x5586e89fe130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35906/0 (socket says 172.21.15.2:35906) 2024-09-19T06:20:02.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.592+0000 7f57b7fff640 1 -- 172.21.15.2:0/3573017823 learned_addr learned my addr 172.21.15.2:0/3573017823 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:02.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.592+0000 7f57bd60d640 1 --2- 172.21.15.2:0/174915967 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f57a00a33b0 0x7f57a00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:02.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.592+0000 7f57bd60d640 1 --2- 172.21.15.2:0/3573017823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5586e89f0b60 0x5586e89f0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:02.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.592+0000 7f57b5ffb640 1 -- 172.21.15.2:0/174915967 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f57b00d0090 con 0x7f57b8101de0 2024-09-19T06:20:02.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.592+0000 7f57b7fff640 1 -- 172.21.15.2:0/3573017823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5586e89f0b60 msgr2=0x5586e89f0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:02.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.592+0000 7f57b7fff640 1 --2- 172.21.15.2:0/3573017823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5586e89f0b60 0x5586e89f0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.592+0000 7f57b7fff640 1 -- 172.21.15.2:0/3573017823 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586e89f1480 msgr2=0x5586e89fb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:02.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.592+0000 7f57b7fff640 1 --2- 172.21.15.2:0/3573017823 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586e89f1480 0x5586e89fb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.592+0000 7f57b7fff640 1 -- 172.21.15.2:0/3573017823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586e890a1f0 con 0x5586e89fbd40 2024-09-19T06:20:02.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.592+0000 7f57bce0c640 1 --2- 172.21.15.2:0/3573017823 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586e89f1480 0x5586e89fb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:02.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.592+0000 7f57b7fff640 1 --2- 172.21.15.2:0/3573017823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5586e89fbd40 0x5586e89fe130 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f57ac00bc30 tx=0x7f57ac0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f061249ab1d36cdd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:02.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.592+0000 7f57bd60d640 1 --2- 172.21.15.2:0/174915967 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f57a00a33b0 0x7f57a00a5870 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f57a8006010 tx=0x7f57a8031400 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:02.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.592+0000 7f579effd640 1 -- 172.21.15.2:0/3573017823 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ac01c480 con 0x5586e89fbd40 2024-09-19T06:20:02.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.592+0000 7f579effd640 1 -- 172.21.15.2:0/3573017823 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f57ac01cad0 con 0x5586e89fbd40 2024-09-19T06:20:02.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.592+0000 7f579effd640 1 -- 172.21.15.2:0/3573017823 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ac011af0 con 0x5586e89fbd40 2024-09-19T06:20:02.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.593+0000 7f57c1449740 1 -- 172.21.15.2:0/3573017823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5586e89fbd40 msgr2=0x5586e89fe130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:02.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.593+0000 7f57c1449740 1 --2- 172.21.15.2:0/3573017823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5586e89fbd40 0x5586e89fe130 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f57ac00bc30 tx=0x7f57ac0107a0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.593+0000 7f57c1449740 1 -- 172.21.15.2:0/3573017823 shutdown_connections 2024-09-19T06:20:02.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.593+0000 7f57c1449740 1 --2- 172.21.15.2:0/3573017823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5586e89fbd40 0x5586e89fe130 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.593+0000 7f57c1449740 1 --2- 172.21.15.2:0/3573017823 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586e89f1480 0x5586e89fb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.593+0000 7f57c1449740 1 --2- 172.21.15.2:0/3573017823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5586e89f0b60 0x5586e89f0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.593+0000 7f57c1449740 1 -- 172.21.15.2:0/3573017823 >> 172.21.15.2:0/3573017823 conn(0x5586e89ed0f0 msgr2=0x5586e89ed4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:02.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.593+0000 7f57c1449740 1 -- 172.21.15.2:0/3573017823 shutdown_connections 2024-09-19T06:20:02.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.593+0000 7f57c1449740 1 -- 172.21.15.2:0/3573017823 wait complete. 2024-09-19T06:20:02.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.593+0000 7f57c1449740 1 -- start start 2024-09-19T06:20:02.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.594+0000 7f57c1449740 1 Processor -- start 2024-09-19T06:20:02.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.594+0000 7f57c1449740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5586e89f0b60 0x5586e89f8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:02.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.594+0000 7f57c1449740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5586e89f1480 0x5586e89f9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:02.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.594+0000 7f57c1449740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586e89fbd40 0x5586e89f96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:02.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.594+0000 7f57c1449740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5586e89fe910 con 0x5586e89f0b60 2024-09-19T06:20:02.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.594+0000 7f57c1449740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5586e8910f10 con 0x5586e89fbd40 2024-09-19T06:20:02.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.594+0000 7f57c1449740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5586e89fea90 con 0x5586e89f1480 2024-09-19T06:20:02.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.594+0000 7f57c1449740 10 client.0 _ll_register_callbacks cb 0x5586e88d9a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:02.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.594+0000 7f57bce0c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5586e89f0b60 0x5586e89f8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:02.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.594+0000 7f57bce0c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5586e89f0b60 0x5586e89f8c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35912/0 (socket says 172.21.15.2:35912) 2024-09-19T06:20:02.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.594+0000 7f57bce0c640 1 -- 172.21.15.2:0/48171014 learned_addr learned my addr 172.21.15.2:0/48171014 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:02.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.594+0000 7f57b7fff640 1 --2- 172.21.15.2:0/48171014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5586e89f1480 0x5586e89f9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:02.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.594+0000 7f57bd60d640 1 --2- 172.21.15.2:0/48171014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586e89fbd40 0x5586e89f96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:02.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.594+0000 7f57bce0c640 1 -- 172.21.15.2:0/48171014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5586e89f1480 msgr2=0x5586e89f9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:02.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.594+0000 7f57bce0c640 1 --2- 172.21.15.2:0/48171014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5586e89f1480 0x5586e89f9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.594+0000 7f57bce0c640 1 -- 172.21.15.2:0/48171014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586e89fbd40 msgr2=0x5586e89f96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:02.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.594+0000 7f57bce0c640 1 --2- 172.21.15.2:0/48171014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586e89fbd40 0x5586e89f96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.594+0000 7f57bce0c640 1 -- 172.21.15.2:0/48171014 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586e86c76a0 con 0x5586e89f0b60 2024-09-19T06:20:02.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.594+0000 7f57bd60d640 1 --2- 172.21.15.2:0/48171014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586e89fbd40 0x5586e89f96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:20:02.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.595+0000 7f57bce0c640 1 --2- 172.21.15.2:0/48171014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5586e89f0b60 0x5586e89f8c30 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f57b000ab20 tx=0x7f57b006b130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7572a5401db54537 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:02.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.595+0000 7f5797fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:02.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.595+0000 7f5797fff640 1 -- 172.21.15.2:0/48171014 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57b009cb40 con 0x5586e89f0b60 2024-09-19T06:20:02.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.595+0000 7f5797fff640 1 -- 172.21.15.2:0/48171014 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f57b00a4c20 con 0x5586e89f0b60 2024-09-19T06:20:02.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.595+0000 7f57c1449740 1 -- 172.21.15.2:0/48171014 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57ac01cad0 con 0x5586e89f0b60 2024-09-19T06:20:02.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.595+0000 7f5797fff640 1 -- 172.21.15.2:0/48171014 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f57b00b5050 con 0x5586e89f0b60 2024-09-19T06:20:02.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.595+0000 7f57c1449740 10 client.16602 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:02.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.595+0000 7f57c1449740 1 -- 172.21.15.2:0/48171014 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5586e8a0a580 con 0x5586e89f0b60 2024-09-19T06:20:02.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.598+0000 7f5797fff640 1 -- 172.21.15.2:0/48171014 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f57ac01cad0 con 0x5586e89f0b60 2024-09-19T06:20:02.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.599+0000 7f5797fff640 1 -- 172.21.15.2:0/48171014 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f57b0079040 con 0x5586e89f0b60 2024-09-19T06:20:02.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.599+0000 7f57c1449740 10 client.16602 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:02.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.599+0000 7f57c1449740 10 client.16602 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:02.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.599+0000 7f57c1449740 20 client.16602 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:02.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.599+0000 7f57c1449740 1 --2- 172.21.15.2:0/48171014 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5586e8a0b990 0x5586e8a0dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:02.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.599+0000 7f57c1449740 4 client.16602 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:02.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.599+0000 7f57c1449740 1 -- 172.21.15.2:0/48171014 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5586e89637f0 con 0x5586e8a0b990 2024-09-19T06:20:02.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.599+0000 7f57b7fff640 1 --2- 172.21.15.2:0/48171014 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5586e8a0b990 0x5586e8a0dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:02.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.599+0000 7f5797fff640 10 client.16602 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:02.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.599+0000 7f57b7fff640 1 --2- 172.21.15.2:0/48171014 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5586e8a0b990 0x5586e8a0dda0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2af556947639b3ca server_cookie=1bf52390060f55f4 in_seq=0 out_seq=0 2024-09-19T06:20:02.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.600+0000 7f5797fff640 1 -- 172.21.15.2:0/48171014 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5586e89637f0 con 0x5586e8a0b990 2024-09-19T06:20:02.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.600+0000 7f5797fff640 10 client.16602 handle_command_reply: tid=0 2024-09-19T06:20:02.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.600+0000 7f57c1449740 1 client.16602 shutdown 2024-09-19T06:20:02.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.600+0000 7f57c1449740 1 -- 172.21.15.2:0/48171014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5586e89f0b60 msgr2=0x5586e89f8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:02.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.600+0000 7f57c1449740 1 --2- 172.21.15.2:0/48171014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5586e89f0b60 0x5586e89f8c30 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f57b000ab20 tx=0x7f57b006b130 comp rx=0 tx=0).stop 2024-09-19T06:20:02.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.600+0000 7f57c1449740 1 -- 172.21.15.2:0/48171014 shutdown_connections 2024-09-19T06:20:02.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.600+0000 7f57c1449740 1 --2- 172.21.15.2:0/48171014 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5586e8a0b990 0x5586e8a0dda0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.600+0000 7f5797fff640 0 client.16602 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:02.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.600+0000 7f57c1449740 1 --2- 172.21.15.2:0/48171014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586e89fbd40 0x5586e89f96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.600+0000 7f57c1449740 1 --2- 172.21.15.2:0/48171014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5586e89f1480 0x5586e89f9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.600+0000 7f57c1449740 1 --2- 172.21.15.2:0/48171014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5586e89f0b60 0x5586e89f8c30 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.600+0000 7f57c1449740 1 -- 172.21.15.2:0/48171014 >> 172.21.15.2:0/48171014 conn(0x5586e89ed0f0 msgr2=0x5586e89ec270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:02.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.601+0000 7f57c1449740 1 -- 172.21.15.2:0/48171014 shutdown_connections 2024-09-19T06:20:02.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.601+0000 7f57c1449740 1 -- 172.21.15.2:0/48171014 wait complete. 2024-09-19T06:20:02.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.601+0000 7f57c1449740 20 client.16602 trim_cache size 0 max 16384 2024-09-19T06:20:02.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.618+0000 7f57c1449740 1 Processor -- start 2024-09-19T06:20:02.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.618+0000 7f57c1449740 1 -- start start 2024-09-19T06:20:02.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.618+0000 7f57c1449740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586e89f0b60 0x5586e8a13640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:02.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.618+0000 7f57c1449740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5586e89f1480 0x5586e8a13b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:02.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.618+0000 7f57c1449740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5586e89fbd40 0x5586e89f5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:02.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.618+0000 7f57c1449740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f57b81aff40 con 0x5586e89f1480 2024-09-19T06:20:02.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.618+0000 7f57c1449740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f57b81ad810 con 0x5586e89f0b60 2024-09-19T06:20:02.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.618+0000 7f57c1449740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f57b81ab660 con 0x5586e89fbd40 2024-09-19T06:20:02.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.618+0000 7f57b7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5586e89f1480 0x5586e8a13b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:02.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.618+0000 7f57b7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5586e89f1480 0x5586e8a13b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35928/0 (socket says 172.21.15.2:35928) 2024-09-19T06:20:02.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.618+0000 7f57b7fff640 1 -- 172.21.15.2:0/4242261489 learned_addr learned my addr 172.21.15.2:0/4242261489 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:02.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.618+0000 7f57bce0c640 1 --2- 172.21.15.2:0/4242261489 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586e89f0b60 0x5586e8a13640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:02.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.619+0000 7f57bd60d640 1 --2- 172.21.15.2:0/4242261489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5586e89fbd40 0x5586e89f5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:02.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.619+0000 7f57b7fff640 1 -- 172.21.15.2:0/4242261489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5586e89fbd40 msgr2=0x5586e89f5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:02.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.619+0000 7f57b7fff640 1 --2- 172.21.15.2:0/4242261489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5586e89fbd40 0x5586e89f5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.619+0000 7f57b7fff640 1 -- 172.21.15.2:0/4242261489 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586e89f0b60 msgr2=0x5586e8a13640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:02.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.619+0000 7f57b7fff640 1 --2- 172.21.15.2:0/4242261489 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586e89f0b60 0x5586e8a13640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.619+0000 7f57b7fff640 1 -- 172.21.15.2:0/4242261489 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586e89e8830 con 0x5586e89f1480 2024-09-19T06:20:02.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.619+0000 7f57b7fff640 1 --2- 172.21.15.2:0/4242261489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5586e89f1480 0x5586e8a13b80 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f57ac011010 tx=0x7f57ac00b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=664feba678b202d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:02.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.619+0000 7f579e7fc640 1 -- 172.21.15.2:0/4242261489 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ac02c030 con 0x5586e89f1480 2024-09-19T06:20:02.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.619+0000 7f579e7fc640 1 -- 172.21.15.2:0/4242261489 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f57ac00bd20 con 0x5586e89f1480 2024-09-19T06:20:02.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.619+0000 7f579e7fc640 1 -- 172.21.15.2:0/4242261489 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ac005490 con 0x5586e89f1480 2024-09-19T06:20:02.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.620+0000 7f57c1449740 1 -- 172.21.15.2:0/4242261489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5586e89f1480 msgr2=0x5586e8a13b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:02.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.620+0000 7f57c1449740 1 --2- 172.21.15.2:0/4242261489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5586e89f1480 0x5586e8a13b80 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f57ac011010 tx=0x7f57ac00b390 comp rx=0 tx=0).stop 2024-09-19T06:20:02.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.620+0000 7f57c1449740 1 -- 172.21.15.2:0/4242261489 shutdown_connections 2024-09-19T06:20:02.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.620+0000 7f57c1449740 1 --2- 172.21.15.2:0/4242261489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5586e89fbd40 0x5586e89f5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.620+0000 7f57c1449740 1 --2- 172.21.15.2:0/4242261489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5586e89f1480 0x5586e8a13b80 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.620+0000 7f57c1449740 1 --2- 172.21.15.2:0/4242261489 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586e89f0b60 0x5586e8a13640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.620+0000 7f57c1449740 1 -- 172.21.15.2:0/4242261489 >> 172.21.15.2:0/4242261489 conn(0x5586e89ed0f0 msgr2=0x5586e89faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:02.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.620+0000 7f57c1449740 1 -- 172.21.15.2:0/4242261489 shutdown_connections 2024-09-19T06:20:02.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.620+0000 7f57c1449740 1 -- 172.21.15.2:0/4242261489 wait complete. 2024-09-19T06:20:02.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.620+0000 7f57c1449740 1 -- start start 2024-09-19T06:20:02.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.620+0000 7f57c1449740 1 Processor -- start 2024-09-19T06:20:02.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.621+0000 7f57c1449740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5586e89f0b60 0x5586e8a00100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:02.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.621+0000 7f57c1449740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586e89f1480 0x5586e8a00640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:02.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.621+0000 7f57c1449740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5586e89fbd40 0x5586e8a75610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:02.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.621+0000 7f57c1449740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f57b81abcd0 con 0x5586e89fbd40 2024-09-19T06:20:02.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.621+0000 7f57c1449740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f57b81ad140 con 0x5586e89f1480 2024-09-19T06:20:02.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.621+0000 7f57c1449740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f57b81ac3a0 con 0x5586e89f0b60 2024-09-19T06:20:02.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.621+0000 7f57c1449740 10 client.0 _ll_register_callbacks cb 0x7f57b00bc040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:02.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.621+0000 7f57bd60d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5586e89fbd40 0x5586e8a75610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:02.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.621+0000 7f57bd60d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5586e89fbd40 0x5586e8a75610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35938/0 (socket says 172.21.15.2:35938) 2024-09-19T06:20:02.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.621+0000 7f57bd60d640 1 -- 172.21.15.2:0/4218968797 learned_addr learned my addr 172.21.15.2:0/4218968797 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:02.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.621+0000 7f57bce0c640 1 --2- 172.21.15.2:0/4218968797 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5586e89f0b60 0x5586e8a00100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:02.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.621+0000 7f57b7fff640 1 --2- 172.21.15.2:0/4218968797 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586e89f1480 0x5586e8a00640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:02.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.621+0000 7f57bd60d640 1 -- 172.21.15.2:0/4218968797 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5586e89f0b60 msgr2=0x5586e8a00100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:02.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.621+0000 7f57bd60d640 1 --2- 172.21.15.2:0/4218968797 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5586e89f0b60 0x5586e8a00100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.621+0000 7f57bd60d640 1 -- 172.21.15.2:0/4218968797 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586e89f1480 msgr2=0x5586e8a00640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:02.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.621+0000 7f57bd60d640 1 --2- 172.21.15.2:0/4218968797 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586e89f1480 0x5586e8a00640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.621+0000 7f57bd60d640 1 -- 172.21.15.2:0/4218968797 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586e8a75b50 con 0x5586e89fbd40 2024-09-19T06:20:02.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.621+0000 7f57bd60d640 1 --2- 172.21.15.2:0/4218968797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5586e89fbd40 0x5586e8a75610 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f57a8009900 tx=0x7f57a802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ce0e2856ced30f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:02.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.621+0000 7f5797fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:02.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.622+0000 7f5797fff640 1 -- 172.21.15.2:0/4218968797 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a8050030 con 0x5586e89fbd40 2024-09-19T06:20:02.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.622+0000 7f5797fff640 1 -- 172.21.15.2:0/4218968797 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f57a8045040 con 0x5586e89fbd40 2024-09-19T06:20:02.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.622+0000 7f57c1449740 1 -- 172.21.15.2:0/4218968797 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57ac00bd20 con 0x5586e89fbd40 2024-09-19T06:20:02.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.622+0000 7f5797fff640 1 -- 172.21.15.2:0/4218968797 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f57a8004250 con 0x5586e89fbd40 2024-09-19T06:20:02.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.622+0000 7f57c1449740 10 client.16608 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:02.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.622+0000 7f57c1449740 1 -- 172.21.15.2:0/4218968797 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5586e8a76e10 con 0x5586e89fbd40 2024-09-19T06:20:02.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.622+0000 7f5797fff640 1 -- 172.21.15.2:0/4218968797 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f57ac00bd20 con 0x5586e89fbd40 2024-09-19T06:20:02.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.622+0000 7f5797fff640 1 -- 172.21.15.2:0/4218968797 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f57a8004880 con 0x5586e89fbd40 2024-09-19T06:20:02.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.622+0000 7f57c1449740 10 client.16608 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:02.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.622+0000 7f57c1449740 10 client.16608 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:02.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.622+0000 7f57c1449740 20 client.16608 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:02.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.622+0000 7f57c1449740 1 --2- 172.21.15.2:0/4218968797 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5586e8a77590 0x5586e8a799b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:02.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.622+0000 7f57c1449740 4 client.16608 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:20:02.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.622+0000 7f57c1449740 1 -- 172.21.15.2:0/4218968797 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5586e895dd00 con 0x5586e8a77590 2024-09-19T06:20:02.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.623+0000 7f57bce0c640 1 --2- 172.21.15.2:0/4218968797 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5586e8a77590 0x5586e8a799b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:02.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.623+0000 7f57bce0c640 1 --2- 172.21.15.2:0/4218968797 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5586e8a77590 0x5586e8a799b0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e401ff36ee32728 server_cookie=981bb45da550a4be in_seq=0 out_seq=0 2024-09-19T06:20:02.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.623+0000 7f5797fff640 10 client.16608 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:02.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.624+0000 7f5797fff640 1 -- 172.21.15.2:0/4218968797 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5586e895dd00 con 0x5586e8a77590 2024-09-19T06:20:02.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.624+0000 7f5797fff640 10 client.16608 handle_command_reply: tid=0 2024-09-19T06:20:02.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.624+0000 7f57c1449740 1 client.16608 shutdown 2024-09-19T06:20:02.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.624+0000 7f57c1449740 1 -- 172.21.15.2:0/4218968797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5586e89fbd40 msgr2=0x5586e8a75610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:02.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.624+0000 7f57c1449740 1 --2- 172.21.15.2:0/4218968797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5586e89fbd40 0x5586e8a75610 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f57a8009900 tx=0x7f57a802a410 comp rx=0 tx=0).stop 2024-09-19T06:20:02.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.624+0000 7f57c1449740 1 -- 172.21.15.2:0/4218968797 shutdown_connections 2024-09-19T06:20:02.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.624+0000 7f57c1449740 1 --2- 172.21.15.2:0/4218968797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5586e89fbd40 0x5586e8a75610 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.624+0000 7f57c1449740 1 --2- 172.21.15.2:0/4218968797 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5586e8a77590 0x5586e8a799b0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.624+0000 7f57c1449740 1 --2- 172.21.15.2:0/4218968797 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5586e89f1480 0x5586e8a00640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.624+0000 7f5797fff640 0 client.16608 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:02.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.624+0000 7f57c1449740 1 --2- 172.21.15.2:0/4218968797 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5586e89f0b60 0x5586e8a00100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.624+0000 7f57c1449740 1 -- 172.21.15.2:0/4218968797 >> 172.21.15.2:0/4218968797 conn(0x5586e89ed0f0 msgr2=0x5586e89f25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:02.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.624+0000 7f57c1449740 1 -- 172.21.15.2:0/4218968797 shutdown_connections 2024-09-19T06:20:02.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.624+0000 7f57c1449740 1 -- 172.21.15.2:0/4218968797 wait complete. 2024-09-19T06:20:02.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.624+0000 7f57c1449740 20 client.16608 trim_cache size 0 max 16384 2024-09-19T06:20:02.631 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:20:02.632 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T06:20:02.632 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "ea473732-2a33-4274-87b2-b6b1496dc362", 2024-09-19T06:20:02.632 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T06:20:02.632 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:20:02.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.625+0000 7f57bf070640 1 -- 172.21.15.2:0/174915967 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f57a00a33b0 msgr2=0x7f57a00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:02.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.625+0000 7f57bf070640 1 --2- 172.21.15.2:0/174915967 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f57a00a33b0 0x7f57a00a5870 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f57a8006010 tx=0x7f57a8031400 comp rx=0 tx=0).stop 2024-09-19T06:20:02.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.625+0000 7f57bf070640 1 -- 172.21.15.2:0/174915967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57b8101de0 msgr2=0x7f57b8198240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:02.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.625+0000 7f57bf070640 1 --2- 172.21.15.2:0/174915967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57b8101de0 0x7f57b8198240 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f57b000cce0 tx=0x7f57b000a620 comp rx=0 tx=0).stop 2024-09-19T06:20:02.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.625+0000 7f57bf070640 1 -- 172.21.15.2:0/174915967 shutdown_connections 2024-09-19T06:20:02.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.625+0000 7f57bf070640 1 --2- 172.21.15.2:0/174915967 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f57a00a33b0 0x7f57a00a5870 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.625+0000 7f57bf070640 1 --2- 172.21.15.2:0/174915967 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57b8106f10 0x7f57b819cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.625+0000 7f57bf070640 1 --2- 172.21.15.2:0/174915967 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57b8102790 0x7f57b8198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.625+0000 7f57bf070640 1 --2- 172.21.15.2:0/174915967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57b8101de0 0x7f57b8198240 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.625+0000 7f57bf070640 1 -- 172.21.15.2:0/174915967 >> 172.21.15.2:0/174915967 conn(0x7f57b80fd8c0 msgr2=0x7f57b80fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:02.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.625+0000 7f57bf070640 1 -- 172.21.15.2:0/174915967 shutdown_connections 2024-09-19T06:20:02.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:02.625+0000 7f57bf070640 1 -- 172.21.15.2:0/174915967 wait complete. 2024-09-19T06:20:02.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:02 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:20:02.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:02 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:20:02.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:02 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:20:02.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:02 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:20:02.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:02 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:20:02.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:02 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:20:03.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:02 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:20:03.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:02 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:20:03.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:02 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:20:03.342 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:20:03.640 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:04.013 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:03 smithi002 ceph-mon[30982]: pgmap v160: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:20:04.013 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:03 smithi002 ceph-mon[30982]: scrub queued for path: / 2024-09-19T06:20:04.013 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:03 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:04.013 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:03 smithi002 ceph-mon[30982]: scrub summary: active paths [/] 2024-09-19T06:20:04.013 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:03 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:04.013 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:03 smithi002 ceph-mon[30982]: scrub summary: idle 2024-09-19T06:20:04.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.090+0000 7f89f8f7b640 1 -- 172.21.15.2:0/3760542548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89f4102d40 msgr2=0x7f89f4103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:04.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.090+0000 7f89f8f7b640 1 --2- 172.21.15.2:0/3760542548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89f4102d40 0x7f89f4103120 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f89e4009900 tx=0x7f89e402a480 comp rx=0 tx=0).stop 2024-09-19T06:20:04.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.090+0000 7f89f8f7b640 1 -- 172.21.15.2:0/3760542548 shutdown_connections 2024-09-19T06:20:04.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.090+0000 7f89f8f7b640 1 --2- 172.21.15.2:0/3760542548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89f410c170 0x7f89f410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:04.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.090+0000 7f89f8f7b640 1 --2- 172.21.15.2:0/3760542548 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89f4103660 0x7f89f410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:04.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.090+0000 7f89f8f7b640 1 --2- 172.21.15.2:0/3760542548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89f4102d40 0x7f89f4103120 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:04.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.090+0000 7f89f8f7b640 1 -- 172.21.15.2:0/3760542548 >> 172.21.15.2:0/3760542548 conn(0x7f89f40fc7a0 msgr2=0x7f89f40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:04.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.090+0000 7f89f8f7b640 1 -- 172.21.15.2:0/3760542548 shutdown_connections 2024-09-19T06:20:04.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.090+0000 7f89f8f7b640 1 -- 172.21.15.2:0/3760542548 wait complete. 2024-09-19T06:20:04.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.091+0000 7f89f8f7b640 1 Processor -- start 2024-09-19T06:20:04.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.091+0000 7f89f8f7b640 1 -- start start 2024-09-19T06:20:04.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.091+0000 7f89f8f7b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89f4102d40 0x7f89f41009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:04.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.091+0000 7f89f8f7b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89f4103660 0x7f89f4100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:04.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.091+0000 7f89f8f7b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89f410c170 0x7f89f4101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:04.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.091+0000 7f89f8f7b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f89f4111e20 con 0x7f89f4102d40 2024-09-19T06:20:04.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.091+0000 7f89f8f7b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f89f4111ca0 con 0x7f89f4103660 2024-09-19T06:20:04.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.091+0000 7f89f8f7b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f89f4111fa0 con 0x7f89f410c170 2024-09-19T06:20:04.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.091+0000 7f89f259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89f4102d40 0x7f89f41009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:04.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.091+0000 7f89f259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89f4102d40 0x7f89f41009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35960/0 (socket says 172.21.15.2:35960) 2024-09-19T06:20:04.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.091+0000 7f89f259c640 1 -- 172.21.15.2:0/3435100801 learned_addr learned my addr 172.21.15.2:0/3435100801 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:04.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.091+0000 7f89ebfff640 1 --2- 172.21.15.2:0/3435100801 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89f4103660 0x7f89f4100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:04.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.092+0000 7f89f2d9d640 1 --2- 172.21.15.2:0/3435100801 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89f410c170 0x7f89f4101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:04.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.092+0000 7f89f259c640 1 -- 172.21.15.2:0/3435100801 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89f410c170 msgr2=0x7f89f4101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:04.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.092+0000 7f89f259c640 1 --2- 172.21.15.2:0/3435100801 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89f410c170 0x7f89f4101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:04.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.092+0000 7f89f259c640 1 -- 172.21.15.2:0/3435100801 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89f4103660 msgr2=0x7f89f4100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:04.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.092+0000 7f89f259c640 1 --2- 172.21.15.2:0/3435100801 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89f4103660 0x7f89f4100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:04.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.092+0000 7f89f259c640 1 -- 172.21.15.2:0/3435100801 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89f41a6860 con 0x7f89f4102d40 2024-09-19T06:20:04.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.092+0000 7f89f259c640 1 --2- 172.21.15.2:0/3435100801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89f4102d40 0x7f89f41009a0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f89e4005940 tx=0x7f89e40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:04.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.092+0000 7f89eb7fe640 1 -- 172.21.15.2:0/3435100801 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e403f030 con 0x7f89f4102d40 2024-09-19T06:20:04.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.092+0000 7f89eb7fe640 1 -- 172.21.15.2:0/3435100801 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f89e4003cb0 con 0x7f89f4102d40 2024-09-19T06:20:04.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.092+0000 7f89eb7fe640 1 -- 172.21.15.2:0/3435100801 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e4035070 con 0x7f89f4102d40 2024-09-19T06:20:04.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.092+0000 7f89f8f7b640 1 -- 172.21.15.2:0/3435100801 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89f41a6af0 con 0x7f89f4102d40 2024-09-19T06:20:04.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.092+0000 7f89f8f7b640 1 -- 172.21.15.2:0/3435100801 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89f41a7020 con 0x7f89f4102d40 2024-09-19T06:20:04.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.094+0000 7f89eb7fe640 1 -- 172.21.15.2:0/3435100801 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f89e4042030 con 0x7f89f4102d40 2024-09-19T06:20:04.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.095+0000 7f89fb354740 1 Processor -- start 2024-09-19T06:20:04.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.095+0000 7f89fb354740 1 -- start start 2024-09-19T06:20:04.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.095+0000 7f89fb354740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d286f884a0 0x55d286f88880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:04.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.095+0000 7f89fb354740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d286f88dc0 0x55d286f93140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:04.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.095+0000 7f89fb354740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d286f93680 0x55d286f95a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:04.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.095+0000 7f89fb354740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d286eee2e0 con 0x55d286f93680 2024-09-19T06:20:04.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.095+0000 7f89fb354740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55d286e95ce0 con 0x55d286f884a0 2024-09-19T06:20:04.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.095+0000 7f89fb354740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55d286eea2a0 con 0x55d286f88dc0 2024-09-19T06:20:04.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.095+0000 7f89eb7fe640 1 --2- 172.21.15.2:0/3435100801 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f89e00a3430 0x7f89e00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:04.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.095+0000 7f89ebfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d286f93680 0x55d286f95a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:04.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.095+0000 7f89ebfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d286f93680 0x55d286f95a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35976/0 (socket says 172.21.15.2:35976) 2024-09-19T06:20:04.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.095+0000 7f89ebfff640 1 -- 172.21.15.2:0/1848930763 learned_addr learned my addr 172.21.15.2:0/1848930763 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:04.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.095+0000 7f89f259c640 1 --2- 172.21.15.2:0/1848930763 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d286f88dc0 0x55d286f93140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:04.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.095+0000 7f89f2d9d640 1 --2- 172.21.15.2:0/3435100801 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f89e00a3430 0x7f89e00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:04.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.096+0000 7f89f2d9d640 1 --2- 172.21.15.2:0/1848930763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d286f884a0 0x55d286f88880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:04.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.096+0000 7f89eb7fe640 1 -- 172.21.15.2:0/3435100801 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f89e40f04a0 con 0x7f89f4102d40 2024-09-19T06:20:04.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.096+0000 7f89ebfff640 1 -- 172.21.15.2:0/1848930763 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d286f88dc0 msgr2=0x55d286f93140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:04.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.096+0000 7f89ebfff640 1 --2- 172.21.15.2:0/1848930763 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d286f88dc0 0x55d286f93140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:04.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.096+0000 7f89ebfff640 1 -- 172.21.15.2:0/1848930763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d286f884a0 msgr2=0x55d286f88880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:04.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.096+0000 7f89ebfff640 1 --2- 172.21.15.2:0/1848930763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d286f884a0 0x55d286f88880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:04.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.096+0000 7f89ebfff640 1 -- 172.21.15.2:0/1848930763 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d286e7a440 con 0x55d286f93680 2024-09-19T06:20:04.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.096+0000 7f89f2d9d640 1 --2- 172.21.15.2:0/1848930763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d286f884a0 0x55d286f88880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:20:04.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.096+0000 7f89ebfff640 1 --2- 172.21.15.2:0/1848930763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d286f93680 0x55d286f95a70 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f89dc009c90 tx=0x7f89dc011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a900119be32b78b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:04.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.096+0000 7f89f2d9d640 1 --2- 172.21.15.2:0/3435100801 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f89e00a3430 0x7f89e00a58f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f89ec005c40 tx=0x7f89ec0094f0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:04.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.096+0000 7f89e8ff9640 1 -- 172.21.15.2:0/1848930763 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89dc005220 con 0x55d286f93680 2024-09-19T06:20:04.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.096+0000 7f89e8ff9640 1 -- 172.21.15.2:0/1848930763 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f89dc004c50 con 0x55d286f93680 2024-09-19T06:20:04.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.096+0000 7f89e8ff9640 1 -- 172.21.15.2:0/1848930763 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89dc019740 con 0x55d286f93680 2024-09-19T06:20:04.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.097+0000 7f89fb354740 1 -- 172.21.15.2:0/1848930763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d286f93680 msgr2=0x55d286f95a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:04.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.097+0000 7f89fb354740 1 --2- 172.21.15.2:0/1848930763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d286f93680 0x55d286f95a70 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f89dc009c90 tx=0x7f89dc011810 comp rx=0 tx=0).stop 2024-09-19T06:20:04.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.097+0000 7f89fb354740 1 -- 172.21.15.2:0/1848930763 shutdown_connections 2024-09-19T06:20:04.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.097+0000 7f89fb354740 1 --2- 172.21.15.2:0/1848930763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d286f93680 0x55d286f95a70 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:04.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.097+0000 7f89fb354740 1 --2- 172.21.15.2:0/1848930763 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d286f88dc0 0x55d286f93140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:04.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.097+0000 7f89fb354740 1 --2- 172.21.15.2:0/1848930763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d286f884a0 0x55d286f88880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:04.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.097+0000 7f89fb354740 1 -- 172.21.15.2:0/1848930763 >> 172.21.15.2:0/1848930763 conn(0x55d286f84a30 msgr2=0x55d286f84e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:04.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.097+0000 7f89fb354740 1 -- 172.21.15.2:0/1848930763 shutdown_connections 2024-09-19T06:20:04.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.097+0000 7f89fb354740 1 -- 172.21.15.2:0/1848930763 wait complete. 2024-09-19T06:20:04.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.097+0000 7f89fb354740 1 -- start start 2024-09-19T06:20:04.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.097+0000 7f89fb354740 1 Processor -- start 2024-09-19T06:20:04.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.098+0000 7f89fb354740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d286f884a0 0x55d286f92fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:04.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.098+0000 7f89fb354740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d286f88dc0 0x55d286f90250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:04.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.098+0000 7f89fb354740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d286f93680 0x55d286f90790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:04.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.098+0000 7f89fb354740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d286f96250 con 0x55d286f93680 2024-09-19T06:20:04.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.098+0000 7f89fb354740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55d286ea9050 con 0x55d286f884a0 2024-09-19T06:20:04.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.098+0000 7f89fb354740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55d286f963d0 con 0x55d286f88dc0 2024-09-19T06:20:04.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.098+0000 7f89fb354740 10 client.0 _ll_register_callbacks cb 0x55d286ee9160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:04.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.098+0000 7f89f2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d286f93680 0x55d286f90790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:04.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.098+0000 7f89f2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d286f93680 0x55d286f90790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35980/0 (socket says 172.21.15.2:35980) 2024-09-19T06:20:04.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.098+0000 7f89f2d9d640 1 -- 172.21.15.2:0/2297924399 learned_addr learned my addr 172.21.15.2:0/2297924399 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:04.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.098+0000 7f89ebfff640 1 --2- 172.21.15.2:0/2297924399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d286f88dc0 0x55d286f90250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:04.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.098+0000 7f89f259c640 1 --2- 172.21.15.2:0/2297924399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d286f884a0 0x55d286f92fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:04.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.098+0000 7f89f2d9d640 1 -- 172.21.15.2:0/2297924399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d286f88dc0 msgr2=0x55d286f90250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:04.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.098+0000 7f89f2d9d640 1 --2- 172.21.15.2:0/2297924399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d286f88dc0 0x55d286f90250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:04.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.098+0000 7f89f2d9d640 1 -- 172.21.15.2:0/2297924399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d286f884a0 msgr2=0x55d286f92fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:04.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.098+0000 7f89f2d9d640 1 --2- 172.21.15.2:0/2297924399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d286f884a0 0x55d286f92fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:04.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.098+0000 7f89f2d9d640 1 -- 172.21.15.2:0/2297924399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d286c5f3c0 con 0x55d286f93680 2024-09-19T06:20:04.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.098+0000 7f89f259c640 1 --2- 172.21.15.2:0/2297924399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d286f884a0 0x55d286f92fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:20:04.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.098+0000 7f89f2d9d640 1 --2- 172.21.15.2:0/2297924399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d286f93680 0x55d286f90790 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f89ec0125b0 tx=0x7f89ec004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba5637d2fb7fe851 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:04.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.098+0000 7f89d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:04.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.099+0000 7f89d9ffb640 1 -- 172.21.15.2:0/2297924399 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ec02b060 con 0x55d286f93680 2024-09-19T06:20:04.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.099+0000 7f89d9ffb640 1 -- 172.21.15.2:0/2297924399 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f89ec01c750 con 0x55d286f93680 2024-09-19T06:20:04.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.099+0000 7f89fb354740 1 -- 172.21.15.2:0/2297924399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89dc004c50 con 0x55d286f93680 2024-09-19T06:20:04.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.099+0000 7f89d9ffb640 1 -- 172.21.15.2:0/2297924399 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f89ec01c950 con 0x55d286f93680 2024-09-19T06:20:04.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.099+0000 7f89fb354740 10 client.16620 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:04.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.099+0000 7f89fb354740 1 -- 172.21.15.2:0/2297924399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55d286fa1ba0 con 0x55d286f93680 2024-09-19T06:20:04.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.099+0000 7f89d9ffb640 1 -- 172.21.15.2:0/2297924399 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f89dc004c50 con 0x55d286f93680 2024-09-19T06:20:04.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.099+0000 7f89d9ffb640 1 -- 172.21.15.2:0/2297924399 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f89ec0113e0 con 0x55d286f93680 2024-09-19T06:20:04.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.099+0000 7f89fb354740 10 client.16620 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:04.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.099+0000 7f89fb354740 10 client.16620 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:04.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.099+0000 7f89fb354740 20 client.16620 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:04.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.099+0000 7f89fb354740 1 --2- 172.21.15.2:0/2297924399 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55d286fa3060 0x55d286fa5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:04.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.099+0000 7f89fb354740 4 client.16620 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:04.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.099+0000 7f89fb354740 1 -- 172.21.15.2:0/2297924399 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d286efb850 con 0x55d286fa3060 2024-09-19T06:20:04.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.099+0000 7f89f259c640 1 --2- 172.21.15.2:0/2297924399 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55d286fa3060 0x55d286fa5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:04.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.100+0000 7f89f259c640 1 --2- 172.21.15.2:0/2297924399 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55d286fa3060 0x55d286fa5470 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6a7f59fdf40fadd server_cookie=c14ef4ec482ae6fe in_seq=0 out_seq=0 2024-09-19T06:20:04.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.100+0000 7f89d9ffb640 10 client.16620 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:04.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.101+0000 7f89d9ffb640 1 -- 172.21.15.2:0/2297924399 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d286efb850 con 0x55d286fa3060 2024-09-19T06:20:04.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.101+0000 7f89d9ffb640 10 client.16620 handle_command_reply: tid=0 2024-09-19T06:20:04.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.101+0000 7f89fb354740 1 client.16620 shutdown 2024-09-19T06:20:04.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.101+0000 7f89fb354740 1 -- 172.21.15.2:0/2297924399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d286f93680 msgr2=0x55d286f90790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:04.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.101+0000 7f89fb354740 1 --2- 172.21.15.2:0/2297924399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d286f93680 0x55d286f90790 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f89ec0125b0 tx=0x7f89ec004ab0 comp rx=0 tx=0).stop 2024-09-19T06:20:04.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.101+0000 7f89fb354740 1 -- 172.21.15.2:0/2297924399 shutdown_connections 2024-09-19T06:20:04.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.101+0000 7f89fb354740 1 --2- 172.21.15.2:0/2297924399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d286f93680 0x55d286f90790 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:04.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.101+0000 7f89fb354740 1 --2- 172.21.15.2:0/2297924399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d286f88dc0 0x55d286f90250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:04.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.101+0000 7f89fb354740 1 --2- 172.21.15.2:0/2297924399 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55d286fa3060 0x55d286fa5470 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:04.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.101+0000 7f89fb354740 1 --2- 172.21.15.2:0/2297924399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d286f884a0 0x55d286f92fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:04.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.101+0000 7f89fb354740 1 -- 172.21.15.2:0/2297924399 >> 172.21.15.2:0/2297924399 conn(0x55d286f84a30 msgr2=0x55d286f8a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:04.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.101+0000 7f89d9ffb640 0 client.16620 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:04.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.101+0000 7f89fb354740 1 -- 172.21.15.2:0/2297924399 shutdown_connections 2024-09-19T06:20:04.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.101+0000 7f89fb354740 1 -- 172.21.15.2:0/2297924399 wait complete. 2024-09-19T06:20:04.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.101+0000 7f89fb354740 20 client.16620 trim_cache size 0 max 16384 2024-09-19T06:20:04.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.118+0000 7f89fb354740 1 Processor -- start 2024-09-19T06:20:04.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.118+0000 7f89fb354740 1 -- start start 2024-09-19T06:20:04.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.118+0000 7f89fb354740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d286f884a0 0x55d286f9f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:04.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.118+0000 7f89fb354740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d286f88dc0 0x55d286faad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:04.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.118+0000 7f89fb354740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d286f93680 0x55d286fab280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:04.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.118+0000 7f89fb354740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f89f41b21d0 con 0x55d286f88dc0 2024-09-19T06:20:04.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.118+0000 7f89fb354740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f89f41afaa0 con 0x55d286f884a0 2024-09-19T06:20:04.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.118+0000 7f89fb354740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f89f41ad8f0 con 0x55d286f93680 2024-09-19T06:20:04.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.118+0000 7f89ebfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d286f88dc0 0x55d286faad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:04.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.118+0000 7f89ebfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d286f88dc0 0x55d286faad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35982/0 (socket says 172.21.15.2:35982) 2024-09-19T06:20:04.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.118+0000 7f89ebfff640 1 -- 172.21.15.2:0/3429500965 learned_addr learned my addr 172.21.15.2:0/3429500965 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:04.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.119+0000 7f89f259c640 1 --2- 172.21.15.2:0/3429500965 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d286f884a0 0x55d286f9f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:04.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.119+0000 7f89ebfff640 1 -- 172.21.15.2:0/3429500965 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d286f93680 msgr2=0x55d286fab280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:04.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.119+0000 7f89ebfff640 1 --2- 172.21.15.2:0/3429500965 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d286f93680 0x55d286fab280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:04.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.119+0000 7f89ebfff640 1 -- 172.21.15.2:0/3429500965 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d286f884a0 msgr2=0x55d286f9f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:04.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.119+0000 7f89ebfff640 1 --2- 172.21.15.2:0/3429500965 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d286f884a0 0x55d286f9f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:04.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.119+0000 7f89ebfff640 1 -- 172.21.15.2:0/3429500965 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d286f84860 con 0x55d286f88dc0 2024-09-19T06:20:04.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.119+0000 7f89ebfff640 1 --2- 172.21.15.2:0/3429500965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d286f88dc0 0x55d286faad40 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f89dc009c90 tx=0x7f89dc0099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e8b9eddc6a9f458 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:04.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.119+0000 7f89dbfff640 1 -- 172.21.15.2:0/3429500965 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89dc028070 con 0x55d286f88dc0 2024-09-19T06:20:04.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.119+0000 7f89dbfff640 1 -- 172.21.15.2:0/3429500965 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f89dc005380 con 0x55d286f88dc0 2024-09-19T06:20:04.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.119+0000 7f89dbfff640 1 -- 172.21.15.2:0/3429500965 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89dc019690 con 0x55d286f88dc0 2024-09-19T06:20:04.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.120+0000 7f89fb354740 1 -- 172.21.15.2:0/3429500965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d286f88dc0 msgr2=0x55d286faad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:04.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.120+0000 7f89fb354740 1 --2- 172.21.15.2:0/3429500965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d286f88dc0 0x55d286faad40 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f89dc009c90 tx=0x7f89dc0099b0 comp rx=0 tx=0).stop 2024-09-19T06:20:04.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.120+0000 7f89fb354740 1 -- 172.21.15.2:0/3429500965 shutdown_connections 2024-09-19T06:20:04.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.120+0000 7f89fb354740 1 --2- 172.21.15.2:0/3429500965 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d286f93680 0x55d286fab280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:04.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.120+0000 7f89fb354740 1 --2- 172.21.15.2:0/3429500965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d286f88dc0 0x55d286faad40 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:04.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.120+0000 7f89fb354740 1 --2- 172.21.15.2:0/3429500965 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d286f884a0 0x55d286f9f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:04.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.120+0000 7f89fb354740 1 -- 172.21.15.2:0/3429500965 >> 172.21.15.2:0/3429500965 conn(0x55d286f84a30 msgr2=0x55d286f8eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:04.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.120+0000 7f89fb354740 1 -- 172.21.15.2:0/3429500965 shutdown_connections 2024-09-19T06:20:04.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.120+0000 7f89fb354740 1 -- 172.21.15.2:0/3429500965 wait complete. 2024-09-19T06:20:04.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.120+0000 7f89fb354740 1 -- start start 2024-09-19T06:20:04.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.120+0000 7f89fb354740 1 Processor -- start 2024-09-19T06:20:04.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.120+0000 7f89fb354740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d286f884a0 0x55d286f977c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:04.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.120+0000 7f89fb354740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d286f88dc0 0x55d286f97d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:04.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.120+0000 7f89fb354740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d286f93680 0x55d28700cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:04.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.121+0000 7f89fb354740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f89f41adf60 con 0x55d286f93680 2024-09-19T06:20:04.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.121+0000 7f89fb354740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f89f41af3d0 con 0x55d286f884a0 2024-09-19T06:20:04.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.121+0000 7f89fb354740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f89f41ae630 con 0x55d286f88dc0 2024-09-19T06:20:04.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.121+0000 7f89fb354740 10 client.0 _ll_register_callbacks cb 0x7f89ec009d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:04.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.121+0000 7f89f2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d286f93680 0x55d28700cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:04.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.121+0000 7f89f2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d286f93680 0x55d28700cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35998/0 (socket says 172.21.15.2:35998) 2024-09-19T06:20:04.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.121+0000 7f89f2d9d640 1 -- 172.21.15.2:0/248660845 learned_addr learned my addr 172.21.15.2:0/248660845 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:04.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.121+0000 7f89f259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d286f884a0 0x55d286f977c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:04.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.121+0000 7f89ebfff640 1 --2- 172.21.15.2:0/248660845 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d286f88dc0 0x55d286f97d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:04.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.121+0000 7f89f259c640 1 -- 172.21.15.2:0/248660845 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d286f88dc0 msgr2=0x55d286f97d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:04.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.121+0000 7f89f259c640 1 --2- 172.21.15.2:0/248660845 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d286f88dc0 0x55d286f97d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:04.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.121+0000 7f89f259c640 1 -- 172.21.15.2:0/248660845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d286f93680 msgr2=0x55d28700cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:04.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.121+0000 7f89f259c640 1 --2- 172.21.15.2:0/248660845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d286f93680 0x55d28700cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:04.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.121+0000 7f89f259c640 1 -- 172.21.15.2:0/248660845 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d28700d250 con 0x55d286f884a0 2024-09-19T06:20:04.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.121+0000 7f89f2d9d640 1 --2- 172.21.15.2:0/248660845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d286f93680 0x55d28700cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:04.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.121+0000 7f89f259c640 1 --2- 172.21.15.2:0/248660845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d286f884a0 0x55d286f977c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f89e40edbc0 tx=0x7f89e40b1be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65c05ea95a0d8877 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:04.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.121+0000 7f89d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-09-19T06:20:04.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.121+0000 7f89d9ffb640 1 -- 172.21.15.2:0/248660845 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e4049040 con 0x55d286f884a0 2024-09-19T06:20:04.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.121+0000 7f89d9ffb640 1 -- 172.21.15.2:0/248660845 <== mon.2 v2:172.21.15.89:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f89e40b8e00 con 0x55d286f884a0 2024-09-19T06:20:04.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.121+0000 7f89fb354740 1 -- 172.21.15.2:0/248660845 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89dc005380 con 0x55d286f884a0 2024-09-19T06:20:04.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.122+0000 7f89d9ffb640 1 -- 172.21.15.2:0/248660845 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f89e40bc0b0 con 0x55d286f884a0 2024-09-19T06:20:04.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.122+0000 7f89fb354740 10 client.26036 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:04.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.122+0000 7f89fb354740 1 -- 172.21.15.2:0/248660845 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55d28700e460 con 0x55d286f884a0 2024-09-19T06:20:04.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.122+0000 7f89d9ffb640 1 -- 172.21.15.2:0/248660845 <== mon.2 v2:172.21.15.89:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f89dc005380 con 0x55d286f884a0 2024-09-19T06:20:04.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.122+0000 7f89d9ffb640 1 -- 172.21.15.2:0/248660845 <== mon.2 v2:172.21.15.89:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f89e40a5050 con 0x55d286f884a0 2024-09-19T06:20:04.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.122+0000 7f89fb354740 10 client.26036 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:04.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.122+0000 7f89fb354740 10 client.26036 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:04.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.122+0000 7f89fb354740 20 client.26036 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:04.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.122+0000 7f89fb354740 1 --2- 172.21.15.2:0/248660845 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55d28700eb30 0x55d287010f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:04.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.122+0000 7f89fb354740 4 client.26036 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:20:04.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.122+0000 7f89fb354740 1 -- 172.21.15.2:0/248660845 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d286f90b20 con 0x55d28700eb30 2024-09-19T06:20:04.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.122+0000 7f89ebfff640 1 --2- 172.21.15.2:0/248660845 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55d28700eb30 0x55d287010f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:04.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.123+0000 7f89ebfff640 1 --2- 172.21.15.2:0/248660845 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55d28700eb30 0x55d287010f20 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83769223ad10bb27 server_cookie=32d727e94b9ebd72 in_seq=0 out_seq=0 2024-09-19T06:20:04.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.123+0000 7f89d9ffb640 10 client.26036 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:04.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.123+0000 7f89d9ffb640 1 -- 172.21.15.2:0/248660845 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55d286f90b20 con 0x55d28700eb30 2024-09-19T06:20:04.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.123+0000 7f89d9ffb640 10 client.26036 handle_command_reply: tid=0 2024-09-19T06:20:04.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.123+0000 7f89fb354740 1 client.26036 shutdown 2024-09-19T06:20:04.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.123+0000 7f89fb354740 1 -- 172.21.15.2:0/248660845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d286f884a0 msgr2=0x55d286f977c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:04.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.123+0000 7f89fb354740 1 --2- 172.21.15.2:0/248660845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d286f884a0 0x55d286f977c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f89e40edbc0 tx=0x7f89e40b1be0 comp rx=0 tx=0).stop 2024-09-19T06:20:04.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.123+0000 7f89fb354740 1 -- 172.21.15.2:0/248660845 shutdown_connections 2024-09-19T06:20:04.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.123+0000 7f89fb354740 1 --2- 172.21.15.2:0/248660845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d286f93680 0x55d28700cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:04.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.123+0000 7f89fb354740 1 --2- 172.21.15.2:0/248660845 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d286f88dc0 0x55d286f97d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:04.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.123+0000 7f89fb354740 1 --2- 172.21.15.2:0/248660845 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55d28700eb30 0x55d287010f20 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:04.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.123+0000 7f89fb354740 1 --2- 172.21.15.2:0/248660845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d286f884a0 0x55d286f977c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:04.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.123+0000 7f89d9ffb640 0 client.26036 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:04.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.123+0000 7f89fb354740 1 -- 172.21.15.2:0/248660845 >> 172.21.15.2:0/248660845 conn(0x55d286f84a30 msgr2=0x55d286f89ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:04.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.123+0000 7f89fb354740 1 -- 172.21.15.2:0/248660845 shutdown_connections 2024-09-19T06:20:04.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.123+0000 7f89fb354740 1 -- 172.21.15.2:0/248660845 wait complete. 2024-09-19T06:20:04.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.123+0000 7f89fb354740 20 client.26036 trim_cache size 0 max 16384 2024-09-19T06:20:04.137 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:20:04.137 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T06:20:04.137 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T06:20:04.137 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:20:04.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.124+0000 7f89f8f7b640 1 -- 172.21.15.2:0/3435100801 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f89e00a3430 msgr2=0x7f89e00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:04.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.124+0000 7f89f8f7b640 1 --2- 172.21.15.2:0/3435100801 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f89e00a3430 0x7f89e00a58f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f89ec005c40 tx=0x7f89ec0094f0 comp rx=0 tx=0).stop 2024-09-19T06:20:04.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.124+0000 7f89f8f7b640 1 -- 172.21.15.2:0/3435100801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89f4102d40 msgr2=0x7f89f41009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:04.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.124+0000 7f89f8f7b640 1 --2- 172.21.15.2:0/3435100801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89f4102d40 0x7f89f41009a0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f89e4005940 tx=0x7f89e40042f0 comp rx=0 tx=0).stop 2024-09-19T06:20:04.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.124+0000 7f89f8f7b640 1 -- 172.21.15.2:0/3435100801 shutdown_connections 2024-09-19T06:20:04.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.124+0000 7f89f8f7b640 1 --2- 172.21.15.2:0/3435100801 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f89e00a3430 0x7f89e00a58f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:04.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.124+0000 7f89f8f7b640 1 --2- 172.21.15.2:0/3435100801 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89f410c170 0x7f89f4101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:04.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.124+0000 7f89f8f7b640 1 --2- 172.21.15.2:0/3435100801 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89f4103660 0x7f89f4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:04.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.124+0000 7f89f8f7b640 1 --2- 172.21.15.2:0/3435100801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89f4102d40 0x7f89f41009a0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:04.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.124+0000 7f89f8f7b640 1 -- 172.21.15.2:0/3435100801 >> 172.21.15.2:0/3435100801 conn(0x7f89f40fc7a0 msgr2=0x7f89f40fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:04.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.124+0000 7f89f8f7b640 1 -- 172.21.15.2:0/3435100801 shutdown_connections 2024-09-19T06:20:04.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:04.124+0000 7f89f8f7b640 1 -- 172.21.15.2:0/3435100801 wait complete. 2024-09-19T06:20:04.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:03 smithi090 ceph-mon[34497]: pgmap v160: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:20:04.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:03 smithi090 ceph-mon[34497]: scrub queued for path: / 2024-09-19T06:20:04.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:03 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:04.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:03 smithi090 ceph-mon[34497]: scrub summary: active paths [/] 2024-09-19T06:20:04.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:03 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:04.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:03 smithi090 ceph-mon[34497]: scrub summary: idle 2024-09-19T06:20:04.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:03 smithi089 ceph-mon[34160]: pgmap v160: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:20:04.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:03 smithi089 ceph-mon[34160]: scrub queued for path: / 2024-09-19T06:20:04.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:03 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:04.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:03 smithi089 ceph-mon[34160]: scrub summary: active paths [/] 2024-09-19T06:20:04.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:03 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:04.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:03 smithi089 ceph-mon[34160]: scrub summary: idle 2024-09-19T06:20:04.901 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:20:04.901 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:20:05.160 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:05.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.656+0000 7f849874e640 1 -- 172.21.15.2:0/2913831481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8490101de0 msgr2=0x7f84901021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:05.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.656+0000 7f849874e640 1 --2- 172.21.15.2:0/2913831481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8490101de0 0x7f84901021c0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f848c009900 tx=0x7f848c02a410 comp rx=0 tx=0).stop 2024-09-19T06:20:05.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.656+0000 7f849874e640 1 -- 172.21.15.2:0/2913831481 shutdown_connections 2024-09-19T06:20:05.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.656+0000 7f849874e640 1 --2- 172.21.15.2:0/2913831481 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8490106f10 0x7f849010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:05.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.656+0000 7f849874e640 1 --2- 172.21.15.2:0/2913831481 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8490102790 0x7f84901067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:05.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.656+0000 7f849874e640 1 --2- 172.21.15.2:0/2913831481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8490101de0 0x7f84901021c0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:05.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.656+0000 7f849874e640 1 -- 172.21.15.2:0/2913831481 >> 172.21.15.2:0/2913831481 conn(0x7f84900fd8c0 msgr2=0x7f84900ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:05.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.656+0000 7f849874e640 1 -- 172.21.15.2:0/2913831481 shutdown_connections 2024-09-19T06:20:05.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.656+0000 7f849874e640 1 -- 172.21.15.2:0/2913831481 wait complete. 2024-09-19T06:20:05.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.657+0000 7f849874e640 1 Processor -- start 2024-09-19T06:20:05.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.657+0000 7f849874e640 1 -- start start 2024-09-19T06:20:05.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.657+0000 7f849874e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8490101de0 0x7f84900744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:05.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.657+0000 7f849874e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8490102790 0x7f8490074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:05.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.657+0000 7f849874e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8490106f10 0x7f8490074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:05.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.657+0000 7f849874e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8490111e20 con 0x7f8490102790 2024-09-19T06:20:05.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.657+0000 7f849874e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8490111ca0 con 0x7f8490101de0 2024-09-19T06:20:05.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.657+0000 7f849874e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8490111fa0 con 0x7f8490106f10 2024-09-19T06:20:05.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.657+0000 7f8495ce9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8490102790 0x7f8490074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:05.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.657+0000 7f8495ce9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8490102790 0x7f8490074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45904/0 (socket says 172.21.15.2:45904) 2024-09-19T06:20:05.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.657+0000 7f8495ce9640 1 -- 172.21.15.2:0/3198470547 learned_addr learned my addr 172.21.15.2:0/3198470547 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:05.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.657+0000 7f84964ea640 1 --2- 172.21.15.2:0/3198470547 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8490101de0 0x7f84900744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:05.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.657+0000 7f8496ceb640 1 --2- 172.21.15.2:0/3198470547 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8490106f10 0x7f8490074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:05.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.657+0000 7f8495ce9640 1 -- 172.21.15.2:0/3198470547 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8490106f10 msgr2=0x7f8490074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:05.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.658+0000 7f8495ce9640 1 --2- 172.21.15.2:0/3198470547 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8490106f10 0x7f8490074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:05.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.658+0000 7f8495ce9640 1 -- 172.21.15.2:0/3198470547 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8490101de0 msgr2=0x7f84900744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:05.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.658+0000 7f8495ce9640 1 --2- 172.21.15.2:0/3198470547 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8490101de0 0x7f84900744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:05.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.658+0000 7f8495ce9640 1 -- 172.21.15.2:0/3198470547 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84901a67a0 con 0x7f8490102790 2024-09-19T06:20:05.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.658+0000 7f8495ce9640 1 --2- 172.21.15.2:0/3198470547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8490102790 0x7f8490074a30 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f848000d770 tx=0x7f848000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:05.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.658+0000 7f84877fe640 1 -- 172.21.15.2:0/3198470547 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8480017070 con 0x7f8490102790 2024-09-19T06:20:05.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.658+0000 7f849874e640 1 -- 172.21.15.2:0/3198470547 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84901a6a90 con 0x7f8490102790 2024-09-19T06:20:05.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.658+0000 7f84877fe640 1 -- 172.21.15.2:0/3198470547 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f84800054d0 con 0x7f8490102790 2024-09-19T06:20:05.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.658+0000 7f84877fe640 1 -- 172.21.15.2:0/3198470547 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8480004cf0 con 0x7f8490102790 2024-09-19T06:20:05.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.658+0000 7f849874e640 1 -- 172.21.15.2:0/3198470547 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84901a6fd0 con 0x7f8490102790 2024-09-19T06:20:05.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.659+0000 7f849874e640 1 -- 172.21.15.2:0/3198470547 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84901021c0 con 0x7f8490102790 2024-09-19T06:20:05.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.661+0000 7f84877fe640 1 -- 172.21.15.2:0/3198470547 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f8480004e90 con 0x7f8490102790 2024-09-19T06:20:05.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.662+0000 7f84877fe640 1 --2- 172.21.15.2:0/3198470547 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f847c0a33b0 0x7f847c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:05.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.662+0000 7f84964ea640 1 --2- 172.21.15.2:0/3198470547 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f847c0a33b0 0x7f847c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:05.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.662+0000 7f84877fe640 1 -- 172.21.15.2:0/3198470547 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f84800cfbb0 con 0x7f8490102790 2024-09-19T06:20:05.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.662+0000 7f84964ea640 1 --2- 172.21.15.2:0/3198470547 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f847c0a33b0 0x7f847c0a5870 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f848c031440 tx=0x7f848c005b50 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:05.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.666+0000 7f84877fe640 1 -- 172.21.15.2:0/3198470547 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f848009c5c0 con 0x7f8490102790 2024-09-19T06:20:05.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.877+0000 7f849874e640 1 -- 172.21.15.2:0/3198470547 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f849010a0f0 con 0x7f8490102790 2024-09-19T06:20:05.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.877+0000 7f84877fe640 1 -- 172.21.15.2:0/3198470547 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11882 (secure 0 0 0) 0x7f848009bec0 con 0x7f8490102790 2024-09-19T06:20:05.879 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:20:05.879 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-09-19T06:14:49:104280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:14:48.191083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24470,24472,24497]},"id":1}]} 2024-09-19T06:20:05.880 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-09-19T06:20:05.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.880+0000 7f849874e640 1 -- 172.21.15.2:0/3198470547 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f847c0a33b0 msgr2=0x7f847c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:05.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.880+0000 7f849874e640 1 --2- 172.21.15.2:0/3198470547 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f847c0a33b0 0x7f847c0a5870 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f848c031440 tx=0x7f848c005b50 comp rx=0 tx=0).stop 2024-09-19T06:20:05.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.880+0000 7f849874e640 1 -- 172.21.15.2:0/3198470547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8490102790 msgr2=0x7f8490074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:05.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.880+0000 7f849874e640 1 --2- 172.21.15.2:0/3198470547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8490102790 0x7f8490074a30 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f848000d770 tx=0x7f848000dc30 comp rx=0 tx=0).stop 2024-09-19T06:20:05.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.880+0000 7f849874e640 1 -- 172.21.15.2:0/3198470547 shutdown_connections 2024-09-19T06:20:05.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.880+0000 7f849874e640 1 --2- 172.21.15.2:0/3198470547 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f847c0a33b0 0x7f847c0a5870 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:05.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.880+0000 7f849874e640 1 --2- 172.21.15.2:0/3198470547 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8490106f10 0x7f8490074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:05.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.880+0000 7f849874e640 1 --2- 172.21.15.2:0/3198470547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8490102790 0x7f8490074a30 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:05.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.880+0000 7f849874e640 1 --2- 172.21.15.2:0/3198470547 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8490101de0 0x7f84900744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:05.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.880+0000 7f849874e640 1 -- 172.21.15.2:0/3198470547 >> 172.21.15.2:0/3198470547 conn(0x7f84900fd8c0 msgr2=0x7f84900fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:05.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.880+0000 7f849874e640 1 -- 172.21.15.2:0/3198470547 shutdown_connections 2024-09-19T06:20:05.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:05.880+0000 7f849874e640 1 -- 172.21.15.2:0/3198470547 wait complete. 2024-09-19T06:20:06.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:05 smithi002 ceph-mon[30982]: pgmap v161: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-19T06:20:06.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:05 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/3198470547' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:20:06.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:05 smithi090 ceph-mon[34497]: pgmap v161: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-19T06:20:06.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:05 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/3198470547' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:20:06.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:05 smithi089 ceph-mon[34160]: pgmap v161: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-19T06:20:06.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:05 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/3198470547' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:20:06.519 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:20:06.777 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:07.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.248+0000 7f7c38216640 1 -- 172.21.15.2:0/3495573348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c301008d0 msgr2=0x7f7c30100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:07.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.248+0000 7f7c38216640 1 --2- 172.21.15.2:0/3495573348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c301008d0 0x7f7c30100cb0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c009900 tx=0x7f7c2c02a410 comp rx=0 tx=0).stop 2024-09-19T06:20:07.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.248+0000 7f7c38216640 1 -- 172.21.15.2:0/3495573348 shutdown_connections 2024-09-19T06:20:07.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.248+0000 7f7c38216640 1 --2- 172.21.15.2:0/3495573348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c3010e480 0x7f7c30110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:07.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.248+0000 7f7c38216640 1 --2- 172.21.15.2:0/3495573348 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c30101280 0x7f7c3010df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:07.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.248+0000 7f7c38216640 1 --2- 172.21.15.2:0/3495573348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c301008d0 0x7f7c30100cb0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:07.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.248+0000 7f7c38216640 1 -- 172.21.15.2:0/3495573348 >> 172.21.15.2:0/3495573348 conn(0x7f7c300fc7a0 msgr2=0x7f7c300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:07.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.248+0000 7f7c38216640 1 -- 172.21.15.2:0/3495573348 shutdown_connections 2024-09-19T06:20:07.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.249+0000 7f7c38216640 1 -- 172.21.15.2:0/3495573348 wait complete. 2024-09-19T06:20:07.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.249+0000 7f7c38216640 1 Processor -- start 2024-09-19T06:20:07.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.249+0000 7f7c38216640 1 -- start start 2024-09-19T06:20:07.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.249+0000 7f7c38216640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c301008d0 0x7f7c3019a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:07.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.249+0000 7f7c38216640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c30101280 0x7f7c3019aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:07.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.249+0000 7f7c38216640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c3010e480 0x7f7c3019ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:07.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.249+0000 7f7c38216640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7c301140a0 con 0x7f7c30101280 2024-09-19T06:20:07.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.249+0000 7f7c38216640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7c30113f20 con 0x7f7c3010e480 2024-09-19T06:20:07.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.249+0000 7f7c38216640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7c30114220 con 0x7f7c301008d0 2024-09-19T06:20:07.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.249+0000 7f7c357b1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c30101280 0x7f7c3019aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:07.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.250+0000 7f7c357b1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c30101280 0x7f7c3019aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45924/0 (socket says 172.21.15.2:45924) 2024-09-19T06:20:07.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.250+0000 7f7c35fb2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c301008d0 0x7f7c3019a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:07.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.250+0000 7f7c357b1640 1 -- 172.21.15.2:0/3923599590 learned_addr learned my addr 172.21.15.2:0/3923599590 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:07.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.250+0000 7f7c367b3640 1 --2- 172.21.15.2:0/3923599590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c3010e480 0x7f7c3019ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:07.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.250+0000 7f7c357b1640 1 -- 172.21.15.2:0/3923599590 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c301008d0 msgr2=0x7f7c3019a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:07.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.250+0000 7f7c357b1640 1 --2- 172.21.15.2:0/3923599590 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c301008d0 0x7f7c3019a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:07.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.250+0000 7f7c357b1640 1 -- 172.21.15.2:0/3923599590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c3010e480 msgr2=0x7f7c3019ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:07.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.250+0000 7f7c357b1640 1 --2- 172.21.15.2:0/3923599590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c3010e480 0x7f7c3019ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:07.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.250+0000 7f7c357b1640 1 -- 172.21.15.2:0/3923599590 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c3019f530 con 0x7f7c30101280 2024-09-19T06:20:07.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.250+0000 7f7c357b1640 1 --2- 172.21.15.2:0/3923599590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c30101280 0x7f7c3019aac0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f7c2000c920 tx=0x7f7c2000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:07.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.250+0000 7f7c26ffd640 1 -- 172.21.15.2:0/3923599590 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c20007c70 con 0x7f7c30101280 2024-09-19T06:20:07.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.250+0000 7f7c38216640 1 -- 172.21.15.2:0/3923599590 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c3019f820 con 0x7f7c30101280 2024-09-19T06:20:07.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.250+0000 7f7c26ffd640 1 -- 172.21.15.2:0/3923599590 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7c20007e10 con 0x7f7c30101280 2024-09-19T06:20:07.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.250+0000 7f7c26ffd640 1 -- 172.21.15.2:0/3923599590 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c20018820 con 0x7f7c30101280 2024-09-19T06:20:07.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.250+0000 7f7c38216640 1 -- 172.21.15.2:0/3923599590 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c301a7100 con 0x7f7c30101280 2024-09-19T06:20:07.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.253+0000 7f7c26ffd640 1 -- 172.21.15.2:0/3923599590 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f7c200189c0 con 0x7f7c30101280 2024-09-19T06:20:07.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.253+0000 7f7c3a5ef740 1 Processor -- start 2024-09-19T06:20:07.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.254+0000 7f7c3a5ef740 1 -- start start 2024-09-19T06:20:07.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.254+0000 7f7c3a5ef740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fd50d0db40 0x55fd50d0c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:07.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.254+0000 7f7c3a5ef740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd50d0c5d0 0x55fd50d0ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:07.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.254+0000 7f7c3a5ef740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd50d17370 0x55fd50d19760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:07.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.254+0000 7f7c3a5ef740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fd50c722f0 con 0x55fd50d0c5d0 2024-09-19T06:20:07.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.254+0000 7f7c3a5ef740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55fd50c19cf0 con 0x55fd50d17370 2024-09-19T06:20:07.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.254+0000 7f7c3a5ef740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55fd50c6e2b0 con 0x55fd50d0db40 2024-09-19T06:20:07.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.254+0000 7f7c35fb2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd50d0c5d0 0x55fd50d0ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:07.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.254+0000 7f7c35fb2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd50d0c5d0 0x55fd50d0ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45934/0 (socket says 172.21.15.2:45934) 2024-09-19T06:20:07.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.254+0000 7f7c35fb2640 1 -- 172.21.15.2:0/4217863303 learned_addr learned my addr 172.21.15.2:0/4217863303 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:07.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.254+0000 7f7c367b3640 1 --2- 172.21.15.2:0/4217863303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fd50d0db40 0x55fd50d0c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:07.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.254+0000 7f7c357b1640 1 --2- 172.21.15.2:0/4217863303 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd50d17370 0x55fd50d19760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:07.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.254+0000 7f7c35fb2640 1 -- 172.21.15.2:0/4217863303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fd50d0db40 msgr2=0x55fd50d0c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:07.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.255+0000 7f7c35fb2640 1 --2- 172.21.15.2:0/4217863303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fd50d0db40 0x55fd50d0c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:07.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.255+0000 7f7c35fb2640 1 -- 172.21.15.2:0/4217863303 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd50d17370 msgr2=0x55fd50d19760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:07.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.255+0000 7f7c35fb2640 1 --2- 172.21.15.2:0/4217863303 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd50d17370 0x55fd50d19760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:07.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.255+0000 7f7c35fb2640 1 -- 172.21.15.2:0/4217863303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd50bfe3a0 con 0x55fd50d0c5d0 2024-09-19T06:20:07.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.255+0000 7f7c357b1640 1 --2- 172.21.15.2:0/4217863303 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd50d17370 0x55fd50d19760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:20:07.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.255+0000 7f7c26ffd640 1 --2- 172.21.15.2:0/3923599590 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f7c1c0a33b0 0x7f7c1c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:07.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.255+0000 7f7c35fb2640 1 --2- 172.21.15.2:0/4217863303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd50d0c5d0 0x55fd50d0ca10 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c006010 tx=0x7f7c2c031dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d805b69b5e20a8e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:07.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.255+0000 7f7c367b3640 1 --2- 172.21.15.2:0/3923599590 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f7c1c0a33b0 0x7f7c1c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:07.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.255+0000 7f7c26ffd640 1 -- 172.21.15.2:0/3923599590 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f7c200cfdd0 con 0x7f7c30101280 2024-09-19T06:20:07.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.255+0000 7f7c1bfff640 1 -- 172.21.15.2:0/4217863303 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c040070 con 0x55fd50d0c5d0 2024-09-19T06:20:07.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.255+0000 7f7c1bfff640 1 -- 172.21.15.2:0/4217863303 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7c2c0316a0 con 0x55fd50d0c5d0 2024-09-19T06:20:07.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.255+0000 7f7c1bfff640 1 -- 172.21.15.2:0/4217863303 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c035040 con 0x55fd50d0c5d0 2024-09-19T06:20:07.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.256+0000 7f7c3a5ef740 1 -- 172.21.15.2:0/4217863303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd50d0c5d0 msgr2=0x55fd50d0ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:07.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.256+0000 7f7c3a5ef740 1 --2- 172.21.15.2:0/4217863303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd50d0c5d0 0x55fd50d0ca10 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c006010 tx=0x7f7c2c031dc0 comp rx=0 tx=0).stop 2024-09-19T06:20:07.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.256+0000 7f7c367b3640 1 --2- 172.21.15.2:0/3923599590 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f7c1c0a33b0 0x7f7c1c0a5870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7c3006a0f0 tx=0x7f7c2800d040 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:07.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.256+0000 7f7c3a5ef740 1 -- 172.21.15.2:0/4217863303 shutdown_connections 2024-09-19T06:20:07.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.256+0000 7f7c3a5ef740 1 --2- 172.21.15.2:0/4217863303 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd50d17370 0x55fd50d19760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:07.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.256+0000 7f7c3a5ef740 1 --2- 172.21.15.2:0/4217863303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd50d0c5d0 0x55fd50d0ca10 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:07.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.256+0000 7f7c3a5ef740 1 --2- 172.21.15.2:0/4217863303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fd50d0db40 0x55fd50d0c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:07.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.256+0000 7f7c3a5ef740 1 -- 172.21.15.2:0/4217863303 >> 172.21.15.2:0/4217863303 conn(0x55fd50cd5310 msgr2=0x55fd50d08c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:07.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.256+0000 7f7c3a5ef740 1 -- 172.21.15.2:0/4217863303 shutdown_connections 2024-09-19T06:20:07.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.256+0000 7f7c3a5ef740 1 -- 172.21.15.2:0/4217863303 wait complete. 2024-09-19T06:20:07.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.257+0000 7f7c3a5ef740 1 -- start start 2024-09-19T06:20:07.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.257+0000 7f7c3a5ef740 1 Processor -- start 2024-09-19T06:20:07.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.257+0000 7f7c3a5ef740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fd50d0c5d0 0x55fd50d16d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:07.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.257+0000 7f7c3a5ef740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd50d0db40 0x55fd50d14010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:07.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.257+0000 7f7c3a5ef740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd50d17370 0x55fd50d14600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:07.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.257+0000 7f7c3a5ef740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fd50d1a010 con 0x55fd50d17370 2024-09-19T06:20:07.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.257+0000 7f7c3a5ef740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55fd50c2d060 con 0x55fd50d0db40 2024-09-19T06:20:07.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.257+0000 7f7c3a5ef740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55fd50d1a190 con 0x55fd50d0c5d0 2024-09-19T06:20:07.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.257+0000 7f7c3a5ef740 10 client.0 _ll_register_callbacks cb 0x55fd509808c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:07.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.257+0000 7f7c367b3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd50d17370 0x55fd50d14600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:07.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.257+0000 7f7c367b3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd50d17370 0x55fd50d14600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45948/0 (socket says 172.21.15.2:45948) 2024-09-19T06:20:07.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.257+0000 7f7c367b3640 1 -- 172.21.15.2:0/1655937728 learned_addr learned my addr 172.21.15.2:0/1655937728 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:07.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.257+0000 7f7c35fb2640 1 --2- 172.21.15.2:0/1655937728 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fd50d0c5d0 0x55fd50d16d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:07.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.257+0000 7f7c357b1640 1 --2- 172.21.15.2:0/1655937728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd50d0db40 0x55fd50d14010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:07.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.258+0000 7f7c367b3640 1 -- 172.21.15.2:0/1655937728 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fd50d0c5d0 msgr2=0x55fd50d16d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:07.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.258+0000 7f7c367b3640 1 --2- 172.21.15.2:0/1655937728 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fd50d0c5d0 0x55fd50d16d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:07.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.258+0000 7f7c367b3640 1 -- 172.21.15.2:0/1655937728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd50d0db40 msgr2=0x55fd50d14010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:07.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.258+0000 7f7c367b3640 1 --2- 172.21.15.2:0/1655937728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd50d0db40 0x55fd50d14010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:07.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.258+0000 7f7c367b3640 1 -- 172.21.15.2:0/1655937728 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd509e33c0 con 0x55fd50d17370 2024-09-19T06:20:07.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.258+0000 7f7c35fb2640 1 --2- 172.21.15.2:0/1655937728 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fd50d0c5d0 0x55fd50d16d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:07.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.258+0000 7f7c357b1640 1 --2- 172.21.15.2:0/1655937728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd50d0db40 0x55fd50d14010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:07.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.258+0000 7f7c367b3640 1 --2- 172.21.15.2:0/1655937728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd50d17370 0x55fd50d14600 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f7c28018ae0 tx=0x7f7c28004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfafe02aa890435e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:07.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.258+0000 7f7c197fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:07.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.258+0000 7f7c197fa640 1 -- 172.21.15.2:0/1655937728 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c28028060 con 0x55fd50d17370 2024-09-19T06:20:07.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.258+0000 7f7c197fa640 1 -- 172.21.15.2:0/1655937728 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f7c28023440 con 0x55fd50d17370 2024-09-19T06:20:07.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.258+0000 7f7c3a5ef740 1 -- 172.21.15.2:0/1655937728 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c2c0316a0 con 0x55fd50d17370 2024-09-19T06:20:07.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.258+0000 7f7c197fa640 1 -- 172.21.15.2:0/1655937728 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7c28016e20 con 0x55fd50d17370 2024-09-19T06:20:07.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.258+0000 7f7c3a5ef740 10 client.16644 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:07.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.258+0000 7f7c3a5ef740 1 -- 172.21.15.2:0/1655937728 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55fd50d25a80 con 0x55fd50d17370 2024-09-19T06:20:07.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.258+0000 7f7c197fa640 1 -- 172.21.15.2:0/1655937728 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7c2c0316a0 con 0x55fd50d17370 2024-09-19T06:20:07.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.259+0000 7f7c197fa640 1 -- 172.21.15.2:0/1655937728 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f7c2802c7f0 con 0x55fd50d17370 2024-09-19T06:20:07.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.259+0000 7f7c3a5ef740 10 client.16644 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:07.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.259+0000 7f7c3a5ef740 10 client.16644 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:20:07.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.259+0000 7f7c3a5ef740 20 client.16644 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:07.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.259+0000 7f7c3a5ef740 1 --2- 172.21.15.2:0/1655937728 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55fd50d26f40 0x55fd50d29330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:07.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.259+0000 7f7c3a5ef740 4 client.16644 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:07.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.259+0000 7f7c3a5ef740 1 -- 172.21.15.2:0/1655937728 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd50c7f860 con 0x55fd50d26f40 2024-09-19T06:20:07.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.259+0000 7f7c35fb2640 1 --2- 172.21.15.2:0/1655937728 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55fd50d26f40 0x55fd50d29330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:07.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.260+0000 7f7c35fb2640 1 --2- 172.21.15.2:0/1655937728 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55fd50d26f40 0x55fd50d29330 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6b14c4a114a0ef9f server_cookie=fe0696314cc69583 in_seq=0 out_seq=0 2024-09-19T06:20:07.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.260+0000 7f7c197fa640 10 client.16644 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:20:07.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.260+0000 7f7c197fa640 1 -- 172.21.15.2:0/1655937728 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fd50c7f860 con 0x55fd50d26f40 2024-09-19T06:20:07.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.260+0000 7f7c197fa640 10 client.16644 handle_command_reply: tid=0 2024-09-19T06:20:07.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.260+0000 7f7c3a5ef740 1 client.16644 shutdown 2024-09-19T06:20:07.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.260+0000 7f7c3a5ef740 1 -- 172.21.15.2:0/1655937728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd50d17370 msgr2=0x55fd50d14600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:07.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.260+0000 7f7c3a5ef740 1 --2- 172.21.15.2:0/1655937728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd50d17370 0x55fd50d14600 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f7c28018ae0 tx=0x7f7c28004a40 comp rx=0 tx=0).stop 2024-09-19T06:20:07.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.261+0000 7f7c3a5ef740 1 -- 172.21.15.2:0/1655937728 shutdown_connections 2024-09-19T06:20:07.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.261+0000 7f7c3a5ef740 1 --2- 172.21.15.2:0/1655937728 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55fd50d26f40 0x55fd50d29330 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:07.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.261+0000 7f7c3a5ef740 1 --2- 172.21.15.2:0/1655937728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd50d17370 0x55fd50d14600 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:07.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.261+0000 7f7c3a5ef740 1 --2- 172.21.15.2:0/1655937728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd50d0db40 0x55fd50d14010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:07.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.261+0000 7f7c197fa640 0 client.16644 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:20:07.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.261+0000 7f7c3a5ef740 1 --2- 172.21.15.2:0/1655937728 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fd50d0c5d0 0x55fd50d16d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:07.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.261+0000 7f7c3a5ef740 1 -- 172.21.15.2:0/1655937728 >> 172.21.15.2:0/1655937728 conn(0x55fd50cd5310 msgr2=0x55fd50d0e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:07.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.261+0000 7f7c3a5ef740 1 -- 172.21.15.2:0/1655937728 shutdown_connections 2024-09-19T06:20:07.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.261+0000 7f7c3a5ef740 1 -- 172.21.15.2:0/1655937728 wait complete. 2024-09-19T06:20:07.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.261+0000 7f7c3a5ef740 20 client.16644 trim_cache size 0 max 16384 2024-09-19T06:20:07.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.274+0000 7f7c3a5ef740 1 Processor -- start 2024-09-19T06:20:07.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.274+0000 7f7c3a5ef740 1 -- start start 2024-09-19T06:20:07.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.274+0000 7f7c3a5ef740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd50d0c5d0 0x55fd50d232b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:07.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.274+0000 7f7c3a5ef740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fd50d0db40 0x55fd50d08700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:07.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.274+0000 7f7c3a5ef740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd50d17370 0x55fd50d08c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:07.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.274+0000 7f7c3a5ef740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7c301b2190 con 0x55fd50d0c5d0 2024-09-19T06:20:07.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.274+0000 7f7c3a5ef740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7c301afa60 con 0x55fd50d17370 2024-09-19T06:20:07.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.274+0000 7f7c3a5ef740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7c301ad8b0 con 0x55fd50d0db40 2024-09-19T06:20:07.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.274+0000 7f7c35fb2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd50d0c5d0 0x55fd50d232b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:07.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.274+0000 7f7c35fb2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd50d0c5d0 0x55fd50d232b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45960/0 (socket says 172.21.15.2:45960) 2024-09-19T06:20:07.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.274+0000 7f7c35fb2640 1 -- 172.21.15.2:0/453363957 learned_addr learned my addr 172.21.15.2:0/453363957 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:07.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.274+0000 7f7c35fb2640 1 -- 172.21.15.2:0/453363957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fd50d0db40 msgr2=0x55fd50d08700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:07.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.274+0000 7f7c35fb2640 1 --2- 172.21.15.2:0/453363957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fd50d0db40 0x55fd50d08700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:07.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.274+0000 7f7c35fb2640 1 -- 172.21.15.2:0/453363957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd50d17370 msgr2=0x55fd50d08c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:07.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.274+0000 7f7c35fb2640 1 --2- 172.21.15.2:0/453363957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd50d17370 0x55fd50d08c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:07.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.274+0000 7f7c35fb2640 1 -- 172.21.15.2:0/453363957 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd50d296a0 con 0x55fd50d0c5d0 2024-09-19T06:20:07.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.274+0000 7f7c35fb2640 1 --2- 172.21.15.2:0/453363957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd50d0c5d0 0x55fd50d232b0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c005ec0 tx=0x7f7c2c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf421be6bd6edfa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:07.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.275+0000 7f7c1b7fe640 1 -- 172.21.15.2:0/453363957 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c052070 con 0x55fd50d0c5d0 2024-09-19T06:20:07.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.275+0000 7f7c1b7fe640 1 -- 172.21.15.2:0/453363957 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7c2c031800 con 0x55fd50d0c5d0 2024-09-19T06:20:07.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.275+0000 7f7c1b7fe640 1 -- 172.21.15.2:0/453363957 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c035040 con 0x55fd50d0c5d0 2024-09-19T06:20:07.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.275+0000 7f7c3a5ef740 1 -- 172.21.15.2:0/453363957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd50d0c5d0 msgr2=0x55fd50d232b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:07.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.275+0000 7f7c3a5ef740 1 --2- 172.21.15.2:0/453363957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd50d0c5d0 0x55fd50d232b0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c005ec0 tx=0x7f7c2c02a410 comp rx=0 tx=0).stop 2024-09-19T06:20:07.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.275+0000 7f7c3a5ef740 1 -- 172.21.15.2:0/453363957 shutdown_connections 2024-09-19T06:20:07.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.275+0000 7f7c3a5ef740 1 --2- 172.21.15.2:0/453363957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd50d17370 0x55fd50d08c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:07.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.275+0000 7f7c3a5ef740 1 --2- 172.21.15.2:0/453363957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fd50d0db40 0x55fd50d08700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:07.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.275+0000 7f7c3a5ef740 1 --2- 172.21.15.2:0/453363957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd50d0c5d0 0x55fd50d232b0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:07.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.275+0000 7f7c3a5ef740 1 -- 172.21.15.2:0/453363957 >> 172.21.15.2:0/453363957 conn(0x55fd50cd5310 msgr2=0x55fd50d128e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:07.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.275+0000 7f7c3a5ef740 1 -- 172.21.15.2:0/453363957 shutdown_connections 2024-09-19T06:20:07.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.275+0000 7f7c3a5ef740 1 -- 172.21.15.2:0/453363957 wait complete. 2024-09-19T06:20:07.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.276+0000 7f7c3a5ef740 1 -- start start 2024-09-19T06:20:07.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.276+0000 7f7c3a5ef740 1 Processor -- start 2024-09-19T06:20:07.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.276+0000 7f7c3a5ef740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd50d0c5d0 0x55fd50d1fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:07.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.276+0000 7f7c3a5ef740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd50d0db40 0x55fd50d10d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:07.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.276+0000 7f7c3a5ef740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fd50d17370 0x55fd50d11280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:07.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.276+0000 7f7c3a5ef740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7c301adf20 con 0x55fd50d0db40 2024-09-19T06:20:07.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.276+0000 7f7c3a5ef740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7c301af390 con 0x55fd50d0c5d0 2024-09-19T06:20:07.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.276+0000 7f7c3a5ef740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7c301ae5f0 con 0x55fd50d17370 2024-09-19T06:20:07.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.276+0000 7f7c3a5ef740 10 client.0 _ll_register_callbacks cb 0x7f7c28009cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:07.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.276+0000 7f7c357b1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd50d0db40 0x55fd50d10d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:07.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.276+0000 7f7c357b1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd50d0db40 0x55fd50d10d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45976/0 (socket says 172.21.15.2:45976) 2024-09-19T06:20:07.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.276+0000 7f7c357b1640 1 -- 172.21.15.2:0/2147810694 learned_addr learned my addr 172.21.15.2:0/2147810694 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:07.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.276+0000 7f7c35fb2640 1 --2- 172.21.15.2:0/2147810694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd50d0c5d0 0x55fd50d1fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:07.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.277+0000 7f7c357b1640 1 -- 172.21.15.2:0/2147810694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fd50d17370 msgr2=0x55fd50d11280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:07.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.277+0000 7f7c357b1640 1 --2- 172.21.15.2:0/2147810694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fd50d17370 0x55fd50d11280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:07.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.277+0000 7f7c357b1640 1 -- 172.21.15.2:0/2147810694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd50d0c5d0 msgr2=0x55fd50d1fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:07.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.277+0000 7f7c357b1640 1 --2- 172.21.15.2:0/2147810694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd50d0c5d0 0x55fd50d1fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:07.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.277+0000 7f7c357b1640 1 -- 172.21.15.2:0/2147810694 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd50d11ab0 con 0x55fd50d0db40 2024-09-19T06:20:07.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.277+0000 7f7c357b1640 1 --2- 172.21.15.2:0/2147810694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd50d0db40 0x55fd50d10d40 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f7c2009c010 tx=0x7f7c2009b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bbdf38db88b75c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:07.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.277+0000 7f7c197fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:07.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.277+0000 7f7c197fa640 1 -- 172.21.15.2:0/2147810694 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2009c780 con 0x55fd50d0db40 2024-09-19T06:20:07.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.277+0000 7f7c197fa640 1 -- 172.21.15.2:0/2147810694 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f7c200cd770 con 0x55fd50d0db40 2024-09-19T06:20:07.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.277+0000 7f7c3a5ef740 1 -- 172.21.15.2:0/2147810694 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c2c031800 con 0x55fd50d0db40 2024-09-19T06:20:07.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.277+0000 7f7c197fa640 1 -- 172.21.15.2:0/2147810694 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7c200cd970 con 0x55fd50d0db40 2024-09-19T06:20:07.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.277+0000 7f7c3a5ef740 10 client.16650 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:07.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.277+0000 7f7c3a5ef740 1 -- 172.21.15.2:0/2147810694 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55fd50d91c20 con 0x55fd50d0db40 2024-09-19T06:20:07.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.277+0000 7f7c197fa640 1 -- 172.21.15.2:0/2147810694 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7c2c031800 con 0x55fd50d0db40 2024-09-19T06:20:07.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.278+0000 7f7c197fa640 1 -- 172.21.15.2:0/2147810694 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f7c20097dd0 con 0x55fd50d0db40 2024-09-19T06:20:07.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.278+0000 7f7c3a5ef740 10 client.16650 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:07.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.278+0000 7f7c3a5ef740 10 client.16650 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:20:07.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.278+0000 7f7c3a5ef740 20 client.16650 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:07.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.278+0000 7f7c3a5ef740 1 --2- 172.21.15.2:0/2147810694 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55fd50d26f40 0x55fd50d943e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:07.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.278+0000 7f7c3a5ef740 4 client.16650 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:20:07.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.278+0000 7f7c3a5ef740 1 -- 172.21.15.2:0/2147810694 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fd50c79d70 con 0x55fd50d26f40 2024-09-19T06:20:07.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.278+0000 7f7c35fb2640 1 --2- 172.21.15.2:0/2147810694 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55fd50d26f40 0x55fd50d943e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:07.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.278+0000 7f7c35fb2640 1 --2- 172.21.15.2:0/2147810694 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55fd50d26f40 0x55fd50d943e0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9cc4044d9ee2ea6 server_cookie=1c4bdbbaff60e2a in_seq=0 out_seq=0 2024-09-19T06:20:07.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.278+0000 7f7c197fa640 10 client.16650 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:20:07.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.279+0000 7f7c197fa640 1 -- 172.21.15.2:0/2147810694 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fd50c79d70 con 0x55fd50d26f40 2024-09-19T06:20:07.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.279+0000 7f7c197fa640 10 client.16650 handle_command_reply: tid=0 2024-09-19T06:20:07.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.279+0000 7f7c3a5ef740 1 client.16650 shutdown 2024-09-19T06:20:07.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.279+0000 7f7c3a5ef740 1 -- 172.21.15.2:0/2147810694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd50d0db40 msgr2=0x55fd50d10d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:07.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.279+0000 7f7c3a5ef740 1 --2- 172.21.15.2:0/2147810694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd50d0db40 0x55fd50d10d40 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f7c2009c010 tx=0x7f7c2009b9e0 comp rx=0 tx=0).stop 2024-09-19T06:20:07.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.279+0000 7f7c3a5ef740 1 -- 172.21.15.2:0/2147810694 shutdown_connections 2024-09-19T06:20:07.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.279+0000 7f7c3a5ef740 1 --2- 172.21.15.2:0/2147810694 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55fd50d26f40 0x55fd50d943e0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:07.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.279+0000 7f7c3a5ef740 1 --2- 172.21.15.2:0/2147810694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fd50d17370 0x55fd50d11280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:07.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.279+0000 7f7c3a5ef740 1 --2- 172.21.15.2:0/2147810694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fd50d0db40 0x55fd50d10d40 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:07.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.279+0000 7f7c3a5ef740 1 --2- 172.21.15.2:0/2147810694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fd50d0c5d0 0x55fd50d1fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:07.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.279+0000 7f7c197fa640 0 client.16650 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:20:07.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.279+0000 7f7c3a5ef740 1 -- 172.21.15.2:0/2147810694 >> 172.21.15.2:0/2147810694 conn(0x55fd50cd5310 msgr2=0x55fd50d08670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:07.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.279+0000 7f7c3a5ef740 1 -- 172.21.15.2:0/2147810694 shutdown_connections 2024-09-19T06:20:07.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.279+0000 7f7c3a5ef740 1 -- 172.21.15.2:0/2147810694 wait complete. 2024-09-19T06:20:07.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.279+0000 7f7c3a5ef740 20 client.16650 trim_cache size 0 max 16384 2024-09-19T06:20:07.286 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:20:07.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.279+0000 7f7c38216640 1 -- 172.21.15.2:0/3923599590 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f7c1c0a33b0 msgr2=0x7f7c1c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:07.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.279+0000 7f7c38216640 1 --2- 172.21.15.2:0/3923599590 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f7c1c0a33b0 0x7f7c1c0a5870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7c3006a0f0 tx=0x7f7c2800d040 comp rx=0 tx=0).stop 2024-09-19T06:20:07.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.279+0000 7f7c38216640 1 -- 172.21.15.2:0/3923599590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c30101280 msgr2=0x7f7c3019aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:07.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.279+0000 7f7c38216640 1 --2- 172.21.15.2:0/3923599590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c30101280 0x7f7c3019aac0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f7c2000c920 tx=0x7f7c2000cde0 comp rx=0 tx=0).stop 2024-09-19T06:20:07.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.280+0000 7f7c38216640 1 -- 172.21.15.2:0/3923599590 shutdown_connections 2024-09-19T06:20:07.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.280+0000 7f7c38216640 1 --2- 172.21.15.2:0/3923599590 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f7c1c0a33b0 0x7f7c1c0a5870 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:07.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.280+0000 7f7c38216640 1 --2- 172.21.15.2:0/3923599590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c3010e480 0x7f7c3019ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:07.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.280+0000 7f7c38216640 1 --2- 172.21.15.2:0/3923599590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c30101280 0x7f7c3019aac0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:07.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.280+0000 7f7c38216640 1 --2- 172.21.15.2:0/3923599590 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c301008d0 0x7f7c3019a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:07.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.280+0000 7f7c38216640 1 -- 172.21.15.2:0/3923599590 >> 172.21.15.2:0/3923599590 conn(0x7f7c300fc7a0 msgr2=0x7f7c300feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:07.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.280+0000 7f7c38216640 1 -- 172.21.15.2:0/3923599590 shutdown_connections 2024-09-19T06:20:07.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:07.280+0000 7f7c38216640 1 -- 172.21.15.2:0/3923599590 wait complete. 2024-09-19T06:20:07.899 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:20:08.154 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:08.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:07 smithi002 ceph-mon[30982]: pgmap v162: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-19T06:20:08.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:07 smithi090 ceph-mon[34497]: pgmap v162: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-19T06:20:08.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:07 smithi089 ceph-mon[34160]: pgmap v162: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-19T06:20:08.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.714+0000 7f805ed67640 1 -- 172.21.15.2:0/4223827461 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8058102790 msgr2=0x7f80581067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:08.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.714+0000 7f805ed67640 1 --2- 172.21.15.2:0/4223827461 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8058102790 0x7f80581067e0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f8044009900 tx=0x7f804402a410 comp rx=0 tx=0).stop 2024-09-19T06:20:08.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.714+0000 7f805ed67640 1 -- 172.21.15.2:0/4223827461 shutdown_connections 2024-09-19T06:20:08.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.714+0000 7f805ed67640 1 --2- 172.21.15.2:0/4223827461 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8058106f10 0x7f805810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:08.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.714+0000 7f805ed67640 1 --2- 172.21.15.2:0/4223827461 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8058102790 0x7f80581067e0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:08.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.714+0000 7f805ed67640 1 --2- 172.21.15.2:0/4223827461 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8058101de0 0x7f80581021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:08.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.714+0000 7f805ed67640 1 -- 172.21.15.2:0/4223827461 >> 172.21.15.2:0/4223827461 conn(0x7f80580fd8c0 msgr2=0x7f80580ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:08.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.714+0000 7f805ed67640 1 -- 172.21.15.2:0/4223827461 shutdown_connections 2024-09-19T06:20:08.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.714+0000 7f805ed67640 1 -- 172.21.15.2:0/4223827461 wait complete. 2024-09-19T06:20:08.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.715+0000 7f805ed67640 1 Processor -- start 2024-09-19T06:20:08.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.715+0000 7f805ed67640 1 -- start start 2024-09-19T06:20:08.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.715+0000 7f805ed67640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8058101de0 0x7f8058198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:08.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.715+0000 7f805ed67640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8058102790 0x7f8058198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:08.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.715+0000 7f805ed67640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8058106f10 0x7f805819cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:08.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.715+0000 7f805ed67640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8058111e20 con 0x7f8058106f10 2024-09-19T06:20:08.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.715+0000 7f805ed67640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8058111ca0 con 0x7f8058101de0 2024-09-19T06:20:08.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.715+0000 7f805ed67640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8058111fa0 con 0x7f8058102790 2024-09-19T06:20:08.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.716+0000 7f805d304640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8058106f10 0x7f805819cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:08.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.716+0000 7f805cb03640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8058101de0 0x7f8058198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:08.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.716+0000 7f805d304640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8058106f10 0x7f805819cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45990/0 (socket says 172.21.15.2:45990) 2024-09-19T06:20:08.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.716+0000 7f805d304640 1 -- 172.21.15.2:0/640633419 learned_addr learned my addr 172.21.15.2:0/640633419 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:08.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.716+0000 7f805cb03640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8058101de0 0x7f8058198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:37822/0 (socket says 172.21.15.2:37822) 2024-09-19T06:20:08.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.716+0000 7f8057fff640 1 --2- 172.21.15.2:0/640633419 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8058102790 0x7f8058198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:08.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.716+0000 7f805d304640 1 -- 172.21.15.2:0/640633419 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8058102790 msgr2=0x7f8058198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:08.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.716+0000 7f805d304640 1 --2- 172.21.15.2:0/640633419 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8058102790 0x7f8058198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:08.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.716+0000 7f805d304640 1 -- 172.21.15.2:0/640633419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8058101de0 msgr2=0x7f8058198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:08.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.716+0000 7f805d304640 1 --2- 172.21.15.2:0/640633419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8058101de0 0x7f8058198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:08.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.716+0000 7f805d304640 1 -- 172.21.15.2:0/640633419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f805819d2b0 con 0x7f8058106f10 2024-09-19T06:20:08.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.716+0000 7f8057fff640 1 --2- 172.21.15.2:0/640633419 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8058102790 0x7f8058198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:08.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.716+0000 7f805cb03640 1 --2- 172.21.15.2:0/640633419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8058101de0 0x7f8058198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:08.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.716+0000 7f805d304640 1 --2- 172.21.15.2:0/640633419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8058106f10 0x7f805819cbd0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f805000eaa0 tx=0x7f805000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:08.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.716+0000 7f8055ffb640 1 -- 172.21.15.2:0/640633419 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8050004d20 con 0x7f8058106f10 2024-09-19T06:20:08.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.716+0000 7f8055ffb640 1 -- 172.21.15.2:0/640633419 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8050005020 con 0x7f8058106f10 2024-09-19T06:20:08.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.716+0000 7f805ed67640 1 -- 172.21.15.2:0/640633419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f805819d5a0 con 0x7f8058106f10 2024-09-19T06:20:08.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.716+0000 7f8055ffb640 1 -- 172.21.15.2:0/640633419 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80500116b0 con 0x7f8058106f10 2024-09-19T06:20:08.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.717+0000 7f805ed67640 1 -- 172.21.15.2:0/640633419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80581a4e80 con 0x7f8058106f10 2024-09-19T06:20:08.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.719+0000 7f8055ffb640 1 -- 172.21.15.2:0/640633419 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f80500051d0 con 0x7f8058106f10 2024-09-19T06:20:08.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.719+0000 7f8061140740 1 Processor -- start 2024-09-19T06:20:08.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.719+0000 7f8061140740 1 -- start start 2024-09-19T06:20:08.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.720+0000 7f8061140740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56415ae5cb40 0x56415ae5b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:08.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.720+0000 7f8055ffb640 1 --2- 172.21.15.2:0/640633419 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f80480a3430 0x7f80480a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:08.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.720+0000 7f8061140740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56415ae5b5d0 0x56415ae5ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:08.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.720+0000 7f8061140740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56415ae66370 0x56415ae68760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:08.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.720+0000 7f8061140740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56415adc12f0 con 0x56415ae5b5d0 2024-09-19T06:20:08.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.720+0000 7f8061140740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56415ad68cf0 con 0x56415ae5cb40 2024-09-19T06:20:08.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.720+0000 7f8061140740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56415adbd2b0 con 0x56415ae66370 2024-09-19T06:20:08.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.720+0000 7f8055ffb640 1 -- 172.21.15.2:0/640633419 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f80500cfe60 con 0x7f8058106f10 2024-09-19T06:20:08.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.720+0000 7f805cb03640 1 --2- 172.21.15.2:0/640633419 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f80480a3430 0x7f80480a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:08.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.720+0000 7f8057fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56415ae5b5d0 0x56415ae5ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:08.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.720+0000 7f8057fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56415ae5b5d0 0x56415ae5ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45998/0 (socket says 172.21.15.2:45998) 2024-09-19T06:20:08.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.720+0000 7f8057fff640 1 -- 172.21.15.2:0/4263309236 learned_addr learned my addr 172.21.15.2:0/4263309236 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:08.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.720+0000 7f8057fff640 1 --2- 172.21.15.2:0/4263309236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56415ae5cb40 0x56415ae5b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:08.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.720+0000 7f805d304640 1 --2- 172.21.15.2:0/4263309236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56415ae66370 0x56415ae68760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:08.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.720+0000 7f8057fff640 1 -- 172.21.15.2:0/4263309236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56415ae66370 msgr2=0x56415ae68760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:08.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.720+0000 7f8057fff640 1 --2- 172.21.15.2:0/4263309236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56415ae66370 0x56415ae68760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:08.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.720+0000 7f8057fff640 1 -- 172.21.15.2:0/4263309236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56415ae5cb40 msgr2=0x56415ae5b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:08.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.720+0000 7f8057fff640 1 --2- 172.21.15.2:0/4263309236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56415ae5cb40 0x56415ae5b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:08.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.720+0000 7f8057fff640 1 -- 172.21.15.2:0/4263309236 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56415ad4d3a0 con 0x56415ae5b5d0 2024-09-19T06:20:08.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.720+0000 7f805cb03640 1 --2- 172.21.15.2:0/640633419 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f80480a3430 0x7f80480a58f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f804c00afb0 tx=0x7f804c00a2d0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:08.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.720+0000 7f8057fff640 1 --2- 172.21.15.2:0/4263309236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56415ae5b5d0 0x56415ae5ba10 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f804402a930 tx=0x7f80440056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a04c8eb5834efc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:08.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.721+0000 7f8042ffd640 1 -- 172.21.15.2:0/4263309236 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8044035040 con 0x56415ae5b5d0 2024-09-19T06:20:08.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.721+0000 7f8042ffd640 1 -- 172.21.15.2:0/4263309236 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8044031680 con 0x56415ae5b5d0 2024-09-19T06:20:08.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.721+0000 7f8042ffd640 1 -- 172.21.15.2:0/4263309236 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f804403bc10 con 0x56415ae5b5d0 2024-09-19T06:20:08.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.722+0000 7f8061140740 1 -- 172.21.15.2:0/4263309236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56415ae5b5d0 msgr2=0x56415ae5ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:08.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.722+0000 7f8061140740 1 --2- 172.21.15.2:0/4263309236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56415ae5b5d0 0x56415ae5ba10 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f804402a930 tx=0x7f80440056d0 comp rx=0 tx=0).stop 2024-09-19T06:20:08.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.722+0000 7f8061140740 1 -- 172.21.15.2:0/4263309236 shutdown_connections 2024-09-19T06:20:08.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.722+0000 7f8061140740 1 --2- 172.21.15.2:0/4263309236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56415ae66370 0x56415ae68760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:08.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.722+0000 7f8061140740 1 --2- 172.21.15.2:0/4263309236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56415ae5b5d0 0x56415ae5ba10 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:08.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.722+0000 7f8061140740 1 --2- 172.21.15.2:0/4263309236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56415ae5cb40 0x56415ae5b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:08.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.722+0000 7f8061140740 1 -- 172.21.15.2:0/4263309236 >> 172.21.15.2:0/4263309236 conn(0x56415ae24310 msgr2=0x56415ae57c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:08.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.722+0000 7f8061140740 1 -- 172.21.15.2:0/4263309236 shutdown_connections 2024-09-19T06:20:08.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.722+0000 7f8061140740 1 -- 172.21.15.2:0/4263309236 wait complete. 2024-09-19T06:20:08.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.723+0000 7f8061140740 1 -- start start 2024-09-19T06:20:08.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.723+0000 7f8061140740 1 Processor -- start 2024-09-19T06:20:08.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.723+0000 7f8061140740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56415ae5b5d0 0x56415ae65d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:08.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.723+0000 7f8061140740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56415ae5cb40 0x56415ae62ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:08.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.723+0000 7f8061140740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56415ae66370 0x56415ae635e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:08.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.723+0000 7f8061140740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56415ae69010 con 0x56415ae66370 2024-09-19T06:20:08.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.723+0000 7f8061140740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56415ad7c060 con 0x56415ae5cb40 2024-09-19T06:20:08.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.723+0000 7f8061140740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56415ae69190 con 0x56415ae5b5d0 2024-09-19T06:20:08.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.723+0000 7f8061140740 10 client.0 _ll_register_callbacks cb 0x56415aacf8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:08.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.723+0000 7f805d304640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56415ae66370 0x56415ae635e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:08.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.723+0000 7f805d304640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56415ae66370 0x56415ae635e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46004/0 (socket says 172.21.15.2:46004) 2024-09-19T06:20:08.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.723+0000 7f805d304640 1 -- 172.21.15.2:0/3426532850 learned_addr learned my addr 172.21.15.2:0/3426532850 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:08.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.724+0000 7f8057fff640 1 --2- 172.21.15.2:0/3426532850 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56415ae5cb40 0x56415ae62ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:08.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.724+0000 7f805cb03640 1 --2- 172.21.15.2:0/3426532850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56415ae5b5d0 0x56415ae65d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:08.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.724+0000 7f805d304640 1 -- 172.21.15.2:0/3426532850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56415ae5b5d0 msgr2=0x56415ae65d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:08.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.724+0000 7f805d304640 1 --2- 172.21.15.2:0/3426532850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56415ae5b5d0 0x56415ae65d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:08.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.724+0000 7f805d304640 1 -- 172.21.15.2:0/3426532850 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56415ae5cb40 msgr2=0x56415ae62ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:08.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.724+0000 7f805d304640 1 --2- 172.21.15.2:0/3426532850 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56415ae5cb40 0x56415ae62ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:08.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.724+0000 7f805d304640 1 -- 172.21.15.2:0/3426532850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56415ab323c0 con 0x56415ae66370 2024-09-19T06:20:08.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.724+0000 7f805cb03640 1 --2- 172.21.15.2:0/3426532850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56415ae5b5d0 0x56415ae65d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:20:08.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.724+0000 7f805d304640 1 --2- 172.21.15.2:0/3426532850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56415ae66370 0x56415ae635e0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f80500cd690 tx=0x7f805009bc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5bde394b45bcfaf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:08.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.724+0000 7f8037fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:08.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.724+0000 7f8037fff640 1 -- 172.21.15.2:0/3426532850 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f805001f040 con 0x56415ae66370 2024-09-19T06:20:08.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.724+0000 7f8037fff640 1 -- 172.21.15.2:0/3426532850 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f80500bc070 con 0x56415ae66370 2024-09-19T06:20:08.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.724+0000 7f8061140740 1 -- 172.21.15.2:0/3426532850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8044031680 con 0x56415ae66370 2024-09-19T06:20:08.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.724+0000 7f8037fff640 1 -- 172.21.15.2:0/3426532850 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f80500bc270 con 0x56415ae66370 2024-09-19T06:20:08.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.724+0000 7f8061140740 10 client.16662 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:08.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.724+0000 7f8061140740 1 -- 172.21.15.2:0/3426532850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56415ae74ae0 con 0x56415ae66370 2024-09-19T06:20:08.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.724+0000 7f8037fff640 1 -- 172.21.15.2:0/3426532850 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8044031680 con 0x56415ae66370 2024-09-19T06:20:08.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.725+0000 7f8037fff640 1 -- 172.21.15.2:0/3426532850 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f8050096ce0 con 0x56415ae66370 2024-09-19T06:20:08.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.725+0000 7f8061140740 10 client.16662 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:08.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.725+0000 7f8061140740 10 client.16662 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:20:08.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.725+0000 7f8061140740 20 client.16662 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:08.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.725+0000 7f8061140740 1 --2- 172.21.15.2:0/3426532850 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x56415ae760a0 0x56415ae78490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:08.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.725+0000 7f8061140740 4 client.16662 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:08.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.725+0000 7f8061140740 1 -- 172.21.15.2:0/3426532850 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56415adce860 con 0x56415ae760a0 2024-09-19T06:20:08.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.725+0000 7f805cb03640 1 --2- 172.21.15.2:0/3426532850 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x56415ae760a0 0x56415ae78490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:08.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.725+0000 7f805cb03640 1 --2- 172.21.15.2:0/3426532850 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x56415ae760a0 0x56415ae78490 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4fee2e98fcb31bd0 server_cookie=ee82fc21f8e6505 in_seq=0 out_seq=0 2024-09-19T06:20:08.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.725+0000 7f8037fff640 10 client.16662 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:20:08.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.726+0000 7f8037fff640 1 -- 172.21.15.2:0/3426532850 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56415adce860 con 0x56415ae760a0 2024-09-19T06:20:08.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.726+0000 7f8037fff640 10 client.16662 handle_command_reply: tid=0 2024-09-19T06:20:08.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.726+0000 7f8061140740 1 client.16662 shutdown 2024-09-19T06:20:08.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.726+0000 7f8061140740 1 -- 172.21.15.2:0/3426532850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56415ae66370 msgr2=0x56415ae635e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:08.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.726+0000 7f8061140740 1 --2- 172.21.15.2:0/3426532850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56415ae66370 0x56415ae635e0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f80500cd690 tx=0x7f805009bc00 comp rx=0 tx=0).stop 2024-09-19T06:20:08.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.726+0000 7f8061140740 1 -- 172.21.15.2:0/3426532850 shutdown_connections 2024-09-19T06:20:08.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.726+0000 7f8061140740 1 --2- 172.21.15.2:0/3426532850 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x56415ae760a0 0x56415ae78490 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:08.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.726+0000 7f8061140740 1 --2- 172.21.15.2:0/3426532850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56415ae66370 0x56415ae635e0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:08.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.726+0000 7f8061140740 1 --2- 172.21.15.2:0/3426532850 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56415ae5cb40 0x56415ae62ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:08.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.726+0000 7f8061140740 1 --2- 172.21.15.2:0/3426532850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56415ae5b5d0 0x56415ae65d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:08.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.726+0000 7f8061140740 1 -- 172.21.15.2:0/3426532850 >> 172.21.15.2:0/3426532850 conn(0x56415ae24310 msgr2=0x56415ae5d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:08.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.726+0000 7f8037fff640 0 client.16662 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:20:08.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.727+0000 7f8061140740 1 -- 172.21.15.2:0/3426532850 shutdown_connections 2024-09-19T06:20:08.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.727+0000 7f8061140740 1 -- 172.21.15.2:0/3426532850 wait complete. 2024-09-19T06:20:08.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.727+0000 7f8061140740 20 client.16662 trim_cache size 0 max 16384 2024-09-19T06:20:08.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.740+0000 7f8061140740 1 Processor -- start 2024-09-19T06:20:08.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.740+0000 7f8061140740 1 -- start start 2024-09-19T06:20:08.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.740+0000 7f8061140740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56415ae5b5d0 0x56415ae722b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:08.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.740+0000 7f8061140740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56415ae5cb40 0x56415ae5e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:08.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.740+0000 7f8061140740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56415ae66370 0x56415ae5e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:08.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.740+0000 7f8061140740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f80581adcc0 con 0x56415ae5b5d0 2024-09-19T06:20:08.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.740+0000 7f8061140740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f80581ab590 con 0x56415ae66370 2024-09-19T06:20:08.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.740+0000 7f8061140740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f80581a93e0 con 0x56415ae5cb40 2024-09-19T06:20:08.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.740+0000 7f805cb03640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56415ae5b5d0 0x56415ae722b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:08.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.740+0000 7f805cb03640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56415ae5b5d0 0x56415ae722b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46012/0 (socket says 172.21.15.2:46012) 2024-09-19T06:20:08.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.740+0000 7f805cb03640 1 -- 172.21.15.2:0/1818657097 learned_addr learned my addr 172.21.15.2:0/1818657097 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:08.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.740+0000 7f8057fff640 1 --2- 172.21.15.2:0/1818657097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56415ae5cb40 0x56415ae5e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:08.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.740+0000 7f805d304640 1 --2- 172.21.15.2:0/1818657097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56415ae66370 0x56415ae5e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:08.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.740+0000 7f805cb03640 1 -- 172.21.15.2:0/1818657097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56415ae5cb40 msgr2=0x56415ae5e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:08.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.740+0000 7f805cb03640 1 --2- 172.21.15.2:0/1818657097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56415ae5cb40 0x56415ae5e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:08.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.740+0000 7f805cb03640 1 -- 172.21.15.2:0/1818657097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56415ae66370 msgr2=0x56415ae5e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:08.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.740+0000 7f805cb03640 1 --2- 172.21.15.2:0/1818657097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56415ae66370 0x56415ae5e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:08.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.740+0000 7f805cb03640 1 -- 172.21.15.2:0/1818657097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56415ae78800 con 0x56415ae5b5d0 2024-09-19T06:20:08.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.740+0000 7f805d304640 1 --2- 172.21.15.2:0/1818657097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56415ae66370 0x56415ae5e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:20:08.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.740+0000 7f805cb03640 1 --2- 172.21.15.2:0/1818657097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56415ae5b5d0 0x56415ae722b0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x56415ae78bc0 tx=0x7f804c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2e6c90daf9abab0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:08.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.741+0000 7f80427fc640 1 -- 172.21.15.2:0/1818657097 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f804c016070 con 0x56415ae5b5d0 2024-09-19T06:20:08.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.741+0000 7f80427fc640 1 -- 172.21.15.2:0/1818657097 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f804c02a070 con 0x56415ae5b5d0 2024-09-19T06:20:08.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.741+0000 7f80427fc640 1 -- 172.21.15.2:0/1818657097 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f804c01bb20 con 0x56415ae5b5d0 2024-09-19T06:20:08.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.741+0000 7f8061140740 1 -- 172.21.15.2:0/1818657097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56415ae5b5d0 msgr2=0x56415ae722b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:08.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.741+0000 7f8061140740 1 --2- 172.21.15.2:0/1818657097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56415ae5b5d0 0x56415ae722b0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x56415ae78bc0 tx=0x7f804c012000 comp rx=0 tx=0).stop 2024-09-19T06:20:08.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.741+0000 7f8061140740 1 -- 172.21.15.2:0/1818657097 shutdown_connections 2024-09-19T06:20:08.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.741+0000 7f8061140740 1 --2- 172.21.15.2:0/1818657097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56415ae66370 0x56415ae5e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:08.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.741+0000 7f8061140740 1 --2- 172.21.15.2:0/1818657097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56415ae5cb40 0x56415ae5e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:08.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.741+0000 7f8061140740 1 --2- 172.21.15.2:0/1818657097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56415ae5b5d0 0x56415ae722b0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:08.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.741+0000 7f8061140740 1 -- 172.21.15.2:0/1818657097 >> 172.21.15.2:0/1818657097 conn(0x56415ae24310 msgr2=0x56415ae620e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:08.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.741+0000 7f8061140740 1 -- 172.21.15.2:0/1818657097 shutdown_connections 2024-09-19T06:20:08.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.741+0000 7f8061140740 1 -- 172.21.15.2:0/1818657097 wait complete. 2024-09-19T06:20:08.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.742+0000 7f8061140740 1 -- start start 2024-09-19T06:20:08.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.742+0000 7f8061140740 1 Processor -- start 2024-09-19T06:20:08.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.742+0000 7f8061140740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56415ae5b5d0 0x56415ae6ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:08.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.742+0000 7f8061140740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56415ae5cb40 0x56415ae69e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:08.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.742+0000 7f8061140740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56415ae66370 0x56415ae6a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:08.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.742+0000 7f8061140740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f80581a9a50 con 0x56415ae5cb40 2024-09-19T06:20:08.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.742+0000 7f8061140740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f80581aaec0 con 0x56415ae66370 2024-09-19T06:20:08.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.742+0000 7f8061140740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f80581aa120 con 0x56415ae5b5d0 2024-09-19T06:20:08.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.742+0000 7f8061140740 10 client.0 _ll_register_callbacks cb 0x7f805009bd20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:08.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.743+0000 7f8057fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56415ae5cb40 0x56415ae69e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:08.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.743+0000 7f8057fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56415ae5cb40 0x56415ae69e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46022/0 (socket says 172.21.15.2:46022) 2024-09-19T06:20:08.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.743+0000 7f8057fff640 1 -- 172.21.15.2:0/493401877 learned_addr learned my addr 172.21.15.2:0/493401877 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:08.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.743+0000 7f805d304640 1 --2- 172.21.15.2:0/493401877 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56415ae66370 0x56415ae6a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:08.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.743+0000 7f805cb03640 1 --2- 172.21.15.2:0/493401877 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56415ae5b5d0 0x56415ae6ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:08.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.743+0000 7f8057fff640 1 -- 172.21.15.2:0/493401877 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56415ae5b5d0 msgr2=0x56415ae6ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:08.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.743+0000 7f8057fff640 1 --2- 172.21.15.2:0/493401877 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56415ae5b5d0 0x56415ae6ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:08.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.743+0000 7f8057fff640 1 -- 172.21.15.2:0/493401877 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56415ae66370 msgr2=0x56415ae6a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:08.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.743+0000 7f8057fff640 1 --2- 172.21.15.2:0/493401877 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56415ae66370 0x56415ae6a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:08.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.743+0000 7f8057fff640 1 -- 172.21.15.2:0/493401877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56415ae6ab40 con 0x56415ae5cb40 2024-09-19T06:20:08.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.743+0000 7f805d304640 1 --2- 172.21.15.2:0/493401877 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56415ae66370 0x56415ae6a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:08.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.743+0000 7f805cb03640 1 --2- 172.21.15.2:0/493401877 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56415ae5b5d0 0x56415ae6ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:08.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.743+0000 7f8057fff640 1 --2- 172.21.15.2:0/493401877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56415ae5cb40 0x56415ae69e00 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f8044009900 tx=0x7f8044004420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2c2e693485758a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:08.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.743+0000 7f8037fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:08.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.743+0000 7f8037fff640 1 -- 172.21.15.2:0/493401877 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f804403f040 con 0x56415ae5cb40 2024-09-19T06:20:08.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.743+0000 7f8037fff640 1 -- 172.21.15.2:0/493401877 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f804403b6e0 con 0x56415ae5cb40 2024-09-19T06:20:08.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.743+0000 7f8061140740 1 -- 172.21.15.2:0/493401877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f804c02a070 con 0x56415ae5cb40 2024-09-19T06:20:08.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.744+0000 7f8037fff640 1 -- 172.21.15.2:0/493401877 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8044035040 con 0x56415ae5cb40 2024-09-19T06:20:08.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.744+0000 7f8061140740 10 client.16668 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:08.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.744+0000 7f8061140740 1 -- 172.21.15.2:0/493401877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56415aee0ad0 con 0x56415ae5cb40 2024-09-19T06:20:08.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.744+0000 7f8037fff640 1 -- 172.21.15.2:0/493401877 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f804c02a070 con 0x56415ae5cb40 2024-09-19T06:20:08.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.744+0000 7f8037fff640 1 -- 172.21.15.2:0/493401877 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f8044031aa0 con 0x56415ae5cb40 2024-09-19T06:20:08.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.744+0000 7f8061140740 10 client.16668 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:08.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.744+0000 7f8061140740 10 client.16668 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:20:08.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.744+0000 7f8061140740 20 client.16668 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.744+0000 7f8061140740 1 --2- 172.21.15.2:0/493401877 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x56415aee0cf0 0x56415aee30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.744+0000 7f8061140740 4 client.16668 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:20:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.744+0000 7f8061140740 1 -- 172.21.15.2:0/493401877 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56415adc8d70 con 0x56415aee0cf0 2024-09-19T06:20:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.744+0000 7f805cb03640 1 --2- 172.21.15.2:0/493401877 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x56415aee0cf0 0x56415aee30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.745+0000 7f805cb03640 1 --2- 172.21.15.2:0/493401877 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x56415aee0cf0 0x56415aee30e0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=eb518a8a3f7a6d67 server_cookie=e237edde82e757ff in_seq=0 out_seq=0 2024-09-19T06:20:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.745+0000 7f8037fff640 10 client.16668 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:20:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.745+0000 7f8037fff640 1 -- 172.21.15.2:0/493401877 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56415adc8d70 con 0x56415aee0cf0 2024-09-19T06:20:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.745+0000 7f8037fff640 10 client.16668 handle_command_reply: tid=0 2024-09-19T06:20:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.745+0000 7f8061140740 1 client.16668 shutdown 2024-09-19T06:20:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.745+0000 7f8061140740 1 -- 172.21.15.2:0/493401877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56415ae5cb40 msgr2=0x56415ae69e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.745+0000 7f8061140740 1 --2- 172.21.15.2:0/493401877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56415ae5cb40 0x56415ae69e00 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f8044009900 tx=0x7f8044004420 comp rx=0 tx=0).stop 2024-09-19T06:20:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.745+0000 7f8061140740 1 -- 172.21.15.2:0/493401877 shutdown_connections 2024-09-19T06:20:08.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.745+0000 7f8061140740 1 --2- 172.21.15.2:0/493401877 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x56415aee0cf0 0x56415aee30e0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:08.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.745+0000 7f8061140740 1 --2- 172.21.15.2:0/493401877 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56415ae66370 0x56415ae6a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:08.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.745+0000 7f8061140740 1 --2- 172.21.15.2:0/493401877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56415ae5cb40 0x56415ae69e00 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:08.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.745+0000 7f8061140740 1 --2- 172.21.15.2:0/493401877 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56415ae5b5d0 0x56415ae6ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:08.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.745+0000 7f8061140740 1 -- 172.21.15.2:0/493401877 >> 172.21.15.2:0/493401877 conn(0x56415ae24310 msgr2=0x56415ae64850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:08.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.745+0000 7f8037fff640 0 client.16668 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:20:08.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.745+0000 7f8061140740 1 -- 172.21.15.2:0/493401877 shutdown_connections 2024-09-19T06:20:08.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.745+0000 7f8061140740 1 -- 172.21.15.2:0/493401877 wait complete. 2024-09-19T06:20:08.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.745+0000 7f8061140740 20 client.16668 trim_cache size 0 max 16384 2024-09-19T06:20:08.753 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:20:08.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.746+0000 7f805ed67640 1 -- 172.21.15.2:0/640633419 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f80480a3430 msgr2=0x7f80480a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:08.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.746+0000 7f805ed67640 1 --2- 172.21.15.2:0/640633419 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f80480a3430 0x7f80480a58f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f804c00afb0 tx=0x7f804c00a2d0 comp rx=0 tx=0).stop 2024-09-19T06:20:08.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.746+0000 7f805ed67640 1 -- 172.21.15.2:0/640633419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8058106f10 msgr2=0x7f805819cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:08.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.746+0000 7f805ed67640 1 --2- 172.21.15.2:0/640633419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8058106f10 0x7f805819cbd0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f805000eaa0 tx=0x7f805000eea0 comp rx=0 tx=0).stop 2024-09-19T06:20:08.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.746+0000 7f805ed67640 1 -- 172.21.15.2:0/640633419 shutdown_connections 2024-09-19T06:20:08.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.746+0000 7f805ed67640 1 --2- 172.21.15.2:0/640633419 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f80480a3430 0x7f80480a58f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:08.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.746+0000 7f805ed67640 1 --2- 172.21.15.2:0/640633419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8058106f10 0x7f805819cbd0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:08.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.746+0000 7f805ed67640 1 --2- 172.21.15.2:0/640633419 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8058102790 0x7f8058198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:08.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.746+0000 7f805ed67640 1 --2- 172.21.15.2:0/640633419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8058101de0 0x7f8058198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:08.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.746+0000 7f805ed67640 1 -- 172.21.15.2:0/640633419 >> 172.21.15.2:0/640633419 conn(0x7f80580fd8c0 msgr2=0x7f80580fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:08.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.746+0000 7f805ed67640 1 -- 172.21.15.2:0/640633419 shutdown_connections 2024-09-19T06:20:08.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:08.746+0000 7f805ed67640 1 -- 172.21.15.2:0/640633419 wait complete. 2024-09-19T06:20:09.430 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:20:09.687 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:10.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:09 smithi002 ceph-mon[30982]: pgmap v163: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-19T06:20:10.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.231+0000 7fbdd901f640 1 -- 172.21.15.2:0/3953766056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdd4101de0 msgr2=0x7fbdd41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:10.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.231+0000 7fbdd901f640 1 --2- 172.21.15.2:0/3953766056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdd4101de0 0x7fbdd41021c0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4009900 tx=0x7fbdc402a410 comp rx=0 tx=0).stop 2024-09-19T06:20:10.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.231+0000 7fbdd901f640 1 -- 172.21.15.2:0/3953766056 shutdown_connections 2024-09-19T06:20:10.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.231+0000 7fbdd901f640 1 --2- 172.21.15.2:0/3953766056 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbdd4106f10 0x7fbdd410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:10.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.231+0000 7fbdd901f640 1 --2- 172.21.15.2:0/3953766056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbdd4102790 0x7fbdd41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:10.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.231+0000 7fbdd901f640 1 --2- 172.21.15.2:0/3953766056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdd4101de0 0x7fbdd41021c0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:10.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.231+0000 7fbdd901f640 1 -- 172.21.15.2:0/3953766056 >> 172.21.15.2:0/3953766056 conn(0x7fbdd40fd8c0 msgr2=0x7fbdd40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:10.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.231+0000 7fbdd901f640 1 -- 172.21.15.2:0/3953766056 shutdown_connections 2024-09-19T06:20:10.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.231+0000 7fbdd901f640 1 -- 172.21.15.2:0/3953766056 wait complete. 2024-09-19T06:20:10.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.232+0000 7fbdd901f640 1 Processor -- start 2024-09-19T06:20:10.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.232+0000 7fbdd901f640 1 -- start start 2024-09-19T06:20:10.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.232+0000 7fbdd901f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbdd4101de0 0x7fbdd419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:10.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.232+0000 7fbdd901f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdd4102790 0x7fbdd419ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:10.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.232+0000 7fbdd901f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbdd4106f10 0x7fbdd419ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:10.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.232+0000 7fbdd901f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd4111e40 con 0x7fbdd4102790 2024-09-19T06:20:10.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.232+0000 7fbdd901f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd4111cc0 con 0x7fbdd4106f10 2024-09-19T06:20:10.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.232+0000 7fbdd901f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd4111fc0 con 0x7fbdd4101de0 2024-09-19T06:20:10.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.232+0000 7fbdd259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdd4102790 0x7fbdd419ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:10.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.232+0000 7fbdd259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdd4102790 0x7fbdd419ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46044/0 (socket says 172.21.15.2:46044) 2024-09-19T06:20:10.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.233+0000 7fbdd259c640 1 -- 172.21.15.2:0/774919087 learned_addr learned my addr 172.21.15.2:0/774919087 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:10.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.233+0000 7fbdd359e640 1 --2- 172.21.15.2:0/774919087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbdd4106f10 0x7fbdd419ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:10.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.233+0000 7fbdd2d9d640 1 --2- 172.21.15.2:0/774919087 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbdd4101de0 0x7fbdd419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:10.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.233+0000 7fbdd259c640 1 -- 172.21.15.2:0/774919087 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbdd4101de0 msgr2=0x7fbdd419a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:10.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.233+0000 7fbdd259c640 1 --2- 172.21.15.2:0/774919087 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbdd4101de0 0x7fbdd419a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:10.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.233+0000 7fbdd259c640 1 -- 172.21.15.2:0/774919087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbdd4106f10 msgr2=0x7fbdd419ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:10.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.233+0000 7fbdd259c640 1 --2- 172.21.15.2:0/774919087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbdd4106f10 0x7fbdd419ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:10.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.233+0000 7fbdd259c640 1 -- 172.21.15.2:0/774919087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdd419f570 con 0x7fbdd4102790 2024-09-19T06:20:10.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.233+0000 7fbdd2d9d640 1 --2- 172.21.15.2:0/774919087 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbdd4101de0 0x7fbdd419a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:10.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.233+0000 7fbdd259c640 1 --2- 172.21.15.2:0/774919087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdd4102790 0x7fbdd419ab00 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fbdc800c920 tx=0x7fbdc800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:10.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.233+0000 7fbdbbfff640 1 -- 172.21.15.2:0/774919087 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8007c70 con 0x7fbdd4102790 2024-09-19T06:20:10.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.233+0000 7fbdd901f640 1 -- 172.21.15.2:0/774919087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdd419f860 con 0x7fbdd4102790 2024-09-19T06:20:10.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.233+0000 7fbdbbfff640 1 -- 172.21.15.2:0/774919087 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbdc8007e10 con 0x7fbdd4102790 2024-09-19T06:20:10.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.233+0000 7fbdbbfff640 1 -- 172.21.15.2:0/774919087 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8018820 con 0x7fbdd4102790 2024-09-19T06:20:10.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.233+0000 7fbdd901f640 1 -- 172.21.15.2:0/774919087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdd41a7140 con 0x7fbdd4102790 2024-09-19T06:20:10.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.236+0000 7fbdbbfff640 1 -- 172.21.15.2:0/774919087 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fbdc80189c0 con 0x7fbdd4102790 2024-09-19T06:20:10.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.236+0000 7fbddb3f8740 1 Processor -- start 2024-09-19T06:20:10.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.236+0000 7fbddb3f8740 1 -- start start 2024-09-19T06:20:10.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.236+0000 7fbddb3f8740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558fecdf1b40 0x558fecdf0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:10.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.236+0000 7fbddb3f8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fecdf05d0 0x558fecdf0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:10.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.236+0000 7fbddb3f8740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558fecdfb370 0x558fecdfd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:10.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.236+0000 7fbddb3f8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558fecd562f0 con 0x558fecdf05d0 2024-09-19T06:20:10.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.236+0000 7fbddb3f8740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x558feccfdcf0 con 0x558fecdfb370 2024-09-19T06:20:10.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.236+0000 7fbddb3f8740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x558fecd522b0 con 0x558fecdf1b40 2024-09-19T06:20:10.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.236+0000 7fbdd2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fecdf05d0 0x558fecdf0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:10.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.236+0000 7fbdd2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fecdf05d0 0x558fecdf0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46046/0 (socket says 172.21.15.2:46046) 2024-09-19T06:20:10.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.237+0000 7fbdd2d9d640 1 -- 172.21.15.2:0/782531815 learned_addr learned my addr 172.21.15.2:0/782531815 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:10.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.237+0000 7fbdd259c640 1 --2- 172.21.15.2:0/782531815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558fecdfb370 0x558fecdfd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:10.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.237+0000 7fbdbbfff640 1 --2- 172.21.15.2:0/774919087 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fbdbc0a33b0 0x7fbdbc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:10.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.237+0000 7fbdd359e640 1 --2- 172.21.15.2:0/782531815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558fecdf1b40 0x558fecdf0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:10.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.237+0000 7fbdd359e640 1 --2- 172.21.15.2:0/774919087 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fbdbc0a33b0 0x7fbdbc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:10.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.237+0000 7fbdd2d9d640 1 -- 172.21.15.2:0/782531815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558fecdf1b40 msgr2=0x558fecdf0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:10.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.237+0000 7fbdd2d9d640 1 --2- 172.21.15.2:0/782531815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558fecdf1b40 0x558fecdf0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:10.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.237+0000 7fbdd2d9d640 1 -- 172.21.15.2:0/782531815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558fecdfb370 msgr2=0x558fecdfd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:10.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.237+0000 7fbdd2d9d640 1 --2- 172.21.15.2:0/782531815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558fecdfb370 0x558fecdfd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:10.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.237+0000 7fbdbbfff640 1 -- 172.21.15.2:0/774919087 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fbdc80cfe20 con 0x7fbdd4102790 2024-09-19T06:20:10.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.237+0000 7fbdd2d9d640 1 -- 172.21.15.2:0/782531815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fecce23a0 con 0x558fecdf05d0 2024-09-19T06:20:10.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.237+0000 7fbdd2d9d640 1 --2- 172.21.15.2:0/782531815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fecdf05d0 0x558fecdf0a10 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fbdc402a930 tx=0x7fbdc4031e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fa5bb74f4d570ef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:10.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.237+0000 7fbdd359e640 1 --2- 172.21.15.2:0/774919087 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fbdbc0a33b0 0x7fbdbc0a5870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc00a8e0 tx=0x7fbdcc004a40 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:10.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.237+0000 7fbdb97fa640 1 -- 172.21.15.2:0/782531815 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc403f070 con 0x558fecdf05d0 2024-09-19T06:20:10.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.237+0000 7fbdb97fa640 1 -- 172.21.15.2:0/782531815 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbdc40316a0 con 0x558fecdf05d0 2024-09-19T06:20:10.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.238+0000 7fbdb97fa640 1 -- 172.21.15.2:0/782531815 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc4035070 con 0x558fecdf05d0 2024-09-19T06:20:10.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:09 smithi090 ceph-mon[34497]: pgmap v163: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-19T06:20:10.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.238+0000 7fbddb3f8740 1 -- 172.21.15.2:0/782531815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fecdf05d0 msgr2=0x558fecdf0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:10.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.238+0000 7fbddb3f8740 1 --2- 172.21.15.2:0/782531815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fecdf05d0 0x558fecdf0a10 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fbdc402a930 tx=0x7fbdc4031e40 comp rx=0 tx=0).stop 2024-09-19T06:20:10.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.238+0000 7fbddb3f8740 1 -- 172.21.15.2:0/782531815 shutdown_connections 2024-09-19T06:20:10.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.238+0000 7fbddb3f8740 1 --2- 172.21.15.2:0/782531815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558fecdfb370 0x558fecdfd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:10.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.238+0000 7fbddb3f8740 1 --2- 172.21.15.2:0/782531815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fecdf05d0 0x558fecdf0a10 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:10.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.238+0000 7fbddb3f8740 1 --2- 172.21.15.2:0/782531815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558fecdf1b40 0x558fecdf0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:10.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.238+0000 7fbddb3f8740 1 -- 172.21.15.2:0/782531815 >> 172.21.15.2:0/782531815 conn(0x558fecdb9310 msgr2=0x558fecdecc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:10.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.238+0000 7fbddb3f8740 1 -- 172.21.15.2:0/782531815 shutdown_connections 2024-09-19T06:20:10.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.238+0000 7fbddb3f8740 1 -- 172.21.15.2:0/782531815 wait complete. 2024-09-19T06:20:10.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.239+0000 7fbddb3f8740 1 -- start start 2024-09-19T06:20:10.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.239+0000 7fbddb3f8740 1 Processor -- start 2024-09-19T06:20:10.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.239+0000 7fbddb3f8740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558fecdf05d0 0x558fecdfad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:10.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.239+0000 7fbddb3f8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fecdf1b40 0x558fecdf7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:10.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.239+0000 7fbddb3f8740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558fecdfb370 0x558fecdf8530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:10.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.239+0000 7fbddb3f8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558fecdfe010 con 0x558fecdf1b40 2024-09-19T06:20:10.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.239+0000 7fbddb3f8740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x558fecd11060 con 0x558fecdfb370 2024-09-19T06:20:10.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.239+0000 7fbddb3f8740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x558fecdfe190 con 0x558fecdf05d0 2024-09-19T06:20:10.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.239+0000 7fbddb3f8740 10 client.0 _ll_register_callbacks cb 0x558feca648c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:10.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.239+0000 7fbdd259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fecdf1b40 0x558fecdf7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:10.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.239+0000 7fbdd259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fecdf1b40 0x558fecdf7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46058/0 (socket says 172.21.15.2:46058) 2024-09-19T06:20:10.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.239+0000 7fbdd259c640 1 -- 172.21.15.2:0/860048390 learned_addr learned my addr 172.21.15.2:0/860048390 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:10.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.239+0000 7fbdd359e640 1 --2- 172.21.15.2:0/860048390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558fecdfb370 0x558fecdf8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:10.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.240+0000 7fbdd2d9d640 1 --2- 172.21.15.2:0/860048390 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558fecdf05d0 0x558fecdfad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:10.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.240+0000 7fbdd259c640 1 -- 172.21.15.2:0/860048390 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558fecdf05d0 msgr2=0x558fecdfad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:10.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.240+0000 7fbdd259c640 1 --2- 172.21.15.2:0/860048390 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558fecdf05d0 0x558fecdfad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:10.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.240+0000 7fbdd259c640 1 -- 172.21.15.2:0/860048390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558fecdfb370 msgr2=0x558fecdf8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:10.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.240+0000 7fbdd259c640 1 --2- 172.21.15.2:0/860048390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558fecdfb370 0x558fecdf8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:10.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.240+0000 7fbdd259c640 1 -- 172.21.15.2:0/860048390 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fecac73c0 con 0x558fecdf1b40 2024-09-19T06:20:10.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.240+0000 7fbdd259c640 1 --2- 172.21.15.2:0/860048390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fecdf1b40 0x558fecdf7fb0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fbdc809c0c0 tx=0x7fbdc809c020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=372a260003a1b7e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:10.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.240+0000 7fbdb6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:10.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.240+0000 7fbdb6ff5640 1 -- 172.21.15.2:0/860048390 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc809ba90 con 0x558fecdf1b40 2024-09-19T06:20:10.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.240+0000 7fbdb6ff5640 1 -- 172.21.15.2:0/860048390 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fbdc80a0130 con 0x558fecdf1b40 2024-09-19T06:20:10.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.240+0000 7fbddb3f8740 1 -- 172.21.15.2:0/860048390 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbdc40316a0 con 0x558fecdf1b40 2024-09-19T06:20:10.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.240+0000 7fbdb6ff5640 1 -- 172.21.15.2:0/860048390 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fbdc8018cb0 con 0x558fecdf1b40 2024-09-19T06:20:10.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.240+0000 7fbddb3f8740 10 client.16680 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:10.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.240+0000 7fbddb3f8740 1 -- 172.21.15.2:0/860048390 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x558fece09af0 con 0x558fecdf1b40 2024-09-19T06:20:10.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.240+0000 7fbdb6ff5640 1 -- 172.21.15.2:0/860048390 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbdc40316a0 con 0x558fecdf1b40 2024-09-19T06:20:10.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.240+0000 7fbdb6ff5640 1 -- 172.21.15.2:0/860048390 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fbdc80a4910 con 0x558fecdf1b40 2024-09-19T06:20:10.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.241+0000 7fbddb3f8740 10 client.16680 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:10.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.241+0000 7fbddb3f8740 10 client.16680 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:10.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.241+0000 7fbddb3f8740 20 client.16680 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:10.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.241+0000 7fbddb3f8740 1 --2- 172.21.15.2:0/860048390 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558fece0afb0 0x558fece0d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:10.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.241+0000 7fbddb3f8740 4 client.16680 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:10.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.241+0000 7fbddb3f8740 1 -- 172.21.15.2:0/860048390 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558fecd63860 con 0x558fece0afb0 2024-09-19T06:20:10.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.241+0000 7fbdd2d9d640 1 --2- 172.21.15.2:0/860048390 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558fece0afb0 0x558fece0d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:10.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.241+0000 7fbdd2d9d640 1 --2- 172.21.15.2:0/860048390 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558fece0afb0 0x558fece0d3a0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6570ed981c703b8 server_cookie=c63e35f2a39a0b6f in_seq=0 out_seq=0 2024-09-19T06:20:10.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.241+0000 7fbdb6ff5640 10 client.16680 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:10.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.242+0000 7fbdb6ff5640 1 -- 172.21.15.2:0/860048390 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558fecd63860 con 0x558fece0afb0 2024-09-19T06:20:10.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.242+0000 7fbdb6ff5640 10 client.16680 handle_command_reply: tid=0 2024-09-19T06:20:10.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.242+0000 7fbddb3f8740 1 client.16680 shutdown 2024-09-19T06:20:10.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.242+0000 7fbddb3f8740 1 -- 172.21.15.2:0/860048390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fecdf1b40 msgr2=0x558fecdf7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:10.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.242+0000 7fbddb3f8740 1 --2- 172.21.15.2:0/860048390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fecdf1b40 0x558fecdf7fb0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fbdc809c0c0 tx=0x7fbdc809c020 comp rx=0 tx=0).stop 2024-09-19T06:20:10.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.242+0000 7fbddb3f8740 1 -- 172.21.15.2:0/860048390 shutdown_connections 2024-09-19T06:20:10.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.242+0000 7fbddb3f8740 1 --2- 172.21.15.2:0/860048390 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558fece0afb0 0x558fece0d3a0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:10.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.242+0000 7fbddb3f8740 1 --2- 172.21.15.2:0/860048390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558fecdfb370 0x558fecdf8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:10.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.242+0000 7fbddb3f8740 1 --2- 172.21.15.2:0/860048390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fecdf1b40 0x558fecdf7fb0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:10.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.242+0000 7fbddb3f8740 1 --2- 172.21.15.2:0/860048390 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558fecdf05d0 0x558fecdfad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:10.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.242+0000 7fbddb3f8740 1 -- 172.21.15.2:0/860048390 >> 172.21.15.2:0/860048390 conn(0x558fecdb9310 msgr2=0x558fecdf2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:10.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.242+0000 7fbdb6ff5640 0 client.16680 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:10.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.242+0000 7fbddb3f8740 1 -- 172.21.15.2:0/860048390 shutdown_connections 2024-09-19T06:20:10.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.242+0000 7fbddb3f8740 1 -- 172.21.15.2:0/860048390 wait complete. 2024-09-19T06:20:10.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.243+0000 7fbddb3f8740 20 client.16680 trim_cache size 0 max 16384 2024-09-19T06:20:10.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.256+0000 7fbddb3f8740 1 Processor -- start 2024-09-19T06:20:10.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.256+0000 7fbddb3f8740 1 -- start start 2024-09-19T06:20:10.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.256+0000 7fbddb3f8740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558fecdf05d0 0x558fecdece10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:10.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.256+0000 7fbddb3f8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fecdf1b40 0x558fece072b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:10.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.256+0000 7fbddb3f8740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558fecdfb370 0x558fecdf3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:10.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.256+0000 7fbddb3f8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd41b2110 con 0x558fecdf1b40 2024-09-19T06:20:10.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.256+0000 7fbddb3f8740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd41af9e0 con 0x558fecdf05d0 2024-09-19T06:20:10.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.256+0000 7fbddb3f8740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd41ad830 con 0x558fecdfb370 2024-09-19T06:20:10.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.256+0000 7fbdd259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fecdf1b40 0x558fece072b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:10.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.256+0000 7fbdd259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fecdf1b40 0x558fece072b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46060/0 (socket says 172.21.15.2:46060) 2024-09-19T06:20:10.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.256+0000 7fbdd259c640 1 -- 172.21.15.2:0/1111561268 learned_addr learned my addr 172.21.15.2:0/1111561268 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:10.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.256+0000 7fbdd2d9d640 1 --2- 172.21.15.2:0/1111561268 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558fecdf05d0 0x558fecdece10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:10.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.256+0000 7fbdd359e640 1 --2- 172.21.15.2:0/1111561268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558fecdfb370 0x558fecdf3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:10.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.257+0000 7fbdd259c640 1 -- 172.21.15.2:0/1111561268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558fecdfb370 msgr2=0x558fecdf3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:10.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.257+0000 7fbdd259c640 1 --2- 172.21.15.2:0/1111561268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558fecdfb370 0x558fecdf3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:10.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.257+0000 7fbdd259c640 1 -- 172.21.15.2:0/1111561268 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558fecdf05d0 msgr2=0x558fecdece10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:10.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.257+0000 7fbdd259c640 1 --2- 172.21.15.2:0/1111561268 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558fecdf05d0 0x558fecdece10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:10.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.257+0000 7fbdd259c640 1 -- 172.21.15.2:0/1111561268 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fecdfb030 con 0x558fecdf1b40 2024-09-19T06:20:10.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.257+0000 7fbdd359e640 1 --2- 172.21.15.2:0/1111561268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558fecdfb370 0x558fecdf3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:10.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.257+0000 7fbdd259c640 1 --2- 172.21.15.2:0/1111561268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fecdf1b40 0x558fece072b0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8098b00 tx=0x7fbdc809c280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=964b75bc0f11e3c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:10.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.257+0000 7fbdb8ff9640 1 -- 172.21.15.2:0/1111561268 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc800fb00 con 0x558fecdf1b40 2024-09-19T06:20:10.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.257+0000 7fbdb8ff9640 1 -- 172.21.15.2:0/1111561268 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbdc809c830 con 0x558fecdf1b40 2024-09-19T06:20:10.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.257+0000 7fbdb8ff9640 1 -- 172.21.15.2:0/1111561268 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8097e80 con 0x558fecdf1b40 2024-09-19T06:20:10.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.258+0000 7fbddb3f8740 1 -- 172.21.15.2:0/1111561268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fecdf1b40 msgr2=0x558fece072b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:10.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.258+0000 7fbddb3f8740 1 --2- 172.21.15.2:0/1111561268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fecdf1b40 0x558fece072b0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8098b00 tx=0x7fbdc809c280 comp rx=0 tx=0).stop 2024-09-19T06:20:10.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.258+0000 7fbddb3f8740 1 -- 172.21.15.2:0/1111561268 shutdown_connections 2024-09-19T06:20:10.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.258+0000 7fbddb3f8740 1 --2- 172.21.15.2:0/1111561268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558fecdfb370 0x558fecdf3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:10.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.258+0000 7fbddb3f8740 1 --2- 172.21.15.2:0/1111561268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fecdf1b40 0x558fece072b0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:10.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.258+0000 7fbddb3f8740 1 --2- 172.21.15.2:0/1111561268 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558fecdf05d0 0x558fecdece10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:10.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.258+0000 7fbddb3f8740 1 -- 172.21.15.2:0/1111561268 >> 172.21.15.2:0/1111561268 conn(0x558fecdb9310 msgr2=0x558fecdec700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:10.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.258+0000 7fbddb3f8740 1 -- 172.21.15.2:0/1111561268 shutdown_connections 2024-09-19T06:20:10.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.258+0000 7fbddb3f8740 1 -- 172.21.15.2:0/1111561268 wait complete. 2024-09-19T06:20:10.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.258+0000 7fbddb3f8740 1 -- start start 2024-09-19T06:20:10.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.258+0000 7fbddb3f8740 1 Processor -- start 2024-09-19T06:20:10.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.258+0000 7fbddb3f8740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558fecdf05d0 0x558fecdfeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:10.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.258+0000 7fbddb3f8740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558fecdf1b40 0x558fecdff0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:10.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.258+0000 7fbddb3f8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fecdfb370 0x558fece763d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:10.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.258+0000 7fbddb3f8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd41adea0 con 0x558fecdfb370 2024-09-19T06:20:10.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.258+0000 7fbddb3f8740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd41af310 con 0x558fecdf1b40 2024-09-19T06:20:10.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.258+0000 7fbddb3f8740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd41ae570 con 0x558fecdf05d0 2024-09-19T06:20:10.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.258+0000 7fbddb3f8740 10 client.0 _ll_register_callbacks cb 0x7fbdc80d3640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:10.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.258+0000 7fbdd359e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fecdfb370 0x558fece763d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:10.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.259+0000 7fbdd359e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fecdfb370 0x558fece763d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46072/0 (socket says 172.21.15.2:46072) 2024-09-19T06:20:10.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.259+0000 7fbdd359e640 1 -- 172.21.15.2:0/2724368774 learned_addr learned my addr 172.21.15.2:0/2724368774 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:10.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.259+0000 7fbdd2d9d640 1 --2- 172.21.15.2:0/2724368774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558fecdf05d0 0x558fecdfeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:10.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.259+0000 7fbdd259c640 1 --2- 172.21.15.2:0/2724368774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558fecdf1b40 0x558fecdff0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:10.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.259+0000 7fbdd359e640 1 -- 172.21.15.2:0/2724368774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558fecdf05d0 msgr2=0x558fecdfeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:10.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.259+0000 7fbdd359e640 1 --2- 172.21.15.2:0/2724368774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558fecdf05d0 0x558fecdfeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:10.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.259+0000 7fbdd359e640 1 -- 172.21.15.2:0/2724368774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558fecdf1b40 msgr2=0x558fecdff0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:10.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.259+0000 7fbdd359e640 1 --2- 172.21.15.2:0/2724368774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558fecdf1b40 0x558fecdff0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:10.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.259+0000 7fbdd359e640 1 -- 172.21.15.2:0/2724368774 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fece769c0 con 0x558fecdfb370 2024-09-19T06:20:10.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.259+0000 7fbdd359e640 1 --2- 172.21.15.2:0/2724368774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fecdfb370 0x558fece763d0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc00a5f0 tx=0x7fbdcc009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e59f94b9095bdd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:10.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.259+0000 7fbdb6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:10.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.259+0000 7fbdb6ff5640 1 -- 172.21.15.2:0/2724368774 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc019e10 con 0x558fecdfb370 2024-09-19T06:20:10.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.259+0000 7fbdb6ff5640 1 -- 172.21.15.2:0/2724368774 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fbdcc027470 con 0x558fecdfb370 2024-09-19T06:20:10.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.259+0000 7fbddb3f8740 1 -- 172.21.15.2:0/2724368774 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbdc809c830 con 0x558fecdfb370 2024-09-19T06:20:10.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.259+0000 7fbdb6ff5640 1 -- 172.21.15.2:0/2724368774 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fbdcc027670 con 0x558fecdfb370 2024-09-19T06:20:10.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.259+0000 7fbddb3f8740 10 client.16686 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:10.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.259+0000 7fbddb3f8740 1 -- 172.21.15.2:0/2724368774 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x558fece7dd80 con 0x558fecdfb370 2024-09-19T06:20:10.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.260+0000 7fbdb6ff5640 1 -- 172.21.15.2:0/2724368774 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbdc809c830 con 0x558fecdfb370 2024-09-19T06:20:10.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.260+0000 7fbdb6ff5640 1 -- 172.21.15.2:0/2724368774 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fbdcc026860 con 0x558fecdfb370 2024-09-19T06:20:10.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.260+0000 7fbddb3f8740 10 client.16686 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:10.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.260+0000 7fbddb3f8740 10 client.16686 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:10.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.260+0000 7fbddb3f8740 20 client.16686 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:10.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.260+0000 7fbddb3f8740 1 --2- 172.21.15.2:0/2724368774 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558fece7e5b0 0x558fece809d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:10.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.260+0000 7fbddb3f8740 4 client.16686 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:20:10.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.260+0000 7fbddb3f8740 1 -- 172.21.15.2:0/2724368774 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558fecd5dd70 con 0x558fece7e5b0 2024-09-19T06:20:10.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.260+0000 7fbdd2d9d640 1 --2- 172.21.15.2:0/2724368774 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558fece7e5b0 0x558fece809d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:10.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.260+0000 7fbdd2d9d640 1 --2- 172.21.15.2:0/2724368774 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558fece7e5b0 0x558fece809d0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64571a4713a19cb1 server_cookie=d0b5a9e44a767020 in_seq=0 out_seq=0 2024-09-19T06:20:10.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.260+0000 7fbdb6ff5640 10 client.16686 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:10.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.261+0000 7fbdb6ff5640 1 -- 172.21.15.2:0/2724368774 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558fecd5dd70 con 0x558fece7e5b0 2024-09-19T06:20:10.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.261+0000 7fbdb6ff5640 10 client.16686 handle_command_reply: tid=0 2024-09-19T06:20:10.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.261+0000 7fbddb3f8740 1 client.16686 shutdown 2024-09-19T06:20:10.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.261+0000 7fbddb3f8740 1 -- 172.21.15.2:0/2724368774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fecdfb370 msgr2=0x558fece763d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:10.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.261+0000 7fbddb3f8740 1 --2- 172.21.15.2:0/2724368774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fecdfb370 0x558fece763d0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc00a5f0 tx=0x7fbdcc009650 comp rx=0 tx=0).stop 2024-09-19T06:20:10.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.261+0000 7fbddb3f8740 1 -- 172.21.15.2:0/2724368774 shutdown_connections 2024-09-19T06:20:10.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.261+0000 7fbddb3f8740 1 --2- 172.21.15.2:0/2724368774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558fecdfb370 0x558fece763d0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:10.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.261+0000 7fbddb3f8740 1 --2- 172.21.15.2:0/2724368774 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558fece7e5b0 0x558fece809d0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:10.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.261+0000 7fbddb3f8740 1 --2- 172.21.15.2:0/2724368774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558fecdf1b40 0x558fecdff0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:10.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.261+0000 7fbddb3f8740 1 --2- 172.21.15.2:0/2724368774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558fecdf05d0 0x558fecdfeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:10.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.261+0000 7fbddb3f8740 1 -- 172.21.15.2:0/2724368774 >> 172.21.15.2:0/2724368774 conn(0x558fecdb9310 msgr2=0x558fecdf9810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:10.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.261+0000 7fbdb6ff5640 0 client.16686 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:10.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.261+0000 7fbddb3f8740 1 -- 172.21.15.2:0/2724368774 shutdown_connections 2024-09-19T06:20:10.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.261+0000 7fbddb3f8740 1 -- 172.21.15.2:0/2724368774 wait complete. 2024-09-19T06:20:10.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.261+0000 7fbddb3f8740 20 client.16686 trim_cache size 0 max 16384 2024-09-19T06:20:10.269 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:20:10.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.261+0000 7fbdd901f640 1 -- 172.21.15.2:0/774919087 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fbdbc0a33b0 msgr2=0x7fbdbc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:10.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.261+0000 7fbdd901f640 1 --2- 172.21.15.2:0/774919087 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fbdbc0a33b0 0x7fbdbc0a5870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc00a8e0 tx=0x7fbdcc004a40 comp rx=0 tx=0).stop 2024-09-19T06:20:10.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.262+0000 7fbdd901f640 1 -- 172.21.15.2:0/774919087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdd4102790 msgr2=0x7fbdd419ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:10.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.262+0000 7fbdd901f640 1 --2- 172.21.15.2:0/774919087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdd4102790 0x7fbdd419ab00 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fbdc800c920 tx=0x7fbdc800cde0 comp rx=0 tx=0).stop 2024-09-19T06:20:10.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.262+0000 7fbdd901f640 1 -- 172.21.15.2:0/774919087 shutdown_connections 2024-09-19T06:20:10.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.262+0000 7fbdd901f640 1 --2- 172.21.15.2:0/774919087 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fbdbc0a33b0 0x7fbdbc0a5870 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:10.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.262+0000 7fbdd901f640 1 --2- 172.21.15.2:0/774919087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbdd4106f10 0x7fbdd419ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:10.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.262+0000 7fbdd901f640 1 --2- 172.21.15.2:0/774919087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdd4102790 0x7fbdd419ab00 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:10.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.262+0000 7fbdd901f640 1 --2- 172.21.15.2:0/774919087 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbdd4101de0 0x7fbdd419a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:10.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.262+0000 7fbdd901f640 1 -- 172.21.15.2:0/774919087 >> 172.21.15.2:0/774919087 conn(0x7fbdd40fd8c0 msgr2=0x7fbdd40fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:10.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.262+0000 7fbdd901f640 1 -- 172.21.15.2:0/774919087 shutdown_connections 2024-09-19T06:20:10.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:10.262+0000 7fbdd901f640 1 -- 172.21.15.2:0/774919087 wait complete. 2024-09-19T06:20:10.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:09 smithi089 ceph-mon[34160]: pgmap v163: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-19T06:20:11.849 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:20:11.849 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:20:12.122 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:12.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:11 smithi002 ceph-mon[30982]: pgmap v164: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-19T06:20:12.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:11 smithi090 ceph-mon[34497]: pgmap v164: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-19T06:20:12.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:11 smithi089 ceph-mon[34160]: pgmap v164: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-19T06:20:12.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.548+0000 7f45c52db640 1 -- 172.21.15.2:0/1021340102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45c0100a80 msgr2=0x7f45c0100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:12.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.548+0000 7f45c52db640 1 --2- 172.21.15.2:0/1021340102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45c0100a80 0x7f45c0100ee0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f45a8009930 tx=0x7f45a802a420 comp rx=0 tx=0).stop 2024-09-19T06:20:12.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.548+0000 7f45c52db640 1 -- 172.21.15.2:0/1021340102 shutdown_connections 2024-09-19T06:20:12.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.548+0000 7f45c52db640 1 --2- 172.21.15.2:0/1021340102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45c0101420 0x7f45c010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:12.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.548+0000 7f45c52db640 1 --2- 172.21.15.2:0/1021340102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45c0100a80 0x7f45c0100ee0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:12.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.548+0000 7f45c52db640 1 --2- 172.21.15.2:0/1021340102 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45c0106a80 0x7f45c0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:12.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.548+0000 7f45c52db640 1 -- 172.21.15.2:0/1021340102 >> 172.21.15.2:0/1021340102 conn(0x7f45c00fc7a0 msgr2=0x7f45c00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:12.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.548+0000 7f45c52db640 1 -- 172.21.15.2:0/1021340102 shutdown_connections 2024-09-19T06:20:12.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.548+0000 7f45c52db640 1 -- 172.21.15.2:0/1021340102 wait complete. 2024-09-19T06:20:12.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.549+0000 7f45c52db640 1 Processor -- start 2024-09-19T06:20:12.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.549+0000 7f45c52db640 1 -- start start 2024-09-19T06:20:12.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.549+0000 7f45c52db640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45c0100a80 0x7f45c01079b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:12.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.549+0000 7f45c52db640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45c0101420 0x7f45c0107ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:12.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.549+0000 7f45c52db640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45c0106a80 0x7f45c0108430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:12.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.549+0000 7f45c52db640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f45c0110d30 con 0x7f45c0106a80 2024-09-19T06:20:12.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.549+0000 7f45c52db640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f45c0110bb0 con 0x7f45c0101420 2024-09-19T06:20:12.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.549+0000 7f45c52db640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f45c0110eb0 con 0x7f45c0100a80 2024-09-19T06:20:12.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.549+0000 7f45bf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45c0106a80 0x7f45c0108430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:12.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.549+0000 7f45be7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45c0101420 0x7f45c0107ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:12.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.549+0000 7f45beffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45c0100a80 0x7f45c01079b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:12.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.549+0000 7f45bf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45c0106a80 0x7f45c0108430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46090/0 (socket says 172.21.15.2:46090) 2024-09-19T06:20:12.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.549+0000 7f45bf7fe640 1 -- 172.21.15.2:0/3335430480 learned_addr learned my addr 172.21.15.2:0/3335430480 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:12.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.550+0000 7f45bf7fe640 1 -- 172.21.15.2:0/3335430480 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45c0100a80 msgr2=0x7f45c01079b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:12.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.550+0000 7f45bf7fe640 1 --2- 172.21.15.2:0/3335430480 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45c0100a80 0x7f45c01079b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:12.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.550+0000 7f45bf7fe640 1 -- 172.21.15.2:0/3335430480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45c0101420 msgr2=0x7f45c0107ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:12.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.550+0000 7f45bf7fe640 1 --2- 172.21.15.2:0/3335430480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45c0101420 0x7f45c0107ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:12.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.550+0000 7f45bf7fe640 1 -- 172.21.15.2:0/3335430480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45c01aac60 con 0x7f45c0106a80 2024-09-19T06:20:12.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.550+0000 7f45bf7fe640 1 --2- 172.21.15.2:0/3335430480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45c0106a80 0x7f45c0108430 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f45b800db20 tx=0x7f45b800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:12.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.550+0000 7f45b7fff640 1 -- 172.21.15.2:0/3335430480 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b8017070 con 0x7f45c0106a80 2024-09-19T06:20:12.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.550+0000 7f45b7fff640 1 -- 172.21.15.2:0/3335430480 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f45b8003e20 con 0x7f45c0106a80 2024-09-19T06:20:12.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.550+0000 7f45c52db640 1 -- 172.21.15.2:0/3335430480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45c01aaf50 con 0x7f45c0106a80 2024-09-19T06:20:12.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.550+0000 7f45b7fff640 1 -- 172.21.15.2:0/3335430480 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b8010460 con 0x7f45c0106a80 2024-09-19T06:20:12.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.550+0000 7f45c52db640 1 -- 172.21.15.2:0/3335430480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45c01ab410 con 0x7f45c0106a80 2024-09-19T06:20:12.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.553+0000 7f45b7fff640 1 -- 172.21.15.2:0/3335430480 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f45b8003970 con 0x7f45c0106a80 2024-09-19T06:20:12.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.553+0000 7f45b7fff640 1 --2- 172.21.15.2:0/3335430480 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f45ac0a33b0 0x7f45ac0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:12.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.553+0000 7f45c76b4740 1 Processor -- start 2024-09-19T06:20:12.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.553+0000 7f45beffd640 1 --2- 172.21.15.2:0/3335430480 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f45ac0a33b0 0x7f45ac0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:12.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.554+0000 7f45b7fff640 1 -- 172.21.15.2:0/3335430480 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f45b80cfa50 con 0x7f45c0106a80 2024-09-19T06:20:12.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.554+0000 7f45c76b4740 1 -- start start 2024-09-19T06:20:12.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.554+0000 7f45beffd640 1 --2- 172.21.15.2:0/3335430480 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f45ac0a33b0 0x7f45ac0a5870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f45b0005fd0 tx=0x7f45b000b390 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:12.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.554+0000 7f45c76b4740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55addb24ab60 0x55addb24af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:12.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.554+0000 7f45c76b4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55addb24b480 0x55addb255800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:12.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.554+0000 7f45c76b4740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55addb255d40 0x55addb258130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:12.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.554+0000 7f45c76b4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55addb1b0280 con 0x55addb24b480 2024-09-19T06:20:12.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.554+0000 7f45c76b4740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55addb157b10 con 0x55addb255d40 2024-09-19T06:20:12.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.554+0000 7f45c76b4740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55addb1ac240 con 0x55addb24ab60 2024-09-19T06:20:12.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.554+0000 7f45be7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55addb24b480 0x55addb255800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:12.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.554+0000 7f45be7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55addb24b480 0x55addb255800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46092/0 (socket says 172.21.15.2:46092) 2024-09-19T06:20:12.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.554+0000 7f45beffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55addb24ab60 0x55addb24af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:12.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.554+0000 7f45be7fc640 1 -- 172.21.15.2:0/3924287320 learned_addr learned my addr 172.21.15.2:0/3924287320 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:12.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.554+0000 7f45bf7fe640 1 --2- 172.21.15.2:0/3924287320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55addb255d40 0x55addb258130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:12.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.554+0000 7f45be7fc640 1 -- 172.21.15.2:0/3924287320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55addb24ab60 msgr2=0x55addb24af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:12.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.554+0000 7f45be7fc640 1 --2- 172.21.15.2:0/3924287320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55addb24ab60 0x55addb24af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:12.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.554+0000 7f45be7fc640 1 -- 172.21.15.2:0/3924287320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55addb255d40 msgr2=0x55addb258130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:12.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.554+0000 7f45be7fc640 1 --2- 172.21.15.2:0/3924287320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55addb255d40 0x55addb258130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:12.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.554+0000 7f45be7fc640 1 -- 172.21.15.2:0/3924287320 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55addb1641f0 con 0x55addb24b480 2024-09-19T06:20:12.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.555+0000 7f45bf7fe640 1 --2- 172.21.15.2:0/3924287320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55addb255d40 0x55addb258130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:12.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.555+0000 7f45beffd640 1 --2- 172.21.15.2:0/3924287320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55addb24ab60 0x55addb24af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:12.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.555+0000 7f45be7fc640 1 --2- 172.21.15.2:0/3924287320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55addb24b480 0x55addb255800 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f45a802a940 tx=0x7f45a8005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2221bbd7211c7c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:12.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.555+0000 7f45b57fa640 1 -- 172.21.15.2:0/3924287320 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a8040070 con 0x55addb24b480 2024-09-19T06:20:12.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.555+0000 7f45b57fa640 1 -- 172.21.15.2:0/3924287320 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f45a80316a0 con 0x55addb24b480 2024-09-19T06:20:12.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.555+0000 7f45b57fa640 1 -- 172.21.15.2:0/3924287320 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a8035040 con 0x55addb24b480 2024-09-19T06:20:12.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.556+0000 7f45c76b4740 1 -- 172.21.15.2:0/3924287320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55addb24b480 msgr2=0x55addb255800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:12.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.556+0000 7f45c76b4740 1 --2- 172.21.15.2:0/3924287320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55addb24b480 0x55addb255800 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f45a802a940 tx=0x7f45a8005c00 comp rx=0 tx=0).stop 2024-09-19T06:20:12.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.556+0000 7f45c76b4740 1 -- 172.21.15.2:0/3924287320 shutdown_connections 2024-09-19T06:20:12.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.556+0000 7f45c76b4740 1 --2- 172.21.15.2:0/3924287320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55addb255d40 0x55addb258130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:12.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.556+0000 7f45c76b4740 1 --2- 172.21.15.2:0/3924287320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55addb24b480 0x55addb255800 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:12.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.556+0000 7f45c76b4740 1 --2- 172.21.15.2:0/3924287320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55addb24ab60 0x55addb24af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:12.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.556+0000 7f45c76b4740 1 -- 172.21.15.2:0/3924287320 >> 172.21.15.2:0/3924287320 conn(0x55addb2470f0 msgr2=0x55addb2474d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:12.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.556+0000 7f45c76b4740 1 -- 172.21.15.2:0/3924287320 shutdown_connections 2024-09-19T06:20:12.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.556+0000 7f45c76b4740 1 -- 172.21.15.2:0/3924287320 wait complete. 2024-09-19T06:20:12.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.556+0000 7f45c76b4740 1 -- start start 2024-09-19T06:20:12.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.556+0000 7f45c76b4740 1 Processor -- start 2024-09-19T06:20:12.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.557+0000 7f45c76b4740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55addb24ab60 0x55addb252bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:12.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.557+0000 7f45c76b4740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55addb24b480 0x55addb253100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:12.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.557+0000 7f45c76b4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55addb255d40 0x55addb253640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:12.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.557+0000 7f45c76b4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55addb258910 con 0x55addb255d40 2024-09-19T06:20:12.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.557+0000 7f45c76b4740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55addb16af10 con 0x55addb24b480 2024-09-19T06:20:12.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.557+0000 7f45c76b4740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55addb258a90 con 0x55addb24ab60 2024-09-19T06:20:12.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.557+0000 7f45c76b4740 10 client.0 _ll_register_callbacks cb 0x55addb133a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:12.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.557+0000 7f45bf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55addb255d40 0x55addb253640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:12.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.557+0000 7f45bf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55addb255d40 0x55addb253640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46102/0 (socket says 172.21.15.2:46102) 2024-09-19T06:20:12.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.557+0000 7f45bf7fe640 1 -- 172.21.15.2:0/3065673953 learned_addr learned my addr 172.21.15.2:0/3065673953 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:12.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.557+0000 7f45be7fc640 1 --2- 172.21.15.2:0/3065673953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55addb24b480 0x55addb253100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:12.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.557+0000 7f45beffd640 1 --2- 172.21.15.2:0/3065673953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55addb24ab60 0x55addb252bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:12.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.557+0000 7f45bf7fe640 1 -- 172.21.15.2:0/3065673953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55addb24ab60 msgr2=0x55addb252bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:12.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.557+0000 7f45bf7fe640 1 --2- 172.21.15.2:0/3065673953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55addb24ab60 0x55addb252bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:12.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.557+0000 7f45bf7fe640 1 -- 172.21.15.2:0/3065673953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55addb24b480 msgr2=0x55addb253100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:12.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.557+0000 7f45bf7fe640 1 --2- 172.21.15.2:0/3065673953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55addb24b480 0x55addb253100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:12.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.557+0000 7f45bf7fe640 1 -- 172.21.15.2:0/3065673953 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55addaf216a0 con 0x55addb255d40 2024-09-19T06:20:12.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.557+0000 7f45bf7fe640 1 --2- 172.21.15.2:0/3065673953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55addb255d40 0x55addb253640 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f45b80987e0 tx=0x7f45b809b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da930a46ecc6be37 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:12.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.557+0000 7f45a67fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:12.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.558+0000 7f45a67fc640 1 -- 172.21.15.2:0/3065673953 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b8014030 con 0x55addb255d40 2024-09-19T06:20:12.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.558+0000 7f45a67fc640 1 -- 172.21.15.2:0/3065673953 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f45b8098480 con 0x55addb255d40 2024-09-19T06:20:12.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.558+0000 7f45c76b4740 1 -- 172.21.15.2:0/3065673953 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45a80316a0 con 0x55addb255d40 2024-09-19T06:20:12.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.558+0000 7f45a67fc640 1 -- 172.21.15.2:0/3065673953 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f45b8020040 con 0x55addb255d40 2024-09-19T06:20:12.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.558+0000 7f45c76b4740 10 client.16698 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:12.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.558+0000 7f45c76b4740 1 -- 172.21.15.2:0/3065673953 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55addb2644c0 con 0x55addb255d40 2024-09-19T06:20:12.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.558+0000 7f45a67fc640 1 -- 172.21.15.2:0/3065673953 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f45a80316a0 con 0x55addb255d40 2024-09-19T06:20:12.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.558+0000 7f45a67fc640 1 -- 172.21.15.2:0/3065673953 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f45b8048ba0 con 0x55addb255d40 2024-09-19T06:20:12.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.558+0000 7f45c76b4740 10 client.16698 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:12.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.558+0000 7f45c76b4740 10 client.16698 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:12.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.558+0000 7f45c76b4740 20 client.16698 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:12.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.558+0000 7f45c76b4740 1 --2- 172.21.15.2:0/3065673953 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55addb265920 0x55addb267d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:12.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.558+0000 7f45c76b4740 4 client.16698 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:12.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.558+0000 7f45c76b4740 1 -- 172.21.15.2:0/3065673953 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55addb1bd7f0 con 0x55addb265920 2024-09-19T06:20:12.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.558+0000 7f45beffd640 1 --2- 172.21.15.2:0/3065673953 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55addb265920 0x55addb267d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:12.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.559+0000 7f45beffd640 1 --2- 172.21.15.2:0/3065673953 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55addb265920 0x55addb267d70 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0bdfaf6ce59b2e2 server_cookie=9bc425e7e61b1862 in_seq=0 out_seq=0 2024-09-19T06:20:12.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.559+0000 7f45a67fc640 10 client.16698 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:12.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.560+0000 7f45a67fc640 1 -- 172.21.15.2:0/3065673953 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55addb1bd7f0 con 0x55addb265920 2024-09-19T06:20:12.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.560+0000 7f45a67fc640 10 client.16698 handle_command_reply: tid=0 2024-09-19T06:20:12.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.560+0000 7f45c76b4740 1 client.16698 shutdown 2024-09-19T06:20:12.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.560+0000 7f45c76b4740 1 -- 172.21.15.2:0/3065673953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55addb255d40 msgr2=0x55addb253640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:12.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.560+0000 7f45c76b4740 1 --2- 172.21.15.2:0/3065673953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55addb255d40 0x55addb253640 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f45b80987e0 tx=0x7f45b809b860 comp rx=0 tx=0).stop 2024-09-19T06:20:12.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.560+0000 7f45c76b4740 1 -- 172.21.15.2:0/3065673953 shutdown_connections 2024-09-19T06:20:12.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.560+0000 7f45c76b4740 1 --2- 172.21.15.2:0/3065673953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55addb255d40 0x55addb253640 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:12.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.560+0000 7f45c76b4740 1 --2- 172.21.15.2:0/3065673953 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55addb265920 0x55addb267d70 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:12.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.560+0000 7f45c76b4740 1 --2- 172.21.15.2:0/3065673953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55addb24b480 0x55addb253100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:12.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.560+0000 7f45c76b4740 1 --2- 172.21.15.2:0/3065673953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55addb24ab60 0x55addb252bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:12.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.560+0000 7f45a67fc640 0 client.16698 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:12.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.560+0000 7f45c76b4740 1 -- 172.21.15.2:0/3065673953 >> 172.21.15.2:0/3065673953 conn(0x55addb2470f0 msgr2=0x55addb246270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:12.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.560+0000 7f45c76b4740 1 -- 172.21.15.2:0/3065673953 shutdown_connections 2024-09-19T06:20:12.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.560+0000 7f45c76b4740 1 -- 172.21.15.2:0/3065673953 wait complete. 2024-09-19T06:20:12.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.560+0000 7f45c76b4740 20 client.16698 trim_cache size 0 max 16384 2024-09-19T06:20:12.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.577+0000 7f45c76b4740 1 Processor -- start 2024-09-19T06:20:12.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.577+0000 7f45c76b4740 1 -- start start 2024-09-19T06:20:12.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.578+0000 7f45c76b4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55addb24ab60 0x55addb24ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:12.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.578+0000 7f45c76b4740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55addb24b480 0x55addb26d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:12.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.578+0000 7f45c76b4740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55addb255d40 0x55addb26db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:12.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.578+0000 7f45c76b4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f45c01b65a0 con 0x55addb24ab60 2024-09-19T06:20:12.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.578+0000 7f45c76b4740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f45c01b3e70 con 0x55addb24b480 2024-09-19T06:20:12.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.578+0000 7f45c76b4740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f45c01b1cc0 con 0x55addb255d40 2024-09-19T06:20:12.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.578+0000 7f45beffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55addb24ab60 0x55addb24ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:12.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.578+0000 7f45beffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55addb24ab60 0x55addb24ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46108/0 (socket says 172.21.15.2:46108) 2024-09-19T06:20:12.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.578+0000 7f45beffd640 1 -- 172.21.15.2:0/2905647291 learned_addr learned my addr 172.21.15.2:0/2905647291 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:12.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.578+0000 7f45bf7fe640 1 --2- 172.21.15.2:0/2905647291 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55addb255d40 0x55addb26db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:12.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.578+0000 7f45be7fc640 1 --2- 172.21.15.2:0/2905647291 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55addb24b480 0x55addb26d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:12.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.578+0000 7f45beffd640 1 -- 172.21.15.2:0/2905647291 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55addb255d40 msgr2=0x55addb26db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:12.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.578+0000 7f45beffd640 1 --2- 172.21.15.2:0/2905647291 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55addb255d40 0x55addb26db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:12.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.578+0000 7f45beffd640 1 -- 172.21.15.2:0/2905647291 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55addb24b480 msgr2=0x55addb26d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:12.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.578+0000 7f45beffd640 1 --2- 172.21.15.2:0/2905647291 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55addb24b480 0x55addb26d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:12.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.578+0000 7f45beffd640 1 -- 172.21.15.2:0/2905647291 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55addb241680 con 0x55addb24ab60 2024-09-19T06:20:12.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.579+0000 7f45beffd640 1 --2- 172.21.15.2:0/2905647291 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55addb24ab60 0x55addb24ccc0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f45b0004650 tx=0x7f45b0013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98bad7f9c289c479 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:12.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.579+0000 7f45b4ff9640 1 -- 172.21.15.2:0/2905647291 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b002a420 con 0x55addb24ab60 2024-09-19T06:20:12.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.579+0000 7f45b4ff9640 1 -- 172.21.15.2:0/2905647291 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f45b002aa70 con 0x55addb24ab60 2024-09-19T06:20:12.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.579+0000 7f45b4ff9640 1 -- 172.21.15.2:0/2905647291 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b001ec80 con 0x55addb24ab60 2024-09-19T06:20:12.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.579+0000 7f45c76b4740 1 -- 172.21.15.2:0/2905647291 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55addb24ab60 msgr2=0x55addb24ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:12.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.579+0000 7f45c76b4740 1 --2- 172.21.15.2:0/2905647291 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55addb24ab60 0x55addb24ccc0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f45b0004650 tx=0x7f45b0013000 comp rx=0 tx=0).stop 2024-09-19T06:20:12.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.580+0000 7f45c76b4740 1 -- 172.21.15.2:0/2905647291 shutdown_connections 2024-09-19T06:20:12.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.580+0000 7f45c76b4740 1 --2- 172.21.15.2:0/2905647291 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55addb255d40 0x55addb26db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:12.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.580+0000 7f45c76b4740 1 --2- 172.21.15.2:0/2905647291 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55addb24b480 0x55addb26d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:12.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.580+0000 7f45c76b4740 1 --2- 172.21.15.2:0/2905647291 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55addb24ab60 0x55addb24ccc0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:12.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.580+0000 7f45c76b4740 1 -- 172.21.15.2:0/2905647291 >> 172.21.15.2:0/2905647291 conn(0x55addb2470f0 msgr2=0x55addb24c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:12.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.580+0000 7f45c76b4740 1 -- 172.21.15.2:0/2905647291 shutdown_connections 2024-09-19T06:20:12.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.580+0000 7f45c76b4740 1 -- 172.21.15.2:0/2905647291 wait complete. 2024-09-19T06:20:12.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.580+0000 7f45c76b4740 1 -- start start 2024-09-19T06:20:12.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.580+0000 7f45c76b4740 1 Processor -- start 2024-09-19T06:20:12.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.580+0000 7f45c76b4740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55addb24ab60 0x55addb24fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:12.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.580+0000 7f45c76b4740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55addb24b480 0x55addb250290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:12.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.580+0000 7f45c76b4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55addb255d40 0x55addb2507d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:12.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.580+0000 7f45c76b4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f45c01b2330 con 0x55addb255d40 2024-09-19T06:20:12.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.580+0000 7f45c76b4740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f45c01b37a0 con 0x55addb24b480 2024-09-19T06:20:12.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.580+0000 7f45c76b4740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f45c01b2a00 con 0x55addb24ab60 2024-09-19T06:20:12.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.580+0000 7f45c76b4740 10 client.0 _ll_register_callbacks cb 0x7f45b80043c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:12.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.581+0000 7f45bf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55addb255d40 0x55addb2507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:12.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.581+0000 7f45bf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55addb255d40 0x55addb2507d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46116/0 (socket says 172.21.15.2:46116) 2024-09-19T06:20:12.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.581+0000 7f45bf7fe640 1 -- 172.21.15.2:0/4130942336 learned_addr learned my addr 172.21.15.2:0/4130942336 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:12.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.581+0000 7f45be7fc640 1 --2- 172.21.15.2:0/4130942336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55addb24b480 0x55addb250290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:12.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.581+0000 7f45beffd640 1 --2- 172.21.15.2:0/4130942336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55addb24ab60 0x55addb24fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:12.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.581+0000 7f45bf7fe640 1 -- 172.21.15.2:0/4130942336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55addb24ab60 msgr2=0x55addb24fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:12.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.581+0000 7f45bf7fe640 1 --2- 172.21.15.2:0/4130942336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55addb24ab60 0x55addb24fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:12.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.581+0000 7f45bf7fe640 1 -- 172.21.15.2:0/4130942336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55addb24b480 msgr2=0x55addb250290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:12.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.581+0000 7f45bf7fe640 1 --2- 172.21.15.2:0/4130942336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55addb24b480 0x55addb250290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:12.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.581+0000 7f45bf7fe640 1 -- 172.21.15.2:0/4130942336 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55addb2cf6e0 con 0x55addb255d40 2024-09-19T06:20:12.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.581+0000 7f45bf7fe640 1 --2- 172.21.15.2:0/4130942336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55addb255d40 0x55addb2507d0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f45b809a0c0 tx=0x7f45b80986b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17c61ce8c00ff064 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:12.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.581+0000 7f45a67fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:12.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.581+0000 7f45a67fc640 1 -- 172.21.15.2:0/4130942336 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b8014020 con 0x55addb255d40 2024-09-19T06:20:12.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.581+0000 7f45a67fc640 1 -- 172.21.15.2:0/4130942336 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f45b809b260 con 0x55addb255d40 2024-09-19T06:20:12.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.581+0000 7f45c76b4740 1 -- 172.21.15.2:0/4130942336 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45b002aa70 con 0x55addb255d40 2024-09-19T06:20:12.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.581+0000 7f45a67fc640 1 -- 172.21.15.2:0/4130942336 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f45b80980b0 con 0x55addb255d40 2024-09-19T06:20:12.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.581+0000 7f45c76b4740 10 client.16704 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:12.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.581+0000 7f45c76b4740 1 -- 172.21.15.2:0/4130942336 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55addb2d0a20 con 0x55addb255d40 2024-09-19T06:20:12.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.582+0000 7f45a67fc640 1 -- 172.21.15.2:0/4130942336 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f45b002aa70 con 0x55addb255d40 2024-09-19T06:20:12.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.582+0000 7f45a67fc640 1 -- 172.21.15.2:0/4130942336 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f45b80a12a0 con 0x55addb255d40 2024-09-19T06:20:12.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.582+0000 7f45c76b4740 10 client.16704 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:12.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.582+0000 7f45c76b4740 10 client.16704 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:12.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.582+0000 7f45c76b4740 20 client.16704 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:12.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.582+0000 7f45c76b4740 1 --2- 172.21.15.2:0/4130942336 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55addb2d1000 0x55addb2d33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:12.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.582+0000 7f45c76b4740 4 client.16704 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:20:12.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.582+0000 7f45c76b4740 1 -- 172.21.15.2:0/4130942336 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55addb1b7d00 con 0x55addb2d1000 2024-09-19T06:20:12.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.582+0000 7f45beffd640 1 --2- 172.21.15.2:0/4130942336 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55addb2d1000 0x55addb2d33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:12.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.582+0000 7f45a67fc640 10 client.16704 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:12.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.582+0000 7f45beffd640 1 --2- 172.21.15.2:0/4130942336 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55addb2d1000 0x55addb2d33f0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9948aa15fe0cd522 server_cookie=73c97fd394a9eca6 in_seq=0 out_seq=0 2024-09-19T06:20:12.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.583+0000 7f45a67fc640 1 -- 172.21.15.2:0/4130942336 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55addb1b7d00 con 0x55addb2d1000 2024-09-19T06:20:12.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.583+0000 7f45a67fc640 10 client.16704 handle_command_reply: tid=0 2024-09-19T06:20:12.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.583+0000 7f45c76b4740 1 client.16704 shutdown 2024-09-19T06:20:12.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.584+0000 7f45c76b4740 1 -- 172.21.15.2:0/4130942336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55addb255d40 msgr2=0x55addb2507d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:12.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.584+0000 7f45c76b4740 1 --2- 172.21.15.2:0/4130942336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55addb255d40 0x55addb2507d0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f45b809a0c0 tx=0x7f45b80986b0 comp rx=0 tx=0).stop 2024-09-19T06:20:12.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.584+0000 7f45c76b4740 1 -- 172.21.15.2:0/4130942336 shutdown_connections 2024-09-19T06:20:12.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.584+0000 7f45c76b4740 1 --2- 172.21.15.2:0/4130942336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55addb255d40 0x55addb2507d0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:12.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.584+0000 7f45c76b4740 1 --2- 172.21.15.2:0/4130942336 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55addb2d1000 0x55addb2d33f0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:12.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.584+0000 7f45c76b4740 1 --2- 172.21.15.2:0/4130942336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55addb24b480 0x55addb250290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:12.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.584+0000 7f45c76b4740 1 --2- 172.21.15.2:0/4130942336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55addb24ab60 0x55addb24fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:12.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.584+0000 7f45a67fc640 0 client.16704 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:12.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.584+0000 7f45c76b4740 1 -- 172.21.15.2:0/4130942336 >> 172.21.15.2:0/4130942336 conn(0x55addb2470f0 msgr2=0x55addb2533a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:12.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.584+0000 7f45c76b4740 1 -- 172.21.15.2:0/4130942336 shutdown_connections 2024-09-19T06:20:12.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.584+0000 7f45c76b4740 1 -- 172.21.15.2:0/4130942336 wait complete. 2024-09-19T06:20:12.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.584+0000 7f45c76b4740 20 client.16704 trim_cache size 0 max 16384 2024-09-19T06:20:12.594 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:20:12.594 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T06:20:12.594 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "a68c6cd9-139b-42a5-bc45-73797dd11e6b", 2024-09-19T06:20:12.594 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T06:20:12.594 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:20:12.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.585+0000 7f45c52db640 1 -- 172.21.15.2:0/3335430480 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f45ac0a33b0 msgr2=0x7f45ac0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:12.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.585+0000 7f45c52db640 1 --2- 172.21.15.2:0/3335430480 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f45ac0a33b0 0x7f45ac0a5870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f45b0005fd0 tx=0x7f45b000b390 comp rx=0 tx=0).stop 2024-09-19T06:20:12.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.585+0000 7f45c52db640 1 -- 172.21.15.2:0/3335430480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45c0106a80 msgr2=0x7f45c0108430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:12.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.585+0000 7f45c52db640 1 --2- 172.21.15.2:0/3335430480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45c0106a80 0x7f45c0108430 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f45b800db20 tx=0x7f45b800b260 comp rx=0 tx=0).stop 2024-09-19T06:20:12.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.585+0000 7f45c52db640 1 -- 172.21.15.2:0/3335430480 shutdown_connections 2024-09-19T06:20:12.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.585+0000 7f45c52db640 1 --2- 172.21.15.2:0/3335430480 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f45ac0a33b0 0x7f45ac0a5870 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:12.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.585+0000 7f45c52db640 1 --2- 172.21.15.2:0/3335430480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45c0106a80 0x7f45c0108430 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:12.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.585+0000 7f45c52db640 1 --2- 172.21.15.2:0/3335430480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45c0101420 0x7f45c0107ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:12.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.585+0000 7f45c52db640 1 --2- 172.21.15.2:0/3335430480 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45c0100a80 0x7f45c01079b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:12.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.585+0000 7f45c52db640 1 -- 172.21.15.2:0/3335430480 >> 172.21.15.2:0/3335430480 conn(0x7f45c00fc7a0 msgr2=0x7f45c010c730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:12.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.585+0000 7f45c52db640 1 -- 172.21.15.2:0/3335430480 shutdown_connections 2024-09-19T06:20:12.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:12.585+0000 7f45c52db640 1 -- 172.21.15.2:0/3335430480 wait complete. 2024-09-19T06:20:13.236 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:20:13.498 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:14.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.963+0000 7ff15fe56640 1 -- 172.21.15.2:0/3344650012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff158102570 msgr2=0x7ff1581029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:14.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.963+0000 7ff15fe56640 1 --2- 172.21.15.2:0/3344650012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff158102570 0x7ff1581029b0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ff148009900 tx=0x7ff14802a480 comp rx=0 tx=0).stop 2024-09-19T06:20:14.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.963+0000 7ff15fe56640 1 -- 172.21.15.2:0/3344650012 shutdown_connections 2024-09-19T06:20:14.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.963+0000 7ff15fe56640 1 --2- 172.21.15.2:0/3344650012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff158102ef0 0x7ff15810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:14.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.963+0000 7ff15fe56640 1 --2- 172.21.15.2:0/3344650012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff158102570 0x7ff1581029b0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:14.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.963+0000 7ff15fe56640 1 --2- 172.21.15.2:0/3344650012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff158100e20 0x7ff158101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:14.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.963+0000 7ff15fe56640 1 -- 172.21.15.2:0/3344650012 >> 172.21.15.2:0/3344650012 conn(0x7ff1580fc7d0 msgr2=0x7ff1580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:14.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.963+0000 7ff15fe56640 1 -- 172.21.15.2:0/3344650012 shutdown_connections 2024-09-19T06:20:14.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.963+0000 7ff15fe56640 1 -- 172.21.15.2:0/3344650012 wait complete. 2024-09-19T06:20:14.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.964+0000 7ff15fe56640 1 Processor -- start 2024-09-19T06:20:14.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.964+0000 7ff15fe56640 1 -- start start 2024-09-19T06:20:14.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.964+0000 7ff15fe56640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff158100e20 0x7ff1581992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:14.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.964+0000 7ff15fe56640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff158102570 0x7ff158199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:14.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.964+0000 7ff15fe56640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff158102ef0 0x7ff1581a4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:14.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.964+0000 7ff15fe56640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff158110e50 con 0x7ff158100e20 2024-09-19T06:20:14.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.964+0000 7ff15fe56640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff158110cd0 con 0x7ff158102570 2024-09-19T06:20:14.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.964+0000 7ff15fe56640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff158110fd0 con 0x7ff158102ef0 2024-09-19T06:20:14.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.964+0000 7ff15dbf2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff158100e20 0x7ff1581992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:14.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.964+0000 7ff15dbf2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff158100e20 0x7ff1581992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46124/0 (socket says 172.21.15.2:46124) 2024-09-19T06:20:14.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.964+0000 7ff15dbf2640 1 -- 172.21.15.2:0/1937114374 learned_addr learned my addr 172.21.15.2:0/1937114374 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:14.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.964+0000 7ff15e3f3640 1 --2- 172.21.15.2:0/1937114374 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff158102ef0 0x7ff1581a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:14.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.964+0000 7ff15d3f1640 1 --2- 172.21.15.2:0/1937114374 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff158102570 0x7ff158199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:14.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.964+0000 7ff15dbf2640 1 -- 172.21.15.2:0/1937114374 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff158102ef0 msgr2=0x7ff1581a4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:14.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.964+0000 7ff15dbf2640 1 --2- 172.21.15.2:0/1937114374 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff158102ef0 0x7ff1581a4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:14.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.964+0000 7ff15dbf2640 1 -- 172.21.15.2:0/1937114374 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff158102570 msgr2=0x7ff158199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:14.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.964+0000 7ff15dbf2640 1 --2- 172.21.15.2:0/1937114374 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff158102570 0x7ff158199820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:14.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.964+0000 7ff15dbf2640 1 -- 172.21.15.2:0/1937114374 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1581a48a0 con 0x7ff158100e20 2024-09-19T06:20:14.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.965+0000 7ff15dbf2640 1 --2- 172.21.15.2:0/1937114374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff158100e20 0x7ff1581992e0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7ff15400b4a0 tx=0x7ff15400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:14.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.965+0000 7ff14effd640 1 -- 172.21.15.2:0/1937114374 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff154014070 con 0x7ff158100e20 2024-09-19T06:20:14.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.965+0000 7ff14effd640 1 -- 172.21.15.2:0/1937114374 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff154010ac0 con 0x7ff158100e20 2024-09-19T06:20:14.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.965+0000 7ff15fe56640 1 -- 172.21.15.2:0/1937114374 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1581a4a70 con 0x7ff158100e20 2024-09-19T06:20:14.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.965+0000 7ff14effd640 1 -- 172.21.15.2:0/1937114374 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff154017c30 con 0x7ff158100e20 2024-09-19T06:20:14.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.965+0000 7ff15fe56640 1 -- 172.21.15.2:0/1937114374 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1581a4f80 con 0x7ff158100e20 2024-09-19T06:20:14.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.968+0000 7ff14effd640 1 -- 172.21.15.2:0/1937114374 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7ff154017070 con 0x7ff158100e20 2024-09-19T06:20:14.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.968+0000 7ff16222f740 1 Processor -- start 2024-09-19T06:20:14.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.968+0000 7ff16222f740 1 -- start start 2024-09-19T06:20:14.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.968+0000 7ff16222f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6081e74a0 0x55a6081e7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:14.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.968+0000 7ff16222f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a6081e7dc0 0x55a6081f2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:14.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.968+0000 7ff16222f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a6081f2680 0x55a6081f4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:14.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.968+0000 7ff16222f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a60814d2e0 con 0x55a6081e74a0 2024-09-19T06:20:14.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.968+0000 7ff16222f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55a6080f4ce0 con 0x55a6081f2680 2024-09-19T06:20:14.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.968+0000 7ff16222f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55a6081492a0 con 0x55a6081e7dc0 2024-09-19T06:20:14.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.969+0000 7ff15e3f3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6081e74a0 0x55a6081e7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:14.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.969+0000 7ff15e3f3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6081e74a0 0x55a6081e7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46134/0 (socket says 172.21.15.2:46134) 2024-09-19T06:20:14.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.969+0000 7ff15e3f3640 1 -- 172.21.15.2:0/1299251834 learned_addr learned my addr 172.21.15.2:0/1299251834 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:14.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.969+0000 7ff15dbf2640 1 --2- 172.21.15.2:0/1299251834 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a6081e7dc0 0x55a6081f2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:14.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.969+0000 7ff15d3f1640 1 --2- 172.21.15.2:0/1299251834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a6081f2680 0x55a6081f4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:14.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.969+0000 7ff15e3f3640 1 -- 172.21.15.2:0/1299251834 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a6081e7dc0 msgr2=0x55a6081f2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:14.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.969+0000 7ff15e3f3640 1 --2- 172.21.15.2:0/1299251834 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a6081e7dc0 0x55a6081f2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:14.063 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:20:14.063 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T06:20:14.063 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T06:20:14.063 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:20:14.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.969+0000 7ff15e3f3640 1 -- 172.21.15.2:0/1299251834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a6081f2680 msgr2=0x55a6081f4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:14.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.969+0000 7ff15e3f3640 1 --2- 172.21.15.2:0/1299251834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a6081f2680 0x55a6081f4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:14.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.969+0000 7ff15e3f3640 1 -- 172.21.15.2:0/1299251834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6080d9440 con 0x55a6081e74a0 2024-09-19T06:20:14.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.969+0000 7ff15d3f1640 1 --2- 172.21.15.2:0/1299251834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a6081f2680 0x55a6081f4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:14.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.969+0000 7ff14effd640 1 --2- 172.21.15.2:0/1937114374 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff1440a3430 0x7ff1440a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:14.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.969+0000 7ff15e3f3640 1 --2- 172.21.15.2:0/1299251834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6081e74a0 0x55a6081e7880 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7ff150009ee0 tx=0x7ff150010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3fc917a457682b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:14.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.969+0000 7ff15dbf2640 1 --2- 172.21.15.2:0/1937114374 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff1440a3430 0x7ff1440a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:14.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.969+0000 7ff14effd640 1 -- 172.21.15.2:0/1937114374 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7ff1540cefb0 con 0x7ff158100e20 2024-09-19T06:20:14.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.969+0000 7ff143fff640 1 -- 172.21.15.2:0/1299251834 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff150016070 con 0x55a6081e74a0 2024-09-19T06:20:14.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.969+0000 7ff143fff640 1 -- 172.21.15.2:0/1299251834 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff150004d20 con 0x55a6081e74a0 2024-09-19T06:20:14.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.969+0000 7ff143fff640 1 -- 172.21.15.2:0/1299251834 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1500126b0 con 0x55a6081e74a0 2024-09-19T06:20:14.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.970+0000 7ff16222f740 1 -- 172.21.15.2:0/1299251834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6081e74a0 msgr2=0x55a6081e7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:14.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.970+0000 7ff15dbf2640 1 --2- 172.21.15.2:0/1937114374 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff1440a3430 0x7ff1440a58f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff1540cc8f0 tx=0x7ff154097040 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:14.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.970+0000 7ff16222f740 1 --2- 172.21.15.2:0/1299251834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6081e74a0 0x55a6081e7880 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7ff150009ee0 tx=0x7ff150010740 comp rx=0 tx=0).stop 2024-09-19T06:20:14.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.970+0000 7ff16222f740 1 -- 172.21.15.2:0/1299251834 shutdown_connections 2024-09-19T06:20:14.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.970+0000 7ff16222f740 1 --2- 172.21.15.2:0/1299251834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a6081f2680 0x55a6081f4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:14.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.970+0000 7ff16222f740 1 --2- 172.21.15.2:0/1299251834 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a6081e7dc0 0x55a6081f2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:14.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.970+0000 7ff16222f740 1 --2- 172.21.15.2:0/1299251834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6081e74a0 0x55a6081e7880 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:14.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.970+0000 7ff16222f740 1 -- 172.21.15.2:0/1299251834 >> 172.21.15.2:0/1299251834 conn(0x55a6081e3a30 msgr2=0x55a6081e3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:14.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.970+0000 7ff16222f740 1 -- 172.21.15.2:0/1299251834 shutdown_connections 2024-09-19T06:20:14.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.970+0000 7ff16222f740 1 -- 172.21.15.2:0/1299251834 wait complete. 2024-09-19T06:20:14.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.971+0000 7ff16222f740 1 -- start start 2024-09-19T06:20:14.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.971+0000 7ff16222f740 1 Processor -- start 2024-09-19T06:20:14.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.971+0000 7ff16222f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a6081e74a0 0x55a6081f1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:14.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.971+0000 7ff16222f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6081e7dc0 0x55a6081ef1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:14.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.971+0000 7ff16222f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a6081f2680 0x55a6081ef730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:14.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.971+0000 7ff16222f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a6081f5250 con 0x55a6081e7dc0 2024-09-19T06:20:14.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.971+0000 7ff16222f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55a608108050 con 0x55a6081f2680 2024-09-19T06:20:14.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.971+0000 7ff16222f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55a6081f53d0 con 0x55a6081e74a0 2024-09-19T06:20:14.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.971+0000 7ff16222f740 10 client.0 _ll_register_callbacks cb 0x55a608148160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:14.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.971+0000 7ff15d3f1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6081e7dc0 0x55a6081ef1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:14.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.971+0000 7ff15d3f1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6081e7dc0 0x55a6081ef1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46142/0 (socket says 172.21.15.2:46142) 2024-09-19T06:20:14.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.971+0000 7ff15d3f1640 1 -- 172.21.15.2:0/136544135 learned_addr learned my addr 172.21.15.2:0/136544135 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:14.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.972+0000 7ff15e3f3640 1 --2- 172.21.15.2:0/136544135 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a6081e74a0 0x55a6081f1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:14.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.972+0000 7ff15e3f3640 1 --2- 172.21.15.2:0/136544135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a6081f2680 0x55a6081ef730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:14.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.972+0000 7ff15d3f1640 1 -- 172.21.15.2:0/136544135 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a6081e74a0 msgr2=0x55a6081f1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:14.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.972+0000 7ff15d3f1640 1 --2- 172.21.15.2:0/136544135 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a6081e74a0 0x55a6081f1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:14.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.972+0000 7ff15d3f1640 1 -- 172.21.15.2:0/136544135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a6081f2680 msgr2=0x55a6081ef730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:14.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.972+0000 7ff15d3f1640 1 --2- 172.21.15.2:0/136544135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a6081f2680 0x55a6081ef730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:14.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.972+0000 7ff15d3f1640 1 -- 172.21.15.2:0/136544135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a607ebe3c0 con 0x55a6081e7dc0 2024-09-19T06:20:14.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.972+0000 7ff15d3f1640 1 --2- 172.21.15.2:0/136544135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6081e7dc0 0x55a6081ef1f0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7ff148000c00 tx=0x7ff1480316e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af2bdbbb94213792 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:14.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.972+0000 7ff1417fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:14.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.972+0000 7ff1417fa640 1 -- 172.21.15.2:0/136544135 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14803f070 con 0x55a6081e7dc0 2024-09-19T06:20:14.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.972+0000 7ff16222f740 1 -- 172.21.15.2:0/136544135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff150004d20 con 0x55a6081e7dc0 2024-09-19T06:20:14.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.972+0000 7ff1417fa640 1 -- 172.21.15.2:0/136544135 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7ff148004250 con 0x55a6081e7dc0 2024-09-19T06:20:14.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.972+0000 7ff1417fa640 1 -- 172.21.15.2:0/136544135 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff148035070 con 0x55a6081e7dc0 2024-09-19T06:20:14.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.972+0000 7ff16222f740 10 client.16716 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:14.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.972+0000 7ff16222f740 1 -- 172.21.15.2:0/136544135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a608200bf0 con 0x55a6081e7dc0 2024-09-19T06:20:14.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.973+0000 7ff1417fa640 1 -- 172.21.15.2:0/136544135 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff150004d20 con 0x55a6081e7dc0 2024-09-19T06:20:14.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.973+0000 7ff1417fa640 1 -- 172.21.15.2:0/136544135 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7ff1480049d0 con 0x55a6081e7dc0 2024-09-19T06:20:14.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.973+0000 7ff16222f740 10 client.16716 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:14.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.973+0000 7ff16222f740 10 client.16716 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:14.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.973+0000 7ff16222f740 20 client.16716 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:14.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.973+0000 7ff16222f740 1 --2- 172.21.15.2:0/136544135 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a608202000 0x55a6082043f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:14.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.973+0000 7ff16222f740 4 client.16716 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:14.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.973+0000 7ff16222f740 1 -- 172.21.15.2:0/136544135 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a60815a850 con 0x55a608202000 2024-09-19T06:20:14.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.973+0000 7ff15e3f3640 1 --2- 172.21.15.2:0/136544135 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a608202000 0x55a6082043f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:14.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.974+0000 7ff1417fa640 10 client.16716 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:14.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.974+0000 7ff15e3f3640 1 --2- 172.21.15.2:0/136544135 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a608202000 0x55a6082043f0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e27734bc7688ebc server_cookie=245ae9b787e11e22 in_seq=0 out_seq=0 2024-09-19T06:20:14.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.974+0000 7ff1417fa640 1 -- 172.21.15.2:0/136544135 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a60815a850 con 0x55a608202000 2024-09-19T06:20:14.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.974+0000 7ff1417fa640 10 client.16716 handle_command_reply: tid=0 2024-09-19T06:20:14.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.974+0000 7ff16222f740 1 client.16716 shutdown 2024-09-19T06:20:14.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.974+0000 7ff16222f740 1 -- 172.21.15.2:0/136544135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6081e7dc0 msgr2=0x55a6081ef1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:14.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.975+0000 7ff16222f740 1 --2- 172.21.15.2:0/136544135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6081e7dc0 0x55a6081ef1f0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7ff148000c00 tx=0x7ff1480316e0 comp rx=0 tx=0).stop 2024-09-19T06:20:14.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.975+0000 7ff16222f740 1 -- 172.21.15.2:0/136544135 shutdown_connections 2024-09-19T06:20:14.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.975+0000 7ff16222f740 1 --2- 172.21.15.2:0/136544135 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a608202000 0x55a6082043f0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:14.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.975+0000 7ff16222f740 1 --2- 172.21.15.2:0/136544135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a6081f2680 0x55a6081ef730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:14.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.975+0000 7ff16222f740 1 --2- 172.21.15.2:0/136544135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6081e7dc0 0x55a6081ef1f0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:14.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.975+0000 7ff1417fa640 0 client.16716 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:14.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.975+0000 7ff16222f740 1 --2- 172.21.15.2:0/136544135 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a6081e74a0 0x55a6081f1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:14.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.975+0000 7ff16222f740 1 -- 172.21.15.2:0/136544135 >> 172.21.15.2:0/136544135 conn(0x55a6081e3a30 msgr2=0x55a6081e9710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:14.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.975+0000 7ff16222f740 1 -- 172.21.15.2:0/136544135 shutdown_connections 2024-09-19T06:20:14.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.975+0000 7ff16222f740 1 -- 172.21.15.2:0/136544135 wait complete. 2024-09-19T06:20:14.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.975+0000 7ff16222f740 20 client.16716 trim_cache size 0 max 16384 2024-09-19T06:20:14.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.992+0000 7ff16222f740 1 Processor -- start 2024-09-19T06:20:14.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.992+0000 7ff16222f740 1 -- start start 2024-09-19T06:20:14.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.992+0000 7ff16222f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a6081e74a0 0x55a6081fe4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:14.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.992+0000 7ff16222f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6081e7dc0 0x55a608209ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:14.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.992+0000 7ff16222f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a6081f2680 0x55a60820a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:14.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.992+0000 7ff16222f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff1581b0090 con 0x55a6081e7dc0 2024-09-19T06:20:14.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.992+0000 7ff16222f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff1581ad960 con 0x55a6081e74a0 2024-09-19T06:20:14.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.992+0000 7ff16222f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff1581ab7b0 con 0x55a6081f2680 2024-09-19T06:20:14.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.992+0000 7ff15d3f1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6081e7dc0 0x55a608209ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:14.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.992+0000 7ff15d3f1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6081e7dc0 0x55a608209ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46150/0 (socket says 172.21.15.2:46150) 2024-09-19T06:20:14.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.992+0000 7ff15d3f1640 1 -- 172.21.15.2:0/2882976411 learned_addr learned my addr 172.21.15.2:0/2882976411 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:14.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.993+0000 7ff15d3f1640 1 -- 172.21.15.2:0/2882976411 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a6081f2680 msgr2=0x55a60820a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:14.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.993+0000 7ff15d3f1640 1 --2- 172.21.15.2:0/2882976411 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a6081f2680 0x55a60820a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:14.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.993+0000 7ff15d3f1640 1 -- 172.21.15.2:0/2882976411 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a6081e74a0 msgr2=0x55a6081fe4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:14.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.993+0000 7ff15d3f1640 1 --2- 172.21.15.2:0/2882976411 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a6081e74a0 0x55a6081fe4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:14.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.993+0000 7ff15d3f1640 1 -- 172.21.15.2:0/2882976411 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a608204a50 con 0x55a6081e7dc0 2024-09-19T06:20:14.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.993+0000 7ff15d3f1640 1 --2- 172.21.15.2:0/2882976411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6081e7dc0 0x55a608209ca0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7ff148001eb0 tx=0x7ff14802a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=723cba2198ceaf9b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:14.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.993+0000 7ff1437fe640 1 -- 172.21.15.2:0/2882976411 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff148050040 con 0x55a6081e7dc0 2024-09-19T06:20:14.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.993+0000 7ff1437fe640 1 -- 172.21.15.2:0/2882976411 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff1480037f0 con 0x55a6081e7dc0 2024-09-19T06:20:14.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.993+0000 7ff1437fe640 1 -- 172.21.15.2:0/2882976411 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14803f040 con 0x55a6081e7dc0 2024-09-19T06:20:14.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.993+0000 7ff16222f740 1 -- 172.21.15.2:0/2882976411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6081e7dc0 msgr2=0x55a608209ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:14.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.993+0000 7ff16222f740 1 --2- 172.21.15.2:0/2882976411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6081e7dc0 0x55a608209ca0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7ff148001eb0 tx=0x7ff14802a480 comp rx=0 tx=0).stop 2024-09-19T06:20:14.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.993+0000 7ff16222f740 1 -- 172.21.15.2:0/2882976411 shutdown_connections 2024-09-19T06:20:14.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.993+0000 7ff16222f740 1 --2- 172.21.15.2:0/2882976411 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a6081f2680 0x55a60820a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:14.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.993+0000 7ff16222f740 1 --2- 172.21.15.2:0/2882976411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6081e7dc0 0x55a608209ca0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:14.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.993+0000 7ff16222f740 1 --2- 172.21.15.2:0/2882976411 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a6081e74a0 0x55a6081fe4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:14.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.993+0000 7ff16222f740 1 -- 172.21.15.2:0/2882976411 >> 172.21.15.2:0/2882976411 conn(0x55a6081e3a30 msgr2=0x55a6081f1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:14.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.994+0000 7ff16222f740 1 -- 172.21.15.2:0/2882976411 shutdown_connections 2024-09-19T06:20:14.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.994+0000 7ff16222f740 1 -- 172.21.15.2:0/2882976411 wait complete. 2024-09-19T06:20:14.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.994+0000 7ff16222f740 1 -- start start 2024-09-19T06:20:14.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.994+0000 7ff16222f740 1 Processor -- start 2024-09-19T06:20:14.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.994+0000 7ff16222f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a6081e74a0 0x55a6081f6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:14.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.994+0000 7ff16222f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6081e7dc0 0x55a6081f7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:14.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.994+0000 7ff16222f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a6081f2680 0x55a60826bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:14.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.994+0000 7ff16222f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff1581abe20 con 0x55a6081e7dc0 2024-09-19T06:20:14.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.994+0000 7ff16222f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff1581ad290 con 0x55a6081e74a0 2024-09-19T06:20:14.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.994+0000 7ff16222f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff1581ac4f0 con 0x55a6081f2680 2024-09-19T06:20:14.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.994+0000 7ff16222f740 10 client.0 _ll_register_callbacks cb 0x7ff148009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:14.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.994+0000 7ff15d3f1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6081e7dc0 0x55a6081f7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:14.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.994+0000 7ff15d3f1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6081e7dc0 0x55a6081f7010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46164/0 (socket says 172.21.15.2:46164) 2024-09-19T06:20:14.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.994+0000 7ff15d3f1640 1 -- 172.21.15.2:0/3441722633 learned_addr learned my addr 172.21.15.2:0/3441722633 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:14.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.994+0000 7ff15e3f3640 1 --2- 172.21.15.2:0/3441722633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a6081e74a0 0x55a6081f6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:14.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.995+0000 7ff15e3f3640 1 --2- 172.21.15.2:0/3441722633 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a6081f2680 0x55a60826bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:14.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.995+0000 7ff15d3f1640 1 -- 172.21.15.2:0/3441722633 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a6081f2680 msgr2=0x55a60826bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:14.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.995+0000 7ff15d3f1640 1 --2- 172.21.15.2:0/3441722633 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a6081f2680 0x55a60826bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:14.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.995+0000 7ff15d3f1640 1 -- 172.21.15.2:0/3441722633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a6081e74a0 msgr2=0x55a6081f6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:14.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.995+0000 7ff15d3f1640 1 --2- 172.21.15.2:0/3441722633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a6081e74a0 0x55a6081f6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:14.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.995+0000 7ff15d3f1640 1 -- 172.21.15.2:0/3441722633 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a60826c1e0 con 0x55a6081e7dc0 2024-09-19T06:20:14.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.995+0000 7ff15d3f1640 1 --2- 172.21.15.2:0/3441722633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6081e7dc0 0x55a6081f7010 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7ff148004df0 tx=0x7ff1480042d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=628d2a55b979aa8c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:14.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.995+0000 7ff1417fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:14.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.995+0000 7ff1417fa640 1 -- 172.21.15.2:0/3441722633 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14803f070 con 0x55a6081e7dc0 2024-09-19T06:20:14.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.995+0000 7ff1417fa640 1 -- 172.21.15.2:0/3441722633 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7ff1480048c0 con 0x55a6081e7dc0 2024-09-19T06:20:14.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.995+0000 7ff16222f740 1 -- 172.21.15.2:0/3441722633 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1480037f0 con 0x55a6081e7dc0 2024-09-19T06:20:14.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.995+0000 7ff1417fa640 1 -- 172.21.15.2:0/3441722633 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff148050040 con 0x55a6081e7dc0 2024-09-19T06:20:14.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.995+0000 7ff16222f740 10 client.16722 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:14.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.995+0000 7ff16222f740 1 -- 172.21.15.2:0/3441722633 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a60826d4d0 con 0x55a6081e7dc0 2024-09-19T06:20:14.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.996+0000 7ff1417fa640 1 -- 172.21.15.2:0/3441722633 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff1480037f0 con 0x55a6081e7dc0 2024-09-19T06:20:14.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.996+0000 7ff1417fa640 1 -- 172.21.15.2:0/3441722633 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7ff148005470 con 0x55a6081e7dc0 2024-09-19T06:20:14.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.996+0000 7ff16222f740 10 client.16722 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:14.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.996+0000 7ff16222f740 10 client.16722 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:14.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.996+0000 7ff16222f740 20 client.16722 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:14.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.996+0000 7ff16222f740 1 --2- 172.21.15.2:0/3441722633 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a60826db40 0x55a60826ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:14.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.996+0000 7ff16222f740 4 client.16722 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:20:14.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.996+0000 7ff16222f740 1 -- 172.21.15.2:0/3441722633 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a608154d60 con 0x55a60826db40 2024-09-19T06:20:14.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.996+0000 7ff15e3f3640 1 --2- 172.21.15.2:0/3441722633 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a60826db40 0x55a60826ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:14.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.996+0000 7ff15e3f3640 1 --2- 172.21.15.2:0/3441722633 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a60826db40 0x55a60826ff60 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73f351948716519b server_cookie=44ec7e44f0fb1c3e in_seq=0 out_seq=0 2024-09-19T06:20:14.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.996+0000 7ff1417fa640 10 client.16722 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:14.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.997+0000 7ff1417fa640 1 -- 172.21.15.2:0/3441722633 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a608154d60 con 0x55a60826db40 2024-09-19T06:20:14.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.997+0000 7ff1417fa640 10 client.16722 handle_command_reply: tid=0 2024-09-19T06:20:14.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.997+0000 7ff16222f740 1 client.16722 shutdown 2024-09-19T06:20:14.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.997+0000 7ff16222f740 1 -- 172.21.15.2:0/3441722633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6081e7dc0 msgr2=0x55a6081f7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:14.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.997+0000 7ff16222f740 1 --2- 172.21.15.2:0/3441722633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6081e7dc0 0x55a6081f7010 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7ff148004df0 tx=0x7ff1480042d0 comp rx=0 tx=0).stop 2024-09-19T06:20:14.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.997+0000 7ff16222f740 1 -- 172.21.15.2:0/3441722633 shutdown_connections 2024-09-19T06:20:14.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.997+0000 7ff16222f740 1 --2- 172.21.15.2:0/3441722633 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a6081f2680 0x55a60826bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:14.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.997+0000 7ff16222f740 1 --2- 172.21.15.2:0/3441722633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a6081e7dc0 0x55a6081f7010 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:14.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.997+0000 7ff16222f740 1 --2- 172.21.15.2:0/3441722633 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a60826db40 0x55a60826ff60 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:14.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.997+0000 7ff16222f740 1 --2- 172.21.15.2:0/3441722633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a6081e74a0 0x55a6081f6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:14.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.997+0000 7ff16222f740 1 -- 172.21.15.2:0/3441722633 >> 172.21.15.2:0/3441722633 conn(0x55a6081e3a30 msgr2=0x55a6081e2350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:14.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.997+0000 7ff1417fa640 0 client.16722 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:14.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.997+0000 7ff16222f740 1 -- 172.21.15.2:0/3441722633 shutdown_connections 2024-09-19T06:20:14.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.997+0000 7ff16222f740 1 -- 172.21.15.2:0/3441722633 wait complete. 2024-09-19T06:20:14.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.997+0000 7ff16222f740 20 client.16722 trim_cache size 0 max 16384 2024-09-19T06:20:14.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.997+0000 7ff15fe56640 1 -- 172.21.15.2:0/1937114374 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff1440a3430 msgr2=0x7ff1440a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:14.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.997+0000 7ff15fe56640 1 --2- 172.21.15.2:0/1937114374 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff1440a3430 0x7ff1440a58f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff1540cc8f0 tx=0x7ff154097040 comp rx=0 tx=0).stop 2024-09-19T06:20:14.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.997+0000 7ff15fe56640 1 -- 172.21.15.2:0/1937114374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff158100e20 msgr2=0x7ff1581992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:14.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.997+0000 7ff15fe56640 1 --2- 172.21.15.2:0/1937114374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff158100e20 0x7ff1581992e0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7ff15400b4a0 tx=0x7ff15400b960 comp rx=0 tx=0).stop 2024-09-19T06:20:14.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.998+0000 7ff15fe56640 1 -- 172.21.15.2:0/1937114374 shutdown_connections 2024-09-19T06:20:14.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.998+0000 7ff15fe56640 1 --2- 172.21.15.2:0/1937114374 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff1440a3430 0x7ff1440a58f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:14.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.998+0000 7ff15fe56640 1 --2- 172.21.15.2:0/1937114374 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff158102ef0 0x7ff1581a4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:14.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.998+0000 7ff15fe56640 1 --2- 172.21.15.2:0/1937114374 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff158102570 0x7ff158199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:14.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.998+0000 7ff15fe56640 1 --2- 172.21.15.2:0/1937114374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff158100e20 0x7ff1581992e0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:14.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.998+0000 7ff15fe56640 1 -- 172.21.15.2:0/1937114374 >> 172.21.15.2:0/1937114374 conn(0x7ff1580fc7d0 msgr2=0x7ff1580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:14.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.998+0000 7ff15fe56640 1 -- 172.21.15.2:0/1937114374 shutdown_connections 2024-09-19T06:20:14.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:13.998+0000 7ff15fe56640 1 -- 172.21.15.2:0/1937114374 wait complete. 2024-09-19T06:20:14.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:13 smithi002 ceph-mon[30982]: pgmap v165: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-19T06:20:14.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:13 smithi002 ceph-mon[30982]: scrub queued for path: / 2024-09-19T06:20:14.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:13 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:14.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:13 smithi002 ceph-mon[30982]: scrub summary: active paths [/] 2024-09-19T06:20:14.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:13 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:14.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:13 smithi002 ceph-mon[30982]: scrub summary: idle 2024-09-19T06:20:14.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:13 smithi090 ceph-mon[34497]: pgmap v165: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-19T06:20:14.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:13 smithi090 ceph-mon[34497]: scrub queued for path: / 2024-09-19T06:20:14.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:13 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:14.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:13 smithi090 ceph-mon[34497]: scrub summary: active paths [/] 2024-09-19T06:20:14.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:13 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:14.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:13 smithi090 ceph-mon[34497]: scrub summary: idle 2024-09-19T06:20:14.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:13 smithi089 ceph-mon[34160]: pgmap v165: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-19T06:20:14.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:13 smithi089 ceph-mon[34160]: scrub queued for path: / 2024-09-19T06:20:14.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:13 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:14.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:13 smithi089 ceph-mon[34160]: scrub summary: active paths [/] 2024-09-19T06:20:14.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:13 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:14.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:13 smithi089 ceph-mon[34160]: scrub summary: idle 2024-09-19T06:20:14.897 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:20:14.897 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:20:15.161 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:15.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.626+0000 7f1249923640 1 -- 172.21.15.2:0/4132676665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1244103660 msgr2=0x7f124410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:15.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.626+0000 7f1249923640 1 --2- 172.21.15.2:0/4132676665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1244103660 0x7f124410bb50 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f1238009900 tx=0x7f123802a480 comp rx=0 tx=0).stop 2024-09-19T06:20:15.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.627+0000 7f1249923640 1 -- 172.21.15.2:0/4132676665 shutdown_connections 2024-09-19T06:20:15.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.627+0000 7f1249923640 1 --2- 172.21.15.2:0/4132676665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f124410c170 0x7f124410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:15.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.627+0000 7f1249923640 1 --2- 172.21.15.2:0/4132676665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1244103660 0x7f124410bb50 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:15.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.627+0000 7f1249923640 1 --2- 172.21.15.2:0/4132676665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1244102d40 0x7f1244103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:15.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.627+0000 7f1249923640 1 -- 172.21.15.2:0/4132676665 >> 172.21.15.2:0/4132676665 conn(0x7f12440fc7a0 msgr2=0x7f12440febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:15.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.627+0000 7f1249923640 1 -- 172.21.15.2:0/4132676665 shutdown_connections 2024-09-19T06:20:15.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.627+0000 7f1249923640 1 -- 172.21.15.2:0/4132676665 wait complete. 2024-09-19T06:20:15.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.627+0000 7f1249923640 1 Processor -- start 2024-09-19T06:20:15.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.627+0000 7f1249923640 1 -- start start 2024-09-19T06:20:15.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.628+0000 7f1249923640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1244102d40 0x7f12441983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:15.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.628+0000 7f1249923640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1244103660 0x7f1244198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:15.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.628+0000 7f1249923640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f124410c170 0x7f124419cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:15.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.628+0000 7f1249923640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1244111e20 con 0x7f1244103660 2024-09-19T06:20:15.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.628+0000 7f1249923640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f1244111ca0 con 0x7f124410c170 2024-09-19T06:20:15.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.628+0000 7f1249923640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1244111fa0 con 0x7f1244102d40 2024-09-19T06:20:15.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.628+0000 7f12427fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1244103660 0x7f1244198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:15.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.628+0000 7f12427fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1244103660 0x7f1244198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60984/0 (socket says 172.21.15.2:60984) 2024-09-19T06:20:15.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.628+0000 7f12427fc640 1 -- 172.21.15.2:0/3545797362 learned_addr learned my addr 172.21.15.2:0/3545797362 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:15.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.628+0000 7f1242ffd640 1 --2- 172.21.15.2:0/3545797362 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1244102d40 0x7f12441983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:15.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.628+0000 7f12437fe640 1 --2- 172.21.15.2:0/3545797362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f124410c170 0x7f124419cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:15.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.628+0000 7f12427fc640 1 -- 172.21.15.2:0/3545797362 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1244102d40 msgr2=0x7f12441983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:15.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.628+0000 7f12427fc640 1 --2- 172.21.15.2:0/3545797362 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1244102d40 0x7f12441983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:15.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.628+0000 7f12427fc640 1 -- 172.21.15.2:0/3545797362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f124410c170 msgr2=0x7f124419cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:15.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.628+0000 7f12427fc640 1 --2- 172.21.15.2:0/3545797362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f124410c170 0x7f124419cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:15.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.628+0000 7f12427fc640 1 -- 172.21.15.2:0/3545797362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f124419d370 con 0x7f1244103660 2024-09-19T06:20:15.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.628+0000 7f12427fc640 1 --2- 172.21.15.2:0/3545797362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1244103660 0x7f1244198900 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f1238005940 tx=0x7f12380042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:15.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.629+0000 7f1248921640 1 -- 172.21.15.2:0/3545797362 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123803f030 con 0x7f1244103660 2024-09-19T06:20:15.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.629+0000 7f1249923640 1 -- 172.21.15.2:0/3545797362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f124419d600 con 0x7f1244103660 2024-09-19T06:20:15.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.629+0000 7f1248921640 1 -- 172.21.15.2:0/3545797362 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1238003cb0 con 0x7f1244103660 2024-09-19T06:20:15.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.629+0000 7f1248921640 1 -- 172.21.15.2:0/3545797362 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1238035070 con 0x7f1244103660 2024-09-19T06:20:15.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.629+0000 7f1249923640 1 -- 172.21.15.2:0/3545797362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12441a4f40 con 0x7f1244103660 2024-09-19T06:20:15.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.630+0000 7f1249923640 1 -- 172.21.15.2:0/3545797362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1244103120 con 0x7f1244103660 2024-09-19T06:20:15.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.631+0000 7f1248921640 1 -- 172.21.15.2:0/3545797362 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f1238042030 con 0x7f1244103660 2024-09-19T06:20:15.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.632+0000 7f1248921640 1 --2- 172.21.15.2:0/3545797362 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f122c0a33b0 0x7f122c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:15.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.632+0000 7f1242ffd640 1 --2- 172.21.15.2:0/3545797362 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f122c0a33b0 0x7f122c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:15.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.632+0000 7f1248921640 1 -- 172.21.15.2:0/3545797362 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f12380f0460 con 0x7f1244103660 2024-09-19T06:20:15.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.632+0000 7f1242ffd640 1 --2- 172.21.15.2:0/3545797362 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f122c0a33b0 0x7f122c0a5870 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f12340058c0 tx=0x7f123400a2d0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:15.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.636+0000 7f1248921640 1 -- 172.21.15.2:0/3545797362 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f12380bc820 con 0x7f1244103660 2024-09-19T06:20:15.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.852+0000 7f1249923640 1 -- 172.21.15.2:0/3545797362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f12441071e0 con 0x7f1244103660 2024-09-19T06:20:15.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.853+0000 7f1248921640 1 -- 172.21.15.2:0/3545797362 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11882 (secure 0 0 0) 0x7f12380c0b20 con 0x7f1244103660 2024-09-19T06:20:15.855 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:20:15.855 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-09-19T06:14:49:104280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:14:48.191083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24470,24472,24497]},"id":1}]} 2024-09-19T06:20:15.856 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-09-19T06:20:15.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.855+0000 7f1249923640 1 -- 172.21.15.2:0/3545797362 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f122c0a33b0 msgr2=0x7f122c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:15.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.855+0000 7f1249923640 1 --2- 172.21.15.2:0/3545797362 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f122c0a33b0 0x7f122c0a5870 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f12340058c0 tx=0x7f123400a2d0 comp rx=0 tx=0).stop 2024-09-19T06:20:15.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.856+0000 7f1249923640 1 -- 172.21.15.2:0/3545797362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1244103660 msgr2=0x7f1244198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:15.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.856+0000 7f1249923640 1 --2- 172.21.15.2:0/3545797362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1244103660 0x7f1244198900 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f1238005940 tx=0x7f12380042f0 comp rx=0 tx=0).stop 2024-09-19T06:20:15.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.856+0000 7f1249923640 1 -- 172.21.15.2:0/3545797362 shutdown_connections 2024-09-19T06:20:15.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.856+0000 7f1249923640 1 --2- 172.21.15.2:0/3545797362 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f122c0a33b0 0x7f122c0a5870 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:15.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.856+0000 7f1249923640 1 --2- 172.21.15.2:0/3545797362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f124410c170 0x7f124419cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:15.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.856+0000 7f1249923640 1 --2- 172.21.15.2:0/3545797362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1244103660 0x7f1244198900 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:15.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.856+0000 7f1249923640 1 --2- 172.21.15.2:0/3545797362 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1244102d40 0x7f12441983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:15.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.856+0000 7f1249923640 1 -- 172.21.15.2:0/3545797362 >> 172.21.15.2:0/3545797362 conn(0x7f12440fc7a0 msgr2=0x7f12440fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:15.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.856+0000 7f1249923640 1 -- 172.21.15.2:0/3545797362 shutdown_connections 2024-09-19T06:20:15.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:15.856+0000 7f1249923640 1 -- 172.21.15.2:0/3545797362 wait complete. 2024-09-19T06:20:16.157 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:15 smithi002 ceph-mon[30982]: pgmap v166: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-19T06:20:16.158 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:15 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/3545797362' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:20:16.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:15 smithi090 ceph-mon[34497]: pgmap v166: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-19T06:20:16.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:15 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/3545797362' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:20:16.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:15 smithi089 ceph-mon[34160]: pgmap v166: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-19T06:20:16.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:15 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/3545797362' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:20:16.473 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:20:16.736 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:17.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.142+0000 7f2fefde3640 1 -- 172.21.15.2:0/2422194887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fe8101280 msgr2=0x7f2fe810df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:17.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.142+0000 7f2fefde3640 1 --2- 172.21.15.2:0/2422194887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fe8101280 0x7f2fe810df40 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f2fd8009900 tx=0x7f2fd802a410 comp rx=0 tx=0).stop 2024-09-19T06:20:17.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.142+0000 7f2fefde3640 1 -- 172.21.15.2:0/2422194887 shutdown_connections 2024-09-19T06:20:17.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.142+0000 7f2fefde3640 1 --2- 172.21.15.2:0/2422194887 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fe810e480 0x7f2fe8110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:17.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.142+0000 7f2fefde3640 1 --2- 172.21.15.2:0/2422194887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fe8101280 0x7f2fe810df40 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:17.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.142+0000 7f2fefde3640 1 --2- 172.21.15.2:0/2422194887 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fe81008d0 0x7f2fe8100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:17.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.142+0000 7f2fefde3640 1 -- 172.21.15.2:0/2422194887 >> 172.21.15.2:0/2422194887 conn(0x7f2fe80fc7a0 msgr2=0x7f2fe80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:17.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.143+0000 7f2fefde3640 1 -- 172.21.15.2:0/2422194887 shutdown_connections 2024-09-19T06:20:17.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.143+0000 7f2fefde3640 1 -- 172.21.15.2:0/2422194887 wait complete. 2024-09-19T06:20:17.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.143+0000 7f2fefde3640 1 Processor -- start 2024-09-19T06:20:17.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.143+0000 7f2fefde3640 1 -- start start 2024-09-19T06:20:17.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.144+0000 7f2fefde3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fe81008d0 0x7f2fe819a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:17.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.144+0000 7f2fefde3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fe8101280 0x7f2fe819aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:17.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.144+0000 7f2fefde3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fe810e480 0x7f2fe819ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:17.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.144+0000 7f2fefde3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe8114050 con 0x7f2fe81008d0 2024-09-19T06:20:17.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.144+0000 7f2fefde3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe8113ed0 con 0x7f2fe8101280 2024-09-19T06:20:17.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.144+0000 7f2fefde3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe81141d0 con 0x7f2fe810e480 2024-09-19T06:20:17.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.144+0000 7f2fedb7f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fe81008d0 0x7f2fe819a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:17.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.144+0000 7f2fedb7f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fe81008d0 0x7f2fe819a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32774/0 (socket says 172.21.15.2:32774) 2024-09-19T06:20:17.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.144+0000 7f2fedb7f640 1 -- 172.21.15.2:0/1549537973 learned_addr learned my addr 172.21.15.2:0/1549537973 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:17.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.144+0000 7f2fed37e640 1 --2- 172.21.15.2:0/1549537973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fe8101280 0x7f2fe819aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:17.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.144+0000 7f2fee380640 1 --2- 172.21.15.2:0/1549537973 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fe810e480 0x7f2fe819ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:17.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.144+0000 7f2fedb7f640 1 -- 172.21.15.2:0/1549537973 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fe810e480 msgr2=0x7f2fe819ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:17.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.144+0000 7f2fedb7f640 1 --2- 172.21.15.2:0/1549537973 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fe810e480 0x7f2fe819ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:17.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.144+0000 7f2fedb7f640 1 -- 172.21.15.2:0/1549537973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fe8101280 msgr2=0x7f2fe819aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:17.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.144+0000 7f2fedb7f640 1 --2- 172.21.15.2:0/1549537973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fe8101280 0x7f2fe819aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:17.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.144+0000 7f2fedb7f640 1 -- 172.21.15.2:0/1549537973 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe819f560 con 0x7f2fe81008d0 2024-09-19T06:20:17.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.144+0000 7f2fedb7f640 1 --2- 172.21.15.2:0/1549537973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fe81008d0 0x7f2fe819a5b0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f2fe400eab0 tx=0x7f2fe400ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:17.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.144+0000 7f2fdeffd640 1 -- 172.21.15.2:0/1549537973 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe400ce40 con 0x7f2fe81008d0 2024-09-19T06:20:17.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.144+0000 7f2fdeffd640 1 -- 172.21.15.2:0/1549537973 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2fe4011920 con 0x7f2fe81008d0 2024-09-19T06:20:17.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.144+0000 7f2fdeffd640 1 -- 172.21.15.2:0/1549537973 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe4010a00 con 0x7f2fe81008d0 2024-09-19T06:20:17.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.144+0000 7f2fefde3640 1 -- 172.21.15.2:0/1549537973 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fe819f850 con 0x7f2fe81008d0 2024-09-19T06:20:17.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.145+0000 7f2fefde3640 1 -- 172.21.15.2:0/1549537973 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fe81a7130 con 0x7f2fe81008d0 2024-09-19T06:20:17.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.147+0000 7f2fdeffd640 1 -- 172.21.15.2:0/1549537973 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f2fe4011ad0 con 0x7f2fe81008d0 2024-09-19T06:20:17.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.147+0000 7f2ff21bc740 1 Processor -- start 2024-09-19T06:20:17.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.147+0000 7f2ff21bc740 1 -- start start 2024-09-19T06:20:17.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.148+0000 7f2ff21bc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b60b43b40 0x563b60b42090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:17.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.148+0000 7f2ff21bc740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563b60b425d0 0x563b60b42a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:17.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.148+0000 7f2ff21bc740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563b60b4d370 0x563b60b4f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:17.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.148+0000 7f2ff21bc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563b60aa82f0 con 0x563b60b43b40 2024-09-19T06:20:17.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.148+0000 7f2ff21bc740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563b60a4fcf0 con 0x563b60b425d0 2024-09-19T06:20:17.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.148+0000 7f2ff21bc740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x563b60aa42b0 con 0x563b60b4d370 2024-09-19T06:20:17.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.148+0000 7f2fee380640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b60b43b40 0x563b60b42090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:17.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.148+0000 7f2fdeffd640 1 --2- 172.21.15.2:0/1549537973 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f2fd40a33b0 0x7f2fd40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:17.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.148+0000 7f2fee380640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b60b43b40 0x563b60b42090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32776/0 (socket says 172.21.15.2:32776) 2024-09-19T06:20:17.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.148+0000 7f2fee380640 1 -- 172.21.15.2:0/1292565394 learned_addr learned my addr 172.21.15.2:0/1292565394 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:17.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.148+0000 7f2fee380640 1 --2- 172.21.15.2:0/1549537973 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f2fd40a33b0 0x7f2fd40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:17.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.148+0000 7f2fed37e640 1 --2- 172.21.15.2:0/1292565394 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563b60b4d370 0x563b60b4f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:17.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.148+0000 7f2fdeffd640 1 -- 172.21.15.2:0/1549537973 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f2fe40d03d0 con 0x7f2fe81008d0 2024-09-19T06:20:17.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.148+0000 7f2fedb7f640 1 --2- 172.21.15.2:0/1292565394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563b60b425d0 0x563b60b42a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:17.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.148+0000 7f2fee380640 1 -- 172.21.15.2:0/1292565394 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563b60b4d370 msgr2=0x563b60b4f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:17.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.148+0000 7f2fee380640 1 --2- 172.21.15.2:0/1292565394 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563b60b4d370 0x563b60b4f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:17.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.148+0000 7f2fee380640 1 -- 172.21.15.2:0/1292565394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563b60b425d0 msgr2=0x563b60b42a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:17.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.148+0000 7f2fee380640 1 --2- 172.21.15.2:0/1292565394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563b60b425d0 0x563b60b42a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:17.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.148+0000 7f2fee380640 1 -- 172.21.15.2:0/1292565394 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b60a343a0 con 0x563b60b43b40 2024-09-19T06:20:17.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.148+0000 7f2fee380640 1 --2- 172.21.15.2:0/1292565394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b60b43b40 0x563b60b42090 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0013630 tx=0x7f2fe0013af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be76c8aa57081158 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:17.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.149+0000 7f2fd3fff640 1 -- 172.21.15.2:0/1292565394 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe001d7c0 con 0x563b60b43b40 2024-09-19T06:20:17.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.149+0000 7f2fd3fff640 1 -- 172.21.15.2:0/1292565394 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2fe0022070 con 0x563b60b43b40 2024-09-19T06:20:17.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.149+0000 7f2fd3fff640 1 -- 172.21.15.2:0/1292565394 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe001c770 con 0x563b60b43b40 2024-09-19T06:20:17.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.149+0000 7f2ff21bc740 1 -- 172.21.15.2:0/1292565394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b60b43b40 msgr2=0x563b60b42090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:17.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.149+0000 7f2ff21bc740 1 --2- 172.21.15.2:0/1292565394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b60b43b40 0x563b60b42090 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0013630 tx=0x7f2fe0013af0 comp rx=0 tx=0).stop 2024-09-19T06:20:17.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.149+0000 7f2fee380640 1 --2- 172.21.15.2:0/1549537973 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f2fd40a33b0 0x7f2fd40a5870 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0021000 tx=0x7f2fe001f000 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:17.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.149+0000 7f2ff21bc740 1 -- 172.21.15.2:0/1292565394 shutdown_connections 2024-09-19T06:20:17.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.149+0000 7f2ff21bc740 1 --2- 172.21.15.2:0/1292565394 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563b60b4d370 0x563b60b4f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:17.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.149+0000 7f2ff21bc740 1 --2- 172.21.15.2:0/1292565394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563b60b425d0 0x563b60b42a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:17.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.149+0000 7f2ff21bc740 1 --2- 172.21.15.2:0/1292565394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b60b43b40 0x563b60b42090 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:17.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.149+0000 7f2ff21bc740 1 -- 172.21.15.2:0/1292565394 >> 172.21.15.2:0/1292565394 conn(0x563b60b0b310 msgr2=0x563b60b3ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:17.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.149+0000 7f2ff21bc740 1 -- 172.21.15.2:0/1292565394 shutdown_connections 2024-09-19T06:20:17.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.149+0000 7f2ff21bc740 1 -- 172.21.15.2:0/1292565394 wait complete. 2024-09-19T06:20:17.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.150+0000 7f2ff21bc740 1 -- start start 2024-09-19T06:20:17.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.150+0000 7f2ff21bc740 1 Processor -- start 2024-09-19T06:20:17.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.150+0000 7f2ff21bc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b60b425d0 0x563b60b4cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:17.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.150+0000 7f2ff21bc740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563b60b43b40 0x563b60b4a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:17.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.150+0000 7f2ff21bc740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563b60b4d370 0x563b60b4a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:17.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.150+0000 7f2ff21bc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563b60b50070 con 0x563b60b425d0 2024-09-19T06:20:17.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.150+0000 7f2ff21bc740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563b60a63060 con 0x563b60b4d370 2024-09-19T06:20:17.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.150+0000 7f2ff21bc740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x563b60b501f0 con 0x563b60b43b40 2024-09-19T06:20:17.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.150+0000 7f2ff21bc740 10 client.0 _ll_register_callbacks cb 0x563b607b68c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:17.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.150+0000 7f2fedb7f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b60b425d0 0x563b60b4cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:17.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.151+0000 7f2fedb7f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b60b425d0 0x563b60b4cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32778/0 (socket says 172.21.15.2:32778) 2024-09-19T06:20:17.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.151+0000 7f2fedb7f640 1 -- 172.21.15.2:0/2557808018 learned_addr learned my addr 172.21.15.2:0/2557808018 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:17.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.151+0000 7f2fee380640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563b60b4d370 0x563b60b4a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:17.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.151+0000 7f2fed37e640 1 --2- 172.21.15.2:0/2557808018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563b60b43b40 0x563b60b4a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:17.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.151+0000 7f2fee380640 1 -- 172.21.15.2:0/2557808018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563b60b43b40 msgr2=0x563b60b4a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:17.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.151+0000 7f2fee380640 1 --2- 172.21.15.2:0/2557808018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563b60b43b40 0x563b60b4a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:17.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.151+0000 7f2fee380640 1 -- 172.21.15.2:0/2557808018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b60b425d0 msgr2=0x563b60b4cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:17.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.151+0000 7f2fee380640 1 --2- 172.21.15.2:0/2557808018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b60b425d0 0x563b60b4cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:17.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.151+0000 7f2fee380640 1 -- 172.21.15.2:0/2557808018 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b608193c0 con 0x563b60b4d370 2024-09-19T06:20:17.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.151+0000 7f2fedb7f640 1 --2- 172.21.15.2:0/2557808018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b60b425d0 0x563b60b4cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:17.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.151+0000 7f2fee380640 1 --2- 172.21.15.2:0/2557808018 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563b60b4d370 0x563b60b4a650 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0011380 tx=0x7f2fe0005b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b4e5dd5deadfc4c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:17.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.151+0000 7f2fd17fa640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-09-19T06:20:17.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.151+0000 7f2fd17fa640 1 -- 172.21.15.2:0/2557808018 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe001cc40 con 0x563b60b4d370 2024-09-19T06:20:17.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.151+0000 7f2fd17fa640 1 -- 172.21.15.2:0/2557808018 <== mon.2 v2:172.21.15.89:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f2fe001cde0 con 0x563b60b4d370 2024-09-19T06:20:17.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.151+0000 7f2ff21bc740 1 -- 172.21.15.2:0/2557808018 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2fe0022070 con 0x563b60b4d370 2024-09-19T06:20:17.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.152+0000 7f2fd17fa640 1 -- 172.21.15.2:0/2557808018 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2fe001d7c0 con 0x563b60b4d370 2024-09-19T06:20:17.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.152+0000 7f2ff21bc740 10 client.26126 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:17.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.152+0000 7f2ff21bc740 1 -- 172.21.15.2:0/2557808018 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563b60b5bb40 con 0x563b60b4d370 2024-09-19T06:20:17.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.152+0000 7f2fd17fa640 1 -- 172.21.15.2:0/2557808018 <== mon.2 v2:172.21.15.89:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2fe0022070 con 0x563b60b4d370 2024-09-19T06:20:17.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.152+0000 7f2fd17fa640 1 -- 172.21.15.2:0/2557808018 <== mon.2 v2:172.21.15.89:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f2fe0004660 con 0x563b60b4d370 2024-09-19T06:20:17.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.152+0000 7f2ff21bc740 10 client.26126 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:17.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.152+0000 7f2ff21bc740 10 client.26126 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:20:17.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.152+0000 7f2ff21bc740 20 client.26126 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:17.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.152+0000 7f2ff21bc740 1 --2- 172.21.15.2:0/2557808018 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x563b60b5cf50 0x563b60b5f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:17.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.152+0000 7f2ff21bc740 4 client.26126 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:17.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.152+0000 7f2ff21bc740 1 -- 172.21.15.2:0/2557808018 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563b60ab5860 con 0x563b60b5cf50 2024-09-19T06:20:17.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.152+0000 7f2fedb7f640 1 --2- 172.21.15.2:0/2557808018 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x563b60b5cf50 0x563b60b5f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:17.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.153+0000 7f2fedb7f640 1 --2- 172.21.15.2:0/2557808018 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x563b60b5cf50 0x563b60b5f340 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d8be72e91bdde12a server_cookie=51f93c50bbea3d19 in_seq=0 out_seq=0 2024-09-19T06:20:17.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.153+0000 7f2fd17fa640 10 client.26126 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:20:17.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.153+0000 7f2fd17fa640 1 -- 172.21.15.2:0/2557808018 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563b60ab5860 con 0x563b60b5cf50 2024-09-19T06:20:17.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.153+0000 7f2fd17fa640 10 client.26126 handle_command_reply: tid=0 2024-09-19T06:20:17.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.153+0000 7f2ff21bc740 1 client.26126 shutdown 2024-09-19T06:20:17.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.153+0000 7f2ff21bc740 1 -- 172.21.15.2:0/2557808018 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563b60b4d370 msgr2=0x563b60b4a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:17.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.153+0000 7f2ff21bc740 1 --2- 172.21.15.2:0/2557808018 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563b60b4d370 0x563b60b4a650 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0011380 tx=0x7f2fe0005b90 comp rx=0 tx=0).stop 2024-09-19T06:20:17.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.154+0000 7f2ff21bc740 1 -- 172.21.15.2:0/2557808018 shutdown_connections 2024-09-19T06:20:17.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.154+0000 7f2ff21bc740 1 --2- 172.21.15.2:0/2557808018 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x563b60b5cf50 0x563b60b5f340 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:17.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.154+0000 7f2ff21bc740 1 --2- 172.21.15.2:0/2557808018 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563b60b4d370 0x563b60b4a650 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:17.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.154+0000 7f2fd17fa640 0 client.26126 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:20:17.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.154+0000 7f2ff21bc740 1 --2- 172.21.15.2:0/2557808018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563b60b43b40 0x563b60b4a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:17.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.154+0000 7f2ff21bc740 1 --2- 172.21.15.2:0/2557808018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b60b425d0 0x563b60b4cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:17.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.154+0000 7f2ff21bc740 1 -- 172.21.15.2:0/2557808018 >> 172.21.15.2:0/2557808018 conn(0x563b60b0b310 msgr2=0x563b60b44960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:17.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.154+0000 7f2ff21bc740 1 -- 172.21.15.2:0/2557808018 shutdown_connections 2024-09-19T06:20:17.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.154+0000 7f2ff21bc740 1 -- 172.21.15.2:0/2557808018 wait complete. 2024-09-19T06:20:17.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.154+0000 7f2ff21bc740 20 client.26126 trim_cache size 0 max 16384 2024-09-19T06:20:17.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.167+0000 7f2ff21bc740 1 Processor -- start 2024-09-19T06:20:17.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.167+0000 7f2ff21bc740 1 -- start start 2024-09-19T06:20:17.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.167+0000 7f2ff21bc740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563b60b425d0 0x563b60b59310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:17.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.167+0000 7f2ff21bc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b60b43b40 0x563b60b45120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:17.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.167+0000 7f2ff21bc740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563b60b4d370 0x563b60b45660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:17.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.167+0000 7f2ff21bc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe81b2270 con 0x563b60b43b40 2024-09-19T06:20:17.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.167+0000 7f2ff21bc740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe81afb40 con 0x563b60b425d0 2024-09-19T06:20:17.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.167+0000 7f2ff21bc740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe81ad990 con 0x563b60b4d370 2024-09-19T06:20:17.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.167+0000 7f2fed37e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b60b43b40 0x563b60b45120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:17.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.167+0000 7f2fed37e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b60b43b40 0x563b60b45120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32788/0 (socket says 172.21.15.2:32788) 2024-09-19T06:20:17.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.167+0000 7f2fed37e640 1 -- 172.21.15.2:0/2094773315 learned_addr learned my addr 172.21.15.2:0/2094773315 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:17.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.167+0000 7f2fedb7f640 1 --2- 172.21.15.2:0/2094773315 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563b60b425d0 0x563b60b59310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:17.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.167+0000 7f2fee380640 1 --2- 172.21.15.2:0/2094773315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563b60b4d370 0x563b60b45660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:17.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.167+0000 7f2fed37e640 1 -- 172.21.15.2:0/2094773315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563b60b4d370 msgr2=0x563b60b45660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:17.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.167+0000 7f2fed37e640 1 --2- 172.21.15.2:0/2094773315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563b60b4d370 0x563b60b45660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:17.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.167+0000 7f2fed37e640 1 -- 172.21.15.2:0/2094773315 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563b60b425d0 msgr2=0x563b60b59310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:17.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.167+0000 7f2fed37e640 1 --2- 172.21.15.2:0/2094773315 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563b60b425d0 0x563b60b59310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:17.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.167+0000 7f2fed37e640 1 -- 172.21.15.2:0/2094773315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b60b3f960 con 0x563b60b43b40 2024-09-19T06:20:17.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.168+0000 7f2fed37e640 1 --2- 172.21.15.2:0/2094773315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b60b43b40 0x563b60b45120 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f2fd8009900 tx=0x7f2fd8032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbc39001593b32b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:17.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.168+0000 7f2fd37fe640 1 -- 172.21.15.2:0/2094773315 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd8035040 con 0x563b60b43b40 2024-09-19T06:20:17.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.168+0000 7f2fd37fe640 1 -- 172.21.15.2:0/2094773315 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2fd80316a0 con 0x563b60b43b40 2024-09-19T06:20:17.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.168+0000 7f2fd37fe640 1 -- 172.21.15.2:0/2094773315 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd8004750 con 0x563b60b43b40 2024-09-19T06:20:17.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.168+0000 7f2ff21bc740 1 -- 172.21.15.2:0/2094773315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b60b43b40 msgr2=0x563b60b45120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:17.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.168+0000 7f2ff21bc740 1 --2- 172.21.15.2:0/2094773315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b60b43b40 0x563b60b45120 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f2fd8009900 tx=0x7f2fd8032dd0 comp rx=0 tx=0).stop 2024-09-19T06:20:17.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.169+0000 7f2ff21bc740 1 -- 172.21.15.2:0/2094773315 shutdown_connections 2024-09-19T06:20:17.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.169+0000 7f2ff21bc740 1 --2- 172.21.15.2:0/2094773315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563b60b4d370 0x563b60b45660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:17.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.169+0000 7f2ff21bc740 1 --2- 172.21.15.2:0/2094773315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b60b43b40 0x563b60b45120 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:17.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.169+0000 7f2ff21bc740 1 --2- 172.21.15.2:0/2094773315 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563b60b425d0 0x563b60b59310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:17.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.169+0000 7f2ff21bc740 1 -- 172.21.15.2:0/2094773315 >> 172.21.15.2:0/2094773315 conn(0x563b60b0b310 msgr2=0x563b60b49130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:17.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.169+0000 7f2ff21bc740 1 -- 172.21.15.2:0/2094773315 shutdown_connections 2024-09-19T06:20:17.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.169+0000 7f2ff21bc740 1 -- 172.21.15.2:0/2094773315 wait complete. 2024-09-19T06:20:17.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.169+0000 7f2ff21bc740 1 -- start start 2024-09-19T06:20:17.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.169+0000 7f2ff21bc740 1 Processor -- start 2024-09-19T06:20:17.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.170+0000 7f2ff21bc740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563b60b425d0 0x563b60b51130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:17.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.170+0000 7f2ff21bc740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563b60b43b40 0x563b60b51670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:17.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.170+0000 7f2ff21bc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b60b4d370 0x563b60b51bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:17.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.170+0000 7f2ff21bc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe81ae000 con 0x563b60b4d370 2024-09-19T06:20:17.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.170+0000 7f2ff21bc740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe81af470 con 0x563b60b425d0 2024-09-19T06:20:17.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.170+0000 7f2ff21bc740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe81ae6d0 con 0x563b60b43b40 2024-09-19T06:20:17.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.170+0000 7f2ff21bc740 10 client.0 _ll_register_callbacks cb 0x7f2fe0013400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:17.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.170+0000 7f2fee380640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b60b4d370 0x563b60b51bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:17.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.170+0000 7f2fedb7f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563b60b425d0 0x563b60b51130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:17.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.170+0000 7f2fee380640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b60b4d370 0x563b60b51bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32798/0 (socket says 172.21.15.2:32798) 2024-09-19T06:20:17.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.170+0000 7f2fee380640 1 -- 172.21.15.2:0/728677421 learned_addr learned my addr 172.21.15.2:0/728677421 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:17.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.170+0000 7f2fed37e640 1 --2- 172.21.15.2:0/728677421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563b60b43b40 0x563b60b51670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:17.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.170+0000 7f2fedb7f640 1 -- 172.21.15.2:0/728677421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563b60b43b40 msgr2=0x563b60b51670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:17.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.170+0000 7f2fedb7f640 1 --2- 172.21.15.2:0/728677421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563b60b43b40 0x563b60b51670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:17.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.170+0000 7f2fedb7f640 1 -- 172.21.15.2:0/728677421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b60b4d370 msgr2=0x563b60b51bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:17.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.170+0000 7f2fedb7f640 1 --2- 172.21.15.2:0/728677421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b60b4d370 0x563b60b51bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:17.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.170+0000 7f2fedb7f640 1 -- 172.21.15.2:0/728677421 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b60b3eed0 con 0x563b60b425d0 2024-09-19T06:20:17.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.170+0000 7f2fee380640 1 --2- 172.21.15.2:0/728677421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b60b4d370 0x563b60b51bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:17.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.170+0000 7f2fedb7f640 1 --2- 172.21.15.2:0/728677421 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563b60b425d0 0x563b60b51130 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2fe40cdb50 tx=0x7f2fe4000f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abb1ba7393cbbd31 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:17.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.170+0000 7f2fd17fa640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-09-19T06:20:17.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.171+0000 7f2fd17fa640 1 -- 172.21.15.2:0/728677421 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe40b4020 con 0x563b60b425d0 2024-09-19T06:20:17.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.171+0000 7f2ff21bc740 1 -- 172.21.15.2:0/728677421 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2fd80316a0 con 0x563b60b425d0 2024-09-19T06:20:17.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.171+0000 7f2fd17fa640 1 -- 172.21.15.2:0/728677421 <== mon.2 v2:172.21.15.89:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f2fe40a4e60 con 0x563b60b425d0 2024-09-19T06:20:17.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.171+0000 7f2fd17fa640 1 -- 172.21.15.2:0/728677421 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2fe40cdf70 con 0x563b60b425d0 2024-09-19T06:20:17.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.171+0000 7f2ff21bc740 10 client.26132 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:17.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.171+0000 7f2ff21bc740 1 -- 172.21.15.2:0/728677421 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563b60bc7a40 con 0x563b60b425d0 2024-09-19T06:20:17.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.171+0000 7f2fd17fa640 1 -- 172.21.15.2:0/728677421 <== mon.2 v2:172.21.15.89:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2fd80316a0 con 0x563b60b425d0 2024-09-19T06:20:17.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.171+0000 7f2fd17fa640 1 -- 172.21.15.2:0/728677421 <== mon.2 v2:172.21.15.89:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f2fe400f040 con 0x563b60b425d0 2024-09-19T06:20:17.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.171+0000 7f2ff21bc740 10 client.26132 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:17.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.171+0000 7f2ff21bc740 10 client.26132 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:20:17.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.171+0000 7f2ff21bc740 20 client.26132 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:17.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.171+0000 7f2ff21bc740 1 --2- 172.21.15.2:0/728677421 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x563b60bc8110 0x563b60bca500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:17.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.171+0000 7f2ff21bc740 4 client.26132 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:20:17.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.171+0000 7f2ff21bc740 1 -- 172.21.15.2:0/728677421 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563b60aafd70 con 0x563b60bc8110 2024-09-19T06:20:17.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.172+0000 7f2fed37e640 1 --2- 172.21.15.2:0/728677421 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x563b60bc8110 0x563b60bca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:17.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.172+0000 7f2fed37e640 1 --2- 172.21.15.2:0/728677421 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x563b60bc8110 0x563b60bca500 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5cab08e3cefea38f server_cookie=2e11749ebfb983de in_seq=0 out_seq=0 2024-09-19T06:20:17.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.172+0000 7f2fd17fa640 10 client.26132 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:20:17.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.172+0000 7f2fd17fa640 1 -- 172.21.15.2:0/728677421 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563b60aafd70 con 0x563b60bc8110 2024-09-19T06:20:17.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.172+0000 7f2fd17fa640 10 client.26132 handle_command_reply: tid=0 2024-09-19T06:20:17.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.172+0000 7f2ff21bc740 1 client.26132 shutdown 2024-09-19T06:20:17.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.172+0000 7f2ff21bc740 1 -- 172.21.15.2:0/728677421 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563b60b425d0 msgr2=0x563b60b51130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:17.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.172+0000 7f2ff21bc740 1 --2- 172.21.15.2:0/728677421 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563b60b425d0 0x563b60b51130 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2fe40cdb50 tx=0x7f2fe4000f40 comp rx=0 tx=0).stop 2024-09-19T06:20:17.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.172+0000 7f2ff21bc740 1 -- 172.21.15.2:0/728677421 shutdown_connections 2024-09-19T06:20:17.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.172+0000 7f2ff21bc740 1 --2- 172.21.15.2:0/728677421 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x563b60bc8110 0x563b60bca500 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:17.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.172+0000 7f2ff21bc740 1 --2- 172.21.15.2:0/728677421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563b60b4d370 0x563b60b51bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:17.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.172+0000 7f2ff21bc740 1 --2- 172.21.15.2:0/728677421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563b60b43b40 0x563b60b51670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:17.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.172+0000 7f2fd17fa640 0 client.26132 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:20:17.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.172+0000 7f2ff21bc740 1 --2- 172.21.15.2:0/728677421 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563b60b425d0 0x563b60b51130 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:17.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.172+0000 7f2ff21bc740 1 -- 172.21.15.2:0/728677421 >> 172.21.15.2:0/728677421 conn(0x563b60b0b310 msgr2=0x563b60b4b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:17.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.173+0000 7f2ff21bc740 1 -- 172.21.15.2:0/728677421 shutdown_connections 2024-09-19T06:20:17.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.173+0000 7f2ff21bc740 1 -- 172.21.15.2:0/728677421 wait complete. 2024-09-19T06:20:17.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.173+0000 7f2ff21bc740 20 client.26132 trim_cache size 0 max 16384 2024-09-19T06:20:17.190 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:20:17.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.173+0000 7f2fefde3640 1 -- 172.21.15.2:0/1549537973 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f2fd40a33b0 msgr2=0x7f2fd40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:17.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.173+0000 7f2fefde3640 1 --2- 172.21.15.2:0/1549537973 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f2fd40a33b0 0x7f2fd40a5870 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0021000 tx=0x7f2fe001f000 comp rx=0 tx=0).stop 2024-09-19T06:20:17.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.173+0000 7f2fefde3640 1 -- 172.21.15.2:0/1549537973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fe81008d0 msgr2=0x7f2fe819a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:17.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.173+0000 7f2fefde3640 1 --2- 172.21.15.2:0/1549537973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fe81008d0 0x7f2fe819a5b0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f2fe400eab0 tx=0x7f2fe400ef70 comp rx=0 tx=0).stop 2024-09-19T06:20:17.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.173+0000 7f2fefde3640 1 -- 172.21.15.2:0/1549537973 shutdown_connections 2024-09-19T06:20:17.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.173+0000 7f2fefde3640 1 --2- 172.21.15.2:0/1549537973 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f2fd40a33b0 0x7f2fd40a5870 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:17.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.173+0000 7f2fefde3640 1 --2- 172.21.15.2:0/1549537973 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fe810e480 0x7f2fe819ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:17.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.173+0000 7f2fefde3640 1 --2- 172.21.15.2:0/1549537973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fe8101280 0x7f2fe819aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:17.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.173+0000 7f2fefde3640 1 --2- 172.21.15.2:0/1549537973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fe81008d0 0x7f2fe819a5b0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:17.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.173+0000 7f2fefde3640 1 -- 172.21.15.2:0/1549537973 >> 172.21.15.2:0/1549537973 conn(0x7f2fe80fc7a0 msgr2=0x7f2fe80feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:17.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.173+0000 7f2fefde3640 1 -- 172.21.15.2:0/1549537973 shutdown_connections 2024-09-19T06:20:17.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:17.173+0000 7f2fefde3640 1 -- 172.21.15.2:0/1549537973 wait complete. 2024-09-19T06:20:17.807 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:20:18.067 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:18.188 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:17 smithi002 ceph-mon[30982]: pgmap v167: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-19T06:20:18.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:17 smithi090 ceph-mon[34497]: pgmap v167: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-19T06:20:18.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:17 smithi089 ceph-mon[34160]: pgmap v167: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-19T06:20:18.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.495+0000 7f9313784640 1 -- 172.21.15.2:0/3725631192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f930c104e80 msgr2=0x7f930c105330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:18.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.495+0000 7f9313784640 1 --2- 172.21.15.2:0/3725631192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f930c104e80 0x7f930c105330 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f92fc009900 tx=0x7f92fc02a410 comp rx=0 tx=0).stop 2024-09-19T06:20:18.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.495+0000 7f9313784640 1 -- 172.21.15.2:0/3725631192 shutdown_connections 2024-09-19T06:20:18.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.495+0000 7f9313784640 1 --2- 172.21.15.2:0/3725631192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f930c104e80 0x7f930c105330 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:18.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.495+0000 7f9313784640 1 --2- 172.21.15.2:0/3725631192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f930c06a370 0x7f930c1009c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:18.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.495+0000 7f9313784640 1 --2- 172.21.15.2:0/3725631192 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f930c069f00 0x7f930c100480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:18.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.495+0000 7f9313784640 1 -- 172.21.15.2:0/3725631192 >> 172.21.15.2:0/3725631192 conn(0x7f930c077210 msgr2=0x7f930c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:18.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.495+0000 7f9313784640 1 -- 172.21.15.2:0/3725631192 shutdown_connections 2024-09-19T06:20:18.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.495+0000 7f9313784640 1 -- 172.21.15.2:0/3725631192 wait complete. 2024-09-19T06:20:18.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.496+0000 7f9313784640 1 Processor -- start 2024-09-19T06:20:18.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.496+0000 7f9313784640 1 -- start start 2024-09-19T06:20:18.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.496+0000 7f9313784640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f930c069f00 0x7f930c198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:18.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.496+0000 7f9313784640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f930c06a370 0x7f930c1987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:18.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.496+0000 7f9313784640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f930c104e80 0x7f930c19cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:18.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.496+0000 7f9313784640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f930c110d60 con 0x7f930c104e80 2024-09-19T06:20:18.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.496+0000 7f9313784640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f930c110be0 con 0x7f930c06a370 2024-09-19T06:20:18.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.496+0000 7f9313784640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f930c110ee0 con 0x7f930c069f00 2024-09-19T06:20:18.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.496+0000 7f9311d21640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f930c104e80 0x7f930c19cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:18.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.496+0000 7f9311d21640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f930c104e80 0x7f930c19cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32824/0 (socket says 172.21.15.2:32824) 2024-09-19T06:20:18.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.496+0000 7f9311d21640 1 -- 172.21.15.2:0/1883226909 learned_addr learned my addr 172.21.15.2:0/1883226909 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:18.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.496+0000 7f9310d1f640 1 --2- 172.21.15.2:0/1883226909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f930c06a370 0x7f930c1987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:18.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.496+0000 7f9311520640 1 --2- 172.21.15.2:0/1883226909 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f930c069f00 0x7f930c198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:18.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.497+0000 7f9311d21640 1 -- 172.21.15.2:0/1883226909 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f930c069f00 msgr2=0x7f930c198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:18.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.497+0000 7f9311d21640 1 --2- 172.21.15.2:0/1883226909 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f930c069f00 0x7f930c198280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:18.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.497+0000 7f9311d21640 1 -- 172.21.15.2:0/1883226909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f930c06a370 msgr2=0x7f930c1987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:18.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.497+0000 7f9311d21640 1 --2- 172.21.15.2:0/1883226909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f930c06a370 0x7f930c1987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:18.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.497+0000 7f9311d21640 1 -- 172.21.15.2:0/1883226909 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f930c19d230 con 0x7f930c104e80 2024-09-19T06:20:18.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.497+0000 7f9311d21640 1 --2- 172.21.15.2:0/1883226909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f930c104e80 0x7f930c19cb50 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f92fc009a20 tx=0x7f92fc0042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:18.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.497+0000 7f930a7fc640 1 -- 172.21.15.2:0/1883226909 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92fc03f030 con 0x7f930c104e80 2024-09-19T06:20:18.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.497+0000 7f9313784640 1 -- 172.21.15.2:0/1883226909 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f930c19d4c0 con 0x7f930c104e80 2024-09-19T06:20:18.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.497+0000 7f930a7fc640 1 -- 172.21.15.2:0/1883226909 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f92fc0044d0 con 0x7f930c104e80 2024-09-19T06:20:18.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.497+0000 7f930a7fc640 1 -- 172.21.15.2:0/1883226909 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92fc035070 con 0x7f930c104e80 2024-09-19T06:20:18.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.497+0000 7f9313784640 1 -- 172.21.15.2:0/1883226909 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f930c1029a0 con 0x7f930c104e80 2024-09-19T06:20:18.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.499+0000 7f930a7fc640 1 -- 172.21.15.2:0/1883226909 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f92fc042030 con 0x7f930c104e80 2024-09-19T06:20:18.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.500+0000 7f9315b5d740 1 Processor -- start 2024-09-19T06:20:18.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.500+0000 7f9315b5d740 1 -- start start 2024-09-19T06:20:18.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.500+0000 7f9315b5d740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca02ba3b40 0x55ca02ba2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:18.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.500+0000 7f9315b5d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca02ba25d0 0x55ca02ba2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:18.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.500+0000 7f9315b5d740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca02bad370 0x55ca02baf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:18.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.500+0000 7f9315b5d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ca02b082f0 con 0x55ca02ba25d0 2024-09-19T06:20:18.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.500+0000 7f9315b5d740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55ca02aafcf0 con 0x55ca02ba3b40 2024-09-19T06:20:18.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.500+0000 7f9315b5d740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55ca02b042b0 con 0x55ca02bad370 2024-09-19T06:20:18.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.500+0000 7f9311520640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca02ba25d0 0x55ca02ba2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:18.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.500+0000 7f9311520640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca02ba25d0 0x55ca02ba2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32836/0 (socket says 172.21.15.2:32836) 2024-09-19T06:20:18.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.500+0000 7f9311520640 1 -- 172.21.15.2:0/3959998877 learned_addr learned my addr 172.21.15.2:0/3959998877 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:18.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.500+0000 7f930a7fc640 1 --2- 172.21.15.2:0/1883226909 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f92f40a33b0 0x7f92f40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:18.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.500+0000 7f9310d1f640 1 --2- 172.21.15.2:0/3959998877 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca02bad370 0x55ca02baf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:18.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.501+0000 7f9310d1f640 1 --2- 172.21.15.2:0/3959998877 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca02ba3b40 0x55ca02ba2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:18.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.501+0000 7f9311d21640 1 --2- 172.21.15.2:0/1883226909 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f92f40a33b0 0x7f92f40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:18.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.501+0000 7f9311520640 1 -- 172.21.15.2:0/3959998877 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca02bad370 msgr2=0x55ca02baf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:18.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.501+0000 7f9311520640 1 --2- 172.21.15.2:0/3959998877 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca02bad370 0x55ca02baf760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:18.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.501+0000 7f9311520640 1 -- 172.21.15.2:0/3959998877 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca02ba3b40 msgr2=0x55ca02ba2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:18.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.501+0000 7f9311520640 1 --2- 172.21.15.2:0/3959998877 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca02ba3b40 0x55ca02ba2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:18.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.501+0000 7f9311520640 1 -- 172.21.15.2:0/3959998877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca02a943a0 con 0x55ca02ba25d0 2024-09-19T06:20:18.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.501+0000 7f9310d1f640 1 --2- 172.21.15.2:0/3959998877 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca02ba3b40 0x55ca02ba2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:18.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.501+0000 7f930a7fc640 1 -- 172.21.15.2:0/1883226909 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f92fc0f05d0 con 0x7f930c104e80 2024-09-19T06:20:18.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.501+0000 7f9311520640 1 --2- 172.21.15.2:0/3959998877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca02ba25d0 0x55ca02ba2a10 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f9304007f90 tx=0x7f930400f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e88e804229218 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:18.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.501+0000 7f9311d21640 1 --2- 172.21.15.2:0/1883226909 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f92f40a33b0 0x7f92f40a5870 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f92fc0bc920 tx=0x7f92fc08b680 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:18.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.501+0000 7f92f37fe640 1 -- 172.21.15.2:0/3959998877 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9304004d20 con 0x55ca02ba25d0 2024-09-19T06:20:18.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.501+0000 7f92f37fe640 1 -- 172.21.15.2:0/3959998877 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9304010bb0 con 0x55ca02ba25d0 2024-09-19T06:20:18.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.501+0000 7f92f37fe640 1 -- 172.21.15.2:0/3959998877 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9304005720 con 0x55ca02ba25d0 2024-09-19T06:20:18.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.502+0000 7f9315b5d740 1 -- 172.21.15.2:0/3959998877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca02ba25d0 msgr2=0x55ca02ba2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:18.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.502+0000 7f9315b5d740 1 --2- 172.21.15.2:0/3959998877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca02ba25d0 0x55ca02ba2a10 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f9304007f90 tx=0x7f930400f850 comp rx=0 tx=0).stop 2024-09-19T06:20:18.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.502+0000 7f9315b5d740 1 -- 172.21.15.2:0/3959998877 shutdown_connections 2024-09-19T06:20:18.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.502+0000 7f9315b5d740 1 --2- 172.21.15.2:0/3959998877 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca02bad370 0x55ca02baf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:18.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.502+0000 7f9315b5d740 1 --2- 172.21.15.2:0/3959998877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca02ba25d0 0x55ca02ba2a10 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:18.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.502+0000 7f9315b5d740 1 --2- 172.21.15.2:0/3959998877 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca02ba3b40 0x55ca02ba2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:18.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.502+0000 7f9315b5d740 1 -- 172.21.15.2:0/3959998877 >> 172.21.15.2:0/3959998877 conn(0x55ca02b6b310 msgr2=0x55ca02b9ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:18.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.502+0000 7f9315b5d740 1 -- 172.21.15.2:0/3959998877 shutdown_connections 2024-09-19T06:20:18.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.502+0000 7f9315b5d740 1 -- 172.21.15.2:0/3959998877 wait complete. 2024-09-19T06:20:18.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.502+0000 7f9315b5d740 1 -- start start 2024-09-19T06:20:18.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.502+0000 7f9315b5d740 1 Processor -- start 2024-09-19T06:20:18.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.503+0000 7f9315b5d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca02ba25d0 0x55ca02bacd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:18.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.503+0000 7f9315b5d740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca02ba3b40 0x55ca02ba9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:18.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.503+0000 7f9315b5d740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca02bad370 0x55ca02baa5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:18.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.503+0000 7f9315b5d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ca02bb0070 con 0x55ca02ba25d0 2024-09-19T06:20:18.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.503+0000 7f9315b5d740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55ca02ac3060 con 0x55ca02ba3b40 2024-09-19T06:20:18.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.503+0000 7f9315b5d740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55ca02bb01f0 con 0x55ca02bad370 2024-09-19T06:20:18.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.503+0000 7f9315b5d740 10 client.0 _ll_register_callbacks cb 0x55ca028168c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:18.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.503+0000 7f9310d1f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca02ba25d0 0x55ca02bacd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:18.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.503+0000 7f9310d1f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca02ba25d0 0x55ca02bacd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32846/0 (socket says 172.21.15.2:32846) 2024-09-19T06:20:18.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.503+0000 7f9310d1f640 1 -- 172.21.15.2:0/2272719538 learned_addr learned my addr 172.21.15.2:0/2272719538 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:18.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.503+0000 7f9311520640 1 --2- 172.21.15.2:0/2272719538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca02ba3b40 0x55ca02ba9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:18.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.503+0000 7f9310d1f640 1 -- 172.21.15.2:0/2272719538 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca02bad370 msgr2=0x55ca02baa5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:18.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.503+0000 7f9310d1f640 1 --2- 172.21.15.2:0/2272719538 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca02bad370 0x55ca02baa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:18.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.503+0000 7f9310d1f640 1 -- 172.21.15.2:0/2272719538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca02ba3b40 msgr2=0x55ca02ba9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:18.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.503+0000 7f9310d1f640 1 --2- 172.21.15.2:0/2272719538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca02ba3b40 0x55ca02ba9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:18.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.503+0000 7f9310d1f640 1 -- 172.21.15.2:0/2272719538 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca028793c0 con 0x55ca02ba25d0 2024-09-19T06:20:18.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.503+0000 7f9311520640 1 --2- 172.21.15.2:0/2272719538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca02ba3b40 0x55ca02ba9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:20:18.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.504+0000 7f9310d1f640 1 --2- 172.21.15.2:0/2272719538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca02ba25d0 0x55ca02bacd40 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f9300013a60 tx=0x7f9300013f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f22b45622506fede server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:18.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.504+0000 7f92f0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:18.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.504+0000 7f92f0ff9640 1 -- 172.21.15.2:0/2272719538 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f930000fca0 con 0x55ca02ba25d0 2024-09-19T06:20:18.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.504+0000 7f92f0ff9640 1 -- 172.21.15.2:0/2272719538 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f930000fe40 con 0x55ca02ba25d0 2024-09-19T06:20:18.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.504+0000 7f9315b5d740 1 -- 172.21.15.2:0/2272719538 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9304010bb0 con 0x55ca02ba25d0 2024-09-19T06:20:18.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.504+0000 7f92f0ff9640 1 -- 172.21.15.2:0/2272719538 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9300005020 con 0x55ca02ba25d0 2024-09-19T06:20:18.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.504+0000 7f9315b5d740 10 client.16758 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:18.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.504+0000 7f9315b5d740 1 -- 172.21.15.2:0/2272719538 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ca02bbbb40 con 0x55ca02ba25d0 2024-09-19T06:20:18.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.504+0000 7f92f0ff9640 1 -- 172.21.15.2:0/2272719538 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9304010bb0 con 0x55ca02ba25d0 2024-09-19T06:20:18.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.504+0000 7f92f0ff9640 1 -- 172.21.15.2:0/2272719538 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f930001b070 con 0x55ca02ba25d0 2024-09-19T06:20:18.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.504+0000 7f9315b5d740 10 client.16758 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:18.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.504+0000 7f9315b5d740 10 client.16758 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:20:18.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.504+0000 7f9315b5d740 20 client.16758 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:18.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.504+0000 7f9315b5d740 1 --2- 172.21.15.2:0/2272719538 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55ca02bbd000 0x55ca02bbf450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:18.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.504+0000 7f9315b5d740 4 client.16758 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:18.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.504+0000 7f9315b5d740 1 -- 172.21.15.2:0/2272719538 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca02b15860 con 0x55ca02bbd000 2024-09-19T06:20:18.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.505+0000 7f9311520640 1 --2- 172.21.15.2:0/2272719538 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55ca02bbd000 0x55ca02bbf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:18.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.505+0000 7f9311520640 1 --2- 172.21.15.2:0/2272719538 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55ca02bbd000 0x55ca02bbf450 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4828303cec4e793f server_cookie=8e28661cc3f07719 in_seq=0 out_seq=0 2024-09-19T06:20:18.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.505+0000 7f92f0ff9640 10 client.16758 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:20:18.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.506+0000 7f92f0ff9640 1 -- 172.21.15.2:0/2272719538 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ca02b15860 con 0x55ca02bbd000 2024-09-19T06:20:18.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.506+0000 7f92f0ff9640 10 client.16758 handle_command_reply: tid=0 2024-09-19T06:20:18.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.506+0000 7f9315b5d740 1 client.16758 shutdown 2024-09-19T06:20:18.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.506+0000 7f9315b5d740 1 -- 172.21.15.2:0/2272719538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca02ba25d0 msgr2=0x55ca02bacd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:18.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.506+0000 7f9315b5d740 1 --2- 172.21.15.2:0/2272719538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca02ba25d0 0x55ca02bacd40 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f9300013a60 tx=0x7f9300013f20 comp rx=0 tx=0).stop 2024-09-19T06:20:18.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.506+0000 7f9315b5d740 1 -- 172.21.15.2:0/2272719538 shutdown_connections 2024-09-19T06:20:18.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.506+0000 7f9315b5d740 1 --2- 172.21.15.2:0/2272719538 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55ca02bbd000 0x55ca02bbf450 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:18.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.506+0000 7f9315b5d740 1 --2- 172.21.15.2:0/2272719538 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca02bad370 0x55ca02baa5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:18.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.506+0000 7f9315b5d740 1 --2- 172.21.15.2:0/2272719538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca02ba3b40 0x55ca02ba9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:18.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.506+0000 7f9315b5d740 1 --2- 172.21.15.2:0/2272719538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca02ba25d0 0x55ca02bacd40 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:18.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.506+0000 7f9315b5d740 1 -- 172.21.15.2:0/2272719538 >> 172.21.15.2:0/2272719538 conn(0x55ca02b6b310 msgr2=0x55ca02ba4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:18.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.506+0000 7f92f0ff9640 0 client.16758 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:20:18.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.506+0000 7f9315b5d740 1 -- 172.21.15.2:0/2272719538 shutdown_connections 2024-09-19T06:20:18.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.506+0000 7f9315b5d740 1 -- 172.21.15.2:0/2272719538 wait complete. 2024-09-19T06:20:18.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.506+0000 7f9315b5d740 20 client.16758 trim_cache size 0 max 16384 2024-09-19T06:20:18.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.519+0000 7f9315b5d740 1 Processor -- start 2024-09-19T06:20:18.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.519+0000 7f9315b5d740 1 -- start start 2024-09-19T06:20:18.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.519+0000 7f9315b5d740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca02ba25d0 0x55ca02b9dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:18.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.519+0000 7f9315b5d740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca02ba3b40 0x55ca02ba5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:18.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.519+0000 7f9315b5d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca02bad370 0x55ca02ba5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:18.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.519+0000 7f9315b5d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f930c1b2180 con 0x55ca02bad370 2024-09-19T06:20:18.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.519+0000 7f9315b5d740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f930c1afa50 con 0x55ca02ba3b40 2024-09-19T06:20:18.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.519+0000 7f9315b5d740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f930c1ad8c0 con 0x55ca02ba25d0 2024-09-19T06:20:18.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.520+0000 7f9310d1f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca02bad370 0x55ca02ba5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:18.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.520+0000 7f9310d1f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca02bad370 0x55ca02ba5660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32860/0 (socket says 172.21.15.2:32860) 2024-09-19T06:20:18.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.520+0000 7f9310d1f640 1 -- 172.21.15.2:0/934922539 learned_addr learned my addr 172.21.15.2:0/934922539 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:18.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.520+0000 7f9311520640 1 --2- 172.21.15.2:0/934922539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca02ba3b40 0x55ca02ba5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:18.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.520+0000 7f9310d1f640 1 --2- 172.21.15.2:0/934922539 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca02ba25d0 0x55ca02b9dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:18.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.520+0000 7f9310d1f640 1 -- 172.21.15.2:0/934922539 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca02ba25d0 msgr2=0x55ca02b9dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:18.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.520+0000 7f9310d1f640 1 --2- 172.21.15.2:0/934922539 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca02ba25d0 0x55ca02b9dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:18.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.520+0000 7f9310d1f640 1 -- 172.21.15.2:0/934922539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca02ba3b40 msgr2=0x55ca02ba5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:18.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.520+0000 7f9310d1f640 1 --2- 172.21.15.2:0/934922539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca02ba3b40 0x55ca02ba5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:18.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.520+0000 7f9310d1f640 1 -- 172.21.15.2:0/934922539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca02b9d310 con 0x55ca02bad370 2024-09-19T06:20:18.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.520+0000 7f9311520640 1 --2- 172.21.15.2:0/934922539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca02ba3b40 0x55ca02ba5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:18.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.520+0000 7f9310d1f640 1 --2- 172.21.15.2:0/934922539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca02bad370 0x55ca02ba5660 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f9300005e80 tx=0x7f9300015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f25bcaf70768db22 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:18.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.520+0000 7f92f2ffd640 1 -- 172.21.15.2:0/934922539 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9300029070 con 0x55ca02bad370 2024-09-19T06:20:18.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.520+0000 7f92f2ffd640 1 -- 172.21.15.2:0/934922539 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f930002a040 con 0x55ca02bad370 2024-09-19T06:20:18.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.520+0000 7f92f2ffd640 1 -- 172.21.15.2:0/934922539 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f930000fd00 con 0x55ca02bad370 2024-09-19T06:20:18.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.521+0000 7f9315b5d740 1 -- 172.21.15.2:0/934922539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca02bad370 msgr2=0x55ca02ba5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:18.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.521+0000 7f9315b5d740 1 --2- 172.21.15.2:0/934922539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca02bad370 0x55ca02ba5660 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f9300005e80 tx=0x7f9300015040 comp rx=0 tx=0).stop 2024-09-19T06:20:18.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.521+0000 7f9315b5d740 1 -- 172.21.15.2:0/934922539 shutdown_connections 2024-09-19T06:20:18.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.521+0000 7f9315b5d740 1 --2- 172.21.15.2:0/934922539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca02bad370 0x55ca02ba5660 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:18.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.521+0000 7f9315b5d740 1 --2- 172.21.15.2:0/934922539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca02ba3b40 0x55ca02ba5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:18.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.521+0000 7f9315b5d740 1 --2- 172.21.15.2:0/934922539 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca02ba25d0 0x55ca02b9dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:18.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.521+0000 7f9315b5d740 1 -- 172.21.15.2:0/934922539 >> 172.21.15.2:0/934922539 conn(0x55ca02b6b310 msgr2=0x55ca02b9d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:18.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.521+0000 7f9315b5d740 1 -- 172.21.15.2:0/934922539 shutdown_connections 2024-09-19T06:20:18.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.521+0000 7f9315b5d740 1 -- 172.21.15.2:0/934922539 wait complete. 2024-09-19T06:20:18.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.521+0000 7f9315b5d740 1 -- start start 2024-09-19T06:20:18.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.522+0000 7f9315b5d740 1 Processor -- start 2024-09-19T06:20:18.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.522+0000 7f9315b5d740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca02ba25d0 0x55ca02bb5a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:18.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.522+0000 7f9315b5d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca02ba3b40 0x55ca02ba6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:18.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.522+0000 7f9315b5d740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca02bad370 0x55ca02ba71d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:18.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.522+0000 7f9315b5d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f930c1adf10 con 0x55ca02ba3b40 2024-09-19T06:20:18.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.522+0000 7f9315b5d740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f930c1af380 con 0x55ca02ba25d0 2024-09-19T06:20:18.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.522+0000 7f9315b5d740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f930c1ae5e0 con 0x55ca02bad370 2024-09-19T06:20:18.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.522+0000 7f9315b5d740 10 client.0 _ll_register_callbacks cb 0x7f930000abd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:18.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.522+0000 7f9311520640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca02ba3b40 0x55ca02ba6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:18.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.522+0000 7f9311520640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca02ba3b40 0x55ca02ba6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32864/0 (socket says 172.21.15.2:32864) 2024-09-19T06:20:18.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.522+0000 7f9311520640 1 -- 172.21.15.2:0/1079101742 learned_addr learned my addr 172.21.15.2:0/1079101742 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:18.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.522+0000 7f9310d1f640 1 --2- 172.21.15.2:0/1079101742 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca02bad370 0x55ca02ba71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:18.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.523+0000 7f9310d1f640 1 --2- 172.21.15.2:0/1079101742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca02ba25d0 0x55ca02bb5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:18.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.523+0000 7f9311520640 1 -- 172.21.15.2:0/1079101742 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca02bad370 msgr2=0x55ca02ba71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:18.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.523+0000 7f9311520640 1 --2- 172.21.15.2:0/1079101742 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca02bad370 0x55ca02ba71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:18.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.523+0000 7f9311520640 1 -- 172.21.15.2:0/1079101742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca02ba25d0 msgr2=0x55ca02bb5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:18.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.523+0000 7f9311520640 1 --2- 172.21.15.2:0/1079101742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca02ba25d0 0x55ca02bb5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:18.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.523+0000 7f9311520640 1 -- 172.21.15.2:0/1079101742 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca02ba78c0 con 0x55ca02ba3b40 2024-09-19T06:20:18.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.523+0000 7f9310d1f640 1 --2- 172.21.15.2:0/1079101742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca02ba25d0 0x55ca02bb5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:20:18.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.523+0000 7f9311520640 1 --2- 172.21.15.2:0/1079101742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca02ba3b40 0x55ca02ba6c90 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f9304007f90 tx=0x7f9304007b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4982ccdb2ea6244 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:18.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.523+0000 7f92f0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:18.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.523+0000 7f92f0ff9640 1 -- 172.21.15.2:0/1079101742 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9304032060 con 0x55ca02ba3b40 2024-09-19T06:20:18.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.523+0000 7f92f0ff9640 1 -- 172.21.15.2:0/1079101742 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f9304010bd0 con 0x55ca02ba3b40 2024-09-19T06:20:18.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.523+0000 7f9315b5d740 1 -- 172.21.15.2:0/1079101742 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f930002a040 con 0x55ca02ba3b40 2024-09-19T06:20:18.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.523+0000 7f92f0ff9640 1 -- 172.21.15.2:0/1079101742 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f930401d040 con 0x55ca02ba3b40 2024-09-19T06:20:18.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.523+0000 7f9315b5d740 10 client.16764 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:18.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.523+0000 7f9315b5d740 1 -- 172.21.15.2:0/1079101742 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ca02c27c20 con 0x55ca02ba3b40 2024-09-19T06:20:18.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.523+0000 7f92f0ff9640 1 -- 172.21.15.2:0/1079101742 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f930002a040 con 0x55ca02ba3b40 2024-09-19T06:20:18.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.524+0000 7f92f0ff9640 1 -- 172.21.15.2:0/1079101742 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f9304004d50 con 0x55ca02ba3b40 2024-09-19T06:20:18.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.524+0000 7f9315b5d740 10 client.16764 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:18.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.524+0000 7f9315b5d740 10 client.16764 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:20:18.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.524+0000 7f9315b5d740 20 client.16764 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:18.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.524+0000 7f9315b5d740 1 --2- 172.21.15.2:0/1079101742 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55ca02c280f0 0x55ca02c2a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:18.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.524+0000 7f9315b5d740 4 client.16764 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:20:18.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.524+0000 7f9315b5d740 1 -- 172.21.15.2:0/1079101742 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ca02b0fd70 con 0x55ca02c280f0 2024-09-19T06:20:18.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.524+0000 7f9310d1f640 1 --2- 172.21.15.2:0/1079101742 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55ca02c280f0 0x55ca02c2a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:18.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.524+0000 7f92f0ff9640 10 client.16764 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:20:18.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.524+0000 7f9310d1f640 1 --2- 172.21.15.2:0/1079101742 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55ca02c280f0 0x55ca02c2a510 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1dd0d4c8fb40bd56 server_cookie=d1265b6b95e1d699 in_seq=0 out_seq=0 2024-09-19T06:20:18.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.524+0000 7f92f0ff9640 1 -- 172.21.15.2:0/1079101742 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ca02b0fd70 con 0x55ca02c280f0 2024-09-19T06:20:18.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.524+0000 7f92f0ff9640 10 client.16764 handle_command_reply: tid=0 2024-09-19T06:20:18.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.524+0000 7f9315b5d740 1 client.16764 shutdown 2024-09-19T06:20:18.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.525+0000 7f9315b5d740 1 -- 172.21.15.2:0/1079101742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca02ba3b40 msgr2=0x55ca02ba6c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:18.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.525+0000 7f9315b5d740 1 --2- 172.21.15.2:0/1079101742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca02ba3b40 0x55ca02ba6c90 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f9304007f90 tx=0x7f9304007b20 comp rx=0 tx=0).stop 2024-09-19T06:20:18.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.525+0000 7f9315b5d740 1 -- 172.21.15.2:0/1079101742 shutdown_connections 2024-09-19T06:20:18.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.525+0000 7f9315b5d740 1 --2- 172.21.15.2:0/1079101742 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55ca02c280f0 0x55ca02c2a510 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:18.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.525+0000 7f9315b5d740 1 --2- 172.21.15.2:0/1079101742 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca02bad370 0x55ca02ba71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:18.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.525+0000 7f9315b5d740 1 --2- 172.21.15.2:0/1079101742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca02ba3b40 0x55ca02ba6c90 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:18.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.525+0000 7f92f0ff9640 0 client.16764 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:20:18.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.525+0000 7f9315b5d740 1 --2- 172.21.15.2:0/1079101742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca02ba25d0 0x55ca02bb5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:18.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.525+0000 7f9315b5d740 1 -- 172.21.15.2:0/1079101742 >> 172.21.15.2:0/1079101742 conn(0x55ca02b6b310 msgr2=0x55ca02b9dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:18.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.525+0000 7f9315b5d740 1 -- 172.21.15.2:0/1079101742 shutdown_connections 2024-09-19T06:20:18.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.525+0000 7f9315b5d740 1 -- 172.21.15.2:0/1079101742 wait complete. 2024-09-19T06:20:18.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.525+0000 7f9315b5d740 20 client.16764 trim_cache size 0 max 16384 2024-09-19T06:20:18.537 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:20:18.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.525+0000 7f9313784640 1 -- 172.21.15.2:0/1883226909 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f92f40a33b0 msgr2=0x7f92f40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:18.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.525+0000 7f9313784640 1 --2- 172.21.15.2:0/1883226909 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f92f40a33b0 0x7f92f40a5870 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f92fc0bc920 tx=0x7f92fc08b680 comp rx=0 tx=0).stop 2024-09-19T06:20:18.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.525+0000 7f9313784640 1 -- 172.21.15.2:0/1883226909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f930c104e80 msgr2=0x7f930c19cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:18.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.525+0000 7f9313784640 1 --2- 172.21.15.2:0/1883226909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f930c104e80 0x7f930c19cb50 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f92fc009a20 tx=0x7f92fc0042e0 comp rx=0 tx=0).stop 2024-09-19T06:20:18.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.526+0000 7f9313784640 1 -- 172.21.15.2:0/1883226909 shutdown_connections 2024-09-19T06:20:18.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.526+0000 7f9313784640 1 --2- 172.21.15.2:0/1883226909 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f92f40a33b0 0x7f92f40a5870 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:18.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.526+0000 7f9313784640 1 --2- 172.21.15.2:0/1883226909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f930c104e80 0x7f930c19cb50 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:18.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.526+0000 7f9313784640 1 --2- 172.21.15.2:0/1883226909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f930c06a370 0x7f930c1987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:18.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.526+0000 7f9313784640 1 --2- 172.21.15.2:0/1883226909 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f930c069f00 0x7f930c198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:18.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.526+0000 7f9313784640 1 -- 172.21.15.2:0/1883226909 >> 172.21.15.2:0/1883226909 conn(0x7f930c077210 msgr2=0x7f930c0fc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:18.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.526+0000 7f9313784640 1 -- 172.21.15.2:0/1883226909 shutdown_connections 2024-09-19T06:20:18.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:18.526+0000 7f9313784640 1 -- 172.21.15.2:0/1883226909 wait complete. 2024-09-19T06:20:19.187 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:20:19.441 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:19.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.902+0000 7efca892b640 1 -- 172.21.15.2:0/2667715405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efca4102790 msgr2=0x7efca41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:19.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.902+0000 7efca892b640 1 --2- 172.21.15.2:0/2667715405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efca4102790 0x7efca41067e0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7efc8c009900 tx=0x7efc8c02a410 comp rx=0 tx=0).stop 2024-09-19T06:20:19.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.902+0000 7efca892b640 1 -- 172.21.15.2:0/2667715405 shutdown_connections 2024-09-19T06:20:19.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.902+0000 7efca892b640 1 --2- 172.21.15.2:0/2667715405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efca4106f10 0x7efca410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.902+0000 7efca892b640 1 --2- 172.21.15.2:0/2667715405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efca4102790 0x7efca41067e0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.902+0000 7efca892b640 1 --2- 172.21.15.2:0/2667715405 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efca4101de0 0x7efca41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.902+0000 7efca892b640 1 -- 172.21.15.2:0/2667715405 >> 172.21.15.2:0/2667715405 conn(0x7efca40fd8c0 msgr2=0x7efca40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:19.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.902+0000 7efca892b640 1 -- 172.21.15.2:0/2667715405 shutdown_connections 2024-09-19T06:20:19.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.902+0000 7efca892b640 1 -- 172.21.15.2:0/2667715405 wait complete. 2024-09-19T06:20:19.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.903+0000 7efca892b640 1 Processor -- start 2024-09-19T06:20:19.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.903+0000 7efca892b640 1 -- start start 2024-09-19T06:20:19.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.903+0000 7efca892b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efca4101de0 0x7efca41983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:19.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.903+0000 7efca892b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efca4102790 0x7efca41988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:19.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.903+0000 7efca892b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efca4106f10 0x7efca419cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:19.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.903+0000 7efca892b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efca4111e20 con 0x7efca4101de0 2024-09-19T06:20:19.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.903+0000 7efca892b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7efca4111ca0 con 0x7efca4106f10 2024-09-19T06:20:19.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.903+0000 7efca892b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efca4111fa0 con 0x7efca4102790 2024-09-19T06:20:19.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.903+0000 7efca259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efca4101de0 0x7efca41983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:19.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.903+0000 7efca259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efca4101de0 0x7efca41983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32890/0 (socket says 172.21.15.2:32890) 2024-09-19T06:20:19.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.903+0000 7efca259c640 1 -- 172.21.15.2:0/1306674902 learned_addr learned my addr 172.21.15.2:0/1306674902 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:19.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.903+0000 7efc9bfff640 1 --2- 172.21.15.2:0/1306674902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efca4102790 0x7efca41988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:19.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.904+0000 7efca259c640 1 -- 172.21.15.2:0/1306674902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efca4102790 msgr2=0x7efca41988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:19.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.904+0000 7efca259c640 1 --2- 172.21.15.2:0/1306674902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efca4102790 0x7efca41988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.904+0000 7efca259c640 1 -- 172.21.15.2:0/1306674902 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efca4106f10 msgr2=0x7efca419cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:19.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.904+0000 7efca2d9d640 1 --2- 172.21.15.2:0/1306674902 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efca4106f10 0x7efca419cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:19.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.904+0000 7efca259c640 1 --2- 172.21.15.2:0/1306674902 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efca4106f10 0x7efca419cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.904+0000 7efca259c640 1 -- 172.21.15.2:0/1306674902 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca419d350 con 0x7efca4101de0 2024-09-19T06:20:19.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.904+0000 7efca259c640 1 --2- 172.21.15.2:0/1306674902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efca4101de0 0x7efca41983a0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7efc9400d770 tx=0x7efc9400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:19.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.904+0000 7efc9b7fe640 1 -- 172.21.15.2:0/1306674902 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc94017070 con 0x7efca4101de0 2024-09-19T06:20:19.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.904+0000 7efc9b7fe640 1 -- 172.21.15.2:0/1306674902 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efc940054d0 con 0x7efca4101de0 2024-09-19T06:20:19.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.904+0000 7efca892b640 1 -- 172.21.15.2:0/1306674902 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efca419d640 con 0x7efca4101de0 2024-09-19T06:20:19.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.904+0000 7efc9b7fe640 1 -- 172.21.15.2:0/1306674902 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc94004cf0 con 0x7efca4101de0 2024-09-19T06:20:19.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.904+0000 7efca892b640 1 -- 172.21.15.2:0/1306674902 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efca41a4f20 con 0x7efca4101de0 2024-09-19T06:20:19.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.906+0000 7efc9b7fe640 1 -- 172.21.15.2:0/1306674902 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7efc94004e90 con 0x7efca4101de0 2024-09-19T06:20:19.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.906+0000 7efcaad04740 1 Processor -- start 2024-09-19T06:20:19.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.907+0000 7efcaad04740 1 -- start start 2024-09-19T06:20:19.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.907+0000 7efcaad04740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5644d37cbb40 0x5644d37ca090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:19.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.907+0000 7efcaad04740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644d37ca5d0 0x5644d37caa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:19.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.907+0000 7efcaad04740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5644d37d9780 0x5644d37dbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:19.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.907+0000 7efcaad04740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5644d37302f0 con 0x5644d37cbb40 2024-09-19T06:20:19.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.907+0000 7efcaad04740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5644d36d7cf0 con 0x5644d37d9780 2024-09-19T06:20:19.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.907+0000 7efcaad04740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5644d372c2b0 con 0x5644d37ca5d0 2024-09-19T06:20:19.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.907+0000 7efca2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5644d37cbb40 0x5644d37ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:19.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.907+0000 7efca2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5644d37cbb40 0x5644d37ca090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32898/0 (socket says 172.21.15.2:32898) 2024-09-19T06:20:19.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.907+0000 7efca2d9d640 1 -- 172.21.15.2:0/639158372 learned_addr learned my addr 172.21.15.2:0/639158372 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:19.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.907+0000 7efc9bfff640 1 --2- 172.21.15.2:0/639158372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5644d37d9780 0x5644d37dbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:19.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.907+0000 7efca259c640 1 --2- 172.21.15.2:0/639158372 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644d37ca5d0 0x5644d37caa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:19.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.907+0000 7efc9b7fe640 1 --2- 172.21.15.2:0/1306674902 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7efc900a3430 0x7efc900a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:19.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.907+0000 7efca2d9d640 1 -- 172.21.15.2:0/639158372 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644d37ca5d0 msgr2=0x5644d37caa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:19.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.907+0000 7efca2d9d640 1 --2- 172.21.15.2:0/639158372 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644d37ca5d0 0x5644d37caa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.907+0000 7efca2d9d640 1 -- 172.21.15.2:0/639158372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5644d37d9780 msgr2=0x5644d37dbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:19.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.907+0000 7efca2d9d640 1 --2- 172.21.15.2:0/639158372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5644d37d9780 0x5644d37dbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.907+0000 7efca2d9d640 1 -- 172.21.15.2:0/639158372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644d36bc3a0 con 0x5644d37cbb40 2024-09-19T06:20:19.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.908+0000 7efca2d9d640 1 --2- 172.21.15.2:0/1306674902 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7efc900a3430 0x7efc900a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:19.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.908+0000 7efc9b7fe640 1 -- 172.21.15.2:0/1306674902 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7efc940cf740 con 0x7efca4101de0 2024-09-19T06:20:19.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.908+0000 7efca2d9d640 1 --2- 172.21.15.2:0/639158372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5644d37cbb40 0x5644d37ca090 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7efc9c009eb0 tx=0x7efc9c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd36e19747508b92 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:19.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.908+0000 7efc98ff9640 1 -- 172.21.15.2:0/639158372 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9c01a610 con 0x5644d37cbb40 2024-09-19T06:20:19.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.908+0000 7efc98ff9640 1 -- 172.21.15.2:0/639158372 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efc9c012e40 con 0x5644d37cbb40 2024-09-19T06:20:19.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.908+0000 7efc98ff9640 1 -- 172.21.15.2:0/639158372 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9c0107c0 con 0x5644d37cbb40 2024-09-19T06:20:19.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.909+0000 7efcaad04740 1 -- 172.21.15.2:0/639158372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5644d37cbb40 msgr2=0x5644d37ca090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:19.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.909+0000 7efcaad04740 1 --2- 172.21.15.2:0/639158372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5644d37cbb40 0x5644d37ca090 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7efc9c009eb0 tx=0x7efc9c00f730 comp rx=0 tx=0).stop 2024-09-19T06:20:19.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.909+0000 7efca2d9d640 1 --2- 172.21.15.2:0/1306674902 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7efc900a3430 0x7efc900a58f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efc9c020000 tx=0x7efc9c01d000 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:19.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.909+0000 7efcaad04740 1 -- 172.21.15.2:0/639158372 shutdown_connections 2024-09-19T06:20:19.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.909+0000 7efcaad04740 1 --2- 172.21.15.2:0/639158372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5644d37d9780 0x5644d37dbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.909+0000 7efcaad04740 1 --2- 172.21.15.2:0/639158372 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644d37ca5d0 0x5644d37caa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.909+0000 7efcaad04740 1 --2- 172.21.15.2:0/639158372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5644d37cbb40 0x5644d37ca090 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.909+0000 7efcaad04740 1 -- 172.21.15.2:0/639158372 >> 172.21.15.2:0/639158372 conn(0x5644d3793310 msgr2=0x5644d37c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:19.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.909+0000 7efcaad04740 1 -- 172.21.15.2:0/639158372 shutdown_connections 2024-09-19T06:20:19.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.909+0000 7efcaad04740 1 -- 172.21.15.2:0/639158372 wait complete. 2024-09-19T06:20:19.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.909+0000 7efcaad04740 1 -- start start 2024-09-19T06:20:19.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.909+0000 7efcaad04740 1 Processor -- start 2024-09-19T06:20:19.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.910+0000 7efcaad04740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644d37ca5d0 0x5644d37d9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:19.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.910+0000 7efcaad04740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5644d37cbb40 0x5644d37d6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:19.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.910+0000 7efcaad04740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5644d37d9780 0x5644d37d6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:19.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.910+0000 7efcaad04740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5644d37dc480 con 0x5644d37cbb40 2024-09-19T06:20:19.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.910+0000 7efcaad04740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5644d36eb060 con 0x5644d37d9780 2024-09-19T06:20:19.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.910+0000 7efcaad04740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5644d37dc600 con 0x5644d37ca5d0 2024-09-19T06:20:19.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.910+0000 7efcaad04740 10 client.0 _ll_register_callbacks cb 0x5644d343e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:19.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.910+0000 7efc9bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5644d37cbb40 0x5644d37d6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:19.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.910+0000 7efc9bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5644d37cbb40 0x5644d37d6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32908/0 (socket says 172.21.15.2:32908) 2024-09-19T06:20:19.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.910+0000 7efc9bfff640 1 -- 172.21.15.2:0/64936460 learned_addr learned my addr 172.21.15.2:0/64936460 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:19.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.910+0000 7efca259c640 1 --2- 172.21.15.2:0/64936460 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644d37ca5d0 0x5644d37d9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:19.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.910+0000 7efca2d9d640 1 --2- 172.21.15.2:0/64936460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5644d37d9780 0x5644d37d6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:19.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.910+0000 7efc9bfff640 1 -- 172.21.15.2:0/64936460 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644d37ca5d0 msgr2=0x5644d37d9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:19.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.910+0000 7efc9bfff640 1 --2- 172.21.15.2:0/64936460 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644d37ca5d0 0x5644d37d9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.910+0000 7efc9bfff640 1 -- 172.21.15.2:0/64936460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5644d37d9780 msgr2=0x5644d37d6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:19.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.910+0000 7efc9bfff640 1 --2- 172.21.15.2:0/64936460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5644d37d9780 0x5644d37d6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.910+0000 7efc9bfff640 1 -- 172.21.15.2:0/64936460 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644d34a13c0 con 0x5644d37cbb40 2024-09-19T06:20:19.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.910+0000 7efc9bfff640 1 --2- 172.21.15.2:0/64936460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5644d37cbb40 0x5644d37d6420 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7efc8c009900 tx=0x7efc8c0316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20487f3aee105ad2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:19.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.910+0000 7efc89ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:19.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.910+0000 7efc89ffb640 1 -- 172.21.15.2:0/64936460 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc8c035040 con 0x5644d37cbb40 2024-09-19T06:20:19.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.911+0000 7efcaad04740 1 -- 172.21.15.2:0/64936460 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5644d373d860 con 0x5644d37cbb40 2024-09-19T06:20:19.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.911+0000 7efc89ffb640 1 -- 172.21.15.2:0/64936460 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7efc8c004040 con 0x5644d37cbb40 2024-09-19T06:20:19.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.911+0000 7efc89ffb640 1 -- 172.21.15.2:0/64936460 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7efc8c004240 con 0x5644d37cbb40 2024-09-19T06:20:19.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.911+0000 7efcaad04740 10 client.16776 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:19.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.911+0000 7efcaad04740 1 -- 172.21.15.2:0/64936460 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5644d37e7f70 con 0x5644d37cbb40 2024-09-19T06:20:19.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.911+0000 7efc89ffb640 1 -- 172.21.15.2:0/64936460 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x5644d373d860 con 0x5644d37cbb40 2024-09-19T06:20:19.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.911+0000 7efc89ffb640 1 -- 172.21.15.2:0/64936460 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7efc8c004910 con 0x5644d37cbb40 2024-09-19T06:20:19.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.911+0000 7efcaad04740 10 client.16776 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:19.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.911+0000 7efcaad04740 10 client.16776 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:19.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.911+0000 7efcaad04740 20 client.16776 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:19.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.911+0000 7efcaad04740 1 --2- 172.21.15.2:0/64936460 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5644d37e9480 0x5644d37eb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:19.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.911+0000 7efcaad04740 4 client.16776 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:19.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.911+0000 7efcaad04740 1 -- 172.21.15.2:0/64936460 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644d3737d70 con 0x5644d37e9480 2024-09-19T06:20:19.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.911+0000 7efca259c640 1 --2- 172.21.15.2:0/64936460 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5644d37e9480 0x5644d37eb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:19.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.912+0000 7efc89ffb640 10 client.16776 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:19.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.912+0000 7efca259c640 1 --2- 172.21.15.2:0/64936460 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5644d37e9480 0x5644d37eb8a0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc5c0bdf0cb26074 server_cookie=baac49769f67ee12 in_seq=0 out_seq=0 2024-09-19T06:20:19.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.913+0000 7efc89ffb640 1 -- 172.21.15.2:0/64936460 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5644d3737d70 con 0x5644d37e9480 2024-09-19T06:20:19.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.913+0000 7efc89ffb640 10 client.16776 handle_command_reply: tid=0 2024-09-19T06:20:19.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.913+0000 7efcaad04740 1 client.16776 shutdown 2024-09-19T06:20:19.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.913+0000 7efcaad04740 1 -- 172.21.15.2:0/64936460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5644d37cbb40 msgr2=0x5644d37d6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:19.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.913+0000 7efcaad04740 1 --2- 172.21.15.2:0/64936460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5644d37cbb40 0x5644d37d6420 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7efc8c009900 tx=0x7efc8c0316d0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.913+0000 7efcaad04740 1 -- 172.21.15.2:0/64936460 shutdown_connections 2024-09-19T06:20:19.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.913+0000 7efcaad04740 1 --2- 172.21.15.2:0/64936460 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5644d37e9480 0x5644d37eb8a0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.913+0000 7efcaad04740 1 --2- 172.21.15.2:0/64936460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5644d37d9780 0x5644d37d6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.913+0000 7efcaad04740 1 --2- 172.21.15.2:0/64936460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5644d37cbb40 0x5644d37d6420 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.913+0000 7efc89ffb640 0 client.16776 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:19.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.913+0000 7efcaad04740 1 --2- 172.21.15.2:0/64936460 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644d37ca5d0 0x5644d37d9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.913+0000 7efcaad04740 1 -- 172.21.15.2:0/64936460 >> 172.21.15.2:0/64936460 conn(0x5644d3793310 msgr2=0x5644d37cc960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:19.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.913+0000 7efcaad04740 1 -- 172.21.15.2:0/64936460 shutdown_connections 2024-09-19T06:20:19.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.913+0000 7efcaad04740 1 -- 172.21.15.2:0/64936460 wait complete. 2024-09-19T06:20:19.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.913+0000 7efcaad04740 20 client.16776 trim_cache size 0 max 16384 2024-09-19T06:20:19.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.926+0000 7efcaad04740 1 Processor -- start 2024-09-19T06:20:19.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.926+0000 7efcaad04740 1 -- start start 2024-09-19T06:20:19.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.926+0000 7efcaad04740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5644d37ca5d0 0x5644d37c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:19.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.926+0000 7efcaad04740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5644d37cbb40 0x5644d37e5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:19.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.926+0000 7efcaad04740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644d37d9780 0x5644d37d5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:19.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.926+0000 7efcaad04740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efca41adcc0 con 0x5644d37ca5d0 2024-09-19T06:20:19.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.926+0000 7efcaad04740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7efca41ab590 con 0x5644d37cbb40 2024-09-19T06:20:19.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.926+0000 7efcaad04740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efca41a93e0 con 0x5644d37d9780 2024-09-19T06:20:19.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.926+0000 7efca259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5644d37ca5d0 0x5644d37c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:19.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.926+0000 7efca259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5644d37ca5d0 0x5644d37c6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32912/0 (socket says 172.21.15.2:32912) 2024-09-19T06:20:19.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.926+0000 7efca259c640 1 -- 172.21.15.2:0/5322060 learned_addr learned my addr 172.21.15.2:0/5322060 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:19.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.926+0000 7efca2d9d640 1 --2- 172.21.15.2:0/5322060 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644d37d9780 0x5644d37d5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:19.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.927+0000 7efca259c640 1 -- 172.21.15.2:0/5322060 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644d37d9780 msgr2=0x5644d37d5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:19.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.927+0000 7efca259c640 1 --2- 172.21.15.2:0/5322060 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644d37d9780 0x5644d37d5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.927+0000 7efca259c640 1 -- 172.21.15.2:0/5322060 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5644d37cbb40 msgr2=0x5644d37e5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:19.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.927+0000 7efca259c640 1 --2- 172.21.15.2:0/5322060 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5644d37cbb40 0x5644d37e5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.927+0000 7efca259c640 1 -- 172.21.15.2:0/5322060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644d37cd120 con 0x5644d37ca5d0 2024-09-19T06:20:19.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.927+0000 7efca2d9d640 1 --2- 172.21.15.2:0/5322060 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644d37d9780 0x5644d37d5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:19.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.927+0000 7efca259c640 1 --2- 172.21.15.2:0/5322060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5644d37ca5d0 0x5644d37c6d70 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7efc940057a0 tx=0x7efc940d1b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6a685bfa297041c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:19.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.930+0000 7efc8bfff640 1 -- 172.21.15.2:0/5322060 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc94020040 con 0x5644d37ca5d0 2024-09-19T06:20:19.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.930+0000 7efc8bfff640 1 -- 172.21.15.2:0/5322060 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efc94009c30 con 0x5644d37ca5d0 2024-09-19T06:20:19.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.930+0000 7efc8bfff640 1 -- 172.21.15.2:0/5322060 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc940860b0 con 0x5644d37ca5d0 2024-09-19T06:20:19.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.930+0000 7efcaad04740 1 -- 172.21.15.2:0/5322060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5644d37ca5d0 msgr2=0x5644d37c6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:19.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.930+0000 7efcaad04740 1 --2- 172.21.15.2:0/5322060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5644d37ca5d0 0x5644d37c6d70 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7efc940057a0 tx=0x7efc940d1b90 comp rx=0 tx=0).stop 2024-09-19T06:20:19.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.930+0000 7efcaad04740 1 -- 172.21.15.2:0/5322060 shutdown_connections 2024-09-19T06:20:19.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.930+0000 7efcaad04740 1 --2- 172.21.15.2:0/5322060 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644d37d9780 0x5644d37d5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.930+0000 7efcaad04740 1 --2- 172.21.15.2:0/5322060 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5644d37cbb40 0x5644d37e5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.930+0000 7efcaad04740 1 --2- 172.21.15.2:0/5322060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5644d37ca5d0 0x5644d37c6d70 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.930+0000 7efcaad04740 1 -- 172.21.15.2:0/5322060 >> 172.21.15.2:0/5322060 conn(0x5644d3793310 msgr2=0x5644d37d4d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:19.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.930+0000 7efcaad04740 1 -- 172.21.15.2:0/5322060 shutdown_connections 2024-09-19T06:20:19.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.930+0000 7efcaad04740 1 -- 172.21.15.2:0/5322060 wait complete. 2024-09-19T06:20:19.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.931+0000 7efcaad04740 1 -- start start 2024-09-19T06:20:19.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.931+0000 7efcaad04740 1 Processor -- start 2024-09-19T06:20:19.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.931+0000 7efcaad04740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644d37ca5d0 0x5644d37e1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:19.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.931+0000 7efcaad04740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5644d37cbb40 0x5644d37d2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:19.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.931+0000 7efcaad04740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5644d37d9780 0x5644d37d3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:19.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.931+0000 7efcaad04740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efca41a9a50 con 0x5644d37d9780 2024-09-19T06:20:19.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.931+0000 7efcaad04740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7efca41aaec0 con 0x5644d37cbb40 2024-09-19T06:20:19.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.931+0000 7efcaad04740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efca41aa120 con 0x5644d37ca5d0 2024-09-19T06:20:19.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.931+0000 7efca2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5644d37d9780 0x5644d37d3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:19.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.931+0000 7efcaad04740 10 client.0 _ll_register_callbacks cb 0x7efc8c009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:19.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.931+0000 7efca2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5644d37d9780 0x5644d37d3380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32924/0 (socket says 172.21.15.2:32924) 2024-09-19T06:20:19.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.931+0000 7efca2d9d640 1 -- 172.21.15.2:0/751255619 learned_addr learned my addr 172.21.15.2:0/751255619 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:19.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.932+0000 7efc9bfff640 1 --2- 172.21.15.2:0/751255619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5644d37cbb40 0x5644d37d2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:19.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.932+0000 7efca259c640 1 --2- 172.21.15.2:0/751255619 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644d37ca5d0 0x5644d37e1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:19.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.932+0000 7efca2d9d640 1 -- 172.21.15.2:0/751255619 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644d37ca5d0 msgr2=0x5644d37e1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:19.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.932+0000 7efca2d9d640 1 --2- 172.21.15.2:0/751255619 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644d37ca5d0 0x5644d37e1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.932+0000 7efca2d9d640 1 -- 172.21.15.2:0/751255619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5644d37cbb40 msgr2=0x5644d37d2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:19.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.932+0000 7efca2d9d640 1 --2- 172.21.15.2:0/751255619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5644d37cbb40 0x5644d37d2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.932+0000 7efca2d9d640 1 -- 172.21.15.2:0/751255619 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644d37d38c0 con 0x5644d37d9780 2024-09-19T06:20:19.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.932+0000 7efc9bfff640 1 --2- 172.21.15.2:0/751255619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5644d37cbb40 0x5644d37d2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:19.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.932+0000 7efca2d9d640 1 --2- 172.21.15.2:0/751255619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5644d37d9780 0x5644d37d3380 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7efc9c010da0 tx=0x7efc9c010dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f97d42b5375f922 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:19.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.932+0000 7efc89ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:19.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.932+0000 7efc89ffb640 1 -- 172.21.15.2:0/751255619 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9c035060 con 0x5644d37d9780 2024-09-19T06:20:19.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.932+0000 7efc89ffb640 1 -- 172.21.15.2:0/751255619 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7efc9c004980 con 0x5644d37d9780 2024-09-19T06:20:19.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.932+0000 7efcaad04740 1 -- 172.21.15.2:0/751255619 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5644d36b4170 con 0x5644d37d9780 2024-09-19T06:20:19.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.932+0000 7efc89ffb640 1 -- 172.21.15.2:0/751255619 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7efc9c00fea0 con 0x5644d37d9780 2024-09-19T06:20:19.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.933+0000 7efcaad04740 10 client.16782 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:19.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.933+0000 7efcaad04740 1 -- 172.21.15.2:0/751255619 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5644d3853e50 con 0x5644d37d9780 2024-09-19T06:20:19.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.933+0000 7efc89ffb640 1 -- 172.21.15.2:0/751255619 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x5644d36b4170 con 0x5644d37d9780 2024-09-19T06:20:19.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.933+0000 7efc89ffb640 1 -- 172.21.15.2:0/751255619 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7efc9c005500 con 0x5644d37d9780 2024-09-19T06:20:19.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.933+0000 7efcaad04740 10 client.16782 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:19.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.933+0000 7efcaad04740 10 client.16782 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:19.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.933+0000 7efcaad04740 20 client.16782 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:19.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.933+0000 7efcaad04740 1 --2- 172.21.15.2:0/751255619 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5644d3854290 0x5644d38566b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:19.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.933+0000 7efcaad04740 4 client.16782 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:20:19.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.933+0000 7efcaad04740 1 -- 172.21.15.2:0/751255619 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5644d37019b0 con 0x5644d3854290 2024-09-19T06:20:19.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.933+0000 7efca259c640 1 --2- 172.21.15.2:0/751255619 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5644d3854290 0x5644d38566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:19.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.934+0000 7efca259c640 1 --2- 172.21.15.2:0/751255619 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5644d3854290 0x5644d38566b0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c1be71b4755fa10 server_cookie=9403460f75ce9259 in_seq=0 out_seq=0 2024-09-19T06:20:19.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.934+0000 7efc89ffb640 10 client.16782 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:19.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.934+0000 7efc89ffb640 1 -- 172.21.15.2:0/751255619 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5644d37019b0 con 0x5644d3854290 2024-09-19T06:20:19.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.934+0000 7efc89ffb640 10 client.16782 handle_command_reply: tid=0 2024-09-19T06:20:19.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.934+0000 7efcaad04740 1 client.16782 shutdown 2024-09-19T06:20:19.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.934+0000 7efcaad04740 1 -- 172.21.15.2:0/751255619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5644d37d9780 msgr2=0x5644d37d3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:19.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.934+0000 7efcaad04740 1 --2- 172.21.15.2:0/751255619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5644d37d9780 0x5644d37d3380 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7efc9c010da0 tx=0x7efc9c010dd0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.934+0000 7efcaad04740 1 -- 172.21.15.2:0/751255619 shutdown_connections 2024-09-19T06:20:19.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.934+0000 7efcaad04740 1 --2- 172.21.15.2:0/751255619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5644d37d9780 0x5644d37d3380 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.934+0000 7efcaad04740 1 --2- 172.21.15.2:0/751255619 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5644d3854290 0x5644d38566b0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.934+0000 7efcaad04740 1 --2- 172.21.15.2:0/751255619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5644d37cbb40 0x5644d37d2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.934+0000 7efcaad04740 1 --2- 172.21.15.2:0/751255619 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644d37ca5d0 0x5644d37e1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.934+0000 7efc89ffb640 0 client.16782 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:19.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.934+0000 7efcaad04740 1 -- 172.21.15.2:0/751255619 >> 172.21.15.2:0/751255619 conn(0x5644d3793310 msgr2=0x5644d37d5570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:19.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.934+0000 7efcaad04740 1 -- 172.21.15.2:0/751255619 shutdown_connections 2024-09-19T06:20:19.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.934+0000 7efcaad04740 1 -- 172.21.15.2:0/751255619 wait complete. 2024-09-19T06:20:19.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.934+0000 7efcaad04740 20 client.16782 trim_cache size 0 max 16384 2024-09-19T06:20:19.956 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:20:19.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.935+0000 7efca892b640 1 -- 172.21.15.2:0/1306674902 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7efc900a3430 msgr2=0x7efc900a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:19.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.935+0000 7efca892b640 1 --2- 172.21.15.2:0/1306674902 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7efc900a3430 0x7efc900a58f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efc9c020000 tx=0x7efc9c01d000 comp rx=0 tx=0).stop 2024-09-19T06:20:19.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.935+0000 7efca892b640 1 -- 172.21.15.2:0/1306674902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efca4101de0 msgr2=0x7efca41983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:19.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.935+0000 7efca892b640 1 --2- 172.21.15.2:0/1306674902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efca4101de0 0x7efca41983a0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7efc9400d770 tx=0x7efc9400dc30 comp rx=0 tx=0).stop 2024-09-19T06:20:19.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.935+0000 7efca892b640 1 -- 172.21.15.2:0/1306674902 shutdown_connections 2024-09-19T06:20:19.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.935+0000 7efca892b640 1 --2- 172.21.15.2:0/1306674902 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7efc900a3430 0x7efc900a58f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.935+0000 7efca892b640 1 --2- 172.21.15.2:0/1306674902 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efca4106f10 0x7efca419cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.935+0000 7efca892b640 1 --2- 172.21.15.2:0/1306674902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efca4102790 0x7efca41988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.935+0000 7efca892b640 1 --2- 172.21.15.2:0/1306674902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efca4101de0 0x7efca41983a0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.935+0000 7efca892b640 1 -- 172.21.15.2:0/1306674902 >> 172.21.15.2:0/1306674902 conn(0x7efca40fd8c0 msgr2=0x7efca40fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:19.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.935+0000 7efca892b640 1 -- 172.21.15.2:0/1306674902 shutdown_connections 2024-09-19T06:20:19.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:19.935+0000 7efca892b640 1 -- 172.21.15.2:0/1306674902 wait complete. 2024-09-19T06:20:20.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:19 smithi002 ceph-mon[30982]: pgmap v168: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-19T06:20:20.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:19 smithi090 ceph-mon[34497]: pgmap v168: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-19T06:20:20.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:19 smithi089 ceph-mon[34160]: pgmap v168: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-19T06:20:21.698 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:20:21.698 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:20:21.970 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:22.067 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:21 smithi002 ceph-mon[30982]: pgmap v169: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-19T06:20:22.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:21 smithi090 ceph-mon[34497]: pgmap v169: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-19T06:20:22.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:21 smithi089 ceph-mon[34160]: pgmap v169: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-19T06:20:22.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.379+0000 7f9040c23640 1 -- 172.21.15.2:0/3011931620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f903c102d40 msgr2=0x7f903c103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:22.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.379+0000 7f9040c23640 1 --2- 172.21.15.2:0/3011931620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f903c102d40 0x7f903c103120 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f902c009900 tx=0x7f902c02a480 comp rx=0 tx=0).stop 2024-09-19T06:20:22.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.379+0000 7f9040c23640 1 -- 172.21.15.2:0/3011931620 shutdown_connections 2024-09-19T06:20:22.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.379+0000 7f9040c23640 1 --2- 172.21.15.2:0/3011931620 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f903c10c170 0x7f903c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:22.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.379+0000 7f9040c23640 1 --2- 172.21.15.2:0/3011931620 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f903c103660 0x7f903c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:22.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.379+0000 7f9040c23640 1 --2- 172.21.15.2:0/3011931620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f903c102d40 0x7f903c103120 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:22.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.379+0000 7f9040c23640 1 -- 172.21.15.2:0/3011931620 >> 172.21.15.2:0/3011931620 conn(0x7f903c0fc7a0 msgr2=0x7f903c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:22.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.379+0000 7f9040c23640 1 -- 172.21.15.2:0/3011931620 shutdown_connections 2024-09-19T06:20:22.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.380+0000 7f9040c23640 1 -- 172.21.15.2:0/3011931620 wait complete. 2024-09-19T06:20:22.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.380+0000 7f9040c23640 1 Processor -- start 2024-09-19T06:20:22.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.380+0000 7f9040c23640 1 -- start start 2024-09-19T06:20:22.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.381+0000 7f9040c23640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f903c102d40 0x7f903c1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:22.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.381+0000 7f9040c23640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f903c103660 0x7f903c100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:22.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.381+0000 7f9040c23640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f903c10c170 0x7f903c101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:22.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.381+0000 7f9040c23640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f903c111e70 con 0x7f903c102d40 2024-09-19T06:20:22.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.381+0000 7f9040c23640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f903c111cf0 con 0x7f903c10c170 2024-09-19T06:20:22.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.381+0000 7f9040c23640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f903c111ff0 con 0x7f903c103660 2024-09-19T06:20:22.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.381+0000 7f903a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f903c102d40 0x7f903c1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:22.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.381+0000 7f903a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f903c102d40 0x7f903c1009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32936/0 (socket says 172.21.15.2:32936) 2024-09-19T06:20:22.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.381+0000 7f903a59c640 1 -- 172.21.15.2:0/3443393754 learned_addr learned my addr 172.21.15.2:0/3443393754 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:22.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.381+0000 7f903ad9d640 1 --2- 172.21.15.2:0/3443393754 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f903c10c170 0x7f903c101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:22.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.381+0000 7f9039d9b640 1 --2- 172.21.15.2:0/3443393754 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f903c103660 0x7f903c100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:22.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.381+0000 7f903a59c640 1 -- 172.21.15.2:0/3443393754 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f903c103660 msgr2=0x7f903c100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:22.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.381+0000 7f903a59c640 1 --2- 172.21.15.2:0/3443393754 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f903c103660 0x7f903c100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:22.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.381+0000 7f903a59c640 1 -- 172.21.15.2:0/3443393754 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f903c10c170 msgr2=0x7f903c101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:22.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.381+0000 7f903a59c640 1 --2- 172.21.15.2:0/3443393754 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f903c10c170 0x7f903c101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:22.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.381+0000 7f903a59c640 1 -- 172.21.15.2:0/3443393754 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f903c1a6730 con 0x7f903c102d40 2024-09-19T06:20:22.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.381+0000 7f903a59c640 1 --2- 172.21.15.2:0/3443393754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f903c102d40 0x7f903c1009a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f902c005ab0 tx=0x7f902c003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:22.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.382+0000 7f902b7fe640 1 -- 172.21.15.2:0/3443393754 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f902c03f070 con 0x7f903c102d40 2024-09-19T06:20:22.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.382+0000 7f9040c23640 1 -- 172.21.15.2:0/3443393754 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f903c1a69c0 con 0x7f903c102d40 2024-09-19T06:20:22.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.382+0000 7f902b7fe640 1 -- 172.21.15.2:0/3443393754 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f902c031d60 con 0x7f903c102d40 2024-09-19T06:20:22.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.382+0000 7f902b7fe640 1 -- 172.21.15.2:0/3443393754 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f902c035030 con 0x7f903c102d40 2024-09-19T06:20:22.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.382+0000 7f9040c23640 1 -- 172.21.15.2:0/3443393754 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f903c1a6ef0 con 0x7f903c102d40 2024-09-19T06:20:22.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.384+0000 7f902b7fe640 1 -- 172.21.15.2:0/3443393754 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f902c042070 con 0x7f903c102d40 2024-09-19T06:20:22.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.384+0000 7f9042ffc740 1 Processor -- start 2024-09-19T06:20:22.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.385+0000 7f9042ffc740 1 -- start start 2024-09-19T06:20:22.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.385+0000 7f9042ffc740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563cb90f5b60 0x563cb90f5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:22.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.385+0000 7f9042ffc740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563cb90f6480 0x563cb9100800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:22.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.385+0000 7f9042ffc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cb9100d40 0x563cb9103130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:22.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.385+0000 7f9042ffc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563cb905b280 con 0x563cb9100d40 2024-09-19T06:20:22.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.385+0000 7f9042ffc740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563cb9002b10 con 0x563cb90f5b60 2024-09-19T06:20:22.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.385+0000 7f9042ffc740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x563cb9057240 con 0x563cb90f6480 2024-09-19T06:20:22.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.385+0000 7f902b7fe640 1 --2- 172.21.15.2:0/3443393754 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f90240a33b0 0x7f90240a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:22.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.385+0000 7f9039d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cb9100d40 0x563cb9103130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:22.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.385+0000 7f903ad9d640 1 --2- 172.21.15.2:0/3443393754 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f90240a33b0 0x7f90240a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:22.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.385+0000 7f9039d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cb9100d40 0x563cb9103130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32944/0 (socket says 172.21.15.2:32944) 2024-09-19T06:20:22.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.385+0000 7f9039d9b640 1 -- 172.21.15.2:0/633478903 learned_addr learned my addr 172.21.15.2:0/633478903 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:22.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.385+0000 7f903a59c640 1 --2- 172.21.15.2:0/633478903 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563cb90f6480 0x563cb9100800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:22.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.385+0000 7f903ad9d640 1 --2- 172.21.15.2:0/633478903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563cb90f5b60 0x563cb90f5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:22.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.386+0000 7f902b7fe640 1 -- 172.21.15.2:0/3443393754 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f902c0f0740 con 0x7f903c102d40 2024-09-19T06:20:22.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.386+0000 7f9039d9b640 1 -- 172.21.15.2:0/633478903 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563cb90f6480 msgr2=0x563cb9100800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:22.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.386+0000 7f9039d9b640 1 --2- 172.21.15.2:0/633478903 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563cb90f6480 0x563cb9100800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:22.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.386+0000 7f9039d9b640 1 -- 172.21.15.2:0/633478903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563cb90f5b60 msgr2=0x563cb90f5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:22.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.386+0000 7f9039d9b640 1 --2- 172.21.15.2:0/633478903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563cb90f5b60 0x563cb90f5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:22.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.386+0000 7f9039d9b640 1 -- 172.21.15.2:0/633478903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cb900f1f0 con 0x563cb9100d40 2024-09-19T06:20:22.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.386+0000 7f903ad9d640 1 --2- 172.21.15.2:0/3443393754 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f90240a33b0 0x7f90240a5870 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9034007fd0 tx=0x7f9034007d60 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:22.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.386+0000 7f9039d9b640 1 --2- 172.21.15.2:0/633478903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cb9100d40 0x563cb9103130 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f9030008b80 tx=0x7f903000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d2ca96429ba525 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:22.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.386+0000 7f9028ff9640 1 -- 172.21.15.2:0/633478903 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9030014070 con 0x563cb9100d40 2024-09-19T06:20:22.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.386+0000 7f9028ff9640 1 -- 172.21.15.2:0/633478903 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f90300047a0 con 0x563cb9100d40 2024-09-19T06:20:22.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.386+0000 7f9028ff9640 1 -- 172.21.15.2:0/633478903 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9030010690 con 0x563cb9100d40 2024-09-19T06:20:22.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.387+0000 7f9042ffc740 1 -- 172.21.15.2:0/633478903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cb9100d40 msgr2=0x563cb9103130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:22.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.387+0000 7f9042ffc740 1 --2- 172.21.15.2:0/633478903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cb9100d40 0x563cb9103130 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f9030008b80 tx=0x7f903000e720 comp rx=0 tx=0).stop 2024-09-19T06:20:22.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.387+0000 7f9042ffc740 1 -- 172.21.15.2:0/633478903 shutdown_connections 2024-09-19T06:20:22.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.387+0000 7f9042ffc740 1 --2- 172.21.15.2:0/633478903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cb9100d40 0x563cb9103130 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:22.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.387+0000 7f9042ffc740 1 --2- 172.21.15.2:0/633478903 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563cb90f6480 0x563cb9100800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:22.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.387+0000 7f9042ffc740 1 --2- 172.21.15.2:0/633478903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563cb90f5b60 0x563cb90f5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:22.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.387+0000 7f9042ffc740 1 -- 172.21.15.2:0/633478903 >> 172.21.15.2:0/633478903 conn(0x563cb90f20f0 msgr2=0x563cb90f24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:22.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.387+0000 7f9042ffc740 1 -- 172.21.15.2:0/633478903 shutdown_connections 2024-09-19T06:20:22.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.387+0000 7f9042ffc740 1 -- 172.21.15.2:0/633478903 wait complete. 2024-09-19T06:20:22.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.387+0000 7f9042ffc740 1 -- start start 2024-09-19T06:20:22.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.388+0000 7f9042ffc740 1 Processor -- start 2024-09-19T06:20:22.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.388+0000 7f9042ffc740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563cb90f5b60 0x563cb90fdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:22.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.388+0000 7f9042ffc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cb90f6480 0x563cb90fe0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:22.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.388+0000 7f9042ffc740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563cb9100d40 0x563cb90fe620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:22.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.388+0000 7f9042ffc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563cb9103910 con 0x563cb90f6480 2024-09-19T06:20:22.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.388+0000 7f9042ffc740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563cb9015f10 con 0x563cb90f5b60 2024-09-19T06:20:22.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.388+0000 7f9042ffc740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x563cb9103a90 con 0x563cb9100d40 2024-09-19T06:20:22.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.388+0000 7f9039d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cb90f6480 0x563cb90fe0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:22.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.388+0000 7f9042ffc740 10 client.0 _ll_register_callbacks cb 0x563cb8fdea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:22.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.388+0000 7f9039d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cb90f6480 0x563cb90fe0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32956/0 (socket says 172.21.15.2:32956) 2024-09-19T06:20:22.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.388+0000 7f9039d9b640 1 -- 172.21.15.2:0/2204599611 learned_addr learned my addr 172.21.15.2:0/2204599611 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:22.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.388+0000 7f903a59c640 1 --2- 172.21.15.2:0/2204599611 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563cb90f5b60 0x563cb90fdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:22.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.388+0000 7f903ad9d640 1 --2- 172.21.15.2:0/2204599611 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563cb9100d40 0x563cb90fe620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:22.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.388+0000 7f9039d9b640 1 -- 172.21.15.2:0/2204599611 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563cb9100d40 msgr2=0x563cb90fe620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:22.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.388+0000 7f9039d9b640 1 --2- 172.21.15.2:0/2204599611 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563cb9100d40 0x563cb90fe620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:22.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.388+0000 7f9039d9b640 1 -- 172.21.15.2:0/2204599611 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563cb90f5b60 msgr2=0x563cb90fdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:22.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.388+0000 7f9039d9b640 1 --2- 172.21.15.2:0/2204599611 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563cb90f5b60 0x563cb90fdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:22.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.388+0000 7f9039d9b640 1 -- 172.21.15.2:0/2204599611 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563cb8dcc6a0 con 0x563cb90f6480 2024-09-19T06:20:22.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.388+0000 7f9039d9b640 1 --2- 172.21.15.2:0/2204599611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cb90f6480 0x563cb90fe0e0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f9030000c00 tx=0x7f9030005230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58bf3566ff9a8667 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:22.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.388+0000 7f9021ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:22.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.389+0000 7f9021ffb640 1 -- 172.21.15.2:0/2204599611 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9030027060 con 0x563cb90f6480 2024-09-19T06:20:22.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.389+0000 7f9021ffb640 1 -- 172.21.15.2:0/2204599611 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f9030004d80 con 0x563cb90f6480 2024-09-19T06:20:22.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.389+0000 7f9042ffc740 1 -- 172.21.15.2:0/2204599611 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90300047a0 con 0x563cb90f6480 2024-09-19T06:20:22.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.389+0000 7f9021ffb640 1 -- 172.21.15.2:0/2204599611 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9030014070 con 0x563cb90f6480 2024-09-19T06:20:22.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.389+0000 7f9042ffc740 10 client.16794 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:22.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.389+0000 7f9042ffc740 1 -- 172.21.15.2:0/2204599611 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563cb910f4a0 con 0x563cb90f6480 2024-09-19T06:20:22.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.389+0000 7f9021ffb640 1 -- 172.21.15.2:0/2204599611 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f90300047a0 con 0x563cb90f6480 2024-09-19T06:20:22.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.389+0000 7f9021ffb640 1 -- 172.21.15.2:0/2204599611 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f9030010b30 con 0x563cb90f6480 2024-09-19T06:20:22.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.389+0000 7f9042ffc740 10 client.16794 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:22.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.389+0000 7f9042ffc740 10 client.16794 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:22.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.389+0000 7f9042ffc740 20 client.16794 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:22.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.389+0000 7f9042ffc740 1 --2- 172.21.15.2:0/2204599611 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563cb91108b0 0x563cb9112ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:22.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.389+0000 7f9042ffc740 4 client.16794 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:22.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.389+0000 7f9042ffc740 1 -- 172.21.15.2:0/2204599611 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563cb90687f0 con 0x563cb91108b0 2024-09-19T06:20:22.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.390+0000 7f903a59c640 1 --2- 172.21.15.2:0/2204599611 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563cb91108b0 0x563cb9112ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:22.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.390+0000 7f903a59c640 1 --2- 172.21.15.2:0/2204599611 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563cb91108b0 0x563cb9112ca0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ee7733dfee0bd55 server_cookie=d1470330d52c6652 in_seq=0 out_seq=0 2024-09-19T06:20:22.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.390+0000 7f9021ffb640 10 client.16794 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:22.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.391+0000 7f9021ffb640 1 -- 172.21.15.2:0/2204599611 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563cb90687f0 con 0x563cb91108b0 2024-09-19T06:20:22.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.391+0000 7f9021ffb640 10 client.16794 handle_command_reply: tid=0 2024-09-19T06:20:22.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.391+0000 7f9042ffc740 1 client.16794 shutdown 2024-09-19T06:20:22.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.391+0000 7f9042ffc740 1 -- 172.21.15.2:0/2204599611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cb90f6480 msgr2=0x563cb90fe0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:22.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.391+0000 7f9042ffc740 1 --2- 172.21.15.2:0/2204599611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cb90f6480 0x563cb90fe0e0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f9030000c00 tx=0x7f9030005230 comp rx=0 tx=0).stop 2024-09-19T06:20:22.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.391+0000 7f9042ffc740 1 -- 172.21.15.2:0/2204599611 shutdown_connections 2024-09-19T06:20:22.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.391+0000 7f9042ffc740 1 --2- 172.21.15.2:0/2204599611 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563cb9100d40 0x563cb90fe620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:22.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.391+0000 7f9042ffc740 1 --2- 172.21.15.2:0/2204599611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cb90f6480 0x563cb90fe0e0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:22.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.391+0000 7f9042ffc740 1 --2- 172.21.15.2:0/2204599611 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563cb91108b0 0x563cb9112ca0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:22.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.391+0000 7f9042ffc740 1 --2- 172.21.15.2:0/2204599611 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563cb90f5b60 0x563cb90fdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:22.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.391+0000 7f9042ffc740 1 -- 172.21.15.2:0/2204599611 >> 172.21.15.2:0/2204599611 conn(0x563cb90f20f0 msgr2=0x563cb90f7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:22.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.391+0000 7f9021ffb640 0 client.16794 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:22.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.391+0000 7f9042ffc740 1 -- 172.21.15.2:0/2204599611 shutdown_connections 2024-09-19T06:20:22.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.391+0000 7f9042ffc740 1 -- 172.21.15.2:0/2204599611 wait complete. 2024-09-19T06:20:22.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.391+0000 7f9042ffc740 20 client.16794 trim_cache size 0 max 16384 2024-09-19T06:20:22.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.409+0000 7f9042ffc740 1 Processor -- start 2024-09-19T06:20:22.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.409+0000 7f9042ffc740 1 -- start start 2024-09-19T06:20:22.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.409+0000 7f9042ffc740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563cb90f5b60 0x563cb90fcb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:22.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.409+0000 7f9042ffc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cb90f6480 0x563cb9118270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:22.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.409+0000 7f9042ffc740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563cb9100d40 0x563cb91187b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:22.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.409+0000 7f9042ffc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f903c1b20e0 con 0x563cb90f6480 2024-09-19T06:20:22.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.409+0000 7f9042ffc740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f903c1af9b0 con 0x563cb90f5b60 2024-09-19T06:20:22.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.409+0000 7f9042ffc740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f903c1ad800 con 0x563cb9100d40 2024-09-19T06:20:22.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.409+0000 7f9039d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cb90f6480 0x563cb9118270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:22.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.409+0000 7f9039d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cb90f6480 0x563cb9118270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32958/0 (socket says 172.21.15.2:32958) 2024-09-19T06:20:22.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.409+0000 7f9039d9b640 1 -- 172.21.15.2:0/196414588 learned_addr learned my addr 172.21.15.2:0/196414588 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:22.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.409+0000 7f903a59c640 1 --2- 172.21.15.2:0/196414588 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563cb90f5b60 0x563cb90fcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:22.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.409+0000 7f903ad9d640 1 --2- 172.21.15.2:0/196414588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563cb9100d40 0x563cb91187b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:22.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.409+0000 7f9039d9b640 1 -- 172.21.15.2:0/196414588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563cb9100d40 msgr2=0x563cb91187b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:22.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.409+0000 7f9039d9b640 1 --2- 172.21.15.2:0/196414588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563cb9100d40 0x563cb91187b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:22.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.409+0000 7f9039d9b640 1 -- 172.21.15.2:0/196414588 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563cb90f5b60 msgr2=0x563cb90fcb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:22.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.409+0000 7f9039d9b640 1 --2- 172.21.15.2:0/196414588 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563cb90f5b60 0x563cb90fcb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:22.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.409+0000 7f9039d9b640 1 -- 172.21.15.2:0/196414588 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cb90f1f20 con 0x563cb90f6480 2024-09-19T06:20:22.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.410+0000 7f903a59c640 1 --2- 172.21.15.2:0/196414588 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563cb90f5b60 0x563cb90fcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:20:22.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.410+0000 7f9039d9b640 1 --2- 172.21.15.2:0/196414588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cb90f6480 0x563cb9118270 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f9030006010 tx=0x7f9030005d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38c1b85c89575dc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:22.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.410+0000 7f9023fff640 1 -- 172.21.15.2:0/196414588 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9030008a00 con 0x563cb90f6480 2024-09-19T06:20:22.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.410+0000 7f9023fff640 1 -- 172.21.15.2:0/196414588 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f90300052a0 con 0x563cb90f6480 2024-09-19T06:20:22.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.410+0000 7f9023fff640 1 -- 172.21.15.2:0/196414588 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9030004030 con 0x563cb90f6480 2024-09-19T06:20:22.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.411+0000 7f9042ffc740 1 -- 172.21.15.2:0/196414588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cb90f6480 msgr2=0x563cb9118270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:22.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.411+0000 7f9042ffc740 1 --2- 172.21.15.2:0/196414588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cb90f6480 0x563cb9118270 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f9030006010 tx=0x7f9030005d60 comp rx=0 tx=0).stop 2024-09-19T06:20:22.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.411+0000 7f9042ffc740 1 -- 172.21.15.2:0/196414588 shutdown_connections 2024-09-19T06:20:22.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.411+0000 7f9042ffc740 1 --2- 172.21.15.2:0/196414588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563cb9100d40 0x563cb91187b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:22.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.411+0000 7f9042ffc740 1 --2- 172.21.15.2:0/196414588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cb90f6480 0x563cb9118270 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:22.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.411+0000 7f9042ffc740 1 --2- 172.21.15.2:0/196414588 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563cb90f5b60 0x563cb90fcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:22.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.411+0000 7f9042ffc740 1 -- 172.21.15.2:0/196414588 >> 172.21.15.2:0/196414588 conn(0x563cb90f20f0 msgr2=0x563cb90f7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:22.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.411+0000 7f9042ffc740 1 -- 172.21.15.2:0/196414588 shutdown_connections 2024-09-19T06:20:22.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.411+0000 7f9042ffc740 1 -- 172.21.15.2:0/196414588 wait complete. 2024-09-19T06:20:22.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.411+0000 7f9042ffc740 1 -- start start 2024-09-19T06:20:22.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.411+0000 7f9042ffc740 1 Processor -- start 2024-09-19T06:20:22.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.412+0000 7f9042ffc740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563cb90f5b60 0x563cb9108ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:22.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.412+0000 7f9042ffc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cb90f6480 0x563cb9109220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:22.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.412+0000 7f9042ffc740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563cb9100d40 0x563cb9105cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:22.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.412+0000 7f9042ffc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f903c1ade70 con 0x563cb90f6480 2024-09-19T06:20:22.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.412+0000 7f9042ffc740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f903c1af2e0 con 0x563cb9100d40 2024-09-19T06:20:22.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.412+0000 7f9042ffc740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f903c1ae540 con 0x563cb90f5b60 2024-09-19T06:20:22.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.412+0000 7f9042ffc740 10 client.0 _ll_register_callbacks cb 0x7f90340146b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:22.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.412+0000 7f9039d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cb90f6480 0x563cb9109220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:22.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.412+0000 7f9039d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cb90f6480 0x563cb9109220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32966/0 (socket says 172.21.15.2:32966) 2024-09-19T06:20:22.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.412+0000 7f9039d9b640 1 -- 172.21.15.2:0/2690285457 learned_addr learned my addr 172.21.15.2:0/2690285457 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:22.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.412+0000 7f903ad9d640 1 --2- 172.21.15.2:0/2690285457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563cb9100d40 0x563cb9105cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:22.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.412+0000 7f903a59c640 1 --2- 172.21.15.2:0/2690285457 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563cb90f5b60 0x563cb9108ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:22.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.412+0000 7f9039d9b640 1 -- 172.21.15.2:0/2690285457 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563cb90f5b60 msgr2=0x563cb9108ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:22.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.412+0000 7f9039d9b640 1 --2- 172.21.15.2:0/2690285457 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563cb90f5b60 0x563cb9108ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:22.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.412+0000 7f9039d9b640 1 -- 172.21.15.2:0/2690285457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563cb9100d40 msgr2=0x563cb9105cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:22.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.412+0000 7f9039d9b640 1 --2- 172.21.15.2:0/2690285457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563cb9100d40 0x563cb9105cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:22.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.412+0000 7f9039d9b640 1 -- 172.21.15.2:0/2690285457 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563cb9106270 con 0x563cb90f6480 2024-09-19T06:20:22.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.412+0000 7f903ad9d640 1 --2- 172.21.15.2:0/2690285457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563cb9100d40 0x563cb9105cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:22.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.413+0000 7f9039d9b640 1 --2- 172.21.15.2:0/2690285457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cb90f6480 0x563cb9109220 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f9030008350 tx=0x7f9030008b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f61276ae94a504 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:22.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.413+0000 7f9021ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:22.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.413+0000 7f9021ffb640 1 -- 172.21.15.2:0/2690285457 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903003c060 con 0x563cb90f6480 2024-09-19T06:20:22.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.413+0000 7f9021ffb640 1 -- 172.21.15.2:0/2690285457 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f90300189d0 con 0x563cb90f6480 2024-09-19T06:20:22.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.413+0000 7f9042ffc740 1 -- 172.21.15.2:0/2690285457 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90300052a0 con 0x563cb90f6480 2024-09-19T06:20:22.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.413+0000 7f9021ffb640 1 -- 172.21.15.2:0/2690285457 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9030018c30 con 0x563cb90f6480 2024-09-19T06:20:22.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.413+0000 7f9042ffc740 10 client.16800 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:22.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.413+0000 7f9042ffc740 1 -- 172.21.15.2:0/2690285457 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563cb917ba80 con 0x563cb90f6480 2024-09-19T06:20:22.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.413+0000 7f9021ffb640 1 -- 172.21.15.2:0/2690285457 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f90300052a0 con 0x563cb90f6480 2024-09-19T06:20:22.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.413+0000 7f9021ffb640 1 -- 172.21.15.2:0/2690285457 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f9030003680 con 0x563cb90f6480 2024-09-19T06:20:22.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.413+0000 7f9042ffc740 10 client.16800 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:22.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.413+0000 7f9042ffc740 10 client.16800 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:22.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.413+0000 7f9042ffc740 20 client.16800 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:22.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.413+0000 7f9042ffc740 1 --2- 172.21.15.2:0/2690285457 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563cb917c130 0x563cb917e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:22.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.414+0000 7f9042ffc740 4 client.16800 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:20:22.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.414+0000 7f9042ffc740 1 -- 172.21.15.2:0/2690285457 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563cb9062d00 con 0x563cb917c130 2024-09-19T06:20:22.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.414+0000 7f903a59c640 1 --2- 172.21.15.2:0/2690285457 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563cb917c130 0x563cb917e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:22.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.414+0000 7f9021ffb640 10 client.16800 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:22.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.414+0000 7f903a59c640 1 --2- 172.21.15.2:0/2690285457 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563cb917c130 0x563cb917e550 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=deb4d36be878d626 server_cookie=5159150019837fe in_seq=0 out_seq=0 2024-09-19T06:20:22.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.415+0000 7f9021ffb640 1 -- 172.21.15.2:0/2690285457 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563cb9062d00 con 0x563cb917c130 2024-09-19T06:20:22.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.415+0000 7f9021ffb640 10 client.16800 handle_command_reply: tid=0 2024-09-19T06:20:22.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.415+0000 7f9042ffc740 1 client.16800 shutdown 2024-09-19T06:20:22.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.416+0000 7f9042ffc740 1 -- 172.21.15.2:0/2690285457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cb90f6480 msgr2=0x563cb9109220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:22.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.416+0000 7f9042ffc740 1 --2- 172.21.15.2:0/2690285457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cb90f6480 0x563cb9109220 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f9030008350 tx=0x7f9030008b10 comp rx=0 tx=0).stop 2024-09-19T06:20:22.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.416+0000 7f9042ffc740 1 -- 172.21.15.2:0/2690285457 shutdown_connections 2024-09-19T06:20:22.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.416+0000 7f9042ffc740 1 --2- 172.21.15.2:0/2690285457 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563cb917c130 0x563cb917e550 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:22.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.416+0000 7f9042ffc740 1 --2- 172.21.15.2:0/2690285457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563cb9100d40 0x563cb9105cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:22.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.416+0000 7f9042ffc740 1 --2- 172.21.15.2:0/2690285457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563cb90f6480 0x563cb9109220 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:22.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.416+0000 7f9042ffc740 1 --2- 172.21.15.2:0/2690285457 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563cb90f5b60 0x563cb9108ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:22.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.416+0000 7f9042ffc740 1 -- 172.21.15.2:0/2690285457 >> 172.21.15.2:0/2690285457 conn(0x563cb90f20f0 msgr2=0x563cb90fdb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:22.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.416+0000 7f9021ffb640 0 client.16800 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:22.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.416+0000 7f9042ffc740 1 -- 172.21.15.2:0/2690285457 shutdown_connections 2024-09-19T06:20:22.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.416+0000 7f9042ffc740 1 -- 172.21.15.2:0/2690285457 wait complete. 2024-09-19T06:20:22.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.416+0000 7f9042ffc740 20 client.16800 trim_cache size 0 max 16384 2024-09-19T06:20:22.432 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:20:22.432 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T06:20:22.432 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "9c73dddc-aa9e-4789-9624-b9d09d209cac", 2024-09-19T06:20:22.432 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T06:20:22.432 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:20:22.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.416+0000 7f9040c23640 1 -- 172.21.15.2:0/3443393754 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f90240a33b0 msgr2=0x7f90240a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:22.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.416+0000 7f9040c23640 1 --2- 172.21.15.2:0/3443393754 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f90240a33b0 0x7f90240a5870 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9034007fd0 tx=0x7f9034007d60 comp rx=0 tx=0).stop 2024-09-19T06:20:22.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.416+0000 7f9040c23640 1 -- 172.21.15.2:0/3443393754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f903c102d40 msgr2=0x7f903c1009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:22.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.416+0000 7f9040c23640 1 --2- 172.21.15.2:0/3443393754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f903c102d40 0x7f903c1009a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f902c005ab0 tx=0x7f902c003d50 comp rx=0 tx=0).stop 2024-09-19T06:20:22.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.417+0000 7f9040c23640 1 -- 172.21.15.2:0/3443393754 shutdown_connections 2024-09-19T06:20:22.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.417+0000 7f9040c23640 1 --2- 172.21.15.2:0/3443393754 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f90240a33b0 0x7f90240a5870 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:22.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.417+0000 7f9040c23640 1 --2- 172.21.15.2:0/3443393754 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f903c10c170 0x7f903c101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:22.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.417+0000 7f9040c23640 1 --2- 172.21.15.2:0/3443393754 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f903c103660 0x7f903c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:22.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.417+0000 7f9040c23640 1 --2- 172.21.15.2:0/3443393754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f903c102d40 0x7f903c1009a0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:22.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.417+0000 7f9040c23640 1 -- 172.21.15.2:0/3443393754 >> 172.21.15.2:0/3443393754 conn(0x7f903c0fc7a0 msgr2=0x7f903c0fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:22.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.417+0000 7f9040c23640 1 -- 172.21.15.2:0/3443393754 shutdown_connections 2024-09-19T06:20:22.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:22.417+0000 7f9040c23640 1 -- 172.21.15.2:0/3443393754 wait complete. 2024-09-19T06:20:23.053 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:20:23.310 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:23.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.727+0000 7f4f8293a640 1 -- 172.21.15.2:0/2439206570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f7c10c170 msgr2=0x7f4f7c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:23.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.727+0000 7f4f8293a640 1 --2- 172.21.15.2:0/2439206570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f7c10c170 0x7f4f7c10e610 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f4f74009ca0 tx=0x7f4f7402a950 comp rx=0 tx=0).stop 2024-09-19T06:20:23.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.727+0000 7f4f8293a640 1 -- 172.21.15.2:0/2439206570 shutdown_connections 2024-09-19T06:20:23.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.727+0000 7f4f8293a640 1 --2- 172.21.15.2:0/2439206570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f7c10c170 0x7f4f7c10e610 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:23.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.727+0000 7f4f8293a640 1 --2- 172.21.15.2:0/2439206570 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f7c103660 0x7f4f7c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:23.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.727+0000 7f4f8293a640 1 --2- 172.21.15.2:0/2439206570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f7c102d40 0x7f4f7c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:23.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.727+0000 7f4f8293a640 1 -- 172.21.15.2:0/2439206570 >> 172.21.15.2:0/2439206570 conn(0x7f4f7c0fc7a0 msgr2=0x7f4f7c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:23.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.727+0000 7f4f8293a640 1 -- 172.21.15.2:0/2439206570 shutdown_connections 2024-09-19T06:20:23.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.727+0000 7f4f8293a640 1 -- 172.21.15.2:0/2439206570 wait complete. 2024-09-19T06:20:23.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.728+0000 7f4f8293a640 1 Processor -- start 2024-09-19T06:20:23.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.728+0000 7f4f8293a640 1 -- start start 2024-09-19T06:20:23.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.728+0000 7f4f8293a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f7c102d40 0x7f4f7c19a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:23.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.728+0000 7f4f8293a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f7c103660 0x7f4f7c19aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:23.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.728+0000 7f4f8293a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f7c10c170 0x7f4f7c19edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:23.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.728+0000 7f4f8293a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7c111e20 con 0x7f4f7c102d40 2024-09-19T06:20:23.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.728+0000 7f4f8293a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7c111ca0 con 0x7f4f7c103660 2024-09-19T06:20:23.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.728+0000 7f4f8293a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7c111fa0 con 0x7f4f7c10c170 2024-09-19T06:20:23.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.728+0000 7f4f7bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f7c102d40 0x7f4f7c19a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:23.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.728+0000 7f4f7bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f7c102d40 0x7f4f7c19a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32980/0 (socket says 172.21.15.2:32980) 2024-09-19T06:20:23.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.728+0000 7f4f7bfff640 1 -- 172.21.15.2:0/2534566055 learned_addr learned my addr 172.21.15.2:0/2534566055 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:23.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.728+0000 7f4f80ed7640 1 --2- 172.21.15.2:0/2534566055 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f7c10c170 0x7f4f7c19edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:23.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.728+0000 7f4f73fff640 1 --2- 172.21.15.2:0/2534566055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f7c103660 0x7f4f7c19aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:23.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.728+0000 7f4f7bfff640 1 -- 172.21.15.2:0/2534566055 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f7c10c170 msgr2=0x7f4f7c19edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:23.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.728+0000 7f4f7bfff640 1 --2- 172.21.15.2:0/2534566055 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f7c10c170 0x7f4f7c19edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:23.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.728+0000 7f4f7bfff640 1 -- 172.21.15.2:0/2534566055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f7c103660 msgr2=0x7f4f7c19aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:23.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.728+0000 7f4f7bfff640 1 --2- 172.21.15.2:0/2534566055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f7c103660 0x7f4f7c19aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:23.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.729+0000 7f4f7bfff640 1 -- 172.21.15.2:0/2534566055 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f7c19f4b0 con 0x7f4f7c102d40 2024-09-19T06:20:23.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.729+0000 7f4f80ed7640 1 --2- 172.21.15.2:0/2534566055 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f7c10c170 0x7f4f7c19edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:20:23.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.729+0000 7f4f73fff640 1 --2- 172.21.15.2:0/2534566055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f7c103660 0x7f4f7c19aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:20:23.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.729+0000 7f4f7bfff640 1 --2- 172.21.15.2:0/2534566055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f7c102d40 0x7f4f7c19a500 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c00d950 tx=0x7f4f6c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:23.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.729+0000 7f4f79ffb640 1 -- 172.21.15.2:0/2534566055 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c017070 con 0x7f4f7c102d40 2024-09-19T06:20:23.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.729+0000 7f4f8293a640 1 -- 172.21.15.2:0/2534566055 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f7c19f7a0 con 0x7f4f7c102d40 2024-09-19T06:20:23.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.729+0000 7f4f79ffb640 1 -- 172.21.15.2:0/2534566055 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4f6c009c30 con 0x7f4f7c102d40 2024-09-19T06:20:23.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.729+0000 7f4f79ffb640 1 -- 172.21.15.2:0/2534566055 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c00f620 con 0x7f4f7c102d40 2024-09-19T06:20:23.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.729+0000 7f4f8293a640 1 -- 172.21.15.2:0/2534566055 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f7c1a7080 con 0x7f4f7c102d40 2024-09-19T06:20:23.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.731+0000 7f4f84d13740 1 Processor -- start 2024-09-19T06:20:23.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.731+0000 7f4f79ffb640 1 -- 172.21.15.2:0/2534566055 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f4f6c0109a0 con 0x7f4f7c102d40 2024-09-19T06:20:23.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.731+0000 7f4f84d13740 1 -- start start 2024-09-19T06:20:23.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.732+0000 7f4f84d13740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5587d88954a0 0x5587d8895880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:23.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.732+0000 7f4f84d13740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5587d8895dc0 0x5587d88a0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:23.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.732+0000 7f4f84d13740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5587d88a0680 0x5587d88a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:23.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.732+0000 7f4f84d13740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5587d87fb2e0 con 0x5587d8895dc0 2024-09-19T06:20:23.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.732+0000 7f4f84d13740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5587d87a2ce0 con 0x5587d88954a0 2024-09-19T06:20:23.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.732+0000 7f4f84d13740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5587d87f72a0 con 0x5587d88a0680 2024-09-19T06:20:23.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.732+0000 7f4f7bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5587d8895dc0 0x5587d88a0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:23.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.732+0000 7f4f7bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5587d8895dc0 0x5587d88a0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32982/0 (socket says 172.21.15.2:32982) 2024-09-19T06:20:23.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.732+0000 7f4f7bfff640 1 -- 172.21.15.2:0/2129065930 learned_addr learned my addr 172.21.15.2:0/2129065930 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:23.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.732+0000 7f4f80ed7640 1 --2- 172.21.15.2:0/2129065930 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5587d88954a0 0x5587d8895880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:23.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.732+0000 7f4f73fff640 1 --2- 172.21.15.2:0/2129065930 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5587d88a0680 0x5587d88a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:23.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.732+0000 7f4f7bfff640 1 -- 172.21.15.2:0/2129065930 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5587d88a0680 msgr2=0x5587d88a2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:23.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.732+0000 7f4f7bfff640 1 --2- 172.21.15.2:0/2129065930 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5587d88a0680 0x5587d88a2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:23.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.732+0000 7f4f7bfff640 1 -- 172.21.15.2:0/2129065930 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5587d88954a0 msgr2=0x5587d8895880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:23.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.732+0000 7f4f7bfff640 1 --2- 172.21.15.2:0/2129065930 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5587d88954a0 0x5587d8895880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:23.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.732+0000 7f4f7bfff640 1 -- 172.21.15.2:0/2129065930 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587d8787440 con 0x5587d8895dc0 2024-09-19T06:20:23.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.732+0000 7f4f79ffb640 1 --2- 172.21.15.2:0/2534566055 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4f680a33b0 0x7f4f680a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:23.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.733+0000 7f4f80ed7640 1 --2- 172.21.15.2:0/2534566055 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4f680a33b0 0x7f4f680a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:23.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.733+0000 7f4f7bfff640 1 --2- 172.21.15.2:0/2129065930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5587d8895dc0 0x5587d88a0140 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c0cca30 tx=0x7f4f6c0d5a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b34d4205dd20ecd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:23.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.733+0000 7f4f79ffb640 1 -- 172.21.15.2:0/2534566055 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f4f6c0cf310 con 0x7f4f7c102d40 2024-09-19T06:20:23.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.733+0000 7f4f727fc640 1 -- 172.21.15.2:0/2129065930 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c0978c0 con 0x5587d8895dc0 2024-09-19T06:20:23.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.733+0000 7f4f727fc640 1 -- 172.21.15.2:0/2129065930 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4f6c09bd20 con 0x5587d8895dc0 2024-09-19T06:20:23.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.733+0000 7f4f727fc640 1 -- 172.21.15.2:0/2129065930 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c018270 con 0x5587d8895dc0 2024-09-19T06:20:23.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.734+0000 7f4f84d13740 1 -- 172.21.15.2:0/2129065930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5587d8895dc0 msgr2=0x5587d88a0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:23.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.734+0000 7f4f84d13740 1 --2- 172.21.15.2:0/2129065930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5587d8895dc0 0x5587d88a0140 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c0cca30 tx=0x7f4f6c0d5a90 comp rx=0 tx=0).stop 2024-09-19T06:20:23.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.734+0000 7f4f80ed7640 1 --2- 172.21.15.2:0/2534566055 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4f680a33b0 0x7f4f680a5870 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4f74009430 tx=0x7f4f7403c040 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:23.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.734+0000 7f4f84d13740 1 -- 172.21.15.2:0/2129065930 shutdown_connections 2024-09-19T06:20:23.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.734+0000 7f4f84d13740 1 --2- 172.21.15.2:0/2129065930 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5587d88a0680 0x5587d88a2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:23.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.734+0000 7f4f84d13740 1 --2- 172.21.15.2:0/2129065930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5587d8895dc0 0x5587d88a0140 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:23.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.734+0000 7f4f84d13740 1 --2- 172.21.15.2:0/2129065930 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5587d88954a0 0x5587d8895880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:23.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.734+0000 7f4f84d13740 1 -- 172.21.15.2:0/2129065930 >> 172.21.15.2:0/2129065930 conn(0x5587d8891a30 msgr2=0x5587d8891e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:23.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.734+0000 7f4f84d13740 1 -- 172.21.15.2:0/2129065930 shutdown_connections 2024-09-19T06:20:23.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.734+0000 7f4f84d13740 1 -- 172.21.15.2:0/2129065930 wait complete. 2024-09-19T06:20:23.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.734+0000 7f4f84d13740 1 -- start start 2024-09-19T06:20:23.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.734+0000 7f4f84d13740 1 Processor -- start 2024-09-19T06:20:23.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.735+0000 7f4f84d13740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5587d88954a0 0x5587d889ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:23.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.735+0000 7f4f84d13740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5587d8895dc0 0x5587d889d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:23.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.735+0000 7f4f84d13740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5587d88a0680 0x5587d889d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:23.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.735+0000 7f4f84d13740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5587d88a31f0 con 0x5587d88a0680 2024-09-19T06:20:23.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.735+0000 7f4f84d13740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5587d87b6050 con 0x5587d88954a0 2024-09-19T06:20:23.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.735+0000 7f4f84d13740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5587d88a3370 con 0x5587d8895dc0 2024-09-19T06:20:23.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.735+0000 7f4f84d13740 10 client.0 _ll_register_callbacks cb 0x5587d87f6160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:23.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.735+0000 7f4f80ed7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5587d88a0680 0x5587d889d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:23.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.735+0000 7f4f80ed7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5587d88a0680 0x5587d889d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32996/0 (socket says 172.21.15.2:32996) 2024-09-19T06:20:23.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.735+0000 7f4f80ed7640 1 -- 172.21.15.2:0/3126875442 learned_addr learned my addr 172.21.15.2:0/3126875442 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:23.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.735+0000 7f4f73fff640 1 --2- 172.21.15.2:0/3126875442 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5587d8895dc0 0x5587d889d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:23.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.735+0000 7f4f7bfff640 1 --2- 172.21.15.2:0/3126875442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5587d88954a0 0x5587d889ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:23.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.735+0000 7f4f80ed7640 1 -- 172.21.15.2:0/3126875442 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5587d8895dc0 msgr2=0x5587d889d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:23.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.735+0000 7f4f80ed7640 1 --2- 172.21.15.2:0/3126875442 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5587d8895dc0 0x5587d889d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:23.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.735+0000 7f4f80ed7640 1 -- 172.21.15.2:0/3126875442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5587d88954a0 msgr2=0x5587d889ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:23.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.735+0000 7f4f80ed7640 1 --2- 172.21.15.2:0/3126875442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5587d88954a0 0x5587d889ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:23.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.735+0000 7f4f80ed7640 1 -- 172.21.15.2:0/3126875442 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587d856c3c0 con 0x5587d88a0680 2024-09-19T06:20:23.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.735+0000 7f4f7bfff640 1 --2- 172.21.15.2:0/3126875442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5587d88954a0 0x5587d889ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:23.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.736+0000 7f4f80ed7640 1 --2- 172.21.15.2:0/3126875442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5587d88a0680 0x5587d889d7a0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f4f7402fcc0 tx=0x7f4f7402a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37f0125484c7469a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:23.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.736+0000 7f4f5b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:23.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.736+0000 7f4f5b7fe640 1 -- 172.21.15.2:0/3126875442 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f74034050 con 0x5587d88a0680 2024-09-19T06:20:23.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.736+0000 7f4f84d13740 1 -- 172.21.15.2:0/3126875442 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f6c09bd20 con 0x5587d88a0680 2024-09-19T06:20:23.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.736+0000 7f4f5b7fe640 1 -- 172.21.15.2:0/3126875442 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f4f74004450 con 0x5587d88a0680 2024-09-19T06:20:23.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.736+0000 7f4f5b7fe640 1 -- 172.21.15.2:0/3126875442 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4f7402f690 con 0x5587d88a0680 2024-09-19T06:20:23.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.736+0000 7f4f84d13740 10 client.16812 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:23.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.736+0000 7f4f84d13740 1 -- 172.21.15.2:0/3126875442 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5587d88aeba0 con 0x5587d88a0680 2024-09-19T06:20:23.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.736+0000 7f4f5b7fe640 1 -- 172.21.15.2:0/3126875442 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4f6c09bd20 con 0x5587d88a0680 2024-09-19T06:20:23.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.736+0000 7f4f5b7fe640 1 -- 172.21.15.2:0/3126875442 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f4f7404f070 con 0x5587d88a0680 2024-09-19T06:20:23.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.736+0000 7f4f84d13740 10 client.16812 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:23.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.736+0000 7f4f84d13740 10 client.16812 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:23.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.736+0000 7f4f84d13740 20 client.16812 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:23.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.736+0000 7f4f84d13740 1 --2- 172.21.15.2:0/3126875442 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5587d88b0070 0x5587d88b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:23.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.736+0000 7f4f84d13740 4 client.16812 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:23.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.736+0000 7f4f84d13740 1 -- 172.21.15.2:0/3126875442 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5587d8808850 con 0x5587d88b0070 2024-09-19T06:20:23.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.737+0000 7f4f7bfff640 1 --2- 172.21.15.2:0/3126875442 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5587d88b0070 0x5587d88b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:23.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.737+0000 7f4f5b7fe640 10 client.16812 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:23.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.737+0000 7f4f7bfff640 1 --2- 172.21.15.2:0/3126875442 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5587d88b0070 0x5587d88b24d0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72e15ec888a7bd8a server_cookie=e14d3be525fd386f in_seq=0 out_seq=0 2024-09-19T06:20:23.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.738+0000 7f4f5b7fe640 1 -- 172.21.15.2:0/3126875442 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5587d8808850 con 0x5587d88b0070 2024-09-19T06:20:23.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.738+0000 7f4f5b7fe640 10 client.16812 handle_command_reply: tid=0 2024-09-19T06:20:23.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.738+0000 7f4f84d13740 1 client.16812 shutdown 2024-09-19T06:20:23.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.738+0000 7f4f84d13740 1 -- 172.21.15.2:0/3126875442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5587d88a0680 msgr2=0x5587d889d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:23.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.738+0000 7f4f84d13740 1 --2- 172.21.15.2:0/3126875442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5587d88a0680 0x5587d889d7a0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f4f7402fcc0 tx=0x7f4f7402a950 comp rx=0 tx=0).stop 2024-09-19T06:20:23.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.738+0000 7f4f84d13740 1 -- 172.21.15.2:0/3126875442 shutdown_connections 2024-09-19T06:20:23.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.738+0000 7f4f84d13740 1 --2- 172.21.15.2:0/3126875442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5587d88a0680 0x5587d889d7a0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:23.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.738+0000 7f4f84d13740 1 --2- 172.21.15.2:0/3126875442 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5587d8895dc0 0x5587d889d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:23.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.738+0000 7f4f84d13740 1 --2- 172.21.15.2:0/3126875442 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5587d88b0070 0x5587d88b24d0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:23.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.738+0000 7f4f84d13740 1 --2- 172.21.15.2:0/3126875442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5587d88954a0 0x5587d889ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:23.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.738+0000 7f4f84d13740 1 -- 172.21.15.2:0/3126875442 >> 172.21.15.2:0/3126875442 conn(0x5587d8891a30 msgr2=0x5587d8897760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:23.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.738+0000 7f4f5b7fe640 0 client.16812 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:23.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.738+0000 7f4f84d13740 1 -- 172.21.15.2:0/3126875442 shutdown_connections 2024-09-19T06:20:23.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.738+0000 7f4f84d13740 1 -- 172.21.15.2:0/3126875442 wait complete. 2024-09-19T06:20:23.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.738+0000 7f4f84d13740 20 client.16812 trim_cache size 0 max 16384 2024-09-19T06:20:23.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.755+0000 7f4f84d13740 1 Processor -- start 2024-09-19T06:20:23.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.755+0000 7f4f84d13740 1 -- start start 2024-09-19T06:20:23.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.756+0000 7f4f84d13740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5587d88954a0 0x5587d88ac450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:23.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.756+0000 7f4f84d13740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5587d8895dc0 0x5587d88b7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:23.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.756+0000 7f4f84d13740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5587d88a0680 0x5587d88b82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:23.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.756+0000 7f4f84d13740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7c1b22e0 con 0x5587d88954a0 2024-09-19T06:20:23.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.756+0000 7f4f84d13740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7c1afbb0 con 0x5587d8895dc0 2024-09-19T06:20:23.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.756+0000 7f4f84d13740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7c1ada00 con 0x5587d88a0680 2024-09-19T06:20:23.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.756+0000 7f4f7bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5587d88954a0 0x5587d88ac450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:23.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.756+0000 7f4f7bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5587d88954a0 0x5587d88ac450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33000/0 (socket says 172.21.15.2:33000) 2024-09-19T06:20:23.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.756+0000 7f4f7bfff640 1 -- 172.21.15.2:0/3182714868 learned_addr learned my addr 172.21.15.2:0/3182714868 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:23.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.756+0000 7f4f73fff640 1 --2- 172.21.15.2:0/3182714868 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5587d8895dc0 0x5587d88b7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:23.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.756+0000 7f4f80ed7640 1 --2- 172.21.15.2:0/3182714868 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5587d88a0680 0x5587d88b82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:23.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.756+0000 7f4f7bfff640 1 -- 172.21.15.2:0/3182714868 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5587d88a0680 msgr2=0x5587d88b82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:23.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.756+0000 7f4f7bfff640 1 --2- 172.21.15.2:0/3182714868 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5587d88a0680 0x5587d88b82e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:23.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.756+0000 7f4f7bfff640 1 -- 172.21.15.2:0/3182714868 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5587d8895dc0 msgr2=0x5587d88b7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:23.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.756+0000 7f4f7bfff640 1 --2- 172.21.15.2:0/3182714868 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5587d8895dc0 0x5587d88b7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:23.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.756+0000 7f4f7bfff640 1 -- 172.21.15.2:0/3182714868 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587d8891860 con 0x5587d88954a0 2024-09-19T06:20:23.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.756+0000 7f4f7bfff640 1 --2- 172.21.15.2:0/3182714868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5587d88954a0 0x5587d88ac450 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c0a3d60 tx=0x7f4f6c09e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73852c430a26d31b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:23.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.756+0000 7f4f71ffb640 1 -- 172.21.15.2:0/3182714868 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c020040 con 0x5587d88954a0 2024-09-19T06:20:23.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.756+0000 7f4f71ffb640 1 -- 172.21.15.2:0/3182714868 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4f6c09bd20 con 0x5587d88954a0 2024-09-19T06:20:23.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.756+0000 7f4f71ffb640 1 -- 172.21.15.2:0/3182714868 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c09af80 con 0x5587d88954a0 2024-09-19T06:20:23.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.757+0000 7f4f84d13740 1 -- 172.21.15.2:0/3182714868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5587d88954a0 msgr2=0x5587d88ac450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:23.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.757+0000 7f4f84d13740 1 --2- 172.21.15.2:0/3182714868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5587d88954a0 0x5587d88ac450 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c0a3d60 tx=0x7f4f6c09e040 comp rx=0 tx=0).stop 2024-09-19T06:20:23.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.757+0000 7f4f84d13740 1 -- 172.21.15.2:0/3182714868 shutdown_connections 2024-09-19T06:20:23.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.757+0000 7f4f84d13740 1 --2- 172.21.15.2:0/3182714868 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5587d88a0680 0x5587d88b82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:23.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.757+0000 7f4f84d13740 1 --2- 172.21.15.2:0/3182714868 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5587d8895dc0 0x5587d88b7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:23.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.757+0000 7f4f84d13740 1 --2- 172.21.15.2:0/3182714868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5587d88954a0 0x5587d88ac450 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:23.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.757+0000 7f4f84d13740 1 -- 172.21.15.2:0/3182714868 >> 172.21.15.2:0/3182714868 conn(0x5587d8891a30 msgr2=0x5587d8898900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:23.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.757+0000 7f4f84d13740 1 -- 172.21.15.2:0/3182714868 shutdown_connections 2024-09-19T06:20:23.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.757+0000 7f4f84d13740 1 -- 172.21.15.2:0/3182714868 wait complete. 2024-09-19T06:20:23.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.757+0000 7f4f84d13740 1 -- start start 2024-09-19T06:20:23.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.758+0000 7f4f84d13740 1 Processor -- start 2024-09-19T06:20:23.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.758+0000 7f4f84d13740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5587d88954a0 0x5587d88a3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:23.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.758+0000 7f4f84d13740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5587d8895dc0 0x5587d88a4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:23.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.758+0000 7f4f84d13740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5587d88a0680 0x5587d8918d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:23.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.758+0000 7f4f84d13740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7c1ae070 con 0x5587d88a0680 2024-09-19T06:20:23.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.758+0000 7f4f84d13740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7c1af4e0 con 0x5587d8895dc0 2024-09-19T06:20:23.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.758+0000 7f4f84d13740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7c1ae740 con 0x5587d88954a0 2024-09-19T06:20:23.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.758+0000 7f4f84d13740 10 client.0 _ll_register_callbacks cb 0x7f4f740099b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:23.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.758+0000 7f4f80ed7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5587d88a0680 0x5587d8918d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:23.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.758+0000 7f4f80ed7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5587d88a0680 0x5587d8918d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33002/0 (socket says 172.21.15.2:33002) 2024-09-19T06:20:23.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.758+0000 7f4f80ed7640 1 -- 172.21.15.2:0/3077041117 learned_addr learned my addr 172.21.15.2:0/3077041117 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:23.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.758+0000 7f4f7bfff640 1 --2- 172.21.15.2:0/3077041117 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5587d88954a0 0x5587d88a3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:23.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.758+0000 7f4f73fff640 1 --2- 172.21.15.2:0/3077041117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5587d8895dc0 0x5587d88a4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:23.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.758+0000 7f4f80ed7640 1 -- 172.21.15.2:0/3077041117 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5587d88954a0 msgr2=0x5587d88a3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:23.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.758+0000 7f4f80ed7640 1 --2- 172.21.15.2:0/3077041117 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5587d88954a0 0x5587d88a3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:23.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.758+0000 7f4f80ed7640 1 -- 172.21.15.2:0/3077041117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5587d8895dc0 msgr2=0x5587d88a4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:23.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.758+0000 7f4f80ed7640 1 --2- 172.21.15.2:0/3077041117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5587d8895dc0 0x5587d88a4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:23.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.758+0000 7f4f80ed7640 1 -- 172.21.15.2:0/3077041117 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587d8919320 con 0x5587d88a0680 2024-09-19T06:20:23.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.759+0000 7f4f80ed7640 1 --2- 172.21.15.2:0/3077041117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5587d88a0680 0x5587d8918d60 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f4f74030490 tx=0x7f4f740307c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=207a34c66c5537d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:23.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.759+0000 7f4f5b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:23.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.759+0000 7f4f5b7fe640 1 -- 172.21.15.2:0/3077041117 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f7405e030 con 0x5587d88a0680 2024-09-19T06:20:23.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.759+0000 7f4f5b7fe640 1 -- 172.21.15.2:0/3077041117 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f4f74030af0 con 0x5587d88a0680 2024-09-19T06:20:23.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.759+0000 7f4f84d13740 1 -- 172.21.15.2:0/3077041117 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f6c09bd20 con 0x5587d88a0680 2024-09-19T06:20:23.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.759+0000 7f4f5b7fe640 1 -- 172.21.15.2:0/3077041117 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4f7402f690 con 0x5587d88a0680 2024-09-19T06:20:23.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.759+0000 7f4f84d13740 10 client.16818 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:23.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.759+0000 7f4f84d13740 1 -- 172.21.15.2:0/3077041117 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5587d891a610 con 0x5587d88a0680 2024-09-19T06:20:23.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.759+0000 7f4f5b7fe640 1 -- 172.21.15.2:0/3077041117 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4f6c09bd20 con 0x5587d88a0680 2024-09-19T06:20:23.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.759+0000 7f4f5b7fe640 1 -- 172.21.15.2:0/3077041117 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f4f7404f040 con 0x5587d88a0680 2024-09-19T06:20:23.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.759+0000 7f4f84d13740 10 client.16818 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:23.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.759+0000 7f4f84d13740 10 client.16818 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:23.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.759+0000 7f4f84d13740 20 client.16818 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:23.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.760+0000 7f4f84d13740 1 --2- 172.21.15.2:0/3077041117 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5587d891acd0 0x5587d891d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:23.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.760+0000 7f4f84d13740 4 client.16818 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:20:23.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.760+0000 7f4f84d13740 1 -- 172.21.15.2:0/3077041117 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5587d8802d60 con 0x5587d891acd0 2024-09-19T06:20:23.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.760+0000 7f4f7bfff640 1 --2- 172.21.15.2:0/3077041117 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5587d891acd0 0x5587d891d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:23.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.760+0000 7f4f7bfff640 1 --2- 172.21.15.2:0/3077041117 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5587d891acd0 0x5587d891d0c0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24aa16aba2c4f8fb server_cookie=2594881c5e9655f0 in_seq=0 out_seq=0 2024-09-19T06:20:23.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.760+0000 7f4f5b7fe640 10 client.16818 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:23.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.760+0000 7f4f5b7fe640 1 -- 172.21.15.2:0/3077041117 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5587d8802d60 con 0x5587d891acd0 2024-09-19T06:20:23.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.760+0000 7f4f5b7fe640 10 client.16818 handle_command_reply: tid=0 2024-09-19T06:20:23.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.760+0000 7f4f84d13740 1 client.16818 shutdown 2024-09-19T06:20:23.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.761+0000 7f4f84d13740 1 -- 172.21.15.2:0/3077041117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5587d88a0680 msgr2=0x5587d8918d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:23.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.761+0000 7f4f84d13740 1 --2- 172.21.15.2:0/3077041117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5587d88a0680 0x5587d8918d60 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f4f74030490 tx=0x7f4f740307c0 comp rx=0 tx=0).stop 2024-09-19T06:20:23.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.761+0000 7f4f84d13740 1 -- 172.21.15.2:0/3077041117 shutdown_connections 2024-09-19T06:20:23.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.761+0000 7f4f84d13740 1 --2- 172.21.15.2:0/3077041117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5587d88a0680 0x5587d8918d60 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:23.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.761+0000 7f4f84d13740 1 --2- 172.21.15.2:0/3077041117 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5587d891acd0 0x5587d891d0c0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:23.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.761+0000 7f4f84d13740 1 --2- 172.21.15.2:0/3077041117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5587d8895dc0 0x5587d88a4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:23.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.761+0000 7f4f84d13740 1 --2- 172.21.15.2:0/3077041117 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5587d88954a0 0x5587d88a3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:23.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.761+0000 7f4f84d13740 1 -- 172.21.15.2:0/3077041117 >> 172.21.15.2:0/3077041117 conn(0x5587d8891a30 msgr2=0x5587d889eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:23.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.761+0000 7f4f5b7fe640 0 client.16818 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:23.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.761+0000 7f4f84d13740 1 -- 172.21.15.2:0/3077041117 shutdown_connections 2024-09-19T06:20:23.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.761+0000 7f4f84d13740 1 -- 172.21.15.2:0/3077041117 wait complete. 2024-09-19T06:20:23.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.761+0000 7f4f84d13740 20 client.16818 trim_cache size 0 max 16384 2024-09-19T06:20:23.769 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:20:23.769 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T06:20:23.769 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T06:20:23.769 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:20:23.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.761+0000 7f4f8293a640 1 -- 172.21.15.2:0/2534566055 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4f680a33b0 msgr2=0x7f4f680a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:23.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.761+0000 7f4f8293a640 1 --2- 172.21.15.2:0/2534566055 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4f680a33b0 0x7f4f680a5870 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4f74009430 tx=0x7f4f7403c040 comp rx=0 tx=0).stop 2024-09-19T06:20:23.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.761+0000 7f4f8293a640 1 -- 172.21.15.2:0/2534566055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f7c102d40 msgr2=0x7f4f7c19a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:23.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.761+0000 7f4f8293a640 1 --2- 172.21.15.2:0/2534566055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f7c102d40 0x7f4f7c19a500 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c00d950 tx=0x7f4f6c00de10 comp rx=0 tx=0).stop 2024-09-19T06:20:23.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.762+0000 7f4f8293a640 1 -- 172.21.15.2:0/2534566055 shutdown_connections 2024-09-19T06:20:23.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.762+0000 7f4f8293a640 1 --2- 172.21.15.2:0/2534566055 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4f680a33b0 0x7f4f680a5870 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:23.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.762+0000 7f4f8293a640 1 --2- 172.21.15.2:0/2534566055 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f7c10c170 0x7f4f7c19edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:23.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.762+0000 7f4f8293a640 1 --2- 172.21.15.2:0/2534566055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f7c103660 0x7f4f7c19aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:23.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.762+0000 7f4f8293a640 1 --2- 172.21.15.2:0/2534566055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f7c102d40 0x7f4f7c19a500 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:23.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.762+0000 7f4f8293a640 1 -- 172.21.15.2:0/2534566055 >> 172.21.15.2:0/2534566055 conn(0x7f4f7c0fc7a0 msgr2=0x7f4f7c101b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:23.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.762+0000 7f4f8293a640 1 -- 172.21.15.2:0/2534566055 shutdown_connections 2024-09-19T06:20:23.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:23.762+0000 7f4f8293a640 1 -- 172.21.15.2:0/2534566055 wait complete. 2024-09-19T06:20:24.070 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:23 smithi002 ceph-mon[30982]: pgmap v170: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:20:24.070 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:23 smithi002 ceph-mon[30982]: scrub queued for path: / 2024-09-19T06:20:24.070 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:23 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:24.071 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:23 smithi002 ceph-mon[30982]: scrub summary: active paths [/] 2024-09-19T06:20:24.071 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:23 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:24.071 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:23 smithi002 ceph-mon[30982]: scrub summary: idle 2024-09-19T06:20:24.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:23 smithi090 ceph-mon[34497]: pgmap v170: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:20:24.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:23 smithi090 ceph-mon[34497]: scrub queued for path: / 2024-09-19T06:20:24.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:23 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:24.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:23 smithi090 ceph-mon[34497]: scrub summary: active paths [/] 2024-09-19T06:20:24.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:23 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:24.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:23 smithi090 ceph-mon[34497]: scrub summary: idle 2024-09-19T06:20:24.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:23 smithi089 ceph-mon[34160]: pgmap v170: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:20:24.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:23 smithi089 ceph-mon[34160]: scrub queued for path: / 2024-09-19T06:20:24.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:23 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:24.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:23 smithi089 ceph-mon[34160]: scrub summary: active paths [/] 2024-09-19T06:20:24.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:23 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:24.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:23 smithi089 ceph-mon[34160]: scrub summary: idle 2024-09-19T06:20:24.394 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:20:24.395 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:20:24.651 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:25.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.075+0000 7fc7c1a1f640 1 -- 172.21.15.2:0/2251836364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7bc102d30 msgr2=0x7fc7bc103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:25.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.075+0000 7fc7c1a1f640 1 --2- 172.21.15.2:0/2251836364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7bc102d30 0x7fc7bc103110 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac009930 tx=0x7fc7ac02a420 comp rx=0 tx=0).stop 2024-09-19T06:20:25.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.075+0000 7fc7c1a1f640 1 -- 172.21.15.2:0/2251836364 shutdown_connections 2024-09-19T06:20:25.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.075+0000 7fc7c1a1f640 1 --2- 172.21.15.2:0/2251836364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7bc1082a0 0x7fc7bc10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:25.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.075+0000 7fc7c1a1f640 1 --2- 172.21.15.2:0/2251836364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7bc1036e0 0x7fc7bc107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:25.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.075+0000 7fc7c1a1f640 1 --2- 172.21.15.2:0/2251836364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7bc102d30 0x7fc7bc103110 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:25.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.075+0000 7fc7c1a1f640 1 -- 172.21.15.2:0/2251836364 >> 172.21.15.2:0/2251836364 conn(0x7fc7bc0fc7d0 msgr2=0x7fc7bc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:25.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.075+0000 7fc7c1a1f640 1 -- 172.21.15.2:0/2251836364 shutdown_connections 2024-09-19T06:20:25.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.075+0000 7fc7c1a1f640 1 -- 172.21.15.2:0/2251836364 wait complete. 2024-09-19T06:20:25.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.075+0000 7fc7c1a1f640 1 Processor -- start 2024-09-19T06:20:25.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.076+0000 7fc7c1a1f640 1 -- start start 2024-09-19T06:20:25.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.076+0000 7fc7c1a1f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7bc102d30 0x7fc7bc100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:25.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.076+0000 7fc7c1a1f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7bc1036e0 0x7fc7bc100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:25.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.076+0000 7fc7c1a1f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7bc1082a0 0x7fc7bc101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:25.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.076+0000 7fc7c1a1f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc7bc111f50 con 0x7fc7bc1082a0 2024-09-19T06:20:25.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.076+0000 7fc7c1a1f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc7bc111dd0 con 0x7fc7bc102d30 2024-09-19T06:20:25.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.076+0000 7fc7c1a1f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc7bc1120d0 con 0x7fc7bc1036e0 2024-09-19T06:20:25.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.076+0000 7fc7bb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7bc1082a0 0x7fc7bc101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:25.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.076+0000 7fc7bb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7bc1082a0 0x7fc7bc101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33016/0 (socket says 172.21.15.2:33016) 2024-09-19T06:20:25.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.076+0000 7fc7bb7fe640 1 -- 172.21.15.2:0/3622825175 learned_addr learned my addr 172.21.15.2:0/3622825175 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:25.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.076+0000 7fc7baffd640 1 --2- 172.21.15.2:0/3622825175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7bc102d30 0x7fc7bc100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:25.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.076+0000 7fc7ba7fc640 1 --2- 172.21.15.2:0/3622825175 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7bc1036e0 0x7fc7bc100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:25.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.076+0000 7fc7bb7fe640 1 -- 172.21.15.2:0/3622825175 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7bc1036e0 msgr2=0x7fc7bc100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:25.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.076+0000 7fc7bb7fe640 1 --2- 172.21.15.2:0/3622825175 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7bc1036e0 0x7fc7bc100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:25.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.076+0000 7fc7bb7fe640 1 -- 172.21.15.2:0/3622825175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7bc102d30 msgr2=0x7fc7bc100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:25.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.076+0000 7fc7bb7fe640 1 --2- 172.21.15.2:0/3622825175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7bc102d30 0x7fc7bc100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:25.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.076+0000 7fc7bb7fe640 1 -- 172.21.15.2:0/3622825175 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7bc1a6930 con 0x7fc7bc1082a0 2024-09-19T06:20:25.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.076+0000 7fc7ba7fc640 1 --2- 172.21.15.2:0/3622825175 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7bc1036e0 0x7fc7bc100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:25.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.077+0000 7fc7bb7fe640 1 --2- 172.21.15.2:0/3622825175 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7bc1082a0 0x7fc7bc101410 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fc7b400cad0 tx=0x7fc7b400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:25.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.077+0000 7fc7c0a1d640 1 -- 172.21.15.2:0/3622825175 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b400ae20 con 0x7fc7bc1082a0 2024-09-19T06:20:25.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.077+0000 7fc7c0a1d640 1 -- 172.21.15.2:0/3622825175 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc7b4005020 con 0x7fc7bc1082a0 2024-09-19T06:20:25.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.077+0000 7fc7c1a1f640 1 -- 172.21.15.2:0/3622825175 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7bc1a6c20 con 0x7fc7bc1082a0 2024-09-19T06:20:25.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.077+0000 7fc7c0a1d640 1 -- 172.21.15.2:0/3622825175 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b400f6b0 con 0x7fc7bc1082a0 2024-09-19T06:20:25.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.077+0000 7fc7c1a1f640 1 -- 172.21.15.2:0/3622825175 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7bc1a7160 con 0x7fc7bc1082a0 2024-09-19T06:20:25.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.078+0000 7fc7c1a1f640 1 -- 172.21.15.2:0/3622825175 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7bc06a850 con 0x7fc7bc1082a0 2024-09-19T06:20:25.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.079+0000 7fc7c0a1d640 1 -- 172.21.15.2:0/3622825175 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fc7b40051d0 con 0x7fc7bc1082a0 2024-09-19T06:20:25.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.080+0000 7fc7c0a1d640 1 --2- 172.21.15.2:0/3622825175 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc7a40a33b0 0x7fc7a40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:25.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.080+0000 7fc7baffd640 1 --2- 172.21.15.2:0/3622825175 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc7a40a33b0 0x7fc7a40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:25.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.080+0000 7fc7c0a1d640 1 -- 172.21.15.2:0/3622825175 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fc7b40cfd20 con 0x7fc7bc1082a0 2024-09-19T06:20:25.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.080+0000 7fc7baffd640 1 --2- 172.21.15.2:0/3622825175 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc7a40a33b0 0x7fc7a40a5870 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac006010 tx=0x7fc7ac000bc0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:25.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.084+0000 7fc7c0a1d640 1 -- 172.21.15.2:0/3622825175 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc7b4014030 con 0x7fc7bc1082a0 2024-09-19T06:20:25.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.296+0000 7fc7c1a1f640 1 -- 172.21.15.2:0/3622825175 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7bc10a2b0 con 0x7fc7bc1082a0 2024-09-19T06:20:25.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.297+0000 7fc7c0a1d640 1 -- 172.21.15.2:0/3622825175 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11882 (secure 0 0 0) 0x7fc7b409c6d0 con 0x7fc7bc1082a0 2024-09-19T06:20:25.300 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:20:25.300 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-09-19T06:14:49:104280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:14:48.191083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24470,24472,24497]},"id":1}]} 2024-09-19T06:20:25.300 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-09-19T06:20:25.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.299+0000 7fc7c1a1f640 1 -- 172.21.15.2:0/3622825175 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc7a40a33b0 msgr2=0x7fc7a40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:25.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.299+0000 7fc7c1a1f640 1 --2- 172.21.15.2:0/3622825175 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc7a40a33b0 0x7fc7a40a5870 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac006010 tx=0x7fc7ac000bc0 comp rx=0 tx=0).stop 2024-09-19T06:20:25.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.299+0000 7fc7c1a1f640 1 -- 172.21.15.2:0/3622825175 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7bc1082a0 msgr2=0x7fc7bc101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:25.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.299+0000 7fc7c1a1f640 1 --2- 172.21.15.2:0/3622825175 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7bc1082a0 0x7fc7bc101410 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fc7b400cad0 tx=0x7fc7b400cf90 comp rx=0 tx=0).stop 2024-09-19T06:20:25.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.299+0000 7fc7c1a1f640 1 -- 172.21.15.2:0/3622825175 shutdown_connections 2024-09-19T06:20:25.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.299+0000 7fc7c1a1f640 1 --2- 172.21.15.2:0/3622825175 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc7a40a33b0 0x7fc7a40a5870 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:25.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.299+0000 7fc7c1a1f640 1 --2- 172.21.15.2:0/3622825175 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7bc1082a0 0x7fc7bc101410 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:25.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.299+0000 7fc7c1a1f640 1 --2- 172.21.15.2:0/3622825175 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7bc1036e0 0x7fc7bc100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:25.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.299+0000 7fc7c1a1f640 1 --2- 172.21.15.2:0/3622825175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7bc102d30 0x7fc7bc100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:25.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.299+0000 7fc7c1a1f640 1 -- 172.21.15.2:0/3622825175 >> 172.21.15.2:0/3622825175 conn(0x7fc7bc0fc7d0 msgr2=0x7fc7bc105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:25.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.299+0000 7fc7c1a1f640 1 -- 172.21.15.2:0/3622825175 shutdown_connections 2024-09-19T06:20:25.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:25.299+0000 7fc7c1a1f640 1 -- 172.21.15.2:0/3622825175 wait complete. 2024-09-19T06:20:25.947 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:20:26.207 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:26.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:25 smithi002 ceph-mon[30982]: pgmap v171: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2024-09-19T06:20:26.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:25 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/3622825175' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:20:26.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:25 smithi090 ceph-mon[34497]: pgmap v171: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2024-09-19T06:20:26.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:25 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/3622825175' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:20:26.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:25 smithi089 ceph-mon[34160]: pgmap v171: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2024-09-19T06:20:26.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:25 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/3622825175' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:20:26.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.632+0000 7ff945140640 1 -- 172.21.15.2:0/56676368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff940102790 msgr2=0x7ff9401067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:26.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.632+0000 7ff945140640 1 --2- 172.21.15.2:0/56676368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff940102790 0x7ff9401067e0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7ff934009900 tx=0x7ff93402a410 comp rx=0 tx=0).stop 2024-09-19T06:20:26.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.632+0000 7ff945140640 1 -- 172.21.15.2:0/56676368 shutdown_connections 2024-09-19T06:20:26.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.632+0000 7ff945140640 1 --2- 172.21.15.2:0/56676368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff940106f10 0x7ff94010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:26.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.632+0000 7ff945140640 1 --2- 172.21.15.2:0/56676368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff940102790 0x7ff9401067e0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:26.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.632+0000 7ff945140640 1 --2- 172.21.15.2:0/56676368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff940101de0 0x7ff9401021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:26.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.632+0000 7ff945140640 1 -- 172.21.15.2:0/56676368 >> 172.21.15.2:0/56676368 conn(0x7ff9400fd8c0 msgr2=0x7ff9400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:26.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.632+0000 7ff945140640 1 -- 172.21.15.2:0/56676368 shutdown_connections 2024-09-19T06:20:26.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.632+0000 7ff945140640 1 -- 172.21.15.2:0/56676368 wait complete. 2024-09-19T06:20:26.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.633+0000 7ff945140640 1 Processor -- start 2024-09-19T06:20:26.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.633+0000 7ff945140640 1 -- start start 2024-09-19T06:20:26.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.634+0000 7ff945140640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff940101de0 0x7ff940198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:26.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.634+0000 7ff945140640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff940102790 0x7ff9401988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:26.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.634+0000 7ff945140640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff940106f10 0x7ff94019cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:26.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.634+0000 7ff945140640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff940111e20 con 0x7ff940102790 2024-09-19T06:20:26.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.634+0000 7ff945140640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff940111ca0 con 0x7ff940101de0 2024-09-19T06:20:26.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.634+0000 7ff945140640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff940111fa0 con 0x7ff940106f10 2024-09-19T06:20:26.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.634+0000 7ff93e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff940102790 0x7ff9401988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:26.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.634+0000 7ff93e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff940102790 0x7ff9401988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35852/0 (socket says 172.21.15.2:35852) 2024-09-19T06:20:26.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.634+0000 7ff93e59c640 1 -- 172.21.15.2:0/1701394663 learned_addr learned my addr 172.21.15.2:0/1701394663 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:26.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.634+0000 7ff93ed9d640 1 --2- 172.21.15.2:0/1701394663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff940101de0 0x7ff940198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:26.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.634+0000 7ff93f59e640 1 --2- 172.21.15.2:0/1701394663 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff940106f10 0x7ff94019cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:26.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.634+0000 7ff93e59c640 1 -- 172.21.15.2:0/1701394663 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff940106f10 msgr2=0x7ff94019cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:26.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.634+0000 7ff93e59c640 1 --2- 172.21.15.2:0/1701394663 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff940106f10 0x7ff94019cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:26.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.634+0000 7ff93e59c640 1 -- 172.21.15.2:0/1701394663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff940101de0 msgr2=0x7ff940198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:26.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.634+0000 7ff93e59c640 1 --2- 172.21.15.2:0/1701394663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff940101de0 0x7ff940198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:26.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.634+0000 7ff93e59c640 1 -- 172.21.15.2:0/1701394663 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff94019d310 con 0x7ff940102790 2024-09-19T06:20:26.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.634+0000 7ff93ed9d640 1 --2- 172.21.15.2:0/1701394663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff940101de0 0x7ff940198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:26.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.634+0000 7ff93e59c640 1 --2- 172.21.15.2:0/1701394663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff940102790 0x7ff9401988a0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7ff934005940 tx=0x7ff934004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:26.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.635+0000 7ff927fff640 1 -- 172.21.15.2:0/1701394663 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff93403f030 con 0x7ff940102790 2024-09-19T06:20:26.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.635+0000 7ff927fff640 1 -- 172.21.15.2:0/1701394663 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff934003aa0 con 0x7ff940102790 2024-09-19T06:20:26.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.635+0000 7ff945140640 1 -- 172.21.15.2:0/1701394663 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff94019d5a0 con 0x7ff940102790 2024-09-19T06:20:26.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.635+0000 7ff927fff640 1 -- 172.21.15.2:0/1701394663 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff934035070 con 0x7ff940102790 2024-09-19T06:20:26.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.635+0000 7ff945140640 1 -- 172.21.15.2:0/1701394663 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9401a4ee0 con 0x7ff940102790 2024-09-19T06:20:26.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.637+0000 7ff927fff640 1 -- 172.21.15.2:0/1701394663 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7ff934042030 con 0x7ff940102790 2024-09-19T06:20:26.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.637+0000 7ff947519740 1 Processor -- start 2024-09-19T06:20:26.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.637+0000 7ff947519740 1 -- start start 2024-09-19T06:20:26.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.638+0000 7ff947519740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1fefceb40 0x55c1fefcd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:26.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.638+0000 7ff947519740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c1fefcd5d0 0x55c1fefcda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:26.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.638+0000 7ff947519740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1fefdc780 0x55c1fefdeb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:26.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.638+0000 7ff947519740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c1fef332f0 con 0x55c1fefceb40 2024-09-19T06:20:26.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.638+0000 7ff947519740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55c1feedacf0 con 0x55c1fefdc780 2024-09-19T06:20:26.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.638+0000 7ff947519740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55c1fef2f2b0 con 0x55c1fefcd5d0 2024-09-19T06:20:26.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.638+0000 7ff93f59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1fefceb40 0x55c1fefcd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:26.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.638+0000 7ff93f59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1fefceb40 0x55c1fefcd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35854/0 (socket says 172.21.15.2:35854) 2024-09-19T06:20:26.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.638+0000 7ff93f59e640 1 -- 172.21.15.2:0/3127147676 learned_addr learned my addr 172.21.15.2:0/3127147676 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:26.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.638+0000 7ff93e59c640 1 --2- 172.21.15.2:0/3127147676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1fefdc780 0x55c1fefdeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:26.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.638+0000 7ff93ed9d640 1 --2- 172.21.15.2:0/3127147676 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c1fefcd5d0 0x55c1fefcda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:26.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.638+0000 7ff927fff640 1 --2- 172.21.15.2:0/1701394663 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff9280a33b0 0x7ff9280a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:26.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.638+0000 7ff93ed9d640 1 -- 172.21.15.2:0/3127147676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1fefdc780 msgr2=0x55c1fefdeb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:26.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.638+0000 7ff93ed9d640 1 --2- 172.21.15.2:0/3127147676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1fefdc780 0x55c1fefdeb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:26.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.638+0000 7ff93f59e640 1 --2- 172.21.15.2:0/1701394663 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff9280a33b0 0x7ff9280a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:26.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.638+0000 7ff93ed9d640 1 -- 172.21.15.2:0/3127147676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1fefceb40 msgr2=0x55c1fefcd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:26.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.638+0000 7ff93ed9d640 1 --2- 172.21.15.2:0/3127147676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1fefceb40 0x55c1fefcd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:26.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.638+0000 7ff93ed9d640 1 -- 172.21.15.2:0/3127147676 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1feebf3a0 con 0x55c1fefcd5d0 2024-09-19T06:20:26.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.638+0000 7ff927fff640 1 -- 172.21.15.2:0/1701394663 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7ff9340f03f0 con 0x7ff940102790 2024-09-19T06:20:26.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.639+0000 7ff93ed9d640 1 --2- 172.21.15.2:0/3127147676 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c1fefcd5d0 0x55c1fefcda10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff930005fd0 tx=0x7ff93000bf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e84219eaf66d863 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:26.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.639+0000 7ff93f59e640 1 --2- 172.21.15.2:0/1701394663 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff9280a33b0 0x7ff9280a5870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff938009fd0 tx=0x7ff938004ab0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:26.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.639+0000 7ff9257fa640 1 -- 172.21.15.2:0/3127147676 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff930011700 con 0x55c1fefcd5d0 2024-09-19T06:20:26.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.639+0000 7ff9257fa640 1 -- 172.21.15.2:0/3127147676 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff930011d50 con 0x55c1fefcd5d0 2024-09-19T06:20:26.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.639+0000 7ff9257fa640 1 -- 172.21.15.2:0/3127147676 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff93001a380 con 0x55c1fefcd5d0 2024-09-19T06:20:26.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.640+0000 7ff947519740 1 -- 172.21.15.2:0/3127147676 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c1fefcd5d0 msgr2=0x55c1fefcda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:26.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.640+0000 7ff947519740 1 --2- 172.21.15.2:0/3127147676 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c1fefcd5d0 0x55c1fefcda10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff930005fd0 tx=0x7ff93000bf90 comp rx=0 tx=0).stop 2024-09-19T06:20:26.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.640+0000 7ff947519740 1 -- 172.21.15.2:0/3127147676 shutdown_connections 2024-09-19T06:20:26.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.640+0000 7ff947519740 1 --2- 172.21.15.2:0/3127147676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1fefdc780 0x55c1fefdeb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:26.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.640+0000 7ff947519740 1 --2- 172.21.15.2:0/3127147676 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c1fefcd5d0 0x55c1fefcda10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:26.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.640+0000 7ff947519740 1 --2- 172.21.15.2:0/3127147676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1fefceb40 0x55c1fefcd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:26.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.640+0000 7ff947519740 1 -- 172.21.15.2:0/3127147676 >> 172.21.15.2:0/3127147676 conn(0x55c1fef96310 msgr2=0x55c1fefc9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:26.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.640+0000 7ff947519740 1 -- 172.21.15.2:0/3127147676 shutdown_connections 2024-09-19T06:20:26.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.640+0000 7ff947519740 1 -- 172.21.15.2:0/3127147676 wait complete. 2024-09-19T06:20:26.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.640+0000 7ff947519740 1 -- start start 2024-09-19T06:20:26.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.640+0000 7ff947519740 1 Processor -- start 2024-09-19T06:20:26.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.640+0000 7ff947519740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1fefcd5d0 0x55c1fefdc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:26.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.640+0000 7ff947519740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c1fefceb40 0x55c1fefd9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:26.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.640+0000 7ff947519740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1fefdc780 0x55c1fefd99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:26.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.640+0000 7ff947519740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c1fefdf480 con 0x55c1fefdc780 2024-09-19T06:20:26.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.640+0000 7ff947519740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55c1feeee060 con 0x55c1fefcd5d0 2024-09-19T06:20:26.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.640+0000 7ff947519740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55c1fefdf600 con 0x55c1fefceb40 2024-09-19T06:20:26.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.640+0000 7ff947519740 10 client.0 _ll_register_callbacks cb 0x55c1fec418c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:26.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.641+0000 7ff93f59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1fefdc780 0x55c1fefd99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:26.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.641+0000 7ff93ed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1fefcd5d0 0x55c1fefdc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:26.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.641+0000 7ff93e59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c1fefceb40 0x55c1fefd9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:26.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.641+0000 7ff93f59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1fefdc780 0x55c1fefd99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35858/0 (socket says 172.21.15.2:35858) 2024-09-19T06:20:26.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.641+0000 7ff93ed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1fefcd5d0 0x55c1fefdc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:49268/0 (socket says 172.21.15.2:49268) 2024-09-19T06:20:26.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.641+0000 7ff93f59e640 1 -- 172.21.15.2:0/18497155 learned_addr learned my addr 172.21.15.2:0/18497155 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:26.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.641+0000 7ff93f59e640 1 -- 172.21.15.2:0/18497155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c1fefceb40 msgr2=0x55c1fefd9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:26.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.641+0000 7ff93f59e640 1 --2- 172.21.15.2:0/18497155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c1fefceb40 0x55c1fefd9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:26.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.641+0000 7ff93f59e640 1 -- 172.21.15.2:0/18497155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1fefcd5d0 msgr2=0x55c1fefdc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:26.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.641+0000 7ff93f59e640 1 --2- 172.21.15.2:0/18497155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1fefcd5d0 0x55c1fefdc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:26.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.641+0000 7ff93f59e640 1 -- 172.21.15.2:0/18497155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1feca43c0 con 0x55c1fefdc780 2024-09-19T06:20:26.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.641+0000 7ff93ed9d640 1 --2- 172.21.15.2:0/18497155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1fefcd5d0 0x55c1fefdc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:26.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.641+0000 7ff93e59c640 1 --2- 172.21.15.2:0/18497155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c1fefceb40 0x55c1fefd9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:26.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.641+0000 7ff93f59e640 1 --2- 172.21.15.2:0/18497155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1fefdc780 0x55c1fefd99e0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7ff938010930 tx=0x7ff938004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=754fb372b1df78d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:26.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.641+0000 7ff922ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:26.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.641+0000 7ff922ff5640 1 -- 172.21.15.2:0/18497155 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff938026020 con 0x55c1fefdc780 2024-09-19T06:20:26.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.641+0000 7ff922ff5640 1 -- 172.21.15.2:0/18497155 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7ff938012bc0 con 0x55c1fefdc780 2024-09-19T06:20:26.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.641+0000 7ff947519740 1 -- 172.21.15.2:0/18497155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff930011d50 con 0x55c1fefdc780 2024-09-19T06:20:26.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.641+0000 7ff922ff5640 1 -- 172.21.15.2:0/18497155 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff93801a070 con 0x55c1fefdc780 2024-09-19T06:20:26.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.642+0000 7ff947519740 10 client.16836 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:26.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.642+0000 7ff947519740 1 -- 172.21.15.2:0/18497155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c1fefeaf60 con 0x55c1fefdc780 2024-09-19T06:20:26.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.642+0000 7ff922ff5640 1 -- 172.21.15.2:0/18497155 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff930011d50 con 0x55c1fefdc780 2024-09-19T06:20:26.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.642+0000 7ff922ff5640 1 -- 172.21.15.2:0/18497155 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7ff93800f040 con 0x55c1fefdc780 2024-09-19T06:20:26.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.642+0000 7ff947519740 10 client.16836 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:26.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.642+0000 7ff947519740 10 client.16836 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:20:26.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.642+0000 7ff947519740 20 client.16836 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:26.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.642+0000 7ff947519740 1 --2- 172.21.15.2:0/18497155 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55c1fefec420 0x55c1fefee810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:26.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.642+0000 7ff947519740 4 client.16836 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:26.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.642+0000 7ff947519740 1 -- 172.21.15.2:0/18497155 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c1fef40860 con 0x55c1fefec420 2024-09-19T06:20:26.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.642+0000 7ff93ed9d640 1 --2- 172.21.15.2:0/18497155 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55c1fefec420 0x55c1fefee810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:26.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.643+0000 7ff93ed9d640 1 --2- 172.21.15.2:0/18497155 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55c1fefec420 0x55c1fefee810 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=334cc5661d34f967 server_cookie=57fab7d2ba8b7cd6 in_seq=0 out_seq=0 2024-09-19T06:20:26.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.643+0000 7ff922ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:20:26.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.643+0000 7ff922ff5640 1 -- 172.21.15.2:0/18497155 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c1fef40860 con 0x55c1fefec420 2024-09-19T06:20:26.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.643+0000 7ff922ff5640 10 client.16836 handle_command_reply: tid=0 2024-09-19T06:20:26.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.643+0000 7ff947519740 1 client.16836 shutdown 2024-09-19T06:20:26.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.643+0000 7ff947519740 1 -- 172.21.15.2:0/18497155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1fefdc780 msgr2=0x55c1fefd99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:26.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.643+0000 7ff947519740 1 --2- 172.21.15.2:0/18497155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1fefdc780 0x55c1fefd99e0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7ff938010930 tx=0x7ff938004a40 comp rx=0 tx=0).stop 2024-09-19T06:20:26.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.644+0000 7ff947519740 1 -- 172.21.15.2:0/18497155 shutdown_connections 2024-09-19T06:20:26.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.644+0000 7ff947519740 1 --2- 172.21.15.2:0/18497155 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55c1fefec420 0x55c1fefee810 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:26.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.644+0000 7ff947519740 1 --2- 172.21.15.2:0/18497155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1fefdc780 0x55c1fefd99e0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:26.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.644+0000 7ff947519740 1 --2- 172.21.15.2:0/18497155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c1fefceb40 0x55c1fefd9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:26.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.644+0000 7ff947519740 1 --2- 172.21.15.2:0/18497155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1fefcd5d0 0x55c1fefdc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:26.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.644+0000 7ff922ff5640 0 client.16836 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:20:26.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.644+0000 7ff947519740 1 -- 172.21.15.2:0/18497155 >> 172.21.15.2:0/18497155 conn(0x55c1fef96310 msgr2=0x55c1fefcf960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:26.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.644+0000 7ff947519740 1 -- 172.21.15.2:0/18497155 shutdown_connections 2024-09-19T06:20:26.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.644+0000 7ff947519740 1 -- 172.21.15.2:0/18497155 wait complete. 2024-09-19T06:20:26.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.644+0000 7ff947519740 20 client.16836 trim_cache size 0 max 16384 2024-09-19T06:20:26.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.657+0000 7ff947519740 1 Processor -- start 2024-09-19T06:20:26.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.657+0000 7ff947519740 1 -- start start 2024-09-19T06:20:26.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.657+0000 7ff947519740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1fefcd5d0 0x55c1fefe8720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:26.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.657+0000 7ff947519740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1fefceb40 0x55c1fefc9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:26.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.657+0000 7ff947519740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c1fefdc780 0x55c1fefc9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:26.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.657+0000 7ff947519740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff9401ade30 con 0x55c1fefcd5d0 2024-09-19T06:20:26.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.657+0000 7ff947519740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff9401ab700 con 0x55c1fefceb40 2024-09-19T06:20:26.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.657+0000 7ff947519740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff9401a9570 con 0x55c1fefdc780 2024-09-19T06:20:26.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.657+0000 7ff93ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1fefcd5d0 0x55c1fefe8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:26.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.657+0000 7ff93ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1fefcd5d0 0x55c1fefe8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35872/0 (socket says 172.21.15.2:35872) 2024-09-19T06:20:26.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.657+0000 7ff93ed9d640 1 -- 172.21.15.2:0/2164365347 learned_addr learned my addr 172.21.15.2:0/2164365347 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:26.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.657+0000 7ff93e59c640 1 --2- 172.21.15.2:0/2164365347 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1fefceb40 0x55c1fefc9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:26.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.657+0000 7ff93f59e640 1 --2- 172.21.15.2:0/2164365347 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c1fefdc780 0x55c1fefc9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:26.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.657+0000 7ff93ed9d640 1 -- 172.21.15.2:0/2164365347 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c1fefdc780 msgr2=0x55c1fefc9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:26.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.657+0000 7ff93ed9d640 1 --2- 172.21.15.2:0/2164365347 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c1fefdc780 0x55c1fefc9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:26.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.657+0000 7ff93ed9d640 1 -- 172.21.15.2:0/2164365347 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1fefceb40 msgr2=0x55c1fefc9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:26.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.657+0000 7ff93ed9d640 1 --2- 172.21.15.2:0/2164365347 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1fefceb40 0x55c1fefc9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:26.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.657+0000 7ff93ed9d640 1 -- 172.21.15.2:0/2164365347 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1fefd0120 con 0x55c1fefcd5d0 2024-09-19T06:20:26.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.658+0000 7ff93ed9d640 1 --2- 172.21.15.2:0/2164365347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1fefcd5d0 0x55c1fefe8720 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7ff93000bdd0 tx=0x7ff930005d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3b978e7bc7f2524 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:26.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.658+0000 7ff924ff9640 1 -- 172.21.15.2:0/2164365347 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff93001c910 con 0x55c1fefcd5d0 2024-09-19T06:20:26.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.658+0000 7ff924ff9640 1 -- 172.21.15.2:0/2164365347 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff930005040 con 0x55c1fefcd5d0 2024-09-19T06:20:26.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.658+0000 7ff924ff9640 1 -- 172.21.15.2:0/2164365347 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9300048c0 con 0x55c1fefcd5d0 2024-09-19T06:20:26.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.658+0000 7ff947519740 1 -- 172.21.15.2:0/2164365347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1fefcd5d0 msgr2=0x55c1fefe8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:26.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.658+0000 7ff947519740 1 --2- 172.21.15.2:0/2164365347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1fefcd5d0 0x55c1fefe8720 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7ff93000bdd0 tx=0x7ff930005d40 comp rx=0 tx=0).stop 2024-09-19T06:20:26.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.658+0000 7ff947519740 1 -- 172.21.15.2:0/2164365347 shutdown_connections 2024-09-19T06:20:26.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.658+0000 7ff947519740 1 --2- 172.21.15.2:0/2164365347 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c1fefdc780 0x55c1fefc9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:26.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.658+0000 7ff947519740 1 --2- 172.21.15.2:0/2164365347 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1fefceb40 0x55c1fefc9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:26.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.658+0000 7ff947519740 1 --2- 172.21.15.2:0/2164365347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1fefcd5d0 0x55c1fefe8720 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:26.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.658+0000 7ff947519740 1 -- 172.21.15.2:0/2164365347 >> 172.21.15.2:0/2164365347 conn(0x55c1fef96310 msgr2=0x55c1fefd93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:26.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.658+0000 7ff947519740 1 -- 172.21.15.2:0/2164365347 shutdown_connections 2024-09-19T06:20:26.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.658+0000 7ff947519740 1 -- 172.21.15.2:0/2164365347 wait complete. 2024-09-19T06:20:26.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.659+0000 7ff947519740 1 -- start start 2024-09-19T06:20:26.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.659+0000 7ff947519740 1 Processor -- start 2024-09-19T06:20:26.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.659+0000 7ff947519740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1fefcd5d0 0x55c1fefe4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:26.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.659+0000 7ff947519740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c1fefceb40 0x55c1fefd60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:26.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.659+0000 7ff947519740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1fefdc780 0x55c1fefd6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:26.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.659+0000 7ff947519740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff9401a9bc0 con 0x55c1fefdc780 2024-09-19T06:20:26.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.659+0000 7ff947519740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff9401ab030 con 0x55c1fefcd5d0 2024-09-19T06:20:26.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.659+0000 7ff947519740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff9401aa290 con 0x55c1fefceb40 2024-09-19T06:20:26.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.659+0000 7ff947519740 10 client.0 _ll_register_callbacks cb 0x7ff938014110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:26.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.659+0000 7ff93f59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1fefdc780 0x55c1fefd6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:26.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.659+0000 7ff93ed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1fefcd5d0 0x55c1fefe4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:26.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.659+0000 7ff93ed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1fefcd5d0 0x55c1fefe4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:49298/0 (socket says 172.21.15.2:49298) 2024-09-19T06:20:26.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.659+0000 7ff93f59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1fefdc780 0x55c1fefd6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35878/0 (socket says 172.21.15.2:35878) 2024-09-19T06:20:26.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.659+0000 7ff93ed9d640 1 -- 172.21.15.2:0/1694848611 learned_addr learned my addr 172.21.15.2:0/1694848611 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:26.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.659+0000 7ff93e59c640 1 --2- 172.21.15.2:0/1694848611 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c1fefceb40 0x55c1fefd60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:26.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.660+0000 7ff93ed9d640 1 -- 172.21.15.2:0/1694848611 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c1fefceb40 msgr2=0x55c1fefd60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:26.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.660+0000 7ff93ed9d640 1 --2- 172.21.15.2:0/1694848611 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c1fefceb40 0x55c1fefd60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:26.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.660+0000 7ff93ed9d640 1 -- 172.21.15.2:0/1694848611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1fefdc780 msgr2=0x55c1fefd6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:26.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.660+0000 7ff93ed9d640 1 --2- 172.21.15.2:0/1694848611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1fefdc780 0x55c1fefd6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:26.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.660+0000 7ff93ed9d640 1 -- 172.21.15.2:0/1694848611 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1fefd6d10 con 0x55c1fefcd5d0 2024-09-19T06:20:26.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.660+0000 7ff93f59e640 1 --2- 172.21.15.2:0/1694848611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1fefdc780 0x55c1fefd6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:26.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.660+0000 7ff93ed9d640 1 --2- 172.21.15.2:0/1694848611 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1fefcd5d0 0x55c1fefe4ea0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff930000c00 tx=0x7ff93001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4b0f8940a5e7e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:26.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.660+0000 7ff922ff5640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-09-19T06:20:26.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.660+0000 7ff922ff5640 1 -- 172.21.15.2:0/1694848611 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff93001c990 con 0x55c1fefcd5d0 2024-09-19T06:20:26.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.660+0000 7ff947519740 1 -- 172.21.15.2:0/1694848611 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff930005040 con 0x55c1fefcd5d0 2024-09-19T06:20:26.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.660+0000 7ff922ff5640 1 -- 172.21.15.2:0/1694848611 <== mon.2 v2:172.21.15.89:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7ff9300051f0 con 0x55c1fefcd5d0 2024-09-19T06:20:26.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.660+0000 7ff922ff5640 1 -- 172.21.15.2:0/1694848611 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff9300053f0 con 0x55c1fefcd5d0 2024-09-19T06:20:26.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.660+0000 7ff947519740 10 client.26201 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:26.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.660+0000 7ff947519740 1 -- 172.21.15.2:0/1694848611 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c1ff056f50 con 0x55c1fefcd5d0 2024-09-19T06:20:26.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.660+0000 7ff922ff5640 1 -- 172.21.15.2:0/1694848611 <== mon.2 v2:172.21.15.89:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff930005040 con 0x55c1fefcd5d0 2024-09-19T06:20:26.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.661+0000 7ff922ff5640 1 -- 172.21.15.2:0/1694848611 <== mon.2 v2:172.21.15.89:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7ff9300295d0 con 0x55c1fefcd5d0 2024-09-19T06:20:26.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.661+0000 7ff947519740 10 client.26201 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:26.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.661+0000 7ff947519740 10 client.26201 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:20:26.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.661+0000 7ff947519740 20 client.26201 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:26.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.661+0000 7ff947519740 1 --2- 172.21.15.2:0/1694848611 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55c1ff0573c0 0x55c1ff0597b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:26.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.661+0000 7ff947519740 4 client.26201 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:20:26.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.661+0000 7ff947519740 1 -- 172.21.15.2:0/1694848611 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c1fef3ad70 con 0x55c1ff0573c0 2024-09-19T06:20:26.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.661+0000 7ff93e59c640 1 --2- 172.21.15.2:0/1694848611 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55c1ff0573c0 0x55c1ff0597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:26.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.661+0000 7ff93e59c640 1 --2- 172.21.15.2:0/1694848611 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55c1ff0573c0 0x55c1ff0597b0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7717f687b0169db8 server_cookie=d2c638a75c4d7f9c in_seq=0 out_seq=0 2024-09-19T06:20:26.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.661+0000 7ff922ff5640 10 client.26201 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:20:26.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.661+0000 7ff922ff5640 1 -- 172.21.15.2:0/1694848611 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c1fef3ad70 con 0x55c1ff0573c0 2024-09-19T06:20:26.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.661+0000 7ff922ff5640 10 client.26201 handle_command_reply: tid=0 2024-09-19T06:20:26.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.661+0000 7ff947519740 1 client.26201 shutdown 2024-09-19T06:20:26.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.661+0000 7ff947519740 1 -- 172.21.15.2:0/1694848611 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1fefcd5d0 msgr2=0x55c1fefe4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:26.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.661+0000 7ff947519740 1 --2- 172.21.15.2:0/1694848611 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1fefcd5d0 0x55c1fefe4ea0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff930000c00 tx=0x7ff93001c480 comp rx=0 tx=0).stop 2024-09-19T06:20:26.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.661+0000 7ff947519740 1 -- 172.21.15.2:0/1694848611 shutdown_connections 2024-09-19T06:20:26.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.661+0000 7ff947519740 1 --2- 172.21.15.2:0/1694848611 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55c1ff0573c0 0x55c1ff0597b0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:26.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.662+0000 7ff947519740 1 --2- 172.21.15.2:0/1694848611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1fefdc780 0x55c1fefd6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:26.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.662+0000 7ff922ff5640 0 client.26201 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:20:26.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.662+0000 7ff947519740 1 --2- 172.21.15.2:0/1694848611 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c1fefceb40 0x55c1fefd60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:26.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.662+0000 7ff947519740 1 --2- 172.21.15.2:0/1694848611 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c1fefcd5d0 0x55c1fefe4ea0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:26.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.662+0000 7ff947519740 1 -- 172.21.15.2:0/1694848611 >> 172.21.15.2:0/1694848611 conn(0x55c1fef96310 msgr2=0x55c1fefd78f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:26.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.662+0000 7ff947519740 1 -- 172.21.15.2:0/1694848611 shutdown_connections 2024-09-19T06:20:26.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.662+0000 7ff947519740 1 -- 172.21.15.2:0/1694848611 wait complete. 2024-09-19T06:20:26.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.662+0000 7ff947519740 20 client.26201 trim_cache size 0 max 16384 2024-09-19T06:20:26.685 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:20:26.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.662+0000 7ff945140640 1 -- 172.21.15.2:0/1701394663 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff9280a33b0 msgr2=0x7ff9280a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:26.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.662+0000 7ff945140640 1 --2- 172.21.15.2:0/1701394663 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff9280a33b0 0x7ff9280a5870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff938009fd0 tx=0x7ff938004ab0 comp rx=0 tx=0).stop 2024-09-19T06:20:26.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.662+0000 7ff945140640 1 -- 172.21.15.2:0/1701394663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff940102790 msgr2=0x7ff9401988a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:26.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.662+0000 7ff945140640 1 --2- 172.21.15.2:0/1701394663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff940102790 0x7ff9401988a0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7ff934005940 tx=0x7ff934004270 comp rx=0 tx=0).stop 2024-09-19T06:20:26.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.662+0000 7ff945140640 1 -- 172.21.15.2:0/1701394663 shutdown_connections 2024-09-19T06:20:26.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.662+0000 7ff945140640 1 --2- 172.21.15.2:0/1701394663 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff9280a33b0 0x7ff9280a5870 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:26.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.662+0000 7ff945140640 1 --2- 172.21.15.2:0/1701394663 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff940106f10 0x7ff94019cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:26.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.662+0000 7ff945140640 1 --2- 172.21.15.2:0/1701394663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff940102790 0x7ff9401988a0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:26.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.662+0000 7ff945140640 1 --2- 172.21.15.2:0/1701394663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff940101de0 0x7ff940198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:26.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.662+0000 7ff945140640 1 -- 172.21.15.2:0/1701394663 >> 172.21.15.2:0/1701394663 conn(0x7ff9400fd8c0 msgr2=0x7ff9400fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:26.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.663+0000 7ff945140640 1 -- 172.21.15.2:0/1701394663 shutdown_connections 2024-09-19T06:20:26.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:26.663+0000 7ff945140640 1 -- 172.21.15.2:0/1701394663 wait complete. 2024-09-19T06:20:27.388 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:20:27.646 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:28.017 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:27 smithi002 ceph-mon[30982]: pgmap v172: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:20:28.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.098+0000 7f41bb7a7640 1 -- 172.21.15.2:0/3898781415 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41b4103740 msgr2=0x7f41b4107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:28.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.098+0000 7f41bb7a7640 1 --2- 172.21.15.2:0/3898781415 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41b4103740 0x7f41b4107b80 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f41a8009930 tx=0x7f41a802a420 comp rx=0 tx=0).stop 2024-09-19T06:20:28.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.098+0000 7f41bb7a7640 1 -- 172.21.15.2:0/3898781415 shutdown_connections 2024-09-19T06:20:28.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.098+0000 7f41bb7a7640 1 --2- 172.21.15.2:0/3898781415 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41b4108290 0x7f41b410ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:28.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.098+0000 7f41bb7a7640 1 --2- 172.21.15.2:0/3898781415 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41b4103740 0x7f41b4107b80 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:28.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.098+0000 7f41bb7a7640 1 --2- 172.21.15.2:0/3898781415 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f41b4102d90 0x7f41b4103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:28.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.098+0000 7f41bb7a7640 1 -- 172.21.15.2:0/3898781415 >> 172.21.15.2:0/3898781415 conn(0x7f41b40fc7d0 msgr2=0x7f41b40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:28.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.098+0000 7f41bb7a7640 1 -- 172.21.15.2:0/3898781415 shutdown_connections 2024-09-19T06:20:28.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.098+0000 7f41bb7a7640 1 -- 172.21.15.2:0/3898781415 wait complete. 2024-09-19T06:20:28.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.098+0000 7f41bb7a7640 1 Processor -- start 2024-09-19T06:20:28.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.098+0000 7f41bb7a7640 1 -- start start 2024-09-19T06:20:28.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.099+0000 7f41bb7a7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f41b4102d90 0x7f41b41984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:28.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.099+0000 7f41bb7a7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41b4103740 0x7f41b4198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:28.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.099+0000 7f41bb7a7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41b4108290 0x7f41b419cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:28.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.099+0000 7f41bb7a7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f41b4111f40 con 0x7f41b4103740 2024-09-19T06:20:28.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.099+0000 7f41bb7a7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f41b4111dc0 con 0x7f41b4108290 2024-09-19T06:20:28.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.099+0000 7f41bb7a7640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f41b41120c0 con 0x7f41b4102d90 2024-09-19T06:20:28.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.099+0000 7f41b8d42640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41b4103740 0x7f41b4198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:28.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.099+0000 7f41b8d42640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41b4103740 0x7f41b4198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35898/0 (socket says 172.21.15.2:35898) 2024-09-19T06:20:28.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.099+0000 7f41b8d42640 1 -- 172.21.15.2:0/486751357 learned_addr learned my addr 172.21.15.2:0/486751357 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:28.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.099+0000 7f41b9543640 1 --2- 172.21.15.2:0/486751357 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f41b4102d90 0x7f41b41984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:28.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.099+0000 7f41b9d44640 1 --2- 172.21.15.2:0/486751357 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41b4108290 0x7f41b419cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:28.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.099+0000 7f41b8d42640 1 -- 172.21.15.2:0/486751357 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f41b4102d90 msgr2=0x7f41b41984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:28.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.099+0000 7f41b8d42640 1 --2- 172.21.15.2:0/486751357 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f41b4102d90 0x7f41b41984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:28.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.099+0000 7f41b8d42640 1 -- 172.21.15.2:0/486751357 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41b4108290 msgr2=0x7f41b419cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:28.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.099+0000 7f41b8d42640 1 --2- 172.21.15.2:0/486751357 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41b4108290 0x7f41b419cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:28.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.099+0000 7f41b8d42640 1 -- 172.21.15.2:0/486751357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41b419d470 con 0x7f41b4103740 2024-09-19T06:20:28.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.099+0000 7f41b8d42640 1 --2- 172.21.15.2:0/486751357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41b4103740 0x7f41b4198a00 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f41a8009230 tx=0x7f41a8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:28.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.100+0000 7f41b27fc640 1 -- 172.21.15.2:0/486751357 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a803f030 con 0x7f41b4103740 2024-09-19T06:20:28.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.100+0000 7f41bb7a7640 1 -- 172.21.15.2:0/486751357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41b419d700 con 0x7f41b4103740 2024-09-19T06:20:28.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.100+0000 7f41b27fc640 1 -- 172.21.15.2:0/486751357 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f41a8003aa0 con 0x7f41b4103740 2024-09-19T06:20:28.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.100+0000 7f41b27fc640 1 -- 172.21.15.2:0/486751357 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a8035070 con 0x7f41b4103740 2024-09-19T06:20:28.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.100+0000 7f41bb7a7640 1 -- 172.21.15.2:0/486751357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41b41a5040 con 0x7f41b4103740 2024-09-19T06:20:28.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.102+0000 7f41b27fc640 1 -- 172.21.15.2:0/486751357 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f41a8042030 con 0x7f41b4103740 2024-09-19T06:20:28.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.102+0000 7f41bdb80740 1 Processor -- start 2024-09-19T06:20:28.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.103+0000 7f41bdb80740 1 -- start start 2024-09-19T06:20:28.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.103+0000 7f41b27fc640 1 --2- 172.21.15.2:0/486751357 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f419c0a33b0 0x7f419c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:28.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.103+0000 7f41bdb80740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e28808b40 0x559e28807090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:28.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.103+0000 7f41bdb80740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e288075d0 0x559e28807a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:28.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.103+0000 7f41bdb80740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e28816780 0x559e28818b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:28.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.103+0000 7f41bdb80740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559e2876d2f0 con 0x559e28816780 2024-09-19T06:20:28.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.103+0000 7f41bdb80740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x559e28714cf0 con 0x559e288075d0 2024-09-19T06:20:28.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.103+0000 7f41bdb80740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x559e287692b0 con 0x559e28808b40 2024-09-19T06:20:28.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.103+0000 7f41b9d44640 1 --2- 172.21.15.2:0/486751357 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f419c0a33b0 0x7f419c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:28.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.103+0000 7f41b27fc640 1 -- 172.21.15.2:0/486751357 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f41a80f0700 con 0x7f41b4103740 2024-09-19T06:20:28.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.103+0000 7f41b9d44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e28816780 0x559e28818b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:28.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.103+0000 7f41b8d42640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e288075d0 0x559e28807a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:28.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.103+0000 7f41b9d44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e28816780 0x559e28818b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35914/0 (socket says 172.21.15.2:35914) 2024-09-19T06:20:28.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.103+0000 7f41b9d44640 1 -- 172.21.15.2:0/1895512133 learned_addr learned my addr 172.21.15.2:0/1895512133 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:28.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.103+0000 7f41b8d42640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e288075d0 0x559e28807a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:49314/0 (socket says 172.21.15.2:49314) 2024-09-19T06:20:28.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.103+0000 7f41b9543640 1 --2- 172.21.15.2:0/1895512133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e28808b40 0x559e28807090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:28.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.103+0000 7f41b8d42640 1 -- 172.21.15.2:0/1895512133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e28808b40 msgr2=0x559e28807090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:28.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.104+0000 7f41b8d42640 1 --2- 172.21.15.2:0/1895512133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e28808b40 0x559e28807090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:28.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.104+0000 7f41b8d42640 1 -- 172.21.15.2:0/1895512133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e28816780 msgr2=0x559e28818b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:28.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.104+0000 7f41b8d42640 1 --2- 172.21.15.2:0/1895512133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e28816780 0x559e28818b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:28.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.104+0000 7f41b8d42640 1 -- 172.21.15.2:0/1895512133 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e286f93a0 con 0x559e288075d0 2024-09-19T06:20:28.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.104+0000 7f41b9d44640 1 --2- 172.21.15.2:0/1895512133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e28816780 0x559e28818b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:28.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.104+0000 7f41b9d44640 1 --2- 172.21.15.2:0/486751357 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f419c0a33b0 0x7f419c0a5870 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f41a40077f0 tx=0x7f41a4007e40 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:28.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.104+0000 7f41b8d42640 1 --2- 172.21.15.2:0/1895512133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e288075d0 0x559e28807a10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f41a80ede80 tx=0x7f41a80058b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7eb31625c41ba331 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:28.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.104+0000 7f419b7fe640 1 -- 172.21.15.2:0/1895512133 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a8049070 con 0x559e288075d0 2024-09-19T06:20:28.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.104+0000 7f419b7fe640 1 -- 172.21.15.2:0/1895512133 <== mon.2 v2:172.21.15.89:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f41a80cf320 con 0x559e288075d0 2024-09-19T06:20:28.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.104+0000 7f419b7fe640 1 -- 172.21.15.2:0/1895512133 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a803b460 con 0x559e288075d0 2024-09-19T06:20:28.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.105+0000 7f41bdb80740 1 -- 172.21.15.2:0/1895512133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e288075d0 msgr2=0x559e28807a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:28.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.105+0000 7f41bdb80740 1 --2- 172.21.15.2:0/1895512133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e288075d0 0x559e28807a10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f41a80ede80 tx=0x7f41a80058b0 comp rx=0 tx=0).stop 2024-09-19T06:20:28.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.105+0000 7f41bdb80740 1 -- 172.21.15.2:0/1895512133 shutdown_connections 2024-09-19T06:20:28.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.105+0000 7f41bdb80740 1 --2- 172.21.15.2:0/1895512133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e28816780 0x559e28818b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:28.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.105+0000 7f41bdb80740 1 --2- 172.21.15.2:0/1895512133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e288075d0 0x559e28807a10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:28.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.105+0000 7f41bdb80740 1 --2- 172.21.15.2:0/1895512133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e28808b40 0x559e28807090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:28.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.105+0000 7f41bdb80740 1 -- 172.21.15.2:0/1895512133 >> 172.21.15.2:0/1895512133 conn(0x559e287d0310 msgr2=0x559e28803c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:28.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.105+0000 7f41bdb80740 1 -- 172.21.15.2:0/1895512133 shutdown_connections 2024-09-19T06:20:28.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.105+0000 7f41bdb80740 1 -- 172.21.15.2:0/1895512133 wait complete. 2024-09-19T06:20:28.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.105+0000 7f41bdb80740 1 -- start start 2024-09-19T06:20:28.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.105+0000 7f41bdb80740 1 Processor -- start 2024-09-19T06:20:28.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.106+0000 7f41bdb80740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e288075d0 0x559e288161a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:28.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.106+0000 7f41bdb80740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e28808b40 0x559e28813450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:28.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.106+0000 7f41bdb80740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e28816780 0x559e28813a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:28.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.106+0000 7f41bdb80740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559e28819240 con 0x559e288075d0 2024-09-19T06:20:28.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.106+0000 7f41bdb80740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x559e28728060 con 0x559e28808b40 2024-09-19T06:20:28.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.106+0000 7f41bdb80740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x559e288193c0 con 0x559e28816780 2024-09-19T06:20:28.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.106+0000 7f41bdb80740 10 client.0 _ll_register_callbacks cb 0x559e2847b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:28.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.106+0000 7f41b9543640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e288075d0 0x559e288161a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:28.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.106+0000 7f41b9543640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e288075d0 0x559e288161a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35930/0 (socket says 172.21.15.2:35930) 2024-09-19T06:20:28.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.106+0000 7f41b9543640 1 -- 172.21.15.2:0/1483529863 learned_addr learned my addr 172.21.15.2:0/1483529863 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:28.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.106+0000 7f41b9d44640 1 --2- 172.21.15.2:0/1483529863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e28816780 0x559e28813a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:28.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.106+0000 7f41b8d42640 1 --2- 172.21.15.2:0/1483529863 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e28808b40 0x559e28813450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:28.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.106+0000 7f41b9543640 1 -- 172.21.15.2:0/1483529863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e28816780 msgr2=0x559e28813a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:28.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.106+0000 7f41b9543640 1 --2- 172.21.15.2:0/1483529863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e28816780 0x559e28813a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:28.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.106+0000 7f41b9543640 1 -- 172.21.15.2:0/1483529863 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e28808b40 msgr2=0x559e28813450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:28.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.106+0000 7f41b9543640 1 --2- 172.21.15.2:0/1483529863 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e28808b40 0x559e28813450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:28.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.106+0000 7f41b9543640 1 -- 172.21.15.2:0/1483529863 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e284de3c0 con 0x559e288075d0 2024-09-19T06:20:28.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.106+0000 7f41b9543640 1 --2- 172.21.15.2:0/1483529863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e288075d0 0x559e288161a0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f41ac010820 tx=0x7f41ac010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e723c0e61c17aa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:28.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.106+0000 7f4198ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:28.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.107+0000 7f4198ff9640 1 -- 172.21.15.2:0/1483529863 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41ac00fb90 con 0x559e288075d0 2024-09-19T06:20:28.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.107+0000 7f4198ff9640 1 -- 172.21.15.2:0/1483529863 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f41ac00fd30 con 0x559e288075d0 2024-09-19T06:20:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.107+0000 7f41bdb80740 1 -- 172.21.15.2:0/1483529863 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41a80cf320 con 0x559e288075d0 2024-09-19T06:20:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.107+0000 7f4198ff9640 1 -- 172.21.15.2:0/1483529863 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f41ac004020 con 0x559e288075d0 2024-09-19T06:20:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.107+0000 7f41bdb80740 10 client.16854 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.107+0000 7f41bdb80740 1 -- 172.21.15.2:0/1483529863 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x559e28824cb0 con 0x559e288075d0 2024-09-19T06:20:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.107+0000 7f4198ff9640 1 -- 172.21.15.2:0/1483529863 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f41a80cf320 con 0x559e288075d0 2024-09-19T06:20:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.107+0000 7f4198ff9640 1 -- 172.21.15.2:0/1483529863 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f41ac019410 con 0x559e288075d0 2024-09-19T06:20:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.107+0000 7f41bdb80740 10 client.16854 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.107+0000 7f41bdb80740 10 client.16854 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:20:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.107+0000 7f41bdb80740 20 client.16854 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.107+0000 7f41bdb80740 1 --2- 172.21.15.2:0/1483529863 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x559e28826170 0x559e288285f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.107+0000 7f41bdb80740 4 client.16854 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.107+0000 7f41bdb80740 1 -- 172.21.15.2:0/1483529863 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e2877a860 con 0x559e28826170 2024-09-19T06:20:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.108+0000 7f41b8d42640 1 --2- 172.21.15.2:0/1483529863 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x559e28826170 0x559e288285f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:28.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.108+0000 7f41b8d42640 1 --2- 172.21.15.2:0/1483529863 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x559e28826170 0x559e288285f0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=84b4f1d7f411c41b server_cookie=fa677c2f567a0738 in_seq=0 out_seq=0 2024-09-19T06:20:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.108+0000 7f4198ff9640 10 client.16854 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:20:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.109+0000 7f4198ff9640 1 -- 172.21.15.2:0/1483529863 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559e2877a860 con 0x559e28826170 2024-09-19T06:20:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.109+0000 7f4198ff9640 10 client.16854 handle_command_reply: tid=0 2024-09-19T06:20:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.109+0000 7f41bdb80740 1 client.16854 shutdown 2024-09-19T06:20:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.109+0000 7f41bdb80740 1 -- 172.21.15.2:0/1483529863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e288075d0 msgr2=0x559e288161a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.109+0000 7f41bdb80740 1 --2- 172.21.15.2:0/1483529863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e288075d0 0x559e288161a0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f41ac010820 tx=0x7f41ac010ce0 comp rx=0 tx=0).stop 2024-09-19T06:20:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.109+0000 7f41bdb80740 1 -- 172.21.15.2:0/1483529863 shutdown_connections 2024-09-19T06:20:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.109+0000 7f41bdb80740 1 --2- 172.21.15.2:0/1483529863 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x559e28826170 0x559e288285f0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.109+0000 7f41bdb80740 1 --2- 172.21.15.2:0/1483529863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e28816780 0x559e28813a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.109+0000 7f41bdb80740 1 --2- 172.21.15.2:0/1483529863 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e28808b40 0x559e28813450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.109+0000 7f41bdb80740 1 --2- 172.21.15.2:0/1483529863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e288075d0 0x559e288161a0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.109+0000 7f41bdb80740 1 -- 172.21.15.2:0/1483529863 >> 172.21.15.2:0/1483529863 conn(0x559e287d0310 msgr2=0x559e288099c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:28.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.109+0000 7f4198ff9640 0 client.16854 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:20:28.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.109+0000 7f41bdb80740 1 -- 172.21.15.2:0/1483529863 shutdown_connections 2024-09-19T06:20:28.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.109+0000 7f41bdb80740 1 -- 172.21.15.2:0/1483529863 wait complete. 2024-09-19T06:20:28.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.109+0000 7f41bdb80740 20 client.16854 trim_cache size 0 max 16384 2024-09-19T06:20:28.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.122+0000 7f41bdb80740 1 Processor -- start 2024-09-19T06:20:28.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.122+0000 7f41bdb80740 1 -- start start 2024-09-19T06:20:28.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.122+0000 7f41bdb80740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e288075d0 0x559e287fec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:28.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.122+0000 7f41bdb80740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e28808b40 0x559e28803e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:28.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.122+0000 7f41bdb80740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e28816780 0x559e288224a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:28.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.122+0000 7f41bdb80740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f41b41addf0 con 0x559e28808b40 2024-09-19T06:20:28.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.122+0000 7f41bdb80740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f41b41ab6c0 con 0x559e288075d0 2024-09-19T06:20:28.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.122+0000 7f41bdb80740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f41b41a9510 con 0x559e28816780 2024-09-19T06:20:28.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.122+0000 7f41b8d42640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e28808b40 0x559e28803e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:28.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.122+0000 7f41b8d42640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e28808b40 0x559e28803e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35936/0 (socket says 172.21.15.2:35936) 2024-09-19T06:20:28.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.122+0000 7f41b8d42640 1 -- 172.21.15.2:0/3831086505 learned_addr learned my addr 172.21.15.2:0/3831086505 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:28.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.123+0000 7f41b9543640 1 --2- 172.21.15.2:0/3831086505 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e288075d0 0x559e287fec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:28.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.123+0000 7f41b9d44640 1 --2- 172.21.15.2:0/3831086505 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e28816780 0x559e288224a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:28.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.123+0000 7f41b9543640 1 -- 172.21.15.2:0/3831086505 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e28816780 msgr2=0x559e288224a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:28.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.123+0000 7f41b9543640 1 --2- 172.21.15.2:0/3831086505 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e28816780 0x559e288224a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:28.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.123+0000 7f41b9543640 1 -- 172.21.15.2:0/3831086505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e28808b40 msgr2=0x559e28803e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:28.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.123+0000 7f41b9543640 1 --2- 172.21.15.2:0/3831086505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e28808b40 0x559e28803e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:28.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.123+0000 7f41b9543640 1 -- 172.21.15.2:0/3831086505 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e288147d0 con 0x559e288075d0 2024-09-19T06:20:28.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.123+0000 7f41b8d42640 1 --2- 172.21.15.2:0/3831086505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e28808b40 0x559e28803e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:28.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.123+0000 7f41b9543640 1 --2- 172.21.15.2:0/3831086505 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e288075d0 0x559e287fec60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f41ac019830 tx=0x7f41ac010430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67d97f3850fa20f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:28.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.123+0000 7f419affd640 1 -- 172.21.15.2:0/3831086505 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41ac0193e0 con 0x559e288075d0 2024-09-19T06:20:28.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.123+0000 7f419affd640 1 -- 172.21.15.2:0/3831086505 <== mon.2 v2:172.21.15.89:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f41ac019580 con 0x559e288075d0 2024-09-19T06:20:28.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.123+0000 7f419affd640 1 -- 172.21.15.2:0/3831086505 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41ac005030 con 0x559e288075d0 2024-09-19T06:20:28.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.124+0000 7f41bdb80740 1 -- 172.21.15.2:0/3831086505 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e288075d0 msgr2=0x559e287fec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:28.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.124+0000 7f41bdb80740 1 --2- 172.21.15.2:0/3831086505 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e288075d0 0x559e287fec60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f41ac019830 tx=0x7f41ac010430 comp rx=0 tx=0).stop 2024-09-19T06:20:28.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.124+0000 7f41bdb80740 1 -- 172.21.15.2:0/3831086505 shutdown_connections 2024-09-19T06:20:28.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.124+0000 7f41bdb80740 1 --2- 172.21.15.2:0/3831086505 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e28816780 0x559e288224a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:28.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.124+0000 7f41bdb80740 1 --2- 172.21.15.2:0/3831086505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e28808b40 0x559e28803e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:28.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.124+0000 7f41bdb80740 1 --2- 172.21.15.2:0/3831086505 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e288075d0 0x559e287fec60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:28.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.124+0000 7f41bdb80740 1 -- 172.21.15.2:0/3831086505 >> 172.21.15.2:0/3831086505 conn(0x559e287d0310 msgr2=0x559e28803700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:28.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.124+0000 7f41bdb80740 1 -- 172.21.15.2:0/3831086505 shutdown_connections 2024-09-19T06:20:28.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.124+0000 7f41bdb80740 1 -- 172.21.15.2:0/3831086505 wait complete. 2024-09-19T06:20:28.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.124+0000 7f41bdb80740 1 -- start start 2024-09-19T06:20:28.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.124+0000 7f41bdb80740 1 Processor -- start 2024-09-19T06:20:28.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.125+0000 7f41bdb80740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e288075d0 0x559e2881eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:28.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.125+0000 7f41bdb80740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e28808b40 0x559e28810290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:28.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.125+0000 7f41bdb80740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e28816780 0x559e288109d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:28.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.125+0000 7f41bdb80740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f41b41a9b80 con 0x559e28816780 2024-09-19T06:20:28.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.125+0000 7f41bdb80740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f41b41aaff0 con 0x559e28808b40 2024-09-19T06:20:28.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.125+0000 7f41bdb80740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f41b41aa250 con 0x559e288075d0 2024-09-19T06:20:28.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.125+0000 7f41bdb80740 10 client.0 _ll_register_callbacks cb 0x7f41ac00a6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:28.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.125+0000 7f41b9d44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e28816780 0x559e288109d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:28.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.125+0000 7f41b9d44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e28816780 0x559e288109d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35944/0 (socket says 172.21.15.2:35944) 2024-09-19T06:20:28.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.125+0000 7f41b9d44640 1 -- 172.21.15.2:0/883722921 learned_addr learned my addr 172.21.15.2:0/883722921 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:28.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.125+0000 7f41b9543640 1 --2- 172.21.15.2:0/883722921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e288075d0 0x559e2881eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:28.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.125+0000 7f41b8d42640 1 --2- 172.21.15.2:0/883722921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e28808b40 0x559e28810290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:28.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.125+0000 7f41b9d44640 1 -- 172.21.15.2:0/883722921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e288075d0 msgr2=0x559e2881eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:28.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.125+0000 7f41b9d44640 1 --2- 172.21.15.2:0/883722921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e288075d0 0x559e2881eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:28.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.125+0000 7f41b9d44640 1 -- 172.21.15.2:0/883722921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e28808b40 msgr2=0x559e28810290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:28.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.125+0000 7f41b9d44640 1 --2- 172.21.15.2:0/883722921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e28808b40 0x559e28810290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:28.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.125+0000 7f41b9d44640 1 -- 172.21.15.2:0/883722921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e2888fee0 con 0x559e28816780 2024-09-19T06:20:28.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.125+0000 7f41b8d42640 1 --2- 172.21.15.2:0/883722921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e28808b40 0x559e28810290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:28.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.125+0000 7f41b9543640 1 --2- 172.21.15.2:0/883722921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e288075d0 0x559e2881eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:28.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.125+0000 7f41b9d44640 1 --2- 172.21.15.2:0/883722921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e28816780 0x559e288109d0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f41a40126b0 tx=0x7f41a4007520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39bf1d087d1a7c7d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:28.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.125+0000 7f4198ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:28.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.126+0000 7f4198ff9640 1 -- 172.21.15.2:0/883722921 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a4004d20 con 0x559e28816780 2024-09-19T06:20:28.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.126+0000 7f4198ff9640 1 -- 172.21.15.2:0/883722921 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f41a4020630 con 0x559e28816780 2024-09-19T06:20:28.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.126+0000 7f41bdb80740 1 -- 172.21.15.2:0/883722921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41ac019580 con 0x559e28816780 2024-09-19T06:20:28.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.126+0000 7f4198ff9640 1 -- 172.21.15.2:0/883722921 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f41a4007a90 con 0x559e28816780 2024-09-19T06:20:28.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.126+0000 7f41bdb80740 10 client.16860 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:28.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.126+0000 7f41bdb80740 1 -- 172.21.15.2:0/883722921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x559e28891020 con 0x559e28816780 2024-09-19T06:20:28.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.126+0000 7f4198ff9640 1 -- 172.21.15.2:0/883722921 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f41ac019580 con 0x559e28816780 2024-09-19T06:20:28.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.126+0000 7f4198ff9640 1 -- 172.21.15.2:0/883722921 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f41a4005350 con 0x559e28816780 2024-09-19T06:20:28.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.126+0000 7f41bdb80740 10 client.16860 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:28.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.126+0000 7f41bdb80740 10 client.16860 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:20:28.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.126+0000 7f41bdb80740 20 client.16860 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:28.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.126+0000 7f41bdb80740 1 --2- 172.21.15.2:0/883722921 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x559e28891790 0x559e28893b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:28.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.126+0000 7f41bdb80740 4 client.16860 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:20:28.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.126+0000 7f41bdb80740 1 -- 172.21.15.2:0/883722921 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559e28774d70 con 0x559e28891790 2024-09-19T06:20:28.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.127+0000 7f41b9543640 1 --2- 172.21.15.2:0/883722921 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x559e28891790 0x559e28893b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:28.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.127+0000 7f4198ff9640 10 client.16860 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:20:28.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.127+0000 7f41b9543640 1 --2- 172.21.15.2:0/883722921 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x559e28891790 0x559e28893b80 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=505f5a3906bc9884 server_cookie=f043d426292e8d92 in_seq=0 out_seq=0 2024-09-19T06:20:28.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.127+0000 7f4198ff9640 1 -- 172.21.15.2:0/883722921 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559e28774d70 con 0x559e28891790 2024-09-19T06:20:28.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.127+0000 7f4198ff9640 10 client.16860 handle_command_reply: tid=0 2024-09-19T06:20:28.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.127+0000 7f41bdb80740 1 client.16860 shutdown 2024-09-19T06:20:28.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.127+0000 7f41bdb80740 1 -- 172.21.15.2:0/883722921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e28816780 msgr2=0x559e288109d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:28.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.127+0000 7f41bdb80740 1 --2- 172.21.15.2:0/883722921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e28816780 0x559e288109d0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f41a40126b0 tx=0x7f41a4007520 comp rx=0 tx=0).stop 2024-09-19T06:20:28.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.127+0000 7f41bdb80740 1 -- 172.21.15.2:0/883722921 shutdown_connections 2024-09-19T06:20:28.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.127+0000 7f41bdb80740 1 --2- 172.21.15.2:0/883722921 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x559e28891790 0x559e28893b80 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:28.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.127+0000 7f41bdb80740 1 --2- 172.21.15.2:0/883722921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e28816780 0x559e288109d0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:28.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.127+0000 7f41bdb80740 1 --2- 172.21.15.2:0/883722921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559e28808b40 0x559e28810290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:28.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.127+0000 7f4198ff9640 0 client.16860 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:20:28.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.127+0000 7f41bdb80740 1 --2- 172.21.15.2:0/883722921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e288075d0 0x559e2881eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:28.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.127+0000 7f41bdb80740 1 -- 172.21.15.2:0/883722921 >> 172.21.15.2:0/883722921 conn(0x559e287d0310 msgr2=0x559e288024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:28.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.128+0000 7f41bdb80740 1 -- 172.21.15.2:0/883722921 shutdown_connections 2024-09-19T06:20:28.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.128+0000 7f41bdb80740 1 -- 172.21.15.2:0/883722921 wait complete. 2024-09-19T06:20:28.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.128+0000 7f41bdb80740 20 client.16860 trim_cache size 0 max 16384 2024-09-19T06:20:28.136 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:20:28.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.128+0000 7f41bb7a7640 1 -- 172.21.15.2:0/486751357 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f419c0a33b0 msgr2=0x7f419c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:28.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.128+0000 7f41bb7a7640 1 --2- 172.21.15.2:0/486751357 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f419c0a33b0 0x7f419c0a5870 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f41a40077f0 tx=0x7f41a4007e40 comp rx=0 tx=0).stop 2024-09-19T06:20:28.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.128+0000 7f41bb7a7640 1 -- 172.21.15.2:0/486751357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41b4103740 msgr2=0x7f41b4198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:28.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.128+0000 7f41bb7a7640 1 --2- 172.21.15.2:0/486751357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41b4103740 0x7f41b4198a00 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f41a8009230 tx=0x7f41a8004270 comp rx=0 tx=0).stop 2024-09-19T06:20:28.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.128+0000 7f41bb7a7640 1 -- 172.21.15.2:0/486751357 shutdown_connections 2024-09-19T06:20:28.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.128+0000 7f41bb7a7640 1 --2- 172.21.15.2:0/486751357 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f419c0a33b0 0x7f419c0a5870 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:28.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.128+0000 7f41bb7a7640 1 --2- 172.21.15.2:0/486751357 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41b4108290 0x7f41b419cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:28.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.128+0000 7f41bb7a7640 1 --2- 172.21.15.2:0/486751357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41b4103740 0x7f41b4198a00 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:28.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.128+0000 7f41bb7a7640 1 --2- 172.21.15.2:0/486751357 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f41b4102d90 0x7f41b41984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:28.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.128+0000 7f41bb7a7640 1 -- 172.21.15.2:0/486751357 >> 172.21.15.2:0/486751357 conn(0x7f41b40fc7d0 msgr2=0x7f41b4105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:28.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.128+0000 7f41bb7a7640 1 -- 172.21.15.2:0/486751357 shutdown_connections 2024-09-19T06:20:28.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:28.128+0000 7f41bb7a7640 1 -- 172.21.15.2:0/486751357 wait complete. 2024-09-19T06:20:28.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:27 smithi090 ceph-mon[34497]: pgmap v172: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:20:28.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:27 smithi089 ceph-mon[34160]: pgmap v172: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:20:28.800 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:20:29.058 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:29.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.508+0000 7f7fad68e640 1 -- 172.21.15.2:0/1081145456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fa8103660 msgr2=0x7f7fa810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:29.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.508+0000 7f7fad68e640 1 --2- 172.21.15.2:0/1081145456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fa8103660 0x7f7fa810bb50 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f7f90009900 tx=0x7f7f9002a480 comp rx=0 tx=0).stop 2024-09-19T06:20:29.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.508+0000 7f7fad68e640 1 -- 172.21.15.2:0/1081145456 shutdown_connections 2024-09-19T06:20:29.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.508+0000 7f7fad68e640 1 --2- 172.21.15.2:0/1081145456 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7fa810c170 0x7f7fa810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:29.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.508+0000 7f7fad68e640 1 --2- 172.21.15.2:0/1081145456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fa8103660 0x7f7fa810bb50 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:29.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.508+0000 7f7fad68e640 1 --2- 172.21.15.2:0/1081145456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fa8102d40 0x7f7fa8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:29.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.508+0000 7f7fad68e640 1 -- 172.21.15.2:0/1081145456 >> 172.21.15.2:0/1081145456 conn(0x7f7fa80fc7a0 msgr2=0x7f7fa80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:29.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.508+0000 7f7fad68e640 1 -- 172.21.15.2:0/1081145456 shutdown_connections 2024-09-19T06:20:29.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.508+0000 7f7fad68e640 1 -- 172.21.15.2:0/1081145456 wait complete. 2024-09-19T06:20:29.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.509+0000 7f7fad68e640 1 Processor -- start 2024-09-19T06:20:29.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.509+0000 7f7fad68e640 1 -- start start 2024-09-19T06:20:29.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.509+0000 7f7fad68e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fa8102d40 0x7f7fa81983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:29.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.509+0000 7f7fad68e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fa8103660 0x7f7fa8198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:29.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.509+0000 7f7fad68e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7fa810c170 0x7f7fa819cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:29.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.509+0000 7f7fad68e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa8111e20 con 0x7f7fa8103660 2024-09-19T06:20:29.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.509+0000 7f7fad68e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa8111ca0 con 0x7f7fa8102d40 2024-09-19T06:20:29.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.509+0000 7f7fad68e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa8111fa0 con 0x7f7fa810c170 2024-09-19T06:20:29.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.509+0000 7f7f9e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fa8103660 0x7f7fa8198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:29.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.509+0000 7f7f9e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fa8103660 0x7f7fa8198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35966/0 (socket says 172.21.15.2:35966) 2024-09-19T06:20:29.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.509+0000 7f7f9e7fc640 1 -- 172.21.15.2:0/1713062599 learned_addr learned my addr 172.21.15.2:0/1713062599 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:29.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.509+0000 7f7fa6ffd640 1 --2- 172.21.15.2:0/1713062599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fa8102d40 0x7f7fa81983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:29.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.509+0000 7f7fa77fe640 1 --2- 172.21.15.2:0/1713062599 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7fa810c170 0x7f7fa819cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:29.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.510+0000 7f7f9e7fc640 1 -- 172.21.15.2:0/1713062599 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7fa810c170 msgr2=0x7f7fa819cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:29.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.510+0000 7f7f9e7fc640 1 --2- 172.21.15.2:0/1713062599 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7fa810c170 0x7f7fa819cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:29.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.510+0000 7f7f9e7fc640 1 -- 172.21.15.2:0/1713062599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fa8102d40 msgr2=0x7f7fa81983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:29.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.510+0000 7f7f9e7fc640 1 --2- 172.21.15.2:0/1713062599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fa8102d40 0x7f7fa81983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:29.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.510+0000 7f7f9e7fc640 1 -- 172.21.15.2:0/1713062599 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fa819d370 con 0x7f7fa8103660 2024-09-19T06:20:29.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.510+0000 7f7fa77fe640 1 --2- 172.21.15.2:0/1713062599 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7fa810c170 0x7f7fa819cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:20:29.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.510+0000 7f7f9e7fc640 1 --2- 172.21.15.2:0/1713062599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fa8103660 0x7f7fa8198900 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f7f90005940 tx=0x7f7f900040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:29.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.510+0000 7f7fa4ff9640 1 -- 172.21.15.2:0/1713062599 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9003f030 con 0x7f7fa8103660 2024-09-19T06:20:29.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.510+0000 7f7fa4ff9640 1 -- 172.21.15.2:0/1713062599 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7f900044c0 con 0x7f7fa8103660 2024-09-19T06:20:29.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.510+0000 7f7fad68e640 1 -- 172.21.15.2:0/1713062599 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fa819d600 con 0x7f7fa8103660 2024-09-19T06:20:29.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.510+0000 7f7fa4ff9640 1 -- 172.21.15.2:0/1713062599 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f90035070 con 0x7f7fa8103660 2024-09-19T06:20:29.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.510+0000 7f7fad68e640 1 -- 172.21.15.2:0/1713062599 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fa81a4f40 con 0x7f7fa8103660 2024-09-19T06:20:29.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.512+0000 7f7fa4ff9640 1 -- 172.21.15.2:0/1713062599 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f7f90042030 con 0x7f7fa8103660 2024-09-19T06:20:29.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.513+0000 7f7fafa67740 1 Processor -- start 2024-09-19T06:20:29.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.513+0000 7f7fafa67740 1 -- start start 2024-09-19T06:20:29.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.513+0000 7f7fafa67740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ac3715f50 0x562ac37144a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:29.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.513+0000 7f7fafa67740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ac37149e0 0x562ac3714e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:29.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.513+0000 7f7fa4ff9640 1 --2- 172.21.15.2:0/1713062599 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f7f940a33b0 0x7f7f940a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:29.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.513+0000 7f7fafa67740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ac371f780 0x562ac3721b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:29.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.513+0000 7f7fafa67740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562ac36762f0 con 0x562ac371f780 2024-09-19T06:20:29.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.513+0000 7f7fafa67740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562ac361dcf0 con 0x562ac3715f50 2024-09-19T06:20:29.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.513+0000 7f7fafa67740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562ac36722b0 con 0x562ac37149e0 2024-09-19T06:20:29.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.514+0000 7f7fa77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ac371f780 0x562ac3721b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:29.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.514+0000 7f7f9e7fc640 1 --2- 172.21.15.2:0/1713062599 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f7f940a33b0 0x7f7f940a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:29.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.514+0000 7f7fa77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ac371f780 0x562ac3721b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35972/0 (socket says 172.21.15.2:35972) 2024-09-19T06:20:29.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.514+0000 7f7fa77fe640 1 -- 172.21.15.2:0/1962186735 learned_addr learned my addr 172.21.15.2:0/1962186735 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:29.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.514+0000 7f7fa77fe640 1 --2- 172.21.15.2:0/1962186735 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ac3715f50 0x562ac37144a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:29.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.514+0000 7f7fa6ffd640 1 --2- 172.21.15.2:0/1962186735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ac37149e0 0x562ac3714e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:29.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.514+0000 7f7fa4ff9640 1 -- 172.21.15.2:0/1713062599 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f7f900f00e0 con 0x7f7fa8103660 2024-09-19T06:20:29.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.514+0000 7f7fa77fe640 1 -- 172.21.15.2:0/1962186735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ac37149e0 msgr2=0x562ac3714e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:29.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.514+0000 7f7fa77fe640 1 --2- 172.21.15.2:0/1962186735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ac37149e0 0x562ac3714e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:29.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.514+0000 7f7fa77fe640 1 -- 172.21.15.2:0/1962186735 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ac3715f50 msgr2=0x562ac37144a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:29.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.514+0000 7f7fa77fe640 1 --2- 172.21.15.2:0/1962186735 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ac3715f50 0x562ac37144a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:29.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.514+0000 7f7fa77fe640 1 -- 172.21.15.2:0/1962186735 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ac36023a0 con 0x562ac371f780 2024-09-19T06:20:29.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.514+0000 7f7f9e7fc640 1 --2- 172.21.15.2:0/1713062599 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f7f940a33b0 0x7f7f940a5870 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7f900ed910 tx=0x7f7f9002a480 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:29.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.514+0000 7f7fa77fe640 1 --2- 172.21.15.2:0/1962186735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ac371f780 0x562ac3721b70 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0013830 tx=0x7f7fa0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fa6d1f903abc0be server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:29.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.514+0000 7f7f9d7fa640 1 -- 172.21.15.2:0/1962186735 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa0019020 con 0x562ac371f780 2024-09-19T06:20:29.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.515+0000 7f7f9d7fa640 1 -- 172.21.15.2:0/1962186735 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7fa0003e20 con 0x562ac371f780 2024-09-19T06:20:29.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.515+0000 7f7f9d7fa640 1 -- 172.21.15.2:0/1962186735 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa0004290 con 0x562ac371f780 2024-09-19T06:20:29.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.515+0000 7f7fafa67740 1 -- 172.21.15.2:0/1962186735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ac371f780 msgr2=0x562ac3721b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:29.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.515+0000 7f7fafa67740 1 --2- 172.21.15.2:0/1962186735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ac371f780 0x562ac3721b70 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0013830 tx=0x7f7fa0009f90 comp rx=0 tx=0).stop 2024-09-19T06:20:29.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.515+0000 7f7fafa67740 1 -- 172.21.15.2:0/1962186735 shutdown_connections 2024-09-19T06:20:29.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.515+0000 7f7fafa67740 1 --2- 172.21.15.2:0/1962186735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ac371f780 0x562ac3721b70 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:29.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.515+0000 7f7fafa67740 1 --2- 172.21.15.2:0/1962186735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ac37149e0 0x562ac3714e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:29.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.515+0000 7f7fafa67740 1 --2- 172.21.15.2:0/1962186735 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ac3715f50 0x562ac37144a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:29.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.515+0000 7f7fafa67740 1 -- 172.21.15.2:0/1962186735 >> 172.21.15.2:0/1962186735 conn(0x562ac36d9310 msgr2=0x562ac3711070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:29.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.515+0000 7f7fafa67740 1 -- 172.21.15.2:0/1962186735 shutdown_connections 2024-09-19T06:20:29.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.515+0000 7f7fafa67740 1 -- 172.21.15.2:0/1962186735 wait complete. 2024-09-19T06:20:29.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.516+0000 7f7fafa67740 1 -- start start 2024-09-19T06:20:29.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.516+0000 7f7fafa67740 1 Processor -- start 2024-09-19T06:20:29.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.516+0000 7f7fafa67740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ac37149e0 0x562ac371f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:29.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.516+0000 7f7fafa67740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ac3715f50 0x562ac371c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:29.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.516+0000 7f7fafa67740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ac371f780 0x562ac371ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:29.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.516+0000 7f7fafa67740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562ac3722480 con 0x562ac3715f50 2024-09-19T06:20:29.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.516+0000 7f7fafa67740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562ac3631060 con 0x562ac371f780 2024-09-19T06:20:29.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.516+0000 7f7fafa67740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562ac3722600 con 0x562ac37149e0 2024-09-19T06:20:29.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.516+0000 7f7fafa67740 10 client.0 _ll_register_callbacks cb 0x562ac33848c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:29.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.516+0000 7f7fa6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ac3715f50 0x562ac371c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:29.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.516+0000 7f7fa6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ac3715f50 0x562ac371c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35986/0 (socket says 172.21.15.2:35986) 2024-09-19T06:20:29.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.516+0000 7f7fa6ffd640 1 -- 172.21.15.2:0/1278364029 learned_addr learned my addr 172.21.15.2:0/1278364029 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:29.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.516+0000 7f7fa77fe640 1 --2- 172.21.15.2:0/1278364029 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ac37149e0 0x562ac371f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:29.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.517+0000 7f7fa77fe640 1 --2- 172.21.15.2:0/1278364029 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ac371f780 0x562ac371ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:29.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.517+0000 7f7fa6ffd640 1 -- 172.21.15.2:0/1278364029 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ac37149e0 msgr2=0x562ac371f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:29.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.517+0000 7f7fa6ffd640 1 --2- 172.21.15.2:0/1278364029 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ac37149e0 0x562ac371f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:29.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.517+0000 7f7fa6ffd640 1 -- 172.21.15.2:0/1278364029 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ac371f780 msgr2=0x562ac371ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:29.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.517+0000 7f7fa6ffd640 1 --2- 172.21.15.2:0/1278364029 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ac371f780 0x562ac371ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:29.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.517+0000 7f7fa6ffd640 1 -- 172.21.15.2:0/1278364029 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ac33e73c0 con 0x562ac3715f50 2024-09-19T06:20:29.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.517+0000 7f7fa77fe640 1 --2- 172.21.15.2:0/1278364029 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ac371f780 0x562ac371ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:20:29.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.517+0000 7f7fa6ffd640 1 --2- 172.21.15.2:0/1278364029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ac3715f50 0x562ac371c420 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f7f98010820 tx=0x7f7f98010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=462f996ba545aa2a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:29.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.517+0000 7f7f8e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:29.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.517+0000 7f7f8e7fc640 1 -- 172.21.15.2:0/1278364029 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9800fb90 con 0x562ac3715f50 2024-09-19T06:20:29.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.517+0000 7f7f8e7fc640 1 -- 172.21.15.2:0/1278364029 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f7f9800fd30 con 0x562ac3715f50 2024-09-19T06:20:29.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.517+0000 7f7fafa67740 1 -- 172.21.15.2:0/1278364029 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fa0003e20 con 0x562ac3715f50 2024-09-19T06:20:29.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.517+0000 7f7f8e7fc640 1 -- 172.21.15.2:0/1278364029 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7f98005020 con 0x562ac3715f50 2024-09-19T06:20:29.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.517+0000 7f7fafa67740 10 client.16872 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:29.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.517+0000 7f7fafa67740 1 -- 172.21.15.2:0/1278364029 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562ac372df80 con 0x562ac3715f50 2024-09-19T06:20:29.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.517+0000 7f7f8e7fc640 1 -- 172.21.15.2:0/1278364029 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7fa0003e20 con 0x562ac3715f50 2024-09-19T06:20:29.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.518+0000 7f7f8e7fc640 1 -- 172.21.15.2:0/1278364029 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f7f98022430 con 0x562ac3715f50 2024-09-19T06:20:29.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.518+0000 7f7fafa67740 10 client.16872 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:29.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.518+0000 7f7fafa67740 10 client.16872 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:29.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.518+0000 7f7fafa67740 20 client.16872 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:29.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.518+0000 7f7fafa67740 1 --2- 172.21.15.2:0/1278364029 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562ac372f4e0 0x562ac3731900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:29.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.518+0000 7f7fafa67740 4 client.16872 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:29.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.518+0000 7f7fafa67740 1 -- 172.21.15.2:0/1278364029 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ac3683860 con 0x562ac372f4e0 2024-09-19T06:20:29.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.518+0000 7f7fa77fe640 1 --2- 172.21.15.2:0/1278364029 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562ac372f4e0 0x562ac3731900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:29.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.518+0000 7f7fa77fe640 1 --2- 172.21.15.2:0/1278364029 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562ac372f4e0 0x562ac3731900 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b1c7da2ea871794 server_cookie=af7b2fbf430d8d0c in_seq=0 out_seq=0 2024-09-19T06:20:29.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.518+0000 7f7f8e7fc640 10 client.16872 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:29.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.519+0000 7f7f8e7fc640 1 -- 172.21.15.2:0/1278364029 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562ac3683860 con 0x562ac372f4e0 2024-09-19T06:20:29.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.519+0000 7f7f8e7fc640 10 client.16872 handle_command_reply: tid=0 2024-09-19T06:20:29.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.519+0000 7f7fafa67740 1 client.16872 shutdown 2024-09-19T06:20:29.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.519+0000 7f7fafa67740 1 -- 172.21.15.2:0/1278364029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ac3715f50 msgr2=0x562ac371c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:29.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.519+0000 7f7fafa67740 1 --2- 172.21.15.2:0/1278364029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ac3715f50 0x562ac371c420 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f7f98010820 tx=0x7f7f98010ce0 comp rx=0 tx=0).stop 2024-09-19T06:20:29.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.519+0000 7f7fafa67740 1 -- 172.21.15.2:0/1278364029 shutdown_connections 2024-09-19T06:20:29.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.519+0000 7f7fafa67740 1 --2- 172.21.15.2:0/1278364029 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562ac372f4e0 0x562ac3731900 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:29.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.519+0000 7f7fafa67740 1 --2- 172.21.15.2:0/1278364029 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ac371f780 0x562ac371ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:29.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.519+0000 7f7fafa67740 1 --2- 172.21.15.2:0/1278364029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ac3715f50 0x562ac371c420 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:29.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.519+0000 7f7f8e7fc640 0 client.16872 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:29.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.519+0000 7f7fafa67740 1 --2- 172.21.15.2:0/1278364029 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ac37149e0 0x562ac371f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:29.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.519+0000 7f7fafa67740 1 -- 172.21.15.2:0/1278364029 >> 172.21.15.2:0/1278364029 conn(0x562ac36d9310 msgr2=0x562ac3716d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:29.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.519+0000 7f7fafa67740 1 -- 172.21.15.2:0/1278364029 shutdown_connections 2024-09-19T06:20:29.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.520+0000 7f7fafa67740 1 -- 172.21.15.2:0/1278364029 wait complete. 2024-09-19T06:20:29.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.520+0000 7f7fafa67740 20 client.16872 trim_cache size 0 max 16384 2024-09-19T06:20:29.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.532+0000 7f7fafa67740 1 Processor -- start 2024-09-19T06:20:29.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.532+0000 7f7fafa67740 1 -- start start 2024-09-19T06:20:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.533+0000 7f7fafa67740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ac37149e0 0x562ac371c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.533+0000 7f7fafa67740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ac3715f50 0x562ac372b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.533+0000 7f7fafa67740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ac371f780 0x562ac3720b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.533+0000 7f7fafa67740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa81ade70 con 0x562ac37149e0 2024-09-19T06:20:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.533+0000 7f7fafa67740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa81ab740 con 0x562ac371f780 2024-09-19T06:20:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.533+0000 7f7fafa67740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa81a9590 con 0x562ac3715f50 2024-09-19T06:20:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.533+0000 7f7fa77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ac37149e0 0x562ac371c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.533+0000 7f7fa77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ac37149e0 0x562ac371c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36000/0 (socket says 172.21.15.2:36000) 2024-09-19T06:20:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.533+0000 7f7fa77fe640 1 -- 172.21.15.2:0/3181397960 learned_addr learned my addr 172.21.15.2:0/3181397960 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.533+0000 7f7fa6ffd640 1 --2- 172.21.15.2:0/3181397960 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ac3715f50 0x562ac372b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.533+0000 7f7fa77fe640 1 -- 172.21.15.2:0/3181397960 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ac3715f50 msgr2=0x562ac372b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.533+0000 7f7fa77fe640 1 --2- 172.21.15.2:0/3181397960 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ac3715f50 0x562ac372b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.533+0000 7f7fa77fe640 1 -- 172.21.15.2:0/3181397960 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ac371f780 msgr2=0x562ac3720b70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:20:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.533+0000 7f7fa77fe640 1 --2- 172.21.15.2:0/3181397960 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ac371f780 0x562ac3720b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.533+0000 7f7fa77fe640 1 -- 172.21.15.2:0/3181397960 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ac371ed90 con 0x562ac37149e0 2024-09-19T06:20:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.533+0000 7f7fa6ffd640 1 --2- 172.21.15.2:0/3181397960 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ac3715f50 0x562ac372b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:20:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.533+0000 7f7fa77fe640 1 --2- 172.21.15.2:0/3181397960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ac37149e0 0x562ac371c3f0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x562ac3715480 tx=0x7f7fa0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=701d92628a767338 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.534+0000 7f7f9cff9640 1 -- 172.21.15.2:0/3181397960 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa0019040 con 0x562ac37149e0 2024-09-19T06:20:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.534+0000 7f7f9cff9640 1 -- 172.21.15.2:0/3181397960 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7fa0003e20 con 0x562ac37149e0 2024-09-19T06:20:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.534+0000 7f7f9cff9640 1 -- 172.21.15.2:0/3181397960 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa00052a0 con 0x562ac37149e0 2024-09-19T06:20:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.534+0000 7f7fafa67740 1 -- 172.21.15.2:0/3181397960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ac37149e0 msgr2=0x562ac371c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.534+0000 7f7fafa67740 1 --2- 172.21.15.2:0/3181397960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ac37149e0 0x562ac371c3f0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x562ac3715480 tx=0x7f7fa0009f90 comp rx=0 tx=0).stop 2024-09-19T06:20:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.534+0000 7f7fafa67740 1 -- 172.21.15.2:0/3181397960 shutdown_connections 2024-09-19T06:20:29.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.534+0000 7f7fafa67740 1 --2- 172.21.15.2:0/3181397960 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ac371f780 0x562ac3720b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:29.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.534+0000 7f7fafa67740 1 --2- 172.21.15.2:0/3181397960 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ac3715f50 0x562ac372b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:29.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.534+0000 7f7fafa67740 1 --2- 172.21.15.2:0/3181397960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ac37149e0 0x562ac371c3f0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:29.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.534+0000 7f7fafa67740 1 -- 172.21.15.2:0/3181397960 >> 172.21.15.2:0/3181397960 conn(0x562ac36d9310 msgr2=0x562ac371bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:29.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.534+0000 7f7fafa67740 1 -- 172.21.15.2:0/3181397960 shutdown_connections 2024-09-19T06:20:29.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.534+0000 7f7fafa67740 1 -- 172.21.15.2:0/3181397960 wait complete. 2024-09-19T06:20:29.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.535+0000 7f7fafa67740 1 -- start start 2024-09-19T06:20:29.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.535+0000 7f7fafa67740 1 Processor -- start 2024-09-19T06:20:29.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.535+0000 7f7fafa67740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ac37149e0 0x562ac3736760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:29.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.535+0000 7f7fafa67740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ac3715f50 0x562ac3736ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:29.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.535+0000 7f7fafa67740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ac371f780 0x562ac3726890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:29.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.535+0000 7f7fafa67740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa81a9c00 con 0x562ac3715f50 2024-09-19T06:20:29.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.535+0000 7f7fafa67740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa81ab070 con 0x562ac37149e0 2024-09-19T06:20:29.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.535+0000 7f7fafa67740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa81aa2d0 con 0x562ac371f780 2024-09-19T06:20:29.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.535+0000 7f7fafa67740 10 client.0 _ll_register_callbacks cb 0x7f7f9800a700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:29.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.535+0000 7f7fa6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ac3715f50 0x562ac3736ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:29.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.535+0000 7f7fa6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ac3715f50 0x562ac3736ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36002/0 (socket says 172.21.15.2:36002) 2024-09-19T06:20:29.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.535+0000 7f7fa6ffd640 1 -- 172.21.15.2:0/1135031395 learned_addr learned my addr 172.21.15.2:0/1135031395 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:29.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.535+0000 7f7fa77fe640 1 --2- 172.21.15.2:0/1135031395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ac37149e0 0x562ac3736760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:29.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.536+0000 7f7fa77fe640 1 --2- 172.21.15.2:0/1135031395 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ac371f780 0x562ac3726890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:29.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.536+0000 7f7fa6ffd640 1 -- 172.21.15.2:0/1135031395 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ac371f780 msgr2=0x562ac3726890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:29.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.536+0000 7f7fa6ffd640 1 --2- 172.21.15.2:0/1135031395 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ac371f780 0x562ac3726890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:29.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.536+0000 7f7fa6ffd640 1 -- 172.21.15.2:0/1135031395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ac37149e0 msgr2=0x562ac3736760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:29.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.536+0000 7f7fa6ffd640 1 --2- 172.21.15.2:0/1135031395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ac37149e0 0x562ac3736760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.536+0000 7f7fa6ffd640 1 -- 172.21.15.2:0/1135031395 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ac3726dd0 con 0x562ac3715f50 2024-09-19T06:20:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.536+0000 7f7fa77fe640 1 --2- 172.21.15.2:0/1135031395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ac37149e0 0x562ac3736760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.536+0000 7f7fa6ffd640 1 --2- 172.21.15.2:0/1135031395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ac3715f50 0x562ac3736ca0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f7f98022a40 tx=0x7f7f98005d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c73825d7d19b93a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.536+0000 7f7f8e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.536+0000 7f7f8e7fc640 1 -- 172.21.15.2:0/1135031395 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f98031060 con 0x562ac3715f50 2024-09-19T06:20:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.536+0000 7f7f8e7fc640 1 -- 172.21.15.2:0/1135031395 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f7f98022430 con 0x562ac3715f50 2024-09-19T06:20:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.536+0000 7f7fafa67740 1 -- 172.21.15.2:0/1135031395 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fa0003e20 con 0x562ac3715f50 2024-09-19T06:20:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.536+0000 7f7f8e7fc640 1 -- 172.21.15.2:0/1135031395 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7f98022650 con 0x562ac3715f50 2024-09-19T06:20:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.536+0000 7f7fafa67740 10 client.16878 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.536+0000 7f7fafa67740 1 -- 172.21.15.2:0/1135031395 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562ac3728060 con 0x562ac3715f50 2024-09-19T06:20:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.536+0000 7f7f8e7fc640 1 -- 172.21.15.2:0/1135031395 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7fa0003e20 con 0x562ac3715f50 2024-09-19T06:20:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.537+0000 7f7f8e7fc640 1 -- 172.21.15.2:0/1135031395 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f7f98004960 con 0x562ac3715f50 2024-09-19T06:20:29.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.537+0000 7f7fafa67740 10 client.16878 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:29.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.537+0000 7f7fafa67740 10 client.16878 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:29.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.537+0000 7f7fafa67740 20 client.16878 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:29.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.537+0000 7f7fafa67740 1 --2- 172.21.15.2:0/1135031395 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562ac379a2b0 0x562ac379c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:29.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.537+0000 7f7fafa67740 4 client.16878 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:20:29.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.537+0000 7f7fafa67740 1 -- 172.21.15.2:0/1135031395 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562ac367dd70 con 0x562ac379a2b0 2024-09-19T06:20:29.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.537+0000 7f7fa77fe640 1 --2- 172.21.15.2:0/1135031395 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562ac379a2b0 0x562ac379c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:29.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.538+0000 7f7fa77fe640 1 --2- 172.21.15.2:0/1135031395 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562ac379a2b0 0x562ac379c6d0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7bacc1912728377 server_cookie=7cdb899ceee2e6b3 in_seq=0 out_seq=0 2024-09-19T06:20:29.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.538+0000 7f7f8e7fc640 10 client.16878 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:29.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.538+0000 7f7f8e7fc640 1 -- 172.21.15.2:0/1135031395 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562ac367dd70 con 0x562ac379a2b0 2024-09-19T06:20:29.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.538+0000 7f7f8e7fc640 10 client.16878 handle_command_reply: tid=0 2024-09-19T06:20:29.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.538+0000 7f7fafa67740 1 client.16878 shutdown 2024-09-19T06:20:29.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.538+0000 7f7fafa67740 1 -- 172.21.15.2:0/1135031395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ac3715f50 msgr2=0x562ac3736ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:29.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.538+0000 7f7fafa67740 1 --2- 172.21.15.2:0/1135031395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ac3715f50 0x562ac3736ca0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f7f98022a40 tx=0x7f7f98005d70 comp rx=0 tx=0).stop 2024-09-19T06:20:29.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.538+0000 7f7fafa67740 1 -- 172.21.15.2:0/1135031395 shutdown_connections 2024-09-19T06:20:29.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.538+0000 7f7fafa67740 1 --2- 172.21.15.2:0/1135031395 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ac371f780 0x562ac3726890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:29.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.538+0000 7f7fafa67740 1 --2- 172.21.15.2:0/1135031395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ac3715f50 0x562ac3736ca0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:29.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.538+0000 7f7fafa67740 1 --2- 172.21.15.2:0/1135031395 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562ac379a2b0 0x562ac379c6d0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:29.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.538+0000 7f7f8e7fc640 0 client.16878 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:29.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.538+0000 7f7fafa67740 1 --2- 172.21.15.2:0/1135031395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ac37149e0 0x562ac3736760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:29.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.538+0000 7f7fafa67740 1 -- 172.21.15.2:0/1135031395 >> 172.21.15.2:0/1135031395 conn(0x562ac36d9310 msgr2=0x562ac371b510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:29.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.538+0000 7f7fafa67740 1 -- 172.21.15.2:0/1135031395 shutdown_connections 2024-09-19T06:20:29.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.538+0000 7f7fafa67740 1 -- 172.21.15.2:0/1135031395 wait complete. 2024-09-19T06:20:29.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.538+0000 7f7fafa67740 20 client.16878 trim_cache size 0 max 16384 2024-09-19T06:20:29.546 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:20:29.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.539+0000 7f7fad68e640 1 -- 172.21.15.2:0/1713062599 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f7f940a33b0 msgr2=0x7f7f940a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:29.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.539+0000 7f7fad68e640 1 --2- 172.21.15.2:0/1713062599 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f7f940a33b0 0x7f7f940a5870 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7f900ed910 tx=0x7f7f9002a480 comp rx=0 tx=0).stop 2024-09-19T06:20:29.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.539+0000 7f7fad68e640 1 -- 172.21.15.2:0/1713062599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fa8103660 msgr2=0x7f7fa8198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:29.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.539+0000 7f7fad68e640 1 --2- 172.21.15.2:0/1713062599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fa8103660 0x7f7fa8198900 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f7f90005940 tx=0x7f7f900040c0 comp rx=0 tx=0).stop 2024-09-19T06:20:29.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.539+0000 7f7fad68e640 1 -- 172.21.15.2:0/1713062599 shutdown_connections 2024-09-19T06:20:29.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.539+0000 7f7fad68e640 1 --2- 172.21.15.2:0/1713062599 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f7f940a33b0 0x7f7f940a5870 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:29.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.539+0000 7f7fad68e640 1 --2- 172.21.15.2:0/1713062599 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7fa810c170 0x7f7fa819cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:29.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.539+0000 7f7fad68e640 1 --2- 172.21.15.2:0/1713062599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fa8103660 0x7f7fa8198900 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:29.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.539+0000 7f7fad68e640 1 --2- 172.21.15.2:0/1713062599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fa8102d40 0x7f7fa81983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:29.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.539+0000 7f7fad68e640 1 -- 172.21.15.2:0/1713062599 >> 172.21.15.2:0/1713062599 conn(0x7f7fa80fc7a0 msgr2=0x7f7fa80fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:29.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.539+0000 7f7fad68e640 1 -- 172.21.15.2:0/1713062599 shutdown_connections 2024-09-19T06:20:29.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:29.539+0000 7f7fad68e640 1 -- 172.21.15.2:0/1713062599 wait complete. 2024-09-19T06:20:30.205 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:29 smithi002 ceph-mon[30982]: pgmap v173: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:20:30.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:29 smithi090 ceph-mon[34497]: pgmap v173: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:20:30.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:29 smithi089 ceph-mon[34160]: pgmap v173: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:20:31.235 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:20:31.235 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:20:31.506 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:31.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.969+0000 7fb6a077f640 1 -- 172.21.15.2:0/2638267073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb698106a80 msgr2=0x7fb698106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:31.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.969+0000 7fb6a077f640 1 --2- 172.21.15.2:0/2638267073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb698106a80 0x7fb698106e60 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fb694009930 tx=0x7fb69402a420 comp rx=0 tx=0).stop 2024-09-19T06:20:31.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.969+0000 7fb6a077f640 1 -- 172.21.15.2:0/2638267073 shutdown_connections 2024-09-19T06:20:31.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.969+0000 7fb6a077f640 1 --2- 172.21.15.2:0/2638267073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb698101420 0x7fb69810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:31.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.969+0000 7fb6a077f640 1 --2- 172.21.15.2:0/2638267073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb698100a80 0x7fb698100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:31.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.969+0000 7fb6a077f640 1 --2- 172.21.15.2:0/2638267073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb698106a80 0x7fb698106e60 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:31.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.969+0000 7fb6a077f640 1 -- 172.21.15.2:0/2638267073 >> 172.21.15.2:0/2638267073 conn(0x7fb6980fc7a0 msgr2=0x7fb6980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:31.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.969+0000 7fb6a077f640 1 -- 172.21.15.2:0/2638267073 shutdown_connections 2024-09-19T06:20:31.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.969+0000 7fb6a077f640 1 -- 172.21.15.2:0/2638267073 wait complete. 2024-09-19T06:20:31.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.970+0000 7fb6a077f640 1 Processor -- start 2024-09-19T06:20:31.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.970+0000 7fb6a077f640 1 -- start start 2024-09-19T06:20:31.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.970+0000 7fb6a077f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb698100a80 0x7fb6981983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:31.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.970+0000 7fb6a077f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb698101420 0x7fb698198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:31.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.970+0000 7fb6a077f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb698106a80 0x7fb69819ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:31.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.970+0000 7fb6a077f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb698111e50 con 0x7fb698100a80 2024-09-19T06:20:31.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.970+0000 7fb6a077f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb698111cd0 con 0x7fb698106a80 2024-09-19T06:20:31.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.970+0000 7fb6a077f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb698111fd0 con 0x7fb698101420 2024-09-19T06:20:31.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.970+0000 7fb69e51b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb698100a80 0x7fb6981983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:31.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.970+0000 7fb69e51b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb698100a80 0x7fb6981983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36014/0 (socket says 172.21.15.2:36014) 2024-09-19T06:20:31.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.970+0000 7fb69e51b640 1 -- 172.21.15.2:0/1521043257 learned_addr learned my addr 172.21.15.2:0/1521043257 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:31.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.970+0000 7fb69dd1a640 1 --2- 172.21.15.2:0/1521043257 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb698101420 0x7fb698198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:31.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.970+0000 7fb69ed1c640 1 --2- 172.21.15.2:0/1521043257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb698106a80 0x7fb69819ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:31.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.970+0000 7fb69e51b640 1 -- 172.21.15.2:0/1521043257 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb698101420 msgr2=0x7fb698198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:31.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.970+0000 7fb69e51b640 1 --2- 172.21.15.2:0/1521043257 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb698101420 0x7fb698198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:31.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.970+0000 7fb69e51b640 1 -- 172.21.15.2:0/1521043257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb698106a80 msgr2=0x7fb69819ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:31.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.970+0000 7fb69e51b640 1 --2- 172.21.15.2:0/1521043257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb698106a80 0x7fb69819ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:31.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.970+0000 7fb69e51b640 1 -- 172.21.15.2:0/1521043257 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb69819d3a0 con 0x7fb698100a80 2024-09-19T06:20:31.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.970+0000 7fb69ed1c640 1 --2- 172.21.15.2:0/1521043257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb698106a80 0x7fb69819ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:20:31.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.971+0000 7fb69e51b640 1 --2- 172.21.15.2:0/1521043257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb698100a80 0x7fb6981983f0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fb694005940 tx=0x7fb6940042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:31.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.971+0000 7fb68f7fe640 1 -- 172.21.15.2:0/1521043257 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb69403f030 con 0x7fb698100a80 2024-09-19T06:20:31.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.971+0000 7fb68f7fe640 1 -- 172.21.15.2:0/1521043257 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb694003cb0 con 0x7fb698100a80 2024-09-19T06:20:31.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.971+0000 7fb6a077f640 1 -- 172.21.15.2:0/1521043257 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb69819d630 con 0x7fb698100a80 2024-09-19T06:20:31.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.971+0000 7fb68f7fe640 1 -- 172.21.15.2:0/1521043257 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb694035070 con 0x7fb698100a80 2024-09-19T06:20:31.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.971+0000 7fb6a077f640 1 -- 172.21.15.2:0/1521043257 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6981a4f70 con 0x7fb698100a80 2024-09-19T06:20:31.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.973+0000 7fb68f7fe640 1 -- 172.21.15.2:0/1521043257 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fb694042030 con 0x7fb698100a80 2024-09-19T06:20:31.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.974+0000 7fb6a2b58740 1 Processor -- start 2024-09-19T06:20:31.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.974+0000 7fb6a2b58740 1 -- start start 2024-09-19T06:20:31.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.974+0000 7fb6a2b58740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db53db4b60 0x55db53db4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:31.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.974+0000 7fb6a2b58740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55db53db5480 0x55db53dbf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:31.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.974+0000 7fb6a2b58740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db53dbfd40 0x55db53dc2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:31.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.974+0000 7fb6a2b58740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55db53d1a280 con 0x55db53dbfd40 2024-09-19T06:20:31.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.974+0000 7fb6a2b58740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55db53cc1b10 con 0x55db53db5480 2024-09-19T06:20:31.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.974+0000 7fb6a2b58740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55db53d16240 con 0x55db53db4b60 2024-09-19T06:20:31.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.974+0000 7fb69ed1c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db53db4b60 0x55db53db4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:31.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.974+0000 7fb69dd1a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db53dbfd40 0x55db53dc2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:31.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.974+0000 7fb69dd1a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db53dbfd40 0x55db53dc2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36024/0 (socket says 172.21.15.2:36024) 2024-09-19T06:20:31.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.974+0000 7fb69ed1c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db53db4b60 0x55db53db4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:39564/0 (socket says 172.21.15.2:39564) 2024-09-19T06:20:31.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.974+0000 7fb69dd1a640 1 -- 172.21.15.2:0/1578243952 learned_addr learned my addr 172.21.15.2:0/1578243952 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:31.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.974+0000 7fb69e51b640 1 --2- 172.21.15.2:0/1578243952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55db53db5480 0x55db53dbf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:31.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.975+0000 7fb69dd1a640 1 -- 172.21.15.2:0/1578243952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db53db4b60 msgr2=0x55db53db4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:31.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.975+0000 7fb69dd1a640 1 --2- 172.21.15.2:0/1578243952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db53db4b60 0x55db53db4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:31.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.975+0000 7fb69dd1a640 1 -- 172.21.15.2:0/1578243952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55db53db5480 msgr2=0x55db53dbf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:31.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.975+0000 7fb69dd1a640 1 --2- 172.21.15.2:0/1578243952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55db53db5480 0x55db53dbf800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:31.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.975+0000 7fb68f7fe640 1 --2- 172.21.15.2:0/1521043257 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb6840a3430 0x7fb6840a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:31.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.975+0000 7fb69dd1a640 1 -- 172.21.15.2:0/1578243952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db53cce1f0 con 0x55db53dbfd40 2024-09-19T06:20:31.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.975+0000 7fb69ed1c640 1 --2- 172.21.15.2:0/1521043257 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb6840a3430 0x7fb6840a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:31.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.975+0000 7fb68f7fe640 1 -- 172.21.15.2:0/1521043257 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fb6940f0250 con 0x7fb698100a80 2024-09-19T06:20:31.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.975+0000 7fb69dd1a640 1 --2- 172.21.15.2:0/1578243952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db53dbfd40 0x55db53dc2130 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fb68800cbc0 tx=0x7fb68800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6137f4a6bc5f9798 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:31.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.975+0000 7fb68cff9640 1 -- 172.21.15.2:0/1578243952 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb688010630 con 0x55db53dbfd40 2024-09-19T06:20:31.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.975+0000 7fb68cff9640 1 -- 172.21.15.2:0/1578243952 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb688010c80 con 0x55db53dbfd40 2024-09-19T06:20:31.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.975+0000 7fb68cff9640 1 -- 172.21.15.2:0/1578243952 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68801ab60 con 0x55db53dbfd40 2024-09-19T06:20:31.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.976+0000 7fb6a2b58740 1 -- 172.21.15.2:0/1578243952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db53dbfd40 msgr2=0x55db53dc2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:31.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.976+0000 7fb69ed1c640 1 --2- 172.21.15.2:0/1521043257 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb6840a3430 0x7fb6840a58f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb69000f4c0 tx=0x7fb690007740 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:31.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.976+0000 7fb6a2b58740 1 --2- 172.21.15.2:0/1578243952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db53dbfd40 0x55db53dc2130 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fb68800cbc0 tx=0x7fb68800e720 comp rx=0 tx=0).stop 2024-09-19T06:20:31.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.976+0000 7fb6a2b58740 1 -- 172.21.15.2:0/1578243952 shutdown_connections 2024-09-19T06:20:31.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.976+0000 7fb6a2b58740 1 --2- 172.21.15.2:0/1578243952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db53dbfd40 0x55db53dc2130 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:31.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.976+0000 7fb6a2b58740 1 --2- 172.21.15.2:0/1578243952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55db53db5480 0x55db53dbf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:31.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.976+0000 7fb6a2b58740 1 --2- 172.21.15.2:0/1578243952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db53db4b60 0x55db53db4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:31.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.976+0000 7fb6a2b58740 1 -- 172.21.15.2:0/1578243952 >> 172.21.15.2:0/1578243952 conn(0x55db53db10f0 msgr2=0x55db53db14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:31.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.976+0000 7fb6a2b58740 1 -- 172.21.15.2:0/1578243952 shutdown_connections 2024-09-19T06:20:31.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.976+0000 7fb6a2b58740 1 -- 172.21.15.2:0/1578243952 wait complete. 2024-09-19T06:20:31.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.976+0000 7fb6a2b58740 1 -- start start 2024-09-19T06:20:31.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.977+0000 7fb6a2b58740 1 Processor -- start 2024-09-19T06:20:31.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.977+0000 7fb6a2b58740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55db53db4b60 0x55db53dbcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:31.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.977+0000 7fb6a2b58740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db53db5480 0x55db53dbd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:31.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.977+0000 7fb6a2b58740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db53dbfd40 0x55db53dbd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:31.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.977+0000 7fb6a2b58740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55db53dc2910 con 0x55db53dbfd40 2024-09-19T06:20:31.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.977+0000 7fb6a2b58740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55db53cd4f10 con 0x55db53db4b60 2024-09-19T06:20:31.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.977+0000 7fb6a2b58740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55db53dc2a90 con 0x55db53db5480 2024-09-19T06:20:31.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.977+0000 7fb6a2b58740 10 client.0 _ll_register_callbacks cb 0x55db53c9da40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:31.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.977+0000 7fb69ed1c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db53dbfd40 0x55db53dbd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:31.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.977+0000 7fb69ed1c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db53dbfd40 0x55db53dbd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36028/0 (socket says 172.21.15.2:36028) 2024-09-19T06:20:31.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.977+0000 7fb69ed1c640 1 -- 172.21.15.2:0/2885208963 learned_addr learned my addr 172.21.15.2:0/2885208963 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:31.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.977+0000 7fb69dd1a640 1 --2- 172.21.15.2:0/2885208963 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db53db5480 0x55db53dbd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:31.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.977+0000 7fb69e51b640 1 --2- 172.21.15.2:0/2885208963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55db53db4b60 0x55db53dbcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:31.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.977+0000 7fb69ed1c640 1 -- 172.21.15.2:0/2885208963 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db53db5480 msgr2=0x55db53dbd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:31.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.977+0000 7fb69ed1c640 1 --2- 172.21.15.2:0/2885208963 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db53db5480 0x55db53dbd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:31.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.977+0000 7fb69ed1c640 1 -- 172.21.15.2:0/2885208963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55db53db4b60 msgr2=0x55db53dbcbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:31.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.977+0000 7fb69ed1c640 1 --2- 172.21.15.2:0/2885208963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55db53db4b60 0x55db53dbcbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:31.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.977+0000 7fb69ed1c640 1 -- 172.21.15.2:0/2885208963 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db53a8b6a0 con 0x55db53dbfd40 2024-09-19T06:20:31.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.978+0000 7fb69ed1c640 1 --2- 172.21.15.2:0/2885208963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db53dbfd40 0x55db53dbd650 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fb690010ee0 tx=0x7fb690004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecc193a07e8392e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:31.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.978+0000 7fb681ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:31.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.978+0000 7fb681ffb640 1 -- 172.21.15.2:0/2885208963 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb690026680 con 0x55db53dbfd40 2024-09-19T06:20:31.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.978+0000 7fb681ffb640 1 -- 172.21.15.2:0/2885208963 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fb69001d420 con 0x55db53dbfd40 2024-09-19T06:20:31.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.978+0000 7fb6a2b58740 1 -- 172.21.15.2:0/2885208963 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb688010c80 con 0x55db53dbfd40 2024-09-19T06:20:31.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.978+0000 7fb681ffb640 1 -- 172.21.15.2:0/2885208963 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb690026820 con 0x55db53dbfd40 2024-09-19T06:20:31.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.978+0000 7fb6a2b58740 10 client.16890 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:31.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.978+0000 7fb6a2b58740 1 -- 172.21.15.2:0/2885208963 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55db53dce520 con 0x55db53dbfd40 2024-09-19T06:20:31.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.978+0000 7fb681ffb640 1 -- 172.21.15.2:0/2885208963 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb688010c80 con 0x55db53dbfd40 2024-09-19T06:20:31.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.978+0000 7fb681ffb640 1 -- 172.21.15.2:0/2885208963 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fb69001dc20 con 0x55db53dbfd40 2024-09-19T06:20:31.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.978+0000 7fb6a2b58740 10 client.16890 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:31.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.978+0000 7fb6a2b58740 10 client.16890 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:31.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.978+0000 7fb6a2b58740 20 client.16890 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:31.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.978+0000 7fb6a2b58740 1 --2- 172.21.15.2:0/2885208963 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55db53dcf930 0x55db53dd1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:31.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.978+0000 7fb6a2b58740 4 client.16890 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:31.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.978+0000 7fb6a2b58740 1 -- 172.21.15.2:0/2885208963 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55db53d277f0 con 0x55db53dcf930 2024-09-19T06:20:31.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.979+0000 7fb69e51b640 1 --2- 172.21.15.2:0/2885208963 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55db53dcf930 0x55db53dd1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:31.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.979+0000 7fb69e51b640 1 --2- 172.21.15.2:0/2885208963 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55db53dcf930 0x55db53dd1d80 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7928968fcac8fa26 server_cookie=a5eb23e04956b621 in_seq=0 out_seq=0 2024-09-19T06:20:31.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.979+0000 7fb681ffb640 10 client.16890 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:31.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.980+0000 7fb681ffb640 1 -- 172.21.15.2:0/2885208963 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55db53d277f0 con 0x55db53dcf930 2024-09-19T06:20:31.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.980+0000 7fb681ffb640 10 client.16890 handle_command_reply: tid=0 2024-09-19T06:20:31.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.980+0000 7fb6a2b58740 1 client.16890 shutdown 2024-09-19T06:20:31.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.980+0000 7fb6a2b58740 1 -- 172.21.15.2:0/2885208963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db53dbfd40 msgr2=0x55db53dbd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:31.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.980+0000 7fb6a2b58740 1 --2- 172.21.15.2:0/2885208963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db53dbfd40 0x55db53dbd650 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fb690010ee0 tx=0x7fb690004b50 comp rx=0 tx=0).stop 2024-09-19T06:20:31.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.980+0000 7fb6a2b58740 1 -- 172.21.15.2:0/2885208963 shutdown_connections 2024-09-19T06:20:31.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.980+0000 7fb6a2b58740 1 --2- 172.21.15.2:0/2885208963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db53dbfd40 0x55db53dbd650 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:31.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.980+0000 7fb6a2b58740 1 --2- 172.21.15.2:0/2885208963 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db53db5480 0x55db53dbd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:31.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.980+0000 7fb6a2b58740 1 --2- 172.21.15.2:0/2885208963 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55db53dcf930 0x55db53dd1d80 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:31.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.980+0000 7fb6a2b58740 1 --2- 172.21.15.2:0/2885208963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55db53db4b60 0x55db53dbcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:31.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.980+0000 7fb6a2b58740 1 -- 172.21.15.2:0/2885208963 >> 172.21.15.2:0/2885208963 conn(0x55db53db10f0 msgr2=0x55db53db6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:31.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.980+0000 7fb681ffb640 0 client.16890 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:31.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.980+0000 7fb6a2b58740 1 -- 172.21.15.2:0/2885208963 shutdown_connections 2024-09-19T06:20:31.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.980+0000 7fb6a2b58740 1 -- 172.21.15.2:0/2885208963 wait complete. 2024-09-19T06:20:31.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.980+0000 7fb6a2b58740 20 client.16890 trim_cache size 0 max 16384 2024-09-19T06:20:32.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.997+0000 7fb6a2b58740 1 Processor -- start 2024-09-19T06:20:32.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.997+0000 7fb6a2b58740 1 -- start start 2024-09-19T06:20:32.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.998+0000 7fb6a2b58740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db53db4b60 0x55db53db6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:32.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.998+0000 7fb6a2b58740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55db53db5480 0x55db53dd7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:32.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.998+0000 7fb6a2b58740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db53dbfd40 0x55db53dd7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:32.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.998+0000 7fb6a2b58740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb6981b0060 con 0x55db53dbfd40 2024-09-19T06:20:32.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.998+0000 7fb6a2b58740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb6981ad930 con 0x55db53db5480 2024-09-19T06:20:32.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.998+0000 7fb6a2b58740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb6981ab780 con 0x55db53db4b60 2024-09-19T06:20:32.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.998+0000 7fb69ed1c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db53dbfd40 0x55db53dd7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:32.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.998+0000 7fb69ed1c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db53dbfd40 0x55db53dd7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36034/0 (socket says 172.21.15.2:36034) 2024-09-19T06:20:32.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.998+0000 7fb69ed1c640 1 -- 172.21.15.2:0/2219678162 learned_addr learned my addr 172.21.15.2:0/2219678162 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:32.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.998+0000 7fb69dd1a640 1 --2- 172.21.15.2:0/2219678162 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55db53db5480 0x55db53dd7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:32.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.998+0000 7fb69e51b640 1 --2- 172.21.15.2:0/2219678162 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db53db4b60 0x55db53db6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:32.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.998+0000 7fb69ed1c640 1 -- 172.21.15.2:0/2219678162 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db53db4b60 msgr2=0x55db53db6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:32.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.998+0000 7fb69ed1c640 1 --2- 172.21.15.2:0/2219678162 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db53db4b60 0x55db53db6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:32.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.998+0000 7fb69ed1c640 1 -- 172.21.15.2:0/2219678162 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55db53db5480 msgr2=0x55db53dd7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:32.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.998+0000 7fb69ed1c640 1 --2- 172.21.15.2:0/2219678162 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55db53db5480 0x55db53dd7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:32.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.998+0000 7fb69ed1c640 1 -- 172.21.15.2:0/2219678162 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db53dac830 con 0x55db53dbfd40 2024-09-19T06:20:32.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.998+0000 7fb69ed1c640 1 --2- 172.21.15.2:0/2219678162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db53dbfd40 0x55db53dd7b90 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fb6900078f0 tx=0x7fb690007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a2b582cbea6e081 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:32.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.999+0000 7fb683fff640 1 -- 172.21.15.2:0/2219678162 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb69003e070 con 0x55db53dbfd40 2024-09-19T06:20:32.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.999+0000 7fb683fff640 1 -- 172.21.15.2:0/2219678162 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb69002f6c0 con 0x55db53dbfd40 2024-09-19T06:20:32.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.999+0000 7fb683fff640 1 -- 172.21.15.2:0/2219678162 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb690035040 con 0x55db53dbfd40 2024-09-19T06:20:32.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.999+0000 7fb6a2b58740 1 -- 172.21.15.2:0/2219678162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db53dbfd40 msgr2=0x55db53dd7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:32.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.999+0000 7fb6a2b58740 1 --2- 172.21.15.2:0/2219678162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db53dbfd40 0x55db53dd7b90 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fb6900078f0 tx=0x7fb690007e80 comp rx=0 tx=0).stop 2024-09-19T06:20:32.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.999+0000 7fb6a2b58740 1 -- 172.21.15.2:0/2219678162 shutdown_connections 2024-09-19T06:20:32.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.999+0000 7fb6a2b58740 1 --2- 172.21.15.2:0/2219678162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db53dbfd40 0x55db53dd7b90 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:32.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.999+0000 7fb6a2b58740 1 --2- 172.21.15.2:0/2219678162 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55db53db5480 0x55db53dd7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:32.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.999+0000 7fb6a2b58740 1 --2- 172.21.15.2:0/2219678162 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db53db4b60 0x55db53db6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:32.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.999+0000 7fb6a2b58740 1 -- 172.21.15.2:0/2219678162 >> 172.21.15.2:0/2219678162 conn(0x55db53db10f0 msgr2=0x55db53db65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:32.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.999+0000 7fb6a2b58740 1 -- 172.21.15.2:0/2219678162 shutdown_connections 2024-09-19T06:20:32.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:31.999+0000 7fb6a2b58740 1 -- 172.21.15.2:0/2219678162 wait complete. 2024-09-19T06:20:32.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.000+0000 7fb6a2b58740 1 -- start start 2024-09-19T06:20:32.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.000+0000 7fb6a2b58740 1 Processor -- start 2024-09-19T06:20:32.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.000+0000 7fb6a2b58740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55db53db4b60 0x55db53dc84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:32.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.000+0000 7fb6a2b58740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db53db5480 0x55db53dc0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:32.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.000+0000 7fb6a2b58740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db53dbfd40 0x55db53dc12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:32.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.000+0000 7fb6a2b58740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb6981abdf0 con 0x55db53dbfd40 2024-09-19T06:20:32.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.000+0000 7fb6a2b58740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb6981ad260 con 0x55db53db4b60 2024-09-19T06:20:32.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.000+0000 7fb6a2b58740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb6981ac4c0 con 0x55db53db5480 2024-09-19T06:20:32.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.000+0000 7fb6a2b58740 10 client.0 _ll_register_callbacks cb 0x7fb690010b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:32.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.000+0000 7fb69ed1c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db53dbfd40 0x55db53dc12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:32.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.000+0000 7fb69ed1c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db53dbfd40 0x55db53dc12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36042/0 (socket says 172.21.15.2:36042) 2024-09-19T06:20:32.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.000+0000 7fb69e51b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55db53db4b60 0x55db53dc84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:32.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.000+0000 7fb69ed1c640 1 -- 172.21.15.2:0/3174092308 learned_addr learned my addr 172.21.15.2:0/3174092308 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:32.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.000+0000 7fb69dd1a640 1 --2- 172.21.15.2:0/3174092308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db53db5480 0x55db53dc0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:32.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.000+0000 7fb69ed1c640 1 -- 172.21.15.2:0/3174092308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db53db5480 msgr2=0x55db53dc0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:32.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.000+0000 7fb69ed1c640 1 --2- 172.21.15.2:0/3174092308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db53db5480 0x55db53dc0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:32.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.000+0000 7fb69ed1c640 1 -- 172.21.15.2:0/3174092308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55db53db4b60 msgr2=0x55db53dc84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:32.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.000+0000 7fb69ed1c640 1 --2- 172.21.15.2:0/3174092308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55db53db4b60 0x55db53dc84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:32.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.000+0000 7fb69ed1c640 1 -- 172.21.15.2:0/3174092308 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db53dc1ad0 con 0x55db53dbfd40 2024-09-19T06:20:32.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.001+0000 7fb69ed1c640 1 --2- 172.21.15.2:0/3174092308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db53dbfd40 0x55db53dc12a0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fb69002f4d0 tx=0x7fb690007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bbf8497a6368a77 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:32.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.001+0000 7fb681ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:32.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.001+0000 7fb681ffb640 1 -- 172.21.15.2:0/3174092308 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb69003e070 con 0x55db53dbfd40 2024-09-19T06:20:32.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.001+0000 7fb681ffb640 1 -- 172.21.15.2:0/3174092308 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fb69002f870 con 0x55db53dbfd40 2024-09-19T06:20:32.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.001+0000 7fb6a2b58740 1 -- 172.21.15.2:0/3174092308 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb69002f6c0 con 0x55db53dbfd40 2024-09-19T06:20:32.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.001+0000 7fb681ffb640 1 -- 172.21.15.2:0/3174092308 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb690035070 con 0x55db53dbfd40 2024-09-19T06:20:32.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.001+0000 7fb6a2b58740 10 client.16896 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:32.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.001+0000 7fb6a2b58740 1 -- 172.21.15.2:0/3174092308 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55db53e3a740 con 0x55db53dbfd40 2024-09-19T06:20:32.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.001+0000 7fb681ffb640 1 -- 172.21.15.2:0/3174092308 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb69002f6c0 con 0x55db53dbfd40 2024-09-19T06:20:32.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.001+0000 7fb681ffb640 1 -- 172.21.15.2:0/3174092308 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fb69001d750 con 0x55db53dbfd40 2024-09-19T06:20:32.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.001+0000 7fb6a2b58740 10 client.16896 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:32.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.001+0000 7fb6a2b58740 10 client.16896 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:32.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.001+0000 7fb6a2b58740 20 client.16896 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:32.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.001+0000 7fb6a2b58740 1 --2- 172.21.15.2:0/3174092308 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55db53e3ac50 0x55db53e3d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:32.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.001+0000 7fb6a2b58740 4 client.16896 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:20:32.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.001+0000 7fb6a2b58740 1 -- 172.21.15.2:0/3174092308 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55db53d21d00 con 0x55db53e3ac50 2024-09-19T06:20:32.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.002+0000 7fb69e51b640 1 --2- 172.21.15.2:0/3174092308 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55db53e3ac50 0x55db53e3d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:32.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.002+0000 7fb681ffb640 10 client.16896 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:32.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.002+0000 7fb69e51b640 1 --2- 172.21.15.2:0/3174092308 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55db53e3ac50 0x55db53e3d040 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fe4c160c714eb68 server_cookie=45c90d680dfb663e in_seq=0 out_seq=0 2024-09-19T06:20:32.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.003+0000 7fb681ffb640 1 -- 172.21.15.2:0/3174092308 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55db53d21d00 con 0x55db53e3ac50 2024-09-19T06:20:32.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.003+0000 7fb681ffb640 10 client.16896 handle_command_reply: tid=0 2024-09-19T06:20:32.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.003+0000 7fb6a2b58740 1 client.16896 shutdown 2024-09-19T06:20:32.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.003+0000 7fb6a2b58740 1 -- 172.21.15.2:0/3174092308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db53dbfd40 msgr2=0x55db53dc12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:32.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.003+0000 7fb6a2b58740 1 --2- 172.21.15.2:0/3174092308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db53dbfd40 0x55db53dc12a0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fb69002f4d0 tx=0x7fb690007ef0 comp rx=0 tx=0).stop 2024-09-19T06:20:32.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.003+0000 7fb6a2b58740 1 -- 172.21.15.2:0/3174092308 shutdown_connections 2024-09-19T06:20:32.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.003+0000 7fb6a2b58740 1 --2- 172.21.15.2:0/3174092308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db53dbfd40 0x55db53dc12a0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:32.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.003+0000 7fb6a2b58740 1 --2- 172.21.15.2:0/3174092308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db53db5480 0x55db53dc0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:32.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.003+0000 7fb6a2b58740 1 --2- 172.21.15.2:0/3174092308 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55db53e3ac50 0x55db53e3d040 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:32.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.003+0000 7fb6a2b58740 1 --2- 172.21.15.2:0/3174092308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55db53db4b60 0x55db53dc84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:32.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.003+0000 7fb6a2b58740 1 -- 172.21.15.2:0/3174092308 >> 172.21.15.2:0/3174092308 conn(0x55db53db10f0 msgr2=0x55db53dbd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:32.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.003+0000 7fb681ffb640 0 client.16896 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:32.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.004+0000 7fb6a2b58740 1 -- 172.21.15.2:0/3174092308 shutdown_connections 2024-09-19T06:20:32.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.004+0000 7fb6a2b58740 1 -- 172.21.15.2:0/3174092308 wait complete. 2024-09-19T06:20:32.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.004+0000 7fb6a2b58740 20 client.16896 trim_cache size 0 max 16384 2024-09-19T06:20:32.010 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:20:32.010 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T06:20:32.010 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "acffd84e-28a2-422b-96e4-e62a61550696", 2024-09-19T06:20:32.010 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T06:20:32.010 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:20:32.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.004+0000 7fb6a077f640 1 -- 172.21.15.2:0/1521043257 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb6840a3430 msgr2=0x7fb6840a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:32.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.004+0000 7fb6a077f640 1 --2- 172.21.15.2:0/1521043257 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb6840a3430 0x7fb6840a58f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb69000f4c0 tx=0x7fb690007740 comp rx=0 tx=0).stop 2024-09-19T06:20:32.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.004+0000 7fb6a077f640 1 -- 172.21.15.2:0/1521043257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb698100a80 msgr2=0x7fb6981983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:32.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.004+0000 7fb6a077f640 1 --2- 172.21.15.2:0/1521043257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb698100a80 0x7fb6981983f0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fb694005940 tx=0x7fb6940042f0 comp rx=0 tx=0).stop 2024-09-19T06:20:32.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.004+0000 7fb6a077f640 1 -- 172.21.15.2:0/1521043257 shutdown_connections 2024-09-19T06:20:32.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.004+0000 7fb6a077f640 1 --2- 172.21.15.2:0/1521043257 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb6840a3430 0x7fb6840a58f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:32.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.004+0000 7fb6a077f640 1 --2- 172.21.15.2:0/1521043257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb698106a80 0x7fb69819ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:32.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.004+0000 7fb6a077f640 1 --2- 172.21.15.2:0/1521043257 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb698101420 0x7fb698198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:32.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.004+0000 7fb6a077f640 1 --2- 172.21.15.2:0/1521043257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb698100a80 0x7fb6981983f0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:32.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.004+0000 7fb6a077f640 1 -- 172.21.15.2:0/1521043257 >> 172.21.15.2:0/1521043257 conn(0x7fb6980fc7a0 msgr2=0x7fb6980fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:32.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.004+0000 7fb6a077f640 1 -- 172.21.15.2:0/1521043257 shutdown_connections 2024-09-19T06:20:32.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:32.004+0000 7fb6a077f640 1 -- 172.21.15.2:0/1521043257 wait complete. 2024-09-19T06:20:32.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:31 smithi002 ceph-mon[30982]: pgmap v174: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:20:32.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:31 smithi090 ceph-mon[34497]: pgmap v174: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:20:32.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:31 smithi089 ceph-mon[34160]: pgmap v174: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:20:32.752 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:20:33.008 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:33.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:32 smithi002 ceph-mon[30982]: scrub queued for path: / 2024-09-19T06:20:33.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:32 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:33.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:32 smithi002 ceph-mon[30982]: scrub summary: active paths [/] 2024-09-19T06:20:33.223 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:32 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:33.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:32 smithi090 ceph-mon[34497]: scrub queued for path: / 2024-09-19T06:20:33.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:32 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:33.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:32 smithi090 ceph-mon[34497]: scrub summary: active paths [/] 2024-09-19T06:20:33.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:32 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:33.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:32 smithi089 ceph-mon[34160]: scrub queued for path: / 2024-09-19T06:20:33.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:32 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:33.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:32 smithi089 ceph-mon[34160]: scrub summary: active paths [/] 2024-09-19T06:20:33.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:32 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:33.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.433+0000 7fac74e56640 1 -- 172.21.15.2:0/3708300672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac70102570 msgr2=0x7fac701029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:33.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.433+0000 7fac74e56640 1 --2- 172.21.15.2:0/3708300672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac70102570 0x7fac701029b0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fac64009ca0 tx=0x7fac6402a950 comp rx=0 tx=0).stop 2024-09-19T06:20:33.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.433+0000 7fac74e56640 1 -- 172.21.15.2:0/3708300672 shutdown_connections 2024-09-19T06:20:33.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.433+0000 7fac74e56640 1 --2- 172.21.15.2:0/3708300672 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac70102ef0 0x7fac7010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.433+0000 7fac74e56640 1 --2- 172.21.15.2:0/3708300672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac70102570 0x7fac701029b0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.433+0000 7fac74e56640 1 --2- 172.21.15.2:0/3708300672 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac70100e20 0x7fac70101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.433+0000 7fac74e56640 1 -- 172.21.15.2:0/3708300672 >> 172.21.15.2:0/3708300672 conn(0x7fac700fc7d0 msgr2=0x7fac700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:33.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.433+0000 7fac74e56640 1 -- 172.21.15.2:0/3708300672 shutdown_connections 2024-09-19T06:20:33.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.433+0000 7fac74e56640 1 -- 172.21.15.2:0/3708300672 wait complete. 2024-09-19T06:20:33.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.434+0000 7fac74e56640 1 Processor -- start 2024-09-19T06:20:33.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.434+0000 7fac74e56640 1 -- start start 2024-09-19T06:20:33.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.434+0000 7fac74e56640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac70100e20 0x7fac700fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:33.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.434+0000 7fac74e56640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac70102570 0x7fac700fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:33.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.434+0000 7fac74e56640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac70102ef0 0x7fac700fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:33.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.434+0000 7fac74e56640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fac70110e80 con 0x7fac70102ef0 2024-09-19T06:20:33.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.434+0000 7fac74e56640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fac70110d00 con 0x7fac70100e20 2024-09-19T06:20:33.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.434+0000 7fac74e56640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fac70111000 con 0x7fac70102570 2024-09-19T06:20:33.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.434+0000 7fac6ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac70102ef0 0x7fac700fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:33.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.434+0000 7fac6ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac70102ef0 0x7fac700fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36068/0 (socket says 172.21.15.2:36068) 2024-09-19T06:20:33.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.434+0000 7fac6ed9d640 1 -- 172.21.15.2:0/1564524304 learned_addr learned my addr 172.21.15.2:0/1564524304 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:33.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.434+0000 7fac6e59c640 1 --2- 172.21.15.2:0/1564524304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac70100e20 0x7fac700fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:33.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.434+0000 7fac6dd9b640 1 --2- 172.21.15.2:0/1564524304 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac70102570 0x7fac700fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:33.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.435+0000 7fac6ed9d640 1 -- 172.21.15.2:0/1564524304 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac70102570 msgr2=0x7fac700fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:33.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.435+0000 7fac6ed9d640 1 --2- 172.21.15.2:0/1564524304 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac70102570 0x7fac700fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.435+0000 7fac6ed9d640 1 -- 172.21.15.2:0/1564524304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac70100e20 msgr2=0x7fac700fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:33.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.435+0000 7fac6ed9d640 1 --2- 172.21.15.2:0/1564524304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac70100e20 0x7fac700fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.435+0000 7fac6ed9d640 1 -- 172.21.15.2:0/1564524304 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac701a6950 con 0x7fac70102ef0 2024-09-19T06:20:33.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.435+0000 7fac6e59c640 1 --2- 172.21.15.2:0/1564524304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac70100e20 0x7fac700fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:33.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.435+0000 7fac6ed9d640 1 --2- 172.21.15.2:0/1564524304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac70102ef0 0x7fac700fd700 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fac6800d750 tx=0x7fac6800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:33.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.435+0000 7fac5f7fe640 1 -- 172.21.15.2:0/1564524304 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac68017070 con 0x7fac70102ef0 2024-09-19T06:20:33.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.435+0000 7fac74e56640 1 -- 172.21.15.2:0/1564524304 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac701a6c40 con 0x7fac70102ef0 2024-09-19T06:20:33.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.435+0000 7fac5f7fe640 1 -- 172.21.15.2:0/1564524304 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fac680054d0 con 0x7fac70102ef0 2024-09-19T06:20:33.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.435+0000 7fac5f7fe640 1 -- 172.21.15.2:0/1564524304 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac68004c60 con 0x7fac70102ef0 2024-09-19T06:20:33.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.435+0000 7fac74e56640 1 -- 172.21.15.2:0/1564524304 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac701a7150 con 0x7fac70102ef0 2024-09-19T06:20:33.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.437+0000 7fac5f7fe640 1 -- 172.21.15.2:0/1564524304 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fac68004e00 con 0x7fac70102ef0 2024-09-19T06:20:33.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.438+0000 7fac7722f740 1 Processor -- start 2024-09-19T06:20:33.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.438+0000 7fac7722f740 1 -- start start 2024-09-19T06:20:33.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.438+0000 7fac7722f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637bfcb14a0 0x5637bfcb1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:33.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.438+0000 7fac7722f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5637bfcb1dc0 0x5637bfcbc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:33.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.438+0000 7fac7722f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5637bfcbc680 0x5637bfcbea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:33.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.438+0000 7fac7722f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5637bfc172e0 con 0x5637bfcb14a0 2024-09-19T06:20:33.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.438+0000 7fac7722f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5637bfbbece0 con 0x5637bfcb1dc0 2024-09-19T06:20:33.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.438+0000 7fac7722f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5637bfc132a0 con 0x5637bfcbc680 2024-09-19T06:20:33.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.438+0000 7fac6dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637bfcb14a0 0x5637bfcb1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:33.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.438+0000 7fac6dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637bfcb14a0 0x5637bfcb1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36072/0 (socket says 172.21.15.2:36072) 2024-09-19T06:20:33.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.438+0000 7fac6dd9b640 1 -- 172.21.15.2:0/2921600105 learned_addr learned my addr 172.21.15.2:0/2921600105 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:33.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.438+0000 7fac5f7fe640 1 --2- 172.21.15.2:0/1564524304 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fac580a33b0 0x7fac580a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:33.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.439+0000 7fac6e59c640 1 --2- 172.21.15.2:0/2921600105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5637bfcb1dc0 0x5637bfcbc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:33.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.439+0000 7fac6ed9d640 1 --2- 172.21.15.2:0/1564524304 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fac580a33b0 0x7fac580a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:33.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.439+0000 7fac6dd9b640 1 --2- 172.21.15.2:0/2921600105 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5637bfcbc680 0x5637bfcbea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:33.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.439+0000 7fac5f7fe640 1 -- 172.21.15.2:0/1564524304 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fac680cf690 con 0x7fac70102ef0 2024-09-19T06:20:33.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.439+0000 7fac6dd9b640 1 -- 172.21.15.2:0/2921600105 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5637bfcbc680 msgr2=0x5637bfcbea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:33.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.439+0000 7fac6dd9b640 1 --2- 172.21.15.2:0/2921600105 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5637bfcbc680 0x5637bfcbea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.439+0000 7fac6dd9b640 1 -- 172.21.15.2:0/2921600105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5637bfcb1dc0 msgr2=0x5637bfcbc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:33.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.439+0000 7fac6dd9b640 1 --2- 172.21.15.2:0/2921600105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5637bfcb1dc0 0x5637bfcbc140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.439+0000 7fac6dd9b640 1 -- 172.21.15.2:0/2921600105 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637bfba3440 con 0x5637bfcb14a0 2024-09-19T06:20:33.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.439+0000 7fac6e59c640 1 --2- 172.21.15.2:0/2921600105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5637bfcb1dc0 0x5637bfcbc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:33.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.439+0000 7fac6dd9b640 1 --2- 172.21.15.2:0/2921600105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637bfcb14a0 0x5637bfcb1880 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fac64000f80 tx=0x7fac64009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dbd62be62471b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:33.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.439+0000 7fac6ed9d640 1 --2- 172.21.15.2:0/1564524304 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fac580a33b0 0x7fac580a5870 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fac6809b640 tx=0x7fac68000bc0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:33.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.439+0000 7fac5cff9640 1 -- 172.21.15.2:0/2921600105 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac64034040 con 0x5637bfcb14a0 2024-09-19T06:20:33.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.439+0000 7fac5cff9640 1 -- 172.21.15.2:0/2921600105 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fac6403e030 con 0x5637bfcb14a0 2024-09-19T06:20:33.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.439+0000 7fac5cff9640 1 -- 172.21.15.2:0/2921600105 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac64030dd0 con 0x5637bfcb14a0 2024-09-19T06:20:33.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.440+0000 7fac7722f740 1 -- 172.21.15.2:0/2921600105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637bfcb14a0 msgr2=0x5637bfcb1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:33.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.440+0000 7fac7722f740 1 --2- 172.21.15.2:0/2921600105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637bfcb14a0 0x5637bfcb1880 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fac64000f80 tx=0x7fac64009920 comp rx=0 tx=0).stop 2024-09-19T06:20:33.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.440+0000 7fac7722f740 1 -- 172.21.15.2:0/2921600105 shutdown_connections 2024-09-19T06:20:33.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.440+0000 7fac7722f740 1 --2- 172.21.15.2:0/2921600105 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5637bfcbc680 0x5637bfcbea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.440+0000 7fac7722f740 1 --2- 172.21.15.2:0/2921600105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5637bfcb1dc0 0x5637bfcbc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.440+0000 7fac7722f740 1 --2- 172.21.15.2:0/2921600105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637bfcb14a0 0x5637bfcb1880 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.440+0000 7fac7722f740 1 -- 172.21.15.2:0/2921600105 >> 172.21.15.2:0/2921600105 conn(0x5637bfcada30 msgr2=0x5637bfcade10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:33.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.440+0000 7fac7722f740 1 -- 172.21.15.2:0/2921600105 shutdown_connections 2024-09-19T06:20:33.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.440+0000 7fac7722f740 1 -- 172.21.15.2:0/2921600105 wait complete. 2024-09-19T06:20:33.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.441+0000 7fac7722f740 1 -- start start 2024-09-19T06:20:33.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.441+0000 7fac7722f740 1 Processor -- start 2024-09-19T06:20:33.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.441+0000 7fac7722f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637bfcb14a0 0x5637bfcbc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:33.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.441+0000 7fac7722f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5637bfcb1dc0 0x5637bfcb92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:33.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.441+0000 7fac7722f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5637bfcbc680 0x5637bfcb9870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:33.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.441+0000 7fac7722f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5637bfcbf250 con 0x5637bfcb14a0 2024-09-19T06:20:33.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.441+0000 7fac7722f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5637bfbd2050 con 0x5637bfcbc680 2024-09-19T06:20:33.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.441+0000 7fac7722f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5637bfcbf3d0 con 0x5637bfcb1dc0 2024-09-19T06:20:33.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.441+0000 7fac7722f740 10 client.0 _ll_register_callbacks cb 0x5637bfc12160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:33.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.441+0000 7fac6dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637bfcb14a0 0x5637bfcbc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:33.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.441+0000 7fac6dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637bfcb14a0 0x5637bfcbc020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36088/0 (socket says 172.21.15.2:36088) 2024-09-19T06:20:33.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.441+0000 7fac6dd9b640 1 -- 172.21.15.2:0/3806296578 learned_addr learned my addr 172.21.15.2:0/3806296578 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:33.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.441+0000 7fac6e59c640 1 --2- 172.21.15.2:0/3806296578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5637bfcb1dc0 0x5637bfcb92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:33.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.441+0000 7fac6dd9b640 1 -- 172.21.15.2:0/3806296578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5637bfcb1dc0 msgr2=0x5637bfcb92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:33.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.441+0000 7fac6dd9b640 1 --2- 172.21.15.2:0/3806296578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5637bfcb1dc0 0x5637bfcb92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.441+0000 7fac6dd9b640 1 -- 172.21.15.2:0/3806296578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5637bfcbc680 msgr2=0x5637bfcb9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:33.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.441+0000 7fac6dd9b640 1 --2- 172.21.15.2:0/3806296578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5637bfcbc680 0x5637bfcb9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.441+0000 7fac6dd9b640 1 -- 172.21.15.2:0/3806296578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637bf9883c0 con 0x5637bfcb14a0 2024-09-19T06:20:33.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.442+0000 7fac6dd9b640 1 --2- 172.21.15.2:0/3806296578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637bfcb14a0 0x5637bfcbc020 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fac6402ae70 tx=0x7fac6402f540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=563923d2a9dab309 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:33.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.442+0000 7fac55ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:33.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.442+0000 7fac55ffb640 1 -- 172.21.15.2:0/3806296578 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac64034070 con 0x5637bfcb14a0 2024-09-19T06:20:33.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.442+0000 7fac55ffb640 1 -- 172.21.15.2:0/3806296578 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fac6402f8c0 con 0x5637bfcb14a0 2024-09-19T06:20:33.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.442+0000 7fac7722f740 1 -- 172.21.15.2:0/3806296578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac6403e030 con 0x5637bfcb14a0 2024-09-19T06:20:33.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.442+0000 7fac55ffb640 1 -- 172.21.15.2:0/3806296578 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fac6402fac0 con 0x5637bfcb14a0 2024-09-19T06:20:33.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.442+0000 7fac7722f740 10 client.16908 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:33.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.442+0000 7fac7722f740 1 -- 172.21.15.2:0/3806296578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5637bfccac60 con 0x5637bfcb14a0 2024-09-19T06:20:33.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.442+0000 7fac55ffb640 1 -- 172.21.15.2:0/3806296578 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fac6403e030 con 0x5637bfcb14a0 2024-09-19T06:20:33.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.442+0000 7fac55ffb640 1 -- 172.21.15.2:0/3806296578 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fac64049a00 con 0x5637bfcb14a0 2024-09-19T06:20:33.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.442+0000 7fac7722f740 10 client.16908 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:33.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.442+0000 7fac7722f740 10 client.16908 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:33.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.443+0000 7fac7722f740 20 client.16908 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:33.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.443+0000 7fac7722f740 1 --2- 172.21.15.2:0/3806296578 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5637bfccbfb0 0x5637bfcce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:33.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.443+0000 7fac7722f740 4 client.16908 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:33.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.443+0000 7fac7722f740 1 -- 172.21.15.2:0/3806296578 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5637bfc24850 con 0x5637bfccbfb0 2024-09-19T06:20:33.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.443+0000 7fac6e59c640 1 --2- 172.21.15.2:0/3806296578 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5637bfccbfb0 0x5637bfcce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:33.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.443+0000 7fac6e59c640 1 --2- 172.21.15.2:0/3806296578 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5637bfccbfb0 0x5637bfcce3a0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc5f128d39fce5e1 server_cookie=87f084935f5fe279 in_seq=0 out_seq=0 2024-09-19T06:20:33.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.443+0000 7fac55ffb640 10 client.16908 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:33.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.444+0000 7fac55ffb640 1 -- 172.21.15.2:0/3806296578 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5637bfc24850 con 0x5637bfccbfb0 2024-09-19T06:20:33.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.444+0000 7fac55ffb640 10 client.16908 handle_command_reply: tid=0 2024-09-19T06:20:33.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.444+0000 7fac7722f740 1 client.16908 shutdown 2024-09-19T06:20:33.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.444+0000 7fac7722f740 1 -- 172.21.15.2:0/3806296578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637bfcb14a0 msgr2=0x5637bfcbc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:33.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.444+0000 7fac7722f740 1 --2- 172.21.15.2:0/3806296578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637bfcb14a0 0x5637bfcbc020 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fac6402ae70 tx=0x7fac6402f540 comp rx=0 tx=0).stop 2024-09-19T06:20:33.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.444+0000 7fac7722f740 1 -- 172.21.15.2:0/3806296578 shutdown_connections 2024-09-19T06:20:33.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.444+0000 7fac7722f740 1 --2- 172.21.15.2:0/3806296578 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5637bfccbfb0 0x5637bfcce3a0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.444+0000 7fac7722f740 1 --2- 172.21.15.2:0/3806296578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5637bfcbc680 0x5637bfcb9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.444+0000 7fac55ffb640 0 client.16908 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:33.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.444+0000 7fac7722f740 1 --2- 172.21.15.2:0/3806296578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5637bfcb1dc0 0x5637bfcb92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.444+0000 7fac7722f740 1 --2- 172.21.15.2:0/3806296578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637bfcb14a0 0x5637bfcbc020 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.444+0000 7fac7722f740 1 -- 172.21.15.2:0/3806296578 >> 172.21.15.2:0/3806296578 conn(0x5637bfcada30 msgr2=0x5637bfcb3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:33.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.444+0000 7fac7722f740 1 -- 172.21.15.2:0/3806296578 shutdown_connections 2024-09-19T06:20:33.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.444+0000 7fac7722f740 1 -- 172.21.15.2:0/3806296578 wait complete. 2024-09-19T06:20:33.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.444+0000 7fac7722f740 20 client.16908 trim_cache size 0 max 16384 2024-09-19T06:20:33.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.461+0000 7fac7722f740 1 Processor -- start 2024-09-19T06:20:33.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.461+0000 7fac7722f740 1 -- start start 2024-09-19T06:20:33.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.462+0000 7fac7722f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637bfcb14a0 0x5637bfcb47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:33.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.462+0000 7fac7722f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5637bfcb1dc0 0x5637bfcd13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:33.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.462+0000 7fac7722f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5637bfcbc680 0x5637bfcd1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:33.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.462+0000 7fac7722f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fac701b2170 con 0x5637bfcb14a0 2024-09-19T06:20:33.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.462+0000 7fac7722f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fac701afa40 con 0x5637bfcbc680 2024-09-19T06:20:33.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.462+0000 7fac7722f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fac701ad8b0 con 0x5637bfcb1dc0 2024-09-19T06:20:33.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.462+0000 7fac6dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637bfcb14a0 0x5637bfcb47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:33.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.462+0000 7fac6dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637bfcb14a0 0x5637bfcb47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36090/0 (socket says 172.21.15.2:36090) 2024-09-19T06:20:33.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.462+0000 7fac6dd9b640 1 -- 172.21.15.2:0/4080874278 learned_addr learned my addr 172.21.15.2:0/4080874278 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:33.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.462+0000 7fac6dd9b640 1 -- 172.21.15.2:0/4080874278 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5637bfcb1dc0 msgr2=0x5637bfcd13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:33.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.462+0000 7fac6dd9b640 1 --2- 172.21.15.2:0/4080874278 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5637bfcb1dc0 0x5637bfcd13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.462+0000 7fac6dd9b640 1 -- 172.21.15.2:0/4080874278 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5637bfcbc680 msgr2=0x5637bfcd1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:33.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.462+0000 7fac6dd9b640 1 --2- 172.21.15.2:0/4080874278 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5637bfcbc680 0x5637bfcd1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.462+0000 7fac6dd9b640 1 -- 172.21.15.2:0/4080874278 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637bfcbc390 con 0x5637bfcb14a0 2024-09-19T06:20:33.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.462+0000 7fac6dd9b640 1 --2- 172.21.15.2:0/4080874278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637bfcb14a0 0x5637bfcb47f0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fac64004aa0 tx=0x7fac64030b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e505b757a07c82d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:33.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.462+0000 7fac57fff640 1 -- 172.21.15.2:0/4080874278 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac64060020 con 0x5637bfcb14a0 2024-09-19T06:20:33.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.462+0000 7fac57fff640 1 -- 172.21.15.2:0/4080874278 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fac6403e070 con 0x5637bfcb14a0 2024-09-19T06:20:33.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.462+0000 7fac57fff640 1 -- 172.21.15.2:0/4080874278 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac64034050 con 0x5637bfcb14a0 2024-09-19T06:20:33.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.463+0000 7fac7722f740 1 -- 172.21.15.2:0/4080874278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637bfcb14a0 msgr2=0x5637bfcb47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:33.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.463+0000 7fac7722f740 1 --2- 172.21.15.2:0/4080874278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637bfcb14a0 0x5637bfcb47f0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fac64004aa0 tx=0x7fac64030b00 comp rx=0 tx=0).stop 2024-09-19T06:20:33.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.463+0000 7fac7722f740 1 -- 172.21.15.2:0/4080874278 shutdown_connections 2024-09-19T06:20:33.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.463+0000 7fac7722f740 1 --2- 172.21.15.2:0/4080874278 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5637bfcbc680 0x5637bfcd1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.463+0000 7fac7722f740 1 --2- 172.21.15.2:0/4080874278 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5637bfcb1dc0 0x5637bfcd13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.463+0000 7fac7722f740 1 --2- 172.21.15.2:0/4080874278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637bfcb14a0 0x5637bfcb47f0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.463+0000 7fac7722f740 1 -- 172.21.15.2:0/4080874278 >> 172.21.15.2:0/4080874278 conn(0x5637bfcada30 msgr2=0x5637bfcb40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:33.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.463+0000 7fac7722f740 1 -- 172.21.15.2:0/4080874278 shutdown_connections 2024-09-19T06:20:33.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.463+0000 7fac7722f740 1 -- 172.21.15.2:0/4080874278 wait complete. 2024-09-19T06:20:33.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.463+0000 7fac7722f740 1 -- start start 2024-09-19T06:20:33.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.463+0000 7fac7722f740 1 Processor -- start 2024-09-19T06:20:33.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.464+0000 7fac7722f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637bfcb14a0 0x5637bfcd18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:33.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.464+0000 7fac7722f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5637bfcb1dc0 0x5637bfccec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:33.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.464+0000 7fac7722f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5637bfcbc680 0x5637bfccf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:33.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.464+0000 7fac7722f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fac701adf00 con 0x5637bfcb14a0 2024-09-19T06:20:33.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.464+0000 7fac7722f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fac701af370 con 0x5637bfcb1dc0 2024-09-19T06:20:33.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.464+0000 7fac7722f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fac701ae5d0 con 0x5637bfcbc680 2024-09-19T06:20:33.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.464+0000 7fac7722f740 10 client.0 _ll_register_callbacks cb 0x7fac6000b440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:33.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.464+0000 7fac6dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637bfcb14a0 0x5637bfcd18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:33.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.464+0000 7fac6dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637bfcb14a0 0x5637bfcd18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36092/0 (socket says 172.21.15.2:36092) 2024-09-19T06:20:33.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.464+0000 7fac6dd9b640 1 -- 172.21.15.2:0/2382762766 learned_addr learned my addr 172.21.15.2:0/2382762766 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:33.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.464+0000 7fac6dd9b640 1 --2- 172.21.15.2:0/2382762766 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5637bfcbc680 0x5637bfccf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:33.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.464+0000 7fac6e59c640 1 --2- 172.21.15.2:0/2382762766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5637bfcb1dc0 0x5637bfccec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:33.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.464+0000 7fac6dd9b640 1 -- 172.21.15.2:0/2382762766 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5637bfcbc680 msgr2=0x5637bfccf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:33.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.464+0000 7fac6dd9b640 1 --2- 172.21.15.2:0/2382762766 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5637bfcbc680 0x5637bfccf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.464+0000 7fac6dd9b640 1 -- 172.21.15.2:0/2382762766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5637bfcb1dc0 msgr2=0x5637bfccec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:33.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.464+0000 7fac6dd9b640 1 --2- 172.21.15.2:0/2382762766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5637bfcb1dc0 0x5637bfccec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.464+0000 7fac6dd9b640 1 -- 172.21.15.2:0/2382762766 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637bfccf740 con 0x5637bfcb14a0 2024-09-19T06:20:33.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.464+0000 7fac6e59c640 1 --2- 172.21.15.2:0/2382762766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5637bfcb1dc0 0x5637bfccec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:20:33.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.464+0000 7fac6dd9b640 1 --2- 172.21.15.2:0/2382762766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637bfcb14a0 0x5637bfcd18f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fac6402ae70 tx=0x7fac6402b0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4eff675987f2bd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:33.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.464+0000 7fac55ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:33.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.464+0000 7fac55ffb640 1 -- 172.21.15.2:0/2382762766 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac64060030 con 0x5637bfcb14a0 2024-09-19T06:20:33.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.465+0000 7fac7722f740 1 -- 172.21.15.2:0/2382762766 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac6403e070 con 0x5637bfcb14a0 2024-09-19T06:20:33.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.465+0000 7fac55ffb640 1 -- 172.21.15.2:0/2382762766 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fac6402fc60 con 0x5637bfcb14a0 2024-09-19T06:20:33.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.465+0000 7fac55ffb640 1 -- 172.21.15.2:0/2382762766 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fac64034040 con 0x5637bfcb14a0 2024-09-19T06:20:33.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.465+0000 7fac7722f740 10 client.16914 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:33.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.465+0000 7fac7722f740 1 -- 172.21.15.2:0/2382762766 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5637bfd366d0 con 0x5637bfcb14a0 2024-09-19T06:20:33.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.465+0000 7fac55ffb640 1 -- 172.21.15.2:0/2382762766 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fac6403e070 con 0x5637bfcb14a0 2024-09-19T06:20:33.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.465+0000 7fac55ffb640 1 -- 172.21.15.2:0/2382762766 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fac64053a20 con 0x5637bfcb14a0 2024-09-19T06:20:33.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.465+0000 7fac7722f740 10 client.16914 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:33.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.465+0000 7fac7722f740 10 client.16914 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:33.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.465+0000 7fac7722f740 20 client.16914 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:33.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.465+0000 7fac7722f740 1 --2- 172.21.15.2:0/2382762766 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5637bfd36b50 0x5637bfd38f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:33.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.465+0000 7fac7722f740 4 client.16914 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:20:33.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.465+0000 7fac7722f740 1 -- 172.21.15.2:0/2382762766 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5637bfc1ed60 con 0x5637bfd36b50 2024-09-19T06:20:33.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.465+0000 7fac6e59c640 1 --2- 172.21.15.2:0/2382762766 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5637bfd36b50 0x5637bfd38f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:33.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.466+0000 7fac6e59c640 1 --2- 172.21.15.2:0/2382762766 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5637bfd36b50 0x5637bfd38f70 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fddb678fa76e7628 server_cookie=3242767209d349ce in_seq=0 out_seq=0 2024-09-19T06:20:33.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.466+0000 7fac55ffb640 10 client.16914 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:33.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.466+0000 7fac55ffb640 1 -- 172.21.15.2:0/2382762766 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5637bfc1ed60 con 0x5637bfd36b50 2024-09-19T06:20:33.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.466+0000 7fac55ffb640 10 client.16914 handle_command_reply: tid=0 2024-09-19T06:20:33.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.466+0000 7fac7722f740 1 client.16914 shutdown 2024-09-19T06:20:33.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.466+0000 7fac7722f740 1 -- 172.21.15.2:0/2382762766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637bfcb14a0 msgr2=0x5637bfcd18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:33.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.466+0000 7fac7722f740 1 --2- 172.21.15.2:0/2382762766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637bfcb14a0 0x5637bfcd18f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fac6402ae70 tx=0x7fac6402b0d0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.466+0000 7fac7722f740 1 -- 172.21.15.2:0/2382762766 shutdown_connections 2024-09-19T06:20:33.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.466+0000 7fac7722f740 1 --2- 172.21.15.2:0/2382762766 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5637bfcbc680 0x5637bfccf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.466+0000 7fac7722f740 1 --2- 172.21.15.2:0/2382762766 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5637bfd36b50 0x5637bfd38f70 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.466+0000 7fac7722f740 1 --2- 172.21.15.2:0/2382762766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5637bfcb1dc0 0x5637bfccec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.466+0000 7fac7722f740 1 --2- 172.21.15.2:0/2382762766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637bfcb14a0 0x5637bfcd18f0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.466+0000 7fac7722f740 1 -- 172.21.15.2:0/2382762766 >> 172.21.15.2:0/2382762766 conn(0x5637bfcada30 msgr2=0x5637bfcac350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:33.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.466+0000 7fac55ffb640 0 client.16914 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:33.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.466+0000 7fac7722f740 1 -- 172.21.15.2:0/2382762766 shutdown_connections 2024-09-19T06:20:33.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.466+0000 7fac7722f740 1 -- 172.21.15.2:0/2382762766 wait complete. 2024-09-19T06:20:33.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.466+0000 7fac7722f740 20 client.16914 trim_cache size 0 max 16384 2024-09-19T06:20:33.476 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:20:33.476 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T06:20:33.476 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T06:20:33.476 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:20:33.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.467+0000 7fac74e56640 1 -- 172.21.15.2:0/1564524304 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fac580a33b0 msgr2=0x7fac580a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:33.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.467+0000 7fac74e56640 1 --2- 172.21.15.2:0/1564524304 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fac580a33b0 0x7fac580a5870 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fac6809b640 tx=0x7fac68000bc0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.467+0000 7fac74e56640 1 -- 172.21.15.2:0/1564524304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac70102ef0 msgr2=0x7fac700fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:33.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.467+0000 7fac74e56640 1 --2- 172.21.15.2:0/1564524304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac70102ef0 0x7fac700fd700 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fac6800d750 tx=0x7fac6800dc10 comp rx=0 tx=0).stop 2024-09-19T06:20:33.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.467+0000 7fac74e56640 1 -- 172.21.15.2:0/1564524304 shutdown_connections 2024-09-19T06:20:33.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.467+0000 7fac74e56640 1 --2- 172.21.15.2:0/1564524304 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fac580a33b0 0x7fac580a5870 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.467+0000 7fac74e56640 1 --2- 172.21.15.2:0/1564524304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac70102ef0 0x7fac700fd700 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.467+0000 7fac74e56640 1 --2- 172.21.15.2:0/1564524304 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac70102570 0x7fac700fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.467+0000 7fac74e56640 1 --2- 172.21.15.2:0/1564524304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac70100e20 0x7fac700fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.467+0000 7fac74e56640 1 -- 172.21.15.2:0/1564524304 >> 172.21.15.2:0/1564524304 conn(0x7fac700fc7d0 msgr2=0x7fac7006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:33.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.467+0000 7fac74e56640 1 -- 172.21.15.2:0/1564524304 shutdown_connections 2024-09-19T06:20:33.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:33.467+0000 7fac74e56640 1 -- 172.21.15.2:0/1564524304 wait complete. 2024-09-19T06:20:34.196 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:33 smithi002 ceph-mon[30982]: pgmap v175: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:20:34.196 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:33 smithi002 ceph-mon[30982]: scrub summary: idle 2024-09-19T06:20:34.228 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:20:34.229 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:20:34.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:33 smithi090 ceph-mon[34497]: pgmap v175: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:20:34.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:33 smithi090 ceph-mon[34497]: scrub summary: idle 2024-09-19T06:20:34.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:33 smithi089 ceph-mon[34160]: pgmap v175: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:20:34.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:33 smithi089 ceph-mon[34160]: scrub summary: idle 2024-09-19T06:20:34.498 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:34.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:34.947+0000 7f8031ac8640 1 -- 172.21.15.2:0/2823478577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f802c10c170 msgr2=0x7f802c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:34.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:34.947+0000 7f8031ac8640 1 --2- 172.21.15.2:0/2823478577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f802c10c170 0x7f802c10e610 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f8024009ca0 tx=0x7f802402a950 comp rx=0 tx=0).stop 2024-09-19T06:20:34.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:34.947+0000 7f8031ac8640 1 -- 172.21.15.2:0/2823478577 shutdown_connections 2024-09-19T06:20:34.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:34.947+0000 7f8031ac8640 1 --2- 172.21.15.2:0/2823478577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f802c10c170 0x7f802c10e610 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:34.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:34.947+0000 7f8031ac8640 1 --2- 172.21.15.2:0/2823478577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f802c103660 0x7f802c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:34.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:34.947+0000 7f8031ac8640 1 --2- 172.21.15.2:0/2823478577 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f802c102d40 0x7f802c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:34.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:34.947+0000 7f8031ac8640 1 -- 172.21.15.2:0/2823478577 >> 172.21.15.2:0/2823478577 conn(0x7f802c0fc7a0 msgr2=0x7f802c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:34.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:34.947+0000 7f8031ac8640 1 -- 172.21.15.2:0/2823478577 shutdown_connections 2024-09-19T06:20:34.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:34.947+0000 7f8031ac8640 1 -- 172.21.15.2:0/2823478577 wait complete. 2024-09-19T06:20:34.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:34.948+0000 7f8031ac8640 1 Processor -- start 2024-09-19T06:20:34.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:34.948+0000 7f8031ac8640 1 -- start start 2024-09-19T06:20:34.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:34.948+0000 7f8031ac8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f802c102d40 0x7f802c1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:34.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:34.948+0000 7f8031ac8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f802c103660 0x7f802c1989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:34.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:34.948+0000 7f8031ac8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f802c10c170 0x7f802c19cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:34.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:34.948+0000 7f8031ac8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f802c111ee0 con 0x7f802c10c170 2024-09-19T06:20:34.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:34.948+0000 7f8031ac8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f802c111d60 con 0x7f802c102d40 2024-09-19T06:20:34.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:34.948+0000 7f8031ac8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f802c112060 con 0x7f802c103660 2024-09-19T06:20:34.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:34.948+0000 7f802bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f802c10c170 0x7f802c19cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:34.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:34.949+0000 7f802bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f802c10c170 0x7f802c19cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36108/0 (socket says 172.21.15.2:36108) 2024-09-19T06:20:34.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:34.949+0000 7f802bfff640 1 -- 172.21.15.2:0/3784791762 learned_addr learned my addr 172.21.15.2:0/3784791762 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:34.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:34.949+0000 7f802b7fe640 1 --2- 172.21.15.2:0/3784791762 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f802c102d40 0x7f802c1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:34.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:34.949+0000 7f802affd640 1 --2- 172.21.15.2:0/3784791762 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f802c103660 0x7f802c1989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:34.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:34.949+0000 7f802bfff640 1 -- 172.21.15.2:0/3784791762 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f802c103660 msgr2=0x7f802c1989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:34.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:34.949+0000 7f802bfff640 1 --2- 172.21.15.2:0/3784791762 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f802c103660 0x7f802c1989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:34.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:34.949+0000 7f802bfff640 1 -- 172.21.15.2:0/3784791762 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f802c102d40 msgr2=0x7f802c1984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:34.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:34.949+0000 7f802bfff640 1 --2- 172.21.15.2:0/3784791762 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f802c102d40 0x7f802c1984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:34.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:34.949+0000 7f802bfff640 1 -- 172.21.15.2:0/3784791762 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f802c19d450 con 0x7f802c10c170 2024-09-19T06:20:34.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:34.949+0000 7f802affd640 1 --2- 172.21.15.2:0/3784791762 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f802c103660 0x7f802c1989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:34.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:34.949+0000 7f802bfff640 1 --2- 172.21.15.2:0/3784791762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f802c10c170 0x7f802c19cd70 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f8024006010 tx=0x7f802402f640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:34.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:34.949+0000 7f8028ff9640 1 -- 172.21.15.2:0/3784791762 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8024034040 con 0x7f802c10c170 2024-09-19T06:20:34.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:34.949+0000 7f8028ff9640 1 -- 172.21.15.2:0/3784791762 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8024003e00 con 0x7f802c10c170 2024-09-19T06:20:34.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:34.949+0000 7f8031ac8640 1 -- 172.21.15.2:0/3784791762 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f802c19d6e0 con 0x7f802c10c170 2024-09-19T06:20:34.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:34.949+0000 7f8028ff9640 1 -- 172.21.15.2:0/3784791762 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8024045480 con 0x7f802c10c170 2024-09-19T06:20:34.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:34.950+0000 7f8031ac8640 1 -- 172.21.15.2:0/3784791762 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f802c1a5020 con 0x7f802c10c170 2024-09-19T06:20:34.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:34.951+0000 7f8031ac8640 1 -- 172.21.15.2:0/3784791762 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f802c1031a0 con 0x7f802c10c170 2024-09-19T06:20:34.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:34.954+0000 7f8028ff9640 1 -- 172.21.15.2:0/3784791762 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f8024037020 con 0x7f802c10c170 2024-09-19T06:20:34.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:34.955+0000 7f8028ff9640 1 --2- 172.21.15.2:0/3784791762 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f80140a3430 0x7f80140a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:34.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:34.955+0000 7f8028ff9640 1 -- 172.21.15.2:0/3784791762 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f80240f0db0 con 0x7f802c10c170 2024-09-19T06:20:34.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:34.955+0000 7f802b7fe640 1 --2- 172.21.15.2:0/3784791762 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f80140a3430 0x7f80140a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:34.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:34.955+0000 7f802b7fe640 1 --2- 172.21.15.2:0/3784791762 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f80140a3430 0x7f80140a58f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f801c009990 tx=0x7f801c009110 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:34.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:34.958+0000 7f8028ff9640 1 -- 172.21.15.2:0/3784791762 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f80240bd900 con 0x7f802c10c170 2024-09-19T06:20:35.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:35.173+0000 7f8031ac8640 1 -- 172.21.15.2:0/3784791762 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f802c1071e0 con 0x7f802c10c170 2024-09-19T06:20:35.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:35.174+0000 7f8028ff9640 1 -- 172.21.15.2:0/3784791762 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11882 (secure 0 0 0) 0x7f80240bd200 con 0x7f802c10c170 2024-09-19T06:20:35.176 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:20:35.176 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-09-19T06:14:49:104280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:14:48.191083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24470,24472,24497]},"id":1}]} 2024-09-19T06:20:35.176 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-09-19T06:20:35.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:35.176+0000 7f8031ac8640 1 -- 172.21.15.2:0/3784791762 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f80140a3430 msgr2=0x7f80140a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:35.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:35.176+0000 7f8031ac8640 1 --2- 172.21.15.2:0/3784791762 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f80140a3430 0x7f80140a58f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f801c009990 tx=0x7f801c009110 comp rx=0 tx=0).stop 2024-09-19T06:20:35.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:35.176+0000 7f8031ac8640 1 -- 172.21.15.2:0/3784791762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f802c10c170 msgr2=0x7f802c19cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:35.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:35.176+0000 7f8031ac8640 1 --2- 172.21.15.2:0/3784791762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f802c10c170 0x7f802c19cd70 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f8024006010 tx=0x7f802402f640 comp rx=0 tx=0).stop 2024-09-19T06:20:35.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:35.176+0000 7f8031ac8640 1 -- 172.21.15.2:0/3784791762 shutdown_connections 2024-09-19T06:20:35.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:35.176+0000 7f8031ac8640 1 --2- 172.21.15.2:0/3784791762 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f80140a3430 0x7f80140a58f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:35.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:35.176+0000 7f8031ac8640 1 --2- 172.21.15.2:0/3784791762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f802c10c170 0x7f802c19cd70 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:35.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:35.177+0000 7f8031ac8640 1 --2- 172.21.15.2:0/3784791762 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f802c103660 0x7f802c1989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:35.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:35.177+0000 7f8031ac8640 1 --2- 172.21.15.2:0/3784791762 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f802c102d40 0x7f802c1984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:35.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:35.177+0000 7f8031ac8640 1 -- 172.21.15.2:0/3784791762 >> 172.21.15.2:0/3784791762 conn(0x7f802c0fc7a0 msgr2=0x7f802c0fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:35.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:35.177+0000 7f8031ac8640 1 -- 172.21.15.2:0/3784791762 shutdown_connections 2024-09-19T06:20:35.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:35.177+0000 7f8031ac8640 1 -- 172.21.15.2:0/3784791762 wait complete. 2024-09-19T06:20:35.889 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:20:36.151 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:36.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:35 smithi002 ceph-mon[30982]: pgmap v176: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2024-09-19T06:20:36.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:35 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/3784791762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:20:36.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:35 smithi090 ceph-mon[34497]: pgmap v176: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2024-09-19T06:20:36.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:35 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/3784791762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:20:36.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:35 smithi089 ceph-mon[34160]: pgmap v176: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2024-09-19T06:20:36.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:35 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/3784791762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:20:36.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.564+0000 7f2420fe4640 1 -- 172.21.15.2:0/3330943226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f241c101de0 msgr2=0x7f241c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:36.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.564+0000 7f2420fe4640 1 --2- 172.21.15.2:0/3330943226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f241c101de0 0x7f241c1021c0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f240c009900 tx=0x7f240c02a410 comp rx=0 tx=0).stop 2024-09-19T06:20:36.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.565+0000 7f2420fe4640 1 -- 172.21.15.2:0/3330943226 shutdown_connections 2024-09-19T06:20:36.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.565+0000 7f2420fe4640 1 --2- 172.21.15.2:0/3330943226 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f241c106f10 0x7f241c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.565+0000 7f2420fe4640 1 --2- 172.21.15.2:0/3330943226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f241c102790 0x7f241c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.565+0000 7f2420fe4640 1 --2- 172.21.15.2:0/3330943226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f241c101de0 0x7f241c1021c0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.565+0000 7f2420fe4640 1 -- 172.21.15.2:0/3330943226 >> 172.21.15.2:0/3330943226 conn(0x7f241c0fd8c0 msgr2=0x7f241c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:36.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.565+0000 7f2420fe4640 1 -- 172.21.15.2:0/3330943226 shutdown_connections 2024-09-19T06:20:36.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.565+0000 7f2420fe4640 1 -- 172.21.15.2:0/3330943226 wait complete. 2024-09-19T06:20:36.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.565+0000 7f2420fe4640 1 Processor -- start 2024-09-19T06:20:36.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.566+0000 7f2420fe4640 1 -- start start 2024-09-19T06:20:36.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.566+0000 7f2420fe4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f241c101de0 0x7f241c198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:36.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.566+0000 7f2420fe4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f241c102790 0x7f241c1988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:36.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.566+0000 7f2420fe4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f241c106f10 0x7f241c19cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:36.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.566+0000 7f2420fe4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f241c111e20 con 0x7f241c106f10 2024-09-19T06:20:36.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.566+0000 7f2420fe4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f241c111ca0 con 0x7f241c102790 2024-09-19T06:20:36.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.566+0000 7f2420fe4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f241c111fa0 con 0x7f241c101de0 2024-09-19T06:20:36.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.566+0000 7f241ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f241c106f10 0x7f241c19cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:36.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.566+0000 7f241ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f241c106f10 0x7f241c19cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34012/0 (socket says 172.21.15.2:34012) 2024-09-19T06:20:36.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.566+0000 7f2419d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f241c102790 0x7f241c1988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:36.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.566+0000 7f241ad9d640 1 -- 172.21.15.2:0/2541406957 learned_addr learned my addr 172.21.15.2:0/2541406957 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:36.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.566+0000 7f241a59c640 1 --2- 172.21.15.2:0/2541406957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f241c101de0 0x7f241c198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:36.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.566+0000 7f241ad9d640 1 -- 172.21.15.2:0/2541406957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f241c101de0 msgr2=0x7f241c198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:36.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.566+0000 7f241ad9d640 1 --2- 172.21.15.2:0/2541406957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f241c101de0 0x7f241c198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.566+0000 7f241ad9d640 1 -- 172.21.15.2:0/2541406957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f241c102790 msgr2=0x7f241c1988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:36.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.566+0000 7f241ad9d640 1 --2- 172.21.15.2:0/2541406957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f241c102790 0x7f241c1988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.566+0000 7f241ad9d640 1 -- 172.21.15.2:0/2541406957 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f241c19d330 con 0x7f241c106f10 2024-09-19T06:20:36.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.566+0000 7f2419d9b640 1 --2- 172.21.15.2:0/2541406957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f241c102790 0x7f241c1988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:36.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.567+0000 7f241ad9d640 1 --2- 172.21.15.2:0/2541406957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f241c106f10 0x7f241c19cc50 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f241400cce0 tx=0x7f241400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:36.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.567+0000 7f240b7fe640 1 -- 172.21.15.2:0/2541406957 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f241400f450 con 0x7f241c106f10 2024-09-19T06:20:36.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.567+0000 7f240b7fe640 1 -- 172.21.15.2:0/2541406957 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f241400faa0 con 0x7f241c106f10 2024-09-19T06:20:36.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.567+0000 7f240b7fe640 1 -- 172.21.15.2:0/2541406957 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2414018b70 con 0x7f241c106f10 2024-09-19T06:20:36.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.567+0000 7f2420fe4640 1 -- 172.21.15.2:0/2541406957 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f241c19d620 con 0x7f241c106f10 2024-09-19T06:20:36.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.567+0000 7f2420fe4640 1 -- 172.21.15.2:0/2541406957 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f241c1a4f00 con 0x7f241c106f10 2024-09-19T06:20:36.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.569+0000 7f240b7fe640 1 -- 172.21.15.2:0/2541406957 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f2414018d10 con 0x7f241c106f10 2024-09-19T06:20:36.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.569+0000 7f24233bd740 1 Processor -- start 2024-09-19T06:20:36.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.570+0000 7f24233bd740 1 -- start start 2024-09-19T06:20:36.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.570+0000 7f24233bd740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5601928e1b40 0x5601928e0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:36.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.570+0000 7f24233bd740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5601928e05d0 0x5601928e0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:36.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.570+0000 7f24233bd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5601928ef780 0x5601928f1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:36.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.570+0000 7f24233bd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5601928462f0 con 0x5601928ef780 2024-09-19T06:20:36.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.570+0000 7f24233bd740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5601927edcf0 con 0x5601928e1b40 2024-09-19T06:20:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.570+0000 7f24233bd740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5601928422b0 con 0x5601928e05d0 2024-09-19T06:20:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.570+0000 7f2419d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5601928ef780 0x5601928f1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.570+0000 7f2419d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5601928ef780 0x5601928f1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34024/0 (socket says 172.21.15.2:34024) 2024-09-19T06:20:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.570+0000 7f2419d9b640 1 -- 172.21.15.2:0/466955592 learned_addr learned my addr 172.21.15.2:0/466955592 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.570+0000 7f241a59c640 1 --2- 172.21.15.2:0/466955592 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5601928e05d0 0x5601928e0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.570+0000 7f2419d9b640 1 --2- 172.21.15.2:0/466955592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5601928e1b40 0x5601928e0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.570+0000 7f240b7fe640 1 --2- 172.21.15.2:0/2541406957 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f24040a33b0 0x7f24040a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.570+0000 7f241a59c640 1 -- 172.21.15.2:0/466955592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5601928e1b40 msgr2=0x5601928e0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.570+0000 7f241a59c640 1 --2- 172.21.15.2:0/466955592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5601928e1b40 0x5601928e0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.570+0000 7f241a59c640 1 -- 172.21.15.2:0/466955592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5601928ef780 msgr2=0x5601928f1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.570+0000 7f241a59c640 1 --2- 172.21.15.2:0/466955592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5601928ef780 0x5601928f1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.570+0000 7f241a59c640 1 -- 172.21.15.2:0/466955592 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601927d23a0 con 0x5601928e05d0 2024-09-19T06:20:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.570+0000 7f2419d9b640 1 --2- 172.21.15.2:0/466955592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5601928ef780 0x5601928f1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:36.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.571+0000 7f241ad9d640 1 --2- 172.21.15.2:0/2541406957 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f24040a33b0 0x7f24040a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:36.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.571+0000 7f240b7fe640 1 -- 172.21.15.2:0/2541406957 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f24140d0010 con 0x7f241c106f10 2024-09-19T06:20:36.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.571+0000 7f241a59c640 1 --2- 172.21.15.2:0/466955592 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5601928e05d0 0x5601928e0a10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f240c009230 tx=0x7f240c032e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9e29b2010e5f94b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:36.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.571+0000 7f2408ff9640 1 -- 172.21.15.2:0/466955592 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f240c040070 con 0x5601928e05d0 2024-09-19T06:20:36.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.571+0000 7f2408ff9640 1 -- 172.21.15.2:0/466955592 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f240c0316a0 con 0x5601928e05d0 2024-09-19T06:20:36.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.571+0000 7f2408ff9640 1 -- 172.21.15.2:0/466955592 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f240c035040 con 0x5601928e05d0 2024-09-19T06:20:36.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.571+0000 7f241ad9d640 1 --2- 172.21.15.2:0/2541406957 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f24040a33b0 0x7f24040a5870 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f24140cdd90 tx=0x7f2414066d10 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:36.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.572+0000 7f24233bd740 1 -- 172.21.15.2:0/466955592 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5601928e05d0 msgr2=0x5601928e0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:36.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.572+0000 7f24233bd740 1 --2- 172.21.15.2:0/466955592 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5601928e05d0 0x5601928e0a10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f240c009230 tx=0x7f240c032e40 comp rx=0 tx=0).stop 2024-09-19T06:20:36.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.572+0000 7f24233bd740 1 -- 172.21.15.2:0/466955592 shutdown_connections 2024-09-19T06:20:36.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.572+0000 7f24233bd740 1 --2- 172.21.15.2:0/466955592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5601928ef780 0x5601928f1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.572+0000 7f24233bd740 1 --2- 172.21.15.2:0/466955592 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5601928e05d0 0x5601928e0a10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.572+0000 7f24233bd740 1 --2- 172.21.15.2:0/466955592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5601928e1b40 0x5601928e0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.572+0000 7f24233bd740 1 -- 172.21.15.2:0/466955592 >> 172.21.15.2:0/466955592 conn(0x5601928a9310 msgr2=0x5601928dcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:36.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.572+0000 7f24233bd740 1 -- 172.21.15.2:0/466955592 shutdown_connections 2024-09-19T06:20:36.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.572+0000 7f24233bd740 1 -- 172.21.15.2:0/466955592 wait complete. 2024-09-19T06:20:36.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.572+0000 7f24233bd740 1 -- start start 2024-09-19T06:20:36.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.572+0000 7f24233bd740 1 Processor -- start 2024-09-19T06:20:36.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.573+0000 7f24233bd740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5601928e05d0 0x5601928ef170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:36.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.573+0000 7f24233bd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5601928e1b40 0x5601928ec470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:36.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.573+0000 7f24233bd740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5601928ef780 0x5601928ecad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:36.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.573+0000 7f24233bd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5601928f2420 con 0x5601928e1b40 2024-09-19T06:20:36.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.573+0000 7f24233bd740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x560192801060 con 0x5601928ef780 2024-09-19T06:20:36.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.573+0000 7f24233bd740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5601928f25a0 con 0x5601928e05d0 2024-09-19T06:20:36.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.573+0000 7f24233bd740 10 client.0 _ll_register_callbacks cb 0x5601925548c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:36.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.573+0000 7f241a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5601928e1b40 0x5601928ec470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.573+0000 7f241a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5601928e1b40 0x5601928ec470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34032/0 (socket says 172.21.15.2:34032) 2024-09-19T06:20:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.573+0000 7f241a59c640 1 -- 172.21.15.2:0/4268938203 learned_addr learned my addr 172.21.15.2:0/4268938203 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.573+0000 7f2419d9b640 1 --2- 172.21.15.2:0/4268938203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5601928e05d0 0x5601928ef170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.573+0000 7f2419d9b640 1 --2- 172.21.15.2:0/4268938203 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5601928ef780 0x5601928ecad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.573+0000 7f241a59c640 1 -- 172.21.15.2:0/4268938203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5601928e05d0 msgr2=0x5601928ef170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.573+0000 7f241a59c640 1 --2- 172.21.15.2:0/4268938203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5601928e05d0 0x5601928ef170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.573+0000 7f241a59c640 1 -- 172.21.15.2:0/4268938203 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5601928ef780 msgr2=0x5601928ecad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.573+0000 7f241a59c640 1 --2- 172.21.15.2:0/4268938203 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5601928ef780 0x5601928ecad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.573+0000 7f241a59c640 1 -- 172.21.15.2:0/4268938203 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601925b73c0 con 0x5601928e1b40 2024-09-19T06:20:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.573+0000 7f2419d9b640 1 --2- 172.21.15.2:0/4268938203 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5601928ef780 0x5601928ecad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:20:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.573+0000 7f241a59c640 1 --2- 172.21.15.2:0/4268938203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5601928e1b40 0x5601928ec470 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f240c006010 tx=0x7f240c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e13e3c987503051d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:36.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.573+0000 7f2401ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:36.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.574+0000 7f2401ffb640 1 -- 172.21.15.2:0/4268938203 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f240c040070 con 0x5601928e1b40 2024-09-19T06:20:36.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.574+0000 7f2401ffb640 1 -- 172.21.15.2:0/4268938203 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f240c031cf0 con 0x5601928e1b40 2024-09-19T06:20:36.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.574+0000 7f24233bd740 1 -- 172.21.15.2:0/4268938203 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f240c0316a0 con 0x5601928e1b40 2024-09-19T06:20:36.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.574+0000 7f2401ffb640 1 -- 172.21.15.2:0/4268938203 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f240c056050 con 0x5601928e1b40 2024-09-19T06:20:36.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.574+0000 7f24233bd740 10 client.16932 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:36.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.574+0000 7f24233bd740 1 -- 172.21.15.2:0/4268938203 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5601928fdf00 con 0x5601928e1b40 2024-09-19T06:20:36.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.574+0000 7f2401ffb640 1 -- 172.21.15.2:0/4268938203 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f240c0316a0 con 0x5601928e1b40 2024-09-19T06:20:36.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.574+0000 7f2401ffb640 1 -- 172.21.15.2:0/4268938203 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f240c003aa0 con 0x5601928e1b40 2024-09-19T06:20:36.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.574+0000 7f24233bd740 10 client.16932 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:36.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.574+0000 7f24233bd740 10 client.16932 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:20:36.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.574+0000 7f24233bd740 20 client.16932 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:36.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.574+0000 7f24233bd740 1 --2- 172.21.15.2:0/4268938203 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x5601928ff250 0x560192901640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:36.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.574+0000 7f24233bd740 4 client.16932 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:36.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.574+0000 7f24233bd740 1 -- 172.21.15.2:0/4268938203 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560192853860 con 0x5601928ff250 2024-09-19T06:20:36.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.575+0000 7f2419d9b640 1 --2- 172.21.15.2:0/4268938203 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x5601928ff250 0x560192901640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:36.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.575+0000 7f2419d9b640 1 --2- 172.21.15.2:0/4268938203 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x5601928ff250 0x560192901640 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=eb0ac7daf5669989 server_cookie=6aac8ebca2ed6da7 in_seq=0 out_seq=0 2024-09-19T06:20:36.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.575+0000 7f2401ffb640 10 client.16932 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:20:36.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.576+0000 7f2401ffb640 1 -- 172.21.15.2:0/4268938203 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560192853860 con 0x5601928ff250 2024-09-19T06:20:36.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.576+0000 7f2401ffb640 10 client.16932 handle_command_reply: tid=0 2024-09-19T06:20:36.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.576+0000 7f24233bd740 1 client.16932 shutdown 2024-09-19T06:20:36.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.576+0000 7f24233bd740 1 -- 172.21.15.2:0/4268938203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5601928e1b40 msgr2=0x5601928ec470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:36.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.576+0000 7f24233bd740 1 --2- 172.21.15.2:0/4268938203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5601928e1b40 0x5601928ec470 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f240c006010 tx=0x7f240c02a410 comp rx=0 tx=0).stop 2024-09-19T06:20:36.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.576+0000 7f24233bd740 1 -- 172.21.15.2:0/4268938203 shutdown_connections 2024-09-19T06:20:36.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.576+0000 7f24233bd740 1 --2- 172.21.15.2:0/4268938203 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x5601928ff250 0x560192901640 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.576+0000 7f24233bd740 1 --2- 172.21.15.2:0/4268938203 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5601928ef780 0x5601928ecad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.576+0000 7f24233bd740 1 --2- 172.21.15.2:0/4268938203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5601928e1b40 0x5601928ec470 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.576+0000 7f2401ffb640 0 client.16932 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:20:36.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.576+0000 7f24233bd740 1 --2- 172.21.15.2:0/4268938203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5601928e05d0 0x5601928ef170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.576+0000 7f24233bd740 1 -- 172.21.15.2:0/4268938203 >> 172.21.15.2:0/4268938203 conn(0x5601928a9310 msgr2=0x5601928e2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:36.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.576+0000 7f24233bd740 1 -- 172.21.15.2:0/4268938203 shutdown_connections 2024-09-19T06:20:36.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.576+0000 7f24233bd740 1 -- 172.21.15.2:0/4268938203 wait complete. 2024-09-19T06:20:36.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.576+0000 7f24233bd740 20 client.16932 trim_cache size 0 max 16384 2024-09-19T06:20:36.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.589+0000 7f24233bd740 1 Processor -- start 2024-09-19T06:20:36.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.589+0000 7f24233bd740 1 -- start start 2024-09-19T06:20:36.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.589+0000 7f24233bd740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5601928e05d0 0x5601928fb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:36.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.589+0000 7f24233bd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5601928e1b40 0x5601928eb360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:36.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.589+0000 7f24233bd740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5601928ef780 0x560192904280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:36.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.589+0000 7f24233bd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f241c1adc70 con 0x5601928e1b40 2024-09-19T06:20:36.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.589+0000 7f24233bd740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f241c1ab540 con 0x5601928ef780 2024-09-19T06:20:36.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.589+0000 7f24233bd740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f241c1a93b0 con 0x5601928e05d0 2024-09-19T06:20:36.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.590+0000 7f241a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5601928e1b40 0x5601928eb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:36.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.590+0000 7f241a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5601928e1b40 0x5601928eb360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34048/0 (socket says 172.21.15.2:34048) 2024-09-19T06:20:36.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.590+0000 7f241a59c640 1 -- 172.21.15.2:0/2761835499 learned_addr learned my addr 172.21.15.2:0/2761835499 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:36.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.590+0000 7f2419d9b640 1 --2- 172.21.15.2:0/2761835499 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5601928e05d0 0x5601928fb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:36.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.590+0000 7f241a59c640 1 -- 172.21.15.2:0/2761835499 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5601928e05d0 msgr2=0x5601928fb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:36.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.590+0000 7f241a59c640 1 --2- 172.21.15.2:0/2761835499 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5601928e05d0 0x5601928fb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.590+0000 7f2419d9b640 1 --2- 172.21.15.2:0/2761835499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5601928ef780 0x560192904280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:36.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.590+0000 7f241a59c640 1 -- 172.21.15.2:0/2761835499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5601928ef780 msgr2=0x560192904280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:36.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.590+0000 7f241a59c640 1 --2- 172.21.15.2:0/2761835499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5601928ef780 0x560192904280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.590+0000 7f241a59c640 1 -- 172.21.15.2:0/2761835499 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601928db310 con 0x5601928e1b40 2024-09-19T06:20:36.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.590+0000 7f2419d9b640 1 --2- 172.21.15.2:0/2761835499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5601928ef780 0x560192904280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:20:36.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.590+0000 7f241a59c640 1 --2- 172.21.15.2:0/2761835499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5601928e1b40 0x5601928eb360 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f240c009900 tx=0x7f240c0053f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4027373c9ccc31 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:36.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.590+0000 7f2403fff640 1 -- 172.21.15.2:0/2761835499 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f240c040040 con 0x5601928e1b40 2024-09-19T06:20:36.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.590+0000 7f2403fff640 1 -- 172.21.15.2:0/2761835499 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f240c04d070 con 0x5601928e1b40 2024-09-19T06:20:36.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.590+0000 7f2403fff640 1 -- 172.21.15.2:0/2761835499 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f240c035040 con 0x5601928e1b40 2024-09-19T06:20:36.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.591+0000 7f24233bd740 1 -- 172.21.15.2:0/2761835499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5601928e1b40 msgr2=0x5601928eb360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:36.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.591+0000 7f24233bd740 1 --2- 172.21.15.2:0/2761835499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5601928e1b40 0x5601928eb360 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f240c009900 tx=0x7f240c0053f0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.591+0000 7f24233bd740 1 -- 172.21.15.2:0/2761835499 shutdown_connections 2024-09-19T06:20:36.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.591+0000 7f24233bd740 1 --2- 172.21.15.2:0/2761835499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5601928ef780 0x560192904280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.591+0000 7f24233bd740 1 --2- 172.21.15.2:0/2761835499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5601928e1b40 0x5601928eb360 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.591+0000 7f24233bd740 1 --2- 172.21.15.2:0/2761835499 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5601928e05d0 0x5601928fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.591+0000 7f24233bd740 1 -- 172.21.15.2:0/2761835499 >> 172.21.15.2:0/2761835499 conn(0x5601928a9310 msgr2=0x5601928eac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:36.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.591+0000 7f24233bd740 1 -- 172.21.15.2:0/2761835499 shutdown_connections 2024-09-19T06:20:36.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.591+0000 7f24233bd740 1 -- 172.21.15.2:0/2761835499 wait complete. 2024-09-19T06:20:36.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.591+0000 7f24233bd740 1 -- start start 2024-09-19T06:20:36.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.591+0000 7f24233bd740 1 Processor -- start 2024-09-19T06:20:36.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.592+0000 7f24233bd740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5601928e05d0 0x560192904a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:36.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.592+0000 7f24233bd740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5601928e1b40 0x560192901d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:36.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.592+0000 7f24233bd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5601928ef780 0x5601929022b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:36.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.592+0000 7f24233bd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f241c1a9a00 con 0x5601928ef780 2024-09-19T06:20:36.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.592+0000 7f24233bd740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f241c1aae70 con 0x5601928e1b40 2024-09-19T06:20:36.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.592+0000 7f24233bd740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f241c1aa0d0 con 0x5601928e05d0 2024-09-19T06:20:36.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.592+0000 7f24233bd740 10 client.0 _ll_register_callbacks cb 0x7f241000be80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:36.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.592+0000 7f2419d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5601928ef780 0x5601929022b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:36.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.592+0000 7f2419d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5601928ef780 0x5601929022b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34054/0 (socket says 172.21.15.2:34054) 2024-09-19T06:20:36.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.592+0000 7f2419d9b640 1 -- 172.21.15.2:0/3302708387 learned_addr learned my addr 172.21.15.2:0/3302708387 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:36.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.592+0000 7f2419d9b640 1 --2- 172.21.15.2:0/3302708387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5601928e05d0 0x560192904a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:36.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.592+0000 7f241a59c640 1 --2- 172.21.15.2:0/3302708387 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5601928e1b40 0x560192901d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:36.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.592+0000 7f2419d9b640 1 -- 172.21.15.2:0/3302708387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5601928e05d0 msgr2=0x560192904a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:36.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.592+0000 7f2419d9b640 1 --2- 172.21.15.2:0/3302708387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5601928e05d0 0x560192904a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.592+0000 7f2419d9b640 1 -- 172.21.15.2:0/3302708387 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5601928e1b40 msgr2=0x560192901d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:36.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.592+0000 7f2419d9b640 1 --2- 172.21.15.2:0/3302708387 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5601928e1b40 0x560192901d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.592+0000 7f2419d9b640 1 -- 172.21.15.2:0/3302708387 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601928dd960 con 0x5601928ef780 2024-09-19T06:20:36.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.592+0000 7f241a59c640 1 --2- 172.21.15.2:0/3302708387 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5601928e1b40 0x560192901d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:36.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.592+0000 7f2419d9b640 1 --2- 172.21.15.2:0/3302708387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5601928ef780 0x5601929022b0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f241000bb40 tx=0x7f240c005380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c347d2c7b3a25cf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:36.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.592+0000 7f2401ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:36.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.593+0000 7f2401ffb640 1 -- 172.21.15.2:0/3302708387 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2410004e50 con 0x5601928ef780 2024-09-19T06:20:36.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.593+0000 7f2401ffb640 1 -- 172.21.15.2:0/3302708387 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f2410004020 con 0x5601928ef780 2024-09-19T06:20:36.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.593+0000 7f24233bd740 1 -- 172.21.15.2:0/3302708387 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f240c04d070 con 0x5601928ef780 2024-09-19T06:20:36.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.593+0000 7f2401ffb640 1 -- 172.21.15.2:0/3302708387 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2410004220 con 0x5601928ef780 2024-09-19T06:20:36.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.593+0000 7f24233bd740 10 client.16938 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:36.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.593+0000 7f24233bd740 1 -- 172.21.15.2:0/3302708387 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5601929699c0 con 0x5601928ef780 2024-09-19T06:20:36.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.593+0000 7f2401ffb640 1 -- 172.21.15.2:0/3302708387 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f240c04d070 con 0x5601928ef780 2024-09-19T06:20:36.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.593+0000 7f2401ffb640 1 -- 172.21.15.2:0/3302708387 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f2410022300 con 0x5601928ef780 2024-09-19T06:20:36.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.593+0000 7f24233bd740 10 client.16938 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:36.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.593+0000 7f24233bd740 10 client.16938 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:20:36.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.593+0000 7f24233bd740 20 client.16938 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:36.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.593+0000 7f24233bd740 1 --2- 172.21.15.2:0/3302708387 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x56019296a090 0x56019296c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:36.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.593+0000 7f24233bd740 4 client.16938 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:20:36.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.593+0000 7f24233bd740 1 -- 172.21.15.2:0/3302708387 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56019284dd70 con 0x56019296a090 2024-09-19T06:20:36.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.594+0000 7f241a59c640 1 --2- 172.21.15.2:0/3302708387 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x56019296a090 0x56019296c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:36.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.594+0000 7f241a59c640 1 --2- 172.21.15.2:0/3302708387 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x56019296a090 0x56019296c480 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8c27bffe5abf1660 server_cookie=5750d1b518ad9d7b in_seq=0 out_seq=0 2024-09-19T06:20:36.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.594+0000 7f2401ffb640 10 client.16938 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:20:36.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.594+0000 7f2401ffb640 1 -- 172.21.15.2:0/3302708387 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56019284dd70 con 0x56019296a090 2024-09-19T06:20:36.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.594+0000 7f2401ffb640 10 client.16938 handle_command_reply: tid=0 2024-09-19T06:20:36.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.594+0000 7f24233bd740 1 client.16938 shutdown 2024-09-19T06:20:36.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.594+0000 7f24233bd740 1 -- 172.21.15.2:0/3302708387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5601928ef780 msgr2=0x5601929022b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:36.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.594+0000 7f24233bd740 1 --2- 172.21.15.2:0/3302708387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5601928ef780 0x5601929022b0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f241000bb40 tx=0x7f240c005380 comp rx=0 tx=0).stop 2024-09-19T06:20:36.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.594+0000 7f24233bd740 1 -- 172.21.15.2:0/3302708387 shutdown_connections 2024-09-19T06:20:36.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.594+0000 7f24233bd740 1 --2- 172.21.15.2:0/3302708387 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x56019296a090 0x56019296c480 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.594+0000 7f24233bd740 1 --2- 172.21.15.2:0/3302708387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5601928ef780 0x5601929022b0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.594+0000 7f24233bd740 1 --2- 172.21.15.2:0/3302708387 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5601928e1b40 0x560192901d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.594+0000 7f2401ffb640 0 client.16938 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:20:36.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.594+0000 7f24233bd740 1 --2- 172.21.15.2:0/3302708387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5601928e05d0 0x560192904a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.594+0000 7f24233bd740 1 -- 172.21.15.2:0/3302708387 >> 172.21.15.2:0/3302708387 conn(0x5601928a9310 msgr2=0x5601928eb470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:36.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.594+0000 7f24233bd740 1 -- 172.21.15.2:0/3302708387 shutdown_connections 2024-09-19T06:20:36.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.594+0000 7f24233bd740 1 -- 172.21.15.2:0/3302708387 wait complete. 2024-09-19T06:20:36.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.594+0000 7f24233bd740 20 client.16938 trim_cache size 0 max 16384 2024-09-19T06:20:36.602 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:20:36.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.595+0000 7f2420fe4640 1 -- 172.21.15.2:0/2541406957 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f24040a33b0 msgr2=0x7f24040a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:36.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.595+0000 7f2420fe4640 1 --2- 172.21.15.2:0/2541406957 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f24040a33b0 0x7f24040a5870 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f24140cdd90 tx=0x7f2414066d10 comp rx=0 tx=0).stop 2024-09-19T06:20:36.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.595+0000 7f2420fe4640 1 -- 172.21.15.2:0/2541406957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f241c106f10 msgr2=0x7f241c19cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:36.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.595+0000 7f2420fe4640 1 --2- 172.21.15.2:0/2541406957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f241c106f10 0x7f241c19cc50 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f241400cce0 tx=0x7f241400a620 comp rx=0 tx=0).stop 2024-09-19T06:20:36.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.595+0000 7f2420fe4640 1 -- 172.21.15.2:0/2541406957 shutdown_connections 2024-09-19T06:20:36.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.595+0000 7f2420fe4640 1 --2- 172.21.15.2:0/2541406957 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f24040a33b0 0x7f24040a5870 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.595+0000 7f2420fe4640 1 --2- 172.21.15.2:0/2541406957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f241c106f10 0x7f241c19cc50 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.595+0000 7f2420fe4640 1 --2- 172.21.15.2:0/2541406957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f241c102790 0x7f241c1988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.595+0000 7f2420fe4640 1 --2- 172.21.15.2:0/2541406957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f241c101de0 0x7f241c198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.595+0000 7f2420fe4640 1 -- 172.21.15.2:0/2541406957 >> 172.21.15.2:0/2541406957 conn(0x7f241c0fd8c0 msgr2=0x7f241c0fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:36.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.595+0000 7f2420fe4640 1 -- 172.21.15.2:0/2541406957 shutdown_connections 2024-09-19T06:20:36.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:36.595+0000 7f2420fe4640 1 -- 172.21.15.2:0/2541406957 wait complete. 2024-09-19T06:20:37.384 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:20:37.641 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:38.074 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:37 smithi002 ceph-mon[30982]: pgmap v177: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:20:38.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.157+0000 7f409048d640 1 -- 172.21.15.2:0/3823390277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4088101420 msgr2=0x7f408810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:38.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.157+0000 7f409048d640 1 --2- 172.21.15.2:0/3823390277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4088101420 0x7f408810d950 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f4080009cd0 tx=0x7f408002a8e0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.157+0000 7f409048d640 1 -- 172.21.15.2:0/3823390277 shutdown_connections 2024-09-19T06:20:38.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.157+0000 7f409048d640 1 --2- 172.21.15.2:0/3823390277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4088101420 0x7f408810d950 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.157+0000 7f409048d640 1 --2- 172.21.15.2:0/3823390277 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4088100a80 0x7f4088100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.157+0000 7f409048d640 1 --2- 172.21.15.2:0/3823390277 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4088106a80 0x7f4088106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.157+0000 7f409048d640 1 -- 172.21.15.2:0/3823390277 >> 172.21.15.2:0/3823390277 conn(0x7f40880fc7a0 msgr2=0x7f40880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:38.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.157+0000 7f409048d640 1 -- 172.21.15.2:0/3823390277 shutdown_connections 2024-09-19T06:20:38.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.157+0000 7f409048d640 1 -- 172.21.15.2:0/3823390277 wait complete. 2024-09-19T06:20:38.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.158+0000 7f409048d640 1 Processor -- start 2024-09-19T06:20:38.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.158+0000 7f409048d640 1 -- start start 2024-09-19T06:20:38.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.158+0000 7f409048d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4088100a80 0x7f40880fce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:38.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.158+0000 7f409048d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4088101420 0x7f40880fd370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:38.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.158+0000 7f409048d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4088106a80 0x7f40880fd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:38.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.158+0000 7f409048d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4088110d30 con 0x7f4088101420 2024-09-19T06:20:38.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.158+0000 7f409048d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4088110bb0 con 0x7f4088106a80 2024-09-19T06:20:38.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.158+0000 7f409048d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4088110eb0 con 0x7f4088100a80 2024-09-19T06:20:38.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.158+0000 7f408da28640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4088101420 0x7f40880fd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:38.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.158+0000 7f408da28640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4088101420 0x7f40880fd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34068/0 (socket says 172.21.15.2:34068) 2024-09-19T06:20:38.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.158+0000 7f408da28640 1 -- 172.21.15.2:0/1853549775 learned_addr learned my addr 172.21.15.2:0/1853549775 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:38.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.158+0000 7f408ea2a640 1 --2- 172.21.15.2:0/1853549775 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4088106a80 0x7f40880fd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:38.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.158+0000 7f408e229640 1 --2- 172.21.15.2:0/1853549775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4088100a80 0x7f40880fce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:38.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.159+0000 7f408da28640 1 -- 172.21.15.2:0/1853549775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4088100a80 msgr2=0x7f40880fce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:38.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.159+0000 7f408da28640 1 --2- 172.21.15.2:0/1853549775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4088100a80 0x7f40880fce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.159+0000 7f408da28640 1 -- 172.21.15.2:0/1853549775 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4088106a80 msgr2=0x7f40880fd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:38.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.159+0000 7f408da28640 1 --2- 172.21.15.2:0/1853549775 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4088106a80 0x7f40880fd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.159+0000 7f408da28640 1 -- 172.21.15.2:0/1853549775 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40881a6830 con 0x7f4088101420 2024-09-19T06:20:38.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.159+0000 7f408ea2a640 1 --2- 172.21.15.2:0/1853549775 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4088106a80 0x7f40880fd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:38.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.159+0000 7f408e229640 1 --2- 172.21.15.2:0/1853549775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4088100a80 0x7f40880fce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:38.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.159+0000 7f408da28640 1 --2- 172.21.15.2:0/1853549775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4088101420 0x7f40880fd370 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f407800d950 tx=0x7f407800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:38.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.159+0000 7f407f7fe640 1 -- 172.21.15.2:0/1853549775 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4078017070 con 0x7f4088101420 2024-09-19T06:20:38.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.159+0000 7f407f7fe640 1 -- 172.21.15.2:0/1853549775 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4078009c30 con 0x7f4088101420 2024-09-19T06:20:38.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.159+0000 7f409048d640 1 -- 172.21.15.2:0/1853549775 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40881a6b20 con 0x7f4088101420 2024-09-19T06:20:38.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.159+0000 7f407f7fe640 1 -- 172.21.15.2:0/1853549775 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407800f620 con 0x7f4088101420 2024-09-19T06:20:38.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.159+0000 7f409048d640 1 -- 172.21.15.2:0/1853549775 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40881a70b0 con 0x7f4088101420 2024-09-19T06:20:38.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.161+0000 7f407f7fe640 1 -- 172.21.15.2:0/1853549775 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f40780109a0 con 0x7f4088101420 2024-09-19T06:20:38.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.162+0000 7f4092866740 1 Processor -- start 2024-09-19T06:20:38.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.162+0000 7f4092866740 1 -- start start 2024-09-19T06:20:38.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.162+0000 7f4092866740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568eeaefb40 0x5568eeaee090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:38.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.162+0000 7f4092866740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5568eeaee5d0 0x5568eeaeea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:38.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.162+0000 7f4092866740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5568eeaf9370 0x5568eeafb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:38.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.162+0000 7f4092866740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5568eea542f0 con 0x5568eeaefb40 2024-09-19T06:20:38.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.162+0000 7f4092866740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5568ee9fbcf0 con 0x5568eeaf9370 2024-09-19T06:20:38.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.162+0000 7f4092866740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5568eea502b0 con 0x5568eeaee5d0 2024-09-19T06:20:38.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.162+0000 7f408ea2a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568eeaefb40 0x5568eeaee090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:38.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.162+0000 7f407f7fe640 1 --2- 172.21.15.2:0/1853549775 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f40740a3430 0x7f40740a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:38.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.162+0000 7f408ea2a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568eeaefb40 0x5568eeaee090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34078/0 (socket says 172.21.15.2:34078) 2024-09-19T06:20:38.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.162+0000 7f408ea2a640 1 -- 172.21.15.2:0/3322943221 learned_addr learned my addr 172.21.15.2:0/3322943221 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:38.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.163+0000 7f408da28640 1 --2- 172.21.15.2:0/3322943221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5568eeaf9370 0x5568eeafb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:38.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.163+0000 7f408e229640 1 --2- 172.21.15.2:0/3322943221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5568eeaee5d0 0x5568eeaeea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:38.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.163+0000 7f408ea2a640 1 --2- 172.21.15.2:0/1853549775 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f40740a3430 0x7f40740a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:38.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.163+0000 7f407f7fe640 1 -- 172.21.15.2:0/1853549775 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f40780cf960 con 0x7f4088101420 2024-09-19T06:20:38.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.163+0000 7f408ea2a640 1 -- 172.21.15.2:0/3322943221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5568eeaee5d0 msgr2=0x5568eeaeea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:38.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.163+0000 7f408ea2a640 1 --2- 172.21.15.2:0/3322943221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5568eeaee5d0 0x5568eeaeea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.163+0000 7f408ea2a640 1 -- 172.21.15.2:0/3322943221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5568eeaf9370 msgr2=0x5568eeafb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:38.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.163+0000 7f408ea2a640 1 --2- 172.21.15.2:0/3322943221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5568eeaf9370 0x5568eeafb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.163+0000 7f408ea2a640 1 -- 172.21.15.2:0/3322943221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568ee9e03a0 con 0x5568eeaefb40 2024-09-19T06:20:38.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.163+0000 7f408ea2a640 1 --2- 172.21.15.2:0/3322943221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568eeaefb40 0x5568eeaee090 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f4080009430 tx=0x7f4080031b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d0ef48d2d788fde server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:38.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.163+0000 7f407cff9640 1 -- 172.21.15.2:0/3322943221 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4080004240 con 0x5568eeaefb40 2024-09-19T06:20:38.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.163+0000 7f407cff9640 1 -- 172.21.15.2:0/3322943221 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4080036040 con 0x5568eeaefb40 2024-09-19T06:20:38.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.163+0000 7f407cff9640 1 -- 172.21.15.2:0/3322943221 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4080030b60 con 0x5568eeaefb40 2024-09-19T06:20:38.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.163+0000 7f408ea2a640 1 --2- 172.21.15.2:0/1853549775 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f40740a3430 0x7f40740a58f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f408004d000 tx=0x7f408004b000 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:38.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.164+0000 7f4092866740 1 -- 172.21.15.2:0/3322943221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568eeaefb40 msgr2=0x5568eeaee090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:38.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.164+0000 7f4092866740 1 --2- 172.21.15.2:0/3322943221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568eeaefb40 0x5568eeaee090 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f4080009430 tx=0x7f4080031b90 comp rx=0 tx=0).stop 2024-09-19T06:20:38.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.164+0000 7f4092866740 1 -- 172.21.15.2:0/3322943221 shutdown_connections 2024-09-19T06:20:38.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.164+0000 7f4092866740 1 --2- 172.21.15.2:0/3322943221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5568eeaf9370 0x5568eeafb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.164+0000 7f4092866740 1 --2- 172.21.15.2:0/3322943221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5568eeaee5d0 0x5568eeaeea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.164+0000 7f4092866740 1 --2- 172.21.15.2:0/3322943221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568eeaefb40 0x5568eeaee090 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.164+0000 7f4092866740 1 -- 172.21.15.2:0/3322943221 >> 172.21.15.2:0/3322943221 conn(0x5568eeab7310 msgr2=0x5568eeaeac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:38.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.164+0000 7f4092866740 1 -- 172.21.15.2:0/3322943221 shutdown_connections 2024-09-19T06:20:38.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.164+0000 7f4092866740 1 -- 172.21.15.2:0/3322943221 wait complete. 2024-09-19T06:20:38.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.165+0000 7f4092866740 1 -- start start 2024-09-19T06:20:38.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.165+0000 7f4092866740 1 Processor -- start 2024-09-19T06:20:38.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.165+0000 7f4092866740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5568eeaee5d0 0x5568eeaf8d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:38.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.165+0000 7f4092866740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568eeaefb40 0x5568eeaf6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:38.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.165+0000 7f4092866740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5568eeaf9370 0x5568eeaf6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:38.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.165+0000 7f4092866740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5568eeafc070 con 0x5568eeaefb40 2024-09-19T06:20:38.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.165+0000 7f4092866740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5568eea0f060 con 0x5568eeaf9370 2024-09-19T06:20:38.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.165+0000 7f4092866740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5568eeafc1f0 con 0x5568eeaee5d0 2024-09-19T06:20:38.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.165+0000 7f4092866740 10 client.0 _ll_register_callbacks cb 0x5568ee7628c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:38.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.165+0000 7f408da28640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568eeaefb40 0x5568eeaf6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:38.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.165+0000 7f408e229640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5568eeaee5d0 0x5568eeaf8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:38.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.165+0000 7f408da28640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568eeaefb40 0x5568eeaf6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34094/0 (socket says 172.21.15.2:34094) 2024-09-19T06:20:38.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.165+0000 7f408da28640 1 -- 172.21.15.2:0/743662626 learned_addr learned my addr 172.21.15.2:0/743662626 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:38.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.165+0000 7f408ea2a640 1 --2- 172.21.15.2:0/743662626 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5568eeaf9370 0x5568eeaf6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:38.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.165+0000 7f408da28640 1 -- 172.21.15.2:0/743662626 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5568eeaee5d0 msgr2=0x5568eeaf8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:38.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.165+0000 7f408da28640 1 --2- 172.21.15.2:0/743662626 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5568eeaee5d0 0x5568eeaf8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.165+0000 7f408da28640 1 -- 172.21.15.2:0/743662626 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5568eeaf9370 msgr2=0x5568eeaf6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:38.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.165+0000 7f408da28640 1 --2- 172.21.15.2:0/743662626 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5568eeaf9370 0x5568eeaf6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.165+0000 7f408da28640 1 -- 172.21.15.2:0/743662626 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568ee7c53c0 con 0x5568eeaefb40 2024-09-19T06:20:38.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.165+0000 7f408ea2a640 1 --2- 172.21.15.2:0/743662626 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5568eeaf9370 0x5568eeaf6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:38.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.166+0000 7f408da28640 1 --2- 172.21.15.2:0/743662626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568eeaefb40 0x5568eeaf6020 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f407809bc00 tx=0x7f4078020e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9677314e7cb1d213 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:38.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.166+0000 7f4071ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:38.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.166+0000 7f4071ffb640 1 -- 172.21.15.2:0/743662626 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4078020040 con 0x5568eeaefb40 2024-09-19T06:20:38.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.166+0000 7f4071ffb640 1 -- 172.21.15.2:0/743662626 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f407809b0c0 con 0x5568eeaefb40 2024-09-19T06:20:38.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.166+0000 7f4092866740 1 -- 172.21.15.2:0/743662626 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4080036040 con 0x5568eeaefb40 2024-09-19T06:20:38.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.166+0000 7f4071ffb640 1 -- 172.21.15.2:0/743662626 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4078092030 con 0x5568eeaefb40 2024-09-19T06:20:38.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.166+0000 7f4092866740 10 client.16950 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:38.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.166+0000 7f4092866740 1 -- 172.21.15.2:0/743662626 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5568eeb07b60 con 0x5568eeaefb40 2024-09-19T06:20:38.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.166+0000 7f4071ffb640 1 -- 172.21.15.2:0/743662626 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4080036040 con 0x5568eeaefb40 2024-09-19T06:20:38.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.166+0000 7f4071ffb640 1 -- 172.21.15.2:0/743662626 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f4078096390 con 0x5568eeaefb40 2024-09-19T06:20:38.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.166+0000 7f4092866740 10 client.16950 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:38.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.167+0000 7f4092866740 10 client.16950 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:20:38.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.167+0000 7f4092866740 20 client.16950 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:38.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.167+0000 7f4092866740 1 --2- 172.21.15.2:0/743662626 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5568eeb09020 0x5568eeb0b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:38.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.167+0000 7f4092866740 4 client.16950 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:38.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.167+0000 7f4092866740 1 -- 172.21.15.2:0/743662626 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5568eea61860 con 0x5568eeb09020 2024-09-19T06:20:38.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.167+0000 7f408e229640 1 --2- 172.21.15.2:0/743662626 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5568eeb09020 0x5568eeb0b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:38.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.167+0000 7f4071ffb640 10 client.16950 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:20:38.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.167+0000 7f408e229640 1 --2- 172.21.15.2:0/743662626 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5568eeb09020 0x5568eeb0b410 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f892703dc9c7fd08 server_cookie=2cb0376c174cfa5b in_seq=0 out_seq=0 2024-09-19T06:20:38.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.168+0000 7f4071ffb640 1 -- 172.21.15.2:0/743662626 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5568eea61860 con 0x5568eeb09020 2024-09-19T06:20:38.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.168+0000 7f4071ffb640 10 client.16950 handle_command_reply: tid=0 2024-09-19T06:20:38.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.168+0000 7f4092866740 1 client.16950 shutdown 2024-09-19T06:20:38.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.168+0000 7f4092866740 1 -- 172.21.15.2:0/743662626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568eeaefb40 msgr2=0x5568eeaf6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:38.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.168+0000 7f4092866740 1 --2- 172.21.15.2:0/743662626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568eeaefb40 0x5568eeaf6020 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f407809bc00 tx=0x7f4078020e80 comp rx=0 tx=0).stop 2024-09-19T06:20:38.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.168+0000 7f4092866740 1 -- 172.21.15.2:0/743662626 shutdown_connections 2024-09-19T06:20:38.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.168+0000 7f4092866740 1 --2- 172.21.15.2:0/743662626 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5568eeb09020 0x5568eeb0b410 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.168+0000 7f4092866740 1 --2- 172.21.15.2:0/743662626 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5568eeaf9370 0x5568eeaf6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.168+0000 7f4092866740 1 --2- 172.21.15.2:0/743662626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568eeaefb40 0x5568eeaf6020 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.168+0000 7f4092866740 1 --2- 172.21.15.2:0/743662626 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5568eeaee5d0 0x5568eeaf8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.168+0000 7f4092866740 1 -- 172.21.15.2:0/743662626 >> 172.21.15.2:0/743662626 conn(0x5568eeab7310 msgr2=0x5568eeaf0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:38.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.168+0000 7f4071ffb640 0 client.16950 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:20:38.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.168+0000 7f4092866740 1 -- 172.21.15.2:0/743662626 shutdown_connections 2024-09-19T06:20:38.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.168+0000 7f4092866740 1 -- 172.21.15.2:0/743662626 wait complete. 2024-09-19T06:20:38.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.168+0000 7f4092866740 20 client.16950 trim_cache size 0 max 16384 2024-09-19T06:20:38.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.182+0000 7f4092866740 1 Processor -- start 2024-09-19T06:20:38.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.182+0000 7f4092866740 1 -- start start 2024-09-19T06:20:38.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.182+0000 7f4092866740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5568eeaee5d0 0x5568eeb05310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:38.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.182+0000 7f4092866740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568eeaefb40 0x5568eeaf58e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:38.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.182+0000 7f4092866740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5568eeaf9370 0x5568eeb10c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:38.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.182+0000 7f4092866740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f40881b21d0 con 0x5568eeaefb40 2024-09-19T06:20:38.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.182+0000 7f4092866740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f40881afaa0 con 0x5568eeaf9370 2024-09-19T06:20:38.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.182+0000 7f4092866740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f40881ad8f0 con 0x5568eeaee5d0 2024-09-19T06:20:38.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.182+0000 7f408da28640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568eeaefb40 0x5568eeaf58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:38.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.182+0000 7f408da28640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568eeaefb40 0x5568eeaf58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34104/0 (socket says 172.21.15.2:34104) 2024-09-19T06:20:38.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.182+0000 7f408da28640 1 -- 172.21.15.2:0/3317132061 learned_addr learned my addr 172.21.15.2:0/3317132061 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:38.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.182+0000 7f408ea2a640 1 --2- 172.21.15.2:0/3317132061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5568eeaf9370 0x5568eeb10c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:38.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.182+0000 7f408e229640 1 --2- 172.21.15.2:0/3317132061 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5568eeaee5d0 0x5568eeb05310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:38.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.182+0000 7f408da28640 1 -- 172.21.15.2:0/3317132061 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5568eeaee5d0 msgr2=0x5568eeb05310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:38.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.182+0000 7f408da28640 1 --2- 172.21.15.2:0/3317132061 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5568eeaee5d0 0x5568eeb05310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.182+0000 7f408da28640 1 -- 172.21.15.2:0/3317132061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5568eeaf9370 msgr2=0x5568eeb10c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:38.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.182+0000 7f408da28640 1 --2- 172.21.15.2:0/3317132061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5568eeaf9370 0x5568eeb10c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.182+0000 7f408da28640 1 -- 172.21.15.2:0/3317132061 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568eeaf1120 con 0x5568eeaefb40 2024-09-19T06:20:38.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.182+0000 7f408e229640 1 --2- 172.21.15.2:0/3317132061 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5568eeaee5d0 0x5568eeb05310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:20:38.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.183+0000 7f408da28640 1 --2- 172.21.15.2:0/3317132061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568eeaefb40 0x5568eeaf58e0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f40780058c0 tx=0x7f40780071c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dfc7d9a3f4479b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:38.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.183+0000 7f4073fff640 1 -- 172.21.15.2:0/3317132061 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407809b5d0 con 0x5568eeaefb40 2024-09-19T06:20:38.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.183+0000 7f4073fff640 1 -- 172.21.15.2:0/3317132061 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4078009de0 con 0x5568eeaefb40 2024-09-19T06:20:38.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.183+0000 7f4073fff640 1 -- 172.21.15.2:0/3317132061 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407809b390 con 0x5568eeaefb40 2024-09-19T06:20:38.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.183+0000 7f4092866740 1 -- 172.21.15.2:0/3317132061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568eeaefb40 msgr2=0x5568eeaf58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:38.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.183+0000 7f4092866740 1 --2- 172.21.15.2:0/3317132061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568eeaefb40 0x5568eeaf58e0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f40780058c0 tx=0x7f40780071c0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.183+0000 7f4092866740 1 -- 172.21.15.2:0/3317132061 shutdown_connections 2024-09-19T06:20:38.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.183+0000 7f4092866740 1 --2- 172.21.15.2:0/3317132061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5568eeaf9370 0x5568eeb10c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.183+0000 7f4092866740 1 --2- 172.21.15.2:0/3317132061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568eeaefb40 0x5568eeaf58e0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.183+0000 7f4092866740 1 --2- 172.21.15.2:0/3317132061 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5568eeaee5d0 0x5568eeb05310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.183+0000 7f4092866740 1 -- 172.21.15.2:0/3317132061 >> 172.21.15.2:0/3317132061 conn(0x5568eeab7310 msgr2=0x5568eeaf5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:38.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.183+0000 7f4092866740 1 -- 172.21.15.2:0/3317132061 shutdown_connections 2024-09-19T06:20:38.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.183+0000 7f4092866740 1 -- 172.21.15.2:0/3317132061 wait complete. 2024-09-19T06:20:38.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.184+0000 7f4092866740 1 -- start start 2024-09-19T06:20:38.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.184+0000 7f4092866740 1 Processor -- start 2024-09-19T06:20:38.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.184+0000 7f4092866740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5568eeaee5d0 0x5568eeafd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:38.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.184+0000 7f4092866740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5568eeaefb40 0x5568eeafde40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:38.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.184+0000 7f4092866740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568eeaf9370 0x5568eeb72c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:38.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.184+0000 7f4092866740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f40881adf60 con 0x5568eeaf9370 2024-09-19T06:20:38.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.184+0000 7f4092866740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f40881af3d0 con 0x5568eeaefb40 2024-09-19T06:20:38.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.184+0000 7f4092866740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f40881ae630 con 0x5568eeaee5d0 2024-09-19T06:20:38.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.184+0000 7f4092866740 10 client.0 _ll_register_callbacks cb 0x7f407800df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:38.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.184+0000 7f408ea2a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568eeaf9370 0x5568eeb72c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:38.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.184+0000 7f408ea2a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568eeaf9370 0x5568eeb72c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34108/0 (socket says 172.21.15.2:34108) 2024-09-19T06:20:38.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.184+0000 7f408ea2a640 1 -- 172.21.15.2:0/915133754 learned_addr learned my addr 172.21.15.2:0/915133754 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:38.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.184+0000 7f408e229640 1 --2- 172.21.15.2:0/915133754 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5568eeaee5d0 0x5568eeafd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:38.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.185+0000 7f408ea2a640 1 -- 172.21.15.2:0/915133754 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5568eeaee5d0 msgr2=0x5568eeafd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:38.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.185+0000 7f408ea2a640 1 --2- 172.21.15.2:0/915133754 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5568eeaee5d0 0x5568eeafd900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.185+0000 7f408da28640 1 --2- 172.21.15.2:0/915133754 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5568eeaefb40 0x5568eeafde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:38.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.185+0000 7f408ea2a640 1 -- 172.21.15.2:0/915133754 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5568eeaefb40 msgr2=0x5568eeafde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:38.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.185+0000 7f408ea2a640 1 --2- 172.21.15.2:0/915133754 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5568eeaefb40 0x5568eeafde40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.185+0000 7f408ea2a640 1 -- 172.21.15.2:0/915133754 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568eeb731a0 con 0x5568eeaf9370 2024-09-19T06:20:38.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.185+0000 7f408da28640 1 --2- 172.21.15.2:0/915133754 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5568eeaefb40 0x5568eeafde40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:20:38.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.185+0000 7f408ea2a640 1 --2- 172.21.15.2:0/915133754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568eeaf9370 0x5568eeb72c60 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f4080030b50 tx=0x7f4080030b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f2104a7c4efaeec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:38.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.185+0000 7f4071ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:38.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.185+0000 7f4071ffb640 1 -- 172.21.15.2:0/915133754 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4080030e80 con 0x5568eeaf9370 2024-09-19T06:20:38.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.185+0000 7f4071ffb640 1 -- 172.21.15.2:0/915133754 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f408002e050 con 0x5568eeaf9370 2024-09-19T06:20:38.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.185+0000 7f4092866740 1 -- 172.21.15.2:0/915133754 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4078009de0 con 0x5568eeaf9370 2024-09-19T06:20:38.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.185+0000 7f4071ffb640 1 -- 172.21.15.2:0/915133754 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4080004250 con 0x5568eeaf9370 2024-09-19T06:20:38.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.185+0000 7f4092866740 10 client.16956 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:38.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.185+0000 7f4092866740 1 -- 172.21.15.2:0/915133754 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5568eeb743e0 con 0x5568eeaf9370 2024-09-19T06:20:38.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.185+0000 7f4071ffb640 1 -- 172.21.15.2:0/915133754 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4078009de0 con 0x5568eeaf9370 2024-09-19T06:20:38.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.186+0000 7f4071ffb640 1 -- 172.21.15.2:0/915133754 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f4080030070 con 0x5568eeaf9370 2024-09-19T06:20:38.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.186+0000 7f4092866740 10 client.16956 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:38.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.186+0000 7f4092866740 10 client.16956 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:20:38.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.186+0000 7f4092866740 20 client.16956 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:38.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.186+0000 7f4092866740 1 --2- 172.21.15.2:0/915133754 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5568eeb74710 0x5568eeb76b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:38.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.186+0000 7f4092866740 4 client.16956 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:20:38.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.186+0000 7f4092866740 1 -- 172.21.15.2:0/915133754 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5568eea5bd70 con 0x5568eeb74710 2024-09-19T06:20:38.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.186+0000 7f408e229640 1 --2- 172.21.15.2:0/915133754 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5568eeb74710 0x5568eeb76b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:38.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.186+0000 7f408e229640 1 --2- 172.21.15.2:0/915133754 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5568eeb74710 0x5568eeb76b00 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a3a1886cf583eb8b server_cookie=e74b81377ef67fee in_seq=0 out_seq=0 2024-09-19T06:20:38.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.186+0000 7f4071ffb640 10 client.16956 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:20:38.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.186+0000 7f4071ffb640 1 -- 172.21.15.2:0/915133754 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5568eea5bd70 con 0x5568eeb74710 2024-09-19T06:20:38.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.186+0000 7f4071ffb640 10 client.16956 handle_command_reply: tid=0 2024-09-19T06:20:38.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.187+0000 7f4092866740 1 client.16956 shutdown 2024-09-19T06:20:38.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.187+0000 7f4092866740 1 -- 172.21.15.2:0/915133754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568eeaf9370 msgr2=0x5568eeb72c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:38.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.187+0000 7f4092866740 1 --2- 172.21.15.2:0/915133754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568eeaf9370 0x5568eeb72c60 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f4080030b50 tx=0x7f4080030b80 comp rx=0 tx=0).stop 2024-09-19T06:20:38.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.187+0000 7f4092866740 1 -- 172.21.15.2:0/915133754 shutdown_connections 2024-09-19T06:20:38.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.187+0000 7f4092866740 1 --2- 172.21.15.2:0/915133754 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5568eeb74710 0x5568eeb76b00 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.187+0000 7f4092866740 1 --2- 172.21.15.2:0/915133754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5568eeaf9370 0x5568eeb72c60 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.187+0000 7f4092866740 1 --2- 172.21.15.2:0/915133754 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5568eeaefb40 0x5568eeafde40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.187+0000 7f4071ffb640 0 client.16956 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:20:38.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.187+0000 7f4092866740 1 --2- 172.21.15.2:0/915133754 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5568eeaee5d0 0x5568eeafd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.187+0000 7f4092866740 1 -- 172.21.15.2:0/915133754 >> 172.21.15.2:0/915133754 conn(0x5568eeab7310 msgr2=0x5568eeaf5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:38.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.187+0000 7f4092866740 1 -- 172.21.15.2:0/915133754 shutdown_connections 2024-09-19T06:20:38.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.187+0000 7f4092866740 1 -- 172.21.15.2:0/915133754 wait complete. 2024-09-19T06:20:38.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.187+0000 7f4092866740 20 client.16956 trim_cache size 0 max 16384 2024-09-19T06:20:38.196 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:20:38.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.187+0000 7f409048d640 1 -- 172.21.15.2:0/1853549775 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f40740a3430 msgr2=0x7f40740a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:38.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.187+0000 7f409048d640 1 --2- 172.21.15.2:0/1853549775 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f40740a3430 0x7f40740a58f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f408004d000 tx=0x7f408004b000 comp rx=0 tx=0).stop 2024-09-19T06:20:38.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.187+0000 7f409048d640 1 -- 172.21.15.2:0/1853549775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4088101420 msgr2=0x7f40880fd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:38.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.187+0000 7f409048d640 1 --2- 172.21.15.2:0/1853549775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4088101420 0x7f40880fd370 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f407800d950 tx=0x7f407800de10 comp rx=0 tx=0).stop 2024-09-19T06:20:38.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.187+0000 7f409048d640 1 -- 172.21.15.2:0/1853549775 shutdown_connections 2024-09-19T06:20:38.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.187+0000 7f409048d640 1 --2- 172.21.15.2:0/1853549775 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f40740a3430 0x7f40740a58f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.187+0000 7f409048d640 1 --2- 172.21.15.2:0/1853549775 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4088106a80 0x7f40880fd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.187+0000 7f409048d640 1 --2- 172.21.15.2:0/1853549775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4088101420 0x7f40880fd370 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.187+0000 7f409048d640 1 --2- 172.21.15.2:0/1853549775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4088100a80 0x7f40880fce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.187+0000 7f409048d640 1 -- 172.21.15.2:0/1853549775 >> 172.21.15.2:0/1853549775 conn(0x7f40880fc7a0 msgr2=0x7f408806aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:38.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.188+0000 7f409048d640 1 -- 172.21.15.2:0/1853549775 shutdown_connections 2024-09-19T06:20:38.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:38.188+0000 7f409048d640 1 -- 172.21.15.2:0/1853549775 wait complete. 2024-09-19T06:20:38.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:37 smithi090 ceph-mon[34497]: pgmap v177: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:20:38.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:37 smithi089 ceph-mon[34160]: pgmap v177: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:20:39.018 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:20:39.276 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:39.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.739+0000 7efceadc7640 1 -- 172.21.15.2:0/611496518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efce4102d30 msgr2=0x7efce4103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:39.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.739+0000 7efceadc7640 1 --2- 172.21.15.2:0/611496518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efce4102d30 0x7efce4103110 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7efcd4009930 tx=0x7efcd402a440 comp rx=0 tx=0).stop 2024-09-19T06:20:39.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.739+0000 7efceadc7640 1 -- 172.21.15.2:0/611496518 shutdown_connections 2024-09-19T06:20:39.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.740+0000 7efceadc7640 1 --2- 172.21.15.2:0/611496518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efce41082a0 0x7efce410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:39.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.740+0000 7efceadc7640 1 --2- 172.21.15.2:0/611496518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efce41036e0 0x7efce4107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:39.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.740+0000 7efceadc7640 1 --2- 172.21.15.2:0/611496518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efce4102d30 0x7efce4103110 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:39.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.740+0000 7efceadc7640 1 -- 172.21.15.2:0/611496518 >> 172.21.15.2:0/611496518 conn(0x7efce40fc7d0 msgr2=0x7efce40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:39.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.740+0000 7efceadc7640 1 -- 172.21.15.2:0/611496518 shutdown_connections 2024-09-19T06:20:39.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.740+0000 7efceadc7640 1 -- 172.21.15.2:0/611496518 wait complete. 2024-09-19T06:20:39.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.740+0000 7efceadc7640 1 Processor -- start 2024-09-19T06:20:39.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.740+0000 7efceadc7640 1 -- start start 2024-09-19T06:20:39.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.740+0000 7efceadc7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efce4102d30 0x7efce4198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:39.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.740+0000 7efceadc7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efce41036e0 0x7efce4198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:39.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.740+0000 7efceadc7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efce41082a0 0x7efce419cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:39.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.740+0000 7efceadc7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efce4112010 con 0x7efce4102d30 2024-09-19T06:20:39.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.740+0000 7efceadc7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7efce4111e90 con 0x7efce41036e0 2024-09-19T06:20:39.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.740+0000 7efceadc7640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efce4112190 con 0x7efce41082a0 2024-09-19T06:20:39.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.741+0000 7efce8b63640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efce4102d30 0x7efce4198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:39.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.741+0000 7efce8b63640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efce4102d30 0x7efce4198630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34122/0 (socket says 172.21.15.2:34122) 2024-09-19T06:20:39.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.741+0000 7efce8b63640 1 -- 172.21.15.2:0/3701267340 learned_addr learned my addr 172.21.15.2:0/3701267340 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:39.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.741+0000 7efce3fff640 1 --2- 172.21.15.2:0/3701267340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efce41036e0 0x7efce4198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:39.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.741+0000 7efce9364640 1 --2- 172.21.15.2:0/3701267340 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efce41082a0 0x7efce419cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:39.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.741+0000 7efce8b63640 1 -- 172.21.15.2:0/3701267340 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efce41082a0 msgr2=0x7efce419cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:39.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.741+0000 7efce8b63640 1 --2- 172.21.15.2:0/3701267340 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efce41082a0 0x7efce419cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:39.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.741+0000 7efce8b63640 1 -- 172.21.15.2:0/3701267340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efce41036e0 msgr2=0x7efce4198b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:39.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.741+0000 7efce8b63640 1 --2- 172.21.15.2:0/3701267340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efce41036e0 0x7efce4198b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:39.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.741+0000 7efce8b63640 1 -- 172.21.15.2:0/3701267340 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efce419d5e0 con 0x7efce4102d30 2024-09-19T06:20:39.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.741+0000 7efce3fff640 1 --2- 172.21.15.2:0/3701267340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efce41036e0 0x7efce4198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:39.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.741+0000 7efce9364640 1 --2- 172.21.15.2:0/3701267340 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efce41082a0 0x7efce419cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:39.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.741+0000 7efce8b63640 1 --2- 172.21.15.2:0/3701267340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efce4102d30 0x7efce4198630 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7efcd4005940 tx=0x7efcd40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:39.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.741+0000 7efce1ffb640 1 -- 172.21.15.2:0/3701267340 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd403f030 con 0x7efce4102d30 2024-09-19T06:20:39.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.741+0000 7efceadc7640 1 -- 172.21.15.2:0/3701267340 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efce419d870 con 0x7efce4102d30 2024-09-19T06:20:39.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.741+0000 7efce1ffb640 1 -- 172.21.15.2:0/3701267340 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efcd4003cb0 con 0x7efce4102d30 2024-09-19T06:20:39.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.741+0000 7efce1ffb640 1 -- 172.21.15.2:0/3701267340 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd4035070 con 0x7efce4102d30 2024-09-19T06:20:39.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.742+0000 7efceadc7640 1 -- 172.21.15.2:0/3701267340 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efce41a51b0 con 0x7efce4102d30 2024-09-19T06:20:39.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.744+0000 7efce1ffb640 1 -- 172.21.15.2:0/3701267340 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7efcd4042030 con 0x7efce4102d30 2024-09-19T06:20:39.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.744+0000 7efced1a0740 1 Processor -- start 2024-09-19T06:20:39.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.744+0000 7efced1a0740 1 -- start start 2024-09-19T06:20:39.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.744+0000 7efced1a0740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56479241db40 0x56479241c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:39.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.744+0000 7efced1a0740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56479241c5d0 0x56479241ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:39.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.744+0000 7efced1a0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56479242b780 0x56479242db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:39.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.744+0000 7efced1a0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5647923822f0 con 0x56479242b780 2024-09-19T06:20:39.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.744+0000 7efced1a0740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x564792329cf0 con 0x56479241db40 2024-09-19T06:20:39.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.744+0000 7efced1a0740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56479237e2b0 con 0x56479241c5d0 2024-09-19T06:20:39.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.744+0000 7efce3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56479242b780 0x56479242db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:39.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.745+0000 7efce3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56479242b780 0x56479242db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34128/0 (socket says 172.21.15.2:34128) 2024-09-19T06:20:39.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.745+0000 7efce3fff640 1 -- 172.21.15.2:0/3686379721 learned_addr learned my addr 172.21.15.2:0/3686379721 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:39.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.745+0000 7efce9364640 1 --2- 172.21.15.2:0/3686379721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56479241db40 0x56479241c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:39.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.745+0000 7efce8b63640 1 --2- 172.21.15.2:0/3686379721 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56479241c5d0 0x56479241ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:39.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.745+0000 7efce1ffb640 1 --2- 172.21.15.2:0/3701267340 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7efccc0a3430 0x7efccc0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:39.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.745+0000 7efce3fff640 1 -- 172.21.15.2:0/3686379721 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56479241c5d0 msgr2=0x56479241ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:39.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.745+0000 7efce3fff640 1 --2- 172.21.15.2:0/3686379721 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56479241c5d0 0x56479241ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:39.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.745+0000 7efce3fff640 1 -- 172.21.15.2:0/3686379721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56479241db40 msgr2=0x56479241c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:39.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.745+0000 7efce3fff640 1 --2- 172.21.15.2:0/3686379721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56479241db40 0x56479241c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:39.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.745+0000 7efce3fff640 1 -- 172.21.15.2:0/3686379721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56479230e3a0 con 0x56479242b780 2024-09-19T06:20:39.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.745+0000 7efce9364640 1 --2- 172.21.15.2:0/3701267340 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7efccc0a3430 0x7efccc0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:39.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.745+0000 7efce1ffb640 1 -- 172.21.15.2:0/3701267340 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7efcd40f0380 con 0x7efce4102d30 2024-09-19T06:20:39.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.745+0000 7efce3fff640 1 --2- 172.21.15.2:0/3686379721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56479242b780 0x56479242db70 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7efcd80077a0 tx=0x7efcd8007c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b73ce20d1f48c7e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:39.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.745+0000 7efccaffd640 1 -- 172.21.15.2:0/3686379721 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd800d950 con 0x56479242b780 2024-09-19T06:20:39.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.745+0000 7efccaffd640 1 -- 172.21.15.2:0/3686379721 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efcd8018070 con 0x56479242b780 2024-09-19T06:20:39.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.745+0000 7efccaffd640 1 -- 172.21.15.2:0/3686379721 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd8013e10 con 0x56479242b780 2024-09-19T06:20:39.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.746+0000 7efced1a0740 1 -- 172.21.15.2:0/3686379721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56479242b780 msgr2=0x56479242db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:39.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.746+0000 7efce9364640 1 --2- 172.21.15.2:0/3701267340 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7efccc0a3430 0x7efccc0a58f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efcdc00a5a0 tx=0x7efcdc00e040 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:39.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.746+0000 7efced1a0740 1 --2- 172.21.15.2:0/3686379721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56479242b780 0x56479242db70 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7efcd80077a0 tx=0x7efcd8007c60 comp rx=0 tx=0).stop 2024-09-19T06:20:39.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.746+0000 7efced1a0740 1 -- 172.21.15.2:0/3686379721 shutdown_connections 2024-09-19T06:20:39.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.746+0000 7efced1a0740 1 --2- 172.21.15.2:0/3686379721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56479242b780 0x56479242db70 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:39.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.746+0000 7efced1a0740 1 --2- 172.21.15.2:0/3686379721 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56479241c5d0 0x56479241ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:39.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.746+0000 7efced1a0740 1 --2- 172.21.15.2:0/3686379721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56479241db40 0x56479241c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:39.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.746+0000 7efced1a0740 1 -- 172.21.15.2:0/3686379721 >> 172.21.15.2:0/3686379721 conn(0x5647923e5310 msgr2=0x564792418c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:39.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.746+0000 7efced1a0740 1 -- 172.21.15.2:0/3686379721 shutdown_connections 2024-09-19T06:20:39.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.746+0000 7efced1a0740 1 -- 172.21.15.2:0/3686379721 wait complete. 2024-09-19T06:20:39.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.747+0000 7efced1a0740 1 -- start start 2024-09-19T06:20:39.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.747+0000 7efced1a0740 1 Processor -- start 2024-09-19T06:20:39.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.747+0000 7efced1a0740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56479241c5d0 0x56479242b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:39.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.747+0000 7efced1a0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56479241db40 0x564792428420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:39.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.747+0000 7efced1a0740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56479242b780 0x564792428a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:39.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.747+0000 7efced1a0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56479242e480 con 0x56479241db40 2024-09-19T06:20:39.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.747+0000 7efced1a0740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56479233d060 con 0x56479241c5d0 2024-09-19T06:20:39.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.747+0000 7efced1a0740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56479242e600 con 0x56479242b780 2024-09-19T06:20:39.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.747+0000 7efced1a0740 10 client.0 _ll_register_callbacks cb 0x5647920908c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:39.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.747+0000 7efce3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56479241db40 0x564792428420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:39.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.747+0000 7efce8b63640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56479241c5d0 0x56479242b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:39.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.747+0000 7efce3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56479241db40 0x564792428420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34130/0 (socket says 172.21.15.2:34130) 2024-09-19T06:20:39.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.747+0000 7efce3fff640 1 -- 172.21.15.2:0/3810922590 learned_addr learned my addr 172.21.15.2:0/3810922590 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:39.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.748+0000 7efce9364640 1 --2- 172.21.15.2:0/3810922590 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56479242b780 0x564792428a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:39.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.748+0000 7efce3fff640 1 -- 172.21.15.2:0/3810922590 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56479242b780 msgr2=0x564792428a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:39.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.748+0000 7efce3fff640 1 --2- 172.21.15.2:0/3810922590 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56479242b780 0x564792428a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:39.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.748+0000 7efce3fff640 1 -- 172.21.15.2:0/3810922590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56479241c5d0 msgr2=0x56479242b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:39.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.748+0000 7efce3fff640 1 --2- 172.21.15.2:0/3810922590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56479241c5d0 0x56479242b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:39.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.748+0000 7efce3fff640 1 -- 172.21.15.2:0/3810922590 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647920f33c0 con 0x56479241db40 2024-09-19T06:20:39.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.748+0000 7efce8b63640 1 --2- 172.21.15.2:0/3810922590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56479241c5d0 0x56479242b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:39.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.748+0000 7efce3fff640 1 --2- 172.21.15.2:0/3810922590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56479241db40 0x564792428420 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7efcd8006e10 tx=0x7efcd80136b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f601a96c76314d57 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:39.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.748+0000 7efcc3fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:39.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.748+0000 7efcc3fff640 1 -- 172.21.15.2:0/3810922590 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd800dd60 con 0x56479241db40 2024-09-19T06:20:39.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.748+0000 7efcc3fff640 1 -- 172.21.15.2:0/3810922590 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7efcd801c3f0 con 0x56479241db40 2024-09-19T06:20:39.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.748+0000 7efced1a0740 1 -- 172.21.15.2:0/3810922590 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efcd8018070 con 0x56479241db40 2024-09-19T06:20:39.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.748+0000 7efcc3fff640 1 -- 172.21.15.2:0/3810922590 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7efcd801c610 con 0x56479241db40 2024-09-19T06:20:39.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.748+0000 7efced1a0740 10 client.16968 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:39.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.748+0000 7efced1a0740 1 -- 172.21.15.2:0/3810922590 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564792439f20 con 0x56479241db40 2024-09-19T06:20:39.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.749+0000 7efcc3fff640 1 -- 172.21.15.2:0/3810922590 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efcd8018070 con 0x56479241db40 2024-09-19T06:20:39.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.749+0000 7efcc3fff640 1 -- 172.21.15.2:0/3810922590 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7efcd8024840 con 0x56479241db40 2024-09-19T06:20:39.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.749+0000 7efced1a0740 10 client.16968 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:39.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.749+0000 7efced1a0740 10 client.16968 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:39.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.749+0000 7efced1a0740 20 client.16968 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:39.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.749+0000 7efced1a0740 1 --2- 172.21.15.2:0/3810922590 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x56479243b380 0x56479243d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:39.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.749+0000 7efced1a0740 4 client.16968 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:39.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.749+0000 7efced1a0740 1 -- 172.21.15.2:0/3810922590 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56479238f860 con 0x56479243b380 2024-09-19T06:20:39.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.749+0000 7efce8b63640 1 --2- 172.21.15.2:0/3810922590 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x56479243b380 0x56479243d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:39.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.750+0000 7efcc3fff640 10 client.16968 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:39.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.750+0000 7efce8b63640 1 --2- 172.21.15.2:0/3810922590 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x56479243b380 0x56479243d770 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fb33c2061946510 server_cookie=b41aa32fb13781cf in_seq=0 out_seq=0 2024-09-19T06:20:39.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.750+0000 7efcc3fff640 1 -- 172.21.15.2:0/3810922590 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56479238f860 con 0x56479243b380 2024-09-19T06:20:39.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.750+0000 7efcc3fff640 10 client.16968 handle_command_reply: tid=0 2024-09-19T06:20:39.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.750+0000 7efced1a0740 1 client.16968 shutdown 2024-09-19T06:20:39.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.750+0000 7efced1a0740 1 -- 172.21.15.2:0/3810922590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56479241db40 msgr2=0x564792428420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:39.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.750+0000 7efced1a0740 1 --2- 172.21.15.2:0/3810922590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56479241db40 0x564792428420 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7efcd8006e10 tx=0x7efcd80136b0 comp rx=0 tx=0).stop 2024-09-19T06:20:39.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.750+0000 7efced1a0740 1 -- 172.21.15.2:0/3810922590 shutdown_connections 2024-09-19T06:20:39.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.750+0000 7efced1a0740 1 --2- 172.21.15.2:0/3810922590 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56479242b780 0x564792428a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:39.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.750+0000 7efced1a0740 1 --2- 172.21.15.2:0/3810922590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56479241db40 0x564792428420 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:39.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.750+0000 7efced1a0740 1 --2- 172.21.15.2:0/3810922590 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x56479243b380 0x56479243d770 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:39.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.751+0000 7efced1a0740 1 --2- 172.21.15.2:0/3810922590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56479241c5d0 0x56479242b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:39.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.751+0000 7efcc3fff640 0 client.16968 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:39.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.751+0000 7efced1a0740 1 -- 172.21.15.2:0/3810922590 >> 172.21.15.2:0/3810922590 conn(0x5647923e5310 msgr2=0x56479241e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:39.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.751+0000 7efced1a0740 1 -- 172.21.15.2:0/3810922590 shutdown_connections 2024-09-19T06:20:39.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.751+0000 7efced1a0740 1 -- 172.21.15.2:0/3810922590 wait complete. 2024-09-19T06:20:39.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.751+0000 7efced1a0740 20 client.16968 trim_cache size 0 max 16384 2024-09-19T06:20:39.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.764+0000 7efced1a0740 1 Processor -- start 2024-09-19T06:20:39.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.764+0000 7efced1a0740 1 -- start start 2024-09-19T06:20:39.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.764+0000 7efced1a0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56479241c5d0 0x56479242db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:39.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.764+0000 7efced1a0740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56479241db40 0x564792437720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:39.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.764+0000 7efced1a0740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56479242b780 0x564792418700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:39.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.764+0000 7efced1a0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efce41adf40 con 0x56479241c5d0 2024-09-19T06:20:39.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.764+0000 7efced1a0740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7efce41ab810 con 0x56479242b780 2024-09-19T06:20:39.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.764+0000 7efced1a0740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efce41a9660 con 0x56479241db40 2024-09-19T06:20:39.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.764+0000 7efce8b63640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56479241c5d0 0x56479242db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:39.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.764+0000 7efce8b63640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56479241c5d0 0x56479242db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34140/0 (socket says 172.21.15.2:34140) 2024-09-19T06:20:39.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.764+0000 7efce8b63640 1 -- 172.21.15.2:0/3124286395 learned_addr learned my addr 172.21.15.2:0/3124286395 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:39.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.764+0000 7efce8b63640 1 -- 172.21.15.2:0/3124286395 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56479241db40 msgr2=0x564792437720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:39.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.764+0000 7efce8b63640 1 --2- 172.21.15.2:0/3124286395 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56479241db40 0x564792437720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:39.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.764+0000 7efce8b63640 1 -- 172.21.15.2:0/3124286395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56479242b780 msgr2=0x564792418700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:39.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.764+0000 7efce8b63640 1 --2- 172.21.15.2:0/3124286395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56479242b780 0x564792418700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:39.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.764+0000 7efce8b63640 1 -- 172.21.15.2:0/3124286395 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564792428d80 con 0x56479241c5d0 2024-09-19T06:20:39.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.765+0000 7efce8b63640 1 --2- 172.21.15.2:0/3124286395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56479241c5d0 0x56479242db70 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7efcd40b8a90 tx=0x7efcd402a440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70f1fb8179a7b408 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:39.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.765+0000 7efcca7fc640 1 -- 172.21.15.2:0/3124286395 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd4049040 con 0x56479241c5d0 2024-09-19T06:20:39.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.765+0000 7efcca7fc640 1 -- 172.21.15.2:0/3124286395 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efcd40bcd30 con 0x56479241c5d0 2024-09-19T06:20:39.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.765+0000 7efcca7fc640 1 -- 172.21.15.2:0/3124286395 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd40edd20 con 0x56479241c5d0 2024-09-19T06:20:39.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.765+0000 7efced1a0740 1 -- 172.21.15.2:0/3124286395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56479241c5d0 msgr2=0x56479242db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:39.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.765+0000 7efced1a0740 1 --2- 172.21.15.2:0/3124286395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56479241c5d0 0x56479242db70 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7efcd40b8a90 tx=0x7efcd402a440 comp rx=0 tx=0).stop 2024-09-19T06:20:39.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.765+0000 7efced1a0740 1 -- 172.21.15.2:0/3124286395 shutdown_connections 2024-09-19T06:20:39.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.765+0000 7efced1a0740 1 --2- 172.21.15.2:0/3124286395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56479242b780 0x564792418700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:39.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.765+0000 7efced1a0740 1 --2- 172.21.15.2:0/3124286395 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56479241db40 0x564792437720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:39.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.765+0000 7efced1a0740 1 --2- 172.21.15.2:0/3124286395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56479241c5d0 0x56479242db70 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:39.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.765+0000 7efced1a0740 1 -- 172.21.15.2:0/3124286395 >> 172.21.15.2:0/3124286395 conn(0x5647923e5310 msgr2=0x564792413a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:39.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.766+0000 7efced1a0740 1 -- 172.21.15.2:0/3124286395 shutdown_connections 2024-09-19T06:20:39.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.766+0000 7efced1a0740 1 -- 172.21.15.2:0/3124286395 wait complete. 2024-09-19T06:20:39.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.766+0000 7efced1a0740 1 -- start start 2024-09-19T06:20:39.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.766+0000 7efced1a0740 1 Processor -- start 2024-09-19T06:20:39.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.766+0000 7efced1a0740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56479241c5d0 0x564792433c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:39.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.766+0000 7efced1a0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56479241db40 0x564792434180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:39.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.766+0000 7efced1a0740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56479242b780 0x564792425050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:39.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.766+0000 7efced1a0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efce41a9cd0 con 0x56479241db40 2024-09-19T06:20:39.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.766+0000 7efced1a0740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7efce41ab140 con 0x56479241c5d0 2024-09-19T06:20:39.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.766+0000 7efced1a0740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efce41aa3a0 con 0x56479242b780 2024-09-19T06:20:39.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.766+0000 7efced1a0740 10 client.0 _ll_register_callbacks cb 0x7efcdc0096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:39.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.766+0000 7efce3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56479241db40 0x564792434180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:39.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.766+0000 7efce3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56479241db40 0x564792434180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34144/0 (socket says 172.21.15.2:34144) 2024-09-19T06:20:39.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.766+0000 7efce3fff640 1 -- 172.21.15.2:0/1266804725 learned_addr learned my addr 172.21.15.2:0/1266804725 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:39.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.767+0000 7efce8b63640 1 --2- 172.21.15.2:0/1266804725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56479241c5d0 0x564792433c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:39.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.767+0000 7efce9364640 1 --2- 172.21.15.2:0/1266804725 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56479242b780 0x564792425050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:39.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.767+0000 7efce3fff640 1 -- 172.21.15.2:0/1266804725 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56479242b780 msgr2=0x564792425050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:39.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.767+0000 7efce3fff640 1 --2- 172.21.15.2:0/1266804725 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56479242b780 0x564792425050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:39.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.767+0000 7efce3fff640 1 -- 172.21.15.2:0/1266804725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56479241c5d0 msgr2=0x564792433c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:39.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.767+0000 7efce3fff640 1 --2- 172.21.15.2:0/1266804725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56479241c5d0 0x564792433c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:39.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.767+0000 7efce3fff640 1 -- 172.21.15.2:0/1266804725 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564792425880 con 0x56479241db40 2024-09-19T06:20:39.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.767+0000 7efce8b63640 1 --2- 172.21.15.2:0/1266804725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56479241c5d0 0x564792433c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:39.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.767+0000 7efce3fff640 1 --2- 172.21.15.2:0/1266804725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56479241db40 0x564792434180 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7efcd8013a20 tx=0x7efcd8001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4220feadffddf2ba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:39.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.767+0000 7efcc3fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:39.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.767+0000 7efcc3fff640 1 -- 172.21.15.2:0/1266804725 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd8031070 con 0x56479241db40 2024-09-19T06:20:39.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.767+0000 7efcc3fff640 1 -- 172.21.15.2:0/1266804725 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7efcd800db60 con 0x56479241db40 2024-09-19T06:20:39.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.767+0000 7efced1a0740 1 -- 172.21.15.2:0/1266804725 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efcd40bcd30 con 0x56479241db40 2024-09-19T06:20:39.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.767+0000 7efcc3fff640 1 -- 172.21.15.2:0/1266804725 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7efcd80072a0 con 0x56479241db40 2024-09-19T06:20:39.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.767+0000 7efced1a0740 10 client.16974 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:39.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.767+0000 7efced1a0740 1 -- 172.21.15.2:0/1266804725 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5647924a5a90 con 0x56479241db40 2024-09-19T06:20:39.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.768+0000 7efcc3fff640 1 -- 172.21.15.2:0/1266804725 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efcd40bcd30 con 0x56479241db40 2024-09-19T06:20:39.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.768+0000 7efcc3fff640 1 -- 172.21.15.2:0/1266804725 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7efcd801c9e0 con 0x56479241db40 2024-09-19T06:20:39.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.768+0000 7efced1a0740 10 client.16974 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:39.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.768+0000 7efced1a0740 10 client.16974 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:39.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.768+0000 7efced1a0740 20 client.16974 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:39.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.768+0000 7efced1a0740 1 --2- 172.21.15.2:0/1266804725 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5647924a6180 0x5647924a85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:39.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.768+0000 7efced1a0740 4 client.16974 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:20:39.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.768+0000 7efced1a0740 1 -- 172.21.15.2:0/1266804725 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564792389d70 con 0x5647924a6180 2024-09-19T06:20:39.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.768+0000 7efce8b63640 1 --2- 172.21.15.2:0/1266804725 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5647924a6180 0x5647924a85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:39.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.769+0000 7efce8b63640 1 --2- 172.21.15.2:0/1266804725 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5647924a6180 0x5647924a85a0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=461d81335da5c042 server_cookie=827db2c20ad14379 in_seq=0 out_seq=0 2024-09-19T06:20:39.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.769+0000 7efcc3fff640 10 client.16974 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:39.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.769+0000 7efcc3fff640 1 -- 172.21.15.2:0/1266804725 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564792389d70 con 0x5647924a6180 2024-09-19T06:20:39.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.769+0000 7efcc3fff640 10 client.16974 handle_command_reply: tid=0 2024-09-19T06:20:39.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.769+0000 7efced1a0740 1 client.16974 shutdown 2024-09-19T06:20:39.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.769+0000 7efced1a0740 1 -- 172.21.15.2:0/1266804725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56479241db40 msgr2=0x564792434180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:39.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.769+0000 7efced1a0740 1 --2- 172.21.15.2:0/1266804725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56479241db40 0x564792434180 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7efcd8013a20 tx=0x7efcd8001e70 comp rx=0 tx=0).stop 2024-09-19T06:20:39.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.769+0000 7efced1a0740 1 -- 172.21.15.2:0/1266804725 shutdown_connections 2024-09-19T06:20:39.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.769+0000 7efced1a0740 1 --2- 172.21.15.2:0/1266804725 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56479242b780 0x564792425050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:39.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.769+0000 7efced1a0740 1 --2- 172.21.15.2:0/1266804725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56479241db40 0x564792434180 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:39.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.769+0000 7efced1a0740 1 --2- 172.21.15.2:0/1266804725 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5647924a6180 0x5647924a85a0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:39.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.769+0000 7efced1a0740 1 --2- 172.21.15.2:0/1266804725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56479241c5d0 0x564792433c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:39.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.769+0000 7efcc3fff640 0 client.16974 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:39.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.769+0000 7efced1a0740 1 -- 172.21.15.2:0/1266804725 >> 172.21.15.2:0/1266804725 conn(0x5647923e5310 msgr2=0x564792418700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:39.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.769+0000 7efced1a0740 1 -- 172.21.15.2:0/1266804725 shutdown_connections 2024-09-19T06:20:39.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.769+0000 7efced1a0740 1 -- 172.21.15.2:0/1266804725 wait complete. 2024-09-19T06:20:39.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.769+0000 7efced1a0740 20 client.16974 trim_cache size 0 max 16384 2024-09-19T06:20:39.777 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:20:39.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.770+0000 7efceadc7640 1 -- 172.21.15.2:0/3701267340 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7efccc0a3430 msgr2=0x7efccc0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:39.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.770+0000 7efceadc7640 1 --2- 172.21.15.2:0/3701267340 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7efccc0a3430 0x7efccc0a58f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efcdc00a5a0 tx=0x7efcdc00e040 comp rx=0 tx=0).stop 2024-09-19T06:20:39.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.770+0000 7efceadc7640 1 -- 172.21.15.2:0/3701267340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efce4102d30 msgr2=0x7efce4198630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:39.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.770+0000 7efceadc7640 1 --2- 172.21.15.2:0/3701267340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efce4102d30 0x7efce4198630 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7efcd4005940 tx=0x7efcd40042f0 comp rx=0 tx=0).stop 2024-09-19T06:20:39.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.770+0000 7efceadc7640 1 -- 172.21.15.2:0/3701267340 shutdown_connections 2024-09-19T06:20:39.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.770+0000 7efceadc7640 1 --2- 172.21.15.2:0/3701267340 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7efccc0a3430 0x7efccc0a58f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:39.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.770+0000 7efceadc7640 1 --2- 172.21.15.2:0/3701267340 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efce41082a0 0x7efce419cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:39.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.770+0000 7efceadc7640 1 --2- 172.21.15.2:0/3701267340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efce41036e0 0x7efce4198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:39.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.770+0000 7efceadc7640 1 --2- 172.21.15.2:0/3701267340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efce4102d30 0x7efce4198630 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:39.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.770+0000 7efceadc7640 1 -- 172.21.15.2:0/3701267340 >> 172.21.15.2:0/3701267340 conn(0x7efce40fc7d0 msgr2=0x7efce4105e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:39.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.770+0000 7efceadc7640 1 -- 172.21.15.2:0/3701267340 shutdown_connections 2024-09-19T06:20:39.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:39.770+0000 7efceadc7640 1 -- 172.21.15.2:0/3701267340 wait complete. 2024-09-19T06:20:40.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:39 smithi002 ceph-mon[30982]: pgmap v178: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:20:40.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:39 smithi090 ceph-mon[34497]: pgmap v178: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:20:40.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:39 smithi089 ceph-mon[34160]: pgmap v178: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:20:41.543 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:20:41.544 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:20:41.814 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:42.190 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:41 smithi002 ceph-mon[30982]: pgmap v179: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:20:42.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:41 smithi090 ceph-mon[34497]: pgmap v179: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:20:42.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:41 smithi089 ceph-mon[34160]: pgmap v179: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:20:42.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.275+0000 7f103e1f0640 1 -- 172.21.15.2:0/3936691482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1038102d30 msgr2=0x7f1038103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:42.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.275+0000 7f103e1f0640 1 --2- 172.21.15.2:0/3936691482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1038102d30 0x7f1038103110 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f1028009930 tx=0x7f102802a420 comp rx=0 tx=0).stop 2024-09-19T06:20:42.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.276+0000 7f103e1f0640 1 -- 172.21.15.2:0/3936691482 shutdown_connections 2024-09-19T06:20:42.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.276+0000 7f103e1f0640 1 --2- 172.21.15.2:0/3936691482 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f10381082a0 0x7f103810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.276+0000 7f103e1f0640 1 --2- 172.21.15.2:0/3936691482 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10381036e0 0x7f1038107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.276+0000 7f103e1f0640 1 --2- 172.21.15.2:0/3936691482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1038102d30 0x7f1038103110 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.276+0000 7f103e1f0640 1 -- 172.21.15.2:0/3936691482 >> 172.21.15.2:0/3936691482 conn(0x7f10380fc7d0 msgr2=0x7f10380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:42.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.276+0000 7f103e1f0640 1 -- 172.21.15.2:0/3936691482 shutdown_connections 2024-09-19T06:20:42.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.276+0000 7f103e1f0640 1 -- 172.21.15.2:0/3936691482 wait complete. 2024-09-19T06:20:42.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.276+0000 7f103e1f0640 1 Processor -- start 2024-09-19T06:20:42.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.276+0000 7f103e1f0640 1 -- start start 2024-09-19T06:20:42.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.277+0000 7f103e1f0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1038102d30 0x7f1038198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:42.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.277+0000 7f103e1f0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10381036e0 0x7f1038198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:42.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.277+0000 7f103e1f0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10381082a0 0x7f103819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:42.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.277+0000 7f103e1f0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1038111f50 con 0x7f10381082a0 2024-09-19T06:20:42.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.277+0000 7f103e1f0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f1038111dd0 con 0x7f10381036e0 2024-09-19T06:20:42.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.277+0000 7f103e1f0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f10381120d0 con 0x7f1038102d30 2024-09-19T06:20:42.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.277+0000 7f1037fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10381082a0 0x7f103819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:42.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.277+0000 7f1037fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10381082a0 0x7f103819cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34148/0 (socket says 172.21.15.2:34148) 2024-09-19T06:20:42.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.277+0000 7f1037fff640 1 -- 172.21.15.2:0/3327241786 learned_addr learned my addr 172.21.15.2:0/3327241786 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:42.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.277+0000 7f10377fe640 1 --2- 172.21.15.2:0/3327241786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1038102d30 0x7f1038198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:42.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.277+0000 7f102effd640 1 --2- 172.21.15.2:0/3327241786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10381036e0 0x7f1038198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:42.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.277+0000 7f1037fff640 1 -- 172.21.15.2:0/3327241786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1038102d30 msgr2=0x7f1038198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:42.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.277+0000 7f1037fff640 1 --2- 172.21.15.2:0/3327241786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1038102d30 0x7f1038198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.277+0000 7f1037fff640 1 -- 172.21.15.2:0/3327241786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10381036e0 msgr2=0x7f1038198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:42.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.277+0000 7f1037fff640 1 --2- 172.21.15.2:0/3327241786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10381036e0 0x7f1038198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.277+0000 7f1037fff640 1 -- 172.21.15.2:0/3327241786 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f103819d400 con 0x7f10381082a0 2024-09-19T06:20:42.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.277+0000 7f102effd640 1 --2- 172.21.15.2:0/3327241786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10381036e0 0x7f1038198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:42.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.277+0000 7f1037fff640 1 --2- 172.21.15.2:0/3327241786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10381082a0 0x7f103819cd20 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f103000cce0 tx=0x7f103000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:42.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.277+0000 7f10357fa640 1 -- 172.21.15.2:0/3327241786 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103000f450 con 0x7f10381082a0 2024-09-19T06:20:42.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.278+0000 7f10357fa640 1 -- 172.21.15.2:0/3327241786 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f103000faa0 con 0x7f10381082a0 2024-09-19T06:20:42.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.278+0000 7f103e1f0640 1 -- 172.21.15.2:0/3327241786 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f103819d6f0 con 0x7f10381082a0 2024-09-19T06:20:42.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.278+0000 7f10357fa640 1 -- 172.21.15.2:0/3327241786 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1030018b70 con 0x7f10381082a0 2024-09-19T06:20:42.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.278+0000 7f103e1f0640 1 -- 172.21.15.2:0/3327241786 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10381a4fd0 con 0x7f10381082a0 2024-09-19T06:20:42.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.280+0000 7f10357fa640 1 -- 172.21.15.2:0/3327241786 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f1030018d10 con 0x7f10381082a0 2024-09-19T06:20:42.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.280+0000 7f10405c9740 1 Processor -- start 2024-09-19T06:20:42.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.280+0000 7f10405c9740 1 -- start start 2024-09-19T06:20:42.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.280+0000 7f10405c9740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5602015d8b60 0x5602015d8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:42.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.280+0000 7f10405c9740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602015d9480 0x5602015e3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:42.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.281+0000 7f10405c9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5602015e3d40 0x5602015e6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:42.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.281+0000 7f10405c9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56020153e280 con 0x5602015e3d40 2024-09-19T06:20:42.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.281+0000 7f10405c9740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5602014e5b10 con 0x5602015d9480 2024-09-19T06:20:42.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.281+0000 7f10405c9740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56020153a240 con 0x5602015d8b60 2024-09-19T06:20:42.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.281+0000 7f102effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5602015e3d40 0x5602015e6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:42.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.281+0000 7f102effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5602015e3d40 0x5602015e6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34158/0 (socket says 172.21.15.2:34158) 2024-09-19T06:20:42.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.281+0000 7f102effd640 1 -- 172.21.15.2:0/2875222576 learned_addr learned my addr 172.21.15.2:0/2875222576 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:42.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.281+0000 7f10357fa640 1 --2- 172.21.15.2:0/3327241786 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f10240a3430 0x7f10240a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:42.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.281+0000 7f10377fe640 1 --2- 172.21.15.2:0/2875222576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602015d9480 0x5602015e3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:42.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.281+0000 7f102effd640 1 --2- 172.21.15.2:0/2875222576 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5602015d8b60 0x5602015d8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:42.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.281+0000 7f1037fff640 1 --2- 172.21.15.2:0/3327241786 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f10240a3430 0x7f10240a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:42.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.281+0000 7f10357fa640 1 -- 172.21.15.2:0/3327241786 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f10300d0040 con 0x7f10381082a0 2024-09-19T06:20:42.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.281+0000 7f10377fe640 1 -- 172.21.15.2:0/2875222576 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5602015d8b60 msgr2=0x5602015d8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:42.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.281+0000 7f10377fe640 1 --2- 172.21.15.2:0/2875222576 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5602015d8b60 0x5602015d8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.281+0000 7f10377fe640 1 -- 172.21.15.2:0/2875222576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5602015e3d40 msgr2=0x5602015e6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:42.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.281+0000 7f10377fe640 1 --2- 172.21.15.2:0/2875222576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5602015e3d40 0x5602015e6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.281+0000 7f10377fe640 1 -- 172.21.15.2:0/2875222576 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602014f21f0 con 0x5602015d9480 2024-09-19T06:20:42.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.281+0000 7f10377fe640 1 --2- 172.21.15.2:0/2875222576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602015d9480 0x5602015e3800 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1028031440 tx=0x7f1028005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb6f22798cc7f7aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:42.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.281+0000 7f1037fff640 1 --2- 172.21.15.2:0/3327241786 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f10240a3430 0x7f10240a58f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f10300cd870 tx=0x7f103000af30 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:42.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.282+0000 7f102dffb640 1 -- 172.21.15.2:0/2875222576 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1028040070 con 0x5602015d9480 2024-09-19T06:20:42.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.282+0000 7f102dffb640 1 -- 172.21.15.2:0/2875222576 <== mon.2 v2:172.21.15.89:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f10280316a0 con 0x5602015d9480 2024-09-19T06:20:42.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.282+0000 7f102dffb640 1 -- 172.21.15.2:0/2875222576 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1028035040 con 0x5602015d9480 2024-09-19T06:20:42.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.282+0000 7f10405c9740 1 -- 172.21.15.2:0/2875222576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602015d9480 msgr2=0x5602015e3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:42.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.282+0000 7f10405c9740 1 --2- 172.21.15.2:0/2875222576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602015d9480 0x5602015e3800 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1028031440 tx=0x7f1028005fd0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.282+0000 7f10405c9740 1 -- 172.21.15.2:0/2875222576 shutdown_connections 2024-09-19T06:20:42.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.282+0000 7f10405c9740 1 --2- 172.21.15.2:0/2875222576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5602015e3d40 0x5602015e6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.282+0000 7f10405c9740 1 --2- 172.21.15.2:0/2875222576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602015d9480 0x5602015e3800 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.282+0000 7f10405c9740 1 --2- 172.21.15.2:0/2875222576 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5602015d8b60 0x5602015d8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.282+0000 7f10405c9740 1 -- 172.21.15.2:0/2875222576 >> 172.21.15.2:0/2875222576 conn(0x5602015d50f0 msgr2=0x5602015d54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:42.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.282+0000 7f10405c9740 1 -- 172.21.15.2:0/2875222576 shutdown_connections 2024-09-19T06:20:42.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.282+0000 7f10405c9740 1 -- 172.21.15.2:0/2875222576 wait complete. 2024-09-19T06:20:42.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.283+0000 7f10405c9740 1 -- start start 2024-09-19T06:20:42.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.283+0000 7f10405c9740 1 Processor -- start 2024-09-19T06:20:42.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.283+0000 7f10405c9740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602015d8b60 0x5602015e0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:42.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.283+0000 7f10405c9740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5602015d9480 0x5602015e11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:42.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.283+0000 7f10405c9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5602015e3d40 0x5602015e16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:42.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.283+0000 7f10405c9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5602015e6910 con 0x5602015e3d40 2024-09-19T06:20:42.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.283+0000 7f10405c9740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5602014f8f10 con 0x5602015d8b60 2024-09-19T06:20:42.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.283+0000 7f10405c9740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5602015e6a90 con 0x5602015d9480 2024-09-19T06:20:42.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.283+0000 7f10405c9740 10 client.0 _ll_register_callbacks cb 0x5602014c1a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:42.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.283+0000 7f102effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5602015e3d40 0x5602015e16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:42.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.283+0000 7f102effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5602015e3d40 0x5602015e16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34164/0 (socket says 172.21.15.2:34164) 2024-09-19T06:20:42.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.283+0000 7f102effd640 1 -- 172.21.15.2:0/3503997867 learned_addr learned my addr 172.21.15.2:0/3503997867 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:42.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.283+0000 7f10377fe640 1 --2- 172.21.15.2:0/3503997867 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5602015d9480 0x5602015e11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:42.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.283+0000 7f102effd640 1 --2- 172.21.15.2:0/3503997867 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602015d8b60 0x5602015e0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:42.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.284+0000 7f102effd640 1 -- 172.21.15.2:0/3503997867 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5602015d9480 msgr2=0x5602015e11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:42.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.284+0000 7f102effd640 1 --2- 172.21.15.2:0/3503997867 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5602015d9480 0x5602015e11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.284+0000 7f102effd640 1 -- 172.21.15.2:0/3503997867 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602015d8b60 msgr2=0x5602015e0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:42.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.284+0000 7f102effd640 1 --2- 172.21.15.2:0/3503997867 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602015d8b60 0x5602015e0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.284+0000 7f102effd640 1 -- 172.21.15.2:0/3503997867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602012af6a0 con 0x5602015e3d40 2024-09-19T06:20:42.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.284+0000 7f102effd640 1 --2- 172.21.15.2:0/3503997867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5602015e3d40 0x5602015e16e0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f1020014bd0 tx=0x7f102000b3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7691f1c8f4eb80f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:42.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.284+0000 7f1016ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:42.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.284+0000 7f1016ffd640 1 -- 172.21.15.2:0/3503997867 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1020004230 con 0x5602015e3d40 2024-09-19T06:20:42.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.284+0000 7f1016ffd640 1 -- 172.21.15.2:0/3503997867 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f10200043d0 con 0x5602015e3d40 2024-09-19T06:20:42.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.284+0000 7f10405c9740 1 -- 172.21.15.2:0/3503997867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10280316a0 con 0x5602015e3d40 2024-09-19T06:20:42.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.284+0000 7f1016ffd640 1 -- 172.21.15.2:0/3503997867 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1020005020 con 0x5602015e3d40 2024-09-19T06:20:42.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.284+0000 7f10405c9740 10 client.16986 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:42.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.284+0000 7f10405c9740 1 -- 172.21.15.2:0/3503997867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5602015f2550 con 0x5602015e3d40 2024-09-19T06:20:42.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.284+0000 7f1016ffd640 1 -- 172.21.15.2:0/3503997867 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f10280316a0 con 0x5602015e3d40 2024-09-19T06:20:42.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.285+0000 7f1016ffd640 1 -- 172.21.15.2:0/3503997867 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f1020004c00 con 0x5602015e3d40 2024-09-19T06:20:42.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.285+0000 7f10405c9740 10 client.16986 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:42.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.285+0000 7f10405c9740 10 client.16986 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:42.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.285+0000 7f10405c9740 20 client.16986 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:42.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.285+0000 7f10405c9740 1 --2- 172.21.15.2:0/3503997867 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5602015f3960 0x5602015f5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:42.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.285+0000 7f10405c9740 4 client.16986 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:42.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.285+0000 7f10405c9740 1 -- 172.21.15.2:0/3503997867 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56020154b7f0 con 0x5602015f3960 2024-09-19T06:20:42.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.285+0000 7f10377fe640 1 --2- 172.21.15.2:0/3503997867 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5602015f3960 0x5602015f5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:42.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.285+0000 7f1016ffd640 10 client.16986 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:42.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.285+0000 7f10377fe640 1 --2- 172.21.15.2:0/3503997867 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5602015f3960 0x5602015f5d50 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a56dd1cb0422e77 server_cookie=ce714163a1363582 in_seq=0 out_seq=0 2024-09-19T06:20:42.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.286+0000 7f1016ffd640 1 -- 172.21.15.2:0/3503997867 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56020154b7f0 con 0x5602015f3960 2024-09-19T06:20:42.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.286+0000 7f1016ffd640 10 client.16986 handle_command_reply: tid=0 2024-09-19T06:20:42.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.286+0000 7f10405c9740 1 client.16986 shutdown 2024-09-19T06:20:42.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.286+0000 7f10405c9740 1 -- 172.21.15.2:0/3503997867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5602015e3d40 msgr2=0x5602015e16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:42.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.286+0000 7f10405c9740 1 --2- 172.21.15.2:0/3503997867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5602015e3d40 0x5602015e16e0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f1020014bd0 tx=0x7f102000b3c0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.286+0000 7f10405c9740 1 -- 172.21.15.2:0/3503997867 shutdown_connections 2024-09-19T06:20:42.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.286+0000 7f10405c9740 1 --2- 172.21.15.2:0/3503997867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5602015e3d40 0x5602015e16e0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.286+0000 7f10405c9740 1 --2- 172.21.15.2:0/3503997867 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5602015d9480 0x5602015e11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.286+0000 7f10405c9740 1 --2- 172.21.15.2:0/3503997867 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5602015f3960 0x5602015f5d50 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.286+0000 7f10405c9740 1 --2- 172.21.15.2:0/3503997867 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602015d8b60 0x5602015e0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.286+0000 7f1016ffd640 0 client.16986 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:42.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.286+0000 7f10405c9740 1 -- 172.21.15.2:0/3503997867 >> 172.21.15.2:0/3503997867 conn(0x5602015d50f0 msgr2=0x5602015d4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:42.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.286+0000 7f10405c9740 1 -- 172.21.15.2:0/3503997867 shutdown_connections 2024-09-19T06:20:42.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.286+0000 7f10405c9740 1 -- 172.21.15.2:0/3503997867 wait complete. 2024-09-19T06:20:42.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.287+0000 7f10405c9740 20 client.16986 trim_cache size 0 max 16384 2024-09-19T06:20:42.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.304+0000 7f10405c9740 1 Processor -- start 2024-09-19T06:20:42.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.304+0000 7f10405c9740 1 -- start start 2024-09-19T06:20:42.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.304+0000 7f10405c9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5602015d8b60 0x5602015db5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:42.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.304+0000 7f10405c9740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602015d9480 0x5602015fb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:42.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.304+0000 7f10405c9740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5602015e3d40 0x5602015fbb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:42.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.304+0000 7f10405c9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f10381aff10 con 0x5602015d8b60 2024-09-19T06:20:42.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.304+0000 7f10405c9740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f10381ad7e0 con 0x5602015d9480 2024-09-19T06:20:42.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.304+0000 7f10405c9740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f10381ab630 con 0x5602015e3d40 2024-09-19T06:20:42.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.304+0000 7f102effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5602015d8b60 0x5602015db5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:42.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.304+0000 7f102effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5602015d8b60 0x5602015db5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34180/0 (socket says 172.21.15.2:34180) 2024-09-19T06:20:42.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.304+0000 7f102effd640 1 -- 172.21.15.2:0/473308851 learned_addr learned my addr 172.21.15.2:0/473308851 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:42.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.305+0000 7f10377fe640 1 --2- 172.21.15.2:0/473308851 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602015d9480 0x5602015fb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:42.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.305+0000 7f102effd640 1 -- 172.21.15.2:0/473308851 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5602015e3d40 msgr2=0x5602015fbb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:42.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.305+0000 7f102effd640 1 --2- 172.21.15.2:0/473308851 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5602015e3d40 0x5602015fbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.305+0000 7f102effd640 1 -- 172.21.15.2:0/473308851 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602015d9480 msgr2=0x5602015fb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:42.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.305+0000 7f102effd640 1 --2- 172.21.15.2:0/473308851 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602015d9480 0x5602015fb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.305+0000 7f102effd640 1 -- 172.21.15.2:0/473308851 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602015d92b0 con 0x5602015d8b60 2024-09-19T06:20:42.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.305+0000 7f102effd640 1 --2- 172.21.15.2:0/473308851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5602015d8b60 0x5602015db5c0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f102000c010 tx=0x7f102000b540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0a7785c4302e2a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:42.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.305+0000 7f102d7fa640 1 -- 172.21.15.2:0/473308851 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102002f070 con 0x5602015d8b60 2024-09-19T06:20:42.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.305+0000 7f102d7fa640 1 -- 172.21.15.2:0/473308851 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f10200037b0 con 0x5602015d8b60 2024-09-19T06:20:42.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.305+0000 7f102d7fa640 1 -- 172.21.15.2:0/473308851 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102002ab00 con 0x5602015d8b60 2024-09-19T06:20:42.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.306+0000 7f10405c9740 1 -- 172.21.15.2:0/473308851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5602015d8b60 msgr2=0x5602015db5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:42.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.306+0000 7f10405c9740 1 --2- 172.21.15.2:0/473308851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5602015d8b60 0x5602015db5c0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f102000c010 tx=0x7f102000b540 comp rx=0 tx=0).stop 2024-09-19T06:20:42.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.306+0000 7f10405c9740 1 -- 172.21.15.2:0/473308851 shutdown_connections 2024-09-19T06:20:42.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.306+0000 7f10405c9740 1 --2- 172.21.15.2:0/473308851 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5602015e3d40 0x5602015fbb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.306+0000 7f10405c9740 1 --2- 172.21.15.2:0/473308851 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602015d9480 0x5602015fb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.306+0000 7f10405c9740 1 --2- 172.21.15.2:0/473308851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5602015d8b60 0x5602015db5c0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.306+0000 7f10405c9740 1 -- 172.21.15.2:0/473308851 >> 172.21.15.2:0/473308851 conn(0x5602015d50f0 msgr2=0x5602015e2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:42.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.306+0000 7f10405c9740 1 -- 172.21.15.2:0/473308851 shutdown_connections 2024-09-19T06:20:42.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.306+0000 7f10405c9740 1 -- 172.21.15.2:0/473308851 wait complete. 2024-09-19T06:20:42.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.306+0000 7f10405c9740 1 -- start start 2024-09-19T06:20:42.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.307+0000 7f10405c9740 1 Processor -- start 2024-09-19T06:20:42.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.307+0000 7f10405c9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5602015d8b60 0x5602015ebec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:42.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.307+0000 7f10405c9740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602015d9480 0x5602015ec400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:42.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.307+0000 7f10405c9740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5602015e3d40 0x5602015e8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:42.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.307+0000 7f10405c9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f10381abca0 con 0x5602015d8b60 2024-09-19T06:20:42.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.307+0000 7f10405c9740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f10381ad110 con 0x5602015d9480 2024-09-19T06:20:42.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.307+0000 7f10405c9740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f10381ac370 con 0x5602015e3d40 2024-09-19T06:20:42.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.307+0000 7f10405c9740 10 client.0 _ll_register_callbacks cb 0x7f1020014050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:42.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.307+0000 7f102effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5602015d8b60 0x5602015ebec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:42.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.307+0000 7f102effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5602015d8b60 0x5602015ebec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34196/0 (socket says 172.21.15.2:34196) 2024-09-19T06:20:42.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.307+0000 7f102effd640 1 -- 172.21.15.2:0/2366549865 learned_addr learned my addr 172.21.15.2:0/2366549865 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:42.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.307+0000 7f10377fe640 1 --2- 172.21.15.2:0/2366549865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602015d9480 0x5602015ec400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:42.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.307+0000 7f102effd640 1 -- 172.21.15.2:0/2366549865 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5602015e3d40 msgr2=0x5602015e8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:42.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.307+0000 7f102effd640 1 --2- 172.21.15.2:0/2366549865 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5602015e3d40 0x5602015e8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.307+0000 7f102effd640 1 -- 172.21.15.2:0/2366549865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602015d9480 msgr2=0x5602015ec400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:42.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.307+0000 7f102effd640 1 --2- 172.21.15.2:0/2366549865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602015d9480 0x5602015ec400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.307+0000 7f102effd640 1 -- 172.21.15.2:0/2366549865 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602015f60c0 con 0x5602015d8b60 2024-09-19T06:20:42.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.307+0000 7f102effd640 1 --2- 172.21.15.2:0/2366549865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5602015d8b60 0x5602015ebec0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f10200036b0 tx=0x7f10200141d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aa3f284d87fef7d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:42.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.307+0000 7f1016ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:42.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.308+0000 7f1016ffd640 1 -- 172.21.15.2:0/2366549865 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102003a070 con 0x5602015d8b60 2024-09-19T06:20:42.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.308+0000 7f1016ffd640 1 -- 172.21.15.2:0/2366549865 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f10200051c0 con 0x5602015d8b60 2024-09-19T06:20:42.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.308+0000 7f10405c9740 1 -- 172.21.15.2:0/2366549865 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10200037b0 con 0x5602015d8b60 2024-09-19T06:20:42.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.308+0000 7f1016ffd640 1 -- 172.21.15.2:0/2366549865 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1020043050 con 0x5602015d8b60 2024-09-19T06:20:42.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.308+0000 7f10405c9740 10 client.16992 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:42.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.308+0000 7f10405c9740 1 -- 172.21.15.2:0/2366549865 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5602016632d0 con 0x5602015d8b60 2024-09-19T06:20:42.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.308+0000 7f1016ffd640 1 -- 172.21.15.2:0/2366549865 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f10200037b0 con 0x5602015d8b60 2024-09-19T06:20:42.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.308+0000 7f1016ffd640 1 -- 172.21.15.2:0/2366549865 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f102003d020 con 0x5602015d8b60 2024-09-19T06:20:42.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.308+0000 7f10405c9740 10 client.16992 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:42.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.308+0000 7f10405c9740 10 client.16992 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:42.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.308+0000 7f10405c9740 20 client.16992 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:42.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.308+0000 7f10405c9740 1 --2- 172.21.15.2:0/2366549865 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560201663920 0x560201665d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:42.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.308+0000 7f10405c9740 4 client.16992 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:20:42.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.308+0000 7f10405c9740 1 -- 172.21.15.2:0/2366549865 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560201545d00 con 0x560201663920 2024-09-19T06:20:42.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.309+0000 7f10377fe640 1 --2- 172.21.15.2:0/2366549865 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560201663920 0x560201665d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:42.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.309+0000 7f10377fe640 1 --2- 172.21.15.2:0/2366549865 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560201663920 0x560201665d40 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad22878bb75a4f9b server_cookie=63a35552e1e18fcb in_seq=0 out_seq=0 2024-09-19T06:20:42.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.309+0000 7f1016ffd640 10 client.16992 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:42.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.310+0000 7f1016ffd640 1 -- 172.21.15.2:0/2366549865 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560201545d00 con 0x560201663920 2024-09-19T06:20:42.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.310+0000 7f1016ffd640 10 client.16992 handle_command_reply: tid=0 2024-09-19T06:20:42.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.310+0000 7f10405c9740 1 client.16992 shutdown 2024-09-19T06:20:42.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.310+0000 7f10405c9740 1 -- 172.21.15.2:0/2366549865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5602015d8b60 msgr2=0x5602015ebec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:42.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.310+0000 7f10405c9740 1 --2- 172.21.15.2:0/2366549865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5602015d8b60 0x5602015ebec0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f10200036b0 tx=0x7f10200141d0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.310+0000 7f10405c9740 1 -- 172.21.15.2:0/2366549865 shutdown_connections 2024-09-19T06:20:42.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.310+0000 7f10405c9740 1 --2- 172.21.15.2:0/2366549865 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5602015e3d40 0x5602015e8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.310+0000 7f10405c9740 1 --2- 172.21.15.2:0/2366549865 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560201663920 0x560201665d40 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.310+0000 7f10405c9740 1 --2- 172.21.15.2:0/2366549865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5602015d9480 0x5602015ec400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.310+0000 7f10405c9740 1 --2- 172.21.15.2:0/2366549865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5602015d8b60 0x5602015ebec0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.310+0000 7f10405c9740 1 -- 172.21.15.2:0/2366549865 >> 172.21.15.2:0/2366549865 conn(0x5602015d50f0 msgr2=0x5602015e0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:42.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.310+0000 7f1016ffd640 0 client.16992 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:42.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.310+0000 7f10405c9740 1 -- 172.21.15.2:0/2366549865 shutdown_connections 2024-09-19T06:20:42.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.310+0000 7f10405c9740 1 -- 172.21.15.2:0/2366549865 wait complete. 2024-09-19T06:20:42.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.310+0000 7f10405c9740 20 client.16992 trim_cache size 0 max 16384 2024-09-19T06:20:42.328 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:20:42.328 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T06:20:42.328 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "bda86923-fc8a-4ccf-97ec-102d985d4a5e", 2024-09-19T06:20:42.328 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T06:20:42.328 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:20:42.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.311+0000 7f103e1f0640 1 -- 172.21.15.2:0/3327241786 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f10240a3430 msgr2=0x7f10240a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:42.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.311+0000 7f103e1f0640 1 --2- 172.21.15.2:0/3327241786 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f10240a3430 0x7f10240a58f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f10300cd870 tx=0x7f103000af30 comp rx=0 tx=0).stop 2024-09-19T06:20:42.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.311+0000 7f103e1f0640 1 -- 172.21.15.2:0/3327241786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10381082a0 msgr2=0x7f103819cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:42.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.311+0000 7f103e1f0640 1 --2- 172.21.15.2:0/3327241786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10381082a0 0x7f103819cd20 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f103000cce0 tx=0x7f103000a620 comp rx=0 tx=0).stop 2024-09-19T06:20:42.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.311+0000 7f103e1f0640 1 -- 172.21.15.2:0/3327241786 shutdown_connections 2024-09-19T06:20:42.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.311+0000 7f103e1f0640 1 --2- 172.21.15.2:0/3327241786 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f10240a3430 0x7f10240a58f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.311+0000 7f103e1f0640 1 --2- 172.21.15.2:0/3327241786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10381082a0 0x7f103819cd20 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.311+0000 7f103e1f0640 1 --2- 172.21.15.2:0/3327241786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10381036e0 0x7f1038198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.311+0000 7f103e1f0640 1 --2- 172.21.15.2:0/3327241786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1038102d30 0x7f1038198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.311+0000 7f103e1f0640 1 -- 172.21.15.2:0/3327241786 >> 172.21.15.2:0/3327241786 conn(0x7f10380fc7d0 msgr2=0x7f1038105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:42.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.311+0000 7f103e1f0640 1 -- 172.21.15.2:0/3327241786 shutdown_connections 2024-09-19T06:20:42.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:42.311+0000 7f103e1f0640 1 -- 172.21.15.2:0/3327241786 wait complete. 2024-09-19T06:20:43.057 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:20:43.314 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:43.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.774+0000 7fe845be4640 1 -- 172.21.15.2:0/3337344043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe840102790 msgr2=0x7fe8401067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:43.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.774+0000 7fe845be4640 1 --2- 172.21.15.2:0/3337344043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe840102790 0x7fe8401067e0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fe834009900 tx=0x7fe83402a410 comp rx=0 tx=0).stop 2024-09-19T06:20:43.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.774+0000 7fe845be4640 1 -- 172.21.15.2:0/3337344043 shutdown_connections 2024-09-19T06:20:43.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.774+0000 7fe845be4640 1 --2- 172.21.15.2:0/3337344043 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe840106f10 0x7fe84010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:43.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.774+0000 7fe845be4640 1 --2- 172.21.15.2:0/3337344043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe840102790 0x7fe8401067e0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:43.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.774+0000 7fe845be4640 1 --2- 172.21.15.2:0/3337344043 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe840101de0 0x7fe8401021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:43.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.774+0000 7fe845be4640 1 -- 172.21.15.2:0/3337344043 >> 172.21.15.2:0/3337344043 conn(0x7fe8400fd8c0 msgr2=0x7fe8400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:43.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.774+0000 7fe845be4640 1 -- 172.21.15.2:0/3337344043 shutdown_connections 2024-09-19T06:20:43.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.774+0000 7fe845be4640 1 -- 172.21.15.2:0/3337344043 wait complete. 2024-09-19T06:20:43.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.774+0000 7fe845be4640 1 Processor -- start 2024-09-19T06:20:43.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.774+0000 7fe845be4640 1 -- start start 2024-09-19T06:20:43.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.775+0000 7fe845be4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe840101de0 0x7fe84019a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:43.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.775+0000 7fe845be4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe840102790 0x7fe84019aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:43.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.775+0000 7fe845be4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe840106f10 0x7fe84019edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:43.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.775+0000 7fe845be4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe840111e70 con 0x7fe840101de0 2024-09-19T06:20:43.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.775+0000 7fe845be4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe840111cf0 con 0x7fe840106f10 2024-09-19T06:20:43.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.775+0000 7fe845be4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe840111ff0 con 0x7fe840102790 2024-09-19T06:20:43.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.775+0000 7fe83f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe840101de0 0x7fe84019a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:43.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.775+0000 7fe83f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe840101de0 0x7fe84019a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34200/0 (socket says 172.21.15.2:34200) 2024-09-19T06:20:43.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.775+0000 7fe83f7fe640 1 -- 172.21.15.2:0/1711554506 learned_addr learned my addr 172.21.15.2:0/1711554506 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:43.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.775+0000 7fe83effd640 1 --2- 172.21.15.2:0/1711554506 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe840102790 0x7fe84019aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:43.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.775+0000 7fe83ffff640 1 --2- 172.21.15.2:0/1711554506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe840106f10 0x7fe84019edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:43.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.775+0000 7fe83f7fe640 1 -- 172.21.15.2:0/1711554506 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe840102790 msgr2=0x7fe84019aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:43.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.775+0000 7fe83f7fe640 1 --2- 172.21.15.2:0/1711554506 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe840102790 0x7fe84019aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:43.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.775+0000 7fe83f7fe640 1 -- 172.21.15.2:0/1711554506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe840106f10 msgr2=0x7fe84019edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:43.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.775+0000 7fe83f7fe640 1 --2- 172.21.15.2:0/1711554506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe840106f10 0x7fe84019edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:43.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.775+0000 7fe83f7fe640 1 -- 172.21.15.2:0/1711554506 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe84019f4d0 con 0x7fe840101de0 2024-09-19T06:20:43.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.775+0000 7fe83ffff640 1 --2- 172.21.15.2:0/1711554506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe840106f10 0x7fe84019edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:43.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.775+0000 7fe83f7fe640 1 --2- 172.21.15.2:0/1711554506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe840101de0 0x7fe84019a520 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fe83000c970 tx=0x7fe83000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:43.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.776+0000 7fe83cff9640 1 -- 172.21.15.2:0/1711554506 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe830007bb0 con 0x7fe840101de0 2024-09-19T06:20:43.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.776+0000 7fe83cff9640 1 -- 172.21.15.2:0/1711554506 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe830007d50 con 0x7fe840101de0 2024-09-19T06:20:43.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.776+0000 7fe845be4640 1 -- 172.21.15.2:0/1711554506 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe84019f7c0 con 0x7fe840101de0 2024-09-19T06:20:43.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.776+0000 7fe83cff9640 1 -- 172.21.15.2:0/1711554506 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe83000f450 con 0x7fe840101de0 2024-09-19T06:20:43.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.776+0000 7fe845be4640 1 -- 172.21.15.2:0/1711554506 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8401a70a0 con 0x7fe840101de0 2024-09-19T06:20:43.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.779+0000 7fe83cff9640 1 -- 172.21.15.2:0/1711554506 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fe830004f20 con 0x7fe840101de0 2024-09-19T06:20:43.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.779+0000 7fe847fbd740 1 Processor -- start 2024-09-19T06:20:43.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.779+0000 7fe847fbd740 1 -- start start 2024-09-19T06:20:43.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.779+0000 7fe847fbd740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56086eeeb4a0 0x56086eeeb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:43.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.779+0000 7fe847fbd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56086eeebdc0 0x56086eef6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:43.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.779+0000 7fe847fbd740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56086eef6680 0x56086eef8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:43.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.779+0000 7fe847fbd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56086ee512e0 con 0x56086eeebdc0 2024-09-19T06:20:43.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.779+0000 7fe847fbd740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56086edf8ce0 con 0x56086eef6680 2024-09-19T06:20:43.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.779+0000 7fe847fbd740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56086ee4d2a0 con 0x56086eeeb4a0 2024-09-19T06:20:43.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.780+0000 7fe83f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56086eeebdc0 0x56086eef6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:43.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.780+0000 7fe83f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56086eeebdc0 0x56086eef6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34202/0 (socket says 172.21.15.2:34202) 2024-09-19T06:20:43.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.780+0000 7fe83f7fe640 1 -- 172.21.15.2:0/1715296971 learned_addr learned my addr 172.21.15.2:0/1715296971 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:43.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.780+0000 7fe83ffff640 1 --2- 172.21.15.2:0/1715296971 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56086eeeb4a0 0x56086eeeb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:43.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.780+0000 7fe83effd640 1 --2- 172.21.15.2:0/1715296971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56086eef6680 0x56086eef8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:43.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.780+0000 7fe83cff9640 1 --2- 172.21.15.2:0/1711554506 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe8280a33b0 0x7fe8280a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:43.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.780+0000 7fe83f7fe640 1 -- 172.21.15.2:0/1715296971 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56086eeeb4a0 msgr2=0x56086eeeb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:43.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.780+0000 7fe83f7fe640 1 --2- 172.21.15.2:0/1715296971 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56086eeeb4a0 0x56086eeeb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:43.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.780+0000 7fe83f7fe640 1 -- 172.21.15.2:0/1715296971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56086eef6680 msgr2=0x56086eef8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:43.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.780+0000 7fe83f7fe640 1 --2- 172.21.15.2:0/1715296971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56086eef6680 0x56086eef8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:43.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.780+0000 7fe83f7fe640 1 -- 172.21.15.2:0/1715296971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56086eddd440 con 0x56086eeebdc0 2024-09-19T06:20:43.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.780+0000 7fe83ffff640 1 --2- 172.21.15.2:0/1715296971 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56086eeeb4a0 0x56086eeeb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:43.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.780+0000 7fe83ffff640 1 --2- 172.21.15.2:0/1711554506 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe8280a33b0 0x7fe8280a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:43.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.780+0000 7fe83cff9640 1 -- 172.21.15.2:0/1711554506 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fe8300cfad0 con 0x7fe840101de0 2024-09-19T06:20:43.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.780+0000 7fe83f7fe640 1 --2- 172.21.15.2:0/1715296971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56086eeebdc0 0x56086eef6140 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fe8300cd130 tx=0x7fe83006db00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14946847e4435393 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:43.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.780+0000 7fe825ffb640 1 -- 172.21.15.2:0/1715296971 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe83001d070 con 0x56086eeebdc0 2024-09-19T06:20:43.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.781+0000 7fe825ffb640 1 -- 172.21.15.2:0/1715296971 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe83006c8d0 con 0x56086eeebdc0 2024-09-19T06:20:43.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.781+0000 7fe825ffb640 1 -- 172.21.15.2:0/1715296971 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe83006f0b0 con 0x56086eeebdc0 2024-09-19T06:20:43.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.781+0000 7fe847fbd740 1 -- 172.21.15.2:0/1715296971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56086eeebdc0 msgr2=0x56086eef6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:43.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.781+0000 7fe83ffff640 1 --2- 172.21.15.2:0/1711554506 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe8280a33b0 0x7fe8280a5870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe838007f50 tx=0x7fe838004a40 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:43.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.781+0000 7fe847fbd740 1 --2- 172.21.15.2:0/1715296971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56086eeebdc0 0x56086eef6140 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fe8300cd130 tx=0x7fe83006db00 comp rx=0 tx=0).stop 2024-09-19T06:20:43.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.782+0000 7fe847fbd740 1 -- 172.21.15.2:0/1715296971 shutdown_connections 2024-09-19T06:20:43.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.782+0000 7fe847fbd740 1 --2- 172.21.15.2:0/1715296971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56086eef6680 0x56086eef8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:43.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.782+0000 7fe847fbd740 1 --2- 172.21.15.2:0/1715296971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56086eeebdc0 0x56086eef6140 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:43.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.782+0000 7fe847fbd740 1 --2- 172.21.15.2:0/1715296971 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56086eeeb4a0 0x56086eeeb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:43.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.782+0000 7fe847fbd740 1 -- 172.21.15.2:0/1715296971 >> 172.21.15.2:0/1715296971 conn(0x56086eee7a30 msgr2=0x56086eee7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:43.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.782+0000 7fe847fbd740 1 -- 172.21.15.2:0/1715296971 shutdown_connections 2024-09-19T06:20:43.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.782+0000 7fe847fbd740 1 -- 172.21.15.2:0/1715296971 wait complete. 2024-09-19T06:20:43.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.782+0000 7fe847fbd740 1 -- start start 2024-09-19T06:20:43.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.782+0000 7fe847fbd740 1 Processor -- start 2024-09-19T06:20:43.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.783+0000 7fe847fbd740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56086eeeb4a0 0x56086eef5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:43.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.783+0000 7fe847fbd740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56086eeebdc0 0x56086eef3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:43.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.783+0000 7fe847fbd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56086eef6680 0x56086eef37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:43.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.783+0000 7fe847fbd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56086eef91f0 con 0x56086eef6680 2024-09-19T06:20:43.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.783+0000 7fe847fbd740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56086ee0c050 con 0x56086eeebdc0 2024-09-19T06:20:43.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.783+0000 7fe847fbd740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56086eef9370 con 0x56086eeeb4a0 2024-09-19T06:20:43.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.783+0000 7fe847fbd740 10 client.0 _ll_register_callbacks cb 0x56086ee4c160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:43.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.783+0000 7fe83ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56086eef6680 0x56086eef37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:43.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.783+0000 7fe83ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56086eef6680 0x56086eef37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34208/0 (socket says 172.21.15.2:34208) 2024-09-19T06:20:43.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.783+0000 7fe83ffff640 1 -- 172.21.15.2:0/259761825 learned_addr learned my addr 172.21.15.2:0/259761825 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:43.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.783+0000 7fe83f7fe640 1 --2- 172.21.15.2:0/259761825 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56086eeeb4a0 0x56086eef5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:43.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.783+0000 7fe83effd640 1 --2- 172.21.15.2:0/259761825 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56086eeebdc0 0x56086eef3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:43.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.783+0000 7fe83ffff640 1 -- 172.21.15.2:0/259761825 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56086eeeb4a0 msgr2=0x56086eef5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:43.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.783+0000 7fe83ffff640 1 --2- 172.21.15.2:0/259761825 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56086eeeb4a0 0x56086eef5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:43.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.783+0000 7fe83ffff640 1 -- 172.21.15.2:0/259761825 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56086eeebdc0 msgr2=0x56086eef3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:43.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.783+0000 7fe83ffff640 1 --2- 172.21.15.2:0/259761825 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56086eeebdc0 0x56086eef3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:43.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.783+0000 7fe83ffff640 1 -- 172.21.15.2:0/259761825 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56086ebc23c0 con 0x56086eef6680 2024-09-19T06:20:43.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.783+0000 7fe83ffff640 1 --2- 172.21.15.2:0/259761825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56086eef6680 0x56086eef37e0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fe8380078d0 tx=0x7fe838007510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b44bf66afd10c20f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:43.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.783+0000 7fe81effd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:43.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.784+0000 7fe81effd640 1 -- 172.21.15.2:0/259761825 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe83801dd80 con 0x56086eef6680 2024-09-19T06:20:43.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.784+0000 7fe81effd640 1 -- 172.21.15.2:0/259761825 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fe83801b450 con 0x56086eef6680 2024-09-19T06:20:43.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.784+0000 7fe847fbd740 1 -- 172.21.15.2:0/259761825 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe83006c8d0 con 0x56086eef6680 2024-09-19T06:20:43.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.784+0000 7fe81effd640 1 -- 172.21.15.2:0/259761825 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe83801b650 con 0x56086eef6680 2024-09-19T06:20:43.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.784+0000 7fe847fbd740 10 client.17004 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:43.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.784+0000 7fe847fbd740 1 -- 172.21.15.2:0/259761825 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56086ef04c20 con 0x56086eef6680 2024-09-19T06:20:43.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.784+0000 7fe81effd640 1 -- 172.21.15.2:0/259761825 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe83006c8d0 con 0x56086eef6680 2024-09-19T06:20:43.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.784+0000 7fe81effd640 1 -- 172.21.15.2:0/259761825 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fe838024070 con 0x56086eef6680 2024-09-19T06:20:43.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.784+0000 7fe847fbd740 10 client.17004 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:43.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.784+0000 7fe847fbd740 10 client.17004 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:43.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.784+0000 7fe847fbd740 20 client.17004 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:43.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.784+0000 7fe847fbd740 1 --2- 172.21.15.2:0/259761825 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x56086ef060e0 0x56086ef08500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:43.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.784+0000 7fe847fbd740 4 client.17004 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:43.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.784+0000 7fe847fbd740 1 -- 172.21.15.2:0/259761825 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56086ee5e850 con 0x56086ef060e0 2024-09-19T06:20:43.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.785+0000 7fe83f7fe640 1 --2- 172.21.15.2:0/259761825 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x56086ef060e0 0x56086ef08500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:43.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.785+0000 7fe83f7fe640 1 --2- 172.21.15.2:0/259761825 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x56086ef060e0 0x56086ef08500 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4bd0d96bc9d9d5b server_cookie=1dd4eb1c93dc2da3 in_seq=0 out_seq=0 2024-09-19T06:20:43.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.785+0000 7fe81effd640 10 client.17004 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:43.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.786+0000 7fe81effd640 1 -- 172.21.15.2:0/259761825 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56086ee5e850 con 0x56086ef060e0 2024-09-19T06:20:43.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.786+0000 7fe81effd640 10 client.17004 handle_command_reply: tid=0 2024-09-19T06:20:43.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.786+0000 7fe847fbd740 1 client.17004 shutdown 2024-09-19T06:20:43.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.786+0000 7fe847fbd740 1 -- 172.21.15.2:0/259761825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56086eef6680 msgr2=0x56086eef37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:43.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.786+0000 7fe847fbd740 1 --2- 172.21.15.2:0/259761825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56086eef6680 0x56086eef37e0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fe8380078d0 tx=0x7fe838007510 comp rx=0 tx=0).stop 2024-09-19T06:20:43.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.786+0000 7fe847fbd740 1 -- 172.21.15.2:0/259761825 shutdown_connections 2024-09-19T06:20:43.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.786+0000 7fe847fbd740 1 --2- 172.21.15.2:0/259761825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56086eef6680 0x56086eef37e0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:43.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.786+0000 7fe847fbd740 1 --2- 172.21.15.2:0/259761825 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x56086ef060e0 0x56086ef08500 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:43.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.786+0000 7fe847fbd740 1 --2- 172.21.15.2:0/259761825 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56086eeebdc0 0x56086eef3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:43.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.786+0000 7fe847fbd740 1 --2- 172.21.15.2:0/259761825 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56086eeeb4a0 0x56086eef5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:43.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.786+0000 7fe847fbd740 1 -- 172.21.15.2:0/259761825 >> 172.21.15.2:0/259761825 conn(0x56086eee7a30 msgr2=0x56086eeed760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:43.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.786+0000 7fe81effd640 0 client.17004 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:43.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.786+0000 7fe847fbd740 1 -- 172.21.15.2:0/259761825 shutdown_connections 2024-09-19T06:20:43.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.786+0000 7fe847fbd740 1 -- 172.21.15.2:0/259761825 wait complete. 2024-09-19T06:20:43.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.786+0000 7fe847fbd740 20 client.17004 trim_cache size 0 max 16384 2024-09-19T06:20:43.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.803+0000 7fe847fbd740 1 Processor -- start 2024-09-19T06:20:43.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.803+0000 7fe847fbd740 1 -- start start 2024-09-19T06:20:43.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.804+0000 7fe847fbd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56086eeeb4a0 0x56086ef02450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:43.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.804+0000 7fe847fbd740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56086eeebdc0 0x56086eef1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:43.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.804+0000 7fe847fbd740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56086eef6680 0x56086eef51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:43.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.804+0000 7fe847fbd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe8401b2210 con 0x56086eeeb4a0 2024-09-19T06:20:43.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.804+0000 7fe847fbd740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe8401afae0 con 0x56086eef6680 2024-09-19T06:20:43.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.804+0000 7fe847fbd740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe8401ad930 con 0x56086eeebdc0 2024-09-19T06:20:43.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.804+0000 7fe83f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56086eeeb4a0 0x56086ef02450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:43.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.804+0000 7fe83f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56086eeeb4a0 0x56086ef02450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34218/0 (socket says 172.21.15.2:34218) 2024-09-19T06:20:43.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.804+0000 7fe83f7fe640 1 -- 172.21.15.2:0/3591981952 learned_addr learned my addr 172.21.15.2:0/3591981952 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:43.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.804+0000 7fe83ffff640 1 --2- 172.21.15.2:0/3591981952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56086eef6680 0x56086eef51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:43.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.804+0000 7fe83f7fe640 1 -- 172.21.15.2:0/3591981952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56086eeebdc0 msgr2=0x56086eef1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:43.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.804+0000 7fe83f7fe640 1 --2- 172.21.15.2:0/3591981952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56086eeebdc0 0x56086eef1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:43.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.804+0000 7fe83f7fe640 1 -- 172.21.15.2:0/3591981952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56086eef6680 msgr2=0x56086eef51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:43.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.804+0000 7fe83f7fe640 1 --2- 172.21.15.2:0/3591981952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56086eef6680 0x56086eef51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:43.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.804+0000 7fe83f7fe640 1 -- 172.21.15.2:0/3591981952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56086eef2230 con 0x56086eeeb4a0 2024-09-19T06:20:43.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.804+0000 7fe83ffff640 1 --2- 172.21.15.2:0/3591981952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56086eef6680 0x56086eef51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:20:43.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.804+0000 7fe83f7fe640 1 --2- 172.21.15.2:0/3591981952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56086eeeb4a0 0x56086ef02450 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fe830098750 tx=0x7fe83009bb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c186394f202354d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:43.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.804+0000 7fe8257fa640 1 -- 172.21.15.2:0/3591981952 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe83001d040 con 0x56086eeeb4a0 2024-09-19T06:20:43.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.804+0000 7fe8257fa640 1 -- 172.21.15.2:0/3591981952 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe83009c480 con 0x56086eeeb4a0 2024-09-19T06:20:43.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.804+0000 7fe8257fa640 1 -- 172.21.15.2:0/3591981952 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8300a49f0 con 0x56086eeeb4a0 2024-09-19T06:20:43.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.805+0000 7fe847fbd740 1 -- 172.21.15.2:0/3591981952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56086eeeb4a0 msgr2=0x56086ef02450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:43.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.805+0000 7fe847fbd740 1 --2- 172.21.15.2:0/3591981952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56086eeeb4a0 0x56086ef02450 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fe830098750 tx=0x7fe83009bb50 comp rx=0 tx=0).stop 2024-09-19T06:20:43.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.805+0000 7fe847fbd740 1 -- 172.21.15.2:0/3591981952 shutdown_connections 2024-09-19T06:20:43.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.805+0000 7fe847fbd740 1 --2- 172.21.15.2:0/3591981952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56086eef6680 0x56086eef51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:43.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.805+0000 7fe847fbd740 1 --2- 172.21.15.2:0/3591981952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56086eeebdc0 0x56086eef1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:43.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.805+0000 7fe847fbd740 1 --2- 172.21.15.2:0/3591981952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56086eeeb4a0 0x56086ef02450 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:43.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.805+0000 7fe847fbd740 1 -- 172.21.15.2:0/3591981952 >> 172.21.15.2:0/3591981952 conn(0x56086eee7a30 msgr2=0x56086eef4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:43.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.805+0000 7fe847fbd740 1 -- 172.21.15.2:0/3591981952 shutdown_connections 2024-09-19T06:20:43.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.805+0000 7fe847fbd740 1 -- 172.21.15.2:0/3591981952 wait complete. 2024-09-19T06:20:43.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.805+0000 7fe847fbd740 1 -- start start 2024-09-19T06:20:43.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.806+0000 7fe847fbd740 1 Processor -- start 2024-09-19T06:20:43.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.806+0000 7fe847fbd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56086eeeb4a0 0x56086eefa280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:43.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.806+0000 7fe847fbd740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56086eeebdc0 0x56086eefa7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:43.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.806+0000 7fe847fbd740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56086eef6680 0x56086eefad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:43.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.806+0000 7fe847fbd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe8401adfa0 con 0x56086eeeb4a0 2024-09-19T06:20:43.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.806+0000 7fe847fbd740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe8401af410 con 0x56086eeebdc0 2024-09-19T06:20:43.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.806+0000 7fe847fbd740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe8401ae670 con 0x56086eef6680 2024-09-19T06:20:43.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.806+0000 7fe847fbd740 10 client.0 _ll_register_callbacks cb 0x7fe838007cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:43.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.806+0000 7fe83f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56086eeeb4a0 0x56086eefa280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:43.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.806+0000 7fe83f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56086eeeb4a0 0x56086eefa280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34226/0 (socket says 172.21.15.2:34226) 2024-09-19T06:20:43.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.806+0000 7fe83f7fe640 1 -- 172.21.15.2:0/1869313921 learned_addr learned my addr 172.21.15.2:0/1869313921 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:43.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.806+0000 7fe83ffff640 1 --2- 172.21.15.2:0/1869313921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56086eef6680 0x56086eefad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:43.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.806+0000 7fe83effd640 1 --2- 172.21.15.2:0/1869313921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56086eeebdc0 0x56086eefa7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:43.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.806+0000 7fe83f7fe640 1 -- 172.21.15.2:0/1869313921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56086eef6680 msgr2=0x56086eefad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:43.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.806+0000 7fe83f7fe640 1 --2- 172.21.15.2:0/1869313921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56086eef6680 0x56086eefad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:43.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.807+0000 7fe83f7fe640 1 -- 172.21.15.2:0/1869313921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56086eeebdc0 msgr2=0x56086eefa7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:43.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.807+0000 7fe83f7fe640 1 --2- 172.21.15.2:0/1869313921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56086eeebdc0 0x56086eefa7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:43.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.807+0000 7fe83f7fe640 1 -- 172.21.15.2:0/1869313921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56086eeebbf0 con 0x56086eeeb4a0 2024-09-19T06:20:43.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.807+0000 7fe83f7fe640 1 --2- 172.21.15.2:0/1869313921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56086eeeb4a0 0x56086eefa280 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fe83009ba80 tx=0x7fe83009b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0060b34f97f24a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:43.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.807+0000 7fe81effd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:43.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.807+0000 7fe81effd640 1 -- 172.21.15.2:0/1869313921 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe83001d070 con 0x56086eeeb4a0 2024-09-19T06:20:43.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.807+0000 7fe81effd640 1 -- 172.21.15.2:0/1869313921 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fe830097c10 con 0x56086eeeb4a0 2024-09-19T06:20:43.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.807+0000 7fe847fbd740 1 -- 172.21.15.2:0/1869313921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe83009c480 con 0x56086eeeb4a0 2024-09-19T06:20:43.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.807+0000 7fe81effd640 1 -- 172.21.15.2:0/1869313921 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe83009bd80 con 0x56086eeeb4a0 2024-09-19T06:20:43.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.807+0000 7fe847fbd740 10 client.17010 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:43.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.807+0000 7fe847fbd740 1 -- 172.21.15.2:0/1869313921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56086ef70de0 con 0x56086eeeb4a0 2024-09-19T06:20:43.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.807+0000 7fe81effd640 1 -- 172.21.15.2:0/1869313921 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe83009c480 con 0x56086eeeb4a0 2024-09-19T06:20:43.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.807+0000 7fe81effd640 1 -- 172.21.15.2:0/1869313921 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fe8300983f0 con 0x56086eeeb4a0 2024-09-19T06:20:43.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.807+0000 7fe847fbd740 10 client.17010 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:43.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.807+0000 7fe847fbd740 10 client.17010 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:43.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.808+0000 7fe847fbd740 20 client.17010 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:43.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.808+0000 7fe847fbd740 1 --2- 172.21.15.2:0/1869313921 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x56086ef70de0 0x56086ef731d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:43.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.808+0000 7fe847fbd740 4 client.17010 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:20:43.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.808+0000 7fe847fbd740 1 -- 172.21.15.2:0/1869313921 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56086ee58d60 con 0x56086ef70de0 2024-09-19T06:20:43.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.808+0000 7fe83effd640 1 --2- 172.21.15.2:0/1869313921 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x56086ef70de0 0x56086ef731d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:43.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.808+0000 7fe81effd640 10 client.17010 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:43.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.808+0000 7fe83effd640 1 --2- 172.21.15.2:0/1869313921 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x56086ef70de0 0x56086ef731d0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1ade40817f769e1 server_cookie=40bbaea740a13a45 in_seq=0 out_seq=0 2024-09-19T06:20:43.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.808+0000 7fe81effd640 1 -- 172.21.15.2:0/1869313921 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56086ee58d60 con 0x56086ef70de0 2024-09-19T06:20:43.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.808+0000 7fe81effd640 10 client.17010 handle_command_reply: tid=0 2024-09-19T06:20:43.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.808+0000 7fe847fbd740 1 client.17010 shutdown 2024-09-19T06:20:43.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.809+0000 7fe847fbd740 1 -- 172.21.15.2:0/1869313921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56086eeeb4a0 msgr2=0x56086eefa280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:43.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.809+0000 7fe847fbd740 1 --2- 172.21.15.2:0/1869313921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56086eeeb4a0 0x56086eefa280 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fe83009ba80 tx=0x7fe83009b6e0 comp rx=0 tx=0).stop 2024-09-19T06:20:43.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.809+0000 7fe847fbd740 1 -- 172.21.15.2:0/1869313921 shutdown_connections 2024-09-19T06:20:43.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.809+0000 7fe847fbd740 1 --2- 172.21.15.2:0/1869313921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56086eef6680 0x56086eefad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:43.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.809+0000 7fe847fbd740 1 --2- 172.21.15.2:0/1869313921 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x56086ef70de0 0x56086ef731d0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:43.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.809+0000 7fe847fbd740 1 --2- 172.21.15.2:0/1869313921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56086eeebdc0 0x56086eefa7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:43.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.809+0000 7fe847fbd740 1 --2- 172.21.15.2:0/1869313921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56086eeeb4a0 0x56086eefa280 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:43.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.809+0000 7fe81effd640 0 client.17010 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:43.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.809+0000 7fe847fbd740 1 -- 172.21.15.2:0/1869313921 >> 172.21.15.2:0/1869313921 conn(0x56086eee7a30 msgr2=0x56086eef5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:43.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.809+0000 7fe847fbd740 1 -- 172.21.15.2:0/1869313921 shutdown_connections 2024-09-19T06:20:43.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.809+0000 7fe847fbd740 1 -- 172.21.15.2:0/1869313921 wait complete. 2024-09-19T06:20:43.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.809+0000 7fe847fbd740 20 client.17010 trim_cache size 0 max 16384 2024-09-19T06:20:43.839 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:20:43.839 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T06:20:43.839 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T06:20:43.839 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:20:43.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.809+0000 7fe845be4640 1 -- 172.21.15.2:0/1711554506 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe8280a33b0 msgr2=0x7fe8280a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:43.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.809+0000 7fe845be4640 1 --2- 172.21.15.2:0/1711554506 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe8280a33b0 0x7fe8280a5870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe838007f50 tx=0x7fe838004a40 comp rx=0 tx=0).stop 2024-09-19T06:20:43.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.809+0000 7fe845be4640 1 -- 172.21.15.2:0/1711554506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe840101de0 msgr2=0x7fe84019a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:43.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.809+0000 7fe845be4640 1 --2- 172.21.15.2:0/1711554506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe840101de0 0x7fe84019a520 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fe83000c970 tx=0x7fe83000ce30 comp rx=0 tx=0).stop 2024-09-19T06:20:43.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.809+0000 7fe845be4640 1 -- 172.21.15.2:0/1711554506 shutdown_connections 2024-09-19T06:20:43.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.809+0000 7fe845be4640 1 --2- 172.21.15.2:0/1711554506 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe8280a33b0 0x7fe8280a5870 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:43.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.809+0000 7fe845be4640 1 --2- 172.21.15.2:0/1711554506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe840106f10 0x7fe84019edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:43.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.809+0000 7fe845be4640 1 --2- 172.21.15.2:0/1711554506 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe840102790 0x7fe84019aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:43.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.809+0000 7fe845be4640 1 --2- 172.21.15.2:0/1711554506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe840101de0 0x7fe84019a520 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:43.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.809+0000 7fe845be4640 1 -- 172.21.15.2:0/1711554506 >> 172.21.15.2:0/1711554506 conn(0x7fe8400fd8c0 msgr2=0x7fe8400fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:43.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.810+0000 7fe845be4640 1 -- 172.21.15.2:0/1711554506 shutdown_connections 2024-09-19T06:20:43.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:43.810+0000 7fe845be4640 1 -- 172.21.15.2:0/1711554506 wait complete. 2024-09-19T06:20:44.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:43 smithi002 ceph-mon[30982]: pgmap v180: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:20:44.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:43 smithi002 ceph-mon[30982]: scrub queued for path: / 2024-09-19T06:20:44.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:43 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:44.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:43 smithi002 ceph-mon[30982]: scrub summary: active paths [/] 2024-09-19T06:20:44.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:43 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:44.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:43 smithi002 ceph-mon[30982]: scrub summary: idle 2024-09-19T06:20:44.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:43 smithi090 ceph-mon[34497]: pgmap v180: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:20:44.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:43 smithi090 ceph-mon[34497]: scrub queued for path: / 2024-09-19T06:20:44.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:43 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:44.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:43 smithi090 ceph-mon[34497]: scrub summary: active paths [/] 2024-09-19T06:20:44.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:43 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:44.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:43 smithi090 ceph-mon[34497]: scrub summary: idle 2024-09-19T06:20:44.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:43 smithi089 ceph-mon[34160]: pgmap v180: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:20:44.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:43 smithi089 ceph-mon[34160]: scrub queued for path: / 2024-09-19T06:20:44.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:43 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:44.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:43 smithi089 ceph-mon[34160]: scrub summary: active paths [/] 2024-09-19T06:20:44.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:43 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:44.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:43 smithi089 ceph-mon[34160]: scrub summary: idle 2024-09-19T06:20:44.464 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:20:44.464 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:20:44.729 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:45.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.289+0000 7f2560fe1640 1 -- 172.21.15.2:0/2449478410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f255c1036e0 msgr2=0x7f255c107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:45.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.289+0000 7f2560fe1640 1 --2- 172.21.15.2:0/2449478410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f255c1036e0 0x7f255c107b90 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f254c009930 tx=0x7f254c02a420 comp rx=0 tx=0).stop 2024-09-19T06:20:45.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.289+0000 7f2560fe1640 1 -- 172.21.15.2:0/2449478410 shutdown_connections 2024-09-19T06:20:45.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.289+0000 7f2560fe1640 1 --2- 172.21.15.2:0/2449478410 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f255c1082a0 0x7f255c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:45.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.289+0000 7f2560fe1640 1 --2- 172.21.15.2:0/2449478410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f255c1036e0 0x7f255c107b90 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:45.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.289+0000 7f2560fe1640 1 --2- 172.21.15.2:0/2449478410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f255c102d30 0x7f255c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:45.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.289+0000 7f2560fe1640 1 -- 172.21.15.2:0/2449478410 >> 172.21.15.2:0/2449478410 conn(0x7f255c0fc7d0 msgr2=0x7f255c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:45.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.289+0000 7f2560fe1640 1 -- 172.21.15.2:0/2449478410 shutdown_connections 2024-09-19T06:20:45.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.289+0000 7f2560fe1640 1 -- 172.21.15.2:0/2449478410 wait complete. 2024-09-19T06:20:45.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.290+0000 7f2560fe1640 1 Processor -- start 2024-09-19T06:20:45.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.290+0000 7f2560fe1640 1 -- start start 2024-09-19T06:20:45.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.290+0000 7f2560fe1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f255c102d30 0x7f255c198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:45.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.290+0000 7f2560fe1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f255c1036e0 0x7f255c198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:45.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.290+0000 7f2560fe1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f255c1082a0 0x7f255c19cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:45.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.290+0000 7f2560fe1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f255c111f50 con 0x7f255c1082a0 2024-09-19T06:20:45.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.290+0000 7f2560fe1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f255c111dd0 con 0x7f255c102d30 2024-09-19T06:20:45.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.290+0000 7f2560fe1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f255c1120d0 con 0x7f255c1036e0 2024-09-19T06:20:45.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.291+0000 7f255ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f255c1082a0 0x7f255c19cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:45.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.291+0000 7f255ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f255c1082a0 0x7f255c19cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34254/0 (socket says 172.21.15.2:34254) 2024-09-19T06:20:45.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.291+0000 7f255ad9d640 1 -- 172.21.15.2:0/2443216757 learned_addr learned my addr 172.21.15.2:0/2443216757 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:45.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.291+0000 7f2559d9b640 1 --2- 172.21.15.2:0/2443216757 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f255c1036e0 0x7f255c198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:45.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.291+0000 7f255a59c640 1 --2- 172.21.15.2:0/2443216757 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f255c102d30 0x7f255c198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:45.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.291+0000 7f255ad9d640 1 -- 172.21.15.2:0/2443216757 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f255c1036e0 msgr2=0x7f255c198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:45.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.291+0000 7f255ad9d640 1 --2- 172.21.15.2:0/2443216757 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f255c1036e0 0x7f255c198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:45.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.291+0000 7f255ad9d640 1 -- 172.21.15.2:0/2443216757 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f255c102d30 msgr2=0x7f255c198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:45.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.291+0000 7f255ad9d640 1 --2- 172.21.15.2:0/2443216757 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f255c102d30 0x7f255c198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:45.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.291+0000 7f255ad9d640 1 -- 172.21.15.2:0/2443216757 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f255c19d4c0 con 0x7f255c1082a0 2024-09-19T06:20:45.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.291+0000 7f255ad9d640 1 --2- 172.21.15.2:0/2443216757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f255c1082a0 0x7f255c19cde0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f255400eaa0 tx=0x7f255400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:45.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.291+0000 7f25537fe640 1 -- 172.21.15.2:0/2443216757 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255400cdb0 con 0x7f255c1082a0 2024-09-19T06:20:45.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.291+0000 7f25537fe640 1 -- 172.21.15.2:0/2443216757 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2554005020 con 0x7f255c1082a0 2024-09-19T06:20:45.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.291+0000 7f25537fe640 1 -- 172.21.15.2:0/2443216757 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25540116d0 con 0x7f255c1082a0 2024-09-19T06:20:45.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.291+0000 7f2560fe1640 1 -- 172.21.15.2:0/2443216757 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f255c19d7b0 con 0x7f255c1082a0 2024-09-19T06:20:45.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.292+0000 7f2560fe1640 1 -- 172.21.15.2:0/2443216757 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f255c1a5090 con 0x7f255c1082a0 2024-09-19T06:20:45.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.293+0000 7f2560fe1640 1 -- 172.21.15.2:0/2443216757 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f255c06a850 con 0x7f255c1082a0 2024-09-19T06:20:45.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.294+0000 7f25537fe640 1 -- 172.21.15.2:0/2443216757 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f25540051d0 con 0x7f255c1082a0 2024-09-19T06:20:45.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.294+0000 7f25537fe640 1 --2- 172.21.15.2:0/2443216757 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f25480a33b0 0x7f25480a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:45.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.295+0000 7f25537fe640 1 -- 172.21.15.2:0/2443216757 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f25540cfdc0 con 0x7f255c1082a0 2024-09-19T06:20:45.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.295+0000 7f255a59c640 1 --2- 172.21.15.2:0/2443216757 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f25480a33b0 0x7f25480a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:45.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.295+0000 7f255a59c640 1 --2- 172.21.15.2:0/2443216757 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f25480a33b0 0x7f25480a5870 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f25440058c0 tx=0x7f254400a2d0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:45.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.299+0000 7f25537fe640 1 -- 172.21.15.2:0/2443216757 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2554016030 con 0x7f255c1082a0 2024-09-19T06:20:45.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.511+0000 7f2560fe1640 1 -- 172.21.15.2:0/2443216757 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f255c10a2b0 con 0x7f255c1082a0 2024-09-19T06:20:45.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.512+0000 7f25537fe640 1 -- 172.21.15.2:0/2443216757 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11882 (secure 0 0 0) 0x7f255409c120 con 0x7f255c1082a0 2024-09-19T06:20:45.514 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:20:45.514 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-09-19T06:14:49:104280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:14:48.191083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24470,24472,24497]},"id":1}]} 2024-09-19T06:20:45.515 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-09-19T06:20:45.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.515+0000 7f2560fe1640 1 -- 172.21.15.2:0/2443216757 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f25480a33b0 msgr2=0x7f25480a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:45.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.515+0000 7f2560fe1640 1 --2- 172.21.15.2:0/2443216757 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f25480a33b0 0x7f25480a5870 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f25440058c0 tx=0x7f254400a2d0 comp rx=0 tx=0).stop 2024-09-19T06:20:45.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.515+0000 7f2560fe1640 1 -- 172.21.15.2:0/2443216757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f255c1082a0 msgr2=0x7f255c19cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:45.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.515+0000 7f2560fe1640 1 --2- 172.21.15.2:0/2443216757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f255c1082a0 0x7f255c19cde0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f255400eaa0 tx=0x7f255400ef60 comp rx=0 tx=0).stop 2024-09-19T06:20:45.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.515+0000 7f2560fe1640 1 -- 172.21.15.2:0/2443216757 shutdown_connections 2024-09-19T06:20:45.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.515+0000 7f2560fe1640 1 --2- 172.21.15.2:0/2443216757 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f25480a33b0 0x7f25480a5870 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:45.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.515+0000 7f2560fe1640 1 --2- 172.21.15.2:0/2443216757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f255c1082a0 0x7f255c19cde0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:45.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.515+0000 7f2560fe1640 1 --2- 172.21.15.2:0/2443216757 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f255c1036e0 0x7f255c198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:45.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.515+0000 7f2560fe1640 1 --2- 172.21.15.2:0/2443216757 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f255c102d30 0x7f255c198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:45.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.515+0000 7f2560fe1640 1 -- 172.21.15.2:0/2443216757 >> 172.21.15.2:0/2443216757 conn(0x7f255c0fc7d0 msgr2=0x7f255c105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:45.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.515+0000 7f2560fe1640 1 -- 172.21.15.2:0/2443216757 shutdown_connections 2024-09-19T06:20:45.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:45.515+0000 7f2560fe1640 1 -- 172.21.15.2:0/2443216757 wait complete. 2024-09-19T06:20:46.152 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:45 smithi002 ceph-mon[30982]: pgmap v181: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2024-09-19T06:20:46.152 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:45 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/2443216757' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:20:46.185 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:20:46.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:45 smithi090 ceph-mon[34497]: pgmap v181: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2024-09-19T06:20:46.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:45 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/2443216757' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:20:46.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:45 smithi089 ceph-mon[34160]: pgmap v181: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2024-09-19T06:20:46.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:45 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/2443216757' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:20:46.444 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:46.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.888+0000 7fdf2e2af640 1 -- 172.21.15.2:0/1716699474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf28100a80 msgr2=0x7fdf28100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:46.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.889+0000 7fdf2e2af640 1 --2- 172.21.15.2:0/1716699474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf28100a80 0x7fdf28100ee0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fdf10009930 tx=0x7fdf1002a420 comp rx=0 tx=0).stop 2024-09-19T06:20:46.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.889+0000 7fdf2e2af640 1 -- 172.21.15.2:0/1716699474 shutdown_connections 2024-09-19T06:20:46.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.889+0000 7fdf2e2af640 1 --2- 172.21.15.2:0/1716699474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf28101420 0x7fdf2810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.889+0000 7fdf2e2af640 1 --2- 172.21.15.2:0/1716699474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf28100a80 0x7fdf28100ee0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.889+0000 7fdf2e2af640 1 --2- 172.21.15.2:0/1716699474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf28106a80 0x7fdf28106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.889+0000 7fdf2e2af640 1 -- 172.21.15.2:0/1716699474 >> 172.21.15.2:0/1716699474 conn(0x7fdf280fc7a0 msgr2=0x7fdf280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:46.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.889+0000 7fdf2e2af640 1 -- 172.21.15.2:0/1716699474 shutdown_connections 2024-09-19T06:20:46.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.889+0000 7fdf2e2af640 1 -- 172.21.15.2:0/1716699474 wait complete. 2024-09-19T06:20:46.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.889+0000 7fdf2e2af640 1 Processor -- start 2024-09-19T06:20:46.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.889+0000 7fdf2e2af640 1 -- start start 2024-09-19T06:20:46.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.890+0000 7fdf2e2af640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf28100a80 0x7fdf28198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.890+0000 7fdf2e2af640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf28101420 0x7fdf28198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.890+0000 7fdf2e2af640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf28106a80 0x7fdf2819cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.890+0000 7fdf2e2af640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdf28111e50 con 0x7fdf28106a80 2024-09-19T06:20:46.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.890+0000 7fdf2e2af640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fdf28111cd0 con 0x7fdf28101420 2024-09-19T06:20:46.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.890+0000 7fdf2e2af640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdf28111fd0 con 0x7fdf28100a80 2024-09-19T06:20:46.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.890+0000 7fdf2c84c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf28106a80 0x7fdf2819cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.890+0000 7fdf2c84c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf28106a80 0x7fdf2819cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54328/0 (socket says 172.21.15.2:54328) 2024-09-19T06:20:46.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.890+0000 7fdf2c84c640 1 -- 172.21.15.2:0/1401455183 learned_addr learned my addr 172.21.15.2:0/1401455183 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:46.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.890+0000 7fdf27fff640 1 --2- 172.21.15.2:0/1401455183 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf28100a80 0x7fdf28198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.890+0000 7fdf1ffff640 1 --2- 172.21.15.2:0/1401455183 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf28101420 0x7fdf28198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.890+0000 7fdf2c84c640 1 -- 172.21.15.2:0/1401455183 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf28100a80 msgr2=0x7fdf28198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:46.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.890+0000 7fdf2c84c640 1 --2- 172.21.15.2:0/1401455183 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf28100a80 0x7fdf28198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.890+0000 7fdf2c84c640 1 -- 172.21.15.2:0/1401455183 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf28101420 msgr2=0x7fdf28198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:46.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.890+0000 7fdf2c84c640 1 --2- 172.21.15.2:0/1401455183 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf28101420 0x7fdf28198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.890+0000 7fdf2c84c640 1 -- 172.21.15.2:0/1401455183 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf2819d2b0 con 0x7fdf28106a80 2024-09-19T06:20:46.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.890+0000 7fdf2c84c640 1 --2- 172.21.15.2:0/1401455183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf28106a80 0x7fdf2819cbd0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fdf2000eaa0 tx=0x7fdf2000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:46.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.890+0000 7fdf25ffb640 1 -- 172.21.15.2:0/1401455183 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf20004d20 con 0x7fdf28106a80 2024-09-19T06:20:46.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.890+0000 7fdf2e2af640 1 -- 172.21.15.2:0/1401455183 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf2819d5a0 con 0x7fdf28106a80 2024-09-19T06:20:46.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.890+0000 7fdf25ffb640 1 -- 172.21.15.2:0/1401455183 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdf20005020 con 0x7fdf28106a80 2024-09-19T06:20:46.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.890+0000 7fdf25ffb640 1 -- 172.21.15.2:0/1401455183 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf200116d0 con 0x7fdf28106a80 2024-09-19T06:20:46.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.891+0000 7fdf2e2af640 1 -- 172.21.15.2:0/1401455183 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf281a4e80 con 0x7fdf28106a80 2024-09-19T06:20:46.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.893+0000 7fdf25ffb640 1 -- 172.21.15.2:0/1401455183 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fdf2000caf0 con 0x7fdf28106a80 2024-09-19T06:20:46.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.893+0000 7fdf30688740 1 Processor -- start 2024-09-19T06:20:46.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.894+0000 7fdf30688740 1 -- start start 2024-09-19T06:20:46.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.894+0000 7fdf30688740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff50b1fb40 0x55ff50b1e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.894+0000 7fdf30688740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ff50b1e5d0 0x55ff50b1ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.894+0000 7fdf30688740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff50b29370 0x55ff50b2b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.894+0000 7fdf30688740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ff50a842f0 con 0x55ff50b29370 2024-09-19T06:20:46.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.894+0000 7fdf30688740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55ff50a2bcf0 con 0x55ff50b1fb40 2024-09-19T06:20:46.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.894+0000 7fdf30688740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55ff50a802b0 con 0x55ff50b1e5d0 2024-09-19T06:20:46.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.894+0000 7fdf25ffb640 1 --2- 172.21.15.2:0/1401455183 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fdf140a33b0 0x7fdf140a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.894+0000 7fdf1ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff50b29370 0x55ff50b2b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.894+0000 7fdf1ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff50b29370 0x55ff50b2b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54332/0 (socket says 172.21.15.2:54332) 2024-09-19T06:20:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.894+0000 7fdf1ffff640 1 -- 172.21.15.2:0/762886277 learned_addr learned my addr 172.21.15.2:0/762886277 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.894+0000 7fdf2c84c640 1 --2- 172.21.15.2:0/1401455183 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fdf140a33b0 0x7fdf140a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.894+0000 7fdf1ffff640 1 --2- 172.21.15.2:0/762886277 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff50b1fb40 0x55ff50b1e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.894+0000 7fdf27fff640 1 --2- 172.21.15.2:0/762886277 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ff50b1e5d0 0x55ff50b1ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.895+0000 7fdf1ffff640 1 -- 172.21.15.2:0/762886277 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ff50b1e5d0 msgr2=0x55ff50b1ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.895+0000 7fdf1ffff640 1 --2- 172.21.15.2:0/762886277 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ff50b1e5d0 0x55ff50b1ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.895+0000 7fdf1ffff640 1 -- 172.21.15.2:0/762886277 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff50b1fb40 msgr2=0x55ff50b1e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.895+0000 7fdf1ffff640 1 --2- 172.21.15.2:0/762886277 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff50b1fb40 0x55ff50b1e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.895+0000 7fdf1ffff640 1 -- 172.21.15.2:0/762886277 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff50a103a0 con 0x55ff50b29370 2024-09-19T06:20:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.895+0000 7fdf25ffb640 1 -- 172.21.15.2:0/1401455183 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fdf200cfe20 con 0x7fdf28106a80 2024-09-19T06:20:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.895+0000 7fdf1ffff640 1 --2- 172.21.15.2:0/762886277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff50b29370 0x55ff50b2b760 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fdf10009930 tx=0x7fdf10005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3bd935ef73a029d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.895+0000 7fdf2c84c640 1 --2- 172.21.15.2:0/1401455183 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fdf140a33b0 0x7fdf140a5870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdf2009bdd0 tx=0x7fdf20097d10 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:46.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.895+0000 7fdf1e7fc640 1 -- 172.21.15.2:0/762886277 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf10035070 con 0x55ff50b29370 2024-09-19T06:20:46.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.895+0000 7fdf1e7fc640 1 -- 172.21.15.2:0/762886277 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdf100316e0 con 0x55ff50b29370 2024-09-19T06:20:46.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.895+0000 7fdf1e7fc640 1 -- 172.21.15.2:0/762886277 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf100047a0 con 0x55ff50b29370 2024-09-19T06:20:46.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.896+0000 7fdf30688740 1 -- 172.21.15.2:0/762886277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff50b29370 msgr2=0x55ff50b2b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:46.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.896+0000 7fdf30688740 1 --2- 172.21.15.2:0/762886277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff50b29370 0x55ff50b2b760 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fdf10009930 tx=0x7fdf10005fd0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.896+0000 7fdf30688740 1 -- 172.21.15.2:0/762886277 shutdown_connections 2024-09-19T06:20:46.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.896+0000 7fdf30688740 1 --2- 172.21.15.2:0/762886277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff50b29370 0x55ff50b2b760 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.896+0000 7fdf30688740 1 --2- 172.21.15.2:0/762886277 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ff50b1e5d0 0x55ff50b1ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.896+0000 7fdf30688740 1 --2- 172.21.15.2:0/762886277 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff50b1fb40 0x55ff50b1e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.896+0000 7fdf30688740 1 -- 172.21.15.2:0/762886277 >> 172.21.15.2:0/762886277 conn(0x55ff50ae7310 msgr2=0x55ff50b1ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:46.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.896+0000 7fdf30688740 1 -- 172.21.15.2:0/762886277 shutdown_connections 2024-09-19T06:20:46.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.896+0000 7fdf30688740 1 -- 172.21.15.2:0/762886277 wait complete. 2024-09-19T06:20:46.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.897+0000 7fdf30688740 1 -- start start 2024-09-19T06:20:46.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.897+0000 7fdf30688740 1 Processor -- start 2024-09-19T06:20:46.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.897+0000 7fdf30688740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff50b1e5d0 0x55ff50b28d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.897+0000 7fdf30688740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ff50b1fb40 0x55ff50b26020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.897+0000 7fdf30688740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff50b29370 0x55ff50b26610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.897+0000 7fdf30688740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ff50b2c010 con 0x55ff50b1e5d0 2024-09-19T06:20:46.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.897+0000 7fdf30688740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55ff50a3f060 con 0x55ff50b29370 2024-09-19T06:20:46.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.897+0000 7fdf30688740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55ff50b2c190 con 0x55ff50b1fb40 2024-09-19T06:20:46.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.897+0000 7fdf30688740 10 client.0 _ll_register_callbacks cb 0x55ff507928c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:46.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.897+0000 7fdf1ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff50b1e5d0 0x55ff50b28d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.897+0000 7fdf1ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff50b1e5d0 0x55ff50b28d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54348/0 (socket says 172.21.15.2:54348) 2024-09-19T06:20:46.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.897+0000 7fdf1ffff640 1 -- 172.21.15.2:0/661178395 learned_addr learned my addr 172.21.15.2:0/661178395 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:46.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.897+0000 7fdf27fff640 1 --2- 172.21.15.2:0/661178395 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ff50b1fb40 0x55ff50b26020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.898+0000 7fdf1ffff640 1 --2- 172.21.15.2:0/661178395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff50b29370 0x55ff50b26610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.898+0000 7fdf1ffff640 1 -- 172.21.15.2:0/661178395 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ff50b1fb40 msgr2=0x55ff50b26020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:46.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.898+0000 7fdf1ffff640 1 --2- 172.21.15.2:0/661178395 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ff50b1fb40 0x55ff50b26020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.898+0000 7fdf1ffff640 1 -- 172.21.15.2:0/661178395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff50b29370 msgr2=0x55ff50b26610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:46.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.898+0000 7fdf1ffff640 1 --2- 172.21.15.2:0/661178395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff50b29370 0x55ff50b26610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.898+0000 7fdf1ffff640 1 -- 172.21.15.2:0/661178395 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff507f53c0 con 0x55ff50b1e5d0 2024-09-19T06:20:46.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.898+0000 7fdf1ffff640 1 --2- 172.21.15.2:0/661178395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff50b1e5d0 0x55ff50b28d70 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fdf10031440 tx=0x7fdf100052e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a4c96e4cb6cdba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:46.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.898+0000 7fdf077fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:46.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.898+0000 7fdf077fe640 1 -- 172.21.15.2:0/661178395 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf10050030 con 0x55ff50b1e5d0 2024-09-19T06:20:46.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.898+0000 7fdf077fe640 1 -- 172.21.15.2:0/661178395 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fdf10004250 con 0x55ff50b1e5d0 2024-09-19T06:20:46.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.898+0000 7fdf30688740 1 -- 172.21.15.2:0/661178395 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf100316e0 con 0x55ff50b1e5d0 2024-09-19T06:20:46.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.898+0000 7fdf077fe640 1 -- 172.21.15.2:0/661178395 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdf1005c050 con 0x55ff50b1e5d0 2024-09-19T06:20:46.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.898+0000 7fdf30688740 10 client.17028 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:46.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.898+0000 7fdf30688740 1 -- 172.21.15.2:0/661178395 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ff50b37ab0 con 0x55ff50b1e5d0 2024-09-19T06:20:46.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.899+0000 7fdf077fe640 1 -- 172.21.15.2:0/661178395 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdf100316e0 con 0x55ff50b1e5d0 2024-09-19T06:20:46.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.899+0000 7fdf077fe640 1 -- 172.21.15.2:0/661178395 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fdf100035f0 con 0x55ff50b1e5d0 2024-09-19T06:20:46.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.899+0000 7fdf30688740 10 client.17028 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:46.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.899+0000 7fdf30688740 10 client.17028 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:20:46.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.899+0000 7fdf30688740 20 client.17028 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:46.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.899+0000 7fdf30688740 1 --2- 172.21.15.2:0/661178395 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55ff50b38e00 0x55ff50b3b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.899+0000 7fdf30688740 4 client.17028 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:46.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.899+0000 7fdf30688740 1 -- 172.21.15.2:0/661178395 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff50a91860 con 0x55ff50b38e00 2024-09-19T06:20:46.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.899+0000 7fdf27fff640 1 --2- 172.21.15.2:0/661178395 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55ff50b38e00 0x55ff50b3b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.900+0000 7fdf077fe640 10 client.17028 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:20:46.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.900+0000 7fdf27fff640 1 --2- 172.21.15.2:0/661178395 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55ff50b38e00 0x55ff50b3b1f0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e1219bf1c687615f server_cookie=5c33a0da123db3d6 in_seq=0 out_seq=0 2024-09-19T06:20:46.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.901+0000 7fdf077fe640 1 -- 172.21.15.2:0/661178395 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ff50a91860 con 0x55ff50b38e00 2024-09-19T06:20:46.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.901+0000 7fdf077fe640 10 client.17028 handle_command_reply: tid=0 2024-09-19T06:20:46.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.901+0000 7fdf30688740 1 client.17028 shutdown 2024-09-19T06:20:46.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.901+0000 7fdf30688740 1 -- 172.21.15.2:0/661178395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff50b1e5d0 msgr2=0x55ff50b28d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:46.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.901+0000 7fdf30688740 1 --2- 172.21.15.2:0/661178395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff50b1e5d0 0x55ff50b28d70 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fdf10031440 tx=0x7fdf100052e0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.901+0000 7fdf30688740 1 -- 172.21.15.2:0/661178395 shutdown_connections 2024-09-19T06:20:46.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.901+0000 7fdf30688740 1 --2- 172.21.15.2:0/661178395 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55ff50b38e00 0x55ff50b3b1f0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.901+0000 7fdf30688740 1 --2- 172.21.15.2:0/661178395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff50b29370 0x55ff50b26610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.901+0000 7fdf077fe640 0 client.17028 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:20:46.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.901+0000 7fdf30688740 1 --2- 172.21.15.2:0/661178395 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ff50b1fb40 0x55ff50b26020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.901+0000 7fdf30688740 1 --2- 172.21.15.2:0/661178395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff50b1e5d0 0x55ff50b28d70 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.901+0000 7fdf30688740 1 -- 172.21.15.2:0/661178395 >> 172.21.15.2:0/661178395 conn(0x55ff50ae7310 msgr2=0x55ff50b20960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:46.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.901+0000 7fdf30688740 1 -- 172.21.15.2:0/661178395 shutdown_connections 2024-09-19T06:20:46.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.901+0000 7fdf30688740 1 -- 172.21.15.2:0/661178395 wait complete. 2024-09-19T06:20:46.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.901+0000 7fdf30688740 20 client.17028 trim_cache size 0 max 16384 2024-09-19T06:20:46.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.914+0000 7fdf30688740 1 Processor -- start 2024-09-19T06:20:46.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.914+0000 7fdf30688740 1 -- start start 2024-09-19T06:20:46.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.914+0000 7fdf30688740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff50b1e5d0 0x55ff50b3e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.914+0000 7fdf30688740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ff50b1fb40 0x55ff50b3e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.914+0000 7fdf30688740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff50b29370 0x55ff50b232c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.914+0000 7fdf30688740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdf281add00 con 0x55ff50b1e5d0 2024-09-19T06:20:46.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.914+0000 7fdf30688740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fdf281ab5d0 con 0x55ff50b29370 2024-09-19T06:20:46.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.914+0000 7fdf30688740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdf281a9420 con 0x55ff50b1fb40 2024-09-19T06:20:46.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.914+0000 7fdf1ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff50b1e5d0 0x55ff50b3e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.914+0000 7fdf1ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff50b1e5d0 0x55ff50b3e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54358/0 (socket says 172.21.15.2:54358) 2024-09-19T06:20:46.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.914+0000 7fdf1ffff640 1 -- 172.21.15.2:0/3492488576 learned_addr learned my addr 172.21.15.2:0/3492488576 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:46.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.915+0000 7fdf1ffff640 1 -- 172.21.15.2:0/3492488576 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ff50b1fb40 msgr2=0x55ff50b3e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:46.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.915+0000 7fdf1ffff640 1 --2- 172.21.15.2:0/3492488576 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ff50b1fb40 0x55ff50b3e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.915+0000 7fdf1ffff640 1 -- 172.21.15.2:0/3492488576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff50b29370 msgr2=0x55ff50b232c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:46.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.915+0000 7fdf1ffff640 1 --2- 172.21.15.2:0/3492488576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff50b29370 0x55ff50b232c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.915+0000 7fdf1ffff640 1 -- 172.21.15.2:0/3492488576 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff50b28990 con 0x55ff50b1e5d0 2024-09-19T06:20:46.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.915+0000 7fdf1ffff640 1 --2- 172.21.15.2:0/3492488576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff50b1e5d0 0x55ff50b3e210 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fdf10005090 tx=0x7fdf10005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63464f7a2d001557 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:46.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.915+0000 7fdf1dffb640 1 -- 172.21.15.2:0/3492488576 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf10050040 con 0x55ff50b1e5d0 2024-09-19T06:20:46.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.915+0000 7fdf1dffb640 1 -- 172.21.15.2:0/3492488576 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdf10009520 con 0x55ff50b1e5d0 2024-09-19T06:20:46.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.915+0000 7fdf1dffb640 1 -- 172.21.15.2:0/3492488576 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf10035040 con 0x55ff50b1e5d0 2024-09-19T06:20:46.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.916+0000 7fdf30688740 1 -- 172.21.15.2:0/3492488576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff50b1e5d0 msgr2=0x55ff50b3e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:46.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.916+0000 7fdf30688740 1 --2- 172.21.15.2:0/3492488576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff50b1e5d0 0x55ff50b3e210 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fdf10005090 tx=0x7fdf10005fd0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.916+0000 7fdf30688740 1 -- 172.21.15.2:0/3492488576 shutdown_connections 2024-09-19T06:20:46.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.916+0000 7fdf30688740 1 --2- 172.21.15.2:0/3492488576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff50b29370 0x55ff50b232c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.916+0000 7fdf30688740 1 --2- 172.21.15.2:0/3492488576 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ff50b1fb40 0x55ff50b3e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.916+0000 7fdf30688740 1 --2- 172.21.15.2:0/3492488576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff50b1e5d0 0x55ff50b3e210 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.916+0000 7fdf30688740 1 -- 172.21.15.2:0/3492488576 >> 172.21.15.2:0/3492488576 conn(0x55ff50ae7310 msgr2=0x55ff50b25130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:46.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.916+0000 7fdf30688740 1 -- 172.21.15.2:0/3492488576 shutdown_connections 2024-09-19T06:20:46.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.916+0000 7fdf30688740 1 -- 172.21.15.2:0/3492488576 wait complete. 2024-09-19T06:20:46.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.916+0000 7fdf30688740 1 -- start start 2024-09-19T06:20:46.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.916+0000 7fdf30688740 1 Processor -- start 2024-09-19T06:20:46.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.917+0000 7fdf30688740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ff50b1e5d0 0x55ff50b3c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.917+0000 7fdf30688740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff50b1fb40 0x55ff50b3c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.917+0000 7fdf30688740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff50b29370 0x55ff50b3caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.917+0000 7fdf30688740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdf281a9a90 con 0x55ff50b1fb40 2024-09-19T06:20:46.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.917+0000 7fdf30688740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fdf281aaf00 con 0x55ff50b29370 2024-09-19T06:20:46.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.917+0000 7fdf30688740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdf281aa160 con 0x55ff50b1e5d0 2024-09-19T06:20:46.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.917+0000 7fdf30688740 10 client.0 _ll_register_callbacks cb 0x7fdf10032f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:46.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.917+0000 7fdf27fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff50b1fb40 0x55ff50b3c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.917+0000 7fdf27fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff50b1fb40 0x55ff50b3c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54364/0 (socket says 172.21.15.2:54364) 2024-09-19T06:20:46.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.917+0000 7fdf27fff640 1 -- 172.21.15.2:0/3026082485 learned_addr learned my addr 172.21.15.2:0/3026082485 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:46.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.917+0000 7fdf1ffff640 1 --2- 172.21.15.2:0/3026082485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff50b29370 0x55ff50b3caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.917+0000 7fdf1ffff640 1 --2- 172.21.15.2:0/3026082485 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ff50b1e5d0 0x55ff50b3c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.917+0000 7fdf27fff640 1 -- 172.21.15.2:0/3026082485 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ff50b1e5d0 msgr2=0x55ff50b3c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:46.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.917+0000 7fdf27fff640 1 --2- 172.21.15.2:0/3026082485 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ff50b1e5d0 0x55ff50b3c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.917+0000 7fdf27fff640 1 -- 172.21.15.2:0/3026082485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff50b29370 msgr2=0x55ff50b3caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:46.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.917+0000 7fdf27fff640 1 --2- 172.21.15.2:0/3026082485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff50b29370 0x55ff50b3caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.917+0000 7fdf27fff640 1 -- 172.21.15.2:0/3026082485 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff50ba2790 con 0x55ff50b1fb40 2024-09-19T06:20:46.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.917+0000 7fdf27fff640 1 --2- 172.21.15.2:0/3026082485 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff50b1fb40 0x55ff50b3c560 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x55ff50b258b0 tx=0x7fdf1800acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f4a84170d24522c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:46.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.917+0000 7fdf077fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:46.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.918+0000 7fdf077fe640 1 -- 172.21.15.2:0/3026082485 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf18014520 con 0x55ff50b1fb40 2024-09-19T06:20:46.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.918+0000 7fdf30688740 1 -- 172.21.15.2:0/3026082485 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf10009520 con 0x55ff50b1fb40 2024-09-19T06:20:46.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.918+0000 7fdf077fe640 1 -- 172.21.15.2:0/3026082485 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fdf180127c0 con 0x55ff50b1fb40 2024-09-19T06:20:46.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.918+0000 7fdf077fe640 1 -- 172.21.15.2:0/3026082485 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdf180129c0 con 0x55ff50b1fb40 2024-09-19T06:20:46.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.918+0000 7fdf30688740 10 client.17034 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:46.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.918+0000 7fdf30688740 1 -- 172.21.15.2:0/3026082485 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ff50ba3ae0 con 0x55ff50b1fb40 2024-09-19T06:20:46.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.918+0000 7fdf077fe640 1 -- 172.21.15.2:0/3026082485 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdf10009520 con 0x55ff50b1fb40 2024-09-19T06:20:46.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.918+0000 7fdf077fe640 1 -- 172.21.15.2:0/3026082485 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fdf18034450 con 0x55ff50b1fb40 2024-09-19T06:20:46.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.918+0000 7fdf30688740 10 client.17034 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:46.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.918+0000 7fdf30688740 10 client.17034 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:20:46.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.918+0000 7fdf30688740 20 client.17034 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:46.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.918+0000 7fdf30688740 1 --2- 172.21.15.2:0/3026082485 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55ff50ba41f0 0x55ff50ba6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.918+0000 7fdf30688740 4 client.17034 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:20:46.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.918+0000 7fdf30688740 1 -- 172.21.15.2:0/3026082485 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ff50a8bd70 con 0x55ff50ba41f0 2024-09-19T06:20:46.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.919+0000 7fdf1ffff640 1 --2- 172.21.15.2:0/3026082485 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55ff50ba41f0 0x55ff50ba6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.919+0000 7fdf1ffff640 1 --2- 172.21.15.2:0/3026082485 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55ff50ba41f0 0x55ff50ba6610 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ed9c02990470d117 server_cookie=b2207dfa1ddf22d in_seq=0 out_seq=0 2024-09-19T06:20:46.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.919+0000 7fdf077fe640 10 client.17034 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:20:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.919+0000 7fdf077fe640 1 -- 172.21.15.2:0/3026082485 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ff50a8bd70 con 0x55ff50ba41f0 2024-09-19T06:20:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.919+0000 7fdf077fe640 10 client.17034 handle_command_reply: tid=0 2024-09-19T06:20:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.919+0000 7fdf30688740 1 client.17034 shutdown 2024-09-19T06:20:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.919+0000 7fdf30688740 1 -- 172.21.15.2:0/3026082485 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff50b1fb40 msgr2=0x55ff50b3c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.919+0000 7fdf30688740 1 --2- 172.21.15.2:0/3026082485 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff50b1fb40 0x55ff50b3c560 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x55ff50b258b0 tx=0x7fdf1800acf0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.919+0000 7fdf30688740 1 -- 172.21.15.2:0/3026082485 shutdown_connections 2024-09-19T06:20:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.919+0000 7fdf30688740 1 --2- 172.21.15.2:0/3026082485 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55ff50ba41f0 0x55ff50ba6610 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.919+0000 7fdf077fe640 0 client.17034 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:20:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.919+0000 7fdf30688740 1 --2- 172.21.15.2:0/3026082485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff50b29370 0x55ff50b3caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.919+0000 7fdf30688740 1 --2- 172.21.15.2:0/3026082485 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff50b1fb40 0x55ff50b3c560 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.919+0000 7fdf30688740 1 --2- 172.21.15.2:0/3026082485 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ff50b1e5d0 0x55ff50b3c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.919+0000 7fdf30688740 1 -- 172.21.15.2:0/3026082485 >> 172.21.15.2:0/3026082485 conn(0x55ff50ae7310 msgr2=0x55ff50b27880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.919+0000 7fdf30688740 1 -- 172.21.15.2:0/3026082485 shutdown_connections 2024-09-19T06:20:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.919+0000 7fdf30688740 1 -- 172.21.15.2:0/3026082485 wait complete. 2024-09-19T06:20:46.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.920+0000 7fdf30688740 20 client.17034 trim_cache size 0 max 16384 2024-09-19T06:20:46.927 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:20:46.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.920+0000 7fdf2e2af640 1 -- 172.21.15.2:0/1401455183 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fdf140a33b0 msgr2=0x7fdf140a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:46.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.920+0000 7fdf2e2af640 1 --2- 172.21.15.2:0/1401455183 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fdf140a33b0 0x7fdf140a5870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdf2009bdd0 tx=0x7fdf20097d10 comp rx=0 tx=0).stop 2024-09-19T06:20:46.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.920+0000 7fdf2e2af640 1 -- 172.21.15.2:0/1401455183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf28106a80 msgr2=0x7fdf2819cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.920+0000 7fdf2e2af640 1 --2- 172.21.15.2:0/1401455183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf28106a80 0x7fdf2819cbd0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fdf2000eaa0 tx=0x7fdf2000eea0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.920+0000 7fdf2e2af640 1 -- 172.21.15.2:0/1401455183 shutdown_connections 2024-09-19T06:20:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.920+0000 7fdf2e2af640 1 --2- 172.21.15.2:0/1401455183 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fdf140a33b0 0x7fdf140a5870 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.920+0000 7fdf2e2af640 1 --2- 172.21.15.2:0/1401455183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf28106a80 0x7fdf2819cbd0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.920+0000 7fdf2e2af640 1 --2- 172.21.15.2:0/1401455183 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf28101420 0x7fdf28198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.920+0000 7fdf2e2af640 1 --2- 172.21.15.2:0/1401455183 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdf28100a80 0x7fdf28198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.920+0000 7fdf2e2af640 1 -- 172.21.15.2:0/1401455183 >> 172.21.15.2:0/1401455183 conn(0x7fdf280fc7a0 msgr2=0x7fdf280fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.920+0000 7fdf2e2af640 1 -- 172.21.15.2:0/1401455183 shutdown_connections 2024-09-19T06:20:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:46.920+0000 7fdf2e2af640 1 -- 172.21.15.2:0/1401455183 wait complete. 2024-09-19T06:20:47.533 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:20:47.793 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:48.204 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:47 smithi002 ceph-mon[30982]: pgmap v182: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:20:48.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:47 smithi090 ceph-mon[34497]: pgmap v182: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:20:48.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:47 smithi089 ceph-mon[34160]: pgmap v182: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:20:48.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.287+0000 7f7916a59640 1 -- 172.21.15.2:0/2613934928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7910102570 msgr2=0x7f79101029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:48.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.287+0000 7f7916a59640 1 --2- 172.21.15.2:0/2613934928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7910102570 0x7f79101029b0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f7904009900 tx=0x7f790402a480 comp rx=0 tx=0).stop 2024-09-19T06:20:48.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.287+0000 7f7916a59640 1 -- 172.21.15.2:0/2613934928 shutdown_connections 2024-09-19T06:20:48.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.287+0000 7f7916a59640 1 --2- 172.21.15.2:0/2613934928 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7910102ef0 0x7f791010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:48.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.287+0000 7f7916a59640 1 --2- 172.21.15.2:0/2613934928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7910102570 0x7f79101029b0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:48.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.287+0000 7f7916a59640 1 --2- 172.21.15.2:0/2613934928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7910100e20 0x7f7910101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:48.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.287+0000 7f7916a59640 1 -- 172.21.15.2:0/2613934928 >> 172.21.15.2:0/2613934928 conn(0x7f79100fc7d0 msgr2=0x7f79100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:48.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.287+0000 7f7916a59640 1 -- 172.21.15.2:0/2613934928 shutdown_connections 2024-09-19T06:20:48.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.287+0000 7f7916a59640 1 -- 172.21.15.2:0/2613934928 wait complete. 2024-09-19T06:20:48.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.287+0000 7f7916a59640 1 Processor -- start 2024-09-19T06:20:48.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.287+0000 7f7916a59640 1 -- start start 2024-09-19T06:20:48.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.288+0000 7f7916a59640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7910100e20 0x7f791019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:48.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.288+0000 7f7916a59640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7910102570 0x7f791019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:48.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.288+0000 7f7916a59640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7910102ef0 0x7f791019eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:48.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.288+0000 7f7916a59640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7910110e30 con 0x7f7910100e20 2024-09-19T06:20:48.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.288+0000 7f7916a59640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7910110cb0 con 0x7f7910102ef0 2024-09-19T06:20:48.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.288+0000 7f7916a59640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7910110fb0 con 0x7f7910102570 2024-09-19T06:20:48.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.288+0000 7f790ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7910100e20 0x7f791019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:48.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.288+0000 7f790ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7910100e20 0x7f791019a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54378/0 (socket says 172.21.15.2:54378) 2024-09-19T06:20:48.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.288+0000 7f790ffff640 1 -- 172.21.15.2:0/2483849258 learned_addr learned my addr 172.21.15.2:0/2483849258 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:48.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.288+0000 7f790f7fe640 1 --2- 172.21.15.2:0/2483849258 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7910102570 0x7f791019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:48.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.288+0000 7f7914ff6640 1 --2- 172.21.15.2:0/2483849258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7910102ef0 0x7f791019eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:48.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.288+0000 7f790ffff640 1 -- 172.21.15.2:0/2483849258 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7910102570 msgr2=0x7f791019ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:48.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.288+0000 7f790ffff640 1 --2- 172.21.15.2:0/2483849258 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7910102570 0x7f791019ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:48.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.288+0000 7f790ffff640 1 -- 172.21.15.2:0/2483849258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7910102ef0 msgr2=0x7f791019eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:48.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.288+0000 7f790ffff640 1 --2- 172.21.15.2:0/2483849258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7910102ef0 0x7f791019eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:48.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.288+0000 7f790ffff640 1 -- 172.21.15.2:0/2483849258 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f791019f5b0 con 0x7f7910100e20 2024-09-19T06:20:48.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.289+0000 7f790ffff640 1 --2- 172.21.15.2:0/2483849258 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7910100e20 0x7f791019a600 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f790000d950 tx=0x7f790000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:48.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.289+0000 7f790d7fa640 1 -- 172.21.15.2:0/2483849258 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7900017070 con 0x7f7910100e20 2024-09-19T06:20:48.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.289+0000 7f7916a59640 1 -- 172.21.15.2:0/2483849258 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f791019f8a0 con 0x7f7910100e20 2024-09-19T06:20:48.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.289+0000 7f790d7fa640 1 -- 172.21.15.2:0/2483849258 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7900009c30 con 0x7f7910100e20 2024-09-19T06:20:48.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.289+0000 7f790d7fa640 1 -- 172.21.15.2:0/2483849258 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790000f620 con 0x7f7910100e20 2024-09-19T06:20:48.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.289+0000 7f7916a59640 1 -- 172.21.15.2:0/2483849258 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79101a7180 con 0x7f7910100e20 2024-09-19T06:20:48.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.292+0000 7f7918e32740 1 Processor -- start 2024-09-19T06:20:48.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.292+0000 7f7918e32740 1 -- start start 2024-09-19T06:20:48.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.292+0000 7f790d7fa640 1 -- 172.21.15.2:0/2483849258 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f79000109a0 con 0x7f7910100e20 2024-09-19T06:20:48.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.292+0000 7f7918e32740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559639a49b40 0x559639a48090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:48.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.292+0000 7f7918e32740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559639a485d0 0x559639a48a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:48.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.292+0000 7f7918e32740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559639a53370 0x559639a55760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:48.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.292+0000 7f7918e32740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5596399ae2f0 con 0x559639a53370 2024-09-19T06:20:48.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.292+0000 7f7918e32740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x559639955cf0 con 0x559639a49b40 2024-09-19T06:20:48.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.292+0000 7f7918e32740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5596399aa2b0 con 0x559639a485d0 2024-09-19T06:20:48.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.292+0000 7f790f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559639a53370 0x559639a55760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:48.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.292+0000 7f790f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559639a53370 0x559639a55760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54390/0 (socket says 172.21.15.2:54390) 2024-09-19T06:20:48.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.292+0000 7f790f7fe640 1 -- 172.21.15.2:0/893509365 learned_addr learned my addr 172.21.15.2:0/893509365 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:48.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.292+0000 7f7914ff6640 1 --2- 172.21.15.2:0/893509365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559639a49b40 0x559639a48090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:48.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.293+0000 7f790ffff640 1 --2- 172.21.15.2:0/893509365 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559639a485d0 0x559639a48a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:48.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.293+0000 7f790f7fe640 1 -- 172.21.15.2:0/893509365 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559639a485d0 msgr2=0x559639a48a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:48.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.293+0000 7f790f7fe640 1 --2- 172.21.15.2:0/893509365 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559639a485d0 0x559639a48a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:48.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.293+0000 7f790f7fe640 1 -- 172.21.15.2:0/893509365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559639a49b40 msgr2=0x559639a48090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:48.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.293+0000 7f790f7fe640 1 --2- 172.21.15.2:0/893509365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559639a49b40 0x559639a48090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:48.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.293+0000 7f790f7fe640 1 -- 172.21.15.2:0/893509365 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55963993a3a0 con 0x559639a53370 2024-09-19T06:20:48.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.293+0000 7f7914ff6640 1 --2- 172.21.15.2:0/893509365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559639a49b40 0x559639a48090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:48.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.293+0000 7f790d7fa640 1 --2- 172.21.15.2:0/2483849258 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f78f80a33b0 0x7f78f80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:48.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.293+0000 7f790f7fe640 1 --2- 172.21.15.2:0/893509365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559639a53370 0x559639a55760 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f7904009900 tx=0x7f7904005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55329c7186b0ab4c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:48.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.293+0000 7f7914ff6640 1 --2- 172.21.15.2:0/2483849258 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f78f80a33b0 0x7f78f80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:48.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.293+0000 7f790d7fa640 1 -- 172.21.15.2:0/2483849258 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f79000cf890 con 0x7f7910100e20 2024-09-19T06:20:48.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.293+0000 7f78f67fc640 1 -- 172.21.15.2:0/893509365 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7904040070 con 0x559639a53370 2024-09-19T06:20:48.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.293+0000 7f78f67fc640 1 -- 172.21.15.2:0/893509365 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7904004030 con 0x559639a53370 2024-09-19T06:20:48.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.293+0000 7f78f67fc640 1 -- 172.21.15.2:0/893509365 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7904035040 con 0x559639a53370 2024-09-19T06:20:48.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.294+0000 7f7918e32740 1 -- 172.21.15.2:0/893509365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559639a53370 msgr2=0x559639a55760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:48.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.294+0000 7f7914ff6640 1 --2- 172.21.15.2:0/2483849258 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f78f80a33b0 0x7f78f80a5870 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7908005fd0 tx=0x7f7908009500 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:48.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.294+0000 7f7918e32740 1 --2- 172.21.15.2:0/893509365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559639a53370 0x559639a55760 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f7904009900 tx=0x7f7904005c00 comp rx=0 tx=0).stop 2024-09-19T06:20:48.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.294+0000 7f7918e32740 1 -- 172.21.15.2:0/893509365 shutdown_connections 2024-09-19T06:20:48.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.294+0000 7f7918e32740 1 --2- 172.21.15.2:0/893509365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559639a53370 0x559639a55760 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:48.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.294+0000 7f7918e32740 1 --2- 172.21.15.2:0/893509365 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559639a485d0 0x559639a48a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:48.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.294+0000 7f7918e32740 1 --2- 172.21.15.2:0/893509365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559639a49b40 0x559639a48090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:48.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.294+0000 7f7918e32740 1 -- 172.21.15.2:0/893509365 >> 172.21.15.2:0/893509365 conn(0x559639a11310 msgr2=0x559639a44c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:48.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.294+0000 7f7918e32740 1 -- 172.21.15.2:0/893509365 shutdown_connections 2024-09-19T06:20:48.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.294+0000 7f7918e32740 1 -- 172.21.15.2:0/893509365 wait complete. 2024-09-19T06:20:48.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.294+0000 7f7918e32740 1 -- start start 2024-09-19T06:20:48.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.295+0000 7f7918e32740 1 Processor -- start 2024-09-19T06:20:48.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.295+0000 7f7918e32740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559639a485d0 0x559639a52d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:48.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.295+0000 7f7918e32740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559639a49b40 0x559639a4ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:48.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.295+0000 7f7918e32740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559639a53370 0x559639a50570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:48.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.295+0000 7f7918e32740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559639a56010 con 0x559639a49b40 2024-09-19T06:20:48.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.295+0000 7f7918e32740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x559639969060 con 0x559639a485d0 2024-09-19T06:20:48.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.295+0000 7f7918e32740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x559639a56190 con 0x559639a53370 2024-09-19T06:20:48.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.295+0000 7f7918e32740 10 client.0 _ll_register_callbacks cb 0x5596396bc8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:48.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.295+0000 7f790f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559639a49b40 0x559639a4ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:48.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.295+0000 7f790f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559639a49b40 0x559639a4ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54404/0 (socket says 172.21.15.2:54404) 2024-09-19T06:20:48.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.295+0000 7f790f7fe640 1 -- 172.21.15.2:0/1722787312 learned_addr learned my addr 172.21.15.2:0/1722787312 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:48.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.295+0000 7f7914ff6640 1 --2- 172.21.15.2:0/1722787312 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559639a53370 0x559639a50570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:48.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.295+0000 7f790ffff640 1 --2- 172.21.15.2:0/1722787312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559639a485d0 0x559639a52d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:48.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.295+0000 7f790f7fe640 1 -- 172.21.15.2:0/1722787312 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559639a53370 msgr2=0x559639a50570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:48.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.295+0000 7f790f7fe640 1 --2- 172.21.15.2:0/1722787312 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559639a53370 0x559639a50570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:48.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.295+0000 7f790f7fe640 1 -- 172.21.15.2:0/1722787312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559639a485d0 msgr2=0x559639a52d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:48.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.295+0000 7f790f7fe640 1 --2- 172.21.15.2:0/1722787312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559639a485d0 0x559639a52d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:48.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.295+0000 7f790f7fe640 1 -- 172.21.15.2:0/1722787312 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55963971f3c0 con 0x559639a49b40 2024-09-19T06:20:48.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.295+0000 7f790ffff640 1 --2- 172.21.15.2:0/1722787312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559639a485d0 0x559639a52d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:20:48.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.296+0000 7f790f7fe640 1 --2- 172.21.15.2:0/1722787312 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559639a49b40 0x559639a4ffd0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f7904005940 tx=0x7f7904009660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4cb15e18ee96de9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:48.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.296+0000 7f78ef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:48.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.296+0000 7f78ef7fe640 1 -- 172.21.15.2:0/1722787312 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7904052060 con 0x559639a49b40 2024-09-19T06:20:48.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.296+0000 7f78ef7fe640 1 -- 172.21.15.2:0/1722787312 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f7904005230 con 0x559639a49b40 2024-09-19T06:20:48.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.296+0000 7f7918e32740 1 -- 172.21.15.2:0/1722787312 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7904004030 con 0x559639a49b40 2024-09-19T06:20:48.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.296+0000 7f78ef7fe640 1 -- 172.21.15.2:0/1722787312 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7904040070 con 0x559639a49b40 2024-09-19T06:20:48.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.296+0000 7f7918e32740 10 client.17046 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:48.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.296+0000 7f7918e32740 1 -- 172.21.15.2:0/1722787312 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x559639a61a60 con 0x559639a49b40 2024-09-19T06:20:48.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.296+0000 7f78ef7fe640 1 -- 172.21.15.2:0/1722787312 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7904004030 con 0x559639a49b40 2024-09-19T06:20:48.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.296+0000 7f78ef7fe640 1 -- 172.21.15.2:0/1722787312 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f79040049f0 con 0x559639a49b40 2024-09-19T06:20:48.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.296+0000 7f7918e32740 10 client.17046 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:48.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.296+0000 7f7918e32740 10 client.17046 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:20:48.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.296+0000 7f7918e32740 20 client.17046 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:48.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.296+0000 7f7918e32740 1 --2- 172.21.15.2:0/1722787312 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x559639a62db0 0x559639a651a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:48.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.296+0000 7f7918e32740 4 client.17046 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:48.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.296+0000 7f7918e32740 1 -- 172.21.15.2:0/1722787312 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5596399bb860 con 0x559639a62db0 2024-09-19T06:20:48.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.297+0000 7f790ffff640 1 --2- 172.21.15.2:0/1722787312 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x559639a62db0 0x559639a651a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:48.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.297+0000 7f790ffff640 1 --2- 172.21.15.2:0/1722787312 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x559639a62db0 0x559639a651a0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b9b388d00ceac7cc server_cookie=7b350fe8c47c9afa in_seq=0 out_seq=0 2024-09-19T06:20:48.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.297+0000 7f78ef7fe640 10 client.17046 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:20:48.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.298+0000 7f78ef7fe640 1 -- 172.21.15.2:0/1722787312 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5596399bb860 con 0x559639a62db0 2024-09-19T06:20:48.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.298+0000 7f78ef7fe640 10 client.17046 handle_command_reply: tid=0 2024-09-19T06:20:48.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.298+0000 7f7918e32740 1 client.17046 shutdown 2024-09-19T06:20:48.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.298+0000 7f7918e32740 1 -- 172.21.15.2:0/1722787312 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559639a49b40 msgr2=0x559639a4ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:48.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.298+0000 7f7918e32740 1 --2- 172.21.15.2:0/1722787312 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559639a49b40 0x559639a4ffd0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f7904005940 tx=0x7f7904009660 comp rx=0 tx=0).stop 2024-09-19T06:20:48.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.298+0000 7f7918e32740 1 -- 172.21.15.2:0/1722787312 shutdown_connections 2024-09-19T06:20:48.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.298+0000 7f7918e32740 1 --2- 172.21.15.2:0/1722787312 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x559639a62db0 0x559639a651a0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:48.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.298+0000 7f78ef7fe640 0 client.17046 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:20:48.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.298+0000 7f7918e32740 1 --2- 172.21.15.2:0/1722787312 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559639a53370 0x559639a50570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:48.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.298+0000 7f7918e32740 1 --2- 172.21.15.2:0/1722787312 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559639a49b40 0x559639a4ffd0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:48.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.298+0000 7f7918e32740 1 --2- 172.21.15.2:0/1722787312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559639a485d0 0x559639a52d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:48.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.298+0000 7f7918e32740 1 -- 172.21.15.2:0/1722787312 >> 172.21.15.2:0/1722787312 conn(0x559639a11310 msgr2=0x559639a4a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:48.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.298+0000 7f7918e32740 1 -- 172.21.15.2:0/1722787312 shutdown_connections 2024-09-19T06:20:48.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.298+0000 7f7918e32740 1 -- 172.21.15.2:0/1722787312 wait complete. 2024-09-19T06:20:48.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.298+0000 7f7918e32740 20 client.17046 trim_cache size 0 max 16384 2024-09-19T06:20:48.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.311+0000 7f7918e32740 1 Processor -- start 2024-09-19T06:20:48.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.311+0000 7f7918e32740 1 -- start start 2024-09-19T06:20:48.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.312+0000 7f7918e32740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559639a485d0 0x559639a5f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:48.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.312+0000 7f7918e32740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559639a49b40 0x559639a4f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:48.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.312+0000 7f7918e32740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559639a53370 0x559639a54760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:48.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.312+0000 7f7918e32740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f79101b2100 con 0x559639a53370 2024-09-19T06:20:48.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.312+0000 7f7918e32740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f79101af9d0 con 0x559639a485d0 2024-09-19T06:20:48.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.312+0000 7f7918e32740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f79101ad820 con 0x559639a49b40 2024-09-19T06:20:48.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.312+0000 7f7914ff6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559639a53370 0x559639a54760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:48.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.312+0000 7f7914ff6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559639a53370 0x559639a54760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54412/0 (socket says 172.21.15.2:54412) 2024-09-19T06:20:48.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.312+0000 7f7914ff6640 1 -- 172.21.15.2:0/1482749994 learned_addr learned my addr 172.21.15.2:0/1482749994 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:48.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.312+0000 7f790ffff640 1 --2- 172.21.15.2:0/1482749994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559639a485d0 0x559639a5f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:48.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.312+0000 7f790f7fe640 1 --2- 172.21.15.2:0/1482749994 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559639a49b40 0x559639a4f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:48.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.312+0000 7f7914ff6640 1 -- 172.21.15.2:0/1482749994 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559639a49b40 msgr2=0x559639a4f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:48.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.312+0000 7f7914ff6640 1 --2- 172.21.15.2:0/1482749994 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559639a49b40 0x559639a4f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:48.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.312+0000 7f7914ff6640 1 -- 172.21.15.2:0/1482749994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559639a485d0 msgr2=0x559639a5f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:48.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.312+0000 7f7914ff6640 1 --2- 172.21.15.2:0/1482749994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559639a485d0 0x559639a5f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:48.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.312+0000 7f7914ff6640 1 -- 172.21.15.2:0/1482749994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559639a45df0 con 0x559639a53370 2024-09-19T06:20:48.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.312+0000 7f790ffff640 1 --2- 172.21.15.2:0/1482749994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559639a485d0 0x559639a5f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:48.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.312+0000 7f7914ff6640 1 --2- 172.21.15.2:0/1482749994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559639a53370 0x559639a54760 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f7908003c40 tx=0x7f7908017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11d39189eaa203d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:48.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.313+0000 7f78f5ffb640 1 -- 172.21.15.2:0/1482749994 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790802d070 con 0x559639a53370 2024-09-19T06:20:48.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.313+0000 7f78f5ffb640 1 -- 172.21.15.2:0/1482749994 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7908003df0 con 0x559639a53370 2024-09-19T06:20:48.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.313+0000 7f78f5ffb640 1 -- 172.21.15.2:0/1482749994 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790800fe00 con 0x559639a53370 2024-09-19T06:20:48.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.313+0000 7f7918e32740 1 -- 172.21.15.2:0/1482749994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559639a53370 msgr2=0x559639a54760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:48.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.313+0000 7f7918e32740 1 --2- 172.21.15.2:0/1482749994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559639a53370 0x559639a54760 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f7908003c40 tx=0x7f7908017000 comp rx=0 tx=0).stop 2024-09-19T06:20:48.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.313+0000 7f7918e32740 1 -- 172.21.15.2:0/1482749994 shutdown_connections 2024-09-19T06:20:48.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.313+0000 7f7918e32740 1 --2- 172.21.15.2:0/1482749994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559639a53370 0x559639a54760 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:48.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.313+0000 7f7918e32740 1 --2- 172.21.15.2:0/1482749994 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559639a49b40 0x559639a4f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:48.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.313+0000 7f7918e32740 1 --2- 172.21.15.2:0/1482749994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559639a485d0 0x559639a5f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:48.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.313+0000 7f7918e32740 1 -- 172.21.15.2:0/1482749994 >> 172.21.15.2:0/1482749994 conn(0x559639a11310 msgr2=0x559639a4e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:48.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.313+0000 7f7918e32740 1 -- 172.21.15.2:0/1482749994 shutdown_connections 2024-09-19T06:20:48.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.313+0000 7f7918e32740 1 -- 172.21.15.2:0/1482749994 wait complete. 2024-09-19T06:20:48.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.314+0000 7f7918e32740 1 -- start start 2024-09-19T06:20:48.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.314+0000 7f7918e32740 1 Processor -- start 2024-09-19T06:20:48.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.314+0000 7f7918e32740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559639a485d0 0x559639a5b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:48.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.314+0000 7f7918e32740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559639a49b40 0x559639a5b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:48.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.314+0000 7f7918e32740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559639a53370 0x559639a4c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:48.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.314+0000 7f7918e32740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f79101ade90 con 0x559639a485d0 2024-09-19T06:20:48.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.314+0000 7f7918e32740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f79101af300 con 0x559639a49b40 2024-09-19T06:20:48.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.314+0000 7f7918e32740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f79101ae560 con 0x559639a53370 2024-09-19T06:20:48.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.314+0000 7f7918e32740 10 client.0 _ll_register_callbacks cb 0x7f7904005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:48.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.314+0000 7f790ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559639a485d0 0x559639a5b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:48.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.314+0000 7f790ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559639a485d0 0x559639a5b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54428/0 (socket says 172.21.15.2:54428) 2024-09-19T06:20:48.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.314+0000 7f790ffff640 1 -- 172.21.15.2:0/4164648213 learned_addr learned my addr 172.21.15.2:0/4164648213 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:48.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.315+0000 7f790f7fe640 1 --2- 172.21.15.2:0/4164648213 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559639a49b40 0x559639a5b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:48.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.315+0000 7f7914ff6640 1 --2- 172.21.15.2:0/4164648213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559639a53370 0x559639a4c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:48.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.315+0000 7f790ffff640 1 -- 172.21.15.2:0/4164648213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559639a53370 msgr2=0x559639a4c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:48.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.315+0000 7f790ffff640 1 --2- 172.21.15.2:0/4164648213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559639a53370 0x559639a4c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:48.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.315+0000 7f790ffff640 1 -- 172.21.15.2:0/4164648213 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559639a49b40 msgr2=0x559639a5b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:48.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.315+0000 7f790ffff640 1 --2- 172.21.15.2:0/4164648213 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559639a49b40 0x559639a5b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:48.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.315+0000 7f790ffff640 1 -- 172.21.15.2:0/4164648213 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559639a5c050 con 0x559639a485d0 2024-09-19T06:20:48.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.315+0000 7f7914ff6640 1 --2- 172.21.15.2:0/4164648213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559639a53370 0x559639a4c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:48.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.315+0000 7f790ffff640 1 --2- 172.21.15.2:0/4164648213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559639a485d0 0x559639a5b420 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f79000cd0c0 tx=0x7f7900005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca865538c873ec0f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:48.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.315+0000 7f78ef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:48.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.315+0000 7f78ef7fe640 1 -- 172.21.15.2:0/4164648213 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7900020040 con 0x559639a485d0 2024-09-19T06:20:48.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.315+0000 7f78ef7fe640 1 -- 172.21.15.2:0/4164648213 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f79000982c0 con 0x559639a485d0 2024-09-19T06:20:48.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.315+0000 7f7918e32740 1 -- 172.21.15.2:0/4164648213 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7908003df0 con 0x559639a485d0 2024-09-19T06:20:48.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.315+0000 7f78ef7fe640 1 -- 172.21.15.2:0/4164648213 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f790009ff50 con 0x559639a485d0 2024-09-19T06:20:48.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.315+0000 7f7918e32740 10 client.17052 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:48.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.315+0000 7f7918e32740 1 -- 172.21.15.2:0/4164648213 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x559639a4d8b0 con 0x559639a485d0 2024-09-19T06:20:48.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.315+0000 7f78ef7fe640 1 -- 172.21.15.2:0/4164648213 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7908003df0 con 0x559639a485d0 2024-09-19T06:20:48.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.316+0000 7f78ef7fe640 1 -- 172.21.15.2:0/4164648213 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f79000979a0 con 0x559639a485d0 2024-09-19T06:20:48.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.316+0000 7f7918e32740 10 client.17052 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:48.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.316+0000 7f7918e32740 10 client.17052 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:20:48.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.316+0000 7f7918e32740 20 client.17052 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:48.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.316+0000 7f7918e32740 1 --2- 172.21.15.2:0/4164648213 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x559639a62db0 0x559639ad0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:48.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.316+0000 7f7918e32740 4 client.17052 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:20:48.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.316+0000 7f7918e32740 1 -- 172.21.15.2:0/4164648213 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5596399b5d70 con 0x559639a62db0 2024-09-19T06:20:48.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.316+0000 7f790f7fe640 1 --2- 172.21.15.2:0/4164648213 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x559639a62db0 0x559639ad0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:48.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.316+0000 7f790f7fe640 1 --2- 172.21.15.2:0/4164648213 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x559639a62db0 0x559639ad0760 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3bf5e6aa2a1ead97 server_cookie=a51dd0c87c77aa04 in_seq=0 out_seq=0 2024-09-19T06:20:48.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.316+0000 7f78ef7fe640 10 client.17052 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:20:48.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.316+0000 7f78ef7fe640 1 -- 172.21.15.2:0/4164648213 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5596399b5d70 con 0x559639a62db0 2024-09-19T06:20:48.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.316+0000 7f78ef7fe640 10 client.17052 handle_command_reply: tid=0 2024-09-19T06:20:48.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.316+0000 7f7918e32740 1 client.17052 shutdown 2024-09-19T06:20:48.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.317+0000 7f7918e32740 1 -- 172.21.15.2:0/4164648213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559639a485d0 msgr2=0x559639a5b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:48.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.317+0000 7f7918e32740 1 --2- 172.21.15.2:0/4164648213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559639a485d0 0x559639a5b420 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f79000cd0c0 tx=0x7f7900005880 comp rx=0 tx=0).stop 2024-09-19T06:20:48.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.317+0000 7f7918e32740 1 -- 172.21.15.2:0/4164648213 shutdown_connections 2024-09-19T06:20:48.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.317+0000 7f7918e32740 1 --2- 172.21.15.2:0/4164648213 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x559639a62db0 0x559639ad0760 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:48.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.317+0000 7f7918e32740 1 --2- 172.21.15.2:0/4164648213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559639a53370 0x559639a4c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:48.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.317+0000 7f7918e32740 1 --2- 172.21.15.2:0/4164648213 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559639a49b40 0x559639a5b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:48.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.317+0000 7f7918e32740 1 --2- 172.21.15.2:0/4164648213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559639a485d0 0x559639a5b420 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:48.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.317+0000 7f78ef7fe640 0 client.17052 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:20:48.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.317+0000 7f7918e32740 1 -- 172.21.15.2:0/4164648213 >> 172.21.15.2:0/4164648213 conn(0x559639a11310 msgr2=0x559639a51830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:48.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.317+0000 7f7918e32740 1 -- 172.21.15.2:0/4164648213 shutdown_connections 2024-09-19T06:20:48.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.317+0000 7f7918e32740 1 -- 172.21.15.2:0/4164648213 wait complete. 2024-09-19T06:20:48.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.317+0000 7f7918e32740 20 client.17052 trim_cache size 0 max 16384 2024-09-19T06:20:48.334 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:20:48.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.317+0000 7f7916a59640 1 -- 172.21.15.2:0/2483849258 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f78f80a33b0 msgr2=0x7f78f80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:48.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.317+0000 7f7916a59640 1 --2- 172.21.15.2:0/2483849258 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f78f80a33b0 0x7f78f80a5870 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7908005fd0 tx=0x7f7908009500 comp rx=0 tx=0).stop 2024-09-19T06:20:48.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.317+0000 7f7916a59640 1 -- 172.21.15.2:0/2483849258 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7910100e20 msgr2=0x7f791019a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:48.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.317+0000 7f7916a59640 1 --2- 172.21.15.2:0/2483849258 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7910100e20 0x7f791019a600 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f790000d950 tx=0x7f790000de10 comp rx=0 tx=0).stop 2024-09-19T06:20:48.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.317+0000 7f7916a59640 1 -- 172.21.15.2:0/2483849258 shutdown_connections 2024-09-19T06:20:48.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.318+0000 7f7916a59640 1 --2- 172.21.15.2:0/2483849258 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f78f80a33b0 0x7f78f80a5870 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:48.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.318+0000 7f7916a59640 1 --2- 172.21.15.2:0/2483849258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7910102ef0 0x7f791019eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:48.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.318+0000 7f7916a59640 1 --2- 172.21.15.2:0/2483849258 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7910102570 0x7f791019ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:48.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.318+0000 7f7916a59640 1 --2- 172.21.15.2:0/2483849258 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7910100e20 0x7f791019a600 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:48.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.318+0000 7f7916a59640 1 -- 172.21.15.2:0/2483849258 >> 172.21.15.2:0/2483849258 conn(0x7f79100fc7d0 msgr2=0x7f791006a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:48.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.318+0000 7f7916a59640 1 -- 172.21.15.2:0/2483849258 shutdown_connections 2024-09-19T06:20:48.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:48.318+0000 7f7916a59640 1 -- 172.21.15.2:0/2483849258 wait complete. 2024-09-19T06:20:49.005 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:20:49.262 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:49.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.718+0000 7f83bbb4b640 1 -- 172.21.15.2:0/3152401469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83b4100e20 msgr2=0x7f83b4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:49.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.718+0000 7f83bbb4b640 1 --2- 172.21.15.2:0/3152401469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83b4100e20 0x7f83b4101200 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f83a4009ca0 tx=0x7f83a402a950 comp rx=0 tx=0).stop 2024-09-19T06:20:49.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.719+0000 7f83bbb4b640 1 -- 172.21.15.2:0/3152401469 shutdown_connections 2024-09-19T06:20:49.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.719+0000 7f83bbb4b640 1 --2- 172.21.15.2:0/3152401469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83b4102ef0 0x7f83b410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.719+0000 7f83bbb4b640 1 --2- 172.21.15.2:0/3152401469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83b4102570 0x7f83b41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.719+0000 7f83bbb4b640 1 --2- 172.21.15.2:0/3152401469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83b4100e20 0x7f83b4101200 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.719+0000 7f83bbb4b640 1 -- 172.21.15.2:0/3152401469 >> 172.21.15.2:0/3152401469 conn(0x7f83b40fc7d0 msgr2=0x7f83b40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:49.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.719+0000 7f83bbb4b640 1 -- 172.21.15.2:0/3152401469 shutdown_connections 2024-09-19T06:20:49.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.719+0000 7f83bbb4b640 1 -- 172.21.15.2:0/3152401469 wait complete. 2024-09-19T06:20:49.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.719+0000 7f83bbb4b640 1 Processor -- start 2024-09-19T06:20:49.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.719+0000 7f83bbb4b640 1 -- start start 2024-09-19T06:20:49.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.720+0000 7f83bbb4b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83b4100e20 0x7f83b41983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:49.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.720+0000 7f83bbb4b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83b4102570 0x7f83b4198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:49.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.720+0000 7f83bbb4b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83b4102ef0 0x7f83b419ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:49.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.720+0000 7f83bbb4b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f83b4110e50 con 0x7f83b4102ef0 2024-09-19T06:20:49.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.720+0000 7f83bbb4b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f83b4110cd0 con 0x7f83b4100e20 2024-09-19T06:20:49.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.720+0000 7f83bbb4b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f83b4110fd0 con 0x7f83b4102570 2024-09-19T06:20:49.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.720+0000 7f83ba0e8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83b4102ef0 0x7f83b419ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:49.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.720+0000 7f83ba0e8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83b4102ef0 0x7f83b419ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54448/0 (socket says 172.21.15.2:54448) 2024-09-19T06:20:49.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.720+0000 7f83ba0e8640 1 -- 172.21.15.2:0/2994564349 learned_addr learned my addr 172.21.15.2:0/2994564349 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:49.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.720+0000 7f83b98e7640 1 --2- 172.21.15.2:0/2994564349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83b4100e20 0x7f83b41983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:49.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.720+0000 7f83b90e6640 1 --2- 172.21.15.2:0/2994564349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83b4102570 0x7f83b4198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:49.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.720+0000 7f83ba0e8640 1 -- 172.21.15.2:0/2994564349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83b4102570 msgr2=0x7f83b4198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:49.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.720+0000 7f83ba0e8640 1 --2- 172.21.15.2:0/2994564349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83b4102570 0x7f83b4198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.720+0000 7f83ba0e8640 1 -- 172.21.15.2:0/2994564349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83b4100e20 msgr2=0x7f83b41983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:49.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.720+0000 7f83ba0e8640 1 --2- 172.21.15.2:0/2994564349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83b4100e20 0x7f83b41983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.720+0000 7f83ba0e8640 1 -- 172.21.15.2:0/2994564349 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83b419d390 con 0x7f83b4102ef0 2024-09-19T06:20:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.720+0000 7f83ba0e8640 1 --2- 172.21.15.2:0/2994564349 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83b4102ef0 0x7f83b419ccb0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f83ac00c970 tx=0x7f83ac00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.720+0000 7f83b2ffd640 1 -- 172.21.15.2:0/2994564349 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ac007bb0 con 0x7f83b4102ef0 2024-09-19T06:20:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.720+0000 7f83bbb4b640 1 -- 172.21.15.2:0/2994564349 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83b419d680 con 0x7f83b4102ef0 2024-09-19T06:20:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.720+0000 7f83b2ffd640 1 -- 172.21.15.2:0/2994564349 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f83ac007d50 con 0x7f83b4102ef0 2024-09-19T06:20:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.720+0000 7f83b2ffd640 1 -- 172.21.15.2:0/2994564349 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ac018700 con 0x7f83b4102ef0 2024-09-19T06:20:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.721+0000 7f83bbb4b640 1 -- 172.21.15.2:0/2994564349 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83b41a4f60 con 0x7f83b4102ef0 2024-09-19T06:20:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.723+0000 7f83b2ffd640 1 -- 172.21.15.2:0/2994564349 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f83ac00fa20 con 0x7f83b4102ef0 2024-09-19T06:20:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.723+0000 7f83bdf24740 1 Processor -- start 2024-09-19T06:20:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.723+0000 7f83bdf24740 1 -- start start 2024-09-19T06:20:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.723+0000 7f83bdf24740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b960b4b40 0x556b960b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.723+0000 7f83bdf24740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b960b35d0 0x556b960b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:49.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.723+0000 7f83bdf24740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b960be370 0x556b960c0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:49.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.723+0000 7f83bdf24740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556b960192f0 con 0x556b960be370 2024-09-19T06:20:49.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.723+0000 7f83bdf24740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x556b95fc0cf0 con 0x556b960b35d0 2024-09-19T06:20:49.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.723+0000 7f83bdf24740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556b960152b0 con 0x556b960b4b40 2024-09-19T06:20:49.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.724+0000 7f83b90e6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b960be370 0x556b960c0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:49.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.724+0000 7f83b90e6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b960be370 0x556b960c0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54464/0 (socket says 172.21.15.2:54464) 2024-09-19T06:20:49.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.724+0000 7f83b90e6640 1 -- 172.21.15.2:0/1912779120 learned_addr learned my addr 172.21.15.2:0/1912779120 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:49.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.724+0000 7f83b2ffd640 1 --2- 172.21.15.2:0/2994564349 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f839c0a33b0 0x7f839c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:49.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.724+0000 7f83b98e7640 1 --2- 172.21.15.2:0/1912779120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b960b35d0 0x556b960b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:49.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.724+0000 7f83b90e6640 1 --2- 172.21.15.2:0/1912779120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b960b4b40 0x556b960b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:49.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.724+0000 7f83ba0e8640 1 --2- 172.21.15.2:0/2994564349 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f839c0a33b0 0x7f839c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:49.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.724+0000 7f83b2ffd640 1 -- 172.21.15.2:0/2994564349 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f83ac0cfdb0 con 0x7f83b4102ef0 2024-09-19T06:20:49.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.724+0000 7f83b90e6640 1 -- 172.21.15.2:0/1912779120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b960b4b40 msgr2=0x556b960b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:49.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.724+0000 7f83b90e6640 1 --2- 172.21.15.2:0/1912779120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b960b4b40 0x556b960b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.724+0000 7f83b90e6640 1 -- 172.21.15.2:0/1912779120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b960b35d0 msgr2=0x556b960b3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:49.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.724+0000 7f83b90e6640 1 --2- 172.21.15.2:0/1912779120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b960b35d0 0x556b960b3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.724+0000 7f83b90e6640 1 -- 172.21.15.2:0/1912779120 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b95fa53a0 con 0x556b960be370 2024-09-19T06:20:49.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.724+0000 7f83b90e6640 1 --2- 172.21.15.2:0/1912779120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b960be370 0x556b960c0760 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f83a80149c0 tx=0x7f83a800c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3cd8e0169193aae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:49.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.724+0000 7f83ba0e8640 1 --2- 172.21.15.2:0/2994564349 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f839c0a33b0 0x7f839c0a5870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f83ac0cd5e0 tx=0x7f83ac0046c0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:49.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.724+0000 7f839bfff640 1 -- 172.21.15.2:0/1912779120 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a80142d0 con 0x556b960be370 2024-09-19T06:20:49.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.724+0000 7f839bfff640 1 -- 172.21.15.2:0/1912779120 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f83a800fc10 con 0x556b960be370 2024-09-19T06:20:49.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.725+0000 7f839bfff640 1 -- 172.21.15.2:0/1912779120 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a80129f0 con 0x556b960be370 2024-09-19T06:20:49.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.725+0000 7f83bdf24740 1 -- 172.21.15.2:0/1912779120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b960be370 msgr2=0x556b960c0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:49.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.725+0000 7f83bdf24740 1 --2- 172.21.15.2:0/1912779120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b960be370 0x556b960c0760 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f83a80149c0 tx=0x7f83a800c4d0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.725+0000 7f83bdf24740 1 -- 172.21.15.2:0/1912779120 shutdown_connections 2024-09-19T06:20:49.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.725+0000 7f83bdf24740 1 --2- 172.21.15.2:0/1912779120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b960be370 0x556b960c0760 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.725+0000 7f83bdf24740 1 --2- 172.21.15.2:0/1912779120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b960b35d0 0x556b960b3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.725+0000 7f83bdf24740 1 --2- 172.21.15.2:0/1912779120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b960b4b40 0x556b960b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.725+0000 7f83bdf24740 1 -- 172.21.15.2:0/1912779120 >> 172.21.15.2:0/1912779120 conn(0x556b9607c310 msgr2=0x556b960afc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:49.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.725+0000 7f83bdf24740 1 -- 172.21.15.2:0/1912779120 shutdown_connections 2024-09-19T06:20:49.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.725+0000 7f83bdf24740 1 -- 172.21.15.2:0/1912779120 wait complete. 2024-09-19T06:20:49.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.726+0000 7f83bdf24740 1 -- start start 2024-09-19T06:20:49.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.726+0000 7f83bdf24740 1 Processor -- start 2024-09-19T06:20:49.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.726+0000 7f83bdf24740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b960b35d0 0x556b960bdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:49.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.726+0000 7f83bdf24740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b960b4b40 0x556b960baff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:49.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.726+0000 7f83bdf24740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b960be370 0x556b960bb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:49.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.726+0000 7f83bdf24740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556b960c1070 con 0x556b960b35d0 2024-09-19T06:20:49.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.726+0000 7f83bdf24740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x556b95fd4060 con 0x556b960be370 2024-09-19T06:20:49.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.726+0000 7f83bdf24740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556b960c11f0 con 0x556b960b4b40 2024-09-19T06:20:49.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.726+0000 7f83bdf24740 10 client.0 _ll_register_callbacks cb 0x556b95d278c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:49.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.727+0000 7f83b90e6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b960b35d0 0x556b960bdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:49.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.727+0000 7f83b90e6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b960b35d0 0x556b960bdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54480/0 (socket says 172.21.15.2:54480) 2024-09-19T06:20:49.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.727+0000 7f83b90e6640 1 -- 172.21.15.2:0/1502119515 learned_addr learned my addr 172.21.15.2:0/1502119515 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:49.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.727+0000 7f83b90e6640 1 --2- 172.21.15.2:0/1502119515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b960be370 0x556b960bb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:49.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.727+0000 7f83b98e7640 1 --2- 172.21.15.2:0/1502119515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b960b4b40 0x556b960baff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:49.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.727+0000 7f83b90e6640 1 -- 172.21.15.2:0/1502119515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b960b4b40 msgr2=0x556b960baff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:49.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.727+0000 7f83b90e6640 1 --2- 172.21.15.2:0/1502119515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b960b4b40 0x556b960baff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.727+0000 7f83b90e6640 1 -- 172.21.15.2:0/1502119515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b960be370 msgr2=0x556b960bb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:49.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.727+0000 7f83b90e6640 1 --2- 172.21.15.2:0/1502119515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b960be370 0x556b960bb5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.727+0000 7f83b90e6640 1 -- 172.21.15.2:0/1502119515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b95d8a3c0 con 0x556b960b35d0 2024-09-19T06:20:49.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.727+0000 7f83b90e6640 1 --2- 172.21.15.2:0/1502119515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b960b35d0 0x556b960bdd40 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f83a80058c0 tx=0x7f83a8005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea8abea24babc38b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:49.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.727+0000 7f83997fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:49.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.727+0000 7f83997fa640 1 -- 172.21.15.2:0/1502119515 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a80142e0 con 0x556b960b35d0 2024-09-19T06:20:49.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.727+0000 7f83997fa640 1 -- 172.21.15.2:0/1502119515 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f83a800f760 con 0x556b960b35d0 2024-09-19T06:20:49.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.727+0000 7f83bdf24740 1 -- 172.21.15.2:0/1502119515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83a800fc10 con 0x556b960b35d0 2024-09-19T06:20:49.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.727+0000 7f83997fa640 1 -- 172.21.15.2:0/1502119515 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f83a8034050 con 0x556b960b35d0 2024-09-19T06:20:49.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.727+0000 7f83bdf24740 10 client.17064 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:49.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.727+0000 7f83bdf24740 1 -- 172.21.15.2:0/1502119515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556b960ccae0 con 0x556b960b35d0 2024-09-19T06:20:49.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.728+0000 7f83997fa640 1 -- 172.21.15.2:0/1502119515 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f83a800fc10 con 0x556b960b35d0 2024-09-19T06:20:49.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.728+0000 7f83997fa640 1 -- 172.21.15.2:0/1502119515 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f83a802d060 con 0x556b960b35d0 2024-09-19T06:20:49.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.728+0000 7f83bdf24740 10 client.17064 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:49.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.728+0000 7f83bdf24740 10 client.17064 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:49.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.728+0000 7f83bdf24740 20 client.17064 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:49.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.728+0000 7f83bdf24740 1 --2- 172.21.15.2:0/1502119515 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556b960cdee0 0x556b960d02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:49.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.728+0000 7f83bdf24740 4 client.17064 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:49.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.728+0000 7f83bdf24740 1 -- 172.21.15.2:0/1502119515 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b96026860 con 0x556b960cdee0 2024-09-19T06:20:49.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.728+0000 7f83b98e7640 1 --2- 172.21.15.2:0/1502119515 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556b960cdee0 0x556b960d02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:49.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.728+0000 7f83997fa640 10 client.17064 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:49.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.728+0000 7f83b98e7640 1 --2- 172.21.15.2:0/1502119515 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556b960cdee0 0x556b960d02d0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8850c174ba9044a server_cookie=64293ffa8fab5ce5 in_seq=0 out_seq=0 2024-09-19T06:20:49.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.729+0000 7f83997fa640 1 -- 172.21.15.2:0/1502119515 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556b96026860 con 0x556b960cdee0 2024-09-19T06:20:49.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.729+0000 7f83997fa640 10 client.17064 handle_command_reply: tid=0 2024-09-19T06:20:49.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.729+0000 7f83bdf24740 1 client.17064 shutdown 2024-09-19T06:20:49.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.729+0000 7f83bdf24740 1 -- 172.21.15.2:0/1502119515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b960b35d0 msgr2=0x556b960bdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:49.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.729+0000 7f83bdf24740 1 --2- 172.21.15.2:0/1502119515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b960b35d0 0x556b960bdd40 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f83a80058c0 tx=0x7f83a8005850 comp rx=0 tx=0).stop 2024-09-19T06:20:49.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.729+0000 7f83bdf24740 1 -- 172.21.15.2:0/1502119515 shutdown_connections 2024-09-19T06:20:49.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.729+0000 7f83bdf24740 1 --2- 172.21.15.2:0/1502119515 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556b960cdee0 0x556b960d02d0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.729+0000 7f83bdf24740 1 --2- 172.21.15.2:0/1502119515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b960be370 0x556b960bb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.729+0000 7f83bdf24740 1 --2- 172.21.15.2:0/1502119515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b960b4b40 0x556b960baff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.729+0000 7f83bdf24740 1 --2- 172.21.15.2:0/1502119515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b960b35d0 0x556b960bdd40 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.729+0000 7f83997fa640 0 client.17064 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:49.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.729+0000 7f83bdf24740 1 -- 172.21.15.2:0/1502119515 >> 172.21.15.2:0/1502119515 conn(0x556b9607c310 msgr2=0x556b960b5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:49.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.730+0000 7f83bdf24740 1 -- 172.21.15.2:0/1502119515 shutdown_connections 2024-09-19T06:20:49.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.730+0000 7f83bdf24740 1 -- 172.21.15.2:0/1502119515 wait complete. 2024-09-19T06:20:49.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.730+0000 7f83bdf24740 20 client.17064 trim_cache size 0 max 16384 2024-09-19T06:20:49.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.743+0000 7f83bdf24740 1 Processor -- start 2024-09-19T06:20:49.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.743+0000 7f83bdf24740 1 -- start start 2024-09-19T06:20:49.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.743+0000 7f83bdf24740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b960b35d0 0x556b960ca310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:49.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.743+0000 7f83bdf24740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b960b4b40 0x556b960b9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:49.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.743+0000 7f83bdf24740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b960be370 0x556b960d59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:49.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.743+0000 7f83bdf24740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f83b41aff60 con 0x556b960b35d0 2024-09-19T06:20:49.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.743+0000 7f83bdf24740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f83b41ad830 con 0x556b960b4b40 2024-09-19T06:20:49.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.743+0000 7f83bdf24740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f83b41ab680 con 0x556b960be370 2024-09-19T06:20:49.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.743+0000 7f83b90e6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b960b35d0 0x556b960ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:49.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.743+0000 7f83b90e6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b960b35d0 0x556b960ca310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54492/0 (socket says 172.21.15.2:54492) 2024-09-19T06:20:49.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.743+0000 7f83b90e6640 1 -- 172.21.15.2:0/1183196550 learned_addr learned my addr 172.21.15.2:0/1183196550 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:49.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.743+0000 7f83b98e7640 1 --2- 172.21.15.2:0/1183196550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b960b4b40 0x556b960b9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:49.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.744+0000 7f83b90e6640 1 -- 172.21.15.2:0/1183196550 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b960be370 msgr2=0x556b960d59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:49.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.744+0000 7f83b90e6640 1 --2- 172.21.15.2:0/1183196550 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b960be370 0x556b960d59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.744+0000 7f83b90e6640 1 -- 172.21.15.2:0/1183196550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b960b4b40 msgr2=0x556b960b9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:49.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.744+0000 7f83b90e6640 1 --2- 172.21.15.2:0/1183196550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b960b4b40 0x556b960b9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.744+0000 7f83b90e6640 1 -- 172.21.15.2:0/1183196550 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b960b4300 con 0x556b960b35d0 2024-09-19T06:20:49.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.744+0000 7f83b90e6640 1 --2- 172.21.15.2:0/1183196550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b960b35d0 0x556b960ca310 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f83a8000c00 tx=0x7f83a800c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20077ef39821f10a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:49.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.744+0000 7f839b7fe640 1 -- 172.21.15.2:0/1183196550 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a8023040 con 0x556b960b35d0 2024-09-19T06:20:49.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.744+0000 7f839b7fe640 1 -- 172.21.15.2:0/1183196550 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f83a800c990 con 0x556b960b35d0 2024-09-19T06:20:49.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.744+0000 7f839b7fe640 1 -- 172.21.15.2:0/1183196550 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a800fd70 con 0x556b960b35d0 2024-09-19T06:20:49.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.745+0000 7f83bdf24740 1 -- 172.21.15.2:0/1183196550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b960b35d0 msgr2=0x556b960ca310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:49.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.745+0000 7f83bdf24740 1 --2- 172.21.15.2:0/1183196550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b960b35d0 0x556b960ca310 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f83a8000c00 tx=0x7f83a800c470 comp rx=0 tx=0).stop 2024-09-19T06:20:49.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.745+0000 7f83bdf24740 1 -- 172.21.15.2:0/1183196550 shutdown_connections 2024-09-19T06:20:49.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.745+0000 7f83bdf24740 1 --2- 172.21.15.2:0/1183196550 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b960be370 0x556b960d59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.745+0000 7f83bdf24740 1 --2- 172.21.15.2:0/1183196550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b960b4b40 0x556b960b9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.745+0000 7f83bdf24740 1 --2- 172.21.15.2:0/1183196550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b960b35d0 0x556b960ca310 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.745+0000 7f83bdf24740 1 -- 172.21.15.2:0/1183196550 >> 172.21.15.2:0/1183196550 conn(0x556b9607c310 msgr2=0x556b960b98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:49.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.745+0000 7f83bdf24740 1 -- 172.21.15.2:0/1183196550 shutdown_connections 2024-09-19T06:20:49.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.745+0000 7f83bdf24740 1 -- 172.21.15.2:0/1183196550 wait complete. 2024-09-19T06:20:49.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.745+0000 7f83bdf24740 1 -- start start 2024-09-19T06:20:49.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.745+0000 7f83bdf24740 1 Processor -- start 2024-09-19T06:20:49.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.746+0000 7f83bdf24740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b960b35d0 0x556b960c6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:49.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.746+0000 7f83bdf24740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b960b4b40 0x556b960b7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:49.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.746+0000 7f83bdf24740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b960be370 0x556b960b80f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:49.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.746+0000 7f83bdf24740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f83b41abcf0 con 0x556b960b4b40 2024-09-19T06:20:49.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.746+0000 7f83bdf24740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f83b41ad160 con 0x556b960b35d0 2024-09-19T06:20:49.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.746+0000 7f83bdf24740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f83b41ac3c0 con 0x556b960be370 2024-09-19T06:20:49.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.746+0000 7f83bdf24740 10 client.0 _ll_register_callbacks cb 0x7f83a4005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:49.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.746+0000 7f83b98e7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b960b4b40 0x556b960b7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:49.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.746+0000 7f83b98e7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b960b4b40 0x556b960b7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54500/0 (socket says 172.21.15.2:54500) 2024-09-19T06:20:49.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.746+0000 7f83b98e7640 1 -- 172.21.15.2:0/3398079006 learned_addr learned my addr 172.21.15.2:0/3398079006 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:49.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.746+0000 7f83b90e6640 1 --2- 172.21.15.2:0/3398079006 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b960b35d0 0x556b960c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:49.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.746+0000 7f83b90e6640 1 --2- 172.21.15.2:0/3398079006 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b960be370 0x556b960b80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:49.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.746+0000 7f83b98e7640 1 -- 172.21.15.2:0/3398079006 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b960be370 msgr2=0x556b960b80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:49.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.746+0000 7f83b98e7640 1 --2- 172.21.15.2:0/3398079006 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b960be370 0x556b960b80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.746+0000 7f83b98e7640 1 -- 172.21.15.2:0/3398079006 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b960b35d0 msgr2=0x556b960c6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:49.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.746+0000 7f83b98e7640 1 --2- 172.21.15.2:0/3398079006 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b960b35d0 0x556b960c6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.746+0000 7f83b98e7640 1 -- 172.21.15.2:0/3398079006 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b960b86b0 con 0x556b960b4b40 2024-09-19T06:20:49.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.746+0000 7f83b90e6640 1 --2- 172.21.15.2:0/3398079006 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b960be370 0x556b960b80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:49.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.746+0000 7f83b98e7640 1 --2- 172.21.15.2:0/3398079006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b960b4b40 0x556b960b7bb0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f83a4005fe0 tx=0x7f83a4003ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f80c0d81de693e26 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:49.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.746+0000 7f83997fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:49.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.746+0000 7f83997fa640 1 -- 172.21.15.2:0/3398079006 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a4034040 con 0x556b960b4b40 2024-09-19T06:20:49.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.747+0000 7f83997fa640 1 -- 172.21.15.2:0/3398079006 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f83a4003e00 con 0x556b960b4b40 2024-09-19T06:20:49.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.747+0000 7f83bdf24740 1 -- 172.21.15.2:0/3398079006 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83a800c990 con 0x556b960b4b40 2024-09-19T06:20:49.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.747+0000 7f83997fa640 1 -- 172.21.15.2:0/3398079006 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f83a402f8c0 con 0x556b960b4b40 2024-09-19T06:20:49.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.747+0000 7f83bdf24740 10 client.17070 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:49.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.747+0000 7f83bdf24740 1 -- 172.21.15.2:0/3398079006 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556b961387f0 con 0x556b960b4b40 2024-09-19T06:20:49.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.747+0000 7f83997fa640 1 -- 172.21.15.2:0/3398079006 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f83a4004040 con 0x556b960b4b40 2024-09-19T06:20:49.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.747+0000 7f83997fa640 1 -- 172.21.15.2:0/3398079006 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f83a404f470 con 0x556b960b4b40 2024-09-19T06:20:49.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.747+0000 7f83bdf24740 10 client.17070 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:49.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.747+0000 7f83bdf24740 10 client.17070 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:49.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.747+0000 7f83bdf24740 20 client.17070 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:49.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.747+0000 7f83bdf24740 1 --2- 172.21.15.2:0/3398079006 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556b96138f50 0x556b9613b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:49.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.747+0000 7f83bdf24740 4 client.17070 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:20:49.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.747+0000 7f83bdf24740 1 -- 172.21.15.2:0/3398079006 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f83a800c990 con 0x556b96138f50 2024-09-19T06:20:49.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.747+0000 7f83b90e6640 1 --2- 172.21.15.2:0/3398079006 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556b96138f50 0x556b9613b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:49.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.748+0000 7f83b90e6640 1 --2- 172.21.15.2:0/3398079006 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556b96138f50 0x556b9613b370 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6b5bedb3136fb17 server_cookie=827a2ad7bb3efa2c in_seq=0 out_seq=0 2024-09-19T06:20:49.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.748+0000 7f83997fa640 10 client.17070 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:49.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.748+0000 7f83997fa640 1 -- 172.21.15.2:0/3398079006 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f83a800c990 con 0x556b96138f50 2024-09-19T06:20:49.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.748+0000 7f83997fa640 10 client.17070 handle_command_reply: tid=0 2024-09-19T06:20:49.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.748+0000 7f83bdf24740 1 client.17070 shutdown 2024-09-19T06:20:49.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.748+0000 7f83bdf24740 1 -- 172.21.15.2:0/3398079006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b960b4b40 msgr2=0x556b960b7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:49.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.748+0000 7f83bdf24740 1 --2- 172.21.15.2:0/3398079006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b960b4b40 0x556b960b7bb0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f83a4005fe0 tx=0x7f83a4003ad0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.748+0000 7f83bdf24740 1 -- 172.21.15.2:0/3398079006 shutdown_connections 2024-09-19T06:20:49.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.748+0000 7f83bdf24740 1 --2- 172.21.15.2:0/3398079006 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b960be370 0x556b960b80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.748+0000 7f83bdf24740 1 --2- 172.21.15.2:0/3398079006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b960b4b40 0x556b960b7bb0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.748+0000 7f83bdf24740 1 --2- 172.21.15.2:0/3398079006 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556b96138f50 0x556b9613b370 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.748+0000 7f83bdf24740 1 --2- 172.21.15.2:0/3398079006 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b960b35d0 0x556b960c6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.748+0000 7f83997fa640 0 client.17070 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:49.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.748+0000 7f83bdf24740 1 -- 172.21.15.2:0/3398079006 >> 172.21.15.2:0/3398079006 conn(0x556b9607c310 msgr2=0x556b960ba0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:49.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.748+0000 7f83bdf24740 1 -- 172.21.15.2:0/3398079006 shutdown_connections 2024-09-19T06:20:49.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.748+0000 7f83bdf24740 1 -- 172.21.15.2:0/3398079006 wait complete. 2024-09-19T06:20:49.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.749+0000 7f83bdf24740 20 client.17070 trim_cache size 0 max 16384 2024-09-19T06:20:49.757 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:20:49.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.749+0000 7f83bbb4b640 1 -- 172.21.15.2:0/2994564349 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f839c0a33b0 msgr2=0x7f839c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:49.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.749+0000 7f83bbb4b640 1 --2- 172.21.15.2:0/2994564349 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f839c0a33b0 0x7f839c0a5870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f83ac0cd5e0 tx=0x7f83ac0046c0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.749+0000 7f83bbb4b640 1 -- 172.21.15.2:0/2994564349 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83b4102ef0 msgr2=0x7f83b419ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:49.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.749+0000 7f83bbb4b640 1 --2- 172.21.15.2:0/2994564349 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83b4102ef0 0x7f83b419ccb0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f83ac00c970 tx=0x7f83ac00ce30 comp rx=0 tx=0).stop 2024-09-19T06:20:49.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.749+0000 7f83bbb4b640 1 -- 172.21.15.2:0/2994564349 shutdown_connections 2024-09-19T06:20:49.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.749+0000 7f83bbb4b640 1 --2- 172.21.15.2:0/2994564349 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f839c0a33b0 0x7f839c0a5870 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.749+0000 7f83bbb4b640 1 --2- 172.21.15.2:0/2994564349 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83b4102ef0 0x7f83b419ccb0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.749+0000 7f83bbb4b640 1 --2- 172.21.15.2:0/2994564349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83b4102570 0x7f83b4198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.749+0000 7f83bbb4b640 1 --2- 172.21.15.2:0/2994564349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83b4100e20 0x7f83b41983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.749+0000 7f83bbb4b640 1 -- 172.21.15.2:0/2994564349 >> 172.21.15.2:0/2994564349 conn(0x7f83b40fc7d0 msgr2=0x7f83b4069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:49.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.749+0000 7f83bbb4b640 1 -- 172.21.15.2:0/2994564349 shutdown_connections 2024-09-19T06:20:49.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:49.749+0000 7f83bbb4b640 1 -- 172.21.15.2:0/2994564349 wait complete. 2024-09-19T06:20:50.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:49 smithi002 ceph-mon[30982]: pgmap v183: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:20:50.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:49 smithi090 ceph-mon[34497]: pgmap v183: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:20:50.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:49 smithi089 ceph-mon[34160]: pgmap v183: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:20:51.396 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:20:51.396 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:20:51.666 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:52.114 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:51 smithi002 ceph-mon[30982]: pgmap v184: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:20:52.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.112+0000 7fa1ca554640 1 -- 172.21.15.2:0/2455954587 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1c4101de0 msgr2=0x7fa1c41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:52.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.112+0000 7fa1ca554640 1 --2- 172.21.15.2:0/2455954587 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1c4101de0 0x7fa1c41021c0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4009900 tx=0x7fa1b402a410 comp rx=0 tx=0).stop 2024-09-19T06:20:52.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.112+0000 7fa1ca554640 1 -- 172.21.15.2:0/2455954587 shutdown_connections 2024-09-19T06:20:52.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.112+0000 7fa1ca554640 1 --2- 172.21.15.2:0/2455954587 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa1c4106f10 0x7fa1c410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:52.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.112+0000 7fa1ca554640 1 --2- 172.21.15.2:0/2455954587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1c4102790 0x7fa1c41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:52.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.112+0000 7fa1ca554640 1 --2- 172.21.15.2:0/2455954587 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1c4101de0 0x7fa1c41021c0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:52.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.112+0000 7fa1ca554640 1 -- 172.21.15.2:0/2455954587 >> 172.21.15.2:0/2455954587 conn(0x7fa1c40fd8c0 msgr2=0x7fa1c40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:52.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.112+0000 7fa1ca554640 1 -- 172.21.15.2:0/2455954587 shutdown_connections 2024-09-19T06:20:52.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.112+0000 7fa1ca554640 1 -- 172.21.15.2:0/2455954587 wait complete. 2024-09-19T06:20:52.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.113+0000 7fa1ca554640 1 Processor -- start 2024-09-19T06:20:52.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.113+0000 7fa1ca554640 1 -- start start 2024-09-19T06:20:52.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.113+0000 7fa1ca554640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa1c4101de0 0x7fa1c40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:52.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.113+0000 7fa1ca554640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1c4102790 0x7fa1c4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:52.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.113+0000 7fa1ca554640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1c4106f10 0x7fa1c4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:52.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.113+0000 7fa1ca554640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c4111ec0 con 0x7fa1c4106f10 2024-09-19T06:20:52.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.113+0000 7fa1ca554640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c4111d40 con 0x7fa1c4102790 2024-09-19T06:20:52.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.113+0000 7fa1ca554640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c4112040 con 0x7fa1c4101de0 2024-09-19T06:20:52.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.114+0000 7fa1c8af1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1c4106f10 0x7fa1c4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:52.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.114+0000 7fa1c8af1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1c4106f10 0x7fa1c4074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54528/0 (socket says 172.21.15.2:54528) 2024-09-19T06:20:52.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.114+0000 7fa1c8af1640 1 -- 172.21.15.2:0/3576194644 learned_addr learned my addr 172.21.15.2:0/3576194644 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:52.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.114+0000 7fa1c37fe640 1 --2- 172.21.15.2:0/3576194644 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1c4102790 0x7fa1c4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:52.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.114+0000 7fa1c3fff640 1 --2- 172.21.15.2:0/3576194644 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa1c4101de0 0x7fa1c40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:52.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.114+0000 7fa1c8af1640 1 -- 172.21.15.2:0/3576194644 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa1c4101de0 msgr2=0x7fa1c40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:52.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.114+0000 7fa1c8af1640 1 --2- 172.21.15.2:0/3576194644 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa1c4101de0 0x7fa1c40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:52.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.114+0000 7fa1c8af1640 1 -- 172.21.15.2:0/3576194644 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1c4102790 msgr2=0x7fa1c4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:52.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.114+0000 7fa1c8af1640 1 --2- 172.21.15.2:0/3576194644 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1c4102790 0x7fa1c4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:52.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.114+0000 7fa1c8af1640 1 -- 172.21.15.2:0/3576194644 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1c41a69e0 con 0x7fa1c4106f10 2024-09-19T06:20:52.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.114+0000 7fa1c3fff640 1 --2- 172.21.15.2:0/3576194644 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa1c4101de0 0x7fa1c40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:52.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.114+0000 7fa1c8af1640 1 --2- 172.21.15.2:0/3576194644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1c4106f10 0x7fa1c4074f70 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc00b970 tx=0x7fa1bc00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:52.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.114+0000 7fa1c17fa640 1 -- 172.21.15.2:0/3576194644 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1bc019070 con 0x7fa1c4106f10 2024-09-19T06:20:52.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.114+0000 7fa1c17fa640 1 -- 172.21.15.2:0/3576194644 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa1bc014440 con 0x7fa1c4106f10 2024-09-19T06:20:52.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.114+0000 7fa1ca554640 1 -- 172.21.15.2:0/3576194644 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1c41a6cd0 con 0x7fa1c4106f10 2024-09-19T06:20:52.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.114+0000 7fa1c17fa640 1 -- 172.21.15.2:0/3576194644 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1bc0075d0 con 0x7fa1c4106f10 2024-09-19T06:20:52.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.115+0000 7fa1ca554640 1 -- 172.21.15.2:0/3576194644 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1c41a7260 con 0x7fa1c4106f10 2024-09-19T06:20:52.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.117+0000 7fa1c17fa640 1 -- 172.21.15.2:0/3576194644 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fa1bc01c070 con 0x7fa1c4106f10 2024-09-19T06:20:52.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.117+0000 7fa1cc92d740 1 Processor -- start 2024-09-19T06:20:52.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.117+0000 7fa1cc92d740 1 -- start start 2024-09-19T06:20:52.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.117+0000 7fa1cc92d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55808ba6db60 0x55808ba6df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:52.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.117+0000 7fa1cc92d740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55808ba6e480 0x55808ba78800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:52.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.117+0000 7fa1c17fa640 1 --2- 172.21.15.2:0/3576194644 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa1ac0a3430 0x7fa1ac0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:52.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.117+0000 7fa1cc92d740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55808ba78d40 0x55808ba7b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:52.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.118+0000 7fa1cc92d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55808b9d3280 con 0x55808ba6db60 2024-09-19T06:20:52.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.118+0000 7fa1cc92d740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55808b97ab10 con 0x55808ba78d40 2024-09-19T06:20:52.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.118+0000 7fa1cc92d740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55808b9cf240 con 0x55808ba6e480 2024-09-19T06:20:52.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.118+0000 7fa1c37fe640 1 --2- 172.21.15.2:0/3576194644 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa1ac0a3430 0x7fa1ac0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:52.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.118+0000 7fa1c8af1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55808ba78d40 0x55808ba7b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:52.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.118+0000 7fa1c17fa640 1 -- 172.21.15.2:0/3576194644 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fa1bc0cf090 con 0x7fa1c4106f10 2024-09-19T06:20:52.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.118+0000 7fa1c3fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55808ba6e480 0x55808ba78800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:52.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.118+0000 7fa1c3fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55808ba6e480 0x55808ba78800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:52970/0 (socket says 172.21.15.2:52970) 2024-09-19T06:20:52.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.118+0000 7fa1c3fff640 1 -- 172.21.15.2:0/3552831714 learned_addr learned my addr 172.21.15.2:0/3552831714 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:52.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.118+0000 7fa1c37fe640 1 --2- 172.21.15.2:0/3552831714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55808ba6db60 0x55808ba6df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:52.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.118+0000 7fa1c3fff640 1 -- 172.21.15.2:0/3552831714 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55808ba78d40 msgr2=0x55808ba7b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:52.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.118+0000 7fa1c3fff640 1 --2- 172.21.15.2:0/3552831714 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55808ba78d40 0x55808ba7b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:52.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.118+0000 7fa1c3fff640 1 -- 172.21.15.2:0/3552831714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55808ba6db60 msgr2=0x55808ba6df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:52.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.118+0000 7fa1c3fff640 1 --2- 172.21.15.2:0/3552831714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55808ba6db60 0x55808ba6df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:52.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.118+0000 7fa1c3fff640 1 -- 172.21.15.2:0/3552831714 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55808b9871f0 con 0x55808ba6e480 2024-09-19T06:20:52.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.118+0000 7fa1c37fe640 1 --2- 172.21.15.2:0/3552831714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55808ba6db60 0x55808ba6df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:52.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.118+0000 7fa1c37fe640 1 --2- 172.21.15.2:0/3576194644 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa1ac0a3430 0x7fa1ac0a58f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8006e10 tx=0x7fa1b8009930 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:52.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.118+0000 7fa1c3fff640 1 --2- 172.21.15.2:0/3552831714 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55808ba6e480 0x55808ba78800 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa1b402a930 tx=0x7fa1b4031e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e02ec454bc195ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:52.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.119+0000 7fa1aa7fc640 1 -- 172.21.15.2:0/3552831714 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b403f070 con 0x55808ba6e480 2024-09-19T06:20:52.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.119+0000 7fa1aa7fc640 1 -- 172.21.15.2:0/3552831714 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa1b40316a0 con 0x55808ba6e480 2024-09-19T06:20:52.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.119+0000 7fa1aa7fc640 1 -- 172.21.15.2:0/3552831714 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b4035070 con 0x55808ba6e480 2024-09-19T06:20:52.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.119+0000 7fa1cc92d740 1 -- 172.21.15.2:0/3552831714 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55808ba6e480 msgr2=0x55808ba78800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:52.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.119+0000 7fa1cc92d740 1 --2- 172.21.15.2:0/3552831714 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55808ba6e480 0x55808ba78800 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa1b402a930 tx=0x7fa1b4031e40 comp rx=0 tx=0).stop 2024-09-19T06:20:52.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.119+0000 7fa1cc92d740 1 -- 172.21.15.2:0/3552831714 shutdown_connections 2024-09-19T06:20:52.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.119+0000 7fa1cc92d740 1 --2- 172.21.15.2:0/3552831714 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55808ba78d40 0x55808ba7b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:52.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.119+0000 7fa1cc92d740 1 --2- 172.21.15.2:0/3552831714 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55808ba6e480 0x55808ba78800 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:52.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.119+0000 7fa1cc92d740 1 --2- 172.21.15.2:0/3552831714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55808ba6db60 0x55808ba6df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:52.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.119+0000 7fa1cc92d740 1 -- 172.21.15.2:0/3552831714 >> 172.21.15.2:0/3552831714 conn(0x55808ba6a0f0 msgr2=0x55808ba6a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:52.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.119+0000 7fa1cc92d740 1 -- 172.21.15.2:0/3552831714 shutdown_connections 2024-09-19T06:20:52.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.120+0000 7fa1cc92d740 1 -- 172.21.15.2:0/3552831714 wait complete. 2024-09-19T06:20:52.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.120+0000 7fa1cc92d740 1 -- start start 2024-09-19T06:20:52.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.120+0000 7fa1cc92d740 1 Processor -- start 2024-09-19T06:20:52.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.120+0000 7fa1cc92d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55808ba6db60 0x55808ba78790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:52.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.120+0000 7fa1cc92d740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55808ba6e480 0x55808ba75ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:52.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.120+0000 7fa1cc92d740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55808ba78d40 0x55808ba76270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:52.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.120+0000 7fa1cc92d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55808ba7b910 con 0x55808ba6db60 2024-09-19T06:20:52.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.120+0000 7fa1cc92d740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55808b98df10 con 0x55808ba6e480 2024-09-19T06:20:52.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.120+0000 7fa1cc92d740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55808ba7ba90 con 0x55808ba78d40 2024-09-19T06:20:52.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.120+0000 7fa1cc92d740 10 client.0 _ll_register_callbacks cb 0x55808b956a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:52.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.120+0000 7fa1c3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55808ba6db60 0x55808ba78790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:52.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.121+0000 7fa1c3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55808ba6db60 0x55808ba78790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54548/0 (socket says 172.21.15.2:54548) 2024-09-19T06:20:52.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.121+0000 7fa1c3fff640 1 -- 172.21.15.2:0/3282968709 learned_addr learned my addr 172.21.15.2:0/3282968709 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:52.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.121+0000 7fa1c37fe640 1 --2- 172.21.15.2:0/3282968709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55808ba6e480 0x55808ba75ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:52.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.121+0000 7fa1c8af1640 1 --2- 172.21.15.2:0/3282968709 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55808ba78d40 0x55808ba76270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:52.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.121+0000 7fa1c3fff640 1 -- 172.21.15.2:0/3282968709 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55808ba78d40 msgr2=0x55808ba76270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:52.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.121+0000 7fa1c3fff640 1 --2- 172.21.15.2:0/3282968709 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55808ba78d40 0x55808ba76270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:52.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.121+0000 7fa1c3fff640 1 -- 172.21.15.2:0/3282968709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55808ba6e480 msgr2=0x55808ba75ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:52.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.121+0000 7fa1c3fff640 1 --2- 172.21.15.2:0/3282968709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55808ba6e480 0x55808ba75ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:52.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.121+0000 7fa1c3fff640 1 -- 172.21.15.2:0/3282968709 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55808b7446a0 con 0x55808ba6db60 2024-09-19T06:20:52.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.121+0000 7fa1c3fff640 1 --2- 172.21.15.2:0/3282968709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55808ba6db60 0x55808ba78790 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fa1b402a9d0 tx=0x7fa1b402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3144701a4326acff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:52.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.121+0000 7fa1a37fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:52.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.121+0000 7fa1a37fe640 1 -- 172.21.15.2:0/3282968709 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b404a070 con 0x55808ba6db60 2024-09-19T06:20:52.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.121+0000 7fa1a37fe640 1 -- 172.21.15.2:0/3282968709 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fa1b4004250 con 0x55808ba6db60 2024-09-19T06:20:52.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.121+0000 7fa1cc92d740 1 -- 172.21.15.2:0/3282968709 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1b40316a0 con 0x55808ba6db60 2024-09-19T06:20:52.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.121+0000 7fa1a37fe640 1 -- 172.21.15.2:0/3282968709 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa1b4056050 con 0x55808ba6db60 2024-09-19T06:20:52.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.122+0000 7fa1cc92d740 10 client.17082 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:52.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.122+0000 7fa1cc92d740 1 -- 172.21.15.2:0/3282968709 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55808ba87410 con 0x55808ba6db60 2024-09-19T06:20:52.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.122+0000 7fa1a37fe640 1 -- 172.21.15.2:0/3282968709 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa1b40316a0 con 0x55808ba6db60 2024-09-19T06:20:52.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.122+0000 7fa1a37fe640 1 -- 172.21.15.2:0/3282968709 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fa1b4003820 con 0x55808ba6db60 2024-09-19T06:20:52.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.122+0000 7fa1cc92d740 10 client.17082 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:52.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.122+0000 7fa1cc92d740 10 client.17082 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:52.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.122+0000 7fa1cc92d740 20 client.17082 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:52.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.122+0000 7fa1cc92d740 1 --2- 172.21.15.2:0/3282968709 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55808ba88760 0x55808ba8ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:52.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.122+0000 7fa1cc92d740 4 client.17082 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:52.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.122+0000 7fa1cc92d740 1 -- 172.21.15.2:0/3282968709 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55808b9e07f0 con 0x55808ba88760 2024-09-19T06:20:52.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.122+0000 7fa1c37fe640 1 --2- 172.21.15.2:0/3282968709 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55808ba88760 0x55808ba8ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:52.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.123+0000 7fa1a37fe640 10 client.17082 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:52.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.123+0000 7fa1c37fe640 1 --2- 172.21.15.2:0/3282968709 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55808ba88760 0x55808ba8ab50 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8eb875ce259cd57c server_cookie=537d529fc3831e7d in_seq=0 out_seq=0 2024-09-19T06:20:52.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.123+0000 7fa1a37fe640 1 -- 172.21.15.2:0/3282968709 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55808b9e07f0 con 0x55808ba88760 2024-09-19T06:20:52.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.123+0000 7fa1a37fe640 10 client.17082 handle_command_reply: tid=0 2024-09-19T06:20:52.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.123+0000 7fa1cc92d740 1 client.17082 shutdown 2024-09-19T06:20:52.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.123+0000 7fa1cc92d740 1 -- 172.21.15.2:0/3282968709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55808ba6db60 msgr2=0x55808ba78790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:52.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.123+0000 7fa1cc92d740 1 --2- 172.21.15.2:0/3282968709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55808ba6db60 0x55808ba78790 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fa1b402a9d0 tx=0x7fa1b402a410 comp rx=0 tx=0).stop 2024-09-19T06:20:52.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.123+0000 7fa1cc92d740 1 -- 172.21.15.2:0/3282968709 shutdown_connections 2024-09-19T06:20:52.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.123+0000 7fa1cc92d740 1 --2- 172.21.15.2:0/3282968709 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55808ba78d40 0x55808ba76270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:52.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.123+0000 7fa1cc92d740 1 --2- 172.21.15.2:0/3282968709 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55808ba88760 0x55808ba8ab50 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:52.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.123+0000 7fa1cc92d740 1 --2- 172.21.15.2:0/3282968709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55808ba6e480 0x55808ba75ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:52.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.123+0000 7fa1cc92d740 1 --2- 172.21.15.2:0/3282968709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55808ba6db60 0x55808ba78790 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:52.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.123+0000 7fa1cc92d740 1 -- 172.21.15.2:0/3282968709 >> 172.21.15.2:0/3282968709 conn(0x55808ba6a0f0 msgr2=0x55808ba6fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:52.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.123+0000 7fa1a37fe640 0 client.17082 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:52.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.124+0000 7fa1cc92d740 1 -- 172.21.15.2:0/3282968709 shutdown_connections 2024-09-19T06:20:52.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.124+0000 7fa1cc92d740 1 -- 172.21.15.2:0/3282968709 wait complete. 2024-09-19T06:20:52.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.124+0000 7fa1cc92d740 20 client.17082 trim_cache size 0 max 16384 2024-09-19T06:20:52.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.142+0000 7fa1cc92d740 1 Processor -- start 2024-09-19T06:20:52.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.142+0000 7fa1cc92d740 1 -- start start 2024-09-19T06:20:52.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.142+0000 7fa1cc92d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55808ba6db60 0x55808ba6a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:52.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.142+0000 7fa1cc92d740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55808ba6e480 0x55808ba74ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:52.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.142+0000 7fa1cc92d740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55808ba78d40 0x55808ba90120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:52.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.142+0000 7fa1cc92d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c41b22a0 con 0x55808ba6db60 2024-09-19T06:20:52.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.142+0000 7fa1cc92d740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c41afb70 con 0x55808ba6e480 2024-09-19T06:20:52.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.142+0000 7fa1cc92d740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c41ad9c0 con 0x55808ba78d40 2024-09-19T06:20:52.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.142+0000 7fa1c3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55808ba6db60 0x55808ba6a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:52.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.142+0000 7fa1c3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55808ba6db60 0x55808ba6a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54554/0 (socket says 172.21.15.2:54554) 2024-09-19T06:20:52.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.142+0000 7fa1c3fff640 1 -- 172.21.15.2:0/3903992428 learned_addr learned my addr 172.21.15.2:0/3903992428 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:52.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.142+0000 7fa1c8af1640 1 --2- 172.21.15.2:0/3903992428 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55808ba78d40 0x55808ba90120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:52.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.142+0000 7fa1c37fe640 1 --2- 172.21.15.2:0/3903992428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55808ba6e480 0x55808ba74ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:52.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.142+0000 7fa1c3fff640 1 -- 172.21.15.2:0/3903992428 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55808ba78d40 msgr2=0x55808ba90120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:52.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.142+0000 7fa1c3fff640 1 --2- 172.21.15.2:0/3903992428 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55808ba78d40 0x55808ba90120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:52.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.142+0000 7fa1c3fff640 1 -- 172.21.15.2:0/3903992428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55808ba6e480 msgr2=0x55808ba74ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:52.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.142+0000 7fa1c3fff640 1 --2- 172.21.15.2:0/3903992428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55808ba6e480 0x55808ba74ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:52.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.142+0000 7fa1c3fff640 1 -- 172.21.15.2:0/3903992428 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55808ba65830 con 0x55808ba6db60 2024-09-19T06:20:52.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.142+0000 7fa1c37fe640 1 --2- 172.21.15.2:0/3903992428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55808ba6e480 0x55808ba74ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:52.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.142+0000 7fa1c8af1640 1 --2- 172.21.15.2:0/3903992428 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55808ba78d40 0x55808ba90120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:52.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.143+0000 7fa1c3fff640 1 --2- 172.21.15.2:0/3903992428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55808ba6db60 0x55808ba6a930 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4006010 tx=0x7fa1b40053c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=725d9c69761af08d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:52.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.143+0000 7fa1a9ffb640 1 -- 172.21.15.2:0/3903992428 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b4000e60 con 0x55808ba6db60 2024-09-19T06:20:52.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.143+0000 7fa1a9ffb640 1 -- 172.21.15.2:0/3903992428 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa1b40314a0 con 0x55808ba6db60 2024-09-19T06:20:52.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.143+0000 7fa1a9ffb640 1 -- 172.21.15.2:0/3903992428 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b4053070 con 0x55808ba6db60 2024-09-19T06:20:52.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.143+0000 7fa1cc92d740 1 -- 172.21.15.2:0/3903992428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55808ba6db60 msgr2=0x55808ba6a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:52.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.143+0000 7fa1cc92d740 1 --2- 172.21.15.2:0/3903992428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55808ba6db60 0x55808ba6a930 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4006010 tx=0x7fa1b40053c0 comp rx=0 tx=0).stop 2024-09-19T06:20:52.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.144+0000 7fa1cc92d740 1 -- 172.21.15.2:0/3903992428 shutdown_connections 2024-09-19T06:20:52.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.144+0000 7fa1cc92d740 1 --2- 172.21.15.2:0/3903992428 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55808ba78d40 0x55808ba90120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:52.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.144+0000 7fa1cc92d740 1 --2- 172.21.15.2:0/3903992428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55808ba6e480 0x55808ba74ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:52.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.144+0000 7fa1cc92d740 1 --2- 172.21.15.2:0/3903992428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55808ba6db60 0x55808ba6a930 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:52.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.144+0000 7fa1cc92d740 1 -- 172.21.15.2:0/3903992428 >> 172.21.15.2:0/3903992428 conn(0x55808ba6a0f0 msgr2=0x55808ba743b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:52.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.144+0000 7fa1cc92d740 1 -- 172.21.15.2:0/3903992428 shutdown_connections 2024-09-19T06:20:52.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.144+0000 7fa1cc92d740 1 -- 172.21.15.2:0/3903992428 wait complete. 2024-09-19T06:20:52.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.144+0000 7fa1cc92d740 1 -- start start 2024-09-19T06:20:52.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.144+0000 7fa1cc92d740 1 Processor -- start 2024-09-19T06:20:52.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.145+0000 7fa1cc92d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55808ba6db60 0x55808ba7cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:52.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.145+0000 7fa1cc92d740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55808ba6e480 0x55808ba7d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:52.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.145+0000 7fa1cc92d740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55808ba78d40 0x55808ba7d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:52.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.145+0000 7fa1cc92d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c41ae030 con 0x55808ba6db60 2024-09-19T06:20:52.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.145+0000 7fa1cc92d740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c41af4a0 con 0x55808ba6e480 2024-09-19T06:20:52.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.145+0000 7fa1cc92d740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c41ae700 con 0x55808ba78d40 2024-09-19T06:20:52.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.145+0000 7fa1cc92d740 10 client.0 _ll_register_callbacks cb 0x7fa1b8009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:52.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.145+0000 7fa1c3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55808ba6db60 0x55808ba7cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:52.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.145+0000 7fa1c3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55808ba6db60 0x55808ba7cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54558/0 (socket says 172.21.15.2:54558) 2024-09-19T06:20:52.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.145+0000 7fa1c3fff640 1 -- 172.21.15.2:0/4213425383 learned_addr learned my addr 172.21.15.2:0/4213425383 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:52.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.145+0000 7fa1c37fe640 1 --2- 172.21.15.2:0/4213425383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55808ba6e480 0x55808ba7d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:52.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.145+0000 7fa1c8af1640 1 --2- 172.21.15.2:0/4213425383 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55808ba78d40 0x55808ba7d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:52.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.145+0000 7fa1c3fff640 1 -- 172.21.15.2:0/4213425383 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55808ba78d40 msgr2=0x55808ba7d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:52.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.145+0000 7fa1c3fff640 1 --2- 172.21.15.2:0/4213425383 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55808ba78d40 0x55808ba7d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:52.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.145+0000 7fa1c3fff640 1 -- 172.21.15.2:0/4213425383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55808ba6e480 msgr2=0x55808ba7d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:52.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.145+0000 7fa1c3fff640 1 --2- 172.21.15.2:0/4213425383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55808ba6e480 0x55808ba7d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:52.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.145+0000 7fa1c3fff640 1 -- 172.21.15.2:0/4213425383 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55808ba6e2b0 con 0x55808ba6db60 2024-09-19T06:20:52.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.145+0000 7fa1c37fe640 1 --2- 172.21.15.2:0/4213425383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55808ba6e480 0x55808ba7d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:20:52.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.145+0000 7fa1c3fff640 1 --2- 172.21.15.2:0/4213425383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55808ba6db60 0x55808ba7cb90 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4031c50 tx=0x7fa1b4003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3e8c66ffed761b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:52.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.145+0000 7fa1a37fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:52.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.145+0000 7fa1a37fe640 1 -- 172.21.15.2:0/4213425383 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b4053040 con 0x55808ba6db60 2024-09-19T06:20:52.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.145+0000 7fa1a37fe640 1 -- 172.21.15.2:0/4213425383 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fa1b40035f0 con 0x55808ba6db60 2024-09-19T06:20:52.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.145+0000 7fa1cc92d740 1 -- 172.21.15.2:0/4213425383 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1b40314a0 con 0x55808ba6db60 2024-09-19T06:20:52.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.146+0000 7fa1a37fe640 1 -- 172.21.15.2:0/4213425383 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa1b406a050 con 0x55808ba6db60 2024-09-19T06:20:52.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.146+0000 7fa1cc92d740 10 client.17088 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:52.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.146+0000 7fa1cc92d740 1 -- 172.21.15.2:0/4213425383 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55808baf3360 con 0x55808ba6db60 2024-09-19T06:20:52.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.146+0000 7fa1a37fe640 1 -- 172.21.15.2:0/4213425383 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa1b40314a0 con 0x55808ba6db60 2024-09-19T06:20:52.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.146+0000 7fa1a37fe640 1 -- 172.21.15.2:0/4213425383 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fa1b40047a0 con 0x55808ba6db60 2024-09-19T06:20:52.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.146+0000 7fa1cc92d740 10 client.17088 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:52.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.146+0000 7fa1cc92d740 10 client.17088 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:52.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.146+0000 7fa1cc92d740 20 client.17088 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:52.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.146+0000 7fa1cc92d740 1 --2- 172.21.15.2:0/4213425383 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55808baf39b0 0x55808baf5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:52.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.146+0000 7fa1cc92d740 4 client.17088 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:20:52.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.146+0000 7fa1cc92d740 1 -- 172.21.15.2:0/4213425383 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55808b9dad00 con 0x55808baf39b0 2024-09-19T06:20:52.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.146+0000 7fa1c37fe640 1 --2- 172.21.15.2:0/4213425383 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55808baf39b0 0x55808baf5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:52.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.147+0000 7fa1c37fe640 1 --2- 172.21.15.2:0/4213425383 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55808baf39b0 0x55808baf5da0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e1e4562b2431ec2 server_cookie=4132c5d3d3e9b31c in_seq=0 out_seq=0 2024-09-19T06:20:52.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.147+0000 7fa1a37fe640 10 client.17088 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:52.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.148+0000 7fa1a37fe640 1 -- 172.21.15.2:0/4213425383 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55808b9dad00 con 0x55808baf39b0 2024-09-19T06:20:52.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.148+0000 7fa1a37fe640 10 client.17088 handle_command_reply: tid=0 2024-09-19T06:20:52.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.148+0000 7fa1cc92d740 1 client.17088 shutdown 2024-09-19T06:20:52.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.148+0000 7fa1cc92d740 1 -- 172.21.15.2:0/4213425383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55808ba6db60 msgr2=0x55808ba7cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:52.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.148+0000 7fa1cc92d740 1 --2- 172.21.15.2:0/4213425383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55808ba6db60 0x55808ba7cb90 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4031c50 tx=0x7fa1b4003f90 comp rx=0 tx=0).stop 2024-09-19T06:20:52.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.148+0000 7fa1cc92d740 1 -- 172.21.15.2:0/4213425383 shutdown_connections 2024-09-19T06:20:52.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.148+0000 7fa1cc92d740 1 --2- 172.21.15.2:0/4213425383 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55808ba78d40 0x55808ba7d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:52.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.148+0000 7fa1cc92d740 1 --2- 172.21.15.2:0/4213425383 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55808baf39b0 0x55808baf5da0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:52.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.148+0000 7fa1a37fe640 0 client.17088 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:52.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.148+0000 7fa1cc92d740 1 --2- 172.21.15.2:0/4213425383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55808ba6e480 0x55808ba7d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:52.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.148+0000 7fa1cc92d740 1 --2- 172.21.15.2:0/4213425383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55808ba6db60 0x55808ba7cb90 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:52.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.148+0000 7fa1cc92d740 1 -- 172.21.15.2:0/4213425383 >> 172.21.15.2:0/4213425383 conn(0x55808ba6a0f0 msgr2=0x55808ba74bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:52.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.148+0000 7fa1cc92d740 1 -- 172.21.15.2:0/4213425383 shutdown_connections 2024-09-19T06:20:52.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.148+0000 7fa1cc92d740 1 -- 172.21.15.2:0/4213425383 wait complete. 2024-09-19T06:20:52.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.148+0000 7fa1cc92d740 20 client.17088 trim_cache size 0 max 16384 2024-09-19T06:20:52.160 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:20:52.160 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T06:20:52.160 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "36590bdf-0117-4b5b-a0c8-db83d7e08c3a", 2024-09-19T06:20:52.160 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T06:20:52.160 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:20:52.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.149+0000 7fa1ca554640 1 -- 172.21.15.2:0/3576194644 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa1ac0a3430 msgr2=0x7fa1ac0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:52.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.149+0000 7fa1ca554640 1 --2- 172.21.15.2:0/3576194644 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa1ac0a3430 0x7fa1ac0a58f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8006e10 tx=0x7fa1b8009930 comp rx=0 tx=0).stop 2024-09-19T06:20:52.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.149+0000 7fa1ca554640 1 -- 172.21.15.2:0/3576194644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1c4106f10 msgr2=0x7fa1c4074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:52.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.149+0000 7fa1ca554640 1 --2- 172.21.15.2:0/3576194644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1c4106f10 0x7fa1c4074f70 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc00b970 tx=0x7fa1bc00bd70 comp rx=0 tx=0).stop 2024-09-19T06:20:52.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.149+0000 7fa1ca554640 1 -- 172.21.15.2:0/3576194644 shutdown_connections 2024-09-19T06:20:52.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.149+0000 7fa1ca554640 1 --2- 172.21.15.2:0/3576194644 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa1ac0a3430 0x7fa1ac0a58f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:52.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.149+0000 7fa1ca554640 1 --2- 172.21.15.2:0/3576194644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1c4106f10 0x7fa1c4074f70 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:52.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.149+0000 7fa1ca554640 1 --2- 172.21.15.2:0/3576194644 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1c4102790 0x7fa1c4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:52.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.149+0000 7fa1ca554640 1 --2- 172.21.15.2:0/3576194644 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa1c4101de0 0x7fa1c40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:52.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.149+0000 7fa1ca554640 1 -- 172.21.15.2:0/3576194644 >> 172.21.15.2:0/3576194644 conn(0x7fa1c40fd8c0 msgr2=0x7fa1c40fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:52.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.149+0000 7fa1ca554640 1 -- 172.21.15.2:0/3576194644 shutdown_connections 2024-09-19T06:20:52.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:52.149+0000 7fa1ca554640 1 -- 172.21.15.2:0/3576194644 wait complete. 2024-09-19T06:20:52.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:51 smithi090 ceph-mon[34497]: pgmap v184: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:20:52.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:51 smithi089 ceph-mon[34160]: pgmap v184: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:20:52.899 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:20:53.161 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:53.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.625+0000 7fc8c089b640 1 -- 172.21.15.2:0/2122115441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8bc106a80 msgr2=0x7fc8bc106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:53.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.625+0000 7fc8c089b640 1 --2- 172.21.15.2:0/2122115441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8bc106a80 0x7fc8bc106e60 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009930 tx=0x7fc8ac02a420 comp rx=0 tx=0).stop 2024-09-19T06:20:53.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.625+0000 7fc8c089b640 1 -- 172.21.15.2:0/2122115441 shutdown_connections 2024-09-19T06:20:53.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.625+0000 7fc8c089b640 1 --2- 172.21.15.2:0/2122115441 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8bc101420 0x7fc8bc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:53.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.625+0000 7fc8c089b640 1 --2- 172.21.15.2:0/2122115441 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8bc100a80 0x7fc8bc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:53.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.625+0000 7fc8c089b640 1 --2- 172.21.15.2:0/2122115441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8bc106a80 0x7fc8bc106e60 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:53.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.625+0000 7fc8c089b640 1 -- 172.21.15.2:0/2122115441 >> 172.21.15.2:0/2122115441 conn(0x7fc8bc0fc7a0 msgr2=0x7fc8bc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:53.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.625+0000 7fc8c089b640 1 -- 172.21.15.2:0/2122115441 shutdown_connections 2024-09-19T06:20:53.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.625+0000 7fc8c089b640 1 -- 172.21.15.2:0/2122115441 wait complete. 2024-09-19T06:20:53.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.626+0000 7fc8c089b640 1 Processor -- start 2024-09-19T06:20:53.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.626+0000 7fc8c089b640 1 -- start start 2024-09-19T06:20:53.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.626+0000 7fc8c089b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8bc100a80 0x7fc8bc198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:53.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.626+0000 7fc8c089b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8bc101420 0x7fc8bc1987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:53.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.626+0000 7fc8c089b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8bc106a80 0x7fc8bc19cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:53.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.626+0000 7fc8c089b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc8bc110d30 con 0x7fc8bc100a80 2024-09-19T06:20:53.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.626+0000 7fc8c089b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc8bc110bb0 con 0x7fc8bc101420 2024-09-19T06:20:53.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.626+0000 7fc8c089b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc8bc110eb0 con 0x7fc8bc106a80 2024-09-19T06:20:53.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.626+0000 7fc8ba59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8bc100a80 0x7fc8bc198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:53.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.626+0000 7fc8ba59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8bc100a80 0x7fc8bc198280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54572/0 (socket says 172.21.15.2:54572) 2024-09-19T06:20:53.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.626+0000 7fc8ba59c640 1 -- 172.21.15.2:0/472879092 learned_addr learned my addr 172.21.15.2:0/472879092 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:53.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.627+0000 7fc8b3fff640 1 --2- 172.21.15.2:0/472879092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8bc101420 0x7fc8bc1987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:53.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.627+0000 7fc8bad9d640 1 --2- 172.21.15.2:0/472879092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8bc106a80 0x7fc8bc19cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:53.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.627+0000 7fc8ba59c640 1 -- 172.21.15.2:0/472879092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8bc106a80 msgr2=0x7fc8bc19cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:53.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.627+0000 7fc8ba59c640 1 --2- 172.21.15.2:0/472879092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8bc106a80 0x7fc8bc19cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:53.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.627+0000 7fc8ba59c640 1 -- 172.21.15.2:0/472879092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8bc101420 msgr2=0x7fc8bc1987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:53.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.627+0000 7fc8ba59c640 1 --2- 172.21.15.2:0/472879092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8bc101420 0x7fc8bc1987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:53.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.627+0000 7fc8ba59c640 1 -- 172.21.15.2:0/472879092 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8bc19d230 con 0x7fc8bc100a80 2024-09-19T06:20:53.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.627+0000 7fc8bad9d640 1 --2- 172.21.15.2:0/472879092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8bc106a80 0x7fc8bc19cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:20:53.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.627+0000 7fc8ba59c640 1 --2- 172.21.15.2:0/472879092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8bc100a80 0x7fc8bc198280 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac005940 tx=0x7fc8ac0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:53.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.627+0000 7fc8b37fe640 1 -- 172.21.15.2:0/472879092 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac03f030 con 0x7fc8bc100a80 2024-09-19T06:20:53.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.627+0000 7fc8c089b640 1 -- 172.21.15.2:0/472879092 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8bc19d4c0 con 0x7fc8bc100a80 2024-09-19T06:20:53.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.627+0000 7fc8b37fe640 1 -- 172.21.15.2:0/472879092 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc8ac003cb0 con 0x7fc8bc100a80 2024-09-19T06:20:53.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.627+0000 7fc8b37fe640 1 -- 172.21.15.2:0/472879092 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac035070 con 0x7fc8bc100a80 2024-09-19T06:20:53.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.627+0000 7fc8c089b640 1 -- 172.21.15.2:0/472879092 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8bc1a4e00 con 0x7fc8bc100a80 2024-09-19T06:20:53.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.630+0000 7fc8b37fe640 1 -- 172.21.15.2:0/472879092 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fc8ac042030 con 0x7fc8bc100a80 2024-09-19T06:20:53.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.630+0000 7fc8c2c74740 1 Processor -- start 2024-09-19T06:20:53.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.630+0000 7fc8c2c74740 1 -- start start 2024-09-19T06:20:53.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.630+0000 7fc8c2c74740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d847003a0 0x560d84700780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:53.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.630+0000 7fc8c2c74740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d84700cc0 0x560d8470f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:53.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.630+0000 7fc8c2c74740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560d8470fa90 0x560d84711e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:53.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.630+0000 7fc8c2c74740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560d846662e0 con 0x560d84700cc0 2024-09-19T06:20:53.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.630+0000 7fc8c2c74740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x560d8460dce0 con 0x560d8470fa90 2024-09-19T06:20:53.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.630+0000 7fc8c2c74740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560d846622a0 con 0x560d847003a0 2024-09-19T06:20:53.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.631+0000 7fc8ba59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d84700cc0 0x560d8470f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:53.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.631+0000 7fc8ba59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d84700cc0 0x560d8470f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54586/0 (socket says 172.21.15.2:54586) 2024-09-19T06:20:53.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.631+0000 7fc8ba59c640 1 -- 172.21.15.2:0/2220058881 learned_addr learned my addr 172.21.15.2:0/2220058881 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:53.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.631+0000 7fc8b3fff640 1 --2- 172.21.15.2:0/2220058881 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560d8470fa90 0x560d84711e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:53.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.631+0000 7fc8b37fe640 1 --2- 172.21.15.2:0/472879092 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc8a80a3430 0x7fc8a80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:53.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.631+0000 7fc8bad9d640 1 --2- 172.21.15.2:0/2220058881 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d847003a0 0x560d84700780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:53.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.631+0000 7fc8bad9d640 1 --2- 172.21.15.2:0/472879092 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc8a80a3430 0x7fc8a80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:53.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.631+0000 7fc8b3fff640 1 -- 172.21.15.2:0/2220058881 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d847003a0 msgr2=0x560d84700780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:53.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.631+0000 7fc8b3fff640 1 --2- 172.21.15.2:0/2220058881 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d847003a0 0x560d84700780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:53.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.631+0000 7fc8b3fff640 1 -- 172.21.15.2:0/2220058881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d84700cc0 msgr2=0x560d8470f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:53.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.631+0000 7fc8b3fff640 1 --2- 172.21.15.2:0/2220058881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d84700cc0 0x560d8470f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:53.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.631+0000 7fc8b3fff640 1 -- 172.21.15.2:0/2220058881 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d845f2440 con 0x560d8470fa90 2024-09-19T06:20:53.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.631+0000 7fc8b37fe640 1 -- 172.21.15.2:0/472879092 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fc8ac0efea0 con 0x7fc8bc100a80 2024-09-19T06:20:53.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.631+0000 7fc8b3fff640 1 --2- 172.21.15.2:0/2220058881 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560d8470fa90 0x560d84711e80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc8a400abc0 tx=0x7fc8a400f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d10f252cae69eb4b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:53.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.632+0000 7fc8b0ff9640 1 -- 172.21.15.2:0/2220058881 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a4005220 con 0x560d8470fa90 2024-09-19T06:20:53.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.632+0000 7fc8bad9d640 1 --2- 172.21.15.2:0/472879092 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc8a80a3430 0x7fc8a80a58f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4012500 tx=0x7fc8b4005f90 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:53.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.632+0000 7fc8b0ff9640 1 -- 172.21.15.2:0/2220058881 <== mon.2 v2:172.21.15.89:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc8a4004c50 con 0x560d8470fa90 2024-09-19T06:20:53.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.632+0000 7fc8b0ff9640 1 -- 172.21.15.2:0/2220058881 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a40187d0 con 0x560d8470fa90 2024-09-19T06:20:53.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.632+0000 7fc8c2c74740 1 -- 172.21.15.2:0/2220058881 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560d8470fa90 msgr2=0x560d84711e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:53.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.632+0000 7fc8c2c74740 1 --2- 172.21.15.2:0/2220058881 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560d8470fa90 0x560d84711e80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc8a400abc0 tx=0x7fc8a400f790 comp rx=0 tx=0).stop 2024-09-19T06:20:53.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.632+0000 7fc8c2c74740 1 -- 172.21.15.2:0/2220058881 shutdown_connections 2024-09-19T06:20:53.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.632+0000 7fc8c2c74740 1 --2- 172.21.15.2:0/2220058881 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560d8470fa90 0x560d84711e80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:53.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.632+0000 7fc8c2c74740 1 --2- 172.21.15.2:0/2220058881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d84700cc0 0x560d8470f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:53.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.632+0000 7fc8c2c74740 1 --2- 172.21.15.2:0/2220058881 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d847003a0 0x560d84700780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:53.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.632+0000 7fc8c2c74740 1 -- 172.21.15.2:0/2220058881 >> 172.21.15.2:0/2220058881 conn(0x560d846fca30 msgr2=0x560d846fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:53.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.633+0000 7fc8c2c74740 1 -- 172.21.15.2:0/2220058881 shutdown_connections 2024-09-19T06:20:53.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.633+0000 7fc8c2c74740 1 -- 172.21.15.2:0/2220058881 wait complete. 2024-09-19T06:20:53.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.633+0000 7fc8c2c74740 1 -- start start 2024-09-19T06:20:53.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.633+0000 7fc8c2c74740 1 Processor -- start 2024-09-19T06:20:53.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.633+0000 7fc8c2c74740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d847003a0 0x560d8470f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:53.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.633+0000 7fc8c2c74740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560d84700cc0 0x560d8470c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:53.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.633+0000 7fc8c2c74740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d8470fa90 0x560d8470ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:53.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.633+0000 7fc8c2c74740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560d847126c0 con 0x560d8470fa90 2024-09-19T06:20:53.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.633+0000 7fc8c2c74740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x560d84621050 con 0x560d84700cc0 2024-09-19T06:20:53.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.633+0000 7fc8c2c74740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560d84712840 con 0x560d847003a0 2024-09-19T06:20:53.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.633+0000 7fc8c2c74740 10 client.0 _ll_register_callbacks cb 0x560d84661160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:53.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.633+0000 7fc8bad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d8470fa90 0x560d8470ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:53.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.633+0000 7fc8bad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d8470fa90 0x560d8470ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54600/0 (socket says 172.21.15.2:54600) 2024-09-19T06:20:53.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.633+0000 7fc8bad9d640 1 -- 172.21.15.2:0/3872200708 learned_addr learned my addr 172.21.15.2:0/3872200708 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:53.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.633+0000 7fc8ba59c640 1 --2- 172.21.15.2:0/3872200708 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d847003a0 0x560d8470f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:53.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.633+0000 7fc8b3fff640 1 --2- 172.21.15.2:0/3872200708 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560d84700cc0 0x560d8470c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:53.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.634+0000 7fc8bad9d640 1 -- 172.21.15.2:0/3872200708 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d847003a0 msgr2=0x560d8470f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:53.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.634+0000 7fc8bad9d640 1 --2- 172.21.15.2:0/3872200708 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d847003a0 0x560d8470f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:53.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.634+0000 7fc8bad9d640 1 -- 172.21.15.2:0/3872200708 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560d84700cc0 msgr2=0x560d8470c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:53.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.634+0000 7fc8bad9d640 1 --2- 172.21.15.2:0/3872200708 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560d84700cc0 0x560d8470c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:53.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.634+0000 7fc8bad9d640 1 -- 172.21.15.2:0/3872200708 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d843d73c0 con 0x560d8470fa90 2024-09-19T06:20:53.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.634+0000 7fc8bad9d640 1 --2- 172.21.15.2:0/3872200708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d8470fa90 0x560d8470ccf0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fc8b400db80 tx=0x7fc8b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ab4e8474b2a2567 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:53.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.634+0000 7fc8a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:53.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.634+0000 7fc8a1ffb640 1 -- 172.21.15.2:0/3872200708 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b401ce60 con 0x560d8470fa90 2024-09-19T06:20:53.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.634+0000 7fc8c2c74740 1 -- 172.21.15.2:0/3872200708 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8a4004c50 con 0x560d8470fa90 2024-09-19T06:20:53.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.634+0000 7fc8a1ffb640 1 -- 172.21.15.2:0/3872200708 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fc8b401d440 con 0x560d8470fa90 2024-09-19T06:20:53.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.634+0000 7fc8a1ffb640 1 -- 172.21.15.2:0/3872200708 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc8b401d680 con 0x560d8470fa90 2024-09-19T06:20:53.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.634+0000 7fc8c2c74740 10 client.17100 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:53.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.634+0000 7fc8c2c74740 1 -- 172.21.15.2:0/3872200708 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560d8471e1a0 con 0x560d8470fa90 2024-09-19T06:20:53.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.635+0000 7fc8a1ffb640 1 -- 172.21.15.2:0/3872200708 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc8a4004c50 con 0x560d8470fa90 2024-09-19T06:20:53.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.635+0000 7fc8a1ffb640 1 -- 172.21.15.2:0/3872200708 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fc8b401aa50 con 0x560d8470fa90 2024-09-19T06:20:53.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.635+0000 7fc8c2c74740 10 client.17100 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:53.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.635+0000 7fc8c2c74740 10 client.17100 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:53.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.635+0000 7fc8c2c74740 20 client.17100 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:53.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.635+0000 7fc8c2c74740 1 --2- 172.21.15.2:0/3872200708 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560d8471f5b0 0x560d84721a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:53.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.635+0000 7fc8c2c74740 4 client.17100 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:53.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.635+0000 7fc8c2c74740 1 -- 172.21.15.2:0/3872200708 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d84673850 con 0x560d8471f5b0 2024-09-19T06:20:53.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.635+0000 7fc8ba59c640 1 --2- 172.21.15.2:0/3872200708 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560d8471f5b0 0x560d84721a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:53.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.636+0000 7fc8ba59c640 1 --2- 172.21.15.2:0/3872200708 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560d8471f5b0 0x560d84721a30 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=526cb1c5f2651061 server_cookie=8dd746f7298d456f in_seq=0 out_seq=0 2024-09-19T06:20:53.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.636+0000 7fc8a1ffb640 10 client.17100 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:53.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.636+0000 7fc8a1ffb640 1 -- 172.21.15.2:0/3872200708 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560d84673850 con 0x560d8471f5b0 2024-09-19T06:20:53.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.636+0000 7fc8a1ffb640 10 client.17100 handle_command_reply: tid=0 2024-09-19T06:20:53.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.636+0000 7fc8c2c74740 1 client.17100 shutdown 2024-09-19T06:20:53.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.636+0000 7fc8c2c74740 1 -- 172.21.15.2:0/3872200708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d8470fa90 msgr2=0x560d8470ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:53.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.636+0000 7fc8c2c74740 1 --2- 172.21.15.2:0/3872200708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d8470fa90 0x560d8470ccf0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fc8b400db80 tx=0x7fc8b4004a40 comp rx=0 tx=0).stop 2024-09-19T06:20:53.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.637+0000 7fc8c2c74740 1 -- 172.21.15.2:0/3872200708 shutdown_connections 2024-09-19T06:20:53.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.637+0000 7fc8c2c74740 1 --2- 172.21.15.2:0/3872200708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d8470fa90 0x560d8470ccf0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:53.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.637+0000 7fc8c2c74740 1 --2- 172.21.15.2:0/3872200708 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560d8471f5b0 0x560d84721a30 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:53.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.637+0000 7fc8c2c74740 1 --2- 172.21.15.2:0/3872200708 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560d84700cc0 0x560d8470c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:53.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.637+0000 7fc8c2c74740 1 --2- 172.21.15.2:0/3872200708 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d847003a0 0x560d8470f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:53.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.637+0000 7fc8a1ffb640 0 client.17100 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:53.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.637+0000 7fc8c2c74740 1 -- 172.21.15.2:0/3872200708 >> 172.21.15.2:0/3872200708 conn(0x560d846fca30 msgr2=0x560d84702790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:53.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.637+0000 7fc8c2c74740 1 -- 172.21.15.2:0/3872200708 shutdown_connections 2024-09-19T06:20:53.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.637+0000 7fc8c2c74740 1 -- 172.21.15.2:0/3872200708 wait complete. 2024-09-19T06:20:53.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.637+0000 7fc8c2c74740 20 client.17100 trim_cache size 0 max 16384 2024-09-19T06:20:53.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.654+0000 7fc8c2c74740 1 Processor -- start 2024-09-19T06:20:53.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.654+0000 7fc8c2c74740 1 -- start start 2024-09-19T06:20:53.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.654+0000 7fc8c2c74740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d846fca30 0x560d8471b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:53.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.654+0000 7fc8c2c74740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560d847003a0 0x560d84727350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:53.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.654+0000 7fc8c2c74740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d84700cc0 0x560d84727890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:53.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.654+0000 7fc8c2c74740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc8bc1add30 con 0x560d846fca30 2024-09-19T06:20:53.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.654+0000 7fc8c2c74740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc8bc1ab600 con 0x560d847003a0 2024-09-19T06:20:53.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.654+0000 7fc8c2c74740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc8bc1a9450 con 0x560d84700cc0 2024-09-19T06:20:53.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.654+0000 7fc8ba59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d846fca30 0x560d8471b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:53.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.654+0000 7fc8ba59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d846fca30 0x560d8471b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54604/0 (socket says 172.21.15.2:54604) 2024-09-19T06:20:53.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.654+0000 7fc8ba59c640 1 -- 172.21.15.2:0/3279923074 learned_addr learned my addr 172.21.15.2:0/3279923074 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:53.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.654+0000 7fc8b3fff640 1 --2- 172.21.15.2:0/3279923074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560d847003a0 0x560d84727350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:53.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.655+0000 7fc8bad9d640 1 --2- 172.21.15.2:0/3279923074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d84700cc0 0x560d84727890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:53.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.655+0000 7fc8ba59c640 1 -- 172.21.15.2:0/3279923074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d84700cc0 msgr2=0x560d84727890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:53.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.655+0000 7fc8ba59c640 1 --2- 172.21.15.2:0/3279923074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d84700cc0 0x560d84727890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:53.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.655+0000 7fc8ba59c640 1 -- 172.21.15.2:0/3279923074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560d847003a0 msgr2=0x560d84727350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:53.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.655+0000 7fc8ba59c640 1 --2- 172.21.15.2:0/3279923074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560d847003a0 0x560d84727350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:53.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.655+0000 7fc8ba59c640 1 -- 172.21.15.2:0/3279923074 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d8470f7e0 con 0x560d846fca30 2024-09-19T06:20:53.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.655+0000 7fc8ba59c640 1 --2- 172.21.15.2:0/3279923074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d846fca30 0x560d8471b960 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac0f3650 tx=0x7fc8ac0b8580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=910b65194209a632 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:53.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.655+0000 7fc8a3fff640 1 -- 172.21.15.2:0/3279923074 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac049040 con 0x560d846fca30 2024-09-19T06:20:53.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.655+0000 7fc8a3fff640 1 -- 172.21.15.2:0/3279923074 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc8ac0bc8b0 con 0x560d846fca30 2024-09-19T06:20:53.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.655+0000 7fc8a3fff640 1 -- 172.21.15.2:0/3279923074 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac03b460 con 0x560d846fca30 2024-09-19T06:20:53.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.656+0000 7fc8c2c74740 1 -- 172.21.15.2:0/3279923074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d846fca30 msgr2=0x560d8471b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:53.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.656+0000 7fc8c2c74740 1 --2- 172.21.15.2:0/3279923074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d846fca30 0x560d8471b960 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac0f3650 tx=0x7fc8ac0b8580 comp rx=0 tx=0).stop 2024-09-19T06:20:53.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.656+0000 7fc8c2c74740 1 -- 172.21.15.2:0/3279923074 shutdown_connections 2024-09-19T06:20:53.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.656+0000 7fc8c2c74740 1 --2- 172.21.15.2:0/3279923074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d84700cc0 0x560d84727890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:53.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.656+0000 7fc8c2c74740 1 --2- 172.21.15.2:0/3279923074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560d847003a0 0x560d84727350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:53.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.656+0000 7fc8c2c74740 1 --2- 172.21.15.2:0/3279923074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d846fca30 0x560d8471b960 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:53.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.656+0000 7fc8c2c74740 1 -- 172.21.15.2:0/3279923074 >> 172.21.15.2:0/3279923074 conn(0x560d84708110 msgr2=0x560d8470aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:53.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.656+0000 7fc8c2c74740 1 -- 172.21.15.2:0/3279923074 shutdown_connections 2024-09-19T06:20:53.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.656+0000 7fc8c2c74740 1 -- 172.21.15.2:0/3279923074 wait complete. 2024-09-19T06:20:53.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.656+0000 7fc8c2c74740 1 -- start start 2024-09-19T06:20:53.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.656+0000 7fc8c2c74740 1 Processor -- start 2024-09-19T06:20:53.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.656+0000 7fc8c2c74740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d846fca30 0x560d847182f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:53.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.656+0000 7fc8c2c74740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d847003a0 0x560d84713620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:53.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.656+0000 7fc8c2c74740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560d84700cc0 0x560d84713bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:53.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.656+0000 7fc8c2c74740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc8bc1a9ac0 con 0x560d847003a0 2024-09-19T06:20:53.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.656+0000 7fc8c2c74740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc8bc1aaf30 con 0x560d84700cc0 2024-09-19T06:20:53.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.656+0000 7fc8c2c74740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc8bc1aa190 con 0x560d846fca30 2024-09-19T06:20:53.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.656+0000 7fc8c2c74740 10 client.0 _ll_register_callbacks cb 0x7fc8b400a9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:53.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.656+0000 7fc8b3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d847003a0 0x560d84713620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:53.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.657+0000 7fc8b3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d847003a0 0x560d84713620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54612/0 (socket says 172.21.15.2:54612) 2024-09-19T06:20:53.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.657+0000 7fc8b3fff640 1 -- 172.21.15.2:0/3373829692 learned_addr learned my addr 172.21.15.2:0/3373829692 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:53.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.657+0000 7fc8bad9d640 1 --2- 172.21.15.2:0/3373829692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560d84700cc0 0x560d84713bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:53.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.657+0000 7fc8ba59c640 1 --2- 172.21.15.2:0/3373829692 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d846fca30 0x560d847182f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:53.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.657+0000 7fc8b3fff640 1 -- 172.21.15.2:0/3373829692 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d846fca30 msgr2=0x560d847182f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:53.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.657+0000 7fc8b3fff640 1 --2- 172.21.15.2:0/3373829692 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d846fca30 0x560d847182f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:53.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.657+0000 7fc8b3fff640 1 -- 172.21.15.2:0/3373829692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560d84700cc0 msgr2=0x560d84713bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:53.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.657+0000 7fc8b3fff640 1 --2- 172.21.15.2:0/3373829692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560d84700cc0 0x560d84713bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:53.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.657+0000 7fc8b3fff640 1 -- 172.21.15.2:0/3373829692 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d847143f0 con 0x560d847003a0 2024-09-19T06:20:53.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.657+0000 7fc8b3fff640 1 --2- 172.21.15.2:0/3373829692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d847003a0 0x560d84713620 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fc8a400a6b0 tx=0x7fc8a4005820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa4fabce7ff51114 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:53.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.657+0000 7fc8a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:53.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.657+0000 7fc8a1ffb640 1 -- 172.21.15.2:0/3373829692 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a4004660 con 0x560d847003a0 2024-09-19T06:20:53.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.657+0000 7fc8a1ffb640 1 -- 172.21.15.2:0/3373829692 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fc8a4004800 con 0x560d847003a0 2024-09-19T06:20:53.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.657+0000 7fc8c2c74740 1 -- 172.21.15.2:0/3373829692 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8ac0bc8b0 con 0x560d847003a0 2024-09-19T06:20:53.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.657+0000 7fc8a1ffb640 1 -- 172.21.15.2:0/3373829692 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc8a4004a00 con 0x560d847003a0 2024-09-19T06:20:53.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.657+0000 7fc8c2c74740 10 client.17106 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:53.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.657+0000 7fc8c2c74740 1 -- 172.21.15.2:0/3373829692 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560d8478a400 con 0x560d847003a0 2024-09-19T06:20:53.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.658+0000 7fc8a1ffb640 1 -- 172.21.15.2:0/3373829692 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc8ac0bc8b0 con 0x560d847003a0 2024-09-19T06:20:53.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.658+0000 7fc8a1ffb640 1 -- 172.21.15.2:0/3373829692 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fc8a4018ca0 con 0x560d847003a0 2024-09-19T06:20:53.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.658+0000 7fc8c2c74740 10 client.17106 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:53.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.658+0000 7fc8c2c74740 10 client.17106 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:53.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.658+0000 7fc8c2c74740 20 client.17106 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:53.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.658+0000 7fc8c2c74740 1 --2- 172.21.15.2:0/3373829692 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560d8470fa90 0x560d8478ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:53.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.658+0000 7fc8c2c74740 4 client.17106 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:20:53.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.658+0000 7fc8c2c74740 1 -- 172.21.15.2:0/3373829692 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560d8466dd60 con 0x560d8470fa90 2024-09-19T06:20:53.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.658+0000 7fc8ba59c640 1 --2- 172.21.15.2:0/3373829692 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560d8470fa90 0x560d8478ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:53.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.658+0000 7fc8a1ffb640 10 client.17106 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:53.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.658+0000 7fc8ba59c640 1 --2- 172.21.15.2:0/3373829692 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560d8470fa90 0x560d8478ca00 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2febdf920d970aa8 server_cookie=b769f6debdf842ca in_seq=0 out_seq=0 2024-09-19T06:20:53.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.659+0000 7fc8a1ffb640 1 -- 172.21.15.2:0/3373829692 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x560d8466dd60 con 0x560d8470fa90 2024-09-19T06:20:53.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.659+0000 7fc8a1ffb640 10 client.17106 handle_command_reply: tid=0 2024-09-19T06:20:53.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.659+0000 7fc8c2c74740 1 client.17106 shutdown 2024-09-19T06:20:53.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.659+0000 7fc8c2c74740 1 -- 172.21.15.2:0/3373829692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d847003a0 msgr2=0x560d84713620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:53.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.659+0000 7fc8c2c74740 1 --2- 172.21.15.2:0/3373829692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d847003a0 0x560d84713620 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fc8a400a6b0 tx=0x7fc8a4005820 comp rx=0 tx=0).stop 2024-09-19T06:20:53.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.659+0000 7fc8c2c74740 1 -- 172.21.15.2:0/3373829692 shutdown_connections 2024-09-19T06:20:53.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.659+0000 7fc8c2c74740 1 --2- 172.21.15.2:0/3373829692 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560d8470fa90 0x560d8478ca00 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:53.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.659+0000 7fc8c2c74740 1 --2- 172.21.15.2:0/3373829692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560d84700cc0 0x560d84713bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:53.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.659+0000 7fc8c2c74740 1 --2- 172.21.15.2:0/3373829692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560d847003a0 0x560d84713620 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:53.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.659+0000 7fc8c2c74740 1 --2- 172.21.15.2:0/3373829692 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560d846fca30 0x560d847182f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:53.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.659+0000 7fc8c2c74740 1 -- 172.21.15.2:0/3373829692 >> 172.21.15.2:0/3373829692 conn(0x560d84708110 msgr2=0x560d84701f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:53.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.659+0000 7fc8a1ffb640 0 client.17106 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:53.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.659+0000 7fc8c2c74740 1 -- 172.21.15.2:0/3373829692 shutdown_connections 2024-09-19T06:20:53.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.659+0000 7fc8c2c74740 1 -- 172.21.15.2:0/3373829692 wait complete. 2024-09-19T06:20:53.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.659+0000 7fc8c2c74740 20 client.17106 trim_cache size 0 max 16384 2024-09-19T06:20:53.668 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:20:53.668 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T06:20:53.668 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T06:20:53.668 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:20:53.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.660+0000 7fc8c089b640 1 -- 172.21.15.2:0/472879092 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc8a80a3430 msgr2=0x7fc8a80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:53.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.660+0000 7fc8c089b640 1 --2- 172.21.15.2:0/472879092 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc8a80a3430 0x7fc8a80a58f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4012500 tx=0x7fc8b4005f90 comp rx=0 tx=0).stop 2024-09-19T06:20:53.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.660+0000 7fc8c089b640 1 -- 172.21.15.2:0/472879092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8bc100a80 msgr2=0x7fc8bc198280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:53.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.660+0000 7fc8c089b640 1 --2- 172.21.15.2:0/472879092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8bc100a80 0x7fc8bc198280 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac005940 tx=0x7fc8ac0042f0 comp rx=0 tx=0).stop 2024-09-19T06:20:53.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.660+0000 7fc8c089b640 1 -- 172.21.15.2:0/472879092 shutdown_connections 2024-09-19T06:20:53.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.660+0000 7fc8c089b640 1 --2- 172.21.15.2:0/472879092 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc8a80a3430 0x7fc8a80a58f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:53.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.660+0000 7fc8c089b640 1 --2- 172.21.15.2:0/472879092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8bc106a80 0x7fc8bc19cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:53.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.660+0000 7fc8c089b640 1 --2- 172.21.15.2:0/472879092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8bc101420 0x7fc8bc1987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:53.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.660+0000 7fc8c089b640 1 --2- 172.21.15.2:0/472879092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8bc100a80 0x7fc8bc198280 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:53.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.660+0000 7fc8c089b640 1 -- 172.21.15.2:0/472879092 >> 172.21.15.2:0/472879092 conn(0x7fc8bc0fc7a0 msgr2=0x7fc8bc104bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:53.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.660+0000 7fc8c089b640 1 -- 172.21.15.2:0/472879092 shutdown_connections 2024-09-19T06:20:53.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:53.660+0000 7fc8c089b640 1 -- 172.21.15.2:0/472879092 wait complete. 2024-09-19T06:20:54.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:53 smithi090 ceph-mon[34497]: scrub queued for path: / 2024-09-19T06:20:54.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:53 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:54.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:53 smithi090 ceph-mon[34497]: scrub summary: active paths [/] 2024-09-19T06:20:54.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:53 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:54.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:53 smithi090 ceph-mon[34497]: pgmap v185: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:20:54.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:53 smithi090 ceph-mon[34497]: scrub summary: idle 2024-09-19T06:20:54.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:53 smithi089 ceph-mon[34160]: scrub queued for path: / 2024-09-19T06:20:54.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:53 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:54.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:53 smithi089 ceph-mon[34160]: scrub summary: active paths [/] 2024-09-19T06:20:54.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:53 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:54.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:53 smithi089 ceph-mon[34160]: pgmap v185: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:20:54.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:53 smithi089 ceph-mon[34160]: scrub summary: idle 2024-09-19T06:20:54.406 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:53 smithi002 ceph-mon[30982]: scrub queued for path: / 2024-09-19T06:20:54.406 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:53 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:54.407 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:53 smithi002 ceph-mon[30982]: scrub summary: active paths [/] 2024-09-19T06:20:54.407 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:53 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:54.407 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:53 smithi002 ceph-mon[30982]: pgmap v185: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:20:54.407 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:53 smithi002 ceph-mon[30982]: scrub summary: idle 2024-09-19T06:20:54.435 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:20:54.435 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:20:54.692 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:55.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.099+0000 7f6ca5a0e640 1 -- 172.21.15.2:0/2771297540 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ca0102ef0 msgr2=0x7f6ca010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:55.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.099+0000 7f6ca5a0e640 1 --2- 172.21.15.2:0/2771297540 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ca0102ef0 0x7f6ca010da40 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f6c98009900 tx=0x7f6c9802a480 comp rx=0 tx=0).stop 2024-09-19T06:20:55.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.099+0000 7f6ca5a0e640 1 -- 172.21.15.2:0/2771297540 shutdown_connections 2024-09-19T06:20:55.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.099+0000 7f6ca5a0e640 1 --2- 172.21.15.2:0/2771297540 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ca0102ef0 0x7f6ca010da40 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:55.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.099+0000 7f6ca5a0e640 1 --2- 172.21.15.2:0/2771297540 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ca0102570 0x7f6ca01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:55.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.099+0000 7f6ca5a0e640 1 --2- 172.21.15.2:0/2771297540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ca0100e20 0x7f6ca0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:55.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.099+0000 7f6ca5a0e640 1 -- 172.21.15.2:0/2771297540 >> 172.21.15.2:0/2771297540 conn(0x7f6ca00fc7d0 msgr2=0x7f6ca00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:55.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.099+0000 7f6ca5a0e640 1 -- 172.21.15.2:0/2771297540 shutdown_connections 2024-09-19T06:20:55.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.099+0000 7f6ca5a0e640 1 -- 172.21.15.2:0/2771297540 wait complete. 2024-09-19T06:20:55.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.099+0000 7f6ca5a0e640 1 Processor -- start 2024-09-19T06:20:55.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.100+0000 7f6ca5a0e640 1 -- start start 2024-09-19T06:20:55.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.100+0000 7f6ca5a0e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ca0100e20 0x7f6ca0197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:55.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.100+0000 7f6ca5a0e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ca0102570 0x7f6ca0197870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:55.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.100+0000 7f6ca5a0e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ca0102ef0 0x7f6ca019bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:55.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.100+0000 7f6ca5a0e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca0110e30 con 0x7f6ca0100e20 2024-09-19T06:20:55.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.100+0000 7f6ca5a0e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca0110cb0 con 0x7f6ca0102ef0 2024-09-19T06:20:55.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.100+0000 7f6ca5a0e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca0110fb0 con 0x7f6ca0102570 2024-09-19T06:20:55.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.100+0000 7f6c9effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ca0100e20 0x7f6ca0197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:55.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.100+0000 7f6c9effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ca0100e20 0x7f6ca0197330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54628/0 (socket says 172.21.15.2:54628) 2024-09-19T06:20:55.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.100+0000 7f6c9effd640 1 -- 172.21.15.2:0/67706879 learned_addr learned my addr 172.21.15.2:0/67706879 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:55.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.100+0000 7f6c9f7fe640 1 --2- 172.21.15.2:0/67706879 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ca0102ef0 0x7f6ca019bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:55.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.100+0000 7f6c9e7fc640 1 --2- 172.21.15.2:0/67706879 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ca0102570 0x7f6ca0197870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:55.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.101+0000 7f6c9effd640 1 -- 172.21.15.2:0/67706879 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ca0102570 msgr2=0x7f6ca0197870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:55.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.101+0000 7f6c9effd640 1 --2- 172.21.15.2:0/67706879 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ca0102570 0x7f6ca0197870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:55.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.101+0000 7f6c9effd640 1 -- 172.21.15.2:0/67706879 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ca0102ef0 msgr2=0x7f6ca019bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:55.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.101+0000 7f6c9effd640 1 --2- 172.21.15.2:0/67706879 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ca0102ef0 0x7f6ca019bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:55.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.101+0000 7f6c9effd640 1 -- 172.21.15.2:0/67706879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca019c2e0 con 0x7f6ca0100e20 2024-09-19T06:20:55.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.101+0000 7f6c9f7fe640 1 --2- 172.21.15.2:0/67706879 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ca0102ef0 0x7f6ca019bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:55.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.101+0000 7f6c9effd640 1 --2- 172.21.15.2:0/67706879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ca0100e20 0x7f6ca0197330 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f6c9000cce0 tx=0x7f6c9000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:55.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.101+0000 7f6ca4a0c640 1 -- 172.21.15.2:0/67706879 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c90004b20 con 0x7f6ca0100e20 2024-09-19T06:20:55.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.101+0000 7f6ca4a0c640 1 -- 172.21.15.2:0/67706879 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6c90004cc0 con 0x7f6ca0100e20 2024-09-19T06:20:55.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.101+0000 7f6ca5a0e640 1 -- 172.21.15.2:0/67706879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ca019c5d0 con 0x7f6ca0100e20 2024-09-19T06:20:55.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.101+0000 7f6ca4a0c640 1 -- 172.21.15.2:0/67706879 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c9000f6b0 con 0x7f6ca0100e20 2024-09-19T06:20:55.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.101+0000 7f6ca5a0e640 1 -- 172.21.15.2:0/67706879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ca01a3eb0 con 0x7f6ca0100e20 2024-09-19T06:20:55.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.102+0000 7f6ca5a0e640 1 -- 172.21.15.2:0/67706879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ca0101200 con 0x7f6ca0100e20 2024-09-19T06:20:55.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.103+0000 7f6ca4a0c640 1 -- 172.21.15.2:0/67706879 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f6c9000f850 con 0x7f6ca0100e20 2024-09-19T06:20:55.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.104+0000 7f6ca4a0c640 1 --2- 172.21.15.2:0/67706879 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f6c880a33b0 0x7f6c880a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:55.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.104+0000 7f6ca4a0c640 1 -- 172.21.15.2:0/67706879 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f6c900cfdd0 con 0x7f6ca0100e20 2024-09-19T06:20:55.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.104+0000 7f6c9e7fc640 1 --2- 172.21.15.2:0/67706879 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f6c880a33b0 0x7f6c880a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:55.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.104+0000 7f6c9e7fc640 1 --2- 172.21.15.2:0/67706879 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f6c880a33b0 0x7f6c880a5870 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6ca00ffe50 tx=0x7f6c9400a2d0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:55.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.108+0000 7f6ca4a0c640 1 -- 172.21.15.2:0/67706879 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6c90014030 con 0x7f6ca0100e20 2024-09-19T06:20:55.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.319+0000 7f6ca5a0e640 1 -- 172.21.15.2:0/67706879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ca01090c0 con 0x7f6ca0100e20 2024-09-19T06:20:55.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.320+0000 7f6ca4a0c640 1 -- 172.21.15.2:0/67706879 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11882 (secure 0 0 0) 0x7f6c9009c7e0 con 0x7f6ca0100e20 2024-09-19T06:20:55.322 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:20:55.322 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-09-19T06:14:49:104280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:14:48.191083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24470,24472,24497]},"id":1}]} 2024-09-19T06:20:55.322 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-09-19T06:20:55.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.322+0000 7f6ca5a0e640 1 -- 172.21.15.2:0/67706879 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f6c880a33b0 msgr2=0x7f6c880a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:55.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.322+0000 7f6ca5a0e640 1 --2- 172.21.15.2:0/67706879 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f6c880a33b0 0x7f6c880a5870 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6ca00ffe50 tx=0x7f6c9400a2d0 comp rx=0 tx=0).stop 2024-09-19T06:20:55.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.322+0000 7f6ca5a0e640 1 -- 172.21.15.2:0/67706879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ca0100e20 msgr2=0x7f6ca0197330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:55.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.322+0000 7f6ca5a0e640 1 --2- 172.21.15.2:0/67706879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ca0100e20 0x7f6ca0197330 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f6c9000cce0 tx=0x7f6c9000a620 comp rx=0 tx=0).stop 2024-09-19T06:20:55.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.322+0000 7f6ca5a0e640 1 -- 172.21.15.2:0/67706879 shutdown_connections 2024-09-19T06:20:55.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.322+0000 7f6ca5a0e640 1 --2- 172.21.15.2:0/67706879 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f6c880a33b0 0x7f6c880a5870 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:55.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.322+0000 7f6ca5a0e640 1 --2- 172.21.15.2:0/67706879 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ca0102ef0 0x7f6ca019bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:55.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.322+0000 7f6ca5a0e640 1 --2- 172.21.15.2:0/67706879 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ca0102570 0x7f6ca0197870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:55.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.322+0000 7f6ca5a0e640 1 --2- 172.21.15.2:0/67706879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ca0100e20 0x7f6ca0197330 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:55.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.322+0000 7f6ca5a0e640 1 -- 172.21.15.2:0/67706879 >> 172.21.15.2:0/67706879 conn(0x7f6ca00fc7d0 msgr2=0x7f6ca00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:55.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.322+0000 7f6ca5a0e640 1 -- 172.21.15.2:0/67706879 shutdown_connections 2024-09-19T06:20:55.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:55.322+0000 7f6ca5a0e640 1 -- 172.21.15.2:0/67706879 wait complete. 2024-09-19T06:20:55.954 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:20:56.215 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:56.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:55 smithi002 ceph-mon[30982]: pgmap v186: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2024-09-19T06:20:56.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:55 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/67706879' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:20:56.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:55 smithi090 ceph-mon[34497]: pgmap v186: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2024-09-19T06:20:56.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:55 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/67706879' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:20:56.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:55 smithi089 ceph-mon[34160]: pgmap v186: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2024-09-19T06:20:56.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:55 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/67706879' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:20:56.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.675+0000 7f97cba14640 1 -- 172.21.15.2:0/3294716573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97c4100e20 msgr2=0x7f97c4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:56.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.675+0000 7f97cba14640 1 --2- 172.21.15.2:0/3294716573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97c4100e20 0x7f97c4101200 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f97c0009900 tx=0x7f97c002a480 comp rx=0 tx=0).stop 2024-09-19T06:20:56.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.675+0000 7f97cba14640 1 -- 172.21.15.2:0/3294716573 shutdown_connections 2024-09-19T06:20:56.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.675+0000 7f97cba14640 1 --2- 172.21.15.2:0/3294716573 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97c4102ef0 0x7f97c410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.675+0000 7f97cba14640 1 --2- 172.21.15.2:0/3294716573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97c4102570 0x7f97c41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.675+0000 7f97cba14640 1 --2- 172.21.15.2:0/3294716573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97c4100e20 0x7f97c4101200 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.675+0000 7f97cba14640 1 -- 172.21.15.2:0/3294716573 >> 172.21.15.2:0/3294716573 conn(0x7f97c40fc7d0 msgr2=0x7f97c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:56.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.675+0000 7f97cba14640 1 -- 172.21.15.2:0/3294716573 shutdown_connections 2024-09-19T06:20:56.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.675+0000 7f97cba14640 1 -- 172.21.15.2:0/3294716573 wait complete. 2024-09-19T06:20:56.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.676+0000 7f97cba14640 1 Processor -- start 2024-09-19T06:20:56.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.676+0000 7f97cba14640 1 -- start start 2024-09-19T06:20:56.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.676+0000 7f97cba14640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97c4100e20 0x7f97c4198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:56.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.676+0000 7f97cba14640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97c4102570 0x7f97c41988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:56.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.676+0000 7f97cba14640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97c4102ef0 0x7f97c419cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:56.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.676+0000 7f97cba14640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f97c4111f10 con 0x7f97c4100e20 2024-09-19T06:20:56.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.676+0000 7f97cba14640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f97c4111d90 con 0x7f97c4102ef0 2024-09-19T06:20:56.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.676+0000 7f97cba14640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f97c4112090 con 0x7f97c4102570 2024-09-19T06:20:56.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.676+0000 7f97c97b0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97c4100e20 0x7f97c4198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:56.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.676+0000 7f97c97b0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97c4100e20 0x7f97c4198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47866/0 (socket says 172.21.15.2:47866) 2024-09-19T06:20:56.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.676+0000 7f97c97b0640 1 -- 172.21.15.2:0/1702653793 learned_addr learned my addr 172.21.15.2:0/1702653793 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:56.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.676+0000 7f97c8faf640 1 --2- 172.21.15.2:0/1702653793 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97c4102570 0x7f97c41988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:56.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.676+0000 7f97c9fb1640 1 --2- 172.21.15.2:0/1702653793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97c4102ef0 0x7f97c419cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:56.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.677+0000 7f97c97b0640 1 -- 172.21.15.2:0/1702653793 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97c4102570 msgr2=0x7f97c41988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:56.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.677+0000 7f97c97b0640 1 --2- 172.21.15.2:0/1702653793 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97c4102570 0x7f97c41988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.677+0000 7f97c97b0640 1 -- 172.21.15.2:0/1702653793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97c4102ef0 msgr2=0x7f97c419cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:56.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.677+0000 7f97c97b0640 1 --2- 172.21.15.2:0/1702653793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97c4102ef0 0x7f97c419cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.677+0000 7f97c97b0640 1 -- 172.21.15.2:0/1702653793 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c419d340 con 0x7f97c4100e20 2024-09-19T06:20:56.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.677+0000 7f97c9fb1640 1 --2- 172.21.15.2:0/1702653793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97c4102ef0 0x7f97c419cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:56.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.677+0000 7f97c97b0640 1 --2- 172.21.15.2:0/1702653793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97c4100e20 0x7f97c4198390 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f97c0006010 tx=0x7f97c0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:56.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.677+0000 7f97ba7fc640 1 -- 172.21.15.2:0/1702653793 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c003f030 con 0x7f97c4100e20 2024-09-19T06:20:56.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.677+0000 7f97cba14640 1 -- 172.21.15.2:0/1702653793 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97c419d5d0 con 0x7f97c4100e20 2024-09-19T06:20:56.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.677+0000 7f97ba7fc640 1 -- 172.21.15.2:0/1702653793 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f97c0003aa0 con 0x7f97c4100e20 2024-09-19T06:20:56.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.677+0000 7f97ba7fc640 1 -- 172.21.15.2:0/1702653793 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c0035070 con 0x7f97c4100e20 2024-09-19T06:20:56.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.677+0000 7f97cba14640 1 -- 172.21.15.2:0/1702653793 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97c410e400 con 0x7f97c4100e20 2024-09-19T06:20:56.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.679+0000 7f97ba7fc640 1 -- 172.21.15.2:0/1702653793 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f97c0042030 con 0x7f97c4100e20 2024-09-19T06:20:56.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.680+0000 7f97cdded740 1 Processor -- start 2024-09-19T06:20:56.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.680+0000 7f97cdded740 1 -- start start 2024-09-19T06:20:56.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.680+0000 7f97cdded740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4aff20b40 0x55d4aff1f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:56.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.680+0000 7f97cdded740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4aff1f5d0 0x55d4aff1fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:56.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.680+0000 7f97cdded740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4aff2a370 0x55d4aff2c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:56.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.680+0000 7f97cdded740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d4afe852f0 con 0x55d4aff20b40 2024-09-19T06:20:56.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.680+0000 7f97cdded740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55d4afe2ccf0 con 0x55d4aff2a370 2024-09-19T06:20:56.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.680+0000 7f97cdded740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55d4afe812b0 con 0x55d4aff1f5d0 2024-09-19T06:20:56.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.680+0000 7f97c9fb1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4aff20b40 0x55d4aff1f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:56.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.680+0000 7f97c9fb1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4aff20b40 0x55d4aff1f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47872/0 (socket says 172.21.15.2:47872) 2024-09-19T06:20:56.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.680+0000 7f97c9fb1640 1 -- 172.21.15.2:0/2195406354 learned_addr learned my addr 172.21.15.2:0/2195406354 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:56.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.680+0000 7f97ba7fc640 1 --2- 172.21.15.2:0/1702653793 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f97b00a33b0 0x7f97b00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:56.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.680+0000 7f97c97b0640 1 --2- 172.21.15.2:0/2195406354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4aff1f5d0 0x55d4aff1fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:56.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.680+0000 7f97c9fb1640 1 --2- 172.21.15.2:0/1702653793 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f97b00a33b0 0x7f97b00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:56.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.681+0000 7f97c8faf640 1 --2- 172.21.15.2:0/2195406354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4aff2a370 0x55d4aff2c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:56.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.681+0000 7f97ba7fc640 1 -- 172.21.15.2:0/1702653793 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f97c00f0360 con 0x7f97c4100e20 2024-09-19T06:20:56.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.681+0000 7f97c9fb1640 1 -- 172.21.15.2:0/2195406354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4aff1f5d0 msgr2=0x55d4aff1fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:56.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.681+0000 7f97c9fb1640 1 --2- 172.21.15.2:0/2195406354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4aff1f5d0 0x55d4aff1fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.681+0000 7f97c9fb1640 1 -- 172.21.15.2:0/2195406354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4aff2a370 msgr2=0x55d4aff2c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:56.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.681+0000 7f97c9fb1640 1 --2- 172.21.15.2:0/2195406354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4aff2a370 0x55d4aff2c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.681+0000 7f97c9fb1640 1 -- 172.21.15.2:0/2195406354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4afe113a0 con 0x55d4aff20b40 2024-09-19T06:20:56.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.681+0000 7f97c97b0640 1 --2- 172.21.15.2:0/2195406354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4aff1f5d0 0x55d4aff1fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:56.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.681+0000 7f97c8faf640 1 --2- 172.21.15.2:0/2195406354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4aff2a370 0x55d4aff2c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:56.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.681+0000 7f97c9fb1640 1 --2- 172.21.15.2:0/2195406354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4aff20b40 0x55d4aff1f090 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f97bc005c40 tx=0x7f97bc00e350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=767f4b66e4634291 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:56.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.681+0000 7f97c9fb1640 1 --2- 172.21.15.2:0/1702653793 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f97b00a33b0 0x7f97b00a5870 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f97bc01c000 tx=0x7f97bc020000 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:56.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.681+0000 7f97af7fe640 1 -- 172.21.15.2:0/2195406354 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97bc00eda0 con 0x55d4aff20b40 2024-09-19T06:20:56.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.681+0000 7f97af7fe640 1 -- 172.21.15.2:0/2195406354 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f97bc023070 con 0x55d4aff20b40 2024-09-19T06:20:56.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.681+0000 7f97af7fe640 1 -- 172.21.15.2:0/2195406354 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97bc010be0 con 0x55d4aff20b40 2024-09-19T06:20:56.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.682+0000 7f97cdded740 1 -- 172.21.15.2:0/2195406354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4aff20b40 msgr2=0x55d4aff1f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:56.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.682+0000 7f97cdded740 1 --2- 172.21.15.2:0/2195406354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4aff20b40 0x55d4aff1f090 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f97bc005c40 tx=0x7f97bc00e350 comp rx=0 tx=0).stop 2024-09-19T06:20:56.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.682+0000 7f97cdded740 1 -- 172.21.15.2:0/2195406354 shutdown_connections 2024-09-19T06:20:56.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.682+0000 7f97cdded740 1 --2- 172.21.15.2:0/2195406354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4aff2a370 0x55d4aff2c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.682+0000 7f97cdded740 1 --2- 172.21.15.2:0/2195406354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4aff1f5d0 0x55d4aff1fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.682+0000 7f97cdded740 1 --2- 172.21.15.2:0/2195406354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4aff20b40 0x55d4aff1f090 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.682+0000 7f97cdded740 1 -- 172.21.15.2:0/2195406354 >> 172.21.15.2:0/2195406354 conn(0x55d4afee8310 msgr2=0x55d4aff1bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:56.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.682+0000 7f97cdded740 1 -- 172.21.15.2:0/2195406354 shutdown_connections 2024-09-19T06:20:56.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.682+0000 7f97cdded740 1 -- 172.21.15.2:0/2195406354 wait complete. 2024-09-19T06:20:56.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.682+0000 7f97cdded740 1 -- start start 2024-09-19T06:20:56.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.683+0000 7f97cdded740 1 Processor -- start 2024-09-19T06:20:56.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.683+0000 7f97cdded740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4aff1f5d0 0x55d4aff29d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:56.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.683+0000 7f97cdded740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4aff20b40 0x55d4aff27000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:56.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.683+0000 7f97cdded740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4aff2a370 0x55d4aff275d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:56.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.683+0000 7f97cdded740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d4aff2d010 con 0x55d4aff1f5d0 2024-09-19T06:20:56.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.683+0000 7f97cdded740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55d4afe40060 con 0x55d4aff20b40 2024-09-19T06:20:56.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.683+0000 7f97cdded740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55d4aff2d190 con 0x55d4aff2a370 2024-09-19T06:20:56.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.683+0000 7f97cdded740 10 client.0 _ll_register_callbacks cb 0x55d4afb938c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:56.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.683+0000 7f97c97b0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4aff1f5d0 0x55d4aff29d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:56.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.683+0000 7f97c97b0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4aff1f5d0 0x55d4aff29d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47880/0 (socket says 172.21.15.2:47880) 2024-09-19T06:20:56.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.683+0000 7f97c97b0640 1 -- 172.21.15.2:0/2044366918 learned_addr learned my addr 172.21.15.2:0/2044366918 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:56.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.683+0000 7f97c8faf640 1 --2- 172.21.15.2:0/2044366918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4aff20b40 0x55d4aff27000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:56.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.683+0000 7f97c9fb1640 1 --2- 172.21.15.2:0/2044366918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4aff2a370 0x55d4aff275d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:56.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.684+0000 7f97c97b0640 1 -- 172.21.15.2:0/2044366918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4aff2a370 msgr2=0x55d4aff275d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:56.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.684+0000 7f97c97b0640 1 --2- 172.21.15.2:0/2044366918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4aff2a370 0x55d4aff275d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.684+0000 7f97c97b0640 1 -- 172.21.15.2:0/2044366918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4aff20b40 msgr2=0x55d4aff27000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:56.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.684+0000 7f97c97b0640 1 --2- 172.21.15.2:0/2044366918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4aff20b40 0x55d4aff27000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.684+0000 7f97c97b0640 1 -- 172.21.15.2:0/2044366918 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4afbf63c0 con 0x55d4aff1f5d0 2024-09-19T06:20:56.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.684+0000 7f97c97b0640 1 --2- 172.21.15.2:0/2044366918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4aff1f5d0 0x55d4aff29d50 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f97c00bc370 tx=0x7f97c008b360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0ce0766e95a4943 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:56.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.684+0000 7f97acff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:56.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.684+0000 7f97acff9640 1 -- 172.21.15.2:0/2044366918 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c0049050 con 0x55d4aff1f5d0 2024-09-19T06:20:56.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.684+0000 7f97acff9640 1 -- 172.21.15.2:0/2044366918 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f97c00b8ce0 con 0x55d4aff1f5d0 2024-09-19T06:20:56.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.684+0000 7f97cdded740 1 -- 172.21.15.2:0/2044366918 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97bc023070 con 0x55d4aff1f5d0 2024-09-19T06:20:56.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.684+0000 7f97acff9640 1 -- 172.21.15.2:0/2044366918 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f97c00bbfd0 con 0x55d4aff1f5d0 2024-09-19T06:20:56.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.684+0000 7f97cdded740 10 client.17124 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:56.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.684+0000 7f97cdded740 1 -- 172.21.15.2:0/2044366918 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55d4aff38a90 con 0x55d4aff1f5d0 2024-09-19T06:20:56.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.684+0000 7f97acff9640 1 -- 172.21.15.2:0/2044366918 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f97bc023070 con 0x55d4aff1f5d0 2024-09-19T06:20:56.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.684+0000 7f97acff9640 1 -- 172.21.15.2:0/2044366918 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f97c0003c50 con 0x55d4aff1f5d0 2024-09-19T06:20:56.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.684+0000 7f97cdded740 10 client.17124 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:56.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.684+0000 7f97cdded740 10 client.17124 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:20:56.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.685+0000 7f97cdded740 20 client.17124 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:56.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.685+0000 7f97cdded740 1 --2- 172.21.15.2:0/2044366918 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55d4aff39f40 0x55d4aff3c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:56.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.685+0000 7f97cdded740 4 client.17124 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:56.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.685+0000 7f97cdded740 1 -- 172.21.15.2:0/2044366918 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d4afe92860 con 0x55d4aff39f40 2024-09-19T06:20:56.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.685+0000 7f97c8faf640 1 --2- 172.21.15.2:0/2044366918 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55d4aff39f40 0x55d4aff3c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:56.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.685+0000 7f97acff9640 10 client.17124 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:20:56.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.685+0000 7f97c8faf640 1 --2- 172.21.15.2:0/2044366918 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55d4aff39f40 0x55d4aff3c370 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c11e507b55f58b22 server_cookie=36acac762a2b3923 in_seq=0 out_seq=0 2024-09-19T06:20:56.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.686+0000 7f97acff9640 1 -- 172.21.15.2:0/2044366918 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d4afe92860 con 0x55d4aff39f40 2024-09-19T06:20:56.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.686+0000 7f97acff9640 10 client.17124 handle_command_reply: tid=0 2024-09-19T06:20:56.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.686+0000 7f97cdded740 1 client.17124 shutdown 2024-09-19T06:20:56.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.686+0000 7f97cdded740 1 -- 172.21.15.2:0/2044366918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4aff1f5d0 msgr2=0x55d4aff29d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:56.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.686+0000 7f97cdded740 1 --2- 172.21.15.2:0/2044366918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4aff1f5d0 0x55d4aff29d50 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f97c00bc370 tx=0x7f97c008b360 comp rx=0 tx=0).stop 2024-09-19T06:20:56.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.686+0000 7f97cdded740 1 -- 172.21.15.2:0/2044366918 shutdown_connections 2024-09-19T06:20:56.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.686+0000 7f97cdded740 1 --2- 172.21.15.2:0/2044366918 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55d4aff39f40 0x55d4aff3c370 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.686+0000 7f97cdded740 1 --2- 172.21.15.2:0/2044366918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4aff2a370 0x55d4aff275d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.686+0000 7f97cdded740 1 --2- 172.21.15.2:0/2044366918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4aff20b40 0x55d4aff27000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.686+0000 7f97cdded740 1 --2- 172.21.15.2:0/2044366918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4aff1f5d0 0x55d4aff29d50 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.686+0000 7f97cdded740 1 -- 172.21.15.2:0/2044366918 >> 172.21.15.2:0/2044366918 conn(0x55d4afee8310 msgr2=0x55d4aff21960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:56.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.686+0000 7f97acff9640 0 client.17124 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:20:56.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.686+0000 7f97cdded740 1 -- 172.21.15.2:0/2044366918 shutdown_connections 2024-09-19T06:20:56.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.687+0000 7f97cdded740 1 -- 172.21.15.2:0/2044366918 wait complete. 2024-09-19T06:20:56.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.687+0000 7f97cdded740 20 client.17124 trim_cache size 0 max 16384 2024-09-19T06:20:56.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.700+0000 7f97cdded740 1 Processor -- start 2024-09-19T06:20:56.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.700+0000 7f97cdded740 1 -- start start 2024-09-19T06:20:56.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.700+0000 7f97cdded740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4aff1f5d0 0x55d4aff25f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:56.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.700+0000 7f97cdded740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4aff20b40 0x55d4aff1ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:56.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.700+0000 7f97cdded740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4aff2a370 0x55d4aff22120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:56.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.700+0000 7f97cdded740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f97c41b20d0 con 0x55d4aff20b40 2024-09-19T06:20:56.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.700+0000 7f97cdded740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f97c41af9a0 con 0x55d4aff1f5d0 2024-09-19T06:20:56.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.700+0000 7f97cdded740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f97c41ad7f0 con 0x55d4aff2a370 2024-09-19T06:20:56.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.700+0000 7f97c8faf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4aff20b40 0x55d4aff1ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:56.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.700+0000 7f97c8faf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4aff20b40 0x55d4aff1ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47888/0 (socket says 172.21.15.2:47888) 2024-09-19T06:20:56.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.700+0000 7f97c8faf640 1 -- 172.21.15.2:0/1059656718 learned_addr learned my addr 172.21.15.2:0/1059656718 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:56.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.700+0000 7f97c9fb1640 1 --2- 172.21.15.2:0/1059656718 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4aff2a370 0x55d4aff22120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:56.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.700+0000 7f97c97b0640 1 --2- 172.21.15.2:0/1059656718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4aff1f5d0 0x55d4aff25f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:56.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.701+0000 7f97c8faf640 1 -- 172.21.15.2:0/1059656718 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4aff2a370 msgr2=0x55d4aff22120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:56.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.701+0000 7f97c8faf640 1 --2- 172.21.15.2:0/1059656718 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4aff2a370 0x55d4aff22120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.701+0000 7f97c8faf640 1 -- 172.21.15.2:0/1059656718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4aff1f5d0 msgr2=0x55d4aff25f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:56.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.701+0000 7f97c8faf640 1 --2- 172.21.15.2:0/1059656718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4aff1f5d0 0x55d4aff25f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.701+0000 7f97c8faf640 1 -- 172.21.15.2:0/1059656718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4aff1c950 con 0x55d4aff20b40 2024-09-19T06:20:56.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.701+0000 7f97c97b0640 1 --2- 172.21.15.2:0/1059656718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4aff1f5d0 0x55d4aff25f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:20:56.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.701+0000 7f97c8faf640 1 --2- 172.21.15.2:0/1059656718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4aff20b40 0x55d4aff1ac10 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f97c40fec10 tx=0x7f97b4013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d84dd1bc58e007f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:56.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.701+0000 7f97aeffd640 1 -- 172.21.15.2:0/1059656718 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b4022070 con 0x55d4aff20b40 2024-09-19T06:20:56.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.701+0000 7f97aeffd640 1 -- 172.21.15.2:0/1059656718 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f97b40118f0 con 0x55d4aff20b40 2024-09-19T06:20:56.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.701+0000 7f97aeffd640 1 -- 172.21.15.2:0/1059656718 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b401c840 con 0x55d4aff20b40 2024-09-19T06:20:56.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.702+0000 7f97cdded740 1 -- 172.21.15.2:0/1059656718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4aff20b40 msgr2=0x55d4aff1ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:56.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.702+0000 7f97cdded740 1 --2- 172.21.15.2:0/1059656718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4aff20b40 0x55d4aff1ac10 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f97c40fec10 tx=0x7f97b4013830 comp rx=0 tx=0).stop 2024-09-19T06:20:56.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.702+0000 7f97cdded740 1 -- 172.21.15.2:0/1059656718 shutdown_connections 2024-09-19T06:20:56.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.702+0000 7f97cdded740 1 --2- 172.21.15.2:0/1059656718 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4aff2a370 0x55d4aff22120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.702+0000 7f97cdded740 1 --2- 172.21.15.2:0/1059656718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4aff20b40 0x55d4aff1ac10 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.702+0000 7f97cdded740 1 --2- 172.21.15.2:0/1059656718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4aff1f5d0 0x55d4aff25f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.702+0000 7f97cdded740 1 -- 172.21.15.2:0/1059656718 >> 172.21.15.2:0/1059656718 conn(0x55d4afee8310 msgr2=0x55d4aff1a500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:56.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.702+0000 7f97cdded740 1 -- 172.21.15.2:0/1059656718 shutdown_connections 2024-09-19T06:20:56.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.702+0000 7f97cdded740 1 -- 172.21.15.2:0/1059656718 wait complete. 2024-09-19T06:20:56.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.702+0000 7f97cdded740 1 -- start start 2024-09-19T06:20:56.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.702+0000 7f97cdded740 1 Processor -- start 2024-09-19T06:20:56.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.703+0000 7f97cdded740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4aff1f5d0 0x55d4aff329c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:56.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.703+0000 7f97cdded740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4aff20b40 0x55d4aff23b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:56.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.703+0000 7f97cdded740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4aff2a370 0x55d4aff24090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:56.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.703+0000 7f97cdded740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f97c41ade60 con 0x55d4aff1f5d0 2024-09-19T06:20:56.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.703+0000 7f97cdded740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f97c41af2d0 con 0x55d4aff20b40 2024-09-19T06:20:56.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.703+0000 7f97cdded740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f97c41ae530 con 0x55d4aff2a370 2024-09-19T06:20:56.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.703+0000 7f97cdded740 10 client.0 _ll_register_callbacks cb 0x7f97c0005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:56.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.703+0000 7f97c97b0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4aff1f5d0 0x55d4aff329c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:56.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.703+0000 7f97c97b0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4aff1f5d0 0x55d4aff329c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47892/0 (socket says 172.21.15.2:47892) 2024-09-19T06:20:56.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.703+0000 7f97c97b0640 1 -- 172.21.15.2:0/2715424881 learned_addr learned my addr 172.21.15.2:0/2715424881 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:56.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.703+0000 7f97c8faf640 1 --2- 172.21.15.2:0/2715424881 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4aff20b40 0x55d4aff23b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:56.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.703+0000 7f97c9fb1640 1 --2- 172.21.15.2:0/2715424881 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4aff2a370 0x55d4aff24090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:56.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.703+0000 7f97c97b0640 1 -- 172.21.15.2:0/2715424881 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4aff2a370 msgr2=0x55d4aff24090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:56.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.703+0000 7f97c97b0640 1 --2- 172.21.15.2:0/2715424881 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4aff2a370 0x55d4aff24090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.703+0000 7f97c97b0640 1 -- 172.21.15.2:0/2715424881 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4aff20b40 msgr2=0x55d4aff23b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:56.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.703+0000 7f97c97b0640 1 --2- 172.21.15.2:0/2715424881 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4aff20b40 0x55d4aff23b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.703+0000 7f97c97b0640 1 -- 172.21.15.2:0/2715424881 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4aff246d0 con 0x55d4aff1f5d0 2024-09-19T06:20:56.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.703+0000 7f97c97b0640 1 --2- 172.21.15.2:0/2715424881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4aff1f5d0 0x55d4aff329c0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f97c00b9040 tx=0x7f97c002a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee1d7d47eba5d532 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:56.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.703+0000 7f97acff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:56.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.703+0000 7f97acff9640 1 -- 172.21.15.2:0/2715424881 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c00d4030 con 0x55d4aff1f5d0 2024-09-19T06:20:56.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.703+0000 7f97acff9640 1 -- 172.21.15.2:0/2715424881 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f97c00c4e50 con 0x55d4aff1f5d0 2024-09-19T06:20:56.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.703+0000 7f97cdded740 1 -- 172.21.15.2:0/2715424881 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97b40118f0 con 0x55d4aff1f5d0 2024-09-19T06:20:56.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.704+0000 7f97acff9640 1 -- 172.21.15.2:0/2715424881 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f97c0049070 con 0x55d4aff1f5d0 2024-09-19T06:20:56.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.704+0000 7f97cdded740 10 client.17130 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:56.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.704+0000 7f97cdded740 1 -- 172.21.15.2:0/2715424881 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55d4affa4a10 con 0x55d4aff1f5d0 2024-09-19T06:20:56.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.704+0000 7f97acff9640 1 -- 172.21.15.2:0/2715424881 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f97b40118f0 con 0x55d4aff1f5d0 2024-09-19T06:20:56.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.704+0000 7f97acff9640 1 -- 172.21.15.2:0/2715424881 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f97c00bc8d0 con 0x55d4aff1f5d0 2024-09-19T06:20:56.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.704+0000 7f97cdded740 10 client.17130 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:56.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.704+0000 7f97cdded740 10 client.17130 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:20:56.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.704+0000 7f97cdded740 20 client.17130 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:56.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.704+0000 7f97cdded740 1 --2- 172.21.15.2:0/2715424881 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55d4affa4fb0 0x55d4affa73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:56.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.704+0000 7f97cdded740 4 client.17130 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:20:56.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.704+0000 7f97cdded740 1 -- 172.21.15.2:0/2715424881 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d4afe8cd70 con 0x55d4affa4fb0 2024-09-19T06:20:56.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.704+0000 7f97c8faf640 1 --2- 172.21.15.2:0/2715424881 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55d4affa4fb0 0x55d4affa73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:56.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.705+0000 7f97c8faf640 1 --2- 172.21.15.2:0/2715424881 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55d4affa4fb0 0x55d4affa73d0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c865d66b8a2c5b9f server_cookie=1efaf157de0a2cde in_seq=0 out_seq=0 2024-09-19T06:20:56.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.705+0000 7f97acff9640 10 client.17130 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:20:56.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.705+0000 7f97acff9640 1 -- 172.21.15.2:0/2715424881 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d4afe8cd70 con 0x55d4affa4fb0 2024-09-19T06:20:56.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.705+0000 7f97acff9640 10 client.17130 handle_command_reply: tid=0 2024-09-19T06:20:56.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.705+0000 7f97cdded740 1 client.17130 shutdown 2024-09-19T06:20:56.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.705+0000 7f97cdded740 1 -- 172.21.15.2:0/2715424881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4aff1f5d0 msgr2=0x55d4aff329c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:56.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.705+0000 7f97cdded740 1 --2- 172.21.15.2:0/2715424881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4aff1f5d0 0x55d4aff329c0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f97c00b9040 tx=0x7f97c002a480 comp rx=0 tx=0).stop 2024-09-19T06:20:56.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.705+0000 7f97cdded740 1 -- 172.21.15.2:0/2715424881 shutdown_connections 2024-09-19T06:20:56.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.705+0000 7f97cdded740 1 --2- 172.21.15.2:0/2715424881 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55d4affa4fb0 0x55d4affa73d0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.705+0000 7f97cdded740 1 --2- 172.21.15.2:0/2715424881 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4aff2a370 0x55d4aff24090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.705+0000 7f97cdded740 1 --2- 172.21.15.2:0/2715424881 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d4aff20b40 0x55d4aff23b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.705+0000 7f97acff9640 0 client.17130 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:20:56.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.705+0000 7f97cdded740 1 --2- 172.21.15.2:0/2715424881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4aff1f5d0 0x55d4aff329c0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.705+0000 7f97cdded740 1 -- 172.21.15.2:0/2715424881 >> 172.21.15.2:0/2715424881 conn(0x55d4afee8310 msgr2=0x55d4aff352a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:56.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.705+0000 7f97cdded740 1 -- 172.21.15.2:0/2715424881 shutdown_connections 2024-09-19T06:20:56.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.705+0000 7f97cdded740 1 -- 172.21.15.2:0/2715424881 wait complete. 2024-09-19T06:20:56.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.705+0000 7f97cdded740 20 client.17130 trim_cache size 0 max 16384 2024-09-19T06:20:56.714 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:20:56.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.706+0000 7f97cba14640 1 -- 172.21.15.2:0/1702653793 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f97b00a33b0 msgr2=0x7f97b00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:56.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.706+0000 7f97cba14640 1 --2- 172.21.15.2:0/1702653793 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f97b00a33b0 0x7f97b00a5870 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f97bc01c000 tx=0x7f97bc020000 comp rx=0 tx=0).stop 2024-09-19T06:20:56.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.706+0000 7f97cba14640 1 -- 172.21.15.2:0/1702653793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97c4100e20 msgr2=0x7f97c4198390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:56.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.706+0000 7f97cba14640 1 --2- 172.21.15.2:0/1702653793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97c4100e20 0x7f97c4198390 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f97c0006010 tx=0x7f97c0004270 comp rx=0 tx=0).stop 2024-09-19T06:20:56.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.706+0000 7f97cba14640 1 -- 172.21.15.2:0/1702653793 shutdown_connections 2024-09-19T06:20:56.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.706+0000 7f97cba14640 1 --2- 172.21.15.2:0/1702653793 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f97b00a33b0 0x7f97b00a5870 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.706+0000 7f97cba14640 1 --2- 172.21.15.2:0/1702653793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97c4102ef0 0x7f97c419cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.706+0000 7f97cba14640 1 --2- 172.21.15.2:0/1702653793 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97c4102570 0x7f97c41988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.706+0000 7f97cba14640 1 --2- 172.21.15.2:0/1702653793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97c4100e20 0x7f97c4198390 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.706+0000 7f97cba14640 1 -- 172.21.15.2:0/1702653793 >> 172.21.15.2:0/1702653793 conn(0x7f97c40fc7d0 msgr2=0x7f97c41068b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:56.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.706+0000 7f97cba14640 1 -- 172.21.15.2:0/1702653793 shutdown_connections 2024-09-19T06:20:56.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:56.706+0000 7f97cba14640 1 -- 172.21.15.2:0/1702653793 wait complete. 2024-09-19T06:20:57.391 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:20:57.648 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:58.040 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:57 smithi002 ceph-mon[30982]: pgmap v187: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:20:58.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.122+0000 7fa1a7dfd640 1 -- 172.21.15.2:0/1748826662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1a0106f10 msgr2=0x7fa1a010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:58.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.122+0000 7fa1a7dfd640 1 --2- 172.21.15.2:0/1748826662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1a0106f10 0x7fa1a010ea90 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fa198009ca0 tx=0x7fa19802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.122+0000 7fa1a7dfd640 1 -- 172.21.15.2:0/1748826662 shutdown_connections 2024-09-19T06:20:58.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.122+0000 7fa1a7dfd640 1 --2- 172.21.15.2:0/1748826662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1a0106f10 0x7fa1a010ea90 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.122+0000 7fa1a7dfd640 1 --2- 172.21.15.2:0/1748826662 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa1a0102790 0x7fa1a01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.122+0000 7fa1a7dfd640 1 --2- 172.21.15.2:0/1748826662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1a0101de0 0x7fa1a01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.122+0000 7fa1a7dfd640 1 -- 172.21.15.2:0/1748826662 >> 172.21.15.2:0/1748826662 conn(0x7fa1a00fd8c0 msgr2=0x7fa1a00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:58.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.122+0000 7fa1a7dfd640 1 -- 172.21.15.2:0/1748826662 shutdown_connections 2024-09-19T06:20:58.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.122+0000 7fa1a7dfd640 1 -- 172.21.15.2:0/1748826662 wait complete. 2024-09-19T06:20:58.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.123+0000 7fa1a7dfd640 1 Processor -- start 2024-09-19T06:20:58.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.123+0000 7fa1a7dfd640 1 -- start start 2024-09-19T06:20:58.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.123+0000 7fa1a7dfd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1a0101de0 0x7fa1a00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:58.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.123+0000 7fa1a7dfd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1a0102790 0x7fa1a0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:58.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.123+0000 7fa1a7dfd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa1a0106f10 0x7fa1a0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:58.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.123+0000 7fa1a7dfd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a0111e20 con 0x7fa1a0102790 2024-09-19T06:20:58.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.123+0000 7fa1a7dfd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a0111ca0 con 0x7fa1a0101de0 2024-09-19T06:20:58.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.123+0000 7fa1a7dfd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a0111fa0 con 0x7fa1a0106f10 2024-09-19T06:20:58.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.123+0000 7fa1a5398640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1a0102790 0x7fa1a0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:58.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.123+0000 7fa1a5398640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1a0102790 0x7fa1a0074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47904/0 (socket says 172.21.15.2:47904) 2024-09-19T06:20:58.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.123+0000 7fa1a5398640 1 -- 172.21.15.2:0/4016100527 learned_addr learned my addr 172.21.15.2:0/4016100527 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:58.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.123+0000 7fa1a5b99640 1 --2- 172.21.15.2:0/4016100527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1a0101de0 0x7fa1a00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:58.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.123+0000 7fa1a639a640 1 --2- 172.21.15.2:0/4016100527 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa1a0106f10 0x7fa1a0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:58.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.123+0000 7fa1a5398640 1 -- 172.21.15.2:0/4016100527 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa1a0106f10 msgr2=0x7fa1a0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:58.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.123+0000 7fa1a5398640 1 --2- 172.21.15.2:0/4016100527 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa1a0106f10 0x7fa1a0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.123+0000 7fa1a5398640 1 -- 172.21.15.2:0/4016100527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1a0101de0 msgr2=0x7fa1a00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:58.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.123+0000 7fa1a5398640 1 --2- 172.21.15.2:0/4016100527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1a0101de0 0x7fa1a00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.123+0000 7fa1a5398640 1 -- 172.21.15.2:0/4016100527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1a01a6700 con 0x7fa1a0102790 2024-09-19T06:20:58.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.124+0000 7fa1a5398640 1 --2- 172.21.15.2:0/4016100527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1a0102790 0x7fa1a0074a30 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fa19000c890 tx=0x7fa19000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:58.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.124+0000 7fa196ffd640 1 -- 172.21.15.2:0/4016100527 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa190004220 con 0x7fa1a0102790 2024-09-19T06:20:58.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.124+0000 7fa196ffd640 1 -- 172.21.15.2:0/4016100527 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa1900043c0 con 0x7fa1a0102790 2024-09-19T06:20:58.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.124+0000 7fa1a7dfd640 1 -- 172.21.15.2:0/4016100527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1a01a69f0 con 0x7fa1a0102790 2024-09-19T06:20:58.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.124+0000 7fa196ffd640 1 -- 172.21.15.2:0/4016100527 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa190004a00 con 0x7fa1a0102790 2024-09-19T06:20:58.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.124+0000 7fa1a7dfd640 1 -- 172.21.15.2:0/4016100527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1a01a6f30 con 0x7fa1a0102790 2024-09-19T06:20:58.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.126+0000 7fa196ffd640 1 -- 172.21.15.2:0/4016100527 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fa190004ba0 con 0x7fa1a0102790 2024-09-19T06:20:58.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.126+0000 7fa1aa1d6740 1 Processor -- start 2024-09-19T06:20:58.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.127+0000 7fa1aa1d6740 1 -- start start 2024-09-19T06:20:58.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.127+0000 7fa1aa1d6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561293f56b40 0x561293f55090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:58.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.127+0000 7fa1aa1d6740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561293f555d0 0x561293f55a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:58.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.127+0000 7fa1aa1d6740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561293f60370 0x561293f62760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:58.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.127+0000 7fa1aa1d6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561293ebb2f0 con 0x561293f56b40 2024-09-19T06:20:58.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.127+0000 7fa1aa1d6740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x561293e62cf0 con 0x561293f555d0 2024-09-19T06:20:58.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.127+0000 7fa1aa1d6740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x561293eb72b0 con 0x561293f60370 2024-09-19T06:20:58.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.127+0000 7fa1a639a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561293f56b40 0x561293f55090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:58.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.127+0000 7fa1a639a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561293f56b40 0x561293f55090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47908/0 (socket says 172.21.15.2:47908) 2024-09-19T06:20:58.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.127+0000 7fa1a639a640 1 -- 172.21.15.2:0/1783473656 learned_addr learned my addr 172.21.15.2:0/1783473656 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:58.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.127+0000 7fa1a5b99640 1 --2- 172.21.15.2:0/1783473656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561293f555d0 0x561293f55a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:58.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.127+0000 7fa196ffd640 1 --2- 172.21.15.2:0/4016100527 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa18c0a33b0 0x7fa18c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:58.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.127+0000 7fa1a5398640 1 --2- 172.21.15.2:0/1783473656 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561293f60370 0x561293f62760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:58.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.127+0000 7fa1a639a640 1 -- 172.21.15.2:0/1783473656 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561293f60370 msgr2=0x561293f62760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:58.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.127+0000 7fa1a639a640 1 --2- 172.21.15.2:0/1783473656 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561293f60370 0x561293f62760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.127+0000 7fa1a639a640 1 -- 172.21.15.2:0/1783473656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561293f555d0 msgr2=0x561293f55a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:58.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.127+0000 7fa1a639a640 1 --2- 172.21.15.2:0/1783473656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561293f555d0 0x561293f55a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.127+0000 7fa1a639a640 1 -- 172.21.15.2:0/1783473656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561293e473a0 con 0x561293f56b40 2024-09-19T06:20:58.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.127+0000 7fa196ffd640 1 -- 172.21.15.2:0/4016100527 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fa1900cfaa0 con 0x7fa1a0102790 2024-09-19T06:20:58.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.127+0000 7fa1a639a640 1 --2- 172.21.15.2:0/4016100527 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa18c0a33b0 0x7fa18c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:58.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.128+0000 7fa1a639a640 1 --2- 172.21.15.2:0/1783473656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561293f56b40 0x561293f55090 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fa198005cc0 tx=0x7fa198031b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2493cb5833f3108 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:58.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.128+0000 7fa18bfff640 1 -- 172.21.15.2:0/1783473656 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa198031690 con 0x561293f56b40 2024-09-19T06:20:58.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.128+0000 7fa18bfff640 1 -- 172.21.15.2:0/1783473656 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa198036040 con 0x561293f56b40 2024-09-19T06:20:58.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.128+0000 7fa18bfff640 1 -- 172.21.15.2:0/1783473656 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa198030820 con 0x561293f56b40 2024-09-19T06:20:58.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.128+0000 7fa1a639a640 1 --2- 172.21.15.2:0/4016100527 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa18c0a33b0 0x7fa18c0a5870 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa19804c000 tx=0x7fa198049000 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:58.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.129+0000 7fa1aa1d6740 1 -- 172.21.15.2:0/1783473656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561293f56b40 msgr2=0x561293f55090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:58.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.129+0000 7fa1aa1d6740 1 --2- 172.21.15.2:0/1783473656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561293f56b40 0x561293f55090 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fa198005cc0 tx=0x7fa198031b10 comp rx=0 tx=0).stop 2024-09-19T06:20:58.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.129+0000 7fa1aa1d6740 1 -- 172.21.15.2:0/1783473656 shutdown_connections 2024-09-19T06:20:58.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.129+0000 7fa1aa1d6740 1 --2- 172.21.15.2:0/1783473656 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561293f60370 0x561293f62760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.129+0000 7fa1aa1d6740 1 --2- 172.21.15.2:0/1783473656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561293f555d0 0x561293f55a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.129+0000 7fa1aa1d6740 1 --2- 172.21.15.2:0/1783473656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561293f56b40 0x561293f55090 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.129+0000 7fa1aa1d6740 1 -- 172.21.15.2:0/1783473656 >> 172.21.15.2:0/1783473656 conn(0x561293f1e310 msgr2=0x561293f51c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:58.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.129+0000 7fa1aa1d6740 1 -- 172.21.15.2:0/1783473656 shutdown_connections 2024-09-19T06:20:58.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.129+0000 7fa1aa1d6740 1 -- 172.21.15.2:0/1783473656 wait complete. 2024-09-19T06:20:58.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.129+0000 7fa1aa1d6740 1 -- start start 2024-09-19T06:20:58.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.129+0000 7fa1aa1d6740 1 Processor -- start 2024-09-19T06:20:58.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.130+0000 7fa1aa1d6740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561293f555d0 0x561293f5fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:58.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.130+0000 7fa1aa1d6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561293f56b40 0x561293f5d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:58.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.130+0000 7fa1aa1d6740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561293f60370 0x561293f5d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:58.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.130+0000 7fa1aa1d6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561293f62ef0 con 0x561293f56b40 2024-09-19T06:20:58.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.130+0000 7fa1aa1d6740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x561293e76060 con 0x561293f555d0 2024-09-19T06:20:58.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.130+0000 7fa1aa1d6740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x561293f63070 con 0x561293f60370 2024-09-19T06:20:58.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.130+0000 7fa1aa1d6740 10 client.0 _ll_register_callbacks cb 0x561293bc98c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:58.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.130+0000 7fa1a5398640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561293f56b40 0x561293f5d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:58.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.130+0000 7fa1a5398640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561293f56b40 0x561293f5d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47912/0 (socket says 172.21.15.2:47912) 2024-09-19T06:20:58.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.130+0000 7fa1a5398640 1 -- 172.21.15.2:0/4106376653 learned_addr learned my addr 172.21.15.2:0/4106376653 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:58.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.130+0000 7fa1a5b99640 1 --2- 172.21.15.2:0/4106376653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561293f555d0 0x561293f5fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:58.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.130+0000 7fa1a639a640 1 --2- 172.21.15.2:0/4106376653 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561293f60370 0x561293f5d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:58.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.130+0000 7fa1a5398640 1 -- 172.21.15.2:0/4106376653 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561293f60370 msgr2=0x561293f5d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:58.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.130+0000 7fa1a5398640 1 --2- 172.21.15.2:0/4106376653 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561293f60370 0x561293f5d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.130+0000 7fa1a5398640 1 -- 172.21.15.2:0/4106376653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561293f555d0 msgr2=0x561293f5fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:58.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.130+0000 7fa1a5398640 1 --2- 172.21.15.2:0/4106376653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561293f555d0 0x561293f5fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.130+0000 7fa1a5398640 1 -- 172.21.15.2:0/4106376653 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561293c2c3c0 con 0x561293f56b40 2024-09-19T06:20:58.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.130+0000 7fa1a5398640 1 --2- 172.21.15.2:0/4106376653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561293f56b40 0x561293f5d030 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fa190098720 tx=0x7fa19009bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5598c685ebf28fb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:58.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.130+0000 7fa1897fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:58.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.130+0000 7fa1897fa640 1 -- 172.21.15.2:0/4106376653 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa19001d040 con 0x561293f56b40 2024-09-19T06:20:58.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.130+0000 7fa1897fa640 1 -- 172.21.15.2:0/4106376653 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fa1900cd440 con 0x561293f56b40 2024-09-19T06:20:58.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.130+0000 7fa1aa1d6740 1 -- 172.21.15.2:0/4106376653 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa198036040 con 0x561293f56b40 2024-09-19T06:20:58.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.131+0000 7fa1897fa640 1 -- 172.21.15.2:0/4106376653 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa1900b9050 con 0x561293f56b40 2024-09-19T06:20:58.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.131+0000 7fa1aa1d6740 10 client.17142 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:58.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.131+0000 7fa1aa1d6740 1 -- 172.21.15.2:0/4106376653 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561293f6e9c0 con 0x561293f56b40 2024-09-19T06:20:58.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.131+0000 7fa1897fa640 1 -- 172.21.15.2:0/4106376653 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa198036040 con 0x561293f56b40 2024-09-19T06:20:58.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.131+0000 7fa1897fa640 1 -- 172.21.15.2:0/4106376653 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fa190097aa0 con 0x561293f56b40 2024-09-19T06:20:58.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.131+0000 7fa1aa1d6740 10 client.17142 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:58.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.131+0000 7fa1aa1d6740 10 client.17142 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:20:58.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.131+0000 7fa1aa1d6740 20 client.17142 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:58.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.131+0000 7fa1aa1d6740 1 --2- 172.21.15.2:0/4106376653 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x561293f6fe20 0x561293f72210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:58.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.131+0000 7fa1aa1d6740 4 client.17142 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:58.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.131+0000 7fa1aa1d6740 1 -- 172.21.15.2:0/4106376653 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561293ec8860 con 0x561293f6fe20 2024-09-19T06:20:58.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.131+0000 7fa1a5b99640 1 --2- 172.21.15.2:0/4106376653 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x561293f6fe20 0x561293f72210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:58.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.132+0000 7fa1a5b99640 1 --2- 172.21.15.2:0/4106376653 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x561293f6fe20 0x561293f72210 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5e42f647836683f server_cookie=ad822f8645f60de6 in_seq=0 out_seq=0 2024-09-19T06:20:58.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.132+0000 7fa1897fa640 10 client.17142 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:20:58.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.132+0000 7fa1897fa640 1 -- 172.21.15.2:0/4106376653 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561293ec8860 con 0x561293f6fe20 2024-09-19T06:20:58.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.132+0000 7fa1897fa640 10 client.17142 handle_command_reply: tid=0 2024-09-19T06:20:58.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.133+0000 7fa1aa1d6740 1 client.17142 shutdown 2024-09-19T06:20:58.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.133+0000 7fa1aa1d6740 1 -- 172.21.15.2:0/4106376653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561293f56b40 msgr2=0x561293f5d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:58.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.133+0000 7fa1aa1d6740 1 --2- 172.21.15.2:0/4106376653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561293f56b40 0x561293f5d030 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fa190098720 tx=0x7fa19009bbe0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.133+0000 7fa1aa1d6740 1 -- 172.21.15.2:0/4106376653 shutdown_connections 2024-09-19T06:20:58.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.133+0000 7fa1aa1d6740 1 --2- 172.21.15.2:0/4106376653 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x561293f6fe20 0x561293f72210 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.133+0000 7fa1aa1d6740 1 --2- 172.21.15.2:0/4106376653 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561293f60370 0x561293f5d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.133+0000 7fa1aa1d6740 1 --2- 172.21.15.2:0/4106376653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561293f56b40 0x561293f5d030 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.133+0000 7fa1897fa640 0 client.17142 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:20:58.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.133+0000 7fa1aa1d6740 1 --2- 172.21.15.2:0/4106376653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561293f555d0 0x561293f5fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.133+0000 7fa1aa1d6740 1 -- 172.21.15.2:0/4106376653 >> 172.21.15.2:0/4106376653 conn(0x561293f1e310 msgr2=0x561293f57930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:58.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.133+0000 7fa1aa1d6740 1 -- 172.21.15.2:0/4106376653 shutdown_connections 2024-09-19T06:20:58.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.133+0000 7fa1aa1d6740 1 -- 172.21.15.2:0/4106376653 wait complete. 2024-09-19T06:20:58.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.133+0000 7fa1aa1d6740 20 client.17142 trim_cache size 0 max 16384 2024-09-19T06:20:58.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.146+0000 7fa1aa1d6740 1 Processor -- start 2024-09-19T06:20:58.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.146+0000 7fa1aa1d6740 1 -- start start 2024-09-19T06:20:58.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.147+0000 7fa1aa1d6740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561293f555d0 0x561293f58120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:58.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.147+0000 7fa1aa1d6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561293f56b40 0x561293f58660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:58.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.147+0000 7fa1aa1d6740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561293f60370 0x561293f77ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:58.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.147+0000 7fa1aa1d6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a01b21f0 con 0x561293f56b40 2024-09-19T06:20:58.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.147+0000 7fa1aa1d6740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a01afac0 con 0x561293f555d0 2024-09-19T06:20:58.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.147+0000 7fa1aa1d6740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a01ad910 con 0x561293f60370 2024-09-19T06:20:58.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.147+0000 7fa1a5398640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561293f56b40 0x561293f58660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:58.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.147+0000 7fa1a5398640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561293f56b40 0x561293f58660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47918/0 (socket says 172.21.15.2:47918) 2024-09-19T06:20:58.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.147+0000 7fa1a5398640 1 -- 172.21.15.2:0/3723518681 learned_addr learned my addr 172.21.15.2:0/3723518681 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:58.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.147+0000 7fa1a639a640 1 --2- 172.21.15.2:0/3723518681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561293f60370 0x561293f77ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:58.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.147+0000 7fa1a5b99640 1 --2- 172.21.15.2:0/3723518681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561293f555d0 0x561293f58120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:58.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.147+0000 7fa1a5398640 1 -- 172.21.15.2:0/3723518681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561293f60370 msgr2=0x561293f77ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:58.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.147+0000 7fa1a5398640 1 --2- 172.21.15.2:0/3723518681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561293f60370 0x561293f77ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.147+0000 7fa1a5398640 1 -- 172.21.15.2:0/3723518681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561293f555d0 msgr2=0x561293f58120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:58.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.147+0000 7fa1a5398640 1 --2- 172.21.15.2:0/3723518681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561293f555d0 0x561293f58120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.147+0000 7fa1a5398640 1 -- 172.21.15.2:0/3723518681 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561293f552d0 con 0x561293f56b40 2024-09-19T06:20:58.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.147+0000 7fa1a639a640 1 --2- 172.21.15.2:0/3723518681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561293f60370 0x561293f77ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:58.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.147+0000 7fa1a5398640 1 --2- 172.21.15.2:0/3723518681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561293f56b40 0x561293f58660 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fa1900986d0 tx=0x7fa190000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3643751bb46de90e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:58.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.147+0000 7fa18b7fe640 1 -- 172.21.15.2:0/3723518681 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa19009bd50 con 0x561293f56b40 2024-09-19T06:20:58.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.147+0000 7fa18b7fe640 1 -- 172.21.15.2:0/3723518681 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa1900a0100 con 0x561293f56b40 2024-09-19T06:20:58.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.147+0000 7fa18b7fe640 1 -- 172.21.15.2:0/3723518681 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1900a1290 con 0x561293f56b40 2024-09-19T06:20:58.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.148+0000 7fa1aa1d6740 1 -- 172.21.15.2:0/3723518681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561293f56b40 msgr2=0x561293f58660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:58.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.148+0000 7fa1aa1d6740 1 --2- 172.21.15.2:0/3723518681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561293f56b40 0x561293f58660 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fa1900986d0 tx=0x7fa190000bc0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.148+0000 7fa1aa1d6740 1 -- 172.21.15.2:0/3723518681 shutdown_connections 2024-09-19T06:20:58.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.148+0000 7fa1aa1d6740 1 --2- 172.21.15.2:0/3723518681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561293f60370 0x561293f77ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.148+0000 7fa1aa1d6740 1 --2- 172.21.15.2:0/3723518681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561293f56b40 0x561293f58660 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.148+0000 7fa1aa1d6740 1 --2- 172.21.15.2:0/3723518681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561293f555d0 0x561293f58120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.148+0000 7fa1aa1d6740 1 -- 172.21.15.2:0/3723518681 >> 172.21.15.2:0/3723518681 conn(0x561293f1e310 msgr2=0x561293f50d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:58.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.148+0000 7fa1aa1d6740 1 -- 172.21.15.2:0/3723518681 shutdown_connections 2024-09-19T06:20:58.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.148+0000 7fa1aa1d6740 1 -- 172.21.15.2:0/3723518681 wait complete. 2024-09-19T06:20:58.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.148+0000 7fa1aa1d6740 1 -- start start 2024-09-19T06:20:58.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.149+0000 7fa1aa1d6740 1 Processor -- start 2024-09-19T06:20:58.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.149+0000 7fa1aa1d6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561293f555d0 0x561293f647f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:58.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.149+0000 7fa1aa1d6740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561293f56b40 0x561293f64d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:58.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.149+0000 7fa1aa1d6740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561293f60370 0x561293fd9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:58.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.149+0000 7fa1aa1d6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a01adf80 con 0x561293f555d0 2024-09-19T06:20:58.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.149+0000 7fa1aa1d6740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a01af3f0 con 0x561293f60370 2024-09-19T06:20:58.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.149+0000 7fa1aa1d6740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a01ae650 con 0x561293f56b40 2024-09-19T06:20:58.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.149+0000 7fa1aa1d6740 10 client.0 _ll_register_callbacks cb 0x7fa1900058c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:58.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.149+0000 7fa1a5b99640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561293f555d0 0x561293f647f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:58.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.149+0000 7fa1a5b99640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561293f555d0 0x561293f647f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47922/0 (socket says 172.21.15.2:47922) 2024-09-19T06:20:58.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.149+0000 7fa1a5b99640 1 -- 172.21.15.2:0/836260585 learned_addr learned my addr 172.21.15.2:0/836260585 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:58.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.149+0000 7fa1a5398640 1 --2- 172.21.15.2:0/836260585 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561293f56b40 0x561293f64d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:58.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.149+0000 7fa1a639a640 1 --2- 172.21.15.2:0/836260585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561293f60370 0x561293fd9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:58.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.149+0000 7fa1a5b99640 1 -- 172.21.15.2:0/836260585 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561293f56b40 msgr2=0x561293f64d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:58.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.149+0000 7fa1a5b99640 1 --2- 172.21.15.2:0/836260585 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561293f56b40 0x561293f64d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.149+0000 7fa1a5b99640 1 -- 172.21.15.2:0/836260585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561293f60370 msgr2=0x561293fd9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:58.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.149+0000 7fa1a5b99640 1 --2- 172.21.15.2:0/836260585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561293f60370 0x561293fd9ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.149+0000 7fa1a5b99640 1 -- 172.21.15.2:0/836260585 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561293fda0a0 con 0x561293f555d0 2024-09-19T06:20:58.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.149+0000 7fa1a5398640 1 --2- 172.21.15.2:0/836260585 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561293f56b40 0x561293f64d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:20:58.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.150+0000 7fa1a5b99640 1 --2- 172.21.15.2:0/836260585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561293f555d0 0x561293f647f0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x561293f72a20 tx=0x7fa19c00cfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=144944095afeddb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:58.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.150+0000 7fa1897fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:58.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.150+0000 7fa1897fa640 1 -- 172.21.15.2:0/836260585 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa19c01c470 con 0x561293f555d0 2024-09-19T06:20:58.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.150+0000 7fa1897fa640 1 -- 172.21.15.2:0/836260585 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fa19c01c610 con 0x561293f555d0 2024-09-19T06:20:58.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.150+0000 7fa1aa1d6740 1 -- 172.21.15.2:0/836260585 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1900a0100 con 0x561293f555d0 2024-09-19T06:20:58.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.150+0000 7fa1897fa640 1 -- 172.21.15.2:0/836260585 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa19c02c050 con 0x561293f555d0 2024-09-19T06:20:58.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.150+0000 7fa1aa1d6740 10 client.17148 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:58.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.150+0000 7fa1aa1d6740 1 -- 172.21.15.2:0/836260585 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561293fdb3a0 con 0x561293f555d0 2024-09-19T06:20:58.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.150+0000 7fa1897fa640 1 -- 172.21.15.2:0/836260585 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa1900a0100 con 0x561293f555d0 2024-09-19T06:20:58.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.150+0000 7fa1897fa640 1 -- 172.21.15.2:0/836260585 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fa19c010b20 con 0x561293f555d0 2024-09-19T06:20:58.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.150+0000 7fa1aa1d6740 10 client.17148 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:58.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.150+0000 7fa1aa1d6740 10 client.17148 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:20:58.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.150+0000 7fa1aa1d6740 20 client.17148 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:58.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.150+0000 7fa1aa1d6740 1 --2- 172.21.15.2:0/836260585 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x561293fdbb00 0x561293fddf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:58.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.151+0000 7fa1aa1d6740 4 client.17148 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:20:58.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.151+0000 7fa1aa1d6740 1 -- 172.21.15.2:0/836260585 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561293ec2d70 con 0x561293fdbb00 2024-09-19T06:20:58.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.151+0000 7fa1a5398640 1 --2- 172.21.15.2:0/836260585 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x561293fdbb00 0x561293fddf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:58.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.151+0000 7fa1a5398640 1 --2- 172.21.15.2:0/836260585 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x561293fdbb00 0x561293fddf20 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9299371e4780ec3c server_cookie=a0ba20edb4ad14b in_seq=0 out_seq=0 2024-09-19T06:20:58.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.151+0000 7fa1897fa640 10 client.17148 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:20:58.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.151+0000 7fa1897fa640 1 -- 172.21.15.2:0/836260585 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561293ec2d70 con 0x561293fdbb00 2024-09-19T06:20:58.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.151+0000 7fa1897fa640 10 client.17148 handle_command_reply: tid=0 2024-09-19T06:20:58.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.151+0000 7fa1aa1d6740 1 client.17148 shutdown 2024-09-19T06:20:58.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.152+0000 7fa1aa1d6740 1 -- 172.21.15.2:0/836260585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561293f555d0 msgr2=0x561293f647f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:58.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.152+0000 7fa1aa1d6740 1 --2- 172.21.15.2:0/836260585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561293f555d0 0x561293f647f0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x561293f72a20 tx=0x7fa19c00cfd0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.152+0000 7fa1aa1d6740 1 -- 172.21.15.2:0/836260585 shutdown_connections 2024-09-19T06:20:58.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.152+0000 7fa1aa1d6740 1 --2- 172.21.15.2:0/836260585 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x561293fdbb00 0x561293fddf20 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.152+0000 7fa1aa1d6740 1 --2- 172.21.15.2:0/836260585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561293f60370 0x561293fd9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.152+0000 7fa1aa1d6740 1 --2- 172.21.15.2:0/836260585 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561293f56b40 0x561293f64d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.152+0000 7fa1aa1d6740 1 --2- 172.21.15.2:0/836260585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561293f555d0 0x561293f647f0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.152+0000 7fa1897fa640 0 client.17148 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:20:58.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.152+0000 7fa1aa1d6740 1 -- 172.21.15.2:0/836260585 >> 172.21.15.2:0/836260585 conn(0x561293f1e310 msgr2=0x561293f5e890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:58.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.152+0000 7fa1aa1d6740 1 -- 172.21.15.2:0/836260585 shutdown_connections 2024-09-19T06:20:58.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.152+0000 7fa1aa1d6740 1 -- 172.21.15.2:0/836260585 wait complete. 2024-09-19T06:20:58.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.152+0000 7fa1aa1d6740 20 client.17148 trim_cache size 0 max 16384 2024-09-19T06:20:58.164 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:20:58.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.153+0000 7fa1a7dfd640 1 -- 172.21.15.2:0/4016100527 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa18c0a33b0 msgr2=0x7fa18c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:58.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.153+0000 7fa1a7dfd640 1 --2- 172.21.15.2:0/4016100527 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa18c0a33b0 0x7fa18c0a5870 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa19804c000 tx=0x7fa198049000 comp rx=0 tx=0).stop 2024-09-19T06:20:58.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.153+0000 7fa1a7dfd640 1 -- 172.21.15.2:0/4016100527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1a0102790 msgr2=0x7fa1a0074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:58.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.153+0000 7fa1a7dfd640 1 --2- 172.21.15.2:0/4016100527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1a0102790 0x7fa1a0074a30 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fa19000c890 tx=0x7fa19000cd50 comp rx=0 tx=0).stop 2024-09-19T06:20:58.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.153+0000 7fa1a7dfd640 1 -- 172.21.15.2:0/4016100527 shutdown_connections 2024-09-19T06:20:58.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.153+0000 7fa1a7dfd640 1 --2- 172.21.15.2:0/4016100527 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa18c0a33b0 0x7fa18c0a5870 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.153+0000 7fa1a7dfd640 1 --2- 172.21.15.2:0/4016100527 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa1a0106f10 0x7fa1a0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.153+0000 7fa1a7dfd640 1 --2- 172.21.15.2:0/4016100527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1a0102790 0x7fa1a0074a30 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.153+0000 7fa1a7dfd640 1 --2- 172.21.15.2:0/4016100527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1a0101de0 0x7fa1a00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.153+0000 7fa1a7dfd640 1 -- 172.21.15.2:0/4016100527 >> 172.21.15.2:0/4016100527 conn(0x7fa1a00fd8c0 msgr2=0x7fa1a00fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:58.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.153+0000 7fa1a7dfd640 1 -- 172.21.15.2:0/4016100527 shutdown_connections 2024-09-19T06:20:58.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:58.153+0000 7fa1a7dfd640 1 -- 172.21.15.2:0/4016100527 wait complete. 2024-09-19T06:20:58.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:57 smithi090 ceph-mon[34497]: pgmap v187: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:20:58.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:57 smithi089 ceph-mon[34160]: pgmap v187: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:20:58.851 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:20:59.109 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.540+0000 7f4b0db72640 1 -- 172.21.15.2:0/762931148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b08101420 msgr2=0x7f4b0810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.540+0000 7f4b0db72640 1 --2- 172.21.15.2:0/762931148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b08101420 0x7f4b0810d950 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f4b00009cd0 tx=0x7f4b0002a8e0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.540+0000 7f4b0db72640 1 -- 172.21.15.2:0/762931148 shutdown_connections 2024-09-19T06:20:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.540+0000 7f4b0db72640 1 --2- 172.21.15.2:0/762931148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b08101420 0x7f4b0810d950 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.540+0000 7f4b0db72640 1 --2- 172.21.15.2:0/762931148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b08100a80 0x7f4b08100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.540+0000 7f4b0db72640 1 --2- 172.21.15.2:0/762931148 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b08106a80 0x7f4b08106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.540+0000 7f4b0db72640 1 -- 172.21.15.2:0/762931148 >> 172.21.15.2:0/762931148 conn(0x7f4b080fc7a0 msgr2=0x7f4b080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:59.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.540+0000 7f4b0db72640 1 -- 172.21.15.2:0/762931148 shutdown_connections 2024-09-19T06:20:59.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.541+0000 7f4b0db72640 1 -- 172.21.15.2:0/762931148 wait complete. 2024-09-19T06:20:59.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.541+0000 7f4b0db72640 1 Processor -- start 2024-09-19T06:20:59.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.541+0000 7f4b0db72640 1 -- start start 2024-09-19T06:20:59.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.542+0000 7f4b0db72640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b08100a80 0x7f4b081982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:59.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.542+0000 7f4b0db72640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b08101420 0x7f4b08198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:59.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.542+0000 7f4b0db72640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b08106a80 0x7f4b0819cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:59.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.542+0000 7f4b0db72640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4b08110d30 con 0x7f4b08100a80 2024-09-19T06:20:59.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.542+0000 7f4b0db72640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4b08110bb0 con 0x7f4b08101420 2024-09-19T06:20:59.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.542+0000 7f4b0db72640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4b08110eb0 con 0x7f4b08106a80 2024-09-19T06:20:59.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.542+0000 7f4b077fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b08100a80 0x7f4b081982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:59.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.542+0000 7f4b077fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b08100a80 0x7f4b081982c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47938/0 (socket says 172.21.15.2:47938) 2024-09-19T06:20:59.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.542+0000 7f4b077fe640 1 -- 172.21.15.2:0/828834070 learned_addr learned my addr 172.21.15.2:0/828834070 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.542+0000 7f4b06ffd640 1 --2- 172.21.15.2:0/828834070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b08101420 0x7f4b08198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.542+0000 7f4b07fff640 1 --2- 172.21.15.2:0/828834070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b08106a80 0x7f4b0819cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.542+0000 7f4b077fe640 1 -- 172.21.15.2:0/828834070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b08106a80 msgr2=0x7f4b0819cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.542+0000 7f4b077fe640 1 --2- 172.21.15.2:0/828834070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b08106a80 0x7f4b0819cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.542+0000 7f4b077fe640 1 -- 172.21.15.2:0/828834070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b08101420 msgr2=0x7f4b08198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.542+0000 7f4b077fe640 1 --2- 172.21.15.2:0/828834070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b08101420 0x7f4b08198800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.542+0000 7f4b077fe640 1 -- 172.21.15.2:0/828834070 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b0819d270 con 0x7f4b08100a80 2024-09-19T06:20:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.542+0000 7f4b07fff640 1 --2- 172.21.15.2:0/828834070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b08106a80 0x7f4b0819cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.542+0000 7f4b077fe640 1 --2- 172.21.15.2:0/828834070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b08100a80 0x7f4b081982c0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f4af800c920 tx=0x7f4af800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.542+0000 7f4b04ff9640 1 -- 172.21.15.2:0/828834070 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af8007c70 con 0x7f4b08100a80 2024-09-19T06:20:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.543+0000 7f4b04ff9640 1 -- 172.21.15.2:0/828834070 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4af8007e10 con 0x7f4b08100a80 2024-09-19T06:20:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.543+0000 7f4b0db72640 1 -- 172.21.15.2:0/828834070 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b0819d560 con 0x7f4b08100a80 2024-09-19T06:20:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.543+0000 7f4b04ff9640 1 -- 172.21.15.2:0/828834070 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af8018820 con 0x7f4b08100a80 2024-09-19T06:20:59.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.543+0000 7f4b0db72640 1 -- 172.21.15.2:0/828834070 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b081a4e40 con 0x7f4b08100a80 2024-09-19T06:20:59.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.545+0000 7f4b0ff4b740 1 Processor -- start 2024-09-19T06:20:59.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.545+0000 7f4b04ff9640 1 -- 172.21.15.2:0/828834070 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f4af80189c0 con 0x7f4b08100a80 2024-09-19T06:20:59.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.545+0000 7f4b0ff4b740 1 -- start start 2024-09-19T06:20:59.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.545+0000 7f4b0ff4b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ffeae6b40 0x555ffeae5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:59.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.545+0000 7f4b0ff4b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ffeae55d0 0x555ffeae5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:59.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.545+0000 7f4b0ff4b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555ffeaf0370 0x555ffeaf2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:59.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.545+0000 7f4b0ff4b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555ffea4b2f0 con 0x555ffeae6b40 2024-09-19T06:20:59.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.545+0000 7f4b0ff4b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x555ffe9f2cf0 con 0x555ffeaf0370 2024-09-19T06:20:59.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.545+0000 7f4b0ff4b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x555ffea472b0 con 0x555ffeae55d0 2024-09-19T06:20:59.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.546+0000 7f4b07fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ffeae6b40 0x555ffeae5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:59.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.546+0000 7f4b07fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ffeae6b40 0x555ffeae5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47942/0 (socket says 172.21.15.2:47942) 2024-09-19T06:20:59.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.546+0000 7f4b07fff640 1 -- 172.21.15.2:0/611894419 learned_addr learned my addr 172.21.15.2:0/611894419 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:59.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.546+0000 7f4b06ffd640 1 --2- 172.21.15.2:0/611894419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555ffeaf0370 0x555ffeaf2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:59.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.546+0000 7f4b077fe640 1 --2- 172.21.15.2:0/611894419 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ffeae55d0 0x555ffeae5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:59.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.546+0000 7f4b07fff640 1 -- 172.21.15.2:0/611894419 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ffeae55d0 msgr2=0x555ffeae5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:59.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.546+0000 7f4b07fff640 1 --2- 172.21.15.2:0/611894419 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ffeae55d0 0x555ffeae5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.546+0000 7f4b07fff640 1 -- 172.21.15.2:0/611894419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555ffeaf0370 msgr2=0x555ffeaf2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:59.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.546+0000 7f4b07fff640 1 --2- 172.21.15.2:0/611894419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555ffeaf0370 0x555ffeaf2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.546+0000 7f4b07fff640 1 -- 172.21.15.2:0/611894419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ffe9d73a0 con 0x555ffeae6b40 2024-09-19T06:20:59.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.546+0000 7f4b07fff640 1 --2- 172.21.15.2:0/611894419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ffeae6b40 0x555ffeae5090 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f4b00035000 tx=0x7f4b00031560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91ce2ddd2713b9fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:59.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.546+0000 7f4b04ff9640 1 --2- 172.21.15.2:0/828834070 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4af00a33b0 0x7f4af00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:59.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.546+0000 7f4aedffb640 1 -- 172.21.15.2:0/611894419 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b00031b10 con 0x555ffeae6b40 2024-09-19T06:20:59.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.546+0000 7f4b077fe640 1 --2- 172.21.15.2:0/828834070 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4af00a33b0 0x7f4af00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:59.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.546+0000 7f4aedffb640 1 -- 172.21.15.2:0/611894419 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4b00036040 con 0x555ffeae6b40 2024-09-19T06:20:59.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.546+0000 7f4aedffb640 1 -- 172.21.15.2:0/611894419 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b000046e0 con 0x555ffeae6b40 2024-09-19T06:20:59.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.546+0000 7f4b04ff9640 1 -- 172.21.15.2:0/828834070 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f4af80cfdb0 con 0x7f4b08100a80 2024-09-19T06:20:59.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.547+0000 7f4b0ff4b740 1 -- 172.21.15.2:0/611894419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ffeae6b40 msgr2=0x555ffeae5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:59.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.547+0000 7f4b077fe640 1 --2- 172.21.15.2:0/828834070 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4af00a33b0 0x7f4af00a5870 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4af80cd5e0 tx=0x7f4af8000bc0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:59.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.547+0000 7f4b0ff4b740 1 --2- 172.21.15.2:0/611894419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ffeae6b40 0x555ffeae5090 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f4b00035000 tx=0x7f4b00031560 comp rx=0 tx=0).stop 2024-09-19T06:20:59.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.547+0000 7f4b0ff4b740 1 -- 172.21.15.2:0/611894419 shutdown_connections 2024-09-19T06:20:59.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.547+0000 7f4b0ff4b740 1 --2- 172.21.15.2:0/611894419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555ffeaf0370 0x555ffeaf2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.547+0000 7f4b0ff4b740 1 --2- 172.21.15.2:0/611894419 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ffeae55d0 0x555ffeae5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.547+0000 7f4b0ff4b740 1 --2- 172.21.15.2:0/611894419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ffeae6b40 0x555ffeae5090 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.547+0000 7f4b0ff4b740 1 -- 172.21.15.2:0/611894419 >> 172.21.15.2:0/611894419 conn(0x555ffeaae310 msgr2=0x555ffeae1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:59.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.547+0000 7f4b0ff4b740 1 -- 172.21.15.2:0/611894419 shutdown_connections 2024-09-19T06:20:59.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.547+0000 7f4b0ff4b740 1 -- 172.21.15.2:0/611894419 wait complete. 2024-09-19T06:20:59.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.548+0000 7f4b0ff4b740 1 -- start start 2024-09-19T06:20:59.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.548+0000 7f4b0ff4b740 1 Processor -- start 2024-09-19T06:20:59.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.548+0000 7f4b0ff4b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ffeae55d0 0x555ffeaefd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:59.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.548+0000 7f4b0ff4b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555ffeae6b40 0x555ffeaed060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:59.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.548+0000 7f4b0ff4b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ffeaf0370 0x555ffeaed6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:59.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.548+0000 7f4b0ff4b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555ffeaf3010 con 0x555ffeae55d0 2024-09-19T06:20:59.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.548+0000 7f4b0ff4b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x555ffea06060 con 0x555ffeae6b40 2024-09-19T06:20:59.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.548+0000 7f4b0ff4b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x555ffeaf3190 con 0x555ffeaf0370 2024-09-19T06:20:59.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.548+0000 7f4b0ff4b740 10 client.0 _ll_register_callbacks cb 0x555ffe7598c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:59.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.548+0000 7f4b07fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ffeae55d0 0x555ffeaefd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:59.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.548+0000 7f4b07fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ffeae55d0 0x555ffeaefd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47956/0 (socket says 172.21.15.2:47956) 2024-09-19T06:20:59.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.548+0000 7f4b07fff640 1 -- 172.21.15.2:0/2804998301 learned_addr learned my addr 172.21.15.2:0/2804998301 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:59.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.548+0000 7f4b06ffd640 1 --2- 172.21.15.2:0/2804998301 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555ffeae6b40 0x555ffeaed060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:59.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.549+0000 7f4b07fff640 1 --2- 172.21.15.2:0/2804998301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ffeaf0370 0x555ffeaed6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:59.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.549+0000 7f4b07fff640 1 -- 172.21.15.2:0/2804998301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ffeaf0370 msgr2=0x555ffeaed6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:59.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.549+0000 7f4b07fff640 1 --2- 172.21.15.2:0/2804998301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ffeaf0370 0x555ffeaed6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.549+0000 7f4b07fff640 1 -- 172.21.15.2:0/2804998301 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555ffeae6b40 msgr2=0x555ffeaed060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:59.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.549+0000 7f4b07fff640 1 --2- 172.21.15.2:0/2804998301 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555ffeae6b40 0x555ffeaed060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.549+0000 7f4b07fff640 1 -- 172.21.15.2:0/2804998301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ffe7bc3c0 con 0x555ffeae55d0 2024-09-19T06:20:59.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.549+0000 7f4b07fff640 1 --2- 172.21.15.2:0/2804998301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ffeae55d0 0x555ffeaefd60 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f4b0002a920 tx=0x7f4b00031780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd54ed48affbc180 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:59.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.549+0000 7f4ae6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:59.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.549+0000 7f4ae6ffd640 1 -- 172.21.15.2:0/2804998301 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b00004860 con 0x555ffeae55d0 2024-09-19T06:20:59.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.549+0000 7f4ae6ffd640 1 -- 172.21.15.2:0/2804998301 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f4b00003b70 con 0x555ffeae55d0 2024-09-19T06:20:59.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.549+0000 7f4b0ff4b740 1 -- 172.21.15.2:0/2804998301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b00036040 con 0x555ffeae55d0 2024-09-19T06:20:59.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.549+0000 7f4ae6ffd640 1 -- 172.21.15.2:0/2804998301 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4b0005d050 con 0x555ffeae55d0 2024-09-19T06:20:59.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.549+0000 7f4b0ff4b740 10 client.17160 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:59.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.549+0000 7f4b0ff4b740 1 -- 172.21.15.2:0/2804998301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555ffeafeaf0 con 0x555ffeae55d0 2024-09-19T06:20:59.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.549+0000 7f4ae6ffd640 1 -- 172.21.15.2:0/2804998301 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4b00036040 con 0x555ffeae55d0 2024-09-19T06:20:59.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.550+0000 7f4ae6ffd640 1 -- 172.21.15.2:0/2804998301 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f4b00030070 con 0x555ffeae55d0 2024-09-19T06:20:59.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.550+0000 7f4b0ff4b740 10 client.17160 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:59.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.550+0000 7f4b0ff4b740 10 client.17160 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:59.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.550+0000 7f4b0ff4b740 20 client.17160 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:59.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.550+0000 7f4b0ff4b740 1 --2- 172.21.15.2:0/2804998301 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x555ffeaffe40 0x555ffeb02230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:59.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.550+0000 7f4b0ff4b740 4 client.17160 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:59.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.550+0000 7f4b0ff4b740 1 -- 172.21.15.2:0/2804998301 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555ffea58860 con 0x555ffeaffe40 2024-09-19T06:20:59.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.550+0000 7f4b06ffd640 1 --2- 172.21.15.2:0/2804998301 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x555ffeaffe40 0x555ffeb02230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:59.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.550+0000 7f4b06ffd640 1 --2- 172.21.15.2:0/2804998301 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x555ffeaffe40 0x555ffeb02230 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4c1e83fb9e94d3a server_cookie=518e74bff8ed59c1 in_seq=0 out_seq=0 2024-09-19T06:20:59.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.550+0000 7f4ae6ffd640 10 client.17160 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:59.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.551+0000 7f4ae6ffd640 1 -- 172.21.15.2:0/2804998301 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555ffea58860 con 0x555ffeaffe40 2024-09-19T06:20:59.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.551+0000 7f4ae6ffd640 10 client.17160 handle_command_reply: tid=0 2024-09-19T06:20:59.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.551+0000 7f4b0ff4b740 1 client.17160 shutdown 2024-09-19T06:20:59.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.551+0000 7f4b0ff4b740 1 -- 172.21.15.2:0/2804998301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ffeae55d0 msgr2=0x555ffeaefd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:59.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.551+0000 7f4b0ff4b740 1 --2- 172.21.15.2:0/2804998301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ffeae55d0 0x555ffeaefd60 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f4b0002a920 tx=0x7f4b00031780 comp rx=0 tx=0).stop 2024-09-19T06:20:59.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.551+0000 7f4b0ff4b740 1 -- 172.21.15.2:0/2804998301 shutdown_connections 2024-09-19T06:20:59.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.551+0000 7f4b0ff4b740 1 --2- 172.21.15.2:0/2804998301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ffeaf0370 0x555ffeaed6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.551+0000 7f4b0ff4b740 1 --2- 172.21.15.2:0/2804998301 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x555ffeaffe40 0x555ffeb02230 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.551+0000 7f4b0ff4b740 1 --2- 172.21.15.2:0/2804998301 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555ffeae6b40 0x555ffeaed060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.551+0000 7f4b0ff4b740 1 --2- 172.21.15.2:0/2804998301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ffeae55d0 0x555ffeaefd60 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.551+0000 7f4b0ff4b740 1 -- 172.21.15.2:0/2804998301 >> 172.21.15.2:0/2804998301 conn(0x555ffeaae310 msgr2=0x555ffeae7960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:59.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.551+0000 7f4ae6ffd640 0 client.17160 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:59.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.551+0000 7f4b0ff4b740 1 -- 172.21.15.2:0/2804998301 shutdown_connections 2024-09-19T06:20:59.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.552+0000 7f4b0ff4b740 1 -- 172.21.15.2:0/2804998301 wait complete. 2024-09-19T06:20:59.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.552+0000 7f4b0ff4b740 20 client.17160 trim_cache size 0 max 16384 2024-09-19T06:20:59.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.565+0000 7f4b0ff4b740 1 Processor -- start 2024-09-19T06:20:59.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.565+0000 7f4b0ff4b740 1 -- start start 2024-09-19T06:20:59.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.565+0000 7f4b0ff4b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555ffeae55d0 0x555ffeafc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:59.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.565+0000 7f4b0ff4b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ffeae6b40 0x555ffeaec920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:59.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.565+0000 7f4b0ff4b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ffeaf0370 0x555ffeb07860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:59.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.565+0000 7f4b0ff4b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4b081afed0 con 0x555ffeae6b40 2024-09-19T06:20:59.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.565+0000 7f4b0ff4b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4b081ad7a0 con 0x555ffeae55d0 2024-09-19T06:20:59.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.565+0000 7f4b0ff4b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4b081ab5f0 con 0x555ffeaf0370 2024-09-19T06:20:59.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.565+0000 7f4b07fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555ffeae55d0 0x555ffeafc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:59.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.565+0000 7f4b06ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ffeae6b40 0x555ffeaec920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:59.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.565+0000 7f4b06ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ffeae6b40 0x555ffeaec920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47962/0 (socket says 172.21.15.2:47962) 2024-09-19T06:20:59.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.565+0000 7f4b06ffd640 1 -- 172.21.15.2:0/1491188032 learned_addr learned my addr 172.21.15.2:0/1491188032 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:59.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.565+0000 7f4b07fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555ffeae55d0 0x555ffeafc2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:59956/0 (socket says 172.21.15.2:59956) 2024-09-19T06:20:59.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.565+0000 7f4b07fff640 1 --2- 172.21.15.2:0/1491188032 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ffeaf0370 0x555ffeb07860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:59.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.566+0000 7f4b06ffd640 1 -- 172.21.15.2:0/1491188032 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ffeaf0370 msgr2=0x555ffeb07860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:59.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.566+0000 7f4b06ffd640 1 --2- 172.21.15.2:0/1491188032 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ffeaf0370 0x555ffeb07860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.566+0000 7f4b06ffd640 1 -- 172.21.15.2:0/1491188032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555ffeae55d0 msgr2=0x555ffeafc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:59.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.566+0000 7f4b06ffd640 1 --2- 172.21.15.2:0/1491188032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555ffeae55d0 0x555ffeafc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.566+0000 7f4b06ffd640 1 -- 172.21.15.2:0/1491188032 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ffeaeefa0 con 0x555ffeae6b40 2024-09-19T06:20:59.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.566+0000 7f4b06ffd640 1 --2- 172.21.15.2:0/1491188032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ffeae6b40 0x555ffeaec920 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f4afc00b820 tx=0x7f4afc00b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=837c077079ab0a6f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:59.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.566+0000 7f4aed7fa640 1 -- 172.21.15.2:0/1491188032 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4afc003f70 con 0x555ffeae6b40 2024-09-19T06:20:59.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.566+0000 7f4aed7fa640 1 -- 172.21.15.2:0/1491188032 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4afc0054d0 con 0x555ffeae6b40 2024-09-19T06:20:59.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.566+0000 7f4aed7fa640 1 -- 172.21.15.2:0/1491188032 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4afc011440 con 0x555ffeae6b40 2024-09-19T06:20:59.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.567+0000 7f4b0ff4b740 1 -- 172.21.15.2:0/1491188032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ffeae6b40 msgr2=0x555ffeaec920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:59.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.567+0000 7f4b0ff4b740 1 --2- 172.21.15.2:0/1491188032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ffeae6b40 0x555ffeaec920 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f4afc00b820 tx=0x7f4afc00b390 comp rx=0 tx=0).stop 2024-09-19T06:20:59.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.567+0000 7f4b0ff4b740 1 -- 172.21.15.2:0/1491188032 shutdown_connections 2024-09-19T06:20:59.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.567+0000 7f4b0ff4b740 1 --2- 172.21.15.2:0/1491188032 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ffeaf0370 0x555ffeb07860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.567+0000 7f4b0ff4b740 1 --2- 172.21.15.2:0/1491188032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ffeae6b40 0x555ffeaec920 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.567+0000 7f4b0ff4b740 1 --2- 172.21.15.2:0/1491188032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555ffeae55d0 0x555ffeafc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.567+0000 7f4b0ff4b740 1 -- 172.21.15.2:0/1491188032 >> 172.21.15.2:0/1491188032 conn(0x555ffeaae310 msgr2=0x555ffeaec150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:59.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.567+0000 7f4b0ff4b740 1 -- 172.21.15.2:0/1491188032 shutdown_connections 2024-09-19T06:20:59.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.567+0000 7f4b0ff4b740 1 -- 172.21.15.2:0/1491188032 wait complete. 2024-09-19T06:20:59.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.567+0000 7f4b0ff4b740 1 -- start start 2024-09-19T06:20:59.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.568+0000 7f4b0ff4b740 1 Processor -- start 2024-09-19T06:20:59.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.568+0000 7f4b0ff4b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ffeae55d0 0x555ffeaf8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:59.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.568+0000 7f4b0ff4b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ffeae6b40 0x555ffeae9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:59.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.568+0000 7f4b0ff4b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555ffeaf0370 0x555ffeaea120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:59.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.568+0000 7f4b0ff4b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4b081abc60 con 0x555ffeae55d0 2024-09-19T06:20:59.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.568+0000 7f4b0ff4b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4b081ad0d0 con 0x555ffeaf0370 2024-09-19T06:20:59.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.568+0000 7f4b0ff4b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4b081ac330 con 0x555ffeae6b40 2024-09-19T06:20:59.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.568+0000 7f4b0ff4b740 10 client.0 _ll_register_callbacks cb 0x7f4afc004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:59.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.568+0000 7f4b07fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ffeae55d0 0x555ffeaf8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:59.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.568+0000 7f4b07fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ffeae55d0 0x555ffeaf8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47970/0 (socket says 172.21.15.2:47970) 2024-09-19T06:20:59.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.568+0000 7f4b07fff640 1 -- 172.21.15.2:0/3591511110 learned_addr learned my addr 172.21.15.2:0/3591511110 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:20:59.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.568+0000 7f4b06ffd640 1 --2- 172.21.15.2:0/3591511110 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ffeae6b40 0x555ffeae9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:59.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.568+0000 7f4b07fff640 1 --2- 172.21.15.2:0/3591511110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555ffeaf0370 0x555ffeaea120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:59.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.568+0000 7f4b07fff640 1 -- 172.21.15.2:0/3591511110 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ffeae6b40 msgr2=0x555ffeae9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:59.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.568+0000 7f4b07fff640 1 --2- 172.21.15.2:0/3591511110 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ffeae6b40 0x555ffeae9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.568+0000 7f4b07fff640 1 -- 172.21.15.2:0/3591511110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555ffeaf0370 msgr2=0x555ffeaea120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:59.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.568+0000 7f4b07fff640 1 --2- 172.21.15.2:0/3591511110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555ffeaf0370 0x555ffeaea120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.568+0000 7f4b07fff640 1 -- 172.21.15.2:0/3591511110 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ffeaea760 con 0x555ffeae55d0 2024-09-19T06:20:59.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.569+0000 7f4b07fff640 1 --2- 172.21.15.2:0/3591511110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ffeae55d0 0x555ffeaf8a10 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f4b00009bf0 tx=0x7f4b00031780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=937c5b54c4b14866 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:59.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.569+0000 7f4ae6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:20:59.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.569+0000 7f4ae6ffd640 1 -- 172.21.15.2:0/3591511110 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b00069060 con 0x555ffeae55d0 2024-09-19T06:20:59.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.569+0000 7f4ae6ffd640 1 -- 172.21.15.2:0/3591511110 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f4b000305a0 con 0x555ffeae55d0 2024-09-19T06:20:59.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.569+0000 7f4b0ff4b740 1 -- 172.21.15.2:0/3591511110 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4afc0054d0 con 0x555ffeae55d0 2024-09-19T06:20:59.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.569+0000 7f4ae6ffd640 1 -- 172.21.15.2:0/3591511110 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4b000307a0 con 0x555ffeae55d0 2024-09-19T06:20:59.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.569+0000 7f4b0ff4b740 10 client.17166 fetch_fsmap learned FSMap version 26 2024-09-19T06:20:59.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.569+0000 7f4b0ff4b740 1 -- 172.21.15.2:0/3591511110 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555ffeb6a660 con 0x555ffeae55d0 2024-09-19T06:20:59.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.569+0000 7f4ae6ffd640 1 -- 172.21.15.2:0/3591511110 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4afc0054d0 con 0x555ffeae55d0 2024-09-19T06:20:59.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.569+0000 7f4ae6ffd640 1 -- 172.21.15.2:0/3591511110 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f4b00030040 con 0x555ffeae55d0 2024-09-19T06:20:59.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.569+0000 7f4b0ff4b740 10 client.17166 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:20:59.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.569+0000 7f4b0ff4b740 10 client.17166 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:59.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.570+0000 7f4b0ff4b740 20 client.17166 populate_metadata read hostname 'smithi002' 2024-09-19T06:20:59.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.570+0000 7f4b0ff4b740 1 --2- 172.21.15.2:0/3591511110 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x555ffeb6ad80 0x555ffeb6d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:59.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.570+0000 7f4b0ff4b740 4 client.17166 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:20:59.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.570+0000 7f4b0ff4b740 1 -- 172.21.15.2:0/3591511110 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555ffea52d70 con 0x555ffeb6ad80 2024-09-19T06:20:59.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.570+0000 7f4b06ffd640 1 --2- 172.21.15.2:0/3591511110 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x555ffeb6ad80 0x555ffeb6d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:59.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.570+0000 7f4ae6ffd640 10 client.17166 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:59.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.570+0000 7f4b06ffd640 1 --2- 172.21.15.2:0/3591511110 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x555ffeb6ad80 0x555ffeb6d1a0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0c0c6c7fd75346e server_cookie=4c812fce38cf909e in_seq=0 out_seq=0 2024-09-19T06:20:59.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.570+0000 7f4ae6ffd640 1 -- 172.21.15.2:0/3591511110 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555ffea52d70 con 0x555ffeb6ad80 2024-09-19T06:20:59.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.570+0000 7f4ae6ffd640 10 client.17166 handle_command_reply: tid=0 2024-09-19T06:20:59.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.570+0000 7f4b0ff4b740 1 client.17166 shutdown 2024-09-19T06:20:59.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.571+0000 7f4b0ff4b740 1 -- 172.21.15.2:0/3591511110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ffeae55d0 msgr2=0x555ffeaf8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:59.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.571+0000 7f4b0ff4b740 1 --2- 172.21.15.2:0/3591511110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ffeae55d0 0x555ffeaf8a10 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f4b00009bf0 tx=0x7f4b00031780 comp rx=0 tx=0).stop 2024-09-19T06:20:59.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.571+0000 7f4b0ff4b740 1 -- 172.21.15.2:0/3591511110 shutdown_connections 2024-09-19T06:20:59.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.571+0000 7f4b0ff4b740 1 --2- 172.21.15.2:0/3591511110 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x555ffeb6ad80 0x555ffeb6d1a0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.571+0000 7f4b0ff4b740 1 --2- 172.21.15.2:0/3591511110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555ffeaf0370 0x555ffeaea120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.571+0000 7f4b0ff4b740 1 --2- 172.21.15.2:0/3591511110 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ffeae6b40 0x555ffeae9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.571+0000 7f4ae6ffd640 0 client.17166 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:20:59.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.571+0000 7f4b0ff4b740 1 --2- 172.21.15.2:0/3591511110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555ffeae55d0 0x555ffeaf8a10 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.571+0000 7f4b0ff4b740 1 -- 172.21.15.2:0/3591511110 >> 172.21.15.2:0/3591511110 conn(0x555ffeaae310 msgr2=0x555ffeafb2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:59.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.571+0000 7f4b0ff4b740 1 -- 172.21.15.2:0/3591511110 shutdown_connections 2024-09-19T06:20:59.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.571+0000 7f4b0ff4b740 1 -- 172.21.15.2:0/3591511110 wait complete. 2024-09-19T06:20:59.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.571+0000 7f4b0ff4b740 20 client.17166 trim_cache size 0 max 16384 2024-09-19T06:20:59.588 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:20:59.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.571+0000 7f4b0db72640 1 -- 172.21.15.2:0/828834070 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4af00a33b0 msgr2=0x7f4af00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:59.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.571+0000 7f4b0db72640 1 --2- 172.21.15.2:0/828834070 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4af00a33b0 0x7f4af00a5870 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4af80cd5e0 tx=0x7f4af8000bc0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.571+0000 7f4b0db72640 1 -- 172.21.15.2:0/828834070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b08100a80 msgr2=0x7f4b081982c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:59.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.571+0000 7f4b0db72640 1 --2- 172.21.15.2:0/828834070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b08100a80 0x7f4b081982c0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f4af800c920 tx=0x7f4af800cde0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.572+0000 7f4b0db72640 1 -- 172.21.15.2:0/828834070 shutdown_connections 2024-09-19T06:20:59.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.572+0000 7f4b0db72640 1 --2- 172.21.15.2:0/828834070 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4af00a33b0 0x7f4af00a5870 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.572+0000 7f4b0db72640 1 --2- 172.21.15.2:0/828834070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b08106a80 0x7f4b0819cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.572+0000 7f4b0db72640 1 --2- 172.21.15.2:0/828834070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b08101420 0x7f4b08198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.572+0000 7f4b0db72640 1 --2- 172.21.15.2:0/828834070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b08100a80 0x7f4b081982c0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.572+0000 7f4b0db72640 1 -- 172.21.15.2:0/828834070 >> 172.21.15.2:0/828834070 conn(0x7f4b080fc7a0 msgr2=0x7f4b0806aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:59.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.572+0000 7f4b0db72640 1 -- 172.21.15.2:0/828834070 shutdown_connections 2024-09-19T06:20:59.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:20:59.572+0000 7f4b0db72640 1 -- 172.21.15.2:0/828834070 wait complete. 2024-09-19T06:21:00.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:20:59 smithi089 ceph-mon[34160]: pgmap v188: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:21:00.371 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:20:59 smithi002 ceph-mon[30982]: pgmap v188: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:21:00.489 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:20:59 smithi090 ceph-mon[34497]: pgmap v188: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:21:01.150 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:21:01.150 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:21:01.421 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:01.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.933+0000 7fec1183b640 1 -- 172.21.15.2:0/4234401452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec0c101de0 msgr2=0x7fec0c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:01.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.933+0000 7fec1183b640 1 --2- 172.21.15.2:0/4234401452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec0c101de0 0x7fec0c1021c0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7febfc009900 tx=0x7febfc02a410 comp rx=0 tx=0).stop 2024-09-19T06:21:01.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.933+0000 7fec1183b640 1 -- 172.21.15.2:0/4234401452 shutdown_connections 2024-09-19T06:21:01.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.933+0000 7fec1183b640 1 --2- 172.21.15.2:0/4234401452 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fec0c106f10 0x7fec0c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:01.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.933+0000 7fec1183b640 1 --2- 172.21.15.2:0/4234401452 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec0c102790 0x7fec0c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:01.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.933+0000 7fec1183b640 1 --2- 172.21.15.2:0/4234401452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec0c101de0 0x7fec0c1021c0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:01.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.933+0000 7fec1183b640 1 -- 172.21.15.2:0/4234401452 >> 172.21.15.2:0/4234401452 conn(0x7fec0c0fd8c0 msgr2=0x7fec0c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:01.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.933+0000 7fec1183b640 1 -- 172.21.15.2:0/4234401452 shutdown_connections 2024-09-19T06:21:01.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.933+0000 7fec1183b640 1 -- 172.21.15.2:0/4234401452 wait complete. 2024-09-19T06:21:01.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.934+0000 7fec1183b640 1 Processor -- start 2024-09-19T06:21:01.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.934+0000 7fec1183b640 1 -- start start 2024-09-19T06:21:01.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.934+0000 7fec1183b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec0c101de0 0x7fec0c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:01.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.934+0000 7fec1183b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec0c102790 0x7fec0c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:01.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.934+0000 7fec1183b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fec0c106f10 0x7fec0c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:01.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.934+0000 7fec1183b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fec0c111e40 con 0x7fec0c101de0 2024-09-19T06:21:01.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.934+0000 7fec1183b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fec0c111cc0 con 0x7fec0c102790 2024-09-19T06:21:01.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.934+0000 7fec1183b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fec0c111fc0 con 0x7fec0c106f10 2024-09-19T06:21:01.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.934+0000 7fec0affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec0c101de0 0x7fec0c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:01.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.935+0000 7fec0affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec0c101de0 0x7fec0c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47988/0 (socket says 172.21.15.2:47988) 2024-09-19T06:21:01.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.935+0000 7fec0affd640 1 -- 172.21.15.2:0/900129019 learned_addr learned my addr 172.21.15.2:0/900129019 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:01.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.935+0000 7fec03fff640 1 --2- 172.21.15.2:0/900129019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec0c102790 0x7fec0c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:01.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.935+0000 7fec0b7fe640 1 --2- 172.21.15.2:0/900129019 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fec0c106f10 0x7fec0c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:01.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.935+0000 7fec0affd640 1 -- 172.21.15.2:0/900129019 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fec0c106f10 msgr2=0x7fec0c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:01.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.935+0000 7fec0affd640 1 --2- 172.21.15.2:0/900129019 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fec0c106f10 0x7fec0c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:01.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.935+0000 7fec0affd640 1 -- 172.21.15.2:0/900129019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec0c102790 msgr2=0x7fec0c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:01.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.935+0000 7fec0affd640 1 --2- 172.21.15.2:0/900129019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec0c102790 0x7fec0c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:01.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.935+0000 7fec0affd640 1 -- 172.21.15.2:0/900129019 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec0c1a6970 con 0x7fec0c101de0 2024-09-19T06:21:01.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.935+0000 7fec0b7fe640 1 --2- 172.21.15.2:0/900129019 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fec0c106f10 0x7fec0c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:21:01.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.935+0000 7fec0affd640 1 --2- 172.21.15.2:0/900129019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec0c101de0 0x7fec0c0744f0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7febfc006010 tx=0x7febfc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:01.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.935+0000 7fec10839640 1 -- 172.21.15.2:0/900129019 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc03f030 con 0x7fec0c101de0 2024-09-19T06:21:01.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.935+0000 7fec1183b640 1 -- 172.21.15.2:0/900129019 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec0c1a6c00 con 0x7fec0c101de0 2024-09-19T06:21:01.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.935+0000 7fec10839640 1 -- 172.21.15.2:0/900129019 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7febfc0035f0 con 0x7fec0c101de0 2024-09-19T06:21:01.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.935+0000 7fec10839640 1 -- 172.21.15.2:0/900129019 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc035070 con 0x7fec0c101de0 2024-09-19T06:21:01.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.935+0000 7fec1183b640 1 -- 172.21.15.2:0/900129019 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec0c1a70e0 con 0x7fec0c101de0 2024-09-19T06:21:01.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.938+0000 7fec10839640 1 -- 172.21.15.2:0/900129019 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7febfc003b10 con 0x7fec0c101de0 2024-09-19T06:21:01.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.938+0000 7fec13c14740 1 Processor -- start 2024-09-19T06:21:01.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.938+0000 7fec13c14740 1 -- start start 2024-09-19T06:21:01.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.938+0000 7fec13c14740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558574967b60 0x558574967f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:01.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.938+0000 7fec13c14740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558574968480 0x558574972800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:01.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.938+0000 7fec13c14740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558574972d40 0x558574975130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:01.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.938+0000 7fec13c14740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5585748cd280 con 0x558574967b60 2024-09-19T06:21:01.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.938+0000 7fec13c14740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x558574874b10 con 0x558574972d40 2024-09-19T06:21:01.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.938+0000 7fec13c14740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5585748c9240 con 0x558574968480 2024-09-19T06:21:01.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.938+0000 7fec0b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558574967b60 0x558574967f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:01.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.938+0000 7fec0b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558574967b60 0x558574967f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47990/0 (socket says 172.21.15.2:47990) 2024-09-19T06:21:01.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.938+0000 7fec0b7fe640 1 -- 172.21.15.2:0/1058837354 learned_addr learned my addr 172.21.15.2:0/1058837354 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:01.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.939+0000 7fec03fff640 1 --2- 172.21.15.2:0/1058837354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558574972d40 0x558574975130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:01.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.939+0000 7fec0affd640 1 --2- 172.21.15.2:0/1058837354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558574968480 0x558574972800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:01.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.939+0000 7fec0b7fe640 1 -- 172.21.15.2:0/1058837354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558574968480 msgr2=0x558574972800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:01.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.939+0000 7fec10839640 1 --2- 172.21.15.2:0/900129019 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7febf80a33b0 0x7febf80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:01.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.939+0000 7fec0b7fe640 1 --2- 172.21.15.2:0/1058837354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558574968480 0x558574972800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:01.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.939+0000 7fec0b7fe640 1 -- 172.21.15.2:0/1058837354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558574972d40 msgr2=0x558574975130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:01.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.939+0000 7fec0b7fe640 1 --2- 172.21.15.2:0/1058837354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558574972d40 0x558574975130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:01.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.939+0000 7fec0b7fe640 1 -- 172.21.15.2:0/1058837354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585748811f0 con 0x558574967b60 2024-09-19T06:21:01.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.939+0000 7fec0affd640 1 --2- 172.21.15.2:0/1058837354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558574968480 0x558574972800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:01.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.939+0000 7fec0b7fe640 1 --2- 172.21.15.2:0/900129019 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7febf80a33b0 0x7febf80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:01.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.939+0000 7fec10839640 1 -- 172.21.15.2:0/900129019 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7febfc0f0920 con 0x7fec0c101de0 2024-09-19T06:21:01.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.939+0000 7fec0b7fe640 1 --2- 172.21.15.2:0/1058837354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558574967b60 0x558574967f40 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fec04007f30 tx=0x7fec0400c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78c89f77939a032e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:01.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.939+0000 7fec01ffb640 1 -- 172.21.15.2:0/1058837354 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0400fc90 con 0x558574967b60 2024-09-19T06:21:01.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.939+0000 7fec01ffb640 1 -- 172.21.15.2:0/1058837354 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fec0401b880 con 0x558574967b60 2024-09-19T06:21:01.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.939+0000 7fec01ffb640 1 -- 172.21.15.2:0/1058837354 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0400e6c0 con 0x558574967b60 2024-09-19T06:21:01.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.940+0000 7fec13c14740 1 -- 172.21.15.2:0/1058837354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558574967b60 msgr2=0x558574967f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:01.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.940+0000 7fec0b7fe640 1 --2- 172.21.15.2:0/900129019 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7febf80a33b0 0x7febf80a5870 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fec0401b000 tx=0x7fec0401e000 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:01.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.940+0000 7fec13c14740 1 --2- 172.21.15.2:0/1058837354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558574967b60 0x558574967f40 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fec04007f30 tx=0x7fec0400c750 comp rx=0 tx=0).stop 2024-09-19T06:21:01.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.940+0000 7fec13c14740 1 -- 172.21.15.2:0/1058837354 shutdown_connections 2024-09-19T06:21:01.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.940+0000 7fec13c14740 1 --2- 172.21.15.2:0/1058837354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558574972d40 0x558574975130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:01.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.940+0000 7fec13c14740 1 --2- 172.21.15.2:0/1058837354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558574968480 0x558574972800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:01.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.940+0000 7fec13c14740 1 --2- 172.21.15.2:0/1058837354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558574967b60 0x558574967f40 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:01.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.940+0000 7fec13c14740 1 -- 172.21.15.2:0/1058837354 >> 172.21.15.2:0/1058837354 conn(0x5585749640f0 msgr2=0x5585749644d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:01.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.940+0000 7fec13c14740 1 -- 172.21.15.2:0/1058837354 shutdown_connections 2024-09-19T06:21:01.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.940+0000 7fec13c14740 1 -- 172.21.15.2:0/1058837354 wait complete. 2024-09-19T06:21:01.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.941+0000 7fec13c14740 1 -- start start 2024-09-19T06:21:01.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.941+0000 7fec13c14740 1 Processor -- start 2024-09-19T06:21:01.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.941+0000 7fec13c14740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558574967b60 0x55857496fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:01.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.941+0000 7fec13c14740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558574968480 0x5585749700f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:01.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.941+0000 7fec13c14740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558574972d40 0x558574970630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:01.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.941+0000 7fec13c14740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558574975910 con 0x558574972d40 2024-09-19T06:21:01.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.941+0000 7fec13c14740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x558574887f10 con 0x558574967b60 2024-09-19T06:21:01.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.941+0000 7fec13c14740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x558574975a90 con 0x558574968480 2024-09-19T06:21:01.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.941+0000 7fec13c14740 10 client.0 _ll_register_callbacks cb 0x558574850a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:01.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.941+0000 7fec0b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558574972d40 0x558574970630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:01.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.941+0000 7fec0b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558574972d40 0x558574970630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47998/0 (socket says 172.21.15.2:47998) 2024-09-19T06:21:01.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.941+0000 7fec0b7fe640 1 -- 172.21.15.2:0/3098458006 learned_addr learned my addr 172.21.15.2:0/3098458006 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:01.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.941+0000 7fec0affd640 1 --2- 172.21.15.2:0/3098458006 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558574967b60 0x55857496fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:01.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.941+0000 7fec03fff640 1 --2- 172.21.15.2:0/3098458006 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558574968480 0x5585749700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:01.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.942+0000 7fec0b7fe640 1 -- 172.21.15.2:0/3098458006 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558574968480 msgr2=0x5585749700f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:01.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.942+0000 7fec0b7fe640 1 --2- 172.21.15.2:0/3098458006 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558574968480 0x5585749700f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:01.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.942+0000 7fec0b7fe640 1 -- 172.21.15.2:0/3098458006 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558574967b60 msgr2=0x55857496fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:01.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.942+0000 7fec0b7fe640 1 --2- 172.21.15.2:0/3098458006 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558574967b60 0x55857496fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:01.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.942+0000 7fec0b7fe640 1 -- 172.21.15.2:0/3098458006 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55857463e6a0 con 0x558574972d40 2024-09-19T06:21:01.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.942+0000 7fec03fff640 1 --2- 172.21.15.2:0/3098458006 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558574968480 0x5585749700f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:01.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.942+0000 7fec0b7fe640 1 --2- 172.21.15.2:0/3098458006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558574972d40 0x558574970630 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fec04007fa0 tx=0x7fec04007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d8d605d23669f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:01.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.942+0000 7febeaffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:01.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.942+0000 7febeaffd640 1 -- 172.21.15.2:0/3098458006 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0401cb60 con 0x558574972d40 2024-09-19T06:21:01.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.942+0000 7febeaffd640 1 -- 172.21.15.2:0/3098458006 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fec0401cd00 con 0x558574972d40 2024-09-19T06:21:01.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.942+0000 7fec13c14740 1 -- 172.21.15.2:0/3098458006 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec0401b880 con 0x558574972d40 2024-09-19T06:21:01.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.942+0000 7febeaffd640 1 -- 172.21.15.2:0/3098458006 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fec0401b3d0 con 0x558574972d40 2024-09-19T06:21:01.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.942+0000 7fec13c14740 10 client.17178 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:01.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.942+0000 7fec13c14740 1 -- 172.21.15.2:0/3098458006 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5585749814a0 con 0x558574972d40 2024-09-19T06:21:01.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.942+0000 7febeaffd640 1 -- 172.21.15.2:0/3098458006 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fec0401b880 con 0x558574972d40 2024-09-19T06:21:01.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.943+0000 7febeaffd640 1 -- 172.21.15.2:0/3098458006 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fec04024040 con 0x558574972d40 2024-09-19T06:21:01.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.943+0000 7fec13c14740 10 client.17178 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:01.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.943+0000 7fec13c14740 10 client.17178 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:01.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.943+0000 7fec13c14740 20 client.17178 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:01.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.943+0000 7fec13c14740 1 --2- 172.21.15.2:0/3098458006 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558574982960 0x558574984d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:01.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.943+0000 7fec13c14740 4 client.17178 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:01.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.943+0000 7fec13c14740 1 -- 172.21.15.2:0/3098458006 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5585748da7f0 con 0x558574982960 2024-09-19T06:21:01.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.943+0000 7fec0affd640 1 --2- 172.21.15.2:0/3098458006 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558574982960 0x558574984d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:01.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.943+0000 7fec0affd640 1 --2- 172.21.15.2:0/3098458006 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558574982960 0x558574984d50 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f927f89679c6b0b6 server_cookie=d1ff32da4ace2c4 in_seq=0 out_seq=0 2024-09-19T06:21:01.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.943+0000 7febeaffd640 10 client.17178 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:01.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.944+0000 7febeaffd640 1 -- 172.21.15.2:0/3098458006 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5585748da7f0 con 0x558574982960 2024-09-19T06:21:01.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.944+0000 7febeaffd640 10 client.17178 handle_command_reply: tid=0 2024-09-19T06:21:01.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.944+0000 7fec13c14740 1 client.17178 shutdown 2024-09-19T06:21:01.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.944+0000 7fec13c14740 1 -- 172.21.15.2:0/3098458006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558574972d40 msgr2=0x558574970630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:01.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.944+0000 7fec13c14740 1 --2- 172.21.15.2:0/3098458006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558574972d40 0x558574970630 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fec04007fa0 tx=0x7fec04007c70 comp rx=0 tx=0).stop 2024-09-19T06:21:01.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.944+0000 7fec13c14740 1 -- 172.21.15.2:0/3098458006 shutdown_connections 2024-09-19T06:21:01.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.944+0000 7fec13c14740 1 --2- 172.21.15.2:0/3098458006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558574972d40 0x558574970630 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:01.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.944+0000 7fec13c14740 1 --2- 172.21.15.2:0/3098458006 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558574968480 0x5585749700f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:01.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.944+0000 7fec13c14740 1 --2- 172.21.15.2:0/3098458006 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558574982960 0x558574984d50 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:01.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.944+0000 7fec13c14740 1 --2- 172.21.15.2:0/3098458006 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558574967b60 0x55857496fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:01.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.944+0000 7fec13c14740 1 -- 172.21.15.2:0/3098458006 >> 172.21.15.2:0/3098458006 conn(0x5585749640f0 msgr2=0x558574963270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:01.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.944+0000 7febeaffd640 0 client.17178 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:01.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.945+0000 7fec13c14740 1 -- 172.21.15.2:0/3098458006 shutdown_connections 2024-09-19T06:21:01.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.945+0000 7fec13c14740 1 -- 172.21.15.2:0/3098458006 wait complete. 2024-09-19T06:21:01.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.945+0000 7fec13c14740 20 client.17178 trim_cache size 0 max 16384 2024-09-19T06:21:01.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.962+0000 7fec13c14740 1 Processor -- start 2024-09-19T06:21:01.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.962+0000 7fec13c14740 1 -- start start 2024-09-19T06:21:01.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.962+0000 7fec13c14740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558574967b60 0x55857496a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:01.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.962+0000 7fec13c14740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558574968480 0x55857498a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:01.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.962+0000 7fec13c14740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558574972d40 0x55857498a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:01.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.962+0000 7fec13c14740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fec0c1b2270 con 0x558574967b60 2024-09-19T06:21:01.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.962+0000 7fec13c14740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fec0c1afb40 con 0x558574968480 2024-09-19T06:21:01.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.962+0000 7fec13c14740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fec0c1ad990 con 0x558574972d40 2024-09-19T06:21:01.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.962+0000 7fec0affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558574967b60 0x55857496a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:01.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.962+0000 7fec0affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558574967b60 0x55857496a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48002/0 (socket says 172.21.15.2:48002) 2024-09-19T06:21:01.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.962+0000 7fec0affd640 1 -- 172.21.15.2:0/2209124965 learned_addr learned my addr 172.21.15.2:0/2209124965 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:01.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.962+0000 7fec03fff640 1 --2- 172.21.15.2:0/2209124965 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558574968480 0x55857498a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:01.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.962+0000 7fec0affd640 1 -- 172.21.15.2:0/2209124965 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558574972d40 msgr2=0x55857498a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:01.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.962+0000 7fec0affd640 1 --2- 172.21.15.2:0/2209124965 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558574972d40 0x55857498a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:01.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.962+0000 7fec0affd640 1 -- 172.21.15.2:0/2209124965 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558574968480 msgr2=0x55857498a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:01.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.962+0000 7fec0affd640 1 --2- 172.21.15.2:0/2209124965 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558574968480 0x55857498a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:01.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.962+0000 7fec0affd640 1 -- 172.21.15.2:0/2209124965 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585749682b0 con 0x558574967b60 2024-09-19T06:21:01.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.962+0000 7fec03fff640 1 --2- 172.21.15.2:0/2209124965 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558574968480 0x55857498a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:21:01.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.963+0000 7fec0affd640 1 --2- 172.21.15.2:0/2209124965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558574967b60 0x55857496a5c0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7febfc005ec0 tx=0x7febfc0a7040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b2527fb3c3559d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:01.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.963+0000 7fec017fa640 1 -- 172.21.15.2:0/2209124965 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc049070 con 0x558574967b60 2024-09-19T06:21:01.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.963+0000 7fec017fa640 1 -- 172.21.15.2:0/2209124965 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7febfc0c0fe0 con 0x558574967b60 2024-09-19T06:21:01.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.963+0000 7fec017fa640 1 -- 172.21.15.2:0/2209124965 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc031aa0 con 0x558574967b60 2024-09-19T06:21:01.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.963+0000 7fec13c14740 1 -- 172.21.15.2:0/2209124965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558574967b60 msgr2=0x55857496a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:01.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.963+0000 7fec13c14740 1 --2- 172.21.15.2:0/2209124965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558574967b60 0x55857496a5c0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7febfc005ec0 tx=0x7febfc0a7040 comp rx=0 tx=0).stop 2024-09-19T06:21:01.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.963+0000 7fec13c14740 1 -- 172.21.15.2:0/2209124965 shutdown_connections 2024-09-19T06:21:01.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.963+0000 7fec13c14740 1 --2- 172.21.15.2:0/2209124965 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558574972d40 0x55857498a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:01.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.963+0000 7fec13c14740 1 --2- 172.21.15.2:0/2209124965 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558574968480 0x55857498a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:01.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.963+0000 7fec13c14740 1 --2- 172.21.15.2:0/2209124965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558574967b60 0x55857496a5c0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:01.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.963+0000 7fec13c14740 1 -- 172.21.15.2:0/2209124965 >> 172.21.15.2:0/2209124965 conn(0x5585749640f0 msgr2=0x558574971b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:01.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.964+0000 7fec13c14740 1 -- 172.21.15.2:0/2209124965 shutdown_connections 2024-09-19T06:21:01.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.964+0000 7fec13c14740 1 -- 172.21.15.2:0/2209124965 wait complete. 2024-09-19T06:21:01.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.964+0000 7fec13c14740 1 -- start start 2024-09-19T06:21:01.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.964+0000 7fec13c14740 1 Processor -- start 2024-09-19T06:21:01.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.964+0000 7fec13c14740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558574967b60 0x558574977160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:01.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.964+0000 7fec13c14740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558574968480 0x5585749776a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:01.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.964+0000 7fec13c14740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558574972d40 0x5585749ec3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:01.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.964+0000 7fec13c14740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fec0c1ae000 con 0x558574972d40 2024-09-19T06:21:01.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.964+0000 7fec13c14740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fec0c1af470 con 0x558574967b60 2024-09-19T06:21:01.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.964+0000 7fec13c14740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fec0c1ae6d0 con 0x558574968480 2024-09-19T06:21:01.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.964+0000 7fec13c14740 10 client.0 _ll_register_callbacks cb 0x7febf400c2d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:01.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.964+0000 7fec0b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558574972d40 0x5585749ec3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:01.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.965+0000 7fec0b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558574972d40 0x5585749ec3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48008/0 (socket says 172.21.15.2:48008) 2024-09-19T06:21:01.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.965+0000 7fec0b7fe640 1 -- 172.21.15.2:0/3465687869 learned_addr learned my addr 172.21.15.2:0/3465687869 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:01.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.965+0000 7fec0affd640 1 --2- 172.21.15.2:0/3465687869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558574967b60 0x558574977160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:01.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.965+0000 7fec03fff640 1 --2- 172.21.15.2:0/3465687869 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558574968480 0x5585749776a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:01.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.965+0000 7fec0b7fe640 1 -- 172.21.15.2:0/3465687869 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558574968480 msgr2=0x5585749776a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:01.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.965+0000 7fec0b7fe640 1 --2- 172.21.15.2:0/3465687869 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558574968480 0x5585749776a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:01.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.965+0000 7fec0b7fe640 1 -- 172.21.15.2:0/3465687869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558574967b60 msgr2=0x558574977160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:01.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.965+0000 7fec0b7fe640 1 --2- 172.21.15.2:0/3465687869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558574967b60 0x558574977160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:01.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.965+0000 7fec0b7fe640 1 -- 172.21.15.2:0/3465687869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585749ec8f0 con 0x558574972d40 2024-09-19T06:21:01.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.965+0000 7fec0b7fe640 1 --2- 172.21.15.2:0/3465687869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558574972d40 0x5585749ec3b0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fec0400cc50 tx=0x7fec0401c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51d2390339f2a00a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:01.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.965+0000 7febeaffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:01.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.965+0000 7febeaffd640 1 -- 172.21.15.2:0/3465687869 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec040071f0 con 0x558574972d40 2024-09-19T06:21:01.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.965+0000 7fec13c14740 1 -- 172.21.15.2:0/3465687869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febfc0c0fe0 con 0x558574972d40 2024-09-19T06:21:01.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.965+0000 7febeaffd640 1 -- 172.21.15.2:0/3465687869 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fec0401bd40 con 0x558574972d40 2024-09-19T06:21:01.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.965+0000 7febeaffd640 1 -- 172.21.15.2:0/3465687869 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fec0401b030 con 0x558574972d40 2024-09-19T06:21:01.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.965+0000 7fec13c14740 10 client.17184 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:01.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.965+0000 7fec13c14740 1 -- 172.21.15.2:0/3465687869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5585749edb20 con 0x558574972d40 2024-09-19T06:21:01.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.966+0000 7febeaffd640 1 -- 172.21.15.2:0/3465687869 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7febfc0c0fe0 con 0x558574972d40 2024-09-19T06:21:01.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.966+0000 7febeaffd640 1 -- 172.21.15.2:0/3465687869 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fec04026470 con 0x558574972d40 2024-09-19T06:21:01.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.966+0000 7fec13c14740 10 client.17184 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:01.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.966+0000 7fec13c14740 10 client.17184 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:01.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.966+0000 7fec13c14740 20 client.17184 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:01.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.966+0000 7fec13c14740 1 --2- 172.21.15.2:0/3465687869 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5585749ee240 0x5585749f0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:01.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.966+0000 7fec13c14740 4 client.17184 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:21:01.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.966+0000 7fec13c14740 1 -- 172.21.15.2:0/3465687869 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5585748d4d00 con 0x5585749ee240 2024-09-19T06:21:01.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.966+0000 7fec0affd640 1 --2- 172.21.15.2:0/3465687869 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5585749ee240 0x5585749f0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:01.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.967+0000 7fec0affd640 1 --2- 172.21.15.2:0/3465687869 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5585749ee240 0x5585749f0630 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d848c249c083419 server_cookie=3744d5c5b34ad93a in_seq=0 out_seq=0 2024-09-19T06:21:01.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.967+0000 7febeaffd640 10 client.17184 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:01.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.968+0000 7febeaffd640 1 -- 172.21.15.2:0/3465687869 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5585748d4d00 con 0x5585749ee240 2024-09-19T06:21:01.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.968+0000 7febeaffd640 10 client.17184 handle_command_reply: tid=0 2024-09-19T06:21:01.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.968+0000 7fec13c14740 1 client.17184 shutdown 2024-09-19T06:21:01.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.968+0000 7fec13c14740 1 -- 172.21.15.2:0/3465687869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558574972d40 msgr2=0x5585749ec3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:01.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.968+0000 7fec13c14740 1 --2- 172.21.15.2:0/3465687869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558574972d40 0x5585749ec3b0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fec0400cc50 tx=0x7fec0401c8d0 comp rx=0 tx=0).stop 2024-09-19T06:21:01.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.968+0000 7fec13c14740 1 -- 172.21.15.2:0/3465687869 shutdown_connections 2024-09-19T06:21:01.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.968+0000 7fec13c14740 1 --2- 172.21.15.2:0/3465687869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558574972d40 0x5585749ec3b0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:01.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.968+0000 7fec13c14740 1 --2- 172.21.15.2:0/3465687869 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558574968480 0x5585749776a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:01.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.968+0000 7fec13c14740 1 --2- 172.21.15.2:0/3465687869 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5585749ee240 0x5585749f0630 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:01.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.968+0000 7fec13c14740 1 --2- 172.21.15.2:0/3465687869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558574967b60 0x558574977160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:01.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.968+0000 7fec13c14740 1 -- 172.21.15.2:0/3465687869 >> 172.21.15.2:0/3465687869 conn(0x5585749640f0 msgr2=0x558574962a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:01.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.968+0000 7febeaffd640 0 client.17184 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:01.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.968+0000 7fec13c14740 1 -- 172.21.15.2:0/3465687869 shutdown_connections 2024-09-19T06:21:01.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.968+0000 7fec13c14740 1 -- 172.21.15.2:0/3465687869 wait complete. 2024-09-19T06:21:01.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.968+0000 7fec13c14740 20 client.17184 trim_cache size 0 max 16384 2024-09-19T06:21:01.975 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:21:01.975 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T06:21:01.975 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "ea4dc893-13d1-4422-899b-c4cc9eccf971", 2024-09-19T06:21:01.975 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T06:21:01.975 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:21:01.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.969+0000 7fec1183b640 1 -- 172.21.15.2:0/900129019 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7febf80a33b0 msgr2=0x7febf80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:01.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.969+0000 7fec1183b640 1 --2- 172.21.15.2:0/900129019 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7febf80a33b0 0x7febf80a5870 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fec0401b000 tx=0x7fec0401e000 comp rx=0 tx=0).stop 2024-09-19T06:21:01.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.969+0000 7fec1183b640 1 -- 172.21.15.2:0/900129019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec0c101de0 msgr2=0x7fec0c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:01.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.969+0000 7fec1183b640 1 --2- 172.21.15.2:0/900129019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec0c101de0 0x7fec0c0744f0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7febfc006010 tx=0x7febfc004270 comp rx=0 tx=0).stop 2024-09-19T06:21:01.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.969+0000 7fec1183b640 1 -- 172.21.15.2:0/900129019 shutdown_connections 2024-09-19T06:21:01.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.969+0000 7fec1183b640 1 --2- 172.21.15.2:0/900129019 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7febf80a33b0 0x7febf80a5870 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:01.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.969+0000 7fec1183b640 1 --2- 172.21.15.2:0/900129019 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fec0c106f10 0x7fec0c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:01.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.969+0000 7fec1183b640 1 --2- 172.21.15.2:0/900129019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec0c102790 0x7fec0c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:01.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.969+0000 7fec1183b640 1 --2- 172.21.15.2:0/900129019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec0c101de0 0x7fec0c0744f0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:01.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.969+0000 7fec1183b640 1 -- 172.21.15.2:0/900129019 >> 172.21.15.2:0/900129019 conn(0x7fec0c0fd8c0 msgr2=0x7fec0c0feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:01.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.969+0000 7fec1183b640 1 -- 172.21.15.2:0/900129019 shutdown_connections 2024-09-19T06:21:01.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:01.969+0000 7fec1183b640 1 -- 172.21.15.2:0/900129019 wait complete. 2024-09-19T06:21:02.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:01 smithi002 ceph-mon[30982]: pgmap v189: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:21:02.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:01 smithi089 ceph-mon[34160]: pgmap v189: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:21:02.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:01 smithi090 ceph-mon[34497]: pgmap v189: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:21:02.613 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:21:02.909 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:03.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:02 smithi089 ceph-mon[34160]: scrub queued for path: / 2024-09-19T06:21:03.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:02 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:03.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:02 smithi089 ceph-mon[34160]: scrub summary: active paths [/] 2024-09-19T06:21:03.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:02 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:03.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:02 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:21:03.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:02 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:21:03.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:02 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:21:03.293 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:02 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:21:03.298 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:02 smithi002 ceph-mon[30982]: scrub queued for path: / 2024-09-19T06:21:03.298 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:02 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:03.298 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:02 smithi002 ceph-mon[30982]: scrub summary: active paths [/] 2024-09-19T06:21:03.299 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:02 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:03.299 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:02 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:21:03.299 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:02 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:21:03.299 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:02 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:21:03.299 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:02 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:21:03.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.380+0000 7f0941116640 1 -- 172.21.15.2:0/1385998499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f093c106a80 msgr2=0x7f093c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:03.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.380+0000 7f0941116640 1 --2- 172.21.15.2:0/1385998499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f093c106a80 0x7f093c106e60 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f092c009930 tx=0x7f092c02a420 comp rx=0 tx=0).stop 2024-09-19T06:21:03.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.380+0000 7f0941116640 1 -- 172.21.15.2:0/1385998499 shutdown_connections 2024-09-19T06:21:03.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.380+0000 7f0941116640 1 --2- 172.21.15.2:0/1385998499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f093c101420 0x7f093c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.380+0000 7f0941116640 1 --2- 172.21.15.2:0/1385998499 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f093c100a80 0x7f093c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.380+0000 7f0941116640 1 --2- 172.21.15.2:0/1385998499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f093c106a80 0x7f093c106e60 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.380+0000 7f0941116640 1 -- 172.21.15.2:0/1385998499 >> 172.21.15.2:0/1385998499 conn(0x7f093c0fc7a0 msgr2=0x7f093c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:03.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.380+0000 7f0941116640 1 -- 172.21.15.2:0/1385998499 shutdown_connections 2024-09-19T06:21:03.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.380+0000 7f0941116640 1 -- 172.21.15.2:0/1385998499 wait complete. 2024-09-19T06:21:03.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.381+0000 7f0941116640 1 Processor -- start 2024-09-19T06:21:03.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.381+0000 7f0941116640 1 -- start start 2024-09-19T06:21:03.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.381+0000 7f0941116640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f093c100a80 0x7f093c19a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:03.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.381+0000 7f0941116640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f093c101420 0x7f093c19aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:03.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.381+0000 7f0941116640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f093c106a80 0x7f093c19ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:03.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.382+0000 7f0941116640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f093c110d30 con 0x7f093c106a80 2024-09-19T06:21:03.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.382+0000 7f0941116640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f093c110bb0 con 0x7f093c100a80 2024-09-19T06:21:03.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.382+0000 7f0941116640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f093c110eb0 con 0x7f093c101420 2024-09-19T06:21:03.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.382+0000 7f093b59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f093c106a80 0x7f093c19ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:03.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.382+0000 7f093a59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f093c101420 0x7f093c19aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:03.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.382+0000 7f093b59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f093c106a80 0x7f093c19ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48034/0 (socket says 172.21.15.2:48034) 2024-09-19T06:21:03.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.382+0000 7f093b59e640 1 -- 172.21.15.2:0/2286313329 learned_addr learned my addr 172.21.15.2:0/2286313329 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:03.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.382+0000 7f093ad9d640 1 --2- 172.21.15.2:0/2286313329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f093c100a80 0x7f093c19a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:03.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.382+0000 7f093b59e640 1 -- 172.21.15.2:0/2286313329 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f093c101420 msgr2=0x7f093c19aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:03.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.382+0000 7f093b59e640 1 --2- 172.21.15.2:0/2286313329 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f093c101420 0x7f093c19aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.382+0000 7f093b59e640 1 -- 172.21.15.2:0/2286313329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f093c100a80 msgr2=0x7f093c19a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:03.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.382+0000 7f093b59e640 1 --2- 172.21.15.2:0/2286313329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f093c100a80 0x7f093c19a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.382+0000 7f093b59e640 1 -- 172.21.15.2:0/2286313329 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f093c19f4c0 con 0x7f093c106a80 2024-09-19T06:21:03.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.382+0000 7f093a59c640 1 --2- 172.21.15.2:0/2286313329 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f093c101420 0x7f093c19aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:03.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.382+0000 7f093b59e640 1 --2- 172.21.15.2:0/2286313329 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f093c106a80 0x7f093c19ede0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f093400cce0 tx=0x7f093400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:03.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.382+0000 7f0923fff640 1 -- 172.21.15.2:0/2286313329 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093400f450 con 0x7f093c106a80 2024-09-19T06:21:03.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.382+0000 7f0923fff640 1 -- 172.21.15.2:0/2286313329 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f093400faa0 con 0x7f093c106a80 2024-09-19T06:21:03.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.382+0000 7f0941116640 1 -- 172.21.15.2:0/2286313329 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f093c19f7b0 con 0x7f093c106a80 2024-09-19T06:21:03.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.383+0000 7f0923fff640 1 -- 172.21.15.2:0/2286313329 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0934018b70 con 0x7f093c106a80 2024-09-19T06:21:03.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.383+0000 7f0941116640 1 -- 172.21.15.2:0/2286313329 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f093c1a7090 con 0x7f093c106a80 2024-09-19T06:21:03.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.385+0000 7f0923fff640 1 -- 172.21.15.2:0/2286313329 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f0934018d10 con 0x7f093c106a80 2024-09-19T06:21:03.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.385+0000 7f09434ef740 1 Processor -- start 2024-09-19T06:21:03.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.385+0000 7f09434ef740 1 -- start start 2024-09-19T06:21:03.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.385+0000 7f09434ef740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558742eab4a0 0x558742eab880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:03.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.385+0000 7f09434ef740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558742eabdc0 0x558742eb6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:03.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.385+0000 7f09434ef740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558742eb6680 0x558742eb8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:03.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.385+0000 7f09434ef740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558742e112e0 con 0x558742eab4a0 2024-09-19T06:21:03.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.385+0000 7f09434ef740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x558742db8ce0 con 0x558742eb6680 2024-09-19T06:21:03.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.385+0000 7f09434ef740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x558742e0d2a0 con 0x558742eabdc0 2024-09-19T06:21:03.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.385+0000 7f093a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558742eab4a0 0x558742eab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:03.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.385+0000 7f093a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558742eab4a0 0x558742eab880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48050/0 (socket says 172.21.15.2:48050) 2024-09-19T06:21:03.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.385+0000 7f093a59c640 1 -- 172.21.15.2:0/669977562 learned_addr learned my addr 172.21.15.2:0/669977562 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:03.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.386+0000 7f093a59c640 1 --2- 172.21.15.2:0/669977562 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558742eb6680 0x558742eb8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:03.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.386+0000 7f0923fff640 1 --2- 172.21.15.2:0/2286313329 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f09240a33b0 0x7f09240a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:03.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.386+0000 7f093ad9d640 1 --2- 172.21.15.2:0/669977562 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558742eabdc0 0x558742eb6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:03.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.386+0000 7f093a59c640 1 -- 172.21.15.2:0/669977562 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558742eabdc0 msgr2=0x558742eb6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:03.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.386+0000 7f093a59c640 1 --2- 172.21.15.2:0/669977562 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558742eabdc0 0x558742eb6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.386+0000 7f093a59c640 1 -- 172.21.15.2:0/669977562 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558742eb6680 msgr2=0x558742eb8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:03.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.386+0000 7f093a59c640 1 --2- 172.21.15.2:0/669977562 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558742eb6680 0x558742eb8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.386+0000 7f093a59c640 1 -- 172.21.15.2:0/669977562 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558742d9d440 con 0x558742eab4a0 2024-09-19T06:21:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.386+0000 7f093b59e640 1 --2- 172.21.15.2:0/2286313329 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f09240a33b0 0x7f09240a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.386+0000 7f0923fff640 1 -- 172.21.15.2:0/2286313329 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f09340d0010 con 0x7f093c106a80 2024-09-19T06:21:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.386+0000 7f093a59c640 1 --2- 172.21.15.2:0/669977562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558742eab4a0 0x558742eab880 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f0930009710 tx=0x7f0930009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a1c5f9ab12060a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.386+0000 7f09217fa640 1 -- 172.21.15.2:0/669977562 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0930004030 con 0x558742eab4a0 2024-09-19T06:21:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.386+0000 7f09217fa640 1 -- 172.21.15.2:0/669977562 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f093000f980 con 0x558742eab4a0 2024-09-19T06:21:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.386+0000 7f09217fa640 1 -- 172.21.15.2:0/669977562 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0930003ab0 con 0x558742eab4a0 2024-09-19T06:21:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.387+0000 7f09434ef740 1 -- 172.21.15.2:0/669977562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558742eab4a0 msgr2=0x558742eab880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.387+0000 7f093b59e640 1 --2- 172.21.15.2:0/2286313329 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f09240a33b0 0x7f09240a5870 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f09340a4a60 tx=0x7f093401baf0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.387+0000 7f09434ef740 1 --2- 172.21.15.2:0/669977562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558742eab4a0 0x558742eab880 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f0930009710 tx=0x7f0930009c00 comp rx=0 tx=0).stop 2024-09-19T06:21:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.387+0000 7f09434ef740 1 -- 172.21.15.2:0/669977562 shutdown_connections 2024-09-19T06:21:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.387+0000 7f09434ef740 1 --2- 172.21.15.2:0/669977562 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558742eb6680 0x558742eb8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.387+0000 7f09434ef740 1 --2- 172.21.15.2:0/669977562 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558742eabdc0 0x558742eb6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.387+0000 7f09434ef740 1 --2- 172.21.15.2:0/669977562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558742eab4a0 0x558742eab880 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.387+0000 7f09434ef740 1 -- 172.21.15.2:0/669977562 >> 172.21.15.2:0/669977562 conn(0x558742ea7a30 msgr2=0x558742ea7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.387+0000 7f09434ef740 1 -- 172.21.15.2:0/669977562 shutdown_connections 2024-09-19T06:21:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.387+0000 7f09434ef740 1 -- 172.21.15.2:0/669977562 wait complete. 2024-09-19T06:21:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.387+0000 7f09434ef740 1 -- start start 2024-09-19T06:21:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.388+0000 7f09434ef740 1 Processor -- start 2024-09-19T06:21:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.388+0000 7f09434ef740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558742eab4a0 0x558742eb5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.388+0000 7f09434ef740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558742eabdc0 0x558742eb32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.388+0000 7f09434ef740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558742eb6680 0x558742eb3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.388+0000 7f09434ef740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558742eb9250 con 0x558742eabdc0 2024-09-19T06:21:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.388+0000 7f09434ef740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x558742dcc050 con 0x558742eb6680 2024-09-19T06:21:03.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.388+0000 7f09434ef740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x558742eb93d0 con 0x558742eab4a0 2024-09-19T06:21:03.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.388+0000 7f09434ef740 10 client.0 _ll_register_callbacks cb 0x558742e0c160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:03.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.388+0000 7f093ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558742eabdc0 0x558742eb32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:03.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.388+0000 7f093ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558742eabdc0 0x558742eb32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48066/0 (socket says 172.21.15.2:48066) 2024-09-19T06:21:03.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.388+0000 7f093ad9d640 1 -- 172.21.15.2:0/1089220779 learned_addr learned my addr 172.21.15.2:0/1089220779 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:03.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.388+0000 7f093a59c640 1 --2- 172.21.15.2:0/1089220779 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558742eab4a0 0x558742eb5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:03.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.388+0000 7f093a59c640 1 --2- 172.21.15.2:0/1089220779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558742eb6680 0x558742eb3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:03.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.388+0000 7f093ad9d640 1 -- 172.21.15.2:0/1089220779 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558742eab4a0 msgr2=0x558742eb5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:03.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.388+0000 7f093ad9d640 1 --2- 172.21.15.2:0/1089220779 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558742eab4a0 0x558742eb5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.388+0000 7f093ad9d640 1 -- 172.21.15.2:0/1089220779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558742eb6680 msgr2=0x558742eb3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:03.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.388+0000 7f093ad9d640 1 --2- 172.21.15.2:0/1089220779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558742eb6680 0x558742eb3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.388+0000 7f093ad9d640 1 -- 172.21.15.2:0/1089220779 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558742b823c0 con 0x558742eabdc0 2024-09-19T06:21:03.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.389+0000 7f093ad9d640 1 --2- 172.21.15.2:0/1089220779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558742eabdc0 0x558742eb32a0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f092c02a940 tx=0x7f092c031f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=569676d786500035 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:03.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.389+0000 7f091eff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:03.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.389+0000 7f091eff5640 1 -- 172.21.15.2:0/1089220779 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f092c035040 con 0x558742eabdc0 2024-09-19T06:21:03.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.389+0000 7f09434ef740 1 -- 172.21.15.2:0/1089220779 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f093000f980 con 0x558742eabdc0 2024-09-19T06:21:03.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.389+0000 7f091eff5640 1 -- 172.21.15.2:0/1089220779 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f092c0317a0 con 0x558742eabdc0 2024-09-19T06:21:03.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.389+0000 7f091eff5640 1 -- 172.21.15.2:0/1089220779 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f092c004040 con 0x558742eabdc0 2024-09-19T06:21:03.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.389+0000 7f09434ef740 10 client.17196 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:03.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.389+0000 7f09434ef740 1 -- 172.21.15.2:0/1089220779 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x558742ec4c70 con 0x558742eabdc0 2024-09-19T06:21:03.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.389+0000 7f091eff5640 1 -- 172.21.15.2:0/1089220779 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f093000f980 con 0x558742eabdc0 2024-09-19T06:21:03.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.389+0000 7f091eff5640 1 -- 172.21.15.2:0/1089220779 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f092c0047a0 con 0x558742eabdc0 2024-09-19T06:21:03.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.389+0000 7f09434ef740 10 client.17196 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:03.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.389+0000 7f09434ef740 10 client.17196 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:03.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.389+0000 7f09434ef740 20 client.17196 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:03.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.389+0000 7f09434ef740 1 --2- 172.21.15.2:0/1089220779 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558742ec6080 0x558742ec84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:03.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.389+0000 7f09434ef740 4 client.17196 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:03.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.389+0000 7f09434ef740 1 -- 172.21.15.2:0/1089220779 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558742e1e850 con 0x558742ec6080 2024-09-19T06:21:03.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.390+0000 7f093a59c640 1 --2- 172.21.15.2:0/1089220779 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558742ec6080 0x558742ec84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:03.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.390+0000 7f091eff5640 10 client.17196 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:03.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.390+0000 7f093a59c640 1 --2- 172.21.15.2:0/1089220779 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558742ec6080 0x558742ec84a0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27333e110d934f6c server_cookie=33fed90ef0be23f8 in_seq=0 out_seq=0 2024-09-19T06:21:03.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.391+0000 7f091eff5640 1 -- 172.21.15.2:0/1089220779 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558742e1e850 con 0x558742ec6080 2024-09-19T06:21:03.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.391+0000 7f091eff5640 10 client.17196 handle_command_reply: tid=0 2024-09-19T06:21:03.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.391+0000 7f09434ef740 1 client.17196 shutdown 2024-09-19T06:21:03.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.391+0000 7f09434ef740 1 -- 172.21.15.2:0/1089220779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558742eabdc0 msgr2=0x558742eb32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:03.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.391+0000 7f09434ef740 1 --2- 172.21.15.2:0/1089220779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558742eabdc0 0x558742eb32a0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f092c02a940 tx=0x7f092c031f30 comp rx=0 tx=0).stop 2024-09-19T06:21:03.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.391+0000 7f09434ef740 1 -- 172.21.15.2:0/1089220779 shutdown_connections 2024-09-19T06:21:03.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.391+0000 7f09434ef740 1 --2- 172.21.15.2:0/1089220779 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558742ec6080 0x558742ec84a0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.391+0000 7f09434ef740 1 --2- 172.21.15.2:0/1089220779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558742eb6680 0x558742eb3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.391+0000 7f09434ef740 1 --2- 172.21.15.2:0/1089220779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558742eabdc0 0x558742eb32a0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.391+0000 7f091eff5640 0 client.17196 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:03.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.391+0000 7f09434ef740 1 --2- 172.21.15.2:0/1089220779 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558742eab4a0 0x558742eb5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.391+0000 7f09434ef740 1 -- 172.21.15.2:0/1089220779 >> 172.21.15.2:0/1089220779 conn(0x558742ea7a30 msgr2=0x558742ead760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:03.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.391+0000 7f09434ef740 1 -- 172.21.15.2:0/1089220779 shutdown_connections 2024-09-19T06:21:03.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.391+0000 7f09434ef740 1 -- 172.21.15.2:0/1089220779 wait complete. 2024-09-19T06:21:03.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.391+0000 7f09434ef740 20 client.17196 trim_cache size 0 max 16384 2024-09-19T06:21:03.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.408+0000 7f09434ef740 1 Processor -- start 2024-09-19T06:21:03.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.408+0000 7f09434ef740 1 -- start start 2024-09-19T06:21:03.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.408+0000 7f09434ef740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558742eab4a0 0x558742ec24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:03.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.409+0000 7f09434ef740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558742eabdc0 0x558742ecdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:03.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.409+0000 7f09434ef740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558742eb6680 0x558742ece2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:03.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.409+0000 7f09434ef740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f093c1b2160 con 0x558742eabdc0 2024-09-19T06:21:03.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.409+0000 7f09434ef740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f093c1afa30 con 0x558742eab4a0 2024-09-19T06:21:03.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.409+0000 7f09434ef740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f093c1ad880 con 0x558742eb6680 2024-09-19T06:21:03.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.409+0000 7f093ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558742eabdc0 0x558742ecdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:03.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.409+0000 7f093ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558742eabdc0 0x558742ecdd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48082/0 (socket says 172.21.15.2:48082) 2024-09-19T06:21:03.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.409+0000 7f093ad9d640 1 -- 172.21.15.2:0/314841374 learned_addr learned my addr 172.21.15.2:0/314841374 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:03.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.409+0000 7f093a59c640 1 --2- 172.21.15.2:0/314841374 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558742eab4a0 0x558742ec24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:03.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.409+0000 7f093a59c640 1 --2- 172.21.15.2:0/314841374 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558742eb6680 0x558742ece2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:03.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.409+0000 7f093ad9d640 1 -- 172.21.15.2:0/314841374 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558742eb6680 msgr2=0x558742ece2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:03.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.409+0000 7f093ad9d640 1 --2- 172.21.15.2:0/314841374 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558742eb6680 0x558742ece2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.409+0000 7f093ad9d640 1 -- 172.21.15.2:0/314841374 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558742eab4a0 msgr2=0x558742ec24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:03.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.409+0000 7f093ad9d640 1 --2- 172.21.15.2:0/314841374 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558742eab4a0 0x558742ec24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.409+0000 7f093ad9d640 1 -- 172.21.15.2:0/314841374 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558742eb3b70 con 0x558742eabdc0 2024-09-19T06:21:03.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.409+0000 7f093ad9d640 1 --2- 172.21.15.2:0/314841374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558742eabdc0 0x558742ecdd70 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f092c005ec0 tx=0x7f092c02a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3e1fb9623134110 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:03.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.409+0000 7f0920ff9640 1 -- 172.21.15.2:0/314841374 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f092c035030 con 0x558742eabdc0 2024-09-19T06:21:03.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.409+0000 7f0920ff9640 1 -- 172.21.15.2:0/314841374 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f092c0043e0 con 0x558742eabdc0 2024-09-19T06:21:03.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.409+0000 7f0920ff9640 1 -- 172.21.15.2:0/314841374 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f092c051040 con 0x558742eabdc0 2024-09-19T06:21:03.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.410+0000 7f09434ef740 1 -- 172.21.15.2:0/314841374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558742eabdc0 msgr2=0x558742ecdd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:03.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.410+0000 7f09434ef740 1 --2- 172.21.15.2:0/314841374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558742eabdc0 0x558742ecdd70 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f092c005ec0 tx=0x7f092c02a420 comp rx=0 tx=0).stop 2024-09-19T06:21:03.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.410+0000 7f09434ef740 1 -- 172.21.15.2:0/314841374 shutdown_connections 2024-09-19T06:21:03.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.410+0000 7f09434ef740 1 --2- 172.21.15.2:0/314841374 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558742eb6680 0x558742ece2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.410+0000 7f09434ef740 1 --2- 172.21.15.2:0/314841374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558742eabdc0 0x558742ecdd70 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.410+0000 7f09434ef740 1 --2- 172.21.15.2:0/314841374 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558742eab4a0 0x558742ec24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.410+0000 7f09434ef740 1 -- 172.21.15.2:0/314841374 >> 172.21.15.2:0/314841374 conn(0x558742ea7a30 msgr2=0x558742eb2390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:03.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.410+0000 7f09434ef740 1 -- 172.21.15.2:0/314841374 shutdown_connections 2024-09-19T06:21:03.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.410+0000 7f09434ef740 1 -- 172.21.15.2:0/314841374 wait complete. 2024-09-19T06:21:03.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.410+0000 7f09434ef740 1 -- start start 2024-09-19T06:21:03.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.410+0000 7f09434ef740 1 Processor -- start 2024-09-19T06:21:03.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.411+0000 7f09434ef740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558742eab4a0 0x558742ebea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:03.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.411+0000 7f09434ef740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558742eabdc0 0x558742eb9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:03.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.411+0000 7f09434ef740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558742eb6680 0x558742eba2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:03.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.411+0000 7f09434ef740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f093c1adef0 con 0x558742eab4a0 2024-09-19T06:21:03.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.411+0000 7f09434ef740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f093c1af360 con 0x558742eb6680 2024-09-19T06:21:03.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.411+0000 7f09434ef740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f093c1ae5c0 con 0x558742eabdc0 2024-09-19T06:21:03.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.411+0000 7f09434ef740 10 client.0 _ll_register_callbacks cb 0x7f092c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:03.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.411+0000 7f093a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558742eab4a0 0x558742ebea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:03.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.411+0000 7f093a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558742eab4a0 0x558742ebea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48090/0 (socket says 172.21.15.2:48090) 2024-09-19T06:21:03.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.411+0000 7f093a59c640 1 -- 172.21.15.2:0/2283999941 learned_addr learned my addr 172.21.15.2:0/2283999941 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:03.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.411+0000 7f093ad9d640 1 --2- 172.21.15.2:0/2283999941 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558742eabdc0 0x558742eb9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:03.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.411+0000 7f093a59c640 1 --2- 172.21.15.2:0/2283999941 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558742eb6680 0x558742eba2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:03.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.411+0000 7f093a59c640 1 -- 172.21.15.2:0/2283999941 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558742eabdc0 msgr2=0x558742eb9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:03.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.411+0000 7f093a59c640 1 --2- 172.21.15.2:0/2283999941 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558742eabdc0 0x558742eb9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.411+0000 7f093a59c640 1 -- 172.21.15.2:0/2283999941 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558742eb6680 msgr2=0x558742eba2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:03.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.411+0000 7f093a59c640 1 --2- 172.21.15.2:0/2283999941 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558742eb6680 0x558742eba2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.411+0000 7f093a59c640 1 -- 172.21.15.2:0/2283999941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558742eba7e0 con 0x558742eab4a0 2024-09-19T06:21:03.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.411+0000 7f093a59c640 1 --2- 172.21.15.2:0/2283999941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558742eab4a0 0x558742ebea30 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f09300096e0 tx=0x7f0930023040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37e52109e8246786 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:03.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.411+0000 7f091eff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:03.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.412+0000 7f091eff5640 1 -- 172.21.15.2:0/2283999941 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093000fe40 con 0x558742eab4a0 2024-09-19T06:21:03.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.412+0000 7f091eff5640 1 -- 172.21.15.2:0/2283999941 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f0930031e80 con 0x558742eab4a0 2024-09-19T06:21:03.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.412+0000 7f09434ef740 1 -- 172.21.15.2:0/2283999941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f092c0043e0 con 0x558742eab4a0 2024-09-19T06:21:03.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.412+0000 7f091eff5640 1 -- 172.21.15.2:0/2283999941 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f09300050d0 con 0x558742eab4a0 2024-09-19T06:21:03.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.412+0000 7f09434ef740 10 client.17202 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:03.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.412+0000 7f09434ef740 1 -- 172.21.15.2:0/2283999941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x558742f30a20 con 0x558742eab4a0 2024-09-19T06:21:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.412+0000 7f091eff5640 1 -- 172.21.15.2:0/2283999941 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f092c0043e0 con 0x558742eab4a0 2024-09-19T06:21:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.412+0000 7f091eff5640 1 -- 172.21.15.2:0/2283999941 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f093001e070 con 0x558742eab4a0 2024-09-19T06:21:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.412+0000 7f09434ef740 10 client.17202 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.412+0000 7f09434ef740 10 client.17202 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.412+0000 7f09434ef740 20 client.17202 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.412+0000 7f09434ef740 1 --2- 172.21.15.2:0/2283999941 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558742f30ee0 0x558742f332d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.412+0000 7f09434ef740 4 client.17202 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:21:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.412+0000 7f09434ef740 1 -- 172.21.15.2:0/2283999941 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558742e18d60 con 0x558742f30ee0 2024-09-19T06:21:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.413+0000 7f093ad9d640 1 --2- 172.21.15.2:0/2283999941 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558742f30ee0 0x558742f332d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.413+0000 7f093ad9d640 1 --2- 172.21.15.2:0/2283999941 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558742f30ee0 0x558742f332d0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5dccc564e6352502 server_cookie=de967de659f0ccf0 in_seq=0 out_seq=0 2024-09-19T06:21:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.413+0000 7f091eff5640 10 client.17202 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.413+0000 7f091eff5640 1 -- 172.21.15.2:0/2283999941 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x558742e18d60 con 0x558742f30ee0 2024-09-19T06:21:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.413+0000 7f091eff5640 10 client.17202 handle_command_reply: tid=0 2024-09-19T06:21:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.413+0000 7f09434ef740 1 client.17202 shutdown 2024-09-19T06:21:03.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.413+0000 7f09434ef740 1 -- 172.21.15.2:0/2283999941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558742eab4a0 msgr2=0x558742ebea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:03.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.413+0000 7f09434ef740 1 --2- 172.21.15.2:0/2283999941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558742eab4a0 0x558742ebea30 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f09300096e0 tx=0x7f0930023040 comp rx=0 tx=0).stop 2024-09-19T06:21:03.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.413+0000 7f09434ef740 1 -- 172.21.15.2:0/2283999941 shutdown_connections 2024-09-19T06:21:03.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.413+0000 7f09434ef740 1 --2- 172.21.15.2:0/2283999941 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558742f30ee0 0x558742f332d0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.413+0000 7f09434ef740 1 --2- 172.21.15.2:0/2283999941 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558742eb6680 0x558742eba2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.413+0000 7f09434ef740 1 --2- 172.21.15.2:0/2283999941 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558742eabdc0 0x558742eb9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.413+0000 7f09434ef740 1 --2- 172.21.15.2:0/2283999941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558742eab4a0 0x558742ebea30 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.413+0000 7f091eff5640 0 client.17202 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:03.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.413+0000 7f09434ef740 1 -- 172.21.15.2:0/2283999941 >> 172.21.15.2:0/2283999941 conn(0x558742ea7a30 msgr2=0x558742ea6350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:03.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.414+0000 7f09434ef740 1 -- 172.21.15.2:0/2283999941 shutdown_connections 2024-09-19T06:21:03.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.414+0000 7f09434ef740 1 -- 172.21.15.2:0/2283999941 wait complete. 2024-09-19T06:21:03.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.414+0000 7f09434ef740 20 client.17202 trim_cache size 0 max 16384 2024-09-19T06:21:03.428 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:21:03.428 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T06:21:03.428 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T06:21:03.428 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:21:03.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.414+0000 7f0941116640 1 -- 172.21.15.2:0/2286313329 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f09240a33b0 msgr2=0x7f09240a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:03.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.414+0000 7f0941116640 1 --2- 172.21.15.2:0/2286313329 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f09240a33b0 0x7f09240a5870 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f09340a4a60 tx=0x7f093401baf0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.414+0000 7f0941116640 1 -- 172.21.15.2:0/2286313329 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f093c106a80 msgr2=0x7f093c19ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:03.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.414+0000 7f0941116640 1 --2- 172.21.15.2:0/2286313329 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f093c106a80 0x7f093c19ede0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f093400cce0 tx=0x7f093400a620 comp rx=0 tx=0).stop 2024-09-19T06:21:03.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.414+0000 7f0941116640 1 -- 172.21.15.2:0/2286313329 shutdown_connections 2024-09-19T06:21:03.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.414+0000 7f0941116640 1 --2- 172.21.15.2:0/2286313329 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f09240a33b0 0x7f09240a5870 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.414+0000 7f0941116640 1 --2- 172.21.15.2:0/2286313329 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f093c106a80 0x7f093c19ede0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.414+0000 7f0941116640 1 --2- 172.21.15.2:0/2286313329 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f093c101420 0x7f093c19aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.414+0000 7f0941116640 1 --2- 172.21.15.2:0/2286313329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f093c100a80 0x7f093c19a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.414+0000 7f0941116640 1 -- 172.21.15.2:0/2286313329 >> 172.21.15.2:0/2286313329 conn(0x7f093c0fc7a0 msgr2=0x7f093c06a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:03.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.414+0000 7f0941116640 1 -- 172.21.15.2:0/2286313329 shutdown_connections 2024-09-19T06:21:03.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:03.414+0000 7f0941116640 1 -- 172.21.15.2:0/2286313329 wait complete. 2024-09-19T06:21:03.489 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:02 smithi090 ceph-mon[34497]: scrub queued for path: / 2024-09-19T06:21:03.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:02 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:03.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:02 smithi090 ceph-mon[34497]: scrub summary: active paths [/] 2024-09-19T06:21:03.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:02 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:03.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:02 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:21:03.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:02 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:21:03.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:02 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:21:03.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:02 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:21:04.108 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:21:04.109 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:21:04.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:03 smithi089 ceph-mon[34160]: pgmap v190: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:21:04.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:03 smithi089 ceph-mon[34160]: scrub summary: idle 2024-09-19T06:21:04.367 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:04.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:03 smithi002 ceph-mon[30982]: pgmap v190: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:21:04.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:03 smithi002 ceph-mon[30982]: scrub summary: idle 2024-09-19T06:21:04.489 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:03 smithi090 ceph-mon[34497]: pgmap v190: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:21:04.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:03 smithi090 ceph-mon[34497]: scrub summary: idle 2024-09-19T06:21:04.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:04.828+0000 7f359bd92640 1 -- 172.21.15.2:0/3885921645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3594106f10 msgr2=0x7f359410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:04.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:04.828+0000 7f359bd92640 1 --2- 172.21.15.2:0/3885921645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3594106f10 0x7f359410ea90 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f358c009ca0 tx=0x7f358c02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:21:04.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:04.828+0000 7f359bd92640 1 -- 172.21.15.2:0/3885921645 shutdown_connections 2024-09-19T06:21:04.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:04.828+0000 7f359bd92640 1 --2- 172.21.15.2:0/3885921645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3594106f10 0x7f359410ea90 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:04.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:04.828+0000 7f359bd92640 1 --2- 172.21.15.2:0/3885921645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3594102790 0x7f35941067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:04.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:04.828+0000 7f359bd92640 1 --2- 172.21.15.2:0/3885921645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3594101de0 0x7f35941021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:04.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:04.828+0000 7f359bd92640 1 -- 172.21.15.2:0/3885921645 >> 172.21.15.2:0/3885921645 conn(0x7f35940fd8c0 msgr2=0x7f35940ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:04.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:04.828+0000 7f359bd92640 1 -- 172.21.15.2:0/3885921645 shutdown_connections 2024-09-19T06:21:04.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:04.828+0000 7f359bd92640 1 -- 172.21.15.2:0/3885921645 wait complete. 2024-09-19T06:21:04.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:04.829+0000 7f359bd92640 1 Processor -- start 2024-09-19T06:21:04.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:04.829+0000 7f359bd92640 1 -- start start 2024-09-19T06:21:04.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:04.829+0000 7f359bd92640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3594101de0 0x7f35941982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:04.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:04.830+0000 7f359bd92640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3594102790 0x7f35941987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:04.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:04.830+0000 7f359bd92640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3594106f10 0x7f359419cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:04.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:04.830+0000 7f359bd92640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3594111e20 con 0x7f3594101de0 2024-09-19T06:21:04.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:04.830+0000 7f359bd92640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3594111ca0 con 0x7f3594102790 2024-09-19T06:21:04.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:04.830+0000 7f359bd92640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3594111fa0 con 0x7f3594106f10 2024-09-19T06:21:04.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:04.830+0000 7f3599b2e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3594101de0 0x7f35941982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:04.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:04.830+0000 7f3599b2e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3594101de0 0x7f35941982a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48102/0 (socket says 172.21.15.2:48102) 2024-09-19T06:21:04.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:04.830+0000 7f3599b2e640 1 -- 172.21.15.2:0/704509001 learned_addr learned my addr 172.21.15.2:0/704509001 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:04.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:04.830+0000 7f359932d640 1 --2- 172.21.15.2:0/704509001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3594102790 0x7f35941987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:04.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:04.830+0000 7f359a32f640 1 --2- 172.21.15.2:0/704509001 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3594106f10 0x7f359419cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:04.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:04.830+0000 7f3599b2e640 1 -- 172.21.15.2:0/704509001 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3594106f10 msgr2=0x7f359419cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:04.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:04.830+0000 7f3599b2e640 1 --2- 172.21.15.2:0/704509001 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3594106f10 0x7f359419cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:04.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:04.830+0000 7f3599b2e640 1 -- 172.21.15.2:0/704509001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3594102790 msgr2=0x7f35941987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:04.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:04.830+0000 7f3599b2e640 1 --2- 172.21.15.2:0/704509001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3594102790 0x7f35941987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:04.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:04.830+0000 7f3599b2e640 1 -- 172.21.15.2:0/704509001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f359419d250 con 0x7f3594101de0 2024-09-19T06:21:04.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:04.830+0000 7f3599b2e640 1 --2- 172.21.15.2:0/704509001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3594101de0 0x7f35941982a0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f358800c920 tx=0x7f358800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:04.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:04.830+0000 7f3586ffd640 1 -- 172.21.15.2:0/704509001 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3588007c70 con 0x7f3594101de0 2024-09-19T06:21:04.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:04.830+0000 7f3586ffd640 1 -- 172.21.15.2:0/704509001 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3588007e10 con 0x7f3594101de0 2024-09-19T06:21:04.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:04.830+0000 7f359bd92640 1 -- 172.21.15.2:0/704509001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f359419d540 con 0x7f3594101de0 2024-09-19T06:21:04.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:04.830+0000 7f3586ffd640 1 -- 172.21.15.2:0/704509001 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3588018820 con 0x7f3594101de0 2024-09-19T06:21:04.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:04.830+0000 7f359bd92640 1 -- 172.21.15.2:0/704509001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35941a4e20 con 0x7f3594101de0 2024-09-19T06:21:04.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:04.831+0000 7f359bd92640 1 -- 172.21.15.2:0/704509001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35941021c0 con 0x7f3594101de0 2024-09-19T06:21:04.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:04.832+0000 7f3586ffd640 1 -- 172.21.15.2:0/704509001 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f35880189c0 con 0x7f3594101de0 2024-09-19T06:21:04.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:04.833+0000 7f3586ffd640 1 --2- 172.21.15.2:0/704509001 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f35800a3430 0x7f35800a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:04.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:04.834+0000 7f359932d640 1 --2- 172.21.15.2:0/704509001 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f35800a3430 0x7f35800a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:04.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:04.834+0000 7f3586ffd640 1 -- 172.21.15.2:0/704509001 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7f35880cfe20 con 0x7f3594101de0 2024-09-19T06:21:04.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:04.834+0000 7f359932d640 1 --2- 172.21.15.2:0/704509001 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f35800a3430 0x7f35800a58f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f35940fdd70 tx=0x7f359000b390 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:04.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:04.838+0000 7f3586ffd640 1 -- 172.21.15.2:0/704509001 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3588014030 con 0x7f3594101de0 2024-09-19T06:21:05.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:05.054+0000 7f359bd92640 1 -- 172.21.15.2:0/704509001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f359402d7c0 con 0x7f3594101de0 2024-09-19T06:21:05.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:05.055+0000 7f3586ffd640 1 -- 172.21.15.2:0/704509001 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11882 (secure 0 0 0) 0x7f358809c7d0 con 0x7f3594101de0 2024-09-19T06:21:05.057 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:21:05.057 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-09-19T06:14:49:104280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:14:48.191083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24470,24472,24497]},"id":1}]} 2024-09-19T06:21:05.057 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-09-19T06:21:05.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:05.057+0000 7f359bd92640 1 -- 172.21.15.2:0/704509001 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f35800a3430 msgr2=0x7f35800a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:05.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:05.057+0000 7f359bd92640 1 --2- 172.21.15.2:0/704509001 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f35800a3430 0x7f35800a58f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f35940fdd70 tx=0x7f359000b390 comp rx=0 tx=0).stop 2024-09-19T06:21:05.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:05.057+0000 7f359bd92640 1 -- 172.21.15.2:0/704509001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3594101de0 msgr2=0x7f35941982a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:05.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:05.057+0000 7f359bd92640 1 --2- 172.21.15.2:0/704509001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3594101de0 0x7f35941982a0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f358800c920 tx=0x7f358800cde0 comp rx=0 tx=0).stop 2024-09-19T06:21:05.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:05.057+0000 7f359bd92640 1 -- 172.21.15.2:0/704509001 shutdown_connections 2024-09-19T06:21:05.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:05.057+0000 7f359bd92640 1 --2- 172.21.15.2:0/704509001 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f35800a3430 0x7f35800a58f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:05.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:05.057+0000 7f359bd92640 1 --2- 172.21.15.2:0/704509001 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3594106f10 0x7f359419cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:05.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:05.057+0000 7f359bd92640 1 --2- 172.21.15.2:0/704509001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3594102790 0x7f35941987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:05.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:05.057+0000 7f359bd92640 1 --2- 172.21.15.2:0/704509001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3594101de0 0x7f35941982a0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:05.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:05.057+0000 7f359bd92640 1 -- 172.21.15.2:0/704509001 >> 172.21.15.2:0/704509001 conn(0x7f35940fd8c0 msgr2=0x7f35940fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:05.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:05.057+0000 7f359bd92640 1 -- 172.21.15.2:0/704509001 shutdown_connections 2024-09-19T06:21:05.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:05.057+0000 7f359bd92640 1 -- 172.21.15.2:0/704509001 wait complete. 2024-09-19T06:21:05.621 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:21:05.879 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:06.262 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:06 smithi002 ceph-mon[30982]: pgmap v191: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-09-19T06:21:06.263 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:06 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/704509001' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:21:06.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:06 smithi089 ceph-mon[34160]: pgmap v191: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-09-19T06:21:06.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:06 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/704509001' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:21:06.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.345+0000 7fba996cc640 1 -- 172.21.15.2:0/739167229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba94101420 msgr2=0x7fba9410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:06.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.345+0000 7fba996cc640 1 --2- 172.21.15.2:0/739167229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba94101420 0x7fba9410d950 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fba8c009cd0 tx=0x7fba8c02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.345+0000 7fba996cc640 1 -- 172.21.15.2:0/739167229 shutdown_connections 2024-09-19T06:21:06.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.345+0000 7fba996cc640 1 --2- 172.21.15.2:0/739167229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba94101420 0x7fba9410d950 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.345+0000 7fba996cc640 1 --2- 172.21.15.2:0/739167229 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba94100a80 0x7fba94100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.345+0000 7fba996cc640 1 --2- 172.21.15.2:0/739167229 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba94106a80 0x7fba94106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.345+0000 7fba996cc640 1 -- 172.21.15.2:0/739167229 >> 172.21.15.2:0/739167229 conn(0x7fba940fc7a0 msgr2=0x7fba940febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:06.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.345+0000 7fba996cc640 1 -- 172.21.15.2:0/739167229 shutdown_connections 2024-09-19T06:21:06.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.345+0000 7fba996cc640 1 -- 172.21.15.2:0/739167229 wait complete. 2024-09-19T06:21:06.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.346+0000 7fba996cc640 1 Processor -- start 2024-09-19T06:21:06.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.346+0000 7fba996cc640 1 -- start start 2024-09-19T06:21:06.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.346+0000 7fba996cc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba94100a80 0x7fba940fce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:06.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.346+0000 7fba996cc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba94101420 0x7fba940fd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:06.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.346+0000 7fba996cc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba94106a80 0x7fba940fd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:06.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.346+0000 7fba996cc640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fba94110d50 con 0x7fba94100a80 2024-09-19T06:21:06.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.346+0000 7fba996cc640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fba94110bd0 con 0x7fba94101420 2024-09-19T06:21:06.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.346+0000 7fba996cc640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fba94110ed0 con 0x7fba94106a80 2024-09-19T06:21:06.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.346+0000 7fba92ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba94100a80 0x7fba940fce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:06.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.347+0000 7fba92ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba94100a80 0x7fba940fce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45496/0 (socket says 172.21.15.2:45496) 2024-09-19T06:21:06.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.347+0000 7fba92ffd640 1 -- 172.21.15.2:0/3010097175 learned_addr learned my addr 172.21.15.2:0/3010097175 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:06.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.347+0000 7fba8a7fc640 1 --2- 172.21.15.2:0/3010097175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba94101420 0x7fba940fd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:06.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.347+0000 7fba937fe640 1 --2- 172.21.15.2:0/3010097175 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba94106a80 0x7fba940fd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:06.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.347+0000 7fba92ffd640 1 -- 172.21.15.2:0/3010097175 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba94106a80 msgr2=0x7fba940fd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:06.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.347+0000 7fba92ffd640 1 --2- 172.21.15.2:0/3010097175 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba94106a80 0x7fba940fd8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.347+0000 7fba92ffd640 1 -- 172.21.15.2:0/3010097175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba94101420 msgr2=0x7fba940fd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:06.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.347+0000 7fba92ffd640 1 --2- 172.21.15.2:0/3010097175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba94101420 0x7fba940fd3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.347+0000 7fba92ffd640 1 -- 172.21.15.2:0/3010097175 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba941a6840 con 0x7fba94100a80 2024-09-19T06:21:06.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.347+0000 7fba937fe640 1 --2- 172.21.15.2:0/3010097175 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba94106a80 0x7fba940fd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:06.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.347+0000 7fba92ffd640 1 --2- 172.21.15.2:0/3010097175 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba94100a80 0x7fba940fce70 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fba8400b4a0 tx=0x7fba8400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:06.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.347+0000 7fba90ff9640 1 -- 172.21.15.2:0/3010097175 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba84014070 con 0x7fba94100a80 2024-09-19T06:21:06.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.347+0000 7fba996cc640 1 -- 172.21.15.2:0/3010097175 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba941a6b30 con 0x7fba94100a80 2024-09-19T06:21:06.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.347+0000 7fba90ff9640 1 -- 172.21.15.2:0/3010097175 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fba84010ac0 con 0x7fba94100a80 2024-09-19T06:21:06.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.347+0000 7fba90ff9640 1 -- 172.21.15.2:0/3010097175 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba84017c30 con 0x7fba94100a80 2024-09-19T06:21:06.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.347+0000 7fba996cc640 1 -- 172.21.15.2:0/3010097175 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba941a70c0 con 0x7fba94100a80 2024-09-19T06:21:06.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.350+0000 7fba90ff9640 1 -- 172.21.15.2:0/3010097175 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fba84017070 con 0x7fba94100a80 2024-09-19T06:21:06.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.350+0000 7fba9baa5740 1 Processor -- start 2024-09-19T06:21:06.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.350+0000 7fba9baa5740 1 -- start start 2024-09-19T06:21:06.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.350+0000 7fba9baa5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca54130b40 0x55ca5412f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:06.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.350+0000 7fba9baa5740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca5412f5d0 0x55ca5412fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:06.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.350+0000 7fba9baa5740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca5413a370 0x55ca5413c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:06.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.350+0000 7fba9baa5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ca540952f0 con 0x55ca54130b40 2024-09-19T06:21:06.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.350+0000 7fba9baa5740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55ca5403ccf0 con 0x55ca5413a370 2024-09-19T06:21:06.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.350+0000 7fba9baa5740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55ca540912b0 con 0x55ca5412f5d0 2024-09-19T06:21:06.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.350+0000 7fba937fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca54130b40 0x55ca5412f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:06.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.350+0000 7fba937fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca54130b40 0x55ca5412f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45508/0 (socket says 172.21.15.2:45508) 2024-09-19T06:21:06.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.350+0000 7fba937fe640 1 -- 172.21.15.2:0/4137670835 learned_addr learned my addr 172.21.15.2:0/4137670835 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:06.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.350+0000 7fba90ff9640 1 --2- 172.21.15.2:0/3010097175 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fba800a33b0 0x7fba800a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:06.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.351+0000 7fba937fe640 1 --2- 172.21.15.2:0/3010097175 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fba800a33b0 0x7fba800a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:06.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.351+0000 7fba8a7fc640 1 --2- 172.21.15.2:0/4137670835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca5413a370 0x55ca5413c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:06.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.351+0000 7fba92ffd640 1 --2- 172.21.15.2:0/4137670835 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca5412f5d0 0x55ca5412fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:06.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.351+0000 7fba90ff9640 1 -- 172.21.15.2:0/3010097175 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fba840cf2a0 con 0x7fba94100a80 2024-09-19T06:21:06.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.351+0000 7fba937fe640 1 -- 172.21.15.2:0/4137670835 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca5412f5d0 msgr2=0x55ca5412fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:06.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.351+0000 7fba937fe640 1 --2- 172.21.15.2:0/4137670835 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca5412f5d0 0x55ca5412fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.351+0000 7fba937fe640 1 -- 172.21.15.2:0/4137670835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca5413a370 msgr2=0x55ca5413c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:06.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.351+0000 7fba937fe640 1 --2- 172.21.15.2:0/4137670835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca5413a370 0x55ca5413c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.351+0000 7fba937fe640 1 -- 172.21.15.2:0/4137670835 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca540213a0 con 0x55ca54130b40 2024-09-19T06:21:06.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.351+0000 7fba92ffd640 1 --2- 172.21.15.2:0/4137670835 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca5412f5d0 0x55ca5412fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:21:06.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.351+0000 7fba937fe640 1 --2- 172.21.15.2:0/4137670835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca54130b40 0x55ca5412f090 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fba8c009430 tx=0x7fba8c031b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b17d2b48db57a15a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:06.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.351+0000 7fba937fe640 1 --2- 172.21.15.2:0/3010097175 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fba800a33b0 0x7fba800a5870 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fba8c0317f0 tx=0x7fba8c049000 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:06.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.351+0000 7fba897fa640 1 -- 172.21.15.2:0/4137670835 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8c004240 con 0x55ca54130b40 2024-09-19T06:21:06.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.351+0000 7fba897fa640 1 -- 172.21.15.2:0/4137670835 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fba8c036040 con 0x55ca54130b40 2024-09-19T06:21:06.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.351+0000 7fba897fa640 1 -- 172.21.15.2:0/4137670835 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8c030be0 con 0x55ca54130b40 2024-09-19T06:21:06.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.352+0000 7fba9baa5740 1 -- 172.21.15.2:0/4137670835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca54130b40 msgr2=0x55ca5412f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:06.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.352+0000 7fba9baa5740 1 --2- 172.21.15.2:0/4137670835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca54130b40 0x55ca5412f090 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fba8c009430 tx=0x7fba8c031b90 comp rx=0 tx=0).stop 2024-09-19T06:21:06.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.352+0000 7fba9baa5740 1 -- 172.21.15.2:0/4137670835 shutdown_connections 2024-09-19T06:21:06.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.352+0000 7fba9baa5740 1 --2- 172.21.15.2:0/4137670835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca5413a370 0x55ca5413c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.352+0000 7fba9baa5740 1 --2- 172.21.15.2:0/4137670835 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca5412f5d0 0x55ca5412fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.352+0000 7fba9baa5740 1 --2- 172.21.15.2:0/4137670835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca54130b40 0x55ca5412f090 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.352+0000 7fba9baa5740 1 -- 172.21.15.2:0/4137670835 >> 172.21.15.2:0/4137670835 conn(0x55ca540f8310 msgr2=0x55ca5412bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:06.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.352+0000 7fba9baa5740 1 -- 172.21.15.2:0/4137670835 shutdown_connections 2024-09-19T06:21:06.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.352+0000 7fba9baa5740 1 -- 172.21.15.2:0/4137670835 wait complete. 2024-09-19T06:21:06.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.353+0000 7fba9baa5740 1 -- start start 2024-09-19T06:21:06.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.353+0000 7fba9baa5740 1 Processor -- start 2024-09-19T06:21:06.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.353+0000 7fba9baa5740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca5412f5d0 0x55ca54139d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:06.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.353+0000 7fba9baa5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca54130b40 0x55ca54136fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:06.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.353+0000 7fba9baa5740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca5413a370 0x55ca54137530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:06.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.353+0000 7fba9baa5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ca5413cfb0 con 0x55ca54130b40 2024-09-19T06:21:06.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.353+0000 7fba9baa5740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55ca54050060 con 0x55ca5412f5d0 2024-09-19T06:21:06.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.353+0000 7fba9baa5740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55ca5413d130 con 0x55ca5413a370 2024-09-19T06:21:06.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.353+0000 7fba9baa5740 10 client.0 _ll_register_callbacks cb 0x55ca53da38c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:06.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.353+0000 7fba8a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca54130b40 0x55ca54136fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:06.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.353+0000 7fba8a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca54130b40 0x55ca54136fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45512/0 (socket says 172.21.15.2:45512) 2024-09-19T06:21:06.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.353+0000 7fba8a7fc640 1 -- 172.21.15.2:0/2947044618 learned_addr learned my addr 172.21.15.2:0/2947044618 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:06.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.353+0000 7fba92ffd640 1 --2- 172.21.15.2:0/2947044618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca5412f5d0 0x55ca54139d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:06.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.353+0000 7fba937fe640 1 --2- 172.21.15.2:0/2947044618 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca5413a370 0x55ca54137530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:06.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.353+0000 7fba8a7fc640 1 -- 172.21.15.2:0/2947044618 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca5413a370 msgr2=0x55ca54137530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:06.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.353+0000 7fba8a7fc640 1 --2- 172.21.15.2:0/2947044618 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca5413a370 0x55ca54137530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.353+0000 7fba8a7fc640 1 -- 172.21.15.2:0/2947044618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca5412f5d0 msgr2=0x55ca54139d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:06.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.353+0000 7fba8a7fc640 1 --2- 172.21.15.2:0/2947044618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca5412f5d0 0x55ca54139d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.353+0000 7fba8a7fc640 1 -- 172.21.15.2:0/2947044618 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca53e063c0 con 0x55ca54130b40 2024-09-19T06:21:06.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.354+0000 7fba92ffd640 1 --2- 172.21.15.2:0/2947044618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca5412f5d0 0x55ca54139d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:06.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.354+0000 7fba8a7fc640 1 --2- 172.21.15.2:0/2947044618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca54130b40 0x55ca54136fb0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0126d0 tx=0x7fba7c012b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4027a9f6d7718d28 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:06.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.354+0000 7fba7a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:06.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.354+0000 7fba7a7fc640 1 -- 172.21.15.2:0/2947044618 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7c01f060 con 0x55ca54130b40 2024-09-19T06:21:06.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.354+0000 7fba7a7fc640 1 -- 172.21.15.2:0/2947044618 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fba7c010dc0 con 0x55ca54130b40 2024-09-19T06:21:06.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.354+0000 7fba9baa5740 1 -- 172.21.15.2:0/2947044618 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba8c036040 con 0x55ca54130b40 2024-09-19T06:21:06.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.354+0000 7fba7a7fc640 1 -- 172.21.15.2:0/2947044618 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fba7c024480 con 0x55ca54130b40 2024-09-19T06:21:06.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.354+0000 7fba9baa5740 10 client.17220 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:06.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.354+0000 7fba9baa5740 1 -- 172.21.15.2:0/2947044618 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ca54148a10 con 0x55ca54130b40 2024-09-19T06:21:06.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.354+0000 7fba7a7fc640 1 -- 172.21.15.2:0/2947044618 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fba8c036040 con 0x55ca54130b40 2024-09-19T06:21:06.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.354+0000 7fba7a7fc640 1 -- 172.21.15.2:0/2947044618 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fba7c022540 con 0x55ca54130b40 2024-09-19T06:21:06.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.354+0000 7fba9baa5740 10 client.17220 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:06.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.354+0000 7fba9baa5740 10 client.17220 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:21:06.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.354+0000 7fba9baa5740 20 client.17220 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:06.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.355+0000 7fba9baa5740 1 --2- 172.21.15.2:0/2947044618 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55ca54149f20 0x55ca5414c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:06.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.355+0000 7fba9baa5740 4 client.17220 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:06.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.355+0000 7fba9baa5740 1 -- 172.21.15.2:0/2947044618 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca540a2860 con 0x55ca54149f20 2024-09-19T06:21:06.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.355+0000 7fba92ffd640 1 --2- 172.21.15.2:0/2947044618 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55ca54149f20 0x55ca5414c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:06.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.355+0000 7fba92ffd640 1 --2- 172.21.15.2:0/2947044618 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55ca54149f20 0x55ca5414c340 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ba321d11775f27bd server_cookie=6a8a339e845ebcd8 in_seq=0 out_seq=0 2024-09-19T06:21:06.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.355+0000 7fba7a7fc640 10 client.17220 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:21:06.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.356+0000 7fba7a7fc640 1 -- 172.21.15.2:0/2947044618 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ca540a2860 con 0x55ca54149f20 2024-09-19T06:21:06.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.356+0000 7fba7a7fc640 10 client.17220 handle_command_reply: tid=0 2024-09-19T06:21:06.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.356+0000 7fba9baa5740 1 client.17220 shutdown 2024-09-19T06:21:06.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.356+0000 7fba9baa5740 1 -- 172.21.15.2:0/2947044618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca54130b40 msgr2=0x55ca54136fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:06.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.356+0000 7fba9baa5740 1 --2- 172.21.15.2:0/2947044618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca54130b40 0x55ca54136fb0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0126d0 tx=0x7fba7c012b90 comp rx=0 tx=0).stop 2024-09-19T06:21:06.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.356+0000 7fba9baa5740 1 -- 172.21.15.2:0/2947044618 shutdown_connections 2024-09-19T06:21:06.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.356+0000 7fba9baa5740 1 --2- 172.21.15.2:0/2947044618 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55ca54149f20 0x55ca5414c340 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.356+0000 7fba9baa5740 1 --2- 172.21.15.2:0/2947044618 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca5413a370 0x55ca54137530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.356+0000 7fba9baa5740 1 --2- 172.21.15.2:0/2947044618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca54130b40 0x55ca54136fb0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.356+0000 7fba7a7fc640 0 client.17220 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:21:06.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.356+0000 7fba9baa5740 1 --2- 172.21.15.2:0/2947044618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca5412f5d0 0x55ca54139d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.356+0000 7fba9baa5740 1 -- 172.21.15.2:0/2947044618 >> 172.21.15.2:0/2947044618 conn(0x55ca540f8310 msgr2=0x55ca54131930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:06.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.356+0000 7fba9baa5740 1 -- 172.21.15.2:0/2947044618 shutdown_connections 2024-09-19T06:21:06.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.356+0000 7fba9baa5740 1 -- 172.21.15.2:0/2947044618 wait complete. 2024-09-19T06:21:06.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.356+0000 7fba9baa5740 20 client.17220 trim_cache size 0 max 16384 2024-09-19T06:21:06.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.369+0000 7fba9baa5740 1 Processor -- start 2024-09-19T06:21:06.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.369+0000 7fba9baa5740 1 -- start start 2024-09-19T06:21:06.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.370+0000 7fba9baa5740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca5412f5d0 0x55ca541462b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:06.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.370+0000 7fba9baa5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca54130b40 0x55ca54151c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:06.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.370+0000 7fba9baa5740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca5413a370 0x55ca54152150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:06.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.370+0000 7fba9baa5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fba941b2290 con 0x55ca54130b40 2024-09-19T06:21:06.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.370+0000 7fba9baa5740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fba941afb60 con 0x55ca5412f5d0 2024-09-19T06:21:06.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.370+0000 7fba9baa5740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fba941ad9b0 con 0x55ca5413a370 2024-09-19T06:21:06.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.370+0000 7fba937fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca5413a370 0x55ca54152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:06.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.370+0000 7fba92ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca5412f5d0 0x55ca541462b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:06.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.370+0000 7fba8a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca54130b40 0x55ca54151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:06.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.370+0000 7fba8a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca54130b40 0x55ca54151c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45528/0 (socket says 172.21.15.2:45528) 2024-09-19T06:21:06.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.370+0000 7fba92ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca5412f5d0 0x55ca541462b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:60278/0 (socket says 172.21.15.2:60278) 2024-09-19T06:21:06.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.370+0000 7fba8a7fc640 1 -- 172.21.15.2:0/1231360011 learned_addr learned my addr 172.21.15.2:0/1231360011 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:06.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.371+0000 7fba8a7fc640 1 -- 172.21.15.2:0/1231360011 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca5413a370 msgr2=0x55ca54152150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:06.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.371+0000 7fba8a7fc640 1 --2- 172.21.15.2:0/1231360011 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca5413a370 0x55ca54152150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.371+0000 7fba8a7fc640 1 -- 172.21.15.2:0/1231360011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca5412f5d0 msgr2=0x55ca541462b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:06.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.371+0000 7fba8a7fc640 1 --2- 172.21.15.2:0/1231360011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca5412f5d0 0x55ca541462b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.371+0000 7fba8a7fc640 1 -- 172.21.15.2:0/1231360011 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca5413d180 con 0x55ca54130b40 2024-09-19T06:21:06.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.371+0000 7fba8a7fc640 1 --2- 172.21.15.2:0/1231360011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca54130b40 0x55ca54151c10 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0058c0 tx=0x7fba7c022f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d9983d11cd6bc43 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:06.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.371+0000 7fba88ff9640 1 -- 172.21.15.2:0/1231360011 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7c010bc0 con 0x55ca54130b40 2024-09-19T06:21:06.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.371+0000 7fba88ff9640 1 -- 172.21.15.2:0/1231360011 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fba7c010d60 con 0x55ca54130b40 2024-09-19T06:21:06.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.371+0000 7fba88ff9640 1 -- 172.21.15.2:0/1231360011 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7c005250 con 0x55ca54130b40 2024-09-19T06:21:06.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.372+0000 7fba9baa5740 1 -- 172.21.15.2:0/1231360011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca54130b40 msgr2=0x55ca54151c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:06.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.372+0000 7fba9baa5740 1 --2- 172.21.15.2:0/1231360011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca54130b40 0x55ca54151c10 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0058c0 tx=0x7fba7c022f30 comp rx=0 tx=0).stop 2024-09-19T06:21:06.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.372+0000 7fba9baa5740 1 -- 172.21.15.2:0/1231360011 shutdown_connections 2024-09-19T06:21:06.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.372+0000 7fba9baa5740 1 --2- 172.21.15.2:0/1231360011 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca5413a370 0x55ca54152150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.372+0000 7fba9baa5740 1 --2- 172.21.15.2:0/1231360011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca54130b40 0x55ca54151c10 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.372+0000 7fba9baa5740 1 --2- 172.21.15.2:0/1231360011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca5412f5d0 0x55ca541462b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.372+0000 7fba9baa5740 1 -- 172.21.15.2:0/1231360011 >> 172.21.15.2:0/1231360011 conn(0x55ca540f8310 msgr2=0x55ca541360a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:06.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.372+0000 7fba9baa5740 1 -- 172.21.15.2:0/1231360011 shutdown_connections 2024-09-19T06:21:06.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.372+0000 7fba9baa5740 1 -- 172.21.15.2:0/1231360011 wait complete. 2024-09-19T06:21:06.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.372+0000 7fba9baa5740 1 -- start start 2024-09-19T06:21:06.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.372+0000 7fba9baa5740 1 Processor -- start 2024-09-19T06:21:06.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.372+0000 7fba9baa5740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca5412f5d0 0x55ca541426f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:06.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.373+0000 7fba9baa5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca54130b40 0x55ca54142c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:06.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.373+0000 7fba9baa5740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca5413a370 0x55ca5413da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:06.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.373+0000 7fba9baa5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fba941ae020 con 0x55ca54130b40 2024-09-19T06:21:06.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.373+0000 7fba9baa5740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fba941af490 con 0x55ca5412f5d0 2024-09-19T06:21:06.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.373+0000 7fba9baa5740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fba941ae6f0 con 0x55ca5413a370 2024-09-19T06:21:06.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.373+0000 7fba9baa5740 10 client.0 _ll_register_callbacks cb 0x7fba7c00a590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:06.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.373+0000 7fba8a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca54130b40 0x55ca54142c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:06.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.373+0000 7fba8a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca54130b40 0x55ca54142c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45544/0 (socket says 172.21.15.2:45544) 2024-09-19T06:21:06.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.373+0000 7fba8a7fc640 1 -- 172.21.15.2:0/678825449 learned_addr learned my addr 172.21.15.2:0/678825449 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:06.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.373+0000 7fba92ffd640 1 --2- 172.21.15.2:0/678825449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca5412f5d0 0x55ca541426f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:06.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.373+0000 7fba937fe640 1 --2- 172.21.15.2:0/678825449 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca5413a370 0x55ca5413da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:06.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.373+0000 7fba8a7fc640 1 -- 172.21.15.2:0/678825449 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca5413a370 msgr2=0x55ca5413da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:06.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.373+0000 7fba8a7fc640 1 --2- 172.21.15.2:0/678825449 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca5413a370 0x55ca5413da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.373+0000 7fba8a7fc640 1 -- 172.21.15.2:0/678825449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca5412f5d0 msgr2=0x55ca541426f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:06.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.373+0000 7fba8a7fc640 1 --2- 172.21.15.2:0/678825449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca5412f5d0 0x55ca541426f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.373+0000 7fba8a7fc640 1 -- 172.21.15.2:0/678825449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca5412c960 con 0x55ca54130b40 2024-09-19T06:21:06.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.373+0000 7fba8a7fc640 1 --2- 172.21.15.2:0/678825449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca54130b40 0x55ca54142c30 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fba7c022a30 tx=0x7fba7c012b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17fea59dbe5c13f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:06.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.373+0000 7fba7a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:06.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.373+0000 7fba7a7fc640 1 -- 172.21.15.2:0/678825449 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7c01f040 con 0x55ca54130b40 2024-09-19T06:21:06.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.373+0000 7fba7a7fc640 1 -- 172.21.15.2:0/678825449 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fba7c004020 con 0x55ca54130b40 2024-09-19T06:21:06.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.373+0000 7fba9baa5740 1 -- 172.21.15.2:0/678825449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba7c010d60 con 0x55ca54130b40 2024-09-19T06:21:06.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.374+0000 7fba7a7fc640 1 -- 172.21.15.2:0/678825449 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fba7c03d050 con 0x55ca54130b40 2024-09-19T06:21:06.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.374+0000 7fba9baa5740 10 client.17226 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:06.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.374+0000 7fba9baa5740 1 -- 172.21.15.2:0/678825449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ca541b45a0 con 0x55ca54130b40 2024-09-19T06:21:06.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.374+0000 7fba7a7fc640 1 -- 172.21.15.2:0/678825449 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fba7c010d60 con 0x55ca54130b40 2024-09-19T06:21:06.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.374+0000 7fba7a7fc640 1 -- 172.21.15.2:0/678825449 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fba7c035070 con 0x55ca54130b40 2024-09-19T06:21:06.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.374+0000 7fba9baa5740 10 client.17226 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:06.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.374+0000 7fba9baa5740 10 client.17226 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:21:06.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.374+0000 7fba9baa5740 20 client.17226 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:06.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.374+0000 7fba9baa5740 1 --2- 172.21.15.2:0/678825449 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55ca541b4bb0 0x55ca541b6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:06.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.374+0000 7fba9baa5740 4 client.17226 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:21:06.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.374+0000 7fba9baa5740 1 -- 172.21.15.2:0/678825449 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ca5409cd70 con 0x55ca541b4bb0 2024-09-19T06:21:06.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.374+0000 7fba92ffd640 1 --2- 172.21.15.2:0/678825449 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55ca541b4bb0 0x55ca541b6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:06.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.375+0000 7fba7a7fc640 10 client.17226 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:21:06.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.375+0000 7fba92ffd640 1 --2- 172.21.15.2:0/678825449 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55ca541b4bb0 0x55ca541b6fa0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1530f6c1ae6cf178 server_cookie=826d77a237decc28 in_seq=0 out_seq=0 2024-09-19T06:21:06.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.375+0000 7fba7a7fc640 1 -- 172.21.15.2:0/678825449 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ca5409cd70 con 0x55ca541b4bb0 2024-09-19T06:21:06.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.375+0000 7fba7a7fc640 10 client.17226 handle_command_reply: tid=0 2024-09-19T06:21:06.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.375+0000 7fba9baa5740 1 client.17226 shutdown 2024-09-19T06:21:06.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.375+0000 7fba9baa5740 1 -- 172.21.15.2:0/678825449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca54130b40 msgr2=0x55ca54142c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:06.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.375+0000 7fba9baa5740 1 --2- 172.21.15.2:0/678825449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca54130b40 0x55ca54142c30 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fba7c022a30 tx=0x7fba7c012b90 comp rx=0 tx=0).stop 2024-09-19T06:21:06.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.375+0000 7fba9baa5740 1 -- 172.21.15.2:0/678825449 shutdown_connections 2024-09-19T06:21:06.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.375+0000 7fba9baa5740 1 --2- 172.21.15.2:0/678825449 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55ca541b4bb0 0x55ca541b6fa0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.375+0000 7fba9baa5740 1 --2- 172.21.15.2:0/678825449 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca5413a370 0x55ca5413da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.375+0000 7fba9baa5740 1 --2- 172.21.15.2:0/678825449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca54130b40 0x55ca54142c30 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.375+0000 7fba9baa5740 1 --2- 172.21.15.2:0/678825449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca5412f5d0 0x55ca541426f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.375+0000 7fba9baa5740 1 -- 172.21.15.2:0/678825449 >> 172.21.15.2:0/678825449 conn(0x55ca540f8310 msgr2=0x55ca54131110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:06.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.375+0000 7fba7a7fc640 0 client.17226 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:21:06.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.375+0000 7fba9baa5740 1 -- 172.21.15.2:0/678825449 shutdown_connections 2024-09-19T06:21:06.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.375+0000 7fba9baa5740 1 -- 172.21.15.2:0/678825449 wait complete. 2024-09-19T06:21:06.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.376+0000 7fba9baa5740 20 client.17226 trim_cache size 0 max 16384 2024-09-19T06:21:06.393 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:21:06.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.376+0000 7fba996cc640 1 -- 172.21.15.2:0/3010097175 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fba800a33b0 msgr2=0x7fba800a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:06.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.376+0000 7fba996cc640 1 --2- 172.21.15.2:0/3010097175 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fba800a33b0 0x7fba800a5870 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fba8c0317f0 tx=0x7fba8c049000 comp rx=0 tx=0).stop 2024-09-19T06:21:06.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.376+0000 7fba996cc640 1 -- 172.21.15.2:0/3010097175 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba94100a80 msgr2=0x7fba940fce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:06.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.376+0000 7fba996cc640 1 --2- 172.21.15.2:0/3010097175 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba94100a80 0x7fba940fce70 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fba8400b4a0 tx=0x7fba8400b960 comp rx=0 tx=0).stop 2024-09-19T06:21:06.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.376+0000 7fba996cc640 1 -- 172.21.15.2:0/3010097175 shutdown_connections 2024-09-19T06:21:06.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.376+0000 7fba996cc640 1 --2- 172.21.15.2:0/3010097175 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fba800a33b0 0x7fba800a5870 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.376+0000 7fba996cc640 1 --2- 172.21.15.2:0/3010097175 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba94106a80 0x7fba940fd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.376+0000 7fba996cc640 1 --2- 172.21.15.2:0/3010097175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba94101420 0x7fba940fd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.376+0000 7fba996cc640 1 --2- 172.21.15.2:0/3010097175 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba94100a80 0x7fba940fce70 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.376+0000 7fba996cc640 1 -- 172.21.15.2:0/3010097175 >> 172.21.15.2:0/3010097175 conn(0x7fba940fc7a0 msgr2=0x7fba9406aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:06.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.376+0000 7fba996cc640 1 -- 172.21.15.2:0/3010097175 shutdown_connections 2024-09-19T06:21:06.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:06.376+0000 7fba996cc640 1 -- 172.21.15.2:0/3010097175 wait complete. 2024-09-19T06:21:06.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:06 smithi090 ceph-mon[34497]: pgmap v191: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-09-19T06:21:06.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:06 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/704509001' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:21:07.006 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:21:07.261 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:07.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.669+0000 7fbc594ba640 1 -- 172.21.15.2:0/2435974424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc54100a80 msgr2=0x7fbc54100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:07.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.669+0000 7fbc594ba640 1 --2- 172.21.15.2:0/2435974424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc54100a80 0x7fbc54100ee0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c009930 tx=0x7fbc3c02a420 comp rx=0 tx=0).stop 2024-09-19T06:21:07.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.670+0000 7fbc594ba640 1 -- 172.21.15.2:0/2435974424 shutdown_connections 2024-09-19T06:21:07.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.670+0000 7fbc594ba640 1 --2- 172.21.15.2:0/2435974424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc54101420 0x7fbc5410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:07.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.670+0000 7fbc594ba640 1 --2- 172.21.15.2:0/2435974424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc54100a80 0x7fbc54100ee0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:07.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.670+0000 7fbc594ba640 1 --2- 172.21.15.2:0/2435974424 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc54106a80 0x7fbc54106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:07.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.670+0000 7fbc594ba640 1 -- 172.21.15.2:0/2435974424 >> 172.21.15.2:0/2435974424 conn(0x7fbc540fc7a0 msgr2=0x7fbc540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:07.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.670+0000 7fbc594ba640 1 -- 172.21.15.2:0/2435974424 shutdown_connections 2024-09-19T06:21:07.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.670+0000 7fbc594ba640 1 -- 172.21.15.2:0/2435974424 wait complete. 2024-09-19T06:21:07.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.670+0000 7fbc594ba640 1 Processor -- start 2024-09-19T06:21:07.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.670+0000 7fbc594ba640 1 -- start start 2024-09-19T06:21:07.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.670+0000 7fbc594ba640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc54100a80 0x7fbc540fceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:07.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.670+0000 7fbc594ba640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc54101420 0x7fbc540fd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:07.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.671+0000 7fbc594ba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc54106a80 0x7fbc540fd930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:07.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.671+0000 7fbc594ba640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbc54110d30 con 0x7fbc54106a80 2024-09-19T06:21:07.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.671+0000 7fbc594ba640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fbc54110bb0 con 0x7fbc54100a80 2024-09-19T06:21:07.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.671+0000 7fbc594ba640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbc54110eb0 con 0x7fbc54101420 2024-09-19T06:21:07.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.671+0000 7fbc537fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc54106a80 0x7fbc540fd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:07.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.671+0000 7fbc537fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc54106a80 0x7fbc540fd930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45556/0 (socket says 172.21.15.2:45556) 2024-09-19T06:21:07.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.671+0000 7fbc537fe640 1 -- 172.21.15.2:0/1990515420 learned_addr learned my addr 172.21.15.2:0/1990515420 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:07.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.671+0000 7fbc52ffd640 1 --2- 172.21.15.2:0/1990515420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc54100a80 0x7fbc540fceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:07.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.671+0000 7fbc4bfff640 1 --2- 172.21.15.2:0/1990515420 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc54101420 0x7fbc540fd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:07.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.671+0000 7fbc537fe640 1 -- 172.21.15.2:0/1990515420 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc54101420 msgr2=0x7fbc540fd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:07.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.671+0000 7fbc537fe640 1 --2- 172.21.15.2:0/1990515420 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc54101420 0x7fbc540fd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:07.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.671+0000 7fbc537fe640 1 -- 172.21.15.2:0/1990515420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc54100a80 msgr2=0x7fbc540fceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:07.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.671+0000 7fbc537fe640 1 --2- 172.21.15.2:0/1990515420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc54100a80 0x7fbc540fceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:07.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.671+0000 7fbc537fe640 1 -- 172.21.15.2:0/1990515420 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc541a6890 con 0x7fbc54106a80 2024-09-19T06:21:07.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.671+0000 7fbc537fe640 1 --2- 172.21.15.2:0/1990515420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc54106a80 0x7fbc540fd930 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c00eaa0 tx=0x7fbc4c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:07.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.671+0000 7fbc50ff9640 1 -- 172.21.15.2:0/1990515420 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c00cdb0 con 0x7fbc54106a80 2024-09-19T06:21:07.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.671+0000 7fbc50ff9640 1 -- 172.21.15.2:0/1990515420 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbc4c005020 con 0x7fbc54106a80 2024-09-19T06:21:07.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.671+0000 7fbc594ba640 1 -- 172.21.15.2:0/1990515420 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc541a6b80 con 0x7fbc54106a80 2024-09-19T06:21:07.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.671+0000 7fbc50ff9640 1 -- 172.21.15.2:0/1990515420 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c0116d0 con 0x7fbc54106a80 2024-09-19T06:21:07.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.672+0000 7fbc594ba640 1 -- 172.21.15.2:0/1990515420 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc541a7040 con 0x7fbc54106a80 2024-09-19T06:21:07.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.674+0000 7fbc50ff9640 1 -- 172.21.15.2:0/1990515420 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fbc4c0051d0 con 0x7fbc54106a80 2024-09-19T06:21:07.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.674+0000 7fbc5b893740 1 Processor -- start 2024-09-19T06:21:07.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.674+0000 7fbc5b893740 1 -- start start 2024-09-19T06:21:07.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.675+0000 7fbc5b893740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5626bc712b40 0x5626bc711090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:07.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.675+0000 7fbc5b893740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5626bc7115d0 0x5626bc711a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:07.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.675+0000 7fbc5b893740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626bc71c370 0x5626bc71e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:07.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.675+0000 7fbc5b893740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5626bc6772f0 con 0x5626bc71c370 2024-09-19T06:21:07.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.675+0000 7fbc5b893740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5626bc61ecf0 con 0x5626bc712b40 2024-09-19T06:21:07.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.675+0000 7fbc5b893740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5626bc6732b0 con 0x5626bc7115d0 2024-09-19T06:21:07.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.675+0000 7fbc4bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626bc71c370 0x5626bc71e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:07.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.675+0000 7fbc4bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626bc71c370 0x5626bc71e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45558/0 (socket says 172.21.15.2:45558) 2024-09-19T06:21:07.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.675+0000 7fbc4bfff640 1 -- 172.21.15.2:0/3685617034 learned_addr learned my addr 172.21.15.2:0/3685617034 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:07.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.675+0000 7fbc52ffd640 1 --2- 172.21.15.2:0/3685617034 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5626bc7115d0 0x5626bc711a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:07.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.675+0000 7fbc4bfff640 1 --2- 172.21.15.2:0/3685617034 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5626bc712b40 0x5626bc711090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:07.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.675+0000 7fbc50ff9640 1 --2- 172.21.15.2:0/1990515420 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fbc400a33b0 0x7fbc400a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:07.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.675+0000 7fbc537fe640 1 --2- 172.21.15.2:0/1990515420 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fbc400a33b0 0x7fbc400a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:07.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.675+0000 7fbc4bfff640 1 -- 172.21.15.2:0/3685617034 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5626bc7115d0 msgr2=0x5626bc711a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:07.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.675+0000 7fbc4bfff640 1 --2- 172.21.15.2:0/3685617034 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5626bc7115d0 0x5626bc711a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:07.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.675+0000 7fbc4bfff640 1 -- 172.21.15.2:0/3685617034 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5626bc712b40 msgr2=0x5626bc711090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:07.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.675+0000 7fbc4bfff640 1 --2- 172.21.15.2:0/3685617034 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5626bc712b40 0x5626bc711090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:07.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.675+0000 7fbc4bfff640 1 -- 172.21.15.2:0/3685617034 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626bc6033a0 con 0x5626bc71c370 2024-09-19T06:21:07.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.675+0000 7fbc50ff9640 1 -- 172.21.15.2:0/1990515420 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fbc4c0cfe60 con 0x7fbc54106a80 2024-09-19T06:21:07.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.675+0000 7fbc4bfff640 1 --2- 172.21.15.2:0/3685617034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626bc71c370 0x5626bc71e760 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c005c40 tx=0x7fbc3c005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71c65e9c65c32bb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:07.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.676+0000 7fbc497fa640 1 -- 172.21.15.2:0/3685617034 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c035070 con 0x5626bc71c370 2024-09-19T06:21:07.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.676+0000 7fbc537fe640 1 --2- 172.21.15.2:0/1990515420 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fbc400a33b0 0x7fbc400a5870 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c09c1b0 tx=0x7fbc4c0a0040 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:07.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.676+0000 7fbc497fa640 1 -- 172.21.15.2:0/3685617034 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbc3c004030 con 0x5626bc71c370 2024-09-19T06:21:07.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.676+0000 7fbc497fa640 1 -- 172.21.15.2:0/3685617034 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c005630 con 0x5626bc71c370 2024-09-19T06:21:07.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.676+0000 7fbc5b893740 1 -- 172.21.15.2:0/3685617034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626bc71c370 msgr2=0x5626bc71e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:07.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.676+0000 7fbc5b893740 1 --2- 172.21.15.2:0/3685617034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626bc71c370 0x5626bc71e760 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c005c40 tx=0x7fbc3c005fd0 comp rx=0 tx=0).stop 2024-09-19T06:21:07.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.677+0000 7fbc5b893740 1 -- 172.21.15.2:0/3685617034 shutdown_connections 2024-09-19T06:21:07.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.677+0000 7fbc5b893740 1 --2- 172.21.15.2:0/3685617034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626bc71c370 0x5626bc71e760 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:07.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.677+0000 7fbc5b893740 1 --2- 172.21.15.2:0/3685617034 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5626bc7115d0 0x5626bc711a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:07.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.677+0000 7fbc5b893740 1 --2- 172.21.15.2:0/3685617034 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5626bc712b40 0x5626bc711090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:07.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.677+0000 7fbc5b893740 1 -- 172.21.15.2:0/3685617034 >> 172.21.15.2:0/3685617034 conn(0x5626bc6da310 msgr2=0x5626bc70dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:07.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.677+0000 7fbc5b893740 1 -- 172.21.15.2:0/3685617034 shutdown_connections 2024-09-19T06:21:07.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.677+0000 7fbc5b893740 1 -- 172.21.15.2:0/3685617034 wait complete. 2024-09-19T06:21:07.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.677+0000 7fbc5b893740 1 -- start start 2024-09-19T06:21:07.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.677+0000 7fbc5b893740 1 Processor -- start 2024-09-19T06:21:07.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.677+0000 7fbc5b893740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626bc7115d0 0x5626bc71bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:07.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.677+0000 7fbc5b893740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5626bc712b40 0x5626bc719030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:07.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.677+0000 7fbc5b893740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5626bc71c370 0x5626bc719640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:07.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.677+0000 7fbc5b893740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5626bc71f010 con 0x5626bc7115d0 2024-09-19T06:21:07.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.677+0000 7fbc5b893740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5626bc632060 con 0x5626bc712b40 2024-09-19T06:21:07.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.677+0000 7fbc5b893740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5626bc71f190 con 0x5626bc71c370 2024-09-19T06:21:07.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.677+0000 7fbc5b893740 10 client.0 _ll_register_callbacks cb 0x5626bc3858c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:07.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.677+0000 7fbc4bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626bc7115d0 0x5626bc71bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:07.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.678+0000 7fbc4bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626bc7115d0 0x5626bc71bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45568/0 (socket says 172.21.15.2:45568) 2024-09-19T06:21:07.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.678+0000 7fbc4bfff640 1 -- 172.21.15.2:0/2505704395 learned_addr learned my addr 172.21.15.2:0/2505704395 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:07.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.678+0000 7fbc52ffd640 1 --2- 172.21.15.2:0/2505704395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5626bc712b40 0x5626bc719030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:07.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.678+0000 7fbc4bfff640 1 --2- 172.21.15.2:0/2505704395 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5626bc71c370 0x5626bc719640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:07.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.678+0000 7fbc4bfff640 1 -- 172.21.15.2:0/2505704395 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5626bc71c370 msgr2=0x5626bc719640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:07.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.678+0000 7fbc4bfff640 1 --2- 172.21.15.2:0/2505704395 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5626bc71c370 0x5626bc719640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:07.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.678+0000 7fbc4bfff640 1 -- 172.21.15.2:0/2505704395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5626bc712b40 msgr2=0x5626bc719030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:07.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.678+0000 7fbc4bfff640 1 --2- 172.21.15.2:0/2505704395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5626bc712b40 0x5626bc719030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:07.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.678+0000 7fbc4bfff640 1 -- 172.21.15.2:0/2505704395 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626bc3e83c0 con 0x5626bc7115d0 2024-09-19T06:21:07.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.678+0000 7fbc4bfff640 1 --2- 172.21.15.2:0/2505704395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626bc7115d0 0x5626bc71bd80 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c0096c0 tx=0x7fbc3c0052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c430cea8afdf4ff0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:07.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.678+0000 7fbc3a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:07.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.678+0000 7fbc3a7fc640 1 -- 172.21.15.2:0/2505704395 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c053060 con 0x5626bc7115d0 2024-09-19T06:21:07.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.678+0000 7fbc3a7fc640 1 -- 172.21.15.2:0/2505704395 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fbc3c0043f0 con 0x5626bc7115d0 2024-09-19T06:21:07.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.678+0000 7fbc5b893740 1 -- 172.21.15.2:0/2505704395 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc3c004030 con 0x5626bc7115d0 2024-09-19T06:21:07.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.678+0000 7fbc3a7fc640 1 -- 172.21.15.2:0/2505704395 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fbc3c035040 con 0x5626bc7115d0 2024-09-19T06:21:07.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.678+0000 7fbc5b893740 10 client.17238 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:07.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.678+0000 7fbc5b893740 1 -- 172.21.15.2:0/2505704395 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5626bc72ab10 con 0x5626bc7115d0 2024-09-19T06:21:07.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.679+0000 7fbc3a7fc640 1 -- 172.21.15.2:0/2505704395 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbc3c004030 con 0x5626bc7115d0 2024-09-19T06:21:07.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.679+0000 7fbc3a7fc640 1 -- 172.21.15.2:0/2505704395 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fbc3c004c30 con 0x5626bc7115d0 2024-09-19T06:21:07.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.679+0000 7fbc5b893740 10 client.17238 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:07.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.679+0000 7fbc5b893740 10 client.17238 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:21:07.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.679+0000 7fbc5b893740 20 client.17238 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:07.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.679+0000 7fbc5b893740 1 --2- 172.21.15.2:0/2505704395 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5626bc72be60 0x5626bc72e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:07.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.679+0000 7fbc5b893740 4 client.17238 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:07.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.679+0000 7fbc5b893740 1 -- 172.21.15.2:0/2505704395 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5626bc684860 con 0x5626bc72be60 2024-09-19T06:21:07.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.679+0000 7fbc52ffd640 1 --2- 172.21.15.2:0/2505704395 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5626bc72be60 0x5626bc72e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:07.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.680+0000 7fbc52ffd640 1 --2- 172.21.15.2:0/2505704395 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5626bc72be60 0x5626bc72e250 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8361fb241dd856b7 server_cookie=56a6ce1067ae33f in_seq=0 out_seq=0 2024-09-19T06:21:07.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.680+0000 7fbc3a7fc640 10 client.17238 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:21:07.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.680+0000 7fbc3a7fc640 1 -- 172.21.15.2:0/2505704395 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5626bc684860 con 0x5626bc72be60 2024-09-19T06:21:07.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.680+0000 7fbc3a7fc640 10 client.17238 handle_command_reply: tid=0 2024-09-19T06:21:07.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.680+0000 7fbc5b893740 1 client.17238 shutdown 2024-09-19T06:21:07.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.681+0000 7fbc5b893740 1 -- 172.21.15.2:0/2505704395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626bc7115d0 msgr2=0x5626bc71bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:07.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.681+0000 7fbc5b893740 1 --2- 172.21.15.2:0/2505704395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626bc7115d0 0x5626bc71bd80 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c0096c0 tx=0x7fbc3c0052f0 comp rx=0 tx=0).stop 2024-09-19T06:21:07.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.681+0000 7fbc5b893740 1 -- 172.21.15.2:0/2505704395 shutdown_connections 2024-09-19T06:21:07.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.681+0000 7fbc5b893740 1 --2- 172.21.15.2:0/2505704395 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5626bc72be60 0x5626bc72e250 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:07.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.681+0000 7fbc3a7fc640 0 client.17238 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:21:07.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.681+0000 7fbc5b893740 1 --2- 172.21.15.2:0/2505704395 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5626bc71c370 0x5626bc719640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:07.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.681+0000 7fbc5b893740 1 --2- 172.21.15.2:0/2505704395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5626bc712b40 0x5626bc719030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:07.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.681+0000 7fbc5b893740 1 --2- 172.21.15.2:0/2505704395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626bc7115d0 0x5626bc71bd80 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:07.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.681+0000 7fbc5b893740 1 -- 172.21.15.2:0/2505704395 >> 172.21.15.2:0/2505704395 conn(0x5626bc6da310 msgr2=0x5626bc713960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:07.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.681+0000 7fbc5b893740 1 -- 172.21.15.2:0/2505704395 shutdown_connections 2024-09-19T06:21:07.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.681+0000 7fbc5b893740 1 -- 172.21.15.2:0/2505704395 wait complete. 2024-09-19T06:21:07.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.681+0000 7fbc5b893740 20 client.17238 trim_cache size 0 max 16384 2024-09-19T06:21:07.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.694+0000 7fbc5b893740 1 Processor -- start 2024-09-19T06:21:07.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.694+0000 7fbc5b893740 1 -- start start 2024-09-19T06:21:07.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.694+0000 7fbc5b893740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5626bc7115d0 0x5626bc728460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:07.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.694+0000 7fbc5b893740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626bc712b40 0x5626bc70de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:07.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.694+0000 7fbc5b893740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5626bc71c370 0x5626bc7188f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:07.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.694+0000 7fbc5b893740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbc541b2200 con 0x5626bc712b40 2024-09-19T06:21:07.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.694+0000 7fbc5b893740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fbc541afad0 con 0x5626bc7115d0 2024-09-19T06:21:07.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.694+0000 7fbc5b893740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbc541ad920 con 0x5626bc71c370 2024-09-19T06:21:07.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.694+0000 7fbc52ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626bc712b40 0x5626bc70de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:07.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.694+0000 7fbc52ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626bc712b40 0x5626bc70de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45570/0 (socket says 172.21.15.2:45570) 2024-09-19T06:21:07.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.694+0000 7fbc52ffd640 1 -- 172.21.15.2:0/2573276322 learned_addr learned my addr 172.21.15.2:0/2573276322 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:07.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.694+0000 7fbc4bfff640 1 --2- 172.21.15.2:0/2573276322 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5626bc7115d0 0x5626bc728460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:07.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.695+0000 7fbc4bfff640 1 --2- 172.21.15.2:0/2573276322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5626bc71c370 0x5626bc7188f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:07.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.695+0000 7fbc52ffd640 1 -- 172.21.15.2:0/2573276322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5626bc71c370 msgr2=0x5626bc7188f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:07.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.695+0000 7fbc52ffd640 1 --2- 172.21.15.2:0/2573276322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5626bc71c370 0x5626bc7188f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:07.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.695+0000 7fbc52ffd640 1 -- 172.21.15.2:0/2573276322 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5626bc7115d0 msgr2=0x5626bc728460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:07.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.695+0000 7fbc52ffd640 1 --2- 172.21.15.2:0/2573276322 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5626bc7115d0 0x5626bc728460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:07.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.695+0000 7fbc52ffd640 1 -- 172.21.15.2:0/2573276322 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626bc719fd0 con 0x5626bc712b40 2024-09-19T06:21:07.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.695+0000 7fbc4bfff640 1 --2- 172.21.15.2:0/2573276322 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5626bc7115d0 0x5626bc728460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:07.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.695+0000 7fbc52ffd640 1 --2- 172.21.15.2:0/2573276322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626bc712b40 0x5626bc70de10 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fbc4400b8c0 tx=0x7fbc4400b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=661d51f18569f54c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:07.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.695+0000 7fbc48ff9640 1 -- 172.21.15.2:0/2573276322 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc44005020 con 0x5626bc712b40 2024-09-19T06:21:07.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.695+0000 7fbc48ff9640 1 -- 172.21.15.2:0/2573276322 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbc440047a0 con 0x5626bc712b40 2024-09-19T06:21:07.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.695+0000 7fbc48ff9640 1 -- 172.21.15.2:0/2573276322 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc440116a0 con 0x5626bc712b40 2024-09-19T06:21:07.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.696+0000 7fbc5b893740 1 -- 172.21.15.2:0/2573276322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626bc712b40 msgr2=0x5626bc70de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:07.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.696+0000 7fbc5b893740 1 --2- 172.21.15.2:0/2573276322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626bc712b40 0x5626bc70de10 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fbc4400b8c0 tx=0x7fbc4400b390 comp rx=0 tx=0).stop 2024-09-19T06:21:07.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.696+0000 7fbc5b893740 1 -- 172.21.15.2:0/2573276322 shutdown_connections 2024-09-19T06:21:07.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.696+0000 7fbc5b893740 1 --2- 172.21.15.2:0/2573276322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5626bc71c370 0x5626bc7188f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:07.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.696+0000 7fbc5b893740 1 --2- 172.21.15.2:0/2573276322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626bc712b40 0x5626bc70de10 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:07.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.696+0000 7fbc5b893740 1 --2- 172.21.15.2:0/2573276322 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5626bc7115d0 0x5626bc728460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:07.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.696+0000 7fbc5b893740 1 -- 172.21.15.2:0/2573276322 >> 172.21.15.2:0/2573276322 conn(0x5626bc6da310 msgr2=0x5626bc70d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:07.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.696+0000 7fbc5b893740 1 -- 172.21.15.2:0/2573276322 shutdown_connections 2024-09-19T06:21:07.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.696+0000 7fbc5b893740 1 -- 172.21.15.2:0/2573276322 wait complete. 2024-09-19T06:21:07.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.696+0000 7fbc5b893740 1 -- start start 2024-09-19T06:21:07.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.696+0000 7fbc5b893740 1 Processor -- start 2024-09-19T06:21:07.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.696+0000 7fbc5b893740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626bc7115d0 0x5626bc7317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:07.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.697+0000 7fbc5b893740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5626bc712b40 0x5626bc72eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:07.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.697+0000 7fbc5b893740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5626bc71c370 0x5626bc72f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:07.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.697+0000 7fbc5b893740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbc541adf90 con 0x5626bc7115d0 2024-09-19T06:21:07.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.697+0000 7fbc5b893740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fbc541af400 con 0x5626bc71c370 2024-09-19T06:21:07.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.697+0000 7fbc5b893740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbc541ae660 con 0x5626bc712b40 2024-09-19T06:21:07.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.697+0000 7fbc5b893740 10 client.0 _ll_register_callbacks cb 0x7fbc44004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:07.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.697+0000 7fbc4bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626bc7115d0 0x5626bc7317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:07.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.697+0000 7fbc4bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626bc7115d0 0x5626bc7317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45576/0 (socket says 172.21.15.2:45576) 2024-09-19T06:21:07.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.697+0000 7fbc4bfff640 1 -- 172.21.15.2:0/150327145 learned_addr learned my addr 172.21.15.2:0/150327145 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:07.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.697+0000 7fbc52ffd640 1 --2- 172.21.15.2:0/150327145 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5626bc712b40 0x5626bc72eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:07.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.697+0000 7fbc4bfff640 1 --2- 172.21.15.2:0/150327145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5626bc71c370 0x5626bc72f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:07.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.697+0000 7fbc4bfff640 1 -- 172.21.15.2:0/150327145 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5626bc712b40 msgr2=0x5626bc72eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:07.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.697+0000 7fbc4bfff640 1 --2- 172.21.15.2:0/150327145 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5626bc712b40 0x5626bc72eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:07.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.697+0000 7fbc4bfff640 1 -- 172.21.15.2:0/150327145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5626bc71c370 msgr2=0x5626bc72f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:07.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.697+0000 7fbc4bfff640 1 --2- 172.21.15.2:0/150327145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5626bc71c370 0x5626bc72f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:07.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.697+0000 7fbc4bfff640 1 -- 172.21.15.2:0/150327145 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626bc72f6c0 con 0x5626bc7115d0 2024-09-19T06:21:07.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.697+0000 7fbc4bfff640 1 --2- 172.21.15.2:0/150327145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626bc7115d0 0x5626bc7317f0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c003950 tx=0x7fbc3c032c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aefa5764af182fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:07.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.697+0000 7fbc3a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:07.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.697+0000 7fbc3a7fc640 1 -- 172.21.15.2:0/150327145 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c053070 con 0x5626bc7115d0 2024-09-19T06:21:07.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.697+0000 7fbc3a7fc640 1 -- 172.21.15.2:0/150327145 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8477+0+0 (secure 0 0 0) 0x7fbc3c0043f0 con 0x5626bc7115d0 2024-09-19T06:21:07.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.697+0000 7fbc5b893740 1 -- 172.21.15.2:0/150327145 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc440047a0 con 0x5626bc7115d0 2024-09-19T06:21:07.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.698+0000 7fbc3a7fc640 1 -- 172.21.15.2:0/150327145 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fbc3c032ce0 con 0x5626bc7115d0 2024-09-19T06:21:07.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.698+0000 7fbc5b893740 10 client.17244 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:07.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.698+0000 7fbc5b893740 1 -- 172.21.15.2:0/150327145 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5626bc7965b0 con 0x5626bc7115d0 2024-09-19T06:21:07.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.698+0000 7fbc3a7fc640 1 -- 172.21.15.2:0/150327145 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbc440047a0 con 0x5626bc7115d0 2024-09-19T06:21:07.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.698+0000 7fbc3a7fc640 1 -- 172.21.15.2:0/150327145 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fbc3c004bb0 con 0x5626bc7115d0 2024-09-19T06:21:07.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.698+0000 7fbc5b893740 10 client.17244 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:07.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.698+0000 7fbc5b893740 10 client.17244 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:21:07.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.698+0000 7fbc5b893740 20 client.17244 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:07.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.698+0000 7fbc5b893740 1 --2- 172.21.15.2:0/150327145 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5626bc796be0 0x5626bc799000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:07.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.698+0000 7fbc5b893740 4 client.17244 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:21:07.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.698+0000 7fbc5b893740 1 -- 172.21.15.2:0/150327145 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5626bc67ed70 con 0x5626bc796be0 2024-09-19T06:21:07.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.698+0000 7fbc52ffd640 1 --2- 172.21.15.2:0/150327145 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5626bc796be0 0x5626bc799000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:07.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.699+0000 7fbc3a7fc640 10 client.17244 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:21:07.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.699+0000 7fbc52ffd640 1 --2- 172.21.15.2:0/150327145 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5626bc796be0 0x5626bc799000 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=30c5b0754271d7cb server_cookie=41a7e44464581199 in_seq=0 out_seq=0 2024-09-19T06:21:07.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.699+0000 7fbc3a7fc640 1 -- 172.21.15.2:0/150327145 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5626bc67ed70 con 0x5626bc796be0 2024-09-19T06:21:07.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.699+0000 7fbc3a7fc640 10 client.17244 handle_command_reply: tid=0 2024-09-19T06:21:07.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.699+0000 7fbc5b893740 1 client.17244 shutdown 2024-09-19T06:21:07.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.699+0000 7fbc5b893740 1 -- 172.21.15.2:0/150327145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626bc7115d0 msgr2=0x5626bc7317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:07.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.699+0000 7fbc5b893740 1 --2- 172.21.15.2:0/150327145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626bc7115d0 0x5626bc7317f0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c003950 tx=0x7fbc3c032c70 comp rx=0 tx=0).stop 2024-09-19T06:21:07.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.699+0000 7fbc5b893740 1 -- 172.21.15.2:0/150327145 shutdown_connections 2024-09-19T06:21:07.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.699+0000 7fbc5b893740 1 --2- 172.21.15.2:0/150327145 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5626bc796be0 0x5626bc799000 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:07.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.699+0000 7fbc5b893740 1 --2- 172.21.15.2:0/150327145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5626bc71c370 0x5626bc72f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:07.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.699+0000 7fbc5b893740 1 --2- 172.21.15.2:0/150327145 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5626bc712b40 0x5626bc72eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:07.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.699+0000 7fbc3a7fc640 0 client.17244 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:21:07.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.699+0000 7fbc5b893740 1 --2- 172.21.15.2:0/150327145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5626bc7115d0 0x5626bc7317f0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:07.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.699+0000 7fbc5b893740 1 -- 172.21.15.2:0/150327145 >> 172.21.15.2:0/150327145 conn(0x5626bc6da310 msgr2=0x5626bc70c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:07.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.699+0000 7fbc5b893740 1 -- 172.21.15.2:0/150327145 shutdown_connections 2024-09-19T06:21:07.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.699+0000 7fbc5b893740 1 -- 172.21.15.2:0/150327145 wait complete. 2024-09-19T06:21:07.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.699+0000 7fbc5b893740 20 client.17244 trim_cache size 0 max 16384 2024-09-19T06:21:07.706 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:21:07.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.700+0000 7fbc594ba640 1 -- 172.21.15.2:0/1990515420 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fbc400a33b0 msgr2=0x7fbc400a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:07.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.700+0000 7fbc594ba640 1 --2- 172.21.15.2:0/1990515420 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fbc400a33b0 0x7fbc400a5870 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c09c1b0 tx=0x7fbc4c0a0040 comp rx=0 tx=0).stop 2024-09-19T06:21:07.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.700+0000 7fbc594ba640 1 -- 172.21.15.2:0/1990515420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc54106a80 msgr2=0x7fbc540fd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:07.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.700+0000 7fbc594ba640 1 --2- 172.21.15.2:0/1990515420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc54106a80 0x7fbc540fd930 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c00eaa0 tx=0x7fbc4c00ef60 comp rx=0 tx=0).stop 2024-09-19T06:21:07.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.700+0000 7fbc594ba640 1 -- 172.21.15.2:0/1990515420 shutdown_connections 2024-09-19T06:21:07.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.700+0000 7fbc594ba640 1 --2- 172.21.15.2:0/1990515420 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fbc400a33b0 0x7fbc400a5870 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:07.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.700+0000 7fbc594ba640 1 --2- 172.21.15.2:0/1990515420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc54106a80 0x7fbc540fd930 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:07.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.700+0000 7fbc594ba640 1 --2- 172.21.15.2:0/1990515420 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc54101420 0x7fbc540fd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:07.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.700+0000 7fbc594ba640 1 --2- 172.21.15.2:0/1990515420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc54100a80 0x7fbc540fceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:07.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.700+0000 7fbc594ba640 1 -- 172.21.15.2:0/1990515420 >> 172.21.15.2:0/1990515420 conn(0x7fbc540fc7a0 msgr2=0x7fbc5406ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:07.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.700+0000 7fbc594ba640 1 -- 172.21.15.2:0/1990515420 shutdown_connections 2024-09-19T06:21:07.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:07.700+0000 7fbc594ba640 1 -- 172.21.15.2:0/1990515420 wait complete. 2024-09-19T06:21:08.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:08 smithi089 ceph-mon[34160]: pgmap v192: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-19T06:21:08.371 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:08 smithi002 ceph-mon[30982]: pgmap v192: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-19T06:21:08.413 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:21:08.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:08 smithi090 ceph-mon[34497]: pgmap v192: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-19T06:21:08.671 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:09.054 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:09 smithi002 ceph-mon[30982]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T06:21:09.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.135+0000 7f0192eb7640 1 -- 172.21.15.2:0/2854826956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f018c101420 msgr2=0x7f018c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:09.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.135+0000 7f0192eb7640 1 --2- 172.21.15.2:0/2854826956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f018c101420 0x7f018c10d950 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f017c009cd0 tx=0x7f017c02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:21:09.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.135+0000 7f0192eb7640 1 -- 172.21.15.2:0/2854826956 shutdown_connections 2024-09-19T06:21:09.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.135+0000 7f0192eb7640 1 --2- 172.21.15.2:0/2854826956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f018c101420 0x7f018c10d950 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:09.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.135+0000 7f0192eb7640 1 --2- 172.21.15.2:0/2854826956 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f018c100a80 0x7f018c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:09.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.135+0000 7f0192eb7640 1 --2- 172.21.15.2:0/2854826956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f018c106a80 0x7f018c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:09.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.135+0000 7f0192eb7640 1 -- 172.21.15.2:0/2854826956 >> 172.21.15.2:0/2854826956 conn(0x7f018c0fc7a0 msgr2=0x7f018c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:09.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.135+0000 7f0192eb7640 1 -- 172.21.15.2:0/2854826956 shutdown_connections 2024-09-19T06:21:09.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.135+0000 7f0192eb7640 1 -- 172.21.15.2:0/2854826956 wait complete. 2024-09-19T06:21:09.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.136+0000 7f0192eb7640 1 Processor -- start 2024-09-19T06:21:09.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.136+0000 7f0192eb7640 1 -- start start 2024-09-19T06:21:09.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.136+0000 7f0192eb7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f018c100a80 0x7f018c0fcde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:09.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.136+0000 7f0192eb7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f018c101420 0x7f018c0fd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:09.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.136+0000 7f0192eb7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f018c106a80 0x7f018c0fd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:09.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.136+0000 7f0192eb7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f018c110d30 con 0x7f018c101420 2024-09-19T06:21:09.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.136+0000 7f0192eb7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f018c110bb0 con 0x7f018c106a80 2024-09-19T06:21:09.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.136+0000 7f0192eb7640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f018c110eb0 con 0x7f018c100a80 2024-09-19T06:21:09.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.136+0000 7f018bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f018c101420 0x7f018c0fd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:09.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.136+0000 7f018bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f018c101420 0x7f018c0fd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45596/0 (socket says 172.21.15.2:45596) 2024-09-19T06:21:09.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.136+0000 7f018bfff640 1 -- 172.21.15.2:0/833728976 learned_addr learned my addr 172.21.15.2:0/833728976 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:09.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.137+0000 7f0190c53640 1 --2- 172.21.15.2:0/833728976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f018c100a80 0x7f018c0fcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:09.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.137+0000 7f0191454640 1 --2- 172.21.15.2:0/833728976 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f018c106a80 0x7f018c0fd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:09.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.137+0000 7f018bfff640 1 -- 172.21.15.2:0/833728976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f018c100a80 msgr2=0x7f018c0fcde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:09.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.137+0000 7f018bfff640 1 --2- 172.21.15.2:0/833728976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f018c100a80 0x7f018c0fcde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:09.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.137+0000 7f018bfff640 1 -- 172.21.15.2:0/833728976 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f018c106a80 msgr2=0x7f018c0fd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:09.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.137+0000 7f018bfff640 1 --2- 172.21.15.2:0/833728976 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f018c106a80 0x7f018c0fd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:09.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.137+0000 7f018bfff640 1 -- 172.21.15.2:0/833728976 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f018c1a67f0 con 0x7f018c101420 2024-09-19T06:21:09.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.137+0000 7f018bfff640 1 --2- 172.21.15.2:0/833728976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f018c101420 0x7f018c0fd320 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f017400c970 tx=0x7f017400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:09.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.137+0000 7f0189ffb640 1 -- 172.21.15.2:0/833728976 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0174007bb0 con 0x7f018c101420 2024-09-19T06:21:09.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.137+0000 7f0189ffb640 1 -- 172.21.15.2:0/833728976 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0174007d50 con 0x7f018c101420 2024-09-19T06:21:09.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.137+0000 7f0189ffb640 1 -- 172.21.15.2:0/833728976 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017400f450 con 0x7f018c101420 2024-09-19T06:21:09.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.137+0000 7f0192eb7640 1 -- 172.21.15.2:0/833728976 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f018c1a6ae0 con 0x7f018c101420 2024-09-19T06:21:09.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.137+0000 7f0192eb7640 1 -- 172.21.15.2:0/833728976 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f018c1a6fd0 con 0x7f018c101420 2024-09-19T06:21:09.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.140+0000 7f0189ffb640 1 -- 172.21.15.2:0/833728976 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f0174004f20 con 0x7f018c101420 2024-09-19T06:21:09.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.140+0000 7f0195290740 1 Processor -- start 2024-09-19T06:21:09.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.140+0000 7f0195290740 1 -- start start 2024-09-19T06:21:09.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.140+0000 7f0195290740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584c19b0b40 0x5584c19af090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:09.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.140+0000 7f0195290740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584c19af5d0 0x5584c19afa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:09.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.140+0000 7f0195290740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5584c19ba370 0x5584c19bc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:09.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.140+0000 7f0195290740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5584c19152f0 con 0x5584c19af5d0 2024-09-19T06:21:09.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.140+0000 7f0195290740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5584c18bccf0 con 0x5584c19ba370 2024-09-19T06:21:09.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.140+0000 7f0195290740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5584c19112b0 con 0x5584c19b0b40 2024-09-19T06:21:09.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.140+0000 7f0190c53640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584c19af5d0 0x5584c19afa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:09.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.140+0000 7f0190c53640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584c19af5d0 0x5584c19afa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45612/0 (socket says 172.21.15.2:45612) 2024-09-19T06:21:09.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.140+0000 7f0189ffb640 1 --2- 172.21.15.2:0/833728976 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f01780a3430 0x7f01780a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:09.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.140+0000 7f0190c53640 1 -- 172.21.15.2:0/3604359794 learned_addr learned my addr 172.21.15.2:0/3604359794 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:09.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.141+0000 7f0191454640 1 --2- 172.21.15.2:0/3604359794 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584c19b0b40 0x5584c19af090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:09.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.141+0000 7f0191454640 1 --2- 172.21.15.2:0/833728976 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f01780a3430 0x7f01780a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:09.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.141+0000 7f018bfff640 1 --2- 172.21.15.2:0/3604359794 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5584c19ba370 0x5584c19bc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:09.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.141+0000 7f0190c53640 1 -- 172.21.15.2:0/3604359794 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584c19b0b40 msgr2=0x5584c19af090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:09.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.141+0000 7f0190c53640 1 --2- 172.21.15.2:0/3604359794 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584c19b0b40 0x5584c19af090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:09.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.141+0000 7f0189ffb640 1 -- 172.21.15.2:0/833728976 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8565+0+0 (secure 0 0 0) 0x7f01740cfb00 con 0x7f018c101420 2024-09-19T06:21:09.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.141+0000 7f0190c53640 1 -- 172.21.15.2:0/3604359794 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5584c19ba370 msgr2=0x5584c19bc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:09.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.141+0000 7f0190c53640 1 --2- 172.21.15.2:0/3604359794 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5584c19ba370 0x5584c19bc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:09.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.141+0000 7f0190c53640 1 -- 172.21.15.2:0/3604359794 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584c18a13a0 con 0x5584c19af5d0 2024-09-19T06:21:09.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.141+0000 7f018bfff640 1 --2- 172.21.15.2:0/3604359794 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5584c19ba370 0x5584c19bc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:21:09.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.141+0000 7f0190c53640 1 --2- 172.21.15.2:0/3604359794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584c19af5d0 0x5584c19afa10 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f018400bc60 tx=0x7f018400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3da86fe503f349bd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:09.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.141+0000 7f0191454640 1 --2- 172.21.15.2:0/833728976 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f01780a3430 0x7f01780a58f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f017c033040 tx=0x7f017c0095c0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:09.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.141+0000 7f0182ffd640 1 -- 172.21.15.2:0/3604359794 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0184015070 con 0x5584c19af5d0 2024-09-19T06:21:09.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.141+0000 7f0182ffd640 1 -- 172.21.15.2:0/3604359794 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f01840118f0 con 0x5584c19af5d0 2024-09-19T06:21:09.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.141+0000 7f0182ffd640 1 -- 172.21.15.2:0/3604359794 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0184010810 con 0x5584c19af5d0 2024-09-19T06:21:09.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.142+0000 7f0195290740 1 -- 172.21.15.2:0/3604359794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584c19af5d0 msgr2=0x5584c19afa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:09.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.142+0000 7f0195290740 1 --2- 172.21.15.2:0/3604359794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584c19af5d0 0x5584c19afa10 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f018400bc60 tx=0x7f018400f730 comp rx=0 tx=0).stop 2024-09-19T06:21:09.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.142+0000 7f0195290740 1 -- 172.21.15.2:0/3604359794 shutdown_connections 2024-09-19T06:21:09.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.142+0000 7f0195290740 1 --2- 172.21.15.2:0/3604359794 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5584c19ba370 0x5584c19bc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:09.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.142+0000 7f0195290740 1 --2- 172.21.15.2:0/3604359794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584c19af5d0 0x5584c19afa10 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:09.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.142+0000 7f0195290740 1 --2- 172.21.15.2:0/3604359794 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584c19b0b40 0x5584c19af090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:09.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.142+0000 7f0195290740 1 -- 172.21.15.2:0/3604359794 >> 172.21.15.2:0/3604359794 conn(0x5584c1978310 msgr2=0x5584c19abc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:09.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.142+0000 7f0195290740 1 -- 172.21.15.2:0/3604359794 shutdown_connections 2024-09-19T06:21:09.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.142+0000 7f0195290740 1 -- 172.21.15.2:0/3604359794 wait complete. 2024-09-19T06:21:09.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.142+0000 7f0195290740 1 -- start start 2024-09-19T06:21:09.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.142+0000 7f0195290740 1 Processor -- start 2024-09-19T06:21:09.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.143+0000 7f0195290740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584c19af5d0 0x5584c19b9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:09.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.143+0000 7f0195290740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584c19b0b40 0x5584c19b7000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:09.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.143+0000 7f0195290740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5584c19ba370 0x5584c19b75d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:09.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.143+0000 7f0195290740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5584c19bd070 con 0x5584c19b0b40 2024-09-19T06:21:09.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.143+0000 7f0195290740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5584c18d0060 con 0x5584c19ba370 2024-09-19T06:21:09.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.143+0000 7f0195290740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5584c19bd1f0 con 0x5584c19af5d0 2024-09-19T06:21:09.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.143+0000 7f0195290740 10 client.0 _ll_register_callbacks cb 0x5584c16238c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:09.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.143+0000 7f018bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584c19b0b40 0x5584c19b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:09.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.143+0000 7f018bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584c19b0b40 0x5584c19b7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45620/0 (socket says 172.21.15.2:45620) 2024-09-19T06:21:09.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.143+0000 7f018bfff640 1 -- 172.21.15.2:0/398095426 learned_addr learned my addr 172.21.15.2:0/398095426 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:09.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.143+0000 7f0191454640 1 --2- 172.21.15.2:0/398095426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5584c19ba370 0x5584c19b75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:09.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.143+0000 7f0190c53640 1 --2- 172.21.15.2:0/398095426 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584c19af5d0 0x5584c19b9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:09.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.143+0000 7f018bfff640 1 -- 172.21.15.2:0/398095426 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584c19af5d0 msgr2=0x5584c19b9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:09.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.143+0000 7f018bfff640 1 --2- 172.21.15.2:0/398095426 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584c19af5d0 0x5584c19b9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:09.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.143+0000 7f018bfff640 1 -- 172.21.15.2:0/398095426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5584c19ba370 msgr2=0x5584c19b75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:09.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.143+0000 7f018bfff640 1 --2- 172.21.15.2:0/398095426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5584c19ba370 0x5584c19b75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:09.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.143+0000 7f018bfff640 1 -- 172.21.15.2:0/398095426 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584c16863c0 con 0x5584c19b0b40 2024-09-19T06:21:09.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.143+0000 7f0190c53640 1 --2- 172.21.15.2:0/398095426 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584c19af5d0 0x5584c19b9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:21:09.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.144+0000 7f018bfff640 1 --2- 172.21.15.2:0/398095426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584c19b0b40 0x5584c19b7000 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f017400c940 tx=0x7f017401d3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaca9fe48e66e1ee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:09.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.144+0000 7f016bfff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:09.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.144+0000 7f016bfff640 1 -- 172.21.15.2:0/398095426 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017409bdb0 con 0x5584c19b0b40 2024-09-19T06:21:09.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.144+0000 7f016bfff640 1 -- 172.21.15.2:0/398095426 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8565+0+0 (secure 0 0 0) 0x7f017409c010 con 0x5584c19b0b40 2024-09-19T06:21:09.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.144+0000 7f0195290740 1 -- 172.21.15.2:0/398095426 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01840118f0 con 0x5584c19b0b40 2024-09-19T06:21:09.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.144+0000 7f016bfff640 1 -- 172.21.15.2:0/398095426 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f01740a0160 con 0x5584c19b0b40 2024-09-19T06:21:09.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.144+0000 7f0195290740 10 client.17256 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:09.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.144+0000 7f0195290740 1 -- 172.21.15.2:0/398095426 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5584c19c8b20 con 0x5584c19b0b40 2024-09-19T06:21:09.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.144+0000 7f016bfff640 1 -- 172.21.15.2:0/398095426 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f01840118f0 con 0x5584c19b0b40 2024-09-19T06:21:09.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.144+0000 7f016bfff640 1 -- 172.21.15.2:0/398095426 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f017409b200 con 0x5584c19b0b40 2024-09-19T06:21:09.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.144+0000 7f0195290740 10 client.17256 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:09.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.145+0000 7f0195290740 10 client.17256 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:09.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.145+0000 7f0195290740 20 client.17256 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:09.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.145+0000 7f0195290740 1 --2- 172.21.15.2:0/398095426 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5584c19c9f80 0x5584c19cc390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:09.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.145+0000 7f0195290740 4 client.17256 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:09.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.145+0000 7f0195290740 1 -- 172.21.15.2:0/398095426 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5584c1922860 con 0x5584c19c9f80 2024-09-19T06:21:09.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.145+0000 7f0190c53640 1 --2- 172.21.15.2:0/398095426 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5584c19c9f80 0x5584c19cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:09.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.145+0000 7f0190c53640 1 --2- 172.21.15.2:0/398095426 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5584c19c9f80 0x5584c19cc390 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=daf62feec5b4992d server_cookie=bb1931b0f9b8bd45 in_seq=0 out_seq=0 2024-09-19T06:21:09.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.145+0000 7f016bfff640 10 client.17256 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:09.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.146+0000 7f016bfff640 1 -- 172.21.15.2:0/398095426 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5584c1922860 con 0x5584c19c9f80 2024-09-19T06:21:09.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.146+0000 7f016bfff640 10 client.17256 handle_command_reply: tid=0 2024-09-19T06:21:09.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.146+0000 7f0195290740 1 client.17256 shutdown 2024-09-19T06:21:09.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.146+0000 7f0195290740 1 -- 172.21.15.2:0/398095426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584c19b0b40 msgr2=0x5584c19b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:09.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.146+0000 7f0195290740 1 --2- 172.21.15.2:0/398095426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584c19b0b40 0x5584c19b7000 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f017400c940 tx=0x7f017401d3f0 comp rx=0 tx=0).stop 2024-09-19T06:21:09.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.146+0000 7f0195290740 1 -- 172.21.15.2:0/398095426 shutdown_connections 2024-09-19T06:21:09.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.146+0000 7f0195290740 1 --2- 172.21.15.2:0/398095426 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5584c19c9f80 0x5584c19cc390 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:09.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.146+0000 7f0195290740 1 --2- 172.21.15.2:0/398095426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5584c19ba370 0x5584c19b75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:09.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.146+0000 7f016bfff640 0 client.17256 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:09.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.146+0000 7f0195290740 1 --2- 172.21.15.2:0/398095426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584c19b0b40 0x5584c19b7000 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:09.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.146+0000 7f0195290740 1 --2- 172.21.15.2:0/398095426 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584c19af5d0 0x5584c19b9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:09.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.146+0000 7f0195290740 1 -- 172.21.15.2:0/398095426 >> 172.21.15.2:0/398095426 conn(0x5584c1978310 msgr2=0x5584c19b1990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:09.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.146+0000 7f0195290740 1 -- 172.21.15.2:0/398095426 shutdown_connections 2024-09-19T06:21:09.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.146+0000 7f0195290740 1 -- 172.21.15.2:0/398095426 wait complete. 2024-09-19T06:21:09.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.147+0000 7f0195290740 20 client.17256 trim_cache size 0 max 16384 2024-09-19T06:21:09.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.159+0000 7f0195290740 1 Processor -- start 2024-09-19T06:21:09.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.160+0000 7f0195290740 1 -- start start 2024-09-19T06:21:09.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.160+0000 7f0195290740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584c19af5d0 0x5584c19b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:09.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.160+0000 7f0195290740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5584c19b0b40 0x5584c19c6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:09.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.160+0000 7f0195290740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584c19ba370 0x5584c19bb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:09.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.160+0000 7f0195290740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f018c1b2280 con 0x5584c19af5d0 2024-09-19T06:21:09.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.160+0000 7f0195290740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f018c1afb50 con 0x5584c19b0b40 2024-09-19T06:21:09.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.160+0000 7f0195290740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f018c1ad9c0 con 0x5584c19ba370 2024-09-19T06:21:09.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.160+0000 7f0190c53640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584c19af5d0 0x5584c19b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:09.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.160+0000 7f0190c53640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584c19af5d0 0x5584c19b0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45632/0 (socket says 172.21.15.2:45632) 2024-09-19T06:21:09.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.160+0000 7f0190c53640 1 -- 172.21.15.2:0/2166313372 learned_addr learned my addr 172.21.15.2:0/2166313372 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:09.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.160+0000 7f0191454640 1 --2- 172.21.15.2:0/2166313372 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584c19ba370 0x5584c19bb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:09.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.160+0000 7f0190c53640 1 -- 172.21.15.2:0/2166313372 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584c19ba370 msgr2=0x5584c19bb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:09.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.160+0000 7f0190c53640 1 --2- 172.21.15.2:0/2166313372 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584c19ba370 0x5584c19bb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:09.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.160+0000 7f0190c53640 1 -- 172.21.15.2:0/2166313372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5584c19b0b40 msgr2=0x5584c19c6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:09.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.160+0000 7f0190c53640 1 --2- 172.21.15.2:0/2166313372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5584c19b0b40 0x5584c19c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:09.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.160+0000 7f0190c53640 1 -- 172.21.15.2:0/2166313372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584c19bbca0 con 0x5584c19af5d0 2024-09-19T06:21:09.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.160+0000 7f0191454640 1 --2- 172.21.15.2:0/2166313372 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584c19ba370 0x5584c19bb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:21:09.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.160+0000 7f0190c53640 1 --2- 172.21.15.2:0/2166313372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584c19af5d0 0x5584c19b0300 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f0184010440 tx=0x7f0184005280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4d4d2e3ad726896 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:09.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.161+0000 7f01827fc640 1 -- 172.21.15.2:0/2166313372 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0184015040 con 0x5584c19af5d0 2024-09-19T06:21:09.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.161+0000 7f01827fc640 1 -- 172.21.15.2:0/2166313372 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f018400b3e0 con 0x5584c19af5d0 2024-09-19T06:21:09.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.161+0000 7f01827fc640 1 -- 172.21.15.2:0/2166313372 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01840048e0 con 0x5584c19af5d0 2024-09-19T06:21:09.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.161+0000 7f0195290740 1 -- 172.21.15.2:0/2166313372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584c19af5d0 msgr2=0x5584c19b0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:09.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.161+0000 7f0195290740 1 --2- 172.21.15.2:0/2166313372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584c19af5d0 0x5584c19b0300 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f0184010440 tx=0x7f0184005280 comp rx=0 tx=0).stop 2024-09-19T06:21:09.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.161+0000 7f0195290740 1 -- 172.21.15.2:0/2166313372 shutdown_connections 2024-09-19T06:21:09.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.161+0000 7f0195290740 1 --2- 172.21.15.2:0/2166313372 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584c19ba370 0x5584c19bb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:09.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.161+0000 7f0195290740 1 --2- 172.21.15.2:0/2166313372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5584c19b0b40 0x5584c19c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:09.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.161+0000 7f0195290740 1 --2- 172.21.15.2:0/2166313372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584c19af5d0 0x5584c19b0300 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:09.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.161+0000 7f0195290740 1 -- 172.21.15.2:0/2166313372 >> 172.21.15.2:0/2166313372 conn(0x5584c1978310 msgr2=0x5584c19a6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:09.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.161+0000 7f0195290740 1 -- 172.21.15.2:0/2166313372 shutdown_connections 2024-09-19T06:21:09.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.162+0000 7f0195290740 1 -- 172.21.15.2:0/2166313372 wait complete. 2024-09-19T06:21:09.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.162+0000 7f0195290740 1 -- start start 2024-09-19T06:21:09.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.162+0000 7f0195290740 1 Processor -- start 2024-09-19T06:21:09.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.162+0000 7f0195290740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5584c19af5d0 0x5584c19d0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:09.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.162+0000 7f0195290740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584c19b0b40 0x5584c19d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:09.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.162+0000 7f0195290740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584c19ba370 0x5584c19c14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:09.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.162+0000 7f0195290740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f018c1ae010 con 0x5584c19ba370 2024-09-19T06:21:09.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.162+0000 7f0195290740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f018c1af480 con 0x5584c19af5d0 2024-09-19T06:21:09.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.162+0000 7f0195290740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f018c1ae6e0 con 0x5584c19b0b40 2024-09-19T06:21:09.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.162+0000 7f0195290740 10 client.0 _ll_register_callbacks cb 0x7f017400a4b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:09.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.163+0000 7f0191454640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584c19ba370 0x5584c19c14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:09.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.163+0000 7f018bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584c19b0b40 0x5584c19d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:09.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.163+0000 7f018bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584c19b0b40 0x5584c19d12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:43500/0 (socket says 172.21.15.2:43500) 2024-09-19T06:21:09.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.163+0000 7f0191454640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584c19ba370 0x5584c19c14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45642/0 (socket says 172.21.15.2:45642) 2024-09-19T06:21:09.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.163+0000 7f018bfff640 1 -- 172.21.15.2:0/4014539546 learned_addr learned my addr 172.21.15.2:0/4014539546 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:09.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.163+0000 7f0190c53640 1 --2- 172.21.15.2:0/4014539546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5584c19af5d0 0x5584c19d0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:09.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.163+0000 7f0191454640 1 -- 172.21.15.2:0/4014539546 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584c19b0b40 msgr2=0x5584c19d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:09.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.163+0000 7f0191454640 1 --2- 172.21.15.2:0/4014539546 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584c19b0b40 0x5584c19d12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:09.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.163+0000 7f0191454640 1 -- 172.21.15.2:0/4014539546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5584c19af5d0 msgr2=0x5584c19d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:09.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.163+0000 7f0191454640 1 --2- 172.21.15.2:0/4014539546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5584c19af5d0 0x5584c19d0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:09.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.163+0000 7f0191454640 1 -- 172.21.15.2:0/4014539546 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584c19c1a20 con 0x5584c19ba370 2024-09-19T06:21:09.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.163+0000 7f0191454640 1 --2- 172.21.15.2:0/4014539546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584c19ba370 0x5584c19c14e0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f017c006010 tx=0x7f017c02a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be65bd4b99496c76 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:09.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.163+0000 7f016bfff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:09.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.163+0000 7f016bfff640 1 -- 172.21.15.2:0/4014539546 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017c043070 con 0x5584c19ba370 2024-09-19T06:21:09.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.163+0000 7f016bfff640 1 -- 172.21.15.2:0/4014539546 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8565+0+0 (secure 0 0 0) 0x7f017c004690 con 0x5584c19ba370 2024-09-19T06:21:09.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.163+0000 7f0195290740 1 -- 172.21.15.2:0/4014539546 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f018400b3e0 con 0x5584c19ba370 2024-09-19T06:21:09.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.164+0000 7f016bfff640 1 -- 172.21.15.2:0/4014539546 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f017c0305a0 con 0x5584c19ba370 2024-09-19T06:21:09.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.164+0000 7f0195290740 10 client.17262 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:09.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.164+0000 7f0195290740 1 -- 172.21.15.2:0/4014539546 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5584c19c2c90 con 0x5584c19ba370 2024-09-19T06:21:09.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.164+0000 7f016bfff640 1 -- 172.21.15.2:0/4014539546 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f017c036040 con 0x5584c19ba370 2024-09-19T06:21:09.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.164+0000 7f016bfff640 1 -- 172.21.15.2:0/4014539546 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f017c051070 con 0x5584c19ba370 2024-09-19T06:21:09.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.164+0000 7f0195290740 10 client.17262 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:09.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.164+0000 7f0195290740 10 client.17262 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:09.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.164+0000 7f0195290740 20 client.17262 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:09.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.164+0000 7f0195290740 1 --2- 172.21.15.2:0/4014539546 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5584c19c9f80 0x5584c1a36c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:09.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.164+0000 7f0195290740 4 client.17262 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:21:09.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.164+0000 7f0195290740 1 -- 172.21.15.2:0/4014539546 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f018400b3e0 con 0x5584c19c9f80 2024-09-19T06:21:09.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.165+0000 7f0190c53640 1 --2- 172.21.15.2:0/4014539546 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5584c19c9f80 0x5584c1a36c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:09.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.165+0000 7f0190c53640 1 --2- 172.21.15.2:0/4014539546 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5584c19c9f80 0x5584c1a36c40 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ae6926e8396a5c0 server_cookie=7b831e5e4c72e9c1 in_seq=0 out_seq=0 2024-09-19T06:21:09.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.165+0000 7f016bfff640 10 client.17262 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:09.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.165+0000 7f016bfff640 1 -- 172.21.15.2:0/4014539546 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f018400b3e0 con 0x5584c19c9f80 2024-09-19T06:21:09.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.165+0000 7f016bfff640 10 client.17262 handle_command_reply: tid=0 2024-09-19T06:21:09.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.165+0000 7f0195290740 1 client.17262 shutdown 2024-09-19T06:21:09.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.165+0000 7f0195290740 1 -- 172.21.15.2:0/4014539546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584c19ba370 msgr2=0x5584c19c14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:09.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.165+0000 7f0195290740 1 --2- 172.21.15.2:0/4014539546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584c19ba370 0x5584c19c14e0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f017c006010 tx=0x7f017c02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:21:09.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.165+0000 7f0195290740 1 -- 172.21.15.2:0/4014539546 shutdown_connections 2024-09-19T06:21:09.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.165+0000 7f0195290740 1 --2- 172.21.15.2:0/4014539546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5584c19ba370 0x5584c19c14e0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:09.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.165+0000 7f0195290740 1 --2- 172.21.15.2:0/4014539546 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584c19b0b40 0x5584c19d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:09.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.165+0000 7f0195290740 1 --2- 172.21.15.2:0/4014539546 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5584c19c9f80 0x5584c1a36c40 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:09.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.165+0000 7f0195290740 1 --2- 172.21.15.2:0/4014539546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5584c19af5d0 0x5584c19d0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:09.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.165+0000 7f016bfff640 0 client.17262 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:09.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.165+0000 7f0195290740 1 -- 172.21.15.2:0/4014539546 >> 172.21.15.2:0/4014539546 conn(0x5584c1978310 msgr2=0x5584c19b8860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:09.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.166+0000 7f0195290740 1 -- 172.21.15.2:0/4014539546 shutdown_connections 2024-09-19T06:21:09.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.166+0000 7f0195290740 1 -- 172.21.15.2:0/4014539546 wait complete. 2024-09-19T06:21:09.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.166+0000 7f0195290740 20 client.17262 trim_cache size 0 max 16384 2024-09-19T06:21:09.174 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:21:09.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.166+0000 7f0192eb7640 1 -- 172.21.15.2:0/833728976 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f01780a3430 msgr2=0x7f01780a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:09.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.166+0000 7f0192eb7640 1 --2- 172.21.15.2:0/833728976 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f01780a3430 0x7f01780a58f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f017c033040 tx=0x7f017c0095c0 comp rx=0 tx=0).stop 2024-09-19T06:21:09.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.166+0000 7f0192eb7640 1 -- 172.21.15.2:0/833728976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f018c101420 msgr2=0x7f018c0fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:09.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.166+0000 7f0192eb7640 1 --2- 172.21.15.2:0/833728976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f018c101420 0x7f018c0fd320 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f017400c970 tx=0x7f017400ce30 comp rx=0 tx=0).stop 2024-09-19T06:21:09.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.166+0000 7f0192eb7640 1 -- 172.21.15.2:0/833728976 shutdown_connections 2024-09-19T06:21:09.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.166+0000 7f0192eb7640 1 --2- 172.21.15.2:0/833728976 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f01780a3430 0x7f01780a58f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:09.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.166+0000 7f0192eb7640 1 --2- 172.21.15.2:0/833728976 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f018c106a80 0x7f018c0fd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:09.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.166+0000 7f0192eb7640 1 --2- 172.21.15.2:0/833728976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f018c101420 0x7f018c0fd320 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:09.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.166+0000 7f0192eb7640 1 --2- 172.21.15.2:0/833728976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f018c100a80 0x7f018c0fcde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:09.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.166+0000 7f0192eb7640 1 -- 172.21.15.2:0/833728976 >> 172.21.15.2:0/833728976 conn(0x7f018c0fc7a0 msgr2=0x7f018c06aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:09.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.166+0000 7f0192eb7640 1 -- 172.21.15.2:0/833728976 shutdown_connections 2024-09-19T06:21:09.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:09.167+0000 7f0192eb7640 1 -- 172.21.15.2:0/833728976 wait complete. 2024-09-19T06:21:09.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:09 smithi089 ceph-mon[34160]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T06:21:09.489 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:09 smithi090 ceph-mon[34497]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T06:21:10.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:10 smithi002 ceph-mon[30982]: pgmap v194: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-19T06:21:10.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:10 smithi089 ceph-mon[34160]: pgmap v194: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-19T06:21:10.489 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:10 smithi090 ceph-mon[34497]: pgmap v194: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-19T06:21:10.874 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:21:10.874 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:21:11.145 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:11.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.647+0000 7f3a70586640 1 -- 172.21.15.2:0/1766441347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a68102d40 msgr2=0x7f3a68103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:11.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.647+0000 7f3a70586640 1 --2- 172.21.15.2:0/1766441347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a68102d40 0x7f3a68103120 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f3a64009900 tx=0x7f3a6402a480 comp rx=0 tx=0).stop 2024-09-19T06:21:11.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.647+0000 7f3a70586640 1 -- 172.21.15.2:0/1766441347 shutdown_connections 2024-09-19T06:21:11.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.647+0000 7f3a70586640 1 --2- 172.21.15.2:0/1766441347 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a6810c170 0x7f3a6810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:11.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.647+0000 7f3a70586640 1 --2- 172.21.15.2:0/1766441347 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a68103660 0x7f3a6810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:11.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.647+0000 7f3a70586640 1 --2- 172.21.15.2:0/1766441347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a68102d40 0x7f3a68103120 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:11.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.647+0000 7f3a70586640 1 -- 172.21.15.2:0/1766441347 >> 172.21.15.2:0/1766441347 conn(0x7f3a680fc7a0 msgr2=0x7f3a680febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:11.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.647+0000 7f3a70586640 1 -- 172.21.15.2:0/1766441347 shutdown_connections 2024-09-19T06:21:11.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.647+0000 7f3a70586640 1 -- 172.21.15.2:0/1766441347 wait complete. 2024-09-19T06:21:11.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.648+0000 7f3a70586640 1 Processor -- start 2024-09-19T06:21:11.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.648+0000 7f3a70586640 1 -- start start 2024-09-19T06:21:11.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.648+0000 7f3a70586640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a68102d40 0x7f3a681009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:11.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.648+0000 7f3a70586640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a68103660 0x7f3a68100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:11.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.648+0000 7f3a70586640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a6810c170 0x7f3a68101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:11.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.648+0000 7f3a70586640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3a68111e60 con 0x7f3a6810c170 2024-09-19T06:21:11.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.648+0000 7f3a70586640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3a68111ce0 con 0x7f3a68102d40 2024-09-19T06:21:11.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.648+0000 7f3a70586640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3a68111fe0 con 0x7f3a68103660 2024-09-19T06:21:11.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.648+0000 7f3a6e322640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a68102d40 0x7f3a681009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:11.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.648+0000 7f3a6e322640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a68102d40 0x7f3a681009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:60402/0 (socket says 172.21.15.2:60402) 2024-09-19T06:21:11.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.648+0000 7f3a6e322640 1 -- 172.21.15.2:0/3446564289 learned_addr learned my addr 172.21.15.2:0/3446564289 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:11.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.648+0000 7f3a6eb23640 1 --2- 172.21.15.2:0/3446564289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a6810c170 0x7f3a68101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:11.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.648+0000 7f3a6db21640 1 --2- 172.21.15.2:0/3446564289 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a68103660 0x7f3a68100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:11.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.649+0000 7f3a6eb23640 1 -- 172.21.15.2:0/3446564289 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a68103660 msgr2=0x7f3a68100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:11.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.649+0000 7f3a6eb23640 1 --2- 172.21.15.2:0/3446564289 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a68103660 0x7f3a68100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:11.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.649+0000 7f3a6eb23640 1 -- 172.21.15.2:0/3446564289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a68102d40 msgr2=0x7f3a681009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:11.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.649+0000 7f3a6eb23640 1 --2- 172.21.15.2:0/3446564289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a68102d40 0x7f3a681009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:11.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.649+0000 7f3a6eb23640 1 -- 172.21.15.2:0/3446564289 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a681a6930 con 0x7f3a6810c170 2024-09-19T06:21:11.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.649+0000 7f3a6eb23640 1 --2- 172.21.15.2:0/3446564289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a6810c170 0x7f3a68101420 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f3a6000be20 tx=0x7f3a6000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:11.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.649+0000 7f3a5f7fe640 1 -- 172.21.15.2:0/3446564289 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a60019070 con 0x7f3a6810c170 2024-09-19T06:21:11.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.649+0000 7f3a5f7fe640 1 -- 172.21.15.2:0/3446564289 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3a600148f0 con 0x7f3a6810c170 2024-09-19T06:21:11.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.649+0000 7f3a70586640 1 -- 172.21.15.2:0/3446564289 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a681a6c20 con 0x7f3a6810c170 2024-09-19T06:21:11.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.649+0000 7f3a5f7fe640 1 -- 172.21.15.2:0/3446564289 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a600127f0 con 0x7f3a6810c170 2024-09-19T06:21:11.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.649+0000 7f3a70586640 1 -- 172.21.15.2:0/3446564289 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a681a7160 con 0x7f3a6810c170 2024-09-19T06:21:11.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.652+0000 7f3a5f7fe640 1 -- 172.21.15.2:0/3446564289 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f3a6001c070 con 0x7f3a6810c170 2024-09-19T06:21:11.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.652+0000 7f3a7295f740 1 Processor -- start 2024-09-19T06:21:11.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.653+0000 7f3a7295f740 1 -- start start 2024-09-19T06:21:11.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.653+0000 7f3a5f7fe640 1 --2- 172.21.15.2:0/3446564289 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f3a540a33b0 0x7f3a540a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:11.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.653+0000 7f3a7295f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555973c44b60 0x555973c44f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:11.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.653+0000 7f3a7295f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555973c45480 0x555973c4f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:11.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.653+0000 7f3a7295f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555973c4fd40 0x555973c52130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:11.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.653+0000 7f3a7295f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555973baa280 con 0x555973c4fd40 2024-09-19T06:21:11.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.653+0000 7f3a7295f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x555973b51b10 con 0x555973c45480 2024-09-19T06:21:11.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.653+0000 7f3a7295f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x555973ba6240 con 0x555973c44b60 2024-09-19T06:21:11.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.653+0000 7f3a5f7fe640 1 -- 172.21.15.2:0/3446564289 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8565+0+0 (secure 0 0 0) 0x7f3a600cf4a0 con 0x7f3a6810c170 2024-09-19T06:21:11.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.653+0000 7f3a6db21640 1 --2- 172.21.15.2:0/3446564289 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f3a540a33b0 0x7f3a540a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:11.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.653+0000 7f3a6eb23640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555973c4fd40 0x555973c52130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:11.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.653+0000 7f3a6eb23640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555973c4fd40 0x555973c52130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45666/0 (socket says 172.21.15.2:45666) 2024-09-19T06:21:11.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.653+0000 7f3a6eb23640 1 -- 172.21.15.2:0/1790757642 learned_addr learned my addr 172.21.15.2:0/1790757642 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:11.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.653+0000 7f3a6e322640 1 --2- 172.21.15.2:0/1790757642 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555973c44b60 0x555973c44f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:11.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.653+0000 7f3a6db21640 1 --2- 172.21.15.2:0/1790757642 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555973c45480 0x555973c4f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:11.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.654+0000 7f3a6eb23640 1 -- 172.21.15.2:0/1790757642 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555973c44b60 msgr2=0x555973c44f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:11.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.654+0000 7f3a6eb23640 1 --2- 172.21.15.2:0/1790757642 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555973c44b60 0x555973c44f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:11.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.654+0000 7f3a6eb23640 1 -- 172.21.15.2:0/1790757642 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555973c45480 msgr2=0x555973c4f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:11.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.654+0000 7f3a6eb23640 1 --2- 172.21.15.2:0/1790757642 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555973c45480 0x555973c4f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:11.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.654+0000 7f3a6eb23640 1 -- 172.21.15.2:0/1790757642 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555973b5e1f0 con 0x555973c4fd40 2024-09-19T06:21:11.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.654+0000 7f3a6db21640 1 --2- 172.21.15.2:0/3446564289 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f3a540a33b0 0x7f3a540a5870 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3a68102430 tx=0x7f3a58013880 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:11.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.654+0000 7f3a6eb23640 1 --2- 172.21.15.2:0/1790757642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555973c4fd40 0x555973c52130 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f3a60000f80 tx=0x7f3a60014e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0d386a79b10099c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:11.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.654+0000 7f3a5cff9640 1 -- 172.21.15.2:0/1790757642 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6009fbb0 con 0x555973c4fd40 2024-09-19T06:21:11.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.654+0000 7f3a5cff9640 1 -- 172.21.15.2:0/1790757642 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3a600a4470 con 0x555973c4fd40 2024-09-19T06:21:11.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.654+0000 7f3a5cff9640 1 -- 172.21.15.2:0/1790757642 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a600a3fe0 con 0x555973c4fd40 2024-09-19T06:21:11.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.655+0000 7f3a7295f740 1 -- 172.21.15.2:0/1790757642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555973c4fd40 msgr2=0x555973c52130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:11.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.655+0000 7f3a7295f740 1 --2- 172.21.15.2:0/1790757642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555973c4fd40 0x555973c52130 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f3a60000f80 tx=0x7f3a60014e10 comp rx=0 tx=0).stop 2024-09-19T06:21:11.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.655+0000 7f3a7295f740 1 -- 172.21.15.2:0/1790757642 shutdown_connections 2024-09-19T06:21:11.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.655+0000 7f3a7295f740 1 --2- 172.21.15.2:0/1790757642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555973c4fd40 0x555973c52130 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:11.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.655+0000 7f3a7295f740 1 --2- 172.21.15.2:0/1790757642 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555973c45480 0x555973c4f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:11.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.655+0000 7f3a7295f740 1 --2- 172.21.15.2:0/1790757642 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555973c44b60 0x555973c44f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:11.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.655+0000 7f3a7295f740 1 -- 172.21.15.2:0/1790757642 >> 172.21.15.2:0/1790757642 conn(0x555973c410f0 msgr2=0x555973c414d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:11.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.655+0000 7f3a7295f740 1 -- 172.21.15.2:0/1790757642 shutdown_connections 2024-09-19T06:21:11.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.655+0000 7f3a7295f740 1 -- 172.21.15.2:0/1790757642 wait complete. 2024-09-19T06:21:11.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.655+0000 7f3a7295f740 1 -- start start 2024-09-19T06:21:11.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.655+0000 7f3a7295f740 1 Processor -- start 2024-09-19T06:21:11.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.656+0000 7f3a7295f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555973c44b60 0x555973c4cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:11.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.656+0000 7f3a7295f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555973c45480 0x555973c4d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:11.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.656+0000 7f3a7295f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555973c4fd40 0x555973c4d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:11.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.656+0000 7f3a7295f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555973c52910 con 0x555973c44b60 2024-09-19T06:21:11.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.656+0000 7f3a7295f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x555973b64f10 con 0x555973c45480 2024-09-19T06:21:11.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.656+0000 7f3a7295f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x555973c52a90 con 0x555973c4fd40 2024-09-19T06:21:11.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.656+0000 7f3a7295f740 10 client.0 _ll_register_callbacks cb 0x555973b2da40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:11.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.656+0000 7f3a6e322640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555973c44b60 0x555973c4cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:11.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.656+0000 7f3a6e322640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555973c44b60 0x555973c4cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45672/0 (socket says 172.21.15.2:45672) 2024-09-19T06:21:11.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.656+0000 7f3a6e322640 1 -- 172.21.15.2:0/3270609082 learned_addr learned my addr 172.21.15.2:0/3270609082 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:11.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.656+0000 7f3a6db21640 1 --2- 172.21.15.2:0/3270609082 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555973c45480 0x555973c4d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:11.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.656+0000 7f3a6eb23640 1 --2- 172.21.15.2:0/3270609082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555973c4fd40 0x555973c4d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:11.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.656+0000 7f3a6e322640 1 -- 172.21.15.2:0/3270609082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555973c4fd40 msgr2=0x555973c4d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:11.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.656+0000 7f3a6e322640 1 --2- 172.21.15.2:0/3270609082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555973c4fd40 0x555973c4d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:11.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.656+0000 7f3a6e322640 1 -- 172.21.15.2:0/3270609082 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555973c45480 msgr2=0x555973c4d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:11.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.656+0000 7f3a6e322640 1 --2- 172.21.15.2:0/3270609082 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555973c45480 0x555973c4d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:11.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.656+0000 7f3a6e322640 1 -- 172.21.15.2:0/3270609082 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55597391b6a0 con 0x555973c44b60 2024-09-19T06:21:11.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.656+0000 7f3a6e322640 1 --2- 172.21.15.2:0/3270609082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555973c44b60 0x555973c4cc70 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f3a64000c00 tx=0x7f3a640316b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c2e143db9afffab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:11.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.656+0000 7f3a51ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:11.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.657+0000 7f3a51ffb640 1 -- 172.21.15.2:0/3270609082 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a64035040 con 0x555973c44b60 2024-09-19T06:21:11.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.657+0000 7f3a51ffb640 1 -- 172.21.15.2:0/3270609082 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8565+0+0 (secure 0 0 0) 0x7f3a64004250 con 0x555973c44b60 2024-09-19T06:21:11.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.657+0000 7f3a7295f740 1 -- 172.21.15.2:0/3270609082 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a600a4470 con 0x555973c44b60 2024-09-19T06:21:11.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.657+0000 7f3a51ffb640 1 -- 172.21.15.2:0/3270609082 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3a64004450 con 0x555973c44b60 2024-09-19T06:21:11.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.657+0000 7f3a7295f740 10 client.17274 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:11.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.657+0000 7f3a7295f740 1 -- 172.21.15.2:0/3270609082 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555973c5e580 con 0x555973c44b60 2024-09-19T06:21:11.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.657+0000 7f3a51ffb640 1 -- 172.21.15.2:0/3270609082 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3a600a4470 con 0x555973c44b60 2024-09-19T06:21:11.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.657+0000 7f3a51ffb640 1 -- 172.21.15.2:0/3270609082 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f3a6404e070 con 0x555973c44b60 2024-09-19T06:21:11.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.657+0000 7f3a7295f740 10 client.17274 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:11.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.657+0000 7f3a7295f740 10 client.17274 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:11.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.657+0000 7f3a7295f740 20 client.17274 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:11.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.657+0000 7f3a7295f740 1 --2- 172.21.15.2:0/3270609082 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x555973c5fa90 0x555973c61f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:11.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.657+0000 7f3a7295f740 4 client.17274 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:11.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.657+0000 7f3a7295f740 1 -- 172.21.15.2:0/3270609082 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555973bb77f0 con 0x555973c5fa90 2024-09-19T06:21:11.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.658+0000 7f3a6db21640 1 --2- 172.21.15.2:0/3270609082 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x555973c5fa90 0x555973c61f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:11.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.658+0000 7f3a6db21640 1 --2- 172.21.15.2:0/3270609082 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x555973c5fa90 0x555973c61f10 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e66f682d1e86e283 server_cookie=3f387f3faf734ca6 in_seq=0 out_seq=0 2024-09-19T06:21:11.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.658+0000 7f3a51ffb640 10 client.17274 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:11.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.659+0000 7f3a51ffb640 1 -- 172.21.15.2:0/3270609082 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555973bb77f0 con 0x555973c5fa90 2024-09-19T06:21:11.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.659+0000 7f3a51ffb640 10 client.17274 handle_command_reply: tid=0 2024-09-19T06:21:11.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.659+0000 7f3a7295f740 1 client.17274 shutdown 2024-09-19T06:21:11.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.659+0000 7f3a7295f740 1 -- 172.21.15.2:0/3270609082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555973c44b60 msgr2=0x555973c4cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:11.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.659+0000 7f3a7295f740 1 --2- 172.21.15.2:0/3270609082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555973c44b60 0x555973c4cc70 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f3a64000c00 tx=0x7f3a640316b0 comp rx=0 tx=0).stop 2024-09-19T06:21:11.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.659+0000 7f3a7295f740 1 -- 172.21.15.2:0/3270609082 shutdown_connections 2024-09-19T06:21:11.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.659+0000 7f3a7295f740 1 --2- 172.21.15.2:0/3270609082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555973c4fd40 0x555973c4d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:11.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.659+0000 7f3a7295f740 1 --2- 172.21.15.2:0/3270609082 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x555973c5fa90 0x555973c61f10 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:11.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.659+0000 7f3a7295f740 1 --2- 172.21.15.2:0/3270609082 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555973c45480 0x555973c4d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:11.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.659+0000 7f3a7295f740 1 --2- 172.21.15.2:0/3270609082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555973c44b60 0x555973c4cc70 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:11.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.659+0000 7f3a7295f740 1 -- 172.21.15.2:0/3270609082 >> 172.21.15.2:0/3270609082 conn(0x555973c410f0 msgr2=0x555973c40270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:11.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.659+0000 7f3a51ffb640 0 client.17274 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:11.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.660+0000 7f3a7295f740 1 -- 172.21.15.2:0/3270609082 shutdown_connections 2024-09-19T06:21:11.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.660+0000 7f3a7295f740 1 -- 172.21.15.2:0/3270609082 wait complete. 2024-09-19T06:21:11.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.660+0000 7f3a7295f740 20 client.17274 trim_cache size 0 max 16384 2024-09-19T06:21:11.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.677+0000 7f3a7295f740 1 Processor -- start 2024-09-19T06:21:11.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.677+0000 7f3a7295f740 1 -- start start 2024-09-19T06:21:11.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.677+0000 7f3a7295f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555973c44b60 0x555973c677e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:11.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.677+0000 7f3a7295f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555973c45480 0x555973c67d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:11.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.677+0000 7f3a7295f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555973c4fd40 0x555973c3fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:11.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.677+0000 7f3a7295f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3a681b2370 con 0x555973c4fd40 2024-09-19T06:21:11.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.677+0000 7f3a7295f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3a681afc40 con 0x555973c45480 2024-09-19T06:21:11.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.677+0000 7f3a7295f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3a681adab0 con 0x555973c44b60 2024-09-19T06:21:11.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.677+0000 7f3a6eb23640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555973c4fd40 0x555973c3fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:11.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.677+0000 7f3a6eb23640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555973c4fd40 0x555973c3fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45682/0 (socket says 172.21.15.2:45682) 2024-09-19T06:21:11.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.677+0000 7f3a6eb23640 1 -- 172.21.15.2:0/4057401045 learned_addr learned my addr 172.21.15.2:0/4057401045 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:11.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.678+0000 7f3a6e322640 1 --2- 172.21.15.2:0/4057401045 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555973c44b60 0x555973c677e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:11.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.678+0000 7f3a6db21640 1 --2- 172.21.15.2:0/4057401045 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555973c45480 0x555973c67d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:11.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.678+0000 7f3a6eb23640 1 -- 172.21.15.2:0/4057401045 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555973c44b60 msgr2=0x555973c677e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:11.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.678+0000 7f3a6eb23640 1 --2- 172.21.15.2:0/4057401045 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555973c44b60 0x555973c677e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:11.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.678+0000 7f3a6eb23640 1 -- 172.21.15.2:0/4057401045 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555973c45480 msgr2=0x555973c67d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:11.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.678+0000 7f3a6eb23640 1 --2- 172.21.15.2:0/4057401045 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555973c45480 0x555973c67d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:11.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.678+0000 7f3a6eb23640 1 -- 172.21.15.2:0/4057401045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555973c3c830 con 0x555973c4fd40 2024-09-19T06:21:11.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.678+0000 7f3a6e322640 1 --2- 172.21.15.2:0/4057401045 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555973c44b60 0x555973c677e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:21:11.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.678+0000 7f3a6eb23640 1 --2- 172.21.15.2:0/4057401045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555973c4fd40 0x555973c3fa50 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f3a600a3f40 tx=0x7f3a6009b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a574acf48842b27 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:11.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.678+0000 7f3a53fff640 1 -- 172.21.15.2:0/4057401045 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a600b9070 con 0x555973c4fd40 2024-09-19T06:21:11.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.678+0000 7f3a53fff640 1 -- 172.21.15.2:0/4057401045 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3a60099c70 con 0x555973c4fd40 2024-09-19T06:21:11.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.678+0000 7f3a53fff640 1 -- 172.21.15.2:0/4057401045 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a60084bb0 con 0x555973c4fd40 2024-09-19T06:21:11.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.679+0000 7f3a7295f740 1 -- 172.21.15.2:0/4057401045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555973c4fd40 msgr2=0x555973c3fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:11.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.679+0000 7f3a7295f740 1 --2- 172.21.15.2:0/4057401045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555973c4fd40 0x555973c3fa50 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f3a600a3f40 tx=0x7f3a6009b7b0 comp rx=0 tx=0).stop 2024-09-19T06:21:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.679+0000 7f3a7295f740 1 -- 172.21.15.2:0/4057401045 shutdown_connections 2024-09-19T06:21:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.679+0000 7f3a7295f740 1 --2- 172.21.15.2:0/4057401045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555973c4fd40 0x555973c3fa50 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.679+0000 7f3a7295f740 1 --2- 172.21.15.2:0/4057401045 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555973c45480 0x555973c67d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.679+0000 7f3a7295f740 1 --2- 172.21.15.2:0/4057401045 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555973c44b60 0x555973c677e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.679+0000 7f3a7295f740 1 -- 172.21.15.2:0/4057401045 >> 172.21.15.2:0/4057401045 conn(0x555973c410f0 msgr2=0x555973c4bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.679+0000 7f3a7295f740 1 -- 172.21.15.2:0/4057401045 shutdown_connections 2024-09-19T06:21:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.679+0000 7f3a7295f740 1 -- 172.21.15.2:0/4057401045 wait complete. 2024-09-19T06:21:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.679+0000 7f3a7295f740 1 -- start start 2024-09-19T06:21:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.679+0000 7f3a7295f740 1 Processor -- start 2024-09-19T06:21:11.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.679+0000 7f3a7295f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555973c44b60 0x555973c53a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:11.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.679+0000 7f3a7295f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555973c45480 0x555973c53fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:11.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.680+0000 7f3a7295f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555973c4fd40 0x555973c544f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:11.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.680+0000 7f3a7295f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3a681ae100 con 0x555973c44b60 2024-09-19T06:21:11.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.680+0000 7f3a7295f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3a681af570 con 0x555973c45480 2024-09-19T06:21:11.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.680+0000 7f3a7295f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3a681ae7d0 con 0x555973c4fd40 2024-09-19T06:21:11.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.680+0000 7f3a7295f740 10 client.0 _ll_register_callbacks cb 0x7f3a64032b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:11.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.680+0000 7f3a6e322640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555973c44b60 0x555973c53a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:11.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.680+0000 7f3a6e322640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555973c44b60 0x555973c53a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45698/0 (socket says 172.21.15.2:45698) 2024-09-19T06:21:11.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.680+0000 7f3a6e322640 1 -- 172.21.15.2:0/1845264463 learned_addr learned my addr 172.21.15.2:0/1845264463 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:11.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.680+0000 7f3a6db21640 1 --2- 172.21.15.2:0/1845264463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555973c45480 0x555973c53fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:11.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.680+0000 7f3a6eb23640 1 --2- 172.21.15.2:0/1845264463 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555973c4fd40 0x555973c544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:11.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.680+0000 7f3a6e322640 1 -- 172.21.15.2:0/1845264463 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555973c4fd40 msgr2=0x555973c544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:11.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.680+0000 7f3a6e322640 1 --2- 172.21.15.2:0/1845264463 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555973c4fd40 0x555973c544f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:11.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.680+0000 7f3a6e322640 1 -- 172.21.15.2:0/1845264463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555973c45480 msgr2=0x555973c53fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:11.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.680+0000 7f3a6e322640 1 --2- 172.21.15.2:0/1845264463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555973c45480 0x555973c53fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:11.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.680+0000 7f3a6e322640 1 -- 172.21.15.2:0/1845264463 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555973c452b0 con 0x555973c44b60 2024-09-19T06:21:11.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.680+0000 7f3a6e322640 1 --2- 172.21.15.2:0/1845264463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555973c44b60 0x555973c53a70 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f3a64031440 tx=0x7f3a6403d660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86fb0bb17b8f8bcf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:11.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.680+0000 7f3a51ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:11.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.680+0000 7f3a51ffb640 1 -- 172.21.15.2:0/1845264463 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a64054070 con 0x555973c44b60 2024-09-19T06:21:11.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.680+0000 7f3a51ffb640 1 -- 172.21.15.2:0/1845264463 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8565+0+0 (secure 0 0 0) 0x7f3a64031930 con 0x555973c44b60 2024-09-19T06:21:11.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.680+0000 7f3a7295f740 1 -- 172.21.15.2:0/1845264463 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555973bb1d00 con 0x555973c44b60 2024-09-19T06:21:11.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.681+0000 7f3a51ffb640 1 -- 172.21.15.2:0/1845264463 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3a64035040 con 0x555973c44b60 2024-09-19T06:21:11.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.681+0000 7f3a7295f740 10 client.17280 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:11.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.681+0000 7f3a7295f740 1 -- 172.21.15.2:0/1845264463 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555973cca880 con 0x555973c44b60 2024-09-19T06:21:11.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.681+0000 7f3a51ffb640 1 -- 172.21.15.2:0/1845264463 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x555973bb1d00 con 0x555973c44b60 2024-09-19T06:21:11.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.681+0000 7f3a51ffb640 1 -- 172.21.15.2:0/1845264463 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f3a6404e070 con 0x555973c44b60 2024-09-19T06:21:11.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.681+0000 7f3a7295f740 10 client.17280 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:11.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.681+0000 7f3a7295f740 10 client.17280 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:11.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.681+0000 7f3a7295f740 20 client.17280 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:11.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.681+0000 7f3a7295f740 1 --2- 172.21.15.2:0/1845264463 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x555973ccaf50 0x555973ccd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:11.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.681+0000 7f3a7295f740 4 client.17280 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:21:11.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.681+0000 7f3a7295f740 1 -- 172.21.15.2:0/1845264463 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x555973b2e110 con 0x555973ccaf50 2024-09-19T06:21:11.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.681+0000 7f3a6db21640 1 --2- 172.21.15.2:0/1845264463 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x555973ccaf50 0x555973ccd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:11.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.682+0000 7f3a6db21640 1 --2- 172.21.15.2:0/1845264463 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x555973ccaf50 0x555973ccd370 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48a8f9667878dc42 server_cookie=139fa1ae5be15db9 in_seq=0 out_seq=0 2024-09-19T06:21:11.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.682+0000 7f3a51ffb640 10 client.17280 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:11.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.683+0000 7f3a51ffb640 1 -- 172.21.15.2:0/1845264463 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555973b2e110 con 0x555973ccaf50 2024-09-19T06:21:11.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.683+0000 7f3a51ffb640 10 client.17280 handle_command_reply: tid=0 2024-09-19T06:21:11.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.683+0000 7f3a7295f740 1 client.17280 shutdown 2024-09-19T06:21:11.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.683+0000 7f3a7295f740 1 -- 172.21.15.2:0/1845264463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555973c44b60 msgr2=0x555973c53a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:11.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.683+0000 7f3a7295f740 1 --2- 172.21.15.2:0/1845264463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555973c44b60 0x555973c53a70 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f3a64031440 tx=0x7f3a6403d660 comp rx=0 tx=0).stop 2024-09-19T06:21:11.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.683+0000 7f3a7295f740 1 -- 172.21.15.2:0/1845264463 shutdown_connections 2024-09-19T06:21:11.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.683+0000 7f3a7295f740 1 --2- 172.21.15.2:0/1845264463 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555973c4fd40 0x555973c544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:11.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.683+0000 7f3a7295f740 1 --2- 172.21.15.2:0/1845264463 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x555973ccaf50 0x555973ccd370 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:11.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.683+0000 7f3a7295f740 1 --2- 172.21.15.2:0/1845264463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555973c45480 0x555973c53fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:11.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.683+0000 7f3a51ffb640 0 client.17280 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:11.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.683+0000 7f3a7295f740 1 --2- 172.21.15.2:0/1845264463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555973c44b60 0x555973c53a70 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:11.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.683+0000 7f3a7295f740 1 -- 172.21.15.2:0/1845264463 >> 172.21.15.2:0/1845264463 conn(0x555973c410f0 msgr2=0x555973c3fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:11.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.683+0000 7f3a7295f740 1 -- 172.21.15.2:0/1845264463 shutdown_connections 2024-09-19T06:21:11.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.683+0000 7f3a7295f740 1 -- 172.21.15.2:0/1845264463 wait complete. 2024-09-19T06:21:11.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.683+0000 7f3a7295f740 20 client.17280 trim_cache size 0 max 16384 2024-09-19T06:21:11.691 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:21:11.691 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T06:21:11.691 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "f8743eeb-8505-4fbe-9799-a542e044307f", 2024-09-19T06:21:11.691 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T06:21:11.691 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:21:11.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.684+0000 7f3a70586640 1 -- 172.21.15.2:0/3446564289 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f3a540a33b0 msgr2=0x7f3a540a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:11.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.684+0000 7f3a70586640 1 --2- 172.21.15.2:0/3446564289 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f3a540a33b0 0x7f3a540a5870 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3a68102430 tx=0x7f3a58013880 comp rx=0 tx=0).stop 2024-09-19T06:21:11.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.684+0000 7f3a70586640 1 -- 172.21.15.2:0/3446564289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a6810c170 msgr2=0x7f3a68101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:11.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.684+0000 7f3a70586640 1 --2- 172.21.15.2:0/3446564289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a6810c170 0x7f3a68101420 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f3a6000be20 tx=0x7f3a6000bf10 comp rx=0 tx=0).stop 2024-09-19T06:21:11.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.684+0000 7f3a70586640 1 -- 172.21.15.2:0/3446564289 shutdown_connections 2024-09-19T06:21:11.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.684+0000 7f3a70586640 1 --2- 172.21.15.2:0/3446564289 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f3a540a33b0 0x7f3a540a5870 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:11.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.684+0000 7f3a70586640 1 --2- 172.21.15.2:0/3446564289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a6810c170 0x7f3a68101420 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:11.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.684+0000 7f3a70586640 1 --2- 172.21.15.2:0/3446564289 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a68103660 0x7f3a68100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:11.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.684+0000 7f3a70586640 1 --2- 172.21.15.2:0/3446564289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a68102d40 0x7f3a681009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:11.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.684+0000 7f3a70586640 1 -- 172.21.15.2:0/3446564289 >> 172.21.15.2:0/3446564289 conn(0x7f3a680fc7a0 msgr2=0x7f3a680fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:11.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.684+0000 7f3a70586640 1 -- 172.21.15.2:0/3446564289 shutdown_connections 2024-09-19T06:21:11.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:11.684+0000 7f3a70586640 1 -- 172.21.15.2:0/3446564289 wait complete. 2024-09-19T06:21:12.272 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:12 smithi002 ceph-mon[30982]: pgmap v195: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-19T06:21:12.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:12 smithi089 ceph-mon[34160]: pgmap v195: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-19T06:21:12.407 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:21:12.489 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:12 smithi090 ceph-mon[34497]: pgmap v195: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-19T06:21:12.664 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:13.071 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:13 smithi002 ceph-mon[30982]: scrub queued for path: / 2024-09-19T06:21:13.071 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:13 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:13.071 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:13 smithi002 ceph-mon[30982]: scrub summary: active paths [/] 2024-09-19T06:21:13.071 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:13 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:13.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.155+0000 7f77db85c640 1 -- 172.21.15.2:0/1609923274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77d4101de0 msgr2=0x7f77d41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:13.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.155+0000 7f77db85c640 1 --2- 172.21.15.2:0/1609923274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77d4101de0 0x7f77d41021c0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f77d0009900 tx=0x7f77d002a410 comp rx=0 tx=0).stop 2024-09-19T06:21:13.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.155+0000 7f77db85c640 1 -- 172.21.15.2:0/1609923274 shutdown_connections 2024-09-19T06:21:13.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.155+0000 7f77db85c640 1 --2- 172.21.15.2:0/1609923274 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77d4106f10 0x7f77d410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:13.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.155+0000 7f77db85c640 1 --2- 172.21.15.2:0/1609923274 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77d4102790 0x7f77d41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:13.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.155+0000 7f77db85c640 1 --2- 172.21.15.2:0/1609923274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77d4101de0 0x7f77d41021c0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:13.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.155+0000 7f77db85c640 1 -- 172.21.15.2:0/1609923274 >> 172.21.15.2:0/1609923274 conn(0x7f77d40fd880 msgr2=0x7f77d40ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:13.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.155+0000 7f77db85c640 1 -- 172.21.15.2:0/1609923274 shutdown_connections 2024-09-19T06:21:13.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.155+0000 7f77db85c640 1 -- 172.21.15.2:0/1609923274 wait complete. 2024-09-19T06:21:13.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.156+0000 7f77db85c640 1 Processor -- start 2024-09-19T06:21:13.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.156+0000 7f77db85c640 1 -- start start 2024-09-19T06:21:13.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.156+0000 7f77db85c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77d4101de0 0x7f77d40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:13.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.156+0000 7f77db85c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77d4102790 0x7f77d4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:13.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.156+0000 7f77db85c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77d4106f10 0x7f77d4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:13.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.156+0000 7f77db85c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f77d4111e60 con 0x7f77d4106f10 2024-09-19T06:21:13.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.156+0000 7f77db85c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f77d4111ce0 con 0x7f77d4102790 2024-09-19T06:21:13.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.156+0000 7f77db85c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f77d4111fe0 con 0x7f77d4101de0 2024-09-19T06:21:13.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.157+0000 7f77d9df9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77d4106f10 0x7f77d4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:13.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.157+0000 7f77d9df9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77d4106f10 0x7f77d4074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45708/0 (socket says 172.21.15.2:45708) 2024-09-19T06:21:13.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.157+0000 7f77d9df9640 1 -- 172.21.15.2:0/1151551714 learned_addr learned my addr 172.21.15.2:0/1151551714 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:13.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.157+0000 7f77d95f8640 1 --2- 172.21.15.2:0/1151551714 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77d4101de0 0x7f77d40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:13.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.157+0000 7f77d8df7640 1 --2- 172.21.15.2:0/1151551714 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77d4102790 0x7f77d4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:13.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.157+0000 7f77d9df9640 1 -- 172.21.15.2:0/1151551714 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77d4101de0 msgr2=0x7f77d40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:13.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.157+0000 7f77d9df9640 1 --2- 172.21.15.2:0/1151551714 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77d4101de0 0x7f77d40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:13.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.157+0000 7f77d9df9640 1 -- 172.21.15.2:0/1151551714 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77d4102790 msgr2=0x7f77d4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:13.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.157+0000 7f77d9df9640 1 --2- 172.21.15.2:0/1151551714 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77d4102790 0x7f77d4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:13.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.157+0000 7f77d9df9640 1 -- 172.21.15.2:0/1151551714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77d41a6890 con 0x7f77d4106f10 2024-09-19T06:21:13.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.157+0000 7f77d8df7640 1 --2- 172.21.15.2:0/1151551714 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77d4102790 0x7f77d4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:13.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.157+0000 7f77d9df9640 1 --2- 172.21.15.2:0/1151551714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77d4106f10 0x7f77d4074f70 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f77cc00b970 tx=0x7f77cc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:13.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.157+0000 7f77ca7fc640 1 -- 172.21.15.2:0/1151551714 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77cc019070 con 0x7f77d4106f10 2024-09-19T06:21:13.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.157+0000 7f77db85c640 1 -- 172.21.15.2:0/1151551714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77d41a6b80 con 0x7f77d4106f10 2024-09-19T06:21:13.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.157+0000 7f77ca7fc640 1 -- 172.21.15.2:0/1151551714 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f77cc014440 con 0x7f77d4106f10 2024-09-19T06:21:13.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.158+0000 7f77ca7fc640 1 -- 172.21.15.2:0/1151551714 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77cc0075d0 con 0x7f77d4106f10 2024-09-19T06:21:13.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.158+0000 7f77db85c640 1 -- 172.21.15.2:0/1151551714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77d41a70c0 con 0x7f77d4106f10 2024-09-19T06:21:13.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.160+0000 7f77ca7fc640 1 -- 172.21.15.2:0/1151551714 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f77cc01c070 con 0x7f77d4106f10 2024-09-19T06:21:13.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.161+0000 7f77ca7fc640 1 --2- 172.21.15.2:0/1151551714 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f77c00a33b0 0x7f77c00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:13.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.161+0000 7f77ddc35740 1 Processor -- start 2024-09-19T06:21:13.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.161+0000 7f77d95f8640 1 --2- 172.21.15.2:0/1151551714 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f77c00a33b0 0x7f77c00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:13.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.161+0000 7f77ca7fc640 1 -- 172.21.15.2:0/1151551714 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8565+0+0 (secure 0 0 0) 0x7f77cc0cf240 con 0x7f77d4106f10 2024-09-19T06:21:13.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.161+0000 7f77ddc35740 1 -- start start 2024-09-19T06:21:13.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.161+0000 7f77ddc35740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b3d2e84a0 0x562b3d2e8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:13.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.161+0000 7f77ddc35740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b3d2e8dc0 0x562b3d2f3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:13.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.161+0000 7f77ddc35740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b3d2f3680 0x562b3d2f5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:13.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.161+0000 7f77ddc35740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562b3d24e2e0 con 0x562b3d2e84a0 2024-09-19T06:21:13.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.162+0000 7f77ddc35740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562b3d1f5ce0 con 0x562b3d2f3680 2024-09-19T06:21:13.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.162+0000 7f77ddc35740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562b3d24a2a0 con 0x562b3d2e8dc0 2024-09-19T06:21:13.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.162+0000 7f77d95f8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b3d2e84a0 0x562b3d2e8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:13.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.162+0000 7f77d95f8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b3d2e84a0 0x562b3d2e8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45714/0 (socket says 172.21.15.2:45714) 2024-09-19T06:21:13.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.162+0000 7f77d95f8640 1 -- 172.21.15.2:0/2884986528 learned_addr learned my addr 172.21.15.2:0/2884986528 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:13.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.162+0000 7f77d95f8640 1 --2- 172.21.15.2:0/1151551714 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f77c00a33b0 0x7f77c00a5870 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f77d0031440 tx=0x7f77d0005b50 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:13.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.162+0000 7f77d8df7640 1 --2- 172.21.15.2:0/2884986528 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b3d2e8dc0 0x562b3d2f3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:13.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.162+0000 7f77d9df9640 1 --2- 172.21.15.2:0/2884986528 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b3d2f3680 0x562b3d2f5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:13.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.162+0000 7f77d95f8640 1 -- 172.21.15.2:0/2884986528 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b3d2e8dc0 msgr2=0x562b3d2f3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:13.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.162+0000 7f77d95f8640 1 --2- 172.21.15.2:0/2884986528 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b3d2e8dc0 0x562b3d2f3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:13.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.162+0000 7f77d95f8640 1 -- 172.21.15.2:0/2884986528 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b3d2f3680 msgr2=0x562b3d2f5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:13.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.162+0000 7f77d95f8640 1 --2- 172.21.15.2:0/2884986528 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b3d2f3680 0x562b3d2f5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:13.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.162+0000 7f77d95f8640 1 -- 172.21.15.2:0/2884986528 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b3d1da440 con 0x562b3d2e84a0 2024-09-19T06:21:13.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.162+0000 7f77d95f8640 1 --2- 172.21.15.2:0/2884986528 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b3d2e84a0 0x562b3d2e8880 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f77d0009900 tx=0x7f77d003d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=587f8e47daaf5a30 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:13.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.163+0000 7f77bf7fe640 1 -- 172.21.15.2:0/2884986528 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d004d070 con 0x562b3d2e84a0 2024-09-19T06:21:13.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.163+0000 7f77bf7fe640 1 -- 172.21.15.2:0/2884986528 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f77d00054f0 con 0x562b3d2e84a0 2024-09-19T06:21:13.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.163+0000 7f77bf7fe640 1 -- 172.21.15.2:0/2884986528 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d0035040 con 0x562b3d2e84a0 2024-09-19T06:21:13.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.163+0000 7f77ddc35740 1 -- 172.21.15.2:0/2884986528 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b3d2e84a0 msgr2=0x562b3d2e8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:13.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.163+0000 7f77ddc35740 1 --2- 172.21.15.2:0/2884986528 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b3d2e84a0 0x562b3d2e8880 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f77d0009900 tx=0x7f77d003d000 comp rx=0 tx=0).stop 2024-09-19T06:21:13.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.163+0000 7f77ddc35740 1 -- 172.21.15.2:0/2884986528 shutdown_connections 2024-09-19T06:21:13.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.163+0000 7f77ddc35740 1 --2- 172.21.15.2:0/2884986528 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b3d2f3680 0x562b3d2f5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:13.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.163+0000 7f77ddc35740 1 --2- 172.21.15.2:0/2884986528 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b3d2e8dc0 0x562b3d2f3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:13.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.163+0000 7f77ddc35740 1 --2- 172.21.15.2:0/2884986528 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b3d2e84a0 0x562b3d2e8880 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:13.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.163+0000 7f77ddc35740 1 -- 172.21.15.2:0/2884986528 >> 172.21.15.2:0/2884986528 conn(0x562b3d2e4a30 msgr2=0x562b3d2e4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:13.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.163+0000 7f77ddc35740 1 -- 172.21.15.2:0/2884986528 shutdown_connections 2024-09-19T06:21:13.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.164+0000 7f77ddc35740 1 -- 172.21.15.2:0/2884986528 wait complete. 2024-09-19T06:21:13.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.164+0000 7f77ddc35740 1 -- start start 2024-09-19T06:21:13.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.164+0000 7f77ddc35740 1 Processor -- start 2024-09-19T06:21:13.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.164+0000 7f77ddc35740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b3d2e84a0 0x562b3d2f2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:13.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.165+0000 7f77ddc35740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b3d2e8dc0 0x562b3d2f0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:13.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.165+0000 7f77ddc35740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b3d2f3680 0x562b3d2f0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:13.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.165+0000 7f77ddc35740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562b3d2f6250 con 0x562b3d2e8dc0 2024-09-19T06:21:13.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.165+0000 7f77ddc35740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562b3d209050 con 0x562b3d2f3680 2024-09-19T06:21:13.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.165+0000 7f77ddc35740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562b3d2f63d0 con 0x562b3d2e84a0 2024-09-19T06:21:13.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.165+0000 7f77ddc35740 10 client.0 _ll_register_callbacks cb 0x562b3d249160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:13.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.165+0000 7f77d95f8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b3d2e84a0 0x562b3d2f2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:13.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.165+0000 7f77d95f8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b3d2e84a0 0x562b3d2f2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:43578/0 (socket says 172.21.15.2:43578) 2024-09-19T06:21:13.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.165+0000 7f77d95f8640 1 -- 172.21.15.2:0/3235312122 learned_addr learned my addr 172.21.15.2:0/3235312122 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:13.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.165+0000 7f77d9df9640 1 --2- 172.21.15.2:0/3235312122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b3d2f3680 0x562b3d2f0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:13.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.165+0000 7f77d8df7640 1 --2- 172.21.15.2:0/3235312122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b3d2e8dc0 0x562b3d2f0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:13.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.165+0000 7f77d95f8640 1 -- 172.21.15.2:0/3235312122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b3d2f3680 msgr2=0x562b3d2f0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:13.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.165+0000 7f77d95f8640 1 --2- 172.21.15.2:0/3235312122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b3d2f3680 0x562b3d2f0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:13.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.165+0000 7f77d95f8640 1 -- 172.21.15.2:0/3235312122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b3d2e8dc0 msgr2=0x562b3d2f0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:13.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.165+0000 7f77d95f8640 1 --2- 172.21.15.2:0/3235312122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b3d2e8dc0 0x562b3d2f0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:13.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.165+0000 7f77d95f8640 1 -- 172.21.15.2:0/3235312122 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b3cfbf3c0 con 0x562b3d2e84a0 2024-09-19T06:21:13.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.165+0000 7f77d95f8640 1 --2- 172.21.15.2:0/3235312122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b3d2e84a0 0x562b3d2f2f70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f77d002a450 tx=0x7f77d00052f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3eed22858969107 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:13.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.165+0000 7f77bcff9640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-19T06:21:13.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.166+0000 7f77bcff9640 1 -- 172.21.15.2:0/3235312122 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d005a020 con 0x562b3d2e84a0 2024-09-19T06:21:13.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.166+0000 7f77ddc35740 1 -- 172.21.15.2:0/3235312122 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77d00054f0 con 0x562b3d2e84a0 2024-09-19T06:21:13.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.166+0000 7f77bcff9640 1 -- 172.21.15.2:0/3235312122 <== mon.1 v2:172.21.15.90:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8565+0+0 (secure 0 0 0) 0x7f77d0004450 con 0x562b3d2e84a0 2024-09-19T06:21:13.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.170+0000 7f77bcff9640 1 -- 172.21.15.2:0/3235312122 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f77d0065050 con 0x562b3d2e84a0 2024-09-19T06:21:13.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.171+0000 7f77ddc35740 10 client.26494 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:13.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.171+0000 7f77ddc35740 1 -- 172.21.15.2:0/3235312122 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562b3d2f6250 con 0x562b3d2e84a0 2024-09-19T06:21:13.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.171+0000 7f77bcff9640 1 -- 172.21.15.2:0/3235312122 <== mon.1 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f77d0004d00 con 0x562b3d2e84a0 2024-09-19T06:21:13.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.171+0000 7f77bcff9640 1 -- 172.21.15.2:0/3235312122 <== mon.1 v2:172.21.15.90:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f77d0003c30 con 0x562b3d2e84a0 2024-09-19T06:21:13.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.171+0000 7f77ddc35740 10 client.26494 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:13.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.171+0000 7f77ddc35740 10 client.26494 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:13.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.171+0000 7f77ddc35740 20 client.26494 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:13.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.171+0000 7f77ddc35740 1 --2- 172.21.15.2:0/3235312122 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562b3d302d70 0x562b3d305160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:13.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.171+0000 7f77ddc35740 4 client.26494 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:13.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.171+0000 7f77ddc35740 1 -- 172.21.15.2:0/3235312122 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f77d00054f0 con 0x562b3d302d70 2024-09-19T06:21:13.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.171+0000 7f77d8df7640 1 --2- 172.21.15.2:0/3235312122 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562b3d302d70 0x562b3d305160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:13.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.172+0000 7f77d8df7640 1 --2- 172.21.15.2:0/3235312122 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562b3d302d70 0x562b3d305160 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36766cee5802bb server_cookie=41e7fab8425beb63 in_seq=0 out_seq=0 2024-09-19T06:21:13.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.172+0000 7f77bcff9640 10 client.26494 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:13.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.172+0000 7f77bcff9640 1 -- 172.21.15.2:0/3235312122 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f77d00054f0 con 0x562b3d302d70 2024-09-19T06:21:13.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.172+0000 7f77bcff9640 10 client.26494 handle_command_reply: tid=0 2024-09-19T06:21:13.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.173+0000 7f77ddc35740 1 client.26494 shutdown 2024-09-19T06:21:13.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.173+0000 7f77ddc35740 1 -- 172.21.15.2:0/3235312122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b3d2e84a0 msgr2=0x562b3d2f2f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:13.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.173+0000 7f77ddc35740 1 --2- 172.21.15.2:0/3235312122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b3d2e84a0 0x562b3d2f2f70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f77d002a450 tx=0x7f77d00052f0 comp rx=0 tx=0).stop 2024-09-19T06:21:13.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.173+0000 7f77ddc35740 1 -- 172.21.15.2:0/3235312122 shutdown_connections 2024-09-19T06:21:13.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.173+0000 7f77ddc35740 1 --2- 172.21.15.2:0/3235312122 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562b3d302d70 0x562b3d305160 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:13.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.173+0000 7f77ddc35740 1 --2- 172.21.15.2:0/3235312122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b3d2f3680 0x562b3d2f0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:13.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.173+0000 7f77ddc35740 1 --2- 172.21.15.2:0/3235312122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b3d2e8dc0 0x562b3d2f0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:13.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.173+0000 7f77bcff9640 0 client.26494 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:13.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.173+0000 7f77ddc35740 1 --2- 172.21.15.2:0/3235312122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b3d2e84a0 0x562b3d2f2f70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:13.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.173+0000 7f77ddc35740 1 -- 172.21.15.2:0/3235312122 >> 172.21.15.2:0/3235312122 conn(0x562b3d2e4a30 msgr2=0x562b3d2ea710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:13.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.173+0000 7f77ddc35740 1 -- 172.21.15.2:0/3235312122 shutdown_connections 2024-09-19T06:21:13.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.173+0000 7f77ddc35740 1 -- 172.21.15.2:0/3235312122 wait complete. 2024-09-19T06:21:13.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.173+0000 7f77ddc35740 20 client.26494 trim_cache size 0 max 16384 2024-09-19T06:21:13.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.190+0000 7f77ddc35740 1 Processor -- start 2024-09-19T06:21:13.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.190+0000 7f77ddc35740 1 -- start start 2024-09-19T06:21:13.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.191+0000 7f77ddc35740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b3d2e4a30 0x562b3d2f0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:13.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.191+0000 7f77ddc35740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b3d2e84a0 0x562b3d2e3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:13.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.191+0000 7f77ddc35740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b3d2e8dc0 0x562b3d30a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:13.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.191+0000 7f77ddc35740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f77d41b2350 con 0x562b3d2e84a0 2024-09-19T06:21:13.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.191+0000 7f77ddc35740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f77d41afc20 con 0x562b3d2e4a30 2024-09-19T06:21:13.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.191+0000 7f77ddc35740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f77d41ada90 con 0x562b3d2e8dc0 2024-09-19T06:21:13.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.191+0000 7f77d8df7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b3d2e84a0 0x562b3d2e3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:13.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.191+0000 7f77d8df7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b3d2e84a0 0x562b3d2e3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45738/0 (socket says 172.21.15.2:45738) 2024-09-19T06:21:13.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.191+0000 7f77d8df7640 1 -- 172.21.15.2:0/645241685 learned_addr learned my addr 172.21.15.2:0/645241685 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:13.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.191+0000 7f77d95f8640 1 --2- 172.21.15.2:0/645241685 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b3d2e4a30 0x562b3d2f0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:13.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.191+0000 7f77d9df9640 1 --2- 172.21.15.2:0/645241685 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b3d2e8dc0 0x562b3d30a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:13.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.191+0000 7f77d8df7640 1 -- 172.21.15.2:0/645241685 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b3d2e8dc0 msgr2=0x562b3d30a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:13.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.191+0000 7f77d8df7640 1 --2- 172.21.15.2:0/645241685 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b3d2e8dc0 0x562b3d30a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:13.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.191+0000 7f77d8df7640 1 -- 172.21.15.2:0/645241685 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b3d2e4a30 msgr2=0x562b3d2f0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:13.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.191+0000 7f77d8df7640 1 --2- 172.21.15.2:0/645241685 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b3d2e4a30 0x562b3d2f0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:13.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.191+0000 7f77d8df7640 1 -- 172.21.15.2:0/645241685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b3d2e82d0 con 0x562b3d2e84a0 2024-09-19T06:21:13.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.191+0000 7f77d8df7640 1 --2- 172.21.15.2:0/645241685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b3d2e84a0 0x562b3d2e3370 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f77c4005f00 tx=0x7f77c40139a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdff43f28b92d3eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:13.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.192+0000 7f77beffd640 1 -- 172.21.15.2:0/645241685 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c4005020 con 0x562b3d2e84a0 2024-09-19T06:21:13.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.192+0000 7f77beffd640 1 -- 172.21.15.2:0/645241685 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f77c40047a0 con 0x562b3d2e84a0 2024-09-19T06:21:13.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.192+0000 7f77beffd640 1 -- 172.21.15.2:0/645241685 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c40106f0 con 0x562b3d2e84a0 2024-09-19T06:21:13.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.192+0000 7f77ddc35740 1 -- 172.21.15.2:0/645241685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b3d2e84a0 msgr2=0x562b3d2e3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:13.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.192+0000 7f77ddc35740 1 --2- 172.21.15.2:0/645241685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b3d2e84a0 0x562b3d2e3370 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f77c4005f00 tx=0x7f77c40139a0 comp rx=0 tx=0).stop 2024-09-19T06:21:13.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.192+0000 7f77ddc35740 1 -- 172.21.15.2:0/645241685 shutdown_connections 2024-09-19T06:21:13.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.192+0000 7f77ddc35740 1 --2- 172.21.15.2:0/645241685 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b3d2e8dc0 0x562b3d30a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:13.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.192+0000 7f77ddc35740 1 --2- 172.21.15.2:0/645241685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b3d2e84a0 0x562b3d2e3370 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:13.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.192+0000 7f77ddc35740 1 --2- 172.21.15.2:0/645241685 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b3d2e4a30 0x562b3d2f0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:13.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.192+0000 7f77ddc35740 1 -- 172.21.15.2:0/645241685 >> 172.21.15.2:0/645241685 conn(0x562b3d2f08c0 msgr2=0x562b3d2ef1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:13.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.193+0000 7f77ddc35740 1 -- 172.21.15.2:0/645241685 shutdown_connections 2024-09-19T06:21:13.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.193+0000 7f77ddc35740 1 -- 172.21.15.2:0/645241685 wait complete. 2024-09-19T06:21:13.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.193+0000 7f77ddc35740 1 -- start start 2024-09-19T06:21:13.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.193+0000 7f77ddc35740 1 Processor -- start 2024-09-19T06:21:13.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.193+0000 7f77ddc35740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b3d2e4a30 0x562b3d2f9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:13.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.193+0000 7f77ddc35740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b3d2e84a0 0x562b3d2fa020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:13.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.193+0000 7f77ddc35740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b3d2e8dc0 0x562b3d36c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:13.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.193+0000 7f77ddc35740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f77d41ae0e0 con 0x562b3d2e84a0 2024-09-19T06:21:13.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.193+0000 7f77ddc35740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f77d41af550 con 0x562b3d2e8dc0 2024-09-19T06:21:13.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.193+0000 7f77ddc35740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f77d41ae7b0 con 0x562b3d2e4a30 2024-09-19T06:21:13.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.194+0000 7f77ddc35740 10 client.0 _ll_register_callbacks cb 0x7f77c400b440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:13.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.194+0000 7f77d8df7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b3d2e84a0 0x562b3d2fa020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:13.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.194+0000 7f77d8df7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b3d2e84a0 0x562b3d2fa020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45742/0 (socket says 172.21.15.2:45742) 2024-09-19T06:21:13.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.194+0000 7f77d8df7640 1 -- 172.21.15.2:0/4292506029 learned_addr learned my addr 172.21.15.2:0/4292506029 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:13.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.194+0000 7f77d9df9640 1 --2- 172.21.15.2:0/4292506029 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b3d2e8dc0 0x562b3d36c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:13.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.194+0000 7f77d95f8640 1 --2- 172.21.15.2:0/4292506029 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b3d2e4a30 0x562b3d2f9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:13.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.194+0000 7f77d8df7640 1 -- 172.21.15.2:0/4292506029 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b3d2e4a30 msgr2=0x562b3d2f9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:13.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.194+0000 7f77d8df7640 1 --2- 172.21.15.2:0/4292506029 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b3d2e4a30 0x562b3d2f9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:13.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.194+0000 7f77d8df7640 1 -- 172.21.15.2:0/4292506029 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b3d2e8dc0 msgr2=0x562b3d36c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:13.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.194+0000 7f77d8df7640 1 --2- 172.21.15.2:0/4292506029 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b3d2e8dc0 0x562b3d36c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:13.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.194+0000 7f77d8df7640 1 -- 172.21.15.2:0/4292506029 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b3d2e56c0 con 0x562b3d2e84a0 2024-09-19T06:21:13.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.194+0000 7f77d95f8640 1 --2- 172.21.15.2:0/4292506029 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b3d2e4a30 0x562b3d2f9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:13.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.194+0000 7f77d8df7640 1 --2- 172.21.15.2:0/4292506029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b3d2e84a0 0x562b3d2fa020 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f77c400b7d0 tx=0x7f77c400ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf281d00c8be1c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:13.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.194+0000 7f77bcff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:13.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.195+0000 7f77bcff9640 1 -- 172.21.15.2:0/4292506029 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c402b070 con 0x562b3d2e84a0 2024-09-19T06:21:13.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.195+0000 7f77bcff9640 1 -- 172.21.15.2:0/4292506029 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f77c4010690 con 0x562b3d2e84a0 2024-09-19T06:21:13.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.195+0000 7f77ddc35740 1 -- 172.21.15.2:0/4292506029 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77c40047a0 con 0x562b3d2e84a0 2024-09-19T06:21:13.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.195+0000 7f77bcff9640 1 -- 172.21.15.2:0/4292506029 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f77c4037050 con 0x562b3d2e84a0 2024-09-19T06:21:13.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.195+0000 7f77ddc35740 10 client.17298 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:13.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.195+0000 7f77ddc35740 1 -- 172.21.15.2:0/4292506029 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562b3d36df80 con 0x562b3d2e84a0 2024-09-19T06:21:13.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.195+0000 7f77bcff9640 1 -- 172.21.15.2:0/4292506029 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f77c4010d40 con 0x562b3d2e84a0 2024-09-19T06:21:13.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.195+0000 7f77bcff9640 1 -- 172.21.15.2:0/4292506029 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f77c4027b60 con 0x562b3d2e84a0 2024-09-19T06:21:13.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.195+0000 7f77ddc35740 10 client.17298 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:13.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.195+0000 7f77ddc35740 10 client.17298 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:13.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.195+0000 7f77ddc35740 20 client.17298 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:13.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.195+0000 7f77ddc35740 1 --2- 172.21.15.2:0/4292506029 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562b3d2f3680 0x562b3d370720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:13.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.195+0000 7f77ddc35740 4 client.17298 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:21:13.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.195+0000 7f77ddc35740 1 -- 172.21.15.2:0/4292506029 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f77c40047a0 con 0x562b3d2f3680 2024-09-19T06:21:13.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.196+0000 7f77d95f8640 1 --2- 172.21.15.2:0/4292506029 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562b3d2f3680 0x562b3d370720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:13.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.196+0000 7f77bcff9640 10 client.17298 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:13.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.196+0000 7f77d95f8640 1 --2- 172.21.15.2:0/4292506029 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562b3d2f3680 0x562b3d370720 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75834135a250fabf server_cookie=a6db0e58d3ac276c in_seq=0 out_seq=0 2024-09-19T06:21:13.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.196+0000 7f77bcff9640 1 -- 172.21.15.2:0/4292506029 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f77c40047a0 con 0x562b3d2f3680 2024-09-19T06:21:13.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.196+0000 7f77bcff9640 10 client.17298 handle_command_reply: tid=0 2024-09-19T06:21:13.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.196+0000 7f77ddc35740 1 client.17298 shutdown 2024-09-19T06:21:13.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.196+0000 7f77ddc35740 1 -- 172.21.15.2:0/4292506029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b3d2e84a0 msgr2=0x562b3d2fa020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:13.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.196+0000 7f77ddc35740 1 --2- 172.21.15.2:0/4292506029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b3d2e84a0 0x562b3d2fa020 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f77c400b7d0 tx=0x7f77c400ba40 comp rx=0 tx=0).stop 2024-09-19T06:21:13.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.197+0000 7f77ddc35740 1 -- 172.21.15.2:0/4292506029 shutdown_connections 2024-09-19T06:21:13.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.197+0000 7f77ddc35740 1 --2- 172.21.15.2:0/4292506029 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562b3d2f3680 0x562b3d370720 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:13.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.197+0000 7f77ddc35740 1 --2- 172.21.15.2:0/4292506029 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562b3d2e8dc0 0x562b3d36c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:13.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.197+0000 7f77ddc35740 1 --2- 172.21.15.2:0/4292506029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562b3d2e84a0 0x562b3d2fa020 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:13.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.197+0000 7f77ddc35740 1 --2- 172.21.15.2:0/4292506029 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562b3d2e4a30 0x562b3d2f9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:13.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.197+0000 7f77ddc35740 1 -- 172.21.15.2:0/4292506029 >> 172.21.15.2:0/4292506029 conn(0x562b3d2f08c0 msgr2=0x562b3d2f1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:13.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.197+0000 7f77bcff9640 0 client.17298 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:13.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.197+0000 7f77ddc35740 1 -- 172.21.15.2:0/4292506029 shutdown_connections 2024-09-19T06:21:13.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.197+0000 7f77ddc35740 1 -- 172.21.15.2:0/4292506029 wait complete. 2024-09-19T06:21:13.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.197+0000 7f77ddc35740 20 client.17298 trim_cache size 0 max 16384 2024-09-19T06:21:13.205 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:21:13.205 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T06:21:13.205 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T06:21:13.206 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:21:13.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.197+0000 7f77db85c640 1 -- 172.21.15.2:0/1151551714 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f77c00a33b0 msgr2=0x7f77c00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:13.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.197+0000 7f77db85c640 1 --2- 172.21.15.2:0/1151551714 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f77c00a33b0 0x7f77c00a5870 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f77d0031440 tx=0x7f77d0005b50 comp rx=0 tx=0).stop 2024-09-19T06:21:13.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.197+0000 7f77db85c640 1 -- 172.21.15.2:0/1151551714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77d4106f10 msgr2=0x7f77d4074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:13.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.197+0000 7f77db85c640 1 --2- 172.21.15.2:0/1151551714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77d4106f10 0x7f77d4074f70 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f77cc00b970 tx=0x7f77cc00be30 comp rx=0 tx=0).stop 2024-09-19T06:21:13.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.198+0000 7f77db85c640 1 -- 172.21.15.2:0/1151551714 shutdown_connections 2024-09-19T06:21:13.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.198+0000 7f77db85c640 1 --2- 172.21.15.2:0/1151551714 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f77c00a33b0 0x7f77c00a5870 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:13.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.198+0000 7f77db85c640 1 --2- 172.21.15.2:0/1151551714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77d4106f10 0x7f77d4074f70 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:13.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.198+0000 7f77db85c640 1 --2- 172.21.15.2:0/1151551714 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77d4102790 0x7f77d4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:13.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.198+0000 7f77db85c640 1 --2- 172.21.15.2:0/1151551714 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77d4101de0 0x7f77d40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:13.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.198+0000 7f77db85c640 1 -- 172.21.15.2:0/1151551714 >> 172.21.15.2:0/1151551714 conn(0x7f77d40fd880 msgr2=0x7f77d40fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:13.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.198+0000 7f77db85c640 1 -- 172.21.15.2:0/1151551714 shutdown_connections 2024-09-19T06:21:13.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:13.198+0000 7f77db85c640 1 -- 172.21.15.2:0/1151551714 wait complete. 2024-09-19T06:21:13.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:13 smithi089 ceph-mon[34160]: scrub queued for path: / 2024-09-19T06:21:13.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:13 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:13.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:13 smithi089 ceph-mon[34160]: scrub summary: active paths [/] 2024-09-19T06:21:13.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:13 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:13.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:13 smithi090 ceph-mon[34497]: scrub queued for path: / 2024-09-19T06:21:13.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:13 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:13.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:13 smithi090 ceph-mon[34497]: scrub summary: active paths [/] 2024-09-19T06:21:13.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:13 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:13.873 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:21:13.873 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:21:14.135 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:14.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:14 smithi002 ceph-mon[30982]: pgmap v196: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-19T06:21:14.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:14 smithi002 ceph-mon[30982]: scrub summary: idle 2024-09-19T06:21:14.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:14 smithi002 ceph-mon[30982]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T06:21:14.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:14 smithi089 ceph-mon[34160]: pgmap v196: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-19T06:21:14.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:14 smithi089 ceph-mon[34160]: scrub summary: idle 2024-09-19T06:21:14.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:14 smithi089 ceph-mon[34160]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T06:21:14.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:14 smithi090 ceph-mon[34497]: pgmap v196: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-19T06:21:14.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:14 smithi090 ceph-mon[34497]: scrub summary: idle 2024-09-19T06:21:14.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:14 smithi090 ceph-mon[34497]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T06:21:14.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.577+0000 7fb1c829c640 1 -- 172.21.15.2:0/1575074325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1c0103660 msgr2=0x7fb1c010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:14.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.577+0000 7fb1c829c640 1 --2- 172.21.15.2:0/1575074325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1c0103660 0x7fb1c010bb50 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fb1b0009900 tx=0x7fb1b002a480 comp rx=0 tx=0).stop 2024-09-19T06:21:14.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.577+0000 7fb1c829c640 1 -- 172.21.15.2:0/1575074325 shutdown_connections 2024-09-19T06:21:14.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.577+0000 7fb1c829c640 1 --2- 172.21.15.2:0/1575074325 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1c010c170 0x7fb1c010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:14.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.577+0000 7fb1c829c640 1 --2- 172.21.15.2:0/1575074325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1c0103660 0x7fb1c010bb50 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:14.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.577+0000 7fb1c829c640 1 --2- 172.21.15.2:0/1575074325 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1c0102d40 0x7fb1c0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:14.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.577+0000 7fb1c829c640 1 -- 172.21.15.2:0/1575074325 >> 172.21.15.2:0/1575074325 conn(0x7fb1c00fc7a0 msgr2=0x7fb1c00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:14.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.578+0000 7fb1c829c640 1 -- 172.21.15.2:0/1575074325 shutdown_connections 2024-09-19T06:21:14.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.578+0000 7fb1c829c640 1 -- 172.21.15.2:0/1575074325 wait complete. 2024-09-19T06:21:14.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.578+0000 7fb1c829c640 1 Processor -- start 2024-09-19T06:21:14.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.578+0000 7fb1c829c640 1 -- start start 2024-09-19T06:21:14.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.579+0000 7fb1c829c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1c0102d40 0x7fb1c01983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:14.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.579+0000 7fb1c829c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1c0103660 0x7fb1c0198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:14.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.579+0000 7fb1c829c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1c010c170 0x7fb1c019cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:14.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.579+0000 7fb1c829c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c0111e20 con 0x7fb1c0103660 2024-09-19T06:21:14.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.579+0000 7fb1c829c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c0111ca0 con 0x7fb1c010c170 2024-09-19T06:21:14.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.579+0000 7fb1c829c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c0111fa0 con 0x7fb1c0102d40 2024-09-19T06:21:14.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.579+0000 7fb1c5837640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1c0103660 0x7fb1c0198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:14.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.579+0000 7fb1c5837640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1c0103660 0x7fb1c0198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45762/0 (socket says 172.21.15.2:45762) 2024-09-19T06:21:14.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.579+0000 7fb1c6038640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1c0102d40 0x7fb1c01983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:14.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.579+0000 7fb1c5837640 1 -- 172.21.15.2:0/572725855 learned_addr learned my addr 172.21.15.2:0/572725855 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:14.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.579+0000 7fb1c6839640 1 --2- 172.21.15.2:0/572725855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1c010c170 0x7fb1c019cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:14.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.579+0000 7fb1c5837640 1 -- 172.21.15.2:0/572725855 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1c0102d40 msgr2=0x7fb1c01983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:14.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.579+0000 7fb1c5837640 1 --2- 172.21.15.2:0/572725855 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1c0102d40 0x7fb1c01983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:14.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.579+0000 7fb1c5837640 1 -- 172.21.15.2:0/572725855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1c010c170 msgr2=0x7fb1c019cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:14.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.579+0000 7fb1c5837640 1 --2- 172.21.15.2:0/572725855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1c010c170 0x7fb1c019cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:14.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.579+0000 7fb1c5837640 1 -- 172.21.15.2:0/572725855 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c019d370 con 0x7fb1c0103660 2024-09-19T06:21:14.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.579+0000 7fb1c6839640 1 --2- 172.21.15.2:0/572725855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1c010c170 0x7fb1c019cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:14.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.579+0000 7fb1c6038640 1 --2- 172.21.15.2:0/572725855 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1c0102d40 0x7fb1c01983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:14.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.580+0000 7fb1c5837640 1 --2- 172.21.15.2:0/572725855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1c0103660 0x7fb1c0198900 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fb1b0005940 tx=0x7fb1b00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:14.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.580+0000 7fb1b77fe640 1 -- 172.21.15.2:0/572725855 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b003f030 con 0x7fb1c0103660 2024-09-19T06:21:14.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.580+0000 7fb1b77fe640 1 -- 172.21.15.2:0/572725855 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb1b0003cb0 con 0x7fb1c0103660 2024-09-19T06:21:14.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.580+0000 7fb1c829c640 1 -- 172.21.15.2:0/572725855 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1c019d600 con 0x7fb1c0103660 2024-09-19T06:21:14.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.580+0000 7fb1b77fe640 1 -- 172.21.15.2:0/572725855 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b0035070 con 0x7fb1c0103660 2024-09-19T06:21:14.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.580+0000 7fb1c829c640 1 -- 172.21.15.2:0/572725855 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1c019da90 con 0x7fb1c0103660 2024-09-19T06:21:14.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.581+0000 7fb1c829c640 1 -- 172.21.15.2:0/572725855 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1c0103120 con 0x7fb1c0103660 2024-09-19T06:21:14.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.582+0000 7fb1b77fe640 1 -- 172.21.15.2:0/572725855 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fb1b0042030 con 0x7fb1c0103660 2024-09-19T06:21:14.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.583+0000 7fb1b77fe640 1 --2- 172.21.15.2:0/572725855 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb1ac0a33b0 0x7fb1ac0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:14.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.583+0000 7fb1c6038640 1 --2- 172.21.15.2:0/572725855 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb1ac0a33b0 0x7fb1ac0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:14.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.583+0000 7fb1b77fe640 1 -- 172.21.15.2:0/572725855 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7fb1b00f0540 con 0x7fb1c0103660 2024-09-19T06:21:14.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.584+0000 7fb1c6038640 1 --2- 172.21.15.2:0/572725855 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb1ac0a33b0 0x7fb1ac0a5870 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc0058c0 tx=0x7fb1bc00a2d0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:14.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.587+0000 7fb1b77fe640 1 -- 172.21.15.2:0/572725855 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb1b00bcec0 con 0x7fb1c0103660 2024-09-19T06:21:14.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.799+0000 7fb1c829c640 1 -- 172.21.15.2:0/572725855 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb1c002d7c0 con 0x7fb1c0103660 2024-09-19T06:21:14.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.799+0000 7fb1b77fe640 1 -- 172.21.15.2:0/572725855 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11882 (secure 0 0 0) 0x7fb1b00bc7c0 con 0x7fb1c0103660 2024-09-19T06:21:14.801 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:21:14.801 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-09-19T06:14:49:104280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:14:48.191083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24470,24472,24497]},"id":1}]} 2024-09-19T06:21:14.802 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-09-19T06:21:14.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.801+0000 7fb1c829c640 1 -- 172.21.15.2:0/572725855 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb1ac0a33b0 msgr2=0x7fb1ac0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:14.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.801+0000 7fb1c829c640 1 --2- 172.21.15.2:0/572725855 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb1ac0a33b0 0x7fb1ac0a5870 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc0058c0 tx=0x7fb1bc00a2d0 comp rx=0 tx=0).stop 2024-09-19T06:21:14.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.801+0000 7fb1c829c640 1 -- 172.21.15.2:0/572725855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1c0103660 msgr2=0x7fb1c0198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:14.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.801+0000 7fb1c829c640 1 --2- 172.21.15.2:0/572725855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1c0103660 0x7fb1c0198900 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fb1b0005940 tx=0x7fb1b00042f0 comp rx=0 tx=0).stop 2024-09-19T06:21:14.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.801+0000 7fb1c829c640 1 -- 172.21.15.2:0/572725855 shutdown_connections 2024-09-19T06:21:14.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.801+0000 7fb1c829c640 1 --2- 172.21.15.2:0/572725855 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb1ac0a33b0 0x7fb1ac0a5870 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:14.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.801+0000 7fb1c829c640 1 --2- 172.21.15.2:0/572725855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1c010c170 0x7fb1c019cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:14.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.801+0000 7fb1c829c640 1 --2- 172.21.15.2:0/572725855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1c0103660 0x7fb1c0198900 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:14.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.801+0000 7fb1c829c640 1 --2- 172.21.15.2:0/572725855 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1c0102d40 0x7fb1c01983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:14.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.801+0000 7fb1c829c640 1 -- 172.21.15.2:0/572725855 >> 172.21.15.2:0/572725855 conn(0x7fb1c00fc7a0 msgr2=0x7fb1c00fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:14.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.802+0000 7fb1c829c640 1 -- 172.21.15.2:0/572725855 shutdown_connections 2024-09-19T06:21:14.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:14.802+0000 7fb1c829c640 1 -- 172.21.15.2:0/572725855 wait complete. 2024-09-19T06:21:15.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:15 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/572725855' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:21:15.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:15 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/572725855' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:21:15.489 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:15 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/572725855' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:21:15.547 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:21:15.805 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:16.183 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:16 smithi002 ceph-mon[30982]: pgmap v198: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T06:21:16.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:16 smithi089 ceph-mon[34160]: pgmap v198: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T06:21:16.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.402+0000 7feeeaa99640 1 -- 172.21.15.2:0/783309947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feee4103660 msgr2=0x7feee410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:16.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.402+0000 7feeeaa99640 1 --2- 172.21.15.2:0/783309947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feee4103660 0x7feee410bb50 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7feed0009900 tx=0x7feed002a480 comp rx=0 tx=0).stop 2024-09-19T06:21:16.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.402+0000 7feeeaa99640 1 -- 172.21.15.2:0/783309947 shutdown_connections 2024-09-19T06:21:16.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.402+0000 7feeeaa99640 1 --2- 172.21.15.2:0/783309947 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feee410c170 0x7feee410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:16.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.402+0000 7feeeaa99640 1 --2- 172.21.15.2:0/783309947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feee4103660 0x7feee410bb50 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:16.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.402+0000 7feeeaa99640 1 --2- 172.21.15.2:0/783309947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feee4102d40 0x7feee4103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:16.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.402+0000 7feeeaa99640 1 -- 172.21.15.2:0/783309947 >> 172.21.15.2:0/783309947 conn(0x7feee40fc7a0 msgr2=0x7feee40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:16.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.402+0000 7feeeaa99640 1 -- 172.21.15.2:0/783309947 shutdown_connections 2024-09-19T06:21:16.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.402+0000 7feeeaa99640 1 -- 172.21.15.2:0/783309947 wait complete. 2024-09-19T06:21:16.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.403+0000 7feeeaa99640 1 Processor -- start 2024-09-19T06:21:16.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.403+0000 7feeeaa99640 1 -- start start 2024-09-19T06:21:16.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.403+0000 7feeeaa99640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feee4102d40 0x7feee419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:16.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.403+0000 7feeeaa99640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feee4103660 0x7feee419aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:16.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.403+0000 7feeeaa99640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feee410c170 0x7feee419ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:16.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.403+0000 7feeeaa99640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7feee4111eb0 con 0x7feee4103660 2024-09-19T06:21:16.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.403+0000 7feeeaa99640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7feee4111d30 con 0x7feee4102d40 2024-09-19T06:21:16.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.403+0000 7feeeaa99640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7feee4112030 con 0x7feee410c170 2024-09-19T06:21:16.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.403+0000 7feee3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feee4103660 0x7feee419aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:16.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.403+0000 7feee3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feee4103660 0x7feee419aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36558/0 (socket says 172.21.15.2:36558) 2024-09-19T06:21:16.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.403+0000 7feee3fff640 1 -- 172.21.15.2:0/2894544832 learned_addr learned my addr 172.21.15.2:0/2894544832 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:16.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.403+0000 7feee9036640 1 --2- 172.21.15.2:0/2894544832 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feee410c170 0x7feee419ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:16.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.403+0000 7feee8835640 1 --2- 172.21.15.2:0/2894544832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feee4102d40 0x7feee419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:16.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.403+0000 7feee3fff640 1 -- 172.21.15.2:0/2894544832 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feee410c170 msgr2=0x7feee419ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:16.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.403+0000 7feee3fff640 1 --2- 172.21.15.2:0/2894544832 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feee410c170 0x7feee419ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:16.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.403+0000 7feee3fff640 1 -- 172.21.15.2:0/2894544832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feee4102d40 msgr2=0x7feee419a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:16.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.404+0000 7feee3fff640 1 --2- 172.21.15.2:0/2894544832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feee4102d40 0x7feee419a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:16.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.404+0000 7feee3fff640 1 -- 172.21.15.2:0/2894544832 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee419f540 con 0x7feee4103660 2024-09-19T06:21:16.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.404+0000 7feee3fff640 1 --2- 172.21.15.2:0/2894544832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feee4103660 0x7feee419aad0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7feed0005ab0 tx=0x7feed0003c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:16.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.404+0000 7feee1ffb640 1 -- 172.21.15.2:0/2894544832 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed003f070 con 0x7feee4103660 2024-09-19T06:21:16.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.404+0000 7feee1ffb640 1 -- 172.21.15.2:0/2894544832 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feed0031d60 con 0x7feee4103660 2024-09-19T06:21:16.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.404+0000 7feeeaa99640 1 -- 172.21.15.2:0/2894544832 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feee419f7d0 con 0x7feee4103660 2024-09-19T06:21:16.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.404+0000 7feee1ffb640 1 -- 172.21.15.2:0/2894544832 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed0035030 con 0x7feee4103660 2024-09-19T06:21:16.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.404+0000 7feeeaa99640 1 -- 172.21.15.2:0/2894544832 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feee41a7110 con 0x7feee4103660 2024-09-19T06:21:16.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.407+0000 7feee1ffb640 1 -- 172.21.15.2:0/2894544832 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7feed0042070 con 0x7feee4103660 2024-09-19T06:21:16.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.407+0000 7feeece72740 1 Processor -- start 2024-09-19T06:21:16.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.407+0000 7feeece72740 1 -- start start 2024-09-19T06:21:16.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.407+0000 7feeece72740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e594e9eb40 0x55e594e9d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:16.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.407+0000 7feee1ffb640 1 --2- 172.21.15.2:0/2894544832 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7feed40a33b0 0x7feed40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:16.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.407+0000 7feeece72740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e594e9d5d0 0x55e594e9da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:16.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.407+0000 7feeece72740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e594ea8370 0x55e594eaa760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:16.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.407+0000 7feeece72740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e594e032f0 con 0x55e594ea8370 2024-09-19T06:21:16.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.407+0000 7feeece72740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55e594daacf0 con 0x55e594e9d5d0 2024-09-19T06:21:16.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.407+0000 7feeece72740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55e594dff2b0 con 0x55e594e9eb40 2024-09-19T06:21:16.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.408+0000 7feee9036640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e594ea8370 0x55e594eaa760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:16.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.408+0000 7feee8835640 1 --2- 172.21.15.2:0/2894544832 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7feed40a33b0 0x7feed40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:16.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.408+0000 7feee3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e594e9d5d0 0x55e594e9da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:16.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.408+0000 7feee9036640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e594ea8370 0x55e594eaa760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36560/0 (socket says 172.21.15.2:36560) 2024-09-19T06:21:16.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.408+0000 7feee9036640 1 -- 172.21.15.2:0/3498933525 learned_addr learned my addr 172.21.15.2:0/3498933525 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:16.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.408+0000 7feee1ffb640 1 -- 172.21.15.2:0/2894544832 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7feed00f0720 con 0x7feee4103660 2024-09-19T06:21:16.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.408+0000 7feee9036640 1 --2- 172.21.15.2:0/3498933525 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e594e9eb40 0x55e594e9d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:16.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.408+0000 7feee9036640 1 -- 172.21.15.2:0/3498933525 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e594e9eb40 msgr2=0x55e594e9d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:16.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.408+0000 7feee9036640 1 --2- 172.21.15.2:0/3498933525 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e594e9eb40 0x55e594e9d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:16.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.408+0000 7feee9036640 1 -- 172.21.15.2:0/3498933525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e594e9d5d0 msgr2=0x55e594e9da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:16.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.408+0000 7feee9036640 1 --2- 172.21.15.2:0/3498933525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e594e9d5d0 0x55e594e9da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:16.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.408+0000 7feee9036640 1 -- 172.21.15.2:0/3498933525 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e594d8f3a0 con 0x55e594ea8370 2024-09-19T06:21:16.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.408+0000 7feee3fff640 1 --2- 172.21.15.2:0/3498933525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e594e9d5d0 0x55e594e9da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:16.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.408+0000 7feee8835640 1 --2- 172.21.15.2:0/2894544832 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7feed40a33b0 0x7feed40a5870 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7feed8009890 tx=0x7feed8008040 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:16.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.408+0000 7feee9036640 1 --2- 172.21.15.2:0/3498933525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e594ea8370 0x55e594eaa760 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7feedc013830 tx=0x7feedc007ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=190dc466c97bd620 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:16.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.408+0000 7feeceffd640 1 -- 172.21.15.2:0/3498933525 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feedc019030 con 0x55e594ea8370 2024-09-19T06:21:16.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.408+0000 7feeceffd640 1 -- 172.21.15.2:0/3498933525 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feedc004b20 con 0x55e594ea8370 2024-09-19T06:21:16.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.408+0000 7feeceffd640 1 -- 172.21.15.2:0/3498933525 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feedc005510 con 0x55e594ea8370 2024-09-19T06:21:16.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.409+0000 7feeece72740 1 -- 172.21.15.2:0/3498933525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e594ea8370 msgr2=0x55e594eaa760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:16.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.409+0000 7feeece72740 1 --2- 172.21.15.2:0/3498933525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e594ea8370 0x55e594eaa760 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7feedc013830 tx=0x7feedc007ac0 comp rx=0 tx=0).stop 2024-09-19T06:21:16.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.409+0000 7feeece72740 1 -- 172.21.15.2:0/3498933525 shutdown_connections 2024-09-19T06:21:16.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.409+0000 7feeece72740 1 --2- 172.21.15.2:0/3498933525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e594ea8370 0x55e594eaa760 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:16.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.409+0000 7feeece72740 1 --2- 172.21.15.2:0/3498933525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e594e9d5d0 0x55e594e9da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:16.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.409+0000 7feeece72740 1 --2- 172.21.15.2:0/3498933525 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e594e9eb40 0x55e594e9d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:16.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.409+0000 7feeece72740 1 -- 172.21.15.2:0/3498933525 >> 172.21.15.2:0/3498933525 conn(0x55e594e66310 msgr2=0x55e594e99c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:16.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.409+0000 7feeece72740 1 -- 172.21.15.2:0/3498933525 shutdown_connections 2024-09-19T06:21:16.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.409+0000 7feeece72740 1 -- 172.21.15.2:0/3498933525 wait complete. 2024-09-19T06:21:16.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.409+0000 7feeece72740 1 -- start start 2024-09-19T06:21:16.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.410+0000 7feeece72740 1 Processor -- start 2024-09-19T06:21:16.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.410+0000 7feeece72740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e594e9d5d0 0x55e594ea7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:16.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.410+0000 7feeece72740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e594e9eb40 0x55e594ea5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:16.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.410+0000 7feeece72740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e594ea8370 0x55e594ea5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:16.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.410+0000 7feeece72740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e594eab070 con 0x55e594e9eb40 2024-09-19T06:21:16.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.410+0000 7feeece72740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55e594dbe060 con 0x55e594e9d5d0 2024-09-19T06:21:16.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.410+0000 7feeece72740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55e594eab1f0 con 0x55e594ea8370 2024-09-19T06:21:16.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.410+0000 7feeece72740 10 client.0 _ll_register_callbacks cb 0x55e594b118c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:16.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.410+0000 7feee3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e594e9eb40 0x55e594ea5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:16.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.410+0000 7feee3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e594e9eb40 0x55e594ea5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36576/0 (socket says 172.21.15.2:36576) 2024-09-19T06:21:16.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.410+0000 7feee3fff640 1 -- 172.21.15.2:0/3021387503 learned_addr learned my addr 172.21.15.2:0/3021387503 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:16.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.410+0000 7feee8835640 1 --2- 172.21.15.2:0/3021387503 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e594e9d5d0 0x55e594ea7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:16.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.410+0000 7feee9036640 1 --2- 172.21.15.2:0/3021387503 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e594ea8370 0x55e594ea5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:16.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.410+0000 7feee3fff640 1 -- 172.21.15.2:0/3021387503 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e594ea8370 msgr2=0x55e594ea5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:16.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.410+0000 7feee3fff640 1 --2- 172.21.15.2:0/3021387503 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e594ea8370 0x55e594ea5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:16.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.410+0000 7feee3fff640 1 -- 172.21.15.2:0/3021387503 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e594e9d5d0 msgr2=0x55e594ea7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:16.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.410+0000 7feee3fff640 1 --2- 172.21.15.2:0/3021387503 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e594e9d5d0 0x55e594ea7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:16.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.410+0000 7feee3fff640 1 -- 172.21.15.2:0/3021387503 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e594b743c0 con 0x55e594e9eb40 2024-09-19T06:21:16.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.411+0000 7feee9036640 1 --2- 172.21.15.2:0/3021387503 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e594ea8370 0x55e594ea5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:21:16.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.411+0000 7feee8835640 1 --2- 172.21.15.2:0/3021387503 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e594e9d5d0 0x55e594ea7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:16.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.411+0000 7feee3fff640 1 --2- 172.21.15.2:0/3021387503 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e594e9eb40 0x55e594ea5030 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7feed00bc990 tx=0x7feed0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40c8e4fa873fa8f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:16.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.411+0000 7feec3fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:16.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.411+0000 7feec3fff640 1 -- 172.21.15.2:0/3021387503 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed0049070 con 0x55e594e9eb40 2024-09-19T06:21:16.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.411+0000 7feec3fff640 1 -- 172.21.15.2:0/3021387503 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7feed0038d90 con 0x55e594e9eb40 2024-09-19T06:21:16.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.411+0000 7feeece72740 1 -- 172.21.15.2:0/3021387503 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feedc004b20 con 0x55e594e9eb40 2024-09-19T06:21:16.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.411+0000 7feec3fff640 1 -- 172.21.15.2:0/3021387503 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7feed00bca00 con 0x55e594e9eb40 2024-09-19T06:21:16.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.411+0000 7feeece72740 10 client.17316 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:16.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.411+0000 7feeece72740 1 -- 172.21.15.2:0/3021387503 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55e594eb6b40 con 0x55e594e9eb40 2024-09-19T06:21:16.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.411+0000 7feec3fff640 1 -- 172.21.15.2:0/3021387503 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feedc004b20 con 0x55e594e9eb40 2024-09-19T06:21:16.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.411+0000 7feec3fff640 1 -- 172.21.15.2:0/3021387503 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7feed00b9070 con 0x55e594e9eb40 2024-09-19T06:21:16.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.411+0000 7feeece72740 10 client.17316 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:16.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.411+0000 7feeece72740 10 client.17316 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:21:16.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.412+0000 7feeece72740 20 client.17316 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:16.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.412+0000 7feeece72740 1 --2- 172.21.15.2:0/3021387503 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55e594eb7ee0 0x55e594eba2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:16.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.412+0000 7feeece72740 4 client.17316 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:16.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.412+0000 7feeece72740 1 -- 172.21.15.2:0/3021387503 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e594e10860 con 0x55e594eb7ee0 2024-09-19T06:21:16.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.412+0000 7feee8835640 1 --2- 172.21.15.2:0/3021387503 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55e594eb7ee0 0x55e594eba2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:16.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.412+0000 7feee8835640 1 --2- 172.21.15.2:0/3021387503 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55e594eb7ee0 0x55e594eba2f0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=909251b4aa1d5b9 server_cookie=15095fa6e0a87281 in_seq=0 out_seq=0 2024-09-19T06:21:16.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.412+0000 7feec3fff640 10 client.17316 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:21:16.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.413+0000 7feec3fff640 1 -- 172.21.15.2:0/3021387503 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e594e10860 con 0x55e594eb7ee0 2024-09-19T06:21:16.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.413+0000 7feec3fff640 10 client.17316 handle_command_reply: tid=0 2024-09-19T06:21:16.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.413+0000 7feeece72740 1 client.17316 shutdown 2024-09-19T06:21:16.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.413+0000 7feeece72740 1 -- 172.21.15.2:0/3021387503 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e594e9eb40 msgr2=0x55e594ea5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:16.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.413+0000 7feeece72740 1 --2- 172.21.15.2:0/3021387503 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e594e9eb40 0x55e594ea5030 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7feed00bc990 tx=0x7feed0000bc0 comp rx=0 tx=0).stop 2024-09-19T06:21:16.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.413+0000 7feeece72740 1 -- 172.21.15.2:0/3021387503 shutdown_connections 2024-09-19T06:21:16.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.413+0000 7feeece72740 1 --2- 172.21.15.2:0/3021387503 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55e594eb7ee0 0x55e594eba2f0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:16.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.413+0000 7feec3fff640 0 client.17316 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:21:16.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.413+0000 7feeece72740 1 --2- 172.21.15.2:0/3021387503 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e594ea8370 0x55e594ea5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:16.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.413+0000 7feeece72740 1 --2- 172.21.15.2:0/3021387503 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e594e9eb40 0x55e594ea5030 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:16.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.413+0000 7feeece72740 1 --2- 172.21.15.2:0/3021387503 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e594e9d5d0 0x55e594ea7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:16.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.413+0000 7feeece72740 1 -- 172.21.15.2:0/3021387503 >> 172.21.15.2:0/3021387503 conn(0x55e594e66310 msgr2=0x55e594e9f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:16.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.413+0000 7feeece72740 1 -- 172.21.15.2:0/3021387503 shutdown_connections 2024-09-19T06:21:16.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.413+0000 7feeece72740 1 -- 172.21.15.2:0/3021387503 wait complete. 2024-09-19T06:21:16.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.413+0000 7feeece72740 20 client.17316 trim_cache size 0 max 16384 2024-09-19T06:21:16.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.426+0000 7feeece72740 1 Processor -- start 2024-09-19T06:21:16.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.426+0000 7feeece72740 1 -- start start 2024-09-19T06:21:16.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.427+0000 7feeece72740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e594e9d5d0 0x55e594eb4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:16.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.427+0000 7feeece72740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e594e9eb40 0x55e594ea0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:16.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.427+0000 7feeece72740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e594ea8370 0x55e594ea0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:16.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.427+0000 7feeece72740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7feee41b21d0 con 0x55e594e9d5d0 2024-09-19T06:21:16.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.427+0000 7feeece72740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7feee41afaa0 con 0x55e594ea8370 2024-09-19T06:21:16.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.427+0000 7feeece72740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7feee41ad910 con 0x55e594e9eb40 2024-09-19T06:21:16.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.427+0000 7feee8835640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e594e9d5d0 0x55e594eb4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:16.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.427+0000 7feee8835640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e594e9d5d0 0x55e594eb4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36590/0 (socket says 172.21.15.2:36590) 2024-09-19T06:21:16.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.427+0000 7feee8835640 1 -- 172.21.15.2:0/2462583903 learned_addr learned my addr 172.21.15.2:0/2462583903 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:16.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.427+0000 7feee3fff640 1 --2- 172.21.15.2:0/2462583903 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e594e9eb40 0x55e594ea0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:16.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.427+0000 7feee9036640 1 --2- 172.21.15.2:0/2462583903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e594ea8370 0x55e594ea0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:16.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.427+0000 7feee8835640 1 -- 172.21.15.2:0/2462583903 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e594e9eb40 msgr2=0x55e594ea0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:16.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.427+0000 7feee8835640 1 --2- 172.21.15.2:0/2462583903 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e594e9eb40 0x55e594ea0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:16.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.427+0000 7feee8835640 1 -- 172.21.15.2:0/2462583903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e594ea8370 msgr2=0x55e594ea0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:16.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.427+0000 7feee8835640 1 --2- 172.21.15.2:0/2462583903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e594ea8370 0x55e594ea0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:16.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.427+0000 7feee8835640 1 -- 172.21.15.2:0/2462583903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e594ea35a0 con 0x55e594e9d5d0 2024-09-19T06:21:16.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.427+0000 7feee3fff640 1 --2- 172.21.15.2:0/2462583903 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e594e9eb40 0x55e594ea0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:21:16.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.427+0000 7feee9036640 1 --2- 172.21.15.2:0/2462583903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e594ea8370 0x55e594ea0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:21:16.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.427+0000 7feee8835640 1 --2- 172.21.15.2:0/2462583903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e594e9d5d0 0x55e594eb4310 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7feed80095e0 tx=0x7feed8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b5de475b50e32e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:16.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.427+0000 7feece7fc640 1 -- 172.21.15.2:0/2462583903 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed8014690 con 0x55e594e9d5d0 2024-09-19T06:21:16.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.427+0000 7feece7fc640 1 -- 172.21.15.2:0/2462583903 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feed8014ce0 con 0x55e594e9d5d0 2024-09-19T06:21:16.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.427+0000 7feece7fc640 1 -- 172.21.15.2:0/2462583903 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed802bc60 con 0x55e594e9d5d0 2024-09-19T06:21:16.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.428+0000 7feeece72740 1 -- 172.21.15.2:0/2462583903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e594e9d5d0 msgr2=0x55e594eb4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:16.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.428+0000 7feeece72740 1 --2- 172.21.15.2:0/2462583903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e594e9d5d0 0x55e594eb4310 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7feed80095e0 tx=0x7feed8013000 comp rx=0 tx=0).stop 2024-09-19T06:21:16.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.428+0000 7feeece72740 1 -- 172.21.15.2:0/2462583903 shutdown_connections 2024-09-19T06:21:16.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.428+0000 7feeece72740 1 --2- 172.21.15.2:0/2462583903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e594ea8370 0x55e594ea0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:16.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.428+0000 7feeece72740 1 --2- 172.21.15.2:0/2462583903 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e594e9eb40 0x55e594ea0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:16.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.428+0000 7feeece72740 1 --2- 172.21.15.2:0/2462583903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e594e9d5d0 0x55e594eb4310 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:16.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.428+0000 7feeece72740 1 -- 172.21.15.2:0/2462583903 >> 172.21.15.2:0/2462583903 conn(0x55e594e66310 msgr2=0x55e594ea4140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:16.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.428+0000 7feeece72740 1 -- 172.21.15.2:0/2462583903 shutdown_connections 2024-09-19T06:21:16.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.428+0000 7feeece72740 1 -- 172.21.15.2:0/2462583903 wait complete. 2024-09-19T06:21:16.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.428+0000 7feeece72740 1 -- start start 2024-09-19T06:21:16.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.429+0000 7feeece72740 1 Processor -- start 2024-09-19T06:21:16.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.429+0000 7feeece72740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e594e9d5d0 0x55e594eb0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:16.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.429+0000 7feeece72740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e594e9eb40 0x55e594ea1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:16.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.429+0000 7feeece72740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e594ea8370 0x55e594ea23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:16.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.429+0000 7feeece72740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7feee41adf60 con 0x55e594e9d5d0 2024-09-19T06:21:16.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.429+0000 7feeece72740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7feee41af3d0 con 0x55e594ea8370 2024-09-19T06:21:16.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.429+0000 7feeece72740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7feee41ae630 con 0x55e594e9eb40 2024-09-19T06:21:16.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.429+0000 7feeece72740 10 client.0 _ll_register_callbacks cb 0x7feed00b8d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:16.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.429+0000 7feee8835640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e594e9d5d0 0x55e594eb0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:16.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.429+0000 7feee8835640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e594e9d5d0 0x55e594eb0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36596/0 (socket says 172.21.15.2:36596) 2024-09-19T06:21:16.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.429+0000 7feee8835640 1 -- 172.21.15.2:0/4133874934 learned_addr learned my addr 172.21.15.2:0/4133874934 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:16.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.429+0000 7feee3fff640 1 --2- 172.21.15.2:0/4133874934 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e594e9eb40 0x55e594ea1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:16.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.429+0000 7feee9036640 1 --2- 172.21.15.2:0/4133874934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e594ea8370 0x55e594ea23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:16.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.429+0000 7feee8835640 1 -- 172.21.15.2:0/4133874934 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e594e9eb40 msgr2=0x55e594ea1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:16.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.429+0000 7feee8835640 1 --2- 172.21.15.2:0/4133874934 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e594e9eb40 0x55e594ea1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:16.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.429+0000 7feee8835640 1 -- 172.21.15.2:0/4133874934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e594ea8370 msgr2=0x55e594ea23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:16.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.429+0000 7feee8835640 1 --2- 172.21.15.2:0/4133874934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e594ea8370 0x55e594ea23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:16.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.429+0000 7feee8835640 1 -- 172.21.15.2:0/4133874934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e594ea2c20 con 0x55e594e9d5d0 2024-09-19T06:21:16.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.429+0000 7feee3fff640 1 --2- 172.21.15.2:0/4133874934 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e594e9eb40 0x55e594ea1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:21:16.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.429+0000 7feee9036640 1 --2- 172.21.15.2:0/4133874934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e594ea8370 0x55e594ea23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:21:16.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.430+0000 7feee8835640 1 --2- 172.21.15.2:0/4133874934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e594e9d5d0 0x55e594eb0c80 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7feed80090f0 tx=0x7feed802b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b32b40e6ecb9bcbf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:16.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.430+0000 7feec3fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:16.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.430+0000 7feec3fff640 1 -- 172.21.15.2:0/4133874934 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed8038060 con 0x55e594e9d5d0 2024-09-19T06:21:16.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.430+0000 7feec3fff640 1 -- 172.21.15.2:0/4133874934 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7feed800f040 con 0x55e594e9d5d0 2024-09-19T06:21:16.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.430+0000 7feeece72740 1 -- 172.21.15.2:0/4133874934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feed8014ce0 con 0x55e594e9d5d0 2024-09-19T06:21:16.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.430+0000 7feec3fff640 1 -- 172.21.15.2:0/4133874934 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7feed802bcf0 con 0x55e594e9d5d0 2024-09-19T06:21:16.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.430+0000 7feeece72740 10 client.17322 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:16.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.430+0000 7feeece72740 1 -- 172.21.15.2:0/4133874934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55e594f22ba0 con 0x55e594e9d5d0 2024-09-19T06:21:16.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.430+0000 7feec3fff640 1 -- 172.21.15.2:0/4133874934 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feed8014ce0 con 0x55e594e9d5d0 2024-09-19T06:21:16.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.430+0000 7feec3fff640 1 -- 172.21.15.2:0/4133874934 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7feed8013070 con 0x55e594e9d5d0 2024-09-19T06:21:16.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.430+0000 7feeece72740 10 client.17322 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:16.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.430+0000 7feeece72740 10 client.17322 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:21:16.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.430+0000 7feeece72740 20 client.17322 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:16.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.430+0000 7feeece72740 1 --2- 172.21.15.2:0/4133874934 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55e594eb7ee0 0x55e594f25280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:16.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.431+0000 7feeece72740 4 client.17322 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:21:16.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.431+0000 7feeece72740 1 -- 172.21.15.2:0/4133874934 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e594e0ad70 con 0x55e594eb7ee0 2024-09-19T06:21:16.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.431+0000 7feee3fff640 1 --2- 172.21.15.2:0/4133874934 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55e594eb7ee0 0x55e594f25280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:16.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.431+0000 7feee3fff640 1 --2- 172.21.15.2:0/4133874934 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55e594eb7ee0 0x55e594f25280 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a8d2b27c9e3fc64 server_cookie=a1d85682fcd0be12 in_seq=0 out_seq=0 2024-09-19T06:21:16.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.431+0000 7feec3fff640 10 client.17322 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:21:16.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.431+0000 7feec3fff640 1 -- 172.21.15.2:0/4133874934 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e594e0ad70 con 0x55e594eb7ee0 2024-09-19T06:21:16.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.431+0000 7feec3fff640 10 client.17322 handle_command_reply: tid=0 2024-09-19T06:21:16.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.431+0000 7feeece72740 1 client.17322 shutdown 2024-09-19T06:21:16.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.431+0000 7feeece72740 1 -- 172.21.15.2:0/4133874934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e594e9d5d0 msgr2=0x55e594eb0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:16.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.431+0000 7feeece72740 1 --2- 172.21.15.2:0/4133874934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e594e9d5d0 0x55e594eb0c80 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7feed80090f0 tx=0x7feed802b660 comp rx=0 tx=0).stop 2024-09-19T06:21:16.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.432+0000 7feeece72740 1 -- 172.21.15.2:0/4133874934 shutdown_connections 2024-09-19T06:21:16.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.432+0000 7feeece72740 1 --2- 172.21.15.2:0/4133874934 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55e594eb7ee0 0x55e594f25280 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:16.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.432+0000 7feeece72740 1 --2- 172.21.15.2:0/4133874934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e594ea8370 0x55e594ea23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:16.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.432+0000 7feeece72740 1 --2- 172.21.15.2:0/4133874934 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e594e9eb40 0x55e594ea1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:16.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.432+0000 7feeece72740 1 --2- 172.21.15.2:0/4133874934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e594e9d5d0 0x55e594eb0c80 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:16.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.432+0000 7feeece72740 1 -- 172.21.15.2:0/4133874934 >> 172.21.15.2:0/4133874934 conn(0x55e594e66310 msgr2=0x55e594ea6890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:16.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.432+0000 7feec3fff640 0 client.17322 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:21:16.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.432+0000 7feeece72740 1 -- 172.21.15.2:0/4133874934 shutdown_connections 2024-09-19T06:21:16.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.432+0000 7feeece72740 1 -- 172.21.15.2:0/4133874934 wait complete. 2024-09-19T06:21:16.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.432+0000 7feeece72740 20 client.17322 trim_cache size 0 max 16384 2024-09-19T06:21:16.439 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:21:16.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.432+0000 7feeeaa99640 1 -- 172.21.15.2:0/2894544832 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7feed40a33b0 msgr2=0x7feed40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:16.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.432+0000 7feeeaa99640 1 --2- 172.21.15.2:0/2894544832 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7feed40a33b0 0x7feed40a5870 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7feed8009890 tx=0x7feed8008040 comp rx=0 tx=0).stop 2024-09-19T06:21:16.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.432+0000 7feeeaa99640 1 -- 172.21.15.2:0/2894544832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feee4103660 msgr2=0x7feee419aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:16.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.432+0000 7feeeaa99640 1 --2- 172.21.15.2:0/2894544832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feee4103660 0x7feee419aad0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7feed0005ab0 tx=0x7feed0003c60 comp rx=0 tx=0).stop 2024-09-19T06:21:16.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.433+0000 7feeeaa99640 1 -- 172.21.15.2:0/2894544832 shutdown_connections 2024-09-19T06:21:16.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.433+0000 7feeeaa99640 1 --2- 172.21.15.2:0/2894544832 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7feed40a33b0 0x7feed40a5870 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:16.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.433+0000 7feeeaa99640 1 --2- 172.21.15.2:0/2894544832 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feee410c170 0x7feee419ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:16.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.433+0000 7feeeaa99640 1 --2- 172.21.15.2:0/2894544832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feee4103660 0x7feee419aad0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:16.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.433+0000 7feeeaa99640 1 --2- 172.21.15.2:0/2894544832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feee4102d40 0x7feee419a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:16.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.433+0000 7feeeaa99640 1 -- 172.21.15.2:0/2894544832 >> 172.21.15.2:0/2894544832 conn(0x7feee40fc7a0 msgr2=0x7feee40fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:16.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.433+0000 7feeeaa99640 1 -- 172.21.15.2:0/2894544832 shutdown_connections 2024-09-19T06:21:16.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:16.433+0000 7feeeaa99640 1 -- 172.21.15.2:0/2894544832 wait complete. 2024-09-19T06:21:16.489 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:16 smithi090 ceph-mon[34497]: pgmap v198: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T06:21:17.154 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:21:17.292 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:17 smithi089 ceph-mon[34160]: pgmap v199: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 249 B/s wr, 9 op/s 2024-09-19T06:21:17.413 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:17.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:17 smithi002 ceph-mon[30982]: pgmap v199: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 249 B/s wr, 9 op/s 2024-09-19T06:21:17.489 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:17 smithi090 ceph-mon[34497]: pgmap v199: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 249 B/s wr, 9 op/s 2024-09-19T06:21:17.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.869+0000 7fab548c5640 1 -- 172.21.15.2:0/874684274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab501037a0 msgr2=0x7fab5010bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:17.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.869+0000 7fab548c5640 1 --2- 172.21.15.2:0/874684274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab501037a0 0x7fab5010bc00 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fab44009ca0 tx=0x7fab4402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:21:17.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.869+0000 7fab548c5640 1 -- 172.21.15.2:0/874684274 shutdown_connections 2024-09-19T06:21:17.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.869+0000 7fab548c5640 1 --2- 172.21.15.2:0/874684274 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab5010c2f0 0x7fab5010e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:17.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.869+0000 7fab548c5640 1 --2- 172.21.15.2:0/874684274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab501037a0 0x7fab5010bc00 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:17.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.869+0000 7fab548c5640 1 --2- 172.21.15.2:0/874684274 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fab50102df0 0x7fab501031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:17.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.869+0000 7fab548c5640 1 -- 172.21.15.2:0/874684274 >> 172.21.15.2:0/874684274 conn(0x7fab500fc7d0 msgr2=0x7fab500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:17.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.869+0000 7fab548c5640 1 -- 172.21.15.2:0/874684274 shutdown_connections 2024-09-19T06:21:17.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.869+0000 7fab548c5640 1 -- 172.21.15.2:0/874684274 wait complete. 2024-09-19T06:21:17.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.869+0000 7fab548c5640 1 Processor -- start 2024-09-19T06:21:17.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.870+0000 7fab548c5640 1 -- start start 2024-09-19T06:21:17.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.870+0000 7fab548c5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fab50102df0 0x7fab501a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:17.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.870+0000 7fab548c5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab501037a0 0x7fab501a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:17.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.870+0000 7fab548c5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab5010c2f0 0x7fab5019a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:17.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.870+0000 7fab548c5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fab50111f60 con 0x7fab5010c2f0 2024-09-19T06:21:17.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.870+0000 7fab548c5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fab50111de0 con 0x7fab501037a0 2024-09-19T06:21:17.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.870+0000 7fab548c5640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fab501120e0 con 0x7fab50102df0 2024-09-19T06:21:17.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.870+0000 7fab4ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab5010c2f0 0x7fab5019a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:17.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.870+0000 7fab4ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab5010c2f0 0x7fab5019a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36620/0 (socket says 172.21.15.2:36620) 2024-09-19T06:21:17.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.870+0000 7fab4ed9d640 1 -- 172.21.15.2:0/1925588708 learned_addr learned my addr 172.21.15.2:0/1925588708 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:17.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.870+0000 7fab4e59c640 1 --2- 172.21.15.2:0/1925588708 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fab50102df0 0x7fab501a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:17.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.870+0000 7fab4dd9b640 1 --2- 172.21.15.2:0/1925588708 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab501037a0 0x7fab501a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:17.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.870+0000 7fab4ed9d640 1 -- 172.21.15.2:0/1925588708 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fab50102df0 msgr2=0x7fab501a0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:17.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.870+0000 7fab4ed9d640 1 --2- 172.21.15.2:0/1925588708 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fab50102df0 0x7fab501a0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:17.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.870+0000 7fab4ed9d640 1 -- 172.21.15.2:0/1925588708 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab501037a0 msgr2=0x7fab501a0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:17.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.870+0000 7fab4ed9d640 1 --2- 172.21.15.2:0/1925588708 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab501037a0 0x7fab501a0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:17.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.870+0000 7fab4ed9d640 1 -- 172.21.15.2:0/1925588708 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab5019ad00 con 0x7fab5010c2f0 2024-09-19T06:21:17.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.870+0000 7fab4ed9d640 1 --2- 172.21.15.2:0/1925588708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab5010c2f0 0x7fab5019a5d0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fab4800c970 tx=0x7fab4800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:17.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.871+0000 7fab3f7fe640 1 -- 172.21.15.2:0/1925588708 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab48007bb0 con 0x7fab5010c2f0 2024-09-19T06:21:17.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.871+0000 7fab548c5640 1 -- 172.21.15.2:0/1925588708 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab5019aff0 con 0x7fab5010c2f0 2024-09-19T06:21:17.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.871+0000 7fab3f7fe640 1 -- 172.21.15.2:0/1925588708 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fab48007d50 con 0x7fab5010c2f0 2024-09-19T06:21:17.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.871+0000 7fab3f7fe640 1 -- 172.21.15.2:0/1925588708 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab48004e10 con 0x7fab5010c2f0 2024-09-19T06:21:17.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.871+0000 7fab548c5640 1 -- 172.21.15.2:0/1925588708 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab501a72e0 con 0x7fab5010c2f0 2024-09-19T06:21:17.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.873+0000 7fab3f7fe640 1 -- 172.21.15.2:0/1925588708 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fab48005020 con 0x7fab5010c2f0 2024-09-19T06:21:17.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.873+0000 7fab56c9e740 1 Processor -- start 2024-09-19T06:21:17.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.874+0000 7fab56c9e740 1 -- start start 2024-09-19T06:21:17.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.874+0000 7fab56c9e740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556e34042b40 0x556e34041090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:17.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.874+0000 7fab56c9e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e340415d0 0x556e34041a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:17.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.874+0000 7fab56c9e740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556e3404c370 0x556e3404e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:17.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.874+0000 7fab56c9e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556e33fa72f0 con 0x556e340415d0 2024-09-19T06:21:17.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.874+0000 7fab56c9e740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x556e33f4ecf0 con 0x556e3404c370 2024-09-19T06:21:17.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.874+0000 7fab56c9e740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556e33fa32b0 con 0x556e34042b40 2024-09-19T06:21:17.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.874+0000 7fab3f7fe640 1 --2- 172.21.15.2:0/1925588708 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fab380a33b0 0x7fab380a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:17.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.874+0000 7fab4e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e340415d0 0x556e34041a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:17.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.874+0000 7fab4dd9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556e34042b40 0x556e34041090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:17.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.874+0000 7fab4e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e340415d0 0x556e34041a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36628/0 (socket says 172.21.15.2:36628) 2024-09-19T06:21:17.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.874+0000 7fab4e59c640 1 -- 172.21.15.2:0/2649899317 learned_addr learned my addr 172.21.15.2:0/2649899317 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:17.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.874+0000 7fab4ed9d640 1 --2- 172.21.15.2:0/1925588708 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fab380a33b0 0x7fab380a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:17.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.874+0000 7fab4dd9b640 1 --2- 172.21.15.2:0/2649899317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556e3404c370 0x556e3404e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:17.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.874+0000 7fab3f7fe640 1 -- 172.21.15.2:0/1925588708 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7fab480cf9f0 con 0x7fab5010c2f0 2024-09-19T06:21:17.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.874+0000 7fab4e59c640 1 -- 172.21.15.2:0/2649899317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556e34042b40 msgr2=0x556e34041090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:17.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.874+0000 7fab4e59c640 1 --2- 172.21.15.2:0/2649899317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556e34042b40 0x556e34041090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:17.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.874+0000 7fab4e59c640 1 -- 172.21.15.2:0/2649899317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556e3404c370 msgr2=0x556e3404e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:17.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.874+0000 7fab4e59c640 1 --2- 172.21.15.2:0/2649899317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556e3404c370 0x556e3404e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:17.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.874+0000 7fab4e59c640 1 -- 172.21.15.2:0/2649899317 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e33f333a0 con 0x556e340415d0 2024-09-19T06:21:17.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.874+0000 7fab4dd9b640 1 --2- 172.21.15.2:0/2649899317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556e34042b40 0x556e34041090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:17.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.875+0000 7fab4ed9d640 1 --2- 172.21.15.2:0/1925588708 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fab380a33b0 0x7fab380a5870 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fab4800c940 tx=0x7fab4801a040 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:17.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.875+0000 7fab4e59c640 1 --2- 172.21.15.2:0/2649899317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e340415d0 0x556e34041a10 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fab4000bd10 tx=0x7fab400107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4450c757155c70d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:17.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.875+0000 7fab3cff9640 1 -- 172.21.15.2:0/2649899317 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab40004030 con 0x556e340415d0 2024-09-19T06:21:17.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.875+0000 7fab3cff9640 1 -- 172.21.15.2:0/2649899317 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fab400035f0 con 0x556e340415d0 2024-09-19T06:21:17.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.875+0000 7fab3cff9640 1 -- 172.21.15.2:0/2649899317 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab400117b0 con 0x556e340415d0 2024-09-19T06:21:17.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.875+0000 7fab56c9e740 1 -- 172.21.15.2:0/2649899317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e340415d0 msgr2=0x556e34041a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:17.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.875+0000 7fab56c9e740 1 --2- 172.21.15.2:0/2649899317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e340415d0 0x556e34041a10 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fab4000bd10 tx=0x7fab400107a0 comp rx=0 tx=0).stop 2024-09-19T06:21:17.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.876+0000 7fab56c9e740 1 -- 172.21.15.2:0/2649899317 shutdown_connections 2024-09-19T06:21:17.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.876+0000 7fab56c9e740 1 --2- 172.21.15.2:0/2649899317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556e3404c370 0x556e3404e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:17.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.876+0000 7fab56c9e740 1 --2- 172.21.15.2:0/2649899317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e340415d0 0x556e34041a10 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:17.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.876+0000 7fab56c9e740 1 --2- 172.21.15.2:0/2649899317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556e34042b40 0x556e34041090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:17.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.876+0000 7fab56c9e740 1 -- 172.21.15.2:0/2649899317 >> 172.21.15.2:0/2649899317 conn(0x556e3400a310 msgr2=0x556e3403dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:17.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.876+0000 7fab56c9e740 1 -- 172.21.15.2:0/2649899317 shutdown_connections 2024-09-19T06:21:17.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.876+0000 7fab56c9e740 1 -- 172.21.15.2:0/2649899317 wait complete. 2024-09-19T06:21:17.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.876+0000 7fab56c9e740 1 -- start start 2024-09-19T06:21:17.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.876+0000 7fab56c9e740 1 Processor -- start 2024-09-19T06:21:17.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.876+0000 7fab56c9e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e340415d0 0x556e3404bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:17.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.876+0000 7fab56c9e740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556e34042b40 0x556e34049000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:17.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.876+0000 7fab56c9e740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556e3404c370 0x556e340495d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:17.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.876+0000 7fab56c9e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556e3404f070 con 0x556e340415d0 2024-09-19T06:21:17.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.876+0000 7fab56c9e740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x556e33f62060 con 0x556e3404c370 2024-09-19T06:21:17.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.876+0000 7fab56c9e740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556e3404f1f0 con 0x556e34042b40 2024-09-19T06:21:17.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.876+0000 7fab56c9e740 10 client.0 _ll_register_callbacks cb 0x556e33cb58c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:17.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.876+0000 7fab4dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e340415d0 0x556e3404bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:17.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.877+0000 7fab4dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e340415d0 0x556e3404bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36632/0 (socket says 172.21.15.2:36632) 2024-09-19T06:21:17.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.877+0000 7fab4dd9b640 1 -- 172.21.15.2:0/4164760045 learned_addr learned my addr 172.21.15.2:0/4164760045 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:17.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.877+0000 7fab4e59c640 1 --2- 172.21.15.2:0/4164760045 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556e34042b40 0x556e34049000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:17.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.877+0000 7fab4dd9b640 1 --2- 172.21.15.2:0/4164760045 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556e3404c370 0x556e340495d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:17.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.877+0000 7fab4dd9b640 1 -- 172.21.15.2:0/4164760045 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556e34042b40 msgr2=0x556e34049000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:17.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.877+0000 7fab4dd9b640 1 --2- 172.21.15.2:0/4164760045 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556e34042b40 0x556e34049000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:17.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.877+0000 7fab4dd9b640 1 -- 172.21.15.2:0/4164760045 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556e3404c370 msgr2=0x556e340495d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:17.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.877+0000 7fab4dd9b640 1 --2- 172.21.15.2:0/4164760045 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556e3404c370 0x556e340495d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:17.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.877+0000 7fab4dd9b640 1 -- 172.21.15.2:0/4164760045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e33d183c0 con 0x556e340415d0 2024-09-19T06:21:17.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.877+0000 7fab4dd9b640 1 --2- 172.21.15.2:0/4164760045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e340415d0 0x556e3404bd50 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fab44005cc0 tx=0x7fab44031450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2977af4ebb4e8606 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:17.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.877+0000 7fab35ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:17.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.877+0000 7fab35ffb640 1 -- 172.21.15.2:0/4164760045 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab44003d80 con 0x556e340415d0 2024-09-19T06:21:17.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.877+0000 7fab56c9e740 1 -- 172.21.15.2:0/4164760045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab400035f0 con 0x556e340415d0 2024-09-19T06:21:17.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.877+0000 7fab35ffb640 1 -- 172.21.15.2:0/4164760045 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7fab44004040 con 0x556e340415d0 2024-09-19T06:21:17.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.877+0000 7fab35ffb640 1 -- 172.21.15.2:0/4164760045 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fab44032eb0 con 0x556e340415d0 2024-09-19T06:21:17.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.877+0000 7fab56c9e740 10 client.17334 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:17.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.877+0000 7fab56c9e740 1 -- 172.21.15.2:0/4164760045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556e3405ab20 con 0x556e340415d0 2024-09-19T06:21:17.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.878+0000 7fab35ffb640 1 -- 172.21.15.2:0/4164760045 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fab400035f0 con 0x556e340415d0 2024-09-19T06:21:17.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.878+0000 7fab35ffb640 1 -- 172.21.15.2:0/4164760045 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fab44030b20 con 0x556e340415d0 2024-09-19T06:21:17.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.878+0000 7fab56c9e740 10 client.17334 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:17.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.878+0000 7fab56c9e740 10 client.17334 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:21:17.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.878+0000 7fab56c9e740 20 client.17334 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:17.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.878+0000 7fab56c9e740 1 --2- 172.21.15.2:0/4164760045 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x556e3405bf10 0x556e3405e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:17.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.878+0000 7fab56c9e740 4 client.17334 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:17.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.878+0000 7fab56c9e740 1 -- 172.21.15.2:0/4164760045 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556e33fb4860 con 0x556e3405bf10 2024-09-19T06:21:17.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.878+0000 7fab4e59c640 1 --2- 172.21.15.2:0/4164760045 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x556e3405bf10 0x556e3405e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:17.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.878+0000 7fab35ffb640 10 client.17334 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:21:17.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.878+0000 7fab4e59c640 1 --2- 172.21.15.2:0/4164760045 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x556e3405bf10 0x556e3405e300 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9fe8dbac61bb34ef server_cookie=5455a939365cb43a in_seq=0 out_seq=0 2024-09-19T06:21:17.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.879+0000 7fab35ffb640 1 -- 172.21.15.2:0/4164760045 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556e33fb4860 con 0x556e3405bf10 2024-09-19T06:21:17.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.879+0000 7fab35ffb640 10 client.17334 handle_command_reply: tid=0 2024-09-19T06:21:17.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.879+0000 7fab56c9e740 1 client.17334 shutdown 2024-09-19T06:21:17.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.879+0000 7fab56c9e740 1 -- 172.21.15.2:0/4164760045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e340415d0 msgr2=0x556e3404bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:17.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.879+0000 7fab56c9e740 1 --2- 172.21.15.2:0/4164760045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e340415d0 0x556e3404bd50 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fab44005cc0 tx=0x7fab44031450 comp rx=0 tx=0).stop 2024-09-19T06:21:17.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.879+0000 7fab56c9e740 1 -- 172.21.15.2:0/4164760045 shutdown_connections 2024-09-19T06:21:17.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.879+0000 7fab56c9e740 1 --2- 172.21.15.2:0/4164760045 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x556e3405bf10 0x556e3405e300 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:17.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.879+0000 7fab56c9e740 1 --2- 172.21.15.2:0/4164760045 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556e3404c370 0x556e340495d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:17.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.879+0000 7fab56c9e740 1 --2- 172.21.15.2:0/4164760045 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556e34042b40 0x556e34049000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:17.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.879+0000 7fab35ffb640 0 client.17334 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:21:17.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.879+0000 7fab56c9e740 1 --2- 172.21.15.2:0/4164760045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e340415d0 0x556e3404bd50 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:17.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.879+0000 7fab56c9e740 1 -- 172.21.15.2:0/4164760045 >> 172.21.15.2:0/4164760045 conn(0x556e3400a310 msgr2=0x556e34043930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:17.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.879+0000 7fab56c9e740 1 -- 172.21.15.2:0/4164760045 shutdown_connections 2024-09-19T06:21:17.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.880+0000 7fab56c9e740 1 -- 172.21.15.2:0/4164760045 wait complete. 2024-09-19T06:21:17.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.880+0000 7fab56c9e740 20 client.17334 trim_cache size 0 max 16384 2024-09-19T06:21:17.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.894+0000 7fab56c9e740 1 Processor -- start 2024-09-19T06:21:17.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.894+0000 7fab56c9e740 1 -- start start 2024-09-19T06:21:17.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.894+0000 7fab56c9e740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556e340415d0 0x556e34044120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:17.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.894+0000 7fab56c9e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e34042b40 0x556e34044660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:17.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.894+0000 7fab56c9e740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556e3404c370 0x556e34063bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:17.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.894+0000 7fab56c9e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fab501b2360 con 0x556e34042b40 2024-09-19T06:21:17.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.894+0000 7fab56c9e740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fab501afc30 con 0x556e3404c370 2024-09-19T06:21:17.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.894+0000 7fab56c9e740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fab501adaa0 con 0x556e340415d0 2024-09-19T06:21:17.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.894+0000 7fab4e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e34042b40 0x556e34044660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:17.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.894+0000 7fab4e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e34042b40 0x556e34044660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36648/0 (socket says 172.21.15.2:36648) 2024-09-19T06:21:17.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.894+0000 7fab4e59c640 1 -- 172.21.15.2:0/3532191406 learned_addr learned my addr 172.21.15.2:0/3532191406 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:17.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.894+0000 7fab4dd9b640 1 --2- 172.21.15.2:0/3532191406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556e3404c370 0x556e34063bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:17.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.894+0000 7fab4dd9b640 1 --2- 172.21.15.2:0/3532191406 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556e340415d0 0x556e34044120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:17.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.894+0000 7fab4e59c640 1 -- 172.21.15.2:0/3532191406 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556e340415d0 msgr2=0x556e34044120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:17.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.894+0000 7fab4e59c640 1 --2- 172.21.15.2:0/3532191406 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556e340415d0 0x556e34044120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:17.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.894+0000 7fab4e59c640 1 -- 172.21.15.2:0/3532191406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556e3404c370 msgr2=0x556e34063bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:17.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.894+0000 7fab4e59c640 1 --2- 172.21.15.2:0/3532191406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556e3404c370 0x556e34063bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:17.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.894+0000 7fab4e59c640 1 -- 172.21.15.2:0/3532191406 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e3405e980 con 0x556e34042b40 2024-09-19T06:21:17.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.894+0000 7fab4dd9b640 1 --2- 172.21.15.2:0/3532191406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556e3404c370 0x556e34063bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:17.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.895+0000 7fab4e59c640 1 --2- 172.21.15.2:0/3532191406 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e34042b40 0x556e34044660 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fab4000bd10 tx=0x7fab4000b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22301cb0809a986 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:17.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.895+0000 7fab37fff640 1 -- 172.21.15.2:0/3532191406 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab40005240 con 0x556e34042b40 2024-09-19T06:21:17.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.895+0000 7fab37fff640 1 -- 172.21.15.2:0/3532191406 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fab400053e0 con 0x556e34042b40 2024-09-19T06:21:17.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.895+0000 7fab37fff640 1 -- 172.21.15.2:0/3532191406 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab400116a0 con 0x556e34042b40 2024-09-19T06:21:17.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.896+0000 7fab56c9e740 1 -- 172.21.15.2:0/3532191406 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e34042b40 msgr2=0x556e34044660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:17.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.896+0000 7fab56c9e740 1 --2- 172.21.15.2:0/3532191406 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e34042b40 0x556e34044660 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fab4000bd10 tx=0x7fab4000b790 comp rx=0 tx=0).stop 2024-09-19T06:21:17.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.896+0000 7fab56c9e740 1 -- 172.21.15.2:0/3532191406 shutdown_connections 2024-09-19T06:21:17.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.896+0000 7fab56c9e740 1 --2- 172.21.15.2:0/3532191406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556e3404c370 0x556e34063bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:17.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.896+0000 7fab56c9e740 1 --2- 172.21.15.2:0/3532191406 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e34042b40 0x556e34044660 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:17.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.896+0000 7fab56c9e740 1 --2- 172.21.15.2:0/3532191406 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556e340415d0 0x556e34044120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:17.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.896+0000 7fab56c9e740 1 -- 172.21.15.2:0/3532191406 >> 172.21.15.2:0/3532191406 conn(0x556e3400a310 msgr2=0x556e3403cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:17.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.896+0000 7fab56c9e740 1 -- 172.21.15.2:0/3532191406 shutdown_connections 2024-09-19T06:21:17.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.896+0000 7fab56c9e740 1 -- 172.21.15.2:0/3532191406 wait complete. 2024-09-19T06:21:17.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.896+0000 7fab56c9e740 1 -- start start 2024-09-19T06:21:17.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.896+0000 7fab56c9e740 1 Processor -- start 2024-09-19T06:21:17.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.896+0000 7fab56c9e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e340415d0 0x556e34050330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:17.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.896+0000 7fab56c9e740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556e34042b40 0x556e34050870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:17.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.896+0000 7fab56c9e740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556e3404c370 0x556e34050db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:17.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.896+0000 7fab56c9e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fab501ae0f0 con 0x556e340415d0 2024-09-19T06:21:17.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.896+0000 7fab56c9e740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fab501af560 con 0x556e34042b40 2024-09-19T06:21:17.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.896+0000 7fab56c9e740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fab501ae7c0 con 0x556e3404c370 2024-09-19T06:21:17.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.897+0000 7fab56c9e740 10 client.0 _ll_register_callbacks cb 0x7fab44032cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:17.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.897+0000 7fab4dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e340415d0 0x556e34050330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:17.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.897+0000 7fab4dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e340415d0 0x556e34050330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36656/0 (socket says 172.21.15.2:36656) 2024-09-19T06:21:17.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.897+0000 7fab4dd9b640 1 -- 172.21.15.2:0/1780487722 learned_addr learned my addr 172.21.15.2:0/1780487722 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:17.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.897+0000 7fab4e59c640 1 --2- 172.21.15.2:0/1780487722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556e34042b40 0x556e34050870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:17.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.897+0000 7fab4dd9b640 1 -- 172.21.15.2:0/1780487722 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556e3404c370 msgr2=0x556e34050db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:17.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.897+0000 7fab4dd9b640 1 --2- 172.21.15.2:0/1780487722 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556e3404c370 0x556e34050db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:17.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.897+0000 7fab4dd9b640 1 -- 172.21.15.2:0/1780487722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556e34042b40 msgr2=0x556e34050870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:17.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.897+0000 7fab4dd9b640 1 --2- 172.21.15.2:0/1780487722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556e34042b40 0x556e34050870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:17.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.897+0000 7fab4dd9b640 1 -- 172.21.15.2:0/1780487722 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e340c5d00 con 0x556e340415d0 2024-09-19T06:21:17.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.897+0000 7fab4dd9b640 1 --2- 172.21.15.2:0/1780487722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e340415d0 0x556e34050330 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fab44009bf0 tx=0x7fab44003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7bc0fed38859ac0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:17.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.897+0000 7fab35ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:17.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.897+0000 7fab35ffb640 1 -- 172.21.15.2:0/1780487722 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab44009880 con 0x556e340415d0 2024-09-19T06:21:17.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.897+0000 7fab35ffb640 1 -- 172.21.15.2:0/1780487722 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7fab440309e0 con 0x556e340415d0 2024-09-19T06:21:17.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.897+0000 7fab56c9e740 1 -- 172.21.15.2:0/1780487722 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab400053e0 con 0x556e340415d0 2024-09-19T06:21:17.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.897+0000 7fab35ffb640 1 -- 172.21.15.2:0/1780487722 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fab44062050 con 0x556e340415d0 2024-09-19T06:21:17.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.897+0000 7fab56c9e740 10 client.17340 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:17.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.897+0000 7fab56c9e740 1 -- 172.21.15.2:0/1780487722 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556e340c6fa0 con 0x556e340415d0 2024-09-19T06:21:17.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.898+0000 7fab35ffb640 1 -- 172.21.15.2:0/1780487722 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fab400053e0 con 0x556e340415d0 2024-09-19T06:21:17.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.898+0000 7fab35ffb640 1 -- 172.21.15.2:0/1780487722 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fab44004040 con 0x556e340415d0 2024-09-19T06:21:17.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.898+0000 7fab56c9e740 10 client.17340 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:17.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.898+0000 7fab56c9e740 10 client.17340 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:21:17.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.898+0000 7fab56c9e740 20 client.17340 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:17.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.898+0000 7fab56c9e740 1 --2- 172.21.15.2:0/1780487722 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x556e340c76f0 0x556e340c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:17.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.898+0000 7fab56c9e740 4 client.17340 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:21:17.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.898+0000 7fab56c9e740 1 -- 172.21.15.2:0/1780487722 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556e33faed70 con 0x556e340c76f0 2024-09-19T06:21:17.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.898+0000 7fab4e59c640 1 --2- 172.21.15.2:0/1780487722 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x556e340c76f0 0x556e340c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:17.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.899+0000 7fab4e59c640 1 --2- 172.21.15.2:0/1780487722 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x556e340c76f0 0x556e340c9b10 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=81d77aaecc16268 server_cookie=139230b5f72f8c56 in_seq=0 out_seq=0 2024-09-19T06:21:17.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.899+0000 7fab35ffb640 10 client.17340 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:21:17.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.899+0000 7fab35ffb640 1 -- 172.21.15.2:0/1780487722 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556e33faed70 con 0x556e340c76f0 2024-09-19T06:21:17.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.899+0000 7fab35ffb640 10 client.17340 handle_command_reply: tid=0 2024-09-19T06:21:17.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.899+0000 7fab56c9e740 1 client.17340 shutdown 2024-09-19T06:21:17.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.899+0000 7fab56c9e740 1 -- 172.21.15.2:0/1780487722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e340415d0 msgr2=0x556e34050330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:17.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.899+0000 7fab56c9e740 1 --2- 172.21.15.2:0/1780487722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e340415d0 0x556e34050330 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fab44009bf0 tx=0x7fab44003f90 comp rx=0 tx=0).stop 2024-09-19T06:21:17.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.899+0000 7fab56c9e740 1 -- 172.21.15.2:0/1780487722 shutdown_connections 2024-09-19T06:21:17.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.899+0000 7fab56c9e740 1 --2- 172.21.15.2:0/1780487722 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x556e340c76f0 0x556e340c9b10 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:17.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.899+0000 7fab56c9e740 1 --2- 172.21.15.2:0/1780487722 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556e3404c370 0x556e34050db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:17.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.899+0000 7fab56c9e740 1 --2- 172.21.15.2:0/1780487722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556e34042b40 0x556e34050870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:17.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.899+0000 7fab56c9e740 1 --2- 172.21.15.2:0/1780487722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556e340415d0 0x556e34050330 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:17.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.899+0000 7fab56c9e740 1 -- 172.21.15.2:0/1780487722 >> 172.21.15.2:0/1780487722 conn(0x556e3400a310 msgr2=0x556e3404a860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:17.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.899+0000 7fab35ffb640 0 client.17340 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:21:17.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.899+0000 7fab56c9e740 1 -- 172.21.15.2:0/1780487722 shutdown_connections 2024-09-19T06:21:17.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.899+0000 7fab56c9e740 1 -- 172.21.15.2:0/1780487722 wait complete. 2024-09-19T06:21:17.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.899+0000 7fab56c9e740 20 client.17340 trim_cache size 0 max 16384 2024-09-19T06:21:17.908 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:21:17.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.900+0000 7fab548c5640 1 -- 172.21.15.2:0/1925588708 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fab380a33b0 msgr2=0x7fab380a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:17.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.900+0000 7fab548c5640 1 --2- 172.21.15.2:0/1925588708 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fab380a33b0 0x7fab380a5870 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fab4800c940 tx=0x7fab4801a040 comp rx=0 tx=0).stop 2024-09-19T06:21:17.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.900+0000 7fab548c5640 1 -- 172.21.15.2:0/1925588708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab5010c2f0 msgr2=0x7fab5019a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:17.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.900+0000 7fab548c5640 1 --2- 172.21.15.2:0/1925588708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab5010c2f0 0x7fab5019a5d0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fab4800c970 tx=0x7fab4800ce30 comp rx=0 tx=0).stop 2024-09-19T06:21:17.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.900+0000 7fab548c5640 1 -- 172.21.15.2:0/1925588708 shutdown_connections 2024-09-19T06:21:17.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.900+0000 7fab548c5640 1 --2- 172.21.15.2:0/1925588708 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fab380a33b0 0x7fab380a5870 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:17.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.900+0000 7fab548c5640 1 --2- 172.21.15.2:0/1925588708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab5010c2f0 0x7fab5019a5d0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:17.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.900+0000 7fab548c5640 1 --2- 172.21.15.2:0/1925588708 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab501037a0 0x7fab501a0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:17.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.900+0000 7fab548c5640 1 --2- 172.21.15.2:0/1925588708 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fab50102df0 0x7fab501a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:17.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.900+0000 7fab548c5640 1 -- 172.21.15.2:0/1925588708 >> 172.21.15.2:0/1925588708 conn(0x7fab500fc7d0 msgr2=0x7fab50101ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:17.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.900+0000 7fab548c5640 1 -- 172.21.15.2:0/1925588708 shutdown_connections 2024-09-19T06:21:17.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:17.900+0000 7fab548c5640 1 -- 172.21.15.2:0/1925588708 wait complete. 2024-09-19T06:21:18.594 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:21:18.849 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:19.222 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:19 smithi002 ceph-mon[30982]: pgmap v200: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-19T06:21:19.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.260+0000 7f0a6add8640 1 -- 172.21.15.2:0/2894525177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a64106f10 msgr2=0x7f0a6410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:19.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.260+0000 7f0a6add8640 1 --2- 172.21.15.2:0/2894525177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a64106f10 0x7f0a6410ea90 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c009ca0 tx=0x7f0a5c02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:21:19.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.260+0000 7f0a6add8640 1 -- 172.21.15.2:0/2894525177 shutdown_connections 2024-09-19T06:21:19.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.260+0000 7f0a6add8640 1 --2- 172.21.15.2:0/2894525177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a64106f10 0x7f0a6410ea90 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:19.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.260+0000 7f0a6add8640 1 --2- 172.21.15.2:0/2894525177 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a64102790 0x7f0a641067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:19.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.260+0000 7f0a6add8640 1 --2- 172.21.15.2:0/2894525177 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a64101de0 0x7f0a641021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:19.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.260+0000 7f0a6add8640 1 -- 172.21.15.2:0/2894525177 >> 172.21.15.2:0/2894525177 conn(0x7f0a640fd8c0 msgr2=0x7f0a640ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:19.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.260+0000 7f0a6add8640 1 -- 172.21.15.2:0/2894525177 shutdown_connections 2024-09-19T06:21:19.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.260+0000 7f0a6add8640 1 -- 172.21.15.2:0/2894525177 wait complete. 2024-09-19T06:21:19.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.261+0000 7f0a6add8640 1 Processor -- start 2024-09-19T06:21:19.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.261+0000 7f0a6add8640 1 -- start start 2024-09-19T06:21:19.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.261+0000 7f0a6add8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a64101de0 0x7f0a641982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:19.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.261+0000 7f0a6add8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a64102790 0x7f0a64198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:19.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.261+0000 7f0a6add8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a64106f10 0x7f0a6419cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:19.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.261+0000 7f0a6add8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0a64111e70 con 0x7f0a64102790 2024-09-19T06:21:19.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.261+0000 7f0a6add8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0a64111cf0 con 0x7f0a64101de0 2024-09-19T06:21:19.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.261+0000 7f0a6add8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0a64111ff0 con 0x7f0a64106f10 2024-09-19T06:21:19.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.261+0000 7f0a63fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a64102790 0x7f0a64198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:19.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.261+0000 7f0a63fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a64102790 0x7f0a64198830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36674/0 (socket says 172.21.15.2:36674) 2024-09-19T06:21:19.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.261+0000 7f0a63fff640 1 -- 172.21.15.2:0/4035197856 learned_addr learned my addr 172.21.15.2:0/4035197856 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:19.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.261+0000 7f0a68b74640 1 --2- 172.21.15.2:0/4035197856 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a64101de0 0x7f0a641982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:19.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.262+0000 7f0a69375640 1 --2- 172.21.15.2:0/4035197856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a64106f10 0x7f0a6419cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:19.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.262+0000 7f0a63fff640 1 -- 172.21.15.2:0/4035197856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a64106f10 msgr2=0x7f0a6419cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:19.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.262+0000 7f0a63fff640 1 --2- 172.21.15.2:0/4035197856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a64106f10 0x7f0a6419cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:19.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.262+0000 7f0a63fff640 1 -- 172.21.15.2:0/4035197856 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a64101de0 msgr2=0x7f0a641982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:19.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.262+0000 7f0a63fff640 1 --2- 172.21.15.2:0/4035197856 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a64101de0 0x7f0a641982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:19.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.262+0000 7f0a63fff640 1 -- 172.21.15.2:0/4035197856 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a6419d2a0 con 0x7f0a64102790 2024-09-19T06:21:19.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.262+0000 7f0a63fff640 1 --2- 172.21.15.2:0/4035197856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a64102790 0x7f0a64198830 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f0a5000d770 tx=0x7f0a5000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:19.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.262+0000 7f0a61ffb640 1 -- 172.21.15.2:0/4035197856 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a50017070 con 0x7f0a64102790 2024-09-19T06:21:19.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.262+0000 7f0a6add8640 1 -- 172.21.15.2:0/4035197856 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a6419d590 con 0x7f0a64102790 2024-09-19T06:21:19.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.262+0000 7f0a61ffb640 1 -- 172.21.15.2:0/4035197856 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0a500054d0 con 0x7f0a64102790 2024-09-19T06:21:19.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.262+0000 7f0a61ffb640 1 -- 172.21.15.2:0/4035197856 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a50004cf0 con 0x7f0a64102790 2024-09-19T06:21:19.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.262+0000 7f0a6add8640 1 -- 172.21.15.2:0/4035197856 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a641a4e70 con 0x7f0a64102790 2024-09-19T06:21:19.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.265+0000 7f0a61ffb640 1 -- 172.21.15.2:0/4035197856 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f0a50004e90 con 0x7f0a64102790 2024-09-19T06:21:19.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.265+0000 7f0a6d1b1740 1 Processor -- start 2024-09-19T06:21:19.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.265+0000 7f0a6d1b1740 1 -- start start 2024-09-19T06:21:19.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.265+0000 7f0a6d1b1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f5a9e7b40 0x558f5a9e6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:19.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.265+0000 7f0a6d1b1740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f5a9e65d0 0x558f5a9e6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:19.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.265+0000 7f0a6d1b1740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f5a9f5780 0x558f5a9f7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:19.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.266+0000 7f0a6d1b1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558f5a94c2f0 con 0x558f5a9e7b40 2024-09-19T06:21:19.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.266+0000 7f0a6d1b1740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x558f5a8f3cf0 con 0x558f5a9e65d0 2024-09-19T06:21:19.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.266+0000 7f0a6d1b1740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x558f5a9482b0 con 0x558f5a9f5780 2024-09-19T06:21:19.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.266+0000 7f0a61ffb640 1 --2- 172.21.15.2:0/4035197856 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f0a540a3430 0x7f0a540a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:19.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.266+0000 7f0a69375640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f5a9e7b40 0x558f5a9e6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:19.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.266+0000 7f0a69375640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f5a9e7b40 0x558f5a9e6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36682/0 (socket says 172.21.15.2:36682) 2024-09-19T06:21:19.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.266+0000 7f0a69375640 1 -- 172.21.15.2:0/1960246768 learned_addr learned my addr 172.21.15.2:0/1960246768 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:19.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.266+0000 7f0a69375640 1 --2- 172.21.15.2:0/4035197856 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f0a540a3430 0x7f0a540a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:19.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.266+0000 7f0a63fff640 1 --2- 172.21.15.2:0/1960246768 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f5a9f5780 0x558f5a9f7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:19.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.266+0000 7f0a68b74640 1 --2- 172.21.15.2:0/1960246768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f5a9e65d0 0x558f5a9e6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:19.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.266+0000 7f0a61ffb640 1 -- 172.21.15.2:0/4035197856 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f0a500cf5e0 con 0x7f0a64102790 2024-09-19T06:21:19.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.266+0000 7f0a69375640 1 -- 172.21.15.2:0/1960246768 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f5a9f5780 msgr2=0x558f5a9f7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:19.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.266+0000 7f0a69375640 1 --2- 172.21.15.2:0/1960246768 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f5a9f5780 0x558f5a9f7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:19.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.266+0000 7f0a69375640 1 -- 172.21.15.2:0/1960246768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f5a9e65d0 msgr2=0x558f5a9e6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:19.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.266+0000 7f0a69375640 1 --2- 172.21.15.2:0/1960246768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f5a9e65d0 0x558f5a9e6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:19.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.266+0000 7f0a69375640 1 -- 172.21.15.2:0/1960246768 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f5a8d83a0 con 0x558f5a9e7b40 2024-09-19T06:21:19.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.266+0000 7f0a68b74640 1 --2- 172.21.15.2:0/1960246768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f5a9e65d0 0x558f5a9e6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:19.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.266+0000 7f0a69375640 1 --2- 172.21.15.2:0/1960246768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f5a9e7b40 0x558f5a9e6090 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c02aeb0 tx=0x7f0a5c032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59023378dafb2de0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:19.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.266+0000 7f0a69375640 1 --2- 172.21.15.2:0/4035197856 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f0a540a3430 0x7f0a540a58f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c004ad0 tx=0x7f0a5c03b000 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:19.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.267+0000 7f0a4effd640 1 -- 172.21.15.2:0/1960246768 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c04e070 con 0x558f5a9e7b40 2024-09-19T06:21:19.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.267+0000 7f0a4effd640 1 -- 172.21.15.2:0/1960246768 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0a5c036040 con 0x558f5a9e7b40 2024-09-19T06:21:19.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.267+0000 7f0a4effd640 1 -- 172.21.15.2:0/1960246768 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c004730 con 0x558f5a9e7b40 2024-09-19T06:21:19.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.267+0000 7f0a6d1b1740 1 -- 172.21.15.2:0/1960246768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f5a9e7b40 msgr2=0x558f5a9e6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:19.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.267+0000 7f0a6d1b1740 1 --2- 172.21.15.2:0/1960246768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f5a9e7b40 0x558f5a9e6090 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c02aeb0 tx=0x7f0a5c032d10 comp rx=0 tx=0).stop 2024-09-19T06:21:19.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.267+0000 7f0a6d1b1740 1 -- 172.21.15.2:0/1960246768 shutdown_connections 2024-09-19T06:21:19.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.267+0000 7f0a6d1b1740 1 --2- 172.21.15.2:0/1960246768 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f5a9f5780 0x558f5a9f7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:19.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.267+0000 7f0a6d1b1740 1 --2- 172.21.15.2:0/1960246768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f5a9e65d0 0x558f5a9e6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:19.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.267+0000 7f0a6d1b1740 1 --2- 172.21.15.2:0/1960246768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f5a9e7b40 0x558f5a9e6090 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:19.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.267+0000 7f0a6d1b1740 1 -- 172.21.15.2:0/1960246768 >> 172.21.15.2:0/1960246768 conn(0x558f5a9af310 msgr2=0x558f5a9e2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:19.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.267+0000 7f0a6d1b1740 1 -- 172.21.15.2:0/1960246768 shutdown_connections 2024-09-19T06:21:19.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.267+0000 7f0a6d1b1740 1 -- 172.21.15.2:0/1960246768 wait complete. 2024-09-19T06:21:19.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.268+0000 7f0a6d1b1740 1 -- start start 2024-09-19T06:21:19.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.268+0000 7f0a6d1b1740 1 Processor -- start 2024-09-19T06:21:19.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.268+0000 7f0a6d1b1740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f5a9e65d0 0x558f5a9f51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:19.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.268+0000 7f0a6d1b1740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f5a9e7b40 0x558f5a9f24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:19.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.268+0000 7f0a6d1b1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f5a9f5780 0x558f5a9f2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:19.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.268+0000 7f0a6d1b1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558f5a9f82a0 con 0x558f5a9f5780 2024-09-19T06:21:19.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.268+0000 7f0a6d1b1740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x558f5a907060 con 0x558f5a9e65d0 2024-09-19T06:21:19.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.268+0000 7f0a6d1b1740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x558f5a9f8420 con 0x558f5a9e7b40 2024-09-19T06:21:19.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.268+0000 7f0a6d1b1740 10 client.0 _ll_register_callbacks cb 0x558f5a65a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:19.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.268+0000 7f0a69375640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f5a9f5780 0x558f5a9f2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:19.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.268+0000 7f0a69375640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f5a9f5780 0x558f5a9f2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36696/0 (socket says 172.21.15.2:36696) 2024-09-19T06:21:19.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.268+0000 7f0a69375640 1 -- 172.21.15.2:0/440667745 learned_addr learned my addr 172.21.15.2:0/440667745 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:19.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.268+0000 7f0a63fff640 1 --2- 172.21.15.2:0/440667745 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f5a9e7b40 0x558f5a9f24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:19.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.269+0000 7f0a68b74640 1 --2- 172.21.15.2:0/440667745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f5a9e65d0 0x558f5a9f51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:19.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.269+0000 7f0a69375640 1 -- 172.21.15.2:0/440667745 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f5a9e7b40 msgr2=0x558f5a9f24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:19.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.269+0000 7f0a69375640 1 --2- 172.21.15.2:0/440667745 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f5a9e7b40 0x558f5a9f24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:19.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.269+0000 7f0a69375640 1 -- 172.21.15.2:0/440667745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f5a9e65d0 msgr2=0x558f5a9f51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:19.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.269+0000 7f0a69375640 1 --2- 172.21.15.2:0/440667745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f5a9e65d0 0x558f5a9f51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:19.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.269+0000 7f0a69375640 1 -- 172.21.15.2:0/440667745 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f5a6bd3c0 con 0x558f5a9f5780 2024-09-19T06:21:19.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.269+0000 7f0a63fff640 1 --2- 172.21.15.2:0/440667745 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f5a9e7b40 0x558f5a9f24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:19.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.269+0000 7f0a69375640 1 --2- 172.21.15.2:0/440667745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f5a9f5780 0x558f5a9f2be0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c04d040 tx=0x7f0a5c031660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=897581a6dd5247d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:19.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.269+0000 7f0a43fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:19.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.269+0000 7f0a43fff640 1 -- 172.21.15.2:0/440667745 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c05a030 con 0x558f5a9f5780 2024-09-19T06:21:19.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.269+0000 7f0a43fff640 1 -- 172.21.15.2:0/440667745 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f0a5c003e00 con 0x558f5a9f5780 2024-09-19T06:21:19.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.269+0000 7f0a6d1b1740 1 -- 172.21.15.2:0/440667745 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a5c036040 con 0x558f5a9f5780 2024-09-19T06:21:19.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.269+0000 7f0a43fff640 1 -- 172.21.15.2:0/440667745 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0a5c04e040 con 0x558f5a9f5780 2024-09-19T06:21:19.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.269+0000 7f0a6d1b1740 10 client.17352 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:19.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.269+0000 7f0a6d1b1740 1 -- 172.21.15.2:0/440667745 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x558f5a9f82a0 con 0x558f5a9f5780 2024-09-19T06:21:19.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.270+0000 7f0a43fff640 1 -- 172.21.15.2:0/440667745 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0a5c036040 con 0x558f5a9f5780 2024-09-19T06:21:19.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.270+0000 7f0a43fff640 1 -- 172.21.15.2:0/440667745 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f0a5c0309a0 con 0x558f5a9f5780 2024-09-19T06:21:19.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.270+0000 7f0a6d1b1740 10 client.17352 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:19.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.270+0000 7f0a6d1b1740 10 client.17352 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:19.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.270+0000 7f0a6d1b1740 20 client.17352 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:19.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.270+0000 7f0a6d1b1740 1 --2- 172.21.15.2:0/440667745 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558f5aa04f50 0x558f5aa07340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:19.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.270+0000 7f0a6d1b1740 4 client.17352 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:19.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.270+0000 7f0a6d1b1740 1 -- 172.21.15.2:0/440667745 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558f5a959860 con 0x558f5aa04f50 2024-09-19T06:21:19.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.270+0000 7f0a68b74640 1 --2- 172.21.15.2:0/440667745 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558f5aa04f50 0x558f5aa07340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:19.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.270+0000 7f0a68b74640 1 --2- 172.21.15.2:0/440667745 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558f5aa04f50 0x558f5aa07340 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0c174cb76b35c5b server_cookie=4f888babdcf2bbe6 in_seq=0 out_seq=0 2024-09-19T06:21:19.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.270+0000 7f0a43fff640 10 client.17352 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:19.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.271+0000 7f0a43fff640 1 -- 172.21.15.2:0/440667745 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558f5a959860 con 0x558f5aa04f50 2024-09-19T06:21:19.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.271+0000 7f0a43fff640 10 client.17352 handle_command_reply: tid=0 2024-09-19T06:21:19.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.271+0000 7f0a6d1b1740 1 client.17352 shutdown 2024-09-19T06:21:19.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.271+0000 7f0a6d1b1740 1 -- 172.21.15.2:0/440667745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f5a9f5780 msgr2=0x558f5a9f2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:19.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.271+0000 7f0a6d1b1740 1 --2- 172.21.15.2:0/440667745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f5a9f5780 0x558f5a9f2be0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c04d040 tx=0x7f0a5c031660 comp rx=0 tx=0).stop 2024-09-19T06:21:19.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.271+0000 7f0a6d1b1740 1 -- 172.21.15.2:0/440667745 shutdown_connections 2024-09-19T06:21:19.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.271+0000 7f0a6d1b1740 1 --2- 172.21.15.2:0/440667745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f5a9f5780 0x558f5a9f2be0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:19.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.271+0000 7f0a6d1b1740 1 --2- 172.21.15.2:0/440667745 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f5a9e7b40 0x558f5a9f24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:19.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.271+0000 7f0a6d1b1740 1 --2- 172.21.15.2:0/440667745 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558f5aa04f50 0x558f5aa07340 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:19.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.271+0000 7f0a43fff640 0 client.17352 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:19.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.271+0000 7f0a6d1b1740 1 --2- 172.21.15.2:0/440667745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f5a9e65d0 0x558f5a9f51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:19.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.271+0000 7f0a6d1b1740 1 -- 172.21.15.2:0/440667745 >> 172.21.15.2:0/440667745 conn(0x558f5a9af310 msgr2=0x558f5a9e8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:19.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.272+0000 7f0a6d1b1740 1 -- 172.21.15.2:0/440667745 shutdown_connections 2024-09-19T06:21:19.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.272+0000 7f0a6d1b1740 1 -- 172.21.15.2:0/440667745 wait complete. 2024-09-19T06:21:19.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.272+0000 7f0a6d1b1740 20 client.17352 trim_cache size 0 max 16384 2024-09-19T06:21:19.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.284+0000 7f0a6d1b1740 1 Processor -- start 2024-09-19T06:21:19.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.284+0000 7f0a6d1b1740 1 -- start start 2024-09-19T06:21:19.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.285+0000 7f0a6d1b1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f5a9e65d0 0x558f5aa01540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:19.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.285+0000 7f0a6d1b1740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f5a9e7b40 0x558f5a9f1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:19.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.285+0000 7f0a6d1b1740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f5a9f5780 0x558f5a9f2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:19.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.285+0000 7f0a6d1b1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0a641ade10 con 0x558f5a9e65d0 2024-09-19T06:21:19.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.285+0000 7f0a6d1b1740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0a641ab6e0 con 0x558f5a9f5780 2024-09-19T06:21:19.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.285+0000 7f0a6d1b1740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0a641a9550 con 0x558f5a9e7b40 2024-09-19T06:21:19.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.285+0000 7f0a68b74640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f5a9e65d0 0x558f5aa01540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:19.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.285+0000 7f0a68b74640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f5a9e65d0 0x558f5aa01540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36700/0 (socket says 172.21.15.2:36700) 2024-09-19T06:21:19.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.285+0000 7f0a68b74640 1 -- 172.21.15.2:0/4049360715 learned_addr learned my addr 172.21.15.2:0/4049360715 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:19.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.285+0000 7f0a63fff640 1 --2- 172.21.15.2:0/4049360715 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f5a9e7b40 0x558f5a9f1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:19.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.285+0000 7f0a68b74640 1 -- 172.21.15.2:0/4049360715 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f5a9e7b40 msgr2=0x558f5a9f1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:19.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.285+0000 7f0a68b74640 1 --2- 172.21.15.2:0/4049360715 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f5a9e7b40 0x558f5a9f1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:19.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.285+0000 7f0a68b74640 1 -- 172.21.15.2:0/4049360715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f5a9f5780 msgr2=0x558f5a9f2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:19.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.285+0000 7f0a68b74640 1 --2- 172.21.15.2:0/4049360715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f5a9f5780 0x558f5a9f2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:19.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.285+0000 7f0a68b74640 1 -- 172.21.15.2:0/4049360715 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f5aa01a80 con 0x558f5a9e65d0 2024-09-19T06:21:19.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.285+0000 7f0a63fff640 1 --2- 172.21.15.2:0/4049360715 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f5a9e7b40 0x558f5a9f1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:19.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.285+0000 7f0a68b74640 1 --2- 172.21.15.2:0/4049360715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f5a9e65d0 0x558f5aa01540 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f0a58000c00 tx=0x7f0a5800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef23e17b7cc527a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:19.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.285+0000 7f0a4e7fc640 1 -- 172.21.15.2:0/4049360715 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a58003ea0 con 0x558f5a9e65d0 2024-09-19T06:21:19.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.286+0000 7f0a4e7fc640 1 -- 172.21.15.2:0/4049360715 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0a580054d0 con 0x558f5a9e65d0 2024-09-19T06:21:19.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.286+0000 7f0a4e7fc640 1 -- 172.21.15.2:0/4049360715 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a580266c0 con 0x558f5a9e65d0 2024-09-19T06:21:19.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.286+0000 7f0a6d1b1740 1 -- 172.21.15.2:0/4049360715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f5a9e65d0 msgr2=0x558f5aa01540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:19.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.286+0000 7f0a6d1b1740 1 --2- 172.21.15.2:0/4049360715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f5a9e65d0 0x558f5aa01540 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f0a58000c00 tx=0x7f0a5800b390 comp rx=0 tx=0).stop 2024-09-19T06:21:19.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.286+0000 7f0a6d1b1740 1 -- 172.21.15.2:0/4049360715 shutdown_connections 2024-09-19T06:21:19.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.286+0000 7f0a6d1b1740 1 --2- 172.21.15.2:0/4049360715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f5a9f5780 0x558f5a9f2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:19.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.286+0000 7f0a6d1b1740 1 --2- 172.21.15.2:0/4049360715 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f5a9e7b40 0x558f5a9f1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:19.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.286+0000 7f0a6d1b1740 1 --2- 172.21.15.2:0/4049360715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f5a9e65d0 0x558f5aa01540 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:19.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.286+0000 7f0a6d1b1740 1 -- 172.21.15.2:0/4049360715 >> 172.21.15.2:0/4049360715 conn(0x558f5a9af310 msgr2=0x558f5a9f4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:19.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.286+0000 7f0a6d1b1740 1 -- 172.21.15.2:0/4049360715 shutdown_connections 2024-09-19T06:21:19.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.286+0000 7f0a6d1b1740 1 -- 172.21.15.2:0/4049360715 wait complete. 2024-09-19T06:21:19.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.286+0000 7f0a6d1b1740 1 -- start start 2024-09-19T06:21:19.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.287+0000 7f0a6d1b1740 1 Processor -- start 2024-09-19T06:21:19.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.287+0000 7f0a6d1b1740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f5a9e65d0 0x558f5a9fdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:19.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.287+0000 7f0a6d1b1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f5a9e7b40 0x558f5a9f8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:19.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.287+0000 7f0a6d1b1740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f5a9f5780 0x558f5a9f9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:19.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.287+0000 7f0a6d1b1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0a641a9ba0 con 0x558f5a9e7b40 2024-09-19T06:21:19.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.287+0000 7f0a6d1b1740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0a641ab010 con 0x558f5a9e65d0 2024-09-19T06:21:19.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.287+0000 7f0a6d1b1740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0a641aa270 con 0x558f5a9f5780 2024-09-19T06:21:19.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.287+0000 7f0a6d1b1740 10 client.0 _ll_register_callbacks cb 0x7f0a5800b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:19.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.287+0000 7f0a63fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f5a9e7b40 0x558f5a9f8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:19.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.287+0000 7f0a63fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f5a9e7b40 0x558f5a9f8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36714/0 (socket says 172.21.15.2:36714) 2024-09-19T06:21:19.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.287+0000 7f0a63fff640 1 -- 172.21.15.2:0/2477720273 learned_addr learned my addr 172.21.15.2:0/2477720273 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:19.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.287+0000 7f0a68b74640 1 --2- 172.21.15.2:0/2477720273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f5a9e65d0 0x558f5a9fdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:19.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.287+0000 7f0a69375640 1 --2- 172.21.15.2:0/2477720273 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f5a9f5780 0x558f5a9f9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:19.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.288+0000 7f0a63fff640 1 -- 172.21.15.2:0/2477720273 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f5a9f5780 msgr2=0x558f5a9f9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:19.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.288+0000 7f0a63fff640 1 --2- 172.21.15.2:0/2477720273 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f5a9f5780 0x558f5a9f9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:19.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.288+0000 7f0a63fff640 1 -- 172.21.15.2:0/2477720273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f5a9e65d0 msgr2=0x558f5a9fdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:19.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.288+0000 7f0a63fff640 1 --2- 172.21.15.2:0/2477720273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f5a9e65d0 0x558f5a9fdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:19.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.288+0000 7f0a63fff640 1 -- 172.21.15.2:0/2477720273 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f5a9f9a50 con 0x558f5a9e7b40 2024-09-19T06:21:19.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.288+0000 7f0a69375640 1 --2- 172.21.15.2:0/2477720273 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f5a9f5780 0x558f5a9f9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:21:19.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.288+0000 7f0a63fff640 1 --2- 172.21.15.2:0/2477720273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f5a9e7b40 0x558f5a9f8f50 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f0a500cd330 tx=0x7f0a500974f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae1ae56c972f96a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:19.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.288+0000 7f0a43fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:19.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.288+0000 7f0a43fff640 1 -- 172.21.15.2:0/2477720273 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a50020040 con 0x558f5a9e7b40 2024-09-19T06:21:19.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.288+0000 7f0a43fff640 1 -- 172.21.15.2:0/2477720273 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f0a500a40a0 con 0x558f5a9e7b40 2024-09-19T06:21:19.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.288+0000 7f0a6d1b1740 1 -- 172.21.15.2:0/2477720273 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a580054d0 con 0x558f5a9e7b40 2024-09-19T06:21:19.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.288+0000 7f0a43fff640 1 -- 172.21.15.2:0/2477720273 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0a50009c30 con 0x558f5a9e7b40 2024-09-19T06:21:19.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.288+0000 7f0a6d1b1740 10 client.17358 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:19.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.288+0000 7f0a6d1b1740 1 -- 172.21.15.2:0/2477720273 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x558f5aa6f9f0 con 0x558f5a9e7b40 2024-09-19T06:21:19.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.288+0000 7f0a43fff640 1 -- 172.21.15.2:0/2477720273 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0a580054d0 con 0x558f5a9e7b40 2024-09-19T06:21:19.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.289+0000 7f0a43fff640 1 -- 172.21.15.2:0/2477720273 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f0a500976c0 con 0x558f5a9e7b40 2024-09-19T06:21:19.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.289+0000 7f0a6d1b1740 10 client.17358 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:19.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.289+0000 7f0a6d1b1740 10 client.17358 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:19.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.289+0000 7f0a6d1b1740 20 client.17358 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:19.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.289+0000 7f0a6d1b1740 1 --2- 172.21.15.2:0/2477720273 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558f5aa04f50 0x558f5aa72230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.289+0000 7f0a6d1b1740 4 client.17358 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:21:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.289+0000 7f0a6d1b1740 1 -- 172.21.15.2:0/2477720273 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558f5a953d70 con 0x558f5aa04f50 2024-09-19T06:21:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.289+0000 7f0a68b74640 1 --2- 172.21.15.2:0/2477720273 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558f5aa04f50 0x558f5aa72230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.289+0000 7f0a68b74640 1 --2- 172.21.15.2:0/2477720273 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558f5aa04f50 0x558f5aa72230 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b72ae885e770d3c server_cookie=1dddbedb1ac3de3d in_seq=0 out_seq=0 2024-09-19T06:21:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.289+0000 7f0a43fff640 10 client.17358 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.289+0000 7f0a43fff640 1 -- 172.21.15.2:0/2477720273 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558f5a953d70 con 0x558f5aa04f50 2024-09-19T06:21:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.289+0000 7f0a43fff640 10 client.17358 handle_command_reply: tid=0 2024-09-19T06:21:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.289+0000 7f0a6d1b1740 1 client.17358 shutdown 2024-09-19T06:21:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.290+0000 7f0a6d1b1740 1 -- 172.21.15.2:0/2477720273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f5a9e7b40 msgr2=0x558f5a9f8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.290+0000 7f0a6d1b1740 1 --2- 172.21.15.2:0/2477720273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f5a9e7b40 0x558f5a9f8f50 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f0a500cd330 tx=0x7f0a500974f0 comp rx=0 tx=0).stop 2024-09-19T06:21:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.290+0000 7f0a6d1b1740 1 -- 172.21.15.2:0/2477720273 shutdown_connections 2024-09-19T06:21:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.290+0000 7f0a6d1b1740 1 --2- 172.21.15.2:0/2477720273 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f5a9f5780 0x558f5a9f9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.290+0000 7f0a6d1b1740 1 --2- 172.21.15.2:0/2477720273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f5a9e7b40 0x558f5a9f8f50 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:19.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.290+0000 7f0a6d1b1740 1 --2- 172.21.15.2:0/2477720273 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558f5aa04f50 0x558f5aa72230 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:19.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.290+0000 7f0a6d1b1740 1 --2- 172.21.15.2:0/2477720273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f5a9e65d0 0x558f5a9fdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:19.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.290+0000 7f0a6d1b1740 1 -- 172.21.15.2:0/2477720273 >> 172.21.15.2:0/2477720273 conn(0x558f5a9af310 msgr2=0x558f5a9e8110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:19.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.290+0000 7f0a43fff640 0 client.17358 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:19.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.290+0000 7f0a6d1b1740 1 -- 172.21.15.2:0/2477720273 shutdown_connections 2024-09-19T06:21:19.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.290+0000 7f0a6d1b1740 1 -- 172.21.15.2:0/2477720273 wait complete. 2024-09-19T06:21:19.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.290+0000 7f0a6d1b1740 20 client.17358 trim_cache size 0 max 16384 2024-09-19T06:21:19.297 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:21:19.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.291+0000 7f0a6add8640 1 -- 172.21.15.2:0/4035197856 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f0a540a3430 msgr2=0x7f0a540a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:19.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.291+0000 7f0a6add8640 1 --2- 172.21.15.2:0/4035197856 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f0a540a3430 0x7f0a540a58f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c004ad0 tx=0x7f0a5c03b000 comp rx=0 tx=0).stop 2024-09-19T06:21:19.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.291+0000 7f0a6add8640 1 -- 172.21.15.2:0/4035197856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a64102790 msgr2=0x7f0a64198830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:19.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.291+0000 7f0a6add8640 1 --2- 172.21.15.2:0/4035197856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a64102790 0x7f0a64198830 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f0a5000d770 tx=0x7f0a5000dc30 comp rx=0 tx=0).stop 2024-09-19T06:21:19.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.291+0000 7f0a6add8640 1 -- 172.21.15.2:0/4035197856 shutdown_connections 2024-09-19T06:21:19.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.291+0000 7f0a6add8640 1 --2- 172.21.15.2:0/4035197856 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f0a540a3430 0x7f0a540a58f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:19.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.291+0000 7f0a6add8640 1 --2- 172.21.15.2:0/4035197856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a64106f10 0x7f0a6419cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:19.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.291+0000 7f0a6add8640 1 --2- 172.21.15.2:0/4035197856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a64102790 0x7f0a64198830 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:19.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.291+0000 7f0a6add8640 1 --2- 172.21.15.2:0/4035197856 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a64101de0 0x7f0a641982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.291+0000 7f0a6add8640 1 -- 172.21.15.2:0/4035197856 >> 172.21.15.2:0/4035197856 conn(0x7f0a640fd8c0 msgr2=0x7f0a640fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.291+0000 7f0a6add8640 1 -- 172.21.15.2:0/4035197856 shutdown_connections 2024-09-19T06:21:19.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:19.291+0000 7f0a6add8640 1 -- 172.21.15.2:0/4035197856 wait complete. 2024-09-19T06:21:19.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:19 smithi090 ceph-mon[34497]: pgmap v200: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-19T06:21:19.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:19 smithi089 ceph-mon[34160]: pgmap v200: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-19T06:21:21.012 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:21:21.013 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:21:21.283 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:21.404 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:21 smithi002 ceph-mon[30982]: pgmap v201: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-19T06:21:21.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:21 smithi089 ceph-mon[34160]: pgmap v201: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-19T06:21:21.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:21 smithi090 ceph-mon[34497]: pgmap v201: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-19T06:21:21.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.762+0000 7fe2c12dc640 1 -- 172.21.15.2:0/2961381888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2bc101440 msgr2=0x7fe2bc10df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:21.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.762+0000 7fe2c12dc640 1 --2- 172.21.15.2:0/2961381888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2bc101440 0x7fe2bc10df30 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0009900 tx=0x7fe2b002a410 comp rx=0 tx=0).stop 2024-09-19T06:21:21.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.762+0000 7fe2c12dc640 1 -- 172.21.15.2:0/2961381888 shutdown_connections 2024-09-19T06:21:21.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.762+0000 7fe2c12dc640 1 --2- 172.21.15.2:0/2961381888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2bc10e500 0x7fe2bc110910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:21.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.762+0000 7fe2c12dc640 1 --2- 172.21.15.2:0/2961381888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2bc101440 0x7fe2bc10df30 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:21.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.762+0000 7fe2c12dc640 1 --2- 172.21.15.2:0/2961381888 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe2bc100b20 0x7fe2bc100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:21.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.762+0000 7fe2c12dc640 1 -- 172.21.15.2:0/2961381888 >> 172.21.15.2:0/2961381888 conn(0x7fe2bc0fc7d0 msgr2=0x7fe2bc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:21.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.762+0000 7fe2c12dc640 1 -- 172.21.15.2:0/2961381888 shutdown_connections 2024-09-19T06:21:21.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.762+0000 7fe2c12dc640 1 -- 172.21.15.2:0/2961381888 wait complete. 2024-09-19T06:21:21.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.762+0000 7fe2c12dc640 1 Processor -- start 2024-09-19T06:21:21.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.762+0000 7fe2c12dc640 1 -- start start 2024-09-19T06:21:21.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.763+0000 7fe2c12dc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2bc100b20 0x7fe2bc19a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:21.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.763+0000 7fe2c12dc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe2bc101440 0x7fe2bc19ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:21.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.763+0000 7fe2c12dc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2bc10e500 0x7fe2bc19ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:21.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.763+0000 7fe2c12dc640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe2bc114100 con 0x7fe2bc10e500 2024-09-19T06:21:21.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.763+0000 7fe2c12dc640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe2bc113f80 con 0x7fe2bc100b20 2024-09-19T06:21:21.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.763+0000 7fe2c12dc640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe2bc114280 con 0x7fe2bc101440 2024-09-19T06:21:21.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.763+0000 7fe2bb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2bc10e500 0x7fe2bc19ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:21.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.763+0000 7fe2bb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2bc10e500 0x7fe2bc19ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36732/0 (socket says 172.21.15.2:36732) 2024-09-19T06:21:21.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.763+0000 7fe2bb7fe640 1 -- 172.21.15.2:0/2295064280 learned_addr learned my addr 172.21.15.2:0/2295064280 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:21.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.763+0000 7fe2ba7fc640 1 --2- 172.21.15.2:0/2295064280 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe2bc101440 0x7fe2bc19ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:21.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.763+0000 7fe2baffd640 1 --2- 172.21.15.2:0/2295064280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2bc100b20 0x7fe2bc19a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:21.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.763+0000 7fe2bb7fe640 1 -- 172.21.15.2:0/2295064280 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe2bc101440 msgr2=0x7fe2bc19ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:21.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.763+0000 7fe2bb7fe640 1 --2- 172.21.15.2:0/2295064280 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe2bc101440 0x7fe2bc19ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:21.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.763+0000 7fe2bb7fe640 1 -- 172.21.15.2:0/2295064280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2bc100b20 msgr2=0x7fe2bc19a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:21.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.763+0000 7fe2bb7fe640 1 --2- 172.21.15.2:0/2295064280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2bc100b20 0x7fe2bc19a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:21.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.763+0000 7fe2bb7fe640 1 -- 172.21.15.2:0/2295064280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2bc19f670 con 0x7fe2bc10e500 2024-09-19T06:21:21.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.763+0000 7fe2baffd640 1 --2- 172.21.15.2:0/2295064280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2bc100b20 0x7fe2bc19a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:21.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.763+0000 7fe2bb7fe640 1 --2- 172.21.15.2:0/2295064280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2bc10e500 0x7fe2bc19ef90 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fe2b400e9d0 tx=0x7fe2b400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:21.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.764+0000 7fe2a3fff640 1 -- 172.21.15.2:0/2295064280 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b400cd80 con 0x7fe2bc10e500 2024-09-19T06:21:21.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.764+0000 7fe2c12dc640 1 -- 172.21.15.2:0/2295064280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2bc19f960 con 0x7fe2bc10e500 2024-09-19T06:21:21.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.764+0000 7fe2a3fff640 1 -- 172.21.15.2:0/2295064280 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe2b4005020 con 0x7fe2bc10e500 2024-09-19T06:21:21.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.764+0000 7fe2a3fff640 1 -- 172.21.15.2:0/2295064280 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b40116d0 con 0x7fe2bc10e500 2024-09-19T06:21:21.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.764+0000 7fe2c12dc640 1 -- 172.21.15.2:0/2295064280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2bc1a7240 con 0x7fe2bc10e500 2024-09-19T06:21:21.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.767+0000 7fe2a3fff640 1 -- 172.21.15.2:0/2295064280 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fe2b40051d0 con 0x7fe2bc10e500 2024-09-19T06:21:21.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.767+0000 7fe2c36b5740 1 Processor -- start 2024-09-19T06:21:21.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.767+0000 7fe2c36b5740 1 -- start start 2024-09-19T06:21:21.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.767+0000 7fe2c36b5740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567dd0abb60 0x5567dd0abf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:21.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.767+0000 7fe2c36b5740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5567dd0ac480 0x5567dd0b6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:21.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.767+0000 7fe2c36b5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567dd0b6d40 0x5567dd0b9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:21.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.767+0000 7fe2c36b5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5567dd011280 con 0x5567dd0b6d40 2024-09-19T06:21:21.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.767+0000 7fe2c36b5740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5567dcfb8b10 con 0x5567dd0abb60 2024-09-19T06:21:21.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.767+0000 7fe2c36b5740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5567dd00d240 con 0x5567dd0ac480 2024-09-19T06:21:21.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.767+0000 7fe2ba7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567dd0b6d40 0x5567dd0b9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:21.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.767+0000 7fe2ba7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567dd0b6d40 0x5567dd0b9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36746/0 (socket says 172.21.15.2:36746) 2024-09-19T06:21:21.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.767+0000 7fe2ba7fc640 1 -- 172.21.15.2:0/3812996431 learned_addr learned my addr 172.21.15.2:0/3812996431 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:21.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.767+0000 7fe2baffd640 1 --2- 172.21.15.2:0/3812996431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5567dd0ac480 0x5567dd0b6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:21.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.768+0000 7fe2ba7fc640 1 --2- 172.21.15.2:0/3812996431 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567dd0abb60 0x5567dd0abf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:21.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.768+0000 7fe2ba7fc640 1 -- 172.21.15.2:0/3812996431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5567dd0ac480 msgr2=0x5567dd0b6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:21.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.768+0000 7fe2ba7fc640 1 --2- 172.21.15.2:0/3812996431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5567dd0ac480 0x5567dd0b6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:21.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.768+0000 7fe2ba7fc640 1 -- 172.21.15.2:0/3812996431 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567dd0abb60 msgr2=0x5567dd0abf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:21.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.768+0000 7fe2ba7fc640 1 --2- 172.21.15.2:0/3812996431 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567dd0abb60 0x5567dd0abf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:21.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.768+0000 7fe2ba7fc640 1 -- 172.21.15.2:0/3812996431 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567dcfc51f0 con 0x5567dd0b6d40 2024-09-19T06:21:21.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.768+0000 7fe2a3fff640 1 --2- 172.21.15.2:0/2295064280 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe2a40a33b0 0x7fe2a40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:21.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.768+0000 7fe2ba7fc640 1 --2- 172.21.15.2:0/3812996431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567dd0b6d40 0x5567dd0b9130 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc06a140 tx=0x7fe2b0005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9bab4e81ac2505 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:21.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.768+0000 7fe2baffd640 1 --2- 172.21.15.2:0/2295064280 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe2a40a33b0 0x7fe2a40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:21.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.768+0000 7fe2a17fa640 1 -- 172.21.15.2:0/3812996431 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b0035070 con 0x5567dd0b6d40 2024-09-19T06:21:21.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.768+0000 7fe2a3fff640 1 -- 172.21.15.2:0/2295064280 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7fe2b40cfed0 con 0x7fe2bc10e500 2024-09-19T06:21:21.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.768+0000 7fe2a17fa640 1 -- 172.21.15.2:0/3812996431 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe2b0004030 con 0x5567dd0b6d40 2024-09-19T06:21:21.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.768+0000 7fe2a17fa640 1 -- 172.21.15.2:0/3812996431 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b0003b90 con 0x5567dd0b6d40 2024-09-19T06:21:21.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.769+0000 7fe2c36b5740 1 -- 172.21.15.2:0/3812996431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567dd0b6d40 msgr2=0x5567dd0b9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:21.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.769+0000 7fe2c36b5740 1 --2- 172.21.15.2:0/3812996431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567dd0b6d40 0x5567dd0b9130 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc06a140 tx=0x7fe2b0005780 comp rx=0 tx=0).stop 2024-09-19T06:21:21.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.769+0000 7fe2baffd640 1 --2- 172.21.15.2:0/2295064280 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe2a40a33b0 0x7fe2a40a5870 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x5567dd0a8f50 tx=0x7fe2ac00c3b0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:21.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.769+0000 7fe2c36b5740 1 -- 172.21.15.2:0/3812996431 shutdown_connections 2024-09-19T06:21:21.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.769+0000 7fe2c36b5740 1 --2- 172.21.15.2:0/3812996431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567dd0b6d40 0x5567dd0b9130 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:21.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.769+0000 7fe2c36b5740 1 --2- 172.21.15.2:0/3812996431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5567dd0ac480 0x5567dd0b6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:21.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.769+0000 7fe2c36b5740 1 --2- 172.21.15.2:0/3812996431 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567dd0abb60 0x5567dd0abf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:21.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.769+0000 7fe2c36b5740 1 -- 172.21.15.2:0/3812996431 >> 172.21.15.2:0/3812996431 conn(0x5567dd0a80f0 msgr2=0x5567dd0a84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:21.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.769+0000 7fe2c36b5740 1 -- 172.21.15.2:0/3812996431 shutdown_connections 2024-09-19T06:21:21.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.769+0000 7fe2c36b5740 1 -- 172.21.15.2:0/3812996431 wait complete. 2024-09-19T06:21:21.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.769+0000 7fe2c36b5740 1 -- start start 2024-09-19T06:21:21.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.769+0000 7fe2c36b5740 1 Processor -- start 2024-09-19T06:21:21.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.770+0000 7fe2c36b5740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5567dd0abb60 0x5567dd0b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:21.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.770+0000 7fe2c36b5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567dd0ac480 0x5567dd0b4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:21.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.770+0000 7fe2c36b5740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567dd0b6d40 0x5567dd0b46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:21.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.770+0000 7fe2c36b5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5567dd0b9910 con 0x5567dd0ac480 2024-09-19T06:21:21.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.770+0000 7fe2c36b5740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5567dcfcbf10 con 0x5567dd0b6d40 2024-09-19T06:21:21.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.770+0000 7fe2c36b5740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5567dd0b9a90 con 0x5567dd0abb60 2024-09-19T06:21:21.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.770+0000 7fe2c36b5740 10 client.0 _ll_register_callbacks cb 0x5567dcf94a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:21.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.770+0000 7fe2ba7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567dd0ac480 0x5567dd0b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:21.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.770+0000 7fe2ba7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567dd0ac480 0x5567dd0b4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36762/0 (socket says 172.21.15.2:36762) 2024-09-19T06:21:21.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.770+0000 7fe2ba7fc640 1 -- 172.21.15.2:0/3713910200 learned_addr learned my addr 172.21.15.2:0/3713910200 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:21.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.770+0000 7fe2baffd640 1 --2- 172.21.15.2:0/3713910200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5567dd0abb60 0x5567dd0b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:21.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.770+0000 7fe2bb7fe640 1 --2- 172.21.15.2:0/3713910200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567dd0b6d40 0x5567dd0b46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:21.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.770+0000 7fe2ba7fc640 1 -- 172.21.15.2:0/3713910200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5567dd0abb60 msgr2=0x5567dd0b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:21.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.770+0000 7fe2ba7fc640 1 --2- 172.21.15.2:0/3713910200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5567dd0abb60 0x5567dd0b3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:21.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.770+0000 7fe2ba7fc640 1 -- 172.21.15.2:0/3713910200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567dd0b6d40 msgr2=0x5567dd0b46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:21.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.770+0000 7fe2ba7fc640 1 --2- 172.21.15.2:0/3713910200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567dd0b6d40 0x5567dd0b46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:21.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.770+0000 7fe2ba7fc640 1 -- 172.21.15.2:0/3713910200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567dcd826a0 con 0x5567dd0ac480 2024-09-19T06:21:21.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.770+0000 7fe2bb7fe640 1 --2- 172.21.15.2:0/3713910200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567dd0b6d40 0x5567dd0b46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:21:21.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.770+0000 7fe2ba7fc640 1 --2- 172.21.15.2:0/3713910200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567dd0ac480 0x5567dd0b4180 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0000c00 tx=0x7fe2b0004490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1035ed7ec81ef5fe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:21.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.770+0000 7fe29eff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:21.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.770+0000 7fe29eff5640 1 -- 172.21.15.2:0/3713910200 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b0035070 con 0x5567dd0ac480 2024-09-19T06:21:21.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.770+0000 7fe29eff5640 1 -- 172.21.15.2:0/3713910200 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7fe2b0005070 con 0x5567dd0ac480 2024-09-19T06:21:21.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.770+0000 7fe2c36b5740 1 -- 172.21.15.2:0/3713910200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2b0004030 con 0x5567dd0ac480 2024-09-19T06:21:21.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.771+0000 7fe29eff5640 1 -- 172.21.15.2:0/3713910200 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe2b005a050 con 0x5567dd0ac480 2024-09-19T06:21:21.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.771+0000 7fe2c36b5740 10 client.17370 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:21.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.771+0000 7fe2c36b5740 1 -- 172.21.15.2:0/3713910200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5567dd0c5540 con 0x5567dd0ac480 2024-09-19T06:21:21.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.771+0000 7fe29eff5640 1 -- 172.21.15.2:0/3713910200 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe2b0004030 con 0x5567dd0ac480 2024-09-19T06:21:21.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.771+0000 7fe29eff5640 1 -- 172.21.15.2:0/3713910200 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fe2b00046c0 con 0x5567dd0ac480 2024-09-19T06:21:21.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.771+0000 7fe2c36b5740 10 client.17370 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:21.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.771+0000 7fe2c36b5740 10 client.17370 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:21.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.771+0000 7fe2c36b5740 20 client.17370 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:21.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.771+0000 7fe2c36b5740 1 --2- 172.21.15.2:0/3713910200 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5567dd0c6890 0x5567dd0c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:21.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.771+0000 7fe2c36b5740 4 client.17370 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:21.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.771+0000 7fe2c36b5740 1 -- 172.21.15.2:0/3713910200 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5567dd01e7f0 con 0x5567dd0c6890 2024-09-19T06:21:21.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.771+0000 7fe2baffd640 1 --2- 172.21.15.2:0/3713910200 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5567dd0c6890 0x5567dd0c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:21.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.772+0000 7fe2baffd640 1 --2- 172.21.15.2:0/3713910200 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5567dd0c6890 0x5567dd0c8c80 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba608987c64b25ae server_cookie=d307c2f5f905a610 in_seq=0 out_seq=0 2024-09-19T06:21:21.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.772+0000 7fe29eff5640 10 client.17370 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:21.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.773+0000 7fe29eff5640 1 -- 172.21.15.2:0/3713910200 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5567dd01e7f0 con 0x5567dd0c6890 2024-09-19T06:21:21.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.773+0000 7fe29eff5640 10 client.17370 handle_command_reply: tid=0 2024-09-19T06:21:21.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.773+0000 7fe2c36b5740 1 client.17370 shutdown 2024-09-19T06:21:21.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.773+0000 7fe2c36b5740 1 -- 172.21.15.2:0/3713910200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567dd0ac480 msgr2=0x5567dd0b4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:21.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.773+0000 7fe2c36b5740 1 --2- 172.21.15.2:0/3713910200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567dd0ac480 0x5567dd0b4180 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0000c00 tx=0x7fe2b0004490 comp rx=0 tx=0).stop 2024-09-19T06:21:21.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.773+0000 7fe2c36b5740 1 -- 172.21.15.2:0/3713910200 shutdown_connections 2024-09-19T06:21:21.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.773+0000 7fe2c36b5740 1 --2- 172.21.15.2:0/3713910200 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5567dd0c6890 0x5567dd0c8c80 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:21.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.773+0000 7fe2c36b5740 1 --2- 172.21.15.2:0/3713910200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567dd0b6d40 0x5567dd0b46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:21.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.773+0000 7fe2c36b5740 1 --2- 172.21.15.2:0/3713910200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567dd0ac480 0x5567dd0b4180 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:21.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.773+0000 7fe29eff5640 0 client.17370 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:21.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.773+0000 7fe2c36b5740 1 --2- 172.21.15.2:0/3713910200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5567dd0abb60 0x5567dd0b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:21.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.773+0000 7fe2c36b5740 1 -- 172.21.15.2:0/3713910200 >> 172.21.15.2:0/3713910200 conn(0x5567dd0a80f0 msgr2=0x5567dd0addd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:21.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.773+0000 7fe2c36b5740 1 -- 172.21.15.2:0/3713910200 shutdown_connections 2024-09-19T06:21:21.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.773+0000 7fe2c36b5740 1 -- 172.21.15.2:0/3713910200 wait complete. 2024-09-19T06:21:21.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.773+0000 7fe2c36b5740 20 client.17370 trim_cache size 0 max 16384 2024-09-19T06:21:21.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.791+0000 7fe2c36b5740 1 Processor -- start 2024-09-19T06:21:21.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.791+0000 7fe2c36b5740 1 -- start start 2024-09-19T06:21:21.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.791+0000 7fe2c36b5740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5567dd0abb60 0x5567dd0b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:21.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.791+0000 7fe2c36b5740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567dd0ac480 0x5567dd0b4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:21.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.791+0000 7fe2c36b5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567dd0b6d40 0x5567dd0ce280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:21.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.791+0000 7fe2c36b5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe2bc1b2240 con 0x5567dd0b6d40 2024-09-19T06:21:21.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.791+0000 7fe2c36b5740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe2bc1afb10 con 0x5567dd0ac480 2024-09-19T06:21:21.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.791+0000 7fe2c36b5740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe2bc1ad980 con 0x5567dd0abb60 2024-09-19T06:21:21.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.791+0000 7fe2bb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567dd0b6d40 0x5567dd0ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:21.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.791+0000 7fe2bb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567dd0b6d40 0x5567dd0ce280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36764/0 (socket says 172.21.15.2:36764) 2024-09-19T06:21:21.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.791+0000 7fe2bb7fe640 1 -- 172.21.15.2:0/2404769209 learned_addr learned my addr 172.21.15.2:0/2404769209 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:21.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.791+0000 7fe2baffd640 1 --2- 172.21.15.2:0/2404769209 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5567dd0abb60 0x5567dd0b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:21.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.791+0000 7fe2ba7fc640 1 --2- 172.21.15.2:0/2404769209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567dd0ac480 0x5567dd0b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:21.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.791+0000 7fe2bb7fe640 1 -- 172.21.15.2:0/2404769209 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5567dd0abb60 msgr2=0x5567dd0b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:21.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.791+0000 7fe2bb7fe640 1 --2- 172.21.15.2:0/2404769209 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5567dd0abb60 0x5567dd0b5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:21.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.791+0000 7fe2bb7fe640 1 -- 172.21.15.2:0/2404769209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567dd0ac480 msgr2=0x5567dd0b4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:21.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.791+0000 7fe2bb7fe640 1 --2- 172.21.15.2:0/2404769209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567dd0ac480 0x5567dd0b4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:21.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.791+0000 7fe2bb7fe640 1 -- 172.21.15.2:0/2404769209 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567dd0ab8e0 con 0x5567dd0b6d40 2024-09-19T06:21:21.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.791+0000 7fe2ba7fc640 1 --2- 172.21.15.2:0/2404769209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567dd0ac480 0x5567dd0b4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:21:21.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.792+0000 7fe2bb7fe640 1 --2- 172.21.15.2:0/2404769209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567dd0b6d40 0x5567dd0ce280 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4098b80 tx=0x7fe2b409be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68d1a97a965660ac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:21.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.792+0000 7fe2a0ff9640 1 -- 172.21.15.2:0/2404769209 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b40b5070 con 0x5567dd0b6d40 2024-09-19T06:21:21.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.792+0000 7fe2a0ff9640 1 -- 172.21.15.2:0/2404769209 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe2b40a4e20 con 0x5567dd0b6d40 2024-09-19T06:21:21.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.792+0000 7fe2a0ff9640 1 -- 172.21.15.2:0/2404769209 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b401f050 con 0x5567dd0b6d40 2024-09-19T06:21:21.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.792+0000 7fe2c36b5740 1 -- 172.21.15.2:0/2404769209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567dd0b6d40 msgr2=0x5567dd0ce280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:21.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.792+0000 7fe2c36b5740 1 --2- 172.21.15.2:0/2404769209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567dd0b6d40 0x5567dd0ce280 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4098b80 tx=0x7fe2b409be20 comp rx=0 tx=0).stop 2024-09-19T06:21:21.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.792+0000 7fe2c36b5740 1 -- 172.21.15.2:0/2404769209 shutdown_connections 2024-09-19T06:21:21.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.792+0000 7fe2c36b5740 1 --2- 172.21.15.2:0/2404769209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567dd0b6d40 0x5567dd0ce280 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:21.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.792+0000 7fe2c36b5740 1 --2- 172.21.15.2:0/2404769209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567dd0ac480 0x5567dd0b4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:21.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.792+0000 7fe2c36b5740 1 --2- 172.21.15.2:0/2404769209 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5567dd0abb60 0x5567dd0b5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:21.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.792+0000 7fe2c36b5740 1 -- 172.21.15.2:0/2404769209 >> 172.21.15.2:0/2404769209 conn(0x5567dd0a80f0 msgr2=0x5567dd0b2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:21.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.793+0000 7fe2c36b5740 1 -- 172.21.15.2:0/2404769209 shutdown_connections 2024-09-19T06:21:21.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.793+0000 7fe2c36b5740 1 -- 172.21.15.2:0/2404769209 wait complete. 2024-09-19T06:21:21.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.793+0000 7fe2c36b5740 1 -- start start 2024-09-19T06:21:21.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.793+0000 7fe2c36b5740 1 Processor -- start 2024-09-19T06:21:21.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.793+0000 7fe2c36b5740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567dd0abb60 0x5567dd0bb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:21.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.793+0000 7fe2c36b5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567dd0ac480 0x5567dd0bb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:21.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.793+0000 7fe2c36b5740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5567dd0b6d40 0x5567dd130250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:21.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.793+0000 7fe2c36b5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe2bc1adfd0 con 0x5567dd0ac480 2024-09-19T06:21:21.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.793+0000 7fe2c36b5740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe2bc1af440 con 0x5567dd0abb60 2024-09-19T06:21:21.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.793+0000 7fe2c36b5740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe2bc1ae6a0 con 0x5567dd0b6d40 2024-09-19T06:21:21.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.793+0000 7fe2c36b5740 10 client.0 _ll_register_callbacks cb 0x7fe2b0032ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:21.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.793+0000 7fe2baffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567dd0abb60 0x5567dd0bb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:21.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.794+0000 7fe2baffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567dd0abb60 0x5567dd0bb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:58834/0 (socket says 172.21.15.2:58834) 2024-09-19T06:21:21.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.794+0000 7fe2baffd640 1 -- 172.21.15.2:0/780409995 learned_addr learned my addr 172.21.15.2:0/780409995 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:21.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.794+0000 7fe2bb7fe640 1 --2- 172.21.15.2:0/780409995 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5567dd0b6d40 0x5567dd130250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:21.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.794+0000 7fe2ba7fc640 1 --2- 172.21.15.2:0/780409995 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567dd0ac480 0x5567dd0bb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:21.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.794+0000 7fe2baffd640 1 -- 172.21.15.2:0/780409995 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5567dd0b6d40 msgr2=0x5567dd130250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:21.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.794+0000 7fe2baffd640 1 --2- 172.21.15.2:0/780409995 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5567dd0b6d40 0x5567dd130250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:21.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.794+0000 7fe2baffd640 1 -- 172.21.15.2:0/780409995 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567dd0ac480 msgr2=0x5567dd0bb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:21.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.794+0000 7fe2baffd640 1 --2- 172.21.15.2:0/780409995 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567dd0ac480 0x5567dd0bb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:21.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.794+0000 7fe2baffd640 1 -- 172.21.15.2:0/780409995 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567dd1307c0 con 0x5567dd0abb60 2024-09-19T06:21:21.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.794+0000 7fe2bb7fe640 1 --2- 172.21.15.2:0/780409995 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5567dd0b6d40 0x5567dd130250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:21:21.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.794+0000 7fe2ba7fc640 1 --2- 172.21.15.2:0/780409995 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567dd0ac480 0x5567dd0bb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:21:21.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.794+0000 7fe2baffd640 1 --2- 172.21.15.2:0/780409995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567dd0abb60 0x5567dd0bb190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00cad0 tx=0x7fe2ac0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9703a8208619a157 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:21.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.794+0000 7fe29eff5640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-09-19T06:21:21.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.794+0000 7fe29eff5640 1 -- 172.21.15.2:0/780409995 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac01ec80 con 0x5567dd0abb60 2024-09-19T06:21:21.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.794+0000 7fe29eff5640 1 -- 172.21.15.2:0/780409995 <== mon.2 v2:172.21.15.89:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7fe2ac027250 con 0x5567dd0abb60 2024-09-19T06:21:21.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.794+0000 7fe2c36b5740 1 -- 172.21.15.2:0/780409995 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2b40a4e20 con 0x5567dd0abb60 2024-09-19T06:21:21.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.795+0000 7fe29eff5640 1 -- 172.21.15.2:0/780409995 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe2ac01ee20 con 0x5567dd0abb60 2024-09-19T06:21:21.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.795+0000 7fe2c36b5740 10 client.26591 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:21.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.795+0000 7fe2c36b5740 1 -- 172.21.15.2:0/780409995 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5567dd131ab0 con 0x5567dd0abb60 2024-09-19T06:21:21.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.795+0000 7fe29eff5640 1 -- 172.21.15.2:0/780409995 <== mon.2 v2:172.21.15.89:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe2b40a4e20 con 0x5567dd0abb60 2024-09-19T06:21:21.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.795+0000 7fe29eff5640 1 -- 172.21.15.2:0/780409995 <== mon.2 v2:172.21.15.89:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fe2ac027450 con 0x5567dd0abb60 2024-09-19T06:21:21.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.795+0000 7fe2c36b5740 10 client.26591 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:21.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.795+0000 7fe2c36b5740 10 client.26591 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:21.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.795+0000 7fe2c36b5740 20 client.26591 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:21.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.795+0000 7fe2c36b5740 1 --2- 172.21.15.2:0/780409995 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5567dd132200 0x5567dd134620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:21.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.795+0000 7fe2c36b5740 4 client.26591 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:21:21.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.795+0000 7fe2c36b5740 1 -- 172.21.15.2:0/780409995 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5567dd018d00 con 0x5567dd132200 2024-09-19T06:21:21.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.795+0000 7fe2ba7fc640 1 --2- 172.21.15.2:0/780409995 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5567dd132200 0x5567dd134620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:21.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.796+0000 7fe2ba7fc640 1 --2- 172.21.15.2:0/780409995 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5567dd132200 0x5567dd134620 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2433314c2906cc66 server_cookie=64cb878d49340564 in_seq=0 out_seq=0 2024-09-19T06:21:21.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.796+0000 7fe29eff5640 10 client.26591 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:21.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.797+0000 7fe29eff5640 1 -- 172.21.15.2:0/780409995 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5567dd018d00 con 0x5567dd132200 2024-09-19T06:21:21.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.797+0000 7fe29eff5640 10 client.26591 handle_command_reply: tid=0 2024-09-19T06:21:21.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.797+0000 7fe2c36b5740 1 client.26591 shutdown 2024-09-19T06:21:21.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.797+0000 7fe2c36b5740 1 -- 172.21.15.2:0/780409995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567dd0abb60 msgr2=0x5567dd0bb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:21.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.797+0000 7fe2c36b5740 1 --2- 172.21.15.2:0/780409995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567dd0abb60 0x5567dd0bb190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00cad0 tx=0x7fe2ac0046c0 comp rx=0 tx=0).stop 2024-09-19T06:21:21.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.797+0000 7fe2c36b5740 1 -- 172.21.15.2:0/780409995 shutdown_connections 2024-09-19T06:21:21.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.797+0000 7fe2c36b5740 1 --2- 172.21.15.2:0/780409995 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5567dd0b6d40 0x5567dd130250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:21.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.797+0000 7fe2c36b5740 1 --2- 172.21.15.2:0/780409995 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567dd0ac480 0x5567dd0bb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:21.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.797+0000 7fe2c36b5740 1 --2- 172.21.15.2:0/780409995 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5567dd132200 0x5567dd134620 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:21.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.797+0000 7fe2c36b5740 1 --2- 172.21.15.2:0/780409995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567dd0abb60 0x5567dd0bb190 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:21.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.797+0000 7fe2c36b5740 1 -- 172.21.15.2:0/780409995 >> 172.21.15.2:0/780409995 conn(0x5567dd0a80f0 msgr2=0x5567dd0a6a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:21.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.797+0000 7fe29eff5640 0 client.26591 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:21.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.797+0000 7fe2c36b5740 1 -- 172.21.15.2:0/780409995 shutdown_connections 2024-09-19T06:21:21.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.797+0000 7fe2c36b5740 1 -- 172.21.15.2:0/780409995 wait complete. 2024-09-19T06:21:21.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.797+0000 7fe2c36b5740 20 client.26591 trim_cache size 0 max 16384 2024-09-19T06:21:21.808 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:21:21.808 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T06:21:21.808 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "bf78283a-c626-4f16-98eb-ed5d661b5054", 2024-09-19T06:21:21.808 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T06:21:21.809 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:21:21.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.798+0000 7fe2c12dc640 1 -- 172.21.15.2:0/2295064280 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe2a40a33b0 msgr2=0x7fe2a40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:21.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.798+0000 7fe2c12dc640 1 --2- 172.21.15.2:0/2295064280 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe2a40a33b0 0x7fe2a40a5870 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x5567dd0a8f50 tx=0x7fe2ac00c3b0 comp rx=0 tx=0).stop 2024-09-19T06:21:21.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.798+0000 7fe2c12dc640 1 -- 172.21.15.2:0/2295064280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2bc10e500 msgr2=0x7fe2bc19ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:21.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.798+0000 7fe2c12dc640 1 --2- 172.21.15.2:0/2295064280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2bc10e500 0x7fe2bc19ef90 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fe2b400e9d0 tx=0x7fe2b400ee90 comp rx=0 tx=0).stop 2024-09-19T06:21:21.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.798+0000 7fe2c12dc640 1 -- 172.21.15.2:0/2295064280 shutdown_connections 2024-09-19T06:21:21.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.798+0000 7fe2c12dc640 1 --2- 172.21.15.2:0/2295064280 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe2a40a33b0 0x7fe2a40a5870 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:21.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.798+0000 7fe2c12dc640 1 --2- 172.21.15.2:0/2295064280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2bc10e500 0x7fe2bc19ef90 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:21.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.798+0000 7fe2c12dc640 1 --2- 172.21.15.2:0/2295064280 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe2bc101440 0x7fe2bc19ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:21.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.798+0000 7fe2c12dc640 1 --2- 172.21.15.2:0/2295064280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2bc100b20 0x7fe2bc19a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:21.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.798+0000 7fe2c12dc640 1 -- 172.21.15.2:0/2295064280 >> 172.21.15.2:0/2295064280 conn(0x7fe2bc0fc7d0 msgr2=0x7fe2bc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:21.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.798+0000 7fe2c12dc640 1 -- 172.21.15.2:0/2295064280 shutdown_connections 2024-09-19T06:21:21.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:21.798+0000 7fe2c12dc640 1 -- 172.21.15.2:0/2295064280 wait complete. 2024-09-19T06:21:22.485 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:21:22.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:22 smithi089 ceph-mon[34160]: scrub queued for path: / 2024-09-19T06:21:22.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:22 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:22.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:22 smithi089 ceph-mon[34160]: scrub summary: active paths [/] 2024-09-19T06:21:22.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:22 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:22.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:22 smithi002 ceph-mon[30982]: scrub queued for path: / 2024-09-19T06:21:22.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:22 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:22.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:22 smithi002 ceph-mon[30982]: scrub summary: active paths [/] 2024-09-19T06:21:22.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:22 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:22.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:22 smithi090 ceph-mon[34497]: scrub queued for path: / 2024-09-19T06:21:22.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:22 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:22.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:22 smithi090 ceph-mon[34497]: scrub summary: active paths [/] 2024-09-19T06:21:22.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:22 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:22.741 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:23.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.152+0000 7f3ea9a8a640 1 -- 172.21.15.2:0/3507752664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ea4101de0 msgr2=0x7f3ea41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:23.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.152+0000 7f3ea9a8a640 1 --2- 172.21.15.2:0/3507752664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ea4101de0 0x7f3ea41021c0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f3e94009ca0 tx=0x7f3e9402a8d0 comp rx=0 tx=0).stop 2024-09-19T06:21:23.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.152+0000 7f3ea9a8a640 1 -- 172.21.15.2:0/3507752664 shutdown_connections 2024-09-19T06:21:23.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.152+0000 7f3ea9a8a640 1 --2- 172.21.15.2:0/3507752664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea4106f10 0x7f3ea410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:23.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.152+0000 7f3ea9a8a640 1 --2- 172.21.15.2:0/3507752664 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ea4102790 0x7f3ea41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:23.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.152+0000 7f3ea9a8a640 1 --2- 172.21.15.2:0/3507752664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ea4101de0 0x7f3ea41021c0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:23.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.152+0000 7f3ea9a8a640 1 -- 172.21.15.2:0/3507752664 >> 172.21.15.2:0/3507752664 conn(0x7f3ea40fd8c0 msgr2=0x7f3ea40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:23.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.152+0000 7f3ea9a8a640 1 -- 172.21.15.2:0/3507752664 shutdown_connections 2024-09-19T06:21:23.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.152+0000 7f3ea9a8a640 1 -- 172.21.15.2:0/3507752664 wait complete. 2024-09-19T06:21:23.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.152+0000 7f3ea9a8a640 1 Processor -- start 2024-09-19T06:21:23.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.153+0000 7f3ea9a8a640 1 -- start start 2024-09-19T06:21:23.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.153+0000 7f3ea9a8a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ea4101de0 0x7f3ea40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:23.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.153+0000 7f3ea9a8a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea4102790 0x7f3ea4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:23.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.153+0000 7f3ea9a8a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ea4106f10 0x7f3ea4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:23.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.153+0000 7f3ea9a8a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea4111ee0 con 0x7f3ea4106f10 2024-09-19T06:21:23.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.153+0000 7f3ea9a8a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea4111d60 con 0x7f3ea4102790 2024-09-19T06:21:23.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.153+0000 7f3ea9a8a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea4112060 con 0x7f3ea4101de0 2024-09-19T06:21:23.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.153+0000 7f3ea3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ea4106f10 0x7f3ea4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:23.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.153+0000 7f3ea3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ea4106f10 0x7f3ea4074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36798/0 (socket says 172.21.15.2:36798) 2024-09-19T06:21:23.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.153+0000 7f3ea3fff640 1 -- 172.21.15.2:0/3950907865 learned_addr learned my addr 172.21.15.2:0/3950907865 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:23.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.153+0000 7f3ea37fe640 1 --2- 172.21.15.2:0/3950907865 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ea4101de0 0x7f3ea40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:23.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.153+0000 7f3ea2ffd640 1 --2- 172.21.15.2:0/3950907865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea4102790 0x7f3ea4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:23.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.154+0000 7f3ea3fff640 1 -- 172.21.15.2:0/3950907865 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ea4101de0 msgr2=0x7f3ea40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:23.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.154+0000 7f3ea3fff640 1 --2- 172.21.15.2:0/3950907865 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ea4101de0 0x7f3ea40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:23.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.154+0000 7f3ea3fff640 1 -- 172.21.15.2:0/3950907865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea4102790 msgr2=0x7f3ea4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:23.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.154+0000 7f3ea3fff640 1 --2- 172.21.15.2:0/3950907865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea4102790 0x7f3ea4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:23.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.154+0000 7f3ea3fff640 1 -- 172.21.15.2:0/3950907865 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ea41a6a00 con 0x7f3ea4106f10 2024-09-19T06:21:23.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.154+0000 7f3ea3fff640 1 --2- 172.21.15.2:0/3950907865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ea4106f10 0x7f3ea4074f70 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c00b3f0 tx=0x7f3e9c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:23.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.154+0000 7f3ea0ff9640 1 -- 172.21.15.2:0/3950907865 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c015020 con 0x7f3ea4106f10 2024-09-19T06:21:23.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.154+0000 7f3ea0ff9640 1 -- 172.21.15.2:0/3950907865 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3e9c011ce0 con 0x7f3ea4106f10 2024-09-19T06:21:23.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.154+0000 7f3ea9a8a640 1 -- 172.21.15.2:0/3950907865 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ea41a6cf0 con 0x7f3ea4106f10 2024-09-19T06:21:23.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.154+0000 7f3ea0ff9640 1 -- 172.21.15.2:0/3950907865 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c010da0 con 0x7f3ea4106f10 2024-09-19T06:21:23.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.154+0000 7f3ea9a8a640 1 -- 172.21.15.2:0/3950907865 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ea41a71d0 con 0x7f3ea4106f10 2024-09-19T06:21:23.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.157+0000 7f3ea0ff9640 1 -- 172.21.15.2:0/3950907865 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f3e9c018020 con 0x7f3ea4106f10 2024-09-19T06:21:23.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.157+0000 7f3eabe63740 1 Processor -- start 2024-09-19T06:21:23.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.157+0000 7f3eabe63740 1 -- start start 2024-09-19T06:21:23.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.158+0000 7f3eabe63740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a4d9914a0 0x560a4d991880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:23.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.158+0000 7f3eabe63740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a4d991dc0 0x560a4d99c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:23.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.158+0000 7f3eabe63740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a4d99c680 0x560a4d99ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:23.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.158+0000 7f3eabe63740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560a4d8f72e0 con 0x560a4d9914a0 2024-09-19T06:21:23.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.158+0000 7f3ea2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a4d9914a0 0x560a4d991880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:23.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.158+0000 7f3eabe63740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x560a4d89ece0 con 0x560a4d991dc0 2024-09-19T06:21:23.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.158+0000 7f3eabe63740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560a4d8f32a0 con 0x560a4d99c680 2024-09-19T06:21:23.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.158+0000 7f3ea2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a4d9914a0 0x560a4d991880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36802/0 (socket says 172.21.15.2:36802) 2024-09-19T06:21:23.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.158+0000 7f3ea2ffd640 1 -- 172.21.15.2:0/2356154980 learned_addr learned my addr 172.21.15.2:0/2356154980 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:23.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.158+0000 7f3ea37fe640 1 --2- 172.21.15.2:0/2356154980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a4d991dc0 0x560a4d99c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:23.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.158+0000 7f3ea2ffd640 1 --2- 172.21.15.2:0/2356154980 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a4d99c680 0x560a4d99ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:23.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.158+0000 7f3ea0ff9640 1 --2- 172.21.15.2:0/3950907865 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f3e8c0a3430 0x7f3e8c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:23.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.158+0000 7f3ea2ffd640 1 -- 172.21.15.2:0/2356154980 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a4d99c680 msgr2=0x560a4d99ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:23.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.158+0000 7f3ea2ffd640 1 --2- 172.21.15.2:0/2356154980 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a4d99c680 0x560a4d99ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:23.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.158+0000 7f3ea2ffd640 1 -- 172.21.15.2:0/2356154980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a4d991dc0 msgr2=0x560a4d99c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:23.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.158+0000 7f3ea2ffd640 1 --2- 172.21.15.2:0/2356154980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a4d991dc0 0x560a4d99c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:23.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.158+0000 7f3ea2ffd640 1 -- 172.21.15.2:0/2356154980 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a4d883440 con 0x560a4d9914a0 2024-09-19T06:21:23.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.158+0000 7f3ea3fff640 1 --2- 172.21.15.2:0/3950907865 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f3e8c0a3430 0x7f3e8c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:23.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.158+0000 7f3ea0ff9640 1 -- 172.21.15.2:0/3950907865 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f3e9c0cf4c0 con 0x7f3ea4106f10 2024-09-19T06:21:23.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.158+0000 7f3ea2ffd640 1 --2- 172.21.15.2:0/2356154980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a4d9914a0 0x560a4d991880 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f3e98006e10 tx=0x7f3e98009420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc4b58959c224ff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:23.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.159+0000 7f3e89ffb640 1 -- 172.21.15.2:0/2356154980 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9801c070 con 0x560a4d9914a0 2024-09-19T06:21:23.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.159+0000 7f3e89ffb640 1 -- 172.21.15.2:0/2356154980 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3e98010040 con 0x560a4d9914a0 2024-09-19T06:21:23.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.159+0000 7f3e89ffb640 1 -- 172.21.15.2:0/2356154980 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e98014620 con 0x560a4d9914a0 2024-09-19T06:21:23.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.159+0000 7f3eabe63740 1 -- 172.21.15.2:0/2356154980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a4d9914a0 msgr2=0x560a4d991880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:23.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.159+0000 7f3ea3fff640 1 --2- 172.21.15.2:0/3950907865 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f3e8c0a3430 0x7f3e8c0a58f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c09b7e0 tx=0x7f3e9c01eb80 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:23.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.159+0000 7f3eabe63740 1 --2- 172.21.15.2:0/2356154980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a4d9914a0 0x560a4d991880 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f3e98006e10 tx=0x7f3e98009420 comp rx=0 tx=0).stop 2024-09-19T06:21:23.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.159+0000 7f3eabe63740 1 -- 172.21.15.2:0/2356154980 shutdown_connections 2024-09-19T06:21:23.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.159+0000 7f3eabe63740 1 --2- 172.21.15.2:0/2356154980 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a4d99c680 0x560a4d99ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:23.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.159+0000 7f3eabe63740 1 --2- 172.21.15.2:0/2356154980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a4d991dc0 0x560a4d99c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:23.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.159+0000 7f3eabe63740 1 --2- 172.21.15.2:0/2356154980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a4d9914a0 0x560a4d991880 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:23.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.159+0000 7f3eabe63740 1 -- 172.21.15.2:0/2356154980 >> 172.21.15.2:0/2356154980 conn(0x560a4d98da30 msgr2=0x560a4d98de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:23.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.159+0000 7f3eabe63740 1 -- 172.21.15.2:0/2356154980 shutdown_connections 2024-09-19T06:21:23.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.159+0000 7f3eabe63740 1 -- 172.21.15.2:0/2356154980 wait complete. 2024-09-19T06:21:23.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.160+0000 7f3eabe63740 1 -- start start 2024-09-19T06:21:23.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.160+0000 7f3eabe63740 1 Processor -- start 2024-09-19T06:21:23.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.160+0000 7f3eabe63740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a4d9914a0 0x560a4d99c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:23.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.160+0000 7f3eabe63740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a4d991dc0 0x560a4d9992d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:23.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.160+0000 7f3eabe63740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a4d99c680 0x560a4d999870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:23.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.160+0000 7f3eabe63740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560a4d99f250 con 0x560a4d9914a0 2024-09-19T06:21:23.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.160+0000 7f3eabe63740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x560a4d8b2050 con 0x560a4d99c680 2024-09-19T06:21:23.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.160+0000 7f3eabe63740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560a4d99f3d0 con 0x560a4d991dc0 2024-09-19T06:21:23.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.160+0000 7f3eabe63740 10 client.0 _ll_register_callbacks cb 0x560a4d8f2160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:23.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.160+0000 7f3ea2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a4d9914a0 0x560a4d99c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:23.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.160+0000 7f3ea2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a4d9914a0 0x560a4d99c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36814/0 (socket says 172.21.15.2:36814) 2024-09-19T06:21:23.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.160+0000 7f3ea2ffd640 1 -- 172.21.15.2:0/581324126 learned_addr learned my addr 172.21.15.2:0/581324126 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:23.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.161+0000 7f3ea2ffd640 1 --2- 172.21.15.2:0/581324126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a4d99c680 0x560a4d999870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:23.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.161+0000 7f3ea37fe640 1 --2- 172.21.15.2:0/581324126 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a4d991dc0 0x560a4d9992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:23.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.161+0000 7f3ea2ffd640 1 -- 172.21.15.2:0/581324126 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a4d991dc0 msgr2=0x560a4d9992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:23.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.161+0000 7f3ea2ffd640 1 --2- 172.21.15.2:0/581324126 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a4d991dc0 0x560a4d9992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:23.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.161+0000 7f3ea2ffd640 1 -- 172.21.15.2:0/581324126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a4d99c680 msgr2=0x560a4d999870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:23.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.161+0000 7f3ea2ffd640 1 --2- 172.21.15.2:0/581324126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a4d99c680 0x560a4d999870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:23.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.161+0000 7f3ea2ffd640 1 -- 172.21.15.2:0/581324126 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a4d6683c0 con 0x560a4d9914a0 2024-09-19T06:21:23.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.161+0000 7f3ea2ffd640 1 --2- 172.21.15.2:0/581324126 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a4d9914a0 0x560a4d99c020 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f3e980093f0 tx=0x7f3e98009380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e857ffb7b14e9201 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:23.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.161+0000 7f3e82ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:23.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.161+0000 7f3e82ffd640 1 -- 172.21.15.2:0/581324126 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9802b060 con 0x560a4d9914a0 2024-09-19T06:21:23.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.161+0000 7f3e82ffd640 1 -- 172.21.15.2:0/581324126 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f3e98024620 con 0x560a4d9914a0 2024-09-19T06:21:23.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.161+0000 7f3eabe63740 1 -- 172.21.15.2:0/581324126 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e98010040 con 0x560a4d9914a0 2024-09-19T06:21:23.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.161+0000 7f3e82ffd640 1 -- 172.21.15.2:0/581324126 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3e9801c040 con 0x560a4d9914a0 2024-09-19T06:21:23.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.161+0000 7f3eabe63740 10 client.17385 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:23.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.161+0000 7f3eabe63740 1 -- 172.21.15.2:0/581324126 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560a4d9aac90 con 0x560a4d9914a0 2024-09-19T06:21:23.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.162+0000 7f3e82ffd640 1 -- 172.21.15.2:0/581324126 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3e98010040 con 0x560a4d9914a0 2024-09-19T06:21:23.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.162+0000 7f3e82ffd640 1 -- 172.21.15.2:0/581324126 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f3e980144b0 con 0x560a4d9914a0 2024-09-19T06:21:23.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.162+0000 7f3eabe63740 10 client.17385 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:23.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.162+0000 7f3eabe63740 10 client.17385 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:23.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.162+0000 7f3eabe63740 20 client.17385 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:23.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.162+0000 7f3eabe63740 1 --2- 172.21.15.2:0/581324126 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560a4d9ac0a0 0x560a4d9ae490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:23.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.162+0000 7f3eabe63740 4 client.17385 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:23.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.162+0000 7f3eabe63740 1 -- 172.21.15.2:0/581324126 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560a4d904850 con 0x560a4d9ac0a0 2024-09-19T06:21:23.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.162+0000 7f3ea37fe640 1 --2- 172.21.15.2:0/581324126 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560a4d9ac0a0 0x560a4d9ae490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:23.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.163+0000 7f3ea37fe640 1 --2- 172.21.15.2:0/581324126 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560a4d9ac0a0 0x560a4d9ae490 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aeb5728ada12fd94 server_cookie=73581b646d7e171c in_seq=0 out_seq=0 2024-09-19T06:21:23.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.163+0000 7f3e82ffd640 10 client.17385 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:23.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.163+0000 7f3e82ffd640 1 -- 172.21.15.2:0/581324126 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560a4d904850 con 0x560a4d9ac0a0 2024-09-19T06:21:23.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.163+0000 7f3e82ffd640 10 client.17385 handle_command_reply: tid=0 2024-09-19T06:21:23.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.163+0000 7f3eabe63740 1 client.17385 shutdown 2024-09-19T06:21:23.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.164+0000 7f3eabe63740 1 -- 172.21.15.2:0/581324126 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a4d9914a0 msgr2=0x560a4d99c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:23.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.164+0000 7f3eabe63740 1 --2- 172.21.15.2:0/581324126 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a4d9914a0 0x560a4d99c020 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f3e980093f0 tx=0x7f3e98009380 comp rx=0 tx=0).stop 2024-09-19T06:21:23.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.164+0000 7f3eabe63740 1 -- 172.21.15.2:0/581324126 shutdown_connections 2024-09-19T06:21:23.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.164+0000 7f3eabe63740 1 --2- 172.21.15.2:0/581324126 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560a4d9ac0a0 0x560a4d9ae490 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:23.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.164+0000 7f3eabe63740 1 --2- 172.21.15.2:0/581324126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a4d99c680 0x560a4d999870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:23.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.164+0000 7f3eabe63740 1 --2- 172.21.15.2:0/581324126 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a4d991dc0 0x560a4d9992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:23.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.164+0000 7f3e82ffd640 0 client.17385 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:23.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.164+0000 7f3eabe63740 1 --2- 172.21.15.2:0/581324126 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a4d9914a0 0x560a4d99c020 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:23.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.164+0000 7f3eabe63740 1 -- 172.21.15.2:0/581324126 >> 172.21.15.2:0/581324126 conn(0x560a4d98da30 msgr2=0x560a4d993760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:23.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.164+0000 7f3eabe63740 1 -- 172.21.15.2:0/581324126 shutdown_connections 2024-09-19T06:21:23.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.164+0000 7f3eabe63740 1 -- 172.21.15.2:0/581324126 wait complete. 2024-09-19T06:21:23.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.164+0000 7f3eabe63740 20 client.17385 trim_cache size 0 max 16384 2024-09-19T06:21:23.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.181+0000 7f3eabe63740 1 Processor -- start 2024-09-19T06:21:23.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.181+0000 7f3eabe63740 1 -- start start 2024-09-19T06:21:23.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.181+0000 7f3eabe63740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a4d9914a0 0x560a4d9a84e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:23.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.181+0000 7f3eabe63740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a4d991dc0 0x560a4d9b3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:23.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.181+0000 7f3eabe63740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a4d99c680 0x560a4d9b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:23.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.181+0000 7f3eabe63740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea41b2370 con 0x560a4d99c680 2024-09-19T06:21:23.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.181+0000 7f3eabe63740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea41afc40 con 0x560a4d9914a0 2024-09-19T06:21:23.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.181+0000 7f3eabe63740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea41adab0 con 0x560a4d991dc0 2024-09-19T06:21:23.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.182+0000 7f3ea2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a4d99c680 0x560a4d9b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:23.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.182+0000 7f3ea2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a4d99c680 0x560a4d9b40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36828/0 (socket says 172.21.15.2:36828) 2024-09-19T06:21:23.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.182+0000 7f3ea2ffd640 1 -- 172.21.15.2:0/4230377154 learned_addr learned my addr 172.21.15.2:0/4230377154 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:23.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.182+0000 7f3ea2ffd640 1 --2- 172.21.15.2:0/4230377154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a4d9914a0 0x560a4d9a84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:23.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.182+0000 7f3ea37fe640 1 --2- 172.21.15.2:0/4230377154 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a4d991dc0 0x560a4d9b3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:23.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.182+0000 7f3ea2ffd640 1 -- 172.21.15.2:0/4230377154 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a4d991dc0 msgr2=0x560a4d9b3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:23.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.182+0000 7f3ea2ffd640 1 --2- 172.21.15.2:0/4230377154 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a4d991dc0 0x560a4d9b3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:23.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.182+0000 7f3ea2ffd640 1 -- 172.21.15.2:0/4230377154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a4d9914a0 msgr2=0x560a4d9a84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:23.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.182+0000 7f3ea2ffd640 1 --2- 172.21.15.2:0/4230377154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a4d9914a0 0x560a4d9a84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:23.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.182+0000 7f3ea2ffd640 1 -- 172.21.15.2:0/4230377154 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a4d99c390 con 0x560a4d99c680 2024-09-19T06:21:23.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.182+0000 7f3ea2ffd640 1 --2- 172.21.15.2:0/4230377154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a4d99c680 0x560a4d9b40c0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f3e98009320 tx=0x7f3e9800f9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11d46ed9dc21ecf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:23.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.182+0000 7f3e897fa640 1 -- 172.21.15.2:0/4230377154 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9800fe60 con 0x560a4d99c680 2024-09-19T06:21:23.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.182+0000 7f3e897fa640 1 -- 172.21.15.2:0/4230377154 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3e98014aa0 con 0x560a4d99c680 2024-09-19T06:21:23.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.182+0000 7f3e897fa640 1 -- 172.21.15.2:0/4230377154 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9802f700 con 0x560a4d99c680 2024-09-19T06:21:23.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.183+0000 7f3eabe63740 1 -- 172.21.15.2:0/4230377154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a4d99c680 msgr2=0x560a4d9b40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:23.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.183+0000 7f3eabe63740 1 --2- 172.21.15.2:0/4230377154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a4d99c680 0x560a4d9b40c0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f3e98009320 tx=0x7f3e9800f9e0 comp rx=0 tx=0).stop 2024-09-19T06:21:23.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.183+0000 7f3eabe63740 1 -- 172.21.15.2:0/4230377154 shutdown_connections 2024-09-19T06:21:23.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.183+0000 7f3eabe63740 1 --2- 172.21.15.2:0/4230377154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a4d99c680 0x560a4d9b40c0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:23.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.183+0000 7f3eabe63740 1 --2- 172.21.15.2:0/4230377154 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a4d991dc0 0x560a4d9b3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:23.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.183+0000 7f3eabe63740 1 --2- 172.21.15.2:0/4230377154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a4d9914a0 0x560a4d9a84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:23.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.183+0000 7f3eabe63740 1 -- 172.21.15.2:0/4230377154 >> 172.21.15.2:0/4230377154 conn(0x560a4d98da30 msgr2=0x560a4d9983c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:23.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.183+0000 7f3eabe63740 1 -- 172.21.15.2:0/4230377154 shutdown_connections 2024-09-19T06:21:23.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.183+0000 7f3eabe63740 1 -- 172.21.15.2:0/4230377154 wait complete. 2024-09-19T06:21:23.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.183+0000 7f3eabe63740 1 -- start start 2024-09-19T06:21:23.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.184+0000 7f3eabe63740 1 Processor -- start 2024-09-19T06:21:23.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.184+0000 7f3eabe63740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a4d9914a0 0x560a4d9a1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:23.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.184+0000 7f3eabe63740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a4d991dc0 0x560a4d9a1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:23.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.184+0000 7f3eabe63740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a4d99c680 0x560a4da14b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:23.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.184+0000 7f3eabe63740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea41ae100 con 0x560a4d99c680 2024-09-19T06:21:23.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.184+0000 7f3eabe63740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea41af570 con 0x560a4d991dc0 2024-09-19T06:21:23.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.184+0000 7f3eabe63740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea41ae7d0 con 0x560a4d9914a0 2024-09-19T06:21:23.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.184+0000 7f3eabe63740 10 client.0 _ll_register_callbacks cb 0x7f3e9801a070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:23.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.184+0000 7f3ea2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a4d99c680 0x560a4da14b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:23.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.184+0000 7f3ea2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a4d99c680 0x560a4da14b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36842/0 (socket says 172.21.15.2:36842) 2024-09-19T06:21:23.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.184+0000 7f3ea2ffd640 1 -- 172.21.15.2:0/928263577 learned_addr learned my addr 172.21.15.2:0/928263577 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:23.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.184+0000 7f3ea2ffd640 1 --2- 172.21.15.2:0/928263577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a4d9914a0 0x560a4d9a1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:23.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.184+0000 7f3ea37fe640 1 --2- 172.21.15.2:0/928263577 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a4d991dc0 0x560a4d9a1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:23.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.184+0000 7f3ea2ffd640 1 -- 172.21.15.2:0/928263577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a4d9914a0 msgr2=0x560a4d9a1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:23.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.184+0000 7f3ea2ffd640 1 --2- 172.21.15.2:0/928263577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a4d9914a0 0x560a4d9a1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:23.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.184+0000 7f3ea2ffd640 1 -- 172.21.15.2:0/928263577 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a4d991dc0 msgr2=0x560a4d9a1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:23.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.184+0000 7f3ea2ffd640 1 --2- 172.21.15.2:0/928263577 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a4d991dc0 0x560a4d9a1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:23.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.184+0000 7f3ea2ffd640 1 -- 172.21.15.2:0/928263577 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a4da15090 con 0x560a4d99c680 2024-09-19T06:21:23.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.185+0000 7f3ea2ffd640 1 --2- 172.21.15.2:0/928263577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a4d99c680 0x560a4da14b50 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f3e98009540 tx=0x7f3e98017ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=581105ed2af5a016 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:23.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.185+0000 7f3e82ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:23.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.185+0000 7f3e82ffd640 1 -- 172.21.15.2:0/928263577 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e980059c0 con 0x560a4d99c680 2024-09-19T06:21:23.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.185+0000 7f3e82ffd640 1 -- 172.21.15.2:0/928263577 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f3e98005b60 con 0x560a4d99c680 2024-09-19T06:21:23.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.185+0000 7f3eabe63740 1 -- 172.21.15.2:0/928263577 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e98014aa0 con 0x560a4d99c680 2024-09-19T06:21:23.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.185+0000 7f3e82ffd640 1 -- 172.21.15.2:0/928263577 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3e98005d60 con 0x560a4d99c680 2024-09-19T06:21:23.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.185+0000 7f3eabe63740 10 client.17391 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:23.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.185+0000 7f3eabe63740 1 -- 172.21.15.2:0/928263577 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560a4da16280 con 0x560a4d99c680 2024-09-19T06:21:23.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.185+0000 7f3e82ffd640 1 -- 172.21.15.2:0/928263577 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3e98014aa0 con 0x560a4d99c680 2024-09-19T06:21:23.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.185+0000 7f3e82ffd640 1 -- 172.21.15.2:0/928263577 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f3e98044020 con 0x560a4d99c680 2024-09-19T06:21:23.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.185+0000 7f3eabe63740 10 client.17391 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:23.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.185+0000 7f3eabe63740 10 client.17391 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:23.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.185+0000 7f3eabe63740 20 client.17391 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:23.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.185+0000 7f3eabe63740 1 --2- 172.21.15.2:0/928263577 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560a4da16880 0x560a4da18ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:23.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.185+0000 7f3eabe63740 4 client.17391 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:21:23.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.185+0000 7f3eabe63740 1 -- 172.21.15.2:0/928263577 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560a4d8fed60 con 0x560a4da16880 2024-09-19T06:21:23.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.186+0000 7f3ea37fe640 1 --2- 172.21.15.2:0/928263577 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560a4da16880 0x560a4da18ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:23.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.186+0000 7f3ea37fe640 1 --2- 172.21.15.2:0/928263577 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560a4da16880 0x560a4da18ca0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3943815c18f4459 server_cookie=a9fa645543bb3b1d in_seq=0 out_seq=0 2024-09-19T06:21:23.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.186+0000 7f3e82ffd640 10 client.17391 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:23.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.186+0000 7f3e82ffd640 1 -- 172.21.15.2:0/928263577 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x560a4d8fed60 con 0x560a4da16880 2024-09-19T06:21:23.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.186+0000 7f3e82ffd640 10 client.17391 handle_command_reply: tid=0 2024-09-19T06:21:23.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.186+0000 7f3eabe63740 1 client.17391 shutdown 2024-09-19T06:21:23.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.187+0000 7f3eabe63740 1 -- 172.21.15.2:0/928263577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a4d99c680 msgr2=0x560a4da14b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:23.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.187+0000 7f3eabe63740 1 --2- 172.21.15.2:0/928263577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a4d99c680 0x560a4da14b50 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f3e98009540 tx=0x7f3e98017ee0 comp rx=0 tx=0).stop 2024-09-19T06:21:23.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.187+0000 7f3eabe63740 1 -- 172.21.15.2:0/928263577 shutdown_connections 2024-09-19T06:21:23.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.187+0000 7f3eabe63740 1 --2- 172.21.15.2:0/928263577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560a4d99c680 0x560a4da14b50 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:23.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.187+0000 7f3eabe63740 1 --2- 172.21.15.2:0/928263577 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560a4da16880 0x560a4da18ca0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:23.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.187+0000 7f3eabe63740 1 --2- 172.21.15.2:0/928263577 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560a4d991dc0 0x560a4d9a1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:23.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.187+0000 7f3eabe63740 1 --2- 172.21.15.2:0/928263577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560a4d9914a0 0x560a4d9a1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:23.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.187+0000 7f3eabe63740 1 -- 172.21.15.2:0/928263577 >> 172.21.15.2:0/928263577 conn(0x560a4d98da30 msgr2=0x560a4d98c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:23.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.187+0000 7f3e82ffd640 0 client.17391 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:23.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.187+0000 7f3eabe63740 1 -- 172.21.15.2:0/928263577 shutdown_connections 2024-09-19T06:21:23.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.187+0000 7f3eabe63740 1 -- 172.21.15.2:0/928263577 wait complete. 2024-09-19T06:21:23.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.187+0000 7f3eabe63740 20 client.17391 trim_cache size 0 max 16384 2024-09-19T06:21:23.194 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:21:23.194 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T06:21:23.194 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T06:21:23.194 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:21:23.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.187+0000 7f3ea9a8a640 1 -- 172.21.15.2:0/3950907865 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f3e8c0a3430 msgr2=0x7f3e8c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:23.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.187+0000 7f3ea9a8a640 1 --2- 172.21.15.2:0/3950907865 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f3e8c0a3430 0x7f3e8c0a58f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c09b7e0 tx=0x7f3e9c01eb80 comp rx=0 tx=0).stop 2024-09-19T06:21:23.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.187+0000 7f3ea9a8a640 1 -- 172.21.15.2:0/3950907865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ea4106f10 msgr2=0x7f3ea4074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:23.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.187+0000 7f3ea9a8a640 1 --2- 172.21.15.2:0/3950907865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ea4106f10 0x7f3ea4074f70 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c00b3f0 tx=0x7f3e9c00b8b0 comp rx=0 tx=0).stop 2024-09-19T06:21:23.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.187+0000 7f3ea9a8a640 1 -- 172.21.15.2:0/3950907865 shutdown_connections 2024-09-19T06:21:23.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.187+0000 7f3ea9a8a640 1 --2- 172.21.15.2:0/3950907865 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f3e8c0a3430 0x7f3e8c0a58f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:23.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.187+0000 7f3ea9a8a640 1 --2- 172.21.15.2:0/3950907865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ea4106f10 0x7f3ea4074f70 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:23.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.187+0000 7f3ea9a8a640 1 --2- 172.21.15.2:0/3950907865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea4102790 0x7f3ea4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:23.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.187+0000 7f3ea9a8a640 1 --2- 172.21.15.2:0/3950907865 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ea4101de0 0x7f3ea40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:23.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.187+0000 7f3ea9a8a640 1 -- 172.21.15.2:0/3950907865 >> 172.21.15.2:0/3950907865 conn(0x7f3ea40fd8c0 msgr2=0x7f3ea40fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:23.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.188+0000 7f3ea9a8a640 1 -- 172.21.15.2:0/3950907865 shutdown_connections 2024-09-19T06:21:23.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:23.188+0000 7f3ea9a8a640 1 -- 172.21.15.2:0/3950907865 wait complete. 2024-09-19T06:21:23.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:23 smithi002 ceph-mon[30982]: pgmap v202: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-19T06:21:23.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:23 smithi002 ceph-mon[30982]: scrub summary: idle 2024-09-19T06:21:23.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:23 smithi089 ceph-mon[34160]: pgmap v202: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-19T06:21:23.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:23 smithi089 ceph-mon[34160]: scrub summary: idle 2024-09-19T06:21:23.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:23 smithi090 ceph-mon[34497]: pgmap v202: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-19T06:21:23.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:23 smithi090 ceph-mon[34497]: scrub summary: idle 2024-09-19T06:21:23.960 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:21:23.960 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:21:24.217 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:24.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.624+0000 7effe8444640 1 -- 172.21.15.2:0/1964646162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effe01002f0 msgr2=0x7effe01006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:24.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.624+0000 7effe8444640 1 --2- 172.21.15.2:0/1964646162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effe01002f0 0x7effe01006d0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7effdc009930 tx=0x7effdc02a420 comp rx=0 tx=0).stop 2024-09-19T06:21:24.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.624+0000 7effe8444640 1 -- 172.21.15.2:0/1964646162 shutdown_connections 2024-09-19T06:21:24.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.624+0000 7effe8444640 1 --2- 172.21.15.2:0/1964646162 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effe0106f50 0x7effe010eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:24.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.624+0000 7effe8444640 1 --2- 172.21.15.2:0/1964646162 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effe0100ca0 0x7effe0106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:24.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.624+0000 7effe8444640 1 --2- 172.21.15.2:0/1964646162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effe01002f0 0x7effe01006d0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:24.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.624+0000 7effe8444640 1 -- 172.21.15.2:0/1964646162 >> 172.21.15.2:0/1964646162 conn(0x7effe0077210 msgr2=0x7effe00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:24.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.624+0000 7effe8444640 1 -- 172.21.15.2:0/1964646162 shutdown_connections 2024-09-19T06:21:24.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.624+0000 7effe8444640 1 -- 172.21.15.2:0/1964646162 wait complete. 2024-09-19T06:21:24.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.625+0000 7effe8444640 1 Processor -- start 2024-09-19T06:21:24.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.625+0000 7effe8444640 1 -- start start 2024-09-19T06:21:24.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.625+0000 7effe8444640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effe01002f0 0x7effe0198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:24.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.625+0000 7effe8444640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effe0100ca0 0x7effe0198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:24.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.625+0000 7effe8444640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effe0106f50 0x7effe019cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:24.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.625+0000 7effe8444640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7effe0111e50 con 0x7effe01002f0 2024-09-19T06:21:24.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.625+0000 7effe8444640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7effe0111cd0 con 0x7effe0106f50 2024-09-19T06:21:24.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.625+0000 7effe8444640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7effe0111fd0 con 0x7effe0100ca0 2024-09-19T06:21:24.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.625+0000 7effe61e0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effe01002f0 0x7effe0198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:24.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.625+0000 7effe61e0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effe01002f0 0x7effe0198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36862/0 (socket says 172.21.15.2:36862) 2024-09-19T06:21:24.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.625+0000 7effe61e0640 1 -- 172.21.15.2:0/2083981443 learned_addr learned my addr 172.21.15.2:0/2083981443 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:24.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.625+0000 7effe69e1640 1 --2- 172.21.15.2:0/2083981443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effe0106f50 0x7effe019cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:24.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.625+0000 7effe59df640 1 --2- 172.21.15.2:0/2083981443 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effe0100ca0 0x7effe0198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:24.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.626+0000 7effe61e0640 1 -- 172.21.15.2:0/2083981443 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effe0100ca0 msgr2=0x7effe0198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:24.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.626+0000 7effe61e0640 1 --2- 172.21.15.2:0/2083981443 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effe0100ca0 0x7effe0198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:24.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.626+0000 7effe61e0640 1 -- 172.21.15.2:0/2083981443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effe0106f50 msgr2=0x7effe019cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:24.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.626+0000 7effe61e0640 1 --2- 172.21.15.2:0/2083981443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effe0106f50 0x7effe019cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:24.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.626+0000 7effe61e0640 1 -- 172.21.15.2:0/2083981443 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effe019d3c0 con 0x7effe01002f0 2024-09-19T06:21:24.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.626+0000 7effe61e0640 1 --2- 172.21.15.2:0/2083981443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effe01002f0 0x7effe0198410 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7effdc005940 tx=0x7effdc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:24.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.626+0000 7effd77fe640 1 -- 172.21.15.2:0/2083981443 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effdc03f030 con 0x7effe01002f0 2024-09-19T06:21:24.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.626+0000 7effd77fe640 1 -- 172.21.15.2:0/2083981443 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7effdc0318a0 con 0x7effe01002f0 2024-09-19T06:21:24.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.627+0000 7effd77fe640 1 -- 172.21.15.2:0/2083981443 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effdc035070 con 0x7effe01002f0 2024-09-19T06:21:24.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.627+0000 7effe8444640 1 -- 172.21.15.2:0/2083981443 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effe019d650 con 0x7effe01002f0 2024-09-19T06:21:24.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.627+0000 7effe8444640 1 -- 172.21.15.2:0/2083981443 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effe01a4f90 con 0x7effe01002f0 2024-09-19T06:21:24.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.628+0000 7effe8444640 1 -- 172.21.15.2:0/2083981443 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effe01006d0 con 0x7effe01002f0 2024-09-19T06:21:24.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.629+0000 7effd77fe640 1 -- 172.21.15.2:0/2083981443 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7effdc042030 con 0x7effe01002f0 2024-09-19T06:21:24.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.630+0000 7effd77fe640 1 --2- 172.21.15.2:0/2083981443 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7effcc0a3430 0x7effcc0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:24.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.630+0000 7effe59df640 1 --2- 172.21.15.2:0/2083981443 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7effcc0a3430 0x7effcc0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:24.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.630+0000 7effd77fe640 1 -- 172.21.15.2:0/2083981443 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7effdc0effc0 con 0x7effe01002f0 2024-09-19T06:21:24.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.630+0000 7effe59df640 1 --2- 172.21.15.2:0/2083981443 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7effcc0a3430 0x7effcc0a58f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7effe00ff8f0 tx=0x7effd000b590 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:24.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.634+0000 7effd77fe640 1 -- 172.21.15.2:0/2083981443 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7effdc0bc9a0 con 0x7effe01002f0 2024-09-19T06:21:24.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.845+0000 7effe8444640 1 -- 172.21.15.2:0/2083981443 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7effe0199770 con 0x7effe01002f0 2024-09-19T06:21:24.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.845+0000 7effd77fe640 1 -- 172.21.15.2:0/2083981443 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11882 (secure 0 0 0) 0x7effdc0bc2a0 con 0x7effe01002f0 2024-09-19T06:21:24.848 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:21:24.849 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-09-19T06:14:49:104280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:14:48.191083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24470,24472,24497]},"id":1}]} 2024-09-19T06:21:24.849 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-09-19T06:21:24.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.847+0000 7effe8444640 1 -- 172.21.15.2:0/2083981443 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7effcc0a3430 msgr2=0x7effcc0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:24.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.847+0000 7effe8444640 1 --2- 172.21.15.2:0/2083981443 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7effcc0a3430 0x7effcc0a58f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7effe00ff8f0 tx=0x7effd000b590 comp rx=0 tx=0).stop 2024-09-19T06:21:24.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.847+0000 7effe8444640 1 -- 172.21.15.2:0/2083981443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effe01002f0 msgr2=0x7effe0198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:24.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.847+0000 7effe8444640 1 --2- 172.21.15.2:0/2083981443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effe01002f0 0x7effe0198410 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7effdc005940 tx=0x7effdc0042f0 comp rx=0 tx=0).stop 2024-09-19T06:21:24.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.847+0000 7effe8444640 1 -- 172.21.15.2:0/2083981443 shutdown_connections 2024-09-19T06:21:24.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.847+0000 7effe8444640 1 --2- 172.21.15.2:0/2083981443 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7effcc0a3430 0x7effcc0a58f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:24.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.847+0000 7effe8444640 1 --2- 172.21.15.2:0/2083981443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effe0106f50 0x7effe019cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:24.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.847+0000 7effe8444640 1 --2- 172.21.15.2:0/2083981443 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effe0100ca0 0x7effe0198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:24.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.847+0000 7effe8444640 1 --2- 172.21.15.2:0/2083981443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effe01002f0 0x7effe0198410 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:24.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.847+0000 7effe8444640 1 -- 172.21.15.2:0/2083981443 >> 172.21.15.2:0/2083981443 conn(0x7effe0077210 msgr2=0x7effe0105330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:24.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.847+0000 7effe8444640 1 -- 172.21.15.2:0/2083981443 shutdown_connections 2024-09-19T06:21:24.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:24.847+0000 7effe8444640 1 -- 172.21.15.2:0/2083981443 wait complete. 2024-09-19T06:21:25.534 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:25 smithi002 ceph-mon[30982]: pgmap v203: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 92 B/s wr, 10 op/s 2024-09-19T06:21:25.534 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:25 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/2083981443' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:21:25.536 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:21:25.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:25 smithi089 ceph-mon[34160]: pgmap v203: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 92 B/s wr, 10 op/s 2024-09-19T06:21:25.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:25 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/2083981443' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:21:25.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:25 smithi090 ceph-mon[34497]: pgmap v203: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 92 B/s wr, 10 op/s 2024-09-19T06:21:25.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:25 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/2083981443' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:21:25.795 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:26.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.223+0000 7f3c17953640 1 -- 172.21.15.2:0/1112917270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c10102ef0 msgr2=0x7f3c1010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:26.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.223+0000 7f3c17953640 1 --2- 172.21.15.2:0/1112917270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c10102ef0 0x7f3c1010da40 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f3c08009ca0 tx=0x7f3c0802a950 comp rx=0 tx=0).stop 2024-09-19T06:21:26.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.223+0000 7f3c17953640 1 -- 172.21.15.2:0/1112917270 shutdown_connections 2024-09-19T06:21:26.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.223+0000 7f3c17953640 1 --2- 172.21.15.2:0/1112917270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c10102ef0 0x7f3c1010da40 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:26.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.223+0000 7f3c17953640 1 --2- 172.21.15.2:0/1112917270 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c10102570 0x7f3c101029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:26.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.223+0000 7f3c17953640 1 --2- 172.21.15.2:0/1112917270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c10100e20 0x7f3c10101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:26.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.223+0000 7f3c17953640 1 -- 172.21.15.2:0/1112917270 >> 172.21.15.2:0/1112917270 conn(0x7f3c100fc7d0 msgr2=0x7f3c100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:26.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.223+0000 7f3c17953640 1 -- 172.21.15.2:0/1112917270 shutdown_connections 2024-09-19T06:21:26.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.223+0000 7f3c17953640 1 -- 172.21.15.2:0/1112917270 wait complete. 2024-09-19T06:21:26.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.224+0000 7f3c17953640 1 Processor -- start 2024-09-19T06:21:26.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.224+0000 7f3c17953640 1 -- start start 2024-09-19T06:21:26.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.224+0000 7f3c17953640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c10100e20 0x7f3c101983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:26.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.224+0000 7f3c17953640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c10102570 0x7f3c101988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:26.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.224+0000 7f3c17953640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c10102ef0 0x7f3c1019cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:26.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.224+0000 7f3c17953640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3c10110e30 con 0x7f3c10102570 2024-09-19T06:21:26.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.224+0000 7f3c17953640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3c10110cb0 con 0x7f3c10100e20 2024-09-19T06:21:26.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.224+0000 7f3c17953640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3c10110fb0 con 0x7f3c10102ef0 2024-09-19T06:21:26.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.225+0000 7f3c14eee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c10102570 0x7f3c101988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:26.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.225+0000 7f3c14eee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c10102570 0x7f3c101988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42646/0 (socket says 172.21.15.2:42646) 2024-09-19T06:21:26.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.225+0000 7f3c14eee640 1 -- 172.21.15.2:0/3905657642 learned_addr learned my addr 172.21.15.2:0/3905657642 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:26.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.225+0000 7f3c156ef640 1 --2- 172.21.15.2:0/3905657642 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c10100e20 0x7f3c101983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:26.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.225+0000 7f3c15ef0640 1 --2- 172.21.15.2:0/3905657642 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c10102ef0 0x7f3c1019cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:26.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.225+0000 7f3c14eee640 1 -- 172.21.15.2:0/3905657642 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c10102ef0 msgr2=0x7f3c1019cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:26.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.225+0000 7f3c14eee640 1 --2- 172.21.15.2:0/3905657642 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c10102ef0 0x7f3c1019cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:26.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.225+0000 7f3c14eee640 1 -- 172.21.15.2:0/3905657642 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c10100e20 msgr2=0x7f3c101983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:26.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.225+0000 7f3c14eee640 1 --2- 172.21.15.2:0/3905657642 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c10100e20 0x7f3c101983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:26.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.225+0000 7f3c14eee640 1 -- 172.21.15.2:0/3905657642 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c1019d360 con 0x7f3c10102570 2024-09-19T06:21:26.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.225+0000 7f3c156ef640 1 --2- 172.21.15.2:0/3905657642 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c10100e20 0x7f3c101983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:26.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.225+0000 7f3c14eee640 1 --2- 172.21.15.2:0/3905657642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c10102570 0x7f3c101988f0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f3c0400c920 tx=0x7f3c0400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:26.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.225+0000 7f3c027fc640 1 -- 172.21.15.2:0/3905657642 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c04007c70 con 0x7f3c10102570 2024-09-19T06:21:26.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.225+0000 7f3c17953640 1 -- 172.21.15.2:0/3905657642 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c1019d650 con 0x7f3c10102570 2024-09-19T06:21:26.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.225+0000 7f3c027fc640 1 -- 172.21.15.2:0/3905657642 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3c04007e10 con 0x7f3c10102570 2024-09-19T06:21:26.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.225+0000 7f3c027fc640 1 -- 172.21.15.2:0/3905657642 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c04018820 con 0x7f3c10102570 2024-09-19T06:21:26.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.226+0000 7f3c17953640 1 -- 172.21.15.2:0/3905657642 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c101a4f30 con 0x7f3c10102570 2024-09-19T06:21:26.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.228+0000 7f3c027fc640 1 -- 172.21.15.2:0/3905657642 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f3c040189c0 con 0x7f3c10102570 2024-09-19T06:21:26.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.228+0000 7f3c19d2c740 1 Processor -- start 2024-09-19T06:21:26.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.228+0000 7f3c19d2c740 1 -- start start 2024-09-19T06:21:26.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.228+0000 7f3c19d2c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ec31c4b40 0x562ec31c3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:26.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.228+0000 7f3c19d2c740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ec31c35d0 0x562ec31c3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:26.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.229+0000 7f3c19d2c740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ec31d2780 0x562ec31d4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:26.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.229+0000 7f3c19d2c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562ec31292f0 con 0x562ec31c4b40 2024-09-19T06:21:26.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.229+0000 7f3c19d2c740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562ec30d0cf0 con 0x562ec31c35d0 2024-09-19T06:21:26.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.229+0000 7f3c19d2c740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562ec31252b0 con 0x562ec31d2780 2024-09-19T06:21:26.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.229+0000 7f3c15ef0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ec31c4b40 0x562ec31c3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:26.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.229+0000 7f3c15ef0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ec31c4b40 0x562ec31c3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42662/0 (socket says 172.21.15.2:42662) 2024-09-19T06:21:26.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.229+0000 7f3c15ef0640 1 -- 172.21.15.2:0/507647732 learned_addr learned my addr 172.21.15.2:0/507647732 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:26.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.229+0000 7f3c156ef640 1 --2- 172.21.15.2:0/507647732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ec31c35d0 0x562ec31c3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:26.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.229+0000 7f3c14eee640 1 --2- 172.21.15.2:0/507647732 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ec31d2780 0x562ec31d4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:26.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.229+0000 7f3c027fc640 1 --2- 172.21.15.2:0/3905657642 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f3bfc0a33b0 0x7f3bfc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:26.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.229+0000 7f3c15ef0640 1 -- 172.21.15.2:0/507647732 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ec31d2780 msgr2=0x562ec31d4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:26.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.229+0000 7f3c15ef0640 1 --2- 172.21.15.2:0/507647732 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ec31d2780 0x562ec31d4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:26.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.229+0000 7f3c15ef0640 1 -- 172.21.15.2:0/507647732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ec31c35d0 msgr2=0x562ec31c3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:26.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.229+0000 7f3c15ef0640 1 --2- 172.21.15.2:0/507647732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ec31c35d0 0x562ec31c3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:26.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.229+0000 7f3c15ef0640 1 -- 172.21.15.2:0/507647732 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ec30b53a0 con 0x562ec31c4b40 2024-09-19T06:21:26.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.229+0000 7f3c156ef640 1 --2- 172.21.15.2:0/507647732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ec31c35d0 0x562ec31c3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:26.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.229+0000 7f3c027fc640 1 -- 172.21.15.2:0/3905657642 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f3c040cfdd0 con 0x7f3c10102570 2024-09-19T06:21:26.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.229+0000 7f3c15ef0640 1 --2- 172.21.15.2:0/3905657642 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f3bfc0a33b0 0x7f3bfc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:26.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.229+0000 7f3c15ef0640 1 --2- 172.21.15.2:0/507647732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ec31c4b40 0x562ec31c3090 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f3c08035000 tx=0x7f3c0802fed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8db40c0d18387fa7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:26.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.229+0000 7f3bfb7fe640 1 -- 172.21.15.2:0/507647732 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c0804a070 con 0x562ec31c4b40 2024-09-19T06:21:26.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.230+0000 7f3bfb7fe640 1 -- 172.21.15.2:0/507647732 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3c0802f460 con 0x562ec31c4b40 2024-09-19T06:21:26.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.230+0000 7f3bfb7fe640 1 -- 172.21.15.2:0/507647732 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c08034040 con 0x562ec31c4b40 2024-09-19T06:21:26.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.230+0000 7f3c19d2c740 1 -- 172.21.15.2:0/507647732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ec31c4b40 msgr2=0x562ec31c3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:26.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.230+0000 7f3c19d2c740 1 --2- 172.21.15.2:0/507647732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ec31c4b40 0x562ec31c3090 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f3c08035000 tx=0x7f3c0802fed0 comp rx=0 tx=0).stop 2024-09-19T06:21:26.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.230+0000 7f3c15ef0640 1 --2- 172.21.15.2:0/3905657642 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f3bfc0a33b0 0x7f3bfc0a5870 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3c08047000 tx=0x7f3c08045550 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:26.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.230+0000 7f3c19d2c740 1 -- 172.21.15.2:0/507647732 shutdown_connections 2024-09-19T06:21:26.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.230+0000 7f3c19d2c740 1 --2- 172.21.15.2:0/507647732 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ec31d2780 0x562ec31d4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:26.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.230+0000 7f3c19d2c740 1 --2- 172.21.15.2:0/507647732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ec31c35d0 0x562ec31c3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:26.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.230+0000 7f3c19d2c740 1 --2- 172.21.15.2:0/507647732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ec31c4b40 0x562ec31c3090 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:26.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.230+0000 7f3c19d2c740 1 -- 172.21.15.2:0/507647732 >> 172.21.15.2:0/507647732 conn(0x562ec318c310 msgr2=0x562ec31bfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:26.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.230+0000 7f3c19d2c740 1 -- 172.21.15.2:0/507647732 shutdown_connections 2024-09-19T06:21:26.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.230+0000 7f3c19d2c740 1 -- 172.21.15.2:0/507647732 wait complete. 2024-09-19T06:21:26.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.231+0000 7f3c19d2c740 1 -- start start 2024-09-19T06:21:26.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.231+0000 7f3c19d2c740 1 Processor -- start 2024-09-19T06:21:26.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.231+0000 7f3c19d2c740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ec31c35d0 0x562ec31d20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:26.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.231+0000 7f3c19d2c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ec31c4b40 0x562ec31cf3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:26.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.231+0000 7f3c19d2c740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ec31d2780 0x562ec31cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:26.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.231+0000 7f3c19d2c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562ec31d5480 con 0x562ec31c4b40 2024-09-19T06:21:26.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.231+0000 7f3c19d2c740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562ec30e4060 con 0x562ec31d2780 2024-09-19T06:21:26.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.231+0000 7f3c19d2c740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562ec31d5600 con 0x562ec31c35d0 2024-09-19T06:21:26.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.231+0000 7f3c19d2c740 10 client.0 _ll_register_callbacks cb 0x562ec2e378c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:26.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.231+0000 7f3c14eee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ec31c4b40 0x562ec31cf3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:26.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.231+0000 7f3c14eee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ec31c4b40 0x562ec31cf3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42666/0 (socket says 172.21.15.2:42666) 2024-09-19T06:21:26.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.231+0000 7f3c14eee640 1 -- 172.21.15.2:0/738374795 learned_addr learned my addr 172.21.15.2:0/738374795 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:26.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.232+0000 7f3c15ef0640 1 --2- 172.21.15.2:0/738374795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ec31d2780 0x562ec31cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:26.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.232+0000 7f3c156ef640 1 --2- 172.21.15.2:0/738374795 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ec31c35d0 0x562ec31d20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:26.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.232+0000 7f3c14eee640 1 -- 172.21.15.2:0/738374795 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ec31c35d0 msgr2=0x562ec31d20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:26.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.232+0000 7f3c14eee640 1 --2- 172.21.15.2:0/738374795 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ec31c35d0 0x562ec31d20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:26.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.232+0000 7f3c14eee640 1 -- 172.21.15.2:0/738374795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ec31d2780 msgr2=0x562ec31cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:26.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.232+0000 7f3c14eee640 1 --2- 172.21.15.2:0/738374795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ec31d2780 0x562ec31cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:26.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.232+0000 7f3c14eee640 1 -- 172.21.15.2:0/738374795 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ec2e9a3c0 con 0x562ec31c4b40 2024-09-19T06:21:26.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.232+0000 7f3c15ef0640 1 --2- 172.21.15.2:0/738374795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ec31d2780 0x562ec31cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:26.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.232+0000 7f3c14eee640 1 --2- 172.21.15.2:0/738374795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ec31c4b40 0x562ec31cf3a0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f3c040cd520 tx=0x7f3c0409bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86677fc950512082 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:26.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.232+0000 7f3bf8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:26.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.232+0000 7f3bf8ff9640 1 -- 172.21.15.2:0/738374795 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c0400fb00 con 0x562ec31c4b40 2024-09-19T06:21:26.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.232+0000 7f3bf8ff9640 1 -- 172.21.15.2:0/738374795 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f3c040cd740 con 0x562ec31c4b40 2024-09-19T06:21:26.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.232+0000 7f3c19d2c740 1 -- 172.21.15.2:0/738374795 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c0802f460 con 0x562ec31c4b40 2024-09-19T06:21:26.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.232+0000 7f3bf8ff9640 1 -- 172.21.15.2:0/738374795 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3c040cd940 con 0x562ec31c4b40 2024-09-19T06:21:26.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.232+0000 7f3c19d2c740 10 client.17409 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:26.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.232+0000 7f3c19d2c740 1 -- 172.21.15.2:0/738374795 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562ec31e0ee0 con 0x562ec31c4b40 2024-09-19T06:21:26.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.232+0000 7f3bf8ff9640 1 -- 172.21.15.2:0/738374795 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3c0802f460 con 0x562ec31c4b40 2024-09-19T06:21:26.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.233+0000 7f3bf8ff9640 1 -- 172.21.15.2:0/738374795 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f3c040b7020 con 0x562ec31c4b40 2024-09-19T06:21:26.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.233+0000 7f3c19d2c740 10 client.17409 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:26.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.233+0000 7f3c19d2c740 10 client.17409 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:21:26.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.233+0000 7f3c19d2c740 20 client.17409 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:26.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.233+0000 7f3c19d2c740 1 --2- 172.21.15.2:0/738374795 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x562ec31e22f0 0x562ec31e46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:26.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.233+0000 7f3c19d2c740 4 client.17409 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:26.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.233+0000 7f3c19d2c740 1 -- 172.21.15.2:0/738374795 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ec3136860 con 0x562ec31e22f0 2024-09-19T06:21:26.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.233+0000 7f3c156ef640 1 --2- 172.21.15.2:0/738374795 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x562ec31e22f0 0x562ec31e46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:26.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.234+0000 7f3bf8ff9640 10 client.17409 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:21:26.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.234+0000 7f3c156ef640 1 --2- 172.21.15.2:0/738374795 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x562ec31e22f0 0x562ec31e46e0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=94511d84e18ffb20 server_cookie=70c80f037984dd71 in_seq=0 out_seq=0 2024-09-19T06:21:26.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.234+0000 7f3bf8ff9640 1 -- 172.21.15.2:0/738374795 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562ec3136860 con 0x562ec31e22f0 2024-09-19T06:21:26.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.234+0000 7f3bf8ff9640 10 client.17409 handle_command_reply: tid=0 2024-09-19T06:21:26.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.234+0000 7f3c19d2c740 1 client.17409 shutdown 2024-09-19T06:21:26.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.234+0000 7f3c19d2c740 1 -- 172.21.15.2:0/738374795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ec31c4b40 msgr2=0x562ec31cf3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:26.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.234+0000 7f3c19d2c740 1 --2- 172.21.15.2:0/738374795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ec31c4b40 0x562ec31cf3a0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f3c040cd520 tx=0x7f3c0409bc50 comp rx=0 tx=0).stop 2024-09-19T06:21:26.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.234+0000 7f3c19d2c740 1 -- 172.21.15.2:0/738374795 shutdown_connections 2024-09-19T06:21:26.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.234+0000 7f3c19d2c740 1 --2- 172.21.15.2:0/738374795 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x562ec31e22f0 0x562ec31e46e0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:26.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.234+0000 7f3c19d2c740 1 --2- 172.21.15.2:0/738374795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ec31d2780 0x562ec31cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:26.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.234+0000 7f3c19d2c740 1 --2- 172.21.15.2:0/738374795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ec31c4b40 0x562ec31cf3a0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:26.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.234+0000 7f3bf8ff9640 0 client.17409 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:21:26.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.234+0000 7f3c19d2c740 1 --2- 172.21.15.2:0/738374795 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ec31c35d0 0x562ec31d20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:26.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.234+0000 7f3c19d2c740 1 -- 172.21.15.2:0/738374795 >> 172.21.15.2:0/738374795 conn(0x562ec318c310 msgr2=0x562ec31c5930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:26.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.235+0000 7f3c19d2c740 1 -- 172.21.15.2:0/738374795 shutdown_connections 2024-09-19T06:21:26.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.235+0000 7f3c19d2c740 1 -- 172.21.15.2:0/738374795 wait complete. 2024-09-19T06:21:26.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.235+0000 7f3c19d2c740 20 client.17409 trim_cache size 0 max 16384 2024-09-19T06:21:26.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.248+0000 7f3c19d2c740 1 Processor -- start 2024-09-19T06:21:26.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.248+0000 7f3c19d2c740 1 -- start start 2024-09-19T06:21:26.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.248+0000 7f3c19d2c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ec31c35d0 0x562ec31de720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:26.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.248+0000 7f3c19d2c740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ec31c4b40 0x562ec31e9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:26.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.248+0000 7f3c19d2c740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ec31d2780 0x562ec31ea4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:26.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.248+0000 7f3c19d2c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3c101addd0 con 0x562ec31c35d0 2024-09-19T06:21:26.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.248+0000 7f3c19d2c740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3c101ab6a0 con 0x562ec31d2780 2024-09-19T06:21:26.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.248+0000 7f3c19d2c740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3c101a9510 con 0x562ec31c4b40 2024-09-19T06:21:26.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.248+0000 7f3c156ef640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ec31c35d0 0x562ec31de720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:26.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.248+0000 7f3c156ef640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ec31c35d0 0x562ec31de720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42676/0 (socket says 172.21.15.2:42676) 2024-09-19T06:21:26.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.248+0000 7f3c156ef640 1 -- 172.21.15.2:0/259977148 learned_addr learned my addr 172.21.15.2:0/259977148 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:26.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.248+0000 7f3c15ef0640 1 --2- 172.21.15.2:0/259977148 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ec31d2780 0x562ec31ea4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:26.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.248+0000 7f3c14eee640 1 --2- 172.21.15.2:0/259977148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ec31c4b40 0x562ec31e9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:26.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.248+0000 7f3c156ef640 1 -- 172.21.15.2:0/259977148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ec31c4b40 msgr2=0x562ec31e9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:26.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.248+0000 7f3c156ef640 1 --2- 172.21.15.2:0/259977148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ec31c4b40 0x562ec31e9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:26.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.248+0000 7f3c156ef640 1 -- 172.21.15.2:0/259977148 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ec31d2780 msgr2=0x562ec31ea4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:26.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.248+0000 7f3c156ef640 1 --2- 172.21.15.2:0/259977148 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ec31d2780 0x562ec31ea4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:26.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.248+0000 7f3c156ef640 1 -- 172.21.15.2:0/259977148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ec31c43a0 con 0x562ec31c35d0 2024-09-19T06:21:26.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.248+0000 7f3c15ef0640 1 --2- 172.21.15.2:0/259977148 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ec31d2780 0x562ec31ea4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:26.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.248+0000 7f3c14eee640 1 --2- 172.21.15.2:0/259977148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ec31c4b40 0x562ec31e9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:21:26.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.249+0000 7f3c156ef640 1 --2- 172.21.15.2:0/259977148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ec31c35d0 0x562ec31de720 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c004700 tx=0x7f3c0c010c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3231ff681826c2d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:26.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.249+0000 7f3bfaffd640 1 -- 172.21.15.2:0/259977148 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c00fad0 con 0x562ec31c35d0 2024-09-19T06:21:26.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.249+0000 7f3bfaffd640 1 -- 172.21.15.2:0/259977148 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3c0c0054d0 con 0x562ec31c35d0 2024-09-19T06:21:26.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.249+0000 7f3bfaffd640 1 -- 172.21.15.2:0/259977148 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c004d30 con 0x562ec31c35d0 2024-09-19T06:21:26.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.250+0000 7f3c19d2c740 1 -- 172.21.15.2:0/259977148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ec31c35d0 msgr2=0x562ec31de720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:26.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.250+0000 7f3c19d2c740 1 --2- 172.21.15.2:0/259977148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ec31c35d0 0x562ec31de720 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c004700 tx=0x7f3c0c010c30 comp rx=0 tx=0).stop 2024-09-19T06:21:26.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.250+0000 7f3c19d2c740 1 -- 172.21.15.2:0/259977148 shutdown_connections 2024-09-19T06:21:26.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.250+0000 7f3c19d2c740 1 --2- 172.21.15.2:0/259977148 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ec31d2780 0x562ec31ea4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:26.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.250+0000 7f3c19d2c740 1 --2- 172.21.15.2:0/259977148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ec31c4b40 0x562ec31e9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:26.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.250+0000 7f3c19d2c740 1 --2- 172.21.15.2:0/259977148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ec31c35d0 0x562ec31de720 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:26.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.250+0000 7f3c19d2c740 1 -- 172.21.15.2:0/259977148 >> 172.21.15.2:0/259977148 conn(0x562ec318c310 msgr2=0x562ec31ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:26.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.250+0000 7f3c19d2c740 1 -- 172.21.15.2:0/259977148 shutdown_connections 2024-09-19T06:21:26.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.250+0000 7f3c19d2c740 1 -- 172.21.15.2:0/259977148 wait complete. 2024-09-19T06:21:26.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.250+0000 7f3c19d2c740 1 -- start start 2024-09-19T06:21:26.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.250+0000 7f3c19d2c740 1 Processor -- start 2024-09-19T06:21:26.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.250+0000 7f3c19d2c740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ec31c35d0 0x562ec31da890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:26.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.251+0000 7f3c19d2c740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ec31c4b40 0x562ec31dadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:26.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.251+0000 7f3c19d2c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ec31d2780 0x562ec31d7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:26.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.251+0000 7f3c19d2c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3c101a9b60 con 0x562ec31d2780 2024-09-19T06:21:26.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.251+0000 7f3c19d2c740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3c101aafd0 con 0x562ec31c4b40 2024-09-19T06:21:26.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.251+0000 7f3c19d2c740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3c101aa230 con 0x562ec31c35d0 2024-09-19T06:21:26.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.251+0000 7f3c19d2c740 10 client.0 _ll_register_callbacks cb 0x7f3c0400fcf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:26.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.251+0000 7f3c15ef0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ec31d2780 0x562ec31d7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:26.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.251+0000 7f3c15ef0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ec31d2780 0x562ec31d7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42690/0 (socket says 172.21.15.2:42690) 2024-09-19T06:21:26.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.251+0000 7f3c15ef0640 1 -- 172.21.15.2:0/213484214 learned_addr learned my addr 172.21.15.2:0/213484214 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:26.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.251+0000 7f3c14eee640 1 --2- 172.21.15.2:0/213484214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ec31c4b40 0x562ec31dadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:26.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.251+0000 7f3c156ef640 1 --2- 172.21.15.2:0/213484214 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ec31c35d0 0x562ec31da890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:26.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.251+0000 7f3c14eee640 1 -- 172.21.15.2:0/213484214 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ec31c35d0 msgr2=0x562ec31da890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:26.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.251+0000 7f3c14eee640 1 --2- 172.21.15.2:0/213484214 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ec31c35d0 0x562ec31da890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:26.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.251+0000 7f3c14eee640 1 -- 172.21.15.2:0/213484214 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ec31d2780 msgr2=0x562ec31d7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:26.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.251+0000 7f3c14eee640 1 --2- 172.21.15.2:0/213484214 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ec31d2780 0x562ec31d7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:26.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.251+0000 7f3c14eee640 1 -- 172.21.15.2:0/213484214 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ec31db490 con 0x562ec31c4b40 2024-09-19T06:21:26.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.251+0000 7f3c15ef0640 1 --2- 172.21.15.2:0/213484214 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ec31d2780 0x562ec31d7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:26.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.251+0000 7f3c14eee640 1 --2- 172.21.15.2:0/213484214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ec31c4b40 0x562ec31dadd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x562ec31df190 tx=0x7f3c0409be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1de8d34c496d99f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:26.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.251+0000 7f3bf8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-09-19T06:21:26.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.251+0000 7f3bf8ff9640 1 -- 172.21.15.2:0/213484214 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c040982f0 con 0x562ec31c4b40 2024-09-19T06:21:26.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.252+0000 7f3bf8ff9640 1 -- 172.21.15.2:0/213484214 <== mon.2 v2:172.21.15.89:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f3c04097da0 con 0x562ec31c4b40 2024-09-19T06:21:26.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.252+0000 7f3c19d2c740 1 -- 172.21.15.2:0/213484214 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c0c0054d0 con 0x562ec31c4b40 2024-09-19T06:21:26.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.252+0000 7f3bf8ff9640 1 -- 172.21.15.2:0/213484214 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3c0409c750 con 0x562ec31c4b40 2024-09-19T06:21:26.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.252+0000 7f3c19d2c740 10 client.26627 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:26.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.252+0000 7f3c19d2c740 1 -- 172.21.15.2:0/213484214 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562ec324d440 con 0x562ec31c4b40 2024-09-19T06:21:26.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.252+0000 7f3bf8ff9640 1 -- 172.21.15.2:0/213484214 <== mon.2 v2:172.21.15.89:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3c0c0054d0 con 0x562ec31c4b40 2024-09-19T06:21:26.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.252+0000 7f3bf8ff9640 1 -- 172.21.15.2:0/213484214 <== mon.2 v2:172.21.15.89:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f3c040d3030 con 0x562ec31c4b40 2024-09-19T06:21:26.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.252+0000 7f3c19d2c740 10 client.26627 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:26.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.252+0000 7f3c19d2c740 10 client.26627 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:21:26.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.252+0000 7f3c19d2c740 20 client.26627 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:26.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.252+0000 7f3c19d2c740 1 --2- 172.21.15.2:0/213484214 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x562ec324db40 0x562ec324ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:26.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.252+0000 7f3c19d2c740 4 client.26627 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:21:26.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.252+0000 7f3c19d2c740 1 -- 172.21.15.2:0/213484214 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562ec3130d70 con 0x562ec324db40 2024-09-19T06:21:26.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.252+0000 7f3c156ef640 1 --2- 172.21.15.2:0/213484214 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x562ec324db40 0x562ec324ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:26.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.253+0000 7f3c156ef640 1 --2- 172.21.15.2:0/213484214 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x562ec324db40 0x562ec324ff60 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8e029405de8038f2 server_cookie=7c91014a3595470e in_seq=0 out_seq=0 2024-09-19T06:21:26.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.253+0000 7f3bf8ff9640 10 client.26627 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:21:26.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.253+0000 7f3bf8ff9640 1 -- 172.21.15.2:0/213484214 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562ec3130d70 con 0x562ec324db40 2024-09-19T06:21:26.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.253+0000 7f3bf8ff9640 10 client.26627 handle_command_reply: tid=0 2024-09-19T06:21:26.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.253+0000 7f3c19d2c740 1 client.26627 shutdown 2024-09-19T06:21:26.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.253+0000 7f3c19d2c740 1 -- 172.21.15.2:0/213484214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ec31c4b40 msgr2=0x562ec31dadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:26.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.253+0000 7f3c19d2c740 1 --2- 172.21.15.2:0/213484214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ec31c4b40 0x562ec31dadd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x562ec31df190 tx=0x7f3c0409be20 comp rx=0 tx=0).stop 2024-09-19T06:21:26.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.253+0000 7f3c19d2c740 1 -- 172.21.15.2:0/213484214 shutdown_connections 2024-09-19T06:21:26.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.253+0000 7f3c19d2c740 1 --2- 172.21.15.2:0/213484214 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x562ec324db40 0x562ec324ff60 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:26.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.253+0000 7f3c19d2c740 1 --2- 172.21.15.2:0/213484214 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562ec31d2780 0x562ec31d7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:26.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.253+0000 7f3c19d2c740 1 --2- 172.21.15.2:0/213484214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562ec31c4b40 0x562ec31dadd0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:26.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.253+0000 7f3bf8ff9640 0 client.26627 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:21:26.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.253+0000 7f3c19d2c740 1 --2- 172.21.15.2:0/213484214 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562ec31c35d0 0x562ec31da890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:26.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.253+0000 7f3c19d2c740 1 -- 172.21.15.2:0/213484214 >> 172.21.15.2:0/213484214 conn(0x562ec318c310 msgr2=0x562ec31be4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:26.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.253+0000 7f3c19d2c740 1 -- 172.21.15.2:0/213484214 shutdown_connections 2024-09-19T06:21:26.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.253+0000 7f3c19d2c740 1 -- 172.21.15.2:0/213484214 wait complete. 2024-09-19T06:21:26.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.253+0000 7f3c19d2c740 20 client.26627 trim_cache size 0 max 16384 2024-09-19T06:21:26.261 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:21:26.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.254+0000 7f3c17953640 1 -- 172.21.15.2:0/3905657642 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f3bfc0a33b0 msgr2=0x7f3bfc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:26.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.254+0000 7f3c17953640 1 --2- 172.21.15.2:0/3905657642 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f3bfc0a33b0 0x7f3bfc0a5870 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3c08047000 tx=0x7f3c08045550 comp rx=0 tx=0).stop 2024-09-19T06:21:26.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.254+0000 7f3c17953640 1 -- 172.21.15.2:0/3905657642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c10102570 msgr2=0x7f3c101988f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:26.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.254+0000 7f3c17953640 1 --2- 172.21.15.2:0/3905657642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c10102570 0x7f3c101988f0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f3c0400c920 tx=0x7f3c0400cde0 comp rx=0 tx=0).stop 2024-09-19T06:21:26.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.254+0000 7f3c17953640 1 -- 172.21.15.2:0/3905657642 shutdown_connections 2024-09-19T06:21:26.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.254+0000 7f3c17953640 1 --2- 172.21.15.2:0/3905657642 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f3bfc0a33b0 0x7f3bfc0a5870 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:26.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.254+0000 7f3c17953640 1 --2- 172.21.15.2:0/3905657642 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c10102ef0 0x7f3c1019cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:26.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.254+0000 7f3c17953640 1 --2- 172.21.15.2:0/3905657642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c10102570 0x7f3c101988f0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:26.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.254+0000 7f3c17953640 1 --2- 172.21.15.2:0/3905657642 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c10100e20 0x7f3c101983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:26.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.254+0000 7f3c17953640 1 -- 172.21.15.2:0/3905657642 >> 172.21.15.2:0/3905657642 conn(0x7f3c100fc7d0 msgr2=0x7f3c1006a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:26.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.254+0000 7f3c17953640 1 -- 172.21.15.2:0/3905657642 shutdown_connections 2024-09-19T06:21:26.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:26.254+0000 7f3c17953640 1 -- 172.21.15.2:0/3905657642 wait complete. 2024-09-19T06:21:27.036 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:21:27.296 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:27.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:27 smithi089 ceph-mon[34160]: pgmap v204: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:21:27.542 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:27 smithi090 ceph-mon[34497]: pgmap v204: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:21:27.599 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:27 smithi002 ceph-mon[30982]: pgmap v204: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:21:27.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.682+0000 7fdbe6d6b640 1 -- 172.21.15.2:0/4021502407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbe0102ef0 msgr2=0x7fdbe010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:27.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.682+0000 7fdbe6d6b640 1 --2- 172.21.15.2:0/4021502407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbe0102ef0 0x7fdbe010da40 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8009900 tx=0x7fdbd802a480 comp rx=0 tx=0).stop 2024-09-19T06:21:27.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.683+0000 7fdbe6d6b640 1 -- 172.21.15.2:0/4021502407 shutdown_connections 2024-09-19T06:21:27.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.683+0000 7fdbe6d6b640 1 --2- 172.21.15.2:0/4021502407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbe0102ef0 0x7fdbe010da40 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:27.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.683+0000 7fdbe6d6b640 1 --2- 172.21.15.2:0/4021502407 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbe0102570 0x7fdbe01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.683+0000 7fdbe6d6b640 1 --2- 172.21.15.2:0/4021502407 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbe0100e20 0x7fdbe0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.683+0000 7fdbe6d6b640 1 -- 172.21.15.2:0/4021502407 >> 172.21.15.2:0/4021502407 conn(0x7fdbe00fc7d0 msgr2=0x7fdbe00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.683+0000 7fdbe6d6b640 1 -- 172.21.15.2:0/4021502407 shutdown_connections 2024-09-19T06:21:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.683+0000 7fdbe6d6b640 1 -- 172.21.15.2:0/4021502407 wait complete. 2024-09-19T06:21:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.683+0000 7fdbe6d6b640 1 Processor -- start 2024-09-19T06:21:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.683+0000 7fdbe6d6b640 1 -- start start 2024-09-19T06:21:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.683+0000 7fdbe6d6b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbe0100e20 0x7fdbe0198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.683+0000 7fdbe6d6b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbe0102570 0x7fdbe0198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.683+0000 7fdbe6d6b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbe0102ef0 0x7fdbe019cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.683+0000 7fdbe6d6b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe0111f50 con 0x7fdbe0100e20 2024-09-19T06:21:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.683+0000 7fdbe6d6b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe0111dd0 con 0x7fdbe0102ef0 2024-09-19T06:21:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.684+0000 7fdbe6d6b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe01120d0 con 0x7fdbe0102570 2024-09-19T06:21:27.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.684+0000 7fdbe4b07640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbe0100e20 0x7fdbe0198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:27.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.684+0000 7fdbe4b07640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbe0100e20 0x7fdbe0198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42710/0 (socket says 172.21.15.2:42710) 2024-09-19T06:21:27.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.684+0000 7fdbe4b07640 1 -- 172.21.15.2:0/3516886959 learned_addr learned my addr 172.21.15.2:0/3516886959 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:27.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.684+0000 7fdbdffff640 1 --2- 172.21.15.2:0/3516886959 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbe0102570 0x7fdbe0198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:27.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.684+0000 7fdbe5308640 1 --2- 172.21.15.2:0/3516886959 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbe0102ef0 0x7fdbe019cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:27.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.684+0000 7fdbe4b07640 1 -- 172.21.15.2:0/3516886959 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbe0102570 msgr2=0x7fdbe0198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:27.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.684+0000 7fdbe4b07640 1 --2- 172.21.15.2:0/3516886959 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbe0102570 0x7fdbe0198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:27.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.684+0000 7fdbe4b07640 1 -- 172.21.15.2:0/3516886959 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbe0102ef0 msgr2=0x7fdbe019cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:27.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.684+0000 7fdbe4b07640 1 --2- 172.21.15.2:0/3516886959 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbe0102ef0 0x7fdbe019cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:27.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.684+0000 7fdbe4b07640 1 -- 172.21.15.2:0/3516886959 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe019d3c0 con 0x7fdbe0100e20 2024-09-19T06:21:27.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.684+0000 7fdbe4b07640 1 --2- 172.21.15.2:0/3516886959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbe0100e20 0x7fdbe0198410 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fdbd400cce0 tx=0x7fdbd400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:27.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.684+0000 7fdbddffb640 1 -- 172.21.15.2:0/3516886959 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd4004b20 con 0x7fdbe0100e20 2024-09-19T06:21:27.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.684+0000 7fdbddffb640 1 -- 172.21.15.2:0/3516886959 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdbd4004cc0 con 0x7fdbe0100e20 2024-09-19T06:21:27.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.684+0000 7fdbe6d6b640 1 -- 172.21.15.2:0/3516886959 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbe019d6b0 con 0x7fdbe0100e20 2024-09-19T06:21:27.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.684+0000 7fdbddffb640 1 -- 172.21.15.2:0/3516886959 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd400f6b0 con 0x7fdbe0100e20 2024-09-19T06:21:27.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.685+0000 7fdbe6d6b640 1 -- 172.21.15.2:0/3516886959 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbe01a4f90 con 0x7fdbe0100e20 2024-09-19T06:21:27.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.687+0000 7fdbddffb640 1 -- 172.21.15.2:0/3516886959 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fdbd400f850 con 0x7fdbe0100e20 2024-09-19T06:21:27.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.687+0000 7fdbe9144740 1 Processor -- start 2024-09-19T06:21:27.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.687+0000 7fdbe9144740 1 -- start start 2024-09-19T06:21:27.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.688+0000 7fdbe9144740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff59c9cb40 0x55ff59c9b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:27.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.688+0000 7fdbe9144740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ff59c9b5d0 0x55ff59c9ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:27.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.688+0000 7fdbe9144740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff59caa780 0x55ff59cacb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:27.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.688+0000 7fdbe9144740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ff59c012f0 con 0x55ff59caa780 2024-09-19T06:21:27.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.688+0000 7fdbe9144740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55ff59ba8cf0 con 0x55ff59c9cb40 2024-09-19T06:21:27.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.688+0000 7fdbe9144740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55ff59bfd2b0 con 0x55ff59c9b5d0 2024-09-19T06:21:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.688+0000 7fdbddffb640 1 --2- 172.21.15.2:0/3516886959 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fdbd00a33b0 0x7fdbd00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.688+0000 7fdbdffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff59caa780 0x55ff59cacb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.688+0000 7fdbe5308640 1 --2- 172.21.15.2:0/3516886959 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fdbd00a33b0 0x7fdbd00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.688+0000 7fdbdffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff59caa780 0x55ff59cacb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42718/0 (socket says 172.21.15.2:42718) 2024-09-19T06:21:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.688+0000 7fdbdffff640 1 -- 172.21.15.2:0/3368455562 learned_addr learned my addr 172.21.15.2:0/3368455562 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.688+0000 7fdbe4b07640 1 --2- 172.21.15.2:0/3368455562 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ff59c9b5d0 0x55ff59c9ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.688+0000 7fdbe5308640 1 --2- 172.21.15.2:0/3368455562 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff59c9cb40 0x55ff59c9b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.688+0000 7fdbddffb640 1 -- 172.21.15.2:0/3516886959 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7fdbd40cff30 con 0x7fdbe0100e20 2024-09-19T06:21:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.688+0000 7fdbdffff640 1 -- 172.21.15.2:0/3368455562 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ff59c9b5d0 msgr2=0x55ff59c9ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.688+0000 7fdbdffff640 1 --2- 172.21.15.2:0/3368455562 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ff59c9b5d0 0x55ff59c9ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.688+0000 7fdbdffff640 1 -- 172.21.15.2:0/3368455562 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff59c9cb40 msgr2=0x55ff59c9b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.688+0000 7fdbdffff640 1 --2- 172.21.15.2:0/3368455562 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff59c9cb40 0x55ff59c9b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:27.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.688+0000 7fdbdffff640 1 -- 172.21.15.2:0/3368455562 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff59b8d3a0 con 0x55ff59caa780 2024-09-19T06:21:27.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.688+0000 7fdbe5308640 1 --2- 172.21.15.2:0/3516886959 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fdbd00a33b0 0x7fdbd00a5870 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdbd80096c0 tx=0x7fdbd8032c60 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:27.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.688+0000 7fdbdffff640 1 --2- 172.21.15.2:0/3368455562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff59caa780 0x55ff59cacb70 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc00b7f0 tx=0x7fdbcc00bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4b50b5901272cfd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:27.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.689+0000 7fdbcaffd640 1 -- 172.21.15.2:0/3368455562 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc00d950 con 0x55ff59caa780 2024-09-19T06:21:27.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.689+0000 7fdbcaffd640 1 -- 172.21.15.2:0/3368455562 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdbcc018070 con 0x55ff59caa780 2024-09-19T06:21:27.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.689+0000 7fdbcaffd640 1 -- 172.21.15.2:0/3368455562 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc013e50 con 0x55ff59caa780 2024-09-19T06:21:27.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.689+0000 7fdbe9144740 1 -- 172.21.15.2:0/3368455562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff59caa780 msgr2=0x55ff59cacb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:27.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.689+0000 7fdbe9144740 1 --2- 172.21.15.2:0/3368455562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff59caa780 0x55ff59cacb70 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc00b7f0 tx=0x7fdbcc00bcb0 comp rx=0 tx=0).stop 2024-09-19T06:21:27.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.690+0000 7fdbe9144740 1 -- 172.21.15.2:0/3368455562 shutdown_connections 2024-09-19T06:21:27.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.690+0000 7fdbe9144740 1 --2- 172.21.15.2:0/3368455562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff59caa780 0x55ff59cacb70 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:27.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.690+0000 7fdbe9144740 1 --2- 172.21.15.2:0/3368455562 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ff59c9b5d0 0x55ff59c9ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:27.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.690+0000 7fdbe9144740 1 --2- 172.21.15.2:0/3368455562 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff59c9cb40 0x55ff59c9b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:27.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.690+0000 7fdbe9144740 1 -- 172.21.15.2:0/3368455562 >> 172.21.15.2:0/3368455562 conn(0x55ff59c64310 msgr2=0x55ff59c97c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:27.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.690+0000 7fdbe9144740 1 -- 172.21.15.2:0/3368455562 shutdown_connections 2024-09-19T06:21:27.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.690+0000 7fdbe9144740 1 -- 172.21.15.2:0/3368455562 wait complete. 2024-09-19T06:21:27.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.690+0000 7fdbe9144740 1 -- start start 2024-09-19T06:21:27.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.690+0000 7fdbe9144740 1 Processor -- start 2024-09-19T06:21:27.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.691+0000 7fdbe9144740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ff59c9b5d0 0x55ff59caa0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:27.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.691+0000 7fdbe9144740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff59c9cb40 0x55ff59ca7390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:27.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.691+0000 7fdbe9144740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff59caa780 0x55ff59ca78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:27.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.691+0000 7fdbe9144740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ff59cad480 con 0x55ff59c9cb40 2024-09-19T06:21:27.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.691+0000 7fdbe9144740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55ff59bbc060 con 0x55ff59caa780 2024-09-19T06:21:27.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.691+0000 7fdbe9144740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55ff59cad600 con 0x55ff59c9b5d0 2024-09-19T06:21:27.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.691+0000 7fdbe9144740 10 client.0 _ll_register_callbacks cb 0x55ff5990f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:27.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.691+0000 7fdbdffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff59c9cb40 0x55ff59ca7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:27.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.691+0000 7fdbdffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff59c9cb40 0x55ff59ca7390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42734/0 (socket says 172.21.15.2:42734) 2024-09-19T06:21:27.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.691+0000 7fdbdffff640 1 -- 172.21.15.2:0/3551196158 learned_addr learned my addr 172.21.15.2:0/3551196158 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:27.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.691+0000 7fdbe4b07640 1 --2- 172.21.15.2:0/3551196158 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ff59c9b5d0 0x55ff59caa0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:27.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.691+0000 7fdbe5308640 1 --2- 172.21.15.2:0/3551196158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff59caa780 0x55ff59ca78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:27.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.691+0000 7fdbdffff640 1 -- 172.21.15.2:0/3551196158 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ff59c9b5d0 msgr2=0x55ff59caa0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:27.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.691+0000 7fdbdffff640 1 --2- 172.21.15.2:0/3551196158 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ff59c9b5d0 0x55ff59caa0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:27.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.692+0000 7fdbdffff640 1 -- 172.21.15.2:0/3551196158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff59caa780 msgr2=0x55ff59ca78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:27.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.692+0000 7fdbdffff640 1 --2- 172.21.15.2:0/3551196158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff59caa780 0x55ff59ca78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:27.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.692+0000 7fdbdffff640 1 -- 172.21.15.2:0/3551196158 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff599723c0 con 0x55ff59c9cb40 2024-09-19T06:21:27.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.692+0000 7fdbe4b07640 1 --2- 172.21.15.2:0/3551196158 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ff59c9b5d0 0x55ff59caa0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:27.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.692+0000 7fdbe5308640 1 --2- 172.21.15.2:0/3551196158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff59caa780 0x55ff59ca78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:27.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.692+0000 7fdbdffff640 1 --2- 172.21.15.2:0/3551196158 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff59c9cb40 0x55ff59ca7390 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc013b90 tx=0x7fdbcc013850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9065109c74b94265 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:27.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.692+0000 7fdbbffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:27.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.692+0000 7fdbbffff640 1 -- 172.21.15.2:0/3551196158 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc023070 con 0x55ff59c9cb40 2024-09-19T06:21:27.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.692+0000 7fdbbffff640 1 -- 172.21.15.2:0/3551196158 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7fdbcc00dd60 con 0x55ff59c9cb40 2024-09-19T06:21:27.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.692+0000 7fdbe9144740 1 -- 172.21.15.2:0/3551196158 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbcc018070 con 0x55ff59c9cb40 2024-09-19T06:21:27.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.692+0000 7fdbbffff640 1 -- 172.21.15.2:0/3551196158 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdbcc02e050 con 0x55ff59c9cb40 2024-09-19T06:21:27.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.692+0000 7fdbe9144740 10 client.17427 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:27.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.692+0000 7fdbe9144740 1 -- 172.21.15.2:0/3551196158 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ff59cb8e90 con 0x55ff59c9cb40 2024-09-19T06:21:27.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.692+0000 7fdbbffff640 1 -- 172.21.15.2:0/3551196158 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdbcc018070 con 0x55ff59c9cb40 2024-09-19T06:21:27.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.693+0000 7fdbbffff640 1 -- 172.21.15.2:0/3551196158 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fdbcc01b380 con 0x55ff59c9cb40 2024-09-19T06:21:27.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.693+0000 7fdbe9144740 10 client.17427 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:27.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.693+0000 7fdbe9144740 10 client.17427 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:21:27.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.693+0000 7fdbe9144740 20 client.17427 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:27.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.693+0000 7fdbe9144740 1 --2- 172.21.15.2:0/3551196158 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55ff59cba550 0x55ff59cbc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:27.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.693+0000 7fdbe9144740 4 client.17427 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:27.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.693+0000 7fdbe9144740 1 -- 172.21.15.2:0/3551196158 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff59c0e860 con 0x55ff59cba550 2024-09-19T06:21:27.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.693+0000 7fdbe4b07640 1 --2- 172.21.15.2:0/3551196158 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55ff59cba550 0x55ff59cbc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:27.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.693+0000 7fdbbffff640 10 client.17427 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:21:27.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.693+0000 7fdbe4b07640 1 --2- 172.21.15.2:0/3551196158 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55ff59cba550 0x55ff59cbc940 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e0886ea93814304d server_cookie=e0e522a3c2f96695 in_seq=0 out_seq=0 2024-09-19T06:21:27.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.694+0000 7fdbbffff640 1 -- 172.21.15.2:0/3551196158 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ff59c0e860 con 0x55ff59cba550 2024-09-19T06:21:27.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.694+0000 7fdbbffff640 10 client.17427 handle_command_reply: tid=0 2024-09-19T06:21:27.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.694+0000 7fdbe9144740 1 client.17427 shutdown 2024-09-19T06:21:27.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.694+0000 7fdbe9144740 1 -- 172.21.15.2:0/3551196158 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff59c9cb40 msgr2=0x55ff59ca7390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:27.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.694+0000 7fdbe9144740 1 --2- 172.21.15.2:0/3551196158 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff59c9cb40 0x55ff59ca7390 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc013b90 tx=0x7fdbcc013850 comp rx=0 tx=0).stop 2024-09-19T06:21:27.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.694+0000 7fdbe9144740 1 -- 172.21.15.2:0/3551196158 shutdown_connections 2024-09-19T06:21:27.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.694+0000 7fdbe9144740 1 --2- 172.21.15.2:0/3551196158 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55ff59cba550 0x55ff59cbc940 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:27.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.694+0000 7fdbe9144740 1 --2- 172.21.15.2:0/3551196158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff59caa780 0x55ff59ca78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:27.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.694+0000 7fdbe9144740 1 --2- 172.21.15.2:0/3551196158 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff59c9cb40 0x55ff59ca7390 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:27.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.694+0000 7fdbbffff640 0 client.17427 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:21:27.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.694+0000 7fdbe9144740 1 --2- 172.21.15.2:0/3551196158 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ff59c9b5d0 0x55ff59caa0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:27.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.694+0000 7fdbe9144740 1 -- 172.21.15.2:0/3551196158 >> 172.21.15.2:0/3551196158 conn(0x55ff59c64310 msgr2=0x55ff59c9d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:27.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.695+0000 7fdbe9144740 1 -- 172.21.15.2:0/3551196158 shutdown_connections 2024-09-19T06:21:27.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.695+0000 7fdbe9144740 1 -- 172.21.15.2:0/3551196158 wait complete. 2024-09-19T06:21:27.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.695+0000 7fdbe9144740 20 client.17427 trim_cache size 0 max 16384 2024-09-19T06:21:27.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.707+0000 7fdbe9144740 1 Processor -- start 2024-09-19T06:21:27.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.708+0000 7fdbe9144740 1 -- start start 2024-09-19T06:21:27.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.708+0000 7fdbe9144740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff59c9b5d0 0x55ff59cabb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:27.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.708+0000 7fdbe9144740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ff59c9cb40 0x55ff59cac0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:27.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.708+0000 7fdbe9144740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff59caa780 0x55ff59ca45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:27.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.708+0000 7fdbe9144740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe01aded0 con 0x55ff59c9b5d0 2024-09-19T06:21:27.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.708+0000 7fdbe9144740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe01ab7a0 con 0x55ff59caa780 2024-09-19T06:21:27.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.708+0000 7fdbe9144740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe01a9610 con 0x55ff59c9cb40 2024-09-19T06:21:27.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.708+0000 7fdbe4b07640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff59c9b5d0 0x55ff59cabb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:27.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.708+0000 7fdbe4b07640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff59c9b5d0 0x55ff59cabb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42736/0 (socket says 172.21.15.2:42736) 2024-09-19T06:21:27.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.708+0000 7fdbe4b07640 1 -- 172.21.15.2:0/2164808456 learned_addr learned my addr 172.21.15.2:0/2164808456 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:27.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.708+0000 7fdbdffff640 1 --2- 172.21.15.2:0/2164808456 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ff59c9cb40 0x55ff59cac0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:27.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.708+0000 7fdbe5308640 1 --2- 172.21.15.2:0/2164808456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff59caa780 0x55ff59ca45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:27.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.708+0000 7fdbe4b07640 1 -- 172.21.15.2:0/2164808456 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ff59c9cb40 msgr2=0x55ff59cac0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:27.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.708+0000 7fdbe4b07640 1 --2- 172.21.15.2:0/2164808456 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ff59c9cb40 0x55ff59cac0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:27.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.708+0000 7fdbe4b07640 1 -- 172.21.15.2:0/2164808456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff59caa780 msgr2=0x55ff59ca45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:27.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.708+0000 7fdbe4b07640 1 --2- 172.21.15.2:0/2164808456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff59caa780 0x55ff59ca45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:27.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.708+0000 7fdbe4b07640 1 -- 172.21.15.2:0/2164808456 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff59c98960 con 0x55ff59c9b5d0 2024-09-19T06:21:27.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.708+0000 7fdbe5308640 1 --2- 172.21.15.2:0/2164808456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff59caa780 0x55ff59ca45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:21:27.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.708+0000 7fdbe4b07640 1 --2- 172.21.15.2:0/2164808456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff59c9b5d0 0x55ff59cabb70 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fdbd409beb0 tx=0x7fdbd40bc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7817efb37695e7d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:27.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.709+0000 7fdbca7fc640 1 -- 172.21.15.2:0/2164808456 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd409c1b0 con 0x55ff59c9b5d0 2024-09-19T06:21:27.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.709+0000 7fdbca7fc640 1 -- 172.21.15.2:0/2164808456 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdbd40a0560 con 0x55ff59c9b5d0 2024-09-19T06:21:27.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.709+0000 7fdbca7fc640 1 -- 172.21.15.2:0/2164808456 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd40cd8a0 con 0x55ff59c9b5d0 2024-09-19T06:21:27.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.709+0000 7fdbe9144740 1 -- 172.21.15.2:0/2164808456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff59c9b5d0 msgr2=0x55ff59cabb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:27.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.709+0000 7fdbe9144740 1 --2- 172.21.15.2:0/2164808456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff59c9b5d0 0x55ff59cabb70 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fdbd409beb0 tx=0x7fdbd40bc040 comp rx=0 tx=0).stop 2024-09-19T06:21:27.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.709+0000 7fdbe9144740 1 -- 172.21.15.2:0/2164808456 shutdown_connections 2024-09-19T06:21:27.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.709+0000 7fdbe9144740 1 --2- 172.21.15.2:0/2164808456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff59caa780 0x55ff59ca45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:27.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.709+0000 7fdbe9144740 1 --2- 172.21.15.2:0/2164808456 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ff59c9cb40 0x55ff59cac0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:27.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.709+0000 7fdbe9144740 1 --2- 172.21.15.2:0/2164808456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff59c9b5d0 0x55ff59cabb70 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:27.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.709+0000 7fdbe9144740 1 -- 172.21.15.2:0/2164808456 >> 172.21.15.2:0/2164808456 conn(0x55ff59c64310 msgr2=0x55ff59ca5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:27.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.709+0000 7fdbe9144740 1 -- 172.21.15.2:0/2164808456 shutdown_connections 2024-09-19T06:21:27.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.709+0000 7fdbe9144740 1 -- 172.21.15.2:0/2164808456 wait complete. 2024-09-19T06:21:27.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.710+0000 7fdbe9144740 1 -- start start 2024-09-19T06:21:27.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.710+0000 7fdbe9144740 1 Processor -- start 2024-09-19T06:21:27.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.710+0000 7fdbe9144740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff59c9b5d0 0x55ff59cc02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:27.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.710+0000 7fdbe9144740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ff59c9cb40 0x55ff59cbb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:27.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.710+0000 7fdbe9144740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff59caa780 0x55ff59cbbd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:27.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.710+0000 7fdbe9144740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe01a9c60 con 0x55ff59caa780 2024-09-19T06:21:27.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.710+0000 7fdbe9144740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe01ab0d0 con 0x55ff59c9b5d0 2024-09-19T06:21:27.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.710+0000 7fdbe9144740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe01aa330 con 0x55ff59c9cb40 2024-09-19T06:21:27.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.710+0000 7fdbe9144740 10 client.0 _ll_register_callbacks cb 0x7fdbd8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:27.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.710+0000 7fdbe5308640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff59caa780 0x55ff59cbbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:27.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.710+0000 7fdbe5308640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff59caa780 0x55ff59cbbd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42752/0 (socket says 172.21.15.2:42752) 2024-09-19T06:21:27.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.710+0000 7fdbe5308640 1 -- 172.21.15.2:0/2808775268 learned_addr learned my addr 172.21.15.2:0/2808775268 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:27.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.710+0000 7fdbdffff640 1 --2- 172.21.15.2:0/2808775268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ff59c9cb40 0x55ff59cbb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:27.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.711+0000 7fdbe4b07640 1 --2- 172.21.15.2:0/2808775268 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff59c9b5d0 0x55ff59cc02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:27.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.711+0000 7fdbe5308640 1 -- 172.21.15.2:0/2808775268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ff59c9cb40 msgr2=0x55ff59cbb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:27.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.711+0000 7fdbe5308640 1 --2- 172.21.15.2:0/2808775268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ff59c9cb40 0x55ff59cbb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:27.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.711+0000 7fdbe5308640 1 -- 172.21.15.2:0/2808775268 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff59c9b5d0 msgr2=0x55ff59cc02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:27.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.711+0000 7fdbe5308640 1 --2- 172.21.15.2:0/2808775268 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff59c9b5d0 0x55ff59cc02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:27.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.711+0000 7fdbe5308640 1 -- 172.21.15.2:0/2808775268 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff59c9e120 con 0x55ff59caa780 2024-09-19T06:21:27.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.711+0000 7fdbe5308640 1 --2- 172.21.15.2:0/2808775268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff59caa780 0x55ff59cbbd60 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8009900 tx=0x7fdbd8046000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb8467547528e976 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:27.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.711+0000 7fdbbffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:27.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.711+0000 7fdbbffff640 1 -- 172.21.15.2:0/2808775268 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd8035070 con 0x55ff59caa780 2024-09-19T06:21:27.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.711+0000 7fdbbffff640 1 -- 172.21.15.2:0/2808775268 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7fdbd8003d40 con 0x55ff59caa780 2024-09-19T06:21:27.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.711+0000 7fdbe9144740 1 -- 172.21.15.2:0/2808775268 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbd40a0560 con 0x55ff59caa780 2024-09-19T06:21:27.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.711+0000 7fdbbffff640 1 -- 172.21.15.2:0/2808775268 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdbd805c050 con 0x55ff59caa780 2024-09-19T06:21:27.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.711+0000 7fdbe9144740 10 client.17433 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:27.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.711+0000 7fdbe9144740 1 -- 172.21.15.2:0/2808775268 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ff59d24e00 con 0x55ff59caa780 2024-09-19T06:21:27.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.711+0000 7fdbbffff640 1 -- 172.21.15.2:0/2808775268 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdbd40a0560 con 0x55ff59caa780 2024-09-19T06:21:27.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.712+0000 7fdbbffff640 1 -- 172.21.15.2:0/2808775268 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fdbd804b040 con 0x55ff59caa780 2024-09-19T06:21:27.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.712+0000 7fdbe9144740 10 client.17433 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:27.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.712+0000 7fdbe9144740 10 client.17433 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:21:27.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.712+0000 7fdbe9144740 20 client.17433 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:27.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.712+0000 7fdbe9144740 1 --2- 172.21.15.2:0/2808775268 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55ff59d255a0 0x55ff59d279c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:27.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.712+0000 7fdbe9144740 4 client.17433 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:21:27.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.712+0000 7fdbe9144740 1 -- 172.21.15.2:0/2808775268 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ff59c08d70 con 0x55ff59d255a0 2024-09-19T06:21:27.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.712+0000 7fdbe4b07640 1 --2- 172.21.15.2:0/2808775268 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55ff59d255a0 0x55ff59d279c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:27.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.712+0000 7fdbbffff640 10 client.17433 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:21:27.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.712+0000 7fdbe4b07640 1 --2- 172.21.15.2:0/2808775268 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55ff59d255a0 0x55ff59d279c0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1730c172a7161daf server_cookie=26417e8892af177f in_seq=0 out_seq=0 2024-09-19T06:21:27.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.713+0000 7fdbbffff640 1 -- 172.21.15.2:0/2808775268 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ff59c08d70 con 0x55ff59d255a0 2024-09-19T06:21:27.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.713+0000 7fdbbffff640 10 client.17433 handle_command_reply: tid=0 2024-09-19T06:21:27.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.713+0000 7fdbe9144740 1 client.17433 shutdown 2024-09-19T06:21:27.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.713+0000 7fdbe9144740 1 -- 172.21.15.2:0/2808775268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff59caa780 msgr2=0x55ff59cbbd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:27.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.713+0000 7fdbe9144740 1 --2- 172.21.15.2:0/2808775268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff59caa780 0x55ff59cbbd60 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8009900 tx=0x7fdbd8046000 comp rx=0 tx=0).stop 2024-09-19T06:21:27.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.713+0000 7fdbe9144740 1 -- 172.21.15.2:0/2808775268 shutdown_connections 2024-09-19T06:21:27.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.713+0000 7fdbe9144740 1 --2- 172.21.15.2:0/2808775268 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55ff59d255a0 0x55ff59d279c0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:27.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.713+0000 7fdbe9144740 1 --2- 172.21.15.2:0/2808775268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ff59caa780 0x55ff59cbbd60 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:27.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.713+0000 7fdbe9144740 1 --2- 172.21.15.2:0/2808775268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ff59c9cb40 0x55ff59cbb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:27.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.713+0000 7fdbbffff640 0 client.17433 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:21:27.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.713+0000 7fdbe9144740 1 --2- 172.21.15.2:0/2808775268 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ff59c9b5d0 0x55ff59cc02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:27.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.713+0000 7fdbe9144740 1 -- 172.21.15.2:0/2808775268 >> 172.21.15.2:0/2808775268 conn(0x55ff59c64310 msgr2=0x55ff59c9d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:27.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.713+0000 7fdbe9144740 1 -- 172.21.15.2:0/2808775268 shutdown_connections 2024-09-19T06:21:27.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.713+0000 7fdbe9144740 1 -- 172.21.15.2:0/2808775268 wait complete. 2024-09-19T06:21:27.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.713+0000 7fdbe9144740 20 client.17433 trim_cache size 0 max 16384 2024-09-19T06:21:27.723 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:21:27.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.714+0000 7fdbe6d6b640 1 -- 172.21.15.2:0/3516886959 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fdbd00a33b0 msgr2=0x7fdbd00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:27.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.714+0000 7fdbe6d6b640 1 --2- 172.21.15.2:0/3516886959 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fdbd00a33b0 0x7fdbd00a5870 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdbd80096c0 tx=0x7fdbd8032c60 comp rx=0 tx=0).stop 2024-09-19T06:21:27.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.714+0000 7fdbe6d6b640 1 -- 172.21.15.2:0/3516886959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbe0100e20 msgr2=0x7fdbe0198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:27.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.714+0000 7fdbe6d6b640 1 --2- 172.21.15.2:0/3516886959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbe0100e20 0x7fdbe0198410 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fdbd400cce0 tx=0x7fdbd400a620 comp rx=0 tx=0).stop 2024-09-19T06:21:27.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.714+0000 7fdbe6d6b640 1 -- 172.21.15.2:0/3516886959 shutdown_connections 2024-09-19T06:21:27.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.714+0000 7fdbe6d6b640 1 --2- 172.21.15.2:0/3516886959 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fdbd00a33b0 0x7fdbd00a5870 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:27.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.714+0000 7fdbe6d6b640 1 --2- 172.21.15.2:0/3516886959 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbe0102ef0 0x7fdbe019cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:27.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.714+0000 7fdbe6d6b640 1 --2- 172.21.15.2:0/3516886959 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbe0102570 0x7fdbe0198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:27.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.714+0000 7fdbe6d6b640 1 --2- 172.21.15.2:0/3516886959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbe0100e20 0x7fdbe0198410 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:27.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.714+0000 7fdbe6d6b640 1 -- 172.21.15.2:0/3516886959 >> 172.21.15.2:0/3516886959 conn(0x7fdbe00fc7d0 msgr2=0x7fdbe00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:27.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.714+0000 7fdbe6d6b640 1 -- 172.21.15.2:0/3516886959 shutdown_connections 2024-09-19T06:21:27.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:27.714+0000 7fdbe6d6b640 1 -- 172.21.15.2:0/3516886959 wait complete. 2024-09-19T06:21:28.558 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:21:28.814 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:29.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.257+0000 7fa84a4cc640 1 -- 172.21.15.2:0/2300590876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa844106f30 msgr2=0x7fa84410eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:29.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.257+0000 7fa84a4cc640 1 --2- 172.21.15.2:0/2300590876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa844106f30 0x7fa84410eab0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fa83c009ca0 tx=0x7fa83c02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:21:29.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.257+0000 7fa84a4cc640 1 -- 172.21.15.2:0/2300590876 shutdown_connections 2024-09-19T06:21:29.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.257+0000 7fa84a4cc640 1 --2- 172.21.15.2:0/2300590876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa844106f30 0x7fa84410eab0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:29.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.257+0000 7fa84a4cc640 1 --2- 172.21.15.2:0/2300590876 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa844100cc0 0x7fa844106800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:29.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.257+0000 7fa84a4cc640 1 --2- 172.21.15.2:0/2300590876 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa844100310 0x7fa8441006f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:29.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.257+0000 7fa84a4cc640 1 -- 172.21.15.2:0/2300590876 >> 172.21.15.2:0/2300590876 conn(0x7fa844077210 msgr2=0x7fa8440fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:29.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.257+0000 7fa84a4cc640 1 -- 172.21.15.2:0/2300590876 shutdown_connections 2024-09-19T06:21:29.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.257+0000 7fa84a4cc640 1 -- 172.21.15.2:0/2300590876 wait complete. 2024-09-19T06:21:29.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.258+0000 7fa84a4cc640 1 Processor -- start 2024-09-19T06:21:29.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.258+0000 7fa84a4cc640 1 -- start start 2024-09-19T06:21:29.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.258+0000 7fa84a4cc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa844100310 0x7fa8441983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:29.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.258+0000 7fa84a4cc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa844100cc0 0x7fa844198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:29.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.258+0000 7fa84a4cc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa844106f30 0x7fa84419cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:29.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.258+0000 7fa84a4cc640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa844111e40 con 0x7fa844106f30 2024-09-19T06:21:29.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.258+0000 7fa84a4cc640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa844111cc0 con 0x7fa844100cc0 2024-09-19T06:21:29.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.258+0000 7fa84a4cc640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa844111fc0 con 0x7fa844100310 2024-09-19T06:21:29.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.258+0000 7fa848a69640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa844106f30 0x7fa84419cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:29.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.258+0000 7fa848a69640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa844106f30 0x7fa84419cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42778/0 (socket says 172.21.15.2:42778) 2024-09-19T06:21:29.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.258+0000 7fa848a69640 1 -- 172.21.15.2:0/3934442955 learned_addr learned my addr 172.21.15.2:0/3934442955 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:29.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.258+0000 7fa843fff640 1 --2- 172.21.15.2:0/3934442955 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa844100310 0x7fa8441983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:29.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.259+0000 7fa83bfff640 1 --2- 172.21.15.2:0/3934442955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa844100cc0 0x7fa844198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:29.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.259+0000 7fa848a69640 1 -- 172.21.15.2:0/3934442955 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa844100310 msgr2=0x7fa8441983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:29.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.259+0000 7fa848a69640 1 --2- 172.21.15.2:0/3934442955 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa844100310 0x7fa8441983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:29.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.259+0000 7fa848a69640 1 -- 172.21.15.2:0/3934442955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa844100cc0 msgr2=0x7fa844198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:29.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.259+0000 7fa848a69640 1 --2- 172.21.15.2:0/3934442955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa844100cc0 0x7fa844198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:29.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.259+0000 7fa848a69640 1 -- 172.21.15.2:0/3934442955 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa84419d370 con 0x7fa844106f30 2024-09-19T06:21:29.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.259+0000 7fa83bfff640 1 --2- 172.21.15.2:0/3934442955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa844100cc0 0x7fa844198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:21:29.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.259+0000 7fa848a69640 1 --2- 172.21.15.2:0/3934442955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa844106f30 0x7fa84419cc90 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fa83c009dc0 tx=0x7fa83c032ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:29.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.259+0000 7fa841ffb640 1 -- 172.21.15.2:0/3934442955 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa83c003bf0 con 0x7fa844106f30 2024-09-19T06:21:29.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.259+0000 7fa841ffb640 1 -- 172.21.15.2:0/3934442955 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa83c003d90 con 0x7fa844106f30 2024-09-19T06:21:29.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.259+0000 7fa841ffb640 1 -- 172.21.15.2:0/3934442955 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa83c030b80 con 0x7fa844106f30 2024-09-19T06:21:29.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.259+0000 7fa84a4cc640 1 -- 172.21.15.2:0/3934442955 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa84419d600 con 0x7fa844106f30 2024-09-19T06:21:29.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.259+0000 7fa84a4cc640 1 -- 172.21.15.2:0/3934442955 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8441a4f40 con 0x7fa844106f30 2024-09-19T06:21:29.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.262+0000 7fa841ffb640 1 -- 172.21.15.2:0/3934442955 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fa83c004040 con 0x7fa844106f30 2024-09-19T06:21:29.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.262+0000 7fa84c8a5740 1 Processor -- start 2024-09-19T06:21:29.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.262+0000 7fa84c8a5740 1 -- start start 2024-09-19T06:21:29.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.262+0000 7fa84c8a5740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a860ec9b40 0x55a860ec8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:29.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.262+0000 7fa84c8a5740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a860ec85d0 0x55a860ec8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:29.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.262+0000 7fa84c8a5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a860ed3370 0x55a860ed5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:29.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.262+0000 7fa84c8a5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a860e2e2f0 con 0x55a860ed3370 2024-09-19T06:21:29.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.262+0000 7fa84c8a5740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55a860dd5cf0 con 0x55a860ec9b40 2024-09-19T06:21:29.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.262+0000 7fa84c8a5740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55a860e2a2b0 con 0x55a860ec85d0 2024-09-19T06:21:29.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.262+0000 7fa83bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a860ed3370 0x55a860ed5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:29.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.262+0000 7fa83bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a860ed3370 0x55a860ed5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42792/0 (socket says 172.21.15.2:42792) 2024-09-19T06:21:29.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.262+0000 7fa83bfff640 1 -- 172.21.15.2:0/2239108903 learned_addr learned my addr 172.21.15.2:0/2239108903 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:29.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.262+0000 7fa83bfff640 1 --2- 172.21.15.2:0/2239108903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a860ec9b40 0x55a860ec8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:29.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.262+0000 7fa843fff640 1 --2- 172.21.15.2:0/2239108903 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a860ec85d0 0x55a860ec8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:29.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.263+0000 7fa841ffb640 1 --2- 172.21.15.2:0/3934442955 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa8300a3430 0x7fa8300a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:29.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.263+0000 7fa83bfff640 1 -- 172.21.15.2:0/2239108903 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a860ec85d0 msgr2=0x55a860ec8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:29.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.263+0000 7fa83bfff640 1 --2- 172.21.15.2:0/2239108903 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a860ec85d0 0x55a860ec8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:29.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.263+0000 7fa83bfff640 1 -- 172.21.15.2:0/2239108903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a860ec9b40 msgr2=0x55a860ec8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:29.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.263+0000 7fa83bfff640 1 --2- 172.21.15.2:0/2239108903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a860ec9b40 0x55a860ec8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:29.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.263+0000 7fa83bfff640 1 -- 172.21.15.2:0/2239108903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a860dba3a0 con 0x55a860ed3370 2024-09-19T06:21:29.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.263+0000 7fa848a69640 1 --2- 172.21.15.2:0/3934442955 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa8300a3430 0x7fa8300a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:29.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.263+0000 7fa83bfff640 1 --2- 172.21.15.2:0/2239108903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a860ed3370 0x55a860ed5760 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0148b0 tx=0x7fa82c0095f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3447b607cf1642e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:29.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.263+0000 7fa841ffb640 1 -- 172.21.15.2:0/3934442955 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7fa83c0f1230 con 0x7fa844106f30 2024-09-19T06:21:29.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.263+0000 7fa83a7fc640 1 -- 172.21.15.2:0/2239108903 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82c014e30 con 0x55a860ed3370 2024-09-19T06:21:29.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.263+0000 7fa83a7fc640 1 -- 172.21.15.2:0/2239108903 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa82c00f760 con 0x55a860ed3370 2024-09-19T06:21:29.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.263+0000 7fa83a7fc640 1 -- 172.21.15.2:0/2239108903 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82c0044e0 con 0x55a860ed3370 2024-09-19T06:21:29.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.264+0000 7fa84c8a5740 1 -- 172.21.15.2:0/2239108903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a860ed3370 msgr2=0x55a860ed5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:29.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.264+0000 7fa84c8a5740 1 --2- 172.21.15.2:0/2239108903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a860ed3370 0x55a860ed5760 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0148b0 tx=0x7fa82c0095f0 comp rx=0 tx=0).stop 2024-09-19T06:21:29.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.264+0000 7fa848a69640 1 --2- 172.21.15.2:0/3934442955 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa8300a3430 0x7fa8300a58f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa83c0bd5b0 tx=0x7fa83c0b99f0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:29.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.264+0000 7fa84c8a5740 1 -- 172.21.15.2:0/2239108903 shutdown_connections 2024-09-19T06:21:29.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.264+0000 7fa84c8a5740 1 --2- 172.21.15.2:0/2239108903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a860ed3370 0x55a860ed5760 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:29.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.264+0000 7fa84c8a5740 1 --2- 172.21.15.2:0/2239108903 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a860ec85d0 0x55a860ec8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:29.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.264+0000 7fa84c8a5740 1 --2- 172.21.15.2:0/2239108903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a860ec9b40 0x55a860ec8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:29.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.264+0000 7fa84c8a5740 1 -- 172.21.15.2:0/2239108903 >> 172.21.15.2:0/2239108903 conn(0x55a860e91310 msgr2=0x55a860ec4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:29.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.264+0000 7fa84c8a5740 1 -- 172.21.15.2:0/2239108903 shutdown_connections 2024-09-19T06:21:29.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.264+0000 7fa84c8a5740 1 -- 172.21.15.2:0/2239108903 wait complete. 2024-09-19T06:21:29.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.264+0000 7fa84c8a5740 1 -- start start 2024-09-19T06:21:29.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.265+0000 7fa84c8a5740 1 Processor -- start 2024-09-19T06:21:29.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.265+0000 7fa84c8a5740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a860ec85d0 0x55a860ed2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:29.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.265+0000 7fa84c8a5740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a860ec9b40 0x55a860ed0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:29.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.265+0000 7fa84c8a5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a860ed3370 0x55a860ed0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:29.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.265+0000 7fa84c8a5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a860ed6070 con 0x55a860ed3370 2024-09-19T06:21:29.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.265+0000 7fa84c8a5740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55a860de9060 con 0x55a860ec9b40 2024-09-19T06:21:29.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.265+0000 7fa84c8a5740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55a860ed61f0 con 0x55a860ec85d0 2024-09-19T06:21:29.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.265+0000 7fa84c8a5740 10 client.0 _ll_register_callbacks cb 0x55a860b3c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:29.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.265+0000 7fa83bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a860ed3370 0x55a860ed0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:29.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.265+0000 7fa83bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a860ed3370 0x55a860ed0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42804/0 (socket says 172.21.15.2:42804) 2024-09-19T06:21:29.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.265+0000 7fa83bfff640 1 -- 172.21.15.2:0/3751659458 learned_addr learned my addr 172.21.15.2:0/3751659458 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:29.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.265+0000 7fa83bfff640 1 --2- 172.21.15.2:0/3751659458 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a860ec85d0 0x55a860ed2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:29.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.265+0000 7fa843fff640 1 --2- 172.21.15.2:0/3751659458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a860ec9b40 0x55a860ed0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:29.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.265+0000 7fa83bfff640 1 -- 172.21.15.2:0/3751659458 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a860ec85d0 msgr2=0x55a860ed2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:29.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.265+0000 7fa83bfff640 1 --2- 172.21.15.2:0/3751659458 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a860ec85d0 0x55a860ed2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:29.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.265+0000 7fa83bfff640 1 -- 172.21.15.2:0/3751659458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a860ec9b40 msgr2=0x55a860ed0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:29.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.265+0000 7fa83bfff640 1 --2- 172.21.15.2:0/3751659458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a860ec9b40 0x55a860ed0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:29.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.265+0000 7fa83bfff640 1 -- 172.21.15.2:0/3751659458 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a860b9f3c0 con 0x55a860ed3370 2024-09-19T06:21:29.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.266+0000 7fa83bfff640 1 --2- 172.21.15.2:0/3751659458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a860ed3370 0x55a860ed0810 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fa82c014420 tx=0x7fa82c005f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac916d104cdb74d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:29.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.266+0000 7fa8237fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:29.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.266+0000 7fa8237fe640 1 -- 172.21.15.2:0/3751659458 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82c0052f0 con 0x55a860ed3370 2024-09-19T06:21:29.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.266+0000 7fa8237fe640 1 -- 172.21.15.2:0/3751659458 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7fa82c005490 con 0x55a860ed3370 2024-09-19T06:21:29.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.266+0000 7fa84c8a5740 1 -- 172.21.15.2:0/3751659458 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa82c00f760 con 0x55a860ed3370 2024-09-19T06:21:29.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.266+0000 7fa8237fe640 1 -- 172.21.15.2:0/3751659458 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa82c033050 con 0x55a860ed3370 2024-09-19T06:21:29.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.266+0000 7fa84c8a5740 10 client.17445 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:29.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.266+0000 7fa84c8a5740 1 -- 172.21.15.2:0/3751659458 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a860ee1b90 con 0x55a860ed3370 2024-09-19T06:21:29.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.266+0000 7fa8237fe640 1 -- 172.21.15.2:0/3751659458 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa82c00f760 con 0x55a860ed3370 2024-09-19T06:21:29.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.266+0000 7fa8237fe640 1 -- 172.21.15.2:0/3751659458 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fa82c0039c0 con 0x55a860ed3370 2024-09-19T06:21:29.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.266+0000 7fa84c8a5740 10 client.17445 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:29.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.266+0000 7fa84c8a5740 10 client.17445 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:29.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.266+0000 7fa84c8a5740 20 client.17445 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:29.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.266+0000 7fa84c8a5740 1 --2- 172.21.15.2:0/3751659458 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a860ee2f40 0x55a860ee5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:29.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.266+0000 7fa84c8a5740 4 client.17445 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:29.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.266+0000 7fa84c8a5740 1 -- 172.21.15.2:0/3751659458 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a860e3b860 con 0x55a860ee2f40 2024-09-19T06:21:29.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.267+0000 7fa843fff640 1 --2- 172.21.15.2:0/3751659458 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a860ee2f40 0x55a860ee5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:29.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.267+0000 7fa843fff640 1 --2- 172.21.15.2:0/3751659458 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a860ee2f40 0x55a860ee5330 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98ff4ea3df0d0fe3 server_cookie=2cb990376270c7b8 in_seq=0 out_seq=0 2024-09-19T06:21:29.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.267+0000 7fa8237fe640 10 client.17445 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:29.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.268+0000 7fa8237fe640 1 -- 172.21.15.2:0/3751659458 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a860e3b860 con 0x55a860ee2f40 2024-09-19T06:21:29.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.268+0000 7fa8237fe640 10 client.17445 handle_command_reply: tid=0 2024-09-19T06:21:29.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.268+0000 7fa84c8a5740 1 client.17445 shutdown 2024-09-19T06:21:29.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.268+0000 7fa84c8a5740 1 -- 172.21.15.2:0/3751659458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a860ed3370 msgr2=0x55a860ed0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:29.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.268+0000 7fa84c8a5740 1 --2- 172.21.15.2:0/3751659458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a860ed3370 0x55a860ed0810 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fa82c014420 tx=0x7fa82c005f50 comp rx=0 tx=0).stop 2024-09-19T06:21:29.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.268+0000 7fa84c8a5740 1 -- 172.21.15.2:0/3751659458 shutdown_connections 2024-09-19T06:21:29.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.268+0000 7fa84c8a5740 1 --2- 172.21.15.2:0/3751659458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a860ed3370 0x55a860ed0810 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:29.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.268+0000 7fa84c8a5740 1 --2- 172.21.15.2:0/3751659458 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a860ee2f40 0x55a860ee5330 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:29.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.268+0000 7fa84c8a5740 1 --2- 172.21.15.2:0/3751659458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a860ec9b40 0x55a860ed0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:29.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.268+0000 7fa84c8a5740 1 --2- 172.21.15.2:0/3751659458 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a860ec85d0 0x55a860ed2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:29.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.268+0000 7fa8237fe640 0 client.17445 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:29.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.268+0000 7fa84c8a5740 1 -- 172.21.15.2:0/3751659458 >> 172.21.15.2:0/3751659458 conn(0x55a860e91310 msgr2=0x55a860eca990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:29.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.268+0000 7fa84c8a5740 1 -- 172.21.15.2:0/3751659458 shutdown_connections 2024-09-19T06:21:29.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.268+0000 7fa84c8a5740 1 -- 172.21.15.2:0/3751659458 wait complete. 2024-09-19T06:21:29.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.268+0000 7fa84c8a5740 20 client.17445 trim_cache size 0 max 16384 2024-09-19T06:21:29.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.282+0000 7fa84c8a5740 1 Processor -- start 2024-09-19T06:21:29.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.282+0000 7fa84c8a5740 1 -- start start 2024-09-19T06:21:29.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.282+0000 7fa84c8a5740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a860ec85d0 0x55a860ebfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:29.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.282+0000 7fa84c8a5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a860ec9b40 0x55a860ecf940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:29.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.282+0000 7fa84c8a5740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a860ed3370 0x55a860ecb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:29.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.282+0000 7fa84c8a5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa8441b0030 con 0x55a860ec9b40 2024-09-19T06:21:29.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.282+0000 7fa84c8a5740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa8441ad900 con 0x55a860ec85d0 2024-09-19T06:21:29.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.282+0000 7fa84c8a5740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa8441ab770 con 0x55a860ed3370 2024-09-19T06:21:29.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.282+0000 7fa843fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a860ec9b40 0x55a860ecf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:29.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.282+0000 7fa843fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a860ec9b40 0x55a860ecf940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42814/0 (socket says 172.21.15.2:42814) 2024-09-19T06:21:29.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.282+0000 7fa843fff640 1 -- 172.21.15.2:0/2612360578 learned_addr learned my addr 172.21.15.2:0/2612360578 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:29.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.282+0000 7fa83bfff640 1 --2- 172.21.15.2:0/2612360578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a860ec85d0 0x55a860ebfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:29.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.282+0000 7fa83bfff640 1 --2- 172.21.15.2:0/2612360578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a860ed3370 0x55a860ecb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:29.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.282+0000 7fa843fff640 1 -- 172.21.15.2:0/2612360578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a860ed3370 msgr2=0x55a860ecb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:29.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.282+0000 7fa843fff640 1 --2- 172.21.15.2:0/2612360578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a860ed3370 0x55a860ecb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:29.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.282+0000 7fa843fff640 1 -- 172.21.15.2:0/2612360578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a860ec85d0 msgr2=0x55a860ebfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:29.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.282+0000 7fa843fff640 1 --2- 172.21.15.2:0/2612360578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a860ec85d0 0x55a860ebfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:29.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.282+0000 7fa843fff640 1 -- 172.21.15.2:0/2612360578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a860ece5d0 con 0x55a860ec9b40 2024-09-19T06:21:29.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.283+0000 7fa843fff640 1 --2- 172.21.15.2:0/2612360578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a860ec9b40 0x55a860ecf940 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fa83400b880 tx=0x7fa83400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bdd2086f5924352 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:29.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.283+0000 7fa839ffb640 1 -- 172.21.15.2:0/2612360578 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa834022030 con 0x55a860ec9b40 2024-09-19T06:21:29.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.283+0000 7fa839ffb640 1 -- 172.21.15.2:0/2612360578 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa8340054d0 con 0x55a860ec9b40 2024-09-19T06:21:29.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.283+0000 7fa839ffb640 1 -- 172.21.15.2:0/2612360578 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa834004c60 con 0x55a860ec9b40 2024-09-19T06:21:29.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.284+0000 7fa84c8a5740 1 -- 172.21.15.2:0/2612360578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a860ec9b40 msgr2=0x55a860ecf940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:29.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.284+0000 7fa84c8a5740 1 --2- 172.21.15.2:0/2612360578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a860ec9b40 0x55a860ecf940 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fa83400b880 tx=0x7fa83400be20 comp rx=0 tx=0).stop 2024-09-19T06:21:29.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.284+0000 7fa84c8a5740 1 -- 172.21.15.2:0/2612360578 shutdown_connections 2024-09-19T06:21:29.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.284+0000 7fa84c8a5740 1 --2- 172.21.15.2:0/2612360578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a860ed3370 0x55a860ecb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:29.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.284+0000 7fa84c8a5740 1 --2- 172.21.15.2:0/2612360578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a860ec9b40 0x55a860ecf940 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:29.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.284+0000 7fa84c8a5740 1 --2- 172.21.15.2:0/2612360578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a860ec85d0 0x55a860ebfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:29.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.284+0000 7fa84c8a5740 1 -- 172.21.15.2:0/2612360578 >> 172.21.15.2:0/2612360578 conn(0x55a860e91310 msgr2=0x55a860ecf170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:29.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.284+0000 7fa84c8a5740 1 -- 172.21.15.2:0/2612360578 shutdown_connections 2024-09-19T06:21:29.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.284+0000 7fa84c8a5740 1 -- 172.21.15.2:0/2612360578 wait complete. 2024-09-19T06:21:29.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.285+0000 7fa84c8a5740 1 -- start start 2024-09-19T06:21:29.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.285+0000 7fa84c8a5740 1 Processor -- start 2024-09-19T06:21:29.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.285+0000 7fa84c8a5740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a860ec85d0 0x55a860edb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:29.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.285+0000 7fa84c8a5740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a860ec9b40 0x55a860edb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:29.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.285+0000 7fa84c8a5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a860ed3370 0x55a860ecc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:29.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.285+0000 7fa84c8a5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa8441abdc0 con 0x55a860ed3370 2024-09-19T06:21:29.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.285+0000 7fa84c8a5740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa8441ad230 con 0x55a860ec85d0 2024-09-19T06:21:29.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.285+0000 7fa84c8a5740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa8441ac490 con 0x55a860ec9b40 2024-09-19T06:21:29.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.285+0000 7fa84c8a5740 10 client.0 _ll_register_callbacks cb 0x7fa82c009e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:29.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.285+0000 7fa83bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a860ed3370 0x55a860ecc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:29.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.285+0000 7fa843fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a860ec9b40 0x55a860edb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:29.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.285+0000 7fa83bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a860ed3370 0x55a860ecc6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42818/0 (socket says 172.21.15.2:42818) 2024-09-19T06:21:29.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.285+0000 7fa83bfff640 1 -- 172.21.15.2:0/4069939794 learned_addr learned my addr 172.21.15.2:0/4069939794 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:29.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.285+0000 7fa83bfff640 1 --2- 172.21.15.2:0/4069939794 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a860ec85d0 0x55a860edb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:29.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.286+0000 7fa83bfff640 1 -- 172.21.15.2:0/4069939794 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a860ec9b40 msgr2=0x55a860edb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:29.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.286+0000 7fa83bfff640 1 --2- 172.21.15.2:0/4069939794 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a860ec9b40 0x55a860edb9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:29.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.286+0000 7fa83bfff640 1 -- 172.21.15.2:0/4069939794 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a860ec85d0 msgr2=0x55a860edb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:29.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.286+0000 7fa83bfff640 1 --2- 172.21.15.2:0/4069939794 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a860ec85d0 0x55a860edb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:29.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.286+0000 7fa83bfff640 1 -- 172.21.15.2:0/4069939794 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a860ecccf0 con 0x55a860ed3370 2024-09-19T06:21:29.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.286+0000 7fa83bfff640 1 --2- 172.21.15.2:0/4069939794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a860ed3370 0x55a860ecc6b0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fa82c012720 tx=0x7fa82c005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b509a11ac23c29b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:29.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.286+0000 7fa8237fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:29.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.286+0000 7fa8237fe640 1 -- 172.21.15.2:0/4069939794 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82c0052f0 con 0x55a860ed3370 2024-09-19T06:21:29.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.286+0000 7fa8237fe640 1 -- 172.21.15.2:0/4069939794 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7fa82c005490 con 0x55a860ed3370 2024-09-19T06:21:29.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.286+0000 7fa84c8a5740 1 -- 172.21.15.2:0/4069939794 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8340054d0 con 0x55a860ed3370 2024-09-19T06:21:29.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.286+0000 7fa8237fe640 1 -- 172.21.15.2:0/4069939794 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa82c048050 con 0x55a860ed3370 2024-09-19T06:21:29.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.286+0000 7fa84c8a5740 10 client.17451 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:29.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.286+0000 7fa84c8a5740 1 -- 172.21.15.2:0/4069939794 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a860f4d380 con 0x55a860ed3370 2024-09-19T06:21:29.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.286+0000 7fa8237fe640 1 -- 172.21.15.2:0/4069939794 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa8340054d0 con 0x55a860ed3370 2024-09-19T06:21:29.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.287+0000 7fa8237fe640 1 -- 172.21.15.2:0/4069939794 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fa82c012960 con 0x55a860ed3370 2024-09-19T06:21:29.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.287+0000 7fa84c8a5740 10 client.17451 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:29.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.287+0000 7fa84c8a5740 10 client.17451 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:29.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.287+0000 7fa84c8a5740 20 client.17451 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:29.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.287+0000 7fa84c8a5740 1 --2- 172.21.15.2:0/4069939794 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a860f4da10 0x55a860f4fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:29.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.287+0000 7fa84c8a5740 4 client.17451 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:21:29.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.287+0000 7fa84c8a5740 1 -- 172.21.15.2:0/4069939794 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a860e35d70 con 0x55a860f4da10 2024-09-19T06:21:29.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.287+0000 7fa843fff640 1 --2- 172.21.15.2:0/4069939794 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a860f4da10 0x55a860f4fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:29.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.287+0000 7fa843fff640 1 --2- 172.21.15.2:0/4069939794 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a860f4da10 0x55a860f4fe30 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba0d311287f037e server_cookie=600fc043d40f89 in_seq=0 out_seq=0 2024-09-19T06:21:29.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.287+0000 7fa8237fe640 10 client.17451 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:29.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.288+0000 7fa8237fe640 1 -- 172.21.15.2:0/4069939794 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a860e35d70 con 0x55a860f4da10 2024-09-19T06:21:29.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.288+0000 7fa8237fe640 10 client.17451 handle_command_reply: tid=0 2024-09-19T06:21:29.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.288+0000 7fa84c8a5740 1 client.17451 shutdown 2024-09-19T06:21:29.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.288+0000 7fa84c8a5740 1 -- 172.21.15.2:0/4069939794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a860ed3370 msgr2=0x55a860ecc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:29.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.288+0000 7fa84c8a5740 1 --2- 172.21.15.2:0/4069939794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a860ed3370 0x55a860ecc6b0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fa82c012720 tx=0x7fa82c005710 comp rx=0 tx=0).stop 2024-09-19T06:21:29.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.288+0000 7fa84c8a5740 1 -- 172.21.15.2:0/4069939794 shutdown_connections 2024-09-19T06:21:29.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.288+0000 7fa84c8a5740 1 --2- 172.21.15.2:0/4069939794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a860ed3370 0x55a860ecc6b0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:29.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.288+0000 7fa84c8a5740 1 --2- 172.21.15.2:0/4069939794 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a860ec9b40 0x55a860edb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:29.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.288+0000 7fa84c8a5740 1 --2- 172.21.15.2:0/4069939794 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a860f4da10 0x55a860f4fe30 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:29.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.288+0000 7fa84c8a5740 1 --2- 172.21.15.2:0/4069939794 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a860ec85d0 0x55a860edb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:29.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.288+0000 7fa8237fe640 0 client.17451 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:29.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.288+0000 7fa84c8a5740 1 -- 172.21.15.2:0/4069939794 >> 172.21.15.2:0/4069939794 conn(0x55a860e91310 msgr2=0x55a860ecf170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:29.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.288+0000 7fa84c8a5740 1 -- 172.21.15.2:0/4069939794 shutdown_connections 2024-09-19T06:21:29.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.288+0000 7fa84c8a5740 1 -- 172.21.15.2:0/4069939794 wait complete. 2024-09-19T06:21:29.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.288+0000 7fa84c8a5740 20 client.17451 trim_cache size 0 max 16384 2024-09-19T06:21:29.294 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:21:29.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.289+0000 7fa84a4cc640 1 -- 172.21.15.2:0/3934442955 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa8300a3430 msgr2=0x7fa8300a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:29.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.289+0000 7fa84a4cc640 1 --2- 172.21.15.2:0/3934442955 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa8300a3430 0x7fa8300a58f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa83c0bd5b0 tx=0x7fa83c0b99f0 comp rx=0 tx=0).stop 2024-09-19T06:21:29.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.289+0000 7fa84a4cc640 1 -- 172.21.15.2:0/3934442955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa844106f30 msgr2=0x7fa84419cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:29.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.289+0000 7fa84a4cc640 1 --2- 172.21.15.2:0/3934442955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa844106f30 0x7fa84419cc90 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fa83c009dc0 tx=0x7fa83c032ff0 comp rx=0 tx=0).stop 2024-09-19T06:21:29.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.289+0000 7fa84a4cc640 1 -- 172.21.15.2:0/3934442955 shutdown_connections 2024-09-19T06:21:29.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.289+0000 7fa84a4cc640 1 --2- 172.21.15.2:0/3934442955 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa8300a3430 0x7fa8300a58f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:29.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.289+0000 7fa84a4cc640 1 --2- 172.21.15.2:0/3934442955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa844106f30 0x7fa84419cc90 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:29.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.289+0000 7fa84a4cc640 1 --2- 172.21.15.2:0/3934442955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa844100cc0 0x7fa844198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:29.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.289+0000 7fa84a4cc640 1 --2- 172.21.15.2:0/3934442955 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa844100310 0x7fa8441983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:29.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.289+0000 7fa84a4cc640 1 -- 172.21.15.2:0/3934442955 >> 172.21.15.2:0/3934442955 conn(0x7fa844077210 msgr2=0x7fa844105150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:29.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.289+0000 7fa84a4cc640 1 -- 172.21.15.2:0/3934442955 shutdown_connections 2024-09-19T06:21:29.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:29.289+0000 7fa84a4cc640 1 -- 172.21.15.2:0/3934442955 wait complete. 2024-09-19T06:21:29.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:29 smithi089 ceph-mon[34160]: pgmap v205: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:21:29.619 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:29 smithi002 ceph-mon[30982]: pgmap v205: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:21:29.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:29 smithi090 ceph-mon[34497]: pgmap v205: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:21:30.995 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:21:30.996 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:21:31.268 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:31.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:31 smithi089 ceph-mon[34160]: pgmap v206: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:21:31.616 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:31 smithi002 ceph-mon[30982]: pgmap v206: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:21:31.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.700+0000 7f473e241640 1 -- 172.21.15.2:0/1058734855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4738101de0 msgr2=0x7f47381021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:31.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.700+0000 7f473e241640 1 --2- 172.21.15.2:0/1058734855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4738101de0 0x7f47381021c0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f4728009900 tx=0x7f472802a410 comp rx=0 tx=0).stop 2024-09-19T06:21:31.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.700+0000 7f473e241640 1 -- 172.21.15.2:0/1058734855 shutdown_connections 2024-09-19T06:21:31.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.700+0000 7f473e241640 1 --2- 172.21.15.2:0/1058734855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4738106f10 0x7f473810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:31.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.700+0000 7f473e241640 1 --2- 172.21.15.2:0/1058734855 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4738102790 0x7f47381067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:31.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.700+0000 7f473e241640 1 --2- 172.21.15.2:0/1058734855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4738101de0 0x7f47381021c0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:31.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.700+0000 7f473e241640 1 -- 172.21.15.2:0/1058734855 >> 172.21.15.2:0/1058734855 conn(0x7f47380fd8c0 msgr2=0x7f47380ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:31.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.700+0000 7f473e241640 1 -- 172.21.15.2:0/1058734855 shutdown_connections 2024-09-19T06:21:31.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.700+0000 7f473e241640 1 -- 172.21.15.2:0/1058734855 wait complete. 2024-09-19T06:21:31.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.700+0000 7f473e241640 1 Processor -- start 2024-09-19T06:21:31.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.701+0000 7f473e241640 1 -- start start 2024-09-19T06:21:31.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.701+0000 7f473e241640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4738101de0 0x7f4738198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:31.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.701+0000 7f473e241640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4738102790 0x7f47381988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:31.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.701+0000 7f473e241640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4738106f10 0x7f473819cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:31.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.701+0000 7f473e241640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4738111de0 con 0x7f4738106f10 2024-09-19T06:21:31.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.701+0000 7f473e241640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4738111c60 con 0x7f4738101de0 2024-09-19T06:21:31.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.701+0000 7f473e241640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4738111f60 con 0x7f4738102790 2024-09-19T06:21:31.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.701+0000 7f4737fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4738106f10 0x7f473819cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:31.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.701+0000 7f4737fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4738106f10 0x7f473819cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42836/0 (socket says 172.21.15.2:42836) 2024-09-19T06:21:31.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.701+0000 7f4737fff640 1 -- 172.21.15.2:0/1975101361 learned_addr learned my addr 172.21.15.2:0/1975101361 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:31.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.701+0000 7f472effd640 1 --2- 172.21.15.2:0/1975101361 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4738102790 0x7f47381988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:31.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.701+0000 7f47377fe640 1 --2- 172.21.15.2:0/1975101361 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4738101de0 0x7f4738198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:31.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.701+0000 7f4737fff640 1 -- 172.21.15.2:0/1975101361 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4738102790 msgr2=0x7f47381988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:31.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.701+0000 7f4737fff640 1 --2- 172.21.15.2:0/1975101361 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4738102790 0x7f47381988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:31.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.701+0000 7f4737fff640 1 -- 172.21.15.2:0/1975101361 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4738101de0 msgr2=0x7f4738198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:31.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.701+0000 7f4737fff640 1 --2- 172.21.15.2:0/1975101361 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4738101de0 0x7f4738198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:31.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.701+0000 7f4737fff640 1 -- 172.21.15.2:0/1975101361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f473819d330 con 0x7f4738106f10 2024-09-19T06:21:31.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.701+0000 7f47377fe640 1 --2- 172.21.15.2:0/1975101361 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4738101de0 0x7f4738198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:21:31.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.701+0000 7f4737fff640 1 --2- 172.21.15.2:0/1975101361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4738106f10 0x7f473819cc50 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f473000eb10 tx=0x7f473000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:31.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.702+0000 7f47357fa640 1 -- 172.21.15.2:0/1975101361 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4730004b20 con 0x7f4738106f10 2024-09-19T06:21:31.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.702+0000 7f473e241640 1 -- 172.21.15.2:0/1975101361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f473819d620 con 0x7f4738106f10 2024-09-19T06:21:31.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.702+0000 7f47357fa640 1 -- 172.21.15.2:0/1975101361 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4730004cc0 con 0x7f4738106f10 2024-09-19T06:21:31.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.702+0000 7f47357fa640 1 -- 172.21.15.2:0/1975101361 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4730010690 con 0x7f4738106f10 2024-09-19T06:21:31.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.702+0000 7f473e241640 1 -- 172.21.15.2:0/1975101361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47381a4f00 con 0x7f4738106f10 2024-09-19T06:21:31.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.704+0000 7f47357fa640 1 -- 172.21.15.2:0/1975101361 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f4730005020 con 0x7f4738106f10 2024-09-19T06:21:31.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.704+0000 7f474061a740 1 Processor -- start 2024-09-19T06:21:31.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.704+0000 7f474061a740 1 -- start start 2024-09-19T06:21:31.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.705+0000 7f474061a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca76383a60 0x55ca76383e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:31.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.705+0000 7f474061a740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca76384380 0x55ca76392c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:31.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.705+0000 7f474061a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca76393150 0x55ca76395540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:31.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.705+0000 7f474061a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ca762e9280 con 0x55ca76383a60 2024-09-19T06:21:31.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.705+0000 7f474061a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55ca76290b10 con 0x55ca76393150 2024-09-19T06:21:31.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.705+0000 7f474061a740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55ca762e5240 con 0x55ca76384380 2024-09-19T06:21:31.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.705+0000 7f472effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca76383a60 0x55ca76383e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:31.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.705+0000 7f472effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca76383a60 0x55ca76383e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42844/0 (socket says 172.21.15.2:42844) 2024-09-19T06:21:31.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.705+0000 7f472effd640 1 -- 172.21.15.2:0/3206254996 learned_addr learned my addr 172.21.15.2:0/3206254996 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:31.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.705+0000 7f47357fa640 1 --2- 172.21.15.2:0/1975101361 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f47240a33b0 0x7f47240a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:31.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.705+0000 7f47377fe640 1 --2- 172.21.15.2:0/3206254996 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca76384380 0x55ca76392c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:31.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.705+0000 7f4737fff640 1 --2- 172.21.15.2:0/1975101361 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f47240a33b0 0x7f47240a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:31.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.705+0000 7f472effd640 1 --2- 172.21.15.2:0/3206254996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca76393150 0x55ca76395540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:31.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.705+0000 7f47357fa640 1 -- 172.21.15.2:0/1975101361 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f47300d0430 con 0x7f4738106f10 2024-09-19T06:21:31.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.705+0000 7f472effd640 1 -- 172.21.15.2:0/3206254996 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca76384380 msgr2=0x55ca76392c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:31.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.705+0000 7f472effd640 1 --2- 172.21.15.2:0/3206254996 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca76384380 0x55ca76392c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:31.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.705+0000 7f472effd640 1 -- 172.21.15.2:0/3206254996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca76393150 msgr2=0x55ca76395540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:31.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.705+0000 7f472effd640 1 --2- 172.21.15.2:0/3206254996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca76393150 0x55ca76395540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:31.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.705+0000 7f472effd640 1 -- 172.21.15.2:0/3206254996 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca7629d1f0 con 0x55ca76383a60 2024-09-19T06:21:31.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.705+0000 7f47377fe640 1 --2- 172.21.15.2:0/3206254996 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca76384380 0x55ca76392c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:31.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.706+0000 7f472effd640 1 --2- 172.21.15.2:0/3206254996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca76383a60 0x55ca76383e40 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f47200135d0 tx=0x7f472000b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe96ea9251ac9d21 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:31.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.706+0000 7f4737fff640 1 --2- 172.21.15.2:0/1975101361 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f47240a33b0 0x7f47240a5870 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4730098b10 tx=0x7f473006b3a0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:31.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.706+0000 7f472dffb640 1 -- 172.21.15.2:0/3206254996 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4720019030 con 0x55ca76383a60 2024-09-19T06:21:31.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.706+0000 7f472dffb640 1 -- 172.21.15.2:0/3206254996 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4720011970 con 0x55ca76383a60 2024-09-19T06:21:31.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.706+0000 7f472dffb640 1 -- 172.21.15.2:0/3206254996 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472001d850 con 0x55ca76383a60 2024-09-19T06:21:31.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.707+0000 7f474061a740 1 -- 172.21.15.2:0/3206254996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca76383a60 msgr2=0x55ca76383e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:31.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.707+0000 7f474061a740 1 --2- 172.21.15.2:0/3206254996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca76383a60 0x55ca76383e40 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f47200135d0 tx=0x7f472000b670 comp rx=0 tx=0).stop 2024-09-19T06:21:31.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.707+0000 7f474061a740 1 -- 172.21.15.2:0/3206254996 shutdown_connections 2024-09-19T06:21:31.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.707+0000 7f474061a740 1 --2- 172.21.15.2:0/3206254996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca76393150 0x55ca76395540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:31.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.707+0000 7f474061a740 1 --2- 172.21.15.2:0/3206254996 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca76384380 0x55ca76392c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:31.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.707+0000 7f474061a740 1 --2- 172.21.15.2:0/3206254996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca76383a60 0x55ca76383e40 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:31.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.707+0000 7f474061a740 1 -- 172.21.15.2:0/3206254996 >> 172.21.15.2:0/3206254996 conn(0x55ca763800f0 msgr2=0x55ca763804d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:31.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.707+0000 7f474061a740 1 -- 172.21.15.2:0/3206254996 shutdown_connections 2024-09-19T06:21:31.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.707+0000 7f474061a740 1 -- 172.21.15.2:0/3206254996 wait complete. 2024-09-19T06:21:31.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.707+0000 7f474061a740 1 -- start start 2024-09-19T06:21:31.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.707+0000 7f474061a740 1 Processor -- start 2024-09-19T06:21:31.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.708+0000 7f474061a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca76383a60 0x55ca763900f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:31.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.708+0000 7f474061a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca76384380 0x55ca76390630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:31.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.708+0000 7f474061a740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca76393150 0x55ca76390b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:31.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.708+0000 7f474061a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ca76395d80 con 0x55ca76383a60 2024-09-19T06:21:31.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.708+0000 7f474061a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55ca762a3f10 con 0x55ca76384380 2024-09-19T06:21:31.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.708+0000 7f474061a740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55ca76395f00 con 0x55ca76393150 2024-09-19T06:21:31.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.708+0000 7f474061a740 10 client.0 _ll_register_callbacks cb 0x55ca7626ca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:31.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.708+0000 7f472effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca76383a60 0x55ca763900f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:31.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.708+0000 7f472effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca76383a60 0x55ca763900f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42852/0 (socket says 172.21.15.2:42852) 2024-09-19T06:21:31.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.708+0000 7f472effd640 1 -- 172.21.15.2:0/4204633707 learned_addr learned my addr 172.21.15.2:0/4204633707 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:31.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.708+0000 7f47377fe640 1 --2- 172.21.15.2:0/4204633707 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca76384380 0x55ca76390630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:31.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.708+0000 7f472effd640 1 --2- 172.21.15.2:0/4204633707 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca76393150 0x55ca76390b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:31.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.708+0000 7f472effd640 1 -- 172.21.15.2:0/4204633707 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca76393150 msgr2=0x55ca76390b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:31.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.708+0000 7f472effd640 1 --2- 172.21.15.2:0/4204633707 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca76393150 0x55ca76390b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:31.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.708+0000 7f472effd640 1 -- 172.21.15.2:0/4204633707 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca76384380 msgr2=0x55ca76390630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:31.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.708+0000 7f472effd640 1 --2- 172.21.15.2:0/4204633707 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca76384380 0x55ca76390630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:31.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.708+0000 7f472effd640 1 -- 172.21.15.2:0/4204633707 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca7605a6a0 con 0x55ca76383a60 2024-09-19T06:21:31.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.708+0000 7f472effd640 1 --2- 172.21.15.2:0/4204633707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca76383a60 0x55ca763900f0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f472000b9a0 tx=0x7f472000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6577bd159aa40d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:31.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.708+0000 7f4716ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:31.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.708+0000 7f4716ffd640 1 -- 172.21.15.2:0/4204633707 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4720019040 con 0x55ca76383a60 2024-09-19T06:21:31.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.708+0000 7f4716ffd640 1 -- 172.21.15.2:0/4204633707 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f4720011d20 con 0x55ca76383a60 2024-09-19T06:21:31.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.708+0000 7f474061a740 1 -- 172.21.15.2:0/4204633707 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4720011970 con 0x55ca76383a60 2024-09-19T06:21:31.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.709+0000 7f4716ffd640 1 -- 172.21.15.2:0/4204633707 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4720004030 con 0x55ca76383a60 2024-09-19T06:21:31.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.709+0000 7f474061a740 10 client.17463 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:31.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.709+0000 7f474061a740 1 -- 172.21.15.2:0/4204633707 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ca763a1a80 con 0x55ca76383a60 2024-09-19T06:21:31.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.709+0000 7f4716ffd640 1 -- 172.21.15.2:0/4204633707 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4720011970 con 0x55ca76383a60 2024-09-19T06:21:31.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.709+0000 7f4716ffd640 1 -- 172.21.15.2:0/4204633707 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f472002b060 con 0x55ca76383a60 2024-09-19T06:21:31.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.709+0000 7f474061a740 10 client.17463 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:31.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.709+0000 7f474061a740 10 client.17463 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:31.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.709+0000 7f474061a740 20 client.17463 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:31.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.709+0000 7f474061a740 1 --2- 172.21.15.2:0/4204633707 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ca763a2dd0 0x55ca763a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:31.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.709+0000 7f474061a740 4 client.17463 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:31.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.709+0000 7f474061a740 1 -- 172.21.15.2:0/4204633707 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca762f67f0 con 0x55ca763a2dd0 2024-09-19T06:21:31.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.709+0000 7f47377fe640 1 --2- 172.21.15.2:0/4204633707 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ca763a2dd0 0x55ca763a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:31.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.710+0000 7f47377fe640 1 --2- 172.21.15.2:0/4204633707 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ca763a2dd0 0x55ca763a51c0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=daaf80fc05bfada6 server_cookie=4ee6c5d265f13de1 in_seq=0 out_seq=0 2024-09-19T06:21:31.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.710+0000 7f4716ffd640 10 client.17463 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:31.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.710+0000 7f4716ffd640 1 -- 172.21.15.2:0/4204633707 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ca762f67f0 con 0x55ca763a2dd0 2024-09-19T06:21:31.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.710+0000 7f4716ffd640 10 client.17463 handle_command_reply: tid=0 2024-09-19T06:21:31.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.711+0000 7f474061a740 1 client.17463 shutdown 2024-09-19T06:21:31.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.711+0000 7f474061a740 1 -- 172.21.15.2:0/4204633707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca76383a60 msgr2=0x55ca763900f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:31.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.711+0000 7f474061a740 1 --2- 172.21.15.2:0/4204633707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca76383a60 0x55ca763900f0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f472000b9a0 tx=0x7f472000b8f0 comp rx=0 tx=0).stop 2024-09-19T06:21:31.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.711+0000 7f474061a740 1 -- 172.21.15.2:0/4204633707 shutdown_connections 2024-09-19T06:21:31.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.711+0000 7f474061a740 1 --2- 172.21.15.2:0/4204633707 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca76393150 0x55ca76390b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:31.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.711+0000 7f474061a740 1 --2- 172.21.15.2:0/4204633707 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ca763a2dd0 0x55ca763a51c0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:31.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.711+0000 7f474061a740 1 --2- 172.21.15.2:0/4204633707 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca76384380 0x55ca76390630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:31.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.711+0000 7f474061a740 1 --2- 172.21.15.2:0/4204633707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca76383a60 0x55ca763900f0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:31.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.711+0000 7f474061a740 1 -- 172.21.15.2:0/4204633707 >> 172.21.15.2:0/4204633707 conn(0x55ca763800f0 msgr2=0x55ca76385e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:31.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.711+0000 7f4716ffd640 0 client.17463 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:31.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.711+0000 7f474061a740 1 -- 172.21.15.2:0/4204633707 shutdown_connections 2024-09-19T06:21:31.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.711+0000 7f474061a740 1 -- 172.21.15.2:0/4204633707 wait complete. 2024-09-19T06:21:31.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.711+0000 7f474061a740 20 client.17463 trim_cache size 0 max 16384 2024-09-19T06:21:31.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.728+0000 7f474061a740 1 Processor -- start 2024-09-19T06:21:31.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.728+0000 7f474061a740 1 -- start start 2024-09-19T06:21:31.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.728+0000 7f474061a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca76383a60 0x55ca76391f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:31.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.729+0000 7f474061a740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca76384380 0x55ca763aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:31.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.729+0000 7f474061a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca76393150 0x55ca763aadf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:31.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.729+0000 7f474061a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f47381adf80 con 0x55ca76393150 2024-09-19T06:21:31.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.729+0000 7f474061a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f47381ab850 con 0x55ca76383a60 2024-09-19T06:21:31.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.729+0000 7f474061a740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f47381a96c0 con 0x55ca76384380 2024-09-19T06:21:31.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.729+0000 7f472effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca76393150 0x55ca763aadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:31.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.729+0000 7f472effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca76393150 0x55ca763aadf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42856/0 (socket says 172.21.15.2:42856) 2024-09-19T06:21:31.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.729+0000 7f472effd640 1 -- 172.21.15.2:0/3865785779 learned_addr learned my addr 172.21.15.2:0/3865785779 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:31.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.729+0000 7f472effd640 1 --2- 172.21.15.2:0/3865785779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca76383a60 0x55ca76391f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:31.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.729+0000 7f47377fe640 1 --2- 172.21.15.2:0/3865785779 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca76384380 0x55ca763aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:31.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.729+0000 7f472effd640 1 -- 172.21.15.2:0/3865785779 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca76384380 msgr2=0x55ca763aa8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:31.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.729+0000 7f472effd640 1 --2- 172.21.15.2:0/3865785779 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca76384380 0x55ca763aa8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:31.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.729+0000 7f472effd640 1 -- 172.21.15.2:0/3865785779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca76383a60 msgr2=0x55ca76391f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:31.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.729+0000 7f472effd640 1 --2- 172.21.15.2:0/3865785779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca76383a60 0x55ca76391f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:31.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.729+0000 7f472effd640 1 -- 172.21.15.2:0/3865785779 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca763841b0 con 0x55ca76393150 2024-09-19T06:21:31.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.729+0000 7f472effd640 1 --2- 172.21.15.2:0/3865785779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca76393150 0x55ca763aadf0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f4720004af0 tx=0x7f4720005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4b6cd93e80d4167 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:31.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.729+0000 7f472d7fa640 1 -- 172.21.15.2:0/3865785779 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4720019070 con 0x55ca76393150 2024-09-19T06:21:31.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.729+0000 7f472d7fa640 1 -- 172.21.15.2:0/3865785779 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f47200041d0 con 0x55ca76393150 2024-09-19T06:21:31.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.729+0000 7f472d7fa640 1 -- 172.21.15.2:0/3865785779 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47200035f0 con 0x55ca76393150 2024-09-19T06:21:31.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.730+0000 7f474061a740 1 -- 172.21.15.2:0/3865785779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca76393150 msgr2=0x55ca763aadf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:31.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.730+0000 7f474061a740 1 --2- 172.21.15.2:0/3865785779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca76393150 0x55ca763aadf0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f4720004af0 tx=0x7f4720005fb0 comp rx=0 tx=0).stop 2024-09-19T06:21:31.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.730+0000 7f474061a740 1 -- 172.21.15.2:0/3865785779 shutdown_connections 2024-09-19T06:21:31.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.730+0000 7f474061a740 1 --2- 172.21.15.2:0/3865785779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca76393150 0x55ca763aadf0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:31.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.730+0000 7f474061a740 1 --2- 172.21.15.2:0/3865785779 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca76384380 0x55ca763aa8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:31.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.730+0000 7f474061a740 1 --2- 172.21.15.2:0/3865785779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca76383a60 0x55ca76391f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:31.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.730+0000 7f474061a740 1 -- 172.21.15.2:0/3865785779 >> 172.21.15.2:0/3865785779 conn(0x55ca763800f0 msgr2=0x55ca76391840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:31.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.730+0000 7f474061a740 1 -- 172.21.15.2:0/3865785779 shutdown_connections 2024-09-19T06:21:31.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.730+0000 7f474061a740 1 -- 172.21.15.2:0/3865785779 wait complete. 2024-09-19T06:21:31.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.730+0000 7f474061a740 1 -- start start 2024-09-19T06:21:31.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.731+0000 7f474061a740 1 Processor -- start 2024-09-19T06:21:31.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.731+0000 7f474061a740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca76383a60 0x55ca7639b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:31.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.731+0000 7f474061a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca76384380 0x55ca7639b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:31.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.731+0000 7f474061a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca76393150 0x55ca7638cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:31.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.731+0000 7f474061a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f47381a9d10 con 0x55ca76384380 2024-09-19T06:21:31.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.731+0000 7f474061a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f47381ab180 con 0x55ca76393150 2024-09-19T06:21:31.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.731+0000 7f474061a740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f47381aa3e0 con 0x55ca76383a60 2024-09-19T06:21:31.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.731+0000 7f474061a740 10 client.0 _ll_register_callbacks cb 0x7f47300093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:31.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.731+0000 7f47377fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca76384380 0x55ca7639b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:31.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.731+0000 7f47377fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca76384380 0x55ca7639b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42858/0 (socket says 172.21.15.2:42858) 2024-09-19T06:21:31.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.731+0000 7f47377fe640 1 -- 172.21.15.2:0/3841923974 learned_addr learned my addr 172.21.15.2:0/3841923974 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:31.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.731+0000 7f472effd640 1 --2- 172.21.15.2:0/3841923974 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca76383a60 0x55ca7639b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:31.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.731+0000 7f472effd640 1 --2- 172.21.15.2:0/3841923974 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca76393150 0x55ca7638cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:31.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.731+0000 7f47377fe640 1 -- 172.21.15.2:0/3841923974 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca76383a60 msgr2=0x55ca7639b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:31.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.731+0000 7f47377fe640 1 --2- 172.21.15.2:0/3841923974 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca76383a60 0x55ca7639b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:31.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.731+0000 7f47377fe640 1 -- 172.21.15.2:0/3841923974 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca76393150 msgr2=0x55ca7638cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:31.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.731+0000 7f47377fe640 1 --2- 172.21.15.2:0/3841923974 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca76393150 0x55ca7638cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:31.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.731+0000 7f47377fe640 1 -- 172.21.15.2:0/3841923974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca7638d2e0 con 0x55ca76384380 2024-09-19T06:21:31.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.732+0000 7f47377fe640 1 --2- 172.21.15.2:0/3841923974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca76384380 0x55ca7639b9f0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f47280092a0 tx=0x7f4728004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7c0fad23e25b68f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:31.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.732+0000 7f4716ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:31.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.732+0000 7f4716ffd640 1 -- 172.21.15.2:0/3841923974 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4728035040 con 0x55ca76384380 2024-09-19T06:21:31.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.732+0000 7f4716ffd640 1 -- 172.21.15.2:0/3841923974 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f4728005450 con 0x55ca76384380 2024-09-19T06:21:31.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.732+0000 7f474061a740 1 -- 172.21.15.2:0/3841923974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47200041d0 con 0x55ca76384380 2024-09-19T06:21:31.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.732+0000 7f4716ffd640 1 -- 172.21.15.2:0/3841923974 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4728005650 con 0x55ca76384380 2024-09-19T06:21:31.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.732+0000 7f474061a740 10 client.17469 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:31.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.732+0000 7f474061a740 1 -- 172.21.15.2:0/3841923974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ca7640d510 con 0x55ca76384380 2024-09-19T06:21:31.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.732+0000 7f4716ffd640 1 -- 172.21.15.2:0/3841923974 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f47200041d0 con 0x55ca76384380 2024-09-19T06:21:31.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.732+0000 7f4716ffd640 1 -- 172.21.15.2:0/3841923974 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f4728003a00 con 0x55ca76384380 2024-09-19T06:21:31.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.733+0000 7f474061a740 10 client.17469 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:31.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.733+0000 7f474061a740 10 client.17469 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:31.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.733+0000 7f474061a740 20 client.17469 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:31.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.733+0000 7f474061a740 1 --2- 172.21.15.2:0/3841923974 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ca7640dcc0 0x55ca764100e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:31.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.733+0000 7f474061a740 4 client.17469 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:21:31.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.733+0000 7f474061a740 1 -- 172.21.15.2:0/3841923974 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ca762f0d00 con 0x55ca7640dcc0 2024-09-19T06:21:31.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.733+0000 7f472effd640 1 --2- 172.21.15.2:0/3841923974 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ca7640dcc0 0x55ca764100e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:31.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.733+0000 7f472effd640 1 --2- 172.21.15.2:0/3841923974 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ca7640dcc0 0x55ca764100e0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=448a01e76edf5052 server_cookie=50e43fac2e91cbf in_seq=0 out_seq=0 2024-09-19T06:21:31.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.733+0000 7f4716ffd640 10 client.17469 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:31.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.734+0000 7f4716ffd640 1 -- 172.21.15.2:0/3841923974 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ca762f0d00 con 0x55ca7640dcc0 2024-09-19T06:21:31.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.734+0000 7f4716ffd640 10 client.17469 handle_command_reply: tid=0 2024-09-19T06:21:31.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.734+0000 7f474061a740 1 client.17469 shutdown 2024-09-19T06:21:31.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.734+0000 7f474061a740 1 -- 172.21.15.2:0/3841923974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca76384380 msgr2=0x55ca7639b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:31.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.734+0000 7f474061a740 1 --2- 172.21.15.2:0/3841923974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca76384380 0x55ca7639b9f0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f47280092a0 tx=0x7f4728004360 comp rx=0 tx=0).stop 2024-09-19T06:21:31.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.734+0000 7f474061a740 1 -- 172.21.15.2:0/3841923974 shutdown_connections 2024-09-19T06:21:31.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.734+0000 7f474061a740 1 --2- 172.21.15.2:0/3841923974 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ca7640dcc0 0x55ca764100e0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:31.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.734+0000 7f474061a740 1 --2- 172.21.15.2:0/3841923974 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca76393150 0x55ca7638cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:31.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.734+0000 7f474061a740 1 --2- 172.21.15.2:0/3841923974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca76384380 0x55ca7639b9f0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:31.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.734+0000 7f474061a740 1 --2- 172.21.15.2:0/3841923974 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca76383a60 0x55ca7639b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:31.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.734+0000 7f4716ffd640 0 client.17469 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:31.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.734+0000 7f474061a740 1 -- 172.21.15.2:0/3841923974 >> 172.21.15.2:0/3841923974 conn(0x55ca763800f0 msgr2=0x55ca76385db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:31.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.734+0000 7f474061a740 1 -- 172.21.15.2:0/3841923974 shutdown_connections 2024-09-19T06:21:31.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.734+0000 7f474061a740 1 -- 172.21.15.2:0/3841923974 wait complete. 2024-09-19T06:21:31.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.735+0000 7f474061a740 20 client.17469 trim_cache size 0 max 16384 2024-09-19T06:21:31.748 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:21:31.748 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T06:21:31.748 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "72daea0a-8e6b-486c-81c0-5067dc864ce9", 2024-09-19T06:21:31.748 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T06:21:31.748 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:21:31.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.735+0000 7f473e241640 1 -- 172.21.15.2:0/1975101361 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f47240a33b0 msgr2=0x7f47240a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:31.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.735+0000 7f473e241640 1 --2- 172.21.15.2:0/1975101361 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f47240a33b0 0x7f47240a5870 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4730098b10 tx=0x7f473006b3a0 comp rx=0 tx=0).stop 2024-09-19T06:21:31.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.735+0000 7f473e241640 1 -- 172.21.15.2:0/1975101361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4738106f10 msgr2=0x7f473819cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:31.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.735+0000 7f473e241640 1 --2- 172.21.15.2:0/1975101361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4738106f10 0x7f473819cc50 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f473000eb10 tx=0x7f473000c2d0 comp rx=0 tx=0).stop 2024-09-19T06:21:31.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.735+0000 7f473e241640 1 -- 172.21.15.2:0/1975101361 shutdown_connections 2024-09-19T06:21:31.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.735+0000 7f473e241640 1 --2- 172.21.15.2:0/1975101361 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f47240a33b0 0x7f47240a5870 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:31.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.735+0000 7f473e241640 1 --2- 172.21.15.2:0/1975101361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4738106f10 0x7f473819cc50 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:31.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.735+0000 7f473e241640 1 --2- 172.21.15.2:0/1975101361 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4738102790 0x7f47381988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:31.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.735+0000 7f473e241640 1 --2- 172.21.15.2:0/1975101361 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4738101de0 0x7f4738198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:31.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.735+0000 7f473e241640 1 -- 172.21.15.2:0/1975101361 >> 172.21.15.2:0/1975101361 conn(0x7f47380fd8c0 msgr2=0x7f47380fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:31.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.735+0000 7f473e241640 1 -- 172.21.15.2:0/1975101361 shutdown_connections 2024-09-19T06:21:31.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:31.735+0000 7f473e241640 1 -- 172.21.15.2:0/1975101361 wait complete. 2024-09-19T06:21:31.750 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:31 smithi090 ceph-mon[34497]: pgmap v206: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:21:32.445 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:21:32.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:32 smithi089 ceph-mon[34160]: scrub queued for path: / 2024-09-19T06:21:32.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:32 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:32.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:32 smithi089 ceph-mon[34160]: scrub summary: active paths [/] 2024-09-19T06:21:32.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:32 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:32.703 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:32.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:32 smithi002 ceph-mon[30982]: scrub queued for path: / 2024-09-19T06:21:32.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:32 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:32.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:32 smithi002 ceph-mon[30982]: scrub summary: active paths [/] 2024-09-19T06:21:32.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:32 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:32.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:32 smithi090 ceph-mon[34497]: scrub queued for path: / 2024-09-19T06:21:32.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:32 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:32.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:32 smithi090 ceph-mon[34497]: scrub summary: active paths [/] 2024-09-19T06:21:32.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:32 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:33.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.164+0000 7fd1fdb49640 1 -- 172.21.15.2:0/3947280004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1f8102d40 msgr2=0x7fd1f8103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:33.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.164+0000 7fd1fdb49640 1 --2- 172.21.15.2:0/3947280004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1f8102d40 0x7fd1f8103120 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8009900 tx=0x7fd1e802a480 comp rx=0 tx=0).stop 2024-09-19T06:21:33.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.164+0000 7fd1fdb49640 1 -- 172.21.15.2:0/3947280004 shutdown_connections 2024-09-19T06:21:33.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.164+0000 7fd1fdb49640 1 --2- 172.21.15.2:0/3947280004 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1f810c170 0x7fd1f810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:33.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.164+0000 7fd1fdb49640 1 --2- 172.21.15.2:0/3947280004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1f8103660 0x7fd1f810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:33.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.164+0000 7fd1fdb49640 1 --2- 172.21.15.2:0/3947280004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1f8102d40 0x7fd1f8103120 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:33.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.164+0000 7fd1fdb49640 1 -- 172.21.15.2:0/3947280004 >> 172.21.15.2:0/3947280004 conn(0x7fd1f80fc7a0 msgr2=0x7fd1f80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:33.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.165+0000 7fd1fdb49640 1 -- 172.21.15.2:0/3947280004 shutdown_connections 2024-09-19T06:21:33.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.165+0000 7fd1fdb49640 1 -- 172.21.15.2:0/3947280004 wait complete. 2024-09-19T06:21:33.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.165+0000 7fd1fdb49640 1 Processor -- start 2024-09-19T06:21:33.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.165+0000 7fd1fdb49640 1 -- start start 2024-09-19T06:21:33.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.165+0000 7fd1fdb49640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1f8102d40 0x7fd1f81982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:33.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.165+0000 7fd1fdb49640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1f8103660 0x7fd1f8198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:33.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.165+0000 7fd1fdb49640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1f810c170 0x7fd1f819cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:33.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.166+0000 7fd1fdb49640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f8111e20 con 0x7fd1f810c170 2024-09-19T06:21:33.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.166+0000 7fd1fdb49640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f8111ca0 con 0x7fd1f8102d40 2024-09-19T06:21:33.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.166+0000 7fd1fdb49640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f8111fa0 con 0x7fd1f8103660 2024-09-19T06:21:33.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.166+0000 7fd1f7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1f810c170 0x7fd1f819cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:33.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.166+0000 7fd1f7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1f810c170 0x7fd1f819cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42874/0 (socket says 172.21.15.2:42874) 2024-09-19T06:21:33.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.166+0000 7fd1f77fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1f8102d40 0x7fd1f81982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:33.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.166+0000 7fd1f7fff640 1 -- 172.21.15.2:0/2467819883 learned_addr learned my addr 172.21.15.2:0/2467819883 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:33.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.166+0000 7fd1effff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1f8103660 0x7fd1f8198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:33.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.166+0000 7fd1f7fff640 1 -- 172.21.15.2:0/2467819883 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1f8103660 msgr2=0x7fd1f8198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:33.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.166+0000 7fd1f7fff640 1 --2- 172.21.15.2:0/2467819883 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1f8103660 0x7fd1f8198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:33.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.166+0000 7fd1f7fff640 1 -- 172.21.15.2:0/2467819883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1f8102d40 msgr2=0x7fd1f81982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:33.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.166+0000 7fd1f7fff640 1 --2- 172.21.15.2:0/2467819883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1f8102d40 0x7fd1f81982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:33.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.166+0000 7fd1f7fff640 1 -- 172.21.15.2:0/2467819883 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1f819d290 con 0x7fd1f810c170 2024-09-19T06:21:33.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.166+0000 7fd1f7fff640 1 --2- 172.21.15.2:0/2467819883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1f810c170 0x7fd1f819cbb0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fd1f000cce0 tx=0x7fd1f000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:33.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.166+0000 7fd1f57fa640 1 -- 172.21.15.2:0/2467819883 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f000f450 con 0x7fd1f810c170 2024-09-19T06:21:33.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.166+0000 7fd1fdb49640 1 -- 172.21.15.2:0/2467819883 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1f819d580 con 0x7fd1f810c170 2024-09-19T06:21:33.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.166+0000 7fd1f57fa640 1 -- 172.21.15.2:0/2467819883 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd1f000faa0 con 0x7fd1f810c170 2024-09-19T06:21:33.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.166+0000 7fd1f57fa640 1 -- 172.21.15.2:0/2467819883 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f0018b70 con 0x7fd1f810c170 2024-09-19T06:21:33.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.167+0000 7fd1fdb49640 1 -- 172.21.15.2:0/2467819883 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1f81008d0 con 0x7fd1f810c170 2024-09-19T06:21:33.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.169+0000 7fd1f57fa640 1 -- 172.21.15.2:0/2467819883 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fd1f0018d10 con 0x7fd1f810c170 2024-09-19T06:21:33.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.169+0000 7fd1fff22740 1 Processor -- start 2024-09-19T06:21:33.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.169+0000 7fd1fff22740 1 -- start start 2024-09-19T06:21:33.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.169+0000 7fd1fff22740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a56bcca4a0 0x55a56bcca880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:33.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.169+0000 7fd1fff22740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a56bccadc0 0x55a56bcd5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:33.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.169+0000 7fd1fff22740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a56bcd5680 0x55a56bcd7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:33.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.169+0000 7fd1fff22740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a56bc302e0 con 0x55a56bccadc0 2024-09-19T06:21:33.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.169+0000 7fd1fff22740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55a56bbd7ce0 con 0x55a56bcd5680 2024-09-19T06:21:33.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.169+0000 7fd1fff22740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55a56bc2c2a0 con 0x55a56bcca4a0 2024-09-19T06:21:33.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.169+0000 7fd1f77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a56bccadc0 0x55a56bcd5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:33.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.169+0000 7fd1f57fa640 1 --2- 172.21.15.2:0/2467819883 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fd1e40a33b0 0x7fd1e40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:33.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.169+0000 7fd1f77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a56bccadc0 0x55a56bcd5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42876/0 (socket says 172.21.15.2:42876) 2024-09-19T06:21:33.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.170+0000 7fd1f77fe640 1 -- 172.21.15.2:0/3738922245 learned_addr learned my addr 172.21.15.2:0/3738922245 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:33.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.170+0000 7fd1effff640 1 --2- 172.21.15.2:0/3738922245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a56bcd5680 0x55a56bcd7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:33.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.170+0000 7fd1effff640 1 --2- 172.21.15.2:0/3738922245 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a56bcca4a0 0x55a56bcca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:33.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.170+0000 7fd1f7fff640 1 --2- 172.21.15.2:0/2467819883 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fd1e40a33b0 0x7fd1e40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:33.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.170+0000 7fd1f57fa640 1 -- 172.21.15.2:0/2467819883 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7fd1f00d0040 con 0x7fd1f810c170 2024-09-19T06:21:33.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.170+0000 7fd1f77fe640 1 -- 172.21.15.2:0/3738922245 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a56bcca4a0 msgr2=0x55a56bcca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:33.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.170+0000 7fd1f77fe640 1 --2- 172.21.15.2:0/3738922245 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a56bcca4a0 0x55a56bcca880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:33.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.170+0000 7fd1f77fe640 1 -- 172.21.15.2:0/3738922245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a56bcd5680 msgr2=0x55a56bcd7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:33.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.170+0000 7fd1f77fe640 1 --2- 172.21.15.2:0/3738922245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a56bcd5680 0x55a56bcd7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:33.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.170+0000 7fd1f77fe640 1 -- 172.21.15.2:0/3738922245 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a56bbbc440 con 0x55a56bccadc0 2024-09-19T06:21:33.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.170+0000 7fd1effff640 1 --2- 172.21.15.2:0/3738922245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a56bcd5680 0x55a56bcd7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:33.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.170+0000 7fd1f77fe640 1 --2- 172.21.15.2:0/3738922245 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a56bccadc0 0x55a56bcd5140 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8009900 tx=0x7fd1e8032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88c1bfc9ad27e491 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:33.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.170+0000 7fd1f7fff640 1 --2- 172.21.15.2:0/2467819883 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fd1e40a33b0 0x7fd1e40a5870 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd1f00cd840 tx=0x7fd1f0020000 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:33.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.170+0000 7fd1edffb640 1 -- 172.21.15.2:0/3738922245 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1e8040070 con 0x55a56bccadc0 2024-09-19T06:21:33.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.170+0000 7fd1edffb640 1 -- 172.21.15.2:0/3738922245 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd1e80316a0 con 0x55a56bccadc0 2024-09-19T06:21:33.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.170+0000 7fd1edffb640 1 -- 172.21.15.2:0/3738922245 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1e8035040 con 0x55a56bccadc0 2024-09-19T06:21:33.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.171+0000 7fd1fff22740 1 -- 172.21.15.2:0/3738922245 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a56bccadc0 msgr2=0x55a56bcd5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:33.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.171+0000 7fd1fff22740 1 --2- 172.21.15.2:0/3738922245 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a56bccadc0 0x55a56bcd5140 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8009900 tx=0x7fd1e8032e40 comp rx=0 tx=0).stop 2024-09-19T06:21:33.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.171+0000 7fd1fff22740 1 -- 172.21.15.2:0/3738922245 shutdown_connections 2024-09-19T06:21:33.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.171+0000 7fd1fff22740 1 --2- 172.21.15.2:0/3738922245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a56bcd5680 0x55a56bcd7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:33.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.171+0000 7fd1fff22740 1 --2- 172.21.15.2:0/3738922245 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a56bccadc0 0x55a56bcd5140 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:33.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.171+0000 7fd1fff22740 1 --2- 172.21.15.2:0/3738922245 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a56bcca4a0 0x55a56bcca880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:33.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.171+0000 7fd1fff22740 1 -- 172.21.15.2:0/3738922245 >> 172.21.15.2:0/3738922245 conn(0x55a56bcc6a30 msgr2=0x55a56bcc6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:33.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.171+0000 7fd1fff22740 1 -- 172.21.15.2:0/3738922245 shutdown_connections 2024-09-19T06:21:33.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.171+0000 7fd1fff22740 1 -- 172.21.15.2:0/3738922245 wait complete. 2024-09-19T06:21:33.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.172+0000 7fd1fff22740 1 -- start start 2024-09-19T06:21:33.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.172+0000 7fd1fff22740 1 Processor -- start 2024-09-19T06:21:33.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.172+0000 7fd1fff22740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a56bcca4a0 0x55a56bcd4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:33.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.172+0000 7fd1fff22740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a56bccadc0 0x55a56bcd21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:33.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.172+0000 7fd1fff22740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a56bcd5680 0x55a56bcd2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:33.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.172+0000 7fd1fff22740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a56bcd8250 con 0x55a56bcd5680 2024-09-19T06:21:33.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.172+0000 7fd1fff22740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55a56bbeb050 con 0x55a56bcca4a0 2024-09-19T06:21:33.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.172+0000 7fd1fff22740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55a56bcd83d0 con 0x55a56bccadc0 2024-09-19T06:21:33.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.172+0000 7fd1fff22740 10 client.0 _ll_register_callbacks cb 0x55a56bc2b160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:33.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.172+0000 7fd1effff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a56bcd5680 0x55a56bcd2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:33.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.172+0000 7fd1effff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a56bcd5680 0x55a56bcd2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42878/0 (socket says 172.21.15.2:42878) 2024-09-19T06:21:33.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.172+0000 7fd1effff640 1 -- 172.21.15.2:0/1810929874 learned_addr learned my addr 172.21.15.2:0/1810929874 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:33.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.173+0000 7fd1f77fe640 1 --2- 172.21.15.2:0/1810929874 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a56bccadc0 0x55a56bcd21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:33.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.173+0000 7fd1effff640 1 --2- 172.21.15.2:0/1810929874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a56bcca4a0 0x55a56bcd4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:33.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.173+0000 7fd1effff640 1 -- 172.21.15.2:0/1810929874 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a56bccadc0 msgr2=0x55a56bcd21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:33.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.173+0000 7fd1effff640 1 --2- 172.21.15.2:0/1810929874 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a56bccadc0 0x55a56bcd21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:33.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.173+0000 7fd1effff640 1 -- 172.21.15.2:0/1810929874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a56bcca4a0 msgr2=0x55a56bcd4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:33.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.173+0000 7fd1effff640 1 --2- 172.21.15.2:0/1810929874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a56bcca4a0 0x55a56bcd4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:33.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.173+0000 7fd1effff640 1 -- 172.21.15.2:0/1810929874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a56b9a13c0 con 0x55a56bcd5680 2024-09-19T06:21:33.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.173+0000 7fd1effff640 1 --2- 172.21.15.2:0/1810929874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a56bcd5680 0x55a56bcd2730 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fd1e00127b0 tx=0x7fd1e0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5138a4d476b9bcd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:33.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.173+0000 7fd1d6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:33.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.173+0000 7fd1d6ffd640 1 -- 172.21.15.2:0/1810929874 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1e0004030 con 0x55a56bcd5680 2024-09-19T06:21:33.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.173+0000 7fd1fff22740 1 -- 172.21.15.2:0/1810929874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1e80316a0 con 0x55a56bcd5680 2024-09-19T06:21:33.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.173+0000 7fd1d6ffd640 1 -- 172.21.15.2:0/1810929874 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7fd1e00041d0 con 0x55a56bcd5680 2024-09-19T06:21:33.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.173+0000 7fd1d6ffd640 1 -- 172.21.15.2:0/1810929874 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd1e00043d0 con 0x55a56bcd5680 2024-09-19T06:21:33.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.173+0000 7fd1fff22740 10 client.17481 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:33.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.173+0000 7fd1fff22740 1 -- 172.21.15.2:0/1810929874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a56bce3c00 con 0x55a56bcd5680 2024-09-19T06:21:33.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.174+0000 7fd1d6ffd640 1 -- 172.21.15.2:0/1810929874 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd1e80316a0 con 0x55a56bcd5680 2024-09-19T06:21:33.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.174+0000 7fd1d6ffd640 1 -- 172.21.15.2:0/1810929874 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fd1e0003b50 con 0x55a56bcd5680 2024-09-19T06:21:33.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.174+0000 7fd1fff22740 10 client.17481 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:33.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.174+0000 7fd1fff22740 10 client.17481 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:33.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.174+0000 7fd1fff22740 20 client.17481 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:33.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.174+0000 7fd1fff22740 1 --2- 172.21.15.2:0/1810929874 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a56bce50c0 0x55a56bce74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:33.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.174+0000 7fd1fff22740 4 client.17481 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:33.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.174+0000 7fd1fff22740 1 -- 172.21.15.2:0/1810929874 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a56bc3d850 con 0x55a56bce50c0 2024-09-19T06:21:33.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.174+0000 7fd1f77fe640 1 --2- 172.21.15.2:0/1810929874 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a56bce50c0 0x55a56bce74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:33.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.175+0000 7fd1d6ffd640 10 client.17481 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:33.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.175+0000 7fd1f77fe640 1 --2- 172.21.15.2:0/1810929874 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a56bce50c0 0x55a56bce74d0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d721eece8d2a48d server_cookie=1b0337f774923167 in_seq=0 out_seq=0 2024-09-19T06:21:33.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.175+0000 7fd1d6ffd640 1 -- 172.21.15.2:0/1810929874 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a56bc3d850 con 0x55a56bce50c0 2024-09-19T06:21:33.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.175+0000 7fd1d6ffd640 10 client.17481 handle_command_reply: tid=0 2024-09-19T06:21:33.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.175+0000 7fd1fff22740 1 client.17481 shutdown 2024-09-19T06:21:33.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.175+0000 7fd1fff22740 1 -- 172.21.15.2:0/1810929874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a56bcd5680 msgr2=0x55a56bcd2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:33.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.175+0000 7fd1fff22740 1 --2- 172.21.15.2:0/1810929874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a56bcd5680 0x55a56bcd2730 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fd1e00127b0 tx=0x7fd1e0004730 comp rx=0 tx=0).stop 2024-09-19T06:21:33.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.175+0000 7fd1fff22740 1 -- 172.21.15.2:0/1810929874 shutdown_connections 2024-09-19T06:21:33.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.175+0000 7fd1fff22740 1 --2- 172.21.15.2:0/1810929874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a56bcd5680 0x55a56bcd2730 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:33.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.175+0000 7fd1fff22740 1 --2- 172.21.15.2:0/1810929874 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a56bccadc0 0x55a56bcd21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:33.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.175+0000 7fd1fff22740 1 --2- 172.21.15.2:0/1810929874 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a56bce50c0 0x55a56bce74d0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:33.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.175+0000 7fd1d6ffd640 0 client.17481 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:33.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.175+0000 7fd1fff22740 1 --2- 172.21.15.2:0/1810929874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a56bcca4a0 0x55a56bcd4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:33.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.176+0000 7fd1fff22740 1 -- 172.21.15.2:0/1810929874 >> 172.21.15.2:0/1810929874 conn(0x55a56bcc6a30 msgr2=0x55a56bccc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:33.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.176+0000 7fd1fff22740 1 -- 172.21.15.2:0/1810929874 shutdown_connections 2024-09-19T06:21:33.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.176+0000 7fd1fff22740 1 -- 172.21.15.2:0/1810929874 wait complete. 2024-09-19T06:21:33.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.176+0000 7fd1fff22740 20 client.17481 trim_cache size 0 max 16384 2024-09-19T06:21:33.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.193+0000 7fd1fff22740 1 Processor -- start 2024-09-19T06:21:33.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.193+0000 7fd1fff22740 1 -- start start 2024-09-19T06:21:33.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.193+0000 7fd1fff22740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a56bcca4a0 0x55a56bcd0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:33.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.193+0000 7fd1fff22740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a56bccadc0 0x55a56bcecda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:33.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.193+0000 7fd1fff22740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a56bcd5680 0x55a56bced2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:33.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.193+0000 7fd1fff22740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f81b2200 con 0x55a56bcca4a0 2024-09-19T06:21:33.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.193+0000 7fd1fff22740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f81afad0 con 0x55a56bccadc0 2024-09-19T06:21:33.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.193+0000 7fd1fff22740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f81ad940 con 0x55a56bcd5680 2024-09-19T06:21:33.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.193+0000 7fd1effff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a56bcca4a0 0x55a56bcd0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:33.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.193+0000 7fd1effff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a56bcca4a0 0x55a56bcd0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42882/0 (socket says 172.21.15.2:42882) 2024-09-19T06:21:33.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.193+0000 7fd1effff640 1 -- 172.21.15.2:0/1355942694 learned_addr learned my addr 172.21.15.2:0/1355942694 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:33.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.193+0000 7fd1f77fe640 1 --2- 172.21.15.2:0/1355942694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a56bccadc0 0x55a56bcecda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:33.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.193+0000 7fd1effff640 1 -- 172.21.15.2:0/1355942694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a56bcd5680 msgr2=0x55a56bced2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:33.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.193+0000 7fd1effff640 1 --2- 172.21.15.2:0/1355942694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a56bcd5680 0x55a56bced2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:33.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.193+0000 7fd1effff640 1 -- 172.21.15.2:0/1355942694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a56bccadc0 msgr2=0x55a56bcecda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:33.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.193+0000 7fd1effff640 1 --2- 172.21.15.2:0/1355942694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a56bccadc0 0x55a56bcecda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:33.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.193+0000 7fd1effff640 1 -- 172.21.15.2:0/1355942694 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a56bcd11a0 con 0x55a56bcca4a0 2024-09-19T06:21:33.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.193+0000 7fd1f77fe640 1 --2- 172.21.15.2:0/1355942694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a56bccadc0 0x55a56bcecda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:21:33.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.194+0000 7fd1effff640 1 --2- 172.21.15.2:0/1355942694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a56bcca4a0 0x55a56bcd0ac0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fd1e000b320 tx=0x7fd1e000b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d56f2e1796bcc4b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:33.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.194+0000 7fd1ed7fa640 1 -- 172.21.15.2:0/1355942694 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1e0004570 con 0x55a56bcca4a0 2024-09-19T06:21:33.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.194+0000 7fd1ed7fa640 1 -- 172.21.15.2:0/1355942694 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd1e001e6a0 con 0x55a56bcca4a0 2024-09-19T06:21:33.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.194+0000 7fd1ed7fa640 1 -- 172.21.15.2:0/1355942694 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1e00107a0 con 0x55a56bcca4a0 2024-09-19T06:21:33.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.194+0000 7fd1fff22740 1 -- 172.21.15.2:0/1355942694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a56bcca4a0 msgr2=0x55a56bcd0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:33.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.194+0000 7fd1fff22740 1 --2- 172.21.15.2:0/1355942694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a56bcca4a0 0x55a56bcd0ac0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fd1e000b320 tx=0x7fd1e000b430 comp rx=0 tx=0).stop 2024-09-19T06:21:33.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.194+0000 7fd1fff22740 1 -- 172.21.15.2:0/1355942694 shutdown_connections 2024-09-19T06:21:33.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.194+0000 7fd1fff22740 1 --2- 172.21.15.2:0/1355942694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a56bcd5680 0x55a56bced2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:33.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.194+0000 7fd1fff22740 1 --2- 172.21.15.2:0/1355942694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a56bccadc0 0x55a56bcecda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:33.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.195+0000 7fd1fff22740 1 --2- 172.21.15.2:0/1355942694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a56bcca4a0 0x55a56bcd0ac0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:33.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.195+0000 7fd1fff22740 1 -- 172.21.15.2:0/1355942694 >> 172.21.15.2:0/1355942694 conn(0x55a56bcc6a30 msgr2=0x55a56bcd4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:33.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.195+0000 7fd1fff22740 1 -- 172.21.15.2:0/1355942694 shutdown_connections 2024-09-19T06:21:33.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.195+0000 7fd1fff22740 1 -- 172.21.15.2:0/1355942694 wait complete. 2024-09-19T06:21:33.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.195+0000 7fd1fff22740 1 -- start start 2024-09-19T06:21:33.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.195+0000 7fd1fff22740 1 Processor -- start 2024-09-19T06:21:33.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.195+0000 7fd1fff22740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a56bcca4a0 0x55a56bcdb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:33.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.195+0000 7fd1fff22740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a56bccadc0 0x55a56bcdb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:33.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.195+0000 7fd1fff22740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a56bcd5680 0x55a56bcdbd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:33.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.195+0000 7fd1fff22740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f81adf90 con 0x55a56bcd5680 2024-09-19T06:21:33.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.195+0000 7fd1fff22740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f81af400 con 0x55a56bccadc0 2024-09-19T06:21:33.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.195+0000 7fd1fff22740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f81ae660 con 0x55a56bcca4a0 2024-09-19T06:21:33.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.195+0000 7fd1fff22740 10 client.0 _ll_register_callbacks cb 0x7fd1e000bd00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:33.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.196+0000 7fd1effff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a56bcd5680 0x55a56bcdbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:33.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.196+0000 7fd1effff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a56bcca4a0 0x55a56bcdb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:33.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.196+0000 7fd1effff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a56bcca4a0 0x55a56bcdb2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:54020/0 (socket says 172.21.15.2:54020) 2024-09-19T06:21:33.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.196+0000 7fd1effff640 1 -- 172.21.15.2:0/1431642960 learned_addr learned my addr 172.21.15.2:0/1431642960 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:33.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.196+0000 7fd1f77fe640 1 --2- 172.21.15.2:0/1431642960 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a56bccadc0 0x55a56bcdb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:33.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.196+0000 7fd1effff640 1 -- 172.21.15.2:0/1431642960 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a56bccadc0 msgr2=0x55a56bcdb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:33.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.196+0000 7fd1effff640 1 --2- 172.21.15.2:0/1431642960 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a56bccadc0 0x55a56bcdb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:33.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.196+0000 7fd1effff640 1 -- 172.21.15.2:0/1431642960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a56bcd5680 msgr2=0x55a56bcdbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:33.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.196+0000 7fd1effff640 1 --2- 172.21.15.2:0/1431642960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a56bcd5680 0x55a56bcdbd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:33.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.196+0000 7fd1effff640 1 -- 172.21.15.2:0/1431642960 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a56bd4ed80 con 0x55a56bcca4a0 2024-09-19T06:21:33.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.196+0000 7fd1effff640 1 --2- 172.21.15.2:0/1431642960 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a56bcca4a0 0x55a56bcdb2e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd1e000b8e0 tx=0x7fd1e001e850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a318a1f2c00ca99 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:33.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.196+0000 7fd1d6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-19T06:21:33.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.196+0000 7fd1d6ffd640 1 -- 172.21.15.2:0/1431642960 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1e0035040 con 0x55a56bcca4a0 2024-09-19T06:21:33.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.196+0000 7fd1fff22740 1 -- 172.21.15.2:0/1431642960 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1e001e6a0 con 0x55a56bcca4a0 2024-09-19T06:21:33.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.196+0000 7fd1d6ffd640 1 -- 172.21.15.2:0/1431642960 <== mon.1 v2:172.21.15.90:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7fd1e001e9c0 con 0x55a56bcca4a0 2024-09-19T06:21:33.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.197+0000 7fd1d6ffd640 1 -- 172.21.15.2:0/1431642960 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd1e001ebc0 con 0x55a56bcca4a0 2024-09-19T06:21:33.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.197+0000 7fd1fff22740 10 client.26650 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:33.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.197+0000 7fd1fff22740 1 -- 172.21.15.2:0/1431642960 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a56bd4ff40 con 0x55a56bcca4a0 2024-09-19T06:21:33.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.197+0000 7fd1d6ffd640 1 -- 172.21.15.2:0/1431642960 <== mon.1 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd1e001e6a0 con 0x55a56bcca4a0 2024-09-19T06:21:33.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.197+0000 7fd1d6ffd640 1 -- 172.21.15.2:0/1431642960 <== mon.1 v2:172.21.15.90:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fd1e003b070 con 0x55a56bcca4a0 2024-09-19T06:21:33.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.197+0000 7fd1fff22740 10 client.26650 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:33.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.197+0000 7fd1fff22740 10 client.26650 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:33.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.197+0000 7fd1fff22740 20 client.26650 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:33.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.197+0000 7fd1fff22740 1 --2- 172.21.15.2:0/1431642960 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a56bd504f0 0x55a56bd528e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:33.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.197+0000 7fd1fff22740 4 client.26650 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:21:33.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.197+0000 7fd1fff22740 1 -- 172.21.15.2:0/1431642960 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a56bc37d60 con 0x55a56bd504f0 2024-09-19T06:21:33.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.197+0000 7fd1f77fe640 1 --2- 172.21.15.2:0/1431642960 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a56bd504f0 0x55a56bd528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:33.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.198+0000 7fd1f77fe640 1 --2- 172.21.15.2:0/1431642960 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a56bd504f0 0x55a56bd528e0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d99d5e17eea6eaa5 server_cookie=a980e79bf5ca8227 in_seq=0 out_seq=0 2024-09-19T06:21:33.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.198+0000 7fd1d6ffd640 10 client.26650 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:33.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.198+0000 7fd1d6ffd640 1 -- 172.21.15.2:0/1431642960 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a56bc37d60 con 0x55a56bd504f0 2024-09-19T06:21:33.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.198+0000 7fd1d6ffd640 10 client.26650 handle_command_reply: tid=0 2024-09-19T06:21:33.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.198+0000 7fd1fff22740 1 client.26650 shutdown 2024-09-19T06:21:33.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.198+0000 7fd1fff22740 1 -- 172.21.15.2:0/1431642960 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a56bcca4a0 msgr2=0x55a56bcdb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:33.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.198+0000 7fd1fff22740 1 --2- 172.21.15.2:0/1431642960 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a56bcca4a0 0x55a56bcdb2e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd1e000b8e0 tx=0x7fd1e001e850 comp rx=0 tx=0).stop 2024-09-19T06:21:33.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.198+0000 7fd1fff22740 1 -- 172.21.15.2:0/1431642960 shutdown_connections 2024-09-19T06:21:33.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.198+0000 7fd1fff22740 1 --2- 172.21.15.2:0/1431642960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a56bcd5680 0x55a56bcdbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:33.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.198+0000 7fd1fff22740 1 --2- 172.21.15.2:0/1431642960 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a56bd504f0 0x55a56bd528e0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:33.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.198+0000 7fd1fff22740 1 --2- 172.21.15.2:0/1431642960 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a56bccadc0 0x55a56bcdb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:33.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.198+0000 7fd1fff22740 1 --2- 172.21.15.2:0/1431642960 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a56bcca4a0 0x55a56bcdb2e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:33.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.198+0000 7fd1d6ffd640 0 client.26650 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:33.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.198+0000 7fd1fff22740 1 -- 172.21.15.2:0/1431642960 >> 172.21.15.2:0/1431642960 conn(0x55a56bcc6a30 msgr2=0x55a56bcc5370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:33.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.198+0000 7fd1fff22740 1 -- 172.21.15.2:0/1431642960 shutdown_connections 2024-09-19T06:21:33.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.198+0000 7fd1fff22740 1 -- 172.21.15.2:0/1431642960 wait complete. 2024-09-19T06:21:33.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.199+0000 7fd1fff22740 20 client.26650 trim_cache size 0 max 16384 2024-09-19T06:21:33.206 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:21:33.206 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T06:21:33.206 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T06:21:33.206 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:21:33.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.199+0000 7fd1fdb49640 1 -- 172.21.15.2:0/2467819883 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fd1e40a33b0 msgr2=0x7fd1e40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:33.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.199+0000 7fd1fdb49640 1 --2- 172.21.15.2:0/2467819883 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fd1e40a33b0 0x7fd1e40a5870 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd1f00cd840 tx=0x7fd1f0020000 comp rx=0 tx=0).stop 2024-09-19T06:21:33.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.199+0000 7fd1fdb49640 1 -- 172.21.15.2:0/2467819883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1f810c170 msgr2=0x7fd1f819cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:33.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.199+0000 7fd1fdb49640 1 --2- 172.21.15.2:0/2467819883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1f810c170 0x7fd1f819cbb0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fd1f000cce0 tx=0x7fd1f000a620 comp rx=0 tx=0).stop 2024-09-19T06:21:33.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.199+0000 7fd1fdb49640 1 -- 172.21.15.2:0/2467819883 shutdown_connections 2024-09-19T06:21:33.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.199+0000 7fd1fdb49640 1 --2- 172.21.15.2:0/2467819883 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fd1e40a33b0 0x7fd1e40a5870 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:33.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.199+0000 7fd1fdb49640 1 --2- 172.21.15.2:0/2467819883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1f810c170 0x7fd1f819cbb0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:33.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.199+0000 7fd1fdb49640 1 --2- 172.21.15.2:0/2467819883 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1f8103660 0x7fd1f8198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:33.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.199+0000 7fd1fdb49640 1 --2- 172.21.15.2:0/2467819883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1f8102d40 0x7fd1f81982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:33.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.199+0000 7fd1fdb49640 1 -- 172.21.15.2:0/2467819883 >> 172.21.15.2:0/2467819883 conn(0x7fd1f80fc7a0 msgr2=0x7fd1f80fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:33.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.199+0000 7fd1fdb49640 1 -- 172.21.15.2:0/2467819883 shutdown_connections 2024-09-19T06:21:33.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:33.199+0000 7fd1fdb49640 1 -- 172.21.15.2:0/2467819883 wait complete. 2024-09-19T06:21:33.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:33 smithi002 ceph-mon[30982]: pgmap v207: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:21:33.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:33 smithi002 ceph-mon[30982]: scrub summary: idle 2024-09-19T06:21:33.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:33 smithi089 ceph-mon[34160]: pgmap v207: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:21:33.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:33 smithi089 ceph-mon[34160]: scrub summary: idle 2024-09-19T06:21:33.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:33 smithi090 ceph-mon[34497]: pgmap v207: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:21:33.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:33 smithi090 ceph-mon[34497]: scrub summary: idle 2024-09-19T06:21:34.023 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:21:34.023 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:21:34.279 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:34.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.737+0000 7f4d83896640 1 -- 172.21.15.2:0/3169766540 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d7c106a80 msgr2=0x7f4d7c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:34.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.737+0000 7f4d83896640 1 --2- 172.21.15.2:0/3169766540 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d7c106a80 0x7f4d7c106e60 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f4d78009930 tx=0x7f4d7802a420 comp rx=0 tx=0).stop 2024-09-19T06:21:34.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.737+0000 7f4d83896640 1 -- 172.21.15.2:0/3169766540 shutdown_connections 2024-09-19T06:21:34.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.737+0000 7f4d83896640 1 --2- 172.21.15.2:0/3169766540 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d7c101420 0x7f4d7c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:34.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.737+0000 7f4d83896640 1 --2- 172.21.15.2:0/3169766540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d7c100a80 0x7f4d7c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:34.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.737+0000 7f4d83896640 1 --2- 172.21.15.2:0/3169766540 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d7c106a80 0x7f4d7c106e60 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:34.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.737+0000 7f4d83896640 1 -- 172.21.15.2:0/3169766540 >> 172.21.15.2:0/3169766540 conn(0x7f4d7c0fc7a0 msgr2=0x7f4d7c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:34.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.737+0000 7f4d83896640 1 -- 172.21.15.2:0/3169766540 shutdown_connections 2024-09-19T06:21:34.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.737+0000 7f4d83896640 1 -- 172.21.15.2:0/3169766540 wait complete. 2024-09-19T06:21:34.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.738+0000 7f4d83896640 1 Processor -- start 2024-09-19T06:21:34.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.738+0000 7f4d83896640 1 -- start start 2024-09-19T06:21:34.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.738+0000 7f4d83896640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d7c100a80 0x7f4d7c197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:34.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.738+0000 7f4d83896640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d7c101420 0x7f4d7c197790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:34.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.738+0000 7f4d83896640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d7c106a80 0x7f4d7c19bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:34.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.738+0000 7f4d83896640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7c110d30 con 0x7f4d7c101420 2024-09-19T06:21:34.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.738+0000 7f4d83896640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7c110bb0 con 0x7f4d7c106a80 2024-09-19T06:21:34.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.738+0000 7f4d83896640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7c110eb0 con 0x7f4d7c100a80 2024-09-19T06:21:34.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.738+0000 7f4d80e31640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d7c101420 0x7f4d7c197790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:34.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.738+0000 7f4d80e31640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d7c101420 0x7f4d7c197790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42912/0 (socket says 172.21.15.2:42912) 2024-09-19T06:21:34.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.738+0000 7f4d80e31640 1 -- 172.21.15.2:0/1444122220 learned_addr learned my addr 172.21.15.2:0/1444122220 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:34.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.739+0000 7f4d81e33640 1 --2- 172.21.15.2:0/1444122220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d7c106a80 0x7f4d7c19bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:34.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.739+0000 7f4d81632640 1 --2- 172.21.15.2:0/1444122220 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d7c100a80 0x7f4d7c197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:34.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.739+0000 7f4d80e31640 1 -- 172.21.15.2:0/1444122220 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d7c100a80 msgr2=0x7f4d7c197250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:34.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.739+0000 7f4d80e31640 1 --2- 172.21.15.2:0/1444122220 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d7c100a80 0x7f4d7c197250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:34.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.739+0000 7f4d80e31640 1 -- 172.21.15.2:0/1444122220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d7c106a80 msgr2=0x7f4d7c19bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:34.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.739+0000 7f4d80e31640 1 --2- 172.21.15.2:0/1444122220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d7c106a80 0x7f4d7c19bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:34.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.739+0000 7f4d80e31640 1 -- 172.21.15.2:0/1444122220 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d7c19c200 con 0x7f4d7c101420 2024-09-19T06:21:34.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.739+0000 7f4d80e31640 1 --2- 172.21.15.2:0/1444122220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d7c101420 0x7f4d7c197790 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c00e9f0 tx=0x7f4d6c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:34.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.739+0000 7f4d727fc640 1 -- 172.21.15.2:0/1444122220 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c00cd80 con 0x7f4d7c101420 2024-09-19T06:21:34.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.739+0000 7f4d83896640 1 -- 172.21.15.2:0/1444122220 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d7c19c4f0 con 0x7f4d7c101420 2024-09-19T06:21:34.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.739+0000 7f4d727fc640 1 -- 172.21.15.2:0/1444122220 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4d6c0108e0 con 0x7f4d7c101420 2024-09-19T06:21:34.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.739+0000 7f4d727fc640 1 -- 172.21.15.2:0/1444122220 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c018920 con 0x7f4d7c101420 2024-09-19T06:21:34.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.739+0000 7f4d83896640 1 -- 172.21.15.2:0/1444122220 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d7c1a3dd0 con 0x7f4d7c101420 2024-09-19T06:21:34.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.740+0000 7f4d83896640 1 -- 172.21.15.2:0/1444122220 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d7c100ee0 con 0x7f4d7c101420 2024-09-19T06:21:34.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.741+0000 7f4d727fc640 1 -- 172.21.15.2:0/1444122220 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f4d6c010a90 con 0x7f4d7c101420 2024-09-19T06:21:34.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.742+0000 7f4d727fc640 1 --2- 172.21.15.2:0/1444122220 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4d680a33b0 0x7f4d680a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:34.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.743+0000 7f4d81632640 1 --2- 172.21.15.2:0/1444122220 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4d680a33b0 0x7f4d680a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:34.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.743+0000 7f4d727fc640 1 -- 172.21.15.2:0/1444122220 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f4d6c0d0580 con 0x7f4d7c101420 2024-09-19T06:21:34.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.743+0000 7f4d81632640 1 --2- 172.21.15.2:0/1444122220 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4d680a33b0 0x7f4d680a5870 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4d78000c00 tx=0x7f4d78032ba0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:34.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.746+0000 7f4d727fc640 1 -- 172.21.15.2:0/1444122220 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4d6c09cf60 con 0x7f4d7c101420 2024-09-19T06:21:34.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.961+0000 7f4d83896640 1 -- 172.21.15.2:0/1444122220 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d7c1985b0 con 0x7f4d7c101420 2024-09-19T06:21:34.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.962+0000 7f4d727fc640 1 -- 172.21.15.2:0/1444122220 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11882 (secure 0 0 0) 0x7f4d7c1985b0 con 0x7f4d7c101420 2024-09-19T06:21:34.964 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:21:34.966 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-09-19T06:14:49:104280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:14:48.191083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24470,24472,24497]},"id":1}]} 2024-09-19T06:21:34.967 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-09-19T06:21:34.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.965+0000 7f4d83896640 1 -- 172.21.15.2:0/1444122220 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4d680a33b0 msgr2=0x7f4d680a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:34.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.965+0000 7f4d83896640 1 --2- 172.21.15.2:0/1444122220 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4d680a33b0 0x7f4d680a5870 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4d78000c00 tx=0x7f4d78032ba0 comp rx=0 tx=0).stop 2024-09-19T06:21:34.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.965+0000 7f4d83896640 1 -- 172.21.15.2:0/1444122220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d7c101420 msgr2=0x7f4d7c197790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:34.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.965+0000 7f4d83896640 1 --2- 172.21.15.2:0/1444122220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d7c101420 0x7f4d7c197790 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c00e9f0 tx=0x7f4d6c00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:21:34.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.965+0000 7f4d83896640 1 -- 172.21.15.2:0/1444122220 shutdown_connections 2024-09-19T06:21:34.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.965+0000 7f4d83896640 1 --2- 172.21.15.2:0/1444122220 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4d680a33b0 0x7f4d680a5870 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:34.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.965+0000 7f4d83896640 1 --2- 172.21.15.2:0/1444122220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d7c106a80 0x7f4d7c19bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:34.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.965+0000 7f4d83896640 1 --2- 172.21.15.2:0/1444122220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d7c101420 0x7f4d7c197790 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:34.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.965+0000 7f4d83896640 1 --2- 172.21.15.2:0/1444122220 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d7c100a80 0x7f4d7c197250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:34.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.965+0000 7f4d83896640 1 -- 172.21.15.2:0/1444122220 >> 172.21.15.2:0/1444122220 conn(0x7f4d7c0fc7a0 msgr2=0x7f4d7c0fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:34.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.965+0000 7f4d83896640 1 -- 172.21.15.2:0/1444122220 shutdown_connections 2024-09-19T06:21:34.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:34.965+0000 7f4d83896640 1 -- 172.21.15.2:0/1444122220 wait complete. 2024-09-19T06:21:35.627 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:35 smithi002 ceph-mon[30982]: pgmap v208: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2024-09-19T06:21:35.627 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:35 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1444122220' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:21:35.658 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:21:35.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:35 smithi090 ceph-mon[34497]: pgmap v208: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2024-09-19T06:21:35.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:35 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1444122220' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:21:35.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:35 smithi089 ceph-mon[34160]: pgmap v208: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2024-09-19T06:21:35.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:35 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1444122220' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:21:35.918 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:36.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.364+0000 7f6f0025c640 1 -- 172.21.15.2:0/2019194572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ef8106f20 msgr2=0x7f6ef810eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:36.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.364+0000 7f6f0025c640 1 --2- 172.21.15.2:0/2019194572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ef8106f20 0x7f6ef810eaa0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0009ca0 tx=0x7f6ef002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:21:36.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.364+0000 7f6f0025c640 1 -- 172.21.15.2:0/2019194572 shutdown_connections 2024-09-19T06:21:36.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.364+0000 7f6f0025c640 1 --2- 172.21.15.2:0/2019194572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ef8106f20 0x7f6ef810eaa0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:36.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.364+0000 7f6f0025c640 1 --2- 172.21.15.2:0/2019194572 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ef81027a0 0x7f6ef81067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:36.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.364+0000 7f6f0025c640 1 --2- 172.21.15.2:0/2019194572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ef8101df0 0x7f6ef81021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:36.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.364+0000 7f6f0025c640 1 -- 172.21.15.2:0/2019194572 >> 172.21.15.2:0/2019194572 conn(0x7f6ef80fd8b0 msgr2=0x7f6ef80ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:36.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.364+0000 7f6f0025c640 1 -- 172.21.15.2:0/2019194572 shutdown_connections 2024-09-19T06:21:36.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.364+0000 7f6f0025c640 1 -- 172.21.15.2:0/2019194572 wait complete. 2024-09-19T06:21:36.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.364+0000 7f6f0025c640 1 Processor -- start 2024-09-19T06:21:36.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.364+0000 7f6f0025c640 1 -- start start 2024-09-19T06:21:36.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.365+0000 7f6f0025c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ef8101df0 0x7f6ef8198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:36.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.365+0000 7f6f0025c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ef81027a0 0x7f6ef81988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:36.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.365+0000 7f6f0025c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ef8106f20 0x7f6ef819cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:36.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.365+0000 7f6f0025c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef8111e30 con 0x7f6ef8101df0 2024-09-19T06:21:36.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.365+0000 7f6f0025c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef8111cb0 con 0x7f6ef81027a0 2024-09-19T06:21:36.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.365+0000 7f6f0025c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef8111fb0 con 0x7f6ef8106f20 2024-09-19T06:21:36.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.365+0000 7f6efdff8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ef8101df0 0x7f6ef8198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:36.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.365+0000 7f6efdff8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ef8101df0 0x7f6ef8198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34646/0 (socket says 172.21.15.2:34646) 2024-09-19T06:21:36.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.365+0000 7f6efdff8640 1 -- 172.21.15.2:0/3520394802 learned_addr learned my addr 172.21.15.2:0/3520394802 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:36.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.365+0000 7f6efe7f9640 1 --2- 172.21.15.2:0/3520394802 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ef8106f20 0x7f6ef819cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:36.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.365+0000 7f6efd7f7640 1 --2- 172.21.15.2:0/3520394802 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ef81027a0 0x7f6ef81988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:36.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.365+0000 7f6efdff8640 1 -- 172.21.15.2:0/3520394802 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ef8106f20 msgr2=0x7f6ef819cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:36.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.365+0000 7f6efdff8640 1 --2- 172.21.15.2:0/3520394802 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ef8106f20 0x7f6ef819cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:36.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.365+0000 7f6efdff8640 1 -- 172.21.15.2:0/3520394802 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ef81027a0 msgr2=0x7f6ef81988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:36.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.365+0000 7f6efdff8640 1 --2- 172.21.15.2:0/3520394802 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ef81027a0 0x7f6ef81988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:36.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.365+0000 7f6efdff8640 1 -- 172.21.15.2:0/3520394802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef819d340 con 0x7f6ef8101df0 2024-09-19T06:21:36.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.365+0000 7f6efdff8640 1 --2- 172.21.15.2:0/3520394802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ef8101df0 0x7f6ef8198390 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f6ef400d950 tx=0x7f6ef400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:36.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.366+0000 7f6eeaffd640 1 -- 172.21.15.2:0/3520394802 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef4017070 con 0x7f6ef8101df0 2024-09-19T06:21:36.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.366+0000 7f6f0025c640 1 -- 172.21.15.2:0/3520394802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ef819d630 con 0x7f6ef8101df0 2024-09-19T06:21:36.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.366+0000 7f6eeaffd640 1 -- 172.21.15.2:0/3520394802 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6ef4009c30 con 0x7f6ef8101df0 2024-09-19T06:21:36.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.366+0000 7f6eeaffd640 1 -- 172.21.15.2:0/3520394802 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef400f620 con 0x7f6ef8101df0 2024-09-19T06:21:36.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.366+0000 7f6f0025c640 1 -- 172.21.15.2:0/3520394802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ef81a4f10 con 0x7f6ef8101df0 2024-09-19T06:21:36.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.368+0000 7f6eeaffd640 1 -- 172.21.15.2:0/3520394802 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f6ef40109a0 con 0x7f6ef8101df0 2024-09-19T06:21:36.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.368+0000 7f6f02635740 1 Processor -- start 2024-09-19T06:21:36.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.369+0000 7f6f02635740 1 -- start start 2024-09-19T06:21:36.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.369+0000 7f6f02635740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564503eaab40 0x564503ea9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:36.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.369+0000 7f6f02635740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564503ea95d0 0x564503ea9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:36.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.369+0000 7f6f02635740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564503eb8780 0x564503ebab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:36.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.369+0000 7f6f02635740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564503e0f2f0 con 0x564503eb8780 2024-09-19T06:21:36.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.369+0000 7f6f02635740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x564503db6cf0 con 0x564503ea95d0 2024-09-19T06:21:36.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.369+0000 7f6f02635740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x564503e0b2b0 con 0x564503eaab40 2024-09-19T06:21:36.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.369+0000 7f6efd7f7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564503eb8780 0x564503ebab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:36.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.369+0000 7f6eeaffd640 1 --2- 172.21.15.2:0/3520394802 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f6ee40a33b0 0x7f6ee40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:36.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.369+0000 7f6efd7f7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564503eb8780 0x564503ebab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34660/0 (socket says 172.21.15.2:34660) 2024-09-19T06:21:36.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.369+0000 7f6efd7f7640 1 -- 172.21.15.2:0/2168900244 learned_addr learned my addr 172.21.15.2:0/2168900244 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:36.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.369+0000 7f6efe7f9640 1 --2- 172.21.15.2:0/2168900244 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564503eaab40 0x564503ea9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:36.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.369+0000 7f6efe7f9640 1 --2- 172.21.15.2:0/3520394802 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f6ee40a33b0 0x7f6ee40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:36.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.369+0000 7f6eeaffd640 1 -- 172.21.15.2:0/3520394802 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f6ef40cf960 con 0x7f6ef8101df0 2024-09-19T06:21:36.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.369+0000 7f6efdff8640 1 --2- 172.21.15.2:0/2168900244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564503ea95d0 0x564503ea9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:36.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.369+0000 7f6efd7f7640 1 -- 172.21.15.2:0/2168900244 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564503eaab40 msgr2=0x564503ea9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:36.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.369+0000 7f6efd7f7640 1 --2- 172.21.15.2:0/2168900244 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564503eaab40 0x564503ea9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:36.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.369+0000 7f6efd7f7640 1 -- 172.21.15.2:0/2168900244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564503ea95d0 msgr2=0x564503ea9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:36.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.369+0000 7f6efd7f7640 1 --2- 172.21.15.2:0/2168900244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564503ea95d0 0x564503ea9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:36.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.369+0000 7f6efd7f7640 1 -- 172.21.15.2:0/2168900244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564503d9b3a0 con 0x564503eb8780 2024-09-19T06:21:36.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.369+0000 7f6efdff8640 1 --2- 172.21.15.2:0/2168900244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564503ea95d0 0x564503ea9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:21:36.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.370+0000 7f6efe7f9640 1 --2- 172.21.15.2:0/2168900244 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564503eaab40 0x564503ea9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:36.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.370+0000 7f6efd7f7640 1 --2- 172.21.15.2:0/2168900244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564503eb8780 0x564503ebab70 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f6eec00bc10 tx=0x7f6eec00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fd05280ec71973a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:36.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.370+0000 7f6ee3fff640 1 -- 172.21.15.2:0/2168900244 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eec015070 con 0x564503eb8780 2024-09-19T06:21:36.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.370+0000 7f6efe7f9640 1 --2- 172.21.15.2:0/3520394802 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f6ee40a33b0 0x7f6ee40a5870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0004af0 tx=0x7f6ef0004a60 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:36.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.370+0000 7f6ee3fff640 1 -- 172.21.15.2:0/2168900244 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6eec0118f0 con 0x564503eb8780 2024-09-19T06:21:36.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.370+0000 7f6ee3fff640 1 -- 172.21.15.2:0/2168900244 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eec0107a0 con 0x564503eb8780 2024-09-19T06:21:36.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.371+0000 7f6f02635740 1 -- 172.21.15.2:0/2168900244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564503eb8780 msgr2=0x564503ebab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:36.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.371+0000 7f6f02635740 1 --2- 172.21.15.2:0/2168900244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564503eb8780 0x564503ebab70 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f6eec00bc10 tx=0x7f6eec00f730 comp rx=0 tx=0).stop 2024-09-19T06:21:36.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.371+0000 7f6f02635740 1 -- 172.21.15.2:0/2168900244 shutdown_connections 2024-09-19T06:21:36.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.371+0000 7f6f02635740 1 --2- 172.21.15.2:0/2168900244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564503eb8780 0x564503ebab70 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:36.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.371+0000 7f6f02635740 1 --2- 172.21.15.2:0/2168900244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564503ea95d0 0x564503ea9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:36.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.371+0000 7f6f02635740 1 --2- 172.21.15.2:0/2168900244 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564503eaab40 0x564503ea9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:36.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.371+0000 7f6f02635740 1 -- 172.21.15.2:0/2168900244 >> 172.21.15.2:0/2168900244 conn(0x564503e72310 msgr2=0x564503ea5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:36.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.371+0000 7f6f02635740 1 -- 172.21.15.2:0/2168900244 shutdown_connections 2024-09-19T06:21:36.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.371+0000 7f6f02635740 1 -- 172.21.15.2:0/2168900244 wait complete. 2024-09-19T06:21:36.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.371+0000 7f6f02635740 1 -- start start 2024-09-19T06:21:36.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.371+0000 7f6f02635740 1 Processor -- start 2024-09-19T06:21:36.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.372+0000 7f6f02635740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564503ea95d0 0x564503eb8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:36.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.372+0000 7f6f02635740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564503eaab40 0x564503eb5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:36.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.372+0000 7f6f02635740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564503eb8780 0x564503eb59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:36.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.372+0000 7f6f02635740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564503ebb480 con 0x564503eaab40 2024-09-19T06:21:36.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.372+0000 7f6f02635740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x564503dca060 con 0x564503ea95d0 2024-09-19T06:21:36.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.372+0000 7f6f02635740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x564503ebb600 con 0x564503eb8780 2024-09-19T06:21:36.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.372+0000 7f6f02635740 10 client.0 _ll_register_callbacks cb 0x564503b1d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:36.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.372+0000 7f6efd7f7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564503eaab40 0x564503eb5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:36.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.372+0000 7f6efd7f7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564503eaab40 0x564503eb5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34676/0 (socket says 172.21.15.2:34676) 2024-09-19T06:21:36.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.372+0000 7f6efd7f7640 1 -- 172.21.15.2:0/210521425 learned_addr learned my addr 172.21.15.2:0/210521425 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:36.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.372+0000 7f6efdff8640 1 --2- 172.21.15.2:0/210521425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564503ea95d0 0x564503eb8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:36.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.372+0000 7f6efe7f9640 1 --2- 172.21.15.2:0/210521425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564503eb8780 0x564503eb59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:36.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.372+0000 7f6efd7f7640 1 -- 172.21.15.2:0/210521425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564503eb8780 msgr2=0x564503eb59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:36.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.372+0000 7f6efd7f7640 1 --2- 172.21.15.2:0/210521425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564503eb8780 0x564503eb59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:36.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.372+0000 7f6efd7f7640 1 -- 172.21.15.2:0/210521425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564503ea95d0 msgr2=0x564503eb8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:36.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.372+0000 7f6efd7f7640 1 --2- 172.21.15.2:0/210521425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564503ea95d0 0x564503eb8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:36.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.372+0000 7f6efd7f7640 1 -- 172.21.15.2:0/210521425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564503b803c0 con 0x564503eaab40 2024-09-19T06:21:36.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.372+0000 7f6efd7f7640 1 --2- 172.21.15.2:0/210521425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564503eaab40 0x564503eb5410 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f6eec000c00 tx=0x7f6eec011670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c2208d36c5d22ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:36.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.372+0000 7f6ee17fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:36.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.373+0000 7f6ee17fa640 1 -- 172.21.15.2:0/210521425 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eec015070 con 0x564503eaab40 2024-09-19T06:21:36.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.373+0000 7f6ee17fa640 1 -- 172.21.15.2:0/210521425 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f6eec011cb0 con 0x564503eaab40 2024-09-19T06:21:36.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.373+0000 7f6f02635740 1 -- 172.21.15.2:0/210521425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6eec0118f0 con 0x564503eaab40 2024-09-19T06:21:36.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.373+0000 7f6ee17fa640 1 -- 172.21.15.2:0/210521425 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6eec00b7f0 con 0x564503eaab40 2024-09-19T06:21:36.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.373+0000 7f6f02635740 10 client.17505 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:36.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.373+0000 7f6f02635740 1 -- 172.21.15.2:0/210521425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564503ec6e70 con 0x564503eaab40 2024-09-19T06:21:36.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.373+0000 7f6ee17fa640 1 -- 172.21.15.2:0/210521425 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6eec0118f0 con 0x564503eaab40 2024-09-19T06:21:36.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.373+0000 7f6ee17fa640 1 -- 172.21.15.2:0/210521425 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f6eec0046c0 con 0x564503eaab40 2024-09-19T06:21:36.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.373+0000 7f6f02635740 10 client.17505 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:36.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.373+0000 7f6f02635740 10 client.17505 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:21:36.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.373+0000 7f6f02635740 20 client.17505 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:36.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.373+0000 7f6f02635740 1 --2- 172.21.15.2:0/210521425 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x564503ec82d0 0x564503eca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:36.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.373+0000 7f6f02635740 4 client.17505 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:36.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.373+0000 7f6f02635740 1 -- 172.21.15.2:0/210521425 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564503e1c860 con 0x564503ec82d0 2024-09-19T06:21:36.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.374+0000 7f6efdff8640 1 --2- 172.21.15.2:0/210521425 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x564503ec82d0 0x564503eca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:36.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.374+0000 7f6efdff8640 1 --2- 172.21.15.2:0/210521425 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x564503ec82d0 0x564503eca6c0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=409b0e77853a9de9 server_cookie=6ff456c1e5081529 in_seq=0 out_seq=0 2024-09-19T06:21:36.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.374+0000 7f6ee17fa640 10 client.17505 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:21:36.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.375+0000 7f6ee17fa640 1 -- 172.21.15.2:0/210521425 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564503e1c860 con 0x564503ec82d0 2024-09-19T06:21:36.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.375+0000 7f6ee17fa640 10 client.17505 handle_command_reply: tid=0 2024-09-19T06:21:36.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.375+0000 7f6f02635740 1 client.17505 shutdown 2024-09-19T06:21:36.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.375+0000 7f6f02635740 1 -- 172.21.15.2:0/210521425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564503eaab40 msgr2=0x564503eb5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:36.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.375+0000 7f6f02635740 1 --2- 172.21.15.2:0/210521425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564503eaab40 0x564503eb5410 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f6eec000c00 tx=0x7f6eec011670 comp rx=0 tx=0).stop 2024-09-19T06:21:36.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.375+0000 7f6f02635740 1 -- 172.21.15.2:0/210521425 shutdown_connections 2024-09-19T06:21:36.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.375+0000 7f6f02635740 1 --2- 172.21.15.2:0/210521425 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x564503ec82d0 0x564503eca6c0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:36.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.375+0000 7f6f02635740 1 --2- 172.21.15.2:0/210521425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564503eb8780 0x564503eb59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:36.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.375+0000 7f6f02635740 1 --2- 172.21.15.2:0/210521425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564503eaab40 0x564503eb5410 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:36.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.375+0000 7f6ee17fa640 0 client.17505 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:21:36.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.375+0000 7f6f02635740 1 --2- 172.21.15.2:0/210521425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564503ea95d0 0x564503eb8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:36.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.375+0000 7f6f02635740 1 -- 172.21.15.2:0/210521425 >> 172.21.15.2:0/210521425 conn(0x564503e72310 msgr2=0x564503eab960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:36.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.375+0000 7f6f02635740 1 -- 172.21.15.2:0/210521425 shutdown_connections 2024-09-19T06:21:36.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.375+0000 7f6f02635740 1 -- 172.21.15.2:0/210521425 wait complete. 2024-09-19T06:21:36.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.376+0000 7f6f02635740 20 client.17505 trim_cache size 0 max 16384 2024-09-19T06:21:36.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.388+0000 7f6f02635740 1 Processor -- start 2024-09-19T06:21:36.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.388+0000 7f6f02635740 1 -- start start 2024-09-19T06:21:36.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.389+0000 7f6f02635740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564503ea95d0 0x564503ea5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:36.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.389+0000 7f6f02635740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564503eaab40 0x564503ec4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:36.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.389+0000 7f6f02635740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564503eb8780 0x564503ecfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:36.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.389+0000 7f6f02635740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef81adf90 con 0x564503eb8780 2024-09-19T06:21:36.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.389+0000 7f6f02635740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef81ab860 con 0x564503ea95d0 2024-09-19T06:21:36.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.389+0000 7f6f02635740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef81a96d0 con 0x564503eaab40 2024-09-19T06:21:36.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.389+0000 7f6efe7f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564503eb8780 0x564503ecfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:36.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.389+0000 7f6efe7f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564503eb8780 0x564503ecfe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34692/0 (socket says 172.21.15.2:34692) 2024-09-19T06:21:36.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.389+0000 7f6efe7f9640 1 -- 172.21.15.2:0/1261878600 learned_addr learned my addr 172.21.15.2:0/1261878600 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:36.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.389+0000 7f6efdff8640 1 --2- 172.21.15.2:0/1261878600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564503ea95d0 0x564503ea5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:36.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.389+0000 7f6efd7f7640 1 --2- 172.21.15.2:0/1261878600 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564503eaab40 0x564503ec4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:36.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.389+0000 7f6efe7f9640 1 -- 172.21.15.2:0/1261878600 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564503eaab40 msgr2=0x564503ec4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:36.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.389+0000 7f6efe7f9640 1 --2- 172.21.15.2:0/1261878600 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564503eaab40 0x564503ec4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:36.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.389+0000 7f6efe7f9640 1 -- 172.21.15.2:0/1261878600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564503ea95d0 msgr2=0x564503ea5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:36.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.389+0000 7f6efe7f9640 1 --2- 172.21.15.2:0/1261878600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564503ea95d0 0x564503ea5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:36.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.389+0000 7f6efe7f9640 1 -- 172.21.15.2:0/1261878600 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564503ea6960 con 0x564503eb8780 2024-09-19T06:21:36.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.389+0000 7f6efe7f9640 1 --2- 172.21.15.2:0/1261878600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564503eb8780 0x564503ecfe30 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0009ca0 tx=0x7f6ef0009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be02d5fb60545d4b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:36.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.390+0000 7f6ee37fe640 1 -- 172.21.15.2:0/1261878600 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef0004240 con 0x564503eb8780 2024-09-19T06:21:36.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.390+0000 7f6ee37fe640 1 -- 172.21.15.2:0/1261878600 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6ef0036070 con 0x564503eb8780 2024-09-19T06:21:36.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.390+0000 7f6ee37fe640 1 -- 172.21.15.2:0/1261878600 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef0030b10 con 0x564503eb8780 2024-09-19T06:21:36.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.390+0000 7f6f02635740 1 -- 172.21.15.2:0/1261878600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564503eb8780 msgr2=0x564503ecfe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:36.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.390+0000 7f6f02635740 1 --2- 172.21.15.2:0/1261878600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564503eb8780 0x564503ecfe30 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0009ca0 tx=0x7f6ef0009360 comp rx=0 tx=0).stop 2024-09-19T06:21:36.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.390+0000 7f6f02635740 1 -- 172.21.15.2:0/1261878600 shutdown_connections 2024-09-19T06:21:36.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.390+0000 7f6f02635740 1 --2- 172.21.15.2:0/1261878600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564503eb8780 0x564503ecfe30 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:36.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.390+0000 7f6f02635740 1 --2- 172.21.15.2:0/1261878600 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564503eaab40 0x564503ec4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:36.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.390+0000 7f6f02635740 1 --2- 172.21.15.2:0/1261878600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564503ea95d0 0x564503ea5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:36.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.390+0000 7f6f02635740 1 -- 172.21.15.2:0/1261878600 >> 172.21.15.2:0/1261878600 conn(0x564503e72310 msgr2=0x564503ea5700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:36.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.390+0000 7f6f02635740 1 -- 172.21.15.2:0/1261878600 shutdown_connections 2024-09-19T06:21:36.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.390+0000 7f6f02635740 1 -- 172.21.15.2:0/1261878600 wait complete. 2024-09-19T06:21:36.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.391+0000 7f6f02635740 1 -- start start 2024-09-19T06:21:36.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.391+0000 7f6f02635740 1 Processor -- start 2024-09-19T06:21:36.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.391+0000 7f6f02635740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564503ea95d0 0x564503ec0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:36.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.391+0000 7f6f02635740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564503eaab40 0x564503ec0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:36.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.391+0000 7f6f02635740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564503eb8780 0x564503ebd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:36.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.391+0000 7f6f02635740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef81a9d20 con 0x564503eaab40 2024-09-19T06:21:36.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.391+0000 7f6f02635740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef81ab190 con 0x564503ea95d0 2024-09-19T06:21:36.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.391+0000 7f6f02635740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef81aa3f0 con 0x564503eb8780 2024-09-19T06:21:36.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.391+0000 7f6f02635740 10 client.0 _ll_register_callbacks cb 0x7f6eec00ba60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:36.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.391+0000 7f6efd7f7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564503eaab40 0x564503ec0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:36.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.391+0000 7f6efd7f7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564503eaab40 0x564503ec0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34704/0 (socket says 172.21.15.2:34704) 2024-09-19T06:21:36.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.391+0000 7f6efd7f7640 1 -- 172.21.15.2:0/1840826185 learned_addr learned my addr 172.21.15.2:0/1840826185 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:36.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.391+0000 7f6efe7f9640 1 --2- 172.21.15.2:0/1840826185 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564503eb8780 0x564503ebd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:36.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.391+0000 7f6efdff8640 1 --2- 172.21.15.2:0/1840826185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564503ea95d0 0x564503ec0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:36.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.392+0000 7f6efd7f7640 1 -- 172.21.15.2:0/1840826185 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564503eb8780 msgr2=0x564503ebd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:36.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.392+0000 7f6efd7f7640 1 --2- 172.21.15.2:0/1840826185 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564503eb8780 0x564503ebd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:36.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.392+0000 7f6efd7f7640 1 -- 172.21.15.2:0/1840826185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564503ea95d0 msgr2=0x564503ec0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:36.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.392+0000 7f6efd7f7640 1 --2- 172.21.15.2:0/1840826185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564503ea95d0 0x564503ec0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:36.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.392+0000 7f6efd7f7640 1 -- 172.21.15.2:0/1840826185 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564503eac120 con 0x564503eaab40 2024-09-19T06:21:36.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.392+0000 7f6efdff8640 1 --2- 172.21.15.2:0/1840826185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564503ea95d0 0x564503ec0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:21:36.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.392+0000 7f6efd7f7640 1 --2- 172.21.15.2:0/1840826185 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564503eaab40 0x564503ec0fb0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f6eec001eb0 tx=0x7f6eec005000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dd6f101fd770705 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:36.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.392+0000 7f6ee17fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:36.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.392+0000 7f6ee17fa640 1 -- 172.21.15.2:0/1840826185 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eec015040 con 0x564503eaab40 2024-09-19T06:21:36.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.392+0000 7f6ee17fa640 1 -- 172.21.15.2:0/1840826185 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f6eec005400 con 0x564503eaab40 2024-09-19T06:21:36.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.392+0000 7f6f02635740 1 -- 172.21.15.2:0/1840826185 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ef0036070 con 0x564503eaab40 2024-09-19T06:21:36.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.392+0000 7f6ee17fa640 1 -- 172.21.15.2:0/1840826185 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6eec03b050 con 0x564503eaab40 2024-09-19T06:21:36.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.392+0000 7f6f02635740 10 client.17511 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:36.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.392+0000 7f6f02635740 1 -- 172.21.15.2:0/1840826185 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564503f336b0 con 0x564503eaab40 2024-09-19T06:21:36.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.392+0000 7f6ee17fa640 1 -- 172.21.15.2:0/1840826185 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6ef0036070 con 0x564503eaab40 2024-09-19T06:21:36.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.393+0000 7f6ee17fa640 1 -- 172.21.15.2:0/1840826185 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f6eec033020 con 0x564503eaab40 2024-09-19T06:21:36.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.393+0000 7f6f02635740 10 client.17511 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:36.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.393+0000 7f6f02635740 10 client.17511 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:21:36.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.393+0000 7f6f02635740 20 client.17511 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:36.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.393+0000 7f6f02635740 1 --2- 172.21.15.2:0/1840826185 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x564503f33df0 0x564503f36210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:36.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.393+0000 7f6f02635740 4 client.17511 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:21:36.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.393+0000 7f6f02635740 1 -- 172.21.15.2:0/1840826185 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564503e16d70 con 0x564503f33df0 2024-09-19T06:21:36.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.393+0000 7f6efdff8640 1 --2- 172.21.15.2:0/1840826185 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x564503f33df0 0x564503f36210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:36.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.393+0000 7f6ee17fa640 10 client.17511 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:21:36.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.393+0000 7f6efdff8640 1 --2- 172.21.15.2:0/1840826185 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x564503f33df0 0x564503f36210 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cad466bf51fcd0c0 server_cookie=9b78fa21d8fa1ed9 in_seq=0 out_seq=0 2024-09-19T06:21:36.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.393+0000 7f6ee17fa640 1 -- 172.21.15.2:0/1840826185 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564503e16d70 con 0x564503f33df0 2024-09-19T06:21:36.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.393+0000 7f6ee17fa640 10 client.17511 handle_command_reply: tid=0 2024-09-19T06:21:36.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.393+0000 7f6f02635740 1 client.17511 shutdown 2024-09-19T06:21:36.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.394+0000 7f6f02635740 1 -- 172.21.15.2:0/1840826185 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564503eaab40 msgr2=0x564503ec0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:36.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.394+0000 7f6f02635740 1 --2- 172.21.15.2:0/1840826185 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564503eaab40 0x564503ec0fb0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f6eec001eb0 tx=0x7f6eec005000 comp rx=0 tx=0).stop 2024-09-19T06:21:36.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.394+0000 7f6f02635740 1 -- 172.21.15.2:0/1840826185 shutdown_connections 2024-09-19T06:21:36.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.394+0000 7f6f02635740 1 --2- 172.21.15.2:0/1840826185 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x564503f33df0 0x564503f36210 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:36.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.394+0000 7f6f02635740 1 --2- 172.21.15.2:0/1840826185 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564503eb8780 0x564503ebd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:36.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.394+0000 7f6f02635740 1 --2- 172.21.15.2:0/1840826185 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564503eaab40 0x564503ec0fb0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:36.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.394+0000 7f6ee17fa640 0 client.17511 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:21:36.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.394+0000 7f6f02635740 1 --2- 172.21.15.2:0/1840826185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564503ea95d0 0x564503ec0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:36.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.394+0000 7f6f02635740 1 -- 172.21.15.2:0/1840826185 >> 172.21.15.2:0/1840826185 conn(0x564503e72310 msgr2=0x564503eb6c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:36.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.394+0000 7f6f02635740 1 -- 172.21.15.2:0/1840826185 shutdown_connections 2024-09-19T06:21:36.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.394+0000 7f6f02635740 1 -- 172.21.15.2:0/1840826185 wait complete. 2024-09-19T06:21:36.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.394+0000 7f6f02635740 20 client.17511 trim_cache size 0 max 16384 2024-09-19T06:21:36.410 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:21:36.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.394+0000 7f6f0025c640 1 -- 172.21.15.2:0/3520394802 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f6ee40a33b0 msgr2=0x7f6ee40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:36.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.394+0000 7f6f0025c640 1 --2- 172.21.15.2:0/3520394802 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f6ee40a33b0 0x7f6ee40a5870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0004af0 tx=0x7f6ef0004a60 comp rx=0 tx=0).stop 2024-09-19T06:21:36.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.394+0000 7f6f0025c640 1 -- 172.21.15.2:0/3520394802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ef8101df0 msgr2=0x7f6ef8198390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:36.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.394+0000 7f6f0025c640 1 --2- 172.21.15.2:0/3520394802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ef8101df0 0x7f6ef8198390 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f6ef400d950 tx=0x7f6ef400de10 comp rx=0 tx=0).stop 2024-09-19T06:21:36.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.394+0000 7f6f0025c640 1 -- 172.21.15.2:0/3520394802 shutdown_connections 2024-09-19T06:21:36.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.394+0000 7f6f0025c640 1 --2- 172.21.15.2:0/3520394802 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f6ee40a33b0 0x7f6ee40a5870 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:36.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.394+0000 7f6f0025c640 1 --2- 172.21.15.2:0/3520394802 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ef8106f20 0x7f6ef819cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:36.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.394+0000 7f6f0025c640 1 --2- 172.21.15.2:0/3520394802 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ef81027a0 0x7f6ef81988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:36.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.394+0000 7f6f0025c640 1 --2- 172.21.15.2:0/3520394802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ef8101df0 0x7f6ef8198390 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:36.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.395+0000 7f6f0025c640 1 -- 172.21.15.2:0/3520394802 >> 172.21.15.2:0/3520394802 conn(0x7f6ef80fd8b0 msgr2=0x7f6ef80fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:36.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.395+0000 7f6f0025c640 1 -- 172.21.15.2:0/3520394802 shutdown_connections 2024-09-19T06:21:36.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:36.395+0000 7f6f0025c640 1 -- 172.21.15.2:0/3520394802 wait complete. 2024-09-19T06:21:37.104 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:21:37.360 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:37.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:37 smithi002 ceph-mon[30982]: pgmap v209: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:21:37.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:37 smithi090 ceph-mon[34497]: pgmap v209: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:21:37.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.771+0000 7fbb6698b640 1 -- 172.21.15.2:0/387576227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb60102d40 msgr2=0x7fbb60103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:37.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.771+0000 7fbb6698b640 1 --2- 172.21.15.2:0/387576227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb60102d40 0x7fbb60103120 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fbb50009900 tx=0x7fbb5002a480 comp rx=0 tx=0).stop 2024-09-19T06:21:37.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.771+0000 7fbb6698b640 1 -- 172.21.15.2:0/387576227 shutdown_connections 2024-09-19T06:21:37.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.771+0000 7fbb6698b640 1 --2- 172.21.15.2:0/387576227 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb6010c170 0x7fbb6010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:37.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.771+0000 7fbb6698b640 1 --2- 172.21.15.2:0/387576227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb60103660 0x7fbb6010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:37.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.771+0000 7fbb6698b640 1 --2- 172.21.15.2:0/387576227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb60102d40 0x7fbb60103120 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:37.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.771+0000 7fbb6698b640 1 -- 172.21.15.2:0/387576227 >> 172.21.15.2:0/387576227 conn(0x7fbb600fc7a0 msgr2=0x7fbb600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:37.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.771+0000 7fbb6698b640 1 -- 172.21.15.2:0/387576227 shutdown_connections 2024-09-19T06:21:37.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.771+0000 7fbb6698b640 1 -- 172.21.15.2:0/387576227 wait complete. 2024-09-19T06:21:37.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.771+0000 7fbb6698b640 1 Processor -- start 2024-09-19T06:21:37.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.771+0000 7fbb6698b640 1 -- start start 2024-09-19T06:21:37.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.772+0000 7fbb6698b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb60102d40 0x7fbb601009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:37.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.772+0000 7fbb6698b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb60103660 0x7fbb60100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:37.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.772+0000 7fbb6698b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb6010c170 0x7fbb60101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:37.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.772+0000 7fbb6698b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbb60111eb0 con 0x7fbb60103660 2024-09-19T06:21:37.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.772+0000 7fbb6698b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fbb60111d30 con 0x7fbb60102d40 2024-09-19T06:21:37.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.772+0000 7fbb6698b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbb60112030 con 0x7fbb6010c170 2024-09-19T06:21:37.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.772+0000 7fbb5f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb60103660 0x7fbb60100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:37.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.772+0000 7fbb5f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb60103660 0x7fbb60100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34720/0 (socket says 172.21.15.2:34720) 2024-09-19T06:21:37.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.772+0000 7fbb5f7fe640 1 -- 172.21.15.2:0/3044593690 learned_addr learned my addr 172.21.15.2:0/3044593690 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:37.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.772+0000 7fbb5ffff640 1 --2- 172.21.15.2:0/3044593690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb60102d40 0x7fbb601009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:37.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.772+0000 7fbb64f28640 1 --2- 172.21.15.2:0/3044593690 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb6010c170 0x7fbb60101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:37.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.772+0000 7fbb5f7fe640 1 -- 172.21.15.2:0/3044593690 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb6010c170 msgr2=0x7fbb60101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:37.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.772+0000 7fbb5f7fe640 1 --2- 172.21.15.2:0/3044593690 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb6010c170 0x7fbb60101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:37.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.772+0000 7fbb5f7fe640 1 -- 172.21.15.2:0/3044593690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb60102d40 msgr2=0x7fbb601009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:37.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.772+0000 7fbb5f7fe640 1 --2- 172.21.15.2:0/3044593690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb60102d40 0x7fbb601009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:37.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.772+0000 7fbb5f7fe640 1 -- 172.21.15.2:0/3044593690 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb601a6870 con 0x7fbb60103660 2024-09-19T06:21:37.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.772+0000 7fbb5f7fe640 1 --2- 172.21.15.2:0/3044593690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb60103660 0x7fbb60100ee0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fbb5400d740 tx=0x7fbb5400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:37.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.773+0000 7fbb5d7fa640 1 -- 172.21.15.2:0/3044593690 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb54017070 con 0x7fbb60103660 2024-09-19T06:21:37.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.773+0000 7fbb5d7fa640 1 -- 172.21.15.2:0/3044593690 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbb5400de50 con 0x7fbb60103660 2024-09-19T06:21:37.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.773+0000 7fbb6698b640 1 -- 172.21.15.2:0/3044593690 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb601a6b60 con 0x7fbb60103660 2024-09-19T06:21:37.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.773+0000 7fbb5d7fa640 1 -- 172.21.15.2:0/3044593690 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5400f620 con 0x7fbb60103660 2024-09-19T06:21:37.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.773+0000 7fbb6698b640 1 -- 172.21.15.2:0/3044593690 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb601a70a0 con 0x7fbb60103660 2024-09-19T06:21:37.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.776+0000 7fbb5d7fa640 1 -- 172.21.15.2:0/3044593690 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fbb54009c30 con 0x7fbb60103660 2024-09-19T06:21:37.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.776+0000 7fbb68d64740 1 Processor -- start 2024-09-19T06:21:37.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.776+0000 7fbb68d64740 1 -- start start 2024-09-19T06:21:37.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.776+0000 7fbb68d64740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a98a87b40 0x555a98a86090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:37.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.776+0000 7fbb68d64740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a98a865d0 0x555a98a86a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:37.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.776+0000 7fbb68d64740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a98a91370 0x555a98a93760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:37.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.776+0000 7fbb68d64740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555a989ec2f0 con 0x555a98a865d0 2024-09-19T06:21:37.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.776+0000 7fbb68d64740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x555a98993cf0 con 0x555a98a91370 2024-09-19T06:21:37.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.776+0000 7fbb68d64740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x555a989e82b0 con 0x555a98a87b40 2024-09-19T06:21:37.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.776+0000 7fbb5ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a98a865d0 0x555a98a86a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:37.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.776+0000 7fbb5ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a98a865d0 0x555a98a86a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34734/0 (socket says 172.21.15.2:34734) 2024-09-19T06:21:37.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.776+0000 7fbb5ffff640 1 -- 172.21.15.2:0/1995671554 learned_addr learned my addr 172.21.15.2:0/1995671554 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:37.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.777+0000 7fbb5d7fa640 1 --2- 172.21.15.2:0/3044593690 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fbb480a33b0 0x7fbb480a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:37.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.777+0000 7fbb64f28640 1 --2- 172.21.15.2:0/1995671554 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a98a87b40 0x555a98a86090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:37.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.777+0000 7fbb5f7fe640 1 --2- 172.21.15.2:0/1995671554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a98a91370 0x555a98a93760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:37.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.777+0000 7fbb5ffff640 1 -- 172.21.15.2:0/1995671554 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a98a87b40 msgr2=0x555a98a86090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:37.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.777+0000 7fbb5ffff640 1 --2- 172.21.15.2:0/1995671554 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a98a87b40 0x555a98a86090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:37.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.777+0000 7fbb5ffff640 1 -- 172.21.15.2:0/1995671554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a98a91370 msgr2=0x555a98a93760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:37.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.777+0000 7fbb5ffff640 1 --2- 172.21.15.2:0/1995671554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a98a91370 0x555a98a93760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:37.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.777+0000 7fbb64f28640 1 --2- 172.21.15.2:0/3044593690 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fbb480a33b0 0x7fbb480a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:37.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.777+0000 7fbb5ffff640 1 -- 172.21.15.2:0/1995671554 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a989783a0 con 0x555a98a865d0 2024-09-19T06:21:37.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.777+0000 7fbb5f7fe640 1 --2- 172.21.15.2:0/1995671554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a98a91370 0x555a98a93760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:37.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.777+0000 7fbb5d7fa640 1 -- 172.21.15.2:0/3044593690 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7fbb540cf800 con 0x7fbb60103660 2024-09-19T06:21:37.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.777+0000 7fbb5ffff640 1 --2- 172.21.15.2:0/1995671554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a98a865d0 0x555a98a86a10 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fbb50009230 tx=0x7fbb50004310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa1d9a2b72b2a78 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:37.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.777+0000 7fbb467fc640 1 -- 172.21.15.2:0/1995671554 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb50035040 con 0x555a98a865d0 2024-09-19T06:21:37.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.777+0000 7fbb467fc640 1 -- 172.21.15.2:0/1995671554 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbb50004770 con 0x555a98a865d0 2024-09-19T06:21:37.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.777+0000 7fbb467fc640 1 -- 172.21.15.2:0/1995671554 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb50003850 con 0x555a98a865d0 2024-09-19T06:21:37.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.777+0000 7fbb64f28640 1 --2- 172.21.15.2:0/3044593690 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fbb480a33b0 0x7fbb480a5870 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fbb58009fd0 tx=0x7fbb5800d040 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:37.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.778+0000 7fbb68d64740 1 -- 172.21.15.2:0/1995671554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a98a865d0 msgr2=0x555a98a86a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:37.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.778+0000 7fbb68d64740 1 --2- 172.21.15.2:0/1995671554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a98a865d0 0x555a98a86a10 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fbb50009230 tx=0x7fbb50004310 comp rx=0 tx=0).stop 2024-09-19T06:21:37.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.778+0000 7fbb68d64740 1 -- 172.21.15.2:0/1995671554 shutdown_connections 2024-09-19T06:21:37.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.778+0000 7fbb68d64740 1 --2- 172.21.15.2:0/1995671554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a98a91370 0x555a98a93760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:37.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.778+0000 7fbb68d64740 1 --2- 172.21.15.2:0/1995671554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a98a865d0 0x555a98a86a10 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:37.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.778+0000 7fbb68d64740 1 --2- 172.21.15.2:0/1995671554 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a98a87b40 0x555a98a86090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:37.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.778+0000 7fbb68d64740 1 -- 172.21.15.2:0/1995671554 >> 172.21.15.2:0/1995671554 conn(0x555a98a4f310 msgr2=0x555a98a82c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:37.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.778+0000 7fbb68d64740 1 -- 172.21.15.2:0/1995671554 shutdown_connections 2024-09-19T06:21:37.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.778+0000 7fbb68d64740 1 -- 172.21.15.2:0/1995671554 wait complete. 2024-09-19T06:21:37.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.778+0000 7fbb68d64740 1 -- start start 2024-09-19T06:21:37.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.779+0000 7fbb68d64740 1 Processor -- start 2024-09-19T06:21:37.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.779+0000 7fbb68d64740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a98a865d0 0x555a98a90d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:37.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.779+0000 7fbb68d64740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a98a87b40 0x555a98a8dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:37.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.779+0000 7fbb68d64740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a98a91370 0x555a98a8e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:37.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.779+0000 7fbb68d64740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555a98a94010 con 0x555a98a865d0 2024-09-19T06:21:37.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.779+0000 7fbb68d64740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x555a989a7060 con 0x555a98a87b40 2024-09-19T06:21:37.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.779+0000 7fbb68d64740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x555a98a94190 con 0x555a98a91370 2024-09-19T06:21:37.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.779+0000 7fbb68d64740 10 client.0 _ll_register_callbacks cb 0x555a986fa8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:37.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.779+0000 7fbb5ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a98a865d0 0x555a98a90d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:37.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.779+0000 7fbb5ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a98a865d0 0x555a98a90d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34736/0 (socket says 172.21.15.2:34736) 2024-09-19T06:21:37.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.779+0000 7fbb5ffff640 1 -- 172.21.15.2:0/2242879187 learned_addr learned my addr 172.21.15.2:0/2242879187 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:37.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.779+0000 7fbb5f7fe640 1 --2- 172.21.15.2:0/2242879187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a98a87b40 0x555a98a8dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:37.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.780+0000 7fbb64f28640 1 --2- 172.21.15.2:0/2242879187 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a98a91370 0x555a98a8e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:37.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.780+0000 7fbb5ffff640 1 -- 172.21.15.2:0/2242879187 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a98a91370 msgr2=0x555a98a8e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:37.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.780+0000 7fbb5ffff640 1 --2- 172.21.15.2:0/2242879187 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a98a91370 0x555a98a8e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:37.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.780+0000 7fbb5ffff640 1 -- 172.21.15.2:0/2242879187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a98a87b40 msgr2=0x555a98a8dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:37.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.780+0000 7fbb5ffff640 1 --2- 172.21.15.2:0/2242879187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a98a87b40 0x555a98a8dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:37.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.780+0000 7fbb5ffff640 1 -- 172.21.15.2:0/2242879187 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a9875d3c0 con 0x555a98a865d0 2024-09-19T06:21:37.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.780+0000 7fbb64f28640 1 --2- 172.21.15.2:0/2242879187 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a98a91370 0x555a98a8e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:21:37.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.780+0000 7fbb5ffff640 1 --2- 172.21.15.2:0/2242879187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a98a865d0 0x555a98a90d30 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fbb5002aa70 tx=0x7fbb50000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d7721fffad633e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:37.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.780+0000 7fbb3f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:37.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.780+0000 7fbb3f7fe640 1 -- 172.21.15.2:0/2242879187 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb50052060 con 0x555a98a865d0 2024-09-19T06:21:37.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.780+0000 7fbb3f7fe640 1 -- 172.21.15.2:0/2242879187 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7fbb50005210 con 0x555a98a865d0 2024-09-19T06:21:37.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.780+0000 7fbb68d64740 1 -- 172.21.15.2:0/2242879187 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb50004770 con 0x555a98a865d0 2024-09-19T06:21:37.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.780+0000 7fbb3f7fe640 1 -- 172.21.15.2:0/2242879187 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fbb50035050 con 0x555a98a865d0 2024-09-19T06:21:37.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.780+0000 7fbb68d64740 10 client.17523 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:37.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.780+0000 7fbb68d64740 1 -- 172.21.15.2:0/2242879187 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555a98a9faa0 con 0x555a98a865d0 2024-09-19T06:21:37.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.780+0000 7fbb3f7fe640 1 -- 172.21.15.2:0/2242879187 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbb50004770 con 0x555a98a865d0 2024-09-19T06:21:37.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.781+0000 7fbb3f7fe640 1 -- 172.21.15.2:0/2242879187 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fbb5003c440 con 0x555a98a865d0 2024-09-19T06:21:37.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.781+0000 7fbb68d64740 10 client.17523 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:37.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.781+0000 7fbb68d64740 10 client.17523 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:21:37.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.781+0000 7fbb68d64740 20 client.17523 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:37.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.781+0000 7fbb68d64740 1 --2- 172.21.15.2:0/2242879187 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x555a98aa0df0 0x555a98aa31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:37.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.781+0000 7fbb68d64740 4 client.17523 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:37.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.781+0000 7fbb68d64740 1 -- 172.21.15.2:0/2242879187 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555a989f9860 con 0x555a98aa0df0 2024-09-19T06:21:37.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.781+0000 7fbb5f7fe640 1 --2- 172.21.15.2:0/2242879187 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x555a98aa0df0 0x555a98aa31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:37.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.781+0000 7fbb5f7fe640 1 --2- 172.21.15.2:0/2242879187 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x555a98aa0df0 0x555a98aa31e0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=aa284f38d0338b8f server_cookie=1169b3769f63d744 in_seq=0 out_seq=0 2024-09-19T06:21:37.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.781+0000 7fbb3f7fe640 10 client.17523 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:21:37.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.782+0000 7fbb3f7fe640 1 -- 172.21.15.2:0/2242879187 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555a989f9860 con 0x555a98aa0df0 2024-09-19T06:21:37.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.782+0000 7fbb3f7fe640 10 client.17523 handle_command_reply: tid=0 2024-09-19T06:21:37.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.782+0000 7fbb68d64740 1 client.17523 shutdown 2024-09-19T06:21:37.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.782+0000 7fbb68d64740 1 -- 172.21.15.2:0/2242879187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a98a865d0 msgr2=0x555a98a90d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:37.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.782+0000 7fbb68d64740 1 --2- 172.21.15.2:0/2242879187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a98a865d0 0x555a98a90d30 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fbb5002aa70 tx=0x7fbb50000bc0 comp rx=0 tx=0).stop 2024-09-19T06:21:37.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.782+0000 7fbb68d64740 1 -- 172.21.15.2:0/2242879187 shutdown_connections 2024-09-19T06:21:37.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.782+0000 7fbb68d64740 1 --2- 172.21.15.2:0/2242879187 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x555a98aa0df0 0x555a98aa31e0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:37.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.782+0000 7fbb68d64740 1 --2- 172.21.15.2:0/2242879187 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a98a91370 0x555a98a8e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:37.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.782+0000 7fbb68d64740 1 --2- 172.21.15.2:0/2242879187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a98a87b40 0x555a98a8dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:37.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.782+0000 7fbb68d64740 1 --2- 172.21.15.2:0/2242879187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a98a865d0 0x555a98a90d30 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:37.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.782+0000 7fbb68d64740 1 -- 172.21.15.2:0/2242879187 >> 172.21.15.2:0/2242879187 conn(0x555a98a4f310 msgr2=0x555a98a88930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:37.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.782+0000 7fbb3f7fe640 0 client.17523 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:21:37.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.782+0000 7fbb68d64740 1 -- 172.21.15.2:0/2242879187 shutdown_connections 2024-09-19T06:21:37.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.782+0000 7fbb68d64740 1 -- 172.21.15.2:0/2242879187 wait complete. 2024-09-19T06:21:37.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.783+0000 7fbb68d64740 20 client.17523 trim_cache size 0 max 16384 2024-09-19T06:21:37.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:37 smithi089 ceph-mon[34160]: pgmap v209: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:21:37.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.795+0000 7fbb68d64740 1 Processor -- start 2024-09-19T06:21:37.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.795+0000 7fbb68d64740 1 -- start start 2024-09-19T06:21:37.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.796+0000 7fbb68d64740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a98a865d0 0x555a98a9d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:37.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.796+0000 7fbb68d64740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a98a87b40 0x555a98a8cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:37.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.796+0000 7fbb68d64740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a98a91370 0x555a98aa8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:37.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.796+0000 7fbb68d64740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbb601b2240 con 0x555a98a87b40 2024-09-19T06:21:37.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.796+0000 7fbb68d64740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fbb601afb10 con 0x555a98a865d0 2024-09-19T06:21:37.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.796+0000 7fbb68d64740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbb601ad980 con 0x555a98a91370 2024-09-19T06:21:37.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.796+0000 7fbb5f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a98a87b40 0x555a98a8cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:37.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.796+0000 7fbb5f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a98a87b40 0x555a98a8cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34748/0 (socket says 172.21.15.2:34748) 2024-09-19T06:21:37.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.796+0000 7fbb5f7fe640 1 -- 172.21.15.2:0/438166661 learned_addr learned my addr 172.21.15.2:0/438166661 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:37.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.796+0000 7fbb64f28640 1 --2- 172.21.15.2:0/438166661 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a98a91370 0x555a98aa8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:37.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.796+0000 7fbb5f7fe640 1 -- 172.21.15.2:0/438166661 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a98a91370 msgr2=0x555a98aa8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:37.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.796+0000 7fbb5f7fe640 1 --2- 172.21.15.2:0/438166661 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a98a91370 0x555a98aa8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:37.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.796+0000 7fbb5ffff640 1 --2- 172.21.15.2:0/438166661 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a98a865d0 0x555a98a9d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:37.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.796+0000 7fbb5f7fe640 1 -- 172.21.15.2:0/438166661 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a98a865d0 msgr2=0x555a98a9d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:37.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.796+0000 7fbb5f7fe640 1 --2- 172.21.15.2:0/438166661 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a98a865d0 0x555a98a9d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:37.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.796+0000 7fbb5f7fe640 1 -- 172.21.15.2:0/438166661 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a98a8c530 con 0x555a98a87b40 2024-09-19T06:21:37.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.796+0000 7fbb64f28640 1 --2- 172.21.15.2:0/438166661 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a98a91370 0x555a98aa8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:21:37.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.796+0000 7fbb5f7fe640 1 --2- 172.21.15.2:0/438166661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a98a87b40 0x555a98a8cfc0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fbb5409b890 tx=0x7fbb54097f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61a45a50d3baf92b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:37.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.796+0000 7fbb45ffb640 1 -- 172.21.15.2:0/438166661 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb54020040 con 0x555a98a87b40 2024-09-19T06:21:37.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.797+0000 7fbb45ffb640 1 -- 172.21.15.2:0/438166661 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbb54099e90 con 0x555a98a87b40 2024-09-19T06:21:37.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.797+0000 7fbb45ffb640 1 -- 172.21.15.2:0/438166661 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb540978e0 con 0x555a98a87b40 2024-09-19T06:21:37.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.797+0000 7fbb68d64740 1 -- 172.21.15.2:0/438166661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a98a87b40 msgr2=0x555a98a8cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:37.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.797+0000 7fbb68d64740 1 --2- 172.21.15.2:0/438166661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a98a87b40 0x555a98a8cfc0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fbb5409b890 tx=0x7fbb54097f60 comp rx=0 tx=0).stop 2024-09-19T06:21:37.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.797+0000 7fbb68d64740 1 -- 172.21.15.2:0/438166661 shutdown_connections 2024-09-19T06:21:37.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.797+0000 7fbb68d64740 1 --2- 172.21.15.2:0/438166661 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a98a91370 0x555a98aa8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:37.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.797+0000 7fbb68d64740 1 --2- 172.21.15.2:0/438166661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a98a87b40 0x555a98a8cfc0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:37.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.797+0000 7fbb68d64740 1 --2- 172.21.15.2:0/438166661 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a98a865d0 0x555a98a9d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:37.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.797+0000 7fbb68d64740 1 -- 172.21.15.2:0/438166661 >> 172.21.15.2:0/438166661 conn(0x555a98a4f310 msgr2=0x555a98a8c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:37.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.797+0000 7fbb68d64740 1 -- 172.21.15.2:0/438166661 shutdown_connections 2024-09-19T06:21:37.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.797+0000 7fbb68d64740 1 -- 172.21.15.2:0/438166661 wait complete. 2024-09-19T06:21:37.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.798+0000 7fbb68d64740 1 -- start start 2024-09-19T06:21:37.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.798+0000 7fbb68d64740 1 Processor -- start 2024-09-19T06:21:37.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.798+0000 7fbb68d64740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a98a865d0 0x555a98a999c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:37.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.798+0000 7fbb68d64740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a98a87b40 0x555a98a8abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:37.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.798+0000 7fbb68d64740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a98a91370 0x555a98a8b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:37.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.798+0000 7fbb68d64740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbb601adfd0 con 0x555a98a87b40 2024-09-19T06:21:37.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.798+0000 7fbb68d64740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fbb601af440 con 0x555a98a91370 2024-09-19T06:21:37.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.798+0000 7fbb68d64740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbb601ae6a0 con 0x555a98a865d0 2024-09-19T06:21:37.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.798+0000 7fbb68d64740 10 client.0 _ll_register_callbacks cb 0x7fbb50004260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:37.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.798+0000 7fbb5f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a98a87b40 0x555a98a8abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:37.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.798+0000 7fbb5f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a98a87b40 0x555a98a8abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34750/0 (socket says 172.21.15.2:34750) 2024-09-19T06:21:37.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.798+0000 7fbb5f7fe640 1 -- 172.21.15.2:0/1082275243 learned_addr learned my addr 172.21.15.2:0/1082275243 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:37.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.799+0000 7fbb64f28640 1 --2- 172.21.15.2:0/1082275243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a98a91370 0x555a98a8b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:37.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.799+0000 7fbb5ffff640 1 --2- 172.21.15.2:0/1082275243 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a98a865d0 0x555a98a999c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:37.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.799+0000 7fbb5f7fe640 1 -- 172.21.15.2:0/1082275243 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a98a865d0 msgr2=0x555a98a999c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:37.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.799+0000 7fbb5f7fe640 1 --2- 172.21.15.2:0/1082275243 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a98a865d0 0x555a98a999c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:37.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.799+0000 7fbb5f7fe640 1 -- 172.21.15.2:0/1082275243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a98a91370 msgr2=0x555a98a8b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:37.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.799+0000 7fbb5f7fe640 1 --2- 172.21.15.2:0/1082275243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a98a91370 0x555a98a8b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:37.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.799+0000 7fbb5f7fe640 1 -- 172.21.15.2:0/1082275243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a98a8b780 con 0x555a98a87b40 2024-09-19T06:21:37.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.799+0000 7fbb5f7fe640 1 --2- 172.21.15.2:0/1082275243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a98a87b40 0x555a98a8abd0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fbb5409b890 tx=0x7fbb5409b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84a46d2e7b68ae8b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:37.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.799+0000 7fbb3f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:37.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.799+0000 7fbb3f7fe640 1 -- 172.21.15.2:0/1082275243 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb540b3020 con 0x555a98a87b40 2024-09-19T06:21:37.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.799+0000 7fbb3f7fe640 1 -- 172.21.15.2:0/1082275243 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7fbb540861b0 con 0x555a98a87b40 2024-09-19T06:21:37.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.799+0000 7fbb68d64740 1 -- 172.21.15.2:0/1082275243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb54099e90 con 0x555a98a87b40 2024-09-19T06:21:37.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.799+0000 7fbb3f7fe640 1 -- 172.21.15.2:0/1082275243 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fbb54020040 con 0x555a98a87b40 2024-09-19T06:21:37.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.799+0000 7fbb68d64740 10 client.17529 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:37.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.799+0000 7fbb68d64740 1 -- 172.21.15.2:0/1082275243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555a98b0b570 con 0x555a98a87b40 2024-09-19T06:21:37.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.800+0000 7fbb3f7fe640 1 -- 172.21.15.2:0/1082275243 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbb54099e90 con 0x555a98a87b40 2024-09-19T06:21:37.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.800+0000 7fbb3f7fe640 1 -- 172.21.15.2:0/1082275243 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fbb540b4ce0 con 0x555a98a87b40 2024-09-19T06:21:37.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.800+0000 7fbb68d64740 10 client.17529 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:37.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.800+0000 7fbb68d64740 10 client.17529 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:21:37.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.800+0000 7fbb68d64740 20 client.17529 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:37.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.800+0000 7fbb68d64740 1 --2- 172.21.15.2:0/1082275243 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x555a98b0bc60 0x555a98b0e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:37.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.800+0000 7fbb68d64740 4 client.17529 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:21:37.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.800+0000 7fbb68d64740 1 -- 172.21.15.2:0/1082275243 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555a989f3d70 con 0x555a98b0bc60 2024-09-19T06:21:37.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.800+0000 7fbb5ffff640 1 --2- 172.21.15.2:0/1082275243 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x555a98b0bc60 0x555a98b0e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:37.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.800+0000 7fbb3f7fe640 10 client.17529 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:21:37.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.800+0000 7fbb5ffff640 1 --2- 172.21.15.2:0/1082275243 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x555a98b0bc60 0x555a98b0e080 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=587da0c3dd962606 server_cookie=7e665716e827bb8c in_seq=0 out_seq=0 2024-09-19T06:21:37.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.801+0000 7fbb3f7fe640 1 -- 172.21.15.2:0/1082275243 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555a989f3d70 con 0x555a98b0bc60 2024-09-19T06:21:37.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.801+0000 7fbb3f7fe640 10 client.17529 handle_command_reply: tid=0 2024-09-19T06:21:37.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.801+0000 7fbb68d64740 1 client.17529 shutdown 2024-09-19T06:21:37.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.801+0000 7fbb68d64740 1 -- 172.21.15.2:0/1082275243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a98a87b40 msgr2=0x555a98a8abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:37.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.801+0000 7fbb68d64740 1 --2- 172.21.15.2:0/1082275243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a98a87b40 0x555a98a8abd0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fbb5409b890 tx=0x7fbb5409b4f0 comp rx=0 tx=0).stop 2024-09-19T06:21:37.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.801+0000 7fbb68d64740 1 -- 172.21.15.2:0/1082275243 shutdown_connections 2024-09-19T06:21:37.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.801+0000 7fbb68d64740 1 --2- 172.21.15.2:0/1082275243 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x555a98b0bc60 0x555a98b0e080 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:37.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.801+0000 7fbb68d64740 1 --2- 172.21.15.2:0/1082275243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a98a91370 0x555a98a8b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:37.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.801+0000 7fbb68d64740 1 --2- 172.21.15.2:0/1082275243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a98a87b40 0x555a98a8abd0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:37.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.801+0000 7fbb3f7fe640 0 client.17529 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:21:37.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.801+0000 7fbb68d64740 1 --2- 172.21.15.2:0/1082275243 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555a98a865d0 0x555a98a999c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:37.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.801+0000 7fbb68d64740 1 -- 172.21.15.2:0/1082275243 >> 172.21.15.2:0/1082275243 conn(0x555a98a4f310 msgr2=0x555a98a8d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:37.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.801+0000 7fbb68d64740 1 -- 172.21.15.2:0/1082275243 shutdown_connections 2024-09-19T06:21:37.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.801+0000 7fbb68d64740 1 -- 172.21.15.2:0/1082275243 wait complete. 2024-09-19T06:21:37.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.801+0000 7fbb68d64740 20 client.17529 trim_cache size 0 max 16384 2024-09-19T06:21:37.809 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:21:37.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.802+0000 7fbb6698b640 1 -- 172.21.15.2:0/3044593690 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fbb480a33b0 msgr2=0x7fbb480a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:37.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.802+0000 7fbb6698b640 1 --2- 172.21.15.2:0/3044593690 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fbb480a33b0 0x7fbb480a5870 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fbb58009fd0 tx=0x7fbb5800d040 comp rx=0 tx=0).stop 2024-09-19T06:21:37.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.802+0000 7fbb6698b640 1 -- 172.21.15.2:0/3044593690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb60103660 msgr2=0x7fbb60100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:37.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.802+0000 7fbb6698b640 1 --2- 172.21.15.2:0/3044593690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb60103660 0x7fbb60100ee0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fbb5400d740 tx=0x7fbb5400dc00 comp rx=0 tx=0).stop 2024-09-19T06:21:37.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.802+0000 7fbb6698b640 1 -- 172.21.15.2:0/3044593690 shutdown_connections 2024-09-19T06:21:37.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.802+0000 7fbb6698b640 1 --2- 172.21.15.2:0/3044593690 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fbb480a33b0 0x7fbb480a5870 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:37.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.802+0000 7fbb6698b640 1 --2- 172.21.15.2:0/3044593690 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb6010c170 0x7fbb60101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:37.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.802+0000 7fbb6698b640 1 --2- 172.21.15.2:0/3044593690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb60103660 0x7fbb60100ee0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:37.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.802+0000 7fbb6698b640 1 --2- 172.21.15.2:0/3044593690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb60102d40 0x7fbb601009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:37.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.802+0000 7fbb6698b640 1 -- 172.21.15.2:0/3044593690 >> 172.21.15.2:0/3044593690 conn(0x7fbb600fc7a0 msgr2=0x7fbb600fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:37.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.802+0000 7fbb6698b640 1 -- 172.21.15.2:0/3044593690 shutdown_connections 2024-09-19T06:21:37.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:37.802+0000 7fbb6698b640 1 -- 172.21.15.2:0/3044593690 wait complete. 2024-09-19T06:21:38.563 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:21:38.817 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:39.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.238+0000 7fd0dbd3e640 1 -- 172.21.15.2:0/3129406970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0d4101de0 msgr2=0x7fd0d41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:39.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.238+0000 7fd0dbd3e640 1 --2- 172.21.15.2:0/3129406970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0d4101de0 0x7fd0d41021c0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fd0d0009900 tx=0x7fd0d002a410 comp rx=0 tx=0).stop 2024-09-19T06:21:39.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.238+0000 7fd0dbd3e640 1 -- 172.21.15.2:0/3129406970 shutdown_connections 2024-09-19T06:21:39.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.238+0000 7fd0dbd3e640 1 --2- 172.21.15.2:0/3129406970 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0d4106f10 0x7fd0d410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.238+0000 7fd0dbd3e640 1 --2- 172.21.15.2:0/3129406970 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0d4102790 0x7fd0d41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.238+0000 7fd0dbd3e640 1 --2- 172.21.15.2:0/3129406970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0d4101de0 0x7fd0d41021c0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.238+0000 7fd0dbd3e640 1 -- 172.21.15.2:0/3129406970 >> 172.21.15.2:0/3129406970 conn(0x7fd0d40fd8c0 msgr2=0x7fd0d40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:39.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.238+0000 7fd0dbd3e640 1 -- 172.21.15.2:0/3129406970 shutdown_connections 2024-09-19T06:21:39.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.238+0000 7fd0dbd3e640 1 -- 172.21.15.2:0/3129406970 wait complete. 2024-09-19T06:21:39.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.239+0000 7fd0dbd3e640 1 Processor -- start 2024-09-19T06:21:39.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.239+0000 7fd0dbd3e640 1 -- start start 2024-09-19T06:21:39.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.240+0000 7fd0dbd3e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0d4101de0 0x7fd0d4198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:39.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.240+0000 7fd0dbd3e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0d4102790 0x7fd0d41988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:39.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.240+0000 7fd0dbd3e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0d4106f10 0x7fd0d419cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:39.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.240+0000 7fd0dbd3e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d4111e20 con 0x7fd0d4106f10 2024-09-19T06:21:39.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.240+0000 7fd0dbd3e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d4111ca0 con 0x7fd0d4102790 2024-09-19T06:21:39.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.240+0000 7fd0dbd3e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d4111fa0 con 0x7fd0d4101de0 2024-09-19T06:21:39.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.240+0000 7fd0da2db640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0d4106f10 0x7fd0d419cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:39.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.240+0000 7fd0da2db640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0d4106f10 0x7fd0d419cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34762/0 (socket says 172.21.15.2:34762) 2024-09-19T06:21:39.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.240+0000 7fd0da2db640 1 -- 172.21.15.2:0/1624673440 learned_addr learned my addr 172.21.15.2:0/1624673440 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:39.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.240+0000 7fd0d9ada640 1 --2- 172.21.15.2:0/1624673440 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0d4101de0 0x7fd0d4198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:39.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.240+0000 7fd0d92d9640 1 --2- 172.21.15.2:0/1624673440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0d4102790 0x7fd0d41988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:39.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.240+0000 7fd0da2db640 1 -- 172.21.15.2:0/1624673440 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0d4101de0 msgr2=0x7fd0d4198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:39.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.240+0000 7fd0da2db640 1 --2- 172.21.15.2:0/1624673440 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0d4101de0 0x7fd0d4198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.240+0000 7fd0da2db640 1 -- 172.21.15.2:0/1624673440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0d4102790 msgr2=0x7fd0d41988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:39.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.240+0000 7fd0da2db640 1 --2- 172.21.15.2:0/1624673440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0d4102790 0x7fd0d41988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.240+0000 7fd0da2db640 1 -- 172.21.15.2:0/1624673440 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0d419d310 con 0x7fd0d4106f10 2024-09-19T06:21:39.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.241+0000 7fd0da2db640 1 --2- 172.21.15.2:0/1624673440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0d4106f10 0x7fd0d419cc30 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc00eaa0 tx=0x7fd0cc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:39.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.241+0000 7fd0caffd640 1 -- 172.21.15.2:0/1624673440 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc00cdb0 con 0x7fd0d4106f10 2024-09-19T06:21:39.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.241+0000 7fd0caffd640 1 -- 172.21.15.2:0/1624673440 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd0cc005020 con 0x7fd0d4106f10 2024-09-19T06:21:39.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.241+0000 7fd0dbd3e640 1 -- 172.21.15.2:0/1624673440 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0d419d600 con 0x7fd0d4106f10 2024-09-19T06:21:39.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.241+0000 7fd0caffd640 1 -- 172.21.15.2:0/1624673440 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc0116d0 con 0x7fd0d4106f10 2024-09-19T06:21:39.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.241+0000 7fd0dbd3e640 1 -- 172.21.15.2:0/1624673440 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0d41a4ee0 con 0x7fd0d4106f10 2024-09-19T06:21:39.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.244+0000 7fd0de117740 1 Processor -- start 2024-09-19T06:21:39.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.244+0000 7fd0caffd640 1 -- 172.21.15.2:0/1624673440 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fd0cc0051d0 con 0x7fd0d4106f10 2024-09-19T06:21:39.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.244+0000 7fd0de117740 1 -- start start 2024-09-19T06:21:39.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.244+0000 7fd0de117740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c89d5ab40 0x559c89d59090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:39.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.244+0000 7fd0de117740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c89d595d0 0x559c89d59a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:39.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.244+0000 7fd0de117740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c89d68780 0x559c89d6ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:39.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.244+0000 7fd0de117740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559c89cbf2f0 con 0x559c89d68780 2024-09-19T06:21:39.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.244+0000 7fd0de117740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x559c89c66cf0 con 0x559c89d5ab40 2024-09-19T06:21:39.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.244+0000 7fd0de117740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x559c89cbb2b0 con 0x559c89d595d0 2024-09-19T06:21:39.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.245+0000 7fd0d92d9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c89d68780 0x559c89d6ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:39.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.245+0000 7fd0d92d9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c89d5ab40 0x559c89d59090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:39.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.245+0000 7fd0d92d9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c89d5ab40 0x559c89d59090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:56596/0 (socket says 172.21.15.2:56596) 2024-09-19T06:21:39.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.245+0000 7fd0d92d9640 1 -- 172.21.15.2:0/2396027793 learned_addr learned my addr 172.21.15.2:0/2396027793 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:39.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.245+0000 7fd0caffd640 1 --2- 172.21.15.2:0/1624673440 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fd0c00a3430 0x7fd0c00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:39.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.245+0000 7fd0d9ada640 1 --2- 172.21.15.2:0/2396027793 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c89d595d0 0x559c89d59a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:39.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.245+0000 7fd0da2db640 1 --2- 172.21.15.2:0/1624673440 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fd0c00a3430 0x7fd0c00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:39.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.245+0000 7fd0d92d9640 1 -- 172.21.15.2:0/2396027793 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c89d595d0 msgr2=0x559c89d59a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:39.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.245+0000 7fd0d92d9640 1 --2- 172.21.15.2:0/2396027793 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c89d595d0 0x559c89d59a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.245+0000 7fd0d92d9640 1 -- 172.21.15.2:0/2396027793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c89d68780 msgr2=0x559c89d6ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:39.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.245+0000 7fd0d92d9640 1 --2- 172.21.15.2:0/2396027793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c89d68780 0x559c89d6ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.245+0000 7fd0d92d9640 1 -- 172.21.15.2:0/2396027793 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c89c4b3a0 con 0x559c89d5ab40 2024-09-19T06:21:39.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.245+0000 7fd0caffd640 1 -- 172.21.15.2:0/1624673440 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7fd0cc0cfd60 con 0x7fd0d4106f10 2024-09-19T06:21:39.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.245+0000 7fd0d9ada640 1 --2- 172.21.15.2:0/2396027793 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c89d595d0 0x559c89d59a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:39.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.245+0000 7fd0d92d9640 1 --2- 172.21.15.2:0/2396027793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c89d5ab40 0x559c89d59090 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x559c89d5a070 tx=0x7fd0c400b390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8f0b93f646479df server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:39.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.246+0000 7fd0da2db640 1 --2- 172.21.15.2:0/1624673440 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fd0c00a3430 0x7fd0c00a58f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc0cd560 tx=0x7fd0cc01e8c0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:39.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.246+0000 7fd0bffff640 1 -- 172.21.15.2:0/2396027793 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c400f760 con 0x559c89d5ab40 2024-09-19T06:21:39.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.246+0000 7fd0bffff640 1 -- 172.21.15.2:0/2396027793 <== mon.2 v2:172.21.15.89:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd0c400fdb0 con 0x559c89d5ab40 2024-09-19T06:21:39.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.246+0000 7fd0bffff640 1 -- 172.21.15.2:0/2396027793 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4010b40 con 0x559c89d5ab40 2024-09-19T06:21:39.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.246+0000 7fd0de117740 1 -- 172.21.15.2:0/2396027793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c89d5ab40 msgr2=0x559c89d59090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:39.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.246+0000 7fd0de117740 1 --2- 172.21.15.2:0/2396027793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c89d5ab40 0x559c89d59090 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x559c89d5a070 tx=0x7fd0c400b390 comp rx=0 tx=0).stop 2024-09-19T06:21:39.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.246+0000 7fd0de117740 1 -- 172.21.15.2:0/2396027793 shutdown_connections 2024-09-19T06:21:39.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.246+0000 7fd0de117740 1 --2- 172.21.15.2:0/2396027793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c89d68780 0x559c89d6ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.246+0000 7fd0de117740 1 --2- 172.21.15.2:0/2396027793 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c89d595d0 0x559c89d59a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.246+0000 7fd0de117740 1 --2- 172.21.15.2:0/2396027793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c89d5ab40 0x559c89d59090 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.246+0000 7fd0de117740 1 -- 172.21.15.2:0/2396027793 >> 172.21.15.2:0/2396027793 conn(0x559c89d22310 msgr2=0x559c89d55c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:39.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.247+0000 7fd0de117740 1 -- 172.21.15.2:0/2396027793 shutdown_connections 2024-09-19T06:21:39.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.247+0000 7fd0de117740 1 -- 172.21.15.2:0/2396027793 wait complete. 2024-09-19T06:21:39.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.247+0000 7fd0de117740 1 -- start start 2024-09-19T06:21:39.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.247+0000 7fd0de117740 1 Processor -- start 2024-09-19T06:21:39.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.247+0000 7fd0de117740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c89d595d0 0x559c89d681b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:39.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.247+0000 7fd0de117740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c89d5ab40 0x559c89d65460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:39.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.247+0000 7fd0de117740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c89d68780 0x559c89d65bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:39.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.247+0000 7fd0de117740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559c89d6b480 con 0x559c89d68780 2024-09-19T06:21:39.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.247+0000 7fd0de117740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x559c89c7a060 con 0x559c89d5ab40 2024-09-19T06:21:39.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.248+0000 7fd0de117740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x559c89d6b600 con 0x559c89d595d0 2024-09-19T06:21:39.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.248+0000 7fd0de117740 10 client.0 _ll_register_callbacks cb 0x559c899cd8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:39.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.248+0000 7fd0d92d9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c89d68780 0x559c89d65bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:39.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.248+0000 7fd0d92d9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c89d68780 0x559c89d65bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34776/0 (socket says 172.21.15.2:34776) 2024-09-19T06:21:39.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.248+0000 7fd0d92d9640 1 -- 172.21.15.2:0/2017657243 learned_addr learned my addr 172.21.15.2:0/2017657243 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:39.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.248+0000 7fd0d9ada640 1 --2- 172.21.15.2:0/2017657243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c89d5ab40 0x559c89d65460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:39.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.248+0000 7fd0d92d9640 1 --2- 172.21.15.2:0/2017657243 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c89d595d0 0x559c89d681b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:39.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.248+0000 7fd0d9ada640 1 -- 172.21.15.2:0/2017657243 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c89d595d0 msgr2=0x559c89d681b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:39.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.248+0000 7fd0d9ada640 1 --2- 172.21.15.2:0/2017657243 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c89d595d0 0x559c89d681b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.248+0000 7fd0d9ada640 1 -- 172.21.15.2:0/2017657243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c89d68780 msgr2=0x559c89d65bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:39.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.248+0000 7fd0d9ada640 1 --2- 172.21.15.2:0/2017657243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c89d68780 0x559c89d65bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.248+0000 7fd0d9ada640 1 -- 172.21.15.2:0/2017657243 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c89a303c0 con 0x559c89d5ab40 2024-09-19T06:21:39.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.248+0000 7fd0d92d9640 1 --2- 172.21.15.2:0/2017657243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c89d68780 0x559c89d65bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:39.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.248+0000 7fd0d9ada640 1 --2- 172.21.15.2:0/2017657243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c89d5ab40 0x559c89d65460 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd0d0009230 tx=0x7fd0d0032e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab4a5eac91f46041 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:39.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.248+0000 7fd0bd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-09-19T06:21:39.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.248+0000 7fd0bd7fa640 1 -- 172.21.15.2:0/2017657243 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d0035040 con 0x559c89d5ab40 2024-09-19T06:21:39.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.249+0000 7fd0de117740 1 -- 172.21.15.2:0/2017657243 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0c400fdb0 con 0x559c89d5ab40 2024-09-19T06:21:39.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.249+0000 7fd0bd7fa640 1 -- 172.21.15.2:0/2017657243 <== mon.2 v2:172.21.15.89:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7fd0d0031720 con 0x559c89d5ab40 2024-09-19T06:21:39.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.249+0000 7fd0bd7fa640 1 -- 172.21.15.2:0/2017657243 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd0d0004040 con 0x559c89d5ab40 2024-09-19T06:21:39.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.249+0000 7fd0de117740 10 client.26723 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:39.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.249+0000 7fd0de117740 1 -- 172.21.15.2:0/2017657243 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x559c89d76fb0 con 0x559c89d5ab40 2024-09-19T06:21:39.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.249+0000 7fd0bd7fa640 1 -- 172.21.15.2:0/2017657243 <== mon.2 v2:172.21.15.89:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd0c400fdb0 con 0x559c89d5ab40 2024-09-19T06:21:39.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.249+0000 7fd0bd7fa640 1 -- 172.21.15.2:0/2017657243 <== mon.2 v2:172.21.15.89:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fd0d0004750 con 0x559c89d5ab40 2024-09-19T06:21:39.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.249+0000 7fd0de117740 10 client.26723 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:39.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.249+0000 7fd0de117740 10 client.26723 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:39.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.249+0000 7fd0de117740 20 client.26723 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:39.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.249+0000 7fd0de117740 1 --2- 172.21.15.2:0/2017657243 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x559c89d783c0 0x559c89d7a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:39.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.249+0000 7fd0de117740 4 client.26723 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:39.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.249+0000 7fd0de117740 1 -- 172.21.15.2:0/2017657243 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559c89ccc860 con 0x559c89d783c0 2024-09-19T06:21:39.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.249+0000 7fd0d92d9640 1 --2- 172.21.15.2:0/2017657243 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x559c89d783c0 0x559c89d7a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:39.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.250+0000 7fd0d92d9640 1 --2- 172.21.15.2:0/2017657243 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x559c89d783c0 0x559c89d7a7b0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b677600fd4b4f1c server_cookie=e8f750a165c3b449 in_seq=0 out_seq=0 2024-09-19T06:21:39.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.250+0000 7fd0bd7fa640 10 client.26723 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:39.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.251+0000 7fd0bd7fa640 1 -- 172.21.15.2:0/2017657243 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559c89ccc860 con 0x559c89d783c0 2024-09-19T06:21:39.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.251+0000 7fd0bd7fa640 10 client.26723 handle_command_reply: tid=0 2024-09-19T06:21:39.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.251+0000 7fd0de117740 1 client.26723 shutdown 2024-09-19T06:21:39.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.251+0000 7fd0de117740 1 -- 172.21.15.2:0/2017657243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c89d5ab40 msgr2=0x559c89d65460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:39.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.251+0000 7fd0de117740 1 --2- 172.21.15.2:0/2017657243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c89d5ab40 0x559c89d65460 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd0d0009230 tx=0x7fd0d0032e70 comp rx=0 tx=0).stop 2024-09-19T06:21:39.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.251+0000 7fd0de117740 1 -- 172.21.15.2:0/2017657243 shutdown_connections 2024-09-19T06:21:39.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.251+0000 7fd0de117740 1 --2- 172.21.15.2:0/2017657243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c89d68780 0x559c89d65bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.251+0000 7fd0de117740 1 --2- 172.21.15.2:0/2017657243 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x559c89d783c0 0x559c89d7a7b0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.251+0000 7fd0de117740 1 --2- 172.21.15.2:0/2017657243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c89d5ab40 0x559c89d65460 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.251+0000 7fd0de117740 1 --2- 172.21.15.2:0/2017657243 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c89d595d0 0x559c89d681b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.251+0000 7fd0bd7fa640 0 client.26723 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:39.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.251+0000 7fd0de117740 1 -- 172.21.15.2:0/2017657243 >> 172.21.15.2:0/2017657243 conn(0x559c89d22310 msgr2=0x559c89d5b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:39.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.251+0000 7fd0de117740 1 -- 172.21.15.2:0/2017657243 shutdown_connections 2024-09-19T06:21:39.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.251+0000 7fd0de117740 1 -- 172.21.15.2:0/2017657243 wait complete. 2024-09-19T06:21:39.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.251+0000 7fd0de117740 20 client.26723 trim_cache size 0 max 16384 2024-09-19T06:21:39.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.264+0000 7fd0de117740 1 Processor -- start 2024-09-19T06:21:39.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.264+0000 7fd0de117740 1 -- start start 2024-09-19T06:21:39.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.264+0000 7fd0de117740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c89d595d0 0x559c89d65430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:39.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.264+0000 7fd0de117740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c89d5ab40 0x559c89d80080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:39.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.264+0000 7fd0de117740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c89d68780 0x559c89d805c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:39.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.264+0000 7fd0de117740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d41ade80 con 0x559c89d595d0 2024-09-19T06:21:39.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.264+0000 7fd0de117740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d41ab750 con 0x559c89d5ab40 2024-09-19T06:21:39.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.264+0000 7fd0de117740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d41a95c0 con 0x559c89d68780 2024-09-19T06:21:39.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.264+0000 7fd0d92d9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c89d595d0 0x559c89d65430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:39.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.264+0000 7fd0d92d9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c89d595d0 0x559c89d65430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34792/0 (socket says 172.21.15.2:34792) 2024-09-19T06:21:39.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.264+0000 7fd0d92d9640 1 -- 172.21.15.2:0/4100279615 learned_addr learned my addr 172.21.15.2:0/4100279615 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:39.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.264+0000 7fd0d9ada640 1 --2- 172.21.15.2:0/4100279615 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c89d5ab40 0x559c89d80080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:39.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.264+0000 7fd0d92d9640 1 -- 172.21.15.2:0/4100279615 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c89d68780 msgr2=0x559c89d805c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:39.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.264+0000 7fd0d92d9640 1 --2- 172.21.15.2:0/4100279615 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c89d68780 0x559c89d805c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.265+0000 7fd0d92d9640 1 -- 172.21.15.2:0/4100279615 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c89d5ab40 msgr2=0x559c89d80080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:39.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.265+0000 7fd0d92d9640 1 --2- 172.21.15.2:0/4100279615 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c89d5ab40 0x559c89d80080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.265+0000 7fd0d92d9640 1 -- 172.21.15.2:0/4100279615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c89d55ed0 con 0x559c89d595d0 2024-09-19T06:21:39.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.265+0000 7fd0d9ada640 1 --2- 172.21.15.2:0/4100279615 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c89d5ab40 0x559c89d80080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:39.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.265+0000 7fd0d92d9640 1 --2- 172.21.15.2:0/4100279615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c89d595d0 0x559c89d65430 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4015040 tx=0x7fd0c4021040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d0e55bd9c071d82 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:39.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.265+0000 7fd0bf7fe640 1 -- 172.21.15.2:0/4100279615 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c400fa50 con 0x559c89d595d0 2024-09-19T06:21:39.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.265+0000 7fd0bf7fe640 1 -- 172.21.15.2:0/4100279615 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd0c40054f0 con 0x559c89d595d0 2024-09-19T06:21:39.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.265+0000 7fd0bf7fe640 1 -- 172.21.15.2:0/4100279615 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4010ab0 con 0x559c89d595d0 2024-09-19T06:21:39.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.266+0000 7fd0de117740 1 -- 172.21.15.2:0/4100279615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c89d595d0 msgr2=0x559c89d65430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:39.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.266+0000 7fd0de117740 1 --2- 172.21.15.2:0/4100279615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c89d595d0 0x559c89d65430 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4015040 tx=0x7fd0c4021040 comp rx=0 tx=0).stop 2024-09-19T06:21:39.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.266+0000 7fd0de117740 1 -- 172.21.15.2:0/4100279615 shutdown_connections 2024-09-19T06:21:39.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.266+0000 7fd0de117740 1 --2- 172.21.15.2:0/4100279615 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c89d68780 0x559c89d805c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.266+0000 7fd0de117740 1 --2- 172.21.15.2:0/4100279615 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c89d5ab40 0x559c89d80080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.266+0000 7fd0de117740 1 --2- 172.21.15.2:0/4100279615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c89d595d0 0x559c89d65430 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.266+0000 7fd0de117740 1 -- 172.21.15.2:0/4100279615 >> 172.21.15.2:0/4100279615 conn(0x559c89d22310 msgr2=0x559c89d64d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:39.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.266+0000 7fd0de117740 1 -- 172.21.15.2:0/4100279615 shutdown_connections 2024-09-19T06:21:39.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.266+0000 7fd0de117740 1 -- 172.21.15.2:0/4100279615 wait complete. 2024-09-19T06:21:39.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.266+0000 7fd0de117740 1 -- start start 2024-09-19T06:21:39.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.266+0000 7fd0de117740 1 Processor -- start 2024-09-19T06:21:39.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.267+0000 7fd0de117740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c89d595d0 0x559c89d6be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:39.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.267+0000 7fd0de117740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c89d5ab40 0x559c89d6c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:39.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.267+0000 7fd0de117740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c89d68780 0x559c89de1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:39.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.267+0000 7fd0de117740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d41a9c10 con 0x559c89d5ab40 2024-09-19T06:21:39.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.267+0000 7fd0de117740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d41ab080 con 0x559c89d595d0 2024-09-19T06:21:39.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.267+0000 7fd0de117740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d41aa2e0 con 0x559c89d68780 2024-09-19T06:21:39.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.267+0000 7fd0de117740 10 client.0 _ll_register_callbacks cb 0x7fd0d002ab30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:39.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.267+0000 7fd0d9ada640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c89d5ab40 0x559c89d6c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:39.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.267+0000 7fd0d9ada640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c89d5ab40 0x559c89d6c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34804/0 (socket says 172.21.15.2:34804) 2024-09-19T06:21:39.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.267+0000 7fd0d9ada640 1 -- 172.21.15.2:0/1201260501 learned_addr learned my addr 172.21.15.2:0/1201260501 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:39.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.267+0000 7fd0d92d9640 1 --2- 172.21.15.2:0/1201260501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c89d595d0 0x559c89d6be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:39.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.267+0000 7fd0d92d9640 1 --2- 172.21.15.2:0/1201260501 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c89d68780 0x559c89de1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:39.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.267+0000 7fd0d9ada640 1 -- 172.21.15.2:0/1201260501 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c89d68780 msgr2=0x559c89de1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:39.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.267+0000 7fd0d9ada640 1 --2- 172.21.15.2:0/1201260501 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c89d68780 0x559c89de1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.267+0000 7fd0d9ada640 1 -- 172.21.15.2:0/1201260501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c89d595d0 msgr2=0x559c89d6be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:39.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.267+0000 7fd0d9ada640 1 --2- 172.21.15.2:0/1201260501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c89d595d0 0x559c89d6be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.267+0000 7fd0d9ada640 1 -- 172.21.15.2:0/1201260501 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c89de1580 con 0x559c89d5ab40 2024-09-19T06:21:39.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.267+0000 7fd0d92d9640 1 --2- 172.21.15.2:0/1201260501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c89d595d0 0x559c89d6be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:21:39.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.267+0000 7fd0d9ada640 1 --2- 172.21.15.2:0/1201260501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c89d5ab40 0x559c89d6c380 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fd0d0004b20 tx=0x7fd0d0004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1260b7dcce0b9163 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:39.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.268+0000 7fd0bd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:39.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.268+0000 7fd0bd7fa640 1 -- 172.21.15.2:0/1201260501 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d0035070 con 0x559c89d5ab40 2024-09-19T06:21:39.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.268+0000 7fd0bd7fa640 1 -- 172.21.15.2:0/1201260501 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7fd0d0003930 con 0x559c89d5ab40 2024-09-19T06:21:39.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.268+0000 7fd0de117740 1 -- 172.21.15.2:0/1201260501 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0c40054f0 con 0x559c89d5ab40 2024-09-19T06:21:39.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.268+0000 7fd0bd7fa640 1 -- 172.21.15.2:0/1201260501 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd0d005e050 con 0x559c89d5ab40 2024-09-19T06:21:39.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.268+0000 7fd0de117740 10 client.17547 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:39.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.268+0000 7fd0de117740 1 -- 172.21.15.2:0/1201260501 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x559c89de2860 con 0x559c89d5ab40 2024-09-19T06:21:39.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.268+0000 7fd0bd7fa640 1 -- 172.21.15.2:0/1201260501 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd0c40054f0 con 0x559c89d5ab40 2024-09-19T06:21:39.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.268+0000 7fd0bd7fa640 1 -- 172.21.15.2:0/1201260501 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fd0d0005290 con 0x559c89d5ab40 2024-09-19T06:21:39.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.268+0000 7fd0de117740 10 client.17547 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:39.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.268+0000 7fd0de117740 10 client.17547 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:39.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.268+0000 7fd0de117740 20 client.17547 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:39.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.268+0000 7fd0de117740 1 --2- 172.21.15.2:0/1201260501 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x559c89de2ef0 0x559c89de5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:39.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.268+0000 7fd0de117740 4 client.17547 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:21:39.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.268+0000 7fd0de117740 1 -- 172.21.15.2:0/1201260501 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559c89cc6d70 con 0x559c89de2ef0 2024-09-19T06:21:39.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.269+0000 7fd0d92d9640 1 --2- 172.21.15.2:0/1201260501 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x559c89de2ef0 0x559c89de5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:39.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.269+0000 7fd0d92d9640 1 --2- 172.21.15.2:0/1201260501 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x559c89de2ef0 0x559c89de5310 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a5085df2fca28e1 server_cookie=5b3c5a37419ddeba in_seq=0 out_seq=0 2024-09-19T06:21:39.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.269+0000 7fd0bd7fa640 10 client.17547 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:39.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.269+0000 7fd0bd7fa640 1 -- 172.21.15.2:0/1201260501 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559c89cc6d70 con 0x559c89de2ef0 2024-09-19T06:21:39.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.269+0000 7fd0bd7fa640 10 client.17547 handle_command_reply: tid=0 2024-09-19T06:21:39.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.269+0000 7fd0de117740 1 client.17547 shutdown 2024-09-19T06:21:39.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.269+0000 7fd0de117740 1 -- 172.21.15.2:0/1201260501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c89d5ab40 msgr2=0x559c89d6c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:39.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.269+0000 7fd0de117740 1 --2- 172.21.15.2:0/1201260501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c89d5ab40 0x559c89d6c380 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fd0d0004b20 tx=0x7fd0d0004410 comp rx=0 tx=0).stop 2024-09-19T06:21:39.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.269+0000 7fd0de117740 1 -- 172.21.15.2:0/1201260501 shutdown_connections 2024-09-19T06:21:39.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.269+0000 7fd0de117740 1 --2- 172.21.15.2:0/1201260501 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559c89d68780 0x559c89de1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.269+0000 7fd0de117740 1 --2- 172.21.15.2:0/1201260501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559c89d5ab40 0x559c89d6c380 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.269+0000 7fd0de117740 1 --2- 172.21.15.2:0/1201260501 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x559c89de2ef0 0x559c89de5310 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.269+0000 7fd0de117740 1 --2- 172.21.15.2:0/1201260501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c89d595d0 0x559c89d6be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.269+0000 7fd0bd7fa640 0 client.17547 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:39.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.269+0000 7fd0de117740 1 -- 172.21.15.2:0/1201260501 >> 172.21.15.2:0/1201260501 conn(0x559c89d22310 msgr2=0x559c89d63d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:39.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.270+0000 7fd0de117740 1 -- 172.21.15.2:0/1201260501 shutdown_connections 2024-09-19T06:21:39.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.270+0000 7fd0de117740 1 -- 172.21.15.2:0/1201260501 wait complete. 2024-09-19T06:21:39.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.270+0000 7fd0de117740 20 client.17547 trim_cache size 0 max 16384 2024-09-19T06:21:39.277 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:21:39.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.270+0000 7fd0dbd3e640 1 -- 172.21.15.2:0/1624673440 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fd0c00a3430 msgr2=0x7fd0c00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:39.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.270+0000 7fd0dbd3e640 1 --2- 172.21.15.2:0/1624673440 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fd0c00a3430 0x7fd0c00a58f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc0cd560 tx=0x7fd0cc01e8c0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.270+0000 7fd0dbd3e640 1 -- 172.21.15.2:0/1624673440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0d4106f10 msgr2=0x7fd0d419cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:39.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.270+0000 7fd0dbd3e640 1 --2- 172.21.15.2:0/1624673440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0d4106f10 0x7fd0d419cc30 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc00eaa0 tx=0x7fd0cc00ef60 comp rx=0 tx=0).stop 2024-09-19T06:21:39.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.270+0000 7fd0dbd3e640 1 -- 172.21.15.2:0/1624673440 shutdown_connections 2024-09-19T06:21:39.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.270+0000 7fd0dbd3e640 1 --2- 172.21.15.2:0/1624673440 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fd0c00a3430 0x7fd0c00a58f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.270+0000 7fd0dbd3e640 1 --2- 172.21.15.2:0/1624673440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0d4106f10 0x7fd0d419cc30 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.270+0000 7fd0dbd3e640 1 --2- 172.21.15.2:0/1624673440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0d4102790 0x7fd0d41988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.270+0000 7fd0dbd3e640 1 --2- 172.21.15.2:0/1624673440 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0d4101de0 0x7fd0d4198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.270+0000 7fd0dbd3e640 1 -- 172.21.15.2:0/1624673440 >> 172.21.15.2:0/1624673440 conn(0x7fd0d40fd8c0 msgr2=0x7fd0d40fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:39.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.270+0000 7fd0dbd3e640 1 -- 172.21.15.2:0/1624673440 shutdown_connections 2024-09-19T06:21:39.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:39.270+0000 7fd0dbd3e640 1 -- 172.21.15.2:0/1624673440 wait complete. 2024-09-19T06:21:39.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:39 smithi002 ceph-mon[30982]: pgmap v210: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:21:39.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:39 smithi090 ceph-mon[34497]: pgmap v210: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:21:39.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:39 smithi089 ceph-mon[34160]: pgmap v210: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:21:41.067 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:21:41.067 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:21:41.339 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:41.444 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:41 smithi002 ceph-mon[30982]: pgmap v211: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:21:41.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:41 smithi090 ceph-mon[34497]: pgmap v211: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:21:41.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.765+0000 7f37af4b1640 1 -- 172.21.15.2:0/2725091733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37a8100e20 msgr2=0x7f37a8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:41.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.765+0000 7f37af4b1640 1 --2- 172.21.15.2:0/2725091733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37a8100e20 0x7f37a8101200 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f3798009ca0 tx=0x7f379802a950 comp rx=0 tx=0).stop 2024-09-19T06:21:41.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.766+0000 7f37af4b1640 1 -- 172.21.15.2:0/2725091733 shutdown_connections 2024-09-19T06:21:41.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.766+0000 7f37af4b1640 1 --2- 172.21.15.2:0/2725091733 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37a8102ef0 0x7f37a810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:41.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.766+0000 7f37af4b1640 1 --2- 172.21.15.2:0/2725091733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37a8102570 0x7f37a81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:41.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.766+0000 7f37af4b1640 1 --2- 172.21.15.2:0/2725091733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37a8100e20 0x7f37a8101200 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:41.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.766+0000 7f37af4b1640 1 -- 172.21.15.2:0/2725091733 >> 172.21.15.2:0/2725091733 conn(0x7f37a80fc7d0 msgr2=0x7f37a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:41.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.766+0000 7f37af4b1640 1 -- 172.21.15.2:0/2725091733 shutdown_connections 2024-09-19T06:21:41.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.766+0000 7f37af4b1640 1 -- 172.21.15.2:0/2725091733 wait complete. 2024-09-19T06:21:41.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.766+0000 7f37af4b1640 1 Processor -- start 2024-09-19T06:21:41.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.766+0000 7f37af4b1640 1 -- start start 2024-09-19T06:21:41.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.767+0000 7f37af4b1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37a8100e20 0x7f37a81992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:41.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.767+0000 7f37af4b1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37a8102570 0x7f37a81997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:41.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.767+0000 7f37af4b1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37a8102ef0 0x7f37a81a4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:41.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.767+0000 7f37af4b1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f37a8110e50 con 0x7f37a8100e20 2024-09-19T06:21:41.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.767+0000 7f37af4b1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f37a8110cd0 con 0x7f37a8102ef0 2024-09-19T06:21:41.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.767+0000 7f37af4b1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f37a8110fd0 con 0x7f37a8102570 2024-09-19T06:21:41.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.767+0000 7f37ad24d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37a8100e20 0x7f37a81992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:41.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.767+0000 7f37ad24d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37a8100e20 0x7f37a81992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34814/0 (socket says 172.21.15.2:34814) 2024-09-19T06:21:41.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.767+0000 7f37ad24d640 1 -- 172.21.15.2:0/2938688010 learned_addr learned my addr 172.21.15.2:0/2938688010 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:41.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.767+0000 7f37ada4e640 1 --2- 172.21.15.2:0/2938688010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37a8102ef0 0x7f37a81a4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:41.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.767+0000 7f37aca4c640 1 --2- 172.21.15.2:0/2938688010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37a8102570 0x7f37a81997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:41.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.767+0000 7f37ad24d640 1 -- 172.21.15.2:0/2938688010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37a8102570 msgr2=0x7f37a81997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:41.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.767+0000 7f37ad24d640 1 --2- 172.21.15.2:0/2938688010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37a8102570 0x7f37a81997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:41.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.767+0000 7f37ad24d640 1 -- 172.21.15.2:0/2938688010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37a8102ef0 msgr2=0x7f37a81a4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:41.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.767+0000 7f37ad24d640 1 --2- 172.21.15.2:0/2938688010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37a8102ef0 0x7f37a81a4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:41.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.767+0000 7f37ad24d640 1 -- 172.21.15.2:0/2938688010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37a81a4860 con 0x7f37a8100e20 2024-09-19T06:21:41.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.767+0000 7f37ad24d640 1 --2- 172.21.15.2:0/2938688010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37a8100e20 0x7f37a81992a0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f3798009430 tx=0x7f379802f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:41.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.768+0000 7f37a67fc640 1 -- 172.21.15.2:0/2938688010 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3798034040 con 0x7f37a8100e20 2024-09-19T06:21:41.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.768+0000 7f37a67fc640 1 -- 172.21.15.2:0/2938688010 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f37980308f0 con 0x7f37a8100e20 2024-09-19T06:21:41.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.768+0000 7f37af4b1640 1 -- 172.21.15.2:0/2938688010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37a81a4a30 con 0x7f37a8100e20 2024-09-19T06:21:41.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.768+0000 7f37a67fc640 1 -- 172.21.15.2:0/2938688010 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3798045480 con 0x7f37a8100e20 2024-09-19T06:21:41.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.768+0000 7f37af4b1640 1 -- 172.21.15.2:0/2938688010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37a81a4e80 con 0x7f37a8100e20 2024-09-19T06:21:41.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.770+0000 7f37a67fc640 1 -- 172.21.15.2:0/2938688010 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f3798037020 con 0x7f37a8100e20 2024-09-19T06:21:41.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.770+0000 7f37b188a740 1 Processor -- start 2024-09-19T06:21:41.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.770+0000 7f37b188a740 1 -- start start 2024-09-19T06:21:41.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.771+0000 7f37b188a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a502b60 0x563a9a502f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:41.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.771+0000 7f37b188a740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a9a503480 0x563a9a50d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:41.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.771+0000 7f37b188a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a9a50dd40 0x563a9a510130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:41.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.771+0000 7f37b188a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563a9a468280 con 0x563a9a50dd40 2024-09-19T06:21:41.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.771+0000 7f37b188a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563a9a40fb10 con 0x563a9a502b60 2024-09-19T06:21:41.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.771+0000 7f37b188a740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x563a9a464240 con 0x563a9a503480 2024-09-19T06:21:41.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.771+0000 7f37a67fc640 1 --2- 172.21.15.2:0/2938688010 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f37900a33b0 0x7f37900a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:41.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.771+0000 7f37aca4c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a9a50dd40 0x563a9a510130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:41.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.771+0000 7f37aca4c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a9a50dd40 0x563a9a510130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34826/0 (socket says 172.21.15.2:34826) 2024-09-19T06:21:41.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.771+0000 7f37aca4c640 1 -- 172.21.15.2:0/1936794515 learned_addr learned my addr 172.21.15.2:0/1936794515 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:41.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.771+0000 7f37ada4e640 1 --2- 172.21.15.2:0/1936794515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a502b60 0x563a9a502f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:41.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.771+0000 7f37ad24d640 1 --2- 172.21.15.2:0/1936794515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a9a503480 0x563a9a50d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:41.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.771+0000 7f37ada4e640 1 --2- 172.21.15.2:0/2938688010 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f37900a33b0 0x7f37900a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:41.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.771+0000 7f37a67fc640 1 -- 172.21.15.2:0/2938688010 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f37980f0e00 con 0x7f37a8100e20 2024-09-19T06:21:41.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.771+0000 7f37aca4c640 1 -- 172.21.15.2:0/1936794515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a9a503480 msgr2=0x563a9a50d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:41.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.771+0000 7f37aca4c640 1 --2- 172.21.15.2:0/1936794515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a9a503480 0x563a9a50d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:41.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.771+0000 7f37aca4c640 1 -- 172.21.15.2:0/1936794515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a502b60 msgr2=0x563a9a502f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:41.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.771+0000 7f37aca4c640 1 --2- 172.21.15.2:0/1936794515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a502b60 0x563a9a502f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:41.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.771+0000 7f37aca4c640 1 -- 172.21.15.2:0/1936794515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a9a41c1f0 con 0x563a9a50dd40 2024-09-19T06:21:41.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.771+0000 7f37ad24d640 1 --2- 172.21.15.2:0/1936794515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a9a503480 0x563a9a50d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:41.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.771+0000 7f37aca4c640 1 --2- 172.21.15.2:0/1936794515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a9a50dd40 0x563a9a510130 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f379c00cbc0 tx=0x7f379c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f41a22a9ef54325 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:41.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.772+0000 7f37ada4e640 1 --2- 172.21.15.2:0/2938688010 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f37900a33b0 0x7f37900a5870 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f37a00176b0 tx=0x7f37a0009520 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:41.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.772+0000 7f378f7fe640 1 -- 172.21.15.2:0/1936794515 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f379c010630 con 0x563a9a50dd40 2024-09-19T06:21:41.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.772+0000 7f378f7fe640 1 -- 172.21.15.2:0/1936794515 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f379c010c80 con 0x563a9a50dd40 2024-09-19T06:21:41.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.772+0000 7f378f7fe640 1 -- 172.21.15.2:0/1936794515 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f379c01ab00 con 0x563a9a50dd40 2024-09-19T06:21:41.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.772+0000 7f37b188a740 1 -- 172.21.15.2:0/1936794515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a9a50dd40 msgr2=0x563a9a510130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:41.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.772+0000 7f37b188a740 1 --2- 172.21.15.2:0/1936794515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a9a50dd40 0x563a9a510130 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f379c00cbc0 tx=0x7f379c00e720 comp rx=0 tx=0).stop 2024-09-19T06:21:41.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.772+0000 7f37b188a740 1 -- 172.21.15.2:0/1936794515 shutdown_connections 2024-09-19T06:21:41.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.772+0000 7f37b188a740 1 --2- 172.21.15.2:0/1936794515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a9a50dd40 0x563a9a510130 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:41.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.772+0000 7f37b188a740 1 --2- 172.21.15.2:0/1936794515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a9a503480 0x563a9a50d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:41.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.772+0000 7f37b188a740 1 --2- 172.21.15.2:0/1936794515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a502b60 0x563a9a502f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:41.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.772+0000 7f37b188a740 1 -- 172.21.15.2:0/1936794515 >> 172.21.15.2:0/1936794515 conn(0x563a9a4ff0f0 msgr2=0x563a9a4ff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:41.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.772+0000 7f37b188a740 1 -- 172.21.15.2:0/1936794515 shutdown_connections 2024-09-19T06:21:41.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.773+0000 7f37b188a740 1 -- 172.21.15.2:0/1936794515 wait complete. 2024-09-19T06:21:41.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.773+0000 7f37b188a740 1 -- start start 2024-09-19T06:21:41.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.773+0000 7f37b188a740 1 Processor -- start 2024-09-19T06:21:41.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.773+0000 7f37b188a740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a9a502b60 0x563a9a50ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:41.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.773+0000 7f37b188a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a9a503480 0x563a9a50b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:41.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.773+0000 7f37b188a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a50dd40 0x563a9a50b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:41.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.773+0000 7f37b188a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563a9a510910 con 0x563a9a503480 2024-09-19T06:21:41.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.773+0000 7f37b188a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563a9a422f10 con 0x563a9a50dd40 2024-09-19T06:21:41.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.773+0000 7f37b188a740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x563a9a510a90 con 0x563a9a502b60 2024-09-19T06:21:41.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.773+0000 7f37b188a740 10 client.0 _ll_register_callbacks cb 0x563a9a3eba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:41.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.774+0000 7f37aca4c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a9a503480 0x563a9a50b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:41.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.774+0000 7f37aca4c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a9a503480 0x563a9a50b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34842/0 (socket says 172.21.15.2:34842) 2024-09-19T06:21:41.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.774+0000 7f37aca4c640 1 -- 172.21.15.2:0/4243631478 learned_addr learned my addr 172.21.15.2:0/4243631478 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:41.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.774+0000 7f37ad24d640 1 --2- 172.21.15.2:0/4243631478 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a9a502b60 0x563a9a50ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:41.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.774+0000 7f37ada4e640 1 --2- 172.21.15.2:0/4243631478 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a50dd40 0x563a9a50b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:41.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.774+0000 7f37aca4c640 1 -- 172.21.15.2:0/4243631478 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a9a502b60 msgr2=0x563a9a50ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:41.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.774+0000 7f37aca4c640 1 --2- 172.21.15.2:0/4243631478 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a9a502b60 0x563a9a50ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:41.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.774+0000 7f37aca4c640 1 -- 172.21.15.2:0/4243631478 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a50dd40 msgr2=0x563a9a50b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:41.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.774+0000 7f37aca4c640 1 --2- 172.21.15.2:0/4243631478 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a50dd40 0x563a9a50b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:41.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.774+0000 7f37aca4c640 1 -- 172.21.15.2:0/4243631478 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a9a1d96a0 con 0x563a9a503480 2024-09-19T06:21:41.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.774+0000 7f37aca4c640 1 --2- 172.21.15.2:0/4243631478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a9a503480 0x563a9a50b150 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f379c00cb90 tx=0x7f379c01aee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6db86f9918968f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:41.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.774+0000 7f378cff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:41.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.774+0000 7f378cff9640 1 -- 172.21.15.2:0/4243631478 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f379c02a060 con 0x563a9a503480 2024-09-19T06:21:41.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.774+0000 7f378cff9640 1 -- 172.21.15.2:0/4243631478 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f379c01a410 con 0x563a9a503480 2024-09-19T06:21:41.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.774+0000 7f37b188a740 1 -- 172.21.15.2:0/4243631478 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f379c010c80 con 0x563a9a503480 2024-09-19T06:21:41.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.774+0000 7f378cff9640 1 -- 172.21.15.2:0/4243631478 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f379c00c6d0 con 0x563a9a503480 2024-09-19T06:21:41.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.774+0000 7f37b188a740 10 client.17559 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:41.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.774+0000 7f37b188a740 1 -- 172.21.15.2:0/4243631478 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563a9a51c570 con 0x563a9a503480 2024-09-19T06:21:41.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.775+0000 7f378cff9640 1 -- 172.21.15.2:0/4243631478 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f379c010c80 con 0x563a9a503480 2024-09-19T06:21:41.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.775+0000 7f378cff9640 1 -- 172.21.15.2:0/4243631478 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f379c02d3b0 con 0x563a9a503480 2024-09-19T06:21:41.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.775+0000 7f37b188a740 10 client.17559 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:41.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.775+0000 7f37b188a740 10 client.17559 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:41.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.775+0000 7f37b188a740 20 client.17559 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:41.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.775+0000 7f37b188a740 1 --2- 172.21.15.2:0/4243631478 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563a9a51da30 0x563a9a51fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:41.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.775+0000 7f37b188a740 4 client.17559 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:41.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.775+0000 7f37b188a740 1 -- 172.21.15.2:0/4243631478 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a9a4757f0 con 0x563a9a51da30 2024-09-19T06:21:41.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.775+0000 7f37ad24d640 1 --2- 172.21.15.2:0/4243631478 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563a9a51da30 0x563a9a51fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:41.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.776+0000 7f378cff9640 10 client.17559 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:41.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.776+0000 7f37ad24d640 1 --2- 172.21.15.2:0/4243631478 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563a9a51da30 0x563a9a51fe20 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2532bb4b36822e22 server_cookie=b6d1cbe033fb991d in_seq=0 out_seq=0 2024-09-19T06:21:41.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.776+0000 7f378cff9640 1 -- 172.21.15.2:0/4243631478 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563a9a4757f0 con 0x563a9a51da30 2024-09-19T06:21:41.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.776+0000 7f378cff9640 10 client.17559 handle_command_reply: tid=0 2024-09-19T06:21:41.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.776+0000 7f37b188a740 1 client.17559 shutdown 2024-09-19T06:21:41.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.777+0000 7f37b188a740 1 -- 172.21.15.2:0/4243631478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a9a503480 msgr2=0x563a9a50b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:41.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.777+0000 7f37b188a740 1 --2- 172.21.15.2:0/4243631478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a9a503480 0x563a9a50b150 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f379c00cb90 tx=0x7f379c01aee0 comp rx=0 tx=0).stop 2024-09-19T06:21:41.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.777+0000 7f37b188a740 1 -- 172.21.15.2:0/4243631478 shutdown_connections 2024-09-19T06:21:41.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.777+0000 7f37b188a740 1 --2- 172.21.15.2:0/4243631478 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563a9a51da30 0x563a9a51fe20 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:41.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.777+0000 7f37b188a740 1 --2- 172.21.15.2:0/4243631478 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a50dd40 0x563a9a50b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:41.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.777+0000 7f37b188a740 1 --2- 172.21.15.2:0/4243631478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a9a503480 0x563a9a50b150 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:41.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.777+0000 7f378cff9640 0 client.17559 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:41.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.777+0000 7f37b188a740 1 --2- 172.21.15.2:0/4243631478 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a9a502b60 0x563a9a50ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:41.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.777+0000 7f37b188a740 1 -- 172.21.15.2:0/4243631478 >> 172.21.15.2:0/4243631478 conn(0x563a9a4ff0f0 msgr2=0x563a9a504dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:41.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.777+0000 7f37b188a740 1 -- 172.21.15.2:0/4243631478 shutdown_connections 2024-09-19T06:21:41.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.777+0000 7f37b188a740 1 -- 172.21.15.2:0/4243631478 wait complete. 2024-09-19T06:21:41.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.777+0000 7f37b188a740 20 client.17559 trim_cache size 0 max 16384 2024-09-19T06:21:41.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:41 smithi089 ceph-mon[34160]: pgmap v211: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:21:41.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.794+0000 7f37b188a740 1 Processor -- start 2024-09-19T06:21:41.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.794+0000 7f37b188a740 1 -- start start 2024-09-19T06:21:41.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.794+0000 7f37b188a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a502b60 0x563a9a504cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:41.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.794+0000 7f37b188a740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a9a503480 0x563a9a5160c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:41.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.794+0000 7f37b188a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a9a50dd40 0x563a9a516600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:41.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.794+0000 7f37b188a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f37a81aff90 con 0x563a9a50dd40 2024-09-19T06:21:41.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.794+0000 7f37b188a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f37a81ad860 con 0x563a9a502b60 2024-09-19T06:21:41.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.794+0000 7f37b188a740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f37a81ab6d0 con 0x563a9a503480 2024-09-19T06:21:41.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.795+0000 7f37ada4e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a9a50dd40 0x563a9a516600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:41.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.795+0000 7f37ad24d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a502b60 0x563a9a504cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:41.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.795+0000 7f37ada4e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a9a50dd40 0x563a9a516600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34858/0 (socket says 172.21.15.2:34858) 2024-09-19T06:21:41.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.795+0000 7f37ada4e640 1 -- 172.21.15.2:0/2725029961 learned_addr learned my addr 172.21.15.2:0/2725029961 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:41.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.795+0000 7f37aca4c640 1 --2- 172.21.15.2:0/2725029961 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a9a503480 0x563a9a5160c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:41.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.795+0000 7f37ada4e640 1 -- 172.21.15.2:0/2725029961 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a9a503480 msgr2=0x563a9a5160c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:41.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.795+0000 7f37ada4e640 1 --2- 172.21.15.2:0/2725029961 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a9a503480 0x563a9a5160c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:41.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.795+0000 7f37ada4e640 1 -- 172.21.15.2:0/2725029961 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a502b60 msgr2=0x563a9a504cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:41.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.795+0000 7f37ada4e640 1 --2- 172.21.15.2:0/2725029961 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a502b60 0x563a9a504cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:41.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.795+0000 7f37ada4e640 1 -- 172.21.15.2:0/2725029961 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a9a4fef20 con 0x563a9a50dd40 2024-09-19T06:21:41.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.795+0000 7f37ada4e640 1 --2- 172.21.15.2:0/2725029961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a9a50dd40 0x563a9a516600 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f37a0006e10 tx=0x7f37a001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6886290cddcaf692 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:41.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.795+0000 7f378effd640 1 -- 172.21.15.2:0/2725029961 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a001e040 con 0x563a9a50dd40 2024-09-19T06:21:41.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.795+0000 7f378effd640 1 -- 172.21.15.2:0/2725029961 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f37a0018900 con 0x563a9a50dd40 2024-09-19T06:21:41.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.795+0000 7f378effd640 1 -- 172.21.15.2:0/2725029961 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a00248f0 con 0x563a9a50dd40 2024-09-19T06:21:41.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.796+0000 7f37b188a740 1 -- 172.21.15.2:0/2725029961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a9a50dd40 msgr2=0x563a9a516600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:41.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.796+0000 7f37b188a740 1 --2- 172.21.15.2:0/2725029961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a9a50dd40 0x563a9a516600 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f37a0006e10 tx=0x7f37a001a000 comp rx=0 tx=0).stop 2024-09-19T06:21:41.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.796+0000 7f37b188a740 1 -- 172.21.15.2:0/2725029961 shutdown_connections 2024-09-19T06:21:41.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.796+0000 7f37b188a740 1 --2- 172.21.15.2:0/2725029961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a9a50dd40 0x563a9a516600 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:41.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.796+0000 7f37b188a740 1 --2- 172.21.15.2:0/2725029961 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a9a503480 0x563a9a5160c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:41.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.796+0000 7f37b188a740 1 --2- 172.21.15.2:0/2725029961 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a502b60 0x563a9a504cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:41.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.796+0000 7f37b188a740 1 -- 172.21.15.2:0/2725029961 >> 172.21.15.2:0/2725029961 conn(0x563a9a4ff0f0 msgr2=0x563a9a5045b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:41.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.796+0000 7f37b188a740 1 -- 172.21.15.2:0/2725029961 shutdown_connections 2024-09-19T06:21:41.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.796+0000 7f37b188a740 1 -- 172.21.15.2:0/2725029961 wait complete. 2024-09-19T06:21:41.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.796+0000 7f37b188a740 1 -- start start 2024-09-19T06:21:41.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.797+0000 7f37b188a740 1 Processor -- start 2024-09-19T06:21:41.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.797+0000 7f37b188a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a502b60 0x563a9a5858c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:41.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.797+0000 7f37b188a740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a9a503480 0x563a9a585e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:41.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.797+0000 7f37b188a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a9a50dd40 0x563a9a5803e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:41.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.797+0000 7f37b188a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f37a81abd20 con 0x563a9a50dd40 2024-09-19T06:21:41.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.797+0000 7f37b188a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f37a81ad190 con 0x563a9a502b60 2024-09-19T06:21:41.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.797+0000 7f37b188a740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f37a81ac3f0 con 0x563a9a503480 2024-09-19T06:21:41.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.797+0000 7f37b188a740 10 client.0 _ll_register_callbacks cb 0x7f379c014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:41.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.797+0000 7f37ada4e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a9a50dd40 0x563a9a5803e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:41.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.797+0000 7f37ada4e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a9a50dd40 0x563a9a5803e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34872/0 (socket says 172.21.15.2:34872) 2024-09-19T06:21:41.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.797+0000 7f37ada4e640 1 -- 172.21.15.2:0/2874286597 learned_addr learned my addr 172.21.15.2:0/2874286597 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:41.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.797+0000 7f37aca4c640 1 --2- 172.21.15.2:0/2874286597 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a9a503480 0x563a9a585e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:41.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.797+0000 7f37ad24d640 1 --2- 172.21.15.2:0/2874286597 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a502b60 0x563a9a5858c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:41.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.797+0000 7f37ada4e640 1 -- 172.21.15.2:0/2874286597 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a9a503480 msgr2=0x563a9a585e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:41.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.797+0000 7f37ada4e640 1 --2- 172.21.15.2:0/2874286597 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a9a503480 0x563a9a585e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:41.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.797+0000 7f37ada4e640 1 -- 172.21.15.2:0/2874286597 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a502b60 msgr2=0x563a9a5858c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:41.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.797+0000 7f37ada4e640 1 --2- 172.21.15.2:0/2874286597 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a502b60 0x563a9a5858c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:41.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.797+0000 7f37ada4e640 1 -- 172.21.15.2:0/2874286597 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a9a50bbe0 con 0x563a9a50dd40 2024-09-19T06:21:41.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.797+0000 7f37ad24d640 1 --2- 172.21.15.2:0/2874286597 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a502b60 0x563a9a5858c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:21:41.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.798+0000 7f37ada4e640 1 --2- 172.21.15.2:0/2874286597 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a9a50dd40 0x563a9a5803e0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f37a0009430 tx=0x7f37a00186f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1903cba42c4e665d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:41.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.798+0000 7f378cff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:41.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.798+0000 7f378cff9640 1 -- 172.21.15.2:0/2874286597 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a0018d40 con 0x563a9a50dd40 2024-09-19T06:21:41.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.798+0000 7f378cff9640 1 -- 172.21.15.2:0/2874286597 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f37a0024440 con 0x563a9a50dd40 2024-09-19T06:21:41.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.798+0000 7f37b188a740 1 -- 172.21.15.2:0/2874286597 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37a0018900 con 0x563a9a50dd40 2024-09-19T06:21:41.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.798+0000 7f378cff9640 1 -- 172.21.15.2:0/2874286597 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f37a0024640 con 0x563a9a50dd40 2024-09-19T06:21:41.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.798+0000 7f37b188a740 10 client.17565 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:41.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.798+0000 7f37b188a740 1 -- 172.21.15.2:0/2874286597 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563a9a58cfa0 con 0x563a9a50dd40 2024-09-19T06:21:41.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.798+0000 7f378cff9640 1 -- 172.21.15.2:0/2874286597 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f37a0018900 con 0x563a9a50dd40 2024-09-19T06:21:41.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.799+0000 7f378cff9640 1 -- 172.21.15.2:0/2874286597 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f37a0034850 con 0x563a9a50dd40 2024-09-19T06:21:41.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.799+0000 7f37b188a740 10 client.17565 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:41.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.799+0000 7f37b188a740 10 client.17565 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:41.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.799+0000 7f37b188a740 20 client.17565 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:41.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.799+0000 7f37b188a740 1 --2- 172.21.15.2:0/2874286597 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563a9a58d610 0x563a9a58fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:41.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.799+0000 7f37b188a740 4 client.17565 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:21:41.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.799+0000 7f37b188a740 1 -- 172.21.15.2:0/2874286597 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563a9a46fd00 con 0x563a9a58d610 2024-09-19T06:21:41.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.799+0000 7f37ad24d640 1 --2- 172.21.15.2:0/2874286597 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563a9a58d610 0x563a9a58fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:41.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.799+0000 7f37ad24d640 1 --2- 172.21.15.2:0/2874286597 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563a9a58d610 0x563a9a58fa30 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f0e224c75a3d397 server_cookie=696cd841ac21bbd1 in_seq=0 out_seq=0 2024-09-19T06:21:41.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.799+0000 7f378cff9640 10 client.17565 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:41.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.800+0000 7f378cff9640 1 -- 172.21.15.2:0/2874286597 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563a9a46fd00 con 0x563a9a58d610 2024-09-19T06:21:41.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.800+0000 7f378cff9640 10 client.17565 handle_command_reply: tid=0 2024-09-19T06:21:41.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.800+0000 7f37b188a740 1 client.17565 shutdown 2024-09-19T06:21:41.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.800+0000 7f37b188a740 1 -- 172.21.15.2:0/2874286597 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a9a50dd40 msgr2=0x563a9a5803e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:41.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.800+0000 7f37b188a740 1 --2- 172.21.15.2:0/2874286597 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a9a50dd40 0x563a9a5803e0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f37a0009430 tx=0x7f37a00186f0 comp rx=0 tx=0).stop 2024-09-19T06:21:41.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.801+0000 7f37b188a740 1 -- 172.21.15.2:0/2874286597 shutdown_connections 2024-09-19T06:21:41.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.801+0000 7f37b188a740 1 --2- 172.21.15.2:0/2874286597 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a9a50dd40 0x563a9a5803e0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:41.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.801+0000 7f37b188a740 1 --2- 172.21.15.2:0/2874286597 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a9a503480 0x563a9a585e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:41.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.801+0000 7f37b188a740 1 --2- 172.21.15.2:0/2874286597 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563a9a58d610 0x563a9a58fa30 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:41.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.801+0000 7f37b188a740 1 --2- 172.21.15.2:0/2874286597 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a9a502b60 0x563a9a5858c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:41.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.801+0000 7f37b188a740 1 -- 172.21.15.2:0/2874286597 >> 172.21.15.2:0/2874286597 conn(0x563a9a4ff0f0 msgr2=0x563a9a509bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:41.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.801+0000 7f378cff9640 0 client.17565 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:41.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.801+0000 7f37b188a740 1 -- 172.21.15.2:0/2874286597 shutdown_connections 2024-09-19T06:21:41.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.801+0000 7f37b188a740 1 -- 172.21.15.2:0/2874286597 wait complete. 2024-09-19T06:21:41.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.801+0000 7f37b188a740 20 client.17565 trim_cache size 0 max 16384 2024-09-19T06:21:41.809 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:21:41.809 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T06:21:41.809 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "4ebaaa55-63a8-48e1-a563-e4a227389fdf", 2024-09-19T06:21:41.810 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T06:21:41.810 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:21:41.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.802+0000 7f37af4b1640 1 -- 172.21.15.2:0/2938688010 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f37900a33b0 msgr2=0x7f37900a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:41.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.802+0000 7f37af4b1640 1 --2- 172.21.15.2:0/2938688010 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f37900a33b0 0x7f37900a5870 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f37a00176b0 tx=0x7f37a0009520 comp rx=0 tx=0).stop 2024-09-19T06:21:41.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.802+0000 7f37af4b1640 1 -- 172.21.15.2:0/2938688010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37a8100e20 msgr2=0x7f37a81992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:41.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.802+0000 7f37af4b1640 1 --2- 172.21.15.2:0/2938688010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37a8100e20 0x7f37a81992a0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f3798009430 tx=0x7f379802f6c0 comp rx=0 tx=0).stop 2024-09-19T06:21:41.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.802+0000 7f37af4b1640 1 -- 172.21.15.2:0/2938688010 shutdown_connections 2024-09-19T06:21:41.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.802+0000 7f37af4b1640 1 --2- 172.21.15.2:0/2938688010 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f37900a33b0 0x7f37900a5870 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:41.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.802+0000 7f37af4b1640 1 --2- 172.21.15.2:0/2938688010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37a8102ef0 0x7f37a81a4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:41.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.802+0000 7f37af4b1640 1 --2- 172.21.15.2:0/2938688010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37a8102570 0x7f37a81997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:41.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.802+0000 7f37af4b1640 1 --2- 172.21.15.2:0/2938688010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37a8100e20 0x7f37a81992a0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:41.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.802+0000 7f37af4b1640 1 -- 172.21.15.2:0/2938688010 >> 172.21.15.2:0/2938688010 conn(0x7f37a80fc7d0 msgr2=0x7f37a80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:41.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.802+0000 7f37af4b1640 1 -- 172.21.15.2:0/2938688010 shutdown_connections 2024-09-19T06:21:41.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:41.802+0000 7f37af4b1640 1 -- 172.21.15.2:0/2938688010 wait complete. 2024-09-19T06:21:42.718 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:42 smithi002 ceph-mon[30982]: scrub queued for path: / 2024-09-19T06:21:42.718 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:42 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:42.719 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:42 smithi002 ceph-mon[30982]: scrub summary: active paths [/] 2024-09-19T06:21:42.719 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:42 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:42.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:42 smithi090 ceph-mon[34497]: scrub queued for path: / 2024-09-19T06:21:42.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:42 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:42.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:42 smithi090 ceph-mon[34497]: scrub summary: active paths [/] 2024-09-19T06:21:42.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:42 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:42.752 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:21:42.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:42 smithi089 ceph-mon[34160]: scrub queued for path: / 2024-09-19T06:21:42.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:42 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:42.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:42 smithi089 ceph-mon[34160]: scrub summary: active paths [/] 2024-09-19T06:21:42.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:42 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:43.011 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:43.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:43 smithi002 ceph-mon[30982]: pgmap v212: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:21:43.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:43 smithi002 ceph-mon[30982]: scrub summary: idle 2024-09-19T06:21:43.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.631+0000 7fa5d4002640 1 -- 172.21.15.2:0/761838515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5cc1027a0 msgr2=0x7fa5cc1067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:43.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.631+0000 7fa5d4002640 1 --2- 172.21.15.2:0/761838515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5cc1027a0 0x7fa5cc1067f0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc009900 tx=0x7fa5bc02a410 comp rx=0 tx=0).stop 2024-09-19T06:21:43.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.631+0000 7fa5d4002640 1 -- 172.21.15.2:0/761838515 shutdown_connections 2024-09-19T06:21:43.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.631+0000 7fa5d4002640 1 --2- 172.21.15.2:0/761838515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5cc106f20 0x7fa5cc10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:43.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.631+0000 7fa5d4002640 1 --2- 172.21.15.2:0/761838515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5cc1027a0 0x7fa5cc1067f0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:43.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.631+0000 7fa5d4002640 1 --2- 172.21.15.2:0/761838515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5cc101df0 0x7fa5cc1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:43.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.631+0000 7fa5d4002640 1 -- 172.21.15.2:0/761838515 >> 172.21.15.2:0/761838515 conn(0x7fa5cc0fd8f0 msgr2=0x7fa5cc0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:43.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.631+0000 7fa5d4002640 1 -- 172.21.15.2:0/761838515 shutdown_connections 2024-09-19T06:21:43.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.631+0000 7fa5d4002640 1 -- 172.21.15.2:0/761838515 wait complete. 2024-09-19T06:21:43.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.632+0000 7fa5d4002640 1 Processor -- start 2024-09-19T06:21:43.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.632+0000 7fa5d4002640 1 -- start start 2024-09-19T06:21:43.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.632+0000 7fa5d4002640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5cc101df0 0x7fa5cc198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:43.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.632+0000 7fa5d4002640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5cc1027a0 0x7fa5cc1988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:43.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.632+0000 7fa5d4002640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5cc106f20 0x7fa5cc19cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:43.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.632+0000 7fa5d4002640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa5cc111e30 con 0x7fa5cc106f20 2024-09-19T06:21:43.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.632+0000 7fa5d4002640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa5cc111cb0 con 0x7fa5cc101df0 2024-09-19T06:21:43.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.632+0000 7fa5d4002640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa5cc111fb0 con 0x7fa5cc1027a0 2024-09-19T06:21:43.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.632+0000 7fa5d259f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5cc106f20 0x7fa5cc19cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:43.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.632+0000 7fa5d259f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5cc106f20 0x7fa5cc19cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34890/0 (socket says 172.21.15.2:34890) 2024-09-19T06:21:43.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.632+0000 7fa5d259f640 1 -- 172.21.15.2:0/3885085781 learned_addr learned my addr 172.21.15.2:0/3885085781 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:43.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.632+0000 7fa5d1d9e640 1 --2- 172.21.15.2:0/3885085781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5cc101df0 0x7fa5cc198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:43.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.632+0000 7fa5d159d640 1 --2- 172.21.15.2:0/3885085781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5cc1027a0 0x7fa5cc1988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:43.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.633+0000 7fa5d259f640 1 -- 172.21.15.2:0/3885085781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5cc1027a0 msgr2=0x7fa5cc1988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:43.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.633+0000 7fa5d259f640 1 --2- 172.21.15.2:0/3885085781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5cc1027a0 0x7fa5cc1988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:43.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.633+0000 7fa5d259f640 1 -- 172.21.15.2:0/3885085781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5cc101df0 msgr2=0x7fa5cc198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:43.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.633+0000 7fa5d259f640 1 --2- 172.21.15.2:0/3885085781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5cc101df0 0x7fa5cc198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:43.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.633+0000 7fa5d259f640 1 -- 172.21.15.2:0/3885085781 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5cc19d310 con 0x7fa5cc106f20 2024-09-19T06:21:43.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.633+0000 7fa5d1d9e640 1 --2- 172.21.15.2:0/3885085781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5cc101df0 0x7fa5cc198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:43.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.633+0000 7fa5d259f640 1 --2- 172.21.15.2:0/3885085781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5cc106f20 0x7fa5cc19cc30 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fa5c400cad0 tx=0x7fa5c400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:43.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.633+0000 7fa5c2ffd640 1 -- 172.21.15.2:0/3885085781 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c400ae20 con 0x7fa5cc106f20 2024-09-19T06:21:43.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.633+0000 7fa5d4002640 1 -- 172.21.15.2:0/3885085781 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5cc19d600 con 0x7fa5cc106f20 2024-09-19T06:21:43.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.633+0000 7fa5c2ffd640 1 -- 172.21.15.2:0/3885085781 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa5c4005020 con 0x7fa5cc106f20 2024-09-19T06:21:43.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.633+0000 7fa5c2ffd640 1 -- 172.21.15.2:0/3885085781 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c400f6b0 con 0x7fa5cc106f20 2024-09-19T06:21:43.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.633+0000 7fa5d4002640 1 -- 172.21.15.2:0/3885085781 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5cc1a4ee0 con 0x7fa5cc106f20 2024-09-19T06:21:43.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.636+0000 7fa5c2ffd640 1 -- 172.21.15.2:0/3885085781 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fa5c40051d0 con 0x7fa5cc106f20 2024-09-19T06:21:43.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.636+0000 7fa5d63db740 1 Processor -- start 2024-09-19T06:21:43.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.636+0000 7fa5d63db740 1 -- start start 2024-09-19T06:21:43.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.636+0000 7fa5d63db740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cf93dcd4a0 0x55cf93dcd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:43.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.636+0000 7fa5d63db740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf93dcddc0 0x55cf93dd8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:43.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.636+0000 7fa5d63db740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf93dd8680 0x55cf93ddaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:43.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.636+0000 7fa5c2ffd640 1 --2- 172.21.15.2:0/3885085781 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa5b80a33b0 0x7fa5b80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:43.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.636+0000 7fa5d63db740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55cf93d332e0 con 0x55cf93dcddc0 2024-09-19T06:21:43.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.636+0000 7fa5d63db740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55cf93cdace0 con 0x55cf93dcd4a0 2024-09-19T06:21:43.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.636+0000 7fa5d63db740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55cf93d2f2a0 con 0x55cf93dd8680 2024-09-19T06:21:43.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.637+0000 7fa5d1d9e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf93dcddc0 0x55cf93dd8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:43.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.637+0000 7fa5d1d9e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf93dcddc0 0x55cf93dd8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34900/0 (socket says 172.21.15.2:34900) 2024-09-19T06:21:43.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.637+0000 7fa5d1d9e640 1 -- 172.21.15.2:0/4114953010 learned_addr learned my addr 172.21.15.2:0/4114953010 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:43.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.637+0000 7fa5d259f640 1 --2- 172.21.15.2:0/3885085781 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa5b80a33b0 0x7fa5b80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:43.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.637+0000 7fa5d159d640 1 --2- 172.21.15.2:0/4114953010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cf93dcd4a0 0x55cf93dcd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:43.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.637+0000 7fa5d159d640 1 --2- 172.21.15.2:0/4114953010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf93dd8680 0x55cf93ddaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:43.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.637+0000 7fa5c2ffd640 1 -- 172.21.15.2:0/3885085781 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7fa5c40cfdc0 con 0x7fa5cc106f20 2024-09-19T06:21:43.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.637+0000 7fa5d1d9e640 1 -- 172.21.15.2:0/4114953010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf93dd8680 msgr2=0x55cf93ddaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:43.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.637+0000 7fa5d1d9e640 1 --2- 172.21.15.2:0/4114953010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf93dd8680 0x55cf93ddaa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:43.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.637+0000 7fa5d1d9e640 1 -- 172.21.15.2:0/4114953010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cf93dcd4a0 msgr2=0x55cf93dcd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:43.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.637+0000 7fa5d1d9e640 1 --2- 172.21.15.2:0/4114953010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cf93dcd4a0 0x55cf93dcd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:43.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.637+0000 7fa5d1d9e640 1 -- 172.21.15.2:0/4114953010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf93cbf440 con 0x55cf93dcddc0 2024-09-19T06:21:43.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.637+0000 7fa5d159d640 1 --2- 172.21.15.2:0/4114953010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf93dd8680 0x55cf93ddaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:43.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.637+0000 7fa5d1d9e640 1 --2- 172.21.15.2:0/4114953010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf93dcddc0 0x55cf93dd8140 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fa5c800bd40 tx=0x7fa5c800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b60427d4bd9deec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:43.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.637+0000 7fa5d259f640 1 --2- 172.21.15.2:0/3885085781 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa5b80a33b0 0x7fa5b80a5870 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa5c409bda0 tx=0x7fa5c4097ca0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:43.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.637+0000 7fa5b7fff640 1 -- 172.21.15.2:0/4114953010 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c8015070 con 0x55cf93dcddc0 2024-09-19T06:21:43.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.638+0000 7fa5b7fff640 1 -- 172.21.15.2:0/4114953010 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa5c800be30 con 0x55cf93dcddc0 2024-09-19T06:21:43.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.638+0000 7fa5b7fff640 1 -- 172.21.15.2:0/4114953010 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c8011890 con 0x55cf93dcddc0 2024-09-19T06:21:43.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.638+0000 7fa5d63db740 1 -- 172.21.15.2:0/4114953010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf93dcddc0 msgr2=0x55cf93dd8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:43.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.638+0000 7fa5d63db740 1 --2- 172.21.15.2:0/4114953010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf93dcddc0 0x55cf93dd8140 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fa5c800bd40 tx=0x7fa5c800f730 comp rx=0 tx=0).stop 2024-09-19T06:21:43.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.638+0000 7fa5d63db740 1 -- 172.21.15.2:0/4114953010 shutdown_connections 2024-09-19T06:21:43.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.638+0000 7fa5d63db740 1 --2- 172.21.15.2:0/4114953010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf93dd8680 0x55cf93ddaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:43.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.638+0000 7fa5d63db740 1 --2- 172.21.15.2:0/4114953010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf93dcddc0 0x55cf93dd8140 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:43.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.638+0000 7fa5d63db740 1 --2- 172.21.15.2:0/4114953010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cf93dcd4a0 0x55cf93dcd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:43.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.638+0000 7fa5d63db740 1 -- 172.21.15.2:0/4114953010 >> 172.21.15.2:0/4114953010 conn(0x55cf93dc9a30 msgr2=0x55cf93dc9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:43.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.638+0000 7fa5d63db740 1 -- 172.21.15.2:0/4114953010 shutdown_connections 2024-09-19T06:21:43.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.638+0000 7fa5d63db740 1 -- 172.21.15.2:0/4114953010 wait complete. 2024-09-19T06:21:43.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.639+0000 7fa5d63db740 1 -- start start 2024-09-19T06:21:43.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.639+0000 7fa5d63db740 1 Processor -- start 2024-09-19T06:21:43.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.639+0000 7fa5d63db740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf93dcd4a0 0x55cf93dd7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:43.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.639+0000 7fa5d63db740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf93dcddc0 0x55cf93dd5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:43.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.639+0000 7fa5d63db740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cf93dd8680 0x55cf93dd5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:43.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.639+0000 7fa5d63db740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55cf93ddb250 con 0x55cf93dcddc0 2024-09-19T06:21:43.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.639+0000 7fa5d63db740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55cf93cee050 con 0x55cf93dd8680 2024-09-19T06:21:43.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.639+0000 7fa5d63db740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55cf93ddb3d0 con 0x55cf93dcd4a0 2024-09-19T06:21:43.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.639+0000 7fa5d63db740 10 client.0 _ll_register_callbacks cb 0x55cf93d2e160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:43.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.639+0000 7fa5d1d9e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf93dcddc0 0x55cf93dd5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:43.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.639+0000 7fa5d1d9e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf93dcddc0 0x55cf93dd5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34906/0 (socket says 172.21.15.2:34906) 2024-09-19T06:21:43.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.639+0000 7fa5d1d9e640 1 -- 172.21.15.2:0/1646652191 learned_addr learned my addr 172.21.15.2:0/1646652191 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:43.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.640+0000 7fa5d159d640 1 --2- 172.21.15.2:0/1646652191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cf93dd8680 0x55cf93dd5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:43.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.640+0000 7fa5d159d640 1 --2- 172.21.15.2:0/1646652191 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf93dcd4a0 0x55cf93dd7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:43.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.640+0000 7fa5d1d9e640 1 -- 172.21.15.2:0/1646652191 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf93dcd4a0 msgr2=0x55cf93dd7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:43.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.640+0000 7fa5d1d9e640 1 --2- 172.21.15.2:0/1646652191 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf93dcd4a0 0x55cf93dd7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:43.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.640+0000 7fa5d1d9e640 1 -- 172.21.15.2:0/1646652191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cf93dd8680 msgr2=0x55cf93dd5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:43.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.640+0000 7fa5d1d9e640 1 --2- 172.21.15.2:0/1646652191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cf93dd8680 0x55cf93dd5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:43.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.640+0000 7fa5d1d9e640 1 -- 172.21.15.2:0/1646652191 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf93aa43c0 con 0x55cf93dcddc0 2024-09-19T06:21:43.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.640+0000 7fa5d159d640 1 --2- 172.21.15.2:0/1646652191 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf93dcd4a0 0x55cf93dd7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:43.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.640+0000 7fa5d1d9e640 1 --2- 172.21.15.2:0/1646652191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf93dcddc0 0x55cf93dd5240 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8011570 tx=0x7fa5c800bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc469f9c901a48b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:43.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.640+0000 7fa5b57fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:43.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.640+0000 7fa5b57fa640 1 -- 172.21.15.2:0/1646652191 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c8028060 con 0x55cf93dcddc0 2024-09-19T06:21:43.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.640+0000 7fa5d63db740 1 -- 172.21.15.2:0/1646652191 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5c800be30 con 0x55cf93dcddc0 2024-09-19T06:21:43.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.640+0000 7fa5b57fa640 1 -- 172.21.15.2:0/1646652191 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7fa5c8005390 con 0x55cf93dcddc0 2024-09-19T06:21:43.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.640+0000 7fa5b57fa640 1 -- 172.21.15.2:0/1646652191 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa5c8015070 con 0x55cf93dcddc0 2024-09-19T06:21:43.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.640+0000 7fa5d63db740 10 client.17577 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:43.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.640+0000 7fa5d63db740 1 -- 172.21.15.2:0/1646652191 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55cf93de6c30 con 0x55cf93dcddc0 2024-09-19T06:21:43.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.641+0000 7fa5b57fa640 1 -- 172.21.15.2:0/1646652191 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa5c800be30 con 0x55cf93dcddc0 2024-09-19T06:21:43.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.641+0000 7fa5b57fa640 1 -- 172.21.15.2:0/1646652191 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fa5c80048f0 con 0x55cf93dcddc0 2024-09-19T06:21:43.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.641+0000 7fa5d63db740 10 client.17577 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:43.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.641+0000 7fa5d63db740 10 client.17577 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:43.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.641+0000 7fa5d63db740 20 client.17577 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:43.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.641+0000 7fa5d63db740 1 --2- 172.21.15.2:0/1646652191 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55cf93de8040 0x55cf93dea430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:43.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.641+0000 7fa5d63db740 4 client.17577 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:43.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.641+0000 7fa5d63db740 1 -- 172.21.15.2:0/1646652191 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cf93d40850 con 0x55cf93de8040 2024-09-19T06:21:43.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.642+0000 7fa5d159d640 1 --2- 172.21.15.2:0/1646652191 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55cf93de8040 0x55cf93dea430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:43.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.642+0000 7fa5d159d640 1 --2- 172.21.15.2:0/1646652191 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55cf93de8040 0x55cf93dea430 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3833afdcb2270df server_cookie=c50d3435b78bd294 in_seq=0 out_seq=0 2024-09-19T06:21:43.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.642+0000 7fa5b57fa640 10 client.17577 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:43.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.643+0000 7fa5b57fa640 1 -- 172.21.15.2:0/1646652191 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cf93d40850 con 0x55cf93de8040 2024-09-19T06:21:43.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.643+0000 7fa5b57fa640 10 client.17577 handle_command_reply: tid=0 2024-09-19T06:21:43.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.643+0000 7fa5d63db740 1 client.17577 shutdown 2024-09-19T06:21:43.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.643+0000 7fa5d63db740 1 -- 172.21.15.2:0/1646652191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf93dcddc0 msgr2=0x55cf93dd5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:43.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.643+0000 7fa5d63db740 1 --2- 172.21.15.2:0/1646652191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf93dcddc0 0x55cf93dd5240 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8011570 tx=0x7fa5c800bab0 comp rx=0 tx=0).stop 2024-09-19T06:21:43.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.643+0000 7fa5d63db740 1 -- 172.21.15.2:0/1646652191 shutdown_connections 2024-09-19T06:21:43.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.643+0000 7fa5d63db740 1 --2- 172.21.15.2:0/1646652191 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55cf93de8040 0x55cf93dea430 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:43.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.643+0000 7fa5d63db740 1 --2- 172.21.15.2:0/1646652191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cf93dd8680 0x55cf93dd5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:43.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.643+0000 7fa5d63db740 1 --2- 172.21.15.2:0/1646652191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf93dcddc0 0x55cf93dd5240 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:43.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.643+0000 7fa5b57fa640 0 client.17577 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:43.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.643+0000 7fa5d63db740 1 --2- 172.21.15.2:0/1646652191 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf93dcd4a0 0x55cf93dd7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:43.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.643+0000 7fa5d63db740 1 -- 172.21.15.2:0/1646652191 >> 172.21.15.2:0/1646652191 conn(0x55cf93dc9a30 msgr2=0x55cf93dc8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:43.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.643+0000 7fa5d63db740 1 -- 172.21.15.2:0/1646652191 shutdown_connections 2024-09-19T06:21:43.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.643+0000 7fa5d63db740 1 -- 172.21.15.2:0/1646652191 wait complete. 2024-09-19T06:21:43.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.643+0000 7fa5d63db740 20 client.17577 trim_cache size 0 max 16384 2024-09-19T06:21:43.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.660+0000 7fa5d63db740 1 Processor -- start 2024-09-19T06:21:43.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.660+0000 7fa5d63db740 1 -- start start 2024-09-19T06:21:43.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.661+0000 7fa5d63db740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf93dcd4a0 0x55cf93de44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:43.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.661+0000 7fa5d63db740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cf93dcddc0 0x55cf93defa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:43.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.661+0000 7fa5d63db740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf93dd8680 0x55cf93deff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:43.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.661+0000 7fa5d63db740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa5cc1affb0 con 0x55cf93dcd4a0 2024-09-19T06:21:43.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.661+0000 7fa5d63db740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa5cc1ad880 con 0x55cf93dcddc0 2024-09-19T06:21:43.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.661+0000 7fa5d63db740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa5cc1ab780 con 0x55cf93dd8680 2024-09-19T06:21:43.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.661+0000 7fa5d159d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf93dcd4a0 0x55cf93de44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:43.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.661+0000 7fa5d159d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf93dcd4a0 0x55cf93de44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34920/0 (socket says 172.21.15.2:34920) 2024-09-19T06:21:43.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.661+0000 7fa5d159d640 1 -- 172.21.15.2:0/2251411029 learned_addr learned my addr 172.21.15.2:0/2251411029 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:43.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.661+0000 7fa5d1d9e640 1 --2- 172.21.15.2:0/2251411029 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cf93dcddc0 0x55cf93defa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:43.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.661+0000 7fa5d159d640 1 -- 172.21.15.2:0/2251411029 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf93dd8680 msgr2=0x55cf93deff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:43.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.661+0000 7fa5d159d640 1 --2- 172.21.15.2:0/2251411029 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf93dd8680 0x55cf93deff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:43.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.661+0000 7fa5d159d640 1 -- 172.21.15.2:0/2251411029 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cf93dcddc0 msgr2=0x55cf93defa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:43.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.661+0000 7fa5d159d640 1 --2- 172.21.15.2:0/2251411029 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cf93dcddc0 0x55cf93defa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:43.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.661+0000 7fa5d159d640 1 -- 172.21.15.2:0/2251411029 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf93dce330 con 0x55cf93dcd4a0 2024-09-19T06:21:43.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.661+0000 7fa5d159d640 1 --2- 172.21.15.2:0/2251411029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf93dcd4a0 0x55cf93de44b0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc005940 tx=0x7fa5bc005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=148d4ceabf34d3aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:43.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.662+0000 7fa5b77fe640 1 -- 172.21.15.2:0/2251411029 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc04f070 con 0x55cf93dcd4a0 2024-09-19T06:21:43.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.662+0000 7fa5b77fe640 1 -- 172.21.15.2:0/2251411029 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa5bc004240 con 0x55cf93dcd4a0 2024-09-19T06:21:43.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.662+0000 7fa5b77fe640 1 -- 172.21.15.2:0/2251411029 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc035040 con 0x55cf93dcd4a0 2024-09-19T06:21:43.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.662+0000 7fa5d63db740 1 -- 172.21.15.2:0/2251411029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf93dcd4a0 msgr2=0x55cf93de44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:43.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.662+0000 7fa5d63db740 1 --2- 172.21.15.2:0/2251411029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf93dcd4a0 0x55cf93de44b0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc005940 tx=0x7fa5bc005a20 comp rx=0 tx=0).stop 2024-09-19T06:21:43.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.663+0000 7fa5d63db740 1 -- 172.21.15.2:0/2251411029 shutdown_connections 2024-09-19T06:21:43.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.663+0000 7fa5d63db740 1 --2- 172.21.15.2:0/2251411029 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf93dd8680 0x55cf93deff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:43.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.663+0000 7fa5d63db740 1 --2- 172.21.15.2:0/2251411029 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cf93dcddc0 0x55cf93defa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:43.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.663+0000 7fa5d63db740 1 --2- 172.21.15.2:0/2251411029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf93dcd4a0 0x55cf93de44b0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:43.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.663+0000 7fa5d63db740 1 -- 172.21.15.2:0/2251411029 >> 172.21.15.2:0/2251411029 conn(0x55cf93dc9a30 msgr2=0x55cf93dd72c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:43.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.663+0000 7fa5d63db740 1 -- 172.21.15.2:0/2251411029 shutdown_connections 2024-09-19T06:21:43.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.663+0000 7fa5d63db740 1 -- 172.21.15.2:0/2251411029 wait complete. 2024-09-19T06:21:43.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.663+0000 7fa5d63db740 1 -- start start 2024-09-19T06:21:43.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.663+0000 7fa5d63db740 1 Processor -- start 2024-09-19T06:21:43.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.664+0000 7fa5d63db740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cf93dcddc0 0x55cf93de0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:43.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.664+0000 7fa5d63db740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf93dd8680 0x55cf93dddde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:43.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.664+0000 7fa5d63db740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf93dde320 0x55cf93dde7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:43.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.664+0000 7fa5d63db740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa5cc1abd40 con 0x55cf93dde320 2024-09-19T06:21:43.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.664+0000 7fa5d63db740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa5cc1ad1b0 con 0x55cf93dcddc0 2024-09-19T06:21:43.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.664+0000 7fa5d63db740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa5cc1ac410 con 0x55cf93dd8680 2024-09-19T06:21:43.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.664+0000 7fa5d63db740 10 client.0 _ll_register_callbacks cb 0x7fa5bc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:43.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.664+0000 7fa5d159d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf93dde320 0x55cf93dde7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:43.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.664+0000 7fa5d1d9e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf93dd8680 0x55cf93dddde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:43.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.664+0000 7fa5d159d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf93dde320 0x55cf93dde7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34932/0 (socket says 172.21.15.2:34932) 2024-09-19T06:21:43.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.664+0000 7fa5d159d640 1 -- 172.21.15.2:0/1009851059 learned_addr learned my addr 172.21.15.2:0/1009851059 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:43.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.664+0000 7fa5d159d640 1 --2- 172.21.15.2:0/1009851059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cf93dcddc0 0x55cf93de0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:43.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.664+0000 7fa5d1d9e640 1 -- 172.21.15.2:0/1009851059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cf93dcddc0 msgr2=0x55cf93de0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:43.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.664+0000 7fa5d1d9e640 1 --2- 172.21.15.2:0/1009851059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cf93dcddc0 0x55cf93de0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:43.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.664+0000 7fa5d1d9e640 1 -- 172.21.15.2:0/1009851059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf93dde320 msgr2=0x55cf93dde7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:43.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.664+0000 7fa5d1d9e640 1 --2- 172.21.15.2:0/1009851059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf93dde320 0x55cf93dde7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:43.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.664+0000 7fa5d1d9e640 1 -- 172.21.15.2:0/1009851059 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf93e519e0 con 0x55cf93dd8680 2024-09-19T06:21:43.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.664+0000 7fa5d1d9e640 1 --2- 172.21.15.2:0/1009851059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf93dd8680 0x55cf93dddde0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8004cc0 tx=0x7fa5c800b510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9827cf4a5aced6c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:43.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.664+0000 7fa5b57fa640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-19T06:21:43.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.665+0000 7fa5b57fa640 1 -- 172.21.15.2:0/1009851059 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c801ad40 con 0x55cf93dd8680 2024-09-19T06:21:43.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.665+0000 7fa5d63db740 1 -- 172.21.15.2:0/1009851059 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5bc004240 con 0x55cf93dd8680 2024-09-19T06:21:43.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.665+0000 7fa5b57fa640 1 -- 172.21.15.2:0/1009851059 <== mon.1 v2:172.21.15.90:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7fa5c80115a0 con 0x55cf93dd8680 2024-09-19T06:21:43.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.665+0000 7fa5b57fa640 1 -- 172.21.15.2:0/1009851059 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa5c8004680 con 0x55cf93dd8680 2024-09-19T06:21:43.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.665+0000 7fa5d63db740 10 client.26722 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:43.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.665+0000 7fa5d63db740 1 -- 172.21.15.2:0/1009851059 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55cf93e52b90 con 0x55cf93dd8680 2024-09-19T06:21:43.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.665+0000 7fa5b57fa640 1 -- 172.21.15.2:0/1009851059 <== mon.1 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa5bc004240 con 0x55cf93dd8680 2024-09-19T06:21:43.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.665+0000 7fa5b57fa640 1 -- 172.21.15.2:0/1009851059 <== mon.1 v2:172.21.15.90:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fa5c801a460 con 0x55cf93dd8680 2024-09-19T06:21:43.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.665+0000 7fa5d63db740 10 client.26722 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:43.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.665+0000 7fa5d63db740 10 client.26722 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:43.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.665+0000 7fa5d63db740 20 client.26722 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:43.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.665+0000 7fa5d63db740 1 --2- 172.21.15.2:0/1009851059 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55cf93e53270 0x55cf93e55690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:43.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.666+0000 7fa5d63db740 4 client.26722 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:21:43.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.666+0000 7fa5d63db740 1 -- 172.21.15.2:0/1009851059 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cf93d3ad60 con 0x55cf93e53270 2024-09-19T06:21:43.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.666+0000 7fa5d159d640 1 --2- 172.21.15.2:0/1009851059 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55cf93e53270 0x55cf93e55690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:43.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.666+0000 7fa5d159d640 1 --2- 172.21.15.2:0/1009851059 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55cf93e53270 0x55cf93e55690 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35e9a58ea542814a server_cookie=c1febdb5eeba0e71 in_seq=0 out_seq=0 2024-09-19T06:21:43.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.666+0000 7fa5b57fa640 10 client.26722 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:43.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.666+0000 7fa5b57fa640 1 -- 172.21.15.2:0/1009851059 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55cf93d3ad60 con 0x55cf93e53270 2024-09-19T06:21:43.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.666+0000 7fa5b57fa640 10 client.26722 handle_command_reply: tid=0 2024-09-19T06:21:43.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.666+0000 7fa5d63db740 1 client.26722 shutdown 2024-09-19T06:21:43.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.666+0000 7fa5d63db740 1 -- 172.21.15.2:0/1009851059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf93dd8680 msgr2=0x55cf93dddde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:43.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.666+0000 7fa5d63db740 1 --2- 172.21.15.2:0/1009851059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf93dd8680 0x55cf93dddde0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8004cc0 tx=0x7fa5c800b510 comp rx=0 tx=0).stop 2024-09-19T06:21:43.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.667+0000 7fa5d63db740 1 -- 172.21.15.2:0/1009851059 shutdown_connections 2024-09-19T06:21:43.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.667+0000 7fa5d63db740 1 --2- 172.21.15.2:0/1009851059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cf93dde320 0x55cf93dde7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:43.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.667+0000 7fa5d63db740 1 --2- 172.21.15.2:0/1009851059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cf93dd8680 0x55cf93dddde0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:43.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.667+0000 7fa5d63db740 1 --2- 172.21.15.2:0/1009851059 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55cf93e53270 0x55cf93e55690 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:43.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.667+0000 7fa5d63db740 1 --2- 172.21.15.2:0/1009851059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cf93dcddc0 0x55cf93de0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:43.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.667+0000 7fa5b57fa640 0 client.26722 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:43.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.667+0000 7fa5d63db740 1 -- 172.21.15.2:0/1009851059 >> 172.21.15.2:0/1009851059 conn(0x55cf93dc9a30 msgr2=0x55cf93dc8350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:43.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.667+0000 7fa5d63db740 1 -- 172.21.15.2:0/1009851059 shutdown_connections 2024-09-19T06:21:43.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.667+0000 7fa5d63db740 1 -- 172.21.15.2:0/1009851059 wait complete. 2024-09-19T06:21:43.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.667+0000 7fa5d63db740 20 client.26722 trim_cache size 0 max 16384 2024-09-19T06:21:43.685 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:21:43.685 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T06:21:43.685 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T06:21:43.685 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:21:43.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.667+0000 7fa5d4002640 1 -- 172.21.15.2:0/3885085781 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa5b80a33b0 msgr2=0x7fa5b80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:43.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.667+0000 7fa5d4002640 1 --2- 172.21.15.2:0/3885085781 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa5b80a33b0 0x7fa5b80a5870 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa5c409bda0 tx=0x7fa5c4097ca0 comp rx=0 tx=0).stop 2024-09-19T06:21:43.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.667+0000 7fa5d4002640 1 -- 172.21.15.2:0/3885085781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5cc106f20 msgr2=0x7fa5cc19cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:43.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.667+0000 7fa5d4002640 1 --2- 172.21.15.2:0/3885085781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5cc106f20 0x7fa5cc19cc30 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fa5c400cad0 tx=0x7fa5c400cf90 comp rx=0 tx=0).stop 2024-09-19T06:21:43.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.667+0000 7fa5d4002640 1 -- 172.21.15.2:0/3885085781 shutdown_connections 2024-09-19T06:21:43.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.667+0000 7fa5d4002640 1 --2- 172.21.15.2:0/3885085781 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa5b80a33b0 0x7fa5b80a5870 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:43.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.667+0000 7fa5d4002640 1 --2- 172.21.15.2:0/3885085781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5cc106f20 0x7fa5cc19cc30 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:43.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.668+0000 7fa5d4002640 1 --2- 172.21.15.2:0/3885085781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5cc1027a0 0x7fa5cc1988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:43.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.668+0000 7fa5d4002640 1 --2- 172.21.15.2:0/3885085781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5cc101df0 0x7fa5cc198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:43.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.668+0000 7fa5d4002640 1 -- 172.21.15.2:0/3885085781 >> 172.21.15.2:0/3885085781 conn(0x7fa5cc0fd8f0 msgr2=0x7fa5cc0fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:43.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.668+0000 7fa5d4002640 1 -- 172.21.15.2:0/3885085781 shutdown_connections 2024-09-19T06:21:43.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:43.668+0000 7fa5d4002640 1 -- 172.21.15.2:0/3885085781 wait complete. 2024-09-19T06:21:43.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:43 smithi090 ceph-mon[34497]: pgmap v212: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:21:43.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:43 smithi090 ceph-mon[34497]: scrub summary: idle 2024-09-19T06:21:43.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:43 smithi089 ceph-mon[34160]: pgmap v212: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:21:43.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:43 smithi089 ceph-mon[34160]: scrub summary: idle 2024-09-19T06:21:44.598 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:21:44.598 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:21:44.859 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:45.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.287+0000 7f43e8c65640 1 -- 172.21.15.2:0/1160825489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43e4100310 msgr2=0x7f43e41006f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:45.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.287+0000 7f43e8c65640 1 --2- 172.21.15.2:0/1160825489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43e4100310 0x7f43e41006f0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f43d4009ca0 tx=0x7f43d402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:21:45.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.288+0000 7f43e8c65640 1 -- 172.21.15.2:0/1160825489 shutdown_connections 2024-09-19T06:21:45.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.288+0000 7f43e8c65640 1 --2- 172.21.15.2:0/1160825489 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43e4106f30 0x7f43e410eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:45.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.288+0000 7f43e8c65640 1 --2- 172.21.15.2:0/1160825489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43e4100cc0 0x7f43e4106800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:45.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.288+0000 7f43e8c65640 1 --2- 172.21.15.2:0/1160825489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43e4100310 0x7f43e41006f0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:45.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.288+0000 7f43e8c65640 1 -- 172.21.15.2:0/1160825489 >> 172.21.15.2:0/1160825489 conn(0x7f43e4077210 msgr2=0x7f43e40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:45.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.288+0000 7f43e8c65640 1 -- 172.21.15.2:0/1160825489 shutdown_connections 2024-09-19T06:21:45.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.288+0000 7f43e8c65640 1 -- 172.21.15.2:0/1160825489 wait complete. 2024-09-19T06:21:45.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.288+0000 7f43e8c65640 1 Processor -- start 2024-09-19T06:21:45.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.288+0000 7f43e8c65640 1 -- start start 2024-09-19T06:21:45.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.289+0000 7f43e8c65640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43e4100310 0x7f43e4198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:45.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.289+0000 7f43e8c65640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43e4100cc0 0x7f43e4198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:45.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.289+0000 7f43e8c65640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43e4106f30 0x7f43e419cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:45.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.289+0000 7f43e8c65640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f43e4111e00 con 0x7f43e4100310 2024-09-19T06:21:45.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.289+0000 7f43e8c65640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f43e4111c80 con 0x7f43e4100cc0 2024-09-19T06:21:45.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.289+0000 7f43e8c65640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f43e4111f80 con 0x7f43e4106f30 2024-09-19T06:21:45.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.289+0000 7f43e259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43e4100310 0x7f43e4198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:45.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.289+0000 7f43e259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43e4100310 0x7f43e4198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34958/0 (socket says 172.21.15.2:34958) 2024-09-19T06:21:45.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.289+0000 7f43e259c640 1 -- 172.21.15.2:0/2253950508 learned_addr learned my addr 172.21.15.2:0/2253950508 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:45.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.289+0000 7f43e1d9b640 1 --2- 172.21.15.2:0/2253950508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43e4100cc0 0x7f43e4198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:45.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.289+0000 7f43e2d9d640 1 --2- 172.21.15.2:0/2253950508 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43e4106f30 0x7f43e419cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:45.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.289+0000 7f43e259c640 1 -- 172.21.15.2:0/2253950508 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43e4106f30 msgr2=0x7f43e419cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:45.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.289+0000 7f43e259c640 1 --2- 172.21.15.2:0/2253950508 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43e4106f30 0x7f43e419cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:45.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.289+0000 7f43e259c640 1 -- 172.21.15.2:0/2253950508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43e4100cc0 msgr2=0x7f43e4198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:45.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.289+0000 7f43e259c640 1 --2- 172.21.15.2:0/2253950508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43e4100cc0 0x7f43e4198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:45.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.289+0000 7f43e259c640 1 -- 172.21.15.2:0/2253950508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e419d2b0 con 0x7f43e4100310 2024-09-19T06:21:45.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.289+0000 7f43e2d9d640 1 --2- 172.21.15.2:0/2253950508 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43e4106f30 0x7f43e419cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:45.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.289+0000 7f43e259c640 1 --2- 172.21.15.2:0/2253950508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43e4100310 0x7f43e4198300 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f43d402ade0 tx=0x7f43d4032ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:45.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.290+0000 7f43db7fe640 1 -- 172.21.15.2:0/2253950508 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d4003cf0 con 0x7f43e4100310 2024-09-19T06:21:45.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.290+0000 7f43db7fe640 1 -- 172.21.15.2:0/2253950508 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f43d40044f0 con 0x7f43e4100310 2024-09-19T06:21:45.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.290+0000 7f43e8c65640 1 -- 172.21.15.2:0/2253950508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43e419d540 con 0x7f43e4100310 2024-09-19T06:21:45.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.290+0000 7f43db7fe640 1 -- 172.21.15.2:0/2253950508 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d4030bd0 con 0x7f43e4100310 2024-09-19T06:21:45.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.290+0000 7f43e8c65640 1 -- 172.21.15.2:0/2253950508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43e41a4e80 con 0x7f43e4100310 2024-09-19T06:21:45.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.291+0000 7f43e8c65640 1 -- 172.21.15.2:0/2253950508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43e41006f0 con 0x7f43e4100310 2024-09-19T06:21:45.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.292+0000 7f43db7fe640 1 -- 172.21.15.2:0/2253950508 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f43d4004040 con 0x7f43e4100310 2024-09-19T06:21:45.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.293+0000 7f43db7fe640 1 --2- 172.21.15.2:0/2253950508 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f43d00a3430 0x7f43d00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:45.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.293+0000 7f43e1d9b640 1 --2- 172.21.15.2:0/2253950508 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f43d00a3430 0x7f43d00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:45.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.293+0000 7f43db7fe640 1 -- 172.21.15.2:0/2253950508 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f43d40f1130 con 0x7f43e4100310 2024-09-19T06:21:45.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.293+0000 7f43e1d9b640 1 --2- 172.21.15.2:0/2253950508 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f43d00a3430 0x7f43d00a58f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f43e4104880 tx=0x7f43cc00a2d0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:45.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.297+0000 7f43db7fe640 1 -- 172.21.15.2:0/2253950508 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f43d40bdbc0 con 0x7f43e4100310 2024-09-19T06:21:45.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.512+0000 7f43e8c65640 1 -- 172.21.15.2:0/2253950508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f43e410a110 con 0x7f43e4100310 2024-09-19T06:21:45.514 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:45 smithi002 ceph-mon[30982]: pgmap v213: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2024-09-19T06:21:45.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.513+0000 7f43db7fe640 1 -- 172.21.15.2:0/2253950508 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11882 (secure 0 0 0) 0x7f43d40bd4c0 con 0x7f43e4100310 2024-09-19T06:21:45.515 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:21:45.515 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-09-19T06:14:49:104280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:14:48.191083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24470,24472,24497]},"id":1}]} 2024-09-19T06:21:45.516 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-09-19T06:21:45.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.516+0000 7f43e8c65640 1 -- 172.21.15.2:0/2253950508 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f43d00a3430 msgr2=0x7f43d00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:45.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.516+0000 7f43e8c65640 1 --2- 172.21.15.2:0/2253950508 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f43d00a3430 0x7f43d00a58f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f43e4104880 tx=0x7f43cc00a2d0 comp rx=0 tx=0).stop 2024-09-19T06:21:45.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.516+0000 7f43e8c65640 1 -- 172.21.15.2:0/2253950508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43e4100310 msgr2=0x7f43e4198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:45.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.516+0000 7f43e8c65640 1 --2- 172.21.15.2:0/2253950508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43e4100310 0x7f43e4198300 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f43d402ade0 tx=0x7f43d4032ff0 comp rx=0 tx=0).stop 2024-09-19T06:21:45.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.516+0000 7f43e8c65640 1 -- 172.21.15.2:0/2253950508 shutdown_connections 2024-09-19T06:21:45.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.516+0000 7f43e8c65640 1 --2- 172.21.15.2:0/2253950508 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f43d00a3430 0x7f43d00a58f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:45.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.516+0000 7f43e8c65640 1 --2- 172.21.15.2:0/2253950508 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43e4106f30 0x7f43e419cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:45.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.516+0000 7f43e8c65640 1 --2- 172.21.15.2:0/2253950508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43e4100cc0 0x7f43e4198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:45.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.516+0000 7f43e8c65640 1 --2- 172.21.15.2:0/2253950508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43e4100310 0x7f43e4198300 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:45.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.516+0000 7f43e8c65640 1 -- 172.21.15.2:0/2253950508 >> 172.21.15.2:0/2253950508 conn(0x7f43e4077210 msgr2=0x7f43e4105890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:45.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.516+0000 7f43e8c65640 1 -- 172.21.15.2:0/2253950508 shutdown_connections 2024-09-19T06:21:45.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:45.516+0000 7f43e8c65640 1 -- 172.21.15.2:0/2253950508 wait complete. 2024-09-19T06:21:45.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:45 smithi090 ceph-mon[34497]: pgmap v213: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2024-09-19T06:21:45.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:45 smithi089 ceph-mon[34160]: pgmap v213: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2024-09-19T06:21:46.190 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:21:46.450 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:46.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:46 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/2253950508' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:21:46.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:46 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/2253950508' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:21:46.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:46 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/2253950508' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:21:46.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.885+0000 7f672f3ee640 1 -- 172.21.15.2:0/397601312 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6728100b30 msgr2=0x7f6728100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:46.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.885+0000 7f672f3ee640 1 --2- 172.21.15.2:0/397601312 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6728100b30 0x7f6728100f10 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f6724009900 tx=0x7f672402a470 comp rx=0 tx=0).stop 2024-09-19T06:21:46.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.886+0000 7f672f3ee640 1 -- 172.21.15.2:0/397601312 shutdown_connections 2024-09-19T06:21:46.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.886+0000 7f672f3ee640 1 --2- 172.21.15.2:0/397601312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6728105f40 0x7f67281063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.886+0000 7f672f3ee640 1 --2- 172.21.15.2:0/397601312 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6728101450 0x7f6728105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.886+0000 7f672f3ee640 1 --2- 172.21.15.2:0/397601312 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6728100b30 0x7f6728100f10 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.886+0000 7f672f3ee640 1 -- 172.21.15.2:0/397601312 >> 172.21.15.2:0/397601312 conn(0x7f67280fc7a0 msgr2=0x7f67280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:46.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.886+0000 7f672f3ee640 1 -- 172.21.15.2:0/397601312 shutdown_connections 2024-09-19T06:21:46.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.886+0000 7f672f3ee640 1 -- 172.21.15.2:0/397601312 wait complete. 2024-09-19T06:21:46.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.886+0000 7f672f3ee640 1 Processor -- start 2024-09-19T06:21:46.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.886+0000 7f672f3ee640 1 -- start start 2024-09-19T06:21:46.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.887+0000 7f672f3ee640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6728100b30 0x7f67281a4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:46.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.887+0000 7f672f3ee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6728101450 0x7f67281a4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:46.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.887+0000 7f672f3ee640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6728105f40 0x7f672819e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:46.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.887+0000 7f672f3ee640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6728118400 con 0x7f6728101450 2024-09-19T06:21:46.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.887+0000 7f672f3ee640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6728118280 con 0x7f6728100b30 2024-09-19T06:21:46.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.887+0000 7f672f3ee640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6728118580 con 0x7f6728105f40 2024-09-19T06:21:46.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.887+0000 7f672c989640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6728101450 0x7f67281a4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:46.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.887+0000 7f672c989640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6728101450 0x7f67281a4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46196/0 (socket says 172.21.15.2:46196) 2024-09-19T06:21:46.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.887+0000 7f672c989640 1 -- 172.21.15.2:0/364407952 learned_addr learned my addr 172.21.15.2:0/364407952 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:46.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.887+0000 7f672d18a640 1 --2- 172.21.15.2:0/364407952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6728100b30 0x7f67281a4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:46.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.887+0000 7f672d98b640 1 --2- 172.21.15.2:0/364407952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6728105f40 0x7f672819e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:46.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.887+0000 7f672c989640 1 -- 172.21.15.2:0/364407952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6728105f40 msgr2=0x7f672819e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:46.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.887+0000 7f672c989640 1 --2- 172.21.15.2:0/364407952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6728105f40 0x7f672819e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.887+0000 7f672c989640 1 -- 172.21.15.2:0/364407952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6728100b30 msgr2=0x7f67281a4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:46.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.887+0000 7f672c989640 1 --2- 172.21.15.2:0/364407952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6728100b30 0x7f67281a4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.887+0000 7f672c989640 1 -- 172.21.15.2:0/364407952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f672819efc0 con 0x7f6728101450 2024-09-19T06:21:46.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.887+0000 7f672c989640 1 --2- 172.21.15.2:0/364407952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6728101450 0x7f67281a4bc0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f671800c970 tx=0x7f671800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:46.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.887+0000 7f671e7fc640 1 -- 172.21.15.2:0/364407952 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6718007bb0 con 0x7f6728101450 2024-09-19T06:21:46.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.887+0000 7f672f3ee640 1 -- 172.21.15.2:0/364407952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f672819f2b0 con 0x7f6728101450 2024-09-19T06:21:46.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.887+0000 7f671e7fc640 1 -- 172.21.15.2:0/364407952 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6718007d50 con 0x7f6728101450 2024-09-19T06:21:46.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.888+0000 7f671e7fc640 1 -- 172.21.15.2:0/364407952 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6718018780 con 0x7f6728101450 2024-09-19T06:21:46.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.888+0000 7f672f3ee640 1 -- 172.21.15.2:0/364407952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67281ab600 con 0x7f6728101450 2024-09-19T06:21:46.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.890+0000 7f671e7fc640 1 -- 172.21.15.2:0/364407952 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f671800f450 con 0x7f6728101450 2024-09-19T06:21:46.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.890+0000 7f67317c7740 1 Processor -- start 2024-09-19T06:21:46.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.890+0000 7f67317c7740 1 -- start start 2024-09-19T06:21:46.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.890+0000 7f67317c7740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560b6e7e8b40 0x560b6e7e7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:46.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.891+0000 7f67317c7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b6e7e75d0 0x560b6e7e7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:46.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.891+0000 7f67317c7740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560b6e7f2370 0x560b6e7f4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:46.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.891+0000 7f67317c7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560b6e74d2f0 con 0x560b6e7e75d0 2024-09-19T06:21:46.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.891+0000 7f67317c7740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x560b6e6f4cf0 con 0x560b6e7e8b40 2024-09-19T06:21:46.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.891+0000 7f67317c7740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560b6e7492b0 con 0x560b6e7f2370 2024-09-19T06:21:46.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.891+0000 7f672d18a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b6e7e75d0 0x560b6e7e7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:46.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.891+0000 7f672d18a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b6e7e75d0 0x560b6e7e7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46198/0 (socket says 172.21.15.2:46198) 2024-09-19T06:21:46.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.891+0000 7f672d18a640 1 -- 172.21.15.2:0/1023458074 learned_addr learned my addr 172.21.15.2:0/1023458074 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:46.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.891+0000 7f671e7fc640 1 --2- 172.21.15.2:0/364407952 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f67140a33b0 0x7f67140a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:46.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.891+0000 7f672d98b640 1 --2- 172.21.15.2:0/1023458074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560b6e7e8b40 0x560b6e7e7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:46.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.891+0000 7f672c989640 1 --2- 172.21.15.2:0/1023458074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560b6e7f2370 0x560b6e7f4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:46.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.891+0000 7f672d18a640 1 -- 172.21.15.2:0/1023458074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560b6e7f2370 msgr2=0x560b6e7f4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:46.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.891+0000 7f672d98b640 1 --2- 172.21.15.2:0/364407952 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f67140a33b0 0x7f67140a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:46.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.891+0000 7f672d18a640 1 --2- 172.21.15.2:0/1023458074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560b6e7f2370 0x560b6e7f4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.891+0000 7f672d18a640 1 -- 172.21.15.2:0/1023458074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560b6e7e8b40 msgr2=0x560b6e7e7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:46.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.891+0000 7f672d18a640 1 --2- 172.21.15.2:0/1023458074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560b6e7e8b40 0x560b6e7e7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.891+0000 7f672d18a640 1 -- 172.21.15.2:0/1023458074 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b6e6d93a0 con 0x560b6e7e75d0 2024-09-19T06:21:46.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.891+0000 7f671e7fc640 1 -- 172.21.15.2:0/364407952 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f67180cfdf0 con 0x7f6728101450 2024-09-19T06:21:46.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.891+0000 7f672d18a640 1 --2- 172.21.15.2:0/1023458074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b6e7e75d0 0x560b6e7e7a10 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f6724009900 tx=0x7f6724032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=248069e0434ce37d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:46.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.892+0000 7f672d98b640 1 --2- 172.21.15.2:0/364407952 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f67140a33b0 0x7f67140a5870 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6720009370 tx=0x7f6720009240 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:46.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.892+0000 7f67137fe640 1 -- 172.21.15.2:0/1023458074 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6724040070 con 0x560b6e7e75d0 2024-09-19T06:21:46.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.892+0000 7f67137fe640 1 -- 172.21.15.2:0/1023458074 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f67240316a0 con 0x560b6e7e75d0 2024-09-19T06:21:46.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.892+0000 7f67137fe640 1 -- 172.21.15.2:0/1023458074 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6724035040 con 0x560b6e7e75d0 2024-09-19T06:21:46.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.892+0000 7f67317c7740 1 -- 172.21.15.2:0/1023458074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b6e7e75d0 msgr2=0x560b6e7e7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:46.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.892+0000 7f67317c7740 1 --2- 172.21.15.2:0/1023458074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b6e7e75d0 0x560b6e7e7a10 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f6724009900 tx=0x7f6724032e40 comp rx=0 tx=0).stop 2024-09-19T06:21:46.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.892+0000 7f67317c7740 1 -- 172.21.15.2:0/1023458074 shutdown_connections 2024-09-19T06:21:46.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.892+0000 7f67317c7740 1 --2- 172.21.15.2:0/1023458074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560b6e7f2370 0x560b6e7f4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.892+0000 7f67317c7740 1 --2- 172.21.15.2:0/1023458074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b6e7e75d0 0x560b6e7e7a10 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.892+0000 7f67317c7740 1 --2- 172.21.15.2:0/1023458074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560b6e7e8b40 0x560b6e7e7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.892+0000 7f67317c7740 1 -- 172.21.15.2:0/1023458074 >> 172.21.15.2:0/1023458074 conn(0x560b6e7b0310 msgr2=0x560b6e7e3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:46.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.893+0000 7f67317c7740 1 -- 172.21.15.2:0/1023458074 shutdown_connections 2024-09-19T06:21:46.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.893+0000 7f67317c7740 1 -- 172.21.15.2:0/1023458074 wait complete. 2024-09-19T06:21:46.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.893+0000 7f67317c7740 1 -- start start 2024-09-19T06:21:46.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.893+0000 7f67317c7740 1 Processor -- start 2024-09-19T06:21:46.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.893+0000 7f67317c7740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560b6e7e75d0 0x560b6e7f1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:46.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.893+0000 7f67317c7740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560b6e7e8b40 0x560b6e7eeff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:46.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.893+0000 7f67317c7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b6e7f2370 0x560b6e7ef5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:46.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.893+0000 7f67317c7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560b6e7f5010 con 0x560b6e7f2370 2024-09-19T06:21:46.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.893+0000 7f67317c7740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x560b6e708060 con 0x560b6e7e8b40 2024-09-19T06:21:46.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.893+0000 7f67317c7740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560b6e7f5190 con 0x560b6e7e75d0 2024-09-19T06:21:46.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.893+0000 7f67317c7740 10 client.0 _ll_register_callbacks cb 0x560b6e45b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:46.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.894+0000 7f672d98b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b6e7f2370 0x560b6e7ef5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.894+0000 7f672d98b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b6e7f2370 0x560b6e7ef5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46214/0 (socket says 172.21.15.2:46214) 2024-09-19T06:21:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.894+0000 7f672d98b640 1 -- 172.21.15.2:0/2629048765 learned_addr learned my addr 172.21.15.2:0/2629048765 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.894+0000 7f672d18a640 1 --2- 172.21.15.2:0/2629048765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560b6e7e75d0 0x560b6e7f1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.894+0000 7f672c989640 1 --2- 172.21.15.2:0/2629048765 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560b6e7e8b40 0x560b6e7eeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.894+0000 7f672d98b640 1 -- 172.21.15.2:0/2629048765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560b6e7e75d0 msgr2=0x560b6e7f1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.894+0000 7f672d98b640 1 --2- 172.21.15.2:0/2629048765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560b6e7e75d0 0x560b6e7f1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.894+0000 7f672d98b640 1 -- 172.21.15.2:0/2629048765 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560b6e7e8b40 msgr2=0x560b6e7eeff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.894+0000 7f672d98b640 1 --2- 172.21.15.2:0/2629048765 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560b6e7e8b40 0x560b6e7eeff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.894+0000 7f672d98b640 1 -- 172.21.15.2:0/2629048765 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b6e4be3c0 con 0x560b6e7f2370 2024-09-19T06:21:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.894+0000 7f672d98b640 1 --2- 172.21.15.2:0/2629048765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b6e7f2370 0x560b6e7ef5e0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f6720009d50 tx=0x7f6720004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ce87dd4d398bde0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.894+0000 7f6710ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.894+0000 7f6710ff9640 1 -- 172.21.15.2:0/2629048765 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6720023020 con 0x560b6e7f2370 2024-09-19T06:21:46.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.894+0000 7f6710ff9640 1 -- 172.21.15.2:0/2629048765 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f6720011470 con 0x560b6e7f2370 2024-09-19T06:21:46.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.894+0000 7f67317c7740 1 -- 172.21.15.2:0/2629048765 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67240316a0 con 0x560b6e7f2370 2024-09-19T06:21:46.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.894+0000 7f6710ff9640 1 -- 172.21.15.2:0/2629048765 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f672002e050 con 0x560b6e7f2370 2024-09-19T06:21:46.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.895+0000 7f67317c7740 10 client.17601 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:46.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.895+0000 7f67317c7740 1 -- 172.21.15.2:0/2629048765 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560b6e800ab0 con 0x560b6e7f2370 2024-09-19T06:21:46.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.895+0000 7f6710ff9640 1 -- 172.21.15.2:0/2629048765 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f67240316a0 con 0x560b6e7f2370 2024-09-19T06:21:46.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.895+0000 7f6710ff9640 1 -- 172.21.15.2:0/2629048765 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f672001f4c0 con 0x560b6e7f2370 2024-09-19T06:21:46.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.895+0000 7f67317c7740 10 client.17601 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:46.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.895+0000 7f67317c7740 10 client.17601 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:21:46.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.895+0000 7f67317c7740 20 client.17601 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:46.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.895+0000 7f67317c7740 1 --2- 172.21.15.2:0/2629048765 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x560b6e801f70 0x560b6e804410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:46.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.895+0000 7f67317c7740 4 client.17601 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:46.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.895+0000 7f67317c7740 1 -- 172.21.15.2:0/2629048765 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b6e75a860 con 0x560b6e801f70 2024-09-19T06:21:46.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.895+0000 7f672d18a640 1 --2- 172.21.15.2:0/2629048765 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x560b6e801f70 0x560b6e804410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:46.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.896+0000 7f672d18a640 1 --2- 172.21.15.2:0/2629048765 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x560b6e801f70 0x560b6e804410 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fdc05d52496007c5 server_cookie=67e5904b0133c97f in_seq=0 out_seq=0 2024-09-19T06:21:46.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.896+0000 7f6710ff9640 10 client.17601 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:21:46.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.896+0000 7f6710ff9640 1 -- 172.21.15.2:0/2629048765 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560b6e75a860 con 0x560b6e801f70 2024-09-19T06:21:46.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.896+0000 7f6710ff9640 10 client.17601 handle_command_reply: tid=0 2024-09-19T06:21:46.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.896+0000 7f67317c7740 1 client.17601 shutdown 2024-09-19T06:21:46.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.897+0000 7f67317c7740 1 -- 172.21.15.2:0/2629048765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b6e7f2370 msgr2=0x560b6e7ef5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:46.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.897+0000 7f67317c7740 1 --2- 172.21.15.2:0/2629048765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b6e7f2370 0x560b6e7ef5e0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f6720009d50 tx=0x7f6720004a40 comp rx=0 tx=0).stop 2024-09-19T06:21:46.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.897+0000 7f67317c7740 1 -- 172.21.15.2:0/2629048765 shutdown_connections 2024-09-19T06:21:46.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.897+0000 7f67317c7740 1 --2- 172.21.15.2:0/2629048765 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x560b6e801f70 0x560b6e804410 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.897+0000 7f67317c7740 1 --2- 172.21.15.2:0/2629048765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b6e7f2370 0x560b6e7ef5e0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.897+0000 7f67317c7740 1 --2- 172.21.15.2:0/2629048765 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560b6e7e8b40 0x560b6e7eeff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.897+0000 7f67317c7740 1 --2- 172.21.15.2:0/2629048765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560b6e7e75d0 0x560b6e7f1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.897+0000 7f67317c7740 1 -- 172.21.15.2:0/2629048765 >> 172.21.15.2:0/2629048765 conn(0x560b6e7b0310 msgr2=0x560b6e7e9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:46.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.897+0000 7f6710ff9640 0 client.17601 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:21:46.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.897+0000 7f67317c7740 1 -- 172.21.15.2:0/2629048765 shutdown_connections 2024-09-19T06:21:46.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.897+0000 7f67317c7740 1 -- 172.21.15.2:0/2629048765 wait complete. 2024-09-19T06:21:46.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.897+0000 7f67317c7740 20 client.17601 trim_cache size 0 max 16384 2024-09-19T06:21:46.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.910+0000 7f67317c7740 1 Processor -- start 2024-09-19T06:21:46.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.910+0000 7f67317c7740 1 -- start start 2024-09-19T06:21:46.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.910+0000 7f67317c7740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560b6e7e75d0 0x560b6e7fe2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:46.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.910+0000 7f67317c7740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560b6e7e8b40 0x560b6e7e3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:46.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.910+0000 7f67317c7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b6e7f2370 0x560b6e7e3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:46.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.910+0000 7f67317c7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f67281b66a0 con 0x560b6e7f2370 2024-09-19T06:21:46.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.910+0000 7f67317c7740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f67281b3f70 con 0x560b6e7e75d0 2024-09-19T06:21:46.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.910+0000 7f67317c7740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f67281b1de0 con 0x560b6e7e8b40 2024-09-19T06:21:46.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.910+0000 7f672d98b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b6e7f2370 0x560b6e7e3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:46.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.910+0000 7f672d98b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b6e7f2370 0x560b6e7e3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46216/0 (socket says 172.21.15.2:46216) 2024-09-19T06:21:46.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.910+0000 7f672d98b640 1 -- 172.21.15.2:0/3348821916 learned_addr learned my addr 172.21.15.2:0/3348821916 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:46.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.910+0000 7f672d18a640 1 --2- 172.21.15.2:0/3348821916 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560b6e7e75d0 0x560b6e7fe2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:46.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.910+0000 7f672c989640 1 --2- 172.21.15.2:0/3348821916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560b6e7e8b40 0x560b6e7e3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:46.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.910+0000 7f672d98b640 1 -- 172.21.15.2:0/3348821916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560b6e7e8b40 msgr2=0x560b6e7e3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:46.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.910+0000 7f672d98b640 1 --2- 172.21.15.2:0/3348821916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560b6e7e8b40 0x560b6e7e3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.910+0000 7f672d98b640 1 -- 172.21.15.2:0/3348821916 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560b6e7e75d0 msgr2=0x560b6e7fe2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:46.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.910+0000 7f672d98b640 1 --2- 172.21.15.2:0/3348821916 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560b6e7e75d0 0x560b6e7fe2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.910+0000 7f672d98b640 1 -- 172.21.15.2:0/3348821916 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b6e7f20b0 con 0x560b6e7f2370 2024-09-19T06:21:46.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.910+0000 7f672d18a640 1 --2- 172.21.15.2:0/3348821916 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560b6e7e75d0 0x560b6e7fe2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:21:46.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.910+0000 7f672c989640 1 --2- 172.21.15.2:0/3348821916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560b6e7e8b40 0x560b6e7e3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:21:46.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.911+0000 7f672d98b640 1 --2- 172.21.15.2:0/3348821916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b6e7f2370 0x560b6e7e3c40 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f6720006010 tx=0x7f6720004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77b4ca101daa5ba8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:46.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.911+0000 7f6712ffd640 1 -- 172.21.15.2:0/3348821916 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6720036070 con 0x560b6e7f2370 2024-09-19T06:21:46.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.911+0000 7f6712ffd640 1 -- 172.21.15.2:0/3348821916 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6720018040 con 0x560b6e7f2370 2024-09-19T06:21:46.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.911+0000 7f6712ffd640 1 -- 172.21.15.2:0/3348821916 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6720023070 con 0x560b6e7f2370 2024-09-19T06:21:46.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.911+0000 7f67317c7740 1 -- 172.21.15.2:0/3348821916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b6e7f2370 msgr2=0x560b6e7e3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:46.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.911+0000 7f67317c7740 1 --2- 172.21.15.2:0/3348821916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b6e7f2370 0x560b6e7e3c40 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f6720006010 tx=0x7f6720004530 comp rx=0 tx=0).stop 2024-09-19T06:21:46.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.912+0000 7f67317c7740 1 -- 172.21.15.2:0/3348821916 shutdown_connections 2024-09-19T06:21:46.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.912+0000 7f67317c7740 1 --2- 172.21.15.2:0/3348821916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b6e7f2370 0x560b6e7e3c40 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.912+0000 7f67317c7740 1 --2- 172.21.15.2:0/3348821916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560b6e7e8b40 0x560b6e7e3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.912+0000 7f67317c7740 1 --2- 172.21.15.2:0/3348821916 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560b6e7e75d0 0x560b6e7fe2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.912+0000 7f67317c7740 1 -- 172.21.15.2:0/3348821916 >> 172.21.15.2:0/3348821916 conn(0x560b6e7b0310 msgr2=0x560b6e7eefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:46.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.912+0000 7f67317c7740 1 -- 172.21.15.2:0/3348821916 shutdown_connections 2024-09-19T06:21:46.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.912+0000 7f67317c7740 1 -- 172.21.15.2:0/3348821916 wait complete. 2024-09-19T06:21:46.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.912+0000 7f67317c7740 1 -- start start 2024-09-19T06:21:46.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.912+0000 7f67317c7740 1 Processor -- start 2024-09-19T06:21:46.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.912+0000 7f67317c7740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560b6e7e75d0 0x560b6e7faa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:46.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.912+0000 7f67317c7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b6e7e8b40 0x560b6e7ebbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:46.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.912+0000 7f67317c7740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560b6e7f2370 0x560b6e7ec100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:46.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.912+0000 7f67317c7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f67281b2430 con 0x560b6e7e8b40 2024-09-19T06:21:46.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.912+0000 7f67317c7740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f67281b38a0 con 0x560b6e7f2370 2024-09-19T06:21:46.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.912+0000 7f67317c7740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f67281b2b00 con 0x560b6e7e75d0 2024-09-19T06:21:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.912+0000 7f67317c7740 10 client.0 _ll_register_callbacks cb 0x7f6720009ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.913+0000 7f672c989640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b6e7e8b40 0x560b6e7ebbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.913+0000 7f672c989640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b6e7e8b40 0x560b6e7ebbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46228/0 (socket says 172.21.15.2:46228) 2024-09-19T06:21:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.913+0000 7f672c989640 1 -- 172.21.15.2:0/3665997118 learned_addr learned my addr 172.21.15.2:0/3665997118 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.913+0000 7f672d98b640 1 --2- 172.21.15.2:0/3665997118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560b6e7f2370 0x560b6e7ec100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.913+0000 7f672d18a640 1 --2- 172.21.15.2:0/3665997118 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560b6e7e75d0 0x560b6e7faa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.913+0000 7f672c989640 1 -- 172.21.15.2:0/3665997118 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560b6e7e75d0 msgr2=0x560b6e7faa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.913+0000 7f672c989640 1 --2- 172.21.15.2:0/3665997118 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560b6e7e75d0 0x560b6e7faa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.913+0000 7f672c989640 1 -- 172.21.15.2:0/3665997118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560b6e7f2370 msgr2=0x560b6e7ec100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.913+0000 7f672c989640 1 --2- 172.21.15.2:0/3665997118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560b6e7f2370 0x560b6e7ec100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.913+0000 7f672c989640 1 -- 172.21.15.2:0/3665997118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b6e7ec770 con 0x560b6e7e8b40 2024-09-19T06:21:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.913+0000 7f672c989640 1 --2- 172.21.15.2:0/3665997118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b6e7e8b40 0x560b6e7ebbc0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f67180cdb40 tx=0x7f671806bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d360ec773308ea5b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:46.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.913+0000 7f6710ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:46.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.913+0000 7f6710ff9640 1 -- 172.21.15.2:0/3665997118 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671809c7d0 con 0x560b6e7e8b40 2024-09-19T06:21:46.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.913+0000 7f6710ff9640 1 -- 172.21.15.2:0/3665997118 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f6718098740 con 0x560b6e7e8b40 2024-09-19T06:21:46.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.913+0000 7f67317c7740 1 -- 172.21.15.2:0/3665997118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6720018040 con 0x560b6e7e8b40 2024-09-19T06:21:46.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.913+0000 7f6710ff9640 1 -- 172.21.15.2:0/3665997118 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f671809c0d0 con 0x560b6e7e8b40 2024-09-19T06:21:46.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.913+0000 7f67317c7740 10 client.17607 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:46.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.913+0000 7f67317c7740 1 -- 172.21.15.2:0/3665997118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560b6e86cb40 con 0x560b6e7e8b40 2024-09-19T06:21:46.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.914+0000 7f6710ff9640 1 -- 172.21.15.2:0/3665997118 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6720018040 con 0x560b6e7e8b40 2024-09-19T06:21:46.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.914+0000 7f6710ff9640 1 -- 172.21.15.2:0/3665997118 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f67180a00d0 con 0x560b6e7e8b40 2024-09-19T06:21:46.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.914+0000 7f67317c7740 10 client.17607 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:46.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.914+0000 7f67317c7740 10 client.17607 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:21:46.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.914+0000 7f67317c7740 20 client.17607 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:46.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.914+0000 7f67317c7740 1 --2- 172.21.15.2:0/3665997118 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x560b6e86d210 0x560b6e86f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:46.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.914+0000 7f67317c7740 4 client.17607 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:21:46.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.914+0000 7f67317c7740 1 -- 172.21.15.2:0/3665997118 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560b6e754d70 con 0x560b6e86d210 2024-09-19T06:21:46.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.914+0000 7f672d18a640 1 --2- 172.21.15.2:0/3665997118 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x560b6e86d210 0x560b6e86f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:46.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.915+0000 7f6710ff9640 10 client.17607 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:21:46.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.915+0000 7f672d18a640 1 --2- 172.21.15.2:0/3665997118 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x560b6e86d210 0x560b6e86f600 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=906aa544d16874a0 server_cookie=5473266a55f2f782 in_seq=0 out_seq=0 2024-09-19T06:21:46.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.915+0000 7f6710ff9640 1 -- 172.21.15.2:0/3665997118 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560b6e754d70 con 0x560b6e86d210 2024-09-19T06:21:46.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.915+0000 7f6710ff9640 10 client.17607 handle_command_reply: tid=0 2024-09-19T06:21:46.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.915+0000 7f67317c7740 1 client.17607 shutdown 2024-09-19T06:21:46.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.915+0000 7f67317c7740 1 -- 172.21.15.2:0/3665997118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b6e7e8b40 msgr2=0x560b6e7ebbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:46.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.915+0000 7f67317c7740 1 --2- 172.21.15.2:0/3665997118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b6e7e8b40 0x560b6e7ebbc0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f67180cdb40 tx=0x7f671806bcf0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.915+0000 7f67317c7740 1 -- 172.21.15.2:0/3665997118 shutdown_connections 2024-09-19T06:21:46.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.915+0000 7f67317c7740 1 --2- 172.21.15.2:0/3665997118 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x560b6e86d210 0x560b6e86f600 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.915+0000 7f67317c7740 1 --2- 172.21.15.2:0/3665997118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560b6e7f2370 0x560b6e7ec100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.915+0000 7f67317c7740 1 --2- 172.21.15.2:0/3665997118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b6e7e8b40 0x560b6e7ebbc0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.915+0000 7f67317c7740 1 --2- 172.21.15.2:0/3665997118 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560b6e7e75d0 0x560b6e7faa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.915+0000 7f67317c7740 1 -- 172.21.15.2:0/3665997118 >> 172.21.15.2:0/3665997118 conn(0x560b6e7b0310 msgr2=0x560b6e7ed4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:46.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.915+0000 7f6710ff9640 0 client.17607 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:21:46.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.915+0000 7f67317c7740 1 -- 172.21.15.2:0/3665997118 shutdown_connections 2024-09-19T06:21:46.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.915+0000 7f67317c7740 1 -- 172.21.15.2:0/3665997118 wait complete. 2024-09-19T06:21:46.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.915+0000 7f67317c7740 20 client.17607 trim_cache size 0 max 16384 2024-09-19T06:21:46.922 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:21:46.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.916+0000 7f672f3ee640 1 -- 172.21.15.2:0/364407952 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f67140a33b0 msgr2=0x7f67140a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:46.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.916+0000 7f672f3ee640 1 --2- 172.21.15.2:0/364407952 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f67140a33b0 0x7f67140a5870 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6720009370 tx=0x7f6720009240 comp rx=0 tx=0).stop 2024-09-19T06:21:46.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.916+0000 7f672f3ee640 1 -- 172.21.15.2:0/364407952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6728101450 msgr2=0x7f67281a4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:46.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.916+0000 7f672f3ee640 1 --2- 172.21.15.2:0/364407952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6728101450 0x7f67281a4bc0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f671800c970 tx=0x7f671800ce30 comp rx=0 tx=0).stop 2024-09-19T06:21:46.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.916+0000 7f672f3ee640 1 -- 172.21.15.2:0/364407952 shutdown_connections 2024-09-19T06:21:46.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.916+0000 7f672f3ee640 1 --2- 172.21.15.2:0/364407952 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f67140a33b0 0x7f67140a5870 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.916+0000 7f672f3ee640 1 --2- 172.21.15.2:0/364407952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6728105f40 0x7f672819e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.916+0000 7f672f3ee640 1 --2- 172.21.15.2:0/364407952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6728101450 0x7f67281a4bc0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.916+0000 7f672f3ee640 1 --2- 172.21.15.2:0/364407952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6728100b30 0x7f67281a4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.916+0000 7f672f3ee640 1 -- 172.21.15.2:0/364407952 >> 172.21.15.2:0/364407952 conn(0x7f67280fc7a0 msgr2=0x7f67280fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:46.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.916+0000 7f672f3ee640 1 -- 172.21.15.2:0/364407952 shutdown_connections 2024-09-19T06:21:46.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:46.916+0000 7f672f3ee640 1 -- 172.21.15.2:0/364407952 wait complete. 2024-09-19T06:21:47.571 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:47 smithi002 ceph-mon[30982]: pgmap v214: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:21:47.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:47 smithi090 ceph-mon[34497]: pgmap v214: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:21:47.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:47 smithi089 ceph-mon[34160]: pgmap v214: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:21:47.817 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:21:48.076 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:48.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.545+0000 7fbf10ede640 1 -- 172.21.15.2:0/3406861398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf0c10c170 msgr2=0x7fbf0c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:48.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.545+0000 7fbf10ede640 1 --2- 172.21.15.2:0/3406861398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf0c10c170 0x7fbf0c10e610 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fbf04009ca0 tx=0x7fbf0402a950 comp rx=0 tx=0).stop 2024-09-19T06:21:48.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.545+0000 7fbf10ede640 1 -- 172.21.15.2:0/3406861398 shutdown_connections 2024-09-19T06:21:48.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.545+0000 7fbf10ede640 1 --2- 172.21.15.2:0/3406861398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf0c10c170 0x7fbf0c10e610 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.545+0000 7fbf10ede640 1 --2- 172.21.15.2:0/3406861398 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf0c103660 0x7fbf0c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.545+0000 7fbf10ede640 1 --2- 172.21.15.2:0/3406861398 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf0c102d40 0x7fbf0c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.545+0000 7fbf10ede640 1 -- 172.21.15.2:0/3406861398 >> 172.21.15.2:0/3406861398 conn(0x7fbf0c0fc7a0 msgr2=0x7fbf0c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:48.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.546+0000 7fbf10ede640 1 -- 172.21.15.2:0/3406861398 shutdown_connections 2024-09-19T06:21:48.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.546+0000 7fbf10ede640 1 -- 172.21.15.2:0/3406861398 wait complete. 2024-09-19T06:21:48.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.546+0000 7fbf10ede640 1 Processor -- start 2024-09-19T06:21:48.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.546+0000 7fbf10ede640 1 -- start start 2024-09-19T06:21:48.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.547+0000 7fbf10ede640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf0c102d40 0x7fbf0c198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:48.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.547+0000 7fbf10ede640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf0c103660 0x7fbf0c1988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:48.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.547+0000 7fbf10ede640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf0c10c170 0x7fbf0c19cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:48.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.547+0000 7fbf10ede640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0c111e60 con 0x7fbf0c102d40 2024-09-19T06:21:48.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.547+0000 7fbf10ede640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0c111ce0 con 0x7fbf0c103660 2024-09-19T06:21:48.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.547+0000 7fbf10ede640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0c111fe0 con 0x7fbf0c10c170 2024-09-19T06:21:48.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.547+0000 7fbf0a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf0c102d40 0x7fbf0c198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:48.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.547+0000 7fbf0a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf0c102d40 0x7fbf0c198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46254/0 (socket says 172.21.15.2:46254) 2024-09-19T06:21:48.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.547+0000 7fbf0a59c640 1 -- 172.21.15.2:0/568586574 learned_addr learned my addr 172.21.15.2:0/568586574 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:48.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.547+0000 7fbf09d9b640 1 --2- 172.21.15.2:0/568586574 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf0c103660 0x7fbf0c1988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:48.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.547+0000 7fbf0ad9d640 1 --2- 172.21.15.2:0/568586574 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf0c10c170 0x7fbf0c19cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:48.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.547+0000 7fbf0a59c640 1 -- 172.21.15.2:0/568586574 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf0c10c170 msgr2=0x7fbf0c19cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:48.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.547+0000 7fbf0a59c640 1 --2- 172.21.15.2:0/568586574 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf0c10c170 0x7fbf0c19cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.547+0000 7fbf0a59c640 1 -- 172.21.15.2:0/568586574 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf0c103660 msgr2=0x7fbf0c1988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:48.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.547+0000 7fbf0a59c640 1 --2- 172.21.15.2:0/568586574 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf0c103660 0x7fbf0c1988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.547+0000 7fbf0a59c640 1 -- 172.21.15.2:0/568586574 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf0c19d330 con 0x7fbf0c102d40 2024-09-19T06:21:48.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.547+0000 7fbf09d9b640 1 --2- 172.21.15.2:0/568586574 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf0c103660 0x7fbf0c1988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:48.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.547+0000 7fbf0a59c640 1 --2- 172.21.15.2:0/568586574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf0c102d40 0x7fbf0c198380 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fbefc00c890 tx=0x7fbefc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:48.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.548+0000 7fbf037fe640 1 -- 172.21.15.2:0/568586574 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbefc004220 con 0x7fbf0c102d40 2024-09-19T06:21:48.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.548+0000 7fbf10ede640 1 -- 172.21.15.2:0/568586574 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf0c19d620 con 0x7fbf0c102d40 2024-09-19T06:21:48.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.548+0000 7fbf037fe640 1 -- 172.21.15.2:0/568586574 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbefc0043c0 con 0x7fbf0c102d40 2024-09-19T06:21:48.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.548+0000 7fbf037fe640 1 -- 172.21.15.2:0/568586574 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbefc004a00 con 0x7fbf0c102d40 2024-09-19T06:21:48.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.548+0000 7fbf10ede640 1 -- 172.21.15.2:0/568586574 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf0c1a4f00 con 0x7fbf0c102d40 2024-09-19T06:21:48.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.550+0000 7fbf037fe640 1 -- 172.21.15.2:0/568586574 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fbefc004ba0 con 0x7fbf0c102d40 2024-09-19T06:21:48.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.550+0000 7fbf132b7740 1 Processor -- start 2024-09-19T06:21:48.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.550+0000 7fbf132b7740 1 -- start start 2024-09-19T06:21:48.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.551+0000 7fbf132b7740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de256efb40 0x55de256ee090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:48.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.551+0000 7fbf132b7740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de256ee5d0 0x55de256eea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:48.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.551+0000 7fbf132b7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de256f9370 0x55de256fb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:48.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.551+0000 7fbf132b7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55de256542f0 con 0x55de256f9370 2024-09-19T06:21:48.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.551+0000 7fbf132b7740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55de255fbcf0 con 0x55de256ee5d0 2024-09-19T06:21:48.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.551+0000 7fbf132b7740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55de256502b0 con 0x55de256efb40 2024-09-19T06:21:48.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.551+0000 7fbf037fe640 1 --2- 172.21.15.2:0/568586574 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fbef80a33b0 0x7fbef80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:48.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.551+0000 7fbf09d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de256f9370 0x55de256fb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:48.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.551+0000 7fbf09d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de256f9370 0x55de256fb760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46258/0 (socket says 172.21.15.2:46258) 2024-09-19T06:21:48.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.551+0000 7fbf09d9b640 1 -- 172.21.15.2:0/4141799282 learned_addr learned my addr 172.21.15.2:0/4141799282 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:48.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.551+0000 7fbf0ad9d640 1 --2- 172.21.15.2:0/4141799282 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de256efb40 0x55de256ee090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:48.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.551+0000 7fbf0ad9d640 1 --2- 172.21.15.2:0/568586574 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fbef80a33b0 0x7fbef80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:48.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.551+0000 7fbf09d9b640 1 -- 172.21.15.2:0/4141799282 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de256efb40 msgr2=0x55de256ee090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:48.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.551+0000 7fbf09d9b640 1 --2- 172.21.15.2:0/4141799282 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de256efb40 0x55de256ee090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.551+0000 7fbf037fe640 1 -- 172.21.15.2:0/568586574 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7fbefc0cf9e0 con 0x7fbf0c102d40 2024-09-19T06:21:48.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.551+0000 7fbf09d9b640 1 -- 172.21.15.2:0/4141799282 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de256ee5d0 msgr2=0x55de256eea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:48.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.551+0000 7fbf0a59c640 1 --2- 172.21.15.2:0/4141799282 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de256ee5d0 0x55de256eea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:48.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.551+0000 7fbf09d9b640 1 --2- 172.21.15.2:0/4141799282 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de256ee5d0 0x55de256eea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.551+0000 7fbf09d9b640 1 -- 172.21.15.2:0/4141799282 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de255e03a0 con 0x55de256f9370 2024-09-19T06:21:48.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.551+0000 7fbf0a59c640 1 --2- 172.21.15.2:0/4141799282 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de256ee5d0 0x55de256eea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:21:48.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.552+0000 7fbf09d9b640 1 --2- 172.21.15.2:0/4141799282 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de256f9370 0x55de256fb760 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fbef40077c0 tx=0x7fbef4007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3412e1c836ff962c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:48.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.552+0000 7fbf0ad9d640 1 --2- 172.21.15.2:0/568586574 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fbef80a33b0 0x7fbef80a5870 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbf04005fe0 tx=0x7fbf04005c50 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:48.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.552+0000 7fbf00ff9640 1 -- 172.21.15.2:0/4141799282 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef400d950 con 0x55de256f9370 2024-09-19T06:21:48.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.552+0000 7fbf00ff9640 1 -- 172.21.15.2:0/4141799282 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbef4018070 con 0x55de256f9370 2024-09-19T06:21:48.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.552+0000 7fbf00ff9640 1 -- 172.21.15.2:0/4141799282 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef4013e60 con 0x55de256f9370 2024-09-19T06:21:48.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.552+0000 7fbf132b7740 1 -- 172.21.15.2:0/4141799282 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de256f9370 msgr2=0x55de256fb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:48.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.552+0000 7fbf132b7740 1 --2- 172.21.15.2:0/4141799282 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de256f9370 0x55de256fb760 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fbef40077c0 tx=0x7fbef4007c80 comp rx=0 tx=0).stop 2024-09-19T06:21:48.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.553+0000 7fbf132b7740 1 -- 172.21.15.2:0/4141799282 shutdown_connections 2024-09-19T06:21:48.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.553+0000 7fbf132b7740 1 --2- 172.21.15.2:0/4141799282 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de256f9370 0x55de256fb760 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.553+0000 7fbf132b7740 1 --2- 172.21.15.2:0/4141799282 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de256ee5d0 0x55de256eea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.553+0000 7fbf132b7740 1 --2- 172.21.15.2:0/4141799282 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de256efb40 0x55de256ee090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.553+0000 7fbf132b7740 1 -- 172.21.15.2:0/4141799282 >> 172.21.15.2:0/4141799282 conn(0x55de256b7310 msgr2=0x55de256eac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:48.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.553+0000 7fbf132b7740 1 -- 172.21.15.2:0/4141799282 shutdown_connections 2024-09-19T06:21:48.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.553+0000 7fbf132b7740 1 -- 172.21.15.2:0/4141799282 wait complete. 2024-09-19T06:21:48.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.553+0000 7fbf132b7740 1 -- start start 2024-09-19T06:21:48.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.553+0000 7fbf132b7740 1 Processor -- start 2024-09-19T06:21:48.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.553+0000 7fbf132b7740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de256ee5d0 0x55de256fd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:48.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.553+0000 7fbf132b7740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de256efb40 0x55de256fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:48.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.553+0000 7fbf132b7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de256f9370 0x55de25701d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:48.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.553+0000 7fbf132b7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55de256fc070 con 0x55de256f9370 2024-09-19T06:21:48.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.553+0000 7fbf132b7740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55de2560f060 con 0x55de256ee5d0 2024-09-19T06:21:48.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.553+0000 7fbf132b7740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55de256fc1f0 con 0x55de256efb40 2024-09-19T06:21:48.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.553+0000 7fbf132b7740 10 client.0 _ll_register_callbacks cb 0x55de253628c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:48.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.554+0000 7fbf0ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de256f9370 0x55de25701d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:48.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.554+0000 7fbf0ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de256f9370 0x55de25701d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46262/0 (socket says 172.21.15.2:46262) 2024-09-19T06:21:48.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.554+0000 7fbf0ad9d640 1 -- 172.21.15.2:0/1307146358 learned_addr learned my addr 172.21.15.2:0/1307146358 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:48.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.554+0000 7fbf0a59c640 1 --2- 172.21.15.2:0/1307146358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de256ee5d0 0x55de256fd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:48.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.554+0000 7fbf09d9b640 1 --2- 172.21.15.2:0/1307146358 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de256efb40 0x55de256fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:48.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.554+0000 7fbf0ad9d640 1 -- 172.21.15.2:0/1307146358 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de256efb40 msgr2=0x55de256fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:48.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.554+0000 7fbf0ad9d640 1 --2- 172.21.15.2:0/1307146358 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de256efb40 0x55de256fdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.554+0000 7fbf0ad9d640 1 -- 172.21.15.2:0/1307146358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de256ee5d0 msgr2=0x55de256fd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:48.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.554+0000 7fbf0ad9d640 1 --2- 172.21.15.2:0/1307146358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de256ee5d0 0x55de256fd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.554+0000 7fbf0ad9d640 1 -- 172.21.15.2:0/1307146358 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de253c53c0 con 0x55de256f9370 2024-09-19T06:21:48.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.554+0000 7fbf0ad9d640 1 --2- 172.21.15.2:0/1307146358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de256f9370 0x55de25701d70 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fbf040093d0 tx=0x7fbf040095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edfd119acb2d2e0f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:48.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.554+0000 7fbef1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:48.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.554+0000 7fbef1ffb640 1 -- 172.21.15.2:0/1307146358 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf0404f030 con 0x55de256f9370 2024-09-19T06:21:48.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.554+0000 7fbef1ffb640 1 -- 172.21.15.2:0/1307146358 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7fbf04004510 con 0x55de256f9370 2024-09-19T06:21:48.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.554+0000 7fbf132b7740 1 -- 172.21.15.2:0/1307146358 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbef4018070 con 0x55de256f9370 2024-09-19T06:21:48.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.555+0000 7fbef1ffb640 1 -- 172.21.15.2:0/1307146358 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fbf04034040 con 0x55de256f9370 2024-09-19T06:21:48.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.555+0000 7fbf132b7740 10 client.17619 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:48.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.555+0000 7fbf132b7740 1 -- 172.21.15.2:0/1307146358 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55de2570bde0 con 0x55de256f9370 2024-09-19T06:21:48.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.555+0000 7fbef1ffb640 1 -- 172.21.15.2:0/1307146358 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbef4018070 con 0x55de256f9370 2024-09-19T06:21:48.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.555+0000 7fbef1ffb640 1 -- 172.21.15.2:0/1307146358 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fbf040564c0 con 0x55de256f9370 2024-09-19T06:21:48.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.555+0000 7fbf132b7740 10 client.17619 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:48.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.555+0000 7fbf132b7740 10 client.17619 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:21:48.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.555+0000 7fbf132b7740 20 client.17619 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:48.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.555+0000 7fbf132b7740 1 --2- 172.21.15.2:0/1307146358 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55de2570d240 0x55de2570f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:48.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.555+0000 7fbf132b7740 4 client.17619 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:48.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.555+0000 7fbf132b7740 1 -- 172.21.15.2:0/1307146358 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de25661860 con 0x55de2570d240 2024-09-19T06:21:48.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.555+0000 7fbf0a59c640 1 --2- 172.21.15.2:0/1307146358 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55de2570d240 0x55de2570f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:48.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.556+0000 7fbf0a59c640 1 --2- 172.21.15.2:0/1307146358 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55de2570d240 0x55de2570f6b0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9d57587f2d8b404b server_cookie=9a0198ecd5b9e506 in_seq=0 out_seq=0 2024-09-19T06:21:48.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.556+0000 7fbef1ffb640 10 client.17619 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:21:48.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.556+0000 7fbef1ffb640 1 -- 172.21.15.2:0/1307146358 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55de25661860 con 0x55de2570d240 2024-09-19T06:21:48.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.556+0000 7fbef1ffb640 10 client.17619 handle_command_reply: tid=0 2024-09-19T06:21:48.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.556+0000 7fbf132b7740 1 client.17619 shutdown 2024-09-19T06:21:48.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.556+0000 7fbf132b7740 1 -- 172.21.15.2:0/1307146358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de256f9370 msgr2=0x55de25701d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:48.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.556+0000 7fbf132b7740 1 --2- 172.21.15.2:0/1307146358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de256f9370 0x55de25701d70 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fbf040093d0 tx=0x7fbf040095c0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.556+0000 7fbf132b7740 1 -- 172.21.15.2:0/1307146358 shutdown_connections 2024-09-19T06:21:48.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.556+0000 7fbf132b7740 1 --2- 172.21.15.2:0/1307146358 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55de2570d240 0x55de2570f6b0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.557+0000 7fbf132b7740 1 --2- 172.21.15.2:0/1307146358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de256f9370 0x55de25701d70 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.557+0000 7fbf132b7740 1 --2- 172.21.15.2:0/1307146358 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de256efb40 0x55de256fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.557+0000 7fbf132b7740 1 --2- 172.21.15.2:0/1307146358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de256ee5d0 0x55de256fd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.557+0000 7fbef1ffb640 0 client.17619 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:21:48.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.557+0000 7fbf132b7740 1 -- 172.21.15.2:0/1307146358 >> 172.21.15.2:0/1307146358 conn(0x55de256b7310 msgr2=0x55de256f0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:48.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.557+0000 7fbf132b7740 1 -- 172.21.15.2:0/1307146358 shutdown_connections 2024-09-19T06:21:48.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.557+0000 7fbf132b7740 1 -- 172.21.15.2:0/1307146358 wait complete. 2024-09-19T06:21:48.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.557+0000 7fbf132b7740 20 client.17619 trim_cache size 0 max 16384 2024-09-19T06:21:48.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.570+0000 7fbf132b7740 1 Processor -- start 2024-09-19T06:21:48.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.570+0000 7fbf132b7740 1 -- start start 2024-09-19T06:21:48.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.570+0000 7fbf132b7740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de256ee5d0 0x55de25701d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:48.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.570+0000 7fbf132b7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de256efb40 0x55de256edbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:48.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.570+0000 7fbf132b7740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de256f9370 0x55de256e9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:48.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.571+0000 7fbf132b7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0c1adee0 con 0x55de256efb40 2024-09-19T06:21:48.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.571+0000 7fbf132b7740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0c1ab7b0 con 0x55de256f9370 2024-09-19T06:21:48.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.571+0000 7fbf132b7740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0c1a9620 con 0x55de256ee5d0 2024-09-19T06:21:48.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.571+0000 7fbf09d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de256efb40 0x55de256edbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:48.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.571+0000 7fbf09d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de256efb40 0x55de256edbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46264/0 (socket says 172.21.15.2:46264) 2024-09-19T06:21:48.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.571+0000 7fbf09d9b640 1 -- 172.21.15.2:0/3085077215 learned_addr learned my addr 172.21.15.2:0/3085077215 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:48.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.571+0000 7fbf0a59c640 1 --2- 172.21.15.2:0/3085077215 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de256ee5d0 0x55de25701d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:48.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.571+0000 7fbf0ad9d640 1 --2- 172.21.15.2:0/3085077215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de256f9370 0x55de256e9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:48.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.571+0000 7fbf09d9b640 1 -- 172.21.15.2:0/3085077215 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de256ee5d0 msgr2=0x55de25701d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:48.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.571+0000 7fbf09d9b640 1 --2- 172.21.15.2:0/3085077215 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de256ee5d0 0x55de25701d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.571+0000 7fbf09d9b640 1 -- 172.21.15.2:0/3085077215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de256f9370 msgr2=0x55de256e9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:48.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.571+0000 7fbf09d9b640 1 --2- 172.21.15.2:0/3085077215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de256f9370 0x55de256e9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.571+0000 7fbf09d9b640 1 -- 172.21.15.2:0/3085077215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de256ef3c0 con 0x55de256efb40 2024-09-19T06:21:48.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.571+0000 7fbf09d9b640 1 --2- 172.21.15.2:0/3085077215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de256efb40 0x55de256edbd0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fbef4013ab0 tx=0x7fbef40047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf0934fd6ec9daec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:48.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.571+0000 7fbef3fff640 1 -- 172.21.15.2:0/3085077215 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef4013680 con 0x55de256efb40 2024-09-19T06:21:48.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.571+0000 7fbef3fff640 1 -- 172.21.15.2:0/3085077215 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbef4018040 con 0x55de256efb40 2024-09-19T06:21:48.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.571+0000 7fbef3fff640 1 -- 172.21.15.2:0/3085077215 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef40286c0 con 0x55de256efb40 2024-09-19T06:21:48.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.572+0000 7fbf132b7740 1 -- 172.21.15.2:0/3085077215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de256efb40 msgr2=0x55de256edbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:48.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.572+0000 7fbf132b7740 1 --2- 172.21.15.2:0/3085077215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de256efb40 0x55de256edbd0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fbef4013ab0 tx=0x7fbef40047d0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.572+0000 7fbf132b7740 1 -- 172.21.15.2:0/3085077215 shutdown_connections 2024-09-19T06:21:48.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.572+0000 7fbf132b7740 1 --2- 172.21.15.2:0/3085077215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de256f9370 0x55de256e9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.572+0000 7fbf132b7740 1 --2- 172.21.15.2:0/3085077215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de256efb40 0x55de256edbd0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.572+0000 7fbf132b7740 1 --2- 172.21.15.2:0/3085077215 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de256ee5d0 0x55de25701d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.572+0000 7fbf132b7740 1 -- 172.21.15.2:0/3085077215 >> 172.21.15.2:0/3085077215 conn(0x55de256b7310 msgr2=0x55de256e94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:48.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.572+0000 7fbf132b7740 1 -- 172.21.15.2:0/3085077215 shutdown_connections 2024-09-19T06:21:48.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.572+0000 7fbf132b7740 1 -- 172.21.15.2:0/3085077215 wait complete. 2024-09-19T06:21:48.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.572+0000 7fbf132b7740 1 -- start start 2024-09-19T06:21:48.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.573+0000 7fbf132b7740 1 Processor -- start 2024-09-19T06:21:48.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.573+0000 7fbf132b7740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de256ee5d0 0x55de257056c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:48.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.573+0000 7fbf132b7740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de256efb40 0x55de25705c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:48.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.573+0000 7fbf132b7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de256f9370 0x55de25770f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:48.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.573+0000 7fbf132b7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0c1a9c70 con 0x55de256f9370 2024-09-19T06:21:48.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.573+0000 7fbf132b7740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0c1ab0e0 con 0x55de256ee5d0 2024-09-19T06:21:48.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.573+0000 7fbf132b7740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0c1aa340 con 0x55de256efb40 2024-09-19T06:21:48.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.573+0000 7fbf132b7740 10 client.0 _ll_register_callbacks cb 0x7fbf0402f870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:48.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.573+0000 7fbf0ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de256f9370 0x55de25770f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:48.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.573+0000 7fbf09d9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de256efb40 0x55de25705c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:48.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.573+0000 7fbf09d9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de256efb40 0x55de25705c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:37842/0 (socket says 172.21.15.2:37842) 2024-09-19T06:21:48.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.573+0000 7fbf09d9b640 1 -- 172.21.15.2:0/1653164770 learned_addr learned my addr 172.21.15.2:0/1653164770 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:48.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.573+0000 7fbf0ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de256f9370 0x55de25770f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46270/0 (socket says 172.21.15.2:46270) 2024-09-19T06:21:48.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.573+0000 7fbf0a59c640 1 --2- 172.21.15.2:0/1653164770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de256ee5d0 0x55de257056c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:48.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.573+0000 7fbf09d9b640 1 -- 172.21.15.2:0/1653164770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de256ee5d0 msgr2=0x55de257056c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:48.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.573+0000 7fbf09d9b640 1 --2- 172.21.15.2:0/1653164770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de256ee5d0 0x55de257056c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.573+0000 7fbf09d9b640 1 -- 172.21.15.2:0/1653164770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de256f9370 msgr2=0x55de25770f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:48.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.573+0000 7fbf09d9b640 1 --2- 172.21.15.2:0/1653164770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de256f9370 0x55de25770f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.573+0000 7fbf09d9b640 1 -- 172.21.15.2:0/1653164770 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de25771600 con 0x55de256efb40 2024-09-19T06:21:48.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.573+0000 7fbf0a59c640 1 --2- 172.21.15.2:0/1653164770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de256ee5d0 0x55de257056c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:48.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.573+0000 7fbf0ad9d640 1 --2- 172.21.15.2:0/1653164770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de256f9370 0x55de25770f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:48.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.574+0000 7fbf09d9b640 1 --2- 172.21.15.2:0/1653164770 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de256efb40 0x55de25705c00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbef4007710 tx=0x7fbef40136b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2831eeb82b97d5b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:48.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.574+0000 7fbef1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-19T06:21:48.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.574+0000 7fbef1ffb640 1 -- 172.21.15.2:0/1653164770 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef4013ae0 con 0x55de256efb40 2024-09-19T06:21:48.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.574+0000 7fbf132b7740 1 -- 172.21.15.2:0/1653164770 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbef4018040 con 0x55de256efb40 2024-09-19T06:21:48.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.574+0000 7fbef1ffb640 1 -- 172.21.15.2:0/1653164770 <== mon.1 v2:172.21.15.90:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7fbef4028480 con 0x55de256efb40 2024-09-19T06:21:48.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.574+0000 7fbef1ffb640 1 -- 172.21.15.2:0/1653164770 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fbef4028680 con 0x55de256efb40 2024-09-19T06:21:48.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.574+0000 7fbf132b7740 10 client.26752 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:48.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.574+0000 7fbf132b7740 1 -- 172.21.15.2:0/1653164770 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55de25778980 con 0x55de256efb40 2024-09-19T06:21:48.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.574+0000 7fbef1ffb640 1 -- 172.21.15.2:0/1653164770 <== mon.1 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbef4018040 con 0x55de256efb40 2024-09-19T06:21:48.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.574+0000 7fbef1ffb640 1 -- 172.21.15.2:0/1653164770 <== mon.1 v2:172.21.15.90:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fbef403c7e0 con 0x55de256efb40 2024-09-19T06:21:48.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.574+0000 7fbf132b7740 10 client.26752 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:48.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.574+0000 7fbf132b7740 10 client.26752 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:21:48.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.574+0000 7fbf132b7740 20 client.26752 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:48.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.574+0000 7fbf132b7740 1 --2- 172.21.15.2:0/1653164770 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55de25778e00 0x55de2577b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:48.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.574+0000 7fbf132b7740 4 client.26752 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:21:48.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.574+0000 7fbf132b7740 1 -- 172.21.15.2:0/1653164770 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55de2565bd70 con 0x55de25778e00 2024-09-19T06:21:48.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.575+0000 7fbf0a59c640 1 --2- 172.21.15.2:0/1653164770 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55de25778e00 0x55de2577b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:48.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.575+0000 7fbef1ffb640 10 client.26752 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:21:48.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.575+0000 7fbf0a59c640 1 --2- 172.21.15.2:0/1653164770 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55de25778e00 0x55de2577b220 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d7223cb4b4f9987c server_cookie=5665eacf209f2c0e in_seq=0 out_seq=0 2024-09-19T06:21:48.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.575+0000 7fbef1ffb640 1 -- 172.21.15.2:0/1653164770 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55de2565bd70 con 0x55de25778e00 2024-09-19T06:21:48.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.575+0000 7fbef1ffb640 10 client.26752 handle_command_reply: tid=0 2024-09-19T06:21:48.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.575+0000 7fbf132b7740 1 client.26752 shutdown 2024-09-19T06:21:48.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.575+0000 7fbf132b7740 1 -- 172.21.15.2:0/1653164770 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de256efb40 msgr2=0x55de25705c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:48.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.575+0000 7fbf132b7740 1 --2- 172.21.15.2:0/1653164770 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de256efb40 0x55de25705c00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbef4007710 tx=0x7fbef40136b0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.575+0000 7fbf132b7740 1 -- 172.21.15.2:0/1653164770 shutdown_connections 2024-09-19T06:21:48.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.575+0000 7fbf132b7740 1 --2- 172.21.15.2:0/1653164770 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55de25778e00 0x55de2577b220 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.575+0000 7fbf132b7740 1 --2- 172.21.15.2:0/1653164770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55de256f9370 0x55de25770f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.575+0000 7fbf132b7740 1 --2- 172.21.15.2:0/1653164770 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55de256efb40 0x55de25705c00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.575+0000 7fbf132b7740 1 --2- 172.21.15.2:0/1653164770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de256ee5d0 0x55de257056c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.575+0000 7fbf132b7740 1 -- 172.21.15.2:0/1653164770 >> 172.21.15.2:0/1653164770 conn(0x55de256b7310 msgr2=0x55de256e9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:48.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.575+0000 7fbef1ffb640 0 client.26752 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:21:48.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.575+0000 7fbf132b7740 1 -- 172.21.15.2:0/1653164770 shutdown_connections 2024-09-19T06:21:48.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.576+0000 7fbf132b7740 1 -- 172.21.15.2:0/1653164770 wait complete. 2024-09-19T06:21:48.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.576+0000 7fbf132b7740 20 client.26752 trim_cache size 0 max 16384 2024-09-19T06:21:48.583 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:21:48.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.576+0000 7fbf10ede640 1 -- 172.21.15.2:0/568586574 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fbef80a33b0 msgr2=0x7fbef80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:48.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.576+0000 7fbf10ede640 1 --2- 172.21.15.2:0/568586574 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fbef80a33b0 0x7fbef80a5870 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbf04005fe0 tx=0x7fbf04005c50 comp rx=0 tx=0).stop 2024-09-19T06:21:48.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.576+0000 7fbf10ede640 1 -- 172.21.15.2:0/568586574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf0c102d40 msgr2=0x7fbf0c198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:48.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.576+0000 7fbf10ede640 1 --2- 172.21.15.2:0/568586574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf0c102d40 0x7fbf0c198380 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fbefc00c890 tx=0x7fbefc00cd50 comp rx=0 tx=0).stop 2024-09-19T06:21:48.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.576+0000 7fbf10ede640 1 -- 172.21.15.2:0/568586574 shutdown_connections 2024-09-19T06:21:48.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.576+0000 7fbf10ede640 1 --2- 172.21.15.2:0/568586574 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fbef80a33b0 0x7fbef80a5870 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.576+0000 7fbf10ede640 1 --2- 172.21.15.2:0/568586574 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf0c10c170 0x7fbf0c19cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.576+0000 7fbf10ede640 1 --2- 172.21.15.2:0/568586574 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf0c103660 0x7fbf0c1988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.576+0000 7fbf10ede640 1 --2- 172.21.15.2:0/568586574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf0c102d40 0x7fbf0c198380 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.576+0000 7fbf10ede640 1 -- 172.21.15.2:0/568586574 >> 172.21.15.2:0/568586574 conn(0x7fbf0c0fc7a0 msgr2=0x7fbf0c0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:48.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.576+0000 7fbf10ede640 1 -- 172.21.15.2:0/568586574 shutdown_connections 2024-09-19T06:21:48.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:48.576+0000 7fbf10ede640 1 -- 172.21.15.2:0/568586574 wait complete. 2024-09-19T06:21:49.315 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:21:49.573 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:49.695 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:49 smithi002 ceph-mon[30982]: pgmap v215: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:21:49.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:49 smithi090 ceph-mon[34497]: pgmap v215: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:21:49.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:49 smithi089 ceph-mon[34160]: pgmap v215: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:21:50.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.012+0000 7f55503c9640 1 -- 172.21.15.2:0/510884910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5548106f10 msgr2=0x7f554810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:50.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.012+0000 7f55503c9640 1 --2- 172.21.15.2:0/510884910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5548106f10 0x7f554810ea90 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f5540009ca0 tx=0x7f554002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.013+0000 7f55503c9640 1 -- 172.21.15.2:0/510884910 shutdown_connections 2024-09-19T06:21:50.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.013+0000 7f55503c9640 1 --2- 172.21.15.2:0/510884910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5548106f10 0x7f554810ea90 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.013+0000 7f55503c9640 1 --2- 172.21.15.2:0/510884910 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5548102790 0x7f55481067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.013+0000 7f55503c9640 1 --2- 172.21.15.2:0/510884910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5548101de0 0x7f55481021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.013+0000 7f55503c9640 1 -- 172.21.15.2:0/510884910 >> 172.21.15.2:0/510884910 conn(0x7f55480fd8c0 msgr2=0x7f55480ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:50.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.013+0000 7f55503c9640 1 -- 172.21.15.2:0/510884910 shutdown_connections 2024-09-19T06:21:50.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.013+0000 7f55503c9640 1 -- 172.21.15.2:0/510884910 wait complete. 2024-09-19T06:21:50.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.013+0000 7f55503c9640 1 Processor -- start 2024-09-19T06:21:50.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.013+0000 7f55503c9640 1 -- start start 2024-09-19T06:21:50.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.014+0000 7f55503c9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5548101de0 0x7f5548198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:50.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.014+0000 7f55503c9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5548102790 0x7f5548198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:50.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.014+0000 7f55503c9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5548106f10 0x7f554819cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:50.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.014+0000 7f55503c9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5548111e20 con 0x7f5548106f10 2024-09-19T06:21:50.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.014+0000 7f55503c9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f5548111ca0 con 0x7f5548102790 2024-09-19T06:21:50.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.014+0000 7f55503c9640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5548111fa0 con 0x7f5548101de0 2024-09-19T06:21:50.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.014+0000 7f554e966640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5548106f10 0x7f554819cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:50.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.014+0000 7f554e966640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5548106f10 0x7f554819cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46288/0 (socket says 172.21.15.2:46288) 2024-09-19T06:21:50.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.014+0000 7f554e966640 1 -- 172.21.15.2:0/3202968906 learned_addr learned my addr 172.21.15.2:0/3202968906 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:50.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.014+0000 7f554d964640 1 --2- 172.21.15.2:0/3202968906 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5548102790 0x7f5548198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:50.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.014+0000 7f554e165640 1 --2- 172.21.15.2:0/3202968906 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5548101de0 0x7f5548198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:50.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.014+0000 7f554e966640 1 -- 172.21.15.2:0/3202968906 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5548101de0 msgr2=0x7f5548198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:50.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.014+0000 7f554e966640 1 --2- 172.21.15.2:0/3202968906 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5548101de0 0x7f5548198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.014+0000 7f554e966640 1 -- 172.21.15.2:0/3202968906 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5548102790 msgr2=0x7f5548198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:50.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.014+0000 7f554e966640 1 --2- 172.21.15.2:0/3202968906 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5548102790 0x7f5548198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.014+0000 7f554e966640 1 -- 172.21.15.2:0/3202968906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f554819d2f0 con 0x7f5548106f10 2024-09-19T06:21:50.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.014+0000 7f554e966640 1 --2- 172.21.15.2:0/3202968906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5548106f10 0x7f554819cc10 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f5540009dc0 tx=0x7f5540032ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:50.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.015+0000 7f553f7fe640 1 -- 172.21.15.2:0/3202968906 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5540003cf0 con 0x7f5548106f10 2024-09-19T06:21:50.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.015+0000 7f553f7fe640 1 -- 172.21.15.2:0/3202968906 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f55400044f0 con 0x7f5548106f10 2024-09-19T06:21:50.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.015+0000 7f55503c9640 1 -- 172.21.15.2:0/3202968906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f554819d580 con 0x7f5548106f10 2024-09-19T06:21:50.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.015+0000 7f553f7fe640 1 -- 172.21.15.2:0/3202968906 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5540030bf0 con 0x7f5548106f10 2024-09-19T06:21:50.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.015+0000 7f55503c9640 1 -- 172.21.15.2:0/3202968906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55481a4ec0 con 0x7f5548106f10 2024-09-19T06:21:50.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.017+0000 7f553f7fe640 1 -- 172.21.15.2:0/3202968906 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f5540004040 con 0x7f5548106f10 2024-09-19T06:21:50.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.017+0000 7f55527a2740 1 Processor -- start 2024-09-19T06:21:50.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.018+0000 7f55527a2740 1 -- start start 2024-09-19T06:21:50.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.018+0000 7f55527a2740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559de1a68b40 0x559de1a67090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:50.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.018+0000 7f55527a2740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559de1a675d0 0x559de1a67a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:50.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.018+0000 7f55527a2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559de1a76780 0x559de1a78b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:50.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.018+0000 7f55527a2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559de19cd2f0 con 0x559de1a76780 2024-09-19T06:21:50.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.018+0000 7f55527a2740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x559de1974cf0 con 0x559de1a675d0 2024-09-19T06:21:50.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.018+0000 7f55527a2740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x559de19c92b0 con 0x559de1a68b40 2024-09-19T06:21:50.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.018+0000 7f553f7fe640 1 --2- 172.21.15.2:0/3202968906 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f55340a3430 0x7f55340a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:50.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.018+0000 7f554d964640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559de1a76780 0x559de1a78b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:50.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.018+0000 7f554d964640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559de1a76780 0x559de1a78b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46294/0 (socket says 172.21.15.2:46294) 2024-09-19T06:21:50.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.018+0000 7f554d964640 1 -- 172.21.15.2:0/2742781014 learned_addr learned my addr 172.21.15.2:0/2742781014 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:50.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.018+0000 7f554e966640 1 --2- 172.21.15.2:0/3202968906 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f55340a3430 0x7f55340a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:50.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.018+0000 7f554e165640 1 --2- 172.21.15.2:0/2742781014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559de1a675d0 0x559de1a67a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:50.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.018+0000 7f554d964640 1 --2- 172.21.15.2:0/2742781014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559de1a68b40 0x559de1a67090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:50.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.018+0000 7f554d964640 1 -- 172.21.15.2:0/2742781014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559de1a68b40 msgr2=0x559de1a67090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:50.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.018+0000 7f554d964640 1 --2- 172.21.15.2:0/2742781014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559de1a68b40 0x559de1a67090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.018+0000 7f553f7fe640 1 -- 172.21.15.2:0/3202968906 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f55400f11a0 con 0x7f5548106f10 2024-09-19T06:21:50.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.018+0000 7f554d964640 1 -- 172.21.15.2:0/2742781014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559de1a675d0 msgr2=0x559de1a67a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:50.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.018+0000 7f554d964640 1 --2- 172.21.15.2:0/2742781014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559de1a675d0 0x559de1a67a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.018+0000 7f554d964640 1 -- 172.21.15.2:0/2742781014 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559de19593a0 con 0x559de1a76780 2024-09-19T06:21:50.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.018+0000 7f554e165640 1 --2- 172.21.15.2:0/2742781014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559de1a675d0 0x559de1a67a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:50.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.019+0000 7f554d964640 1 --2- 172.21.15.2:0/2742781014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559de1a76780 0x559de1a78b70 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f553800bf90 tx=0x7f553800b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ce56dbc817af658 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:50.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.019+0000 7f554e966640 1 --2- 172.21.15.2:0/3202968906 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f55340a3430 0x7f55340a58f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f55400b9990 tx=0x7f55400883c0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:50.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.019+0000 7f553cdea640 1 -- 172.21.15.2:0/2742781014 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5538004300 con 0x559de1a76780 2024-09-19T06:21:50.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.019+0000 7f553cdea640 1 -- 172.21.15.2:0/2742781014 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f55380044a0 con 0x559de1a76780 2024-09-19T06:21:50.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.019+0000 7f553cdea640 1 -- 172.21.15.2:0/2742781014 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55380035f0 con 0x559de1a76780 2024-09-19T06:21:50.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.020+0000 7f55527a2740 1 -- 172.21.15.2:0/2742781014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559de1a76780 msgr2=0x559de1a78b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:50.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.020+0000 7f55527a2740 1 --2- 172.21.15.2:0/2742781014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559de1a76780 0x559de1a78b70 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f553800bf90 tx=0x7f553800b790 comp rx=0 tx=0).stop 2024-09-19T06:21:50.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.020+0000 7f55527a2740 1 -- 172.21.15.2:0/2742781014 shutdown_connections 2024-09-19T06:21:50.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.020+0000 7f55527a2740 1 --2- 172.21.15.2:0/2742781014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559de1a76780 0x559de1a78b70 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.020+0000 7f55527a2740 1 --2- 172.21.15.2:0/2742781014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559de1a675d0 0x559de1a67a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.020+0000 7f55527a2740 1 --2- 172.21.15.2:0/2742781014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559de1a68b40 0x559de1a67090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.020+0000 7f55527a2740 1 -- 172.21.15.2:0/2742781014 >> 172.21.15.2:0/2742781014 conn(0x559de1a30310 msgr2=0x559de1a63c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:50.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.020+0000 7f55527a2740 1 -- 172.21.15.2:0/2742781014 shutdown_connections 2024-09-19T06:21:50.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.020+0000 7f55527a2740 1 -- 172.21.15.2:0/2742781014 wait complete. 2024-09-19T06:21:50.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.021+0000 7f55527a2740 1 -- start start 2024-09-19T06:21:50.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.021+0000 7f55527a2740 1 Processor -- start 2024-09-19T06:21:50.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.021+0000 7f55527a2740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559de1a675d0 0x559de1a76190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:50.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.021+0000 7f55527a2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559de1a68b40 0x559de1a73440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:50.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.021+0000 7f55527a2740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559de1a76780 0x559de1a73a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:50.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.021+0000 7f55527a2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559de1a79480 con 0x559de1a68b40 2024-09-19T06:21:50.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.021+0000 7f55527a2740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x559de1988060 con 0x559de1a675d0 2024-09-19T06:21:50.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.021+0000 7f55527a2740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x559de1a79600 con 0x559de1a76780 2024-09-19T06:21:50.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.021+0000 7f55527a2740 10 client.0 _ll_register_callbacks cb 0x559de16db8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:50.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.021+0000 7f554e165640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559de1a68b40 0x559de1a73440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:50.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.021+0000 7f554e165640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559de1a68b40 0x559de1a73440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46306/0 (socket says 172.21.15.2:46306) 2024-09-19T06:21:50.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.021+0000 7f554e165640 1 -- 172.21.15.2:0/558899816 learned_addr learned my addr 172.21.15.2:0/558899816 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:50.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.021+0000 7f554d964640 1 --2- 172.21.15.2:0/558899816 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559de1a76780 0x559de1a73a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:50.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.021+0000 7f554d964640 1 --2- 172.21.15.2:0/558899816 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559de1a675d0 0x559de1a76190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:50.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.021+0000 7f554e165640 1 -- 172.21.15.2:0/558899816 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559de1a76780 msgr2=0x559de1a73a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:50.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.021+0000 7f554e165640 1 --2- 172.21.15.2:0/558899816 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559de1a76780 0x559de1a73a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.021+0000 7f554e165640 1 -- 172.21.15.2:0/558899816 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559de1a675d0 msgr2=0x559de1a76190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:50.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.021+0000 7f554e165640 1 --2- 172.21.15.2:0/558899816 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559de1a675d0 0x559de1a76190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.021+0000 7f554e165640 1 -- 172.21.15.2:0/558899816 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559de173e3c0 con 0x559de1a68b40 2024-09-19T06:21:50.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.021+0000 7f554d964640 1 --2- 172.21.15.2:0/558899816 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559de1a675d0 0x559de1a76190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:21:50.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.022+0000 7f554e165640 1 --2- 172.21.15.2:0/558899816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559de1a68b40 0x559de1a73440 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f554400baa0 tx=0x7f554400bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=865013b84d3f3080 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:50.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.022+0000 7f5531ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:50.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.022+0000 7f5531ffb640 1 -- 172.21.15.2:0/558899816 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554401b640 con 0x559de1a68b40 2024-09-19T06:21:50.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.022+0000 7f5531ffb640 1 -- 172.21.15.2:0/558899816 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f5544011440 con 0x559de1a68b40 2024-09-19T06:21:50.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.022+0000 7f55527a2740 1 -- 172.21.15.2:0/558899816 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559de19da860 con 0x559de1a68b40 2024-09-19T06:21:50.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.022+0000 7f5531ffb640 1 -- 172.21.15.2:0/558899816 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f554401b7e0 con 0x559de1a68b40 2024-09-19T06:21:50.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.022+0000 7f55527a2740 10 client.17637 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:50.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.022+0000 7f55527a2740 1 -- 172.21.15.2:0/558899816 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x559de1a84fb0 con 0x559de1a68b40 2024-09-19T06:21:50.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.022+0000 7f5531ffb640 1 -- 172.21.15.2:0/558899816 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x559de19da860 con 0x559de1a68b40 2024-09-19T06:21:50.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.022+0000 7f5531ffb640 1 -- 172.21.15.2:0/558899816 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f5544019020 con 0x559de1a68b40 2024-09-19T06:21:50.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.022+0000 7f55527a2740 10 client.17637 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:50.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.022+0000 7f55527a2740 10 client.17637 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:50.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.023+0000 7f55527a2740 20 client.17637 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:50.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.023+0000 7f55527a2740 1 --2- 172.21.15.2:0/558899816 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x559de1a86460 0x559de1a88850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:50.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.023+0000 7f55527a2740 4 client.17637 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:50.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.023+0000 7f55527a2740 1 -- 172.21.15.2:0/558899816 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559de19d4d70 con 0x559de1a86460 2024-09-19T06:21:50.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.023+0000 7f554d964640 1 --2- 172.21.15.2:0/558899816 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x559de1a86460 0x559de1a88850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:50.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.023+0000 7f554d964640 1 --2- 172.21.15.2:0/558899816 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x559de1a86460 0x559de1a88850 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=761ea5de53be8f39 server_cookie=1f09d8a402b4ece5 in_seq=0 out_seq=0 2024-09-19T06:21:50.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.023+0000 7f5531ffb640 10 client.17637 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:50.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.024+0000 7f5531ffb640 1 -- 172.21.15.2:0/558899816 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559de19d4d70 con 0x559de1a86460 2024-09-19T06:21:50.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.024+0000 7f5531ffb640 10 client.17637 handle_command_reply: tid=0 2024-09-19T06:21:50.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.024+0000 7f55527a2740 1 client.17637 shutdown 2024-09-19T06:21:50.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.024+0000 7f55527a2740 1 -- 172.21.15.2:0/558899816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559de1a68b40 msgr2=0x559de1a73440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:50.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.024+0000 7f55527a2740 1 --2- 172.21.15.2:0/558899816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559de1a68b40 0x559de1a73440 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f554400baa0 tx=0x7f554400bf60 comp rx=0 tx=0).stop 2024-09-19T06:21:50.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.024+0000 7f55527a2740 1 -- 172.21.15.2:0/558899816 shutdown_connections 2024-09-19T06:21:50.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.024+0000 7f55527a2740 1 --2- 172.21.15.2:0/558899816 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559de1a76780 0x559de1a73a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.024+0000 7f55527a2740 1 --2- 172.21.15.2:0/558899816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559de1a68b40 0x559de1a73440 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.024+0000 7f55527a2740 1 --2- 172.21.15.2:0/558899816 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x559de1a86460 0x559de1a88850 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.024+0000 7f55527a2740 1 --2- 172.21.15.2:0/558899816 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559de1a675d0 0x559de1a76190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.024+0000 7f55527a2740 1 -- 172.21.15.2:0/558899816 >> 172.21.15.2:0/558899816 conn(0x559de1a30310 msgr2=0x559de1a69960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:50.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.024+0000 7f5531ffb640 0 client.17637 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:50.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.024+0000 7f55527a2740 1 -- 172.21.15.2:0/558899816 shutdown_connections 2024-09-19T06:21:50.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.024+0000 7f55527a2740 1 -- 172.21.15.2:0/558899816 wait complete. 2024-09-19T06:21:50.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.025+0000 7f55527a2740 20 client.17637 trim_cache size 0 max 16384 2024-09-19T06:21:50.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.037+0000 7f55527a2740 1 Processor -- start 2024-09-19T06:21:50.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.037+0000 7f55527a2740 1 -- start start 2024-09-19T06:21:50.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.038+0000 7f55527a2740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559de1a675d0 0x559de1a82720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:50.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.038+0000 7f55527a2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559de1a68b40 0x559de1a753b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:50.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.038+0000 7f55527a2740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559de1a76780 0x559de1a8e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:50.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.038+0000 7f55527a2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f55481ade40 con 0x559de1a68b40 2024-09-19T06:21:50.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.038+0000 7f55527a2740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f55481ab710 con 0x559de1a675d0 2024-09-19T06:21:50.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.038+0000 7f55527a2740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f55481a9580 con 0x559de1a76780 2024-09-19T06:21:50.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.038+0000 7f554e165640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559de1a68b40 0x559de1a753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:50.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.038+0000 7f554e165640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559de1a68b40 0x559de1a753b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46320/0 (socket says 172.21.15.2:46320) 2024-09-19T06:21:50.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.038+0000 7f554e165640 1 -- 172.21.15.2:0/1691829422 learned_addr learned my addr 172.21.15.2:0/1691829422 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:50.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.038+0000 7f554d964640 1 --2- 172.21.15.2:0/1691829422 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559de1a675d0 0x559de1a82720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:50.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.038+0000 7f554d964640 1 --2- 172.21.15.2:0/1691829422 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559de1a76780 0x559de1a8e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:50.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.038+0000 7f554e165640 1 -- 172.21.15.2:0/1691829422 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559de1a76780 msgr2=0x559de1a8e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:50.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.038+0000 7f554e165640 1 --2- 172.21.15.2:0/1691829422 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559de1a76780 0x559de1a8e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.038+0000 7f554e165640 1 -- 172.21.15.2:0/1691829422 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559de1a675d0 msgr2=0x559de1a82720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:50.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.038+0000 7f554e165640 1 --2- 172.21.15.2:0/1691829422 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559de1a675d0 0x559de1a82720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.038+0000 7f554e165640 1 -- 172.21.15.2:0/1691829422 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559de1a672d0 con 0x559de1a68b40 2024-09-19T06:21:50.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.038+0000 7f554d964640 1 --2- 172.21.15.2:0/1691829422 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559de1a675d0 0x559de1a82720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:50.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.038+0000 7f554e165640 1 --2- 172.21.15.2:0/1691829422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559de1a68b40 0x559de1a753b0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f5544000c00 tx=0x7f55440039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=752acb1cc4504dd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:50.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.038+0000 7f5533fff640 1 -- 172.21.15.2:0/1691829422 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5544005850 con 0x559de1a68b40 2024-09-19T06:21:50.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.038+0000 7f5533fff640 1 -- 172.21.15.2:0/1691829422 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f554401be30 con 0x559de1a68b40 2024-09-19T06:21:50.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.039+0000 7f5533fff640 1 -- 172.21.15.2:0/1691829422 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5544011440 con 0x559de1a68b40 2024-09-19T06:21:50.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.039+0000 7f55527a2740 1 -- 172.21.15.2:0/1691829422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559de1a68b40 msgr2=0x559de1a753b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:50.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.039+0000 7f55527a2740 1 --2- 172.21.15.2:0/1691829422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559de1a68b40 0x559de1a753b0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f5544000c00 tx=0x7f55440039c0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.039+0000 7f55527a2740 1 -- 172.21.15.2:0/1691829422 shutdown_connections 2024-09-19T06:21:50.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.039+0000 7f55527a2740 1 --2- 172.21.15.2:0/1691829422 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559de1a76780 0x559de1a8e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.039+0000 7f55527a2740 1 --2- 172.21.15.2:0/1691829422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559de1a68b40 0x559de1a753b0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.039+0000 7f55527a2740 1 --2- 172.21.15.2:0/1691829422 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559de1a675d0 0x559de1a82720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.039+0000 7f55527a2740 1 -- 172.21.15.2:0/1691829422 >> 172.21.15.2:0/1691829422 conn(0x559de1a30310 msgr2=0x559de1a74ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:50.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.039+0000 7f55527a2740 1 -- 172.21.15.2:0/1691829422 shutdown_connections 2024-09-19T06:21:50.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.039+0000 7f55527a2740 1 -- 172.21.15.2:0/1691829422 wait complete. 2024-09-19T06:21:50.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.039+0000 7f55527a2740 1 -- start start 2024-09-19T06:21:50.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.040+0000 7f55527a2740 1 Processor -- start 2024-09-19T06:21:50.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.040+0000 7f55527a2740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559de1a675d0 0x559de1a7f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:50.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.040+0000 7f55527a2740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559de1a68b40 0x559de1a703c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:50.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.040+0000 7f55527a2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559de1a76780 0x559de1a70b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:50.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.040+0000 7f55527a2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f55481a9bd0 con 0x559de1a76780 2024-09-19T06:21:50.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.040+0000 7f55527a2740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f55481ab040 con 0x559de1a68b40 2024-09-19T06:21:50.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.040+0000 7f55527a2740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f55481aa2a0 con 0x559de1a675d0 2024-09-19T06:21:50.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.040+0000 7f55527a2740 10 client.0 _ll_register_callbacks cb 0x7f5544004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:50.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.040+0000 7f554d964640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559de1a76780 0x559de1a70b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:50.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.040+0000 7f554d964640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559de1a76780 0x559de1a70b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46326/0 (socket says 172.21.15.2:46326) 2024-09-19T06:21:50.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.040+0000 7f554d964640 1 -- 172.21.15.2:0/1570498239 learned_addr learned my addr 172.21.15.2:0/1570498239 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:50.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.040+0000 7f554d964640 1 --2- 172.21.15.2:0/1570498239 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559de1a675d0 0x559de1a7f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:50.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.040+0000 7f554e165640 1 --2- 172.21.15.2:0/1570498239 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559de1a68b40 0x559de1a703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:50.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.040+0000 7f554d964640 1 -- 172.21.15.2:0/1570498239 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559de1a675d0 msgr2=0x559de1a7f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:50.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.040+0000 7f554d964640 1 --2- 172.21.15.2:0/1570498239 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559de1a675d0 0x559de1a7f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.040+0000 7f554d964640 1 -- 172.21.15.2:0/1570498239 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559de1a68b40 msgr2=0x559de1a703c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:50.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.040+0000 7f554d964640 1 --2- 172.21.15.2:0/1570498239 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559de1a68b40 0x559de1a703c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.040+0000 7f554d964640 1 -- 172.21.15.2:0/1570498239 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559de1a64960 con 0x559de1a76780 2024-09-19T06:21:50.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.040+0000 7f554e165640 1 --2- 172.21.15.2:0/1570498239 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559de1a68b40 0x559de1a703c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:21:50.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.041+0000 7f554d964640 1 --2- 172.21.15.2:0/1570498239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559de1a76780 0x559de1a70b50 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f5538012e30 tx=0x7f553800b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa56395e7c4bc3bc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:50.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.041+0000 7f5531ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:50.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.041+0000 7f5531ffb640 1 -- 172.21.15.2:0/1570498239 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5538030020 con 0x559de1a76780 2024-09-19T06:21:50.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.041+0000 7f5531ffb640 1 -- 172.21.15.2:0/1570498239 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f5538003bc0 con 0x559de1a76780 2024-09-19T06:21:50.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.041+0000 7f55527a2740 1 -- 172.21.15.2:0/1570498239 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f554401be30 con 0x559de1a76780 2024-09-19T06:21:50.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.041+0000 7f5531ffb640 1 -- 172.21.15.2:0/1570498239 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f553803b050 con 0x559de1a76780 2024-09-19T06:21:50.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.041+0000 7f55527a2740 10 client.17643 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:50.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.041+0000 7f55527a2740 1 -- 172.21.15.2:0/1570498239 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x559de1af10d0 con 0x559de1a76780 2024-09-19T06:21:50.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.041+0000 7f5531ffb640 1 -- 172.21.15.2:0/1570498239 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f554401be30 con 0x559de1a76780 2024-09-19T06:21:50.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.041+0000 7f5531ffb640 1 -- 172.21.15.2:0/1570498239 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f553801c020 con 0x559de1a76780 2024-09-19T06:21:50.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.041+0000 7f55527a2740 10 client.17643 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:50.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.041+0000 7f55527a2740 10 client.17643 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:50.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.041+0000 7f55527a2740 20 client.17643 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:50.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.041+0000 7f55527a2740 1 --2- 172.21.15.2:0/1570498239 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x559de1af1710 0x559de1af3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:50.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.041+0000 7f55527a2740 4 client.17643 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:21:50.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.041+0000 7f55527a2740 1 -- 172.21.15.2:0/1570498239 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559de1951170 con 0x559de1af1710 2024-09-19T06:21:50.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.042+0000 7f554e165640 1 --2- 172.21.15.2:0/1570498239 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x559de1af1710 0x559de1af3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:50.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.042+0000 7f554e165640 1 --2- 172.21.15.2:0/1570498239 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x559de1af1710 0x559de1af3b30 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6dcc116f29ea8ff4 server_cookie=51f295e6d2d5e46e in_seq=0 out_seq=0 2024-09-19T06:21:50.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.042+0000 7f5531ffb640 10 client.17643 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:50.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.042+0000 7f5531ffb640 1 -- 172.21.15.2:0/1570498239 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559de1951170 con 0x559de1af1710 2024-09-19T06:21:50.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.042+0000 7f5531ffb640 10 client.17643 handle_command_reply: tid=0 2024-09-19T06:21:50.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.042+0000 7f55527a2740 1 client.17643 shutdown 2024-09-19T06:21:50.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.043+0000 7f55527a2740 1 -- 172.21.15.2:0/1570498239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559de1a76780 msgr2=0x559de1a70b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:50.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.043+0000 7f55527a2740 1 --2- 172.21.15.2:0/1570498239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559de1a76780 0x559de1a70b50 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f5538012e30 tx=0x7f553800b790 comp rx=0 tx=0).stop 2024-09-19T06:21:50.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.043+0000 7f55527a2740 1 -- 172.21.15.2:0/1570498239 shutdown_connections 2024-09-19T06:21:50.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.043+0000 7f55527a2740 1 --2- 172.21.15.2:0/1570498239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559de1a76780 0x559de1a70b50 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.043+0000 7f55527a2740 1 --2- 172.21.15.2:0/1570498239 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x559de1af1710 0x559de1af3b30 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.043+0000 7f55527a2740 1 --2- 172.21.15.2:0/1570498239 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559de1a68b40 0x559de1a703c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.043+0000 7f55527a2740 1 --2- 172.21.15.2:0/1570498239 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559de1a675d0 0x559de1a7f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.043+0000 7f55527a2740 1 -- 172.21.15.2:0/1570498239 >> 172.21.15.2:0/1570498239 conn(0x559de1a30310 msgr2=0x559de1a754c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:50.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.043+0000 7f5531ffb640 0 client.17643 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:50.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.043+0000 7f55527a2740 1 -- 172.21.15.2:0/1570498239 shutdown_connections 2024-09-19T06:21:50.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.043+0000 7f55527a2740 1 -- 172.21.15.2:0/1570498239 wait complete. 2024-09-19T06:21:50.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.043+0000 7f55527a2740 20 client.17643 trim_cache size 0 max 16384 2024-09-19T06:21:50.054 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:21:50.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.043+0000 7f55503c9640 1 -- 172.21.15.2:0/3202968906 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f55340a3430 msgr2=0x7f55340a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:50.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.043+0000 7f55503c9640 1 --2- 172.21.15.2:0/3202968906 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f55340a3430 0x7f55340a58f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f55400b9990 tx=0x7f55400883c0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.043+0000 7f55503c9640 1 -- 172.21.15.2:0/3202968906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5548106f10 msgr2=0x7f554819cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:50.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.043+0000 7f55503c9640 1 --2- 172.21.15.2:0/3202968906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5548106f10 0x7f554819cc10 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f5540009dc0 tx=0x7f5540032ff0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.043+0000 7f55503c9640 1 -- 172.21.15.2:0/3202968906 shutdown_connections 2024-09-19T06:21:50.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.043+0000 7f55503c9640 1 --2- 172.21.15.2:0/3202968906 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f55340a3430 0x7f55340a58f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.043+0000 7f55503c9640 1 --2- 172.21.15.2:0/3202968906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5548106f10 0x7f554819cc10 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.043+0000 7f55503c9640 1 --2- 172.21.15.2:0/3202968906 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5548102790 0x7f5548198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.043+0000 7f55503c9640 1 --2- 172.21.15.2:0/3202968906 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5548101de0 0x7f5548198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.043+0000 7f55503c9640 1 -- 172.21.15.2:0/3202968906 >> 172.21.15.2:0/3202968906 conn(0x7f55480fd8c0 msgr2=0x7f55480fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:50.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.044+0000 7f55503c9640 1 -- 172.21.15.2:0/3202968906 shutdown_connections 2024-09-19T06:21:50.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:50.044+0000 7f55503c9640 1 -- 172.21.15.2:0/3202968906 wait complete. 2024-09-19T06:21:51.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:51 smithi002 ceph-mon[30982]: pgmap v216: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:21:51.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:51 smithi090 ceph-mon[34497]: pgmap v216: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:21:51.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:51 smithi089 ceph-mon[34160]: pgmap v216: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:21:51.839 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:21:51.840 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:21:52.109 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:52.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.555+0000 7f759da77640 1 -- 172.21.15.2:0/1973570083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f759810c170 msgr2=0x7f759810e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:52.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.555+0000 7f759da77640 1 --2- 172.21.15.2:0/1973570083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f759810c170 0x7f759810e600 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f7590009ca0 tx=0x7f759002a950 comp rx=0 tx=0).stop 2024-09-19T06:21:52.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.555+0000 7f759da77640 1 -- 172.21.15.2:0/1973570083 shutdown_connections 2024-09-19T06:21:52.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.555+0000 7f759da77640 1 --2- 172.21.15.2:0/1973570083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f759810c170 0x7f759810e600 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.555+0000 7f759da77640 1 --2- 172.21.15.2:0/1973570083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75981036f0 0x7f759810bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.555+0000 7f759da77640 1 --2- 172.21.15.2:0/1973570083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7598102dd0 0x7f75981031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.555+0000 7f759da77640 1 -- 172.21.15.2:0/1973570083 >> 172.21.15.2:0/1973570083 conn(0x7f75980fc790 msgr2=0x7f75980febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:52.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.555+0000 7f759da77640 1 -- 172.21.15.2:0/1973570083 shutdown_connections 2024-09-19T06:21:52.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.555+0000 7f759da77640 1 -- 172.21.15.2:0/1973570083 wait complete. 2024-09-19T06:21:52.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.556+0000 7f759da77640 1 Processor -- start 2024-09-19T06:21:52.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.556+0000 7f759da77640 1 -- start start 2024-09-19T06:21:52.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.556+0000 7f759da77640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7598102dd0 0x7f759819efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.556+0000 7f759da77640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75981036f0 0x7f759819f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.556+0000 7f759da77640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f759810c170 0x7f759810af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.556+0000 7f759da77640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7598111e10 con 0x7f759810c170 2024-09-19T06:21:52.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.556+0000 7f759da77640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7598111c90 con 0x7f75981036f0 2024-09-19T06:21:52.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.556+0000 7f759da77640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7598111f90 con 0x7f7598102dd0 2024-09-19T06:21:52.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.556+0000 7f7597fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f759810c170 0x7f759810af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.556+0000 7f7597fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f759810c170 0x7f759810af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46348/0 (socket says 172.21.15.2:46348) 2024-09-19T06:21:52.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.556+0000 7f7597fff640 1 -- 172.21.15.2:0/2470585918 learned_addr learned my addr 172.21.15.2:0/2470585918 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:52.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.556+0000 7f75977fe640 1 --2- 172.21.15.2:0/2470585918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7598102dd0 0x7f759819efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.557+0000 7f7596ffd640 1 --2- 172.21.15.2:0/2470585918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75981036f0 0x7f759819f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.557+0000 7f7597fff640 1 -- 172.21.15.2:0/2470585918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7598102dd0 msgr2=0x7f759819efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:52.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.557+0000 7f7597fff640 1 --2- 172.21.15.2:0/2470585918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7598102dd0 0x7f759819efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.557+0000 7f7597fff640 1 -- 172.21.15.2:0/2470585918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75981036f0 msgr2=0x7f759819f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:52.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.557+0000 7f7597fff640 1 --2- 172.21.15.2:0/2470585918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75981036f0 0x7f759819f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.557+0000 7f7597fff640 1 -- 172.21.15.2:0/2470585918 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f759810b830 con 0x7f759810c170 2024-09-19T06:21:52.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.557+0000 7f7596ffd640 1 --2- 172.21.15.2:0/2470585918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75981036f0 0x7f759819f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:52.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.557+0000 7f7597fff640 1 --2- 172.21.15.2:0/2470585918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f759810c170 0x7f759810af70 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f759002ae70 tx=0x7f759002f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:52.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.557+0000 7f7594ff9640 1 -- 172.21.15.2:0/2470585918 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7590034040 con 0x7f759810c170 2024-09-19T06:21:52.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.557+0000 7f7594ff9640 1 -- 172.21.15.2:0/2470585918 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f75900308f0 con 0x7f759810c170 2024-09-19T06:21:52.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.557+0000 7f759da77640 1 -- 172.21.15.2:0/2470585918 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f759810bac0 con 0x7f759810c170 2024-09-19T06:21:52.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.557+0000 7f7594ff9640 1 -- 172.21.15.2:0/2470585918 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75900047f0 con 0x7f759810c170 2024-09-19T06:21:52.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.557+0000 7f759da77640 1 -- 172.21.15.2:0/2470585918 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f759819ab20 con 0x7f759810c170 2024-09-19T06:21:52.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.560+0000 7f7594ff9640 1 -- 172.21.15.2:0/2470585918 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f7590037020 con 0x7f759810c170 2024-09-19T06:21:52.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.560+0000 7f759fe50740 1 Processor -- start 2024-09-19T06:21:52.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.560+0000 7f759fe50740 1 -- start start 2024-09-19T06:21:52.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.560+0000 7f759fe50740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c7561cb60 0x562c7561cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.560+0000 7f759fe50740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c7561d480 0x562c75627800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.560+0000 7f759fe50740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562c75627d40 0x562c7562a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.560+0000 7f759fe50740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562c75582280 con 0x562c7561d480 2024-09-19T06:21:52.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.560+0000 7f759fe50740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562c75529b10 con 0x562c7561cb60 2024-09-19T06:21:52.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.560+0000 7f759fe50740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562c7557e240 con 0x562c75627d40 2024-09-19T06:21:52.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.560+0000 7f75977fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c7561d480 0x562c75627800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.560+0000 7f75977fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c7561d480 0x562c75627800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46364/0 (socket says 172.21.15.2:46364) 2024-09-19T06:21:52.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.560+0000 7f75977fe640 1 -- 172.21.15.2:0/2469831188 learned_addr learned my addr 172.21.15.2:0/2469831188 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:52.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.560+0000 7f7596ffd640 1 --2- 172.21.15.2:0/2469831188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562c75627d40 0x562c7562a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.560+0000 7f7596ffd640 1 --2- 172.21.15.2:0/2469831188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c7561cb60 0x562c7561cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.560+0000 7f75977fe640 1 -- 172.21.15.2:0/2469831188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562c75627d40 msgr2=0x562c7562a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:52.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.560+0000 7f75977fe640 1 --2- 172.21.15.2:0/2469831188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562c75627d40 0x562c7562a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.560+0000 7f75977fe640 1 -- 172.21.15.2:0/2469831188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c7561cb60 msgr2=0x562c7561cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:52.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.560+0000 7f75977fe640 1 --2- 172.21.15.2:0/2469831188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c7561cb60 0x562c7561cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.560+0000 7f75977fe640 1 -- 172.21.15.2:0/2469831188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c755361f0 con 0x562c7561d480 2024-09-19T06:21:52.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.560+0000 7f7596ffd640 1 --2- 172.21.15.2:0/2469831188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562c75627d40 0x562c7562a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:52.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.561+0000 7f7594ff9640 1 --2- 172.21.15.2:0/2470585918 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f75800a33b0 0x7f75800a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.561+0000 7f75977fe640 1 --2- 172.21.15.2:0/2469831188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c7561d480 0x562c75627800 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f758800bd10 tx=0x7f75880107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11a486dc4a93aef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:52.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.561+0000 7f7594ff9640 1 -- 172.21.15.2:0/2470585918 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f75900f0bd0 con 0x7f759810c170 2024-09-19T06:21:52.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.561+0000 7f757dffb640 1 -- 172.21.15.2:0/2469831188 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7588004030 con 0x562c7561d480 2024-09-19T06:21:52.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.561+0000 7f757dffb640 1 -- 172.21.15.2:0/2469831188 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f75880035f0 con 0x562c7561d480 2024-09-19T06:21:52.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.561+0000 7f757dffb640 1 -- 172.21.15.2:0/2469831188 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75880117b0 con 0x562c7561d480 2024-09-19T06:21:52.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.561+0000 7f7596ffd640 1 --2- 172.21.15.2:0/2470585918 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f75800a33b0 0x7f75800a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.562+0000 7f7596ffd640 1 --2- 172.21.15.2:0/2470585918 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f75800a33b0 0x7f75800a5870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x562c7561a470 tx=0x7f758c005f90 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:52.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.562+0000 7f759fe50740 1 -- 172.21.15.2:0/2469831188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c7561d480 msgr2=0x562c75627800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:52.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.562+0000 7f759fe50740 1 --2- 172.21.15.2:0/2469831188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c7561d480 0x562c75627800 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f758800bd10 tx=0x7f75880107a0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.562+0000 7f759fe50740 1 -- 172.21.15.2:0/2469831188 shutdown_connections 2024-09-19T06:21:52.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.562+0000 7f759fe50740 1 --2- 172.21.15.2:0/2469831188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562c75627d40 0x562c7562a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.562+0000 7f759fe50740 1 --2- 172.21.15.2:0/2469831188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c7561d480 0x562c75627800 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.562+0000 7f759fe50740 1 --2- 172.21.15.2:0/2469831188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c7561cb60 0x562c7561cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.562+0000 7f759fe50740 1 -- 172.21.15.2:0/2469831188 >> 172.21.15.2:0/2469831188 conn(0x562c756190f0 msgr2=0x562c756194d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:52.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.562+0000 7f759fe50740 1 -- 172.21.15.2:0/2469831188 shutdown_connections 2024-09-19T06:21:52.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.562+0000 7f759fe50740 1 -- 172.21.15.2:0/2469831188 wait complete. 2024-09-19T06:21:52.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.563+0000 7f759fe50740 1 -- start start 2024-09-19T06:21:52.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.563+0000 7f759fe50740 1 Processor -- start 2024-09-19T06:21:52.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.563+0000 7f759fe50740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562c7561cb60 0x562c75624c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.563+0000 7f759fe50740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c7561d480 0x562c756251c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.563+0000 7f759fe50740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c75627d40 0x562c75625700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.563+0000 7f759fe50740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562c7562a910 con 0x562c7561d480 2024-09-19T06:21:52.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.563+0000 7f759fe50740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562c7553cf10 con 0x562c75627d40 2024-09-19T06:21:52.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.563+0000 7f759fe50740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562c7562aa90 con 0x562c7561cb60 2024-09-19T06:21:52.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.563+0000 7f759fe50740 10 client.0 _ll_register_callbacks cb 0x562c75505a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:52.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.563+0000 7f7596ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c7561d480 0x562c756251c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.564+0000 7f7597fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c75627d40 0x562c75625700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.564+0000 7f75977fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562c7561cb60 0x562c75624c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.564+0000 7f7596ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c7561d480 0x562c756251c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46380/0 (socket says 172.21.15.2:46380) 2024-09-19T06:21:52.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.564+0000 7f7596ffd640 1 -- 172.21.15.2:0/53077257 learned_addr learned my addr 172.21.15.2:0/53077257 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:52.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.564+0000 7f75977fe640 1 -- 172.21.15.2:0/53077257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c75627d40 msgr2=0x562c75625700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:52.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.564+0000 7f75977fe640 1 --2- 172.21.15.2:0/53077257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c75627d40 0x562c75625700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.564+0000 7f75977fe640 1 -- 172.21.15.2:0/53077257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c7561d480 msgr2=0x562c756251c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:52.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.564+0000 7f75977fe640 1 --2- 172.21.15.2:0/53077257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c7561d480 0x562c756251c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.564+0000 7f75977fe640 1 -- 172.21.15.2:0/53077257 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c752f36a0 con 0x562c7561cb60 2024-09-19T06:21:52.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.564+0000 7f7596ffd640 1 --2- 172.21.15.2:0/53077257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c7561d480 0x562c756251c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:52.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.564+0000 7f75977fe640 1 --2- 172.21.15.2:0/53077257 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562c7561cb60 0x562c75624c80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7588000c00 tx=0x7f758800b950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f90810de1cfa8d66 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:52.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.564+0000 7f7576ffd640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-19T06:21:52.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.564+0000 7f7576ffd640 1 -- 172.21.15.2:0/53077257 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75880039b0 con 0x562c7561cb60 2024-09-19T06:21:52.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.564+0000 7f759fe50740 1 -- 172.21.15.2:0/53077257 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75880035f0 con 0x562c7561cb60 2024-09-19T06:21:52.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.564+0000 7f7576ffd640 1 -- 172.21.15.2:0/53077257 <== mon.1 v2:172.21.15.90:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f7588004000 con 0x562c7561cb60 2024-09-19T06:21:52.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.565+0000 7f7576ffd640 1 -- 172.21.15.2:0/53077257 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7588004200 con 0x562c7561cb60 2024-09-19T06:21:52.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.565+0000 7f759fe50740 10 client.26782 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:52.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.565+0000 7f759fe50740 1 -- 172.21.15.2:0/53077257 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562c756365a0 con 0x562c7561cb60 2024-09-19T06:21:52.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.565+0000 7f7576ffd640 1 -- 172.21.15.2:0/53077257 <== mon.1 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f75880035f0 con 0x562c7561cb60 2024-09-19T06:21:52.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.565+0000 7f7576ffd640 1 -- 172.21.15.2:0/53077257 <== mon.1 v2:172.21.15.90:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f75880048c0 con 0x562c7561cb60 2024-09-19T06:21:52.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.565+0000 7f759fe50740 10 client.26782 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:52.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.565+0000 7f759fe50740 10 client.26782 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:52.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.565+0000 7f759fe50740 20 client.26782 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:52.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.565+0000 7f759fe50740 1 --2- 172.21.15.2:0/53077257 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562c75637950 0x562c75639d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.565+0000 7f759fe50740 4 client.26782 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:52.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.565+0000 7f759fe50740 1 -- 172.21.15.2:0/53077257 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c7558f7f0 con 0x562c75637950 2024-09-19T06:21:52.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.566+0000 7f7596ffd640 1 --2- 172.21.15.2:0/53077257 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562c75637950 0x562c75639d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.566+0000 7f7576ffd640 10 client.26782 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:52.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.566+0000 7f7596ffd640 1 --2- 172.21.15.2:0/53077257 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562c75637950 0x562c75639d40 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6430fd9a07f0cb88 server_cookie=3ad4266a10fc1848 in_seq=0 out_seq=0 2024-09-19T06:21:52.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.567+0000 7f7576ffd640 1 -- 172.21.15.2:0/53077257 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562c7558f7f0 con 0x562c75637950 2024-09-19T06:21:52.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.567+0000 7f7576ffd640 10 client.26782 handle_command_reply: tid=0 2024-09-19T06:21:52.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.567+0000 7f759fe50740 1 client.26782 shutdown 2024-09-19T06:21:52.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.567+0000 7f759fe50740 1 -- 172.21.15.2:0/53077257 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562c7561cb60 msgr2=0x562c75624c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:52.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.567+0000 7f759fe50740 1 --2- 172.21.15.2:0/53077257 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562c7561cb60 0x562c75624c80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7588000c00 tx=0x7f758800b950 comp rx=0 tx=0).stop 2024-09-19T06:21:52.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.567+0000 7f759fe50740 1 -- 172.21.15.2:0/53077257 shutdown_connections 2024-09-19T06:21:52.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.567+0000 7f759fe50740 1 --2- 172.21.15.2:0/53077257 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562c75637950 0x562c75639d40 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.567+0000 7f759fe50740 1 --2- 172.21.15.2:0/53077257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c75627d40 0x562c75625700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.567+0000 7f7576ffd640 0 client.26782 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:52.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.567+0000 7f759fe50740 1 --2- 172.21.15.2:0/53077257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c7561d480 0x562c756251c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.567+0000 7f759fe50740 1 --2- 172.21.15.2:0/53077257 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562c7561cb60 0x562c75624c80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.567+0000 7f759fe50740 1 -- 172.21.15.2:0/53077257 >> 172.21.15.2:0/53077257 conn(0x562c756190f0 msgr2=0x562c75618270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:52.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.567+0000 7f759fe50740 1 -- 172.21.15.2:0/53077257 shutdown_connections 2024-09-19T06:21:52.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.567+0000 7f759fe50740 1 -- 172.21.15.2:0/53077257 wait complete. 2024-09-19T06:21:52.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.567+0000 7f759fe50740 20 client.26782 trim_cache size 0 max 16384 2024-09-19T06:21:52.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.586+0000 7f759fe50740 1 Processor -- start 2024-09-19T06:21:52.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.586+0000 7f759fe50740 1 -- start start 2024-09-19T06:21:52.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.586+0000 7f759fe50740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c7561cb60 0x562c75626ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.586+0000 7f759fe50740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562c7561d480 0x562c7563f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.587+0000 7f759fe50740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c75627d40 0x562c7563f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.587+0000 7f759fe50740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f75981bede0 con 0x562c7561cb60 2024-09-19T06:21:52.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.587+0000 7f759fe50740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f75981bc6b0 con 0x562c75627d40 2024-09-19T06:21:52.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.587+0000 7f759fe50740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f75981ba520 con 0x562c7561d480 2024-09-19T06:21:52.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.587+0000 7f75977fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c7561cb60 0x562c75626ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.587+0000 7f75977fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c7561cb60 0x562c75626ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46392/0 (socket says 172.21.15.2:46392) 2024-09-19T06:21:52.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.587+0000 7f75977fe640 1 -- 172.21.15.2:0/115629970 learned_addr learned my addr 172.21.15.2:0/115629970 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:52.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.587+0000 7f7596ffd640 1 --2- 172.21.15.2:0/115629970 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562c7561d480 0x562c7563f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.587+0000 7f7597fff640 1 --2- 172.21.15.2:0/115629970 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c75627d40 0x562c7563f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.587+0000 7f75977fe640 1 -- 172.21.15.2:0/115629970 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562c7561d480 msgr2=0x562c7563f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:52.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.587+0000 7f75977fe640 1 --2- 172.21.15.2:0/115629970 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562c7561d480 0x562c7563f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.587+0000 7f75977fe640 1 -- 172.21.15.2:0/115629970 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c75627d40 msgr2=0x562c7563f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:52.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.587+0000 7f75977fe640 1 --2- 172.21.15.2:0/115629970 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c75627d40 0x562c7563f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.587+0000 7f75977fe640 1 -- 172.21.15.2:0/115629970 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c7562a7f0 con 0x562c7561cb60 2024-09-19T06:21:52.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.587+0000 7f75977fe640 1 --2- 172.21.15.2:0/115629970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c7561cb60 0x562c75626ae0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f7588005d00 tx=0x7f75880107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=388e73d83e760365 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:52.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.587+0000 7f757d7fa640 1 -- 172.21.15.2:0/115629970 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75880039b0 con 0x562c7561cb60 2024-09-19T06:21:52.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.587+0000 7f757d7fa640 1 -- 172.21.15.2:0/115629970 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7588011440 con 0x562c7561cb60 2024-09-19T06:21:52.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.587+0000 7f757d7fa640 1 -- 172.21.15.2:0/115629970 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7588011740 con 0x562c7561cb60 2024-09-19T06:21:52.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.588+0000 7f759fe50740 1 -- 172.21.15.2:0/115629970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c7561cb60 msgr2=0x562c75626ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:52.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.588+0000 7f759fe50740 1 --2- 172.21.15.2:0/115629970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c7561cb60 0x562c75626ae0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f7588005d00 tx=0x7f75880107a0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.588+0000 7f759fe50740 1 -- 172.21.15.2:0/115629970 shutdown_connections 2024-09-19T06:21:52.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.588+0000 7f759fe50740 1 --2- 172.21.15.2:0/115629970 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c75627d40 0x562c7563f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.588+0000 7f759fe50740 1 --2- 172.21.15.2:0/115629970 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562c7561d480 0x562c7563f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.588+0000 7f759fe50740 1 --2- 172.21.15.2:0/115629970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c7561cb60 0x562c75626ae0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.588+0000 7f759fe50740 1 -- 172.21.15.2:0/115629970 >> 172.21.15.2:0/115629970 conn(0x562c756190f0 msgr2=0x562c756263d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:52.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.588+0000 7f759fe50740 1 -- 172.21.15.2:0/115629970 shutdown_connections 2024-09-19T06:21:52.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.588+0000 7f759fe50740 1 -- 172.21.15.2:0/115629970 wait complete. 2024-09-19T06:21:52.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.588+0000 7f759fe50740 1 -- start start 2024-09-19T06:21:52.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.589+0000 7f759fe50740 1 Processor -- start 2024-09-19T06:21:52.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.589+0000 7f759fe50740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c7561cb60 0x562c7562bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.589+0000 7f759fe50740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562c7561d480 0x562c7562c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.589+0000 7f759fe50740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c75627d40 0x562c7562c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.589+0000 7f759fe50740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f75981bab70 con 0x562c7561cb60 2024-09-19T06:21:52.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.589+0000 7f759fe50740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f75981bbfe0 con 0x562c75627d40 2024-09-19T06:21:52.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.589+0000 7f759fe50740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f75981bb240 con 0x562c7561d480 2024-09-19T06:21:52.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.589+0000 7f759fe50740 10 client.0 _ll_register_callbacks cb 0x7f758800bb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:52.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.589+0000 7f75977fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c7561cb60 0x562c7562bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.589+0000 7f75977fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c7561cb60 0x562c7562bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46396/0 (socket says 172.21.15.2:46396) 2024-09-19T06:21:52.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.589+0000 7f75977fe640 1 -- 172.21.15.2:0/340972120 learned_addr learned my addr 172.21.15.2:0/340972120 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:52.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.589+0000 7f7596ffd640 1 --2- 172.21.15.2:0/340972120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562c7561d480 0x562c7562c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.589+0000 7f7597fff640 1 --2- 172.21.15.2:0/340972120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c75627d40 0x562c7562c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.589+0000 7f75977fe640 1 -- 172.21.15.2:0/340972120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562c7561d480 msgr2=0x562c7562c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:52.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.589+0000 7f75977fe640 1 --2- 172.21.15.2:0/340972120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562c7561d480 0x562c7562c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.589+0000 7f75977fe640 1 -- 172.21.15.2:0/340972120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c75627d40 msgr2=0x562c7562c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:52.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.589+0000 7f75977fe640 1 --2- 172.21.15.2:0/340972120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c75627d40 0x562c7562c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.589+0000 7f75977fe640 1 -- 172.21.15.2:0/340972120 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c75613680 con 0x562c7561cb60 2024-09-19T06:21:52.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.590+0000 7f7597fff640 1 --2- 172.21.15.2:0/340972120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c75627d40 0x562c7562c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:52.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.590+0000 7f75977fe640 1 --2- 172.21.15.2:0/340972120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c7561cb60 0x562c7562bce0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f758800b4c0 tx=0x7f7588003dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=835b26869d1248a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:52.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.590+0000 7f7576ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:52.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.590+0000 7f7576ffd640 1 -- 172.21.15.2:0/340972120 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758803c070 con 0x562c7561cb60 2024-09-19T06:21:52.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.590+0000 7f7576ffd640 1 -- 172.21.15.2:0/340972120 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f7588005240 con 0x562c7561cb60 2024-09-19T06:21:52.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.590+0000 7f759fe50740 1 -- 172.21.15.2:0/340972120 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7588011440 con 0x562c7561cb60 2024-09-19T06:21:52.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.590+0000 7f7576ffd640 1 -- 172.21.15.2:0/340972120 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7588005460 con 0x562c7561cb60 2024-09-19T06:21:52.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.590+0000 7f759fe50740 10 client.17661 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:52.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.590+0000 7f759fe50740 1 -- 172.21.15.2:0/340972120 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562c756a2760 con 0x562c7561cb60 2024-09-19T06:21:52.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.590+0000 7f7576ffd640 1 -- 172.21.15.2:0/340972120 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7588011440 con 0x562c7561cb60 2024-09-19T06:21:52.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.591+0000 7f7576ffd640 1 -- 172.21.15.2:0/340972120 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f7588033020 con 0x562c7561cb60 2024-09-19T06:21:52.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.591+0000 7f759fe50740 10 client.17661 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:52.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.591+0000 7f759fe50740 10 client.17661 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:52.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.591+0000 7f759fe50740 20 client.17661 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:52.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.591+0000 7f759fe50740 1 --2- 172.21.15.2:0/340972120 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562c75637950 0x562c756a4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.591+0000 7f759fe50740 4 client.17661 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:21:52.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.591+0000 7f759fe50740 1 -- 172.21.15.2:0/340972120 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562c75589d00 con 0x562c75637950 2024-09-19T06:21:52.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.591+0000 7f7596ffd640 1 --2- 172.21.15.2:0/340972120 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562c75637950 0x562c756a4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.591+0000 7f7596ffd640 1 --2- 172.21.15.2:0/340972120 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562c75637950 0x562c756a4d80 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9588d39fbdda712e server_cookie=2a94fc420c27600e in_seq=0 out_seq=0 2024-09-19T06:21:52.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.591+0000 7f7576ffd640 10 client.17661 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:52.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.592+0000 7f7576ffd640 1 -- 172.21.15.2:0/340972120 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562c75589d00 con 0x562c75637950 2024-09-19T06:21:52.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.592+0000 7f7576ffd640 10 client.17661 handle_command_reply: tid=0 2024-09-19T06:21:52.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.592+0000 7f759fe50740 1 client.17661 shutdown 2024-09-19T06:21:52.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.592+0000 7f759fe50740 1 -- 172.21.15.2:0/340972120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c7561cb60 msgr2=0x562c7562bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:52.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.592+0000 7f759fe50740 1 --2- 172.21.15.2:0/340972120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c7561cb60 0x562c7562bce0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f758800b4c0 tx=0x7f7588003dc0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.593+0000 7f759fe50740 1 -- 172.21.15.2:0/340972120 shutdown_connections 2024-09-19T06:21:52.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.593+0000 7f759fe50740 1 --2- 172.21.15.2:0/340972120 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562c75637950 0x562c756a4d80 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.593+0000 7f759fe50740 1 --2- 172.21.15.2:0/340972120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562c75627d40 0x562c7562c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.593+0000 7f759fe50740 1 --2- 172.21.15.2:0/340972120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562c7561d480 0x562c7562c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.593+0000 7f759fe50740 1 --2- 172.21.15.2:0/340972120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562c7561cb60 0x562c7562bce0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.593+0000 7f7576ffd640 0 client.17661 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:52.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.593+0000 7f759fe50740 1 -- 172.21.15.2:0/340972120 >> 172.21.15.2:0/340972120 conn(0x562c756190f0 msgr2=0x562c75625440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:52.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.593+0000 7f759fe50740 1 -- 172.21.15.2:0/340972120 shutdown_connections 2024-09-19T06:21:52.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.593+0000 7f759fe50740 1 -- 172.21.15.2:0/340972120 wait complete. 2024-09-19T06:21:52.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.593+0000 7f759fe50740 20 client.17661 trim_cache size 0 max 16384 2024-09-19T06:21:52.599 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:21:52.599 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T06:21:52.599 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "df63610b-7313-437a-9eda-fde102d9dc47", 2024-09-19T06:21:52.599 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T06:21:52.599 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:21:52.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.593+0000 7f759da77640 1 -- 172.21.15.2:0/2470585918 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f75800a33b0 msgr2=0x7f75800a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:52.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.593+0000 7f759da77640 1 --2- 172.21.15.2:0/2470585918 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f75800a33b0 0x7f75800a5870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x562c7561a470 tx=0x7f758c005f90 comp rx=0 tx=0).stop 2024-09-19T06:21:52.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.593+0000 7f759da77640 1 -- 172.21.15.2:0/2470585918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f759810c170 msgr2=0x7f759810af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:52.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.593+0000 7f759da77640 1 --2- 172.21.15.2:0/2470585918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f759810c170 0x7f759810af70 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f759002ae70 tx=0x7f759002f5d0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.594+0000 7f759da77640 1 -- 172.21.15.2:0/2470585918 shutdown_connections 2024-09-19T06:21:52.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.594+0000 7f759da77640 1 --2- 172.21.15.2:0/2470585918 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f75800a33b0 0x7f75800a5870 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.594+0000 7f759da77640 1 --2- 172.21.15.2:0/2470585918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f759810c170 0x7f759810af70 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.594+0000 7f759da77640 1 --2- 172.21.15.2:0/2470585918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75981036f0 0x7f759819f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.594+0000 7f759da77640 1 --2- 172.21.15.2:0/2470585918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7598102dd0 0x7f759819efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.594+0000 7f759da77640 1 -- 172.21.15.2:0/2470585918 >> 172.21.15.2:0/2470585918 conn(0x7f75980fc790 msgr2=0x7f75980fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:52.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.594+0000 7f759da77640 1 -- 172.21.15.2:0/2470585918 shutdown_connections 2024-09-19T06:21:52.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:52.594+0000 7f759da77640 1 -- 172.21.15.2:0/2470585918 wait complete. 2024-09-19T06:21:53.306 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:21:53.564 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:53.685 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:53 smithi002 ceph-mon[30982]: pgmap v217: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:21:53.685 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:53 smithi002 ceph-mon[30982]: scrub queued for path: / 2024-09-19T06:21:53.685 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:53 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:53.685 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:53 smithi002 ceph-mon[30982]: scrub summary: active paths [/] 2024-09-19T06:21:53.686 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:53 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:53.686 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:53 smithi002 ceph-mon[30982]: scrub summary: idle 2024-09-19T06:21:53.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:53 smithi090 ceph-mon[34497]: pgmap v217: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:21:53.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:53 smithi090 ceph-mon[34497]: scrub queued for path: / 2024-09-19T06:21:53.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:53 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:53.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:53 smithi090 ceph-mon[34497]: scrub summary: active paths [/] 2024-09-19T06:21:53.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:53 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:53.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:53 smithi090 ceph-mon[34497]: scrub summary: idle 2024-09-19T06:21:53.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:53 smithi089 ceph-mon[34160]: pgmap v217: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:21:53.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:53 smithi089 ceph-mon[34160]: scrub queued for path: / 2024-09-19T06:21:53.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:53 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:53.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:53 smithi089 ceph-mon[34160]: scrub summary: active paths [/] 2024-09-19T06:21:53.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:53 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:53.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:53 smithi089 ceph-mon[34160]: scrub summary: idle 2024-09-19T06:21:54.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.027+0000 7ff91b2da640 1 -- 172.21.15.2:0/3387018725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff914100ca0 msgr2=0x7ff914106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:54.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.027+0000 7ff91b2da640 1 --2- 172.21.15.2:0/3387018725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff914100ca0 0x7ff914106840 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7ff904009930 tx=0x7ff90402a420 comp rx=0 tx=0).stop 2024-09-19T06:21:54.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.027+0000 7ff91b2da640 1 -- 172.21.15.2:0/3387018725 shutdown_connections 2024-09-19T06:21:54.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.027+0000 7ff91b2da640 1 --2- 172.21.15.2:0/3387018725 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff914106f50 0x7ff91410eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:54.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.027+0000 7ff91b2da640 1 --2- 172.21.15.2:0/3387018725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff914100ca0 0x7ff914106840 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:54.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.027+0000 7ff91b2da640 1 --2- 172.21.15.2:0/3387018725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9141002f0 0x7ff9141006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:54.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.027+0000 7ff91b2da640 1 -- 172.21.15.2:0/3387018725 >> 172.21.15.2:0/3387018725 conn(0x7ff914077210 msgr2=0x7ff9140fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:54.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.028+0000 7ff91b2da640 1 -- 172.21.15.2:0/3387018725 shutdown_connections 2024-09-19T06:21:54.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.028+0000 7ff91b2da640 1 -- 172.21.15.2:0/3387018725 wait complete. 2024-09-19T06:21:54.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.028+0000 7ff91b2da640 1 Processor -- start 2024-09-19T06:21:54.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.028+0000 7ff91b2da640 1 -- start start 2024-09-19T06:21:54.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.029+0000 7ff91b2da640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9141002f0 0x7ff914101270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:54.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.029+0000 7ff91b2da640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff914100ca0 0x7ff9141017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:54.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.029+0000 7ff91b2da640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff914106f50 0x7ff914101cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:54.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.029+0000 7ff91b2da640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff914111e90 con 0x7ff914106f50 2024-09-19T06:21:54.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.029+0000 7ff91b2da640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff914111d10 con 0x7ff9141002f0 2024-09-19T06:21:54.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.029+0000 7ff91b2da640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff914112010 con 0x7ff914100ca0 2024-09-19T06:21:54.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.029+0000 7ff919877640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff914106f50 0x7ff914101cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:54.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.029+0000 7ff919877640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff914106f50 0x7ff914101cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46428/0 (socket says 172.21.15.2:46428) 2024-09-19T06:21:54.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.029+0000 7ff919877640 1 -- 172.21.15.2:0/1552193388 learned_addr learned my addr 172.21.15.2:0/1552193388 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:54.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.029+0000 7ff918875640 1 --2- 172.21.15.2:0/1552193388 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff914100ca0 0x7ff9141017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:54.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.029+0000 7ff919076640 1 --2- 172.21.15.2:0/1552193388 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9141002f0 0x7ff914101270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:54.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.029+0000 7ff919877640 1 -- 172.21.15.2:0/1552193388 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff914100ca0 msgr2=0x7ff9141017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:54.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.029+0000 7ff919877640 1 --2- 172.21.15.2:0/1552193388 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff914100ca0 0x7ff9141017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:54.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.029+0000 7ff919877640 1 -- 172.21.15.2:0/1552193388 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9141002f0 msgr2=0x7ff914101270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:54.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.029+0000 7ff919877640 1 --2- 172.21.15.2:0/1552193388 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9141002f0 0x7ff914101270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:54.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.029+0000 7ff919877640 1 -- 172.21.15.2:0/1552193388 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9141a6910 con 0x7ff914106f50 2024-09-19T06:21:54.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.029+0000 7ff919877640 1 --2- 172.21.15.2:0/1552193388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff914106f50 0x7ff914101cf0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7ff90c00b970 tx=0x7ff90c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:54.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.029+0000 7ff90a7fc640 1 -- 172.21.15.2:0/1552193388 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90c019070 con 0x7ff914106f50 2024-09-19T06:21:54.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.029+0000 7ff91b2da640 1 -- 172.21.15.2:0/1552193388 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9141a6c00 con 0x7ff914106f50 2024-09-19T06:21:54.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.029+0000 7ff90a7fc640 1 -- 172.21.15.2:0/1552193388 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff90c014440 con 0x7ff914106f50 2024-09-19T06:21:54.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.029+0000 7ff90a7fc640 1 -- 172.21.15.2:0/1552193388 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90c0075d0 con 0x7ff914106f50 2024-09-19T06:21:54.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.030+0000 7ff91b2da640 1 -- 172.21.15.2:0/1552193388 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9141a7110 con 0x7ff914106f50 2024-09-19T06:21:54.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.032+0000 7ff90a7fc640 1 -- 172.21.15.2:0/1552193388 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7ff90c01c070 con 0x7ff914106f50 2024-09-19T06:21:54.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.032+0000 7ff91d6b3740 1 Processor -- start 2024-09-19T06:21:54.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.032+0000 7ff91d6b3740 1 -- start start 2024-09-19T06:21:54.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.033+0000 7ff91d6b3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561553efe4a0 0x561553efe880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:54.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.033+0000 7ff91d6b3740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561553efedc0 0x561553f09140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:54.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.033+0000 7ff91d6b3740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561553f09680 0x561553f0ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:54.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.033+0000 7ff91d6b3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561553e642e0 con 0x561553efe4a0 2024-09-19T06:21:54.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.033+0000 7ff91d6b3740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x561553e0bce0 con 0x561553efedc0 2024-09-19T06:21:54.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.033+0000 7ff91d6b3740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x561553e602a0 con 0x561553f09680 2024-09-19T06:21:54.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.033+0000 7ff90a7fc640 1 --2- 172.21.15.2:0/1552193388 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff9000a33b0 0x7ff9000a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:54.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.033+0000 7ff918875640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561553efe4a0 0x561553efe880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:54.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.033+0000 7ff918875640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561553efe4a0 0x561553efe880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46444/0 (socket says 172.21.15.2:46444) 2024-09-19T06:21:54.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.033+0000 7ff918875640 1 -- 172.21.15.2:0/1835289709 learned_addr learned my addr 172.21.15.2:0/1835289709 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:54.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.033+0000 7ff919877640 1 --2- 172.21.15.2:0/1552193388 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff9000a33b0 0x7ff9000a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:54.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.033+0000 7ff918875640 1 --2- 172.21.15.2:0/1835289709 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561553f09680 0x561553f0ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:54.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.033+0000 7ff919076640 1 --2- 172.21.15.2:0/1835289709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561553efedc0 0x561553f09140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:54.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.033+0000 7ff90a7fc640 1 -- 172.21.15.2:0/1552193388 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7ff90c0cf250 con 0x7ff914106f50 2024-09-19T06:21:54.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.033+0000 7ff918875640 1 -- 172.21.15.2:0/1835289709 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561553f09680 msgr2=0x561553f0ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:54.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.033+0000 7ff918875640 1 --2- 172.21.15.2:0/1835289709 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561553f09680 0x561553f0ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:54.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.033+0000 7ff918875640 1 -- 172.21.15.2:0/1835289709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561553efedc0 msgr2=0x561553f09140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:54.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.033+0000 7ff918875640 1 --2- 172.21.15.2:0/1835289709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561553efedc0 0x561553f09140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.033+0000 7ff918875640 1 -- 172.21.15.2:0/1835289709 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561553df0440 con 0x561553efe4a0 2024-09-19T06:21:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.033+0000 7ff919076640 1 --2- 172.21.15.2:0/1835289709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561553efedc0 0x561553f09140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.034+0000 7ff918875640 1 --2- 172.21.15.2:0/1835289709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561553efe4a0 0x561553efe880 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7ff904031fd0 tx=0x7ff904005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97f877a99310baec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.034+0000 7ff919877640 1 --2- 172.21.15.2:0/1552193388 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff9000a33b0 0x7ff9000a5870 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff90c097af0 tx=0x7ff90c004a40 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.034+0000 7ff8ff7fe640 1 -- 172.21.15.2:0/1835289709 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff904044030 con 0x561553efe4a0 2024-09-19T06:21:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.034+0000 7ff8ff7fe640 1 -- 172.21.15.2:0/1835289709 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff9040316e0 con 0x561553efe4a0 2024-09-19T06:21:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.034+0000 7ff8ff7fe640 1 -- 172.21.15.2:0/1835289709 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff904035040 con 0x561553efe4a0 2024-09-19T06:21:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.034+0000 7ff91d6b3740 1 -- 172.21.15.2:0/1835289709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561553efe4a0 msgr2=0x561553efe880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.034+0000 7ff91d6b3740 1 --2- 172.21.15.2:0/1835289709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561553efe4a0 0x561553efe880 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7ff904031fd0 tx=0x7ff904005fd0 comp rx=0 tx=0).stop 2024-09-19T06:21:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.035+0000 7ff91d6b3740 1 -- 172.21.15.2:0/1835289709 shutdown_connections 2024-09-19T06:21:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.035+0000 7ff91d6b3740 1 --2- 172.21.15.2:0/1835289709 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561553f09680 0x561553f0ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.035+0000 7ff91d6b3740 1 --2- 172.21.15.2:0/1835289709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561553efedc0 0x561553f09140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:54.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.035+0000 7ff91d6b3740 1 --2- 172.21.15.2:0/1835289709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561553efe4a0 0x561553efe880 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:54.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.035+0000 7ff91d6b3740 1 -- 172.21.15.2:0/1835289709 >> 172.21.15.2:0/1835289709 conn(0x561553efaa30 msgr2=0x561553efae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:54.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.035+0000 7ff91d6b3740 1 -- 172.21.15.2:0/1835289709 shutdown_connections 2024-09-19T06:21:54.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.035+0000 7ff91d6b3740 1 -- 172.21.15.2:0/1835289709 wait complete. 2024-09-19T06:21:54.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.035+0000 7ff91d6b3740 1 -- start start 2024-09-19T06:21:54.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.035+0000 7ff91d6b3740 1 Processor -- start 2024-09-19T06:21:54.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.035+0000 7ff91d6b3740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561553efe4a0 0x561553f08f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:54.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.035+0000 7ff91d6b3740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561553efedc0 0x561553f061e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:54.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.035+0000 7ff91d6b3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561553f09680 0x561553f06720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:54.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.035+0000 7ff91d6b3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561553f0c250 con 0x561553f09680 2024-09-19T06:21:54.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.035+0000 7ff91d6b3740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x561553e1f050 con 0x561553efe4a0 2024-09-19T06:21:54.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.035+0000 7ff91d6b3740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x561553f0c3d0 con 0x561553efedc0 2024-09-19T06:21:54.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.036+0000 7ff91d6b3740 10 client.0 _ll_register_callbacks cb 0x561553e5f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:54.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.036+0000 7ff918875640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561553f09680 0x561553f06720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:54.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.036+0000 7ff918875640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561553f09680 0x561553f06720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46454/0 (socket says 172.21.15.2:46454) 2024-09-19T06:21:54.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.036+0000 7ff918875640 1 -- 172.21.15.2:0/1242352000 learned_addr learned my addr 172.21.15.2:0/1242352000 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:54.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.036+0000 7ff918875640 1 --2- 172.21.15.2:0/1242352000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561553efe4a0 0x561553f08f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:54.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.036+0000 7ff919076640 1 --2- 172.21.15.2:0/1242352000 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561553efedc0 0x561553f061e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:54.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.036+0000 7ff918875640 1 -- 172.21.15.2:0/1242352000 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561553efedc0 msgr2=0x561553f061e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:54.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.036+0000 7ff918875640 1 --2- 172.21.15.2:0/1242352000 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561553efedc0 0x561553f061e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:54.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.036+0000 7ff918875640 1 -- 172.21.15.2:0/1242352000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561553efe4a0 msgr2=0x561553f08f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:54.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.036+0000 7ff918875640 1 --2- 172.21.15.2:0/1242352000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561553efe4a0 0x561553f08f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:54.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.036+0000 7ff918875640 1 -- 172.21.15.2:0/1242352000 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561553bd53c0 con 0x561553f09680 2024-09-19T06:21:54.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.036+0000 7ff918875640 1 --2- 172.21.15.2:0/1242352000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561553f09680 0x561553f06720 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7ff904031e60 tx=0x7ff904009610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e6ce041223bcf4d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:54.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.036+0000 7ff8fcff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:54.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.036+0000 7ff8fcff9640 1 -- 172.21.15.2:0/1242352000 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff904044070 con 0x561553f09680 2024-09-19T06:21:54.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.036+0000 7ff91d6b3740 1 -- 172.21.15.2:0/1242352000 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9040316e0 con 0x561553f09680 2024-09-19T06:21:54.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.036+0000 7ff8fcff9640 1 -- 172.21.15.2:0/1242352000 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7ff904004460 con 0x561553f09680 2024-09-19T06:21:54.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.036+0000 7ff8fcff9640 1 -- 172.21.15.2:0/1242352000 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff904035040 con 0x561553f09680 2024-09-19T06:21:54.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.037+0000 7ff91d6b3740 10 client.17673 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:54.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.037+0000 7ff91d6b3740 1 -- 172.21.15.2:0/1242352000 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561553f17bd0 con 0x561553f09680 2024-09-19T06:21:54.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.037+0000 7ff8fcff9640 1 -- 172.21.15.2:0/1242352000 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff9040316e0 con 0x561553f09680 2024-09-19T06:21:54.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.037+0000 7ff8fcff9640 1 -- 172.21.15.2:0/1242352000 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7ff9040037b0 con 0x561553f09680 2024-09-19T06:21:54.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.037+0000 7ff91d6b3740 10 client.17673 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:54.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.037+0000 7ff91d6b3740 10 client.17673 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:54.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.037+0000 7ff91d6b3740 20 client.17673 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:54.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.037+0000 7ff91d6b3740 1 --2- 172.21.15.2:0/1242352000 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x561553f18f20 0x561553f1b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:54.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.037+0000 7ff91d6b3740 4 client.17673 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:54.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.037+0000 7ff91d6b3740 1 -- 172.21.15.2:0/1242352000 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561553e71850 con 0x561553f18f20 2024-09-19T06:21:54.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.037+0000 7ff919076640 1 --2- 172.21.15.2:0/1242352000 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x561553f18f20 0x561553f1b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:54.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.038+0000 7ff919076640 1 --2- 172.21.15.2:0/1242352000 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x561553f18f20 0x561553f1b310 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbccc53a3221124d server_cookie=c5d8b07812f3c61e in_seq=0 out_seq=0 2024-09-19T06:21:54.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.038+0000 7ff8fcff9640 10 client.17673 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:54.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.038+0000 7ff8fcff9640 1 -- 172.21.15.2:0/1242352000 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561553e71850 con 0x561553f18f20 2024-09-19T06:21:54.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.038+0000 7ff8fcff9640 10 client.17673 handle_command_reply: tid=0 2024-09-19T06:21:54.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.038+0000 7ff91d6b3740 1 client.17673 shutdown 2024-09-19T06:21:54.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.039+0000 7ff91d6b3740 1 -- 172.21.15.2:0/1242352000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561553f09680 msgr2=0x561553f06720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:54.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.039+0000 7ff91d6b3740 1 --2- 172.21.15.2:0/1242352000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561553f09680 0x561553f06720 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7ff904031e60 tx=0x7ff904009610 comp rx=0 tx=0).stop 2024-09-19T06:21:54.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.039+0000 7ff91d6b3740 1 -- 172.21.15.2:0/1242352000 shutdown_connections 2024-09-19T06:21:54.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.039+0000 7ff91d6b3740 1 --2- 172.21.15.2:0/1242352000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561553f09680 0x561553f06720 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:54.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.039+0000 7ff91d6b3740 1 --2- 172.21.15.2:0/1242352000 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561553efedc0 0x561553f061e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:54.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.039+0000 7ff91d6b3740 1 --2- 172.21.15.2:0/1242352000 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x561553f18f20 0x561553f1b310 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:54.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.039+0000 7ff91d6b3740 1 --2- 172.21.15.2:0/1242352000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561553efe4a0 0x561553f08f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:54.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.039+0000 7ff8fcff9640 0 client.17673 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:54.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.039+0000 7ff91d6b3740 1 -- 172.21.15.2:0/1242352000 >> 172.21.15.2:0/1242352000 conn(0x561553efaa30 msgr2=0x561553f00760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:54.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.039+0000 7ff91d6b3740 1 -- 172.21.15.2:0/1242352000 shutdown_connections 2024-09-19T06:21:54.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.039+0000 7ff91d6b3740 1 -- 172.21.15.2:0/1242352000 wait complete. 2024-09-19T06:21:54.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.039+0000 7ff91d6b3740 20 client.17673 trim_cache size 0 max 16384 2024-09-19T06:21:54.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.056+0000 7ff91d6b3740 1 Processor -- start 2024-09-19T06:21:54.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.056+0000 7ff91d6b3740 1 -- start start 2024-09-19T06:21:54.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.057+0000 7ff91d6b3740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561553efaa30 0x561553f1e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:54.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.057+0000 7ff91d6b3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561553efe4a0 0x561553f1e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:54.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.057+0000 7ff91d6b3740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561553efedc0 0x561553f03440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:54.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.057+0000 7ff91d6b3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff9141b2280 con 0x561553efe4a0 2024-09-19T06:21:54.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.057+0000 7ff91d6b3740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff9141afb50 con 0x561553efaa30 2024-09-19T06:21:54.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.057+0000 7ff91d6b3740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff9141ad9c0 con 0x561553efedc0 2024-09-19T06:21:54.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.057+0000 7ff919076640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561553efe4a0 0x561553f1e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:54.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.057+0000 7ff919076640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561553efe4a0 0x561553f1e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46464/0 (socket says 172.21.15.2:46464) 2024-09-19T06:21:54.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.057+0000 7ff919076640 1 -- 172.21.15.2:0/2585812110 learned_addr learned my addr 172.21.15.2:0/2585812110 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:54.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.057+0000 7ff918875640 1 --2- 172.21.15.2:0/2585812110 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561553efedc0 0x561553f03440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:54.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.057+0000 7ff918875640 1 --2- 172.21.15.2:0/2585812110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561553efaa30 0x561553f1e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:54.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.057+0000 7ff919076640 1 -- 172.21.15.2:0/2585812110 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561553efedc0 msgr2=0x561553f03440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:54.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.057+0000 7ff919076640 1 --2- 172.21.15.2:0/2585812110 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561553efedc0 0x561553f03440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:54.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.057+0000 7ff919076640 1 -- 172.21.15.2:0/2585812110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561553efaa30 msgr2=0x561553f1e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:54.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.057+0000 7ff919076640 1 --2- 172.21.15.2:0/2585812110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561553efaa30 0x561553f1e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:54.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.057+0000 7ff919076640 1 -- 172.21.15.2:0/2585812110 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561553efa860 con 0x561553efe4a0 2024-09-19T06:21:54.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.057+0000 7ff918875640 1 --2- 172.21.15.2:0/2585812110 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561553efedc0 0x561553f03440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:54.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.057+0000 7ff919076640 1 --2- 172.21.15.2:0/2585812110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561553efe4a0 0x561553f1e870 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7ff9100045f0 tx=0x7ff91000be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80b744e2fd3d273 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:54.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.058+0000 7ff8feffd640 1 -- 172.21.15.2:0/2585812110 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff910003ea0 con 0x561553efe4a0 2024-09-19T06:21:54.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.058+0000 7ff8feffd640 1 -- 172.21.15.2:0/2585812110 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff9100118f0 con 0x561553efe4a0 2024-09-19T06:21:54.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.058+0000 7ff8feffd640 1 -- 172.21.15.2:0/2585812110 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff91001c980 con 0x561553efe4a0 2024-09-19T06:21:54.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.058+0000 7ff91d6b3740 1 -- 172.21.15.2:0/2585812110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561553efe4a0 msgr2=0x561553f1e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:54.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.058+0000 7ff91d6b3740 1 --2- 172.21.15.2:0/2585812110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561553efe4a0 0x561553f1e870 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7ff9100045f0 tx=0x7ff91000be00 comp rx=0 tx=0).stop 2024-09-19T06:21:54.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.058+0000 7ff91d6b3740 1 -- 172.21.15.2:0/2585812110 shutdown_connections 2024-09-19T06:21:54.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.058+0000 7ff91d6b3740 1 --2- 172.21.15.2:0/2585812110 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561553efedc0 0x561553f03440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:54.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.058+0000 7ff91d6b3740 1 --2- 172.21.15.2:0/2585812110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561553efe4a0 0x561553f1e870 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:54.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.058+0000 7ff91d6b3740 1 --2- 172.21.15.2:0/2585812110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561553efaa30 0x561553f1e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:54.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.058+0000 7ff91d6b3740 1 -- 172.21.15.2:0/2585812110 >> 172.21.15.2:0/2585812110 conn(0x561553f06880 msgr2=0x561553f04ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:54.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.058+0000 7ff91d6b3740 1 -- 172.21.15.2:0/2585812110 shutdown_connections 2024-09-19T06:21:54.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.058+0000 7ff91d6b3740 1 -- 172.21.15.2:0/2585812110 wait complete. 2024-09-19T06:21:54.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.059+0000 7ff91d6b3740 1 -- start start 2024-09-19T06:21:54.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.059+0000 7ff91d6b3740 1 Processor -- start 2024-09-19T06:21:54.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.059+0000 7ff91d6b3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561553efaa30 0x561553f1c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:54.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.059+0000 7ff91d6b3740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561553efe4a0 0x561553f1c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:54.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.059+0000 7ff91d6b3740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561553efedc0 0x561553f1cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:54.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.059+0000 7ff91d6b3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff9141ae010 con 0x561553efaa30 2024-09-19T06:21:54.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.059+0000 7ff91d6b3740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff9141af480 con 0x561553efe4a0 2024-09-19T06:21:54.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.059+0000 7ff91d6b3740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff9141ae6e0 con 0x561553efedc0 2024-09-19T06:21:54.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.059+0000 7ff91d6b3740 10 client.0 _ll_register_callbacks cb 0x7ff904031f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:54.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.059+0000 7ff918875640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561553efaa30 0x561553f1c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:54.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.059+0000 7ff918875640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561553efaa30 0x561553f1c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46468/0 (socket says 172.21.15.2:46468) 2024-09-19T06:21:54.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.059+0000 7ff918875640 1 -- 172.21.15.2:0/4249304854 learned_addr learned my addr 172.21.15.2:0/4249304854 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:54.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.059+0000 7ff919076640 1 --2- 172.21.15.2:0/4249304854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561553efe4a0 0x561553f1c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:54.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.059+0000 7ff918875640 1 -- 172.21.15.2:0/4249304854 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561553efedc0 msgr2=0x561553f1cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:54.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.059+0000 7ff918875640 1 --2- 172.21.15.2:0/4249304854 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561553efedc0 0x561553f1cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:54.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.059+0000 7ff918875640 1 -- 172.21.15.2:0/4249304854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561553efe4a0 msgr2=0x561553f1c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:54.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.059+0000 7ff918875640 1 --2- 172.21.15.2:0/4249304854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561553efe4a0 0x561553f1c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:54.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.060+0000 7ff918875640 1 -- 172.21.15.2:0/4249304854 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561553f82a60 con 0x561553efaa30 2024-09-19T06:21:54.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.060+0000 7ff918875640 1 --2- 172.21.15.2:0/4249304854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561553efaa30 0x561553f1c2c0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7ff904033000 tx=0x7ff904031a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3841208d967c8e67 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:54.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.060+0000 7ff8fcff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:54.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.060+0000 7ff8fcff9640 1 -- 172.21.15.2:0/4249304854 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff904044040 con 0x561553efaa30 2024-09-19T06:21:54.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.060+0000 7ff8fcff9640 1 -- 172.21.15.2:0/4249304854 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7ff904003800 con 0x561553efaa30 2024-09-19T06:21:54.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.060+0000 7ff91d6b3740 1 -- 172.21.15.2:0/4249304854 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9100118f0 con 0x561553efaa30 2024-09-19T06:21:54.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.060+0000 7ff8fcff9640 1 -- 172.21.15.2:0/4249304854 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff9040316e0 con 0x561553efaa30 2024-09-19T06:21:54.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.060+0000 7ff91d6b3740 10 client.17679 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:54.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.060+0000 7ff91d6b3740 1 -- 172.21.15.2:0/4249304854 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561553f83d50 con 0x561553efaa30 2024-09-19T06:21:54.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.060+0000 7ff8fcff9640 1 -- 172.21.15.2:0/4249304854 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff9100118f0 con 0x561553efaa30 2024-09-19T06:21:54.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.060+0000 7ff8fcff9640 1 -- 172.21.15.2:0/4249304854 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7ff904049470 con 0x561553efaa30 2024-09-19T06:21:54.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.061+0000 7ff91d6b3740 10 client.17679 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:54.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.061+0000 7ff91d6b3740 10 client.17679 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:54.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.061+0000 7ff91d6b3740 20 client.17679 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:54.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.061+0000 7ff91d6b3740 1 --2- 172.21.15.2:0/4249304854 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x561553f09680 0x561553f863f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:54.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.061+0000 7ff91d6b3740 4 client.17679 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:21:54.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.061+0000 7ff91d6b3740 1 -- 172.21.15.2:0/4249304854 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561553e6bd60 con 0x561553f09680 2024-09-19T06:21:54.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.061+0000 7ff919076640 1 --2- 172.21.15.2:0/4249304854 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x561553f09680 0x561553f863f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:54.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.061+0000 7ff919076640 1 --2- 172.21.15.2:0/4249304854 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x561553f09680 0x561553f863f0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db97a60793cf880d server_cookie=2a1b01497d77aa3c in_seq=0 out_seq=0 2024-09-19T06:21:54.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.061+0000 7ff8fcff9640 10 client.17679 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:54.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.061+0000 7ff8fcff9640 1 -- 172.21.15.2:0/4249304854 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x561553e6bd60 con 0x561553f09680 2024-09-19T06:21:54.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.061+0000 7ff8fcff9640 10 client.17679 handle_command_reply: tid=0 2024-09-19T06:21:54.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.061+0000 7ff91d6b3740 1 client.17679 shutdown 2024-09-19T06:21:54.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.062+0000 7ff91d6b3740 1 -- 172.21.15.2:0/4249304854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561553efaa30 msgr2=0x561553f1c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:54.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.062+0000 7ff91d6b3740 1 --2- 172.21.15.2:0/4249304854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561553efaa30 0x561553f1c2c0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7ff904033000 tx=0x7ff904031a80 comp rx=0 tx=0).stop 2024-09-19T06:21:54.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.062+0000 7ff91d6b3740 1 -- 172.21.15.2:0/4249304854 shutdown_connections 2024-09-19T06:21:54.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.062+0000 7ff91d6b3740 1 --2- 172.21.15.2:0/4249304854 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561553efedc0 0x561553f1cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:54.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.062+0000 7ff91d6b3740 1 --2- 172.21.15.2:0/4249304854 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x561553f09680 0x561553f863f0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:54.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.062+0000 7ff91d6b3740 1 --2- 172.21.15.2:0/4249304854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561553efe4a0 0x561553f1c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:54.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.062+0000 7ff91d6b3740 1 --2- 172.21.15.2:0/4249304854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561553efaa30 0x561553f1c2c0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:54.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.062+0000 7ff8fcff9640 0 client.17679 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:54.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.062+0000 7ff91d6b3740 1 -- 172.21.15.2:0/4249304854 >> 172.21.15.2:0/4249304854 conn(0x561553f06880 msgr2=0x561553f08260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:54.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.062+0000 7ff91d6b3740 1 -- 172.21.15.2:0/4249304854 shutdown_connections 2024-09-19T06:21:54.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.062+0000 7ff91d6b3740 1 -- 172.21.15.2:0/4249304854 wait complete. 2024-09-19T06:21:54.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.062+0000 7ff91d6b3740 20 client.17679 trim_cache size 0 max 16384 2024-09-19T06:21:54.069 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:21:54.069 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T06:21:54.069 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T06:21:54.069 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:21:54.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.062+0000 7ff91b2da640 1 -- 172.21.15.2:0/1552193388 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff9000a33b0 msgr2=0x7ff9000a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:54.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.062+0000 7ff91b2da640 1 --2- 172.21.15.2:0/1552193388 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff9000a33b0 0x7ff9000a5870 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff90c097af0 tx=0x7ff90c004a40 comp rx=0 tx=0).stop 2024-09-19T06:21:54.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.062+0000 7ff91b2da640 1 -- 172.21.15.2:0/1552193388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff914106f50 msgr2=0x7ff914101cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:54.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.062+0000 7ff91b2da640 1 --2- 172.21.15.2:0/1552193388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff914106f50 0x7ff914101cf0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7ff90c00b970 tx=0x7ff90c00be30 comp rx=0 tx=0).stop 2024-09-19T06:21:54.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.062+0000 7ff91b2da640 1 -- 172.21.15.2:0/1552193388 shutdown_connections 2024-09-19T06:21:54.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.062+0000 7ff91b2da640 1 --2- 172.21.15.2:0/1552193388 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff9000a33b0 0x7ff9000a5870 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:54.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.062+0000 7ff91b2da640 1 --2- 172.21.15.2:0/1552193388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff914106f50 0x7ff914101cf0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:54.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.062+0000 7ff91b2da640 1 --2- 172.21.15.2:0/1552193388 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff914100ca0 0x7ff9141017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:54.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.062+0000 7ff91b2da640 1 --2- 172.21.15.2:0/1552193388 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9141002f0 0x7ff914101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:54.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.062+0000 7ff91b2da640 1 -- 172.21.15.2:0/1552193388 >> 172.21.15.2:0/1552193388 conn(0x7ff914077210 msgr2=0x7ff914105280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:54.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.063+0000 7ff91b2da640 1 -- 172.21.15.2:0/1552193388 shutdown_connections 2024-09-19T06:21:54.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:54.063+0000 7ff91b2da640 1 -- 172.21.15.2:0/1552193388 wait complete. 2024-09-19T06:21:54.695 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:21:54.696 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:21:54.951 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:55.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.401+0000 7f3f4e6ab640 1 -- 172.21.15.2:0/683125981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f48101420 msgr2=0x7f3f4810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:55.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.401+0000 7f3f4e6ab640 1 --2- 172.21.15.2:0/683125981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f48101420 0x7f3f4810d950 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f3f40009cd0 tx=0x7f3f4002a8e0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.401+0000 7f3f4e6ab640 1 -- 172.21.15.2:0/683125981 shutdown_connections 2024-09-19T06:21:55.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.401+0000 7f3f4e6ab640 1 --2- 172.21.15.2:0/683125981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f48101420 0x7f3f4810d950 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.401+0000 7f3f4e6ab640 1 --2- 172.21.15.2:0/683125981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f48100a80 0x7f3f48100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.401+0000 7f3f4e6ab640 1 --2- 172.21.15.2:0/683125981 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f48106a80 0x7f3f48106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.401+0000 7f3f4e6ab640 1 -- 172.21.15.2:0/683125981 >> 172.21.15.2:0/683125981 conn(0x7f3f480fc7a0 msgr2=0x7f3f480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:55.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.401+0000 7f3f4e6ab640 1 -- 172.21.15.2:0/683125981 shutdown_connections 2024-09-19T06:21:55.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.401+0000 7f3f4e6ab640 1 -- 172.21.15.2:0/683125981 wait complete. 2024-09-19T06:21:55.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.402+0000 7f3f4e6ab640 1 Processor -- start 2024-09-19T06:21:55.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.402+0000 7f3f4e6ab640 1 -- start start 2024-09-19T06:21:55.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.402+0000 7f3f4e6ab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f48100a80 0x7f3f481982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:55.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.402+0000 7f3f4e6ab640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f48101420 0x7f3f48198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:55.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.402+0000 7f3f4e6ab640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f48106a80 0x7f3f4819cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:55.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.403+0000 7f3f4e6ab640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3f48111e50 con 0x7f3f48100a80 2024-09-19T06:21:55.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.403+0000 7f3f4e6ab640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3f48111cd0 con 0x7f3f48101420 2024-09-19T06:21:55.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.403+0000 7f3f4e6ab640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3f48111fd0 con 0x7f3f48106a80 2024-09-19T06:21:55.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.403+0000 7f3f47fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f48100a80 0x7f3f481982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:55.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.403+0000 7f3f47fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f48100a80 0x7f3f481982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45360/0 (socket says 172.21.15.2:45360) 2024-09-19T06:21:55.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.403+0000 7f3f47fff640 1 -- 172.21.15.2:0/3043521048 learned_addr learned my addr 172.21.15.2:0/3043521048 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:55.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.403+0000 7f3f4cc48640 1 --2- 172.21.15.2:0/3043521048 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f48106a80 0x7f3f4819cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:55.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.403+0000 7f3f477fe640 1 --2- 172.21.15.2:0/3043521048 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f48101420 0x7f3f48198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:55.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.403+0000 7f3f47fff640 1 -- 172.21.15.2:0/3043521048 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f48106a80 msgr2=0x7f3f4819cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:55.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.403+0000 7f3f47fff640 1 --2- 172.21.15.2:0/3043521048 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f48106a80 0x7f3f4819cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.403+0000 7f3f47fff640 1 -- 172.21.15.2:0/3043521048 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f48101420 msgr2=0x7f3f48198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:55.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.403+0000 7f3f47fff640 1 --2- 172.21.15.2:0/3043521048 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f48101420 0x7f3f48198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.403+0000 7f3f47fff640 1 -- 172.21.15.2:0/3043521048 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f4819d290 con 0x7f3f48100a80 2024-09-19T06:21:55.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.403+0000 7f3f47fff640 1 --2- 172.21.15.2:0/3043521048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f48100a80 0x7f3f481982e0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f3f3800c970 tx=0x7f3f3800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:55.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.403+0000 7f3f457fa640 1 -- 172.21.15.2:0/3043521048 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f38007bb0 con 0x7f3f48100a80 2024-09-19T06:21:55.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.403+0000 7f3f457fa640 1 -- 172.21.15.2:0/3043521048 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3f38007d50 con 0x7f3f48100a80 2024-09-19T06:21:55.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.403+0000 7f3f4e6ab640 1 -- 172.21.15.2:0/3043521048 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f4819d580 con 0x7f3f48100a80 2024-09-19T06:21:55.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.403+0000 7f3f457fa640 1 -- 172.21.15.2:0/3043521048 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f3800f450 con 0x7f3f48100a80 2024-09-19T06:21:55.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.404+0000 7f3f4e6ab640 1 -- 172.21.15.2:0/3043521048 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f481a4e60 con 0x7f3f48100a80 2024-09-19T06:21:55.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.404+0000 7f3f4e6ab640 1 -- 172.21.15.2:0/3043521048 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f48100ee0 con 0x7f3f48100a80 2024-09-19T06:21:55.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.406+0000 7f3f457fa640 1 -- 172.21.15.2:0/3043521048 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f3f38004f00 con 0x7f3f48100a80 2024-09-19T06:21:55.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.406+0000 7f3f457fa640 1 --2- 172.21.15.2:0/3043521048 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f3f300a33b0 0x7f3f300a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:55.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.407+0000 7f3f477fe640 1 --2- 172.21.15.2:0/3043521048 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f3f300a33b0 0x7f3f300a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:55.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.407+0000 7f3f457fa640 1 -- 172.21.15.2:0/3043521048 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f3f380cfdf0 con 0x7f3f48100a80 2024-09-19T06:21:55.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.407+0000 7f3f477fe640 1 --2- 172.21.15.2:0/3043521048 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f3f300a33b0 0x7f3f300a5870 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c005e10 tx=0x7f3f3c005da0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:55.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.410+0000 7f3f457fa640 1 -- 172.21.15.2:0/3043521048 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3f38014030 con 0x7f3f48100a80 2024-09-19T06:21:55.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.621+0000 7f3f4e6ab640 1 -- 172.21.15.2:0/3043521048 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3f48109050 con 0x7f3f48100a80 2024-09-19T06:21:55.624 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:55 smithi002 ceph-mon[30982]: pgmap v218: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2024-09-19T06:21:55.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.621+0000 7f3f457fa640 1 -- 172.21.15.2:0/3043521048 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11882 (secure 0 0 0) 0x7f3f3809c7d0 con 0x7f3f48100a80 2024-09-19T06:21:55.624 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:21:55.625 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-09-19T06:14:49:104280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:14:48.191083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24470,24472,24497]},"id":1}]} 2024-09-19T06:21:55.625 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-09-19T06:21:55.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.624+0000 7f3f4e6ab640 1 -- 172.21.15.2:0/3043521048 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f3f300a33b0 msgr2=0x7f3f300a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:55.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.624+0000 7f3f4e6ab640 1 --2- 172.21.15.2:0/3043521048 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f3f300a33b0 0x7f3f300a5870 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c005e10 tx=0x7f3f3c005da0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.624+0000 7f3f4e6ab640 1 -- 172.21.15.2:0/3043521048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f48100a80 msgr2=0x7f3f481982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:55.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.624+0000 7f3f4e6ab640 1 --2- 172.21.15.2:0/3043521048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f48100a80 0x7f3f481982e0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f3f3800c970 tx=0x7f3f3800ce30 comp rx=0 tx=0).stop 2024-09-19T06:21:55.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.624+0000 7f3f4e6ab640 1 -- 172.21.15.2:0/3043521048 shutdown_connections 2024-09-19T06:21:55.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.624+0000 7f3f4e6ab640 1 --2- 172.21.15.2:0/3043521048 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f3f300a33b0 0x7f3f300a5870 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.624+0000 7f3f4e6ab640 1 --2- 172.21.15.2:0/3043521048 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f48106a80 0x7f3f4819cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.624+0000 7f3f4e6ab640 1 --2- 172.21.15.2:0/3043521048 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f48101420 0x7f3f48198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.624+0000 7f3f4e6ab640 1 --2- 172.21.15.2:0/3043521048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f48100a80 0x7f3f481982e0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.624+0000 7f3f4e6ab640 1 -- 172.21.15.2:0/3043521048 >> 172.21.15.2:0/3043521048 conn(0x7f3f480fc7a0 msgr2=0x7f3f480fcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:55.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.624+0000 7f3f4e6ab640 1 -- 172.21.15.2:0/3043521048 shutdown_connections 2024-09-19T06:21:55.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:55.624+0000 7f3f4e6ab640 1 -- 172.21.15.2:0/3043521048 wait complete. 2024-09-19T06:21:55.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:55 smithi090 ceph-mon[34497]: pgmap v218: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2024-09-19T06:21:55.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:55 smithi089 ceph-mon[34160]: pgmap v218: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2024-09-19T06:21:56.280 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:21:56.539 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:56.661 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:56 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/3043521048' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:21:56.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:56 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/3043521048' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:21:56.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:56 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/3043521048' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:21:57.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.983+0000 7f674552c640 1 -- 172.21.15.2:0/770050988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6740101420 msgr2=0x7f674010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:57.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.983+0000 7f674552c640 1 --2- 172.21.15.2:0/770050988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6740101420 0x7f674010d950 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f6738009cd0 tx=0x7f673802a8e0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.983+0000 7f674552c640 1 -- 172.21.15.2:0/770050988 shutdown_connections 2024-09-19T06:21:57.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.983+0000 7f674552c640 1 --2- 172.21.15.2:0/770050988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6740101420 0x7f674010d950 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.983+0000 7f674552c640 1 --2- 172.21.15.2:0/770050988 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6740100a80 0x7f6740100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.983+0000 7f674552c640 1 --2- 172.21.15.2:0/770050988 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6740106a80 0x7f6740106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.983+0000 7f674552c640 1 -- 172.21.15.2:0/770050988 >> 172.21.15.2:0/770050988 conn(0x7f67400fc7a0 msgr2=0x7f67400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:57.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.983+0000 7f674552c640 1 -- 172.21.15.2:0/770050988 shutdown_connections 2024-09-19T06:21:57.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.983+0000 7f674552c640 1 -- 172.21.15.2:0/770050988 wait complete. 2024-09-19T06:21:57.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.984+0000 7f674552c640 1 Processor -- start 2024-09-19T06:21:57.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.984+0000 7f674552c640 1 -- start start 2024-09-19T06:21:57.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.984+0000 7f674552c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6740100a80 0x7f6740197210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:57.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.984+0000 7f674552c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6740101420 0x7f6740197750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:57.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.984+0000 7f674552c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6740106a80 0x7f674019bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:57.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.984+0000 7f674552c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6740110d30 con 0x7f6740106a80 2024-09-19T06:21:57.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.984+0000 7f674552c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6740110bb0 con 0x7f6740100a80 2024-09-19T06:21:57.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.984+0000 7f674552c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6740110eb0 con 0x7f6740101420 2024-09-19T06:21:57.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.984+0000 7f673f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6740106a80 0x7f674019bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:57.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.984+0000 7f673f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6740106a80 0x7f674019bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45380/0 (socket says 172.21.15.2:45380) 2024-09-19T06:21:57.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.984+0000 7f673f7fe640 1 -- 172.21.15.2:0/3173416043 learned_addr learned my addr 172.21.15.2:0/3173416043 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:57.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.985+0000 7f673e7fc640 1 --2- 172.21.15.2:0/3173416043 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6740101420 0x7f6740197750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:57.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.985+0000 7f673effd640 1 --2- 172.21.15.2:0/3173416043 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6740100a80 0x7f6740197210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:57.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.985+0000 7f673f7fe640 1 -- 172.21.15.2:0/3173416043 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6740101420 msgr2=0x7f6740197750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:57.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.985+0000 7f673f7fe640 1 --2- 172.21.15.2:0/3173416043 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6740101420 0x7f6740197750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.985+0000 7f673f7fe640 1 -- 172.21.15.2:0/3173416043 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6740100a80 msgr2=0x7f6740197210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:57.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.985+0000 7f673f7fe640 1 --2- 172.21.15.2:0/3173416043 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6740100a80 0x7f6740197210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.985+0000 7f673f7fe640 1 -- 172.21.15.2:0/3173416043 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f674019c1c0 con 0x7f6740106a80 2024-09-19T06:21:57.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.985+0000 7f673effd640 1 --2- 172.21.15.2:0/3173416043 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6740100a80 0x7f6740197210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:57.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.985+0000 7f673f7fe640 1 --2- 172.21.15.2:0/3173416043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6740106a80 0x7f674019bae0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f6738005cc0 tx=0x7f6738003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:57.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.985+0000 7f6727fff640 1 -- 172.21.15.2:0/3173416043 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6738004450 con 0x7f6740106a80 2024-09-19T06:21:57.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.985+0000 7f6727fff640 1 -- 172.21.15.2:0/3173416043 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6738031c90 con 0x7f6740106a80 2024-09-19T06:21:57.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.985+0000 7f674552c640 1 -- 172.21.15.2:0/3173416043 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f674019c450 con 0x7f6740106a80 2024-09-19T06:21:57.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.985+0000 7f6727fff640 1 -- 172.21.15.2:0/3173416043 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673803b400 con 0x7f6740106a80 2024-09-19T06:21:57.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.985+0000 7f674552c640 1 -- 172.21.15.2:0/3173416043 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67401a3d90 con 0x7f6740106a80 2024-09-19T06:21:57.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.988+0000 7f6727fff640 1 -- 172.21.15.2:0/3173416043 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f6738004680 con 0x7f6740106a80 2024-09-19T06:21:57.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.988+0000 7f6747905740 1 Processor -- start 2024-09-19T06:21:57.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.988+0000 7f6747905740 1 -- start start 2024-09-19T06:21:57.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.988+0000 7f6747905740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cec887b40 0x560cec886090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:57.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.988+0000 7f6747905740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cec8865d0 0x560cec886a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:57.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.988+0000 7f6747905740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cec893580 0x560cec895970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:57.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.988+0000 7f6747905740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560cec7ec2f0 con 0x560cec887b40 2024-09-19T06:21:57.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.988+0000 7f6747905740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x560cec793cf0 con 0x560cec893580 2024-09-19T06:21:57.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.988+0000 7f6747905740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560cec7e82b0 con 0x560cec8865d0 2024-09-19T06:21:57.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.988+0000 7f673e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cec887b40 0x560cec886090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:57.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.988+0000 7f673e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cec887b40 0x560cec886090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45388/0 (socket says 172.21.15.2:45388) 2024-09-19T06:21:57.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.988+0000 7f673e7fc640 1 -- 172.21.15.2:0/1439069131 learned_addr learned my addr 172.21.15.2:0/1439069131 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:57.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.988+0000 7f6727fff640 1 --2- 172.21.15.2:0/3173416043 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f67280a33b0 0x7f67280a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:57.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.988+0000 7f673effd640 1 --2- 172.21.15.2:0/1439069131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cec8865d0 0x560cec886a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:57.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.989+0000 7f673f7fe640 1 --2- 172.21.15.2:0/3173416043 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f67280a33b0 0x7f67280a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:57.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.989+0000 7f673e7fc640 1 -- 172.21.15.2:0/1439069131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cec8865d0 msgr2=0x560cec886a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:57.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.989+0000 7f673e7fc640 1 --2- 172.21.15.2:0/1439069131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cec8865d0 0x560cec886a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.989+0000 7f673e7fc640 1 -- 172.21.15.2:0/1439069131 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cec893580 msgr2=0x560cec895970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:57.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.989+0000 7f673e7fc640 1 --2- 172.21.15.2:0/1439069131 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cec893580 0x560cec895970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.989+0000 7f673e7fc640 1 -- 172.21.15.2:0/1439069131 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cec7783a0 con 0x560cec887b40 2024-09-19T06:21:57.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.989+0000 7f673effd640 1 --2- 172.21.15.2:0/1439069131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cec8865d0 0x560cec886a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:57.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.989+0000 7f6727fff640 1 -- 172.21.15.2:0/3173416043 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f673802e030 con 0x7f6740106a80 2024-09-19T06:21:57.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.989+0000 7f673e7fc640 1 --2- 172.21.15.2:0/1439069131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cec887b40 0x560cec886090 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f673400b790 tx=0x7f673400bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22bff89847b44ae1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:57.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.989+0000 7f67257fa640 1 -- 172.21.15.2:0/1439069131 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673400bea0 con 0x560cec887b40 2024-09-19T06:21:57.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.989+0000 7f673f7fe640 1 --2- 172.21.15.2:0/3173416043 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f67280a33b0 0x7f67280a5870 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f67380b9640 tx=0x7f673808ef60 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:57.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.989+0000 7f67257fa640 1 -- 172.21.15.2:0/1439069131 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6734016030 con 0x560cec887b40 2024-09-19T06:21:57.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.989+0000 7f67257fa640 1 -- 172.21.15.2:0/1439069131 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6734004cf0 con 0x560cec887b40 2024-09-19T06:21:57.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.990+0000 7f6747905740 1 -- 172.21.15.2:0/1439069131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cec887b40 msgr2=0x560cec886090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:57.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.990+0000 7f6747905740 1 --2- 172.21.15.2:0/1439069131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cec887b40 0x560cec886090 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f673400b790 tx=0x7f673400bc50 comp rx=0 tx=0).stop 2024-09-19T06:21:57.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.990+0000 7f6747905740 1 -- 172.21.15.2:0/1439069131 shutdown_connections 2024-09-19T06:21:57.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.990+0000 7f6747905740 1 --2- 172.21.15.2:0/1439069131 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cec893580 0x560cec895970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.990+0000 7f6747905740 1 --2- 172.21.15.2:0/1439069131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cec8865d0 0x560cec886a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.990+0000 7f6747905740 1 --2- 172.21.15.2:0/1439069131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cec887b40 0x560cec886090 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.990+0000 7f6747905740 1 -- 172.21.15.2:0/1439069131 >> 172.21.15.2:0/1439069131 conn(0x560cec84f310 msgr2=0x560cec882c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:57.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.990+0000 7f6747905740 1 -- 172.21.15.2:0/1439069131 shutdown_connections 2024-09-19T06:21:57.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.990+0000 7f6747905740 1 -- 172.21.15.2:0/1439069131 wait complete. 2024-09-19T06:21:57.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.990+0000 7f6747905740 1 -- start start 2024-09-19T06:21:57.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.990+0000 7f6747905740 1 Processor -- start 2024-09-19T06:21:57.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.990+0000 7f6747905740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cec8865d0 0x560cec88e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:57.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.990+0000 7f6747905740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cec887b40 0x560cec88ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:57.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.990+0000 7f6747905740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cec893580 0x560cec88f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:57.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.990+0000 7f6747905740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560cec8894f0 con 0x560cec893580 2024-09-19T06:21:57.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.990+0000 7f6747905740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x560cec7a7060 con 0x560cec8865d0 2024-09-19T06:21:57.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.990+0000 7f6747905740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560cec889670 con 0x560cec887b40 2024-09-19T06:21:57.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.990+0000 7f6747905740 10 client.0 _ll_register_callbacks cb 0x560cec4fa8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:57.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.991+0000 7f673e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cec893580 0x560cec88f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:57.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.991+0000 7f673e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cec893580 0x560cec88f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45404/0 (socket says 172.21.15.2:45404) 2024-09-19T06:21:57.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.991+0000 7f673e7fc640 1 -- 172.21.15.2:0/3890611102 learned_addr learned my addr 172.21.15.2:0/3890611102 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:57.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.991+0000 7f673e7fc640 1 --2- 172.21.15.2:0/3890611102 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cec8865d0 0x560cec88e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:57.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.991+0000 7f673effd640 1 --2- 172.21.15.2:0/3890611102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cec887b40 0x560cec88ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:57.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.991+0000 7f673e7fc640 1 -- 172.21.15.2:0/3890611102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cec887b40 msgr2=0x560cec88ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:57.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.991+0000 7f673e7fc640 1 --2- 172.21.15.2:0/3890611102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cec887b40 0x560cec88ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.991+0000 7f673e7fc640 1 -- 172.21.15.2:0/3890611102 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cec8865d0 msgr2=0x560cec88e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:57.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.991+0000 7f673e7fc640 1 --2- 172.21.15.2:0/3890611102 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cec8865d0 0x560cec88e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.991+0000 7f673e7fc640 1 -- 172.21.15.2:0/3890611102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cec55d3c0 con 0x560cec893580 2024-09-19T06:21:57.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.991+0000 7f673effd640 1 --2- 172.21.15.2:0/3890611102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cec887b40 0x560cec88ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:21:57.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.991+0000 7f673e7fc640 1 --2- 172.21.15.2:0/3890611102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cec893580 0x560cec88f100 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f67340045a0 tx=0x7f67340042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db82756335db72d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:57.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.991+0000 7f6722ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:57.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.991+0000 7f6722ff5640 1 -- 172.21.15.2:0/3890611102 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6734024040 con 0x560cec893580 2024-09-19T06:21:57.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.991+0000 7f6722ff5640 1 -- 172.21.15.2:0/3890611102 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f673401b670 con 0x560cec893580 2024-09-19T06:21:57.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.991+0000 7f6747905740 1 -- 172.21.15.2:0/3890611102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6734016030 con 0x560cec893580 2024-09-19T06:21:57.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.991+0000 7f6722ff5640 1 -- 172.21.15.2:0/3890611102 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6734031050 con 0x560cec893580 2024-09-19T06:21:57.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.991+0000 7f6747905740 10 client.17697 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:57.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.991+0000 7f6747905740 1 -- 172.21.15.2:0/3890611102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560cec89fb00 con 0x560cec893580 2024-09-19T06:21:57.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.992+0000 7f6722ff5640 1 -- 172.21.15.2:0/3890611102 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6734016030 con 0x560cec893580 2024-09-19T06:21:57.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.992+0000 7f6722ff5640 1 -- 172.21.15.2:0/3890611102 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f6734010780 con 0x560cec893580 2024-09-19T06:21:57.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.992+0000 7f6747905740 10 client.17697 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:57.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.992+0000 7f6747905740 10 client.17697 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:21:57.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.992+0000 7f6747905740 20 client.17697 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:57.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.992+0000 7f6747905740 1 --2- 172.21.15.2:0/3890611102 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x560cec8a0fc0 0x560cec8a33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:57.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.992+0000 7f6747905740 4 client.17697 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:57.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.992+0000 7f6747905740 1 -- 172.21.15.2:0/3890611102 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560cec7f9860 con 0x560cec8a0fc0 2024-09-19T06:21:57.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.992+0000 7f673effd640 1 --2- 172.21.15.2:0/3890611102 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x560cec8a0fc0 0x560cec8a33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:57.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.993+0000 7f6722ff5640 10 client.17697 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:21:57.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.993+0000 7f673effd640 1 --2- 172.21.15.2:0/3890611102 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x560cec8a0fc0 0x560cec8a33b0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9642feb7b7ba7dc server_cookie=1acb83746318fa50 in_seq=0 out_seq=0 2024-09-19T06:21:57.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.994+0000 7f6722ff5640 1 -- 172.21.15.2:0/3890611102 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560cec7f9860 con 0x560cec8a0fc0 2024-09-19T06:21:57.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.994+0000 7f6722ff5640 10 client.17697 handle_command_reply: tid=0 2024-09-19T06:21:57.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.994+0000 7f6747905740 1 client.17697 shutdown 2024-09-19T06:21:57.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.994+0000 7f6747905740 1 -- 172.21.15.2:0/3890611102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cec893580 msgr2=0x560cec88f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:57.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.994+0000 7f6747905740 1 --2- 172.21.15.2:0/3890611102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cec893580 0x560cec88f100 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f67340045a0 tx=0x7f67340042c0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.994+0000 7f6747905740 1 -- 172.21.15.2:0/3890611102 shutdown_connections 2024-09-19T06:21:57.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.994+0000 7f6747905740 1 --2- 172.21.15.2:0/3890611102 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x560cec8a0fc0 0x560cec8a33b0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.994+0000 7f6747905740 1 --2- 172.21.15.2:0/3890611102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cec893580 0x560cec88f100 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.994+0000 7f6747905740 1 --2- 172.21.15.2:0/3890611102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cec887b40 0x560cec88ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.994+0000 7f6722ff5640 0 client.17697 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:21:57.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.994+0000 7f6747905740 1 --2- 172.21.15.2:0/3890611102 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cec8865d0 0x560cec88e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.994+0000 7f6747905740 1 -- 172.21.15.2:0/3890611102 >> 172.21.15.2:0/3890611102 conn(0x560cec84f310 msgr2=0x560cec888960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:57.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.994+0000 7f6747905740 1 -- 172.21.15.2:0/3890611102 shutdown_connections 2024-09-19T06:21:57.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.994+0000 7f6747905740 1 -- 172.21.15.2:0/3890611102 wait complete. 2024-09-19T06:21:57.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:56.994+0000 7f6747905740 20 client.17697 trim_cache size 0 max 16384 2024-09-19T06:21:57.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.007+0000 7f6747905740 1 Processor -- start 2024-09-19T06:21:57.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.007+0000 7f6747905740 1 -- start start 2024-09-19T06:21:57.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.007+0000 7f6747905740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cec8865d0 0x560cec88ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:57.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.007+0000 7f6747905740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cec887b40 0x560cec8a8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:57.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.007+0000 7f6747905740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cec893580 0x560cec8a9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:57.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.007+0000 7f6747905740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f67401b21a0 con 0x560cec887b40 2024-09-19T06:21:57.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.007+0000 7f6747905740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f67401afa70 con 0x560cec893580 2024-09-19T06:21:57.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.007+0000 7f6747905740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f67401ad8e0 con 0x560cec8865d0 2024-09-19T06:21:57.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.007+0000 7f673effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cec887b40 0x560cec8a8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:57.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.007+0000 7f673effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cec887b40 0x560cec8a8b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45414/0 (socket says 172.21.15.2:45414) 2024-09-19T06:21:57.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.007+0000 7f673effd640 1 -- 172.21.15.2:0/4140785392 learned_addr learned my addr 172.21.15.2:0/4140785392 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:57.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.007+0000 7f673e7fc640 1 --2- 172.21.15.2:0/4140785392 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cec893580 0x560cec8a9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:57.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.007+0000 7f673e7fc640 1 --2- 172.21.15.2:0/4140785392 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cec8865d0 0x560cec88ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:57.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.007+0000 7f673effd640 1 -- 172.21.15.2:0/4140785392 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cec8865d0 msgr2=0x560cec88ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:57.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.007+0000 7f673effd640 1 --2- 172.21.15.2:0/4140785392 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cec8865d0 0x560cec88ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.007+0000 7f673effd640 1 -- 172.21.15.2:0/4140785392 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cec893580 msgr2=0x560cec8a9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:57.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.007+0000 7f673effd640 1 --2- 172.21.15.2:0/4140785392 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cec893580 0x560cec8a9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.008+0000 7f673effd640 1 -- 172.21.15.2:0/4140785392 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cec88d630 con 0x560cec887b40 2024-09-19T06:21:57.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.008+0000 7f673e7fc640 1 --2- 172.21.15.2:0/4140785392 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cec8865d0 0x560cec88ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:21:57.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.008+0000 7f673effd640 1 --2- 172.21.15.2:0/4140785392 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cec887b40 0x560cec8a8b40 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x560cec88df10 tx=0x7f673000f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18aad39a8ba9951d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:57.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.008+0000 7f6724ff9640 1 -- 172.21.15.2:0/4140785392 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6730021070 con 0x560cec887b40 2024-09-19T06:21:57.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.008+0000 7f6724ff9640 1 -- 172.21.15.2:0/4140785392 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f67300054d0 con 0x560cec887b40 2024-09-19T06:21:57.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.008+0000 7f6724ff9640 1 -- 172.21.15.2:0/4140785392 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6730004b20 con 0x560cec887b40 2024-09-19T06:21:57.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.008+0000 7f6747905740 1 -- 172.21.15.2:0/4140785392 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cec887b40 msgr2=0x560cec8a8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:57.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.008+0000 7f6747905740 1 --2- 172.21.15.2:0/4140785392 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cec887b40 0x560cec8a8b40 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x560cec88df10 tx=0x7f673000f3c0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.008+0000 7f6747905740 1 -- 172.21.15.2:0/4140785392 shutdown_connections 2024-09-19T06:21:57.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.008+0000 7f6747905740 1 --2- 172.21.15.2:0/4140785392 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cec893580 0x560cec8a9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.008+0000 7f6747905740 1 --2- 172.21.15.2:0/4140785392 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cec887b40 0x560cec8a8b40 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.008+0000 7f6747905740 1 --2- 172.21.15.2:0/4140785392 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cec8865d0 0x560cec88ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.009+0000 7f6747905740 1 -- 172.21.15.2:0/4140785392 >> 172.21.15.2:0/4140785392 conn(0x560cec84f310 msgr2=0x560cec88e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:57.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.009+0000 7f6747905740 1 -- 172.21.15.2:0/4140785392 shutdown_connections 2024-09-19T06:21:57.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.009+0000 7f6747905740 1 -- 172.21.15.2:0/4140785392 wait complete. 2024-09-19T06:21:57.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.009+0000 7f6747905740 1 -- start start 2024-09-19T06:21:57.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.009+0000 7f6747905740 1 Processor -- start 2024-09-19T06:21:57.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.009+0000 7f6747905740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cec8865d0 0x560cec897e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:57.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.009+0000 7f6747905740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cec887b40 0x560cec898370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:57.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.009+0000 7f6747905740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cec893580 0x560cec8988b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:57.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.009+0000 7f6747905740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f67401adf30 con 0x560cec887b40 2024-09-19T06:21:57.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.009+0000 7f6747905740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f67401af3a0 con 0x560cec893580 2024-09-19T06:21:57.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.009+0000 7f6747905740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f67401ae600 con 0x560cec8865d0 2024-09-19T06:21:57.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.009+0000 7f6747905740 10 client.0 _ll_register_callbacks cb 0x7f673400b690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:57.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.009+0000 7f673effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cec887b40 0x560cec898370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:57.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.009+0000 7f673effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cec887b40 0x560cec898370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45424/0 (socket says 172.21.15.2:45424) 2024-09-19T06:21:57.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.009+0000 7f673effd640 1 -- 172.21.15.2:0/4141566379 learned_addr learned my addr 172.21.15.2:0/4141566379 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:57.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.010+0000 7f673e7fc640 1 --2- 172.21.15.2:0/4141566379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cec893580 0x560cec8988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:57.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.010+0000 7f673e7fc640 1 --2- 172.21.15.2:0/4141566379 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cec8865d0 0x560cec897e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:57.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.010+0000 7f673effd640 1 -- 172.21.15.2:0/4141566379 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cec8865d0 msgr2=0x560cec897e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:57.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.010+0000 7f673effd640 1 --2- 172.21.15.2:0/4141566379 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cec8865d0 0x560cec897e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.010+0000 7f673effd640 1 -- 172.21.15.2:0/4141566379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cec893580 msgr2=0x560cec8988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:57.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.010+0000 7f673effd640 1 --2- 172.21.15.2:0/4141566379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cec893580 0x560cec8988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.010+0000 7f673effd640 1 -- 172.21.15.2:0/4141566379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cec90ab10 con 0x560cec887b40 2024-09-19T06:21:57.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.010+0000 7f673effd640 1 --2- 172.21.15.2:0/4141566379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cec887b40 0x560cec898370 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f6730000c00 tx=0x7f6730005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acafff87faa533a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:57.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.010+0000 7f6722ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:57.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.010+0000 7f6722ff5640 1 -- 172.21.15.2:0/4141566379 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6730035060 con 0x560cec887b40 2024-09-19T06:21:57.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.010+0000 7f6722ff5640 1 -- 172.21.15.2:0/4141566379 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f6730004230 con 0x560cec887b40 2024-09-19T06:21:57.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.010+0000 7f6747905740 1 -- 172.21.15.2:0/4141566379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67300054d0 con 0x560cec887b40 2024-09-19T06:21:57.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.010+0000 7f6722ff5640 1 -- 172.21.15.2:0/4141566379 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6730021040 con 0x560cec887b40 2024-09-19T06:21:57.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.010+0000 7f6747905740 10 client.17703 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:57.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.010+0000 7f6747905740 1 -- 172.21.15.2:0/4141566379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560cec90bc80 con 0x560cec887b40 2024-09-19T06:21:57.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.010+0000 7f6722ff5640 1 -- 172.21.15.2:0/4141566379 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f67300054d0 con 0x560cec887b40 2024-09-19T06:21:57.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.011+0000 7f6722ff5640 1 -- 172.21.15.2:0/4141566379 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f673001d580 con 0x560cec887b40 2024-09-19T06:21:57.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.011+0000 7f6747905740 10 client.17703 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:57.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.011+0000 7f6747905740 10 client.17703 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:21:57.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.011+0000 7f6747905740 20 client.17703 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:57.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.011+0000 7f6747905740 1 --2- 172.21.15.2:0/4141566379 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x560cec90c370 0x560cec90e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:57.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.011+0000 7f6747905740 4 client.17703 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:21:57.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.011+0000 7f6747905740 1 -- 172.21.15.2:0/4141566379 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560cec7f3d70 con 0x560cec90c370 2024-09-19T06:21:57.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.011+0000 7f673e7fc640 1 --2- 172.21.15.2:0/4141566379 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x560cec90c370 0x560cec90e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:57.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.011+0000 7f673e7fc640 1 --2- 172.21.15.2:0/4141566379 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x560cec90c370 0x560cec90e790 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=762a1d52352f72cd server_cookie=1fb71fe8e043d689 in_seq=0 out_seq=0 2024-09-19T06:21:57.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.011+0000 7f6722ff5640 10 client.17703 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:21:57.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.012+0000 7f6722ff5640 1 -- 172.21.15.2:0/4141566379 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560cec7f3d70 con 0x560cec90c370 2024-09-19T06:21:57.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.012+0000 7f6722ff5640 10 client.17703 handle_command_reply: tid=0 2024-09-19T06:21:57.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.012+0000 7f6747905740 1 client.17703 shutdown 2024-09-19T06:21:57.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.012+0000 7f6747905740 1 -- 172.21.15.2:0/4141566379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cec887b40 msgr2=0x560cec898370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:57.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.012+0000 7f6747905740 1 --2- 172.21.15.2:0/4141566379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cec887b40 0x560cec898370 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f6730000c00 tx=0x7f6730005760 comp rx=0 tx=0).stop 2024-09-19T06:21:57.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.012+0000 7f6747905740 1 -- 172.21.15.2:0/4141566379 shutdown_connections 2024-09-19T06:21:57.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.012+0000 7f6747905740 1 --2- 172.21.15.2:0/4141566379 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x560cec90c370 0x560cec90e790 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.012+0000 7f6747905740 1 --2- 172.21.15.2:0/4141566379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cec893580 0x560cec8988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.012+0000 7f6747905740 1 --2- 172.21.15.2:0/4141566379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cec887b40 0x560cec898370 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.012+0000 7f6747905740 1 --2- 172.21.15.2:0/4141566379 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cec8865d0 0x560cec897e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.012+0000 7f6747905740 1 -- 172.21.15.2:0/4141566379 >> 172.21.15.2:0/4141566379 conn(0x560cec84f310 msgr2=0x560cec892710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:57.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.012+0000 7f6722ff5640 0 client.17703 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:21:57.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.012+0000 7f6747905740 1 -- 172.21.15.2:0/4141566379 shutdown_connections 2024-09-19T06:21:57.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.012+0000 7f6747905740 1 -- 172.21.15.2:0/4141566379 wait complete. 2024-09-19T06:21:57.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.012+0000 7f6747905740 20 client.17703 trim_cache size 0 max 16384 2024-09-19T06:21:57.023 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:21:57.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.012+0000 7f674552c640 1 -- 172.21.15.2:0/3173416043 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f67280a33b0 msgr2=0x7f67280a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:57.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.012+0000 7f674552c640 1 --2- 172.21.15.2:0/3173416043 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f67280a33b0 0x7f67280a5870 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f67380b9640 tx=0x7f673808ef60 comp rx=0 tx=0).stop 2024-09-19T06:21:57.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.012+0000 7f674552c640 1 -- 172.21.15.2:0/3173416043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6740106a80 msgr2=0x7f674019bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:57.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.012+0000 7f674552c640 1 --2- 172.21.15.2:0/3173416043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6740106a80 0x7f674019bae0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f6738005cc0 tx=0x7f6738003c20 comp rx=0 tx=0).stop 2024-09-19T06:21:57.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.012+0000 7f674552c640 1 -- 172.21.15.2:0/3173416043 shutdown_connections 2024-09-19T06:21:57.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.012+0000 7f674552c640 1 --2- 172.21.15.2:0/3173416043 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f67280a33b0 0x7f67280a5870 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.012+0000 7f674552c640 1 --2- 172.21.15.2:0/3173416043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6740106a80 0x7f674019bae0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.012+0000 7f674552c640 1 --2- 172.21.15.2:0/3173416043 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6740101420 0x7f6740197750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.012+0000 7f674552c640 1 --2- 172.21.15.2:0/3173416043 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6740100a80 0x7f6740197210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.013+0000 7f674552c640 1 -- 172.21.15.2:0/3173416043 >> 172.21.15.2:0/3173416043 conn(0x7f67400fc7a0 msgr2=0x7f67400fcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:57.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.013+0000 7f674552c640 1 -- 172.21.15.2:0/3173416043 shutdown_connections 2024-09-19T06:21:57.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:57.013+0000 7f674552c640 1 -- 172.21.15.2:0/3173416043 wait complete. 2024-09-19T06:21:57.641 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:57 smithi090 ceph-mon[34497]: pgmap v219: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:21:57.693 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:57 smithi089 ceph-mon[34160]: pgmap v219: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:21:57.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:57 smithi002 ceph-mon[30982]: pgmap v219: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:21:57.808 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:21:58.068 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:58.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.458+0000 7f730df51640 1 -- 172.21.15.2:0/4184420138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7308102790 msgr2=0x7f73081067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:58.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.458+0000 7f730df51640 1 --2- 172.21.15.2:0/4184420138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7308102790 0x7f73081067e0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f72fc009900 tx=0x7f72fc02a410 comp rx=0 tx=0).stop 2024-09-19T06:21:58.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.458+0000 7f730df51640 1 -- 172.21.15.2:0/4184420138 shutdown_connections 2024-09-19T06:21:58.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.458+0000 7f730df51640 1 --2- 172.21.15.2:0/4184420138 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7308106f10 0x7f730810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:58.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.458+0000 7f730df51640 1 --2- 172.21.15.2:0/4184420138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7308102790 0x7f73081067e0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:58.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.458+0000 7f730df51640 1 --2- 172.21.15.2:0/4184420138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7308101de0 0x7f73081021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:58.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.458+0000 7f730df51640 1 -- 172.21.15.2:0/4184420138 >> 172.21.15.2:0/4184420138 conn(0x7f73080fd8c0 msgr2=0x7f73080ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:58.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.458+0000 7f730df51640 1 -- 172.21.15.2:0/4184420138 shutdown_connections 2024-09-19T06:21:58.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.458+0000 7f730df51640 1 -- 172.21.15.2:0/4184420138 wait complete. 2024-09-19T06:21:58.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.459+0000 7f730df51640 1 Processor -- start 2024-09-19T06:21:58.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.459+0000 7f730df51640 1 -- start start 2024-09-19T06:21:58.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.460+0000 7f730df51640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7308101de0 0x7f7308198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:58.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.460+0000 7f730df51640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7308102790 0x7f7308198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:58.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.460+0000 7f730df51640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7308106f10 0x7f730819cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:58.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.460+0000 7f730df51640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7308111e40 con 0x7f7308101de0 2024-09-19T06:21:58.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.460+0000 7f730df51640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7308111cc0 con 0x7f7308106f10 2024-09-19T06:21:58.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.460+0000 7f730df51640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7308111fc0 con 0x7f7308102790 2024-09-19T06:21:58.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.460+0000 7f73077fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7308101de0 0x7f7308198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:58.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.460+0000 7f73077fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7308101de0 0x7f7308198320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45446/0 (socket says 172.21.15.2:45446) 2024-09-19T06:21:58.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.460+0000 7f73077fe640 1 -- 172.21.15.2:0/1133941852 learned_addr learned my addr 172.21.15.2:0/1133941852 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:58.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.460+0000 7f7306ffd640 1 --2- 172.21.15.2:0/1133941852 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7308102790 0x7f7308198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:58.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.460+0000 7f7307fff640 1 --2- 172.21.15.2:0/1133941852 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7308106f10 0x7f730819cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:58.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.460+0000 7f73077fe640 1 -- 172.21.15.2:0/1133941852 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7308102790 msgr2=0x7f7308198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:58.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.460+0000 7f73077fe640 1 --2- 172.21.15.2:0/1133941852 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7308102790 0x7f7308198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:58.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.460+0000 7f73077fe640 1 -- 172.21.15.2:0/1133941852 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7308106f10 msgr2=0x7f730819cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:58.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.460+0000 7f73077fe640 1 --2- 172.21.15.2:0/1133941852 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7308106f10 0x7f730819cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:58.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.460+0000 7f73077fe640 1 -- 172.21.15.2:0/1133941852 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f730819d2d0 con 0x7f7308101de0 2024-09-19T06:21:58.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.460+0000 7f73077fe640 1 --2- 172.21.15.2:0/1133941852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7308101de0 0x7f7308198320 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f72f800c920 tx=0x7f72f800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:58.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.460+0000 7f7304ff9640 1 -- 172.21.15.2:0/1133941852 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f8007c70 con 0x7f7308101de0 2024-09-19T06:21:58.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.461+0000 7f730df51640 1 -- 172.21.15.2:0/1133941852 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f730819d5c0 con 0x7f7308101de0 2024-09-19T06:21:58.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.461+0000 7f7304ff9640 1 -- 172.21.15.2:0/1133941852 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f72f8007e10 con 0x7f7308101de0 2024-09-19T06:21:58.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.461+0000 7f7304ff9640 1 -- 172.21.15.2:0/1133941852 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f8018820 con 0x7f7308101de0 2024-09-19T06:21:58.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.461+0000 7f730df51640 1 -- 172.21.15.2:0/1133941852 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73081a4ea0 con 0x7f7308101de0 2024-09-19T06:21:58.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.463+0000 7f7304ff9640 1 -- 172.21.15.2:0/1133941852 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f72f80189c0 con 0x7f7308101de0 2024-09-19T06:21:58.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.463+0000 7f731032a740 1 Processor -- start 2024-09-19T06:21:58.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.463+0000 7f731032a740 1 -- start start 2024-09-19T06:21:58.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.464+0000 7f731032a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565405205b40 0x565405204090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:58.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.464+0000 7f731032a740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5654052045d0 0x565405204a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:58.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.464+0000 7f731032a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56540520f370 0x565405211760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:58.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.464+0000 7f731032a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56540516a2f0 con 0x565405205b40 2024-09-19T06:21:58.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.464+0000 7f731032a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x565405111cf0 con 0x56540520f370 2024-09-19T06:21:58.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.464+0000 7f731032a740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5654051662b0 con 0x5654052045d0 2024-09-19T06:21:58.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.464+0000 7f7307fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565405205b40 0x565405204090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:58.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.464+0000 7f7304ff9640 1 --2- 172.21.15.2:0/1133941852 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f72f00a33b0 0x7f72f00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:58.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.464+0000 7f7307fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565405205b40 0x565405204090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45462/0 (socket says 172.21.15.2:45462) 2024-09-19T06:21:58.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.464+0000 7f7307fff640 1 -- 172.21.15.2:0/3738516222 learned_addr learned my addr 172.21.15.2:0/3738516222 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:58.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.464+0000 7f7306ffd640 1 --2- 172.21.15.2:0/3738516222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56540520f370 0x565405211760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:58.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.464+0000 7f7307fff640 1 --2- 172.21.15.2:0/1133941852 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f72f00a33b0 0x7f72f00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:58.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.464+0000 7f7304ff9640 1 -- 172.21.15.2:0/1133941852 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f72f80cfe50 con 0x7f7308101de0 2024-09-19T06:21:58.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.464+0000 7f73077fe640 1 --2- 172.21.15.2:0/3738516222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5654052045d0 0x565405204a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:58.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.464+0000 7f7307fff640 1 -- 172.21.15.2:0/3738516222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5654052045d0 msgr2=0x565405204a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:58.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.464+0000 7f7307fff640 1 --2- 172.21.15.2:0/3738516222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5654052045d0 0x565405204a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:58.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.464+0000 7f7307fff640 1 -- 172.21.15.2:0/3738516222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56540520f370 msgr2=0x565405211760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:58.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.464+0000 7f7307fff640 1 --2- 172.21.15.2:0/3738516222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56540520f370 0x565405211760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:58.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.464+0000 7f7307fff640 1 -- 172.21.15.2:0/3738516222 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654050f63a0 con 0x565405205b40 2024-09-19T06:21:58.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.464+0000 7f7307fff640 1 --2- 172.21.15.2:0/3738516222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565405205b40 0x565405204090 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f730000cb20 tx=0x7f73000072b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae126c49bef855d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:58.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.464+0000 7f72edffb640 1 -- 172.21.15.2:0/3738516222 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7300015070 con 0x565405205b40 2024-09-19T06:21:58.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.465+0000 7f72edffb640 1 -- 172.21.15.2:0/3738516222 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7300016040 con 0x565405205b40 2024-09-19T06:21:58.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.465+0000 7f7307fff640 1 --2- 172.21.15.2:0/1133941852 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f72f00a33b0 0x7f72f00a5870 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f730001f000 tx=0x7f730001b000 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:58.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.465+0000 7f72edffb640 1 -- 172.21.15.2:0/3738516222 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f730001e020 con 0x565405205b40 2024-09-19T06:21:58.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.465+0000 7f731032a740 1 -- 172.21.15.2:0/3738516222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565405205b40 msgr2=0x565405204090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:58.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.465+0000 7f731032a740 1 --2- 172.21.15.2:0/3738516222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565405205b40 0x565405204090 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f730000cb20 tx=0x7f73000072b0 comp rx=0 tx=0).stop 2024-09-19T06:21:58.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.465+0000 7f731032a740 1 -- 172.21.15.2:0/3738516222 shutdown_connections 2024-09-19T06:21:58.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.465+0000 7f731032a740 1 --2- 172.21.15.2:0/3738516222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56540520f370 0x565405211760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:58.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.465+0000 7f731032a740 1 --2- 172.21.15.2:0/3738516222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5654052045d0 0x565405204a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:58.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.465+0000 7f731032a740 1 --2- 172.21.15.2:0/3738516222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565405205b40 0x565405204090 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:58.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.465+0000 7f731032a740 1 -- 172.21.15.2:0/3738516222 >> 172.21.15.2:0/3738516222 conn(0x5654051cd310 msgr2=0x565405200c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:58.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.465+0000 7f731032a740 1 -- 172.21.15.2:0/3738516222 shutdown_connections 2024-09-19T06:21:58.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.465+0000 7f731032a740 1 -- 172.21.15.2:0/3738516222 wait complete. 2024-09-19T06:21:58.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.466+0000 7f731032a740 1 -- start start 2024-09-19T06:21:58.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.466+0000 7f731032a740 1 Processor -- start 2024-09-19T06:21:58.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.466+0000 7f731032a740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5654052045d0 0x56540520ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:58.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.466+0000 7f731032a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565405205b40 0x56540520bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:58.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.466+0000 7f731032a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56540520f370 0x56540520c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:58.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.466+0000 7f731032a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x565405212070 con 0x56540520f370 2024-09-19T06:21:58.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.466+0000 7f731032a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x565405125060 con 0x565405205b40 2024-09-19T06:21:58.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.466+0000 7f731032a740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5654052121f0 con 0x5654052045d0 2024-09-19T06:21:58.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.466+0000 7f731032a740 10 client.0 _ll_register_callbacks cb 0x565404e788c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:58.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.466+0000 7f7307fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56540520f370 0x56540520c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:58.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.467+0000 7f7306ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565405205b40 0x56540520bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:58.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.467+0000 7f7307fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56540520f370 0x56540520c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45466/0 (socket says 172.21.15.2:45466) 2024-09-19T06:21:58.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.467+0000 7f7307fff640 1 -- 172.21.15.2:0/4050474715 learned_addr learned my addr 172.21.15.2:0/4050474715 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:58.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.467+0000 7f73077fe640 1 --2- 172.21.15.2:0/4050474715 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5654052045d0 0x56540520ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:58.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.467+0000 7f7307fff640 1 -- 172.21.15.2:0/4050474715 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5654052045d0 msgr2=0x56540520ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:58.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.467+0000 7f7307fff640 1 --2- 172.21.15.2:0/4050474715 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5654052045d0 0x56540520ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:58.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.467+0000 7f7307fff640 1 -- 172.21.15.2:0/4050474715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565405205b40 msgr2=0x56540520bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:58.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.467+0000 7f7307fff640 1 --2- 172.21.15.2:0/4050474715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565405205b40 0x56540520bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:58.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.467+0000 7f7307fff640 1 -- 172.21.15.2:0/4050474715 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565404edb3c0 con 0x56540520f370 2024-09-19T06:21:58.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.467+0000 7f7306ffd640 1 --2- 172.21.15.2:0/4050474715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565405205b40 0x56540520bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:58.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.467+0000 7f73077fe640 1 --2- 172.21.15.2:0/4050474715 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5654052045d0 0x56540520ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:58.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.467+0000 7f7307fff640 1 --2- 172.21.15.2:0/4050474715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56540520f370 0x56540520c600 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f7300009580 tx=0x7f730001a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f18264f78967516 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:58.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.467+0000 7f72e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:58.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.467+0000 7f72e6ffd640 1 -- 172.21.15.2:0/4050474715 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7300015050 con 0x56540520f370 2024-09-19T06:21:58.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.467+0000 7f72e6ffd640 1 -- 172.21.15.2:0/4050474715 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f730000a6c0 con 0x56540520f370 2024-09-19T06:21:58.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.467+0000 7f731032a740 1 -- 172.21.15.2:0/4050474715 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7300016040 con 0x56540520f370 2024-09-19T06:21:58.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.468+0000 7f72e6ffd640 1 -- 172.21.15.2:0/4050474715 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f730001e040 con 0x56540520f370 2024-09-19T06:21:58.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.468+0000 7f731032a740 10 client.17715 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:58.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.468+0000 7f731032a740 1 -- 172.21.15.2:0/4050474715 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x565405221ef0 con 0x56540520f370 2024-09-19T06:21:58.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.468+0000 7f72e6ffd640 1 -- 172.21.15.2:0/4050474715 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7300016040 con 0x56540520f370 2024-09-19T06:21:58.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.468+0000 7f72e6ffd640 1 -- 172.21.15.2:0/4050474715 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f730002b430 con 0x56540520f370 2024-09-19T06:21:58.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.468+0000 7f731032a740 10 client.17715 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:58.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.468+0000 7f731032a740 10 client.17715 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:21:58.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.468+0000 7f731032a740 20 client.17715 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:58.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.468+0000 7f731032a740 1 --2- 172.21.15.2:0/4050474715 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5654052233b0 0x5654052257a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:58.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.468+0000 7f731032a740 4 client.17715 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:58.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.468+0000 7f731032a740 1 -- 172.21.15.2:0/4050474715 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565405177860 con 0x5654052233b0 2024-09-19T06:21:58.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.469+0000 7f73077fe640 1 --2- 172.21.15.2:0/4050474715 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5654052233b0 0x5654052257a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:58.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.469+0000 7f73077fe640 1 --2- 172.21.15.2:0/4050474715 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5654052233b0 0x5654052257a0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8ddab9ad6e3fd1b4 server_cookie=72d7e1a42adfe373 in_seq=0 out_seq=0 2024-09-19T06:21:58.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.469+0000 7f72e6ffd640 10 client.17715 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:21:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.470+0000 7f72e6ffd640 1 -- 172.21.15.2:0/4050474715 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x565405177860 con 0x5654052233b0 2024-09-19T06:21:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.470+0000 7f72e6ffd640 10 client.17715 handle_command_reply: tid=0 2024-09-19T06:21:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.470+0000 7f731032a740 1 client.17715 shutdown 2024-09-19T06:21:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.470+0000 7f731032a740 1 -- 172.21.15.2:0/4050474715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56540520f370 msgr2=0x56540520c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.470+0000 7f731032a740 1 --2- 172.21.15.2:0/4050474715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56540520f370 0x56540520c600 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f7300009580 tx=0x7f730001a6c0 comp rx=0 tx=0).stop 2024-09-19T06:21:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.470+0000 7f731032a740 1 -- 172.21.15.2:0/4050474715 shutdown_connections 2024-09-19T06:21:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.470+0000 7f731032a740 1 --2- 172.21.15.2:0/4050474715 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5654052233b0 0x5654052257a0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.470+0000 7f72e6ffd640 0 client.17715 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:21:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.470+0000 7f731032a740 1 --2- 172.21.15.2:0/4050474715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56540520f370 0x56540520c600 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.470+0000 7f731032a740 1 --2- 172.21.15.2:0/4050474715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565405205b40 0x56540520bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.470+0000 7f731032a740 1 --2- 172.21.15.2:0/4050474715 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5654052045d0 0x56540520ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.470+0000 7f731032a740 1 -- 172.21.15.2:0/4050474715 >> 172.21.15.2:0/4050474715 conn(0x5654051cd310 msgr2=0x565405206960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:58.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.470+0000 7f731032a740 1 -- 172.21.15.2:0/4050474715 shutdown_connections 2024-09-19T06:21:58.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.470+0000 7f731032a740 1 -- 172.21.15.2:0/4050474715 wait complete. 2024-09-19T06:21:58.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.470+0000 7f731032a740 20 client.17715 trim_cache size 0 max 16384 2024-09-19T06:21:58.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.483+0000 7f731032a740 1 Processor -- start 2024-09-19T06:21:58.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.483+0000 7f731032a740 1 -- start start 2024-09-19T06:21:58.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.483+0000 7f731032a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654052045d0 0x56540521f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:58.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.483+0000 7f731032a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565405205b40 0x565405207120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:58.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.483+0000 7f731032a740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56540520f370 0x565405207660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:58.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.483+0000 7f731032a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f73081addb0 con 0x5654052045d0 2024-09-19T06:21:58.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.483+0000 7f731032a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f73081ab680 con 0x565405205b40 2024-09-19T06:21:58.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.483+0000 7f731032a740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f73081a94f0 con 0x56540520f370 2024-09-19T06:21:58.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.484+0000 7f73077fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654052045d0 0x56540521f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:58.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.484+0000 7f73077fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654052045d0 0x56540521f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45468/0 (socket says 172.21.15.2:45468) 2024-09-19T06:21:58.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.484+0000 7f73077fe640 1 -- 172.21.15.2:0/3873189527 learned_addr learned my addr 172.21.15.2:0/3873189527 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:58.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.484+0000 7f7306ffd640 1 --2- 172.21.15.2:0/3873189527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565405205b40 0x565405207120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:58.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.484+0000 7f7307fff640 1 --2- 172.21.15.2:0/3873189527 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56540520f370 0x565405207660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:58.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.484+0000 7f73077fe640 1 -- 172.21.15.2:0/3873189527 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56540520f370 msgr2=0x565405207660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:58.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.484+0000 7f73077fe640 1 --2- 172.21.15.2:0/3873189527 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56540520f370 0x565405207660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:58.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.484+0000 7f73077fe640 1 -- 172.21.15.2:0/3873189527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565405205b40 msgr2=0x565405207120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:58.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.484+0000 7f73077fe640 1 --2- 172.21.15.2:0/3873189527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565405205b40 0x565405207120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:58.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.484+0000 7f73077fe640 1 -- 172.21.15.2:0/3873189527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565405225d60 con 0x5654052045d0 2024-09-19T06:21:58.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.484+0000 7f7307fff640 1 --2- 172.21.15.2:0/3873189527 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56540520f370 0x565405207660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:21:58.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.484+0000 7f73077fe640 1 --2- 172.21.15.2:0/3873189527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654052045d0 0x56540521f7a0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f72f800feb0 tx=0x7f72f80bc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=612d3fc1beb61e5b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:58.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.484+0000 7f72ed7fa640 1 -- 172.21.15.2:0/3873189527 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f80b4070 con 0x5654052045d0 2024-09-19T06:21:58.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.484+0000 7f72ed7fa640 1 -- 172.21.15.2:0/3873189527 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f72f809c130 con 0x5654052045d0 2024-09-19T06:21:58.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.484+0000 7f72ed7fa640 1 -- 172.21.15.2:0/3873189527 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f80cd820 con 0x5654052045d0 2024-09-19T06:21:58.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.485+0000 7f731032a740 1 -- 172.21.15.2:0/3873189527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654052045d0 msgr2=0x56540521f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:58.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.485+0000 7f731032a740 1 --2- 172.21.15.2:0/3873189527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654052045d0 0x56540521f7a0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f72f800feb0 tx=0x7f72f80bc040 comp rx=0 tx=0).stop 2024-09-19T06:21:58.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.485+0000 7f731032a740 1 -- 172.21.15.2:0/3873189527 shutdown_connections 2024-09-19T06:21:58.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.485+0000 7f731032a740 1 --2- 172.21.15.2:0/3873189527 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56540520f370 0x565405207660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:58.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.485+0000 7f731032a740 1 --2- 172.21.15.2:0/3873189527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x565405205b40 0x565405207120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:58.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.485+0000 7f731032a740 1 --2- 172.21.15.2:0/3873189527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654052045d0 0x56540521f7a0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:58.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.485+0000 7f731032a740 1 -- 172.21.15.2:0/3873189527 >> 172.21.15.2:0/3873189527 conn(0x5654051cd310 msgr2=0x56540520e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:58.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.485+0000 7f731032a740 1 -- 172.21.15.2:0/3873189527 shutdown_connections 2024-09-19T06:21:58.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.485+0000 7f731032a740 1 -- 172.21.15.2:0/3873189527 wait complete. 2024-09-19T06:21:58.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.485+0000 7f731032a740 1 -- start start 2024-09-19T06:21:58.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.486+0000 7f731032a740 1 Processor -- start 2024-09-19T06:21:58.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.486+0000 7f731032a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654052045d0 0x56540521baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:58.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.486+0000 7f731032a740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565405205b40 0x56540521c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:58.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.486+0000 7f731032a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56540520f370 0x565405208800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:58.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.486+0000 7f731032a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f73081a9b40 con 0x56540520f370 2024-09-19T06:21:58.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.486+0000 7f731032a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f73081aafb0 con 0x5654052045d0 2024-09-19T06:21:58.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.486+0000 7f731032a740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f73081aa210 con 0x565405205b40 2024-09-19T06:21:58.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.486+0000 7f731032a740 10 client.0 _ll_register_callbacks cb 0x7f72fc009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:58.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.486+0000 7f7307fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56540520f370 0x565405208800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:58.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.486+0000 7f7307fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56540520f370 0x565405208800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45484/0 (socket says 172.21.15.2:45484) 2024-09-19T06:21:58.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.486+0000 7f7307fff640 1 -- 172.21.15.2:0/2538381716 learned_addr learned my addr 172.21.15.2:0/2538381716 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:58.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.486+0000 7f7306ffd640 1 --2- 172.21.15.2:0/2538381716 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565405205b40 0x56540521c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:58.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.486+0000 7f73077fe640 1 --2- 172.21.15.2:0/2538381716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654052045d0 0x56540521baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:58.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.486+0000 7f7307fff640 1 -- 172.21.15.2:0/2538381716 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565405205b40 msgr2=0x56540521c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:58.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.486+0000 7f7307fff640 1 --2- 172.21.15.2:0/2538381716 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565405205b40 0x56540521c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:58.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.486+0000 7f7307fff640 1 -- 172.21.15.2:0/2538381716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654052045d0 msgr2=0x56540521baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:58.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.486+0000 7f7307fff640 1 --2- 172.21.15.2:0/2538381716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654052045d0 0x56540521baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:58.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.486+0000 7f7307fff640 1 -- 172.21.15.2:0/2538381716 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56540520cc00 con 0x56540520f370 2024-09-19T06:21:58.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.487+0000 7f7307fff640 1 --2- 172.21.15.2:0/2538381716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56540520f370 0x565405208800 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f730002b920 tx=0x7f7300009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=449d6fe865ca71e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:58.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.487+0000 7f72e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:58.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.487+0000 7f72e6ffd640 1 -- 172.21.15.2:0/2538381716 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7300015040 con 0x56540520f370 2024-09-19T06:21:58.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.487+0000 7f72e6ffd640 1 -- 172.21.15.2:0/2538381716 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f730002b630 con 0x56540520f370 2024-09-19T06:21:58.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.487+0000 7f731032a740 1 -- 172.21.15.2:0/2538381716 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72f809c130 con 0x56540520f370 2024-09-19T06:21:58.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.487+0000 7f72e6ffd640 1 -- 172.21.15.2:0/2538381716 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f730001aaf0 con 0x56540520f370 2024-09-19T06:21:58.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.487+0000 7f731032a740 10 client.17721 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:58.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.487+0000 7f731032a740 1 -- 172.21.15.2:0/2538381716 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56540528d7d0 con 0x56540520f370 2024-09-19T06:21:58.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.487+0000 7f72e6ffd640 1 -- 172.21.15.2:0/2538381716 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f72f809c130 con 0x56540520f370 2024-09-19T06:21:58.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.487+0000 7f72e6ffd640 1 -- 172.21.15.2:0/2538381716 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f730000aa90 con 0x56540520f370 2024-09-19T06:21:58.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.487+0000 7f731032a740 10 client.17721 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:58.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.487+0000 7f731032a740 10 client.17721 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:21:58.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.487+0000 7f731032a740 20 client.17721 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:58.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.487+0000 7f731032a740 1 --2- 172.21.15.2:0/2538381716 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x56540528def0 0x565405290310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:58.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.487+0000 7f731032a740 4 client.17721 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:21:58.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.487+0000 7f731032a740 1 -- 172.21.15.2:0/2538381716 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x565405171d70 con 0x56540528def0 2024-09-19T06:21:58.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.488+0000 7f73077fe640 1 --2- 172.21.15.2:0/2538381716 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x56540528def0 0x565405290310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:58.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.488+0000 7f72e6ffd640 10 client.17721 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:21:58.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.488+0000 7f73077fe640 1 --2- 172.21.15.2:0/2538381716 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x56540528def0 0x565405290310 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f785d34387ce6c0b server_cookie=b9665913f72dc725 in_seq=0 out_seq=0 2024-09-19T06:21:58.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.488+0000 7f72e6ffd640 1 -- 172.21.15.2:0/2538381716 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x565405171d70 con 0x56540528def0 2024-09-19T06:21:58.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.488+0000 7f72e6ffd640 10 client.17721 handle_command_reply: tid=0 2024-09-19T06:21:58.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.488+0000 7f731032a740 1 client.17721 shutdown 2024-09-19T06:21:58.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.488+0000 7f731032a740 1 -- 172.21.15.2:0/2538381716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56540520f370 msgr2=0x565405208800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:58.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.488+0000 7f731032a740 1 --2- 172.21.15.2:0/2538381716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56540520f370 0x565405208800 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f730002b920 tx=0x7f7300009b20 comp rx=0 tx=0).stop 2024-09-19T06:21:58.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.488+0000 7f731032a740 1 -- 172.21.15.2:0/2538381716 shutdown_connections 2024-09-19T06:21:58.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.488+0000 7f731032a740 1 --2- 172.21.15.2:0/2538381716 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x56540528def0 0x565405290310 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:58.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.489+0000 7f731032a740 1 --2- 172.21.15.2:0/2538381716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56540520f370 0x565405208800 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:58.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.489+0000 7f731032a740 1 --2- 172.21.15.2:0/2538381716 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x565405205b40 0x56540521c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:58.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.489+0000 7f731032a740 1 --2- 172.21.15.2:0/2538381716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5654052045d0 0x56540521baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:58.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.489+0000 7f72e6ffd640 0 client.17721 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:21:58.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.489+0000 7f731032a740 1 -- 172.21.15.2:0/2538381716 >> 172.21.15.2:0/2538381716 conn(0x5654051cd310 msgr2=0x56540520a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:58.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.489+0000 7f731032a740 1 -- 172.21.15.2:0/2538381716 shutdown_connections 2024-09-19T06:21:58.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.489+0000 7f731032a740 1 -- 172.21.15.2:0/2538381716 wait complete. 2024-09-19T06:21:58.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.489+0000 7f731032a740 20 client.17721 trim_cache size 0 max 16384 2024-09-19T06:21:58.497 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:21:58.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.489+0000 7f730df51640 1 -- 172.21.15.2:0/1133941852 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f72f00a33b0 msgr2=0x7f72f00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:58.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.489+0000 7f730df51640 1 --2- 172.21.15.2:0/1133941852 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f72f00a33b0 0x7f72f00a5870 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f730001f000 tx=0x7f730001b000 comp rx=0 tx=0).stop 2024-09-19T06:21:58.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.489+0000 7f730df51640 1 -- 172.21.15.2:0/1133941852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7308101de0 msgr2=0x7f7308198320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:58.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.489+0000 7f730df51640 1 --2- 172.21.15.2:0/1133941852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7308101de0 0x7f7308198320 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f72f800c920 tx=0x7f72f800cde0 comp rx=0 tx=0).stop 2024-09-19T06:21:58.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.489+0000 7f730df51640 1 -- 172.21.15.2:0/1133941852 shutdown_connections 2024-09-19T06:21:58.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.489+0000 7f730df51640 1 --2- 172.21.15.2:0/1133941852 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f72f00a33b0 0x7f72f00a5870 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:58.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.489+0000 7f730df51640 1 --2- 172.21.15.2:0/1133941852 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7308106f10 0x7f730819cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:58.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.489+0000 7f730df51640 1 --2- 172.21.15.2:0/1133941852 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7308102790 0x7f7308198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:58.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.490+0000 7f730df51640 1 --2- 172.21.15.2:0/1133941852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7308101de0 0x7f7308198320 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:58.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.490+0000 7f730df51640 1 -- 172.21.15.2:0/1133941852 >> 172.21.15.2:0/1133941852 conn(0x7f73080fd8c0 msgr2=0x7f73080fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:58.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.490+0000 7f730df51640 1 -- 172.21.15.2:0/1133941852 shutdown_connections 2024-09-19T06:21:58.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:58.490+0000 7f730df51640 1 -- 172.21.15.2:0/1133941852 wait complete. 2024-09-19T06:21:59.164 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:21:59.423 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:59.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:21:59 smithi002 ceph-mon[30982]: pgmap v220: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:21:59.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:21:59 smithi090 ceph-mon[34497]: pgmap v220: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:21:59.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:21:59 smithi089 ceph-mon[34160]: pgmap v220: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:21:59.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.811+0000 7ff1931b0640 1 -- 172.21.15.2:0/1891845744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff18c102570 msgr2=0x7ff18c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:59.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.811+0000 7ff1931b0640 1 --2- 172.21.15.2:0/1891845744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff18c102570 0x7ff18c1029b0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7ff178009900 tx=0x7ff17802a480 comp rx=0 tx=0).stop 2024-09-19T06:21:59.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.811+0000 7ff1931b0640 1 -- 172.21.15.2:0/1891845744 shutdown_connections 2024-09-19T06:21:59.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.811+0000 7ff1931b0640 1 --2- 172.21.15.2:0/1891845744 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff18c102ef0 0x7ff18c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:59.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.811+0000 7ff1931b0640 1 --2- 172.21.15.2:0/1891845744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff18c102570 0x7ff18c1029b0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:59.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.811+0000 7ff1931b0640 1 --2- 172.21.15.2:0/1891845744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff18c100e20 0x7ff18c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:59.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.811+0000 7ff1931b0640 1 -- 172.21.15.2:0/1891845744 >> 172.21.15.2:0/1891845744 conn(0x7ff18c0fc7d0 msgr2=0x7ff18c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:59.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.811+0000 7ff1931b0640 1 -- 172.21.15.2:0/1891845744 shutdown_connections 2024-09-19T06:21:59.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.811+0000 7ff1931b0640 1 -- 172.21.15.2:0/1891845744 wait complete. 2024-09-19T06:21:59.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.812+0000 7ff1931b0640 1 Processor -- start 2024-09-19T06:21:59.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.812+0000 7ff1931b0640 1 -- start start 2024-09-19T06:21:59.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.812+0000 7ff1931b0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff18c100e20 0x7ff18c19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:59.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.812+0000 7ff1931b0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff18c102570 0x7ff18c19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:59.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.812+0000 7ff1931b0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff18c102ef0 0x7ff18c19ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:59.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.812+0000 7ff1931b0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff18c10fd30 con 0x7ff18c102ef0 2024-09-19T06:21:59.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.812+0000 7ff1931b0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff18c10fbb0 con 0x7ff18c100e20 2024-09-19T06:21:59.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.812+0000 7ff1931b0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff18c10feb0 con 0x7ff18c102570 2024-09-19T06:21:59.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.813+0000 7ff18bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff18c102570 0x7ff18c19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:59.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.813+0000 7ff18bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff18c102570 0x7ff18c19ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:47850/0 (socket says 172.21.15.2:47850) 2024-09-19T06:21:59.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.813+0000 7ff18bfff640 1 -- 172.21.15.2:0/2968615100 learned_addr learned my addr 172.21.15.2:0/2968615100 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:59.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.813+0000 7ff19174d640 1 --2- 172.21.15.2:0/2968615100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff18c102ef0 0x7ff18c19ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:59.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.813+0000 7ff190f4c640 1 --2- 172.21.15.2:0/2968615100 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff18c100e20 0x7ff18c19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:59.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.813+0000 7ff19174d640 1 -- 172.21.15.2:0/2968615100 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff18c102570 msgr2=0x7ff18c19ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:59.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.813+0000 7ff19174d640 1 --2- 172.21.15.2:0/2968615100 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff18c102570 0x7ff18c19ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:59.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.813+0000 7ff19174d640 1 -- 172.21.15.2:0/2968615100 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff18c100e20 msgr2=0x7ff18c19a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:59.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.813+0000 7ff19174d640 1 --2- 172.21.15.2:0/2968615100 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff18c100e20 0x7ff18c19a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:59.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.813+0000 7ff19174d640 1 -- 172.21.15.2:0/2968615100 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff18c19f5f0 con 0x7ff18c102ef0 2024-09-19T06:21:59.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.813+0000 7ff18bfff640 1 --2- 172.21.15.2:0/2968615100 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff18c102570 0x7ff18c19ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:59.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.813+0000 7ff19174d640 1 --2- 172.21.15.2:0/2968615100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff18c102ef0 0x7ff18c19ef10 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7ff18400e940 tx=0x7ff18400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:59.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.813+0000 7ff189ffb640 1 -- 172.21.15.2:0/2968615100 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff184004d20 con 0x7ff18c102ef0 2024-09-19T06:21:59.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.813+0000 7ff1931b0640 1 -- 172.21.15.2:0/2968615100 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff18c19f8e0 con 0x7ff18c102ef0 2024-09-19T06:21:59.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.813+0000 7ff189ffb640 1 -- 172.21.15.2:0/2968615100 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff184005020 con 0x7ff18c102ef0 2024-09-19T06:21:59.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.813+0000 7ff189ffb640 1 -- 172.21.15.2:0/2968615100 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1840116d0 con 0x7ff18c102ef0 2024-09-19T06:21:59.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.814+0000 7ff1931b0640 1 -- 172.21.15.2:0/2968615100 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff18c1a71c0 con 0x7ff18c102ef0 2024-09-19T06:21:59.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.816+0000 7ff189ffb640 1 -- 172.21.15.2:0/2968615100 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7ff18400cb20 con 0x7ff18c102ef0 2024-09-19T06:21:59.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.817+0000 7ff195589740 1 Processor -- start 2024-09-19T06:21:59.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.817+0000 7ff195589740 1 -- start start 2024-09-19T06:21:59.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.817+0000 7ff195589740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55772a1b8b40 0x55772a1b7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:59.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.817+0000 7ff195589740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55772a1b75d0 0x55772a1b7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:59.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.817+0000 7ff195589740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55772a1c2370 0x55772a1c4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:59.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.817+0000 7ff195589740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55772a11d2f0 con 0x55772a1c2370 2024-09-19T06:21:59.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.817+0000 7ff195589740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55772a0c4cf0 con 0x55772a1b75d0 2024-09-19T06:21:59.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.817+0000 7ff195589740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55772a1192b0 con 0x55772a1b8b40 2024-09-19T06:21:59.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.817+0000 7ff189ffb640 1 --2- 172.21.15.2:0/2968615100 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff17c0a3430 0x7ff17c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:59.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.817+0000 7ff18bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55772a1b8b40 0x55772a1b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:59.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.817+0000 7ff190f4c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55772a1b75d0 0x55772a1b7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:59.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.817+0000 7ff18bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55772a1b8b40 0x55772a1b7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:47854/0 (socket says 172.21.15.2:47854) 2024-09-19T06:21:59.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.817+0000 7ff18bfff640 1 -- 172.21.15.2:0/462484207 learned_addr learned my addr 172.21.15.2:0/462484207 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:59.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.818+0000 7ff18bfff640 1 --2- 172.21.15.2:0/462484207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55772a1c2370 0x55772a1c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:59.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.818+0000 7ff190f4c640 1 -- 172.21.15.2:0/462484207 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55772a1b8b40 msgr2=0x55772a1b7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:59.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.818+0000 7ff190f4c640 1 --2- 172.21.15.2:0/462484207 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55772a1b8b40 0x55772a1b7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:59.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.818+0000 7ff189ffb640 1 -- 172.21.15.2:0/2968615100 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7ff1840cfe10 con 0x7ff18c102ef0 2024-09-19T06:21:59.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.818+0000 7ff190f4c640 1 -- 172.21.15.2:0/462484207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55772a1c2370 msgr2=0x55772a1c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:59.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.818+0000 7ff19174d640 1 --2- 172.21.15.2:0/2968615100 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff17c0a3430 0x7ff17c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:59.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.818+0000 7ff190f4c640 1 --2- 172.21.15.2:0/462484207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55772a1c2370 0x55772a1c4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:59.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.818+0000 7ff190f4c640 1 -- 172.21.15.2:0/462484207 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55772a0a93a0 con 0x55772a1b75d0 2024-09-19T06:21:59.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.818+0000 7ff18bfff640 1 --2- 172.21.15.2:0/462484207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55772a1c2370 0x55772a1c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:59.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.818+0000 7ff190f4c640 1 --2- 172.21.15.2:0/462484207 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55772a1b75d0 0x55772a1b7a10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff18000bbf0 tx=0x7ff1800107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb35af7af6546df5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:59.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.818+0000 7ff19174d640 1 --2- 172.21.15.2:0/2968615100 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff17c0a3430 0x7ff17c0a58f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff18400c640 tx=0x7ff1840bc040 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:59.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.818+0000 7ff176ffd640 1 -- 172.21.15.2:0/462484207 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff180004030 con 0x55772a1b75d0 2024-09-19T06:21:59.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.818+0000 7ff176ffd640 1 -- 172.21.15.2:0/462484207 <== mon.2 v2:172.21.15.89:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff1800035f0 con 0x55772a1b75d0 2024-09-19T06:21:59.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.818+0000 7ff176ffd640 1 -- 172.21.15.2:0/462484207 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff180011640 con 0x55772a1b75d0 2024-09-19T06:21:59.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.819+0000 7ff195589740 1 -- 172.21.15.2:0/462484207 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55772a1b75d0 msgr2=0x55772a1b7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:59.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.819+0000 7ff195589740 1 --2- 172.21.15.2:0/462484207 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55772a1b75d0 0x55772a1b7a10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff18000bbf0 tx=0x7ff1800107a0 comp rx=0 tx=0).stop 2024-09-19T06:21:59.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.819+0000 7ff195589740 1 -- 172.21.15.2:0/462484207 shutdown_connections 2024-09-19T06:21:59.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.819+0000 7ff195589740 1 --2- 172.21.15.2:0/462484207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55772a1c2370 0x55772a1c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:59.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.819+0000 7ff195589740 1 --2- 172.21.15.2:0/462484207 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55772a1b75d0 0x55772a1b7a10 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:59.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.819+0000 7ff195589740 1 --2- 172.21.15.2:0/462484207 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55772a1b8b40 0x55772a1b7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:59.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.819+0000 7ff195589740 1 -- 172.21.15.2:0/462484207 >> 172.21.15.2:0/462484207 conn(0x55772a180310 msgr2=0x55772a1b3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:59.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.819+0000 7ff195589740 1 -- 172.21.15.2:0/462484207 shutdown_connections 2024-09-19T06:21:59.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.819+0000 7ff195589740 1 -- 172.21.15.2:0/462484207 wait complete. 2024-09-19T06:21:59.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.819+0000 7ff195589740 1 -- start start 2024-09-19T06:21:59.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.819+0000 7ff195589740 1 Processor -- start 2024-09-19T06:21:59.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.820+0000 7ff195589740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55772a1b75d0 0x55772a1c1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:59.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.820+0000 7ff195589740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55772a1b8b40 0x55772a1bf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:59.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.820+0000 7ff195589740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55772a1c2370 0x55772a1bf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:59.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.820+0000 7ff195589740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55772a1c5070 con 0x55772a1b75d0 2024-09-19T06:21:59.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.820+0000 7ff195589740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55772a0d8060 con 0x55772a1b8b40 2024-09-19T06:21:59.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.820+0000 7ff195589740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55772a1c51f0 con 0x55772a1c2370 2024-09-19T06:21:59.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.820+0000 7ff195589740 10 client.0 _ll_register_callbacks cb 0x557729e2b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:59.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.820+0000 7ff18bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55772a1b75d0 0x55772a1c1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:59.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.820+0000 7ff18bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55772a1b75d0 0x55772a1c1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45538/0 (socket says 172.21.15.2:45538) 2024-09-19T06:21:59.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.820+0000 7ff190f4c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55772a1b8b40 0x55772a1bf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:59.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.820+0000 7ff18bfff640 1 -- 172.21.15.2:0/3140314372 learned_addr learned my addr 172.21.15.2:0/3140314372 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:59.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.820+0000 7ff18bfff640 1 --2- 172.21.15.2:0/3140314372 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55772a1c2370 0x55772a1bf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:59.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.820+0000 7ff190f4c640 1 -- 172.21.15.2:0/3140314372 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55772a1c2370 msgr2=0x55772a1bf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:59.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.820+0000 7ff190f4c640 1 --2- 172.21.15.2:0/3140314372 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55772a1c2370 0x55772a1bf5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:59.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.820+0000 7ff190f4c640 1 -- 172.21.15.2:0/3140314372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55772a1b75d0 msgr2=0x55772a1c1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:59.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.820+0000 7ff190f4c640 1 --2- 172.21.15.2:0/3140314372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55772a1b75d0 0x55772a1c1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:59.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.820+0000 7ff190f4c640 1 -- 172.21.15.2:0/3140314372 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557729e8e3c0 con 0x55772a1b8b40 2024-09-19T06:21:59.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.820+0000 7ff18bfff640 1 --2- 172.21.15.2:0/3140314372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55772a1b75d0 0x55772a1c1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:59.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.821+0000 7ff190f4c640 1 --2- 172.21.15.2:0/3140314372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55772a1b8b40 0x55772a1bf000 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff180000c00 tx=0x7ff18000bfd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b8f1980b16ac036 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:59.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.821+0000 7ff16bfff640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-09-19T06:21:59.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.821+0000 7ff16bfff640 1 -- 172.21.15.2:0/3140314372 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff18002a060 con 0x55772a1b8b40 2024-09-19T06:21:59.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.821+0000 7ff195589740 1 -- 172.21.15.2:0/3140314372 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1800035f0 con 0x55772a1b8b40 2024-09-19T06:21:59.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.821+0000 7ff16bfff640 1 -- 172.21.15.2:0/3140314372 <== mon.2 v2:172.21.15.89:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7ff180003fe0 con 0x55772a1b8b40 2024-09-19T06:21:59.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.821+0000 7ff16bfff640 1 -- 172.21.15.2:0/3140314372 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff180003a70 con 0x55772a1b8b40 2024-09-19T06:21:59.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.821+0000 7ff195589740 10 client.26876 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:59.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.821+0000 7ff195589740 1 -- 172.21.15.2:0/3140314372 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55772a1d0af0 con 0x55772a1b8b40 2024-09-19T06:21:59.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.821+0000 7ff16bfff640 1 -- 172.21.15.2:0/3140314372 <== mon.2 v2:172.21.15.89:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff1800035f0 con 0x55772a1b8b40 2024-09-19T06:21:59.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.821+0000 7ff16bfff640 1 -- 172.21.15.2:0/3140314372 <== mon.2 v2:172.21.15.89:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7ff180004750 con 0x55772a1b8b40 2024-09-19T06:21:59.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.822+0000 7ff195589740 10 client.26876 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:59.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.822+0000 7ff195589740 10 client.26876 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:59.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.822+0000 7ff195589740 20 client.26876 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:59.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.822+0000 7ff195589740 1 --2- 172.21.15.2:0/3140314372 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55772a1d1ea0 0x55772a1d4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:59.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.822+0000 7ff195589740 4 client.26876 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:59.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.822+0000 7ff195589740 1 -- 172.21.15.2:0/3140314372 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55772a12a860 con 0x55772a1d1ea0 2024-09-19T06:21:59.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.822+0000 7ff18bfff640 1 --2- 172.21.15.2:0/3140314372 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55772a1d1ea0 0x55772a1d4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:59.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.822+0000 7ff18bfff640 1 --2- 172.21.15.2:0/3140314372 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55772a1d1ea0 0x55772a1d4290 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52c5ad9814fa5170 server_cookie=11d452954da2b3a8 in_seq=0 out_seq=0 2024-09-19T06:21:59.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.822+0000 7ff16bfff640 10 client.26876 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:59.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.823+0000 7ff16bfff640 1 -- 172.21.15.2:0/3140314372 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55772a12a860 con 0x55772a1d1ea0 2024-09-19T06:21:59.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.823+0000 7ff16bfff640 10 client.26876 handle_command_reply: tid=0 2024-09-19T06:21:59.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.823+0000 7ff195589740 1 client.26876 shutdown 2024-09-19T06:21:59.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.823+0000 7ff195589740 1 -- 172.21.15.2:0/3140314372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55772a1b8b40 msgr2=0x55772a1bf000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:59.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.823+0000 7ff195589740 1 --2- 172.21.15.2:0/3140314372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55772a1b8b40 0x55772a1bf000 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff180000c00 tx=0x7ff18000bfd0 comp rx=0 tx=0).stop 2024-09-19T06:21:59.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.823+0000 7ff195589740 1 -- 172.21.15.2:0/3140314372 shutdown_connections 2024-09-19T06:21:59.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.823+0000 7ff195589740 1 --2- 172.21.15.2:0/3140314372 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55772a1c2370 0x55772a1bf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:59.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.823+0000 7ff195589740 1 --2- 172.21.15.2:0/3140314372 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55772a1d1ea0 0x55772a1d4290 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:59.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.823+0000 7ff195589740 1 --2- 172.21.15.2:0/3140314372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55772a1b8b40 0x55772a1bf000 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:59.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.823+0000 7ff195589740 1 --2- 172.21.15.2:0/3140314372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55772a1b75d0 0x55772a1c1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:59.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.823+0000 7ff16bfff640 0 client.26876 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:59.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.823+0000 7ff195589740 1 -- 172.21.15.2:0/3140314372 >> 172.21.15.2:0/3140314372 conn(0x55772a180310 msgr2=0x55772a1b9960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:59.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.823+0000 7ff195589740 1 -- 172.21.15.2:0/3140314372 shutdown_connections 2024-09-19T06:21:59.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.823+0000 7ff195589740 1 -- 172.21.15.2:0/3140314372 wait complete. 2024-09-19T06:21:59.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.823+0000 7ff195589740 20 client.26876 trim_cache size 0 max 16384 2024-09-19T06:21:59.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.837+0000 7ff195589740 1 Processor -- start 2024-09-19T06:21:59.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.837+0000 7ff195589740 1 -- start start 2024-09-19T06:21:59.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.837+0000 7ff195589740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55772a1b75d0 0x55772a1ce310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:59.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.837+0000 7ff195589740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55772a1b8b40 0x55772a1c0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:59.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.837+0000 7ff195589740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55772a1c2370 0x55772a1d9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:59.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.837+0000 7ff195589740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff18c1b2220 con 0x55772a1b8b40 2024-09-19T06:21:59.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.837+0000 7ff195589740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff18c1afaf0 con 0x55772a1c2370 2024-09-19T06:21:59.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.837+0000 7ff195589740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff18c1ad960 con 0x55772a1b75d0 2024-09-19T06:21:59.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.837+0000 7ff190f4c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55772a1b8b40 0x55772a1c0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:59.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.837+0000 7ff18bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55772a1b75d0 0x55772a1ce310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:59.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.837+0000 7ff190f4c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55772a1b8b40 0x55772a1c0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45552/0 (socket says 172.21.15.2:45552) 2024-09-19T06:21:59.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.837+0000 7ff190f4c640 1 -- 172.21.15.2:0/1201551838 learned_addr learned my addr 172.21.15.2:0/1201551838 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:59.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.837+0000 7ff18bfff640 1 --2- 172.21.15.2:0/1201551838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55772a1c2370 0x55772a1d9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:59.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.837+0000 7ff190f4c640 1 -- 172.21.15.2:0/1201551838 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55772a1b75d0 msgr2=0x55772a1ce310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:59.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.837+0000 7ff190f4c640 1 --2- 172.21.15.2:0/1201551838 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55772a1b75d0 0x55772a1ce310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:59.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.837+0000 7ff190f4c640 1 -- 172.21.15.2:0/1201551838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55772a1c2370 msgr2=0x55772a1d9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:59.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.837+0000 7ff190f4c640 1 --2- 172.21.15.2:0/1201551838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55772a1c2370 0x55772a1d9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:59.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.837+0000 7ff190f4c640 1 -- 172.21.15.2:0/1201551838 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55772a1c20c0 con 0x55772a1b8b40 2024-09-19T06:21:59.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.837+0000 7ff18bfff640 1 --2- 172.21.15.2:0/1201551838 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55772a1b75d0 0x55772a1ce310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:59.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.838+0000 7ff190f4c640 1 --2- 172.21.15.2:0/1201551838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55772a1b8b40 0x55772a1c0f70 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7ff18000b3d0 tx=0x7ff180005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac95fb8b23159566 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:59.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.838+0000 7ff1767fc640 1 -- 172.21.15.2:0/1201551838 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff18002a030 con 0x55772a1b8b40 2024-09-19T06:21:59.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.838+0000 7ff1767fc640 1 -- 172.21.15.2:0/1201551838 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff18000b770 con 0x55772a1b8b40 2024-09-19T06:21:59.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.838+0000 7ff1767fc640 1 -- 172.21.15.2:0/1201551838 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff180005080 con 0x55772a1b8b40 2024-09-19T06:21:59.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.838+0000 7ff195589740 1 -- 172.21.15.2:0/1201551838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55772a1b8b40 msgr2=0x55772a1c0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:59.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.838+0000 7ff195589740 1 --2- 172.21.15.2:0/1201551838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55772a1b8b40 0x55772a1c0f70 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7ff18000b3d0 tx=0x7ff180005900 comp rx=0 tx=0).stop 2024-09-19T06:21:59.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.838+0000 7ff195589740 1 -- 172.21.15.2:0/1201551838 shutdown_connections 2024-09-19T06:21:59.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.838+0000 7ff195589740 1 --2- 172.21.15.2:0/1201551838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55772a1c2370 0x55772a1d9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:59.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.838+0000 7ff195589740 1 --2- 172.21.15.2:0/1201551838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55772a1b8b40 0x55772a1c0f70 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:59.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.838+0000 7ff195589740 1 --2- 172.21.15.2:0/1201551838 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55772a1b75d0 0x55772a1ce310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:59.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.838+0000 7ff195589740 1 -- 172.21.15.2:0/1201551838 >> 172.21.15.2:0/1201551838 conn(0x55772a180310 msgr2=0x55772a1c0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:59.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.839+0000 7ff195589740 1 -- 172.21.15.2:0/1201551838 shutdown_connections 2024-09-19T06:21:59.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.839+0000 7ff195589740 1 -- 172.21.15.2:0/1201551838 wait complete. 2024-09-19T06:21:59.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.839+0000 7ff195589740 1 -- start start 2024-09-19T06:21:59.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.839+0000 7ff195589740 1 Processor -- start 2024-09-19T06:21:59.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.839+0000 7ff195589740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55772a1b75d0 0x55772a1ca660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:59.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.839+0000 7ff195589740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55772a1b8b40 0x55772a1caba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:59.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.839+0000 7ff195589740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55772a1c2370 0x55772a1bb870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:59.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.839+0000 7ff195589740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff18c1adfb0 con 0x55772a1b8b40 2024-09-19T06:21:59.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.839+0000 7ff195589740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff18c1af420 con 0x55772a1c2370 2024-09-19T06:21:59.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.839+0000 7ff195589740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff18c1ae680 con 0x55772a1b75d0 2024-09-19T06:21:59.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.839+0000 7ff195589740 10 client.0 _ll_register_callbacks cb 0x7ff178004430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:59.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.839+0000 7ff190f4c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55772a1b8b40 0x55772a1caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:59.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.840+0000 7ff190f4c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55772a1b8b40 0x55772a1caba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45562/0 (socket says 172.21.15.2:45562) 2024-09-19T06:21:59.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.840+0000 7ff190f4c640 1 -- 172.21.15.2:0/2522893275 learned_addr learned my addr 172.21.15.2:0/2522893275 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:21:59.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.840+0000 7ff18bfff640 1 --2- 172.21.15.2:0/2522893275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55772a1c2370 0x55772a1bb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:59.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.840+0000 7ff18bfff640 1 --2- 172.21.15.2:0/2522893275 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55772a1b75d0 0x55772a1ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:59.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.840+0000 7ff190f4c640 1 -- 172.21.15.2:0/2522893275 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55772a1b75d0 msgr2=0x55772a1ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:59.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.840+0000 7ff190f4c640 1 --2- 172.21.15.2:0/2522893275 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55772a1b75d0 0x55772a1ca660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:59.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.840+0000 7ff190f4c640 1 -- 172.21.15.2:0/2522893275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55772a1c2370 msgr2=0x55772a1bb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:59.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.840+0000 7ff190f4c640 1 --2- 172.21.15.2:0/2522893275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55772a1c2370 0x55772a1bb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:59.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.840+0000 7ff190f4c640 1 -- 172.21.15.2:0/2522893275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55772a1bc050 con 0x55772a1b8b40 2024-09-19T06:21:59.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.840+0000 7ff18bfff640 1 --2- 172.21.15.2:0/2522893275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55772a1c2370 0x55772a1bb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:59.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.840+0000 7ff190f4c640 1 --2- 172.21.15.2:0/2522893275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55772a1b8b40 0x55772a1caba0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7ff18000b4e0 tx=0x7ff1800050b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c885ac0c5dcc6c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:59.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.840+0000 7ff16bfff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:21:59.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.840+0000 7ff16bfff640 1 -- 172.21.15.2:0/2522893275 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff18002a070 con 0x55772a1b8b40 2024-09-19T06:21:59.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.840+0000 7ff16bfff640 1 -- 172.21.15.2:0/2522893275 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7ff1800054b0 con 0x55772a1b8b40 2024-09-19T06:21:59.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.840+0000 7ff195589740 1 -- 172.21.15.2:0/2522893275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff18000b770 con 0x55772a1b8b40 2024-09-19T06:21:59.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.840+0000 7ff16bfff640 1 -- 172.21.15.2:0/2522893275 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff1800035f0 con 0x55772a1b8b40 2024-09-19T06:21:59.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.840+0000 7ff195589740 10 client.17739 fetch_fsmap learned FSMap version 26 2024-09-19T06:21:59.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.840+0000 7ff195589740 1 -- 172.21.15.2:0/2522893275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55772a23c2e0 con 0x55772a1b8b40 2024-09-19T06:21:59.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.841+0000 7ff16bfff640 1 -- 172.21.15.2:0/2522893275 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff18000b770 con 0x55772a1b8b40 2024-09-19T06:21:59.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.841+0000 7ff16bfff640 1 -- 172.21.15.2:0/2522893275 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7ff18003e020 con 0x55772a1b8b40 2024-09-19T06:21:59.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.841+0000 7ff195589740 10 client.17739 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:21:59.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.841+0000 7ff195589740 10 client.17739 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:59.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.841+0000 7ff195589740 20 client.17739 populate_metadata read hostname 'smithi002' 2024-09-19T06:21:59.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.841+0000 7ff195589740 1 --2- 172.21.15.2:0/2522893275 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55772a23c940 0x55772a23ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:59.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.841+0000 7ff195589740 4 client.17739 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:21:59.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.841+0000 7ff195589740 1 -- 172.21.15.2:0/2522893275 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55772a124d70 con 0x55772a23c940 2024-09-19T06:21:59.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.841+0000 7ff18bfff640 1 --2- 172.21.15.2:0/2522893275 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55772a23c940 0x55772a23ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:59.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.842+0000 7ff18bfff640 1 --2- 172.21.15.2:0/2522893275 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55772a23c940 0x55772a23ed60 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=496ccc89661ece29 server_cookie=5b299cb525399113 in_seq=0 out_seq=0 2024-09-19T06:21:59.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.842+0000 7ff16bfff640 10 client.17739 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:59.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.842+0000 7ff16bfff640 1 -- 172.21.15.2:0/2522893275 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55772a124d70 con 0x55772a23c940 2024-09-19T06:21:59.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.842+0000 7ff16bfff640 10 client.17739 handle_command_reply: tid=0 2024-09-19T06:21:59.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.842+0000 7ff195589740 1 client.17739 shutdown 2024-09-19T06:21:59.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.842+0000 7ff195589740 1 -- 172.21.15.2:0/2522893275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55772a1b8b40 msgr2=0x55772a1caba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:59.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.842+0000 7ff195589740 1 --2- 172.21.15.2:0/2522893275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55772a1b8b40 0x55772a1caba0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7ff18000b4e0 tx=0x7ff1800050b0 comp rx=0 tx=0).stop 2024-09-19T06:21:59.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.842+0000 7ff195589740 1 -- 172.21.15.2:0/2522893275 shutdown_connections 2024-09-19T06:21:59.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.842+0000 7ff195589740 1 --2- 172.21.15.2:0/2522893275 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55772a23c940 0x55772a23ed60 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:59.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.842+0000 7ff195589740 1 --2- 172.21.15.2:0/2522893275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55772a1c2370 0x55772a1bb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:59.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.842+0000 7ff195589740 1 --2- 172.21.15.2:0/2522893275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55772a1b8b40 0x55772a1caba0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:59.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.842+0000 7ff195589740 1 --2- 172.21.15.2:0/2522893275 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55772a1b75d0 0x55772a1ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:59.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.842+0000 7ff195589740 1 -- 172.21.15.2:0/2522893275 >> 172.21.15.2:0/2522893275 conn(0x55772a180310 msgr2=0x55772a1c1080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:59.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.842+0000 7ff16bfff640 0 client.17739 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:21:59.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.842+0000 7ff195589740 1 -- 172.21.15.2:0/2522893275 shutdown_connections 2024-09-19T06:21:59.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.842+0000 7ff195589740 1 -- 172.21.15.2:0/2522893275 wait complete. 2024-09-19T06:21:59.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.842+0000 7ff195589740 20 client.17739 trim_cache size 0 max 16384 2024-09-19T06:21:59.867 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:21:59.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.843+0000 7ff1931b0640 1 -- 172.21.15.2:0/2968615100 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff17c0a3430 msgr2=0x7ff17c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:59.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.843+0000 7ff1931b0640 1 --2- 172.21.15.2:0/2968615100 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff17c0a3430 0x7ff17c0a58f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff18400c640 tx=0x7ff1840bc040 comp rx=0 tx=0).stop 2024-09-19T06:21:59.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.843+0000 7ff1931b0640 1 -- 172.21.15.2:0/2968615100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff18c102ef0 msgr2=0x7ff18c19ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:59.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.843+0000 7ff1931b0640 1 --2- 172.21.15.2:0/2968615100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff18c102ef0 0x7ff18c19ef10 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7ff18400e940 tx=0x7ff18400ee00 comp rx=0 tx=0).stop 2024-09-19T06:21:59.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.843+0000 7ff1931b0640 1 -- 172.21.15.2:0/2968615100 shutdown_connections 2024-09-19T06:21:59.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.843+0000 7ff1931b0640 1 --2- 172.21.15.2:0/2968615100 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff17c0a3430 0x7ff17c0a58f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:59.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.843+0000 7ff1931b0640 1 --2- 172.21.15.2:0/2968615100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff18c102ef0 0x7ff18c19ef10 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:59.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.843+0000 7ff1931b0640 1 --2- 172.21.15.2:0/2968615100 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff18c102570 0x7ff18c19ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:59.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.843+0000 7ff1931b0640 1 --2- 172.21.15.2:0/2968615100 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff18c100e20 0x7ff18c19a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:59.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.843+0000 7ff1931b0640 1 -- 172.21.15.2:0/2968615100 >> 172.21.15.2:0/2968615100 conn(0x7ff18c0fc7d0 msgr2=0x7ff18c1067c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:59.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.843+0000 7ff1931b0640 1 -- 172.21.15.2:0/2968615100 shutdown_connections 2024-09-19T06:21:59.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:21:59.843+0000 7ff1931b0640 1 -- 172.21.15.2:0/2968615100 wait complete. 2024-09-19T06:22:01.515 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:22:01.516 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:22:01.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:01 smithi002 ceph-mon[30982]: pgmap v221: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:22:01.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:01 smithi090 ceph-mon[34497]: pgmap v221: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:22:01.788 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:22:01.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:01 smithi089 ceph-mon[34160]: pgmap v221: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:22:02.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.218+0000 7f2bce564640 1 -- 172.21.15.2:0/2937483567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc8101420 msgr2=0x7f2bc810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:02.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.218+0000 7f2bce564640 1 --2- 172.21.15.2:0/2937483567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc8101420 0x7f2bc810d950 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0009cd0 tx=0x7f2bc002a8e0 comp rx=0 tx=0).stop 2024-09-19T06:22:02.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.218+0000 7f2bce564640 1 -- 172.21.15.2:0/2937483567 shutdown_connections 2024-09-19T06:22:02.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.218+0000 7f2bce564640 1 --2- 172.21.15.2:0/2937483567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc8101420 0x7f2bc810d950 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:02.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.218+0000 7f2bce564640 1 --2- 172.21.15.2:0/2937483567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bc8100a80 0x7f2bc8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:02.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.218+0000 7f2bce564640 1 --2- 172.21.15.2:0/2937483567 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bc8106a80 0x7f2bc8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:02.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.218+0000 7f2bce564640 1 -- 172.21.15.2:0/2937483567 >> 172.21.15.2:0/2937483567 conn(0x7f2bc80fc7a0 msgr2=0x7f2bc80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:02.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.218+0000 7f2bce564640 1 -- 172.21.15.2:0/2937483567 shutdown_connections 2024-09-19T06:22:02.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.218+0000 7f2bce564640 1 -- 172.21.15.2:0/2937483567 wait complete. 2024-09-19T06:22:02.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.219+0000 7f2bce564640 1 Processor -- start 2024-09-19T06:22:02.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.219+0000 7f2bce564640 1 -- start start 2024-09-19T06:22:02.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.219+0000 7f2bce564640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bc8100a80 0x7f2bc81982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:02.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.219+0000 7f2bce564640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bc8101420 0x7f2bc8198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:02.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.219+0000 7f2bce564640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc8106a80 0x7f2bc819cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:02.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.219+0000 7f2bce564640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc8110d30 con 0x7f2bc8106a80 2024-09-19T06:22:02.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.219+0000 7f2bce564640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc8110bb0 con 0x7f2bc8101420 2024-09-19T06:22:02.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.219+0000 7f2bce564640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc8110eb0 con 0x7f2bc8100a80 2024-09-19T06:22:02.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.220+0000 7f2bccb01640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc8106a80 0x7f2bc819cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:02.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.220+0000 7f2bccb01640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc8106a80 0x7f2bc819cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45584/0 (socket says 172.21.15.2:45584) 2024-09-19T06:22:02.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.220+0000 7f2bccb01640 1 -- 172.21.15.2:0/1613985675 learned_addr learned my addr 172.21.15.2:0/1613985675 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:02.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.220+0000 7f2bc77fe640 1 --2- 172.21.15.2:0/1613985675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bc8101420 0x7f2bc8198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:02.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.220+0000 7f2bc7fff640 1 --2- 172.21.15.2:0/1613985675 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bc8100a80 0x7f2bc81982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:02.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.220+0000 7f2bccb01640 1 -- 172.21.15.2:0/1613985675 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bc8100a80 msgr2=0x7f2bc81982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:02.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.220+0000 7f2bccb01640 1 --2- 172.21.15.2:0/1613985675 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bc8100a80 0x7f2bc81982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:02.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.220+0000 7f2bccb01640 1 -- 172.21.15.2:0/1613985675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bc8101420 msgr2=0x7f2bc8198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:02.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.220+0000 7f2bccb01640 1 --2- 172.21.15.2:0/1613985675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bc8101420 0x7f2bc8198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:02.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.220+0000 7f2bccb01640 1 -- 172.21.15.2:0/1613985675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bc819d290 con 0x7f2bc8106a80 2024-09-19T06:22:02.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.220+0000 7f2bc77fe640 1 --2- 172.21.15.2:0/1613985675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bc8101420 0x7f2bc8198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:02.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.220+0000 7f2bccb01640 1 --2- 172.21.15.2:0/1613985675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc8106a80 0x7f2bc819cbb0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0005cc0 tx=0x7f2bc0003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:02.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.220+0000 7f2bc57fa640 1 -- 172.21.15.2:0/1613985675 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc0004450 con 0x7f2bc8106a80 2024-09-19T06:22:02.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.220+0000 7f2bce564640 1 -- 172.21.15.2:0/1613985675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bc819d520 con 0x7f2bc8106a80 2024-09-19T06:22:02.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.220+0000 7f2bc57fa640 1 -- 172.21.15.2:0/1613985675 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2bc0031c90 con 0x7f2bc8106a80 2024-09-19T06:22:02.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.220+0000 7f2bc57fa640 1 -- 172.21.15.2:0/1613985675 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc0030e70 con 0x7f2bc8106a80 2024-09-19T06:22:02.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.221+0000 7f2bce564640 1 -- 172.21.15.2:0/1613985675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bc81a4e60 con 0x7f2bc8106a80 2024-09-19T06:22:02.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.223+0000 7f2bc57fa640 1 -- 172.21.15.2:0/1613985675 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f2bc00045f0 con 0x7f2bc8106a80 2024-09-19T06:22:02.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.223+0000 7f2bd093d740 1 Processor -- start 2024-09-19T06:22:02.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.223+0000 7f2bd093d740 1 -- start start 2024-09-19T06:22:02.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.224+0000 7f2bd093d740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638c9631a60 0x5638c9631e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:02.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.224+0000 7f2bd093d740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638c9632380 0x5638c9640c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:02.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.224+0000 7f2bd093d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638c9641150 0x5638c9643540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:02.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.224+0000 7f2bd093d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5638c9597280 con 0x5638c9641150 2024-09-19T06:22:02.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.224+0000 7f2bd093d740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5638c953eb10 con 0x5638c9632380 2024-09-19T06:22:02.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.224+0000 7f2bd093d740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5638c9593240 con 0x5638c9631a60 2024-09-19T06:22:02.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.224+0000 7f2bc77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638c9641150 0x5638c9643540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:02.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.224+0000 7f2bc77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638c9641150 0x5638c9643540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45598/0 (socket says 172.21.15.2:45598) 2024-09-19T06:22:02.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.224+0000 7f2bc77fe640 1 -- 172.21.15.2:0/793068994 learned_addr learned my addr 172.21.15.2:0/793068994 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:02.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.224+0000 7f2bc57fa640 1 --2- 172.21.15.2:0/1613985675 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f2bb00a33b0 0x7f2bb00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:02.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.224+0000 7f2bc7fff640 1 --2- 172.21.15.2:0/793068994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638c9632380 0x5638c9640c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:02.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.224+0000 7f2bccb01640 1 --2- 172.21.15.2:0/1613985675 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f2bb00a33b0 0x7f2bb00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:02.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.224+0000 7f2bc77fe640 1 -- 172.21.15.2:0/793068994 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638c9631a60 msgr2=0x5638c9631e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:02.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.224+0000 7f2bc77fe640 1 --2- 172.21.15.2:0/793068994 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638c9631a60 0x5638c9631e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:02.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.224+0000 7f2bc77fe640 1 -- 172.21.15.2:0/793068994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638c9632380 msgr2=0x5638c9640c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:02.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.224+0000 7f2bc77fe640 1 --2- 172.21.15.2:0/793068994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638c9632380 0x5638c9640c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:02.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.224+0000 7f2bc77fe640 1 -- 172.21.15.2:0/793068994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638c954b1f0 con 0x5638c9641150 2024-09-19T06:22:02.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.224+0000 7f2bc57fa640 1 -- 172.21.15.2:0/1613985675 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f2bc002e030 con 0x7f2bc8106a80 2024-09-19T06:22:02.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.225+0000 7f2bccb01640 1 --2- 172.21.15.2:0/1613985675 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f2bb00a33b0 0x7f2bb00a5870 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2bc00ee8c0 tx=0x7f2bc00b9020 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:02.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.225+0000 7f2bc77fe640 1 --2- 172.21.15.2:0/793068994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638c9641150 0x5638c9643540 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc0124f0 tx=0x7f2bbc0129b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fecde57b83f65fb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:02.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.225+0000 7f2bae7fc640 1 -- 172.21.15.2:0/793068994 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc005220 con 0x5638c9641150 2024-09-19T06:22:02.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.225+0000 7f2bae7fc640 1 -- 172.21.15.2:0/793068994 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2bbc004c50 con 0x5638c9641150 2024-09-19T06:22:02.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.225+0000 7f2bae7fc640 1 -- 172.21.15.2:0/793068994 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc0109a0 con 0x5638c9641150 2024-09-19T06:22:02.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.226+0000 7f2bd093d740 1 -- 172.21.15.2:0/793068994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638c9641150 msgr2=0x5638c9643540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:02.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.226+0000 7f2bd093d740 1 --2- 172.21.15.2:0/793068994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638c9641150 0x5638c9643540 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc0124f0 tx=0x7f2bbc0129b0 comp rx=0 tx=0).stop 2024-09-19T06:22:02.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.226+0000 7f2bd093d740 1 -- 172.21.15.2:0/793068994 shutdown_connections 2024-09-19T06:22:02.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.226+0000 7f2bd093d740 1 --2- 172.21.15.2:0/793068994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638c9641150 0x5638c9643540 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:02.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.226+0000 7f2bd093d740 1 --2- 172.21.15.2:0/793068994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638c9632380 0x5638c9640c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:02.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.226+0000 7f2bd093d740 1 --2- 172.21.15.2:0/793068994 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638c9631a60 0x5638c9631e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:02.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.226+0000 7f2bd093d740 1 -- 172.21.15.2:0/793068994 >> 172.21.15.2:0/793068994 conn(0x5638c962e0f0 msgr2=0x5638c962e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:02.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.226+0000 7f2bd093d740 1 -- 172.21.15.2:0/793068994 shutdown_connections 2024-09-19T06:22:02.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.226+0000 7f2bd093d740 1 -- 172.21.15.2:0/793068994 wait complete. 2024-09-19T06:22:02.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.226+0000 7f2bd093d740 1 -- start start 2024-09-19T06:22:02.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.227+0000 7f2bd093d740 1 Processor -- start 2024-09-19T06:22:02.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.227+0000 7f2bd093d740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638c9631a60 0x5638c963e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:02.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.227+0000 7f2bd093d740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638c9632380 0x5638c963e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:02.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.227+0000 7f2bd093d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638c9641150 0x5638c963eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:02.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.227+0000 7f2bd093d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5638c9643d80 con 0x5638c9641150 2024-09-19T06:22:02.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.227+0000 7f2bd093d740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5638c9551f10 con 0x5638c9632380 2024-09-19T06:22:02.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.227+0000 7f2bd093d740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5638c9643f00 con 0x5638c9631a60 2024-09-19T06:22:02.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.227+0000 7f2bd093d740 10 client.0 _ll_register_callbacks cb 0x5638c951aa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:02.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.227+0000 7f2bc77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638c9641150 0x5638c963eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:02.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.227+0000 7f2bc77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638c9641150 0x5638c963eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45604/0 (socket says 172.21.15.2:45604) 2024-09-19T06:22:02.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.227+0000 7f2bc77fe640 1 -- 172.21.15.2:0/2005348097 learned_addr learned my addr 172.21.15.2:0/2005348097 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:02.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.227+0000 7f2bc7fff640 1 --2- 172.21.15.2:0/2005348097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638c9632380 0x5638c963e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:02.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.227+0000 7f2bc77fe640 1 --2- 172.21.15.2:0/2005348097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638c9631a60 0x5638c963e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:02.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.228+0000 7f2bc77fe640 1 -- 172.21.15.2:0/2005348097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638c9631a60 msgr2=0x5638c963e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:02.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.228+0000 7f2bc77fe640 1 --2- 172.21.15.2:0/2005348097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638c9631a60 0x5638c963e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:02.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.228+0000 7f2bc77fe640 1 -- 172.21.15.2:0/2005348097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638c9632380 msgr2=0x5638c963e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:02.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.228+0000 7f2bc77fe640 1 --2- 172.21.15.2:0/2005348097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638c9632380 0x5638c963e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:02.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.228+0000 7f2bc77fe640 1 -- 172.21.15.2:0/2005348097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638c93086a0 con 0x5638c9641150 2024-09-19T06:22:02.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.228+0000 7f2bc7fff640 1 --2- 172.21.15.2:0/2005348097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638c9632380 0x5638c963e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:02.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.228+0000 7f2bc77fe640 1 --2- 172.21.15.2:0/2005348097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638c9641150 0x5638c963eb10 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc00b620 tx=0x7f2bbc00b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=998f2ee8a8673369 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:02.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.228+0000 7f2ba77fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:22:02.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.228+0000 7f2ba77fe640 1 -- 172.21.15.2:0/2005348097 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc02c070 con 0x5638c9641150 2024-09-19T06:22:02.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.228+0000 7f2ba77fe640 1 -- 172.21.15.2:0/2005348097 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f2bbc004020 con 0x5638c9641150 2024-09-19T06:22:02.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.228+0000 7f2bd093d740 1 -- 172.21.15.2:0/2005348097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2bbc004c50 con 0x5638c9641150 2024-09-19T06:22:02.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.229+0000 7f2ba77fe640 1 -- 172.21.15.2:0/2005348097 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2bbc037050 con 0x5638c9641150 2024-09-19T06:22:02.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.229+0000 7f2bd093d740 10 client.17751 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:02.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.229+0000 7f2bd093d740 1 -- 172.21.15.2:0/2005348097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5638c964fa20 con 0x5638c9641150 2024-09-19T06:22:02.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.229+0000 7f2ba77fe640 1 -- 172.21.15.2:0/2005348097 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2bbc004c50 con 0x5638c9641150 2024-09-19T06:22:02.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.229+0000 7f2ba77fe640 1 -- 172.21.15.2:0/2005348097 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f2bbc004220 con 0x5638c9641150 2024-09-19T06:22:02.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.229+0000 7f2bd093d740 10 client.17751 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:02.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.229+0000 7f2bd093d740 10 client.17751 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:02.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.229+0000 7f2bd093d740 20 client.17751 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:02.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.229+0000 7f2bd093d740 1 --2- 172.21.15.2:0/2005348097 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5638c9650e30 0x5638c9653220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:02.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.229+0000 7f2bd093d740 4 client.17751 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:22:02.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.229+0000 7f2bd093d740 1 -- 172.21.15.2:0/2005348097 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5638c95a47f0 con 0x5638c9650e30 2024-09-19T06:22:02.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.229+0000 7f2bc7fff640 1 --2- 172.21.15.2:0/2005348097 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5638c9650e30 0x5638c9653220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:02.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.230+0000 7f2bc7fff640 1 --2- 172.21.15.2:0/2005348097 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5638c9650e30 0x5638c9653220 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72473ab27ba20c90 server_cookie=179fa7ad86f49a89 in_seq=0 out_seq=0 2024-09-19T06:22:02.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.230+0000 7f2ba77fe640 10 client.17751 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:02.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.230+0000 7f2ba77fe640 1 -- 172.21.15.2:0/2005348097 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5638c95a47f0 con 0x5638c9650e30 2024-09-19T06:22:02.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.230+0000 7f2ba77fe640 10 client.17751 handle_command_reply: tid=0 2024-09-19T06:22:02.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.231+0000 7f2bd093d740 1 client.17751 shutdown 2024-09-19T06:22:02.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.231+0000 7f2bd093d740 1 -- 172.21.15.2:0/2005348097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638c9641150 msgr2=0x5638c963eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:02.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.231+0000 7f2bd093d740 1 --2- 172.21.15.2:0/2005348097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638c9641150 0x5638c963eb10 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc00b620 tx=0x7f2bbc00b5b0 comp rx=0 tx=0).stop 2024-09-19T06:22:02.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.231+0000 7f2bd093d740 1 -- 172.21.15.2:0/2005348097 shutdown_connections 2024-09-19T06:22:02.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.231+0000 7f2bd093d740 1 --2- 172.21.15.2:0/2005348097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638c9641150 0x5638c963eb10 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:02.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.231+0000 7f2bd093d740 1 --2- 172.21.15.2:0/2005348097 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5638c9650e30 0x5638c9653220 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:02.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.231+0000 7f2bd093d740 1 --2- 172.21.15.2:0/2005348097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638c9632380 0x5638c963e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:02.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.231+0000 7f2bd093d740 1 --2- 172.21.15.2:0/2005348097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638c9631a60 0x5638c963e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:02.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.231+0000 7f2ba77fe640 0 client.17751 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:02.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.231+0000 7f2bd093d740 1 -- 172.21.15.2:0/2005348097 >> 172.21.15.2:0/2005348097 conn(0x5638c962e0f0 msgr2=0x5638c9633e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:02.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.231+0000 7f2bd093d740 1 -- 172.21.15.2:0/2005348097 shutdown_connections 2024-09-19T06:22:02.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.231+0000 7f2bd093d740 1 -- 172.21.15.2:0/2005348097 wait complete. 2024-09-19T06:22:02.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.231+0000 7f2bd093d740 20 client.17751 trim_cache size 0 max 16384 2024-09-19T06:22:02.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.248+0000 7f2bd093d740 1 Processor -- start 2024-09-19T06:22:02.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.248+0000 7f2bd093d740 1 -- start start 2024-09-19T06:22:02.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.249+0000 7f2bd093d740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638c9631a60 0x5638c96589e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:02.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.249+0000 7f2bd093d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638c9632380 0x5638c9658f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:02.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.249+0000 7f2bd093d740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638c9641150 0x5638c9633590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:02.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.249+0000 7f2bd093d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc81add60 con 0x5638c9632380 2024-09-19T06:22:02.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.249+0000 7f2bd093d740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc81ab630 con 0x5638c9641150 2024-09-19T06:22:02.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.249+0000 7f2bd093d740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc81a94c0 con 0x5638c9631a60 2024-09-19T06:22:02.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.249+0000 7f2bc7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638c9632380 0x5638c9658f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:02.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.249+0000 7f2bc7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638c9632380 0x5638c9658f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45618/0 (socket says 172.21.15.2:45618) 2024-09-19T06:22:02.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.249+0000 7f2bc7fff640 1 -- 172.21.15.2:0/1412280802 learned_addr learned my addr 172.21.15.2:0/1412280802 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:02.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.249+0000 7f2bc77fe640 1 --2- 172.21.15.2:0/1412280802 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638c9641150 0x5638c9633590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:02.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.249+0000 7f2bc77fe640 1 --2- 172.21.15.2:0/1412280802 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638c9631a60 0x5638c96589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:02.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.249+0000 7f2bc7fff640 1 -- 172.21.15.2:0/1412280802 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638c9631a60 msgr2=0x5638c96589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:02.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.249+0000 7f2bc7fff640 1 --2- 172.21.15.2:0/1412280802 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638c9631a60 0x5638c96589e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:02.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.249+0000 7f2bc7fff640 1 -- 172.21.15.2:0/1412280802 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638c9641150 msgr2=0x5638c9633590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:02.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.249+0000 7f2bc7fff640 1 --2- 172.21.15.2:0/1412280802 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638c9641150 0x5638c9633590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:02.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.249+0000 7f2bc7fff640 1 -- 172.21.15.2:0/1412280802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638c96321b0 con 0x5638c9632380 2024-09-19T06:22:02.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.249+0000 7f2bc7fff640 1 --2- 172.21.15.2:0/1412280802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638c9632380 0x5638c9658f20 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f2bb8005f10 tx=0x7f2bb800a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34e7b2e8db87abeb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:02.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.249+0000 7f2badffb640 1 -- 172.21.15.2:0/1412280802 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb8005220 con 0x5638c9632380 2024-09-19T06:22:02.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.249+0000 7f2badffb640 1 -- 172.21.15.2:0/1412280802 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2bb8004c50 con 0x5638c9632380 2024-09-19T06:22:02.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.249+0000 7f2badffb640 1 -- 172.21.15.2:0/1412280802 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb800faf0 con 0x5638c9632380 2024-09-19T06:22:02.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.250+0000 7f2bd093d740 1 -- 172.21.15.2:0/1412280802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638c9632380 msgr2=0x5638c9658f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:02.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.250+0000 7f2bd093d740 1 --2- 172.21.15.2:0/1412280802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638c9632380 0x5638c9658f20 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f2bb8005f10 tx=0x7f2bb800a2d0 comp rx=0 tx=0).stop 2024-09-19T06:22:02.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.250+0000 7f2bd093d740 1 -- 172.21.15.2:0/1412280802 shutdown_connections 2024-09-19T06:22:02.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.250+0000 7f2bd093d740 1 --2- 172.21.15.2:0/1412280802 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638c9641150 0x5638c9633590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:02.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.250+0000 7f2bd093d740 1 --2- 172.21.15.2:0/1412280802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638c9632380 0x5638c9658f20 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:02.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.250+0000 7f2bd093d740 1 --2- 172.21.15.2:0/1412280802 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638c9631a60 0x5638c96589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:02.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.250+0000 7f2bd093d740 1 -- 172.21.15.2:0/1412280802 >> 172.21.15.2:0/1412280802 conn(0x5638c962e0f0 msgr2=0x5638c9640000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:02.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.250+0000 7f2bd093d740 1 -- 172.21.15.2:0/1412280802 shutdown_connections 2024-09-19T06:22:02.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.250+0000 7f2bd093d740 1 -- 172.21.15.2:0/1412280802 wait complete. 2024-09-19T06:22:02.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.250+0000 7f2bd093d740 1 -- start start 2024-09-19T06:22:02.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.251+0000 7f2bd093d740 1 Processor -- start 2024-09-19T06:22:02.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.251+0000 7f2bd093d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638c9631a60 0x5638c96495f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:02.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.251+0000 7f2bd093d740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638c9632380 0x5638c9644920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:02.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.251+0000 7f2bd093d740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638c9641150 0x5638c9644e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:02.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.251+0000 7f2bd093d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc81a9b10 con 0x5638c9631a60 2024-09-19T06:22:02.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.251+0000 7f2bd093d740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc81aaf60 con 0x5638c9632380 2024-09-19T06:22:02.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.251+0000 7f2bd093d740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc81aa1c0 con 0x5638c9641150 2024-09-19T06:22:02.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.251+0000 7f2bd093d740 10 client.0 _ll_register_callbacks cb 0x7f2bb800a630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:02.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.251+0000 7f2bc77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638c9631a60 0x5638c96495f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:02.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.251+0000 7f2bc77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638c9631a60 0x5638c96495f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45634/0 (socket says 172.21.15.2:45634) 2024-09-19T06:22:02.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.251+0000 7f2bc77fe640 1 -- 172.21.15.2:0/2342883391 learned_addr learned my addr 172.21.15.2:0/2342883391 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:02.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.251+0000 7f2bc77fe640 1 --2- 172.21.15.2:0/2342883391 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638c9641150 0x5638c9644e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:02.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.251+0000 7f2bc7fff640 1 --2- 172.21.15.2:0/2342883391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638c9632380 0x5638c9644920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:02.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.252+0000 7f2bc77fe640 1 -- 172.21.15.2:0/2342883391 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638c9641150 msgr2=0x5638c9644e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:02.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.252+0000 7f2bc77fe640 1 --2- 172.21.15.2:0/2342883391 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638c9641150 0x5638c9644e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:02.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.252+0000 7f2bc77fe640 1 -- 172.21.15.2:0/2342883391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638c9632380 msgr2=0x5638c9644920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:02.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.252+0000 7f2bc77fe640 1 --2- 172.21.15.2:0/2342883391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638c9632380 0x5638c9644920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:02.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.252+0000 7f2bc77fe640 1 -- 172.21.15.2:0/2342883391 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638c96453a0 con 0x5638c9631a60 2024-09-19T06:22:02.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.252+0000 7f2bc7fff640 1 --2- 172.21.15.2:0/2342883391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638c9632380 0x5638c9644920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:02.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.252+0000 7f2bc77fe640 1 --2- 172.21.15.2:0/2342883391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638c9631a60 0x5638c96495f0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc001eb0 tx=0x7f2bbc00b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=441f057890c58ace server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:02.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.252+0000 7f2ba77fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:22:02.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.252+0000 7f2ba77fe640 1 -- 172.21.15.2:0/2342883391 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc02c040 con 0x5638c9631a60 2024-09-19T06:22:02.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.252+0000 7f2ba77fe640 1 -- 172.21.15.2:0/2342883391 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f2bbc010570 con 0x5638c9631a60 2024-09-19T06:22:02.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.252+0000 7f2bd093d740 1 -- 172.21.15.2:0/2342883391 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2bb8004c50 con 0x5638c9631a60 2024-09-19T06:22:02.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.252+0000 7f2ba77fe640 1 -- 172.21.15.2:0/2342883391 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2bbc00bd70 con 0x5638c9631a60 2024-09-19T06:22:02.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.252+0000 7f2bd093d740 10 client.17757 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:02.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.252+0000 7f2bd093d740 1 -- 172.21.15.2:0/2342883391 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5638c96bb700 con 0x5638c9631a60 2024-09-19T06:22:02.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.252+0000 7f2ba77fe640 1 -- 172.21.15.2:0/2342883391 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2bb8004c50 con 0x5638c9631a60 2024-09-19T06:22:02.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.253+0000 7f2ba77fe640 1 -- 172.21.15.2:0/2342883391 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f2bbc003ac0 con 0x5638c9631a60 2024-09-19T06:22:02.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.253+0000 7f2bd093d740 10 client.17757 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:02.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.253+0000 7f2bd093d740 10 client.17757 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:02.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.253+0000 7f2bd093d740 20 client.17757 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:02.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.253+0000 7f2bd093d740 1 --2- 172.21.15.2:0/2342883391 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5638c96bbd60 0x5638c96be150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:02.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.253+0000 7f2bd093d740 4 client.17757 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:22:02.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.253+0000 7f2bd093d740 1 -- 172.21.15.2:0/2342883391 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5638c959ed00 con 0x5638c96bbd60 2024-09-19T06:22:02.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.253+0000 7f2bc7fff640 1 --2- 172.21.15.2:0/2342883391 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5638c96bbd60 0x5638c96be150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:02.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.253+0000 7f2ba77fe640 10 client.17757 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:02.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.253+0000 7f2bc7fff640 1 --2- 172.21.15.2:0/2342883391 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5638c96bbd60 0x5638c96be150 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11db913c04ca0350 server_cookie=bcd4866756389f4d in_seq=0 out_seq=0 2024-09-19T06:22:02.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.254+0000 7f2ba77fe640 1 -- 172.21.15.2:0/2342883391 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5638c959ed00 con 0x5638c96bbd60 2024-09-19T06:22:02.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.255+0000 7f2ba77fe640 10 client.17757 handle_command_reply: tid=0 2024-09-19T06:22:02.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.255+0000 7f2bd093d740 1 client.17757 shutdown 2024-09-19T06:22:02.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.255+0000 7f2bd093d740 1 -- 172.21.15.2:0/2342883391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638c9631a60 msgr2=0x5638c96495f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:02.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.255+0000 7f2bd093d740 1 --2- 172.21.15.2:0/2342883391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638c9631a60 0x5638c96495f0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc001eb0 tx=0x7f2bbc00b5b0 comp rx=0 tx=0).stop 2024-09-19T06:22:02.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.255+0000 7f2bd093d740 1 -- 172.21.15.2:0/2342883391 shutdown_connections 2024-09-19T06:22:02.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.255+0000 7f2bd093d740 1 --2- 172.21.15.2:0/2342883391 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5638c9641150 0x5638c9644e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:02.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.255+0000 7f2bd093d740 1 --2- 172.21.15.2:0/2342883391 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5638c96bbd60 0x5638c96be150 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:02.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.255+0000 7f2bd093d740 1 --2- 172.21.15.2:0/2342883391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638c9632380 0x5638c9644920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:02.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.255+0000 7f2ba77fe640 0 client.17757 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:02.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.255+0000 7f2bd093d740 1 --2- 172.21.15.2:0/2342883391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5638c9631a60 0x5638c96495f0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:02.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.255+0000 7f2bd093d740 1 -- 172.21.15.2:0/2342883391 >> 172.21.15.2:0/2342883391 conn(0x5638c962e0f0 msgr2=0x5638c962ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:02.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.255+0000 7f2bd093d740 1 -- 172.21.15.2:0/2342883391 shutdown_connections 2024-09-19T06:22:02.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.255+0000 7f2bd093d740 1 -- 172.21.15.2:0/2342883391 wait complete. 2024-09-19T06:22:02.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.255+0000 7f2bd093d740 20 client.17757 trim_cache size 0 max 16384 2024-09-19T06:22:02.265 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:22:02.265 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T06:22:02.265 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "e146f146-1f51-4357-9b45-952ee3d9737b", 2024-09-19T06:22:02.265 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T06:22:02.265 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:22:02.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.256+0000 7f2bce564640 1 -- 172.21.15.2:0/1613985675 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f2bb00a33b0 msgr2=0x7f2bb00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:02.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.256+0000 7f2bce564640 1 --2- 172.21.15.2:0/1613985675 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f2bb00a33b0 0x7f2bb00a5870 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2bc00ee8c0 tx=0x7f2bc00b9020 comp rx=0 tx=0).stop 2024-09-19T06:22:02.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.256+0000 7f2bce564640 1 -- 172.21.15.2:0/1613985675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc8106a80 msgr2=0x7f2bc819cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:02.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.256+0000 7f2bce564640 1 --2- 172.21.15.2:0/1613985675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc8106a80 0x7f2bc819cbb0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0005cc0 tx=0x7f2bc0003c20 comp rx=0 tx=0).stop 2024-09-19T06:22:02.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.256+0000 7f2bce564640 1 -- 172.21.15.2:0/1613985675 shutdown_connections 2024-09-19T06:22:02.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.256+0000 7f2bce564640 1 --2- 172.21.15.2:0/1613985675 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f2bb00a33b0 0x7f2bb00a5870 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:02.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.256+0000 7f2bce564640 1 --2- 172.21.15.2:0/1613985675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc8106a80 0x7f2bc819cbb0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:02.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.256+0000 7f2bce564640 1 --2- 172.21.15.2:0/1613985675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bc8101420 0x7f2bc8198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:02.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.256+0000 7f2bce564640 1 --2- 172.21.15.2:0/1613985675 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bc8100a80 0x7f2bc81982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:02.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.256+0000 7f2bce564640 1 -- 172.21.15.2:0/1613985675 >> 172.21.15.2:0/1613985675 conn(0x7f2bc80fc7a0 msgr2=0x7f2bc806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:02.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.256+0000 7f2bce564640 1 -- 172.21.15.2:0/1613985675 shutdown_connections 2024-09-19T06:22:02.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:02.256+0000 7f2bce564640 1 -- 172.21.15.2:0/1613985675 wait complete. 2024-09-19T06:22:02.911 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:22:03.197 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:22:03.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:03 smithi002 ceph-mon[30982]: pgmap v222: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:22:03.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:03 smithi002 ceph-mon[30982]: scrub queued for path: / 2024-09-19T06:22:03.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:03 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:22:03.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:03 smithi002 ceph-mon[30982]: scrub summary: active paths [/] 2024-09-19T06:22:03.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:03 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:22:03.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:03 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:22:03.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:03 smithi002 ceph-mon[30982]: scrub summary: idle 2024-09-19T06:22:03.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.645+0000 7ff7e667e640 1 -- 172.21.15.2:0/1396141840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7e0101400 msgr2=0x7ff7e010d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:03.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.645+0000 7ff7e667e640 1 --2- 172.21.15.2:0/1396141840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7e0101400 0x7ff7e010d930 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7ff7d8009cd0 tx=0x7ff7d802a8e0 comp rx=0 tx=0).stop 2024-09-19T06:22:03.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.645+0000 7ff7e667e640 1 -- 172.21.15.2:0/1396141840 shutdown_connections 2024-09-19T06:22:03.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.645+0000 7ff7e667e640 1 --2- 172.21.15.2:0/1396141840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7e0101400 0x7ff7e010d930 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:03.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.645+0000 7ff7e667e640 1 --2- 172.21.15.2:0/1396141840 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7e0100a60 0x7ff7e0100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:03.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.645+0000 7ff7e667e640 1 --2- 172.21.15.2:0/1396141840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7e0106a60 0x7ff7e0106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:03.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.645+0000 7ff7e667e640 1 -- 172.21.15.2:0/1396141840 >> 172.21.15.2:0/1396141840 conn(0x7ff7e00fc780 msgr2=0x7ff7e00feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:03.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.645+0000 7ff7e667e640 1 -- 172.21.15.2:0/1396141840 shutdown_connections 2024-09-19T06:22:03.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.645+0000 7ff7e667e640 1 -- 172.21.15.2:0/1396141840 wait complete. 2024-09-19T06:22:03.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.645+0000 7ff7e667e640 1 Processor -- start 2024-09-19T06:22:03.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.645+0000 7ff7e667e640 1 -- start start 2024-09-19T06:22:03.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.646+0000 7ff7e667e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7e0100a60 0x7ff7e01982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:03.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.646+0000 7ff7e667e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7e0101400 0x7ff7e0198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:03.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.646+0000 7ff7e667e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7e0106a60 0x7ff7e019cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:03.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.646+0000 7ff7e667e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e0110d60 con 0x7ff7e0101400 2024-09-19T06:22:03.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.646+0000 7ff7e667e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e0110be0 con 0x7ff7e0106a60 2024-09-19T06:22:03.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.646+0000 7ff7e667e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e0110ee0 con 0x7ff7e0100a60 2024-09-19T06:22:03.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.646+0000 7ff7df7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7e0101400 0x7ff7e0198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:03.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.646+0000 7ff7df7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7e0101400 0x7ff7e0198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45650/0 (socket says 172.21.15.2:45650) 2024-09-19T06:22:03.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.646+0000 7ff7e4c1b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7e0106a60 0x7ff7e019cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:03.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.646+0000 7ff7df7fe640 1 -- 172.21.15.2:0/2860353490 learned_addr learned my addr 172.21.15.2:0/2860353490 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:03.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.646+0000 7ff7dffff640 1 --2- 172.21.15.2:0/2860353490 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7e0100a60 0x7ff7e01982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:03.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.646+0000 7ff7df7fe640 1 -- 172.21.15.2:0/2860353490 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7e0100a60 msgr2=0x7ff7e01982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:03.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.646+0000 7ff7df7fe640 1 --2- 172.21.15.2:0/2860353490 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7e0100a60 0x7ff7e01982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:03.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.646+0000 7ff7df7fe640 1 -- 172.21.15.2:0/2860353490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7e0106a60 msgr2=0x7ff7e019cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:03.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.646+0000 7ff7df7fe640 1 --2- 172.21.15.2:0/2860353490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7e0106a60 0x7ff7e019cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:03.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.646+0000 7ff7df7fe640 1 -- 172.21.15.2:0/2860353490 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7e019d290 con 0x7ff7e0101400 2024-09-19T06:22:03.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.647+0000 7ff7df7fe640 1 --2- 172.21.15.2:0/2860353490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7e0101400 0x7ff7e0198820 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7ff7d400c920 tx=0x7ff7d400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:03.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.647+0000 7ff7dd7fa640 1 -- 172.21.15.2:0/2860353490 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d4007c70 con 0x7ff7e0101400 2024-09-19T06:22:03.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.647+0000 7ff7e667e640 1 -- 172.21.15.2:0/2860353490 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7e019d580 con 0x7ff7e0101400 2024-09-19T06:22:03.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.647+0000 7ff7dd7fa640 1 -- 172.21.15.2:0/2860353490 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff7d4007e10 con 0x7ff7e0101400 2024-09-19T06:22:03.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.647+0000 7ff7dd7fa640 1 -- 172.21.15.2:0/2860353490 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d4018820 con 0x7ff7e0101400 2024-09-19T06:22:03.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.647+0000 7ff7e667e640 1 -- 172.21.15.2:0/2860353490 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7e01a4e60 con 0x7ff7e0101400 2024-09-19T06:22:03.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.649+0000 7ff7dd7fa640 1 -- 172.21.15.2:0/2860353490 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7ff7d40189c0 con 0x7ff7e0101400 2024-09-19T06:22:03.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.649+0000 7ff7e8a57740 1 Processor -- start 2024-09-19T06:22:03.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.650+0000 7ff7e8a57740 1 -- start start 2024-09-19T06:22:03.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.650+0000 7ff7e8a57740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cc5acd94a0 0x55cc5acd9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:03.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.650+0000 7ff7e8a57740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc5acd9dc0 0x55cc5ace4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:03.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.650+0000 7ff7e8a57740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc5ace4680 0x55cc5ace6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:03.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.650+0000 7ff7e8a57740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55cc5ac3f2e0 con 0x55cc5ace4680 2024-09-19T06:22:03.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.650+0000 7ff7e8a57740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55cc5abe6ce0 con 0x55cc5acd94a0 2024-09-19T06:22:03.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.650+0000 7ff7e8a57740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55cc5ac3b2a0 con 0x55cc5acd9dc0 2024-09-19T06:22:03.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.650+0000 7ff7dd7fa640 1 --2- 172.21.15.2:0/2860353490 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff7c80a33b0 0x7ff7c80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:03.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.650+0000 7ff7df7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc5ace4680 0x55cc5ace6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:03.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.650+0000 7ff7dffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc5acd9dc0 0x55cc5ace4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:03.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.650+0000 7ff7df7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc5ace4680 0x55cc5ace6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45654/0 (socket says 172.21.15.2:45654) 2024-09-19T06:22:03.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.650+0000 7ff7e4c1b640 1 --2- 172.21.15.2:0/2860353490 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff7c80a33b0 0x7ff7c80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:03.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.650+0000 7ff7df7fe640 1 -- 172.21.15.2:0/1013336608 learned_addr learned my addr 172.21.15.2:0/1013336608 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:03.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.650+0000 7ff7e4c1b640 1 --2- 172.21.15.2:0/1013336608 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cc5acd94a0 0x55cc5acd9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:03.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.650+0000 7ff7dd7fa640 1 -- 172.21.15.2:0/2860353490 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7ff7d40cfe00 con 0x7ff7e0101400 2024-09-19T06:22:03.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.650+0000 7ff7dffff640 1 -- 172.21.15.2:0/1013336608 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cc5acd94a0 msgr2=0x55cc5acd9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:03.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.650+0000 7ff7dffff640 1 --2- 172.21.15.2:0/1013336608 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cc5acd94a0 0x55cc5acd9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:03.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.650+0000 7ff7dffff640 1 -- 172.21.15.2:0/1013336608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc5ace4680 msgr2=0x55cc5ace6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:03.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.651+0000 7ff7dffff640 1 --2- 172.21.15.2:0/1013336608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc5ace4680 0x55cc5ace6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:03.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.651+0000 7ff7dffff640 1 -- 172.21.15.2:0/1013336608 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc5abcb440 con 0x55cc5acd9dc0 2024-09-19T06:22:03.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.651+0000 7ff7e4c1b640 1 --2- 172.21.15.2:0/1013336608 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cc5acd94a0 0x55cc5acd9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:03.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.651+0000 7ff7df7fe640 1 --2- 172.21.15.2:0/1013336608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc5ace4680 0x55cc5ace6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:03.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.651+0000 7ff7dffff640 1 --2- 172.21.15.2:0/1013336608 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc5acd9dc0 0x55cc5ace4140 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff7d000bb70 tx=0x7ff7d00107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a9d071c8c0a0de0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:03.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.651+0000 7ff7e4c1b640 1 --2- 172.21.15.2:0/2860353490 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff7c80a33b0 0x7ff7c80a5870 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff7d8004af0 tx=0x7ff7d8009360 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:03.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.651+0000 7ff7c67fc640 1 -- 172.21.15.2:0/1013336608 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d0004030 con 0x55cc5acd9dc0 2024-09-19T06:22:03.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.651+0000 7ff7c67fc640 1 -- 172.21.15.2:0/1013336608 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff7d00035f0 con 0x55cc5acd9dc0 2024-09-19T06:22:03.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.651+0000 7ff7c67fc640 1 -- 172.21.15.2:0/1013336608 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d00116a0 con 0x55cc5acd9dc0 2024-09-19T06:22:03.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.652+0000 7ff7e8a57740 1 -- 172.21.15.2:0/1013336608 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc5acd9dc0 msgr2=0x55cc5ace4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:03.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.652+0000 7ff7e8a57740 1 --2- 172.21.15.2:0/1013336608 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc5acd9dc0 0x55cc5ace4140 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff7d000bb70 tx=0x7ff7d00107a0 comp rx=0 tx=0).stop 2024-09-19T06:22:03.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.652+0000 7ff7e8a57740 1 -- 172.21.15.2:0/1013336608 shutdown_connections 2024-09-19T06:22:03.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.652+0000 7ff7e8a57740 1 --2- 172.21.15.2:0/1013336608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc5ace4680 0x55cc5ace6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:03.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.652+0000 7ff7e8a57740 1 --2- 172.21.15.2:0/1013336608 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc5acd9dc0 0x55cc5ace4140 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:03.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.652+0000 7ff7e8a57740 1 --2- 172.21.15.2:0/1013336608 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cc5acd94a0 0x55cc5acd9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:03.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.652+0000 7ff7e8a57740 1 -- 172.21.15.2:0/1013336608 >> 172.21.15.2:0/1013336608 conn(0x55cc5acd5a30 msgr2=0x55cc5acd5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:03.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.652+0000 7ff7e8a57740 1 -- 172.21.15.2:0/1013336608 shutdown_connections 2024-09-19T06:22:03.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.652+0000 7ff7e8a57740 1 -- 172.21.15.2:0/1013336608 wait complete. 2024-09-19T06:22:03.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.652+0000 7ff7e8a57740 1 -- start start 2024-09-19T06:22:03.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.652+0000 7ff7e8a57740 1 Processor -- start 2024-09-19T06:22:03.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.653+0000 7ff7e8a57740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc5acd94a0 0x55cc5ace3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:03.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.653+0000 7ff7e8a57740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cc5acd9dc0 0x55cc5ace11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:03.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.653+0000 7ff7e8a57740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc5ace4680 0x55cc5ace1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:03.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.653+0000 7ff7e8a57740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55cc5ace7250 con 0x55cc5acd94a0 2024-09-19T06:22:03.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.653+0000 7ff7e8a57740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55cc5abfa050 con 0x55cc5acd9dc0 2024-09-19T06:22:03.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.653+0000 7ff7e8a57740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55cc5ace73d0 con 0x55cc5ace4680 2024-09-19T06:22:03.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.653+0000 7ff7e8a57740 10 client.0 _ll_register_callbacks cb 0x55cc5ac3a160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:03.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.653+0000 7ff7dffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc5acd94a0 0x55cc5ace3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:03.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.653+0000 7ff7dffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc5acd94a0 0x55cc5ace3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45656/0 (socket says 172.21.15.2:45656) 2024-09-19T06:22:03.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.653+0000 7ff7e4c1b640 1 --2- 172.21.15.2:0/1912602259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc5ace4680 0x55cc5ace1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:03.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.653+0000 7ff7dffff640 1 -- 172.21.15.2:0/1912602259 learned_addr learned my addr 172.21.15.2:0/1912602259 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:03.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.653+0000 7ff7df7fe640 1 --2- 172.21.15.2:0/1912602259 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cc5acd9dc0 0x55cc5ace11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:03.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.653+0000 7ff7dffff640 1 -- 172.21.15.2:0/1912602259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc5ace4680 msgr2=0x55cc5ace1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:03.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.653+0000 7ff7dffff640 1 --2- 172.21.15.2:0/1912602259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc5ace4680 0x55cc5ace1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:03.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.653+0000 7ff7dffff640 1 -- 172.21.15.2:0/1912602259 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cc5acd9dc0 msgr2=0x55cc5ace11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:03.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.653+0000 7ff7dffff640 1 --2- 172.21.15.2:0/1912602259 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cc5acd9dc0 0x55cc5ace11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:03.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.653+0000 7ff7dffff640 1 -- 172.21.15.2:0/1912602259 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc5a9b03c0 con 0x55cc5acd94a0 2024-09-19T06:22:03.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.653+0000 7ff7e4c1b640 1 --2- 172.21.15.2:0/1912602259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc5ace4680 0x55cc5ace1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:03.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.653+0000 7ff7df7fe640 1 --2- 172.21.15.2:0/1912602259 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cc5acd9dc0 0x55cc5ace11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:03.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.653+0000 7ff7dffff640 1 --2- 172.21.15.2:0/1912602259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc5acd94a0 0x55cc5ace3f30 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0011010 tx=0x7ff7d000bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=279de64b407d9e9d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:03.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.653+0000 7ff7bf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:22:03.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.653+0000 7ff7bf7fe640 1 -- 172.21.15.2:0/1912602259 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d002a060 con 0x55cc5acd94a0 2024-09-19T06:22:03.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.653+0000 7ff7e8a57740 1 -- 172.21.15.2:0/1912602259 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7d00035f0 con 0x55cc5acd94a0 2024-09-19T06:22:03.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.654+0000 7ff7bf7fe640 1 -- 172.21.15.2:0/1912602259 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7ff7d00039b0 con 0x55cc5acd94a0 2024-09-19T06:22:03.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.654+0000 7ff7bf7fe640 1 -- 172.21.15.2:0/1912602259 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff7d0003f40 con 0x55cc5acd94a0 2024-09-19T06:22:03.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.654+0000 7ff7e8a57740 10 client.17769 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:03.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.654+0000 7ff7e8a57740 1 -- 172.21.15.2:0/1912602259 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55cc5acf7010 con 0x55cc5acd94a0 2024-09-19T06:22:03.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.654+0000 7ff7bf7fe640 1 -- 172.21.15.2:0/1912602259 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff7d00035f0 con 0x55cc5acd94a0 2024-09-19T06:22:03.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.654+0000 7ff7bf7fe640 1 -- 172.21.15.2:0/1912602259 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7ff7d00046c0 con 0x55cc5acd94a0 2024-09-19T06:22:03.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.654+0000 7ff7e8a57740 10 client.17769 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:03.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.654+0000 7ff7e8a57740 10 client.17769 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:03.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.654+0000 7ff7e8a57740 20 client.17769 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:03.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.654+0000 7ff7e8a57740 1 --2- 172.21.15.2:0/1912602259 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55cc5acf8420 0x55cc5acfa810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:03.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.654+0000 7ff7e8a57740 4 client.17769 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:22:03.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.654+0000 7ff7e8a57740 1 -- 172.21.15.2:0/1912602259 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc5ac4c850 con 0x55cc5acf8420 2024-09-19T06:22:03.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.654+0000 7ff7df7fe640 1 --2- 172.21.15.2:0/1912602259 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55cc5acf8420 0x55cc5acfa810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:03.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.655+0000 7ff7df7fe640 1 --2- 172.21.15.2:0/1912602259 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55cc5acf8420 0x55cc5acfa810 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f95332ab24fe39f5 server_cookie=4ffd06c4999bdaf2 in_seq=0 out_seq=0 2024-09-19T06:22:03.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.655+0000 7ff7bf7fe640 10 client.17769 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:03.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.655+0000 7ff7bf7fe640 1 -- 172.21.15.2:0/1912602259 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cc5ac4c850 con 0x55cc5acf8420 2024-09-19T06:22:03.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.655+0000 7ff7bf7fe640 10 client.17769 handle_command_reply: tid=0 2024-09-19T06:22:03.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.655+0000 7ff7e8a57740 1 client.17769 shutdown 2024-09-19T06:22:03.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.656+0000 7ff7e8a57740 1 -- 172.21.15.2:0/1912602259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc5acd94a0 msgr2=0x55cc5ace3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:03.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.656+0000 7ff7e8a57740 1 --2- 172.21.15.2:0/1912602259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc5acd94a0 0x55cc5ace3f30 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0011010 tx=0x7ff7d000bf50 comp rx=0 tx=0).stop 2024-09-19T06:22:03.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.656+0000 7ff7e8a57740 1 -- 172.21.15.2:0/1912602259 shutdown_connections 2024-09-19T06:22:03.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.656+0000 7ff7e8a57740 1 --2- 172.21.15.2:0/1912602259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc5ace4680 0x55cc5ace1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:03.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.656+0000 7ff7e8a57740 1 --2- 172.21.15.2:0/1912602259 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55cc5acf8420 0x55cc5acfa810 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:03.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.656+0000 7ff7e8a57740 1 --2- 172.21.15.2:0/1912602259 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cc5acd9dc0 0x55cc5ace11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:03.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.656+0000 7ff7e8a57740 1 --2- 172.21.15.2:0/1912602259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc5acd94a0 0x55cc5ace3f30 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:03.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.656+0000 7ff7e8a57740 1 -- 172.21.15.2:0/1912602259 >> 172.21.15.2:0/1912602259 conn(0x55cc5acd5a30 msgr2=0x55cc5acdb710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:03.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.656+0000 7ff7bf7fe640 0 client.17769 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:03.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.656+0000 7ff7e8a57740 1 -- 172.21.15.2:0/1912602259 shutdown_connections 2024-09-19T06:22:03.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.656+0000 7ff7e8a57740 1 -- 172.21.15.2:0/1912602259 wait complete. 2024-09-19T06:22:03.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.656+0000 7ff7e8a57740 20 client.17769 trim_cache size 0 max 16384 2024-09-19T06:22:03.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.673+0000 7ff7e8a57740 1 Processor -- start 2024-09-19T06:22:03.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.673+0000 7ff7e8a57740 1 -- start start 2024-09-19T06:22:03.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.673+0000 7ff7e8a57740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cc5acd5a30 0x55cc5acdc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:03.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.674+0000 7ff7e8a57740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc5acd94a0 0x55cc5acdb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:03.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.674+0000 7ff7e8a57740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc5acd9dc0 0x55cc5acffe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:03.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.674+0000 7ff7e8a57740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e01adee0 con 0x55cc5acd94a0 2024-09-19T06:22:03.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.674+0000 7ff7e8a57740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e01ab7b0 con 0x55cc5acd5a30 2024-09-19T06:22:03.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.674+0000 7ff7e8a57740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e01a9620 con 0x55cc5acd9dc0 2024-09-19T06:22:03.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.674+0000 7ff7df7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc5acd94a0 0x55cc5acdb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:03.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.674+0000 7ff7df7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc5acd94a0 0x55cc5acdb600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45662/0 (socket says 172.21.15.2:45662) 2024-09-19T06:22:03.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.674+0000 7ff7df7fe640 1 -- 172.21.15.2:0/1355991499 learned_addr learned my addr 172.21.15.2:0/1355991499 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:03.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.674+0000 7ff7dffff640 1 --2- 172.21.15.2:0/1355991499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cc5acd5a30 0x55cc5acdc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:03.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.674+0000 7ff7e4c1b640 1 --2- 172.21.15.2:0/1355991499 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc5acd9dc0 0x55cc5acffe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:03.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.674+0000 7ff7df7fe640 1 -- 172.21.15.2:0/1355991499 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc5acd9dc0 msgr2=0x55cc5acffe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:03.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.674+0000 7ff7df7fe640 1 --2- 172.21.15.2:0/1355991499 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc5acd9dc0 0x55cc5acffe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:03.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.674+0000 7ff7df7fe640 1 -- 172.21.15.2:0/1355991499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cc5acd5a30 msgr2=0x55cc5acdc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:03.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.674+0000 7ff7df7fe640 1 --2- 172.21.15.2:0/1355991499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cc5acd5a30 0x55cc5acdc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:03.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.674+0000 7ff7df7fe640 1 -- 172.21.15.2:0/1355991499 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc5ace42a0 con 0x55cc5acd94a0 2024-09-19T06:22:03.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.674+0000 7ff7e4c1b640 1 --2- 172.21.15.2:0/1355991499 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc5acd9dc0 0x55cc5acffe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:03.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.674+0000 7ff7df7fe640 1 --2- 172.21.15.2:0/1355991499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc5acd94a0 0x55cc5acdb600 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7ff7d4098a50 tx=0x7ff7d4098320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64e7e169d361d4be server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:03.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.674+0000 7ff7c5ffb640 1 -- 172.21.15.2:0/1355991499 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d40a0430 con 0x55cc5acd94a0 2024-09-19T06:22:03.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.674+0000 7ff7c5ffb640 1 -- 172.21.15.2:0/1355991499 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff7d40a4cf0 con 0x55cc5acd94a0 2024-09-19T06:22:03.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.674+0000 7ff7c5ffb640 1 -- 172.21.15.2:0/1355991499 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d40cd770 con 0x55cc5acd94a0 2024-09-19T06:22:03.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.675+0000 7ff7e8a57740 1 -- 172.21.15.2:0/1355991499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc5acd94a0 msgr2=0x55cc5acdb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:03.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.675+0000 7ff7e8a57740 1 --2- 172.21.15.2:0/1355991499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc5acd94a0 0x55cc5acdb600 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7ff7d4098a50 tx=0x7ff7d4098320 comp rx=0 tx=0).stop 2024-09-19T06:22:03.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.675+0000 7ff7e8a57740 1 -- 172.21.15.2:0/1355991499 shutdown_connections 2024-09-19T06:22:03.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.675+0000 7ff7e8a57740 1 --2- 172.21.15.2:0/1355991499 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc5acd9dc0 0x55cc5acffe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:03.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.675+0000 7ff7e8a57740 1 --2- 172.21.15.2:0/1355991499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc5acd94a0 0x55cc5acdb600 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:03.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.675+0000 7ff7e8a57740 1 --2- 172.21.15.2:0/1355991499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cc5acd5a30 0x55cc5acdc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:03.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.675+0000 7ff7e8a57740 1 -- 172.21.15.2:0/1355991499 >> 172.21.15.2:0/1355991499 conn(0x55cc5ace1880 msgr2=0x55cc5acdaef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:03.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.675+0000 7ff7e8a57740 1 -- 172.21.15.2:0/1355991499 shutdown_connections 2024-09-19T06:22:03.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.675+0000 7ff7e8a57740 1 -- 172.21.15.2:0/1355991499 wait complete. 2024-09-19T06:22:03.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.675+0000 7ff7e8a57740 1 -- start start 2024-09-19T06:22:03.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.676+0000 7ff7e8a57740 1 Processor -- start 2024-09-19T06:22:03.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.676+0000 7ff7e8a57740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc5acd5a30 0x55cc5acebbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:03.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.676+0000 7ff7e8a57740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cc5acd94a0 0x55cc5acec100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:03.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.676+0000 7ff7e8a57740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc5acd9dc0 0x55cc5ad60e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:03.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.676+0000 7ff7e8a57740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e01a9c70 con 0x55cc5acd5a30 2024-09-19T06:22:03.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.676+0000 7ff7e8a57740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e01ab0e0 con 0x55cc5acd94a0 2024-09-19T06:22:03.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.676+0000 7ff7e8a57740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e01aa340 con 0x55cc5acd9dc0 2024-09-19T06:22:03.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.676+0000 7ff7e8a57740 10 client.0 _ll_register_callbacks cb 0x7ff7d400fe00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:03.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.676+0000 7ff7dffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc5acd5a30 0x55cc5acebbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:03.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.676+0000 7ff7df7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cc5acd94a0 0x55cc5acec100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:03.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.676+0000 7ff7e4c1b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc5acd9dc0 0x55cc5ad60e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:03.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.676+0000 7ff7dffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc5acd5a30 0x55cc5acebbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45664/0 (socket says 172.21.15.2:45664) 2024-09-19T06:22:03.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.676+0000 7ff7dffff640 1 -- 172.21.15.2:0/1460316377 learned_addr learned my addr 172.21.15.2:0/1460316377 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:03.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.676+0000 7ff7df7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cc5acd94a0 0x55cc5acec100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:34986/0 (socket says 172.21.15.2:34986) 2024-09-19T06:22:03.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.676+0000 7ff7dffff640 1 -- 172.21.15.2:0/1460316377 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc5acd9dc0 msgr2=0x55cc5ad60e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:03.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.676+0000 7ff7dffff640 1 --2- 172.21.15.2:0/1460316377 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc5acd9dc0 0x55cc5ad60e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:03.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.676+0000 7ff7dffff640 1 -- 172.21.15.2:0/1460316377 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cc5acd94a0 msgr2=0x55cc5acec100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:03.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.676+0000 7ff7dffff640 1 --2- 172.21.15.2:0/1460316377 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cc5acd94a0 0x55cc5acec100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:03.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.676+0000 7ff7dffff640 1 -- 172.21.15.2:0/1460316377 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc5ad61340 con 0x55cc5acd5a30 2024-09-19T06:22:03.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.677+0000 7ff7dffff640 1 --2- 172.21.15.2:0/1460316377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc5acd5a30 0x55cc5acebbc0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0005940 tx=0x7ff7d000b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18a8950264fbb52b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:03.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.677+0000 7ff7bf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:22:03.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.677+0000 7ff7bf7fe640 1 -- 172.21.15.2:0/1460316377 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d00035f0 con 0x55cc5acd5a30 2024-09-19T06:22:03.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.677+0000 7ff7bf7fe640 1 -- 172.21.15.2:0/1460316377 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7ff7d0003bc0 con 0x55cc5acd5a30 2024-09-19T06:22:03.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.677+0000 7ff7e8a57740 1 -- 172.21.15.2:0/1460316377 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7d40a4cf0 con 0x55cc5acd5a30 2024-09-19T06:22:03.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.677+0000 7ff7bf7fe640 1 -- 172.21.15.2:0/1460316377 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff7d00040e0 con 0x55cc5acd5a30 2024-09-19T06:22:03.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.677+0000 7ff7e8a57740 10 client.17775 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:03.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.677+0000 7ff7e8a57740 1 -- 172.21.15.2:0/1460316377 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55cc5ad624f0 con 0x55cc5acd5a30 2024-09-19T06:22:03.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.677+0000 7ff7bf7fe640 1 -- 172.21.15.2:0/1460316377 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff7d40a4cf0 con 0x55cc5acd5a30 2024-09-19T06:22:03.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.677+0000 7ff7bf7fe640 1 -- 172.21.15.2:0/1460316377 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7ff7d0005460 con 0x55cc5acd5a30 2024-09-19T06:22:03.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.677+0000 7ff7e8a57740 10 client.17775 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:03.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.677+0000 7ff7e8a57740 10 client.17775 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:03.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.677+0000 7ff7e8a57740 20 client.17775 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:03.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.677+0000 7ff7e8a57740 1 --2- 172.21.15.2:0/1460316377 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55cc5ace4680 0x55cc5ad64bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:03.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.677+0000 7ff7e8a57740 4 client.17775 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:22:03.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.677+0000 7ff7e8a57740 1 -- 172.21.15.2:0/1460316377 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cc5ac46d60 con 0x55cc5ace4680 2024-09-19T06:22:03.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.678+0000 7ff7df7fe640 1 --2- 172.21.15.2:0/1460316377 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55cc5ace4680 0x55cc5ad64bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:03.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.678+0000 7ff7df7fe640 1 --2- 172.21.15.2:0/1460316377 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55cc5ace4680 0x55cc5ad64bf0 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39be3505861de29e server_cookie=aef1536b0f749e91 in_seq=0 out_seq=0 2024-09-19T06:22:03.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.678+0000 7ff7bf7fe640 10 client.17775 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:03.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.678+0000 7ff7bf7fe640 1 -- 172.21.15.2:0/1460316377 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55cc5ac46d60 con 0x55cc5ace4680 2024-09-19T06:22:03.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.678+0000 7ff7bf7fe640 10 client.17775 handle_command_reply: tid=0 2024-09-19T06:22:03.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.678+0000 7ff7e8a57740 1 client.17775 shutdown 2024-09-19T06:22:03.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.678+0000 7ff7e8a57740 1 -- 172.21.15.2:0/1460316377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc5acd5a30 msgr2=0x55cc5acebbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:03.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.678+0000 7ff7e8a57740 1 --2- 172.21.15.2:0/1460316377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc5acd5a30 0x55cc5acebbc0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0005940 tx=0x7ff7d000b8c0 comp rx=0 tx=0).stop 2024-09-19T06:22:03.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.678+0000 7ff7e8a57740 1 -- 172.21.15.2:0/1460316377 shutdown_connections 2024-09-19T06:22:03.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.678+0000 7ff7e8a57740 1 --2- 172.21.15.2:0/1460316377 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cc5acd9dc0 0x55cc5ad60e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:03.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.678+0000 7ff7e8a57740 1 --2- 172.21.15.2:0/1460316377 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55cc5ace4680 0x55cc5ad64bf0 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:03.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.678+0000 7ff7e8a57740 1 --2- 172.21.15.2:0/1460316377 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cc5acd94a0 0x55cc5acec100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:03.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.678+0000 7ff7e8a57740 1 --2- 172.21.15.2:0/1460316377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cc5acd5a30 0x55cc5acebbc0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:03.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.678+0000 7ff7bf7fe640 0 client.17775 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:03.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.678+0000 7ff7e8a57740 1 -- 172.21.15.2:0/1460316377 >> 172.21.15.2:0/1460316377 conn(0x55cc5ace1880 msgr2=0x55cc5acdc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:03.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.678+0000 7ff7e8a57740 1 -- 172.21.15.2:0/1460316377 shutdown_connections 2024-09-19T06:22:03.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.679+0000 7ff7e8a57740 1 -- 172.21.15.2:0/1460316377 wait complete. 2024-09-19T06:22:03.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.679+0000 7ff7e8a57740 20 client.17775 trim_cache size 0 max 16384 2024-09-19T06:22:03.693 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:22:03.693 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T06:22:03.693 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T06:22:03.693 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:22:03.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.679+0000 7ff7e667e640 1 -- 172.21.15.2:0/2860353490 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff7c80a33b0 msgr2=0x7ff7c80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:03.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.679+0000 7ff7e667e640 1 --2- 172.21.15.2:0/2860353490 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff7c80a33b0 0x7ff7c80a5870 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff7d8004af0 tx=0x7ff7d8009360 comp rx=0 tx=0).stop 2024-09-19T06:22:03.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.679+0000 7ff7e667e640 1 -- 172.21.15.2:0/2860353490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7e0101400 msgr2=0x7ff7e0198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:03.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.679+0000 7ff7e667e640 1 --2- 172.21.15.2:0/2860353490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7e0101400 0x7ff7e0198820 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7ff7d400c920 tx=0x7ff7d400cde0 comp rx=0 tx=0).stop 2024-09-19T06:22:03.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.679+0000 7ff7e667e640 1 -- 172.21.15.2:0/2860353490 shutdown_connections 2024-09-19T06:22:03.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.679+0000 7ff7e667e640 1 --2- 172.21.15.2:0/2860353490 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff7c80a33b0 0x7ff7c80a5870 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:03.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.679+0000 7ff7e667e640 1 --2- 172.21.15.2:0/2860353490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7e0106a60 0x7ff7e019cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:03.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.679+0000 7ff7e667e640 1 --2- 172.21.15.2:0/2860353490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7e0101400 0x7ff7e0198820 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:03.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.679+0000 7ff7e667e640 1 --2- 172.21.15.2:0/2860353490 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7e0100a60 0x7ff7e01982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:03.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.679+0000 7ff7e667e640 1 -- 172.21.15.2:0/2860353490 >> 172.21.15.2:0/2860353490 conn(0x7ff7e00fc780 msgr2=0x7ff7e006aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:03.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.679+0000 7ff7e667e640 1 -- 172.21.15.2:0/2860353490 shutdown_connections 2024-09-19T06:22:03.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:03.679+0000 7ff7e667e640 1 -- 172.21.15.2:0/2860353490 wait complete. 2024-09-19T06:22:03.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:03 smithi090 ceph-mon[34497]: pgmap v222: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:22:03.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:03 smithi090 ceph-mon[34497]: scrub queued for path: / 2024-09-19T06:22:03.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:03 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:22:03.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:03 smithi090 ceph-mon[34497]: scrub summary: active paths [/] 2024-09-19T06:22:03.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:03 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:22:03.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:03 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:22:03.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:03 smithi090 ceph-mon[34497]: scrub summary: idle 2024-09-19T06:22:03.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:03 smithi089 ceph-mon[34160]: pgmap v222: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:22:03.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:03 smithi089 ceph-mon[34160]: scrub queued for path: / 2024-09-19T06:22:03.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:03 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:22:03.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:03 smithi089 ceph-mon[34160]: scrub summary: active paths [/] 2024-09-19T06:22:03.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:03 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:22:03.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:03 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:22:03.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:03 smithi089 ceph-mon[34160]: scrub summary: idle 2024-09-19T06:22:04.308 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:22:04.308 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:22:04.562 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:22:04.684 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:04 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:22:04.684 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:04 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:22:04.684 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:04 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:22:04.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:04 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:22:04.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:04 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:22:04.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:04 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:22:04.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:04 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:22:04.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:04 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:22:04.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:04 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:22:05.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.032+0000 7f9176190640 1 -- 172.21.15.2:0/571978632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9170074510 msgr2=0x7f91700748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:05.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.032+0000 7f9176190640 1 --2- 172.21.15.2:0/571978632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9170074510 0x7f91700748f0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f9160009900 tx=0x7f916002a480 comp rx=0 tx=0).stop 2024-09-19T06:22:05.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.032+0000 7f9176190640 1 -- 172.21.15.2:0/571978632 shutdown_connections 2024-09-19T06:22:05.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.032+0000 7f9176190640 1 --2- 172.21.15.2:0/571978632 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f917010e440 0x7f9170110830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.032+0000 7f9176190640 1 --2- 172.21.15.2:0/571978632 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9170074e30 0x7f917010df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.032+0000 7f9176190640 1 --2- 172.21.15.2:0/571978632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9170074510 0x7f91700748f0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.032+0000 7f9176190640 1 -- 172.21.15.2:0/571978632 >> 172.21.15.2:0/571978632 conn(0x7f91700fd8c0 msgr2=0x7f91700ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:05.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.032+0000 7f9176190640 1 -- 172.21.15.2:0/571978632 shutdown_connections 2024-09-19T06:22:05.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.032+0000 7f9176190640 1 -- 172.21.15.2:0/571978632 wait complete. 2024-09-19T06:22:05.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.033+0000 7f9176190640 1 Processor -- start 2024-09-19T06:22:05.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.033+0000 7f9176190640 1 -- start start 2024-09-19T06:22:05.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.033+0000 7f9176190640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9170074510 0x7f917019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:05.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.033+0000 7f9176190640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9170074e30 0x7f917019a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:05.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.033+0000 7f9176190640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f917010e440 0x7f917019ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:05.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.033+0000 7f9176190640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9170114000 con 0x7f9170074e30 2024-09-19T06:22:05.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.033+0000 7f9176190640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9170113e80 con 0x7f9170074510 2024-09-19T06:22:05.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.034+0000 7f9176190640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9170114180 con 0x7f917010e440 2024-09-19T06:22:05.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.034+0000 7f916effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9170074e30 0x7f917019a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:05.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.034+0000 7f916effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9170074e30 0x7f917019a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45688/0 (socket says 172.21.15.2:45688) 2024-09-19T06:22:05.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.034+0000 7f916effd640 1 -- 172.21.15.2:0/1499298261 learned_addr learned my addr 172.21.15.2:0/1499298261 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:05.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.034+0000 7f916f7fe640 1 --2- 172.21.15.2:0/1499298261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9170074510 0x7f917019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:05.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.034+0000 7f916ffff640 1 --2- 172.21.15.2:0/1499298261 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f917010e440 0x7f917019ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:05.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.034+0000 7f916effd640 1 -- 172.21.15.2:0/1499298261 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f917010e440 msgr2=0x7f917019ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:05.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.034+0000 7f916effd640 1 --2- 172.21.15.2:0/1499298261 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f917010e440 0x7f917019ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.034+0000 7f916effd640 1 -- 172.21.15.2:0/1499298261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9170074510 msgr2=0x7f917019a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:05.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.034+0000 7f916effd640 1 --2- 172.21.15.2:0/1499298261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9170074510 0x7f917019a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.034+0000 7f916effd640 1 -- 172.21.15.2:0/1499298261 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f917019f450 con 0x7f9170074e30 2024-09-19T06:22:05.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.034+0000 7f916effd640 1 --2- 172.21.15.2:0/1499298261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9170074e30 0x7f917019a9e0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f916400c920 tx=0x7f916400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:05.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.034+0000 7f916cff9640 1 -- 172.21.15.2:0/1499298261 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9164007c70 con 0x7f9170074e30 2024-09-19T06:22:05.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.034+0000 7f916cff9640 1 -- 172.21.15.2:0/1499298261 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9164007e10 con 0x7f9170074e30 2024-09-19T06:22:05.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.034+0000 7f9176190640 1 -- 172.21.15.2:0/1499298261 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f917019f740 con 0x7f9170074e30 2024-09-19T06:22:05.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.035+0000 7f916cff9640 1 -- 172.21.15.2:0/1499298261 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9164018820 con 0x7f9170074e30 2024-09-19T06:22:05.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.035+0000 7f9176190640 1 -- 172.21.15.2:0/1499298261 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91701a7020 con 0x7f9170074e30 2024-09-19T06:22:05.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.035+0000 7f9176190640 1 -- 172.21.15.2:0/1499298261 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91700748f0 con 0x7f9170074e30 2024-09-19T06:22:05.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.037+0000 7f916cff9640 1 -- 172.21.15.2:0/1499298261 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f91640189c0 con 0x7f9170074e30 2024-09-19T06:22:05.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.037+0000 7f916cff9640 1 --2- 172.21.15.2:0/1499298261 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f91580a33b0 0x7f91580a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:05.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.038+0000 7f916f7fe640 1 --2- 172.21.15.2:0/1499298261 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f91580a33b0 0x7f91580a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:05.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.038+0000 7f916cff9640 1 -- 172.21.15.2:0/1499298261 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f91640d00a0 con 0x7f9170074e30 2024-09-19T06:22:05.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.038+0000 7f916f7fe640 1 --2- 172.21.15.2:0/1499298261 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f91580a33b0 0x7f91580a5870 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9160031440 tx=0x7f9160005e80 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:05.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.041+0000 7f916cff9640 1 -- 172.21.15.2:0/1499298261 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9164014030 con 0x7f9170074e30 2024-09-19T06:22:05.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.254+0000 7f9176190640 1 -- 172.21.15.2:0/1499298261 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f917019b800 con 0x7f9170074e30 2024-09-19T06:22:05.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.255+0000 7f916cff9640 1 -- 172.21.15.2:0/1499298261 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11882 (secure 0 0 0) 0x7f917019b800 con 0x7f9170074e30 2024-09-19T06:22:05.256 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:22:05.257 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-09-19T06:14:49:104280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:14:48.191083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24470,24472,24497]},"id":1}]} 2024-09-19T06:22:05.257 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-09-19T06:22:05.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.257+0000 7f9176190640 1 -- 172.21.15.2:0/1499298261 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f91580a33b0 msgr2=0x7f91580a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:05.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.257+0000 7f9176190640 1 --2- 172.21.15.2:0/1499298261 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f91580a33b0 0x7f91580a5870 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9160031440 tx=0x7f9160005e80 comp rx=0 tx=0).stop 2024-09-19T06:22:05.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.257+0000 7f9176190640 1 -- 172.21.15.2:0/1499298261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9170074e30 msgr2=0x7f917019a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:05.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.257+0000 7f9176190640 1 --2- 172.21.15.2:0/1499298261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9170074e30 0x7f917019a9e0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f916400c920 tx=0x7f916400cde0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.257+0000 7f9176190640 1 -- 172.21.15.2:0/1499298261 shutdown_connections 2024-09-19T06:22:05.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.257+0000 7f9176190640 1 --2- 172.21.15.2:0/1499298261 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f91580a33b0 0x7f91580a5870 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.257+0000 7f9176190640 1 --2- 172.21.15.2:0/1499298261 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f917010e440 0x7f917019ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.257+0000 7f9176190640 1 --2- 172.21.15.2:0/1499298261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9170074e30 0x7f917019a9e0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.257+0000 7f9176190640 1 --2- 172.21.15.2:0/1499298261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9170074510 0x7f917019a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.257+0000 7f9176190640 1 -- 172.21.15.2:0/1499298261 >> 172.21.15.2:0/1499298261 conn(0x7f91700fd8c0 msgr2=0x7f91700fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:05.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.257+0000 7f9176190640 1 -- 172.21.15.2:0/1499298261 shutdown_connections 2024-09-19T06:22:05.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:05.257+0000 7f9176190640 1 -- 172.21.15.2:0/1499298261 wait complete. 2024-09-19T06:22:05.554 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:05 smithi002 ceph-mon[30982]: pgmap v223: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-09-19T06:22:05.554 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:05 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1499298261' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:22:05.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:05 smithi090 ceph-mon[34497]: pgmap v223: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-09-19T06:22:05.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:05 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1499298261' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:22:05.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:05 smithi089 ceph-mon[34160]: pgmap v223: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-09-19T06:22:05.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:05 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1499298261' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:22:05.867 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:22:06.123 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:22:06.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.549+0000 7f2dca3d7640 1 -- 172.21.15.2:0/2010900542 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2dc4100a80 msgr2=0x7f2dc4100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:06.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.549+0000 7f2dca3d7640 1 --2- 172.21.15.2:0/2010900542 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2dc4100a80 0x7f2dc4100ee0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f2db8009930 tx=0x7f2db802a420 comp rx=0 tx=0).stop 2024-09-19T06:22:06.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.549+0000 7f2dca3d7640 1 -- 172.21.15.2:0/2010900542 shutdown_connections 2024-09-19T06:22:06.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.549+0000 7f2dca3d7640 1 --2- 172.21.15.2:0/2010900542 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dc4101420 0x7f2dc410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:06.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.549+0000 7f2dca3d7640 1 --2- 172.21.15.2:0/2010900542 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2dc4100a80 0x7f2dc4100ee0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:06.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.549+0000 7f2dca3d7640 1 --2- 172.21.15.2:0/2010900542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dc4106a80 0x7f2dc4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:06.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.549+0000 7f2dca3d7640 1 -- 172.21.15.2:0/2010900542 >> 172.21.15.2:0/2010900542 conn(0x7f2dc40fc7a0 msgr2=0x7f2dc40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:06.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.550+0000 7f2dca3d7640 1 -- 172.21.15.2:0/2010900542 shutdown_connections 2024-09-19T06:22:06.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.550+0000 7f2dca3d7640 1 -- 172.21.15.2:0/2010900542 wait complete. 2024-09-19T06:22:06.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.550+0000 7f2dca3d7640 1 Processor -- start 2024-09-19T06:22:06.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.550+0000 7f2dca3d7640 1 -- start start 2024-09-19T06:22:06.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.551+0000 7f2dca3d7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dc4100a80 0x7f2dc4198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:06.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.551+0000 7f2dca3d7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2dc4101420 0x7f2dc4198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:06.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.551+0000 7f2dca3d7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dc4106a80 0x7f2dc419cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:06.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.551+0000 7f2dca3d7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc4110d30 con 0x7f2dc4101420 2024-09-19T06:22:06.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.551+0000 7f2dca3d7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc4110bb0 con 0x7f2dc4100a80 2024-09-19T06:22:06.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.551+0000 7f2dca3d7640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc4110eb0 con 0x7f2dc4106a80 2024-09-19T06:22:06.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.551+0000 7f2dc37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2dc4101420 0x7f2dc4198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:06.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.551+0000 7f2dc37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2dc4101420 0x7f2dc4198850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54734/0 (socket says 172.21.15.2:54734) 2024-09-19T06:22:06.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.551+0000 7f2dc37fe640 1 -- 172.21.15.2:0/1445816946 learned_addr learned my addr 172.21.15.2:0/1445816946 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:06.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.551+0000 7f2dc3fff640 1 --2- 172.21.15.2:0/1445816946 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dc4100a80 0x7f2dc4198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:06.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.551+0000 7f2dc8974640 1 --2- 172.21.15.2:0/1445816946 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dc4106a80 0x7f2dc419cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:06.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.551+0000 7f2dc37fe640 1 -- 172.21.15.2:0/1445816946 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dc4106a80 msgr2=0x7f2dc419cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:06.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.551+0000 7f2dc37fe640 1 --2- 172.21.15.2:0/1445816946 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dc4106a80 0x7f2dc419cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:06.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.551+0000 7f2dc37fe640 1 -- 172.21.15.2:0/1445816946 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dc4100a80 msgr2=0x7f2dc4198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:06.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.551+0000 7f2dc37fe640 1 --2- 172.21.15.2:0/1445816946 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dc4100a80 0x7f2dc4198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:06.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.551+0000 7f2dc37fe640 1 -- 172.21.15.2:0/1445816946 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dc419d2c0 con 0x7f2dc4101420 2024-09-19T06:22:06.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.551+0000 7f2dc37fe640 1 --2- 172.21.15.2:0/1445816946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2dc4101420 0x7f2dc4198850 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f2db8005940 tx=0x7f2db80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:06.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.551+0000 7f2dc17fa640 1 -- 172.21.15.2:0/1445816946 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db803f030 con 0x7f2dc4101420 2024-09-19T06:22:06.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.552+0000 7f2dca3d7640 1 -- 172.21.15.2:0/1445816946 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dc419d550 con 0x7f2dc4101420 2024-09-19T06:22:06.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.552+0000 7f2dc17fa640 1 -- 172.21.15.2:0/1445816946 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2db8003cb0 con 0x7f2dc4101420 2024-09-19T06:22:06.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.552+0000 7f2dc17fa640 1 -- 172.21.15.2:0/1445816946 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db8035070 con 0x7f2dc4101420 2024-09-19T06:22:06.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.552+0000 7f2dca3d7640 1 -- 172.21.15.2:0/1445816946 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dc41a4e90 con 0x7f2dc4101420 2024-09-19T06:22:06.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.554+0000 7f2dc17fa640 1 -- 172.21.15.2:0/1445816946 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f2db8042030 con 0x7f2dc4101420 2024-09-19T06:22:06.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.554+0000 7f2dcc7b0740 1 Processor -- start 2024-09-19T06:22:06.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.554+0000 7f2dcc7b0740 1 -- start start 2024-09-19T06:22:06.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.554+0000 7f2dc17fa640 1 --2- 172.21.15.2:0/1445816946 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f2dac0a33b0 0x7f2dac0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:06.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.554+0000 7f2dcc7b0740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6d9768b40 0x55c6d9767090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:06.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.554+0000 7f2dcc7b0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6d97675d0 0x55c6d9767a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:06.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.555+0000 7f2dcc7b0740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c6d9772370 0x55c6d9774760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:06.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.555+0000 7f2dcc7b0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c6d96cd2f0 con 0x55c6d97675d0 2024-09-19T06:22:06.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.555+0000 7f2dcc7b0740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55c6d9674cf0 con 0x55c6d9768b40 2024-09-19T06:22:06.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.555+0000 7f2dcc7b0740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55c6d96c92b0 con 0x55c6d9772370 2024-09-19T06:22:06.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.555+0000 7f2dc8974640 1 --2- 172.21.15.2:0/1445816946 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f2dac0a33b0 0x7f2dac0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:06.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.555+0000 7f2dc37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6d97675d0 0x55c6d9767a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:06.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.555+0000 7f2dc37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6d97675d0 0x55c6d9767a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54746/0 (socket says 172.21.15.2:54746) 2024-09-19T06:22:06.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.555+0000 7f2dc37fe640 1 -- 172.21.15.2:0/2496678312 learned_addr learned my addr 172.21.15.2:0/2496678312 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:06.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.555+0000 7f2dc3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6d9768b40 0x55c6d9767090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:06.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.555+0000 7f2dc17fa640 1 -- 172.21.15.2:0/1445816946 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f2db80f0230 con 0x7f2dc4101420 2024-09-19T06:22:06.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.555+0000 7f2dc8974640 1 --2- 172.21.15.2:0/2496678312 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c6d9772370 0x55c6d9774760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:06.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.555+0000 7f2dc3fff640 1 -- 172.21.15.2:0/2496678312 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c6d9772370 msgr2=0x55c6d9774760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:06.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.555+0000 7f2dc3fff640 1 --2- 172.21.15.2:0/2496678312 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c6d9772370 0x55c6d9774760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:06.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.555+0000 7f2dc3fff640 1 -- 172.21.15.2:0/2496678312 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6d97675d0 msgr2=0x55c6d9767a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:06.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.555+0000 7f2dc3fff640 1 --2- 172.21.15.2:0/2496678312 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6d97675d0 0x55c6d9767a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:06.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.555+0000 7f2dc3fff640 1 -- 172.21.15.2:0/2496678312 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6d96593a0 con 0x55c6d9768b40 2024-09-19T06:22:06.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.555+0000 7f2dc8974640 1 --2- 172.21.15.2:0/1445816946 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f2dac0a33b0 0x7f2dac0a5870 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc00a780 tx=0x7f2dbc013ae0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:06.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.555+0000 7f2dc3fff640 1 --2- 172.21.15.2:0/2496678312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6d9768b40 0x55c6d9767090 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2db400ab70 tx=0x7f2db400f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ddef747bafeb9b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:06.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.556+0000 7f2daa7fc640 1 -- 172.21.15.2:0/2496678312 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db4005220 con 0x55c6d9768b40 2024-09-19T06:22:06.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.556+0000 7f2daa7fc640 1 -- 172.21.15.2:0/2496678312 <== mon.2 v2:172.21.15.89:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2db4004c50 con 0x55c6d9768b40 2024-09-19T06:22:06.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.556+0000 7f2daa7fc640 1 -- 172.21.15.2:0/2496678312 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db4018680 con 0x55c6d9768b40 2024-09-19T06:22:06.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.556+0000 7f2dcc7b0740 1 -- 172.21.15.2:0/2496678312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6d9768b40 msgr2=0x55c6d9767090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:06.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.556+0000 7f2dcc7b0740 1 --2- 172.21.15.2:0/2496678312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6d9768b40 0x55c6d9767090 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2db400ab70 tx=0x7f2db400f790 comp rx=0 tx=0).stop 2024-09-19T06:22:06.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.556+0000 7f2dcc7b0740 1 -- 172.21.15.2:0/2496678312 shutdown_connections 2024-09-19T06:22:06.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.556+0000 7f2dcc7b0740 1 --2- 172.21.15.2:0/2496678312 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c6d9772370 0x55c6d9774760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:06.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.556+0000 7f2dcc7b0740 1 --2- 172.21.15.2:0/2496678312 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6d97675d0 0x55c6d9767a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:06.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.556+0000 7f2dcc7b0740 1 --2- 172.21.15.2:0/2496678312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6d9768b40 0x55c6d9767090 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:06.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.556+0000 7f2dcc7b0740 1 -- 172.21.15.2:0/2496678312 >> 172.21.15.2:0/2496678312 conn(0x55c6d9730310 msgr2=0x55c6d9763c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:06.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.556+0000 7f2dcc7b0740 1 -- 172.21.15.2:0/2496678312 shutdown_connections 2024-09-19T06:22:06.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.556+0000 7f2dcc7b0740 1 -- 172.21.15.2:0/2496678312 wait complete. 2024-09-19T06:22:06.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.557+0000 7f2dcc7b0740 1 -- start start 2024-09-19T06:22:06.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.557+0000 7f2dcc7b0740 1 Processor -- start 2024-09-19T06:22:06.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.557+0000 7f2dcc7b0740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c6d97675d0 0x55c6d9771cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:06.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.557+0000 7f2dcc7b0740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6d9768b40 0x55c6d976efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:06.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.557+0000 7f2dcc7b0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6d9772370 0x55c6d976f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:06.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.557+0000 7f2dcc7b0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c6d9775070 con 0x55c6d9772370 2024-09-19T06:22:06.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.557+0000 7f2dcc7b0740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55c6d9688060 con 0x55c6d9768b40 2024-09-19T06:22:06.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.557+0000 7f2dcc7b0740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55c6d97751f0 con 0x55c6d97675d0 2024-09-19T06:22:06.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.557+0000 7f2dcc7b0740 10 client.0 _ll_register_callbacks cb 0x55c6d93db8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:06.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.557+0000 7f2dc8974640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6d9772370 0x55c6d976f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:06.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.557+0000 7f2dc37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6d9768b40 0x55c6d976efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:06.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.557+0000 7f2dc8974640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6d9772370 0x55c6d976f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54762/0 (socket says 172.21.15.2:54762) 2024-09-19T06:22:06.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.557+0000 7f2dc37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6d9768b40 0x55c6d976efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:36762/0 (socket says 172.21.15.2:36762) 2024-09-19T06:22:06.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.557+0000 7f2dc8974640 1 -- 172.21.15.2:0/143611761 learned_addr learned my addr 172.21.15.2:0/143611761 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:06.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.558+0000 7f2dc3fff640 1 --2- 172.21.15.2:0/143611761 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c6d97675d0 0x55c6d9771cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:06.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.558+0000 7f2dc8974640 1 -- 172.21.15.2:0/143611761 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c6d97675d0 msgr2=0x55c6d9771cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:06.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.558+0000 7f2dc8974640 1 --2- 172.21.15.2:0/143611761 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c6d97675d0 0x55c6d9771cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:06.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.558+0000 7f2dc8974640 1 -- 172.21.15.2:0/143611761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6d9768b40 msgr2=0x55c6d976efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:06.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.558+0000 7f2dc8974640 1 --2- 172.21.15.2:0/143611761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6d9768b40 0x55c6d976efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:06.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.558+0000 7f2dc8974640 1 -- 172.21.15.2:0/143611761 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6d943e3c0 con 0x55c6d9772370 2024-09-19T06:22:06.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.558+0000 7f2dc3fff640 1 --2- 172.21.15.2:0/143611761 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c6d97675d0 0x55c6d9771cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:06.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.558+0000 7f2dc37fe640 1 --2- 172.21.15.2:0/143611761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6d9768b40 0x55c6d976efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:06.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.558+0000 7f2dc8974640 1 --2- 172.21.15.2:0/143611761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6d9772370 0x55c6d976f530 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc011f60 tx=0x7f2dbc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=417628cc630978b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:06.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.558+0000 7f2da37fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:22:06.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.558+0000 7f2da37fe640 1 -- 172.21.15.2:0/143611761 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc013220 con 0x55c6d9772370 2024-09-19T06:22:06.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.558+0000 7f2da37fe640 1 -- 172.21.15.2:0/143611761 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f2dbc003970 con 0x55c6d9772370 2024-09-19T06:22:06.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.558+0000 7f2dcc7b0740 1 -- 172.21.15.2:0/143611761 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2db4004c50 con 0x55c6d9772370 2024-09-19T06:22:06.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.558+0000 7f2da37fe640 1 -- 172.21.15.2:0/143611761 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2dbc003bb0 con 0x55c6d9772370 2024-09-19T06:22:06.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.558+0000 7f2dcc7b0740 10 client.17793 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:06.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.558+0000 7f2dcc7b0740 1 -- 172.21.15.2:0/143611761 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c6d9780af0 con 0x55c6d9772370 2024-09-19T06:22:06.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.559+0000 7f2da37fe640 1 -- 172.21.15.2:0/143611761 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2db4004c50 con 0x55c6d9772370 2024-09-19T06:22:06.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.559+0000 7f2da37fe640 1 -- 172.21.15.2:0/143611761 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f2dbc01f600 con 0x55c6d9772370 2024-09-19T06:22:06.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.559+0000 7f2dcc7b0740 10 client.17793 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:06.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.559+0000 7f2dcc7b0740 10 client.17793 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:22:06.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.559+0000 7f2dcc7b0740 20 client.17793 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:06.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.559+0000 7f2dcc7b0740 1 --2- 172.21.15.2:0/143611761 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55c6d9781f50 0x55c6d97843a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:06.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.559+0000 7f2dcc7b0740 4 client.17793 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:22:06.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.559+0000 7f2dcc7b0740 1 -- 172.21.15.2:0/143611761 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c6d96da860 con 0x55c6d9781f50 2024-09-19T06:22:06.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.559+0000 7f2dc3fff640 1 --2- 172.21.15.2:0/143611761 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55c6d9781f50 0x55c6d97843a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:06.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.560+0000 7f2dc3fff640 1 --2- 172.21.15.2:0/143611761 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55c6d9781f50 0x55c6d97843a0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2cf942b90d32a5e8 server_cookie=a38c497b1029e381 in_seq=0 out_seq=0 2024-09-19T06:22:06.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.560+0000 7f2da37fe640 10 client.17793 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:22:06.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.560+0000 7f2da37fe640 1 -- 172.21.15.2:0/143611761 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c6d96da860 con 0x55c6d9781f50 2024-09-19T06:22:06.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.560+0000 7f2da37fe640 10 client.17793 handle_command_reply: tid=0 2024-09-19T06:22:06.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.560+0000 7f2dcc7b0740 1 client.17793 shutdown 2024-09-19T06:22:06.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.561+0000 7f2dcc7b0740 1 -- 172.21.15.2:0/143611761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6d9772370 msgr2=0x55c6d976f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:06.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.561+0000 7f2dcc7b0740 1 --2- 172.21.15.2:0/143611761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6d9772370 0x55c6d976f530 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc011f60 tx=0x7f2dbc004ab0 comp rx=0 tx=0).stop 2024-09-19T06:22:06.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.561+0000 7f2dcc7b0740 1 -- 172.21.15.2:0/143611761 shutdown_connections 2024-09-19T06:22:06.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.561+0000 7f2dcc7b0740 1 --2- 172.21.15.2:0/143611761 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55c6d9781f50 0x55c6d97843a0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:06.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.561+0000 7f2dcc7b0740 1 --2- 172.21.15.2:0/143611761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6d9772370 0x55c6d976f530 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:06.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.561+0000 7f2dcc7b0740 1 --2- 172.21.15.2:0/143611761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6d9768b40 0x55c6d976efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:06.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.561+0000 7f2dcc7b0740 1 --2- 172.21.15.2:0/143611761 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c6d97675d0 0x55c6d9771cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:06.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.561+0000 7f2da37fe640 0 client.17793 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:22:06.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.561+0000 7f2dcc7b0740 1 -- 172.21.15.2:0/143611761 >> 172.21.15.2:0/143611761 conn(0x55c6d9730310 msgr2=0x55c6d97699c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:06.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.561+0000 7f2dcc7b0740 1 -- 172.21.15.2:0/143611761 shutdown_connections 2024-09-19T06:22:06.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.561+0000 7f2dcc7b0740 1 -- 172.21.15.2:0/143611761 wait complete. 2024-09-19T06:22:06.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.561+0000 7f2dcc7b0740 20 client.17793 trim_cache size 0 max 16384 2024-09-19T06:22:06.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.574+0000 7f2dcc7b0740 1 Processor -- start 2024-09-19T06:22:06.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.574+0000 7f2dcc7b0740 1 -- start start 2024-09-19T06:22:06.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.574+0000 7f2dcc7b0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6d9730310 0x55c6d977e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:06.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.574+0000 7f2dcc7b0740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6d97675d0 0x55c6d9763700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:06.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.574+0000 7f2dcc7b0740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c6d9768b40 0x55c6d9789c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:06.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.574+0000 7f2dcc7b0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc41b0040 con 0x55c6d9730310 2024-09-19T06:22:06.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.574+0000 7f2dcc7b0740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc41ad910 con 0x55c6d97675d0 2024-09-19T06:22:06.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.574+0000 7f2dcc7b0740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc41ab780 con 0x55c6d9768b40 2024-09-19T06:22:06.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.574+0000 7f2dc3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6d9730310 0x55c6d977e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:06.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.574+0000 7f2dc3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6d9730310 0x55c6d977e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54770/0 (socket says 172.21.15.2:54770) 2024-09-19T06:22:06.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.574+0000 7f2dc3fff640 1 -- 172.21.15.2:0/398993424 learned_addr learned my addr 172.21.15.2:0/398993424 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:06.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.574+0000 7f2dc37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6d97675d0 0x55c6d9763700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:06.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.575+0000 7f2dc8974640 1 --2- 172.21.15.2:0/398993424 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c6d9768b40 0x55c6d9789c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:06.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.575+0000 7f2dc3fff640 1 -- 172.21.15.2:0/398993424 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c6d9768b40 msgr2=0x55c6d9789c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:06.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.575+0000 7f2dc3fff640 1 --2- 172.21.15.2:0/398993424 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c6d9768b40 0x55c6d9789c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:06.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.575+0000 7f2dc3fff640 1 -- 172.21.15.2:0/398993424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6d97675d0 msgr2=0x55c6d9763700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:06.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.575+0000 7f2dc3fff640 1 --2- 172.21.15.2:0/398993424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6d97675d0 0x55c6d9763700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:06.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.575+0000 7f2dc3fff640 1 -- 172.21.15.2:0/398993424 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6d9784a20 con 0x55c6d9730310 2024-09-19T06:22:06.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.575+0000 7f2dc37fe640 1 --2- 172.21.15.2:0/398993424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6d97675d0 0x55c6d9763700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:06.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.575+0000 7f2dc3fff640 1 --2- 172.21.15.2:0/398993424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6d9730310 0x55c6d977e310 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f2db4004ec0 tx=0x7f2db400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7daeccfac79ade8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:06.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.575+0000 7f2da9ffb640 1 -- 172.21.15.2:0/398993424 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db40056c0 con 0x55c6d9730310 2024-09-19T06:22:06.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.575+0000 7f2da9ffb640 1 -- 172.21.15.2:0/398993424 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2db402e030 con 0x55c6d9730310 2024-09-19T06:22:06.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.575+0000 7f2da9ffb640 1 -- 172.21.15.2:0/398993424 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db4004a90 con 0x55c6d9730310 2024-09-19T06:22:06.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.576+0000 7f2dcc7b0740 1 -- 172.21.15.2:0/398993424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6d9730310 msgr2=0x55c6d977e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:06.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.576+0000 7f2dcc7b0740 1 --2- 172.21.15.2:0/398993424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6d9730310 0x55c6d977e310 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f2db4004ec0 tx=0x7f2db400a650 comp rx=0 tx=0).stop 2024-09-19T06:22:06.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.576+0000 7f2dcc7b0740 1 -- 172.21.15.2:0/398993424 shutdown_connections 2024-09-19T06:22:06.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.576+0000 7f2dcc7b0740 1 --2- 172.21.15.2:0/398993424 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c6d9768b40 0x55c6d9789c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:06.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.576+0000 7f2dcc7b0740 1 --2- 172.21.15.2:0/398993424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6d97675d0 0x55c6d9763700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:06.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.576+0000 7f2dcc7b0740 1 --2- 172.21.15.2:0/398993424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6d9730310 0x55c6d977e310 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:06.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.576+0000 7f2dcc7b0740 1 -- 172.21.15.2:0/398993424 >> 172.21.15.2:0/398993424 conn(0x55c6d976a9a0 msgr2=0x55c6d976d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:06.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.576+0000 7f2dcc7b0740 1 -- 172.21.15.2:0/398993424 shutdown_connections 2024-09-19T06:22:06.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.576+0000 7f2dcc7b0740 1 -- 172.21.15.2:0/398993424 wait complete. 2024-09-19T06:22:06.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.576+0000 7f2dcc7b0740 1 -- start start 2024-09-19T06:22:06.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.577+0000 7f2dcc7b0740 1 Processor -- start 2024-09-19T06:22:06.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.577+0000 7f2dcc7b0740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c6d9730310 0x55c6d977acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:06.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.577+0000 7f2dcc7b0740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6d97675d0 0x55c6d9775fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:06.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.577+0000 7f2dcc7b0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6d9768b40 0x55c6d97765d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:06.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.577+0000 7f2dcc7b0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc41abdd0 con 0x55c6d9768b40 2024-09-19T06:22:06.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.577+0000 7f2dcc7b0740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc41ad240 con 0x55c6d97675d0 2024-09-19T06:22:06.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.577+0000 7f2dcc7b0740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc41ac4a0 con 0x55c6d9730310 2024-09-19T06:22:06.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.577+0000 7f2dcc7b0740 10 client.0 _ll_register_callbacks cb 0x7f2dbc0117b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:06.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.577+0000 7f2dc8974640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6d9768b40 0x55c6d97765d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:06.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.577+0000 7f2dc8974640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6d9768b40 0x55c6d97765d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54776/0 (socket says 172.21.15.2:54776) 2024-09-19T06:22:06.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.577+0000 7f2dc8974640 1 -- 172.21.15.2:0/250707964 learned_addr learned my addr 172.21.15.2:0/250707964 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:06.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.577+0000 7f2dc3fff640 1 --2- 172.21.15.2:0/250707964 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c6d9730310 0x55c6d977acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:06.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.577+0000 7f2dc37fe640 1 --2- 172.21.15.2:0/250707964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6d97675d0 0x55c6d9775fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:06.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.577+0000 7f2dc8974640 1 -- 172.21.15.2:0/250707964 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c6d9730310 msgr2=0x55c6d977acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:06.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.577+0000 7f2dc8974640 1 --2- 172.21.15.2:0/250707964 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c6d9730310 0x55c6d977acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:06.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.577+0000 7f2dc8974640 1 -- 172.21.15.2:0/250707964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6d97675d0 msgr2=0x55c6d9775fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:06.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.577+0000 7f2dc8974640 1 --2- 172.21.15.2:0/250707964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6d97675d0 0x55c6d9775fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:06.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.577+0000 7f2dc8974640 1 -- 172.21.15.2:0/250707964 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6d9776e00 con 0x55c6d9768b40 2024-09-19T06:22:06.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.578+0000 7f2dc8974640 1 --2- 172.21.15.2:0/250707964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6d9768b40 0x55c6d97765d0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc01f9a0 tx=0x7f2dbc00ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf315441a2634473 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:06.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.578+0000 7f2da37fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:22:06.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.578+0000 7f2da37fe640 1 -- 172.21.15.2:0/250707964 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc00aae0 con 0x55c6d9768b40 2024-09-19T06:22:06.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.578+0000 7f2da37fe640 1 -- 172.21.15.2:0/250707964 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f2dbc004b20 con 0x55c6d9768b40 2024-09-19T06:22:06.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.578+0000 7f2dcc7b0740 1 -- 172.21.15.2:0/250707964 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2db402e030 con 0x55c6d9768b40 2024-09-19T06:22:06.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.578+0000 7f2da37fe640 1 -- 172.21.15.2:0/250707964 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2dbc004d20 con 0x55c6d9768b40 2024-09-19T06:22:06.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.578+0000 7f2dcc7b0740 10 client.17799 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:06.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.578+0000 7f2dcc7b0740 1 -- 172.21.15.2:0/250707964 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c6d97f5530 con 0x55c6d9768b40 2024-09-19T06:22:06.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.578+0000 7f2da37fe640 1 -- 172.21.15.2:0/250707964 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2db402e030 con 0x55c6d9768b40 2024-09-19T06:22:06.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.578+0000 7f2da37fe640 1 -- 172.21.15.2:0/250707964 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f2dbc02f430 con 0x55c6d9768b40 2024-09-19T06:22:06.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.578+0000 7f2dcc7b0740 10 client.17799 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:06.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.578+0000 7f2dcc7b0740 10 client.17799 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:22:06.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.578+0000 7f2dcc7b0740 20 client.17799 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:06.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.578+0000 7f2dcc7b0740 1 --2- 172.21.15.2:0/250707964 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55c6d9772370 0x55c6d97f7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:06.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.578+0000 7f2dcc7b0740 4 client.17799 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:22:06.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.578+0000 7f2dcc7b0740 1 -- 172.21.15.2:0/250707964 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c6d96d4d70 con 0x55c6d9772370 2024-09-19T06:22:06.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.579+0000 7f2dc3fff640 1 --2- 172.21.15.2:0/250707964 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55c6d9772370 0x55c6d97f7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:06.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.579+0000 7f2dc3fff640 1 --2- 172.21.15.2:0/250707964 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55c6d9772370 0x55c6d97f7b90 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b5ef49ec8a022bac server_cookie=fa3828af91116407 in_seq=0 out_seq=0 2024-09-19T06:22:06.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.579+0000 7f2da37fe640 10 client.17799 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:22:06.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.579+0000 7f2da37fe640 1 -- 172.21.15.2:0/250707964 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c6d96d4d70 con 0x55c6d9772370 2024-09-19T06:22:06.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.579+0000 7f2da37fe640 10 client.17799 handle_command_reply: tid=0 2024-09-19T06:22:06.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.579+0000 7f2dcc7b0740 1 client.17799 shutdown 2024-09-19T06:22:06.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.579+0000 7f2dcc7b0740 1 -- 172.21.15.2:0/250707964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6d9768b40 msgr2=0x55c6d97765d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:06.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.579+0000 7f2dcc7b0740 1 --2- 172.21.15.2:0/250707964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6d9768b40 0x55c6d97765d0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc01f9a0 tx=0x7f2dbc00ec90 comp rx=0 tx=0).stop 2024-09-19T06:22:06.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.579+0000 7f2dcc7b0740 1 -- 172.21.15.2:0/250707964 shutdown_connections 2024-09-19T06:22:06.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.579+0000 7f2dcc7b0740 1 --2- 172.21.15.2:0/250707964 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55c6d9772370 0x55c6d97f7b90 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:06.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.579+0000 7f2da37fe640 0 client.17799 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:22:06.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.579+0000 7f2dcc7b0740 1 --2- 172.21.15.2:0/250707964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6d9768b40 0x55c6d97765d0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:06.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.579+0000 7f2dcc7b0740 1 --2- 172.21.15.2:0/250707964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6d97675d0 0x55c6d9775fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:06.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.579+0000 7f2dcc7b0740 1 --2- 172.21.15.2:0/250707964 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c6d9730310 0x55c6d977acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:06.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.579+0000 7f2dcc7b0740 1 -- 172.21.15.2:0/250707964 >> 172.21.15.2:0/250707964 conn(0x55c6d976a9a0 msgr2=0x55c6d9770810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:06.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.580+0000 7f2dcc7b0740 1 -- 172.21.15.2:0/250707964 shutdown_connections 2024-09-19T06:22:06.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.580+0000 7f2dcc7b0740 1 -- 172.21.15.2:0/250707964 wait complete. 2024-09-19T06:22:06.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.580+0000 7f2dcc7b0740 20 client.17799 trim_cache size 0 max 16384 2024-09-19T06:22:06.589 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:22:06.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.580+0000 7f2dca3d7640 1 -- 172.21.15.2:0/1445816946 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f2dac0a33b0 msgr2=0x7f2dac0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:06.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.580+0000 7f2dca3d7640 1 --2- 172.21.15.2:0/1445816946 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f2dac0a33b0 0x7f2dac0a5870 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc00a780 tx=0x7f2dbc013ae0 comp rx=0 tx=0).stop 2024-09-19T06:22:06.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.580+0000 7f2dca3d7640 1 -- 172.21.15.2:0/1445816946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2dc4101420 msgr2=0x7f2dc4198850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:06.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.580+0000 7f2dca3d7640 1 --2- 172.21.15.2:0/1445816946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2dc4101420 0x7f2dc4198850 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f2db8005940 tx=0x7f2db80042f0 comp rx=0 tx=0).stop 2024-09-19T06:22:06.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.580+0000 7f2dca3d7640 1 -- 172.21.15.2:0/1445816946 shutdown_connections 2024-09-19T06:22:06.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.580+0000 7f2dca3d7640 1 --2- 172.21.15.2:0/1445816946 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f2dac0a33b0 0x7f2dac0a5870 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:06.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.580+0000 7f2dca3d7640 1 --2- 172.21.15.2:0/1445816946 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dc4106a80 0x7f2dc419cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:06.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.581+0000 7f2dca3d7640 1 --2- 172.21.15.2:0/1445816946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2dc4101420 0x7f2dc4198850 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:06.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.581+0000 7f2dca3d7640 1 --2- 172.21.15.2:0/1445816946 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2dc4100a80 0x7f2dc4198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:06.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.581+0000 7f2dca3d7640 1 -- 172.21.15.2:0/1445816946 >> 172.21.15.2:0/1445816946 conn(0x7f2dc40fc7a0 msgr2=0x7f2dc406aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:06.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.581+0000 7f2dca3d7640 1 -- 172.21.15.2:0/1445816946 shutdown_connections 2024-09-19T06:22:06.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:06.581+0000 7f2dca3d7640 1 -- 172.21.15.2:0/1445816946 wait complete. 2024-09-19T06:22:07.167 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:22:07.424 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:22:07.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:07 smithi002 ceph-mon[30982]: pgmap v224: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-19T06:22:07.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:07 smithi090 ceph-mon[34497]: pgmap v224: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-19T06:22:07.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:07 smithi089 ceph-mon[34160]: pgmap v224: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-19T06:22:07.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.914+0000 7f89e96eb640 1 -- 172.21.15.2:0/2113707614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89e4106f00 msgr2=0x7f89e410ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:07.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.914+0000 7f89e96eb640 1 --2- 172.21.15.2:0/2113707614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89e4106f00 0x7f89e410ea80 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f89d4009900 tx=0x7f89d402a410 comp rx=0 tx=0).stop 2024-09-19T06:22:07.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.914+0000 7f89e96eb640 1 -- 172.21.15.2:0/2113707614 shutdown_connections 2024-09-19T06:22:07.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.914+0000 7f89e96eb640 1 --2- 172.21.15.2:0/2113707614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89e4106f00 0x7f89e410ea80 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:07.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.914+0000 7f89e96eb640 1 --2- 172.21.15.2:0/2113707614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89e4102780 0x7f89e41067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:07.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.914+0000 7f89e96eb640 1 --2- 172.21.15.2:0/2113707614 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89e4101dd0 0x7f89e41021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:07.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.914+0000 7f89e96eb640 1 -- 172.21.15.2:0/2113707614 >> 172.21.15.2:0/2113707614 conn(0x7f89e40fd890 msgr2=0x7f89e40ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:07.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.914+0000 7f89e96eb640 1 -- 172.21.15.2:0/2113707614 shutdown_connections 2024-09-19T06:22:07.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.914+0000 7f89e96eb640 1 -- 172.21.15.2:0/2113707614 wait complete. 2024-09-19T06:22:07.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.914+0000 7f89e96eb640 1 Processor -- start 2024-09-19T06:22:07.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.915+0000 7f89e96eb640 1 -- start start 2024-09-19T06:22:07.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.915+0000 7f89e96eb640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89e4101dd0 0x7f89e419a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:07.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.915+0000 7f89e96eb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89e4102780 0x7f89e419aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:07.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.915+0000 7f89e96eb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89e4106f00 0x7f89e419ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:07.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.915+0000 7f89e96eb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f89e4111e10 con 0x7f89e4106f00 2024-09-19T06:22:07.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.915+0000 7f89e96eb640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f89e4111c90 con 0x7f89e4102780 2024-09-19T06:22:07.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.915+0000 7f89e96eb640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f89e4111f90 con 0x7f89e4101dd0 2024-09-19T06:22:07.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.915+0000 7f89e37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89e4106f00 0x7f89e419ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:07.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.915+0000 7f89e37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89e4106f00 0x7f89e419ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54786/0 (socket says 172.21.15.2:54786) 2024-09-19T06:22:07.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.915+0000 7f89e37fe640 1 -- 172.21.15.2:0/2510264488 learned_addr learned my addr 172.21.15.2:0/2510264488 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:07.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.915+0000 7f89e2ffd640 1 --2- 172.21.15.2:0/2510264488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89e4101dd0 0x7f89e419a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:07.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.915+0000 7f89e27fc640 1 --2- 172.21.15.2:0/2510264488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89e4102780 0x7f89e419aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:07.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.915+0000 7f89e37fe640 1 -- 172.21.15.2:0/2510264488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89e4101dd0 msgr2=0x7f89e419a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:07.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.915+0000 7f89e37fe640 1 --2- 172.21.15.2:0/2510264488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89e4101dd0 0x7f89e419a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:07.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.915+0000 7f89e37fe640 1 -- 172.21.15.2:0/2510264488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89e4102780 msgr2=0x7f89e419aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:07.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.915+0000 7f89e37fe640 1 --2- 172.21.15.2:0/2510264488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89e4102780 0x7f89e419aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:07.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.915+0000 7f89e37fe640 1 -- 172.21.15.2:0/2510264488 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e419f520 con 0x7f89e4106f00 2024-09-19T06:22:07.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.916+0000 7f89e37fe640 1 --2- 172.21.15.2:0/2510264488 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89e4106f00 0x7f89e419ee40 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f89d4009230 tx=0x7f89d4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:07.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.916+0000 7f89dbfff640 1 -- 172.21.15.2:0/2510264488 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d403f030 con 0x7f89e4106f00 2024-09-19T06:22:07.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.916+0000 7f89dbfff640 1 -- 172.21.15.2:0/2510264488 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f89d4003aa0 con 0x7f89e4106f00 2024-09-19T06:22:07.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.916+0000 7f89dbfff640 1 -- 172.21.15.2:0/2510264488 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d4035070 con 0x7f89e4106f00 2024-09-19T06:22:07.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.916+0000 7f89e96eb640 1 -- 172.21.15.2:0/2510264488 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89e419f7b0 con 0x7f89e4106f00 2024-09-19T06:22:07.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.916+0000 7f89e96eb640 1 -- 172.21.15.2:0/2510264488 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89e41a70f0 con 0x7f89e4106f00 2024-09-19T06:22:07.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.918+0000 7f89dbfff640 1 -- 172.21.15.2:0/2510264488 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f89d4042030 con 0x7f89e4106f00 2024-09-19T06:22:07.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.919+0000 7f89ebac4740 1 Processor -- start 2024-09-19T06:22:07.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.919+0000 7f89ebac4740 1 -- start start 2024-09-19T06:22:07.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.919+0000 7f89ebac4740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d7bcc5b40 0x563d7bcc4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:07.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.919+0000 7f89ebac4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d7bcc45d0 0x563d7bcc4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:07.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.919+0000 7f89ebac4740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d7bccf370 0x563d7bcd1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:07.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.919+0000 7f89ebac4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563d7bc2a2f0 con 0x563d7bcc45d0 2024-09-19T06:22:07.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.919+0000 7f89ebac4740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563d7bbd1cf0 con 0x563d7bccf370 2024-09-19T06:22:07.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.919+0000 7f89ebac4740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x563d7bc262b0 con 0x563d7bcc5b40 2024-09-19T06:22:07.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.919+0000 7f89e2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d7bcc45d0 0x563d7bcc4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:07.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.919+0000 7f89dbfff640 1 --2- 172.21.15.2:0/2510264488 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f89d00a3430 0x7f89d00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:07.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.919+0000 7f89e2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d7bcc45d0 0x563d7bcc4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54802/0 (socket says 172.21.15.2:54802) 2024-09-19T06:22:07.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.919+0000 7f89e2ffd640 1 -- 172.21.15.2:0/351984353 learned_addr learned my addr 172.21.15.2:0/351984353 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:07.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.919+0000 7f89e27fc640 1 --2- 172.21.15.2:0/351984353 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d7bcc5b40 0x563d7bcc4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:07.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.919+0000 7f89e37fe640 1 --2- 172.21.15.2:0/2510264488 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f89d00a3430 0x7f89d00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:07.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.920+0000 7f89e27fc640 1 --2- 172.21.15.2:0/351984353 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d7bccf370 0x563d7bcd1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:07.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.920+0000 7f89e2ffd640 1 -- 172.21.15.2:0/351984353 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d7bcc5b40 msgr2=0x563d7bcc4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:07.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.920+0000 7f89e2ffd640 1 --2- 172.21.15.2:0/351984353 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d7bcc5b40 0x563d7bcc4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:07.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.920+0000 7f89e2ffd640 1 -- 172.21.15.2:0/351984353 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d7bccf370 msgr2=0x563d7bcd1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:07.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.920+0000 7f89e2ffd640 1 --2- 172.21.15.2:0/351984353 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d7bccf370 0x563d7bcd1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:07.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.920+0000 7f89dbfff640 1 -- 172.21.15.2:0/2510264488 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f89d40f0340 con 0x7f89e4106f00 2024-09-19T06:22:07.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.920+0000 7f89e2ffd640 1 -- 172.21.15.2:0/351984353 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d7bbb63a0 con 0x563d7bcc45d0 2024-09-19T06:22:07.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.920+0000 7f89e27fc640 1 --2- 172.21.15.2:0/351984353 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d7bccf370 0x563d7bcd1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:22:07.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.920+0000 7f89e2ffd640 1 --2- 172.21.15.2:0/351984353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d7bcc45d0 0x563d7bcc4a10 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f89dc0103f0 tx=0x7f89dc0108b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7798a6e7afbfcf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:07.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.920+0000 7f89e37fe640 1 --2- 172.21.15.2:0/2510264488 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f89d00a3430 0x7f89d00a58f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f89d408c380 tx=0x7f89d4009260 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:07.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.920+0000 7f89d97fa640 1 -- 172.21.15.2:0/351984353 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89dc016070 con 0x563d7bcc45d0 2024-09-19T06:22:07.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.920+0000 7f89d97fa640 1 -- 172.21.15.2:0/351984353 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f89dc004d20 con 0x563d7bcc45d0 2024-09-19T06:22:07.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.920+0000 7f89d97fa640 1 -- 172.21.15.2:0/351984353 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89dc005380 con 0x563d7bcc45d0 2024-09-19T06:22:07.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.921+0000 7f89ebac4740 1 -- 172.21.15.2:0/351984353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d7bcc45d0 msgr2=0x563d7bcc4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:07.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.921+0000 7f89ebac4740 1 --2- 172.21.15.2:0/351984353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d7bcc45d0 0x563d7bcc4a10 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f89dc0103f0 tx=0x7f89dc0108b0 comp rx=0 tx=0).stop 2024-09-19T06:22:07.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.921+0000 7f89ebac4740 1 -- 172.21.15.2:0/351984353 shutdown_connections 2024-09-19T06:22:07.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.921+0000 7f89ebac4740 1 --2- 172.21.15.2:0/351984353 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d7bccf370 0x563d7bcd1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:07.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.921+0000 7f89ebac4740 1 --2- 172.21.15.2:0/351984353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d7bcc45d0 0x563d7bcc4a10 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:07.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.921+0000 7f89ebac4740 1 --2- 172.21.15.2:0/351984353 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d7bcc5b40 0x563d7bcc4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:07.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.921+0000 7f89ebac4740 1 -- 172.21.15.2:0/351984353 >> 172.21.15.2:0/351984353 conn(0x563d7bc8d310 msgr2=0x563d7bcc0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:07.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.921+0000 7f89ebac4740 1 -- 172.21.15.2:0/351984353 shutdown_connections 2024-09-19T06:22:07.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.921+0000 7f89ebac4740 1 -- 172.21.15.2:0/351984353 wait complete. 2024-09-19T06:22:07.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.921+0000 7f89ebac4740 1 -- start start 2024-09-19T06:22:07.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.921+0000 7f89ebac4740 1 Processor -- start 2024-09-19T06:22:07.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.922+0000 7f89ebac4740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d7bcc45d0 0x563d7bcced80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:07.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.922+0000 7f89ebac4740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d7bcc5b40 0x563d7bccc030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:07.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.922+0000 7f89ebac4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d7bccf370 0x563d7bccc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:07.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.922+0000 7f89ebac4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563d7bcd2070 con 0x563d7bccf370 2024-09-19T06:22:07.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.922+0000 7f89ebac4740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563d7bbe5060 con 0x563d7bcc45d0 2024-09-19T06:22:07.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.922+0000 7f89ebac4740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x563d7bcd21f0 con 0x563d7bcc5b40 2024-09-19T06:22:07.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.922+0000 7f89ebac4740 10 client.0 _ll_register_callbacks cb 0x563d7b9388c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:07.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.922+0000 7f89e2ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d7bcc5b40 0x563d7bccc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:07.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.922+0000 7f89e27fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d7bccf370 0x563d7bccc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:07.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.922+0000 7f89e2ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d7bcc5b40 0x563d7bccc030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:47116/0 (socket says 172.21.15.2:47116) 2024-09-19T06:22:07.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.922+0000 7f89e2ffd640 1 -- 172.21.15.2:0/1932997472 learned_addr learned my addr 172.21.15.2:0/1932997472 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:07.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.922+0000 7f89e27fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d7bccf370 0x563d7bccc640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54806/0 (socket says 172.21.15.2:54806) 2024-09-19T06:22:07.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.922+0000 7f89e27fc640 1 --2- 172.21.15.2:0/1932997472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d7bcc45d0 0x563d7bcced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:07.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.922+0000 7f89e2ffd640 1 -- 172.21.15.2:0/1932997472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d7bcc45d0 msgr2=0x563d7bcced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:07.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.922+0000 7f89e2ffd640 1 --2- 172.21.15.2:0/1932997472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d7bcc45d0 0x563d7bcced80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:07.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.922+0000 7f89e2ffd640 1 -- 172.21.15.2:0/1932997472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d7bccf370 msgr2=0x563d7bccc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:07.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.922+0000 7f89e2ffd640 1 --2- 172.21.15.2:0/1932997472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d7bccf370 0x563d7bccc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:07.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.922+0000 7f89e2ffd640 1 -- 172.21.15.2:0/1932997472 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d7b99b3c0 con 0x563d7bcc5b40 2024-09-19T06:22:07.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.922+0000 7f89e27fc640 1 --2- 172.21.15.2:0/1932997472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d7bccf370 0x563d7bccc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:07.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.922+0000 7f89e2ffd640 1 --2- 172.21.15.2:0/1932997472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d7bcc5b40 0x563d7bccc030 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f89dc006010 tx=0x7f89dc004c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=219d8c6c566680ff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:07.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.922+0000 7f89ca7fc640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-19T06:22:07.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.923+0000 7f89ca7fc640 1 -- 172.21.15.2:0/1932997472 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89dc029060 con 0x563d7bcc5b40 2024-09-19T06:22:07.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.923+0000 7f89ebac4740 1 -- 172.21.15.2:0/1932997472 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89dc004d20 con 0x563d7bcc5b40 2024-09-19T06:22:07.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.923+0000 7f89ca7fc640 1 -- 172.21.15.2:0/1932997472 <== mon.1 v2:172.21.15.90:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f89dc012890 con 0x563d7bcc5b40 2024-09-19T06:22:07.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.923+0000 7f89ca7fc640 1 -- 172.21.15.2:0/1932997472 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f89dc016070 con 0x563d7bcc5b40 2024-09-19T06:22:07.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.923+0000 7f89ebac4740 10 client.26896 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:07.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.923+0000 7f89ebac4740 1 -- 172.21.15.2:0/1932997472 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563d7bcddab0 con 0x563d7bcc5b40 2024-09-19T06:22:07.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.923+0000 7f89ca7fc640 1 -- 172.21.15.2:0/1932997472 <== mon.1 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f89dc004d20 con 0x563d7bcc5b40 2024-09-19T06:22:07.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.923+0000 7f89ca7fc640 1 -- 172.21.15.2:0/1932997472 <== mon.1 v2:172.21.15.90:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f89dc00f040 con 0x563d7bcc5b40 2024-09-19T06:22:07.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.923+0000 7f89ebac4740 10 client.26896 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:07.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.923+0000 7f89ebac4740 10 client.26896 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:22:07.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.923+0000 7f89ebac4740 20 client.26896 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:07.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.923+0000 7f89ebac4740 1 --2- 172.21.15.2:0/1932997472 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x563d7bcdee60 0x563d7bce1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:07.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.923+0000 7f89ebac4740 4 client.26896 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:22:07.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.923+0000 7f89ebac4740 1 -- 172.21.15.2:0/1932997472 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d7bc37860 con 0x563d7bcdee60 2024-09-19T06:22:07.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.924+0000 7f89e27fc640 1 --2- 172.21.15.2:0/1932997472 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x563d7bcdee60 0x563d7bce1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:07.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.924+0000 7f89e27fc640 1 --2- 172.21.15.2:0/1932997472 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x563d7bcdee60 0x563d7bce1250 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=edd4b06215c0e86b server_cookie=27dc72d9547ee9e9 in_seq=0 out_seq=0 2024-09-19T06:22:07.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.924+0000 7f89ca7fc640 10 client.26896 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:22:07.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.925+0000 7f89ca7fc640 1 -- 172.21.15.2:0/1932997472 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563d7bc37860 con 0x563d7bcdee60 2024-09-19T06:22:07.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.925+0000 7f89ca7fc640 10 client.26896 handle_command_reply: tid=0 2024-09-19T06:22:07.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.925+0000 7f89ebac4740 1 client.26896 shutdown 2024-09-19T06:22:07.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.925+0000 7f89ebac4740 1 -- 172.21.15.2:0/1932997472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d7bcc5b40 msgr2=0x563d7bccc030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:07.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.925+0000 7f89ebac4740 1 --2- 172.21.15.2:0/1932997472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d7bcc5b40 0x563d7bccc030 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f89dc006010 tx=0x7f89dc004c70 comp rx=0 tx=0).stop 2024-09-19T06:22:07.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.925+0000 7f89ebac4740 1 -- 172.21.15.2:0/1932997472 shutdown_connections 2024-09-19T06:22:07.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.925+0000 7f89ebac4740 1 --2- 172.21.15.2:0/1932997472 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x563d7bcdee60 0x563d7bce1250 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:07.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.925+0000 7f89ebac4740 1 --2- 172.21.15.2:0/1932997472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d7bccf370 0x563d7bccc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:07.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.925+0000 7f89ebac4740 1 --2- 172.21.15.2:0/1932997472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d7bcc5b40 0x563d7bccc030 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:07.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.925+0000 7f89ebac4740 1 --2- 172.21.15.2:0/1932997472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d7bcc45d0 0x563d7bcced80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:07.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.925+0000 7f89ebac4740 1 -- 172.21.15.2:0/1932997472 >> 172.21.15.2:0/1932997472 conn(0x563d7bc8d310 msgr2=0x563d7bcc6960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:07.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.925+0000 7f89ca7fc640 0 client.26896 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:22:07.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.925+0000 7f89ebac4740 1 -- 172.21.15.2:0/1932997472 shutdown_connections 2024-09-19T06:22:07.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.925+0000 7f89ebac4740 1 -- 172.21.15.2:0/1932997472 wait complete. 2024-09-19T06:22:07.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.925+0000 7f89ebac4740 20 client.26896 trim_cache size 0 max 16384 2024-09-19T06:22:07.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.938+0000 7f89ebac4740 1 Processor -- start 2024-09-19T06:22:07.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.938+0000 7f89ebac4740 1 -- start start 2024-09-19T06:22:07.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.939+0000 7f89ebac4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d7bcc45d0 0x563d7bcdb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:07.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.939+0000 7f89ebac4740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d7bcc5b40 0x563d7bccb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:07.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.939+0000 7f89ebac4740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d7bccf370 0x563d7bcd0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:07.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.939+0000 7f89ebac4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f89e41b22a0 con 0x563d7bcc45d0 2024-09-19T06:22:07.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.939+0000 7f89ebac4740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f89e41afb70 con 0x563d7bccf370 2024-09-19T06:22:07.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.939+0000 7f89ebac4740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f89e41ad9e0 con 0x563d7bcc5b40 2024-09-19T06:22:07.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.939+0000 7f89e27fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d7bcc45d0 0x563d7bcdb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:07.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.939+0000 7f89e27fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d7bcc45d0 0x563d7bcdb310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54822/0 (socket says 172.21.15.2:54822) 2024-09-19T06:22:07.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.939+0000 7f89e27fc640 1 -- 172.21.15.2:0/2885160323 learned_addr learned my addr 172.21.15.2:0/2885160323 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:07.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.939+0000 7f89e2ffd640 1 --2- 172.21.15.2:0/2885160323 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d7bcc5b40 0x563d7bccb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:07.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.939+0000 7f89e27fc640 1 --2- 172.21.15.2:0/2885160323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d7bccf370 0x563d7bcd0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:07.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.939+0000 7f89e27fc640 1 -- 172.21.15.2:0/2885160323 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d7bcc5b40 msgr2=0x563d7bccb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:07.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.939+0000 7f89e27fc640 1 --2- 172.21.15.2:0/2885160323 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d7bcc5b40 0x563d7bccb8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:07.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.939+0000 7f89e27fc640 1 -- 172.21.15.2:0/2885160323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d7bccf370 msgr2=0x563d7bcd0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:07.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.939+0000 7f89e27fc640 1 --2- 172.21.15.2:0/2885160323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d7bccf370 0x563d7bcd0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:07.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.939+0000 7f89e27fc640 1 -- 172.21.15.2:0/2885160323 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d7bcc1960 con 0x563d7bcc45d0 2024-09-19T06:22:07.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.939+0000 7f89e27fc640 1 --2- 172.21.15.2:0/2885160323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d7bcc45d0 0x563d7bcdb310 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f89e40ff7b0 tx=0x7f89cc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54e236ea4b7f3cf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:07.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.940+0000 7f89d8ff9640 1 -- 172.21.15.2:0/2885160323 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89cc004020 con 0x563d7bcc45d0 2024-09-19T06:22:07.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.940+0000 7f89d8ff9640 1 -- 172.21.15.2:0/2885160323 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f89cc0054d0 con 0x563d7bcc45d0 2024-09-19T06:22:07.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.940+0000 7f89d8ff9640 1 -- 172.21.15.2:0/2885160323 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89cc004a00 con 0x563d7bcc45d0 2024-09-19T06:22:07.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.940+0000 7f89ebac4740 1 -- 172.21.15.2:0/2885160323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d7bcc45d0 msgr2=0x563d7bcdb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:07.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.940+0000 7f89ebac4740 1 --2- 172.21.15.2:0/2885160323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d7bcc45d0 0x563d7bcdb310 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f89e40ff7b0 tx=0x7f89cc004730 comp rx=0 tx=0).stop 2024-09-19T06:22:07.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.940+0000 7f89ebac4740 1 -- 172.21.15.2:0/2885160323 shutdown_connections 2024-09-19T06:22:07.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.940+0000 7f89ebac4740 1 --2- 172.21.15.2:0/2885160323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d7bccf370 0x563d7bcd0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:07.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.940+0000 7f89ebac4740 1 --2- 172.21.15.2:0/2885160323 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d7bcc5b40 0x563d7bccb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:07.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.940+0000 7f89ebac4740 1 --2- 172.21.15.2:0/2885160323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d7bcc45d0 0x563d7bcdb310 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:07.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.940+0000 7f89ebac4740 1 -- 172.21.15.2:0/2885160323 >> 172.21.15.2:0/2885160323 conn(0x563d7bc8d310 msgr2=0x563d7bcc7310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:07.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.940+0000 7f89ebac4740 1 -- 172.21.15.2:0/2885160323 shutdown_connections 2024-09-19T06:22:07.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.940+0000 7f89ebac4740 1 -- 172.21.15.2:0/2885160323 wait complete. 2024-09-19T06:22:07.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.941+0000 7f89ebac4740 1 -- start start 2024-09-19T06:22:07.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.941+0000 7f89ebac4740 1 Processor -- start 2024-09-19T06:22:07.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.941+0000 7f89ebac4740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d7bcc45d0 0x563d7bccfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:07.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.941+0000 7f89ebac4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d7bcc5b40 0x563d7bcd0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:07.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.941+0000 7f89ebac4740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d7bccf370 0x563d7bcd0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:07.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.941+0000 7f89ebac4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f89e41ae030 con 0x563d7bcc5b40 2024-09-19T06:22:07.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.941+0000 7f89ebac4740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f89e41af4a0 con 0x563d7bcc45d0 2024-09-19T06:22:07.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.941+0000 7f89ebac4740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f89e41ae700 con 0x563d7bccf370 2024-09-19T06:22:07.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.941+0000 7f89ebac4740 10 client.0 _ll_register_callbacks cb 0x7f89cc00a5e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:07.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.941+0000 7f89e2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d7bcc5b40 0x563d7bcd0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:07.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.941+0000 7f89e2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d7bcc5b40 0x563d7bcd0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54828/0 (socket says 172.21.15.2:54828) 2024-09-19T06:22:07.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.941+0000 7f89e2ffd640 1 -- 172.21.15.2:0/2385126989 learned_addr learned my addr 172.21.15.2:0/2385126989 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:07.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.941+0000 7f89e27fc640 1 --2- 172.21.15.2:0/2385126989 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d7bccf370 0x563d7bcd0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:07.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.941+0000 7f89e27fc640 1 --2- 172.21.15.2:0/2385126989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d7bcc45d0 0x563d7bccfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:07.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.942+0000 7f89e2ffd640 1 -- 172.21.15.2:0/2385126989 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d7bccf370 msgr2=0x563d7bcd0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:07.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.942+0000 7f89e2ffd640 1 --2- 172.21.15.2:0/2385126989 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d7bccf370 0x563d7bcd0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:07.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.942+0000 7f89e2ffd640 1 -- 172.21.15.2:0/2385126989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d7bcc45d0 msgr2=0x563d7bccfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:07.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.942+0000 7f89e2ffd640 1 --2- 172.21.15.2:0/2385126989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d7bcc45d0 0x563d7bccfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:07.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.942+0000 7f89e2ffd640 1 -- 172.21.15.2:0/2385126989 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d7bcc7120 con 0x563d7bcc5b40 2024-09-19T06:22:07.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.942+0000 7f89e27fc640 1 --2- 172.21.15.2:0/2385126989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d7bcc45d0 0x563d7bccfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:07.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.942+0000 7f89e2ffd640 1 --2- 172.21.15.2:0/2385126989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d7bcc5b40 0x563d7bcd0210 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x563d7bccd670 tx=0x7f89dc011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c2e579d1c3cb3a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:07.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.942+0000 7f89ca7fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:22:07.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.942+0000 7f89ca7fc640 1 -- 172.21.15.2:0/2385126989 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89dc029050 con 0x563d7bcc5b40 2024-09-19T06:22:07.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.942+0000 7f89ca7fc640 1 -- 172.21.15.2:0/2385126989 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8521+0+0 (secure 0 0 0) 0x7f89dc003970 con 0x563d7bcc5b40 2024-09-19T06:22:07.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.942+0000 7f89ebac4740 1 -- 172.21.15.2:0/2385126989 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89cc0054d0 con 0x563d7bcc5b40 2024-09-19T06:22:07.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.942+0000 7f89ca7fc640 1 -- 172.21.15.2:0/2385126989 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f89dc009680 con 0x563d7bcc5b40 2024-09-19T06:22:07.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.942+0000 7f89ebac4740 10 client.17817 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:07.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.942+0000 7f89ebac4740 1 -- 172.21.15.2:0/2385126989 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563d7bcd7820 con 0x563d7bcc5b40 2024-09-19T06:22:07.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.942+0000 7f89ca7fc640 1 -- 172.21.15.2:0/2385126989 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f89cc0054d0 con 0x563d7bcc5b40 2024-09-19T06:22:07.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.942+0000 7f89ca7fc640 1 -- 172.21.15.2:0/2385126989 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f89dc004030 con 0x563d7bcc5b40 2024-09-19T06:22:07.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.943+0000 7f89ebac4740 10 client.17817 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:07.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.943+0000 7f89ebac4740 10 client.17817 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:22:07.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.943+0000 7f89ebac4740 20 client.17817 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:07.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.943+0000 7f89ebac4740 1 --2- 172.21.15.2:0/2385126989 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x563d7bd49840 0x563d7bd4bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:07.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.943+0000 7f89ebac4740 4 client.17817 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:22:07.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.943+0000 7f89ebac4740 1 -- 172.21.15.2:0/2385126989 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563d7bc31d70 con 0x563d7bd49840 2024-09-19T06:22:07.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.943+0000 7f89e27fc640 1 --2- 172.21.15.2:0/2385126989 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x563d7bd49840 0x563d7bd4bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:07.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.943+0000 7f89ca7fc640 10 client.17817 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:22:07.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.943+0000 7f89e27fc640 1 --2- 172.21.15.2:0/2385126989 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x563d7bd49840 0x563d7bd4bc30 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6da155753f5f4b84 server_cookie=9efc5be897fd3afa in_seq=0 out_seq=0 2024-09-19T06:22:07.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.943+0000 7f89ca7fc640 1 -- 172.21.15.2:0/2385126989 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563d7bc31d70 con 0x563d7bd49840 2024-09-19T06:22:07.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.943+0000 7f89ca7fc640 10 client.17817 handle_command_reply: tid=0 2024-09-19T06:22:07.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.943+0000 7f89ebac4740 1 client.17817 shutdown 2024-09-19T06:22:07.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.943+0000 7f89ebac4740 1 -- 172.21.15.2:0/2385126989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d7bcc5b40 msgr2=0x563d7bcd0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:07.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.943+0000 7f89ebac4740 1 --2- 172.21.15.2:0/2385126989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d7bcc5b40 0x563d7bcd0210 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x563d7bccd670 tx=0x7f89dc011c40 comp rx=0 tx=0).stop 2024-09-19T06:22:07.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.944+0000 7f89ebac4740 1 -- 172.21.15.2:0/2385126989 shutdown_connections 2024-09-19T06:22:07.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.944+0000 7f89ebac4740 1 --2- 172.21.15.2:0/2385126989 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x563d7bd49840 0x563d7bd4bc30 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:07.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.944+0000 7f89ebac4740 1 --2- 172.21.15.2:0/2385126989 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d7bccf370 0x563d7bcd0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:07.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.944+0000 7f89ebac4740 1 --2- 172.21.15.2:0/2385126989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d7bcc5b40 0x563d7bcd0210 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:07.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.944+0000 7f89ebac4740 1 --2- 172.21.15.2:0/2385126989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d7bcc45d0 0x563d7bccfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:07.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.944+0000 7f89ebac4740 1 -- 172.21.15.2:0/2385126989 >> 172.21.15.2:0/2385126989 conn(0x563d7bc8d310 msgr2=0x563d7bccb120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:07.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.944+0000 7f89ca7fc640 0 client.17817 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:22:07.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.944+0000 7f89ebac4740 1 -- 172.21.15.2:0/2385126989 shutdown_connections 2024-09-19T06:22:07.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.944+0000 7f89ebac4740 1 -- 172.21.15.2:0/2385126989 wait complete. 2024-09-19T06:22:07.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.944+0000 7f89ebac4740 20 client.17817 trim_cache size 0 max 16384 2024-09-19T06:22:07.951 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:22:07.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.944+0000 7f89e96eb640 1 -- 172.21.15.2:0/2510264488 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f89d00a3430 msgr2=0x7f89d00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:07.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.944+0000 7f89e96eb640 1 --2- 172.21.15.2:0/2510264488 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f89d00a3430 0x7f89d00a58f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f89d408c380 tx=0x7f89d4009260 comp rx=0 tx=0).stop 2024-09-19T06:22:07.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.944+0000 7f89e96eb640 1 -- 172.21.15.2:0/2510264488 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89e4106f00 msgr2=0x7f89e419ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:07.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.944+0000 7f89e96eb640 1 --2- 172.21.15.2:0/2510264488 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89e4106f00 0x7f89e419ee40 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f89d4009230 tx=0x7f89d4004270 comp rx=0 tx=0).stop 2024-09-19T06:22:07.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.944+0000 7f89e96eb640 1 -- 172.21.15.2:0/2510264488 shutdown_connections 2024-09-19T06:22:07.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.944+0000 7f89e96eb640 1 --2- 172.21.15.2:0/2510264488 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f89d00a3430 0x7f89d00a58f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:07.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.944+0000 7f89e96eb640 1 --2- 172.21.15.2:0/2510264488 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89e4106f00 0x7f89e419ee40 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:07.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.944+0000 7f89e96eb640 1 --2- 172.21.15.2:0/2510264488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89e4102780 0x7f89e419aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:07.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.944+0000 7f89e96eb640 1 --2- 172.21.15.2:0/2510264488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89e4101dd0 0x7f89e419a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:07.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.944+0000 7f89e96eb640 1 -- 172.21.15.2:0/2510264488 >> 172.21.15.2:0/2510264488 conn(0x7f89e40fd890 msgr2=0x7f89e40fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:07.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.945+0000 7f89e96eb640 1 -- 172.21.15.2:0/2510264488 shutdown_connections 2024-09-19T06:22:07.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:07.945+0000 7f89e96eb640 1 -- 172.21.15.2:0/2510264488 wait complete. 2024-09-19T06:22:08.676 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:22:08.933 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:22:09.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.347+0000 7f1648acc640 1 -- 172.21.15.2:0/3562901793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f164410c170 msgr2=0x7f164410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:09.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.347+0000 7f1648acc640 1 --2- 172.21.15.2:0/3562901793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f164410c170 0x7f164410e610 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f163c009ca0 tx=0x7f163c02a950 comp rx=0 tx=0).stop 2024-09-19T06:22:09.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.347+0000 7f1648acc640 1 -- 172.21.15.2:0/3562901793 shutdown_connections 2024-09-19T06:22:09.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.347+0000 7f1648acc640 1 --2- 172.21.15.2:0/3562901793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f164410c170 0x7f164410e610 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:09.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.347+0000 7f1648acc640 1 --2- 172.21.15.2:0/3562901793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1644103660 0x7f164410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:09.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.347+0000 7f1648acc640 1 --2- 172.21.15.2:0/3562901793 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1644102d40 0x7f1644103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:09.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.347+0000 7f1648acc640 1 -- 172.21.15.2:0/3562901793 >> 172.21.15.2:0/3562901793 conn(0x7f16440fc7a0 msgr2=0x7f16440febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:09.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.347+0000 7f1648acc640 1 -- 172.21.15.2:0/3562901793 shutdown_connections 2024-09-19T06:22:09.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.347+0000 7f1648acc640 1 -- 172.21.15.2:0/3562901793 wait complete. 2024-09-19T06:22:09.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.348+0000 7f1648acc640 1 Processor -- start 2024-09-19T06:22:09.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.348+0000 7f1648acc640 1 -- start start 2024-09-19T06:22:09.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.348+0000 7f1648acc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1644102d40 0x7f164419a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:09.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.348+0000 7f1648acc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1644103660 0x7f164419aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:09.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.348+0000 7f1648acc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f164410c170 0x7f164419eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:09.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.348+0000 7f1648acc640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1644111e20 con 0x7f1644102d40 2024-09-19T06:22:09.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.348+0000 7f1648acc640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f1644111ca0 con 0x7f1644103660 2024-09-19T06:22:09.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.348+0000 7f1648acc640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1644111fa0 con 0x7f164410c170 2024-09-19T06:22:09.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.348+0000 7f164259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1644102d40 0x7f164419a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:09.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.348+0000 7f164259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1644102d40 0x7f164419a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54850/0 (socket says 172.21.15.2:54850) 2024-09-19T06:22:09.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.349+0000 7f164259c640 1 -- 172.21.15.2:0/1499166355 learned_addr learned my addr 172.21.15.2:0/1499166355 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:09.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.349+0000 7f163bfff640 1 --2- 172.21.15.2:0/1499166355 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1644103660 0x7f164419aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:09.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.349+0000 7f1642d9d640 1 --2- 172.21.15.2:0/1499166355 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f164410c170 0x7f164419eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:09.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.349+0000 7f164259c640 1 -- 172.21.15.2:0/1499166355 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f164410c170 msgr2=0x7f164419eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:09.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.349+0000 7f164259c640 1 --2- 172.21.15.2:0/1499166355 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f164410c170 0x7f164419eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:09.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.349+0000 7f164259c640 1 -- 172.21.15.2:0/1499166355 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1644103660 msgr2=0x7f164419aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:09.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.349+0000 7f164259c640 1 --2- 172.21.15.2:0/1499166355 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1644103660 0x7f164419aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:09.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.349+0000 7f164259c640 1 -- 172.21.15.2:0/1499166355 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f164419f480 con 0x7f1644102d40 2024-09-19T06:22:09.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.349+0000 7f164259c640 1 --2- 172.21.15.2:0/1499166355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1644102d40 0x7f164419a4d0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f163400c890 tx=0x7f163400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:09.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.349+0000 7f163b7fe640 1 -- 172.21.15.2:0/1499166355 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1634004220 con 0x7f1644102d40 2024-09-19T06:22:09.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.349+0000 7f163b7fe640 1 -- 172.21.15.2:0/1499166355 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f16340043c0 con 0x7f1644102d40 2024-09-19T06:22:09.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.349+0000 7f1648acc640 1 -- 172.21.15.2:0/1499166355 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f164419f770 con 0x7f1644102d40 2024-09-19T06:22:09.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.349+0000 7f163b7fe640 1 -- 172.21.15.2:0/1499166355 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1634004a00 con 0x7f1644102d40 2024-09-19T06:22:09.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.349+0000 7f1648acc640 1 -- 172.21.15.2:0/1499166355 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16441a7050 con 0x7f1644102d40 2024-09-19T06:22:09.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.352+0000 7f164aea5740 1 Processor -- start 2024-09-19T06:22:09.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.352+0000 7f164aea5740 1 -- start start 2024-09-19T06:22:09.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.352+0000 7f163b7fe640 1 -- 172.21.15.2:0/1499166355 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f1634004ba0 con 0x7f1644102d40 2024-09-19T06:22:09.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.352+0000 7f164aea5740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604f96d0b40 0x5604f96cf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:09.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.352+0000 7f164aea5740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5604f96cf5d0 0x5604f96cfa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:09.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.353+0000 7f164aea5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604f96da370 0x5604f96dc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:09.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.353+0000 7f164aea5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5604f96352f0 con 0x5604f96da370 2024-09-19T06:22:09.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.353+0000 7f164aea5740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5604f95dccf0 con 0x5604f96cf5d0 2024-09-19T06:22:09.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.353+0000 7f164aea5740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5604f96312b0 con 0x5604f96d0b40 2024-09-19T06:22:09.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.353+0000 7f1642d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604f96d0b40 0x5604f96cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:09.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.353+0000 7f164259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5604f96cf5d0 0x5604f96cfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:09.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.353+0000 7f1642d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604f96d0b40 0x5604f96cf090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:47164/0 (socket says 172.21.15.2:47164) 2024-09-19T06:22:09.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.353+0000 7f1642d9d640 1 -- 172.21.15.2:0/4111980955 learned_addr learned my addr 172.21.15.2:0/4111980955 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:09.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.353+0000 7f163bfff640 1 --2- 172.21.15.2:0/4111980955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604f96da370 0x5604f96dc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:09.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.353+0000 7f1642d9d640 1 -- 172.21.15.2:0/4111980955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5604f96cf5d0 msgr2=0x5604f96cfa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:09.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.353+0000 7f1642d9d640 1 --2- 172.21.15.2:0/4111980955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5604f96cf5d0 0x5604f96cfa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:09.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.353+0000 7f1642d9d640 1 -- 172.21.15.2:0/4111980955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604f96da370 msgr2=0x5604f96dc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:09.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.353+0000 7f1642d9d640 1 --2- 172.21.15.2:0/4111980955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604f96da370 0x5604f96dc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:09.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.353+0000 7f1642d9d640 1 -- 172.21.15.2:0/4111980955 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604f95c13a0 con 0x5604f96d0b40 2024-09-19T06:22:09.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.353+0000 7f163b7fe640 1 --2- 172.21.15.2:0/1499166355 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f16300a3430 0x7f16300a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:09.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.354+0000 7f1642d9d640 1 --2- 172.21.15.2:0/4111980955 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604f96d0b40 0x5604f96cf090 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f163c035000 tx=0x7f163c02fe80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=476009674693bc95 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:09.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.354+0000 7f163b7fe640 1 -- 172.21.15.2:0/1499166355 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8565+0+0 (secure 0 0 0) 0x7f16340cf8e0 con 0x7f1644102d40 2024-09-19T06:22:09.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.354+0000 7f164259c640 1 --2- 172.21.15.2:0/1499166355 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f16300a3430 0x7f16300a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:09.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.354+0000 7f164259c640 1 --2- 172.21.15.2:0/1499166355 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f16300a3430 0x7f16300a58f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f16340cd0b0 tx=0x7f16340d5550 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:09.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.355+0000 7f1638ff9640 1 -- 172.21.15.2:0/4111980955 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c048070 con 0x5604f96d0b40 2024-09-19T06:22:09.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.355+0000 7f1638ff9640 1 -- 172.21.15.2:0/4111980955 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f163c003e20 con 0x5604f96d0b40 2024-09-19T06:22:09.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.355+0000 7f1638ff9640 1 -- 172.21.15.2:0/4111980955 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c034040 con 0x5604f96d0b40 2024-09-19T06:22:09.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.355+0000 7f164aea5740 1 -- 172.21.15.2:0/4111980955 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604f96d0b40 msgr2=0x5604f96cf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:09.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.355+0000 7f164aea5740 1 --2- 172.21.15.2:0/4111980955 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604f96d0b40 0x5604f96cf090 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f163c035000 tx=0x7f163c02fe80 comp rx=0 tx=0).stop 2024-09-19T06:22:09.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.355+0000 7f164aea5740 1 -- 172.21.15.2:0/4111980955 shutdown_connections 2024-09-19T06:22:09.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.355+0000 7f164aea5740 1 --2- 172.21.15.2:0/4111980955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604f96da370 0x5604f96dc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:09.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.355+0000 7f164aea5740 1 --2- 172.21.15.2:0/4111980955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5604f96cf5d0 0x5604f96cfa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:09.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.355+0000 7f164aea5740 1 --2- 172.21.15.2:0/4111980955 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604f96d0b40 0x5604f96cf090 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:09.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.355+0000 7f164aea5740 1 -- 172.21.15.2:0/4111980955 >> 172.21.15.2:0/4111980955 conn(0x5604f9698310 msgr2=0x5604f96cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:09.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.355+0000 7f164aea5740 1 -- 172.21.15.2:0/4111980955 shutdown_connections 2024-09-19T06:22:09.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.356+0000 7f164aea5740 1 -- 172.21.15.2:0/4111980955 wait complete. 2024-09-19T06:22:09.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.356+0000 7f164aea5740 1 -- start start 2024-09-19T06:22:09.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.356+0000 7f164aea5740 1 Processor -- start 2024-09-19T06:22:09.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.356+0000 7f164aea5740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604f96cf5d0 0x5604f96d9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:09.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.356+0000 7f164aea5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604f96d0b40 0x5604f96d7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:09.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.356+0000 7f164aea5740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5604f96da370 0x5604f96d77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:09.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.356+0000 7f164aea5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5604f96dd010 con 0x5604f96d0b40 2024-09-19T06:22:09.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.356+0000 7f164aea5740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5604f95f0060 con 0x5604f96da370 2024-09-19T06:22:09.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.356+0000 7f164aea5740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5604f96dd190 con 0x5604f96cf5d0 2024-09-19T06:22:09.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.356+0000 7f164aea5740 10 client.0 _ll_register_callbacks cb 0x5604f93438c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:09.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.356+0000 7f163bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604f96d0b40 0x5604f96d7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:09.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.356+0000 7f163bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604f96d0b40 0x5604f96d7060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54878/0 (socket says 172.21.15.2:54878) 2024-09-19T06:22:09.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.356+0000 7f163bfff640 1 -- 172.21.15.2:0/2777977280 learned_addr learned my addr 172.21.15.2:0/2777977280 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:09.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.356+0000 7f1642d9d640 1 --2- 172.21.15.2:0/2777977280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5604f96da370 0x5604f96d77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:09.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.357+0000 7f1642d9d640 1 --2- 172.21.15.2:0/2777977280 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604f96cf5d0 0x5604f96d9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:09.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.357+0000 7f163bfff640 1 -- 172.21.15.2:0/2777977280 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604f96cf5d0 msgr2=0x5604f96d9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:09.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.357+0000 7f163bfff640 1 --2- 172.21.15.2:0/2777977280 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604f96cf5d0 0x5604f96d9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:09.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.357+0000 7f163bfff640 1 -- 172.21.15.2:0/2777977280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5604f96da370 msgr2=0x5604f96d77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:09.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.357+0000 7f163bfff640 1 --2- 172.21.15.2:0/2777977280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5604f96da370 0x5604f96d77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:09.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.357+0000 7f163bfff640 1 -- 172.21.15.2:0/2777977280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604f93a63c0 con 0x5604f96d0b40 2024-09-19T06:22:09.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.357+0000 7f163bfff640 1 --2- 172.21.15.2:0/2777977280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604f96d0b40 0x5604f96d7060 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f162c010800 tx=0x7f162c010cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47be59fd254aab2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:09.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.357+0000 7f1629ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:22:09.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.357+0000 7f1629ffb640 1 -- 172.21.15.2:0/2777977280 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f162c01e060 con 0x5604f96d0b40 2024-09-19T06:22:09.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.357+0000 7f1629ffb640 1 -- 172.21.15.2:0/2777977280 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8565+0+0 (secure 0 0 0) 0x7f162c00fc50 con 0x5604f96d0b40 2024-09-19T06:22:09.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.357+0000 7f164aea5740 1 -- 172.21.15.2:0/2777977280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f163c003e20 con 0x5604f96d0b40 2024-09-19T06:22:09.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.357+0000 7f1629ffb640 1 -- 172.21.15.2:0/2777977280 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f162c00fe50 con 0x5604f96d0b40 2024-09-19T06:22:09.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.357+0000 7f164aea5740 10 client.17829 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:09.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.357+0000 7f164aea5740 1 -- 172.21.15.2:0/2777977280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5604f96e8b60 con 0x5604f96d0b40 2024-09-19T06:22:09.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.357+0000 7f1629ffb640 1 -- 172.21.15.2:0/2777977280 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f163c003e20 con 0x5604f96d0b40 2024-09-19T06:22:09.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.358+0000 7f1629ffb640 1 -- 172.21.15.2:0/2777977280 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f162c00e5b0 con 0x5604f96d0b40 2024-09-19T06:22:09.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.358+0000 7f164aea5740 10 client.17829 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:09.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.358+0000 7f164aea5740 10 client.17829 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:09.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.358+0000 7f164aea5740 20 client.17829 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:09.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.358+0000 7f164aea5740 1 --2- 172.21.15.2:0/2777977280 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5604f96ea070 0x5604f96ec490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:09.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.358+0000 7f164aea5740 4 client.17829 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:22:09.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.358+0000 7f164aea5740 1 -- 172.21.15.2:0/2777977280 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604f9642860 con 0x5604f96ea070 2024-09-19T06:22:09.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.358+0000 7f1642d9d640 1 --2- 172.21.15.2:0/2777977280 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5604f96ea070 0x5604f96ec490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:09.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.358+0000 7f1642d9d640 1 --2- 172.21.15.2:0/2777977280 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5604f96ea070 0x5604f96ec490 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2ff44dd9e0aa972 server_cookie=b72754e811d40c1f in_seq=0 out_seq=0 2024-09-19T06:22:09.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.358+0000 7f1629ffb640 10 client.17829 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:09.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.359+0000 7f1629ffb640 1 -- 172.21.15.2:0/2777977280 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5604f9642860 con 0x5604f96ea070 2024-09-19T06:22:09.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.359+0000 7f1629ffb640 10 client.17829 handle_command_reply: tid=0 2024-09-19T06:22:09.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.359+0000 7f164aea5740 1 client.17829 shutdown 2024-09-19T06:22:09.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.359+0000 7f164aea5740 1 -- 172.21.15.2:0/2777977280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604f96d0b40 msgr2=0x5604f96d7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:09.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.359+0000 7f164aea5740 1 --2- 172.21.15.2:0/2777977280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604f96d0b40 0x5604f96d7060 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f162c010800 tx=0x7f162c010cc0 comp rx=0 tx=0).stop 2024-09-19T06:22:09.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.359+0000 7f164aea5740 1 -- 172.21.15.2:0/2777977280 shutdown_connections 2024-09-19T06:22:09.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.359+0000 7f164aea5740 1 --2- 172.21.15.2:0/2777977280 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5604f96ea070 0x5604f96ec490 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:09.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.359+0000 7f1629ffb640 0 client.17829 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:09.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.359+0000 7f164aea5740 1 --2- 172.21.15.2:0/2777977280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5604f96da370 0x5604f96d77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:09.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.359+0000 7f164aea5740 1 --2- 172.21.15.2:0/2777977280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604f96d0b40 0x5604f96d7060 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:09.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.359+0000 7f164aea5740 1 --2- 172.21.15.2:0/2777977280 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604f96cf5d0 0x5604f96d9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:09.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.359+0000 7f164aea5740 1 -- 172.21.15.2:0/2777977280 >> 172.21.15.2:0/2777977280 conn(0x5604f9698310 msgr2=0x5604f96d1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:09.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.359+0000 7f164aea5740 1 -- 172.21.15.2:0/2777977280 shutdown_connections 2024-09-19T06:22:09.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.359+0000 7f164aea5740 1 -- 172.21.15.2:0/2777977280 wait complete. 2024-09-19T06:22:09.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.360+0000 7f164aea5740 20 client.17829 trim_cache size 0 max 16384 2024-09-19T06:22:09.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.372+0000 7f164aea5740 1 Processor -- start 2024-09-19T06:22:09.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.372+0000 7f164aea5740 1 -- start start 2024-09-19T06:22:09.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.372+0000 7f164aea5740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604f96cf5d0 0x5604f96d6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:09.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.372+0000 7f164aea5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604f96d0b40 0x5604f96f1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:09.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.373+0000 7f164aea5740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5604f96da370 0x5604f96f2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:09.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.373+0000 7f164aea5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f16441b22b0 con 0x5604f96d0b40 2024-09-19T06:22:09.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.373+0000 7f164aea5740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f16441afb80 con 0x5604f96da370 2024-09-19T06:22:09.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.373+0000 7f164aea5740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f16441ad9f0 con 0x5604f96cf5d0 2024-09-19T06:22:09.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.373+0000 7f163bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604f96d0b40 0x5604f96f1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:09.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.373+0000 7f163bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604f96d0b40 0x5604f96f1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54884/0 (socket says 172.21.15.2:54884) 2024-09-19T06:22:09.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.373+0000 7f163bfff640 1 -- 172.21.15.2:0/1369274598 learned_addr learned my addr 172.21.15.2:0/1369274598 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:09.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.373+0000 7f1642d9d640 1 --2- 172.21.15.2:0/1369274598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5604f96da370 0x5604f96f2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:09.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.373+0000 7f1642d9d640 1 --2- 172.21.15.2:0/1369274598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604f96cf5d0 0x5604f96d6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:09.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.373+0000 7f163bfff640 1 -- 172.21.15.2:0/1369274598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604f96cf5d0 msgr2=0x5604f96d6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:09.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.373+0000 7f163bfff640 1 --2- 172.21.15.2:0/1369274598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604f96cf5d0 0x5604f96d6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:09.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.373+0000 7f163bfff640 1 -- 172.21.15.2:0/1369274598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5604f96da370 msgr2=0x5604f96f2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:09.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.373+0000 7f163bfff640 1 --2- 172.21.15.2:0/1369274598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5604f96da370 0x5604f96f2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:09.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.373+0000 7f163bfff640 1 -- 172.21.15.2:0/1369274598 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604f96d2120 con 0x5604f96d0b40 2024-09-19T06:22:09.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.373+0000 7f1642d9d640 1 --2- 172.21.15.2:0/1369274598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5604f96da370 0x5604f96f2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:09.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.373+0000 7f163bfff640 1 --2- 172.21.15.2:0/1369274598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604f96d0b40 0x5604f96f1d40 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f162c00e9a0 tx=0x7f162c00a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98d91b3c47b43d51 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:09.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.373+0000 7f162bfff640 1 -- 172.21.15.2:0/1369274598 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f162c030070 con 0x5604f96d0b40 2024-09-19T06:22:09.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.373+0000 7f162bfff640 1 -- 172.21.15.2:0/1369274598 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f162c00a2c0 con 0x5604f96d0b40 2024-09-19T06:22:09.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.373+0000 7f162bfff640 1 -- 172.21.15.2:0/1369274598 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f162c02b850 con 0x5604f96d0b40 2024-09-19T06:22:09.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.374+0000 7f164aea5740 1 -- 172.21.15.2:0/1369274598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604f96d0b40 msgr2=0x5604f96f1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:09.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.374+0000 7f164aea5740 1 --2- 172.21.15.2:0/1369274598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604f96d0b40 0x5604f96f1d40 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f162c00e9a0 tx=0x7f162c00a6c0 comp rx=0 tx=0).stop 2024-09-19T06:22:09.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.374+0000 7f164aea5740 1 -- 172.21.15.2:0/1369274598 shutdown_connections 2024-09-19T06:22:09.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.374+0000 7f164aea5740 1 --2- 172.21.15.2:0/1369274598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5604f96da370 0x5604f96f2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:09.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.374+0000 7f164aea5740 1 --2- 172.21.15.2:0/1369274598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604f96d0b40 0x5604f96f1d40 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:09.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.374+0000 7f164aea5740 1 --2- 172.21.15.2:0/1369274598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604f96cf5d0 0x5604f96d6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:09.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.374+0000 7f164aea5740 1 -- 172.21.15.2:0/1369274598 >> 172.21.15.2:0/1369274598 conn(0x5604f9698310 msgr2=0x5604f96d5930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:09.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.374+0000 7f164aea5740 1 -- 172.21.15.2:0/1369274598 shutdown_connections 2024-09-19T06:22:09.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.374+0000 7f164aea5740 1 -- 172.21.15.2:0/1369274598 wait complete. 2024-09-19T06:22:09.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.374+0000 7f164aea5740 1 -- start start 2024-09-19T06:22:09.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.375+0000 7f164aea5740 1 Processor -- start 2024-09-19T06:22:09.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.375+0000 7f164aea5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604f96cf5d0 0x5604f96de310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:09.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.375+0000 7f164aea5740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5604f96d0b40 0x5604f96de850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:09.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.375+0000 7f164aea5740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604f96da370 0x5604f96ded90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:09.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.375+0000 7f164aea5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f16441ae040 con 0x5604f96cf5d0 2024-09-19T06:22:09.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.375+0000 7f164aea5740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f16441af4b0 con 0x5604f96d0b40 2024-09-19T06:22:09.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.375+0000 7f164aea5740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f16441ae710 con 0x5604f96da370 2024-09-19T06:22:09.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.375+0000 7f164aea5740 10 client.0 _ll_register_callbacks cb 0x7f162c00a7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:09.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.375+0000 7f1642d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604f96cf5d0 0x5604f96de310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:09.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.375+0000 7f1642d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604f96cf5d0 0x5604f96de310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54890/0 (socket says 172.21.15.2:54890) 2024-09-19T06:22:09.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.375+0000 7f1642d9d640 1 -- 172.21.15.2:0/2661186173 learned_addr learned my addr 172.21.15.2:0/2661186173 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:09.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.375+0000 7f163bfff640 1 --2- 172.21.15.2:0/2661186173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5604f96d0b40 0x5604f96de850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:09.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.375+0000 7f1642d9d640 1 -- 172.21.15.2:0/2661186173 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604f96da370 msgr2=0x5604f96ded90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:09.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.375+0000 7f1642d9d640 1 --2- 172.21.15.2:0/2661186173 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604f96da370 0x5604f96ded90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:09.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.375+0000 7f1642d9d640 1 -- 172.21.15.2:0/2661186173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5604f96d0b40 msgr2=0x5604f96de850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:09.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.375+0000 7f1642d9d640 1 --2- 172.21.15.2:0/2661186173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5604f96d0b40 0x5604f96de850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:09.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.375+0000 7f1642d9d640 1 -- 172.21.15.2:0/2661186173 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604f9753e70 con 0x5604f96cf5d0 2024-09-19T06:22:09.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.375+0000 7f163bfff640 1 --2- 172.21.15.2:0/2661186173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5604f96d0b40 0x5604f96de850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:22:09.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.375+0000 7f1642d9d640 1 --2- 172.21.15.2:0/2661186173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604f96cf5d0 0x5604f96de310 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f163c005cc0 tx=0x7f163c009540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c998d59afb7f6f15 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:09.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.375+0000 7f1629ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:22:09.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.376+0000 7f1629ffb640 1 -- 172.21.15.2:0/2661186173 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c048040 con 0x5604f96cf5d0 2024-09-19T06:22:09.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.376+0000 7f1629ffb640 1 -- 172.21.15.2:0/2661186173 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8565+0+0 (secure 0 0 0) 0x7f163c02f5b0 con 0x5604f96cf5d0 2024-09-19T06:22:09.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.376+0000 7f164aea5740 1 -- 172.21.15.2:0/2661186173 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f162c00a2c0 con 0x5604f96cf5d0 2024-09-19T06:22:09.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.376+0000 7f1629ffb640 1 -- 172.21.15.2:0/2661186173 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f163c003970 con 0x5604f96cf5d0 2024-09-19T06:22:09.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.376+0000 7f164aea5740 10 client.17835 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:09.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.376+0000 7f164aea5740 1 -- 172.21.15.2:0/2661186173 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5604f9755130 con 0x5604f96cf5d0 2024-09-19T06:22:09.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.376+0000 7f1629ffb640 1 -- 172.21.15.2:0/2661186173 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f162c00a2c0 con 0x5604f96cf5d0 2024-09-19T06:22:09.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.376+0000 7f1629ffb640 1 -- 172.21.15.2:0/2661186173 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f163c060020 con 0x5604f96cf5d0 2024-09-19T06:22:09.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.376+0000 7f164aea5740 10 client.17835 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:09.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.376+0000 7f164aea5740 10 client.17835 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:09.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.376+0000 7f164aea5740 20 client.17835 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:09.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.376+0000 7f164aea5740 1 --2- 172.21.15.2:0/2661186173 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5604f96ea070 0x5604f9757420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:09.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.376+0000 7f164aea5740 4 client.17835 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:22:09.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.376+0000 7f164aea5740 1 -- 172.21.15.2:0/2661186173 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5604f963cd70 con 0x5604f96ea070 2024-09-19T06:22:09.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.377+0000 7f163bfff640 1 --2- 172.21.15.2:0/2661186173 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5604f96ea070 0x5604f9757420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:09.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.377+0000 7f163bfff640 1 --2- 172.21.15.2:0/2661186173 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5604f96ea070 0x5604f9757420 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc954275a42b0add server_cookie=ec7ddd45c4a04b4e in_seq=0 out_seq=0 2024-09-19T06:22:09.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.377+0000 7f1629ffb640 10 client.17835 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:09.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.377+0000 7f1629ffb640 1 -- 172.21.15.2:0/2661186173 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5604f963cd70 con 0x5604f96ea070 2024-09-19T06:22:09.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.377+0000 7f1629ffb640 10 client.17835 handle_command_reply: tid=0 2024-09-19T06:22:09.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.377+0000 7f164aea5740 1 client.17835 shutdown 2024-09-19T06:22:09.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.377+0000 7f164aea5740 1 -- 172.21.15.2:0/2661186173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604f96cf5d0 msgr2=0x5604f96de310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:09.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.377+0000 7f164aea5740 1 --2- 172.21.15.2:0/2661186173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604f96cf5d0 0x5604f96de310 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f163c005cc0 tx=0x7f163c009540 comp rx=0 tx=0).stop 2024-09-19T06:22:09.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.377+0000 7f164aea5740 1 -- 172.21.15.2:0/2661186173 shutdown_connections 2024-09-19T06:22:09.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.377+0000 7f164aea5740 1 --2- 172.21.15.2:0/2661186173 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5604f96da370 0x5604f96ded90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:09.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.377+0000 7f164aea5740 1 --2- 172.21.15.2:0/2661186173 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5604f96ea070 0x5604f9757420 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:09.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.377+0000 7f164aea5740 1 --2- 172.21.15.2:0/2661186173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5604f96d0b40 0x5604f96de850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:09.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.377+0000 7f164aea5740 1 --2- 172.21.15.2:0/2661186173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5604f96cf5d0 0x5604f96de310 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:09.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.377+0000 7f164aea5740 1 -- 172.21.15.2:0/2661186173 >> 172.21.15.2:0/2661186173 conn(0x5604f9698310 msgr2=0x5604f96d88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:09.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.377+0000 7f1629ffb640 0 client.17835 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:09.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.377+0000 7f164aea5740 1 -- 172.21.15.2:0/2661186173 shutdown_connections 2024-09-19T06:22:09.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.377+0000 7f164aea5740 1 -- 172.21.15.2:0/2661186173 wait complete. 2024-09-19T06:22:09.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.378+0000 7f164aea5740 20 client.17835 trim_cache size 0 max 16384 2024-09-19T06:22:09.385 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:22:09.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.378+0000 7f1648acc640 1 -- 172.21.15.2:0/1499166355 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f16300a3430 msgr2=0x7f16300a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:09.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.378+0000 7f1648acc640 1 --2- 172.21.15.2:0/1499166355 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f16300a3430 0x7f16300a58f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f16340cd0b0 tx=0x7f16340d5550 comp rx=0 tx=0).stop 2024-09-19T06:22:09.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.378+0000 7f1648acc640 1 -- 172.21.15.2:0/1499166355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1644102d40 msgr2=0x7f164419a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:09.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.378+0000 7f1648acc640 1 --2- 172.21.15.2:0/1499166355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1644102d40 0x7f164419a4d0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f163400c890 tx=0x7f163400cd50 comp rx=0 tx=0).stop 2024-09-19T06:22:09.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.378+0000 7f1648acc640 1 -- 172.21.15.2:0/1499166355 shutdown_connections 2024-09-19T06:22:09.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.378+0000 7f1648acc640 1 --2- 172.21.15.2:0/1499166355 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f16300a3430 0x7f16300a58f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:09.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.378+0000 7f1648acc640 1 --2- 172.21.15.2:0/1499166355 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f164410c170 0x7f164419eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:09.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.378+0000 7f1648acc640 1 --2- 172.21.15.2:0/1499166355 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1644103660 0x7f164419aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:09.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.378+0000 7f1648acc640 1 --2- 172.21.15.2:0/1499166355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1644102d40 0x7f164419a4d0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:09.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.378+0000 7f1648acc640 1 -- 172.21.15.2:0/1499166355 >> 172.21.15.2:0/1499166355 conn(0x7f16440fc7a0 msgr2=0x7f16440fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:09.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.378+0000 7f1648acc640 1 -- 172.21.15.2:0/1499166355 shutdown_connections 2024-09-19T06:22:09.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:09.378+0000 7f1648acc640 1 -- 172.21.15.2:0/1499166355 wait complete. 2024-09-19T06:22:09.660 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:09 smithi002 ceph-mon[30982]: pgmap v225: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-19T06:22:09.660 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:09 smithi002 ceph-mon[30982]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T06:22:09.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:09 smithi090 ceph-mon[34497]: pgmap v225: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-19T06:22:09.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:09 smithi090 ceph-mon[34497]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T06:22:09.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:09 smithi089 ceph-mon[34160]: pgmap v225: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-19T06:22:09.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:09 smithi089 ceph-mon[34160]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T06:22:11.054 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:22:11.054 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:22:11.324 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:22:11.689 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:11 smithi002 ceph-mon[30982]: pgmap v227: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-19T06:22:11.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:11 smithi090 ceph-mon[34497]: pgmap v227: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-19T06:22:11.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.774+0000 7f3fc9b4a640 1 -- 172.21.15.2:0/3844319233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fc4100a80 msgr2=0x7f3fc4100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:11.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.774+0000 7f3fc9b4a640 1 --2- 172.21.15.2:0/3844319233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fc4100a80 0x7f3fc4100ee0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8009930 tx=0x7f3fb802a420 comp rx=0 tx=0).stop 2024-09-19T06:22:11.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.774+0000 7f3fc9b4a640 1 -- 172.21.15.2:0/3844319233 shutdown_connections 2024-09-19T06:22:11.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.774+0000 7f3fc9b4a640 1 --2- 172.21.15.2:0/3844319233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fc4101420 0x7f3fc410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:11.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.774+0000 7f3fc9b4a640 1 --2- 172.21.15.2:0/3844319233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fc4100a80 0x7f3fc4100ee0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:11.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.774+0000 7f3fc9b4a640 1 --2- 172.21.15.2:0/3844319233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3fc4106a80 0x7f3fc4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:11.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.774+0000 7f3fc9b4a640 1 -- 172.21.15.2:0/3844319233 >> 172.21.15.2:0/3844319233 conn(0x7f3fc40fc7a0 msgr2=0x7f3fc40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:11.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.774+0000 7f3fc9b4a640 1 -- 172.21.15.2:0/3844319233 shutdown_connections 2024-09-19T06:22:11.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.774+0000 7f3fc9b4a640 1 -- 172.21.15.2:0/3844319233 wait complete. 2024-09-19T06:22:11.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.775+0000 7f3fc9b4a640 1 Processor -- start 2024-09-19T06:22:11.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.775+0000 7f3fc9b4a640 1 -- start start 2024-09-19T06:22:11.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.775+0000 7f3fc9b4a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fc4100a80 0x7f3fc41982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:11.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.775+0000 7f3fc9b4a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3fc4101420 0x7f3fc4198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:11.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.775+0000 7f3fc9b4a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fc4106a80 0x7f3fc419cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:11.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.776+0000 7f3fc9b4a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc4110cf0 con 0x7f3fc4106a80 2024-09-19T06:22:11.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.776+0000 7f3fc9b4a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc4110b70 con 0x7f3fc4100a80 2024-09-19T06:22:11.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.776+0000 7f3fc9b4a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc4110e70 con 0x7f3fc4101420 2024-09-19T06:22:11.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.776+0000 7f3fc3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fc4106a80 0x7f3fc419cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:11.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.776+0000 7f3fc37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fc4100a80 0x7f3fc41982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:11.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.776+0000 7f3fc3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fc4106a80 0x7f3fc419cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54920/0 (socket says 172.21.15.2:54920) 2024-09-19T06:22:11.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.776+0000 7f3fc3fff640 1 -- 172.21.15.2:0/3445131027 learned_addr learned my addr 172.21.15.2:0/3445131027 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:11.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.776+0000 7f3fc2ffd640 1 --2- 172.21.15.2:0/3445131027 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3fc4101420 0x7f3fc4198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:11.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.776+0000 7f3fc3fff640 1 -- 172.21.15.2:0/3445131027 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3fc4101420 msgr2=0x7f3fc4198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:11.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.776+0000 7f3fc3fff640 1 --2- 172.21.15.2:0/3445131027 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3fc4101420 0x7f3fc4198800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:11.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.776+0000 7f3fc3fff640 1 -- 172.21.15.2:0/3445131027 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fc4100a80 msgr2=0x7f3fc41982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:11.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.776+0000 7f3fc3fff640 1 --2- 172.21.15.2:0/3445131027 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fc4100a80 0x7f3fc41982c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:11.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.776+0000 7f3fc3fff640 1 -- 172.21.15.2:0/3445131027 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fc419d270 con 0x7f3fc4106a80 2024-09-19T06:22:11.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.776+0000 7f3fc2ffd640 1 --2- 172.21.15.2:0/3445131027 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3fc4101420 0x7f3fc4198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:11.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.776+0000 7f3fc3fff640 1 --2- 172.21.15.2:0/3445131027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fc4106a80 0x7f3fc419cb90 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00cad0 tx=0x7f3fbc00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:11.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.776+0000 7f3fc0ff9640 1 -- 172.21.15.2:0/3445131027 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc00ad60 con 0x7f3fc4106a80 2024-09-19T06:22:11.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.776+0000 7f3fc0ff9640 1 -- 172.21.15.2:0/3445131027 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3fbc005020 con 0x7f3fc4106a80 2024-09-19T06:22:11.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.776+0000 7f3fc0ff9640 1 -- 172.21.15.2:0/3445131027 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc00f6b0 con 0x7f3fc4106a80 2024-09-19T06:22:11.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.776+0000 7f3fc9b4a640 1 -- 172.21.15.2:0/3445131027 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fc419d560 con 0x7f3fc4106a80 2024-09-19T06:22:11.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.777+0000 7f3fc9b4a640 1 -- 172.21.15.2:0/3445131027 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fc41a4e40 con 0x7f3fc4106a80 2024-09-19T06:22:11.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.779+0000 7f3fc0ff9640 1 -- 172.21.15.2:0/3445131027 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f3fbc0051d0 con 0x7f3fc4106a80 2024-09-19T06:22:11.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.779+0000 7f3fcbf23740 1 Processor -- start 2024-09-19T06:22:11.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.779+0000 7f3fcbf23740 1 -- start start 2024-09-19T06:22:11.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.779+0000 7f3fcbf23740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5579b278cb60 0x5579b278cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:11.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.779+0000 7f3fcbf23740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5579b278d480 0x5579b2797800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:11.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.780+0000 7f3fcbf23740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579b2797d40 0x5579b279a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:11.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.780+0000 7f3fcbf23740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5579b26f2280 con 0x5579b2797d40 2024-09-19T06:22:11.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.780+0000 7f3fcbf23740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5579b2699b10 con 0x5579b278cb60 2024-09-19T06:22:11.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.780+0000 7f3fcbf23740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5579b26ee240 con 0x5579b278d480 2024-09-19T06:22:11.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.780+0000 7f3fc2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579b2797d40 0x5579b279a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:11.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.780+0000 7f3fc2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579b2797d40 0x5579b279a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54932/0 (socket says 172.21.15.2:54932) 2024-09-19T06:22:11.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.780+0000 7f3fc2ffd640 1 -- 172.21.15.2:0/2835899535 learned_addr learned my addr 172.21.15.2:0/2835899535 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:11.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.780+0000 7f3fc2ffd640 1 --2- 172.21.15.2:0/2835899535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5579b278cb60 0x5579b278cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:11.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.780+0000 7f3fc37fe640 1 --2- 172.21.15.2:0/2835899535 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5579b278d480 0x5579b2797800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:11.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.780+0000 7f3fc0ff9640 1 --2- 172.21.15.2:0/3445131027 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f3fac0a33b0 0x7f3fac0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:11.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.780+0000 7f3fc2ffd640 1 -- 172.21.15.2:0/2835899535 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5579b278d480 msgr2=0x5579b2797800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:11.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.780+0000 7f3fc2ffd640 1 --2- 172.21.15.2:0/2835899535 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5579b278d480 0x5579b2797800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:11.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.780+0000 7f3fc2ffd640 1 -- 172.21.15.2:0/2835899535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5579b278cb60 msgr2=0x5579b278cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:11.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.780+0000 7f3fc2ffd640 1 --2- 172.21.15.2:0/2835899535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5579b278cb60 0x5579b278cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:11.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.780+0000 7f3fc2ffd640 1 -- 172.21.15.2:0/2835899535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579b26a61f0 con 0x5579b2797d40 2024-09-19T06:22:11.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.780+0000 7f3fc3fff640 1 --2- 172.21.15.2:0/3445131027 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f3fac0a33b0 0x7f3fac0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:11.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.780+0000 7f3fc2ffd640 1 --2- 172.21.15.2:0/2835899535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579b2797d40 0x5579b279a130 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f3fb802a940 tx=0x7f3fb80058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=494f6d6255f0161f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:11.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.780+0000 7f3fc0ff9640 1 -- 172.21.15.2:0/3445131027 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8565+0+0 (secure 0 0 0) 0x7f3fbc0cfdf0 con 0x7f3fc4106a80 2024-09-19T06:22:11.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.781+0000 7f3fa9ffb640 1 -- 172.21.15.2:0/2835899535 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb8035040 con 0x5579b2797d40 2024-09-19T06:22:11.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.781+0000 7f3fa9ffb640 1 -- 172.21.15.2:0/2835899535 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3fb80318d0 con 0x5579b2797d40 2024-09-19T06:22:11.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.781+0000 7f3fa9ffb640 1 -- 172.21.15.2:0/2835899535 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb8004a00 con 0x5579b2797d40 2024-09-19T06:22:11.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.781+0000 7f3fcbf23740 1 -- 172.21.15.2:0/2835899535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579b2797d40 msgr2=0x5579b279a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:11.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.781+0000 7f3fc3fff640 1 --2- 172.21.15.2:0/3445131027 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f3fac0a33b0 0x7f3fac0a5870 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc0cd5c0 tx=0x7f3fbc098420 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:11.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.781+0000 7f3fcbf23740 1 --2- 172.21.15.2:0/2835899535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579b2797d40 0x5579b279a130 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f3fb802a940 tx=0x7f3fb80058b0 comp rx=0 tx=0).stop 2024-09-19T06:22:11.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.781+0000 7f3fcbf23740 1 -- 172.21.15.2:0/2835899535 shutdown_connections 2024-09-19T06:22:11.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.781+0000 7f3fcbf23740 1 --2- 172.21.15.2:0/2835899535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579b2797d40 0x5579b279a130 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:11.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.781+0000 7f3fcbf23740 1 --2- 172.21.15.2:0/2835899535 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5579b278d480 0x5579b2797800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:11.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.781+0000 7f3fcbf23740 1 --2- 172.21.15.2:0/2835899535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5579b278cb60 0x5579b278cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:11.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.781+0000 7f3fcbf23740 1 -- 172.21.15.2:0/2835899535 >> 172.21.15.2:0/2835899535 conn(0x5579b27890f0 msgr2=0x5579b27894d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:11.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.782+0000 7f3fcbf23740 1 -- 172.21.15.2:0/2835899535 shutdown_connections 2024-09-19T06:22:11.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.782+0000 7f3fcbf23740 1 -- 172.21.15.2:0/2835899535 wait complete. 2024-09-19T06:22:11.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.782+0000 7f3fcbf23740 1 -- start start 2024-09-19T06:22:11.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.782+0000 7f3fcbf23740 1 Processor -- start 2024-09-19T06:22:11.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.782+0000 7f3fcbf23740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5579b278cb60 0x5579b2794d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:11.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.782+0000 7f3fcbf23740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579b278d480 0x5579b2795240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:11.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.782+0000 7f3fcbf23740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5579b2797d40 0x5579b2795780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:11.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.782+0000 7f3fcbf23740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5579b279a910 con 0x5579b278d480 2024-09-19T06:22:11.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.782+0000 7f3fcbf23740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5579b26acf10 con 0x5579b2797d40 2024-09-19T06:22:11.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.782+0000 7f3fcbf23740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5579b279aa90 con 0x5579b278cb60 2024-09-19T06:22:11.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.783+0000 7f3fcbf23740 10 client.0 _ll_register_callbacks cb 0x5579b2675a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:11.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.783+0000 7f3fc37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579b278d480 0x5579b2795240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:11.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.783+0000 7f3fc37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579b278d480 0x5579b2795240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54942/0 (socket says 172.21.15.2:54942) 2024-09-19T06:22:11.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.783+0000 7f3fc37fe640 1 -- 172.21.15.2:0/1241819780 learned_addr learned my addr 172.21.15.2:0/1241819780 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:11.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.783+0000 7f3fc2ffd640 1 --2- 172.21.15.2:0/1241819780 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5579b278cb60 0x5579b2794d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:11.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.783+0000 7f3fc2ffd640 1 --2- 172.21.15.2:0/1241819780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5579b2797d40 0x5579b2795780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:11.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.783+0000 7f3fc37fe640 1 -- 172.21.15.2:0/1241819780 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5579b278cb60 msgr2=0x5579b2794d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:11.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.783+0000 7f3fc37fe640 1 --2- 172.21.15.2:0/1241819780 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5579b278cb60 0x5579b2794d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:11.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.783+0000 7f3fc37fe640 1 -- 172.21.15.2:0/1241819780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5579b2797d40 msgr2=0x5579b2795780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:11.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.783+0000 7f3fc37fe640 1 --2- 172.21.15.2:0/1241819780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5579b2797d40 0x5579b2795780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:11.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.783+0000 7f3fc37fe640 1 -- 172.21.15.2:0/1241819780 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579b24636a0 con 0x5579b278d480 2024-09-19T06:22:11.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.783+0000 7f3fc2ffd640 1 --2- 172.21.15.2:0/1241819780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5579b2797d40 0x5579b2795780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:11.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.783+0000 7f3fc37fe640 1 --2- 172.21.15.2:0/1241819780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579b278d480 0x5579b2795240 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4010a50 tx=0x7f3fb4010f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9b806db7ab7ad5a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:11.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.783+0000 7f3fa2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:22:11.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.783+0000 7f3fa2ffd640 1 -- 172.21.15.2:0/1241819780 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb401e060 con 0x5579b278d480 2024-09-19T06:22:11.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.783+0000 7f3fa2ffd640 1 -- 172.21.15.2:0/1241819780 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8565+0+0 (secure 0 0 0) 0x7f3fb400fbd0 con 0x5579b278d480 2024-09-19T06:22:11.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.783+0000 7f3fcbf23740 1 -- 172.21.15.2:0/1241819780 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3fb80318d0 con 0x5579b278d480 2024-09-19T06:22:11.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.784+0000 7f3fa2ffd640 1 -- 172.21.15.2:0/1241819780 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3fb400fdd0 con 0x5579b278d480 2024-09-19T06:22:11.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.784+0000 7f3fcbf23740 10 client.17847 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:11.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.784+0000 7f3fcbf23740 1 -- 172.21.15.2:0/1241819780 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5579b27aaa60 con 0x5579b278d480 2024-09-19T06:22:11.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.784+0000 7f3fa2ffd640 1 -- 172.21.15.2:0/1241819780 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3fb80318d0 con 0x5579b278d480 2024-09-19T06:22:11.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.784+0000 7f3fa2ffd640 1 -- 172.21.15.2:0/1241819780 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f3fb400e570 con 0x5579b278d480 2024-09-19T06:22:11.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.784+0000 7f3fcbf23740 10 client.17847 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:11.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.784+0000 7f3fcbf23740 10 client.17847 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:11.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.784+0000 7f3fcbf23740 20 client.17847 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:11.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.784+0000 7f3fcbf23740 1 --2- 172.21.15.2:0/1241819780 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5579b27abf70 0x5579b27ae3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:11.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.784+0000 7f3fcbf23740 4 client.17847 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:22:11.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.784+0000 7f3fcbf23740 1 -- 172.21.15.2:0/1241819780 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5579b26ff7f0 con 0x5579b27abf70 2024-09-19T06:22:11.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.784+0000 7f3fc2ffd640 1 --2- 172.21.15.2:0/1241819780 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5579b27abf70 0x5579b27ae3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:11.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.785+0000 7f3fa2ffd640 10 client.17847 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:11.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.785+0000 7f3fc2ffd640 1 --2- 172.21.15.2:0/1241819780 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5579b27abf70 0x5579b27ae3b0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebdf988319b0e2f3 server_cookie=caadb9d27c51cebc in_seq=0 out_seq=0 2024-09-19T06:22:11.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.786+0000 7f3fa2ffd640 1 -- 172.21.15.2:0/1241819780 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5579b26ff7f0 con 0x5579b27abf70 2024-09-19T06:22:11.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.786+0000 7f3fa2ffd640 10 client.17847 handle_command_reply: tid=0 2024-09-19T06:22:11.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.786+0000 7f3fcbf23740 1 client.17847 shutdown 2024-09-19T06:22:11.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.786+0000 7f3fcbf23740 1 -- 172.21.15.2:0/1241819780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579b278d480 msgr2=0x5579b2795240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:11.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.786+0000 7f3fcbf23740 1 --2- 172.21.15.2:0/1241819780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579b278d480 0x5579b2795240 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4010a50 tx=0x7f3fb4010f10 comp rx=0 tx=0).stop 2024-09-19T06:22:11.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.786+0000 7f3fcbf23740 1 -- 172.21.15.2:0/1241819780 shutdown_connections 2024-09-19T06:22:11.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.786+0000 7f3fcbf23740 1 --2- 172.21.15.2:0/1241819780 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5579b27abf70 0x5579b27ae3b0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:11.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.786+0000 7f3fcbf23740 1 --2- 172.21.15.2:0/1241819780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5579b2797d40 0x5579b2795780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:11.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.786+0000 7f3fcbf23740 1 --2- 172.21.15.2:0/1241819780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579b278d480 0x5579b2795240 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:11.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.786+0000 7f3fcbf23740 1 --2- 172.21.15.2:0/1241819780 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5579b278cb60 0x5579b2794d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:11.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.786+0000 7f3fa2ffd640 0 client.17847 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:11.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.786+0000 7f3fcbf23740 1 -- 172.21.15.2:0/1241819780 >> 172.21.15.2:0/1241819780 conn(0x5579b27890f0 msgr2=0x5579b278ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:11.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.786+0000 7f3fcbf23740 1 -- 172.21.15.2:0/1241819780 shutdown_connections 2024-09-19T06:22:11.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.786+0000 7f3fcbf23740 1 -- 172.21.15.2:0/1241819780 wait complete. 2024-09-19T06:22:11.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.786+0000 7f3fcbf23740 20 client.17847 trim_cache size 0 max 16384 2024-09-19T06:22:11.794 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:11 smithi089 ceph-mon[34160]: pgmap v227: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-19T06:22:11.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.803+0000 7f3fcbf23740 1 Processor -- start 2024-09-19T06:22:11.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.803+0000 7f3fcbf23740 1 -- start start 2024-09-19T06:22:11.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.804+0000 7f3fcbf23740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5579b278cb60 0x5579b2793bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:11.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.804+0000 7f3fcbf23740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579b278d480 0x5579b27b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:11.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.804+0000 7f3fcbf23740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5579b2797d40 0x5579b27b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:11.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.804+0000 7f3fcbf23740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc41adec0 con 0x5579b278d480 2024-09-19T06:22:11.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.804+0000 7f3fcbf23740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc41ab790 con 0x5579b2797d40 2024-09-19T06:22:11.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.804+0000 7f3fcbf23740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc41a9600 con 0x5579b278cb60 2024-09-19T06:22:11.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.804+0000 7f3fc37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579b278d480 0x5579b27b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:11.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.804+0000 7f3fc37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579b278d480 0x5579b27b3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54944/0 (socket says 172.21.15.2:54944) 2024-09-19T06:22:11.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.804+0000 7f3fc37fe640 1 -- 172.21.15.2:0/1049804417 learned_addr learned my addr 172.21.15.2:0/1049804417 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:11.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.804+0000 7f3fc2ffd640 1 --2- 172.21.15.2:0/1049804417 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5579b278cb60 0x5579b2793bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:11.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.804+0000 7f3fc2ffd640 1 --2- 172.21.15.2:0/1049804417 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5579b2797d40 0x5579b27b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:11.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.804+0000 7f3fc37fe640 1 -- 172.21.15.2:0/1049804417 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5579b278cb60 msgr2=0x5579b2793bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:11.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.804+0000 7f3fc37fe640 1 --2- 172.21.15.2:0/1049804417 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5579b278cb60 0x5579b2793bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:11.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.804+0000 7f3fc37fe640 1 -- 172.21.15.2:0/1049804417 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5579b2797d40 msgr2=0x5579b27b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:11.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.804+0000 7f3fc37fe640 1 --2- 172.21.15.2:0/1049804417 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5579b2797d40 0x5579b27b41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:11.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.804+0000 7f3fc37fe640 1 -- 172.21.15.2:0/1049804417 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579b27972e0 con 0x5579b278d480 2024-09-19T06:22:11.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.804+0000 7f3fc37fe640 1 --2- 172.21.15.2:0/1049804417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579b278d480 0x5579b27b3c80 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f3fb400f010 tx=0x7f3fb400fd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c53247a1bb44e27 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:11.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.804+0000 7f3fa97fa640 1 -- 172.21.15.2:0/1049804417 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4030070 con 0x5579b278d480 2024-09-19T06:22:11.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.805+0000 7f3fa97fa640 1 -- 172.21.15.2:0/1049804417 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3fb400a340 con 0x5579b278d480 2024-09-19T06:22:11.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.805+0000 7f3fa97fa640 1 -- 172.21.15.2:0/1049804417 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb402b940 con 0x5579b278d480 2024-09-19T06:22:11.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.805+0000 7f3fcbf23740 1 -- 172.21.15.2:0/1049804417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579b278d480 msgr2=0x5579b27b3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:11.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.805+0000 7f3fcbf23740 1 --2- 172.21.15.2:0/1049804417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579b278d480 0x5579b27b3c80 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f3fb400f010 tx=0x7f3fb400fd60 comp rx=0 tx=0).stop 2024-09-19T06:22:11.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.805+0000 7f3fcbf23740 1 -- 172.21.15.2:0/1049804417 shutdown_connections 2024-09-19T06:22:11.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.805+0000 7f3fcbf23740 1 --2- 172.21.15.2:0/1049804417 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5579b2797d40 0x5579b27b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:11.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.805+0000 7f3fcbf23740 1 --2- 172.21.15.2:0/1049804417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579b278d480 0x5579b27b3c80 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:11.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.805+0000 7f3fcbf23740 1 --2- 172.21.15.2:0/1049804417 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5579b278cb60 0x5579b2793bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:11.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.805+0000 7f3fcbf23740 1 -- 172.21.15.2:0/1049804417 >> 172.21.15.2:0/1049804417 conn(0x5579b27890f0 msgr2=0x5579b27934a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:11.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.805+0000 7f3fcbf23740 1 -- 172.21.15.2:0/1049804417 shutdown_connections 2024-09-19T06:22:11.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.805+0000 7f3fcbf23740 1 -- 172.21.15.2:0/1049804417 wait complete. 2024-09-19T06:22:11.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.806+0000 7f3fcbf23740 1 -- start start 2024-09-19T06:22:11.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.806+0000 7f3fcbf23740 1 Processor -- start 2024-09-19T06:22:11.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.806+0000 7f3fcbf23740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5579b278cb60 0x5579b27a4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:11.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.806+0000 7f3fcbf23740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5579b278d480 0x5579b27a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:11.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.806+0000 7f3fcbf23740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579b2797d40 0x5579b27a1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:11.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.806+0000 7f3fcbf23740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc41a9c50 con 0x5579b2797d40 2024-09-19T06:22:11.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.806+0000 7f3fcbf23740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc41ab0c0 con 0x5579b278d480 2024-09-19T06:22:11.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.806+0000 7f3fcbf23740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc41aa320 con 0x5579b278cb60 2024-09-19T06:22:11.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.806+0000 7f3fcbf23740 10 client.0 _ll_register_callbacks cb 0x7f3fb400a740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:11.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.806+0000 7f3fc2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579b2797d40 0x5579b27a1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:11.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.806+0000 7f3fc2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579b2797d40 0x5579b27a1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54950/0 (socket says 172.21.15.2:54950) 2024-09-19T06:22:11.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.806+0000 7f3fc2ffd640 1 -- 172.21.15.2:0/3974976640 learned_addr learned my addr 172.21.15.2:0/3974976640 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:11.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.806+0000 7f3fc2ffd640 1 --2- 172.21.15.2:0/3974976640 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5579b278cb60 0x5579b27a4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:11.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.807+0000 7f3fc37fe640 1 --2- 172.21.15.2:0/3974976640 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5579b278d480 0x5579b27a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:11.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.807+0000 7f3fc2ffd640 1 -- 172.21.15.2:0/3974976640 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5579b278cb60 msgr2=0x5579b27a4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:11.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.807+0000 7f3fc2ffd640 1 --2- 172.21.15.2:0/3974976640 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5579b278cb60 0x5579b27a4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:11.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.807+0000 7f3fc2ffd640 1 -- 172.21.15.2:0/3974976640 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5579b278d480 msgr2=0x5579b27a46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:11.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.807+0000 7f3fc2ffd640 1 --2- 172.21.15.2:0/3974976640 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5579b278d480 0x5579b27a46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:11.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.807+0000 7f3fc2ffd640 1 -- 172.21.15.2:0/3974976640 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579b27a4da0 con 0x5579b2797d40 2024-09-19T06:22:11.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.807+0000 7f3fc37fe640 1 --2- 172.21.15.2:0/3974976640 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5579b278d480 0x5579b27a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:11.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.807+0000 7f3fc2ffd640 1 --2- 172.21.15.2:0/3974976640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579b2797d40 0x5579b27a1140 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8033000 tx=0x7f3fb400ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=869fddbeb8b0ea33 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:11.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.807+0000 7f3fa2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:22:11.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.807+0000 7f3fa2ffd640 1 -- 172.21.15.2:0/3974976640 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb8035040 con 0x5579b2797d40 2024-09-19T06:22:11.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.807+0000 7f3fa2ffd640 1 -- 172.21.15.2:0/3974976640 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8565+0+0 (secure 0 0 0) 0x7f3fb8005020 con 0x5579b2797d40 2024-09-19T06:22:11.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.807+0000 7f3fcbf23740 1 -- 172.21.15.2:0/3974976640 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3fb400a340 con 0x5579b2797d40 2024-09-19T06:22:11.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.807+0000 7f3fa2ffd640 1 -- 172.21.15.2:0/3974976640 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3fb8005220 con 0x5579b2797d40 2024-09-19T06:22:11.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.807+0000 7f3fcbf23740 10 client.17853 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:11.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.807+0000 7f3fcbf23740 1 -- 172.21.15.2:0/3974976640 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5579b28172a0 con 0x5579b2797d40 2024-09-19T06:22:11.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.807+0000 7f3fa2ffd640 1 -- 172.21.15.2:0/3974976640 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3fb805d020 con 0x5579b2797d40 2024-09-19T06:22:11.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.808+0000 7f3fa2ffd640 1 -- 172.21.15.2:0/3974976640 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f3fb803a040 con 0x5579b2797d40 2024-09-19T06:22:11.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.808+0000 7f3fcbf23740 10 client.17853 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:11.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.808+0000 7f3fcbf23740 10 client.17853 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:11.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.808+0000 7f3fcbf23740 20 client.17853 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:11.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.808+0000 7f3fcbf23740 1 --2- 172.21.15.2:0/3974976640 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5579b2817580 0x5579b2819970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:11.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.808+0000 7f3fcbf23740 4 client.17853 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:22:11.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.808+0000 7f3fcbf23740 1 -- 172.21.15.2:0/3974976640 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5579b26f9d00 con 0x5579b2817580 2024-09-19T06:22:11.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.808+0000 7f3fc37fe640 1 --2- 172.21.15.2:0/3974976640 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5579b2817580 0x5579b2819970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:11.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.808+0000 7f3fc37fe640 1 --2- 172.21.15.2:0/3974976640 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5579b2817580 0x5579b2819970 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5b2fb943c7cd00f server_cookie=4850f31cd3cf2c83 in_seq=0 out_seq=0 2024-09-19T06:22:11.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.808+0000 7f3fa2ffd640 10 client.17853 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:11.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.810+0000 7f3fa2ffd640 1 -- 172.21.15.2:0/3974976640 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5579b26f9d00 con 0x5579b2817580 2024-09-19T06:22:11.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.810+0000 7f3fa2ffd640 10 client.17853 handle_command_reply: tid=0 2024-09-19T06:22:11.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.810+0000 7f3fcbf23740 1 client.17853 shutdown 2024-09-19T06:22:11.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.810+0000 7f3fcbf23740 1 -- 172.21.15.2:0/3974976640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579b2797d40 msgr2=0x5579b27a1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:11.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.810+0000 7f3fcbf23740 1 --2- 172.21.15.2:0/3974976640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579b2797d40 0x5579b27a1140 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8033000 tx=0x7f3fb400ada0 comp rx=0 tx=0).stop 2024-09-19T06:22:11.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.810+0000 7f3fcbf23740 1 -- 172.21.15.2:0/3974976640 shutdown_connections 2024-09-19T06:22:11.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.810+0000 7f3fcbf23740 1 --2- 172.21.15.2:0/3974976640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5579b2797d40 0x5579b27a1140 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:11.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.810+0000 7f3fcbf23740 1 --2- 172.21.15.2:0/3974976640 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5579b2817580 0x5579b2819970 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:11.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.810+0000 7f3fa2ffd640 0 client.17853 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:11.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.810+0000 7f3fcbf23740 1 --2- 172.21.15.2:0/3974976640 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5579b278d480 0x5579b27a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:11.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.810+0000 7f3fcbf23740 1 --2- 172.21.15.2:0/3974976640 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5579b278cb60 0x5579b27a4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:11.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.810+0000 7f3fcbf23740 1 -- 172.21.15.2:0/3974976640 >> 172.21.15.2:0/3974976640 conn(0x5579b27890f0 msgr2=0x5579b2788270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:11.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.810+0000 7f3fcbf23740 1 -- 172.21.15.2:0/3974976640 shutdown_connections 2024-09-19T06:22:11.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.810+0000 7f3fcbf23740 1 -- 172.21.15.2:0/3974976640 wait complete. 2024-09-19T06:22:11.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.810+0000 7f3fcbf23740 20 client.17853 trim_cache size 0 max 16384 2024-09-19T06:22:11.818 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:22:11.818 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T06:22:11.818 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "09ff832b-94e4-4a68-87b3-b706fd166f6d", 2024-09-19T06:22:11.818 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T06:22:11.818 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:22:11.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.811+0000 7f3fc9b4a640 1 -- 172.21.15.2:0/3445131027 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f3fac0a33b0 msgr2=0x7f3fac0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:11.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.811+0000 7f3fc9b4a640 1 --2- 172.21.15.2:0/3445131027 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f3fac0a33b0 0x7f3fac0a5870 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc0cd5c0 tx=0x7f3fbc098420 comp rx=0 tx=0).stop 2024-09-19T06:22:11.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.811+0000 7f3fc9b4a640 1 -- 172.21.15.2:0/3445131027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fc4106a80 msgr2=0x7f3fc419cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:11.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.811+0000 7f3fc9b4a640 1 --2- 172.21.15.2:0/3445131027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fc4106a80 0x7f3fc419cb90 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00cad0 tx=0x7f3fbc00ced0 comp rx=0 tx=0).stop 2024-09-19T06:22:11.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.811+0000 7f3fc9b4a640 1 -- 172.21.15.2:0/3445131027 shutdown_connections 2024-09-19T06:22:11.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.811+0000 7f3fc9b4a640 1 --2- 172.21.15.2:0/3445131027 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f3fac0a33b0 0x7f3fac0a5870 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:11.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.811+0000 7f3fc9b4a640 1 --2- 172.21.15.2:0/3445131027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fc4106a80 0x7f3fc419cb90 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:11.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.811+0000 7f3fc9b4a640 1 --2- 172.21.15.2:0/3445131027 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3fc4101420 0x7f3fc4198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:11.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.811+0000 7f3fc9b4a640 1 --2- 172.21.15.2:0/3445131027 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fc4100a80 0x7f3fc41982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:11.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.811+0000 7f3fc9b4a640 1 -- 172.21.15.2:0/3445131027 >> 172.21.15.2:0/3445131027 conn(0x7f3fc40fc7a0 msgr2=0x7f3fc406aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:11.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.811+0000 7f3fc9b4a640 1 -- 172.21.15.2:0/3445131027 shutdown_connections 2024-09-19T06:22:11.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:11.811+0000 7f3fc9b4a640 1 -- 172.21.15.2:0/3445131027 wait complete. 2024-09-19T06:22:12.415 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:22:12.671 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:22:12.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:12 smithi002 ceph-mon[30982]: scrub queued for path: / 2024-09-19T06:22:12.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:12 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:22:12.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:12 smithi002 ceph-mon[30982]: scrub summary: active paths [/] 2024-09-19T06:22:12.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:12 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:22:12.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:12 smithi090 ceph-mon[34497]: scrub queued for path: / 2024-09-19T06:22:12.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:12 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:22:12.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:12 smithi090 ceph-mon[34497]: scrub summary: active paths [/] 2024-09-19T06:22:12.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:12 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:22:12.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:12 smithi089 ceph-mon[34160]: scrub queued for path: / 2024-09-19T06:22:12.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:12 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:22:12.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:12 smithi089 ceph-mon[34160]: scrub summary: active paths [/] 2024-09-19T06:22:12.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:12 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:22:13.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.128+0000 7f9b8c1c6640 1 -- 172.21.15.2:0/983896565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b841027c0 msgr2=0x7f9b84106810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:13.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.128+0000 7f9b8c1c6640 1 --2- 172.21.15.2:0/983896565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b841027c0 0x7f9b84106810 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f9b74009900 tx=0x7f9b7402a410 comp rx=0 tx=0).stop 2024-09-19T06:22:13.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.128+0000 7f9b8c1c6640 1 -- 172.21.15.2:0/983896565 shutdown_connections 2024-09-19T06:22:13.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.128+0000 7f9b8c1c6640 1 --2- 172.21.15.2:0/983896565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b84106f40 0x7f9b8410eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:13.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.128+0000 7f9b8c1c6640 1 --2- 172.21.15.2:0/983896565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b841027c0 0x7f9b84106810 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:13.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.128+0000 7f9b8c1c6640 1 --2- 172.21.15.2:0/983896565 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b84101e10 0x7f9b841021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:13.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.128+0000 7f9b8c1c6640 1 -- 172.21.15.2:0/983896565 >> 172.21.15.2:0/983896565 conn(0x7f9b840fd8d0 msgr2=0x7f9b840ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:13.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.129+0000 7f9b8c1c6640 1 -- 172.21.15.2:0/983896565 shutdown_connections 2024-09-19T06:22:13.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.129+0000 7f9b8c1c6640 1 -- 172.21.15.2:0/983896565 wait complete. 2024-09-19T06:22:13.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.129+0000 7f9b8c1c6640 1 Processor -- start 2024-09-19T06:22:13.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.129+0000 7f9b8c1c6640 1 -- start start 2024-09-19T06:22:13.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.129+0000 7f9b8c1c6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b84101e10 0x7f9b84198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:13.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.129+0000 7f9b8c1c6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b841027c0 0x7f9b84198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:13.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.129+0000 7f9b8c1c6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b84106f40 0x7f9b8419cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:13.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.129+0000 7f9b8c1c6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9b84111ef0 con 0x7f9b84106f40 2024-09-19T06:22:13.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.129+0000 7f9b8c1c6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9b84111d70 con 0x7f9b84101e10 2024-09-19T06:22:13.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.129+0000 7f9b8c1c6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9b84112070 con 0x7f9b841027c0 2024-09-19T06:22:13.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.130+0000 7f9b8a763640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b84106f40 0x7f9b8419cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:13.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.130+0000 7f9b8a763640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b84106f40 0x7f9b8419cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54976/0 (socket says 172.21.15.2:54976) 2024-09-19T06:22:13.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.130+0000 7f9b8a763640 1 -- 172.21.15.2:0/3798551350 learned_addr learned my addr 172.21.15.2:0/3798551350 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:13.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.130+0000 7f9b89f62640 1 --2- 172.21.15.2:0/3798551350 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b84101e10 0x7f9b84198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:13.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.130+0000 7f9b89761640 1 --2- 172.21.15.2:0/3798551350 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b841027c0 0x7f9b84198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:13.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.130+0000 7f9b8a763640 1 -- 172.21.15.2:0/3798551350 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b841027c0 msgr2=0x7f9b84198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:13.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.130+0000 7f9b8a763640 1 --2- 172.21.15.2:0/3798551350 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b841027c0 0x7f9b84198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:13.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.130+0000 7f9b8a763640 1 -- 172.21.15.2:0/3798551350 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b84101e10 msgr2=0x7f9b84198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:13.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.130+0000 7f9b8a763640 1 --2- 172.21.15.2:0/3798551350 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b84101e10 0x7f9b84198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:13.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.130+0000 7f9b8a763640 1 -- 172.21.15.2:0/3798551350 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b8419d4c0 con 0x7f9b84106f40 2024-09-19T06:22:13.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.130+0000 7f9b89761640 1 --2- 172.21.15.2:0/3798551350 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b841027c0 0x7f9b84198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:22:13.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.130+0000 7f9b8a763640 1 --2- 172.21.15.2:0/3798551350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b84106f40 0x7f9b8419cde0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c00b970 tx=0x7f9b7c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:13.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.130+0000 7f9b7affd640 1 -- 172.21.15.2:0/3798551350 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c019070 con 0x7f9b84106f40 2024-09-19T06:22:13.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.130+0000 7f9b7affd640 1 -- 172.21.15.2:0/3798551350 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9b7c014440 con 0x7f9b84106f40 2024-09-19T06:22:13.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.130+0000 7f9b8c1c6640 1 -- 172.21.15.2:0/3798551350 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b8419d7b0 con 0x7f9b84106f40 2024-09-19T06:22:13.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.130+0000 7f9b7affd640 1 -- 172.21.15.2:0/3798551350 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c0075d0 con 0x7f9b84106f40 2024-09-19T06:22:13.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.130+0000 7f9b8c1c6640 1 -- 172.21.15.2:0/3798551350 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b841a5090 con 0x7f9b84106f40 2024-09-19T06:22:13.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.133+0000 7f9b7affd640 1 -- 172.21.15.2:0/3798551350 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f9b7c01c070 con 0x7f9b84106f40 2024-09-19T06:22:13.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.133+0000 7f9b8e59f740 1 Processor -- start 2024-09-19T06:22:13.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.133+0000 7f9b8e59f740 1 -- start start 2024-09-19T06:22:13.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.133+0000 7f9b8e59f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625b1a9b380 0x5625b1a9b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:13.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.133+0000 7f9b8e59f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5625b1a9bca0 0x5625b1aaa550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:13.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.133+0000 7f9b8e59f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625b1aaaa90 0x5625b1aace80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:13.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.133+0000 7f9b8e59f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5625b1a012e0 con 0x5625b1a9b380 2024-09-19T06:22:13.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.133+0000 7f9b8e59f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5625b19a8ce0 con 0x5625b1a9bca0 2024-09-19T06:22:13.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.133+0000 7f9b8e59f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5625b19fd2a0 con 0x5625b1aaaa90 2024-09-19T06:22:13.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.134+0000 7f9b89761640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625b1a9b380 0x5625b1a9b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:13.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.134+0000 7f9b89761640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625b1a9b380 0x5625b1a9b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54992/0 (socket says 172.21.15.2:54992) 2024-09-19T06:22:13.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.134+0000 7f9b89f62640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5625b1a9bca0 0x5625b1aaa550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:13.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.134+0000 7f9b89761640 1 -- 172.21.15.2:0/4004766617 learned_addr learned my addr 172.21.15.2:0/4004766617 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:13.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.134+0000 7f9b7affd640 1 --2- 172.21.15.2:0/3798551350 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9b700a3430 0x7f9b700a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:13.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.134+0000 7f9b8a763640 1 --2- 172.21.15.2:0/3798551350 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9b700a3430 0x7f9b700a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:13.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.134+0000 7f9b89f62640 1 -- 172.21.15.2:0/4004766617 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625b1aaaa90 msgr2=0x5625b1aace80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:13.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.134+0000 7f9b89761640 1 --2- 172.21.15.2:0/4004766617 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625b1aaaa90 0x5625b1aace80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:13.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.134+0000 7f9b89f62640 1 --2- 172.21.15.2:0/4004766617 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625b1aaaa90 0x5625b1aace80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:13.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.134+0000 7f9b89f62640 1 -- 172.21.15.2:0/4004766617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625b1a9b380 msgr2=0x5625b1a9b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:13.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.134+0000 7f9b89f62640 1 --2- 172.21.15.2:0/4004766617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625b1a9b380 0x5625b1a9b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:13.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.134+0000 7f9b89f62640 1 -- 172.21.15.2:0/4004766617 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625b198d440 con 0x5625b1a9bca0 2024-09-19T06:22:13.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.134+0000 7f9b89761640 1 --2- 172.21.15.2:0/4004766617 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625b1aaaa90 0x5625b1aace80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:22:13.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.134+0000 7f9b7affd640 1 -- 172.21.15.2:0/3798551350 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8565+0+0 (secure 0 0 0) 0x7f9b7c0cf180 con 0x7f9b84106f40 2024-09-19T06:22:13.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.134+0000 7f9b89f62640 1 --2- 172.21.15.2:0/4004766617 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5625b1a9bca0 0x5625b1aaa550 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9b800099a0 tx=0x7f9b80009e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd78be08ce28fd44 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:13.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.134+0000 7f9b6ffff640 1 -- 172.21.15.2:0/4004766617 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b80017070 con 0x5625b1a9bca0 2024-09-19T06:22:13.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.134+0000 7f9b8a763640 1 --2- 172.21.15.2:0/3798551350 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9b700a3430 0x7f9b700a58f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c0cca60 tx=0x7f9b7c06b160 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:13.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.134+0000 7f9b6ffff640 1 -- 172.21.15.2:0/4004766617 <== mon.2 v2:172.21.15.89:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9b80013470 con 0x5625b1a9bca0 2024-09-19T06:22:13.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.134+0000 7f9b6ffff640 1 -- 172.21.15.2:0/4004766617 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b80012630 con 0x5625b1a9bca0 2024-09-19T06:22:13.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.135+0000 7f9b8e59f740 1 -- 172.21.15.2:0/4004766617 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5625b1a9bca0 msgr2=0x5625b1aaa550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:13.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.135+0000 7f9b8e59f740 1 --2- 172.21.15.2:0/4004766617 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5625b1a9bca0 0x5625b1aaa550 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9b800099a0 tx=0x7f9b80009e60 comp rx=0 tx=0).stop 2024-09-19T06:22:13.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.135+0000 7f9b8e59f740 1 -- 172.21.15.2:0/4004766617 shutdown_connections 2024-09-19T06:22:13.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.135+0000 7f9b8e59f740 1 --2- 172.21.15.2:0/4004766617 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625b1aaaa90 0x5625b1aace80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:13.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.135+0000 7f9b8e59f740 1 --2- 172.21.15.2:0/4004766617 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5625b1a9bca0 0x5625b1aaa550 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:13.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.135+0000 7f9b8e59f740 1 --2- 172.21.15.2:0/4004766617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625b1a9b380 0x5625b1a9b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:13.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.135+0000 7f9b8e59f740 1 -- 172.21.15.2:0/4004766617 >> 172.21.15.2:0/4004766617 conn(0x5625b1a97a30 msgr2=0x5625b1a97e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:13.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.135+0000 7f9b8e59f740 1 -- 172.21.15.2:0/4004766617 shutdown_connections 2024-09-19T06:22:13.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.135+0000 7f9b8e59f740 1 -- 172.21.15.2:0/4004766617 wait complete. 2024-09-19T06:22:13.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.136+0000 7f9b8e59f740 1 -- start start 2024-09-19T06:22:13.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.136+0000 7f9b8e59f740 1 Processor -- start 2024-09-19T06:22:13.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.136+0000 7f9b8e59f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5625b1a9b380 0x5625b1aaa360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:13.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.136+0000 7f9b8e59f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625b1a9bca0 0x5625b1aa7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:13.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.136+0000 7f9b8e59f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625b1aaaa90 0x5625b1aa7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:13.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.136+0000 7f9b8e59f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5625b1aad660 con 0x5625b1a9bca0 2024-09-19T06:22:13.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.136+0000 7f9b8e59f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5625b19bc050 con 0x5625b1a9b380 2024-09-19T06:22:13.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.136+0000 7f9b8e59f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5625b1aad7e0 con 0x5625b1aaaa90 2024-09-19T06:22:13.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.136+0000 7f9b8e59f740 10 client.0 _ll_register_callbacks cb 0x5625b19fc160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:13.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.136+0000 7f9b89f62640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625b1a9bca0 0x5625b1aa7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:13.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.136+0000 7f9b89f62640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625b1a9bca0 0x5625b1aa7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55006/0 (socket says 172.21.15.2:55006) 2024-09-19T06:22:13.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.136+0000 7f9b89f62640 1 -- 172.21.15.2:0/60258829 learned_addr learned my addr 172.21.15.2:0/60258829 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:13.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.136+0000 7f9b89761640 1 --2- 172.21.15.2:0/60258829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5625b1a9b380 0x5625b1aaa360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:13.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.137+0000 7f9b89761640 1 --2- 172.21.15.2:0/60258829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625b1aaaa90 0x5625b1aa7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:13.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.137+0000 7f9b89f62640 1 -- 172.21.15.2:0/60258829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625b1aaaa90 msgr2=0x5625b1aa7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:13.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.137+0000 7f9b89f62640 1 --2- 172.21.15.2:0/60258829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625b1aaaa90 0x5625b1aa7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:13.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.137+0000 7f9b89f62640 1 -- 172.21.15.2:0/60258829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5625b1a9b380 msgr2=0x5625b1aaa360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:13.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.137+0000 7f9b89f62640 1 --2- 172.21.15.2:0/60258829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5625b1a9b380 0x5625b1aaa360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:13.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.137+0000 7f9b89f62640 1 -- 172.21.15.2:0/60258829 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625b17723c0 con 0x5625b1a9bca0 2024-09-19T06:22:13.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.137+0000 7f9b89761640 1 --2- 172.21.15.2:0/60258829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5625b1a9b380 0x5625b1aaa360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:13.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.137+0000 7f9b89f62640 1 --2- 172.21.15.2:0/60258829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625b1a9bca0 0x5625b1aa7610 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f9b80006aa0 tx=0x7f9b80006ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c95a7ade010a7d33 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:13.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.137+0000 7f9b6d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:22:13.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.137+0000 7f9b6d7fa640 1 -- 172.21.15.2:0/60258829 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b80017050 con 0x5625b1a9bca0 2024-09-19T06:22:13.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.137+0000 7f9b8e59f740 1 -- 172.21.15.2:0/60258829 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b80013470 con 0x5625b1a9bca0 2024-09-19T06:22:13.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.137+0000 7f9b6d7fa640 1 -- 172.21.15.2:0/60258829 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8565+0+0 (secure 0 0 0) 0x7f9b8001c450 con 0x5625b1a9bca0 2024-09-19T06:22:13.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.137+0000 7f9b6d7fa640 1 -- 172.21.15.2:0/60258829 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9b8001c650 con 0x5625b1a9bca0 2024-09-19T06:22:13.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.137+0000 7f9b8e59f740 10 client.17865 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:13.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.137+0000 7f9b8e59f740 1 -- 172.21.15.2:0/60258829 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5625b1ab8f60 con 0x5625b1a9bca0 2024-09-19T06:22:13.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.138+0000 7f9b6d7fa640 1 -- 172.21.15.2:0/60258829 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9b80013470 con 0x5625b1a9bca0 2024-09-19T06:22:13.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.138+0000 7f9b6d7fa640 1 -- 172.21.15.2:0/60258829 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f9b8002d070 con 0x5625b1a9bca0 2024-09-19T06:22:13.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.138+0000 7f9b8e59f740 10 client.17865 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:13.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.138+0000 7f9b8e59f740 10 client.17865 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:13.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.138+0000 7f9b8e59f740 20 client.17865 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:13.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.138+0000 7f9b8e59f740 1 --2- 172.21.15.2:0/60258829 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5625b1aba420 0x5625b1abc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:13.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.138+0000 7f9b8e59f740 4 client.17865 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:22:13.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.138+0000 7f9b8e59f740 1 -- 172.21.15.2:0/60258829 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5625b1a0e850 con 0x5625b1aba420 2024-09-19T06:22:13.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.138+0000 7f9b89761640 1 --2- 172.21.15.2:0/60258829 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5625b1aba420 0x5625b1abc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:13.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.139+0000 7f9b89761640 1 --2- 172.21.15.2:0/60258829 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5625b1aba420 0x5625b1abc810 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0e6b2136fd2dae8 server_cookie=61688e91a92f56b8 in_seq=0 out_seq=0 2024-09-19T06:22:13.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.139+0000 7f9b6d7fa640 10 client.17865 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:13.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.139+0000 7f9b6d7fa640 1 -- 172.21.15.2:0/60258829 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5625b1a0e850 con 0x5625b1aba420 2024-09-19T06:22:13.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.139+0000 7f9b6d7fa640 10 client.17865 handle_command_reply: tid=0 2024-09-19T06:22:13.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.139+0000 7f9b8e59f740 1 client.17865 shutdown 2024-09-19T06:22:13.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.139+0000 7f9b8e59f740 1 -- 172.21.15.2:0/60258829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625b1a9bca0 msgr2=0x5625b1aa7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:13.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.139+0000 7f9b8e59f740 1 --2- 172.21.15.2:0/60258829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625b1a9bca0 0x5625b1aa7610 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f9b80006aa0 tx=0x7f9b80006ec0 comp rx=0 tx=0).stop 2024-09-19T06:22:13.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.140+0000 7f9b8e59f740 1 -- 172.21.15.2:0/60258829 shutdown_connections 2024-09-19T06:22:13.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.140+0000 7f9b8e59f740 1 --2- 172.21.15.2:0/60258829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625b1aaaa90 0x5625b1aa7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:13.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.140+0000 7f9b8e59f740 1 --2- 172.21.15.2:0/60258829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625b1a9bca0 0x5625b1aa7610 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:13.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.140+0000 7f9b8e59f740 1 --2- 172.21.15.2:0/60258829 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5625b1aba420 0x5625b1abc810 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:13.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.140+0000 7f9b8e59f740 1 --2- 172.21.15.2:0/60258829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5625b1a9b380 0x5625b1aaa360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:13.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.140+0000 7f9b8e59f740 1 -- 172.21.15.2:0/60258829 >> 172.21.15.2:0/60258829 conn(0x5625b1a97a30 msgr2=0x5625b1a9d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:13.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.140+0000 7f9b6d7fa640 0 client.17865 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:13.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.140+0000 7f9b8e59f740 1 -- 172.21.15.2:0/60258829 shutdown_connections 2024-09-19T06:22:13.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.140+0000 7f9b8e59f740 1 -- 172.21.15.2:0/60258829 wait complete. 2024-09-19T06:22:13.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.140+0000 7f9b8e59f740 20 client.17865 trim_cache size 0 max 16384 2024-09-19T06:22:13.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.157+0000 7f9b8e59f740 1 Processor -- start 2024-09-19T06:22:13.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.157+0000 7f9b8e59f740 1 -- start start 2024-09-19T06:22:13.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.157+0000 7f9b8e59f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625b1a9b380 0x5625b1ab6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:13.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.157+0000 7f9b8e59f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625b1a9bca0 0x5625b1ac1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:13.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.157+0000 7f9b8e59f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5625b1aaaa90 0x5625b1ac23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:13.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.157+0000 7f9b8e59f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9b841ae060 con 0x5625b1a9b380 2024-09-19T06:22:13.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.157+0000 7f9b8e59f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9b841ab930 con 0x5625b1aaaa90 2024-09-19T06:22:13.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.157+0000 7f9b8e59f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9b841a97a0 con 0x5625b1a9bca0 2024-09-19T06:22:13.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.157+0000 7f9b89761640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625b1a9b380 0x5625b1ab6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:13.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.157+0000 7f9b89761640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625b1a9b380 0x5625b1ab6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55022/0 (socket says 172.21.15.2:55022) 2024-09-19T06:22:13.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.157+0000 7f9b89761640 1 -- 172.21.15.2:0/1697559708 learned_addr learned my addr 172.21.15.2:0/1697559708 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:13.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.157+0000 7f9b89f62640 1 --2- 172.21.15.2:0/1697559708 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625b1a9bca0 0x5625b1ac1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:13.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.157+0000 7f9b89761640 1 -- 172.21.15.2:0/1697559708 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625b1a9bca0 msgr2=0x5625b1ac1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:13.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.158+0000 7f9b89761640 1 --2- 172.21.15.2:0/1697559708 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625b1a9bca0 0x5625b1ac1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:13.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.158+0000 7f9b89761640 1 -- 172.21.15.2:0/1697559708 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5625b1aaaa90 msgr2=0x5625b1ac23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:13.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.158+0000 7f9b89761640 1 --2- 172.21.15.2:0/1697559708 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5625b1aaaa90 0x5625b1ac23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:13.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.158+0000 7f9b89761640 1 -- 172.21.15.2:0/1697559708 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625b1aaa6d0 con 0x5625b1a9b380 2024-09-19T06:22:13.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.158+0000 7f9b89f62640 1 --2- 172.21.15.2:0/1697559708 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625b1a9bca0 0x5625b1ac1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:22:13.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.158+0000 7f9b89761640 1 --2- 172.21.15.2:0/1697559708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625b1a9b380 0x5625b1ab6900 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f9b74009230 tx=0x7f9b74009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3034a6f7e0a9e06f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:13.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.158+0000 7f9b6f7fe640 1 -- 172.21.15.2:0/1697559708 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b74043030 con 0x5625b1a9b380 2024-09-19T06:22:13.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.158+0000 7f9b6f7fe640 1 -- 172.21.15.2:0/1697559708 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9b7404c070 con 0x5625b1a9b380 2024-09-19T06:22:13.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.158+0000 7f9b6f7fe640 1 -- 172.21.15.2:0/1697559708 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b74035040 con 0x5625b1a9b380 2024-09-19T06:22:13.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.158+0000 7f9b8e59f740 1 -- 172.21.15.2:0/1697559708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625b1a9b380 msgr2=0x5625b1ab6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:13.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.158+0000 7f9b8e59f740 1 --2- 172.21.15.2:0/1697559708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625b1a9b380 0x5625b1ab6900 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f9b74009230 tx=0x7f9b74009260 comp rx=0 tx=0).stop 2024-09-19T06:22:13.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.159+0000 7f9b8e59f740 1 -- 172.21.15.2:0/1697559708 shutdown_connections 2024-09-19T06:22:13.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.159+0000 7f9b8e59f740 1 --2- 172.21.15.2:0/1697559708 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5625b1aaaa90 0x5625b1ac23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:13.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.159+0000 7f9b8e59f740 1 --2- 172.21.15.2:0/1697559708 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625b1a9bca0 0x5625b1ac1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:13.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.159+0000 7f9b8e59f740 1 --2- 172.21.15.2:0/1697559708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625b1a9b380 0x5625b1ab6900 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:13.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.159+0000 7f9b8e59f740 1 -- 172.21.15.2:0/1697559708 >> 172.21.15.2:0/1697559708 conn(0x5625b1a97a30 msgr2=0x5625b1aa9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:13.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.159+0000 7f9b8e59f740 1 -- 172.21.15.2:0/1697559708 shutdown_connections 2024-09-19T06:22:13.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.159+0000 7f9b8e59f740 1 -- 172.21.15.2:0/1697559708 wait complete. 2024-09-19T06:22:13.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.159+0000 7f9b8e59f740 1 -- start start 2024-09-19T06:22:13.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.159+0000 7f9b8e59f740 1 Processor -- start 2024-09-19T06:22:13.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.159+0000 7f9b8e59f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625b1a9b380 0x5625b1ab30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:13.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.159+0000 7f9b8e59f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5625b1a9bca0 0x5625b1aae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:13.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.160+0000 7f9b8e59f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625b1aaaa90 0x5625b1aae950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:13.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.160+0000 7f9b8e59f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9b841a9df0 con 0x5625b1a9b380 2024-09-19T06:22:13.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.160+0000 7f9b8e59f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9b841ab260 con 0x5625b1a9bca0 2024-09-19T06:22:13.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.160+0000 7f9b8e59f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9b841aa4c0 con 0x5625b1aaaa90 2024-09-19T06:22:13.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.160+0000 7f9b8e59f740 10 client.0 _ll_register_callbacks cb 0x7f9b74009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:13.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.160+0000 7f9b89761640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625b1a9b380 0x5625b1ab30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:13.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.160+0000 7f9b89761640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625b1a9b380 0x5625b1ab30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55028/0 (socket says 172.21.15.2:55028) 2024-09-19T06:22:13.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.160+0000 7f9b89761640 1 -- 172.21.15.2:0/1105153787 learned_addr learned my addr 172.21.15.2:0/1105153787 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:13.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.160+0000 7f9b89f62640 1 --2- 172.21.15.2:0/1105153787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5625b1a9bca0 0x5625b1aae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:13.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.160+0000 7f9b89761640 1 -- 172.21.15.2:0/1105153787 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625b1aaaa90 msgr2=0x5625b1aae950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:13.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.160+0000 7f9b89761640 1 --2- 172.21.15.2:0/1105153787 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625b1aaaa90 0x5625b1aae950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:13.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.160+0000 7f9b89761640 1 -- 172.21.15.2:0/1105153787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5625b1a9bca0 msgr2=0x5625b1aae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:13.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.160+0000 7f9b89761640 1 --2- 172.21.15.2:0/1105153787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5625b1a9bca0 0x5625b1aae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:13.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.160+0000 7f9b89761640 1 -- 172.21.15.2:0/1105153787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625b1aaf180 con 0x5625b1a9b380 2024-09-19T06:22:13.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.160+0000 7f9b89761640 1 --2- 172.21.15.2:0/1105153787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625b1a9b380 0x5625b1ab30e0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f9b74009630 tx=0x7f9b74032990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7604d532167ff7c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:13.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.160+0000 7f9b6d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:22:13.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.160+0000 7f9b6d7fa640 1 -- 172.21.15.2:0/1105153787 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b74054070 con 0x5625b1a9b380 2024-09-19T06:22:13.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.160+0000 7f9b6d7fa640 1 -- 172.21.15.2:0/1105153787 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8565+0+0 (secure 0 0 0) 0x7f9b740324d0 con 0x5625b1a9b380 2024-09-19T06:22:13.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.160+0000 7f9b8e59f740 1 -- 172.21.15.2:0/1105153787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b7404c070 con 0x5625b1a9b380 2024-09-19T06:22:13.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.161+0000 7f9b6d7fa640 1 -- 172.21.15.2:0/1105153787 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9b7405d050 con 0x5625b1a9b380 2024-09-19T06:22:13.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.161+0000 7f9b8e59f740 10 client.17871 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:13.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.161+0000 7f9b8e59f740 1 -- 172.21.15.2:0/1105153787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5625b1b24d20 con 0x5625b1a9b380 2024-09-19T06:22:13.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.161+0000 7f9b6d7fa640 1 -- 172.21.15.2:0/1105153787 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9b7404c070 con 0x5625b1a9b380 2024-09-19T06:22:13.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.161+0000 7f9b6d7fa640 1 -- 172.21.15.2:0/1105153787 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f9b74057020 con 0x5625b1a9b380 2024-09-19T06:22:13.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.161+0000 7f9b8e59f740 10 client.17871 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:13.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.161+0000 7f9b8e59f740 10 client.17871 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:13.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.161+0000 7f9b8e59f740 20 client.17871 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:13.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.161+0000 7f9b8e59f740 1 --2- 172.21.15.2:0/1105153787 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5625b1b25390 0x5625b1b277b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:13.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.161+0000 7f9b8e59f740 4 client.17871 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:22:13.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.161+0000 7f9b8e59f740 1 -- 172.21.15.2:0/1105153787 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5625b1a08d60 con 0x5625b1b25390 2024-09-19T06:22:13.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.161+0000 7f9b89f62640 1 --2- 172.21.15.2:0/1105153787 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5625b1b25390 0x5625b1b277b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:13.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.162+0000 7f9b89f62640 1 --2- 172.21.15.2:0/1105153787 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5625b1b25390 0x5625b1b277b0 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcbde298b9dba09d server_cookie=86d27d64af050263 in_seq=0 out_seq=0 2024-09-19T06:22:13.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.162+0000 7f9b6d7fa640 10 client.17871 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:13.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.162+0000 7f9b6d7fa640 1 -- 172.21.15.2:0/1105153787 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5625b1a08d60 con 0x5625b1b25390 2024-09-19T06:22:13.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.162+0000 7f9b6d7fa640 10 client.17871 handle_command_reply: tid=0 2024-09-19T06:22:13.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.162+0000 7f9b8e59f740 1 client.17871 shutdown 2024-09-19T06:22:13.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.162+0000 7f9b8e59f740 1 -- 172.21.15.2:0/1105153787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625b1a9b380 msgr2=0x5625b1ab30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:13.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.162+0000 7f9b8e59f740 1 --2- 172.21.15.2:0/1105153787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625b1a9b380 0x5625b1ab30e0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f9b74009630 tx=0x7f9b74032990 comp rx=0 tx=0).stop 2024-09-19T06:22:13.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.162+0000 7f9b8e59f740 1 -- 172.21.15.2:0/1105153787 shutdown_connections 2024-09-19T06:22:13.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.162+0000 7f9b8e59f740 1 --2- 172.21.15.2:0/1105153787 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5625b1aaaa90 0x5625b1aae950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:13.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.162+0000 7f9b8e59f740 1 --2- 172.21.15.2:0/1105153787 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5625b1b25390 0x5625b1b277b0 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:13.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.162+0000 7f9b8e59f740 1 --2- 172.21.15.2:0/1105153787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5625b1a9bca0 0x5625b1aae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:13.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.162+0000 7f9b8e59f740 1 --2- 172.21.15.2:0/1105153787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5625b1a9b380 0x5625b1ab30e0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:13.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.162+0000 7f9b6d7fa640 0 client.17871 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:13.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.162+0000 7f9b8e59f740 1 -- 172.21.15.2:0/1105153787 >> 172.21.15.2:0/1105153787 conn(0x5625b1a97a30 msgr2=0x5625b1aa8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:13.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.162+0000 7f9b8e59f740 1 -- 172.21.15.2:0/1105153787 shutdown_connections 2024-09-19T06:22:13.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.162+0000 7f9b8e59f740 1 -- 172.21.15.2:0/1105153787 wait complete. 2024-09-19T06:22:13.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.162+0000 7f9b8e59f740 20 client.17871 trim_cache size 0 max 16384 2024-09-19T06:22:13.173 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:22:13.173 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T06:22:13.173 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T06:22:13.173 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:22:13.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.163+0000 7f9b8c1c6640 1 -- 172.21.15.2:0/3798551350 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9b700a3430 msgr2=0x7f9b700a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:13.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.163+0000 7f9b8c1c6640 1 --2- 172.21.15.2:0/3798551350 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9b700a3430 0x7f9b700a58f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c0cca60 tx=0x7f9b7c06b160 comp rx=0 tx=0).stop 2024-09-19T06:22:13.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.163+0000 7f9b8c1c6640 1 -- 172.21.15.2:0/3798551350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b84106f40 msgr2=0x7f9b8419cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:13.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.163+0000 7f9b8c1c6640 1 --2- 172.21.15.2:0/3798551350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b84106f40 0x7f9b8419cde0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c00b970 tx=0x7f9b7c00bd70 comp rx=0 tx=0).stop 2024-09-19T06:22:13.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.163+0000 7f9b8c1c6640 1 -- 172.21.15.2:0/3798551350 shutdown_connections 2024-09-19T06:22:13.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.163+0000 7f9b8c1c6640 1 --2- 172.21.15.2:0/3798551350 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9b700a3430 0x7f9b700a58f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:13.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.163+0000 7f9b8c1c6640 1 --2- 172.21.15.2:0/3798551350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b84106f40 0x7f9b8419cde0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:13.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.163+0000 7f9b8c1c6640 1 --2- 172.21.15.2:0/3798551350 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b841027c0 0x7f9b84198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:13.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.163+0000 7f9b8c1c6640 1 --2- 172.21.15.2:0/3798551350 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b84101e10 0x7f9b84198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:13.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.163+0000 7f9b8c1c6640 1 -- 172.21.15.2:0/3798551350 >> 172.21.15.2:0/3798551350 conn(0x7f9b840fd8d0 msgr2=0x7f9b840fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:13.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.163+0000 7f9b8c1c6640 1 -- 172.21.15.2:0/3798551350 shutdown_connections 2024-09-19T06:22:13.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:13.163+0000 7f9b8c1c6640 1 -- 172.21.15.2:0/3798551350 wait complete. 2024-09-19T06:22:13.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:13 smithi002 ceph-mon[30982]: pgmap v228: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-19T06:22:13.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:13 smithi002 ceph-mon[30982]: scrub summary: idle 2024-09-19T06:22:13.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:13 smithi002 ceph-mon[30982]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T06:22:13.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:13 smithi090 ceph-mon[34497]: pgmap v228: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-19T06:22:13.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:13 smithi090 ceph-mon[34497]: scrub summary: idle 2024-09-19T06:22:13.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:13 smithi090 ceph-mon[34497]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T06:22:13.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:13 smithi089 ceph-mon[34160]: pgmap v228: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-19T06:22:13.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:13 smithi089 ceph-mon[34160]: scrub summary: idle 2024-09-19T06:22:13.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:13 smithi089 ceph-mon[34160]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T06:22:13.796 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:22:13.796 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:22:14.054 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:22:14.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.542+0000 7f3f90c85640 1 -- 172.21.15.2:0/3192066642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f8c101de0 msgr2=0x7f3f8c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:14.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.542+0000 7f3f90c85640 1 --2- 172.21.15.2:0/3192066642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f8c101de0 0x7f3f8c1021c0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c009900 tx=0x7f3f7c02a410 comp rx=0 tx=0).stop 2024-09-19T06:22:14.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.542+0000 7f3f90c85640 1 -- 172.21.15.2:0/3192066642 shutdown_connections 2024-09-19T06:22:14.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.542+0000 7f3f90c85640 1 --2- 172.21.15.2:0/3192066642 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f8c106f10 0x7f3f8c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:14.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.542+0000 7f3f90c85640 1 --2- 172.21.15.2:0/3192066642 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f8c102790 0x7f3f8c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:14.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.542+0000 7f3f90c85640 1 --2- 172.21.15.2:0/3192066642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f8c101de0 0x7f3f8c1021c0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:14.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.542+0000 7f3f90c85640 1 -- 172.21.15.2:0/3192066642 >> 172.21.15.2:0/3192066642 conn(0x7f3f8c0fd8c0 msgr2=0x7f3f8c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:14.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.542+0000 7f3f90c85640 1 -- 172.21.15.2:0/3192066642 shutdown_connections 2024-09-19T06:22:14.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.542+0000 7f3f90c85640 1 -- 172.21.15.2:0/3192066642 wait complete. 2024-09-19T06:22:14.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.543+0000 7f3f90c85640 1 Processor -- start 2024-09-19T06:22:14.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.543+0000 7f3f90c85640 1 -- start start 2024-09-19T06:22:14.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.543+0000 7f3f90c85640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f8c101de0 0x7f3f8c198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:14.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.543+0000 7f3f90c85640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f8c102790 0x7f3f8c198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:14.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.543+0000 7f3f90c85640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f8c106f10 0x7f3f8c19ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:14.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.543+0000 7f3f90c85640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3f8c111e60 con 0x7f3f8c106f10 2024-09-19T06:22:14.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.543+0000 7f3f90c85640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3f8c111ce0 con 0x7f3f8c101de0 2024-09-19T06:22:14.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.543+0000 7f3f90c85640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3f8c111fe0 con 0x7f3f8c102790 2024-09-19T06:22:14.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.543+0000 7f3f8ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f8c106f10 0x7f3f8c19ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:14.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.543+0000 7f3f8ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f8c106f10 0x7f3f8c19ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55032/0 (socket says 172.21.15.2:55032) 2024-09-19T06:22:14.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.543+0000 7f3f8ad9d640 1 -- 172.21.15.2:0/4118773302 learned_addr learned my addr 172.21.15.2:0/4118773302 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:14.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.544+0000 7f3f8a59c640 1 --2- 172.21.15.2:0/4118773302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f8c101de0 0x7f3f8c198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:14.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.544+0000 7f3f89d9b640 1 --2- 172.21.15.2:0/4118773302 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f8c102790 0x7f3f8c198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:14.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.544+0000 7f3f8ad9d640 1 -- 172.21.15.2:0/4118773302 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f8c102790 msgr2=0x7f3f8c198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:14.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.544+0000 7f3f8ad9d640 1 --2- 172.21.15.2:0/4118773302 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f8c102790 0x7f3f8c198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:14.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.544+0000 7f3f8ad9d640 1 -- 172.21.15.2:0/4118773302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f8c101de0 msgr2=0x7f3f8c198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:14.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.544+0000 7f3f8ad9d640 1 --2- 172.21.15.2:0/4118773302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f8c101de0 0x7f3f8c198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:14.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.544+0000 7f3f8ad9d640 1 -- 172.21.15.2:0/4118773302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f8c19d3d0 con 0x7f3f8c106f10 2024-09-19T06:22:14.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.544+0000 7f3f8ad9d640 1 --2- 172.21.15.2:0/4118773302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f8c106f10 0x7f3f8c19ccf0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f3f8400cad0 tx=0x7f3f8400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:14.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.544+0000 7f3f837fe640 1 -- 172.21.15.2:0/4118773302 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f8400ae20 con 0x7f3f8c106f10 2024-09-19T06:22:14.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.544+0000 7f3f837fe640 1 -- 172.21.15.2:0/4118773302 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3f84005020 con 0x7f3f8c106f10 2024-09-19T06:22:14.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.544+0000 7f3f90c85640 1 -- 172.21.15.2:0/4118773302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f8c19d6c0 con 0x7f3f8c106f10 2024-09-19T06:22:14.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.544+0000 7f3f837fe640 1 -- 172.21.15.2:0/4118773302 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f8400f6b0 con 0x7f3f8c106f10 2024-09-19T06:22:14.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.544+0000 7f3f90c85640 1 -- 172.21.15.2:0/4118773302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f8c1a4fa0 con 0x7f3f8c106f10 2024-09-19T06:22:14.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.545+0000 7f3f90c85640 1 -- 172.21.15.2:0/4118773302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f8c1021c0 con 0x7f3f8c106f10 2024-09-19T06:22:14.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.546+0000 7f3f837fe640 1 -- 172.21.15.2:0/4118773302 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f3f840051d0 con 0x7f3f8c106f10 2024-09-19T06:22:14.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.547+0000 7f3f837fe640 1 --2- 172.21.15.2:0/4118773302 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f3f780a33b0 0x7f3f780a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:14.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.547+0000 7f3f8a59c640 1 --2- 172.21.15.2:0/4118773302 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f3f780a33b0 0x7f3f780a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:14.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.547+0000 7f3f837fe640 1 -- 172.21.15.2:0/4118773302 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7f3f840cfd60 con 0x7f3f8c106f10 2024-09-19T06:22:14.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.548+0000 7f3f8a59c640 1 --2- 172.21.15.2:0/4118773302 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f3f780a33b0 0x7f3f780a5870 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c031440 tx=0x7f3f7c005e80 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:14.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.551+0000 7f3f837fe640 1 -- 172.21.15.2:0/4118773302 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3f84014030 con 0x7f3f8c106f10 2024-09-19T06:22:14.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.762+0000 7f3f90c85640 1 -- 172.21.15.2:0/4118773302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3f8c02d7c0 con 0x7f3f8c106f10 2024-09-19T06:22:14.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.763+0000 7f3f837fe640 1 -- 172.21.15.2:0/4118773302 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11882 (secure 0 0 0) 0x7f3f8409c740 con 0x7f3f8c106f10 2024-09-19T06:22:14.764 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:22:14.764 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-09-19T06:14:49:104280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:14:48.191083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24470,24472,24497]},"id":1}]} 2024-09-19T06:22:14.765 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-09-19T06:22:14.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.765+0000 7f3f90c85640 1 -- 172.21.15.2:0/4118773302 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f3f780a33b0 msgr2=0x7f3f780a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:14.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.765+0000 7f3f90c85640 1 --2- 172.21.15.2:0/4118773302 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f3f780a33b0 0x7f3f780a5870 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c031440 tx=0x7f3f7c005e80 comp rx=0 tx=0).stop 2024-09-19T06:22:14.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.765+0000 7f3f90c85640 1 -- 172.21.15.2:0/4118773302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f8c106f10 msgr2=0x7f3f8c19ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:14.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.765+0000 7f3f90c85640 1 --2- 172.21.15.2:0/4118773302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f8c106f10 0x7f3f8c19ccf0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f3f8400cad0 tx=0x7f3f8400cf90 comp rx=0 tx=0).stop 2024-09-19T06:22:14.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.765+0000 7f3f90c85640 1 -- 172.21.15.2:0/4118773302 shutdown_connections 2024-09-19T06:22:14.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.765+0000 7f3f90c85640 1 --2- 172.21.15.2:0/4118773302 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f3f780a33b0 0x7f3f780a5870 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:14.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.765+0000 7f3f90c85640 1 --2- 172.21.15.2:0/4118773302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f8c106f10 0x7f3f8c19ccf0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:14.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.765+0000 7f3f90c85640 1 --2- 172.21.15.2:0/4118773302 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f8c102790 0x7f3f8c198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:14.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.765+0000 7f3f90c85640 1 --2- 172.21.15.2:0/4118773302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f8c101de0 0x7f3f8c198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:14.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.765+0000 7f3f90c85640 1 -- 172.21.15.2:0/4118773302 >> 172.21.15.2:0/4118773302 conn(0x7f3f8c0fd8c0 msgr2=0x7f3f8c0fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:14.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.765+0000 7f3f90c85640 1 -- 172.21.15.2:0/4118773302 shutdown_connections 2024-09-19T06:22:14.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:14.765+0000 7f3f90c85640 1 -- 172.21.15.2:0/4118773302 wait complete. 2024-09-19T06:22:15.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:15 smithi002 ceph-mon[30982]: pgmap v230: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T06:22:15.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:15 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/4118773302' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:22:15.415 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:22:15.673 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:22:15.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:15 smithi090 ceph-mon[34497]: pgmap v230: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T06:22:15.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:15 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/4118773302' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:22:15.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:15 smithi089 ceph-mon[34160]: pgmap v230: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T06:22:15.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:15 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/4118773302' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:22:16.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.168+0000 7f64080c6640 1 -- 172.21.15.2:0/344646206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6400101420 msgr2=0x7f640010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:16.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.168+0000 7f64080c6640 1 --2- 172.21.15.2:0/344646206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6400101420 0x7f640010d950 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f63f8009cd0 tx=0x7f63f802a8e0 comp rx=0 tx=0).stop 2024-09-19T06:22:16.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.168+0000 7f64080c6640 1 -- 172.21.15.2:0/344646206 shutdown_connections 2024-09-19T06:22:16.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.168+0000 7f64080c6640 1 --2- 172.21.15.2:0/344646206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6400101420 0x7f640010d950 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:16.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.168+0000 7f64080c6640 1 --2- 172.21.15.2:0/344646206 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6400100a80 0x7f6400100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:16.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.168+0000 7f64080c6640 1 --2- 172.21.15.2:0/344646206 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6400106a80 0x7f6400106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:16.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.168+0000 7f64080c6640 1 -- 172.21.15.2:0/344646206 >> 172.21.15.2:0/344646206 conn(0x7f64000fc7a0 msgr2=0x7f64000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:16.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.168+0000 7f64080c6640 1 -- 172.21.15.2:0/344646206 shutdown_connections 2024-09-19T06:22:16.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.168+0000 7f64080c6640 1 -- 172.21.15.2:0/344646206 wait complete. 2024-09-19T06:22:16.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.168+0000 7f64080c6640 1 Processor -- start 2024-09-19T06:22:16.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.168+0000 7f64080c6640 1 -- start start 2024-09-19T06:22:16.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.169+0000 7f64080c6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6400100a80 0x7f64001982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:16.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.169+0000 7f64080c6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6400101420 0x7f6400198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:16.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.169+0000 7f64080c6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6400106a80 0x7f640019cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:16.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.169+0000 7f64080c6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6400111e30 con 0x7f6400106a80 2024-09-19T06:22:16.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.169+0000 7f64080c6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6400111cb0 con 0x7f6400101420 2024-09-19T06:22:16.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.169+0000 7f64080c6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6400111fb0 con 0x7f6400100a80 2024-09-19T06:22:16.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.169+0000 7f6406663640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6400106a80 0x7f640019cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:16.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.169+0000 7f6405e62640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6400100a80 0x7f64001982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:16.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.169+0000 7f6406663640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6400106a80 0x7f640019cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54564/0 (socket says 172.21.15.2:54564) 2024-09-19T06:22:16.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.169+0000 7f6406663640 1 -- 172.21.15.2:0/2987942605 learned_addr learned my addr 172.21.15.2:0/2987942605 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:16.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.169+0000 7f6405e62640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6400100a80 0x7f64001982d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:41532/0 (socket says 172.21.15.2:41532) 2024-09-19T06:22:16.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.169+0000 7f6405661640 1 --2- 172.21.15.2:0/2987942605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6400101420 0x7f6400198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:16.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.169+0000 7f6406663640 1 -- 172.21.15.2:0/2987942605 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6400100a80 msgr2=0x7f64001982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:16.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.169+0000 7f6406663640 1 --2- 172.21.15.2:0/2987942605 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6400100a80 0x7f64001982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:16.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.169+0000 7f6406663640 1 -- 172.21.15.2:0/2987942605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6400101420 msgr2=0x7f6400198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:16.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.169+0000 7f6406663640 1 --2- 172.21.15.2:0/2987942605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6400101420 0x7f6400198810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:16.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.169+0000 7f6406663640 1 -- 172.21.15.2:0/2987942605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f640019d280 con 0x7f6400106a80 2024-09-19T06:22:16.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.169+0000 7f6405661640 1 --2- 172.21.15.2:0/2987942605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6400101420 0x7f6400198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:16.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.169+0000 7f6405e62640 1 --2- 172.21.15.2:0/2987942605 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6400100a80 0x7f64001982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:16.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.169+0000 7f6406663640 1 --2- 172.21.15.2:0/2987942605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6400106a80 0x7f640019cba0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f63f8005cc0 tx=0x7f63f8003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:16.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.170+0000 7f63f6ffd640 1 -- 172.21.15.2:0/2987942605 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f8004450 con 0x7f6400106a80 2024-09-19T06:22:16.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.170+0000 7f64080c6640 1 -- 172.21.15.2:0/2987942605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f640019d510 con 0x7f6400106a80 2024-09-19T06:22:16.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.170+0000 7f63f6ffd640 1 -- 172.21.15.2:0/2987942605 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f63f8031c90 con 0x7f6400106a80 2024-09-19T06:22:16.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.170+0000 7f63f6ffd640 1 -- 172.21.15.2:0/2987942605 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f8030e70 con 0x7f6400106a80 2024-09-19T06:22:16.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.170+0000 7f64080c6640 1 -- 172.21.15.2:0/2987942605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64001a4e50 con 0x7f6400106a80 2024-09-19T06:22:16.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.172+0000 7f63f6ffd640 1 -- 172.21.15.2:0/2987942605 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f63f80045f0 con 0x7f6400106a80 2024-09-19T06:22:16.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.172+0000 7f640a49f740 1 Processor -- start 2024-09-19T06:22:16.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.173+0000 7f640a49f740 1 -- start start 2024-09-19T06:22:16.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.173+0000 7f640a49f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561a26314b40 0x561a26313090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:16.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.173+0000 7f640a49f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a263135d0 0x561a26313a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:16.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.173+0000 7f640a49f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561a2631e370 0x561a26320760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:16.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.173+0000 7f640a49f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561a262792f0 con 0x561a2631e370 2024-09-19T06:22:16.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.173+0000 7f640a49f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x561a26220cf0 con 0x561a26314b40 2024-09-19T06:22:16.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.173+0000 7f640a49f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x561a262752b0 con 0x561a263135d0 2024-09-19T06:22:16.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.173+0000 7f6405661640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561a2631e370 0x561a26320760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:16.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.173+0000 7f6405e62640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a263135d0 0x561a26313a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:16.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.173+0000 7f6405e62640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a263135d0 0x561a26313a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:41546/0 (socket says 172.21.15.2:41546) 2024-09-19T06:22:16.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.173+0000 7f6405e62640 1 -- 172.21.15.2:0/1222238111 learned_addr learned my addr 172.21.15.2:0/1222238111 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:16.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.173+0000 7f6405661640 1 --2- 172.21.15.2:0/1222238111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561a26314b40 0x561a26313090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:16.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.174+0000 7f6405e62640 1 -- 172.21.15.2:0/1222238111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561a26314b40 msgr2=0x561a26313090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:16.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.174+0000 7f6405e62640 1 --2- 172.21.15.2:0/1222238111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561a26314b40 0x561a26313090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:16.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.174+0000 7f6405e62640 1 -- 172.21.15.2:0/1222238111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561a2631e370 msgr2=0x561a26320760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:16.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.174+0000 7f6405e62640 1 --2- 172.21.15.2:0/1222238111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561a2631e370 0x561a26320760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:16.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.174+0000 7f6405e62640 1 -- 172.21.15.2:0/1222238111 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a262053a0 con 0x561a263135d0 2024-09-19T06:22:16.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.174+0000 7f6405661640 1 --2- 172.21.15.2:0/1222238111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561a2631e370 0x561a26320760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:16.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.174+0000 7f6405e62640 1 --2- 172.21.15.2:0/1222238111 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a263135d0 0x561a26313a10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f63fc00f440 tx=0x7f63fc00f900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67c3ffd04a9114ce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:16.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.174+0000 7f63f6ffd640 1 --2- 172.21.15.2:0/2987942605 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f63ec0a33b0 0x7f63ec0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:16.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.174+0000 7f6405661640 1 --2- 172.21.15.2:0/2987942605 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f63ec0a33b0 0x7f63ec0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:16.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.174+0000 7f63f6ffd640 1 -- 172.21.15.2:0/2987942605 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7f63f802e030 con 0x7f6400106a80 2024-09-19T06:22:16.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.175+0000 7f63ebfff640 1 -- 172.21.15.2:0/1222238111 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63fc005220 con 0x561a263135d0 2024-09-19T06:22:16.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.175+0000 7f63ebfff640 1 -- 172.21.15.2:0/1222238111 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f63fc014070 con 0x561a263135d0 2024-09-19T06:22:16.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.175+0000 7f63ebfff640 1 -- 172.21.15.2:0/1222238111 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63fc010a90 con 0x561a263135d0 2024-09-19T06:22:16.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.176+0000 7f6405661640 1 --2- 172.21.15.2:0/2987942605 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f63ec0a33b0 0x7f63ec0a5870 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x561a26314070 tx=0x7f63f000c510 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:16.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.176+0000 7f640a49f740 1 -- 172.21.15.2:0/1222238111 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a263135d0 msgr2=0x561a26313a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:16.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.176+0000 7f640a49f740 1 --2- 172.21.15.2:0/1222238111 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a263135d0 0x561a26313a10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f63fc00f440 tx=0x7f63fc00f900 comp rx=0 tx=0).stop 2024-09-19T06:22:16.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.176+0000 7f640a49f740 1 -- 172.21.15.2:0/1222238111 shutdown_connections 2024-09-19T06:22:16.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.176+0000 7f640a49f740 1 --2- 172.21.15.2:0/1222238111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561a2631e370 0x561a26320760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:16.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.176+0000 7f640a49f740 1 --2- 172.21.15.2:0/1222238111 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a263135d0 0x561a26313a10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:16.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.176+0000 7f640a49f740 1 --2- 172.21.15.2:0/1222238111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561a26314b40 0x561a26313090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:16.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.176+0000 7f640a49f740 1 -- 172.21.15.2:0/1222238111 >> 172.21.15.2:0/1222238111 conn(0x561a262dc310 msgr2=0x561a2630fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:16.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.176+0000 7f640a49f740 1 -- 172.21.15.2:0/1222238111 shutdown_connections 2024-09-19T06:22:16.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.177+0000 7f640a49f740 1 -- 172.21.15.2:0/1222238111 wait complete. 2024-09-19T06:22:16.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.177+0000 7f640a49f740 1 -- start start 2024-09-19T06:22:16.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.177+0000 7f640a49f740 1 Processor -- start 2024-09-19T06:22:16.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.178+0000 7f640a49f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561a263135d0 0x561a2631dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:16.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.178+0000 7f640a49f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561a26314b40 0x561a2631b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:16.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.178+0000 7f640a49f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a2631e370 0x561a2631b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:16.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.178+0000 7f640a49f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561a26321070 con 0x561a263135d0 2024-09-19T06:22:16.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.178+0000 7f640a49f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x561a26234060 con 0x561a26314b40 2024-09-19T06:22:16.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.178+0000 7f640a49f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x561a263211f0 con 0x561a2631e370 2024-09-19T06:22:16.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.178+0000 7f640a49f740 10 client.0 _ll_register_callbacks cb 0x561a25f878c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:16.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.178+0000 7f6405e62640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561a263135d0 0x561a2631dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:16.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.178+0000 7f6405e62640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561a263135d0 0x561a2631dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54574/0 (socket says 172.21.15.2:54574) 2024-09-19T06:22:16.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.178+0000 7f6405e62640 1 -- 172.21.15.2:0/2849976987 learned_addr learned my addr 172.21.15.2:0/2849976987 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:16.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.179+0000 7f6405661640 1 --2- 172.21.15.2:0/2849976987 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561a26314b40 0x561a2631b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:16.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.179+0000 7f6406663640 1 --2- 172.21.15.2:0/2849976987 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a2631e370 0x561a2631b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:16.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.179+0000 7f6405e62640 1 -- 172.21.15.2:0/2849976987 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a2631e370 msgr2=0x561a2631b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:16.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.179+0000 7f6405e62640 1 --2- 172.21.15.2:0/2849976987 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a2631e370 0x561a2631b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:16.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.179+0000 7f6405e62640 1 -- 172.21.15.2:0/2849976987 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561a26314b40 msgr2=0x561a2631b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:16.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.179+0000 7f6405e62640 1 --2- 172.21.15.2:0/2849976987 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561a26314b40 0x561a2631b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:16.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.179+0000 7f6405e62640 1 -- 172.21.15.2:0/2849976987 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a25fea3c0 con 0x561a263135d0 2024-09-19T06:22:16.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.179+0000 7f6406663640 1 --2- 172.21.15.2:0/2849976987 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a2631e370 0x561a2631b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:16.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.179+0000 7f6405e62640 1 --2- 172.21.15.2:0/2849976987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561a263135d0 0x561a2631dda0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f63fc0056f0 tx=0x7f63fc010c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94a08bf19e076c4e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:16.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.179+0000 7f63e97fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:22:16.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.179+0000 7f63e97fa640 1 -- 172.21.15.2:0/2849976987 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63fc018420 con 0x561a263135d0 2024-09-19T06:22:16.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.179+0000 7f640a49f740 1 -- 172.21.15.2:0/2849976987 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63fc014070 con 0x561a263135d0 2024-09-19T06:22:16.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.179+0000 7f63e97fa640 1 -- 172.21.15.2:0/2849976987 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7f63fc0185c0 con 0x561a263135d0 2024-09-19T06:22:16.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.180+0000 7f63e97fa640 1 -- 172.21.15.2:0/2849976987 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f63fc02f050 con 0x561a263135d0 2024-09-19T06:22:16.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.180+0000 7f640a49f740 10 client.17889 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:16.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.180+0000 7f640a49f740 1 -- 172.21.15.2:0/2849976987 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561a2632cb50 con 0x561a263135d0 2024-09-19T06:22:16.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.180+0000 7f63e97fa640 1 -- 172.21.15.2:0/2849976987 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f63fc014070 con 0x561a263135d0 2024-09-19T06:22:16.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.180+0000 7f63e97fa640 1 -- 172.21.15.2:0/2849976987 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f63fc021760 con 0x561a263135d0 2024-09-19T06:22:16.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.180+0000 7f640a49f740 10 client.17889 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:16.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.180+0000 7f640a49f740 10 client.17889 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:22:16.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.180+0000 7f640a49f740 20 client.17889 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:16.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.180+0000 7f640a49f740 1 --2- 172.21.15.2:0/2849976987 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x561a2632dfb0 0x561a263303a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:16.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.180+0000 7f640a49f740 4 client.17889 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:22:16.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.180+0000 7f640a49f740 1 -- 172.21.15.2:0/2849976987 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a26286860 con 0x561a2632dfb0 2024-09-19T06:22:16.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.181+0000 7f6405661640 1 --2- 172.21.15.2:0/2849976987 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x561a2632dfb0 0x561a263303a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:16.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.181+0000 7f6405661640 1 --2- 172.21.15.2:0/2849976987 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x561a2632dfb0 0x561a263303a0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=820b9f6c09f2aa28 server_cookie=b684a23aa15e61d in_seq=0 out_seq=0 2024-09-19T06:22:16.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.181+0000 7f63e97fa640 10 client.17889 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:22:16.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.182+0000 7f63e97fa640 1 -- 172.21.15.2:0/2849976987 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561a26286860 con 0x561a2632dfb0 2024-09-19T06:22:16.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.182+0000 7f63e97fa640 10 client.17889 handle_command_reply: tid=0 2024-09-19T06:22:16.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.182+0000 7f640a49f740 1 client.17889 shutdown 2024-09-19T06:22:16.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.182+0000 7f640a49f740 1 -- 172.21.15.2:0/2849976987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561a263135d0 msgr2=0x561a2631dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:16.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.182+0000 7f640a49f740 1 --2- 172.21.15.2:0/2849976987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561a263135d0 0x561a2631dda0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f63fc0056f0 tx=0x7f63fc010c40 comp rx=0 tx=0).stop 2024-09-19T06:22:16.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.182+0000 7f640a49f740 1 -- 172.21.15.2:0/2849976987 shutdown_connections 2024-09-19T06:22:16.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.182+0000 7f640a49f740 1 --2- 172.21.15.2:0/2849976987 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x561a2632dfb0 0x561a263303a0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:16.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.182+0000 7f640a49f740 1 --2- 172.21.15.2:0/2849976987 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a2631e370 0x561a2631b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:16.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.182+0000 7f640a49f740 1 --2- 172.21.15.2:0/2849976987 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561a26314b40 0x561a2631b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:16.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.182+0000 7f640a49f740 1 --2- 172.21.15.2:0/2849976987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561a263135d0 0x561a2631dda0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:16.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.182+0000 7f63e97fa640 0 client.17889 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:22:16.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.182+0000 7f640a49f740 1 -- 172.21.15.2:0/2849976987 >> 172.21.15.2:0/2849976987 conn(0x561a262dc310 msgr2=0x561a26315960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:16.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.182+0000 7f640a49f740 1 -- 172.21.15.2:0/2849976987 shutdown_connections 2024-09-19T06:22:16.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.182+0000 7f640a49f740 1 -- 172.21.15.2:0/2849976987 wait complete. 2024-09-19T06:22:16.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.182+0000 7f640a49f740 20 client.17889 trim_cache size 0 max 16384 2024-09-19T06:22:16.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.195+0000 7f640a49f740 1 Processor -- start 2024-09-19T06:22:16.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.195+0000 7f640a49f740 1 -- start start 2024-09-19T06:22:16.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.196+0000 7f640a49f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a263135d0 0x561a2630fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:16.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.196+0000 7f640a49f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561a26314b40 0x561a26316120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:16.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.196+0000 7f640a49f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561a2631e370 0x561a26316660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:16.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.196+0000 7f640a49f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f64001aff50 con 0x561a2631e370 2024-09-19T06:22:16.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.196+0000 7f640a49f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f64001ad820 con 0x561a26314b40 2024-09-19T06:22:16.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.196+0000 7f640a49f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f64001ab690 con 0x561a263135d0 2024-09-19T06:22:16.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.196+0000 7f6406663640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561a2631e370 0x561a26316660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:16.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.196+0000 7f6406663640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561a2631e370 0x561a26316660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54588/0 (socket says 172.21.15.2:54588) 2024-09-19T06:22:16.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.196+0000 7f6406663640 1 -- 172.21.15.2:0/4293580848 learned_addr learned my addr 172.21.15.2:0/4293580848 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:16.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.196+0000 7f6405e62640 1 --2- 172.21.15.2:0/4293580848 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a263135d0 0x561a2630fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:16.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.196+0000 7f6405661640 1 --2- 172.21.15.2:0/4293580848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561a26314b40 0x561a26316120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:16.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.196+0000 7f6406663640 1 -- 172.21.15.2:0/4293580848 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a263135d0 msgr2=0x561a2630fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:16.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.196+0000 7f6406663640 1 --2- 172.21.15.2:0/4293580848 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a263135d0 0x561a2630fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:16.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.196+0000 7f6406663640 1 -- 172.21.15.2:0/4293580848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561a26314b40 msgr2=0x561a26316120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:16.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.196+0000 7f6406663640 1 --2- 172.21.15.2:0/4293580848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561a26314b40 0x561a26316120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:16.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.196+0000 7f6406663640 1 -- 172.21.15.2:0/4293580848 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a263211e0 con 0x561a2631e370 2024-09-19T06:22:16.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.196+0000 7f6405e62640 1 --2- 172.21.15.2:0/4293580848 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a263135d0 0x561a2630fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:16.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.196+0000 7f6405661640 1 --2- 172.21.15.2:0/4293580848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561a26314b40 0x561a26316120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:16.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.196+0000 7f6406663640 1 --2- 172.21.15.2:0/4293580848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561a2631e370 0x561a26316660 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f63f80bd400 tx=0x7f63f80bd070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f082c3386fc790d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:16.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.197+0000 7f63eb7fe640 1 -- 172.21.15.2:0/4293580848 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f80bd470 con 0x561a2631e370 2024-09-19T06:22:16.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.197+0000 7f63eb7fe640 1 -- 172.21.15.2:0/4293580848 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f63f8036040 con 0x561a2631e370 2024-09-19T06:22:16.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.197+0000 7f63eb7fe640 1 -- 172.21.15.2:0/4293580848 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f80b9ae0 con 0x561a2631e370 2024-09-19T06:22:16.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.197+0000 7f640a49f740 1 -- 172.21.15.2:0/4293580848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561a2631e370 msgr2=0x561a26316660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:16.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.197+0000 7f640a49f740 1 --2- 172.21.15.2:0/4293580848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561a2631e370 0x561a26316660 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f63f80bd400 tx=0x7f63f80bd070 comp rx=0 tx=0).stop 2024-09-19T06:22:16.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.197+0000 7f640a49f740 1 -- 172.21.15.2:0/4293580848 shutdown_connections 2024-09-19T06:22:16.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.197+0000 7f640a49f740 1 --2- 172.21.15.2:0/4293580848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561a2631e370 0x561a26316660 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:16.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.197+0000 7f640a49f740 1 --2- 172.21.15.2:0/4293580848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561a26314b40 0x561a26316120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:16.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.197+0000 7f640a49f740 1 --2- 172.21.15.2:0/4293580848 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a263135d0 0x561a2630fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:16.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.197+0000 7f640a49f740 1 -- 172.21.15.2:0/4293580848 >> 172.21.15.2:0/4293580848 conn(0x561a262dc310 msgr2=0x561a26329b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:16.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.197+0000 7f640a49f740 1 -- 172.21.15.2:0/4293580848 shutdown_connections 2024-09-19T06:22:16.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.197+0000 7f640a49f740 1 -- 172.21.15.2:0/4293580848 wait complete. 2024-09-19T06:22:16.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.198+0000 7f640a49f740 1 -- start start 2024-09-19T06:22:16.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.198+0000 7f640a49f740 1 Processor -- start 2024-09-19T06:22:16.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.198+0000 7f640a49f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a263135d0 0x561a26326480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:16.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.198+0000 7f640a49f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561a26314b40 0x561a263269c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:16.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.198+0000 7f640a49f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561a2631e370 0x561a26323450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:16.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.198+0000 7f640a49f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f64001abce0 con 0x561a26314b40 2024-09-19T06:22:16.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.198+0000 7f640a49f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f64001ad150 con 0x561a2631e370 2024-09-19T06:22:16.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.198+0000 7f640a49f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f64001ac3b0 con 0x561a263135d0 2024-09-19T06:22:16.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.198+0000 7f640a49f740 10 client.0 _ll_register_callbacks cb 0x7f63f000cab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:16.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.198+0000 7f6405661640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561a26314b40 0x561a263269c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:16.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.198+0000 7f6405661640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561a26314b40 0x561a263269c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54594/0 (socket says 172.21.15.2:54594) 2024-09-19T06:22:16.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.198+0000 7f6405661640 1 -- 172.21.15.2:0/3627924847 learned_addr learned my addr 172.21.15.2:0/3627924847 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:16.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.198+0000 7f6405e62640 1 --2- 172.21.15.2:0/3627924847 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a263135d0 0x561a26326480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:16.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.199+0000 7f6406663640 1 --2- 172.21.15.2:0/3627924847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561a2631e370 0x561a26323450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:16.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.199+0000 7f6405661640 1 -- 172.21.15.2:0/3627924847 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a263135d0 msgr2=0x561a26326480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:16.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.199+0000 7f6405661640 1 --2- 172.21.15.2:0/3627924847 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a263135d0 0x561a26326480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:16.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.199+0000 7f6405661640 1 -- 172.21.15.2:0/3627924847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561a2631e370 msgr2=0x561a26323450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:16.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.199+0000 7f6405661640 1 --2- 172.21.15.2:0/3627924847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561a2631e370 0x561a26323450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:16.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.199+0000 7f6405661640 1 -- 172.21.15.2:0/3627924847 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a26310dd0 con 0x561a26314b40 2024-09-19T06:22:16.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.199+0000 7f6406663640 1 --2- 172.21.15.2:0/3627924847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561a2631e370 0x561a26323450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:22:16.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.199+0000 7f6405661640 1 --2- 172.21.15.2:0/3627924847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561a26314b40 0x561a263269c0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f63f000c980 tx=0x7f63f0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f003ceb1541109 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:16.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.199+0000 7f63e97fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:22:16.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.199+0000 7f63e97fa640 1 -- 172.21.15.2:0/3627924847 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f000f950 con 0x561a26314b40 2024-09-19T06:22:16.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.199+0000 7f63e97fa640 1 -- 172.21.15.2:0/3627924847 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7f63f000faf0 con 0x561a26314b40 2024-09-19T06:22:16.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.199+0000 7f640a49f740 1 -- 172.21.15.2:0/3627924847 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63f8036040 con 0x561a26314b40 2024-09-19T06:22:16.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.199+0000 7f63e97fa640 1 -- 172.21.15.2:0/3627924847 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f63f003c050 con 0x561a26314b40 2024-09-19T06:22:16.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.199+0000 7f640a49f740 10 client.17895 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:16.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.199+0000 7f640a49f740 1 -- 172.21.15.2:0/3627924847 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561a26310960 con 0x561a26314b40 2024-09-19T06:22:16.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.200+0000 7f63e97fa640 1 -- 172.21.15.2:0/3627924847 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f63f8036040 con 0x561a26314b40 2024-09-19T06:22:16.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.200+0000 7f63e97fa640 1 -- 172.21.15.2:0/3627924847 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f63f001d070 con 0x561a26314b40 2024-09-19T06:22:16.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.200+0000 7f640a49f740 10 client.17895 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:16.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.200+0000 7f640a49f740 10 client.17895 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:22:16.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.200+0000 7f640a49f740 20 client.17895 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:16.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.200+0000 7f640a49f740 1 --2- 172.21.15.2:0/3627924847 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x561a263994b0 0x561a2639b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:16.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.200+0000 7f640a49f740 4 client.17895 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:22:16.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.200+0000 7f640a49f740 1 -- 172.21.15.2:0/3627924847 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561a26280d70 con 0x561a263994b0 2024-09-19T06:22:16.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.200+0000 7f6405e62640 1 --2- 172.21.15.2:0/3627924847 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x561a263994b0 0x561a2639b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:16.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.201+0000 7f6405e62640 1 --2- 172.21.15.2:0/3627924847 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x561a263994b0 0x561a2639b8d0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2c3bd9d169c3dbbb server_cookie=45919e9e204401a1 in_seq=0 out_seq=0 2024-09-19T06:22:16.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.201+0000 7f63e97fa640 10 client.17895 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:22:16.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.201+0000 7f63e97fa640 1 -- 172.21.15.2:0/3627924847 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561a26280d70 con 0x561a263994b0 2024-09-19T06:22:16.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.201+0000 7f63e97fa640 10 client.17895 handle_command_reply: tid=0 2024-09-19T06:22:16.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.201+0000 7f640a49f740 1 client.17895 shutdown 2024-09-19T06:22:16.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.201+0000 7f640a49f740 1 -- 172.21.15.2:0/3627924847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561a26314b40 msgr2=0x561a263269c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:16.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.201+0000 7f640a49f740 1 --2- 172.21.15.2:0/3627924847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561a26314b40 0x561a263269c0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f63f000c980 tx=0x7f63f0004730 comp rx=0 tx=0).stop 2024-09-19T06:22:16.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.201+0000 7f640a49f740 1 -- 172.21.15.2:0/3627924847 shutdown_connections 2024-09-19T06:22:16.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.201+0000 7f640a49f740 1 --2- 172.21.15.2:0/3627924847 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x561a263994b0 0x561a2639b8d0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:16.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.201+0000 7f640a49f740 1 --2- 172.21.15.2:0/3627924847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561a2631e370 0x561a26323450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:16.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.201+0000 7f63e97fa640 0 client.17895 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:22:16.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.201+0000 7f640a49f740 1 --2- 172.21.15.2:0/3627924847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561a26314b40 0x561a263269c0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:16.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.201+0000 7f640a49f740 1 --2- 172.21.15.2:0/3627924847 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a263135d0 0x561a26326480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:16.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.201+0000 7f640a49f740 1 -- 172.21.15.2:0/3627924847 >> 172.21.15.2:0/3627924847 conn(0x561a262dc310 msgr2=0x561a2631c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:16.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.201+0000 7f640a49f740 1 -- 172.21.15.2:0/3627924847 shutdown_connections 2024-09-19T06:22:16.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.201+0000 7f640a49f740 1 -- 172.21.15.2:0/3627924847 wait complete. 2024-09-19T06:22:16.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.201+0000 7f640a49f740 20 client.17895 trim_cache size 0 max 16384 2024-09-19T06:22:16.210 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:22:16.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.202+0000 7f64080c6640 1 -- 172.21.15.2:0/2987942605 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f63ec0a33b0 msgr2=0x7f63ec0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:16.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.202+0000 7f64080c6640 1 --2- 172.21.15.2:0/2987942605 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f63ec0a33b0 0x7f63ec0a5870 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x561a26314070 tx=0x7f63f000c510 comp rx=0 tx=0).stop 2024-09-19T06:22:16.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.202+0000 7f64080c6640 1 -- 172.21.15.2:0/2987942605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6400106a80 msgr2=0x7f640019cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:16.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.202+0000 7f64080c6640 1 --2- 172.21.15.2:0/2987942605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6400106a80 0x7f640019cba0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f63f8005cc0 tx=0x7f63f8003c20 comp rx=0 tx=0).stop 2024-09-19T06:22:16.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.202+0000 7f64080c6640 1 -- 172.21.15.2:0/2987942605 shutdown_connections 2024-09-19T06:22:16.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.202+0000 7f64080c6640 1 --2- 172.21.15.2:0/2987942605 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f63ec0a33b0 0x7f63ec0a5870 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:16.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.202+0000 7f64080c6640 1 --2- 172.21.15.2:0/2987942605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6400106a80 0x7f640019cba0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:16.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.202+0000 7f64080c6640 1 --2- 172.21.15.2:0/2987942605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6400101420 0x7f6400198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:16.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.202+0000 7f64080c6640 1 --2- 172.21.15.2:0/2987942605 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6400100a80 0x7f64001982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:16.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.202+0000 7f64080c6640 1 -- 172.21.15.2:0/2987942605 >> 172.21.15.2:0/2987942605 conn(0x7f64000fc7a0 msgr2=0x7f64000fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:16.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.202+0000 7f64080c6640 1 -- 172.21.15.2:0/2987942605 shutdown_connections 2024-09-19T06:22:16.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:16.202+0000 7f64080c6640 1 -- 172.21.15.2:0/2987942605 wait complete. 2024-09-19T06:22:16.810 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:22:17.066 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:22:17.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:17 smithi002 ceph-mon[30982]: pgmap v231: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T06:22:17.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.509+0000 7fac355b9640 1 -- 172.21.15.2:0/3445793540 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac30102790 msgr2=0x7fac301067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:17.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.509+0000 7fac355b9640 1 --2- 172.21.15.2:0/3445793540 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac30102790 0x7fac301067e0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fac24009900 tx=0x7fac2402a410 comp rx=0 tx=0).stop 2024-09-19T06:22:17.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.510+0000 7fac355b9640 1 -- 172.21.15.2:0/3445793540 shutdown_connections 2024-09-19T06:22:17.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.510+0000 7fac355b9640 1 --2- 172.21.15.2:0/3445793540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac30106f10 0x7fac3010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:17.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.510+0000 7fac355b9640 1 --2- 172.21.15.2:0/3445793540 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac30102790 0x7fac301067e0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:17.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.510+0000 7fac355b9640 1 --2- 172.21.15.2:0/3445793540 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac30101de0 0x7fac301021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:17.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.510+0000 7fac355b9640 1 -- 172.21.15.2:0/3445793540 >> 172.21.15.2:0/3445793540 conn(0x7fac300fd8c0 msgr2=0x7fac300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:17.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.510+0000 7fac355b9640 1 -- 172.21.15.2:0/3445793540 shutdown_connections 2024-09-19T06:22:17.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.510+0000 7fac355b9640 1 -- 172.21.15.2:0/3445793540 wait complete. 2024-09-19T06:22:17.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.510+0000 7fac355b9640 1 Processor -- start 2024-09-19T06:22:17.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.510+0000 7fac355b9640 1 -- start start 2024-09-19T06:22:17.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.511+0000 7fac355b9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac30101de0 0x7fac300744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:17.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.511+0000 7fac355b9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac30102790 0x7fac30074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:17.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.511+0000 7fac355b9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac30106f10 0x7fac30074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:17.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.511+0000 7fac355b9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fac30111e20 con 0x7fac30102790 2024-09-19T06:22:17.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.511+0000 7fac355b9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fac30111ca0 con 0x7fac30106f10 2024-09-19T06:22:17.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.511+0000 7fac355b9640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fac30111fa0 con 0x7fac30101de0 2024-09-19T06:22:17.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.511+0000 7fac2e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac30102790 0x7fac30074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:17.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.511+0000 7fac2effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac30101de0 0x7fac300744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:17.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.511+0000 7fac2e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac30102790 0x7fac30074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54616/0 (socket says 172.21.15.2:54616) 2024-09-19T06:22:17.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.511+0000 7fac2effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac30101de0 0x7fac300744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:41592/0 (socket says 172.21.15.2:41592) 2024-09-19T06:22:17.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.511+0000 7fac2e7fc640 1 -- 172.21.15.2:0/1594395270 learned_addr learned my addr 172.21.15.2:0/1594395270 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:17.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.511+0000 7fac2f7fe640 1 --2- 172.21.15.2:0/1594395270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac30106f10 0x7fac30074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:17.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.511+0000 7fac2e7fc640 1 -- 172.21.15.2:0/1594395270 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac30101de0 msgr2=0x7fac300744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:17.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.511+0000 7fac2e7fc640 1 --2- 172.21.15.2:0/1594395270 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac30101de0 0x7fac300744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:17.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.511+0000 7fac2e7fc640 1 -- 172.21.15.2:0/1594395270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac30106f10 msgr2=0x7fac30074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:17.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.511+0000 7fac2e7fc640 1 --2- 172.21.15.2:0/1594395270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac30106f10 0x7fac30074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:17.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.511+0000 7fac2e7fc640 1 -- 172.21.15.2:0/1594395270 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac301a6860 con 0x7fac30102790 2024-09-19T06:22:17.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.512+0000 7fac2e7fc640 1 --2- 172.21.15.2:0/1594395270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac30102790 0x7fac30074a30 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fac24005940 tx=0x7fac240040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:17.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.512+0000 7fac17fff640 1 -- 172.21.15.2:0/1594395270 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2403f030 con 0x7fac30102790 2024-09-19T06:22:17.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.512+0000 7fac17fff640 1 -- 172.21.15.2:0/1594395270 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fac240044c0 con 0x7fac30102790 2024-09-19T06:22:17.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.512+0000 7fac355b9640 1 -- 172.21.15.2:0/1594395270 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac301a6af0 con 0x7fac30102790 2024-09-19T06:22:17.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.512+0000 7fac17fff640 1 -- 172.21.15.2:0/1594395270 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac24035070 con 0x7fac30102790 2024-09-19T06:22:17.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.512+0000 7fac355b9640 1 -- 172.21.15.2:0/1594395270 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac301a6fd0 con 0x7fac30102790 2024-09-19T06:22:17.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.515+0000 7fac17fff640 1 -- 172.21.15.2:0/1594395270 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fac24042030 con 0x7fac30102790 2024-09-19T06:22:17.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.515+0000 7fac37992740 1 Processor -- start 2024-09-19T06:22:17.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.515+0000 7fac37992740 1 -- start start 2024-09-19T06:22:17.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.515+0000 7fac37992740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56063f907b40 0x56063f906090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:17.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.515+0000 7fac37992740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56063f9065d0 0x56063f906a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:17.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.515+0000 7fac37992740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56063f911370 0x56063f913760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:17.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.515+0000 7fac37992740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56063f86c2f0 con 0x56063f911370 2024-09-19T06:22:17.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.515+0000 7fac37992740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56063f813cf0 con 0x56063f907b40 2024-09-19T06:22:17.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.515+0000 7fac37992740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56063f8682b0 con 0x56063f9065d0 2024-09-19T06:22:17.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.515+0000 7fac2f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56063f907b40 0x56063f906090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:17.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.516+0000 7fac2f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56063f907b40 0x56063f906090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:37860/0 (socket says 172.21.15.2:37860) 2024-09-19T06:22:17.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.516+0000 7fac2e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56063f911370 0x56063f913760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:17.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.516+0000 7fac2f7fe640 1 -- 172.21.15.2:0/3870510757 learned_addr learned my addr 172.21.15.2:0/3870510757 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:17.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.516+0000 7fac2effd640 1 --2- 172.21.15.2:0/3870510757 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56063f9065d0 0x56063f906a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:17.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.516+0000 7fac17fff640 1 --2- 172.21.15.2:0/1594395270 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fac180a33b0 0x7fac180a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:17.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.516+0000 7fac2effd640 1 -- 172.21.15.2:0/3870510757 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56063f907b40 msgr2=0x56063f906090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:17.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.516+0000 7fac2effd640 1 --2- 172.21.15.2:0/3870510757 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56063f907b40 0x56063f906090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:17.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.516+0000 7fac2effd640 1 -- 172.21.15.2:0/3870510757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56063f911370 msgr2=0x56063f913760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:17.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.516+0000 7fac2effd640 1 --2- 172.21.15.2:0/3870510757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56063f911370 0x56063f913760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:17.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.516+0000 7fac2effd640 1 -- 172.21.15.2:0/3870510757 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56063f7f83a0 con 0x56063f9065d0 2024-09-19T06:22:17.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.516+0000 7fac2f7fe640 1 --2- 172.21.15.2:0/1594395270 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fac180a33b0 0x7fac180a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:17.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.516+0000 7fac17fff640 1 -- 172.21.15.2:0/1594395270 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7fac240f0040 con 0x7fac30102790 2024-09-19T06:22:17.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.516+0000 7fac2effd640 1 --2- 172.21.15.2:0/3870510757 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56063f9065d0 0x56063f906a10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fac20009c20 tx=0x7fac20011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=539e17ec91f24c3b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:17.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.516+0000 7fac157fa640 1 -- 172.21.15.2:0/3870510757 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac20009dd0 con 0x56063f9065d0 2024-09-19T06:22:17.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.516+0000 7fac157fa640 1 -- 172.21.15.2:0/3870510757 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fac20005020 con 0x56063f9065d0 2024-09-19T06:22:17.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.516+0000 7fac157fa640 1 -- 172.21.15.2:0/3870510757 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac20004a00 con 0x56063f9065d0 2024-09-19T06:22:17.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.517+0000 7fac37992740 1 -- 172.21.15.2:0/3870510757 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56063f9065d0 msgr2=0x56063f906a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:17.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.517+0000 7fac2f7fe640 1 --2- 172.21.15.2:0/1594395270 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fac180a33b0 0x7fac180a5870 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fac28011a00 tx=0x7fac28004ab0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:17.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.517+0000 7fac37992740 1 --2- 172.21.15.2:0/3870510757 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56063f9065d0 0x56063f906a10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fac20009c20 tx=0x7fac20011810 comp rx=0 tx=0).stop 2024-09-19T06:22:17.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.517+0000 7fac37992740 1 -- 172.21.15.2:0/3870510757 shutdown_connections 2024-09-19T06:22:17.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.517+0000 7fac37992740 1 --2- 172.21.15.2:0/3870510757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56063f911370 0x56063f913760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:17.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.517+0000 7fac37992740 1 --2- 172.21.15.2:0/3870510757 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56063f9065d0 0x56063f906a10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:17.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.517+0000 7fac37992740 1 --2- 172.21.15.2:0/3870510757 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56063f907b40 0x56063f906090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:17.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.517+0000 7fac37992740 1 -- 172.21.15.2:0/3870510757 >> 172.21.15.2:0/3870510757 conn(0x56063f8cf310 msgr2=0x56063f902c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:17.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.517+0000 7fac37992740 1 -- 172.21.15.2:0/3870510757 shutdown_connections 2024-09-19T06:22:17.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.517+0000 7fac37992740 1 -- 172.21.15.2:0/3870510757 wait complete. 2024-09-19T06:22:17.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.518+0000 7fac37992740 1 -- start start 2024-09-19T06:22:17.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.518+0000 7fac37992740 1 Processor -- start 2024-09-19T06:22:17.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.518+0000 7fac37992740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56063f9065d0 0x56063f910ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:17.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.518+0000 7fac37992740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56063f907b40 0x56063f90df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:17.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.518+0000 7fac37992740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56063f911370 0x56063f90e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:17.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.518+0000 7fac37992740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56063f914070 con 0x56063f9065d0 2024-09-19T06:22:17.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.518+0000 7fac37992740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56063f827060 con 0x56063f907b40 2024-09-19T06:22:17.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.518+0000 7fac37992740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56063f9141f0 con 0x56063f911370 2024-09-19T06:22:17.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.518+0000 7fac37992740 10 client.0 _ll_register_callbacks cb 0x56063f57a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:17.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.518+0000 7fac2effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56063f9065d0 0x56063f910ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:17.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.518+0000 7fac2effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56063f9065d0 0x56063f910ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54636/0 (socket says 172.21.15.2:54636) 2024-09-19T06:22:17.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.518+0000 7fac2effd640 1 -- 172.21.15.2:0/624205680 learned_addr learned my addr 172.21.15.2:0/624205680 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:17.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.518+0000 7fac2f7fe640 1 --2- 172.21.15.2:0/624205680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56063f911370 0x56063f90e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:17.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.518+0000 7fac2e7fc640 1 --2- 172.21.15.2:0/624205680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56063f907b40 0x56063f90df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:17.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.519+0000 7fac2effd640 1 -- 172.21.15.2:0/624205680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56063f911370 msgr2=0x56063f90e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:17.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.519+0000 7fac2effd640 1 --2- 172.21.15.2:0/624205680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56063f911370 0x56063f90e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:17.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.519+0000 7fac2effd640 1 -- 172.21.15.2:0/624205680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56063f907b40 msgr2=0x56063f90df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:17.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.519+0000 7fac2effd640 1 --2- 172.21.15.2:0/624205680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56063f907b40 0x56063f90df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:17.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.519+0000 7fac2effd640 1 -- 172.21.15.2:0/624205680 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56063f5dd3c0 con 0x56063f9065d0 2024-09-19T06:22:17.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.519+0000 7fac2e7fc640 1 --2- 172.21.15.2:0/624205680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56063f907b40 0x56063f90df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:17.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.519+0000 7fac2effd640 1 --2- 172.21.15.2:0/624205680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56063f9065d0 0x56063f910ce0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fac2001b040 tx=0x7fac20005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=510e8515dc4e141a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:17.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.519+0000 7fac12ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:22:17.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.519+0000 7fac12ff5640 1 -- 172.21.15.2:0/624205680 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac20029020 con 0x56063f9065d0 2024-09-19T06:22:17.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.519+0000 7fac12ff5640 1 -- 172.21.15.2:0/624205680 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7fac20004950 con 0x56063f9065d0 2024-09-19T06:22:17.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.519+0000 7fac37992740 1 -- 172.21.15.2:0/624205680 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac20005020 con 0x56063f9065d0 2024-09-19T06:22:17.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.519+0000 7fac12ff5640 1 -- 172.21.15.2:0/624205680 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fac20034050 con 0x56063f9065d0 2024-09-19T06:22:17.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.519+0000 7fac37992740 10 client.17907 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:17.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.519+0000 7fac37992740 1 -- 172.21.15.2:0/624205680 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56063f91fa80 con 0x56063f9065d0 2024-09-19T06:22:17.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.519+0000 7fac12ff5640 1 -- 172.21.15.2:0/624205680 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fac20005020 con 0x56063f9065d0 2024-09-19T06:22:17.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.520+0000 7fac12ff5640 1 -- 172.21.15.2:0/624205680 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fac20025c90 con 0x56063f9065d0 2024-09-19T06:22:17.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.520+0000 7fac37992740 10 client.17907 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:17.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.520+0000 7fac37992740 10 client.17907 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:22:17.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.520+0000 7fac37992740 20 client.17907 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:17.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.520+0000 7fac37992740 1 --2- 172.21.15.2:0/624205680 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x56063f920ee0 0x56063f9232d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:17.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.520+0000 7fac37992740 4 client.17907 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:22:17.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.520+0000 7fac37992740 1 -- 172.21.15.2:0/624205680 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56063f879860 con 0x56063f920ee0 2024-09-19T06:22:17.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.520+0000 7fac2e7fc640 1 --2- 172.21.15.2:0/624205680 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x56063f920ee0 0x56063f9232d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:17.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.520+0000 7fac2e7fc640 1 --2- 172.21.15.2:0/624205680 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x56063f920ee0 0x56063f9232d0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8d79f6c64e8b458b server_cookie=6fddb9e34c38e141 in_seq=0 out_seq=0 2024-09-19T06:22:17.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.520+0000 7fac12ff5640 10 client.17907 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:22:17.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.521+0000 7fac12ff5640 1 -- 172.21.15.2:0/624205680 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56063f879860 con 0x56063f920ee0 2024-09-19T06:22:17.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.521+0000 7fac12ff5640 10 client.17907 handle_command_reply: tid=0 2024-09-19T06:22:17.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.521+0000 7fac37992740 1 client.17907 shutdown 2024-09-19T06:22:17.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.521+0000 7fac37992740 1 -- 172.21.15.2:0/624205680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56063f9065d0 msgr2=0x56063f910ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:17.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.521+0000 7fac37992740 1 --2- 172.21.15.2:0/624205680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56063f9065d0 0x56063f910ce0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fac2001b040 tx=0x7fac20005db0 comp rx=0 tx=0).stop 2024-09-19T06:22:17.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.521+0000 7fac37992740 1 -- 172.21.15.2:0/624205680 shutdown_connections 2024-09-19T06:22:17.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.521+0000 7fac37992740 1 --2- 172.21.15.2:0/624205680 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x56063f920ee0 0x56063f9232d0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:17.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.521+0000 7fac37992740 1 --2- 172.21.15.2:0/624205680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56063f911370 0x56063f90e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:17.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.521+0000 7fac37992740 1 --2- 172.21.15.2:0/624205680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56063f907b40 0x56063f90df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:17.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.521+0000 7fac12ff5640 0 client.17907 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:22:17.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.521+0000 7fac37992740 1 --2- 172.21.15.2:0/624205680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56063f9065d0 0x56063f910ce0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:17.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.521+0000 7fac37992740 1 -- 172.21.15.2:0/624205680 >> 172.21.15.2:0/624205680 conn(0x56063f8cf310 msgr2=0x56063f908960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:17.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.521+0000 7fac37992740 1 -- 172.21.15.2:0/624205680 shutdown_connections 2024-09-19T06:22:17.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.521+0000 7fac37992740 1 -- 172.21.15.2:0/624205680 wait complete. 2024-09-19T06:22:17.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.521+0000 7fac37992740 20 client.17907 trim_cache size 0 max 16384 2024-09-19T06:22:17.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.534+0000 7fac37992740 1 Processor -- start 2024-09-19T06:22:17.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.534+0000 7fac37992740 1 -- start start 2024-09-19T06:22:17.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.534+0000 7fac37992740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56063f9065d0 0x56063f91d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:17.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.534+0000 7fac37992740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56063f907b40 0x56063f90d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:17.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.534+0000 7fac37992740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56063f911370 0x56063f909120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:17.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.535+0000 7fac37992740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fac301b22e0 con 0x56063f911370 2024-09-19T06:22:17.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.535+0000 7fac37992740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fac301afbb0 con 0x56063f9065d0 2024-09-19T06:22:17.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.535+0000 7fac37992740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fac301ada20 con 0x56063f907b40 2024-09-19T06:22:17.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.535+0000 7fac2f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56063f911370 0x56063f909120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:17.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.535+0000 7fac2f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56063f911370 0x56063f909120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54652/0 (socket says 172.21.15.2:54652) 2024-09-19T06:22:17.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.535+0000 7fac2f7fe640 1 -- 172.21.15.2:0/1327767621 learned_addr learned my addr 172.21.15.2:0/1327767621 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:17.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.535+0000 7fac2effd640 1 --2- 172.21.15.2:0/1327767621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56063f9065d0 0x56063f91d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:17.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.535+0000 7fac2e7fc640 1 --2- 172.21.15.2:0/1327767621 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56063f907b40 0x56063f90d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:17.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.535+0000 7fac2f7fe640 1 -- 172.21.15.2:0/1327767621 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56063f907b40 msgr2=0x56063f90d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:17.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.535+0000 7fac2f7fe640 1 --2- 172.21.15.2:0/1327767621 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56063f907b40 0x56063f90d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:17.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.535+0000 7fac2f7fe640 1 -- 172.21.15.2:0/1327767621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56063f9065d0 msgr2=0x56063f91d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:17.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.535+0000 7fac2f7fe640 1 --2- 172.21.15.2:0/1327767621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56063f9065d0 0x56063f91d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:17.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.535+0000 7fac2f7fe640 1 -- 172.21.15.2:0/1327767621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56063f923860 con 0x56063f911370 2024-09-19T06:22:17.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.535+0000 7fac2effd640 1 --2- 172.21.15.2:0/1327767621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56063f9065d0 0x56063f91d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:17.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.535+0000 7fac2e7fc640 1 --2- 172.21.15.2:0/1327767621 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56063f907b40 0x56063f90d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:22:17.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.535+0000 7fac2f7fe640 1 --2- 172.21.15.2:0/1327767621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56063f911370 0x56063f909120 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fac28003dc0 tx=0x7fac28009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f27277e72875a899 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:17.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.535+0000 7fac14ff9640 1 -- 172.21.15.2:0/1327767621 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2801a040 con 0x56063f911370 2024-09-19T06:22:17.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.535+0000 7fac14ff9640 1 -- 172.21.15.2:0/1327767621 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fac2800fcf0 con 0x56063f911370 2024-09-19T06:22:17.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.535+0000 7fac14ff9640 1 -- 172.21.15.2:0/1327767621 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac28005220 con 0x56063f911370 2024-09-19T06:22:17.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.536+0000 7fac37992740 1 -- 172.21.15.2:0/1327767621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56063f911370 msgr2=0x56063f909120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:17.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.536+0000 7fac37992740 1 --2- 172.21.15.2:0/1327767621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56063f911370 0x56063f909120 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fac28003dc0 tx=0x7fac28009c50 comp rx=0 tx=0).stop 2024-09-19T06:22:17.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.536+0000 7fac37992740 1 -- 172.21.15.2:0/1327767621 shutdown_connections 2024-09-19T06:22:17.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.536+0000 7fac37992740 1 --2- 172.21.15.2:0/1327767621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56063f911370 0x56063f909120 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:17.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.536+0000 7fac37992740 1 --2- 172.21.15.2:0/1327767621 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56063f907b40 0x56063f90d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:17.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.536+0000 7fac37992740 1 --2- 172.21.15.2:0/1327767621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56063f9065d0 0x56063f91d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:17.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.536+0000 7fac37992740 1 -- 172.21.15.2:0/1327767621 >> 172.21.15.2:0/1327767621 conn(0x56063f8cf310 msgr2=0x56063f8fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:17.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.536+0000 7fac37992740 1 -- 172.21.15.2:0/1327767621 shutdown_connections 2024-09-19T06:22:17.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.536+0000 7fac37992740 1 -- 172.21.15.2:0/1327767621 wait complete. 2024-09-19T06:22:17.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.536+0000 7fac37992740 1 -- start start 2024-09-19T06:22:17.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.536+0000 7fac37992740 1 Processor -- start 2024-09-19T06:22:17.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.537+0000 7fac37992740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56063f9065d0 0x56063f919480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:17.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.537+0000 7fac37992740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56063f907b40 0x56063f9199c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:17.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.537+0000 7fac37992740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56063f911370 0x56063f90a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:17.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.537+0000 7fac37992740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fac301ae070 con 0x56063f907b40 2024-09-19T06:22:17.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.537+0000 7fac37992740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fac301af4e0 con 0x56063f911370 2024-09-19T06:22:17.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.537+0000 7fac37992740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fac301ae740 con 0x56063f9065d0 2024-09-19T06:22:17.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.537+0000 7fac37992740 10 client.0 _ll_register_callbacks cb 0x7fac240f3a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:17.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.537+0000 7fac2e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56063f907b40 0x56063f9199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:17.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.537+0000 7fac2e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56063f907b40 0x56063f9199c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54666/0 (socket says 172.21.15.2:54666) 2024-09-19T06:22:17.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.537+0000 7fac2e7fc640 1 -- 172.21.15.2:0/1094753975 learned_addr learned my addr 172.21.15.2:0/1094753975 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:17.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.537+0000 7fac2effd640 1 --2- 172.21.15.2:0/1094753975 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56063f9065d0 0x56063f919480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:17.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.537+0000 7fac2f7fe640 1 --2- 172.21.15.2:0/1094753975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56063f911370 0x56063f90a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:17.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.537+0000 7fac2e7fc640 1 -- 172.21.15.2:0/1094753975 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56063f9065d0 msgr2=0x56063f919480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:17.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.537+0000 7fac2e7fc640 1 --2- 172.21.15.2:0/1094753975 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56063f9065d0 0x56063f919480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:17.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.537+0000 7fac2e7fc640 1 -- 172.21.15.2:0/1094753975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56063f911370 msgr2=0x56063f90a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:17.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.537+0000 7fac2e7fc640 1 --2- 172.21.15.2:0/1094753975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56063f911370 0x56063f90a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:17.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.537+0000 7fac2e7fc640 1 -- 172.21.15.2:0/1094753975 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56063f903960 con 0x56063f907b40 2024-09-19T06:22:17.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.537+0000 7fac2f7fe640 1 --2- 172.21.15.2:0/1094753975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56063f911370 0x56063f90a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:17.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.537+0000 7fac2e7fc640 1 --2- 172.21.15.2:0/1094753975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56063f907b40 0x56063f9199c0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fac240edd90 tx=0x7fac240f3b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a76d0f7634729309 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:17.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.537+0000 7fac12ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:22:17.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.537+0000 7fac12ff5640 1 -- 172.21.15.2:0/1094753975 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac24049040 con 0x56063f907b40 2024-09-19T06:22:17.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.537+0000 7fac12ff5640 1 -- 172.21.15.2:0/1094753975 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7fac240f3d40 con 0x56063f907b40 2024-09-19T06:22:17.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.537+0000 7fac37992740 1 -- 172.21.15.2:0/1094753975 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac2800fcf0 con 0x56063f907b40 2024-09-19T06:22:17.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.538+0000 7fac12ff5640 1 -- 172.21.15.2:0/1094753975 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fac240bbf10 con 0x56063f907b40 2024-09-19T06:22:17.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.538+0000 7fac37992740 10 client.17913 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:17.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.538+0000 7fac37992740 1 -- 172.21.15.2:0/1094753975 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56063f98b130 con 0x56063f907b40 2024-09-19T06:22:17.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.538+0000 7fac12ff5640 1 -- 172.21.15.2:0/1094753975 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fac2800fcf0 con 0x56063f907b40 2024-09-19T06:22:17.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.538+0000 7fac12ff5640 1 -- 172.21.15.2:0/1094753975 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fac240b8a40 con 0x56063f907b40 2024-09-19T06:22:17.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.538+0000 7fac37992740 10 client.17913 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:17.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.538+0000 7fac37992740 10 client.17913 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:22:17.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.538+0000 7fac37992740 20 client.17913 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:17.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.538+0000 7fac37992740 1 --2- 172.21.15.2:0/1094753975 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x56063f98b890 0x56063f98dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:17.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.538+0000 7fac37992740 4 client.17913 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:22:17.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.538+0000 7fac37992740 1 -- 172.21.15.2:0/1094753975 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56063f873d70 con 0x56063f98b890 2024-09-19T06:22:17.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.538+0000 7fac2effd640 1 --2- 172.21.15.2:0/1094753975 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x56063f98b890 0x56063f98dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:17.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.539+0000 7fac12ff5640 10 client.17913 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:22:17.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.539+0000 7fac2effd640 1 --2- 172.21.15.2:0/1094753975 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x56063f98b890 0x56063f98dcb0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=40fdef14babfe2b0 server_cookie=83c9ed6e6ce03e85 in_seq=0 out_seq=0 2024-09-19T06:22:17.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.539+0000 7fac12ff5640 1 -- 172.21.15.2:0/1094753975 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56063f873d70 con 0x56063f98b890 2024-09-19T06:22:17.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.539+0000 7fac12ff5640 10 client.17913 handle_command_reply: tid=0 2024-09-19T06:22:17.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.539+0000 7fac37992740 1 client.17913 shutdown 2024-09-19T06:22:17.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.539+0000 7fac37992740 1 -- 172.21.15.2:0/1094753975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56063f907b40 msgr2=0x56063f9199c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:17.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.539+0000 7fac37992740 1 --2- 172.21.15.2:0/1094753975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56063f907b40 0x56063f9199c0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fac240edd90 tx=0x7fac240f3b10 comp rx=0 tx=0).stop 2024-09-19T06:22:17.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.539+0000 7fac37992740 1 -- 172.21.15.2:0/1094753975 shutdown_connections 2024-09-19T06:22:17.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.539+0000 7fac37992740 1 --2- 172.21.15.2:0/1094753975 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x56063f98b890 0x56063f98dcb0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:17.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.539+0000 7fac37992740 1 --2- 172.21.15.2:0/1094753975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56063f911370 0x56063f90a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:17.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.539+0000 7fac37992740 1 --2- 172.21.15.2:0/1094753975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56063f907b40 0x56063f9199c0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:17.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.539+0000 7fac37992740 1 --2- 172.21.15.2:0/1094753975 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56063f9065d0 0x56063f919480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:17.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.539+0000 7fac12ff5640 0 client.17913 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:22:17.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.539+0000 7fac37992740 1 -- 172.21.15.2:0/1094753975 >> 172.21.15.2:0/1094753975 conn(0x56063f8cf310 msgr2=0x56063f90d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:17.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.539+0000 7fac37992740 1 -- 172.21.15.2:0/1094753975 shutdown_connections 2024-09-19T06:22:17.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.539+0000 7fac37992740 1 -- 172.21.15.2:0/1094753975 wait complete. 2024-09-19T06:22:17.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.539+0000 7fac37992740 20 client.17913 trim_cache size 0 max 16384 2024-09-19T06:22:17.547 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:22:17.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.540+0000 7fac355b9640 1 -- 172.21.15.2:0/1594395270 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fac180a33b0 msgr2=0x7fac180a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:17.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.540+0000 7fac355b9640 1 --2- 172.21.15.2:0/1594395270 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fac180a33b0 0x7fac180a5870 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fac28011a00 tx=0x7fac28004ab0 comp rx=0 tx=0).stop 2024-09-19T06:22:17.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.540+0000 7fac355b9640 1 -- 172.21.15.2:0/1594395270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac30102790 msgr2=0x7fac30074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:17.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.540+0000 7fac355b9640 1 --2- 172.21.15.2:0/1594395270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac30102790 0x7fac30074a30 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fac24005940 tx=0x7fac240040c0 comp rx=0 tx=0).stop 2024-09-19T06:22:17.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.540+0000 7fac355b9640 1 -- 172.21.15.2:0/1594395270 shutdown_connections 2024-09-19T06:22:17.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.540+0000 7fac355b9640 1 --2- 172.21.15.2:0/1594395270 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fac180a33b0 0x7fac180a5870 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:17.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.540+0000 7fac355b9640 1 --2- 172.21.15.2:0/1594395270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac30106f10 0x7fac30074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:17.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.540+0000 7fac355b9640 1 --2- 172.21.15.2:0/1594395270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac30102790 0x7fac30074a30 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:17.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.540+0000 7fac355b9640 1 --2- 172.21.15.2:0/1594395270 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac30101de0 0x7fac300744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:17.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.540+0000 7fac355b9640 1 -- 172.21.15.2:0/1594395270 >> 172.21.15.2:0/1594395270 conn(0x7fac300fd8c0 msgr2=0x7fac300fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:17.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.540+0000 7fac355b9640 1 -- 172.21.15.2:0/1594395270 shutdown_connections 2024-09-19T06:22:17.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:17.540+0000 7fac355b9640 1 -- 172.21.15.2:0/1594395270 wait complete. 2024-09-19T06:22:17.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:17 smithi090 ceph-mon[34497]: pgmap v231: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T06:22:17.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:17 smithi089 ceph-mon[34160]: pgmap v231: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T06:22:18.452 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:22:18.715 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:22:19.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.219+0000 7fb55da32640 1 -- 172.21.15.2:0/4282355050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb558100e20 msgr2=0x7fb558101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:19.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.219+0000 7fb55da32640 1 --2- 172.21.15.2:0/4282355050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb558100e20 0x7fb558101200 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fb550009900 tx=0x7fb55002a480 comp rx=0 tx=0).stop 2024-09-19T06:22:19.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.219+0000 7fb55da32640 1 -- 172.21.15.2:0/4282355050 shutdown_connections 2024-09-19T06:22:19.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.219+0000 7fb55da32640 1 --2- 172.21.15.2:0/4282355050 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb558102ef0 0x7fb55810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:19.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.219+0000 7fb55da32640 1 --2- 172.21.15.2:0/4282355050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb558102570 0x7fb5581029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:19.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.219+0000 7fb55da32640 1 --2- 172.21.15.2:0/4282355050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb558100e20 0x7fb558101200 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:19.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.219+0000 7fb55da32640 1 -- 172.21.15.2:0/4282355050 >> 172.21.15.2:0/4282355050 conn(0x7fb5580fc7d0 msgr2=0x7fb5580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:19.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.219+0000 7fb55da32640 1 -- 172.21.15.2:0/4282355050 shutdown_connections 2024-09-19T06:22:19.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.219+0000 7fb55da32640 1 -- 172.21.15.2:0/4282355050 wait complete. 2024-09-19T06:22:19.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.219+0000 7fb55da32640 1 Processor -- start 2024-09-19T06:22:19.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.220+0000 7fb55da32640 1 -- start start 2024-09-19T06:22:19.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.220+0000 7fb55da32640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb558100e20 0x7fb5581983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:19.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.220+0000 7fb55da32640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb558102570 0x7fb558198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:19.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.220+0000 7fb55da32640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb558102ef0 0x7fb55819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:19.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.220+0000 7fb55da32640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb558111f50 con 0x7fb558102ef0 2024-09-19T06:22:19.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.220+0000 7fb55da32640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb558111dd0 con 0x7fb558102570 2024-09-19T06:22:19.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.220+0000 7fb55da32640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb5581120d0 con 0x7fb558100e20 2024-09-19T06:22:19.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.220+0000 7fb5577fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb558102ef0 0x7fb55819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:19.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.220+0000 7fb5577fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb558102ef0 0x7fb55819cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54696/0 (socket says 172.21.15.2:54696) 2024-09-19T06:22:19.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.220+0000 7fb5577fe640 1 -- 172.21.15.2:0/2189446279 learned_addr learned my addr 172.21.15.2:0/2189446279 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:19.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.220+0000 7fb556ffd640 1 --2- 172.21.15.2:0/2189446279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb558100e20 0x7fb5581983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:19.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.220+0000 7fb5567fc640 1 --2- 172.21.15.2:0/2189446279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb558102570 0x7fb558198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:19.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.220+0000 7fb5577fe640 1 -- 172.21.15.2:0/2189446279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb558100e20 msgr2=0x7fb5581983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:19.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.220+0000 7fb5577fe640 1 --2- 172.21.15.2:0/2189446279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb558100e20 0x7fb5581983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:19.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.220+0000 7fb5577fe640 1 -- 172.21.15.2:0/2189446279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb558102570 msgr2=0x7fb558198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:19.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.220+0000 7fb5577fe640 1 --2- 172.21.15.2:0/2189446279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb558102570 0x7fb558198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:19.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.220+0000 7fb5577fe640 1 -- 172.21.15.2:0/2189446279 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb55819d380 con 0x7fb558102ef0 2024-09-19T06:22:19.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.220+0000 7fb5567fc640 1 --2- 172.21.15.2:0/2189446279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb558102570 0x7fb558198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:19.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.221+0000 7fb5577fe640 1 --2- 172.21.15.2:0/2189446279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb558102ef0 0x7fb55819cca0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fb54800b970 tx=0x7fb54800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:19.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.221+0000 7fb55ca30640 1 -- 172.21.15.2:0/2189446279 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb548019070 con 0x7fb558102ef0 2024-09-19T06:22:19.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.221+0000 7fb55da32640 1 -- 172.21.15.2:0/2189446279 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb55819d670 con 0x7fb558102ef0 2024-09-19T06:22:19.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.221+0000 7fb55ca30640 1 -- 172.21.15.2:0/2189446279 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb548014440 con 0x7fb558102ef0 2024-09-19T06:22:19.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.221+0000 7fb55ca30640 1 -- 172.21.15.2:0/2189446279 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5480075d0 con 0x7fb558102ef0 2024-09-19T06:22:19.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.221+0000 7fb55da32640 1 -- 172.21.15.2:0/2189446279 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5581a4f50 con 0x7fb558102ef0 2024-09-19T06:22:19.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.223+0000 7fb55ca30640 1 -- 172.21.15.2:0/2189446279 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fb54801c070 con 0x7fb558102ef0 2024-09-19T06:22:19.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.223+0000 7fb55fe0b740 1 Processor -- start 2024-09-19T06:22:19.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.223+0000 7fb55fe0b740 1 -- start start 2024-09-19T06:22:19.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.224+0000 7fb55fe0b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556d0b361b40 0x556d0b360090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:19.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.224+0000 7fb55fe0b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556d0b3605d0 0x556d0b360a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:19.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.224+0000 7fb55fe0b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d0b36f780 0x556d0b371b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:19.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.224+0000 7fb55fe0b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556d0b2c62f0 con 0x556d0b3605d0 2024-09-19T06:22:19.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.224+0000 7fb55fe0b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x556d0b26dcf0 con 0x556d0b36f780 2024-09-19T06:22:19.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.224+0000 7fb55fe0b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556d0b2c22b0 con 0x556d0b361b40 2024-09-19T06:22:19.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.224+0000 7fb556ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556d0b3605d0 0x556d0b360a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:19.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.224+0000 7fb556ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556d0b3605d0 0x556d0b360a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54700/0 (socket says 172.21.15.2:54700) 2024-09-19T06:22:19.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.224+0000 7fb556ffd640 1 -- 172.21.15.2:0/1303453168 learned_addr learned my addr 172.21.15.2:0/1303453168 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:19.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.224+0000 7fb5567fc640 1 --2- 172.21.15.2:0/1303453168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d0b36f780 0x556d0b371b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:19.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.224+0000 7fb55ca30640 1 --2- 172.21.15.2:0/2189446279 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb5440a33b0 0x7fb5440a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:19.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.224+0000 7fb5567fc640 1 --2- 172.21.15.2:0/1303453168 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556d0b361b40 0x556d0b360090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:19.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.224+0000 7fb556ffd640 1 -- 172.21.15.2:0/1303453168 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556d0b361b40 msgr2=0x556d0b360090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:19.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.224+0000 7fb556ffd640 1 --2- 172.21.15.2:0/1303453168 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556d0b361b40 0x556d0b360090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:19.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.224+0000 7fb556ffd640 1 -- 172.21.15.2:0/1303453168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d0b36f780 msgr2=0x556d0b371b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:19.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.224+0000 7fb556ffd640 1 --2- 172.21.15.2:0/1303453168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d0b36f780 0x556d0b371b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:19.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.224+0000 7fb556ffd640 1 -- 172.21.15.2:0/1303453168 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d0b2523a0 con 0x556d0b3605d0 2024-09-19T06:22:19.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.224+0000 7fb5577fe640 1 --2- 172.21.15.2:0/2189446279 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb5440a33b0 0x7fb5440a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:19.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.224+0000 7fb5567fc640 1 --2- 172.21.15.2:0/1303453168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d0b36f780 0x556d0b371b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:19.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.224+0000 7fb55ca30640 1 -- 172.21.15.2:0/2189446279 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7fb5480cf1f0 con 0x7fb558102ef0 2024-09-19T06:22:19.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.224+0000 7fb556ffd640 1 --2- 172.21.15.2:0/1303453168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556d0b3605d0 0x556d0b360a10 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fb550009900 tx=0x7fb550032e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b386472a1b3dd57a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:19.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.225+0000 7fb54dffb640 1 -- 172.21.15.2:0/1303453168 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb550035070 con 0x556d0b3605d0 2024-09-19T06:22:19.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.225+0000 7fb5577fe640 1 --2- 172.21.15.2:0/2189446279 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb5440a33b0 0x7fb5440a5870 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb54809b390 tx=0x7fb548066080 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:19.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.225+0000 7fb54dffb640 1 -- 172.21.15.2:0/1303453168 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb5500316f0 con 0x556d0b3605d0 2024-09-19T06:22:19.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.225+0000 7fb54dffb640 1 -- 172.21.15.2:0/1303453168 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb550003d70 con 0x556d0b3605d0 2024-09-19T06:22:19.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.225+0000 7fb55fe0b740 1 -- 172.21.15.2:0/1303453168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556d0b3605d0 msgr2=0x556d0b360a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:19.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.225+0000 7fb55fe0b740 1 --2- 172.21.15.2:0/1303453168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556d0b3605d0 0x556d0b360a10 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fb550009900 tx=0x7fb550032e20 comp rx=0 tx=0).stop 2024-09-19T06:22:19.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.225+0000 7fb55fe0b740 1 -- 172.21.15.2:0/1303453168 shutdown_connections 2024-09-19T06:22:19.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.225+0000 7fb55fe0b740 1 --2- 172.21.15.2:0/1303453168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d0b36f780 0x556d0b371b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:19.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.225+0000 7fb55fe0b740 1 --2- 172.21.15.2:0/1303453168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556d0b3605d0 0x556d0b360a10 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:19.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.225+0000 7fb55fe0b740 1 --2- 172.21.15.2:0/1303453168 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556d0b361b40 0x556d0b360090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:19.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.225+0000 7fb55fe0b740 1 -- 172.21.15.2:0/1303453168 >> 172.21.15.2:0/1303453168 conn(0x556d0b329310 msgr2=0x556d0b35cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:19.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.225+0000 7fb55fe0b740 1 -- 172.21.15.2:0/1303453168 shutdown_connections 2024-09-19T06:22:19.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.226+0000 7fb55fe0b740 1 -- 172.21.15.2:0/1303453168 wait complete. 2024-09-19T06:22:19.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.226+0000 7fb55fe0b740 1 -- start start 2024-09-19T06:22:19.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.226+0000 7fb55fe0b740 1 Processor -- start 2024-09-19T06:22:19.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.226+0000 7fb55fe0b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556d0b3605d0 0x556d0b36f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:19.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.226+0000 7fb55fe0b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556d0b361b40 0x556d0b36c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:19.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.226+0000 7fb55fe0b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d0b36f780 0x556d0b36ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:19.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.226+0000 7fb55fe0b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556d0b372420 con 0x556d0b361b40 2024-09-19T06:22:19.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.226+0000 7fb55fe0b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x556d0b281060 con 0x556d0b36f780 2024-09-19T06:22:19.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.226+0000 7fb55fe0b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556d0b3725a0 con 0x556d0b3605d0 2024-09-19T06:22:19.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.226+0000 7fb55fe0b740 10 client.0 _ll_register_callbacks cb 0x556d0afd48c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:19.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.226+0000 7fb556ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556d0b361b40 0x556d0b36c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:19.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.226+0000 7fb556ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556d0b361b40 0x556d0b36c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54710/0 (socket says 172.21.15.2:54710) 2024-09-19T06:22:19.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.226+0000 7fb556ffd640 1 -- 172.21.15.2:0/3138689373 learned_addr learned my addr 172.21.15.2:0/3138689373 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:19.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.227+0000 7fb5567fc640 1 --2- 172.21.15.2:0/3138689373 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556d0b3605d0 0x556d0b36f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:19.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.227+0000 7fb5567fc640 1 --2- 172.21.15.2:0/3138689373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d0b36f780 0x556d0b36ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:19.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.227+0000 7fb556ffd640 1 -- 172.21.15.2:0/3138689373 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556d0b3605d0 msgr2=0x556d0b36f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:19.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.227+0000 7fb556ffd640 1 --2- 172.21.15.2:0/3138689373 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556d0b3605d0 0x556d0b36f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:19.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.227+0000 7fb556ffd640 1 -- 172.21.15.2:0/3138689373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d0b36f780 msgr2=0x556d0b36ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:19.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.227+0000 7fb556ffd640 1 --2- 172.21.15.2:0/3138689373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d0b36f780 0x556d0b36ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:19.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.227+0000 7fb556ffd640 1 -- 172.21.15.2:0/3138689373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d0b0373c0 con 0x556d0b361b40 2024-09-19T06:22:19.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.227+0000 7fb5567fc640 1 --2- 172.21.15.2:0/3138689373 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556d0b3605d0 0x556d0b36f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:19.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.227+0000 7fb556ffd640 1 --2- 172.21.15.2:0/3138689373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556d0b361b40 0x556d0b36c440 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fb550005940 tx=0x7fb550032b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3e7c4a19aa040e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:19.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.227+0000 7fb536ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:22:19.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.227+0000 7fb536ffd640 1 -- 172.21.15.2:0/3138689373 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb550035050 con 0x556d0b361b40 2024-09-19T06:22:19.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.227+0000 7fb536ffd640 1 -- 172.21.15.2:0/3138689373 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7fb550003af0 con 0x556d0b361b40 2024-09-19T06:22:19.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.227+0000 7fb55fe0b740 1 -- 172.21.15.2:0/3138689373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5500316f0 con 0x556d0b361b40 2024-09-19T06:22:19.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.227+0000 7fb536ffd640 1 -- 172.21.15.2:0/3138689373 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb550003cf0 con 0x556d0b361b40 2024-09-19T06:22:19.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.227+0000 7fb55fe0b740 10 client.17925 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:19.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.227+0000 7fb55fe0b740 1 -- 172.21.15.2:0/3138689373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556d0b37def0 con 0x556d0b361b40 2024-09-19T06:22:19.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.228+0000 7fb536ffd640 1 -- 172.21.15.2:0/3138689373 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb5500316f0 con 0x556d0b361b40 2024-09-19T06:22:19.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.228+0000 7fb536ffd640 1 -- 172.21.15.2:0/3138689373 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fb550045600 con 0x556d0b361b40 2024-09-19T06:22:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.228+0000 7fb55fe0b740 10 client.17925 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.228+0000 7fb55fe0b740 10 client.17925 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.228+0000 7fb55fe0b740 20 client.17925 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.228+0000 7fb55fe0b740 1 --2- 172.21.15.2:0/3138689373 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556d0b37f240 0x556d0b381630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.228+0000 7fb55fe0b740 4 client.17925 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:22:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.228+0000 7fb55fe0b740 1 -- 172.21.15.2:0/3138689373 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556d0b2d3860 con 0x556d0b37f240 2024-09-19T06:22:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.228+0000 7fb5567fc640 1 --2- 172.21.15.2:0/3138689373 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556d0b37f240 0x556d0b381630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.229+0000 7fb536ffd640 10 client.17925 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.229+0000 7fb5567fc640 1 --2- 172.21.15.2:0/3138689373 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556d0b37f240 0x556d0b381630 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0c733a7c9074d35 server_cookie=3fe58233e9f903df in_seq=0 out_seq=0 2024-09-19T06:22:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.229+0000 7fb536ffd640 1 -- 172.21.15.2:0/3138689373 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556d0b2d3860 con 0x556d0b37f240 2024-09-19T06:22:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.229+0000 7fb536ffd640 10 client.17925 handle_command_reply: tid=0 2024-09-19T06:22:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.229+0000 7fb55fe0b740 1 client.17925 shutdown 2024-09-19T06:22:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.229+0000 7fb55fe0b740 1 -- 172.21.15.2:0/3138689373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556d0b361b40 msgr2=0x556d0b36c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.229+0000 7fb55fe0b740 1 --2- 172.21.15.2:0/3138689373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556d0b361b40 0x556d0b36c440 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fb550005940 tx=0x7fb550032b60 comp rx=0 tx=0).stop 2024-09-19T06:22:19.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.230+0000 7fb55fe0b740 1 -- 172.21.15.2:0/3138689373 shutdown_connections 2024-09-19T06:22:19.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.230+0000 7fb55fe0b740 1 --2- 172.21.15.2:0/3138689373 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556d0b37f240 0x556d0b381630 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:19.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.230+0000 7fb55fe0b740 1 --2- 172.21.15.2:0/3138689373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d0b36f780 0x556d0b36ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:19.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.230+0000 7fb55fe0b740 1 --2- 172.21.15.2:0/3138689373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556d0b361b40 0x556d0b36c440 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:19.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.230+0000 7fb55fe0b740 1 --2- 172.21.15.2:0/3138689373 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556d0b3605d0 0x556d0b36f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:19.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.230+0000 7fb55fe0b740 1 -- 172.21.15.2:0/3138689373 >> 172.21.15.2:0/3138689373 conn(0x556d0b329310 msgr2=0x556d0b362960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:19.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.230+0000 7fb536ffd640 0 client.17925 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:19.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.230+0000 7fb55fe0b740 1 -- 172.21.15.2:0/3138689373 shutdown_connections 2024-09-19T06:22:19.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.230+0000 7fb55fe0b740 1 -- 172.21.15.2:0/3138689373 wait complete. 2024-09-19T06:22:19.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.230+0000 7fb55fe0b740 20 client.17925 trim_cache size 0 max 16384 2024-09-19T06:22:19.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.243+0000 7fb55fe0b740 1 Processor -- start 2024-09-19T06:22:19.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.243+0000 7fb55fe0b740 1 -- start start 2024-09-19T06:22:19.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.243+0000 7fb55fe0b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d0b3605d0 0x556d0b37b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:19.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.243+0000 7fb55fe0b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556d0b361b40 0x556d0b35ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:19.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.243+0000 7fb55fe0b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556d0b36f780 0x556d0b384650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:19.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.243+0000 7fb55fe0b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb5581ade30 con 0x556d0b36f780 2024-09-19T06:22:19.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.243+0000 7fb55fe0b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb5581ab700 con 0x556d0b3605d0 2024-09-19T06:22:19.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.243+0000 7fb55fe0b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb5581a9570 con 0x556d0b361b40 2024-09-19T06:22:19.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.243+0000 7fb5567fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556d0b36f780 0x556d0b384650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:19.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.243+0000 7fb5567fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556d0b36f780 0x556d0b384650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54716/0 (socket says 172.21.15.2:54716) 2024-09-19T06:22:19.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.243+0000 7fb5567fc640 1 -- 172.21.15.2:0/3530749342 learned_addr learned my addr 172.21.15.2:0/3530749342 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:19.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.243+0000 7fb556ffd640 1 --2- 172.21.15.2:0/3530749342 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556d0b361b40 0x556d0b35ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:19.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.243+0000 7fb5567fc640 1 --2- 172.21.15.2:0/3530749342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d0b3605d0 0x556d0b37b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:19.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.243+0000 7fb5567fc640 1 -- 172.21.15.2:0/3530749342 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556d0b361b40 msgr2=0x556d0b35ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:19.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.243+0000 7fb5567fc640 1 --2- 172.21.15.2:0/3530749342 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556d0b361b40 0x556d0b35ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:19.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.243+0000 7fb5567fc640 1 -- 172.21.15.2:0/3530749342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d0b3605d0 msgr2=0x556d0b37b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:19.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.243+0000 7fb5567fc640 1 --2- 172.21.15.2:0/3530749342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d0b3605d0 0x556d0b37b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:19.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.243+0000 7fb5567fc640 1 -- 172.21.15.2:0/3530749342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d0b35d960 con 0x556d0b36f780 2024-09-19T06:22:19.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.243+0000 7fb5567fc640 1 --2- 172.21.15.2:0/3530749342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556d0b36f780 0x556d0b384650 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fb540004700 tx=0x7fb540005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd66729f4c4823c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:19.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.244+0000 7fb54d7fa640 1 -- 172.21.15.2:0/3530749342 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb540004380 con 0x556d0b36f780 2024-09-19T06:22:19.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.244+0000 7fb54d7fa640 1 -- 172.21.15.2:0/3530749342 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb5400054d0 con 0x556d0b36f780 2024-09-19T06:22:19.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.244+0000 7fb54d7fa640 1 -- 172.21.15.2:0/3530749342 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb540022460 con 0x556d0b36f780 2024-09-19T06:22:19.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.244+0000 7fb55fe0b740 1 -- 172.21.15.2:0/3530749342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556d0b36f780 msgr2=0x556d0b384650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:19.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.244+0000 7fb55fe0b740 1 --2- 172.21.15.2:0/3530749342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556d0b36f780 0x556d0b384650 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fb540004700 tx=0x7fb540005f90 comp rx=0 tx=0).stop 2024-09-19T06:22:19.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.244+0000 7fb55fe0b740 1 -- 172.21.15.2:0/3530749342 shutdown_connections 2024-09-19T06:22:19.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.244+0000 7fb55fe0b740 1 --2- 172.21.15.2:0/3530749342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556d0b36f780 0x556d0b384650 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:19.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.244+0000 7fb55fe0b740 1 --2- 172.21.15.2:0/3530749342 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556d0b361b40 0x556d0b35ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:19.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.244+0000 7fb55fe0b740 1 --2- 172.21.15.2:0/3530749342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d0b3605d0 0x556d0b37b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:19.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.244+0000 7fb55fe0b740 1 -- 172.21.15.2:0/3530749342 >> 172.21.15.2:0/3530749342 conn(0x556d0b329310 msgr2=0x556d0b35c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:19.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.244+0000 7fb55fe0b740 1 -- 172.21.15.2:0/3530749342 shutdown_connections 2024-09-19T06:22:19.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.244+0000 7fb55fe0b740 1 -- 172.21.15.2:0/3530749342 wait complete. 2024-09-19T06:22:19.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.245+0000 7fb55fe0b740 1 -- start start 2024-09-19T06:22:19.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.245+0000 7fb55fe0b740 1 Processor -- start 2024-09-19T06:22:19.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.245+0000 7fb55fe0b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556d0b3605d0 0x556d0b382640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:19.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.245+0000 7fb55fe0b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d0b361b40 0x556d0b382b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:19.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.245+0000 7fb55fe0b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556d0b36f780 0x556d0b3830c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:19.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.245+0000 7fb55fe0b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb5581a9bc0 con 0x556d0b36f780 2024-09-19T06:22:19.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.245+0000 7fb55fe0b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb5581ab030 con 0x556d0b361b40 2024-09-19T06:22:19.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.245+0000 7fb55fe0b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb5581aa290 con 0x556d0b3605d0 2024-09-19T06:22:19.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.245+0000 7fb55fe0b740 10 client.0 _ll_register_callbacks cb 0x7fb550032cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:19.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.246+0000 7fb5567fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556d0b36f780 0x556d0b3830c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:19.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.246+0000 7fb5567fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556d0b36f780 0x556d0b3830c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54732/0 (socket says 172.21.15.2:54732) 2024-09-19T06:22:19.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.246+0000 7fb5567fc640 1 -- 172.21.15.2:0/1804214873 learned_addr learned my addr 172.21.15.2:0/1804214873 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:19.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.246+0000 7fb556ffd640 1 --2- 172.21.15.2:0/1804214873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d0b361b40 0x556d0b382b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:19.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.246+0000 7fb5567fc640 1 --2- 172.21.15.2:0/1804214873 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556d0b3605d0 0x556d0b382640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:19.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.246+0000 7fb5567fc640 1 -- 172.21.15.2:0/1804214873 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556d0b3605d0 msgr2=0x556d0b382640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:19.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.246+0000 7fb5567fc640 1 --2- 172.21.15.2:0/1804214873 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556d0b3605d0 0x556d0b382640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:19.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.246+0000 7fb5567fc640 1 -- 172.21.15.2:0/1804214873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d0b361b40 msgr2=0x556d0b382b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:19.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.246+0000 7fb5567fc640 1 --2- 172.21.15.2:0/1804214873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d0b361b40 0x556d0b382b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:19.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.246+0000 7fb5567fc640 1 -- 172.21.15.2:0/1804214873 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d0b35c4f0 con 0x556d0b36f780 2024-09-19T06:22:19.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.246+0000 7fb556ffd640 1 --2- 172.21.15.2:0/1804214873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d0b361b40 0x556d0b382b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:19.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.246+0000 7fb5567fc640 1 --2- 172.21.15.2:0/1804214873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556d0b36f780 0x556d0b3830c0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fb5400045d0 tx=0x7fb54000bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3188c5e84ecfe4d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:19.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.246+0000 7fb536ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:22:19.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.246+0000 7fb536ffd640 1 -- 172.21.15.2:0/1804214873 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb540033040 con 0x556d0b36f780 2024-09-19T06:22:19.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.246+0000 7fb55fe0b740 1 -- 172.21.15.2:0/1804214873 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5400054d0 con 0x556d0b36f780 2024-09-19T06:22:19.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.246+0000 7fb536ffd640 1 -- 172.21.15.2:0/1804214873 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7fb540004730 con 0x556d0b36f780 2024-09-19T06:22:19.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.246+0000 7fb536ffd640 1 -- 172.21.15.2:0/1804214873 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb54003f050 con 0x556d0b36f780 2024-09-19T06:22:19.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.246+0000 7fb55fe0b740 10 client.17931 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:19.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.246+0000 7fb55fe0b740 1 -- 172.21.15.2:0/1804214873 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556d0b36d3e0 con 0x556d0b36f780 2024-09-19T06:22:19.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.247+0000 7fb536ffd640 1 -- 172.21.15.2:0/1804214873 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb5400054d0 con 0x556d0b36f780 2024-09-19T06:22:19.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.247+0000 7fb536ffd640 1 -- 172.21.15.2:0/1804214873 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fb5400229a0 con 0x556d0b36f780 2024-09-19T06:22:19.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.247+0000 7fb55fe0b740 10 client.17931 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:19.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.247+0000 7fb55fe0b740 10 client.17931 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:19.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.247+0000 7fb55fe0b740 20 client.17931 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:19.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.247+0000 7fb55fe0b740 1 --2- 172.21.15.2:0/1804214873 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556d0b3ea240 0x556d0b3ec630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:19.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.247+0000 7fb55fe0b740 4 client.17931 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:22:19.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.247+0000 7fb55fe0b740 1 -- 172.21.15.2:0/1804214873 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556d0b2cdd70 con 0x556d0b3ea240 2024-09-19T06:22:19.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.247+0000 7fb556ffd640 1 --2- 172.21.15.2:0/1804214873 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556d0b3ea240 0x556d0b3ec630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:19.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.248+0000 7fb536ffd640 10 client.17931 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:19.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.248+0000 7fb556ffd640 1 --2- 172.21.15.2:0/1804214873 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556d0b3ea240 0x556d0b3ec630 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cbe5ad177834a8 server_cookie=4131ccfbd44b3cab in_seq=0 out_seq=0 2024-09-19T06:22:19.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.248+0000 7fb536ffd640 1 -- 172.21.15.2:0/1804214873 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556d0b2cdd70 con 0x556d0b3ea240 2024-09-19T06:22:19.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.248+0000 7fb536ffd640 10 client.17931 handle_command_reply: tid=0 2024-09-19T06:22:19.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.248+0000 7fb55fe0b740 1 client.17931 shutdown 2024-09-19T06:22:19.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.248+0000 7fb55fe0b740 1 -- 172.21.15.2:0/1804214873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556d0b36f780 msgr2=0x556d0b3830c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:19.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.248+0000 7fb55fe0b740 1 --2- 172.21.15.2:0/1804214873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556d0b36f780 0x556d0b3830c0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fb5400045d0 tx=0x7fb54000bd40 comp rx=0 tx=0).stop 2024-09-19T06:22:19.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.248+0000 7fb55fe0b740 1 -- 172.21.15.2:0/1804214873 shutdown_connections 2024-09-19T06:22:19.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.248+0000 7fb55fe0b740 1 --2- 172.21.15.2:0/1804214873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556d0b36f780 0x556d0b3830c0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:19.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.248+0000 7fb55fe0b740 1 --2- 172.21.15.2:0/1804214873 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556d0b3ea240 0x556d0b3ec630 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:19.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.248+0000 7fb55fe0b740 1 --2- 172.21.15.2:0/1804214873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556d0b361b40 0x556d0b382b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:19.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.248+0000 7fb55fe0b740 1 --2- 172.21.15.2:0/1804214873 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556d0b3605d0 0x556d0b382640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:19.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.248+0000 7fb55fe0b740 1 -- 172.21.15.2:0/1804214873 >> 172.21.15.2:0/1804214873 conn(0x556d0b329310 msgr2=0x556d0b36dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:19.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.248+0000 7fb536ffd640 0 client.17931 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:19.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.248+0000 7fb55fe0b740 1 -- 172.21.15.2:0/1804214873 shutdown_connections 2024-09-19T06:22:19.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.248+0000 7fb55fe0b740 1 -- 172.21.15.2:0/1804214873 wait complete. 2024-09-19T06:22:19.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.248+0000 7fb55fe0b740 20 client.17931 trim_cache size 0 max 16384 2024-09-19T06:22:19.256 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:22:19.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.249+0000 7fb55da32640 1 -- 172.21.15.2:0/2189446279 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb5440a33b0 msgr2=0x7fb5440a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:19.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.249+0000 7fb55da32640 1 --2- 172.21.15.2:0/2189446279 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb5440a33b0 0x7fb5440a5870 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb54809b390 tx=0x7fb548066080 comp rx=0 tx=0).stop 2024-09-19T06:22:19.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.249+0000 7fb55da32640 1 -- 172.21.15.2:0/2189446279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb558102ef0 msgr2=0x7fb55819cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:19.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.249+0000 7fb55da32640 1 --2- 172.21.15.2:0/2189446279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb558102ef0 0x7fb55819cca0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fb54800b970 tx=0x7fb54800be30 comp rx=0 tx=0).stop 2024-09-19T06:22:19.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.249+0000 7fb55da32640 1 -- 172.21.15.2:0/2189446279 shutdown_connections 2024-09-19T06:22:19.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.249+0000 7fb55da32640 1 --2- 172.21.15.2:0/2189446279 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb5440a33b0 0x7fb5440a5870 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:19.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.249+0000 7fb55da32640 1 --2- 172.21.15.2:0/2189446279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb558102ef0 0x7fb55819cca0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:19.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.249+0000 7fb55da32640 1 --2- 172.21.15.2:0/2189446279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb558102570 0x7fb558198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:19.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.249+0000 7fb55da32640 1 --2- 172.21.15.2:0/2189446279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb558100e20 0x7fb5581983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:19.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.249+0000 7fb55da32640 1 -- 172.21.15.2:0/2189446279 >> 172.21.15.2:0/2189446279 conn(0x7fb5580fc7d0 msgr2=0x7fb5580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:19.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.249+0000 7fb55da32640 1 -- 172.21.15.2:0/2189446279 shutdown_connections 2024-09-19T06:22:19.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:19.249+0000 7fb55da32640 1 -- 172.21.15.2:0/2189446279 wait complete. 2024-09-19T06:22:19.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:19 smithi002 ceph-mon[30982]: pgmap v232: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 207 B/s wr, 7 op/s 2024-09-19T06:22:19.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:19 smithi090 ceph-mon[34497]: pgmap v232: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 207 B/s wr, 7 op/s 2024-09-19T06:22:19.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:19 smithi089 ceph-mon[34160]: pgmap v232: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 207 B/s wr, 7 op/s 2024-09-19T06:22:20.894 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:22:20.895 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:22:21.164 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:22:21.576 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:21 smithi002 ceph-mon[30982]: pgmap v233: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-19T06:22:21.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.577+0000 7f25b33bf640 1 -- 172.21.15.2:0/3284928034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25ac103660 msgr2=0x7f25ac10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:21.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.577+0000 7f25b33bf640 1 --2- 172.21.15.2:0/3284928034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25ac103660 0x7f25ac10bb50 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f259c009900 tx=0x7f259c02a480 comp rx=0 tx=0).stop 2024-09-19T06:22:21.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.577+0000 7f25b33bf640 1 -- 172.21.15.2:0/3284928034 shutdown_connections 2024-09-19T06:22:21.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.577+0000 7f25b33bf640 1 --2- 172.21.15.2:0/3284928034 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25ac10c170 0x7f25ac10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:21.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.577+0000 7f25b33bf640 1 --2- 172.21.15.2:0/3284928034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25ac103660 0x7f25ac10bb50 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:21.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.577+0000 7f25b33bf640 1 --2- 172.21.15.2:0/3284928034 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25ac102d40 0x7f25ac103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:21.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.577+0000 7f25b33bf640 1 -- 172.21.15.2:0/3284928034 >> 172.21.15.2:0/3284928034 conn(0x7f25ac0fc7a0 msgr2=0x7f25ac0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:21.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.577+0000 7f25b33bf640 1 -- 172.21.15.2:0/3284928034 shutdown_connections 2024-09-19T06:22:21.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.577+0000 7f25b33bf640 1 -- 172.21.15.2:0/3284928034 wait complete. 2024-09-19T06:22:21.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.577+0000 7f25b33bf640 1 Processor -- start 2024-09-19T06:22:21.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.577+0000 7f25b33bf640 1 -- start start 2024-09-19T06:22:21.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.578+0000 7f25b33bf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25ac102d40 0x7f25ac1983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:21.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.578+0000 7f25b33bf640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25ac103660 0x7f25ac198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:21.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.578+0000 7f25b33bf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25ac10c170 0x7f25ac19ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:21.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.578+0000 7f25b33bf640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f25ac111e20 con 0x7f25ac10c170 2024-09-19T06:22:21.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.578+0000 7f25b33bf640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f25ac111ca0 con 0x7f25ac102d40 2024-09-19T06:22:21.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.578+0000 7f25b33bf640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f25ac111fa0 con 0x7f25ac103660 2024-09-19T06:22:21.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.578+0000 7f25b195c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25ac10c170 0x7f25ac19ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:21.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.578+0000 7f25b195c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25ac10c170 0x7f25ac19ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54738/0 (socket says 172.21.15.2:54738) 2024-09-19T06:22:21.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.578+0000 7f25b195c640 1 -- 172.21.15.2:0/3067426796 learned_addr learned my addr 172.21.15.2:0/3067426796 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:21.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.578+0000 7f25b095a640 1 --2- 172.21.15.2:0/3067426796 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25ac103660 0x7f25ac198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:21.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.578+0000 7f25b115b640 1 --2- 172.21.15.2:0/3067426796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25ac102d40 0x7f25ac1983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:21.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.578+0000 7f25b195c640 1 -- 172.21.15.2:0/3067426796 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25ac103660 msgr2=0x7f25ac198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:21.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.578+0000 7f25b195c640 1 --2- 172.21.15.2:0/3067426796 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25ac103660 0x7f25ac198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:21.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.578+0000 7f25b195c640 1 -- 172.21.15.2:0/3067426796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25ac102d40 msgr2=0x7f25ac1983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:21.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.578+0000 7f25b195c640 1 --2- 172.21.15.2:0/3067426796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25ac102d40 0x7f25ac1983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:21.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.578+0000 7f25b195c640 1 -- 172.21.15.2:0/3067426796 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25ac19d390 con 0x7f25ac10c170 2024-09-19T06:22:21.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.578+0000 7f25b115b640 1 --2- 172.21.15.2:0/3067426796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25ac102d40 0x7f25ac1983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:21.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.578+0000 7f25b195c640 1 --2- 172.21.15.2:0/3067426796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25ac10c170 0x7f25ac19ccb0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f25a400eaa0 tx=0x7f25a400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:21.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.578+0000 7f25a27fc640 1 -- 172.21.15.2:0/3067426796 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a400cdb0 con 0x7f25ac10c170 2024-09-19T06:22:21.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.579+0000 7f25a27fc640 1 -- 172.21.15.2:0/3067426796 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f25a4005020 con 0x7f25ac10c170 2024-09-19T06:22:21.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.579+0000 7f25b33bf640 1 -- 172.21.15.2:0/3067426796 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25ac19d680 con 0x7f25ac10c170 2024-09-19T06:22:21.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.579+0000 7f25a27fc640 1 -- 172.21.15.2:0/3067426796 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a40116d0 con 0x7f25ac10c170 2024-09-19T06:22:21.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.579+0000 7f25b33bf640 1 -- 172.21.15.2:0/3067426796 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25ac1a4f60 con 0x7f25ac10c170 2024-09-19T06:22:21.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.581+0000 7f25a27fc640 1 -- 172.21.15.2:0/3067426796 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f25a40051d0 con 0x7f25ac10c170 2024-09-19T06:22:21.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.581+0000 7f25b5798740 1 Processor -- start 2024-09-19T06:22:21.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.581+0000 7f25b5798740 1 -- start start 2024-09-19T06:22:21.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.582+0000 7f25b5798740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559889079b60 0x559889079f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:21.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.582+0000 7f25b5798740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55988907a480 0x559889084800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:21.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.582+0000 7f25b5798740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559889084d40 0x559889087130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:21.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.582+0000 7f25b5798740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559888fdf280 con 0x55988907a480 2024-09-19T06:22:21.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.582+0000 7f25b5798740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x559888f86b10 con 0x559889079b60 2024-09-19T06:22:21.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.582+0000 7f25b5798740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x559888fdb240 con 0x559889084d40 2024-09-19T06:22:21.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.582+0000 7f25b115b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55988907a480 0x559889084800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:21.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.582+0000 7f25b115b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55988907a480 0x559889084800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54740/0 (socket says 172.21.15.2:54740) 2024-09-19T06:22:21.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.582+0000 7f25b115b640 1 -- 172.21.15.2:0/191450840 learned_addr learned my addr 172.21.15.2:0/191450840 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:21.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.582+0000 7f25b095a640 1 --2- 172.21.15.2:0/191450840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559889079b60 0x559889079f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:21.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.582+0000 7f25b095a640 1 --2- 172.21.15.2:0/191450840 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559889084d40 0x559889087130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:21.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.582+0000 7f25b115b640 1 -- 172.21.15.2:0/191450840 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559889084d40 msgr2=0x559889087130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:21.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.582+0000 7f25b115b640 1 --2- 172.21.15.2:0/191450840 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559889084d40 0x559889087130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:21.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.582+0000 7f25b115b640 1 -- 172.21.15.2:0/191450840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559889079b60 msgr2=0x559889079f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:21.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.582+0000 7f25b115b640 1 --2- 172.21.15.2:0/191450840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559889079b60 0x559889079f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:21.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.582+0000 7f25b115b640 1 -- 172.21.15.2:0/191450840 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559888f931f0 con 0x55988907a480 2024-09-19T06:22:21.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.582+0000 7f25a27fc640 1 --2- 172.21.15.2:0/3067426796 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f25980a3430 0x7f25980a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:21.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.582+0000 7f25b095a640 1 --2- 172.21.15.2:0/191450840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559889079b60 0x559889079f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:22:21.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.582+0000 7f25b115b640 1 --2- 172.21.15.2:0/191450840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55988907a480 0x559889084800 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f25a800bd40 tx=0x7f25a800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b475ea0a80e7da5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:21.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.582+0000 7f25b095a640 1 --2- 172.21.15.2:0/3067426796 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f25980a3430 0x7f25980a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:21.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.582+0000 7f25a27fc640 1 -- 172.21.15.2:0/3067426796 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7f25a40cfe70 con 0x7f25ac10c170 2024-09-19T06:22:21.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.583+0000 7f25977fe640 1 -- 172.21.15.2:0/191450840 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a8015070 con 0x55988907a480 2024-09-19T06:22:21.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.583+0000 7f25977fe640 1 -- 172.21.15.2:0/191450840 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f25a800be30 con 0x55988907a480 2024-09-19T06:22:21.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.583+0000 7f25977fe640 1 -- 172.21.15.2:0/191450840 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a8011a00 con 0x55988907a480 2024-09-19T06:22:21.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.583+0000 7f25b5798740 1 -- 172.21.15.2:0/191450840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55988907a480 msgr2=0x559889084800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:21.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.583+0000 7f25b095a640 1 --2- 172.21.15.2:0/3067426796 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f25980a3430 0x7f25980a58f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f259c031440 tx=0x7f259c005b50 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:21.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.583+0000 7f25b5798740 1 --2- 172.21.15.2:0/191450840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55988907a480 0x559889084800 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f25a800bd40 tx=0x7f25a800f730 comp rx=0 tx=0).stop 2024-09-19T06:22:21.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.583+0000 7f25b5798740 1 -- 172.21.15.2:0/191450840 shutdown_connections 2024-09-19T06:22:21.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.583+0000 7f25b5798740 1 --2- 172.21.15.2:0/191450840 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559889084d40 0x559889087130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:21.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.583+0000 7f25b5798740 1 --2- 172.21.15.2:0/191450840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55988907a480 0x559889084800 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:21.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.583+0000 7f25b5798740 1 --2- 172.21.15.2:0/191450840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559889079b60 0x559889079f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:21.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.583+0000 7f25b5798740 1 -- 172.21.15.2:0/191450840 >> 172.21.15.2:0/191450840 conn(0x5598890760f0 msgr2=0x5598890764d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:21.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.583+0000 7f25b5798740 1 -- 172.21.15.2:0/191450840 shutdown_connections 2024-09-19T06:22:21.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.583+0000 7f25b5798740 1 -- 172.21.15.2:0/191450840 wait complete. 2024-09-19T06:22:21.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.584+0000 7f25b5798740 1 -- start start 2024-09-19T06:22:21.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.584+0000 7f25b5798740 1 Processor -- start 2024-09-19T06:22:21.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.584+0000 7f25b5798740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559889079b60 0x559889081c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:21.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.584+0000 7f25b5798740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55988907a480 0x559889082180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:21.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.584+0000 7f25b5798740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559889084d40 0x5598890826c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:21.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.584+0000 7f25b5798740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559889087910 con 0x559889079b60 2024-09-19T06:22:21.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.584+0000 7f25b5798740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x559888f99f10 con 0x55988907a480 2024-09-19T06:22:21.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.584+0000 7f25b5798740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x559889087a90 con 0x559889084d40 2024-09-19T06:22:21.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.584+0000 7f25b5798740 10 client.0 _ll_register_callbacks cb 0x559888f62a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:21.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.584+0000 7f25b115b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559889079b60 0x559889081c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:21.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.584+0000 7f25b115b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559889079b60 0x559889081c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54746/0 (socket says 172.21.15.2:54746) 2024-09-19T06:22:21.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.585+0000 7f25b115b640 1 -- 172.21.15.2:0/137944143 learned_addr learned my addr 172.21.15.2:0/137944143 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:21.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.585+0000 7f25b095a640 1 --2- 172.21.15.2:0/137944143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55988907a480 0x559889082180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:21.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.585+0000 7f25b195c640 1 --2- 172.21.15.2:0/137944143 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559889084d40 0x5598890826c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:21.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.585+0000 7f25b115b640 1 -- 172.21.15.2:0/137944143 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559889084d40 msgr2=0x5598890826c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:21.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.585+0000 7f25b115b640 1 --2- 172.21.15.2:0/137944143 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559889084d40 0x5598890826c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:21.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.585+0000 7f25b115b640 1 -- 172.21.15.2:0/137944143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55988907a480 msgr2=0x559889082180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:21.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.585+0000 7f25b115b640 1 --2- 172.21.15.2:0/137944143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55988907a480 0x559889082180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:21.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.585+0000 7f25b115b640 1 -- 172.21.15.2:0/137944143 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559888d506a0 con 0x559889079b60 2024-09-19T06:22:21.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.585+0000 7f25b115b640 1 --2- 172.21.15.2:0/137944143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559889079b60 0x559889081c40 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f25a800bab0 tx=0x7f25a8005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b9ca05301b836 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:21.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.585+0000 7f2594ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:22:21.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.585+0000 7f2594ff9640 1 -- 172.21.15.2:0/137944143 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a8028060 con 0x559889079b60 2024-09-19T06:22:21.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.585+0000 7f2594ff9640 1 -- 172.21.15.2:0/137944143 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7f25a8005430 con 0x559889079b60 2024-09-19T06:22:21.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.585+0000 7f25b5798740 1 -- 172.21.15.2:0/137944143 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25a800be30 con 0x559889079b60 2024-09-19T06:22:21.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.586+0000 7f2594ff9640 1 -- 172.21.15.2:0/137944143 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f25a8015070 con 0x559889079b60 2024-09-19T06:22:21.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.586+0000 7f25b5798740 10 client.17943 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:21.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.586+0000 7f25b5798740 1 -- 172.21.15.2:0/137944143 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5598890934b0 con 0x559889079b60 2024-09-19T06:22:21.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.586+0000 7f2594ff9640 1 -- 172.21.15.2:0/137944143 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f25a800be30 con 0x559889079b60 2024-09-19T06:22:21.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.586+0000 7f2594ff9640 1 -- 172.21.15.2:0/137944143 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f25a8004a30 con 0x559889079b60 2024-09-19T06:22:21.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.586+0000 7f25b5798740 10 client.17943 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:21.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.586+0000 7f25b5798740 10 client.17943 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:21.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.586+0000 7f25b5798740 20 client.17943 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:21.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.586+0000 7f25b5798740 1 --2- 172.21.15.2:0/137944143 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5598890948b0 0x559889096ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:21.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.586+0000 7f25b5798740 4 client.17943 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:22:21.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.586+0000 7f25b5798740 1 -- 172.21.15.2:0/137944143 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559888fec7f0 con 0x5598890948b0 2024-09-19T06:22:21.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.586+0000 7f25b095a640 1 --2- 172.21.15.2:0/137944143 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5598890948b0 0x559889096ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:21.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.587+0000 7f25b095a640 1 --2- 172.21.15.2:0/137944143 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5598890948b0 0x559889096ca0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a021d60d9a5379d9 server_cookie=836a7bd7fa29a6c8 in_seq=0 out_seq=0 2024-09-19T06:22:21.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.587+0000 7f2594ff9640 10 client.17943 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:21.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.587+0000 7f2594ff9640 1 -- 172.21.15.2:0/137944143 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559888fec7f0 con 0x5598890948b0 2024-09-19T06:22:21.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.587+0000 7f2594ff9640 10 client.17943 handle_command_reply: tid=0 2024-09-19T06:22:21.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.587+0000 7f25b5798740 1 client.17943 shutdown 2024-09-19T06:22:21.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.588+0000 7f25b5798740 1 -- 172.21.15.2:0/137944143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559889079b60 msgr2=0x559889081c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:21.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.588+0000 7f25b5798740 1 --2- 172.21.15.2:0/137944143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559889079b60 0x559889081c40 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f25a800bab0 tx=0x7f25a8005040 comp rx=0 tx=0).stop 2024-09-19T06:22:21.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.588+0000 7f25b5798740 1 -- 172.21.15.2:0/137944143 shutdown_connections 2024-09-19T06:22:21.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.588+0000 7f25b5798740 1 --2- 172.21.15.2:0/137944143 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559889084d40 0x5598890826c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:21.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.588+0000 7f25b5798740 1 --2- 172.21.15.2:0/137944143 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5598890948b0 0x559889096ca0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:21.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.588+0000 7f25b5798740 1 --2- 172.21.15.2:0/137944143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55988907a480 0x559889082180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:21.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.588+0000 7f25b5798740 1 --2- 172.21.15.2:0/137944143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559889079b60 0x559889081c40 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:21.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.588+0000 7f2594ff9640 0 client.17943 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:21.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.588+0000 7f25b5798740 1 -- 172.21.15.2:0/137944143 >> 172.21.15.2:0/137944143 conn(0x5598890760f0 msgr2=0x55988907be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:21.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.588+0000 7f25b5798740 1 -- 172.21.15.2:0/137944143 shutdown_connections 2024-09-19T06:22:21.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.588+0000 7f25b5798740 1 -- 172.21.15.2:0/137944143 wait complete. 2024-09-19T06:22:21.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.588+0000 7f25b5798740 20 client.17943 trim_cache size 0 max 16384 2024-09-19T06:22:21.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.605+0000 7f25b5798740 1 Processor -- start 2024-09-19T06:22:21.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.605+0000 7f25b5798740 1 -- start start 2024-09-19T06:22:21.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.605+0000 7f25b5798740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559889079b60 0x55988909c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:21.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.605+0000 7f25b5798740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55988907a480 0x55988909c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:21.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.605+0000 7f25b5798740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559889084d40 0x559889074a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:21.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.605+0000 7f25b5798740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f25ac1b0180 con 0x55988907a480 2024-09-19T06:22:21.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.605+0000 7f25b5798740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f25ac1ada50 con 0x559889084d40 2024-09-19T06:22:21.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.605+0000 7f25b5798740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f25ac1ab8c0 con 0x559889079b60 2024-09-19T06:22:21.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.606+0000 7f25b095a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55988907a480 0x55988909c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:21.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.606+0000 7f25b095a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55988907a480 0x55988909c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54748/0 (socket says 172.21.15.2:54748) 2024-09-19T06:22:21.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.606+0000 7f25b095a640 1 -- 172.21.15.2:0/177813383 learned_addr learned my addr 172.21.15.2:0/177813383 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:21.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.606+0000 7f25b115b640 1 --2- 172.21.15.2:0/177813383 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559889079b60 0x55988909c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:21.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.606+0000 7f25b195c640 1 --2- 172.21.15.2:0/177813383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559889084d40 0x559889074a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:21.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.606+0000 7f25b095a640 1 -- 172.21.15.2:0/177813383 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559889079b60 msgr2=0x55988909c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:21.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.606+0000 7f25b095a640 1 --2- 172.21.15.2:0/177813383 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559889079b60 0x55988909c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:21.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.606+0000 7f25b095a640 1 -- 172.21.15.2:0/177813383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559889084d40 msgr2=0x559889074a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:21.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.606+0000 7f25b095a640 1 --2- 172.21.15.2:0/177813383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559889084d40 0x559889074a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:21.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.606+0000 7f25b095a640 1 -- 172.21.15.2:0/177813383 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559889071830 con 0x55988907a480 2024-09-19T06:22:21.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.606+0000 7f25b095a640 1 --2- 172.21.15.2:0/177813383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55988907a480 0x55988909c7e0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f259c009900 tx=0x7f259c03f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d75c7b9c94049a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:21.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.606+0000 7f2596ffd640 1 -- 172.21.15.2:0/177813383 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259c043070 con 0x55988907a480 2024-09-19T06:22:21.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.606+0000 7f2596ffd640 1 -- 172.21.15.2:0/177813383 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f259c058070 con 0x55988907a480 2024-09-19T06:22:21.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.606+0000 7f2596ffd640 1 -- 172.21.15.2:0/177813383 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259c035040 con 0x55988907a480 2024-09-19T06:22:21.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.607+0000 7f25b5798740 1 -- 172.21.15.2:0/177813383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55988907a480 msgr2=0x55988909c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:21.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.607+0000 7f25b5798740 1 --2- 172.21.15.2:0/177813383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55988907a480 0x55988909c7e0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f259c009900 tx=0x7f259c03f070 comp rx=0 tx=0).stop 2024-09-19T06:22:21.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.607+0000 7f25b5798740 1 -- 172.21.15.2:0/177813383 shutdown_connections 2024-09-19T06:22:21.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.607+0000 7f25b5798740 1 --2- 172.21.15.2:0/177813383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559889084d40 0x559889074a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:21.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.607+0000 7f25b5798740 1 --2- 172.21.15.2:0/177813383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55988907a480 0x55988909c7e0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:21.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.607+0000 7f25b5798740 1 --2- 172.21.15.2:0/177813383 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559889079b60 0x55988909c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:21.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.607+0000 7f25b5798740 1 -- 172.21.15.2:0/177813383 >> 172.21.15.2:0/177813383 conn(0x5598890760f0 msgr2=0x559889083bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:21.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.607+0000 7f25b5798740 1 -- 172.21.15.2:0/177813383 shutdown_connections 2024-09-19T06:22:21.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.607+0000 7f25b5798740 1 -- 172.21.15.2:0/177813383 wait complete. 2024-09-19T06:22:21.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.607+0000 7f25b5798740 1 -- start start 2024-09-19T06:22:21.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.607+0000 7f25b5798740 1 Processor -- start 2024-09-19T06:22:21.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.608+0000 7f25b5798740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559889079b60 0x55988908d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:21.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.608+0000 7f25b5798740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55988907a480 0x55988907ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:21.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.608+0000 7f25b5798740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559889084d40 0x55988907f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:21.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.608+0000 7f25b5798740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f25ac1abf10 con 0x559889084d40 2024-09-19T06:22:21.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.608+0000 7f25b5798740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f25ac1ad380 con 0x55988907a480 2024-09-19T06:22:21.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.608+0000 7f25b5798740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f25ac1ac5e0 con 0x559889079b60 2024-09-19T06:22:21.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.608+0000 7f25b5798740 10 client.0 _ll_register_callbacks cb 0x7f25a800bbc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:21.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.608+0000 7f25b195c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559889084d40 0x55988907f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:21.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.608+0000 7f25b195c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559889084d40 0x55988907f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54764/0 (socket says 172.21.15.2:54764) 2024-09-19T06:22:21.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.608+0000 7f25b095a640 1 --2- 172.21.15.2:0/1912523748 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55988907a480 0x55988907ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:21.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.608+0000 7f25b195c640 1 -- 172.21.15.2:0/1912523748 learned_addr learned my addr 172.21.15.2:0/1912523748 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:21.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.608+0000 7f25b115b640 1 --2- 172.21.15.2:0/1912523748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559889079b60 0x55988908d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:21.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.608+0000 7f25b195c640 1 -- 172.21.15.2:0/1912523748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559889079b60 msgr2=0x55988908d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:21.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.608+0000 7f25b195c640 1 --2- 172.21.15.2:0/1912523748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559889079b60 0x55988908d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:21.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.608+0000 7f25b195c640 1 -- 172.21.15.2:0/1912523748 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55988907a480 msgr2=0x55988907ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:21.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.608+0000 7f25b195c640 1 --2- 172.21.15.2:0/1912523748 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55988907a480 0x55988907ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:21.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.608+0000 7f25b195c640 1 -- 172.21.15.2:0/1912523748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55988907f8d0 con 0x559889084d40 2024-09-19T06:22:21.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.609+0000 7f25b195c640 1 --2- 172.21.15.2:0/1912523748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559889084d40 0x55988907f0a0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f25a409bdf0 tx=0x7f25a409c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a40f27042d5b08a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:21.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.609+0000 7f2594ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:22:21.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.609+0000 7f2594ff9640 1 -- 172.21.15.2:0/1912523748 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a40b5060 con 0x559889084d40 2024-09-19T06:22:21.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.609+0000 7f2594ff9640 1 -- 172.21.15.2:0/1912523748 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7f25a40bc0b0 con 0x559889084d40 2024-09-19T06:22:21.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.609+0000 7f25b5798740 1 -- 172.21.15.2:0/1912523748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f259c058070 con 0x559889084d40 2024-09-19T06:22:21.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.609+0000 7f2594ff9640 1 -- 172.21.15.2:0/1912523748 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f25a401f070 con 0x559889084d40 2024-09-19T06:22:21.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.609+0000 7f25b5798740 10 client.17949 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:21.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.609+0000 7f25b5798740 1 -- 172.21.15.2:0/1912523748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5598890ff440 con 0x559889084d40 2024-09-19T06:22:21.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.609+0000 7f2594ff9640 1 -- 172.21.15.2:0/1912523748 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f259c058070 con 0x559889084d40 2024-09-19T06:22:21.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.609+0000 7f2594ff9640 1 -- 172.21.15.2:0/1912523748 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f25a40b6020 con 0x559889084d40 2024-09-19T06:22:21.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.609+0000 7f25b5798740 10 client.17949 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:21.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.609+0000 7f25b5798740 10 client.17949 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:21.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.609+0000 7f25b5798740 20 client.17949 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:21.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.609+0000 7f25b5798740 1 --2- 172.21.15.2:0/1912523748 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5598890ffb60 0x559889101f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:21.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.609+0000 7f25b5798740 4 client.17949 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:22:21.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.609+0000 7f25b5798740 1 -- 172.21.15.2:0/1912523748 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559888fe6d00 con 0x5598890ffb60 2024-09-19T06:22:21.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.610+0000 7f25b115b640 1 --2- 172.21.15.2:0/1912523748 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5598890ffb60 0x559889101f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:21.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.610+0000 7f25b115b640 1 --2- 172.21.15.2:0/1912523748 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5598890ffb60 0x559889101f50 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=595ac602c792281f server_cookie=edaf67a076bedbd6 in_seq=0 out_seq=0 2024-09-19T06:22:21.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.610+0000 7f2594ff9640 10 client.17949 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:21.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.611+0000 7f2594ff9640 1 -- 172.21.15.2:0/1912523748 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559888fe6d00 con 0x5598890ffb60 2024-09-19T06:22:21.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.611+0000 7f2594ff9640 10 client.17949 handle_command_reply: tid=0 2024-09-19T06:22:21.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.611+0000 7f25b5798740 1 client.17949 shutdown 2024-09-19T06:22:21.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.611+0000 7f25b5798740 1 -- 172.21.15.2:0/1912523748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559889084d40 msgr2=0x55988907f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:21.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.611+0000 7f25b5798740 1 --2- 172.21.15.2:0/1912523748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559889084d40 0x55988907f0a0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f25a409bdf0 tx=0x7f25a409c930 comp rx=0 tx=0).stop 2024-09-19T06:22:21.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.612+0000 7f25b5798740 1 -- 172.21.15.2:0/1912523748 shutdown_connections 2024-09-19T06:22:21.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.612+0000 7f25b5798740 1 --2- 172.21.15.2:0/1912523748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559889084d40 0x55988907f0a0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:21.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.612+0000 7f25b5798740 1 --2- 172.21.15.2:0/1912523748 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5598890ffb60 0x559889101f50 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:21.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.612+0000 7f25b5798740 1 --2- 172.21.15.2:0/1912523748 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55988907a480 0x55988907ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:21.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.612+0000 7f25b5798740 1 --2- 172.21.15.2:0/1912523748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559889079b60 0x55988908d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:21.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.612+0000 7f2594ff9640 0 client.17949 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:21.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.612+0000 7f25b5798740 1 -- 172.21.15.2:0/1912523748 >> 172.21.15.2:0/1912523748 conn(0x5598890760f0 msgr2=0x559889074a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:21.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.612+0000 7f25b5798740 1 -- 172.21.15.2:0/1912523748 shutdown_connections 2024-09-19T06:22:21.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.612+0000 7f25b5798740 1 -- 172.21.15.2:0/1912523748 wait complete. 2024-09-19T06:22:21.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.612+0000 7f25b5798740 20 client.17949 trim_cache size 0 max 16384 2024-09-19T06:22:21.623 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:22:21.623 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T06:22:21.623 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "ac4baacf-ad00-4670-b43e-4bf2881c6b00", 2024-09-19T06:22:21.623 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T06:22:21.623 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:22:21.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.612+0000 7f25b33bf640 1 -- 172.21.15.2:0/3067426796 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f25980a3430 msgr2=0x7f25980a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:21.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.612+0000 7f25b33bf640 1 --2- 172.21.15.2:0/3067426796 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f25980a3430 0x7f25980a58f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f259c031440 tx=0x7f259c005b50 comp rx=0 tx=0).stop 2024-09-19T06:22:21.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.612+0000 7f25b33bf640 1 -- 172.21.15.2:0/3067426796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25ac10c170 msgr2=0x7f25ac19ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:21.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.612+0000 7f25b33bf640 1 --2- 172.21.15.2:0/3067426796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25ac10c170 0x7f25ac19ccb0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f25a400eaa0 tx=0x7f25a400ef60 comp rx=0 tx=0).stop 2024-09-19T06:22:21.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.612+0000 7f25b33bf640 1 -- 172.21.15.2:0/3067426796 shutdown_connections 2024-09-19T06:22:21.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.612+0000 7f25b33bf640 1 --2- 172.21.15.2:0/3067426796 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f25980a3430 0x7f25980a58f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:21.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.612+0000 7f25b33bf640 1 --2- 172.21.15.2:0/3067426796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25ac10c170 0x7f25ac19ccb0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:21.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.612+0000 7f25b33bf640 1 --2- 172.21.15.2:0/3067426796 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25ac103660 0x7f25ac198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:21.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.612+0000 7f25b33bf640 1 --2- 172.21.15.2:0/3067426796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25ac102d40 0x7f25ac1983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:21.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.612+0000 7f25b33bf640 1 -- 172.21.15.2:0/3067426796 >> 172.21.15.2:0/3067426796 conn(0x7f25ac0fc7a0 msgr2=0x7f25ac0fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:21.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.613+0000 7f25b33bf640 1 -- 172.21.15.2:0/3067426796 shutdown_connections 2024-09-19T06:22:21.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:21.613+0000 7f25b33bf640 1 -- 172.21.15.2:0/3067426796 wait complete. 2024-09-19T06:22:21.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:21 smithi090 ceph-mon[34497]: pgmap v233: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-19T06:22:21.791 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:21 smithi089 ceph-mon[34160]: pgmap v233: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-19T06:22:22.382 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:22:22.643 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:22:22.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:22 smithi002 ceph-mon[30982]: scrub queued for path: / 2024-09-19T06:22:22.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:22 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:22:22.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:22 smithi002 ceph-mon[30982]: scrub summary: active paths [/] 2024-09-19T06:22:22.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:22 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:22:22.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:22 smithi090 ceph-mon[34497]: scrub queued for path: / 2024-09-19T06:22:22.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:22 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:22:22.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:22 smithi090 ceph-mon[34497]: scrub summary: active paths [/] 2024-09-19T06:22:22.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:22 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:22:22.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:22 smithi089 ceph-mon[34160]: scrub queued for path: / 2024-09-19T06:22:22.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:22 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:22:22.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:22 smithi089 ceph-mon[34160]: scrub summary: active paths [/] 2024-09-19T06:22:22.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:22 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:22:23.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.119+0000 7f8e46348640 1 -- 172.21.15.2:0/2069803963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e40100a80 msgr2=0x7f8e40100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:23.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.119+0000 7f8e46348640 1 --2- 172.21.15.2:0/2069803963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e40100a80 0x7f8e40100ee0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f8e34009930 tx=0x7f8e3402a420 comp rx=0 tx=0).stop 2024-09-19T06:22:23.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.119+0000 7f8e46348640 1 -- 172.21.15.2:0/2069803963 shutdown_connections 2024-09-19T06:22:23.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.119+0000 7f8e46348640 1 --2- 172.21.15.2:0/2069803963 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e40101420 0x7f8e4010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:23.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.119+0000 7f8e46348640 1 --2- 172.21.15.2:0/2069803963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e40100a80 0x7f8e40100ee0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:23.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.119+0000 7f8e46348640 1 --2- 172.21.15.2:0/2069803963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e40106a80 0x7f8e40106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:23.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.119+0000 7f8e46348640 1 -- 172.21.15.2:0/2069803963 >> 172.21.15.2:0/2069803963 conn(0x7f8e400fc7a0 msgr2=0x7f8e400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:23.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.119+0000 7f8e46348640 1 -- 172.21.15.2:0/2069803963 shutdown_connections 2024-09-19T06:22:23.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.119+0000 7f8e46348640 1 -- 172.21.15.2:0/2069803963 wait complete. 2024-09-19T06:22:23.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.120+0000 7f8e46348640 1 Processor -- start 2024-09-19T06:22:23.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.120+0000 7f8e46348640 1 -- start start 2024-09-19T06:22:23.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.120+0000 7f8e46348640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e40100a80 0x7f8e40199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:23.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.120+0000 7f8e46348640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e40101420 0x7f8e401996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:23.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.120+0000 7f8e46348640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e40106a80 0x7f8e401a4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:23.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.120+0000 7f8e46348640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8e40110d30 con 0x7f8e40106a80 2024-09-19T06:22:23.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.120+0000 7f8e46348640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8e40110bb0 con 0x7f8e40101420 2024-09-19T06:22:23.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.120+0000 7f8e46348640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8e40110eb0 con 0x7f8e40100a80 2024-09-19T06:22:23.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.121+0000 7f8e448e5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e40106a80 0x7f8e401a4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:23.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.121+0000 7f8e448e5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e40106a80 0x7f8e401a4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54782/0 (socket says 172.21.15.2:54782) 2024-09-19T06:22:23.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.121+0000 7f8e448e5640 1 -- 172.21.15.2:0/67673855 learned_addr learned my addr 172.21.15.2:0/67673855 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:23.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.121+0000 7f8e3f7fe640 1 --2- 172.21.15.2:0/67673855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e40101420 0x7f8e401996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:23.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.121+0000 7f8e3ffff640 1 --2- 172.21.15.2:0/67673855 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e40100a80 0x7f8e40199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:23.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.121+0000 7f8e448e5640 1 -- 172.21.15.2:0/67673855 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e40100a80 msgr2=0x7f8e40199180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:23.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.121+0000 7f8e448e5640 1 --2- 172.21.15.2:0/67673855 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e40100a80 0x7f8e40199180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:23.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.121+0000 7f8e448e5640 1 -- 172.21.15.2:0/67673855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e40101420 msgr2=0x7f8e401996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:23.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.121+0000 7f8e448e5640 1 --2- 172.21.15.2:0/67673855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e40101420 0x7f8e401996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:23.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.121+0000 7f8e448e5640 1 -- 172.21.15.2:0/67673855 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e401a4740 con 0x7f8e40106a80 2024-09-19T06:22:23.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.121+0000 7f8e448e5640 1 --2- 172.21.15.2:0/67673855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e40106a80 0x7f8e401a4200 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f8e3800eb10 tx=0x7f8e3800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:23.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.121+0000 7f8e3d7fa640 1 -- 172.21.15.2:0/67673855 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e38004b20 con 0x7f8e40106a80 2024-09-19T06:22:23.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.121+0000 7f8e3d7fa640 1 -- 172.21.15.2:0/67673855 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8e38004cc0 con 0x7f8e40106a80 2024-09-19T06:22:23.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.121+0000 7f8e46348640 1 -- 172.21.15.2:0/67673855 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e401a4910 con 0x7f8e40106a80 2024-09-19T06:22:23.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.121+0000 7f8e3d7fa640 1 -- 172.21.15.2:0/67673855 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e38010690 con 0x7f8e40106a80 2024-09-19T06:22:23.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.121+0000 7f8e46348640 1 -- 172.21.15.2:0/67673855 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e401a4e20 con 0x7f8e40106a80 2024-09-19T06:22:23.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.124+0000 7f8e48721740 1 Processor -- start 2024-09-19T06:22:23.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.124+0000 7f8e3d7fa640 1 -- 172.21.15.2:0/67673855 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f8e38005020 con 0x7f8e40106a80 2024-09-19T06:22:23.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.124+0000 7f8e48721740 1 -- start start 2024-09-19T06:22:23.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.124+0000 7f8e48721740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c60b2a84a0 0x55c60b2a8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:23.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.124+0000 7f8e48721740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c60b2a8dc0 0x55c60b2b3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:23.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.124+0000 7f8e48721740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c60b2b3680 0x55c60b2b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:23.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.124+0000 7f8e48721740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c60b20e2e0 con 0x55c60b2a84a0 2024-09-19T06:22:23.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.124+0000 7f8e48721740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55c60b1b5ce0 con 0x55c60b2b3680 2024-09-19T06:22:23.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.124+0000 7f8e48721740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55c60b20a2a0 con 0x55c60b2a8dc0 2024-09-19T06:22:23.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.124+0000 7f8e3f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c60b2a84a0 0x55c60b2a8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:23.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.124+0000 7f8e3f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c60b2a84a0 0x55c60b2a8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54784/0 (socket says 172.21.15.2:54784) 2024-09-19T06:22:23.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.124+0000 7f8e3f7fe640 1 -- 172.21.15.2:0/2891049763 learned_addr learned my addr 172.21.15.2:0/2891049763 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:23.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.125+0000 7f8e3ffff640 1 --2- 172.21.15.2:0/2891049763 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c60b2a8dc0 0x55c60b2b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:23.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.125+0000 7f8e3f7fe640 1 --2- 172.21.15.2:0/2891049763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c60b2b3680 0x55c60b2b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:23.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.125+0000 7f8e3f7fe640 1 -- 172.21.15.2:0/2891049763 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c60b2a8dc0 msgr2=0x55c60b2b3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:23.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.125+0000 7f8e3f7fe640 1 --2- 172.21.15.2:0/2891049763 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c60b2a8dc0 0x55c60b2b3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:23.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.125+0000 7f8e3f7fe640 1 -- 172.21.15.2:0/2891049763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c60b2b3680 msgr2=0x55c60b2b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:23.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.125+0000 7f8e3d7fa640 1 --2- 172.21.15.2:0/67673855 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f8e280a33b0 0x7f8e280a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:23.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.125+0000 7f8e3f7fe640 1 --2- 172.21.15.2:0/2891049763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c60b2b3680 0x55c60b2b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:23.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.125+0000 7f8e3f7fe640 1 -- 172.21.15.2:0/2891049763 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c60b19a440 con 0x55c60b2a84a0 2024-09-19T06:22:23.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.125+0000 7f8e448e5640 1 --2- 172.21.15.2:0/67673855 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f8e280a33b0 0x7f8e280a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:23.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.125+0000 7f8e3f7fe640 1 --2- 172.21.15.2:0/2891049763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c60b2a84a0 0x55c60b2a8880 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f8e34000c00 tx=0x7f8e34005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcaa204417b74a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:23.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.125+0000 7f8e3d7fa640 1 -- 172.21.15.2:0/67673855 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7f8e380d03c0 con 0x7f8e40106a80 2024-09-19T06:22:23.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.125+0000 7f8e267fc640 1 -- 172.21.15.2:0/2891049763 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e34044030 con 0x55c60b2a84a0 2024-09-19T06:22:23.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.125+0000 7f8e267fc640 1 -- 172.21.15.2:0/2891049763 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8e34004030 con 0x55c60b2a84a0 2024-09-19T06:22:23.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.125+0000 7f8e267fc640 1 -- 172.21.15.2:0/2891049763 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e34035040 con 0x55c60b2a84a0 2024-09-19T06:22:23.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.126+0000 7f8e48721740 1 -- 172.21.15.2:0/2891049763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c60b2a84a0 msgr2=0x55c60b2a8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:23.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.126+0000 7f8e48721740 1 --2- 172.21.15.2:0/2891049763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c60b2a84a0 0x55c60b2a8880 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f8e34000c00 tx=0x7f8e34005e50 comp rx=0 tx=0).stop 2024-09-19T06:22:23.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.126+0000 7f8e448e5640 1 --2- 172.21.15.2:0/67673855 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f8e280a33b0 0x7f8e280a5870 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8e38098b00 tx=0x7f8e38097040 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:23.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.126+0000 7f8e48721740 1 -- 172.21.15.2:0/2891049763 shutdown_connections 2024-09-19T06:22:23.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.126+0000 7f8e48721740 1 --2- 172.21.15.2:0/2891049763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c60b2b3680 0x55c60b2b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:23.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.126+0000 7f8e48721740 1 --2- 172.21.15.2:0/2891049763 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c60b2a8dc0 0x55c60b2b3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:23.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.126+0000 7f8e48721740 1 --2- 172.21.15.2:0/2891049763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c60b2a84a0 0x55c60b2a8880 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:23.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.126+0000 7f8e48721740 1 -- 172.21.15.2:0/2891049763 >> 172.21.15.2:0/2891049763 conn(0x55c60b2a4a30 msgr2=0x55c60b2a4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:23.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.126+0000 7f8e48721740 1 -- 172.21.15.2:0/2891049763 shutdown_connections 2024-09-19T06:22:23.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.126+0000 7f8e48721740 1 -- 172.21.15.2:0/2891049763 wait complete. 2024-09-19T06:22:23.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.126+0000 7f8e48721740 1 -- start start 2024-09-19T06:22:23.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.127+0000 7f8e48721740 1 Processor -- start 2024-09-19T06:22:23.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.127+0000 7f8e48721740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c60b2a84a0 0x55c60b2b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:23.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.127+0000 7f8e48721740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c60b2a8dc0 0x55c60b2b0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:23.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.127+0000 7f8e48721740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c60b2b3680 0x55c60b2b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:23.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.127+0000 7f8e48721740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c60b2b6250 con 0x55c60b2a84a0 2024-09-19T06:22:23.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.127+0000 7f8e48721740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55c60b1c9050 con 0x55c60b2b3680 2024-09-19T06:22:23.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.127+0000 7f8e48721740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55c60b2b63d0 con 0x55c60b2a8dc0 2024-09-19T06:22:23.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.127+0000 7f8e48721740 10 client.0 _ll_register_callbacks cb 0x55c60b209160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:23.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.127+0000 7f8e3f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c60b2a84a0 0x55c60b2b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:23.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.127+0000 7f8e3f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c60b2a84a0 0x55c60b2b2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54790/0 (socket says 172.21.15.2:54790) 2024-09-19T06:22:23.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.127+0000 7f8e3f7fe640 1 -- 172.21.15.2:0/734076296 learned_addr learned my addr 172.21.15.2:0/734076296 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:23.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.127+0000 7f8e3ffff640 1 --2- 172.21.15.2:0/734076296 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c60b2a8dc0 0x55c60b2b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:23.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.127+0000 7f8e3f7fe640 1 -- 172.21.15.2:0/734076296 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c60b2a8dc0 msgr2=0x55c60b2b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:23.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.127+0000 7f8e3f7fe640 1 --2- 172.21.15.2:0/734076296 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c60b2a8dc0 0x55c60b2b0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:23.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.127+0000 7f8e3f7fe640 1 -- 172.21.15.2:0/734076296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c60b2b3680 msgr2=0x55c60b2b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:23.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.127+0000 7f8e3f7fe640 1 --2- 172.21.15.2:0/734076296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c60b2b3680 0x55c60b2b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:23.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.127+0000 7f8e3f7fe640 1 -- 172.21.15.2:0/734076296 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c60af7f3c0 con 0x55c60b2a84a0 2024-09-19T06:22:23.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.127+0000 7f8e3f7fe640 1 --2- 172.21.15.2:0/734076296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c60b2a84a0 0x55c60b2b2f70 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f8e340092a0 tx=0x7f8e34031c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31f054916abf9d15 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:23.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.127+0000 7f8e1f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:22:23.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.128+0000 7f8e1f7fe640 1 -- 172.21.15.2:0/734076296 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e3404d020 con 0x55c60b2a84a0 2024-09-19T06:22:23.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.128+0000 7f8e1f7fe640 1 -- 172.21.15.2:0/734076296 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7f8e340054f0 con 0x55c60b2a84a0 2024-09-19T06:22:23.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.128+0000 7f8e48721740 1 -- 172.21.15.2:0/734076296 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e34004030 con 0x55c60b2a84a0 2024-09-19T06:22:23.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.128+0000 7f8e1f7fe640 1 -- 172.21.15.2:0/734076296 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8e34035070 con 0x55c60b2a84a0 2024-09-19T06:22:23.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.128+0000 7f8e48721740 10 client.17961 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:23.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.128+0000 7f8e48721740 1 -- 172.21.15.2:0/734076296 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c60b2c1bf0 con 0x55c60b2a84a0 2024-09-19T06:22:23.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.128+0000 7f8e1f7fe640 1 -- 172.21.15.2:0/734076296 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8e34004030 con 0x55c60b2a84a0 2024-09-19T06:22:23.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.128+0000 7f8e1f7fe640 1 -- 172.21.15.2:0/734076296 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f8e340035f0 con 0x55c60b2a84a0 2024-09-19T06:22:23.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.128+0000 7f8e48721740 10 client.17961 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:23.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.128+0000 7f8e48721740 10 client.17961 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:23.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.128+0000 7f8e48721740 20 client.17961 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:23.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.128+0000 7f8e48721740 1 --2- 172.21.15.2:0/734076296 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55c60b2c2f40 0x55c60b2c5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:23.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.128+0000 7f8e48721740 4 client.17961 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:22:23.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.128+0000 7f8e48721740 1 -- 172.21.15.2:0/734076296 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c60b21b850 con 0x55c60b2c2f40 2024-09-19T06:22:23.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.128+0000 7f8e3ffff640 1 --2- 172.21.15.2:0/734076296 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55c60b2c2f40 0x55c60b2c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:23.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.129+0000 7f8e3ffff640 1 --2- 172.21.15.2:0/734076296 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55c60b2c2f40 0x55c60b2c5330 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fecede2783a1a8f server_cookie=9e95032b97b4dcee in_seq=0 out_seq=0 2024-09-19T06:22:23.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.129+0000 7f8e1f7fe640 10 client.17961 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:23.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.130+0000 7f8e1f7fe640 1 -- 172.21.15.2:0/734076296 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c60b21b850 con 0x55c60b2c2f40 2024-09-19T06:22:23.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.130+0000 7f8e1f7fe640 10 client.17961 handle_command_reply: tid=0 2024-09-19T06:22:23.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.130+0000 7f8e48721740 1 client.17961 shutdown 2024-09-19T06:22:23.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.130+0000 7f8e48721740 1 -- 172.21.15.2:0/734076296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c60b2a84a0 msgr2=0x55c60b2b2f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:23.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.130+0000 7f8e48721740 1 --2- 172.21.15.2:0/734076296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c60b2a84a0 0x55c60b2b2f70 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f8e340092a0 tx=0x7f8e34031c20 comp rx=0 tx=0).stop 2024-09-19T06:22:23.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.130+0000 7f8e48721740 1 -- 172.21.15.2:0/734076296 shutdown_connections 2024-09-19T06:22:23.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.130+0000 7f8e48721740 1 --2- 172.21.15.2:0/734076296 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55c60b2c2f40 0x55c60b2c5330 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:23.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.130+0000 7f8e48721740 1 --2- 172.21.15.2:0/734076296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c60b2b3680 0x55c60b2b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:23.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.130+0000 7f8e48721740 1 --2- 172.21.15.2:0/734076296 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c60b2a8dc0 0x55c60b2b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:23.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.130+0000 7f8e48721740 1 --2- 172.21.15.2:0/734076296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c60b2a84a0 0x55c60b2b2f70 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:23.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.130+0000 7f8e1f7fe640 0 client.17961 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:23.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.130+0000 7f8e48721740 1 -- 172.21.15.2:0/734076296 >> 172.21.15.2:0/734076296 conn(0x55c60b2a4a30 msgr2=0x55c60b2aa760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:23.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.130+0000 7f8e48721740 1 -- 172.21.15.2:0/734076296 shutdown_connections 2024-09-19T06:22:23.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.130+0000 7f8e48721740 1 -- 172.21.15.2:0/734076296 wait complete. 2024-09-19T06:22:23.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.130+0000 7f8e48721740 20 client.17961 trim_cache size 0 max 16384 2024-09-19T06:22:23.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.148+0000 7f8e48721740 1 Processor -- start 2024-09-19T06:22:23.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.148+0000 7f8e48721740 1 -- start start 2024-09-19T06:22:23.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.148+0000 7f8e48721740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c60b2a84a0 0x55c60b2aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:23.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.148+0000 7f8e48721740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c60b2a8dc0 0x55c60b2c8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:23.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.148+0000 7f8e48721740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c60b2b3680 0x55c60b2c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:23.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.148+0000 7f8e48721740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8e401b0000 con 0x55c60b2b3680 2024-09-19T06:22:23.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.148+0000 7f8e48721740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8e401ad8d0 con 0x55c60b2a84a0 2024-09-19T06:22:23.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.148+0000 7f8e48721740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8e401ab740 con 0x55c60b2a8dc0 2024-09-19T06:22:23.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.148+0000 7f8e3f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c60b2b3680 0x55c60b2c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:23.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.148+0000 7f8e3f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c60b2b3680 0x55c60b2c88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54804/0 (socket says 172.21.15.2:54804) 2024-09-19T06:22:23.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.148+0000 7f8e3f7fe640 1 -- 172.21.15.2:0/712851607 learned_addr learned my addr 172.21.15.2:0/712851607 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:23.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.148+0000 7f8e3f7fe640 1 --2- 172.21.15.2:0/712851607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c60b2a84a0 0x55c60b2aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:23.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.148+0000 7f8e3ffff640 1 --2- 172.21.15.2:0/712851607 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c60b2a8dc0 0x55c60b2c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:23.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.148+0000 7f8e3f7fe640 1 -- 172.21.15.2:0/712851607 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c60b2a8dc0 msgr2=0x55c60b2c8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:23.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.148+0000 7f8e3f7fe640 1 --2- 172.21.15.2:0/712851607 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c60b2a8dc0 0x55c60b2c8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:23.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.148+0000 7f8e3f7fe640 1 -- 172.21.15.2:0/712851607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c60b2a84a0 msgr2=0x55c60b2aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:23.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.148+0000 7f8e3f7fe640 1 --2- 172.21.15.2:0/712851607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c60b2a84a0 0x55c60b2aeaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:23.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.148+0000 7f8e3f7fe640 1 -- 172.21.15.2:0/712851607 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c60b2a4860 con 0x55c60b2b3680 2024-09-19T06:22:23.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.149+0000 7f8e3f7fe640 1 --2- 172.21.15.2:0/712851607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c60b2b3680 0x55c60b2c88a0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f8e34001eb0 tx=0x7f8e3403f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b825128db338d120 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:23.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.149+0000 7f8e25ffb640 1 -- 172.21.15.2:0/712851607 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e3404d070 con 0x55c60b2b3680 2024-09-19T06:22:23.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.149+0000 7f8e25ffb640 1 -- 172.21.15.2:0/712851607 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8e340035f0 con 0x55c60b2b3680 2024-09-19T06:22:23.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.149+0000 7f8e25ffb640 1 -- 172.21.15.2:0/712851607 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e34044040 con 0x55c60b2b3680 2024-09-19T06:22:23.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.149+0000 7f8e48721740 1 -- 172.21.15.2:0/712851607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c60b2b3680 msgr2=0x55c60b2c88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:23.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.149+0000 7f8e48721740 1 --2- 172.21.15.2:0/712851607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c60b2b3680 0x55c60b2c88a0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f8e34001eb0 tx=0x7f8e3403f040 comp rx=0 tx=0).stop 2024-09-19T06:22:23.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.149+0000 7f8e48721740 1 -- 172.21.15.2:0/712851607 shutdown_connections 2024-09-19T06:22:23.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.149+0000 7f8e48721740 1 --2- 172.21.15.2:0/712851607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c60b2b3680 0x55c60b2c88a0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:23.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.149+0000 7f8e48721740 1 --2- 172.21.15.2:0/712851607 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c60b2a8dc0 0x55c60b2c8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:23.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.149+0000 7f8e48721740 1 --2- 172.21.15.2:0/712851607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c60b2a84a0 0x55c60b2aeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:23.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.149+0000 7f8e48721740 1 -- 172.21.15.2:0/712851607 >> 172.21.15.2:0/712851607 conn(0x55c60b2a4a30 msgr2=0x55c60b2a3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:23.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.149+0000 7f8e48721740 1 -- 172.21.15.2:0/712851607 shutdown_connections 2024-09-19T06:22:23.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.150+0000 7f8e48721740 1 -- 172.21.15.2:0/712851607 wait complete. 2024-09-19T06:22:23.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.150+0000 7f8e48721740 1 -- start start 2024-09-19T06:22:23.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.150+0000 7f8e48721740 1 Processor -- start 2024-09-19T06:22:23.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.150+0000 7f8e48721740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c60b2a84a0 0x55c60b2c8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:23.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.150+0000 7f8e48721740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c60b2a8dc0 0x55c60b2c8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:23.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.150+0000 7f8e48721740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c60b2b3680 0x55c60b324e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:23.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.150+0000 7f8e48721740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8e401abd90 con 0x55c60b2b3680 2024-09-19T06:22:23.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.150+0000 7f8e48721740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8e401ad200 con 0x55c60b2a8dc0 2024-09-19T06:22:23.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.150+0000 7f8e48721740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8e401ac460 con 0x55c60b2a84a0 2024-09-19T06:22:23.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.150+0000 7f8e48721740 10 client.0 _ll_register_callbacks cb 0x7f8e34031df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:23.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.151+0000 7f8e3f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c60b2b3680 0x55c60b324e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:23.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.151+0000 7f8e3ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c60b2a8dc0 0x55c60b2c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:23.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.151+0000 7f8e3f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c60b2b3680 0x55c60b324e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54808/0 (socket says 172.21.15.2:54808) 2024-09-19T06:22:23.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.151+0000 7f8e3ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c60b2a8dc0 0x55c60b2c8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:38022/0 (socket says 172.21.15.2:38022) 2024-09-19T06:22:23.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.151+0000 7f8e3f7fe640 1 -- 172.21.15.2:0/3497024614 learned_addr learned my addr 172.21.15.2:0/3497024614 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:23.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.151+0000 7f8e3f7fe640 1 --2- 172.21.15.2:0/3497024614 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c60b2a84a0 0x55c60b2c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:23.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.151+0000 7f8e3f7fe640 1 -- 172.21.15.2:0/3497024614 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c60b2a84a0 msgr2=0x55c60b2c8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:23.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.151+0000 7f8e3f7fe640 1 --2- 172.21.15.2:0/3497024614 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c60b2a84a0 0x55c60b2c8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:23.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.151+0000 7f8e3f7fe640 1 -- 172.21.15.2:0/3497024614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c60b2a8dc0 msgr2=0x55c60b2c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:23.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.151+0000 7f8e3f7fe640 1 --2- 172.21.15.2:0/3497024614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c60b2a8dc0 0x55c60b2c8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:23.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.151+0000 7f8e3f7fe640 1 -- 172.21.15.2:0/3497024614 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c60b325500 con 0x55c60b2b3680 2024-09-19T06:22:23.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.151+0000 7f8e3ffff640 1 --2- 172.21.15.2:0/3497024614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c60b2a8dc0 0x55c60b2c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:23.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.151+0000 7f8e3f7fe640 1 --2- 172.21.15.2:0/3497024614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c60b2b3680 0x55c60b324e60 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f8e34031c60 tx=0x7f8e340054a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3c32132f067c963 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:23.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.151+0000 7f8e1f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:22:23.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.151+0000 7f8e1f7fe640 1 -- 172.21.15.2:0/3497024614 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e3404d030 con 0x55c60b2b3680 2024-09-19T06:22:23.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.151+0000 7f8e1f7fe640 1 -- 172.21.15.2:0/3497024614 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7f8e34005580 con 0x55c60b2b3680 2024-09-19T06:22:23.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.151+0000 7f8e48721740 1 -- 172.21.15.2:0/3497024614 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e340035f0 con 0x55c60b2b3680 2024-09-19T06:22:23.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.151+0000 7f8e1f7fe640 1 -- 172.21.15.2:0/3497024614 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8e34044040 con 0x55c60b2b3680 2024-09-19T06:22:23.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.152+0000 7f8e48721740 10 client.17967 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:23.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.152+0000 7f8e48721740 1 -- 172.21.15.2:0/3497024614 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c60b325500 con 0x55c60b2b3680 2024-09-19T06:22:23.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.152+0000 7f8e1f7fe640 1 -- 172.21.15.2:0/3497024614 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8e340035f0 con 0x55c60b2b3680 2024-09-19T06:22:23.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.152+0000 7f8e1f7fe640 1 -- 172.21.15.2:0/3497024614 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f8e3406a020 con 0x55c60b2b3680 2024-09-19T06:22:23.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.152+0000 7f8e48721740 10 client.17967 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:23.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.152+0000 7f8e48721740 10 client.17967 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:23.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.152+0000 7f8e48721740 20 client.17967 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:23.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.152+0000 7f8e48721740 1 --2- 172.21.15.2:0/3497024614 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55c60b32dd50 0x55c60b330140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:23.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.152+0000 7f8e48721740 4 client.17967 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:22:23.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.152+0000 7f8e48721740 1 -- 172.21.15.2:0/3497024614 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c60b2b0af0 con 0x55c60b32dd50 2024-09-19T06:22:23.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.152+0000 7f8e3ffff640 1 --2- 172.21.15.2:0/3497024614 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55c60b32dd50 0x55c60b330140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:23.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.153+0000 7f8e3ffff640 1 --2- 172.21.15.2:0/3497024614 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55c60b32dd50 0x55c60b330140 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12181c2e91644527 server_cookie=193b6ed6b4e66aaf in_seq=0 out_seq=0 2024-09-19T06:22:23.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.153+0000 7f8e1f7fe640 10 client.17967 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:23.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.153+0000 7f8e1f7fe640 1 -- 172.21.15.2:0/3497024614 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55c60b2b0af0 con 0x55c60b32dd50 2024-09-19T06:22:23.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.153+0000 7f8e1f7fe640 10 client.17967 handle_command_reply: tid=0 2024-09-19T06:22:23.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.153+0000 7f8e48721740 1 client.17967 shutdown 2024-09-19T06:22:23.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.153+0000 7f8e48721740 1 -- 172.21.15.2:0/3497024614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c60b2b3680 msgr2=0x55c60b324e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:23.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.153+0000 7f8e48721740 1 --2- 172.21.15.2:0/3497024614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c60b2b3680 0x55c60b324e60 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f8e34031c60 tx=0x7f8e340054a0 comp rx=0 tx=0).stop 2024-09-19T06:22:23.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.153+0000 7f8e48721740 1 -- 172.21.15.2:0/3497024614 shutdown_connections 2024-09-19T06:22:23.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.153+0000 7f8e48721740 1 --2- 172.21.15.2:0/3497024614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c60b2b3680 0x55c60b324e60 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:23.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.153+0000 7f8e48721740 1 --2- 172.21.15.2:0/3497024614 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55c60b32dd50 0x55c60b330140 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:23.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.153+0000 7f8e48721740 1 --2- 172.21.15.2:0/3497024614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c60b2a8dc0 0x55c60b2c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:23.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.153+0000 7f8e48721740 1 --2- 172.21.15.2:0/3497024614 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c60b2a84a0 0x55c60b2c8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:23.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.153+0000 7f8e48721740 1 -- 172.21.15.2:0/3497024614 >> 172.21.15.2:0/3497024614 conn(0x55c60b2a4a30 msgr2=0x55c60b2b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:23.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.153+0000 7f8e1f7fe640 0 client.17967 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:23.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.153+0000 7f8e48721740 1 -- 172.21.15.2:0/3497024614 shutdown_connections 2024-09-19T06:22:23.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.153+0000 7f8e48721740 1 -- 172.21.15.2:0/3497024614 wait complete. 2024-09-19T06:22:23.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.153+0000 7f8e48721740 20 client.17967 trim_cache size 0 max 16384 2024-09-19T06:22:23.164 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:22:23.164 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T06:22:23.164 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T06:22:23.164 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:22:23.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.154+0000 7f8e46348640 1 -- 172.21.15.2:0/67673855 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f8e280a33b0 msgr2=0x7f8e280a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:23.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.154+0000 7f8e46348640 1 --2- 172.21.15.2:0/67673855 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f8e280a33b0 0x7f8e280a5870 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8e38098b00 tx=0x7f8e38097040 comp rx=0 tx=0).stop 2024-09-19T06:22:23.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.154+0000 7f8e46348640 1 -- 172.21.15.2:0/67673855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e40106a80 msgr2=0x7f8e401a4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:23.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.154+0000 7f8e46348640 1 --2- 172.21.15.2:0/67673855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e40106a80 0x7f8e401a4200 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f8e3800eb10 tx=0x7f8e3800c2d0 comp rx=0 tx=0).stop 2024-09-19T06:22:23.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.154+0000 7f8e46348640 1 -- 172.21.15.2:0/67673855 shutdown_connections 2024-09-19T06:22:23.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.154+0000 7f8e46348640 1 --2- 172.21.15.2:0/67673855 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f8e280a33b0 0x7f8e280a5870 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:23.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.154+0000 7f8e46348640 1 --2- 172.21.15.2:0/67673855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e40106a80 0x7f8e401a4200 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:23.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.154+0000 7f8e46348640 1 --2- 172.21.15.2:0/67673855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e40101420 0x7f8e401996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:23.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.154+0000 7f8e46348640 1 --2- 172.21.15.2:0/67673855 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e40100a80 0x7f8e40199180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:23.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.154+0000 7f8e46348640 1 -- 172.21.15.2:0/67673855 >> 172.21.15.2:0/67673855 conn(0x7f8e400fc7a0 msgr2=0x7f8e400fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:23.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.154+0000 7f8e46348640 1 -- 172.21.15.2:0/67673855 shutdown_connections 2024-09-19T06:22:23.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:23.154+0000 7f8e46348640 1 -- 172.21.15.2:0/67673855 wait complete. 2024-09-19T06:22:23.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:23 smithi002 ceph-mon[30982]: pgmap v234: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-19T06:22:23.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:23 smithi002 ceph-mon[30982]: scrub summary: idle 2024-09-19T06:22:23.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:23 smithi090 ceph-mon[34497]: pgmap v234: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-19T06:22:23.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:23 smithi090 ceph-mon[34497]: scrub summary: idle 2024-09-19T06:22:23.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:23 smithi089 ceph-mon[34160]: pgmap v234: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-19T06:22:23.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:23 smithi089 ceph-mon[34160]: scrub summary: idle 2024-09-19T06:22:23.861 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:22:23.861 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:22:24.117 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:22:24.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.565+0000 7fb56086f640 1 -- 172.21.15.2:0/4009356689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb55c106f00 msgr2=0x7fb55c10ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:24.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.565+0000 7fb56086f640 1 --2- 172.21.15.2:0/4009356689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb55c106f00 0x7fb55c10ea80 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fb554009ca0 tx=0x7fb55402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:22:24.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.565+0000 7fb56086f640 1 -- 172.21.15.2:0/4009356689 shutdown_connections 2024-09-19T06:22:24.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.565+0000 7fb56086f640 1 --2- 172.21.15.2:0/4009356689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb55c106f00 0x7fb55c10ea80 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:24.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.565+0000 7fb56086f640 1 --2- 172.21.15.2:0/4009356689 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb55c102780 0x7fb55c1067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:24.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.565+0000 7fb56086f640 1 --2- 172.21.15.2:0/4009356689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb55c101dd0 0x7fb55c1021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:24.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.565+0000 7fb56086f640 1 -- 172.21.15.2:0/4009356689 >> 172.21.15.2:0/4009356689 conn(0x7fb55c0fd8b0 msgr2=0x7fb55c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:24.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.565+0000 7fb56086f640 1 -- 172.21.15.2:0/4009356689 shutdown_connections 2024-09-19T06:22:24.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.565+0000 7fb56086f640 1 -- 172.21.15.2:0/4009356689 wait complete. 2024-09-19T06:22:24.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.566+0000 7fb56086f640 1 Processor -- start 2024-09-19T06:22:24.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.566+0000 7fb56086f640 1 -- start start 2024-09-19T06:22:24.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.566+0000 7fb56086f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb55c101dd0 0x7fb55c198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:24.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.566+0000 7fb56086f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb55c102780 0x7fb55c198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:24.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.566+0000 7fb56086f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb55c106f00 0x7fb55c19cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:24.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.566+0000 7fb56086f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb55c111e10 con 0x7fb55c106f00 2024-09-19T06:22:24.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.566+0000 7fb56086f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb55c111c90 con 0x7fb55c101dd0 2024-09-19T06:22:24.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.566+0000 7fb56086f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb55c111f90 con 0x7fb55c102780 2024-09-19T06:22:24.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.566+0000 7fb55ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb55c106f00 0x7fb55c19cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:24.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.566+0000 7fb55ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb55c106f00 0x7fb55c19cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54826/0 (socket says 172.21.15.2:54826) 2024-09-19T06:22:24.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.566+0000 7fb55ad9d640 1 -- 172.21.15.2:0/3788666552 learned_addr learned my addr 172.21.15.2:0/3788666552 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:24.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.566+0000 7fb553fff640 1 --2- 172.21.15.2:0/3788666552 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb55c102780 0x7fb55c198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:24.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.566+0000 7fb55a59c640 1 --2- 172.21.15.2:0/3788666552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb55c101dd0 0x7fb55c198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:24.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.566+0000 7fb55ad9d640 1 -- 172.21.15.2:0/3788666552 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb55c102780 msgr2=0x7fb55c198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:24.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.566+0000 7fb55ad9d640 1 --2- 172.21.15.2:0/3788666552 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb55c102780 0x7fb55c198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:24.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.566+0000 7fb55ad9d640 1 -- 172.21.15.2:0/3788666552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb55c101dd0 msgr2=0x7fb55c198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:24.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.566+0000 7fb55ad9d640 1 --2- 172.21.15.2:0/3788666552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb55c101dd0 0x7fb55c198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:24.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.566+0000 7fb55ad9d640 1 -- 172.21.15.2:0/3788666552 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb55c19d2e0 con 0x7fb55c106f00 2024-09-19T06:22:24.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.566+0000 7fb55a59c640 1 --2- 172.21.15.2:0/3788666552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb55c101dd0 0x7fb55c198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:24.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.567+0000 7fb55ad9d640 1 --2- 172.21.15.2:0/3788666552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb55c106f00 0x7fb55c19cc00 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fb554009dc0 tx=0x7fb554032ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:24.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.567+0000 7fb5537fe640 1 -- 172.21.15.2:0/3788666552 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb554003cf0 con 0x7fb55c106f00 2024-09-19T06:22:24.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.567+0000 7fb5537fe640 1 -- 172.21.15.2:0/3788666552 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb5540044f0 con 0x7fb55c106f00 2024-09-19T06:22:24.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.567+0000 7fb56086f640 1 -- 172.21.15.2:0/3788666552 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb55c19d570 con 0x7fb55c106f00 2024-09-19T06:22:24.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.567+0000 7fb5537fe640 1 -- 172.21.15.2:0/3788666552 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb554030bf0 con 0x7fb55c106f00 2024-09-19T06:22:24.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.567+0000 7fb56086f640 1 -- 172.21.15.2:0/3788666552 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb55c1a4eb0 con 0x7fb55c106f00 2024-09-19T06:22:24.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.568+0000 7fb56086f640 1 -- 172.21.15.2:0/3788666552 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb55c1021b0 con 0x7fb55c106f00 2024-09-19T06:22:24.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.569+0000 7fb5537fe640 1 -- 172.21.15.2:0/3788666552 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fb554004040 con 0x7fb55c106f00 2024-09-19T06:22:24.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.570+0000 7fb5537fe640 1 --2- 172.21.15.2:0/3788666552 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb5480a33b0 0x7fb5480a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:24.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.570+0000 7fb55a59c640 1 --2- 172.21.15.2:0/3788666552 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb5480a33b0 0x7fb5480a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:24.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.570+0000 7fb5537fe640 1 -- 172.21.15.2:0/3788666552 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7fb5540f1390 con 0x7fb55c106f00 2024-09-19T06:22:24.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.571+0000 7fb55a59c640 1 --2- 172.21.15.2:0/3788666552 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb5480a33b0 0x7fb5480a5870 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb54c0058c0 tx=0x7fb54c005850 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:24.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.574+0000 7fb5537fe640 1 -- 172.21.15.2:0/3788666552 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb5540bdf10 con 0x7fb55c106f00 2024-09-19T06:22:24.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.788+0000 7fb56086f640 1 -- 172.21.15.2:0/3788666552 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb55c199690 con 0x7fb55c106f00 2024-09-19T06:22:24.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.789+0000 7fb5537fe640 1 -- 172.21.15.2:0/3788666552 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11882 (secure 0 0 0) 0x7fb55c199690 con 0x7fb55c106f00 2024-09-19T06:22:24.790 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:22:24.790 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-09-19T06:14:49:104280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:14:48.191083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24470,24472,24497]},"id":1}]} 2024-09-19T06:22:24.791 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-09-19T06:22:24.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.791+0000 7fb56086f640 1 -- 172.21.15.2:0/3788666552 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb5480a33b0 msgr2=0x7fb5480a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:24.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.791+0000 7fb56086f640 1 --2- 172.21.15.2:0/3788666552 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb5480a33b0 0x7fb5480a5870 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb54c0058c0 tx=0x7fb54c005850 comp rx=0 tx=0).stop 2024-09-19T06:22:24.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.791+0000 7fb56086f640 1 -- 172.21.15.2:0/3788666552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb55c106f00 msgr2=0x7fb55c19cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:24.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.791+0000 7fb56086f640 1 --2- 172.21.15.2:0/3788666552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb55c106f00 0x7fb55c19cc00 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fb554009dc0 tx=0x7fb554032ff0 comp rx=0 tx=0).stop 2024-09-19T06:22:24.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.791+0000 7fb56086f640 1 -- 172.21.15.2:0/3788666552 shutdown_connections 2024-09-19T06:22:24.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.791+0000 7fb56086f640 1 --2- 172.21.15.2:0/3788666552 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb5480a33b0 0x7fb5480a5870 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:24.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.791+0000 7fb56086f640 1 --2- 172.21.15.2:0/3788666552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb55c106f00 0x7fb55c19cc00 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:24.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.791+0000 7fb56086f640 1 --2- 172.21.15.2:0/3788666552 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb55c102780 0x7fb55c198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:24.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.791+0000 7fb56086f640 1 --2- 172.21.15.2:0/3788666552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb55c101dd0 0x7fb55c198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:24.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.791+0000 7fb56086f640 1 -- 172.21.15.2:0/3788666552 >> 172.21.15.2:0/3788666552 conn(0x7fb55c0fd8b0 msgr2=0x7fb55c0fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:24.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.791+0000 7fb56086f640 1 -- 172.21.15.2:0/3788666552 shutdown_connections 2024-09-19T06:22:24.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:24.791+0000 7fb56086f640 1 -- 172.21.15.2:0/3788666552 wait complete. 2024-09-19T06:22:25.496 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:22:25.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:25 smithi002 ceph-mon[30982]: pgmap v235: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 92 B/s wr, 10 op/s 2024-09-19T06:22:25.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:25 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/3788666552' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:22:25.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:25 smithi090 ceph-mon[34497]: pgmap v235: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 92 B/s wr, 10 op/s 2024-09-19T06:22:25.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:25 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/3788666552' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:22:25.755 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:22:25.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:25 smithi089 ceph-mon[34160]: pgmap v235: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 92 B/s wr, 10 op/s 2024-09-19T06:22:25.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:25 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/3788666552' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:22:26.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.183+0000 7f57c5362640 1 -- 172.21.15.2:0/311628548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57c0106f10 msgr2=0x7f57c010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:26.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.183+0000 7f57c5362640 1 --2- 172.21.15.2:0/311628548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57c0106f10 0x7f57c010ea90 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f57b8009ca0 tx=0x7f57b802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:22:26.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.183+0000 7f57c5362640 1 -- 172.21.15.2:0/311628548 shutdown_connections 2024-09-19T06:22:26.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.183+0000 7f57c5362640 1 --2- 172.21.15.2:0/311628548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57c0106f10 0x7f57c010ea90 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:26.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.183+0000 7f57c5362640 1 --2- 172.21.15.2:0/311628548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57c0102790 0x7f57c01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:26.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.183+0000 7f57c5362640 1 --2- 172.21.15.2:0/311628548 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57c0101de0 0x7f57c01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:26.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.183+0000 7f57c5362640 1 -- 172.21.15.2:0/311628548 >> 172.21.15.2:0/311628548 conn(0x7f57c00fd8c0 msgr2=0x7f57c00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:26.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.183+0000 7f57c5362640 1 -- 172.21.15.2:0/311628548 shutdown_connections 2024-09-19T06:22:26.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.183+0000 7f57c5362640 1 -- 172.21.15.2:0/311628548 wait complete. 2024-09-19T06:22:26.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.184+0000 7f57c5362640 1 Processor -- start 2024-09-19T06:22:26.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.184+0000 7f57c5362640 1 -- start start 2024-09-19T06:22:26.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.184+0000 7f57c5362640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57c0101de0 0x7f57c00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:26.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.184+0000 7f57c5362640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57c0102790 0x7f57c0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:26.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.184+0000 7f57c5362640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57c0106f10 0x7f57c0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:26.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.184+0000 7f57c5362640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f57c0111e20 con 0x7f57c0102790 2024-09-19T06:22:26.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.184+0000 7f57c5362640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f57c0111ca0 con 0x7f57c0106f10 2024-09-19T06:22:26.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.184+0000 7f57c5362640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f57c0111fa0 con 0x7f57c0101de0 2024-09-19T06:22:26.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.184+0000 7f57be7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57c0102790 0x7f57c0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:26.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.184+0000 7f57be7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57c0102790 0x7f57c0074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53194/0 (socket says 172.21.15.2:53194) 2024-09-19T06:22:26.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.184+0000 7f57be7fc640 1 -- 172.21.15.2:0/3422747905 learned_addr learned my addr 172.21.15.2:0/3422747905 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:26.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.184+0000 7f57beffd640 1 --2- 172.21.15.2:0/3422747905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57c0101de0 0x7f57c00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:26.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.185+0000 7f57bf7fe640 1 --2- 172.21.15.2:0/3422747905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57c0106f10 0x7f57c0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:26.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.185+0000 7f57be7fc640 1 -- 172.21.15.2:0/3422747905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57c0101de0 msgr2=0x7f57c00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:26.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.185+0000 7f57be7fc640 1 --2- 172.21.15.2:0/3422747905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57c0101de0 0x7f57c00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:26.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.185+0000 7f57be7fc640 1 -- 172.21.15.2:0/3422747905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57c0106f10 msgr2=0x7f57c0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:26.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.185+0000 7f57be7fc640 1 --2- 172.21.15.2:0/3422747905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57c0106f10 0x7f57c0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:26.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.185+0000 7f57be7fc640 1 -- 172.21.15.2:0/3422747905 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57c01a67e0 con 0x7f57c0102790 2024-09-19T06:22:26.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.185+0000 7f57bf7fe640 1 --2- 172.21.15.2:0/3422747905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57c0106f10 0x7f57c0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:26.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.185+0000 7f57be7fc640 1 --2- 172.21.15.2:0/3422747905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57c0102790 0x7f57c0074a30 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f57b400c890 tx=0x7f57b400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:26.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.185+0000 7f57a7fff640 1 -- 172.21.15.2:0/3422747905 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57b4004220 con 0x7f57c0102790 2024-09-19T06:22:26.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.185+0000 7f57a7fff640 1 -- 172.21.15.2:0/3422747905 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f57b40043c0 con 0x7f57c0102790 2024-09-19T06:22:26.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.185+0000 7f57c5362640 1 -- 172.21.15.2:0/3422747905 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57c01a6ad0 con 0x7f57c0102790 2024-09-19T06:22:26.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.185+0000 7f57a7fff640 1 -- 172.21.15.2:0/3422747905 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57b4004a00 con 0x7f57c0102790 2024-09-19T06:22:26.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.185+0000 7f57c5362640 1 -- 172.21.15.2:0/3422747905 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57c01a7010 con 0x7f57c0102790 2024-09-19T06:22:26.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.188+0000 7f57c773b740 1 Processor -- start 2024-09-19T06:22:26.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.188+0000 7f57a7fff640 1 -- 172.21.15.2:0/3422747905 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f57b4004ba0 con 0x7f57c0102790 2024-09-19T06:22:26.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.188+0000 7f57c773b740 1 -- start start 2024-09-19T06:22:26.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.188+0000 7f57c773b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d3633ab40 0x563d36339090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:26.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.188+0000 7f57c773b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d363395d0 0x563d36339a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:26.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.188+0000 7f57c773b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d36344370 0x563d36346760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:26.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.188+0000 7f57c773b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563d3629f2f0 con 0x563d3633ab40 2024-09-19T06:22:26.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.188+0000 7f57c773b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563d36246cf0 con 0x563d36344370 2024-09-19T06:22:26.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.188+0000 7f57c773b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x563d3629b2b0 con 0x563d363395d0 2024-09-19T06:22:26.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.188+0000 7f57bf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d3633ab40 0x563d36339090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:26.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.188+0000 7f57bf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d3633ab40 0x563d36339090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53200/0 (socket says 172.21.15.2:53200) 2024-09-19T06:22:26.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.188+0000 7f57bf7fe640 1 -- 172.21.15.2:0/990891670 learned_addr learned my addr 172.21.15.2:0/990891670 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:26.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.188+0000 7f57beffd640 1 --2- 172.21.15.2:0/990891670 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d363395d0 0x563d36339a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:26.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.188+0000 7f57be7fc640 1 --2- 172.21.15.2:0/990891670 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d36344370 0x563d36346760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:26.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.189+0000 7f57bf7fe640 1 -- 172.21.15.2:0/990891670 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d363395d0 msgr2=0x563d36339a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:26.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.189+0000 7f57bf7fe640 1 --2- 172.21.15.2:0/990891670 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d363395d0 0x563d36339a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:26.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.189+0000 7f57bf7fe640 1 -- 172.21.15.2:0/990891670 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d36344370 msgr2=0x563d36346760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:26.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.189+0000 7f57bf7fe640 1 --2- 172.21.15.2:0/990891670 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d36344370 0x563d36346760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:26.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.189+0000 7f57bf7fe640 1 -- 172.21.15.2:0/990891670 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d3622b3a0 con 0x563d3633ab40 2024-09-19T06:22:26.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.189+0000 7f57be7fc640 1 --2- 172.21.15.2:0/990891670 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d36344370 0x563d36346760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:22:26.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.189+0000 7f57a7fff640 1 --2- 172.21.15.2:0/3422747905 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f57a80a33b0 0x7f57a80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:26.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.189+0000 7f57beffd640 1 --2- 172.21.15.2:0/3422747905 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f57a80a33b0 0x7f57a80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:26.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.189+0000 7f57bf7fe640 1 --2- 172.21.15.2:0/990891670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d3633ab40 0x563d36339090 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f57b8031b40 tx=0x7f57b8031b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5f8c810e84e565b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:26.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.189+0000 7f57a7fff640 1 -- 172.21.15.2:0/3422747905 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7f57b40cf970 con 0x7f57c0102790 2024-09-19T06:22:26.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.189+0000 7f57a57fa640 1 -- 172.21.15.2:0/990891670 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57b8031650 con 0x563d3633ab40 2024-09-19T06:22:26.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.189+0000 7f57a57fa640 1 -- 172.21.15.2:0/990891670 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f57b8036040 con 0x563d3633ab40 2024-09-19T06:22:26.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.189+0000 7f57a57fa640 1 -- 172.21.15.2:0/990891670 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57b80045c0 con 0x563d3633ab40 2024-09-19T06:22:26.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.190+0000 7f57c773b740 1 -- 172.21.15.2:0/990891670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d3633ab40 msgr2=0x563d36339090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:26.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.190+0000 7f57c773b740 1 --2- 172.21.15.2:0/990891670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d3633ab40 0x563d36339090 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f57b8031b40 tx=0x7f57b8031b70 comp rx=0 tx=0).stop 2024-09-19T06:22:26.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.190+0000 7f57beffd640 1 --2- 172.21.15.2:0/3422747905 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f57a80a33b0 0x7f57a80a5870 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x563d36336ac0 tx=0x7f57b0005f90 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:26.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.190+0000 7f57c773b740 1 -- 172.21.15.2:0/990891670 shutdown_connections 2024-09-19T06:22:26.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.190+0000 7f57c773b740 1 --2- 172.21.15.2:0/990891670 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d36344370 0x563d36346760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:26.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.190+0000 7f57c773b740 1 --2- 172.21.15.2:0/990891670 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d363395d0 0x563d36339a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:26.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.190+0000 7f57c773b740 1 --2- 172.21.15.2:0/990891670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d3633ab40 0x563d36339090 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:26.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.190+0000 7f57c773b740 1 -- 172.21.15.2:0/990891670 >> 172.21.15.2:0/990891670 conn(0x563d36302310 msgr2=0x563d36335c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:26.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.190+0000 7f57c773b740 1 -- 172.21.15.2:0/990891670 shutdown_connections 2024-09-19T06:22:26.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.190+0000 7f57c773b740 1 -- 172.21.15.2:0/990891670 wait complete. 2024-09-19T06:22:26.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.190+0000 7f57c773b740 1 -- start start 2024-09-19T06:22:26.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.190+0000 7f57c773b740 1 Processor -- start 2024-09-19T06:22:26.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.191+0000 7f57c773b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d363395d0 0x563d36343cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:26.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.191+0000 7f57c773b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d3633ab40 0x563d36340f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:26.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.191+0000 7f57c773b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d36344370 0x563d363414d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:26.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.191+0000 7f57c773b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563d36347010 con 0x563d3633ab40 2024-09-19T06:22:26.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.191+0000 7f57c773b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563d3625a060 con 0x563d363395d0 2024-09-19T06:22:26.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.191+0000 7f57c773b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x563d36347190 con 0x563d36344370 2024-09-19T06:22:26.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.191+0000 7f57c773b740 10 client.0 _ll_register_callbacks cb 0x563d35fad8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:26.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.191+0000 7f57be7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d3633ab40 0x563d36340f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:26.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.191+0000 7f57be7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d3633ab40 0x563d36340f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53204/0 (socket says 172.21.15.2:53204) 2024-09-19T06:22:26.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.191+0000 7f57be7fc640 1 -- 172.21.15.2:0/652638706 learned_addr learned my addr 172.21.15.2:0/652638706 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:26.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.191+0000 7f57beffd640 1 --2- 172.21.15.2:0/652638706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d363395d0 0x563d36343cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:26.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.191+0000 7f57bf7fe640 1 --2- 172.21.15.2:0/652638706 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d36344370 0x563d363414d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:26.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.191+0000 7f57be7fc640 1 -- 172.21.15.2:0/652638706 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d36344370 msgr2=0x563d363414d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:26.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.191+0000 7f57be7fc640 1 --2- 172.21.15.2:0/652638706 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d36344370 0x563d363414d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:26.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.191+0000 7f57be7fc640 1 -- 172.21.15.2:0/652638706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d363395d0 msgr2=0x563d36343cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:26.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.191+0000 7f57be7fc640 1 --2- 172.21.15.2:0/652638706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d363395d0 0x563d36343cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:26.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.191+0000 7f57be7fc640 1 -- 172.21.15.2:0/652638706 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d360103c0 con 0x563d3633ab40 2024-09-19T06:22:26.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.191+0000 7f57beffd640 1 --2- 172.21.15.2:0/652638706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d363395d0 0x563d36343cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:26.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.191+0000 7f57be7fc640 1 --2- 172.21.15.2:0/652638706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d3633ab40 0x563d36340f70 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f57b4000c00 tx=0x7f57b409b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fb06040ca3f74b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:26.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.191+0000 7f57a2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:22:26.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.192+0000 7f57a2ff5640 1 -- 172.21.15.2:0/652638706 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57b401d040 con 0x563d3633ab40 2024-09-19T06:22:26.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.192+0000 7f57a2ff5640 1 -- 172.21.15.2:0/652638706 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7f57b40982c0 con 0x563d3633ab40 2024-09-19T06:22:26.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.192+0000 7f57c773b740 1 -- 172.21.15.2:0/652638706 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57b8036040 con 0x563d3633ab40 2024-09-19T06:22:26.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.192+0000 7f57a2ff5640 1 -- 172.21.15.2:0/652638706 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f57b409bc50 con 0x563d3633ab40 2024-09-19T06:22:26.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.192+0000 7f57c773b740 10 client.17985 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:26.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.192+0000 7f57c773b740 1 -- 172.21.15.2:0/652638706 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563d363529c0 con 0x563d3633ab40 2024-09-19T06:22:26.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.192+0000 7f57a2ff5640 1 -- 172.21.15.2:0/652638706 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f57b8036040 con 0x563d3633ab40 2024-09-19T06:22:26.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.192+0000 7f57a2ff5640 1 -- 172.21.15.2:0/652638706 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f57b40979a0 con 0x563d3633ab40 2024-09-19T06:22:26.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.192+0000 7f57c773b740 10 client.17985 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:26.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.192+0000 7f57c773b740 10 client.17985 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:22:26.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.192+0000 7f57c773b740 20 client.17985 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:26.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.192+0000 7f57c773b740 1 --2- 172.21.15.2:0/652638706 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x563d36353e80 0x563d363562d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:26.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.192+0000 7f57c773b740 4 client.17985 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:22:26.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.192+0000 7f57c773b740 1 -- 172.21.15.2:0/652638706 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d362ac860 con 0x563d36353e80 2024-09-19T06:22:26.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.192+0000 7f57beffd640 1 --2- 172.21.15.2:0/652638706 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x563d36353e80 0x563d363562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:26.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.193+0000 7f57a2ff5640 10 client.17985 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:22:26.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.193+0000 7f57beffd640 1 --2- 172.21.15.2:0/652638706 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x563d36353e80 0x563d363562d0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7ec129dc7c43b980 server_cookie=a7f400b568e7ce6f in_seq=0 out_seq=0 2024-09-19T06:22:26.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.194+0000 7f57a2ff5640 1 -- 172.21.15.2:0/652638706 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563d362ac860 con 0x563d36353e80 2024-09-19T06:22:26.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.194+0000 7f57a2ff5640 10 client.17985 handle_command_reply: tid=0 2024-09-19T06:22:26.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.194+0000 7f57c773b740 1 client.17985 shutdown 2024-09-19T06:22:26.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.194+0000 7f57c773b740 1 -- 172.21.15.2:0/652638706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d3633ab40 msgr2=0x563d36340f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:26.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.194+0000 7f57c773b740 1 --2- 172.21.15.2:0/652638706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d3633ab40 0x563d36340f70 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f57b4000c00 tx=0x7f57b409b790 comp rx=0 tx=0).stop 2024-09-19T06:22:26.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.194+0000 7f57c773b740 1 -- 172.21.15.2:0/652638706 shutdown_connections 2024-09-19T06:22:26.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.194+0000 7f57c773b740 1 --2- 172.21.15.2:0/652638706 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x563d36353e80 0x563d363562d0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:26.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.194+0000 7f57c773b740 1 --2- 172.21.15.2:0/652638706 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d36344370 0x563d363414d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:26.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.194+0000 7f57c773b740 1 --2- 172.21.15.2:0/652638706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d3633ab40 0x563d36340f70 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:26.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.194+0000 7f57a2ff5640 0 client.17985 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:22:26.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.194+0000 7f57c773b740 1 --2- 172.21.15.2:0/652638706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d363395d0 0x563d36343cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:26.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.194+0000 7f57c773b740 1 -- 172.21.15.2:0/652638706 >> 172.21.15.2:0/652638706 conn(0x563d36302310 msgr2=0x563d3633b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:26.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.194+0000 7f57c773b740 1 -- 172.21.15.2:0/652638706 shutdown_connections 2024-09-19T06:22:26.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.194+0000 7f57c773b740 1 -- 172.21.15.2:0/652638706 wait complete. 2024-09-19T06:22:26.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.194+0000 7f57c773b740 20 client.17985 trim_cache size 0 max 16384 2024-09-19T06:22:26.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.207+0000 7f57c773b740 1 Processor -- start 2024-09-19T06:22:26.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.207+0000 7f57c773b740 1 -- start start 2024-09-19T06:22:26.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.207+0000 7f57c773b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d363395d0 0x563d363502e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:26.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.207+0000 7f57c773b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d3633ab40 0x563d3633c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:26.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.207+0000 7f57c773b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d36344370 0x563d3633c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:26.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.207+0000 7f57c773b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f57c01b2290 con 0x563d363395d0 2024-09-19T06:22:26.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.207+0000 7f57c773b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f57c01afb60 con 0x563d3633ab40 2024-09-19T06:22:26.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.207+0000 7f57c773b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f57c01ad9d0 con 0x563d36344370 2024-09-19T06:22:26.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.207+0000 7f57beffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d363395d0 0x563d363502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:26.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.207+0000 7f57beffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d363395d0 0x563d363502e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53216/0 (socket says 172.21.15.2:53216) 2024-09-19T06:22:26.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.207+0000 7f57beffd640 1 -- 172.21.15.2:0/2460168122 learned_addr learned my addr 172.21.15.2:0/2460168122 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:26.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.208+0000 7f57beffd640 1 -- 172.21.15.2:0/2460168122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d36344370 msgr2=0x563d3633c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:26.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.208+0000 7f57beffd640 1 --2- 172.21.15.2:0/2460168122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d36344370 0x563d3633c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:26.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.208+0000 7f57beffd640 1 -- 172.21.15.2:0/2460168122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d3633ab40 msgr2=0x563d3633c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:26.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.208+0000 7f57beffd640 1 --2- 172.21.15.2:0/2460168122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d3633ab40 0x563d3633c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:26.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.208+0000 7f57beffd640 1 -- 172.21.15.2:0/2460168122 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d363438e0 con 0x563d363395d0 2024-09-19T06:22:26.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.208+0000 7f57beffd640 1 --2- 172.21.15.2:0/2460168122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d363395d0 0x563d363502e0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x563d36356b10 tx=0x7f57b001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a7f9d8396b1898 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:26.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.208+0000 7f57a4ff9640 1 -- 172.21.15.2:0/2460168122 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57b001dc60 con 0x563d363395d0 2024-09-19T06:22:26.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.208+0000 7f57a4ff9640 1 -- 172.21.15.2:0/2460168122 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f57b001de00 con 0x563d363395d0 2024-09-19T06:22:26.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.208+0000 7f57a4ff9640 1 -- 172.21.15.2:0/2460168122 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57b0004de0 con 0x563d363395d0 2024-09-19T06:22:26.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.208+0000 7f57c773b740 1 -- 172.21.15.2:0/2460168122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d363395d0 msgr2=0x563d363502e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:26.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.208+0000 7f57c773b740 1 --2- 172.21.15.2:0/2460168122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d363395d0 0x563d363502e0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x563d36356b10 tx=0x7f57b001b000 comp rx=0 tx=0).stop 2024-09-19T06:22:26.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.209+0000 7f57c773b740 1 -- 172.21.15.2:0/2460168122 shutdown_connections 2024-09-19T06:22:26.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.209+0000 7f57c773b740 1 --2- 172.21.15.2:0/2460168122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d36344370 0x563d3633c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:26.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.209+0000 7f57c773b740 1 --2- 172.21.15.2:0/2460168122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d3633ab40 0x563d3633c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:26.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.209+0000 7f57c773b740 1 --2- 172.21.15.2:0/2460168122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d363395d0 0x563d363502e0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:26.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.209+0000 7f57c773b740 1 -- 172.21.15.2:0/2460168122 >> 172.21.15.2:0/2460168122 conn(0x563d36302310 msgr2=0x563d36340060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:26.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.209+0000 7f57c773b740 1 -- 172.21.15.2:0/2460168122 shutdown_connections 2024-09-19T06:22:26.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.209+0000 7f57c773b740 1 -- 172.21.15.2:0/2460168122 wait complete. 2024-09-19T06:22:26.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.209+0000 7f57c773b740 1 -- start start 2024-09-19T06:22:26.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.209+0000 7f57c773b740 1 Processor -- start 2024-09-19T06:22:26.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.209+0000 7f57c773b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d363395d0 0x563d3634cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:26.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.209+0000 7f57c773b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d3633ab40 0x563d36348040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:26.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.209+0000 7f57c773b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d36344370 0x563d363487d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:26.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.209+0000 7f57c773b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f57c01ae020 con 0x563d36344370 2024-09-19T06:22:26.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.209+0000 7f57c773b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f57c01af490 con 0x563d3633ab40 2024-09-19T06:22:26.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.209+0000 7f57c773b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f57c01ae6f0 con 0x563d363395d0 2024-09-19T06:22:26.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.209+0000 7f57c773b740 10 client.0 _ll_register_callbacks cb 0x7f57b4084f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:26.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.210+0000 7f57bf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d36344370 0x563d363487d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:26.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.210+0000 7f57bf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d36344370 0x563d363487d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53226/0 (socket says 172.21.15.2:53226) 2024-09-19T06:22:26.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.210+0000 7f57bf7fe640 1 -- 172.21.15.2:0/3998378370 learned_addr learned my addr 172.21.15.2:0/3998378370 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:26.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.210+0000 7f57be7fc640 1 --2- 172.21.15.2:0/3998378370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d3633ab40 0x563d36348040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:26.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.210+0000 7f57beffd640 1 --2- 172.21.15.2:0/3998378370 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d363395d0 0x563d3634cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:26.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.210+0000 7f57bf7fe640 1 -- 172.21.15.2:0/3998378370 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d363395d0 msgr2=0x563d3634cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:26.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.210+0000 7f57bf7fe640 1 --2- 172.21.15.2:0/3998378370 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d363395d0 0x563d3634cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:26.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.210+0000 7f57bf7fe640 1 -- 172.21.15.2:0/3998378370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d3633ab40 msgr2=0x563d36348040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:26.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.210+0000 7f57bf7fe640 1 --2- 172.21.15.2:0/3998378370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d3633ab40 0x563d36348040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:26.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.210+0000 7f57bf7fe640 1 -- 172.21.15.2:0/3998378370 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d363bdb70 con 0x563d36344370 2024-09-19T06:22:26.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.210+0000 7f57beffd640 1 --2- 172.21.15.2:0/3998378370 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d363395d0 0x563d3634cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:26.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.210+0000 7f57bf7fe640 1 --2- 172.21.15.2:0/3998378370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d36344370 0x563d363487d0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f57b8031be0 tx=0x7f57b8009890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dfb198b68a887b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:26.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.210+0000 7f57a2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:22:26.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.210+0000 7f57a2ff5640 1 -- 172.21.15.2:0/3998378370 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57b8031660 con 0x563d36344370 2024-09-19T06:22:26.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.210+0000 7f57a2ff5640 1 -- 172.21.15.2:0/3998378370 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7f57b8031800 con 0x563d36344370 2024-09-19T06:22:26.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.210+0000 7f57c773b740 1 -- 172.21.15.2:0/3998378370 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57b001de00 con 0x563d36344370 2024-09-19T06:22:26.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.211+0000 7f57a2ff5640 1 -- 172.21.15.2:0/3998378370 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f57b805a050 con 0x563d36344370 2024-09-19T06:22:26.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.211+0000 7f57c773b740 10 client.17991 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:26.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.211+0000 7f57c773b740 1 -- 172.21.15.2:0/3998378370 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563d363becf0 con 0x563d36344370 2024-09-19T06:22:26.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.211+0000 7f57a2ff5640 1 -- 172.21.15.2:0/3998378370 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f57b001de00 con 0x563d36344370 2024-09-19T06:22:26.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.211+0000 7f57a2ff5640 1 -- 172.21.15.2:0/3998378370 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f57b8055030 con 0x563d36344370 2024-09-19T06:22:26.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.211+0000 7f57c773b740 10 client.17991 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:26.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.211+0000 7f57c773b740 10 client.17991 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:22:26.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.211+0000 7f57c773b740 20 client.17991 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:26.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.211+0000 7f57c773b740 1 --2- 172.21.15.2:0/3998378370 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x563d363befc0 0x563d363c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:26.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.211+0000 7f57c773b740 4 client.17991 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:22:26.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.211+0000 7f57c773b740 1 -- 172.21.15.2:0/3998378370 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563d362a6d70 con 0x563d363befc0 2024-09-19T06:22:26.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.211+0000 7f57beffd640 1 --2- 172.21.15.2:0/3998378370 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x563d363befc0 0x563d363c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:26.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.212+0000 7f57beffd640 1 --2- 172.21.15.2:0/3998378370 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x563d363befc0 0x563d363c13b0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6c5396bb964d3c0f server_cookie=e1d3c1682331d9d7 in_seq=0 out_seq=0 2024-09-19T06:22:26.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.212+0000 7f57a2ff5640 10 client.17991 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:22:26.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.212+0000 7f57a2ff5640 1 -- 172.21.15.2:0/3998378370 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563d362a6d70 con 0x563d363befc0 2024-09-19T06:22:26.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.212+0000 7f57a2ff5640 10 client.17991 handle_command_reply: tid=0 2024-09-19T06:22:26.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.212+0000 7f57c773b740 1 client.17991 shutdown 2024-09-19T06:22:26.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.212+0000 7f57c773b740 1 -- 172.21.15.2:0/3998378370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d36344370 msgr2=0x563d363487d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:26.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.212+0000 7f57c773b740 1 --2- 172.21.15.2:0/3998378370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d36344370 0x563d363487d0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f57b8031be0 tx=0x7f57b8009890 comp rx=0 tx=0).stop 2024-09-19T06:22:26.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.212+0000 7f57c773b740 1 -- 172.21.15.2:0/3998378370 shutdown_connections 2024-09-19T06:22:26.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.212+0000 7f57c773b740 1 --2- 172.21.15.2:0/3998378370 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x563d363befc0 0x563d363c13b0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:26.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.212+0000 7f57c773b740 1 --2- 172.21.15.2:0/3998378370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d36344370 0x563d363487d0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:26.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.212+0000 7f57c773b740 1 --2- 172.21.15.2:0/3998378370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563d3633ab40 0x563d36348040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:26.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.212+0000 7f57c773b740 1 --2- 172.21.15.2:0/3998378370 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d363395d0 0x563d3634cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:26.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.212+0000 7f57c773b740 1 -- 172.21.15.2:0/3998378370 >> 172.21.15.2:0/3998378370 conn(0x563d36302310 msgr2=0x563d363427d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:26.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.212+0000 7f57a2ff5640 0 client.17991 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:22:26.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.212+0000 7f57c773b740 1 -- 172.21.15.2:0/3998378370 shutdown_connections 2024-09-19T06:22:26.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.212+0000 7f57c773b740 1 -- 172.21.15.2:0/3998378370 wait complete. 2024-09-19T06:22:26.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.212+0000 7f57c773b740 20 client.17991 trim_cache size 0 max 16384 2024-09-19T06:22:26.220 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:22:26.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.213+0000 7f57c5362640 1 -- 172.21.15.2:0/3422747905 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f57a80a33b0 msgr2=0x7f57a80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:26.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.213+0000 7f57c5362640 1 --2- 172.21.15.2:0/3422747905 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f57a80a33b0 0x7f57a80a5870 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x563d36336ac0 tx=0x7f57b0005f90 comp rx=0 tx=0).stop 2024-09-19T06:22:26.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.213+0000 7f57c5362640 1 -- 172.21.15.2:0/3422747905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57c0102790 msgr2=0x7f57c0074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:26.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.213+0000 7f57c5362640 1 --2- 172.21.15.2:0/3422747905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57c0102790 0x7f57c0074a30 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f57b400c890 tx=0x7f57b400cd50 comp rx=0 tx=0).stop 2024-09-19T06:22:26.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.213+0000 7f57c5362640 1 -- 172.21.15.2:0/3422747905 shutdown_connections 2024-09-19T06:22:26.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.213+0000 7f57c5362640 1 --2- 172.21.15.2:0/3422747905 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f57a80a33b0 0x7f57a80a5870 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:26.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.213+0000 7f57c5362640 1 --2- 172.21.15.2:0/3422747905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57c0106f10 0x7f57c0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:26.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.213+0000 7f57c5362640 1 --2- 172.21.15.2:0/3422747905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57c0102790 0x7f57c0074a30 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:26.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.213+0000 7f57c5362640 1 --2- 172.21.15.2:0/3422747905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57c0101de0 0x7f57c00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:26.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.213+0000 7f57c5362640 1 -- 172.21.15.2:0/3422747905 >> 172.21.15.2:0/3422747905 conn(0x7f57c00fd8c0 msgr2=0x7f57c00fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:26.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.213+0000 7f57c5362640 1 -- 172.21.15.2:0/3422747905 shutdown_connections 2024-09-19T06:22:26.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:26.213+0000 7f57c5362640 1 -- 172.21.15.2:0/3422747905 wait complete. 2024-09-19T06:22:26.872 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:22:27.131 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:22:27.549 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:27 smithi002 ceph-mon[30982]: pgmap v236: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:22:27.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.556+0000 7f0dc2534640 1 -- 172.21.15.2:0/2067827248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dbc102790 msgr2=0x7f0dbc1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:27.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.556+0000 7f0dc2534640 1 --2- 172.21.15.2:0/2067827248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dbc102790 0x7f0dbc1067e0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f0db0009900 tx=0x7f0db002a410 comp rx=0 tx=0).stop 2024-09-19T06:22:27.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.556+0000 7f0dc2534640 1 -- 172.21.15.2:0/2067827248 shutdown_connections 2024-09-19T06:22:27.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.556+0000 7f0dc2534640 1 --2- 172.21.15.2:0/2067827248 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0dbc106f10 0x7f0dbc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:27.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.556+0000 7f0dc2534640 1 --2- 172.21.15.2:0/2067827248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dbc102790 0x7f0dbc1067e0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:27.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.556+0000 7f0dc2534640 1 --2- 172.21.15.2:0/2067827248 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0dbc101de0 0x7f0dbc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:27.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.556+0000 7f0dc2534640 1 -- 172.21.15.2:0/2067827248 >> 172.21.15.2:0/2067827248 conn(0x7f0dbc0fd8c0 msgr2=0x7f0dbc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:27.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.556+0000 7f0dc2534640 1 -- 172.21.15.2:0/2067827248 shutdown_connections 2024-09-19T06:22:27.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.556+0000 7f0dc2534640 1 -- 172.21.15.2:0/2067827248 wait complete. 2024-09-19T06:22:27.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.557+0000 7f0dc2534640 1 Processor -- start 2024-09-19T06:22:27.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.557+0000 7f0dc2534640 1 -- start start 2024-09-19T06:22:27.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.557+0000 7f0dc2534640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0dbc101de0 0x7f0dbc1983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:27.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.557+0000 7f0dc2534640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0dbc102790 0x7f0dbc198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:27.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.557+0000 7f0dc2534640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dbc106f10 0x7f0dbc19cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:27.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.557+0000 7f0dc2534640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0dbc111e20 con 0x7f0dbc106f10 2024-09-19T06:22:27.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.557+0000 7f0dc2534640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0dbc111ca0 con 0x7f0dbc101de0 2024-09-19T06:22:27.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.557+0000 7f0dc2534640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0dbc111fa0 con 0x7f0dbc102790 2024-09-19T06:22:27.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.557+0000 7f0dc0ad1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dbc106f10 0x7f0dbc19cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:27.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.557+0000 7f0dc0ad1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dbc106f10 0x7f0dbc19cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53256/0 (socket says 172.21.15.2:53256) 2024-09-19T06:22:27.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.557+0000 7f0dc0ad1640 1 -- 172.21.15.2:0/838021936 learned_addr learned my addr 172.21.15.2:0/838021936 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:27.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.557+0000 7f0dbb7fe640 1 --2- 172.21.15.2:0/838021936 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0dbc102790 0x7f0dbc198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:27.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.558+0000 7f0dbbfff640 1 --2- 172.21.15.2:0/838021936 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0dbc101de0 0x7f0dbc1983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:27.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.558+0000 7f0dc0ad1640 1 -- 172.21.15.2:0/838021936 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0dbc102790 msgr2=0x7f0dbc198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:27.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.558+0000 7f0dc0ad1640 1 --2- 172.21.15.2:0/838021936 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0dbc102790 0x7f0dbc198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:27.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.558+0000 7f0dc0ad1640 1 -- 172.21.15.2:0/838021936 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0dbc101de0 msgr2=0x7f0dbc1983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:27.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.558+0000 7f0dc0ad1640 1 --2- 172.21.15.2:0/838021936 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0dbc101de0 0x7f0dbc1983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:27.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.558+0000 7f0dc0ad1640 1 -- 172.21.15.2:0/838021936 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dbc19d370 con 0x7f0dbc106f10 2024-09-19T06:22:27.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.558+0000 7f0dbbfff640 1 --2- 172.21.15.2:0/838021936 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0dbc101de0 0x7f0dbc1983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:27.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.558+0000 7f0dc0ad1640 1 --2- 172.21.15.2:0/838021936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dbc106f10 0x7f0dbc19cc90 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f0db4009fd0 tx=0x7f0db400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:27.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.558+0000 7f0db97fa640 1 -- 172.21.15.2:0/838021936 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db4017070 con 0x7f0dbc106f10 2024-09-19T06:22:27.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.558+0000 7f0dc2534640 1 -- 172.21.15.2:0/838021936 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dbc19d660 con 0x7f0dbc106f10 2024-09-19T06:22:27.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.558+0000 7f0db97fa640 1 -- 172.21.15.2:0/838021936 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0db4003e20 con 0x7f0dbc106f10 2024-09-19T06:22:27.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.558+0000 7f0db97fa640 1 -- 172.21.15.2:0/838021936 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db4010460 con 0x7f0dbc106f10 2024-09-19T06:22:27.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.558+0000 7f0dc2534640 1 -- 172.21.15.2:0/838021936 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dbc1a4f40 con 0x7f0dbc106f10 2024-09-19T06:22:27.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.560+0000 7f0db97fa640 1 -- 172.21.15.2:0/838021936 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f0db4003970 con 0x7f0dbc106f10 2024-09-19T06:22:27.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.561+0000 7f0dc490d740 1 Processor -- start 2024-09-19T06:22:27.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.561+0000 7f0dc490d740 1 -- start start 2024-09-19T06:22:27.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.561+0000 7f0dc490d740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56071ca6eb40 0x56071ca6d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:27.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.561+0000 7f0dc490d740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56071ca6d5d0 0x56071ca6da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:27.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.561+0000 7f0db97fa640 1 --2- 172.21.15.2:0/838021936 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f0da40a33b0 0x7f0da40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:27.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.561+0000 7f0dc490d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56071ca78370 0x56071ca7a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:27.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.561+0000 7f0dc490d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56071c9d32f0 con 0x56071ca78370 2024-09-19T06:22:27.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.561+0000 7f0dc490d740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56071c97acf0 con 0x56071ca6eb40 2024-09-19T06:22:27.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.561+0000 7f0dc490d740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56071c9cf2b0 con 0x56071ca6d5d0 2024-09-19T06:22:27.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.561+0000 7f0dbb7fe640 1 --2- 172.21.15.2:0/838021936 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f0da40a33b0 0x7f0da40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:27.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.561+0000 7f0dc0ad1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56071ca78370 0x56071ca7a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:27.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.561+0000 7f0dc0ad1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56071ca78370 0x56071ca7a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53268/0 (socket says 172.21.15.2:53268) 2024-09-19T06:22:27.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.561+0000 7f0dc0ad1640 1 -- 172.21.15.2:0/3493100426 learned_addr learned my addr 172.21.15.2:0/3493100426 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:27.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.562+0000 7f0db97fa640 1 -- 172.21.15.2:0/838021936 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7f0db40cfb80 con 0x7f0dbc106f10 2024-09-19T06:22:27.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.562+0000 7f0dbbfff640 1 --2- 172.21.15.2:0/3493100426 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56071ca6d5d0 0x56071ca6da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:27.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.562+0000 7f0dbb7fe640 1 --2- 172.21.15.2:0/3493100426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56071ca6eb40 0x56071ca6d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:27.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.562+0000 7f0dc0ad1640 1 -- 172.21.15.2:0/3493100426 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56071ca6d5d0 msgr2=0x56071ca6da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:27.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.562+0000 7f0dc0ad1640 1 --2- 172.21.15.2:0/3493100426 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56071ca6d5d0 0x56071ca6da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:27.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.562+0000 7f0dc0ad1640 1 -- 172.21.15.2:0/3493100426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56071ca6eb40 msgr2=0x56071ca6d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:27.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.562+0000 7f0dc0ad1640 1 --2- 172.21.15.2:0/3493100426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56071ca6eb40 0x56071ca6d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:27.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.562+0000 7f0dc0ad1640 1 -- 172.21.15.2:0/3493100426 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56071c95f3a0 con 0x56071ca78370 2024-09-19T06:22:27.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.562+0000 7f0dbbfff640 1 --2- 172.21.15.2:0/3493100426 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56071ca6d5d0 0x56071ca6da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:27.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.562+0000 7f0dc0ad1640 1 --2- 172.21.15.2:0/3493100426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56071ca78370 0x56071ca7a760 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f0db400b760 tx=0x7f0db401e7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa9d4f42d10aaceb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:27.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.562+0000 7f0dbb7fe640 1 --2- 172.21.15.2:0/838021936 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f0da40a33b0 0x7f0da40a5870 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0db0031440 tx=0x7f0db0032f30 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:27.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.562+0000 7f0da27fc640 1 -- 172.21.15.2:0/3493100426 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db4003c60 con 0x56071ca78370 2024-09-19T06:22:27.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.562+0000 7f0da27fc640 1 -- 172.21.15.2:0/3493100426 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0db40b6020 con 0x56071ca78370 2024-09-19T06:22:27.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.562+0000 7f0da27fc640 1 -- 172.21.15.2:0/3493100426 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db409a100 con 0x56071ca78370 2024-09-19T06:22:27.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.563+0000 7f0dc490d740 1 -- 172.21.15.2:0/3493100426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56071ca78370 msgr2=0x56071ca7a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:27.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.563+0000 7f0dc490d740 1 --2- 172.21.15.2:0/3493100426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56071ca78370 0x56071ca7a760 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f0db400b760 tx=0x7f0db401e7b0 comp rx=0 tx=0).stop 2024-09-19T06:22:27.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.563+0000 7f0dc490d740 1 -- 172.21.15.2:0/3493100426 shutdown_connections 2024-09-19T06:22:27.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.563+0000 7f0dc490d740 1 --2- 172.21.15.2:0/3493100426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56071ca78370 0x56071ca7a760 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:27.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.563+0000 7f0dc490d740 1 --2- 172.21.15.2:0/3493100426 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56071ca6d5d0 0x56071ca6da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:27.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.563+0000 7f0dc490d740 1 --2- 172.21.15.2:0/3493100426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56071ca6eb40 0x56071ca6d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:27.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.563+0000 7f0dc490d740 1 -- 172.21.15.2:0/3493100426 >> 172.21.15.2:0/3493100426 conn(0x56071ca36310 msgr2=0x56071ca69c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:27.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.563+0000 7f0dc490d740 1 -- 172.21.15.2:0/3493100426 shutdown_connections 2024-09-19T06:22:27.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.563+0000 7f0dc490d740 1 -- 172.21.15.2:0/3493100426 wait complete. 2024-09-19T06:22:27.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.563+0000 7f0dc490d740 1 -- start start 2024-09-19T06:22:27.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.564+0000 7f0dc490d740 1 Processor -- start 2024-09-19T06:22:27.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.564+0000 7f0dc490d740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56071ca6d5d0 0x56071ca77de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:27.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.564+0000 7f0dc490d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56071ca6eb40 0x56071ca75090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:27.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.564+0000 7f0dc490d740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56071ca78370 0x56071ca757d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:27.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.564+0000 7f0dc490d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56071ca7b010 con 0x56071ca6eb40 2024-09-19T06:22:27.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.564+0000 7f0dc490d740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56071c98e060 con 0x56071ca78370 2024-09-19T06:22:27.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.564+0000 7f0dc490d740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56071ca7b190 con 0x56071ca6d5d0 2024-09-19T06:22:27.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.564+0000 7f0dc490d740 10 client.0 _ll_register_callbacks cb 0x56071c6e18c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:27.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.564+0000 7f0dbb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56071ca6eb40 0x56071ca75090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:27.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.564+0000 7f0dbb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56071ca6eb40 0x56071ca75090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53282/0 (socket says 172.21.15.2:53282) 2024-09-19T06:22:27.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.564+0000 7f0dbb7fe640 1 -- 172.21.15.2:0/1927918408 learned_addr learned my addr 172.21.15.2:0/1927918408 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:27.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.564+0000 7f0dbbfff640 1 --2- 172.21.15.2:0/1927918408 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56071ca6d5d0 0x56071ca77de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:27.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.564+0000 7f0dc0ad1640 1 --2- 172.21.15.2:0/1927918408 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56071ca78370 0x56071ca757d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:27.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.564+0000 7f0dbb7fe640 1 -- 172.21.15.2:0/1927918408 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56071ca6d5d0 msgr2=0x56071ca77de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:27.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.564+0000 7f0dbb7fe640 1 --2- 172.21.15.2:0/1927918408 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56071ca6d5d0 0x56071ca77de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:27.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.564+0000 7f0dbb7fe640 1 -- 172.21.15.2:0/1927918408 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56071ca78370 msgr2=0x56071ca757d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:27.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.564+0000 7f0dbb7fe640 1 --2- 172.21.15.2:0/1927918408 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56071ca78370 0x56071ca757d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:27.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.564+0000 7f0dbb7fe640 1 -- 172.21.15.2:0/1927918408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56071c7443c0 con 0x56071ca6eb40 2024-09-19T06:22:27.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.565+0000 7f0dbb7fe640 1 --2- 172.21.15.2:0/1927918408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56071ca6eb40 0x56071ca75090 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f0db0009900 tx=0x7f0db0005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e19d0af01401b2ef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:27.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.565+0000 7f0d9b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:22:27.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.565+0000 7f0d9b7fe640 1 -- 172.21.15.2:0/1927918408 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db0004450 con 0x56071ca6eb40 2024-09-19T06:22:27.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.565+0000 7f0d9b7fe640 1 -- 172.21.15.2:0/1927918408 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7f0db00035f0 con 0x56071ca6eb40 2024-09-19T06:22:27.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.565+0000 7f0dc490d740 1 -- 172.21.15.2:0/1927918408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0db40b6020 con 0x56071ca6eb40 2024-09-19T06:22:27.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.565+0000 7f0d9b7fe640 1 -- 172.21.15.2:0/1927918408 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0db005b050 con 0x56071ca6eb40 2024-09-19T06:22:27.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.565+0000 7f0dc490d740 10 client.18003 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:27.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.565+0000 7f0dc490d740 1 -- 172.21.15.2:0/1927918408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56071ca86b90 con 0x56071ca6eb40 2024-09-19T06:22:27.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.565+0000 7f0d9b7fe640 1 -- 172.21.15.2:0/1927918408 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0db40b6020 con 0x56071ca6eb40 2024-09-19T06:22:27.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.565+0000 7f0d9b7fe640 1 -- 172.21.15.2:0/1927918408 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f0db0032350 con 0x56071ca6eb40 2024-09-19T06:22:27.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.566+0000 7f0dc490d740 10 client.18003 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:27.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.566+0000 7f0dc490d740 10 client.18003 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:22:27.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.566+0000 7f0dc490d740 20 client.18003 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:27.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.566+0000 7f0dc490d740 1 --2- 172.21.15.2:0/1927918408 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x56071ca880a0 0x56071ca8a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:27.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.566+0000 7f0dc490d740 4 client.18003 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:22:27.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.566+0000 7f0dc490d740 1 -- 172.21.15.2:0/1927918408 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56071c9e0860 con 0x56071ca880a0 2024-09-19T06:22:27.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.566+0000 7f0dbbfff640 1 --2- 172.21.15.2:0/1927918408 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x56071ca880a0 0x56071ca8a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:27.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.566+0000 7f0dbbfff640 1 --2- 172.21.15.2:0/1927918408 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x56071ca880a0 0x56071ca8a500 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2316a5e13b6ebd54 server_cookie=e436ac7df21612a6 in_seq=0 out_seq=0 2024-09-19T06:22:27.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.566+0000 7f0d9b7fe640 10 client.18003 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:22:27.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.567+0000 7f0d9b7fe640 1 -- 172.21.15.2:0/1927918408 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56071c9e0860 con 0x56071ca880a0 2024-09-19T06:22:27.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.567+0000 7f0d9b7fe640 10 client.18003 handle_command_reply: tid=0 2024-09-19T06:22:27.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.567+0000 7f0dc490d740 1 client.18003 shutdown 2024-09-19T06:22:27.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.567+0000 7f0dc490d740 1 -- 172.21.15.2:0/1927918408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56071ca6eb40 msgr2=0x56071ca75090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:27.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.567+0000 7f0dc490d740 1 --2- 172.21.15.2:0/1927918408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56071ca6eb40 0x56071ca75090 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f0db0009900 tx=0x7f0db0005780 comp rx=0 tx=0).stop 2024-09-19T06:22:27.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.567+0000 7f0dc490d740 1 -- 172.21.15.2:0/1927918408 shutdown_connections 2024-09-19T06:22:27.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.567+0000 7f0dc490d740 1 --2- 172.21.15.2:0/1927918408 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x56071ca880a0 0x56071ca8a500 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:27.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.567+0000 7f0dc490d740 1 --2- 172.21.15.2:0/1927918408 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56071ca78370 0x56071ca757d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:27.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.567+0000 7f0dc490d740 1 --2- 172.21.15.2:0/1927918408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56071ca6eb40 0x56071ca75090 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:27.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.567+0000 7f0d9b7fe640 0 client.18003 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:22:27.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.567+0000 7f0dc490d740 1 --2- 172.21.15.2:0/1927918408 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56071ca6d5d0 0x56071ca77de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:27.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.567+0000 7f0dc490d740 1 -- 172.21.15.2:0/1927918408 >> 172.21.15.2:0/1927918408 conn(0x56071ca36310 msgr2=0x56071ca6f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:27.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.567+0000 7f0dc490d740 1 -- 172.21.15.2:0/1927918408 shutdown_connections 2024-09-19T06:22:27.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.567+0000 7f0dc490d740 1 -- 172.21.15.2:0/1927918408 wait complete. 2024-09-19T06:22:27.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.567+0000 7f0dc490d740 20 client.18003 trim_cache size 0 max 16384 2024-09-19T06:22:27.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.580+0000 7f0dc490d740 1 Processor -- start 2024-09-19T06:22:27.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.581+0000 7f0dc490d740 1 -- start start 2024-09-19T06:22:27.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.581+0000 7f0dc490d740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56071ca6d5d0 0x56071ca768f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:27.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.581+0000 7f0dc490d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56071ca6eb40 0x56071ca70180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:27.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.581+0000 7f0dc490d740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56071ca78370 0x56071ca706c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:27.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.581+0000 7f0dc490d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0dbc1adea0 con 0x56071ca6eb40 2024-09-19T06:22:27.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.581+0000 7f0dc490d740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0dbc1ab770 con 0x56071ca6d5d0 2024-09-19T06:22:27.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.581+0000 7f0dc490d740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0dbc1a95e0 con 0x56071ca78370 2024-09-19T06:22:27.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.581+0000 7f0dbb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56071ca6eb40 0x56071ca70180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:27.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.581+0000 7f0dbb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56071ca6eb40 0x56071ca70180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53288/0 (socket says 172.21.15.2:53288) 2024-09-19T06:22:27.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.581+0000 7f0dbb7fe640 1 -- 172.21.15.2:0/2859084313 learned_addr learned my addr 172.21.15.2:0/2859084313 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:27.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.581+0000 7f0dbbfff640 1 --2- 172.21.15.2:0/2859084313 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56071ca6d5d0 0x56071ca768f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:27.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.581+0000 7f0dc0ad1640 1 --2- 172.21.15.2:0/2859084313 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56071ca78370 0x56071ca706c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:27.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.581+0000 7f0dbb7fe640 1 -- 172.21.15.2:0/2859084313 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56071ca78370 msgr2=0x56071ca706c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:27.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.581+0000 7f0dbb7fe640 1 --2- 172.21.15.2:0/2859084313 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56071ca78370 0x56071ca706c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:27.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.581+0000 7f0dbb7fe640 1 -- 172.21.15.2:0/2859084313 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56071ca6d5d0 msgr2=0x56071ca768f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:27.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.581+0000 7f0dbb7fe640 1 --2- 172.21.15.2:0/2859084313 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56071ca6d5d0 0x56071ca768f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:27.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.581+0000 7f0dbb7fe640 1 -- 172.21.15.2:0/2859084313 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56071ca777a0 con 0x56071ca6eb40 2024-09-19T06:22:27.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.581+0000 7f0dc0ad1640 1 --2- 172.21.15.2:0/2859084313 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56071ca78370 0x56071ca706c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:22:27.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.581+0000 7f0dbbfff640 1 --2- 172.21.15.2:0/2859084313 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56071ca6d5d0 0x56071ca768f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:27.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.581+0000 7f0dbb7fe640 1 --2- 172.21.15.2:0/2859084313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56071ca6eb40 0x56071ca70180 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f0db0033000 tx=0x7f0db0009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b2d0e2a4947f071 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:27.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.582+0000 7f0da1ffb640 1 -- 172.21.15.2:0/2859084313 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db0004250 con 0x56071ca6eb40 2024-09-19T06:22:27.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.582+0000 7f0da1ffb640 1 -- 172.21.15.2:0/2859084313 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0db0052070 con 0x56071ca6eb40 2024-09-19T06:22:27.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.582+0000 7f0da1ffb640 1 -- 172.21.15.2:0/2859084313 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db00038e0 con 0x56071ca6eb40 2024-09-19T06:22:27.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.582+0000 7f0dc490d740 1 -- 172.21.15.2:0/2859084313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56071ca6eb40 msgr2=0x56071ca70180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:27.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.582+0000 7f0dc490d740 1 --2- 172.21.15.2:0/2859084313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56071ca6eb40 0x56071ca70180 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f0db0033000 tx=0x7f0db0009680 comp rx=0 tx=0).stop 2024-09-19T06:22:27.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.582+0000 7f0dc490d740 1 -- 172.21.15.2:0/2859084313 shutdown_connections 2024-09-19T06:22:27.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.582+0000 7f0dc490d740 1 --2- 172.21.15.2:0/2859084313 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56071ca78370 0x56071ca706c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:27.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.582+0000 7f0dc490d740 1 --2- 172.21.15.2:0/2859084313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56071ca6eb40 0x56071ca70180 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:27.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.582+0000 7f0dc490d740 1 --2- 172.21.15.2:0/2859084313 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56071ca6d5d0 0x56071ca768f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:27.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.582+0000 7f0dc490d740 1 -- 172.21.15.2:0/2859084313 >> 172.21.15.2:0/2859084313 conn(0x56071ca36310 msgr2=0x56071ca74050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:27.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.582+0000 7f0dc490d740 1 -- 172.21.15.2:0/2859084313 shutdown_connections 2024-09-19T06:22:27.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.582+0000 7f0dc490d740 1 -- 172.21.15.2:0/2859084313 wait complete. 2024-09-19T06:22:27.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.583+0000 7f0dc490d740 1 -- start start 2024-09-19T06:22:27.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.583+0000 7f0dc490d740 1 Processor -- start 2024-09-19T06:22:27.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.583+0000 7f0dc490d740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56071ca6d5d0 0x56071ca7c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:27.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.583+0000 7f0dc490d740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56071ca6eb40 0x56071ca7cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:27.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.583+0000 7f0dc490d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56071ca78370 0x56071caf1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:27.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.583+0000 7f0dc490d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0dbc1a9c30 con 0x56071ca78370 2024-09-19T06:22:27.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.583+0000 7f0dc490d740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0dbc1ab0a0 con 0x56071ca6d5d0 2024-09-19T06:22:27.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.583+0000 7f0dc490d740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0dbc1aa300 con 0x56071ca6eb40 2024-09-19T06:22:27.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.583+0000 7f0dc490d740 10 client.0 _ll_register_callbacks cb 0x7f0db0005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:27.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.583+0000 7f0dc0ad1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56071ca78370 0x56071caf1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:27.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.583+0000 7f0dc0ad1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56071ca78370 0x56071caf1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53290/0 (socket says 172.21.15.2:53290) 2024-09-19T06:22:27.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.583+0000 7f0dc0ad1640 1 -- 172.21.15.2:0/3188388174 learned_addr learned my addr 172.21.15.2:0/3188388174 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:27.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.583+0000 7f0dbb7fe640 1 --2- 172.21.15.2:0/3188388174 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56071ca6eb40 0x56071ca7cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:27.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.584+0000 7f0dbbfff640 1 --2- 172.21.15.2:0/3188388174 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56071ca6d5d0 0x56071ca7c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:27.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.584+0000 7f0dc0ad1640 1 -- 172.21.15.2:0/3188388174 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56071ca6eb40 msgr2=0x56071ca7cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:27.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.584+0000 7f0dc0ad1640 1 --2- 172.21.15.2:0/3188388174 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56071ca6eb40 0x56071ca7cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:27.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.584+0000 7f0dc0ad1640 1 -- 172.21.15.2:0/3188388174 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56071ca6d5d0 msgr2=0x56071ca7c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:27.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.584+0000 7f0dc0ad1640 1 --2- 172.21.15.2:0/3188388174 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56071ca6d5d0 0x56071ca7c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:27.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.584+0000 7f0dc0ad1640 1 -- 172.21.15.2:0/3188388174 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56071caf22e0 con 0x56071ca78370 2024-09-19T06:22:27.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.584+0000 7f0dbbfff640 1 --2- 172.21.15.2:0/3188388174 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56071ca6d5d0 0x56071ca7c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:27.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.584+0000 7f0dc0ad1640 1 --2- 172.21.15.2:0/3188388174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56071ca78370 0x56071caf1da0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f0db409bb00 tx=0x7f0db4003c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=776a8466868c7bdd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:27.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.584+0000 7f0d9b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:22:27.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.584+0000 7f0d9b7fe640 1 -- 172.21.15.2:0/3188388174 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db409c500 con 0x56071ca78370 2024-09-19T06:22:27.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.584+0000 7f0d9b7fe640 1 -- 172.21.15.2:0/3188388174 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7f0db4098470 con 0x56071ca78370 2024-09-19T06:22:27.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.584+0000 7f0dc490d740 1 -- 172.21.15.2:0/3188388174 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0db0052070 con 0x56071ca78370 2024-09-19T06:22:27.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.584+0000 7f0d9b7fe640 1 -- 172.21.15.2:0/3188388174 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0db409be00 con 0x56071ca78370 2024-09-19T06:22:27.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.584+0000 7f0dc490d740 10 client.18009 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:27.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.584+0000 7f0dc490d740 1 -- 172.21.15.2:0/3188388174 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56071caf33a0 con 0x56071ca78370 2024-09-19T06:22:27.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.584+0000 7f0d9b7fe640 1 -- 172.21.15.2:0/3188388174 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0db0052070 con 0x56071ca78370 2024-09-19T06:22:27.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.584+0000 7f0d9b7fe640 1 -- 172.21.15.2:0/3188388174 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f0db40b9020 con 0x56071ca78370 2024-09-19T06:22:27.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.585+0000 7f0dc490d740 10 client.18009 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:27.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.585+0000 7f0dc490d740 10 client.18009 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:22:27.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.585+0000 7f0dc490d740 20 client.18009 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:27.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.585+0000 7f0dc490d740 1 --2- 172.21.15.2:0/3188388174 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x56071caf36e0 0x56071caf5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:27.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.585+0000 7f0dc490d740 4 client.18009 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:22:27.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.585+0000 7f0dc490d740 1 -- 172.21.15.2:0/3188388174 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56071c9dad70 con 0x56071caf36e0 2024-09-19T06:22:27.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.585+0000 7f0dbbfff640 1 --2- 172.21.15.2:0/3188388174 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x56071caf36e0 0x56071caf5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:27.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.585+0000 7f0dbbfff640 1 --2- 172.21.15.2:0/3188388174 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x56071caf36e0 0x56071caf5ad0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9d0873d8b7bbf459 server_cookie=3cb19130e8a0ccb8 in_seq=0 out_seq=0 2024-09-19T06:22:27.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.585+0000 7f0d9b7fe640 10 client.18009 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:22:27.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.585+0000 7f0d9b7fe640 1 -- 172.21.15.2:0/3188388174 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56071c9dad70 con 0x56071caf36e0 2024-09-19T06:22:27.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.585+0000 7f0d9b7fe640 10 client.18009 handle_command_reply: tid=0 2024-09-19T06:22:27.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.585+0000 7f0dc490d740 1 client.18009 shutdown 2024-09-19T06:22:27.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.586+0000 7f0dc490d740 1 -- 172.21.15.2:0/3188388174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56071ca78370 msgr2=0x56071caf1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:27.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.586+0000 7f0dc490d740 1 --2- 172.21.15.2:0/3188388174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56071ca78370 0x56071caf1da0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f0db409bb00 tx=0x7f0db4003c60 comp rx=0 tx=0).stop 2024-09-19T06:22:27.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.586+0000 7f0dc490d740 1 -- 172.21.15.2:0/3188388174 shutdown_connections 2024-09-19T06:22:27.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.586+0000 7f0dc490d740 1 --2- 172.21.15.2:0/3188388174 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x56071caf36e0 0x56071caf5ad0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:27.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.586+0000 7f0dc490d740 1 --2- 172.21.15.2:0/3188388174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56071ca78370 0x56071caf1da0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:27.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.586+0000 7f0dc490d740 1 --2- 172.21.15.2:0/3188388174 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56071ca6eb40 0x56071ca7cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:27.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.586+0000 7f0dc490d740 1 --2- 172.21.15.2:0/3188388174 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56071ca6d5d0 0x56071ca7c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:27.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.586+0000 7f0dc490d740 1 -- 172.21.15.2:0/3188388174 >> 172.21.15.2:0/3188388174 conn(0x56071ca36310 msgr2=0x56071ca73830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:27.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.586+0000 7f0d9b7fe640 0 client.18009 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:22:27.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.586+0000 7f0dc490d740 1 -- 172.21.15.2:0/3188388174 shutdown_connections 2024-09-19T06:22:27.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.586+0000 7f0dc490d740 1 -- 172.21.15.2:0/3188388174 wait complete. 2024-09-19T06:22:27.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.586+0000 7f0dc490d740 20 client.18009 trim_cache size 0 max 16384 2024-09-19T06:22:27.594 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:22:27.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.586+0000 7f0dc2534640 1 -- 172.21.15.2:0/838021936 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f0da40a33b0 msgr2=0x7f0da40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:27.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.586+0000 7f0dc2534640 1 --2- 172.21.15.2:0/838021936 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f0da40a33b0 0x7f0da40a5870 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0db0031440 tx=0x7f0db0032f30 comp rx=0 tx=0).stop 2024-09-19T06:22:27.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.586+0000 7f0dc2534640 1 -- 172.21.15.2:0/838021936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dbc106f10 msgr2=0x7f0dbc19cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:27.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.586+0000 7f0dc2534640 1 --2- 172.21.15.2:0/838021936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dbc106f10 0x7f0dbc19cc90 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f0db4009fd0 tx=0x7f0db400b260 comp rx=0 tx=0).stop 2024-09-19T06:22:27.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.586+0000 7f0dc2534640 1 -- 172.21.15.2:0/838021936 shutdown_connections 2024-09-19T06:22:27.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.586+0000 7f0dc2534640 1 --2- 172.21.15.2:0/838021936 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f0da40a33b0 0x7f0da40a5870 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:27.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.587+0000 7f0dc2534640 1 --2- 172.21.15.2:0/838021936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dbc106f10 0x7f0dbc19cc90 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:27.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.587+0000 7f0dc2534640 1 --2- 172.21.15.2:0/838021936 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0dbc102790 0x7f0dbc198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:27.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.587+0000 7f0dc2534640 1 --2- 172.21.15.2:0/838021936 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0dbc101de0 0x7f0dbc1983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:27.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.587+0000 7f0dc2534640 1 -- 172.21.15.2:0/838021936 >> 172.21.15.2:0/838021936 conn(0x7f0dbc0fd8c0 msgr2=0x7f0dbc0fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:27.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.587+0000 7f0dc2534640 1 -- 172.21.15.2:0/838021936 shutdown_connections 2024-09-19T06:22:27.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:27.587+0000 7f0dc2534640 1 -- 172.21.15.2:0/838021936 wait complete. 2024-09-19T06:22:27.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:27 smithi090 ceph-mon[34497]: pgmap v236: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:22:27.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:27 smithi089 ceph-mon[34160]: pgmap v236: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:22:28.449 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:22:28.712 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:22:29.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.123+0000 7f679d77b640 1 -- 172.21.15.2:0/1782892000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6798100e20 msgr2=0x7f6798101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:29.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.123+0000 7f679d77b640 1 --2- 172.21.15.2:0/1782892000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6798100e20 0x7f6798101200 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f6788009ca0 tx=0x7f678802a950 comp rx=0 tx=0).stop 2024-09-19T06:22:29.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.124+0000 7f679d77b640 1 -- 172.21.15.2:0/1782892000 shutdown_connections 2024-09-19T06:22:29.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.124+0000 7f679d77b640 1 --2- 172.21.15.2:0/1782892000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6798102ef0 0x7f679810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.124+0000 7f679d77b640 1 --2- 172.21.15.2:0/1782892000 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6798102570 0x7f67981029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.124+0000 7f679d77b640 1 --2- 172.21.15.2:0/1782892000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6798100e20 0x7f6798101200 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.124+0000 7f679d77b640 1 -- 172.21.15.2:0/1782892000 >> 172.21.15.2:0/1782892000 conn(0x7f67980fc7d0 msgr2=0x7f67980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:29.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.124+0000 7f679d77b640 1 -- 172.21.15.2:0/1782892000 shutdown_connections 2024-09-19T06:22:29.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.124+0000 7f679d77b640 1 -- 172.21.15.2:0/1782892000 wait complete. 2024-09-19T06:22:29.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.124+0000 7f679d77b640 1 Processor -- start 2024-09-19T06:22:29.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.124+0000 7f679d77b640 1 -- start start 2024-09-19T06:22:29.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.125+0000 7f679d77b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6798100e20 0x7f6798103750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:29.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.125+0000 7f679d77b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6798102570 0x7f6798103c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:29.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.125+0000 7f679d77b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6798102ef0 0x7f67981041d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:29.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.125+0000 7f679d77b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6798110e30 con 0x7f6798102570 2024-09-19T06:22:29.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.125+0000 7f679d77b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6798110cb0 con 0x7f6798100e20 2024-09-19T06:22:29.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.125+0000 7f679d77b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6798110fb0 con 0x7f6798102ef0 2024-09-19T06:22:29.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.125+0000 7f67967fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6798102570 0x7f6798103c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:29.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.125+0000 7f67967fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6798102570 0x7f6798103c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53302/0 (socket says 172.21.15.2:53302) 2024-09-19T06:22:29.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.125+0000 7f67967fc640 1 -- 172.21.15.2:0/3838173135 learned_addr learned my addr 172.21.15.2:0/3838173135 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:29.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.125+0000 7f6796ffd640 1 --2- 172.21.15.2:0/3838173135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6798100e20 0x7f6798103750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:29.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.125+0000 7f67977fe640 1 --2- 172.21.15.2:0/3838173135 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6798102ef0 0x7f67981041d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:29.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.125+0000 7f67967fc640 1 -- 172.21.15.2:0/3838173135 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6798102ef0 msgr2=0x7f67981041d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:29.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.125+0000 7f67967fc640 1 --2- 172.21.15.2:0/3838173135 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6798102ef0 0x7f67981041d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.125+0000 7f67967fc640 1 -- 172.21.15.2:0/3838173135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6798100e20 msgr2=0x7f6798103750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:29.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.125+0000 7f67967fc640 1 --2- 172.21.15.2:0/3838173135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6798100e20 0x7f6798103750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.125+0000 7f67967fc640 1 -- 172.21.15.2:0/3838173135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67981a6900 con 0x7f6798102570 2024-09-19T06:22:29.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.125+0000 7f67967fc640 1 --2- 172.21.15.2:0/3838173135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6798102570 0x7f6798103c90 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f678c00d950 tx=0x7f678c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:29.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.126+0000 7f677ffff640 1 -- 172.21.15.2:0/3838173135 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f678c017070 con 0x7f6798102570 2024-09-19T06:22:29.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.126+0000 7f677ffff640 1 -- 172.21.15.2:0/3838173135 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f678c009c30 con 0x7f6798102570 2024-09-19T06:22:29.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.126+0000 7f677ffff640 1 -- 172.21.15.2:0/3838173135 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f678c00f620 con 0x7f6798102570 2024-09-19T06:22:29.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.126+0000 7f679d77b640 1 -- 172.21.15.2:0/3838173135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67981a6bf0 con 0x7f6798102570 2024-09-19T06:22:29.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.126+0000 7f679d77b640 1 -- 172.21.15.2:0/3838173135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67981a70e0 con 0x7f6798102570 2024-09-19T06:22:29.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.129+0000 7f677ffff640 1 -- 172.21.15.2:0/3838173135 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f678c0109a0 con 0x7f6798102570 2024-09-19T06:22:29.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.129+0000 7f679fb54740 1 Processor -- start 2024-09-19T06:22:29.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.129+0000 7f679fb54740 1 -- start start 2024-09-19T06:22:29.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.129+0000 7f679fb54740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56212e6c9b40 0x56212e6c8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:29.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.129+0000 7f679fb54740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56212e6c85d0 0x56212e6c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:29.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.129+0000 7f679fb54740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56212e6d3370 0x56212e6d5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:29.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.129+0000 7f679fb54740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56212e62e2f0 con 0x56212e6c9b40 2024-09-19T06:22:29.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.129+0000 7f679fb54740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56212e5d5cf0 con 0x56212e6d3370 2024-09-19T06:22:29.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.129+0000 7f679fb54740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56212e62a2b0 con 0x56212e6c85d0 2024-09-19T06:22:29.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.129+0000 7f67977fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56212e6c9b40 0x56212e6c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:29.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.129+0000 7f67977fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56212e6c9b40 0x56212e6c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53312/0 (socket says 172.21.15.2:53312) 2024-09-19T06:22:29.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.129+0000 7f67977fe640 1 -- 172.21.15.2:0/4287620981 learned_addr learned my addr 172.21.15.2:0/4287620981 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:29.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.129+0000 7f6796ffd640 1 --2- 172.21.15.2:0/4287620981 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56212e6c85d0 0x56212e6c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:29.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.130+0000 7f677ffff640 1 --2- 172.21.15.2:0/3838173135 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f67800a33b0 0x7f67800a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:29.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.130+0000 7f67977fe640 1 -- 172.21.15.2:0/4287620981 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56212e6c85d0 msgr2=0x56212e6c8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:29.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.130+0000 7f67977fe640 1 --2- 172.21.15.2:0/4287620981 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56212e6c85d0 0x56212e6c8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.130+0000 7f67977fe640 1 -- 172.21.15.2:0/4287620981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56212e6d3370 msgr2=0x56212e6d5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:29.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.130+0000 7f67977fe640 1 --2- 172.21.15.2:0/4287620981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56212e6d3370 0x56212e6d5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.130+0000 7f67977fe640 1 -- 172.21.15.2:0/4287620981 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56212e5ba3a0 con 0x56212e6c9b40 2024-09-19T06:22:29.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.130+0000 7f677ffff640 1 -- 172.21.15.2:0/3838173135 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7f678c0cf8a0 con 0x7f6798102570 2024-09-19T06:22:29.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.130+0000 7f67977fe640 1 --2- 172.21.15.2:0/3838173135 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f67800a33b0 0x7f67800a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:29.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.130+0000 7f67977fe640 1 --2- 172.21.15.2:0/4287620981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56212e6c9b40 0x56212e6c8090 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f679000b6b0 tx=0x7f6790004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=258bd47be8274802 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:29.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.130+0000 7f677d7fa640 1 -- 172.21.15.2:0/4287620981 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6790003d60 con 0x56212e6c9b40 2024-09-19T06:22:29.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.130+0000 7f677d7fa640 1 -- 172.21.15.2:0/4287620981 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6790015070 con 0x56212e6c9b40 2024-09-19T06:22:29.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.130+0000 7f677d7fa640 1 -- 172.21.15.2:0/4287620981 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f679001bae0 con 0x56212e6c9b40 2024-09-19T06:22:29.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.131+0000 7f679fb54740 1 -- 172.21.15.2:0/4287620981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56212e6c9b40 msgr2=0x56212e6c8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:29.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.131+0000 7f67977fe640 1 --2- 172.21.15.2:0/3838173135 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f67800a33b0 0x7f67800a5870 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f679001c000 tx=0x7f6790010810 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:29.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.131+0000 7f679fb54740 1 --2- 172.21.15.2:0/4287620981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56212e6c9b40 0x56212e6c8090 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f679000b6b0 tx=0x7f6790004610 comp rx=0 tx=0).stop 2024-09-19T06:22:29.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.131+0000 7f679fb54740 1 -- 172.21.15.2:0/4287620981 shutdown_connections 2024-09-19T06:22:29.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.131+0000 7f679fb54740 1 --2- 172.21.15.2:0/4287620981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56212e6d3370 0x56212e6d5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.131+0000 7f679fb54740 1 --2- 172.21.15.2:0/4287620981 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56212e6c85d0 0x56212e6c8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.131+0000 7f679fb54740 1 --2- 172.21.15.2:0/4287620981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56212e6c9b40 0x56212e6c8090 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.131+0000 7f679fb54740 1 -- 172.21.15.2:0/4287620981 >> 172.21.15.2:0/4287620981 conn(0x56212e691310 msgr2=0x56212e6c4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:29.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.131+0000 7f679fb54740 1 -- 172.21.15.2:0/4287620981 shutdown_connections 2024-09-19T06:22:29.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.131+0000 7f679fb54740 1 -- 172.21.15.2:0/4287620981 wait complete. 2024-09-19T06:22:29.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.131+0000 7f679fb54740 1 -- start start 2024-09-19T06:22:29.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.132+0000 7f679fb54740 1 Processor -- start 2024-09-19T06:22:29.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.132+0000 7f679fb54740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56212e6c85d0 0x56212e6d2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:29.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.132+0000 7f679fb54740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56212e6c9b40 0x56212e6cff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:29.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.132+0000 7f679fb54740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56212e6d3370 0x56212e6d04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:29.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.132+0000 7f679fb54740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56212e6d6070 con 0x56212e6d3370 2024-09-19T06:22:29.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.132+0000 7f679fb54740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56212e5e9060 con 0x56212e6c9b40 2024-09-19T06:22:29.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.132+0000 7f679fb54740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56212e6d61f0 con 0x56212e6c85d0 2024-09-19T06:22:29.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.132+0000 7f679fb54740 10 client.0 _ll_register_callbacks cb 0x56212e33c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:29.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.132+0000 7f67977fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56212e6d3370 0x56212e6d04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:29.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.132+0000 7f67977fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56212e6d3370 0x56212e6d04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53322/0 (socket says 172.21.15.2:53322) 2024-09-19T06:22:29.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.132+0000 7f67977fe640 1 -- 172.21.15.2:0/1142189590 learned_addr learned my addr 172.21.15.2:0/1142189590 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:29.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.132+0000 7f6796ffd640 1 --2- 172.21.15.2:0/1142189590 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56212e6c85d0 0x56212e6d2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:29.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.132+0000 7f67967fc640 1 --2- 172.21.15.2:0/1142189590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56212e6c9b40 0x56212e6cff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:29.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.132+0000 7f67977fe640 1 -- 172.21.15.2:0/1142189590 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56212e6c85d0 msgr2=0x56212e6d2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:29.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.132+0000 7f67977fe640 1 --2- 172.21.15.2:0/1142189590 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56212e6c85d0 0x56212e6d2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.132+0000 7f67977fe640 1 -- 172.21.15.2:0/1142189590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56212e6c9b40 msgr2=0x56212e6cff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:29.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.132+0000 7f67977fe640 1 --2- 172.21.15.2:0/1142189590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56212e6c9b40 0x56212e6cff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.132+0000 7f67977fe640 1 -- 172.21.15.2:0/1142189590 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56212e39f3c0 con 0x56212e6d3370 2024-09-19T06:22:29.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.132+0000 7f67967fc640 1 --2- 172.21.15.2:0/1142189590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56212e6c9b40 0x56212e6cff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:29.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.133+0000 7f67977fe640 1 --2- 172.21.15.2:0/1142189590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56212e6d3370 0x56212e6d04f0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f67900035f0 tx=0x7f6790015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cbaf764faa69e81 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:29.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.133+0000 7f677aff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:22:29.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.133+0000 7f677aff5640 1 -- 172.21.15.2:0/1142189590 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67900042d0 con 0x56212e6d3370 2024-09-19T06:22:29.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.133+0000 7f677aff5640 1 -- 172.21.15.2:0/1142189590 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7f6790011500 con 0x56212e6d3370 2024-09-19T06:22:29.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.133+0000 7f679fb54740 1 -- 172.21.15.2:0/1142189590 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6790015070 con 0x56212e6d3370 2024-09-19T06:22:29.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.133+0000 7f677aff5640 1 -- 172.21.15.2:0/1142189590 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f679003e050 con 0x56212e6d3370 2024-09-19T06:22:29.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.133+0000 7f679fb54740 10 client.18021 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:29.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.133+0000 7f679fb54740 1 -- 172.21.15.2:0/1142189590 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56212e6e1ad0 con 0x56212e6d3370 2024-09-19T06:22:29.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.133+0000 7f677aff5640 1 -- 172.21.15.2:0/1142189590 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6790015070 con 0x56212e6d3370 2024-09-19T06:22:29.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.133+0000 7f677aff5640 1 -- 172.21.15.2:0/1142189590 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f6790005040 con 0x56212e6d3370 2024-09-19T06:22:29.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.134+0000 7f679fb54740 10 client.18021 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:29.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.134+0000 7f679fb54740 10 client.18021 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:29.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.134+0000 7f679fb54740 20 client.18021 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:29.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.134+0000 7f679fb54740 1 --2- 172.21.15.2:0/1142189590 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x56212e6e2f90 0x56212e6e5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:29.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.134+0000 7f679fb54740 4 client.18021 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:22:29.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.134+0000 7f679fb54740 1 -- 172.21.15.2:0/1142189590 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56212e63b860 con 0x56212e6e2f90 2024-09-19T06:22:29.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.134+0000 7f6796ffd640 1 --2- 172.21.15.2:0/1142189590 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x56212e6e2f90 0x56212e6e5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:29.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.134+0000 7f6796ffd640 1 --2- 172.21.15.2:0/1142189590 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x56212e6e2f90 0x56212e6e5380 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2dad2a7b50cc2c5a server_cookie=b0f706d30fe8b4b4 in_seq=0 out_seq=0 2024-09-19T06:22:29.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.134+0000 7f677aff5640 10 client.18021 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:29.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.135+0000 7f677aff5640 1 -- 172.21.15.2:0/1142189590 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56212e63b860 con 0x56212e6e2f90 2024-09-19T06:22:29.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.135+0000 7f677aff5640 10 client.18021 handle_command_reply: tid=0 2024-09-19T06:22:29.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.135+0000 7f679fb54740 1 client.18021 shutdown 2024-09-19T06:22:29.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.135+0000 7f679fb54740 1 -- 172.21.15.2:0/1142189590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56212e6d3370 msgr2=0x56212e6d04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:29.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.135+0000 7f679fb54740 1 --2- 172.21.15.2:0/1142189590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56212e6d3370 0x56212e6d04f0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f67900035f0 tx=0x7f6790015000 comp rx=0 tx=0).stop 2024-09-19T06:22:29.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.135+0000 7f679fb54740 1 -- 172.21.15.2:0/1142189590 shutdown_connections 2024-09-19T06:22:29.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.135+0000 7f679fb54740 1 --2- 172.21.15.2:0/1142189590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56212e6d3370 0x56212e6d04f0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.135+0000 7f679fb54740 1 --2- 172.21.15.2:0/1142189590 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x56212e6e2f90 0x56212e6e5380 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.135+0000 7f679fb54740 1 --2- 172.21.15.2:0/1142189590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56212e6c9b40 0x56212e6cff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.135+0000 7f677aff5640 0 client.18021 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:29.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.135+0000 7f679fb54740 1 --2- 172.21.15.2:0/1142189590 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56212e6c85d0 0x56212e6d2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.135+0000 7f679fb54740 1 -- 172.21.15.2:0/1142189590 >> 172.21.15.2:0/1142189590 conn(0x56212e691310 msgr2=0x56212e6ca960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:29.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.135+0000 7f679fb54740 1 -- 172.21.15.2:0/1142189590 shutdown_connections 2024-09-19T06:22:29.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.135+0000 7f679fb54740 1 -- 172.21.15.2:0/1142189590 wait complete. 2024-09-19T06:22:29.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.135+0000 7f679fb54740 20 client.18021 trim_cache size 0 max 16384 2024-09-19T06:22:29.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.148+0000 7f679fb54740 1 Processor -- start 2024-09-19T06:22:29.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.148+0000 7f679fb54740 1 -- start start 2024-09-19T06:22:29.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.149+0000 7f679fb54740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56212e691310 0x56212e6bfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:29.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.149+0000 7f679fb54740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56212e6c85d0 0x56212e6df310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:29.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.149+0000 7f679fb54740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56212e6c9b40 0x56212e6d1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:29.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.149+0000 7f679fb54740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f67981b2330 con 0x56212e691310 2024-09-19T06:22:29.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.149+0000 7f679fb54740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f67981afc00 con 0x56212e6c9b40 2024-09-19T06:22:29.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.149+0000 7f679fb54740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f67981ada70 con 0x56212e6c85d0 2024-09-19T06:22:29.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.149+0000 7f6796ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56212e691310 0x56212e6bfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:29.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.149+0000 7f6796ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56212e691310 0x56212e6bfc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53338/0 (socket says 172.21.15.2:53338) 2024-09-19T06:22:29.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.149+0000 7f6796ffd640 1 -- 172.21.15.2:0/3492089666 learned_addr learned my addr 172.21.15.2:0/3492089666 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:29.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.149+0000 7f67967fc640 1 --2- 172.21.15.2:0/3492089666 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56212e6c85d0 0x56212e6df310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:29.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.149+0000 7f67977fe640 1 --2- 172.21.15.2:0/3492089666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56212e6c9b40 0x56212e6d1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:29.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.149+0000 7f6796ffd640 1 -- 172.21.15.2:0/3492089666 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56212e6c85d0 msgr2=0x56212e6df310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:29.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.149+0000 7f6796ffd640 1 --2- 172.21.15.2:0/3492089666 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56212e6c85d0 0x56212e6df310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.149+0000 7f6796ffd640 1 -- 172.21.15.2:0/3492089666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56212e6c9b40 msgr2=0x56212e6d1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:29.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.149+0000 7f6796ffd640 1 --2- 172.21.15.2:0/3492089666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56212e6c9b40 0x56212e6d1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.149+0000 7f6796ffd640 1 -- 172.21.15.2:0/3492089666 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56212e6c5960 con 0x56212e691310 2024-09-19T06:22:29.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.149+0000 7f67967fc640 1 --2- 172.21.15.2:0/3492089666 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56212e6c85d0 0x56212e6df310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:29.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.149+0000 7f6796ffd640 1 --2- 172.21.15.2:0/3492089666 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56212e691310 0x56212e6bfc60 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f6788004ad0 tx=0x7f678802f970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6289bf00f8dc91 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:29.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.150+0000 7f677cff9640 1 -- 172.21.15.2:0/3492089666 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6788034040 con 0x56212e691310 2024-09-19T06:22:29.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.150+0000 7f677cff9640 1 -- 172.21.15.2:0/3492089666 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6788003970 con 0x56212e691310 2024-09-19T06:22:29.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.150+0000 7f677cff9640 1 -- 172.21.15.2:0/3492089666 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6788004650 con 0x56212e691310 2024-09-19T06:22:29.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.150+0000 7f679fb54740 1 -- 172.21.15.2:0/3492089666 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56212e691310 msgr2=0x56212e6bfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:29.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.150+0000 7f679fb54740 1 --2- 172.21.15.2:0/3492089666 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56212e691310 0x56212e6bfc60 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f6788004ad0 tx=0x7f678802f970 comp rx=0 tx=0).stop 2024-09-19T06:22:29.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.150+0000 7f679fb54740 1 -- 172.21.15.2:0/3492089666 shutdown_connections 2024-09-19T06:22:29.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.150+0000 7f679fb54740 1 --2- 172.21.15.2:0/3492089666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56212e6c9b40 0x56212e6d1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.150+0000 7f679fb54740 1 --2- 172.21.15.2:0/3492089666 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56212e6c85d0 0x56212e6df310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.150+0000 7f679fb54740 1 --2- 172.21.15.2:0/3492089666 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56212e691310 0x56212e6bfc60 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.150+0000 7f679fb54740 1 -- 172.21.15.2:0/3492089666 >> 172.21.15.2:0/3492089666 conn(0x56212e6cb9a0 msgr2=0x56212e6d17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:29.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.150+0000 7f679fb54740 1 -- 172.21.15.2:0/3492089666 shutdown_connections 2024-09-19T06:22:29.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.150+0000 7f679fb54740 1 -- 172.21.15.2:0/3492089666 wait complete. 2024-09-19T06:22:29.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.151+0000 7f679fb54740 1 -- start start 2024-09-19T06:22:29.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.151+0000 7f679fb54740 1 Processor -- start 2024-09-19T06:22:29.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.151+0000 7f679fb54740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56212e691310 0x56212e6dbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:29.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.151+0000 7f679fb54740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56212e6c85d0 0x56212e6ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:29.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.151+0000 7f679fb54740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56212e6c9b40 0x56212e6cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:29.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.151+0000 7f679fb54740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f67981ae0c0 con 0x56212e6c9b40 2024-09-19T06:22:29.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.151+0000 7f679fb54740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f67981af530 con 0x56212e6c85d0 2024-09-19T06:22:29.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.151+0000 7f679fb54740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f67981ae790 con 0x56212e691310 2024-09-19T06:22:29.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.151+0000 7f679fb54740 10 client.0 _ll_register_callbacks cb 0x7f6788009360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:29.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.151+0000 7f67977fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56212e6c9b40 0x56212e6cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:29.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.151+0000 7f67967fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56212e6c85d0 0x56212e6ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:29.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.151+0000 7f67977fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56212e6c9b40 0x56212e6cd1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53344/0 (socket says 172.21.15.2:53344) 2024-09-19T06:22:29.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.151+0000 7f67967fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56212e6c85d0 0x56212e6ccc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:40342/0 (socket says 172.21.15.2:40342) 2024-09-19T06:22:29.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.151+0000 7f67977fe640 1 -- 172.21.15.2:0/4257191336 learned_addr learned my addr 172.21.15.2:0/4257191336 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:29.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.151+0000 7f6796ffd640 1 --2- 172.21.15.2:0/4257191336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56212e691310 0x56212e6dbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:29.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.151+0000 7f67967fc640 1 -- 172.21.15.2:0/4257191336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56212e691310 msgr2=0x56212e6dbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:29.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.151+0000 7f67967fc640 1 --2- 172.21.15.2:0/4257191336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56212e691310 0x56212e6dbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.151+0000 7f67967fc640 1 -- 172.21.15.2:0/4257191336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56212e6c9b40 msgr2=0x56212e6cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:29.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.151+0000 7f67967fc640 1 --2- 172.21.15.2:0/4257191336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56212e6c9b40 0x56212e6cd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.152+0000 7f67967fc640 1 -- 172.21.15.2:0/4257191336 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56212e6cd9b0 con 0x56212e6c85d0 2024-09-19T06:22:29.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.152+0000 7f67977fe640 1 --2- 172.21.15.2:0/4257191336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56212e6c9b40 0x56212e6cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:29.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.152+0000 7f67967fc640 1 --2- 172.21.15.2:0/4257191336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56212e6c85d0 0x56212e6ccc70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f678c0ccff0 tx=0x7f678c009ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bf32e3464f293c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:29.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.152+0000 7f677aff5640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-09-19T06:22:29.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.152+0000 7f677aff5640 1 -- 172.21.15.2:0/4257191336 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f678c020040 con 0x56212e6c85d0 2024-09-19T06:22:29.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.152+0000 7f679fb54740 1 -- 172.21.15.2:0/4257191336 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6788003970 con 0x56212e6c85d0 2024-09-19T06:22:29.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.152+0000 7f677aff5640 1 -- 172.21.15.2:0/4257191336 <== mon.2 v2:172.21.15.89:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7f678c0860c0 con 0x56212e6c85d0 2024-09-19T06:22:29.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.152+0000 7f677aff5640 1 -- 172.21.15.2:0/4257191336 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f678c0b9050 con 0x56212e6c85d0 2024-09-19T06:22:29.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.152+0000 7f679fb54740 10 client.27107 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:29.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.152+0000 7f679fb54740 1 -- 172.21.15.2:0/4257191336 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56212e74d9a0 con 0x56212e6c85d0 2024-09-19T06:22:29.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.152+0000 7f677aff5640 1 -- 172.21.15.2:0/4257191336 <== mon.2 v2:172.21.15.89:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f678c0b3030 con 0x56212e6c85d0 2024-09-19T06:22:29.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.152+0000 7f677aff5640 1 -- 172.21.15.2:0/4257191336 <== mon.2 v2:172.21.15.89:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f678c0ba2d0 con 0x56212e6c85d0 2024-09-19T06:22:29.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.152+0000 7f679fb54740 10 client.27107 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:29.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.152+0000 7f679fb54740 10 client.27107 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:29.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.152+0000 7f679fb54740 20 client.27107 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:29.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.153+0000 7f679fb54740 1 --2- 172.21.15.2:0/4257191336 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x56212e6d3370 0x56212e750030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:29.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.153+0000 7f679fb54740 4 client.27107 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:22:29.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.153+0000 7f679fb54740 1 -- 172.21.15.2:0/4257191336 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56212e635d70 con 0x56212e6d3370 2024-09-19T06:22:29.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.153+0000 7f6796ffd640 1 --2- 172.21.15.2:0/4257191336 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x56212e6d3370 0x56212e750030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:29.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.153+0000 7f677aff5640 10 client.27107 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:29.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.153+0000 7f6796ffd640 1 --2- 172.21.15.2:0/4257191336 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x56212e6d3370 0x56212e750030 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85539a39521813c7 server_cookie=43657582e6770af3 in_seq=0 out_seq=0 2024-09-19T06:22:29.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.153+0000 7f677aff5640 1 -- 172.21.15.2:0/4257191336 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56212e635d70 con 0x56212e6d3370 2024-09-19T06:22:29.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.153+0000 7f677aff5640 10 client.27107 handle_command_reply: tid=0 2024-09-19T06:22:29.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.153+0000 7f679fb54740 1 client.27107 shutdown 2024-09-19T06:22:29.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.153+0000 7f679fb54740 1 -- 172.21.15.2:0/4257191336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56212e6c85d0 msgr2=0x56212e6ccc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:29.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.153+0000 7f679fb54740 1 --2- 172.21.15.2:0/4257191336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56212e6c85d0 0x56212e6ccc70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f678c0ccff0 tx=0x7f678c009ea0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.154+0000 7f679fb54740 1 -- 172.21.15.2:0/4257191336 shutdown_connections 2024-09-19T06:22:29.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.154+0000 7f679fb54740 1 --2- 172.21.15.2:0/4257191336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56212e6c9b40 0x56212e6cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.154+0000 7f679fb54740 1 --2- 172.21.15.2:0/4257191336 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x56212e6d3370 0x56212e750030 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.154+0000 7f679fb54740 1 --2- 172.21.15.2:0/4257191336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56212e6c85d0 0x56212e6ccc70 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.154+0000 7f679fb54740 1 --2- 172.21.15.2:0/4257191336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56212e691310 0x56212e6dbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.154+0000 7f679fb54740 1 -- 172.21.15.2:0/4257191336 >> 172.21.15.2:0/4257191336 conn(0x56212e6cb9a0 msgr2=0x56212e6ca930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:29.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.154+0000 7f677aff5640 0 client.27107 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:29.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.154+0000 7f679fb54740 1 -- 172.21.15.2:0/4257191336 shutdown_connections 2024-09-19T06:22:29.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.154+0000 7f679fb54740 1 -- 172.21.15.2:0/4257191336 wait complete. 2024-09-19T06:22:29.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.154+0000 7f679fb54740 20 client.27107 trim_cache size 0 max 16384 2024-09-19T06:22:29.162 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:22:29.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.154+0000 7f679d77b640 1 -- 172.21.15.2:0/3838173135 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f67800a33b0 msgr2=0x7f67800a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:29.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.154+0000 7f679d77b640 1 --2- 172.21.15.2:0/3838173135 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f67800a33b0 0x7f67800a5870 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f679001c000 tx=0x7f6790010810 comp rx=0 tx=0).stop 2024-09-19T06:22:29.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.154+0000 7f679d77b640 1 -- 172.21.15.2:0/3838173135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6798102570 msgr2=0x7f6798103c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:29.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.154+0000 7f679d77b640 1 --2- 172.21.15.2:0/3838173135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6798102570 0x7f6798103c90 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f678c00d950 tx=0x7f678c00de10 comp rx=0 tx=0).stop 2024-09-19T06:22:29.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.154+0000 7f679d77b640 1 -- 172.21.15.2:0/3838173135 shutdown_connections 2024-09-19T06:22:29.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.154+0000 7f679d77b640 1 --2- 172.21.15.2:0/3838173135 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f67800a33b0 0x7f67800a5870 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.154+0000 7f679d77b640 1 --2- 172.21.15.2:0/3838173135 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6798102ef0 0x7f67981041d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.154+0000 7f679d77b640 1 --2- 172.21.15.2:0/3838173135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6798102570 0x7f6798103c90 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.154+0000 7f679d77b640 1 --2- 172.21.15.2:0/3838173135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6798100e20 0x7f6798103750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.154+0000 7f679d77b640 1 -- 172.21.15.2:0/3838173135 >> 172.21.15.2:0/3838173135 conn(0x7f67980fc7d0 msgr2=0x7f679806a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:29.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.154+0000 7f679d77b640 1 -- 172.21.15.2:0/3838173135 shutdown_connections 2024-09-19T06:22:29.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:29.154+0000 7f679d77b640 1 -- 172.21.15.2:0/3838173135 wait complete. 2024-09-19T06:22:29.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:29 smithi002 ceph-mon[30982]: pgmap v237: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:22:29.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:29 smithi090 ceph-mon[34497]: pgmap v237: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:22:29.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:29 smithi089 ceph-mon[34160]: pgmap v237: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:22:30.943 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:22:30.944 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:22:31.212 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:22:31.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:31 smithi002 ceph-mon[30982]: pgmap v238: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:22:31.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.642+0000 7f658c1f3640 1 -- 172.21.15.2:0/4016827840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6584101420 msgr2=0x7f658410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:31.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.642+0000 7f658c1f3640 1 --2- 172.21.15.2:0/4016827840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6584101420 0x7f658410d950 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f657c009cd0 tx=0x7f657c02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.642+0000 7f658c1f3640 1 -- 172.21.15.2:0/4016827840 shutdown_connections 2024-09-19T06:22:31.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.642+0000 7f658c1f3640 1 --2- 172.21.15.2:0/4016827840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6584101420 0x7f658410d950 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.642+0000 7f658c1f3640 1 --2- 172.21.15.2:0/4016827840 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6584100a80 0x7f6584100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.642+0000 7f658c1f3640 1 --2- 172.21.15.2:0/4016827840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6584106a80 0x7f6584106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.642+0000 7f658c1f3640 1 -- 172.21.15.2:0/4016827840 >> 172.21.15.2:0/4016827840 conn(0x7f65840fc7a0 msgr2=0x7f65840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:31.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.642+0000 7f658c1f3640 1 -- 172.21.15.2:0/4016827840 shutdown_connections 2024-09-19T06:22:31.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.642+0000 7f658c1f3640 1 -- 172.21.15.2:0/4016827840 wait complete. 2024-09-19T06:22:31.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.642+0000 7f658c1f3640 1 Processor -- start 2024-09-19T06:22:31.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.642+0000 7f658c1f3640 1 -- start start 2024-09-19T06:22:31.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.643+0000 7f658c1f3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6584100a80 0x7f65840fcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:31.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.643+0000 7f658c1f3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6584101420 0x7f65840fd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:31.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.643+0000 7f658c1f3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6584106a80 0x7f65840fd850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:31.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.643+0000 7f658c1f3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6584110dc0 con 0x7f6584106a80 2024-09-19T06:22:31.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.643+0000 7f658c1f3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6584110c40 con 0x7f6584100a80 2024-09-19T06:22:31.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.643+0000 7f658c1f3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6584110f40 con 0x7f6584101420 2024-09-19T06:22:31.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.643+0000 7f658a790640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6584106a80 0x7f65840fd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:31.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.643+0000 7f658a790640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6584106a80 0x7f65840fd850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53372/0 (socket says 172.21.15.2:53372) 2024-09-19T06:22:31.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.643+0000 7f658a790640 1 -- 172.21.15.2:0/1042780095 learned_addr learned my addr 172.21.15.2:0/1042780095 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:31.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.643+0000 7f658978e640 1 --2- 172.21.15.2:0/1042780095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6584101420 0x7f65840fd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:31.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.643+0000 7f6589f8f640 1 --2- 172.21.15.2:0/1042780095 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6584100a80 0x7f65840fcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:31.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.643+0000 7f658a790640 1 -- 172.21.15.2:0/1042780095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6584101420 msgr2=0x7f65840fd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:31.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.643+0000 7f658a790640 1 --2- 172.21.15.2:0/1042780095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6584101420 0x7f65840fd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.643+0000 7f658a790640 1 -- 172.21.15.2:0/1042780095 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6584100a80 msgr2=0x7f65840fcdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:31.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.643+0000 7f658a790640 1 --2- 172.21.15.2:0/1042780095 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6584100a80 0x7f65840fcdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.643+0000 7f658a790640 1 -- 172.21.15.2:0/1042780095 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65841a68b0 con 0x7f6584106a80 2024-09-19T06:22:31.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.643+0000 7f658978e640 1 --2- 172.21.15.2:0/1042780095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6584101420 0x7f65840fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:31.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.644+0000 7f658a790640 1 --2- 172.21.15.2:0/1042780095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6584106a80 0x7f65840fd850 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f657c005e30 tx=0x7f657c003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:31.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.644+0000 7f657affd640 1 -- 172.21.15.2:0/1042780095 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f657c004240 con 0x7f6584106a80 2024-09-19T06:22:31.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.644+0000 7f657affd640 1 -- 172.21.15.2:0/1042780095 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f657c031ce0 con 0x7f6584106a80 2024-09-19T06:22:31.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.644+0000 7f658c1f3640 1 -- 172.21.15.2:0/1042780095 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65841a6b40 con 0x7f6584106a80 2024-09-19T06:22:31.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.644+0000 7f657affd640 1 -- 172.21.15.2:0/1042780095 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f657c030ea0 con 0x7f6584106a80 2024-09-19T06:22:31.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.644+0000 7f658c1f3640 1 -- 172.21.15.2:0/1042780095 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65841a70d0 con 0x7f6584106a80 2024-09-19T06:22:31.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.646+0000 7f657affd640 1 -- 172.21.15.2:0/1042780095 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f657c0305a0 con 0x7f6584106a80 2024-09-19T06:22:31.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.647+0000 7f658e5cc740 1 Processor -- start 2024-09-19T06:22:31.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.647+0000 7f658e5cc740 1 -- start start 2024-09-19T06:22:31.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.647+0000 7f657affd640 1 --2- 172.21.15.2:0/1042780095 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f65700a3430 0x7f65700a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:31.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.647+0000 7f658e5cc740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55590a3afb60 0x55590a3aff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:31.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.647+0000 7f658e5cc740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55590a3b0480 0x55590a3ba800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:31.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.647+0000 7f658e5cc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55590a3bad40 0x55590a3bd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:31.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.647+0000 7f657affd640 1 -- 172.21.15.2:0/1042780095 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7f657c02e030 con 0x7f6584106a80 2024-09-19T06:22:31.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.647+0000 7f658e5cc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55590a315280 con 0x55590a3bad40 2024-09-19T06:22:31.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.647+0000 7f658e5cc740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55590a2bcb10 con 0x55590a3b0480 2024-09-19T06:22:31.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.647+0000 7f658e5cc740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55590a311240 con 0x55590a3afb60 2024-09-19T06:22:31.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.647+0000 7f658978e640 1 --2- 172.21.15.2:0/1042780095 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f65700a3430 0x7f65700a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:31.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.647+0000 7f658a790640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55590a3bad40 0x55590a3bd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:31.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.647+0000 7f658a790640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55590a3bad40 0x55590a3bd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53384/0 (socket says 172.21.15.2:53384) 2024-09-19T06:22:31.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.647+0000 7f658a790640 1 -- 172.21.15.2:0/3587969923 learned_addr learned my addr 172.21.15.2:0/3587969923 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:31.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.648+0000 7f6589f8f640 1 --2- 172.21.15.2:0/3587969923 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55590a3afb60 0x55590a3aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:31.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.648+0000 7f658978e640 1 --2- 172.21.15.2:0/3587969923 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55590a3b0480 0x55590a3ba800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:31.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.648+0000 7f658a790640 1 -- 172.21.15.2:0/3587969923 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55590a3afb60 msgr2=0x55590a3aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:31.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.648+0000 7f658a790640 1 --2- 172.21.15.2:0/3587969923 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55590a3afb60 0x55590a3aff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.648+0000 7f658a790640 1 -- 172.21.15.2:0/3587969923 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55590a3b0480 msgr2=0x55590a3ba800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:31.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.648+0000 7f658a790640 1 --2- 172.21.15.2:0/3587969923 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55590a3b0480 0x55590a3ba800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.648+0000 7f658a790640 1 -- 172.21.15.2:0/3587969923 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55590a2c91f0 con 0x55590a3bad40 2024-09-19T06:22:31.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.648+0000 7f658978e640 1 --2- 172.21.15.2:0/1042780095 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f65700a3430 0x7f65700a58f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f65840fe860 tx=0x7f657400bba0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:31.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.648+0000 7f658a790640 1 --2- 172.21.15.2:0/3587969923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55590a3bad40 0x55590a3bd130 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f657c0ba050 tx=0x7f657c0bd0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2e8ee0d492931a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:31.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.648+0000 7f656ffff640 1 -- 172.21.15.2:0/3587969923 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f657c0c62f0 con 0x55590a3bad40 2024-09-19T06:22:31.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.648+0000 7f656ffff640 1 -- 172.21.15.2:0/3587969923 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f657c036070 con 0x55590a3bad40 2024-09-19T06:22:31.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.648+0000 7f656ffff640 1 -- 172.21.15.2:0/3587969923 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f657c0d1ba0 con 0x55590a3bad40 2024-09-19T06:22:31.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.649+0000 7f658e5cc740 1 -- 172.21.15.2:0/3587969923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55590a3bad40 msgr2=0x55590a3bd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:31.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.649+0000 7f658e5cc740 1 --2- 172.21.15.2:0/3587969923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55590a3bad40 0x55590a3bd130 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f657c0ba050 tx=0x7f657c0bd0a0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.649+0000 7f658e5cc740 1 -- 172.21.15.2:0/3587969923 shutdown_connections 2024-09-19T06:22:31.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.649+0000 7f658e5cc740 1 --2- 172.21.15.2:0/3587969923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55590a3bad40 0x55590a3bd130 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.649+0000 7f658e5cc740 1 --2- 172.21.15.2:0/3587969923 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55590a3b0480 0x55590a3ba800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.649+0000 7f658e5cc740 1 --2- 172.21.15.2:0/3587969923 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55590a3afb60 0x55590a3aff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.649+0000 7f658e5cc740 1 -- 172.21.15.2:0/3587969923 >> 172.21.15.2:0/3587969923 conn(0x55590a3ac0f0 msgr2=0x55590a3ac4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:31.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.649+0000 7f658e5cc740 1 -- 172.21.15.2:0/3587969923 shutdown_connections 2024-09-19T06:22:31.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.649+0000 7f658e5cc740 1 -- 172.21.15.2:0/3587969923 wait complete. 2024-09-19T06:22:31.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.650+0000 7f658e5cc740 1 -- start start 2024-09-19T06:22:31.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.650+0000 7f658e5cc740 1 Processor -- start 2024-09-19T06:22:31.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.650+0000 7f658e5cc740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55590a3afb60 0x55590a3b7c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:31.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.650+0000 7f658e5cc740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55590a3b0480 0x55590a3b81b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:31.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.650+0000 7f658e5cc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55590a3bad40 0x55590a3b86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:31.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.650+0000 7f658e5cc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55590a3bd6d0 con 0x55590a3bad40 2024-09-19T06:22:31.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.650+0000 7f658e5cc740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55590a2cff10 con 0x55590a3b0480 2024-09-19T06:22:31.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.650+0000 7f658e5cc740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55590a3bd850 con 0x55590a3afb60 2024-09-19T06:22:31.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.650+0000 7f658e5cc740 10 client.0 _ll_register_callbacks cb 0x55590a298a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:31.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.650+0000 7f658a790640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55590a3bad40 0x55590a3b86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:31.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.650+0000 7f658a790640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55590a3bad40 0x55590a3b86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53394/0 (socket says 172.21.15.2:53394) 2024-09-19T06:22:31.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.650+0000 7f658a790640 1 -- 172.21.15.2:0/1346986997 learned_addr learned my addr 172.21.15.2:0/1346986997 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:31.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.650+0000 7f658978e640 1 --2- 172.21.15.2:0/1346986997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55590a3b0480 0x55590a3b81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:31.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.650+0000 7f6589f8f640 1 --2- 172.21.15.2:0/1346986997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55590a3afb60 0x55590a3b7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:31.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.651+0000 7f658a790640 1 -- 172.21.15.2:0/1346986997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55590a3afb60 msgr2=0x55590a3b7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:31.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.651+0000 7f658a790640 1 --2- 172.21.15.2:0/1346986997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55590a3afb60 0x55590a3b7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.651+0000 7f658a790640 1 -- 172.21.15.2:0/1346986997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55590a3b0480 msgr2=0x55590a3b81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:31.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.651+0000 7f658a790640 1 --2- 172.21.15.2:0/1346986997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55590a3b0480 0x55590a3b81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.651+0000 7f658a790640 1 -- 172.21.15.2:0/1346986997 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55590a0866a0 con 0x55590a3bad40 2024-09-19T06:22:31.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.651+0000 7f6589f8f640 1 --2- 172.21.15.2:0/1346986997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55590a3afb60 0x55590a3b7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:31.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.651+0000 7f658978e640 1 --2- 172.21.15.2:0/1346986997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55590a3b0480 0x55590a3b81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:31.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.651+0000 7f658a790640 1 --2- 172.21.15.2:0/1346986997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55590a3bad40 0x55590a3b86f0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f657c0bd610 tx=0x7f657c0c6370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecd3da435df16713 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:31.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.651+0000 7f656d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:22:31.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.651+0000 7f656d7fa640 1 -- 172.21.15.2:0/1346986997 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f657c0d1da0 con 0x55590a3bad40 2024-09-19T06:22:31.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.651+0000 7f656d7fa640 1 -- 172.21.15.2:0/1346986997 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7f657c0bcad0 con 0x55590a3bad40 2024-09-19T06:22:31.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.651+0000 7f658e5cc740 1 -- 172.21.15.2:0/1346986997 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f657c036070 con 0x55590a3bad40 2024-09-19T06:22:31.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.651+0000 7f656d7fa640 1 -- 172.21.15.2:0/1346986997 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f657c0bccd0 con 0x55590a3bad40 2024-09-19T06:22:31.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.651+0000 7f658e5cc740 10 client.18039 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:31.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.651+0000 7f658e5cc740 1 -- 172.21.15.2:0/1346986997 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55590a3bd6d0 con 0x55590a3bad40 2024-09-19T06:22:31.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.651+0000 7f656d7fa640 1 -- 172.21.15.2:0/1346986997 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f657c036070 con 0x55590a3bad40 2024-09-19T06:22:31.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.652+0000 7f656d7fa640 1 -- 172.21.15.2:0/1346986997 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f657c04e070 con 0x55590a3bad40 2024-09-19T06:22:31.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.652+0000 7f658e5cc740 10 client.18039 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:31.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.652+0000 7f658e5cc740 10 client.18039 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:31.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.652+0000 7f658e5cc740 20 client.18039 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:31.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.652+0000 7f658e5cc740 1 --2- 172.21.15.2:0/1346986997 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55590a3ca510 0x55590a3cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:31.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.652+0000 7f658e5cc740 4 client.18039 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:22:31.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.652+0000 7f658e5cc740 1 -- 172.21.15.2:0/1346986997 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55590a3227f0 con 0x55590a3ca510 2024-09-19T06:22:31.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.652+0000 7f6589f8f640 1 --2- 172.21.15.2:0/1346986997 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55590a3ca510 0x55590a3cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:31.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.652+0000 7f656d7fa640 10 client.18039 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:31.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.652+0000 7f6589f8f640 1 --2- 172.21.15.2:0/1346986997 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55590a3ca510 0x55590a3cc900 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2c263a905340496 server_cookie=14cbf8ad633701a3 in_seq=0 out_seq=0 2024-09-19T06:22:31.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.653+0000 7f656d7fa640 1 -- 172.21.15.2:0/1346986997 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55590a3227f0 con 0x55590a3ca510 2024-09-19T06:22:31.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.653+0000 7f656d7fa640 10 client.18039 handle_command_reply: tid=0 2024-09-19T06:22:31.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.653+0000 7f658e5cc740 1 client.18039 shutdown 2024-09-19T06:22:31.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.653+0000 7f658e5cc740 1 -- 172.21.15.2:0/1346986997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55590a3bad40 msgr2=0x55590a3b86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:31.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.653+0000 7f658e5cc740 1 --2- 172.21.15.2:0/1346986997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55590a3bad40 0x55590a3b86f0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f657c0bd610 tx=0x7f657c0c6370 comp rx=0 tx=0).stop 2024-09-19T06:22:31.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.653+0000 7f658e5cc740 1 -- 172.21.15.2:0/1346986997 shutdown_connections 2024-09-19T06:22:31.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.653+0000 7f658e5cc740 1 --2- 172.21.15.2:0/1346986997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55590a3bad40 0x55590a3b86f0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.653+0000 7f658e5cc740 1 --2- 172.21.15.2:0/1346986997 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55590a3ca510 0x55590a3cc900 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.653+0000 7f658e5cc740 1 --2- 172.21.15.2:0/1346986997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55590a3b0480 0x55590a3b81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.653+0000 7f658e5cc740 1 --2- 172.21.15.2:0/1346986997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55590a3afb60 0x55590a3b7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.653+0000 7f656d7fa640 0 client.18039 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:31.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.653+0000 7f658e5cc740 1 -- 172.21.15.2:0/1346986997 >> 172.21.15.2:0/1346986997 conn(0x55590a3ac0f0 msgr2=0x55590a3ab270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:31.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.653+0000 7f658e5cc740 1 -- 172.21.15.2:0/1346986997 shutdown_connections 2024-09-19T06:22:31.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.654+0000 7f658e5cc740 1 -- 172.21.15.2:0/1346986997 wait complete. 2024-09-19T06:22:31.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.654+0000 7f658e5cc740 20 client.18039 trim_cache size 0 max 16384 2024-09-19T06:22:31.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.671+0000 7f658e5cc740 1 Processor -- start 2024-09-19T06:22:31.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.671+0000 7f658e5cc740 1 -- start start 2024-09-19T06:22:31.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.671+0000 7f658e5cc740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55590a3ac0f0 0x55590a3b8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:31.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.671+0000 7f658e5cc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55590a3afb60 0x55590a3d21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:31.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.671+0000 7f658e5cc740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55590a3b0480 0x55590a3d26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:31.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.671+0000 7f658e5cc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f65841b2260 con 0x55590a3afb60 2024-09-19T06:22:31.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.671+0000 7f658e5cc740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f65841afb30 con 0x55590a3b0480 2024-09-19T06:22:31.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.671+0000 7f658e5cc740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f65841ad9a0 con 0x55590a3ac0f0 2024-09-19T06:22:31.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.671+0000 7f658978e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55590a3afb60 0x55590a3d21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:31.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.671+0000 7f658978e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55590a3afb60 0x55590a3d21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53408/0 (socket says 172.21.15.2:53408) 2024-09-19T06:22:31.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.671+0000 7f658978e640 1 -- 172.21.15.2:0/606085918 learned_addr learned my addr 172.21.15.2:0/606085918 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:31.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.671+0000 7f6589f8f640 1 --2- 172.21.15.2:0/606085918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55590a3ac0f0 0x55590a3b8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:31.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.671+0000 7f658978e640 1 -- 172.21.15.2:0/606085918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55590a3ac0f0 msgr2=0x55590a3b8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:31.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.671+0000 7f658978e640 1 --2- 172.21.15.2:0/606085918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55590a3ac0f0 0x55590a3b8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.671+0000 7f658a790640 1 --2- 172.21.15.2:0/606085918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55590a3b0480 0x55590a3d26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:31.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.671+0000 7f658978e640 1 -- 172.21.15.2:0/606085918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55590a3b0480 msgr2=0x55590a3d26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:31.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.671+0000 7f658978e640 1 --2- 172.21.15.2:0/606085918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55590a3b0480 0x55590a3d26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.671+0000 7f658978e640 1 -- 172.21.15.2:0/606085918 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55590a3acd80 con 0x55590a3afb60 2024-09-19T06:22:31.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.672+0000 7f658978e640 1 --2- 172.21.15.2:0/606085918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55590a3afb60 0x55590a3d21a0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f657401a000 tx=0x7f6574015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=841d8836cd3f9650 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:31.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.672+0000 7f656f7fe640 1 -- 172.21.15.2:0/606085918 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f657402c070 con 0x55590a3afb60 2024-09-19T06:22:31.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.672+0000 7f656f7fe640 1 -- 172.21.15.2:0/606085918 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f657401db90 con 0x55590a3afb60 2024-09-19T06:22:31.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.672+0000 7f656f7fe640 1 -- 172.21.15.2:0/606085918 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6574027c90 con 0x55590a3afb60 2024-09-19T06:22:31.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.672+0000 7f658e5cc740 1 -- 172.21.15.2:0/606085918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55590a3afb60 msgr2=0x55590a3d21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:31.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.672+0000 7f658e5cc740 1 --2- 172.21.15.2:0/606085918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55590a3afb60 0x55590a3d21a0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f657401a000 tx=0x7f6574015000 comp rx=0 tx=0).stop 2024-09-19T06:22:31.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.672+0000 7f658e5cc740 1 -- 172.21.15.2:0/606085918 shutdown_connections 2024-09-19T06:22:31.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.672+0000 7f658e5cc740 1 --2- 172.21.15.2:0/606085918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55590a3b0480 0x55590a3d26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.672+0000 7f658e5cc740 1 --2- 172.21.15.2:0/606085918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55590a3afb60 0x55590a3d21a0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.672+0000 7f658e5cc740 1 --2- 172.21.15.2:0/606085918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55590a3ac0f0 0x55590a3b8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.672+0000 7f658e5cc740 1 -- 172.21.15.2:0/606085918 >> 172.21.15.2:0/606085918 conn(0x55590a3b3660 msgr2=0x55590a3b9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:31.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.672+0000 7f658e5cc740 1 -- 172.21.15.2:0/606085918 shutdown_connections 2024-09-19T06:22:31.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.673+0000 7f658e5cc740 1 -- 172.21.15.2:0/606085918 wait complete. 2024-09-19T06:22:31.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.673+0000 7f658e5cc740 1 -- start start 2024-09-19T06:22:31.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.673+0000 7f658e5cc740 1 Processor -- start 2024-09-19T06:22:31.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.673+0000 7f658e5cc740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55590a3ac0f0 0x55590a3bee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:31.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.673+0000 7f658e5cc740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55590a3afb60 0x55590a3bf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:31.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.673+0000 7f658e5cc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55590a3b0480 0x55590a434170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:31.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.673+0000 7f658e5cc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f65841adff0 con 0x55590a3b0480 2024-09-19T06:22:31.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.673+0000 7f658e5cc740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f65841af460 con 0x55590a3ac0f0 2024-09-19T06:22:31.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.673+0000 7f658e5cc740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f65841ae6c0 con 0x55590a3afb60 2024-09-19T06:22:31.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.673+0000 7f658e5cc740 10 client.0 _ll_register_callbacks cb 0x7f657c0bd1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:31.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.673+0000 7f658a790640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55590a3b0480 0x55590a434170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:31.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.674+0000 7f658a790640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55590a3b0480 0x55590a434170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53420/0 (socket says 172.21.15.2:53420) 2024-09-19T06:22:31.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.674+0000 7f658a790640 1 -- 172.21.15.2:0/1701256451 learned_addr learned my addr 172.21.15.2:0/1701256451 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:31.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.674+0000 7f6589f8f640 1 --2- 172.21.15.2:0/1701256451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55590a3ac0f0 0x55590a3bee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:31.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.674+0000 7f658978e640 1 --2- 172.21.15.2:0/1701256451 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55590a3afb60 0x55590a3bf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:31.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.674+0000 7f658a790640 1 -- 172.21.15.2:0/1701256451 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55590a3afb60 msgr2=0x55590a3bf3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:31.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.674+0000 7f658a790640 1 --2- 172.21.15.2:0/1701256451 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55590a3afb60 0x55590a3bf3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.674+0000 7f658a790640 1 -- 172.21.15.2:0/1701256451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55590a3ac0f0 msgr2=0x55590a3bee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:31.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.674+0000 7f658a790640 1 --2- 172.21.15.2:0/1701256451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55590a3ac0f0 0x55590a3bee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.674+0000 7f658a790640 1 -- 172.21.15.2:0/1701256451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55590a4346b0 con 0x55590a3b0480 2024-09-19T06:22:31.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.674+0000 7f658978e640 1 --2- 172.21.15.2:0/1701256451 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55590a3afb60 0x55590a3bf3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:22:31.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.674+0000 7f658a790640 1 --2- 172.21.15.2:0/1701256451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55590a3b0480 0x55590a434170 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f657c0ba050 tx=0x7f657c0f1250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf5b97bc8f4decf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:31.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.674+0000 7f656d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:22:31.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.674+0000 7f656d7fa640 1 -- 172.21.15.2:0/1701256451 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f657c0b9920 con 0x55590a3b0480 2024-09-19T06:22:31.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.674+0000 7f656d7fa640 1 -- 172.21.15.2:0/1701256451 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7f657c0d1db0 con 0x55590a3b0480 2024-09-19T06:22:31.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.674+0000 7f658e5cc740 1 -- 172.21.15.2:0/1701256451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f657401db90 con 0x55590a3b0480 2024-09-19T06:22:31.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.674+0000 7f656d7fa640 1 -- 172.21.15.2:0/1701256451 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f657c0c2c90 con 0x55590a3b0480 2024-09-19T06:22:31.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.674+0000 7f658e5cc740 10 client.18045 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:31.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.674+0000 7f658e5cc740 1 -- 172.21.15.2:0/1701256451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55590a4346b0 con 0x55590a3b0480 2024-09-19T06:22:31.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.675+0000 7f656d7fa640 1 -- 172.21.15.2:0/1701256451 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f657401db90 con 0x55590a3b0480 2024-09-19T06:22:31.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.675+0000 7f656d7fa640 1 -- 172.21.15.2:0/1701256451 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f657c04e070 con 0x55590a3b0480 2024-09-19T06:22:31.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.675+0000 7f658e5cc740 10 client.18045 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:31.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.675+0000 7f658e5cc740 10 client.18045 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:31.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.675+0000 7f658e5cc740 20 client.18045 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:31.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.675+0000 7f658e5cc740 1 --2- 172.21.15.2:0/1701256451 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55590a3bad40 0x55590a437d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:31.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.675+0000 7f658e5cc740 4 client.18045 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:22:31.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.675+0000 7f658e5cc740 1 -- 172.21.15.2:0/1701256451 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55590a31cd00 con 0x55590a3bad40 2024-09-19T06:22:31.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.675+0000 7f6589f8f640 1 --2- 172.21.15.2:0/1701256451 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55590a3bad40 0x55590a437d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:31.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.675+0000 7f656d7fa640 10 client.18045 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:31.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.675+0000 7f6589f8f640 1 --2- 172.21.15.2:0/1701256451 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55590a3bad40 0x55590a437d20 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aed46bc9bc920544 server_cookie=401385b1030f807d in_seq=0 out_seq=0 2024-09-19T06:22:31.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.677+0000 7f656d7fa640 1 -- 172.21.15.2:0/1701256451 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55590a31cd00 con 0x55590a3bad40 2024-09-19T06:22:31.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.677+0000 7f656d7fa640 10 client.18045 handle_command_reply: tid=0 2024-09-19T06:22:31.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.677+0000 7f658e5cc740 1 client.18045 shutdown 2024-09-19T06:22:31.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.677+0000 7f658e5cc740 1 -- 172.21.15.2:0/1701256451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55590a3b0480 msgr2=0x55590a434170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:31.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.677+0000 7f658e5cc740 1 --2- 172.21.15.2:0/1701256451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55590a3b0480 0x55590a434170 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f657c0ba050 tx=0x7f657c0f1250 comp rx=0 tx=0).stop 2024-09-19T06:22:31.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.677+0000 7f658e5cc740 1 -- 172.21.15.2:0/1701256451 shutdown_connections 2024-09-19T06:22:31.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.677+0000 7f658e5cc740 1 --2- 172.21.15.2:0/1701256451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55590a3b0480 0x55590a434170 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.677+0000 7f658e5cc740 1 --2- 172.21.15.2:0/1701256451 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55590a3afb60 0x55590a3bf3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.677+0000 7f658e5cc740 1 --2- 172.21.15.2:0/1701256451 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55590a3bad40 0x55590a437d20 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.677+0000 7f658e5cc740 1 --2- 172.21.15.2:0/1701256451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55590a3ac0f0 0x55590a3bee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.677+0000 7f656d7fa640 0 client.18045 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:31.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.677+0000 7f658e5cc740 1 -- 172.21.15.2:0/1701256451 >> 172.21.15.2:0/1701256451 conn(0x55590a3b3660 msgr2=0x55590a3b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:31.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.677+0000 7f658e5cc740 1 -- 172.21.15.2:0/1701256451 shutdown_connections 2024-09-19T06:22:31.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.677+0000 7f658e5cc740 1 -- 172.21.15.2:0/1701256451 wait complete. 2024-09-19T06:22:31.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.677+0000 7f658e5cc740 20 client.18045 trim_cache size 0 max 16384 2024-09-19T06:22:31.684 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:22:31.684 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T06:22:31.684 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "421a696f-f2dc-41a7-b9b7-5782a03c019e", 2024-09-19T06:22:31.684 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T06:22:31.684 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:22:31.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.678+0000 7f658c1f3640 1 -- 172.21.15.2:0/1042780095 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f65700a3430 msgr2=0x7f65700a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:31.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.678+0000 7f658c1f3640 1 --2- 172.21.15.2:0/1042780095 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f65700a3430 0x7f65700a58f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f65840fe860 tx=0x7f657400bba0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.678+0000 7f658c1f3640 1 -- 172.21.15.2:0/1042780095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6584106a80 msgr2=0x7f65840fd850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:31.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.678+0000 7f658c1f3640 1 --2- 172.21.15.2:0/1042780095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6584106a80 0x7f65840fd850 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f657c005e30 tx=0x7f657c003ba0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.678+0000 7f658c1f3640 1 -- 172.21.15.2:0/1042780095 shutdown_connections 2024-09-19T06:22:31.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.678+0000 7f658c1f3640 1 --2- 172.21.15.2:0/1042780095 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f65700a3430 0x7f65700a58f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.678+0000 7f658c1f3640 1 --2- 172.21.15.2:0/1042780095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6584106a80 0x7f65840fd850 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.678+0000 7f658c1f3640 1 --2- 172.21.15.2:0/1042780095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6584101420 0x7f65840fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.678+0000 7f658c1f3640 1 --2- 172.21.15.2:0/1042780095 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6584100a80 0x7f65840fcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.678+0000 7f658c1f3640 1 -- 172.21.15.2:0/1042780095 >> 172.21.15.2:0/1042780095 conn(0x7f65840fc7a0 msgr2=0x7f658406aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:31.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.678+0000 7f658c1f3640 1 -- 172.21.15.2:0/1042780095 shutdown_connections 2024-09-19T06:22:31.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:31.678+0000 7f658c1f3640 1 -- 172.21.15.2:0/1042780095 wait complete. 2024-09-19T06:22:31.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:31 smithi090 ceph-mon[34497]: pgmap v238: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:22:31.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:31 smithi089 ceph-mon[34160]: pgmap v238: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:22:32.451 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:22:32.708 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:22:32.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:32 smithi002 ceph-mon[30982]: scrub queued for path: / 2024-09-19T06:22:32.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:32 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:22:32.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:32 smithi002 ceph-mon[30982]: scrub summary: active paths [/] 2024-09-19T06:22:32.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:32 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:22:32.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:32 smithi090 ceph-mon[34497]: scrub queued for path: / 2024-09-19T06:22:32.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:32 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:22:32.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:32 smithi090 ceph-mon[34497]: scrub summary: active paths [/] 2024-09-19T06:22:32.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:32 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:22:32.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:32 smithi089 ceph-mon[34160]: scrub queued for path: / 2024-09-19T06:22:32.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:32 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:22:32.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:32 smithi089 ceph-mon[34160]: scrub summary: active paths [/] 2024-09-19T06:22:32.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:32 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:22:33.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.122+0000 7f8fc3bd7640 1 -- 172.21.15.2:0/679701618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fbc10e480 msgr2=0x7f8fbc110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:33.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.122+0000 7f8fc3bd7640 1 --2- 172.21.15.2:0/679701618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fbc10e480 0x7f8fbc110870 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4009ca0 tx=0x7f8fb402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.122+0000 7f8fc3bd7640 1 -- 172.21.15.2:0/679701618 shutdown_connections 2024-09-19T06:22:33.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.122+0000 7f8fc3bd7640 1 --2- 172.21.15.2:0/679701618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fbc10e480 0x7f8fbc110870 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.122+0000 7f8fc3bd7640 1 --2- 172.21.15.2:0/679701618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fbc101280 0x7f8fbc10df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.122+0000 7f8fc3bd7640 1 --2- 172.21.15.2:0/679701618 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fbc1008d0 0x7f8fbc100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.122+0000 7f8fc3bd7640 1 -- 172.21.15.2:0/679701618 >> 172.21.15.2:0/679701618 conn(0x7f8fbc0fc7a0 msgr2=0x7f8fbc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:33.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.122+0000 7f8fc3bd7640 1 -- 172.21.15.2:0/679701618 shutdown_connections 2024-09-19T06:22:33.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.122+0000 7f8fc3bd7640 1 -- 172.21.15.2:0/679701618 wait complete. 2024-09-19T06:22:33.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.123+0000 7f8fc3bd7640 1 Processor -- start 2024-09-19T06:22:33.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.123+0000 7f8fc3bd7640 1 -- start start 2024-09-19T06:22:33.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.124+0000 7f8fc3bd7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fbc1008d0 0x7f8fbc19a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:33.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.124+0000 7f8fc3bd7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fbc101280 0x7f8fbc19aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:33.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.124+0000 7f8fc3bd7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fbc10e480 0x7f8fbc19edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:33.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.124+0000 7f8fc3bd7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8fbc114010 con 0x7f8fbc101280 2024-09-19T06:22:33.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.124+0000 7f8fc3bd7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8fbc113e90 con 0x7f8fbc10e480 2024-09-19T06:22:33.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.124+0000 7f8fc3bd7640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8fbc114190 con 0x7f8fbc1008d0 2024-09-19T06:22:33.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.124+0000 7f8fc1172640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fbc101280 0x7f8fbc19aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:33.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.124+0000 7f8fc1172640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fbc101280 0x7f8fbc19aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53428/0 (socket says 172.21.15.2:53428) 2024-09-19T06:22:33.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.124+0000 7f8fc1172640 1 -- 172.21.15.2:0/3337543396 learned_addr learned my addr 172.21.15.2:0/3337543396 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:33.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.124+0000 7f8fc2174640 1 --2- 172.21.15.2:0/3337543396 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fbc10e480 0x7f8fbc19edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:33.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.124+0000 7f8fc1973640 1 --2- 172.21.15.2:0/3337543396 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fbc1008d0 0x7f8fbc19a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:33.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.124+0000 7f8fc1172640 1 -- 172.21.15.2:0/3337543396 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fbc1008d0 msgr2=0x7f8fbc19a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:33.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.124+0000 7f8fc1172640 1 --2- 172.21.15.2:0/3337543396 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fbc1008d0 0x7f8fbc19a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.124+0000 7f8fc1172640 1 -- 172.21.15.2:0/3337543396 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fbc10e480 msgr2=0x7f8fbc19edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:33.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.124+0000 7f8fc1172640 1 --2- 172.21.15.2:0/3337543396 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fbc10e480 0x7f8fbc19edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.124+0000 7f8fc1172640 1 -- 172.21.15.2:0/3337543396 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fbc19f4a0 con 0x7f8fbc101280 2024-09-19T06:22:33.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.124+0000 7f8fc1973640 1 --2- 172.21.15.2:0/3337543396 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fbc1008d0 0x7f8fbc19a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:22:33.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.124+0000 7f8fc2174640 1 --2- 172.21.15.2:0/3337543396 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fbc10e480 0x7f8fbc19edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:33.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.124+0000 7f8fc1172640 1 --2- 172.21.15.2:0/3337543396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fbc101280 0x7f8fbc19aa30 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f8fac00d950 tx=0x7f8fac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:33.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.124+0000 7f8fb2ffd640 1 -- 172.21.15.2:0/3337543396 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fac017070 con 0x7f8fbc101280 2024-09-19T06:22:33.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.125+0000 7f8fc3bd7640 1 -- 172.21.15.2:0/3337543396 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fbc19f790 con 0x7f8fbc101280 2024-09-19T06:22:33.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.125+0000 7f8fb2ffd640 1 -- 172.21.15.2:0/3337543396 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8fac009c30 con 0x7f8fbc101280 2024-09-19T06:22:33.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.125+0000 7f8fb2ffd640 1 -- 172.21.15.2:0/3337543396 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fac00f620 con 0x7f8fbc101280 2024-09-19T06:22:33.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.125+0000 7f8fc3bd7640 1 -- 172.21.15.2:0/3337543396 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fbc1a7070 con 0x7f8fbc101280 2024-09-19T06:22:33.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.127+0000 7f8fb2ffd640 1 -- 172.21.15.2:0/3337543396 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f8fac0109a0 con 0x7f8fbc101280 2024-09-19T06:22:33.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.127+0000 7f8fc5fb0740 1 Processor -- start 2024-09-19T06:22:33.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.127+0000 7f8fc5fb0740 1 -- start start 2024-09-19T06:22:33.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.128+0000 7f8fc5fb0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559ca10704a0 0x559ca1070880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:33.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.128+0000 7f8fc5fb0740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559ca1070dc0 0x559ca107b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:33.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.128+0000 7f8fc5fb0740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559ca107b680 0x559ca107da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:33.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.128+0000 7f8fc5fb0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559ca0fd62e0 con 0x559ca10704a0 2024-09-19T06:22:33.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.128+0000 7f8fc5fb0740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x559ca0f7dce0 con 0x559ca107b680 2024-09-19T06:22:33.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.128+0000 7f8fc5fb0740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x559ca0fd22a0 con 0x559ca1070dc0 2024-09-19T06:22:33.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.128+0000 7f8fc2174640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559ca10704a0 0x559ca1070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:33.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.128+0000 7f8fc2174640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559ca10704a0 0x559ca1070880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53436/0 (socket says 172.21.15.2:53436) 2024-09-19T06:22:33.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.128+0000 7f8fc2174640 1 -- 172.21.15.2:0/3922591557 learned_addr learned my addr 172.21.15.2:0/3922591557 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:33.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.128+0000 7f8fc1973640 1 --2- 172.21.15.2:0/3922591557 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559ca1070dc0 0x559ca107b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:33.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.128+0000 7f8fc1172640 1 --2- 172.21.15.2:0/3922591557 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559ca107b680 0x559ca107da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:33.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.128+0000 7f8fb2ffd640 1 --2- 172.21.15.2:0/3337543396 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f8fa80a33b0 0x7f8fa80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:33.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.128+0000 7f8fc2174640 1 -- 172.21.15.2:0/3922591557 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559ca1070dc0 msgr2=0x559ca107b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:33.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.128+0000 7f8fc2174640 1 --2- 172.21.15.2:0/3922591557 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559ca1070dc0 0x559ca107b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.128+0000 7f8fc2174640 1 -- 172.21.15.2:0/3922591557 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559ca107b680 msgr2=0x559ca107da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:33.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.128+0000 7f8fc2174640 1 --2- 172.21.15.2:0/3922591557 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559ca107b680 0x559ca107da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.128+0000 7f8fc2174640 1 -- 172.21.15.2:0/3922591557 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ca0f62440 con 0x559ca10704a0 2024-09-19T06:22:33.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.128+0000 7f8fc1172640 1 --2- 172.21.15.2:0/3922591557 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559ca107b680 0x559ca107da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:22:33.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.128+0000 7f8fb2ffd640 1 -- 172.21.15.2:0/3337543396 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7f8fac0cf9b0 con 0x7f8fbc101280 2024-09-19T06:22:33.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.128+0000 7f8fc2174640 1 --2- 172.21.15.2:0/3337543396 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f8fa80a33b0 0x7f8fa80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:33.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.129+0000 7f8fc2174640 1 --2- 172.21.15.2:0/3922591557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559ca10704a0 0x559ca1070880 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4009ca0 tx=0x7f8fb4031bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f751001ff0a15af server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:33.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.129+0000 7f8fa7fff640 1 -- 172.21.15.2:0/3922591557 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb404d070 con 0x559ca10704a0 2024-09-19T06:22:33.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.129+0000 7f8fa7fff640 1 -- 172.21.15.2:0/3922591557 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8fb4036040 con 0x559ca10704a0 2024-09-19T06:22:33.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.129+0000 7f8fa7fff640 1 -- 172.21.15.2:0/3922591557 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb40305c0 con 0x559ca10704a0 2024-09-19T06:22:33.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.130+0000 7f8fc5fb0740 1 -- 172.21.15.2:0/3922591557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559ca10704a0 msgr2=0x559ca1070880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:33.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.130+0000 7f8fc2174640 1 --2- 172.21.15.2:0/3337543396 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f8fa80a33b0 0x7f8fa80a5870 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8fb404a000 tx=0x7f8fb404b000 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:33.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.130+0000 7f8fc5fb0740 1 --2- 172.21.15.2:0/3922591557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559ca10704a0 0x559ca1070880 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4009ca0 tx=0x7f8fb4031bf0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.130+0000 7f8fc5fb0740 1 -- 172.21.15.2:0/3922591557 shutdown_connections 2024-09-19T06:22:33.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.130+0000 7f8fc5fb0740 1 --2- 172.21.15.2:0/3922591557 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559ca107b680 0x559ca107da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.130+0000 7f8fc5fb0740 1 --2- 172.21.15.2:0/3922591557 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559ca1070dc0 0x559ca107b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.130+0000 7f8fc5fb0740 1 --2- 172.21.15.2:0/3922591557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559ca10704a0 0x559ca1070880 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.130+0000 7f8fc5fb0740 1 -- 172.21.15.2:0/3922591557 >> 172.21.15.2:0/3922591557 conn(0x559ca106ca30 msgr2=0x559ca106ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:33.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.130+0000 7f8fc5fb0740 1 -- 172.21.15.2:0/3922591557 shutdown_connections 2024-09-19T06:22:33.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.130+0000 7f8fc5fb0740 1 -- 172.21.15.2:0/3922591557 wait complete. 2024-09-19T06:22:33.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.130+0000 7f8fc5fb0740 1 -- start start 2024-09-19T06:22:33.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.130+0000 7f8fc5fb0740 1 Processor -- start 2024-09-19T06:22:33.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.131+0000 7f8fc5fb0740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559ca10704a0 0x559ca107afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:33.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.131+0000 7f8fc5fb0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559ca1070dc0 0x559ca1078250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:33.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.131+0000 7f8fc5fb0740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559ca107b680 0x559ca1078790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:33.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.131+0000 7f8fc5fb0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559ca107e250 con 0x559ca1070dc0 2024-09-19T06:22:33.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.131+0000 7f8fc5fb0740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x559ca0f91050 con 0x559ca107b680 2024-09-19T06:22:33.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.131+0000 7f8fc5fb0740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x559ca107e3d0 con 0x559ca10704a0 2024-09-19T06:22:33.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.131+0000 7f8fc5fb0740 10 client.0 _ll_register_callbacks cb 0x559ca0fd1160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:33.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.131+0000 7f8fc1172640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559ca1070dc0 0x559ca1078250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:33.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.131+0000 7f8fc1172640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559ca1070dc0 0x559ca1078250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53452/0 (socket says 172.21.15.2:53452) 2024-09-19T06:22:33.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.131+0000 7f8fc1172640 1 -- 172.21.15.2:0/4197994464 learned_addr learned my addr 172.21.15.2:0/4197994464 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:33.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.131+0000 7f8fc1973640 1 --2- 172.21.15.2:0/4197994464 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559ca10704a0 0x559ca107afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:33.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.131+0000 7f8fc2174640 1 --2- 172.21.15.2:0/4197994464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559ca107b680 0x559ca1078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:33.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.131+0000 7f8fc1172640 1 -- 172.21.15.2:0/4197994464 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559ca10704a0 msgr2=0x559ca107afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:33.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.131+0000 7f8fc1172640 1 --2- 172.21.15.2:0/4197994464 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559ca10704a0 0x559ca107afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.131+0000 7f8fc1172640 1 -- 172.21.15.2:0/4197994464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559ca107b680 msgr2=0x559ca1078790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:33.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.131+0000 7f8fc1172640 1 --2- 172.21.15.2:0/4197994464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559ca107b680 0x559ca1078790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.131+0000 7f8fc1172640 1 -- 172.21.15.2:0/4197994464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ca0d473c0 con 0x559ca1070dc0 2024-09-19T06:22:33.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.131+0000 7f8fc2174640 1 --2- 172.21.15.2:0/4197994464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559ca107b680 0x559ca1078790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:33.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.131+0000 7f8fc1172640 1 --2- 172.21.15.2:0/4197994464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559ca1070dc0 0x559ca1078250 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f8fac000c00 tx=0x7f8fac0a02a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4761eb373dac72b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:33.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.131+0000 7f8fa57fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:22:33.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.132+0000 7f8fa57fa640 1 -- 172.21.15.2:0/4197994464 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fac0cfe60 con 0x559ca1070dc0 2024-09-19T06:22:33.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.132+0000 7f8fa57fa640 1 -- 172.21.15.2:0/4197994464 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7f8fac098300 con 0x559ca1070dc0 2024-09-19T06:22:33.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.132+0000 7f8fc5fb0740 1 -- 172.21.15.2:0/4197994464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8fb4036040 con 0x559ca1070dc0 2024-09-19T06:22:33.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.132+0000 7f8fa57fa640 1 -- 172.21.15.2:0/4197994464 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8fac020070 con 0x559ca1070dc0 2024-09-19T06:22:33.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.132+0000 7f8fc5fb0740 10 client.18057 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:33.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.132+0000 7f8fc5fb0740 1 -- 172.21.15.2:0/4197994464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x559ca1089bf0 con 0x559ca1070dc0 2024-09-19T06:22:33.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.132+0000 7f8fa57fa640 1 -- 172.21.15.2:0/4197994464 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8fb4036040 con 0x559ca1070dc0 2024-09-19T06:22:33.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.132+0000 7f8fa57fa640 1 -- 172.21.15.2:0/4197994464 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f8fac010460 con 0x559ca1070dc0 2024-09-19T06:22:33.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.132+0000 7f8fc5fb0740 10 client.18057 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:33.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.132+0000 7f8fc5fb0740 10 client.18057 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:33.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.132+0000 7f8fc5fb0740 20 client.18057 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:33.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.132+0000 7f8fc5fb0740 1 --2- 172.21.15.2:0/4197994464 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x559ca108b000 0x559ca108d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:33.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.132+0000 7f8fc5fb0740 4 client.18057 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:22:33.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.132+0000 7f8fc5fb0740 1 -- 172.21.15.2:0/4197994464 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559ca0fe3850 con 0x559ca108b000 2024-09-19T06:22:33.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.133+0000 7f8fc1973640 1 --2- 172.21.15.2:0/4197994464 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x559ca108b000 0x559ca108d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:33.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.133+0000 7f8fc1973640 1 --2- 172.21.15.2:0/4197994464 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x559ca108b000 0x559ca108d410 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee202c66cc09512b server_cookie=83e31c3f571cba09 in_seq=0 out_seq=0 2024-09-19T06:22:33.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.133+0000 7f8fa57fa640 10 client.18057 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:33.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.134+0000 7f8fa57fa640 1 -- 172.21.15.2:0/4197994464 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559ca0fe3850 con 0x559ca108b000 2024-09-19T06:22:33.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.134+0000 7f8fa57fa640 10 client.18057 handle_command_reply: tid=0 2024-09-19T06:22:33.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.134+0000 7f8fc5fb0740 1 client.18057 shutdown 2024-09-19T06:22:33.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.134+0000 7f8fc5fb0740 1 -- 172.21.15.2:0/4197994464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559ca1070dc0 msgr2=0x559ca1078250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:33.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.134+0000 7f8fc5fb0740 1 --2- 172.21.15.2:0/4197994464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559ca1070dc0 0x559ca1078250 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f8fac000c00 tx=0x7f8fac0a02a0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.134+0000 7f8fc5fb0740 1 -- 172.21.15.2:0/4197994464 shutdown_connections 2024-09-19T06:22:33.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.134+0000 7f8fc5fb0740 1 --2- 172.21.15.2:0/4197994464 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x559ca108b000 0x559ca108d410 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.134+0000 7f8fc5fb0740 1 --2- 172.21.15.2:0/4197994464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559ca107b680 0x559ca1078790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.134+0000 7f8fc5fb0740 1 --2- 172.21.15.2:0/4197994464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559ca1070dc0 0x559ca1078250 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.134+0000 7f8fc5fb0740 1 --2- 172.21.15.2:0/4197994464 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559ca10704a0 0x559ca107afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.134+0000 7f8fc5fb0740 1 -- 172.21.15.2:0/4197994464 >> 172.21.15.2:0/4197994464 conn(0x559ca106ca30 msgr2=0x559ca1072710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:33.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.134+0000 7f8fa57fa640 0 client.18057 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:33.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.134+0000 7f8fc5fb0740 1 -- 172.21.15.2:0/4197994464 shutdown_connections 2024-09-19T06:22:33.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.134+0000 7f8fc5fb0740 1 -- 172.21.15.2:0/4197994464 wait complete. 2024-09-19T06:22:33.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.134+0000 7f8fc5fb0740 20 client.18057 trim_cache size 0 max 16384 2024-09-19T06:22:33.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.151+0000 7f8fc5fb0740 1 Processor -- start 2024-09-19T06:22:33.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.152+0000 7f8fc5fb0740 1 -- start start 2024-09-19T06:22:33.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.152+0000 7f8fc5fb0740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559ca10704a0 0x559ca10874b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:33.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.152+0000 7f8fc5fb0740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559ca1070dc0 0x559ca1092ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:33.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.152+0000 7f8fc5fb0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559ca107b680 0x559ca1093220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:33.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.152+0000 7f8fc5fb0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8fbc1b2260 con 0x559ca107b680 2024-09-19T06:22:33.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.152+0000 7f8fc5fb0740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8fbc1afb30 con 0x559ca1070dc0 2024-09-19T06:22:33.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.152+0000 7f8fc5fb0740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8fbc1ad9a0 con 0x559ca10704a0 2024-09-19T06:22:33.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.152+0000 7f8fc2174640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559ca107b680 0x559ca1093220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:33.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.152+0000 7f8fc2174640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559ca107b680 0x559ca1093220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53454/0 (socket says 172.21.15.2:53454) 2024-09-19T06:22:33.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.152+0000 7f8fc2174640 1 -- 172.21.15.2:0/2597609074 learned_addr learned my addr 172.21.15.2:0/2597609074 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:33.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.152+0000 7f8fc1973640 1 --2- 172.21.15.2:0/2597609074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559ca10704a0 0x559ca10874b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:33.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.152+0000 7f8fc1172640 1 --2- 172.21.15.2:0/2597609074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559ca1070dc0 0x559ca1092ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:33.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.152+0000 7f8fc2174640 1 -- 172.21.15.2:0/2597609074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559ca10704a0 msgr2=0x559ca10874b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:33.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.152+0000 7f8fc2174640 1 --2- 172.21.15.2:0/2597609074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559ca10704a0 0x559ca10874b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.152+0000 7f8fc2174640 1 -- 172.21.15.2:0/2597609074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559ca1070dc0 msgr2=0x559ca1092ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:33.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.152+0000 7f8fc2174640 1 --2- 172.21.15.2:0/2597609074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559ca1070dc0 0x559ca1092ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.152+0000 7f8fc2174640 1 -- 172.21.15.2:0/2597609074 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ca10702d0 con 0x559ca107b680 2024-09-19T06:22:33.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.153+0000 7f8fc2174640 1 --2- 172.21.15.2:0/2597609074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559ca107b680 0x559ca1093220 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4009ba0 tx=0x7f8fb4050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ede19193b0b65547 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:33.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.153+0000 7f8fa77fe640 1 -- 172.21.15.2:0/2597609074 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb404d040 con 0x559ca107b680 2024-09-19T06:22:33.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.153+0000 7f8fa77fe640 1 -- 172.21.15.2:0/2597609074 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8fb4036070 con 0x559ca107b680 2024-09-19T06:22:33.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.153+0000 7f8fa77fe640 1 -- 172.21.15.2:0/2597609074 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb4004630 con 0x559ca107b680 2024-09-19T06:22:33.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.153+0000 7f8fc5fb0740 1 -- 172.21.15.2:0/2597609074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559ca107b680 msgr2=0x559ca1093220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:33.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.153+0000 7f8fc5fb0740 1 --2- 172.21.15.2:0/2597609074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559ca107b680 0x559ca1093220 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4009ba0 tx=0x7f8fb4050000 comp rx=0 tx=0).stop 2024-09-19T06:22:33.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.153+0000 7f8fc5fb0740 1 -- 172.21.15.2:0/2597609074 shutdown_connections 2024-09-19T06:22:33.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.153+0000 7f8fc5fb0740 1 --2- 172.21.15.2:0/2597609074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559ca107b680 0x559ca1093220 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.153+0000 7f8fc5fb0740 1 --2- 172.21.15.2:0/2597609074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559ca1070dc0 0x559ca1092ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.153+0000 7f8fc5fb0740 1 --2- 172.21.15.2:0/2597609074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559ca10704a0 0x559ca10874b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.153+0000 7f8fc5fb0740 1 -- 172.21.15.2:0/2597609074 >> 172.21.15.2:0/2597609074 conn(0x559ca106ca30 msgr2=0x559ca1077340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:33.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.154+0000 7f8fc5fb0740 1 -- 172.21.15.2:0/2597609074 shutdown_connections 2024-09-19T06:22:33.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.154+0000 7f8fc5fb0740 1 -- 172.21.15.2:0/2597609074 wait complete. 2024-09-19T06:22:33.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.154+0000 7f8fc5fb0740 1 -- start start 2024-09-19T06:22:33.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.154+0000 7f8fc5fb0740 1 Processor -- start 2024-09-19T06:22:33.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.154+0000 7f8fc5fb0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559ca10704a0 0x559ca10812e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:33.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.154+0000 7f8fc5fb0740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559ca1070dc0 0x559ca1081820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:33.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.154+0000 7f8fc5fb0740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559ca107b680 0x559ca1081d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:33.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.154+0000 7f8fc5fb0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8fbc1adff0 con 0x559ca10704a0 2024-09-19T06:22:33.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.154+0000 7f8fc5fb0740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8fbc1af460 con 0x559ca1070dc0 2024-09-19T06:22:33.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.154+0000 7f8fc5fb0740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8fbc1ae6c0 con 0x559ca107b680 2024-09-19T06:22:33.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.154+0000 7f8fc5fb0740 10 client.0 _ll_register_callbacks cb 0x7f8fac00df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:33.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.155+0000 7f8fc1973640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559ca10704a0 0x559ca10812e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:33.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.155+0000 7f8fc1973640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559ca10704a0 0x559ca10812e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53470/0 (socket says 172.21.15.2:53470) 2024-09-19T06:22:33.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.155+0000 7f8fc1973640 1 -- 172.21.15.2:0/3785755935 learned_addr learned my addr 172.21.15.2:0/3785755935 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:33.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.155+0000 7f8fc2174640 1 --2- 172.21.15.2:0/3785755935 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559ca107b680 0x559ca1081d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:33.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.155+0000 7f8fc1172640 1 --2- 172.21.15.2:0/3785755935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559ca1070dc0 0x559ca1081820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:33.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.155+0000 7f8fc1973640 1 -- 172.21.15.2:0/3785755935 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559ca107b680 msgr2=0x559ca1081d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:33.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.155+0000 7f8fc1973640 1 --2- 172.21.15.2:0/3785755935 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559ca107b680 0x559ca1081d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.155+0000 7f8fc1973640 1 -- 172.21.15.2:0/3785755935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559ca1070dc0 msgr2=0x559ca1081820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:33.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.155+0000 7f8fc1973640 1 --2- 172.21.15.2:0/3785755935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559ca1070dc0 0x559ca1081820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.155+0000 7f8fc1973640 1 -- 172.21.15.2:0/3785755935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ca10f4cc0 con 0x559ca10704a0 2024-09-19T06:22:33.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.155+0000 7f8fc1172640 1 --2- 172.21.15.2:0/3785755935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559ca1070dc0 0x559ca1081820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:33.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.155+0000 7f8fc2174640 1 --2- 172.21.15.2:0/3785755935 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559ca107b680 0x559ca1081d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:33.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.155+0000 7f8fc1973640 1 --2- 172.21.15.2:0/3785755935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559ca10704a0 0x559ca10812e0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x559ca108dc50 tx=0x7f8fb8010b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f76d883f12656f25 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:33.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.155+0000 7f8fa57fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:22:33.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.155+0000 7f8fa57fa640 1 -- 172.21.15.2:0/3785755935 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb800f950 con 0x559ca10704a0 2024-09-19T06:22:33.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.155+0000 7f8fa57fa640 1 -- 172.21.15.2:0/3785755935 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7f8fb800faf0 con 0x559ca10704a0 2024-09-19T06:22:33.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.155+0000 7f8fc5fb0740 1 -- 172.21.15.2:0/3785755935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8fb4036070 con 0x559ca10704a0 2024-09-19T06:22:33.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.155+0000 7f8fa57fa640 1 -- 172.21.15.2:0/3785755935 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8fb800fcf0 con 0x559ca10704a0 2024-09-19T06:22:33.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.155+0000 7f8fc5fb0740 10 client.18063 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:33.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.155+0000 7f8fc5fb0740 1 -- 172.21.15.2:0/3785755935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x559ca10f5f70 con 0x559ca10704a0 2024-09-19T06:22:33.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.156+0000 7f8fa57fa640 1 -- 172.21.15.2:0/3785755935 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8fb4036070 con 0x559ca10704a0 2024-09-19T06:22:33.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.156+0000 7f8fa57fa640 1 -- 172.21.15.2:0/3785755935 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f8fb80246d0 con 0x559ca10704a0 2024-09-19T06:22:33.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.156+0000 7f8fc5fb0740 10 client.18063 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:33.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.156+0000 7f8fc5fb0740 10 client.18063 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:33.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.156+0000 7f8fc5fb0740 20 client.18063 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:33.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.156+0000 7f8fc5fb0740 1 --2- 172.21.15.2:0/3785755935 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x559ca10f6740 0x559ca10f8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:33.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.156+0000 7f8fc5fb0740 4 client.18063 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:22:33.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.156+0000 7f8fc5fb0740 1 -- 172.21.15.2:0/3785755935 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559ca10793a0 con 0x559ca10f6740 2024-09-19T06:22:33.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.156+0000 7f8fc1172640 1 --2- 172.21.15.2:0/3785755935 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x559ca10f6740 0x559ca10f8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:33.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.157+0000 7f8fc1172640 1 --2- 172.21.15.2:0/3785755935 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x559ca10f6740 0x559ca10f8b60 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75c58c92a20b5ae5 server_cookie=6b86444b49c3d537 in_seq=0 out_seq=0 2024-09-19T06:22:33.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.157+0000 7f8fa57fa640 10 client.18063 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:33.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.157+0000 7f8fa57fa640 1 -- 172.21.15.2:0/3785755935 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x559ca10793a0 con 0x559ca10f6740 2024-09-19T06:22:33.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.157+0000 7f8fa57fa640 10 client.18063 handle_command_reply: tid=0 2024-09-19T06:22:33.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.157+0000 7f8fc5fb0740 1 client.18063 shutdown 2024-09-19T06:22:33.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.157+0000 7f8fc5fb0740 1 -- 172.21.15.2:0/3785755935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559ca10704a0 msgr2=0x559ca10812e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:33.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.157+0000 7f8fc5fb0740 1 --2- 172.21.15.2:0/3785755935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559ca10704a0 0x559ca10812e0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x559ca108dc50 tx=0x7f8fb8010b40 comp rx=0 tx=0).stop 2024-09-19T06:22:33.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.157+0000 7f8fc5fb0740 1 -- 172.21.15.2:0/3785755935 shutdown_connections 2024-09-19T06:22:33.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.157+0000 7f8fc5fb0740 1 --2- 172.21.15.2:0/3785755935 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559ca107b680 0x559ca1081d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.157+0000 7f8fc5fb0740 1 --2- 172.21.15.2:0/3785755935 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x559ca10f6740 0x559ca10f8b60 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.157+0000 7f8fc5fb0740 1 --2- 172.21.15.2:0/3785755935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559ca1070dc0 0x559ca1081820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.157+0000 7f8fc5fb0740 1 --2- 172.21.15.2:0/3785755935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559ca10704a0 0x559ca10812e0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.157+0000 7f8fc5fb0740 1 -- 172.21.15.2:0/3785755935 >> 172.21.15.2:0/3785755935 conn(0x559ca106ca30 msgr2=0x559ca106b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:33.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.157+0000 7f8fa57fa640 0 client.18063 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:33.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.157+0000 7f8fc5fb0740 1 -- 172.21.15.2:0/3785755935 shutdown_connections 2024-09-19T06:22:33.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.157+0000 7f8fc5fb0740 1 -- 172.21.15.2:0/3785755935 wait complete. 2024-09-19T06:22:33.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.157+0000 7f8fc5fb0740 20 client.18063 trim_cache size 0 max 16384 2024-09-19T06:22:33.165 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:22:33.165 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T06:22:33.165 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T06:22:33.165 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:22:33.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.158+0000 7f8fc3bd7640 1 -- 172.21.15.2:0/3337543396 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f8fa80a33b0 msgr2=0x7f8fa80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:33.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.158+0000 7f8fc3bd7640 1 --2- 172.21.15.2:0/3337543396 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f8fa80a33b0 0x7f8fa80a5870 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8fb404a000 tx=0x7f8fb404b000 comp rx=0 tx=0).stop 2024-09-19T06:22:33.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.158+0000 7f8fc3bd7640 1 -- 172.21.15.2:0/3337543396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fbc101280 msgr2=0x7f8fbc19aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:33.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.158+0000 7f8fc3bd7640 1 --2- 172.21.15.2:0/3337543396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fbc101280 0x7f8fbc19aa30 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f8fac00d950 tx=0x7f8fac00de10 comp rx=0 tx=0).stop 2024-09-19T06:22:33.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.158+0000 7f8fc3bd7640 1 -- 172.21.15.2:0/3337543396 shutdown_connections 2024-09-19T06:22:33.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.158+0000 7f8fc3bd7640 1 --2- 172.21.15.2:0/3337543396 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f8fa80a33b0 0x7f8fa80a5870 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.158+0000 7f8fc3bd7640 1 --2- 172.21.15.2:0/3337543396 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fbc10e480 0x7f8fbc19edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.158+0000 7f8fc3bd7640 1 --2- 172.21.15.2:0/3337543396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fbc101280 0x7f8fbc19aa30 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.158+0000 7f8fc3bd7640 1 --2- 172.21.15.2:0/3337543396 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fbc1008d0 0x7f8fbc19a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.158+0000 7f8fc3bd7640 1 -- 172.21.15.2:0/3337543396 >> 172.21.15.2:0/3337543396 conn(0x7f8fbc0fc7a0 msgr2=0x7f8fbc0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:33.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.158+0000 7f8fc3bd7640 1 -- 172.21.15.2:0/3337543396 shutdown_connections 2024-09-19T06:22:33.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:33.158+0000 7f8fc3bd7640 1 -- 172.21.15.2:0/3337543396 wait complete. 2024-09-19T06:22:33.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:33 smithi002 ceph-mon[30982]: pgmap v239: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:22:33.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:33 smithi002 ceph-mon[30982]: scrub summary: idle 2024-09-19T06:22:33.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:33 smithi090 ceph-mon[34497]: pgmap v239: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:22:33.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:33 smithi090 ceph-mon[34497]: scrub summary: idle 2024-09-19T06:22:33.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:33 smithi089 ceph-mon[34160]: pgmap v239: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:22:33.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:33 smithi089 ceph-mon[34160]: scrub summary: idle 2024-09-19T06:22:33.823 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:22:33.823 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:22:34.080 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:22:34.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.552+0000 7f67ee36b640 1 -- 172.21.15.2:0/3822827558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67e8102790 msgr2=0x7f67e81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:34.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.552+0000 7f67ee36b640 1 --2- 172.21.15.2:0/3822827558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67e8102790 0x7f67e81067e0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f67dc009900 tx=0x7f67dc02a410 comp rx=0 tx=0).stop 2024-09-19T06:22:34.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.552+0000 7f67ee36b640 1 -- 172.21.15.2:0/3822827558 shutdown_connections 2024-09-19T06:22:34.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.552+0000 7f67ee36b640 1 --2- 172.21.15.2:0/3822827558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f67e8106f10 0x7f67e810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:34.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.552+0000 7f67ee36b640 1 --2- 172.21.15.2:0/3822827558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67e8102790 0x7f67e81067e0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:34.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.552+0000 7f67ee36b640 1 --2- 172.21.15.2:0/3822827558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67e8101de0 0x7f67e81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:34.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.552+0000 7f67ee36b640 1 -- 172.21.15.2:0/3822827558 >> 172.21.15.2:0/3822827558 conn(0x7f67e80fd8c0 msgr2=0x7f67e80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:34.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.552+0000 7f67ee36b640 1 -- 172.21.15.2:0/3822827558 shutdown_connections 2024-09-19T06:22:34.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.552+0000 7f67ee36b640 1 -- 172.21.15.2:0/3822827558 wait complete. 2024-09-19T06:22:34.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.553+0000 7f67ee36b640 1 Processor -- start 2024-09-19T06:22:34.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.553+0000 7f67ee36b640 1 -- start start 2024-09-19T06:22:34.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.554+0000 7f67ee36b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f67e8101de0 0x7f67e8198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:34.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.554+0000 7f67ee36b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67e8102790 0x7f67e81988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:34.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.554+0000 7f67ee36b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67e8106f10 0x7f67e819cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:34.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.554+0000 7f67ee36b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f67e8111e20 con 0x7f67e8102790 2024-09-19T06:22:34.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.554+0000 7f67ee36b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f67e8111ca0 con 0x7f67e8106f10 2024-09-19T06:22:34.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.554+0000 7f67ee36b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f67e8111fa0 con 0x7f67e8101de0 2024-09-19T06:22:34.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.554+0000 7f67e77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67e8102790 0x7f67e81988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:34.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.554+0000 7f67e77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67e8102790 0x7f67e81988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53482/0 (socket says 172.21.15.2:53482) 2024-09-19T06:22:34.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.554+0000 7f67e77fe640 1 -- 172.21.15.2:0/1269975031 learned_addr learned my addr 172.21.15.2:0/1269975031 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:34.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.554+0000 7f67ec908640 1 --2- 172.21.15.2:0/1269975031 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67e8106f10 0x7f67e819cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:34.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.554+0000 7f67e7fff640 1 --2- 172.21.15.2:0/1269975031 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f67e8101de0 0x7f67e8198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:34.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.554+0000 7f67e77fe640 1 -- 172.21.15.2:0/1269975031 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f67e8101de0 msgr2=0x7f67e8198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:34.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.554+0000 7f67e77fe640 1 --2- 172.21.15.2:0/1269975031 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f67e8101de0 0x7f67e8198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:34.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.554+0000 7f67e77fe640 1 -- 172.21.15.2:0/1269975031 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67e8106f10 msgr2=0x7f67e819cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:34.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.554+0000 7f67e77fe640 1 --2- 172.21.15.2:0/1269975031 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67e8106f10 0x7f67e819cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:34.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.554+0000 7f67e77fe640 1 -- 172.21.15.2:0/1269975031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67e819d310 con 0x7f67e8102790 2024-09-19T06:22:34.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.554+0000 7f67e77fe640 1 --2- 172.21.15.2:0/1269975031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67e8102790 0x7f67e81988a0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f67dc005940 tx=0x7f67dc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:34.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.555+0000 7f67e57fa640 1 -- 172.21.15.2:0/1269975031 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc03f030 con 0x7f67e8102790 2024-09-19T06:22:34.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.555+0000 7f67e57fa640 1 -- 172.21.15.2:0/1269975031 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f67dc003aa0 con 0x7f67e8102790 2024-09-19T06:22:34.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.555+0000 7f67ee36b640 1 -- 172.21.15.2:0/1269975031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67e819d5a0 con 0x7f67e8102790 2024-09-19T06:22:34.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.555+0000 7f67e57fa640 1 -- 172.21.15.2:0/1269975031 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc035070 con 0x7f67e8102790 2024-09-19T06:22:34.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.555+0000 7f67ee36b640 1 -- 172.21.15.2:0/1269975031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67e81a4ee0 con 0x7f67e8102790 2024-09-19T06:22:34.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.556+0000 7f67ee36b640 1 -- 172.21.15.2:0/1269975031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67e81021c0 con 0x7f67e8102790 2024-09-19T06:22:34.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.557+0000 7f67e57fa640 1 -- 172.21.15.2:0/1269975031 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f67dc042030 con 0x7f67e8102790 2024-09-19T06:22:34.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.558+0000 7f67e57fa640 1 --2- 172.21.15.2:0/1269975031 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f67d00a33b0 0x7f67d00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:34.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.558+0000 7f67e7fff640 1 --2- 172.21.15.2:0/1269975031 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f67d00a33b0 0x7f67d00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:34.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.558+0000 7f67e57fa640 1 -- 172.21.15.2:0/1269975031 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7f67dc0f0730 con 0x7f67e8102790 2024-09-19T06:22:34.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.558+0000 7f67e7fff640 1 --2- 172.21.15.2:0/1269975031 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f67d00a33b0 0x7f67d00a5870 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f67d8005fd0 tx=0x7f67d8005850 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:34.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.561+0000 7f67e57fa640 1 -- 172.21.15.2:0/1269975031 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f67dc0bd110 con 0x7f67e8102790 2024-09-19T06:22:34.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.775+0000 7f67ee36b640 1 -- 172.21.15.2:0/1269975031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f67e810a0f0 con 0x7f67e8102790 2024-09-19T06:22:34.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.775+0000 7f67e57fa640 1 -- 172.21.15.2:0/1269975031 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11882 (secure 0 0 0) 0x7f67dc0bca10 con 0x7f67e8102790 2024-09-19T06:22:34.777 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:22:34.777 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-09-19T06:14:49:104280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:14:48.191083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24470,24472,24497]},"id":1}]} 2024-09-19T06:22:34.778 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-09-19T06:22:34.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.778+0000 7f67ee36b640 1 -- 172.21.15.2:0/1269975031 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f67d00a33b0 msgr2=0x7f67d00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:34.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.778+0000 7f67ee36b640 1 --2- 172.21.15.2:0/1269975031 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f67d00a33b0 0x7f67d00a5870 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f67d8005fd0 tx=0x7f67d8005850 comp rx=0 tx=0).stop 2024-09-19T06:22:34.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.778+0000 7f67ee36b640 1 -- 172.21.15.2:0/1269975031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67e8102790 msgr2=0x7f67e81988a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:34.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.778+0000 7f67ee36b640 1 --2- 172.21.15.2:0/1269975031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67e8102790 0x7f67e81988a0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f67dc005940 tx=0x7f67dc004270 comp rx=0 tx=0).stop 2024-09-19T06:22:34.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.778+0000 7f67ee36b640 1 -- 172.21.15.2:0/1269975031 shutdown_connections 2024-09-19T06:22:34.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.778+0000 7f67ee36b640 1 --2- 172.21.15.2:0/1269975031 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f67d00a33b0 0x7f67d00a5870 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:34.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.778+0000 7f67ee36b640 1 --2- 172.21.15.2:0/1269975031 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67e8106f10 0x7f67e819cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:34.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.778+0000 7f67ee36b640 1 --2- 172.21.15.2:0/1269975031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67e8102790 0x7f67e81988a0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:34.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.778+0000 7f67ee36b640 1 --2- 172.21.15.2:0/1269975031 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f67e8101de0 0x7f67e8198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:34.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.778+0000 7f67ee36b640 1 -- 172.21.15.2:0/1269975031 >> 172.21.15.2:0/1269975031 conn(0x7f67e80fd8c0 msgr2=0x7f67e80fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:34.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.778+0000 7f67ee36b640 1 -- 172.21.15.2:0/1269975031 shutdown_connections 2024-09-19T06:22:34.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:34.778+0000 7f67ee36b640 1 -- 172.21.15.2:0/1269975031 wait complete. 2024-09-19T06:22:35.437 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:22:35.696 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:22:35.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:35 smithi002 ceph-mon[30982]: pgmap v240: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2024-09-19T06:22:35.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:35 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1269975031' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:22:35.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:35 smithi090 ceph-mon[34497]: pgmap v240: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2024-09-19T06:22:35.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:35 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1269975031' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:22:35.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:35 smithi089 ceph-mon[34160]: pgmap v240: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2024-09-19T06:22:35.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:35 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1269975031' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:22:36.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.178+0000 7f39f493f640 1 -- 172.21.15.2:0/865613913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39f0102790 msgr2=0x7f39f01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:36.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.178+0000 7f39f493f640 1 --2- 172.21.15.2:0/865613913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39f0102790 0x7f39f01067e0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f39e4009900 tx=0x7f39e402a3f0 comp rx=0 tx=0).stop 2024-09-19T06:22:36.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.178+0000 7f39f493f640 1 -- 172.21.15.2:0/865613913 shutdown_connections 2024-09-19T06:22:36.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.178+0000 7f39f493f640 1 --2- 172.21.15.2:0/865613913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39f0106f10 0x7f39f010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:36.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.178+0000 7f39f493f640 1 --2- 172.21.15.2:0/865613913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39f0102790 0x7f39f01067e0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:36.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.178+0000 7f39f493f640 1 --2- 172.21.15.2:0/865613913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39f0101de0 0x7f39f01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:36.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.178+0000 7f39f493f640 1 -- 172.21.15.2:0/865613913 >> 172.21.15.2:0/865613913 conn(0x7f39f00fd8c0 msgr2=0x7f39f00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:36.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.178+0000 7f39f493f640 1 -- 172.21.15.2:0/865613913 shutdown_connections 2024-09-19T06:22:36.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.178+0000 7f39f493f640 1 -- 172.21.15.2:0/865613913 wait complete. 2024-09-19T06:22:36.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.179+0000 7f39f493f640 1 Processor -- start 2024-09-19T06:22:36.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.179+0000 7f39f493f640 1 -- start start 2024-09-19T06:22:36.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.179+0000 7f39f493f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39f0101de0 0x7f39f0198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:36.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.179+0000 7f39f493f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39f0102790 0x7f39f0198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:36.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.179+0000 7f39f493f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39f0106f10 0x7f39f019ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:36.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.179+0000 7f39f493f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f39f0111e40 con 0x7f39f0102790 2024-09-19T06:22:36.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.179+0000 7f39f493f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f39f0111cc0 con 0x7f39f0106f10 2024-09-19T06:22:36.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.179+0000 7f39f493f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f39f0111fc0 con 0x7f39f0101de0 2024-09-19T06:22:36.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.179+0000 7f39edd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39f0102790 0x7f39f0198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:36.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.179+0000 7f39edd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39f0102790 0x7f39f0198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44468/0 (socket says 172.21.15.2:44468) 2024-09-19T06:22:36.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.179+0000 7f39edd9b640 1 -- 172.21.15.2:0/502743496 learned_addr learned my addr 172.21.15.2:0/502743496 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:36.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.179+0000 7f39ee59c640 1 --2- 172.21.15.2:0/502743496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39f0101de0 0x7f39f0198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:36.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.179+0000 7f39eed9d640 1 --2- 172.21.15.2:0/502743496 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39f0106f10 0x7f39f019ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:36.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.180+0000 7f39edd9b640 1 -- 172.21.15.2:0/502743496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39f0101de0 msgr2=0x7f39f0198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:36.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.180+0000 7f39edd9b640 1 --2- 172.21.15.2:0/502743496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39f0101de0 0x7f39f0198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:36.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.180+0000 7f39edd9b640 1 -- 172.21.15.2:0/502743496 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39f0106f10 msgr2=0x7f39f019ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:36.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.180+0000 7f39edd9b640 1 --2- 172.21.15.2:0/502743496 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39f0106f10 0x7f39f019ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:36.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.180+0000 7f39edd9b640 1 -- 172.21.15.2:0/502743496 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39f019d3d0 con 0x7f39f0102790 2024-09-19T06:22:36.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.180+0000 7f39edd9b640 1 --2- 172.21.15.2:0/502743496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39f0102790 0x7f39f0198960 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f39e4005940 tx=0x7f39e4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:36.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.180+0000 7f39df7fe640 1 -- 172.21.15.2:0/502743496 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e403f030 con 0x7f39f0102790 2024-09-19T06:22:36.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.180+0000 7f39df7fe640 1 -- 172.21.15.2:0/502743496 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f39e4003aa0 con 0x7f39f0102790 2024-09-19T06:22:36.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.180+0000 7f39f493f640 1 -- 172.21.15.2:0/502743496 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39f019d660 con 0x7f39f0102790 2024-09-19T06:22:36.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.180+0000 7f39df7fe640 1 -- 172.21.15.2:0/502743496 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e4035070 con 0x7f39f0102790 2024-09-19T06:22:36.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.180+0000 7f39f493f640 1 -- 172.21.15.2:0/502743496 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39f01a4fa0 con 0x7f39f0102790 2024-09-19T06:22:36.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.182+0000 7f39df7fe640 1 -- 172.21.15.2:0/502743496 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f39e4042030 con 0x7f39f0102790 2024-09-19T06:22:36.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.182+0000 7f39f6d18740 1 Processor -- start 2024-09-19T06:22:36.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.183+0000 7f39f6d18740 1 -- start start 2024-09-19T06:22:36.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.183+0000 7f39f6d18740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561d70231b40 0x561d70230090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:36.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.183+0000 7f39f6d18740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d702305d0 0x561d70230a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:36.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.183+0000 7f39f6d18740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561d7023f780 0x561d70241b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:36.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.183+0000 7f39f6d18740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561d701962f0 con 0x561d702305d0 2024-09-19T06:22:36.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.183+0000 7f39f6d18740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x561d7013dcf0 con 0x561d7023f780 2024-09-19T06:22:36.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.183+0000 7f39f6d18740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x561d701922b0 con 0x561d70231b40 2024-09-19T06:22:36.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.183+0000 7f39ee59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d702305d0 0x561d70230a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:36.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.183+0000 7f39ee59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d702305d0 0x561d70230a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44484/0 (socket says 172.21.15.2:44484) 2024-09-19T06:22:36.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.183+0000 7f39ee59c640 1 -- 172.21.15.2:0/3079744257 learned_addr learned my addr 172.21.15.2:0/3079744257 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:36.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.183+0000 7f39df7fe640 1 --2- 172.21.15.2:0/502743496 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f39d80a33b0 0x7f39d80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:36.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.183+0000 7f39eed9d640 1 --2- 172.21.15.2:0/3079744257 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561d70231b40 0x561d70230090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:36.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.183+0000 7f39ee59c640 1 -- 172.21.15.2:0/3079744257 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561d70231b40 msgr2=0x561d70230090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:36.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.183+0000 7f39ee59c640 1 --2- 172.21.15.2:0/3079744257 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561d70231b40 0x561d70230090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:36.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.183+0000 7f39ee59c640 1 -- 172.21.15.2:0/3079744257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561d7023f780 msgr2=0x561d70241b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:36.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.183+0000 7f39ee59c640 1 --2- 172.21.15.2:0/3079744257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561d7023f780 0x561d70241b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:36.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.183+0000 7f39df7fe640 1 -- 172.21.15.2:0/502743496 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7f39e40eff60 con 0x7f39f0102790 2024-09-19T06:22:36.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.183+0000 7f39ee59c640 1 -- 172.21.15.2:0/3079744257 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d701223a0 con 0x561d702305d0 2024-09-19T06:22:36.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.184+0000 7f39eed9d640 1 --2- 172.21.15.2:0/3079744257 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561d70231b40 0x561d70230090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:22:36.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.184+0000 7f39eed9d640 1 --2- 172.21.15.2:0/502743496 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f39d80a33b0 0x7f39d80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:36.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.184+0000 7f39ee59c640 1 --2- 172.21.15.2:0/3079744257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d702305d0 0x561d70230a10 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f39e0009a70 tx=0x7f39e0009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31a5064bcc1b11a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:36.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.184+0000 7f39dcff9640 1 -- 172.21.15.2:0/3079744257 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e0017070 con 0x561d702305d0 2024-09-19T06:22:36.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.184+0000 7f39dcff9640 1 -- 172.21.15.2:0/3079744257 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f39e0013470 con 0x561d702305d0 2024-09-19T06:22:36.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.184+0000 7f39dcff9640 1 -- 172.21.15.2:0/3079744257 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e00125d0 con 0x561d702305d0 2024-09-19T06:22:36.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.185+0000 7f39f6d18740 1 -- 172.21.15.2:0/3079744257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d702305d0 msgr2=0x561d70230a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:36.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.185+0000 7f39eed9d640 1 --2- 172.21.15.2:0/502743496 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f39d80a33b0 0x7f39d80a5870 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f39e8005c40 tx=0x7f39e8004a40 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:36.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.185+0000 7f39f6d18740 1 --2- 172.21.15.2:0/3079744257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d702305d0 0x561d70230a10 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f39e0009a70 tx=0x7f39e0009f30 comp rx=0 tx=0).stop 2024-09-19T06:22:36.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.185+0000 7f39f6d18740 1 -- 172.21.15.2:0/3079744257 shutdown_connections 2024-09-19T06:22:36.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.185+0000 7f39f6d18740 1 --2- 172.21.15.2:0/3079744257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561d7023f780 0x561d70241b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:36.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.185+0000 7f39f6d18740 1 --2- 172.21.15.2:0/3079744257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d702305d0 0x561d70230a10 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:36.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.185+0000 7f39f6d18740 1 --2- 172.21.15.2:0/3079744257 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561d70231b40 0x561d70230090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:36.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.185+0000 7f39f6d18740 1 -- 172.21.15.2:0/3079744257 >> 172.21.15.2:0/3079744257 conn(0x561d701f9310 msgr2=0x561d7022cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:36.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.185+0000 7f39f6d18740 1 -- 172.21.15.2:0/3079744257 shutdown_connections 2024-09-19T06:22:36.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.185+0000 7f39f6d18740 1 -- 172.21.15.2:0/3079744257 wait complete. 2024-09-19T06:22:36.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.185+0000 7f39f6d18740 1 -- start start 2024-09-19T06:22:36.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.185+0000 7f39f6d18740 1 Processor -- start 2024-09-19T06:22:36.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.186+0000 7f39f6d18740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561d702305d0 0x561d7023f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:36.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.186+0000 7f39f6d18740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d70231b40 0x561d7023c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:36.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.186+0000 7f39f6d18740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561d7023f780 0x561d7023cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:36.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.186+0000 7f39f6d18740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561d70242480 con 0x561d70231b40 2024-09-19T06:22:36.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.186+0000 7f39f6d18740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x561d70151060 con 0x561d702305d0 2024-09-19T06:22:36.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.186+0000 7f39f6d18740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x561d70242600 con 0x561d7023f780 2024-09-19T06:22:36.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.186+0000 7f39f6d18740 10 client.0 _ll_register_callbacks cb 0x561d6fea48c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:36.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.186+0000 7f39edd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d70231b40 0x561d7023c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:36.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.186+0000 7f39edd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d70231b40 0x561d7023c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44486/0 (socket says 172.21.15.2:44486) 2024-09-19T06:22:36.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.186+0000 7f39edd9b640 1 -- 172.21.15.2:0/595131443 learned_addr learned my addr 172.21.15.2:0/595131443 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:36.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.186+0000 7f39ee59c640 1 --2- 172.21.15.2:0/595131443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561d702305d0 0x561d7023f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:36.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.186+0000 7f39eed9d640 1 --2- 172.21.15.2:0/595131443 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561d7023f780 0x561d7023cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:36.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.186+0000 7f39edd9b640 1 -- 172.21.15.2:0/595131443 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561d7023f780 msgr2=0x561d7023cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:36.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.186+0000 7f39edd9b640 1 --2- 172.21.15.2:0/595131443 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561d7023f780 0x561d7023cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:36.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.186+0000 7f39edd9b640 1 -- 172.21.15.2:0/595131443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561d702305d0 msgr2=0x561d7023f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:36.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.186+0000 7f39edd9b640 1 --2- 172.21.15.2:0/595131443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561d702305d0 0x561d7023f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:36.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.186+0000 7f39edd9b640 1 -- 172.21.15.2:0/595131443 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d6ff073c0 con 0x561d70231b40 2024-09-19T06:22:36.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.186+0000 7f39edd9b640 1 --2- 172.21.15.2:0/595131443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d70231b40 0x561d7023c480 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f39e4006010 tx=0x7f39e40b84e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9b7cef0fe0a947a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:36.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.186+0000 7f39d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:22:36.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.187+0000 7f39d5ffb640 1 -- 172.21.15.2:0/595131443 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e4049040 con 0x561d70231b40 2024-09-19T06:22:36.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.187+0000 7f39d5ffb640 1 -- 172.21.15.2:0/595131443 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7f39e40ed930 con 0x561d70231b40 2024-09-19T06:22:36.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.187+0000 7f39f6d18740 1 -- 172.21.15.2:0/595131443 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39e0013470 con 0x561d70231b40 2024-09-19T06:22:36.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.187+0000 7f39d5ffb640 1 -- 172.21.15.2:0/595131443 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f39e40bc240 con 0x561d70231b40 2024-09-19T06:22:36.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.187+0000 7f39f6d18740 10 client.18081 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:36.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.187+0000 7f39f6d18740 1 -- 172.21.15.2:0/595131443 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561d7024df00 con 0x561d70231b40 2024-09-19T06:22:36.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.187+0000 7f39d5ffb640 1 -- 172.21.15.2:0/595131443 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f39e0013470 con 0x561d70231b40 2024-09-19T06:22:36.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.187+0000 7f39d5ffb640 1 -- 172.21.15.2:0/595131443 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f39e404c060 con 0x561d70231b40 2024-09-19T06:22:36.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.187+0000 7f39f6d18740 10 client.18081 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:36.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.187+0000 7f39f6d18740 10 client.18081 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:22:36.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.187+0000 7f39f6d18740 20 client.18081 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:36.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.187+0000 7f39f6d18740 1 --2- 172.21.15.2:0/595131443 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x561d7024f340 0x561d70251730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:36.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.187+0000 7f39f6d18740 4 client.18081 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:22:36.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.187+0000 7f39f6d18740 1 -- 172.21.15.2:0/595131443 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561d701a3860 con 0x561d7024f340 2024-09-19T06:22:36.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.187+0000 7f39ee59c640 1 --2- 172.21.15.2:0/595131443 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x561d7024f340 0x561d70251730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:36.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.188+0000 7f39ee59c640 1 --2- 172.21.15.2:0/595131443 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x561d7024f340 0x561d70251730 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dab594f4a3b9dea7 server_cookie=e11335a96406b6db in_seq=0 out_seq=0 2024-09-19T06:22:36.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.188+0000 7f39d5ffb640 10 client.18081 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:22:36.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.189+0000 7f39d5ffb640 1 -- 172.21.15.2:0/595131443 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561d701a3860 con 0x561d7024f340 2024-09-19T06:22:36.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.189+0000 7f39d5ffb640 10 client.18081 handle_command_reply: tid=0 2024-09-19T06:22:36.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.189+0000 7f39f6d18740 1 client.18081 shutdown 2024-09-19T06:22:36.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.189+0000 7f39f6d18740 1 -- 172.21.15.2:0/595131443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d70231b40 msgr2=0x561d7023c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:36.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.189+0000 7f39f6d18740 1 --2- 172.21.15.2:0/595131443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d70231b40 0x561d7023c480 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f39e4006010 tx=0x7f39e40b84e0 comp rx=0 tx=0).stop 2024-09-19T06:22:36.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.189+0000 7f39f6d18740 1 -- 172.21.15.2:0/595131443 shutdown_connections 2024-09-19T06:22:36.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.189+0000 7f39f6d18740 1 --2- 172.21.15.2:0/595131443 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x561d7024f340 0x561d70251730 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:36.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.189+0000 7f39f6d18740 1 --2- 172.21.15.2:0/595131443 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561d7023f780 0x561d7023cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:36.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.189+0000 7f39f6d18740 1 --2- 172.21.15.2:0/595131443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d70231b40 0x561d7023c480 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:36.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.189+0000 7f39f6d18740 1 --2- 172.21.15.2:0/595131443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561d702305d0 0x561d7023f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:36.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.189+0000 7f39f6d18740 1 -- 172.21.15.2:0/595131443 >> 172.21.15.2:0/595131443 conn(0x561d701f9310 msgr2=0x561d70232960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:36.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.189+0000 7f39d5ffb640 0 client.18081 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:22:36.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.189+0000 7f39f6d18740 1 -- 172.21.15.2:0/595131443 shutdown_connections 2024-09-19T06:22:36.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.189+0000 7f39f6d18740 1 -- 172.21.15.2:0/595131443 wait complete. 2024-09-19T06:22:36.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.189+0000 7f39f6d18740 20 client.18081 trim_cache size 0 max 16384 2024-09-19T06:22:36.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.202+0000 7f39f6d18740 1 Processor -- start 2024-09-19T06:22:36.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.202+0000 7f39f6d18740 1 -- start start 2024-09-19T06:22:36.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.202+0000 7f39f6d18740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561d702305d0 0x561d7022ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:36.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.202+0000 7f39f6d18740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561d70231b40 0x561d70231300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:36.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.202+0000 7f39f6d18740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d7023f780 0x561d7023bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:36.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.202+0000 7f39f6d18740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f39f01adee0 con 0x561d7023f780 2024-09-19T06:22:36.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.202+0000 7f39f6d18740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f39f01ab7b0 con 0x561d70231b40 2024-09-19T06:22:36.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.202+0000 7f39f6d18740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f39f01a9620 con 0x561d702305d0 2024-09-19T06:22:36.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.202+0000 7f39eed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d7023f780 0x561d7023bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:36.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.202+0000 7f39eed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d7023f780 0x561d7023bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44498/0 (socket says 172.21.15.2:44498) 2024-09-19T06:22:36.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.202+0000 7f39eed9d640 1 -- 172.21.15.2:0/2582946343 learned_addr learned my addr 172.21.15.2:0/2582946343 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:36.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.203+0000 7f39edd9b640 1 --2- 172.21.15.2:0/2582946343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561d70231b40 0x561d70231300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:36.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.203+0000 7f39ee59c640 1 --2- 172.21.15.2:0/2582946343 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561d702305d0 0x561d7022ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:36.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.203+0000 7f39eed9d640 1 -- 172.21.15.2:0/2582946343 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561d702305d0 msgr2=0x561d7022ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:36.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.203+0000 7f39eed9d640 1 --2- 172.21.15.2:0/2582946343 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561d702305d0 0x561d7022ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:36.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.203+0000 7f39eed9d640 1 -- 172.21.15.2:0/2582946343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561d70231b40 msgr2=0x561d70231300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:36.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.203+0000 7f39eed9d640 1 --2- 172.21.15.2:0/2582946343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561d70231b40 0x561d70231300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:36.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.203+0000 7f39eed9d640 1 -- 172.21.15.2:0/2582946343 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d70251aa0 con 0x561d7023f780 2024-09-19T06:22:36.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.203+0000 7f39eed9d640 1 --2- 172.21.15.2:0/2582946343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d7023f780 0x561d7023bd40 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f39e8013810 tx=0x7f39e8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f11874aab4c8c239 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:36.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.203+0000 7f39d7fff640 1 -- 172.21.15.2:0/2582946343 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e8013030 con 0x561d7023f780 2024-09-19T06:22:36.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.203+0000 7f39d7fff640 1 -- 172.21.15.2:0/2582946343 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f39e80131d0 con 0x561d7023f780 2024-09-19T06:22:36.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.203+0000 7f39d7fff640 1 -- 172.21.15.2:0/2582946343 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e80053a0 con 0x561d7023f780 2024-09-19T06:22:36.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.204+0000 7f39f6d18740 1 -- 172.21.15.2:0/2582946343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d7023f780 msgr2=0x561d7023bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:36.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.204+0000 7f39f6d18740 1 --2- 172.21.15.2:0/2582946343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d7023f780 0x561d7023bd40 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f39e8013810 tx=0x7f39e8014000 comp rx=0 tx=0).stop 2024-09-19T06:22:36.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.204+0000 7f39f6d18740 1 -- 172.21.15.2:0/2582946343 shutdown_connections 2024-09-19T06:22:36.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.204+0000 7f39f6d18740 1 --2- 172.21.15.2:0/2582946343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d7023f780 0x561d7023bd40 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:36.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.204+0000 7f39f6d18740 1 --2- 172.21.15.2:0/2582946343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561d70231b40 0x561d70231300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:36.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.204+0000 7f39f6d18740 1 --2- 172.21.15.2:0/2582946343 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561d702305d0 0x561d7022ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:36.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.204+0000 7f39f6d18740 1 -- 172.21.15.2:0/2582946343 >> 172.21.15.2:0/2582946343 conn(0x561d701f9310 msgr2=0x561d7022c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:36.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.204+0000 7f39f6d18740 1 -- 172.21.15.2:0/2582946343 shutdown_connections 2024-09-19T06:22:36.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.204+0000 7f39f6d18740 1 -- 172.21.15.2:0/2582946343 wait complete. 2024-09-19T06:22:36.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.204+0000 7f39f6d18740 1 -- start start 2024-09-19T06:22:36.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.204+0000 7f39f6d18740 1 Processor -- start 2024-09-19T06:22:36.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.204+0000 7f39f6d18740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d702305d0 0x561d70247fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:36.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.204+0000 7f39f6d18740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561d70231b40 0x561d702391f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:36.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.204+0000 7f39f6d18740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561d7023f780 0x561d70239750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:36.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.204+0000 7f39f6d18740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f39f01a9c70 con 0x561d702305d0 2024-09-19T06:22:36.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.204+0000 7f39f6d18740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f39f01ab0e0 con 0x561d70231b40 2024-09-19T06:22:36.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.204+0000 7f39f6d18740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f39f01aa340 con 0x561d7023f780 2024-09-19T06:22:36.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.205+0000 7f39f6d18740 10 client.0 _ll_register_callbacks cb 0x7f39e4005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:36.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.205+0000 7f39ee59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d702305d0 0x561d70247fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:36.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.205+0000 7f39ee59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d702305d0 0x561d70247fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44514/0 (socket says 172.21.15.2:44514) 2024-09-19T06:22:36.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.205+0000 7f39ee59c640 1 -- 172.21.15.2:0/2585113249 learned_addr learned my addr 172.21.15.2:0/2585113249 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:36.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.205+0000 7f39edd9b640 1 --2- 172.21.15.2:0/2585113249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561d70231b40 0x561d702391f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:36.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.205+0000 7f39eed9d640 1 --2- 172.21.15.2:0/2585113249 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561d7023f780 0x561d70239750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:36.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.205+0000 7f39ee59c640 1 -- 172.21.15.2:0/2585113249 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561d7023f780 msgr2=0x561d70239750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:36.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.205+0000 7f39ee59c640 1 --2- 172.21.15.2:0/2585113249 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561d7023f780 0x561d70239750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:36.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.205+0000 7f39ee59c640 1 -- 172.21.15.2:0/2585113249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561d70231b40 msgr2=0x561d702391f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:36.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.205+0000 7f39ee59c640 1 --2- 172.21.15.2:0/2585113249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561d70231b40 0x561d702391f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:36.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.205+0000 7f39ee59c640 1 -- 172.21.15.2:0/2585113249 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d70239f80 con 0x561d702305d0 2024-09-19T06:22:36.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.205+0000 7f39ee59c640 1 --2- 172.21.15.2:0/2585113249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d702305d0 0x561d70247fe0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f39e0008010 tx=0x7f39e0013b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7681f410c17701b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:36.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.205+0000 7f39d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:22:36.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.205+0000 7f39d5ffb640 1 -- 172.21.15.2:0/2585113249 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e0017040 con 0x561d702305d0 2024-09-19T06:22:36.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.205+0000 7f39d5ffb640 1 -- 172.21.15.2:0/2585113249 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7f39e00059c0 con 0x561d702305d0 2024-09-19T06:22:36.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.205+0000 7f39f6d18740 1 -- 172.21.15.2:0/2585113249 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39e80131d0 con 0x561d702305d0 2024-09-19T06:22:36.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.205+0000 7f39d5ffb640 1 -- 172.21.15.2:0/2585113249 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f39e0005bc0 con 0x561d702305d0 2024-09-19T06:22:36.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.205+0000 7f39f6d18740 10 client.18087 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:36.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.205+0000 7f39f6d18740 1 -- 172.21.15.2:0/2585113249 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561d702b9fc0 con 0x561d702305d0 2024-09-19T06:22:36.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.206+0000 7f39d5ffb640 1 -- 172.21.15.2:0/2585113249 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f39e80131d0 con 0x561d702305d0 2024-09-19T06:22:36.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.206+0000 7f39d5ffb640 1 -- 172.21.15.2:0/2585113249 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f39e0026660 con 0x561d702305d0 2024-09-19T06:22:36.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.206+0000 7f39f6d18740 10 client.18087 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:36.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.206+0000 7f39f6d18740 10 client.18087 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:22:36.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.206+0000 7f39f6d18740 20 client.18087 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:36.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.206+0000 7f39f6d18740 1 --2- 172.21.15.2:0/2585113249 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x561d702ba2a0 0x561d702bc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:36.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.206+0000 7f39f6d18740 4 client.18087 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:22:36.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.206+0000 7f39f6d18740 1 -- 172.21.15.2:0/2585113249 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561d7019dd70 con 0x561d702ba2a0 2024-09-19T06:22:36.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.206+0000 7f39edd9b640 1 --2- 172.21.15.2:0/2585113249 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x561d702ba2a0 0x561d702bc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:36.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.207+0000 7f39edd9b640 1 --2- 172.21.15.2:0/2585113249 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x561d702ba2a0 0x561d702bc690 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=658176c397340f60 server_cookie=ab28a08fc3ea94bc in_seq=0 out_seq=0 2024-09-19T06:22:36.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.207+0000 7f39d5ffb640 10 client.18087 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:22:36.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.207+0000 7f39d5ffb640 1 -- 172.21.15.2:0/2585113249 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561d7019dd70 con 0x561d702ba2a0 2024-09-19T06:22:36.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.207+0000 7f39d5ffb640 10 client.18087 handle_command_reply: tid=0 2024-09-19T06:22:36.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.207+0000 7f39f6d18740 1 client.18087 shutdown 2024-09-19T06:22:36.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.207+0000 7f39f6d18740 1 -- 172.21.15.2:0/2585113249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d702305d0 msgr2=0x561d70247fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:36.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.207+0000 7f39f6d18740 1 --2- 172.21.15.2:0/2585113249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d702305d0 0x561d70247fe0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f39e0008010 tx=0x7f39e0013b80 comp rx=0 tx=0).stop 2024-09-19T06:22:36.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.207+0000 7f39f6d18740 1 -- 172.21.15.2:0/2585113249 shutdown_connections 2024-09-19T06:22:36.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.207+0000 7f39f6d18740 1 --2- 172.21.15.2:0/2585113249 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x561d702ba2a0 0x561d702bc690 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:36.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.207+0000 7f39f6d18740 1 --2- 172.21.15.2:0/2585113249 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561d7023f780 0x561d70239750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:36.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.207+0000 7f39d5ffb640 0 client.18087 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:22:36.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.207+0000 7f39f6d18740 1 --2- 172.21.15.2:0/2585113249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561d70231b40 0x561d702391f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:36.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.207+0000 7f39f6d18740 1 --2- 172.21.15.2:0/2585113249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d702305d0 0x561d70247fe0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:36.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.207+0000 7f39f6d18740 1 -- 172.21.15.2:0/2585113249 >> 172.21.15.2:0/2585113249 conn(0x561d701f9310 msgr2=0x561d70232930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:36.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.207+0000 7f39f6d18740 1 -- 172.21.15.2:0/2585113249 shutdown_connections 2024-09-19T06:22:36.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.207+0000 7f39f6d18740 1 -- 172.21.15.2:0/2585113249 wait complete. 2024-09-19T06:22:36.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.207+0000 7f39f6d18740 20 client.18087 trim_cache size 0 max 16384 2024-09-19T06:22:36.215 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:22:36.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.208+0000 7f39f493f640 1 -- 172.21.15.2:0/502743496 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f39d80a33b0 msgr2=0x7f39d80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:36.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.208+0000 7f39f493f640 1 --2- 172.21.15.2:0/502743496 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f39d80a33b0 0x7f39d80a5870 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f39e8005c40 tx=0x7f39e8004a40 comp rx=0 tx=0).stop 2024-09-19T06:22:36.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.208+0000 7f39f493f640 1 -- 172.21.15.2:0/502743496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39f0102790 msgr2=0x7f39f0198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:36.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.208+0000 7f39f493f640 1 --2- 172.21.15.2:0/502743496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39f0102790 0x7f39f0198960 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f39e4005940 tx=0x7f39e4004270 comp rx=0 tx=0).stop 2024-09-19T06:22:36.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.208+0000 7f39f493f640 1 -- 172.21.15.2:0/502743496 shutdown_connections 2024-09-19T06:22:36.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.208+0000 7f39f493f640 1 --2- 172.21.15.2:0/502743496 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f39d80a33b0 0x7f39d80a5870 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:36.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.208+0000 7f39f493f640 1 --2- 172.21.15.2:0/502743496 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39f0106f10 0x7f39f019ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:36.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.208+0000 7f39f493f640 1 --2- 172.21.15.2:0/502743496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39f0102790 0x7f39f0198960 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:36.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.208+0000 7f39f493f640 1 --2- 172.21.15.2:0/502743496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39f0101de0 0x7f39f0198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:36.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.208+0000 7f39f493f640 1 -- 172.21.15.2:0/502743496 >> 172.21.15.2:0/502743496 conn(0x7f39f00fd8c0 msgr2=0x7f39f00fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:36.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.208+0000 7f39f493f640 1 -- 172.21.15.2:0/502743496 shutdown_connections 2024-09-19T06:22:36.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:36.208+0000 7f39f493f640 1 -- 172.21.15.2:0/502743496 wait complete. 2024-09-19T06:22:36.892 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:22:37.154 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:22:37.570 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:37 smithi002 ceph-mon[30982]: pgmap v241: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:22:37.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.587+0000 7f9834b56640 1 -- 172.21.15.2:0/1024056486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9830106f10 msgr2=0x7f983010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:37.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.587+0000 7f9834b56640 1 --2- 172.21.15.2:0/1024056486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9830106f10 0x7f983010ea90 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f9828009ca0 tx=0x7f982802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.587+0000 7f9834b56640 1 -- 172.21.15.2:0/1024056486 shutdown_connections 2024-09-19T06:22:37.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.587+0000 7f9834b56640 1 --2- 172.21.15.2:0/1024056486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9830106f10 0x7f983010ea90 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.587+0000 7f9834b56640 1 --2- 172.21.15.2:0/1024056486 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9830102790 0x7f98301067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.587+0000 7f9834b56640 1 --2- 172.21.15.2:0/1024056486 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9830101de0 0x7f98301021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.587+0000 7f9834b56640 1 -- 172.21.15.2:0/1024056486 >> 172.21.15.2:0/1024056486 conn(0x7f98300fd8c0 msgr2=0x7f98300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:37.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.587+0000 7f9834b56640 1 -- 172.21.15.2:0/1024056486 shutdown_connections 2024-09-19T06:22:37.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.587+0000 7f9834b56640 1 -- 172.21.15.2:0/1024056486 wait complete. 2024-09-19T06:22:37.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.588+0000 7f9834b56640 1 Processor -- start 2024-09-19T06:22:37.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.588+0000 7f9834b56640 1 -- start start 2024-09-19T06:22:37.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.589+0000 7f9834b56640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9830101de0 0x7f9830198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:37.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.589+0000 7f9834b56640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9830102790 0x7f98301989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:37.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.589+0000 7f9834b56640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9830106f10 0x7f983019cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:37.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.589+0000 7f9834b56640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9830111ec0 con 0x7f9830106f10 2024-09-19T06:22:37.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.589+0000 7f9834b56640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9830111d40 con 0x7f9830102790 2024-09-19T06:22:37.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.589+0000 7f9834b56640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9830112040 con 0x7f9830101de0 2024-09-19T06:22:37.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.589+0000 7f982ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9830106f10 0x7f983019cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:37.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.589+0000 7f9825d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9830102790 0x7f98301989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:37.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.589+0000 7f9825d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9830102790 0x7f98301989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:33512/0 (socket says 172.21.15.2:33512) 2024-09-19T06:22:37.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.589+0000 7f982ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9830106f10 0x7f983019cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44536/0 (socket says 172.21.15.2:44536) 2024-09-19T06:22:37.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.589+0000 7f982e59c640 1 --2- 172.21.15.2:0/3304403730 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9830101de0 0x7f9830198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:37.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.589+0000 7f9825d9b640 1 -- 172.21.15.2:0/3304403730 learned_addr learned my addr 172.21.15.2:0/3304403730 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:37.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.589+0000 7f982ed9d640 1 -- 172.21.15.2:0/3304403730 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9830101de0 msgr2=0x7f9830198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:37.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.589+0000 7f982ed9d640 1 --2- 172.21.15.2:0/3304403730 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9830101de0 0x7f9830198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.589+0000 7f982ed9d640 1 -- 172.21.15.2:0/3304403730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9830102790 msgr2=0x7f98301989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:37.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.589+0000 7f982ed9d640 1 --2- 172.21.15.2:0/3304403730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9830102790 0x7f98301989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.589+0000 7f982ed9d640 1 -- 172.21.15.2:0/3304403730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f983019d430 con 0x7f9830106f10 2024-09-19T06:22:37.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.590+0000 7f982ed9d640 1 --2- 172.21.15.2:0/3304403730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9830106f10 0x7f983019cd50 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f9828009ca0 tx=0x7f9828003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:37.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.590+0000 7f9827fff640 1 -- 172.21.15.2:0/3304403730 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9828032e90 con 0x7f9830106f10 2024-09-19T06:22:37.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.590+0000 7f9827fff640 1 -- 172.21.15.2:0/3304403730 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f98280044f0 con 0x7f9830106f10 2024-09-19T06:22:37.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.590+0000 7f9834b56640 1 -- 172.21.15.2:0/3304403730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f983019d6c0 con 0x7f9830106f10 2024-09-19T06:22:37.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.590+0000 7f9827fff640 1 -- 172.21.15.2:0/3304403730 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9828030d40 con 0x7f9830106f10 2024-09-19T06:22:37.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.590+0000 7f9834b56640 1 -- 172.21.15.2:0/3304403730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98301a5000 con 0x7f9830106f10 2024-09-19T06:22:37.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.592+0000 7f9827fff640 1 -- 172.21.15.2:0/3304403730 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f9828004040 con 0x7f9830106f10 2024-09-19T06:22:37.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.592+0000 7f9836f2f740 1 Processor -- start 2024-09-19T06:22:37.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.593+0000 7f9836f2f740 1 -- start start 2024-09-19T06:22:37.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.593+0000 7f9836f2f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651d2752b40 0x5651d2751090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:37.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.593+0000 7f9836f2f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5651d27515d0 0x5651d2751a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:37.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.593+0000 7f9836f2f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651d275c370 0x5651d275e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:37.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.593+0000 7f9836f2f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5651d26b72f0 con 0x5651d2752b40 2024-09-19T06:22:37.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.593+0000 7f9836f2f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5651d265ecf0 con 0x5651d275c370 2024-09-19T06:22:37.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.593+0000 7f9836f2f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5651d26b32b0 con 0x5651d27515d0 2024-09-19T06:22:37.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.593+0000 7f9825d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651d2752b40 0x5651d2751090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:37.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.593+0000 7f9825d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651d2752b40 0x5651d2751090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44544/0 (socket says 172.21.15.2:44544) 2024-09-19T06:22:37.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.593+0000 7f9825d9b640 1 -- 172.21.15.2:0/4269151815 learned_addr learned my addr 172.21.15.2:0/4269151815 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:37.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.593+0000 7f9827fff640 1 --2- 172.21.15.2:0/3304403730 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f981c0a3430 0x7f981c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:37.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.593+0000 7f982e59c640 1 --2- 172.21.15.2:0/4269151815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5651d27515d0 0x5651d2751a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:37.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.593+0000 7f9825d9b640 1 --2- 172.21.15.2:0/4269151815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651d275c370 0x5651d275e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:37.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.593+0000 7f982ed9d640 1 --2- 172.21.15.2:0/3304403730 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f981c0a3430 0x7f981c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:37.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.593+0000 7f9825d9b640 1 -- 172.21.15.2:0/4269151815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5651d27515d0 msgr2=0x5651d2751a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:37.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.594+0000 7f9825d9b640 1 --2- 172.21.15.2:0/4269151815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5651d27515d0 0x5651d2751a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.594+0000 7f9825d9b640 1 -- 172.21.15.2:0/4269151815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651d275c370 msgr2=0x5651d275e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:37.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.594+0000 7f9825d9b640 1 --2- 172.21.15.2:0/4269151815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651d275c370 0x5651d275e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.594+0000 7f9825d9b640 1 -- 172.21.15.2:0/4269151815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651d26433a0 con 0x5651d2752b40 2024-09-19T06:22:37.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.594+0000 7f982e59c640 1 --2- 172.21.15.2:0/4269151815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5651d27515d0 0x5651d2751a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:37.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.594+0000 7f9827fff640 1 -- 172.21.15.2:0/3304403730 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7f98280f11e0 con 0x7f9830106f10 2024-09-19T06:22:37.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.594+0000 7f9825d9b640 1 --2- 172.21.15.2:0/4269151815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651d2752b40 0x5651d2751090 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f9818006aa0 tx=0x7f9818009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b291b3cc2d42f46 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:37.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.594+0000 7f982ed9d640 1 --2- 172.21.15.2:0/3304403730 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f981c0a3430 0x7f981c0a58f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f98280b99e0 tx=0x7f98280b9870 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:37.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.594+0000 7f9824d99640 1 -- 172.21.15.2:0/4269151815 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98180136f0 con 0x5651d2752b40 2024-09-19T06:22:37.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.594+0000 7f9824d99640 1 -- 172.21.15.2:0/4269151815 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f981801c070 con 0x5651d2752b40 2024-09-19T06:22:37.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.594+0000 7f9824d99640 1 -- 172.21.15.2:0/4269151815 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98180179a0 con 0x5651d2752b40 2024-09-19T06:22:37.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.595+0000 7f9836f2f740 1 -- 172.21.15.2:0/4269151815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651d2752b40 msgr2=0x5651d2751090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:37.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.595+0000 7f9836f2f740 1 --2- 172.21.15.2:0/4269151815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651d2752b40 0x5651d2751090 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f9818006aa0 tx=0x7f9818009680 comp rx=0 tx=0).stop 2024-09-19T06:22:37.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.595+0000 7f9836f2f740 1 -- 172.21.15.2:0/4269151815 shutdown_connections 2024-09-19T06:22:37.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.595+0000 7f9836f2f740 1 --2- 172.21.15.2:0/4269151815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651d275c370 0x5651d275e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.595+0000 7f9836f2f740 1 --2- 172.21.15.2:0/4269151815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5651d27515d0 0x5651d2751a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.595+0000 7f9836f2f740 1 --2- 172.21.15.2:0/4269151815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651d2752b40 0x5651d2751090 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.595+0000 7f9836f2f740 1 -- 172.21.15.2:0/4269151815 >> 172.21.15.2:0/4269151815 conn(0x5651d271a310 msgr2=0x5651d274dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:37.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.595+0000 7f9836f2f740 1 -- 172.21.15.2:0/4269151815 shutdown_connections 2024-09-19T06:22:37.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.595+0000 7f9836f2f740 1 -- 172.21.15.2:0/4269151815 wait complete. 2024-09-19T06:22:37.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.595+0000 7f9836f2f740 1 -- start start 2024-09-19T06:22:37.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.595+0000 7f9836f2f740 1 Processor -- start 2024-09-19T06:22:37.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.596+0000 7f9836f2f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5651d27515d0 0x5651d275bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:37.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.596+0000 7f9836f2f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651d2752b40 0x5651d2758f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:37.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.596+0000 7f9836f2f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651d275c370 0x5651d27594d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:37.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.596+0000 7f9836f2f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5651d275f010 con 0x5651d275c370 2024-09-19T06:22:37.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.596+0000 7f9836f2f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5651d2672060 con 0x5651d2752b40 2024-09-19T06:22:37.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.596+0000 7f9836f2f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5651d275f190 con 0x5651d27515d0 2024-09-19T06:22:37.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.596+0000 7f9836f2f740 10 client.0 _ll_register_callbacks cb 0x5651d23c58c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:37.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.596+0000 7f9825d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651d275c370 0x5651d27594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:37.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.596+0000 7f9825d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651d275c370 0x5651d27594d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44548/0 (socket says 172.21.15.2:44548) 2024-09-19T06:22:37.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.596+0000 7f9825d9b640 1 -- 172.21.15.2:0/1243800132 learned_addr learned my addr 172.21.15.2:0/1243800132 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:37.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.596+0000 7f9825d9b640 1 --2- 172.21.15.2:0/1243800132 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5651d27515d0 0x5651d275bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:37.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.596+0000 7f982e59c640 1 --2- 172.21.15.2:0/1243800132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651d2752b40 0x5651d2758f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:37.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.596+0000 7f9825d9b640 1 -- 172.21.15.2:0/1243800132 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5651d27515d0 msgr2=0x5651d275bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:37.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.596+0000 7f9825d9b640 1 --2- 172.21.15.2:0/1243800132 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5651d27515d0 0x5651d275bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.596+0000 7f9825d9b640 1 -- 172.21.15.2:0/1243800132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651d2752b40 msgr2=0x5651d2758f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:37.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.596+0000 7f9825d9b640 1 --2- 172.21.15.2:0/1243800132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651d2752b40 0x5651d2758f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.596+0000 7f9825d9b640 1 -- 172.21.15.2:0/1243800132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651d24283c0 con 0x5651d275c370 2024-09-19T06:22:37.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.596+0000 7f9825d9b640 1 --2- 172.21.15.2:0/1243800132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651d275c370 0x5651d27594d0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f9818009d60 tx=0x7f98180091c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=340ae37a1d8de7f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:37.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.596+0000 7f9815ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:22:37.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.596+0000 7f9815ffb640 1 -- 172.21.15.2:0/1243800132 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9818018bc0 con 0x5651d275c370 2024-09-19T06:22:37.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.596+0000 7f9815ffb640 1 -- 172.21.15.2:0/1243800132 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7f9818018d60 con 0x5651d275c370 2024-09-19T06:22:37.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.596+0000 7f9836f2f740 1 -- 172.21.15.2:0/1243800132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f981801c070 con 0x5651d275c370 2024-09-19T06:22:37.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.597+0000 7f9815ffb640 1 -- 172.21.15.2:0/1243800132 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9818036050 con 0x5651d275c370 2024-09-19T06:22:37.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.597+0000 7f9836f2f740 10 client.18099 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:37.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.597+0000 7f9836f2f740 1 -- 172.21.15.2:0/1243800132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5651d276aa20 con 0x5651d275c370 2024-09-19T06:22:37.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.597+0000 7f9815ffb640 1 -- 172.21.15.2:0/1243800132 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f981801c070 con 0x5651d275c370 2024-09-19T06:22:37.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.597+0000 7f9815ffb640 1 -- 172.21.15.2:0/1243800132 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f9818021590 con 0x5651d275c370 2024-09-19T06:22:37.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.597+0000 7f9836f2f740 10 client.18099 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:37.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.597+0000 7f9836f2f740 10 client.18099 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:22:37.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.597+0000 7f9836f2f740 20 client.18099 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:37.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.597+0000 7f9836f2f740 1 --2- 172.21.15.2:0/1243800132 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5651d276bd70 0x5651d276e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:37.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.597+0000 7f9836f2f740 4 client.18099 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:22:37.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.597+0000 7f9836f2f740 1 -- 172.21.15.2:0/1243800132 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5651d26c4860 con 0x5651d276bd70 2024-09-19T06:22:37.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.597+0000 7f982e59c640 1 --2- 172.21.15.2:0/1243800132 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5651d276bd70 0x5651d276e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:37.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.598+0000 7f982e59c640 1 --2- 172.21.15.2:0/1243800132 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5651d276bd70 0x5651d276e160 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9fb24410625e8d9f server_cookie=b8abf0155d913155 in_seq=0 out_seq=0 2024-09-19T06:22:37.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.598+0000 7f9815ffb640 10 client.18099 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:22:37.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.599+0000 7f9815ffb640 1 -- 172.21.15.2:0/1243800132 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5651d26c4860 con 0x5651d276bd70 2024-09-19T06:22:37.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.599+0000 7f9815ffb640 10 client.18099 handle_command_reply: tid=0 2024-09-19T06:22:37.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.599+0000 7f9836f2f740 1 client.18099 shutdown 2024-09-19T06:22:37.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.599+0000 7f9836f2f740 1 -- 172.21.15.2:0/1243800132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651d275c370 msgr2=0x5651d27594d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:37.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.599+0000 7f9836f2f740 1 --2- 172.21.15.2:0/1243800132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651d275c370 0x5651d27594d0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f9818009d60 tx=0x7f98180091c0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.599+0000 7f9836f2f740 1 -- 172.21.15.2:0/1243800132 shutdown_connections 2024-09-19T06:22:37.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.599+0000 7f9836f2f740 1 --2- 172.21.15.2:0/1243800132 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5651d276bd70 0x5651d276e160 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.599+0000 7f9836f2f740 1 --2- 172.21.15.2:0/1243800132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651d275c370 0x5651d27594d0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.599+0000 7f9836f2f740 1 --2- 172.21.15.2:0/1243800132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651d2752b40 0x5651d2758f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.599+0000 7f9836f2f740 1 --2- 172.21.15.2:0/1243800132 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5651d27515d0 0x5651d275bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.599+0000 7f9836f2f740 1 -- 172.21.15.2:0/1243800132 >> 172.21.15.2:0/1243800132 conn(0x5651d271a310 msgr2=0x5651d2753960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:37.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.599+0000 7f9815ffb640 0 client.18099 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:22:37.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.599+0000 7f9836f2f740 1 -- 172.21.15.2:0/1243800132 shutdown_connections 2024-09-19T06:22:37.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.599+0000 7f9836f2f740 1 -- 172.21.15.2:0/1243800132 wait complete. 2024-09-19T06:22:37.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.599+0000 7f9836f2f740 20 client.18099 trim_cache size 0 max 16384 2024-09-19T06:22:37.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.612+0000 7f9836f2f740 1 Processor -- start 2024-09-19T06:22:37.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.612+0000 7f9836f2f740 1 -- start start 2024-09-19T06:22:37.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.612+0000 7f9836f2f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651d27515d0 0x5651d27682b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:37.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.612+0000 7f9836f2f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651d2752b40 0x5651d2764800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:37.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.612+0000 7f9836f2f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5651d275c370 0x5651d2764d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:37.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.612+0000 7f9836f2f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f98301afff0 con 0x5651d2752b40 2024-09-19T06:22:37.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.612+0000 7f9836f2f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f98301ad8c0 con 0x5651d27515d0 2024-09-19T06:22:37.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.612+0000 7f9836f2f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f98301ab730 con 0x5651d275c370 2024-09-19T06:22:37.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.612+0000 7f982e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651d2752b40 0x5651d2764800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:37.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.612+0000 7f982e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651d2752b40 0x5651d2764800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44562/0 (socket says 172.21.15.2:44562) 2024-09-19T06:22:37.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.612+0000 7f982e59c640 1 -- 172.21.15.2:0/2093526433 learned_addr learned my addr 172.21.15.2:0/2093526433 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:37.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.613+0000 7f9825d9b640 1 --2- 172.21.15.2:0/2093526433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651d27515d0 0x5651d27682b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:37.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.613+0000 7f9825d9b640 1 --2- 172.21.15.2:0/2093526433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5651d275c370 0x5651d2764d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:37.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.613+0000 7f982e59c640 1 -- 172.21.15.2:0/2093526433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5651d275c370 msgr2=0x5651d2764d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:37.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.613+0000 7f982e59c640 1 --2- 172.21.15.2:0/2093526433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5651d275c370 0x5651d2764d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.613+0000 7f982e59c640 1 -- 172.21.15.2:0/2093526433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651d27515d0 msgr2=0x5651d27682b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:37.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.613+0000 7f982e59c640 1 --2- 172.21.15.2:0/2093526433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651d27515d0 0x5651d27682b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.613+0000 7f982e59c640 1 -- 172.21.15.2:0/2093526433 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651d27574c0 con 0x5651d2752b40 2024-09-19T06:22:37.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.613+0000 7f982e59c640 1 --2- 172.21.15.2:0/2093526433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651d2752b40 0x5651d2764800 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x5651d2758800 tx=0x7f9820009110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc32713eb68d99a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:37.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.613+0000 7f9817fff640 1 -- 172.21.15.2:0/2093526433 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9820024070 con 0x5651d2752b40 2024-09-19T06:22:37.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.613+0000 7f9817fff640 1 -- 172.21.15.2:0/2093526433 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f982001e450 con 0x5651d2752b40 2024-09-19T06:22:37.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.613+0000 7f9817fff640 1 -- 172.21.15.2:0/2093526433 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9820014670 con 0x5651d2752b40 2024-09-19T06:22:37.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.614+0000 7f9836f2f740 1 -- 172.21.15.2:0/2093526433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651d2752b40 msgr2=0x5651d2764800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:37.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.614+0000 7f9836f2f740 1 --2- 172.21.15.2:0/2093526433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651d2752b40 0x5651d2764800 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x5651d2758800 tx=0x7f9820009110 comp rx=0 tx=0).stop 2024-09-19T06:22:37.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.614+0000 7f9836f2f740 1 -- 172.21.15.2:0/2093526433 shutdown_connections 2024-09-19T06:22:37.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.614+0000 7f9836f2f740 1 --2- 172.21.15.2:0/2093526433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5651d275c370 0x5651d2764d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.614+0000 7f9836f2f740 1 --2- 172.21.15.2:0/2093526433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651d2752b40 0x5651d2764800 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.614+0000 7f9836f2f740 1 --2- 172.21.15.2:0/2093526433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651d27515d0 0x5651d27682b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.614+0000 7f9836f2f740 1 -- 172.21.15.2:0/2093526433 >> 172.21.15.2:0/2093526433 conn(0x5651d271a310 msgr2=0x5651d2758060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:37.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.614+0000 7f9836f2f740 1 -- 172.21.15.2:0/2093526433 shutdown_connections 2024-09-19T06:22:37.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.614+0000 7f9836f2f740 1 -- 172.21.15.2:0/2093526433 wait complete. 2024-09-19T06:22:37.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.614+0000 7f9836f2f740 1 -- start start 2024-09-19T06:22:37.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.614+0000 7f9836f2f740 1 Processor -- start 2024-09-19T06:22:37.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.614+0000 7f9836f2f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651d27515d0 0x5651d27734b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:37.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.614+0000 7f9836f2f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5651d2752b40 0x5651d27739f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:37.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.614+0000 7f9836f2f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651d275c370 0x5651d27d1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:37.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.614+0000 7f9836f2f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f98301abd80 con 0x5651d27515d0 2024-09-19T06:22:37.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.614+0000 7f9836f2f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f98301ad1f0 con 0x5651d275c370 2024-09-19T06:22:37.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.614+0000 7f9836f2f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f98301ac450 con 0x5651d2752b40 2024-09-19T06:22:37.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.614+0000 7f9836f2f740 10 client.0 _ll_register_callbacks cb 0x7f98200093c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:37.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.614+0000 7f9825d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651d27515d0 0x5651d27734b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:37.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.615+0000 7f9825d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651d27515d0 0x5651d27734b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44574/0 (socket says 172.21.15.2:44574) 2024-09-19T06:22:37.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.615+0000 7f9825d9b640 1 -- 172.21.15.2:0/901026153 learned_addr learned my addr 172.21.15.2:0/901026153 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:37.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.615+0000 7f9825d9b640 1 --2- 172.21.15.2:0/901026153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651d275c370 0x5651d27d1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:37.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.615+0000 7f982e59c640 1 --2- 172.21.15.2:0/901026153 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5651d2752b40 0x5651d27739f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:37.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.615+0000 7f9825d9b640 1 -- 172.21.15.2:0/901026153 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5651d2752b40 msgr2=0x5651d27739f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:37.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.615+0000 7f9825d9b640 1 --2- 172.21.15.2:0/901026153 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5651d2752b40 0x5651d27739f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.615+0000 7f9825d9b640 1 -- 172.21.15.2:0/901026153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651d275c370 msgr2=0x5651d27d1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:37.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.615+0000 7f9825d9b640 1 --2- 172.21.15.2:0/901026153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651d275c370 0x5651d27d1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.615+0000 7f9825d9b640 1 -- 172.21.15.2:0/901026153 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651d27d22a0 con 0x5651d27515d0 2024-09-19T06:22:37.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.615+0000 7f9825d9b640 1 --2- 172.21.15.2:0/901026153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651d27515d0 0x5651d27734b0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f9818018980 tx=0x7f9818024040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27fa151087158a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:37.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.615+0000 7f9815ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:22:37.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.615+0000 7f9815ffb640 1 -- 172.21.15.2:0/901026153 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9818018bc0 con 0x5651d27515d0 2024-09-19T06:22:37.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.615+0000 7f9815ffb640 1 -- 172.21.15.2:0/901026153 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7f9818018d60 con 0x5651d27515d0 2024-09-19T06:22:37.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.615+0000 7f9836f2f740 1 -- 172.21.15.2:0/901026153 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f982001e450 con 0x5651d27515d0 2024-09-19T06:22:37.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.615+0000 7f9815ffb640 1 -- 172.21.15.2:0/901026153 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9818021b30 con 0x5651d27515d0 2024-09-19T06:22:37.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.615+0000 7f9836f2f740 10 client.18105 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:37.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.615+0000 7f9836f2f740 1 -- 172.21.15.2:0/901026153 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5651d27da830 con 0x5651d27515d0 2024-09-19T06:22:37.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.616+0000 7f9815ffb640 1 -- 172.21.15.2:0/901026153 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f982001e450 con 0x5651d27515d0 2024-09-19T06:22:37.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.616+0000 7f9815ffb640 1 -- 172.21.15.2:0/901026153 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f98180181c0 con 0x5651d27515d0 2024-09-19T06:22:37.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.616+0000 7f9836f2f740 10 client.18105 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:37.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.616+0000 7f9836f2f740 10 client.18105 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:22:37.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.616+0000 7f9836f2f740 20 client.18105 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:37.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.616+0000 7f9836f2f740 1 --2- 172.21.15.2:0/901026153 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5651d27daf20 0x5651d27dd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:37.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.616+0000 7f9836f2f740 4 client.18105 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:22:37.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.616+0000 7f9836f2f740 1 -- 172.21.15.2:0/901026153 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5651d26bed70 con 0x5651d27daf20 2024-09-19T06:22:37.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.616+0000 7f982e59c640 1 --2- 172.21.15.2:0/901026153 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5651d27daf20 0x5651d27dd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:37.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.616+0000 7f982e59c640 1 --2- 172.21.15.2:0/901026153 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5651d27daf20 0x5651d27dd340 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=263e61f97a2ba926 server_cookie=2704e92acabf200 in_seq=0 out_seq=0 2024-09-19T06:22:37.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.616+0000 7f9815ffb640 10 client.18105 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:22:37.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.617+0000 7f9815ffb640 1 -- 172.21.15.2:0/901026153 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5651d26bed70 con 0x5651d27daf20 2024-09-19T06:22:37.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.617+0000 7f9815ffb640 10 client.18105 handle_command_reply: tid=0 2024-09-19T06:22:37.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.617+0000 7f9836f2f740 1 client.18105 shutdown 2024-09-19T06:22:37.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.617+0000 7f9836f2f740 1 -- 172.21.15.2:0/901026153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651d27515d0 msgr2=0x5651d27734b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:37.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.617+0000 7f9836f2f740 1 --2- 172.21.15.2:0/901026153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651d27515d0 0x5651d27734b0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f9818018980 tx=0x7f9818024040 comp rx=0 tx=0).stop 2024-09-19T06:22:37.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.617+0000 7f9836f2f740 1 -- 172.21.15.2:0/901026153 shutdown_connections 2024-09-19T06:22:37.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.617+0000 7f9836f2f740 1 --2- 172.21.15.2:0/901026153 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5651d27daf20 0x5651d27dd340 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.617+0000 7f9836f2f740 1 --2- 172.21.15.2:0/901026153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651d275c370 0x5651d27d1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.617+0000 7f9836f2f740 1 --2- 172.21.15.2:0/901026153 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5651d2752b40 0x5651d27739f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.617+0000 7f9836f2f740 1 --2- 172.21.15.2:0/901026153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651d27515d0 0x5651d27734b0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.617+0000 7f9836f2f740 1 -- 172.21.15.2:0/901026153 >> 172.21.15.2:0/901026153 conn(0x5651d271a310 msgr2=0x5651d275a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:37.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.617+0000 7f9815ffb640 0 client.18105 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:22:37.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.617+0000 7f9836f2f740 1 -- 172.21.15.2:0/901026153 shutdown_connections 2024-09-19T06:22:37.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.617+0000 7f9836f2f740 1 -- 172.21.15.2:0/901026153 wait complete. 2024-09-19T06:22:37.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.617+0000 7f9836f2f740 20 client.18105 trim_cache size 0 max 16384 2024-09-19T06:22:37.626 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:22:37.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.617+0000 7f9834b56640 1 -- 172.21.15.2:0/3304403730 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f981c0a3430 msgr2=0x7f981c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:37.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.617+0000 7f9834b56640 1 --2- 172.21.15.2:0/3304403730 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f981c0a3430 0x7f981c0a58f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f98280b99e0 tx=0x7f98280b9870 comp rx=0 tx=0).stop 2024-09-19T06:22:37.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.617+0000 7f9834b56640 1 -- 172.21.15.2:0/3304403730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9830106f10 msgr2=0x7f983019cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:37.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.617+0000 7f9834b56640 1 --2- 172.21.15.2:0/3304403730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9830106f10 0x7f983019cd50 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f9828009ca0 tx=0x7f9828003ba0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.618+0000 7f9834b56640 1 -- 172.21.15.2:0/3304403730 shutdown_connections 2024-09-19T06:22:37.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.618+0000 7f9834b56640 1 --2- 172.21.15.2:0/3304403730 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f981c0a3430 0x7f981c0a58f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.618+0000 7f9834b56640 1 --2- 172.21.15.2:0/3304403730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9830106f10 0x7f983019cd50 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.618+0000 7f9834b56640 1 --2- 172.21.15.2:0/3304403730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9830102790 0x7f98301989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.618+0000 7f9834b56640 1 --2- 172.21.15.2:0/3304403730 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9830101de0 0x7f9830198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.618+0000 7f9834b56640 1 -- 172.21.15.2:0/3304403730 >> 172.21.15.2:0/3304403730 conn(0x7f98300fd8c0 msgr2=0x7f98300fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:37.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.618+0000 7f9834b56640 1 -- 172.21.15.2:0/3304403730 shutdown_connections 2024-09-19T06:22:37.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:37.618+0000 7f9834b56640 1 -- 172.21.15.2:0/3304403730 wait complete. 2024-09-19T06:22:37.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:37 smithi090 ceph-mon[34497]: pgmap v241: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:22:37.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:37 smithi089 ceph-mon[34160]: pgmap v241: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:22:38.349 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:22:38.607 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:22:39.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.044+0000 7fa2da686640 1 -- 172.21.15.2:0/3241911736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2d4106a80 msgr2=0x7fa2d4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:39.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.044+0000 7fa2da686640 1 --2- 172.21.15.2:0/3241911736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2d4106a80 0x7fa2d4106e60 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4009930 tx=0x7fa2c402a420 comp rx=0 tx=0).stop 2024-09-19T06:22:39.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.044+0000 7fa2da686640 1 -- 172.21.15.2:0/3241911736 shutdown_connections 2024-09-19T06:22:39.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.044+0000 7fa2da686640 1 --2- 172.21.15.2:0/3241911736 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2d4101420 0x7fa2d410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.044+0000 7fa2da686640 1 --2- 172.21.15.2:0/3241911736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2d4100a80 0x7fa2d4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.044+0000 7fa2da686640 1 --2- 172.21.15.2:0/3241911736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2d4106a80 0x7fa2d4106e60 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.044+0000 7fa2da686640 1 -- 172.21.15.2:0/3241911736 >> 172.21.15.2:0/3241911736 conn(0x7fa2d40fc7a0 msgr2=0x7fa2d40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:39.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.044+0000 7fa2da686640 1 -- 172.21.15.2:0/3241911736 shutdown_connections 2024-09-19T06:22:39.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.044+0000 7fa2da686640 1 -- 172.21.15.2:0/3241911736 wait complete. 2024-09-19T06:22:39.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.044+0000 7fa2da686640 1 Processor -- start 2024-09-19T06:22:39.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.045+0000 7fa2da686640 1 -- start start 2024-09-19T06:22:39.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.045+0000 7fa2da686640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2d4100a80 0x7fa2d40fce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:39.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.045+0000 7fa2da686640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2d4101420 0x7fa2d40fd370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:39.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.045+0000 7fa2da686640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2d4106a80 0x7fa2d40fd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:39.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.045+0000 7fa2da686640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d4110d50 con 0x7fa2d4101420 2024-09-19T06:22:39.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.045+0000 7fa2da686640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d4110bd0 con 0x7fa2d4106a80 2024-09-19T06:22:39.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.045+0000 7fa2da686640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d4110ed0 con 0x7fa2d4100a80 2024-09-19T06:22:39.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.045+0000 7fa2d37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2d4101420 0x7fa2d40fd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:39.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.045+0000 7fa2d37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2d4101420 0x7fa2d40fd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44580/0 (socket says 172.21.15.2:44580) 2024-09-19T06:22:39.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.045+0000 7fa2d37fe640 1 -- 172.21.15.2:0/637649876 learned_addr learned my addr 172.21.15.2:0/637649876 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:39.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.045+0000 7fa2d8c23640 1 --2- 172.21.15.2:0/637649876 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2d4106a80 0x7fa2d40fd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:39.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.045+0000 7fa2d3fff640 1 --2- 172.21.15.2:0/637649876 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2d4100a80 0x7fa2d40fce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:39.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.045+0000 7fa2d37fe640 1 -- 172.21.15.2:0/637649876 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2d4100a80 msgr2=0x7fa2d40fce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:39.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.045+0000 7fa2d37fe640 1 --2- 172.21.15.2:0/637649876 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2d4100a80 0x7fa2d40fce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.046+0000 7fa2d37fe640 1 -- 172.21.15.2:0/637649876 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2d4106a80 msgr2=0x7fa2d40fd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:39.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.046+0000 7fa2d37fe640 1 --2- 172.21.15.2:0/637649876 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2d4106a80 0x7fa2d40fd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.046+0000 7fa2d37fe640 1 -- 172.21.15.2:0/637649876 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2d41a6900 con 0x7fa2d4101420 2024-09-19T06:22:39.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.046+0000 7fa2d8c23640 1 --2- 172.21.15.2:0/637649876 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2d4106a80 0x7fa2d40fd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:39.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.046+0000 7fa2d37fe640 1 --2- 172.21.15.2:0/637649876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2d4101420 0x7fa2d40fd370 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fa2c800d950 tx=0x7fa2c800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:39.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.046+0000 7fa2d17fa640 1 -- 172.21.15.2:0/637649876 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8017070 con 0x7fa2d4101420 2024-09-19T06:22:39.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.046+0000 7fa2da686640 1 -- 172.21.15.2:0/637649876 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2d41a6bf0 con 0x7fa2d4101420 2024-09-19T06:22:39.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.046+0000 7fa2d17fa640 1 -- 172.21.15.2:0/637649876 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa2c8009c30 con 0x7fa2d4101420 2024-09-19T06:22:39.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.046+0000 7fa2d17fa640 1 -- 172.21.15.2:0/637649876 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c800f620 con 0x7fa2d4101420 2024-09-19T06:22:39.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.046+0000 7fa2da686640 1 -- 172.21.15.2:0/637649876 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2d41a7180 con 0x7fa2d4101420 2024-09-19T06:22:39.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.048+0000 7fa2d17fa640 1 -- 172.21.15.2:0/637649876 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fa2c80109a0 con 0x7fa2d4101420 2024-09-19T06:22:39.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.049+0000 7fa2dca5f740 1 Processor -- start 2024-09-19T06:22:39.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.049+0000 7fa2dca5f740 1 -- start start 2024-09-19T06:22:39.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.049+0000 7fa2dca5f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556f16647b40 0x556f16646090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:39.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.049+0000 7fa2dca5f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f166465d0 0x556f16646a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:39.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.049+0000 7fa2dca5f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f16651370 0x556f16653760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:39.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.049+0000 7fa2dca5f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556f165ac2f0 con 0x556f16651370 2024-09-19T06:22:39.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.049+0000 7fa2dca5f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x556f16553cf0 con 0x556f16647b40 2024-09-19T06:22:39.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.049+0000 7fa2dca5f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556f165a82b0 con 0x556f166465d0 2024-09-19T06:22:39.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.049+0000 7fa2d17fa640 1 --2- 172.21.15.2:0/637649876 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa2bc0a33b0 0x7fa2bc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:39.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.049+0000 7fa2d37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f16651370 0x556f16653760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:39.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.049+0000 7fa2d37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f16651370 0x556f16653760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44588/0 (socket says 172.21.15.2:44588) 2024-09-19T06:22:39.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.049+0000 7fa2d37fe640 1 -- 172.21.15.2:0/1021637130 learned_addr learned my addr 172.21.15.2:0/1021637130 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:39.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.049+0000 7fa2d3fff640 1 --2- 172.21.15.2:0/1021637130 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f166465d0 0x556f16646a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:39.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.049+0000 7fa2d8c23640 1 --2- 172.21.15.2:0/1021637130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556f16647b40 0x556f16646090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:39.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.049+0000 7fa2d8c23640 1 --2- 172.21.15.2:0/637649876 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa2bc0a33b0 0x7fa2bc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:39.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.049+0000 7fa2d37fe640 1 -- 172.21.15.2:0/1021637130 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f166465d0 msgr2=0x556f16646a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:39.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.050+0000 7fa2d37fe640 1 --2- 172.21.15.2:0/1021637130 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f166465d0 0x556f16646a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.050+0000 7fa2d37fe640 1 -- 172.21.15.2:0/1021637130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556f16647b40 msgr2=0x556f16646090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:39.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.050+0000 7fa2d37fe640 1 --2- 172.21.15.2:0/1021637130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556f16647b40 0x556f16646090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.050+0000 7fa2d37fe640 1 -- 172.21.15.2:0/1021637130 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f165383a0 con 0x556f16651370 2024-09-19T06:22:39.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.050+0000 7fa2d17fa640 1 -- 172.21.15.2:0/637649876 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7fa2c80cfa00 con 0x7fa2d4101420 2024-09-19T06:22:39.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.050+0000 7fa2d8c23640 1 --2- 172.21.15.2:0/637649876 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa2bc0a33b0 0x7fa2bc0a5870 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc009440 tx=0x7fa2cc0093d0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:39.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.050+0000 7fa2d37fe640 1 --2- 172.21.15.2:0/1021637130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f16651370 0x556f16653760 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fa2c80b0110 tx=0x7fa2c8022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f155ec21baaf7184 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:39.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.050+0000 7fa2ba7fc640 1 -- 172.21.15.2:0/1021637130 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c809c3e0 con 0x556f16651370 2024-09-19T06:22:39.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.050+0000 7fa2ba7fc640 1 -- 172.21.15.2:0/1021637130 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa2c8009de0 con 0x556f16651370 2024-09-19T06:22:39.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.050+0000 7fa2ba7fc640 1 -- 172.21.15.2:0/1021637130 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c80a4950 con 0x556f16651370 2024-09-19T06:22:39.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.051+0000 7fa2dca5f740 1 -- 172.21.15.2:0/1021637130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f16651370 msgr2=0x556f16653760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:39.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.051+0000 7fa2dca5f740 1 --2- 172.21.15.2:0/1021637130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f16651370 0x556f16653760 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fa2c80b0110 tx=0x7fa2c8022000 comp rx=0 tx=0).stop 2024-09-19T06:22:39.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.051+0000 7fa2dca5f740 1 -- 172.21.15.2:0/1021637130 shutdown_connections 2024-09-19T06:22:39.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.051+0000 7fa2dca5f740 1 --2- 172.21.15.2:0/1021637130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f16651370 0x556f16653760 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.051+0000 7fa2dca5f740 1 --2- 172.21.15.2:0/1021637130 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f166465d0 0x556f16646a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.051+0000 7fa2dca5f740 1 --2- 172.21.15.2:0/1021637130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556f16647b40 0x556f16646090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.051+0000 7fa2dca5f740 1 -- 172.21.15.2:0/1021637130 >> 172.21.15.2:0/1021637130 conn(0x556f1660f310 msgr2=0x556f16642c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:39.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.051+0000 7fa2dca5f740 1 -- 172.21.15.2:0/1021637130 shutdown_connections 2024-09-19T06:22:39.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.051+0000 7fa2dca5f740 1 -- 172.21.15.2:0/1021637130 wait complete. 2024-09-19T06:22:39.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.051+0000 7fa2dca5f740 1 -- start start 2024-09-19T06:22:39.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.051+0000 7fa2dca5f740 1 Processor -- start 2024-09-19T06:22:39.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.052+0000 7fa2dca5f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556f166465d0 0x556f16650d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:39.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.052+0000 7fa2dca5f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f16647b40 0x556f1664dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:39.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.052+0000 7fa2dca5f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f16651370 0x556f1664e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:39.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.052+0000 7fa2dca5f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556f16654010 con 0x556f16647b40 2024-09-19T06:22:39.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.052+0000 7fa2dca5f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x556f16567060 con 0x556f166465d0 2024-09-19T06:22:39.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.052+0000 7fa2dca5f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556f16654190 con 0x556f16651370 2024-09-19T06:22:39.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.052+0000 7fa2dca5f740 10 client.0 _ll_register_callbacks cb 0x556f162ba8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:39.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.052+0000 7fa2d37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f16647b40 0x556f1664dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:39.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.052+0000 7fa2d37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f16647b40 0x556f1664dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44594/0 (socket says 172.21.15.2:44594) 2024-09-19T06:22:39.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.052+0000 7fa2d37fe640 1 -- 172.21.15.2:0/2676681849 learned_addr learned my addr 172.21.15.2:0/2676681849 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:39.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.052+0000 7fa2d3fff640 1 --2- 172.21.15.2:0/2676681849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556f166465d0 0x556f16650d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:39.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.052+0000 7fa2d8c23640 1 --2- 172.21.15.2:0/2676681849 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f16651370 0x556f1664e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:39.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.052+0000 7fa2d37fe640 1 -- 172.21.15.2:0/2676681849 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f16651370 msgr2=0x556f1664e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:39.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.052+0000 7fa2d37fe640 1 --2- 172.21.15.2:0/2676681849 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f16651370 0x556f1664e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.052+0000 7fa2d37fe640 1 -- 172.21.15.2:0/2676681849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556f166465d0 msgr2=0x556f16650d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:39.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.052+0000 7fa2d37fe640 1 --2- 172.21.15.2:0/2676681849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556f166465d0 0x556f16650d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.052+0000 7fa2d37fe640 1 -- 172.21.15.2:0/2676681849 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f1631d3c0 con 0x556f16647b40 2024-09-19T06:22:39.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.052+0000 7fa2d37fe640 1 --2- 172.21.15.2:0/2676681849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f16647b40 0x556f1664dfe0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fa2c80cd750 tx=0x7fa2c8010c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5feda05253ef007 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:39.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.052+0000 7fa2b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:22:39.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.052+0000 7fa2b37fe640 1 -- 172.21.15.2:0/2676681849 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8020070 con 0x556f16647b40 2024-09-19T06:22:39.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.052+0000 7fa2b37fe640 1 -- 172.21.15.2:0/2676681849 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7fa2c80b0200 con 0x556f16647b40 2024-09-19T06:22:39.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.052+0000 7fa2dca5f740 1 -- 172.21.15.2:0/2676681849 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2c8009de0 con 0x556f16647b40 2024-09-19T06:22:39.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.053+0000 7fa2b37fe640 1 -- 172.21.15.2:0/2676681849 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa2c8097f80 con 0x556f16647b40 2024-09-19T06:22:39.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.053+0000 7fa2dca5f740 10 client.18117 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:39.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.053+0000 7fa2dca5f740 1 -- 172.21.15.2:0/2676681849 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556f1665fa70 con 0x556f16647b40 2024-09-19T06:22:39.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.053+0000 7fa2b37fe640 1 -- 172.21.15.2:0/2676681849 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa2c8009de0 con 0x556f16647b40 2024-09-19T06:22:39.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.053+0000 7fa2b37fe640 1 -- 172.21.15.2:0/2676681849 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fa2c80b3830 con 0x556f16647b40 2024-09-19T06:22:39.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.053+0000 7fa2dca5f740 10 client.18117 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:39.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.053+0000 7fa2dca5f740 10 client.18117 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:39.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.053+0000 7fa2dca5f740 20 client.18117 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:39.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.053+0000 7fa2dca5f740 1 --2- 172.21.15.2:0/2676681849 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556f16660dc0 0x556f166631b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:39.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.053+0000 7fa2dca5f740 4 client.18117 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:22:39.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.053+0000 7fa2dca5f740 1 -- 172.21.15.2:0/2676681849 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f165b9860 con 0x556f16660dc0 2024-09-19T06:22:39.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.053+0000 7fa2d3fff640 1 --2- 172.21.15.2:0/2676681849 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556f16660dc0 0x556f166631b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:39.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.054+0000 7fa2d3fff640 1 --2- 172.21.15.2:0/2676681849 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556f16660dc0 0x556f166631b0 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41cd0e35f38cc60e server_cookie=8f5976103748af35 in_seq=0 out_seq=0 2024-09-19T06:22:39.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.054+0000 7fa2b37fe640 10 client.18117 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:39.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.054+0000 7fa2b37fe640 1 -- 172.21.15.2:0/2676681849 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556f165b9860 con 0x556f16660dc0 2024-09-19T06:22:39.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.054+0000 7fa2b37fe640 10 client.18117 handle_command_reply: tid=0 2024-09-19T06:22:39.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.054+0000 7fa2dca5f740 1 client.18117 shutdown 2024-09-19T06:22:39.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.055+0000 7fa2dca5f740 1 -- 172.21.15.2:0/2676681849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f16647b40 msgr2=0x556f1664dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:39.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.055+0000 7fa2dca5f740 1 --2- 172.21.15.2:0/2676681849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f16647b40 0x556f1664dfe0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fa2c80cd750 tx=0x7fa2c8010c90 comp rx=0 tx=0).stop 2024-09-19T06:22:39.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.055+0000 7fa2dca5f740 1 -- 172.21.15.2:0/2676681849 shutdown_connections 2024-09-19T06:22:39.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.055+0000 7fa2dca5f740 1 --2- 172.21.15.2:0/2676681849 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f16651370 0x556f1664e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.055+0000 7fa2dca5f740 1 --2- 172.21.15.2:0/2676681849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f16647b40 0x556f1664dfe0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.055+0000 7fa2dca5f740 1 --2- 172.21.15.2:0/2676681849 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556f16660dc0 0x556f166631b0 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.055+0000 7fa2dca5f740 1 --2- 172.21.15.2:0/2676681849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556f166465d0 0x556f16650d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.055+0000 7fa2dca5f740 1 -- 172.21.15.2:0/2676681849 >> 172.21.15.2:0/2676681849 conn(0x556f1660f310 msgr2=0x556f16648990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:39.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.055+0000 7fa2b37fe640 0 client.18117 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:39.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.055+0000 7fa2dca5f740 1 -- 172.21.15.2:0/2676681849 shutdown_connections 2024-09-19T06:22:39.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.055+0000 7fa2dca5f740 1 -- 172.21.15.2:0/2676681849 wait complete. 2024-09-19T06:22:39.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.055+0000 7fa2dca5f740 20 client.18117 trim_cache size 0 max 16384 2024-09-19T06:22:39.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.068+0000 7fa2dca5f740 1 Processor -- start 2024-09-19T06:22:39.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.068+0000 7fa2dca5f740 1 -- start start 2024-09-19T06:22:39.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.068+0000 7fa2dca5f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556f166465d0 0x556f1664dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:39.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.068+0000 7fa2dca5f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f16647b40 0x556f16652760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:39.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.068+0000 7fa2dca5f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f16651370 0x556f16652ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:39.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.068+0000 7fa2dca5f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d41b22c0 con 0x556f16647b40 2024-09-19T06:22:39.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.068+0000 7fa2dca5f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d41afb90 con 0x556f166465d0 2024-09-19T06:22:39.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.068+0000 7fa2dca5f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d41ada00 con 0x556f16651370 2024-09-19T06:22:39.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.068+0000 7fa2d37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f16647b40 0x556f16652760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:39.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.068+0000 7fa2d37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f16647b40 0x556f16652760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44604/0 (socket says 172.21.15.2:44604) 2024-09-19T06:22:39.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.068+0000 7fa2d37fe640 1 -- 172.21.15.2:0/1989479675 learned_addr learned my addr 172.21.15.2:0/1989479675 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:39.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.068+0000 7fa2d37fe640 1 -- 172.21.15.2:0/1989479675 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f16651370 msgr2=0x556f16652ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:39.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.068+0000 7fa2d37fe640 1 --2- 172.21.15.2:0/1989479675 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f16651370 0x556f16652ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.068+0000 7fa2d37fe640 1 -- 172.21.15.2:0/1989479675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556f166465d0 msgr2=0x556f1664dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:39.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.068+0000 7fa2d37fe640 1 --2- 172.21.15.2:0/1989479675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556f166465d0 0x556f1664dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.068+0000 7fa2d37fe640 1 -- 172.21.15.2:0/1989479675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f16642ed0 con 0x556f16647b40 2024-09-19T06:22:39.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.069+0000 7fa2d37fe640 1 --2- 172.21.15.2:0/1989479675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f16647b40 0x556f16652760 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fa2c80058c0 tx=0x7fa2c800bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=145d35df958347a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:39.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.069+0000 7fa2b9ffb640 1 -- 172.21.15.2:0/1989479675 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8020030 con 0x556f16647b40 2024-09-19T06:22:39.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.069+0000 7fa2b9ffb640 1 -- 172.21.15.2:0/1989479675 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa2c8009de0 con 0x556f16647b40 2024-09-19T06:22:39.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.069+0000 7fa2b9ffb640 1 -- 172.21.15.2:0/1989479675 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c809bce0 con 0x556f16647b40 2024-09-19T06:22:39.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.069+0000 7fa2dca5f740 1 -- 172.21.15.2:0/1989479675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f16647b40 msgr2=0x556f16652760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:39.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.069+0000 7fa2dca5f740 1 --2- 172.21.15.2:0/1989479675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f16647b40 0x556f16652760 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fa2c80058c0 tx=0x7fa2c800bf60 comp rx=0 tx=0).stop 2024-09-19T06:22:39.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.069+0000 7fa2dca5f740 1 -- 172.21.15.2:0/1989479675 shutdown_connections 2024-09-19T06:22:39.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.069+0000 7fa2dca5f740 1 --2- 172.21.15.2:0/1989479675 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f16651370 0x556f16652ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.069+0000 7fa2dca5f740 1 --2- 172.21.15.2:0/1989479675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f16647b40 0x556f16652760 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.069+0000 7fa2dca5f740 1 --2- 172.21.15.2:0/1989479675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556f166465d0 0x556f1664dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.069+0000 7fa2dca5f740 1 -- 172.21.15.2:0/1989479675 >> 172.21.15.2:0/1989479675 conn(0x556f1660f310 msgr2=0x556f1664d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:39.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.070+0000 7fa2dca5f740 1 -- 172.21.15.2:0/1989479675 shutdown_connections 2024-09-19T06:22:39.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.070+0000 7fa2dca5f740 1 -- 172.21.15.2:0/1989479675 wait complete. 2024-09-19T06:22:39.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.070+0000 7fa2dca5f740 1 -- start start 2024-09-19T06:22:39.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.070+0000 7fa2dca5f740 1 Processor -- start 2024-09-19T06:22:39.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.070+0000 7fa2dca5f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f166465d0 0x556f166c3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:39.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.070+0000 7fa2dca5f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556f16647b40 0x556f166c3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:39.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.070+0000 7fa2dca5f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f16651370 0x556f16665a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:39.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.070+0000 7fa2dca5f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d41ae050 con 0x556f166465d0 2024-09-19T06:22:39.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.070+0000 7fa2dca5f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d41af4c0 con 0x556f16647b40 2024-09-19T06:22:39.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.070+0000 7fa2dca5f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d41ae720 con 0x556f16651370 2024-09-19T06:22:39.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.070+0000 7fa2dca5f740 10 client.0 _ll_register_callbacks cb 0x7fa2cc009ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:39.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.070+0000 7fa2d3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f166465d0 0x556f166c3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:39.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.071+0000 7fa2d3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f166465d0 0x556f166c3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44606/0 (socket says 172.21.15.2:44606) 2024-09-19T06:22:39.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.071+0000 7fa2d3fff640 1 -- 172.21.15.2:0/3209983749 learned_addr learned my addr 172.21.15.2:0/3209983749 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:39.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.071+0000 7fa2d37fe640 1 --2- 172.21.15.2:0/3209983749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556f16647b40 0x556f166c3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:39.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.071+0000 7fa2d8c23640 1 --2- 172.21.15.2:0/3209983749 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f16651370 0x556f16665a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:39.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.071+0000 7fa2d3fff640 1 -- 172.21.15.2:0/3209983749 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f16651370 msgr2=0x556f16665a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:39.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.071+0000 7fa2d3fff640 1 --2- 172.21.15.2:0/3209983749 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f16651370 0x556f16665a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.071+0000 7fa2d3fff640 1 -- 172.21.15.2:0/3209983749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556f16647b40 msgr2=0x556f166c3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:39.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.071+0000 7fa2d3fff640 1 --2- 172.21.15.2:0/3209983749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556f16647b40 0x556f166c3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.071+0000 7fa2d3fff640 1 -- 172.21.15.2:0/3209983749 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f1664e940 con 0x556f166465d0 2024-09-19T06:22:39.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.071+0000 7fa2d37fe640 1 --2- 172.21.15.2:0/3209983749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556f16647b40 0x556f166c3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:39.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.071+0000 7fa2d3fff640 1 --2- 172.21.15.2:0/3209983749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f166465d0 0x556f166c3890 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4005ab0 tx=0x7fa2c4032da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c03bf89441a81b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:39.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.071+0000 7fa2b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:22:39.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.071+0000 7fa2b37fe640 1 -- 172.21.15.2:0/3209983749 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c404a060 con 0x556f166465d0 2024-09-19T06:22:39.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.071+0000 7fa2b37fe640 1 -- 172.21.15.2:0/3209983749 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7fa2c4005040 con 0x556f166465d0 2024-09-19T06:22:39.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.071+0000 7fa2dca5f740 1 -- 172.21.15.2:0/3209983749 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2c8009de0 con 0x556f166465d0 2024-09-19T06:22:39.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.071+0000 7fa2b37fe640 1 -- 172.21.15.2:0/3209983749 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa2c4035040 con 0x556f166465d0 2024-09-19T06:22:39.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.071+0000 7fa2dca5f740 10 client.18123 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:39.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.071+0000 7fa2dca5f740 1 -- 172.21.15.2:0/3209983749 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556f166cafe0 con 0x556f166465d0 2024-09-19T06:22:39.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.072+0000 7fa2b37fe640 1 -- 172.21.15.2:0/3209983749 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa2c8009de0 con 0x556f166465d0 2024-09-19T06:22:39.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.072+0000 7fa2b37fe640 1 -- 172.21.15.2:0/3209983749 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fa2c40035f0 con 0x556f166465d0 2024-09-19T06:22:39.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.072+0000 7fa2dca5f740 10 client.18123 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:39.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.072+0000 7fa2dca5f740 10 client.18123 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:39.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.072+0000 7fa2dca5f740 20 client.18123 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:39.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.072+0000 7fa2dca5f740 1 --2- 172.21.15.2:0/3209983749 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556f166cb6b0 0x556f166cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:39.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.072+0000 7fa2dca5f740 4 client.18123 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:22:39.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.072+0000 7fa2dca5f740 1 -- 172.21.15.2:0/3209983749 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556f165b3d70 con 0x556f166cb6b0 2024-09-19T06:22:39.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.072+0000 7fa2d37fe640 1 --2- 172.21.15.2:0/3209983749 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556f166cb6b0 0x556f166cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:39.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.073+0000 7fa2d37fe640 1 --2- 172.21.15.2:0/3209983749 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556f166cb6b0 0x556f166cdaa0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75b84c07562f91aa server_cookie=92f09ae018cfc704 in_seq=0 out_seq=0 2024-09-19T06:22:39.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.073+0000 7fa2b37fe640 10 client.18123 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:39.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.073+0000 7fa2b37fe640 1 -- 172.21.15.2:0/3209983749 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556f165b3d70 con 0x556f166cb6b0 2024-09-19T06:22:39.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.073+0000 7fa2b37fe640 10 client.18123 handle_command_reply: tid=0 2024-09-19T06:22:39.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.073+0000 7fa2dca5f740 1 client.18123 shutdown 2024-09-19T06:22:39.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.073+0000 7fa2dca5f740 1 -- 172.21.15.2:0/3209983749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f166465d0 msgr2=0x556f166c3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:39.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.073+0000 7fa2dca5f740 1 --2- 172.21.15.2:0/3209983749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f166465d0 0x556f166c3890 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4005ab0 tx=0x7fa2c4032da0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.073+0000 7fa2dca5f740 1 -- 172.21.15.2:0/3209983749 shutdown_connections 2024-09-19T06:22:39.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.073+0000 7fa2dca5f740 1 --2- 172.21.15.2:0/3209983749 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556f16651370 0x556f16665a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.073+0000 7fa2dca5f740 1 --2- 172.21.15.2:0/3209983749 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556f166cb6b0 0x556f166cdaa0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.073+0000 7fa2b37fe640 0 client.18123 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:39.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.073+0000 7fa2dca5f740 1 --2- 172.21.15.2:0/3209983749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556f16647b40 0x556f166c3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.073+0000 7fa2dca5f740 1 --2- 172.21.15.2:0/3209983749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556f166465d0 0x556f166c3890 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.073+0000 7fa2dca5f740 1 -- 172.21.15.2:0/3209983749 >> 172.21.15.2:0/3209983749 conn(0x556f1660f310 msgr2=0x556f16641d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:39.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.073+0000 7fa2dca5f740 1 -- 172.21.15.2:0/3209983749 shutdown_connections 2024-09-19T06:22:39.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.073+0000 7fa2dca5f740 1 -- 172.21.15.2:0/3209983749 wait complete. 2024-09-19T06:22:39.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.073+0000 7fa2dca5f740 20 client.18123 trim_cache size 0 max 16384 2024-09-19T06:22:39.086 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:22:39.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.074+0000 7fa2da686640 1 -- 172.21.15.2:0/637649876 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa2bc0a33b0 msgr2=0x7fa2bc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:39.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.074+0000 7fa2da686640 1 --2- 172.21.15.2:0/637649876 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa2bc0a33b0 0x7fa2bc0a5870 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc009440 tx=0x7fa2cc0093d0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.074+0000 7fa2da686640 1 -- 172.21.15.2:0/637649876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2d4101420 msgr2=0x7fa2d40fd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:39.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.074+0000 7fa2da686640 1 --2- 172.21.15.2:0/637649876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2d4101420 0x7fa2d40fd370 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fa2c800d950 tx=0x7fa2c800de10 comp rx=0 tx=0).stop 2024-09-19T06:22:39.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.074+0000 7fa2da686640 1 -- 172.21.15.2:0/637649876 shutdown_connections 2024-09-19T06:22:39.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.074+0000 7fa2da686640 1 --2- 172.21.15.2:0/637649876 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa2bc0a33b0 0x7fa2bc0a5870 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.074+0000 7fa2da686640 1 --2- 172.21.15.2:0/637649876 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2d4106a80 0x7fa2d40fd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.074+0000 7fa2da686640 1 --2- 172.21.15.2:0/637649876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2d4101420 0x7fa2d40fd370 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.074+0000 7fa2da686640 1 --2- 172.21.15.2:0/637649876 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2d4100a80 0x7fa2d40fce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.074+0000 7fa2da686640 1 -- 172.21.15.2:0/637649876 >> 172.21.15.2:0/637649876 conn(0x7fa2d40fc7a0 msgr2=0x7fa2d406aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:39.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.074+0000 7fa2da686640 1 -- 172.21.15.2:0/637649876 shutdown_connections 2024-09-19T06:22:39.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:39.074+0000 7fa2da686640 1 -- 172.21.15.2:0/637649876 wait complete. 2024-09-19T06:22:39.700 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:39 smithi002 ceph-mon[30982]: pgmap v242: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:22:39.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:39 smithi090 ceph-mon[34497]: pgmap v242: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:22:39.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:39 smithi089 ceph-mon[34160]: pgmap v242: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:22:40.731 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:22:40.731 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:22:41.002 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:22:41.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.446+0000 7feafee64640 1 -- 172.21.15.2:0/284281726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feaf8101400 msgr2=0x7feaf810d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:41.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.446+0000 7feafee64640 1 --2- 172.21.15.2:0/284281726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feaf8101400 0x7feaf810d930 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7feaf0009cd0 tx=0x7feaf002a8e0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.446+0000 7feafee64640 1 -- 172.21.15.2:0/284281726 shutdown_connections 2024-09-19T06:22:41.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.446+0000 7feafee64640 1 --2- 172.21.15.2:0/284281726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feaf8101400 0x7feaf810d930 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.446+0000 7feafee64640 1 --2- 172.21.15.2:0/284281726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feaf8100a60 0x7feaf8100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.446+0000 7feafee64640 1 --2- 172.21.15.2:0/284281726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feaf8106a60 0x7feaf8106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.446+0000 7feafee64640 1 -- 172.21.15.2:0/284281726 >> 172.21.15.2:0/284281726 conn(0x7feaf80fc780 msgr2=0x7feaf80feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:41.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.446+0000 7feafee64640 1 -- 172.21.15.2:0/284281726 shutdown_connections 2024-09-19T06:22:41.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.446+0000 7feafee64640 1 -- 172.21.15.2:0/284281726 wait complete. 2024-09-19T06:22:41.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.447+0000 7feafee64640 1 Processor -- start 2024-09-19T06:22:41.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.447+0000 7feafee64640 1 -- start start 2024-09-19T06:22:41.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.447+0000 7feafee64640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feaf8100a60 0x7feaf8198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:41.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.447+0000 7feafee64640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feaf8101400 0x7feaf81988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:41.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.447+0000 7feafee64640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feaf8106a60 0x7feaf819cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:41.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.447+0000 7feafee64640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7feaf8111e30 con 0x7feaf8100a60 2024-09-19T06:22:41.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.447+0000 7feafee64640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7feaf8111cb0 con 0x7feaf8101400 2024-09-19T06:22:41.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.447+0000 7feafee64640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7feaf8111fb0 con 0x7feaf8106a60 2024-09-19T06:22:41.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.447+0000 7feafcc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feaf8100a60 0x7feaf8198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:41.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.447+0000 7feafcc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feaf8100a60 0x7feaf8198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44612/0 (socket says 172.21.15.2:44612) 2024-09-19T06:22:41.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.447+0000 7feafcc00640 1 -- 172.21.15.2:0/3741450742 learned_addr learned my addr 172.21.15.2:0/3741450742 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:41.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.448+0000 7feaf7fff640 1 --2- 172.21.15.2:0/3741450742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feaf8101400 0x7feaf81988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:41.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.448+0000 7feafd401640 1 --2- 172.21.15.2:0/3741450742 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feaf8106a60 0x7feaf819cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:41.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.448+0000 7feafcc00640 1 -- 172.21.15.2:0/3741450742 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feaf8106a60 msgr2=0x7feaf819cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:41.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.448+0000 7feafcc00640 1 --2- 172.21.15.2:0/3741450742 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feaf8106a60 0x7feaf819cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.448+0000 7feafcc00640 1 -- 172.21.15.2:0/3741450742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feaf8101400 msgr2=0x7feaf81988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:41.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.448+0000 7feafcc00640 1 --2- 172.21.15.2:0/3741450742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feaf8101400 0x7feaf81988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.448+0000 7feafcc00640 1 -- 172.21.15.2:0/3741450742 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaf819d320 con 0x7feaf8100a60 2024-09-19T06:22:41.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.448+0000 7feafd401640 1 --2- 172.21.15.2:0/3741450742 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feaf8106a60 0x7feaf819cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:22:41.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.448+0000 7feafcc00640 1 --2- 172.21.15.2:0/3741450742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feaf8100a60 0x7feaf8198370 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7feaec00e9f0 tx=0x7feaec00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:41.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.448+0000 7feaf5ffb640 1 -- 172.21.15.2:0/3741450742 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaec00cd80 con 0x7feaf8100a60 2024-09-19T06:22:41.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.448+0000 7feafee64640 1 -- 172.21.15.2:0/3741450742 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaf819d610 con 0x7feaf8100a60 2024-09-19T06:22:41.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.448+0000 7feaf5ffb640 1 -- 172.21.15.2:0/3741450742 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feaec0054d0 con 0x7feaf8100a60 2024-09-19T06:22:41.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.448+0000 7feaf5ffb640 1 -- 172.21.15.2:0/3741450742 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaec010490 con 0x7feaf8100a60 2024-09-19T06:22:41.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.448+0000 7feafee64640 1 -- 172.21.15.2:0/3741450742 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaf81a4ef0 con 0x7feaf8100a60 2024-09-19T06:22:41.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.450+0000 7feaf5ffb640 1 -- 172.21.15.2:0/3741450742 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7feaec005020 con 0x7feaf8100a60 2024-09-19T06:22:41.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.451+0000 7feb0123d740 1 Processor -- start 2024-09-19T06:22:41.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.451+0000 7feb0123d740 1 -- start start 2024-09-19T06:22:41.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.451+0000 7feb0123d740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55defef53a40 0x55defef53e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:41.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.451+0000 7feaf5ffb640 1 --2- 172.21.15.2:0/3741450742 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7feae80a33b0 0x7feae80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:41.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.451+0000 7feb0123d740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55defef54360 0x55defef62c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:41.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.451+0000 7feb0123d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55defef63150 0x55defef65540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:41.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.451+0000 7feb0123d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55defeeb9280 con 0x55defef63150 2024-09-19T06:22:41.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.451+0000 7feb0123d740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55defee60b10 con 0x55defef53a40 2024-09-19T06:22:41.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.451+0000 7feb0123d740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55defeeb5240 con 0x55defef54360 2024-09-19T06:22:41.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.451+0000 7feafcc00640 1 --2- 172.21.15.2:0/3741450742 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7feae80a33b0 0x7feae80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:41.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.451+0000 7feafd401640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55defef63150 0x55defef65540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:41.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.451+0000 7feafd401640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55defef63150 0x55defef65540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44620/0 (socket says 172.21.15.2:44620) 2024-09-19T06:22:41.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.451+0000 7feafd401640 1 -- 172.21.15.2:0/3962990414 learned_addr learned my addr 172.21.15.2:0/3962990414 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:41.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.451+0000 7feaf7fff640 1 --2- 172.21.15.2:0/3962990414 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55defef54360 0x55defef62c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:41.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.451+0000 7feafd401640 1 --2- 172.21.15.2:0/3962990414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55defef53a40 0x55defef53e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:41.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.452+0000 7feaf5ffb640 1 -- 172.21.15.2:0/3741450742 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7feaec0d0090 con 0x7feaf8100a60 2024-09-19T06:22:41.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.452+0000 7feafd401640 1 -- 172.21.15.2:0/3962990414 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55defef54360 msgr2=0x55defef62c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:41.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.452+0000 7feafd401640 1 --2- 172.21.15.2:0/3962990414 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55defef54360 0x55defef62c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.452+0000 7feafd401640 1 -- 172.21.15.2:0/3962990414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55defef53a40 msgr2=0x55defef53e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:41.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.452+0000 7feafd401640 1 --2- 172.21.15.2:0/3962990414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55defef53a40 0x55defef53e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.452+0000 7feafd401640 1 -- 172.21.15.2:0/3962990414 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55defee6d1f0 con 0x55defef63150 2024-09-19T06:22:41.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.452+0000 7feafcc00640 1 --2- 172.21.15.2:0/3741450742 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7feae80a33b0 0x7feae80a5870 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7feaec0cd890 tx=0x7feaec091800 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:41.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.452+0000 7feafd401640 1 --2- 172.21.15.2:0/3962990414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55defef63150 0x55defef65540 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7feaf0009a60 tx=0x7feaf0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69c2e77d4ecdd79 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:41.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.452+0000 7feae2ffd640 1 -- 172.21.15.2:0/3962990414 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf0004d40 con 0x55defef63150 2024-09-19T06:22:41.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.452+0000 7feae2ffd640 1 -- 172.21.15.2:0/3962990414 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feaf0036040 con 0x55defef63150 2024-09-19T06:22:41.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.452+0000 7feae2ffd640 1 -- 172.21.15.2:0/3962990414 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf00042a0 con 0x55defef63150 2024-09-19T06:22:41.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.453+0000 7feb0123d740 1 -- 172.21.15.2:0/3962990414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55defef63150 msgr2=0x55defef65540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:41.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.453+0000 7feb0123d740 1 --2- 172.21.15.2:0/3962990414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55defef63150 0x55defef65540 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7feaf0009a60 tx=0x7feaf0004a40 comp rx=0 tx=0).stop 2024-09-19T06:22:41.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.453+0000 7feb0123d740 1 -- 172.21.15.2:0/3962990414 shutdown_connections 2024-09-19T06:22:41.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.453+0000 7feb0123d740 1 --2- 172.21.15.2:0/3962990414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55defef63150 0x55defef65540 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.453+0000 7feb0123d740 1 --2- 172.21.15.2:0/3962990414 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55defef54360 0x55defef62c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.453+0000 7feb0123d740 1 --2- 172.21.15.2:0/3962990414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55defef53a40 0x55defef53e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.453+0000 7feb0123d740 1 -- 172.21.15.2:0/3962990414 >> 172.21.15.2:0/3962990414 conn(0x55defef500f0 msgr2=0x55defef504d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:41.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.453+0000 7feb0123d740 1 -- 172.21.15.2:0/3962990414 shutdown_connections 2024-09-19T06:22:41.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.453+0000 7feb0123d740 1 -- 172.21.15.2:0/3962990414 wait complete. 2024-09-19T06:22:41.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.453+0000 7feb0123d740 1 -- start start 2024-09-19T06:22:41.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.453+0000 7feb0123d740 1 Processor -- start 2024-09-19T06:22:41.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.454+0000 7feb0123d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55defef53a40 0x55defef60090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:41.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.454+0000 7feb0123d740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55defef54360 0x55defef605d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:41.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.454+0000 7feb0123d740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55defef63150 0x55defef60b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:41.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.454+0000 7feb0123d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55defef65d20 con 0x55defef53a40 2024-09-19T06:22:41.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.454+0000 7feb0123d740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55defee73f10 con 0x55defef63150 2024-09-19T06:22:41.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.454+0000 7feb0123d740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55defef65ea0 con 0x55defef54360 2024-09-19T06:22:41.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.454+0000 7feb0123d740 10 client.0 _ll_register_callbacks cb 0x55defee3ca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:41.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.454+0000 7feafd401640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55defef53a40 0x55defef60090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:41.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.454+0000 7feafd401640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55defef53a40 0x55defef60090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44632/0 (socket says 172.21.15.2:44632) 2024-09-19T06:22:41.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.454+0000 7feafd401640 1 -- 172.21.15.2:0/3299851212 learned_addr learned my addr 172.21.15.2:0/3299851212 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:41.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.454+0000 7feaf7fff640 1 --2- 172.21.15.2:0/3299851212 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55defef54360 0x55defef605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:41.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.454+0000 7feafd401640 1 --2- 172.21.15.2:0/3299851212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55defef63150 0x55defef60b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:41.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.454+0000 7feafd401640 1 -- 172.21.15.2:0/3299851212 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55defef54360 msgr2=0x55defef605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:41.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.454+0000 7feafd401640 1 --2- 172.21.15.2:0/3299851212 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55defef54360 0x55defef605d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.454+0000 7feafd401640 1 -- 172.21.15.2:0/3299851212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55defef63150 msgr2=0x55defef60b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:41.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.454+0000 7feafd401640 1 --2- 172.21.15.2:0/3299851212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55defef63150 0x55defef60b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.454+0000 7feafd401640 1 -- 172.21.15.2:0/3299851212 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55defec2a6a0 con 0x55defef53a40 2024-09-19T06:22:41.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.454+0000 7feaf7fff640 1 --2- 172.21.15.2:0/3299851212 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55defef54360 0x55defef605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:41.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.455+0000 7feafd401640 1 --2- 172.21.15.2:0/3299851212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55defef53a40 0x55defef60090 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7feaf0009560 tx=0x7feaf00099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40c1859dbf51810c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:41.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.455+0000 7fead7fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:22:41.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.455+0000 7fead7fff640 1 -- 172.21.15.2:0/3299851212 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf0055060 con 0x55defef53a40 2024-09-19T06:22:41.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.455+0000 7feb0123d740 1 -- 172.21.15.2:0/3299851212 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feaf0036040 con 0x55defef53a40 2024-09-19T06:22:41.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.455+0000 7fead7fff640 1 -- 172.21.15.2:0/3299851212 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7feaf0031af0 con 0x55defef53a40 2024-09-19T06:22:41.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.455+0000 7fead7fff640 1 -- 172.21.15.2:0/3299851212 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7feaf0004000 con 0x55defef53a40 2024-09-19T06:22:41.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.455+0000 7feb0123d740 10 client.18135 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:41.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.455+0000 7feb0123d740 1 -- 172.21.15.2:0/3299851212 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55defef719b0 con 0x55defef53a40 2024-09-19T06:22:41.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.455+0000 7fead7fff640 1 -- 172.21.15.2:0/3299851212 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feaf0036040 con 0x55defef53a40 2024-09-19T06:22:41.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.455+0000 7fead7fff640 1 -- 172.21.15.2:0/3299851212 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7feaf0030070 con 0x55defef53a40 2024-09-19T06:22:41.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.455+0000 7feb0123d740 10 client.18135 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:41.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.455+0000 7feb0123d740 10 client.18135 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:41.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.455+0000 7feb0123d740 20 client.18135 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:41.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.456+0000 7feb0123d740 1 --2- 172.21.15.2:0/3299851212 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55defef72d00 0x55defef750f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:41.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.456+0000 7feb0123d740 4 client.18135 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:22:41.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.456+0000 7feb0123d740 1 -- 172.21.15.2:0/3299851212 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55defeec67f0 con 0x55defef72d00 2024-09-19T06:22:41.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.456+0000 7feaf7fff640 1 --2- 172.21.15.2:0/3299851212 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55defef72d00 0x55defef750f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:41.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.456+0000 7feaf7fff640 1 --2- 172.21.15.2:0/3299851212 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55defef72d00 0x55defef750f0 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0dff51d1b2e6a2f server_cookie=adabf367b14511c0 in_seq=0 out_seq=0 2024-09-19T06:22:41.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.456+0000 7fead7fff640 10 client.18135 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:41.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.457+0000 7fead7fff640 1 -- 172.21.15.2:0/3299851212 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55defeec67f0 con 0x55defef72d00 2024-09-19T06:22:41.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.457+0000 7fead7fff640 10 client.18135 handle_command_reply: tid=0 2024-09-19T06:22:41.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.457+0000 7feb0123d740 1 client.18135 shutdown 2024-09-19T06:22:41.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.457+0000 7feb0123d740 1 -- 172.21.15.2:0/3299851212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55defef53a40 msgr2=0x55defef60090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:41.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.457+0000 7feb0123d740 1 --2- 172.21.15.2:0/3299851212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55defef53a40 0x55defef60090 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7feaf0009560 tx=0x7feaf00099c0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.457+0000 7feb0123d740 1 -- 172.21.15.2:0/3299851212 shutdown_connections 2024-09-19T06:22:41.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.457+0000 7feb0123d740 1 --2- 172.21.15.2:0/3299851212 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55defef72d00 0x55defef750f0 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.457+0000 7fead7fff640 0 client.18135 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:41.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.457+0000 7feb0123d740 1 --2- 172.21.15.2:0/3299851212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55defef63150 0x55defef60b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.457+0000 7feb0123d740 1 --2- 172.21.15.2:0/3299851212 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55defef54360 0x55defef605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.457+0000 7feb0123d740 1 --2- 172.21.15.2:0/3299851212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55defef53a40 0x55defef60090 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.457+0000 7feb0123d740 1 -- 172.21.15.2:0/3299851212 >> 172.21.15.2:0/3299851212 conn(0x55defef500f0 msgr2=0x55defef55e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:41.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.457+0000 7feb0123d740 1 -- 172.21.15.2:0/3299851212 shutdown_connections 2024-09-19T06:22:41.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.457+0000 7feb0123d740 1 -- 172.21.15.2:0/3299851212 wait complete. 2024-09-19T06:22:41.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.458+0000 7feb0123d740 20 client.18135 trim_cache size 0 max 16384 2024-09-19T06:22:41.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.475+0000 7feb0123d740 1 Processor -- start 2024-09-19T06:22:41.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.475+0000 7feb0123d740 1 -- start start 2024-09-19T06:22:41.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.475+0000 7feb0123d740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55defef53a40 0x55defef61ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:41.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.475+0000 7feb0123d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55defef54360 0x55defef78110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:41.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.475+0000 7feb0123d740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55defef63150 0x55defef78650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:41.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.475+0000 7feb0123d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7feaf81ade10 con 0x55defef54360 2024-09-19T06:22:41.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.475+0000 7feb0123d740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7feaf81ab6e0 con 0x55defef63150 2024-09-19T06:22:41.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.475+0000 7feb0123d740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7feaf81a9550 con 0x55defef53a40 2024-09-19T06:22:41.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.475+0000 7feaf7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55defef54360 0x55defef78110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:41.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.475+0000 7feaf7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55defef54360 0x55defef78110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44646/0 (socket says 172.21.15.2:44646) 2024-09-19T06:22:41.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.475+0000 7feaf7fff640 1 -- 172.21.15.2:0/2087600927 learned_addr learned my addr 172.21.15.2:0/2087600927 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:41.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.475+0000 7feafd401640 1 --2- 172.21.15.2:0/2087600927 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55defef63150 0x55defef78650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:41.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.475+0000 7feafd401640 1 --2- 172.21.15.2:0/2087600927 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55defef53a40 0x55defef61ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:41.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.476+0000 7feaf7fff640 1 -- 172.21.15.2:0/2087600927 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55defef53a40 msgr2=0x55defef61ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:41.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.476+0000 7feaf7fff640 1 --2- 172.21.15.2:0/2087600927 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55defef53a40 0x55defef61ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.476+0000 7feaf7fff640 1 -- 172.21.15.2:0/2087600927 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55defef63150 msgr2=0x55defef78650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:41.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.476+0000 7feaf7fff640 1 --2- 172.21.15.2:0/2087600927 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55defef63150 0x55defef78650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.476+0000 7feaf7fff640 1 -- 172.21.15.2:0/2087600927 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55defef62960 con 0x55defef54360 2024-09-19T06:22:41.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.476+0000 7feaf7fff640 1 --2- 172.21.15.2:0/2087600927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55defef54360 0x55defef78110 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x55defef5f920 tx=0x7feae4012bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bc2ec6d4555c4e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:41.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.476+0000 7feae27fc640 1 -- 172.21.15.2:0/2087600927 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae4005020 con 0x55defef54360 2024-09-19T06:22:41.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.476+0000 7feae27fc640 1 -- 172.21.15.2:0/2087600927 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feae400f810 con 0x55defef54360 2024-09-19T06:22:41.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.476+0000 7feae27fc640 1 -- 172.21.15.2:0/2087600927 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae4004a00 con 0x55defef54360 2024-09-19T06:22:41.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.477+0000 7feb0123d740 1 -- 172.21.15.2:0/2087600927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55defef54360 msgr2=0x55defef78110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:41.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.477+0000 7feb0123d740 1 --2- 172.21.15.2:0/2087600927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55defef54360 0x55defef78110 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x55defef5f920 tx=0x7feae4012bb0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.477+0000 7feb0123d740 1 -- 172.21.15.2:0/2087600927 shutdown_connections 2024-09-19T06:22:41.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.477+0000 7feb0123d740 1 --2- 172.21.15.2:0/2087600927 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55defef63150 0x55defef78650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.477+0000 7feb0123d740 1 --2- 172.21.15.2:0/2087600927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55defef54360 0x55defef78110 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.477+0000 7feb0123d740 1 --2- 172.21.15.2:0/2087600927 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55defef53a40 0x55defef61ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.477+0000 7feb0123d740 1 -- 172.21.15.2:0/2087600927 >> 172.21.15.2:0/2087600927 conn(0x55defef500f0 msgr2=0x55defef617e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:41.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.477+0000 7feb0123d740 1 -- 172.21.15.2:0/2087600927 shutdown_connections 2024-09-19T06:22:41.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.477+0000 7feb0123d740 1 -- 172.21.15.2:0/2087600927 wait complete. 2024-09-19T06:22:41.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.477+0000 7feb0123d740 1 -- start start 2024-09-19T06:22:41.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.477+0000 7feb0123d740 1 Processor -- start 2024-09-19T06:22:41.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.478+0000 7feb0123d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55defef53a40 0x55defef75f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:41.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.478+0000 7feb0123d740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55defef54360 0x55defef76460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:41.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.478+0000 7feb0123d740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55defef63150 0x55defef769a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:41.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.478+0000 7feb0123d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7feaf81a9ba0 con 0x55defef53a40 2024-09-19T06:22:41.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.478+0000 7feb0123d740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7feaf81ab010 con 0x55defef63150 2024-09-19T06:22:41.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.478+0000 7feb0123d740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7feaf81aa270 con 0x55defef54360 2024-09-19T06:22:41.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.478+0000 7feb0123d740 10 client.0 _ll_register_callbacks cb 0x7feaec005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:41.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.478+0000 7feafd401640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55defef53a40 0x55defef75f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:41.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.478+0000 7feafd401640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55defef53a40 0x55defef75f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44652/0 (socket says 172.21.15.2:44652) 2024-09-19T06:22:41.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.478+0000 7feafd401640 1 -- 172.21.15.2:0/3707426957 learned_addr learned my addr 172.21.15.2:0/3707426957 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:41.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.478+0000 7feaf7fff640 1 --2- 172.21.15.2:0/3707426957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55defef54360 0x55defef76460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:41.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.478+0000 7feafd401640 1 --2- 172.21.15.2:0/3707426957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55defef63150 0x55defef769a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:41.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.478+0000 7feafd401640 1 -- 172.21.15.2:0/3707426957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55defef54360 msgr2=0x55defef76460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:41.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.478+0000 7feafd401640 1 --2- 172.21.15.2:0/3707426957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55defef54360 0x55defef76460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.478+0000 7feafd401640 1 -- 172.21.15.2:0/3707426957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55defef63150 msgr2=0x55defef769a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:41.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.478+0000 7feafd401640 1 --2- 172.21.15.2:0/3707426957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55defef63150 0x55defef769a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.478+0000 7feafd401640 1 -- 172.21.15.2:0/3707426957 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55defefdc6c0 con 0x55defef53a40 2024-09-19T06:22:41.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.478+0000 7feafd401640 1 --2- 172.21.15.2:0/3707426957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55defef53a40 0x55defef75f20 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7feaf0009560 tx=0x7feaf00099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5191ce5030b9ed64 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:41.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.478+0000 7fead7fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:22:41.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.478+0000 7fead7fff640 1 -- 172.21.15.2:0/3707426957 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf0055040 con 0x55defef53a40 2024-09-19T06:22:41.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.478+0000 7fead7fff640 1 -- 172.21.15.2:0/3707426957 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7feaf00305a0 con 0x55defef53a40 2024-09-19T06:22:41.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.478+0000 7feb0123d740 1 -- 172.21.15.2:0/3707426957 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feae400f810 con 0x55defef53a40 2024-09-19T06:22:41.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.479+0000 7fead7fff640 1 -- 172.21.15.2:0/3707426957 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7feaf00041a0 con 0x55defef53a40 2024-09-19T06:22:41.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.479+0000 7feb0123d740 10 client.18141 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:41.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.479+0000 7feb0123d740 1 -- 172.21.15.2:0/3707426957 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55defefdd9e0 con 0x55defef53a40 2024-09-19T06:22:41.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.479+0000 7fead7fff640 1 -- 172.21.15.2:0/3707426957 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feae400f810 con 0x55defef53a40 2024-09-19T06:22:41.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.479+0000 7fead7fff640 1 -- 172.21.15.2:0/3707426957 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7feaf0030040 con 0x55defef53a40 2024-09-19T06:22:41.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.479+0000 7feb0123d740 10 client.18141 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:41.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.479+0000 7feb0123d740 10 client.18141 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:41.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.479+0000 7feb0123d740 20 client.18141 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:41.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.479+0000 7feb0123d740 1 --2- 172.21.15.2:0/3707426957 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55defef72d00 0x55defefe00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:41.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.479+0000 7feb0123d740 4 client.18141 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:22:41.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.479+0000 7feb0123d740 1 -- 172.21.15.2:0/3707426957 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55defeec0d00 con 0x55defef72d00 2024-09-19T06:22:41.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.479+0000 7feaf7fff640 1 --2- 172.21.15.2:0/3707426957 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55defef72d00 0x55defefe00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:41.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.480+0000 7feaf7fff640 1 --2- 172.21.15.2:0/3707426957 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55defef72d00 0x55defefe00c0 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18bf2ae07a33a16e server_cookie=5e6dc33576a0356c in_seq=0 out_seq=0 2024-09-19T06:22:41.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.480+0000 7fead7fff640 10 client.18141 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:41.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.481+0000 7fead7fff640 1 -- 172.21.15.2:0/3707426957 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55defeec0d00 con 0x55defef72d00 2024-09-19T06:22:41.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.481+0000 7fead7fff640 10 client.18141 handle_command_reply: tid=0 2024-09-19T06:22:41.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.481+0000 7feb0123d740 1 client.18141 shutdown 2024-09-19T06:22:41.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.481+0000 7feb0123d740 1 -- 172.21.15.2:0/3707426957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55defef53a40 msgr2=0x55defef75f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:41.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.481+0000 7feb0123d740 1 --2- 172.21.15.2:0/3707426957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55defef53a40 0x55defef75f20 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7feaf0009560 tx=0x7feaf00099c0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.481+0000 7feb0123d740 1 -- 172.21.15.2:0/3707426957 shutdown_connections 2024-09-19T06:22:41.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.481+0000 7feb0123d740 1 --2- 172.21.15.2:0/3707426957 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55defef72d00 0x55defefe00c0 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.481+0000 7feb0123d740 1 --2- 172.21.15.2:0/3707426957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55defef63150 0x55defef769a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.481+0000 7fead7fff640 0 client.18141 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:41.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.481+0000 7feb0123d740 1 --2- 172.21.15.2:0/3707426957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55defef54360 0x55defef76460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.481+0000 7feb0123d740 1 --2- 172.21.15.2:0/3707426957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55defef53a40 0x55defef75f20 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.481+0000 7feb0123d740 1 -- 172.21.15.2:0/3707426957 >> 172.21.15.2:0/3707426957 conn(0x55defef500f0 msgr2=0x55defef55d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:41.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.481+0000 7feb0123d740 1 -- 172.21.15.2:0/3707426957 shutdown_connections 2024-09-19T06:22:41.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.481+0000 7feb0123d740 1 -- 172.21.15.2:0/3707426957 wait complete. 2024-09-19T06:22:41.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.481+0000 7feb0123d740 20 client.18141 trim_cache size 0 max 16384 2024-09-19T06:22:41.488 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:22:41.488 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T06:22:41.489 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "2f376a5b-eeb9-45c0-9acf-407e69c6cb15", 2024-09-19T06:22:41.489 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T06:22:41.489 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:22:41.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.482+0000 7feafee64640 1 -- 172.21.15.2:0/3741450742 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7feae80a33b0 msgr2=0x7feae80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:41.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.482+0000 7feafee64640 1 --2- 172.21.15.2:0/3741450742 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7feae80a33b0 0x7feae80a5870 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7feaec0cd890 tx=0x7feaec091800 comp rx=0 tx=0).stop 2024-09-19T06:22:41.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.482+0000 7feafee64640 1 -- 172.21.15.2:0/3741450742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feaf8100a60 msgr2=0x7feaf8198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:41.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.482+0000 7feafee64640 1 --2- 172.21.15.2:0/3741450742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feaf8100a60 0x7feaf8198370 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7feaec00e9f0 tx=0x7feaec00edf0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.482+0000 7feafee64640 1 -- 172.21.15.2:0/3741450742 shutdown_connections 2024-09-19T06:22:41.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.482+0000 7feafee64640 1 --2- 172.21.15.2:0/3741450742 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7feae80a33b0 0x7feae80a5870 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.482+0000 7feafee64640 1 --2- 172.21.15.2:0/3741450742 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feaf8106a60 0x7feaf819cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.482+0000 7feafee64640 1 --2- 172.21.15.2:0/3741450742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feaf8101400 0x7feaf81988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.482+0000 7feafee64640 1 --2- 172.21.15.2:0/3741450742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feaf8100a60 0x7feaf8198370 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.482+0000 7feafee64640 1 -- 172.21.15.2:0/3741450742 >> 172.21.15.2:0/3741450742 conn(0x7feaf80fc780 msgr2=0x7feaf80fd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:41.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.482+0000 7feafee64640 1 -- 172.21.15.2:0/3741450742 shutdown_connections 2024-09-19T06:22:41.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:41.482+0000 7feafee64640 1 -- 172.21.15.2:0/3741450742 wait complete. 2024-09-19T06:22:41.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:41 smithi002 ceph-mon[30982]: pgmap v243: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:22:41.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:41 smithi090 ceph-mon[34497]: pgmap v243: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:22:41.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:41 smithi089 ceph-mon[34160]: pgmap v243: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:22:42.168 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:22:42.433 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:22:42.683 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:42 smithi002 ceph-mon[30982]: scrub queued for path: / 2024-09-19T06:22:42.683 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:42 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:22:42.684 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:42 smithi002 ceph-mon[30982]: scrub summary: active paths [/] 2024-09-19T06:22:42.684 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:42 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:22:42.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:42 smithi090 ceph-mon[34497]: scrub queued for path: / 2024-09-19T06:22:42.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:42 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:22:42.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:42 smithi090 ceph-mon[34497]: scrub summary: active paths [/] 2024-09-19T06:22:42.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:42 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:22:42.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:42 smithi089 ceph-mon[34160]: scrub queued for path: / 2024-09-19T06:22:42.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:42 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:22:42.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:42 smithi089 ceph-mon[34160]: scrub summary: active paths [/] 2024-09-19T06:22:42.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:42 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:22:42.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.875+0000 7fc7e91bc640 1 -- 172.21.15.2:0/2522780960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7e4102ef0 msgr2=0x7fc7e410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:42.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.875+0000 7fc7e91bc640 1 --2- 172.21.15.2:0/2522780960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7e4102ef0 0x7fc7e410da40 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4009ca0 tx=0x7fc7d402a950 comp rx=0 tx=0).stop 2024-09-19T06:22:42.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.875+0000 7fc7e91bc640 1 -- 172.21.15.2:0/2522780960 shutdown_connections 2024-09-19T06:22:42.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.875+0000 7fc7e91bc640 1 --2- 172.21.15.2:0/2522780960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7e4102ef0 0x7fc7e410da40 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:42.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.875+0000 7fc7e91bc640 1 --2- 172.21.15.2:0/2522780960 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7e4102570 0x7fc7e41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:42.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.875+0000 7fc7e91bc640 1 --2- 172.21.15.2:0/2522780960 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7e4100e20 0x7fc7e4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:42.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.875+0000 7fc7e91bc640 1 -- 172.21.15.2:0/2522780960 >> 172.21.15.2:0/2522780960 conn(0x7fc7e40fc7d0 msgr2=0x7fc7e40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:42.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.876+0000 7fc7e91bc640 1 -- 172.21.15.2:0/2522780960 shutdown_connections 2024-09-19T06:22:42.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.876+0000 7fc7e91bc640 1 -- 172.21.15.2:0/2522780960 wait complete. 2024-09-19T06:22:42.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.876+0000 7fc7e91bc640 1 Processor -- start 2024-09-19T06:22:42.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.876+0000 7fc7e91bc640 1 -- start start 2024-09-19T06:22:42.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.877+0000 7fc7e91bc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7e4100e20 0x7fc7e41992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:42.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.877+0000 7fc7e91bc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7e4102570 0x7fc7e4199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:42.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.877+0000 7fc7e91bc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7e4102ef0 0x7fc7e41a4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:42.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.877+0000 7fc7e91bc640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e4110e50 con 0x7fc7e4100e20 2024-09-19T06:22:42.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.877+0000 7fc7e91bc640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e4110cd0 con 0x7fc7e4102ef0 2024-09-19T06:22:42.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.877+0000 7fc7e91bc640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e4110fd0 con 0x7fc7e4102570 2024-09-19T06:22:42.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.877+0000 7fc7e2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7e4100e20 0x7fc7e41992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:42.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.877+0000 7fc7e2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7e4100e20 0x7fc7e41992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44666/0 (socket says 172.21.15.2:44666) 2024-09-19T06:22:42.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.877+0000 7fc7e2d9d640 1 -- 172.21.15.2:0/3954546624 learned_addr learned my addr 172.21.15.2:0/3954546624 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:42.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.877+0000 7fc7e259c640 1 --2- 172.21.15.2:0/3954546624 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7e4102570 0x7fc7e4199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:42.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.877+0000 7fc7e359e640 1 --2- 172.21.15.2:0/3954546624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7e4102ef0 0x7fc7e41a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:42.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.877+0000 7fc7e2d9d640 1 -- 172.21.15.2:0/3954546624 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7e4102570 msgr2=0x7fc7e4199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:42.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.877+0000 7fc7e2d9d640 1 --2- 172.21.15.2:0/3954546624 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7e4102570 0x7fc7e4199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:42.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.877+0000 7fc7e2d9d640 1 -- 172.21.15.2:0/3954546624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7e4102ef0 msgr2=0x7fc7e41a4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:42.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.877+0000 7fc7e2d9d640 1 --2- 172.21.15.2:0/3954546624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7e4102ef0 0x7fc7e41a4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:42.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.877+0000 7fc7e2d9d640 1 -- 172.21.15.2:0/3954546624 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7e41a48a0 con 0x7fc7e4100e20 2024-09-19T06:22:42.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.877+0000 7fc7e2d9d640 1 --2- 172.21.15.2:0/3954546624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7e4100e20 0x7fc7e41992e0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc00b4a0 tx=0x7fc7dc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:42.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.877+0000 7fc7dbfff640 1 -- 172.21.15.2:0/3954546624 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc014070 con 0x7fc7e4100e20 2024-09-19T06:22:42.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.878+0000 7fc7dbfff640 1 -- 172.21.15.2:0/3954546624 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc7dc010ac0 con 0x7fc7e4100e20 2024-09-19T06:22:42.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.878+0000 7fc7e91bc640 1 -- 172.21.15.2:0/3954546624 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7e41a4a70 con 0x7fc7e4100e20 2024-09-19T06:22:42.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.878+0000 7fc7dbfff640 1 -- 172.21.15.2:0/3954546624 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc017c30 con 0x7fc7e4100e20 2024-09-19T06:22:42.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.878+0000 7fc7e91bc640 1 -- 172.21.15.2:0/3954546624 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7e41a4f60 con 0x7fc7e4100e20 2024-09-19T06:22:42.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.881+0000 7fc7dbfff640 1 -- 172.21.15.2:0/3954546624 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fc7dc017070 con 0x7fc7e4100e20 2024-09-19T06:22:42.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.881+0000 7fc7eb595740 1 Processor -- start 2024-09-19T06:22:42.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.881+0000 7fc7eb595740 1 -- start start 2024-09-19T06:22:42.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.881+0000 7fc7eb595740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562192eb84a0 0x562192eb8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:42.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.881+0000 7fc7eb595740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562192eb8dc0 0x562192ec3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:42.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.881+0000 7fc7eb595740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562192ec3680 0x562192ec5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:42.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.881+0000 7fc7eb595740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562192e1e2e0 con 0x562192eb8dc0 2024-09-19T06:22:42.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.881+0000 7fc7eb595740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562192dc5ce0 con 0x562192ec3680 2024-09-19T06:22:42.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.881+0000 7fc7eb595740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562192e1a2a0 con 0x562192eb84a0 2024-09-19T06:22:42.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.881+0000 7fc7e2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562192eb8dc0 0x562192ec3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:42.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.881+0000 7fc7e2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562192eb8dc0 0x562192ec3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44676/0 (socket says 172.21.15.2:44676) 2024-09-19T06:22:42.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.881+0000 7fc7e2d9d640 1 -- 172.21.15.2:0/669273221 learned_addr learned my addr 172.21.15.2:0/669273221 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:42.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.881+0000 7fc7e359e640 1 --2- 172.21.15.2:0/669273221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562192eb84a0 0x562192eb8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:42.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.882+0000 7fc7e259c640 1 --2- 172.21.15.2:0/669273221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562192ec3680 0x562192ec5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:42.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.882+0000 7fc7e2d9d640 1 -- 172.21.15.2:0/669273221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562192eb84a0 msgr2=0x562192eb8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:42.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.882+0000 7fc7e2d9d640 1 --2- 172.21.15.2:0/669273221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562192eb84a0 0x562192eb8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:42.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.882+0000 7fc7e2d9d640 1 -- 172.21.15.2:0/669273221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562192ec3680 msgr2=0x562192ec5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:42.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.882+0000 7fc7e2d9d640 1 --2- 172.21.15.2:0/669273221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562192ec3680 0x562192ec5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:42.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.882+0000 7fc7e2d9d640 1 -- 172.21.15.2:0/669273221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562192daa440 con 0x562192eb8dc0 2024-09-19T06:22:42.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.882+0000 7fc7dbfff640 1 --2- 172.21.15.2:0/3954546624 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc7d00a33b0 0x7fc7d00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:42.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.882+0000 7fc7e2d9d640 1 --2- 172.21.15.2:0/669273221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562192eb8dc0 0x562192ec3140 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc0cc790 tx=0x7fc7dc0d76f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9c9bbf70f8319df server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:42.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.882+0000 7fc7e359e640 1 --2- 172.21.15.2:0/3954546624 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc7d00a33b0 0x7fc7d00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:42.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.882+0000 7fc7dbfff640 1 -- 172.21.15.2:0/3954546624 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7fc7dc0cefc0 con 0x7fc7e4100e20 2024-09-19T06:22:42.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.882+0000 7fc7d97fa640 1 -- 172.21.15.2:0/669273221 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc097650 con 0x562192eb8dc0 2024-09-19T06:22:42.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.882+0000 7fc7d97fa640 1 -- 172.21.15.2:0/669273221 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc7dc09bab0 con 0x562192eb8dc0 2024-09-19T06:22:42.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.882+0000 7fc7d97fa640 1 -- 172.21.15.2:0/669273221 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc09ad10 con 0x562192eb8dc0 2024-09-19T06:22:42.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.883+0000 7fc7eb595740 1 -- 172.21.15.2:0/669273221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562192eb8dc0 msgr2=0x562192ec3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:42.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.883+0000 7fc7e359e640 1 --2- 172.21.15.2:0/3954546624 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc7d00a33b0 0x7fc7d00a5870 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4009430 tx=0x7fc7d4009360 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:42.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.883+0000 7fc7eb595740 1 --2- 172.21.15.2:0/669273221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562192eb8dc0 0x562192ec3140 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc0cc790 tx=0x7fc7dc0d76f0 comp rx=0 tx=0).stop 2024-09-19T06:22:42.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.883+0000 7fc7eb595740 1 -- 172.21.15.2:0/669273221 shutdown_connections 2024-09-19T06:22:42.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.883+0000 7fc7eb595740 1 --2- 172.21.15.2:0/669273221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562192ec3680 0x562192ec5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:42.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.883+0000 7fc7eb595740 1 --2- 172.21.15.2:0/669273221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562192eb8dc0 0x562192ec3140 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:42.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.883+0000 7fc7eb595740 1 --2- 172.21.15.2:0/669273221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562192eb84a0 0x562192eb8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:42.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.883+0000 7fc7eb595740 1 -- 172.21.15.2:0/669273221 >> 172.21.15.2:0/669273221 conn(0x562192eb4a30 msgr2=0x562192eb4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:42.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.883+0000 7fc7eb595740 1 -- 172.21.15.2:0/669273221 shutdown_connections 2024-09-19T06:22:42.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.883+0000 7fc7eb595740 1 -- 172.21.15.2:0/669273221 wait complete. 2024-09-19T06:22:42.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.884+0000 7fc7eb595740 1 -- start start 2024-09-19T06:22:42.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.884+0000 7fc7eb595740 1 Processor -- start 2024-09-19T06:22:42.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.884+0000 7fc7eb595740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562192eb84a0 0x562192ec2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:42.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.884+0000 7fc7eb595740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562192eb8dc0 0x562192ec0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:42.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.884+0000 7fc7eb595740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562192ec3680 0x562192ec0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:42.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.884+0000 7fc7eb595740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562192ec6250 con 0x562192eb84a0 2024-09-19T06:22:42.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.884+0000 7fc7eb595740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562192dd9050 con 0x562192ec3680 2024-09-19T06:22:42.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.884+0000 7fc7eb595740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562192ec63d0 con 0x562192eb8dc0 2024-09-19T06:22:42.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.884+0000 7fc7eb595740 10 client.0 _ll_register_callbacks cb 0x562192e19160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:42.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.884+0000 7fc7e2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562192eb84a0 0x562192ec2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:42.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.884+0000 7fc7e2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562192eb84a0 0x562192ec2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44680/0 (socket says 172.21.15.2:44680) 2024-09-19T06:22:42.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.884+0000 7fc7e2d9d640 1 -- 172.21.15.2:0/496517681 learned_addr learned my addr 172.21.15.2:0/496517681 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:42.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.884+0000 7fc7e259c640 1 --2- 172.21.15.2:0/496517681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562192eb8dc0 0x562192ec0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:42.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.884+0000 7fc7e359e640 1 --2- 172.21.15.2:0/496517681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562192ec3680 0x562192ec0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:42.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.884+0000 7fc7e2d9d640 1 -- 172.21.15.2:0/496517681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562192eb8dc0 msgr2=0x562192ec0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:42.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.884+0000 7fc7e2d9d640 1 --2- 172.21.15.2:0/496517681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562192eb8dc0 0x562192ec0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:42.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.884+0000 7fc7e2d9d640 1 -- 172.21.15.2:0/496517681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562192ec3680 msgr2=0x562192ec0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:42.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.884+0000 7fc7e2d9d640 1 --2- 172.21.15.2:0/496517681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562192ec3680 0x562192ec0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:42.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.884+0000 7fc7e2d9d640 1 -- 172.21.15.2:0/496517681 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562192b8f3c0 con 0x562192eb84a0 2024-09-19T06:22:42.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.884+0000 7fc7e359e640 1 --2- 172.21.15.2:0/496517681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562192ec3680 0x562192ec0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:42.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.885+0000 7fc7e2d9d640 1 --2- 172.21.15.2:0/496517681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562192eb84a0 0x562192ec2f50 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc0ccd10 tx=0x7fc7dc0d2970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13c6645a3cb3a799 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:42.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.885+0000 7fc7ca7fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:22:42.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.885+0000 7fc7ca7fc640 1 -- 172.21.15.2:0/496517681 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc0cce60 con 0x562192eb84a0 2024-09-19T06:22:42.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.885+0000 7fc7ca7fc640 1 -- 172.21.15.2:0/496517681 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7fc7dc0b42b0 con 0x562192eb84a0 2024-09-19T06:22:42.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.885+0000 7fc7eb595740 1 -- 172.21.15.2:0/496517681 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7dc09bab0 con 0x562192eb84a0 2024-09-19T06:22:42.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.885+0000 7fc7ca7fc640 1 -- 172.21.15.2:0/496517681 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc7dc01e070 con 0x562192eb84a0 2024-09-19T06:22:42.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.885+0000 7fc7eb595740 10 client.18153 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:42.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.885+0000 7fc7eb595740 1 -- 172.21.15.2:0/496517681 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562192ec6250 con 0x562192eb84a0 2024-09-19T06:22:42.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.885+0000 7fc7ca7fc640 1 -- 172.21.15.2:0/496517681 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc7dc09bab0 con 0x562192eb84a0 2024-09-19T06:22:42.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.885+0000 7fc7ca7fc640 1 -- 172.21.15.2:0/496517681 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fc7dc097a20 con 0x562192eb84a0 2024-09-19T06:22:42.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.885+0000 7fc7eb595740 10 client.18153 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:42.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.885+0000 7fc7eb595740 10 client.18153 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:42.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.885+0000 7fc7eb595740 20 client.18153 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:42.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.885+0000 7fc7eb595740 1 --2- 172.21.15.2:0/496517681 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562192ed2d50 0x562192ed5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:42.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.885+0000 7fc7eb595740 4 client.18153 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:22:42.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.885+0000 7fc7eb595740 1 -- 172.21.15.2:0/496517681 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562192e2b850 con 0x562192ed2d50 2024-09-19T06:22:42.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.886+0000 7fc7e259c640 1 --2- 172.21.15.2:0/496517681 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562192ed2d50 0x562192ed5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:42.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.886+0000 7fc7e259c640 1 --2- 172.21.15.2:0/496517681 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562192ed2d50 0x562192ed5140 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=345b580b60760ed4 server_cookie=f8384bc30f0e801d in_seq=0 out_seq=0 2024-09-19T06:22:42.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.886+0000 7fc7ca7fc640 10 client.18153 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:42.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.887+0000 7fc7ca7fc640 1 -- 172.21.15.2:0/496517681 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562192e2b850 con 0x562192ed2d50 2024-09-19T06:22:42.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.887+0000 7fc7ca7fc640 10 client.18153 handle_command_reply: tid=0 2024-09-19T06:22:42.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.887+0000 7fc7eb595740 1 client.18153 shutdown 2024-09-19T06:22:42.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.887+0000 7fc7eb595740 1 -- 172.21.15.2:0/496517681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562192eb84a0 msgr2=0x562192ec2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:42.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.887+0000 7fc7eb595740 1 --2- 172.21.15.2:0/496517681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562192eb84a0 0x562192ec2f50 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc0ccd10 tx=0x7fc7dc0d2970 comp rx=0 tx=0).stop 2024-09-19T06:22:42.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.887+0000 7fc7eb595740 1 -- 172.21.15.2:0/496517681 shutdown_connections 2024-09-19T06:22:42.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.887+0000 7fc7eb595740 1 --2- 172.21.15.2:0/496517681 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562192ed2d50 0x562192ed5140 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:42.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.887+0000 7fc7eb595740 1 --2- 172.21.15.2:0/496517681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562192ec3680 0x562192ec0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:42.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.887+0000 7fc7eb595740 1 --2- 172.21.15.2:0/496517681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562192eb8dc0 0x562192ec0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:42.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.887+0000 7fc7eb595740 1 --2- 172.21.15.2:0/496517681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562192eb84a0 0x562192ec2f50 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:42.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.887+0000 7fc7eb595740 1 -- 172.21.15.2:0/496517681 >> 172.21.15.2:0/496517681 conn(0x562192eb4a30 msgr2=0x562192eba710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:42.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.887+0000 7fc7ca7fc640 0 client.18153 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:42.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.887+0000 7fc7eb595740 1 -- 172.21.15.2:0/496517681 shutdown_connections 2024-09-19T06:22:42.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.887+0000 7fc7eb595740 1 -- 172.21.15.2:0/496517681 wait complete. 2024-09-19T06:22:42.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.887+0000 7fc7eb595740 20 client.18153 trim_cache size 0 max 16384 2024-09-19T06:22:42.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.905+0000 7fc7eb595740 1 Processor -- start 2024-09-19T06:22:42.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.905+0000 7fc7eb595740 1 -- start start 2024-09-19T06:22:42.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.905+0000 7fc7eb595740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562192eb84a0 0x562192ebead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:42.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.905+0000 7fc7eb595740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562192eb8dc0 0x562192eda7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:42.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.905+0000 7fc7eb595740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562192ec3680 0x562192edace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:42.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.905+0000 7fc7eb595740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e41b00f0 con 0x562192eb84a0 2024-09-19T06:22:42.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.905+0000 7fc7eb595740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e41ad9c0 con 0x562192eb8dc0 2024-09-19T06:22:42.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.905+0000 7fc7eb595740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e41ab830 con 0x562192ec3680 2024-09-19T06:22:42.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.905+0000 7fc7e2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562192eb84a0 0x562192ebead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:42.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.905+0000 7fc7e2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562192eb84a0 0x562192ebead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44690/0 (socket says 172.21.15.2:44690) 2024-09-19T06:22:42.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.905+0000 7fc7e2d9d640 1 -- 172.21.15.2:0/3375694850 learned_addr learned my addr 172.21.15.2:0/3375694850 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:42.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.905+0000 7fc7e359e640 1 --2- 172.21.15.2:0/3375694850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562192ec3680 0x562192edace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:42.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.905+0000 7fc7e2d9d640 1 -- 172.21.15.2:0/3375694850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562192ec3680 msgr2=0x562192edace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:42.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.905+0000 7fc7e259c640 1 --2- 172.21.15.2:0/3375694850 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562192eb8dc0 0x562192eda7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:42.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.905+0000 7fc7e2d9d640 1 --2- 172.21.15.2:0/3375694850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562192ec3680 0x562192edace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:42.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.905+0000 7fc7e2d9d640 1 -- 172.21.15.2:0/3375694850 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562192eb8dc0 msgr2=0x562192eda7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:42.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.905+0000 7fc7e2d9d640 1 --2- 172.21.15.2:0/3375694850 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562192eb8dc0 0x562192eda7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:42.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.905+0000 7fc7e2d9d640 1 -- 172.21.15.2:0/3375694850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562192eb8bf0 con 0x562192eb84a0 2024-09-19T06:22:42.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.905+0000 7fc7e259c640 1 --2- 172.21.15.2:0/3375694850 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562192eb8dc0 0x562192eda7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:22:42.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.906+0000 7fc7e2d9d640 1 --2- 172.21.15.2:0/3375694850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562192eb84a0 0x562192ebead0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc00b470 tx=0x7fc7dc0d76f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36ea5a23cbdf3609 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:42.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.906+0000 7fc7d8ff9640 1 -- 172.21.15.2:0/3375694850 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc0cce60 con 0x562192eb84a0 2024-09-19T06:22:42.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.906+0000 7fc7d8ff9640 1 -- 172.21.15.2:0/3375694850 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc7dc0a4020 con 0x562192eb84a0 2024-09-19T06:22:42.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.906+0000 7fc7d8ff9640 1 -- 172.21.15.2:0/3375694850 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc09aef0 con 0x562192eb84a0 2024-09-19T06:22:42.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.907+0000 7fc7eb595740 1 -- 172.21.15.2:0/3375694850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562192eb84a0 msgr2=0x562192ebead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:42.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.907+0000 7fc7eb595740 1 --2- 172.21.15.2:0/3375694850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562192eb84a0 0x562192ebead0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc00b470 tx=0x7fc7dc0d76f0 comp rx=0 tx=0).stop 2024-09-19T06:22:42.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.907+0000 7fc7eb595740 1 -- 172.21.15.2:0/3375694850 shutdown_connections 2024-09-19T06:22:42.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.907+0000 7fc7eb595740 1 --2- 172.21.15.2:0/3375694850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562192ec3680 0x562192edace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:42.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.907+0000 7fc7eb595740 1 --2- 172.21.15.2:0/3375694850 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562192eb8dc0 0x562192eda7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:42.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.907+0000 7fc7eb595740 1 --2- 172.21.15.2:0/3375694850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562192eb84a0 0x562192ebead0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:42.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.907+0000 7fc7eb595740 1 -- 172.21.15.2:0/3375694850 >> 172.21.15.2:0/3375694850 conn(0x562192eb4a30 msgr2=0x562192eb3b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:42.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.907+0000 7fc7eb595740 1 -- 172.21.15.2:0/3375694850 shutdown_connections 2024-09-19T06:22:42.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.907+0000 7fc7eb595740 1 -- 172.21.15.2:0/3375694850 wait complete. 2024-09-19T06:22:42.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.907+0000 7fc7eb595740 1 -- start start 2024-09-19T06:22:42.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.907+0000 7fc7eb595740 1 Processor -- start 2024-09-19T06:22:42.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.907+0000 7fc7eb595740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562192eb84a0 0x562192ecbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:42.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.907+0000 7fc7eb595740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562192eb8dc0 0x562192ec9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:42.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.907+0000 7fc7eb595740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562192ec3680 0x562192ec96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:42.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.907+0000 7fc7eb595740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e41abe80 con 0x562192eb8dc0 2024-09-19T06:22:42.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.907+0000 7fc7eb595740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e41ad2f0 con 0x562192ec3680 2024-09-19T06:22:42.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.907+0000 7fc7eb595740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e41ac550 con 0x562192eb84a0 2024-09-19T06:22:42.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.907+0000 7fc7eb595740 10 client.0 _ll_register_callbacks cb 0x7fc7d4009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:42.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.908+0000 7fc7e259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562192eb8dc0 0x562192ec9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:42.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.908+0000 7fc7e359e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562192ec3680 0x562192ec96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:42.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.908+0000 7fc7e259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562192eb8dc0 0x562192ec9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44700/0 (socket says 172.21.15.2:44700) 2024-09-19T06:22:42.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.908+0000 7fc7e259c640 1 -- 172.21.15.2:0/2599123389 learned_addr learned my addr 172.21.15.2:0/2599123389 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:22:42.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.908+0000 7fc7e2d9d640 1 --2- 172.21.15.2:0/2599123389 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562192eb84a0 0x562192ecbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:42.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.908+0000 7fc7e259c640 1 -- 172.21.15.2:0/2599123389 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562192eb84a0 msgr2=0x562192ecbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:42.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.908+0000 7fc7e259c640 1 --2- 172.21.15.2:0/2599123389 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562192eb84a0 0x562192ecbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:42.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.908+0000 7fc7e259c640 1 -- 172.21.15.2:0/2599123389 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562192ec3680 msgr2=0x562192ec96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:42.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.908+0000 7fc7e259c640 1 --2- 172.21.15.2:0/2599123389 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562192ec3680 0x562192ec96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:42.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.908+0000 7fc7e259c640 1 -- 172.21.15.2:0/2599123389 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562192ec9f00 con 0x562192eb8dc0 2024-09-19T06:22:42.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.908+0000 7fc7e2d9d640 1 --2- 172.21.15.2:0/2599123389 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562192eb84a0 0x562192ecbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:42.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.908+0000 7fc7e359e640 1 --2- 172.21.15.2:0/2599123389 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562192ec3680 0x562192ec96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:42.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.908+0000 7fc7e259c640 1 --2- 172.21.15.2:0/2599123389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562192eb8dc0 0x562192ec9190 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc000c00 tx=0x7fc7cc00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea1937c512d7b035 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:42.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.908+0000 7fc7ca7fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:22:42.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.908+0000 7fc7ca7fc640 1 -- 172.21.15.2:0/2599123389 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc01d470 con 0x562192eb8dc0 2024-09-19T06:22:42.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.908+0000 7fc7ca7fc640 1 -- 172.21.15.2:0/2599123389 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8521+0+0 (secure 0 0 0) 0x7fc7cc01d610 con 0x562192eb8dc0 2024-09-19T06:22:42.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.908+0000 7fc7eb595740 1 -- 172.21.15.2:0/2599123389 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7dc0a4020 con 0x562192eb8dc0 2024-09-19T06:22:42.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.909+0000 7fc7ca7fc640 1 -- 172.21.15.2:0/2599123389 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc7cc02d050 con 0x562192eb8dc0 2024-09-19T06:22:42.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.909+0000 7fc7eb595740 10 client.18159 fetch_fsmap learned FSMap version 26 2024-09-19T06:22:42.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.909+0000 7fc7eb595740 1 -- 172.21.15.2:0/2599123389 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562192f3d7c0 con 0x562192eb8dc0 2024-09-19T06:22:42.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.909+0000 7fc7ca7fc640 1 -- 172.21.15.2:0/2599123389 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc7dc0a4020 con 0x562192eb8dc0 2024-09-19T06:22:42.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.909+0000 7fc7ca7fc640 1 -- 172.21.15.2:0/2599123389 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fc7cc0119f0 con 0x562192eb8dc0 2024-09-19T06:22:42.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.909+0000 7fc7eb595740 10 client.18159 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:22:42.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.909+0000 7fc7eb595740 10 client.18159 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:42.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.909+0000 7fc7eb595740 20 client.18159 populate_metadata read hostname 'smithi002' 2024-09-19T06:22:42.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.909+0000 7fc7eb595740 1 --2- 172.21.15.2:0/2599123389 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562192f3def0 0x562192f40310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:42.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.909+0000 7fc7eb595740 4 client.18159 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:22:42.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.909+0000 7fc7eb595740 1 -- 172.21.15.2:0/2599123389 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562192ec0ad0 con 0x562192f3def0 2024-09-19T06:22:42.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.909+0000 7fc7e2d9d640 1 --2- 172.21.15.2:0/2599123389 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562192f3def0 0x562192f40310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:42.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.910+0000 7fc7ca7fc640 10 client.18159 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:42.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.910+0000 7fc7e2d9d640 1 --2- 172.21.15.2:0/2599123389 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562192f3def0 0x562192f40310 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13edef0b041a1046 server_cookie=d284db7256b66f07 in_seq=0 out_seq=0 2024-09-19T06:22:42.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.910+0000 7fc7ca7fc640 1 -- 172.21.15.2:0/2599123389 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x562192ec0ad0 con 0x562192f3def0 2024-09-19T06:22:42.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.910+0000 7fc7ca7fc640 10 client.18159 handle_command_reply: tid=0 2024-09-19T06:22:42.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.910+0000 7fc7eb595740 1 client.18159 shutdown 2024-09-19T06:22:42.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.910+0000 7fc7eb595740 1 -- 172.21.15.2:0/2599123389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562192eb8dc0 msgr2=0x562192ec9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:42.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.910+0000 7fc7eb595740 1 --2- 172.21.15.2:0/2599123389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562192eb8dc0 0x562192ec9190 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc000c00 tx=0x7fc7cc00be20 comp rx=0 tx=0).stop 2024-09-19T06:22:42.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.910+0000 7fc7eb595740 1 -- 172.21.15.2:0/2599123389 shutdown_connections 2024-09-19T06:22:42.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.910+0000 7fc7eb595740 1 --2- 172.21.15.2:0/2599123389 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562192f3def0 0x562192f40310 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:42.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.910+0000 7fc7eb595740 1 --2- 172.21.15.2:0/2599123389 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562192ec3680 0x562192ec96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:42.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.910+0000 7fc7eb595740 1 --2- 172.21.15.2:0/2599123389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562192eb8dc0 0x562192ec9190 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:42.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.910+0000 7fc7ca7fc640 0 client.18159 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:22:42.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.910+0000 7fc7eb595740 1 --2- 172.21.15.2:0/2599123389 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562192eb84a0 0x562192ecbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:42.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.910+0000 7fc7eb595740 1 -- 172.21.15.2:0/2599123389 >> 172.21.15.2:0/2599123389 conn(0x562192eb4a30 msgr2=0x562192ec1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:42.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.910+0000 7fc7eb595740 1 -- 172.21.15.2:0/2599123389 shutdown_connections 2024-09-19T06:22:42.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.910+0000 7fc7eb595740 1 -- 172.21.15.2:0/2599123389 wait complete. 2024-09-19T06:22:42.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.910+0000 7fc7eb595740 20 client.18159 trim_cache size 0 max 16384 2024-09-19T06:22:42.918 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:22:42.918 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:22:42.918 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-19T06:22:42.918 INFO:teuthology.orchestra.run.smithi002.stdout: "2f376a5b-eeb9-45c0-9acf-407e69c6cb15": { 2024-09-19T06:22:42.918 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-19T06:22:42.918 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "2f376a5b-eeb9-45c0-9acf-407e69c6cb15", 2024-09-19T06:22:42.918 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-19T06:22:42.918 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:22:42.918 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:22:42.919 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:22:42.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.911+0000 7fc7e91bc640 1 -- 172.21.15.2:0/3954546624 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc7d00a33b0 msgr2=0x7fc7d00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:42.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.911+0000 7fc7e91bc640 1 --2- 172.21.15.2:0/3954546624 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc7d00a33b0 0x7fc7d00a5870 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4009430 tx=0x7fc7d4009360 comp rx=0 tx=0).stop 2024-09-19T06:22:42.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.911+0000 7fc7e91bc640 1 -- 172.21.15.2:0/3954546624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7e4100e20 msgr2=0x7fc7e41992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:42.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.911+0000 7fc7e91bc640 1 --2- 172.21.15.2:0/3954546624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7e4100e20 0x7fc7e41992e0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc00b4a0 tx=0x7fc7dc00b960 comp rx=0 tx=0).stop 2024-09-19T06:22:42.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.911+0000 7fc7e91bc640 1 -- 172.21.15.2:0/3954546624 shutdown_connections 2024-09-19T06:22:42.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.911+0000 7fc7e91bc640 1 --2- 172.21.15.2:0/3954546624 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc7d00a33b0 0x7fc7d00a5870 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:42.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.911+0000 7fc7e91bc640 1 --2- 172.21.15.2:0/3954546624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7e4102ef0 0x7fc7e41a4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:42.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.911+0000 7fc7e91bc640 1 --2- 172.21.15.2:0/3954546624 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7e4102570 0x7fc7e4199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:42.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.911+0000 7fc7e91bc640 1 --2- 172.21.15.2:0/3954546624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7e4100e20 0x7fc7e41992e0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:42.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.911+0000 7fc7e91bc640 1 -- 172.21.15.2:0/3954546624 >> 172.21.15.2:0/3954546624 conn(0x7fc7e40fc7d0 msgr2=0x7fc7e40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:42.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.911+0000 7fc7e91bc640 1 -- 172.21.15.2:0/3954546624 shutdown_connections 2024-09-19T06:22:42.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:22:42.911+0000 7fc7e91bc640 1 -- 172.21.15.2:0/3954546624 wait complete. 2024-09-19T06:22:43.658 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:43 smithi002 ceph-mon[30982]: pgmap v244: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:22:43.658 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:43 smithi002 ceph-mon[30982]: scrub summary: idle 2024-09-19T06:22:43.690 INFO:tasks.cephfs.filesystem:scrub status for tag:2f376a5b-eeb9-45c0-9acf-407e69c6cb15 - {'path': '/', 'tag': '2f376a5b-eeb9-45c0-9acf-407e69c6cb15', 'options': 'recursive,force'} 2024-09-19T06:22:43.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:43 smithi090 ceph-mon[34497]: pgmap v244: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:22:43.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:43 smithi090 ceph-mon[34497]: scrub summary: idle 2024-09-19T06:22:43.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:43 smithi089 ceph-mon[34160]: pgmap v244: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:22:43.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:43 smithi089 ceph-mon[34160]: scrub summary: idle 2024-09-19T06:22:45.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:45 smithi002 ceph-mon[30982]: pgmap v245: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2024-09-19T06:22:45.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:45 smithi090 ceph-mon[34497]: pgmap v245: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2024-09-19T06:22:45.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:45 smithi089 ceph-mon[34160]: pgmap v245: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2024-09-19T06:22:47.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:47 smithi002 ceph-mon[30982]: pgmap v246: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:22:47.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:47 smithi090 ceph-mon[34497]: pgmap v246: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:22:47.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:47 smithi089 ceph-mon[34160]: pgmap v246: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:22:49.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:49 smithi002 ceph-mon[30982]: pgmap v247: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:22:49.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:49 smithi090 ceph-mon[34497]: pgmap v247: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:22:49.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:49 smithi089 ceph-mon[34160]: pgmap v247: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:22:51.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:51 smithi002 ceph-mon[30982]: pgmap v248: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:22:51.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:51 smithi090 ceph-mon[34497]: pgmap v248: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:22:51.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:51 smithi089 ceph-mon[34160]: pgmap v248: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:22:53.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:53 smithi002 ceph-mon[30982]: pgmap v249: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:22:53.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:53 smithi090 ceph-mon[34497]: pgmap v249: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:22:53.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:53 smithi089 ceph-mon[34160]: pgmap v249: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:22:55.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:55 smithi002 ceph-mon[30982]: pgmap v250: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:22:55.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:55 smithi090 ceph-mon[34497]: pgmap v250: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:22:55.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:55 smithi089 ceph-mon[34160]: pgmap v250: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:22:57.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:57 smithi002 ceph-mon[30982]: pgmap v251: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:22:57.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:57 smithi090 ceph-mon[34497]: pgmap v251: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:22:57.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:57 smithi089 ceph-mon[34160]: pgmap v251: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:22:59.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:22:59 smithi002 ceph-mon[30982]: pgmap v252: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:22:59.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:22:59 smithi090 ceph-mon[34497]: pgmap v252: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:22:59.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:22:59 smithi089 ceph-mon[34160]: pgmap v252: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:23:01.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:01 smithi002 ceph-mon[30982]: pgmap v253: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:23:01.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:01 smithi090 ceph-mon[34497]: pgmap v253: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:23:01.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:01 smithi089 ceph-mon[34160]: pgmap v253: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:23:03.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:03 smithi002 ceph-mon[30982]: pgmap v254: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:23:03.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:03 smithi090 ceph-mon[34497]: pgmap v254: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:23:03.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:03 smithi089 ceph-mon[34160]: pgmap v254: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:23:04.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:04 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:23:04.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:04 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:23:04.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:04 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:23:05.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:05 smithi002 ceph-mon[30982]: pgmap v255: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T06:23:05.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:05 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:23:05.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:05 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:23:05.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:05 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:23:05.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:05 smithi090 ceph-mon[34497]: pgmap v255: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T06:23:05.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:05 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:23:05.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:05 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:23:05.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:05 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:23:05.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:05 smithi089 ceph-mon[34160]: pgmap v255: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T06:23:05.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:05 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:23:05.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:05 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:23:05.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:05 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:23:07.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:07 smithi002 ceph-mon[30982]: pgmap v256: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T06:23:07.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:07 smithi090 ceph-mon[34497]: pgmap v256: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T06:23:07.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:07 smithi089 ceph-mon[34160]: pgmap v256: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T06:23:09.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:09 smithi002 ceph-mon[30982]: pgmap v257: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T06:23:09.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:09 smithi002 ceph-mon[30982]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T06:23:09.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:09 smithi090 ceph-mon[34497]: pgmap v257: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T06:23:09.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:09 smithi090 ceph-mon[34497]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T06:23:09.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:09 smithi089 ceph-mon[34160]: pgmap v257: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T06:23:09.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:09 smithi089 ceph-mon[34160]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T06:23:11.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:11 smithi002 ceph-mon[30982]: pgmap v259: 97 pgs: 97 active+clean; 1.9 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T06:23:11.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:11 smithi090 ceph-mon[34497]: pgmap v259: 97 pgs: 97 active+clean; 1.9 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T06:23:11.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:11 smithi089 ceph-mon[34160]: pgmap v259: 97 pgs: 97 active+clean; 1.9 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T06:23:13.692 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:23:13.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:13 smithi090 ceph-mon[34497]: pgmap v260: 97 pgs: 97 active+clean; 1.9 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T06:23:13.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:13 smithi090 ceph-mon[34497]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T06:23:13.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:13 smithi089 ceph-mon[34160]: pgmap v260: 97 pgs: 97 active+clean; 1.9 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T06:23:13.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:13 smithi089 ceph-mon[34160]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T06:23:13.965 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:23:13.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:13 smithi002 ceph-mon[30982]: pgmap v260: 97 pgs: 97 active+clean; 1.9 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T06:23:13.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:13 smithi002 ceph-mon[30982]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T06:23:14.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.436+0000 7f3336ca7640 1 -- 172.21.15.2:0/1239100244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3330101de0 msgr2=0x7f33301021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:14.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.436+0000 7f3336ca7640 1 --2- 172.21.15.2:0/1239100244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3330101de0 0x7f33301021c0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f332c009900 tx=0x7f332c02a3f0 comp rx=0 tx=0).stop 2024-09-19T06:23:14.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.436+0000 7f3336ca7640 1 -- 172.21.15.2:0/1239100244 shutdown_connections 2024-09-19T06:23:14.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.436+0000 7f3336ca7640 1 --2- 172.21.15.2:0/1239100244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3330106f10 0x7f333010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:14.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.436+0000 7f3336ca7640 1 --2- 172.21.15.2:0/1239100244 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3330102790 0x7f33301067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:14.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.436+0000 7f3336ca7640 1 --2- 172.21.15.2:0/1239100244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3330101de0 0x7f33301021c0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:14.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.436+0000 7f3336ca7640 1 -- 172.21.15.2:0/1239100244 >> 172.21.15.2:0/1239100244 conn(0x7f33300fd8c0 msgr2=0x7f33300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:14.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.436+0000 7f3336ca7640 1 -- 172.21.15.2:0/1239100244 shutdown_connections 2024-09-19T06:23:14.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.436+0000 7f3336ca7640 1 -- 172.21.15.2:0/1239100244 wait complete. 2024-09-19T06:23:14.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.437+0000 7f3336ca7640 1 Processor -- start 2024-09-19T06:23:14.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.437+0000 7f3336ca7640 1 -- start start 2024-09-19T06:23:14.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.437+0000 7f3336ca7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3330101de0 0x7f3330198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:14.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.437+0000 7f3336ca7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3330102790 0x7f3330198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:14.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.437+0000 7f3336ca7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3330106f10 0x7f333019cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:14.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.437+0000 7f3336ca7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3330111e30 con 0x7f3330102790 2024-09-19T06:23:14.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.437+0000 7f3336ca7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3330111cb0 con 0x7f3330106f10 2024-09-19T06:23:14.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.437+0000 7f3336ca7640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3330111fb0 con 0x7f3330101de0 2024-09-19T06:23:14.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.437+0000 7f3327fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3330102790 0x7f3330198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:14.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.437+0000 7f3327fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3330102790 0x7f3330198850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46976/0 (socket says 172.21.15.2:46976) 2024-09-19T06:23:14.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.437+0000 7f3327fff640 1 -- 172.21.15.2:0/3887647703 learned_addr learned my addr 172.21.15.2:0/3887647703 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:14.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.437+0000 7f3335244640 1 --2- 172.21.15.2:0/3887647703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3330106f10 0x7f333019cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:14.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.437+0000 7f3334a43640 1 --2- 172.21.15.2:0/3887647703 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3330101de0 0x7f3330198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:14.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.437+0000 7f3327fff640 1 -- 172.21.15.2:0/3887647703 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3330101de0 msgr2=0x7f3330198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:14.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.437+0000 7f3327fff640 1 --2- 172.21.15.2:0/3887647703 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3330101de0 0x7f3330198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:14.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.437+0000 7f3327fff640 1 -- 172.21.15.2:0/3887647703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3330106f10 msgr2=0x7f333019cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:14.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.437+0000 7f3327fff640 1 --2- 172.21.15.2:0/3887647703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3330106f10 0x7f333019cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:14.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.437+0000 7f3327fff640 1 -- 172.21.15.2:0/3887647703 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f333019d2c0 con 0x7f3330102790 2024-09-19T06:23:14.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.437+0000 7f3334a43640 1 --2- 172.21.15.2:0/3887647703 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3330101de0 0x7f3330198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:14.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.438+0000 7f3327fff640 1 --2- 172.21.15.2:0/3887647703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3330102790 0x7f3330198850 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f332000c920 tx=0x7f332000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:14.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.438+0000 7f3325ffb640 1 -- 172.21.15.2:0/3887647703 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3320007c70 con 0x7f3330102790 2024-09-19T06:23:14.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.438+0000 7f3325ffb640 1 -- 172.21.15.2:0/3887647703 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3320007e10 con 0x7f3330102790 2024-09-19T06:23:14.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.438+0000 7f3336ca7640 1 -- 172.21.15.2:0/3887647703 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f333019d5b0 con 0x7f3330102790 2024-09-19T06:23:14.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.438+0000 7f3325ffb640 1 -- 172.21.15.2:0/3887647703 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3320018820 con 0x7f3330102790 2024-09-19T06:23:14.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.438+0000 7f3336ca7640 1 -- 172.21.15.2:0/3887647703 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33301a4e90 con 0x7f3330102790 2024-09-19T06:23:14.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.440+0000 7f3325ffb640 1 -- 172.21.15.2:0/3887647703 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f33200189c0 con 0x7f3330102790 2024-09-19T06:23:14.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.441+0000 7f3339080740 1 Processor -- start 2024-09-19T06:23:14.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.441+0000 7f3339080740 1 -- start start 2024-09-19T06:23:14.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.441+0000 7f3339080740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b6f36234a0 0x55b6f3623880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:14.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.441+0000 7f3339080740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b6f3623dc0 0x55b6f362e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:14.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.441+0000 7f3339080740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6f362e680 0x55b6f3630a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:14.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.441+0000 7f3339080740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b6f35892e0 con 0x55b6f362e680 2024-09-19T06:23:14.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.441+0000 7f3339080740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55b6f3530ce0 con 0x55b6f3623dc0 2024-09-19T06:23:14.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.441+0000 7f3339080740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55b6f35852a0 con 0x55b6f36234a0 2024-09-19T06:23:14.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.441+0000 7f3327fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6f362e680 0x55b6f3630a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:14.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.441+0000 7f3327fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6f362e680 0x55b6f3630a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46990/0 (socket says 172.21.15.2:46990) 2024-09-19T06:23:14.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.441+0000 7f3325ffb640 1 --2- 172.21.15.2:0/3887647703 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f33180a33b0 0x7f33180a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:14.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.441+0000 7f3327fff640 1 -- 172.21.15.2:0/846135037 learned_addr learned my addr 172.21.15.2:0/846135037 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:14.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.441+0000 7f3335244640 1 --2- 172.21.15.2:0/846135037 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b6f36234a0 0x55b6f3623880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:14.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.441+0000 7f3334a43640 1 --2- 172.21.15.2:0/846135037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b6f3623dc0 0x55b6f362e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:14.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.442+0000 7f3335244640 1 --2- 172.21.15.2:0/3887647703 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f33180a33b0 0x7f33180a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:14.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.442+0000 7f3325ffb640 1 -- 172.21.15.2:0/3887647703 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f33200cfeb0 con 0x7f3330102790 2024-09-19T06:23:14.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.442+0000 7f3327fff640 1 -- 172.21.15.2:0/846135037 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b6f36234a0 msgr2=0x55b6f3623880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:14.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.442+0000 7f3327fff640 1 --2- 172.21.15.2:0/846135037 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b6f36234a0 0x55b6f3623880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:14.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.442+0000 7f3327fff640 1 -- 172.21.15.2:0/846135037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b6f3623dc0 msgr2=0x55b6f362e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:14.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.442+0000 7f3327fff640 1 --2- 172.21.15.2:0/846135037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b6f3623dc0 0x55b6f362e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:14.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.442+0000 7f3327fff640 1 -- 172.21.15.2:0/846135037 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6f3515440 con 0x55b6f362e680 2024-09-19T06:23:14.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.442+0000 7f3334a43640 1 --2- 172.21.15.2:0/846135037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b6f3623dc0 0x55b6f362e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:23:14.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.442+0000 7f3327fff640 1 --2- 172.21.15.2:0/846135037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6f362e680 0x55b6f3630a70 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f332009c0c0 tx=0x7f3320000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a8ccefe7aa1d704 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:14.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.442+0000 7f3335244640 1 --2- 172.21.15.2:0/3887647703 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f33180a33b0 0x7f33180a5870 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3328005fd0 tx=0x7f3328004ab0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:14.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.442+0000 7f3316ffd640 1 -- 172.21.15.2:0/846135037 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332009c830 con 0x55b6f362e680 2024-09-19T06:23:14.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.442+0000 7f3316ffd640 1 -- 172.21.15.2:0/846135037 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f332009c130 con 0x55b6f362e680 2024-09-19T06:23:14.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.442+0000 7f3316ffd640 1 -- 172.21.15.2:0/846135037 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33200a0120 con 0x55b6f362e680 2024-09-19T06:23:14.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.443+0000 7f3339080740 1 -- 172.21.15.2:0/846135037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6f362e680 msgr2=0x55b6f3630a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:14.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.443+0000 7f3339080740 1 --2- 172.21.15.2:0/846135037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6f362e680 0x55b6f3630a70 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f332009c0c0 tx=0x7f3320000bc0 comp rx=0 tx=0).stop 2024-09-19T06:23:14.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.443+0000 7f3339080740 1 -- 172.21.15.2:0/846135037 shutdown_connections 2024-09-19T06:23:14.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.443+0000 7f3339080740 1 --2- 172.21.15.2:0/846135037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6f362e680 0x55b6f3630a70 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:14.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.443+0000 7f3339080740 1 --2- 172.21.15.2:0/846135037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b6f3623dc0 0x55b6f362e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:14.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.443+0000 7f3339080740 1 --2- 172.21.15.2:0/846135037 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b6f36234a0 0x55b6f3623880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:14.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.443+0000 7f3339080740 1 -- 172.21.15.2:0/846135037 >> 172.21.15.2:0/846135037 conn(0x55b6f361fa30 msgr2=0x55b6f361fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:14.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.443+0000 7f3339080740 1 -- 172.21.15.2:0/846135037 shutdown_connections 2024-09-19T06:23:14.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.443+0000 7f3339080740 1 -- 172.21.15.2:0/846135037 wait complete. 2024-09-19T06:23:14.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.443+0000 7f3339080740 1 -- start start 2024-09-19T06:23:14.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.443+0000 7f3339080740 1 Processor -- start 2024-09-19T06:23:14.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.444+0000 7f3339080740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b6f36234a0 0x55b6f362dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:14.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.444+0000 7f3339080740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6f3623dc0 0x55b6f362b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:14.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.444+0000 7f3339080740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b6f362e680 0x55b6f362b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:14.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.444+0000 7f3339080740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b6f36311f0 con 0x55b6f3623dc0 2024-09-19T06:23:14.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.444+0000 7f3339080740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55b6f3544050 con 0x55b6f36234a0 2024-09-19T06:23:14.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.444+0000 7f3339080740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55b6f3631370 con 0x55b6f362e680 2024-09-19T06:23:14.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.444+0000 7f3339080740 10 client.0 _ll_register_callbacks cb 0x55b6f3584160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:14.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.444+0000 7f3327fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6f3623dc0 0x55b6f362b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:14.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.444+0000 7f3327fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6f3623dc0 0x55b6f362b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46994/0 (socket says 172.21.15.2:46994) 2024-09-19T06:23:14.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.444+0000 7f3327fff640 1 -- 172.21.15.2:0/3740230859 learned_addr learned my addr 172.21.15.2:0/3740230859 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:14.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.444+0000 7f3335244640 1 --2- 172.21.15.2:0/3740230859 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b6f362e680 0x55b6f362b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:14.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.444+0000 7f3334a43640 1 --2- 172.21.15.2:0/3740230859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b6f36234a0 0x55b6f362dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:14.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.444+0000 7f3327fff640 1 -- 172.21.15.2:0/3740230859 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b6f362e680 msgr2=0x55b6f362b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:14.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.444+0000 7f3327fff640 1 --2- 172.21.15.2:0/3740230859 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b6f362e680 0x55b6f362b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:14.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.444+0000 7f3327fff640 1 -- 172.21.15.2:0/3740230859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b6f36234a0 msgr2=0x55b6f362dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:14.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.444+0000 7f3327fff640 1 --2- 172.21.15.2:0/3740230859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b6f36234a0 0x55b6f362dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:14.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.444+0000 7f3327fff640 1 -- 172.21.15.2:0/3740230859 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6f32fa3c0 con 0x55b6f3623dc0 2024-09-19T06:23:14.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.445+0000 7f3327fff640 1 --2- 172.21.15.2:0/3740230859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6f3623dc0 0x55b6f362b280 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f332000fda0 tx=0x7f33200a4da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3723f01fd444851c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:14.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.445+0000 7f330ffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:14.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.445+0000 7f330ffff640 1 -- 172.21.15.2:0/3740230859 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33200b4030 con 0x55b6f3623dc0 2024-09-19T06:23:14.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.445+0000 7f330ffff640 1 -- 172.21.15.2:0/3740230859 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f33200987a0 con 0x55b6f3623dc0 2024-09-19T06:23:14.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.445+0000 7f3339080740 1 -- 172.21.15.2:0/3740230859 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f332009c130 con 0x55b6f3623dc0 2024-09-19T06:23:14.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.445+0000 7f330ffff640 1 -- 172.21.15.2:0/3740230859 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f332009c830 con 0x55b6f3623dc0 2024-09-19T06:23:14.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.445+0000 7f3339080740 10 client.18171 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:14.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.445+0000 7f3339080740 1 -- 172.21.15.2:0/3740230859 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b6f363cbc0 con 0x55b6f3623dc0 2024-09-19T06:23:14.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.445+0000 7f330ffff640 1 -- 172.21.15.2:0/3740230859 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f332009c130 con 0x55b6f3623dc0 2024-09-19T06:23:14.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.445+0000 7f330ffff640 1 -- 172.21.15.2:0/3740230859 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f33200a49a0 con 0x55b6f3623dc0 2024-09-19T06:23:14.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.445+0000 7f3339080740 10 client.18171 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:14.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.445+0000 7f3339080740 10 client.18171 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:14.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.445+0000 7f3339080740 20 client.18171 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:14.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.445+0000 7f3339080740 1 --2- 172.21.15.2:0/3740230859 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55b6f363df10 0x55b6f3640300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:14.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.445+0000 7f3339080740 4 client.18171 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:23:14.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.445+0000 7f3339080740 1 -- 172.21.15.2:0/3740230859 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b6f3596850 con 0x55b6f363df10 2024-09-19T06:23:14.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.446+0000 7f3334a43640 1 --2- 172.21.15.2:0/3740230859 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55b6f363df10 0x55b6f3640300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:14.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.446+0000 7f330ffff640 10 client.18171 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:14.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.446+0000 7f3334a43640 1 --2- 172.21.15.2:0/3740230859 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55b6f363df10 0x55b6f3640300 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1988d806e81a62de server_cookie=47908d1d27fff163 in_seq=0 out_seq=0 2024-09-19T06:23:14.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.447+0000 7f330ffff640 1 -- 172.21.15.2:0/3740230859 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b6f3596850 con 0x55b6f363df10 2024-09-19T06:23:14.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.447+0000 7f330ffff640 10 client.18171 handle_command_reply: tid=0 2024-09-19T06:23:14.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.447+0000 7f3339080740 1 client.18171 shutdown 2024-09-19T06:23:14.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.447+0000 7f3339080740 1 -- 172.21.15.2:0/3740230859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6f3623dc0 msgr2=0x55b6f362b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:14.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.447+0000 7f3339080740 1 --2- 172.21.15.2:0/3740230859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6f3623dc0 0x55b6f362b280 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f332000fda0 tx=0x7f33200a4da0 comp rx=0 tx=0).stop 2024-09-19T06:23:14.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.447+0000 7f3339080740 1 -- 172.21.15.2:0/3740230859 shutdown_connections 2024-09-19T06:23:14.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.447+0000 7f3339080740 1 --2- 172.21.15.2:0/3740230859 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b6f362e680 0x55b6f362b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:14.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.447+0000 7f3339080740 1 --2- 172.21.15.2:0/3740230859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6f3623dc0 0x55b6f362b280 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:14.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.447+0000 7f3339080740 1 --2- 172.21.15.2:0/3740230859 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55b6f363df10 0x55b6f3640300 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:14.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.447+0000 7f3339080740 1 --2- 172.21.15.2:0/3740230859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b6f36234a0 0x55b6f362dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:14.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.447+0000 7f330ffff640 0 client.18171 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:14.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.447+0000 7f3339080740 1 -- 172.21.15.2:0/3740230859 >> 172.21.15.2:0/3740230859 conn(0x55b6f361fa30 msgr2=0x55b6f3625710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:14.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.447+0000 7f3339080740 1 -- 172.21.15.2:0/3740230859 shutdown_connections 2024-09-19T06:23:14.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.447+0000 7f3339080740 1 -- 172.21.15.2:0/3740230859 wait complete. 2024-09-19T06:23:14.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.447+0000 7f3339080740 20 client.18171 trim_cache size 0 max 16384 2024-09-19T06:23:14.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.465+0000 7f3339080740 1 Processor -- start 2024-09-19T06:23:14.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.465+0000 7f3339080740 1 -- start start 2024-09-19T06:23:14.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.465+0000 7f3339080740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b6f36234a0 0x55b6f36284e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:14.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.465+0000 7f3339080740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6f3623dc0 0x55b6f3628a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:14.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.465+0000 7f3339080740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b6f362e680 0x55b6f3629a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:14.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.465+0000 7f3339080740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f33301b00a0 con 0x55b6f3623dc0 2024-09-19T06:23:14.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.465+0000 7f3339080740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f33301ad970 con 0x55b6f362e680 2024-09-19T06:23:14.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.465+0000 7f3339080740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f33301ab7e0 con 0x55b6f36234a0 2024-09-19T06:23:14.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.465+0000 7f3327fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6f3623dc0 0x55b6f3628a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:14.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.465+0000 7f3327fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6f3623dc0 0x55b6f3628a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46998/0 (socket says 172.21.15.2:46998) 2024-09-19T06:23:14.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.465+0000 7f3327fff640 1 -- 172.21.15.2:0/2622385787 learned_addr learned my addr 172.21.15.2:0/2622385787 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:14.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.465+0000 7f3334a43640 1 --2- 172.21.15.2:0/2622385787 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b6f36234a0 0x55b6f36284e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:14.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.465+0000 7f3335244640 1 --2- 172.21.15.2:0/2622385787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b6f362e680 0x55b6f3629a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:14.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.465+0000 7f3327fff640 1 -- 172.21.15.2:0/2622385787 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b6f36234a0 msgr2=0x55b6f36284e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:14.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.465+0000 7f3327fff640 1 --2- 172.21.15.2:0/2622385787 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b6f36234a0 0x55b6f36284e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:14.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.465+0000 7f3327fff640 1 -- 172.21.15.2:0/2622385787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b6f362e680 msgr2=0x55b6f3629a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:14.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.465+0000 7f3327fff640 1 --2- 172.21.15.2:0/2622385787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b6f362e680 0x55b6f3629a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:14.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.465+0000 7f3327fff640 1 -- 172.21.15.2:0/2622385787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6f3623bf0 con 0x55b6f3623dc0 2024-09-19T06:23:14.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.465+0000 7f3335244640 1 --2- 172.21.15.2:0/2622385787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b6f362e680 0x55b6f3629a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:23:14.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.466+0000 7f3327fff640 1 --2- 172.21.15.2:0/2622385787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6f3623dc0 0x55b6f3628a20 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f33200a4870 tx=0x7f3320000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3768843c7fe1eb1f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:14.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.466+0000 7f33167fc640 1 -- 172.21.15.2:0/2622385787 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33200b4070 con 0x55b6f3623dc0 2024-09-19T06:23:14.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.466+0000 7f33167fc640 1 -- 172.21.15.2:0/2622385787 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f332009c130 con 0x55b6f3623dc0 2024-09-19T06:23:14.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.466+0000 7f33167fc640 1 -- 172.21.15.2:0/2622385787 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33200a02c0 con 0x55b6f3623dc0 2024-09-19T06:23:14.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.466+0000 7f3339080740 1 -- 172.21.15.2:0/2622385787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6f3623dc0 msgr2=0x55b6f3628a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:14.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.466+0000 7f3339080740 1 --2- 172.21.15.2:0/2622385787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6f3623dc0 0x55b6f3628a20 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f33200a4870 tx=0x7f3320000bc0 comp rx=0 tx=0).stop 2024-09-19T06:23:14.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.466+0000 7f3339080740 1 -- 172.21.15.2:0/2622385787 shutdown_connections 2024-09-19T06:23:14.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.466+0000 7f3339080740 1 --2- 172.21.15.2:0/2622385787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b6f362e680 0x55b6f3629a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:14.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.467+0000 7f3339080740 1 --2- 172.21.15.2:0/2622385787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6f3623dc0 0x55b6f3628a20 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:14.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.467+0000 7f3339080740 1 --2- 172.21.15.2:0/2622385787 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b6f36234a0 0x55b6f36284e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:14.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.467+0000 7f3339080740 1 -- 172.21.15.2:0/2622385787 >> 172.21.15.2:0/2622385787 conn(0x55b6f361fa30 msgr2=0x55b6f362d300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:14.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.467+0000 7f3339080740 1 -- 172.21.15.2:0/2622385787 shutdown_connections 2024-09-19T06:23:14.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.467+0000 7f3339080740 1 -- 172.21.15.2:0/2622385787 wait complete. 2024-09-19T06:23:14.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.467+0000 7f3339080740 1 -- start start 2024-09-19T06:23:14.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.467+0000 7f3339080740 1 Processor -- start 2024-09-19T06:23:14.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.467+0000 7f3339080740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6f36234a0 0x55b6f3643810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:14.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.467+0000 7f3339080740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b6f3623dc0 0x55b6f3640b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:14.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.467+0000 7f3339080740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b6f362e680 0x55b6f36410a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:14.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.468+0000 7f3339080740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f33301abe30 con 0x55b6f36234a0 2024-09-19T06:23:14.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.468+0000 7f3339080740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f33301ad2a0 con 0x55b6f362e680 2024-09-19T06:23:14.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.468+0000 7f3339080740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f33301ac500 con 0x55b6f3623dc0 2024-09-19T06:23:14.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.468+0000 7f3339080740 10 client.0 _ll_register_callbacks cb 0x7f332c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:14.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.468+0000 7f3334a43640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6f36234a0 0x55b6f3643810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:14.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.468+0000 7f3334a43640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6f36234a0 0x55b6f3643810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47002/0 (socket says 172.21.15.2:47002) 2024-09-19T06:23:14.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.468+0000 7f3334a43640 1 -- 172.21.15.2:0/2612571753 learned_addr learned my addr 172.21.15.2:0/2612571753 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:14.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.468+0000 7f3327fff640 1 --2- 172.21.15.2:0/2612571753 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b6f3623dc0 0x55b6f3640b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:14.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.468+0000 7f3335244640 1 --2- 172.21.15.2:0/2612571753 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b6f362e680 0x55b6f36410a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:14.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.468+0000 7f3334a43640 1 -- 172.21.15.2:0/2612571753 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b6f3623dc0 msgr2=0x55b6f3640b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:14.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.468+0000 7f3334a43640 1 --2- 172.21.15.2:0/2612571753 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b6f3623dc0 0x55b6f3640b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:14.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.468+0000 7f3334a43640 1 -- 172.21.15.2:0/2612571753 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b6f362e680 msgr2=0x55b6f36410a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:14.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.468+0000 7f3334a43640 1 --2- 172.21.15.2:0/2612571753 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b6f362e680 0x55b6f36410a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:14.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.468+0000 7f3334a43640 1 -- 172.21.15.2:0/2612571753 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6f3641660 con 0x55b6f36234a0 2024-09-19T06:23:14.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.468+0000 7f3335244640 1 --2- 172.21.15.2:0/2612571753 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b6f362e680 0x55b6f36410a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:14.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.468+0000 7f3334a43640 1 --2- 172.21.15.2:0/2612571753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6f36234a0 0x55b6f3643810 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f332c004440 tx=0x7f332c0050d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33749d1b8c1b3487 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:14.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.468+0000 7f330ffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:14.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.468+0000 7f330ffff640 1 -- 172.21.15.2:0/2612571753 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c035040 con 0x55b6f36234a0 2024-09-19T06:23:14.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.468+0000 7f3339080740 1 -- 172.21.15.2:0/2612571753 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f332009c130 con 0x55b6f36234a0 2024-09-19T06:23:14.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.468+0000 7f330ffff640 1 -- 172.21.15.2:0/2612571753 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f332c0046c0 con 0x55b6f36234a0 2024-09-19T06:23:14.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.469+0000 7f330ffff640 1 -- 172.21.15.2:0/2612571753 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f332c0048c0 con 0x55b6f36234a0 2024-09-19T06:23:14.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.469+0000 7f3339080740 10 client.18177 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:14.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.469+0000 7f3339080740 1 -- 172.21.15.2:0/2612571753 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b6f36a85c0 con 0x55b6f36234a0 2024-09-19T06:23:14.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.469+0000 7f330ffff640 1 -- 172.21.15.2:0/2612571753 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f332009c130 con 0x55b6f36234a0 2024-09-19T06:23:14.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.469+0000 7f330ffff640 1 -- 172.21.15.2:0/2612571753 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f332c003b80 con 0x55b6f36234a0 2024-09-19T06:23:14.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.469+0000 7f3339080740 10 client.18177 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:14.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.469+0000 7f3339080740 10 client.18177 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:14.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.469+0000 7f3339080740 20 client.18177 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:14.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.469+0000 7f3339080740 1 --2- 172.21.15.2:0/2612571753 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55b6f36a8c90 0x55b6f36ab0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:14.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.469+0000 7f3339080740 4 client.18177 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:23:14.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.469+0000 7f3339080740 1 -- 172.21.15.2:0/2612571753 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b6f3590d60 con 0x55b6f36a8c90 2024-09-19T06:23:14.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.469+0000 7f3327fff640 1 --2- 172.21.15.2:0/2612571753 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55b6f36a8c90 0x55b6f36ab0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:14.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.470+0000 7f330ffff640 10 client.18177 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:14.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.470+0000 7f3327fff640 1 --2- 172.21.15.2:0/2612571753 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55b6f36a8c90 0x55b6f36ab0b0 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9d6838edd56efbd server_cookie=7f948e6865d26ed1 in_seq=0 out_seq=0 2024-09-19T06:23:14.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.470+0000 7f330ffff640 1 -- 172.21.15.2:0/2612571753 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55b6f3590d60 con 0x55b6f36a8c90 2024-09-19T06:23:14.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.470+0000 7f330ffff640 10 client.18177 handle_command_reply: tid=0 2024-09-19T06:23:14.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.470+0000 7f3339080740 1 client.18177 shutdown 2024-09-19T06:23:14.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.470+0000 7f3339080740 1 -- 172.21.15.2:0/2612571753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6f36234a0 msgr2=0x55b6f3643810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:14.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.470+0000 7f3339080740 1 --2- 172.21.15.2:0/2612571753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6f36234a0 0x55b6f3643810 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f332c004440 tx=0x7f332c0050d0 comp rx=0 tx=0).stop 2024-09-19T06:23:14.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.470+0000 7f3339080740 1 -- 172.21.15.2:0/2612571753 shutdown_connections 2024-09-19T06:23:14.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.470+0000 7f3339080740 1 --2- 172.21.15.2:0/2612571753 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55b6f36a8c90 0x55b6f36ab0b0 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:14.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.470+0000 7f3339080740 1 --2- 172.21.15.2:0/2612571753 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b6f362e680 0x55b6f36410a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:14.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.470+0000 7f3339080740 1 --2- 172.21.15.2:0/2612571753 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b6f3623dc0 0x55b6f3640b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:14.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.470+0000 7f330ffff640 0 client.18177 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:14.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.470+0000 7f3339080740 1 --2- 172.21.15.2:0/2612571753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b6f36234a0 0x55b6f3643810 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:14.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.470+0000 7f3339080740 1 -- 172.21.15.2:0/2612571753 >> 172.21.15.2:0/2612571753 conn(0x55b6f361fa30 msgr2=0x55b6f3629a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:14.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.470+0000 7f3339080740 1 -- 172.21.15.2:0/2612571753 shutdown_connections 2024-09-19T06:23:14.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.470+0000 7f3339080740 1 -- 172.21.15.2:0/2612571753 wait complete. 2024-09-19T06:23:14.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.470+0000 7f3339080740 20 client.18177 trim_cache size 0 max 16384 2024-09-19T06:23:14.483 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:23:14.483 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T06:23:14.483 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T06:23:14.483 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:23:14.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.471+0000 7f3336ca7640 1 -- 172.21.15.2:0/3887647703 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f33180a33b0 msgr2=0x7f33180a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:14.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.471+0000 7f3336ca7640 1 --2- 172.21.15.2:0/3887647703 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f33180a33b0 0x7f33180a5870 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3328005fd0 tx=0x7f3328004ab0 comp rx=0 tx=0).stop 2024-09-19T06:23:14.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.471+0000 7f3336ca7640 1 -- 172.21.15.2:0/3887647703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3330102790 msgr2=0x7f3330198850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:14.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.471+0000 7f3336ca7640 1 --2- 172.21.15.2:0/3887647703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3330102790 0x7f3330198850 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f332000c920 tx=0x7f332000cde0 comp rx=0 tx=0).stop 2024-09-19T06:23:14.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.471+0000 7f3336ca7640 1 -- 172.21.15.2:0/3887647703 shutdown_connections 2024-09-19T06:23:14.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.471+0000 7f3336ca7640 1 --2- 172.21.15.2:0/3887647703 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f33180a33b0 0x7f33180a5870 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:14.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.471+0000 7f3336ca7640 1 --2- 172.21.15.2:0/3887647703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3330106f10 0x7f333019cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:14.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.471+0000 7f3336ca7640 1 --2- 172.21.15.2:0/3887647703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3330102790 0x7f3330198850 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:14.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.471+0000 7f3336ca7640 1 --2- 172.21.15.2:0/3887647703 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3330101de0 0x7f3330198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:14.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.471+0000 7f3336ca7640 1 -- 172.21.15.2:0/3887647703 >> 172.21.15.2:0/3887647703 conn(0x7f33300fd8c0 msgr2=0x7f33300fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:14.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.471+0000 7f3336ca7640 1 -- 172.21.15.2:0/3887647703 shutdown_connections 2024-09-19T06:23:14.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:14.471+0000 7f3336ca7640 1 -- 172.21.15.2:0/3887647703 wait complete. 2024-09-19T06:23:15.199 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:23:15.199 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:23:15.465 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:23:15.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:15 smithi090 ceph-mon[34497]: pgmap v262: 97 pgs: 97 active+clean; 1.9 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T06:23:15.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:15 smithi089 ceph-mon[34160]: pgmap v262: 97 pgs: 97 active+clean; 1.9 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T06:23:15.883 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:15 smithi002 ceph-mon[30982]: pgmap v262: 97 pgs: 97 active+clean; 1.9 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T06:23:15.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:15.964+0000 7f9949d7e640 1 -- 172.21.15.2:0/1108844545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9944103660 msgr2=0x7f994410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:15.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:15.964+0000 7f9949d7e640 1 --2- 172.21.15.2:0/1108844545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9944103660 0x7f994410bb50 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f9938009ca0 tx=0x7f993802a950 comp rx=0 tx=0).stop 2024-09-19T06:23:15.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:15.964+0000 7f9949d7e640 1 -- 172.21.15.2:0/1108844545 shutdown_connections 2024-09-19T06:23:15.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:15.964+0000 7f9949d7e640 1 --2- 172.21.15.2:0/1108844545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f994410c170 0x7f994410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:15.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:15.964+0000 7f9949d7e640 1 --2- 172.21.15.2:0/1108844545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9944103660 0x7f994410bb50 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:15.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:15.964+0000 7f9949d7e640 1 --2- 172.21.15.2:0/1108844545 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9944102d40 0x7f9944103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:15.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:15.964+0000 7f9949d7e640 1 -- 172.21.15.2:0/1108844545 >> 172.21.15.2:0/1108844545 conn(0x7f99440fc7a0 msgr2=0x7f99440febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:15.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:15.964+0000 7f9949d7e640 1 -- 172.21.15.2:0/1108844545 shutdown_connections 2024-09-19T06:23:15.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:15.964+0000 7f9949d7e640 1 -- 172.21.15.2:0/1108844545 wait complete. 2024-09-19T06:23:15.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:15.965+0000 7f9949d7e640 1 Processor -- start 2024-09-19T06:23:15.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:15.965+0000 7f9949d7e640 1 -- start start 2024-09-19T06:23:15.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:15.965+0000 7f9949d7e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9944102d40 0x7f9944198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:15.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:15.965+0000 7f9949d7e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9944103660 0x7f9944198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:15.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:15.965+0000 7f9949d7e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f994410c170 0x7f994419cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:15.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:15.965+0000 7f9949d7e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9944111e70 con 0x7f9944103660 2024-09-19T06:23:15.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:15.965+0000 7f9949d7e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9944111cf0 con 0x7f994410c170 2024-09-19T06:23:15.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:15.965+0000 7f9949d7e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9944111ff0 con 0x7f9944102d40 2024-09-19T06:23:15.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:15.965+0000 7f9942ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9944103660 0x7f9944198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:15.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:15.965+0000 7f9942ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9944103660 0x7f9944198890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39038/0 (socket says 172.21.15.2:39038) 2024-09-19T06:23:15.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:15.966+0000 7f9942ffd640 1 -- 172.21.15.2:0/1956150177 learned_addr learned my addr 172.21.15.2:0/1956150177 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:15.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:15.966+0000 7f99437fe640 1 --2- 172.21.15.2:0/1956150177 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9944102d40 0x7f9944198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:15.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:15.966+0000 7f9943fff640 1 --2- 172.21.15.2:0/1956150177 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f994410c170 0x7f994419cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:15.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:15.966+0000 7f9942ffd640 1 -- 172.21.15.2:0/1956150177 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9944102d40 msgr2=0x7f9944198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:15.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:15.966+0000 7f9942ffd640 1 --2- 172.21.15.2:0/1956150177 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9944102d40 0x7f9944198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:15.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:15.966+0000 7f9942ffd640 1 -- 172.21.15.2:0/1956150177 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f994410c170 msgr2=0x7f994419cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:15.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:15.966+0000 7f9942ffd640 1 --2- 172.21.15.2:0/1956150177 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f994410c170 0x7f994419cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:15.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:15.966+0000 7f9942ffd640 1 -- 172.21.15.2:0/1956150177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f994419d300 con 0x7f9944103660 2024-09-19T06:23:15.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:15.966+0000 7f99437fe640 1 --2- 172.21.15.2:0/1956150177 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9944102d40 0x7f9944198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:15.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:15.966+0000 7f9942ffd640 1 --2- 172.21.15.2:0/1956150177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9944103660 0x7f9944198890 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f9938005e30 tx=0x7f9938003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:15.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:15.966+0000 7f9940ff9640 1 -- 172.21.15.2:0/1956150177 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9938034040 con 0x7f9944103660 2024-09-19T06:23:15.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:15.966+0000 7f9940ff9640 1 -- 172.21.15.2:0/1956150177 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9938030850 con 0x7f9944103660 2024-09-19T06:23:15.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:15.966+0000 7f9949d7e640 1 -- 172.21.15.2:0/1956150177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f994419d590 con 0x7f9944103660 2024-09-19T06:23:15.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:15.966+0000 7f9940ff9640 1 -- 172.21.15.2:0/1956150177 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9938004790 con 0x7f9944103660 2024-09-19T06:23:15.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:15.966+0000 7f9949d7e640 1 -- 172.21.15.2:0/1956150177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99441a4ed0 con 0x7f9944103660 2024-09-19T06:23:15.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:15.967+0000 7f9949d7e640 1 -- 172.21.15.2:0/1956150177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f994406b070 con 0x7f9944103660 2024-09-19T06:23:15.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:15.969+0000 7f9940ff9640 1 -- 172.21.15.2:0/1956150177 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f9938037020 con 0x7f9944103660 2024-09-19T06:23:15.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:15.970+0000 7f9940ff9640 1 --2- 172.21.15.2:0/1956150177 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f992c0a33b0 0x7f992c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:15.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:15.970+0000 7f99437fe640 1 --2- 172.21.15.2:0/1956150177 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f992c0a33b0 0x7f992c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:15.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:15.970+0000 7f9940ff9640 1 -- 172.21.15.2:0/1956150177 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f99380f0d50 con 0x7f9944103660 2024-09-19T06:23:15.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:15.970+0000 7f99437fe640 1 --2- 172.21.15.2:0/1956150177 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f992c0a33b0 0x7f992c0a5870 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f99340058c0 tx=0x7f9934005850 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:15.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:15.973+0000 7f9940ff9640 1 -- 172.21.15.2:0/1956150177 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f99380bd7e0 con 0x7f9944103660 2024-09-19T06:23:16.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:16.191+0000 7f9949d7e640 1 -- 172.21.15.2:0/1956150177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f99441071e0 con 0x7f9944103660 2024-09-19T06:23:16.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:16.192+0000 7f9940ff9640 1 -- 172.21.15.2:0/1956150177 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11882 (secure 0 0 0) 0x7f99380098b0 con 0x7f9944103660 2024-09-19T06:23:16.193 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:23:16.194 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-09-19T06:14:49:104280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:14:48.191083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24470,24472,24497]},"id":1}]} 2024-09-19T06:23:16.194 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-09-19T06:23:16.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:16.194+0000 7f9949d7e640 1 -- 172.21.15.2:0/1956150177 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f992c0a33b0 msgr2=0x7f992c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:16.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:16.194+0000 7f9949d7e640 1 --2- 172.21.15.2:0/1956150177 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f992c0a33b0 0x7f992c0a5870 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f99340058c0 tx=0x7f9934005850 comp rx=0 tx=0).stop 2024-09-19T06:23:16.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:16.194+0000 7f9949d7e640 1 -- 172.21.15.2:0/1956150177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9944103660 msgr2=0x7f9944198890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:16.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:16.194+0000 7f9949d7e640 1 --2- 172.21.15.2:0/1956150177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9944103660 0x7f9944198890 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f9938005e30 tx=0x7f9938003f90 comp rx=0 tx=0).stop 2024-09-19T06:23:16.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:16.194+0000 7f9949d7e640 1 -- 172.21.15.2:0/1956150177 shutdown_connections 2024-09-19T06:23:16.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:16.194+0000 7f9949d7e640 1 --2- 172.21.15.2:0/1956150177 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f992c0a33b0 0x7f992c0a5870 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:16.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:16.194+0000 7f9949d7e640 1 --2- 172.21.15.2:0/1956150177 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f994410c170 0x7f994419cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:16.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:16.194+0000 7f9949d7e640 1 --2- 172.21.15.2:0/1956150177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9944103660 0x7f9944198890 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:16.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:16.194+0000 7f9949d7e640 1 --2- 172.21.15.2:0/1956150177 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9944102d40 0x7f9944198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:16.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:16.194+0000 7f9949d7e640 1 -- 172.21.15.2:0/1956150177 >> 172.21.15.2:0/1956150177 conn(0x7f99440fc7a0 msgr2=0x7f99440fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:16.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:16.194+0000 7f9949d7e640 1 -- 172.21.15.2:0/1956150177 shutdown_connections 2024-09-19T06:23:16.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:16.194+0000 7f9949d7e640 1 -- 172.21.15.2:0/1956150177 wait complete. 2024-09-19T06:23:16.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:16 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1956150177' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:23:16.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:16 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1956150177' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:23:16.838 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:16 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1956150177' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:23:16.869 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:23:17.127 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:23:17.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.539+0000 7f9086790640 1 -- 172.21.15.2:0/607347357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9080102ef0 msgr2=0x7f908010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:17.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.539+0000 7f9086790640 1 --2- 172.21.15.2:0/607347357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9080102ef0 0x7f908010da40 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f9078009ca0 tx=0x7f907802a950 comp rx=0 tx=0).stop 2024-09-19T06:23:17.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.540+0000 7f9086790640 1 -- 172.21.15.2:0/607347357 shutdown_connections 2024-09-19T06:23:17.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.540+0000 7f9086790640 1 --2- 172.21.15.2:0/607347357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9080102ef0 0x7f908010da40 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:17.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.540+0000 7f9086790640 1 --2- 172.21.15.2:0/607347357 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9080102570 0x7f90801029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:17.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.540+0000 7f9086790640 1 --2- 172.21.15.2:0/607347357 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9080100e20 0x7f9080101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:17.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.540+0000 7f9086790640 1 -- 172.21.15.2:0/607347357 >> 172.21.15.2:0/607347357 conn(0x7f90800fc7d0 msgr2=0x7f90800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:17.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.540+0000 7f9086790640 1 -- 172.21.15.2:0/607347357 shutdown_connections 2024-09-19T06:23:17.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.540+0000 7f9086790640 1 -- 172.21.15.2:0/607347357 wait complete. 2024-09-19T06:23:17.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.540+0000 7f9086790640 1 Processor -- start 2024-09-19T06:23:17.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.540+0000 7f9086790640 1 -- start start 2024-09-19T06:23:17.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.541+0000 7f9086790640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9080100e20 0x7f908019a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:17.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.541+0000 7f9086790640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9080102570 0x7f908019abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:17.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.541+0000 7f9086790640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9080102ef0 0x7f908019ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:17.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.541+0000 7f9086790640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9080110e50 con 0x7f9080100e20 2024-09-19T06:23:17.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.541+0000 7f9086790640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9080110cd0 con 0x7f9080102570 2024-09-19T06:23:17.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.541+0000 7f9086790640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9080110fd0 con 0x7f9080102ef0 2024-09-19T06:23:17.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.541+0000 7f907ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9080100e20 0x7f908019a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:17.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.541+0000 7f907ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9080100e20 0x7f908019a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39052/0 (socket says 172.21.15.2:39052) 2024-09-19T06:23:17.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.541+0000 7f907ffff640 1 -- 172.21.15.2:0/1878267184 learned_addr learned my addr 172.21.15.2:0/1878267184 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:17.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.541+0000 7f907f7fe640 1 --2- 172.21.15.2:0/1878267184 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9080102570 0x7f908019abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:17.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.541+0000 7f9084d2d640 1 --2- 172.21.15.2:0/1878267184 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9080102ef0 0x7f908019ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:17.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.541+0000 7f907ffff640 1 -- 172.21.15.2:0/1878267184 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9080102ef0 msgr2=0x7f908019ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:17.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.541+0000 7f907ffff640 1 --2- 172.21.15.2:0/1878267184 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9080102ef0 0x7f908019ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:17.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.541+0000 7f907ffff640 1 -- 172.21.15.2:0/1878267184 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9080102570 msgr2=0x7f908019abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:17.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.541+0000 7f907ffff640 1 --2- 172.21.15.2:0/1878267184 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9080102570 0x7f908019abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:17.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.541+0000 7f907ffff640 1 -- 172.21.15.2:0/1878267184 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f908019f620 con 0x7f9080100e20 2024-09-19T06:23:17.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.541+0000 7f907ffff640 1 --2- 172.21.15.2:0/1878267184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9080100e20 0x7f908019a670 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f907000d950 tx=0x7f907000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:17.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.541+0000 7f907d7fa640 1 -- 172.21.15.2:0/1878267184 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9070017070 con 0x7f9080100e20 2024-09-19T06:23:17.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.541+0000 7f907d7fa640 1 -- 172.21.15.2:0/1878267184 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9070009c30 con 0x7f9080100e20 2024-09-19T06:23:17.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.541+0000 7f9086790640 1 -- 172.21.15.2:0/1878267184 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f908019f910 con 0x7f9080100e20 2024-09-19T06:23:17.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.541+0000 7f907d7fa640 1 -- 172.21.15.2:0/1878267184 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907000f620 con 0x7f9080100e20 2024-09-19T06:23:17.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.542+0000 7f9086790640 1 -- 172.21.15.2:0/1878267184 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90801a71f0 con 0x7f9080100e20 2024-09-19T06:23:17.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.544+0000 7f907d7fa640 1 -- 172.21.15.2:0/1878267184 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f90700109a0 con 0x7f9080100e20 2024-09-19T06:23:17.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.544+0000 7f9088b69740 1 Processor -- start 2024-09-19T06:23:17.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.544+0000 7f9088b69740 1 -- start start 2024-09-19T06:23:17.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.544+0000 7f9088b69740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fefbb40 0x561b4fefa090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:17.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.544+0000 7f9088b69740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4fefa5d0 0x561b4fefaa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:17.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.544+0000 7f9088b69740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561b4ff05370 0x561b4ff07760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:17.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.544+0000 7f9088b69740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561b4fe602f0 con 0x561b4fefa5d0 2024-09-19T06:23:17.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.544+0000 7f9088b69740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x561b4fe07cf0 con 0x561b4ff05370 2024-09-19T06:23:17.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.544+0000 7f9088b69740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x561b4fe5c2b0 con 0x561b4fefbb40 2024-09-19T06:23:17.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.545+0000 7f907ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4fefa5d0 0x561b4fefaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:17.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.545+0000 7f907ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4fefa5d0 0x561b4fefaa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39056/0 (socket says 172.21.15.2:39056) 2024-09-19T06:23:17.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.545+0000 7f907ffff640 1 -- 172.21.15.2:0/3860734023 learned_addr learned my addr 172.21.15.2:0/3860734023 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:17.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.545+0000 7f907d7fa640 1 --2- 172.21.15.2:0/1878267184 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f90680a33b0 0x7f90680a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:17.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.545+0000 7f907f7fe640 1 --2- 172.21.15.2:0/3860734023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561b4ff05370 0x561b4ff07760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:17.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.545+0000 7f9084d2d640 1 --2- 172.21.15.2:0/3860734023 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fefbb40 0x561b4fefa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:17.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.545+0000 7f9084d2d640 1 --2- 172.21.15.2:0/1878267184 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f90680a33b0 0x7f90680a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:17.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.545+0000 7f907ffff640 1 -- 172.21.15.2:0/3860734023 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fefbb40 msgr2=0x561b4fefa090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:17.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.545+0000 7f907ffff640 1 --2- 172.21.15.2:0/3860734023 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fefbb40 0x561b4fefa090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:17.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.545+0000 7f907ffff640 1 -- 172.21.15.2:0/3860734023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561b4ff05370 msgr2=0x561b4ff07760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:17.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.545+0000 7f907ffff640 1 --2- 172.21.15.2:0/3860734023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561b4ff05370 0x561b4ff07760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:17.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.545+0000 7f907d7fa640 1 -- 172.21.15.2:0/1878267184 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f90700cfa20 con 0x7f9080100e20 2024-09-19T06:23:17.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.545+0000 7f907ffff640 1 -- 172.21.15.2:0/3860734023 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b4fdec3a0 con 0x561b4fefa5d0 2024-09-19T06:23:17.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.545+0000 7f9084d2d640 1 --2- 172.21.15.2:0/3860734023 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fefbb40 0x561b4fefa090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:17.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.545+0000 7f907ffff640 1 --2- 172.21.15.2:0/3860734023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4fefa5d0 0x561b4fefaa10 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f907009bc90 tx=0x7f907009bc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ff072e5264dbdca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:17.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.545+0000 7f9084d2d640 1 --2- 172.21.15.2:0/1878267184 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f90680a33b0 0x7f90680a5870 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9078009a60 tx=0x7f90780095c0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:17.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.545+0000 7f90667fc640 1 -- 172.21.15.2:0/3860734023 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9070020070 con 0x561b4fefa5d0 2024-09-19T06:23:17.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.545+0000 7f90667fc640 1 -- 172.21.15.2:0/3860734023 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9070009de0 con 0x561b4fefa5d0 2024-09-19T06:23:17.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.545+0000 7f90667fc640 1 -- 172.21.15.2:0/3860734023 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907009a000 con 0x561b4fefa5d0 2024-09-19T06:23:17.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.546+0000 7f9088b69740 1 -- 172.21.15.2:0/3860734023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4fefa5d0 msgr2=0x561b4fefaa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:17.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.546+0000 7f9088b69740 1 --2- 172.21.15.2:0/3860734023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4fefa5d0 0x561b4fefaa10 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f907009bc90 tx=0x7f907009bc00 comp rx=0 tx=0).stop 2024-09-19T06:23:17.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.546+0000 7f9088b69740 1 -- 172.21.15.2:0/3860734023 shutdown_connections 2024-09-19T06:23:17.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.546+0000 7f9088b69740 1 --2- 172.21.15.2:0/3860734023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561b4ff05370 0x561b4ff07760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:17.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.546+0000 7f9088b69740 1 --2- 172.21.15.2:0/3860734023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4fefa5d0 0x561b4fefaa10 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:17.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.546+0000 7f9088b69740 1 --2- 172.21.15.2:0/3860734023 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fefbb40 0x561b4fefa090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:17.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.546+0000 7f9088b69740 1 -- 172.21.15.2:0/3860734023 >> 172.21.15.2:0/3860734023 conn(0x561b4fec3310 msgr2=0x561b4fef6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:17.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.546+0000 7f9088b69740 1 -- 172.21.15.2:0/3860734023 shutdown_connections 2024-09-19T06:23:17.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.546+0000 7f9088b69740 1 -- 172.21.15.2:0/3860734023 wait complete. 2024-09-19T06:23:17.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.546+0000 7f9088b69740 1 -- start start 2024-09-19T06:23:17.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.547+0000 7f9088b69740 1 Processor -- start 2024-09-19T06:23:17.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.547+0000 7f9088b69740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561b4fefa5d0 0x561b4ff04d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:17.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.547+0000 7f9088b69740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fefbb40 0x561b4ff02020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:17.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.547+0000 7f9088b69740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4ff05370 0x561b4ff02610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:17.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.547+0000 7f9088b69740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561b4ff08010 con 0x561b4ff05370 2024-09-19T06:23:17.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.547+0000 7f9088b69740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x561b4fe1b060 con 0x561b4fefa5d0 2024-09-19T06:23:17.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.547+0000 7f9088b69740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x561b4ff08190 con 0x561b4fefbb40 2024-09-19T06:23:17.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.547+0000 7f9088b69740 10 client.0 _ll_register_callbacks cb 0x561b4fb6e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:17.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.547+0000 7f9084d2d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4ff05370 0x561b4ff02610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:17.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.547+0000 7f9084d2d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4ff05370 0x561b4ff02610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39066/0 (socket says 172.21.15.2:39066) 2024-09-19T06:23:17.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.547+0000 7f9084d2d640 1 -- 172.21.15.2:0/1674537556 learned_addr learned my addr 172.21.15.2:0/1674537556 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:17.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.547+0000 7f907f7fe640 1 --2- 172.21.15.2:0/1674537556 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fefbb40 0x561b4ff02020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:17.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.547+0000 7f907ffff640 1 --2- 172.21.15.2:0/1674537556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561b4fefa5d0 0x561b4ff04d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:17.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.548+0000 7f9084d2d640 1 -- 172.21.15.2:0/1674537556 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fefbb40 msgr2=0x561b4ff02020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:17.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.548+0000 7f9084d2d640 1 --2- 172.21.15.2:0/1674537556 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fefbb40 0x561b4ff02020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:17.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.548+0000 7f9084d2d640 1 -- 172.21.15.2:0/1674537556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561b4fefa5d0 msgr2=0x561b4ff04d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:17.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.548+0000 7f9084d2d640 1 --2- 172.21.15.2:0/1674537556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561b4fefa5d0 0x561b4ff04d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:17.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.548+0000 7f9084d2d640 1 -- 172.21.15.2:0/1674537556 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b4fbd13c0 con 0x561b4ff05370 2024-09-19T06:23:17.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.548+0000 7f907ffff640 1 --2- 172.21.15.2:0/1674537556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561b4fefa5d0 0x561b4ff04d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:17.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.548+0000 7f9084d2d640 1 --2- 172.21.15.2:0/1674537556 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4ff05370 0x561b4ff02610 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f9078009390 tx=0x7f907802a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f91bde8344f40be server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:17.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.548+0000 7f905f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:17.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.548+0000 7f905f7fe640 1 -- 172.21.15.2:0/1674537556 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907804d070 con 0x561b4ff05370 2024-09-19T06:23:17.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.548+0000 7f9088b69740 1 -- 172.21.15.2:0/1674537556 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9070009de0 con 0x561b4ff05370 2024-09-19T06:23:17.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.548+0000 7f905f7fe640 1 -- 172.21.15.2:0/1674537556 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f9078004450 con 0x561b4ff05370 2024-09-19T06:23:17.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.548+0000 7f905f7fe640 1 -- 172.21.15.2:0/1674537556 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9078059050 con 0x561b4ff05370 2024-09-19T06:23:17.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.548+0000 7f9088b69740 10 client.18195 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:17.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.548+0000 7f9088b69740 1 -- 172.21.15.2:0/1674537556 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561b4ff13ab0 con 0x561b4ff05370 2024-09-19T06:23:17.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.548+0000 7f905f7fe640 1 -- 172.21.15.2:0/1674537556 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9070009de0 con 0x561b4ff05370 2024-09-19T06:23:17.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.548+0000 7f905f7fe640 1 -- 172.21.15.2:0/1674537556 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f9078039420 con 0x561b4ff05370 2024-09-19T06:23:17.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.549+0000 7f9088b69740 10 client.18195 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:17.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.549+0000 7f9088b69740 10 client.18195 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:23:17.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.549+0000 7f9088b69740 20 client.18195 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:17.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.549+0000 7f9088b69740 1 --2- 172.21.15.2:0/1674537556 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x561b4ff14f80 0x561b4ff173e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:17.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.549+0000 7f9088b69740 4 client.18195 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:23:17.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.549+0000 7f9088b69740 1 -- 172.21.15.2:0/1674537556 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b4fe6d860 con 0x561b4ff14f80 2024-09-19T06:23:17.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.549+0000 7f907ffff640 1 --2- 172.21.15.2:0/1674537556 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x561b4ff14f80 0x561b4ff173e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:17.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.549+0000 7f907ffff640 1 --2- 172.21.15.2:0/1674537556 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x561b4ff14f80 0x561b4ff173e0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f8ca5b2f772d058 server_cookie=bc17caa80b975ab0 in_seq=0 out_seq=0 2024-09-19T06:23:17.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.549+0000 7f905f7fe640 10 client.18195 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:23:17.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.550+0000 7f905f7fe640 1 -- 172.21.15.2:0/1674537556 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561b4fe6d860 con 0x561b4ff14f80 2024-09-19T06:23:17.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.550+0000 7f905f7fe640 10 client.18195 handle_command_reply: tid=0 2024-09-19T06:23:17.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.550+0000 7f9088b69740 1 client.18195 shutdown 2024-09-19T06:23:17.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.550+0000 7f9088b69740 1 -- 172.21.15.2:0/1674537556 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4ff05370 msgr2=0x561b4ff02610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:17.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.550+0000 7f9088b69740 1 --2- 172.21.15.2:0/1674537556 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4ff05370 0x561b4ff02610 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f9078009390 tx=0x7f907802a950 comp rx=0 tx=0).stop 2024-09-19T06:23:17.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.550+0000 7f9088b69740 1 -- 172.21.15.2:0/1674537556 shutdown_connections 2024-09-19T06:23:17.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.550+0000 7f9088b69740 1 --2- 172.21.15.2:0/1674537556 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x561b4ff14f80 0x561b4ff173e0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:17.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.550+0000 7f9088b69740 1 --2- 172.21.15.2:0/1674537556 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4ff05370 0x561b4ff02610 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:17.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.550+0000 7f9088b69740 1 --2- 172.21.15.2:0/1674537556 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fefbb40 0x561b4ff02020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:17.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.550+0000 7f9088b69740 1 --2- 172.21.15.2:0/1674537556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561b4fefa5d0 0x561b4ff04d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:17.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.550+0000 7f905f7fe640 0 client.18195 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:23:17.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.550+0000 7f9088b69740 1 -- 172.21.15.2:0/1674537556 >> 172.21.15.2:0/1674537556 conn(0x561b4fec3310 msgr2=0x561b4fefc990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:17.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.551+0000 7f9088b69740 1 -- 172.21.15.2:0/1674537556 shutdown_connections 2024-09-19T06:23:17.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.551+0000 7f9088b69740 1 -- 172.21.15.2:0/1674537556 wait complete. 2024-09-19T06:23:17.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.551+0000 7f9088b69740 20 client.18195 trim_cache size 0 max 16384 2024-09-19T06:23:17.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.563+0000 7f9088b69740 1 Processor -- start 2024-09-19T06:23:17.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.563+0000 7f9088b69740 1 -- start start 2024-09-19T06:23:17.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.564+0000 7f9088b69740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fefa5d0 0x561b4ff112b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:17.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.564+0000 7f9088b69740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561b4fefbb40 0x561b4fefd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:17.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.564+0000 7f9088b69740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4ff05370 0x561b4fefd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:17.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.564+0000 7f9088b69740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f90801b2320 con 0x561b4ff05370 2024-09-19T06:23:17.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.564+0000 7f9088b69740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f90801afbf0 con 0x561b4fefbb40 2024-09-19T06:23:17.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.564+0000 7f9088b69740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f90801ada60 con 0x561b4fefa5d0 2024-09-19T06:23:17.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.564+0000 7f9084d2d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4ff05370 0x561b4fefd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:17.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.564+0000 7f9084d2d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4ff05370 0x561b4fefd660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39074/0 (socket says 172.21.15.2:39074) 2024-09-19T06:23:17.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.564+0000 7f9084d2d640 1 -- 172.21.15.2:0/2662506591 learned_addr learned my addr 172.21.15.2:0/2662506591 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:17.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.564+0000 7f907ffff640 1 --2- 172.21.15.2:0/2662506591 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fefa5d0 0x561b4ff112b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:17.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.564+0000 7f907f7fe640 1 --2- 172.21.15.2:0/2662506591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561b4fefbb40 0x561b4fefd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:17.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.564+0000 7f9084d2d640 1 -- 172.21.15.2:0/2662506591 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fefa5d0 msgr2=0x561b4ff112b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:17.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.564+0000 7f9084d2d640 1 --2- 172.21.15.2:0/2662506591 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fefa5d0 0x561b4ff112b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:17.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.564+0000 7f9084d2d640 1 -- 172.21.15.2:0/2662506591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561b4fefbb40 msgr2=0x561b4fefd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:17.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.564+0000 7f9084d2d640 1 --2- 172.21.15.2:0/2662506591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561b4fefbb40 0x561b4fefd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:17.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.564+0000 7f9084d2d640 1 -- 172.21.15.2:0/2662506591 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b4ff050e0 con 0x561b4ff05370 2024-09-19T06:23:17.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.564+0000 7f9084d2d640 1 --2- 172.21.15.2:0/2662506591 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4ff05370 0x561b4fefd660 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f9078009bf0 tx=0x7f907802afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bf45a5bdedff364 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:17.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.564+0000 7f9065ffb640 1 -- 172.21.15.2:0/2662506591 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9078062070 con 0x561b4ff05370 2024-09-19T06:23:17.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.565+0000 7f9065ffb640 1 -- 172.21.15.2:0/2662506591 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9078004700 con 0x561b4ff05370 2024-09-19T06:23:17.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.565+0000 7f9065ffb640 1 -- 172.21.15.2:0/2662506591 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9078056070 con 0x561b4ff05370 2024-09-19T06:23:17.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.565+0000 7f9088b69740 1 -- 172.21.15.2:0/2662506591 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4ff05370 msgr2=0x561b4fefd660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:17.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.565+0000 7f9088b69740 1 --2- 172.21.15.2:0/2662506591 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4ff05370 0x561b4fefd660 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f9078009bf0 tx=0x7f907802afd0 comp rx=0 tx=0).stop 2024-09-19T06:23:17.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.565+0000 7f9088b69740 1 -- 172.21.15.2:0/2662506591 shutdown_connections 2024-09-19T06:23:17.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.565+0000 7f9088b69740 1 --2- 172.21.15.2:0/2662506591 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4ff05370 0x561b4fefd660 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:17.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.565+0000 7f9088b69740 1 --2- 172.21.15.2:0/2662506591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561b4fefbb40 0x561b4fefd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:17.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.565+0000 7f9088b69740 1 --2- 172.21.15.2:0/2662506591 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fefa5d0 0x561b4ff112b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:17.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.565+0000 7f9088b69740 1 -- 172.21.15.2:0/2662506591 >> 172.21.15.2:0/2662506591 conn(0x561b4fec3310 msgr2=0x561b4ff01110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:17.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.565+0000 7f9088b69740 1 -- 172.21.15.2:0/2662506591 shutdown_connections 2024-09-19T06:23:17.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.565+0000 7f9088b69740 1 -- 172.21.15.2:0/2662506591 wait complete. 2024-09-19T06:23:17.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.566+0000 7f9088b69740 1 -- start start 2024-09-19T06:23:17.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.566+0000 7f9088b69740 1 Processor -- start 2024-09-19T06:23:17.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.566+0000 7f9088b69740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fefa5d0 0x561b4ff091f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:17.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.566+0000 7f9088b69740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4fefbb40 0x561b4ff09730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:17.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.566+0000 7f9088b69740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561b4ff05370 0x561b4ff09c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:17.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.566+0000 7f9088b69740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f90801ae0b0 con 0x561b4fefbb40 2024-09-19T06:23:17.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.566+0000 7f9088b69740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f90801af520 con 0x561b4ff05370 2024-09-19T06:23:17.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.566+0000 7f9088b69740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f90801ae780 con 0x561b4fefa5d0 2024-09-19T06:23:17.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.566+0000 7f9088b69740 10 client.0 _ll_register_callbacks cb 0x7f9078009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:17.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.566+0000 7f907f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4fefbb40 0x561b4ff09730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:17.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.566+0000 7f907f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4fefbb40 0x561b4ff09730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39088/0 (socket says 172.21.15.2:39088) 2024-09-19T06:23:17.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.566+0000 7f907f7fe640 1 -- 172.21.15.2:0/2587448764 learned_addr learned my addr 172.21.15.2:0/2587448764 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:17.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.566+0000 7f9084d2d640 1 --2- 172.21.15.2:0/2587448764 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561b4ff05370 0x561b4ff09c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:17.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.566+0000 7f907ffff640 1 --2- 172.21.15.2:0/2587448764 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fefa5d0 0x561b4ff091f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:17.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.567+0000 7f907f7fe640 1 -- 172.21.15.2:0/2587448764 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fefa5d0 msgr2=0x561b4ff091f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:17.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.567+0000 7f907f7fe640 1 --2- 172.21.15.2:0/2587448764 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fefa5d0 0x561b4ff091f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:17.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.567+0000 7f907f7fe640 1 -- 172.21.15.2:0/2587448764 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561b4ff05370 msgr2=0x561b4ff09c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:17.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.567+0000 7f907f7fe640 1 --2- 172.21.15.2:0/2587448764 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561b4ff05370 0x561b4ff09c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:17.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.567+0000 7f907f7fe640 1 -- 172.21.15.2:0/2587448764 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b4ff7ed00 con 0x561b4fefbb40 2024-09-19T06:23:17.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.567+0000 7f907f7fe640 1 --2- 172.21.15.2:0/2587448764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4fefbb40 0x561b4ff09730 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f90740143c0 tx=0x7f9074014880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2869bff54bcc8892 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:17.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.567+0000 7f905f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:17.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.567+0000 7f905f7fe640 1 -- 172.21.15.2:0/2587448764 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9074016700 con 0x561b4fefbb40 2024-09-19T06:23:17.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.567+0000 7f905f7fe640 1 -- 172.21.15.2:0/2587448764 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f90740168a0 con 0x561b4fefbb40 2024-09-19T06:23:17.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.567+0000 7f9088b69740 1 -- 172.21.15.2:0/2587448764 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9078004700 con 0x561b4fefbb40 2024-09-19T06:23:17.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.567+0000 7f905f7fe640 1 -- 172.21.15.2:0/2587448764 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9074016aa0 con 0x561b4fefbb40 2024-09-19T06:23:17.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.567+0000 7f9088b69740 10 client.18201 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:17.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.567+0000 7f9088b69740 1 -- 172.21.15.2:0/2587448764 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561b4ff80070 con 0x561b4fefbb40 2024-09-19T06:23:17.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.567+0000 7f905f7fe640 1 -- 172.21.15.2:0/2587448764 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9078004700 con 0x561b4fefbb40 2024-09-19T06:23:17.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.567+0000 7f905f7fe640 1 -- 172.21.15.2:0/2587448764 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f9074020410 con 0x561b4fefbb40 2024-09-19T06:23:17.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.568+0000 7f9088b69740 10 client.18201 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:17.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.568+0000 7f9088b69740 10 client.18201 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:23:17.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.568+0000 7f9088b69740 20 client.18201 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:17.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.568+0000 7f9088b69740 1 --2- 172.21.15.2:0/2587448764 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x561b4ff807d0 0x561b4ff82bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:17.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.568+0000 7f9088b69740 4 client.18201 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:23:17.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.568+0000 7f9088b69740 1 -- 172.21.15.2:0/2587448764 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561b4fe67d70 con 0x561b4ff807d0 2024-09-19T06:23:17.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.568+0000 7f907ffff640 1 --2- 172.21.15.2:0/2587448764 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x561b4ff807d0 0x561b4ff82bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:17.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.568+0000 7f905f7fe640 10 client.18201 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:23:17.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.568+0000 7f907ffff640 1 --2- 172.21.15.2:0/2587448764 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x561b4ff807d0 0x561b4ff82bf0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5eb53c421e3ca61 server_cookie=651791c5c869e387 in_seq=0 out_seq=0 2024-09-19T06:23:17.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.568+0000 7f905f7fe640 1 -- 172.21.15.2:0/2587448764 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561b4fe67d70 con 0x561b4ff807d0 2024-09-19T06:23:17.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.568+0000 7f905f7fe640 10 client.18201 handle_command_reply: tid=0 2024-09-19T06:23:17.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.568+0000 7f9088b69740 1 client.18201 shutdown 2024-09-19T06:23:17.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.569+0000 7f9088b69740 1 -- 172.21.15.2:0/2587448764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4fefbb40 msgr2=0x561b4ff09730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:17.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.569+0000 7f9088b69740 1 --2- 172.21.15.2:0/2587448764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4fefbb40 0x561b4ff09730 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f90740143c0 tx=0x7f9074014880 comp rx=0 tx=0).stop 2024-09-19T06:23:17.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.569+0000 7f9088b69740 1 -- 172.21.15.2:0/2587448764 shutdown_connections 2024-09-19T06:23:17.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.569+0000 7f9088b69740 1 --2- 172.21.15.2:0/2587448764 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x561b4ff807d0 0x561b4ff82bf0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:17.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.569+0000 7f9088b69740 1 --2- 172.21.15.2:0/2587448764 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561b4ff05370 0x561b4ff09c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:17.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.569+0000 7f9088b69740 1 --2- 172.21.15.2:0/2587448764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b4fefbb40 0x561b4ff09730 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:17.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.569+0000 7f9088b69740 1 --2- 172.21.15.2:0/2587448764 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fefa5d0 0x561b4ff091f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:17.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.569+0000 7f9088b69740 1 -- 172.21.15.2:0/2587448764 >> 172.21.15.2:0/2587448764 conn(0x561b4fec3310 msgr2=0x561b4fef54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:17.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.569+0000 7f905f7fe640 0 client.18201 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:23:17.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.569+0000 7f9088b69740 1 -- 172.21.15.2:0/2587448764 shutdown_connections 2024-09-19T06:23:17.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.569+0000 7f9088b69740 1 -- 172.21.15.2:0/2587448764 wait complete. 2024-09-19T06:23:17.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.569+0000 7f9088b69740 20 client.18201 trim_cache size 0 max 16384 2024-09-19T06:23:17.578 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:23:17.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.569+0000 7f9086790640 1 -- 172.21.15.2:0/1878267184 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f90680a33b0 msgr2=0x7f90680a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:17.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.569+0000 7f9086790640 1 --2- 172.21.15.2:0/1878267184 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f90680a33b0 0x7f90680a5870 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9078009a60 tx=0x7f90780095c0 comp rx=0 tx=0).stop 2024-09-19T06:23:17.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.569+0000 7f9086790640 1 -- 172.21.15.2:0/1878267184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9080100e20 msgr2=0x7f908019a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:17.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.569+0000 7f9086790640 1 --2- 172.21.15.2:0/1878267184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9080100e20 0x7f908019a670 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f907000d950 tx=0x7f907000de10 comp rx=0 tx=0).stop 2024-09-19T06:23:17.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.570+0000 7f9086790640 1 -- 172.21.15.2:0/1878267184 shutdown_connections 2024-09-19T06:23:17.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.570+0000 7f9086790640 1 --2- 172.21.15.2:0/1878267184 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f90680a33b0 0x7f90680a5870 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:17.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.570+0000 7f9086790640 1 --2- 172.21.15.2:0/1878267184 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9080102ef0 0x7f908019ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:17.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.570+0000 7f9086790640 1 --2- 172.21.15.2:0/1878267184 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9080102570 0x7f908019abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:17.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.570+0000 7f9086790640 1 --2- 172.21.15.2:0/1878267184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9080100e20 0x7f908019a670 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:17.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.570+0000 7f9086790640 1 -- 172.21.15.2:0/1878267184 >> 172.21.15.2:0/1878267184 conn(0x7f90800fc7d0 msgr2=0x7f908006a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:17.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.570+0000 7f9086790640 1 -- 172.21.15.2:0/1878267184 shutdown_connections 2024-09-19T06:23:17.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:17.570+0000 7f9086790640 1 -- 172.21.15.2:0/1878267184 wait complete. 2024-09-19T06:23:17.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:17 smithi090 ceph-mon[34497]: pgmap v263: 97 pgs: 97 active+clean; 1.9 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T06:23:17.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:17 smithi089 ceph-mon[34160]: pgmap v263: 97 pgs: 97 active+clean; 1.9 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T06:23:17.877 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:17 smithi002 ceph-mon[30982]: pgmap v263: 97 pgs: 97 active+clean; 1.9 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T06:23:18.352 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:23:18.608 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:23:19.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.048+0000 7fea5d39e640 1 -- 172.21.15.2:0/2807402259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea58101430 msgr2=0x7fea5810d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:19.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.048+0000 7fea5d39e640 1 --2- 172.21.15.2:0/2807402259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea58101430 0x7fea5810d960 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fea50009cd0 tx=0x7fea5002a8e0 comp rx=0 tx=0).stop 2024-09-19T06:23:19.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.049+0000 7fea5d39e640 1 -- 172.21.15.2:0/2807402259 shutdown_connections 2024-09-19T06:23:19.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.049+0000 7fea5d39e640 1 --2- 172.21.15.2:0/2807402259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea58101430 0x7fea5810d960 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:19.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.049+0000 7fea5d39e640 1 --2- 172.21.15.2:0/2807402259 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea58100a90 0x7fea58100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:19.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.049+0000 7fea5d39e640 1 --2- 172.21.15.2:0/2807402259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea58106a90 0x7fea58106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:19.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.049+0000 7fea5d39e640 1 -- 172.21.15.2:0/2807402259 >> 172.21.15.2:0/2807402259 conn(0x7fea580fc7d0 msgr2=0x7fea580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:19.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.049+0000 7fea5d39e640 1 -- 172.21.15.2:0/2807402259 shutdown_connections 2024-09-19T06:23:19.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.049+0000 7fea5d39e640 1 -- 172.21.15.2:0/2807402259 wait complete. 2024-09-19T06:23:19.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.049+0000 7fea5d39e640 1 Processor -- start 2024-09-19T06:23:19.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.049+0000 7fea5d39e640 1 -- start start 2024-09-19T06:23:19.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.050+0000 7fea5d39e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea58100a90 0x7fea580fcd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:19.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.050+0000 7fea5d39e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea58101430 0x7fea580fd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:19.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.050+0000 7fea5d39e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea58106a90 0x7fea580fd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:19.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.050+0000 7fea5d39e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fea58110d40 con 0x7fea58101430 2024-09-19T06:23:19.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.050+0000 7fea5d39e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fea58110bc0 con 0x7fea58100a90 2024-09-19T06:23:19.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.050+0000 7fea5d39e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fea58110ec0 con 0x7fea58106a90 2024-09-19T06:23:19.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.050+0000 7fea4ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea58101430 0x7fea580fd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:19.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.050+0000 7fea4ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea58101430 0x7fea580fd260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39108/0 (socket says 172.21.15.2:39108) 2024-09-19T06:23:19.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.050+0000 7fea4ffff640 1 -- 172.21.15.2:0/2525318703 learned_addr learned my addr 172.21.15.2:0/2525318703 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:19.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.050+0000 7fea577fe640 1 --2- 172.21.15.2:0/2525318703 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea58106a90 0x7fea580fd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:19.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.050+0000 7fea56ffd640 1 --2- 172.21.15.2:0/2525318703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea58100a90 0x7fea580fcd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:19.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.050+0000 7fea4ffff640 1 -- 172.21.15.2:0/2525318703 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea58106a90 msgr2=0x7fea580fd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:19.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.050+0000 7fea4ffff640 1 --2- 172.21.15.2:0/2525318703 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea58106a90 0x7fea580fd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:19.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.050+0000 7fea4ffff640 1 -- 172.21.15.2:0/2525318703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea58100a90 msgr2=0x7fea580fcd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:19.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.050+0000 7fea4ffff640 1 --2- 172.21.15.2:0/2525318703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea58100a90 0x7fea580fcd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:19.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.050+0000 7fea4ffff640 1 -- 172.21.15.2:0/2525318703 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea581a66f0 con 0x7fea58101430 2024-09-19T06:23:19.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.050+0000 7fea4ffff640 1 --2- 172.21.15.2:0/2525318703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea58101430 0x7fea580fd260 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fea4000c920 tx=0x7fea4000cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:19.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.051+0000 7fea54ff9640 1 -- 172.21.15.2:0/2525318703 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea40007bb0 con 0x7fea58101430 2024-09-19T06:23:19.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.051+0000 7fea54ff9640 1 -- 172.21.15.2:0/2525318703 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fea40007d50 con 0x7fea58101430 2024-09-19T06:23:19.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.051+0000 7fea5d39e640 1 -- 172.21.15.2:0/2525318703 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea581a69e0 con 0x7fea58101430 2024-09-19T06:23:19.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.051+0000 7fea54ff9640 1 -- 172.21.15.2:0/2525318703 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea40018730 con 0x7fea58101430 2024-09-19T06:23:19.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.051+0000 7fea5d39e640 1 -- 172.21.15.2:0/2525318703 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea581a6f70 con 0x7fea58101430 2024-09-19T06:23:19.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.053+0000 7fea54ff9640 1 -- 172.21.15.2:0/2525318703 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fea4000f450 con 0x7fea58101430 2024-09-19T06:23:19.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.054+0000 7fea5f777740 1 Processor -- start 2024-09-19T06:23:19.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.054+0000 7fea5f777740 1 -- start start 2024-09-19T06:23:19.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.054+0000 7fea5f777740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629b05f8b40 0x5629b05f7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:19.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.054+0000 7fea5f777740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b05f75d0 0x5629b05f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:19.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.054+0000 7fea5f777740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629b0602370 0x5629b0604760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:19.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.054+0000 7fea5f777740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5629b055d2f0 con 0x5629b05f8b40 2024-09-19T06:23:19.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.054+0000 7fea5f777740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5629b0504cf0 con 0x5629b0602370 2024-09-19T06:23:19.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.054+0000 7fea5f777740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5629b05592b0 con 0x5629b05f75d0 2024-09-19T06:23:19.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.054+0000 7fea54ff9640 1 --2- 172.21.15.2:0/2525318703 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fea440a3430 0x7fea440a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:19.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.054+0000 7fea577fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629b05f8b40 0x5629b05f7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:19.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.054+0000 7fea577fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629b05f8b40 0x5629b05f7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39114/0 (socket says 172.21.15.2:39114) 2024-09-19T06:23:19.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.054+0000 7fea577fe640 1 -- 172.21.15.2:0/2998898099 learned_addr learned my addr 172.21.15.2:0/2998898099 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:19.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.054+0000 7fea4ffff640 1 --2- 172.21.15.2:0/2998898099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629b0602370 0x5629b0604760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:19.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.054+0000 7fea577fe640 1 --2- 172.21.15.2:0/2525318703 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fea440a3430 0x7fea440a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:19.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.055+0000 7fea56ffd640 1 --2- 172.21.15.2:0/2998898099 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b05f75d0 0x5629b05f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:19.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.055+0000 7fea54ff9640 1 -- 172.21.15.2:0/2525318703 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7fea400cfdb0 con 0x7fea58101430 2024-09-19T06:23:19.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.055+0000 7fea577fe640 1 -- 172.21.15.2:0/2998898099 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b05f75d0 msgr2=0x5629b05f7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:19.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.055+0000 7fea577fe640 1 --2- 172.21.15.2:0/2998898099 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b05f75d0 0x5629b05f7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:19.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.055+0000 7fea577fe640 1 -- 172.21.15.2:0/2998898099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629b0602370 msgr2=0x5629b0604760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:19.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.055+0000 7fea577fe640 1 --2- 172.21.15.2:0/2998898099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629b0602370 0x5629b0604760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:19.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.055+0000 7fea577fe640 1 -- 172.21.15.2:0/2998898099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629b04e93a0 con 0x5629b05f8b40 2024-09-19T06:23:19.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.055+0000 7fea56ffd640 1 --2- 172.21.15.2:0/2998898099 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b05f75d0 0x5629b05f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:19.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.055+0000 7fea4ffff640 1 --2- 172.21.15.2:0/2998898099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629b0602370 0x5629b0604760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:23:19.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.055+0000 7fea577fe640 1 --2- 172.21.15.2:0/2998898099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629b05f8b40 0x5629b05f7090 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fea50009a60 tx=0x7fea50003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e10eaa2e0f567449 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:19.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.055+0000 7fea577fe640 1 --2- 172.21.15.2:0/2525318703 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fea440a3430 0x7fea440a58f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fea50009890 tx=0x7fea50036000 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:19.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.055+0000 7fea4d7fa640 1 -- 172.21.15.2:0/2998898099 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea5004d070 con 0x5629b05f8b40 2024-09-19T06:23:19.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.055+0000 7fea4d7fa640 1 -- 172.21.15.2:0/2998898099 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fea50036070 con 0x5629b05f8b40 2024-09-19T06:23:19.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.055+0000 7fea4d7fa640 1 -- 172.21.15.2:0/2998898099 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea50030e70 con 0x5629b05f8b40 2024-09-19T06:23:19.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.056+0000 7fea5f777740 1 -- 172.21.15.2:0/2998898099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629b05f8b40 msgr2=0x5629b05f7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:19.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.056+0000 7fea5f777740 1 --2- 172.21.15.2:0/2998898099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629b05f8b40 0x5629b05f7090 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fea50009a60 tx=0x7fea50003970 comp rx=0 tx=0).stop 2024-09-19T06:23:19.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.056+0000 7fea5f777740 1 -- 172.21.15.2:0/2998898099 shutdown_connections 2024-09-19T06:23:19.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.056+0000 7fea5f777740 1 --2- 172.21.15.2:0/2998898099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629b0602370 0x5629b0604760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:19.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.056+0000 7fea5f777740 1 --2- 172.21.15.2:0/2998898099 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b05f75d0 0x5629b05f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:19.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.056+0000 7fea5f777740 1 --2- 172.21.15.2:0/2998898099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629b05f8b40 0x5629b05f7090 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:19.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.056+0000 7fea5f777740 1 -- 172.21.15.2:0/2998898099 >> 172.21.15.2:0/2998898099 conn(0x5629b05c0310 msgr2=0x5629b05f3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:19.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.056+0000 7fea5f777740 1 -- 172.21.15.2:0/2998898099 shutdown_connections 2024-09-19T06:23:19.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.056+0000 7fea5f777740 1 -- 172.21.15.2:0/2998898099 wait complete. 2024-09-19T06:23:19.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.057+0000 7fea5f777740 1 -- start start 2024-09-19T06:23:19.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.057+0000 7fea5f777740 1 Processor -- start 2024-09-19T06:23:19.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.057+0000 7fea5f777740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629b05f75d0 0x5629b0601d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:19.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.057+0000 7fea5f777740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629b05f8b40 0x5629b05ff030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:19.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.057+0000 7fea5f777740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b0602370 0x5629b05ff640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:19.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.057+0000 7fea5f777740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5629b0604fb0 con 0x5629b05f75d0 2024-09-19T06:23:19.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.057+0000 7fea5f777740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5629b0518060 con 0x5629b05f8b40 2024-09-19T06:23:19.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.057+0000 7fea5f777740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5629b0605130 con 0x5629b0602370 2024-09-19T06:23:19.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.057+0000 7fea56ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629b05f75d0 0x5629b0601d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:19.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.057+0000 7fea5f777740 10 client.0 _ll_register_callbacks cb 0x5629b026b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:19.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.057+0000 7fea56ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629b05f75d0 0x5629b0601d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39120/0 (socket says 172.21.15.2:39120) 2024-09-19T06:23:19.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.057+0000 7fea56ffd640 1 -- 172.21.15.2:0/2224214092 learned_addr learned my addr 172.21.15.2:0/2224214092 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:19.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.057+0000 7fea4ffff640 1 --2- 172.21.15.2:0/2224214092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629b05f8b40 0x5629b05ff030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:19.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.057+0000 7fea577fe640 1 --2- 172.21.15.2:0/2224214092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b0602370 0x5629b05ff640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:19.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.058+0000 7fea56ffd640 1 -- 172.21.15.2:0/2224214092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b0602370 msgr2=0x5629b05ff640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:19.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.058+0000 7fea56ffd640 1 --2- 172.21.15.2:0/2224214092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b0602370 0x5629b05ff640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:19.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.058+0000 7fea56ffd640 1 -- 172.21.15.2:0/2224214092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629b05f8b40 msgr2=0x5629b05ff030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:19.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.058+0000 7fea56ffd640 1 --2- 172.21.15.2:0/2224214092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629b05f8b40 0x5629b05ff030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:19.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.058+0000 7fea56ffd640 1 -- 172.21.15.2:0/2224214092 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629b02ce3c0 con 0x5629b05f75d0 2024-09-19T06:23:19.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.058+0000 7fea56ffd640 1 --2- 172.21.15.2:0/2224214092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629b05f75d0 0x5629b0601d80 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fea48012750 tx=0x7fea48012c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16b46f38e512aa6b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:19.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.058+0000 7fea3e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:19.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.058+0000 7fea3e7fc640 1 -- 172.21.15.2:0/2224214092 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4801f060 con 0x5629b05f75d0 2024-09-19T06:23:19.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.058+0000 7fea3e7fc640 1 -- 172.21.15.2:0/2224214092 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7fea48010dc0 con 0x5629b05f75d0 2024-09-19T06:23:19.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.058+0000 7fea5f777740 1 -- 172.21.15.2:0/2224214092 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea50036070 con 0x5629b05f75d0 2024-09-19T06:23:19.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.058+0000 7fea3e7fc640 1 -- 172.21.15.2:0/2224214092 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fea48012e60 con 0x5629b05f75d0 2024-09-19T06:23:19.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.058+0000 7fea5f777740 10 client.18213 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:19.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.058+0000 7fea5f777740 1 -- 172.21.15.2:0/2224214092 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5629b0610ae0 con 0x5629b05f75d0 2024-09-19T06:23:19.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.058+0000 7fea3e7fc640 1 -- 172.21.15.2:0/2224214092 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fea50036070 con 0x5629b05f75d0 2024-09-19T06:23:19.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.059+0000 7fea3e7fc640 1 -- 172.21.15.2:0/2224214092 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fea48022560 con 0x5629b05f75d0 2024-09-19T06:23:19.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.059+0000 7fea5f777740 10 client.18213 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:19.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.059+0000 7fea5f777740 10 client.18213 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:23:19.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.059+0000 7fea5f777740 20 client.18213 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:19.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.059+0000 7fea5f777740 1 --2- 172.21.15.2:0/2224214092 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5629b0611fa0 0x5629b06143b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:19.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.059+0000 7fea5f777740 4 client.18213 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:23:19.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.059+0000 7fea5f777740 1 -- 172.21.15.2:0/2224214092 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5629b056a860 con 0x5629b0611fa0 2024-09-19T06:23:19.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.059+0000 7fea4ffff640 1 --2- 172.21.15.2:0/2224214092 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5629b0611fa0 0x5629b06143b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:19.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.059+0000 7fea4ffff640 1 --2- 172.21.15.2:0/2224214092 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5629b0611fa0 0x5629b06143b0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1e65111380f44af7 server_cookie=92ea195fc2a9d7fe in_seq=0 out_seq=0 2024-09-19T06:23:19.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.059+0000 7fea3e7fc640 10 client.18213 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:23:19.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.060+0000 7fea3e7fc640 1 -- 172.21.15.2:0/2224214092 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5629b056a860 con 0x5629b0611fa0 2024-09-19T06:23:19.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.060+0000 7fea3e7fc640 10 client.18213 handle_command_reply: tid=0 2024-09-19T06:23:19.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.060+0000 7fea5f777740 1 client.18213 shutdown 2024-09-19T06:23:19.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.060+0000 7fea5f777740 1 -- 172.21.15.2:0/2224214092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629b05f75d0 msgr2=0x5629b0601d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:19.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.060+0000 7fea5f777740 1 --2- 172.21.15.2:0/2224214092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629b05f75d0 0x5629b0601d80 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fea48012750 tx=0x7fea48012c10 comp rx=0 tx=0).stop 2024-09-19T06:23:19.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.060+0000 7fea5f777740 1 -- 172.21.15.2:0/2224214092 shutdown_connections 2024-09-19T06:23:19.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.060+0000 7fea5f777740 1 --2- 172.21.15.2:0/2224214092 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5629b0611fa0 0x5629b06143b0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:19.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.060+0000 7fea5f777740 1 --2- 172.21.15.2:0/2224214092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b0602370 0x5629b05ff640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:19.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.060+0000 7fea5f777740 1 --2- 172.21.15.2:0/2224214092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629b05f8b40 0x5629b05ff030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:19.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.060+0000 7fea5f777740 1 --2- 172.21.15.2:0/2224214092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629b05f75d0 0x5629b0601d80 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:19.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.060+0000 7fea3e7fc640 0 client.18213 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:23:19.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.060+0000 7fea5f777740 1 -- 172.21.15.2:0/2224214092 >> 172.21.15.2:0/2224214092 conn(0x5629b05c0310 msgr2=0x5629b05f9960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:19.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.060+0000 7fea5f777740 1 -- 172.21.15.2:0/2224214092 shutdown_connections 2024-09-19T06:23:19.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.060+0000 7fea5f777740 1 -- 172.21.15.2:0/2224214092 wait complete. 2024-09-19T06:23:19.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.060+0000 7fea5f777740 20 client.18213 trim_cache size 0 max 16384 2024-09-19T06:23:19.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.073+0000 7fea5f777740 1 Processor -- start 2024-09-19T06:23:19.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.074+0000 7fea5f777740 1 -- start start 2024-09-19T06:23:19.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.074+0000 7fea5f777740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629b05f75d0 0x5629b05fa120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:19.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.074+0000 7fea5f777740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b05f8b40 0x5629b05fa660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:19.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.074+0000 7fea5f777740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629b0602370 0x5629b0619c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:19.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.074+0000 7fea5f777740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fea581b20c0 con 0x5629b0602370 2024-09-19T06:23:19.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.074+0000 7fea5f777740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fea581af990 con 0x5629b05f75d0 2024-09-19T06:23:19.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.074+0000 7fea5f777740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fea581ad800 con 0x5629b05f8b40 2024-09-19T06:23:19.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.074+0000 7fea577fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629b0602370 0x5629b0619c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:19.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.074+0000 7fea577fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629b0602370 0x5629b0619c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39134/0 (socket says 172.21.15.2:39134) 2024-09-19T06:23:19.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.074+0000 7fea577fe640 1 -- 172.21.15.2:0/2373361631 learned_addr learned my addr 172.21.15.2:0/2373361631 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:19.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.074+0000 7fea4ffff640 1 --2- 172.21.15.2:0/2373361631 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b05f8b40 0x5629b05fa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:19.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.074+0000 7fea56ffd640 1 --2- 172.21.15.2:0/2373361631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629b05f75d0 0x5629b05fa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:19.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.074+0000 7fea577fe640 1 -- 172.21.15.2:0/2373361631 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b05f8b40 msgr2=0x5629b05fa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:19.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.074+0000 7fea577fe640 1 --2- 172.21.15.2:0/2373361631 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b05f8b40 0x5629b05fa660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:19.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.074+0000 7fea577fe640 1 -- 172.21.15.2:0/2373361631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629b05f75d0 msgr2=0x5629b05fa120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:19.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.074+0000 7fea577fe640 1 --2- 172.21.15.2:0/2373361631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629b05f75d0 0x5629b05fa120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:19.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.074+0000 7fea577fe640 1 -- 172.21.15.2:0/2373361631 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629b05f4960 con 0x5629b0602370 2024-09-19T06:23:19.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.075+0000 7fea577fe640 1 --2- 172.21.15.2:0/2373361631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629b0602370 0x5629b0619c80 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fea50031e90 tx=0x7fea50009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7662bebf4028e389 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:19.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.075+0000 7fea4cff9640 1 -- 172.21.15.2:0/2373361631 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea5005e070 con 0x5629b0602370 2024-09-19T06:23:19.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.075+0000 7fea4cff9640 1 -- 172.21.15.2:0/2373361631 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fea500319f0 con 0x5629b0602370 2024-09-19T06:23:19.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.075+0000 7fea4cff9640 1 -- 172.21.15.2:0/2373361631 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea5004d050 con 0x5629b0602370 2024-09-19T06:23:19.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.075+0000 7fea5f777740 1 -- 172.21.15.2:0/2373361631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629b0602370 msgr2=0x5629b0619c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:19.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.075+0000 7fea5f777740 1 --2- 172.21.15.2:0/2373361631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629b0602370 0x5629b0619c80 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fea50031e90 tx=0x7fea50009800 comp rx=0 tx=0).stop 2024-09-19T06:23:19.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.076+0000 7fea5f777740 1 -- 172.21.15.2:0/2373361631 shutdown_connections 2024-09-19T06:23:19.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.076+0000 7fea5f777740 1 --2- 172.21.15.2:0/2373361631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629b0602370 0x5629b0619c80 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:19.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.076+0000 7fea5f777740 1 --2- 172.21.15.2:0/2373361631 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b05f8b40 0x5629b05fa660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:19.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.076+0000 7fea5f777740 1 --2- 172.21.15.2:0/2373361631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629b05f75d0 0x5629b05fa120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:19.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.076+0000 7fea5f777740 1 -- 172.21.15.2:0/2373361631 >> 172.21.15.2:0/2373361631 conn(0x5629b05c0310 msgr2=0x5629b05f2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:19.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.076+0000 7fea5f777740 1 -- 172.21.15.2:0/2373361631 shutdown_connections 2024-09-19T06:23:19.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.076+0000 7fea5f777740 1 -- 172.21.15.2:0/2373361631 wait complete. 2024-09-19T06:23:19.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.076+0000 7fea5f777740 1 -- start start 2024-09-19T06:23:19.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.076+0000 7fea5f777740 1 Processor -- start 2024-09-19T06:23:19.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.076+0000 7fea5f777740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629b05f75d0 0x5629b060a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:19.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.076+0000 7fea5f777740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629b05f8b40 0x5629b060a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:19.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.076+0000 7fea5f777740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b0602370 0x5629b0607390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:19.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.076+0000 7fea5f777740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fea581ade50 con 0x5629b05f8b40 2024-09-19T06:23:19.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.076+0000 7fea5f777740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fea581af2c0 con 0x5629b05f75d0 2024-09-19T06:23:19.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.076+0000 7fea5f777740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fea581ae520 con 0x5629b0602370 2024-09-19T06:23:19.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.076+0000 7fea5f777740 10 client.0 _ll_register_callbacks cb 0x7fea4800a630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:19.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.076+0000 7fea4ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629b05f8b40 0x5629b060a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:19.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.076+0000 7fea4ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629b05f8b40 0x5629b060a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39136/0 (socket says 172.21.15.2:39136) 2024-09-19T06:23:19.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.076+0000 7fea4ffff640 1 -- 172.21.15.2:0/785708253 learned_addr learned my addr 172.21.15.2:0/785708253 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:19.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.077+0000 7fea56ffd640 1 --2- 172.21.15.2:0/785708253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629b05f75d0 0x5629b060a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:19.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.077+0000 7fea577fe640 1 --2- 172.21.15.2:0/785708253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b0602370 0x5629b0607390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:19.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.077+0000 7fea4ffff640 1 -- 172.21.15.2:0/785708253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b0602370 msgr2=0x5629b0607390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:19.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.077+0000 7fea4ffff640 1 --2- 172.21.15.2:0/785708253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b0602370 0x5629b0607390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:19.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.077+0000 7fea4ffff640 1 -- 172.21.15.2:0/785708253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629b05f75d0 msgr2=0x5629b060a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:19.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.077+0000 7fea4ffff640 1 --2- 172.21.15.2:0/785708253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629b05f75d0 0x5629b060a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:19.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.077+0000 7fea4ffff640 1 -- 172.21.15.2:0/785708253 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629b05fffd0 con 0x5629b05f8b40 2024-09-19T06:23:19.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.077+0000 7fea56ffd640 1 --2- 172.21.15.2:0/785708253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629b05f75d0 0x5629b060a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:19.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.077+0000 7fea4ffff640 1 --2- 172.21.15.2:0/785708253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629b05f8b40 0x5629b060a900 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fea4000fca0 tx=0x7fea4006ddb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ca01c0954a2aeea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:19.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.077+0000 7fea3e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:19.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.077+0000 7fea3e7fc640 1 -- 172.21.15.2:0/785708253 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4009c030 con 0x5629b05f8b40 2024-09-19T06:23:19.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.077+0000 7fea3e7fc640 1 -- 172.21.15.2:0/785708253 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7fea4000f740 con 0x5629b05f8b40 2024-09-19T06:23:19.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.077+0000 7fea5f777740 1 -- 172.21.15.2:0/785708253 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea500319f0 con 0x5629b05f8b40 2024-09-19T06:23:19.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.077+0000 7fea3e7fc640 1 -- 172.21.15.2:0/785708253 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fea400a03e0 con 0x5629b05f8b40 2024-09-19T06:23:19.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.077+0000 7fea5f777740 10 client.18219 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:19.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.077+0000 7fea5f777740 1 -- 172.21.15.2:0/785708253 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5629b067d130 con 0x5629b05f8b40 2024-09-19T06:23:19.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.077+0000 7fea3e7fc640 1 -- 172.21.15.2:0/785708253 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fea500319f0 con 0x5629b05f8b40 2024-09-19T06:23:19.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.078+0000 7fea3e7fc640 1 -- 172.21.15.2:0/785708253 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fea400a4810 con 0x5629b05f8b40 2024-09-19T06:23:19.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.078+0000 7fea5f777740 10 client.18219 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:19.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.078+0000 7fea5f777740 10 client.18219 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:23:19.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.078+0000 7fea5f777740 20 client.18219 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:19.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.078+0000 7fea5f777740 1 --2- 172.21.15.2:0/785708253 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5629b067d7b0 0x5629b067fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:19.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.078+0000 7fea5f777740 4 client.18219 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:23:19.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.078+0000 7fea5f777740 1 -- 172.21.15.2:0/785708253 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5629b0564d70 con 0x5629b067d7b0 2024-09-19T06:23:19.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.078+0000 7fea56ffd640 1 --2- 172.21.15.2:0/785708253 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5629b067d7b0 0x5629b067fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:19.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.078+0000 7fea56ffd640 1 --2- 172.21.15.2:0/785708253 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5629b067d7b0 0x5629b067fba0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5cef51c5d4075b29 server_cookie=b6a1437150235bd5 in_seq=0 out_seq=0 2024-09-19T06:23:19.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.078+0000 7fea3e7fc640 10 client.18219 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:23:19.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.078+0000 7fea3e7fc640 1 -- 172.21.15.2:0/785708253 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5629b0564d70 con 0x5629b067d7b0 2024-09-19T06:23:19.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.078+0000 7fea3e7fc640 10 client.18219 handle_command_reply: tid=0 2024-09-19T06:23:19.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.079+0000 7fea5f777740 1 client.18219 shutdown 2024-09-19T06:23:19.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.079+0000 7fea5f777740 1 -- 172.21.15.2:0/785708253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629b05f8b40 msgr2=0x5629b060a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:19.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.079+0000 7fea5f777740 1 --2- 172.21.15.2:0/785708253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629b05f8b40 0x5629b060a900 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fea4000fca0 tx=0x7fea4006ddb0 comp rx=0 tx=0).stop 2024-09-19T06:23:19.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.079+0000 7fea5f777740 1 -- 172.21.15.2:0/785708253 shutdown_connections 2024-09-19T06:23:19.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.079+0000 7fea5f777740 1 --2- 172.21.15.2:0/785708253 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x5629b067d7b0 0x5629b067fba0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:19.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.079+0000 7fea5f777740 1 --2- 172.21.15.2:0/785708253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b0602370 0x5629b0607390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:19.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.079+0000 7fea5f777740 1 --2- 172.21.15.2:0/785708253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629b05f8b40 0x5629b060a900 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:19.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.079+0000 7fea5f777740 1 --2- 172.21.15.2:0/785708253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629b05f75d0 0x5629b060a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:19.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.079+0000 7fea5f777740 1 -- 172.21.15.2:0/785708253 >> 172.21.15.2:0/785708253 conn(0x5629b05c0310 msgr2=0x5629b0600890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:19.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.079+0000 7fea3e7fc640 0 client.18219 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:23:19.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.079+0000 7fea5f777740 1 -- 172.21.15.2:0/785708253 shutdown_connections 2024-09-19T06:23:19.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.079+0000 7fea5f777740 1 -- 172.21.15.2:0/785708253 wait complete. 2024-09-19T06:23:19.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.079+0000 7fea5f777740 20 client.18219 trim_cache size 0 max 16384 2024-09-19T06:23:19.086 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:23:19.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.080+0000 7fea5d39e640 1 -- 172.21.15.2:0/2525318703 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fea440a3430 msgr2=0x7fea440a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:19.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.080+0000 7fea5d39e640 1 --2- 172.21.15.2:0/2525318703 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fea440a3430 0x7fea440a58f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fea50009890 tx=0x7fea50036000 comp rx=0 tx=0).stop 2024-09-19T06:23:19.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.080+0000 7fea5d39e640 1 -- 172.21.15.2:0/2525318703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea58101430 msgr2=0x7fea580fd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:19.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.080+0000 7fea5d39e640 1 --2- 172.21.15.2:0/2525318703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea58101430 0x7fea580fd260 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fea4000c920 tx=0x7fea4000cd20 comp rx=0 tx=0).stop 2024-09-19T06:23:19.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.080+0000 7fea5d39e640 1 -- 172.21.15.2:0/2525318703 shutdown_connections 2024-09-19T06:23:19.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.080+0000 7fea5d39e640 1 --2- 172.21.15.2:0/2525318703 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fea440a3430 0x7fea440a58f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:19.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.080+0000 7fea5d39e640 1 --2- 172.21.15.2:0/2525318703 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea58106a90 0x7fea580fd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:19.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.080+0000 7fea5d39e640 1 --2- 172.21.15.2:0/2525318703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea58101430 0x7fea580fd260 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:19.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.080+0000 7fea5d39e640 1 --2- 172.21.15.2:0/2525318703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea58100a90 0x7fea580fcd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:19.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.080+0000 7fea5d39e640 1 -- 172.21.15.2:0/2525318703 >> 172.21.15.2:0/2525318703 conn(0x7fea580fc7d0 msgr2=0x7fea5806a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:19.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.080+0000 7fea5d39e640 1 -- 172.21.15.2:0/2525318703 shutdown_connections 2024-09-19T06:23:19.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:19.080+0000 7fea5d39e640 1 -- 172.21.15.2:0/2525318703 wait complete. 2024-09-19T06:23:19.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:19 smithi002 ceph-mon[30982]: pgmap v264: 97 pgs: 97 active+clean; 1.9 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 209 B/s wr, 6 op/s 2024-09-19T06:23:19.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:19 smithi090 ceph-mon[34497]: pgmap v264: 97 pgs: 97 active+clean; 1.9 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 209 B/s wr, 6 op/s 2024-09-19T06:23:19.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:19 smithi089 ceph-mon[34160]: pgmap v264: 97 pgs: 97 active+clean; 1.9 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 209 B/s wr, 6 op/s 2024-09-19T06:23:19.809 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:23:20.067 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:23:20.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.514+0000 7f1bc6ac6640 1 -- 172.21.15.2:0/412149843 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bc0101420 msgr2=0x7f1bc010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:20.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.514+0000 7f1bc6ac6640 1 --2- 172.21.15.2:0/412149843 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bc0101420 0x7f1bc010d950 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8009cd0 tx=0x7f1bb802a8e0 comp rx=0 tx=0).stop 2024-09-19T06:23:20.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.514+0000 7f1bc6ac6640 1 -- 172.21.15.2:0/412149843 shutdown_connections 2024-09-19T06:23:20.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.514+0000 7f1bc6ac6640 1 --2- 172.21.15.2:0/412149843 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bc0101420 0x7f1bc010d950 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:20.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.514+0000 7f1bc6ac6640 1 --2- 172.21.15.2:0/412149843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1bc0100a80 0x7f1bc0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:20.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.514+0000 7f1bc6ac6640 1 --2- 172.21.15.2:0/412149843 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1bc0106a80 0x7f1bc0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:20.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.514+0000 7f1bc6ac6640 1 -- 172.21.15.2:0/412149843 >> 172.21.15.2:0/412149843 conn(0x7f1bc00fc7a0 msgr2=0x7f1bc00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:20.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.515+0000 7f1bc6ac6640 1 -- 172.21.15.2:0/412149843 shutdown_connections 2024-09-19T06:23:20.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.515+0000 7f1bc6ac6640 1 -- 172.21.15.2:0/412149843 wait complete. 2024-09-19T06:23:20.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.515+0000 7f1bc6ac6640 1 Processor -- start 2024-09-19T06:23:20.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.515+0000 7f1bc6ac6640 1 -- start start 2024-09-19T06:23:20.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.515+0000 7f1bc6ac6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bc0100a80 0x7f1bc00fce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:20.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.515+0000 7f1bc6ac6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1bc0101420 0x7f1bc00fd370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:20.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.515+0000 7f1bc6ac6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1bc0106a80 0x7f1bc00fd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:20.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.515+0000 7f1bc6ac6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc0110d30 con 0x7f1bc0100a80 2024-09-19T06:23:20.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.515+0000 7f1bc6ac6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc0110bb0 con 0x7f1bc0106a80 2024-09-19T06:23:20.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.515+0000 7f1bc6ac6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc0110eb0 con 0x7f1bc0101420 2024-09-19T06:23:20.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.516+0000 7f1bc4862640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bc0100a80 0x7f1bc00fce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:20.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.516+0000 7f1bc4862640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bc0100a80 0x7f1bc00fce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39158/0 (socket says 172.21.15.2:39158) 2024-09-19T06:23:20.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.516+0000 7f1bc4862640 1 -- 172.21.15.2:0/813929445 learned_addr learned my addr 172.21.15.2:0/813929445 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:20.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.516+0000 7f1bb7fff640 1 --2- 172.21.15.2:0/813929445 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1bc0101420 0x7f1bc00fd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:20.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.516+0000 7f1bc5063640 1 --2- 172.21.15.2:0/813929445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1bc0106a80 0x7f1bc00fd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:20.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.516+0000 7f1bc4862640 1 -- 172.21.15.2:0/813929445 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1bc0101420 msgr2=0x7f1bc00fd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:20.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.516+0000 7f1bc4862640 1 --2- 172.21.15.2:0/813929445 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1bc0101420 0x7f1bc00fd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:20.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.516+0000 7f1bc4862640 1 -- 172.21.15.2:0/813929445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1bc0106a80 msgr2=0x7f1bc00fd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:20.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.516+0000 7f1bc4862640 1 --2- 172.21.15.2:0/813929445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1bc0106a80 0x7f1bc00fd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:20.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.516+0000 7f1bc4862640 1 -- 172.21.15.2:0/813929445 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc01a6920 con 0x7f1bc0100a80 2024-09-19T06:23:20.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.516+0000 7f1bc4862640 1 --2- 172.21.15.2:0/813929445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bc0100a80 0x7f1bc00fce30 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc00d950 tx=0x7f1bbc00dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:20.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.516+0000 7f1bb5ffb640 1 -- 172.21.15.2:0/813929445 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc017030 con 0x7f1bc0100a80 2024-09-19T06:23:20.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.516+0000 7f1bb5ffb640 1 -- 172.21.15.2:0/813929445 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1bbc004020 con 0x7f1bc0100a80 2024-09-19T06:23:20.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.516+0000 7f1bc6ac6640 1 -- 172.21.15.2:0/813929445 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bc01a6c10 con 0x7f1bc0100a80 2024-09-19T06:23:20.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.516+0000 7f1bb5ffb640 1 -- 172.21.15.2:0/813929445 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc005570 con 0x7f1bc0100a80 2024-09-19T06:23:20.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.517+0000 7f1bc6ac6640 1 -- 172.21.15.2:0/813929445 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bc01a7150 con 0x7f1bc0100a80 2024-09-19T06:23:20.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.519+0000 7f1bb5ffb640 1 -- 172.21.15.2:0/813929445 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f1bbc0041d0 con 0x7f1bc0100a80 2024-09-19T06:23:20.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.520+0000 7f1bc8e9f740 1 Processor -- start 2024-09-19T06:23:20.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.520+0000 7f1bc8e9f740 1 -- start start 2024-09-19T06:23:20.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.520+0000 7f1bc8e9f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fac1c8b40 0x561fac1c7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:20.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.520+0000 7f1bc8e9f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fac1c75d0 0x561fac1c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:20.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.520+0000 7f1bc8e9f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561fac1d2370 0x561fac1d4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:20.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.520+0000 7f1bc8e9f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561fac12d2f0 con 0x561fac1c75d0 2024-09-19T06:23:20.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.520+0000 7f1bc8e9f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x561fac0d4cf0 con 0x561fac1d2370 2024-09-19T06:23:20.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.520+0000 7f1bc8e9f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x561fac1292b0 con 0x561fac1c8b40 2024-09-19T06:23:20.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.520+0000 7f1bc4862640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fac1c75d0 0x561fac1c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:20.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.520+0000 7f1bc4862640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fac1c75d0 0x561fac1c7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39166/0 (socket says 172.21.15.2:39166) 2024-09-19T06:23:20.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.520+0000 7f1bc4862640 1 -- 172.21.15.2:0/2279926452 learned_addr learned my addr 172.21.15.2:0/2279926452 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:20.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.520+0000 7f1bb5ffb640 1 --2- 172.21.15.2:0/813929445 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f1ba80a33b0 0x7f1ba80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:20.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.520+0000 7f1bc5063640 1 --2- 172.21.15.2:0/2279926452 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fac1c8b40 0x561fac1c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:20.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.521+0000 7f1bb7fff640 1 --2- 172.21.15.2:0/2279926452 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561fac1d2370 0x561fac1d4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:20.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.521+0000 7f1bc5063640 1 --2- 172.21.15.2:0/813929445 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f1ba80a33b0 0x7f1ba80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:20.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.521+0000 7f1bb5ffb640 1 -- 172.21.15.2:0/813929445 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f1bbc0cf700 con 0x7f1bc0100a80 2024-09-19T06:23:20.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.521+0000 7f1bc4862640 1 -- 172.21.15.2:0/2279926452 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fac1c8b40 msgr2=0x561fac1c7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:20.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.521+0000 7f1bc4862640 1 --2- 172.21.15.2:0/2279926452 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fac1c8b40 0x561fac1c7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:20.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.521+0000 7f1bc4862640 1 -- 172.21.15.2:0/2279926452 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561fac1d2370 msgr2=0x561fac1d4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:20.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.521+0000 7f1bc4862640 1 --2- 172.21.15.2:0/2279926452 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561fac1d2370 0x561fac1d4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:20.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.521+0000 7f1bc4862640 1 -- 172.21.15.2:0/2279926452 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fac0b93a0 con 0x561fac1c75d0 2024-09-19T06:23:20.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.521+0000 7f1bc4862640 1 --2- 172.21.15.2:0/2279926452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fac1c75d0 0x561fac1c7a10 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc0ccd60 tx=0x7f1bbc00df90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fba5221c3e3e87f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:20.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.521+0000 7f1bc5063640 1 --2- 172.21.15.2:0/813929445 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f1ba80a33b0 0x7f1ba80a5870 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8033040 tx=0x7f1bb80095c0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:20.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.521+0000 7f1ba6ffd640 1 -- 172.21.15.2:0/2279926452 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc09b4c0 con 0x561fac1c75d0 2024-09-19T06:23:20.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.521+0000 7f1ba6ffd640 1 -- 172.21.15.2:0/2279926452 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1bbc09c080 con 0x561fac1c75d0 2024-09-19T06:23:20.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.521+0000 7f1ba6ffd640 1 -- 172.21.15.2:0/2279926452 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc09b2e0 con 0x561fac1c75d0 2024-09-19T06:23:20.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.522+0000 7f1bc8e9f740 1 -- 172.21.15.2:0/2279926452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fac1c75d0 msgr2=0x561fac1c7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:20.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.522+0000 7f1bc8e9f740 1 --2- 172.21.15.2:0/2279926452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fac1c75d0 0x561fac1c7a10 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc0ccd60 tx=0x7f1bbc00df90 comp rx=0 tx=0).stop 2024-09-19T06:23:20.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.522+0000 7f1bc8e9f740 1 -- 172.21.15.2:0/2279926452 shutdown_connections 2024-09-19T06:23:20.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.522+0000 7f1bc8e9f740 1 --2- 172.21.15.2:0/2279926452 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561fac1d2370 0x561fac1d4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:20.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.522+0000 7f1bc8e9f740 1 --2- 172.21.15.2:0/2279926452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fac1c75d0 0x561fac1c7a10 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:20.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.522+0000 7f1bc8e9f740 1 --2- 172.21.15.2:0/2279926452 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fac1c8b40 0x561fac1c7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:20.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.522+0000 7f1bc8e9f740 1 -- 172.21.15.2:0/2279926452 >> 172.21.15.2:0/2279926452 conn(0x561fac190310 msgr2=0x561fac1c3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:20.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.522+0000 7f1bc8e9f740 1 -- 172.21.15.2:0/2279926452 shutdown_connections 2024-09-19T06:23:20.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.522+0000 7f1bc8e9f740 1 -- 172.21.15.2:0/2279926452 wait complete. 2024-09-19T06:23:20.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.522+0000 7f1bc8e9f740 1 -- start start 2024-09-19T06:23:20.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.522+0000 7f1bc8e9f740 1 Processor -- start 2024-09-19T06:23:20.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.523+0000 7f1bc8e9f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561fac1c75d0 0x561fac1d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:20.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.523+0000 7f1bc8e9f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fac1c8b40 0x561fac1cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:20.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.523+0000 7f1bc8e9f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fac1d2370 0x561fac1cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:20.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.523+0000 7f1bc8e9f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561fac1d4fb0 con 0x561fac1c8b40 2024-09-19T06:23:20.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.523+0000 7f1bc8e9f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x561fac0e8060 con 0x561fac1c75d0 2024-09-19T06:23:20.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.523+0000 7f1bc8e9f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x561fac1d5130 con 0x561fac1d2370 2024-09-19T06:23:20.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.523+0000 7f1bc8e9f740 10 client.0 _ll_register_callbacks cb 0x561fabe3b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:20.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.523+0000 7f1bb7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fac1c8b40 0x561fac1cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:20.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.523+0000 7f1bb7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fac1c8b40 0x561fac1cf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39180/0 (socket says 172.21.15.2:39180) 2024-09-19T06:23:20.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.523+0000 7f1bb7fff640 1 -- 172.21.15.2:0/3936827832 learned_addr learned my addr 172.21.15.2:0/3936827832 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:20.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.523+0000 7f1bc5063640 1 --2- 172.21.15.2:0/3936827832 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fac1d2370 0x561fac1cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:20.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.523+0000 7f1bc4862640 1 --2- 172.21.15.2:0/3936827832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561fac1c75d0 0x561fac1d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:20.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.523+0000 7f1bb7fff640 1 -- 172.21.15.2:0/3936827832 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fac1d2370 msgr2=0x561fac1cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:20.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.523+0000 7f1bb7fff640 1 --2- 172.21.15.2:0/3936827832 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fac1d2370 0x561fac1cf7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:20.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.523+0000 7f1bb7fff640 1 -- 172.21.15.2:0/3936827832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561fac1c75d0 msgr2=0x561fac1d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:20.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.523+0000 7f1bb7fff640 1 --2- 172.21.15.2:0/3936827832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561fac1c75d0 0x561fac1d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:20.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.523+0000 7f1bb7fff640 1 -- 172.21.15.2:0/3936827832 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fabe9e3c0 con 0x561fac1c8b40 2024-09-19T06:23:20.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.524+0000 7f1bb7fff640 1 --2- 172.21.15.2:0/3936827832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fac1c8b40 0x561fac1cf050 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0010a50 tx=0x7f1bb0010f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f9210a35ebde264 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:20.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.524+0000 7f1b9ffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:20.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.524+0000 7f1b9ffff640 1 -- 172.21.15.2:0/3936827832 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb000fbd0 con 0x561fac1c8b40 2024-09-19T06:23:20.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.524+0000 7f1b9ffff640 1 -- 172.21.15.2:0/3936827832 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f1bb000fd70 con 0x561fac1c8b40 2024-09-19T06:23:20.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.524+0000 7f1bc8e9f740 1 -- 172.21.15.2:0/3936827832 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1bbc09c080 con 0x561fac1c8b40 2024-09-19T06:23:20.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.524+0000 7f1b9ffff640 1 -- 172.21.15.2:0/3936827832 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1bb0005020 con 0x561fac1c8b40 2024-09-19T06:23:20.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.524+0000 7f1bc8e9f740 10 client.18231 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:20.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.524+0000 7f1bc8e9f740 1 -- 172.21.15.2:0/3936827832 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561fac1e0b20 con 0x561fac1c8b40 2024-09-19T06:23:20.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.524+0000 7f1b9ffff640 1 -- 172.21.15.2:0/3936827832 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1bbc09c080 con 0x561fac1c8b40 2024-09-19T06:23:20.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.524+0000 7f1b9ffff640 1 -- 172.21.15.2:0/3936827832 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f1bb0019410 con 0x561fac1c8b40 2024-09-19T06:23:20.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.524+0000 7f1bc8e9f740 10 client.18231 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:20.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.524+0000 7f1bc8e9f740 10 client.18231 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:20.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.525+0000 7f1bc8e9f740 20 client.18231 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:20.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.525+0000 7f1bc8e9f740 1 --2- 172.21.15.2:0/3936827832 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x561fac1e1fe0 0x561fac1e4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:20.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.525+0000 7f1bc8e9f740 4 client.18231 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:23:20.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.525+0000 7f1bc8e9f740 1 -- 172.21.15.2:0/3936827832 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561fac13a860 con 0x561fac1e1fe0 2024-09-19T06:23:20.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.525+0000 7f1bc4862640 1 --2- 172.21.15.2:0/3936827832 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x561fac1e1fe0 0x561fac1e4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:20.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.525+0000 7f1bc4862640 1 --2- 172.21.15.2:0/3936827832 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x561fac1e1fe0 0x561fac1e4480 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e52f136d56a984f server_cookie=43801a2d106de3d8 in_seq=0 out_seq=0 2024-09-19T06:23:20.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.525+0000 7f1b9ffff640 10 client.18231 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:20.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.526+0000 7f1b9ffff640 1 -- 172.21.15.2:0/3936827832 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561fac13a860 con 0x561fac1e1fe0 2024-09-19T06:23:20.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.526+0000 7f1b9ffff640 10 client.18231 handle_command_reply: tid=0 2024-09-19T06:23:20.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.526+0000 7f1bc8e9f740 1 client.18231 shutdown 2024-09-19T06:23:20.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.526+0000 7f1bc8e9f740 1 -- 172.21.15.2:0/3936827832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fac1c8b40 msgr2=0x561fac1cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:20.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.526+0000 7f1bc8e9f740 1 --2- 172.21.15.2:0/3936827832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fac1c8b40 0x561fac1cf050 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0010a50 tx=0x7f1bb0010f10 comp rx=0 tx=0).stop 2024-09-19T06:23:20.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.526+0000 7f1bc8e9f740 1 -- 172.21.15.2:0/3936827832 shutdown_connections 2024-09-19T06:23:20.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.526+0000 7f1bc8e9f740 1 --2- 172.21.15.2:0/3936827832 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fac1d2370 0x561fac1cf7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:20.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.526+0000 7f1bc8e9f740 1 --2- 172.21.15.2:0/3936827832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fac1c8b40 0x561fac1cf050 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:20.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.526+0000 7f1bc8e9f740 1 --2- 172.21.15.2:0/3936827832 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x561fac1e1fe0 0x561fac1e4480 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:20.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.526+0000 7f1bc8e9f740 1 --2- 172.21.15.2:0/3936827832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561fac1c75d0 0x561fac1d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:20.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.526+0000 7f1b9ffff640 0 client.18231 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:20.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.526+0000 7f1bc8e9f740 1 -- 172.21.15.2:0/3936827832 >> 172.21.15.2:0/3936827832 conn(0x561fac190310 msgr2=0x561fac1c9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:20.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.526+0000 7f1bc8e9f740 1 -- 172.21.15.2:0/3936827832 shutdown_connections 2024-09-19T06:23:20.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.526+0000 7f1bc8e9f740 1 -- 172.21.15.2:0/3936827832 wait complete. 2024-09-19T06:23:20.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.527+0000 7f1bc8e9f740 20 client.18231 trim_cache size 0 max 16384 2024-09-19T06:23:20.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.540+0000 7f1bc8e9f740 1 Processor -- start 2024-09-19T06:23:20.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.540+0000 7f1bc8e9f740 1 -- start start 2024-09-19T06:23:20.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.540+0000 7f1bc8e9f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561fac1c75d0 0x561fac1d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:20.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.540+0000 7f1bc8e9f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fac1c8b40 0x561fac1e9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:20.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.540+0000 7f1bc8e9f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fac1d2370 0x561fac1ea290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:20.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.540+0000 7f1bc8e9f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc01b22c0 con 0x561fac1c8b40 2024-09-19T06:23:20.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.540+0000 7f1bc8e9f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc01afb90 con 0x561fac1c75d0 2024-09-19T06:23:20.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.540+0000 7f1bc8e9f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc01ada00 con 0x561fac1d2370 2024-09-19T06:23:20.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.540+0000 7f1bb7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fac1c8b40 0x561fac1e9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:20.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.540+0000 7f1bb7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fac1c8b40 0x561fac1e9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39184/0 (socket says 172.21.15.2:39184) 2024-09-19T06:23:20.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.540+0000 7f1bb7fff640 1 -- 172.21.15.2:0/4208727673 learned_addr learned my addr 172.21.15.2:0/4208727673 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:20.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.540+0000 7f1bc5063640 1 --2- 172.21.15.2:0/4208727673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fac1d2370 0x561fac1ea290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:20.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.540+0000 7f1bc4862640 1 --2- 172.21.15.2:0/4208727673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561fac1c75d0 0x561fac1d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:20.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.540+0000 7f1bb7fff640 1 -- 172.21.15.2:0/4208727673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fac1d2370 msgr2=0x561fac1ea290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:20.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.540+0000 7f1bb7fff640 1 --2- 172.21.15.2:0/4208727673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fac1d2370 0x561fac1ea290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:20.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.540+0000 7f1bb7fff640 1 -- 172.21.15.2:0/4208727673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561fac1c75d0 msgr2=0x561fac1d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:20.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.540+0000 7f1bb7fff640 1 --2- 172.21.15.2:0/4208727673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561fac1c75d0 0x561fac1d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:20.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.540+0000 7f1bb7fff640 1 -- 172.21.15.2:0/4208727673 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fac1c8780 con 0x561fac1c8b40 2024-09-19T06:23:20.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.540+0000 7f1bc4862640 1 --2- 172.21.15.2:0/4208727673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561fac1c75d0 0x561fac1d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:20.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.541+0000 7f1bb7fff640 1 --2- 172.21.15.2:0/4208727673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fac1c8b40 0x561fac1e9d50 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0019830 tx=0x7f1bb000f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f1802224608a705 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:20.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.541+0000 7f1ba67fc640 1 -- 172.21.15.2:0/4208727673 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb0019aa0 con 0x561fac1c8b40 2024-09-19T06:23:20.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.541+0000 7f1ba67fc640 1 -- 172.21.15.2:0/4208727673 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1bb0019c40 con 0x561fac1c8b40 2024-09-19T06:23:20.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.541+0000 7f1ba67fc640 1 -- 172.21.15.2:0/4208727673 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb00048c0 con 0x561fac1c8b40 2024-09-19T06:23:20.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.541+0000 7f1bc8e9f740 1 -- 172.21.15.2:0/4208727673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fac1c8b40 msgr2=0x561fac1e9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:20.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.541+0000 7f1bc8e9f740 1 --2- 172.21.15.2:0/4208727673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fac1c8b40 0x561fac1e9d50 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0019830 tx=0x7f1bb000f7f0 comp rx=0 tx=0).stop 2024-09-19T06:23:20.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.541+0000 7f1bc8e9f740 1 -- 172.21.15.2:0/4208727673 shutdown_connections 2024-09-19T06:23:20.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.541+0000 7f1bc8e9f740 1 --2- 172.21.15.2:0/4208727673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fac1d2370 0x561fac1ea290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:20.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.541+0000 7f1bc8e9f740 1 --2- 172.21.15.2:0/4208727673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fac1c8b40 0x561fac1e9d50 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:20.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.541+0000 7f1bc8e9f740 1 --2- 172.21.15.2:0/4208727673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561fac1c75d0 0x561fac1d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:20.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.541+0000 7f1bc8e9f740 1 -- 172.21.15.2:0/4208727673 >> 172.21.15.2:0/4208727673 conn(0x561fac190310 msgr2=0x561fac1d08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:20.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.541+0000 7f1bc8e9f740 1 -- 172.21.15.2:0/4208727673 shutdown_connections 2024-09-19T06:23:20.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.541+0000 7f1bc8e9f740 1 -- 172.21.15.2:0/4208727673 wait complete. 2024-09-19T06:23:20.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.542+0000 7f1bc8e9f740 1 -- start start 2024-09-19T06:23:20.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.542+0000 7f1bc8e9f740 1 Processor -- start 2024-09-19T06:23:20.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.542+0000 7f1bc8e9f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fac1c75d0 0x561fac1da3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:20.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.542+0000 7f1bc8e9f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561fac1c8b40 0x561fac1da930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:20.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.542+0000 7f1bc8e9f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fac1d2370 0x561fac1d73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:20.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.542+0000 7f1bc8e9f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc01ae050 con 0x561fac1d2370 2024-09-19T06:23:20.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.542+0000 7f1bc8e9f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc01af4c0 con 0x561fac1c8b40 2024-09-19T06:23:20.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.542+0000 7f1bc8e9f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc01ae720 con 0x561fac1c75d0 2024-09-19T06:23:20.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.542+0000 7f1bc8e9f740 10 client.0 _ll_register_callbacks cb 0x7f1bb000a820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:20.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.543+0000 7f1bc5063640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fac1d2370 0x561fac1d73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:20.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.543+0000 7f1bc4862640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fac1c75d0 0x561fac1da3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:20.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.543+0000 7f1bc5063640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fac1d2370 0x561fac1d73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39188/0 (socket says 172.21.15.2:39188) 2024-09-19T06:23:20.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.543+0000 7f1bc5063640 1 -- 172.21.15.2:0/212773103 learned_addr learned my addr 172.21.15.2:0/212773103 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:20.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.543+0000 7f1bb7fff640 1 --2- 172.21.15.2:0/212773103 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561fac1c8b40 0x561fac1da930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:20.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.543+0000 7f1bc5063640 1 -- 172.21.15.2:0/212773103 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fac1c75d0 msgr2=0x561fac1da3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:20.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.543+0000 7f1bc5063640 1 --2- 172.21.15.2:0/212773103 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fac1c75d0 0x561fac1da3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:20.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.543+0000 7f1bc5063640 1 -- 172.21.15.2:0/212773103 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561fac1c8b40 msgr2=0x561fac1da930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:20.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.543+0000 7f1bc5063640 1 --2- 172.21.15.2:0/212773103 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561fac1c8b40 0x561fac1da930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:20.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.543+0000 7f1bc5063640 1 -- 172.21.15.2:0/212773103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fac1d7900 con 0x561fac1d2370 2024-09-19T06:23:20.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.543+0000 7f1bc5063640 1 --2- 172.21.15.2:0/212773103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fac1d2370 0x561fac1d73c0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8009cd0 tx=0x7f1bb8032fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee5acf685e663456 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:20.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.543+0000 7f1b9ffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:20.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.543+0000 7f1b9ffff640 1 -- 172.21.15.2:0/212773103 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8004720 con 0x561fac1d2370 2024-09-19T06:23:20.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.543+0000 7f1b9ffff640 1 -- 172.21.15.2:0/212773103 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f1bb80305a0 con 0x561fac1d2370 2024-09-19T06:23:20.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.543+0000 7f1bc8e9f740 1 -- 172.21.15.2:0/212773103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1bb0019c40 con 0x561fac1d2370 2024-09-19T06:23:20.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.543+0000 7f1b9ffff640 1 -- 172.21.15.2:0/212773103 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1bb80307a0 con 0x561fac1d2370 2024-09-19T06:23:20.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.543+0000 7f1bc8e9f740 10 client.18237 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:20.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.543+0000 7f1bc8e9f740 1 -- 172.21.15.2:0/212773103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561fac24d3c0 con 0x561fac1d2370 2024-09-19T06:23:20.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.544+0000 7f1b9ffff640 1 -- 172.21.15.2:0/212773103 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1bb0019c40 con 0x561fac1d2370 2024-09-19T06:23:20.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.544+0000 7f1b9ffff640 1 -- 172.21.15.2:0/212773103 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f1bb8030070 con 0x561fac1d2370 2024-09-19T06:23:20.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.544+0000 7f1bc8e9f740 10 client.18237 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:20.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.544+0000 7f1bc8e9f740 10 client.18237 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:20.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.544+0000 7f1bc8e9f740 20 client.18237 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:20.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.544+0000 7f1bc8e9f740 1 --2- 172.21.15.2:0/212773103 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x561fac24dbc0 0x561fac24ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:20.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.544+0000 7f1bc8e9f740 4 client.18237 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:23:20.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.544+0000 7f1bc8e9f740 1 -- 172.21.15.2:0/212773103 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561fac134d70 con 0x561fac24dbc0 2024-09-19T06:23:20.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.544+0000 7f1bc4862640 1 --2- 172.21.15.2:0/212773103 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x561fac24dbc0 0x561fac24ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:20.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.545+0000 7f1b9ffff640 10 client.18237 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:20.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.545+0000 7f1bc4862640 1 --2- 172.21.15.2:0/212773103 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x561fac24dbc0 0x561fac24ffe0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c51aff9a4a9d0b2f server_cookie=d3c7b5bfe9bf3339 in_seq=0 out_seq=0 2024-09-19T06:23:20.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.545+0000 7f1b9ffff640 1 -- 172.21.15.2:0/212773103 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561fac134d70 con 0x561fac24dbc0 2024-09-19T06:23:20.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.545+0000 7f1b9ffff640 10 client.18237 handle_command_reply: tid=0 2024-09-19T06:23:20.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.545+0000 7f1bc8e9f740 1 client.18237 shutdown 2024-09-19T06:23:20.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.545+0000 7f1bc8e9f740 1 -- 172.21.15.2:0/212773103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fac1d2370 msgr2=0x561fac1d73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:20.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.545+0000 7f1bc8e9f740 1 --2- 172.21.15.2:0/212773103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fac1d2370 0x561fac1d73c0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8009cd0 tx=0x7f1bb8032fd0 comp rx=0 tx=0).stop 2024-09-19T06:23:20.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.545+0000 7f1bc8e9f740 1 -- 172.21.15.2:0/212773103 shutdown_connections 2024-09-19T06:23:20.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.545+0000 7f1bc8e9f740 1 --2- 172.21.15.2:0/212773103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561fac1d2370 0x561fac1d73c0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:20.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.545+0000 7f1bc8e9f740 1 --2- 172.21.15.2:0/212773103 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x561fac24dbc0 0x561fac24ffe0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:20.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.545+0000 7f1bc8e9f740 1 --2- 172.21.15.2:0/212773103 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561fac1c8b40 0x561fac1da930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:20.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.545+0000 7f1bc8e9f740 1 --2- 172.21.15.2:0/212773103 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561fac1c75d0 0x561fac1da3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:20.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.545+0000 7f1bc8e9f740 1 -- 172.21.15.2:0/212773103 >> 172.21.15.2:0/212773103 conn(0x561fac190310 msgr2=0x561fac1d10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:20.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.545+0000 7f1b9ffff640 0 client.18237 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:20.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.545+0000 7f1bc8e9f740 1 -- 172.21.15.2:0/212773103 shutdown_connections 2024-09-19T06:23:20.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.545+0000 7f1bc8e9f740 1 -- 172.21.15.2:0/212773103 wait complete. 2024-09-19T06:23:20.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.545+0000 7f1bc8e9f740 20 client.18237 trim_cache size 0 max 16384 2024-09-19T06:23:20.553 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:23:20.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.546+0000 7f1bc6ac6640 1 -- 172.21.15.2:0/813929445 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f1ba80a33b0 msgr2=0x7f1ba80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:20.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.546+0000 7f1bc6ac6640 1 --2- 172.21.15.2:0/813929445 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f1ba80a33b0 0x7f1ba80a5870 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8033040 tx=0x7f1bb80095c0 comp rx=0 tx=0).stop 2024-09-19T06:23:20.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.546+0000 7f1bc6ac6640 1 -- 172.21.15.2:0/813929445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bc0100a80 msgr2=0x7f1bc00fce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:20.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.546+0000 7f1bc6ac6640 1 --2- 172.21.15.2:0/813929445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bc0100a80 0x7f1bc00fce30 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc00d950 tx=0x7f1bbc00dd50 comp rx=0 tx=0).stop 2024-09-19T06:23:20.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.546+0000 7f1bc6ac6640 1 -- 172.21.15.2:0/813929445 shutdown_connections 2024-09-19T06:23:20.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.546+0000 7f1bc6ac6640 1 --2- 172.21.15.2:0/813929445 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f1ba80a33b0 0x7f1ba80a5870 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:20.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.546+0000 7f1bc6ac6640 1 --2- 172.21.15.2:0/813929445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1bc0106a80 0x7f1bc00fd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:20.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.546+0000 7f1bc6ac6640 1 --2- 172.21.15.2:0/813929445 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1bc0101420 0x7f1bc00fd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:20.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.546+0000 7f1bc6ac6640 1 --2- 172.21.15.2:0/813929445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bc0100a80 0x7f1bc00fce30 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:20.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.546+0000 7f1bc6ac6640 1 -- 172.21.15.2:0/813929445 >> 172.21.15.2:0/813929445 conn(0x7f1bc00fc7a0 msgr2=0x7f1bc006a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:20.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.546+0000 7f1bc6ac6640 1 -- 172.21.15.2:0/813929445 shutdown_connections 2024-09-19T06:23:20.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:20.546+0000 7f1bc6ac6640 1 -- 172.21.15.2:0/813929445 wait complete. 2024-09-19T06:23:21.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:21 smithi090 ceph-mon[34497]: pgmap v265: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T06:23:21.791 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:21 smithi089 ceph-mon[34160]: pgmap v265: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T06:23:21.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:21 smithi002 ceph-mon[30982]: pgmap v265: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T06:23:22.068 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:23:22.069 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:23:22.342 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:23:22.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.773+0000 7f7369a6e640 1 -- 172.21.15.2:0/3040490651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7364101de0 msgr2=0x7f73641021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:22.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.773+0000 7f7369a6e640 1 --2- 172.21.15.2:0/3040490651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7364101de0 0x7f73641021c0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f7354009900 tx=0x7f735402a410 comp rx=0 tx=0).stop 2024-09-19T06:23:22.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.773+0000 7f7369a6e640 1 -- 172.21.15.2:0/3040490651 shutdown_connections 2024-09-19T06:23:22.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.773+0000 7f7369a6e640 1 --2- 172.21.15.2:0/3040490651 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7364106f10 0x7f736410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:22.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.773+0000 7f7369a6e640 1 --2- 172.21.15.2:0/3040490651 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7364102790 0x7f73641067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:22.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.773+0000 7f7369a6e640 1 --2- 172.21.15.2:0/3040490651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7364101de0 0x7f73641021c0 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:22.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.773+0000 7f7369a6e640 1 -- 172.21.15.2:0/3040490651 >> 172.21.15.2:0/3040490651 conn(0x7f73640fd8c0 msgr2=0x7f73640ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:22.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.773+0000 7f7369a6e640 1 -- 172.21.15.2:0/3040490651 shutdown_connections 2024-09-19T06:23:22.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.773+0000 7f7369a6e640 1 -- 172.21.15.2:0/3040490651 wait complete. 2024-09-19T06:23:22.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.774+0000 7f7369a6e640 1 Processor -- start 2024-09-19T06:23:22.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.774+0000 7f7369a6e640 1 -- start start 2024-09-19T06:23:22.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.774+0000 7f7369a6e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7364101de0 0x7f736419a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:22.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.774+0000 7f7369a6e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7364102790 0x7f736419aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:22.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.774+0000 7f7369a6e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7364106f10 0x7f736419edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:22.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.774+0000 7f7369a6e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7364111de0 con 0x7f7364101de0 2024-09-19T06:23:22.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.774+0000 7f7369a6e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7364111c60 con 0x7f7364106f10 2024-09-19T06:23:22.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.774+0000 7f7369a6e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7364111f60 con 0x7f7364102790 2024-09-19T06:23:22.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.775+0000 7f73637fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7364101de0 0x7f736419a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:22.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.775+0000 7f73637fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7364101de0 0x7f736419a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39204/0 (socket says 172.21.15.2:39204) 2024-09-19T06:23:22.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.775+0000 7f73637fe640 1 -- 172.21.15.2:0/3544117551 learned_addr learned my addr 172.21.15.2:0/3544117551 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:22.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.775+0000 7f7362ffd640 1 --2- 172.21.15.2:0/3544117551 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7364102790 0x7f736419aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:22.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.775+0000 7f7363fff640 1 --2- 172.21.15.2:0/3544117551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7364106f10 0x7f736419edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:22.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.775+0000 7f73637fe640 1 -- 172.21.15.2:0/3544117551 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7364102790 msgr2=0x7f736419aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:22.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.775+0000 7f73637fe640 1 --2- 172.21.15.2:0/3544117551 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7364102790 0x7f736419aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:22.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.775+0000 7f73637fe640 1 -- 172.21.15.2:0/3544117551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7364106f10 msgr2=0x7f736419edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:22.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.775+0000 7f73637fe640 1 --2- 172.21.15.2:0/3544117551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7364106f10 0x7f736419edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:22.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.775+0000 7f73637fe640 1 -- 172.21.15.2:0/3544117551 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f736419f4d0 con 0x7f7364101de0 2024-09-19T06:23:22.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.775+0000 7f73637fe640 1 --2- 172.21.15.2:0/3544117551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7364101de0 0x7f736419a520 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f7354006010 tx=0x7f7354004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:22.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.775+0000 7f7360ff9640 1 -- 172.21.15.2:0/3544117551 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735403f030 con 0x7f7364101de0 2024-09-19T06:23:22.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.775+0000 7f7360ff9640 1 -- 172.21.15.2:0/3544117551 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f73540035f0 con 0x7f7364101de0 2024-09-19T06:23:22.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.775+0000 7f7369a6e640 1 -- 172.21.15.2:0/3544117551 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f736419f760 con 0x7f7364101de0 2024-09-19T06:23:22.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.775+0000 7f7360ff9640 1 -- 172.21.15.2:0/3544117551 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7354035070 con 0x7f7364101de0 2024-09-19T06:23:22.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.775+0000 7f7369a6e640 1 -- 172.21.15.2:0/3544117551 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73641a70a0 con 0x7f7364101de0 2024-09-19T06:23:22.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.778+0000 7f7360ff9640 1 -- 172.21.15.2:0/3544117551 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f7354003b10 con 0x7f7364101de0 2024-09-19T06:23:22.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.778+0000 7f736be47740 1 Processor -- start 2024-09-19T06:23:22.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.778+0000 7f736be47740 1 -- start start 2024-09-19T06:23:22.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.778+0000 7f736be47740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559cf9012b60 0x559cf9012f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:22.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.778+0000 7f736be47740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559cf9013480 0x559cf901d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:22.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.778+0000 7f736be47740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559cf901dd40 0x559cf9020130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:22.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.778+0000 7f736be47740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559cf8f78280 con 0x559cf901dd40 2024-09-19T06:23:22.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.778+0000 7f736be47740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x559cf8f1fb10 con 0x559cf9013480 2024-09-19T06:23:22.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.778+0000 7f736be47740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x559cf8f74240 con 0x559cf9012b60 2024-09-19T06:23:22.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.778+0000 7f7362ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559cf901dd40 0x559cf9020130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:22.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.778+0000 7f7362ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559cf901dd40 0x559cf9020130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39208/0 (socket says 172.21.15.2:39208) 2024-09-19T06:23:22.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.778+0000 7f7362ffd640 1 -- 172.21.15.2:0/713282166 learned_addr learned my addr 172.21.15.2:0/713282166 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:22.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.779+0000 7f7360ff9640 1 --2- 172.21.15.2:0/3544117551 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f734c0a33b0 0x7f734c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:22.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.779+0000 7f7363fff640 1 --2- 172.21.15.2:0/713282166 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559cf9012b60 0x559cf9012f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:22.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.779+0000 7f73637fe640 1 --2- 172.21.15.2:0/713282166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559cf9013480 0x559cf901d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:22.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.779+0000 7f7362ffd640 1 -- 172.21.15.2:0/713282166 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559cf9012b60 msgr2=0x559cf9012f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:22.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.779+0000 7f7362ffd640 1 --2- 172.21.15.2:0/713282166 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559cf9012b60 0x559cf9012f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:22.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.779+0000 7f7362ffd640 1 -- 172.21.15.2:0/713282166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559cf9013480 msgr2=0x559cf901d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:22.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.779+0000 7f7362ffd640 1 --2- 172.21.15.2:0/713282166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559cf9013480 0x559cf901d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:22.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.779+0000 7f7362ffd640 1 -- 172.21.15.2:0/713282166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cf8f2c1f0 con 0x559cf901dd40 2024-09-19T06:23:22.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.779+0000 7f73637fe640 1 --2- 172.21.15.2:0/713282166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559cf9013480 0x559cf901d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:22.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.779+0000 7f7363fff640 1 --2- 172.21.15.2:0/713282166 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559cf9012b60 0x559cf9012f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:22.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.779+0000 7f7363fff640 1 --2- 172.21.15.2:0/3544117551 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f734c0a33b0 0x7f734c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:22.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.779+0000 7f7360ff9640 1 -- 172.21.15.2:0/3544117551 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f73540f0870 con 0x7f7364101de0 2024-09-19T06:23:22.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.779+0000 7f7362ffd640 1 --2- 172.21.15.2:0/713282166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559cf901dd40 0x559cf9020130 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f735800aca0 tx=0x7f735800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea4abef3f95b33a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:22.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.779+0000 7f7349ffb640 1 -- 172.21.15.2:0/713282166 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735801d070 con 0x559cf901dd40 2024-09-19T06:23:22.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.779+0000 7f7363fff640 1 --2- 172.21.15.2:0/3544117551 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f734c0a33b0 0x7f734c0a5870 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f735c008e00 tx=0x7f735c004a40 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:22.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.779+0000 7f7349ffb640 1 -- 172.21.15.2:0/713282166 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7358018af0 con 0x559cf901dd40 2024-09-19T06:23:22.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.779+0000 7f7349ffb640 1 -- 172.21.15.2:0/713282166 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7358010b50 con 0x559cf901dd40 2024-09-19T06:23:22.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.780+0000 7f736be47740 1 -- 172.21.15.2:0/713282166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559cf901dd40 msgr2=0x559cf9020130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:22.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.780+0000 7f736be47740 1 --2- 172.21.15.2:0/713282166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559cf901dd40 0x559cf9020130 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f735800aca0 tx=0x7f735800f790 comp rx=0 tx=0).stop 2024-09-19T06:23:22.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.780+0000 7f736be47740 1 -- 172.21.15.2:0/713282166 shutdown_connections 2024-09-19T06:23:22.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.780+0000 7f736be47740 1 --2- 172.21.15.2:0/713282166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559cf901dd40 0x559cf9020130 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:22.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.780+0000 7f736be47740 1 --2- 172.21.15.2:0/713282166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559cf9013480 0x559cf901d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:22.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.780+0000 7f736be47740 1 --2- 172.21.15.2:0/713282166 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559cf9012b60 0x559cf9012f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:22.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.780+0000 7f736be47740 1 -- 172.21.15.2:0/713282166 >> 172.21.15.2:0/713282166 conn(0x559cf900f0f0 msgr2=0x559cf900f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:22.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.780+0000 7f736be47740 1 -- 172.21.15.2:0/713282166 shutdown_connections 2024-09-19T06:23:22.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.780+0000 7f736be47740 1 -- 172.21.15.2:0/713282166 wait complete. 2024-09-19T06:23:22.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.781+0000 7f736be47740 1 -- start start 2024-09-19T06:23:22.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.781+0000 7f736be47740 1 Processor -- start 2024-09-19T06:23:22.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.781+0000 7f736be47740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559cf9012b60 0x559cf901abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:22.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.781+0000 7f736be47740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559cf9013480 0x559cf901b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:22.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.781+0000 7f736be47740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559cf901dd40 0x559cf901b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:22.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.781+0000 7f736be47740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559cf9020910 con 0x559cf9012b60 2024-09-19T06:23:22.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.781+0000 7f736be47740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x559cf8f32f10 con 0x559cf9013480 2024-09-19T06:23:22.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.781+0000 7f736be47740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x559cf9020a90 con 0x559cf901dd40 2024-09-19T06:23:22.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.781+0000 7f736be47740 10 client.0 _ll_register_callbacks cb 0x559cf8efba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:22.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.781+0000 7f73637fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559cf9012b60 0x559cf901abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:22.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.781+0000 7f73637fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559cf9012b60 0x559cf901abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39224/0 (socket says 172.21.15.2:39224) 2024-09-19T06:23:22.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.781+0000 7f73637fe640 1 -- 172.21.15.2:0/168308099 learned_addr learned my addr 172.21.15.2:0/168308099 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:22.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.781+0000 7f7362ffd640 1 --2- 172.21.15.2:0/168308099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559cf9013480 0x559cf901b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:22.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.782+0000 7f73637fe640 1 -- 172.21.15.2:0/168308099 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559cf901dd40 msgr2=0x559cf901b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:22.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.782+0000 7f7363fff640 1 --2- 172.21.15.2:0/168308099 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559cf901dd40 0x559cf901b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:22.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.782+0000 7f73637fe640 1 --2- 172.21.15.2:0/168308099 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559cf901dd40 0x559cf901b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:22.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.782+0000 7f73637fe640 1 -- 172.21.15.2:0/168308099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559cf9013480 msgr2=0x559cf901b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:22.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.782+0000 7f73637fe640 1 --2- 172.21.15.2:0/168308099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559cf9013480 0x559cf901b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:22.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.782+0000 7f73637fe640 1 -- 172.21.15.2:0/168308099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cf8ce96a0 con 0x559cf9012b60 2024-09-19T06:23:22.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.782+0000 7f7362ffd640 1 --2- 172.21.15.2:0/168308099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559cf9013480 0x559cf901b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:22.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.782+0000 7f73637fe640 1 --2- 172.21.15.2:0/168308099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559cf9012b60 0x559cf901abc0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f73540bc850 tx=0x7f73540bca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96d855d8ce794200 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:22.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.782+0000 7f7342ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:22.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.782+0000 7f7342ffd640 1 -- 172.21.15.2:0/168308099 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7354049070 con 0x559cf9012b60 2024-09-19T06:23:22.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.782+0000 7f7342ffd640 1 -- 172.21.15.2:0/168308099 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f73540a70b0 con 0x559cf9012b60 2024-09-19T06:23:22.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.782+0000 7f736be47740 1 -- 172.21.15.2:0/168308099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7358018af0 con 0x559cf9012b60 2024-09-19T06:23:22.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.782+0000 7f7342ffd640 1 -- 172.21.15.2:0/168308099 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f73540bd250 con 0x559cf9012b60 2024-09-19T06:23:22.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.782+0000 7f736be47740 10 client.18249 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:22.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.782+0000 7f736be47740 1 -- 172.21.15.2:0/168308099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x559cf902c4c0 con 0x559cf9012b60 2024-09-19T06:23:22.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.782+0000 7f7342ffd640 1 -- 172.21.15.2:0/168308099 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7358018af0 con 0x559cf9012b60 2024-09-19T06:23:22.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.782+0000 7f7342ffd640 1 -- 172.21.15.2:0/168308099 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f73540bcdb0 con 0x559cf9012b60 2024-09-19T06:23:22.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.783+0000 7f736be47740 10 client.18249 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:22.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.783+0000 7f736be47740 10 client.18249 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:22.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.783+0000 7f736be47740 20 client.18249 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:22.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.783+0000 7f736be47740 1 --2- 172.21.15.2:0/168308099 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x559cf902d810 0x559cf902fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:22.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.783+0000 7f736be47740 4 client.18249 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:23:22.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.783+0000 7f736be47740 1 -- 172.21.15.2:0/168308099 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559cf8f857f0 con 0x559cf902d810 2024-09-19T06:23:22.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.783+0000 7f7362ffd640 1 --2- 172.21.15.2:0/168308099 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x559cf902d810 0x559cf902fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:22.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.783+0000 7f7342ffd640 10 client.18249 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:22.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.783+0000 7f7362ffd640 1 --2- 172.21.15.2:0/168308099 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x559cf902d810 0x559cf902fca0 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a851791b58888ca5 server_cookie=9de37ba88c0ba75a in_seq=0 out_seq=0 2024-09-19T06:23:22.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.784+0000 7f7342ffd640 1 -- 172.21.15.2:0/168308099 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559cf8f857f0 con 0x559cf902d810 2024-09-19T06:23:22.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.784+0000 7f7342ffd640 10 client.18249 handle_command_reply: tid=0 2024-09-19T06:23:22.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.784+0000 7f736be47740 1 client.18249 shutdown 2024-09-19T06:23:22.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.784+0000 7f736be47740 1 -- 172.21.15.2:0/168308099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559cf9012b60 msgr2=0x559cf901abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:22.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.784+0000 7f736be47740 1 --2- 172.21.15.2:0/168308099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559cf9012b60 0x559cf901abc0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f73540bc850 tx=0x7f73540bca50 comp rx=0 tx=0).stop 2024-09-19T06:23:22.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.784+0000 7f736be47740 1 -- 172.21.15.2:0/168308099 shutdown_connections 2024-09-19T06:23:22.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.784+0000 7f736be47740 1 --2- 172.21.15.2:0/168308099 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559cf901dd40 0x559cf901b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:22.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.784+0000 7f736be47740 1 --2- 172.21.15.2:0/168308099 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x559cf902d810 0x559cf902fca0 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:22.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.784+0000 7f736be47740 1 --2- 172.21.15.2:0/168308099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559cf9013480 0x559cf901b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:22.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.784+0000 7f736be47740 1 --2- 172.21.15.2:0/168308099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559cf9012b60 0x559cf901abc0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:22.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.784+0000 7f736be47740 1 -- 172.21.15.2:0/168308099 >> 172.21.15.2:0/168308099 conn(0x559cf900f0f0 msgr2=0x559cf900e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:22.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.784+0000 7f7342ffd640 0 client.18249 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:22.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.785+0000 7f736be47740 1 -- 172.21.15.2:0/168308099 shutdown_connections 2024-09-19T06:23:22.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.785+0000 7f736be47740 1 -- 172.21.15.2:0/168308099 wait complete. 2024-09-19T06:23:22.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.785+0000 7f736be47740 20 client.18249 trim_cache size 0 max 16384 2024-09-19T06:23:22.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.802+0000 7f736be47740 1 Processor -- start 2024-09-19T06:23:22.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.802+0000 7f736be47740 1 -- start start 2024-09-19T06:23:22.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.802+0000 7f736be47740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559cf9012b60 0x559cf90155c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:22.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.802+0000 7f736be47740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559cf9013480 0x559cf901ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:22.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.802+0000 7f736be47740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559cf901dd40 0x559cf9035590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:22.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.802+0000 7f736be47740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f73641b2280 con 0x559cf9013480 2024-09-19T06:23:22.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.802+0000 7f736be47740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f73641afb50 con 0x559cf901dd40 2024-09-19T06:23:22.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.802+0000 7f736be47740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f73641ad9c0 con 0x559cf9012b60 2024-09-19T06:23:22.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.803+0000 7f7362ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559cf9013480 0x559cf901ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:22.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.803+0000 7f73637fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559cf9012b60 0x559cf90155c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:22.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.803+0000 7f7362ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559cf9013480 0x559cf901ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39226/0 (socket says 172.21.15.2:39226) 2024-09-19T06:23:22.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.803+0000 7f7362ffd640 1 -- 172.21.15.2:0/3425025836 learned_addr learned my addr 172.21.15.2:0/3425025836 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:22.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.803+0000 7f7363fff640 1 --2- 172.21.15.2:0/3425025836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559cf901dd40 0x559cf9035590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:22.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.803+0000 7f7362ffd640 1 -- 172.21.15.2:0/3425025836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559cf9012b60 msgr2=0x559cf90155c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:22.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.803+0000 7f7362ffd640 1 --2- 172.21.15.2:0/3425025836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559cf9012b60 0x559cf90155c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:22.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.803+0000 7f7362ffd640 1 -- 172.21.15.2:0/3425025836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559cf901dd40 msgr2=0x559cf9035590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:22.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.803+0000 7f7362ffd640 1 --2- 172.21.15.2:0/3425025836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559cf901dd40 0x559cf9035590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:22.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.803+0000 7f7362ffd640 1 -- 172.21.15.2:0/3425025836 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cf9010280 con 0x559cf9013480 2024-09-19T06:23:22.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.803+0000 7f73637fe640 1 --2- 172.21.15.2:0/3425025836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559cf9012b60 0x559cf90155c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:23:22.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.803+0000 7f7362ffd640 1 --2- 172.21.15.2:0/3425025836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559cf9013480 0x559cf901ca20 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f735800aca0 tx=0x7f735800abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=531730076249147f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:22.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.803+0000 7f73497fa640 1 -- 172.21.15.2:0/3425025836 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7358032070 con 0x559cf9013480 2024-09-19T06:23:22.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.803+0000 7f73497fa640 1 -- 172.21.15.2:0/3425025836 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f73580054f0 con 0x559cf9013480 2024-09-19T06:23:22.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.803+0000 7f73497fa640 1 -- 172.21.15.2:0/3425025836 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735801d040 con 0x559cf9013480 2024-09-19T06:23:22.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.804+0000 7f736be47740 1 -- 172.21.15.2:0/3425025836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559cf9013480 msgr2=0x559cf901ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:22.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.804+0000 7f736be47740 1 --2- 172.21.15.2:0/3425025836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559cf9013480 0x559cf901ca20 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f735800aca0 tx=0x7f735800abd0 comp rx=0 tx=0).stop 2024-09-19T06:23:22.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.804+0000 7f736be47740 1 -- 172.21.15.2:0/3425025836 shutdown_connections 2024-09-19T06:23:22.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.804+0000 7f736be47740 1 --2- 172.21.15.2:0/3425025836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559cf901dd40 0x559cf9035590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:22.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.804+0000 7f736be47740 1 --2- 172.21.15.2:0/3425025836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559cf9013480 0x559cf901ca20 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:22.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.804+0000 7f736be47740 1 --2- 172.21.15.2:0/3425025836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559cf9012b60 0x559cf90155c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:22.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.804+0000 7f736be47740 1 -- 172.21.15.2:0/3425025836 >> 172.21.15.2:0/3425025836 conn(0x559cf900f0f0 msgr2=0x559cf901c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:22.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.804+0000 7f736be47740 1 -- 172.21.15.2:0/3425025836 shutdown_connections 2024-09-19T06:23:22.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.804+0000 7f736be47740 1 -- 172.21.15.2:0/3425025836 wait complete. 2024-09-19T06:23:22.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.804+0000 7f736be47740 1 -- start start 2024-09-19T06:23:22.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.805+0000 7f736be47740 1 Processor -- start 2024-09-19T06:23:22.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.805+0000 7f736be47740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559cf9012b60 0x559cf9017c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:22.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.805+0000 7f736be47740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559cf9013480 0x559cf90181a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:22.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.805+0000 7f736be47740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559cf901dd40 0x559cf90186e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:22.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.805+0000 7f736be47740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f73641ae010 con 0x559cf9013480 2024-09-19T06:23:22.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.805+0000 7f736be47740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f73641af480 con 0x559cf901dd40 2024-09-19T06:23:22.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.805+0000 7f736be47740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f73641ae6e0 con 0x559cf9012b60 2024-09-19T06:23:22.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.805+0000 7f736be47740 10 client.0 _ll_register_callbacks cb 0x7f73540b86d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:22.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.805+0000 7f7362ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559cf9013480 0x559cf90181a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:22.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.805+0000 7f7362ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559cf9013480 0x559cf90181a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39228/0 (socket says 172.21.15.2:39228) 2024-09-19T06:23:22.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.805+0000 7f7362ffd640 1 -- 172.21.15.2:0/2823236089 learned_addr learned my addr 172.21.15.2:0/2823236089 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:22.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.805+0000 7f7363fff640 1 --2- 172.21.15.2:0/2823236089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559cf901dd40 0x559cf90186e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:22.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.805+0000 7f73637fe640 1 --2- 172.21.15.2:0/2823236089 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559cf9012b60 0x559cf9017c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:22.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.805+0000 7f7362ffd640 1 -- 172.21.15.2:0/2823236089 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559cf9012b60 msgr2=0x559cf9017c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:22.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.805+0000 7f7362ffd640 1 --2- 172.21.15.2:0/2823236089 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559cf9012b60 0x559cf9017c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:22.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.805+0000 7f7362ffd640 1 -- 172.21.15.2:0/2823236089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559cf901dd40 msgr2=0x559cf90186e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:22.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.805+0000 7f7362ffd640 1 --2- 172.21.15.2:0/2823236089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559cf901dd40 0x559cf90186e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:22.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.805+0000 7f7362ffd640 1 -- 172.21.15.2:0/2823236089 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cf9097610 con 0x559cf9013480 2024-09-19T06:23:22.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.805+0000 7f73637fe640 1 --2- 172.21.15.2:0/2823236089 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559cf9012b60 0x559cf9017c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:23:22.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.806+0000 7f7362ffd640 1 --2- 172.21.15.2:0/2823236089 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559cf9013480 0x559cf90181a0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f735801b040 tx=0x7f735800fd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5702402b4db6db4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:22.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.806+0000 7f7342ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:22.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.806+0000 7f7342ffd640 1 -- 172.21.15.2:0/2823236089 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735803d060 con 0x559cf9013480 2024-09-19T06:23:22.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.806+0000 7f7342ffd640 1 -- 172.21.15.2:0/2823236089 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f7358018640 con 0x559cf9013480 2024-09-19T06:23:22.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.806+0000 7f736be47740 1 -- 172.21.15.2:0/2823236089 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73580054f0 con 0x559cf9013480 2024-09-19T06:23:22.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.806+0000 7f7342ffd640 1 -- 172.21.15.2:0/2823236089 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7358032040 con 0x559cf9013480 2024-09-19T06:23:22.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.806+0000 7f736be47740 10 client.18255 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:22.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.806+0000 7f736be47740 1 -- 172.21.15.2:0/2823236089 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x559cf9098930 con 0x559cf9013480 2024-09-19T06:23:22.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.806+0000 7f7342ffd640 1 -- 172.21.15.2:0/2823236089 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f73580054f0 con 0x559cf9013480 2024-09-19T06:23:22.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.806+0000 7f7342ffd640 1 -- 172.21.15.2:0/2823236089 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f7358035030 con 0x559cf9013480 2024-09-19T06:23:22.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.806+0000 7f736be47740 10 client.18255 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:22.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.806+0000 7f736be47740 10 client.18255 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:22.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.806+0000 7f736be47740 20 client.18255 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:22.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.806+0000 7f736be47740 1 --2- 172.21.15.2:0/2823236089 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x559cf9098e00 0x559cf909b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:22.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.806+0000 7f736be47740 4 client.18255 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:23:22.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.806+0000 7f736be47740 1 -- 172.21.15.2:0/2823236089 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559cf8f7fd00 con 0x559cf9098e00 2024-09-19T06:23:22.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.807+0000 7f73637fe640 1 --2- 172.21.15.2:0/2823236089 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x559cf9098e00 0x559cf909b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:22.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.807+0000 7f73637fe640 1 --2- 172.21.15.2:0/2823236089 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x559cf9098e00 0x559cf909b220 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54534001f9d2e3ac server_cookie=fc8868634cdcec6f in_seq=0 out_seq=0 2024-09-19T06:23:22.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.807+0000 7f7342ffd640 10 client.18255 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:22.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.808+0000 7f7342ffd640 1 -- 172.21.15.2:0/2823236089 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559cf8f7fd00 con 0x559cf9098e00 2024-09-19T06:23:22.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.808+0000 7f7342ffd640 10 client.18255 handle_command_reply: tid=0 2024-09-19T06:23:22.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.808+0000 7f736be47740 1 client.18255 shutdown 2024-09-19T06:23:22.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.808+0000 7f736be47740 1 -- 172.21.15.2:0/2823236089 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559cf9013480 msgr2=0x559cf90181a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:22.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.808+0000 7f736be47740 1 --2- 172.21.15.2:0/2823236089 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559cf9013480 0x559cf90181a0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f735801b040 tx=0x7f735800fd30 comp rx=0 tx=0).stop 2024-09-19T06:23:22.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.808+0000 7f736be47740 1 -- 172.21.15.2:0/2823236089 shutdown_connections 2024-09-19T06:23:22.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.808+0000 7f736be47740 1 --2- 172.21.15.2:0/2823236089 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x559cf9098e00 0x559cf909b220 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:22.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.808+0000 7f736be47740 1 --2- 172.21.15.2:0/2823236089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559cf901dd40 0x559cf90186e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:22.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.808+0000 7f736be47740 1 --2- 172.21.15.2:0/2823236089 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559cf9013480 0x559cf90181a0 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:22.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.808+0000 7f7342ffd640 0 client.18255 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:22.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.808+0000 7f736be47740 1 --2- 172.21.15.2:0/2823236089 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559cf9012b60 0x559cf9017c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:22.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.808+0000 7f736be47740 1 -- 172.21.15.2:0/2823236089 >> 172.21.15.2:0/2823236089 conn(0x559cf900f0f0 msgr2=0x559cf900e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:22.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.809+0000 7f736be47740 1 -- 172.21.15.2:0/2823236089 shutdown_connections 2024-09-19T06:23:22.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.809+0000 7f736be47740 1 -- 172.21.15.2:0/2823236089 wait complete. 2024-09-19T06:23:22.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.809+0000 7f736be47740 20 client.18255 trim_cache size 0 max 16384 2024-09-19T06:23:22.817 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:23:22.817 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T06:23:22.817 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "8d2d899d-4cfc-4943-97e1-38a7b9afff53", 2024-09-19T06:23:22.817 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T06:23:22.817 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:23:22.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.809+0000 7f7369a6e640 1 -- 172.21.15.2:0/3544117551 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f734c0a33b0 msgr2=0x7f734c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:22.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.809+0000 7f7369a6e640 1 --2- 172.21.15.2:0/3544117551 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f734c0a33b0 0x7f734c0a5870 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f735c008e00 tx=0x7f735c004a40 comp rx=0 tx=0).stop 2024-09-19T06:23:22.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.809+0000 7f7369a6e640 1 -- 172.21.15.2:0/3544117551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7364101de0 msgr2=0x7f736419a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:22.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.809+0000 7f7369a6e640 1 --2- 172.21.15.2:0/3544117551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7364101de0 0x7f736419a520 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f7354006010 tx=0x7f7354004270 comp rx=0 tx=0).stop 2024-09-19T06:23:22.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.809+0000 7f7369a6e640 1 -- 172.21.15.2:0/3544117551 shutdown_connections 2024-09-19T06:23:22.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.809+0000 7f7369a6e640 1 --2- 172.21.15.2:0/3544117551 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f734c0a33b0 0x7f734c0a5870 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:22.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.809+0000 7f7369a6e640 1 --2- 172.21.15.2:0/3544117551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7364106f10 0x7f736419edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:22.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.809+0000 7f7369a6e640 1 --2- 172.21.15.2:0/3544117551 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7364102790 0x7f736419aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:22.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.809+0000 7f7369a6e640 1 --2- 172.21.15.2:0/3544117551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7364101de0 0x7f736419a520 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:22.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.809+0000 7f7369a6e640 1 -- 172.21.15.2:0/3544117551 >> 172.21.15.2:0/3544117551 conn(0x7f73640fd8c0 msgr2=0x7f73640fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:22.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.810+0000 7f7369a6e640 1 -- 172.21.15.2:0/3544117551 shutdown_connections 2024-09-19T06:23:22.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:22.810+0000 7f7369a6e640 1 -- 172.21.15.2:0/3544117551 wait complete. 2024-09-19T06:23:23.623 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:23:23.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:23 smithi002 ceph-mon[30982]: pgmap v266: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T06:23:23.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:23 smithi002 ceph-mon[30982]: scrub queued for path: / 2024-09-19T06:23:23.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:23 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:23:23.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:23 smithi002 ceph-mon[30982]: scrub summary: active paths [/] 2024-09-19T06:23:23.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:23 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:23:23.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:23 smithi002 ceph-mon[30982]: scrub summary: idle 2024-09-19T06:23:23.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:23 smithi089 ceph-mon[34160]: pgmap v266: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T06:23:23.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:23 smithi089 ceph-mon[34160]: scrub queued for path: / 2024-09-19T06:23:23.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:23 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:23:23.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:23 smithi089 ceph-mon[34160]: scrub summary: active paths [/] 2024-09-19T06:23:23.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:23 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:23:23.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:23 smithi089 ceph-mon[34160]: scrub summary: idle 2024-09-19T06:23:23.881 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:23:23.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:23 smithi090 ceph-mon[34497]: pgmap v266: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T06:23:23.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:23 smithi090 ceph-mon[34497]: scrub queued for path: / 2024-09-19T06:23:23.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:23 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:23:23.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:23 smithi090 ceph-mon[34497]: scrub summary: active paths [/] 2024-09-19T06:23:23.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:23 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:23:23.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:23 smithi090 ceph-mon[34497]: scrub summary: idle 2024-09-19T06:23:24.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.296+0000 7f40a0b72640 1 -- 172.21.15.2:0/3932783433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f409c106a80 msgr2=0x7f409c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:24.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.296+0000 7f40a0b72640 1 --2- 172.21.15.2:0/3932783433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f409c106a80 0x7f409c106e60 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f408c009930 tx=0x7f408c02a420 comp rx=0 tx=0).stop 2024-09-19T06:23:24.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.296+0000 7f40a0b72640 1 -- 172.21.15.2:0/3932783433 shutdown_connections 2024-09-19T06:23:24.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.296+0000 7f40a0b72640 1 --2- 172.21.15.2:0/3932783433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f409c101420 0x7f409c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.296+0000 7f40a0b72640 1 --2- 172.21.15.2:0/3932783433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f409c100a80 0x7f409c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.296+0000 7f40a0b72640 1 --2- 172.21.15.2:0/3932783433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f409c106a80 0x7f409c106e60 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.296+0000 7f40a0b72640 1 -- 172.21.15.2:0/3932783433 >> 172.21.15.2:0/3932783433 conn(0x7f409c0fc7a0 msgr2=0x7f409c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:24.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.296+0000 7f40a0b72640 1 -- 172.21.15.2:0/3932783433 shutdown_connections 2024-09-19T06:23:24.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.296+0000 7f40a0b72640 1 -- 172.21.15.2:0/3932783433 wait complete. 2024-09-19T06:23:24.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.297+0000 7f40a0b72640 1 Processor -- start 2024-09-19T06:23:24.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.297+0000 7f40a0b72640 1 -- start start 2024-09-19T06:23:24.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.297+0000 7f40a0b72640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f409c100a80 0x7f409c19a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:24.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.297+0000 7f40a0b72640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f409c101420 0x7f409c19aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:24.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.297+0000 7f40a0b72640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f409c106a80 0x7f409c19ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:24.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.297+0000 7f40a0b72640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f409c110d50 con 0x7f409c106a80 2024-09-19T06:23:24.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.297+0000 7f40a0b72640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f409c110bd0 con 0x7f409c101420 2024-09-19T06:23:24.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.297+0000 7f40a0b72640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f409c110ed0 con 0x7f409c100a80 2024-09-19T06:23:24.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.298+0000 7f409ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f409c106a80 0x7f409c19ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:24.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.298+0000 7f409ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f409c106a80 0x7f409c19ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39234/0 (socket says 172.21.15.2:39234) 2024-09-19T06:23:24.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.298+0000 7f409ad9d640 1 -- 172.21.15.2:0/1607258170 learned_addr learned my addr 172.21.15.2:0/1607258170 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:24.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.298+0000 7f4091d9b640 1 --2- 172.21.15.2:0/1607258170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f409c101420 0x7f409c19aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:24.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.298+0000 7f409a59c640 1 --2- 172.21.15.2:0/1607258170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f409c100a80 0x7f409c19a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:24.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.298+0000 7f409ad9d640 1 -- 172.21.15.2:0/1607258170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f409c100a80 msgr2=0x7f409c19a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:24.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.298+0000 7f409ad9d640 1 --2- 172.21.15.2:0/1607258170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f409c100a80 0x7f409c19a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.298+0000 7f409ad9d640 1 -- 172.21.15.2:0/1607258170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f409c101420 msgr2=0x7f409c19aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:24.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.298+0000 7f409ad9d640 1 --2- 172.21.15.2:0/1607258170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f409c101420 0x7f409c19aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.298+0000 7f409ad9d640 1 -- 172.21.15.2:0/1607258170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f409c19f510 con 0x7f409c106a80 2024-09-19T06:23:24.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.298+0000 7f4091d9b640 1 --2- 172.21.15.2:0/1607258170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f409c101420 0x7f409c19aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:24.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.298+0000 7f409a59c640 1 --2- 172.21.15.2:0/1607258170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f409c100a80 0x7f409c19a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:24.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.298+0000 7f409ad9d640 1 --2- 172.21.15.2:0/1607258170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f409c106a80 0x7f409c19ee30 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f409400b970 tx=0x7f409400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:24.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.298+0000 7f4093fff640 1 -- 172.21.15.2:0/1607258170 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4094019070 con 0x7f409c106a80 2024-09-19T06:23:24.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.298+0000 7f4093fff640 1 -- 172.21.15.2:0/1607258170 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4094014440 con 0x7f409c106a80 2024-09-19T06:23:24.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.298+0000 7f40a0b72640 1 -- 172.21.15.2:0/1607258170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f409c19f800 con 0x7f409c106a80 2024-09-19T06:23:24.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.298+0000 7f4093fff640 1 -- 172.21.15.2:0/1607258170 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40940075d0 con 0x7f409c106a80 2024-09-19T06:23:24.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.298+0000 7f40a0b72640 1 -- 172.21.15.2:0/1607258170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f409c1a70e0 con 0x7f409c106a80 2024-09-19T06:23:24.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.301+0000 7f4093fff640 1 -- 172.21.15.2:0/1607258170 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f409401c070 con 0x7f409c106a80 2024-09-19T06:23:24.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.301+0000 7f40a2f4b740 1 Processor -- start 2024-09-19T06:23:24.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.302+0000 7f40a2f4b740 1 -- start start 2024-09-19T06:23:24.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.302+0000 7f40a2f4b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c1c6bf4a0 0x558c1c6bf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:24.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.302+0000 7f40a2f4b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c1c6bfdc0 0x558c1c6ca140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:24.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.302+0000 7f40a2f4b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c1c6ca680 0x558c1c6cca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:24.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.302+0000 7f40a2f4b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558c1c6252e0 con 0x558c1c6bfdc0 2024-09-19T06:23:24.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.302+0000 7f40a2f4b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x558c1c5ccce0 con 0x558c1c6ca680 2024-09-19T06:23:24.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.302+0000 7f40a2f4b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x558c1c6212a0 con 0x558c1c6bf4a0 2024-09-19T06:23:24.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.302+0000 7f409a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c1c6bfdc0 0x558c1c6ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:24.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.302+0000 7f409a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c1c6bfdc0 0x558c1c6ca140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39244/0 (socket says 172.21.15.2:39244) 2024-09-19T06:23:24.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.302+0000 7f409a59c640 1 -- 172.21.15.2:0/2263015474 learned_addr learned my addr 172.21.15.2:0/2263015474 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:24.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.302+0000 7f4091d9b640 1 --2- 172.21.15.2:0/2263015474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c1c6bf4a0 0x558c1c6bf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:24.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.302+0000 7f4093fff640 1 --2- 172.21.15.2:0/1607258170 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f40880a33b0 0x7f40880a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:24.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.302+0000 7f4091d9b640 1 --2- 172.21.15.2:0/2263015474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c1c6ca680 0x558c1c6cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:24.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.302+0000 7f409a59c640 1 -- 172.21.15.2:0/2263015474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c1c6bf4a0 msgr2=0x558c1c6bf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:24.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.302+0000 7f409a59c640 1 --2- 172.21.15.2:0/2263015474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c1c6bf4a0 0x558c1c6bf880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.302+0000 7f409a59c640 1 -- 172.21.15.2:0/2263015474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c1c6ca680 msgr2=0x558c1c6cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:24.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.302+0000 7f409a59c640 1 --2- 172.21.15.2:0/2263015474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c1c6ca680 0x558c1c6cca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.302+0000 7f409a59c640 1 -- 172.21.15.2:0/2263015474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c1c5b1440 con 0x558c1c6bfdc0 2024-09-19T06:23:24.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.302+0000 7f4091d9b640 1 --2- 172.21.15.2:0/2263015474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c1c6ca680 0x558c1c6cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:23:24.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.303+0000 7f4093fff640 1 -- 172.21.15.2:0/1607258170 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f40940cf210 con 0x7f409c106a80 2024-09-19T06:23:24.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.303+0000 7f409ad9d640 1 --2- 172.21.15.2:0/1607258170 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f40880a33b0 0x7f40880a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:24.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.303+0000 7f409a59c640 1 --2- 172.21.15.2:0/2263015474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c1c6bfdc0 0x558c1c6ca140 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f408c009930 tx=0x7f408c031e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3561ddc482ff0eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:24.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.303+0000 7f4090d99640 1 -- 172.21.15.2:0/2263015474 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f408c03f070 con 0x558c1c6bfdc0 2024-09-19T06:23:24.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.303+0000 7f409ad9d640 1 --2- 172.21.15.2:0/1607258170 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f40880a33b0 0x7f40880a5870 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4094097a60 tx=0x7f4094014b50 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:24.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.303+0000 7f4090d99640 1 -- 172.21.15.2:0/2263015474 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f408c0316a0 con 0x558c1c6bfdc0 2024-09-19T06:23:24.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.303+0000 7f4090d99640 1 -- 172.21.15.2:0/2263015474 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f408c035070 con 0x558c1c6bfdc0 2024-09-19T06:23:24.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.304+0000 7f40a2f4b740 1 -- 172.21.15.2:0/2263015474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c1c6bfdc0 msgr2=0x558c1c6ca140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:24.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.304+0000 7f40a2f4b740 1 --2- 172.21.15.2:0/2263015474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c1c6bfdc0 0x558c1c6ca140 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f408c009930 tx=0x7f408c031e40 comp rx=0 tx=0).stop 2024-09-19T06:23:24.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.304+0000 7f40a2f4b740 1 -- 172.21.15.2:0/2263015474 shutdown_connections 2024-09-19T06:23:24.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.304+0000 7f40a2f4b740 1 --2- 172.21.15.2:0/2263015474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c1c6ca680 0x558c1c6cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.304+0000 7f40a2f4b740 1 --2- 172.21.15.2:0/2263015474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c1c6bfdc0 0x558c1c6ca140 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.304+0000 7f40a2f4b740 1 --2- 172.21.15.2:0/2263015474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c1c6bf4a0 0x558c1c6bf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.304+0000 7f40a2f4b740 1 -- 172.21.15.2:0/2263015474 >> 172.21.15.2:0/2263015474 conn(0x558c1c6bba30 msgr2=0x558c1c6bbe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:24.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.304+0000 7f40a2f4b740 1 -- 172.21.15.2:0/2263015474 shutdown_connections 2024-09-19T06:23:24.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.304+0000 7f40a2f4b740 1 -- 172.21.15.2:0/2263015474 wait complete. 2024-09-19T06:23:24.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.304+0000 7f40a2f4b740 1 -- start start 2024-09-19T06:23:24.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.305+0000 7f40a2f4b740 1 Processor -- start 2024-09-19T06:23:24.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.305+0000 7f40a2f4b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c1c6bf4a0 0x558c1c6c9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:24.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.305+0000 7f40a2f4b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c1c6bfdc0 0x558c1c6c7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:24.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.305+0000 7f40a2f4b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c1c6ca680 0x558c1c6c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:24.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.305+0000 7f40a2f4b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558c1c6cd250 con 0x558c1c6ca680 2024-09-19T06:23:24.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.305+0000 7f40a2f4b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x558c1c5e0050 con 0x558c1c6bfdc0 2024-09-19T06:23:24.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.305+0000 7f40a2f4b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x558c1c6cd3d0 con 0x558c1c6bf4a0 2024-09-19T06:23:24.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.305+0000 7f40a2f4b740 10 client.0 _ll_register_callbacks cb 0x558c1c620160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:24.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.305+0000 7f4091d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c1c6ca680 0x558c1c6c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:24.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.305+0000 7f4091d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c1c6ca680 0x558c1c6c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39246/0 (socket says 172.21.15.2:39246) 2024-09-19T06:23:24.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.305+0000 7f4091d9b640 1 -- 172.21.15.2:0/1783450617 learned_addr learned my addr 172.21.15.2:0/1783450617 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:24.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.305+0000 7f4091d9b640 1 --2- 172.21.15.2:0/1783450617 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c1c6bf4a0 0x558c1c6c9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:24.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.305+0000 7f409a59c640 1 --2- 172.21.15.2:0/1783450617 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c1c6bfdc0 0x558c1c6c7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:24.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.305+0000 7f4091d9b640 1 -- 172.21.15.2:0/1783450617 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c1c6bf4a0 msgr2=0x558c1c6c9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.305+0000 7f4091d9b640 1 --2- 172.21.15.2:0/1783450617 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c1c6bf4a0 0x558c1c6c9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.305+0000 7f4091d9b640 1 -- 172.21.15.2:0/1783450617 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c1c6bfdc0 msgr2=0x558c1c6c7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.305+0000 7f4091d9b640 1 --2- 172.21.15.2:0/1783450617 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c1c6bfdc0 0x558c1c6c7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.305+0000 7f4091d9b640 1 -- 172.21.15.2:0/1783450617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c1c3963c0 con 0x558c1c6ca680 2024-09-19T06:23:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.305+0000 7f409a59c640 1 --2- 172.21.15.2:0/1783450617 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c1c6bfdc0 0x558c1c6c7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.306+0000 7f4091d9b640 1 --2- 172.21.15.2:0/1783450617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c1c6ca680 0x558c1c6c7760 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f4084010440 tx=0x7f40840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c390eb3fb431ba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.306+0000 7f4081ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.306+0000 7f4081ffb640 1 -- 172.21.15.2:0/1783450617 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4084004030 con 0x558c1c6ca680 2024-09-19T06:23:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.306+0000 7f4081ffb640 1 -- 172.21.15.2:0/1783450617 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f40840041d0 con 0x558c1c6ca680 2024-09-19T06:23:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.306+0000 7f40a2f4b740 1 -- 172.21.15.2:0/1783450617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f408c0316a0 con 0x558c1c6ca680 2024-09-19T06:23:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.306+0000 7f4081ffb640 1 -- 172.21.15.2:0/1783450617 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4084026050 con 0x558c1c6ca680 2024-09-19T06:23:24.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.306+0000 7f40a2f4b740 10 client.18267 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:24.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.306+0000 7f40a2f4b740 1 -- 172.21.15.2:0/1783450617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x558c1c6d8b90 con 0x558c1c6ca680 2024-09-19T06:23:24.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.306+0000 7f4081ffb640 1 -- 172.21.15.2:0/1783450617 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f408c0316a0 con 0x558c1c6ca680 2024-09-19T06:23:24.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.306+0000 7f4081ffb640 1 -- 172.21.15.2:0/1783450617 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f408401e3a0 con 0x558c1c6ca680 2024-09-19T06:23:24.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.306+0000 7f40a2f4b740 10 client.18267 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:24.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.306+0000 7f40a2f4b740 10 client.18267 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:24.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.306+0000 7f40a2f4b740 20 client.18267 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:24.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.306+0000 7f40a2f4b740 1 --2- 172.21.15.2:0/1783450617 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558c1c6d9fa0 0x558c1c6dc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:24.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.307+0000 7f40a2f4b740 4 client.18267 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:23:24.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.307+0000 7f40a2f4b740 1 -- 172.21.15.2:0/1783450617 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c1c632850 con 0x558c1c6d9fa0 2024-09-19T06:23:24.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.307+0000 7f409a59c640 1 --2- 172.21.15.2:0/1783450617 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558c1c6d9fa0 0x558c1c6dc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:24.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.307+0000 7f409a59c640 1 --2- 172.21.15.2:0/1783450617 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558c1c6d9fa0 0x558c1c6dc400 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7807dffeba1c921 server_cookie=b7a6bb5468112d7f in_seq=0 out_seq=0 2024-09-19T06:23:24.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.307+0000 7f4081ffb640 10 client.18267 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:24.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.308+0000 7f4081ffb640 1 -- 172.21.15.2:0/1783450617 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558c1c632850 con 0x558c1c6d9fa0 2024-09-19T06:23:24.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.308+0000 7f4081ffb640 10 client.18267 handle_command_reply: tid=0 2024-09-19T06:23:24.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.308+0000 7f40a2f4b740 1 client.18267 shutdown 2024-09-19T06:23:24.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.308+0000 7f40a2f4b740 1 -- 172.21.15.2:0/1783450617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c1c6ca680 msgr2=0x558c1c6c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:24.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.308+0000 7f40a2f4b740 1 --2- 172.21.15.2:0/1783450617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c1c6ca680 0x558c1c6c7760 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f4084010440 tx=0x7f40840046c0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.308+0000 7f40a2f4b740 1 -- 172.21.15.2:0/1783450617 shutdown_connections 2024-09-19T06:23:24.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.308+0000 7f40a2f4b740 1 --2- 172.21.15.2:0/1783450617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c1c6ca680 0x558c1c6c7760 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.308+0000 7f40a2f4b740 1 --2- 172.21.15.2:0/1783450617 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558c1c6d9fa0 0x558c1c6dc400 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.308+0000 7f40a2f4b740 1 --2- 172.21.15.2:0/1783450617 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c1c6bfdc0 0x558c1c6c7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.308+0000 7f40a2f4b740 1 --2- 172.21.15.2:0/1783450617 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c1c6bf4a0 0x558c1c6c9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.308+0000 7f40a2f4b740 1 -- 172.21.15.2:0/1783450617 >> 172.21.15.2:0/1783450617 conn(0x558c1c6bba30 msgr2=0x558c1c6c1710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:24.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.308+0000 7f4081ffb640 0 client.18267 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:24.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.308+0000 7f40a2f4b740 1 -- 172.21.15.2:0/1783450617 shutdown_connections 2024-09-19T06:23:24.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.308+0000 7f40a2f4b740 1 -- 172.21.15.2:0/1783450617 wait complete. 2024-09-19T06:23:24.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.308+0000 7f40a2f4b740 20 client.18267 trim_cache size 0 max 16384 2024-09-19T06:23:24.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.326+0000 7f40a2f4b740 1 Processor -- start 2024-09-19T06:23:24.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.326+0000 7f40a2f4b740 1 -- start start 2024-09-19T06:23:24.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.326+0000 7f40a2f4b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c1c6bf4a0 0x558c1c6c5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:24.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.326+0000 7f40a2f4b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c1c6bfdc0 0x558c1c6c9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:24.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.326+0000 7f40a2f4b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c1c6ca680 0x558c1c6e1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:24.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.326+0000 7f40a2f4b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f409c1b2210 con 0x558c1c6ca680 2024-09-19T06:23:24.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.326+0000 7f40a2f4b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f409c1afae0 con 0x558c1c6bfdc0 2024-09-19T06:23:24.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.326+0000 7f40a2f4b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f409c1ad950 con 0x558c1c6bf4a0 2024-09-19T06:23:24.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.326+0000 7f4091d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c1c6ca680 0x558c1c6e1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:24.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.326+0000 7f4091d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c1c6ca680 0x558c1c6e1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39252/0 (socket says 172.21.15.2:39252) 2024-09-19T06:23:24.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.326+0000 7f4091d9b640 1 -- 172.21.15.2:0/1119188128 learned_addr learned my addr 172.21.15.2:0/1119188128 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:24.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.326+0000 7f4091d9b640 1 --2- 172.21.15.2:0/1119188128 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c1c6bf4a0 0x558c1c6c5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:24.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.326+0000 7f409a59c640 1 --2- 172.21.15.2:0/1119188128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c1c6bfdc0 0x558c1c6c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:24.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.326+0000 7f4091d9b640 1 -- 172.21.15.2:0/1119188128 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c1c6bf4a0 msgr2=0x558c1c6c5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:24.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.326+0000 7f4091d9b640 1 --2- 172.21.15.2:0/1119188128 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c1c6bf4a0 0x558c1c6c5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.326+0000 7f4091d9b640 1 -- 172.21.15.2:0/1119188128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c1c6bfdc0 msgr2=0x558c1c6c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:24.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.326+0000 7f4091d9b640 1 --2- 172.21.15.2:0/1119188128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c1c6bfdc0 0x558c1c6c9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.326+0000 7f4091d9b640 1 -- 172.21.15.2:0/1119188128 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c1c6c61d0 con 0x558c1c6ca680 2024-09-19T06:23:24.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.326+0000 7f409a59c640 1 --2- 172.21.15.2:0/1119188128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c1c6bfdc0 0x558c1c6c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:23:24.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.327+0000 7f4091d9b640 1 --2- 172.21.15.2:0/1119188128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c1c6ca680 0x558c1c6e1cd0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f408400bb20 tx=0x7f408400bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69043e1507006509 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:24.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.327+0000 7f4083fff640 1 -- 172.21.15.2:0/1119188128 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f408401e5a0 con 0x558c1c6ca680 2024-09-19T06:23:24.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.327+0000 7f4083fff640 1 -- 172.21.15.2:0/1119188128 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4084023020 con 0x558c1c6ca680 2024-09-19T06:23:24.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.327+0000 7f4083fff640 1 -- 172.21.15.2:0/1119188128 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4084004730 con 0x558c1c6ca680 2024-09-19T06:23:24.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.327+0000 7f40a2f4b740 1 -- 172.21.15.2:0/1119188128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c1c6ca680 msgr2=0x558c1c6e1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:24.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.327+0000 7f40a2f4b740 1 --2- 172.21.15.2:0/1119188128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c1c6ca680 0x558c1c6e1cd0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f408400bb20 tx=0x7f408400bab0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.327+0000 7f40a2f4b740 1 -- 172.21.15.2:0/1119188128 shutdown_connections 2024-09-19T06:23:24.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.327+0000 7f40a2f4b740 1 --2- 172.21.15.2:0/1119188128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c1c6ca680 0x558c1c6e1cd0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.327+0000 7f40a2f4b740 1 --2- 172.21.15.2:0/1119188128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c1c6bfdc0 0x558c1c6c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.327+0000 7f40a2f4b740 1 --2- 172.21.15.2:0/1119188128 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c1c6bf4a0 0x558c1c6c5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.327+0000 7f40a2f4b740 1 -- 172.21.15.2:0/1119188128 >> 172.21.15.2:0/1119188128 conn(0x558c1c6bba30 msgr2=0x558c1c6c8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:24.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.328+0000 7f40a2f4b740 1 -- 172.21.15.2:0/1119188128 shutdown_connections 2024-09-19T06:23:24.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.328+0000 7f40a2f4b740 1 -- 172.21.15.2:0/1119188128 wait complete. 2024-09-19T06:23:24.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.328+0000 7f40a2f4b740 1 -- start start 2024-09-19T06:23:24.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.328+0000 7f40a2f4b740 1 Processor -- start 2024-09-19T06:23:24.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.328+0000 7f40a2f4b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c1c6bf4a0 0x558c1c6d2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:24.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.328+0000 7f40a2f4b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c1c6bfdc0 0x558c1c6d2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:24.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.328+0000 7f40a2f4b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c1c6ca680 0x558c1c6cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:24.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.328+0000 7f40a2f4b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f409c1adfa0 con 0x558c1c6bfdc0 2024-09-19T06:23:24.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.328+0000 7f40a2f4b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f409c1af410 con 0x558c1c6ca680 2024-09-19T06:23:24.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.328+0000 7f40a2f4b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f409c1ae670 con 0x558c1c6bf4a0 2024-09-19T06:23:24.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.328+0000 7f40a2f4b740 10 client.0 _ll_register_callbacks cb 0x7f408400bb50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:24.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.328+0000 7f409a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c1c6bfdc0 0x558c1c6d2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:24.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.328+0000 7f409a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c1c6bfdc0 0x558c1c6d2cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39258/0 (socket says 172.21.15.2:39258) 2024-09-19T06:23:24.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.328+0000 7f409a59c640 1 -- 172.21.15.2:0/3790434987 learned_addr learned my addr 172.21.15.2:0/3790434987 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:24.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.328+0000 7f4091d9b640 1 --2- 172.21.15.2:0/3790434987 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c1c6bf4a0 0x558c1c6d2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:24.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.328+0000 7f4091d9b640 1 --2- 172.21.15.2:0/3790434987 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c1c6ca680 0x558c1c6cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:24.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.329+0000 7f409a59c640 1 -- 172.21.15.2:0/3790434987 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c1c6bf4a0 msgr2=0x558c1c6d2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:24.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.329+0000 7f409a59c640 1 --2- 172.21.15.2:0/3790434987 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c1c6bf4a0 0x558c1c6d2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.329+0000 7f409a59c640 1 -- 172.21.15.2:0/3790434987 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c1c6ca680 msgr2=0x558c1c6cfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:24.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.329+0000 7f409a59c640 1 --2- 172.21.15.2:0/3790434987 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c1c6ca680 0x558c1c6cfbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.329+0000 7f409a59c640 1 -- 172.21.15.2:0/3790434987 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c1c6bfbf0 con 0x558c1c6bfdc0 2024-09-19T06:23:24.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.329+0000 7f4091d9b640 1 --2- 172.21.15.2:0/3790434987 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c1c6bf4a0 0x558c1c6d2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:24.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.329+0000 7f409a59c640 1 --2- 172.21.15.2:0/3790434987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c1c6bfdc0 0x558c1c6d2cd0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f408c0039a0 tx=0x7f408c003930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=337f807ca19b919c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:24.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.329+0000 7f4081ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:24.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.329+0000 7f4081ffb640 1 -- 172.21.15.2:0/3790434987 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f408c03f040 con 0x558c1c6bfdc0 2024-09-19T06:23:24.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.329+0000 7f4081ffb640 1 -- 172.21.15.2:0/3790434987 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f408c005220 con 0x558c1c6bfdc0 2024-09-19T06:23:24.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.329+0000 7f40a2f4b740 1 -- 172.21.15.2:0/3790434987 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4084023020 con 0x558c1c6bfdc0 2024-09-19T06:23:24.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.329+0000 7f4081ffb640 1 -- 172.21.15.2:0/3790434987 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f408c035040 con 0x558c1c6bfdc0 2024-09-19T06:23:24.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.329+0000 7f40a2f4b740 10 client.18273 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:24.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.329+0000 7f40a2f4b740 1 -- 172.21.15.2:0/3790434987 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x558c1c744590 con 0x558c1c6bfdc0 2024-09-19T06:23:24.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.329+0000 7f4081ffb640 1 -- 172.21.15.2:0/3790434987 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4084023020 con 0x558c1c6bfdc0 2024-09-19T06:23:24.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.330+0000 7f4081ffb640 1 -- 172.21.15.2:0/3790434987 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f408c005420 con 0x558c1c6bfdc0 2024-09-19T06:23:24.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.330+0000 7f40a2f4b740 10 client.18273 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:24.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.330+0000 7f40a2f4b740 10 client.18273 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:24.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.330+0000 7f40a2f4b740 20 client.18273 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:24.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.330+0000 7f40a2f4b740 1 --2- 172.21.15.2:0/3790434987 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558c1c7448d0 0x558c1c746cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:24.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.330+0000 7f40a2f4b740 4 client.18273 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:23:24.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.330+0000 7f40a2f4b740 1 -- 172.21.15.2:0/3790434987 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558c1c62cd60 con 0x558c1c7448d0 2024-09-19T06:23:24.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.330+0000 7f4091d9b640 1 --2- 172.21.15.2:0/3790434987 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558c1c7448d0 0x558c1c746cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:24.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.330+0000 7f4081ffb640 10 client.18273 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:24.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.330+0000 7f4091d9b640 1 --2- 172.21.15.2:0/3790434987 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558c1c7448d0 0x558c1c746cc0 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2076cc5d2ceb4e7b server_cookie=d93c58e02cf001b7 in_seq=0 out_seq=0 2024-09-19T06:23:24.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.331+0000 7f4081ffb640 1 -- 172.21.15.2:0/3790434987 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x558c1c62cd60 con 0x558c1c7448d0 2024-09-19T06:23:24.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.331+0000 7f4081ffb640 10 client.18273 handle_command_reply: tid=0 2024-09-19T06:23:24.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.331+0000 7f40a2f4b740 1 client.18273 shutdown 2024-09-19T06:23:24.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.331+0000 7f40a2f4b740 1 -- 172.21.15.2:0/3790434987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c1c6bfdc0 msgr2=0x558c1c6d2cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:24.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.331+0000 7f40a2f4b740 1 --2- 172.21.15.2:0/3790434987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c1c6bfdc0 0x558c1c6d2cd0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f408c0039a0 tx=0x7f408c003930 comp rx=0 tx=0).stop 2024-09-19T06:23:24.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.331+0000 7f40a2f4b740 1 -- 172.21.15.2:0/3790434987 shutdown_connections 2024-09-19T06:23:24.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.331+0000 7f40a2f4b740 1 --2- 172.21.15.2:0/3790434987 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558c1c7448d0 0x558c1c746cc0 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.331+0000 7f40a2f4b740 1 --2- 172.21.15.2:0/3790434987 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c1c6ca680 0x558c1c6cfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.331+0000 7f4081ffb640 0 client.18273 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:24.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.331+0000 7f40a2f4b740 1 --2- 172.21.15.2:0/3790434987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558c1c6bfdc0 0x558c1c6d2cd0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.331+0000 7f40a2f4b740 1 --2- 172.21.15.2:0/3790434987 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c1c6bf4a0 0x558c1c6d2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.331+0000 7f40a2f4b740 1 -- 172.21.15.2:0/3790434987 >> 172.21.15.2:0/3790434987 conn(0x558c1c6bba30 msgr2=0x558c1c6c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:24.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.331+0000 7f40a2f4b740 1 -- 172.21.15.2:0/3790434987 shutdown_connections 2024-09-19T06:23:24.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.331+0000 7f40a2f4b740 1 -- 172.21.15.2:0/3790434987 wait complete. 2024-09-19T06:23:24.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.331+0000 7f40a2f4b740 20 client.18273 trim_cache size 0 max 16384 2024-09-19T06:23:24.343 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:23:24.344 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T06:23:24.344 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T06:23:24.344 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:23:24.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.331+0000 7f40a0b72640 1 -- 172.21.15.2:0/1607258170 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f40880a33b0 msgr2=0x7f40880a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:24.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.331+0000 7f40a0b72640 1 --2- 172.21.15.2:0/1607258170 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f40880a33b0 0x7f40880a5870 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4094097a60 tx=0x7f4094014b50 comp rx=0 tx=0).stop 2024-09-19T06:23:24.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.331+0000 7f40a0b72640 1 -- 172.21.15.2:0/1607258170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f409c106a80 msgr2=0x7f409c19ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:24.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.331+0000 7f40a0b72640 1 --2- 172.21.15.2:0/1607258170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f409c106a80 0x7f409c19ee30 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f409400b970 tx=0x7f409400be30 comp rx=0 tx=0).stop 2024-09-19T06:23:24.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.332+0000 7f40a0b72640 1 -- 172.21.15.2:0/1607258170 shutdown_connections 2024-09-19T06:23:24.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.332+0000 7f40a0b72640 1 --2- 172.21.15.2:0/1607258170 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f40880a33b0 0x7f40880a5870 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.332+0000 7f40a0b72640 1 --2- 172.21.15.2:0/1607258170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f409c106a80 0x7f409c19ee30 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.332+0000 7f40a0b72640 1 --2- 172.21.15.2:0/1607258170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f409c101420 0x7f409c19aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.332+0000 7f40a0b72640 1 --2- 172.21.15.2:0/1607258170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f409c100a80 0x7f409c19a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.332+0000 7f40a0b72640 1 -- 172.21.15.2:0/1607258170 >> 172.21.15.2:0/1607258170 conn(0x7f409c0fc7a0 msgr2=0x7f409c0fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:24.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.332+0000 7f40a0b72640 1 -- 172.21.15.2:0/1607258170 shutdown_connections 2024-09-19T06:23:24.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:24.332+0000 7f40a0b72640 1 -- 172.21.15.2:0/1607258170 wait complete. 2024-09-19T06:23:25.230 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:23:25.231 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:23:25.494 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:23:25.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:25 smithi089 ceph-mon[34160]: pgmap v267: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 92 B/s wr, 9 op/s 2024-09-19T06:23:25.797 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:25 smithi002 ceph-mon[30982]: pgmap v267: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 92 B/s wr, 9 op/s 2024-09-19T06:23:25.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:25.877+0000 7fccc5096640 1 -- 172.21.15.2:0/2615031433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccc0103660 msgr2=0x7fccc010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:25.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:25.877+0000 7fccc5096640 1 --2- 172.21.15.2:0/2615031433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccc0103660 0x7fccc010bb50 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fccb4009900 tx=0x7fccb402a480 comp rx=0 tx=0).stop 2024-09-19T06:23:25.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:25.877+0000 7fccc5096640 1 -- 172.21.15.2:0/2615031433 shutdown_connections 2024-09-19T06:23:25.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:25.877+0000 7fccc5096640 1 --2- 172.21.15.2:0/2615031433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fccc010c170 0x7fccc010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:25.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:25.877+0000 7fccc5096640 1 --2- 172.21.15.2:0/2615031433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccc0103660 0x7fccc010bb50 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:25.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:25.877+0000 7fccc5096640 1 --2- 172.21.15.2:0/2615031433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fccc0102d40 0x7fccc0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:25.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:25.877+0000 7fccc5096640 1 -- 172.21.15.2:0/2615031433 >> 172.21.15.2:0/2615031433 conn(0x7fccc00fc7a0 msgr2=0x7fccc00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:25.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:25.877+0000 7fccc5096640 1 -- 172.21.15.2:0/2615031433 shutdown_connections 2024-09-19T06:23:25.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:25.877+0000 7fccc5096640 1 -- 172.21.15.2:0/2615031433 wait complete. 2024-09-19T06:23:25.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:25.878+0000 7fccc5096640 1 Processor -- start 2024-09-19T06:23:25.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:25.878+0000 7fccc5096640 1 -- start start 2024-09-19T06:23:25.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:25.878+0000 7fccc5096640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccc0102d40 0x7fccc01983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:25.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:25.878+0000 7fccc5096640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fccc0103660 0x7fccc0198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:25.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:25.878+0000 7fccc5096640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fccc010c170 0x7fccc019ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:25.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:25.878+0000 7fccc5096640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fccc0111e20 con 0x7fccc0102d40 2024-09-19T06:23:25.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:25.878+0000 7fccc5096640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fccc0111ca0 con 0x7fccc010c170 2024-09-19T06:23:25.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:25.878+0000 7fccc5096640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fccc0111fa0 con 0x7fccc0103660 2024-09-19T06:23:25.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:25.878+0000 7fccbed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccc0102d40 0x7fccc01983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:25.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:25.878+0000 7fccbed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccc0102d40 0x7fccc01983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52020/0 (socket says 172.21.15.2:52020) 2024-09-19T06:23:25.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:25.878+0000 7fccbed9d640 1 -- 172.21.15.2:0/366029800 learned_addr learned my addr 172.21.15.2:0/366029800 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:25.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:25.878+0000 7fccbe59c640 1 --2- 172.21.15.2:0/366029800 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fccc0103660 0x7fccc0198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:25.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:25.878+0000 7fccbf59e640 1 --2- 172.21.15.2:0/366029800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fccc010c170 0x7fccc019ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:25.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:25.879+0000 7fccbed9d640 1 -- 172.21.15.2:0/366029800 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fccc0103660 msgr2=0x7fccc0198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:25.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:25.879+0000 7fccbed9d640 1 --2- 172.21.15.2:0/366029800 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fccc0103660 0x7fccc0198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:25.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:25.879+0000 7fccbed9d640 1 -- 172.21.15.2:0/366029800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fccc010c170 msgr2=0x7fccc019ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:25.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:25.879+0000 7fccbed9d640 1 --2- 172.21.15.2:0/366029800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fccc010c170 0x7fccc019ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:25.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:25.879+0000 7fccbed9d640 1 -- 172.21.15.2:0/366029800 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccc019d390 con 0x7fccc0102d40 2024-09-19T06:23:25.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:25.879+0000 7fccbed9d640 1 --2- 172.21.15.2:0/366029800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccc0102d40 0x7fccc01983e0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fccb000d950 tx=0x7fccb000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:25.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:25.879+0000 7fcca7fff640 1 -- 172.21.15.2:0/366029800 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb0017070 con 0x7fccc0102d40 2024-09-19T06:23:25.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:25.879+0000 7fccc5096640 1 -- 172.21.15.2:0/366029800 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccc019d680 con 0x7fccc0102d40 2024-09-19T06:23:25.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:25.879+0000 7fcca7fff640 1 -- 172.21.15.2:0/366029800 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fccb0009c30 con 0x7fccc0102d40 2024-09-19T06:23:25.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:25.879+0000 7fcca7fff640 1 -- 172.21.15.2:0/366029800 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb000f620 con 0x7fccc0102d40 2024-09-19T06:23:25.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:25.879+0000 7fccc5096640 1 -- 172.21.15.2:0/366029800 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccc01a4f60 con 0x7fccc0102d40 2024-09-19T06:23:25.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:25.880+0000 7fccc5096640 1 -- 172.21.15.2:0/366029800 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccc0103120 con 0x7fccc0102d40 2024-09-19T06:23:25.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:25.882+0000 7fcca7fff640 1 -- 172.21.15.2:0/366029800 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fccb00109a0 con 0x7fccc0102d40 2024-09-19T06:23:25.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:25.883+0000 7fcca7fff640 1 --2- 172.21.15.2:0/366029800 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fcca80a33b0 0x7fcca80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:25.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:25.883+0000 7fccbe59c640 1 --2- 172.21.15.2:0/366029800 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fcca80a33b0 0x7fcca80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:25.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:25.883+0000 7fcca7fff640 1 -- 172.21.15.2:0/366029800 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7fccb00cfa40 con 0x7fccc0102d40 2024-09-19T06:23:25.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:25.883+0000 7fccbe59c640 1 --2- 172.21.15.2:0/366029800 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fcca80a33b0 0x7fcca80a5870 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fccb4031440 tx=0x7fccb40095f0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:25.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:25.887+0000 7fcca7fff640 1 -- 172.21.15.2:0/366029800 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fccb0009de0 con 0x7fccc0102d40 2024-09-19T06:23:25.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:25 smithi090 ceph-mon[34497]: pgmap v267: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 92 B/s wr, 9 op/s 2024-09-19T06:23:26.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:26.101+0000 7fccc5096640 1 -- 172.21.15.2:0/366029800 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fccc01071e0 con 0x7fccc0102d40 2024-09-19T06:23:26.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:26.102+0000 7fcca7fff640 1 -- 172.21.15.2:0/366029800 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11882 (secure 0 0 0) 0x7fccb009c3c0 con 0x7fccc0102d40 2024-09-19T06:23:26.105 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:23:26.105 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-09-19T06:14:49:104280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:14:48.191083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24470,24472,24497]},"id":1}]} 2024-09-19T06:23:26.106 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-09-19T06:23:26.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:26.104+0000 7fccc5096640 1 -- 172.21.15.2:0/366029800 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fcca80a33b0 msgr2=0x7fcca80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:26.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:26.104+0000 7fccc5096640 1 --2- 172.21.15.2:0/366029800 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fcca80a33b0 0x7fcca80a5870 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fccb4031440 tx=0x7fccb40095f0 comp rx=0 tx=0).stop 2024-09-19T06:23:26.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:26.104+0000 7fccc5096640 1 -- 172.21.15.2:0/366029800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccc0102d40 msgr2=0x7fccc01983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:26.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:26.104+0000 7fccc5096640 1 --2- 172.21.15.2:0/366029800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccc0102d40 0x7fccc01983e0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fccb000d950 tx=0x7fccb000de10 comp rx=0 tx=0).stop 2024-09-19T06:23:26.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:26.105+0000 7fccc5096640 1 -- 172.21.15.2:0/366029800 shutdown_connections 2024-09-19T06:23:26.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:26.105+0000 7fccc5096640 1 --2- 172.21.15.2:0/366029800 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fcca80a33b0 0x7fcca80a5870 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:26.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:26.105+0000 7fccc5096640 1 --2- 172.21.15.2:0/366029800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fccc010c170 0x7fccc019ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:26.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:26.105+0000 7fccc5096640 1 --2- 172.21.15.2:0/366029800 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fccc0103660 0x7fccc0198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:26.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:26.105+0000 7fccc5096640 1 --2- 172.21.15.2:0/366029800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fccc0102d40 0x7fccc01983e0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:26.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:26.105+0000 7fccc5096640 1 -- 172.21.15.2:0/366029800 >> 172.21.15.2:0/366029800 conn(0x7fccc00fc7a0 msgr2=0x7fccc00fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:26.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:26.105+0000 7fccc5096640 1 -- 172.21.15.2:0/366029800 shutdown_connections 2024-09-19T06:23:26.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:26.105+0000 7fccc5096640 1 -- 172.21.15.2:0/366029800 wait complete. 2024-09-19T06:23:26.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:26 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/366029800' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:23:26.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:26 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/366029800' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:23:26.796 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:23:26.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:26 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/366029800' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:23:27.060 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:23:27.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.461+0000 7f2846275640 1 -- 172.21.15.2:0/2195975404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f284010c170 msgr2=0x7f284010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:27.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.461+0000 7f2846275640 1 --2- 172.21.15.2:0/2195975404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f284010c170 0x7f284010e610 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f2838009ca0 tx=0x7f283802a950 comp rx=0 tx=0).stop 2024-09-19T06:23:27.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.461+0000 7f2846275640 1 -- 172.21.15.2:0/2195975404 shutdown_connections 2024-09-19T06:23:27.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.461+0000 7f2846275640 1 --2- 172.21.15.2:0/2195975404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f284010c170 0x7f284010e610 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:27.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.461+0000 7f2846275640 1 --2- 172.21.15.2:0/2195975404 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2840103660 0x7f284010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:27.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.461+0000 7f2846275640 1 --2- 172.21.15.2:0/2195975404 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2840102d40 0x7f2840103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:27.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.461+0000 7f2846275640 1 -- 172.21.15.2:0/2195975404 >> 172.21.15.2:0/2195975404 conn(0x7f28400fc7a0 msgr2=0x7f28400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:27.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.461+0000 7f2846275640 1 -- 172.21.15.2:0/2195975404 shutdown_connections 2024-09-19T06:23:27.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.461+0000 7f2846275640 1 -- 172.21.15.2:0/2195975404 wait complete. 2024-09-19T06:23:27.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.461+0000 7f2846275640 1 Processor -- start 2024-09-19T06:23:27.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.462+0000 7f2846275640 1 -- start start 2024-09-19T06:23:27.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.462+0000 7f2846275640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2840102d40 0x7f2840198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:27.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.462+0000 7f2846275640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2840103660 0x7f2840198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:27.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.462+0000 7f2846275640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f284010c170 0x7f284019cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:27.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.462+0000 7f2846275640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2840111e30 con 0x7f2840103660 2024-09-19T06:23:27.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.462+0000 7f2846275640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2840111cb0 con 0x7f2840102d40 2024-09-19T06:23:27.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.462+0000 7f2846275640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2840111fb0 con 0x7f284010c170 2024-09-19T06:23:27.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.462+0000 7f283f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2840103660 0x7f2840198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:27.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.462+0000 7f283f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2840103660 0x7f2840198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52032/0 (socket says 172.21.15.2:52032) 2024-09-19T06:23:27.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.462+0000 7f283f7fe640 1 -- 172.21.15.2:0/4199212931 learned_addr learned my addr 172.21.15.2:0/4199212931 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:27.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.462+0000 7f283ffff640 1 --2- 172.21.15.2:0/4199212931 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2840102d40 0x7f2840198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:27.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.462+0000 7f2844812640 1 --2- 172.21.15.2:0/4199212931 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f284010c170 0x7f284019cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:27.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.462+0000 7f283f7fe640 1 -- 172.21.15.2:0/4199212931 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f284010c170 msgr2=0x7f284019cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:27.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.462+0000 7f283f7fe640 1 --2- 172.21.15.2:0/4199212931 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f284010c170 0x7f284019cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:27.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.462+0000 7f283f7fe640 1 -- 172.21.15.2:0/4199212931 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2840102d40 msgr2=0x7f2840198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:27.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.462+0000 7f283f7fe640 1 --2- 172.21.15.2:0/4199212931 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2840102d40 0x7f2840198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:27.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.462+0000 7f283f7fe640 1 -- 172.21.15.2:0/4199212931 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f284019d2b0 con 0x7f2840103660 2024-09-19T06:23:27.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.463+0000 7f283f7fe640 1 --2- 172.21.15.2:0/4199212931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2840103660 0x7f2840198840 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f283400c940 tx=0x7f283400ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:27.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.463+0000 7f283d7fa640 1 -- 172.21.15.2:0/4199212931 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2834004220 con 0x7f2840103660 2024-09-19T06:23:27.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.463+0000 7f2846275640 1 -- 172.21.15.2:0/4199212931 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f284019d5a0 con 0x7f2840103660 2024-09-19T06:23:27.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.463+0000 7f283d7fa640 1 -- 172.21.15.2:0/4199212931 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f28340043c0 con 0x7f2840103660 2024-09-19T06:23:27.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.463+0000 7f283d7fa640 1 -- 172.21.15.2:0/4199212931 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2834004a00 con 0x7f2840103660 2024-09-19T06:23:27.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.463+0000 7f2846275640 1 -- 172.21.15.2:0/4199212931 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28401a4e80 con 0x7f2840103660 2024-09-19T06:23:27.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.465+0000 7f283d7fa640 1 -- 172.21.15.2:0/4199212931 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f28340079b0 con 0x7f2840103660 2024-09-19T06:23:27.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.465+0000 7f284864e740 1 Processor -- start 2024-09-19T06:23:27.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.466+0000 7f284864e740 1 -- start start 2024-09-19T06:23:27.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.466+0000 7f284864e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56138830db40 0x56138830c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:27.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.466+0000 7f284864e740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56138830c5d0 0x56138830ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:27.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.466+0000 7f284864e740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56138831b780 0x56138831db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:27.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.466+0000 7f284864e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5613882722f0 con 0x56138830db40 2024-09-19T06:23:27.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.466+0000 7f284864e740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x561388219cf0 con 0x56138831b780 2024-09-19T06:23:27.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.466+0000 7f284864e740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56138826e2b0 con 0x56138830c5d0 2024-09-19T06:23:27.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.466+0000 7f2844812640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56138830db40 0x56138830c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:27.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.466+0000 7f2844812640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56138830db40 0x56138830c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52042/0 (socket says 172.21.15.2:52042) 2024-09-19T06:23:27.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.466+0000 7f2844812640 1 -- 172.21.15.2:0/1060645566 learned_addr learned my addr 172.21.15.2:0/1060645566 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:27.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.466+0000 7f283ffff640 1 --2- 172.21.15.2:0/1060645566 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56138830c5d0 0x56138830ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:27.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.466+0000 7f2844812640 1 -- 172.21.15.2:0/1060645566 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56138830c5d0 msgr2=0x56138830ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:27.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.466+0000 7f2844812640 1 --2- 172.21.15.2:0/1060645566 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56138830c5d0 0x56138830ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:27.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.466+0000 7f283f7fe640 1 --2- 172.21.15.2:0/1060645566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56138831b780 0x56138831db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:27.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.466+0000 7f2844812640 1 -- 172.21.15.2:0/1060645566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56138831b780 msgr2=0x56138831db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:27.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.466+0000 7f2844812640 1 --2- 172.21.15.2:0/1060645566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56138831b780 0x56138831db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:27.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.466+0000 7f2844812640 1 -- 172.21.15.2:0/1060645566 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613881fe3a0 con 0x56138830db40 2024-09-19T06:23:27.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.466+0000 7f283d7fa640 1 --2- 172.21.15.2:0/4199212931 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f28280a3430 0x7f28280a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:27.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.466+0000 7f283ffff640 1 --2- 172.21.15.2:0/1060645566 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56138830c5d0 0x56138830ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:23:27.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.466+0000 7f283f7fe640 1 --2- 172.21.15.2:0/1060645566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56138831b780 0x56138831db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:23:27.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.467+0000 7f283ffff640 1 --2- 172.21.15.2:0/4199212931 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f28280a3430 0x7f28280a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:27.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.467+0000 7f2844812640 1 --2- 172.21.15.2:0/1060645566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56138830db40 0x56138830c090 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f283802f670 tx=0x7f283802f6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=268173955f9152dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:27.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.467+0000 7f283d7fa640 1 -- 172.21.15.2:0/4199212931 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f28340cfbe0 con 0x7f2840103660 2024-09-19T06:23:27.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.467+0000 7f28267fc640 1 -- 172.21.15.2:0/1060645566 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2838034040 con 0x56138830db40 2024-09-19T06:23:27.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.467+0000 7f28267fc640 1 -- 172.21.15.2:0/1060645566 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f283802fd20 con 0x56138830db40 2024-09-19T06:23:27.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.467+0000 7f28267fc640 1 -- 172.21.15.2:0/1060645566 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28380044b0 con 0x56138830db40 2024-09-19T06:23:27.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.468+0000 7f284864e740 1 -- 172.21.15.2:0/1060645566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56138830db40 msgr2=0x56138830c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:27.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.468+0000 7f283ffff640 1 --2- 172.21.15.2:0/4199212931 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f28280a3430 0x7f28280a58f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x561388309ac0 tx=0x7f283000a2d0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:27.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.468+0000 7f284864e740 1 --2- 172.21.15.2:0/1060645566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56138830db40 0x56138830c090 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f283802f670 tx=0x7f283802f6a0 comp rx=0 tx=0).stop 2024-09-19T06:23:27.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.468+0000 7f284864e740 1 -- 172.21.15.2:0/1060645566 shutdown_connections 2024-09-19T06:23:27.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.468+0000 7f284864e740 1 --2- 172.21.15.2:0/1060645566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56138831b780 0x56138831db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:27.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.468+0000 7f284864e740 1 --2- 172.21.15.2:0/1060645566 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56138830c5d0 0x56138830ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:27.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.468+0000 7f284864e740 1 --2- 172.21.15.2:0/1060645566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56138830db40 0x56138830c090 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:27.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.468+0000 7f284864e740 1 -- 172.21.15.2:0/1060645566 >> 172.21.15.2:0/1060645566 conn(0x5613882d5310 msgr2=0x561388308c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:27.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.468+0000 7f284864e740 1 -- 172.21.15.2:0/1060645566 shutdown_connections 2024-09-19T06:23:27.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.468+0000 7f284864e740 1 -- 172.21.15.2:0/1060645566 wait complete. 2024-09-19T06:23:27.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.468+0000 7f284864e740 1 -- start start 2024-09-19T06:23:27.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.468+0000 7f284864e740 1 Processor -- start 2024-09-19T06:23:27.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.469+0000 7f284864e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56138830c5d0 0x56138831b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:27.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.469+0000 7f284864e740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56138830db40 0x561388318350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:27.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.469+0000 7f284864e740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56138831b780 0x561388318890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:27.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.469+0000 7f284864e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56138831e420 con 0x56138830c5d0 2024-09-19T06:23:27.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.469+0000 7f284864e740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56138822d060 con 0x56138831b780 2024-09-19T06:23:27.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.469+0000 7f284864e740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56138831e5a0 con 0x56138830db40 2024-09-19T06:23:27.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.469+0000 7f284864e740 10 client.0 _ll_register_callbacks cb 0x561387f808c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:27.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.469+0000 7f283ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56138830c5d0 0x56138831b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:27.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.469+0000 7f283ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56138830c5d0 0x56138831b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52052/0 (socket says 172.21.15.2:52052) 2024-09-19T06:23:27.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.469+0000 7f283ffff640 1 -- 172.21.15.2:0/2835762550 learned_addr learned my addr 172.21.15.2:0/2835762550 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:27.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.469+0000 7f283f7fe640 1 --2- 172.21.15.2:0/2835762550 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56138830db40 0x561388318350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:27.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.469+0000 7f2844812640 1 --2- 172.21.15.2:0/2835762550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56138831b780 0x561388318890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:27.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.469+0000 7f283ffff640 1 -- 172.21.15.2:0/2835762550 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56138830db40 msgr2=0x561388318350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:27.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.469+0000 7f283ffff640 1 --2- 172.21.15.2:0/2835762550 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56138830db40 0x561388318350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:27.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.469+0000 7f283ffff640 1 -- 172.21.15.2:0/2835762550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56138831b780 msgr2=0x561388318890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:27.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.469+0000 7f283ffff640 1 --2- 172.21.15.2:0/2835762550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56138831b780 0x561388318890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:27.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.469+0000 7f283ffff640 1 -- 172.21.15.2:0/2835762550 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561387fe33c0 con 0x56138830c5d0 2024-09-19T06:23:27.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.469+0000 7f283ffff640 1 --2- 172.21.15.2:0/2835762550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56138830c5d0 0x56138831b0a0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f2830012a80 tx=0x7f28300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f15ae6e34886ffc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:27.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.469+0000 7f281f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:27.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.470+0000 7f281f7fe640 1 -- 172.21.15.2:0/2835762550 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283000fce0 con 0x56138830c5d0 2024-09-19T06:23:27.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.470+0000 7f281f7fe640 1 -- 172.21.15.2:0/2835762550 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f283001f420 con 0x56138830c5d0 2024-09-19T06:23:27.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.470+0000 7f284864e740 1 -- 172.21.15.2:0/2835762550 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f283802fd20 con 0x56138830c5d0 2024-09-19T06:23:27.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.470+0000 7f281f7fe640 1 -- 172.21.15.2:0/2835762550 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f283000fe80 con 0x56138830c5d0 2024-09-19T06:23:27.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.470+0000 7f284864e740 10 client.18291 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:27.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.470+0000 7f284864e740 1 -- 172.21.15.2:0/2835762550 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561388329db0 con 0x56138830c5d0 2024-09-19T06:23:27.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.470+0000 7f281f7fe640 1 -- 172.21.15.2:0/2835762550 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f283802fd20 con 0x56138830c5d0 2024-09-19T06:23:27.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.470+0000 7f281f7fe640 1 -- 172.21.15.2:0/2835762550 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f2830030850 con 0x56138830c5d0 2024-09-19T06:23:27.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.470+0000 7f284864e740 10 client.18291 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:27.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.470+0000 7f284864e740 10 client.18291 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:23:27.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.470+0000 7f284864e740 20 client.18291 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:27.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.470+0000 7f284864e740 1 --2- 172.21.15.2:0/2835762550 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x56138832b1c0 0x56138832d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:27.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.470+0000 7f284864e740 4 client.18291 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:23:27.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.470+0000 7f284864e740 1 -- 172.21.15.2:0/2835762550 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56138827f860 con 0x56138832b1c0 2024-09-19T06:23:27.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.471+0000 7f283f7fe640 1 --2- 172.21.15.2:0/2835762550 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x56138832b1c0 0x56138832d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:27.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.471+0000 7f283f7fe640 1 --2- 172.21.15.2:0/2835762550 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x56138832b1c0 0x56138832d5b0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c34ae89ac8b1a4f8 server_cookie=c947b00d5dd32b5b in_seq=0 out_seq=0 2024-09-19T06:23:27.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.471+0000 7f281f7fe640 10 client.18291 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:23:27.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.472+0000 7f281f7fe640 1 -- 172.21.15.2:0/2835762550 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56138827f860 con 0x56138832b1c0 2024-09-19T06:23:27.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.472+0000 7f281f7fe640 10 client.18291 handle_command_reply: tid=0 2024-09-19T06:23:27.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.472+0000 7f284864e740 1 client.18291 shutdown 2024-09-19T06:23:27.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.472+0000 7f284864e740 1 -- 172.21.15.2:0/2835762550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56138830c5d0 msgr2=0x56138831b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:27.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.472+0000 7f284864e740 1 --2- 172.21.15.2:0/2835762550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56138830c5d0 0x56138831b0a0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f2830012a80 tx=0x7f28300046c0 comp rx=0 tx=0).stop 2024-09-19T06:23:27.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.472+0000 7f284864e740 1 -- 172.21.15.2:0/2835762550 shutdown_connections 2024-09-19T06:23:27.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.472+0000 7f284864e740 1 --2- 172.21.15.2:0/2835762550 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x56138832b1c0 0x56138832d5b0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:27.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.472+0000 7f284864e740 1 --2- 172.21.15.2:0/2835762550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56138831b780 0x561388318890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:27.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.472+0000 7f284864e740 1 --2- 172.21.15.2:0/2835762550 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56138830db40 0x561388318350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:27.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.472+0000 7f284864e740 1 --2- 172.21.15.2:0/2835762550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56138830c5d0 0x56138831b0a0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:27.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.472+0000 7f284864e740 1 -- 172.21.15.2:0/2835762550 >> 172.21.15.2:0/2835762550 conn(0x5613882d5310 msgr2=0x56138830e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:27.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.472+0000 7f281f7fe640 0 client.18291 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:23:27.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.472+0000 7f284864e740 1 -- 172.21.15.2:0/2835762550 shutdown_connections 2024-09-19T06:23:27.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.472+0000 7f284864e740 1 -- 172.21.15.2:0/2835762550 wait complete. 2024-09-19T06:23:27.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.472+0000 7f284864e740 20 client.18291 trim_cache size 0 max 16384 2024-09-19T06:23:27.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.485+0000 7f284864e740 1 Processor -- start 2024-09-19T06:23:27.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.485+0000 7f284864e740 1 -- start start 2024-09-19T06:23:27.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.486+0000 7f284864e740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56138830c5d0 0x5613883276c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:27.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.486+0000 7f284864e740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56138830db40 0x561388316c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:27.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.486+0000 7f284864e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56138831b780 0x561388317160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:27.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.486+0000 7f284864e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f28401adee0 con 0x56138831b780 2024-09-19T06:23:27.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.486+0000 7f284864e740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f28401ab7b0 con 0x56138830db40 2024-09-19T06:23:27.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.486+0000 7f284864e740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f28401a9620 con 0x56138830c5d0 2024-09-19T06:23:27.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.486+0000 7f2844812640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56138831b780 0x561388317160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:27.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.486+0000 7f2844812640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56138831b780 0x561388317160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52066/0 (socket says 172.21.15.2:52066) 2024-09-19T06:23:27.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.486+0000 7f2844812640 1 -- 172.21.15.2:0/843351233 learned_addr learned my addr 172.21.15.2:0/843351233 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:27.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.486+0000 7f283f7fe640 1 --2- 172.21.15.2:0/843351233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56138830db40 0x561388316c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:27.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.486+0000 7f283ffff640 1 --2- 172.21.15.2:0/843351233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56138830c5d0 0x5613883276c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:27.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.486+0000 7f2844812640 1 -- 172.21.15.2:0/843351233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56138830c5d0 msgr2=0x5613883276c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:27.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.486+0000 7f2844812640 1 --2- 172.21.15.2:0/843351233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56138830c5d0 0x5613883276c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:27.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.486+0000 7f2844812640 1 -- 172.21.15.2:0/843351233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56138830db40 msgr2=0x561388316c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:27.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.486+0000 7f2844812640 1 --2- 172.21.15.2:0/843351233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56138830db40 0x561388316c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:27.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.486+0000 7f2844812640 1 -- 172.21.15.2:0/843351233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56138830d300 con 0x56138831b780 2024-09-19T06:23:27.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.486+0000 7f283ffff640 1 --2- 172.21.15.2:0/843351233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56138830c5d0 0x5613883276c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:23:27.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.486+0000 7f2844812640 1 --2- 172.21.15.2:0/843351233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56138831b780 0x561388317160 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f283802f670 tx=0x7f2838005f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7826a55481f46a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:27.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.486+0000 7f2825ffb640 1 -- 172.21.15.2:0/843351233 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2838051070 con 0x56138831b780 2024-09-19T06:23:27.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.487+0000 7f2825ffb640 1 -- 172.21.15.2:0/843351233 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f283802fd20 con 0x56138831b780 2024-09-19T06:23:27.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.487+0000 7f2825ffb640 1 -- 172.21.15.2:0/843351233 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2838034040 con 0x56138831b780 2024-09-19T06:23:27.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.487+0000 7f284864e740 1 -- 172.21.15.2:0/843351233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56138831b780 msgr2=0x561388317160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:27.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.487+0000 7f284864e740 1 --2- 172.21.15.2:0/843351233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56138831b780 0x561388317160 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f283802f670 tx=0x7f2838005f70 comp rx=0 tx=0).stop 2024-09-19T06:23:27.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.487+0000 7f284864e740 1 -- 172.21.15.2:0/843351233 shutdown_connections 2024-09-19T06:23:27.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.487+0000 7f284864e740 1 --2- 172.21.15.2:0/843351233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56138831b780 0x561388317160 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:27.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.487+0000 7f284864e740 1 --2- 172.21.15.2:0/843351233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56138830db40 0x561388316c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:27.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.487+0000 7f284864e740 1 --2- 172.21.15.2:0/843351233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56138830c5d0 0x5613883276c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:27.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.487+0000 7f284864e740 1 -- 172.21.15.2:0/843351233 >> 172.21.15.2:0/843351233 conn(0x5613882d5310 msgr2=0x561388318310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:27.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.487+0000 7f284864e740 1 -- 172.21.15.2:0/843351233 shutdown_connections 2024-09-19T06:23:27.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.487+0000 7f284864e740 1 -- 172.21.15.2:0/843351233 wait complete. 2024-09-19T06:23:27.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.488+0000 7f284864e740 1 -- start start 2024-09-19T06:23:27.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.488+0000 7f284864e740 1 Processor -- start 2024-09-19T06:23:27.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.488+0000 7f284864e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56138830c5d0 0x561388323e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:27.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.488+0000 7f284864e740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56138830db40 0x56138831f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:27.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.488+0000 7f284864e740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56138831b780 0x56138831f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:27.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.488+0000 7f284864e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f28401a9c70 con 0x56138830c5d0 2024-09-19T06:23:27.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.488+0000 7f284864e740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f28401ab0e0 con 0x56138830db40 2024-09-19T06:23:27.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.488+0000 7f284864e740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f28401aa340 con 0x56138831b780 2024-09-19T06:23:27.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.488+0000 7f284864e740 10 client.0 _ll_register_callbacks cb 0x7f2830012730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:27.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.488+0000 7f283ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56138830c5d0 0x561388323e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:27.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.488+0000 7f283ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56138830c5d0 0x561388323e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52070/0 (socket says 172.21.15.2:52070) 2024-09-19T06:23:27.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.488+0000 7f283ffff640 1 -- 172.21.15.2:0/1767132084 learned_addr learned my addr 172.21.15.2:0/1767132084 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:27.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.488+0000 7f283f7fe640 1 --2- 172.21.15.2:0/1767132084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56138830db40 0x56138831f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:27.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.489+0000 7f2844812640 1 --2- 172.21.15.2:0/1767132084 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56138831b780 0x56138831f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:27.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.489+0000 7f283ffff640 1 -- 172.21.15.2:0/1767132084 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56138831b780 msgr2=0x56138831f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:27.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.489+0000 7f283ffff640 1 --2- 172.21.15.2:0/1767132084 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56138831b780 0x56138831f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:27.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.489+0000 7f283ffff640 1 -- 172.21.15.2:0/1767132084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56138830db40 msgr2=0x56138831f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:27.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.489+0000 7f283ffff640 1 --2- 172.21.15.2:0/1767132084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56138830db40 0x56138831f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:27.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.489+0000 7f283ffff640 1 -- 172.21.15.2:0/1767132084 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56138831fdc0 con 0x56138830c5d0 2024-09-19T06:23:27.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.489+0000 7f283f7fe640 1 --2- 172.21.15.2:0/1767132084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56138830db40 0x56138831f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:23:27.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.489+0000 7f283ffff640 1 --2- 172.21.15.2:0/1767132084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56138830c5d0 0x561388323e60 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f28300124d0 tx=0x7f2830011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc71c5e7b12cc225 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:27.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.489+0000 7f281f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:27.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.489+0000 7f281f7fe640 1 -- 172.21.15.2:0/1767132084 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2830040060 con 0x56138830c5d0 2024-09-19T06:23:27.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.489+0000 7f281f7fe640 1 -- 172.21.15.2:0/1767132084 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f2830030990 con 0x56138830c5d0 2024-09-19T06:23:27.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.489+0000 7f284864e740 1 -- 172.21.15.2:0/1767132084 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f283802fd20 con 0x56138830c5d0 2024-09-19T06:23:27.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.489+0000 7f281f7fe640 1 -- 172.21.15.2:0/1767132084 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2830027610 con 0x56138830c5d0 2024-09-19T06:23:27.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.489+0000 7f284864e740 10 client.18297 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:27.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.489+0000 7f284864e740 1 -- 172.21.15.2:0/1767132084 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561388395cb0 con 0x56138830c5d0 2024-09-19T06:23:27.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.489+0000 7f281f7fe640 1 -- 172.21.15.2:0/1767132084 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f283802fd20 con 0x56138830c5d0 2024-09-19T06:23:27.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.490+0000 7f281f7fe640 1 -- 172.21.15.2:0/1767132084 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f283003b920 con 0x56138830c5d0 2024-09-19T06:23:27.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.490+0000 7f284864e740 10 client.18297 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:27.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.490+0000 7f284864e740 10 client.18297 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:23:27.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.490+0000 7f284864e740 20 client.18297 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:27.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.490+0000 7f284864e740 1 --2- 172.21.15.2:0/1767132084 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x5613883963d0 0x5613883987e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:27.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.490+0000 7f284864e740 4 client.18297 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:23:27.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.490+0000 7f284864e740 1 -- 172.21.15.2:0/1767132084 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561388279d70 con 0x5613883963d0 2024-09-19T06:23:27.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.490+0000 7f283f7fe640 1 --2- 172.21.15.2:0/1767132084 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x5613883963d0 0x5613883987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:27.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.490+0000 7f283f7fe640 1 --2- 172.21.15.2:0/1767132084 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x5613883963d0 0x5613883987e0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=466006d97b449628 server_cookie=ed60c601a34fc68f in_seq=0 out_seq=0 2024-09-19T06:23:27.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.490+0000 7f281f7fe640 10 client.18297 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:23:27.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.491+0000 7f281f7fe640 1 -- 172.21.15.2:0/1767132084 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561388279d70 con 0x5613883963d0 2024-09-19T06:23:27.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.491+0000 7f281f7fe640 10 client.18297 handle_command_reply: tid=0 2024-09-19T06:23:27.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.491+0000 7f284864e740 1 client.18297 shutdown 2024-09-19T06:23:27.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.491+0000 7f284864e740 1 -- 172.21.15.2:0/1767132084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56138830c5d0 msgr2=0x561388323e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:27.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.491+0000 7f284864e740 1 --2- 172.21.15.2:0/1767132084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56138830c5d0 0x561388323e60 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f28300124d0 tx=0x7f2830011940 comp rx=0 tx=0).stop 2024-09-19T06:23:27.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.491+0000 7f284864e740 1 -- 172.21.15.2:0/1767132084 shutdown_connections 2024-09-19T06:23:27.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.491+0000 7f284864e740 1 --2- 172.21.15.2:0/1767132084 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x5613883963d0 0x5613883987e0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:27.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.491+0000 7f284864e740 1 --2- 172.21.15.2:0/1767132084 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56138831b780 0x56138831f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:27.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.491+0000 7f284864e740 1 --2- 172.21.15.2:0/1767132084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56138830db40 0x56138831f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:27.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.491+0000 7f284864e740 1 --2- 172.21.15.2:0/1767132084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56138830c5d0 0x561388323e60 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:27.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.491+0000 7f284864e740 1 -- 172.21.15.2:0/1767132084 >> 172.21.15.2:0/1767132084 conn(0x5613882d5310 msgr2=0x561388316b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:27.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.491+0000 7f281f7fe640 0 client.18297 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:23:27.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.491+0000 7f284864e740 1 -- 172.21.15.2:0/1767132084 shutdown_connections 2024-09-19T06:23:27.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.491+0000 7f284864e740 1 -- 172.21.15.2:0/1767132084 wait complete. 2024-09-19T06:23:27.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.491+0000 7f284864e740 20 client.18297 trim_cache size 0 max 16384 2024-09-19T06:23:27.503 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:23:27.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.492+0000 7f2846275640 1 -- 172.21.15.2:0/4199212931 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f28280a3430 msgr2=0x7f28280a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:27.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.492+0000 7f2846275640 1 --2- 172.21.15.2:0/4199212931 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f28280a3430 0x7f28280a58f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x561388309ac0 tx=0x7f283000a2d0 comp rx=0 tx=0).stop 2024-09-19T06:23:27.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.492+0000 7f2846275640 1 -- 172.21.15.2:0/4199212931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2840103660 msgr2=0x7f2840198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:27.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.492+0000 7f2846275640 1 --2- 172.21.15.2:0/4199212931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2840103660 0x7f2840198840 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f283400c940 tx=0x7f283400ce00 comp rx=0 tx=0).stop 2024-09-19T06:23:27.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.492+0000 7f2846275640 1 -- 172.21.15.2:0/4199212931 shutdown_connections 2024-09-19T06:23:27.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.492+0000 7f2846275640 1 --2- 172.21.15.2:0/4199212931 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f28280a3430 0x7f28280a58f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:27.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.492+0000 7f2846275640 1 --2- 172.21.15.2:0/4199212931 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f284010c170 0x7f284019cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:27.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.492+0000 7f2846275640 1 --2- 172.21.15.2:0/4199212931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2840103660 0x7f2840198840 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:27.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.492+0000 7f2846275640 1 --2- 172.21.15.2:0/4199212931 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2840102d40 0x7f2840198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:27.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.492+0000 7f2846275640 1 -- 172.21.15.2:0/4199212931 >> 172.21.15.2:0/4199212931 conn(0x7f28400fc7a0 msgr2=0x7f28400fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:27.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.492+0000 7f2846275640 1 -- 172.21.15.2:0/4199212931 shutdown_connections 2024-09-19T06:23:27.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:27.492+0000 7f2846275640 1 -- 172.21.15.2:0/4199212931 wait complete. 2024-09-19T06:23:27.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:27 smithi002 ceph-mon[30982]: pgmap v268: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:23:27.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:27 smithi089 ceph-mon[34160]: pgmap v268: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:23:27.891 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:27 smithi090 ceph-mon[34497]: pgmap v268: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:23:28.173 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:23:28.430 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:23:28.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.879+0000 7f2c3a8b8640 1 -- 172.21.15.2:0/1594524172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c34102ef0 msgr2=0x7f2c3410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:28.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.879+0000 7f2c3a8b8640 1 --2- 172.21.15.2:0/1594524172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c34102ef0 0x7f2c3410da40 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c009ca0 tx=0x7f2c2c02a950 comp rx=0 tx=0).stop 2024-09-19T06:23:28.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.879+0000 7f2c3a8b8640 1 -- 172.21.15.2:0/1594524172 shutdown_connections 2024-09-19T06:23:28.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.879+0000 7f2c3a8b8640 1 --2- 172.21.15.2:0/1594524172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c34102ef0 0x7f2c3410da40 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:28.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.879+0000 7f2c3a8b8640 1 --2- 172.21.15.2:0/1594524172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c34102570 0x7f2c341029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:28.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.879+0000 7f2c3a8b8640 1 --2- 172.21.15.2:0/1594524172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c34100e20 0x7f2c34101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:28.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.879+0000 7f2c3a8b8640 1 -- 172.21.15.2:0/1594524172 >> 172.21.15.2:0/1594524172 conn(0x7f2c340fc7d0 msgr2=0x7f2c340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:28.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.879+0000 7f2c3a8b8640 1 -- 172.21.15.2:0/1594524172 shutdown_connections 2024-09-19T06:23:28.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.879+0000 7f2c3a8b8640 1 -- 172.21.15.2:0/1594524172 wait complete. 2024-09-19T06:23:28.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.880+0000 7f2c3a8b8640 1 Processor -- start 2024-09-19T06:23:28.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.880+0000 7f2c3a8b8640 1 -- start start 2024-09-19T06:23:28.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.880+0000 7f2c3a8b8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c34100e20 0x7f2c34198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:28.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.880+0000 7f2c3a8b8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c34102570 0x7f2c34198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:28.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.880+0000 7f2c3a8b8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c34102ef0 0x7f2c3419cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:28.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.880+0000 7f2c3a8b8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2c34110e30 con 0x7f2c34102ef0 2024-09-19T06:23:28.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.880+0000 7f2c3a8b8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2c34110cb0 con 0x7f2c34100e20 2024-09-19T06:23:28.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.880+0000 7f2c3a8b8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2c34110fb0 con 0x7f2c34102570 2024-09-19T06:23:28.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.880+0000 7f2c38e55640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c34102ef0 0x7f2c3419cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:28.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.880+0000 7f2c38e55640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c34102ef0 0x7f2c3419cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52086/0 (socket says 172.21.15.2:52086) 2024-09-19T06:23:28.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.880+0000 7f2c38e55640 1 -- 172.21.15.2:0/425624062 learned_addr learned my addr 172.21.15.2:0/425624062 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:28.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.880+0000 7f2c33fff640 1 --2- 172.21.15.2:0/425624062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c34100e20 0x7f2c34198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:28.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.880+0000 7f2c337fe640 1 --2- 172.21.15.2:0/425624062 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c34102570 0x7f2c34198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:28.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.881+0000 7f2c38e55640 1 -- 172.21.15.2:0/425624062 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c34102570 msgr2=0x7f2c34198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:28.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.881+0000 7f2c38e55640 1 --2- 172.21.15.2:0/425624062 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c34102570 0x7f2c34198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:28.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.881+0000 7f2c38e55640 1 -- 172.21.15.2:0/425624062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c34100e20 msgr2=0x7f2c34198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:28.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.881+0000 7f2c38e55640 1 --2- 172.21.15.2:0/425624062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c34100e20 0x7f2c34198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:28.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.881+0000 7f2c38e55640 1 -- 172.21.15.2:0/425624062 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c3419d2b0 con 0x7f2c34102ef0 2024-09-19T06:23:28.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.881+0000 7f2c33fff640 1 --2- 172.21.15.2:0/425624062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c34100e20 0x7f2c34198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:23:28.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.881+0000 7f2c38e55640 1 --2- 172.21.15.2:0/425624062 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c34102ef0 0x7f2c3419cbd0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c02ae70 tx=0x7f2c2c02f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:28.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.881+0000 7f2c317fa640 1 -- 172.21.15.2:0/425624062 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c034040 con 0x7f2c34102ef0 2024-09-19T06:23:28.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.881+0000 7f2c3a8b8640 1 -- 172.21.15.2:0/425624062 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c3419d540 con 0x7f2c34102ef0 2024-09-19T06:23:28.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.881+0000 7f2c317fa640 1 -- 172.21.15.2:0/425624062 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2c2c0308f0 con 0x7f2c34102ef0 2024-09-19T06:23:28.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.881+0000 7f2c317fa640 1 -- 172.21.15.2:0/425624062 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c004750 con 0x7f2c34102ef0 2024-09-19T06:23:28.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.881+0000 7f2c3a8b8640 1 -- 172.21.15.2:0/425624062 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c341a4e80 con 0x7f2c34102ef0 2024-09-19T06:23:28.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.883+0000 7f2c317fa640 1 -- 172.21.15.2:0/425624062 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f2c2c037020 con 0x7f2c34102ef0 2024-09-19T06:23:28.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.884+0000 7f2c3cc91740 1 Processor -- start 2024-09-19T06:23:28.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.884+0000 7f2c3cc91740 1 -- start start 2024-09-19T06:23:28.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.884+0000 7f2c3cc91740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557358e79b40 0x557358e78090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:28.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.884+0000 7f2c3cc91740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557358e785d0 0x557358e78a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:28.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.884+0000 7f2c3cc91740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557358e87780 0x557358e89b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:28.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.884+0000 7f2c3cc91740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557358dde2f0 con 0x557358e79b40 2024-09-19T06:23:28.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.884+0000 7f2c3cc91740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x557358d85cf0 con 0x557358e785d0 2024-09-19T06:23:28.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.884+0000 7f2c3cc91740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x557358dda2b0 con 0x557358e87780 2024-09-19T06:23:28.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.884+0000 7f2c337fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557358e79b40 0x557358e78090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:28.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.884+0000 7f2c337fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557358e79b40 0x557358e78090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52090/0 (socket says 172.21.15.2:52090) 2024-09-19T06:23:28.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.884+0000 7f2c337fe640 1 -- 172.21.15.2:0/3339401237 learned_addr learned my addr 172.21.15.2:0/3339401237 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:28.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.884+0000 7f2c317fa640 1 --2- 172.21.15.2:0/425624062 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f2c1c0a33b0 0x7f2c1c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:28.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.884+0000 7f2c38e55640 1 --2- 172.21.15.2:0/425624062 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f2c1c0a33b0 0x7f2c1c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:28.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.884+0000 7f2c337fe640 1 --2- 172.21.15.2:0/3339401237 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557358e87780 0x557358e89b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:28.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.884+0000 7f2c33fff640 1 --2- 172.21.15.2:0/3339401237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557358e785d0 0x557358e78a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:28.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.884+0000 7f2c337fe640 1 -- 172.21.15.2:0/3339401237 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557358e87780 msgr2=0x557358e89b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:28.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.884+0000 7f2c337fe640 1 --2- 172.21.15.2:0/3339401237 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557358e87780 0x557358e89b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:28.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.884+0000 7f2c317fa640 1 -- 172.21.15.2:0/425624062 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f2c2c0f0b10 con 0x7f2c34102ef0 2024-09-19T06:23:28.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.884+0000 7f2c337fe640 1 -- 172.21.15.2:0/3339401237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557358e785d0 msgr2=0x557358e78a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:28.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.884+0000 7f2c337fe640 1 --2- 172.21.15.2:0/3339401237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557358e785d0 0x557358e78a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:28.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.885+0000 7f2c337fe640 1 -- 172.21.15.2:0/3339401237 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557358d6a3a0 con 0x557358e79b40 2024-09-19T06:23:28.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.885+0000 7f2c33fff640 1 --2- 172.21.15.2:0/3339401237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557358e785d0 0x557358e78a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:23:28.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.885+0000 7f2c337fe640 1 --2- 172.21.15.2:0/3339401237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557358e79b40 0x557358e78090 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f2c28013560 tx=0x7f2c2800a800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a1a9fbaeb70a28c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:28.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.885+0000 7f2c38e55640 1 --2- 172.21.15.2:0/425624062 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f2c1c0a33b0 0x7f2c1c0a5870 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c0ee860 tx=0x7f2c2c08ec80 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:28.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.885+0000 7f2c1a7fc640 1 -- 172.21.15.2:0/3339401237 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c28019030 con 0x557358e79b40 2024-09-19T06:23:28.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.885+0000 7f2c1a7fc640 1 -- 172.21.15.2:0/3339401237 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2c280110d0 con 0x557358e79b40 2024-09-19T06:23:28.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.885+0000 7f2c1a7fc640 1 -- 172.21.15.2:0/3339401237 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2800f780 con 0x557358e79b40 2024-09-19T06:23:28.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.886+0000 7f2c3cc91740 1 -- 172.21.15.2:0/3339401237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557358e79b40 msgr2=0x557358e78090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:28.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.886+0000 7f2c3cc91740 1 --2- 172.21.15.2:0/3339401237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557358e79b40 0x557358e78090 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f2c28013560 tx=0x7f2c2800a800 comp rx=0 tx=0).stop 2024-09-19T06:23:28.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.886+0000 7f2c3cc91740 1 -- 172.21.15.2:0/3339401237 shutdown_connections 2024-09-19T06:23:28.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.886+0000 7f2c3cc91740 1 --2- 172.21.15.2:0/3339401237 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557358e87780 0x557358e89b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:28.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.886+0000 7f2c3cc91740 1 --2- 172.21.15.2:0/3339401237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557358e785d0 0x557358e78a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:28.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.886+0000 7f2c3cc91740 1 --2- 172.21.15.2:0/3339401237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557358e79b40 0x557358e78090 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:28.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.886+0000 7f2c3cc91740 1 -- 172.21.15.2:0/3339401237 >> 172.21.15.2:0/3339401237 conn(0x557358e41310 msgr2=0x557358e74c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:28.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.886+0000 7f2c3cc91740 1 -- 172.21.15.2:0/3339401237 shutdown_connections 2024-09-19T06:23:28.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.886+0000 7f2c3cc91740 1 -- 172.21.15.2:0/3339401237 wait complete. 2024-09-19T06:23:28.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.886+0000 7f2c3cc91740 1 -- start start 2024-09-19T06:23:28.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.886+0000 7f2c3cc91740 1 Processor -- start 2024-09-19T06:23:28.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.887+0000 7f2c3cc91740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557358e785d0 0x557358e87110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:28.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.887+0000 7f2c3cc91740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557358e79b40 0x557358e843c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:28.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.887+0000 7f2c3cc91740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557358e87780 0x557358e84940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:28.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.887+0000 7f2c3cc91740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557358e8a480 con 0x557358e785d0 2024-09-19T06:23:28.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.887+0000 7f2c3cc91740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x557358d99060 con 0x557358e87780 2024-09-19T06:23:28.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.887+0000 7f2c3cc91740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x557358e8a600 con 0x557358e79b40 2024-09-19T06:23:28.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.887+0000 7f2c3cc91740 10 client.0 _ll_register_callbacks cb 0x557358aec8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:28.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.887+0000 7f2c337fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557358e785d0 0x557358e87110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:28.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.887+0000 7f2c337fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557358e785d0 0x557358e87110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52096/0 (socket says 172.21.15.2:52096) 2024-09-19T06:23:28.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.887+0000 7f2c337fe640 1 -- 172.21.15.2:0/3338507401 learned_addr learned my addr 172.21.15.2:0/3338507401 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:28.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.887+0000 7f2c33fff640 1 --2- 172.21.15.2:0/3338507401 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557358e79b40 0x557358e843c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:28.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.887+0000 7f2c337fe640 1 --2- 172.21.15.2:0/3338507401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557358e87780 0x557358e84940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:28.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.887+0000 7f2c337fe640 1 -- 172.21.15.2:0/3338507401 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557358e79b40 msgr2=0x557358e843c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:28.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.887+0000 7f2c337fe640 1 --2- 172.21.15.2:0/3338507401 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557358e79b40 0x557358e843c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:28.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.887+0000 7f2c337fe640 1 -- 172.21.15.2:0/3338507401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557358e87780 msgr2=0x557358e84940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:28.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.887+0000 7f2c337fe640 1 --2- 172.21.15.2:0/3338507401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557358e87780 0x557358e84940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:28.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.887+0000 7f2c337fe640 1 -- 172.21.15.2:0/3338507401 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557358b4f3c0 con 0x557358e785d0 2024-09-19T06:23:28.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.887+0000 7f2c337fe640 1 --2- 172.21.15.2:0/3338507401 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557358e785d0 0x557358e87110 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f2c2800a6e0 tx=0x7f2c2800a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b67007fd907bd01a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:28.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.887+0000 7f2c137fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:28.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.888+0000 7f2c137fe640 1 -- 172.21.15.2:0/3338507401 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c28019040 con 0x557358e785d0 2024-09-19T06:23:28.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.888+0000 7f2c137fe640 1 -- 172.21.15.2:0/3338507401 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f2c280052c0 con 0x557358e785d0 2024-09-19T06:23:28.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.888+0000 7f2c3cc91740 1 -- 172.21.15.2:0/3338507401 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c280110d0 con 0x557358e785d0 2024-09-19T06:23:28.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.888+0000 7f2c137fe640 1 -- 172.21.15.2:0/3338507401 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2c28032050 con 0x557358e785d0 2024-09-19T06:23:28.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.888+0000 7f2c3cc91740 10 client.18309 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:28.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.888+0000 7f2c3cc91740 1 -- 172.21.15.2:0/3338507401 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557358e95e20 con 0x557358e785d0 2024-09-19T06:23:28.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.888+0000 7f2c137fe640 1 -- 172.21.15.2:0/3338507401 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2c280110d0 con 0x557358e785d0 2024-09-19T06:23:28.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.888+0000 7f2c137fe640 1 -- 172.21.15.2:0/3338507401 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f2c2800f500 con 0x557358e785d0 2024-09-19T06:23:28.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.888+0000 7f2c3cc91740 10 client.18309 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:28.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.888+0000 7f2c3cc91740 10 client.18309 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:23:28.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.888+0000 7f2c3cc91740 20 client.18309 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:28.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.888+0000 7f2c3cc91740 1 --2- 172.21.15.2:0/3338507401 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x557358e97170 0x557358e99560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:28.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.888+0000 7f2c3cc91740 4 client.18309 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:23:28.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.888+0000 7f2c3cc91740 1 -- 172.21.15.2:0/3338507401 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557358deb860 con 0x557358e97170 2024-09-19T06:23:28.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.889+0000 7f2c33fff640 1 --2- 172.21.15.2:0/3338507401 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x557358e97170 0x557358e99560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:28.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.889+0000 7f2c33fff640 1 --2- 172.21.15.2:0/3338507401 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x557358e97170 0x557358e99560 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cfb90c0cbcab46ac server_cookie=3b02a45de8e05d00 in_seq=0 out_seq=0 2024-09-19T06:23:28.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.889+0000 7f2c137fe640 10 client.18309 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:23:28.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.890+0000 7f2c137fe640 1 -- 172.21.15.2:0/3338507401 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557358deb860 con 0x557358e97170 2024-09-19T06:23:28.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.890+0000 7f2c137fe640 10 client.18309 handle_command_reply: tid=0 2024-09-19T06:23:28.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.890+0000 7f2c3cc91740 1 client.18309 shutdown 2024-09-19T06:23:28.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.890+0000 7f2c3cc91740 1 -- 172.21.15.2:0/3338507401 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557358e785d0 msgr2=0x557358e87110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:28.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.890+0000 7f2c3cc91740 1 --2- 172.21.15.2:0/3338507401 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557358e785d0 0x557358e87110 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f2c2800a6e0 tx=0x7f2c2800a630 comp rx=0 tx=0).stop 2024-09-19T06:23:28.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.890+0000 7f2c3cc91740 1 -- 172.21.15.2:0/3338507401 shutdown_connections 2024-09-19T06:23:28.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.890+0000 7f2c3cc91740 1 --2- 172.21.15.2:0/3338507401 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x557358e97170 0x557358e99560 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:28.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.890+0000 7f2c3cc91740 1 --2- 172.21.15.2:0/3338507401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557358e87780 0x557358e84940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:28.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.890+0000 7f2c3cc91740 1 --2- 172.21.15.2:0/3338507401 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557358e79b40 0x557358e843c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:28.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.890+0000 7f2c137fe640 0 client.18309 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:23:28.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.890+0000 7f2c3cc91740 1 --2- 172.21.15.2:0/3338507401 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557358e785d0 0x557358e87110 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:28.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.890+0000 7f2c3cc91740 1 -- 172.21.15.2:0/3338507401 >> 172.21.15.2:0/3338507401 conn(0x557358e41310 msgr2=0x557358e7a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:28.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.890+0000 7f2c3cc91740 1 -- 172.21.15.2:0/3338507401 shutdown_connections 2024-09-19T06:23:28.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.890+0000 7f2c3cc91740 1 -- 172.21.15.2:0/3338507401 wait complete. 2024-09-19T06:23:28.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.890+0000 7f2c3cc91740 20 client.18309 trim_cache size 0 max 16384 2024-09-19T06:23:28.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.903+0000 7f2c3cc91740 1 Processor -- start 2024-09-19T06:23:28.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.903+0000 7f2c3cc91740 1 -- start start 2024-09-19T06:23:28.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.903+0000 7f2c3cc91740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557358e785d0 0x557358e93720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:28.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.903+0000 7f2c3cc91740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557358e79b40 0x557358e9eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:28.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.903+0000 7f2c3cc91740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557358e87780 0x557358e9f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:28.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.903+0000 7f2c3cc91740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2c341adc90 con 0x557358e785d0 2024-09-19T06:23:28.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.903+0000 7f2c3cc91740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2c341ab560 con 0x557358e79b40 2024-09-19T06:23:28.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.903+0000 7f2c3cc91740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2c341a93f0 con 0x557358e87780 2024-09-19T06:23:28.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.903+0000 7f2c337fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557358e785d0 0x557358e93720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:28.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.903+0000 7f2c337fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557358e785d0 0x557358e93720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52106/0 (socket says 172.21.15.2:52106) 2024-09-19T06:23:28.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.903+0000 7f2c337fe640 1 -- 172.21.15.2:0/105287189 learned_addr learned my addr 172.21.15.2:0/105287189 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:28.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.904+0000 7f2c33fff640 1 --2- 172.21.15.2:0/105287189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557358e79b40 0x557358e9eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:28.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.904+0000 7f2c337fe640 1 -- 172.21.15.2:0/105287189 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557358e87780 msgr2=0x557358e9f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:28.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.904+0000 7f2c337fe640 1 --2- 172.21.15.2:0/105287189 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557358e87780 0x557358e9f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:28.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.904+0000 7f2c337fe640 1 -- 172.21.15.2:0/105287189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557358e79b40 msgr2=0x557358e9eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:28.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.904+0000 7f2c337fe640 1 --2- 172.21.15.2:0/105287189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557358e79b40 0x557358e9eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:28.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.904+0000 7f2c337fe640 1 -- 172.21.15.2:0/105287189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557358e82910 con 0x557358e785d0 2024-09-19T06:23:28.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.904+0000 7f2c337fe640 1 --2- 172.21.15.2:0/105287189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557358e785d0 0x557358e93720 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f2c2800fa20 tx=0x7f2c28011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3052ceff57dd4939 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:28.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.904+0000 7f2c19ffb640 1 -- 172.21.15.2:0/105287189 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2800a2d0 con 0x557358e785d0 2024-09-19T06:23:28.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.904+0000 7f2c19ffb640 1 -- 172.21.15.2:0/105287189 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2c2800fc20 con 0x557358e785d0 2024-09-19T06:23:28.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.904+0000 7f2c19ffb640 1 -- 172.21.15.2:0/105287189 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c28004660 con 0x557358e785d0 2024-09-19T06:23:28.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.905+0000 7f2c3cc91740 1 -- 172.21.15.2:0/105287189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557358e785d0 msgr2=0x557358e93720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:28.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.905+0000 7f2c3cc91740 1 --2- 172.21.15.2:0/105287189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557358e785d0 0x557358e93720 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f2c2800fa20 tx=0x7f2c28011ab0 comp rx=0 tx=0).stop 2024-09-19T06:23:28.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.905+0000 7f2c3cc91740 1 -- 172.21.15.2:0/105287189 shutdown_connections 2024-09-19T06:23:28.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.905+0000 7f2c3cc91740 1 --2- 172.21.15.2:0/105287189 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557358e87780 0x557358e9f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:28.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.905+0000 7f2c3cc91740 1 --2- 172.21.15.2:0/105287189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557358e79b40 0x557358e9eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:28.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.905+0000 7f2c3cc91740 1 --2- 172.21.15.2:0/105287189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557358e785d0 0x557358e93720 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:28.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.905+0000 7f2c3cc91740 1 -- 172.21.15.2:0/105287189 >> 172.21.15.2:0/105287189 conn(0x557358e41310 msgr2=0x557358e834b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:28.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.905+0000 7f2c3cc91740 1 -- 172.21.15.2:0/105287189 shutdown_connections 2024-09-19T06:23:28.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.905+0000 7f2c3cc91740 1 -- 172.21.15.2:0/105287189 wait complete. 2024-09-19T06:23:28.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.905+0000 7f2c3cc91740 1 -- start start 2024-09-19T06:23:28.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.905+0000 7f2c3cc91740 1 Processor -- start 2024-09-19T06:23:28.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.906+0000 7f2c3cc91740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557358e785d0 0x557358e8fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:28.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.906+0000 7f2c3cc91740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557358e79b40 0x557358e90120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:28.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.906+0000 7f2c3cc91740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557358e87780 0x557358e8b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:28.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.906+0000 7f2c3cc91740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2c341a9a40 con 0x557358e79b40 2024-09-19T06:23:28.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.906+0000 7f2c3cc91740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2c341aae90 con 0x557358e785d0 2024-09-19T06:23:28.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.906+0000 7f2c3cc91740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2c341aa0f0 con 0x557358e87780 2024-09-19T06:23:28.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.906+0000 7f2c3cc91740 10 client.0 _ll_register_callbacks cb 0x7f2c28013460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:28.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.906+0000 7f2c33fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557358e79b40 0x557358e90120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:28.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.906+0000 7f2c33fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557358e79b40 0x557358e90120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52110/0 (socket says 172.21.15.2:52110) 2024-09-19T06:23:28.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.906+0000 7f2c33fff640 1 -- 172.21.15.2:0/3737013337 learned_addr learned my addr 172.21.15.2:0/3737013337 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:28.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.906+0000 7f2c337fe640 1 --2- 172.21.15.2:0/3737013337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557358e785d0 0x557358e8fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:28.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.906+0000 7f2c337fe640 1 --2- 172.21.15.2:0/3737013337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557358e87780 0x557358e8b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:28.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.906+0000 7f2c33fff640 1 -- 172.21.15.2:0/3737013337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557358e87780 msgr2=0x557358e8b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:28.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.906+0000 7f2c33fff640 1 --2- 172.21.15.2:0/3737013337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557358e87780 0x557358e8b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:28.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.906+0000 7f2c33fff640 1 -- 172.21.15.2:0/3737013337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557358e785d0 msgr2=0x557358e8fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:28.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.906+0000 7f2c33fff640 1 --2- 172.21.15.2:0/3737013337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557358e785d0 0x557358e8fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:28.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.906+0000 7f2c33fff640 1 -- 172.21.15.2:0/3737013337 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557358e8b860 con 0x557358e79b40 2024-09-19T06:23:28.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.906+0000 7f2c337fe640 1 --2- 172.21.15.2:0/3737013337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557358e785d0 0x557358e8fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:28.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.906+0000 7f2c33fff640 1 --2- 172.21.15.2:0/3737013337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557358e79b40 0x557358e90120 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f2c2400b560 tx=0x7f2c24012ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcbcef00bcee6eac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:28.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.906+0000 7f2c137fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:28.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.906+0000 7f2c137fe640 1 -- 172.21.15.2:0/3737013337 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c24011b80 con 0x557358e79b40 2024-09-19T06:23:28.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.907+0000 7f2c137fe640 1 -- 172.21.15.2:0/3737013337 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f2c24011d20 con 0x557358e79b40 2024-09-19T06:23:28.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.907+0000 7f2c3cc91740 1 -- 172.21.15.2:0/3737013337 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c2800fc20 con 0x557358e79b40 2024-09-19T06:23:28.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.907+0000 7f2c137fe640 1 -- 172.21.15.2:0/3737013337 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2c24005020 con 0x557358e79b40 2024-09-19T06:23:28.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.907+0000 7f2c3cc91740 10 client.18315 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:28.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.907+0000 7f2c3cc91740 1 -- 172.21.15.2:0/3737013337 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557358f01900 con 0x557358e79b40 2024-09-19T06:23:28.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.907+0000 7f2c137fe640 1 -- 172.21.15.2:0/3737013337 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2c2800fc20 con 0x557358e79b40 2024-09-19T06:23:28.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.907+0000 7f2c137fe640 1 -- 172.21.15.2:0/3737013337 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f2c24004cc0 con 0x557358e79b40 2024-09-19T06:23:28.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.907+0000 7f2c3cc91740 10 client.18315 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:28.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.907+0000 7f2c3cc91740 10 client.18315 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:23:28.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.907+0000 7f2c3cc91740 20 client.18315 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:28.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.907+0000 7f2c3cc91740 1 --2- 172.21.15.2:0/3737013337 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x557358e97170 0x557358f040f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:28.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.907+0000 7f2c3cc91740 4 client.18315 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:23:28.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.907+0000 7f2c3cc91740 1 -- 172.21.15.2:0/3737013337 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557358de5d70 con 0x557358e97170 2024-09-19T06:23:28.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.907+0000 7f2c337fe640 1 --2- 172.21.15.2:0/3737013337 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x557358e97170 0x557358f040f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:28.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.908+0000 7f2c337fe640 1 --2- 172.21.15.2:0/3737013337 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x557358e97170 0x557358f040f0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a724c04d1f09b5e5 server_cookie=182cd1446c0ae5c0 in_seq=0 out_seq=0 2024-09-19T06:23:28.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.908+0000 7f2c137fe640 10 client.18315 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:23:28.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.908+0000 7f2c137fe640 1 -- 172.21.15.2:0/3737013337 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557358de5d70 con 0x557358e97170 2024-09-19T06:23:28.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.908+0000 7f2c137fe640 10 client.18315 handle_command_reply: tid=0 2024-09-19T06:23:28.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.908+0000 7f2c3cc91740 1 client.18315 shutdown 2024-09-19T06:23:28.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.908+0000 7f2c3cc91740 1 -- 172.21.15.2:0/3737013337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557358e79b40 msgr2=0x557358e90120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:28.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.908+0000 7f2c3cc91740 1 --2- 172.21.15.2:0/3737013337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557358e79b40 0x557358e90120 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f2c2400b560 tx=0x7f2c24012ba0 comp rx=0 tx=0).stop 2024-09-19T06:23:28.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.908+0000 7f2c3cc91740 1 -- 172.21.15.2:0/3737013337 shutdown_connections 2024-09-19T06:23:28.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.908+0000 7f2c3cc91740 1 --2- 172.21.15.2:0/3737013337 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x557358e97170 0x557358f040f0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:28.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.908+0000 7f2c3cc91740 1 --2- 172.21.15.2:0/3737013337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557358e87780 0x557358e8b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:28.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.908+0000 7f2c3cc91740 1 --2- 172.21.15.2:0/3737013337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557358e79b40 0x557358e90120 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:28.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.908+0000 7f2c137fe640 0 client.18315 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:23:28.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.908+0000 7f2c3cc91740 1 --2- 172.21.15.2:0/3737013337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557358e785d0 0x557358e8fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:28.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.908+0000 7f2c3cc91740 1 -- 172.21.15.2:0/3737013337 >> 172.21.15.2:0/3737013337 conn(0x557358e41310 msgr2=0x557358e734e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:28.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.908+0000 7f2c3cc91740 1 -- 172.21.15.2:0/3737013337 shutdown_connections 2024-09-19T06:23:28.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.908+0000 7f2c3cc91740 1 -- 172.21.15.2:0/3737013337 wait complete. 2024-09-19T06:23:28.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.908+0000 7f2c3cc91740 20 client.18315 trim_cache size 0 max 16384 2024-09-19T06:23:28.916 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:23:28.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.909+0000 7f2c3a8b8640 1 -- 172.21.15.2:0/425624062 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f2c1c0a33b0 msgr2=0x7f2c1c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:28.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.909+0000 7f2c3a8b8640 1 --2- 172.21.15.2:0/425624062 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f2c1c0a33b0 0x7f2c1c0a5870 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c0ee860 tx=0x7f2c2c08ec80 comp rx=0 tx=0).stop 2024-09-19T06:23:28.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.909+0000 7f2c3a8b8640 1 -- 172.21.15.2:0/425624062 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c34102ef0 msgr2=0x7f2c3419cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:28.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.909+0000 7f2c3a8b8640 1 --2- 172.21.15.2:0/425624062 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c34102ef0 0x7f2c3419cbd0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c02ae70 tx=0x7f2c2c02f5d0 comp rx=0 tx=0).stop 2024-09-19T06:23:28.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.909+0000 7f2c3a8b8640 1 -- 172.21.15.2:0/425624062 shutdown_connections 2024-09-19T06:23:28.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.909+0000 7f2c3a8b8640 1 --2- 172.21.15.2:0/425624062 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f2c1c0a33b0 0x7f2c1c0a5870 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:28.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.909+0000 7f2c3a8b8640 1 --2- 172.21.15.2:0/425624062 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c34102ef0 0x7f2c3419cbd0 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:28.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.909+0000 7f2c3a8b8640 1 --2- 172.21.15.2:0/425624062 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c34102570 0x7f2c34198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:28.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.909+0000 7f2c3a8b8640 1 --2- 172.21.15.2:0/425624062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c34100e20 0x7f2c34198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:28.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.909+0000 7f2c3a8b8640 1 -- 172.21.15.2:0/425624062 >> 172.21.15.2:0/425624062 conn(0x7f2c340fc7d0 msgr2=0x7f2c3406a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:28.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.909+0000 7f2c3a8b8640 1 -- 172.21.15.2:0/425624062 shutdown_connections 2024-09-19T06:23:28.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:28.909+0000 7f2c3a8b8640 1 -- 172.21.15.2:0/425624062 wait complete. 2024-09-19T06:23:29.662 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:23:29.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:29 smithi089 ceph-mon[34160]: pgmap v269: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:23:29.926 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:23:29.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:29 smithi002 ceph-mon[30982]: pgmap v269: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:23:29.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:29 smithi090 ceph-mon[34497]: pgmap v269: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:23:30.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.369+0000 7f3998c69640 1 -- 172.21.15.2:0/1642531585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3994103660 msgr2=0x7f399410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:30.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.369+0000 7f3998c69640 1 --2- 172.21.15.2:0/1642531585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3994103660 0x7f399410bb50 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f397c009900 tx=0x7f397c02a480 comp rx=0 tx=0).stop 2024-09-19T06:23:30.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.369+0000 7f3998c69640 1 -- 172.21.15.2:0/1642531585 shutdown_connections 2024-09-19T06:23:30.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.369+0000 7f3998c69640 1 --2- 172.21.15.2:0/1642531585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f399410c170 0x7f399410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:30.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.369+0000 7f3998c69640 1 --2- 172.21.15.2:0/1642531585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3994103660 0x7f399410bb50 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:30.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.369+0000 7f3998c69640 1 --2- 172.21.15.2:0/1642531585 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3994102d40 0x7f3994103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:30.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.369+0000 7f3998c69640 1 -- 172.21.15.2:0/1642531585 >> 172.21.15.2:0/1642531585 conn(0x7f39940fc7a0 msgr2=0x7f39940febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:30.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.369+0000 7f3998c69640 1 -- 172.21.15.2:0/1642531585 shutdown_connections 2024-09-19T06:23:30.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.369+0000 7f3998c69640 1 -- 172.21.15.2:0/1642531585 wait complete. 2024-09-19T06:23:30.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.370+0000 7f3998c69640 1 Processor -- start 2024-09-19T06:23:30.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.370+0000 7f3998c69640 1 -- start start 2024-09-19T06:23:30.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.370+0000 7f3998c69640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3994102d40 0x7f3994198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:30.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.370+0000 7f3998c69640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3994103660 0x7f3994198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:30.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.370+0000 7f3998c69640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f399410c170 0x7f399419cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:30.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.370+0000 7f3998c69640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3994111e20 con 0x7f399410c170 2024-09-19T06:23:30.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.370+0000 7f3998c69640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3994111ca0 con 0x7f3994103660 2024-09-19T06:23:30.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.370+0000 7f3998c69640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3994111fa0 con 0x7f3994102d40 2024-09-19T06:23:30.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.371+0000 7f3992d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f399410c170 0x7f399419cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:30.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.371+0000 7f3989d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3994103660 0x7f3994198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:30.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.371+0000 7f399259c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3994102d40 0x7f3994198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:30.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.371+0000 7f3989d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3994103660 0x7f3994198890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:57048/0 (socket says 172.21.15.2:57048) 2024-09-19T06:23:30.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.371+0000 7f3992d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f399410c170 0x7f399419cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52130/0 (socket says 172.21.15.2:52130) 2024-09-19T06:23:30.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.371+0000 7f3989d9b640 1 -- 172.21.15.2:0/1977766082 learned_addr learned my addr 172.21.15.2:0/1977766082 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:30.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.371+0000 7f399259c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3994102d40 0x7f3994198350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:53786/0 (socket says 172.21.15.2:53786) 2024-09-19T06:23:30.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.371+0000 7f3989d9b640 1 -- 172.21.15.2:0/1977766082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3994102d40 msgr2=0x7f3994198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:30.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.371+0000 7f3989d9b640 1 --2- 172.21.15.2:0/1977766082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3994102d40 0x7f3994198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:30.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.371+0000 7f3989d9b640 1 -- 172.21.15.2:0/1977766082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f399410c170 msgr2=0x7f399419cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:30.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.371+0000 7f3989d9b640 1 --2- 172.21.15.2:0/1977766082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f399410c170 0x7f399419cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:30.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.371+0000 7f3989d9b640 1 -- 172.21.15.2:0/1977766082 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f399419d300 con 0x7f3994103660 2024-09-19T06:23:30.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.371+0000 7f3992d9d640 1 --2- 172.21.15.2:0/1977766082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f399410c170 0x7f399419cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:23:30.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.371+0000 7f3989d9b640 1 --2- 172.21.15.2:0/1977766082 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3994103660 0x7f3994198890 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f397c005940 tx=0x7f397c0042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:30.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.372+0000 7f398bfff640 1 -- 172.21.15.2:0/1977766082 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397c03f030 con 0x7f3994103660 2024-09-19T06:23:30.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.372+0000 7f3998c69640 1 -- 172.21.15.2:0/1977766082 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f399419d590 con 0x7f3994103660 2024-09-19T06:23:30.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.372+0000 7f3998c69640 1 -- 172.21.15.2:0/1977766082 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39941a4ed0 con 0x7f3994103660 2024-09-19T06:23:30.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.372+0000 7f398bfff640 1 -- 172.21.15.2:0/1977766082 <== mon.2 v2:172.21.15.89:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f397c003cb0 con 0x7f3994103660 2024-09-19T06:23:30.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.372+0000 7f398bfff640 1 -- 172.21.15.2:0/1977766082 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397c035070 con 0x7f3994103660 2024-09-19T06:23:30.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.374+0000 7f399b042740 1 Processor -- start 2024-09-19T06:23:30.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.374+0000 7f399b042740 1 -- start start 2024-09-19T06:23:30.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.374+0000 7f398bfff640 1 -- 172.21.15.2:0/1977766082 <== mon.2 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f397c042030 con 0x7f3994103660 2024-09-19T06:23:30.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.375+0000 7f399b042740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590883b6b40 0x5590883b5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:30.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.375+0000 7f399b042740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590883b55d0 0x5590883b5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:30.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.375+0000 7f399b042740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590883c0370 0x5590883c2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:30.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.375+0000 7f399b042740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55908831b2f0 con 0x5590883c0370 2024-09-19T06:23:30.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.375+0000 7f399b042740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5590882c2cf0 con 0x5590883b6b40 2024-09-19T06:23:30.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.375+0000 7f399b042740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5590883172b0 con 0x5590883b55d0 2024-09-19T06:23:30.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.375+0000 7f3989d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590883c0370 0x5590883c2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:30.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.375+0000 7f3989d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590883c0370 0x5590883c2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52144/0 (socket says 172.21.15.2:52144) 2024-09-19T06:23:30.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.375+0000 7f3989d9b640 1 -- 172.21.15.2:0/3169361533 learned_addr learned my addr 172.21.15.2:0/3169361533 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:30.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.375+0000 7f3992d9d640 1 --2- 172.21.15.2:0/3169361533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590883b6b40 0x5590883b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:30.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.375+0000 7f399259c640 1 --2- 172.21.15.2:0/3169361533 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590883b55d0 0x5590883b5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:30.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.375+0000 7f3989d9b640 1 -- 172.21.15.2:0/3169361533 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590883b55d0 msgr2=0x5590883b5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:30.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.375+0000 7f3989d9b640 1 --2- 172.21.15.2:0/3169361533 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590883b55d0 0x5590883b5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:30.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.375+0000 7f3989d9b640 1 -- 172.21.15.2:0/3169361533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590883b6b40 msgr2=0x5590883b5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:30.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.375+0000 7f3989d9b640 1 --2- 172.21.15.2:0/3169361533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590883b6b40 0x5590883b5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:30.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.375+0000 7f3989d9b640 1 -- 172.21.15.2:0/3169361533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590882a73a0 con 0x5590883c0370 2024-09-19T06:23:30.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.375+0000 7f3992d9d640 1 --2- 172.21.15.2:0/3169361533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590883b6b40 0x5590883b5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:23:30.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.375+0000 7f399259c640 1 --2- 172.21.15.2:0/3169361533 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590883b55d0 0x5590883b5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:30.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.375+0000 7f3989d9b640 1 --2- 172.21.15.2:0/3169361533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590883c0370 0x5590883c2760 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f397c0edac0 tx=0x7f397c0f66a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eac399b1f43aafa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:30.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.375+0000 7f398bfff640 1 --2- 172.21.15.2:0/1977766082 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f39800a3430 0x7f39800a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:30.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.376+0000 7f3988d99640 1 -- 172.21.15.2:0/3169361533 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397c0b8a30 con 0x5590883c0370 2024-09-19T06:23:30.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.376+0000 7f3992d9d640 1 --2- 172.21.15.2:0/1977766082 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f39800a3430 0x7f39800a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:30.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.376+0000 7f3988d99640 1 -- 172.21.15.2:0/3169361533 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f397c0fd030 con 0x5590883c0370 2024-09-19T06:23:30.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.376+0000 7f398bfff640 1 -- 172.21.15.2:0/1977766082 <== mon.2 v2:172.21.15.89:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f397c0f0400 con 0x7f3994103660 2024-09-19T06:23:30.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.376+0000 7f3988d99640 1 -- 172.21.15.2:0/3169361533 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397c0bbf10 con 0x5590883c0370 2024-09-19T06:23:30.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.376+0000 7f399b042740 1 -- 172.21.15.2:0/3169361533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590883c0370 msgr2=0x5590883c2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:30.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.376+0000 7f3992d9d640 1 --2- 172.21.15.2:0/1977766082 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f39800a3430 0x7f39800a58f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f398c005fd0 tx=0x7f398c009600 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:30.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.376+0000 7f399b042740 1 --2- 172.21.15.2:0/3169361533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590883c0370 0x5590883c2760 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f397c0edac0 tx=0x7f397c0f66a0 comp rx=0 tx=0).stop 2024-09-19T06:23:30.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.377+0000 7f399b042740 1 -- 172.21.15.2:0/3169361533 shutdown_connections 2024-09-19T06:23:30.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.377+0000 7f399b042740 1 --2- 172.21.15.2:0/3169361533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590883c0370 0x5590883c2760 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:30.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.377+0000 7f399b042740 1 --2- 172.21.15.2:0/3169361533 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590883b55d0 0x5590883b5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:30.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.377+0000 7f399b042740 1 --2- 172.21.15.2:0/3169361533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590883b6b40 0x5590883b5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:30.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.377+0000 7f399b042740 1 -- 172.21.15.2:0/3169361533 >> 172.21.15.2:0/3169361533 conn(0x55908837e310 msgr2=0x5590883b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:30.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.377+0000 7f399b042740 1 -- 172.21.15.2:0/3169361533 shutdown_connections 2024-09-19T06:23:30.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.377+0000 7f399b042740 1 -- 172.21.15.2:0/3169361533 wait complete. 2024-09-19T06:23:30.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.377+0000 7f399b042740 1 -- start start 2024-09-19T06:23:30.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.377+0000 7f399b042740 1 Processor -- start 2024-09-19T06:23:30.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.377+0000 7f399b042740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590883b55d0 0x5590883bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:30.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.377+0000 7f399b042740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590883b6b40 0x5590883bcf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:30.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.377+0000 7f399b042740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590883c0370 0x5590883bd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:30.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.377+0000 7f399b042740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5590883c2e30 con 0x5590883b55d0 2024-09-19T06:23:30.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.377+0000 7f399b042740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5590882d6060 con 0x5590883c0370 2024-09-19T06:23:30.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.378+0000 7f399b042740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5590883c2fb0 con 0x5590883b6b40 2024-09-19T06:23:30.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.378+0000 7f399b042740 10 client.0 _ll_register_callbacks cb 0x5590880298c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:30.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.378+0000 7f399259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590883b55d0 0x5590883bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:30.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.378+0000 7f399259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590883b55d0 0x5590883bfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52154/0 (socket says 172.21.15.2:52154) 2024-09-19T06:23:30.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.378+0000 7f399259c640 1 -- 172.21.15.2:0/585378593 learned_addr learned my addr 172.21.15.2:0/585378593 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:30.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.378+0000 7f3992d9d640 1 --2- 172.21.15.2:0/585378593 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590883c0370 0x5590883bd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:30.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.378+0000 7f3989d9b640 1 --2- 172.21.15.2:0/585378593 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590883b6b40 0x5590883bcf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:30.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.378+0000 7f399259c640 1 -- 172.21.15.2:0/585378593 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590883b6b40 msgr2=0x5590883bcf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:30.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.378+0000 7f399259c640 1 --2- 172.21.15.2:0/585378593 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590883b6b40 0x5590883bcf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:30.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.378+0000 7f399259c640 1 -- 172.21.15.2:0/585378593 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590883c0370 msgr2=0x5590883bd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:30.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.378+0000 7f399259c640 1 --2- 172.21.15.2:0/585378593 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590883c0370 0x5590883bd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:30.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.378+0000 7f399259c640 1 -- 172.21.15.2:0/585378593 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55908808c3c0 con 0x5590883b55d0 2024-09-19T06:23:30.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.378+0000 7f3989d9b640 1 --2- 172.21.15.2:0/585378593 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590883b6b40 0x5590883bcf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:23:30.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.378+0000 7f399259c640 1 --2- 172.21.15.2:0/585378593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590883b55d0 0x5590883bfcd0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f398400baa0 tx=0x7f398400bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b173d1610fa1ec40 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:30.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.378+0000 7f3979ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:30.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.378+0000 7f3979ffb640 1 -- 172.21.15.2:0/585378593 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398401b640 con 0x5590883b55d0 2024-09-19T06:23:30.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.378+0000 7f3979ffb640 1 -- 172.21.15.2:0/585378593 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f3984011440 con 0x5590883b55d0 2024-09-19T06:23:30.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.378+0000 7f399b042740 1 -- 172.21.15.2:0/585378593 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f397c0fd030 con 0x5590883b55d0 2024-09-19T06:23:30.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.379+0000 7f3979ffb640 1 -- 172.21.15.2:0/585378593 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f398401b7e0 con 0x5590883b55d0 2024-09-19T06:23:30.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.379+0000 7f399b042740 10 client.18327 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:30.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.379+0000 7f399b042740 1 -- 172.21.15.2:0/585378593 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5590883ce820 con 0x5590883b55d0 2024-09-19T06:23:30.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.379+0000 7f3979ffb640 1 -- 172.21.15.2:0/585378593 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f397c0fd030 con 0x5590883b55d0 2024-09-19T06:23:30.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.379+0000 7f3979ffb640 1 -- 172.21.15.2:0/585378593 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f3984019020 con 0x5590883b55d0 2024-09-19T06:23:30.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.379+0000 7f399b042740 10 client.18327 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:30.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.379+0000 7f399b042740 10 client.18327 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:30.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.379+0000 7f399b042740 20 client.18327 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:30.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.379+0000 7f399b042740 1 --2- 172.21.15.2:0/585378593 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5590883cfc30 0x5590883d2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:30.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.379+0000 7f399b042740 4 client.18327 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:23:30.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.379+0000 7f399b042740 1 -- 172.21.15.2:0/585378593 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559088328860 con 0x5590883cfc30 2024-09-19T06:23:30.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.379+0000 7f3989d9b640 1 --2- 172.21.15.2:0/585378593 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5590883cfc30 0x5590883d2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:30.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.380+0000 7f3989d9b640 1 --2- 172.21.15.2:0/585378593 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5590883cfc30 0x5590883d2080 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9879c9ad656a7c99 server_cookie=f01508d0299ac486 in_seq=0 out_seq=0 2024-09-19T06:23:30.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.380+0000 7f3979ffb640 10 client.18327 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:30.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.381+0000 7f3979ffb640 1 -- 172.21.15.2:0/585378593 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559088328860 con 0x5590883cfc30 2024-09-19T06:23:30.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.381+0000 7f3979ffb640 10 client.18327 handle_command_reply: tid=0 2024-09-19T06:23:30.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.381+0000 7f399b042740 1 client.18327 shutdown 2024-09-19T06:23:30.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.381+0000 7f399b042740 1 -- 172.21.15.2:0/585378593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590883b55d0 msgr2=0x5590883bfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:30.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.381+0000 7f399b042740 1 --2- 172.21.15.2:0/585378593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590883b55d0 0x5590883bfcd0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f398400baa0 tx=0x7f398400bf60 comp rx=0 tx=0).stop 2024-09-19T06:23:30.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.381+0000 7f399b042740 1 -- 172.21.15.2:0/585378593 shutdown_connections 2024-09-19T06:23:30.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.381+0000 7f399b042740 1 --2- 172.21.15.2:0/585378593 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5590883cfc30 0x5590883d2080 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:30.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.381+0000 7f3979ffb640 0 client.18327 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:30.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.381+0000 7f399b042740 1 --2- 172.21.15.2:0/585378593 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590883c0370 0x5590883bd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:30.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.381+0000 7f399b042740 1 --2- 172.21.15.2:0/585378593 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590883b6b40 0x5590883bcf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:30.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.381+0000 7f399b042740 1 --2- 172.21.15.2:0/585378593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590883b55d0 0x5590883bfcd0 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:30.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.381+0000 7f399b042740 1 -- 172.21.15.2:0/585378593 >> 172.21.15.2:0/585378593 conn(0x55908837e310 msgr2=0x5590883b7960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:30.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.381+0000 7f399b042740 1 -- 172.21.15.2:0/585378593 shutdown_connections 2024-09-19T06:23:30.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.381+0000 7f399b042740 1 -- 172.21.15.2:0/585378593 wait complete. 2024-09-19T06:23:30.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.381+0000 7f399b042740 20 client.18327 trim_cache size 0 max 16384 2024-09-19T06:23:30.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.394+0000 7f399b042740 1 Processor -- start 2024-09-19T06:23:30.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.394+0000 7f399b042740 1 -- start start 2024-09-19T06:23:30.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.394+0000 7f399b042740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590883b55d0 0x5590883b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:30.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.394+0000 7f399b042740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590883b6b40 0x5590883cc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:30.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.394+0000 7f399b042740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590883c0370 0x5590883c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:30.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.394+0000 7f399b042740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f39941b0040 con 0x5590883b6b40 2024-09-19T06:23:30.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.394+0000 7f399b042740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f39941ad910 con 0x5590883b55d0 2024-09-19T06:23:30.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.394+0000 7f399b042740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f39941ab780 con 0x5590883c0370 2024-09-19T06:23:30.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.394+0000 7f3989d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590883b6b40 0x5590883cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:30.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.394+0000 7f3989d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590883b6b40 0x5590883cc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52156/0 (socket says 172.21.15.2:52156) 2024-09-19T06:23:30.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.394+0000 7f3989d9b640 1 -- 172.21.15.2:0/1222760703 learned_addr learned my addr 172.21.15.2:0/1222760703 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:30.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.395+0000 7f399259c640 1 --2- 172.21.15.2:0/1222760703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590883b55d0 0x5590883b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:30.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.395+0000 7f3989d9b640 1 -- 172.21.15.2:0/1222760703 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590883c0370 msgr2=0x5590883c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:30.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.395+0000 7f3989d9b640 1 --2- 172.21.15.2:0/1222760703 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590883c0370 0x5590883c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:30.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.395+0000 7f3989d9b640 1 -- 172.21.15.2:0/1222760703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590883b55d0 msgr2=0x5590883b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:30.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.395+0000 7f3989d9b640 1 --2- 172.21.15.2:0/1222760703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590883b55d0 0x5590883b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:30.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.395+0000 7f3989d9b640 1 -- 172.21.15.2:0/1222760703 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590883b2730 con 0x5590883b6b40 2024-09-19T06:23:30.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.395+0000 7f3989d9b640 1 --2- 172.21.15.2:0/1222760703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590883b6b40 0x5590883cc090 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f397c0f6530 tx=0x7f397c02a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc6f1ab372caf493 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:30.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.395+0000 7f397bfff640 1 -- 172.21.15.2:0/1222760703 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397c049040 con 0x5590883b6b40 2024-09-19T06:23:30.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.395+0000 7f397bfff640 1 -- 172.21.15.2:0/1222760703 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f397c0fd070 con 0x5590883b6b40 2024-09-19T06:23:30.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.395+0000 7f397bfff640 1 -- 172.21.15.2:0/1222760703 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397c0bc0f0 con 0x5590883b6b40 2024-09-19T06:23:30.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.396+0000 7f399b042740 1 -- 172.21.15.2:0/1222760703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590883b6b40 msgr2=0x5590883cc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:30.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.396+0000 7f399b042740 1 --2- 172.21.15.2:0/1222760703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590883b6b40 0x5590883cc090 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f397c0f6530 tx=0x7f397c02a480 comp rx=0 tx=0).stop 2024-09-19T06:23:30.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.396+0000 7f399b042740 1 -- 172.21.15.2:0/1222760703 shutdown_connections 2024-09-19T06:23:30.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.396+0000 7f399b042740 1 --2- 172.21.15.2:0/1222760703 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590883c0370 0x5590883c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:30.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.396+0000 7f399b042740 1 --2- 172.21.15.2:0/1222760703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590883b6b40 0x5590883cc090 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:30.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.396+0000 7f399b042740 1 --2- 172.21.15.2:0/1222760703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590883b55d0 0x5590883b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:30.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.396+0000 7f399b042740 1 -- 172.21.15.2:0/1222760703 >> 172.21.15.2:0/1222760703 conn(0x55908837e310 msgr2=0x5590883b1700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:30.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.396+0000 7f399b042740 1 -- 172.21.15.2:0/1222760703 shutdown_connections 2024-09-19T06:23:30.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.396+0000 7f399b042740 1 -- 172.21.15.2:0/1222760703 wait complete. 2024-09-19T06:23:30.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.396+0000 7f399b042740 1 -- start start 2024-09-19T06:23:30.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.396+0000 7f399b042740 1 Processor -- start 2024-09-19T06:23:30.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.396+0000 7f399b042740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590883b55d0 0x5590883b9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:30.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.396+0000 7f399b042740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590883b6b40 0x5590883b9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:30.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.396+0000 7f399b042740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590883c0370 0x5590883b9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:30.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.396+0000 7f399b042740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f39941abdd0 con 0x5590883c0370 2024-09-19T06:23:30.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.396+0000 7f399b042740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f39941ad240 con 0x5590883b55d0 2024-09-19T06:23:30.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.396+0000 7f399b042740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f39941ac4a0 con 0x5590883b6b40 2024-09-19T06:23:30.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.396+0000 7f399b042740 10 client.0 _ll_register_callbacks cb 0x7f3984004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:30.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.397+0000 7f3992d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590883c0370 0x5590883b9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:30.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.397+0000 7f399259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590883b55d0 0x5590883b9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:30.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.397+0000 7f3992d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590883c0370 0x5590883b9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52168/0 (socket says 172.21.15.2:52168) 2024-09-19T06:23:30.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.397+0000 7f3992d9d640 1 -- 172.21.15.2:0/3106398859 learned_addr learned my addr 172.21.15.2:0/3106398859 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:30.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.397+0000 7f3989d9b640 1 --2- 172.21.15.2:0/3106398859 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590883b6b40 0x5590883b9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:30.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.397+0000 7f3992d9d640 1 -- 172.21.15.2:0/3106398859 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590883b6b40 msgr2=0x5590883b9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:30.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.397+0000 7f3992d9d640 1 --2- 172.21.15.2:0/3106398859 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590883b6b40 0x5590883b9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:30.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.397+0000 7f3992d9d640 1 -- 172.21.15.2:0/3106398859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590883b55d0 msgr2=0x5590883b9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:30.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.397+0000 7f3992d9d640 1 --2- 172.21.15.2:0/3106398859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590883b55d0 0x5590883b9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:30.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.397+0000 7f3992d9d640 1 -- 172.21.15.2:0/3106398859 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590883ba540 con 0x5590883c0370 2024-09-19T06:23:30.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.397+0000 7f3992d9d640 1 --2- 172.21.15.2:0/3106398859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590883c0370 0x5590883b9da0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f398c013d10 tx=0x7f398c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=326e87b3a364cb6a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:30.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.397+0000 7f3979ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:30.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.397+0000 7f3979ffb640 1 -- 172.21.15.2:0/3106398859 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398c02d060 con 0x5590883c0370 2024-09-19T06:23:30.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.397+0000 7f3979ffb640 1 -- 172.21.15.2:0/3106398859 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f398c028680 con 0x5590883c0370 2024-09-19T06:23:30.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.397+0000 7f399b042740 1 -- 172.21.15.2:0/3106398859 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f397c0fd070 con 0x5590883c0370 2024-09-19T06:23:30.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.398+0000 7f3979ffb640 1 -- 172.21.15.2:0/3106398859 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f398c0288c0 con 0x5590883c0370 2024-09-19T06:23:30.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.398+0000 7f399b042740 10 client.18333 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:30.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.398+0000 7f399b042740 1 -- 172.21.15.2:0/3106398859 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55908843efe0 con 0x5590883c0370 2024-09-19T06:23:30.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.398+0000 7f3979ffb640 1 -- 172.21.15.2:0/3106398859 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f397c0fd070 con 0x5590883c0370 2024-09-19T06:23:30.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.398+0000 7f3979ffb640 1 -- 172.21.15.2:0/3106398859 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f398c01a040 con 0x5590883c0370 2024-09-19T06:23:30.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.398+0000 7f399b042740 10 client.18333 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:30.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.398+0000 7f399b042740 10 client.18333 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:30.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.398+0000 7f399b042740 20 client.18333 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:30.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.398+0000 7f399b042740 1 --2- 172.21.15.2:0/3106398859 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55908843f790 0x559088441bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:30.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.398+0000 7f399b042740 4 client.18333 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:23:30.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.398+0000 7f399b042740 1 -- 172.21.15.2:0/3106398859 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559088322d70 con 0x55908843f790 2024-09-19T06:23:30.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.398+0000 7f399259c640 1 --2- 172.21.15.2:0/3106398859 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55908843f790 0x559088441bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:30.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.399+0000 7f399259c640 1 --2- 172.21.15.2:0/3106398859 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55908843f790 0x559088441bb0 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acac9e63bef57192 server_cookie=b9cab7db70b143b7 in_seq=0 out_seq=0 2024-09-19T06:23:30.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.399+0000 7f3979ffb640 10 client.18333 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:30.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.399+0000 7f3979ffb640 1 -- 172.21.15.2:0/3106398859 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559088322d70 con 0x55908843f790 2024-09-19T06:23:30.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.399+0000 7f3979ffb640 10 client.18333 handle_command_reply: tid=0 2024-09-19T06:23:30.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.399+0000 7f399b042740 1 client.18333 shutdown 2024-09-19T06:23:30.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.399+0000 7f399b042740 1 -- 172.21.15.2:0/3106398859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590883c0370 msgr2=0x5590883b9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:30.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.399+0000 7f399b042740 1 --2- 172.21.15.2:0/3106398859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590883c0370 0x5590883b9da0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f398c013d10 tx=0x7f398c004a40 comp rx=0 tx=0).stop 2024-09-19T06:23:30.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.399+0000 7f399b042740 1 -- 172.21.15.2:0/3106398859 shutdown_connections 2024-09-19T06:23:30.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.399+0000 7f399b042740 1 --2- 172.21.15.2:0/3106398859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590883c0370 0x5590883b9da0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:30.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.399+0000 7f399b042740 1 --2- 172.21.15.2:0/3106398859 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590883b6b40 0x5590883b9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:30.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.399+0000 7f399b042740 1 --2- 172.21.15.2:0/3106398859 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55908843f790 0x559088441bb0 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:30.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.399+0000 7f399b042740 1 --2- 172.21.15.2:0/3106398859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590883b55d0 0x5590883b9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:30.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.399+0000 7f399b042740 1 -- 172.21.15.2:0/3106398859 >> 172.21.15.2:0/3106398859 conn(0x55908837e310 msgr2=0x5590883b7110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:30.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.399+0000 7f3979ffb640 0 client.18333 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:30.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.399+0000 7f399b042740 1 -- 172.21.15.2:0/3106398859 shutdown_connections 2024-09-19T06:23:30.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.399+0000 7f399b042740 1 -- 172.21.15.2:0/3106398859 wait complete. 2024-09-19T06:23:30.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.399+0000 7f399b042740 20 client.18333 trim_cache size 0 max 16384 2024-09-19T06:23:30.407 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:23:30.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.400+0000 7f3998c69640 1 -- 172.21.15.2:0/1977766082 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f39800a3430 msgr2=0x7f39800a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:30.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.400+0000 7f3998c69640 1 --2- 172.21.15.2:0/1977766082 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f39800a3430 0x7f39800a58f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f398c005fd0 tx=0x7f398c009600 comp rx=0 tx=0).stop 2024-09-19T06:23:30.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.400+0000 7f3998c69640 1 -- 172.21.15.2:0/1977766082 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3994103660 msgr2=0x7f3994198890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:30.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.400+0000 7f3998c69640 1 --2- 172.21.15.2:0/1977766082 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3994103660 0x7f3994198890 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f397c005940 tx=0x7f397c0042f0 comp rx=0 tx=0).stop 2024-09-19T06:23:30.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.400+0000 7f3998c69640 1 -- 172.21.15.2:0/1977766082 shutdown_connections 2024-09-19T06:23:30.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.400+0000 7f3998c69640 1 --2- 172.21.15.2:0/1977766082 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f39800a3430 0x7f39800a58f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:30.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.400+0000 7f3998c69640 1 --2- 172.21.15.2:0/1977766082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f399410c170 0x7f399419cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:30.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.400+0000 7f3998c69640 1 --2- 172.21.15.2:0/1977766082 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3994103660 0x7f3994198890 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:30.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.400+0000 7f3998c69640 1 --2- 172.21.15.2:0/1977766082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3994102d40 0x7f3994198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:30.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.400+0000 7f3998c69640 1 -- 172.21.15.2:0/1977766082 >> 172.21.15.2:0/1977766082 conn(0x7f39940fc7a0 msgr2=0x7f39940fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:30.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.400+0000 7f3998c69640 1 -- 172.21.15.2:0/1977766082 shutdown_connections 2024-09-19T06:23:30.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:30.400+0000 7f3998c69640 1 -- 172.21.15.2:0/1977766082 wait complete. 2024-09-19T06:23:31.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:31 smithi089 ceph-mon[34160]: pgmap v270: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:23:31.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:31 smithi002 ceph-mon[30982]: pgmap v270: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:23:31.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:31 smithi090 ceph-mon[34497]: pgmap v270: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:23:32.068 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:23:32.068 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:23:32.339 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:23:32.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.855+0000 7ff9dd9dd640 1 -- 172.21.15.2:0/774275252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9d8102d40 msgr2=0x7ff9d8103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:32.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.855+0000 7ff9dd9dd640 1 --2- 172.21.15.2:0/774275252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9d8102d40 0x7ff9d8103120 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8009900 tx=0x7ff9c802a480 comp rx=0 tx=0).stop 2024-09-19T06:23:32.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.855+0000 7ff9dd9dd640 1 -- 172.21.15.2:0/774275252 shutdown_connections 2024-09-19T06:23:32.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.855+0000 7ff9dd9dd640 1 --2- 172.21.15.2:0/774275252 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff9d810c170 0x7ff9d810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:32.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.855+0000 7ff9dd9dd640 1 --2- 172.21.15.2:0/774275252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9d8103660 0x7ff9d810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:32.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.855+0000 7ff9dd9dd640 1 --2- 172.21.15.2:0/774275252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9d8102d40 0x7ff9d8103120 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:32.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.855+0000 7ff9dd9dd640 1 -- 172.21.15.2:0/774275252 >> 172.21.15.2:0/774275252 conn(0x7ff9d80fc7a0 msgr2=0x7ff9d80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:32.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.855+0000 7ff9dd9dd640 1 -- 172.21.15.2:0/774275252 shutdown_connections 2024-09-19T06:23:32.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.855+0000 7ff9dd9dd640 1 -- 172.21.15.2:0/774275252 wait complete. 2024-09-19T06:23:32.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.856+0000 7ff9dd9dd640 1 Processor -- start 2024-09-19T06:23:32.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.856+0000 7ff9dd9dd640 1 -- start start 2024-09-19T06:23:32.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.856+0000 7ff9dd9dd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff9d8102d40 0x7ff9d81009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:32.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.856+0000 7ff9dd9dd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9d8103660 0x7ff9d8100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:32.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.857+0000 7ff9dd9dd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9d810c170 0x7ff9d8101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:32.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.857+0000 7ff9dd9dd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d8111e60 con 0x7ff9d810c170 2024-09-19T06:23:32.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.857+0000 7ff9dd9dd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d8111ce0 con 0x7ff9d8103660 2024-09-19T06:23:32.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.857+0000 7ff9dd9dd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d8111fe0 con 0x7ff9d8102d40 2024-09-19T06:23:32.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.857+0000 7ff9d77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9d810c170 0x7ff9d8101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:32.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.857+0000 7ff9d77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9d810c170 0x7ff9d8101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52190/0 (socket says 172.21.15.2:52190) 2024-09-19T06:23:32.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.857+0000 7ff9d77fe640 1 -- 172.21.15.2:0/872628776 learned_addr learned my addr 172.21.15.2:0/872628776 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:32.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.857+0000 7ff9d67fc640 1 --2- 172.21.15.2:0/872628776 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9d8103660 0x7ff9d8100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:32.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.857+0000 7ff9d6ffd640 1 --2- 172.21.15.2:0/872628776 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff9d8102d40 0x7ff9d81009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:32.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.857+0000 7ff9d77fe640 1 -- 172.21.15.2:0/872628776 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff9d8102d40 msgr2=0x7ff9d81009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:32.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.857+0000 7ff9d77fe640 1 --2- 172.21.15.2:0/872628776 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff9d8102d40 0x7ff9d81009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:32.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.857+0000 7ff9d77fe640 1 -- 172.21.15.2:0/872628776 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9d8103660 msgr2=0x7ff9d8100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:32.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.857+0000 7ff9d77fe640 1 --2- 172.21.15.2:0/872628776 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9d8103660 0x7ff9d8100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:32.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.857+0000 7ff9d77fe640 1 -- 172.21.15.2:0/872628776 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9d81a6860 con 0x7ff9d810c170 2024-09-19T06:23:32.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.857+0000 7ff9d77fe640 1 --2- 172.21.15.2:0/872628776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9d810c170 0x7ff9d8101420 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7ff9d000b970 tx=0x7ff9d000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:32.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.857+0000 7ff9dc9db640 1 -- 172.21.15.2:0/872628776 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0019070 con 0x7ff9d810c170 2024-09-19T06:23:32.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.858+0000 7ff9dd9dd640 1 -- 172.21.15.2:0/872628776 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9d81a6b50 con 0x7ff9d810c170 2024-09-19T06:23:32.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.858+0000 7ff9dc9db640 1 -- 172.21.15.2:0/872628776 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff9d0014440 con 0x7ff9d810c170 2024-09-19T06:23:32.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.858+0000 7ff9dc9db640 1 -- 172.21.15.2:0/872628776 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d00075d0 con 0x7ff9d810c170 2024-09-19T06:23:32.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.858+0000 7ff9dd9dd640 1 -- 172.21.15.2:0/872628776 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9d81a7090 con 0x7ff9d810c170 2024-09-19T06:23:32.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.860+0000 7ff9dc9db640 1 -- 172.21.15.2:0/872628776 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7ff9d001c070 con 0x7ff9d810c170 2024-09-19T06:23:32.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.860+0000 7ff9dfdb6740 1 Processor -- start 2024-09-19T06:23:32.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.860+0000 7ff9dfdb6740 1 -- start start 2024-09-19T06:23:32.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.860+0000 7ff9dfdb6740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f52d13b60 0x560f52d13f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:32.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.860+0000 7ff9dfdb6740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f52d14480 0x560f52d1e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:32.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.860+0000 7ff9dfdb6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f52d1ed40 0x560f52d21130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:32.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.860+0000 7ff9dfdb6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560f52c79280 con 0x560f52d1ed40 2024-09-19T06:23:32.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.860+0000 7ff9dfdb6740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x560f52c20b10 con 0x560f52d13b60 2024-09-19T06:23:32.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.860+0000 7ff9dfdb6740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560f52c75240 con 0x560f52d14480 2024-09-19T06:23:32.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.860+0000 7ff9d67fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f52d1ed40 0x560f52d21130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:32.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.861+0000 7ff9d67fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f52d1ed40 0x560f52d21130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52202/0 (socket says 172.21.15.2:52202) 2024-09-19T06:23:32.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.861+0000 7ff9d67fc640 1 -- 172.21.15.2:0/539611366 learned_addr learned my addr 172.21.15.2:0/539611366 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:32.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.861+0000 7ff9dc9db640 1 --2- 172.21.15.2:0/872628776 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff9c00a3430 0x7ff9c00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:32.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.861+0000 7ff9d67fc640 1 --2- 172.21.15.2:0/539611366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f52d13b60 0x560f52d13f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:32.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.861+0000 7ff9d6ffd640 1 --2- 172.21.15.2:0/539611366 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f52d14480 0x560f52d1e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:32.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.861+0000 7ff9d77fe640 1 --2- 172.21.15.2:0/872628776 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff9c00a3430 0x7ff9c00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:32.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.861+0000 7ff9d67fc640 1 -- 172.21.15.2:0/539611366 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f52d14480 msgr2=0x560f52d1e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:32.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.861+0000 7ff9d67fc640 1 --2- 172.21.15.2:0/539611366 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f52d14480 0x560f52d1e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:32.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.861+0000 7ff9d67fc640 1 -- 172.21.15.2:0/539611366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f52d13b60 msgr2=0x560f52d13f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:32.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.861+0000 7ff9d67fc640 1 --2- 172.21.15.2:0/539611366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f52d13b60 0x560f52d13f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:32.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.861+0000 7ff9d67fc640 1 -- 172.21.15.2:0/539611366 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f52c2d1f0 con 0x560f52d1ed40 2024-09-19T06:23:32.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.861+0000 7ff9dc9db640 1 -- 172.21.15.2:0/872628776 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7ff9d00cf0d0 con 0x7ff9d810c170 2024-09-19T06:23:32.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.861+0000 7ff9d67fc640 1 --2- 172.21.15.2:0/539611366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f52d1ed40 0x560f52d21130 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc012790 tx=0x7ff9cc00b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b561812353da37 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:32.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.861+0000 7ff9d77fe640 1 --2- 172.21.15.2:0/872628776 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff9c00a3430 0x7ff9c00a58f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff9d00cca80 tx=0x7ff9d006b230 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:32.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.861+0000 7ff9bdffb640 1 -- 172.21.15.2:0/539611366 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc012d10 con 0x560f52d1ed40 2024-09-19T06:23:32.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.861+0000 7ff9bdffb640 1 -- 172.21.15.2:0/539611366 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff9cc010c20 con 0x560f52d1ed40 2024-09-19T06:23:32.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.861+0000 7ff9bdffb640 1 -- 172.21.15.2:0/539611366 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc01e990 con 0x560f52d1ed40 2024-09-19T06:23:32.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.862+0000 7ff9dfdb6740 1 -- 172.21.15.2:0/539611366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f52d1ed40 msgr2=0x560f52d21130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:32.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.862+0000 7ff9dfdb6740 1 --2- 172.21.15.2:0/539611366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f52d1ed40 0x560f52d21130 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc012790 tx=0x7ff9cc00b7b0 comp rx=0 tx=0).stop 2024-09-19T06:23:32.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.862+0000 7ff9dfdb6740 1 -- 172.21.15.2:0/539611366 shutdown_connections 2024-09-19T06:23:32.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.862+0000 7ff9dfdb6740 1 --2- 172.21.15.2:0/539611366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f52d1ed40 0x560f52d21130 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:32.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.862+0000 7ff9dfdb6740 1 --2- 172.21.15.2:0/539611366 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f52d14480 0x560f52d1e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:32.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.862+0000 7ff9dfdb6740 1 --2- 172.21.15.2:0/539611366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f52d13b60 0x560f52d13f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:32.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.862+0000 7ff9dfdb6740 1 -- 172.21.15.2:0/539611366 >> 172.21.15.2:0/539611366 conn(0x560f52d100f0 msgr2=0x560f52d104d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:32.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.862+0000 7ff9dfdb6740 1 -- 172.21.15.2:0/539611366 shutdown_connections 2024-09-19T06:23:32.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.862+0000 7ff9dfdb6740 1 -- 172.21.15.2:0/539611366 wait complete. 2024-09-19T06:23:32.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.863+0000 7ff9dfdb6740 1 -- start start 2024-09-19T06:23:32.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.863+0000 7ff9dfdb6740 1 Processor -- start 2024-09-19T06:23:32.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.863+0000 7ff9dfdb6740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f52d13b60 0x560f52d1bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:32.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.863+0000 7ff9dfdb6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f52d14480 0x560f52d1c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:32.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.863+0000 7ff9dfdb6740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f52d1ed40 0x560f52d1c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:32.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.863+0000 7ff9dfdb6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560f52d21910 con 0x560f52d14480 2024-09-19T06:23:32.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.863+0000 7ff9dfdb6740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x560f52c33f10 con 0x560f52d1ed40 2024-09-19T06:23:32.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.863+0000 7ff9dfdb6740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560f52d21a90 con 0x560f52d13b60 2024-09-19T06:23:32.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.863+0000 7ff9dfdb6740 10 client.0 _ll_register_callbacks cb 0x560f52bfca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:32.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.863+0000 7ff9d6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f52d14480 0x560f52d1c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:32.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.863+0000 7ff9d6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f52d14480 0x560f52d1c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52212/0 (socket says 172.21.15.2:52212) 2024-09-19T06:23:32.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.863+0000 7ff9d6ffd640 1 -- 172.21.15.2:0/667709954 learned_addr learned my addr 172.21.15.2:0/667709954 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:32.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.863+0000 7ff9d67fc640 1 --2- 172.21.15.2:0/667709954 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f52d13b60 0x560f52d1bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:32.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.864+0000 7ff9d67fc640 1 --2- 172.21.15.2:0/667709954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f52d1ed40 0x560f52d1c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:32.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.864+0000 7ff9d6ffd640 1 -- 172.21.15.2:0/667709954 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f52d13b60 msgr2=0x560f52d1bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:32.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.864+0000 7ff9d6ffd640 1 --2- 172.21.15.2:0/667709954 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f52d13b60 0x560f52d1bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:32.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.864+0000 7ff9d6ffd640 1 -- 172.21.15.2:0/667709954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f52d1ed40 msgr2=0x560f52d1c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:32.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.864+0000 7ff9d6ffd640 1 --2- 172.21.15.2:0/667709954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f52d1ed40 0x560f52d1c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:32.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.864+0000 7ff9d6ffd640 1 -- 172.21.15.2:0/667709954 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f529ea6a0 con 0x560f52d14480 2024-09-19T06:23:32.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.864+0000 7ff9d67fc640 1 --2- 172.21.15.2:0/667709954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f52d1ed40 0x560f52d1c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:23:32.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.864+0000 7ff9d6ffd640 1 --2- 172.21.15.2:0/667709954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f52d14480 0x560f52d1c180 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8033000 tx=0x7ff9c80316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99782df1dc4286eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:32.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.864+0000 7ff9b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:32.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.864+0000 7ff9b6ffd640 1 -- 172.21.15.2:0/667709954 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8035040 con 0x560f52d14480 2024-09-19T06:23:32.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.864+0000 7ff9b6ffd640 1 -- 172.21.15.2:0/667709954 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7ff9c8031cf0 con 0x560f52d14480 2024-09-19T06:23:32.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.864+0000 7ff9dfdb6740 1 -- 172.21.15.2:0/667709954 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9cc010c20 con 0x560f52d14480 2024-09-19T06:23:32.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.864+0000 7ff9b6ffd640 1 -- 172.21.15.2:0/667709954 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff9c804d050 con 0x560f52d14480 2024-09-19T06:23:32.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.864+0000 7ff9dfdb6740 10 client.18345 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:32.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.864+0000 7ff9dfdb6740 1 -- 172.21.15.2:0/667709954 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560f52d2d540 con 0x560f52d14480 2024-09-19T06:23:32.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.864+0000 7ff9b6ffd640 1 -- 172.21.15.2:0/667709954 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff9cc010c20 con 0x560f52d14480 2024-09-19T06:23:32.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.865+0000 7ff9b6ffd640 1 -- 172.21.15.2:0/667709954 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7ff9c8004750 con 0x560f52d14480 2024-09-19T06:23:32.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.865+0000 7ff9dfdb6740 10 client.18345 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:32.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.865+0000 7ff9dfdb6740 10 client.18345 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:32.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.865+0000 7ff9dfdb6740 20 client.18345 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:32.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.865+0000 7ff9dfdb6740 1 --2- 172.21.15.2:0/667709954 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560f52d2ea10 0x560f52d30e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:32.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.865+0000 7ff9dfdb6740 4 client.18345 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:23:32.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.865+0000 7ff9dfdb6740 1 -- 172.21.15.2:0/667709954 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560f52c867f0 con 0x560f52d2ea10 2024-09-19T06:23:32.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.865+0000 7ff9d67fc640 1 --2- 172.21.15.2:0/667709954 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560f52d2ea10 0x560f52d30e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:32.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.865+0000 7ff9d67fc640 1 --2- 172.21.15.2:0/667709954 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560f52d2ea10 0x560f52d30e50 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=639a786ad646fcb2 server_cookie=bd872b0cf41ce85b in_seq=0 out_seq=0 2024-09-19T06:23:32.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.865+0000 7ff9b6ffd640 10 client.18345 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:32.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.866+0000 7ff9b6ffd640 1 -- 172.21.15.2:0/667709954 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560f52c867f0 con 0x560f52d2ea10 2024-09-19T06:23:32.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.866+0000 7ff9b6ffd640 10 client.18345 handle_command_reply: tid=0 2024-09-19T06:23:32.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.866+0000 7ff9dfdb6740 1 client.18345 shutdown 2024-09-19T06:23:32.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.866+0000 7ff9dfdb6740 1 -- 172.21.15.2:0/667709954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f52d14480 msgr2=0x560f52d1c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:32.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.866+0000 7ff9dfdb6740 1 --2- 172.21.15.2:0/667709954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f52d14480 0x560f52d1c180 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8033000 tx=0x7ff9c80316d0 comp rx=0 tx=0).stop 2024-09-19T06:23:32.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.866+0000 7ff9dfdb6740 1 -- 172.21.15.2:0/667709954 shutdown_connections 2024-09-19T06:23:32.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.866+0000 7ff9dfdb6740 1 --2- 172.21.15.2:0/667709954 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560f52d2ea10 0x560f52d30e50 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:32.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.866+0000 7ff9dfdb6740 1 --2- 172.21.15.2:0/667709954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f52d1ed40 0x560f52d1c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:32.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.866+0000 7ff9dfdb6740 1 --2- 172.21.15.2:0/667709954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f52d14480 0x560f52d1c180 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:32.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.866+0000 7ff9dfdb6740 1 --2- 172.21.15.2:0/667709954 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f52d13b60 0x560f52d1bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:32.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.866+0000 7ff9dfdb6740 1 -- 172.21.15.2:0/667709954 >> 172.21.15.2:0/667709954 conn(0x560f52d100f0 msgr2=0x560f52d15dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:32.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.866+0000 7ff9b6ffd640 0 client.18345 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:32.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.866+0000 7ff9dfdb6740 1 -- 172.21.15.2:0/667709954 shutdown_connections 2024-09-19T06:23:32.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.867+0000 7ff9dfdb6740 1 -- 172.21.15.2:0/667709954 wait complete. 2024-09-19T06:23:32.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.867+0000 7ff9dfdb6740 20 client.18345 trim_cache size 0 max 16384 2024-09-19T06:23:32.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.884+0000 7ff9dfdb6740 1 Processor -- start 2024-09-19T06:23:32.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.884+0000 7ff9dfdb6740 1 -- start start 2024-09-19T06:23:32.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.884+0000 7ff9dfdb6740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f52d13b60 0x560f52d1daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:32.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.884+0000 7ff9dfdb6740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f52d14480 0x560f52d36720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:32.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.884+0000 7ff9dfdb6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f52d1ed40 0x560f52d36c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:32.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.884+0000 7ff9dfdb6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d81b2180 con 0x560f52d1ed40 2024-09-19T06:23:32.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.884+0000 7ff9dfdb6740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d81afa50 con 0x560f52d14480 2024-09-19T06:23:32.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.884+0000 7ff9dfdb6740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d81ad8c0 con 0x560f52d13b60 2024-09-19T06:23:32.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.884+0000 7ff9d67fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f52d1ed40 0x560f52d36c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:32.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.884+0000 7ff9d67fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f52d1ed40 0x560f52d36c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52224/0 (socket says 172.21.15.2:52224) 2024-09-19T06:23:32.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.884+0000 7ff9d67fc640 1 -- 172.21.15.2:0/888607631 learned_addr learned my addr 172.21.15.2:0/888607631 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:32.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.885+0000 7ff9d6ffd640 1 --2- 172.21.15.2:0/888607631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f52d14480 0x560f52d36720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:32.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.885+0000 7ff9d67fc640 1 --2- 172.21.15.2:0/888607631 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f52d13b60 0x560f52d1daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:32.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.885+0000 7ff9d67fc640 1 -- 172.21.15.2:0/888607631 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f52d13b60 msgr2=0x560f52d1daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:32.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.885+0000 7ff9d67fc640 1 --2- 172.21.15.2:0/888607631 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f52d13b60 0x560f52d1daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:32.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.885+0000 7ff9d67fc640 1 -- 172.21.15.2:0/888607631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f52d14480 msgr2=0x560f52d36720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:32.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.885+0000 7ff9d67fc640 1 --2- 172.21.15.2:0/888607631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f52d14480 0x560f52d36720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:32.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.885+0000 7ff9d67fc640 1 -- 172.21.15.2:0/888607631 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f52d11280 con 0x560f52d1ed40 2024-09-19T06:23:32.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.885+0000 7ff9d67fc640 1 --2- 172.21.15.2:0/888607631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f52d1ed40 0x560f52d36c60 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc01e620 tx=0x7ff9cc00b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c9e542ccad9c834 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:32.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.885+0000 7ff9bd7fa640 1 -- 172.21.15.2:0/888607631 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc024040 con 0x560f52d1ed40 2024-09-19T06:23:32.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.885+0000 7ff9bd7fa640 1 -- 172.21.15.2:0/888607631 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff9cc016070 con 0x560f52d1ed40 2024-09-19T06:23:32.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.885+0000 7ff9bd7fa640 1 -- 172.21.15.2:0/888607631 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc0055a0 con 0x560f52d1ed40 2024-09-19T06:23:32.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.886+0000 7ff9dfdb6740 1 -- 172.21.15.2:0/888607631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f52d1ed40 msgr2=0x560f52d36c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:32.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.886+0000 7ff9dfdb6740 1 --2- 172.21.15.2:0/888607631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f52d1ed40 0x560f52d36c60 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc01e620 tx=0x7ff9cc00b7b0 comp rx=0 tx=0).stop 2024-09-19T06:23:32.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.886+0000 7ff9dfdb6740 1 -- 172.21.15.2:0/888607631 shutdown_connections 2024-09-19T06:23:32.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.886+0000 7ff9dfdb6740 1 --2- 172.21.15.2:0/888607631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f52d1ed40 0x560f52d36c60 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:32.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.886+0000 7ff9dfdb6740 1 --2- 172.21.15.2:0/888607631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f52d14480 0x560f52d36720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:32.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.886+0000 7ff9dfdb6740 1 --2- 172.21.15.2:0/888607631 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f52d13b60 0x560f52d1daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:32.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.886+0000 7ff9dfdb6740 1 -- 172.21.15.2:0/888607631 >> 172.21.15.2:0/888607631 conn(0x560f52d100f0 msgr2=0x560f52d1d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:32.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.886+0000 7ff9dfdb6740 1 -- 172.21.15.2:0/888607631 shutdown_connections 2024-09-19T06:23:32.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.886+0000 7ff9dfdb6740 1 -- 172.21.15.2:0/888607631 wait complete. 2024-09-19T06:23:32.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.886+0000 7ff9dfdb6740 1 -- start start 2024-09-19T06:23:32.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.886+0000 7ff9dfdb6740 1 Processor -- start 2024-09-19T06:23:32.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.887+0000 7ff9dfdb6740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f52d13b60 0x560f52d23370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:32.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.887+0000 7ff9dfdb6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f52d14480 0x560f52d238b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:32.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.887+0000 7ff9dfdb6740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f52d1ed40 0x560f52d92730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:32.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.887+0000 7ff9dfdb6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d81adf10 con 0x560f52d14480 2024-09-19T06:23:32.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.887+0000 7ff9dfdb6740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d81af380 con 0x560f52d1ed40 2024-09-19T06:23:32.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.887+0000 7ff9dfdb6740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d81ae5e0 con 0x560f52d13b60 2024-09-19T06:23:32.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.887+0000 7ff9dfdb6740 10 client.0 _ll_register_callbacks cb 0x7ff9c8009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:32.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.887+0000 7ff9d6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f52d14480 0x560f52d238b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:32.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.887+0000 7ff9d67fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f52d13b60 0x560f52d23370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:32.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.887+0000 7ff9d67fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f52d13b60 0x560f52d23370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:53862/0 (socket says 172.21.15.2:53862) 2024-09-19T06:23:32.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.887+0000 7ff9d6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f52d14480 0x560f52d238b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52232/0 (socket says 172.21.15.2:52232) 2024-09-19T06:23:32.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.887+0000 7ff9d67fc640 1 -- 172.21.15.2:0/3850627726 learned_addr learned my addr 172.21.15.2:0/3850627726 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:32.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.887+0000 7ff9d67fc640 1 --2- 172.21.15.2:0/3850627726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f52d1ed40 0x560f52d92730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:32.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.887+0000 7ff9d6ffd640 1 -- 172.21.15.2:0/3850627726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f52d13b60 msgr2=0x560f52d23370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:32.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.887+0000 7ff9d6ffd640 1 --2- 172.21.15.2:0/3850627726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f52d13b60 0x560f52d23370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:32.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.887+0000 7ff9d6ffd640 1 -- 172.21.15.2:0/3850627726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f52d1ed40 msgr2=0x560f52d92730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:32.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.887+0000 7ff9d6ffd640 1 --2- 172.21.15.2:0/3850627726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f52d1ed40 0x560f52d92730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:32.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.887+0000 7ff9d6ffd640 1 -- 172.21.15.2:0/3850627726 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f52d92dd0 con 0x560f52d14480 2024-09-19T06:23:32.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.887+0000 7ff9d67fc640 1 --2- 172.21.15.2:0/3850627726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f52d1ed40 0x560f52d92730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:32.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.887+0000 7ff9d6ffd640 1 --2- 172.21.15.2:0/3850627726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f52d14480 0x560f52d238b0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8032fd0 tx=0x7ff9c8009830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc6278c5f8479d5f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:32.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.887+0000 7ff9b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:32.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.887+0000 7ff9b6ffd640 1 -- 172.21.15.2:0/3850627726 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8057060 con 0x560f52d14480 2024-09-19T06:23:32.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.888+0000 7ff9b6ffd640 1 -- 172.21.15.2:0/3850627726 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7ff9c8031c80 con 0x560f52d14480 2024-09-19T06:23:32.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.888+0000 7ff9dfdb6740 1 -- 172.21.15.2:0/3850627726 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9cc016070 con 0x560f52d14480 2024-09-19T06:23:32.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.888+0000 7ff9b6ffd640 1 -- 172.21.15.2:0/3850627726 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff9c8035070 con 0x560f52d14480 2024-09-19T06:23:32.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.888+0000 7ff9dfdb6740 10 client.18351 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:32.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.888+0000 7ff9dfdb6740 1 -- 172.21.15.2:0/3850627726 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560f52d9a180 con 0x560f52d14480 2024-09-19T06:23:32.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.888+0000 7ff9b6ffd640 1 -- 172.21.15.2:0/3850627726 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff9cc016070 con 0x560f52d14480 2024-09-19T06:23:32.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.888+0000 7ff9b6ffd640 1 -- 172.21.15.2:0/3850627726 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7ff9c8032070 con 0x560f52d14480 2024-09-19T06:23:32.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.888+0000 7ff9dfdb6740 10 client.18351 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:32.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.888+0000 7ff9dfdb6740 10 client.18351 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:32.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.888+0000 7ff9dfdb6740 20 client.18351 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:32.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.888+0000 7ff9dfdb6740 1 --2- 172.21.15.2:0/3850627726 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560f52d9a7e0 0x560f52d9cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:32.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.888+0000 7ff9dfdb6740 4 client.18351 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:23:32.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.888+0000 7ff9dfdb6740 1 -- 172.21.15.2:0/3850627726 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560f52c80d00 con 0x560f52d9a7e0 2024-09-19T06:23:32.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.889+0000 7ff9d67fc640 1 --2- 172.21.15.2:0/3850627726 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560f52d9a7e0 0x560f52d9cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:32.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.889+0000 7ff9d67fc640 1 --2- 172.21.15.2:0/3850627726 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560f52d9a7e0 0x560f52d9cbd0 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18d1186c2bf0eff9 server_cookie=45a771f7d1b9e616 in_seq=0 out_seq=0 2024-09-19T06:23:32.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.889+0000 7ff9b6ffd640 10 client.18351 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:32.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.890+0000 7ff9b6ffd640 1 -- 172.21.15.2:0/3850627726 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560f52c80d00 con 0x560f52d9a7e0 2024-09-19T06:23:32.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.890+0000 7ff9b6ffd640 10 client.18351 handle_command_reply: tid=0 2024-09-19T06:23:32.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.890+0000 7ff9dfdb6740 1 client.18351 shutdown 2024-09-19T06:23:32.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.890+0000 7ff9dfdb6740 1 -- 172.21.15.2:0/3850627726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f52d14480 msgr2=0x560f52d238b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:32.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.890+0000 7ff9dfdb6740 1 --2- 172.21.15.2:0/3850627726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f52d14480 0x560f52d238b0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8032fd0 tx=0x7ff9c8009830 comp rx=0 tx=0).stop 2024-09-19T06:23:32.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.890+0000 7ff9dfdb6740 1 -- 172.21.15.2:0/3850627726 shutdown_connections 2024-09-19T06:23:32.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.890+0000 7ff9dfdb6740 1 --2- 172.21.15.2:0/3850627726 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560f52d9a7e0 0x560f52d9cbd0 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:32.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.890+0000 7ff9dfdb6740 1 --2- 172.21.15.2:0/3850627726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f52d1ed40 0x560f52d92730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:32.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.890+0000 7ff9dfdb6740 1 --2- 172.21.15.2:0/3850627726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f52d14480 0x560f52d238b0 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:32.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.890+0000 7ff9dfdb6740 1 --2- 172.21.15.2:0/3850627726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560f52d13b60 0x560f52d23370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:32.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.890+0000 7ff9b6ffd640 0 client.18351 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:32.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.890+0000 7ff9dfdb6740 1 -- 172.21.15.2:0/3850627726 >> 172.21.15.2:0/3850627726 conn(0x560f52d100f0 msgr2=0x560f52d15dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:32.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.890+0000 7ff9dfdb6740 1 -- 172.21.15.2:0/3850627726 shutdown_connections 2024-09-19T06:23:32.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.891+0000 7ff9dfdb6740 1 -- 172.21.15.2:0/3850627726 wait complete. 2024-09-19T06:23:32.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.891+0000 7ff9dfdb6740 20 client.18351 trim_cache size 0 max 16384 2024-09-19T06:23:32.897 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:23:32.898 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T06:23:32.898 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "0b2139e4-767b-40ad-8d0b-b177a54a3236", 2024-09-19T06:23:32.898 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T06:23:32.898 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:23:32.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.891+0000 7ff9dd9dd640 1 -- 172.21.15.2:0/872628776 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff9c00a3430 msgr2=0x7ff9c00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:32.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.891+0000 7ff9dd9dd640 1 --2- 172.21.15.2:0/872628776 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff9c00a3430 0x7ff9c00a58f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff9d00cca80 tx=0x7ff9d006b230 comp rx=0 tx=0).stop 2024-09-19T06:23:32.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.891+0000 7ff9dd9dd640 1 -- 172.21.15.2:0/872628776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9d810c170 msgr2=0x7ff9d8101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:32.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.891+0000 7ff9dd9dd640 1 --2- 172.21.15.2:0/872628776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9d810c170 0x7ff9d8101420 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7ff9d000b970 tx=0x7ff9d000be30 comp rx=0 tx=0).stop 2024-09-19T06:23:32.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.891+0000 7ff9dd9dd640 1 -- 172.21.15.2:0/872628776 shutdown_connections 2024-09-19T06:23:32.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.891+0000 7ff9dd9dd640 1 --2- 172.21.15.2:0/872628776 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff9c00a3430 0x7ff9c00a58f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:32.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.891+0000 7ff9dd9dd640 1 --2- 172.21.15.2:0/872628776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9d810c170 0x7ff9d8101420 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:32.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.891+0000 7ff9dd9dd640 1 --2- 172.21.15.2:0/872628776 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9d8103660 0x7ff9d8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:32.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.891+0000 7ff9dd9dd640 1 --2- 172.21.15.2:0/872628776 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff9d8102d40 0x7ff9d81009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:32.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.891+0000 7ff9dd9dd640 1 -- 172.21.15.2:0/872628776 >> 172.21.15.2:0/872628776 conn(0x7ff9d80fc7a0 msgr2=0x7ff9d80fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:32.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.891+0000 7ff9dd9dd640 1 -- 172.21.15.2:0/872628776 shutdown_connections 2024-09-19T06:23:32.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:32.891+0000 7ff9dd9dd640 1 -- 172.21.15.2:0/872628776 wait complete. 2024-09-19T06:23:33.598 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:23:33.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:33 smithi002 ceph-mon[30982]: pgmap v271: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:23:33.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:33 smithi002 ceph-mon[30982]: scrub queued for path: / 2024-09-19T06:23:33.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:33 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:23:33.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:33 smithi002 ceph-mon[30982]: scrub summary: active paths [/] 2024-09-19T06:23:33.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:33 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:23:33.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:33 smithi002 ceph-mon[30982]: scrub summary: idle 2024-09-19T06:23:33.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:33 smithi089 ceph-mon[34160]: pgmap v271: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:23:33.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:33 smithi089 ceph-mon[34160]: scrub queued for path: / 2024-09-19T06:23:33.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:33 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:23:33.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:33 smithi089 ceph-mon[34160]: scrub summary: active paths [/] 2024-09-19T06:23:33.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:33 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:23:33.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:33 smithi089 ceph-mon[34160]: scrub summary: idle 2024-09-19T06:23:33.859 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:23:33.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:33 smithi090 ceph-mon[34497]: pgmap v271: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:23:33.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:33 smithi090 ceph-mon[34497]: scrub queued for path: / 2024-09-19T06:23:33.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:33 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:23:33.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:33 smithi090 ceph-mon[34497]: scrub summary: active paths [/] 2024-09-19T06:23:33.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:33 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:23:33.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:33 smithi090 ceph-mon[34497]: scrub summary: idle 2024-09-19T06:23:34.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.303+0000 7f5c641fa640 1 -- 172.21.15.2:0/1444873018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c5c112b90 msgr2=0x7f5c5c114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:34.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.303+0000 7f5c641fa640 1 --2- 172.21.15.2:0/1444873018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c5c112b90 0x7f5c5c114f80 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f5c54009ca0 tx=0x7f5c5402a950 comp rx=0 tx=0).stop 2024-09-19T06:23:34.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.304+0000 7f5c641fa640 1 -- 172.21.15.2:0/1444873018 shutdown_connections 2024-09-19T06:23:34.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.304+0000 7f5c641fa640 1 --2- 172.21.15.2:0/1444873018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c5c112b90 0x7f5c5c114f80 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:34.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.304+0000 7f5c641fa640 1 --2- 172.21.15.2:0/1444873018 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c5c074eb0 0x7f5c5c112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:34.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.304+0000 7f5c641fa640 1 --2- 172.21.15.2:0/1444873018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5c5c074590 0x7f5c5c074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:34.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.304+0000 7f5c641fa640 1 -- 172.21.15.2:0/1444873018 >> 172.21.15.2:0/1444873018 conn(0x7f5c5c0fd8c0 msgr2=0x7f5c5c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:34.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.304+0000 7f5c641fa640 1 -- 172.21.15.2:0/1444873018 shutdown_connections 2024-09-19T06:23:34.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.304+0000 7f5c641fa640 1 -- 172.21.15.2:0/1444873018 wait complete. 2024-09-19T06:23:34.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.304+0000 7f5c641fa640 1 Processor -- start 2024-09-19T06:23:34.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.304+0000 7f5c641fa640 1 -- start start 2024-09-19T06:23:34.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.305+0000 7f5c641fa640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5c5c074590 0x7f5c5c1a4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:34.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.305+0000 7f5c641fa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c5c074eb0 0x7f5c5c1a4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:34.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.305+0000 7f5c641fa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c5c112b90 0x7f5c5c19e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:34.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.305+0000 7f5c641fa640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5c5c118400 con 0x7f5c5c074eb0 2024-09-19T06:23:34.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.305+0000 7f5c641fa640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f5c5c118280 con 0x7f5c5c112b90 2024-09-19T06:23:34.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.305+0000 7f5c641fa640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5c5c118580 con 0x7f5c5c074590 2024-09-19T06:23:34.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.305+0000 7f5c61795640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c5c074eb0 0x7f5c5c1a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:34.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.305+0000 7f5c61795640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c5c074eb0 0x7f5c5c1a4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52258/0 (socket says 172.21.15.2:52258) 2024-09-19T06:23:34.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.305+0000 7f5c61795640 1 -- 172.21.15.2:0/1638891052 learned_addr learned my addr 172.21.15.2:0/1638891052 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:34.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.305+0000 7f5c61f96640 1 --2- 172.21.15.2:0/1638891052 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5c5c074590 0x7f5c5c1a4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:34.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.305+0000 7f5c62797640 1 --2- 172.21.15.2:0/1638891052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c5c112b90 0x7f5c5c19e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:34.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.305+0000 7f5c61795640 1 -- 172.21.15.2:0/1638891052 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5c5c074590 msgr2=0x7f5c5c1a4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:34.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.305+0000 7f5c61795640 1 --2- 172.21.15.2:0/1638891052 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5c5c074590 0x7f5c5c1a4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:34.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.305+0000 7f5c61795640 1 -- 172.21.15.2:0/1638891052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c5c112b90 msgr2=0x7f5c5c19e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:34.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.305+0000 7f5c61795640 1 --2- 172.21.15.2:0/1638891052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c5c112b90 0x7f5c5c19e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:34.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.305+0000 7f5c61795640 1 -- 172.21.15.2:0/1638891052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c5c19efa0 con 0x7f5c5c074eb0 2024-09-19T06:23:34.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.306+0000 7f5c61795640 1 --2- 172.21.15.2:0/1638891052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c5c074eb0 0x7f5c5c1a4ba0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c00c920 tx=0x7f5c4c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:34.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.306+0000 7f5c52ffd640 1 -- 172.21.15.2:0/1638891052 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c4c007c70 con 0x7f5c5c074eb0 2024-09-19T06:23:34.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.306+0000 7f5c52ffd640 1 -- 172.21.15.2:0/1638891052 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5c4c007e10 con 0x7f5c5c074eb0 2024-09-19T06:23:34.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.306+0000 7f5c641fa640 1 -- 172.21.15.2:0/1638891052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c5c19f290 con 0x7f5c5c074eb0 2024-09-19T06:23:34.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.306+0000 7f5c52ffd640 1 -- 172.21.15.2:0/1638891052 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c4c018820 con 0x7f5c5c074eb0 2024-09-19T06:23:34.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.306+0000 7f5c641fa640 1 -- 172.21.15.2:0/1638891052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c5c1ab5e0 con 0x7f5c5c074eb0 2024-09-19T06:23:34.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.308+0000 7f5c52ffd640 1 -- 172.21.15.2:0/1638891052 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f5c4c0189c0 con 0x7f5c5c074eb0 2024-09-19T06:23:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.308+0000 7f5c665d3740 1 Processor -- start 2024-09-19T06:23:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.308+0000 7f5c665d3740 1 -- start start 2024-09-19T06:23:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.309+0000 7f5c665d3740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55646bc154a0 0x55646bc15880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.309+0000 7f5c665d3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55646bc15dc0 0x55646bc20140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.309+0000 7f5c665d3740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55646bc20680 0x55646bc22a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.309+0000 7f5c665d3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55646bb7b2e0 con 0x55646bc15dc0 2024-09-19T06:23:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.309+0000 7f5c665d3740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55646bb22ce0 con 0x55646bc154a0 2024-09-19T06:23:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.309+0000 7f5c665d3740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55646bb772a0 con 0x55646bc20680 2024-09-19T06:23:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.309+0000 7f5c61f96640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55646bc15dc0 0x55646bc20140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.309+0000 7f5c61f96640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55646bc15dc0 0x55646bc20140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52266/0 (socket says 172.21.15.2:52266) 2024-09-19T06:23:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.309+0000 7f5c61f96640 1 -- 172.21.15.2:0/3376088073 learned_addr learned my addr 172.21.15.2:0/3376088073 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.309+0000 7f5c62797640 1 --2- 172.21.15.2:0/3376088073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55646bc154a0 0x55646bc15880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.309+0000 7f5c61795640 1 --2- 172.21.15.2:0/3376088073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55646bc20680 0x55646bc22a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:34.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.309+0000 7f5c61f96640 1 -- 172.21.15.2:0/3376088073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55646bc20680 msgr2=0x55646bc22a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:34.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.309+0000 7f5c61f96640 1 --2- 172.21.15.2:0/3376088073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55646bc20680 0x55646bc22a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:34.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.309+0000 7f5c61f96640 1 -- 172.21.15.2:0/3376088073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55646bc154a0 msgr2=0x55646bc15880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:34.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.309+0000 7f5c61f96640 1 --2- 172.21.15.2:0/3376088073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55646bc154a0 0x55646bc15880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:34.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.309+0000 7f5c61f96640 1 -- 172.21.15.2:0/3376088073 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55646bb07440 con 0x55646bc15dc0 2024-09-19T06:23:34.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.309+0000 7f5c61795640 1 --2- 172.21.15.2:0/3376088073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55646bc20680 0x55646bc22a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:23:34.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.309+0000 7f5c52ffd640 1 --2- 172.21.15.2:0/1638891052 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f5c480a33b0 0x7f5c480a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:34.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.309+0000 7f5c61f96640 1 --2- 172.21.15.2:0/3376088073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55646bc15dc0 0x55646bc20140 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f5c58009cf0 tx=0x7f5c58011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=684766d52e446bc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:34.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.310+0000 7f5c62797640 1 --2- 172.21.15.2:0/1638891052 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f5c480a33b0 0x7f5c480a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:34.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.310+0000 7f5c47fff640 1 -- 172.21.15.2:0/3376088073 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c58004230 con 0x55646bc15dc0 2024-09-19T06:23:34.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.310+0000 7f5c52ffd640 1 -- 172.21.15.2:0/1638891052 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f5c4c0cfe20 con 0x7f5c5c074eb0 2024-09-19T06:23:34.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.310+0000 7f5c47fff640 1 -- 172.21.15.2:0/3376088073 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5c580043d0 con 0x55646bc15dc0 2024-09-19T06:23:34.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.310+0000 7f5c47fff640 1 -- 172.21.15.2:0/3376088073 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c58019890 con 0x55646bc15dc0 2024-09-19T06:23:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.310+0000 7f5c665d3740 1 -- 172.21.15.2:0/3376088073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55646bc15dc0 msgr2=0x55646bc20140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.310+0000 7f5c62797640 1 --2- 172.21.15.2:0/1638891052 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f5c480a33b0 0x7f5c480a5870 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5c54005cc0 tx=0x7f5c54005c30 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.310+0000 7f5c665d3740 1 --2- 172.21.15.2:0/3376088073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55646bc15dc0 0x55646bc20140 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f5c58009cf0 tx=0x7f5c58011810 comp rx=0 tx=0).stop 2024-09-19T06:23:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.311+0000 7f5c665d3740 1 -- 172.21.15.2:0/3376088073 shutdown_connections 2024-09-19T06:23:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.311+0000 7f5c665d3740 1 --2- 172.21.15.2:0/3376088073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55646bc20680 0x55646bc22a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.311+0000 7f5c665d3740 1 --2- 172.21.15.2:0/3376088073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55646bc15dc0 0x55646bc20140 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.311+0000 7f5c665d3740 1 --2- 172.21.15.2:0/3376088073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55646bc154a0 0x55646bc15880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.311+0000 7f5c665d3740 1 -- 172.21.15.2:0/3376088073 >> 172.21.15.2:0/3376088073 conn(0x55646bc11a30 msgr2=0x55646bc11e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.311+0000 7f5c665d3740 1 -- 172.21.15.2:0/3376088073 shutdown_connections 2024-09-19T06:23:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.311+0000 7f5c665d3740 1 -- 172.21.15.2:0/3376088073 wait complete. 2024-09-19T06:23:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.311+0000 7f5c665d3740 1 -- start start 2024-09-19T06:23:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.311+0000 7f5c665d3740 1 Processor -- start 2024-09-19T06:23:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.311+0000 7f5c665d3740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55646bc154a0 0x55646bc1ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.312+0000 7f5c665d3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55646bc15dc0 0x55646bc1d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.312+0000 7f5c665d3740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55646bc20680 0x55646bc1d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.312+0000 7f5c665d3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55646bc23250 con 0x55646bc15dc0 2024-09-19T06:23:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.312+0000 7f5c665d3740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55646bb36050 con 0x55646bc20680 2024-09-19T06:23:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.312+0000 7f5c665d3740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55646bc233d0 con 0x55646bc154a0 2024-09-19T06:23:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.312+0000 7f5c665d3740 10 client.0 _ll_register_callbacks cb 0x55646bb76160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.312+0000 7f5c61795640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55646bc15dc0 0x55646bc1d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.312+0000 7f5c61795640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55646bc15dc0 0x55646bc1d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52274/0 (socket says 172.21.15.2:52274) 2024-09-19T06:23:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.312+0000 7f5c61795640 1 -- 172.21.15.2:0/1292614730 learned_addr learned my addr 172.21.15.2:0/1292614730 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.312+0000 7f5c61f96640 1 --2- 172.21.15.2:0/1292614730 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55646bc154a0 0x55646bc1ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.312+0000 7f5c62797640 1 --2- 172.21.15.2:0/1292614730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55646bc20680 0x55646bc1d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.312+0000 7f5c61795640 1 -- 172.21.15.2:0/1292614730 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55646bc154a0 msgr2=0x55646bc1ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.312+0000 7f5c61795640 1 --2- 172.21.15.2:0/1292614730 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55646bc154a0 0x55646bc1ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.312+0000 7f5c61795640 1 -- 172.21.15.2:0/1292614730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55646bc20680 msgr2=0x55646bc1d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.312+0000 7f5c61795640 1 --2- 172.21.15.2:0/1292614730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55646bc20680 0x55646bc1d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.312+0000 7f5c61795640 1 -- 172.21.15.2:0/1292614730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55646b8ec3c0 con 0x55646bc15dc0 2024-09-19T06:23:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.312+0000 7f5c62797640 1 --2- 172.21.15.2:0/1292614730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55646bc20680 0x55646bc1d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.312+0000 7f5c61795640 1 --2- 172.21.15.2:0/1292614730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55646bc15dc0 0x55646bc1d1b0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c09be00 tx=0x7f5c4c09bb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5932edfbd88220f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.312+0000 7f5c457fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.312+0000 7f5c457fa640 1 -- 172.21.15.2:0/1292614730 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c4c0b4020 con 0x55646bc15dc0 2024-09-19T06:23:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.312+0000 7f5c457fa640 1 -- 172.21.15.2:0/1292614730 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f5c4c098770 con 0x55646bc15dc0 2024-09-19T06:23:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.312+0000 7f5c665d3740 1 -- 172.21.15.2:0/1292614730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c580043d0 con 0x55646bc15dc0 2024-09-19T06:23:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.313+0000 7f5c457fa640 1 -- 172.21.15.2:0/1292614730 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5c4c09c100 con 0x55646bc15dc0 2024-09-19T06:23:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.313+0000 7f5c665d3740 10 client.18363 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.313+0000 7f5c665d3740 1 -- 172.21.15.2:0/1292614730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55646bc2ead0 con 0x55646bc15dc0 2024-09-19T06:23:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.313+0000 7f5c457fa640 1 -- 172.21.15.2:0/1292614730 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5c580043d0 con 0x55646bc15dc0 2024-09-19T06:23:34.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.313+0000 7f5c457fa640 1 -- 172.21.15.2:0/1292614730 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f5c4c0a48e0 con 0x55646bc15dc0 2024-09-19T06:23:34.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.313+0000 7f5c665d3740 10 client.18363 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:34.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.313+0000 7f5c665d3740 10 client.18363 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:34.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.313+0000 7f5c665d3740 20 client.18363 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:34.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.313+0000 7f5c665d3740 1 --2- 172.21.15.2:0/1292614730 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55646bc2ff90 0x55646bc323a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:34.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.313+0000 7f5c665d3740 4 client.18363 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:23:34.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.313+0000 7f5c665d3740 1 -- 172.21.15.2:0/1292614730 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55646bb88850 con 0x55646bc2ff90 2024-09-19T06:23:34.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.313+0000 7f5c61f96640 1 --2- 172.21.15.2:0/1292614730 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55646bc2ff90 0x55646bc323a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:34.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.314+0000 7f5c61f96640 1 --2- 172.21.15.2:0/1292614730 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55646bc2ff90 0x55646bc323a0 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=973e0f6bf9d71fe6 server_cookie=c97f47666057764e in_seq=0 out_seq=0 2024-09-19T06:23:34.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.314+0000 7f5c457fa640 10 client.18363 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:34.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.315+0000 7f5c457fa640 1 -- 172.21.15.2:0/1292614730 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55646bb88850 con 0x55646bc2ff90 2024-09-19T06:23:34.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.315+0000 7f5c457fa640 10 client.18363 handle_command_reply: tid=0 2024-09-19T06:23:34.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.315+0000 7f5c665d3740 1 client.18363 shutdown 2024-09-19T06:23:34.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.315+0000 7f5c665d3740 1 -- 172.21.15.2:0/1292614730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55646bc15dc0 msgr2=0x55646bc1d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:34.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.315+0000 7f5c665d3740 1 --2- 172.21.15.2:0/1292614730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55646bc15dc0 0x55646bc1d1b0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c09be00 tx=0x7f5c4c09bb20 comp rx=0 tx=0).stop 2024-09-19T06:23:34.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.315+0000 7f5c665d3740 1 -- 172.21.15.2:0/1292614730 shutdown_connections 2024-09-19T06:23:34.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.315+0000 7f5c665d3740 1 --2- 172.21.15.2:0/1292614730 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55646bc2ff90 0x55646bc323a0 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:34.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.315+0000 7f5c665d3740 1 --2- 172.21.15.2:0/1292614730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55646bc20680 0x55646bc1d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:34.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.315+0000 7f5c665d3740 1 --2- 172.21.15.2:0/1292614730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55646bc15dc0 0x55646bc1d1b0 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:34.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.315+0000 7f5c665d3740 1 --2- 172.21.15.2:0/1292614730 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55646bc154a0 0x55646bc1ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:34.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.315+0000 7f5c457fa640 0 client.18363 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:34.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.315+0000 7f5c665d3740 1 -- 172.21.15.2:0/1292614730 >> 172.21.15.2:0/1292614730 conn(0x55646bc11a30 msgr2=0x55646bc17760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:34.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.315+0000 7f5c665d3740 1 -- 172.21.15.2:0/1292614730 shutdown_connections 2024-09-19T06:23:34.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.315+0000 7f5c665d3740 1 -- 172.21.15.2:0/1292614730 wait complete. 2024-09-19T06:23:34.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.315+0000 7f5c665d3740 20 client.18363 trim_cache size 0 max 16384 2024-09-19T06:23:34.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.332+0000 7f5c665d3740 1 Processor -- start 2024-09-19T06:23:34.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.332+0000 7f5c665d3740 1 -- start start 2024-09-19T06:23:34.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.332+0000 7f5c665d3740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55646bc11a30 0x55646bc10a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:34.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.332+0000 7f5c665d3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55646bc154a0 0x55646bc37c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:34.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.332+0000 7f5c665d3740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55646bc15dc0 0x55646bc381b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:34.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.332+0000 7f5c665d3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5c5c1b65e0 con 0x55646bc154a0 2024-09-19T06:23:34.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.332+0000 7f5c665d3740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f5c5c1b3eb0 con 0x55646bc15dc0 2024-09-19T06:23:34.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.332+0000 7f5c665d3740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5c5c1b1d20 con 0x55646bc11a30 2024-09-19T06:23:34.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.333+0000 7f5c61795640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55646bc154a0 0x55646bc37c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:34.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.333+0000 7f5c61795640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55646bc154a0 0x55646bc37c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52290/0 (socket says 172.21.15.2:52290) 2024-09-19T06:23:34.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.333+0000 7f5c61795640 1 -- 172.21.15.2:0/2676749529 learned_addr learned my addr 172.21.15.2:0/2676749529 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:34.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.333+0000 7f5c61795640 1 -- 172.21.15.2:0/2676749529 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55646bc11a30 msgr2=0x55646bc10a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:34.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.333+0000 7f5c61795640 1 --2- 172.21.15.2:0/2676749529 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55646bc11a30 0x55646bc10a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:34.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.333+0000 7f5c61795640 1 -- 172.21.15.2:0/2676749529 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55646bc15dc0 msgr2=0x55646bc381b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:34.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.333+0000 7f5c61795640 1 --2- 172.21.15.2:0/2676749529 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55646bc15dc0 0x55646bc381b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:34.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.333+0000 7f5c61795640 1 -- 172.21.15.2:0/2676749529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55646bc11860 con 0x55646bc154a0 2024-09-19T06:23:34.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.333+0000 7f5c61795640 1 --2- 172.21.15.2:0/2676749529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55646bc154a0 0x55646bc37c70 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c09c090 tx=0x7f5c4c09bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdf025514a8754ac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:34.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.333+0000 7f5c477fe640 1 -- 172.21.15.2:0/2676749529 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c4c0b4050 con 0x55646bc154a0 2024-09-19T06:23:34.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.333+0000 7f5c477fe640 1 -- 172.21.15.2:0/2676749529 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5c4c0a04b0 con 0x55646bc154a0 2024-09-19T06:23:34.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.333+0000 7f5c477fe640 1 -- 172.21.15.2:0/2676749529 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c4c0a48e0 con 0x55646bc154a0 2024-09-19T06:23:34.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.334+0000 7f5c665d3740 1 -- 172.21.15.2:0/2676749529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55646bc154a0 msgr2=0x55646bc37c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:34.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.334+0000 7f5c665d3740 1 --2- 172.21.15.2:0/2676749529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55646bc154a0 0x55646bc37c70 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c09c090 tx=0x7f5c4c09bb90 comp rx=0 tx=0).stop 2024-09-19T06:23:34.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.334+0000 7f5c665d3740 1 -- 172.21.15.2:0/2676749529 shutdown_connections 2024-09-19T06:23:34.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.334+0000 7f5c665d3740 1 --2- 172.21.15.2:0/2676749529 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55646bc15dc0 0x55646bc381b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:34.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.334+0000 7f5c665d3740 1 --2- 172.21.15.2:0/2676749529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55646bc154a0 0x55646bc37c70 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:34.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.334+0000 7f5c665d3740 1 --2- 172.21.15.2:0/2676749529 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55646bc11a30 0x55646bc10a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:34.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.334+0000 7f5c665d3740 1 -- 172.21.15.2:0/2676749529 >> 172.21.15.2:0/2676749529 conn(0x55646bc1d850 msgr2=0x55646bc10350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:34.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.334+0000 7f5c665d3740 1 -- 172.21.15.2:0/2676749529 shutdown_connections 2024-09-19T06:23:34.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.334+0000 7f5c665d3740 1 -- 172.21.15.2:0/2676749529 wait complete. 2024-09-19T06:23:34.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.334+0000 7f5c665d3740 1 -- start start 2024-09-19T06:23:34.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.334+0000 7f5c665d3740 1 Processor -- start 2024-09-19T06:23:34.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.335+0000 7f5c665d3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55646bc11a30 0x55646bc28ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:34.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.335+0000 7f5c665d3740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55646bc154a0 0x55646bc26220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:34.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.335+0000 7f5c665d3740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55646bc15dc0 0x55646bc269b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:34.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.335+0000 7f5c665d3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5c5c1b2370 con 0x55646bc11a30 2024-09-19T06:23:34.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.335+0000 7f5c665d3740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f5c5c1b37e0 con 0x55646bc15dc0 2024-09-19T06:23:34.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.335+0000 7f5c665d3740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5c5c1b2a40 con 0x55646bc154a0 2024-09-19T06:23:34.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.335+0000 7f5c665d3740 10 client.0 _ll_register_callbacks cb 0x7f5c4c00fe00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:34.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.335+0000 7f5c61f96640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55646bc11a30 0x55646bc28ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:34.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.335+0000 7f5c61f96640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55646bc11a30 0x55646bc28ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52294/0 (socket says 172.21.15.2:52294) 2024-09-19T06:23:34.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.335+0000 7f5c61f96640 1 -- 172.21.15.2:0/2112672718 learned_addr learned my addr 172.21.15.2:0/2112672718 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:34.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.335+0000 7f5c62797640 1 --2- 172.21.15.2:0/2112672718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55646bc15dc0 0x55646bc269b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:34.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.335+0000 7f5c61795640 1 --2- 172.21.15.2:0/2112672718 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55646bc154a0 0x55646bc26220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:34.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.335+0000 7f5c61f96640 1 -- 172.21.15.2:0/2112672718 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55646bc154a0 msgr2=0x55646bc26220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:34.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.335+0000 7f5c61f96640 1 --2- 172.21.15.2:0/2112672718 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55646bc154a0 0x55646bc26220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:34.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.335+0000 7f5c61f96640 1 -- 172.21.15.2:0/2112672718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55646bc15dc0 msgr2=0x55646bc269b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:34.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.335+0000 7f5c61f96640 1 --2- 172.21.15.2:0/2112672718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55646bc15dc0 0x55646bc269b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:34.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.335+0000 7f5c61f96640 1 -- 172.21.15.2:0/2112672718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55646bc126c0 con 0x55646bc11a30 2024-09-19T06:23:34.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.335+0000 7f5c62797640 1 --2- 172.21.15.2:0/2112672718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55646bc15dc0 0x55646bc269b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:34.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.335+0000 7f5c61f96640 1 --2- 172.21.15.2:0/2112672718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55646bc11a30 0x55646bc28ed0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f5c58011d10 tx=0x7f5c58009280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=715baee42f00f66d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:34.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.335+0000 7f5c457fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:34.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.336+0000 7f5c457fa640 1 -- 172.21.15.2:0/2112672718 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c58005450 con 0x55646bc11a30 2024-09-19T06:23:34.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.336+0000 7f5c457fa640 1 -- 172.21.15.2:0/2112672718 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f5c580055f0 con 0x55646bc11a30 2024-09-19T06:23:34.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.336+0000 7f5c665d3740 1 -- 172.21.15.2:0/2112672718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c4c0a04b0 con 0x55646bc11a30 2024-09-19T06:23:34.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.336+0000 7f5c457fa640 1 -- 172.21.15.2:0/2112672718 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5c58039050 con 0x55646bc11a30 2024-09-19T06:23:34.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.336+0000 7f5c665d3740 10 client.18369 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:34.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.336+0000 7f5c665d3740 1 -- 172.21.15.2:0/2112672718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55646bc9abf0 con 0x55646bc11a30 2024-09-19T06:23:34.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.336+0000 7f5c457fa640 1 -- 172.21.15.2:0/2112672718 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5c4c0a04b0 con 0x55646bc11a30 2024-09-19T06:23:34.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.336+0000 7f5c457fa640 1 -- 172.21.15.2:0/2112672718 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f5c5802b6a0 con 0x55646bc11a30 2024-09-19T06:23:34.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.336+0000 7f5c665d3740 10 client.18369 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:34.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.336+0000 7f5c665d3740 10 client.18369 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:34.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.336+0000 7f5c665d3740 20 client.18369 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:34.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.336+0000 7f5c665d3740 1 --2- 172.21.15.2:0/2112672718 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55646bc20680 0x55646bc9d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:34.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.336+0000 7f5c665d3740 4 client.18369 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:23:34.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.336+0000 7f5c665d3740 1 -- 172.21.15.2:0/2112672718 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55646bb82d60 con 0x55646bc20680 2024-09-19T06:23:34.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.337+0000 7f5c61795640 1 --2- 172.21.15.2:0/2112672718 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55646bc20680 0x55646bc9d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:34.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.337+0000 7f5c61795640 1 --2- 172.21.15.2:0/2112672718 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55646bc20680 0x55646bc9d180 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4c98b7fc4a84e2b server_cookie=46f8ddbfdd6a6740 in_seq=0 out_seq=0 2024-09-19T06:23:34.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.337+0000 7f5c457fa640 10 client.18369 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:34.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.337+0000 7f5c457fa640 1 -- 172.21.15.2:0/2112672718 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55646bb82d60 con 0x55646bc20680 2024-09-19T06:23:34.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.337+0000 7f5c457fa640 10 client.18369 handle_command_reply: tid=0 2024-09-19T06:23:34.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.337+0000 7f5c665d3740 1 client.18369 shutdown 2024-09-19T06:23:34.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.337+0000 7f5c665d3740 1 -- 172.21.15.2:0/2112672718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55646bc11a30 msgr2=0x55646bc28ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:34.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.337+0000 7f5c665d3740 1 --2- 172.21.15.2:0/2112672718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55646bc11a30 0x55646bc28ed0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f5c58011d10 tx=0x7f5c58009280 comp rx=0 tx=0).stop 2024-09-19T06:23:34.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.337+0000 7f5c665d3740 1 -- 172.21.15.2:0/2112672718 shutdown_connections 2024-09-19T06:23:34.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.337+0000 7f5c665d3740 1 --2- 172.21.15.2:0/2112672718 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55646bc20680 0x55646bc9d180 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:34.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.337+0000 7f5c665d3740 1 --2- 172.21.15.2:0/2112672718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55646bc15dc0 0x55646bc269b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:34.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.337+0000 7f5c665d3740 1 --2- 172.21.15.2:0/2112672718 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55646bc154a0 0x55646bc26220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:34.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.337+0000 7f5c665d3740 1 --2- 172.21.15.2:0/2112672718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55646bc11a30 0x55646bc28ed0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:34.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.337+0000 7f5c457fa640 0 client.18369 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:34.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.337+0000 7f5c665d3740 1 -- 172.21.15.2:0/2112672718 >> 172.21.15.2:0/2112672718 conn(0x55646bc1d850 msgr2=0x55646bc1b640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:34.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.337+0000 7f5c665d3740 1 -- 172.21.15.2:0/2112672718 shutdown_connections 2024-09-19T06:23:34.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.338+0000 7f5c665d3740 1 -- 172.21.15.2:0/2112672718 wait complete. 2024-09-19T06:23:34.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.338+0000 7f5c665d3740 20 client.18369 trim_cache size 0 max 16384 2024-09-19T06:23:34.346 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:23:34.346 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T06:23:34.347 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T06:23:34.347 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:23:34.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.338+0000 7f5c641fa640 1 -- 172.21.15.2:0/1638891052 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f5c480a33b0 msgr2=0x7f5c480a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:34.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.338+0000 7f5c641fa640 1 --2- 172.21.15.2:0/1638891052 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f5c480a33b0 0x7f5c480a5870 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5c54005cc0 tx=0x7f5c54005c30 comp rx=0 tx=0).stop 2024-09-19T06:23:34.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.338+0000 7f5c641fa640 1 -- 172.21.15.2:0/1638891052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c5c074eb0 msgr2=0x7f5c5c1a4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:34.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.338+0000 7f5c641fa640 1 --2- 172.21.15.2:0/1638891052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c5c074eb0 0x7f5c5c1a4ba0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c00c920 tx=0x7f5c4c00cde0 comp rx=0 tx=0).stop 2024-09-19T06:23:34.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.338+0000 7f5c641fa640 1 -- 172.21.15.2:0/1638891052 shutdown_connections 2024-09-19T06:23:34.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.338+0000 7f5c641fa640 1 --2- 172.21.15.2:0/1638891052 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f5c480a33b0 0x7f5c480a5870 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:34.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.338+0000 7f5c641fa640 1 --2- 172.21.15.2:0/1638891052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c5c112b90 0x7f5c5c19e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:34.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.338+0000 7f5c641fa640 1 --2- 172.21.15.2:0/1638891052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c5c074eb0 0x7f5c5c1a4ba0 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:34.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.338+0000 7f5c641fa640 1 --2- 172.21.15.2:0/1638891052 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5c5c074590 0x7f5c5c1a4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:34.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.338+0000 7f5c641fa640 1 -- 172.21.15.2:0/1638891052 >> 172.21.15.2:0/1638891052 conn(0x7f5c5c0fd8c0 msgr2=0x7f5c5c0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:34.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.338+0000 7f5c641fa640 1 -- 172.21.15.2:0/1638891052 shutdown_connections 2024-09-19T06:23:34.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:34.338+0000 7f5c641fa640 1 -- 172.21.15.2:0/1638891052 wait complete. 2024-09-19T06:23:35.031 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:23:35.031 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:23:35.290 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:23:35.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:35 smithi002 ceph-mon[30982]: pgmap v272: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2024-09-19T06:23:35.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.725+0000 7f8f0e99a640 1 -- 172.21.15.2:0/2206246060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f08106a80 msgr2=0x7f8f08106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:35.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.725+0000 7f8f0e99a640 1 --2- 172.21.15.2:0/2206246060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f08106a80 0x7f8f08106e60 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8009930 tx=0x7f8ef802a420 comp rx=0 tx=0).stop 2024-09-19T06:23:35.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.725+0000 7f8f0e99a640 1 -- 172.21.15.2:0/2206246060 shutdown_connections 2024-09-19T06:23:35.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.725+0000 7f8f0e99a640 1 --2- 172.21.15.2:0/2206246060 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f08101420 0x7f8f0810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.725+0000 7f8f0e99a640 1 --2- 172.21.15.2:0/2206246060 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f08100a80 0x7f8f08100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.725+0000 7f8f0e99a640 1 --2- 172.21.15.2:0/2206246060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f08106a80 0x7f8f08106e60 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.725+0000 7f8f0e99a640 1 -- 172.21.15.2:0/2206246060 >> 172.21.15.2:0/2206246060 conn(0x7f8f080fc7a0 msgr2=0x7f8f080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:35.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.725+0000 7f8f0e99a640 1 -- 172.21.15.2:0/2206246060 shutdown_connections 2024-09-19T06:23:35.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.725+0000 7f8f0e99a640 1 -- 172.21.15.2:0/2206246060 wait complete. 2024-09-19T06:23:35.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.725+0000 7f8f0e99a640 1 Processor -- start 2024-09-19T06:23:35.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.725+0000 7f8f0e99a640 1 -- start start 2024-09-19T06:23:35.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.726+0000 7f8f0e99a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f08100a80 0x7f8f08197220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:35.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.726+0000 7f8f0e99a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f08101420 0x7f8f08197760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:35.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.726+0000 7f8f0e99a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f08106a80 0x7f8f0819baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:35.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.726+0000 7f8f0e99a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8f08110d80 con 0x7f8f08106a80 2024-09-19T06:23:35.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.726+0000 7f8f0e99a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8f08110c00 con 0x7f8f08101420 2024-09-19T06:23:35.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.726+0000 7f8f0e99a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8f08110f00 con 0x7f8f08100a80 2024-09-19T06:23:35.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.726+0000 7f8f0cf37640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f08106a80 0x7f8f0819baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:35.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.726+0000 7f8f0cf37640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f08106a80 0x7f8f0819baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46452/0 (socket says 172.21.15.2:46452) 2024-09-19T06:23:35.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.726+0000 7f8f07fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f08100a80 0x7f8f08197220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:35.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.726+0000 7f8f0cf37640 1 -- 172.21.15.2:0/3069501674 learned_addr learned my addr 172.21.15.2:0/3069501674 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:35.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.726+0000 7f8efffff640 1 --2- 172.21.15.2:0/3069501674 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f08101420 0x7f8f08197760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:35.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.726+0000 7f8f0cf37640 1 -- 172.21.15.2:0/3069501674 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f08100a80 msgr2=0x7f8f08197220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:35.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.726+0000 7f8f0cf37640 1 --2- 172.21.15.2:0/3069501674 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f08100a80 0x7f8f08197220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.726+0000 7f8f0cf37640 1 -- 172.21.15.2:0/3069501674 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f08101420 msgr2=0x7f8f08197760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:35.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.726+0000 7f8f0cf37640 1 --2- 172.21.15.2:0/3069501674 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f08101420 0x7f8f08197760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.726+0000 7f8f0cf37640 1 -- 172.21.15.2:0/3069501674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f0819c1d0 con 0x7f8f08106a80 2024-09-19T06:23:35.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.726+0000 7f8efffff640 1 --2- 172.21.15.2:0/3069501674 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f08101420 0x7f8f08197760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:35.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.727+0000 7f8f0cf37640 1 --2- 172.21.15.2:0/3069501674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f08106a80 0x7f8f0819baf0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f8f0000cce0 tx=0x7f8f0000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:35.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.727+0000 7f8f05ffb640 1 -- 172.21.15.2:0/3069501674 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f0000f450 con 0x7f8f08106a80 2024-09-19T06:23:35.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.727+0000 7f8f05ffb640 1 -- 172.21.15.2:0/3069501674 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8f0000faa0 con 0x7f8f08106a80 2024-09-19T06:23:35.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.727+0000 7f8f0e99a640 1 -- 172.21.15.2:0/3069501674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f0819c4c0 con 0x7f8f08106a80 2024-09-19T06:23:35.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.727+0000 7f8f05ffb640 1 -- 172.21.15.2:0/3069501674 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f00018b70 con 0x7f8f08106a80 2024-09-19T06:23:35.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.727+0000 7f8f0e99a640 1 -- 172.21.15.2:0/3069501674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f081a3da0 con 0x7f8f08106a80 2024-09-19T06:23:35.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.728+0000 7f8f0e99a640 1 -- 172.21.15.2:0/3069501674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f08100ee0 con 0x7f8f08106a80 2024-09-19T06:23:35.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.729+0000 7f8f05ffb640 1 -- 172.21.15.2:0/3069501674 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f8f00018d10 con 0x7f8f08106a80 2024-09-19T06:23:35.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.730+0000 7f8f05ffb640 1 --2- 172.21.15.2:0/3069501674 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f8ef40a3430 0x7f8ef40a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:35.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.730+0000 7f8f05ffb640 1 -- 172.21.15.2:0/3069501674 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f8f000d0070 con 0x7f8f08106a80 2024-09-19T06:23:35.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.730+0000 7f8f07fff640 1 --2- 172.21.15.2:0/3069501674 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f8ef40a3430 0x7f8ef40a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:35.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.730+0000 7f8f07fff640 1 --2- 172.21.15.2:0/3069501674 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f8ef40a3430 0x7f8ef40a58f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8031440 tx=0x7f8ef8005a20 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:35.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.734+0000 7f8f05ffb640 1 -- 172.21.15.2:0/3069501674 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8f00014030 con 0x7f8f08106a80 2024-09-19T06:23:35.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:35 smithi089 ceph-mon[34160]: pgmap v272: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2024-09-19T06:23:35.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.953+0000 7f8f0e99a640 1 -- 172.21.15.2:0/3069501674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8f0802d7c0 con 0x7f8f08106a80 2024-09-19T06:23:35.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.954+0000 7f8f05ffb640 1 -- 172.21.15.2:0/3069501674 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11882 (secure 0 0 0) 0x7f8f0009ca50 con 0x7f8f08106a80 2024-09-19T06:23:35.956 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:23:35.956 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-09-19T06:14:49:104280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:14:48.191083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24470,24472,24497]},"id":1}]} 2024-09-19T06:23:35.956 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-09-19T06:23:35.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.956+0000 7f8f0e99a640 1 -- 172.21.15.2:0/3069501674 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f8ef40a3430 msgr2=0x7f8ef40a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:35.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.956+0000 7f8f0e99a640 1 --2- 172.21.15.2:0/3069501674 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f8ef40a3430 0x7f8ef40a58f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8031440 tx=0x7f8ef8005a20 comp rx=0 tx=0).stop 2024-09-19T06:23:35.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.956+0000 7f8f0e99a640 1 -- 172.21.15.2:0/3069501674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f08106a80 msgr2=0x7f8f0819baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:35.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.956+0000 7f8f0e99a640 1 --2- 172.21.15.2:0/3069501674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f08106a80 0x7f8f0819baf0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f8f0000cce0 tx=0x7f8f0000a620 comp rx=0 tx=0).stop 2024-09-19T06:23:35.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.956+0000 7f8f0e99a640 1 -- 172.21.15.2:0/3069501674 shutdown_connections 2024-09-19T06:23:35.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.956+0000 7f8f0e99a640 1 --2- 172.21.15.2:0/3069501674 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f8ef40a3430 0x7f8ef40a58f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.956+0000 7f8f0e99a640 1 --2- 172.21.15.2:0/3069501674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f08106a80 0x7f8f0819baf0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.956+0000 7f8f0e99a640 1 --2- 172.21.15.2:0/3069501674 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f08101420 0x7f8f08197760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.956+0000 7f8f0e99a640 1 --2- 172.21.15.2:0/3069501674 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f08100a80 0x7f8f08197220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.956+0000 7f8f0e99a640 1 -- 172.21.15.2:0/3069501674 >> 172.21.15.2:0/3069501674 conn(0x7f8f080fc7a0 msgr2=0x7f8f080fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:35.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.956+0000 7f8f0e99a640 1 -- 172.21.15.2:0/3069501674 shutdown_connections 2024-09-19T06:23:35.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:35.956+0000 7f8f0e99a640 1 -- 172.21.15.2:0/3069501674 wait complete. 2024-09-19T06:23:35.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:35 smithi090 ceph-mon[34497]: pgmap v272: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2024-09-19T06:23:36.573 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:36 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/3069501674' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:23:36.605 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:23:36.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:36 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/3069501674' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:23:36.864 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:23:36.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:36 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/3069501674' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:23:37.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.275+0000 7f8fb16d1640 1 -- 172.21.15.2:0/1650241823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fac106f10 msgr2=0x7f8fac10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:37.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.275+0000 7f8fb16d1640 1 --2- 172.21.15.2:0/1650241823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fac106f10 0x7f8fac10ea90 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4009ca0 tx=0x7f8fa402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.275+0000 7f8fb16d1640 1 -- 172.21.15.2:0/1650241823 shutdown_connections 2024-09-19T06:23:37.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.275+0000 7f8fb16d1640 1 --2- 172.21.15.2:0/1650241823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fac106f10 0x7f8fac10ea90 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.275+0000 7f8fb16d1640 1 --2- 172.21.15.2:0/1650241823 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fac102790 0x7f8fac1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.275+0000 7f8fb16d1640 1 --2- 172.21.15.2:0/1650241823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fac101de0 0x7f8fac1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.275+0000 7f8fb16d1640 1 -- 172.21.15.2:0/1650241823 >> 172.21.15.2:0/1650241823 conn(0x7f8fac0fd8c0 msgr2=0x7f8fac0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:37.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.275+0000 7f8fb16d1640 1 -- 172.21.15.2:0/1650241823 shutdown_connections 2024-09-19T06:23:37.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.275+0000 7f8fb16d1640 1 -- 172.21.15.2:0/1650241823 wait complete. 2024-09-19T06:23:37.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.276+0000 7f8fb16d1640 1 Processor -- start 2024-09-19T06:23:37.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.276+0000 7f8fb16d1640 1 -- start start 2024-09-19T06:23:37.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.276+0000 7f8fb16d1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fac101de0 0x7f8fac1981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:37.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.276+0000 7f8fb16d1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fac102790 0x7f8fac198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:37.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.276+0000 7f8fb16d1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fac106f10 0x7f8fac19ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:37.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.276+0000 7f8fb16d1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8fac111e20 con 0x7f8fac106f10 2024-09-19T06:23:37.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.276+0000 7f8fb16d1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8fac111ca0 con 0x7f8fac102790 2024-09-19T06:23:37.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.276+0000 7f8fb16d1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8fac111fa0 con 0x7f8fac101de0 2024-09-19T06:23:37.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.277+0000 7f8fab7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fac106f10 0x7f8fac19ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:37.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.277+0000 7f8fab7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fac106f10 0x7f8fac19ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46460/0 (socket says 172.21.15.2:46460) 2024-09-19T06:23:37.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.277+0000 7f8fab7fe640 1 -- 172.21.15.2:0/120206370 learned_addr learned my addr 172.21.15.2:0/120206370 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:37.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.277+0000 7f8faaffd640 1 --2- 172.21.15.2:0/120206370 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fac101de0 0x7f8fac1981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:37.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.277+0000 7f8faa7fc640 1 --2- 172.21.15.2:0/120206370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fac102790 0x7f8fac198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:37.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.277+0000 7f8fab7fe640 1 -- 172.21.15.2:0/120206370 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fac101de0 msgr2=0x7f8fac1981c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:37.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.277+0000 7f8fab7fe640 1 --2- 172.21.15.2:0/120206370 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fac101de0 0x7f8fac1981c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.277+0000 7f8fab7fe640 1 -- 172.21.15.2:0/120206370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fac102790 msgr2=0x7f8fac198700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:37.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.277+0000 7f8fab7fe640 1 --2- 172.21.15.2:0/120206370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fac102790 0x7f8fac198700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.277+0000 7f8fab7fe640 1 -- 172.21.15.2:0/120206370 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fac19d170 con 0x7f8fac106f10 2024-09-19T06:23:37.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.277+0000 7f8fab7fe640 1 --2- 172.21.15.2:0/120206370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fac106f10 0x7f8fac19ca90 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4009dc0 tx=0x7f8fa4003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:37.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.277+0000 7f8f93fff640 1 -- 172.21.15.2:0/120206370 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa4004040 con 0x7f8fac106f10 2024-09-19T06:23:37.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.277+0000 7f8f93fff640 1 -- 172.21.15.2:0/120206370 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8fa4004690 con 0x7f8fac106f10 2024-09-19T06:23:37.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.277+0000 7f8fb16d1640 1 -- 172.21.15.2:0/120206370 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fac19d400 con 0x7f8fac106f10 2024-09-19T06:23:37.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.277+0000 7f8f93fff640 1 -- 172.21.15.2:0/120206370 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa4030c90 con 0x7f8fac106f10 2024-09-19T06:23:37.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.278+0000 7f8fb16d1640 1 -- 172.21.15.2:0/120206370 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fac1a4d40 con 0x7f8fac106f10 2024-09-19T06:23:37.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.280+0000 7f8f93fff640 1 -- 172.21.15.2:0/120206370 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f8fa40041e0 con 0x7f8fac106f10 2024-09-19T06:23:37.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.280+0000 7f8fb3aaa740 1 Processor -- start 2024-09-19T06:23:37.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.280+0000 7f8fb3aaa740 1 -- start start 2024-09-19T06:23:37.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.280+0000 7f8fb3aaa740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bb736f7b40 0x55bb736f6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:37.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.280+0000 7f8fb3aaa740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb736f65d0 0x55bb736f6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:37.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.280+0000 7f8fb3aaa740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb73705780 0x55bb73707b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:37.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.280+0000 7f8fb3aaa740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55bb7365c2f0 con 0x55bb73705780 2024-09-19T06:23:37.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.280+0000 7f8fb3aaa740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55bb73603cf0 con 0x55bb736f7b40 2024-09-19T06:23:37.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.280+0000 7f8fb3aaa740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55bb736582b0 con 0x55bb736f65d0 2024-09-19T06:23:37.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.280+0000 7f8faa7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb73705780 0x55bb73707b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:37.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.280+0000 7f8faa7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb73705780 0x55bb73707b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46468/0 (socket says 172.21.15.2:46468) 2024-09-19T06:23:37.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.280+0000 7f8faa7fc640 1 -- 172.21.15.2:0/376511083 learned_addr learned my addr 172.21.15.2:0/376511083 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:37.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.280+0000 7f8f93fff640 1 --2- 172.21.15.2:0/120206370 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f8f940a33b0 0x7f8f940a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:37.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.281+0000 7f8faa7fc640 1 --2- 172.21.15.2:0/376511083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bb736f7b40 0x55bb736f6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:37.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.281+0000 7f8faaffd640 1 --2- 172.21.15.2:0/376511083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb736f65d0 0x55bb736f6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:37.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.281+0000 7f8fab7fe640 1 --2- 172.21.15.2:0/120206370 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f8f940a33b0 0x7f8f940a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:37.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.281+0000 7f8faa7fc640 1 -- 172.21.15.2:0/376511083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb736f65d0 msgr2=0x55bb736f6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:37.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.281+0000 7f8faa7fc640 1 --2- 172.21.15.2:0/376511083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb736f65d0 0x55bb736f6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.281+0000 7f8faa7fc640 1 -- 172.21.15.2:0/376511083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bb736f7b40 msgr2=0x55bb736f6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:37.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.281+0000 7f8faa7fc640 1 --2- 172.21.15.2:0/376511083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bb736f7b40 0x55bb736f6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.281+0000 7f8faa7fc640 1 -- 172.21.15.2:0/376511083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb735e83a0 con 0x55bb73705780 2024-09-19T06:23:37.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.281+0000 7f8f93fff640 1 -- 172.21.15.2:0/120206370 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f8fa40f14a0 con 0x7f8fac106f10 2024-09-19T06:23:37.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.281+0000 7f8faa7fc640 1 --2- 172.21.15.2:0/376511083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb73705780 0x55bb73707b70 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0011770 tx=0x7f8fa000a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1629b693c0bb2bc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:37.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.281+0000 7f8fab7fe640 1 --2- 172.21.15.2:0/120206370 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f8f940a33b0 0x7f8f940a5870 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8fa40eedb0 tx=0x7f8fa40b9510 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:37.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.281+0000 7f8f917fa640 1 -- 172.21.15.2:0/376511083 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0005020 con 0x55bb73705780 2024-09-19T06:23:37.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.281+0000 7f8f917fa640 1 -- 172.21.15.2:0/376511083 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8fa00047a0 con 0x55bb73705780 2024-09-19T06:23:37.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.281+0000 7f8f917fa640 1 -- 172.21.15.2:0/376511083 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa000fa20 con 0x55bb73705780 2024-09-19T06:23:37.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.282+0000 7f8fb3aaa740 1 -- 172.21.15.2:0/376511083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb73705780 msgr2=0x55bb73707b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:37.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.282+0000 7f8fb3aaa740 1 --2- 172.21.15.2:0/376511083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb73705780 0x55bb73707b70 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0011770 tx=0x7f8fa000a6e0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.282+0000 7f8fb3aaa740 1 -- 172.21.15.2:0/376511083 shutdown_connections 2024-09-19T06:23:37.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.282+0000 7f8fb3aaa740 1 --2- 172.21.15.2:0/376511083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb73705780 0x55bb73707b70 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.282+0000 7f8fb3aaa740 1 --2- 172.21.15.2:0/376511083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb736f65d0 0x55bb736f6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.282+0000 7f8fb3aaa740 1 --2- 172.21.15.2:0/376511083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bb736f7b40 0x55bb736f6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.282+0000 7f8fb3aaa740 1 -- 172.21.15.2:0/376511083 >> 172.21.15.2:0/376511083 conn(0x55bb736bf310 msgr2=0x55bb736f2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:37.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.282+0000 7f8fb3aaa740 1 -- 172.21.15.2:0/376511083 shutdown_connections 2024-09-19T06:23:37.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.282+0000 7f8fb3aaa740 1 -- 172.21.15.2:0/376511083 wait complete. 2024-09-19T06:23:37.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.282+0000 7f8fb3aaa740 1 -- start start 2024-09-19T06:23:37.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.282+0000 7f8fb3aaa740 1 Processor -- start 2024-09-19T06:23:37.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.283+0000 7f8fb3aaa740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bb736f65d0 0x55bb737051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:37.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.283+0000 7f8fb3aaa740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb736f7b40 0x55bb73702470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:37.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.283+0000 7f8fb3aaa740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb73705780 0x55bb73702c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:37.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.283+0000 7f8fb3aaa740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55bb73708480 con 0x55bb73705780 2024-09-19T06:23:37.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.283+0000 7f8fb3aaa740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55bb73617060 con 0x55bb736f65d0 2024-09-19T06:23:37.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.283+0000 7f8fb3aaa740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55bb73708600 con 0x55bb736f7b40 2024-09-19T06:23:37.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.283+0000 7f8fb3aaa740 10 client.0 _ll_register_callbacks cb 0x55bb7336a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:37.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.283+0000 7f8faa7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb73705780 0x55bb73702c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:37.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.283+0000 7f8faa7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb73705780 0x55bb73702c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46482/0 (socket says 172.21.15.2:46482) 2024-09-19T06:23:37.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.283+0000 7f8faa7fc640 1 -- 172.21.15.2:0/3439713446 learned_addr learned my addr 172.21.15.2:0/3439713446 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:37.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.283+0000 7f8faaffd640 1 --2- 172.21.15.2:0/3439713446 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb736f7b40 0x55bb73702470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:37.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.283+0000 7f8faa7fc640 1 --2- 172.21.15.2:0/3439713446 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bb736f65d0 0x55bb737051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:37.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.283+0000 7f8faa7fc640 1 -- 172.21.15.2:0/3439713446 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb736f7b40 msgr2=0x55bb73702470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:37.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.283+0000 7f8faa7fc640 1 --2- 172.21.15.2:0/3439713446 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb736f7b40 0x55bb73702470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.283+0000 7f8faa7fc640 1 -- 172.21.15.2:0/3439713446 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bb736f65d0 msgr2=0x55bb737051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:37.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.283+0000 7f8faa7fc640 1 --2- 172.21.15.2:0/3439713446 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bb736f65d0 0x55bb737051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.283+0000 7f8faa7fc640 1 -- 172.21.15.2:0/3439713446 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb733cd3c0 con 0x55bb73705780 2024-09-19T06:23:37.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.283+0000 7f8faa7fc640 1 --2- 172.21.15.2:0/3439713446 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb73705780 0x55bb73702c00 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0011740 tx=0x7f8fa001a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ada73ea6c77d4aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:37.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.283+0000 7f8f8eff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:37.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.283+0000 7f8f8eff5640 1 -- 172.21.15.2:0/3439713446 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0005350 con 0x55bb73705780 2024-09-19T06:23:37.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.283+0000 7f8fb3aaa740 1 -- 172.21.15.2:0/3439713446 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8fa00047a0 con 0x55bb73705780 2024-09-19T06:23:37.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.283+0000 7f8f8eff5640 1 -- 172.21.15.2:0/3439713446 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f8fa00054f0 con 0x55bb73705780 2024-09-19T06:23:37.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.284+0000 7f8f8eff5640 1 -- 172.21.15.2:0/3439713446 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8fa0031050 con 0x55bb73705780 2024-09-19T06:23:37.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.284+0000 7f8fb3aaa740 10 client.18387 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:37.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.284+0000 7f8fb3aaa740 1 -- 172.21.15.2:0/3439713446 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55bb73713f70 con 0x55bb73705780 2024-09-19T06:23:37.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.284+0000 7f8f8eff5640 1 -- 172.21.15.2:0/3439713446 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8fa00047a0 con 0x55bb73705780 2024-09-19T06:23:37.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.284+0000 7f8f8eff5640 1 -- 172.21.15.2:0/3439713446 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f8fa002c690 con 0x55bb73705780 2024-09-19T06:23:37.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.284+0000 7f8fb3aaa740 10 client.18387 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:37.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.284+0000 7f8fb3aaa740 10 client.18387 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:23:37.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.284+0000 7f8fb3aaa740 20 client.18387 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:37.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.284+0000 7f8fb3aaa740 1 --2- 172.21.15.2:0/3439713446 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55bb737152c0 0x55bb737176b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:37.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.284+0000 7f8fb3aaa740 4 client.18387 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:23:37.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.284+0000 7f8fb3aaa740 1 -- 172.21.15.2:0/3439713446 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bb73669860 con 0x55bb737152c0 2024-09-19T06:23:37.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.284+0000 7f8faaffd640 1 --2- 172.21.15.2:0/3439713446 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55bb737152c0 0x55bb737176b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:37.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.285+0000 7f8f8eff5640 10 client.18387 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:23:37.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.285+0000 7f8faaffd640 1 --2- 172.21.15.2:0/3439713446 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55bb737152c0 0x55bb737176b0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fcf5f00b78f11b6f server_cookie=3a822d1e86b865a1 in_seq=0 out_seq=0 2024-09-19T06:23:37.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.286+0000 7f8f8eff5640 1 -- 172.21.15.2:0/3439713446 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bb73669860 con 0x55bb737152c0 2024-09-19T06:23:37.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.286+0000 7f8f8eff5640 10 client.18387 handle_command_reply: tid=0 2024-09-19T06:23:37.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.286+0000 7f8fb3aaa740 1 client.18387 shutdown 2024-09-19T06:23:37.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.286+0000 7f8fb3aaa740 1 -- 172.21.15.2:0/3439713446 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb73705780 msgr2=0x55bb73702c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:37.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.286+0000 7f8fb3aaa740 1 --2- 172.21.15.2:0/3439713446 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb73705780 0x55bb73702c00 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0011740 tx=0x7f8fa001a040 comp rx=0 tx=0).stop 2024-09-19T06:23:37.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.286+0000 7f8fb3aaa740 1 -- 172.21.15.2:0/3439713446 shutdown_connections 2024-09-19T06:23:37.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.286+0000 7f8fb3aaa740 1 --2- 172.21.15.2:0/3439713446 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55bb737152c0 0x55bb737176b0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.286+0000 7f8fb3aaa740 1 --2- 172.21.15.2:0/3439713446 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb73705780 0x55bb73702c00 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.286+0000 7f8fb3aaa740 1 --2- 172.21.15.2:0/3439713446 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb736f7b40 0x55bb73702470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.286+0000 7f8fb3aaa740 1 --2- 172.21.15.2:0/3439713446 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bb736f65d0 0x55bb737051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.286+0000 7f8f8eff5640 0 client.18387 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:23:37.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.286+0000 7f8fb3aaa740 1 -- 172.21.15.2:0/3439713446 >> 172.21.15.2:0/3439713446 conn(0x55bb736bf310 msgr2=0x55bb736f8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:37.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.286+0000 7f8fb3aaa740 1 -- 172.21.15.2:0/3439713446 shutdown_connections 2024-09-19T06:23:37.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.286+0000 7f8fb3aaa740 1 -- 172.21.15.2:0/3439713446 wait complete. 2024-09-19T06:23:37.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.286+0000 7f8fb3aaa740 20 client.18387 trim_cache size 0 max 16384 2024-09-19T06:23:37.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.299+0000 7f8fb3aaa740 1 Processor -- start 2024-09-19T06:23:37.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.299+0000 7f8fb3aaa740 1 -- start start 2024-09-19T06:23:37.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.299+0000 7f8fb3aaa740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb736f65d0 0x55bb737176b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:37.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.299+0000 7f8fb3aaa740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bb736f7b40 0x55bb73701d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:37.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.299+0000 7f8fb3aaa740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb73705780 0x55bb73701450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:37.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.299+0000 7f8fb3aaa740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8fac1adce0 con 0x55bb736f65d0 2024-09-19T06:23:37.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.299+0000 7f8fb3aaa740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8fac1ab5b0 con 0x55bb736f7b40 2024-09-19T06:23:37.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.299+0000 7f8fb3aaa740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8fac1a9420 con 0x55bb73705780 2024-09-19T06:23:37.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.299+0000 7f8faa7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb736f65d0 0x55bb737176b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:37.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.299+0000 7f8faa7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb736f65d0 0x55bb737176b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46498/0 (socket says 172.21.15.2:46498) 2024-09-19T06:23:37.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.299+0000 7f8faa7fc640 1 -- 172.21.15.2:0/2816982051 learned_addr learned my addr 172.21.15.2:0/2816982051 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:37.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.299+0000 7f8faaffd640 1 --2- 172.21.15.2:0/2816982051 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bb736f7b40 0x55bb73701d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:37.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.300+0000 7f8faa7fc640 1 -- 172.21.15.2:0/2816982051 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb73705780 msgr2=0x55bb73701450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:37.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.300+0000 7f8faa7fc640 1 --2- 172.21.15.2:0/2816982051 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb73705780 0x55bb73701450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.300+0000 7f8faa7fc640 1 -- 172.21.15.2:0/2816982051 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bb736f7b40 msgr2=0x55bb73701d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:37.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.300+0000 7f8faa7fc640 1 --2- 172.21.15.2:0/2816982051 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bb736f7b40 0x55bb73701d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.300+0000 7f8faa7fc640 1 -- 172.21.15.2:0/2816982051 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb736f7300 con 0x55bb736f65d0 2024-09-19T06:23:37.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.300+0000 7f8faa7fc640 1 --2- 172.21.15.2:0/2816982051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb736f65d0 0x55bb737176b0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0014000 tx=0x7f8fa002ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6750c14b3042f2e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:37.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.300+0000 7f8f90ff9640 1 -- 172.21.15.2:0/2816982051 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0022070 con 0x55bb736f65d0 2024-09-19T06:23:37.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.300+0000 7f8f90ff9640 1 -- 172.21.15.2:0/2816982051 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8fa000a340 con 0x55bb736f65d0 2024-09-19T06:23:37.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.300+0000 7f8f90ff9640 1 -- 172.21.15.2:0/2816982051 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa002c400 con 0x55bb736f65d0 2024-09-19T06:23:37.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.300+0000 7f8fb3aaa740 1 -- 172.21.15.2:0/2816982051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb736f65d0 msgr2=0x55bb737176b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:37.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.300+0000 7f8fb3aaa740 1 --2- 172.21.15.2:0/2816982051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb736f65d0 0x55bb737176b0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0014000 tx=0x7f8fa002ce90 comp rx=0 tx=0).stop 2024-09-19T06:23:37.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.300+0000 7f8fb3aaa740 1 -- 172.21.15.2:0/2816982051 shutdown_connections 2024-09-19T06:23:37.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.301+0000 7f8fb3aaa740 1 --2- 172.21.15.2:0/2816982051 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb73705780 0x55bb73701450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.301+0000 7f8fb3aaa740 1 --2- 172.21.15.2:0/2816982051 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bb736f7b40 0x55bb73701d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.301+0000 7f8fb3aaa740 1 --2- 172.21.15.2:0/2816982051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb736f65d0 0x55bb737176b0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.301+0000 7f8fb3aaa740 1 -- 172.21.15.2:0/2816982051 >> 172.21.15.2:0/2816982051 conn(0x55bb736bf310 msgr2=0x55bb73700d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:37.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.301+0000 7f8fb3aaa740 1 -- 172.21.15.2:0/2816982051 shutdown_connections 2024-09-19T06:23:37.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.301+0000 7f8fb3aaa740 1 -- 172.21.15.2:0/2816982051 wait complete. 2024-09-19T06:23:37.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.301+0000 7f8fb3aaa740 1 -- start start 2024-09-19T06:23:37.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.301+0000 7f8fb3aaa740 1 Processor -- start 2024-09-19T06:23:37.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.301+0000 7f8fb3aaa740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bb736f65d0 0x55bb73778090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:37.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.301+0000 7f8fb3aaa740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb736f7b40 0x55bb737785d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:37.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.301+0000 7f8fb3aaa740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb73705780 0x55bb73708e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:37.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.301+0000 7f8fb3aaa740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8fac1a9a70 con 0x55bb736f7b40 2024-09-19T06:23:37.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.301+0000 7f8fb3aaa740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8fac1aaee0 con 0x55bb736f65d0 2024-09-19T06:23:37.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.301+0000 7f8fb3aaa740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8fac1aa140 con 0x55bb73705780 2024-09-19T06:23:37.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.301+0000 7f8fb3aaa740 10 client.0 _ll_register_callbacks cb 0x7f8fa000adf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:37.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.301+0000 7f8faaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb736f7b40 0x55bb737785d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:37.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.301+0000 7f8faaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb736f7b40 0x55bb737785d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46506/0 (socket says 172.21.15.2:46506) 2024-09-19T06:23:37.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.301+0000 7f8faaffd640 1 -- 172.21.15.2:0/4143356437 learned_addr learned my addr 172.21.15.2:0/4143356437 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:37.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.302+0000 7f8faa7fc640 1 --2- 172.21.15.2:0/4143356437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bb736f65d0 0x55bb73778090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:37.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.302+0000 7f8faa7fc640 1 --2- 172.21.15.2:0/4143356437 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb73705780 0x55bb73708e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:37.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.302+0000 7f8faaffd640 1 -- 172.21.15.2:0/4143356437 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb73705780 msgr2=0x55bb73708e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:37.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.302+0000 7f8faaffd640 1 --2- 172.21.15.2:0/4143356437 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb73705780 0x55bb73708e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.302+0000 7f8faaffd640 1 -- 172.21.15.2:0/4143356437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bb736f65d0 msgr2=0x55bb73778090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:37.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.302+0000 7f8faaffd640 1 --2- 172.21.15.2:0/4143356437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bb736f65d0 0x55bb73778090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.302+0000 7f8faaffd640 1 -- 172.21.15.2:0/4143356437 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb73709500 con 0x55bb736f7b40 2024-09-19T06:23:37.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.302+0000 7f8faa7fc640 1 --2- 172.21.15.2:0/4143356437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bb736f65d0 0x55bb73778090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:23:37.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.302+0000 7f8faaffd640 1 --2- 172.21.15.2:0/4143356437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb736f7b40 0x55bb737785d0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c00acb0 tx=0x7f8f9c01da40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73c1156fc3ca415b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:37.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.302+0000 7f8f8eff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:37.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.302+0000 7f8f8eff5640 1 -- 172.21.15.2:0/4143356437 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c011d80 con 0x55bb736f7b40 2024-09-19T06:23:37.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.302+0000 7f8f8eff5640 1 -- 172.21.15.2:0/4143356437 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f8f9c005020 con 0x55bb736f7b40 2024-09-19T06:23:37.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.302+0000 7f8fb3aaa740 1 -- 172.21.15.2:0/4143356437 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8fa000a340 con 0x55bb736f7b40 2024-09-19T06:23:37.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.302+0000 7f8f8eff5640 1 -- 172.21.15.2:0/4143356437 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8f9c005220 con 0x55bb736f7b40 2024-09-19T06:23:37.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.302+0000 7f8fb3aaa740 10 client.18393 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:37.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.302+0000 7f8fb3aaa740 1 -- 172.21.15.2:0/4143356437 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55bb7377f8c0 con 0x55bb736f7b40 2024-09-19T06:23:37.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.302+0000 7f8f8eff5640 1 -- 172.21.15.2:0/4143356437 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8fa000a340 con 0x55bb736f7b40 2024-09-19T06:23:37.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.303+0000 7f8f8eff5640 1 -- 172.21.15.2:0/4143356437 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f8f9c02e480 con 0x55bb736f7b40 2024-09-19T06:23:37.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.303+0000 7f8fb3aaa740 10 client.18393 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:37.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.303+0000 7f8fb3aaa740 10 client.18393 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:23:37.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.303+0000 7f8fb3aaa740 20 client.18393 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:37.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.303+0000 7f8fb3aaa740 1 --2- 172.21.15.2:0/4143356437 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55bb7377ffc0 0x55bb737823e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:37.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.303+0000 7f8fb3aaa740 4 client.18393 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:23:37.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.303+0000 7f8fb3aaa740 1 -- 172.21.15.2:0/4143356437 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bb73663d70 con 0x55bb7377ffc0 2024-09-19T06:23:37.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.303+0000 7f8faa7fc640 1 --2- 172.21.15.2:0/4143356437 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55bb7377ffc0 0x55bb737823e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:37.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.303+0000 7f8faa7fc640 1 --2- 172.21.15.2:0/4143356437 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55bb7377ffc0 0x55bb737823e0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=21cb3ea345ce2a14 server_cookie=c6380a97f9a3bdb in_seq=0 out_seq=0 2024-09-19T06:23:37.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.303+0000 7f8f8eff5640 10 client.18393 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:23:37.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.304+0000 7f8f8eff5640 1 -- 172.21.15.2:0/4143356437 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bb73663d70 con 0x55bb7377ffc0 2024-09-19T06:23:37.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.304+0000 7f8f8eff5640 10 client.18393 handle_command_reply: tid=0 2024-09-19T06:23:37.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.304+0000 7f8fb3aaa740 1 client.18393 shutdown 2024-09-19T06:23:37.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.304+0000 7f8fb3aaa740 1 -- 172.21.15.2:0/4143356437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb736f7b40 msgr2=0x55bb737785d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:37.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.304+0000 7f8fb3aaa740 1 --2- 172.21.15.2:0/4143356437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb736f7b40 0x55bb737785d0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c00acb0 tx=0x7f8f9c01da40 comp rx=0 tx=0).stop 2024-09-19T06:23:37.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.304+0000 7f8fb3aaa740 1 -- 172.21.15.2:0/4143356437 shutdown_connections 2024-09-19T06:23:37.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.304+0000 7f8fb3aaa740 1 --2- 172.21.15.2:0/4143356437 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55bb7377ffc0 0x55bb737823e0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.304+0000 7f8fb3aaa740 1 --2- 172.21.15.2:0/4143356437 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55bb73705780 0x55bb73708e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.304+0000 7f8fb3aaa740 1 --2- 172.21.15.2:0/4143356437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bb736f7b40 0x55bb737785d0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.304+0000 7f8fb3aaa740 1 --2- 172.21.15.2:0/4143356437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bb736f65d0 0x55bb73778090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.304+0000 7f8f8eff5640 0 client.18393 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:23:37.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.304+0000 7f8fb3aaa740 1 -- 172.21.15.2:0/4143356437 >> 172.21.15.2:0/4143356437 conn(0x55bb736bf310 msgr2=0x55bb73703cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:37.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.304+0000 7f8fb3aaa740 1 -- 172.21.15.2:0/4143356437 shutdown_connections 2024-09-19T06:23:37.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.304+0000 7f8fb3aaa740 1 -- 172.21.15.2:0/4143356437 wait complete. 2024-09-19T06:23:37.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.304+0000 7f8fb3aaa740 20 client.18393 trim_cache size 0 max 16384 2024-09-19T06:23:37.314 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:23:37.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.304+0000 7f8fb16d1640 1 -- 172.21.15.2:0/120206370 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f8f940a33b0 msgr2=0x7f8f940a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:37.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.304+0000 7f8fb16d1640 1 --2- 172.21.15.2:0/120206370 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f8f940a33b0 0x7f8f940a5870 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8fa40eedb0 tx=0x7f8fa40b9510 comp rx=0 tx=0).stop 2024-09-19T06:23:37.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.304+0000 7f8fb16d1640 1 -- 172.21.15.2:0/120206370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fac106f10 msgr2=0x7f8fac19ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:37.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.304+0000 7f8fb16d1640 1 --2- 172.21.15.2:0/120206370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fac106f10 0x7f8fac19ca90 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4009dc0 tx=0x7f8fa4003ba0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.304+0000 7f8fb16d1640 1 -- 172.21.15.2:0/120206370 shutdown_connections 2024-09-19T06:23:37.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.305+0000 7f8fb16d1640 1 --2- 172.21.15.2:0/120206370 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f8f940a33b0 0x7f8f940a5870 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.305+0000 7f8fb16d1640 1 --2- 172.21.15.2:0/120206370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8fac106f10 0x7f8fac19ca90 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.305+0000 7f8fb16d1640 1 --2- 172.21.15.2:0/120206370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fac102790 0x7f8fac198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.305+0000 7f8fb16d1640 1 --2- 172.21.15.2:0/120206370 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fac101de0 0x7f8fac1981c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.305+0000 7f8fb16d1640 1 -- 172.21.15.2:0/120206370 >> 172.21.15.2:0/120206370 conn(0x7f8fac0fd8c0 msgr2=0x7f8fac0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:37.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.305+0000 7f8fb16d1640 1 -- 172.21.15.2:0/120206370 shutdown_connections 2024-09-19T06:23:37.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:37.305+0000 7f8fb16d1640 1 -- 172.21.15.2:0/120206370 wait complete. 2024-09-19T06:23:37.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:37 smithi002 ceph-mon[30982]: pgmap v273: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:23:37.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:37 smithi089 ceph-mon[34160]: pgmap v273: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:23:37.934 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:23:37.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:37 smithi090 ceph-mon[34497]: pgmap v273: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:23:38.189 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:23:38.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.691+0000 7f885c365640 1 -- 172.21.15.2:0/512772686 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88541036e0 msgr2=0x7f8854107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:38.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.691+0000 7f885c365640 1 --2- 172.21.15.2:0/512772686 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88541036e0 0x7f8854107b90 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f8844009930 tx=0x7f884402a420 comp rx=0 tx=0).stop 2024-09-19T06:23:38.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.692+0000 7f885c365640 1 -- 172.21.15.2:0/512772686 shutdown_connections 2024-09-19T06:23:38.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.692+0000 7f885c365640 1 --2- 172.21.15.2:0/512772686 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88541082a0 0x7f885410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.692+0000 7f885c365640 1 --2- 172.21.15.2:0/512772686 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88541036e0 0x7f8854107b90 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.692+0000 7f885c365640 1 --2- 172.21.15.2:0/512772686 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8854102d30 0x7f8854103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.692+0000 7f885c365640 1 -- 172.21.15.2:0/512772686 >> 172.21.15.2:0/512772686 conn(0x7f88540fc7d0 msgr2=0x7f88540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:38.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.692+0000 7f885c365640 1 -- 172.21.15.2:0/512772686 shutdown_connections 2024-09-19T06:23:38.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.692+0000 7f885c365640 1 -- 172.21.15.2:0/512772686 wait complete. 2024-09-19T06:23:38.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.692+0000 7f885c365640 1 Processor -- start 2024-09-19T06:23:38.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.692+0000 7f885c365640 1 -- start start 2024-09-19T06:23:38.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.693+0000 7f885c365640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8854102d30 0x7f8854100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:38.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.693+0000 7f885c365640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88541036e0 0x7f8854100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:38.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.693+0000 7f885c365640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88541082a0 0x7f8854101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:38.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.693+0000 7f885c365640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8854111f50 con 0x7f88541082a0 2024-09-19T06:23:38.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.693+0000 7f885c365640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8854111dd0 con 0x7f8854102d30 2024-09-19T06:23:38.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.693+0000 7f885c365640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f88541120d0 con 0x7f88541036e0 2024-09-19T06:23:38.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.693+0000 7f885a902640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88541082a0 0x7f8854101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:38.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.693+0000 7f885a902640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88541082a0 0x7f8854101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46524/0 (socket says 172.21.15.2:46524) 2024-09-19T06:23:38.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.693+0000 7f885a902640 1 -- 172.21.15.2:0/4041341709 learned_addr learned my addr 172.21.15.2:0/4041341709 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:38.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.693+0000 7f885a101640 1 --2- 172.21.15.2:0/4041341709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8854102d30 0x7f8854100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:38.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.693+0000 7f8859900640 1 --2- 172.21.15.2:0/4041341709 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88541036e0 0x7f8854100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:38.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.693+0000 7f885a902640 1 -- 172.21.15.2:0/4041341709 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88541036e0 msgr2=0x7f8854100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:38.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.693+0000 7f885a902640 1 --2- 172.21.15.2:0/4041341709 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88541036e0 0x7f8854100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.693+0000 7f885a902640 1 -- 172.21.15.2:0/4041341709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8854102d30 msgr2=0x7f8854100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:38.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.693+0000 7f885a902640 1 --2- 172.21.15.2:0/4041341709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8854102d30 0x7f8854100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.693+0000 7f885a902640 1 -- 172.21.15.2:0/4041341709 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88541a6950 con 0x7f88541082a0 2024-09-19T06:23:38.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.693+0000 7f885a902640 1 --2- 172.21.15.2:0/4041341709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88541082a0 0x7f8854101410 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f884c00c970 tx=0x7f884c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:38.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.694+0000 7f884b7fe640 1 -- 172.21.15.2:0/4041341709 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c007bb0 con 0x7f88541082a0 2024-09-19T06:23:38.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.694+0000 7f884b7fe640 1 -- 172.21.15.2:0/4041341709 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f884c007d50 con 0x7f88541082a0 2024-09-19T06:23:38.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.694+0000 7f885c365640 1 -- 172.21.15.2:0/4041341709 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88541a6c40 con 0x7f88541082a0 2024-09-19T06:23:38.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.694+0000 7f884b7fe640 1 -- 172.21.15.2:0/4041341709 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c004e10 con 0x7f88541082a0 2024-09-19T06:23:38.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.694+0000 7f885c365640 1 -- 172.21.15.2:0/4041341709 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88541a71a0 con 0x7f88541082a0 2024-09-19T06:23:38.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.696+0000 7f884b7fe640 1 -- 172.21.15.2:0/4041341709 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f884c005020 con 0x7f88541082a0 2024-09-19T06:23:38.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.696+0000 7f885e73e740 1 Processor -- start 2024-09-19T06:23:38.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.696+0000 7f885e73e740 1 -- start start 2024-09-19T06:23:38.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.697+0000 7f885e73e740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cdcd06b40 0x560cdcd05090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:38.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.697+0000 7f885e73e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cdcd055d0 0x560cdcd05a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:38.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.697+0000 7f885e73e740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cdcd10370 0x560cdcd12760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:38.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.697+0000 7f885e73e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560cdcc6b2f0 con 0x560cdcd055d0 2024-09-19T06:23:38.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.697+0000 7f885e73e740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x560cdcc12cf0 con 0x560cdcd10370 2024-09-19T06:23:38.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.697+0000 7f885e73e740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560cdcc672b0 con 0x560cdcd06b40 2024-09-19T06:23:38.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.697+0000 7f885a101640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cdcd055d0 0x560cdcd05a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:38.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.697+0000 7f884b7fe640 1 --2- 172.21.15.2:0/4041341709 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f88400a3430 0x7f88400a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:38.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.697+0000 7f885a101640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cdcd055d0 0x560cdcd05a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46540/0 (socket says 172.21.15.2:46540) 2024-09-19T06:23:38.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.697+0000 7f8859900640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cdcd06b40 0x560cdcd05090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:38.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.697+0000 7f885a101640 1 -- 172.21.15.2:0/2060212763 learned_addr learned my addr 172.21.15.2:0/2060212763 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:38.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.697+0000 7f8859900640 1 --2- 172.21.15.2:0/2060212763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cdcd10370 0x560cdcd12760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:38.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.697+0000 7f885a902640 1 --2- 172.21.15.2:0/4041341709 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f88400a3430 0x7f88400a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:38.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.697+0000 7f884b7fe640 1 -- 172.21.15.2:0/4041341709 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f884c0cfb00 con 0x7f88541082a0 2024-09-19T06:23:38.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.697+0000 7f8859900640 1 -- 172.21.15.2:0/2060212763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cdcd10370 msgr2=0x560cdcd12760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:38.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.697+0000 7f8859900640 1 --2- 172.21.15.2:0/2060212763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cdcd10370 0x560cdcd12760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.697+0000 7f8859900640 1 -- 172.21.15.2:0/2060212763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cdcd055d0 msgr2=0x560cdcd05a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:38.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.697+0000 7f8859900640 1 --2- 172.21.15.2:0/2060212763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cdcd055d0 0x560cdcd05a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.697+0000 7f8859900640 1 -- 172.21.15.2:0/2060212763 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cdcbf73a0 con 0x560cdcd06b40 2024-09-19T06:23:38.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.698+0000 7f8859900640 1 --2- 172.21.15.2:0/2060212763 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cdcd06b40 0x560cdcd05090 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f884402a940 tx=0x7f8844005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9163b2060b183f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:38.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.698+0000 7f8848dea640 1 -- 172.21.15.2:0/2060212763 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8844035070 con 0x560cdcd06b40 2024-09-19T06:23:38.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.698+0000 7f885a902640 1 --2- 172.21.15.2:0/4041341709 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f88400a3430 0x7f88400a58f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f884c0cd300 tx=0x7f884c066880 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.698+0000 7f8848dea640 1 -- 172.21.15.2:0/2060212763 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8844032d60 con 0x560cdcd06b40 2024-09-19T06:23:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.698+0000 7f8848dea640 1 -- 172.21.15.2:0/2060212763 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8844004a00 con 0x560cdcd06b40 2024-09-19T06:23:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.698+0000 7f885e73e740 1 -- 172.21.15.2:0/2060212763 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cdcd06b40 msgr2=0x560cdcd05090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.699+0000 7f885e73e740 1 --2- 172.21.15.2:0/2060212763 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cdcd06b40 0x560cdcd05090 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f884402a940 tx=0x7f8844005fd0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.699+0000 7f885e73e740 1 -- 172.21.15.2:0/2060212763 shutdown_connections 2024-09-19T06:23:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.699+0000 7f885e73e740 1 --2- 172.21.15.2:0/2060212763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cdcd10370 0x560cdcd12760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.699+0000 7f885e73e740 1 --2- 172.21.15.2:0/2060212763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cdcd055d0 0x560cdcd05a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.699+0000 7f885e73e740 1 --2- 172.21.15.2:0/2060212763 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cdcd06b40 0x560cdcd05090 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.699+0000 7f885e73e740 1 -- 172.21.15.2:0/2060212763 >> 172.21.15.2:0/2060212763 conn(0x560cdccce310 msgr2=0x560cdcd01c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.699+0000 7f885e73e740 1 -- 172.21.15.2:0/2060212763 shutdown_connections 2024-09-19T06:23:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.699+0000 7f885e73e740 1 -- 172.21.15.2:0/2060212763 wait complete. 2024-09-19T06:23:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.699+0000 7f885e73e740 1 -- start start 2024-09-19T06:23:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.699+0000 7f885e73e740 1 Processor -- start 2024-09-19T06:23:38.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.699+0000 7f885e73e740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cdcd055d0 0x560cdcd0fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:38.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.699+0000 7f885e73e740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cdcd06b40 0x560cdcd0cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:38.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.699+0000 7f885e73e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cdcd10370 0x560cdcd0d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:38.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.699+0000 7f885e73e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560cdcd13010 con 0x560cdcd10370 2024-09-19T06:23:38.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.699+0000 7f885e73e740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x560cdcc26060 con 0x560cdcd055d0 2024-09-19T06:23:38.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.699+0000 7f885e73e740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560cdcd13190 con 0x560cdcd06b40 2024-09-19T06:23:38.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.700+0000 7f885e73e740 10 client.0 _ll_register_callbacks cb 0x560cdc9798c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:38.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.700+0000 7f8859900640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cdcd10370 0x560cdcd0d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:38.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.700+0000 7f8859900640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cdcd10370 0x560cdcd0d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46556/0 (socket says 172.21.15.2:46556) 2024-09-19T06:23:38.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.700+0000 7f8859900640 1 -- 172.21.15.2:0/2192326131 learned_addr learned my addr 172.21.15.2:0/2192326131 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:38.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.700+0000 7f885a101640 1 --2- 172.21.15.2:0/2192326131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cdcd06b40 0x560cdcd0cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:38.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.700+0000 7f8859900640 1 --2- 172.21.15.2:0/2192326131 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cdcd055d0 0x560cdcd0fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:38.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.700+0000 7f885a101640 1 -- 172.21.15.2:0/2192326131 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cdcd055d0 msgr2=0x560cdcd0fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:38.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.700+0000 7f885a101640 1 --2- 172.21.15.2:0/2192326131 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cdcd055d0 0x560cdcd0fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.700+0000 7f885a101640 1 -- 172.21.15.2:0/2192326131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cdcd10370 msgr2=0x560cdcd0d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:38.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.700+0000 7f885a101640 1 --2- 172.21.15.2:0/2192326131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cdcd10370 0x560cdcd0d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.700+0000 7f885a101640 1 -- 172.21.15.2:0/2192326131 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cdc9dc3c0 con 0x560cdcd06b40 2024-09-19T06:23:38.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.700+0000 7f8859900640 1 --2- 172.21.15.2:0/2192326131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cdcd10370 0x560cdcd0d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:23:38.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.700+0000 7f885a101640 1 --2- 172.21.15.2:0/2192326131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cdcd06b40 0x560cdcd0cfd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8850010ad0 tx=0x7f8850010f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9499fe35419b3ff0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:38.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.700+0000 7f883dffb640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-19T06:23:38.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.700+0000 7f883dffb640 1 -- 172.21.15.2:0/2192326131 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f885000fe30 con 0x560cdcd06b40 2024-09-19T06:23:38.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.700+0000 7f883dffb640 1 -- 172.21.15.2:0/2192326131 <== mon.1 v2:172.21.15.90:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f88500193c0 con 0x560cdcd06b40 2024-09-19T06:23:38.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.700+0000 7f885e73e740 1 -- 172.21.15.2:0/2192326131 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8844032d60 con 0x560cdcd06b40 2024-09-19T06:23:38.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.701+0000 7f883dffb640 1 -- 172.21.15.2:0/2192326131 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f88500195c0 con 0x560cdcd06b40 2024-09-19T06:23:38.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.701+0000 7f885e73e740 10 client.27328 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:38.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.701+0000 7f885e73e740 1 -- 172.21.15.2:0/2192326131 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560cdcd1eaa0 con 0x560cdcd06b40 2024-09-19T06:23:38.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.701+0000 7f883dffb640 1 -- 172.21.15.2:0/2192326131 <== mon.1 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8844032d60 con 0x560cdcd06b40 2024-09-19T06:23:38.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.701+0000 7f883dffb640 1 -- 172.21.15.2:0/2192326131 <== mon.1 v2:172.21.15.90:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f885001a850 con 0x560cdcd06b40 2024-09-19T06:23:38.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.701+0000 7f885e73e740 10 client.27328 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:38.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.701+0000 7f885e73e740 10 client.27328 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:23:38.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.701+0000 7f885e73e740 20 client.27328 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:38.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.701+0000 7f885e73e740 1 --2- 172.21.15.2:0/2192326131 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x560cdcd20000 0x560cdcd22420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:38.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.701+0000 7f885e73e740 4 client.27328 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:23:38.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.701+0000 7f885e73e740 1 -- 172.21.15.2:0/2192326131 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560cdcc78860 con 0x560cdcd20000 2024-09-19T06:23:38.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.701+0000 7f8859900640 1 --2- 172.21.15.2:0/2192326131 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x560cdcd20000 0x560cdcd22420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:38.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.702+0000 7f8859900640 1 --2- 172.21.15.2:0/2192326131 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x560cdcd20000 0x560cdcd22420 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6a0d4252f0c75a05 server_cookie=e52f0d225355ef0c in_seq=0 out_seq=0 2024-09-19T06:23:38.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.702+0000 7f883dffb640 10 client.27328 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:23:38.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.702+0000 7f883dffb640 1 -- 172.21.15.2:0/2192326131 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560cdcc78860 con 0x560cdcd20000 2024-09-19T06:23:38.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.702+0000 7f883dffb640 10 client.27328 handle_command_reply: tid=0 2024-09-19T06:23:38.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.702+0000 7f885e73e740 1 client.27328 shutdown 2024-09-19T06:23:38.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.703+0000 7f885e73e740 1 -- 172.21.15.2:0/2192326131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cdcd06b40 msgr2=0x560cdcd0cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:38.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.703+0000 7f885e73e740 1 --2- 172.21.15.2:0/2192326131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cdcd06b40 0x560cdcd0cfd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8850010ad0 tx=0x7f8850010f90 comp rx=0 tx=0).stop 2024-09-19T06:23:38.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.703+0000 7f885e73e740 1 -- 172.21.15.2:0/2192326131 shutdown_connections 2024-09-19T06:23:38.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.703+0000 7f885e73e740 1 --2- 172.21.15.2:0/2192326131 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x560cdcd20000 0x560cdcd22420 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.703+0000 7f885e73e740 1 --2- 172.21.15.2:0/2192326131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cdcd10370 0x560cdcd0d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.703+0000 7f885e73e740 1 --2- 172.21.15.2:0/2192326131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cdcd06b40 0x560cdcd0cfd0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.703+0000 7f883dffb640 0 client.27328 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:23:38.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.703+0000 7f885e73e740 1 --2- 172.21.15.2:0/2192326131 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cdcd055d0 0x560cdcd0fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.703+0000 7f885e73e740 1 -- 172.21.15.2:0/2192326131 >> 172.21.15.2:0/2192326131 conn(0x560cdccce310 msgr2=0x560cdcd079c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:38.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.703+0000 7f885e73e740 1 -- 172.21.15.2:0/2192326131 shutdown_connections 2024-09-19T06:23:38.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.703+0000 7f885e73e740 1 -- 172.21.15.2:0/2192326131 wait complete. 2024-09-19T06:23:38.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.703+0000 7f885e73e740 20 client.27328 trim_cache size 0 max 16384 2024-09-19T06:23:38.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.715+0000 7f885e73e740 1 Processor -- start 2024-09-19T06:23:38.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.716+0000 7f885e73e740 1 -- start start 2024-09-19T06:23:38.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.716+0000 7f885e73e740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cdcd055d0 0x560cdcd1c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:38.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.716+0000 7f885e73e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cdcd06b40 0x560cdcd08120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:38.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.716+0000 7f885e73e740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cdcd10370 0x560cdcd08660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:38.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.716+0000 7f885e73e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f88541b2350 con 0x560cdcd06b40 2024-09-19T06:23:38.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.716+0000 7f885e73e740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f88541afc20 con 0x560cdcd10370 2024-09-19T06:23:38.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.716+0000 7f885e73e740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f88541ada90 con 0x560cdcd055d0 2024-09-19T06:23:38.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.716+0000 7f885a101640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cdcd06b40 0x560cdcd08120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:38.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.716+0000 7f885a101640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cdcd06b40 0x560cdcd08120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46558/0 (socket says 172.21.15.2:46558) 2024-09-19T06:23:38.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.716+0000 7f885a101640 1 -- 172.21.15.2:0/128065141 learned_addr learned my addr 172.21.15.2:0/128065141 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:38.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.716+0000 7f8859900640 1 --2- 172.21.15.2:0/128065141 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cdcd055d0 0x560cdcd1c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:38.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.716+0000 7f8859900640 1 --2- 172.21.15.2:0/128065141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cdcd10370 0x560cdcd08660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:38.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.716+0000 7f885a101640 1 -- 172.21.15.2:0/128065141 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cdcd055d0 msgr2=0x560cdcd1c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:38.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.716+0000 7f885a101640 1 --2- 172.21.15.2:0/128065141 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cdcd055d0 0x560cdcd1c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.716+0000 7f885a101640 1 -- 172.21.15.2:0/128065141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cdcd10370 msgr2=0x560cdcd08660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:38.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.716+0000 7f885a101640 1 --2- 172.21.15.2:0/128065141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cdcd10370 0x560cdcd08660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.716+0000 7f885a101640 1 -- 172.21.15.2:0/128065141 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cdcd08ba0 con 0x560cdcd06b40 2024-09-19T06:23:38.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.716+0000 7f885a101640 1 --2- 172.21.15.2:0/128065141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cdcd06b40 0x560cdcd08120 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f885001aeb0 tx=0x7f885000f8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccaacb548f6e665a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:38.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.717+0000 7f883ffff640 1 -- 172.21.15.2:0/128065141 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f885000fe30 con 0x560cdcd06b40 2024-09-19T06:23:38.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.717+0000 7f883ffff640 1 -- 172.21.15.2:0/128065141 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f885001a420 con 0x560cdcd06b40 2024-09-19T06:23:38.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.717+0000 7f883ffff640 1 -- 172.21.15.2:0/128065141 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8850019760 con 0x560cdcd06b40 2024-09-19T06:23:38.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.717+0000 7f885e73e740 1 -- 172.21.15.2:0/128065141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cdcd06b40 msgr2=0x560cdcd08120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:38.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.717+0000 7f885e73e740 1 --2- 172.21.15.2:0/128065141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cdcd06b40 0x560cdcd08120 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f885001aeb0 tx=0x7f885000f8b0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.717+0000 7f885e73e740 1 -- 172.21.15.2:0/128065141 shutdown_connections 2024-09-19T06:23:38.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.717+0000 7f885e73e740 1 --2- 172.21.15.2:0/128065141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cdcd10370 0x560cdcd08660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.717+0000 7f885e73e740 1 --2- 172.21.15.2:0/128065141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cdcd06b40 0x560cdcd08120 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.717+0000 7f885e73e740 1 --2- 172.21.15.2:0/128065141 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cdcd055d0 0x560cdcd1c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.717+0000 7f885e73e740 1 -- 172.21.15.2:0/128065141 >> 172.21.15.2:0/128065141 conn(0x560cdccce310 msgr2=0x560cdcd0c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:38.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.717+0000 7f885e73e740 1 -- 172.21.15.2:0/128065141 shutdown_connections 2024-09-19T06:23:38.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.717+0000 7f885e73e740 1 -- 172.21.15.2:0/128065141 wait complete. 2024-09-19T06:23:38.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.717+0000 7f885e73e740 1 -- start start 2024-09-19T06:23:38.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.718+0000 7f885e73e740 1 Processor -- start 2024-09-19T06:23:38.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.718+0000 7f885e73e740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cdcd055d0 0x560cdcd18af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:38.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.718+0000 7f885e73e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cdcd06b40 0x560cdcd13e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:38.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.718+0000 7f885e73e740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cdcd10370 0x560cdcd14360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:38.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.718+0000 7f885e73e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f88541ae0e0 con 0x560cdcd06b40 2024-09-19T06:23:38.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.718+0000 7f885e73e740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f88541af550 con 0x560cdcd055d0 2024-09-19T06:23:38.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.718+0000 7f885e73e740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f88541ae7b0 con 0x560cdcd10370 2024-09-19T06:23:38.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.718+0000 7f885e73e740 10 client.0 _ll_register_callbacks cb 0x7f8850007ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:38.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.718+0000 7f885a101640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cdcd06b40 0x560cdcd13e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:38.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.718+0000 7f8859900640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cdcd055d0 0x560cdcd18af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:38.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.718+0000 7f885a101640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cdcd06b40 0x560cdcd13e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46566/0 (socket says 172.21.15.2:46566) 2024-09-19T06:23:38.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.718+0000 7f885a101640 1 -- 172.21.15.2:0/798116683 learned_addr learned my addr 172.21.15.2:0/798116683 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:38.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.718+0000 7f8859900640 1 --2- 172.21.15.2:0/798116683 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cdcd10370 0x560cdcd14360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:38.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.718+0000 7f885a101640 1 -- 172.21.15.2:0/798116683 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cdcd10370 msgr2=0x560cdcd14360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:38.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.718+0000 7f885a101640 1 --2- 172.21.15.2:0/798116683 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cdcd10370 0x560cdcd14360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.718+0000 7f885a101640 1 -- 172.21.15.2:0/798116683 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cdcd055d0 msgr2=0x560cdcd18af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:38.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.718+0000 7f885a101640 1 --2- 172.21.15.2:0/798116683 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cdcd055d0 0x560cdcd18af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.718+0000 7f885a101640 1 -- 172.21.15.2:0/798116683 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cdcd14b90 con 0x560cdcd06b40 2024-09-19T06:23:38.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.719+0000 7f885a101640 1 --2- 172.21.15.2:0/798116683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cdcd06b40 0x560cdcd13e20 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f8850007950 tx=0x7f885001adc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=918267374a859d58 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:38.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.719+0000 7f883dffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:38.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.719+0000 7f883dffb640 1 -- 172.21.15.2:0/798116683 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8850019760 con 0x560cdcd06b40 2024-09-19T06:23:38.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.719+0000 7f883dffb640 1 -- 172.21.15.2:0/798116683 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f8850019900 con 0x560cdcd06b40 2024-09-19T06:23:38.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.719+0000 7f885e73e740 1 -- 172.21.15.2:0/798116683 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f885001a420 con 0x560cdcd06b40 2024-09-19T06:23:38.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.719+0000 7f883dffb640 1 -- 172.21.15.2:0/798116683 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f885003d050 con 0x560cdcd06b40 2024-09-19T06:23:38.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.719+0000 7f885e73e740 10 client.18411 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:38.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.719+0000 7f885e73e740 1 -- 172.21.15.2:0/798116683 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560cdcd8ac50 con 0x560cdcd06b40 2024-09-19T06:23:38.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.719+0000 7f883dffb640 1 -- 172.21.15.2:0/798116683 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f885001a420 con 0x560cdcd06b40 2024-09-19T06:23:38.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.719+0000 7f883dffb640 1 -- 172.21.15.2:0/798116683 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f8850029020 con 0x560cdcd06b40 2024-09-19T06:23:38.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.719+0000 7f885e73e740 10 client.18411 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:38.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.719+0000 7f885e73e740 10 client.18411 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:23:38.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.719+0000 7f885e73e740 20 client.18411 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:38.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.719+0000 7f885e73e740 1 --2- 172.21.15.2:0/798116683 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x560cdcd8b280 0x560cdcd8d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:38.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.719+0000 7f885e73e740 4 client.18411 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:23:38.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.719+0000 7f885e73e740 1 -- 172.21.15.2:0/798116683 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560cdcc72d70 con 0x560cdcd8b280 2024-09-19T06:23:38.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.720+0000 7f8859900640 1 --2- 172.21.15.2:0/798116683 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x560cdcd8b280 0x560cdcd8d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:38.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.720+0000 7f8859900640 1 --2- 172.21.15.2:0/798116683 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x560cdcd8b280 0x560cdcd8d6a0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c7f6fee0b1d5ebff server_cookie=f28caa8417eea116 in_seq=0 out_seq=0 2024-09-19T06:23:38.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.720+0000 7f883dffb640 10 client.18411 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:23:38.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.720+0000 7f883dffb640 1 -- 172.21.15.2:0/798116683 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560cdcc72d70 con 0x560cdcd8b280 2024-09-19T06:23:38.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.720+0000 7f883dffb640 10 client.18411 handle_command_reply: tid=0 2024-09-19T06:23:38.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.720+0000 7f885e73e740 1 client.18411 shutdown 2024-09-19T06:23:38.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.720+0000 7f885e73e740 1 -- 172.21.15.2:0/798116683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cdcd06b40 msgr2=0x560cdcd13e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:38.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.720+0000 7f885e73e740 1 --2- 172.21.15.2:0/798116683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cdcd06b40 0x560cdcd13e20 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f8850007950 tx=0x7f885001adc0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.720+0000 7f885e73e740 1 -- 172.21.15.2:0/798116683 shutdown_connections 2024-09-19T06:23:38.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.720+0000 7f885e73e740 1 --2- 172.21.15.2:0/798116683 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x560cdcd8b280 0x560cdcd8d6a0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.720+0000 7f885e73e740 1 --2- 172.21.15.2:0/798116683 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560cdcd10370 0x560cdcd14360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.720+0000 7f885e73e740 1 --2- 172.21.15.2:0/798116683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560cdcd06b40 0x560cdcd13e20 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.720+0000 7f885e73e740 1 --2- 172.21.15.2:0/798116683 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560cdcd055d0 0x560cdcd18af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.720+0000 7f883dffb640 0 client.18411 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:23:38.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.720+0000 7f885e73e740 1 -- 172.21.15.2:0/798116683 >> 172.21.15.2:0/798116683 conn(0x560cdccce310 msgr2=0x560cdcd0e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:38.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.721+0000 7f885e73e740 1 -- 172.21.15.2:0/798116683 shutdown_connections 2024-09-19T06:23:38.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.721+0000 7f885e73e740 1 -- 172.21.15.2:0/798116683 wait complete. 2024-09-19T06:23:38.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.721+0000 7f885e73e740 20 client.18411 trim_cache size 0 max 16384 2024-09-19T06:23:38.728 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:23:38.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.721+0000 7f885c365640 1 -- 172.21.15.2:0/4041341709 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f88400a3430 msgr2=0x7f88400a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:38.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.721+0000 7f885c365640 1 --2- 172.21.15.2:0/4041341709 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f88400a3430 0x7f88400a58f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f884c0cd300 tx=0x7f884c066880 comp rx=0 tx=0).stop 2024-09-19T06:23:38.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.721+0000 7f885c365640 1 -- 172.21.15.2:0/4041341709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88541082a0 msgr2=0x7f8854101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:38.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.721+0000 7f885c365640 1 --2- 172.21.15.2:0/4041341709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88541082a0 0x7f8854101410 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f884c00c970 tx=0x7f884c00ce30 comp rx=0 tx=0).stop 2024-09-19T06:23:38.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.721+0000 7f885c365640 1 -- 172.21.15.2:0/4041341709 shutdown_connections 2024-09-19T06:23:38.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.721+0000 7f885c365640 1 --2- 172.21.15.2:0/4041341709 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f88400a3430 0x7f88400a58f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.721+0000 7f885c365640 1 --2- 172.21.15.2:0/4041341709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88541082a0 0x7f8854101410 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.721+0000 7f885c365640 1 --2- 172.21.15.2:0/4041341709 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88541036e0 0x7f8854100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.721+0000 7f885c365640 1 --2- 172.21.15.2:0/4041341709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8854102d30 0x7f8854100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.721+0000 7f885c365640 1 -- 172.21.15.2:0/4041341709 >> 172.21.15.2:0/4041341709 conn(0x7f88540fc7d0 msgr2=0x7f8854105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:38.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.721+0000 7f885c365640 1 -- 172.21.15.2:0/4041341709 shutdown_connections 2024-09-19T06:23:38.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:38.721+0000 7f885c365640 1 -- 172.21.15.2:0/4041341709 wait complete. 2024-09-19T06:23:39.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:39 smithi002 ceph-mon[30982]: pgmap v274: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:23:39.428 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:23:39.490 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:39 smithi090 ceph-mon[34497]: pgmap v274: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:23:39.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:39 smithi089 ceph-mon[34160]: pgmap v274: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:23:39.686 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:23:40.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.192+0000 7fd2981cd640 1 -- 172.21.15.2:0/1616325593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd290106f10 msgr2=0x7fd29010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:40.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.192+0000 7fd2981cd640 1 --2- 172.21.15.2:0/1616325593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd290106f10 0x7fd29010ea90 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fd288009ca0 tx=0x7fd28802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.192+0000 7fd2981cd640 1 -- 172.21.15.2:0/1616325593 shutdown_connections 2024-09-19T06:23:40.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.192+0000 7fd2981cd640 1 --2- 172.21.15.2:0/1616325593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd290106f10 0x7fd29010ea90 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.192+0000 7fd2981cd640 1 --2- 172.21.15.2:0/1616325593 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd290102790 0x7fd2901067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.192+0000 7fd2981cd640 1 --2- 172.21.15.2:0/1616325593 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd290101de0 0x7fd2901021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.192+0000 7fd2981cd640 1 -- 172.21.15.2:0/1616325593 >> 172.21.15.2:0/1616325593 conn(0x7fd2900fd8c0 msgr2=0x7fd2900ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:40.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.192+0000 7fd2981cd640 1 -- 172.21.15.2:0/1616325593 shutdown_connections 2024-09-19T06:23:40.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.192+0000 7fd2981cd640 1 -- 172.21.15.2:0/1616325593 wait complete. 2024-09-19T06:23:40.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.192+0000 7fd2981cd640 1 Processor -- start 2024-09-19T06:23:40.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.192+0000 7fd2981cd640 1 -- start start 2024-09-19T06:23:40.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.193+0000 7fd2981cd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd290101de0 0x7fd290198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:40.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.193+0000 7fd2981cd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd290102790 0x7fd290198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:40.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.193+0000 7fd2981cd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd290106f10 0x7fd29019cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:40.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.193+0000 7fd2981cd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd290111e70 con 0x7fd290101de0 2024-09-19T06:23:40.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.193+0000 7fd2981cd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd290111cf0 con 0x7fd290106f10 2024-09-19T06:23:40.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.193+0000 7fd2981cd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd290111ff0 con 0x7fd290102790 2024-09-19T06:23:40.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.193+0000 7fd295f69640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd290101de0 0x7fd290198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:40.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.193+0000 7fd295f69640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd290101de0 0x7fd290198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46596/0 (socket says 172.21.15.2:46596) 2024-09-19T06:23:40.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.193+0000 7fd295f69640 1 -- 172.21.15.2:0/173423469 learned_addr learned my addr 172.21.15.2:0/173423469 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:40.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.193+0000 7fd295768640 1 --2- 172.21.15.2:0/173423469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd290102790 0x7fd290198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:40.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.193+0000 7fd29676a640 1 --2- 172.21.15.2:0/173423469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd290106f10 0x7fd29019cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:40.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.193+0000 7fd295f69640 1 -- 172.21.15.2:0/173423469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd290102790 msgr2=0x7fd290198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:40.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.193+0000 7fd295f69640 1 --2- 172.21.15.2:0/173423469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd290102790 0x7fd290198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.193+0000 7fd295f69640 1 -- 172.21.15.2:0/173423469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd290106f10 msgr2=0x7fd29019cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:40.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.193+0000 7fd295f69640 1 --2- 172.21.15.2:0/173423469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd290106f10 0x7fd29019cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.193+0000 7fd295f69640 1 -- 172.21.15.2:0/173423469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd29019d2e0 con 0x7fd290101de0 2024-09-19T06:23:40.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.193+0000 7fd29676a640 1 --2- 172.21.15.2:0/173423469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd290106f10 0x7fd29019cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:40.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.193+0000 7fd295f69640 1 --2- 172.21.15.2:0/173423469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd290101de0 0x7fd290198330 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fd28c00d950 tx=0x7fd28c00dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:40.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.193+0000 7fd286ffd640 1 -- 172.21.15.2:0/173423469 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd28c017030 con 0x7fd290101de0 2024-09-19T06:23:40.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.194+0000 7fd2981cd640 1 -- 172.21.15.2:0/173423469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd29019d5d0 con 0x7fd290101de0 2024-09-19T06:23:40.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.194+0000 7fd286ffd640 1 -- 172.21.15.2:0/173423469 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd28c004020 con 0x7fd290101de0 2024-09-19T06:23:40.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.194+0000 7fd286ffd640 1 -- 172.21.15.2:0/173423469 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd28c005570 con 0x7fd290101de0 2024-09-19T06:23:40.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.194+0000 7fd2981cd640 1 -- 172.21.15.2:0/173423469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2901a4eb0 con 0x7fd290101de0 2024-09-19T06:23:40.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.196+0000 7fd286ffd640 1 -- 172.21.15.2:0/173423469 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fd28c0041d0 con 0x7fd290101de0 2024-09-19T06:23:40.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.196+0000 7fd29a5a6740 1 Processor -- start 2024-09-19T06:23:40.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.197+0000 7fd29a5a6740 1 -- start start 2024-09-19T06:23:40.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.197+0000 7fd29a5a6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fca8957b40 0x55fca8956090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:40.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.197+0000 7fd29a5a6740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fca89565d0 0x55fca8956a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:40.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.197+0000 7fd29a5a6740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fca8961370 0x55fca8963760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:40.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.197+0000 7fd29a5a6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fca88bc2f0 con 0x55fca8957b40 2024-09-19T06:23:40.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.197+0000 7fd29a5a6740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55fca8863cf0 con 0x55fca8961370 2024-09-19T06:23:40.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.197+0000 7fd29a5a6740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55fca88b82b0 con 0x55fca89565d0 2024-09-19T06:23:40.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.197+0000 7fd29676a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fca8957b40 0x55fca8956090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:40.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.197+0000 7fd29676a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fca8957b40 0x55fca8956090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46608/0 (socket says 172.21.15.2:46608) 2024-09-19T06:23:40.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.197+0000 7fd29676a640 1 -- 172.21.15.2:0/1651273123 learned_addr learned my addr 172.21.15.2:0/1651273123 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:40.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.197+0000 7fd286ffd640 1 --2- 172.21.15.2:0/173423469 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fd27c0a33b0 0x7fd27c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:40.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.197+0000 7fd295768640 1 --2- 172.21.15.2:0/1651273123 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fca8961370 0x55fca8963760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:40.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.197+0000 7fd295f69640 1 --2- 172.21.15.2:0/1651273123 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fca89565d0 0x55fca8956a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:40.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.197+0000 7fd29676a640 1 --2- 172.21.15.2:0/173423469 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fd27c0a33b0 0x7fd27c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:40.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.198+0000 7fd29676a640 1 -- 172.21.15.2:0/1651273123 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fca89565d0 msgr2=0x55fca8956a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:40.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.198+0000 7fd286ffd640 1 -- 172.21.15.2:0/173423469 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7fd28c0cf6f0 con 0x7fd290101de0 2024-09-19T06:23:40.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.198+0000 7fd29676a640 1 --2- 172.21.15.2:0/1651273123 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fca89565d0 0x55fca8956a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.198+0000 7fd29676a640 1 -- 172.21.15.2:0/1651273123 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fca8961370 msgr2=0x55fca8963760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:40.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.198+0000 7fd29676a640 1 --2- 172.21.15.2:0/1651273123 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fca8961370 0x55fca8963760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.198+0000 7fd29676a640 1 -- 172.21.15.2:0/1651273123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fca88483a0 con 0x55fca8957b40 2024-09-19T06:23:40.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.198+0000 7fd29676a640 1 --2- 172.21.15.2:0/1651273123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fca8957b40 0x55fca8956090 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fd288035000 tx=0x7fd288031600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd57e55475c5fb75 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:40.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.198+0000 7fd27bfff640 1 -- 172.21.15.2:0/1651273123 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd288004d40 con 0x55fca8957b40 2024-09-19T06:23:40.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.198+0000 7fd27bfff640 1 -- 172.21.15.2:0/1651273123 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd28804e070 con 0x55fca8957b40 2024-09-19T06:23:40.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.198+0000 7fd27bfff640 1 -- 172.21.15.2:0/1651273123 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd288030800 con 0x55fca8957b40 2024-09-19T06:23:40.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.198+0000 7fd29676a640 1 --2- 172.21.15.2:0/173423469 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fd27c0a33b0 0x7fd27c0a5870 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd28804d000 tx=0x7fd28804b000 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:40.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.199+0000 7fd29a5a6740 1 -- 172.21.15.2:0/1651273123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fca8957b40 msgr2=0x55fca8956090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:40.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.199+0000 7fd29a5a6740 1 --2- 172.21.15.2:0/1651273123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fca8957b40 0x55fca8956090 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fd288035000 tx=0x7fd288031600 comp rx=0 tx=0).stop 2024-09-19T06:23:40.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.199+0000 7fd29a5a6740 1 -- 172.21.15.2:0/1651273123 shutdown_connections 2024-09-19T06:23:40.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.199+0000 7fd29a5a6740 1 --2- 172.21.15.2:0/1651273123 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fca8961370 0x55fca8963760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.199+0000 7fd29a5a6740 1 --2- 172.21.15.2:0/1651273123 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fca89565d0 0x55fca8956a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.199+0000 7fd29a5a6740 1 --2- 172.21.15.2:0/1651273123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fca8957b40 0x55fca8956090 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.199+0000 7fd29a5a6740 1 -- 172.21.15.2:0/1651273123 >> 172.21.15.2:0/1651273123 conn(0x55fca891f310 msgr2=0x55fca8952c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:40.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.199+0000 7fd29a5a6740 1 -- 172.21.15.2:0/1651273123 shutdown_connections 2024-09-19T06:23:40.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.199+0000 7fd29a5a6740 1 -- 172.21.15.2:0/1651273123 wait complete. 2024-09-19T06:23:40.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.199+0000 7fd29a5a6740 1 -- start start 2024-09-19T06:23:40.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.199+0000 7fd29a5a6740 1 Processor -- start 2024-09-19T06:23:40.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.200+0000 7fd29a5a6740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fca89565d0 0x55fca8960d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:40.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.200+0000 7fd29a5a6740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fca8957b40 0x55fca895e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:40.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.200+0000 7fd29a5a6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fca8961370 0x55fca895e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:40.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.200+0000 7fd29a5a6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fca8964070 con 0x55fca8961370 2024-09-19T06:23:40.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.200+0000 7fd29a5a6740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55fca8877060 con 0x55fca8957b40 2024-09-19T06:23:40.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.200+0000 7fd29a5a6740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55fca89641f0 con 0x55fca89565d0 2024-09-19T06:23:40.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.200+0000 7fd29a5a6740 10 client.0 _ll_register_callbacks cb 0x55fca85ca8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:40.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.200+0000 7fd29676a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fca8961370 0x55fca895e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:40.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.200+0000 7fd29676a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fca8961370 0x55fca895e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46620/0 (socket says 172.21.15.2:46620) 2024-09-19T06:23:40.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.200+0000 7fd29676a640 1 -- 172.21.15.2:0/1246314711 learned_addr learned my addr 172.21.15.2:0/1246314711 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:40.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.200+0000 7fd295f69640 1 --2- 172.21.15.2:0/1246314711 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fca89565d0 0x55fca8960d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:40.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.200+0000 7fd295768640 1 --2- 172.21.15.2:0/1246314711 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fca8957b40 0x55fca895e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:40.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.200+0000 7fd29676a640 1 -- 172.21.15.2:0/1246314711 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fca89565d0 msgr2=0x55fca8960d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:40.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.200+0000 7fd29676a640 1 --2- 172.21.15.2:0/1246314711 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fca89565d0 0x55fca8960d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.200+0000 7fd29676a640 1 -- 172.21.15.2:0/1246314711 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fca8957b40 msgr2=0x55fca895e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:40.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.200+0000 7fd29676a640 1 --2- 172.21.15.2:0/1246314711 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fca8957b40 0x55fca895e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.200+0000 7fd29676a640 1 -- 172.21.15.2:0/1246314711 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fca862d3c0 con 0x55fca8961370 2024-09-19T06:23:40.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.201+0000 7fd29676a640 1 --2- 172.21.15.2:0/1246314711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fca8961370 0x55fca895e600 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fd28802a900 tx=0x7fd288004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=849852e9c677c78c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:40.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.201+0000 7fd2797fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:40.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.201+0000 7fd2797fa640 1 -- 172.21.15.2:0/1246314711 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2880307d0 con 0x55fca8961370 2024-09-19T06:23:40.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.201+0000 7fd2797fa640 1 -- 172.21.15.2:0/1246314711 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7fd288004b40 con 0x55fca8961370 2024-09-19T06:23:40.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.201+0000 7fd29a5a6740 1 -- 172.21.15.2:0/1246314711 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd28804e070 con 0x55fca8961370 2024-09-19T06:23:40.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.201+0000 7fd2797fa640 1 -- 172.21.15.2:0/1246314711 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd288004d40 con 0x55fca8961370 2024-09-19T06:23:40.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.201+0000 7fd29a5a6740 10 client.18423 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:40.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.201+0000 7fd29a5a6740 1 -- 172.21.15.2:0/1246314711 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55fca8964070 con 0x55fca8961370 2024-09-19T06:23:40.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.201+0000 7fd2797fa640 1 -- 172.21.15.2:0/1246314711 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd28804e070 con 0x55fca8961370 2024-09-19T06:23:40.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.201+0000 7fd2797fa640 1 -- 172.21.15.2:0/1246314711 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fd288004530 con 0x55fca8961370 2024-09-19T06:23:40.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.201+0000 7fd29a5a6740 10 client.18423 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:40.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.201+0000 7fd29a5a6740 10 client.18423 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:40.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.201+0000 7fd29a5a6740 20 client.18423 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:40.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.202+0000 7fd29a5a6740 1 --2- 172.21.15.2:0/1246314711 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55fca8970c90 0x55fca8973080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:40.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.202+0000 7fd29a5a6740 4 client.18423 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:23:40.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.202+0000 7fd29a5a6740 1 -- 172.21.15.2:0/1246314711 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fca88c9860 con 0x55fca8970c90 2024-09-19T06:23:40.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.202+0000 7fd295f69640 1 --2- 172.21.15.2:0/1246314711 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55fca8970c90 0x55fca8973080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:40.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.202+0000 7fd295f69640 1 --2- 172.21.15.2:0/1246314711 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55fca8970c90 0x55fca8973080 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef2db2cb05b75727 server_cookie=6ebf35935bb1b0fb in_seq=0 out_seq=0 2024-09-19T06:23:40.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.202+0000 7fd2797fa640 10 client.18423 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:40.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.203+0000 7fd2797fa640 1 -- 172.21.15.2:0/1246314711 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fca88c9860 con 0x55fca8970c90 2024-09-19T06:23:40.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.203+0000 7fd2797fa640 10 client.18423 handle_command_reply: tid=0 2024-09-19T06:23:40.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.203+0000 7fd29a5a6740 1 client.18423 shutdown 2024-09-19T06:23:40.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.203+0000 7fd29a5a6740 1 -- 172.21.15.2:0/1246314711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fca8961370 msgr2=0x55fca895e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:40.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.203+0000 7fd29a5a6740 1 --2- 172.21.15.2:0/1246314711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fca8961370 0x55fca895e600 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fd28802a900 tx=0x7fd288004950 comp rx=0 tx=0).stop 2024-09-19T06:23:40.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.203+0000 7fd29a5a6740 1 -- 172.21.15.2:0/1246314711 shutdown_connections 2024-09-19T06:23:40.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.203+0000 7fd29a5a6740 1 --2- 172.21.15.2:0/1246314711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fca8961370 0x55fca895e600 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.203+0000 7fd29a5a6740 1 --2- 172.21.15.2:0/1246314711 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55fca8970c90 0x55fca8973080 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.203+0000 7fd29a5a6740 1 --2- 172.21.15.2:0/1246314711 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fca8957b40 0x55fca895e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.203+0000 7fd2797fa640 0 client.18423 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:40.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.203+0000 7fd29a5a6740 1 --2- 172.21.15.2:0/1246314711 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fca89565d0 0x55fca8960d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.203+0000 7fd29a5a6740 1 -- 172.21.15.2:0/1246314711 >> 172.21.15.2:0/1246314711 conn(0x55fca891f310 msgr2=0x55fca8958960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:40.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.203+0000 7fd29a5a6740 1 -- 172.21.15.2:0/1246314711 shutdown_connections 2024-09-19T06:23:40.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.203+0000 7fd29a5a6740 1 -- 172.21.15.2:0/1246314711 wait complete. 2024-09-19T06:23:40.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.203+0000 7fd29a5a6740 20 client.18423 trim_cache size 0 max 16384 2024-09-19T06:23:40.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.216+0000 7fd29a5a6740 1 Processor -- start 2024-09-19T06:23:40.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.217+0000 7fd29a5a6740 1 -- start start 2024-09-19T06:23:40.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.217+0000 7fd29a5a6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fca89565d0 0x55fca8960340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:40.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.217+0000 7fd29a5a6740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fca8957b40 0x55fca8959120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:40.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.217+0000 7fd29a5a6740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fca8961370 0x55fca8959660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:40.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.217+0000 7fd29a5a6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd2901b0030 con 0x55fca89565d0 2024-09-19T06:23:40.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.217+0000 7fd29a5a6740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd2901ad900 con 0x55fca8961370 2024-09-19T06:23:40.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.217+0000 7fd29a5a6740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd2901ab770 con 0x55fca8957b40 2024-09-19T06:23:40.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.217+0000 7fd295f69640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fca89565d0 0x55fca8960340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:40.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.217+0000 7fd295f69640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fca89565d0 0x55fca8960340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46630/0 (socket says 172.21.15.2:46630) 2024-09-19T06:23:40.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.217+0000 7fd295f69640 1 -- 172.21.15.2:0/489481939 learned_addr learned my addr 172.21.15.2:0/489481939 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:40.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.217+0000 7fd29676a640 1 --2- 172.21.15.2:0/489481939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fca8961370 0x55fca8959660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:40.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.217+0000 7fd295768640 1 --2- 172.21.15.2:0/489481939 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fca8957b40 0x55fca8959120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:40.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.217+0000 7fd295f69640 1 -- 172.21.15.2:0/489481939 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fca8957b40 msgr2=0x55fca8959120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:40.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.217+0000 7fd295f69640 1 --2- 172.21.15.2:0/489481939 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fca8957b40 0x55fca8959120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.217+0000 7fd295f69640 1 -- 172.21.15.2:0/489481939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fca8961370 msgr2=0x55fca8959660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:40.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.217+0000 7fd295f69640 1 --2- 172.21.15.2:0/489481939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fca8961370 0x55fca8959660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.217+0000 7fd295f69640 1 -- 172.21.15.2:0/489481939 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fca89610d0 con 0x55fca89565d0 2024-09-19T06:23:40.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.217+0000 7fd29676a640 1 --2- 172.21.15.2:0/489481939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fca8961370 0x55fca8959660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:40.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.217+0000 7fd295f69640 1 --2- 172.21.15.2:0/489481939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fca89565d0 0x55fca8960340 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fd28c097e30 tx=0x7fd28c086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c81edef9a51aace server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:40.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.218+0000 7fd27b7fe640 1 -- 172.21.15.2:0/489481939 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd28c09b9d0 con 0x55fca89565d0 2024-09-19T06:23:40.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.218+0000 7fd27b7fe640 1 -- 172.21.15.2:0/489481939 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd28c09fd80 con 0x55fca89565d0 2024-09-19T06:23:40.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.218+0000 7fd27b7fe640 1 -- 172.21.15.2:0/489481939 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd28c098040 con 0x55fca89565d0 2024-09-19T06:23:40.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.218+0000 7fd29a5a6740 1 -- 172.21.15.2:0/489481939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fca89565d0 msgr2=0x55fca8960340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:40.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.218+0000 7fd29a5a6740 1 --2- 172.21.15.2:0/489481939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fca89565d0 0x55fca8960340 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fd28c097e30 tx=0x7fd28c086040 comp rx=0 tx=0).stop 2024-09-19T06:23:40.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.218+0000 7fd29a5a6740 1 -- 172.21.15.2:0/489481939 shutdown_connections 2024-09-19T06:23:40.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.218+0000 7fd29a5a6740 1 --2- 172.21.15.2:0/489481939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fca8961370 0x55fca8959660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.218+0000 7fd29a5a6740 1 --2- 172.21.15.2:0/489481939 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fca8957b40 0x55fca8959120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.218+0000 7fd29a5a6740 1 --2- 172.21.15.2:0/489481939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fca89565d0 0x55fca8960340 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.218+0000 7fd29a5a6740 1 -- 172.21.15.2:0/489481939 >> 172.21.15.2:0/489481939 conn(0x55fca891f310 msgr2=0x55fca8951d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:40.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.218+0000 7fd29a5a6740 1 -- 172.21.15.2:0/489481939 shutdown_connections 2024-09-19T06:23:40.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.218+0000 7fd29a5a6740 1 -- 172.21.15.2:0/489481939 wait complete. 2024-09-19T06:23:40.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.219+0000 7fd29a5a6740 1 -- start start 2024-09-19T06:23:40.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.219+0000 7fd29a5a6740 1 Processor -- start 2024-09-19T06:23:40.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.219+0000 7fd29a5a6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fca89565d0 0x55fca8969480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:40.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.219+0000 7fd29a5a6740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fca8957b40 0x55fca89699c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:40.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.219+0000 7fd29a5a6740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fca8961370 0x55fca8966450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:40.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.219+0000 7fd29a5a6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd2901abdc0 con 0x55fca89565d0 2024-09-19T06:23:40.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.219+0000 7fd29a5a6740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd2901ad230 con 0x55fca8961370 2024-09-19T06:23:40.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.219+0000 7fd29a5a6740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd2901ac490 con 0x55fca8957b40 2024-09-19T06:23:40.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.219+0000 7fd29a5a6740 10 client.0 _ll_register_callbacks cb 0x7fd28000a630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:40.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.219+0000 7fd295f69640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fca89565d0 0x55fca8969480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:40.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.219+0000 7fd295f69640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fca89565d0 0x55fca8969480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46636/0 (socket says 172.21.15.2:46636) 2024-09-19T06:23:40.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.219+0000 7fd295f69640 1 -- 172.21.15.2:0/3684081124 learned_addr learned my addr 172.21.15.2:0/3684081124 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:40.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.219+0000 7fd29676a640 1 --2- 172.21.15.2:0/3684081124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fca8961370 0x55fca8966450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:40.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.220+0000 7fd295768640 1 --2- 172.21.15.2:0/3684081124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fca8957b40 0x55fca89699c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:40.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.220+0000 7fd295f69640 1 -- 172.21.15.2:0/3684081124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fca8957b40 msgr2=0x55fca89699c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:40.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.220+0000 7fd295f69640 1 --2- 172.21.15.2:0/3684081124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fca8957b40 0x55fca89699c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.220+0000 7fd295f69640 1 -- 172.21.15.2:0/3684081124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fca8961370 msgr2=0x55fca8966450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:40.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.220+0000 7fd295f69640 1 --2- 172.21.15.2:0/3684081124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fca8961370 0x55fca8966450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.220+0000 7fd295f69640 1 -- 172.21.15.2:0/3684081124 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fca8966a40 con 0x55fca89565d0 2024-09-19T06:23:40.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.220+0000 7fd295f69640 1 --2- 172.21.15.2:0/3684081124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fca89565d0 0x55fca8969480 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fd28c0ccef0 tx=0x7fd28c00df90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=788b109181af0273 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:40.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.220+0000 7fd2797fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:40.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.220+0000 7fd2797fa640 1 -- 172.21.15.2:0/3684081124 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd28c0b3070 con 0x55fca89565d0 2024-09-19T06:23:40.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.220+0000 7fd2797fa640 1 -- 172.21.15.2:0/3684081124 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7fd28c098040 con 0x55fca89565d0 2024-09-19T06:23:40.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.220+0000 7fd29a5a6740 1 -- 172.21.15.2:0/3684081124 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd28c09fd80 con 0x55fca89565d0 2024-09-19T06:23:40.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.220+0000 7fd2797fa640 1 -- 172.21.15.2:0/3684081124 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd28c0a4640 con 0x55fca89565d0 2024-09-19T06:23:40.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.220+0000 7fd29a5a6740 10 client.18429 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:40.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.220+0000 7fd29a5a6740 1 -- 172.21.15.2:0/3684081124 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55fca89dc180 con 0x55fca89565d0 2024-09-19T06:23:40.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.220+0000 7fd2797fa640 1 -- 172.21.15.2:0/3684081124 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd28c09fd80 con 0x55fca89565d0 2024-09-19T06:23:40.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.221+0000 7fd2797fa640 1 -- 172.21.15.2:0/3684081124 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fd28c097720 con 0x55fca89565d0 2024-09-19T06:23:40.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.221+0000 7fd29a5a6740 10 client.18429 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:40.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.221+0000 7fd29a5a6740 10 client.18429 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:40.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.221+0000 7fd29a5a6740 20 client.18429 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:40.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.221+0000 7fd29a5a6740 1 --2- 172.21.15.2:0/3684081124 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55fca89dc8a0 0x55fca89dec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:40.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.221+0000 7fd29a5a6740 4 client.18429 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:23:40.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.221+0000 7fd29a5a6740 1 -- 172.21.15.2:0/3684081124 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fca88c3d70 con 0x55fca89dc8a0 2024-09-19T06:23:40.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.221+0000 7fd295768640 1 --2- 172.21.15.2:0/3684081124 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55fca89dc8a0 0x55fca89dec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:40.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.221+0000 7fd2797fa640 10 client.18429 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:40.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.221+0000 7fd295768640 1 --2- 172.21.15.2:0/3684081124 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55fca89dc8a0 0x55fca89dec90 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1016b929c752564c server_cookie=79fd873eff801a96 in_seq=0 out_seq=0 2024-09-19T06:23:40.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.222+0000 7fd2797fa640 1 -- 172.21.15.2:0/3684081124 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fca88c3d70 con 0x55fca89dc8a0 2024-09-19T06:23:40.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.222+0000 7fd2797fa640 10 client.18429 handle_command_reply: tid=0 2024-09-19T06:23:40.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.222+0000 7fd29a5a6740 1 client.18429 shutdown 2024-09-19T06:23:40.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.222+0000 7fd29a5a6740 1 -- 172.21.15.2:0/3684081124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fca89565d0 msgr2=0x55fca8969480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:40.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.222+0000 7fd29a5a6740 1 --2- 172.21.15.2:0/3684081124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fca89565d0 0x55fca8969480 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fd28c0ccef0 tx=0x7fd28c00df90 comp rx=0 tx=0).stop 2024-09-19T06:23:40.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.222+0000 7fd29a5a6740 1 -- 172.21.15.2:0/3684081124 shutdown_connections 2024-09-19T06:23:40.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.222+0000 7fd29a5a6740 1 --2- 172.21.15.2:0/3684081124 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55fca89dc8a0 0x55fca89dec90 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.222+0000 7fd29a5a6740 1 --2- 172.21.15.2:0/3684081124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fca8961370 0x55fca8966450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.222+0000 7fd29a5a6740 1 --2- 172.21.15.2:0/3684081124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fca8957b40 0x55fca89699c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.222+0000 7fd2797fa640 0 client.18429 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:40.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.222+0000 7fd29a5a6740 1 --2- 172.21.15.2:0/3684081124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fca89565d0 0x55fca8969480 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.222+0000 7fd29a5a6740 1 -- 172.21.15.2:0/3684081124 >> 172.21.15.2:0/3684081124 conn(0x55fca891f310 msgr2=0x55fca895d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:40.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.222+0000 7fd29a5a6740 1 -- 172.21.15.2:0/3684081124 shutdown_connections 2024-09-19T06:23:40.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.222+0000 7fd29a5a6740 1 -- 172.21.15.2:0/3684081124 wait complete. 2024-09-19T06:23:40.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.222+0000 7fd29a5a6740 20 client.18429 trim_cache size 0 max 16384 2024-09-19T06:23:40.229 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:23:40.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.223+0000 7fd2981cd640 1 -- 172.21.15.2:0/173423469 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fd27c0a33b0 msgr2=0x7fd27c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:40.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.223+0000 7fd2981cd640 1 --2- 172.21.15.2:0/173423469 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fd27c0a33b0 0x7fd27c0a5870 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd28804d000 tx=0x7fd28804b000 comp rx=0 tx=0).stop 2024-09-19T06:23:40.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.223+0000 7fd2981cd640 1 -- 172.21.15.2:0/173423469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd290101de0 msgr2=0x7fd290198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:40.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.223+0000 7fd2981cd640 1 --2- 172.21.15.2:0/173423469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd290101de0 0x7fd290198330 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fd28c00d950 tx=0x7fd28c00dd50 comp rx=0 tx=0).stop 2024-09-19T06:23:40.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.223+0000 7fd2981cd640 1 -- 172.21.15.2:0/173423469 shutdown_connections 2024-09-19T06:23:40.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.223+0000 7fd2981cd640 1 --2- 172.21.15.2:0/173423469 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fd27c0a33b0 0x7fd27c0a5870 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.223+0000 7fd2981cd640 1 --2- 172.21.15.2:0/173423469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd290106f10 0x7fd29019cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.223+0000 7fd2981cd640 1 --2- 172.21.15.2:0/173423469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd290102790 0x7fd290198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.223+0000 7fd2981cd640 1 --2- 172.21.15.2:0/173423469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd290101de0 0x7fd290198330 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.223+0000 7fd2981cd640 1 -- 172.21.15.2:0/173423469 >> 172.21.15.2:0/173423469 conn(0x7fd2900fd8c0 msgr2=0x7fd2900febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:40.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.223+0000 7fd2981cd640 1 -- 172.21.15.2:0/173423469 shutdown_connections 2024-09-19T06:23:40.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:40.223+0000 7fd2981cd640 1 -- 172.21.15.2:0/173423469 wait complete. 2024-09-19T06:23:41.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:41 smithi002 ceph-mon[30982]: pgmap v275: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:23:41.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:41 smithi090 ceph-mon[34497]: pgmap v275: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:23:41.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:41 smithi089 ceph-mon[34160]: pgmap v275: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:23:41.871 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:23:41.872 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:23:42.143 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:23:42.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.584+0000 7f47be39a640 1 -- 172.21.15.2:0/622037441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47b8100e20 msgr2=0x7f47b8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:42.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.584+0000 7f47be39a640 1 --2- 172.21.15.2:0/622037441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47b8100e20 0x7f47b8101200 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009900 tx=0x7f47a802a480 comp rx=0 tx=0).stop 2024-09-19T06:23:42.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.584+0000 7f47be39a640 1 -- 172.21.15.2:0/622037441 shutdown_connections 2024-09-19T06:23:42.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.584+0000 7f47be39a640 1 --2- 172.21.15.2:0/622037441 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47b8102ef0 0x7f47b810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.584+0000 7f47be39a640 1 --2- 172.21.15.2:0/622037441 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47b8102570 0x7f47b81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.584+0000 7f47be39a640 1 --2- 172.21.15.2:0/622037441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47b8100e20 0x7f47b8101200 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.584+0000 7f47be39a640 1 -- 172.21.15.2:0/622037441 >> 172.21.15.2:0/622037441 conn(0x7f47b80fc7d0 msgr2=0x7f47b80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:42.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.584+0000 7f47be39a640 1 -- 172.21.15.2:0/622037441 shutdown_connections 2024-09-19T06:23:42.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.584+0000 7f47be39a640 1 -- 172.21.15.2:0/622037441 wait complete. 2024-09-19T06:23:42.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.585+0000 7f47be39a640 1 Processor -- start 2024-09-19T06:23:42.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.585+0000 7f47be39a640 1 -- start start 2024-09-19T06:23:42.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.585+0000 7f47be39a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47b8100e20 0x7f47b8103750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:42.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.585+0000 7f47be39a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47b8102570 0x7f47b8103c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:42.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.585+0000 7f47be39a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47b8102ef0 0x7f47b81041d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:42.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.585+0000 7f47be39a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f47b8110e30 con 0x7f47b8102ef0 2024-09-19T06:23:42.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.585+0000 7f47be39a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f47b8110cb0 con 0x7f47b8102570 2024-09-19T06:23:42.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.585+0000 7f47be39a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f47b8110fb0 con 0x7f47b8100e20 2024-09-19T06:23:42.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.585+0000 7f47bc937640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47b8102ef0 0x7f47b81041d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:42.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.585+0000 7f47b7fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47b8100e20 0x7f47b8103750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:42.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.585+0000 7f47bc937640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47b8102ef0 0x7f47b81041d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46648/0 (socket says 172.21.15.2:46648) 2024-09-19T06:23:42.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.585+0000 7f47bc937640 1 -- 172.21.15.2:0/3104626703 learned_addr learned my addr 172.21.15.2:0/3104626703 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:42.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.585+0000 7f47b77fe640 1 --2- 172.21.15.2:0/3104626703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47b8102570 0x7f47b8103c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:42.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.586+0000 7f47bc937640 1 -- 172.21.15.2:0/3104626703 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47b8100e20 msgr2=0x7f47b8103750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:42.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.586+0000 7f47bc937640 1 --2- 172.21.15.2:0/3104626703 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47b8100e20 0x7f47b8103750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.586+0000 7f47bc937640 1 -- 172.21.15.2:0/3104626703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47b8102570 msgr2=0x7f47b8103c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:42.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.586+0000 7f47bc937640 1 --2- 172.21.15.2:0/3104626703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47b8102570 0x7f47b8103c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.586+0000 7f47bc937640 1 -- 172.21.15.2:0/3104626703 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b81a6810 con 0x7f47b8102ef0 2024-09-19T06:23:42.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.586+0000 7f47bc937640 1 --2- 172.21.15.2:0/3104626703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47b8102ef0 0x7f47b81041d0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f47b000cce0 tx=0x7f47b000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:42.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.586+0000 7f47b57fa640 1 -- 172.21.15.2:0/3104626703 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b000f450 con 0x7f47b8102ef0 2024-09-19T06:23:42.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.586+0000 7f47be39a640 1 -- 172.21.15.2:0/3104626703 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47b81a6b00 con 0x7f47b8102ef0 2024-09-19T06:23:42.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.586+0000 7f47b57fa640 1 -- 172.21.15.2:0/3104626703 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f47b000faa0 con 0x7f47b8102ef0 2024-09-19T06:23:42.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.586+0000 7f47b57fa640 1 -- 172.21.15.2:0/3104626703 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b0018b70 con 0x7f47b8102ef0 2024-09-19T06:23:42.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.586+0000 7f47be39a640 1 -- 172.21.15.2:0/3104626703 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47b81a7040 con 0x7f47b8102ef0 2024-09-19T06:23:42.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.588+0000 7f47c0773740 1 Processor -- start 2024-09-19T06:23:42.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.589+0000 7f47b57fa640 1 -- 172.21.15.2:0/3104626703 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f47b0018d10 con 0x7f47b8102ef0 2024-09-19T06:23:42.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.589+0000 7f47c0773740 1 -- start start 2024-09-19T06:23:42.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.589+0000 7f47c0773740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede17bb60 0x560ede17bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:42.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.589+0000 7f47c0773740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560ede17c480 0x560ede186800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:42.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.589+0000 7f47c0773740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede186d40 0x560ede189130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:42.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.589+0000 7f47c0773740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560ede0e1280 con 0x560ede17bb60 2024-09-19T06:23:42.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.589+0000 7f47c0773740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x560ede088b10 con 0x560ede186d40 2024-09-19T06:23:42.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.589+0000 7f47c0773740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560ede0dd240 con 0x560ede17c480 2024-09-19T06:23:42.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.589+0000 7f47b77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede17bb60 0x560ede17bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:42.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.589+0000 7f47b77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede17bb60 0x560ede17bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46656/0 (socket says 172.21.15.2:46656) 2024-09-19T06:23:42.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.589+0000 7f47b77fe640 1 -- 172.21.15.2:0/3498843422 learned_addr learned my addr 172.21.15.2:0/3498843422 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:42.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.589+0000 7f47b7fff640 1 --2- 172.21.15.2:0/3498843422 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560ede17c480 0x560ede186800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:42.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.589+0000 7f47b77fe640 1 --2- 172.21.15.2:0/3498843422 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede186d40 0x560ede189130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:42.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.589+0000 7f47b77fe640 1 -- 172.21.15.2:0/3498843422 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560ede17c480 msgr2=0x560ede186800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:42.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.589+0000 7f47b77fe640 1 --2- 172.21.15.2:0/3498843422 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560ede17c480 0x560ede186800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.589+0000 7f47b77fe640 1 -- 172.21.15.2:0/3498843422 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede186d40 msgr2=0x560ede189130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:42.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.589+0000 7f47b77fe640 1 --2- 172.21.15.2:0/3498843422 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede186d40 0x560ede189130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.589+0000 7f47b77fe640 1 -- 172.21.15.2:0/3498843422 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ede0951f0 con 0x560ede17bb60 2024-09-19T06:23:42.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.590+0000 7f47b57fa640 1 --2- 172.21.15.2:0/3104626703 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f47a00a33b0 0x7f47a00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:42.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.590+0000 7f47b7fff640 1 --2- 172.21.15.2:0/3104626703 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f47a00a33b0 0x7f47a00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:42.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.590+0000 7f47b77fe640 1 --2- 172.21.15.2:0/3498843422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede17bb60 0x560ede17bf40 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f47ac0058a0 tx=0x7f47ac00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd1cc0c2611285e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:42.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.590+0000 7f47b57fa640 1 -- 172.21.15.2:0/3104626703 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f47b00d0020 con 0x7f47b8102ef0 2024-09-19T06:23:42.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.590+0000 7f479e7fc640 1 -- 172.21.15.2:0/3498843422 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ac004030 con 0x560ede17bb60 2024-09-19T06:23:42.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.590+0000 7f479e7fc640 1 -- 172.21.15.2:0/3498843422 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f47ac0041d0 con 0x560ede17bb60 2024-09-19T06:23:42.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.590+0000 7f479e7fc640 1 -- 172.21.15.2:0/3498843422 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ac00f480 con 0x560ede17bb60 2024-09-19T06:23:42.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.591+0000 7f47c0773740 1 -- 172.21.15.2:0/3498843422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede17bb60 msgr2=0x560ede17bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:42.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.591+0000 7f47b7fff640 1 --2- 172.21.15.2:0/3104626703 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f47a00a33b0 0x7f47a00a5870 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009230 tx=0x7f47a80058d0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:42.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.591+0000 7f47c0773740 1 --2- 172.21.15.2:0/3498843422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede17bb60 0x560ede17bf40 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f47ac0058a0 tx=0x7f47ac00b840 comp rx=0 tx=0).stop 2024-09-19T06:23:42.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.591+0000 7f47c0773740 1 -- 172.21.15.2:0/3498843422 shutdown_connections 2024-09-19T06:23:42.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.591+0000 7f47c0773740 1 --2- 172.21.15.2:0/3498843422 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede186d40 0x560ede189130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.591+0000 7f47c0773740 1 --2- 172.21.15.2:0/3498843422 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560ede17c480 0x560ede186800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.591+0000 7f47c0773740 1 --2- 172.21.15.2:0/3498843422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede17bb60 0x560ede17bf40 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.591+0000 7f47c0773740 1 -- 172.21.15.2:0/3498843422 >> 172.21.15.2:0/3498843422 conn(0x560ede1780f0 msgr2=0x560ede1784d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:42.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.591+0000 7f47c0773740 1 -- 172.21.15.2:0/3498843422 shutdown_connections 2024-09-19T06:23:42.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.591+0000 7f47c0773740 1 -- 172.21.15.2:0/3498843422 wait complete. 2024-09-19T06:23:42.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.591+0000 7f47c0773740 1 -- start start 2024-09-19T06:23:42.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.591+0000 7f47c0773740 1 Processor -- start 2024-09-19T06:23:42.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.592+0000 7f47c0773740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede17bb60 0x560ede183be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:42.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.592+0000 7f47c0773740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560ede17c480 0x560ede184120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:42.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.592+0000 7f47c0773740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede186d40 0x560ede184660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:42.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.592+0000 7f47c0773740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560ede189910 con 0x560ede17bb60 2024-09-19T06:23:42.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.592+0000 7f47c0773740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x560ede09bf10 con 0x560ede186d40 2024-09-19T06:23:42.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.592+0000 7f47c0773740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560ede189a90 con 0x560ede17c480 2024-09-19T06:23:42.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.592+0000 7f47c0773740 10 client.0 _ll_register_callbacks cb 0x560ede064a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:42.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.592+0000 7f47b7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede17bb60 0x560ede183be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:42.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.592+0000 7f47b7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede17bb60 0x560ede183be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46670/0 (socket says 172.21.15.2:46670) 2024-09-19T06:23:42.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.592+0000 7f47b7fff640 1 -- 172.21.15.2:0/4130613174 learned_addr learned my addr 172.21.15.2:0/4130613174 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:42.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.592+0000 7f47b77fe640 1 --2- 172.21.15.2:0/4130613174 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560ede17c480 0x560ede184120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:42.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.592+0000 7f47bc937640 1 --2- 172.21.15.2:0/4130613174 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede186d40 0x560ede184660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:42.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.592+0000 7f47b7fff640 1 -- 172.21.15.2:0/4130613174 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560ede17c480 msgr2=0x560ede184120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:42.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.592+0000 7f47b7fff640 1 --2- 172.21.15.2:0/4130613174 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560ede17c480 0x560ede184120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.592+0000 7f47b7fff640 1 -- 172.21.15.2:0/4130613174 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede186d40 msgr2=0x560ede184660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:42.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.592+0000 7f47b7fff640 1 --2- 172.21.15.2:0/4130613174 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede186d40 0x560ede184660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.592+0000 7f47b7fff640 1 -- 172.21.15.2:0/4130613174 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560edde526a0 con 0x560ede17bb60 2024-09-19T06:23:42.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.592+0000 7f47b7fff640 1 --2- 172.21.15.2:0/4130613174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede17bb60 0x560ede183be0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f47a8031780 tx=0x7f47a8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c69b129ac37ce11 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:42.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.592+0000 7f47977fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:42.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.593+0000 7f47977fe640 1 -- 172.21.15.2:0/4130613174 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a804d070 con 0x560ede17bb60 2024-09-19T06:23:42.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.593+0000 7f47977fe640 1 -- 172.21.15.2:0/4130613174 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f47a8004460 con 0x560ede17bb60 2024-09-19T06:23:42.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.593+0000 7f47c0773740 1 -- 172.21.15.2:0/4130613174 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47ac0041d0 con 0x560ede17bb60 2024-09-19T06:23:42.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.593+0000 7f47977fe640 1 -- 172.21.15.2:0/4130613174 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f47a8059050 con 0x560ede17bb60 2024-09-19T06:23:42.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.593+0000 7f47c0773740 10 client.18441 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:42.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.593+0000 7f47c0773740 1 -- 172.21.15.2:0/4130613174 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560ede1954e0 con 0x560ede17bb60 2024-09-19T06:23:42.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.593+0000 7f47977fe640 1 -- 172.21.15.2:0/4130613174 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f47ac0041d0 con 0x560ede17bb60 2024-09-19T06:23:42.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.593+0000 7f47977fe640 1 -- 172.21.15.2:0/4130613174 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f47a8003c60 con 0x560ede17bb60 2024-09-19T06:23:42.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.593+0000 7f47c0773740 10 client.18441 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:42.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.593+0000 7f47c0773740 10 client.18441 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:42.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.593+0000 7f47c0773740 20 client.18441 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:42.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.593+0000 7f47c0773740 1 --2- 172.21.15.2:0/4130613174 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560ede1969b0 0x560ede198e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:42.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.593+0000 7f47c0773740 4 client.18441 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:23:42.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.593+0000 7f47c0773740 1 -- 172.21.15.2:0/4130613174 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560ede0ee7f0 con 0x560ede1969b0 2024-09-19T06:23:42.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.594+0000 7f47b77fe640 1 --2- 172.21.15.2:0/4130613174 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560ede1969b0 0x560ede198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:42.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.594+0000 7f47b77fe640 1 --2- 172.21.15.2:0/4130613174 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560ede1969b0 0x560ede198e10 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab22b7cebc1a89ec server_cookie=1ac75b294146f39e in_seq=0 out_seq=0 2024-09-19T06:23:42.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.594+0000 7f47977fe640 10 client.18441 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:42.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.595+0000 7f47977fe640 1 -- 172.21.15.2:0/4130613174 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560ede0ee7f0 con 0x560ede1969b0 2024-09-19T06:23:42.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.595+0000 7f47977fe640 10 client.18441 handle_command_reply: tid=0 2024-09-19T06:23:42.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.595+0000 7f47c0773740 1 client.18441 shutdown 2024-09-19T06:23:42.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.595+0000 7f47c0773740 1 -- 172.21.15.2:0/4130613174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede17bb60 msgr2=0x560ede183be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:42.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.595+0000 7f47c0773740 1 --2- 172.21.15.2:0/4130613174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede17bb60 0x560ede183be0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f47a8031780 tx=0x7f47a8009260 comp rx=0 tx=0).stop 2024-09-19T06:23:42.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.595+0000 7f47c0773740 1 -- 172.21.15.2:0/4130613174 shutdown_connections 2024-09-19T06:23:42.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.595+0000 7f47c0773740 1 --2- 172.21.15.2:0/4130613174 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560ede1969b0 0x560ede198e10 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.595+0000 7f47c0773740 1 --2- 172.21.15.2:0/4130613174 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede186d40 0x560ede184660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.595+0000 7f47c0773740 1 --2- 172.21.15.2:0/4130613174 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560ede17c480 0x560ede184120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.595+0000 7f47c0773740 1 --2- 172.21.15.2:0/4130613174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede17bb60 0x560ede183be0 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.595+0000 7f47c0773740 1 -- 172.21.15.2:0/4130613174 >> 172.21.15.2:0/4130613174 conn(0x560ede1780f0 msgr2=0x560ede17de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:42.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.595+0000 7f47977fe640 0 client.18441 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:42.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.595+0000 7f47c0773740 1 -- 172.21.15.2:0/4130613174 shutdown_connections 2024-09-19T06:23:42.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.595+0000 7f47c0773740 1 -- 172.21.15.2:0/4130613174 wait complete. 2024-09-19T06:23:42.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.595+0000 7f47c0773740 20 client.18441 trim_cache size 0 max 16384 2024-09-19T06:23:42.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.613+0000 7f47c0773740 1 Processor -- start 2024-09-19T06:23:42.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.613+0000 7f47c0773740 1 -- start start 2024-09-19T06:23:42.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.613+0000 7f47c0773740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede17bb60 0x560ede17e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:42.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.613+0000 7f47c0773740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede17c480 0x560ede19e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:42.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.613+0000 7f47c0773740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560ede186d40 0x560ede19ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:42.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.613+0000 7f47c0773740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f47b81b2190 con 0x560ede17c480 2024-09-19T06:23:42.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.613+0000 7f47c0773740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f47b81afa60 con 0x560ede17bb60 2024-09-19T06:23:42.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.613+0000 7f47c0773740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f47b81ad8d0 con 0x560ede186d40 2024-09-19T06:23:42.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.613+0000 7f47b77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede17c480 0x560ede19e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:42.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.613+0000 7f47b77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede17c480 0x560ede19e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46684/0 (socket says 172.21.15.2:46684) 2024-09-19T06:23:42.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.613+0000 7f47b77fe640 1 -- 172.21.15.2:0/244026494 learned_addr learned my addr 172.21.15.2:0/244026494 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:42.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.613+0000 7f47b7fff640 1 --2- 172.21.15.2:0/244026494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede17bb60 0x560ede17e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:42.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.613+0000 7f47b77fe640 1 -- 172.21.15.2:0/244026494 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560ede186d40 msgr2=0x560ede19ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:42.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.613+0000 7f47b77fe640 1 --2- 172.21.15.2:0/244026494 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560ede186d40 0x560ede19ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.613+0000 7f47b77fe640 1 -- 172.21.15.2:0/244026494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede17bb60 msgr2=0x560ede17e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:42.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.613+0000 7f47b77fe640 1 --2- 172.21.15.2:0/244026494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede17bb60 0x560ede17e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.613+0000 7f47b77fe640 1 -- 172.21.15.2:0/244026494 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ede177f20 con 0x560ede17c480 2024-09-19T06:23:42.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.613+0000 7f47b7fff640 1 --2- 172.21.15.2:0/244026494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede17bb60 0x560ede17e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:23:42.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.613+0000 7f47b77fe640 1 --2- 172.21.15.2:0/244026494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede17c480 0x560ede19e6e0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f47ac000c00 tx=0x7f47ac021040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe109fc5f29457fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:42.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.614+0000 7f479dffb640 1 -- 172.21.15.2:0/244026494 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ac0037f0 con 0x560ede17c480 2024-09-19T06:23:42.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.614+0000 7f479dffb640 1 -- 172.21.15.2:0/244026494 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f47ac003990 con 0x560ede17c480 2024-09-19T06:23:42.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.614+0000 7f479dffb640 1 -- 172.21.15.2:0/244026494 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ac010860 con 0x560ede17c480 2024-09-19T06:23:42.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.614+0000 7f47c0773740 1 -- 172.21.15.2:0/244026494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede17c480 msgr2=0x560ede19e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:42.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.614+0000 7f47c0773740 1 --2- 172.21.15.2:0/244026494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede17c480 0x560ede19e6e0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f47ac000c00 tx=0x7f47ac021040 comp rx=0 tx=0).stop 2024-09-19T06:23:42.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.614+0000 7f47c0773740 1 -- 172.21.15.2:0/244026494 shutdown_connections 2024-09-19T06:23:42.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.614+0000 7f47c0773740 1 --2- 172.21.15.2:0/244026494 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560ede186d40 0x560ede19ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.614+0000 7f47c0773740 1 --2- 172.21.15.2:0/244026494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede17c480 0x560ede19e6e0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.614+0000 7f47c0773740 1 --2- 172.21.15.2:0/244026494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede17bb60 0x560ede17e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.614+0000 7f47c0773740 1 -- 172.21.15.2:0/244026494 >> 172.21.15.2:0/244026494 conn(0x560ede1780f0 msgr2=0x560ede185b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:42.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.614+0000 7f47c0773740 1 -- 172.21.15.2:0/244026494 shutdown_connections 2024-09-19T06:23:42.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.614+0000 7f47c0773740 1 -- 172.21.15.2:0/244026494 wait complete. 2024-09-19T06:23:42.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.615+0000 7f47c0773740 1 -- start start 2024-09-19T06:23:42.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.615+0000 7f47c0773740 1 Processor -- start 2024-09-19T06:23:42.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.615+0000 7f47c0773740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560ede17bb60 0x560ede18f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:42.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.615+0000 7f47c0773740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede17c480 0x560ede18a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:42.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.615+0000 7f47c0773740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede186d40 0x560ede18aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:42.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.615+0000 7f47c0773740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f47b81adf20 con 0x560ede186d40 2024-09-19T06:23:42.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.615+0000 7f47c0773740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f47b81af390 con 0x560ede17c480 2024-09-19T06:23:42.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.615+0000 7f47c0773740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f47b81ae5f0 con 0x560ede17bb60 2024-09-19T06:23:42.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.615+0000 7f47c0773740 10 client.0 _ll_register_callbacks cb 0x7f47a8009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:42.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.615+0000 7f47bc937640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede186d40 0x560ede18aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:42.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.616+0000 7f47bc937640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede186d40 0x560ede18aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46692/0 (socket says 172.21.15.2:46692) 2024-09-19T06:23:42.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.616+0000 7f47bc937640 1 -- 172.21.15.2:0/240053665 learned_addr learned my addr 172.21.15.2:0/240053665 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:42.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.616+0000 7f47b77fe640 1 --2- 172.21.15.2:0/240053665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede17c480 0x560ede18a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:42.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.616+0000 7f47b7fff640 1 --2- 172.21.15.2:0/240053665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560ede17bb60 0x560ede18f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:42.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.616+0000 7f47bc937640 1 -- 172.21.15.2:0/240053665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560ede17bb60 msgr2=0x560ede18f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:42.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.616+0000 7f47bc937640 1 --2- 172.21.15.2:0/240053665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560ede17bb60 0x560ede18f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.616+0000 7f47bc937640 1 -- 172.21.15.2:0/240053665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede17c480 msgr2=0x560ede18a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:42.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.616+0000 7f47bc937640 1 --2- 172.21.15.2:0/240053665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede17c480 0x560ede18a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.616+0000 7f47bc937640 1 -- 172.21.15.2:0/240053665 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ede18b3d0 con 0x560ede186d40 2024-09-19T06:23:42.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.616+0000 7f47b77fe640 1 --2- 172.21.15.2:0/240053665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede17c480 0x560ede18a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:23:42.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.616+0000 7f47bc937640 1 --2- 172.21.15.2:0/240053665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede186d40 0x560ede18aba0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f47b00cd7d0 tx=0x7f47b009beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cea83925d1e5f29 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:42.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.616+0000 7f47977fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:42.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.616+0000 7f47977fe640 1 -- 172.21.15.2:0/240053665 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b00b4020 con 0x560ede186d40 2024-09-19T06:23:42.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.616+0000 7f47977fe640 1 -- 172.21.15.2:0/240053665 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f47b00a4ae0 con 0x560ede186d40 2024-09-19T06:23:42.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.616+0000 7f47c0773740 1 -- 172.21.15.2:0/240053665 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47ac003990 con 0x560ede186d40 2024-09-19T06:23:42.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.616+0000 7f47977fe640 1 -- 172.21.15.2:0/240053665 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f47b009ca00 con 0x560ede186d40 2024-09-19T06:23:42.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.616+0000 7f47c0773740 10 client.18447 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:42.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.616+0000 7f47c0773740 1 -- 172.21.15.2:0/240053665 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560ede2015c0 con 0x560ede186d40 2024-09-19T06:23:42.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.617+0000 7f47977fe640 1 -- 172.21.15.2:0/240053665 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f47ac003990 con 0x560ede186d40 2024-09-19T06:23:42.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.617+0000 7f47977fe640 1 -- 172.21.15.2:0/240053665 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f47b009b750 con 0x560ede186d40 2024-09-19T06:23:42.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.617+0000 7f47c0773740 10 client.18447 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:42.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.617+0000 7f47c0773740 10 client.18447 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:42.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.617+0000 7f47c0773740 20 client.18447 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:42.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.617+0000 7f47c0773740 1 --2- 172.21.15.2:0/240053665 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560ede201ce0 0x560ede204100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:42.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.617+0000 7f47c0773740 4 client.18447 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:23:42.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.617+0000 7f47c0773740 1 -- 172.21.15.2:0/240053665 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560ede0e8d00 con 0x560ede201ce0 2024-09-19T06:23:42.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.617+0000 7f47b7fff640 1 --2- 172.21.15.2:0/240053665 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560ede201ce0 0x560ede204100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:42.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.618+0000 7f47b7fff640 1 --2- 172.21.15.2:0/240053665 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560ede201ce0 0x560ede204100 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9e52cb98224a5fe server_cookie=4b5a0774d9d8de1 in_seq=0 out_seq=0 2024-09-19T06:23:42.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.618+0000 7f47977fe640 10 client.18447 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:42.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.619+0000 7f47977fe640 1 -- 172.21.15.2:0/240053665 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560ede0e8d00 con 0x560ede201ce0 2024-09-19T06:23:42.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.619+0000 7f47977fe640 10 client.18447 handle_command_reply: tid=0 2024-09-19T06:23:42.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.619+0000 7f47c0773740 1 client.18447 shutdown 2024-09-19T06:23:42.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.619+0000 7f47c0773740 1 -- 172.21.15.2:0/240053665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede186d40 msgr2=0x560ede18aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:42.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.619+0000 7f47c0773740 1 --2- 172.21.15.2:0/240053665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede186d40 0x560ede18aba0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f47b00cd7d0 tx=0x7f47b009beb0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.619+0000 7f47c0773740 1 -- 172.21.15.2:0/240053665 shutdown_connections 2024-09-19T06:23:42.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.619+0000 7f47c0773740 1 --2- 172.21.15.2:0/240053665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede186d40 0x560ede18aba0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.619+0000 7f47c0773740 1 --2- 172.21.15.2:0/240053665 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560ede201ce0 0x560ede204100 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.619+0000 7f47c0773740 1 --2- 172.21.15.2:0/240053665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede17c480 0x560ede18a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.619+0000 7f47c0773740 1 --2- 172.21.15.2:0/240053665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560ede17bb60 0x560ede18f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.619+0000 7f47c0773740 1 -- 172.21.15.2:0/240053665 >> 172.21.15.2:0/240053665 conn(0x560ede1780f0 msgr2=0x560ede182380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:42.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.619+0000 7f47977fe640 0 client.18447 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:42.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.619+0000 7f47c0773740 1 -- 172.21.15.2:0/240053665 shutdown_connections 2024-09-19T06:23:42.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.619+0000 7f47c0773740 1 -- 172.21.15.2:0/240053665 wait complete. 2024-09-19T06:23:42.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.619+0000 7f47c0773740 20 client.18447 trim_cache size 0 max 16384 2024-09-19T06:23:42.625 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:23:42.625 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T06:23:42.625 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "f5de1a6c-de6e-4694-b42e-5fe996766f9c", 2024-09-19T06:23:42.626 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T06:23:42.626 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:23:42.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.620+0000 7f47be39a640 1 -- 172.21.15.2:0/3104626703 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f47a00a33b0 msgr2=0x7f47a00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:42.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.620+0000 7f47be39a640 1 --2- 172.21.15.2:0/3104626703 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f47a00a33b0 0x7f47a00a5870 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009230 tx=0x7f47a80058d0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.620+0000 7f47be39a640 1 -- 172.21.15.2:0/3104626703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47b8102ef0 msgr2=0x7f47b81041d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:42.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.620+0000 7f47be39a640 1 --2- 172.21.15.2:0/3104626703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47b8102ef0 0x7f47b81041d0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f47b000cce0 tx=0x7f47b000a620 comp rx=0 tx=0).stop 2024-09-19T06:23:42.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.620+0000 7f47be39a640 1 -- 172.21.15.2:0/3104626703 shutdown_connections 2024-09-19T06:23:42.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.620+0000 7f47be39a640 1 --2- 172.21.15.2:0/3104626703 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f47a00a33b0 0x7f47a00a5870 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.620+0000 7f47be39a640 1 --2- 172.21.15.2:0/3104626703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47b8102ef0 0x7f47b81041d0 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.620+0000 7f47be39a640 1 --2- 172.21.15.2:0/3104626703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47b8102570 0x7f47b8103c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.620+0000 7f47be39a640 1 --2- 172.21.15.2:0/3104626703 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47b8100e20 0x7f47b8103750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.620+0000 7f47be39a640 1 -- 172.21.15.2:0/3104626703 >> 172.21.15.2:0/3104626703 conn(0x7f47b80fc7d0 msgr2=0x7f47b806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:42.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.620+0000 7f47be39a640 1 -- 172.21.15.2:0/3104626703 shutdown_connections 2024-09-19T06:23:42.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:42.620+0000 7f47be39a640 1 -- 172.21.15.2:0/3104626703 wait complete. 2024-09-19T06:23:43.340 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:23:43.600 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:23:43.721 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:43 smithi002 ceph-mon[30982]: pgmap v276: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:23:43.727 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:43 smithi002 ceph-mon[30982]: scrub queued for path: / 2024-09-19T06:23:43.727 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:43 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:23:43.727 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:43 smithi002 ceph-mon[30982]: scrub summary: active paths [/] 2024-09-19T06:23:43.727 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:43 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:23:43.727 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:43 smithi002 ceph-mon[30982]: scrub summary: idle 2024-09-19T06:23:43.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:43 smithi090 ceph-mon[34497]: pgmap v276: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:23:43.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:43 smithi090 ceph-mon[34497]: scrub queued for path: / 2024-09-19T06:23:43.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:43 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:23:43.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:43 smithi090 ceph-mon[34497]: scrub summary: active paths [/] 2024-09-19T06:23:43.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:43 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:23:43.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:43 smithi090 ceph-mon[34497]: scrub summary: idle 2024-09-19T06:23:43.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:43 smithi089 ceph-mon[34160]: pgmap v276: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:23:43.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:43 smithi089 ceph-mon[34160]: scrub queued for path: / 2024-09-19T06:23:43.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:43 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:23:43.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:43 smithi089 ceph-mon[34160]: scrub summary: active paths [/] 2024-09-19T06:23:43.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:43 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:23:43.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:43 smithi089 ceph-mon[34160]: scrub summary: idle 2024-09-19T06:23:44.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.089+0000 7f4a1f0b6640 1 -- 172.21.15.2:0/1764851592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a18106a80 msgr2=0x7f4a18106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:44.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.089+0000 7f4a1f0b6640 1 --2- 172.21.15.2:0/1764851592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a18106a80 0x7f4a18106e60 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f4a08009930 tx=0x7f4a0802a420 comp rx=0 tx=0).stop 2024-09-19T06:23:44.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.089+0000 7f4a1f0b6640 1 -- 172.21.15.2:0/1764851592 shutdown_connections 2024-09-19T06:23:44.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.089+0000 7f4a1f0b6640 1 --2- 172.21.15.2:0/1764851592 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a18101420 0x7f4a1810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.089+0000 7f4a1f0b6640 1 --2- 172.21.15.2:0/1764851592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a18100a80 0x7f4a18100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.089+0000 7f4a1f0b6640 1 --2- 172.21.15.2:0/1764851592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a18106a80 0x7f4a18106e60 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.089+0000 7f4a1f0b6640 1 -- 172.21.15.2:0/1764851592 >> 172.21.15.2:0/1764851592 conn(0x7f4a180fc7a0 msgr2=0x7f4a180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:44.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.089+0000 7f4a1f0b6640 1 -- 172.21.15.2:0/1764851592 shutdown_connections 2024-09-19T06:23:44.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.089+0000 7f4a1f0b6640 1 -- 172.21.15.2:0/1764851592 wait complete. 2024-09-19T06:23:44.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.090+0000 7f4a1f0b6640 1 Processor -- start 2024-09-19T06:23:44.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.090+0000 7f4a1f0b6640 1 -- start start 2024-09-19T06:23:44.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.090+0000 7f4a1f0b6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a18100a80 0x7f4a18197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:44.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.090+0000 7f4a1f0b6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a18101420 0x7f4a181977b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:44.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.090+0000 7f4a1f0b6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a18106a80 0x7f4a1819bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:44.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.090+0000 7f4a1f0b6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4a18110cf0 con 0x7f4a18100a80 2024-09-19T06:23:44.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.090+0000 7f4a1f0b6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4a18110b70 con 0x7f4a18106a80 2024-09-19T06:23:44.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.090+0000 7f4a1f0b6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4a18110e70 con 0x7f4a18101420 2024-09-19T06:23:44.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.090+0000 7f4a1ce52640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a18100a80 0x7f4a18197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:44.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.090+0000 7f4a1ce52640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a18100a80 0x7f4a18197270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46720/0 (socket says 172.21.15.2:46720) 2024-09-19T06:23:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.090+0000 7f4a1ce52640 1 -- 172.21.15.2:0/474814680 learned_addr learned my addr 172.21.15.2:0/474814680 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.090+0000 7f4a17fff640 1 --2- 172.21.15.2:0/474814680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a18101420 0x7f4a181977b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.091+0000 7f4a1d653640 1 --2- 172.21.15.2:0/474814680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a18106a80 0x7f4a1819bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.091+0000 7f4a1ce52640 1 -- 172.21.15.2:0/474814680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a18101420 msgr2=0x7f4a181977b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.091+0000 7f4a1ce52640 1 --2- 172.21.15.2:0/474814680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a18101420 0x7f4a181977b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.091+0000 7f4a1ce52640 1 -- 172.21.15.2:0/474814680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a18106a80 msgr2=0x7f4a1819bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.091+0000 7f4a1ce52640 1 --2- 172.21.15.2:0/474814680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a18106a80 0x7f4a1819bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.091+0000 7f4a1ce52640 1 -- 172.21.15.2:0/474814680 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a1819c220 con 0x7f4a18100a80 2024-09-19T06:23:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.091+0000 7f4a1d653640 1 --2- 172.21.15.2:0/474814680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a18106a80 0x7f4a1819bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:23:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.091+0000 7f4a1ce52640 1 --2- 172.21.15.2:0/474814680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a18100a80 0x7f4a18197270 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f4a08004770 tx=0x7f4a080042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.091+0000 7f4a15ffb640 1 -- 172.21.15.2:0/474814680 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0803f070 con 0x7f4a18100a80 2024-09-19T06:23:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.091+0000 7f4a15ffb640 1 -- 172.21.15.2:0/474814680 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4a0803b460 con 0x7f4a18100a80 2024-09-19T06:23:44.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.091+0000 7f4a1f0b6640 1 -- 172.21.15.2:0/474814680 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a1819c4b0 con 0x7f4a18100a80 2024-09-19T06:23:44.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.091+0000 7f4a15ffb640 1 -- 172.21.15.2:0/474814680 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a08035070 con 0x7f4a18100a80 2024-09-19T06:23:44.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.091+0000 7f4a1f0b6640 1 -- 172.21.15.2:0/474814680 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a1806a790 con 0x7f4a18100a80 2024-09-19T06:23:44.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.094+0000 7f4a15ffb640 1 -- 172.21.15.2:0/474814680 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f4a0803b610 con 0x7f4a18100a80 2024-09-19T06:23:44.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.094+0000 7f4a2148f740 1 Processor -- start 2024-09-19T06:23:44.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.094+0000 7f4a2148f740 1 -- start start 2024-09-19T06:23:44.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.095+0000 7f4a2148f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55afb9214380 0x55afb9214760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:44.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.095+0000 7f4a2148f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55afb9214ca0 0x55afb9223550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:44.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.095+0000 7f4a2148f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afb9223a90 0x55afb9225e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:44.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.095+0000 7f4a2148f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55afb917a2e0 con 0x55afb9223a90 2024-09-19T06:23:44.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.095+0000 7f4a2148f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55afb9121ce0 con 0x55afb9214ca0 2024-09-19T06:23:44.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.095+0000 7f4a2148f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55afb91762a0 con 0x55afb9214380 2024-09-19T06:23:44.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.095+0000 7f4a17fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afb9223a90 0x55afb9225e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:44.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.095+0000 7f4a17fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afb9223a90 0x55afb9225e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46728/0 (socket says 172.21.15.2:46728) 2024-09-19T06:23:44.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.095+0000 7f4a17fff640 1 -- 172.21.15.2:0/134280294 learned_addr learned my addr 172.21.15.2:0/134280294 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:44.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.095+0000 7f4a1d653640 1 --2- 172.21.15.2:0/134280294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55afb9214380 0x55afb9214760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:44.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.095+0000 7f4a1ce52640 1 --2- 172.21.15.2:0/134280294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55afb9214ca0 0x55afb9223550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:44.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.095+0000 7f4a15ffb640 1 --2- 172.21.15.2:0/474814680 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4a040a33b0 0x7f4a040a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:44.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.095+0000 7f4a17fff640 1 -- 172.21.15.2:0/134280294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55afb9214380 msgr2=0x55afb9214760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:44.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.095+0000 7f4a17fff640 1 --2- 172.21.15.2:0/134280294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55afb9214380 0x55afb9214760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.095+0000 7f4a17fff640 1 -- 172.21.15.2:0/134280294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55afb9214ca0 msgr2=0x55afb9223550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:44.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.095+0000 7f4a17fff640 1 --2- 172.21.15.2:0/134280294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55afb9214ca0 0x55afb9223550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.095+0000 7f4a17fff640 1 -- 172.21.15.2:0/134280294 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afb9106440 con 0x55afb9223a90 2024-09-19T06:23:44.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.095+0000 7f4a1ce52640 1 --2- 172.21.15.2:0/134280294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55afb9214ca0 0x55afb9223550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:44.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.095+0000 7f4a1d653640 1 --2- 172.21.15.2:0/474814680 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4a040a33b0 0x7f4a040a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:44.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.096+0000 7f4a15ffb640 1 -- 172.21.15.2:0/474814680 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f4a080f0110 con 0x7f4a18100a80 2024-09-19T06:23:44.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.096+0000 7f4a17fff640 1 --2- 172.21.15.2:0/134280294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afb9223a90 0x55afb9225e80 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f4a0000abf0 tx=0x7f4a0000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6ddb85ef1a7954 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:44.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.096+0000 7f4a0effd640 1 -- 172.21.15.2:0/134280294 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0001d070 con 0x55afb9223a90 2024-09-19T06:23:44.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.096+0000 7f4a0effd640 1 -- 172.21.15.2:0/134280294 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4a00018af0 con 0x55afb9223a90 2024-09-19T06:23:44.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.096+0000 7f4a0effd640 1 -- 172.21.15.2:0/134280294 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a00010a60 con 0x55afb9223a90 2024-09-19T06:23:44.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.097+0000 7f4a2148f740 1 -- 172.21.15.2:0/134280294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afb9223a90 msgr2=0x55afb9225e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:44.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.097+0000 7f4a1d653640 1 --2- 172.21.15.2:0/474814680 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4a040a33b0 0x7f4a040a5870 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4a10005fd0 tx=0x7f4a10004a40 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:44.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.097+0000 7f4a2148f740 1 --2- 172.21.15.2:0/134280294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afb9223a90 0x55afb9225e80 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f4a0000abf0 tx=0x7f4a0000f790 comp rx=0 tx=0).stop 2024-09-19T06:23:44.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.097+0000 7f4a2148f740 1 -- 172.21.15.2:0/134280294 shutdown_connections 2024-09-19T06:23:44.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.097+0000 7f4a2148f740 1 --2- 172.21.15.2:0/134280294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afb9223a90 0x55afb9225e80 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.097+0000 7f4a2148f740 1 --2- 172.21.15.2:0/134280294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55afb9214ca0 0x55afb9223550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.097+0000 7f4a2148f740 1 --2- 172.21.15.2:0/134280294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55afb9214380 0x55afb9214760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.097+0000 7f4a2148f740 1 -- 172.21.15.2:0/134280294 >> 172.21.15.2:0/134280294 conn(0x55afb9210a30 msgr2=0x55afb9210e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:44.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.097+0000 7f4a2148f740 1 -- 172.21.15.2:0/134280294 shutdown_connections 2024-09-19T06:23:44.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.097+0000 7f4a2148f740 1 -- 172.21.15.2:0/134280294 wait complete. 2024-09-19T06:23:44.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.097+0000 7f4a2148f740 1 -- start start 2024-09-19T06:23:44.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.097+0000 7f4a2148f740 1 Processor -- start 2024-09-19T06:23:44.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.098+0000 7f4a2148f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afb9214380 0x55afb9223400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:44.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.098+0000 7f4a2148f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55afb9214ca0 0x55afb9220700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:44.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.098+0000 7f4a2148f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55afb9223a90 0x55afb9220d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:44.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.098+0000 7f4a2148f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55afb9226660 con 0x55afb9214380 2024-09-19T06:23:44.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.098+0000 7f4a2148f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55afb9135050 con 0x55afb9214ca0 2024-09-19T06:23:44.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.098+0000 7f4a2148f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55afb92267e0 con 0x55afb9223a90 2024-09-19T06:23:44.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.098+0000 7f4a2148f740 10 client.0 _ll_register_callbacks cb 0x55afb9175160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:44.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.098+0000 7f4a1ce52640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afb9214380 0x55afb9223400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:44.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.098+0000 7f4a1ce52640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afb9214380 0x55afb9223400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46744/0 (socket says 172.21.15.2:46744) 2024-09-19T06:23:44.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.098+0000 7f4a1ce52640 1 -- 172.21.15.2:0/4272299757 learned_addr learned my addr 172.21.15.2:0/4272299757 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:44.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.098+0000 7f4a17fff640 1 --2- 172.21.15.2:0/4272299757 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55afb9214ca0 0x55afb9220700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:44.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.098+0000 7f4a1d653640 1 --2- 172.21.15.2:0/4272299757 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55afb9223a90 0x55afb9220d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:44.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.098+0000 7f4a1ce52640 1 -- 172.21.15.2:0/4272299757 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55afb9223a90 msgr2=0x55afb9220d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:44.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.098+0000 7f4a1ce52640 1 --2- 172.21.15.2:0/4272299757 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55afb9223a90 0x55afb9220d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.098+0000 7f4a1ce52640 1 -- 172.21.15.2:0/4272299757 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55afb9214ca0 msgr2=0x55afb9220700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:44.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.098+0000 7f4a1ce52640 1 --2- 172.21.15.2:0/4272299757 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55afb9214ca0 0x55afb9220700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.098+0000 7f4a1ce52640 1 -- 172.21.15.2:0/4272299757 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afb8eeb3c0 con 0x55afb9214380 2024-09-19T06:23:44.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.098+0000 7f4a1d653640 1 --2- 172.21.15.2:0/4272299757 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55afb9223a90 0x55afb9220d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:44.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.098+0000 7f4a1ce52640 1 --2- 172.21.15.2:0/4272299757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afb9214380 0x55afb9223400 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f4a080ed860 tx=0x7f4a080bbf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2b412caadaec8b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:44.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.098+0000 7f49f7fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:44.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.098+0000 7f49f7fff640 1 -- 172.21.15.2:0/4272299757 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a08048050 con 0x55afb9214380 2024-09-19T06:23:44.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.098+0000 7f49f7fff640 1 -- 172.21.15.2:0/4272299757 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f4a080eda80 con 0x55afb9214380 2024-09-19T06:23:44.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.098+0000 7f4a2148f740 1 -- 172.21.15.2:0/4272299757 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a00018af0 con 0x55afb9214380 2024-09-19T06:23:44.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.099+0000 7f49f7fff640 1 -- 172.21.15.2:0/4272299757 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4a080edc80 con 0x55afb9214380 2024-09-19T06:23:44.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.099+0000 7f4a2148f740 10 client.18459 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:44.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.099+0000 7f4a2148f740 1 -- 172.21.15.2:0/4272299757 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55afb92320b0 con 0x55afb9214380 2024-09-19T06:23:44.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.099+0000 7f49f7fff640 1 -- 172.21.15.2:0/4272299757 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4a00018af0 con 0x55afb9214380 2024-09-19T06:23:44.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.099+0000 7f49f7fff640 1 -- 172.21.15.2:0/4272299757 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f4a0804b060 con 0x55afb9214380 2024-09-19T06:23:44.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.099+0000 7f4a2148f740 10 client.18459 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:44.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.099+0000 7f4a2148f740 10 client.18459 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:44.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.099+0000 7f4a2148f740 20 client.18459 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:44.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.099+0000 7f4a2148f740 1 --2- 172.21.15.2:0/4272299757 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55afb9233400 0x55afb92357f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:44.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.099+0000 7f4a2148f740 4 client.18459 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:23:44.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.099+0000 7f4a2148f740 1 -- 172.21.15.2:0/4272299757 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55afb9187850 con 0x55afb9233400 2024-09-19T06:23:44.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.099+0000 7f4a17fff640 1 --2- 172.21.15.2:0/4272299757 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55afb9233400 0x55afb92357f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:44.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.100+0000 7f4a17fff640 1 --2- 172.21.15.2:0/4272299757 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55afb9233400 0x55afb92357f0 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cb2f42a9ead56fe server_cookie=cec0c9a5eaeda08d in_seq=0 out_seq=0 2024-09-19T06:23:44.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.100+0000 7f49f7fff640 10 client.18459 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:44.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.101+0000 7f49f7fff640 1 -- 172.21.15.2:0/4272299757 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55afb9187850 con 0x55afb9233400 2024-09-19T06:23:44.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.101+0000 7f49f7fff640 10 client.18459 handle_command_reply: tid=0 2024-09-19T06:23:44.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.101+0000 7f4a2148f740 1 client.18459 shutdown 2024-09-19T06:23:44.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.101+0000 7f4a2148f740 1 -- 172.21.15.2:0/4272299757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afb9214380 msgr2=0x55afb9223400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:44.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.101+0000 7f4a2148f740 1 --2- 172.21.15.2:0/4272299757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afb9214380 0x55afb9223400 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f4a080ed860 tx=0x7f4a080bbf50 comp rx=0 tx=0).stop 2024-09-19T06:23:44.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.101+0000 7f4a2148f740 1 -- 172.21.15.2:0/4272299757 shutdown_connections 2024-09-19T06:23:44.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.101+0000 7f4a2148f740 1 --2- 172.21.15.2:0/4272299757 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55afb9223a90 0x55afb9220d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.101+0000 7f4a2148f740 1 --2- 172.21.15.2:0/4272299757 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55afb9233400 0x55afb92357f0 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.101+0000 7f4a2148f740 1 --2- 172.21.15.2:0/4272299757 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55afb9214ca0 0x55afb9220700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.101+0000 7f49f7fff640 0 client.18459 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:44.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.101+0000 7f4a2148f740 1 --2- 172.21.15.2:0/4272299757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afb9214380 0x55afb9223400 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.101+0000 7f4a2148f740 1 -- 172.21.15.2:0/4272299757 >> 172.21.15.2:0/4272299757 conn(0x55afb9210a30 msgr2=0x55afb9216790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:44.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.101+0000 7f4a2148f740 1 -- 172.21.15.2:0/4272299757 shutdown_connections 2024-09-19T06:23:44.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.101+0000 7f4a2148f740 1 -- 172.21.15.2:0/4272299757 wait complete. 2024-09-19T06:23:44.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.101+0000 7f4a2148f740 20 client.18459 trim_cache size 0 max 16384 2024-09-19T06:23:44.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.118+0000 7f4a2148f740 1 Processor -- start 2024-09-19T06:23:44.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.118+0000 7f4a2148f740 1 -- start start 2024-09-19T06:23:44.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.118+0000 7f4a2148f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55afb9214380 0x55afb922f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:44.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.118+0000 7f4a2148f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afb9214ca0 0x55afb923b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:44.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.118+0000 7f4a2148f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55afb9223a90 0x55afb923b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:44.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.118+0000 7f4a2148f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4a181adf10 con 0x55afb9214ca0 2024-09-19T06:23:44.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.118+0000 7f4a2148f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4a181ab7e0 con 0x55afb9214380 2024-09-19T06:23:44.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.118+0000 7f4a2148f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4a181a9650 con 0x55afb9223a90 2024-09-19T06:23:44.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.119+0000 7f4a17fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afb9214ca0 0x55afb923b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:44.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.119+0000 7f4a17fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afb9214ca0 0x55afb923b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46746/0 (socket says 172.21.15.2:46746) 2024-09-19T06:23:44.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.119+0000 7f4a17fff640 1 -- 172.21.15.2:0/145314487 learned_addr learned my addr 172.21.15.2:0/145314487 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:44.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.119+0000 7f4a17fff640 1 -- 172.21.15.2:0/145314487 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55afb9223a90 msgr2=0x55afb923b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:44.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.119+0000 7f4a1d653640 1 --2- 172.21.15.2:0/145314487 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55afb9223a90 0x55afb923b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:44.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.119+0000 7f4a17fff640 1 --2- 172.21.15.2:0/145314487 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55afb9223a90 0x55afb923b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.119+0000 7f4a17fff640 1 -- 172.21.15.2:0/145314487 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55afb9214380 msgr2=0x55afb922f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:44.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.119+0000 7f4a1ce52640 1 --2- 172.21.15.2:0/145314487 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55afb9214380 0x55afb922f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:44.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.119+0000 7f4a17fff640 1 --2- 172.21.15.2:0/145314487 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55afb9214380 0x55afb922f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.119+0000 7f4a17fff640 1 -- 172.21.15.2:0/145314487 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afb9235b60 con 0x55afb9214ca0 2024-09-19T06:23:44.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.119+0000 7f4a17fff640 1 --2- 172.21.15.2:0/145314487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afb9214ca0 0x55afb923b090 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f4a0000a7f0 tx=0x7f4a0000fdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=260e9feb7c1066e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:44.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.119+0000 7f4a0e7fc640 1 -- 172.21.15.2:0/145314487 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0001d040 con 0x55afb9214ca0 2024-09-19T06:23:44.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.119+0000 7f4a0e7fc640 1 -- 172.21.15.2:0/145314487 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4a0001e040 con 0x55afb9214ca0 2024-09-19T06:23:44.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.119+0000 7f4a0e7fc640 1 -- 172.21.15.2:0/145314487 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a00018720 con 0x55afb9214ca0 2024-09-19T06:23:44.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.120+0000 7f4a2148f740 1 -- 172.21.15.2:0/145314487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afb9214ca0 msgr2=0x55afb923b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:44.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.120+0000 7f4a2148f740 1 --2- 172.21.15.2:0/145314487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afb9214ca0 0x55afb923b090 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f4a0000a7f0 tx=0x7f4a0000fdc0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.120+0000 7f4a2148f740 1 -- 172.21.15.2:0/145314487 shutdown_connections 2024-09-19T06:23:44.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.120+0000 7f4a2148f740 1 --2- 172.21.15.2:0/145314487 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55afb9223a90 0x55afb923b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.120+0000 7f4a2148f740 1 --2- 172.21.15.2:0/145314487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afb9214ca0 0x55afb923b090 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.120+0000 7f4a2148f740 1 --2- 172.21.15.2:0/145314487 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55afb9214380 0x55afb922f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.120+0000 7f4a2148f740 1 -- 172.21.15.2:0/145314487 >> 172.21.15.2:0/145314487 conn(0x55afb9210a30 msgr2=0x55afb921bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:44.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.120+0000 7f4a2148f740 1 -- 172.21.15.2:0/145314487 shutdown_connections 2024-09-19T06:23:44.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.120+0000 7f4a2148f740 1 -- 172.21.15.2:0/145314487 wait complete. 2024-09-19T06:23:44.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.121+0000 7f4a2148f740 1 -- start start 2024-09-19T06:23:44.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.121+0000 7f4a2148f740 1 Processor -- start 2024-09-19T06:23:44.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.121+0000 7f4a2148f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55afb9214380 0x55afb92278f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:44.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.121+0000 7f4a2148f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55afb9214ca0 0x55afb9227e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:44.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.121+0000 7f4a2148f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afb9223a90 0x55afb9228370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:44.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.121+0000 7f4a2148f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4a181a9ca0 con 0x55afb9223a90 2024-09-19T06:23:44.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.121+0000 7f4a2148f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4a181ab110 con 0x55afb9214ca0 2024-09-19T06:23:44.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.121+0000 7f4a2148f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4a181aa370 con 0x55afb9214380 2024-09-19T06:23:44.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.121+0000 7f4a2148f740 10 client.0 _ll_register_callbacks cb 0x7f4a08009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:44.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.121+0000 7f4a1d653640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afb9223a90 0x55afb9228370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:44.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.121+0000 7f4a1d653640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afb9223a90 0x55afb9228370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46758/0 (socket says 172.21.15.2:46758) 2024-09-19T06:23:44.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.121+0000 7f4a1d653640 1 -- 172.21.15.2:0/554115913 learned_addr learned my addr 172.21.15.2:0/554115913 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:44.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.121+0000 7f4a1ce52640 1 --2- 172.21.15.2:0/554115913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55afb9214380 0x55afb92278f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:44.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.122+0000 7f4a17fff640 1 --2- 172.21.15.2:0/554115913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55afb9214ca0 0x55afb9227e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:44.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.122+0000 7f4a1d653640 1 -- 172.21.15.2:0/554115913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55afb9214380 msgr2=0x55afb92278f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:44.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.122+0000 7f4a1d653640 1 --2- 172.21.15.2:0/554115913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55afb9214380 0x55afb92278f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.122+0000 7f4a1d653640 1 -- 172.21.15.2:0/554115913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55afb9214ca0 msgr2=0x55afb9227e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:44.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.122+0000 7f4a1d653640 1 --2- 172.21.15.2:0/554115913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55afb9214ca0 0x55afb9227e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.122+0000 7f4a1d653640 1 -- 172.21.15.2:0/554115913 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afb929d1c0 con 0x55afb9223a90 2024-09-19T06:23:44.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.122+0000 7f4a17fff640 1 --2- 172.21.15.2:0/554115913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55afb9214ca0 0x55afb9227e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:44.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.122+0000 7f4a1d653640 1 --2- 172.21.15.2:0/554115913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afb9223a90 0x55afb9228370 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f4a100129e0 tx=0x7f4a10004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad3858ce67be1610 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:44.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.122+0000 7f49f7fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:44.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.122+0000 7f49f7fff640 1 -- 172.21.15.2:0/554115913 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a1000fe10 con 0x55afb9223a90 2024-09-19T06:23:44.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.122+0000 7f49f7fff640 1 -- 172.21.15.2:0/554115913 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f4a10021410 con 0x55afb9223a90 2024-09-19T06:23:44.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.122+0000 7f4a2148f740 1 -- 172.21.15.2:0/554115913 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a0001e040 con 0x55afb9223a90 2024-09-19T06:23:44.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.122+0000 7f49f7fff640 1 -- 172.21.15.2:0/554115913 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4a10021610 con 0x55afb9223a90 2024-09-19T06:23:44.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.122+0000 7f4a2148f740 10 client.18465 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:44.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.122+0000 7f4a2148f740 1 -- 172.21.15.2:0/554115913 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55afb929e4d0 con 0x55afb9223a90 2024-09-19T06:23:44.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.123+0000 7f49f7fff640 1 -- 172.21.15.2:0/554115913 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4a0001e040 con 0x55afb9223a90 2024-09-19T06:23:44.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.123+0000 7f49f7fff640 1 -- 172.21.15.2:0/554115913 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f4a1001d070 con 0x55afb9223a90 2024-09-19T06:23:44.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.123+0000 7f4a2148f740 10 client.18465 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:44.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.123+0000 7f4a2148f740 10 client.18465 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:44.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.123+0000 7f4a2148f740 20 client.18465 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:44.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.123+0000 7f4a2148f740 1 --2- 172.21.15.2:0/554115913 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55afb9233400 0x55afb92a0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:44.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.123+0000 7f4a2148f740 4 client.18465 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:23:44.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.123+0000 7f4a2148f740 1 -- 172.21.15.2:0/554115913 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55afb9181d60 con 0x55afb9233400 2024-09-19T06:23:44.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.123+0000 7f4a1ce52640 1 --2- 172.21.15.2:0/554115913 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55afb9233400 0x55afb92a0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:44.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.123+0000 7f4a1ce52640 1 --2- 172.21.15.2:0/554115913 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55afb9233400 0x55afb92a0c10 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7375a850955a6b1 server_cookie=ee601bff161f5b5c in_seq=0 out_seq=0 2024-09-19T06:23:44.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.123+0000 7f49f7fff640 10 client.18465 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:44.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.124+0000 7f49f7fff640 1 -- 172.21.15.2:0/554115913 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55afb9181d60 con 0x55afb9233400 2024-09-19T06:23:44.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.124+0000 7f49f7fff640 10 client.18465 handle_command_reply: tid=0 2024-09-19T06:23:44.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.124+0000 7f4a2148f740 1 client.18465 shutdown 2024-09-19T06:23:44.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.124+0000 7f4a2148f740 1 -- 172.21.15.2:0/554115913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afb9223a90 msgr2=0x55afb9228370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:44.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.124+0000 7f4a2148f740 1 --2- 172.21.15.2:0/554115913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afb9223a90 0x55afb9228370 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f4a100129e0 tx=0x7f4a10004ab0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.124+0000 7f4a2148f740 1 -- 172.21.15.2:0/554115913 shutdown_connections 2024-09-19T06:23:44.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.124+0000 7f4a2148f740 1 --2- 172.21.15.2:0/554115913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55afb9223a90 0x55afb9228370 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.124+0000 7f4a2148f740 1 --2- 172.21.15.2:0/554115913 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55afb9233400 0x55afb92a0c10 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.124+0000 7f4a2148f740 1 --2- 172.21.15.2:0/554115913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55afb9214ca0 0x55afb9227e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.124+0000 7f4a2148f740 1 --2- 172.21.15.2:0/554115913 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55afb9214380 0x55afb92278f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.124+0000 7f4a2148f740 1 -- 172.21.15.2:0/554115913 >> 172.21.15.2:0/554115913 conn(0x55afb9210a30 msgr2=0x55afb920f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:44.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.124+0000 7f49f7fff640 0 client.18465 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:44.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.124+0000 7f4a2148f740 1 -- 172.21.15.2:0/554115913 shutdown_connections 2024-09-19T06:23:44.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.124+0000 7f4a2148f740 1 -- 172.21.15.2:0/554115913 wait complete. 2024-09-19T06:23:44.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.124+0000 7f4a2148f740 20 client.18465 trim_cache size 0 max 16384 2024-09-19T06:23:44.131 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:23:44.131 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T06:23:44.131 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T06:23:44.131 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:23:44.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.125+0000 7f4a1f0b6640 1 -- 172.21.15.2:0/474814680 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4a040a33b0 msgr2=0x7f4a040a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:44.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.125+0000 7f4a1f0b6640 1 --2- 172.21.15.2:0/474814680 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4a040a33b0 0x7f4a040a5870 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4a10005fd0 tx=0x7f4a10004a40 comp rx=0 tx=0).stop 2024-09-19T06:23:44.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.125+0000 7f4a1f0b6640 1 -- 172.21.15.2:0/474814680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a18100a80 msgr2=0x7f4a18197270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:44.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.125+0000 7f4a1f0b6640 1 --2- 172.21.15.2:0/474814680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a18100a80 0x7f4a18197270 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f4a08004770 tx=0x7f4a080042f0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.125+0000 7f4a1f0b6640 1 -- 172.21.15.2:0/474814680 shutdown_connections 2024-09-19T06:23:44.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.125+0000 7f4a1f0b6640 1 --2- 172.21.15.2:0/474814680 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4a040a33b0 0x7f4a040a5870 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.125+0000 7f4a1f0b6640 1 --2- 172.21.15.2:0/474814680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a18106a80 0x7f4a1819bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.125+0000 7f4a1f0b6640 1 --2- 172.21.15.2:0/474814680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a18101420 0x7f4a181977b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.125+0000 7f4a1f0b6640 1 --2- 172.21.15.2:0/474814680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a18100a80 0x7f4a18197270 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.125+0000 7f4a1f0b6640 1 -- 172.21.15.2:0/474814680 >> 172.21.15.2:0/474814680 conn(0x7f4a180fc7a0 msgr2=0x7f4a180fd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:44.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.125+0000 7f4a1f0b6640 1 -- 172.21.15.2:0/474814680 shutdown_connections 2024-09-19T06:23:44.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:44.125+0000 7f4a1f0b6640 1 -- 172.21.15.2:0/474814680 wait complete. 2024-09-19T06:23:44.791 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:23:44.791 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:23:45.048 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:23:45.457 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:45 smithi002 ceph-mon[30982]: pgmap v277: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2024-09-19T06:23:45.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.537+0000 7f9ebbf4e640 1 -- 172.21.15.2:0/4190112614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9eb4102de0 msgr2=0x7f9eb41031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:45.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.537+0000 7f9ebbf4e640 1 --2- 172.21.15.2:0/4190112614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9eb4102de0 0x7f9eb41031c0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0009900 tx=0x7f9eb002a480 comp rx=0 tx=0).stop 2024-09-19T06:23:45.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.537+0000 7f9ebbf4e640 1 -- 172.21.15.2:0/4190112614 shutdown_connections 2024-09-19T06:23:45.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.537+0000 7f9ebbf4e640 1 --2- 172.21.15.2:0/4190112614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9eb410c180 0x7f9eb410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:45.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.537+0000 7f9ebbf4e640 1 --2- 172.21.15.2:0/4190112614 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9eb4103700 0x7f9eb410bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:45.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.537+0000 7f9ebbf4e640 1 --2- 172.21.15.2:0/4190112614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9eb4102de0 0x7f9eb41031c0 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:45.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.537+0000 7f9ebbf4e640 1 -- 172.21.15.2:0/4190112614 >> 172.21.15.2:0/4190112614 conn(0x7f9eb40fc7a0 msgr2=0x7f9eb40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:45.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.537+0000 7f9ebbf4e640 1 -- 172.21.15.2:0/4190112614 shutdown_connections 2024-09-19T06:23:45.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.537+0000 7f9ebbf4e640 1 -- 172.21.15.2:0/4190112614 wait complete. 2024-09-19T06:23:45.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.538+0000 7f9ebbf4e640 1 Processor -- start 2024-09-19T06:23:45.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.538+0000 7f9ebbf4e640 1 -- start start 2024-09-19T06:23:45.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.538+0000 7f9ebbf4e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9eb4102de0 0x7f9eb4100a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:45.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.538+0000 7f9ebbf4e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9eb4103700 0x7f9eb4100f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:45.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.538+0000 7f9ebbf4e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9eb410c180 0x7f9eb41014c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:45.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.538+0000 7f9ebbf4e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb4111e20 con 0x7f9eb4102de0 2024-09-19T06:23:45.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.538+0000 7f9ebbf4e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb4111ca0 con 0x7f9eb4103700 2024-09-19T06:23:45.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.538+0000 7f9ebbf4e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb4111fa0 con 0x7f9eb410c180 2024-09-19T06:23:45.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.538+0000 7f9eb9cea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9eb4102de0 0x7f9eb4100a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:45.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.538+0000 7f9eb9cea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9eb4102de0 0x7f9eb4100a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51788/0 (socket says 172.21.15.2:51788) 2024-09-19T06:23:45.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.538+0000 7f9eb9cea640 1 -- 172.21.15.2:0/1169358684 learned_addr learned my addr 172.21.15.2:0/1169358684 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:45.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.539+0000 7f9eb94e9640 1 --2- 172.21.15.2:0/1169358684 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9eb4103700 0x7f9eb4100f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:45.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.539+0000 7f9eba4eb640 1 --2- 172.21.15.2:0/1169358684 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9eb410c180 0x7f9eb41014c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:45.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.539+0000 7f9eb9cea640 1 -- 172.21.15.2:0/1169358684 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9eb410c180 msgr2=0x7f9eb41014c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:45.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.539+0000 7f9eb9cea640 1 --2- 172.21.15.2:0/1169358684 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9eb410c180 0x7f9eb41014c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:45.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.539+0000 7f9eb9cea640 1 -- 172.21.15.2:0/1169358684 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9eb4103700 msgr2=0x7f9eb4100f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:45.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.539+0000 7f9eb9cea640 1 --2- 172.21.15.2:0/1169358684 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9eb4103700 0x7f9eb4100f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:45.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.539+0000 7f9eb9cea640 1 -- 172.21.15.2:0/1169358684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eb41a6900 con 0x7f9eb4102de0 2024-09-19T06:23:45.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.539+0000 7f9eb94e9640 1 --2- 172.21.15.2:0/1169358684 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9eb4103700 0x7f9eb4100f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:23:45.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.539+0000 7f9eb9cea640 1 --2- 172.21.15.2:0/1169358684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9eb4102de0 0x7f9eb4100a40 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0005940 tx=0x7f9eb0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:45.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.539+0000 7f9eaaffd640 1 -- 172.21.15.2:0/1169358684 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb003f030 con 0x7f9eb4102de0 2024-09-19T06:23:45.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.539+0000 7f9ebbf4e640 1 -- 172.21.15.2:0/1169358684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9eb41a6b90 con 0x7f9eb4102de0 2024-09-19T06:23:45.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.539+0000 7f9eaaffd640 1 -- 172.21.15.2:0/1169358684 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9eb0003aa0 con 0x7f9eb4102de0 2024-09-19T06:23:45.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.539+0000 7f9eaaffd640 1 -- 172.21.15.2:0/1169358684 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb0035070 con 0x7f9eb4102de0 2024-09-19T06:23:45.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.539+0000 7f9ebbf4e640 1 -- 172.21.15.2:0/1169358684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9eb41a7070 con 0x7f9eb4102de0 2024-09-19T06:23:45.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.540+0000 7f9ebbf4e640 1 -- 172.21.15.2:0/1169358684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9eb41031c0 con 0x7f9eb4102de0 2024-09-19T06:23:45.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.541+0000 7f9eaaffd640 1 -- 172.21.15.2:0/1169358684 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f9eb0042030 con 0x7f9eb4102de0 2024-09-19T06:23:45.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.542+0000 7f9eaaffd640 1 --2- 172.21.15.2:0/1169358684 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9ea00a33b0 0x7f9ea00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:45.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.542+0000 7f9eb94e9640 1 --2- 172.21.15.2:0/1169358684 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9ea00a33b0 0x7f9ea00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:45.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.542+0000 7f9eaaffd640 1 -- 172.21.15.2:0/1169358684 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f9eb00f0210 con 0x7f9eb4102de0 2024-09-19T06:23:45.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.543+0000 7f9eb94e9640 1 --2- 172.21.15.2:0/1169358684 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9ea00a33b0 0x7f9ea00a5870 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9eb41024d0 tx=0x7f9ea4005e50 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:45.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.546+0000 7f9eaaffd640 1 -- 172.21.15.2:0/1169358684 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9eb00bcbf0 con 0x7f9eb4102de0 2024-09-19T06:23:45.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:45 smithi090 ceph-mon[34497]: pgmap v277: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2024-09-19T06:23:45.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.759+0000 7f9ebbf4e640 1 -- 172.21.15.2:0/1169358684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9eb4107260 con 0x7f9eb4102de0 2024-09-19T06:23:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.759+0000 7f9eaaffd640 1 -- 172.21.15.2:0/1169358684 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11882 (secure 0 0 0) 0x7f9eb00bc4f0 con 0x7f9eb4102de0 2024-09-19T06:23:45.762 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:23:45.762 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-09-19T06:14:49:104280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:14:48.191083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24470,24472,24497]},"id":1}]} 2024-09-19T06:23:45.762 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-09-19T06:23:45.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.762+0000 7f9ebbf4e640 1 -- 172.21.15.2:0/1169358684 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9ea00a33b0 msgr2=0x7f9ea00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:45.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.762+0000 7f9ebbf4e640 1 --2- 172.21.15.2:0/1169358684 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9ea00a33b0 0x7f9ea00a5870 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9eb41024d0 tx=0x7f9ea4005e50 comp rx=0 tx=0).stop 2024-09-19T06:23:45.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.762+0000 7f9ebbf4e640 1 -- 172.21.15.2:0/1169358684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9eb4102de0 msgr2=0x7f9eb4100a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:45.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.762+0000 7f9ebbf4e640 1 --2- 172.21.15.2:0/1169358684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9eb4102de0 0x7f9eb4100a40 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0005940 tx=0x7f9eb0004270 comp rx=0 tx=0).stop 2024-09-19T06:23:45.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.762+0000 7f9ebbf4e640 1 -- 172.21.15.2:0/1169358684 shutdown_connections 2024-09-19T06:23:45.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.762+0000 7f9ebbf4e640 1 --2- 172.21.15.2:0/1169358684 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9ea00a33b0 0x7f9ea00a5870 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:45.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.762+0000 7f9ebbf4e640 1 --2- 172.21.15.2:0/1169358684 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9eb410c180 0x7f9eb41014c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:45.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.762+0000 7f9ebbf4e640 1 --2- 172.21.15.2:0/1169358684 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9eb4103700 0x7f9eb4100f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:45.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.762+0000 7f9ebbf4e640 1 --2- 172.21.15.2:0/1169358684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9eb4102de0 0x7f9eb4100a40 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:45.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.762+0000 7f9ebbf4e640 1 -- 172.21.15.2:0/1169358684 >> 172.21.15.2:0/1169358684 conn(0x7f9eb40fc7a0 msgr2=0x7f9eb40fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:45.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.762+0000 7f9ebbf4e640 1 -- 172.21.15.2:0/1169358684 shutdown_connections 2024-09-19T06:23:45.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:45.762+0000 7f9ebbf4e640 1 -- 172.21.15.2:0/1169358684 wait complete. 2024-09-19T06:23:45.791 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:45 smithi089 ceph-mon[34160]: pgmap v277: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2024-09-19T06:23:46.369 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:46 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1169358684' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:23:46.401 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:23:46.659 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:23:46.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:46 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1169358684' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:23:46.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:46 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1169358684' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:23:47.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.071+0000 7f0c6000d640 1 -- 172.21.15.2:0/3091405294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c58100a80 msgr2=0x7f0c58100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:47.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.071+0000 7f0c6000d640 1 --2- 172.21.15.2:0/3091405294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c58100a80 0x7f0c58100ee0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f0c48009930 tx=0x7f0c4802a420 comp rx=0 tx=0).stop 2024-09-19T06:23:47.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.071+0000 7f0c6000d640 1 -- 172.21.15.2:0/3091405294 shutdown_connections 2024-09-19T06:23:47.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.071+0000 7f0c6000d640 1 --2- 172.21.15.2:0/3091405294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c58101420 0x7f0c5810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:47.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.071+0000 7f0c6000d640 1 --2- 172.21.15.2:0/3091405294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c58100a80 0x7f0c58100ee0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:47.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.071+0000 7f0c6000d640 1 --2- 172.21.15.2:0/3091405294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c58106a80 0x7f0c58106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:47.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.071+0000 7f0c6000d640 1 -- 172.21.15.2:0/3091405294 >> 172.21.15.2:0/3091405294 conn(0x7f0c580fc7a0 msgr2=0x7f0c580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:47.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.071+0000 7f0c6000d640 1 -- 172.21.15.2:0/3091405294 shutdown_connections 2024-09-19T06:23:47.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.071+0000 7f0c6000d640 1 -- 172.21.15.2:0/3091405294 wait complete. 2024-09-19T06:23:47.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.071+0000 7f0c6000d640 1 Processor -- start 2024-09-19T06:23:47.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.072+0000 7f0c6000d640 1 -- start start 2024-09-19T06:23:47.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.072+0000 7f0c6000d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c58100a80 0x7f0c5810fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:47.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.072+0000 7f0c6000d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c58101420 0x7f0c58110040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:47.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.072+0000 7f0c6000d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c58106a80 0x7f0c58110580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:47.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.072+0000 7f0c6000d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0c58111e60 con 0x7f0c58100a80 2024-09-19T06:23:47.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.072+0000 7f0c6000d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0c58111ce0 con 0x7f0c58106a80 2024-09-19T06:23:47.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.072+0000 7f0c6000d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0c58111fe0 con 0x7f0c58101420 2024-09-19T06:23:47.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.072+0000 7f0c5dda9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c58100a80 0x7f0c5810fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:47.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.072+0000 7f0c5dda9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c58100a80 0x7f0c5810fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51812/0 (socket says 172.21.15.2:51812) 2024-09-19T06:23:47.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.072+0000 7f0c5dda9640 1 -- 172.21.15.2:0/1400692347 learned_addr learned my addr 172.21.15.2:0/1400692347 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:47.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.072+0000 7f0c5d5a8640 1 --2- 172.21.15.2:0/1400692347 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c58101420 0x7f0c58110040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:47.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.072+0000 7f0c5e5aa640 1 --2- 172.21.15.2:0/1400692347 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c58106a80 0x7f0c58110580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:47.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.072+0000 7f0c5dda9640 1 -- 172.21.15.2:0/1400692347 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c58101420 msgr2=0x7f0c58110040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:47.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.072+0000 7f0c5dda9640 1 --2- 172.21.15.2:0/1400692347 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c58101420 0x7f0c58110040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:47.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.072+0000 7f0c5dda9640 1 -- 172.21.15.2:0/1400692347 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c58106a80 msgr2=0x7f0c58110580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:47.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.072+0000 7f0c5dda9640 1 --2- 172.21.15.2:0/1400692347 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c58106a80 0x7f0c58110580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:47.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.072+0000 7f0c5dda9640 1 -- 172.21.15.2:0/1400692347 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c581a68b0 con 0x7f0c58100a80 2024-09-19T06:23:47.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.072+0000 7f0c5dda9640 1 --2- 172.21.15.2:0/1400692347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c58100a80 0x7f0c5810fb00 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f0c5400d950 tx=0x7f0c5400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:47.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.073+0000 7f0c4effd640 1 -- 172.21.15.2:0/1400692347 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c54017070 con 0x7f0c58100a80 2024-09-19T06:23:47.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.073+0000 7f0c6000d640 1 -- 172.21.15.2:0/1400692347 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c581a6ba0 con 0x7f0c58100a80 2024-09-19T06:23:47.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.073+0000 7f0c4effd640 1 -- 172.21.15.2:0/1400692347 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0c54009c30 con 0x7f0c58100a80 2024-09-19T06:23:47.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.073+0000 7f0c4effd640 1 -- 172.21.15.2:0/1400692347 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c5400f620 con 0x7f0c58100a80 2024-09-19T06:23:47.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.073+0000 7f0c6000d640 1 -- 172.21.15.2:0/1400692347 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c581a70b0 con 0x7f0c58100a80 2024-09-19T06:23:47.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.075+0000 7f0c4effd640 1 -- 172.21.15.2:0/1400692347 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f0c540109a0 con 0x7f0c58100a80 2024-09-19T06:23:47.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.075+0000 7f0c623e6740 1 Processor -- start 2024-09-19T06:23:47.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.075+0000 7f0c623e6740 1 -- start start 2024-09-19T06:23:47.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.076+0000 7f0c623e6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561be4cc5b40 0x561be4cc4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:47.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.076+0000 7f0c623e6740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561be4cc45d0 0x561be4cc4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:47.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.076+0000 7f0c623e6740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561be4ccf370 0x561be4cd1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:47.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.076+0000 7f0c623e6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561be4c2a2f0 con 0x561be4cc5b40 2024-09-19T06:23:47.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.076+0000 7f0c623e6740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x561be4bd1cf0 con 0x561be4cc45d0 2024-09-19T06:23:47.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.076+0000 7f0c623e6740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x561be4c262b0 con 0x561be4ccf370 2024-09-19T06:23:47.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.076+0000 7f0c5e5aa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561be4cc5b40 0x561be4cc4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:47.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.076+0000 7f0c5e5aa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561be4cc5b40 0x561be4cc4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51818/0 (socket says 172.21.15.2:51818) 2024-09-19T06:23:47.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.076+0000 7f0c5e5aa640 1 -- 172.21.15.2:0/4015712211 learned_addr learned my addr 172.21.15.2:0/4015712211 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:47.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.076+0000 7f0c5dda9640 1 --2- 172.21.15.2:0/4015712211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561be4cc45d0 0x561be4cc4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:47.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.076+0000 7f0c5d5a8640 1 --2- 172.21.15.2:0/4015712211 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561be4ccf370 0x561be4cd1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:47.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.076+0000 7f0c4effd640 1 --2- 172.21.15.2:0/1400692347 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f0c440a33b0 0x7f0c440a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:47.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.076+0000 7f0c5e5aa640 1 -- 172.21.15.2:0/4015712211 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561be4ccf370 msgr2=0x561be4cd1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:47.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.076+0000 7f0c5e5aa640 1 --2- 172.21.15.2:0/4015712211 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561be4ccf370 0x561be4cd1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:47.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.076+0000 7f0c5e5aa640 1 -- 172.21.15.2:0/4015712211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561be4cc45d0 msgr2=0x561be4cc4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:47.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.076+0000 7f0c5e5aa640 1 --2- 172.21.15.2:0/4015712211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561be4cc45d0 0x561be4cc4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:47.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.076+0000 7f0c5e5aa640 1 -- 172.21.15.2:0/4015712211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561be4bb63a0 con 0x561be4cc5b40 2024-09-19T06:23:47.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.076+0000 7f0c5dda9640 1 --2- 172.21.15.2:0/4015712211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561be4cc45d0 0x561be4cc4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:47.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.076+0000 7f0c4effd640 1 -- 172.21.15.2:0/1400692347 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f0c540cf900 con 0x7f0c58100a80 2024-09-19T06:23:47.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.076+0000 7f0c5e5aa640 1 --2- 172.21.15.2:0/1400692347 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f0c440a33b0 0x7f0c440a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:47.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.076+0000 7f0c5e5aa640 1 --2- 172.21.15.2:0/4015712211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561be4cc5b40 0x561be4cc4090 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f0c5000a430 tx=0x7f0c50009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df7099fe355d34c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:47.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.077+0000 7f0c43fff640 1 -- 172.21.15.2:0/4015712211 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c50010c10 con 0x561be4cc5b40 2024-09-19T06:23:47.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.077+0000 7f0c43fff640 1 -- 172.21.15.2:0/4015712211 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0c50010e30 con 0x561be4cc5b40 2024-09-19T06:23:47.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.077+0000 7f0c43fff640 1 -- 172.21.15.2:0/4015712211 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c50013910 con 0x561be4cc5b40 2024-09-19T06:23:47.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.077+0000 7f0c623e6740 1 -- 172.21.15.2:0/4015712211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561be4cc5b40 msgr2=0x561be4cc4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:47.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.077+0000 7f0c5e5aa640 1 --2- 172.21.15.2:0/1400692347 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f0c440a33b0 0x7f0c440a5870 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0c5001e000 tx=0x7f0c5001f710 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:47.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.077+0000 7f0c623e6740 1 --2- 172.21.15.2:0/4015712211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561be4cc5b40 0x561be4cc4090 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f0c5000a430 tx=0x7f0c50009650 comp rx=0 tx=0).stop 2024-09-19T06:23:47.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.078+0000 7f0c623e6740 1 -- 172.21.15.2:0/4015712211 shutdown_connections 2024-09-19T06:23:47.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.078+0000 7f0c623e6740 1 --2- 172.21.15.2:0/4015712211 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561be4ccf370 0x561be4cd1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:47.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.078+0000 7f0c623e6740 1 --2- 172.21.15.2:0/4015712211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561be4cc45d0 0x561be4cc4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:47.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.078+0000 7f0c623e6740 1 --2- 172.21.15.2:0/4015712211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561be4cc5b40 0x561be4cc4090 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:47.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.078+0000 7f0c623e6740 1 -- 172.21.15.2:0/4015712211 >> 172.21.15.2:0/4015712211 conn(0x561be4c8d310 msgr2=0x561be4cc0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:47.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.078+0000 7f0c623e6740 1 -- 172.21.15.2:0/4015712211 shutdown_connections 2024-09-19T06:23:47.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.078+0000 7f0c623e6740 1 -- 172.21.15.2:0/4015712211 wait complete. 2024-09-19T06:23:47.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.078+0000 7f0c623e6740 1 -- start start 2024-09-19T06:23:47.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.078+0000 7f0c623e6740 1 Processor -- start 2024-09-19T06:23:47.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.078+0000 7f0c623e6740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561be4cc45d0 0x561be4cced00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:47.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.078+0000 7f0c623e6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561be4cc5b40 0x561be4ccbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:47.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.079+0000 7f0c623e6740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561be4ccf370 0x561be4ccc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:47.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.079+0000 7f0c623e6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561be4cd2070 con 0x561be4cc5b40 2024-09-19T06:23:47.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.079+0000 7f0c623e6740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x561be4be5060 con 0x561be4ccf370 2024-09-19T06:23:47.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.079+0000 7f0c623e6740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x561be4cd21f0 con 0x561be4cc45d0 2024-09-19T06:23:47.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.079+0000 7f0c623e6740 10 client.0 _ll_register_callbacks cb 0x561be49388c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:47.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.079+0000 7f0c5d5a8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561be4cc5b40 0x561be4ccbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:47.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.079+0000 7f0c5dda9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561be4cc45d0 0x561be4cced00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:47.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.079+0000 7f0c5d5a8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561be4cc5b40 0x561be4ccbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51820/0 (socket says 172.21.15.2:51820) 2024-09-19T06:23:47.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.079+0000 7f0c5dda9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561be4cc45d0 0x561be4cced00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:35344/0 (socket says 172.21.15.2:35344) 2024-09-19T06:23:47.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.079+0000 7f0c5d5a8640 1 -- 172.21.15.2:0/4177927503 learned_addr learned my addr 172.21.15.2:0/4177927503 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:47.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.079+0000 7f0c5e5aa640 1 --2- 172.21.15.2:0/4177927503 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561be4ccf370 0x561be4ccc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:47.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.079+0000 7f0c5dda9640 1 -- 172.21.15.2:0/4177927503 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561be4ccf370 msgr2=0x561be4ccc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:47.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.079+0000 7f0c5dda9640 1 --2- 172.21.15.2:0/4177927503 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561be4ccf370 0x561be4ccc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:47.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.079+0000 7f0c5dda9640 1 -- 172.21.15.2:0/4177927503 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561be4cc5b40 msgr2=0x561be4ccbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:47.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.079+0000 7f0c5dda9640 1 --2- 172.21.15.2:0/4177927503 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561be4cc5b40 0x561be4ccbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:47.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.079+0000 7f0c5dda9640 1 -- 172.21.15.2:0/4177927503 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561be499b3c0 con 0x561be4cc45d0 2024-09-19T06:23:47.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.079+0000 7f0c5d5a8640 1 --2- 172.21.15.2:0/4177927503 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561be4cc5b40 0x561be4ccbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:23:47.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.079+0000 7f0c5dda9640 1 --2- 172.21.15.2:0/4177927503 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561be4cc45d0 0x561be4cced00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0c540ccff0 tx=0x7f0c5409b7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e32486b45980c728 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:47.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.079+0000 7f0c417fa640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-19T06:23:47.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.080+0000 7f0c417fa640 1 -- 172.21.15.2:0/4177927503 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c54020070 con 0x561be4cc45d0 2024-09-19T06:23:47.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.080+0000 7f0c417fa640 1 -- 172.21.15.2:0/4177927503 <== mon.1 v2:172.21.15.90:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f0c5409b080 con 0x561be4cc45d0 2024-09-19T06:23:47.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.080+0000 7f0c623e6740 1 -- 172.21.15.2:0/4177927503 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c50010e30 con 0x561be4cc45d0 2024-09-19T06:23:47.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.080+0000 7f0c417fa640 1 -- 172.21.15.2:0/4177927503 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0c540cd470 con 0x561be4cc45d0 2024-09-19T06:23:47.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.080+0000 7f0c623e6740 10 client.27385 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:47.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.080+0000 7f0c623e6740 1 -- 172.21.15.2:0/4177927503 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561be4cddb50 con 0x561be4cc45d0 2024-09-19T06:23:47.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.080+0000 7f0c417fa640 1 -- 172.21.15.2:0/4177927503 <== mon.1 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0c50010e30 con 0x561be4cc45d0 2024-09-19T06:23:47.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.080+0000 7f0c417fa640 1 -- 172.21.15.2:0/4177927503 <== mon.1 v2:172.21.15.90:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f0c54097980 con 0x561be4cc45d0 2024-09-19T06:23:47.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.080+0000 7f0c623e6740 10 client.27385 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:47.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.080+0000 7f0c623e6740 10 client.27385 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:23:47.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.080+0000 7f0c623e6740 20 client.27385 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:47.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.080+0000 7f0c623e6740 1 --2- 172.21.15.2:0/4177927503 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x561be4cdf010 0x561be4ce1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:47.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.080+0000 7f0c623e6740 4 client.27385 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:23:47.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.080+0000 7f0c623e6740 1 -- 172.21.15.2:0/4177927503 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561be4c37860 con 0x561be4cdf010 2024-09-19T06:23:47.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.081+0000 7f0c5d5a8640 1 --2- 172.21.15.2:0/4177927503 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x561be4cdf010 0x561be4ce1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:47.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.081+0000 7f0c5d5a8640 1 --2- 172.21.15.2:0/4177927503 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x561be4cdf010 0x561be4ce1440 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8ed43b38e3a9a787 server_cookie=9dacaf9171c4a1d6 in_seq=0 out_seq=0 2024-09-19T06:23:47.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.081+0000 7f0c417fa640 10 client.27385 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:23:47.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.082+0000 7f0c417fa640 1 -- 172.21.15.2:0/4177927503 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561be4c37860 con 0x561be4cdf010 2024-09-19T06:23:47.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.082+0000 7f0c417fa640 10 client.27385 handle_command_reply: tid=0 2024-09-19T06:23:47.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.082+0000 7f0c623e6740 1 client.27385 shutdown 2024-09-19T06:23:47.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.082+0000 7f0c623e6740 1 -- 172.21.15.2:0/4177927503 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561be4cc45d0 msgr2=0x561be4cced00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:47.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.082+0000 7f0c623e6740 1 --2- 172.21.15.2:0/4177927503 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561be4cc45d0 0x561be4cced00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0c540ccff0 tx=0x7f0c5409b7f0 comp rx=0 tx=0).stop 2024-09-19T06:23:47.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.082+0000 7f0c623e6740 1 -- 172.21.15.2:0/4177927503 shutdown_connections 2024-09-19T06:23:47.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.082+0000 7f0c623e6740 1 --2- 172.21.15.2:0/4177927503 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x561be4cdf010 0x561be4ce1440 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:47.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.082+0000 7f0c623e6740 1 --2- 172.21.15.2:0/4177927503 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561be4ccf370 0x561be4ccc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:47.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.082+0000 7f0c623e6740 1 --2- 172.21.15.2:0/4177927503 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561be4cc5b40 0x561be4ccbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:47.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.082+0000 7f0c623e6740 1 --2- 172.21.15.2:0/4177927503 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561be4cc45d0 0x561be4cced00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:47.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.082+0000 7f0c417fa640 0 client.27385 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:23:47.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.082+0000 7f0c623e6740 1 -- 172.21.15.2:0/4177927503 >> 172.21.15.2:0/4177927503 conn(0x561be4c8d310 msgr2=0x561be4cc6930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:47.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.082+0000 7f0c623e6740 1 -- 172.21.15.2:0/4177927503 shutdown_connections 2024-09-19T06:23:47.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.082+0000 7f0c623e6740 1 -- 172.21.15.2:0/4177927503 wait complete. 2024-09-19T06:23:47.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.082+0000 7f0c623e6740 20 client.27385 trim_cache size 0 max 16384 2024-09-19T06:23:47.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.095+0000 7f0c623e6740 1 Processor -- start 2024-09-19T06:23:47.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.095+0000 7f0c623e6740 1 -- start start 2024-09-19T06:23:47.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.095+0000 7f0c623e6740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561be4cc45d0 0x561be4ccb870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:47.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.095+0000 7f0c623e6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561be4cc5b40 0x561be4cbfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:47.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.095+0000 7f0c623e6740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561be4ccf370 0x561be4cc7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:47.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.095+0000 7f0c623e6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0c581b2330 con 0x561be4cc5b40 2024-09-19T06:23:47.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.095+0000 7f0c623e6740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0c581afc00 con 0x561be4ccf370 2024-09-19T06:23:47.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.095+0000 7f0c623e6740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0c581ada70 con 0x561be4cc45d0 2024-09-19T06:23:47.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.096+0000 7f0c5d5a8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561be4cc5b40 0x561be4cbfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:47.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.096+0000 7f0c5d5a8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561be4cc5b40 0x561be4cbfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51826/0 (socket says 172.21.15.2:51826) 2024-09-19T06:23:47.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.096+0000 7f0c5d5a8640 1 -- 172.21.15.2:0/3747336820 learned_addr learned my addr 172.21.15.2:0/3747336820 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:47.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.096+0000 7f0c5dda9640 1 --2- 172.21.15.2:0/3747336820 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561be4cc45d0 0x561be4ccb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:47.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.096+0000 7f0c5e5aa640 1 --2- 172.21.15.2:0/3747336820 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561be4ccf370 0x561be4cc7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:47.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.096+0000 7f0c5d5a8640 1 -- 172.21.15.2:0/3747336820 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561be4cc45d0 msgr2=0x561be4ccb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:47.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.096+0000 7f0c5d5a8640 1 --2- 172.21.15.2:0/3747336820 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561be4cc45d0 0x561be4ccb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:47.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.096+0000 7f0c5d5a8640 1 -- 172.21.15.2:0/3747336820 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561be4ccf370 msgr2=0x561be4cc7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:47.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.096+0000 7f0c5d5a8640 1 --2- 172.21.15.2:0/3747336820 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561be4ccf370 0x561be4cc7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:47.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.096+0000 7f0c5d5a8640 1 -- 172.21.15.2:0/3747336820 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561be4cc1960 con 0x561be4cc5b40 2024-09-19T06:23:47.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.096+0000 7f0c5d5a8640 1 --2- 172.21.15.2:0/3747336820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561be4cc5b40 0x561be4cbfbf0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f0c48031440 tx=0x7f0c48000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0f0df4567e4e3df server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:47.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.096+0000 7f0c437fe640 1 -- 172.21.15.2:0/3747336820 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c48035040 con 0x561be4cc5b40 2024-09-19T06:23:47.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.096+0000 7f0c437fe640 1 -- 172.21.15.2:0/3747336820 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0c48031950 con 0x561be4cc5b40 2024-09-19T06:23:47.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.096+0000 7f0c437fe640 1 -- 172.21.15.2:0/3747336820 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c48005460 con 0x561be4cc5b40 2024-09-19T06:23:47.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.097+0000 7f0c623e6740 1 -- 172.21.15.2:0/3747336820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561be4cc5b40 msgr2=0x561be4cbfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:47.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.097+0000 7f0c623e6740 1 --2- 172.21.15.2:0/3747336820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561be4cc5b40 0x561be4cbfbf0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f0c48031440 tx=0x7f0c48000bc0 comp rx=0 tx=0).stop 2024-09-19T06:23:47.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.097+0000 7f0c623e6740 1 -- 172.21.15.2:0/3747336820 shutdown_connections 2024-09-19T06:23:47.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.097+0000 7f0c623e6740 1 --2- 172.21.15.2:0/3747336820 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561be4ccf370 0x561be4cc7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:47.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.097+0000 7f0c623e6740 1 --2- 172.21.15.2:0/3747336820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561be4cc5b40 0x561be4cbfbf0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:47.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.097+0000 7f0c623e6740 1 --2- 172.21.15.2:0/3747336820 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561be4cc45d0 0x561be4ccb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:47.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.097+0000 7f0c623e6740 1 -- 172.21.15.2:0/3747336820 >> 172.21.15.2:0/3747336820 conn(0x561be4c8d310 msgr2=0x561be4cbf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:47.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.097+0000 7f0c623e6740 1 -- 172.21.15.2:0/3747336820 shutdown_connections 2024-09-19T06:23:47.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.097+0000 7f0c623e6740 1 -- 172.21.15.2:0/3747336820 wait complete. 2024-09-19T06:23:47.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.097+0000 7f0c623e6740 1 -- start start 2024-09-19T06:23:47.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.097+0000 7f0c623e6740 1 Processor -- start 2024-09-19T06:23:47.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.098+0000 7f0c623e6740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561be4cc45d0 0x561be4cd79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:47.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.098+0000 7f0c623e6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561be4cc5b40 0x561be4cd2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:47.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.098+0000 7f0c623e6740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561be4ccf370 0x561be4cd3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:47.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.098+0000 7f0c623e6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0c581ae0c0 con 0x561be4cc5b40 2024-09-19T06:23:47.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.098+0000 7f0c623e6740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0c581af530 con 0x561be4ccf370 2024-09-19T06:23:47.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.098+0000 7f0c623e6740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0c581ae790 con 0x561be4cc45d0 2024-09-19T06:23:47.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.098+0000 7f0c623e6740 10 client.0 _ll_register_callbacks cb 0x7f0c5400df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:47.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.098+0000 7f0c5d5a8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561be4cc5b40 0x561be4cd2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:47.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.098+0000 7f0c5d5a8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561be4cc5b40 0x561be4cd2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51836/0 (socket says 172.21.15.2:51836) 2024-09-19T06:23:47.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.098+0000 7f0c5d5a8640 1 -- 172.21.15.2:0/4161292223 learned_addr learned my addr 172.21.15.2:0/4161292223 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:47.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.098+0000 7f0c5e5aa640 1 --2- 172.21.15.2:0/4161292223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561be4ccf370 0x561be4cd3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:47.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.098+0000 7f0c5dda9640 1 --2- 172.21.15.2:0/4161292223 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561be4cc45d0 0x561be4cd79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:47.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.098+0000 7f0c5d5a8640 1 -- 172.21.15.2:0/4161292223 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561be4cc45d0 msgr2=0x561be4cd79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:47.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.098+0000 7f0c5d5a8640 1 --2- 172.21.15.2:0/4161292223 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561be4cc45d0 0x561be4cd79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:47.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.098+0000 7f0c5d5a8640 1 -- 172.21.15.2:0/4161292223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561be4ccf370 msgr2=0x561be4cd3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:47.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.098+0000 7f0c5d5a8640 1 --2- 172.21.15.2:0/4161292223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561be4ccf370 0x561be4cd3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:47.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.098+0000 7f0c5d5a8640 1 -- 172.21.15.2:0/4161292223 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561be4cd38a0 con 0x561be4cc5b40 2024-09-19T06:23:47.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.099+0000 7f0c5d5a8640 1 --2- 172.21.15.2:0/4161292223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561be4cc5b40 0x561be4cd2d20 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f0c48047040 tx=0x7f0c48031d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a7f272d39ceff14 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:47.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.099+0000 7f0c417fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:47.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.099+0000 7f0c417fa640 1 -- 172.21.15.2:0/4161292223 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c48052020 con 0x561be4cc5b40 2024-09-19T06:23:47.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.099+0000 7f0c417fa640 1 -- 172.21.15.2:0/4161292223 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f0c48043040 con 0x561be4cc5b40 2024-09-19T06:23:47.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.099+0000 7f0c623e6740 1 -- 172.21.15.2:0/4161292223 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c48031950 con 0x561be4cc5b40 2024-09-19T06:23:47.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.099+0000 7f0c417fa640 1 -- 172.21.15.2:0/4161292223 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0c4805d050 con 0x561be4cc5b40 2024-09-19T06:23:47.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.099+0000 7f0c623e6740 10 client.18489 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:47.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.099+0000 7f0c623e6740 1 -- 172.21.15.2:0/4161292223 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561be4d49af0 con 0x561be4cc5b40 2024-09-19T06:23:47.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.099+0000 7f0c417fa640 1 -- 172.21.15.2:0/4161292223 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0c48031950 con 0x561be4cc5b40 2024-09-19T06:23:47.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.099+0000 7f0c417fa640 1 -- 172.21.15.2:0/4161292223 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f0c480037b0 con 0x561be4cc5b40 2024-09-19T06:23:47.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.099+0000 7f0c623e6740 10 client.18489 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:47.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.099+0000 7f0c623e6740 10 client.18489 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:23:47.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.099+0000 7f0c623e6740 20 client.18489 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:47.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.100+0000 7f0c623e6740 1 --2- 172.21.15.2:0/4161292223 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x561be4d4a260 0x561be4d4c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:47.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.100+0000 7f0c623e6740 4 client.18489 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:23:47.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.100+0000 7f0c623e6740 1 -- 172.21.15.2:0/4161292223 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561be4c31d70 con 0x561be4d4a260 2024-09-19T06:23:47.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.100+0000 7f0c5dda9640 1 --2- 172.21.15.2:0/4161292223 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x561be4d4a260 0x561be4d4c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:47.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.100+0000 7f0c5dda9640 1 --2- 172.21.15.2:0/4161292223 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x561be4d4a260 0x561be4d4c680 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3a3b36c6222627e9 server_cookie=86baa81575f9ec75 in_seq=0 out_seq=0 2024-09-19T06:23:47.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.100+0000 7f0c417fa640 10 client.18489 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:23:47.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.100+0000 7f0c417fa640 1 -- 172.21.15.2:0/4161292223 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561be4c31d70 con 0x561be4d4a260 2024-09-19T06:23:47.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.100+0000 7f0c417fa640 10 client.18489 handle_command_reply: tid=0 2024-09-19T06:23:47.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.100+0000 7f0c623e6740 1 client.18489 shutdown 2024-09-19T06:23:47.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.100+0000 7f0c623e6740 1 -- 172.21.15.2:0/4161292223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561be4cc5b40 msgr2=0x561be4cd2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:47.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.100+0000 7f0c623e6740 1 --2- 172.21.15.2:0/4161292223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561be4cc5b40 0x561be4cd2d20 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f0c48047040 tx=0x7f0c48031d00 comp rx=0 tx=0).stop 2024-09-19T06:23:47.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.101+0000 7f0c623e6740 1 -- 172.21.15.2:0/4161292223 shutdown_connections 2024-09-19T06:23:47.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.101+0000 7f0c623e6740 1 --2- 172.21.15.2:0/4161292223 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x561be4d4a260 0x561be4d4c680 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:47.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.101+0000 7f0c623e6740 1 --2- 172.21.15.2:0/4161292223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561be4ccf370 0x561be4cd3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:47.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.101+0000 7f0c417fa640 0 client.18489 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:23:47.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.101+0000 7f0c623e6740 1 --2- 172.21.15.2:0/4161292223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561be4cc5b40 0x561be4cd2d20 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:47.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.101+0000 7f0c623e6740 1 --2- 172.21.15.2:0/4161292223 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561be4cc45d0 0x561be4cd79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:47.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.101+0000 7f0c623e6740 1 -- 172.21.15.2:0/4161292223 >> 172.21.15.2:0/4161292223 conn(0x561be4c8d310 msgr2=0x561be4cbf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:47.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.101+0000 7f0c623e6740 1 -- 172.21.15.2:0/4161292223 shutdown_connections 2024-09-19T06:23:47.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.101+0000 7f0c623e6740 1 -- 172.21.15.2:0/4161292223 wait complete. 2024-09-19T06:23:47.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.101+0000 7f0c623e6740 20 client.18489 trim_cache size 0 max 16384 2024-09-19T06:23:47.113 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:23:47.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.101+0000 7f0c6000d640 1 -- 172.21.15.2:0/1400692347 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f0c440a33b0 msgr2=0x7f0c440a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:47.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.101+0000 7f0c6000d640 1 --2- 172.21.15.2:0/1400692347 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f0c440a33b0 0x7f0c440a5870 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0c5001e000 tx=0x7f0c5001f710 comp rx=0 tx=0).stop 2024-09-19T06:23:47.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.101+0000 7f0c6000d640 1 -- 172.21.15.2:0/1400692347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c58100a80 msgr2=0x7f0c5810fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:47.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.101+0000 7f0c6000d640 1 --2- 172.21.15.2:0/1400692347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c58100a80 0x7f0c5810fb00 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f0c5400d950 tx=0x7f0c5400de10 comp rx=0 tx=0).stop 2024-09-19T06:23:47.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.101+0000 7f0c6000d640 1 -- 172.21.15.2:0/1400692347 shutdown_connections 2024-09-19T06:23:47.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.101+0000 7f0c6000d640 1 --2- 172.21.15.2:0/1400692347 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f0c440a33b0 0x7f0c440a5870 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:47.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.101+0000 7f0c6000d640 1 --2- 172.21.15.2:0/1400692347 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c58106a80 0x7f0c58110580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:47.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.101+0000 7f0c6000d640 1 --2- 172.21.15.2:0/1400692347 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c58101420 0x7f0c58110040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:47.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.101+0000 7f0c6000d640 1 --2- 172.21.15.2:0/1400692347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c58100a80 0x7f0c5810fb00 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:47.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.101+0000 7f0c6000d640 1 -- 172.21.15.2:0/1400692347 >> 172.21.15.2:0/1400692347 conn(0x7f0c580fc7a0 msgr2=0x7f0c580fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:47.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.101+0000 7f0c6000d640 1 -- 172.21.15.2:0/1400692347 shutdown_connections 2024-09-19T06:23:47.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:47.101+0000 7f0c6000d640 1 -- 172.21.15.2:0/1400692347 wait complete. 2024-09-19T06:23:47.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:47 smithi002 ceph-mon[30982]: pgmap v278: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:23:47.676 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:23:47.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:47 smithi090 ceph-mon[34497]: pgmap v278: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:23:47.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:47 smithi089 ceph-mon[34160]: pgmap v278: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:23:47.942 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:23:48.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.405+0000 7f227b691640 1 -- 172.21.15.2:0/638101492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2274101280 msgr2=0x7f227410df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:48.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.405+0000 7f227b691640 1 --2- 172.21.15.2:0/638101492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2274101280 0x7f227410df40 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f2264009900 tx=0x7f226402a410 comp rx=0 tx=0).stop 2024-09-19T06:23:48.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.405+0000 7f227b691640 1 -- 172.21.15.2:0/638101492 shutdown_connections 2024-09-19T06:23:48.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.405+0000 7f227b691640 1 --2- 172.21.15.2:0/638101492 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f227410e480 0x7f2274110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.405+0000 7f227b691640 1 --2- 172.21.15.2:0/638101492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2274101280 0x7f227410df40 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.405+0000 7f227b691640 1 --2- 172.21.15.2:0/638101492 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22741008d0 0x7f2274100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.405+0000 7f227b691640 1 -- 172.21.15.2:0/638101492 >> 172.21.15.2:0/638101492 conn(0x7f22740fc7a0 msgr2=0x7f22740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:48.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.405+0000 7f227b691640 1 -- 172.21.15.2:0/638101492 shutdown_connections 2024-09-19T06:23:48.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.405+0000 7f227b691640 1 -- 172.21.15.2:0/638101492 wait complete. 2024-09-19T06:23:48.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.406+0000 7f227b691640 1 Processor -- start 2024-09-19T06:23:48.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.406+0000 7f227b691640 1 -- start start 2024-09-19T06:23:48.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.406+0000 7f227b691640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22741008d0 0x7f227419a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:48.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.406+0000 7f227b691640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2274101280 0x7f227419aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:48.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.406+0000 7f227b691640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f227410e480 0x7f227419ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:48.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.406+0000 7f227b691640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2274114040 con 0x7f227410e480 2024-09-19T06:23:48.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.406+0000 7f227b691640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2274113ec0 con 0x7f2274101280 2024-09-19T06:23:48.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.406+0000 7f227b691640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f22741141c0 con 0x7f22741008d0 2024-09-19T06:23:48.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.406+0000 7f2279c2e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f227410e480 0x7f227419ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:48.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.406+0000 7f2279c2e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f227410e480 0x7f227419ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51864/0 (socket says 172.21.15.2:51864) 2024-09-19T06:23:48.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.406+0000 7f2279c2e640 1 -- 172.21.15.2:0/2481308509 learned_addr learned my addr 172.21.15.2:0/2481308509 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:48.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.406+0000 7f227942d640 1 --2- 172.21.15.2:0/2481308509 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22741008d0 0x7f227419a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:48.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.407+0000 7f2278c2c640 1 --2- 172.21.15.2:0/2481308509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2274101280 0x7f227419aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:48.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.407+0000 7f2279c2e640 1 -- 172.21.15.2:0/2481308509 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22741008d0 msgr2=0x7f227419a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:48.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.407+0000 7f2279c2e640 1 --2- 172.21.15.2:0/2481308509 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22741008d0 0x7f227419a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.407+0000 7f2279c2e640 1 -- 172.21.15.2:0/2481308509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2274101280 msgr2=0x7f227419aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:48.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.407+0000 7f2279c2e640 1 --2- 172.21.15.2:0/2481308509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2274101280 0x7f227419aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.407+0000 7f2279c2e640 1 -- 172.21.15.2:0/2481308509 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f227419f4f0 con 0x7f227410e480 2024-09-19T06:23:48.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.407+0000 7f2278c2c640 1 --2- 172.21.15.2:0/2481308509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2274101280 0x7f227419aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:23:48.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.407+0000 7f2279c2e640 1 --2- 172.21.15.2:0/2481308509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f227410e480 0x7f227419ee10 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f226c009fd0 tx=0x7f226c00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:48.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.407+0000 7f226a7fc640 1 -- 172.21.15.2:0/2481308509 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226c004d20 con 0x7f227410e480 2024-09-19T06:23:48.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.407+0000 7f227b691640 1 -- 172.21.15.2:0/2481308509 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f227419f7e0 con 0x7f227410e480 2024-09-19T06:23:48.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.407+0000 7f226a7fc640 1 -- 172.21.15.2:0/2481308509 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f226c005020 con 0x7f227410e480 2024-09-19T06:23:48.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.407+0000 7f226a7fc640 1 -- 172.21.15.2:0/2481308509 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226c0116b0 con 0x7f227410e480 2024-09-19T06:23:48.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.407+0000 7f227b691640 1 -- 172.21.15.2:0/2481308509 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22741a70c0 con 0x7f227410e480 2024-09-19T06:23:48.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.410+0000 7f226a7fc640 1 -- 172.21.15.2:0/2481308509 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f226c0051d0 con 0x7f227410e480 2024-09-19T06:23:48.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.410+0000 7f227da6a740 1 Processor -- start 2024-09-19T06:23:48.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.410+0000 7f227da6a740 1 -- start start 2024-09-19T06:23:48.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.410+0000 7f227da6a740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56321f194b40 0x56321f193090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:48.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.410+0000 7f227da6a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56321f1935d0 0x56321f193a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:48.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.410+0000 7f227da6a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56321f19e370 0x56321f1a0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:48.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.410+0000 7f227da6a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56321f0f92f0 con 0x56321f19e370 2024-09-19T06:23:48.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.410+0000 7f227da6a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56321f0a0cf0 con 0x56321f1935d0 2024-09-19T06:23:48.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.410+0000 7f227da6a740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56321f0f52b0 con 0x56321f194b40 2024-09-19T06:23:48.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.410+0000 7f2278c2c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56321f19e370 0x56321f1a0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:48.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.410+0000 7f2278c2c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56321f19e370 0x56321f1a0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51872/0 (socket says 172.21.15.2:51872) 2024-09-19T06:23:48.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.410+0000 7f2278c2c640 1 -- 172.21.15.2:0/2507270814 learned_addr learned my addr 172.21.15.2:0/2507270814 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:48.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.410+0000 7f2278c2c640 1 --2- 172.21.15.2:0/2507270814 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56321f194b40 0x56321f193090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:48.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.410+0000 7f227942d640 1 --2- 172.21.15.2:0/2507270814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56321f1935d0 0x56321f193a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:48.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.411+0000 7f226a7fc640 1 --2- 172.21.15.2:0/2481308509 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f22600a33b0 0x7f22600a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:48.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.411+0000 7f2278c2c640 1 -- 172.21.15.2:0/2507270814 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56321f194b40 msgr2=0x56321f193090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:48.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.411+0000 7f2278c2c640 1 --2- 172.21.15.2:0/2507270814 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56321f194b40 0x56321f193090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.411+0000 7f2278c2c640 1 -- 172.21.15.2:0/2507270814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56321f1935d0 msgr2=0x56321f193a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:48.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.411+0000 7f2278c2c640 1 --2- 172.21.15.2:0/2507270814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56321f1935d0 0x56321f193a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.411+0000 7f2278c2c640 1 -- 172.21.15.2:0/2507270814 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56321f0853a0 con 0x56321f19e370 2024-09-19T06:23:48.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.411+0000 7f2279c2e640 1 --2- 172.21.15.2:0/2481308509 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f22600a33b0 0x7f22600a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:48.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.411+0000 7f227942d640 1 --2- 172.21.15.2:0/2507270814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56321f1935d0 0x56321f193a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:23:48.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.411+0000 7f226a7fc640 1 -- 172.21.15.2:0/2481308509 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f226c0cffd0 con 0x7f227410e480 2024-09-19T06:23:48.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.411+0000 7f2278c2c640 1 --2- 172.21.15.2:0/2507270814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56321f19e370 0x56321f1a0760 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f2264032fd0 tx=0x7f2264031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af3a9de0a5be4553 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:48.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.411+0000 7f225f7fe640 1 -- 172.21.15.2:0/2507270814 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2264045070 con 0x56321f19e370 2024-09-19T06:23:48.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.411+0000 7f225f7fe640 1 -- 172.21.15.2:0/2507270814 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f22640035f0 con 0x56321f19e370 2024-09-19T06:23:48.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.411+0000 7f225f7fe640 1 -- 172.21.15.2:0/2507270814 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2264035040 con 0x56321f19e370 2024-09-19T06:23:48.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.411+0000 7f2279c2e640 1 --2- 172.21.15.2:0/2481308509 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f22600a33b0 0x7f22600a5870 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f226c0cd7d0 tx=0x7f226c04b040 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:48.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.412+0000 7f227da6a740 1 -- 172.21.15.2:0/2507270814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56321f19e370 msgr2=0x56321f1a0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:48.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.412+0000 7f227da6a740 1 --2- 172.21.15.2:0/2507270814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56321f19e370 0x56321f1a0760 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f2264032fd0 tx=0x7f2264031400 comp rx=0 tx=0).stop 2024-09-19T06:23:48.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.412+0000 7f227da6a740 1 -- 172.21.15.2:0/2507270814 shutdown_connections 2024-09-19T06:23:48.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.412+0000 7f227da6a740 1 --2- 172.21.15.2:0/2507270814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56321f19e370 0x56321f1a0760 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.412+0000 7f227da6a740 1 --2- 172.21.15.2:0/2507270814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56321f1935d0 0x56321f193a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.412+0000 7f227da6a740 1 --2- 172.21.15.2:0/2507270814 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56321f194b40 0x56321f193090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.412+0000 7f227da6a740 1 -- 172.21.15.2:0/2507270814 >> 172.21.15.2:0/2507270814 conn(0x56321f15c310 msgr2=0x56321f18fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:48.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.412+0000 7f227da6a740 1 -- 172.21.15.2:0/2507270814 shutdown_connections 2024-09-19T06:23:48.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.412+0000 7f227da6a740 1 -- 172.21.15.2:0/2507270814 wait complete. 2024-09-19T06:23:48.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.412+0000 7f227da6a740 1 -- start start 2024-09-19T06:23:48.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.413+0000 7f227da6a740 1 Processor -- start 2024-09-19T06:23:48.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.413+0000 7f227da6a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56321f1935d0 0x56321f19ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:48.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.413+0000 7f227da6a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56321f194b40 0x56321f19b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:48.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.413+0000 7f227da6a740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56321f19e370 0x56321f19b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:48.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.413+0000 7f227da6a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56321f1a1010 con 0x56321f1935d0 2024-09-19T06:23:48.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.413+0000 7f227da6a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56321f0b4060 con 0x56321f194b40 2024-09-19T06:23:48.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.413+0000 7f227da6a740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56321f1a1190 con 0x56321f19e370 2024-09-19T06:23:48.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.413+0000 7f2278c2c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56321f1935d0 0x56321f19ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:48.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.413+0000 7f227da6a740 10 client.0 _ll_register_callbacks cb 0x56321ee078c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:48.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.413+0000 7f2278c2c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56321f1935d0 0x56321f19ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51884/0 (socket says 172.21.15.2:51884) 2024-09-19T06:23:48.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.413+0000 7f2278c2c640 1 -- 172.21.15.2:0/1999338806 learned_addr learned my addr 172.21.15.2:0/1999338806 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:48.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.413+0000 7f227942d640 1 --2- 172.21.15.2:0/1999338806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56321f194b40 0x56321f19b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:48.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.413+0000 7f2278c2c640 1 -- 172.21.15.2:0/1999338806 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56321f19e370 msgr2=0x56321f19b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:48.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.413+0000 7f2278c2c640 1 --2- 172.21.15.2:0/1999338806 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56321f19e370 0x56321f19b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.413+0000 7f2278c2c640 1 -- 172.21.15.2:0/1999338806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56321f194b40 msgr2=0x56321f19b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:48.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.413+0000 7f2278c2c640 1 --2- 172.21.15.2:0/1999338806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56321f194b40 0x56321f19b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.413+0000 7f2278c2c640 1 -- 172.21.15.2:0/1999338806 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56321ee6a3c0 con 0x56321f1935d0 2024-09-19T06:23:48.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.413+0000 7f227942d640 1 --2- 172.21.15.2:0/1999338806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56321f194b40 0x56321f19b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:23:48.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.414+0000 7f2278c2c640 1 --2- 172.21.15.2:0/1999338806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56321f1935d0 0x56321f19ddd0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f2264033000 tx=0x7f2264003d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7f924480b9914e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:48.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.414+0000 7f225cff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:48.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.414+0000 7f225cff9640 1 -- 172.21.15.2:0/1999338806 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226404d020 con 0x56321f1935d0 2024-09-19T06:23:48.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.414+0000 7f225cff9640 1 -- 172.21.15.2:0/1999338806 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f22640041e0 con 0x56321f1935d0 2024-09-19T06:23:48.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.414+0000 7f227da6a740 1 -- 172.21.15.2:0/1999338806 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22640035f0 con 0x56321f1935d0 2024-09-19T06:23:48.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.414+0000 7f225cff9640 1 -- 172.21.15.2:0/1999338806 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2264058050 con 0x56321f1935d0 2024-09-19T06:23:48.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.414+0000 7f227da6a740 10 client.18501 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:48.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.414+0000 7f227da6a740 1 -- 172.21.15.2:0/1999338806 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56321f1acb30 con 0x56321f1935d0 2024-09-19T06:23:48.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.414+0000 7f225cff9640 1 -- 172.21.15.2:0/1999338806 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f22640035f0 con 0x56321f1935d0 2024-09-19T06:23:48.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.414+0000 7f225cff9640 1 -- 172.21.15.2:0/1999338806 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f226403a040 con 0x56321f1935d0 2024-09-19T06:23:48.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.415+0000 7f227da6a740 10 client.18501 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:48.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.415+0000 7f227da6a740 10 client.18501 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:23:48.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.415+0000 7f227da6a740 20 client.18501 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:48.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.415+0000 7f227da6a740 1 --2- 172.21.15.2:0/1999338806 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x56321f1ade80 0x56321f1b0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:48.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.415+0000 7f227da6a740 4 client.18501 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:23:48.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.415+0000 7f227da6a740 1 -- 172.21.15.2:0/1999338806 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56321f106860 con 0x56321f1ade80 2024-09-19T06:23:48.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.415+0000 7f227942d640 1 --2- 172.21.15.2:0/1999338806 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x56321f1ade80 0x56321f1b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:48.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.415+0000 7f225cff9640 10 client.18501 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:23:48.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.415+0000 7f227942d640 1 --2- 172.21.15.2:0/1999338806 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x56321f1ade80 0x56321f1b0270 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=60a1a80327b5c53b server_cookie=24e154807760d7c6 in_seq=0 out_seq=0 2024-09-19T06:23:48.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.416+0000 7f225cff9640 1 -- 172.21.15.2:0/1999338806 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56321f106860 con 0x56321f1ade80 2024-09-19T06:23:48.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.416+0000 7f225cff9640 10 client.18501 handle_command_reply: tid=0 2024-09-19T06:23:48.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.416+0000 7f227da6a740 1 client.18501 shutdown 2024-09-19T06:23:48.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.416+0000 7f227da6a740 1 -- 172.21.15.2:0/1999338806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56321f1935d0 msgr2=0x56321f19ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:48.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.416+0000 7f227da6a740 1 --2- 172.21.15.2:0/1999338806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56321f1935d0 0x56321f19ddd0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f2264033000 tx=0x7f2264003d70 comp rx=0 tx=0).stop 2024-09-19T06:23:48.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.416+0000 7f227da6a740 1 -- 172.21.15.2:0/1999338806 shutdown_connections 2024-09-19T06:23:48.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.416+0000 7f227da6a740 1 --2- 172.21.15.2:0/1999338806 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x56321f1ade80 0x56321f1b0270 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.416+0000 7f227da6a740 1 --2- 172.21.15.2:0/1999338806 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56321f19e370 0x56321f19b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.416+0000 7f227da6a740 1 --2- 172.21.15.2:0/1999338806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56321f194b40 0x56321f19b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.416+0000 7f227da6a740 1 --2- 172.21.15.2:0/1999338806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56321f1935d0 0x56321f19ddd0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.416+0000 7f227da6a740 1 -- 172.21.15.2:0/1999338806 >> 172.21.15.2:0/1999338806 conn(0x56321f15c310 msgr2=0x56321f195960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:48.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.416+0000 7f225cff9640 0 client.18501 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:23:48.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.416+0000 7f227da6a740 1 -- 172.21.15.2:0/1999338806 shutdown_connections 2024-09-19T06:23:48.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.416+0000 7f227da6a740 1 -- 172.21.15.2:0/1999338806 wait complete. 2024-09-19T06:23:48.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.416+0000 7f227da6a740 20 client.18501 trim_cache size 0 max 16384 2024-09-19T06:23:48.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.429+0000 7f227da6a740 1 Processor -- start 2024-09-19T06:23:48.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.430+0000 7f227da6a740 1 -- start start 2024-09-19T06:23:48.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.430+0000 7f227da6a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56321f1935d0 0x56321f1a9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:48.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.430+0000 7f227da6a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56321f194b40 0x56321f1982e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:48.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.430+0000 7f227da6a740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56321f19e370 0x56321f198820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:48.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.430+0000 7f227da6a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f22741b21b0 con 0x56321f194b40 2024-09-19T06:23:48.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.430+0000 7f227da6a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f22741afa80 con 0x56321f1935d0 2024-09-19T06:23:48.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.430+0000 7f227da6a740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f22741ad8f0 con 0x56321f19e370 2024-09-19T06:23:48.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.430+0000 7f227942d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56321f194b40 0x56321f1982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:48.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.430+0000 7f227942d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56321f194b40 0x56321f1982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51886/0 (socket says 172.21.15.2:51886) 2024-09-19T06:23:48.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.430+0000 7f227942d640 1 -- 172.21.15.2:0/1995136248 learned_addr learned my addr 172.21.15.2:0/1995136248 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:48.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.430+0000 7f2278c2c640 1 --2- 172.21.15.2:0/1995136248 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56321f1935d0 0x56321f1a9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:48.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.430+0000 7f227942d640 1 -- 172.21.15.2:0/1995136248 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56321f19e370 msgr2=0x56321f198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:48.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.430+0000 7f2278c2c640 1 --2- 172.21.15.2:0/1995136248 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56321f19e370 0x56321f198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:48.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.430+0000 7f227942d640 1 --2- 172.21.15.2:0/1995136248 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56321f19e370 0x56321f198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.430+0000 7f227942d640 1 -- 172.21.15.2:0/1995136248 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56321f1935d0 msgr2=0x56321f1a9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:48.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.430+0000 7f227942d640 1 --2- 172.21.15.2:0/1995136248 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56321f1935d0 0x56321f1a9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.430+0000 7f227942d640 1 -- 172.21.15.2:0/1995136248 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56321f19c020 con 0x56321f194b40 2024-09-19T06:23:48.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.430+0000 7f2278c2c640 1 --2- 172.21.15.2:0/1995136248 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56321f19e370 0x56321f198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:23:48.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.430+0000 7f227942d640 1 --2- 172.21.15.2:0/1995136248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56321f194b40 0x56321f1982e0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f2270005e00 tx=0x7f227000c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6d1ec9544c1ac6f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:48.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.431+0000 7f225effd640 1 -- 172.21.15.2:0/1995136248 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2270003cf0 con 0x56321f194b40 2024-09-19T06:23:48.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.431+0000 7f225effd640 1 -- 172.21.15.2:0/1995136248 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2270003e90 con 0x56321f194b40 2024-09-19T06:23:48.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.431+0000 7f225effd640 1 -- 172.21.15.2:0/1995136248 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22700117c0 con 0x56321f194b40 2024-09-19T06:23:48.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.431+0000 7f227da6a740 1 -- 172.21.15.2:0/1995136248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56321f194b40 msgr2=0x56321f1982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:48.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.431+0000 7f227da6a740 1 --2- 172.21.15.2:0/1995136248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56321f194b40 0x56321f1982e0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f2270005e00 tx=0x7f227000c4b0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.431+0000 7f227da6a740 1 -- 172.21.15.2:0/1995136248 shutdown_connections 2024-09-19T06:23:48.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.431+0000 7f227da6a740 1 --2- 172.21.15.2:0/1995136248 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56321f19e370 0x56321f198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.431+0000 7f227da6a740 1 --2- 172.21.15.2:0/1995136248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56321f194b40 0x56321f1982e0 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.431+0000 7f227da6a740 1 --2- 172.21.15.2:0/1995136248 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56321f1935d0 0x56321f1a9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.431+0000 7f227da6a740 1 -- 172.21.15.2:0/1995136248 >> 172.21.15.2:0/1995136248 conn(0x56321f15c310 msgr2=0x56321f1a9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:48.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.431+0000 7f227da6a740 1 -- 172.21.15.2:0/1995136248 shutdown_connections 2024-09-19T06:23:48.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.431+0000 7f227da6a740 1 -- 172.21.15.2:0/1995136248 wait complete. 2024-09-19T06:23:48.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.431+0000 7f227da6a740 1 -- start start 2024-09-19T06:23:48.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.432+0000 7f227da6a740 1 Processor -- start 2024-09-19T06:23:48.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.432+0000 7f227da6a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56321f1935d0 0x56321f1b35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:48.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.432+0000 7f227da6a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56321f194b40 0x56321f1b0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:48.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.432+0000 7f227da6a740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56321f19e370 0x56321f1b0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:48.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.432+0000 7f227da6a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f22741adf40 con 0x56321f1935d0 2024-09-19T06:23:48.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.432+0000 7f227da6a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f22741af3b0 con 0x56321f194b40 2024-09-19T06:23:48.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.432+0000 7f227da6a740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f22741ae610 con 0x56321f19e370 2024-09-19T06:23:48.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.432+0000 7f227da6a740 10 client.0 _ll_register_callbacks cb 0x7f227000c350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:48.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.432+0000 7f2278c2c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56321f1935d0 0x56321f1b35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:48.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.432+0000 7f2278c2c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56321f1935d0 0x56321f1b35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51900/0 (socket says 172.21.15.2:51900) 2024-09-19T06:23:48.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.432+0000 7f2278c2c640 1 -- 172.21.15.2:0/4159625360 learned_addr learned my addr 172.21.15.2:0/4159625360 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:48.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.432+0000 7f227942d640 1 --2- 172.21.15.2:0/4159625360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56321f194b40 0x56321f1b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:48.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.432+0000 7f2278c2c640 1 -- 172.21.15.2:0/4159625360 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56321f19e370 msgr2=0x56321f1b0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:48.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.432+0000 7f2278c2c640 1 --2- 172.21.15.2:0/4159625360 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56321f19e370 0x56321f1b0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.432+0000 7f2278c2c640 1 -- 172.21.15.2:0/4159625360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56321f194b40 msgr2=0x56321f1b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:48.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.432+0000 7f2278c2c640 1 --2- 172.21.15.2:0/4159625360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56321f194b40 0x56321f1b0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.432+0000 7f2278c2c640 1 -- 172.21.15.2:0/4159625360 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56321f1b1680 con 0x56321f1935d0 2024-09-19T06:23:48.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.432+0000 7f227942d640 1 --2- 172.21.15.2:0/4159625360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56321f194b40 0x56321f1b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:48.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.433+0000 7f2278c2c640 1 --2- 172.21.15.2:0/4159625360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56321f1935d0 0x56321f1b35c0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f22640092a0 tx=0x7f2264032f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea2a47a2d2e49ecd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:48.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.433+0000 7f225cff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:48.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.433+0000 7f225cff9640 1 -- 172.21.15.2:0/4159625360 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2264042070 con 0x56321f1935d0 2024-09-19T06:23:48.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.433+0000 7f225cff9640 1 -- 172.21.15.2:0/4159625360 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f226403e800 con 0x56321f1935d0 2024-09-19T06:23:48.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.433+0000 7f227da6a740 1 -- 172.21.15.2:0/4159625360 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2270003e90 con 0x56321f1935d0 2024-09-19T06:23:48.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.433+0000 7f225cff9640 1 -- 172.21.15.2:0/4159625360 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f226406a050 con 0x56321f1935d0 2024-09-19T06:23:48.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.433+0000 7f227da6a740 10 client.18507 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:48.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.433+0000 7f227da6a740 1 -- 172.21.15.2:0/4159625360 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56321f2186e0 con 0x56321f1935d0 2024-09-19T06:23:48.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.433+0000 7f225cff9640 1 -- 172.21.15.2:0/4159625360 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2270003e90 con 0x56321f1935d0 2024-09-19T06:23:48.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.433+0000 7f225cff9640 1 -- 172.21.15.2:0/4159625360 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f226403a040 con 0x56321f1935d0 2024-09-19T06:23:48.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.434+0000 7f227da6a740 10 client.18507 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:48.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.434+0000 7f227da6a740 10 client.18507 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:23:48.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.434+0000 7f227da6a740 20 client.18507 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:48.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.434+0000 7f227da6a740 1 --2- 172.21.15.2:0/4159625360 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x56321f218da0 0x56321f21b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:48.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.434+0000 7f227da6a740 4 client.18507 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:23:48.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.434+0000 7f227da6a740 1 -- 172.21.15.2:0/4159625360 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56321f100d70 con 0x56321f218da0 2024-09-19T06:23:48.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.434+0000 7f227942d640 1 --2- 172.21.15.2:0/4159625360 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x56321f218da0 0x56321f21b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:48.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.434+0000 7f227942d640 1 --2- 172.21.15.2:0/4159625360 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x56321f218da0 0x56321f21b1c0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bec6f88c76b68efe server_cookie=3c380f1917ef2af1 in_seq=0 out_seq=0 2024-09-19T06:23:48.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.434+0000 7f225cff9640 10 client.18507 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:23:48.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.434+0000 7f225cff9640 1 -- 172.21.15.2:0/4159625360 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56321f100d70 con 0x56321f218da0 2024-09-19T06:23:48.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.434+0000 7f225cff9640 10 client.18507 handle_command_reply: tid=0 2024-09-19T06:23:48.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.434+0000 7f227da6a740 1 client.18507 shutdown 2024-09-19T06:23:48.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.435+0000 7f227da6a740 1 -- 172.21.15.2:0/4159625360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56321f1935d0 msgr2=0x56321f1b35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:48.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.435+0000 7f227da6a740 1 --2- 172.21.15.2:0/4159625360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56321f1935d0 0x56321f1b35c0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f22640092a0 tx=0x7f2264032f30 comp rx=0 tx=0).stop 2024-09-19T06:23:48.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.435+0000 7f227da6a740 1 -- 172.21.15.2:0/4159625360 shutdown_connections 2024-09-19T06:23:48.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.435+0000 7f227da6a740 1 --2- 172.21.15.2:0/4159625360 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x56321f218da0 0x56321f21b1c0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.435+0000 7f227da6a740 1 --2- 172.21.15.2:0/4159625360 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56321f19e370 0x56321f1b0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.435+0000 7f227da6a740 1 --2- 172.21.15.2:0/4159625360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56321f194b40 0x56321f1b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.435+0000 7f225cff9640 0 client.18507 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:23:48.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.435+0000 7f227da6a740 1 --2- 172.21.15.2:0/4159625360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56321f1935d0 0x56321f1b35c0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.435+0000 7f227da6a740 1 -- 172.21.15.2:0/4159625360 >> 172.21.15.2:0/4159625360 conn(0x56321f15c310 msgr2=0x56321f1a9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:48.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.435+0000 7f227da6a740 1 -- 172.21.15.2:0/4159625360 shutdown_connections 2024-09-19T06:23:48.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.435+0000 7f227da6a740 1 -- 172.21.15.2:0/4159625360 wait complete. 2024-09-19T06:23:48.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.435+0000 7f227da6a740 20 client.18507 trim_cache size 0 max 16384 2024-09-19T06:23:48.443 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:23:48.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.435+0000 7f227b691640 1 -- 172.21.15.2:0/2481308509 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f22600a33b0 msgr2=0x7f22600a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:48.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.435+0000 7f227b691640 1 --2- 172.21.15.2:0/2481308509 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f22600a33b0 0x7f22600a5870 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f226c0cd7d0 tx=0x7f226c04b040 comp rx=0 tx=0).stop 2024-09-19T06:23:48.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.435+0000 7f227b691640 1 -- 172.21.15.2:0/2481308509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f227410e480 msgr2=0x7f227419ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:48.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.435+0000 7f227b691640 1 --2- 172.21.15.2:0/2481308509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f227410e480 0x7f227419ee10 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f226c009fd0 tx=0x7f226c00ee60 comp rx=0 tx=0).stop 2024-09-19T06:23:48.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.436+0000 7f227b691640 1 -- 172.21.15.2:0/2481308509 shutdown_connections 2024-09-19T06:23:48.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.436+0000 7f227b691640 1 --2- 172.21.15.2:0/2481308509 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f22600a33b0 0x7f22600a5870 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.436+0000 7f227b691640 1 --2- 172.21.15.2:0/2481308509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f227410e480 0x7f227419ee10 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.436+0000 7f227b691640 1 --2- 172.21.15.2:0/2481308509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2274101280 0x7f227419aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.436+0000 7f227b691640 1 --2- 172.21.15.2:0/2481308509 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22741008d0 0x7f227419a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.436+0000 7f227b691640 1 -- 172.21.15.2:0/2481308509 >> 172.21.15.2:0/2481308509 conn(0x7f22740fc7a0 msgr2=0x7f22740feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:48.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.436+0000 7f227b691640 1 -- 172.21.15.2:0/2481308509 shutdown_connections 2024-09-19T06:23:48.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:48.436+0000 7f227b691640 1 -- 172.21.15.2:0/2481308509 wait complete. 2024-09-19T06:23:49.151 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:23:49.411 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:23:49.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:49 smithi002 ceph-mon[30982]: pgmap v279: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:23:49.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:49 smithi090 ceph-mon[34497]: pgmap v279: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:23:49.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:49 smithi089 ceph-mon[34160]: pgmap v279: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:23:49.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.861+0000 7f96cd976640 1 -- 172.21.15.2:0/2629193155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96c8101df0 msgr2=0x7f96c81021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:49.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.861+0000 7f96cd976640 1 --2- 172.21.15.2:0/2629193155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96c8101df0 0x7f96c81021d0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f96c0009900 tx=0x7f96c002a410 comp rx=0 tx=0).stop 2024-09-19T06:23:49.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.861+0000 7f96cd976640 1 -- 172.21.15.2:0/2629193155 shutdown_connections 2024-09-19T06:23:49.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.861+0000 7f96cd976640 1 --2- 172.21.15.2:0/2629193155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96c8106f20 0x7f96c810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:49.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.861+0000 7f96cd976640 1 --2- 172.21.15.2:0/2629193155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96c81027a0 0x7f96c81067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:49.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.861+0000 7f96cd976640 1 --2- 172.21.15.2:0/2629193155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96c8101df0 0x7f96c81021d0 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:49.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.861+0000 7f96cd976640 1 -- 172.21.15.2:0/2629193155 >> 172.21.15.2:0/2629193155 conn(0x7f96c80fd8f0 msgr2=0x7f96c80ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:49.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.861+0000 7f96cd976640 1 -- 172.21.15.2:0/2629193155 shutdown_connections 2024-09-19T06:23:49.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.861+0000 7f96cd976640 1 -- 172.21.15.2:0/2629193155 wait complete. 2024-09-19T06:23:49.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.861+0000 7f96cd976640 1 Processor -- start 2024-09-19T06:23:49.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.862+0000 7f96cd976640 1 -- start start 2024-09-19T06:23:49.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.862+0000 7f96cd976640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96c8101df0 0x7f96c80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:49.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.862+0000 7f96cd976640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96c81027a0 0x7f96c8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:49.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.862+0000 7f96cd976640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96c8106f20 0x7f96c8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:49.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.862+0000 7f96cd976640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f96c8111df0 con 0x7f96c8101df0 2024-09-19T06:23:49.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.862+0000 7f96cd976640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f96c8111c70 con 0x7f96c8106f20 2024-09-19T06:23:49.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.862+0000 7f96cd976640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f96c8111f70 con 0x7f96c81027a0 2024-09-19T06:23:49.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.862+0000 7f96c6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96c8101df0 0x7f96c80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:49.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.862+0000 7f96c6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96c8101df0 0x7f96c80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51926/0 (socket says 172.21.15.2:51926) 2024-09-19T06:23:49.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.862+0000 7f96c6ffd640 1 -- 172.21.15.2:0/3618708362 learned_addr learned my addr 172.21.15.2:0/3618708362 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:49.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.862+0000 7f96c67fc640 1 --2- 172.21.15.2:0/3618708362 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96c81027a0 0x7f96c8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:49.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.862+0000 7f96c77fe640 1 --2- 172.21.15.2:0/3618708362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96c8106f20 0x7f96c8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:49.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.862+0000 7f96c6ffd640 1 -- 172.21.15.2:0/3618708362 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96c81027a0 msgr2=0x7f96c8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:49.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.862+0000 7f96c6ffd640 1 --2- 172.21.15.2:0/3618708362 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96c81027a0 0x7f96c8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:49.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.862+0000 7f96c6ffd640 1 -- 172.21.15.2:0/3618708362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96c8106f20 msgr2=0x7f96c8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:49.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.862+0000 7f96c6ffd640 1 --2- 172.21.15.2:0/3618708362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96c8106f20 0x7f96c8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:49.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.862+0000 7f96c6ffd640 1 -- 172.21.15.2:0/3618708362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96c81a6830 con 0x7f96c8101df0 2024-09-19T06:23:49.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.863+0000 7f96c6ffd640 1 --2- 172.21.15.2:0/3618708362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96c8101df0 0x7f96c80744f0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f96c0005940 tx=0x7f96c0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:49.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.863+0000 7f96cc974640 1 -- 172.21.15.2:0/3618708362 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c003f030 con 0x7f96c8101df0 2024-09-19T06:23:49.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.863+0000 7f96cc974640 1 -- 172.21.15.2:0/3618708362 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f96c0003aa0 con 0x7f96c8101df0 2024-09-19T06:23:49.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.863+0000 7f96cd976640 1 -- 172.21.15.2:0/3618708362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96c81a6ac0 con 0x7f96c8101df0 2024-09-19T06:23:49.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.863+0000 7f96cd976640 1 -- 172.21.15.2:0/3618708362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96c81a6fa0 con 0x7f96c8101df0 2024-09-19T06:23:49.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.863+0000 7f96cc974640 1 -- 172.21.15.2:0/3618708362 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c0035070 con 0x7f96c8101df0 2024-09-19T06:23:49.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.865+0000 7f96cc974640 1 -- 172.21.15.2:0/3618708362 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f96c0042030 con 0x7f96c8101df0 2024-09-19T06:23:49.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.865+0000 7f96cfd4f740 1 Processor -- start 2024-09-19T06:23:49.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.866+0000 7f96cfd4f740 1 -- start start 2024-09-19T06:23:49.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.866+0000 7f96cfd4f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ea737b7b40 0x55ea737b6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:49.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.866+0000 7f96cfd4f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea737b65d0 0x55ea737b6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:49.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.866+0000 7f96cfd4f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea737c1370 0x55ea737c3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:49.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.866+0000 7f96cfd4f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ea7371c2f0 con 0x55ea737b65d0 2024-09-19T06:23:49.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.866+0000 7f96cfd4f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55ea736c3cf0 con 0x55ea737c1370 2024-09-19T06:23:49.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.866+0000 7f96cfd4f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55ea737182b0 con 0x55ea737b7b40 2024-09-19T06:23:49.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.866+0000 7f96c6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea737b65d0 0x55ea737b6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:49.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.866+0000 7f96c6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea737b65d0 0x55ea737b6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51932/0 (socket says 172.21.15.2:51932) 2024-09-19T06:23:49.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.866+0000 7f96c6ffd640 1 -- 172.21.15.2:0/1599670532 learned_addr learned my addr 172.21.15.2:0/1599670532 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:49.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.866+0000 7f96c77fe640 1 --2- 172.21.15.2:0/1599670532 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ea737b7b40 0x55ea737b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:49.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.866+0000 7f96c67fc640 1 --2- 172.21.15.2:0/1599670532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea737c1370 0x55ea737c3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:49.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.866+0000 7f96c6ffd640 1 -- 172.21.15.2:0/1599670532 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ea737b7b40 msgr2=0x55ea737b6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:49.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.866+0000 7f96c6ffd640 1 --2- 172.21.15.2:0/1599670532 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ea737b7b40 0x55ea737b6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:49.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.866+0000 7f96c6ffd640 1 -- 172.21.15.2:0/1599670532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea737c1370 msgr2=0x55ea737c3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:49.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.866+0000 7f96c6ffd640 1 --2- 172.21.15.2:0/1599670532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea737c1370 0x55ea737c3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:49.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.866+0000 7f96c6ffd640 1 -- 172.21.15.2:0/1599670532 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea736a83a0 con 0x55ea737b65d0 2024-09-19T06:23:49.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.866+0000 7f96c67fc640 1 --2- 172.21.15.2:0/1599670532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea737c1370 0x55ea737c3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:49.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.867+0000 7f96c6ffd640 1 --2- 172.21.15.2:0/1599670532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea737b65d0 0x55ea737b6a10 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f96c00ed900 tx=0x7f96c00f66c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26ac0a2e36f12643 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:49.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.867+0000 7f96cc974640 1 --2- 172.21.15.2:0/3618708362 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f96b40a33b0 0x7f96b40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:49.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.867+0000 7f96c77fe640 1 --2- 172.21.15.2:0/3618708362 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f96b40a33b0 0x7f96b40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:49.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.867+0000 7f96bdffb640 1 -- 172.21.15.2:0/1599670532 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c00b87c0 con 0x55ea737b65d0 2024-09-19T06:23:49.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.867+0000 7f96cc974640 1 -- 172.21.15.2:0/3618708362 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f96c00f02a0 con 0x7f96c8101df0 2024-09-19T06:23:49.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.867+0000 7f96bdffb640 1 -- 172.21.15.2:0/1599670532 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f96c00fd030 con 0x55ea737b65d0 2024-09-19T06:23:49.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.867+0000 7f96bdffb640 1 -- 172.21.15.2:0/1599670532 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c00b9f70 con 0x55ea737b65d0 2024-09-19T06:23:49.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.868+0000 7f96cfd4f740 1 -- 172.21.15.2:0/1599670532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea737b65d0 msgr2=0x55ea737b6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:49.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.868+0000 7f96c77fe640 1 --2- 172.21.15.2:0/3618708362 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f96b40a33b0 0x7f96b40a5870 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f96b8005fd0 tx=0x7f96b8009600 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:49.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.868+0000 7f96cfd4f740 1 --2- 172.21.15.2:0/1599670532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea737b65d0 0x55ea737b6a10 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f96c00ed900 tx=0x7f96c00f66c0 comp rx=0 tx=0).stop 2024-09-19T06:23:49.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.868+0000 7f96cfd4f740 1 -- 172.21.15.2:0/1599670532 shutdown_connections 2024-09-19T06:23:49.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.868+0000 7f96cfd4f740 1 --2- 172.21.15.2:0/1599670532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea737c1370 0x55ea737c3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:49.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.868+0000 7f96cfd4f740 1 --2- 172.21.15.2:0/1599670532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea737b65d0 0x55ea737b6a10 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:49.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.868+0000 7f96cfd4f740 1 --2- 172.21.15.2:0/1599670532 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ea737b7b40 0x55ea737b6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:49.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.868+0000 7f96cfd4f740 1 -- 172.21.15.2:0/1599670532 >> 172.21.15.2:0/1599670532 conn(0x55ea7377f310 msgr2=0x55ea737b2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:49.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.868+0000 7f96cfd4f740 1 -- 172.21.15.2:0/1599670532 shutdown_connections 2024-09-19T06:23:49.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.868+0000 7f96cfd4f740 1 -- 172.21.15.2:0/1599670532 wait complete. 2024-09-19T06:23:49.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.868+0000 7f96cfd4f740 1 -- start start 2024-09-19T06:23:49.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.868+0000 7f96cfd4f740 1 Processor -- start 2024-09-19T06:23:49.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.869+0000 7f96cfd4f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea737b65d0 0x55ea737c0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:49.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.869+0000 7f96cfd4f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea737b7b40 0x55ea737bdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:49.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.869+0000 7f96cfd4f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ea737c1370 0x55ea737be5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:49.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.869+0000 7f96cfd4f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ea737c3e30 con 0x55ea737b7b40 2024-09-19T06:23:49.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.869+0000 7f96cfd4f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55ea736d7060 con 0x55ea737b65d0 2024-09-19T06:23:49.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.869+0000 7f96cfd4f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55ea737c3fb0 con 0x55ea737c1370 2024-09-19T06:23:49.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.869+0000 7f96cfd4f740 10 client.0 _ll_register_callbacks cb 0x55ea7342a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:49.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.869+0000 7f96c67fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea737b7b40 0x55ea737bdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:49.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.869+0000 7f96c67fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea737b7b40 0x55ea737bdfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51948/0 (socket says 172.21.15.2:51948) 2024-09-19T06:23:49.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.869+0000 7f96c67fc640 1 -- 172.21.15.2:0/1964713519 learned_addr learned my addr 172.21.15.2:0/1964713519 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:49.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.869+0000 7f96c77fe640 1 --2- 172.21.15.2:0/1964713519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ea737c1370 0x55ea737be5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:49.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.869+0000 7f96c6ffd640 1 --2- 172.21.15.2:0/1964713519 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea737b65d0 0x55ea737c0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:49.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.869+0000 7f96c67fc640 1 -- 172.21.15.2:0/1964713519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ea737c1370 msgr2=0x55ea737be5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:49.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.869+0000 7f96c67fc640 1 --2- 172.21.15.2:0/1964713519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ea737c1370 0x55ea737be5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:49.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.869+0000 7f96c67fc640 1 -- 172.21.15.2:0/1964713519 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea737b65d0 msgr2=0x55ea737c0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:49.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.869+0000 7f96c67fc640 1 --2- 172.21.15.2:0/1964713519 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea737b65d0 0x55ea737c0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:49.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.869+0000 7f96c67fc640 1 -- 172.21.15.2:0/1964713519 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea7348d3c0 con 0x55ea737b7b40 2024-09-19T06:23:49.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.869+0000 7f96c6ffd640 1 --2- 172.21.15.2:0/1964713519 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea737b65d0 0x55ea737c0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:49.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.869+0000 7f96c67fc640 1 --2- 172.21.15.2:0/1964713519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea737b7b40 0x55ea737bdfe0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f96b0012750 tx=0x7f96b0012b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7888ac5847b4def7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:49.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.869+0000 7f96a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:49.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.870+0000 7f96a6ffd640 1 -- 172.21.15.2:0/1964713519 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b001f060 con 0x55ea737b7b40 2024-09-19T06:23:49.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.870+0000 7f96a6ffd640 1 -- 172.21.15.2:0/1964713519 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f96b0010dc0 con 0x55ea737b7b40 2024-09-19T06:23:49.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.870+0000 7f96cfd4f740 1 -- 172.21.15.2:0/1964713519 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96c00fd030 con 0x55ea737b7b40 2024-09-19T06:23:49.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.870+0000 7f96a6ffd640 1 -- 172.21.15.2:0/1964713519 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f96b001a430 con 0x55ea737b7b40 2024-09-19T06:23:49.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.870+0000 7f96cfd4f740 10 client.18519 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:49.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.870+0000 7f96cfd4f740 1 -- 172.21.15.2:0/1964713519 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ea737cf870 con 0x55ea737b7b40 2024-09-19T06:23:49.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.870+0000 7f96a6ffd640 1 -- 172.21.15.2:0/1964713519 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f96c00fd030 con 0x55ea737b7b40 2024-09-19T06:23:49.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.870+0000 7f96a6ffd640 1 -- 172.21.15.2:0/1964713519 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f96b0022780 con 0x55ea737b7b40 2024-09-19T06:23:49.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.870+0000 7f96cfd4f740 10 client.18519 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:49.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.870+0000 7f96cfd4f740 10 client.18519 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:49.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.870+0000 7f96cfd4f740 20 client.18519 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:49.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.870+0000 7f96cfd4f740 1 --2- 172.21.15.2:0/1964713519 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ea737d0d80 0x55ea737d3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:49.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.870+0000 7f96cfd4f740 4 client.18519 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:23:49.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.870+0000 7f96cfd4f740 1 -- 172.21.15.2:0/1964713519 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea73729860 con 0x55ea737d0d80 2024-09-19T06:23:49.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.871+0000 7f96c6ffd640 1 --2- 172.21.15.2:0/1964713519 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ea737d0d80 0x55ea737d3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:49.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.871+0000 7f96a6ffd640 10 client.18519 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:49.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.871+0000 7f96c6ffd640 1 --2- 172.21.15.2:0/1964713519 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ea737d0d80 0x55ea737d3190 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a37dbba499601ff1 server_cookie=da06a2206ae6375 in_seq=0 out_seq=0 2024-09-19T06:23:49.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.872+0000 7f96a6ffd640 1 -- 172.21.15.2:0/1964713519 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ea73729860 con 0x55ea737d0d80 2024-09-19T06:23:49.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.872+0000 7f96a6ffd640 10 client.18519 handle_command_reply: tid=0 2024-09-19T06:23:49.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.872+0000 7f96cfd4f740 1 client.18519 shutdown 2024-09-19T06:23:49.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.872+0000 7f96cfd4f740 1 -- 172.21.15.2:0/1964713519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea737b7b40 msgr2=0x55ea737bdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:49.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.872+0000 7f96cfd4f740 1 --2- 172.21.15.2:0/1964713519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea737b7b40 0x55ea737bdfe0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f96b0012750 tx=0x7f96b0012b50 comp rx=0 tx=0).stop 2024-09-19T06:23:49.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.872+0000 7f96cfd4f740 1 -- 172.21.15.2:0/1964713519 shutdown_connections 2024-09-19T06:23:49.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.872+0000 7f96cfd4f740 1 --2- 172.21.15.2:0/1964713519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ea737c1370 0x55ea737be5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:49.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.872+0000 7f96cfd4f740 1 --2- 172.21.15.2:0/1964713519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea737b7b40 0x55ea737bdfe0 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:49.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.872+0000 7f96cfd4f740 1 --2- 172.21.15.2:0/1964713519 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ea737d0d80 0x55ea737d3190 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:49.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.872+0000 7f96a6ffd640 0 client.18519 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:49.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.872+0000 7f96cfd4f740 1 --2- 172.21.15.2:0/1964713519 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea737b65d0 0x55ea737c0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:49.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.872+0000 7f96cfd4f740 1 -- 172.21.15.2:0/1964713519 >> 172.21.15.2:0/1964713519 conn(0x55ea7377f310 msgr2=0x55ea737b8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:49.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.872+0000 7f96cfd4f740 1 -- 172.21.15.2:0/1964713519 shutdown_connections 2024-09-19T06:23:49.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.872+0000 7f96cfd4f740 1 -- 172.21.15.2:0/1964713519 wait complete. 2024-09-19T06:23:49.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.872+0000 7f96cfd4f740 20 client.18519 trim_cache size 0 max 16384 2024-09-19T06:23:49.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.885+0000 7f96cfd4f740 1 Processor -- start 2024-09-19T06:23:49.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.885+0000 7f96cfd4f740 1 -- start start 2024-09-19T06:23:49.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.885+0000 7f96cfd4f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea737b65d0 0x55ea737b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:49.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.885+0000 7f96cfd4f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea737b7b40 0x55ea737b9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:49.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.886+0000 7f96cfd4f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ea737c1370 0x55ea737b9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:49.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.886+0000 7f96cfd4f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f96c81b2350 con 0x55ea737b65d0 2024-09-19T06:23:49.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.886+0000 7f96cfd4f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f96c81afc20 con 0x55ea737b7b40 2024-09-19T06:23:49.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.886+0000 7f96cfd4f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f96c81ada90 con 0x55ea737c1370 2024-09-19T06:23:49.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.886+0000 7f96c6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea737b65d0 0x55ea737b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:49.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.886+0000 7f96c6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea737b65d0 0x55ea737b2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51956/0 (socket says 172.21.15.2:51956) 2024-09-19T06:23:49.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.886+0000 7f96c6ffd640 1 -- 172.21.15.2:0/2648435737 learned_addr learned my addr 172.21.15.2:0/2648435737 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:49.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.886+0000 7f96c77fe640 1 --2- 172.21.15.2:0/2648435737 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ea737c1370 0x55ea737b9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:49.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.886+0000 7f96c67fc640 1 --2- 172.21.15.2:0/2648435737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea737b7b40 0x55ea737b9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:49.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.886+0000 7f96c6ffd640 1 -- 172.21.15.2:0/2648435737 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ea737c1370 msgr2=0x55ea737b9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:49.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.886+0000 7f96c6ffd640 1 --2- 172.21.15.2:0/2648435737 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ea737c1370 0x55ea737b9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:49.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.886+0000 7f96c6ffd640 1 -- 172.21.15.2:0/2648435737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea737b7b40 msgr2=0x55ea737b9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:49.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.886+0000 7f96c6ffd640 1 --2- 172.21.15.2:0/2648435737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea737b7b40 0x55ea737b9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:49.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.886+0000 7f96c6ffd640 1 -- 172.21.15.2:0/2648435737 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea737b7300 con 0x55ea737b65d0 2024-09-19T06:23:49.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.886+0000 7f96c6ffd640 1 --2- 172.21.15.2:0/2648435737 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea737b65d0 0x55ea737b2d70 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f96c00bc220 tx=0x7f96c002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3c75b011b352a99 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:49.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.886+0000 7f96bd7fa640 1 -- 172.21.15.2:0/2648435737 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c00ba400 con 0x55ea737b65d0 2024-09-19T06:23:49.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.886+0000 7f96bd7fa640 1 -- 172.21.15.2:0/2648435737 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f96c00fd050 con 0x55ea737b65d0 2024-09-19T06:23:49.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.886+0000 7f96bd7fa640 1 -- 172.21.15.2:0/2648435737 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c00ba660 con 0x55ea737b65d0 2024-09-19T06:23:49.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.887+0000 7f96cfd4f740 1 -- 172.21.15.2:0/2648435737 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea737b65d0 msgr2=0x55ea737b2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:49.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.887+0000 7f96cfd4f740 1 --2- 172.21.15.2:0/2648435737 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea737b65d0 0x55ea737b2d70 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f96c00bc220 tx=0x7f96c002a410 comp rx=0 tx=0).stop 2024-09-19T06:23:49.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.887+0000 7f96cfd4f740 1 -- 172.21.15.2:0/2648435737 shutdown_connections 2024-09-19T06:23:49.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.887+0000 7f96cfd4f740 1 --2- 172.21.15.2:0/2648435737 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ea737c1370 0x55ea737b9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:49.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.887+0000 7f96cfd4f740 1 --2- 172.21.15.2:0/2648435737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea737b7b40 0x55ea737b9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:49.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.887+0000 7f96cfd4f740 1 --2- 172.21.15.2:0/2648435737 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea737b65d0 0x55ea737b2d70 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:49.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.887+0000 7f96cfd4f740 1 -- 172.21.15.2:0/2648435737 >> 172.21.15.2:0/2648435737 conn(0x55ea7377f310 msgr2=0x55ea737c0060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:49.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.887+0000 7f96cfd4f740 1 -- 172.21.15.2:0/2648435737 shutdown_connections 2024-09-19T06:23:49.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.887+0000 7f96cfd4f740 1 -- 172.21.15.2:0/2648435737 wait complete. 2024-09-19T06:23:49.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.887+0000 7f96cfd4f740 1 -- start start 2024-09-19T06:23:49.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.888+0000 7f96cfd4f740 1 Processor -- start 2024-09-19T06:23:49.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.888+0000 7f96cfd4f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea737b65d0 0x55ea737c55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:49.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.888+0000 7f96cfd4f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea737b7b40 0x55ea737c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:49.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.888+0000 7f96cfd4f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ea737c1370 0x55ea7383aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:49.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.888+0000 7f96cfd4f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f96c81ae0e0 con 0x55ea737b65d0 2024-09-19T06:23:49.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.888+0000 7f96cfd4f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f96c81af550 con 0x55ea737b7b40 2024-09-19T06:23:49.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.888+0000 7f96cfd4f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f96c81ae7b0 con 0x55ea737c1370 2024-09-19T06:23:49.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.888+0000 7f96cfd4f740 10 client.0 _ll_register_callbacks cb 0x7f96b000a670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:49.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.888+0000 7f96c6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea737b65d0 0x55ea737c55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:49.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.888+0000 7f96c6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea737b65d0 0x55ea737c55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51970/0 (socket says 172.21.15.2:51970) 2024-09-19T06:23:49.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.888+0000 7f96c6ffd640 1 -- 172.21.15.2:0/721085722 learned_addr learned my addr 172.21.15.2:0/721085722 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:49.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.888+0000 7f96c77fe640 1 --2- 172.21.15.2:0/721085722 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ea737c1370 0x55ea7383aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:49.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.888+0000 7f96c67fc640 1 --2- 172.21.15.2:0/721085722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea737b7b40 0x55ea737c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:49.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.888+0000 7f96c6ffd640 1 -- 172.21.15.2:0/721085722 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ea737c1370 msgr2=0x55ea7383aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:49.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.888+0000 7f96c6ffd640 1 --2- 172.21.15.2:0/721085722 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ea737c1370 0x55ea7383aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:49.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.888+0000 7f96c6ffd640 1 -- 172.21.15.2:0/721085722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea737b7b40 msgr2=0x55ea737c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:49.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.888+0000 7f96c6ffd640 1 --2- 172.21.15.2:0/721085722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea737b7b40 0x55ea737c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:49.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.888+0000 7f96c6ffd640 1 -- 172.21.15.2:0/721085722 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea7383afb0 con 0x55ea737b65d0 2024-09-19T06:23:49.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.889+0000 7f96c6ffd640 1 --2- 172.21.15.2:0/721085722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea737b65d0 0x55ea737c55e0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f96c00f0590 tx=0x7f96c0005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac44508e40fab0f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:49.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.889+0000 7f96a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:49.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.889+0000 7f96a6ffd640 1 -- 172.21.15.2:0/721085722 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c00bb220 con 0x55ea737b65d0 2024-09-19T06:23:49.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.889+0000 7f96a6ffd640 1 -- 172.21.15.2:0/721085722 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f96c00ba820 con 0x55ea737b65d0 2024-09-19T06:23:49.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.889+0000 7f96cfd4f740 1 -- 172.21.15.2:0/721085722 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96c00fd050 con 0x55ea737b65d0 2024-09-19T06:23:49.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.889+0000 7f96a6ffd640 1 -- 172.21.15.2:0/721085722 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f96c00bbe80 con 0x55ea737b65d0 2024-09-19T06:23:49.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.889+0000 7f96cfd4f740 10 client.18525 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:49.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.889+0000 7f96cfd4f740 1 -- 172.21.15.2:0/721085722 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ea7383c1f0 con 0x55ea737b65d0 2024-09-19T06:23:49.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.889+0000 7f96a6ffd640 1 -- 172.21.15.2:0/721085722 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f96c00fd050 con 0x55ea737b65d0 2024-09-19T06:23:49.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.889+0000 7f96a6ffd640 1 -- 172.21.15.2:0/721085722 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f96c00b8b90 con 0x55ea737b65d0 2024-09-19T06:23:49.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.889+0000 7f96cfd4f740 10 client.18525 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:49.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.889+0000 7f96cfd4f740 10 client.18525 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:49.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.889+0000 7f96cfd4f740 20 client.18525 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:49.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.889+0000 7f96cfd4f740 1 --2- 172.21.15.2:0/721085722 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ea737d0d80 0x55ea7383e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:49.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.889+0000 7f96cfd4f740 4 client.18525 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:23:49.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.889+0000 7f96cfd4f740 1 -- 172.21.15.2:0/721085722 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ea73723d70 con 0x55ea737d0d80 2024-09-19T06:23:49.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.890+0000 7f96c67fc640 1 --2- 172.21.15.2:0/721085722 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ea737d0d80 0x55ea7383e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:49.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.890+0000 7f96c67fc640 1 --2- 172.21.15.2:0/721085722 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ea737d0d80 0x55ea7383e540 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66127f35f873188e server_cookie=6d3e829390e4f170 in_seq=0 out_seq=0 2024-09-19T06:23:49.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.890+0000 7f96a6ffd640 10 client.18525 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:49.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.890+0000 7f96a6ffd640 1 -- 172.21.15.2:0/721085722 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ea73723d70 con 0x55ea737d0d80 2024-09-19T06:23:49.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.890+0000 7f96a6ffd640 10 client.18525 handle_command_reply: tid=0 2024-09-19T06:23:49.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.890+0000 7f96cfd4f740 1 client.18525 shutdown 2024-09-19T06:23:49.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.890+0000 7f96cfd4f740 1 -- 172.21.15.2:0/721085722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea737b65d0 msgr2=0x55ea737c55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:49.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.890+0000 7f96cfd4f740 1 --2- 172.21.15.2:0/721085722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea737b65d0 0x55ea737c55e0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f96c00f0590 tx=0x7f96c0005a20 comp rx=0 tx=0).stop 2024-09-19T06:23:49.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.890+0000 7f96cfd4f740 1 -- 172.21.15.2:0/721085722 shutdown_connections 2024-09-19T06:23:49.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.890+0000 7f96cfd4f740 1 --2- 172.21.15.2:0/721085722 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ea737c1370 0x55ea7383aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:49.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.890+0000 7f96cfd4f740 1 --2- 172.21.15.2:0/721085722 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ea737d0d80 0x55ea7383e540 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:49.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.890+0000 7f96cfd4f740 1 --2- 172.21.15.2:0/721085722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ea737b7b40 0x55ea737c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:49.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.890+0000 7f96cfd4f740 1 --2- 172.21.15.2:0/721085722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea737b65d0 0x55ea737c55e0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:49.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.890+0000 7f96cfd4f740 1 -- 172.21.15.2:0/721085722 >> 172.21.15.2:0/721085722 conn(0x55ea7377f310 msgr2=0x55ea737b14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:49.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.890+0000 7f96a6ffd640 0 client.18525 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:49.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.891+0000 7f96cfd4f740 1 -- 172.21.15.2:0/721085722 shutdown_connections 2024-09-19T06:23:49.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.891+0000 7f96cfd4f740 1 -- 172.21.15.2:0/721085722 wait complete. 2024-09-19T06:23:49.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.891+0000 7f96cfd4f740 20 client.18525 trim_cache size 0 max 16384 2024-09-19T06:23:49.898 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:23:49.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.891+0000 7f96cd976640 1 -- 172.21.15.2:0/3618708362 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f96b40a33b0 msgr2=0x7f96b40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:49.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.891+0000 7f96cd976640 1 --2- 172.21.15.2:0/3618708362 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f96b40a33b0 0x7f96b40a5870 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f96b8005fd0 tx=0x7f96b8009600 comp rx=0 tx=0).stop 2024-09-19T06:23:49.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.891+0000 7f96cd976640 1 -- 172.21.15.2:0/3618708362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96c8101df0 msgr2=0x7f96c80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:49.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.891+0000 7f96cd976640 1 --2- 172.21.15.2:0/3618708362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96c8101df0 0x7f96c80744f0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f96c0005940 tx=0x7f96c0004270 comp rx=0 tx=0).stop 2024-09-19T06:23:49.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.891+0000 7f96cd976640 1 -- 172.21.15.2:0/3618708362 shutdown_connections 2024-09-19T06:23:49.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.891+0000 7f96cd976640 1 --2- 172.21.15.2:0/3618708362 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f96b40a33b0 0x7f96b40a5870 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:49.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.891+0000 7f96cd976640 1 --2- 172.21.15.2:0/3618708362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96c8106f20 0x7f96c8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:49.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.891+0000 7f96cd976640 1 --2- 172.21.15.2:0/3618708362 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96c81027a0 0x7f96c8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:49.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.891+0000 7f96cd976640 1 --2- 172.21.15.2:0/3618708362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96c8101df0 0x7f96c80744f0 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:49.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.891+0000 7f96cd976640 1 -- 172.21.15.2:0/3618708362 >> 172.21.15.2:0/3618708362 conn(0x7f96c80fd8f0 msgr2=0x7f96c80fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:49.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.891+0000 7f96cd976640 1 -- 172.21.15.2:0/3618708362 shutdown_connections 2024-09-19T06:23:49.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:49.891+0000 7f96cd976640 1 -- 172.21.15.2:0/3618708362 wait complete. 2024-09-19T06:23:51.581 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:23:51.582 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:23:51.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:51 smithi002 ceph-mon[30982]: pgmap v280: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:23:51.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:51 smithi090 ceph-mon[34497]: pgmap v280: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:23:51.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:51 smithi089 ceph-mon[34160]: pgmap v280: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:23:51.855 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:23:52.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.339+0000 7fe14d8fc640 1 -- 172.21.15.2:0/3550777104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe148100e30 msgr2=0x7fe148104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:52.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.339+0000 7fe14d8fc640 1 --2- 172.21.15.2:0/3550777104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe148100e30 0x7fe148104e80 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fe130009900 tx=0x7fe13002a410 comp rx=0 tx=0).stop 2024-09-19T06:23:52.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.339+0000 7fe14d8fc640 1 -- 172.21.15.2:0/3550777104 shutdown_connections 2024-09-19T06:23:52.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.339+0000 7fe14d8fc640 1 --2- 172.21.15.2:0/3550777104 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1481055b0 0x7fe14810d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:52.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.339+0000 7fe14d8fc640 1 --2- 172.21.15.2:0/3550777104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe148100e30 0x7fe148104e80 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:52.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.339+0000 7fe14d8fc640 1 --2- 172.21.15.2:0/3550777104 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe148100480 0x7fe148100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:52.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.339+0000 7fe14d8fc640 1 -- 172.21.15.2:0/3550777104 >> 172.21.15.2:0/3550777104 conn(0x7fe148077210 msgr2=0x7fe1480fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:52.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.339+0000 7fe14d8fc640 1 -- 172.21.15.2:0/3550777104 shutdown_connections 2024-09-19T06:23:52.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.339+0000 7fe14d8fc640 1 -- 172.21.15.2:0/3550777104 wait complete. 2024-09-19T06:23:52.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.340+0000 7fe14d8fc640 1 Processor -- start 2024-09-19T06:23:52.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.340+0000 7fe14d8fc640 1 -- start start 2024-09-19T06:23:52.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.340+0000 7fe14d8fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe148100480 0x7fe14810e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:52.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.340+0000 7fe14d8fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe148100e30 0x7fe14810ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:52.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.340+0000 7fe14d8fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1481055b0 0x7fe14810f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:52.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.340+0000 7fe14d8fc640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe148111e60 con 0x7fe148100e30 2024-09-19T06:23:52.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.340+0000 7fe14d8fc640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe148111ce0 con 0x7fe1481055b0 2024-09-19T06:23:52.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.340+0000 7fe14d8fc640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe148111fe0 con 0x7fe148100480 2024-09-19T06:23:52.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.340+0000 7fe13ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe148100e30 0x7fe14810ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:52.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.340+0000 7fe13ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe148100e30 0x7fe14810ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51982/0 (socket says 172.21.15.2:51982) 2024-09-19T06:23:52.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.340+0000 7fe13ffff640 1 -- 172.21.15.2:0/3513809952 learned_addr learned my addr 172.21.15.2:0/3513809952 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:52.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.340+0000 7fe146ffd640 1 --2- 172.21.15.2:0/3513809952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe148100480 0x7fe14810e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:52.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.340+0000 7fe1477fe640 1 --2- 172.21.15.2:0/3513809952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1481055b0 0x7fe14810f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:52.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.340+0000 7fe13ffff640 1 -- 172.21.15.2:0/3513809952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe148100480 msgr2=0x7fe14810e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:52.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.340+0000 7fe13ffff640 1 --2- 172.21.15.2:0/3513809952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe148100480 0x7fe14810e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:52.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.340+0000 7fe13ffff640 1 -- 172.21.15.2:0/3513809952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1481055b0 msgr2=0x7fe14810f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:52.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.340+0000 7fe13ffff640 1 --2- 172.21.15.2:0/3513809952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1481055b0 0x7fe14810f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:52.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.340+0000 7fe13ffff640 1 -- 172.21.15.2:0/3513809952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1481a6880 con 0x7fe148100e30 2024-09-19T06:23:52.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.341+0000 7fe13ffff640 1 --2- 172.21.15.2:0/3513809952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe148100e30 0x7fe14810ed90 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fe130006010 tx=0x7fe130004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:52.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.341+0000 7fe14c8fa640 1 -- 172.21.15.2:0/3513809952 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe13003f030 con 0x7fe148100e30 2024-09-19T06:23:52.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.341+0000 7fe14d8fc640 1 -- 172.21.15.2:0/3513809952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1481a6b10 con 0x7fe148100e30 2024-09-19T06:23:52.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.341+0000 7fe14c8fa640 1 -- 172.21.15.2:0/3513809952 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe1300035f0 con 0x7fe148100e30 2024-09-19T06:23:52.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.341+0000 7fe14c8fa640 1 -- 172.21.15.2:0/3513809952 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe130035070 con 0x7fe148100e30 2024-09-19T06:23:52.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.341+0000 7fe14d8fc640 1 -- 172.21.15.2:0/3513809952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1481a7040 con 0x7fe148100e30 2024-09-19T06:23:52.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.344+0000 7fe14fcd5740 1 Processor -- start 2024-09-19T06:23:52.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.344+0000 7fe14fcd5740 1 -- start start 2024-09-19T06:23:52.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.344+0000 7fe14c8fa640 1 -- 172.21.15.2:0/3513809952 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fe130003b10 con 0x7fe148100e30 2024-09-19T06:23:52.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.344+0000 7fe14fcd5740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f92e489b60 0x55f92e489f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:52.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.344+0000 7fe14fcd5740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f92e48a480 0x55f92e494800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:52.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.344+0000 7fe14fcd5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f92e494d40 0x55f92e497130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:52.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.344+0000 7fe14fcd5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f92e3ef280 con 0x55f92e494d40 2024-09-19T06:23:52.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.344+0000 7fe14fcd5740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55f92e396b10 con 0x55f92e489b60 2024-09-19T06:23:52.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.344+0000 7fe14fcd5740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f92e3eb240 con 0x55f92e48a480 2024-09-19T06:23:52.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.344+0000 7fe13ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f92e494d40 0x55f92e497130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:52.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.345+0000 7fe13ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f92e494d40 0x55f92e497130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51996/0 (socket says 172.21.15.2:51996) 2024-09-19T06:23:52.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.345+0000 7fe13ffff640 1 -- 172.21.15.2:0/2281560593 learned_addr learned my addr 172.21.15.2:0/2281560593 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:52.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.345+0000 7fe1477fe640 1 --2- 172.21.15.2:0/2281560593 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f92e489b60 0x55f92e489f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:52.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.345+0000 7fe146ffd640 1 --2- 172.21.15.2:0/2281560593 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f92e48a480 0x55f92e494800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:52.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.345+0000 7fe13ffff640 1 -- 172.21.15.2:0/2281560593 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f92e48a480 msgr2=0x55f92e494800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:52.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.345+0000 7fe13ffff640 1 --2- 172.21.15.2:0/2281560593 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f92e48a480 0x55f92e494800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:52.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.345+0000 7fe13ffff640 1 -- 172.21.15.2:0/2281560593 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f92e489b60 msgr2=0x55f92e489f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:52.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.345+0000 7fe13ffff640 1 --2- 172.21.15.2:0/2281560593 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f92e489b60 0x55f92e489f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:52.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.345+0000 7fe13ffff640 1 -- 172.21.15.2:0/2281560593 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f92e3a31f0 con 0x55f92e494d40 2024-09-19T06:23:52.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.345+0000 7fe1477fe640 1 --2- 172.21.15.2:0/2281560593 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f92e489b60 0x55f92e489f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:52.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.345+0000 7fe13ffff640 1 --2- 172.21.15.2:0/2281560593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f92e494d40 0x55f92e497130 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fe1300edde0 tx=0x7fe1300f6c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0b4909a3a340115 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:52.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.345+0000 7fe14c8fa640 1 --2- 172.21.15.2:0/3513809952 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe1340a33b0 0x7fe1340a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:52.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.345+0000 7fe13dffb640 1 -- 172.21.15.2:0/2281560593 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1300bc180 con 0x55f92e494d40 2024-09-19T06:23:52.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.345+0000 7fe1477fe640 1 --2- 172.21.15.2:0/3513809952 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe1340a33b0 0x7fe1340a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:52.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.345+0000 7fe14c8fa640 1 -- 172.21.15.2:0/3513809952 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7fe1300f0720 con 0x7fe148100e30 2024-09-19T06:23:52.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.345+0000 7fe13dffb640 1 -- 172.21.15.2:0/2281560593 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe130100020 con 0x55f92e494d40 2024-09-19T06:23:52.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.345+0000 7fe13dffb640 1 -- 172.21.15.2:0/2281560593 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1300bc360 con 0x55f92e494d40 2024-09-19T06:23:52.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.346+0000 7fe14fcd5740 1 -- 172.21.15.2:0/2281560593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f92e494d40 msgr2=0x55f92e497130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:52.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.346+0000 7fe1477fe640 1 --2- 172.21.15.2:0/3513809952 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe1340a33b0 0x7fe1340a5870 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe140007470 tx=0x7fe140007400 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:52.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.346+0000 7fe14fcd5740 1 --2- 172.21.15.2:0/2281560593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f92e494d40 0x55f92e497130 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fe1300edde0 tx=0x7fe1300f6c60 comp rx=0 tx=0).stop 2024-09-19T06:23:52.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.346+0000 7fe14fcd5740 1 -- 172.21.15.2:0/2281560593 shutdown_connections 2024-09-19T06:23:52.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.346+0000 7fe14fcd5740 1 --2- 172.21.15.2:0/2281560593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f92e494d40 0x55f92e497130 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:52.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.346+0000 7fe14fcd5740 1 --2- 172.21.15.2:0/2281560593 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f92e48a480 0x55f92e494800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:52.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.346+0000 7fe14fcd5740 1 --2- 172.21.15.2:0/2281560593 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f92e489b60 0x55f92e489f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:52.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.346+0000 7fe14fcd5740 1 -- 172.21.15.2:0/2281560593 >> 172.21.15.2:0/2281560593 conn(0x55f92e4860f0 msgr2=0x55f92e4864d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:52.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.346+0000 7fe14fcd5740 1 -- 172.21.15.2:0/2281560593 shutdown_connections 2024-09-19T06:23:52.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.346+0000 7fe14fcd5740 1 -- 172.21.15.2:0/2281560593 wait complete. 2024-09-19T06:23:52.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.347+0000 7fe14fcd5740 1 -- start start 2024-09-19T06:23:52.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.347+0000 7fe14fcd5740 1 Processor -- start 2024-09-19T06:23:52.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.347+0000 7fe14fcd5740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f92e489b60 0x55f92e4947f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:52.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.347+0000 7fe14fcd5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f92e48a480 0x55f92e491b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:52.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.347+0000 7fe14fcd5740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f92e494d40 0x55f92e4922d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:52.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.347+0000 7fe14fcd5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f92e4976d0 con 0x55f92e48a480 2024-09-19T06:23:52.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.347+0000 7fe14fcd5740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55f92e3a9f10 con 0x55f92e489b60 2024-09-19T06:23:52.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.347+0000 7fe14fcd5740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f92e497850 con 0x55f92e494d40 2024-09-19T06:23:52.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.347+0000 7fe14fcd5740 10 client.0 _ll_register_callbacks cb 0x55f92e372a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:52.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.347+0000 7fe13ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f92e48a480 0x55f92e491b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:52.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.347+0000 7fe13ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f92e48a480 0x55f92e491b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52004/0 (socket says 172.21.15.2:52004) 2024-09-19T06:23:52.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.347+0000 7fe13ffff640 1 -- 172.21.15.2:0/2988674319 learned_addr learned my addr 172.21.15.2:0/2988674319 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:52.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.347+0000 7fe1477fe640 1 --2- 172.21.15.2:0/2988674319 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f92e494d40 0x55f92e4922d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:52.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.348+0000 7fe146ffd640 1 --2- 172.21.15.2:0/2988674319 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f92e489b60 0x55f92e4947f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:52.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.348+0000 7fe13ffff640 1 -- 172.21.15.2:0/2988674319 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f92e494d40 msgr2=0x55f92e4922d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:52.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.348+0000 7fe13ffff640 1 --2- 172.21.15.2:0/2988674319 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f92e494d40 0x55f92e4922d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:52.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.348+0000 7fe13ffff640 1 -- 172.21.15.2:0/2988674319 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f92e489b60 msgr2=0x55f92e4947f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:52.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.348+0000 7fe13ffff640 1 --2- 172.21.15.2:0/2988674319 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f92e489b60 0x55f92e4947f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:52.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.348+0000 7fe13ffff640 1 -- 172.21.15.2:0/2988674319 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f92e1606a0 con 0x55f92e48a480 2024-09-19T06:23:52.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.348+0000 7fe13ffff640 1 --2- 172.21.15.2:0/2988674319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f92e48a480 0x55f92e491b40 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fe1300edf20 tx=0x7fe130005b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5a50f05186941ab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:52.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.348+0000 7fe126ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:52.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.348+0000 7fe126ffd640 1 -- 172.21.15.2:0/2988674319 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1300ff070 con 0x55f92e48a480 2024-09-19T06:23:52.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.348+0000 7fe126ffd640 1 -- 172.21.15.2:0/2988674319 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7fe1300bad00 con 0x55f92e48a480 2024-09-19T06:23:52.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.348+0000 7fe14fcd5740 1 -- 172.21.15.2:0/2988674319 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe130100020 con 0x55f92e48a480 2024-09-19T06:23:52.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.348+0000 7fe126ffd640 1 -- 172.21.15.2:0/2988674319 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe1300bc540 con 0x55f92e48a480 2024-09-19T06:23:52.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.348+0000 7fe14fcd5740 10 client.18537 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:52.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.348+0000 7fe14fcd5740 1 -- 172.21.15.2:0/2988674319 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f92e4976d0 con 0x55f92e48a480 2024-09-19T06:23:52.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.348+0000 7fe126ffd640 1 -- 172.21.15.2:0/2988674319 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe130100020 con 0x55f92e48a480 2024-09-19T06:23:52.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.349+0000 7fe126ffd640 1 -- 172.21.15.2:0/2988674319 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fe1300ee0f0 con 0x55f92e48a480 2024-09-19T06:23:52.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.349+0000 7fe14fcd5740 10 client.18537 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:52.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.349+0000 7fe14fcd5740 10 client.18537 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:52.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.349+0000 7fe14fcd5740 20 client.18537 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:52.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.349+0000 7fe14fcd5740 1 --2- 172.21.15.2:0/2988674319 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55f92e4a4340 0x55f92e4a6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:52.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.349+0000 7fe14fcd5740 4 client.18537 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:23:52.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.349+0000 7fe14fcd5740 1 -- 172.21.15.2:0/2988674319 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f92e3fc7f0 con 0x55f92e4a4340 2024-09-19T06:23:52.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.349+0000 7fe146ffd640 1 --2- 172.21.15.2:0/2988674319 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55f92e4a4340 0x55f92e4a6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:52.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.349+0000 7fe146ffd640 1 --2- 172.21.15.2:0/2988674319 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55f92e4a4340 0x55f92e4a6730 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1ebd7471d585337 server_cookie=457f1df8a3162137 in_seq=0 out_seq=0 2024-09-19T06:23:52.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.349+0000 7fe126ffd640 10 client.18537 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:52.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.350+0000 7fe126ffd640 1 -- 172.21.15.2:0/2988674319 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f92e3fc7f0 con 0x55f92e4a4340 2024-09-19T06:23:52.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.350+0000 7fe126ffd640 10 client.18537 handle_command_reply: tid=0 2024-09-19T06:23:52.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.350+0000 7fe14fcd5740 1 client.18537 shutdown 2024-09-19T06:23:52.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.350+0000 7fe14fcd5740 1 -- 172.21.15.2:0/2988674319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f92e48a480 msgr2=0x55f92e491b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:52.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.350+0000 7fe14fcd5740 1 --2- 172.21.15.2:0/2988674319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f92e48a480 0x55f92e491b40 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fe1300edf20 tx=0x7fe130005b70 comp rx=0 tx=0).stop 2024-09-19T06:23:52.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.350+0000 7fe14fcd5740 1 -- 172.21.15.2:0/2988674319 shutdown_connections 2024-09-19T06:23:52.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.350+0000 7fe14fcd5740 1 --2- 172.21.15.2:0/2988674319 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f92e494d40 0x55f92e4922d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:52.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.350+0000 7fe14fcd5740 1 --2- 172.21.15.2:0/2988674319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f92e48a480 0x55f92e491b40 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:52.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.350+0000 7fe14fcd5740 1 --2- 172.21.15.2:0/2988674319 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55f92e4a4340 0x55f92e4a6730 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:52.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.350+0000 7fe14fcd5740 1 --2- 172.21.15.2:0/2988674319 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f92e489b60 0x55f92e4947f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:52.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.350+0000 7fe126ffd640 0 client.18537 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:52.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.350+0000 7fe14fcd5740 1 -- 172.21.15.2:0/2988674319 >> 172.21.15.2:0/2988674319 conn(0x55f92e4860f0 msgr2=0x55f92e48bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:52.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.351+0000 7fe14fcd5740 1 -- 172.21.15.2:0/2988674319 shutdown_connections 2024-09-19T06:23:52.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.351+0000 7fe14fcd5740 1 -- 172.21.15.2:0/2988674319 wait complete. 2024-09-19T06:23:52.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.351+0000 7fe14fcd5740 20 client.18537 trim_cache size 0 max 16384 2024-09-19T06:23:52.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.368+0000 7fe14fcd5740 1 Processor -- start 2024-09-19T06:23:52.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.368+0000 7fe14fcd5740 1 -- start start 2024-09-19T06:23:52.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.368+0000 7fe14fcd5740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f92e489b60 0x55f92e490b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:52.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.368+0000 7fe14fcd5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f92e48a480 0x55f92e4abef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:52.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.368+0000 7fe14fcd5740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f92e494d40 0x55f92e4ac430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:52.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.368+0000 7fe14fcd5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe1481b21e0 con 0x55f92e48a480 2024-09-19T06:23:52.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.368+0000 7fe14fcd5740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe1481afab0 con 0x55f92e494d40 2024-09-19T06:23:52.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.368+0000 7fe14fcd5740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe1481ad920 con 0x55f92e489b60 2024-09-19T06:23:52.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.368+0000 7fe13ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f92e48a480 0x55f92e4abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:52.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.368+0000 7fe13ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f92e48a480 0x55f92e4abef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52024/0 (socket says 172.21.15.2:52024) 2024-09-19T06:23:52.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.368+0000 7fe13ffff640 1 -- 172.21.15.2:0/499946807 learned_addr learned my addr 172.21.15.2:0/499946807 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:52.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.368+0000 7fe146ffd640 1 --2- 172.21.15.2:0/499946807 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f92e489b60 0x55f92e490b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:52.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.369+0000 7fe1477fe640 1 --2- 172.21.15.2:0/499946807 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f92e494d40 0x55f92e4ac430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:52.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.369+0000 7fe13ffff640 1 -- 172.21.15.2:0/499946807 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f92e489b60 msgr2=0x55f92e490b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:52.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.369+0000 7fe13ffff640 1 --2- 172.21.15.2:0/499946807 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f92e489b60 0x55f92e490b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:52.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.369+0000 7fe13ffff640 1 -- 172.21.15.2:0/499946807 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f92e494d40 msgr2=0x55f92e4ac430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:52.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.369+0000 7fe13ffff640 1 --2- 172.21.15.2:0/499946807 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f92e494d40 0x55f92e4ac430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:52.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.369+0000 7fe13ffff640 1 -- 172.21.15.2:0/499946807 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f92e485f20 con 0x55f92e48a480 2024-09-19T06:23:52.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.369+0000 7fe1477fe640 1 --2- 172.21.15.2:0/499946807 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f92e494d40 0x55f92e4ac430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:23:52.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.369+0000 7fe13ffff640 1 --2- 172.21.15.2:0/499946807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f92e48a480 0x55f92e4abef0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fe13003d040 tx=0x7fe1300f6c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5544f4a66f2149b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:52.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.369+0000 7fe13d7fa640 1 -- 172.21.15.2:0/499946807 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1300ff020 con 0x55f92e48a480 2024-09-19T06:23:52.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.369+0000 7fe13d7fa640 1 -- 172.21.15.2:0/499946807 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe1300f6320 con 0x55f92e48a480 2024-09-19T06:23:52.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.369+0000 7fe13d7fa640 1 -- 172.21.15.2:0/499946807 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe130049030 con 0x55f92e48a480 2024-09-19T06:23:52.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.369+0000 7fe14fcd5740 1 -- 172.21.15.2:0/499946807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f92e48a480 msgr2=0x55f92e4abef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:52.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.369+0000 7fe14fcd5740 1 --2- 172.21.15.2:0/499946807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f92e48a480 0x55f92e4abef0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fe13003d040 tx=0x7fe1300f6c60 comp rx=0 tx=0).stop 2024-09-19T06:23:52.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.370+0000 7fe14fcd5740 1 -- 172.21.15.2:0/499946807 shutdown_connections 2024-09-19T06:23:52.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.370+0000 7fe14fcd5740 1 --2- 172.21.15.2:0/499946807 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f92e494d40 0x55f92e4ac430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:52.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.370+0000 7fe14fcd5740 1 --2- 172.21.15.2:0/499946807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f92e48a480 0x55f92e4abef0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:52.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.370+0000 7fe14fcd5740 1 --2- 172.21.15.2:0/499946807 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f92e489b60 0x55f92e490b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:52.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.370+0000 7fe14fcd5740 1 -- 172.21.15.2:0/499946807 >> 172.21.15.2:0/499946807 conn(0x55f92e4860f0 msgr2=0x55f92e490410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:52.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.370+0000 7fe14fcd5740 1 -- 172.21.15.2:0/499946807 shutdown_connections 2024-09-19T06:23:52.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.370+0000 7fe14fcd5740 1 -- 172.21.15.2:0/499946807 wait complete. 2024-09-19T06:23:52.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.370+0000 7fe14fcd5740 1 -- start start 2024-09-19T06:23:52.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.370+0000 7fe14fcd5740 1 Processor -- start 2024-09-19T06:23:52.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.370+0000 7fe14fcd5740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f92e489b60 0x55f92e49cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:52.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.370+0000 7fe14fcd5740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f92e48a480 0x55f92e49cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:52.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.370+0000 7fe14fcd5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f92e494d40 0x55f92e497a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:52.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.370+0000 7fe14fcd5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe1481adf70 con 0x55f92e494d40 2024-09-19T06:23:52.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.370+0000 7fe14fcd5740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe1481af3e0 con 0x55f92e489b60 2024-09-19T06:23:52.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.370+0000 7fe14fcd5740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe1481ae640 con 0x55f92e48a480 2024-09-19T06:23:52.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.370+0000 7fe14fcd5740 10 client.0 _ll_register_callbacks cb 0x7fe1300f6a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:52.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.371+0000 7fe1477fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f92e494d40 0x55f92e497a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:52.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.371+0000 7fe1477fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f92e494d40 0x55f92e497a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52036/0 (socket says 172.21.15.2:52036) 2024-09-19T06:23:52.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.371+0000 7fe1477fe640 1 -- 172.21.15.2:0/46861364 learned_addr learned my addr 172.21.15.2:0/46861364 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:52.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.371+0000 7fe146ffd640 1 --2- 172.21.15.2:0/46861364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f92e489b60 0x55f92e49cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:52.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.371+0000 7fe13ffff640 1 --2- 172.21.15.2:0/46861364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f92e48a480 0x55f92e49cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:52.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.371+0000 7fe1477fe640 1 -- 172.21.15.2:0/46861364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f92e48a480 msgr2=0x55f92e49cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:52.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.371+0000 7fe1477fe640 1 --2- 172.21.15.2:0/46861364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f92e48a480 0x55f92e49cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:52.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.371+0000 7fe1477fe640 1 -- 172.21.15.2:0/46861364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f92e489b60 msgr2=0x55f92e49cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:52.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.371+0000 7fe1477fe640 1 --2- 172.21.15.2:0/46861364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f92e489b60 0x55f92e49cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:52.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.371+0000 7fe1477fe640 1 -- 172.21.15.2:0/46861364 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f92e4a0930 con 0x55f92e494d40 2024-09-19T06:23:52.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.371+0000 7fe13ffff640 1 --2- 172.21.15.2:0/46861364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f92e48a480 0x55f92e49cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:52.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.371+0000 7fe1477fe640 1 --2- 172.21.15.2:0/46861364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f92e494d40 0x55f92e497a60 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fe140020de0 tx=0x7fe140004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaac5ed68a5de9c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:52.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.371+0000 7fe126ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:52.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.371+0000 7fe126ffd640 1 -- 172.21.15.2:0/46861364 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe140003d80 con 0x55f92e494d40 2024-09-19T06:23:52.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.371+0000 7fe126ffd640 1 -- 172.21.15.2:0/46861364 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7fe140004050 con 0x55f92e494d40 2024-09-19T06:23:52.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.371+0000 7fe14fcd5740 1 -- 172.21.15.2:0/46861364 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1300f6320 con 0x55f92e494d40 2024-09-19T06:23:52.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.372+0000 7fe126ffd640 1 -- 172.21.15.2:0/46861364 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe140004250 con 0x55f92e494d40 2024-09-19T06:23:52.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.372+0000 7fe14fcd5740 10 client.18543 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:52.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.372+0000 7fe14fcd5740 1 -- 172.21.15.2:0/46861364 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f92e50f4d0 con 0x55f92e494d40 2024-09-19T06:23:52.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.372+0000 7fe126ffd640 1 -- 172.21.15.2:0/46861364 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe1300f6320 con 0x55f92e494d40 2024-09-19T06:23:52.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.372+0000 7fe126ffd640 1 -- 172.21.15.2:0/46861364 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fe140027020 con 0x55f92e494d40 2024-09-19T06:23:52.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.372+0000 7fe14fcd5740 10 client.18543 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:52.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.372+0000 7fe14fcd5740 10 client.18543 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:52.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.372+0000 7fe14fcd5740 20 client.18543 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:52.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.372+0000 7fe14fcd5740 1 --2- 172.21.15.2:0/46861364 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55f92e50fc80 0x55f92e5120a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:52.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.372+0000 7fe14fcd5740 4 client.18543 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:23:52.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.372+0000 7fe14fcd5740 1 -- 172.21.15.2:0/46861364 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f92e3f6d00 con 0x55f92e50fc80 2024-09-19T06:23:52.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.372+0000 7fe146ffd640 1 --2- 172.21.15.2:0/46861364 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55f92e50fc80 0x55f92e5120a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:52.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.373+0000 7fe146ffd640 1 --2- 172.21.15.2:0/46861364 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55f92e50fc80 0x55f92e5120a0 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc4d2ed2ed4956ed server_cookie=d4f450e794094458 in_seq=0 out_seq=0 2024-09-19T06:23:52.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.373+0000 7fe126ffd640 10 client.18543 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:52.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.374+0000 7fe126ffd640 1 -- 172.21.15.2:0/46861364 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f92e3f6d00 con 0x55f92e50fc80 2024-09-19T06:23:52.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.374+0000 7fe126ffd640 10 client.18543 handle_command_reply: tid=0 2024-09-19T06:23:52.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.374+0000 7fe14fcd5740 1 client.18543 shutdown 2024-09-19T06:23:52.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.374+0000 7fe14fcd5740 1 -- 172.21.15.2:0/46861364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f92e494d40 msgr2=0x55f92e497a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:52.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.374+0000 7fe14fcd5740 1 --2- 172.21.15.2:0/46861364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f92e494d40 0x55f92e497a60 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fe140020de0 tx=0x7fe140004a40 comp rx=0 tx=0).stop 2024-09-19T06:23:52.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.374+0000 7fe14fcd5740 1 -- 172.21.15.2:0/46861364 shutdown_connections 2024-09-19T06:23:52.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.374+0000 7fe14fcd5740 1 --2- 172.21.15.2:0/46861364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f92e494d40 0x55f92e497a60 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:52.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.374+0000 7fe14fcd5740 1 --2- 172.21.15.2:0/46861364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f92e48a480 0x55f92e49cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:52.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.374+0000 7fe14fcd5740 1 --2- 172.21.15.2:0/46861364 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55f92e50fc80 0x55f92e5120a0 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:52.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.374+0000 7fe14fcd5740 1 --2- 172.21.15.2:0/46861364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f92e489b60 0x55f92e49cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:52.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.374+0000 7fe14fcd5740 1 -- 172.21.15.2:0/46861364 >> 172.21.15.2:0/46861364 conn(0x55f92e4860f0 msgr2=0x55f92e490c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:52.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.374+0000 7fe126ffd640 0 client.18543 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:52.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.374+0000 7fe14fcd5740 1 -- 172.21.15.2:0/46861364 shutdown_connections 2024-09-19T06:23:52.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.374+0000 7fe14fcd5740 1 -- 172.21.15.2:0/46861364 wait complete. 2024-09-19T06:23:52.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.374+0000 7fe14fcd5740 20 client.18543 trim_cache size 0 max 16384 2024-09-19T06:23:52.387 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:23:52.387 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T06:23:52.387 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "b40c1f64-f022-43c6-b870-1a973aa5abd5", 2024-09-19T06:23:52.387 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T06:23:52.387 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:23:52.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.375+0000 7fe14d8fc640 1 -- 172.21.15.2:0/3513809952 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe1340a33b0 msgr2=0x7fe1340a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:52.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.375+0000 7fe14d8fc640 1 --2- 172.21.15.2:0/3513809952 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe1340a33b0 0x7fe1340a5870 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe140007470 tx=0x7fe140007400 comp rx=0 tx=0).stop 2024-09-19T06:23:52.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.375+0000 7fe14d8fc640 1 -- 172.21.15.2:0/3513809952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe148100e30 msgr2=0x7fe14810ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:52.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.375+0000 7fe14d8fc640 1 --2- 172.21.15.2:0/3513809952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe148100e30 0x7fe14810ed90 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fe130006010 tx=0x7fe130004270 comp rx=0 tx=0).stop 2024-09-19T06:23:52.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.375+0000 7fe14d8fc640 1 -- 172.21.15.2:0/3513809952 shutdown_connections 2024-09-19T06:23:52.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.375+0000 7fe14d8fc640 1 --2- 172.21.15.2:0/3513809952 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe1340a33b0 0x7fe1340a5870 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:52.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.375+0000 7fe14d8fc640 1 --2- 172.21.15.2:0/3513809952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1481055b0 0x7fe14810f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:52.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.375+0000 7fe14d8fc640 1 --2- 172.21.15.2:0/3513809952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe148100e30 0x7fe14810ed90 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:52.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.375+0000 7fe14d8fc640 1 --2- 172.21.15.2:0/3513809952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe148100480 0x7fe14810e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:52.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.375+0000 7fe14d8fc640 1 -- 172.21.15.2:0/3513809952 >> 172.21.15.2:0/3513809952 conn(0x7fe148077210 msgr2=0x7fe1480fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:52.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.375+0000 7fe14d8fc640 1 -- 172.21.15.2:0/3513809952 shutdown_connections 2024-09-19T06:23:52.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:52.375+0000 7fe14d8fc640 1 -- 172.21.15.2:0/3513809952 wait complete. 2024-09-19T06:23:53.082 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:23:53.328 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:53 smithi002 ceph-mon[30982]: pgmap v281: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:23:53.328 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:53 smithi002 ceph-mon[30982]: scrub queued for path: / 2024-09-19T06:23:53.328 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:53 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:23:53.328 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:53 smithi002 ceph-mon[30982]: scrub summary: active paths [/] 2024-09-19T06:23:53.328 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:53 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:23:53.386 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:23:53.592 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:53 smithi002 ceph-mon[30982]: scrub summary: idle 2024-09-19T06:23:53.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:53 smithi090 ceph-mon[34497]: pgmap v281: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:23:53.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:53 smithi090 ceph-mon[34497]: scrub queued for path: / 2024-09-19T06:23:53.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:53 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:23:53.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:53 smithi090 ceph-mon[34497]: scrub summary: active paths [/] 2024-09-19T06:23:53.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:53 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:23:53.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:53 smithi090 ceph-mon[34497]: scrub summary: idle 2024-09-19T06:23:53.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:53 smithi089 ceph-mon[34160]: pgmap v281: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:23:53.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:53 smithi089 ceph-mon[34160]: scrub queued for path: / 2024-09-19T06:23:53.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:53 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:23:53.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:53 smithi089 ceph-mon[34160]: scrub summary: active paths [/] 2024-09-19T06:23:53.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:53 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:23:53.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:53 smithi089 ceph-mon[34160]: scrub summary: idle 2024-09-19T06:23:53.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.785+0000 7fc6a6ac2640 1 -- 172.21.15.2:0/1453361342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6a0103660 msgr2=0x7fc6a010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:53.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.785+0000 7fc6a6ac2640 1 --2- 172.21.15.2:0/1453361342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6a0103660 0x7fc6a010bb50 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7fc690009900 tx=0x7fc69002a480 comp rx=0 tx=0).stop 2024-09-19T06:23:53.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.785+0000 7fc6a6ac2640 1 -- 172.21.15.2:0/1453361342 shutdown_connections 2024-09-19T06:23:53.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.785+0000 7fc6a6ac2640 1 --2- 172.21.15.2:0/1453361342 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6a010c170 0x7fc6a010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.785+0000 7fc6a6ac2640 1 --2- 172.21.15.2:0/1453361342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6a0103660 0x7fc6a010bb50 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.785+0000 7fc6a6ac2640 1 --2- 172.21.15.2:0/1453361342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6a0102d40 0x7fc6a0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.785+0000 7fc6a6ac2640 1 -- 172.21.15.2:0/1453361342 >> 172.21.15.2:0/1453361342 conn(0x7fc6a00fc7a0 msgr2=0x7fc6a00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:53.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.785+0000 7fc6a6ac2640 1 -- 172.21.15.2:0/1453361342 shutdown_connections 2024-09-19T06:23:53.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.785+0000 7fc6a6ac2640 1 -- 172.21.15.2:0/1453361342 wait complete. 2024-09-19T06:23:53.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.786+0000 7fc6a6ac2640 1 Processor -- start 2024-09-19T06:23:53.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.786+0000 7fc6a6ac2640 1 -- start start 2024-09-19T06:23:53.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.786+0000 7fc6a6ac2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6a0102d40 0x7fc6a019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:53.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.786+0000 7fc6a6ac2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6a0103660 0x7fc6a019aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:53.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.786+0000 7fc6a6ac2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6a010c170 0x7fc6a019ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:53.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.786+0000 7fc6a6ac2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a0111e20 con 0x7fc6a010c170 2024-09-19T06:23:53.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.786+0000 7fc6a6ac2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a0111ca0 con 0x7fc6a0103660 2024-09-19T06:23:53.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.786+0000 7fc6a6ac2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a0111fa0 con 0x7fc6a0102d40 2024-09-19T06:23:53.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.786+0000 7fc6a505f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6a010c170 0x7fc6a019ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:53.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.786+0000 7fc6a505f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6a010c170 0x7fc6a019ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52064/0 (socket says 172.21.15.2:52064) 2024-09-19T06:23:53.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.786+0000 7fc6a505f640 1 -- 172.21.15.2:0/3814054093 learned_addr learned my addr 172.21.15.2:0/3814054093 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:53.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.786+0000 7fc69ffff640 1 --2- 172.21.15.2:0/3814054093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6a0103660 0x7fc6a019aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:53.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.786+0000 7fc6a485e640 1 --2- 172.21.15.2:0/3814054093 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6a0102d40 0x7fc6a019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:53.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.786+0000 7fc6a505f640 1 -- 172.21.15.2:0/3814054093 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6a0102d40 msgr2=0x7fc6a019a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:53.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.786+0000 7fc6a505f640 1 --2- 172.21.15.2:0/3814054093 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6a0102d40 0x7fc6a019a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.786+0000 7fc6a505f640 1 -- 172.21.15.2:0/3814054093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6a0103660 msgr2=0x7fc6a019aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:53.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.786+0000 7fc6a505f640 1 --2- 172.21.15.2:0/3814054093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6a0103660 0x7fc6a019aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.786+0000 7fc6a505f640 1 -- 172.21.15.2:0/3814054093 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6a019f540 con 0x7fc6a010c170 2024-09-19T06:23:53.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.786+0000 7fc6a485e640 1 --2- 172.21.15.2:0/3814054093 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6a0102d40 0x7fc6a019a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:23:53.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.787+0000 7fc6a505f640 1 --2- 172.21.15.2:0/3814054093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6a010c170 0x7fc6a019ee60 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fc69800eaa0 tx=0x7fc69800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:53.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.787+0000 7fc69dffb640 1 -- 172.21.15.2:0/3814054093 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69800cdb0 con 0x7fc6a010c170 2024-09-19T06:23:53.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.787+0000 7fc6a6ac2640 1 -- 172.21.15.2:0/3814054093 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6a019f830 con 0x7fc6a010c170 2024-09-19T06:23:53.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.787+0000 7fc69dffb640 1 -- 172.21.15.2:0/3814054093 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc698005020 con 0x7fc6a010c170 2024-09-19T06:23:53.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.787+0000 7fc69dffb640 1 -- 172.21.15.2:0/3814054093 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6980116d0 con 0x7fc6a010c170 2024-09-19T06:23:53.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.787+0000 7fc6a6ac2640 1 -- 172.21.15.2:0/3814054093 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6a01a7110 con 0x7fc6a010c170 2024-09-19T06:23:53.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.789+0000 7fc69dffb640 1 -- 172.21.15.2:0/3814054093 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fc6980051d0 con 0x7fc6a010c170 2024-09-19T06:23:53.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.789+0000 7fc6a8e9b740 1 Processor -- start 2024-09-19T06:23:53.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.790+0000 7fc6a8e9b740 1 -- start start 2024-09-19T06:23:53.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.790+0000 7fc6a8e9b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562abda1f4a0 0x562abda1f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:53.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.790+0000 7fc6a8e9b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562abda1fdc0 0x562abda2a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:53.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.790+0000 7fc6a8e9b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562abda2a680 0x562abda2ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:53.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.790+0000 7fc6a8e9b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562abd9852e0 con 0x562abda1f4a0 2024-09-19T06:23:53.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.790+0000 7fc6a8e9b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562abd92cce0 con 0x562abda2a680 2024-09-19T06:23:53.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.790+0000 7fc6a8e9b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562abd9812a0 con 0x562abda1fdc0 2024-09-19T06:23:53.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.790+0000 7fc69ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562abda1f4a0 0x562abda1f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:53.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.790+0000 7fc69dffb640 1 --2- 172.21.15.2:0/3814054093 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc68c0a33b0 0x7fc68c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:53.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.790+0000 7fc69ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562abda1f4a0 0x562abda1f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52080/0 (socket says 172.21.15.2:52080) 2024-09-19T06:23:53.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.790+0000 7fc69ffff640 1 -- 172.21.15.2:0/82999587 learned_addr learned my addr 172.21.15.2:0/82999587 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:53.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.790+0000 7fc6a485e640 1 --2- 172.21.15.2:0/82999587 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562abda1fdc0 0x562abda2a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:53.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.790+0000 7fc6a505f640 1 --2- 172.21.15.2:0/3814054093 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc68c0a33b0 0x7fc68c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:53.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.790+0000 7fc69dffb640 1 -- 172.21.15.2:0/3814054093 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7fc6980cfec0 con 0x7fc6a010c170 2024-09-19T06:23:53.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.790+0000 7fc69ffff640 1 -- 172.21.15.2:0/82999587 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562abda1fdc0 msgr2=0x562abda2a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:53.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.790+0000 7fc69ffff640 1 --2- 172.21.15.2:0/82999587 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562abda1fdc0 0x562abda2a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.790+0000 7fc69ffff640 1 -- 172.21.15.2:0/82999587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562abda2a680 msgr2=0x562abda2ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:53.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.790+0000 7fc69ffff640 1 --2- 172.21.15.2:0/82999587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562abda2a680 0x562abda2ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.790+0000 7fc69ffff640 1 -- 172.21.15.2:0/82999587 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562abd911440 con 0x562abda1f4a0 2024-09-19T06:23:53.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.791+0000 7fc69ffff640 1 --2- 172.21.15.2:0/82999587 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562abda1f4a0 0x562abda1f880 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fc69002a9a0 tx=0x7fc6900095e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1971fb4eae8c6d97 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:53.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.791+0000 7fc6a505f640 1 --2- 172.21.15.2:0/3814054093 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc68c0a33b0 0x7fc68c0a5870 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc69809be40 tx=0x7fc69806ae30 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:53.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.791+0000 7fc696ffd640 1 -- 172.21.15.2:0/82999587 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc690035040 con 0x562abda1f4a0 2024-09-19T06:23:53.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.791+0000 7fc696ffd640 1 -- 172.21.15.2:0/82999587 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc690032e50 con 0x562abda1f4a0 2024-09-19T06:23:53.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.791+0000 7fc696ffd640 1 -- 172.21.15.2:0/82999587 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc690005600 con 0x562abda1f4a0 2024-09-19T06:23:53.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.791+0000 7fc6a8e9b740 1 -- 172.21.15.2:0/82999587 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562abda1f4a0 msgr2=0x562abda1f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:53.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.791+0000 7fc6a8e9b740 1 --2- 172.21.15.2:0/82999587 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562abda1f4a0 0x562abda1f880 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fc69002a9a0 tx=0x7fc6900095e0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.791+0000 7fc6a8e9b740 1 -- 172.21.15.2:0/82999587 shutdown_connections 2024-09-19T06:23:53.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.791+0000 7fc6a8e9b740 1 --2- 172.21.15.2:0/82999587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562abda2a680 0x562abda2ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.791+0000 7fc6a8e9b740 1 --2- 172.21.15.2:0/82999587 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562abda1fdc0 0x562abda2a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.792+0000 7fc6a8e9b740 1 --2- 172.21.15.2:0/82999587 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562abda1f4a0 0x562abda1f880 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.792+0000 7fc6a8e9b740 1 -- 172.21.15.2:0/82999587 >> 172.21.15.2:0/82999587 conn(0x562abda1ba30 msgr2=0x562abda1be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:53.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.792+0000 7fc6a8e9b740 1 -- 172.21.15.2:0/82999587 shutdown_connections 2024-09-19T06:23:53.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.792+0000 7fc6a8e9b740 1 -- 172.21.15.2:0/82999587 wait complete. 2024-09-19T06:23:53.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.792+0000 7fc6a8e9b740 1 -- start start 2024-09-19T06:23:53.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.792+0000 7fc6a8e9b740 1 Processor -- start 2024-09-19T06:23:53.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.792+0000 7fc6a8e9b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562abda1f4a0 0x562abda29fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:53.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.792+0000 7fc6a8e9b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562abda1fdc0 0x562abda27280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:53.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.792+0000 7fc6a8e9b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562abda2a680 0x562abda277e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:53.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.792+0000 7fc6a8e9b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562abda2d250 con 0x562abda2a680 2024-09-19T06:23:53.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.792+0000 7fc6a8e9b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562abd940050 con 0x562abda1fdc0 2024-09-19T06:23:53.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.792+0000 7fc6a8e9b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562abda2d3d0 con 0x562abda1f4a0 2024-09-19T06:23:53.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.792+0000 7fc6a8e9b740 10 client.0 _ll_register_callbacks cb 0x562abd980160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:53.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.793+0000 7fc69ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562abda2a680 0x562abda277e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:53.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.793+0000 7fc69ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562abda2a680 0x562abda277e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52094/0 (socket says 172.21.15.2:52094) 2024-09-19T06:23:53.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.793+0000 7fc69ffff640 1 -- 172.21.15.2:0/308287940 learned_addr learned my addr 172.21.15.2:0/308287940 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:53.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.793+0000 7fc69ffff640 1 --2- 172.21.15.2:0/308287940 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562abda1f4a0 0x562abda29fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:53.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.793+0000 7fc6a485e640 1 --2- 172.21.15.2:0/308287940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562abda1fdc0 0x562abda27280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:53.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.793+0000 7fc69ffff640 1 -- 172.21.15.2:0/308287940 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562abda1f4a0 msgr2=0x562abda29fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:53.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.793+0000 7fc69ffff640 1 --2- 172.21.15.2:0/308287940 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562abda1f4a0 0x562abda29fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.793+0000 7fc69ffff640 1 -- 172.21.15.2:0/308287940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562abda1fdc0 msgr2=0x562abda27280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:53.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.793+0000 7fc69ffff640 1 --2- 172.21.15.2:0/308287940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562abda1fdc0 0x562abda27280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.793+0000 7fc69ffff640 1 -- 172.21.15.2:0/308287940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562abd6f63c0 con 0x562abda2a680 2024-09-19T06:23:53.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.793+0000 7fc6a485e640 1 --2- 172.21.15.2:0/308287940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562abda1fdc0 0x562abda27280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:53.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.793+0000 7fc69ffff640 1 --2- 172.21.15.2:0/308287940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562abda2a680 0x562abda277e0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fc690006010 tx=0x7fc6900051e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b7caed51f9a32a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:53.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.793+0000 7fc67ffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:53.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.793+0000 7fc67ffff640 1 -- 172.21.15.2:0/308287940 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc690035030 con 0x562abda2a680 2024-09-19T06:23:53.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.793+0000 7fc67ffff640 1 -- 172.21.15.2:0/308287940 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7fc6900316b0 con 0x562abda2a680 2024-09-19T06:23:53.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.793+0000 7fc6a8e9b740 1 -- 172.21.15.2:0/308287940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc690032e50 con 0x562abda2a680 2024-09-19T06:23:53.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.793+0000 7fc67ffff640 1 -- 172.21.15.2:0/308287940 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc690004020 con 0x562abda2a680 2024-09-19T06:23:53.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.793+0000 7fc6a8e9b740 10 client.18555 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:53.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.793+0000 7fc6a8e9b740 1 -- 172.21.15.2:0/308287940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562abda38c20 con 0x562abda2a680 2024-09-19T06:23:53.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.794+0000 7fc67ffff640 1 -- 172.21.15.2:0/308287940 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc690032e50 con 0x562abda2a680 2024-09-19T06:23:53.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.794+0000 7fc67ffff640 1 -- 172.21.15.2:0/308287940 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fc6900035f0 con 0x562abda2a680 2024-09-19T06:23:53.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.794+0000 7fc6a8e9b740 10 client.18555 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:53.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.794+0000 7fc6a8e9b740 10 client.18555 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:53.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.794+0000 7fc6a8e9b740 20 client.18555 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:53.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.794+0000 7fc6a8e9b740 1 --2- 172.21.15.2:0/308287940 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562abda39f70 0x562abda3c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:53.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.794+0000 7fc6a8e9b740 4 client.18555 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:23:53.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.794+0000 7fc6a8e9b740 1 -- 172.21.15.2:0/308287940 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562abd992850 con 0x562abda39f70 2024-09-19T06:23:53.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.794+0000 7fc6a485e640 1 --2- 172.21.15.2:0/308287940 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562abda39f70 0x562abda3c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:53.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.795+0000 7fc67ffff640 10 client.18555 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:53.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.795+0000 7fc6a485e640 1 --2- 172.21.15.2:0/308287940 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562abda39f70 0x562abda3c360 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b424da5f6e68c414 server_cookie=936fd00355c64e4a in_seq=0 out_seq=0 2024-09-19T06:23:53.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.795+0000 7fc67ffff640 1 -- 172.21.15.2:0/308287940 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562abd992850 con 0x562abda39f70 2024-09-19T06:23:53.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.795+0000 7fc67ffff640 10 client.18555 handle_command_reply: tid=0 2024-09-19T06:23:53.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.795+0000 7fc6a8e9b740 1 client.18555 shutdown 2024-09-19T06:23:53.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.795+0000 7fc6a8e9b740 1 -- 172.21.15.2:0/308287940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562abda2a680 msgr2=0x562abda277e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:53.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.795+0000 7fc6a8e9b740 1 --2- 172.21.15.2:0/308287940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562abda2a680 0x562abda277e0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fc690006010 tx=0x7fc6900051e0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.795+0000 7fc6a8e9b740 1 -- 172.21.15.2:0/308287940 shutdown_connections 2024-09-19T06:23:53.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.795+0000 7fc6a8e9b740 1 --2- 172.21.15.2:0/308287940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562abda2a680 0x562abda277e0 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.795+0000 7fc6a8e9b740 1 --2- 172.21.15.2:0/308287940 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562abda39f70 0x562abda3c360 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.795+0000 7fc6a8e9b740 1 --2- 172.21.15.2:0/308287940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562abda1fdc0 0x562abda27280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.795+0000 7fc6a8e9b740 1 --2- 172.21.15.2:0/308287940 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562abda1f4a0 0x562abda29fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.795+0000 7fc67ffff640 0 client.18555 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:53.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.795+0000 7fc6a8e9b740 1 -- 172.21.15.2:0/308287940 >> 172.21.15.2:0/308287940 conn(0x562abda1ba30 msgr2=0x562abda21760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:53.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.796+0000 7fc6a8e9b740 1 -- 172.21.15.2:0/308287940 shutdown_connections 2024-09-19T06:23:53.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.796+0000 7fc6a8e9b740 1 -- 172.21.15.2:0/308287940 wait complete. 2024-09-19T06:23:53.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.796+0000 7fc6a8e9b740 20 client.18555 trim_cache size 0 max 16384 2024-09-19T06:23:53.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.813+0000 7fc6a8e9b740 1 Processor -- start 2024-09-19T06:23:53.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.813+0000 7fc6a8e9b740 1 -- start start 2024-09-19T06:23:53.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.813+0000 7fc6a8e9b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562abda1f4a0 0x562abda244e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:53.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.813+0000 7fc6a8e9b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562abda1fdc0 0x562abda24a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:53.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.813+0000 7fc6a8e9b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562abda2a680 0x562abda28ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:53.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.813+0000 7fc6a8e9b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a01b22d0 con 0x562abda1fdc0 2024-09-19T06:23:53.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.813+0000 7fc6a8e9b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a01afba0 con 0x562abda2a680 2024-09-19T06:23:53.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.813+0000 7fc6a8e9b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a01ada10 con 0x562abda1f4a0 2024-09-19T06:23:53.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.814+0000 7fc6a485e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562abda1fdc0 0x562abda24a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:53.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.814+0000 7fc6a485e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562abda1fdc0 0x562abda24a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52102/0 (socket says 172.21.15.2:52102) 2024-09-19T06:23:53.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.814+0000 7fc6a485e640 1 -- 172.21.15.2:0/3696533242 learned_addr learned my addr 172.21.15.2:0/3696533242 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:53.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.814+0000 7fc69ffff640 1 --2- 172.21.15.2:0/3696533242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562abda2a680 0x562abda28ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:53.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.814+0000 7fc69ffff640 1 --2- 172.21.15.2:0/3696533242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562abda1f4a0 0x562abda244e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:53.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.814+0000 7fc6a485e640 1 -- 172.21.15.2:0/3696533242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562abda1f4a0 msgr2=0x562abda244e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:53.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.814+0000 7fc6a485e640 1 --2- 172.21.15.2:0/3696533242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562abda1f4a0 0x562abda244e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.814+0000 7fc6a485e640 1 -- 172.21.15.2:0/3696533242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562abda2a680 msgr2=0x562abda28ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:53.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.814+0000 7fc6a485e640 1 --2- 172.21.15.2:0/3696533242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562abda2a680 0x562abda28ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.814+0000 7fc6a485e640 1 -- 172.21.15.2:0/3696533242 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562abda2a340 con 0x562abda1fdc0 2024-09-19T06:23:53.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.814+0000 7fc6a485e640 1 --2- 172.21.15.2:0/3696533242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562abda1fdc0 0x562abda24a20 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x562abda1c890 tx=0x7fc68800f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c68a0e1e0924cad0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:53.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.814+0000 7fc6967fc640 1 -- 172.21.15.2:0/3696533242 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc688021070 con 0x562abda1fdc0 2024-09-19T06:23:53.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.814+0000 7fc6967fc640 1 -- 172.21.15.2:0/3696533242 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc68800eb20 con 0x562abda1fdc0 2024-09-19T06:23:53.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.814+0000 7fc6967fc640 1 -- 172.21.15.2:0/3696533242 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68801bb70 con 0x562abda1fdc0 2024-09-19T06:23:53.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.815+0000 7fc6a8e9b740 1 -- 172.21.15.2:0/3696533242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562abda1fdc0 msgr2=0x562abda24a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:53.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.815+0000 7fc6a8e9b740 1 --2- 172.21.15.2:0/3696533242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562abda1fdc0 0x562abda24a20 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x562abda1c890 tx=0x7fc68800f7f0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.815+0000 7fc6a8e9b740 1 -- 172.21.15.2:0/3696533242 shutdown_connections 2024-09-19T06:23:53.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.815+0000 7fc6a8e9b740 1 --2- 172.21.15.2:0/3696533242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562abda2a680 0x562abda28ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.815+0000 7fc6a8e9b740 1 --2- 172.21.15.2:0/3696533242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562abda1fdc0 0x562abda24a20 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.815+0000 7fc6a8e9b740 1 --2- 172.21.15.2:0/3696533242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562abda1f4a0 0x562abda244e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.815+0000 7fc6a8e9b740 1 -- 172.21.15.2:0/3696533242 >> 172.21.15.2:0/3696533242 conn(0x562abda1ba30 msgr2=0x562abda26370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:53.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.815+0000 7fc6a8e9b740 1 -- 172.21.15.2:0/3696533242 shutdown_connections 2024-09-19T06:23:53.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.815+0000 7fc6a8e9b740 1 -- 172.21.15.2:0/3696533242 wait complete. 2024-09-19T06:23:53.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.815+0000 7fc6a8e9b740 1 -- start start 2024-09-19T06:23:53.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.815+0000 7fc6a8e9b740 1 Processor -- start 2024-09-19T06:23:53.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.816+0000 7fc6a8e9b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562abda1f4a0 0x562abda3ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:53.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.816+0000 7fc6a8e9b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562abda1fdc0 0x562abda3efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:53.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.816+0000 7fc6a8e9b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562abda2a680 0x562abda9c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:53.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.816+0000 7fc6a8e9b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a01ae060 con 0x562abda2a680 2024-09-19T06:23:53.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.816+0000 7fc6a8e9b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a01af4d0 con 0x562abda1fdc0 2024-09-19T06:23:53.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.816+0000 7fc6a8e9b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a01ae730 con 0x562abda1f4a0 2024-09-19T06:23:53.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.816+0000 7fc6a8e9b740 10 client.0 _ll_register_callbacks cb 0x7fc68800b2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:53.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.816+0000 7fc69ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562abda2a680 0x562abda9c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:53.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.816+0000 7fc69ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562abda2a680 0x562abda9c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52112/0 (socket says 172.21.15.2:52112) 2024-09-19T06:23:53.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.816+0000 7fc69ffff640 1 -- 172.21.15.2:0/1598346033 learned_addr learned my addr 172.21.15.2:0/1598346033 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:53.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.816+0000 7fc6a485e640 1 --2- 172.21.15.2:0/1598346033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562abda1fdc0 0x562abda3efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:53.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.816+0000 7fc69ffff640 1 --2- 172.21.15.2:0/1598346033 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562abda1f4a0 0x562abda3ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:53.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.816+0000 7fc69ffff640 1 -- 172.21.15.2:0/1598346033 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562abda1f4a0 msgr2=0x562abda3ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:53.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.816+0000 7fc69ffff640 1 --2- 172.21.15.2:0/1598346033 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562abda1f4a0 0x562abda3ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.816+0000 7fc69ffff640 1 -- 172.21.15.2:0/1598346033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562abda1fdc0 msgr2=0x562abda3efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:53.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.816+0000 7fc69ffff640 1 --2- 172.21.15.2:0/1598346033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562abda1fdc0 0x562abda3efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.816+0000 7fc69ffff640 1 -- 172.21.15.2:0/1598346033 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562abda9cf20 con 0x562abda2a680 2024-09-19T06:23:53.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.817+0000 7fc69ffff640 1 --2- 172.21.15.2:0/1598346033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562abda2a680 0x562abda9c880 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7fc690003a90 tx=0x7fc690047040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0d2227304618065 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:53.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.817+0000 7fc67ffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:53.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.817+0000 7fc67ffff640 1 -- 172.21.15.2:0/1598346033 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc690035070 con 0x562abda2a680 2024-09-19T06:23:53.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.817+0000 7fc67ffff640 1 -- 172.21.15.2:0/1598346033 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7fc6900035f0 con 0x562abda2a680 2024-09-19T06:23:53.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.817+0000 7fc6a8e9b740 1 -- 172.21.15.2:0/1598346033 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc68800eb20 con 0x562abda2a680 2024-09-19T06:23:53.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.817+0000 7fc67ffff640 1 -- 172.21.15.2:0/1598346033 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc6900037f0 con 0x562abda2a680 2024-09-19T06:23:53.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.817+0000 7fc6a8e9b740 10 client.18561 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:53.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.817+0000 7fc6a8e9b740 1 -- 172.21.15.2:0/1598346033 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562abdaa4290 con 0x562abda2a680 2024-09-19T06:23:53.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.817+0000 7fc67ffff640 1 -- 172.21.15.2:0/1598346033 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc68800eb20 con 0x562abda2a680 2024-09-19T06:23:53.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.817+0000 7fc67ffff640 1 -- 172.21.15.2:0/1598346033 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fc6900316b0 con 0x562abda2a680 2024-09-19T06:23:53.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.817+0000 7fc6a8e9b740 10 client.18561 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:53.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.817+0000 7fc6a8e9b740 10 client.18561 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:53.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.817+0000 7fc6a8e9b740 20 client.18561 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:53.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.817+0000 7fc6a8e9b740 1 --2- 172.21.15.2:0/1598346033 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562abdaa4720 0x562abdaa6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:53.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.817+0000 7fc6a8e9b740 4 client.18561 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:23:53.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.817+0000 7fc6a8e9b740 1 -- 172.21.15.2:0/1598346033 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562abd98cd60 con 0x562abdaa4720 2024-09-19T06:23:53.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.818+0000 7fc6a485e640 1 --2- 172.21.15.2:0/1598346033 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562abdaa4720 0x562abdaa6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:53.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.818+0000 7fc67ffff640 10 client.18561 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:53.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.818+0000 7fc6a485e640 1 --2- 172.21.15.2:0/1598346033 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562abdaa4720 0x562abdaa6b40 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c02fae3bf3f42552 server_cookie=1df476e7c1837771 in_seq=0 out_seq=0 2024-09-19T06:23:53.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.818+0000 7fc67ffff640 1 -- 172.21.15.2:0/1598346033 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x562abd98cd60 con 0x562abdaa4720 2024-09-19T06:23:53.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.818+0000 7fc67ffff640 10 client.18561 handle_command_reply: tid=0 2024-09-19T06:23:53.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.818+0000 7fc6a8e9b740 1 client.18561 shutdown 2024-09-19T06:23:53.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.818+0000 7fc6a8e9b740 1 -- 172.21.15.2:0/1598346033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562abda2a680 msgr2=0x562abda9c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:53.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.818+0000 7fc6a8e9b740 1 --2- 172.21.15.2:0/1598346033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562abda2a680 0x562abda9c880 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7fc690003a90 tx=0x7fc690047040 comp rx=0 tx=0).stop 2024-09-19T06:23:53.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.818+0000 7fc6a8e9b740 1 -- 172.21.15.2:0/1598346033 shutdown_connections 2024-09-19T06:23:53.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.818+0000 7fc6a8e9b740 1 --2- 172.21.15.2:0/1598346033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562abda2a680 0x562abda9c880 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.818+0000 7fc6a8e9b740 1 --2- 172.21.15.2:0/1598346033 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562abdaa4720 0x562abdaa6b40 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.818+0000 7fc6a8e9b740 1 --2- 172.21.15.2:0/1598346033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562abda1fdc0 0x562abda3efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.818+0000 7fc6a8e9b740 1 --2- 172.21.15.2:0/1598346033 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562abda1f4a0 0x562abda3ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.818+0000 7fc6a8e9b740 1 -- 172.21.15.2:0/1598346033 >> 172.21.15.2:0/1598346033 conn(0x562abda1ba30 msgr2=0x562abda28ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:53.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.818+0000 7fc67ffff640 0 client.18561 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:53.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.819+0000 7fc6a8e9b740 1 -- 172.21.15.2:0/1598346033 shutdown_connections 2024-09-19T06:23:53.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.819+0000 7fc6a8e9b740 1 -- 172.21.15.2:0/1598346033 wait complete. 2024-09-19T06:23:53.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.819+0000 7fc6a8e9b740 20 client.18561 trim_cache size 0 max 16384 2024-09-19T06:23:53.826 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:23:53.826 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T06:23:53.826 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T06:23:53.826 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:23:53.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.819+0000 7fc6a6ac2640 1 -- 172.21.15.2:0/3814054093 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc68c0a33b0 msgr2=0x7fc68c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:53.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.819+0000 7fc6a6ac2640 1 --2- 172.21.15.2:0/3814054093 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc68c0a33b0 0x7fc68c0a5870 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc69809be40 tx=0x7fc69806ae30 comp rx=0 tx=0).stop 2024-09-19T06:23:53.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.819+0000 7fc6a6ac2640 1 -- 172.21.15.2:0/3814054093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6a010c170 msgr2=0x7fc6a019ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:53.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.819+0000 7fc6a6ac2640 1 --2- 172.21.15.2:0/3814054093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6a010c170 0x7fc6a019ee60 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fc69800eaa0 tx=0x7fc69800ef60 comp rx=0 tx=0).stop 2024-09-19T06:23:53.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.819+0000 7fc6a6ac2640 1 -- 172.21.15.2:0/3814054093 shutdown_connections 2024-09-19T06:23:53.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.819+0000 7fc6a6ac2640 1 --2- 172.21.15.2:0/3814054093 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc68c0a33b0 0x7fc68c0a5870 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.819+0000 7fc6a6ac2640 1 --2- 172.21.15.2:0/3814054093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6a010c170 0x7fc6a019ee60 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.819+0000 7fc6a6ac2640 1 --2- 172.21.15.2:0/3814054093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6a0103660 0x7fc6a019aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.819+0000 7fc6a6ac2640 1 --2- 172.21.15.2:0/3814054093 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6a0102d40 0x7fc6a019a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.819+0000 7fc6a6ac2640 1 -- 172.21.15.2:0/3814054093 >> 172.21.15.2:0/3814054093 conn(0x7fc6a00fc7a0 msgr2=0x7fc6a01008d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:53.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.820+0000 7fc6a6ac2640 1 -- 172.21.15.2:0/3814054093 shutdown_connections 2024-09-19T06:23:53.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:53.820+0000 7fc6a6ac2640 1 -- 172.21.15.2:0/3814054093 wait complete. 2024-09-19T06:23:54.521 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:23:54.522 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:23:54.780 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:23:55.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.174+0000 7f8679d15640 1 -- 172.21.15.2:0/3242689848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8674101de0 msgr2=0x7f86741021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:55.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.174+0000 7f8679d15640 1 --2- 172.21.15.2:0/3242689848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8674101de0 0x7f86741021c0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f8664009900 tx=0x7f866402a410 comp rx=0 tx=0).stop 2024-09-19T06:23:55.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.174+0000 7f8679d15640 1 -- 172.21.15.2:0/3242689848 shutdown_connections 2024-09-19T06:23:55.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.174+0000 7f8679d15640 1 --2- 172.21.15.2:0/3242689848 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8674106f10 0x7f867410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:55.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.174+0000 7f8679d15640 1 --2- 172.21.15.2:0/3242689848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8674102790 0x7f86741067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:55.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.174+0000 7f8679d15640 1 --2- 172.21.15.2:0/3242689848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8674101de0 0x7f86741021c0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:55.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.174+0000 7f8679d15640 1 -- 172.21.15.2:0/3242689848 >> 172.21.15.2:0/3242689848 conn(0x7f86740fd8c0 msgr2=0x7f86740ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:55.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.174+0000 7f8679d15640 1 -- 172.21.15.2:0/3242689848 shutdown_connections 2024-09-19T06:23:55.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.174+0000 7f8679d15640 1 -- 172.21.15.2:0/3242689848 wait complete. 2024-09-19T06:23:55.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.175+0000 7f8679d15640 1 Processor -- start 2024-09-19T06:23:55.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.175+0000 7f8679d15640 1 -- start start 2024-09-19T06:23:55.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.175+0000 7f8679d15640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8674101de0 0x7f86741983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:55.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.175+0000 7f8679d15640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8674102790 0x7f8674198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:55.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.175+0000 7f8679d15640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8674106f10 0x7f867419ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:55.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.175+0000 7f8679d15640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8674111e60 con 0x7f8674106f10 2024-09-19T06:23:55.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.175+0000 7f8679d15640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8674111ce0 con 0x7f8674102790 2024-09-19T06:23:55.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.175+0000 7f8679d15640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8674111fe0 con 0x7f8674101de0 2024-09-19T06:23:55.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.176+0000 7f8673fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8674106f10 0x7f867419ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:55.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.176+0000 7f8673fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8674106f10 0x7f867419ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52128/0 (socket says 172.21.15.2:52128) 2024-09-19T06:23:55.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.176+0000 7f8673fff640 1 -- 172.21.15.2:0/3861452225 learned_addr learned my addr 172.21.15.2:0/3861452225 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:55.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.176+0000 7f8672ffd640 1 --2- 172.21.15.2:0/3861452225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8674102790 0x7f8674198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:55.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.176+0000 7f86737fe640 1 --2- 172.21.15.2:0/3861452225 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8674101de0 0x7f86741983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:55.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.176+0000 7f8673fff640 1 -- 172.21.15.2:0/3861452225 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8674101de0 msgr2=0x7f86741983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:55.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.176+0000 7f8673fff640 1 --2- 172.21.15.2:0/3861452225 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8674101de0 0x7f86741983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:55.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.176+0000 7f8673fff640 1 -- 172.21.15.2:0/3861452225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8674102790 msgr2=0x7f8674198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:55.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.176+0000 7f8673fff640 1 --2- 172.21.15.2:0/3861452225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8674102790 0x7f8674198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:55.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.176+0000 7f8673fff640 1 -- 172.21.15.2:0/3861452225 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f867419d390 con 0x7f8674106f10 2024-09-19T06:23:55.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.176+0000 7f8673fff640 1 --2- 172.21.15.2:0/3861452225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8674106f10 0x7f867419ccb0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f866c00d750 tx=0x7f866c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:55.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.176+0000 7f8670ff9640 1 -- 172.21.15.2:0/3861452225 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f866c017070 con 0x7f8674106f10 2024-09-19T06:23:55.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.176+0000 7f8670ff9640 1 -- 172.21.15.2:0/3861452225 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f866c0054d0 con 0x7f8674106f10 2024-09-19T06:23:55.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.176+0000 7f8679d15640 1 -- 172.21.15.2:0/3861452225 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f867419d680 con 0x7f8674106f10 2024-09-19T06:23:55.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.176+0000 7f8670ff9640 1 -- 172.21.15.2:0/3861452225 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f866c004c60 con 0x7f8674106f10 2024-09-19T06:23:55.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.177+0000 7f8679d15640 1 -- 172.21.15.2:0/3861452225 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86741a4f60 con 0x7f8674106f10 2024-09-19T06:23:55.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.178+0000 7f8679d15640 1 -- 172.21.15.2:0/3861452225 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86741021c0 con 0x7f8674106f10 2024-09-19T06:23:55.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.179+0000 7f8670ff9640 1 -- 172.21.15.2:0/3861452225 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f866c004e00 con 0x7f8674106f10 2024-09-19T06:23:55.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.179+0000 7f8670ff9640 1 --2- 172.21.15.2:0/3861452225 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f865c0a3430 0x7f865c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:55.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.180+0000 7f86737fe640 1 --2- 172.21.15.2:0/3861452225 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f865c0a3430 0x7f865c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:55.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.180+0000 7f8670ff9640 1 -- 172.21.15.2:0/3861452225 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f866c0cf9c0 con 0x7f8674106f10 2024-09-19T06:23:55.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.180+0000 7f86737fe640 1 --2- 172.21.15.2:0/3861452225 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f865c0a3430 0x7f865c0a58f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8664031440 tx=0x7f8664005b50 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:55.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.183+0000 7f8670ff9640 1 -- 172.21.15.2:0/3861452225 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f866c09bdd0 con 0x7f8674106f10 2024-09-19T06:23:55.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.399+0000 7f8679d15640 1 -- 172.21.15.2:0/3861452225 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f867402d7c0 con 0x7f8674106f10 2024-09-19T06:23:55.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.400+0000 7f8670ff9640 1 -- 172.21.15.2:0/3861452225 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11882 (secure 0 0 0) 0x7f866c0a00d0 con 0x7f8674106f10 2024-09-19T06:23:55.402 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:23:55.402 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-09-19T06:14:49:104280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:14:48.191083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24470,24472,24497]},"id":1}]} 2024-09-19T06:23:55.402 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-09-19T06:23:55.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.402+0000 7f8679d15640 1 -- 172.21.15.2:0/3861452225 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f865c0a3430 msgr2=0x7f865c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:55.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.402+0000 7f8679d15640 1 --2- 172.21.15.2:0/3861452225 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f865c0a3430 0x7f865c0a58f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8664031440 tx=0x7f8664005b50 comp rx=0 tx=0).stop 2024-09-19T06:23:55.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.402+0000 7f8679d15640 1 -- 172.21.15.2:0/3861452225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8674106f10 msgr2=0x7f867419ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:55.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.402+0000 7f8679d15640 1 --2- 172.21.15.2:0/3861452225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8674106f10 0x7f867419ccb0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f866c00d750 tx=0x7f866c00dc10 comp rx=0 tx=0).stop 2024-09-19T06:23:55.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.402+0000 7f8679d15640 1 -- 172.21.15.2:0/3861452225 shutdown_connections 2024-09-19T06:23:55.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.402+0000 7f8679d15640 1 --2- 172.21.15.2:0/3861452225 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f865c0a3430 0x7f865c0a58f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:55.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.402+0000 7f8679d15640 1 --2- 172.21.15.2:0/3861452225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8674106f10 0x7f867419ccb0 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:55.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.402+0000 7f8679d15640 1 --2- 172.21.15.2:0/3861452225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8674102790 0x7f8674198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:55.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.402+0000 7f8679d15640 1 --2- 172.21.15.2:0/3861452225 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8674101de0 0x7f86741983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:55.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.403+0000 7f8679d15640 1 -- 172.21.15.2:0/3861452225 >> 172.21.15.2:0/3861452225 conn(0x7f86740fd8c0 msgr2=0x7f86740fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:55.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.403+0000 7f8679d15640 1 -- 172.21.15.2:0/3861452225 shutdown_connections 2024-09-19T06:23:55.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:55.403+0000 7f8679d15640 1 -- 172.21.15.2:0/3861452225 wait complete. 2024-09-19T06:23:55.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:55 smithi002 ceph-mon[30982]: pgmap v282: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2024-09-19T06:23:55.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:55 smithi090 ceph-mon[34497]: pgmap v282: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2024-09-19T06:23:55.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:55 smithi089 ceph-mon[34160]: pgmap v282: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2024-09-19T06:23:56.164 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:23:56.428 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:23:56.471 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:56 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/3861452225' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:23:56.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:56 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/3861452225' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:23:56.791 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:56 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/3861452225' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:23:56.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.874+0000 7fe83aeef640 1 -- 172.21.15.2:0/565167182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe834102570 msgr2=0x7fe8341029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:56.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.874+0000 7fe83aeef640 1 --2- 172.21.15.2:0/565167182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe834102570 0x7fe8341029b0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7fe820009900 tx=0x7fe82002a480 comp rx=0 tx=0).stop 2024-09-19T06:23:56.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.874+0000 7fe83aeef640 1 -- 172.21.15.2:0/565167182 shutdown_connections 2024-09-19T06:23:56.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.874+0000 7fe83aeef640 1 --2- 172.21.15.2:0/565167182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe834102ef0 0x7fe83410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:56.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.874+0000 7fe83aeef640 1 --2- 172.21.15.2:0/565167182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe834102570 0x7fe8341029b0 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:56.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.874+0000 7fe83aeef640 1 --2- 172.21.15.2:0/565167182 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe834100e20 0x7fe834101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:56.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.874+0000 7fe83aeef640 1 -- 172.21.15.2:0/565167182 >> 172.21.15.2:0/565167182 conn(0x7fe8340fc7d0 msgr2=0x7fe8340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:56.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.874+0000 7fe83aeef640 1 -- 172.21.15.2:0/565167182 shutdown_connections 2024-09-19T06:23:56.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.874+0000 7fe83aeef640 1 -- 172.21.15.2:0/565167182 wait complete. 2024-09-19T06:23:56.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.875+0000 7fe83aeef640 1 Processor -- start 2024-09-19T06:23:56.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.875+0000 7fe83aeef640 1 -- start start 2024-09-19T06:23:56.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.875+0000 7fe83aeef640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe834100e20 0x7fe834198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:56.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.875+0000 7fe83aeef640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe834102570 0x7fe834198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:56.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.875+0000 7fe83aeef640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe834102ef0 0x7fe83419ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:56.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.875+0000 7fe83aeef640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe834111f50 con 0x7fe834102ef0 2024-09-19T06:23:56.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.875+0000 7fe83aeef640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe834111dd0 con 0x7fe834102570 2024-09-19T06:23:56.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.875+0000 7fe83aeef640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe8341120d0 con 0x7fe834100e20 2024-09-19T06:23:56.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.875+0000 7fe83948c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe834102ef0 0x7fe83419ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:56.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.875+0000 7fe83948c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe834102ef0 0x7fe83419ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36744/0 (socket says 172.21.15.2:36744) 2024-09-19T06:23:56.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.875+0000 7fe83948c640 1 -- 172.21.15.2:0/2824132460 learned_addr learned my addr 172.21.15.2:0/2824132460 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:56.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.875+0000 7fe833fff640 1 --2- 172.21.15.2:0/2824132460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe834102570 0x7fe834198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:56.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.876+0000 7fe838c8b640 1 --2- 172.21.15.2:0/2824132460 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe834100e20 0x7fe834198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:56.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.876+0000 7fe83948c640 1 -- 172.21.15.2:0/2824132460 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe834100e20 msgr2=0x7fe834198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:56.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.876+0000 7fe83948c640 1 --2- 172.21.15.2:0/2824132460 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe834100e20 0x7fe834198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:56.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.876+0000 7fe83948c640 1 -- 172.21.15.2:0/2824132460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe834102570 msgr2=0x7fe834198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:56.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.876+0000 7fe83948c640 1 --2- 172.21.15.2:0/2824132460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe834102570 0x7fe834198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:56.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.876+0000 7fe83948c640 1 -- 172.21.15.2:0/2824132460 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe83419d3d0 con 0x7fe834102ef0 2024-09-19T06:23:56.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.876+0000 7fe83948c640 1 --2- 172.21.15.2:0/2824132460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe834102ef0 0x7fe83419ccf0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fe82c00cce0 tx=0x7fe82c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:56.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.876+0000 7fe831ffb640 1 -- 172.21.15.2:0/2824132460 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe82c00f450 con 0x7fe834102ef0 2024-09-19T06:23:56.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.876+0000 7fe83aeef640 1 -- 172.21.15.2:0/2824132460 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe83419d6c0 con 0x7fe834102ef0 2024-09-19T06:23:56.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.876+0000 7fe831ffb640 1 -- 172.21.15.2:0/2824132460 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe82c00faa0 con 0x7fe834102ef0 2024-09-19T06:23:56.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.876+0000 7fe831ffb640 1 -- 172.21.15.2:0/2824132460 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe82c018b70 con 0x7fe834102ef0 2024-09-19T06:23:56.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.877+0000 7fe83aeef640 1 -- 172.21.15.2:0/2824132460 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8341a4fa0 con 0x7fe834102ef0 2024-09-19T06:23:56.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.879+0000 7fe831ffb640 1 -- 172.21.15.2:0/2824132460 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fe82c018d10 con 0x7fe834102ef0 2024-09-19T06:23:56.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.879+0000 7fe83d2c8740 1 Processor -- start 2024-09-19T06:23:56.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.879+0000 7fe83d2c8740 1 -- start start 2024-09-19T06:23:56.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.879+0000 7fe831ffb640 1 --2- 172.21.15.2:0/2824132460 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe8240a33b0 0x7fe8240a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:56.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.879+0000 7fe83d2c8740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede151b40 0x560ede150090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:56.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.879+0000 7fe83d2c8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede1505d0 0x560ede150a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:56.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.879+0000 7fe83d2c8740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560ede15b370 0x560ede15d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:56.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.879+0000 7fe83d2c8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560ede0b62f0 con 0x560ede1505d0 2024-09-19T06:23:56.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.879+0000 7fe83d2c8740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x560ede05dcf0 con 0x560ede151b40 2024-09-19T06:23:56.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.879+0000 7fe83d2c8740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560ede0b22b0 con 0x560ede15b370 2024-09-19T06:23:56.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.879+0000 7fe833fff640 1 --2- 172.21.15.2:0/2824132460 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe8240a33b0 0x7fe8240a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:56.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.879+0000 7fe831ffb640 1 -- 172.21.15.2:0/2824132460 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7fe82c0d0040 con 0x7fe834102ef0 2024-09-19T06:23:56.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.880+0000 7fe838c8b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede151b40 0x560ede150090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:56.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.880+0000 7fe838c8b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede151b40 0x560ede150090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:55168/0 (socket says 172.21.15.2:55168) 2024-09-19T06:23:56.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.880+0000 7fe838c8b640 1 -- 172.21.15.2:0/2045418380 learned_addr learned my addr 172.21.15.2:0/2045418380 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:56.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.880+0000 7fe833fff640 1 --2- 172.21.15.2:0/2045418380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede1505d0 0x560ede150a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:56.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.880+0000 7fe83948c640 1 --2- 172.21.15.2:0/2045418380 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560ede15b370 0x560ede15d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:56.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.880+0000 7fe838c8b640 1 -- 172.21.15.2:0/2045418380 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560ede15b370 msgr2=0x560ede15d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:56.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.880+0000 7fe838c8b640 1 --2- 172.21.15.2:0/2045418380 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560ede15b370 0x560ede15d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:56.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.880+0000 7fe838c8b640 1 -- 172.21.15.2:0/2045418380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede1505d0 msgr2=0x560ede150a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:56.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.880+0000 7fe838c8b640 1 --2- 172.21.15.2:0/2045418380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede1505d0 0x560ede150a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:56.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.880+0000 7fe838c8b640 1 -- 172.21.15.2:0/2045418380 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ede0423a0 con 0x560ede151b40 2024-09-19T06:23:56.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.880+0000 7fe838c8b640 1 --2- 172.21.15.2:0/2045418380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede151b40 0x560ede150090 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe82800b760 tx=0x7fe82800bc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=924894bd6d1a58df server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:56.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.880+0000 7fe833fff640 1 --2- 172.21.15.2:0/2824132460 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe8240a33b0 0x7fe8240a5870 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe820009230 tx=0x7fe820031bb0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:56.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.880+0000 7fe81effd640 1 -- 172.21.15.2:0/2045418380 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe828003dd0 con 0x560ede151b40 2024-09-19T06:23:56.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.881+0000 7fe81effd640 1 -- 172.21.15.2:0/2045418380 <== mon.2 v2:172.21.15.89:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe828015070 con 0x560ede151b40 2024-09-19T06:23:56.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.881+0000 7fe81effd640 1 -- 172.21.15.2:0/2045418380 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe828004d40 con 0x560ede151b40 2024-09-19T06:23:56.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.881+0000 7fe83d2c8740 1 -- 172.21.15.2:0/2045418380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede151b40 msgr2=0x560ede150090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:56.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.881+0000 7fe83d2c8740 1 --2- 172.21.15.2:0/2045418380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede151b40 0x560ede150090 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe82800b760 tx=0x7fe82800bc20 comp rx=0 tx=0).stop 2024-09-19T06:23:56.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.881+0000 7fe83d2c8740 1 -- 172.21.15.2:0/2045418380 shutdown_connections 2024-09-19T06:23:56.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.881+0000 7fe83d2c8740 1 --2- 172.21.15.2:0/2045418380 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560ede15b370 0x560ede15d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:56.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.881+0000 7fe83d2c8740 1 --2- 172.21.15.2:0/2045418380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede1505d0 0x560ede150a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:56.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.881+0000 7fe83d2c8740 1 --2- 172.21.15.2:0/2045418380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede151b40 0x560ede150090 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:56.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.881+0000 7fe83d2c8740 1 -- 172.21.15.2:0/2045418380 >> 172.21.15.2:0/2045418380 conn(0x560ede119310 msgr2=0x560ede14cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:56.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.881+0000 7fe83d2c8740 1 -- 172.21.15.2:0/2045418380 shutdown_connections 2024-09-19T06:23:56.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.881+0000 7fe83d2c8740 1 -- 172.21.15.2:0/2045418380 wait complete. 2024-09-19T06:23:56.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.882+0000 7fe83d2c8740 1 -- start start 2024-09-19T06:23:56.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.882+0000 7fe83d2c8740 1 Processor -- start 2024-09-19T06:23:56.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.882+0000 7fe83d2c8740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede1505d0 0x560ede15ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:56.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.882+0000 7fe83d2c8740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560ede151b40 0x560ede158000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:56.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.882+0000 7fe83d2c8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede15b370 0x560ede1585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:56.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.882+0000 7fe83d2c8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560ede15e070 con 0x560ede15b370 2024-09-19T06:23:56.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.882+0000 7fe83d2c8740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x560ede071060 con 0x560ede1505d0 2024-09-19T06:23:56.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.882+0000 7fe83d2c8740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560ede15e1f0 con 0x560ede151b40 2024-09-19T06:23:56.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.882+0000 7fe83d2c8740 10 client.0 _ll_register_callbacks cb 0x560edddc48c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:56.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.882+0000 7fe83948c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede15b370 0x560ede1585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:56.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.882+0000 7fe838c8b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede1505d0 0x560ede15ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:56.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.882+0000 7fe83948c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede15b370 0x560ede1585f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36762/0 (socket says 172.21.15.2:36762) 2024-09-19T06:23:56.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.882+0000 7fe83948c640 1 -- 172.21.15.2:0/1619859056 learned_addr learned my addr 172.21.15.2:0/1619859056 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:56.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.882+0000 7fe833fff640 1 --2- 172.21.15.2:0/1619859056 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560ede151b40 0x560ede158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:56.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.883+0000 7fe83948c640 1 -- 172.21.15.2:0/1619859056 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560ede151b40 msgr2=0x560ede158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:56.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.883+0000 7fe83948c640 1 --2- 172.21.15.2:0/1619859056 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560ede151b40 0x560ede158000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:56.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.883+0000 7fe83948c640 1 -- 172.21.15.2:0/1619859056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede1505d0 msgr2=0x560ede15ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:56.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.883+0000 7fe83948c640 1 --2- 172.21.15.2:0/1619859056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede1505d0 0x560ede15ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:56.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.883+0000 7fe83948c640 1 -- 172.21.15.2:0/1619859056 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560edde273c0 con 0x560ede15b370 2024-09-19T06:23:56.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.883+0000 7fe838c8b640 1 --2- 172.21.15.2:0/1619859056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede1505d0 0x560ede15ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:23:56.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.883+0000 7fe83948c640 1 --2- 172.21.15.2:0/1619859056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede15b370 0x560ede1585f0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fe82c0cdd90 tx=0x7fe82c09bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51da8e9a00276113 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:56.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.883+0000 7fe813fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:56.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.883+0000 7fe813fff640 1 -- 172.21.15.2:0/1619859056 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe82c0b4070 con 0x560ede15b370 2024-09-19T06:23:56.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.883+0000 7fe813fff640 1 -- 172.21.15.2:0/1619859056 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7fe82c0a4b00 con 0x560ede15b370 2024-09-19T06:23:56.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.883+0000 7fe83d2c8740 1 -- 172.21.15.2:0/1619859056 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe828015070 con 0x560ede15b370 2024-09-19T06:23:56.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.883+0000 7fe813fff640 1 -- 172.21.15.2:0/1619859056 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe82c09c320 con 0x560ede15b370 2024-09-19T06:23:56.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.883+0000 7fe83d2c8740 10 client.18579 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:56.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.883+0000 7fe83d2c8740 1 -- 172.21.15.2:0/1619859056 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560ede169b40 con 0x560ede15b370 2024-09-19T06:23:56.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.883+0000 7fe813fff640 1 -- 172.21.15.2:0/1619859056 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe828015070 con 0x560ede15b370 2024-09-19T06:23:56.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.884+0000 7fe813fff640 1 -- 172.21.15.2:0/1619859056 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fe82c0a0170 con 0x560ede15b370 2024-09-19T06:23:56.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.884+0000 7fe83d2c8740 10 client.18579 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:56.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.884+0000 7fe83d2c8740 10 client.18579 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:23:56.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.884+0000 7fe83d2c8740 20 client.18579 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:56.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.884+0000 7fe83d2c8740 1 --2- 172.21.15.2:0/1619859056 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x560ede16b000 0x560ede16d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:56.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.884+0000 7fe83d2c8740 4 client.18579 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:23:56.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.884+0000 7fe83d2c8740 1 -- 172.21.15.2:0/1619859056 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560ede0c3860 con 0x560ede16b000 2024-09-19T06:23:56.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.884+0000 7fe838c8b640 1 --2- 172.21.15.2:0/1619859056 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x560ede16b000 0x560ede16d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:56.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.884+0000 7fe838c8b640 1 --2- 172.21.15.2:0/1619859056 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x560ede16b000 0x560ede16d480 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bb31e5b024f883ba server_cookie=cd59c0f849b59cc in_seq=0 out_seq=0 2024-09-19T06:23:56.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.884+0000 7fe813fff640 10 client.18579 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:23:56.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.885+0000 7fe813fff640 1 -- 172.21.15.2:0/1619859056 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560ede0c3860 con 0x560ede16b000 2024-09-19T06:23:56.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.885+0000 7fe813fff640 10 client.18579 handle_command_reply: tid=0 2024-09-19T06:23:56.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.885+0000 7fe83d2c8740 1 client.18579 shutdown 2024-09-19T06:23:56.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.885+0000 7fe83d2c8740 1 -- 172.21.15.2:0/1619859056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede15b370 msgr2=0x560ede1585f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:56.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.885+0000 7fe83d2c8740 1 --2- 172.21.15.2:0/1619859056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede15b370 0x560ede1585f0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fe82c0cdd90 tx=0x7fe82c09bf90 comp rx=0 tx=0).stop 2024-09-19T06:23:56.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.885+0000 7fe83d2c8740 1 -- 172.21.15.2:0/1619859056 shutdown_connections 2024-09-19T06:23:56.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.885+0000 7fe83d2c8740 1 --2- 172.21.15.2:0/1619859056 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x560ede16b000 0x560ede16d480 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:56.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.885+0000 7fe83d2c8740 1 --2- 172.21.15.2:0/1619859056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede15b370 0x560ede1585f0 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:56.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.885+0000 7fe813fff640 0 client.18579 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:23:56.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.885+0000 7fe83d2c8740 1 --2- 172.21.15.2:0/1619859056 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560ede151b40 0x560ede158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:56.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.885+0000 7fe83d2c8740 1 --2- 172.21.15.2:0/1619859056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede1505d0 0x560ede15ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:56.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.885+0000 7fe83d2c8740 1 -- 172.21.15.2:0/1619859056 >> 172.21.15.2:0/1619859056 conn(0x560ede119310 msgr2=0x560ede152960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:56.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.885+0000 7fe83d2c8740 1 -- 172.21.15.2:0/1619859056 shutdown_connections 2024-09-19T06:23:56.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.885+0000 7fe83d2c8740 1 -- 172.21.15.2:0/1619859056 wait complete. 2024-09-19T06:23:56.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.886+0000 7fe83d2c8740 20 client.18579 trim_cache size 0 max 16384 2024-09-19T06:23:56.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.898+0000 7fe83d2c8740 1 Processor -- start 2024-09-19T06:23:56.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.898+0000 7fe83d2c8740 1 -- start start 2024-09-19T06:23:56.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.899+0000 7fe83d2c8740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560ede1505d0 0x560ede167310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:56.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.899+0000 7fe83d2c8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede151b40 0x560ede153120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:56.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.899+0000 7fe83d2c8740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede15b370 0x560ede153660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:56.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.899+0000 7fe83d2c8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe8341aff00 con 0x560ede151b40 2024-09-19T06:23:56.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.899+0000 7fe83d2c8740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe8341ad7d0 con 0x560ede15b370 2024-09-19T06:23:56.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.899+0000 7fe83d2c8740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe8341ab640 con 0x560ede1505d0 2024-09-19T06:23:56.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.899+0000 7fe833fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede151b40 0x560ede153120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:56.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.899+0000 7fe833fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede151b40 0x560ede153120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36772/0 (socket says 172.21.15.2:36772) 2024-09-19T06:23:56.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.899+0000 7fe833fff640 1 -- 172.21.15.2:0/3548945244 learned_addr learned my addr 172.21.15.2:0/3548945244 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:56.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.899+0000 7fe838c8b640 1 --2- 172.21.15.2:0/3548945244 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560ede1505d0 0x560ede167310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:56.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.899+0000 7fe83948c640 1 --2- 172.21.15.2:0/3548945244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede15b370 0x560ede153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:56.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.899+0000 7fe833fff640 1 -- 172.21.15.2:0/3548945244 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560ede1505d0 msgr2=0x560ede167310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:56.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.899+0000 7fe833fff640 1 --2- 172.21.15.2:0/3548945244 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560ede1505d0 0x560ede167310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:56.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.899+0000 7fe833fff640 1 -- 172.21.15.2:0/3548945244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede15b370 msgr2=0x560ede153660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:56.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.899+0000 7fe833fff640 1 --2- 172.21.15.2:0/3548945244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede15b370 0x560ede153660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:56.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.899+0000 7fe833fff640 1 -- 172.21.15.2:0/3548945244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ede16db00 con 0x560ede151b40 2024-09-19T06:23:56.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.899+0000 7fe838c8b640 1 --2- 172.21.15.2:0/3548945244 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560ede1505d0 0x560ede167310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:56.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.899+0000 7fe833fff640 1 --2- 172.21.15.2:0/3548945244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede151b40 0x560ede153120 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fe820009900 tx=0x7fe820049000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfdb31bcdfd38dbe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:56.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.899+0000 7fe81e7fc640 1 -- 172.21.15.2:0/3548945244 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe820035040 con 0x560ede151b40 2024-09-19T06:23:56.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.900+0000 7fe81e7fc640 1 -- 172.21.15.2:0/3548945244 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe820050070 con 0x560ede151b40 2024-09-19T06:23:56.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.900+0000 7fe81e7fc640 1 -- 172.21.15.2:0/3548945244 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe820055bd0 con 0x560ede151b40 2024-09-19T06:23:56.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.900+0000 7fe83d2c8740 1 -- 172.21.15.2:0/3548945244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede151b40 msgr2=0x560ede153120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:56.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.900+0000 7fe83d2c8740 1 --2- 172.21.15.2:0/3548945244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede151b40 0x560ede153120 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fe820009900 tx=0x7fe820049000 comp rx=0 tx=0).stop 2024-09-19T06:23:56.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.900+0000 7fe83d2c8740 1 -- 172.21.15.2:0/3548945244 shutdown_connections 2024-09-19T06:23:56.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.900+0000 7fe83d2c8740 1 --2- 172.21.15.2:0/3548945244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede15b370 0x560ede153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:56.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.900+0000 7fe83d2c8740 1 --2- 172.21.15.2:0/3548945244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede151b40 0x560ede153120 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:56.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.900+0000 7fe83d2c8740 1 --2- 172.21.15.2:0/3548945244 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560ede1505d0 0x560ede167310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:56.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.900+0000 7fe83d2c8740 1 -- 172.21.15.2:0/3548945244 >> 172.21.15.2:0/3548945244 conn(0x560ede119310 msgr2=0x560ede157fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:56.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.900+0000 7fe83d2c8740 1 -- 172.21.15.2:0/3548945244 shutdown_connections 2024-09-19T06:23:56.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.900+0000 7fe83d2c8740 1 -- 172.21.15.2:0/3548945244 wait complete. 2024-09-19T06:23:56.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.901+0000 7fe83d2c8740 1 -- start start 2024-09-19T06:23:56.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.901+0000 7fe83d2c8740 1 Processor -- start 2024-09-19T06:23:56.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.901+0000 7fe83d2c8740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560ede1505d0 0x560ede163d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:56.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.901+0000 7fe83d2c8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede151b40 0x560ede15f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:56.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.901+0000 7fe83d2c8740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede15b370 0x560ede15f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:56.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.901+0000 7fe83d2c8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe8341abc90 con 0x560ede151b40 2024-09-19T06:23:56.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.901+0000 7fe83d2c8740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe8341ad100 con 0x560ede15b370 2024-09-19T06:23:56.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.901+0000 7fe83d2c8740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe8341ac360 con 0x560ede1505d0 2024-09-19T06:23:56.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.901+0000 7fe83d2c8740 10 client.0 _ll_register_callbacks cb 0x7fe82c0985c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:56.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.901+0000 7fe833fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede151b40 0x560ede15f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:56.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.901+0000 7fe833fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede151b40 0x560ede15f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36778/0 (socket says 172.21.15.2:36778) 2024-09-19T06:23:56.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.901+0000 7fe833fff640 1 -- 172.21.15.2:0/2600755134 learned_addr learned my addr 172.21.15.2:0/2600755134 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:56.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.901+0000 7fe83948c640 1 --2- 172.21.15.2:0/2600755134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede15b370 0x560ede15f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:56.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.901+0000 7fe838c8b640 1 --2- 172.21.15.2:0/2600755134 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560ede1505d0 0x560ede163d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:56.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.901+0000 7fe833fff640 1 -- 172.21.15.2:0/2600755134 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560ede1505d0 msgr2=0x560ede163d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:56.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.901+0000 7fe833fff640 1 --2- 172.21.15.2:0/2600755134 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560ede1505d0 0x560ede163d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:56.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.901+0000 7fe833fff640 1 -- 172.21.15.2:0/2600755134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede15b370 msgr2=0x560ede15f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:56.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.902+0000 7fe833fff640 1 --2- 172.21.15.2:0/2600755134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede15b370 0x560ede15f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:56.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.902+0000 7fe833fff640 1 -- 172.21.15.2:0/2600755134 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ede1d4d70 con 0x560ede151b40 2024-09-19T06:23:56.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.902+0000 7fe83948c640 1 --2- 172.21.15.2:0/2600755134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede15b370 0x560ede15f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:23:56.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.902+0000 7fe838c8b640 1 --2- 172.21.15.2:0/2600755134 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560ede1505d0 0x560ede163d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:23:56.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.902+0000 7fe833fff640 1 --2- 172.21.15.2:0/2600755134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede151b40 0x560ede15f080 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fe820004770 tx=0x7fe820055720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16bd058b4c7a55cd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:56.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.902+0000 7fe813fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:56.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.902+0000 7fe813fff640 1 -- 172.21.15.2:0/2600755134 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe820055d20 con 0x560ede151b40 2024-09-19T06:23:56.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.902+0000 7fe83d2c8740 1 -- 172.21.15.2:0/2600755134 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe820050070 con 0x560ede151b40 2024-09-19T06:23:56.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.902+0000 7fe813fff640 1 -- 172.21.15.2:0/2600755134 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7fe820003770 con 0x560ede151b40 2024-09-19T06:23:56.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.902+0000 7fe813fff640 1 -- 172.21.15.2:0/2600755134 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe820003970 con 0x560ede151b40 2024-09-19T06:23:56.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.902+0000 7fe83d2c8740 10 client.18585 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:56.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.902+0000 7fe83d2c8740 1 -- 172.21.15.2:0/2600755134 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560ede1d5f00 con 0x560ede151b40 2024-09-19T06:23:56.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.902+0000 7fe813fff640 1 -- 172.21.15.2:0/2600755134 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe820050070 con 0x560ede151b40 2024-09-19T06:23:56.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.903+0000 7fe813fff640 1 -- 172.21.15.2:0/2600755134 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fe820061a50 con 0x560ede151b40 2024-09-19T06:23:56.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.903+0000 7fe83d2c8740 10 client.18585 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:56.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.903+0000 7fe83d2c8740 10 client.18585 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:23:56.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.903+0000 7fe83d2c8740 20 client.18585 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:56.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.903+0000 7fe83d2c8740 1 --2- 172.21.15.2:0/2600755134 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x560ede1d65d0 0x560ede1d89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:56.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.903+0000 7fe83d2c8740 4 client.18585 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:23:56.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.903+0000 7fe83d2c8740 1 -- 172.21.15.2:0/2600755134 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560ede0bdd70 con 0x560ede1d65d0 2024-09-19T06:23:56.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.903+0000 7fe838c8b640 1 --2- 172.21.15.2:0/2600755134 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x560ede1d65d0 0x560ede1d89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:56.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.903+0000 7fe838c8b640 1 --2- 172.21.15.2:0/2600755134 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x560ede1d65d0 0x560ede1d89f0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e51a8660cc71f688 server_cookie=ff0ea94e3ae3f3f4 in_seq=0 out_seq=0 2024-09-19T06:23:56.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.903+0000 7fe813fff640 10 client.18585 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:23:56.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.904+0000 7fe813fff640 1 -- 172.21.15.2:0/2600755134 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560ede0bdd70 con 0x560ede1d65d0 2024-09-19T06:23:56.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.904+0000 7fe813fff640 10 client.18585 handle_command_reply: tid=0 2024-09-19T06:23:56.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.904+0000 7fe83d2c8740 1 client.18585 shutdown 2024-09-19T06:23:56.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.904+0000 7fe83d2c8740 1 -- 172.21.15.2:0/2600755134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede151b40 msgr2=0x560ede15f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:56.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.904+0000 7fe83d2c8740 1 --2- 172.21.15.2:0/2600755134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede151b40 0x560ede15f080 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fe820004770 tx=0x7fe820055720 comp rx=0 tx=0).stop 2024-09-19T06:23:56.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.904+0000 7fe83d2c8740 1 -- 172.21.15.2:0/2600755134 shutdown_connections 2024-09-19T06:23:56.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.904+0000 7fe83d2c8740 1 --2- 172.21.15.2:0/2600755134 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x560ede1d65d0 0x560ede1d89f0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:56.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.904+0000 7fe813fff640 0 client.18585 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:23:56.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.904+0000 7fe83d2c8740 1 --2- 172.21.15.2:0/2600755134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560ede15b370 0x560ede15f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:56.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.904+0000 7fe83d2c8740 1 --2- 172.21.15.2:0/2600755134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560ede151b40 0x560ede15f080 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:56.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.904+0000 7fe83d2c8740 1 --2- 172.21.15.2:0/2600755134 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560ede1505d0 0x560ede163d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:56.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.904+0000 7fe83d2c8740 1 -- 172.21.15.2:0/2600755134 >> 172.21.15.2:0/2600755134 conn(0x560ede119310 msgr2=0x560ede159860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:56.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.904+0000 7fe83d2c8740 1 -- 172.21.15.2:0/2600755134 shutdown_connections 2024-09-19T06:23:56.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.904+0000 7fe83d2c8740 1 -- 172.21.15.2:0/2600755134 wait complete. 2024-09-19T06:23:56.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.904+0000 7fe83d2c8740 20 client.18585 trim_cache size 0 max 16384 2024-09-19T06:23:56.915 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:23:56.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.905+0000 7fe83aeef640 1 -- 172.21.15.2:0/2824132460 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe8240a33b0 msgr2=0x7fe8240a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:56.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.905+0000 7fe83aeef640 1 --2- 172.21.15.2:0/2824132460 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe8240a33b0 0x7fe8240a5870 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe820009230 tx=0x7fe820031bb0 comp rx=0 tx=0).stop 2024-09-19T06:23:56.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.905+0000 7fe83aeef640 1 -- 172.21.15.2:0/2824132460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe834102ef0 msgr2=0x7fe83419ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:56.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.905+0000 7fe83aeef640 1 --2- 172.21.15.2:0/2824132460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe834102ef0 0x7fe83419ccf0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fe82c00cce0 tx=0x7fe82c00a620 comp rx=0 tx=0).stop 2024-09-19T06:23:56.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.905+0000 7fe83aeef640 1 -- 172.21.15.2:0/2824132460 shutdown_connections 2024-09-19T06:23:56.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.905+0000 7fe83aeef640 1 --2- 172.21.15.2:0/2824132460 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe8240a33b0 0x7fe8240a5870 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:56.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.905+0000 7fe83aeef640 1 --2- 172.21.15.2:0/2824132460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe834102ef0 0x7fe83419ccf0 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:56.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.905+0000 7fe83aeef640 1 --2- 172.21.15.2:0/2824132460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe834102570 0x7fe834198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:56.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.905+0000 7fe83aeef640 1 --2- 172.21.15.2:0/2824132460 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe834100e20 0x7fe834198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:56.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.905+0000 7fe83aeef640 1 -- 172.21.15.2:0/2824132460 >> 172.21.15.2:0/2824132460 conn(0x7fe8340fc7d0 msgr2=0x7fe8340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:56.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.905+0000 7fe83aeef640 1 -- 172.21.15.2:0/2824132460 shutdown_connections 2024-09-19T06:23:56.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:56.905+0000 7fe83aeef640 1 -- 172.21.15.2:0/2824132460 wait complete. 2024-09-19T06:23:57.471 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:57 smithi002 ceph-mon[30982]: pgmap v283: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:23:57.617 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:23:57.641 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:57 smithi090 ceph-mon[34497]: pgmap v283: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:23:57.693 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:57 smithi089 ceph-mon[34160]: pgmap v283: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:23:57.873 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:23:58.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.307+0000 7fc9f1796640 1 -- 172.21.15.2:0/2457906419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9ec106f10 msgr2=0x7fc9ec10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:58.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.307+0000 7fc9f1796640 1 --2- 172.21.15.2:0/2457906419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9ec106f10 0x7fc9ec10ea90 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4009900 tx=0x7fc9e402a410 comp rx=0 tx=0).stop 2024-09-19T06:23:58.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.308+0000 7fc9f1796640 1 -- 172.21.15.2:0/2457906419 shutdown_connections 2024-09-19T06:23:58.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.308+0000 7fc9f1796640 1 --2- 172.21.15.2:0/2457906419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9ec106f10 0x7fc9ec10ea90 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:58.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.308+0000 7fc9f1796640 1 --2- 172.21.15.2:0/2457906419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9ec102790 0x7fc9ec1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:58.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.308+0000 7fc9f1796640 1 --2- 172.21.15.2:0/2457906419 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9ec101de0 0x7fc9ec1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:58.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.308+0000 7fc9f1796640 1 -- 172.21.15.2:0/2457906419 >> 172.21.15.2:0/2457906419 conn(0x7fc9ec0fd8c0 msgr2=0x7fc9ec0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:58.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.308+0000 7fc9f1796640 1 -- 172.21.15.2:0/2457906419 shutdown_connections 2024-09-19T06:23:58.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.308+0000 7fc9f1796640 1 -- 172.21.15.2:0/2457906419 wait complete. 2024-09-19T06:23:58.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.308+0000 7fc9f1796640 1 Processor -- start 2024-09-19T06:23:58.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.309+0000 7fc9f1796640 1 -- start start 2024-09-19T06:23:58.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.309+0000 7fc9f1796640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9ec101de0 0x7fc9ec1983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:58.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.309+0000 7fc9f1796640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9ec102790 0x7fc9ec1988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:58.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.309+0000 7fc9f1796640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9ec106f10 0x7fc9ec19cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:58.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.309+0000 7fc9f1796640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec111e70 con 0x7fc9ec101de0 2024-09-19T06:23:58.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.309+0000 7fc9f1796640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec111cf0 con 0x7fc9ec106f10 2024-09-19T06:23:58.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.309+0000 7fc9f1796640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec111ff0 con 0x7fc9ec102790 2024-09-19T06:23:58.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.309+0000 7fc9eaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9ec101de0 0x7fc9ec1983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:58.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.309+0000 7fc9eaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9ec101de0 0x7fc9ec1983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36794/0 (socket says 172.21.15.2:36794) 2024-09-19T06:23:58.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.309+0000 7fc9eaffd640 1 -- 172.21.15.2:0/257920106 learned_addr learned my addr 172.21.15.2:0/257920106 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:58.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.309+0000 7fc9ea7fc640 1 --2- 172.21.15.2:0/257920106 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9ec102790 0x7fc9ec1988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:58.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.309+0000 7fc9eb7fe640 1 --2- 172.21.15.2:0/257920106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9ec106f10 0x7fc9ec19cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:58.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.309+0000 7fc9eaffd640 1 -- 172.21.15.2:0/257920106 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9ec102790 msgr2=0x7fc9ec1988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:58.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.309+0000 7fc9eaffd640 1 --2- 172.21.15.2:0/257920106 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9ec102790 0x7fc9ec1988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:58.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.309+0000 7fc9eaffd640 1 -- 172.21.15.2:0/257920106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9ec106f10 msgr2=0x7fc9ec19cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:58.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.309+0000 7fc9eaffd640 1 --2- 172.21.15.2:0/257920106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9ec106f10 0x7fc9ec19cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:58.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.309+0000 7fc9eaffd640 1 -- 172.21.15.2:0/257920106 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9ec19d360 con 0x7fc9ec101de0 2024-09-19T06:23:58.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.309+0000 7fc9eaffd640 1 --2- 172.21.15.2:0/257920106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9ec101de0 0x7fc9ec1983b0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc00cce0 tx=0x7fc9dc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:58.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.310+0000 7fc9e3fff640 1 -- 172.21.15.2:0/257920106 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc004b20 con 0x7fc9ec101de0 2024-09-19T06:23:58.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.310+0000 7fc9e3fff640 1 -- 172.21.15.2:0/257920106 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc9dc004cc0 con 0x7fc9ec101de0 2024-09-19T06:23:58.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.310+0000 7fc9f1796640 1 -- 172.21.15.2:0/257920106 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9ec19d650 con 0x7fc9ec101de0 2024-09-19T06:23:58.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.310+0000 7fc9e3fff640 1 -- 172.21.15.2:0/257920106 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc00f850 con 0x7fc9ec101de0 2024-09-19T06:23:58.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.310+0000 7fc9f1796640 1 -- 172.21.15.2:0/257920106 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9ec1a4f30 con 0x7fc9ec101de0 2024-09-19T06:23:58.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.312+0000 7fc9e3fff640 1 -- 172.21.15.2:0/257920106 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fc9dc005020 con 0x7fc9ec101de0 2024-09-19T06:23:58.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.312+0000 7fc9f3b6f740 1 Processor -- start 2024-09-19T06:23:58.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.312+0000 7fc9f3b6f740 1 -- start start 2024-09-19T06:23:58.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.313+0000 7fc9f3b6f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c69e7db40 0x557c69e7c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:58.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.313+0000 7fc9f3b6f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c69e7c5d0 0x557c69e7ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:58.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.313+0000 7fc9f3b6f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c69e87370 0x557c69e89760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:58.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.313+0000 7fc9f3b6f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557c69de22f0 con 0x557c69e87370 2024-09-19T06:23:58.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.313+0000 7fc9f3b6f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x557c69d89cf0 con 0x557c69e7db40 2024-09-19T06:23:58.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.313+0000 7fc9f3b6f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x557c69dde2b0 con 0x557c69e7c5d0 2024-09-19T06:23:58.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.313+0000 7fc9ea7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c69e87370 0x557c69e89760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:58.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.313+0000 7fc9e3fff640 1 --2- 172.21.15.2:0/257920106 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc9d80a33b0 0x7fc9d80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:58.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.313+0000 7fc9ea7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c69e87370 0x557c69e89760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36798/0 (socket says 172.21.15.2:36798) 2024-09-19T06:23:58.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.313+0000 7fc9ea7fc640 1 -- 172.21.15.2:0/2759986781 learned_addr learned my addr 172.21.15.2:0/2759986781 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:58.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.313+0000 7fc9eaffd640 1 --2- 172.21.15.2:0/2759986781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c69e7c5d0 0x557c69e7ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:58.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.313+0000 7fc9eb7fe640 1 --2- 172.21.15.2:0/2759986781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c69e7db40 0x557c69e7c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:58.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.313+0000 7fc9eb7fe640 1 --2- 172.21.15.2:0/257920106 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc9d80a33b0 0x7fc9d80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:58.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.313+0000 7fc9ea7fc640 1 -- 172.21.15.2:0/2759986781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c69e7c5d0 msgr2=0x557c69e7ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:58.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.313+0000 7fc9ea7fc640 1 --2- 172.21.15.2:0/2759986781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c69e7c5d0 0x557c69e7ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:58.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.313+0000 7fc9ea7fc640 1 -- 172.21.15.2:0/2759986781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c69e7db40 msgr2=0x557c69e7c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:58.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.313+0000 7fc9ea7fc640 1 --2- 172.21.15.2:0/2759986781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c69e7db40 0x557c69e7c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:58.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.313+0000 7fc9ea7fc640 1 -- 172.21.15.2:0/2759986781 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c69d6e3a0 con 0x557c69e87370 2024-09-19T06:23:58.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.313+0000 7fc9e3fff640 1 -- 172.21.15.2:0/257920106 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7fc9dc0cfdf0 con 0x7fc9ec101de0 2024-09-19T06:23:58.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.314+0000 7fc9ea7fc640 1 --2- 172.21.15.2:0/2759986781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c69e87370 0x557c69e89760 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fc9d400bc10 tx=0x7fc9d40107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6362c294441fa8f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:58.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.314+0000 7fc9eb7fe640 1 --2- 172.21.15.2:0/257920106 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc9d80a33b0 0x7fc9d80a5870 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4031440 tx=0x7fc9e4005a20 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:58.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.314+0000 7fc9e17fa640 1 -- 172.21.15.2:0/2759986781 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d4005020 con 0x557c69e87370 2024-09-19T06:23:58.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.314+0000 7fc9e17fa640 1 -- 172.21.15.2:0/2759986781 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc9d40047a0 con 0x557c69e87370 2024-09-19T06:23:58.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.314+0000 7fc9e17fa640 1 -- 172.21.15.2:0/2759986781 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d40116a0 con 0x557c69e87370 2024-09-19T06:23:58.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.315+0000 7fc9f3b6f740 1 -- 172.21.15.2:0/2759986781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c69e87370 msgr2=0x557c69e89760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:58.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.315+0000 7fc9f3b6f740 1 --2- 172.21.15.2:0/2759986781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c69e87370 0x557c69e89760 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fc9d400bc10 tx=0x7fc9d40107a0 comp rx=0 tx=0).stop 2024-09-19T06:23:58.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.315+0000 7fc9f3b6f740 1 -- 172.21.15.2:0/2759986781 shutdown_connections 2024-09-19T06:23:58.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.315+0000 7fc9f3b6f740 1 --2- 172.21.15.2:0/2759986781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c69e87370 0x557c69e89760 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:58.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.315+0000 7fc9f3b6f740 1 --2- 172.21.15.2:0/2759986781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c69e7c5d0 0x557c69e7ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:58.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.315+0000 7fc9f3b6f740 1 --2- 172.21.15.2:0/2759986781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c69e7db40 0x557c69e7c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:58.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.315+0000 7fc9f3b6f740 1 -- 172.21.15.2:0/2759986781 >> 172.21.15.2:0/2759986781 conn(0x557c69e45310 msgr2=0x557c69e78c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:58.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.315+0000 7fc9f3b6f740 1 -- 172.21.15.2:0/2759986781 shutdown_connections 2024-09-19T06:23:58.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.315+0000 7fc9f3b6f740 1 -- 172.21.15.2:0/2759986781 wait complete. 2024-09-19T06:23:58.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.315+0000 7fc9f3b6f740 1 -- start start 2024-09-19T06:23:58.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.315+0000 7fc9f3b6f740 1 Processor -- start 2024-09-19T06:23:58.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.316+0000 7fc9f3b6f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c69e7c5d0 0x557c69e86d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:58.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.316+0000 7fc9f3b6f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c69e7db40 0x557c69e83fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:58.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.316+0000 7fc9f3b6f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c69e87370 0x557c69e845d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:58.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.316+0000 7fc9f3b6f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557c69e8a070 con 0x557c69e7db40 2024-09-19T06:23:58.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.316+0000 7fc9f3b6f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x557c69d9d060 con 0x557c69e7c5d0 2024-09-19T06:23:58.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.316+0000 7fc9f3b6f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x557c69e8a1f0 con 0x557c69e87370 2024-09-19T06:23:58.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.316+0000 7fc9ea7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c69e7db40 0x557c69e83fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:58.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.316+0000 7fc9f3b6f740 10 client.0 _ll_register_callbacks cb 0x557c69af08c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:58.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.316+0000 7fc9ea7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c69e7db40 0x557c69e83fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36810/0 (socket says 172.21.15.2:36810) 2024-09-19T06:23:58.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.316+0000 7fc9ea7fc640 1 -- 172.21.15.2:0/1885716210 learned_addr learned my addr 172.21.15.2:0/1885716210 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:58.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.316+0000 7fc9eb7fe640 1 --2- 172.21.15.2:0/1885716210 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c69e87370 0x557c69e845d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:58.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.316+0000 7fc9eaffd640 1 --2- 172.21.15.2:0/1885716210 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c69e7c5d0 0x557c69e86d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:58.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.316+0000 7fc9ea7fc640 1 -- 172.21.15.2:0/1885716210 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c69e87370 msgr2=0x557c69e845d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:58.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.316+0000 7fc9ea7fc640 1 --2- 172.21.15.2:0/1885716210 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c69e87370 0x557c69e845d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:58.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.316+0000 7fc9ea7fc640 1 -- 172.21.15.2:0/1885716210 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c69e7c5d0 msgr2=0x557c69e86d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:58.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.316+0000 7fc9ea7fc640 1 --2- 172.21.15.2:0/1885716210 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c69e7c5d0 0x557c69e86d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:58.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.316+0000 7fc9ea7fc640 1 -- 172.21.15.2:0/1885716210 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c69b533c0 con 0x557c69e7db40 2024-09-19T06:23:58.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.316+0000 7fc9eaffd640 1 --2- 172.21.15.2:0/1885716210 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c69e7c5d0 0x557c69e86d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:58.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.317+0000 7fc9ea7fc640 1 --2- 172.21.15.2:0/1885716210 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c69e7db40 0x557c69e83fe0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4011010 tx=0x7fc9d400b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea8e0c05fd3a4e77 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:58.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.317+0000 7fc9d27fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:58.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.317+0000 7fc9d27fc640 1 -- 172.21.15.2:0/1885716210 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d4004be0 con 0x557c69e7db40 2024-09-19T06:23:58.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.317+0000 7fc9d27fc640 1 -- 172.21.15.2:0/1885716210 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7fc9d4004020 con 0x557c69e7db40 2024-09-19T06:23:58.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.317+0000 7fc9f3b6f740 1 -- 172.21.15.2:0/1885716210 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9d40047a0 con 0x557c69e7db40 2024-09-19T06:23:58.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.317+0000 7fc9d27fc640 1 -- 172.21.15.2:0/1885716210 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc9d4004260 con 0x557c69e7db40 2024-09-19T06:23:58.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.317+0000 7fc9f3b6f740 10 client.18597 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:58.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.317+0000 7fc9f3b6f740 1 -- 172.21.15.2:0/1885716210 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557c69e99ee0 con 0x557c69e7db40 2024-09-19T06:23:58.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.317+0000 7fc9d27fc640 1 -- 172.21.15.2:0/1885716210 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc9d40047a0 con 0x557c69e7db40 2024-09-19T06:23:58.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.317+0000 7fc9d27fc640 1 -- 172.21.15.2:0/1885716210 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fc9d4003810 con 0x557c69e7db40 2024-09-19T06:23:58.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.317+0000 7fc9f3b6f740 10 client.18597 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:58.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.317+0000 7fc9f3b6f740 10 client.18597 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:23:58.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.317+0000 7fc9f3b6f740 20 client.18597 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:58.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.318+0000 7fc9f3b6f740 1 --2- 172.21.15.2:0/1885716210 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x557c69e9b2e0 0x557c69e9d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:58.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.318+0000 7fc9f3b6f740 4 client.18597 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:23:58.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.318+0000 7fc9f3b6f740 1 -- 172.21.15.2:0/1885716210 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c69def860 con 0x557c69e9b2e0 2024-09-19T06:23:58.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.318+0000 7fc9eaffd640 1 --2- 172.21.15.2:0/1885716210 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x557c69e9b2e0 0x557c69e9d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:58.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.318+0000 7fc9eaffd640 1 --2- 172.21.15.2:0/1885716210 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x557c69e9b2e0 0x557c69e9d6d0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=805c6f44e7aa8682 server_cookie=356b48c4d740920a in_seq=0 out_seq=0 2024-09-19T06:23:58.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.318+0000 7fc9d27fc640 10 client.18597 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:23:58.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.319+0000 7fc9d27fc640 1 -- 172.21.15.2:0/1885716210 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557c69def860 con 0x557c69e9b2e0 2024-09-19T06:23:58.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.319+0000 7fc9d27fc640 10 client.18597 handle_command_reply: tid=0 2024-09-19T06:23:58.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.319+0000 7fc9f3b6f740 1 client.18597 shutdown 2024-09-19T06:23:58.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.319+0000 7fc9f3b6f740 1 -- 172.21.15.2:0/1885716210 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c69e7db40 msgr2=0x557c69e83fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:58.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.319+0000 7fc9f3b6f740 1 --2- 172.21.15.2:0/1885716210 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c69e7db40 0x557c69e83fe0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4011010 tx=0x7fc9d400b850 comp rx=0 tx=0).stop 2024-09-19T06:23:58.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.319+0000 7fc9f3b6f740 1 -- 172.21.15.2:0/1885716210 shutdown_connections 2024-09-19T06:23:58.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.319+0000 7fc9f3b6f740 1 --2- 172.21.15.2:0/1885716210 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x557c69e9b2e0 0x557c69e9d6d0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:58.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.319+0000 7fc9f3b6f740 1 --2- 172.21.15.2:0/1885716210 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c69e87370 0x557c69e845d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:58.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.319+0000 7fc9f3b6f740 1 --2- 172.21.15.2:0/1885716210 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c69e7db40 0x557c69e83fe0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:58.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.319+0000 7fc9f3b6f740 1 --2- 172.21.15.2:0/1885716210 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c69e7c5d0 0x557c69e86d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:58.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.319+0000 7fc9f3b6f740 1 -- 172.21.15.2:0/1885716210 >> 172.21.15.2:0/1885716210 conn(0x557c69e45310 msgr2=0x557c69e7e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:58.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.319+0000 7fc9d27fc640 0 client.18597 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:23:58.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.319+0000 7fc9f3b6f740 1 -- 172.21.15.2:0/1885716210 shutdown_connections 2024-09-19T06:23:58.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.319+0000 7fc9f3b6f740 1 -- 172.21.15.2:0/1885716210 wait complete. 2024-09-19T06:23:58.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.319+0000 7fc9f3b6f740 20 client.18597 trim_cache size 0 max 16384 2024-09-19T06:23:58.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.332+0000 7fc9f3b6f740 1 Processor -- start 2024-09-19T06:23:58.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.332+0000 7fc9f3b6f740 1 -- start start 2024-09-19T06:23:58.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.333+0000 7fc9f3b6f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c69e7c5d0 0x557c69e93310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:58.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.333+0000 7fc9f3b6f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c69e7db40 0x557c69e88760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:58.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.333+0000 7fc9f3b6f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c69e87370 0x557c69e88ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:58.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.333+0000 7fc9f3b6f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec1adee0 con 0x557c69e7db40 2024-09-19T06:23:58.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.333+0000 7fc9f3b6f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec1ab7b0 con 0x557c69e87370 2024-09-19T06:23:58.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.333+0000 7fc9f3b6f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec1a9620 con 0x557c69e7c5d0 2024-09-19T06:23:58.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.333+0000 7fc9ea7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c69e7db40 0x557c69e88760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:58.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.333+0000 7fc9ea7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c69e7db40 0x557c69e88760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36826/0 (socket says 172.21.15.2:36826) 2024-09-19T06:23:58.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.333+0000 7fc9ea7fc640 1 -- 172.21.15.2:0/4062641800 learned_addr learned my addr 172.21.15.2:0/4062641800 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:58.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.333+0000 7fc9eb7fe640 1 --2- 172.21.15.2:0/4062641800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c69e87370 0x557c69e88ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:58.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.333+0000 7fc9eaffd640 1 --2- 172.21.15.2:0/4062641800 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c69e7c5d0 0x557c69e93310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:58.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.333+0000 7fc9ea7fc640 1 -- 172.21.15.2:0/4062641800 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c69e7c5d0 msgr2=0x557c69e93310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:58.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.333+0000 7fc9ea7fc640 1 --2- 172.21.15.2:0/4062641800 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c69e7c5d0 0x557c69e93310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:58.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.333+0000 7fc9ea7fc640 1 -- 172.21.15.2:0/4062641800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c69e87370 msgr2=0x557c69e88ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:58.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.333+0000 7fc9ea7fc640 1 --2- 172.21.15.2:0/4062641800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c69e87370 0x557c69e88ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:58.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.333+0000 7fc9ea7fc640 1 -- 172.21.15.2:0/4062641800 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c69e82530 con 0x557c69e7db40 2024-09-19T06:23:58.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.333+0000 7fc9eaffd640 1 --2- 172.21.15.2:0/4062641800 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c69e7c5d0 0x557c69e93310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:23:58.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.333+0000 7fc9ea7fc640 1 --2- 172.21.15.2:0/4062641800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c69e7db40 0x557c69e88760 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4000c00 tx=0x7fc9d400b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0046a85a3cbdcd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:58.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.334+0000 7fc9e0ff9640 1 -- 172.21.15.2:0/4062641800 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d4004400 con 0x557c69e7db40 2024-09-19T06:23:58.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.334+0000 7fc9e0ff9640 1 -- 172.21.15.2:0/4062641800 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc9d4004660 con 0x557c69e7db40 2024-09-19T06:23:58.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.334+0000 7fc9e0ff9640 1 -- 172.21.15.2:0/4062641800 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d402e950 con 0x557c69e7db40 2024-09-19T06:23:58.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.334+0000 7fc9f3b6f740 1 -- 172.21.15.2:0/4062641800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c69e7db40 msgr2=0x557c69e88760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:58.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.334+0000 7fc9f3b6f740 1 --2- 172.21.15.2:0/4062641800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c69e7db40 0x557c69e88760 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4000c00 tx=0x7fc9d400b940 comp rx=0 tx=0).stop 2024-09-19T06:23:58.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.334+0000 7fc9f3b6f740 1 -- 172.21.15.2:0/4062641800 shutdown_connections 2024-09-19T06:23:58.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.334+0000 7fc9f3b6f740 1 --2- 172.21.15.2:0/4062641800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c69e87370 0x557c69e88ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:58.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.334+0000 7fc9f3b6f740 1 --2- 172.21.15.2:0/4062641800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c69e7db40 0x557c69e88760 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:58.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.334+0000 7fc9f3b6f740 1 --2- 172.21.15.2:0/4062641800 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c69e7c5d0 0x557c69e93310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:58.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.334+0000 7fc9f3b6f740 1 -- 172.21.15.2:0/4062641800 >> 172.21.15.2:0/4062641800 conn(0x557c69e45310 msgr2=0x557c69e828b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:58.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.335+0000 7fc9f3b6f740 1 -- 172.21.15.2:0/4062641800 shutdown_connections 2024-09-19T06:23:58.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.335+0000 7fc9f3b6f740 1 -- 172.21.15.2:0/4062641800 wait complete. 2024-09-19T06:23:58.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.335+0000 7fc9f3b6f740 1 -- start start 2024-09-19T06:23:58.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.335+0000 7fc9f3b6f740 1 Processor -- start 2024-09-19T06:23:58.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.335+0000 7fc9f3b6f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c69e7c5d0 0x557c69ea22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:58.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.335+0000 7fc9f3b6f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c69e7db40 0x557c69ea27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:58.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.335+0000 7fc9f3b6f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c69e87370 0x557c69e8e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:58.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.335+0000 7fc9f3b6f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec1a9c70 con 0x557c69e7db40 2024-09-19T06:23:58.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.335+0000 7fc9f3b6f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec1ab0e0 con 0x557c69e7c5d0 2024-09-19T06:23:58.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.335+0000 7fc9f3b6f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec1aa340 con 0x557c69e87370 2024-09-19T06:23:58.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.335+0000 7fc9f3b6f740 10 client.0 _ll_register_callbacks cb 0x7fc9dc09bea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:58.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.335+0000 7fc9ea7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c69e7db40 0x557c69ea27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:58.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.336+0000 7fc9ea7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c69e7db40 0x557c69ea27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36836/0 (socket says 172.21.15.2:36836) 2024-09-19T06:23:58.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.336+0000 7fc9ea7fc640 1 -- 172.21.15.2:0/3593889551 learned_addr learned my addr 172.21.15.2:0/3593889551 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:58.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.336+0000 7fc9eb7fe640 1 --2- 172.21.15.2:0/3593889551 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c69e87370 0x557c69e8e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:58.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.336+0000 7fc9eaffd640 1 --2- 172.21.15.2:0/3593889551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c69e7c5d0 0x557c69ea22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:58.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.336+0000 7fc9ea7fc640 1 -- 172.21.15.2:0/3593889551 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c69e87370 msgr2=0x557c69e8e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:58.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.336+0000 7fc9ea7fc640 1 --2- 172.21.15.2:0/3593889551 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c69e87370 0x557c69e8e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:58.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.336+0000 7fc9ea7fc640 1 -- 172.21.15.2:0/3593889551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c69e7c5d0 msgr2=0x557c69ea22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:58.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.336+0000 7fc9ea7fc640 1 --2- 172.21.15.2:0/3593889551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c69e7c5d0 0x557c69ea22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:58.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.336+0000 7fc9ea7fc640 1 -- 172.21.15.2:0/3593889551 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c69e8eb20 con 0x557c69e7db40 2024-09-19T06:23:58.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.336+0000 7fc9eaffd640 1 --2- 172.21.15.2:0/3593889551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c69e7c5d0 0x557c69ea22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:58.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.336+0000 7fc9ea7fc640 1 --2- 172.21.15.2:0/3593889551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c69e7db40 0x557c69ea27e0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fc9d40107e0 tx=0x7fc9d4005f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75efb6c641d42a19 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:58.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.336+0000 7fc9d27fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:58.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.338+0000 7fc9d27fc640 1 -- 172.21.15.2:0/3593889551 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d4004810 con 0x557c69e7db40 2024-09-19T06:23:58.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.338+0000 7fc9d27fc640 1 -- 172.21.15.2:0/3593889551 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7fc9d40035f0 con 0x557c69e7db40 2024-09-19T06:23:58.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.338+0000 7fc9f3b6f740 1 -- 172.21.15.2:0/3593889551 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9d4004660 con 0x557c69e7db40 2024-09-19T06:23:58.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.338+0000 7fc9d27fc640 1 -- 172.21.15.2:0/3593889551 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc9d4047050 con 0x557c69e7db40 2024-09-19T06:23:58.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.338+0000 7fc9f3b6f740 10 client.18603 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:58.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.338+0000 7fc9f3b6f740 1 -- 172.21.15.2:0/3593889551 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557c69e8fd50 con 0x557c69e7db40 2024-09-19T06:23:58.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.339+0000 7fc9d27fc640 1 -- 172.21.15.2:0/3593889551 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc9d4004660 con 0x557c69e7db40 2024-09-19T06:23:58.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.339+0000 7fc9d27fc640 1 -- 172.21.15.2:0/3593889551 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fc9d4036020 con 0x557c69e7db40 2024-09-19T06:23:58.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.339+0000 7fc9f3b6f740 10 client.18603 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:58.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.339+0000 7fc9f3b6f740 10 client.18603 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:23:58.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.339+0000 7fc9f3b6f740 20 client.18603 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:58.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.339+0000 7fc9f3b6f740 1 --2- 172.21.15.2:0/3593889551 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x557c69f05e10 0x557c69f08200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:58.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.339+0000 7fc9f3b6f740 4 client.18603 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:23:58.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.339+0000 7fc9f3b6f740 1 -- 172.21.15.2:0/3593889551 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557c69de9d70 con 0x557c69f05e10 2024-09-19T06:23:58.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.339+0000 7fc9eaffd640 1 --2- 172.21.15.2:0/3593889551 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x557c69f05e10 0x557c69f08200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:58.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.339+0000 7fc9d27fc640 10 client.18603 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:23:58.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.339+0000 7fc9eaffd640 1 --2- 172.21.15.2:0/3593889551 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x557c69f05e10 0x557c69f08200 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=969438f6e0014266 server_cookie=4abcd5ed3c0f70c4 in_seq=0 out_seq=0 2024-09-19T06:23:58.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.340+0000 7fc9d27fc640 1 -- 172.21.15.2:0/3593889551 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557c69de9d70 con 0x557c69f05e10 2024-09-19T06:23:58.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.340+0000 7fc9d27fc640 10 client.18603 handle_command_reply: tid=0 2024-09-19T06:23:58.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.340+0000 7fc9f3b6f740 1 client.18603 shutdown 2024-09-19T06:23:58.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.340+0000 7fc9f3b6f740 1 -- 172.21.15.2:0/3593889551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c69e7db40 msgr2=0x557c69ea27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:58.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.340+0000 7fc9f3b6f740 1 --2- 172.21.15.2:0/3593889551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c69e7db40 0x557c69ea27e0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fc9d40107e0 tx=0x7fc9d4005f60 comp rx=0 tx=0).stop 2024-09-19T06:23:58.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.340+0000 7fc9f3b6f740 1 -- 172.21.15.2:0/3593889551 shutdown_connections 2024-09-19T06:23:58.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.340+0000 7fc9f3b6f740 1 --2- 172.21.15.2:0/3593889551 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x557c69f05e10 0x557c69f08200 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:58.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.340+0000 7fc9f3b6f740 1 --2- 172.21.15.2:0/3593889551 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557c69e87370 0x557c69e8e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:58.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.340+0000 7fc9f3b6f740 1 --2- 172.21.15.2:0/3593889551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557c69e7db40 0x557c69ea27e0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:58.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.340+0000 7fc9f3b6f740 1 --2- 172.21.15.2:0/3593889551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557c69e7c5d0 0x557c69ea22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:58.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.340+0000 7fc9d27fc640 0 client.18603 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:23:58.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.340+0000 7fc9f3b6f740 1 -- 172.21.15.2:0/3593889551 >> 172.21.15.2:0/3593889551 conn(0x557c69e45310 msgr2=0x557c69e85840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:58.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.340+0000 7fc9f3b6f740 1 -- 172.21.15.2:0/3593889551 shutdown_connections 2024-09-19T06:23:58.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.340+0000 7fc9f3b6f740 1 -- 172.21.15.2:0/3593889551 wait complete. 2024-09-19T06:23:58.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.340+0000 7fc9f3b6f740 20 client.18603 trim_cache size 0 max 16384 2024-09-19T06:23:58.349 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:23:58.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.341+0000 7fc9f1796640 1 -- 172.21.15.2:0/257920106 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc9d80a33b0 msgr2=0x7fc9d80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:58.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.341+0000 7fc9f1796640 1 --2- 172.21.15.2:0/257920106 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc9d80a33b0 0x7fc9d80a5870 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4031440 tx=0x7fc9e4005a20 comp rx=0 tx=0).stop 2024-09-19T06:23:58.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.341+0000 7fc9f1796640 1 -- 172.21.15.2:0/257920106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9ec101de0 msgr2=0x7fc9ec1983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:58.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.341+0000 7fc9f1796640 1 --2- 172.21.15.2:0/257920106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9ec101de0 0x7fc9ec1983b0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc00cce0 tx=0x7fc9dc00a620 comp rx=0 tx=0).stop 2024-09-19T06:23:58.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.341+0000 7fc9f1796640 1 -- 172.21.15.2:0/257920106 shutdown_connections 2024-09-19T06:23:58.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.341+0000 7fc9f1796640 1 --2- 172.21.15.2:0/257920106 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc9d80a33b0 0x7fc9d80a5870 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:58.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.341+0000 7fc9f1796640 1 --2- 172.21.15.2:0/257920106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9ec106f10 0x7fc9ec19cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:58.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.341+0000 7fc9f1796640 1 --2- 172.21.15.2:0/257920106 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9ec102790 0x7fc9ec1988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:58.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.341+0000 7fc9f1796640 1 --2- 172.21.15.2:0/257920106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9ec101de0 0x7fc9ec1983b0 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:58.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.341+0000 7fc9f1796640 1 -- 172.21.15.2:0/257920106 >> 172.21.15.2:0/257920106 conn(0x7fc9ec0fd8c0 msgr2=0x7fc9ec0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:58.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.341+0000 7fc9f1796640 1 -- 172.21.15.2:0/257920106 shutdown_connections 2024-09-19T06:23:58.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:58.341+0000 7fc9f1796640 1 -- 172.21.15.2:0/257920106 wait complete. 2024-09-19T06:23:58.902 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:23:59.165 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:23:59.556 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:23:59 smithi002 ceph-mon[30982]: pgmap v284: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:23:59.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.639+0000 7f07208a9640 1 -- 172.21.15.2:0/1109319724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f071c100a80 msgr2=0x7f071c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:59.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.639+0000 7f07208a9640 1 --2- 172.21.15.2:0/1109319724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f071c100a80 0x7f071c100ee0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f0704009930 tx=0x7f070402a420 comp rx=0 tx=0).stop 2024-09-19T06:23:59.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.639+0000 7f07208a9640 1 -- 172.21.15.2:0/1109319724 shutdown_connections 2024-09-19T06:23:59.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.639+0000 7f07208a9640 1 --2- 172.21.15.2:0/1109319724 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f071c101420 0x7f071c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:59.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.639+0000 7f07208a9640 1 --2- 172.21.15.2:0/1109319724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f071c100a80 0x7f071c100ee0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:59.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.639+0000 7f07208a9640 1 --2- 172.21.15.2:0/1109319724 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f071c106a80 0x7f071c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:59.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.639+0000 7f07208a9640 1 -- 172.21.15.2:0/1109319724 >> 172.21.15.2:0/1109319724 conn(0x7f071c0fc7a0 msgr2=0x7f071c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:59.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.639+0000 7f07208a9640 1 -- 172.21.15.2:0/1109319724 shutdown_connections 2024-09-19T06:23:59.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.639+0000 7f07208a9640 1 -- 172.21.15.2:0/1109319724 wait complete. 2024-09-19T06:23:59.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.639+0000 7f07208a9640 1 Processor -- start 2024-09-19T06:23:59.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.640+0000 7f07208a9640 1 -- start start 2024-09-19T06:23:59.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.640+0000 7f07208a9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f071c100a80 0x7f071c199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:59.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.640+0000 7f07208a9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f071c101420 0x7f071c1997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:59.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.640+0000 7f07208a9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f071c106a80 0x7f071c1a42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:59.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.640+0000 7f07208a9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f071c110d30 con 0x7f071c100a80 2024-09-19T06:23:59.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.640+0000 7f07208a9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f071c110bb0 con 0x7f071c106a80 2024-09-19T06:23:59.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.640+0000 7f07208a9640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f071c110eb0 con 0x7f071c101420 2024-09-19T06:23:59.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.640+0000 7f071a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f071c100a80 0x7f071c199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:59.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.640+0000 7f071a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f071c100a80 0x7f071c199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36856/0 (socket says 172.21.15.2:36856) 2024-09-19T06:23:59.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.640+0000 7f071a59c640 1 -- 172.21.15.2:0/2799392498 learned_addr learned my addr 172.21.15.2:0/2799392498 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:59.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.640+0000 7f0713fff640 1 --2- 172.21.15.2:0/2799392498 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f071c101420 0x7f071c1997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:59.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.640+0000 7f071ad9d640 1 --2- 172.21.15.2:0/2799392498 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f071c106a80 0x7f071c1a42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:59.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.640+0000 7f071a59c640 1 -- 172.21.15.2:0/2799392498 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f071c101420 msgr2=0x7f071c1997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:59.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.640+0000 7f071a59c640 1 --2- 172.21.15.2:0/2799392498 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f071c101420 0x7f071c1997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:59.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.640+0000 7f071a59c640 1 -- 172.21.15.2:0/2799392498 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f071c106a80 msgr2=0x7f071c1a42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:59.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.640+0000 7f071a59c640 1 --2- 172.21.15.2:0/2799392498 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f071c106a80 0x7f071c1a42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:59.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.640+0000 7f071a59c640 1 -- 172.21.15.2:0/2799392498 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f071c1a4820 con 0x7f071c100a80 2024-09-19T06:23:59.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.640+0000 7f071ad9d640 1 --2- 172.21.15.2:0/2799392498 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f071c106a80 0x7f071c1a42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:23:59.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.640+0000 7f071a59c640 1 --2- 172.21.15.2:0/2799392498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f071c100a80 0x7f071c199260 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f070c00d950 tx=0x7f070c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:59.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.641+0000 7f07137fe640 1 -- 172.21.15.2:0/2799392498 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f070c017070 con 0x7f071c100a80 2024-09-19T06:23:59.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.641+0000 7f07208a9640 1 -- 172.21.15.2:0/2799392498 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f071c1a49f0 con 0x7f071c100a80 2024-09-19T06:23:59.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.641+0000 7f07137fe640 1 -- 172.21.15.2:0/2799392498 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f070c009c30 con 0x7f071c100a80 2024-09-19T06:23:59.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.641+0000 7f07137fe640 1 -- 172.21.15.2:0/2799392498 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f070c00f620 con 0x7f071c100a80 2024-09-19T06:23:59.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.641+0000 7f07208a9640 1 -- 172.21.15.2:0/2799392498 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f071c1a4f00 con 0x7f071c100a80 2024-09-19T06:23:59.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.643+0000 7f07137fe640 1 -- 172.21.15.2:0/2799392498 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f070c0109a0 con 0x7f071c100a80 2024-09-19T06:23:59.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.643+0000 7f0722c82740 1 Processor -- start 2024-09-19T06:23:59.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.644+0000 7f0722c82740 1 -- start start 2024-09-19T06:23:59.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.644+0000 7f0722c82740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca4fab4b40 0x55ca4fab3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:59.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.644+0000 7f0722c82740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca4fab35d0 0x55ca4fab3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:59.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.644+0000 7f0722c82740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca4fabe370 0x55ca4fac0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:59.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.644+0000 7f0722c82740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ca4fa192f0 con 0x55ca4fab4b40 2024-09-19T06:23:59.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.644+0000 7f0722c82740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55ca4f9c0cf0 con 0x55ca4fabe370 2024-09-19T06:23:59.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.644+0000 7f0722c82740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55ca4fa152b0 con 0x55ca4fab35d0 2024-09-19T06:23:59.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.644+0000 7f07137fe640 1 --2- 172.21.15.2:0/2799392498 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f07080a33b0 0x7f07080a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:59.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.644+0000 7f071ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca4fab4b40 0x55ca4fab3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:59.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.644+0000 7f071ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca4fab4b40 0x55ca4fab3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36860/0 (socket says 172.21.15.2:36860) 2024-09-19T06:23:59.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.644+0000 7f071ad9d640 1 -- 172.21.15.2:0/2740070153 learned_addr learned my addr 172.21.15.2:0/2740070153 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:59.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.644+0000 7f07137fe640 1 -- 172.21.15.2:0/2799392498 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f070c0cf8b0 con 0x7f071c100a80 2024-09-19T06:23:59.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.644+0000 7f071a59c640 1 --2- 172.21.15.2:0/2740070153 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca4fab35d0 0x55ca4fab3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:59.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.644+0000 7f0713fff640 1 --2- 172.21.15.2:0/2740070153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca4fabe370 0x55ca4fac0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:59.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.645+0000 7f071ad9d640 1 --2- 172.21.15.2:0/2799392498 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f07080a33b0 0x7f07080a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:59.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.645+0000 7f071ad9d640 1 -- 172.21.15.2:0/2740070153 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca4fab35d0 msgr2=0x55ca4fab3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:59.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.645+0000 7f071ad9d640 1 --2- 172.21.15.2:0/2740070153 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca4fab35d0 0x55ca4fab3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:59.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.645+0000 7f071ad9d640 1 -- 172.21.15.2:0/2740070153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca4fabe370 msgr2=0x55ca4fac0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:59.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.645+0000 7f071ad9d640 1 --2- 172.21.15.2:0/2740070153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca4fabe370 0x55ca4fac0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:59.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.645+0000 7f071ad9d640 1 -- 172.21.15.2:0/2740070153 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca4f9a53a0 con 0x55ca4fab4b40 2024-09-19T06:23:59.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.645+0000 7f071ad9d640 1 --2- 172.21.15.2:0/2740070153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca4fab4b40 0x55ca4fab3090 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f07140149b0 tx=0x7f0714014db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=517b8d7c471ef5ab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:59.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.645+0000 7f0710ff9640 1 -- 172.21.15.2:0/2740070153 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0714021070 con 0x55ca4fab4b40 2024-09-19T06:23:59.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.645+0000 7f0710ff9640 1 -- 172.21.15.2:0/2740070153 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f07140258d0 con 0x55ca4fab4b40 2024-09-19T06:23:59.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.645+0000 7f071ad9d640 1 --2- 172.21.15.2:0/2799392498 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f07080a33b0 0x7f07080a5870 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f071401e000 tx=0x7f071401a000 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:59.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.645+0000 7f0710ff9640 1 -- 172.21.15.2:0/2740070153 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071400f630 con 0x55ca4fab4b40 2024-09-19T06:23:59.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.646+0000 7f0722c82740 1 -- 172.21.15.2:0/2740070153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca4fab4b40 msgr2=0x55ca4fab3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:59.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.646+0000 7f0722c82740 1 --2- 172.21.15.2:0/2740070153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca4fab4b40 0x55ca4fab3090 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f07140149b0 tx=0x7f0714014db0 comp rx=0 tx=0).stop 2024-09-19T06:23:59.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.646+0000 7f0722c82740 1 -- 172.21.15.2:0/2740070153 shutdown_connections 2024-09-19T06:23:59.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.646+0000 7f0722c82740 1 --2- 172.21.15.2:0/2740070153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca4fabe370 0x55ca4fac0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:59.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.646+0000 7f0722c82740 1 --2- 172.21.15.2:0/2740070153 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca4fab35d0 0x55ca4fab3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:59.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.646+0000 7f0722c82740 1 --2- 172.21.15.2:0/2740070153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca4fab4b40 0x55ca4fab3090 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:59.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.646+0000 7f0722c82740 1 -- 172.21.15.2:0/2740070153 >> 172.21.15.2:0/2740070153 conn(0x55ca4fa7c310 msgr2=0x55ca4faafc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:59.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.646+0000 7f0722c82740 1 -- 172.21.15.2:0/2740070153 shutdown_connections 2024-09-19T06:23:59.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.646+0000 7f0722c82740 1 -- 172.21.15.2:0/2740070153 wait complete. 2024-09-19T06:23:59.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.646+0000 7f0722c82740 1 -- start start 2024-09-19T06:23:59.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.646+0000 7f0722c82740 1 Processor -- start 2024-09-19T06:23:59.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.647+0000 7f0722c82740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca4fab35d0 0x55ca4fabdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:59.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.647+0000 7f0722c82740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca4fab4b40 0x55ca4fabb010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:59.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.647+0000 7f0722c82740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca4fabe370 0x55ca4fabb620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:59.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.647+0000 7f0722c82740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ca4fac1070 con 0x55ca4fab4b40 2024-09-19T06:23:59.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.647+0000 7f0722c82740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55ca4f9d4060 con 0x55ca4fabe370 2024-09-19T06:23:59.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.647+0000 7f0722c82740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55ca4fac11f0 con 0x55ca4fab35d0 2024-09-19T06:23:59.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.647+0000 7f0722c82740 10 client.0 _ll_register_callbacks cb 0x55ca4f7278c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:59.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.647+0000 7f0713fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca4fab4b40 0x55ca4fabb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:59.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.647+0000 7f0713fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca4fab4b40 0x55ca4fabb010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36876/0 (socket says 172.21.15.2:36876) 2024-09-19T06:23:59.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.647+0000 7f0713fff640 1 -- 172.21.15.2:0/464037889 learned_addr learned my addr 172.21.15.2:0/464037889 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:59.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.647+0000 7f071a59c640 1 --2- 172.21.15.2:0/464037889 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca4fab35d0 0x55ca4fabdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:59.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.647+0000 7f071ad9d640 1 --2- 172.21.15.2:0/464037889 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca4fabe370 0x55ca4fabb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:59.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.647+0000 7f0713fff640 1 -- 172.21.15.2:0/464037889 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca4fab35d0 msgr2=0x55ca4fabdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:59.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.647+0000 7f0713fff640 1 --2- 172.21.15.2:0/464037889 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca4fab35d0 0x55ca4fabdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:59.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.647+0000 7f0713fff640 1 -- 172.21.15.2:0/464037889 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca4fabe370 msgr2=0x55ca4fabb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:59.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.647+0000 7f0713fff640 1 --2- 172.21.15.2:0/464037889 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca4fabe370 0x55ca4fabb620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:59.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.647+0000 7f0713fff640 1 -- 172.21.15.2:0/464037889 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca4f78a3c0 con 0x55ca4fab4b40 2024-09-19T06:23:59.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.648+0000 7f0713fff640 1 --2- 172.21.15.2:0/464037889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca4fab4b40 0x55ca4fabb010 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f070402a940 tx=0x7f07040314a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87b7b0d93a9a807b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:59.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.648+0000 7f0701ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:59.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.648+0000 7f0701ffb640 1 -- 172.21.15.2:0/464037889 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0704035040 con 0x55ca4fab4b40 2024-09-19T06:23:59.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.648+0000 7f0722c82740 1 -- 172.21.15.2:0/464037889 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07140258d0 con 0x55ca4fab4b40 2024-09-19T06:23:59.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.648+0000 7f0701ffb640 1 -- 172.21.15.2:0/464037889 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f0704031810 con 0x55ca4fab4b40 2024-09-19T06:23:59.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.648+0000 7f0701ffb640 1 -- 172.21.15.2:0/464037889 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0704004040 con 0x55ca4fab4b40 2024-09-19T06:23:59.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.648+0000 7f0722c82740 10 client.18615 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:59.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.648+0000 7f0722c82740 1 -- 172.21.15.2:0/464037889 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ca4faccb00 con 0x55ca4fab4b40 2024-09-19T06:23:59.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.648+0000 7f0701ffb640 1 -- 172.21.15.2:0/464037889 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f07140258d0 con 0x55ca4fab4b40 2024-09-19T06:23:59.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.648+0000 7f0701ffb640 1 -- 172.21.15.2:0/464037889 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f070404e480 con 0x55ca4fab4b40 2024-09-19T06:23:59.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.648+0000 7f0722c82740 10 client.18615 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:59.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.648+0000 7f0722c82740 10 client.18615 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:59.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.648+0000 7f0722c82740 20 client.18615 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:59.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.648+0000 7f0722c82740 1 --2- 172.21.15.2:0/464037889 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ca4facdf10 0x55ca4fad0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:59.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.648+0000 7f0722c82740 4 client.18615 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:23:59.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.648+0000 7f0722c82740 1 -- 172.21.15.2:0/464037889 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca4fa26860 con 0x55ca4facdf10 2024-09-19T06:23:59.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.649+0000 7f071a59c640 1 --2- 172.21.15.2:0/464037889 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ca4facdf10 0x55ca4fad0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:59.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.649+0000 7f0701ffb640 10 client.18615 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:59.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.649+0000 7f071a59c640 1 --2- 172.21.15.2:0/464037889 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ca4facdf10 0x55ca4fad0370 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45c499bfc582be04 server_cookie=2af2d6372dd0c040 in_seq=0 out_seq=0 2024-09-19T06:23:59.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.650+0000 7f0701ffb640 1 -- 172.21.15.2:0/464037889 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ca4fa26860 con 0x55ca4facdf10 2024-09-19T06:23:59.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.650+0000 7f0701ffb640 10 client.18615 handle_command_reply: tid=0 2024-09-19T06:23:59.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.650+0000 7f0722c82740 1 client.18615 shutdown 2024-09-19T06:23:59.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.650+0000 7f0722c82740 1 -- 172.21.15.2:0/464037889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca4fab4b40 msgr2=0x55ca4fabb010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:59.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.650+0000 7f0722c82740 1 --2- 172.21.15.2:0/464037889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca4fab4b40 0x55ca4fabb010 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f070402a940 tx=0x7f07040314a0 comp rx=0 tx=0).stop 2024-09-19T06:23:59.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.650+0000 7f0722c82740 1 -- 172.21.15.2:0/464037889 shutdown_connections 2024-09-19T06:23:59.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.650+0000 7f0722c82740 1 --2- 172.21.15.2:0/464037889 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ca4facdf10 0x55ca4fad0370 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:59.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.650+0000 7f0722c82740 1 --2- 172.21.15.2:0/464037889 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca4fabe370 0x55ca4fabb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:59.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.650+0000 7f0722c82740 1 --2- 172.21.15.2:0/464037889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca4fab4b40 0x55ca4fabb010 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:59.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.650+0000 7f0722c82740 1 --2- 172.21.15.2:0/464037889 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca4fab35d0 0x55ca4fabdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:59.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.650+0000 7f0701ffb640 0 client.18615 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:59.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.650+0000 7f0722c82740 1 -- 172.21.15.2:0/464037889 >> 172.21.15.2:0/464037889 conn(0x55ca4fa7c310 msgr2=0x55ca4fab5990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:59.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.650+0000 7f0722c82740 1 -- 172.21.15.2:0/464037889 shutdown_connections 2024-09-19T06:23:59.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.650+0000 7f0722c82740 1 -- 172.21.15.2:0/464037889 wait complete. 2024-09-19T06:23:59.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.650+0000 7f0722c82740 20 client.18615 trim_cache size 0 max 16384 2024-09-19T06:23:59.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.663+0000 7f0722c82740 1 Processor -- start 2024-09-19T06:23:59.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.663+0000 7f0722c82740 1 -- start start 2024-09-19T06:23:59.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.663+0000 7f0722c82740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca4fab35d0 0x55ca4faaec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:59.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.663+0000 7f0722c82740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca4fab4b40 0x55ca4faaf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:59.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.663+0000 7f0722c82740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca4fabe370 0x55ca4fab6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:59.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.663+0000 7f0722c82740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f071c1b0110 con 0x55ca4fabe370 2024-09-19T06:23:59.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.663+0000 7f0722c82740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f071c1ad9e0 con 0x55ca4fab35d0 2024-09-19T06:23:59.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.663+0000 7f0722c82740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f071c1ab850 con 0x55ca4fab4b40 2024-09-19T06:23:59.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.663+0000 7f071ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca4fabe370 0x55ca4fab6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:59.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.664+0000 7f071ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca4fabe370 0x55ca4fab6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36886/0 (socket says 172.21.15.2:36886) 2024-09-19T06:23:59.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.664+0000 7f071ad9d640 1 -- 172.21.15.2:0/239595515 learned_addr learned my addr 172.21.15.2:0/239595515 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:59.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.664+0000 7f071a59c640 1 --2- 172.21.15.2:0/239595515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca4fab35d0 0x55ca4faaec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:59.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.664+0000 7f071ad9d640 1 -- 172.21.15.2:0/239595515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca4fab4b40 msgr2=0x55ca4faaf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:59.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.664+0000 7f0713fff640 1 --2- 172.21.15.2:0/239595515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca4fab4b40 0x55ca4faaf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:59.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.664+0000 7f071ad9d640 1 --2- 172.21.15.2:0/239595515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca4fab4b40 0x55ca4faaf150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:59.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.664+0000 7f071ad9d640 1 -- 172.21.15.2:0/239595515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca4fab35d0 msgr2=0x55ca4faaec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:59.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.664+0000 7f071ad9d640 1 --2- 172.21.15.2:0/239595515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca4fab35d0 0x55ca4faaec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:59.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.664+0000 7f071ad9d640 1 -- 172.21.15.2:0/239595515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca4fab9560 con 0x55ca4fabe370 2024-09-19T06:23:59.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.664+0000 7f071a59c640 1 --2- 172.21.15.2:0/239595515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca4fab35d0 0x55ca4faaec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:23:59.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.664+0000 7f071ad9d640 1 --2- 172.21.15.2:0/239595515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca4fabe370 0x55ca4fab6120 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f071400a620 tx=0x7f0714025f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbfdcd9eb799a194 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:59.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.664+0000 7f0703fff640 1 -- 172.21.15.2:0/239595515 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0714021040 con 0x55ca4fabe370 2024-09-19T06:23:59.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.664+0000 7f0703fff640 1 -- 172.21.15.2:0/239595515 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0714034070 con 0x55ca4fabe370 2024-09-19T06:23:59.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.664+0000 7f0703fff640 1 -- 172.21.15.2:0/239595515 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071400fbb0 con 0x55ca4fabe370 2024-09-19T06:23:59.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.665+0000 7f0722c82740 1 -- 172.21.15.2:0/239595515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca4fabe370 msgr2=0x55ca4fab6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:59.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.665+0000 7f0722c82740 1 --2- 172.21.15.2:0/239595515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca4fabe370 0x55ca4fab6120 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f071400a620 tx=0x7f0714025f90 comp rx=0 tx=0).stop 2024-09-19T06:23:59.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.665+0000 7f0722c82740 1 -- 172.21.15.2:0/239595515 shutdown_connections 2024-09-19T06:23:59.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.665+0000 7f0722c82740 1 --2- 172.21.15.2:0/239595515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca4fabe370 0x55ca4fab6120 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:59.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.665+0000 7f0722c82740 1 --2- 172.21.15.2:0/239595515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca4fab4b40 0x55ca4faaf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:59.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.665+0000 7f0722c82740 1 --2- 172.21.15.2:0/239595515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca4fab35d0 0x55ca4faaec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:59.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.665+0000 7f0722c82740 1 -- 172.21.15.2:0/239595515 >> 172.21.15.2:0/239595515 conn(0x55ca4fa7c310 msgr2=0x55ca4faae500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:59.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.665+0000 7f0722c82740 1 -- 172.21.15.2:0/239595515 shutdown_connections 2024-09-19T06:23:59.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.665+0000 7f0722c82740 1 -- 172.21.15.2:0/239595515 wait complete. 2024-09-19T06:23:59.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.665+0000 7f0722c82740 1 -- start start 2024-09-19T06:23:59.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.665+0000 7f0722c82740 1 Processor -- start 2024-09-19T06:23:59.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.666+0000 7f0722c82740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca4fab35d0 0x55ca4fac6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:59.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.666+0000 7f0722c82740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca4fab4b40 0x55ca4fac1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:59.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.666+0000 7f0722c82740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca4fabe370 0x55ca4fac25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:59.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.666+0000 7f0722c82740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f071c1abea0 con 0x55ca4fabe370 2024-09-19T06:23:59.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.666+0000 7f0722c82740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f071c1ad310 con 0x55ca4fab35d0 2024-09-19T06:23:59.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.666+0000 7f0722c82740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f071c1ac570 con 0x55ca4fab4b40 2024-09-19T06:23:59.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.666+0000 7f0722c82740 10 client.0 _ll_register_callbacks cb 0x7f0704009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:59.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.666+0000 7f071ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca4fabe370 0x55ca4fac25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:59.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.666+0000 7f071ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca4fabe370 0x55ca4fac25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36902/0 (socket says 172.21.15.2:36902) 2024-09-19T06:23:59.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.666+0000 7f071ad9d640 1 -- 172.21.15.2:0/1663071445 learned_addr learned my addr 172.21.15.2:0/1663071445 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:23:59.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.666+0000 7f071a59c640 1 --2- 172.21.15.2:0/1663071445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca4fab35d0 0x55ca4fac6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:59.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.666+0000 7f0713fff640 1 --2- 172.21.15.2:0/1663071445 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca4fab4b40 0x55ca4fac1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:59.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.666+0000 7f071ad9d640 1 -- 172.21.15.2:0/1663071445 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca4fab4b40 msgr2=0x55ca4fac1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:59.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.666+0000 7f071ad9d640 1 --2- 172.21.15.2:0/1663071445 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca4fab4b40 0x55ca4fac1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:59.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.666+0000 7f071ad9d640 1 -- 172.21.15.2:0/1663071445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca4fab35d0 msgr2=0x55ca4fac6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:59.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.666+0000 7f071ad9d640 1 --2- 172.21.15.2:0/1663071445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca4fab35d0 0x55ca4fac6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:59.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.666+0000 7f071ad9d640 1 -- 172.21.15.2:0/1663071445 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca4fac2de0 con 0x55ca4fabe370 2024-09-19T06:23:59.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.666+0000 7f071ad9d640 1 --2- 172.21.15.2:0/1663071445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca4fabe370 0x55ca4fac25e0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f07140117b0 tx=0x7f0714004df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5444bf9e09ee9ab5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:59.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.666+0000 7f0701ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:23:59.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.666+0000 7f0701ffb640 1 -- 172.21.15.2:0/1663071445 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071403e020 con 0x55ca4fabe370 2024-09-19T06:23:59.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.666+0000 7f0722c82740 1 -- 172.21.15.2:0/1663071445 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0714034070 con 0x55ca4fabe370 2024-09-19T06:23:59.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.666+0000 7f0701ffb640 1 -- 172.21.15.2:0/1663071445 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f0714014250 con 0x55ca4fabe370 2024-09-19T06:23:59.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.667+0000 7f0701ffb640 1 -- 172.21.15.2:0/1663071445 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0714049050 con 0x55ca4fabe370 2024-09-19T06:23:59.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.667+0000 7f0722c82740 10 client.18621 fetch_fsmap learned FSMap version 26 2024-09-19T06:23:59.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.667+0000 7f0722c82740 1 -- 172.21.15.2:0/1663071445 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ca4fb38c10 con 0x55ca4fabe370 2024-09-19T06:23:59.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.667+0000 7f0701ffb640 1 -- 172.21.15.2:0/1663071445 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0714034070 con 0x55ca4fabe370 2024-09-19T06:23:59.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.667+0000 7f0701ffb640 1 -- 172.21.15.2:0/1663071445 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f07140254b0 con 0x55ca4fabe370 2024-09-19T06:23:59.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.667+0000 7f0722c82740 10 client.18621 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:23:59.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.667+0000 7f0722c82740 10 client.18621 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:59.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.667+0000 7f0722c82740 20 client.18621 populate_metadata read hostname 'smithi002' 2024-09-19T06:23:59.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.667+0000 7f0722c82740 1 --2- 172.21.15.2:0/1663071445 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ca4fb39120 0x55ca4fb3b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:59.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.667+0000 7f0722c82740 4 client.18621 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:23:59.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.667+0000 7f0722c82740 1 -- 172.21.15.2:0/1663071445 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ca4fa20d70 con 0x55ca4fb39120 2024-09-19T06:23:59.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.667+0000 7f071a59c640 1 --2- 172.21.15.2:0/1663071445 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ca4fb39120 0x55ca4fb3b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:59.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.668+0000 7f071a59c640 1 --2- 172.21.15.2:0/1663071445 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ca4fb39120 0x55ca4fb3b510 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c056a43f6f1b0cfd server_cookie=1240f74f05553e36 in_seq=0 out_seq=0 2024-09-19T06:23:59.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.668+0000 7f0701ffb640 10 client.18621 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:59.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.668+0000 7f0701ffb640 1 -- 172.21.15.2:0/1663071445 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ca4fa20d70 con 0x55ca4fb39120 2024-09-19T06:23:59.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.668+0000 7f0701ffb640 10 client.18621 handle_command_reply: tid=0 2024-09-19T06:23:59.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.668+0000 7f0722c82740 1 client.18621 shutdown 2024-09-19T06:23:59.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.668+0000 7f0722c82740 1 -- 172.21.15.2:0/1663071445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca4fabe370 msgr2=0x55ca4fac25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:59.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.668+0000 7f0722c82740 1 --2- 172.21.15.2:0/1663071445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca4fabe370 0x55ca4fac25e0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f07140117b0 tx=0x7f0714004df0 comp rx=0 tx=0).stop 2024-09-19T06:23:59.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.668+0000 7f0722c82740 1 -- 172.21.15.2:0/1663071445 shutdown_connections 2024-09-19T06:23:59.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.668+0000 7f0722c82740 1 --2- 172.21.15.2:0/1663071445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ca4fabe370 0x55ca4fac25e0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:59.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.668+0000 7f0722c82740 1 --2- 172.21.15.2:0/1663071445 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ca4fab4b40 0x55ca4fac1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:59.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.668+0000 7f0722c82740 1 --2- 172.21.15.2:0/1663071445 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ca4fb39120 0x55ca4fb3b510 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:59.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.668+0000 7f0722c82740 1 --2- 172.21.15.2:0/1663071445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ca4fab35d0 0x55ca4fac6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:59.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.668+0000 7f0722c82740 1 -- 172.21.15.2:0/1663071445 >> 172.21.15.2:0/1663071445 conn(0x55ca4fa7c310 msgr2=0x55ca4faaed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:59.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.668+0000 7f0701ffb640 0 client.18621 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:23:59.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.668+0000 7f0722c82740 1 -- 172.21.15.2:0/1663071445 shutdown_connections 2024-09-19T06:23:59.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.668+0000 7f0722c82740 1 -- 172.21.15.2:0/1663071445 wait complete. 2024-09-19T06:23:59.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.668+0000 7f0722c82740 20 client.18621 trim_cache size 0 max 16384 2024-09-19T06:23:59.676 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:23:59.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.669+0000 7f07208a9640 1 -- 172.21.15.2:0/2799392498 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f07080a33b0 msgr2=0x7f07080a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:59.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.669+0000 7f07208a9640 1 --2- 172.21.15.2:0/2799392498 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f07080a33b0 0x7f07080a5870 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f071401e000 tx=0x7f071401a000 comp rx=0 tx=0).stop 2024-09-19T06:23:59.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.669+0000 7f07208a9640 1 -- 172.21.15.2:0/2799392498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f071c100a80 msgr2=0x7f071c199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:59.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.669+0000 7f07208a9640 1 --2- 172.21.15.2:0/2799392498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f071c100a80 0x7f071c199260 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f070c00d950 tx=0x7f070c00de10 comp rx=0 tx=0).stop 2024-09-19T06:23:59.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.669+0000 7f07208a9640 1 -- 172.21.15.2:0/2799392498 shutdown_connections 2024-09-19T06:23:59.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.669+0000 7f07208a9640 1 --2- 172.21.15.2:0/2799392498 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f07080a33b0 0x7f07080a5870 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:59.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.669+0000 7f07208a9640 1 --2- 172.21.15.2:0/2799392498 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f071c106a80 0x7f071c1a42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:59.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.669+0000 7f07208a9640 1 --2- 172.21.15.2:0/2799392498 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f071c101420 0x7f071c1997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:59.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.669+0000 7f07208a9640 1 --2- 172.21.15.2:0/2799392498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f071c100a80 0x7f071c199260 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:59.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.669+0000 7f07208a9640 1 -- 172.21.15.2:0/2799392498 >> 172.21.15.2:0/2799392498 conn(0x7f071c0fc7a0 msgr2=0x7f071c0fd190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:59.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.669+0000 7f07208a9640 1 -- 172.21.15.2:0/2799392498 shutdown_connections 2024-09-19T06:23:59.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:23:59.669+0000 7f07208a9640 1 -- 172.21.15.2:0/2799392498 wait complete. 2024-09-19T06:23:59.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:23:59 smithi090 ceph-mon[34497]: pgmap v284: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:23:59.791 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:23:59 smithi089 ceph-mon[34160]: pgmap v284: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:24:01.345 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:24:01.346 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:24:01.615 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:24:01.719 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:01 smithi002 ceph-mon[30982]: pgmap v285: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:24:01.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:01 smithi090 ceph-mon[34497]: pgmap v285: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:24:01.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:01 smithi089 ceph-mon[34160]: pgmap v285: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:24:02.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.056+0000 7f37ef433640 1 -- 172.21.15.2:0/1428430323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37e80747f0 msgr2=0x7f37e8074bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:02.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.056+0000 7f37ef433640 1 --2- 172.21.15.2:0/1428430323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37e80747f0 0x7f37e8074bd0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f37e4009900 tx=0x7f37e402a410 comp rx=0 tx=0).stop 2024-09-19T06:24:02.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.057+0000 7f37ef433640 1 -- 172.21.15.2:0/1428430323 shutdown_connections 2024-09-19T06:24:02.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.057+0000 7f37ef433640 1 --2- 172.21.15.2:0/1428430323 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37e810e480 0x7f37e81108b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:02.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.057+0000 7f37ef433640 1 --2- 172.21.15.2:0/1428430323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37e8075110 0x7f37e810deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:02.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.057+0000 7f37ef433640 1 --2- 172.21.15.2:0/1428430323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37e80747f0 0x7f37e8074bd0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:02.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.057+0000 7f37ef433640 1 -- 172.21.15.2:0/1428430323 >> 172.21.15.2:0/1428430323 conn(0x7f37e80fd8d0 msgr2=0x7f37e80ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:02.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.057+0000 7f37ef433640 1 -- 172.21.15.2:0/1428430323 shutdown_connections 2024-09-19T06:24:02.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.057+0000 7f37ef433640 1 -- 172.21.15.2:0/1428430323 wait complete. 2024-09-19T06:24:02.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.057+0000 7f37ef433640 1 Processor -- start 2024-09-19T06:24:02.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.057+0000 7f37ef433640 1 -- start start 2024-09-19T06:24:02.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.057+0000 7f37ef433640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37e80747f0 0x7f37e819a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:02.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.057+0000 7f37ef433640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37e8075110 0x7f37e819ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:02.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.057+0000 7f37ef433640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37e810e480 0x7f37e819ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:02.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.057+0000 7f37ef433640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f37e81140c0 con 0x7f37e810e480 2024-09-19T06:24:02.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.057+0000 7f37ef433640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f37e8113f40 con 0x7f37e80747f0 2024-09-19T06:24:02.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.057+0000 7f37ef433640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f37e8114240 con 0x7f37e8075110 2024-09-19T06:24:02.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.058+0000 7f37ed9d0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37e810e480 0x7f37e819ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:02.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.058+0000 7f37ed9d0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37e810e480 0x7f37e819ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36926/0 (socket says 172.21.15.2:36926) 2024-09-19T06:24:02.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.058+0000 7f37ed9d0640 1 -- 172.21.15.2:0/1905928594 learned_addr learned my addr 172.21.15.2:0/1905928594 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:02.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.058+0000 7f37ec9ce640 1 --2- 172.21.15.2:0/1905928594 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37e8075110 0x7f37e819ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:02.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.058+0000 7f37ed1cf640 1 --2- 172.21.15.2:0/1905928594 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37e80747f0 0x7f37e819a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:02.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.058+0000 7f37ed9d0640 1 -- 172.21.15.2:0/1905928594 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37e8075110 msgr2=0x7f37e819ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:02.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.058+0000 7f37ed9d0640 1 --2- 172.21.15.2:0/1905928594 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37e8075110 0x7f37e819ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:02.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.058+0000 7f37ed9d0640 1 -- 172.21.15.2:0/1905928594 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37e80747f0 msgr2=0x7f37e819a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:02.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.058+0000 7f37ed9d0640 1 --2- 172.21.15.2:0/1905928594 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37e80747f0 0x7f37e819a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:02.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.058+0000 7f37ed9d0640 1 -- 172.21.15.2:0/1905928594 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37e819f5e0 con 0x7f37e810e480 2024-09-19T06:24:02.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.058+0000 7f37ed9d0640 1 --2- 172.21.15.2:0/1905928594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37e810e480 0x7f37e819ef00 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f37e000e9d0 tx=0x7f37e000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:02.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.058+0000 7f37de7fc640 1 -- 172.21.15.2:0/1905928594 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e000cd80 con 0x7f37e810e480 2024-09-19T06:24:02.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.058+0000 7f37ef433640 1 -- 172.21.15.2:0/1905928594 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37e819f8d0 con 0x7f37e810e480 2024-09-19T06:24:02.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.058+0000 7f37de7fc640 1 -- 172.21.15.2:0/1905928594 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f37e0005020 con 0x7f37e810e480 2024-09-19T06:24:02.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.058+0000 7f37de7fc640 1 -- 172.21.15.2:0/1905928594 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e00116d0 con 0x7f37e810e480 2024-09-19T06:24:02.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.058+0000 7f37ef433640 1 -- 172.21.15.2:0/1905928594 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37e81a71b0 con 0x7f37e810e480 2024-09-19T06:24:02.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.061+0000 7f37de7fc640 1 -- 172.21.15.2:0/1905928594 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f37e00051d0 con 0x7f37e810e480 2024-09-19T06:24:02.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.061+0000 7f37f180c740 1 Processor -- start 2024-09-19T06:24:02.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.061+0000 7f37f180c740 1 -- start start 2024-09-19T06:24:02.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.061+0000 7f37f180c740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56390471cb60 0x56390471cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:02.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.061+0000 7f37f180c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56390471d480 0x563904727800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:02.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.061+0000 7f37f180c740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563904727d40 0x56390472a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:02.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.061+0000 7f37f180c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563904682280 con 0x56390471d480 2024-09-19T06:24:02.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.061+0000 7f37f180c740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563904629b10 con 0x563904727d40 2024-09-19T06:24:02.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.061+0000 7f37f180c740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56390467e240 con 0x56390471cb60 2024-09-19T06:24:02.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.062+0000 7f37ed1cf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56390471d480 0x563904727800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:02.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.062+0000 7f37ed1cf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56390471d480 0x563904727800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36934/0 (socket says 172.21.15.2:36934) 2024-09-19T06:24:02.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.062+0000 7f37ed1cf640 1 -- 172.21.15.2:0/1226036044 learned_addr learned my addr 172.21.15.2:0/1226036044 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:02.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.062+0000 7f37de7fc640 1 --2- 172.21.15.2:0/1905928594 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f37d40a33b0 0x7f37d40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:02.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.062+0000 7f37ec9ce640 1 --2- 172.21.15.2:0/1226036044 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56390471cb60 0x56390471cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:02.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.062+0000 7f37ed9d0640 1 --2- 172.21.15.2:0/1905928594 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f37d40a33b0 0x7f37d40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:02.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.062+0000 7f37ec9ce640 1 --2- 172.21.15.2:0/1226036044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563904727d40 0x56390472a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:02.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.062+0000 7f37ed1cf640 1 -- 172.21.15.2:0/1226036044 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56390471cb60 msgr2=0x56390471cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:02.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.062+0000 7f37ed1cf640 1 --2- 172.21.15.2:0/1226036044 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56390471cb60 0x56390471cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:02.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.062+0000 7f37ed1cf640 1 -- 172.21.15.2:0/1226036044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563904727d40 msgr2=0x56390472a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:02.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.062+0000 7f37ed1cf640 1 --2- 172.21.15.2:0/1226036044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563904727d40 0x56390472a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:02.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.062+0000 7f37ed1cf640 1 -- 172.21.15.2:0/1226036044 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639046361f0 con 0x56390471d480 2024-09-19T06:24:02.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.062+0000 7f37de7fc640 1 -- 172.21.15.2:0/1905928594 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f37e00cff20 con 0x7f37e810e480 2024-09-19T06:24:02.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.062+0000 7f37ed1cf640 1 --2- 172.21.15.2:0/1226036044 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56390471d480 0x563904727800 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f37e4009900 tx=0x7f37e4032c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48d0673d31135feb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:02.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.062+0000 7f37ed9d0640 1 --2- 172.21.15.2:0/1905928594 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f37d40a33b0 0x7f37d40a5870 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f37e0098660 tx=0x7f37e0098520 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:02.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.062+0000 7f37d37fe640 1 -- 172.21.15.2:0/1226036044 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e403f070 con 0x56390471d480 2024-09-19T06:24:02.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.063+0000 7f37d37fe640 1 -- 172.21.15.2:0/1226036044 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f37e40316a0 con 0x56390471d480 2024-09-19T06:24:02.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.063+0000 7f37d37fe640 1 -- 172.21.15.2:0/1226036044 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e4035070 con 0x56390471d480 2024-09-19T06:24:02.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.063+0000 7f37f180c740 1 -- 172.21.15.2:0/1226036044 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56390471d480 msgr2=0x563904727800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:02.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.063+0000 7f37f180c740 1 --2- 172.21.15.2:0/1226036044 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56390471d480 0x563904727800 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f37e4009900 tx=0x7f37e4032c20 comp rx=0 tx=0).stop 2024-09-19T06:24:02.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.063+0000 7f37f180c740 1 -- 172.21.15.2:0/1226036044 shutdown_connections 2024-09-19T06:24:02.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.063+0000 7f37f180c740 1 --2- 172.21.15.2:0/1226036044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563904727d40 0x56390472a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:02.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.063+0000 7f37f180c740 1 --2- 172.21.15.2:0/1226036044 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56390471d480 0x563904727800 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:02.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.063+0000 7f37f180c740 1 --2- 172.21.15.2:0/1226036044 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56390471cb60 0x56390471cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:02.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.063+0000 7f37f180c740 1 -- 172.21.15.2:0/1226036044 >> 172.21.15.2:0/1226036044 conn(0x5639047190f0 msgr2=0x5639047194d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:02.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.063+0000 7f37f180c740 1 -- 172.21.15.2:0/1226036044 shutdown_connections 2024-09-19T06:24:02.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.063+0000 7f37f180c740 1 -- 172.21.15.2:0/1226036044 wait complete. 2024-09-19T06:24:02.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.064+0000 7f37f180c740 1 -- start start 2024-09-19T06:24:02.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.064+0000 7f37f180c740 1 Processor -- start 2024-09-19T06:24:02.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.064+0000 7f37f180c740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56390471cb60 0x563904724be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:02.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.064+0000 7f37f180c740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56390471d480 0x563904725120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:02.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.064+0000 7f37f180c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563904727d40 0x563904725660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:02.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.064+0000 7f37f180c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56390472a910 con 0x563904727d40 2024-09-19T06:24:02.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.064+0000 7f37f180c740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56390463cf10 con 0x56390471d480 2024-09-19T06:24:02.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.064+0000 7f37f180c740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56390472aa90 con 0x56390471cb60 2024-09-19T06:24:02.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.064+0000 7f37f180c740 10 client.0 _ll_register_callbacks cb 0x563904605a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:02.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.064+0000 7f37ec9ce640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563904727d40 0x563904725660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:02.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.064+0000 7f37ec9ce640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563904727d40 0x563904725660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36942/0 (socket says 172.21.15.2:36942) 2024-09-19T06:24:02.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.065+0000 7f37ec9ce640 1 -- 172.21.15.2:0/3254966750 learned_addr learned my addr 172.21.15.2:0/3254966750 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:02.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.065+0000 7f37ed1cf640 1 --2- 172.21.15.2:0/3254966750 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56390471d480 0x563904725120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:02.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.065+0000 7f37ec9ce640 1 --2- 172.21.15.2:0/3254966750 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56390471cb60 0x563904724be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:02.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.065+0000 7f37ec9ce640 1 -- 172.21.15.2:0/3254966750 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56390471cb60 msgr2=0x563904724be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:02.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.065+0000 7f37ec9ce640 1 --2- 172.21.15.2:0/3254966750 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56390471cb60 0x563904724be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:02.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.065+0000 7f37ec9ce640 1 -- 172.21.15.2:0/3254966750 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56390471d480 msgr2=0x563904725120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:02.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.065+0000 7f37ec9ce640 1 --2- 172.21.15.2:0/3254966750 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56390471d480 0x563904725120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:02.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.065+0000 7f37ec9ce640 1 -- 172.21.15.2:0/3254966750 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639043f36a0 con 0x563904727d40 2024-09-19T06:24:02.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.065+0000 7f37ec9ce640 1 --2- 172.21.15.2:0/3254966750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563904727d40 0x563904725660 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f37d8013b90 tx=0x7f37d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=501afc3876df2a99 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:02.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.065+0000 7f37d0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:24:02.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.065+0000 7f37d0ff9640 1 -- 172.21.15.2:0/3254966750 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d8004230 con 0x563904727d40 2024-09-19T06:24:02.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.065+0000 7f37d0ff9640 1 -- 172.21.15.2:0/3254966750 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f37d80043d0 con 0x563904727d40 2024-09-19T06:24:02.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.065+0000 7f37f180c740 1 -- 172.21.15.2:0/3254966750 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37e40316a0 con 0x563904727d40 2024-09-19T06:24:02.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.065+0000 7f37d0ff9640 1 -- 172.21.15.2:0/3254966750 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f37d8005020 con 0x563904727d40 2024-09-19T06:24:02.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.065+0000 7f37f180c740 10 client.18633 fetch_fsmap learned FSMap version 26 2024-09-19T06:24:02.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.065+0000 7f37f180c740 1 -- 172.21.15.2:0/3254966750 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563904736540 con 0x563904727d40 2024-09-19T06:24:02.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.066+0000 7f37d0ff9640 1 -- 172.21.15.2:0/3254966750 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f37e40316a0 con 0x563904727d40 2024-09-19T06:24:02.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.066+0000 7f37d0ff9640 1 -- 172.21.15.2:0/3254966750 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f37d8004b80 con 0x563904727d40 2024-09-19T06:24:02.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.066+0000 7f37f180c740 10 client.18633 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:24:02.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.066+0000 7f37f180c740 10 client.18633 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:24:02.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.066+0000 7f37f180c740 20 client.18633 populate_metadata read hostname 'smithi002' 2024-09-19T06:24:02.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.066+0000 7f37f180c740 1 --2- 172.21.15.2:0/3254966750 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563904737ca0 0x56390473a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:02.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.066+0000 7f37f180c740 4 client.18633 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:24:02.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.066+0000 7f37f180c740 1 -- 172.21.15.2:0/3254966750 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56390468f7f0 con 0x563904737ca0 2024-09-19T06:24:02.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.066+0000 7f37ed1cf640 1 --2- 172.21.15.2:0/3254966750 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563904737ca0 0x56390473a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:02.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.067+0000 7f37ed1cf640 1 --2- 172.21.15.2:0/3254966750 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563904737ca0 0x56390473a120 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a27cc03ace8cab4 server_cookie=86da7762c6403fd7 in_seq=0 out_seq=0 2024-09-19T06:24:02.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.067+0000 7f37d0ff9640 10 client.18633 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:02.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.067+0000 7f37d0ff9640 1 -- 172.21.15.2:0/3254966750 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56390468f7f0 con 0x563904737ca0 2024-09-19T06:24:02.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.067+0000 7f37d0ff9640 10 client.18633 handle_command_reply: tid=0 2024-09-19T06:24:02.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.067+0000 7f37f180c740 1 client.18633 shutdown 2024-09-19T06:24:02.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.068+0000 7f37f180c740 1 -- 172.21.15.2:0/3254966750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563904727d40 msgr2=0x563904725660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:02.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.068+0000 7f37f180c740 1 --2- 172.21.15.2:0/3254966750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563904727d40 0x563904725660 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f37d8013b90 tx=0x7f37d80046c0 comp rx=0 tx=0).stop 2024-09-19T06:24:02.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.068+0000 7f37f180c740 1 -- 172.21.15.2:0/3254966750 shutdown_connections 2024-09-19T06:24:02.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.068+0000 7f37f180c740 1 --2- 172.21.15.2:0/3254966750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563904727d40 0x563904725660 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:02.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.068+0000 7f37f180c740 1 --2- 172.21.15.2:0/3254966750 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x563904737ca0 0x56390473a120 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:02.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.068+0000 7f37f180c740 1 --2- 172.21.15.2:0/3254966750 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56390471d480 0x563904725120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:02.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.068+0000 7f37f180c740 1 --2- 172.21.15.2:0/3254966750 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56390471cb60 0x563904724be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:02.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.068+0000 7f37d0ff9640 0 client.18633 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:02.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.068+0000 7f37f180c740 1 -- 172.21.15.2:0/3254966750 >> 172.21.15.2:0/3254966750 conn(0x5639047190f0 msgr2=0x563904718270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:02.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.068+0000 7f37f180c740 1 -- 172.21.15.2:0/3254966750 shutdown_connections 2024-09-19T06:24:02.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.068+0000 7f37f180c740 1 -- 172.21.15.2:0/3254966750 wait complete. 2024-09-19T06:24:02.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.068+0000 7f37f180c740 20 client.18633 trim_cache size 0 max 16384 2024-09-19T06:24:02.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.085+0000 7f37f180c740 1 Processor -- start 2024-09-19T06:24:02.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.085+0000 7f37f180c740 1 -- start start 2024-09-19T06:24:02.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.085+0000 7f37f180c740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56390471cb60 0x56390471f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:02.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.085+0000 7f37f180c740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56390471d480 0x563904726a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:02.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.086+0000 7f37f180c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563904727d40 0x56390473f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:02.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.086+0000 7f37f180c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f37e81b2330 con 0x563904727d40 2024-09-19T06:24:02.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.086+0000 7f37f180c740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f37e81afc00 con 0x56390471d480 2024-09-19T06:24:02.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.086+0000 7f37f180c740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f37e81ada70 con 0x56390471cb60 2024-09-19T06:24:02.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.086+0000 7f37ec9ce640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563904727d40 0x56390473f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:02.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.086+0000 7f37ec9ce640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563904727d40 0x56390473f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36946/0 (socket says 172.21.15.2:36946) 2024-09-19T06:24:02.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.086+0000 7f37ec9ce640 1 -- 172.21.15.2:0/621472456 learned_addr learned my addr 172.21.15.2:0/621472456 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:02.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.086+0000 7f37ed1cf640 1 --2- 172.21.15.2:0/621472456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56390471d480 0x563904726a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:02.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.086+0000 7f37ec9ce640 1 --2- 172.21.15.2:0/621472456 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56390471cb60 0x56390471f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:02.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.086+0000 7f37ec9ce640 1 -- 172.21.15.2:0/621472456 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56390471cb60 msgr2=0x56390471f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:02.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.086+0000 7f37ec9ce640 1 --2- 172.21.15.2:0/621472456 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56390471cb60 0x56390471f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:02.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.086+0000 7f37ec9ce640 1 -- 172.21.15.2:0/621472456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56390471d480 msgr2=0x563904726a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:02.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.086+0000 7f37ec9ce640 1 --2- 172.21.15.2:0/621472456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56390471d480 0x563904726a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:02.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.086+0000 7f37ec9ce640 1 -- 172.21.15.2:0/621472456 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639047274b0 con 0x563904727d40 2024-09-19T06:24:02.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.086+0000 7f37ed1cf640 1 --2- 172.21.15.2:0/621472456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56390471d480 0x563904726a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:24:02.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.086+0000 7f37ec9ce640 1 --2- 172.21.15.2:0/621472456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563904727d40 0x56390473f7d0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x563904727a10 tx=0x7f37d800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab5a4885bb38040b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:02.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.086+0000 7f37d2ffd640 1 -- 172.21.15.2:0/621472456 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d8031020 con 0x563904727d40 2024-09-19T06:24:02.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.086+0000 7f37d2ffd640 1 -- 172.21.15.2:0/621472456 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f37d8004730 con 0x563904727d40 2024-09-19T06:24:02.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.086+0000 7f37d2ffd640 1 -- 172.21.15.2:0/621472456 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d802a680 con 0x563904727d40 2024-09-19T06:24:02.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.087+0000 7f37f180c740 1 -- 172.21.15.2:0/621472456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563904727d40 msgr2=0x56390473f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:02.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.087+0000 7f37f180c740 1 --2- 172.21.15.2:0/621472456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563904727d40 0x56390473f7d0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x563904727a10 tx=0x7f37d800bf10 comp rx=0 tx=0).stop 2024-09-19T06:24:02.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.087+0000 7f37f180c740 1 -- 172.21.15.2:0/621472456 shutdown_connections 2024-09-19T06:24:02.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.087+0000 7f37f180c740 1 --2- 172.21.15.2:0/621472456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563904727d40 0x56390473f7d0 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:02.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.087+0000 7f37f180c740 1 --2- 172.21.15.2:0/621472456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56390471d480 0x563904726a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:02.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.087+0000 7f37f180c740 1 --2- 172.21.15.2:0/621472456 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56390471cb60 0x56390471f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:02.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.087+0000 7f37f180c740 1 -- 172.21.15.2:0/621472456 >> 172.21.15.2:0/621472456 conn(0x5639047190f0 msgr2=0x563904726330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:02.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.087+0000 7f37f180c740 1 -- 172.21.15.2:0/621472456 shutdown_connections 2024-09-19T06:24:02.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.087+0000 7f37f180c740 1 -- 172.21.15.2:0/621472456 wait complete. 2024-09-19T06:24:02.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.087+0000 7f37f180c740 1 -- start start 2024-09-19T06:24:02.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.087+0000 7f37f180c740 1 Processor -- start 2024-09-19T06:24:02.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.088+0000 7f37f180c740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56390471cb60 0x5639047304f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:02.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.088+0000 7f37f180c740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56390471d480 0x56390472b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:02.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.088+0000 7f37f180c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563904727d40 0x56390472bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:02.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.088+0000 7f37f180c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f37e81ae0c0 con 0x563904727d40 2024-09-19T06:24:02.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.088+0000 7f37f180c740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f37e81af530 con 0x56390471cb60 2024-09-19T06:24:02.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.088+0000 7f37f180c740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f37e81ae790 con 0x56390471d480 2024-09-19T06:24:02.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.088+0000 7f37f180c740 10 client.0 _ll_register_callbacks cb 0x7f37d800bd20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:02.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.088+0000 7f37ec9ce640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563904727d40 0x56390472bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:02.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.088+0000 7f37ec9ce640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563904727d40 0x56390472bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36962/0 (socket says 172.21.15.2:36962) 2024-09-19T06:24:02.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.088+0000 7f37ec9ce640 1 -- 172.21.15.2:0/2232438246 learned_addr learned my addr 172.21.15.2:0/2232438246 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:02.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.088+0000 7f37ed1cf640 1 --2- 172.21.15.2:0/2232438246 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56390471d480 0x56390472b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:02.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.088+0000 7f37ec9ce640 1 --2- 172.21.15.2:0/2232438246 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56390471cb60 0x5639047304f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:02.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.088+0000 7f37ec9ce640 1 -- 172.21.15.2:0/2232438246 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56390471d480 msgr2=0x56390472b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:02.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.088+0000 7f37ec9ce640 1 --2- 172.21.15.2:0/2232438246 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56390471d480 0x56390472b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:02.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.088+0000 7f37ec9ce640 1 -- 172.21.15.2:0/2232438246 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56390471cb60 msgr2=0x5639047304f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:02.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.088+0000 7f37ec9ce640 1 --2- 172.21.15.2:0/2232438246 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56390471cb60 0x5639047304f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:02.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.088+0000 7f37ec9ce640 1 -- 172.21.15.2:0/2232438246 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56390472c5f0 con 0x563904727d40 2024-09-19T06:24:02.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.088+0000 7f37ed1cf640 1 --2- 172.21.15.2:0/2232438246 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56390471d480 0x56390472b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:24:02.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.088+0000 7f37ec9ce640 1 --2- 172.21.15.2:0/2232438246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563904727d40 0x56390472bdc0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f37d8005c20 tx=0x7f37d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=630baf641c228cbf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:02.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.088+0000 7f37d0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:24:02.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.089+0000 7f37d0ff9640 1 -- 172.21.15.2:0/2232438246 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d803b060 con 0x563904727d40 2024-09-19T06:24:02.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.089+0000 7f37f180c740 1 -- 172.21.15.2:0/2232438246 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37d8004730 con 0x563904727d40 2024-09-19T06:24:02.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.089+0000 7f37d0ff9640 1 -- 172.21.15.2:0/2232438246 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f37d8004ae0 con 0x563904727d40 2024-09-19T06:24:02.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.089+0000 7f37d0ff9640 1 -- 172.21.15.2:0/2232438246 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f37d8031070 con 0x563904727d40 2024-09-19T06:24:02.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.089+0000 7f37f180c740 10 client.18639 fetch_fsmap learned FSMap version 26 2024-09-19T06:24:02.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.089+0000 7f37f180c740 1 -- 172.21.15.2:0/2232438246 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5639047a28b0 con 0x563904727d40 2024-09-19T06:24:02.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.089+0000 7f37d0ff9640 1 -- 172.21.15.2:0/2232438246 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f37d8004730 con 0x563904727d40 2024-09-19T06:24:02.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.089+0000 7f37d0ff9640 1 -- 172.21.15.2:0/2232438246 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f37d803f460 con 0x563904727d40 2024-09-19T06:24:02.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.089+0000 7f37f180c740 10 client.18639 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:24:02.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.089+0000 7f37f180c740 10 client.18639 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:24:02.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.089+0000 7f37f180c740 20 client.18639 populate_metadata read hostname 'smithi002' 2024-09-19T06:24:02.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.089+0000 7f37f180c740 1 --2- 172.21.15.2:0/2232438246 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5639047a2f20 0x5639047a5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:02.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.089+0000 7f37f180c740 4 client.18639 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:24:02.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.089+0000 7f37f180c740 1 -- 172.21.15.2:0/2232438246 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563904689d00 con 0x5639047a2f20 2024-09-19T06:24:02.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.090+0000 7f37ed1cf640 1 --2- 172.21.15.2:0/2232438246 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5639047a2f20 0x5639047a5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:02.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.090+0000 7f37ed1cf640 1 --2- 172.21.15.2:0/2232438246 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5639047a2f20 0x5639047a5310 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2dc2f260fc626547 server_cookie=a0a8fc2ce9e65c59 in_seq=0 out_seq=0 2024-09-19T06:24:02.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.090+0000 7f37d0ff9640 10 client.18639 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:02.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.091+0000 7f37d0ff9640 1 -- 172.21.15.2:0/2232438246 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563904689d00 con 0x5639047a2f20 2024-09-19T06:24:02.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.091+0000 7f37d0ff9640 10 client.18639 handle_command_reply: tid=0 2024-09-19T06:24:02.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.091+0000 7f37f180c740 1 client.18639 shutdown 2024-09-19T06:24:02.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.091+0000 7f37f180c740 1 -- 172.21.15.2:0/2232438246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563904727d40 msgr2=0x56390472bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:02.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.091+0000 7f37f180c740 1 --2- 172.21.15.2:0/2232438246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563904727d40 0x56390472bdc0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f37d8005c20 tx=0x7f37d80046c0 comp rx=0 tx=0).stop 2024-09-19T06:24:02.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.091+0000 7f37f180c740 1 -- 172.21.15.2:0/2232438246 shutdown_connections 2024-09-19T06:24:02.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.091+0000 7f37f180c740 1 --2- 172.21.15.2:0/2232438246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563904727d40 0x56390472bdc0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:02.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.091+0000 7f37f180c740 1 --2- 172.21.15.2:0/2232438246 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56390471d480 0x56390472b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:02.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.091+0000 7f37f180c740 1 --2- 172.21.15.2:0/2232438246 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5639047a2f20 0x5639047a5310 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:02.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.091+0000 7f37f180c740 1 --2- 172.21.15.2:0/2232438246 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56390471cb60 0x5639047304f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:02.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.091+0000 7f37d0ff9640 0 client.18639 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:02.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.091+0000 7f37f180c740 1 -- 172.21.15.2:0/2232438246 >> 172.21.15.2:0/2232438246 conn(0x5639047190f0 msgr2=0x563904718270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:02.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.091+0000 7f37f180c740 1 -- 172.21.15.2:0/2232438246 shutdown_connections 2024-09-19T06:24:02.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.091+0000 7f37f180c740 1 -- 172.21.15.2:0/2232438246 wait complete. 2024-09-19T06:24:02.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.091+0000 7f37f180c740 20 client.18639 trim_cache size 0 max 16384 2024-09-19T06:24:02.098 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:24:02.098 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T06:24:02.098 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "93e8490e-6c49-49b3-b98e-4dcb9c3bab11", 2024-09-19T06:24:02.098 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T06:24:02.098 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:24:02.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.092+0000 7f37ef433640 1 -- 172.21.15.2:0/1905928594 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f37d40a33b0 msgr2=0x7f37d40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:02.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.092+0000 7f37ef433640 1 --2- 172.21.15.2:0/1905928594 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f37d40a33b0 0x7f37d40a5870 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f37e0098660 tx=0x7f37e0098520 comp rx=0 tx=0).stop 2024-09-19T06:24:02.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.092+0000 7f37ef433640 1 -- 172.21.15.2:0/1905928594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37e810e480 msgr2=0x7f37e819ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:02.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.092+0000 7f37ef433640 1 --2- 172.21.15.2:0/1905928594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37e810e480 0x7f37e819ef00 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f37e000e9d0 tx=0x7f37e000ee90 comp rx=0 tx=0).stop 2024-09-19T06:24:02.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.092+0000 7f37ef433640 1 -- 172.21.15.2:0/1905928594 shutdown_connections 2024-09-19T06:24:02.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.092+0000 7f37ef433640 1 --2- 172.21.15.2:0/1905928594 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f37d40a33b0 0x7f37d40a5870 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:02.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.092+0000 7f37ef433640 1 --2- 172.21.15.2:0/1905928594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37e810e480 0x7f37e819ef00 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:02.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.092+0000 7f37ef433640 1 --2- 172.21.15.2:0/1905928594 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37e8075110 0x7f37e819ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:02.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.092+0000 7f37ef433640 1 --2- 172.21.15.2:0/1905928594 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37e80747f0 0x7f37e819a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:02.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.092+0000 7f37ef433640 1 -- 172.21.15.2:0/1905928594 >> 172.21.15.2:0/1905928594 conn(0x7f37e80fd8d0 msgr2=0x7f37e80fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:02.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.092+0000 7f37ef433640 1 -- 172.21.15.2:0/1905928594 shutdown_connections 2024-09-19T06:24:02.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:02.092+0000 7f37ef433640 1 -- 172.21.15.2:0/1905928594 wait complete. 2024-09-19T06:24:02.868 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:24:03.126 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:24:03.497 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:03 smithi002 ceph-mon[30982]: scrub queued for path: / 2024-09-19T06:24:03.497 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:03 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:24:03.497 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:03 smithi002 ceph-mon[30982]: scrub summary: active paths [/] 2024-09-19T06:24:03.497 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:03 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:24:03.497 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:03 smithi002 ceph-mon[30982]: pgmap v286: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:24:03.497 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:03 smithi002 ceph-mon[30982]: scrub summary: idle 2024-09-19T06:24:03.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.580+0000 7f2f2f45c640 1 -- 172.21.15.2:0/3892756644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f28074f40 msgr2=0x7f2f2810de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:03.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.580+0000 7f2f2f45c640 1 --2- 172.21.15.2:0/3892756644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f28074f40 0x7f2f2810de90 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f2f18009900 tx=0x7f2f1802a480 comp rx=0 tx=0).stop 2024-09-19T06:24:03.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.580+0000 7f2f2f45c640 1 -- 172.21.15.2:0/3892756644 shutdown_connections 2024-09-19T06:24:03.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.580+0000 7f2f2f45c640 1 --2- 172.21.15.2:0/3892756644 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f2810e3d0 0x7f2f28110820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:03.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.580+0000 7f2f2f45c640 1 --2- 172.21.15.2:0/3892756644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f28074f40 0x7f2f2810de90 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:03.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.580+0000 7f2f2f45c640 1 --2- 172.21.15.2:0/3892756644 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f28074620 0x7f2f28074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:03.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.580+0000 7f2f2f45c640 1 -- 172.21.15.2:0/3892756644 >> 172.21.15.2:0/3892756644 conn(0x7f2f280fd8b0 msgr2=0x7f2f280ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:03.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.580+0000 7f2f2f45c640 1 -- 172.21.15.2:0/3892756644 shutdown_connections 2024-09-19T06:24:03.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.580+0000 7f2f2f45c640 1 -- 172.21.15.2:0/3892756644 wait complete. 2024-09-19T06:24:03.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.580+0000 7f2f2f45c640 1 Processor -- start 2024-09-19T06:24:03.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.580+0000 7f2f2f45c640 1 -- start start 2024-09-19T06:24:03.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.581+0000 7f2f2f45c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f28074620 0x7f2f2819a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:03.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.581+0000 7f2f2f45c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f28074f40 0x7f2f2819aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:03.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.581+0000 7f2f2f45c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f2810e3d0 0x7f2f2819ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:03.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.581+0000 7f2f2f45c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2f28114000 con 0x7f2f28074620 2024-09-19T06:24:03.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.581+0000 7f2f2f45c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2f28113e80 con 0x7f2f2810e3d0 2024-09-19T06:24:03.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.581+0000 7f2f2f45c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2f28114180 con 0x7f2f28074f40 2024-09-19T06:24:03.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.581+0000 7f2f2d1f8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f28074620 0x7f2f2819a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:03.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.581+0000 7f2f2d1f8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f28074620 0x7f2f2819a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36982/0 (socket says 172.21.15.2:36982) 2024-09-19T06:24:03.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.581+0000 7f2f2d1f8640 1 -- 172.21.15.2:0/2467914830 learned_addr learned my addr 172.21.15.2:0/2467914830 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:03.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.581+0000 7f2f2c9f7640 1 --2- 172.21.15.2:0/2467914830 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f28074f40 0x7f2f2819aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:03.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.581+0000 7f2f2d9f9640 1 --2- 172.21.15.2:0/2467914830 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f2810e3d0 0x7f2f2819ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:03.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.581+0000 7f2f2d1f8640 1 -- 172.21.15.2:0/2467914830 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f28074f40 msgr2=0x7f2f2819aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:03.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.581+0000 7f2f2d1f8640 1 --2- 172.21.15.2:0/2467914830 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f28074f40 0x7f2f2819aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:03.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.581+0000 7f2f2d1f8640 1 -- 172.21.15.2:0/2467914830 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f2810e3d0 msgr2=0x7f2f2819ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:03.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.581+0000 7f2f2d1f8640 1 --2- 172.21.15.2:0/2467914830 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f2810e3d0 0x7f2f2819ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:03.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.581+0000 7f2f2d1f8640 1 -- 172.21.15.2:0/2467914830 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f2819f560 con 0x7f2f28074620 2024-09-19T06:24:03.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.581+0000 7f2f2d1f8640 1 --2- 172.21.15.2:0/2467914830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f28074620 0x7f2f2819a5b0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f2f2400d950 tx=0x7f2f2400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:03.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.581+0000 7f2f1e7fc640 1 -- 172.21.15.2:0/2467914830 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f24017070 con 0x7f2f28074620 2024-09-19T06:24:03.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.582+0000 7f2f1e7fc640 1 -- 172.21.15.2:0/2467914830 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2f24009c30 con 0x7f2f28074620 2024-09-19T06:24:03.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.582+0000 7f2f2f45c640 1 -- 172.21.15.2:0/2467914830 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f2819f850 con 0x7f2f28074620 2024-09-19T06:24:03.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.582+0000 7f2f1e7fc640 1 -- 172.21.15.2:0/2467914830 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f2400f620 con 0x7f2f28074620 2024-09-19T06:24:03.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.582+0000 7f2f2f45c640 1 -- 172.21.15.2:0/2467914830 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f281a7130 con 0x7f2f28074620 2024-09-19T06:24:03.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.584+0000 7f2f1e7fc640 1 -- 172.21.15.2:0/2467914830 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f2f240109a0 con 0x7f2f28074620 2024-09-19T06:24:03.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.584+0000 7f2f31835740 1 Processor -- start 2024-09-19T06:24:03.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.584+0000 7f2f31835740 1 -- start start 2024-09-19T06:24:03.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.585+0000 7f2f31835740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a9ff894a0 0x562a9ff89880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:03.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.585+0000 7f2f31835740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a9ff89dc0 0x562a9ff94140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:03.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.585+0000 7f2f31835740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562a9ff94680 0x562a9ff96a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:03.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.585+0000 7f2f31835740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562a9feef2e0 con 0x562a9ff894a0 2024-09-19T06:24:03.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.585+0000 7f2f31835740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562a9fe96ce0 con 0x562a9ff89dc0 2024-09-19T06:24:03.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.585+0000 7f2f31835740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562a9feeb2a0 con 0x562a9ff94680 2024-09-19T06:24:03.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.585+0000 7f2f1e7fc640 1 --2- 172.21.15.2:0/2467914830 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f2f140a3430 0x7f2f140a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:03.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.585+0000 7f2f2d9f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a9ff894a0 0x562a9ff89880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:03.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.585+0000 7f2f2d1f8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a9ff89dc0 0x562a9ff94140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:03.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.585+0000 7f2f2c9f7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562a9ff94680 0x562a9ff96a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:03.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.585+0000 7f2f2d1f8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a9ff89dc0 0x562a9ff94140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.2:55360/0 (socket says 172.21.15.2:55360) 2024-09-19T06:24:03.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.585+0000 7f2f2d1f8640 1 -- 172.21.15.2:0/3676070158 learned_addr learned my addr 172.21.15.2:0/3676070158 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:03.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.585+0000 7f2f1e7fc640 1 -- 172.21.15.2:0/2467914830 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f2f240cf850 con 0x7f2f28074620 2024-09-19T06:24:03.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.585+0000 7f2f2d9f9640 1 --2- 172.21.15.2:0/2467914830 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f2f140a3430 0x7f2f140a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:03.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.585+0000 7f2f2d1f8640 1 -- 172.21.15.2:0/3676070158 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562a9ff94680 msgr2=0x562a9ff96a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:03.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.585+0000 7f2f2d1f8640 1 --2- 172.21.15.2:0/3676070158 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562a9ff94680 0x562a9ff96a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:03.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.585+0000 7f2f2d1f8640 1 -- 172.21.15.2:0/3676070158 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a9ff894a0 msgr2=0x562a9ff89880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:03.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.585+0000 7f2f2d1f8640 1 --2- 172.21.15.2:0/3676070158 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a9ff894a0 0x562a9ff89880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:03.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.585+0000 7f2f2d1f8640 1 -- 172.21.15.2:0/3676070158 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a9fe7b440 con 0x562a9ff89dc0 2024-09-19T06:24:03.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.585+0000 7f2f2c9f7640 1 --2- 172.21.15.2:0/3676070158 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562a9ff94680 0x562a9ff96a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:24:03.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.586+0000 7f2f2d1f8640 1 --2- 172.21.15.2:0/3676070158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a9ff89dc0 0x562a9ff94140 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2f2409b8e0 tx=0x7f2f24091070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5f3e0f3e49eaa5c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:03.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.586+0000 7f2f2d9f9640 1 --2- 172.21.15.2:0/2467914830 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f2f140a3430 0x7f2f140a58f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2f200077f0 tx=0x7f2f20004ab0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:03.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.586+0000 7f2f137fe640 1 -- 172.21.15.2:0/3676070158 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f24020070 con 0x562a9ff89dc0 2024-09-19T06:24:03.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.586+0000 7f2f137fe640 1 -- 172.21.15.2:0/3676070158 <== mon.2 v2:172.21.15.89:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2f2409bbe0 con 0x562a9ff89dc0 2024-09-19T06:24:03.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.586+0000 7f2f137fe640 1 -- 172.21.15.2:0/3676070158 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f2409be40 con 0x562a9ff89dc0 2024-09-19T06:24:03.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.587+0000 7f2f31835740 1 -- 172.21.15.2:0/3676070158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a9ff89dc0 msgr2=0x562a9ff94140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:03.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.587+0000 7f2f31835740 1 --2- 172.21.15.2:0/3676070158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a9ff89dc0 0x562a9ff94140 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2f2409b8e0 tx=0x7f2f24091070 comp rx=0 tx=0).stop 2024-09-19T06:24:03.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.587+0000 7f2f31835740 1 -- 172.21.15.2:0/3676070158 shutdown_connections 2024-09-19T06:24:03.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.587+0000 7f2f31835740 1 --2- 172.21.15.2:0/3676070158 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562a9ff94680 0x562a9ff96a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:03.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.587+0000 7f2f31835740 1 --2- 172.21.15.2:0/3676070158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a9ff89dc0 0x562a9ff94140 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:03.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.587+0000 7f2f31835740 1 --2- 172.21.15.2:0/3676070158 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a9ff894a0 0x562a9ff89880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:03.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.587+0000 7f2f31835740 1 -- 172.21.15.2:0/3676070158 >> 172.21.15.2:0/3676070158 conn(0x562a9ff85a30 msgr2=0x562a9ff85e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:03.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.587+0000 7f2f31835740 1 -- 172.21.15.2:0/3676070158 shutdown_connections 2024-09-19T06:24:03.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.587+0000 7f2f31835740 1 -- 172.21.15.2:0/3676070158 wait complete. 2024-09-19T06:24:03.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.587+0000 7f2f31835740 1 -- start start 2024-09-19T06:24:03.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.587+0000 7f2f31835740 1 Processor -- start 2024-09-19T06:24:03.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.588+0000 7f2f31835740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562a9ff894a0 0x562a9ff93ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:03.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.588+0000 7f2f31835740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a9ff89dc0 0x562a9ff912a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:03.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.588+0000 7f2f31835740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a9ff94680 0x562a9ff91800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:03.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.588+0000 7f2f31835740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562a9ff97250 con 0x562a9ff89dc0 2024-09-19T06:24:03.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.588+0000 7f2f31835740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562a9feaa050 con 0x562a9ff94680 2024-09-19T06:24:03.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.588+0000 7f2f31835740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562a9ff973d0 con 0x562a9ff894a0 2024-09-19T06:24:03.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.588+0000 7f2f31835740 10 client.0 _ll_register_callbacks cb 0x562a9feea160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:03.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.588+0000 7f2f2c9f7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a9ff89dc0 0x562a9ff912a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:03.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.588+0000 7f2f2c9f7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a9ff89dc0 0x562a9ff912a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36996/0 (socket says 172.21.15.2:36996) 2024-09-19T06:24:03.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.588+0000 7f2f2c9f7640 1 -- 172.21.15.2:0/123376271 learned_addr learned my addr 172.21.15.2:0/123376271 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:03.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.588+0000 7f2f2d9f9640 1 --2- 172.21.15.2:0/123376271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a9ff94680 0x562a9ff91800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:03.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.588+0000 7f2f2d1f8640 1 --2- 172.21.15.2:0/123376271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562a9ff894a0 0x562a9ff93ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:03.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.588+0000 7f2f2c9f7640 1 -- 172.21.15.2:0/123376271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562a9ff894a0 msgr2=0x562a9ff93ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:03.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.588+0000 7f2f2c9f7640 1 --2- 172.21.15.2:0/123376271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562a9ff894a0 0x562a9ff93ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:03.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.588+0000 7f2f2c9f7640 1 -- 172.21.15.2:0/123376271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a9ff94680 msgr2=0x562a9ff91800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:03.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.588+0000 7f2f2c9f7640 1 --2- 172.21.15.2:0/123376271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a9ff94680 0x562a9ff91800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:03.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.588+0000 7f2f2c9f7640 1 -- 172.21.15.2:0/123376271 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a9fc603c0 con 0x562a9ff89dc0 2024-09-19T06:24:03.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.588+0000 7f2f2c9f7640 1 --2- 172.21.15.2:0/123376271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a9ff89dc0 0x562a9ff912a0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f2f18009900 tx=0x7f2f180316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e29d7cac19f993 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:03.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.588+0000 7f2f10ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:24:03.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.588+0000 7f2f10ff9640 1 -- 172.21.15.2:0/123376271 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f18035040 con 0x562a9ff89dc0 2024-09-19T06:24:03.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.589+0000 7f2f10ff9640 1 -- 172.21.15.2:0/123376271 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f2f18031cf0 con 0x562a9ff89dc0 2024-09-19T06:24:03.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.589+0000 7f2f31835740 1 -- 172.21.15.2:0/123376271 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f2409bbe0 con 0x562a9ff89dc0 2024-09-19T06:24:03.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.589+0000 7f2f10ff9640 1 -- 172.21.15.2:0/123376271 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2f18004040 con 0x562a9ff89dc0 2024-09-19T06:24:03.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.589+0000 7f2f31835740 10 client.18651 fetch_fsmap learned FSMap version 26 2024-09-19T06:24:03.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.589+0000 7f2f31835740 1 -- 172.21.15.2:0/123376271 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562a9ffa2c20 con 0x562a9ff89dc0 2024-09-19T06:24:03.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.589+0000 7f2f10ff9640 1 -- 172.21.15.2:0/123376271 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2f2409bbe0 con 0x562a9ff89dc0 2024-09-19T06:24:03.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.589+0000 7f2f10ff9640 1 -- 172.21.15.2:0/123376271 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f2f18004750 con 0x562a9ff89dc0 2024-09-19T06:24:03.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.589+0000 7f2f31835740 10 client.18651 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:24:03.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.589+0000 7f2f31835740 10 client.18651 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:24:03.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.589+0000 7f2f31835740 20 client.18651 populate_metadata read hostname 'smithi002' 2024-09-19T06:24:03.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.589+0000 7f2f31835740 1 --2- 172.21.15.2:0/123376271 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562a9ffa4130 0x562a9ffa6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:03.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.589+0000 7f2f31835740 4 client.18651 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:24:03.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.589+0000 7f2f31835740 1 -- 172.21.15.2:0/123376271 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a9fefc850 con 0x562a9ffa4130 2024-09-19T06:24:03.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.590+0000 7f2f2d1f8640 1 --2- 172.21.15.2:0/123376271 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562a9ffa4130 0x562a9ffa6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:03.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.590+0000 7f2f2d1f8640 1 --2- 172.21.15.2:0/123376271 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562a9ffa4130 0x562a9ffa6570 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21c209638ce54730 server_cookie=9ef7691b8e5024b3 in_seq=0 out_seq=0 2024-09-19T06:24:03.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.590+0000 7f2f10ff9640 10 client.18651 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:03.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.591+0000 7f2f10ff9640 1 -- 172.21.15.2:0/123376271 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562a9fefc850 con 0x562a9ffa4130 2024-09-19T06:24:03.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.591+0000 7f2f10ff9640 10 client.18651 handle_command_reply: tid=0 2024-09-19T06:24:03.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.591+0000 7f2f31835740 1 client.18651 shutdown 2024-09-19T06:24:03.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.591+0000 7f2f31835740 1 -- 172.21.15.2:0/123376271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a9ff89dc0 msgr2=0x562a9ff912a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:03.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.591+0000 7f2f31835740 1 --2- 172.21.15.2:0/123376271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a9ff89dc0 0x562a9ff912a0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f2f18009900 tx=0x7f2f180316d0 comp rx=0 tx=0).stop 2024-09-19T06:24:03.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.591+0000 7f2f31835740 1 -- 172.21.15.2:0/123376271 shutdown_connections 2024-09-19T06:24:03.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.591+0000 7f2f31835740 1 --2- 172.21.15.2:0/123376271 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562a9ffa4130 0x562a9ffa6570 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:03.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.591+0000 7f2f31835740 1 --2- 172.21.15.2:0/123376271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a9ff94680 0x562a9ff91800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:03.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.591+0000 7f2f31835740 1 --2- 172.21.15.2:0/123376271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a9ff89dc0 0x562a9ff912a0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:03.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.591+0000 7f2f10ff9640 0 client.18651 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:03.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.591+0000 7f2f31835740 1 --2- 172.21.15.2:0/123376271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562a9ff894a0 0x562a9ff93ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:03.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.591+0000 7f2f31835740 1 -- 172.21.15.2:0/123376271 >> 172.21.15.2:0/123376271 conn(0x562a9ff85a30 msgr2=0x562a9ff8b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:03.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.591+0000 7f2f31835740 1 -- 172.21.15.2:0/123376271 shutdown_connections 2024-09-19T06:24:03.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.591+0000 7f2f31835740 1 -- 172.21.15.2:0/123376271 wait complete. 2024-09-19T06:24:03.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.591+0000 7f2f31835740 20 client.18651 trim_cache size 0 max 16384 2024-09-19T06:24:03.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.608+0000 7f2f31835740 1 Processor -- start 2024-09-19T06:24:03.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.608+0000 7f2f31835740 1 -- start start 2024-09-19T06:24:03.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.608+0000 7f2f31835740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a9ff894a0 0x562a9ffa04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:03.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.608+0000 7f2f31835740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562a9ff89dc0 0x562a9ffabe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:03.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.608+0000 7f2f31835740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a9ff94680 0x562a9ffac380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:03.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.608+0000 7f2f31835740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2f281ade10 con 0x562a9ff94680 2024-09-19T06:24:03.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.608+0000 7f2f31835740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2f281ab6e0 con 0x562a9ff894a0 2024-09-19T06:24:03.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.608+0000 7f2f31835740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2f281a9550 con 0x562a9ff89dc0 2024-09-19T06:24:03.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.609+0000 7f2f2d9f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a9ff94680 0x562a9ffac380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:03.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.609+0000 7f2f2d9f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a9ff94680 0x562a9ffac380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36998/0 (socket says 172.21.15.2:36998) 2024-09-19T06:24:03.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.609+0000 7f2f2d9f9640 1 -- 172.21.15.2:0/1519536730 learned_addr learned my addr 172.21.15.2:0/1519536730 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:03.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.609+0000 7f2f2d1f8640 1 --2- 172.21.15.2:0/1519536730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a9ff894a0 0x562a9ffa04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:03.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.609+0000 7f2f2c9f7640 1 --2- 172.21.15.2:0/1519536730 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562a9ff89dc0 0x562a9ffabe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:03.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.609+0000 7f2f2d9f9640 1 -- 172.21.15.2:0/1519536730 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562a9ff89dc0 msgr2=0x562a9ffabe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:03.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.609+0000 7f2f2d9f9640 1 --2- 172.21.15.2:0/1519536730 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562a9ff89dc0 0x562a9ffabe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:03.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.609+0000 7f2f2d9f9640 1 -- 172.21.15.2:0/1519536730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a9ff894a0 msgr2=0x562a9ffa04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:03.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.609+0000 7f2f2d9f9640 1 --2- 172.21.15.2:0/1519536730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a9ff894a0 0x562a9ffa04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:03.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.609+0000 7f2f2d9f9640 1 -- 172.21.15.2:0/1519536730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a9ff866c0 con 0x562a9ff94680 2024-09-19T06:24:03.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.609+0000 7f2f2c9f7640 1 --2- 172.21.15.2:0/1519536730 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562a9ff89dc0 0x562a9ffabe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:24:03.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.609+0000 7f2f2d9f9640 1 --2- 172.21.15.2:0/1519536730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a9ff94680 0x562a9ffac380 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f2f20007f80 tx=0x7f2f20007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d976f732bce5fd4c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:03.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.609+0000 7f2f12ffd640 1 -- 172.21.15.2:0/1519536730 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f20025070 con 0x562a9ff94680 2024-09-19T06:24:03.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.609+0000 7f2f12ffd640 1 -- 172.21.15.2:0/1519536730 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2f20005020 con 0x562a9ff94680 2024-09-19T06:24:03.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.609+0000 7f2f12ffd640 1 -- 172.21.15.2:0/1519536730 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f20012670 con 0x562a9ff94680 2024-09-19T06:24:03.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.610+0000 7f2f31835740 1 -- 172.21.15.2:0/1519536730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a9ff94680 msgr2=0x562a9ffac380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:03.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.610+0000 7f2f31835740 1 --2- 172.21.15.2:0/1519536730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a9ff94680 0x562a9ffac380 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f2f20007f80 tx=0x7f2f20007780 comp rx=0 tx=0).stop 2024-09-19T06:24:03.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.610+0000 7f2f31835740 1 -- 172.21.15.2:0/1519536730 shutdown_connections 2024-09-19T06:24:03.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.610+0000 7f2f31835740 1 --2- 172.21.15.2:0/1519536730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a9ff94680 0x562a9ffac380 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:03.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.610+0000 7f2f31835740 1 --2- 172.21.15.2:0/1519536730 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562a9ff89dc0 0x562a9ffabe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:03.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.610+0000 7f2f31835740 1 --2- 172.21.15.2:0/1519536730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a9ff894a0 0x562a9ffa04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:03.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.610+0000 7f2f31835740 1 -- 172.21.15.2:0/1519536730 >> 172.21.15.2:0/1519536730 conn(0x562a9ff85a30 msgr2=0x562a9ff90390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:03.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.610+0000 7f2f31835740 1 -- 172.21.15.2:0/1519536730 shutdown_connections 2024-09-19T06:24:03.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.610+0000 7f2f31835740 1 -- 172.21.15.2:0/1519536730 wait complete. 2024-09-19T06:24:03.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.610+0000 7f2f31835740 1 -- start start 2024-09-19T06:24:03.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.610+0000 7f2f31835740 1 Processor -- start 2024-09-19T06:24:03.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.611+0000 7f2f31835740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a9ff894a0 0x562a9ff98290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:03.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.611+0000 7f2f31835740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a9ff89dc0 0x562a9ff987d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:03.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.611+0000 7f2f31835740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562a9ff94680 0x562a9ff98d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:03.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.611+0000 7f2f31835740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2f281a9ba0 con 0x562a9ff89dc0 2024-09-19T06:24:03.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.611+0000 7f2f31835740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2f281ab010 con 0x562a9ff894a0 2024-09-19T06:24:03.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.611+0000 7f2f31835740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2f281aa270 con 0x562a9ff94680 2024-09-19T06:24:03.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.611+0000 7f2f31835740 10 client.0 _ll_register_callbacks cb 0x7f2f18009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:03.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.611+0000 7f2f2c9f7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a9ff89dc0 0x562a9ff987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:03.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.611+0000 7f2f2c9f7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a9ff89dc0 0x562a9ff987d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37010/0 (socket says 172.21.15.2:37010) 2024-09-19T06:24:03.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.611+0000 7f2f2d1f8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a9ff894a0 0x562a9ff98290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:03.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.611+0000 7f2f2c9f7640 1 -- 172.21.15.2:0/4038048156 learned_addr learned my addr 172.21.15.2:0/4038048156 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:03.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.611+0000 7f2f2d9f9640 1 --2- 172.21.15.2:0/4038048156 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562a9ff94680 0x562a9ff98d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:03.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.611+0000 7f2f2c9f7640 1 -- 172.21.15.2:0/4038048156 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562a9ff94680 msgr2=0x562a9ff98d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:03.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.611+0000 7f2f2c9f7640 1 --2- 172.21.15.2:0/4038048156 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562a9ff94680 0x562a9ff98d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:03.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.611+0000 7f2f2c9f7640 1 -- 172.21.15.2:0/4038048156 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a9ff894a0 msgr2=0x562a9ff98290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:03.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.611+0000 7f2f2c9f7640 1 --2- 172.21.15.2:0/4038048156 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a9ff894a0 0x562a9ff98290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:03.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.611+0000 7f2f2c9f7640 1 -- 172.21.15.2:0/4038048156 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562aa000de10 con 0x562a9ff89dc0 2024-09-19T06:24:03.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.611+0000 7f2f2c9f7640 1 --2- 172.21.15.2:0/4038048156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a9ff89dc0 0x562a9ff987d0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f2f1802a9a0 tx=0x7f2f18032fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b25d3fd0469ee7eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:03.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.611+0000 7f2f10ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:24:03.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.612+0000 7f2f10ff9640 1 -- 172.21.15.2:0/4038048156 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f18035070 con 0x562a9ff89dc0 2024-09-19T06:24:03.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.612+0000 7f2f10ff9640 1 -- 172.21.15.2:0/4038048156 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f2f18031a50 con 0x562a9ff89dc0 2024-09-19T06:24:03.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.612+0000 7f2f31835740 1 -- 172.21.15.2:0/4038048156 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f20005020 con 0x562a9ff89dc0 2024-09-19T06:24:03.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.612+0000 7f2f10ff9640 1 -- 172.21.15.2:0/4038048156 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2f18052040 con 0x562a9ff89dc0 2024-09-19T06:24:03.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.612+0000 7f2f31835740 10 client.18657 fetch_fsmap learned FSMap version 26 2024-09-19T06:24:03.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.612+0000 7f2f31835740 1 -- 172.21.15.2:0/4038048156 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562aa000f020 con 0x562a9ff89dc0 2024-09-19T06:24:03.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.612+0000 7f2f10ff9640 1 -- 172.21.15.2:0/4038048156 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2f20005020 con 0x562a9ff89dc0 2024-09-19T06:24:03.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.612+0000 7f2f10ff9640 1 -- 172.21.15.2:0/4038048156 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f2f18004d90 con 0x562a9ff89dc0 2024-09-19T06:24:03.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.612+0000 7f2f31835740 10 client.18657 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:24:03.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.612+0000 7f2f31835740 10 client.18657 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:24:03.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.612+0000 7f2f31835740 20 client.18657 populate_metadata read hostname 'smithi002' 2024-09-19T06:24:03.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.612+0000 7f2f31835740 1 --2- 172.21.15.2:0/4038048156 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562aa000f690 0x562aa0011a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:03.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.612+0000 7f2f31835740 4 client.18657 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:24:03.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.612+0000 7f2f31835740 1 -- 172.21.15.2:0/4038048156 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562a9fef6d60 con 0x562aa000f690 2024-09-19T06:24:03.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.613+0000 7f2f2d1f8640 1 --2- 172.21.15.2:0/4038048156 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562aa000f690 0x562aa0011a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:03.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.613+0000 7f2f2d1f8640 1 --2- 172.21.15.2:0/4038048156 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562aa000f690 0x562aa0011a80 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79d5e9ee2e8c6fa9 server_cookie=a7fb70e9397897d9 in_seq=0 out_seq=0 2024-09-19T06:24:03.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.613+0000 7f2f10ff9640 10 client.18657 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:03.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.613+0000 7f2f10ff9640 1 -- 172.21.15.2:0/4038048156 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x562a9fef6d60 con 0x562aa000f690 2024-09-19T06:24:03.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.613+0000 7f2f10ff9640 10 client.18657 handle_command_reply: tid=0 2024-09-19T06:24:03.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.613+0000 7f2f31835740 1 client.18657 shutdown 2024-09-19T06:24:03.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.613+0000 7f2f31835740 1 -- 172.21.15.2:0/4038048156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a9ff89dc0 msgr2=0x562a9ff987d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:03.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.613+0000 7f2f31835740 1 --2- 172.21.15.2:0/4038048156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a9ff89dc0 0x562a9ff987d0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f2f1802a9a0 tx=0x7f2f18032fc0 comp rx=0 tx=0).stop 2024-09-19T06:24:03.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.613+0000 7f2f31835740 1 -- 172.21.15.2:0/4038048156 shutdown_connections 2024-09-19T06:24:03.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.613+0000 7f2f31835740 1 --2- 172.21.15.2:0/4038048156 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562a9ff94680 0x562a9ff98d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:03.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.613+0000 7f2f31835740 1 --2- 172.21.15.2:0/4038048156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562a9ff89dc0 0x562a9ff987d0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:03.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.613+0000 7f2f31835740 1 --2- 172.21.15.2:0/4038048156 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x562aa000f690 0x562aa0011a80 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:03.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.613+0000 7f2f31835740 1 --2- 172.21.15.2:0/4038048156 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a9ff894a0 0x562a9ff98290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:03.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.613+0000 7f2f10ff9640 0 client.18657 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:03.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.613+0000 7f2f31835740 1 -- 172.21.15.2:0/4038048156 >> 172.21.15.2:0/4038048156 conn(0x562a9ff85a30 msgr2=0x562a9ff92b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:03.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.614+0000 7f2f31835740 1 -- 172.21.15.2:0/4038048156 shutdown_connections 2024-09-19T06:24:03.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.614+0000 7f2f31835740 1 -- 172.21.15.2:0/4038048156 wait complete. 2024-09-19T06:24:03.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.614+0000 7f2f31835740 20 client.18657 trim_cache size 0 max 16384 2024-09-19T06:24:03.621 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:24:03.621 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T06:24:03.621 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T06:24:03.621 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:24:03.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.614+0000 7f2f2f45c640 1 -- 172.21.15.2:0/2467914830 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f2f140a3430 msgr2=0x7f2f140a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:03.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.614+0000 7f2f2f45c640 1 --2- 172.21.15.2:0/2467914830 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f2f140a3430 0x7f2f140a58f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2f200077f0 tx=0x7f2f20004ab0 comp rx=0 tx=0).stop 2024-09-19T06:24:03.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.614+0000 7f2f2f45c640 1 -- 172.21.15.2:0/2467914830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f28074620 msgr2=0x7f2f2819a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:03.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.614+0000 7f2f2f45c640 1 --2- 172.21.15.2:0/2467914830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f28074620 0x7f2f2819a5b0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f2f2400d950 tx=0x7f2f2400de10 comp rx=0 tx=0).stop 2024-09-19T06:24:03.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.614+0000 7f2f2f45c640 1 -- 172.21.15.2:0/2467914830 shutdown_connections 2024-09-19T06:24:03.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.614+0000 7f2f2f45c640 1 --2- 172.21.15.2:0/2467914830 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f2f140a3430 0x7f2f140a58f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:03.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.614+0000 7f2f2f45c640 1 --2- 172.21.15.2:0/2467914830 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f2810e3d0 0x7f2f2819ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:03.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.614+0000 7f2f2f45c640 1 --2- 172.21.15.2:0/2467914830 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f28074f40 0x7f2f2819aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:03.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.614+0000 7f2f2f45c640 1 --2- 172.21.15.2:0/2467914830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f28074620 0x7f2f2819a5b0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:03.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.614+0000 7f2f2f45c640 1 -- 172.21.15.2:0/2467914830 >> 172.21.15.2:0/2467914830 conn(0x7f2f280fd8b0 msgr2=0x7f2f280ff0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:03.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.614+0000 7f2f2f45c640 1 -- 172.21.15.2:0/2467914830 shutdown_connections 2024-09-19T06:24:03.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:03.614+0000 7f2f2f45c640 1 -- 172.21.15.2:0/2467914830 wait complete. 2024-09-19T06:24:03.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:03 smithi090 ceph-mon[34497]: scrub queued for path: / 2024-09-19T06:24:03.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:03 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:24:03.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:03 smithi090 ceph-mon[34497]: scrub summary: active paths [/] 2024-09-19T06:24:03.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:03 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:24:03.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:03 smithi090 ceph-mon[34497]: pgmap v286: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:24:03.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:03 smithi090 ceph-mon[34497]: scrub summary: idle 2024-09-19T06:24:03.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:03 smithi089 ceph-mon[34160]: scrub queued for path: / 2024-09-19T06:24:03.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:03 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:24:03.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:03 smithi089 ceph-mon[34160]: scrub summary: active paths [/] 2024-09-19T06:24:03.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:03 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:24:03.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:03 smithi089 ceph-mon[34160]: pgmap v286: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:24:03.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:03 smithi089 ceph-mon[34160]: scrub summary: idle 2024-09-19T06:24:04.435 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:24:04.436 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:24:04.695 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:24:05.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.105+0000 7f7854447640 1 -- 172.21.15.2:0/3390657085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f784c100e20 msgr2=0x7f784c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:05.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.105+0000 7f7854447640 1 --2- 172.21.15.2:0/3390657085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f784c100e20 0x7f784c101200 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f7848009900 tx=0x7f784802a480 comp rx=0 tx=0).stop 2024-09-19T06:24:05.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.105+0000 7f7854447640 1 -- 172.21.15.2:0/3390657085 shutdown_connections 2024-09-19T06:24:05.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.105+0000 7f7854447640 1 --2- 172.21.15.2:0/3390657085 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f784c102ef0 0x7f784c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:05.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.105+0000 7f7854447640 1 --2- 172.21.15.2:0/3390657085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f784c102570 0x7f784c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:05.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.105+0000 7f7854447640 1 --2- 172.21.15.2:0/3390657085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f784c100e20 0x7f784c101200 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:05.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.105+0000 7f7854447640 1 -- 172.21.15.2:0/3390657085 >> 172.21.15.2:0/3390657085 conn(0x7f784c0fc7d0 msgr2=0x7f784c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:05.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.105+0000 7f7854447640 1 -- 172.21.15.2:0/3390657085 shutdown_connections 2024-09-19T06:24:05.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.106+0000 7f7854447640 1 -- 172.21.15.2:0/3390657085 wait complete. 2024-09-19T06:24:05.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.106+0000 7f7854447640 1 Processor -- start 2024-09-19T06:24:05.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.106+0000 7f7854447640 1 -- start start 2024-09-19T06:24:05.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.107+0000 7f7854447640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f784c100e20 0x7f784c198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:05.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.107+0000 7f7854447640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f784c102570 0x7f784c198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:05.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.107+0000 7f7854447640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f784c102ef0 0x7f784c19cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:05.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.107+0000 7f7854447640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f784c111ef0 con 0x7f784c100e20 2024-09-19T06:24:05.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.107+0000 7f7854447640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f784c111d70 con 0x7f784c102570 2024-09-19T06:24:05.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.107+0000 7f7854447640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f784c112070 con 0x7f784c102ef0 2024-09-19T06:24:05.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.107+0000 7f78521e3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f784c100e20 0x7f784c198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:05.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.107+0000 7f78521e3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f784c100e20 0x7f784c198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37030/0 (socket says 172.21.15.2:37030) 2024-09-19T06:24:05.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.107+0000 7f78521e3640 1 -- 172.21.15.2:0/3412667037 learned_addr learned my addr 172.21.15.2:0/3412667037 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:05.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.107+0000 7f78519e2640 1 --2- 172.21.15.2:0/3412667037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f784c102570 0x7f784c198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:05.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.107+0000 7f78529e4640 1 --2- 172.21.15.2:0/3412667037 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f784c102ef0 0x7f784c19cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:05.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.107+0000 7f78521e3640 1 -- 172.21.15.2:0/3412667037 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f784c102ef0 msgr2=0x7f784c19cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:05.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.107+0000 7f78521e3640 1 --2- 172.21.15.2:0/3412667037 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f784c102ef0 0x7f784c19cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:05.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.107+0000 7f78521e3640 1 -- 172.21.15.2:0/3412667037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f784c102570 msgr2=0x7f784c198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:05.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.107+0000 7f78521e3640 1 --2- 172.21.15.2:0/3412667037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f784c102570 0x7f784c198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:05.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.107+0000 7f78521e3640 1 -- 172.21.15.2:0/3412667037 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f784c19d3c0 con 0x7f784c100e20 2024-09-19T06:24:05.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.107+0000 7f78519e2640 1 --2- 172.21.15.2:0/3412667037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f784c102570 0x7f784c198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:24:05.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.108+0000 7f78521e3640 1 --2- 172.21.15.2:0/3412667037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f784c100e20 0x7f784c198410 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f7848006010 tx=0x7f78480042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:05.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.108+0000 7f78437fe640 1 -- 172.21.15.2:0/3412667037 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f784803f030 con 0x7f784c100e20 2024-09-19T06:24:05.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.108+0000 7f7854447640 1 -- 172.21.15.2:0/3412667037 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f784c19d650 con 0x7f784c100e20 2024-09-19T06:24:05.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.108+0000 7f78437fe640 1 -- 172.21.15.2:0/3412667037 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7848003cb0 con 0x7f784c100e20 2024-09-19T06:24:05.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.108+0000 7f78437fe640 1 -- 172.21.15.2:0/3412667037 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7848035070 con 0x7f784c100e20 2024-09-19T06:24:05.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.108+0000 7f7854447640 1 -- 172.21.15.2:0/3412667037 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f784c1a4f90 con 0x7f784c100e20 2024-09-19T06:24:05.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.109+0000 7f7854447640 1 -- 172.21.15.2:0/3412667037 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f784c101200 con 0x7f784c100e20 2024-09-19T06:24:05.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.110+0000 7f78437fe640 1 -- 172.21.15.2:0/3412667037 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f7848042030 con 0x7f784c100e20 2024-09-19T06:24:05.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.111+0000 7f78437fe640 1 --2- 172.21.15.2:0/3412667037 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f78380a33b0 0x7f78380a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:05.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.111+0000 7f78519e2640 1 --2- 172.21.15.2:0/3412667037 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f78380a33b0 0x7f78380a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:05.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.111+0000 7f78437fe640 1 -- 172.21.15.2:0/3412667037 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f78480f04e0 con 0x7f784c100e20 2024-09-19T06:24:05.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.112+0000 7f78519e2640 1 --2- 172.21.15.2:0/3412667037 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f78380a33b0 0x7f78380a5870 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f784c0ffdf0 tx=0x7f783c00b410 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:05.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.114+0000 7f78437fe640 1 -- 172.21.15.2:0/3412667037 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f78480bcec0 con 0x7f784c100e20 2024-09-19T06:24:05.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.331+0000 7f7854447640 1 -- 172.21.15.2:0/3412667037 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f784c109090 con 0x7f784c100e20 2024-09-19T06:24:05.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.332+0000 7f78437fe640 1 -- 172.21.15.2:0/3412667037 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11882 (secure 0 0 0) 0x7f78480bc7c0 con 0x7f784c100e20 2024-09-19T06:24:05.334 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:24:05.334 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-09-19T06:14:49:104280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:14:48.191083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24470,24472,24497]},"id":1}]} 2024-09-19T06:24:05.334 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-09-19T06:24:05.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.334+0000 7f7854447640 1 -- 172.21.15.2:0/3412667037 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f78380a33b0 msgr2=0x7f78380a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:05.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.334+0000 7f7854447640 1 --2- 172.21.15.2:0/3412667037 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f78380a33b0 0x7f78380a5870 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f784c0ffdf0 tx=0x7f783c00b410 comp rx=0 tx=0).stop 2024-09-19T06:24:05.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.334+0000 7f7854447640 1 -- 172.21.15.2:0/3412667037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f784c100e20 msgr2=0x7f784c198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:05.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.334+0000 7f7854447640 1 --2- 172.21.15.2:0/3412667037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f784c100e20 0x7f784c198410 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f7848006010 tx=0x7f78480042f0 comp rx=0 tx=0).stop 2024-09-19T06:24:05.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.334+0000 7f7854447640 1 -- 172.21.15.2:0/3412667037 shutdown_connections 2024-09-19T06:24:05.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.334+0000 7f7854447640 1 --2- 172.21.15.2:0/3412667037 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f78380a33b0 0x7f78380a5870 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:05.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.334+0000 7f7854447640 1 --2- 172.21.15.2:0/3412667037 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f784c102ef0 0x7f784c19cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:05.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.334+0000 7f7854447640 1 --2- 172.21.15.2:0/3412667037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f784c102570 0x7f784c198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:05.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.334+0000 7f7854447640 1 --2- 172.21.15.2:0/3412667037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f784c100e20 0x7f784c198410 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:05.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.334+0000 7f7854447640 1 -- 172.21.15.2:0/3412667037 >> 172.21.15.2:0/3412667037 conn(0x7f784c0fc7d0 msgr2=0x7f784c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:05.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.334+0000 7f7854447640 1 -- 172.21.15.2:0/3412667037 shutdown_connections 2024-09-19T06:24:05.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:05.334+0000 7f7854447640 1 -- 172.21.15.2:0/3412667037 wait complete. 2024-09-19T06:24:05.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:05 smithi002 ceph-mon[30982]: pgmap v287: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-09-19T06:24:05.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:05 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:24:05.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:05 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:24:05.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:05 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:24:05.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:05 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:24:05.472 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:05 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/3412667037' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:24:05.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:05 smithi090 ceph-mon[34497]: pgmap v287: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-09-19T06:24:05.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:05 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:24:05.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:05 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:24:05.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:05 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:24:05.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:05 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:24:05.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:05 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/3412667037' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:24:05.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:05 smithi089 ceph-mon[34160]: pgmap v287: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-09-19T06:24:05.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:05 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:24:05.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:05 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:24:05.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:05 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:24:05.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:05 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:24:05.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:05 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/3412667037' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:24:05.974 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:24:06.234 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:24:06.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.679+0000 7fcc529d4640 1 -- 172.21.15.2:0/3935325682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc4c101de0 msgr2=0x7fcc4c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:06.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.679+0000 7fcc529d4640 1 --2- 172.21.15.2:0/3935325682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc4c101de0 0x7fcc4c1021c0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c009900 tx=0x7fcc3c02a410 comp rx=0 tx=0).stop 2024-09-19T06:24:06.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.679+0000 7fcc529d4640 1 -- 172.21.15.2:0/3935325682 shutdown_connections 2024-09-19T06:24:06.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.679+0000 7fcc529d4640 1 --2- 172.21.15.2:0/3935325682 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc4c106f10 0x7fcc4c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:06.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.679+0000 7fcc529d4640 1 --2- 172.21.15.2:0/3935325682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc4c102790 0x7fcc4c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:06.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.679+0000 7fcc529d4640 1 --2- 172.21.15.2:0/3935325682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc4c101de0 0x7fcc4c1021c0 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:06.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.679+0000 7fcc529d4640 1 -- 172.21.15.2:0/3935325682 >> 172.21.15.2:0/3935325682 conn(0x7fcc4c0fd8c0 msgr2=0x7fcc4c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:06.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.679+0000 7fcc529d4640 1 -- 172.21.15.2:0/3935325682 shutdown_connections 2024-09-19T06:24:06.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.679+0000 7fcc529d4640 1 -- 172.21.15.2:0/3935325682 wait complete. 2024-09-19T06:24:06.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.680+0000 7fcc529d4640 1 Processor -- start 2024-09-19T06:24:06.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.680+0000 7fcc529d4640 1 -- start start 2024-09-19T06:24:06.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.681+0000 7fcc529d4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc4c101de0 0x7fcc4c1982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:06.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.681+0000 7fcc529d4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc4c102790 0x7fcc4c198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:06.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.681+0000 7fcc529d4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc4c106f10 0x7fcc4c19cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:06.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.681+0000 7fcc529d4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4c111de0 con 0x7fcc4c106f10 2024-09-19T06:24:06.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.681+0000 7fcc529d4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4c111c60 con 0x7fcc4c102790 2024-09-19T06:24:06.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.681+0000 7fcc529d4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4c111f60 con 0x7fcc4c101de0 2024-09-19T06:24:06.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.681+0000 7fcc50f71640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc4c106f10 0x7fcc4c19cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:06.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.681+0000 7fcc50f71640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc4c106f10 0x7fcc4c19cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37368/0 (socket says 172.21.15.2:37368) 2024-09-19T06:24:06.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.681+0000 7fcc4b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc4c102790 0x7fcc4c198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:06.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.681+0000 7fcc50f71640 1 -- 172.21.15.2:0/3552287694 learned_addr learned my addr 172.21.15.2:0/3552287694 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:06.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.681+0000 7fcc4bfff640 1 --2- 172.21.15.2:0/3552287694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc4c101de0 0x7fcc4c1982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:06.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.681+0000 7fcc50f71640 1 -- 172.21.15.2:0/3552287694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc4c101de0 msgr2=0x7fcc4c1982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:06.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.681+0000 7fcc50f71640 1 --2- 172.21.15.2:0/3552287694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc4c101de0 0x7fcc4c1982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:06.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.681+0000 7fcc50f71640 1 -- 172.21.15.2:0/3552287694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc4c102790 msgr2=0x7fcc4c198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:06.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.681+0000 7fcc50f71640 1 --2- 172.21.15.2:0/3552287694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc4c102790 0x7fcc4c198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:06.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.681+0000 7fcc50f71640 1 -- 172.21.15.2:0/3552287694 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc4c19d2a0 con 0x7fcc4c106f10 2024-09-19T06:24:06.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.681+0000 7fcc4b7fe640 1 --2- 172.21.15.2:0/3552287694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc4c102790 0x7fcc4c198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:24:06.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.681+0000 7fcc50f71640 1 --2- 172.21.15.2:0/3552287694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc4c106f10 0x7fcc4c19cbc0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fcc4400cad0 tx=0x7fcc4400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:06.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.682+0000 7fcc497fa640 1 -- 172.21.15.2:0/3552287694 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc4400ad60 con 0x7fcc4c106f10 2024-09-19T06:24:06.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.682+0000 7fcc529d4640 1 -- 172.21.15.2:0/3552287694 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc4c19d590 con 0x7fcc4c106f10 2024-09-19T06:24:06.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.682+0000 7fcc497fa640 1 -- 172.21.15.2:0/3552287694 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcc44005020 con 0x7fcc4c106f10 2024-09-19T06:24:06.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.682+0000 7fcc497fa640 1 -- 172.21.15.2:0/3552287694 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc4400f6b0 con 0x7fcc4c106f10 2024-09-19T06:24:06.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.682+0000 7fcc529d4640 1 -- 172.21.15.2:0/3552287694 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc4c1a4e70 con 0x7fcc4c106f10 2024-09-19T06:24:06.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.684+0000 7fcc497fa640 1 -- 172.21.15.2:0/3552287694 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fcc440051d0 con 0x7fcc4c106f10 2024-09-19T06:24:06.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.684+0000 7fcc54dad740 1 Processor -- start 2024-09-19T06:24:06.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.684+0000 7fcc54dad740 1 -- start start 2024-09-19T06:24:06.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.684+0000 7fcc54dad740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e7504d5b40 0x55e7504d4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:06.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.684+0000 7fcc54dad740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7504d45d0 0x55e7504d4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:06.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.685+0000 7fcc54dad740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e7504df370 0x55e7504e1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:06.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.685+0000 7fcc54dad740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e75043a2f0 con 0x55e7504d45d0 2024-09-19T06:24:06.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.685+0000 7fcc54dad740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55e7503e1cf0 con 0x55e7504df370 2024-09-19T06:24:06.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.685+0000 7fcc54dad740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55e7504362b0 con 0x55e7504d5b40 2024-09-19T06:24:06.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.685+0000 7fcc4bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7504d45d0 0x55e7504d4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:06.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.685+0000 7fcc4bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7504d45d0 0x55e7504d4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37378/0 (socket says 172.21.15.2:37378) 2024-09-19T06:24:06.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.685+0000 7fcc4bfff640 1 -- 172.21.15.2:0/2107075713 learned_addr learned my addr 172.21.15.2:0/2107075713 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:06.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.685+0000 7fcc497fa640 1 --2- 172.21.15.2:0/3552287694 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fcc340a33b0 0x7fcc340a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:06.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.685+0000 7fcc4b7fe640 1 --2- 172.21.15.2:0/2107075713 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e7504df370 0x55e7504e1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:06.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.685+0000 7fcc4b7fe640 1 --2- 172.21.15.2:0/2107075713 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e7504d5b40 0x55e7504d4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:06.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.685+0000 7fcc50f71640 1 --2- 172.21.15.2:0/3552287694 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fcc340a33b0 0x7fcc340a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:06.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.685+0000 7fcc4bfff640 1 -- 172.21.15.2:0/2107075713 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e7504d5b40 msgr2=0x55e7504d4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:06.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.685+0000 7fcc4bfff640 1 --2- 172.21.15.2:0/2107075713 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e7504d5b40 0x55e7504d4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:06.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.685+0000 7fcc4bfff640 1 -- 172.21.15.2:0/2107075713 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e7504df370 msgr2=0x55e7504e1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:06.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.685+0000 7fcc497fa640 1 -- 172.21.15.2:0/3552287694 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7fcc440cfc70 con 0x7fcc4c106f10 2024-09-19T06:24:06.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.685+0000 7fcc4bfff640 1 --2- 172.21.15.2:0/2107075713 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e7504df370 0x55e7504e1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:06.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.685+0000 7fcc4bfff640 1 -- 172.21.15.2:0/2107075713 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7503c63a0 con 0x55e7504d45d0 2024-09-19T06:24:06.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.685+0000 7fcc4bfff640 1 --2- 172.21.15.2:0/2107075713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7504d45d0 0x55e7504d4a10 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c009900 tx=0x7fcc3c031dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3341ea220bddcbb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:06.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.686+0000 7fcc327fc640 1 -- 172.21.15.2:0/2107075713 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c040070 con 0x55e7504d45d0 2024-09-19T06:24:06.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.686+0000 7fcc50f71640 1 --2- 172.21.15.2:0/3552287694 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fcc340a33b0 0x7fcc340a5870 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fcc440cd9c0 tx=0x7fcc4401baf0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:06.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.686+0000 7fcc327fc640 1 -- 172.21.15.2:0/2107075713 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcc3c0316a0 con 0x55e7504d45d0 2024-09-19T06:24:06.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.686+0000 7fcc327fc640 1 -- 172.21.15.2:0/2107075713 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c035040 con 0x55e7504d45d0 2024-09-19T06:24:06.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.686+0000 7fcc54dad740 1 -- 172.21.15.2:0/2107075713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7504d45d0 msgr2=0x55e7504d4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:06.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.686+0000 7fcc54dad740 1 --2- 172.21.15.2:0/2107075713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7504d45d0 0x55e7504d4a10 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c009900 tx=0x7fcc3c031dc0 comp rx=0 tx=0).stop 2024-09-19T06:24:06.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.686+0000 7fcc54dad740 1 -- 172.21.15.2:0/2107075713 shutdown_connections 2024-09-19T06:24:06.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.686+0000 7fcc54dad740 1 --2- 172.21.15.2:0/2107075713 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e7504df370 0x55e7504e1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:06.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.686+0000 7fcc54dad740 1 --2- 172.21.15.2:0/2107075713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7504d45d0 0x55e7504d4a10 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:06.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.686+0000 7fcc54dad740 1 --2- 172.21.15.2:0/2107075713 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e7504d5b40 0x55e7504d4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:06.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.686+0000 7fcc54dad740 1 -- 172.21.15.2:0/2107075713 >> 172.21.15.2:0/2107075713 conn(0x55e75049d310 msgr2=0x55e7504d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:06.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.686+0000 7fcc54dad740 1 -- 172.21.15.2:0/2107075713 shutdown_connections 2024-09-19T06:24:06.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.686+0000 7fcc54dad740 1 -- 172.21.15.2:0/2107075713 wait complete. 2024-09-19T06:24:06.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.687+0000 7fcc54dad740 1 -- start start 2024-09-19T06:24:06.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.687+0000 7fcc54dad740 1 Processor -- start 2024-09-19T06:24:06.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.687+0000 7fcc54dad740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e7504d45d0 0x55e7504ded90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:06.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.687+0000 7fcc54dad740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e7504d5b40 0x55e7504dc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:06.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.687+0000 7fcc54dad740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7504df370 0x55e7504dc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:06.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.687+0000 7fcc54dad740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e7504e2010 con 0x55e7504df370 2024-09-19T06:24:06.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.687+0000 7fcc54dad740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55e7503f5060 con 0x55e7504d5b40 2024-09-19T06:24:06.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.687+0000 7fcc54dad740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55e7504e2190 con 0x55e7504d45d0 2024-09-19T06:24:06.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.687+0000 7fcc54dad740 10 client.0 _ll_register_callbacks cb 0x55e7501488c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:06.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.687+0000 7fcc4b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7504df370 0x55e7504dc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:06.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.687+0000 7fcc4b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7504df370 0x55e7504dc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37394/0 (socket says 172.21.15.2:37394) 2024-09-19T06:24:06.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.687+0000 7fcc4b7fe640 1 -- 172.21.15.2:0/3648651638 learned_addr learned my addr 172.21.15.2:0/3648651638 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:06.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.688+0000 7fcc4bfff640 1 --2- 172.21.15.2:0/3648651638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e7504d5b40 0x55e7504dc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:06.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.688+0000 7fcc4b7fe640 1 --2- 172.21.15.2:0/3648651638 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e7504d45d0 0x55e7504ded90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:06.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.688+0000 7fcc4b7fe640 1 -- 172.21.15.2:0/3648651638 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e7504d45d0 msgr2=0x55e7504ded90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:06.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.688+0000 7fcc4b7fe640 1 --2- 172.21.15.2:0/3648651638 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e7504d45d0 0x55e7504ded90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:06.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.688+0000 7fcc4b7fe640 1 -- 172.21.15.2:0/3648651638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e7504d5b40 msgr2=0x55e7504dc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:06.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.688+0000 7fcc4b7fe640 1 --2- 172.21.15.2:0/3648651638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e7504d5b40 0x55e7504dc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:06.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.688+0000 7fcc4b7fe640 1 -- 172.21.15.2:0/3648651638 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7501ab3c0 con 0x55e7504df370 2024-09-19T06:24:06.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.688+0000 7fcc4b7fe640 1 --2- 172.21.15.2:0/3648651638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7504df370 0x55e7504dc650 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fcc4000f760 tx=0x7fcc40013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f10c32a16b731093 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:06.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.688+0000 7fcc2b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:24:06.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.688+0000 7fcc2b7fe640 1 -- 172.21.15.2:0/3648651638 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc40024060 con 0x55e7504df370 2024-09-19T06:24:06.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.688+0000 7fcc2b7fe640 1 -- 172.21.15.2:0/3648651638 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7fcc4000d900 con 0x55e7504df370 2024-09-19T06:24:06.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.688+0000 7fcc54dad740 1 -- 172.21.15.2:0/3648651638 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc3c0316a0 con 0x55e7504df370 2024-09-19T06:24:06.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.688+0000 7fcc2b7fe640 1 -- 172.21.15.2:0/3648651638 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fcc4000db00 con 0x55e7504df370 2024-09-19T06:24:06.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.688+0000 7fcc54dad740 10 client.18675 fetch_fsmap learned FSMap version 26 2024-09-19T06:24:06.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.688+0000 7fcc54dad740 1 -- 172.21.15.2:0/3648651638 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55e7504edb40 con 0x55e7504df370 2024-09-19T06:24:06.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.689+0000 7fcc2b7fe640 1 -- 172.21.15.2:0/3648651638 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcc3c0316a0 con 0x55e7504df370 2024-09-19T06:24:06.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.689+0000 7fcc2b7fe640 1 -- 172.21.15.2:0/3648651638 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fcc4001fc20 con 0x55e7504df370 2024-09-19T06:24:06.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.689+0000 7fcc54dad740 10 client.18675 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:24:06.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.689+0000 7fcc54dad740 10 client.18675 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:24:06.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.689+0000 7fcc54dad740 20 client.18675 populate_metadata read hostname 'smithi002' 2024-09-19T06:24:06.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.689+0000 7fcc54dad740 1 --2- 172.21.15.2:0/3648651638 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55e7504ef000 0x55e7504f1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:06.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.689+0000 7fcc54dad740 4 client.18675 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:24:06.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.689+0000 7fcc54dad740 1 -- 172.21.15.2:0/3648651638 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e750447860 con 0x55e7504ef000 2024-09-19T06:24:06.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.689+0000 7fcc4bfff640 1 --2- 172.21.15.2:0/3648651638 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55e7504ef000 0x55e7504f1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:06.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.690+0000 7fcc4bfff640 1 --2- 172.21.15.2:0/3648651638 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55e7504ef000 0x55e7504f1410 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a1eef8b4985af4f8 server_cookie=98f6f692179264a6 in_seq=0 out_seq=0 2024-09-19T06:24:06.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.690+0000 7fcc2b7fe640 10 client.18675 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:24:06.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.690+0000 7fcc2b7fe640 1 -- 172.21.15.2:0/3648651638 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e750447860 con 0x55e7504ef000 2024-09-19T06:24:06.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.690+0000 7fcc2b7fe640 10 client.18675 handle_command_reply: tid=0 2024-09-19T06:24:06.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.690+0000 7fcc54dad740 1 client.18675 shutdown 2024-09-19T06:24:06.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.690+0000 7fcc54dad740 1 -- 172.21.15.2:0/3648651638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7504df370 msgr2=0x55e7504dc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:06.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.690+0000 7fcc54dad740 1 --2- 172.21.15.2:0/3648651638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7504df370 0x55e7504dc650 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fcc4000f760 tx=0x7fcc40013040 comp rx=0 tx=0).stop 2024-09-19T06:24:06.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.691+0000 7fcc54dad740 1 -- 172.21.15.2:0/3648651638 shutdown_connections 2024-09-19T06:24:06.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.691+0000 7fcc54dad740 1 --2- 172.21.15.2:0/3648651638 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55e7504ef000 0x55e7504f1410 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:06.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.691+0000 7fcc54dad740 1 --2- 172.21.15.2:0/3648651638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7504df370 0x55e7504dc650 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:06.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.691+0000 7fcc54dad740 1 --2- 172.21.15.2:0/3648651638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e7504d5b40 0x55e7504dc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:06.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.691+0000 7fcc54dad740 1 --2- 172.21.15.2:0/3648651638 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e7504d45d0 0x55e7504ded90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:06.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.691+0000 7fcc54dad740 1 -- 172.21.15.2:0/3648651638 >> 172.21.15.2:0/3648651638 conn(0x55e75049d310 msgr2=0x55e7504d6960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:06.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.691+0000 7fcc2b7fe640 0 client.18675 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:24:06.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.691+0000 7fcc54dad740 1 -- 172.21.15.2:0/3648651638 shutdown_connections 2024-09-19T06:24:06.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.691+0000 7fcc54dad740 1 -- 172.21.15.2:0/3648651638 wait complete. 2024-09-19T06:24:06.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.691+0000 7fcc54dad740 20 client.18675 trim_cache size 0 max 16384 2024-09-19T06:24:06.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.704+0000 7fcc54dad740 1 Processor -- start 2024-09-19T06:24:06.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.704+0000 7fcc54dad740 1 -- start start 2024-09-19T06:24:06.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.704+0000 7fcc54dad740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7504d45d0 0x55e7504ddfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:06.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.704+0000 7fcc54dad740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e7504d5b40 0x55e7504d7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:06.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.704+0000 7fcc54dad740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e7504df370 0x55e7504d7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:06.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.704+0000 7fcc54dad740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4c1ade30 con 0x55e7504d45d0 2024-09-19T06:24:06.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.704+0000 7fcc54dad740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4c1ab700 con 0x55e7504df370 2024-09-19T06:24:06.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.704+0000 7fcc54dad740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4c1a9570 con 0x55e7504d5b40 2024-09-19T06:24:06.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.704+0000 7fcc4b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7504d45d0 0x55e7504ddfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:06.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.704+0000 7fcc4b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7504d45d0 0x55e7504ddfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37400/0 (socket says 172.21.15.2:37400) 2024-09-19T06:24:06.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.704+0000 7fcc4b7fe640 1 -- 172.21.15.2:0/1843280556 learned_addr learned my addr 172.21.15.2:0/1843280556 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:06.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.704+0000 7fcc4bfff640 1 --2- 172.21.15.2:0/1843280556 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e7504d5b40 0x55e7504d7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:06.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.704+0000 7fcc4b7fe640 1 -- 172.21.15.2:0/1843280556 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e7504d5b40 msgr2=0x55e7504d7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:06.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.704+0000 7fcc4b7fe640 1 --2- 172.21.15.2:0/1843280556 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e7504d5b40 0x55e7504d7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:06.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.704+0000 7fcc4b7fe640 1 -- 172.21.15.2:0/1843280556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e7504df370 msgr2=0x55e7504d7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:06.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.704+0000 7fcc4b7fe640 1 --2- 172.21.15.2:0/1843280556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e7504df370 0x55e7504d7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:06.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.704+0000 7fcc4b7fe640 1 -- 172.21.15.2:0/1843280556 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7504db010 con 0x55e7504d45d0 2024-09-19T06:24:06.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.705+0000 7fcc4b7fe640 1 --2- 172.21.15.2:0/1843280556 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7504d45d0 0x55e7504ddfb0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fcc4001e4f0 tx=0x7fcc4000ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd5b5c19bc8d6110 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:06.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.705+0000 7fcc31ffb640 1 -- 172.21.15.2:0/1843280556 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc4000d900 con 0x55e7504d45d0 2024-09-19T06:24:06.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.705+0000 7fcc31ffb640 1 -- 172.21.15.2:0/1843280556 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcc4001eda0 con 0x55e7504d45d0 2024-09-19T06:24:06.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.705+0000 7fcc31ffb640 1 -- 172.21.15.2:0/1843280556 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc40005280 con 0x55e7504d45d0 2024-09-19T06:24:06.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.705+0000 7fcc54dad740 1 -- 172.21.15.2:0/1843280556 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7504d45d0 msgr2=0x55e7504ddfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:06.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.705+0000 7fcc54dad740 1 --2- 172.21.15.2:0/1843280556 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7504d45d0 0x55e7504ddfb0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fcc4001e4f0 tx=0x7fcc4000ace0 comp rx=0 tx=0).stop 2024-09-19T06:24:06.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.705+0000 7fcc54dad740 1 -- 172.21.15.2:0/1843280556 shutdown_connections 2024-09-19T06:24:06.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.705+0000 7fcc54dad740 1 --2- 172.21.15.2:0/1843280556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e7504df370 0x55e7504d7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:06.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.705+0000 7fcc54dad740 1 --2- 172.21.15.2:0/1843280556 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e7504d5b40 0x55e7504d7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:06.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.705+0000 7fcc54dad740 1 --2- 172.21.15.2:0/1843280556 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7504d45d0 0x55e7504ddfb0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:06.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.705+0000 7fcc54dad740 1 -- 172.21.15.2:0/1843280556 >> 172.21.15.2:0/1843280556 conn(0x55e75049d310 msgr2=0x55e7504dd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:06.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.706+0000 7fcc54dad740 1 -- 172.21.15.2:0/1843280556 shutdown_connections 2024-09-19T06:24:06.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.706+0000 7fcc54dad740 1 -- 172.21.15.2:0/1843280556 wait complete. 2024-09-19T06:24:06.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.706+0000 7fcc54dad740 1 -- start start 2024-09-19T06:24:06.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.706+0000 7fcc54dad740 1 Processor -- start 2024-09-19T06:24:06.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.706+0000 7fcc54dad740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e7504d45d0 0x55e7504e7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:06.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.706+0000 7fcc54dad740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7504d5b40 0x55e7504d8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:06.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.706+0000 7fcc54dad740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e7504df370 0x55e7504d9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:06.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.706+0000 7fcc54dad740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4c1a9bc0 con 0x55e7504d5b40 2024-09-19T06:24:06.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.706+0000 7fcc54dad740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4c1ab030 con 0x55e7504df370 2024-09-19T06:24:06.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.706+0000 7fcc54dad740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4c1aa290 con 0x55e7504d45d0 2024-09-19T06:24:06.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.706+0000 7fcc54dad740 10 client.0 _ll_register_callbacks cb 0x7fcc400114c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:06.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.706+0000 7fcc4bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7504d5b40 0x55e7504d8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:06.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.707+0000 7fcc4bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7504d5b40 0x55e7504d8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37406/0 (socket says 172.21.15.2:37406) 2024-09-19T06:24:06.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.707+0000 7fcc4bfff640 1 -- 172.21.15.2:0/312252770 learned_addr learned my addr 172.21.15.2:0/312252770 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:06.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.707+0000 7fcc4b7fe640 1 --2- 172.21.15.2:0/312252770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e7504df370 0x55e7504d9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:06.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.707+0000 7fcc4b7fe640 1 --2- 172.21.15.2:0/312252770 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e7504d45d0 0x55e7504e7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:06.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.707+0000 7fcc4bfff640 1 -- 172.21.15.2:0/312252770 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e7504d45d0 msgr2=0x55e7504e7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:06.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.707+0000 7fcc4bfff640 1 --2- 172.21.15.2:0/312252770 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e7504d45d0 0x55e7504e7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:06.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.707+0000 7fcc4bfff640 1 -- 172.21.15.2:0/312252770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e7504df370 msgr2=0x55e7504d9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:06.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.707+0000 7fcc4bfff640 1 --2- 172.21.15.2:0/312252770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e7504df370 0x55e7504d9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:06.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.707+0000 7fcc4bfff640 1 -- 172.21.15.2:0/312252770 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7504d9950 con 0x55e7504d5b40 2024-09-19T06:24:06.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.707+0000 7fcc4b7fe640 1 --2- 172.21.15.2:0/312252770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e7504df370 0x55e7504d9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:24:06.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.707+0000 7fcc4bfff640 1 --2- 172.21.15.2:0/312252770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7504d5b40 0x55e7504d8cd0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c009900 tx=0x7fcc3c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28475f872a845ea3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:06.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.707+0000 7fcc2b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:24:06.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.707+0000 7fcc2b7fe640 1 -- 172.21.15.2:0/312252770 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c058060 con 0x55e7504d5b40 2024-09-19T06:24:06.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.707+0000 7fcc2b7fe640 1 -- 172.21.15.2:0/312252770 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7fcc3c03c440 con 0x55e7504d5b40 2024-09-19T06:24:06.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.707+0000 7fcc54dad740 1 -- 172.21.15.2:0/312252770 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc4001eda0 con 0x55e7504d5b40 2024-09-19T06:24:06.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.707+0000 7fcc2b7fe640 1 -- 172.21.15.2:0/312252770 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fcc3c040040 con 0x55e7504d5b40 2024-09-19T06:24:06.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.707+0000 7fcc54dad740 10 client.18681 fetch_fsmap learned FSMap version 26 2024-09-19T06:24:06.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.707+0000 7fcc54dad740 1 -- 172.21.15.2:0/312252770 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55e750559c40 con 0x55e7504d5b40 2024-09-19T06:24:06.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.708+0000 7fcc2b7fe640 1 -- 172.21.15.2:0/312252770 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcc4001eda0 con 0x55e7504d5b40 2024-09-19T06:24:06.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.708+0000 7fcc2b7fe640 1 -- 172.21.15.2:0/312252770 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fcc3c04f430 con 0x55e7504d5b40 2024-09-19T06:24:06.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.708+0000 7fcc54dad740 10 client.18681 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:24:06.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.708+0000 7fcc54dad740 10 client.18681 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:24:06.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.708+0000 7fcc54dad740 20 client.18681 populate_metadata read hostname 'smithi002' 2024-09-19T06:24:06.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.708+0000 7fcc54dad740 1 --2- 172.21.15.2:0/312252770 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55e750559fb0 0x55e75055c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:06.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.708+0000 7fcc54dad740 4 client.18681 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:24:06.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.708+0000 7fcc54dad740 1 -- 172.21.15.2:0/312252770 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e750441d70 con 0x55e750559fb0 2024-09-19T06:24:06.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.708+0000 7fcc4b7fe640 1 --2- 172.21.15.2:0/312252770 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55e750559fb0 0x55e75055c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:06.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.708+0000 7fcc4b7fe640 1 --2- 172.21.15.2:0/312252770 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55e750559fb0 0x55e75055c3a0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a5c112e2367bd28a server_cookie=1f76af4d5403b6d4 in_seq=0 out_seq=0 2024-09-19T06:24:06.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.708+0000 7fcc2b7fe640 10 client.18681 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:24:06.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.709+0000 7fcc2b7fe640 1 -- 172.21.15.2:0/312252770 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e750441d70 con 0x55e750559fb0 2024-09-19T06:24:06.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.709+0000 7fcc2b7fe640 10 client.18681 handle_command_reply: tid=0 2024-09-19T06:24:06.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.709+0000 7fcc54dad740 1 client.18681 shutdown 2024-09-19T06:24:06.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.709+0000 7fcc54dad740 1 -- 172.21.15.2:0/312252770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7504d5b40 msgr2=0x55e7504d8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:06.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.709+0000 7fcc54dad740 1 --2- 172.21.15.2:0/312252770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7504d5b40 0x55e7504d8cd0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c009900 tx=0x7fcc3c000bc0 comp rx=0 tx=0).stop 2024-09-19T06:24:06.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.709+0000 7fcc54dad740 1 -- 172.21.15.2:0/312252770 shutdown_connections 2024-09-19T06:24:06.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.709+0000 7fcc54dad740 1 --2- 172.21.15.2:0/312252770 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55e750559fb0 0x55e75055c3a0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:06.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.709+0000 7fcc54dad740 1 --2- 172.21.15.2:0/312252770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e7504df370 0x55e7504d9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:06.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.709+0000 7fcc54dad740 1 --2- 172.21.15.2:0/312252770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7504d5b40 0x55e7504d8cd0 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:06.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.709+0000 7fcc2b7fe640 0 client.18681 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:24:06.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.709+0000 7fcc54dad740 1 --2- 172.21.15.2:0/312252770 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e7504d45d0 0x55e7504e7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:06.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.709+0000 7fcc54dad740 1 -- 172.21.15.2:0/312252770 >> 172.21.15.2:0/312252770 conn(0x55e75049d310 msgr2=0x55e7504de0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:06.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.709+0000 7fcc54dad740 1 -- 172.21.15.2:0/312252770 shutdown_connections 2024-09-19T06:24:06.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.709+0000 7fcc54dad740 1 -- 172.21.15.2:0/312252770 wait complete. 2024-09-19T06:24:06.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.709+0000 7fcc54dad740 20 client.18681 trim_cache size 0 max 16384 2024-09-19T06:24:06.716 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:24:06.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.710+0000 7fcc529d4640 1 -- 172.21.15.2:0/3552287694 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fcc340a33b0 msgr2=0x7fcc340a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:06.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.710+0000 7fcc529d4640 1 --2- 172.21.15.2:0/3552287694 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fcc340a33b0 0x7fcc340a5870 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fcc440cd9c0 tx=0x7fcc4401baf0 comp rx=0 tx=0).stop 2024-09-19T06:24:06.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.710+0000 7fcc529d4640 1 -- 172.21.15.2:0/3552287694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc4c106f10 msgr2=0x7fcc4c19cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:06.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.710+0000 7fcc529d4640 1 --2- 172.21.15.2:0/3552287694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc4c106f10 0x7fcc4c19cbc0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fcc4400cad0 tx=0x7fcc4400ced0 comp rx=0 tx=0).stop 2024-09-19T06:24:06.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.710+0000 7fcc529d4640 1 -- 172.21.15.2:0/3552287694 shutdown_connections 2024-09-19T06:24:06.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.710+0000 7fcc529d4640 1 --2- 172.21.15.2:0/3552287694 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fcc340a33b0 0x7fcc340a5870 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:06.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.710+0000 7fcc529d4640 1 --2- 172.21.15.2:0/3552287694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc4c106f10 0x7fcc4c19cbc0 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:06.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.710+0000 7fcc529d4640 1 --2- 172.21.15.2:0/3552287694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc4c102790 0x7fcc4c198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:06.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.710+0000 7fcc529d4640 1 --2- 172.21.15.2:0/3552287694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc4c101de0 0x7fcc4c1982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:06.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.710+0000 7fcc529d4640 1 -- 172.21.15.2:0/3552287694 >> 172.21.15.2:0/3552287694 conn(0x7fcc4c0fd8c0 msgr2=0x7fcc4c0fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:06.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.710+0000 7fcc529d4640 1 -- 172.21.15.2:0/3552287694 shutdown_connections 2024-09-19T06:24:06.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:06.710+0000 7fcc529d4640 1 -- 172.21.15.2:0/3552287694 wait complete. 2024-09-19T06:24:07.475 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:24:07.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:07 smithi002 ceph-mon[30982]: pgmap v288: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-19T06:24:07.735 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:24:07.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:07 smithi090 ceph-mon[34497]: pgmap v288: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-19T06:24:07.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:07 smithi089 ceph-mon[34160]: pgmap v288: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-19T06:24:08.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.185+0000 7f765f31b640 1 -- 172.21.15.2:0/2396767466 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7658102790 msgr2=0x7f76581067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:08.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.185+0000 7f765f31b640 1 --2- 172.21.15.2:0/2396767466 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7658102790 0x7f76581067e0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f7648009900 tx=0x7f764802a410 comp rx=0 tx=0).stop 2024-09-19T06:24:08.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.185+0000 7f765f31b640 1 -- 172.21.15.2:0/2396767466 shutdown_connections 2024-09-19T06:24:08.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.185+0000 7f765f31b640 1 --2- 172.21.15.2:0/2396767466 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7658106f10 0x7f765810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:08.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.185+0000 7f765f31b640 1 --2- 172.21.15.2:0/2396767466 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7658102790 0x7f76581067e0 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:08.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.185+0000 7f765f31b640 1 --2- 172.21.15.2:0/2396767466 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7658101de0 0x7f76581021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:08.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.185+0000 7f765f31b640 1 -- 172.21.15.2:0/2396767466 >> 172.21.15.2:0/2396767466 conn(0x7f76580fd8c0 msgr2=0x7f76580ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:08.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.185+0000 7f765f31b640 1 -- 172.21.15.2:0/2396767466 shutdown_connections 2024-09-19T06:24:08.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.185+0000 7f765f31b640 1 -- 172.21.15.2:0/2396767466 wait complete. 2024-09-19T06:24:08.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.186+0000 7f765f31b640 1 Processor -- start 2024-09-19T06:24:08.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.186+0000 7f765f31b640 1 -- start start 2024-09-19T06:24:08.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.186+0000 7f765f31b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7658101de0 0x7f7658198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:08.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.187+0000 7f765f31b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7658102790 0x7f7658198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:08.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.187+0000 7f765f31b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7658106f10 0x7f765819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:08.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.187+0000 7f765f31b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7658111e40 con 0x7f7658106f10 2024-09-19T06:24:08.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.187+0000 7f765f31b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7658111cc0 con 0x7f7658101de0 2024-09-19T06:24:08.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.187+0000 7f765f31b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7658111fc0 con 0x7f7658102790 2024-09-19T06:24:08.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.187+0000 7f765d8b8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7658106f10 0x7f765819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:08.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.187+0000 7f765d8b8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7658106f10 0x7f765819cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37422/0 (socket says 172.21.15.2:37422) 2024-09-19T06:24:08.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.187+0000 7f765d8b8640 1 -- 172.21.15.2:0/1707311432 learned_addr learned my addr 172.21.15.2:0/1707311432 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:08.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.187+0000 7f765c8b6640 1 --2- 172.21.15.2:0/1707311432 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7658102790 0x7f7658198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:08.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.187+0000 7f765d0b7640 1 --2- 172.21.15.2:0/1707311432 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7658101de0 0x7f7658198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:08.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.187+0000 7f765d8b8640 1 -- 172.21.15.2:0/1707311432 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7658102790 msgr2=0x7f7658198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:08.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.187+0000 7f765d8b8640 1 --2- 172.21.15.2:0/1707311432 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7658102790 0x7f7658198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:08.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.187+0000 7f765d8b8640 1 -- 172.21.15.2:0/1707311432 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7658101de0 msgr2=0x7f7658198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:08.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.187+0000 7f765d8b8640 1 --2- 172.21.15.2:0/1707311432 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7658101de0 0x7f7658198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:08.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.187+0000 7f765d8b8640 1 -- 172.21.15.2:0/1707311432 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f765819d3f0 con 0x7f7658106f10 2024-09-19T06:24:08.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.187+0000 7f765d8b8640 1 --2- 172.21.15.2:0/1707311432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7658106f10 0x7f765819cd10 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f765000cad0 tx=0x7f765000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:08.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.187+0000 7f764e7fc640 1 -- 172.21.15.2:0/1707311432 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765000ad60 con 0x7f7658106f10 2024-09-19T06:24:08.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.188+0000 7f764e7fc640 1 -- 172.21.15.2:0/1707311432 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7650005020 con 0x7f7658106f10 2024-09-19T06:24:08.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.188+0000 7f765f31b640 1 -- 172.21.15.2:0/1707311432 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f765819d6e0 con 0x7f7658106f10 2024-09-19T06:24:08.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.188+0000 7f764e7fc640 1 -- 172.21.15.2:0/1707311432 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765000f6b0 con 0x7f7658106f10 2024-09-19T06:24:08.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.188+0000 7f765f31b640 1 -- 172.21.15.2:0/1707311432 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76581a4fc0 con 0x7f7658106f10 2024-09-19T06:24:08.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.190+0000 7f764e7fc640 1 -- 172.21.15.2:0/1707311432 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f76500051d0 con 0x7f7658106f10 2024-09-19T06:24:08.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.190+0000 7f76616f4740 1 Processor -- start 2024-09-19T06:24:08.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.190+0000 7f76616f4740 1 -- start start 2024-09-19T06:24:08.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.190+0000 7f76616f4740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c34dddab40 0x55c34ddd9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:08.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.190+0000 7f76616f4740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c34ddd95d0 0x55c34ddd9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:08.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.190+0000 7f76616f4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34dde4370 0x55c34dde6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:08.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.190+0000 7f76616f4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c34dd3f2f0 con 0x55c34dde4370 2024-09-19T06:24:08.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.190+0000 7f76616f4740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55c34dce6cf0 con 0x55c34dddab40 2024-09-19T06:24:08.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.190+0000 7f76616f4740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55c34dd3b2b0 con 0x55c34ddd95d0 2024-09-19T06:24:08.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.191+0000 7f765c8b6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34dde4370 0x55c34dde6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:08.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.191+0000 7f765c8b6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34dde4370 0x55c34dde6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37432/0 (socket says 172.21.15.2:37432) 2024-09-19T06:24:08.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.191+0000 7f765c8b6640 1 -- 172.21.15.2:0/2977437963 learned_addr learned my addr 172.21.15.2:0/2977437963 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:08.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.191+0000 7f765d0b7640 1 --2- 172.21.15.2:0/2977437963 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c34ddd95d0 0x55c34ddd9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:08.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.191+0000 7f765c8b6640 1 --2- 172.21.15.2:0/2977437963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c34dddab40 0x55c34ddd9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:08.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.191+0000 7f764e7fc640 1 --2- 172.21.15.2:0/1707311432 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f76440a3430 0x7f76440a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:08.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.191+0000 7f765d0b7640 1 -- 172.21.15.2:0/2977437963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c34dddab40 msgr2=0x55c34ddd9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:08.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.191+0000 7f765d0b7640 1 --2- 172.21.15.2:0/2977437963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c34dddab40 0x55c34ddd9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:08.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.191+0000 7f765d0b7640 1 -- 172.21.15.2:0/2977437963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34dde4370 msgr2=0x55c34dde6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:08.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.191+0000 7f765d0b7640 1 --2- 172.21.15.2:0/2977437963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34dde4370 0x55c34dde6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:08.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.191+0000 7f765d0b7640 1 -- 172.21.15.2:0/2977437963 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c34dccb3a0 con 0x55c34ddd95d0 2024-09-19T06:24:08.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.191+0000 7f765d8b8640 1 --2- 172.21.15.2:0/1707311432 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f76440a3430 0x7f76440a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:08.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.191+0000 7f764e7fc640 1 -- 172.21.15.2:0/1707311432 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f76500cfc90 con 0x7f7658106f10 2024-09-19T06:24:08.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.191+0000 7f765d0b7640 1 --2- 172.21.15.2:0/2977437963 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c34ddd95d0 0x55c34ddd9a10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f76540099a0 tx=0x7f7654009e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=623524a2951d6b74 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:08.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.192+0000 7f76437fe640 1 -- 172.21.15.2:0/2977437963 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7654017070 con 0x55c34ddd95d0 2024-09-19T06:24:08.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.192+0000 7f76437fe640 1 -- 172.21.15.2:0/2977437963 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7654013470 con 0x55c34ddd95d0 2024-09-19T06:24:08.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.192+0000 7f76437fe640 1 -- 172.21.15.2:0/2977437963 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7654012630 con 0x55c34ddd95d0 2024-09-19T06:24:08.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.192+0000 7f76616f4740 1 -- 172.21.15.2:0/2977437963 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c34ddd95d0 msgr2=0x55c34ddd9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:08.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.192+0000 7f765d8b8640 1 --2- 172.21.15.2:0/1707311432 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f76440a3430 0x7f76440a58f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7650098370 tx=0x7f7650066900 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:08.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.192+0000 7f76616f4740 1 --2- 172.21.15.2:0/2977437963 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c34ddd95d0 0x55c34ddd9a10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f76540099a0 tx=0x7f7654009e60 comp rx=0 tx=0).stop 2024-09-19T06:24:08.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.192+0000 7f76616f4740 1 -- 172.21.15.2:0/2977437963 shutdown_connections 2024-09-19T06:24:08.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.192+0000 7f76616f4740 1 --2- 172.21.15.2:0/2977437963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34dde4370 0x55c34dde6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:08.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.192+0000 7f76616f4740 1 --2- 172.21.15.2:0/2977437963 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c34ddd95d0 0x55c34ddd9a10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:08.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.192+0000 7f76616f4740 1 --2- 172.21.15.2:0/2977437963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c34dddab40 0x55c34ddd9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:08.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.192+0000 7f76616f4740 1 -- 172.21.15.2:0/2977437963 >> 172.21.15.2:0/2977437963 conn(0x55c34dda2310 msgr2=0x55c34ddd5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:08.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.192+0000 7f76616f4740 1 -- 172.21.15.2:0/2977437963 shutdown_connections 2024-09-19T06:24:08.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.193+0000 7f76616f4740 1 -- 172.21.15.2:0/2977437963 wait complete. 2024-09-19T06:24:08.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.193+0000 7f76616f4740 1 -- start start 2024-09-19T06:24:08.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.193+0000 7f76616f4740 1 Processor -- start 2024-09-19T06:24:08.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.193+0000 7f76616f4740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c34ddd95d0 0x55c34dde3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:08.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.193+0000 7f76616f4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34dddab40 0x55c34dde0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:08.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.193+0000 7f76616f4740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c34dde4370 0x55c34dde1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:08.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.193+0000 7f76616f4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c34dde7070 con 0x55c34dddab40 2024-09-19T06:24:08.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.193+0000 7f76616f4740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55c34dcfa060 con 0x55c34ddd95d0 2024-09-19T06:24:08.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.193+0000 7f76616f4740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55c34dde71f0 con 0x55c34dde4370 2024-09-19T06:24:08.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.193+0000 7f76616f4740 10 client.0 _ll_register_callbacks cb 0x55c34da4d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:08.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.193+0000 7f765d0b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34dddab40 0x55c34dde0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:08.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.194+0000 7f765c8b6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c34dde4370 0x55c34dde1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:08.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.194+0000 7f765d0b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34dddab40 0x55c34dde0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37448/0 (socket says 172.21.15.2:37448) 2024-09-19T06:24:08.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.194+0000 7f765d0b7640 1 -- 172.21.15.2:0/555453659 learned_addr learned my addr 172.21.15.2:0/555453659 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:08.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.194+0000 7f765c8b6640 1 --2- 172.21.15.2:0/555453659 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c34ddd95d0 0x55c34dde3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:08.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.194+0000 7f765c8b6640 1 -- 172.21.15.2:0/555453659 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c34ddd95d0 msgr2=0x55c34dde3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:08.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.194+0000 7f765c8b6640 1 --2- 172.21.15.2:0/555453659 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c34ddd95d0 0x55c34dde3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:08.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.194+0000 7f765c8b6640 1 -- 172.21.15.2:0/555453659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34dddab40 msgr2=0x55c34dde0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:08.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.194+0000 7f765c8b6640 1 --2- 172.21.15.2:0/555453659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34dddab40 0x55c34dde0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:08.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.194+0000 7f765c8b6640 1 -- 172.21.15.2:0/555453659 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c34dab03c0 con 0x55c34dde4370 2024-09-19T06:24:08.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.194+0000 7f765d0b7640 1 --2- 172.21.15.2:0/555453659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34dddab40 0x55c34dde0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:24:08.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.194+0000 7f765c8b6640 1 --2- 172.21.15.2:0/555453659 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c34dde4370 0x55c34dde1570 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7648009230 tx=0x7f7648041040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7bc2ae4665b23cd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:08.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.194+0000 7f7640ff9640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-19T06:24:08.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.194+0000 7f7640ff9640 1 -- 172.21.15.2:0/555453659 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7648035040 con 0x55c34dde4370 2024-09-19T06:24:08.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.194+0000 7f76616f4740 1 -- 172.21.15.2:0/555453659 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7654013470 con 0x55c34dde4370 2024-09-19T06:24:08.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.194+0000 7f7640ff9640 1 -- 172.21.15.2:0/555453659 <== mon.1 v2:172.21.15.90:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f7648031cf0 con 0x55c34dde4370 2024-09-19T06:24:08.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.195+0000 7f7640ff9640 1 -- 172.21.15.2:0/555453659 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7648058050 con 0x55c34dde4370 2024-09-19T06:24:08.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.195+0000 7f76616f4740 10 client.27547 fetch_fsmap learned FSMap version 26 2024-09-19T06:24:08.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.195+0000 7f76616f4740 1 -- 172.21.15.2:0/555453659 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c34ddf2b40 con 0x55c34dde4370 2024-09-19T06:24:08.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.195+0000 7f7640ff9640 1 -- 172.21.15.2:0/555453659 <== mon.1 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7654013470 con 0x55c34dde4370 2024-09-19T06:24:08.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.195+0000 7f7640ff9640 1 -- 172.21.15.2:0/555453659 <== mon.1 v2:172.21.15.90:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f7648053030 con 0x55c34dde4370 2024-09-19T06:24:08.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.195+0000 7f76616f4740 10 client.27547 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:24:08.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.195+0000 7f76616f4740 10 client.27547 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:24:08.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.195+0000 7f76616f4740 20 client.27547 populate_metadata read hostname 'smithi002' 2024-09-19T06:24:08.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.195+0000 7f76616f4740 1 --2- 172.21.15.2:0/555453659 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55c34ddf3f50 0x55c34ddf6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:08.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.195+0000 7f76616f4740 4 client.27547 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:24:08.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.195+0000 7f76616f4740 1 -- 172.21.15.2:0/555453659 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c34dd4c860 con 0x55c34ddf3f50 2024-09-19T06:24:08.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.196+0000 7f765d0b7640 1 --2- 172.21.15.2:0/555453659 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55c34ddf3f50 0x55c34ddf6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:08.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.196+0000 7f765d0b7640 1 --2- 172.21.15.2:0/555453659 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55c34ddf3f50 0x55c34ddf6340 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c748980d40cdf7a9 server_cookie=c762d56eb5cc9a73 in_seq=0 out_seq=0 2024-09-19T06:24:08.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.196+0000 7f7640ff9640 10 client.27547 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:24:08.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.197+0000 7f7640ff9640 1 -- 172.21.15.2:0/555453659 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c34dd4c860 con 0x55c34ddf3f50 2024-09-19T06:24:08.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.197+0000 7f7640ff9640 10 client.27547 handle_command_reply: tid=0 2024-09-19T06:24:08.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.197+0000 7f76616f4740 1 client.27547 shutdown 2024-09-19T06:24:08.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.197+0000 7f76616f4740 1 -- 172.21.15.2:0/555453659 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c34dde4370 msgr2=0x55c34dde1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:08.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.197+0000 7f76616f4740 1 --2- 172.21.15.2:0/555453659 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c34dde4370 0x55c34dde1570 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7648009230 tx=0x7f7648041040 comp rx=0 tx=0).stop 2024-09-19T06:24:08.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.197+0000 7f76616f4740 1 -- 172.21.15.2:0/555453659 shutdown_connections 2024-09-19T06:24:08.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.197+0000 7f76616f4740 1 --2- 172.21.15.2:0/555453659 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55c34ddf3f50 0x55c34ddf6340 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:08.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.197+0000 7f76616f4740 1 --2- 172.21.15.2:0/555453659 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c34dde4370 0x55c34dde1570 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:08.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.197+0000 7f76616f4740 1 --2- 172.21.15.2:0/555453659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34dddab40 0x55c34dde0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:08.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.197+0000 7f76616f4740 1 --2- 172.21.15.2:0/555453659 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c34ddd95d0 0x55c34dde3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:08.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.197+0000 7f7640ff9640 0 client.27547 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:24:08.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.197+0000 7f76616f4740 1 -- 172.21.15.2:0/555453659 >> 172.21.15.2:0/555453659 conn(0x55c34dda2310 msgr2=0x55c34dddb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:08.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.197+0000 7f76616f4740 1 -- 172.21.15.2:0/555453659 shutdown_connections 2024-09-19T06:24:08.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.197+0000 7f76616f4740 1 -- 172.21.15.2:0/555453659 wait complete. 2024-09-19T06:24:08.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.197+0000 7f76616f4740 20 client.27547 trim_cache size 0 max 16384 2024-09-19T06:24:08.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.210+0000 7f76616f4740 1 Processor -- start 2024-09-19T06:24:08.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.210+0000 7f76616f4740 1 -- start start 2024-09-19T06:24:08.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.210+0000 7f76616f4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34ddd95d0 0x55c34ddf0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:08.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.210+0000 7f76616f4740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c34dddab40 0x55c34dde5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:08.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.210+0000 7f76616f4740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c34dde4370 0x55c34dde5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:08.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.210+0000 7f76616f4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f76581adf70 con 0x55c34ddd95d0 2024-09-19T06:24:08.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.210+0000 7f76616f4740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f76581ab840 con 0x55c34dde4370 2024-09-19T06:24:08.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.210+0000 7f76616f4740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f76581a96b0 con 0x55c34dddab40 2024-09-19T06:24:08.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.211+0000 7f765c8b6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34ddd95d0 0x55c34ddf0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:08.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.211+0000 7f765c8b6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34ddd95d0 0x55c34ddf0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37462/0 (socket says 172.21.15.2:37462) 2024-09-19T06:24:08.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.211+0000 7f765c8b6640 1 -- 172.21.15.2:0/2614560907 learned_addr learned my addr 172.21.15.2:0/2614560907 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:08.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.211+0000 7f765c8b6640 1 --2- 172.21.15.2:0/2614560907 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c34dde4370 0x55c34dde5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:08.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.211+0000 7f765d0b7640 1 --2- 172.21.15.2:0/2614560907 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c34dddab40 0x55c34dde5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:08.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.211+0000 7f765c8b6640 1 -- 172.21.15.2:0/2614560907 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c34dddab40 msgr2=0x55c34dde5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:08.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.211+0000 7f765c8b6640 1 --2- 172.21.15.2:0/2614560907 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c34dddab40 0x55c34dde5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:08.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.211+0000 7f765c8b6640 1 -- 172.21.15.2:0/2614560907 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c34dde4370 msgr2=0x55c34dde5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:08.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.211+0000 7f765c8b6640 1 --2- 172.21.15.2:0/2614560907 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c34dde4370 0x55c34dde5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:08.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.211+0000 7f765c8b6640 1 -- 172.21.15.2:0/2614560907 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c34ddd5ed0 con 0x55c34ddd95d0 2024-09-19T06:24:08.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.211+0000 7f765c8b6640 1 --2- 172.21.15.2:0/2614560907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34ddd95d0 0x55c34ddf0340 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f7648005ec0 tx=0x7f7648005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa522f0649d465a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:08.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.211+0000 7f7642ffd640 1 -- 172.21.15.2:0/2614560907 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7648035040 con 0x55c34ddd95d0 2024-09-19T06:24:08.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.211+0000 7f7642ffd640 1 -- 172.21.15.2:0/2614560907 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7648048940 con 0x55c34ddd95d0 2024-09-19T06:24:08.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.211+0000 7f7642ffd640 1 -- 172.21.15.2:0/2614560907 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76480038e0 con 0x55c34ddd95d0 2024-09-19T06:24:08.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.212+0000 7f76616f4740 1 -- 172.21.15.2:0/2614560907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34ddd95d0 msgr2=0x55c34ddf0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:08.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.212+0000 7f76616f4740 1 --2- 172.21.15.2:0/2614560907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34ddd95d0 0x55c34ddf0340 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f7648005ec0 tx=0x7f7648005fd0 comp rx=0 tx=0).stop 2024-09-19T06:24:08.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.212+0000 7f76616f4740 1 -- 172.21.15.2:0/2614560907 shutdown_connections 2024-09-19T06:24:08.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.212+0000 7f76616f4740 1 --2- 172.21.15.2:0/2614560907 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c34dde4370 0x55c34dde5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:08.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.212+0000 7f76616f4740 1 --2- 172.21.15.2:0/2614560907 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c34dddab40 0x55c34dde5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:08.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.212+0000 7f76616f4740 1 --2- 172.21.15.2:0/2614560907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34ddd95d0 0x55c34ddf0340 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:08.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.212+0000 7f76616f4740 1 -- 172.21.15.2:0/2614560907 >> 172.21.15.2:0/2614560907 conn(0x55c34dda2310 msgr2=0x55c34dde0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:08.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.212+0000 7f76616f4740 1 -- 172.21.15.2:0/2614560907 shutdown_connections 2024-09-19T06:24:08.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.212+0000 7f76616f4740 1 -- 172.21.15.2:0/2614560907 wait complete. 2024-09-19T06:24:08.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.212+0000 7f76616f4740 1 -- start start 2024-09-19T06:24:08.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.213+0000 7f76616f4740 1 Processor -- start 2024-09-19T06:24:08.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.213+0000 7f76616f4740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c34ddd95d0 0x55c34ddfad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:08.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.213+0000 7f76616f4740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c34dddab40 0x55c34ddfb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:08.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.213+0000 7f76616f4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34dde4370 0x55c34ddeb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:08.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.213+0000 7f76616f4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f76581a9d00 con 0x55c34dde4370 2024-09-19T06:24:08.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.213+0000 7f76616f4740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f76581ab170 con 0x55c34ddd95d0 2024-09-19T06:24:08.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.213+0000 7f76616f4740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f76581aa3d0 con 0x55c34dddab40 2024-09-19T06:24:08.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.213+0000 7f76616f4740 10 client.0 _ll_register_callbacks cb 0x7f7648004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:08.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.213+0000 7f765c8b6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34dde4370 0x55c34ddeb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:08.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.213+0000 7f765c8b6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34dde4370 0x55c34ddeb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37478/0 (socket says 172.21.15.2:37478) 2024-09-19T06:24:08.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.213+0000 7f765c8b6640 1 -- 172.21.15.2:0/2144566026 learned_addr learned my addr 172.21.15.2:0/2144566026 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:08.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.213+0000 7f765c8b6640 1 --2- 172.21.15.2:0/2144566026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c34ddd95d0 0x55c34ddfad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:08.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.213+0000 7f765d0b7640 1 --2- 172.21.15.2:0/2144566026 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c34dddab40 0x55c34ddfb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:08.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.213+0000 7f765c8b6640 1 -- 172.21.15.2:0/2144566026 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c34dddab40 msgr2=0x55c34ddfb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:08.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.213+0000 7f765c8b6640 1 --2- 172.21.15.2:0/2144566026 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c34dddab40 0x55c34ddfb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:08.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.213+0000 7f765c8b6640 1 -- 172.21.15.2:0/2144566026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c34ddd95d0 msgr2=0x55c34ddfad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:08.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.213+0000 7f765c8b6640 1 --2- 172.21.15.2:0/2144566026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c34ddd95d0 0x55c34ddfad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:08.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.214+0000 7f765c8b6640 1 -- 172.21.15.2:0/2144566026 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c34ddeb9f0 con 0x55c34dde4370 2024-09-19T06:24:08.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.214+0000 7f765c8b6640 1 --2- 172.21.15.2:0/2144566026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34dde4370 0x55c34ddeb4b0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f7648048640 tx=0x7f7648005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab0ef4be9992f738 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:08.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.214+0000 7f7640ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:24:08.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.214+0000 7f7640ff9640 1 -- 172.21.15.2:0/2144566026 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7648035050 con 0x55c34dde4370 2024-09-19T06:24:08.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.214+0000 7f7640ff9640 1 -- 172.21.15.2:0/2144566026 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8521+0+0 (secure 0 0 0) 0x7f7648048740 con 0x55c34dde4370 2024-09-19T06:24:08.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.214+0000 7f76616f4740 1 -- 172.21.15.2:0/2144566026 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7648048940 con 0x55c34dde4370 2024-09-19T06:24:08.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.214+0000 7f7640ff9640 1 -- 172.21.15.2:0/2144566026 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7648070050 con 0x55c34dde4370 2024-09-19T06:24:08.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.214+0000 7f76616f4740 10 client.18699 fetch_fsmap learned FSMap version 26 2024-09-19T06:24:08.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.214+0000 7f76616f4740 1 -- 172.21.15.2:0/2144566026 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c34ddeccf0 con 0x55c34dde4370 2024-09-19T06:24:08.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.214+0000 7f7640ff9640 1 -- 172.21.15.2:0/2144566026 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7648048940 con 0x55c34dde4370 2024-09-19T06:24:08.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.214+0000 7f7640ff9640 1 -- 172.21.15.2:0/2144566026 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f7648053070 con 0x55c34dde4370 2024-09-19T06:24:08.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.214+0000 7f76616f4740 10 client.18699 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:24:08.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.214+0000 7f76616f4740 10 client.18699 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:24:08.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.215+0000 7f76616f4740 20 client.18699 populate_metadata read hostname 'smithi002' 2024-09-19T06:24:08.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.215+0000 7f76616f4740 1 --2- 172.21.15.2:0/2144566026 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55c34de5ebb0 0x55c34de60fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:08.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.215+0000 7f76616f4740 4 client.18699 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:24:08.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.215+0000 7f76616f4740 1 -- 172.21.15.2:0/2144566026 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c34dd46d70 con 0x55c34de5ebb0 2024-09-19T06:24:08.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.215+0000 7f765d0b7640 1 --2- 172.21.15.2:0/2144566026 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55c34de5ebb0 0x55c34de60fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:08.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.215+0000 7f7640ff9640 10 client.18699 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:24:08.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.215+0000 7f765d0b7640 1 --2- 172.21.15.2:0/2144566026 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55c34de5ebb0 0x55c34de60fa0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b644af54d595f5b9 server_cookie=66694587f904629b in_seq=0 out_seq=0 2024-09-19T06:24:08.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.215+0000 7f7640ff9640 1 -- 172.21.15.2:0/2144566026 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c34dd46d70 con 0x55c34de5ebb0 2024-09-19T06:24:08.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.215+0000 7f7640ff9640 10 client.18699 handle_command_reply: tid=0 2024-09-19T06:24:08.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.215+0000 7f76616f4740 1 client.18699 shutdown 2024-09-19T06:24:08.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.216+0000 7f76616f4740 1 -- 172.21.15.2:0/2144566026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34dde4370 msgr2=0x55c34ddeb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:08.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.216+0000 7f76616f4740 1 --2- 172.21.15.2:0/2144566026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34dde4370 0x55c34ddeb4b0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f7648048640 tx=0x7f7648005c90 comp rx=0 tx=0).stop 2024-09-19T06:24:08.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.216+0000 7f76616f4740 1 -- 172.21.15.2:0/2144566026 shutdown_connections 2024-09-19T06:24:08.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.216+0000 7f76616f4740 1 --2- 172.21.15.2:0/2144566026 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55c34de5ebb0 0x55c34de60fa0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:08.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.216+0000 7f7640ff9640 0 client.18699 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:24:08.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.216+0000 7f76616f4740 1 --2- 172.21.15.2:0/2144566026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34dde4370 0x55c34ddeb4b0 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:08.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.216+0000 7f76616f4740 1 --2- 172.21.15.2:0/2144566026 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c34dddab40 0x55c34ddfb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:08.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.216+0000 7f76616f4740 1 --2- 172.21.15.2:0/2144566026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c34ddd95d0 0x55c34ddfad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:08.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.216+0000 7f76616f4740 1 -- 172.21.15.2:0/2144566026 >> 172.21.15.2:0/2144566026 conn(0x55c34dda2310 msgr2=0x55c34dddf810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:08.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.216+0000 7f76616f4740 1 -- 172.21.15.2:0/2144566026 shutdown_connections 2024-09-19T06:24:08.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.216+0000 7f76616f4740 1 -- 172.21.15.2:0/2144566026 wait complete. 2024-09-19T06:24:08.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.216+0000 7f76616f4740 20 client.18699 trim_cache size 0 max 16384 2024-09-19T06:24:08.223 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:24:08.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.216+0000 7f765f31b640 1 -- 172.21.15.2:0/1707311432 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f76440a3430 msgr2=0x7f76440a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:08.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.216+0000 7f765f31b640 1 --2- 172.21.15.2:0/1707311432 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f76440a3430 0x7f76440a58f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7650098370 tx=0x7f7650066900 comp rx=0 tx=0).stop 2024-09-19T06:24:08.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.216+0000 7f765f31b640 1 -- 172.21.15.2:0/1707311432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7658106f10 msgr2=0x7f765819cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:08.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.216+0000 7f765f31b640 1 --2- 172.21.15.2:0/1707311432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7658106f10 0x7f765819cd10 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f765000cad0 tx=0x7f765000ced0 comp rx=0 tx=0).stop 2024-09-19T06:24:08.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.217+0000 7f765f31b640 1 -- 172.21.15.2:0/1707311432 shutdown_connections 2024-09-19T06:24:08.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.217+0000 7f765f31b640 1 --2- 172.21.15.2:0/1707311432 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f76440a3430 0x7f76440a58f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:08.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.217+0000 7f765f31b640 1 --2- 172.21.15.2:0/1707311432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7658106f10 0x7f765819cd10 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:08.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.217+0000 7f765f31b640 1 --2- 172.21.15.2:0/1707311432 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7658102790 0x7f7658198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:08.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.217+0000 7f765f31b640 1 --2- 172.21.15.2:0/1707311432 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7658101de0 0x7f7658198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:08.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.217+0000 7f765f31b640 1 -- 172.21.15.2:0/1707311432 >> 172.21.15.2:0/1707311432 conn(0x7f76580fd8c0 msgr2=0x7f76580fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:08.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.217+0000 7f765f31b640 1 -- 172.21.15.2:0/1707311432 shutdown_connections 2024-09-19T06:24:08.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:08.217+0000 7f765f31b640 1 -- 172.21.15.2:0/1707311432 wait complete. 2024-09-19T06:24:08.886 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:24:09.141 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:24:09.561 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:09 smithi002 ceph-mon[30982]: pgmap v289: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-19T06:24:09.561 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:09 smithi002 ceph-mon[30982]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T06:24:09.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.567+0000 7f27d588b640 1 -- 172.21.15.2:0/3667527634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27d0100e20 msgr2=0x7f27d0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:09.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.568+0000 7f27d588b640 1 --2- 172.21.15.2:0/3667527634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27d0100e20 0x7f27d0101200 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f27c0009900 tx=0x7f27c002a480 comp rx=0 tx=0).stop 2024-09-19T06:24:09.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.568+0000 7f27d588b640 1 -- 172.21.15.2:0/3667527634 shutdown_connections 2024-09-19T06:24:09.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.568+0000 7f27d588b640 1 --2- 172.21.15.2:0/3667527634 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27d0102ef0 0x7f27d010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:09.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.568+0000 7f27d588b640 1 --2- 172.21.15.2:0/3667527634 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27d0102570 0x7f27d01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:09.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.568+0000 7f27d588b640 1 --2- 172.21.15.2:0/3667527634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27d0100e20 0x7f27d0101200 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:09.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.568+0000 7f27d588b640 1 -- 172.21.15.2:0/3667527634 >> 172.21.15.2:0/3667527634 conn(0x7f27d00fc7d0 msgr2=0x7f27d00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:09.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.568+0000 7f27d588b640 1 -- 172.21.15.2:0/3667527634 shutdown_connections 2024-09-19T06:24:09.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.568+0000 7f27d588b640 1 -- 172.21.15.2:0/3667527634 wait complete. 2024-09-19T06:24:09.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.568+0000 7f27d588b640 1 Processor -- start 2024-09-19T06:24:09.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.569+0000 7f27d588b640 1 -- start start 2024-09-19T06:24:09.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.569+0000 7f27d588b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27d0100e20 0x7f27d019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:09.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.569+0000 7f27d588b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27d0102570 0x7f27d019aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:09.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.569+0000 7f27d588b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27d0102ef0 0x7f27d019ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:09.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.569+0000 7f27d588b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f27d0110e50 con 0x7f27d0102570 2024-09-19T06:24:09.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.569+0000 7f27d588b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f27d0110cd0 con 0x7f27d0100e20 2024-09-19T06:24:09.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.569+0000 7f27d588b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f27d0110fd0 con 0x7f27d0102ef0 2024-09-19T06:24:09.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.569+0000 7f27ce7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27d0102570 0x7f27d019aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:09.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.569+0000 7f27ce7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27d0102570 0x7f27d019aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37492/0 (socket says 172.21.15.2:37492) 2024-09-19T06:24:09.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.569+0000 7f27ce7fc640 1 -- 172.21.15.2:0/2702652507 learned_addr learned my addr 172.21.15.2:0/2702652507 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:09.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.569+0000 7f27ceffd640 1 --2- 172.21.15.2:0/2702652507 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27d0100e20 0x7f27d019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:09.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.569+0000 7f27cf7fe640 1 --2- 172.21.15.2:0/2702652507 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27d0102ef0 0x7f27d019ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:09.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.569+0000 7f27ce7fc640 1 -- 172.21.15.2:0/2702652507 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27d0102ef0 msgr2=0x7f27d019ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:09.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.569+0000 7f27ce7fc640 1 --2- 172.21.15.2:0/2702652507 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27d0102ef0 0x7f27d019ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:09.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.569+0000 7f27ce7fc640 1 -- 172.21.15.2:0/2702652507 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27d0100e20 msgr2=0x7f27d019a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:09.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.569+0000 7f27ce7fc640 1 --2- 172.21.15.2:0/2702652507 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27d0100e20 0x7f27d019a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:09.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.569+0000 7f27ce7fc640 1 -- 172.21.15.2:0/2702652507 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27d019f540 con 0x7f27d0102570 2024-09-19T06:24:09.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.569+0000 7f27ceffd640 1 --2- 172.21.15.2:0/2702652507 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27d0100e20 0x7f27d019a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:24:09.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.570+0000 7f27ce7fc640 1 --2- 172.21.15.2:0/2702652507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27d0102570 0x7f27d019aad0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f27c400c920 tx=0x7f27c400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:09.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.570+0000 7f27d4889640 1 -- 172.21.15.2:0/2702652507 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c4007c70 con 0x7f27d0102570 2024-09-19T06:24:09.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.570+0000 7f27d588b640 1 -- 172.21.15.2:0/2702652507 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27d019f830 con 0x7f27d0102570 2024-09-19T06:24:09.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.570+0000 7f27d4889640 1 -- 172.21.15.2:0/2702652507 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f27c4007e10 con 0x7f27d0102570 2024-09-19T06:24:09.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.570+0000 7f27d4889640 1 -- 172.21.15.2:0/2702652507 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c4018820 con 0x7f27d0102570 2024-09-19T06:24:09.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.570+0000 7f27d588b640 1 -- 172.21.15.2:0/2702652507 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27d01a7110 con 0x7f27d0102570 2024-09-19T06:24:09.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.572+0000 7f27d4889640 1 -- 172.21.15.2:0/2702652507 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f27c40189c0 con 0x7f27d0102570 2024-09-19T06:24:09.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.572+0000 7f27d7c64740 1 Processor -- start 2024-09-19T06:24:09.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.572+0000 7f27d7c64740 1 -- start start 2024-09-19T06:24:09.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.573+0000 7f27d7c64740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590bc62ab40 0x5590bc629090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:09.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.573+0000 7f27d7c64740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590bc6295d0 0x5590bc629a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:09.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.573+0000 7f27d7c64740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590bc634370 0x5590bc636760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:09.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.573+0000 7f27d7c64740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5590bc58f2f0 con 0x5590bc6295d0 2024-09-19T06:24:09.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.573+0000 7f27d7c64740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5590bc536cf0 con 0x5590bc62ab40 2024-09-19T06:24:09.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.573+0000 7f27d7c64740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5590bc58b2b0 con 0x5590bc634370 2024-09-19T06:24:09.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.573+0000 7f27ceffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590bc6295d0 0x5590bc629a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:09.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.573+0000 7f27ceffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590bc6295d0 0x5590bc629a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37508/0 (socket says 172.21.15.2:37508) 2024-09-19T06:24:09.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.573+0000 7f27ceffd640 1 -- 172.21.15.2:0/517132238 learned_addr learned my addr 172.21.15.2:0/517132238 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:09.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.573+0000 7f27d4889640 1 --2- 172.21.15.2:0/2702652507 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f27b80a33b0 0x7f27b80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:09.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.573+0000 7f27cf7fe640 1 --2- 172.21.15.2:0/517132238 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590bc62ab40 0x5590bc629090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:09.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.573+0000 7f27ce7fc640 1 --2- 172.21.15.2:0/517132238 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590bc634370 0x5590bc636760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:09.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.573+0000 7f27cf7fe640 1 --2- 172.21.15.2:0/2702652507 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f27b80a33b0 0x7f27b80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:09.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.573+0000 7f27ceffd640 1 -- 172.21.15.2:0/517132238 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590bc634370 msgr2=0x5590bc636760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:09.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.573+0000 7f27ceffd640 1 --2- 172.21.15.2:0/517132238 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590bc634370 0x5590bc636760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:09.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.573+0000 7f27ceffd640 1 -- 172.21.15.2:0/517132238 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590bc62ab40 msgr2=0x5590bc629090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:09.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.573+0000 7f27ceffd640 1 --2- 172.21.15.2:0/517132238 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590bc62ab40 0x5590bc629090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:09.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.573+0000 7f27ceffd640 1 -- 172.21.15.2:0/517132238 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590bc51b3a0 con 0x5590bc6295d0 2024-09-19T06:24:09.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.573+0000 7f27d4889640 1 -- 172.21.15.2:0/2702652507 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8565+0+0 (secure 0 0 0) 0x7f27c40cfe80 con 0x7f27d0102570 2024-09-19T06:24:09.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.574+0000 7f27ceffd640 1 --2- 172.21.15.2:0/517132238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590bc6295d0 0x5590bc629a10 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f27c0009900 tx=0x7f27c00042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95f0528a51b720e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:09.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.574+0000 7f27cf7fe640 1 --2- 172.21.15.2:0/2702652507 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f27b80a33b0 0x7f27b80a5870 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f27c8005c40 tx=0x7f27c8009500 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:09.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.574+0000 7f27b5ffb640 1 -- 172.21.15.2:0/517132238 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c0035030 con 0x5590bc6295d0 2024-09-19T06:24:09.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.574+0000 7f27b5ffb640 1 -- 172.21.15.2:0/517132238 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f27c00044d0 con 0x5590bc6295d0 2024-09-19T06:24:09.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.574+0000 7f27b5ffb640 1 -- 172.21.15.2:0/517132238 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c0003850 con 0x5590bc6295d0 2024-09-19T06:24:09.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.574+0000 7f27d7c64740 1 -- 172.21.15.2:0/517132238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590bc6295d0 msgr2=0x5590bc629a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:09.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.574+0000 7f27d7c64740 1 --2- 172.21.15.2:0/517132238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590bc6295d0 0x5590bc629a10 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f27c0009900 tx=0x7f27c00042e0 comp rx=0 tx=0).stop 2024-09-19T06:24:09.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.575+0000 7f27d7c64740 1 -- 172.21.15.2:0/517132238 shutdown_connections 2024-09-19T06:24:09.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.575+0000 7f27d7c64740 1 --2- 172.21.15.2:0/517132238 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590bc634370 0x5590bc636760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:09.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.575+0000 7f27d7c64740 1 --2- 172.21.15.2:0/517132238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590bc6295d0 0x5590bc629a10 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:09.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.575+0000 7f27d7c64740 1 --2- 172.21.15.2:0/517132238 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590bc62ab40 0x5590bc629090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:09.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.575+0000 7f27d7c64740 1 -- 172.21.15.2:0/517132238 >> 172.21.15.2:0/517132238 conn(0x5590bc5f2310 msgr2=0x5590bc625c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:09.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.575+0000 7f27d7c64740 1 -- 172.21.15.2:0/517132238 shutdown_connections 2024-09-19T06:24:09.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.575+0000 7f27d7c64740 1 -- 172.21.15.2:0/517132238 wait complete. 2024-09-19T06:24:09.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.575+0000 7f27d7c64740 1 -- start start 2024-09-19T06:24:09.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.575+0000 7f27d7c64740 1 Processor -- start 2024-09-19T06:24:09.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.575+0000 7f27d7c64740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590bc6295d0 0x5590bc633d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:09.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.575+0000 7f27d7c64740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590bc62ab40 0x5590bc630ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:09.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.575+0000 7f27d7c64740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590bc634370 0x5590bc6315e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:09.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.575+0000 7f27d7c64740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5590bc637010 con 0x5590bc62ab40 2024-09-19T06:24:09.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.575+0000 7f27d7c64740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5590bc54a060 con 0x5590bc634370 2024-09-19T06:24:09.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.575+0000 7f27d7c64740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5590bc637190 con 0x5590bc6295d0 2024-09-19T06:24:09.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.576+0000 7f27d7c64740 10 client.0 _ll_register_callbacks cb 0x5590bc29d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:09.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.576+0000 7f27ce7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590bc62ab40 0x5590bc630ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:09.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.576+0000 7f27ce7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590bc62ab40 0x5590bc630ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37520/0 (socket says 172.21.15.2:37520) 2024-09-19T06:24:09.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.576+0000 7f27ce7fc640 1 -- 172.21.15.2:0/3292955710 learned_addr learned my addr 172.21.15.2:0/3292955710 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:09.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.576+0000 7f27cf7fe640 1 --2- 172.21.15.2:0/3292955710 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590bc634370 0x5590bc6315e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:09.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.576+0000 7f27ceffd640 1 --2- 172.21.15.2:0/3292955710 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590bc6295d0 0x5590bc633d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:09.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.576+0000 7f27ce7fc640 1 -- 172.21.15.2:0/3292955710 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590bc6295d0 msgr2=0x5590bc633d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:09.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.576+0000 7f27ce7fc640 1 --2- 172.21.15.2:0/3292955710 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590bc6295d0 0x5590bc633d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:09.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.576+0000 7f27ce7fc640 1 -- 172.21.15.2:0/3292955710 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590bc634370 msgr2=0x5590bc6315e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:09.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.576+0000 7f27ce7fc640 1 --2- 172.21.15.2:0/3292955710 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590bc634370 0x5590bc6315e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:09.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.576+0000 7f27ce7fc640 1 -- 172.21.15.2:0/3292955710 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590bc3003c0 con 0x5590bc62ab40 2024-09-19T06:24:09.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.576+0000 7f27ce7fc640 1 --2- 172.21.15.2:0/3292955710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590bc62ab40 0x5590bc630ff0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f27c4007590 tx=0x7f27c406bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8961390676807ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:09.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.576+0000 7f27aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:24:09.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.576+0000 7f27aeffd640 1 -- 172.21.15.2:0/3292955710 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c400fb00 con 0x5590bc62ab40 2024-09-19T06:24:09.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.576+0000 7f27aeffd640 1 -- 172.21.15.2:0/3292955710 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8565+0+0 (secure 0 0 0) 0x7f27c40987a0 con 0x5590bc62ab40 2024-09-19T06:24:09.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.576+0000 7f27d7c64740 1 -- 172.21.15.2:0/3292955710 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27c00044d0 con 0x5590bc62ab40 2024-09-19T06:24:09.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.577+0000 7f27aeffd640 1 -- 172.21.15.2:0/3292955710 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f27c4066f80 con 0x5590bc62ab40 2024-09-19T06:24:09.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.577+0000 7f27d7c64740 10 client.18711 fetch_fsmap learned FSMap version 26 2024-09-19T06:24:09.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.577+0000 7f27d7c64740 1 -- 172.21.15.2:0/3292955710 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5590bc642a80 con 0x5590bc62ab40 2024-09-19T06:24:09.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.577+0000 7f27aeffd640 1 -- 172.21.15.2:0/3292955710 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f27c00044d0 con 0x5590bc62ab40 2024-09-19T06:24:09.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.577+0000 7f27aeffd640 1 -- 172.21.15.2:0/3292955710 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f27c406a070 con 0x5590bc62ab40 2024-09-19T06:24:09.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.577+0000 7f27d7c64740 10 client.18711 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:24:09.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.577+0000 7f27d7c64740 10 client.18711 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:24:09.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.577+0000 7f27d7c64740 20 client.18711 populate_metadata read hostname 'smithi002' 2024-09-19T06:24:09.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.577+0000 7f27d7c64740 1 --2- 172.21.15.2:0/3292955710 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5590bc643e90 0x5590bc646280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:09.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.577+0000 7f27d7c64740 4 client.18711 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:24:09.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.577+0000 7f27d7c64740 1 -- 172.21.15.2:0/3292955710 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5590bc59c860 con 0x5590bc643e90 2024-09-19T06:24:09.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.577+0000 7f27ceffd640 1 --2- 172.21.15.2:0/3292955710 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5590bc643e90 0x5590bc646280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:09.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.578+0000 7f27ceffd640 1 --2- 172.21.15.2:0/3292955710 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5590bc643e90 0x5590bc646280 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2236048987f052a3 server_cookie=ec5a95e2ace5ff8c in_seq=0 out_seq=0 2024-09-19T06:24:09.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.578+0000 7f27aeffd640 10 client.18711 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:09.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.578+0000 7f27aeffd640 1 -- 172.21.15.2:0/3292955710 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5590bc59c860 con 0x5590bc643e90 2024-09-19T06:24:09.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.578+0000 7f27aeffd640 10 client.18711 handle_command_reply: tid=0 2024-09-19T06:24:09.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.578+0000 7f27d7c64740 1 client.18711 shutdown 2024-09-19T06:24:09.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.579+0000 7f27d7c64740 1 -- 172.21.15.2:0/3292955710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590bc62ab40 msgr2=0x5590bc630ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:09.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.579+0000 7f27d7c64740 1 --2- 172.21.15.2:0/3292955710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590bc62ab40 0x5590bc630ff0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f27c4007590 tx=0x7f27c406bd50 comp rx=0 tx=0).stop 2024-09-19T06:24:09.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.579+0000 7f27d7c64740 1 -- 172.21.15.2:0/3292955710 shutdown_connections 2024-09-19T06:24:09.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.579+0000 7f27d7c64740 1 --2- 172.21.15.2:0/3292955710 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5590bc643e90 0x5590bc646280 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:09.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.579+0000 7f27d7c64740 1 --2- 172.21.15.2:0/3292955710 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590bc634370 0x5590bc6315e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:09.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.579+0000 7f27d7c64740 1 --2- 172.21.15.2:0/3292955710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590bc62ab40 0x5590bc630ff0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:09.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.579+0000 7f27d7c64740 1 --2- 172.21.15.2:0/3292955710 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590bc6295d0 0x5590bc633d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:09.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.579+0000 7f27aeffd640 0 client.18711 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:09.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.579+0000 7f27d7c64740 1 -- 172.21.15.2:0/3292955710 >> 172.21.15.2:0/3292955710 conn(0x5590bc5f2310 msgr2=0x5590bc62b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:09.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.579+0000 7f27d7c64740 1 -- 172.21.15.2:0/3292955710 shutdown_connections 2024-09-19T06:24:09.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.579+0000 7f27d7c64740 1 -- 172.21.15.2:0/3292955710 wait complete. 2024-09-19T06:24:09.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.579+0000 7f27d7c64740 20 client.18711 trim_cache size 0 max 16384 2024-09-19T06:24:09.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.592+0000 7f27d7c64740 1 Processor -- start 2024-09-19T06:24:09.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.592+0000 7f27d7c64740 1 -- start start 2024-09-19T06:24:09.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.592+0000 7f27d7c64740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590bc6295d0 0x5590bc625e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:09.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.592+0000 7f27d7c64740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590bc62ab40 0x5590bc6402b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:09.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.592+0000 7f27d7c64740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590bc634370 0x5590bc64bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:09.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.592+0000 7f27d7c64740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f27d01b2230 con 0x5590bc6295d0 2024-09-19T06:24:09.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.592+0000 7f27d7c64740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f27d01afb00 con 0x5590bc62ab40 2024-09-19T06:24:09.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.592+0000 7f27d7c64740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f27d01ad970 con 0x5590bc634370 2024-09-19T06:24:09.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.592+0000 7f27ceffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590bc6295d0 0x5590bc625e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:09.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.592+0000 7f27ceffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590bc6295d0 0x5590bc625e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37532/0 (socket says 172.21.15.2:37532) 2024-09-19T06:24:09.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.592+0000 7f27ceffd640 1 -- 172.21.15.2:0/4212736782 learned_addr learned my addr 172.21.15.2:0/4212736782 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:09.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.592+0000 7f27ce7fc640 1 --2- 172.21.15.2:0/4212736782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590bc62ab40 0x5590bc6402b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:09.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.592+0000 7f27ceffd640 1 -- 172.21.15.2:0/4212736782 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590bc634370 msgr2=0x5590bc64bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:09.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.592+0000 7f27ceffd640 1 --2- 172.21.15.2:0/4212736782 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590bc634370 0x5590bc64bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:09.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.592+0000 7f27ceffd640 1 -- 172.21.15.2:0/4212736782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590bc62ab40 msgr2=0x5590bc6402b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:09.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.592+0000 7f27ceffd640 1 --2- 172.21.15.2:0/4212736782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590bc62ab40 0x5590bc6402b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:09.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.592+0000 7f27ceffd640 1 -- 172.21.15.2:0/4212736782 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590bc6465f0 con 0x5590bc6295d0 2024-09-19T06:24:09.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.593+0000 7f27ce7fc640 1 --2- 172.21.15.2:0/4212736782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590bc62ab40 0x5590bc6402b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:24:09.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.593+0000 7f27ceffd640 1 --2- 172.21.15.2:0/4212736782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590bc6295d0 0x5590bc625e10 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f27c00092a0 tx=0x7f27c0009230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5df624181dd46e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:09.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.593+0000 7f27b57fa640 1 -- 172.21.15.2:0/4212736782 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c0035040 con 0x5590bc6295d0 2024-09-19T06:24:09.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.593+0000 7f27b57fa640 1 -- 172.21.15.2:0/4212736782 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f27c0054070 con 0x5590bc6295d0 2024-09-19T06:24:09.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.593+0000 7f27b57fa640 1 -- 172.21.15.2:0/4212736782 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c004ea40 con 0x5590bc6295d0 2024-09-19T06:24:09.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.593+0000 7f27d7c64740 1 -- 172.21.15.2:0/4212736782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590bc6295d0 msgr2=0x5590bc625e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:09.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.593+0000 7f27d7c64740 1 --2- 172.21.15.2:0/4212736782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590bc6295d0 0x5590bc625e10 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f27c00092a0 tx=0x7f27c0009230 comp rx=0 tx=0).stop 2024-09-19T06:24:09.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.593+0000 7f27d7c64740 1 -- 172.21.15.2:0/4212736782 shutdown_connections 2024-09-19T06:24:09.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.593+0000 7f27d7c64740 1 --2- 172.21.15.2:0/4212736782 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590bc634370 0x5590bc64bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:09.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.593+0000 7f27d7c64740 1 --2- 172.21.15.2:0/4212736782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590bc62ab40 0x5590bc6402b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:09.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.593+0000 7f27d7c64740 1 --2- 172.21.15.2:0/4212736782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590bc6295d0 0x5590bc625e10 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:09.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.593+0000 7f27d7c64740 1 -- 172.21.15.2:0/4212736782 >> 172.21.15.2:0/4212736782 conn(0x5590bc5f2310 msgr2=0x5590bc625700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:09.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.594+0000 7f27d7c64740 1 -- 172.21.15.2:0/4212736782 shutdown_connections 2024-09-19T06:24:09.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.594+0000 7f27d7c64740 1 -- 172.21.15.2:0/4212736782 wait complete. 2024-09-19T06:24:09.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.594+0000 7f27d7c64740 1 -- start start 2024-09-19T06:24:09.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.594+0000 7f27d7c64740 1 Processor -- start 2024-09-19T06:24:09.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.594+0000 7f27d7c64740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590bc6295d0 0x5590bc638390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:09.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.594+0000 7f27d7c64740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590bc62ab40 0x5590bc6388d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:09.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.594+0000 7f27d7c64740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590bc634370 0x5590bc638e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:09.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.594+0000 7f27d7c64740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f27d01adfc0 con 0x5590bc634370 2024-09-19T06:24:09.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.594+0000 7f27d7c64740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f27d01af430 con 0x5590bc6295d0 2024-09-19T06:24:09.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.594+0000 7f27d7c64740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f27d01ae690 con 0x5590bc62ab40 2024-09-19T06:24:09.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.594+0000 7f27d7c64740 10 client.0 _ll_register_callbacks cb 0x7f27c400c870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:09.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.595+0000 7f27cf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590bc634370 0x5590bc638e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:09.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.595+0000 7f27cf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590bc634370 0x5590bc638e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37548/0 (socket says 172.21.15.2:37548) 2024-09-19T06:24:09.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.595+0000 7f27cf7fe640 1 -- 172.21.15.2:0/2618129364 learned_addr learned my addr 172.21.15.2:0/2618129364 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:09.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.595+0000 7f27ceffd640 1 --2- 172.21.15.2:0/2618129364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590bc6295d0 0x5590bc638390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:09.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.595+0000 7f27ce7fc640 1 --2- 172.21.15.2:0/2618129364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590bc62ab40 0x5590bc6388d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:09.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.595+0000 7f27cf7fe640 1 -- 172.21.15.2:0/2618129364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590bc62ab40 msgr2=0x5590bc6388d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:09.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.595+0000 7f27cf7fe640 1 --2- 172.21.15.2:0/2618129364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590bc62ab40 0x5590bc6388d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:09.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.595+0000 7f27cf7fe640 1 -- 172.21.15.2:0/2618129364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590bc6295d0 msgr2=0x5590bc638390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:09.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.595+0000 7f27cf7fe640 1 --2- 172.21.15.2:0/2618129364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590bc6295d0 0x5590bc638390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:09.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.595+0000 7f27cf7fe640 1 -- 172.21.15.2:0/2618129364 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590bc6add20 con 0x5590bc634370 2024-09-19T06:24:09.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.595+0000 7f27ce7fc640 1 --2- 172.21.15.2:0/2618129364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590bc62ab40 0x5590bc6388d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:24:09.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.595+0000 7f27ceffd640 1 --2- 172.21.15.2:0/2618129364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590bc6295d0 0x5590bc638390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:24:09.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.595+0000 7f27cf7fe640 1 --2- 172.21.15.2:0/2618129364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590bc634370 0x5590bc638e10 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f27c80042d0 tx=0x7f27c8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7425dfc0f4767f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:09.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.595+0000 7f27aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:24:09.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.596+0000 7f27aeffd640 1 -- 172.21.15.2:0/2618129364 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c8010c70 con 0x5590bc634370 2024-09-19T06:24:09.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.596+0000 7f27aeffd640 1 -- 172.21.15.2:0/2618129364 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8565+0+0 (secure 0 0 0) 0x7f27c8028410 con 0x5590bc634370 2024-09-19T06:24:09.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.596+0000 7f27d7c64740 1 -- 172.21.15.2:0/2618129364 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27c0054070 con 0x5590bc634370 2024-09-19T06:24:09.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.596+0000 7f27aeffd640 1 -- 172.21.15.2:0/2618129364 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f27c8010e10 con 0x5590bc634370 2024-09-19T06:24:09.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.596+0000 7f27d7c64740 10 client.18717 fetch_fsmap learned FSMap version 26 2024-09-19T06:24:09.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.596+0000 7f27d7c64740 1 -- 172.21.15.2:0/2618129364 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5590bc6aefd0 con 0x5590bc634370 2024-09-19T06:24:09.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.596+0000 7f27aeffd640 1 -- 172.21.15.2:0/2618129364 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f27c0054070 con 0x5590bc634370 2024-09-19T06:24:09.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.596+0000 7f27aeffd640 1 -- 172.21.15.2:0/2618129364 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f27c802f070 con 0x5590bc634370 2024-09-19T06:24:09.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.596+0000 7f27d7c64740 10 client.18717 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:24:09.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.596+0000 7f27d7c64740 10 client.18717 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:24:09.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.596+0000 7f27d7c64740 20 client.18717 populate_metadata read hostname 'smithi002' 2024-09-19T06:24:09.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.596+0000 7f27d7c64740 1 --2- 172.21.15.2:0/2618129364 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5590bc6af750 0x5590bc6b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:09.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.596+0000 7f27d7c64740 4 client.18717 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:24:09.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.596+0000 7f27d7c64740 1 -- 172.21.15.2:0/2618129364 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5590bc596d70 con 0x5590bc6af750 2024-09-19T06:24:09.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.597+0000 7f27ceffd640 1 --2- 172.21.15.2:0/2618129364 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5590bc6af750 0x5590bc6b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:09.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.597+0000 7f27ceffd640 1 --2- 172.21.15.2:0/2618129364 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5590bc6af750 0x5590bc6b1b70 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf2f463c749e1449 server_cookie=943bae0f6354a293 in_seq=0 out_seq=0 2024-09-19T06:24:09.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.597+0000 7f27aeffd640 10 client.18717 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:09.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.597+0000 7f27aeffd640 1 -- 172.21.15.2:0/2618129364 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5590bc596d70 con 0x5590bc6af750 2024-09-19T06:24:09.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.597+0000 7f27aeffd640 10 client.18717 handle_command_reply: tid=0 2024-09-19T06:24:09.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.597+0000 7f27d7c64740 1 client.18717 shutdown 2024-09-19T06:24:09.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.597+0000 7f27d7c64740 1 -- 172.21.15.2:0/2618129364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590bc634370 msgr2=0x5590bc638e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:09.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.597+0000 7f27d7c64740 1 --2- 172.21.15.2:0/2618129364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590bc634370 0x5590bc638e10 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f27c80042d0 tx=0x7f27c8009bb0 comp rx=0 tx=0).stop 2024-09-19T06:24:09.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.598+0000 7f27d7c64740 1 -- 172.21.15.2:0/2618129364 shutdown_connections 2024-09-19T06:24:09.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.598+0000 7f27d7c64740 1 --2- 172.21.15.2:0/2618129364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590bc634370 0x5590bc638e10 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:09.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.598+0000 7f27d7c64740 1 --2- 172.21.15.2:0/2618129364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590bc62ab40 0x5590bc6388d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:09.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.598+0000 7f27d7c64740 1 --2- 172.21.15.2:0/2618129364 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5590bc6af750 0x5590bc6b1b70 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:09.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.598+0000 7f27d7c64740 1 --2- 172.21.15.2:0/2618129364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5590bc6295d0 0x5590bc638390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:09.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.598+0000 7f27aeffd640 0 client.18717 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:09.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.598+0000 7f27d7c64740 1 -- 172.21.15.2:0/2618129364 >> 172.21.15.2:0/2618129364 conn(0x5590bc5f2310 msgr2=0x5590bc6244e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:09.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.598+0000 7f27d7c64740 1 -- 172.21.15.2:0/2618129364 shutdown_connections 2024-09-19T06:24:09.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.598+0000 7f27d7c64740 1 -- 172.21.15.2:0/2618129364 wait complete. 2024-09-19T06:24:09.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.598+0000 7f27d7c64740 20 client.18717 trim_cache size 0 max 16384 2024-09-19T06:24:09.610 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:24:09.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.598+0000 7f27d588b640 1 -- 172.21.15.2:0/2702652507 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f27b80a33b0 msgr2=0x7f27b80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:09.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.598+0000 7f27d588b640 1 --2- 172.21.15.2:0/2702652507 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f27b80a33b0 0x7f27b80a5870 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f27c8005c40 tx=0x7f27c8009500 comp rx=0 tx=0).stop 2024-09-19T06:24:09.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.598+0000 7f27d588b640 1 -- 172.21.15.2:0/2702652507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27d0102570 msgr2=0x7f27d019aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:09.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.598+0000 7f27d588b640 1 --2- 172.21.15.2:0/2702652507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27d0102570 0x7f27d019aad0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f27c400c920 tx=0x7f27c400cde0 comp rx=0 tx=0).stop 2024-09-19T06:24:09.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.598+0000 7f27d588b640 1 -- 172.21.15.2:0/2702652507 shutdown_connections 2024-09-19T06:24:09.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.598+0000 7f27d588b640 1 --2- 172.21.15.2:0/2702652507 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f27b80a33b0 0x7f27b80a5870 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:09.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.598+0000 7f27d588b640 1 --2- 172.21.15.2:0/2702652507 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27d0102ef0 0x7f27d019ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:09.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.598+0000 7f27d588b640 1 --2- 172.21.15.2:0/2702652507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27d0102570 0x7f27d019aad0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:09.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.598+0000 7f27d588b640 1 --2- 172.21.15.2:0/2702652507 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27d0100e20 0x7f27d019a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:09.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.598+0000 7f27d588b640 1 -- 172.21.15.2:0/2702652507 >> 172.21.15.2:0/2702652507 conn(0x7f27d00fc7d0 msgr2=0x7f27d006a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:09.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.599+0000 7f27d588b640 1 -- 172.21.15.2:0/2702652507 shutdown_connections 2024-09-19T06:24:09.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:09.599+0000 7f27d588b640 1 -- 172.21.15.2:0/2702652507 wait complete. 2024-09-19T06:24:09.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:09 smithi090 ceph-mon[34497]: pgmap v289: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-19T06:24:09.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:09 smithi090 ceph-mon[34497]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T06:24:09.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:09 smithi089 ceph-mon[34160]: pgmap v289: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-19T06:24:09.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:09 smithi089 ceph-mon[34160]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T06:24:11.372 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:24:11.372 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:24:11.642 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:24:11.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:11 smithi002 ceph-mon[30982]: pgmap v291: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-19T06:24:11.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:11 smithi090 ceph-mon[34497]: pgmap v291: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-19T06:24:11.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:11 smithi089 ceph-mon[34160]: pgmap v291: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-19T06:24:12.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.095+0000 7f858f325640 1 -- 172.21.15.2:0/3482853654 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8588101de0 msgr2=0x7f85881021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:12.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.095+0000 7f858f325640 1 --2- 172.21.15.2:0/3482853654 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8588101de0 0x7f85881021c0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f8584009900 tx=0x7f858402a410 comp rx=0 tx=0).stop 2024-09-19T06:24:12.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.095+0000 7f858f325640 1 -- 172.21.15.2:0/3482853654 shutdown_connections 2024-09-19T06:24:12.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.095+0000 7f858f325640 1 --2- 172.21.15.2:0/3482853654 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8588106f10 0x7f858810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:12.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.095+0000 7f858f325640 1 --2- 172.21.15.2:0/3482853654 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8588102790 0x7f85881067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:12.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.095+0000 7f858f325640 1 --2- 172.21.15.2:0/3482853654 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8588101de0 0x7f85881021c0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:12.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.095+0000 7f858f325640 1 -- 172.21.15.2:0/3482853654 >> 172.21.15.2:0/3482853654 conn(0x7f85880fd8c0 msgr2=0x7f85880ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:12.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.095+0000 7f858f325640 1 -- 172.21.15.2:0/3482853654 shutdown_connections 2024-09-19T06:24:12.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.095+0000 7f858f325640 1 -- 172.21.15.2:0/3482853654 wait complete. 2024-09-19T06:24:12.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.096+0000 7f858f325640 1 Processor -- start 2024-09-19T06:24:12.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.096+0000 7f858f325640 1 -- start start 2024-09-19T06:24:12.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.096+0000 7f858f325640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8588101de0 0x7f8588198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:12.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.096+0000 7f858f325640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8588102790 0x7f85881988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:12.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.096+0000 7f858f325640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8588106f10 0x7f858819cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:12.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.096+0000 7f858f325640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8588111e40 con 0x7f8588101de0 2024-09-19T06:24:12.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.096+0000 7f858f325640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8588111cc0 con 0x7f8588106f10 2024-09-19T06:24:12.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.096+0000 7f858f325640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8588111fc0 con 0x7f8588102790 2024-09-19T06:24:12.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.097+0000 7f858d0c1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8588101de0 0x7f8588198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:12.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.097+0000 7f858d0c1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8588101de0 0x7f8588198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37564/0 (socket says 172.21.15.2:37564) 2024-09-19T06:24:12.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.097+0000 7f858d0c1640 1 -- 172.21.15.2:0/786832622 learned_addr learned my addr 172.21.15.2:0/786832622 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:12.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.097+0000 7f858d8c2640 1 --2- 172.21.15.2:0/786832622 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8588106f10 0x7f858819cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:12.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.097+0000 7f858c8c0640 1 --2- 172.21.15.2:0/786832622 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8588102790 0x7f85881988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:12.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.097+0000 7f858d0c1640 1 -- 172.21.15.2:0/786832622 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8588102790 msgr2=0x7f85881988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:12.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.097+0000 7f858d0c1640 1 --2- 172.21.15.2:0/786832622 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8588102790 0x7f85881988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:12.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.097+0000 7f858d0c1640 1 -- 172.21.15.2:0/786832622 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8588106f10 msgr2=0x7f858819cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:12.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.097+0000 7f858d0c1640 1 --2- 172.21.15.2:0/786832622 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8588106f10 0x7f858819cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:12.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.097+0000 7f858d0c1640 1 -- 172.21.15.2:0/786832622 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f858819d330 con 0x7f8588101de0 2024-09-19T06:24:12.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.097+0000 7f858d0c1640 1 --2- 172.21.15.2:0/786832622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8588101de0 0x7f8588198380 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f8584006010 tx=0x7f8584004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:12.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.097+0000 7f857e7fc640 1 -- 172.21.15.2:0/786832622 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858403f030 con 0x7f8588101de0 2024-09-19T06:24:12.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.097+0000 7f857e7fc640 1 -- 172.21.15.2:0/786832622 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f85840035f0 con 0x7f8588101de0 2024-09-19T06:24:12.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.097+0000 7f858f325640 1 -- 172.21.15.2:0/786832622 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f858819d5c0 con 0x7f8588101de0 2024-09-19T06:24:12.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.097+0000 7f857e7fc640 1 -- 172.21.15.2:0/786832622 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8584035070 con 0x7f8588101de0 2024-09-19T06:24:12.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.098+0000 7f858f325640 1 -- 172.21.15.2:0/786832622 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85881a4f00 con 0x7f8588101de0 2024-09-19T06:24:12.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.100+0000 7f857e7fc640 1 -- 172.21.15.2:0/786832622 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f8584003b10 con 0x7f8588101de0 2024-09-19T06:24:12.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.100+0000 7f85916fe740 1 Processor -- start 2024-09-19T06:24:12.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.100+0000 7f85916fe740 1 -- start start 2024-09-19T06:24:12.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.100+0000 7f85916fe740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5bdac2b60 0x55a5bdac2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:12.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.100+0000 7f85916fe740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a5bdac3480 0x55a5bdacd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:12.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.101+0000 7f85916fe740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a5bdacdd40 0x55a5bdad0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:12.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.101+0000 7f85916fe740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a5bda28280 con 0x55a5bdac2b60 2024-09-19T06:24:12.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.101+0000 7f85916fe740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55a5bd9cfb10 con 0x55a5bdacdd40 2024-09-19T06:24:12.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.101+0000 7f85916fe740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55a5bda24240 con 0x55a5bdac3480 2024-09-19T06:24:12.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.101+0000 7f858d8c2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5bdac2b60 0x55a5bdac2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:12.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.101+0000 7f858d8c2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5bdac2b60 0x55a5bdac2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37566/0 (socket says 172.21.15.2:37566) 2024-09-19T06:24:12.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.101+0000 7f858d8c2640 1 -- 172.21.15.2:0/811282919 learned_addr learned my addr 172.21.15.2:0/811282919 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:12.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.101+0000 7f858c8c0640 1 --2- 172.21.15.2:0/811282919 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a5bdacdd40 0x55a5bdad0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:12.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.101+0000 7f858d0c1640 1 --2- 172.21.15.2:0/811282919 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a5bdac3480 0x55a5bdacd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:12.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.101+0000 7f858d8c2640 1 -- 172.21.15.2:0/811282919 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a5bdac3480 msgr2=0x55a5bdacd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:12.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.101+0000 7f858d8c2640 1 --2- 172.21.15.2:0/811282919 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a5bdac3480 0x55a5bdacd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:12.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.101+0000 7f858d8c2640 1 -- 172.21.15.2:0/811282919 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a5bdacdd40 msgr2=0x55a5bdad0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:12.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.101+0000 7f858d8c2640 1 --2- 172.21.15.2:0/811282919 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a5bdacdd40 0x55a5bdad0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:12.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.101+0000 7f857e7fc640 1 --2- 172.21.15.2:0/786832622 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f85740a3430 0x7f85740a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:12.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.101+0000 7f858d8c2640 1 -- 172.21.15.2:0/811282919 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5bd9dc1f0 con 0x55a5bdac2b60 2024-09-19T06:24:12.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.101+0000 7f858c8c0640 1 --2- 172.21.15.2:0/811282919 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a5bdacdd40 0x55a5bdad0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:24:12.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.101+0000 7f858d0c1640 1 --2- 172.21.15.2:0/786832622 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f85740a3430 0x7f85740a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:12.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.101+0000 7f858d8c2640 1 --2- 172.21.15.2:0/811282919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5bdac2b60 0x55a5bdac2f40 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f8580007f40 tx=0x7f858000f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb27cdfe77ee9ad3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:12.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.101+0000 7f857e7fc640 1 -- 172.21.15.2:0/786832622 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8565+0+0 (secure 0 0 0) 0x7f85840f0760 con 0x7f8588101de0 2024-09-19T06:24:12.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.101+0000 7f85737fe640 1 -- 172.21.15.2:0/811282919 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8580010900 con 0x55a5bdac2b60 2024-09-19T06:24:12.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.102+0000 7f85737fe640 1 -- 172.21.15.2:0/811282919 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f85800183f0 con 0x55a5bdac2b60 2024-09-19T06:24:12.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.102+0000 7f85737fe640 1 -- 172.21.15.2:0/811282919 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8580017600 con 0x55a5bdac2b60 2024-09-19T06:24:12.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.102+0000 7f85916fe740 1 -- 172.21.15.2:0/811282919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5bdac2b60 msgr2=0x55a5bdac2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:12.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.102+0000 7f858d0c1640 1 --2- 172.21.15.2:0/786832622 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f85740a3430 0x7f85740a58f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f85840edf30 tx=0x7f858402a410 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:12.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.102+0000 7f85916fe740 1 --2- 172.21.15.2:0/811282919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5bdac2b60 0x55a5bdac2f40 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f8580007f40 tx=0x7f858000f850 comp rx=0 tx=0).stop 2024-09-19T06:24:12.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.102+0000 7f85916fe740 1 -- 172.21.15.2:0/811282919 shutdown_connections 2024-09-19T06:24:12.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.102+0000 7f85916fe740 1 --2- 172.21.15.2:0/811282919 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a5bdacdd40 0x55a5bdad0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:12.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.102+0000 7f85916fe740 1 --2- 172.21.15.2:0/811282919 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a5bdac3480 0x55a5bdacd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:12.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.102+0000 7f85916fe740 1 --2- 172.21.15.2:0/811282919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5bdac2b60 0x55a5bdac2f40 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:12.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.102+0000 7f85916fe740 1 -- 172.21.15.2:0/811282919 >> 172.21.15.2:0/811282919 conn(0x55a5bdabf0f0 msgr2=0x55a5bdabf4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:12.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.102+0000 7f85916fe740 1 -- 172.21.15.2:0/811282919 shutdown_connections 2024-09-19T06:24:12.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.102+0000 7f85916fe740 1 -- 172.21.15.2:0/811282919 wait complete. 2024-09-19T06:24:12.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.103+0000 7f85916fe740 1 -- start start 2024-09-19T06:24:12.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.103+0000 7f85916fe740 1 Processor -- start 2024-09-19T06:24:12.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.103+0000 7f85916fe740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5bdac2b60 0x55a5bdacabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:12.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.103+0000 7f85916fe740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a5bdac3480 0x55a5bdacb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:12.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.103+0000 7f85916fe740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a5bdacdd40 0x55a5bdacb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:12.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.103+0000 7f85916fe740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a5bdad0910 con 0x55a5bdac2b60 2024-09-19T06:24:12.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.103+0000 7f85916fe740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55a5bd9e2f10 con 0x55a5bdacdd40 2024-09-19T06:24:12.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.103+0000 7f85916fe740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55a5bdad0a90 con 0x55a5bdac3480 2024-09-19T06:24:12.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.103+0000 7f85916fe740 10 client.0 _ll_register_callbacks cb 0x55a5bd9aba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:12.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.103+0000 7f858d8c2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5bdac2b60 0x55a5bdacabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:12.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.103+0000 7f858d8c2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5bdac2b60 0x55a5bdacabb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37582/0 (socket says 172.21.15.2:37582) 2024-09-19T06:24:12.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.103+0000 7f858d8c2640 1 -- 172.21.15.2:0/3916682760 learned_addr learned my addr 172.21.15.2:0/3916682760 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:12.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.104+0000 7f858d8c2640 1 -- 172.21.15.2:0/3916682760 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a5bdac3480 msgr2=0x55a5bdacb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:12.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.104+0000 7f858d8c2640 1 --2- 172.21.15.2:0/3916682760 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a5bdac3480 0x55a5bdacb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:12.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.104+0000 7f858d8c2640 1 -- 172.21.15.2:0/3916682760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a5bdacdd40 msgr2=0x55a5bdacb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:12.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.104+0000 7f858d8c2640 1 --2- 172.21.15.2:0/3916682760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a5bdacdd40 0x55a5bdacb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:12.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.104+0000 7f858d8c2640 1 -- 172.21.15.2:0/3916682760 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5bd7996a0 con 0x55a5bdac2b60 2024-09-19T06:24:12.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.104+0000 7f858d8c2640 1 --2- 172.21.15.2:0/3916682760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5bdac2b60 0x55a5bdacabb0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f8580005cc0 tx=0x7f8580007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=179e835671079462 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:12.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.104+0000 7f8570ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:24:12.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.104+0000 7f8570ff9640 1 -- 172.21.15.2:0/3916682760 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8580003e40 con 0x55a5bdac2b60 2024-09-19T06:24:12.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.104+0000 7f8570ff9640 1 -- 172.21.15.2:0/3916682760 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8565+0+0 (secure 0 0 0) 0x7f8580010700 con 0x55a5bdac2b60 2024-09-19T06:24:12.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.104+0000 7f85916fe740 1 -- 172.21.15.2:0/3916682760 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85800183f0 con 0x55a5bdac2b60 2024-09-19T06:24:12.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.104+0000 7f8570ff9640 1 -- 172.21.15.2:0/3916682760 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8580010900 con 0x55a5bdac2b60 2024-09-19T06:24:12.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.104+0000 7f85916fe740 10 client.18729 fetch_fsmap learned FSMap version 26 2024-09-19T06:24:12.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.104+0000 7f85916fe740 1 -- 172.21.15.2:0/3916682760 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a5bdae08b0 con 0x55a5bdac2b60 2024-09-19T06:24:12.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.104+0000 7f8570ff9640 1 -- 172.21.15.2:0/3916682760 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f85800183f0 con 0x55a5bdac2b60 2024-09-19T06:24:12.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.105+0000 7f8570ff9640 1 -- 172.21.15.2:0/3916682760 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f8580023440 con 0x55a5bdac2b60 2024-09-19T06:24:12.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.105+0000 7f85916fe740 10 client.18729 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:24:12.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.105+0000 7f85916fe740 10 client.18729 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:24:12.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.105+0000 7f85916fe740 20 client.18729 populate_metadata read hostname 'smithi002' 2024-09-19T06:24:12.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.105+0000 7f85916fe740 1 --2- 172.21.15.2:0/3916682760 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a5bdae1d10 0x55a5bdae4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:12.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.105+0000 7f85916fe740 4 client.18729 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:24:12.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.105+0000 7f85916fe740 1 -- 172.21.15.2:0/3916682760 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5bda357f0 con 0x55a5bdae1d10 2024-09-19T06:24:12.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.105+0000 7f858c8c0640 1 --2- 172.21.15.2:0/3916682760 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a5bdae1d10 0x55a5bdae4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:12.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.105+0000 7f8570ff9640 10 client.18729 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:12.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.105+0000 7f858c8c0640 1 --2- 172.21.15.2:0/3916682760 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a5bdae1d10 0x55a5bdae4100 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=514fab2c45a09a5e server_cookie=7f21ca248a372859 in_seq=0 out_seq=0 2024-09-19T06:24:12.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.106+0000 7f8570ff9640 1 -- 172.21.15.2:0/3916682760 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a5bda357f0 con 0x55a5bdae1d10 2024-09-19T06:24:12.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.106+0000 7f8570ff9640 10 client.18729 handle_command_reply: tid=0 2024-09-19T06:24:12.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.106+0000 7f85916fe740 1 client.18729 shutdown 2024-09-19T06:24:12.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.106+0000 7f85916fe740 1 -- 172.21.15.2:0/3916682760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5bdac2b60 msgr2=0x55a5bdacabb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:12.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.106+0000 7f85916fe740 1 --2- 172.21.15.2:0/3916682760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5bdac2b60 0x55a5bdacabb0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f8580005cc0 tx=0x7f8580007c90 comp rx=0 tx=0).stop 2024-09-19T06:24:12.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.106+0000 7f85916fe740 1 -- 172.21.15.2:0/3916682760 shutdown_connections 2024-09-19T06:24:12.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.106+0000 7f85916fe740 1 --2- 172.21.15.2:0/3916682760 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a5bdae1d10 0x55a5bdae4100 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:12.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.106+0000 7f85916fe740 1 --2- 172.21.15.2:0/3916682760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a5bdacdd40 0x55a5bdacb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:12.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.106+0000 7f85916fe740 1 --2- 172.21.15.2:0/3916682760 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a5bdac3480 0x55a5bdacb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:12.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.106+0000 7f85916fe740 1 --2- 172.21.15.2:0/3916682760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5bdac2b60 0x55a5bdacabb0 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:12.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.106+0000 7f8570ff9640 0 client.18729 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:12.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.106+0000 7f85916fe740 1 -- 172.21.15.2:0/3916682760 >> 172.21.15.2:0/3916682760 conn(0x55a5bdabf0f0 msgr2=0x55a5bdabe270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:12.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.106+0000 7f85916fe740 1 -- 172.21.15.2:0/3916682760 shutdown_connections 2024-09-19T06:24:12.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.106+0000 7f85916fe740 1 -- 172.21.15.2:0/3916682760 wait complete. 2024-09-19T06:24:12.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.107+0000 7f85916fe740 20 client.18729 trim_cache size 0 max 16384 2024-09-19T06:24:12.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.124+0000 7f85916fe740 1 Processor -- start 2024-09-19T06:24:12.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.124+0000 7f85916fe740 1 -- start start 2024-09-19T06:24:12.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.124+0000 7f85916fe740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5bdac2b60 0x55a5bdac55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:12.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.124+0000 7f85916fe740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a5bdac3480 0x55a5bdacca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:12.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.124+0000 7f85916fe740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a5bdacdd40 0x55a5bdae9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:12.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.124+0000 7f85916fe740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f85881adf30 con 0x55a5bdac2b60 2024-09-19T06:24:12.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.124+0000 7f85916fe740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f85881ab800 con 0x55a5bdacdd40 2024-09-19T06:24:12.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.124+0000 7f85916fe740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f85881a9670 con 0x55a5bdac3480 2024-09-19T06:24:12.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.124+0000 7f858d8c2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5bdac2b60 0x55a5bdac55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:12.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.124+0000 7f858d8c2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5bdac2b60 0x55a5bdac55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37596/0 (socket says 172.21.15.2:37596) 2024-09-19T06:24:12.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.124+0000 7f858d8c2640 1 -- 172.21.15.2:0/3781051750 learned_addr learned my addr 172.21.15.2:0/3781051750 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:12.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.125+0000 7f858c8c0640 1 --2- 172.21.15.2:0/3781051750 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a5bdac3480 0x55a5bdacca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:12.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.125+0000 7f858d8c2640 1 -- 172.21.15.2:0/3781051750 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a5bdac3480 msgr2=0x55a5bdacca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:12.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.125+0000 7f858d8c2640 1 --2- 172.21.15.2:0/3781051750 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a5bdac3480 0x55a5bdacca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:12.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.125+0000 7f858d8c2640 1 -- 172.21.15.2:0/3781051750 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a5bdacdd40 msgr2=0x55a5bdae9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:12.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.125+0000 7f858d8c2640 1 --2- 172.21.15.2:0/3781051750 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a5bdacdd40 0x55a5bdae9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:12.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.125+0000 7f858d8c2640 1 -- 172.21.15.2:0/3781051750 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5bdabef20 con 0x55a5bdac2b60 2024-09-19T06:24:12.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.125+0000 7f858d8c2640 1 --2- 172.21.15.2:0/3781051750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5bdac2b60 0x55a5bdac55c0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f8580002230 tx=0x7f8580007f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ce4a27bb93e8643 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:12.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.125+0000 7f8572ffd640 1 -- 172.21.15.2:0/3781051750 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858003c070 con 0x55a5bdac2b60 2024-09-19T06:24:12.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.125+0000 7f8572ffd640 1 -- 172.21.15.2:0/3781051750 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8580028070 con 0x55a5bdac2b60 2024-09-19T06:24:12.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.125+0000 7f8572ffd640 1 -- 172.21.15.2:0/3781051750 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8580018c70 con 0x55a5bdac2b60 2024-09-19T06:24:12.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.126+0000 7f85916fe740 1 -- 172.21.15.2:0/3781051750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5bdac2b60 msgr2=0x55a5bdac55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:12.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.126+0000 7f85916fe740 1 --2- 172.21.15.2:0/3781051750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5bdac2b60 0x55a5bdac55c0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f8580002230 tx=0x7f8580007f10 comp rx=0 tx=0).stop 2024-09-19T06:24:12.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.126+0000 7f85916fe740 1 -- 172.21.15.2:0/3781051750 shutdown_connections 2024-09-19T06:24:12.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.126+0000 7f85916fe740 1 --2- 172.21.15.2:0/3781051750 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a5bdacdd40 0x55a5bdae9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:12.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.126+0000 7f85916fe740 1 --2- 172.21.15.2:0/3781051750 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a5bdac3480 0x55a5bdacca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:12.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.126+0000 7f85916fe740 1 --2- 172.21.15.2:0/3781051750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5bdac2b60 0x55a5bdac55c0 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:12.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.126+0000 7f85916fe740 1 -- 172.21.15.2:0/3781051750 >> 172.21.15.2:0/3781051750 conn(0x55a5bdabf0f0 msgr2=0x55a5bdacc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:12.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.126+0000 7f85916fe740 1 -- 172.21.15.2:0/3781051750 shutdown_connections 2024-09-19T06:24:12.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.126+0000 7f85916fe740 1 -- 172.21.15.2:0/3781051750 wait complete. 2024-09-19T06:24:12.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.126+0000 7f85916fe740 1 -- start start 2024-09-19T06:24:12.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.126+0000 7f85916fe740 1 Processor -- start 2024-09-19T06:24:12.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.127+0000 7f85916fe740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a5bdac2b60 0x55a5bdad5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:12.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.127+0000 7f85916fe740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a5bdac3480 0x55a5bdad6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:12.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.127+0000 7f85916fe740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5bdacdd40 0x55a5bdad6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:12.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.127+0000 7f85916fe740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f85881a9cc0 con 0x55a5bdacdd40 2024-09-19T06:24:12.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.127+0000 7f85916fe740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f85881ab130 con 0x55a5bdac3480 2024-09-19T06:24:12.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.127+0000 7f85916fe740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f85881aa390 con 0x55a5bdac2b60 2024-09-19T06:24:12.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.127+0000 7f85916fe740 10 client.0 _ll_register_callbacks cb 0x7f8580007d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:12.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.127+0000 7f858d8c2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5bdacdd40 0x55a5bdad6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:12.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.127+0000 7f858d8c2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5bdacdd40 0x55a5bdad6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37608/0 (socket says 172.21.15.2:37608) 2024-09-19T06:24:12.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.127+0000 7f858d8c2640 1 -- 172.21.15.2:0/3185117001 learned_addr learned my addr 172.21.15.2:0/3185117001 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:12.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.127+0000 7f858d8c2640 1 --2- 172.21.15.2:0/3185117001 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a5bdac2b60 0x55a5bdad5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:12.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.127+0000 7f858c8c0640 1 --2- 172.21.15.2:0/3185117001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a5bdac3480 0x55a5bdad6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:12.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.127+0000 7f858d8c2640 1 -- 172.21.15.2:0/3185117001 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a5bdac2b60 msgr2=0x55a5bdad5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:12.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.127+0000 7f858d8c2640 1 --2- 172.21.15.2:0/3185117001 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a5bdac2b60 0x55a5bdad5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:12.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.127+0000 7f858d8c2640 1 -- 172.21.15.2:0/3185117001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a5bdac3480 msgr2=0x55a5bdad6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:12.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.127+0000 7f858d8c2640 1 --2- 172.21.15.2:0/3185117001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a5bdac3480 0x55a5bdad6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:12.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.127+0000 7f858d8c2640 1 -- 172.21.15.2:0/3185117001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5bdaba830 con 0x55a5bdacdd40 2024-09-19T06:24:12.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.127+0000 7f858d8c2640 1 --2- 172.21.15.2:0/3185117001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5bdacdd40 0x55a5bdad6990 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f8580005ef0 tx=0x7f85800184f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=642e48dca4ab943e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:12.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.127+0000 7f8570ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:24:12.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.127+0000 7f8570ff9640 1 -- 172.21.15.2:0/3185117001 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858003c070 con 0x55a5bdacdd40 2024-09-19T06:24:12.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.127+0000 7f85916fe740 1 -- 172.21.15.2:0/3185117001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8580028070 con 0x55a5bdacdd40 2024-09-19T06:24:12.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.127+0000 7f8570ff9640 1 -- 172.21.15.2:0/3185117001 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8565+0+0 (secure 0 0 0) 0x7f8580010cb0 con 0x55a5bdacdd40 2024-09-19T06:24:12.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.128+0000 7f8570ff9640 1 -- 172.21.15.2:0/3185117001 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8580023ce0 con 0x55a5bdacdd40 2024-09-19T06:24:12.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.128+0000 7f85916fe740 10 client.18735 fetch_fsmap learned FSMap version 26 2024-09-19T06:24:12.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.128+0000 7f85916fe740 1 -- 172.21.15.2:0/3185117001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a5bdb4c870 con 0x55a5bdacdd40 2024-09-19T06:24:12.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.128+0000 7f8570ff9640 1 -- 172.21.15.2:0/3185117001 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8580028070 con 0x55a5bdacdd40 2024-09-19T06:24:12.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.128+0000 7f8570ff9640 1 -- 172.21.15.2:0/3185117001 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f8580037500 con 0x55a5bdacdd40 2024-09-19T06:24:12.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.128+0000 7f85916fe740 10 client.18735 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:24:12.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.128+0000 7f85916fe740 10 client.18735 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:24:12.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.128+0000 7f85916fe740 20 client.18735 populate_metadata read hostname 'smithi002' 2024-09-19T06:24:12.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.128+0000 7f85916fe740 1 --2- 172.21.15.2:0/3185117001 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a5bdb4cd40 0x55a5bdb4f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:12.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.128+0000 7f85916fe740 4 client.18735 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:24:12.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.128+0000 7f85916fe740 1 -- 172.21.15.2:0/3185117001 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a5bda2fd00 con 0x55a5bdb4cd40 2024-09-19T06:24:12.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.128+0000 7f858c8c0640 1 --2- 172.21.15.2:0/3185117001 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a5bdb4cd40 0x55a5bdb4f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:12.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.129+0000 7f858c8c0640 1 --2- 172.21.15.2:0/3185117001 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a5bdb4cd40 0x55a5bdb4f130 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e81d7cda2f8646 server_cookie=a9c32b1071769f98 in_seq=0 out_seq=0 2024-09-19T06:24:12.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.129+0000 7f8570ff9640 10 client.18735 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:12.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.130+0000 7f8570ff9640 1 -- 172.21.15.2:0/3185117001 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a5bda2fd00 con 0x55a5bdb4cd40 2024-09-19T06:24:12.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.130+0000 7f8570ff9640 10 client.18735 handle_command_reply: tid=0 2024-09-19T06:24:12.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.130+0000 7f85916fe740 1 client.18735 shutdown 2024-09-19T06:24:12.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.130+0000 7f85916fe740 1 -- 172.21.15.2:0/3185117001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5bdacdd40 msgr2=0x55a5bdad6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:12.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.130+0000 7f85916fe740 1 --2- 172.21.15.2:0/3185117001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5bdacdd40 0x55a5bdad6990 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f8580005ef0 tx=0x7f85800184f0 comp rx=0 tx=0).stop 2024-09-19T06:24:12.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.130+0000 7f85916fe740 1 -- 172.21.15.2:0/3185117001 shutdown_connections 2024-09-19T06:24:12.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.130+0000 7f85916fe740 1 --2- 172.21.15.2:0/3185117001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5bdacdd40 0x55a5bdad6990 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:12.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.130+0000 7f85916fe740 1 --2- 172.21.15.2:0/3185117001 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55a5bdb4cd40 0x55a5bdb4f130 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:12.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.130+0000 7f85916fe740 1 --2- 172.21.15.2:0/3185117001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a5bdac3480 0x55a5bdad6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:12.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.130+0000 7f85916fe740 1 --2- 172.21.15.2:0/3185117001 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a5bdac2b60 0x55a5bdad5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:12.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.130+0000 7f85916fe740 1 -- 172.21.15.2:0/3185117001 >> 172.21.15.2:0/3185117001 conn(0x55a5bdabf0f0 msgr2=0x55a5bdacca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:12.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.130+0000 7f8570ff9640 0 client.18735 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:12.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.130+0000 7f85916fe740 1 -- 172.21.15.2:0/3185117001 shutdown_connections 2024-09-19T06:24:12.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.130+0000 7f85916fe740 1 -- 172.21.15.2:0/3185117001 wait complete. 2024-09-19T06:24:12.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.130+0000 7f85916fe740 20 client.18735 trim_cache size 0 max 16384 2024-09-19T06:24:12.137 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:24:12.137 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T06:24:12.137 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "2b9398a6-7f14-40d9-bb5c-8a08ddda5c83", 2024-09-19T06:24:12.137 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T06:24:12.137 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:24:12.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.131+0000 7f858f325640 1 -- 172.21.15.2:0/786832622 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f85740a3430 msgr2=0x7f85740a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:12.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.131+0000 7f858f325640 1 --2- 172.21.15.2:0/786832622 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f85740a3430 0x7f85740a58f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f85840edf30 tx=0x7f858402a410 comp rx=0 tx=0).stop 2024-09-19T06:24:12.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.131+0000 7f858f325640 1 -- 172.21.15.2:0/786832622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8588101de0 msgr2=0x7f8588198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:12.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.131+0000 7f858f325640 1 --2- 172.21.15.2:0/786832622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8588101de0 0x7f8588198380 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f8584006010 tx=0x7f8584004270 comp rx=0 tx=0).stop 2024-09-19T06:24:12.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.131+0000 7f858f325640 1 -- 172.21.15.2:0/786832622 shutdown_connections 2024-09-19T06:24:12.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.131+0000 7f858f325640 1 --2- 172.21.15.2:0/786832622 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f85740a3430 0x7f85740a58f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:12.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.131+0000 7f858f325640 1 --2- 172.21.15.2:0/786832622 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8588106f10 0x7f858819cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:12.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.131+0000 7f858f325640 1 --2- 172.21.15.2:0/786832622 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8588102790 0x7f85881988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:12.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.131+0000 7f858f325640 1 --2- 172.21.15.2:0/786832622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8588101de0 0x7f8588198380 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:12.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.131+0000 7f858f325640 1 -- 172.21.15.2:0/786832622 >> 172.21.15.2:0/786832622 conn(0x7f85880fd8c0 msgr2=0x7f85880fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:12.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.131+0000 7f858f325640 1 -- 172.21.15.2:0/786832622 shutdown_connections 2024-09-19T06:24:12.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:12.131+0000 7f858f325640 1 -- 172.21.15.2:0/786832622 wait complete. 2024-09-19T06:24:12.925 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:24:13.186 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:24:13.620 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:13 smithi002 ceph-mon[30982]: scrub queued for path: / 2024-09-19T06:24:13.620 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:13 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:24:13.620 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:13 smithi002 ceph-mon[30982]: scrub summary: active paths [/] 2024-09-19T06:24:13.620 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:13 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:24:13.620 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:13 smithi002 ceph-mon[30982]: pgmap v292: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-19T06:24:13.620 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:13 smithi002 ceph-mon[30982]: scrub summary: idle 2024-09-19T06:24:13.620 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:13 smithi002 ceph-mon[30982]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T06:24:13.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.618+0000 7f78b558f640 1 -- 172.21.15.2:0/1719417125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78b01082a0 msgr2=0x7f78b010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:13.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.618+0000 7f78b558f640 1 --2- 172.21.15.2:0/1719417125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78b01082a0 0x7f78b010ec40 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f78a8009cd0 tx=0x7f78a802a8e0 comp rx=0 tx=0).stop 2024-09-19T06:24:13.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.618+0000 7f78b558f640 1 -- 172.21.15.2:0/1719417125 shutdown_connections 2024-09-19T06:24:13.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.618+0000 7f78b558f640 1 --2- 172.21.15.2:0/1719417125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78b01082a0 0x7f78b010ec40 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:13.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.618+0000 7f78b558f640 1 --2- 172.21.15.2:0/1719417125 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78b01036e0 0x7f78b0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:13.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.618+0000 7f78b558f640 1 --2- 172.21.15.2:0/1719417125 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78b0102d30 0x7f78b0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:13.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.618+0000 7f78b558f640 1 -- 172.21.15.2:0/1719417125 >> 172.21.15.2:0/1719417125 conn(0x7f78b00fc7d0 msgr2=0x7f78b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:13.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.618+0000 7f78b558f640 1 -- 172.21.15.2:0/1719417125 shutdown_connections 2024-09-19T06:24:13.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.618+0000 7f78b558f640 1 -- 172.21.15.2:0/1719417125 wait complete. 2024-09-19T06:24:13.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.619+0000 7f78b558f640 1 Processor -- start 2024-09-19T06:24:13.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.619+0000 7f78b558f640 1 -- start start 2024-09-19T06:24:13.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.619+0000 7f78b558f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78b0102d30 0x7f78b0198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:13.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.619+0000 7f78b558f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78b01036e0 0x7f78b01989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:13.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.619+0000 7f78b558f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78b01082a0 0x7f78b019cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:13.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.619+0000 7f78b558f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f78b0111f50 con 0x7f78b01036e0 2024-09-19T06:24:13.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.619+0000 7f78b558f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f78b0111dd0 con 0x7f78b01082a0 2024-09-19T06:24:13.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.619+0000 7f78b558f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f78b01120d0 con 0x7f78b0102d30 2024-09-19T06:24:13.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.619+0000 7f78ae7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78b01036e0 0x7f78b01989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:13.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.619+0000 7f78ae7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78b01036e0 0x7f78b01989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37624/0 (socket says 172.21.15.2:37624) 2024-09-19T06:24:13.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.619+0000 7f78ae7fc640 1 -- 172.21.15.2:0/2506606268 learned_addr learned my addr 172.21.15.2:0/2506606268 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:13.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.620+0000 7f78aeffd640 1 --2- 172.21.15.2:0/2506606268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78b0102d30 0x7f78b0198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:13.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.620+0000 7f78af7fe640 1 --2- 172.21.15.2:0/2506606268 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78b01082a0 0x7f78b019cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:13.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.620+0000 7f78ae7fc640 1 -- 172.21.15.2:0/2506606268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78b0102d30 msgr2=0x7f78b0198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:13.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.620+0000 7f78ae7fc640 1 --2- 172.21.15.2:0/2506606268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78b0102d30 0x7f78b0198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:13.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.620+0000 7f78ae7fc640 1 -- 172.21.15.2:0/2506606268 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78b01082a0 msgr2=0x7f78b019cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:13.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.620+0000 7f78ae7fc640 1 --2- 172.21.15.2:0/2506606268 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78b01082a0 0x7f78b019cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:13.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.620+0000 7f78ae7fc640 1 -- 172.21.15.2:0/2506606268 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b019d420 con 0x7f78b01036e0 2024-09-19T06:24:13.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.620+0000 7f78aeffd640 1 --2- 172.21.15.2:0/2506606268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78b0102d30 0x7f78b0198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:24:13.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.620+0000 7f78af7fe640 1 --2- 172.21.15.2:0/2506606268 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78b01082a0 0x7f78b019cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:24:13.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.620+0000 7f78ae7fc640 1 --2- 172.21.15.2:0/2506606268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78b01036e0 0x7f78b01989b0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f78a400d740 tx=0x7f78a400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:13.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.620+0000 7f7897fff640 1 -- 172.21.15.2:0/2506606268 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a4017070 con 0x7f78b01036e0 2024-09-19T06:24:13.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.620+0000 7f7897fff640 1 -- 172.21.15.2:0/2506606268 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f78a400de50 con 0x7f78b01036e0 2024-09-19T06:24:13.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.620+0000 7f78b558f640 1 -- 172.21.15.2:0/2506606268 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78b019d710 con 0x7f78b01036e0 2024-09-19T06:24:13.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.620+0000 7f7897fff640 1 -- 172.21.15.2:0/2506606268 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a400f620 con 0x7f78b01036e0 2024-09-19T06:24:13.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.620+0000 7f78b558f640 1 -- 172.21.15.2:0/2506606268 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78b01a4ff0 con 0x7f78b01036e0 2024-09-19T06:24:13.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.623+0000 7f7897fff640 1 -- 172.21.15.2:0/2506606268 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f78a401a070 con 0x7f78b01036e0 2024-09-19T06:24:13.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.623+0000 7f78b7968740 1 Processor -- start 2024-09-19T06:24:13.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.623+0000 7f78b7968740 1 -- start start 2024-09-19T06:24:13.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.623+0000 7f78b7968740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ba095b9380 0x55ba095b9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:13.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.623+0000 7f78b7968740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba095b9ca0 0x55ba095c8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:13.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.623+0000 7f78b7968740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba095c8a90 0x55ba095cae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:13.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.623+0000 7f78b7968740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ba0951f2e0 con 0x55ba095b9ca0 2024-09-19T06:24:13.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.623+0000 7f78b7968740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55ba094c6ce0 con 0x55ba095c8a90 2024-09-19T06:24:13.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.623+0000 7f78b7968740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55ba0951b2a0 con 0x55ba095b9380 2024-09-19T06:24:13.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.623+0000 7f78aeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba095b9ca0 0x55ba095c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:13.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.623+0000 7f78aeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba095b9ca0 0x55ba095c8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37640/0 (socket says 172.21.15.2:37640) 2024-09-19T06:24:13.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.623+0000 7f78aeffd640 1 -- 172.21.15.2:0/3361664612 learned_addr learned my addr 172.21.15.2:0/3361664612 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:13.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.623+0000 7f78af7fe640 1 --2- 172.21.15.2:0/3361664612 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ba095b9380 0x55ba095b9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:13.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.623+0000 7f78ae7fc640 1 --2- 172.21.15.2:0/3361664612 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba095c8a90 0x55ba095cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:13.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.624+0000 7f78aeffd640 1 -- 172.21.15.2:0/3361664612 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ba095b9380 msgr2=0x55ba095b9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:13.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.624+0000 7f78aeffd640 1 --2- 172.21.15.2:0/3361664612 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ba095b9380 0x55ba095b9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:13.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.624+0000 7f78aeffd640 1 -- 172.21.15.2:0/3361664612 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba095c8a90 msgr2=0x55ba095cae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:13.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.624+0000 7f78aeffd640 1 --2- 172.21.15.2:0/3361664612 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba095c8a90 0x55ba095cae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:13.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.624+0000 7f7897fff640 1 --2- 172.21.15.2:0/2506606268 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f78980a33b0 0x7f78980a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:13.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.624+0000 7f78aeffd640 1 -- 172.21.15.2:0/3361664612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba094ab440 con 0x55ba095b9ca0 2024-09-19T06:24:13.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.624+0000 7f78ae7fc640 1 --2- 172.21.15.2:0/3361664612 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba095c8a90 0x55ba095cae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:24:13.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.624+0000 7f78af7fe640 1 --2- 172.21.15.2:0/2506606268 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f78980a33b0 0x7f78980a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:13.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.624+0000 7f78aeffd640 1 --2- 172.21.15.2:0/3361664612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba095b9ca0 0x55ba095c8550 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f78a0009c50 tx=0x7f78a000e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb0d0a0bbe285d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:13.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.624+0000 7f7897fff640 1 -- 172.21.15.2:0/2506606268 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7f78a40cf7b0 con 0x7f78b01036e0 2024-09-19T06:24:13.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.624+0000 7f78957fa640 1 -- 172.21.15.2:0/3361664612 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a0016070 con 0x55ba095b9ca0 2024-09-19T06:24:13.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.624+0000 7f78957fa640 1 -- 172.21.15.2:0/3361664612 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f78a00054d0 con 0x55ba095b9ca0 2024-09-19T06:24:13.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.624+0000 7f78957fa640 1 -- 172.21.15.2:0/3361664612 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a0011470 con 0x55ba095b9ca0 2024-09-19T06:24:13.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.625+0000 7f78b7968740 1 -- 172.21.15.2:0/3361664612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba095b9ca0 msgr2=0x55ba095c8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:13.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.625+0000 7f78b7968740 1 --2- 172.21.15.2:0/3361664612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba095b9ca0 0x55ba095c8550 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f78a0009c50 tx=0x7f78a000e6c0 comp rx=0 tx=0).stop 2024-09-19T06:24:13.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.625+0000 7f78af7fe640 1 --2- 172.21.15.2:0/2506606268 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f78980a33b0 0x7f78980a5870 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f78a8009a60 tx=0x7f78a8005d80 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:13.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.625+0000 7f78b7968740 1 -- 172.21.15.2:0/3361664612 shutdown_connections 2024-09-19T06:24:13.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.625+0000 7f78b7968740 1 --2- 172.21.15.2:0/3361664612 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba095c8a90 0x55ba095cae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:13.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.625+0000 7f78b7968740 1 --2- 172.21.15.2:0/3361664612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba095b9ca0 0x55ba095c8550 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:13.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.625+0000 7f78b7968740 1 --2- 172.21.15.2:0/3361664612 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ba095b9380 0x55ba095b9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:13.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.625+0000 7f78b7968740 1 -- 172.21.15.2:0/3361664612 >> 172.21.15.2:0/3361664612 conn(0x55ba095b5a30 msgr2=0x55ba095b5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:13.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.625+0000 7f78b7968740 1 -- 172.21.15.2:0/3361664612 shutdown_connections 2024-09-19T06:24:13.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.625+0000 7f78b7968740 1 -- 172.21.15.2:0/3361664612 wait complete. 2024-09-19T06:24:13.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.625+0000 7f78b7968740 1 -- start start 2024-09-19T06:24:13.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.625+0000 7f78b7968740 1 Processor -- start 2024-09-19T06:24:13.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.626+0000 7f78b7968740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba095b9380 0x55ba095c8330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:13.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.626+0000 7f78b7968740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba095b9ca0 0x55ba095c5630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:13.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.626+0000 7f78b7968740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ba095c8a90 0x55ba095c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:13.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.626+0000 7f78b7968740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ba095cb6b0 con 0x55ba095b9380 2024-09-19T06:24:13.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.626+0000 7f78b7968740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55ba094da050 con 0x55ba095b9ca0 2024-09-19T06:24:13.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.626+0000 7f78b7968740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55ba095cb830 con 0x55ba095c8a90 2024-09-19T06:24:13.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.626+0000 7f78b7968740 10 client.0 _ll_register_callbacks cb 0x55ba0951a160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:13.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.626+0000 7f78aeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba095b9380 0x55ba095c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:13.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.626+0000 7f78aeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba095b9380 0x55ba095c8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37650/0 (socket says 172.21.15.2:37650) 2024-09-19T06:24:13.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.626+0000 7f78aeffd640 1 -- 172.21.15.2:0/4236263926 learned_addr learned my addr 172.21.15.2:0/4236263926 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:13.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.626+0000 7f78ae7fc640 1 --2- 172.21.15.2:0/4236263926 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba095b9ca0 0x55ba095c5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:13.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.626+0000 7f78af7fe640 1 --2- 172.21.15.2:0/4236263926 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ba095c8a90 0x55ba095c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:13.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.626+0000 7f78aeffd640 1 -- 172.21.15.2:0/4236263926 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ba095c8a90 msgr2=0x55ba095c5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:13.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.626+0000 7f78aeffd640 1 --2- 172.21.15.2:0/4236263926 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ba095c8a90 0x55ba095c5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:13.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.626+0000 7f78aeffd640 1 -- 172.21.15.2:0/4236263926 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba095b9ca0 msgr2=0x55ba095c5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:13.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.626+0000 7f78aeffd640 1 --2- 172.21.15.2:0/4236263926 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba095b9ca0 0x55ba095c5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:13.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.626+0000 7f78aeffd640 1 -- 172.21.15.2:0/4236263926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba092903c0 con 0x55ba095b9380 2024-09-19T06:24:13.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.626+0000 7f78aeffd640 1 --2- 172.21.15.2:0/4236263926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba095b9380 0x55ba095c8330 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f78a0005e90 tx=0x7f78a00056f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82fdc2c73808746e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:13.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.626+0000 7f7892ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:24:13.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.626+0000 7f7892ff5640 1 -- 172.21.15.2:0/4236263926 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a0028060 con 0x55ba095b9380 2024-09-19T06:24:13.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.626+0000 7f7892ff5640 1 -- 172.21.15.2:0/4236263926 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7f78a0009d40 con 0x55ba095b9380 2024-09-19T06:24:13.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.626+0000 7f78b7968740 1 -- 172.21.15.2:0/4236263926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78a00054d0 con 0x55ba095b9380 2024-09-19T06:24:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.627+0000 7f7892ff5640 1 -- 172.21.15.2:0/4236263926 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f78a0016040 con 0x55ba095b9380 2024-09-19T06:24:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.627+0000 7f78b7968740 10 client.18747 fetch_fsmap learned FSMap version 26 2024-09-19T06:24:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.627+0000 7f78b7968740 1 -- 172.21.15.2:0/4236263926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ba095d6fd0 con 0x55ba095b9380 2024-09-19T06:24:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.627+0000 7f7892ff5640 1 -- 172.21.15.2:0/4236263926 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f78a00054d0 con 0x55ba095b9380 2024-09-19T06:24:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.627+0000 7f7892ff5640 1 -- 172.21.15.2:0/4236263926 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f78a000f040 con 0x55ba095b9380 2024-09-19T06:24:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.627+0000 7f78b7968740 10 client.18747 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:24:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.627+0000 7f78b7968740 10 client.18747 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:24:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.627+0000 7f78b7968740 20 client.18747 populate_metadata read hostname 'smithi002' 2024-09-19T06:24:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.627+0000 7f78b7968740 1 --2- 172.21.15.2:0/4236263926 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ba095d8490 0x55ba095da880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.627+0000 7f78b7968740 4 client.18747 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:24:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.627+0000 7f78b7968740 1 -- 172.21.15.2:0/4236263926 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba0952c850 con 0x55ba095d8490 2024-09-19T06:24:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.628+0000 7f78ae7fc640 1 --2- 172.21.15.2:0/4236263926 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ba095d8490 0x55ba095da880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:13.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.628+0000 7f7892ff5640 10 client.18747 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:13.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.628+0000 7f78ae7fc640 1 --2- 172.21.15.2:0/4236263926 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ba095d8490 0x55ba095da880 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74df3c38845a11f5 server_cookie=c34ec4f0438f1633 in_seq=0 out_seq=0 2024-09-19T06:24:13.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.629+0000 7f7892ff5640 1 -- 172.21.15.2:0/4236263926 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ba0952c850 con 0x55ba095d8490 2024-09-19T06:24:13.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.629+0000 7f7892ff5640 10 client.18747 handle_command_reply: tid=0 2024-09-19T06:24:13.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.629+0000 7f78b7968740 1 client.18747 shutdown 2024-09-19T06:24:13.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.629+0000 7f78b7968740 1 -- 172.21.15.2:0/4236263926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba095b9380 msgr2=0x55ba095c8330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:13.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.629+0000 7f78b7968740 1 --2- 172.21.15.2:0/4236263926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba095b9380 0x55ba095c8330 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f78a0005e90 tx=0x7f78a00056f0 comp rx=0 tx=0).stop 2024-09-19T06:24:13.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.629+0000 7f78b7968740 1 -- 172.21.15.2:0/4236263926 shutdown_connections 2024-09-19T06:24:13.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.629+0000 7f78b7968740 1 --2- 172.21.15.2:0/4236263926 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ba095c8a90 0x55ba095c5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:13.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.629+0000 7f78b7968740 1 --2- 172.21.15.2:0/4236263926 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ba095d8490 0x55ba095da880 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:13.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.629+0000 7f78b7968740 1 --2- 172.21.15.2:0/4236263926 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba095b9ca0 0x55ba095c5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:13.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.629+0000 7f78b7968740 1 --2- 172.21.15.2:0/4236263926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba095b9380 0x55ba095c8330 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:13.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.629+0000 7f7892ff5640 0 client.18747 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:13.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.629+0000 7f78b7968740 1 -- 172.21.15.2:0/4236263926 >> 172.21.15.2:0/4236263926 conn(0x55ba095b5a30 msgr2=0x55ba095bb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:13.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.629+0000 7f78b7968740 1 -- 172.21.15.2:0/4236263926 shutdown_connections 2024-09-19T06:24:13.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.629+0000 7f78b7968740 1 -- 172.21.15.2:0/4236263926 wait complete. 2024-09-19T06:24:13.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.629+0000 7f78b7968740 20 client.18747 trim_cache size 0 max 16384 2024-09-19T06:24:13.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.646+0000 7f78b7968740 1 Processor -- start 2024-09-19T06:24:13.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.646+0000 7f78b7968740 1 -- start start 2024-09-19T06:24:13.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.646+0000 7f78b7968740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba095b9380 0x55ba095b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:13.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.646+0000 7f78b7968740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ba095b9ca0 0x55ba095c4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:13.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.646+0000 7f78b7968740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba095c8a90 0x55ba095dfe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:13.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.646+0000 7f78b7968740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f78b01adf30 con 0x55ba095c8a90 2024-09-19T06:24:13.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.646+0000 7f78b7968740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f78b01ab800 con 0x55ba095b9380 2024-09-19T06:24:13.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.646+0000 7f78b7968740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f78b01a9670 con 0x55ba095b9ca0 2024-09-19T06:24:13.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.647+0000 7f78af7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba095c8a90 0x55ba095dfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:13.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.647+0000 7f78ae7fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ba095b9ca0 0x55ba095c4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:13.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.647+0000 7f78af7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba095c8a90 0x55ba095dfe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37656/0 (socket says 172.21.15.2:37656) 2024-09-19T06:24:13.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.647+0000 7f78af7fe640 1 -- 172.21.15.2:0/3476220352 learned_addr learned my addr 172.21.15.2:0/3476220352 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:13.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.647+0000 7f78aeffd640 1 --2- 172.21.15.2:0/3476220352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba095b9380 0x55ba095b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:13.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.647+0000 7f78ae7fc640 1 -- 172.21.15.2:0/3476220352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba095b9380 msgr2=0x55ba095b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:13.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.647+0000 7f78ae7fc640 1 --2- 172.21.15.2:0/3476220352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba095b9380 0x55ba095b4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:13.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.647+0000 7f78ae7fc640 1 -- 172.21.15.2:0/3476220352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba095c8a90 msgr2=0x55ba095dfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:13.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.647+0000 7f78ae7fc640 1 --2- 172.21.15.2:0/3476220352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba095c8a90 0x55ba095dfe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:13.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.647+0000 7f78ae7fc640 1 -- 172.21.15.2:0/3476220352 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba095c69b0 con 0x55ba095b9ca0 2024-09-19T06:24:13.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.647+0000 7f78af7fe640 1 --2- 172.21.15.2:0/3476220352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba095c8a90 0x55ba095dfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:24:13.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.647+0000 7f78ae7fc640 1 --2- 172.21.15.2:0/3476220352 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ba095b9ca0 0x55ba095c4f10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f78a40ccf00 tx=0x7f78a40d1d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9eaa63798e2a9d90 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:13.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.647+0000 7f7894ff9640 1 -- 172.21.15.2:0/3476220352 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a40b4070 con 0x55ba095b9ca0 2024-09-19T06:24:13.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.647+0000 7f7894ff9640 1 -- 172.21.15.2:0/3476220352 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f78a409fe40 con 0x55ba095b9ca0 2024-09-19T06:24:13.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.647+0000 7f7894ff9640 1 -- 172.21.15.2:0/3476220352 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a4021040 con 0x55ba095b9ca0 2024-09-19T06:24:13.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.648+0000 7f78b7968740 1 -- 172.21.15.2:0/3476220352 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ba095b9ca0 msgr2=0x55ba095c4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:13.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.648+0000 7f78b7968740 1 --2- 172.21.15.2:0/3476220352 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ba095b9ca0 0x55ba095c4f10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f78a40ccf00 tx=0x7f78a40d1d30 comp rx=0 tx=0).stop 2024-09-19T06:24:13.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.648+0000 7f78b7968740 1 -- 172.21.15.2:0/3476220352 shutdown_connections 2024-09-19T06:24:13.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.648+0000 7f78b7968740 1 --2- 172.21.15.2:0/3476220352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba095c8a90 0x55ba095dfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:13.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.648+0000 7f78b7968740 1 --2- 172.21.15.2:0/3476220352 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ba095b9ca0 0x55ba095c4f10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:13.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.648+0000 7f78b7968740 1 --2- 172.21.15.2:0/3476220352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba095b9380 0x55ba095b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:13.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.648+0000 7f78b7968740 1 -- 172.21.15.2:0/3476220352 >> 172.21.15.2:0/3476220352 conn(0x55ba095b5a30 msgr2=0x55ba095bb620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:13.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.648+0000 7f78b7968740 1 -- 172.21.15.2:0/3476220352 shutdown_connections 2024-09-19T06:24:13.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.648+0000 7f78b7968740 1 -- 172.21.15.2:0/3476220352 wait complete. 2024-09-19T06:24:13.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.648+0000 7f78b7968740 1 -- start start 2024-09-19T06:24:13.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.648+0000 7f78b7968740 1 Processor -- start 2024-09-19T06:24:13.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.649+0000 7f78b7968740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba095b9380 0x55ba095d1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:13.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.649+0000 7f78b7968740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba095b9ca0 0x55ba095cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:13.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.649+0000 7f78b7968740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ba095c8a90 0x55ba095cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:13.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.649+0000 7f78b7968740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f78b01a9cc0 con 0x55ba095b9380 2024-09-19T06:24:13.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.649+0000 7f78b7968740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f78b01ab130 con 0x55ba095b9ca0 2024-09-19T06:24:13.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.649+0000 7f78b7968740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f78b01aa390 con 0x55ba095c8a90 2024-09-19T06:24:13.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.649+0000 7f78b7968740 10 client.0 _ll_register_callbacks cb 0x7f78a8009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:13.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.649+0000 7f78aeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba095b9380 0x55ba095d1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:13.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.649+0000 7f78aeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba095b9380 0x55ba095d1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37660/0 (socket says 172.21.15.2:37660) 2024-09-19T06:24:13.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.649+0000 7f78aeffd640 1 -- 172.21.15.2:0/3875466169 learned_addr learned my addr 172.21.15.2:0/3875466169 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:13.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.649+0000 7f78af7fe640 1 --2- 172.21.15.2:0/3875466169 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ba095c8a90 0x55ba095cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:13.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.649+0000 7f78ae7fc640 1 --2- 172.21.15.2:0/3875466169 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba095b9ca0 0x55ba095cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:13.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.649+0000 7f78aeffd640 1 -- 172.21.15.2:0/3875466169 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ba095c8a90 msgr2=0x55ba095cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:13.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.649+0000 7f78aeffd640 1 --2- 172.21.15.2:0/3875466169 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ba095c8a90 0x55ba095cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:13.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.649+0000 7f78aeffd640 1 -- 172.21.15.2:0/3875466169 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba095b9ca0 msgr2=0x55ba095cc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:13.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.649+0000 7f78aeffd640 1 --2- 172.21.15.2:0/3875466169 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba095b9ca0 0x55ba095cc6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:13.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.649+0000 7f78aeffd640 1 -- 172.21.15.2:0/3875466169 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba09641e50 con 0x55ba095b9380 2024-09-19T06:24:13.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.649+0000 7f78ae7fc640 1 --2- 172.21.15.2:0/3875466169 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba095b9ca0 0x55ba095cc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:24:13.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.649+0000 7f78aeffd640 1 --2- 172.21.15.2:0/3875466169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba095b9380 0x55ba095d1370 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f78a0000c00 tx=0x7f78a00119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2560057c7090f520 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:13.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.649+0000 7f7892ff5640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:24:13.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.649+0000 7f7892ff5640 1 -- 172.21.15.2:0/3875466169 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a000ebc0 con 0x55ba095b9380 2024-09-19T06:24:13.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.650+0000 7f7892ff5640 1 -- 172.21.15.2:0/3875466169 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7f78a0004b70 con 0x55ba095b9380 2024-09-19T06:24:13.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.650+0000 7f78b7968740 1 -- 172.21.15.2:0/3875466169 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78a409fe40 con 0x55ba095b9380 2024-09-19T06:24:13.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.650+0000 7f7892ff5640 1 -- 172.21.15.2:0/3875466169 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f78a0009aa0 con 0x55ba095b9380 2024-09-19T06:24:13.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.650+0000 7f78b7968740 10 client.18753 fetch_fsmap learned FSMap version 26 2024-09-19T06:24:13.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.650+0000 7f78b7968740 1 -- 172.21.15.2:0/3875466169 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ba09642fc0 con 0x55ba095b9380 2024-09-19T06:24:13.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.650+0000 7f7892ff5640 1 -- 172.21.15.2:0/3875466169 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f78a409fe40 con 0x55ba095b9380 2024-09-19T06:24:13.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.650+0000 7f7892ff5640 1 -- 172.21.15.2:0/3875466169 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f78a002c940 con 0x55ba095b9380 2024-09-19T06:24:13.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.650+0000 7f78b7968740 10 client.18753 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:24:13.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.650+0000 7f78b7968740 10 client.18753 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:24:13.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.650+0000 7f78b7968740 20 client.18753 populate_metadata read hostname 'smithi002' 2024-09-19T06:24:13.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.650+0000 7f78b7968740 1 --2- 172.21.15.2:0/3875466169 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ba09643700 0x55ba09645b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:13.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.650+0000 7f78b7968740 4 client.18753 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:24:13.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.650+0000 7f78b7968740 1 -- 172.21.15.2:0/3875466169 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ba09526d60 con 0x55ba09643700 2024-09-19T06:24:13.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.650+0000 7f78ae7fc640 1 --2- 172.21.15.2:0/3875466169 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ba09643700 0x55ba09645b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:13.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.651+0000 7f78ae7fc640 1 --2- 172.21.15.2:0/3875466169 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ba09643700 0x55ba09645b20 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fe09fd9a8bc2bf6 server_cookie=38cfe5becea9e3c9 in_seq=0 out_seq=0 2024-09-19T06:24:13.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.651+0000 7f7892ff5640 10 client.18753 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:13.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.651+0000 7f7892ff5640 1 -- 172.21.15.2:0/3875466169 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ba09526d60 con 0x55ba09643700 2024-09-19T06:24:13.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.651+0000 7f7892ff5640 10 client.18753 handle_command_reply: tid=0 2024-09-19T06:24:13.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.651+0000 7f78b7968740 1 client.18753 shutdown 2024-09-19T06:24:13.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.651+0000 7f78b7968740 1 -- 172.21.15.2:0/3875466169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba095b9380 msgr2=0x55ba095d1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:13.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.651+0000 7f78b7968740 1 --2- 172.21.15.2:0/3875466169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba095b9380 0x55ba095d1370 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f78a0000c00 tx=0x7f78a00119b0 comp rx=0 tx=0).stop 2024-09-19T06:24:13.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.651+0000 7f78b7968740 1 -- 172.21.15.2:0/3875466169 shutdown_connections 2024-09-19T06:24:13.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.651+0000 7f78b7968740 1 --2- 172.21.15.2:0/3875466169 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ba095c8a90 0x55ba095cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:13.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.651+0000 7f78b7968740 1 --2- 172.21.15.2:0/3875466169 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55ba09643700 0x55ba09645b20 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:13.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.651+0000 7f78b7968740 1 --2- 172.21.15.2:0/3875466169 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba095b9ca0 0x55ba095cc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:13.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.651+0000 7f78b7968740 1 --2- 172.21.15.2:0/3875466169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba095b9380 0x55ba095d1370 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:13.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.651+0000 7f7892ff5640 0 client.18753 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:13.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.651+0000 7f78b7968740 1 -- 172.21.15.2:0/3875466169 >> 172.21.15.2:0/3875466169 conn(0x55ba095b5a30 msgr2=0x55ba095bae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:13.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.651+0000 7f78b7968740 1 -- 172.21.15.2:0/3875466169 shutdown_connections 2024-09-19T06:24:13.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.651+0000 7f78b7968740 1 -- 172.21.15.2:0/3875466169 wait complete. 2024-09-19T06:24:13.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.651+0000 7f78b7968740 20 client.18753 trim_cache size 0 max 16384 2024-09-19T06:24:13.660 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:24:13.660 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T06:24:13.660 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T06:24:13.660 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:24:13.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.652+0000 7f78b558f640 1 -- 172.21.15.2:0/2506606268 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f78980a33b0 msgr2=0x7f78980a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:13.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.652+0000 7f78b558f640 1 --2- 172.21.15.2:0/2506606268 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f78980a33b0 0x7f78980a5870 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f78a8009a60 tx=0x7f78a8005d80 comp rx=0 tx=0).stop 2024-09-19T06:24:13.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.652+0000 7f78b558f640 1 -- 172.21.15.2:0/2506606268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78b01036e0 msgr2=0x7f78b01989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:13.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.652+0000 7f78b558f640 1 --2- 172.21.15.2:0/2506606268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78b01036e0 0x7f78b01989b0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f78a400d740 tx=0x7f78a400dc00 comp rx=0 tx=0).stop 2024-09-19T06:24:13.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.652+0000 7f78b558f640 1 -- 172.21.15.2:0/2506606268 shutdown_connections 2024-09-19T06:24:13.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.652+0000 7f78b558f640 1 --2- 172.21.15.2:0/2506606268 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f78980a33b0 0x7f78980a5870 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:13.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.652+0000 7f78b558f640 1 --2- 172.21.15.2:0/2506606268 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78b01082a0 0x7f78b019cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:13.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.652+0000 7f78b558f640 1 --2- 172.21.15.2:0/2506606268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78b01036e0 0x7f78b01989b0 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:13.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.652+0000 7f78b558f640 1 --2- 172.21.15.2:0/2506606268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78b0102d30 0x7f78b0198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:13.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.652+0000 7f78b558f640 1 -- 172.21.15.2:0/2506606268 >> 172.21.15.2:0/2506606268 conn(0x7f78b00fc7d0 msgr2=0x7f78b0105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:13.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.652+0000 7f78b558f640 1 -- 172.21.15.2:0/2506606268 shutdown_connections 2024-09-19T06:24:13.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:13.652+0000 7f78b558f640 1 -- 172.21.15.2:0/2506606268 wait complete. 2024-09-19T06:24:13.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:13 smithi090 ceph-mon[34497]: scrub queued for path: / 2024-09-19T06:24:13.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:13 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:24:13.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:13 smithi090 ceph-mon[34497]: scrub summary: active paths [/] 2024-09-19T06:24:13.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:13 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:24:13.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:13 smithi090 ceph-mon[34497]: pgmap v292: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-19T06:24:13.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:13 smithi090 ceph-mon[34497]: scrub summary: idle 2024-09-19T06:24:13.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:13 smithi090 ceph-mon[34497]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T06:24:13.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:13 smithi089 ceph-mon[34160]: scrub queued for path: / 2024-09-19T06:24:13.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:13 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:24:13.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:13 smithi089 ceph-mon[34160]: scrub summary: active paths [/] 2024-09-19T06:24:13.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:13 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:24:13.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:13 smithi089 ceph-mon[34160]: pgmap v292: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-19T06:24:13.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:13 smithi089 ceph-mon[34160]: scrub summary: idle 2024-09-19T06:24:13.793 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:13 smithi089 ceph-mon[34160]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T06:24:14.252 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:24:14.252 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:24:14.509 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:24:14.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:14.925+0000 7f5a792c5640 1 -- 172.21.15.2:0/1574425221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a74106f10 msgr2=0x7f5a7410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:14.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:14.925+0000 7f5a792c5640 1 --2- 172.21.15.2:0/1574425221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a74106f10 0x7f5a7410ea90 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c009ca0 tx=0x7f5a6c02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:24:14.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:14.925+0000 7f5a792c5640 1 -- 172.21.15.2:0/1574425221 shutdown_connections 2024-09-19T06:24:14.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:14.925+0000 7f5a792c5640 1 --2- 172.21.15.2:0/1574425221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a74106f10 0x7f5a7410ea90 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:14.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:14.925+0000 7f5a792c5640 1 --2- 172.21.15.2:0/1574425221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a74102790 0x7f5a741067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:14.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:14.925+0000 7f5a792c5640 1 --2- 172.21.15.2:0/1574425221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a74101de0 0x7f5a741021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:14.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:14.925+0000 7f5a792c5640 1 -- 172.21.15.2:0/1574425221 >> 172.21.15.2:0/1574425221 conn(0x7f5a740fd8c0 msgr2=0x7f5a740ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:14.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:14.925+0000 7f5a792c5640 1 -- 172.21.15.2:0/1574425221 shutdown_connections 2024-09-19T06:24:14.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:14.925+0000 7f5a792c5640 1 -- 172.21.15.2:0/1574425221 wait complete. 2024-09-19T06:24:14.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:14.926+0000 7f5a792c5640 1 Processor -- start 2024-09-19T06:24:14.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:14.926+0000 7f5a792c5640 1 -- start start 2024-09-19T06:24:14.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:14.927+0000 7f5a792c5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a74101de0 0x7f5a74198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:14.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:14.927+0000 7f5a792c5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a74102790 0x7f5a74198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:14.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:14.927+0000 7f5a792c5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a74106f10 0x7f5a7419cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:14.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:14.927+0000 7f5a792c5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5a74111e20 con 0x7f5a74102790 2024-09-19T06:24:14.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:14.927+0000 7f5a792c5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f5a74111ca0 con 0x7f5a74106f10 2024-09-19T06:24:14.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:14.927+0000 7f5a792c5640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5a74111fa0 con 0x7f5a74101de0 2024-09-19T06:24:14.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:14.927+0000 7f5a6a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a74102790 0x7f5a74198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:14.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:14.927+0000 7f5a6a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a74102790 0x7f5a74198860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37674/0 (socket says 172.21.15.2:37674) 2024-09-19T06:24:14.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:14.927+0000 7f5a6a7fc640 1 -- 172.21.15.2:0/1829783765 learned_addr learned my addr 172.21.15.2:0/1829783765 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:14.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:14.927+0000 7f5a72ffd640 1 --2- 172.21.15.2:0/1829783765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a74101de0 0x7f5a74198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:14.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:14.927+0000 7f5a737fe640 1 --2- 172.21.15.2:0/1829783765 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a74106f10 0x7f5a7419cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:14.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:14.927+0000 7f5a6a7fc640 1 -- 172.21.15.2:0/1829783765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a74101de0 msgr2=0x7f5a74198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:14.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:14.927+0000 7f5a6a7fc640 1 --2- 172.21.15.2:0/1829783765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a74101de0 0x7f5a74198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:14.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:14.927+0000 7f5a6a7fc640 1 -- 172.21.15.2:0/1829783765 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a74106f10 msgr2=0x7f5a7419cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:14.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:14.927+0000 7f5a6a7fc640 1 --2- 172.21.15.2:0/1829783765 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a74106f10 0x7f5a7419cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:14.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:14.927+0000 7f5a6a7fc640 1 -- 172.21.15.2:0/1829783765 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a7419d2d0 con 0x7f5a74102790 2024-09-19T06:24:14.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:14.927+0000 7f5a737fe640 1 --2- 172.21.15.2:0/1829783765 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a74106f10 0x7f5a7419cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:24:14.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:14.927+0000 7f5a6a7fc640 1 --2- 172.21.15.2:0/1829783765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a74102790 0x7f5a74198860 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c00d950 tx=0x7f5a5c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:14.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:14.927+0000 7f5a70ff9640 1 -- 172.21.15.2:0/1829783765 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c017070 con 0x7f5a74102790 2024-09-19T06:24:14.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:14.928+0000 7f5a792c5640 1 -- 172.21.15.2:0/1829783765 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a7419d5c0 con 0x7f5a74102790 2024-09-19T06:24:14.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:14.928+0000 7f5a70ff9640 1 -- 172.21.15.2:0/1829783765 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5a5c009c30 con 0x7f5a74102790 2024-09-19T06:24:14.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:14.928+0000 7f5a70ff9640 1 -- 172.21.15.2:0/1829783765 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c00f620 con 0x7f5a74102790 2024-09-19T06:24:14.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:14.928+0000 7f5a792c5640 1 -- 172.21.15.2:0/1829783765 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a741a4ea0 con 0x7f5a74102790 2024-09-19T06:24:14.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:14.929+0000 7f5a792c5640 1 -- 172.21.15.2:0/1829783765 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a741021c0 con 0x7f5a74102790 2024-09-19T06:24:14.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:14.930+0000 7f5a70ff9640 1 -- 172.21.15.2:0/1829783765 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f5a5c0109a0 con 0x7f5a74102790 2024-09-19T06:24:14.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:14.930+0000 7f5a70ff9640 1 --2- 172.21.15.2:0/1829783765 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f5a600a33b0 0x7f5a600a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:14.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:14.931+0000 7f5a72ffd640 1 --2- 172.21.15.2:0/1829783765 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f5a600a33b0 0x7f5a600a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:14.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:14.931+0000 7f5a70ff9640 1 -- 172.21.15.2:0/1829783765 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7f5a5c0cf900 con 0x7f5a74102790 2024-09-19T06:24:14.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:14.931+0000 7f5a72ffd640 1 --2- 172.21.15.2:0/1829783765 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f5a600a33b0 0x7f5a600a5870 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5a64005fd0 tx=0x7f5a6400b390 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:14.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:14.935+0000 7f5a70ff9640 1 -- 172.21.15.2:0/1829783765 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5a5c009de0 con 0x7f5a74102790 2024-09-19T06:24:15.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:15.150+0000 7f5a792c5640 1 -- 172.21.15.2:0/1829783765 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5a74199680 con 0x7f5a74102790 2024-09-19T06:24:15.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:15.151+0000 7f5a70ff9640 1 -- 172.21.15.2:0/1829783765 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11882 (secure 0 0 0) 0x7f5a5c09c2e0 con 0x7f5a74102790 2024-09-19T06:24:15.153 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:24:15.153 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-09-19T06:14:49:104280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:14:48.191083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24470,24472,24497]},"id":1}]} 2024-09-19T06:24:15.153 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-09-19T06:24:15.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:15.153+0000 7f5a792c5640 1 -- 172.21.15.2:0/1829783765 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f5a600a33b0 msgr2=0x7f5a600a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:15.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:15.153+0000 7f5a792c5640 1 --2- 172.21.15.2:0/1829783765 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f5a600a33b0 0x7f5a600a5870 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5a64005fd0 tx=0x7f5a6400b390 comp rx=0 tx=0).stop 2024-09-19T06:24:15.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:15.153+0000 7f5a792c5640 1 -- 172.21.15.2:0/1829783765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a74102790 msgr2=0x7f5a74198860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:15.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:15.153+0000 7f5a792c5640 1 --2- 172.21.15.2:0/1829783765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a74102790 0x7f5a74198860 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c00d950 tx=0x7f5a5c00de10 comp rx=0 tx=0).stop 2024-09-19T06:24:15.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:15.153+0000 7f5a792c5640 1 -- 172.21.15.2:0/1829783765 shutdown_connections 2024-09-19T06:24:15.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:15.153+0000 7f5a792c5640 1 --2- 172.21.15.2:0/1829783765 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f5a600a33b0 0x7f5a600a5870 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:15.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:15.153+0000 7f5a792c5640 1 --2- 172.21.15.2:0/1829783765 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a74106f10 0x7f5a7419cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:15.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:15.153+0000 7f5a792c5640 1 --2- 172.21.15.2:0/1829783765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a74102790 0x7f5a74198860 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:15.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:15.153+0000 7f5a792c5640 1 --2- 172.21.15.2:0/1829783765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a74101de0 0x7f5a74198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:15.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:15.153+0000 7f5a792c5640 1 -- 172.21.15.2:0/1829783765 >> 172.21.15.2:0/1829783765 conn(0x7f5a740fd8c0 msgr2=0x7f5a740fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:15.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:15.154+0000 7f5a792c5640 1 -- 172.21.15.2:0/1829783765 shutdown_connections 2024-09-19T06:24:15.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:15.154+0000 7f5a792c5640 1 -- 172.21.15.2:0/1829783765 wait complete. 2024-09-19T06:24:15.447 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:15 smithi002 ceph-mon[30982]: pgmap v294: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T06:24:15.448 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:15 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1829783765' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:24:15.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:15 smithi090 ceph-mon[34497]: pgmap v294: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T06:24:15.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:15 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1829783765' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:24:15.774 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:24:15.791 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:15 smithi089 ceph-mon[34160]: pgmap v294: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T06:24:15.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:15 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1829783765' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:24:16.035 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:24:16.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.534+0000 7fa93941c640 1 -- 172.21.15.2:0/1564031160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa934106a80 msgr2=0x7fa934106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:16.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.534+0000 7fa93941c640 1 --2- 172.21.15.2:0/1564031160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa934106a80 0x7fa934106e60 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fa924009930 tx=0x7fa92402a420 comp rx=0 tx=0).stop 2024-09-19T06:24:16.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.534+0000 7fa93941c640 1 -- 172.21.15.2:0/1564031160 shutdown_connections 2024-09-19T06:24:16.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.534+0000 7fa93941c640 1 --2- 172.21.15.2:0/1564031160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa934101420 0x7fa93410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:16.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.534+0000 7fa93941c640 1 --2- 172.21.15.2:0/1564031160 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa934100a80 0x7fa934100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:16.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.534+0000 7fa93941c640 1 --2- 172.21.15.2:0/1564031160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa934106a80 0x7fa934106e60 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:16.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.534+0000 7fa93941c640 1 -- 172.21.15.2:0/1564031160 >> 172.21.15.2:0/1564031160 conn(0x7fa9340fc7a0 msgr2=0x7fa9340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:16.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.534+0000 7fa93941c640 1 -- 172.21.15.2:0/1564031160 shutdown_connections 2024-09-19T06:24:16.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.534+0000 7fa93941c640 1 -- 172.21.15.2:0/1564031160 wait complete. 2024-09-19T06:24:16.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.534+0000 7fa93941c640 1 Processor -- start 2024-09-19T06:24:16.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.535+0000 7fa93941c640 1 -- start start 2024-09-19T06:24:16.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.535+0000 7fa93941c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa934100a80 0x7fa93419a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:16.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.535+0000 7fa93941c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa934101420 0x7fa93419aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:16.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.535+0000 7fa93941c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa934106a80 0x7fa93419ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:16.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.535+0000 7fa93941c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa934110d80 con 0x7fa934106a80 2024-09-19T06:24:16.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.535+0000 7fa93941c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa934110c00 con 0x7fa934101420 2024-09-19T06:24:16.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.535+0000 7fa93941c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa934110f00 con 0x7fa934100a80 2024-09-19T06:24:16.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.535+0000 7fa9337fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa934106a80 0x7fa93419ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:16.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.535+0000 7fa9337fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa934106a80 0x7fa93419ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57366/0 (socket says 172.21.15.2:57366) 2024-09-19T06:24:16.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.535+0000 7fa9337fe640 1 -- 172.21.15.2:0/2236045095 learned_addr learned my addr 172.21.15.2:0/2236045095 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:16.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.535+0000 7fa932ffd640 1 --2- 172.21.15.2:0/2236045095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa934100a80 0x7fa93419a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:16.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.535+0000 7fa92a7fc640 1 --2- 172.21.15.2:0/2236045095 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa934101420 0x7fa93419aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:16.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.536+0000 7fa9337fe640 1 -- 172.21.15.2:0/2236045095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa934100a80 msgr2=0x7fa93419a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:16.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.536+0000 7fa9337fe640 1 --2- 172.21.15.2:0/2236045095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa934100a80 0x7fa93419a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:16.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.536+0000 7fa9337fe640 1 -- 172.21.15.2:0/2236045095 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa934101420 msgr2=0x7fa93419aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:16.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.536+0000 7fa9337fe640 1 --2- 172.21.15.2:0/2236045095 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa934101420 0x7fa93419aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:16.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.536+0000 7fa9337fe640 1 -- 172.21.15.2:0/2236045095 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa93419f500 con 0x7fa934106a80 2024-09-19T06:24:16.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.536+0000 7fa9337fe640 1 --2- 172.21.15.2:0/2236045095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa934106a80 0x7fa93419ee20 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7fa92c00eaa0 tx=0x7fa92c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:16.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.536+0000 7fa930ff9640 1 -- 172.21.15.2:0/2236045095 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa92c00cdb0 con 0x7fa934106a80 2024-09-19T06:24:16.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.536+0000 7fa930ff9640 1 -- 172.21.15.2:0/2236045095 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa92c005020 con 0x7fa934106a80 2024-09-19T06:24:16.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.536+0000 7fa930ff9640 1 -- 172.21.15.2:0/2236045095 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa92c0116d0 con 0x7fa934106a80 2024-09-19T06:24:16.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.536+0000 7fa93941c640 1 -- 172.21.15.2:0/2236045095 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa93419f7f0 con 0x7fa934106a80 2024-09-19T06:24:16.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.536+0000 7fa93941c640 1 -- 172.21.15.2:0/2236045095 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9341a70d0 con 0x7fa934106a80 2024-09-19T06:24:16.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.539+0000 7fa930ff9640 1 -- 172.21.15.2:0/2236045095 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fa92c0051d0 con 0x7fa934106a80 2024-09-19T06:24:16.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.539+0000 7fa93b7f5740 1 Processor -- start 2024-09-19T06:24:16.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.539+0000 7fa93b7f5740 1 -- start start 2024-09-19T06:24:16.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.539+0000 7fa93b7f5740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55905ff74b40 0x55905ff73090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:16.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.539+0000 7fa93b7f5740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55905ff735d0 0x55905ff73a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:16.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.539+0000 7fa93b7f5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55905ff7e370 0x55905ff80760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:16.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.539+0000 7fa93b7f5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55905fed92f0 con 0x55905ff7e370 2024-09-19T06:24:16.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.539+0000 7fa93b7f5740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55905fe80cf0 con 0x55905ff74b40 2024-09-19T06:24:16.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.539+0000 7fa93b7f5740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55905fed52b0 con 0x55905ff735d0 2024-09-19T06:24:16.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.539+0000 7fa92a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55905ff7e370 0x55905ff80760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:16.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.539+0000 7fa92a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55905ff7e370 0x55905ff80760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57378/0 (socket says 172.21.15.2:57378) 2024-09-19T06:24:16.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.539+0000 7fa92a7fc640 1 -- 172.21.15.2:0/1278739522 learned_addr learned my addr 172.21.15.2:0/1278739522 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:16.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.539+0000 7fa930ff9640 1 --2- 172.21.15.2:0/2236045095 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa9200a3430 0x7fa9200a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:16.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.540+0000 7fa932ffd640 1 --2- 172.21.15.2:0/1278739522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55905ff735d0 0x55905ff73a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:16.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.540+0000 7fa92a7fc640 1 --2- 172.21.15.2:0/1278739522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55905ff74b40 0x55905ff73090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:16.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.540+0000 7fa9337fe640 1 --2- 172.21.15.2:0/2236045095 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa9200a3430 0x7fa9200a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:16.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.540+0000 7fa92a7fc640 1 -- 172.21.15.2:0/1278739522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55905ff735d0 msgr2=0x55905ff73a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:16.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.540+0000 7fa92a7fc640 1 --2- 172.21.15.2:0/1278739522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55905ff735d0 0x55905ff73a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:16.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.540+0000 7fa92a7fc640 1 -- 172.21.15.2:0/1278739522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55905ff74b40 msgr2=0x55905ff73090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:16.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.540+0000 7fa930ff9640 1 -- 172.21.15.2:0/2236045095 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7fa92c0cfd30 con 0x7fa934106a80 2024-09-19T06:24:16.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.540+0000 7fa92a7fc640 1 --2- 172.21.15.2:0/1278739522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55905ff74b40 0x55905ff73090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:16.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.540+0000 7fa92a7fc640 1 -- 172.21.15.2:0/1278739522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55905fe653a0 con 0x55905ff7e370 2024-09-19T06:24:16.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.540+0000 7fa932ffd640 1 --2- 172.21.15.2:0/1278739522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55905ff735d0 0x55905ff73a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:24:16.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.540+0000 7fa92a7fc640 1 --2- 172.21.15.2:0/1278739522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55905ff7e370 0x55905ff80760 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7fa91c0125c0 tx=0x7fa91c00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec36605e9b0bfb3f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:16.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.540+0000 7fa9337fe640 1 --2- 172.21.15.2:0/2236045095 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa9200a3430 0x7fa9200a58f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa92c0cd530 tx=0x7fa92c06eef0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:16.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.540+0000 7fa9297fa640 1 -- 172.21.15.2:0/1278739522 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa91c0106b0 con 0x55905ff7e370 2024-09-19T06:24:16.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.540+0000 7fa9297fa640 1 -- 172.21.15.2:0/1278739522 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa91c010d00 con 0x55905ff7e370 2024-09-19T06:24:16.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.540+0000 7fa9297fa640 1 -- 172.21.15.2:0/1278739522 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa91c01dc40 con 0x55905ff7e370 2024-09-19T06:24:16.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.541+0000 7fa93b7f5740 1 -- 172.21.15.2:0/1278739522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55905ff7e370 msgr2=0x55905ff80760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:16.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.541+0000 7fa93b7f5740 1 --2- 172.21.15.2:0/1278739522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55905ff7e370 0x55905ff80760 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7fa91c0125c0 tx=0x7fa91c00b870 comp rx=0 tx=0).stop 2024-09-19T06:24:16.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.541+0000 7fa93b7f5740 1 -- 172.21.15.2:0/1278739522 shutdown_connections 2024-09-19T06:24:16.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.541+0000 7fa93b7f5740 1 --2- 172.21.15.2:0/1278739522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55905ff7e370 0x55905ff80760 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:16.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.541+0000 7fa93b7f5740 1 --2- 172.21.15.2:0/1278739522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55905ff735d0 0x55905ff73a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:16.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.541+0000 7fa93b7f5740 1 --2- 172.21.15.2:0/1278739522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55905ff74b40 0x55905ff73090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:16.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.541+0000 7fa93b7f5740 1 -- 172.21.15.2:0/1278739522 >> 172.21.15.2:0/1278739522 conn(0x55905ff3c310 msgr2=0x55905ff6fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:16.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.541+0000 7fa93b7f5740 1 -- 172.21.15.2:0/1278739522 shutdown_connections 2024-09-19T06:24:16.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.541+0000 7fa93b7f5740 1 -- 172.21.15.2:0/1278739522 wait complete. 2024-09-19T06:24:16.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.542+0000 7fa93b7f5740 1 -- start start 2024-09-19T06:24:16.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.542+0000 7fa93b7f5740 1 Processor -- start 2024-09-19T06:24:16.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.542+0000 7fa93b7f5740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55905ff735d0 0x55905ff7dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:16.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.542+0000 7fa93b7f5740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55905ff74b40 0x55905ff7aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:16.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.542+0000 7fa93b7f5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55905ff7e370 0x55905ff7b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:16.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.542+0000 7fa93b7f5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55905ff81070 con 0x55905ff7e370 2024-09-19T06:24:16.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.542+0000 7fa93b7f5740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55905fe94060 con 0x55905ff74b40 2024-09-19T06:24:16.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.542+0000 7fa93b7f5740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55905ff811f0 con 0x55905ff735d0 2024-09-19T06:24:16.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.542+0000 7fa93b7f5740 10 client.0 _ll_register_callbacks cb 0x55905fbe78c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:16.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.542+0000 7fa92a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55905ff7e370 0x55905ff7b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:16.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.542+0000 7fa92a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55905ff7e370 0x55905ff7b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57392/0 (socket says 172.21.15.2:57392) 2024-09-19T06:24:16.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.542+0000 7fa92a7fc640 1 -- 172.21.15.2:0/504863796 learned_addr learned my addr 172.21.15.2:0/504863796 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:16.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.542+0000 7fa92a7fc640 1 --2- 172.21.15.2:0/504863796 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55905ff735d0 0x55905ff7dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:16.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.542+0000 7fa932ffd640 1 --2- 172.21.15.2:0/504863796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55905ff74b40 0x55905ff7aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:16.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.543+0000 7fa92a7fc640 1 -- 172.21.15.2:0/504863796 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55905ff735d0 msgr2=0x55905ff7dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:16.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.543+0000 7fa92a7fc640 1 --2- 172.21.15.2:0/504863796 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55905ff735d0 0x55905ff7dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:16.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.543+0000 7fa92a7fc640 1 -- 172.21.15.2:0/504863796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55905ff74b40 msgr2=0x55905ff7aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:16.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.543+0000 7fa92a7fc640 1 --2- 172.21.15.2:0/504863796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55905ff74b40 0x55905ff7aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:16.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.543+0000 7fa92a7fc640 1 -- 172.21.15.2:0/504863796 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55905fc4a3c0 con 0x55905ff7e370 2024-09-19T06:24:16.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.543+0000 7fa92a7fc640 1 --2- 172.21.15.2:0/504863796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55905ff7e370 0x55905ff7b5e0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7fa91c010fd0 tx=0x7fa91c01d820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b120883ad92054ef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:16.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.543+0000 7fa91a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:24:16.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.543+0000 7fa91a7fc640 1 -- 172.21.15.2:0/504863796 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa91c031060 con 0x55905ff7e370 2024-09-19T06:24:16.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.543+0000 7fa91a7fc640 1 -- 172.21.15.2:0/504863796 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7fa91c01ddf0 con 0x55905ff7e370 2024-09-19T06:24:16.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.543+0000 7fa93b7f5740 1 -- 172.21.15.2:0/504863796 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa91c010d00 con 0x55905ff7e370 2024-09-19T06:24:16.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.543+0000 7fa91a7fc640 1 -- 172.21.15.2:0/504863796 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa91c023040 con 0x55905ff7e370 2024-09-19T06:24:16.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.543+0000 7fa93b7f5740 10 client.18771 fetch_fsmap learned FSMap version 26 2024-09-19T06:24:16.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.543+0000 7fa93b7f5740 1 -- 172.21.15.2:0/504863796 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55905ff8cae0 con 0x55905ff7e370 2024-09-19T06:24:16.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.543+0000 7fa91a7fc640 1 -- 172.21.15.2:0/504863796 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa91c010d00 con 0x55905ff7e370 2024-09-19T06:24:16.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.543+0000 7fa91a7fc640 1 -- 172.21.15.2:0/504863796 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fa91c029030 con 0x55905ff7e370 2024-09-19T06:24:16.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.544+0000 7fa93b7f5740 10 client.18771 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:24:16.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.544+0000 7fa93b7f5740 10 client.18771 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:24:16.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.544+0000 7fa93b7f5740 20 client.18771 populate_metadata read hostname 'smithi002' 2024-09-19T06:24:16.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.544+0000 7fa93b7f5740 1 --2- 172.21.15.2:0/504863796 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55905ff8df40 0x55905ff90330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:16.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.544+0000 7fa93b7f5740 4 client.18771 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:24:16.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.544+0000 7fa93b7f5740 1 -- 172.21.15.2:0/504863796 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55905fee6860 con 0x55905ff8df40 2024-09-19T06:24:16.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.544+0000 7fa932ffd640 1 --2- 172.21.15.2:0/504863796 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55905ff8df40 0x55905ff90330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:16.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.544+0000 7fa932ffd640 1 --2- 172.21.15.2:0/504863796 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55905ff8df40 0x55905ff90330 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d07e836f81d77315 server_cookie=d1eb2abd84dcbb17 in_seq=0 out_seq=0 2024-09-19T06:24:16.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.544+0000 7fa91a7fc640 10 client.18771 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:24:16.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.545+0000 7fa91a7fc640 1 -- 172.21.15.2:0/504863796 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55905fee6860 con 0x55905ff8df40 2024-09-19T06:24:16.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.545+0000 7fa91a7fc640 10 client.18771 handle_command_reply: tid=0 2024-09-19T06:24:16.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.545+0000 7fa93b7f5740 1 client.18771 shutdown 2024-09-19T06:24:16.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.545+0000 7fa93b7f5740 1 -- 172.21.15.2:0/504863796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55905ff7e370 msgr2=0x55905ff7b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:16.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.545+0000 7fa93b7f5740 1 --2- 172.21.15.2:0/504863796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55905ff7e370 0x55905ff7b5e0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7fa91c010fd0 tx=0x7fa91c01d820 comp rx=0 tx=0).stop 2024-09-19T06:24:16.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.545+0000 7fa93b7f5740 1 -- 172.21.15.2:0/504863796 shutdown_connections 2024-09-19T06:24:16.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.545+0000 7fa93b7f5740 1 --2- 172.21.15.2:0/504863796 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55905ff8df40 0x55905ff90330 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:16.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.545+0000 7fa93b7f5740 1 --2- 172.21.15.2:0/504863796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55905ff7e370 0x55905ff7b5e0 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:16.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.545+0000 7fa93b7f5740 1 --2- 172.21.15.2:0/504863796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55905ff74b40 0x55905ff7aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:16.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.545+0000 7fa93b7f5740 1 --2- 172.21.15.2:0/504863796 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55905ff735d0 0x55905ff7dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:16.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.545+0000 7fa93b7f5740 1 -- 172.21.15.2:0/504863796 >> 172.21.15.2:0/504863796 conn(0x55905ff3c310 msgr2=0x55905ff75960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:16.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.545+0000 7fa91a7fc640 0 client.18771 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:24:16.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.545+0000 7fa93b7f5740 1 -- 172.21.15.2:0/504863796 shutdown_connections 2024-09-19T06:24:16.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.545+0000 7fa93b7f5740 1 -- 172.21.15.2:0/504863796 wait complete. 2024-09-19T06:24:16.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.546+0000 7fa93b7f5740 20 client.18771 trim_cache size 0 max 16384 2024-09-19T06:24:16.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.559+0000 7fa93b7f5740 1 Processor -- start 2024-09-19T06:24:16.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.559+0000 7fa93b7f5740 1 -- start start 2024-09-19T06:24:16.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.559+0000 7fa93b7f5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55905ff735d0 0x55905ff8a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:16.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.559+0000 7fa93b7f5740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55905ff74b40 0x55905ff959e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:16.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.559+0000 7fa93b7f5740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55905ff7e370 0x55905ff95f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:16.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.559+0000 7fa93b7f5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa9341b2370 con 0x55905ff735d0 2024-09-19T06:24:16.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.559+0000 7fa93b7f5740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa9341afc40 con 0x55905ff74b40 2024-09-19T06:24:16.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.559+0000 7fa93b7f5740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa9341adab0 con 0x55905ff7e370 2024-09-19T06:24:16.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.559+0000 7fa92a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55905ff735d0 0x55905ff8a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:16.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.559+0000 7fa92a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55905ff735d0 0x55905ff8a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57402/0 (socket says 172.21.15.2:57402) 2024-09-19T06:24:16.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.559+0000 7fa92a7fc640 1 -- 172.21.15.2:0/3715097080 learned_addr learned my addr 172.21.15.2:0/3715097080 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:16.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.559+0000 7fa92a7fc640 1 -- 172.21.15.2:0/3715097080 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55905ff7e370 msgr2=0x55905ff95f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:16.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.559+0000 7fa92a7fc640 1 --2- 172.21.15.2:0/3715097080 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55905ff7e370 0x55905ff95f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:16.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.559+0000 7fa92a7fc640 1 -- 172.21.15.2:0/3715097080 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55905ff74b40 msgr2=0x55905ff959e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:16.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.559+0000 7fa92a7fc640 1 --2- 172.21.15.2:0/3715097080 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55905ff74b40 0x55905ff959e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:16.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.559+0000 7fa92a7fc640 1 -- 172.21.15.2:0/3715097080 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55905ff7c460 con 0x55905ff735d0 2024-09-19T06:24:16.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.560+0000 7fa92a7fc640 1 --2- 172.21.15.2:0/3715097080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55905ff735d0 0x55905ff8a310 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fa91c01d5a0 tx=0x7fa91c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b2b1480e6177ce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:16.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.560+0000 7fa928ff9640 1 -- 172.21.15.2:0/3715097080 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa91c031040 con 0x55905ff735d0 2024-09-19T06:24:16.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.560+0000 7fa928ff9640 1 -- 172.21.15.2:0/3715097080 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa91c010c10 con 0x55905ff735d0 2024-09-19T06:24:16.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.560+0000 7fa928ff9640 1 -- 172.21.15.2:0/3715097080 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa91c01de30 con 0x55905ff735d0 2024-09-19T06:24:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.560+0000 7fa93b7f5740 1 -- 172.21.15.2:0/3715097080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55905ff735d0 msgr2=0x55905ff8a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.560+0000 7fa93b7f5740 1 --2- 172.21.15.2:0/3715097080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55905ff735d0 0x55905ff8a310 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fa91c01d5a0 tx=0x7fa91c000bc0 comp rx=0 tx=0).stop 2024-09-19T06:24:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.561+0000 7fa93b7f5740 1 -- 172.21.15.2:0/3715097080 shutdown_connections 2024-09-19T06:24:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.561+0000 7fa93b7f5740 1 --2- 172.21.15.2:0/3715097080 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55905ff7e370 0x55905ff95f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.561+0000 7fa93b7f5740 1 --2- 172.21.15.2:0/3715097080 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55905ff74b40 0x55905ff959e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.561+0000 7fa93b7f5740 1 --2- 172.21.15.2:0/3715097080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55905ff735d0 0x55905ff8a310 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.561+0000 7fa93b7f5740 1 -- 172.21.15.2:0/3715097080 >> 172.21.15.2:0/3715097080 conn(0x55905ff3c310 msgr2=0x55905ff7a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.561+0000 7fa93b7f5740 1 -- 172.21.15.2:0/3715097080 shutdown_connections 2024-09-19T06:24:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.561+0000 7fa93b7f5740 1 -- 172.21.15.2:0/3715097080 wait complete. 2024-09-19T06:24:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.561+0000 7fa93b7f5740 1 -- start start 2024-09-19T06:24:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.561+0000 7fa93b7f5740 1 Processor -- start 2024-09-19T06:24:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.561+0000 7fa93b7f5740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55905ff735d0 0x55905ff86480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.561+0000 7fa93b7f5740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55905ff74b40 0x55905ff869c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.561+0000 7fa93b7f5740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55905ff7e370 0x55905ff77360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.561+0000 7fa93b7f5740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa9341ae100 con 0x55905ff74b40 2024-09-19T06:24:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.561+0000 7fa93b7f5740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa9341af570 con 0x55905ff7e370 2024-09-19T06:24:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.561+0000 7fa93b7f5740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa9341ae7d0 con 0x55905ff735d0 2024-09-19T06:24:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.561+0000 7fa93b7f5740 10 client.0 _ll_register_callbacks cb 0x7fa91c0123f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.561+0000 7fa932ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55905ff74b40 0x55905ff869c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.561+0000 7fa932ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55905ff74b40 0x55905ff869c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57410/0 (socket says 172.21.15.2:57410) 2024-09-19T06:24:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.561+0000 7fa932ffd640 1 -- 172.21.15.2:0/3308741074 learned_addr learned my addr 172.21.15.2:0/3308741074 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.561+0000 7fa92a7fc640 1 --2- 172.21.15.2:0/3308741074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55905ff735d0 0x55905ff86480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.562+0000 7fa92a7fc640 1 --2- 172.21.15.2:0/3308741074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55905ff7e370 0x55905ff77360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.562+0000 7fa932ffd640 1 -- 172.21.15.2:0/3308741074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55905ff735d0 msgr2=0x55905ff86480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.562+0000 7fa932ffd640 1 --2- 172.21.15.2:0/3308741074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55905ff735d0 0x55905ff86480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.562+0000 7fa932ffd640 1 -- 172.21.15.2:0/3308741074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55905ff7e370 msgr2=0x55905ff77360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.562+0000 7fa932ffd640 1 --2- 172.21.15.2:0/3308741074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55905ff7e370 0x55905ff77360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.562+0000 7fa932ffd640 1 -- 172.21.15.2:0/3308741074 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55905ff778a0 con 0x55905ff74b40 2024-09-19T06:24:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.562+0000 7fa932ffd640 1 --2- 172.21.15.2:0/3308741074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55905ff74b40 0x55905ff869c0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fa924006010 tx=0x7fa924005090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e6190127526ce2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.562+0000 7fa91a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:24:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.562+0000 7fa91a7fc640 1 -- 172.21.15.2:0/3308741074 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa924035040 con 0x55905ff74b40 2024-09-19T06:24:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.562+0000 7fa91a7fc640 1 -- 172.21.15.2:0/3308741074 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7fa924004750 con 0x55905ff74b40 2024-09-19T06:24:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.562+0000 7fa93b7f5740 1 -- 172.21.15.2:0/3308741074 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa91c010c10 con 0x55905ff74b40 2024-09-19T06:24:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.562+0000 7fa91a7fc640 1 -- 172.21.15.2:0/3308741074 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa924053050 con 0x55905ff74b40 2024-09-19T06:24:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.562+0000 7fa93b7f5740 10 client.18777 fetch_fsmap learned FSMap version 26 2024-09-19T06:24:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.562+0000 7fa93b7f5740 1 -- 172.21.15.2:0/3308741074 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55905fff7fe0 con 0x55905ff74b40 2024-09-19T06:24:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.563+0000 7fa91a7fc640 1 -- 172.21.15.2:0/3308741074 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa91c010c10 con 0x55905ff74b40 2024-09-19T06:24:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.563+0000 7fa91a7fc640 1 -- 172.21.15.2:0/3308741074 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fa924045980 con 0x55905ff74b40 2024-09-19T06:24:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.563+0000 7fa93b7f5740 10 client.18777 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:24:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.563+0000 7fa93b7f5740 10 client.18777 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:24:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.563+0000 7fa93b7f5740 20 client.18777 populate_metadata read hostname 'smithi002' 2024-09-19T06:24:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.563+0000 7fa93b7f5740 1 --2- 172.21.15.2:0/3308741074 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55905fff8760 0x55905fffab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.563+0000 7fa93b7f5740 4 client.18777 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:24:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.563+0000 7fa93b7f5740 1 -- 172.21.15.2:0/3308741074 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55905fee0d70 con 0x55905fff8760 2024-09-19T06:24:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.563+0000 7fa92a7fc640 1 --2- 172.21.15.2:0/3308741074 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55905fff8760 0x55905fffab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.564+0000 7fa92a7fc640 1 --2- 172.21.15.2:0/3308741074 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55905fff8760 0x55905fffab80 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=840b22c7de0907b server_cookie=d0b9069a03e01d1a in_seq=0 out_seq=0 2024-09-19T06:24:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.564+0000 7fa91a7fc640 10 client.18777 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:24:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.564+0000 7fa91a7fc640 1 -- 172.21.15.2:0/3308741074 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55905fee0d70 con 0x55905fff8760 2024-09-19T06:24:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.564+0000 7fa91a7fc640 10 client.18777 handle_command_reply: tid=0 2024-09-19T06:24:16.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.564+0000 7fa93b7f5740 1 client.18777 shutdown 2024-09-19T06:24:16.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.564+0000 7fa93b7f5740 1 -- 172.21.15.2:0/3308741074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55905ff74b40 msgr2=0x55905ff869c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:16.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.564+0000 7fa93b7f5740 1 --2- 172.21.15.2:0/3308741074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55905ff74b40 0x55905ff869c0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fa924006010 tx=0x7fa924005090 comp rx=0 tx=0).stop 2024-09-19T06:24:16.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.564+0000 7fa93b7f5740 1 -- 172.21.15.2:0/3308741074 shutdown_connections 2024-09-19T06:24:16.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.564+0000 7fa93b7f5740 1 --2- 172.21.15.2:0/3308741074 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55905fff8760 0x55905fffab80 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:16.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.564+0000 7fa93b7f5740 1 --2- 172.21.15.2:0/3308741074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55905ff7e370 0x55905ff77360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:16.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.564+0000 7fa93b7f5740 1 --2- 172.21.15.2:0/3308741074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55905ff74b40 0x55905ff869c0 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:16.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.564+0000 7fa93b7f5740 1 --2- 172.21.15.2:0/3308741074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55905ff735d0 0x55905ff86480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:16.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.564+0000 7fa93b7f5740 1 -- 172.21.15.2:0/3308741074 >> 172.21.15.2:0/3308741074 conn(0x55905ff3c310 msgr2=0x55905ff75110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:16.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.564+0000 7fa91a7fc640 0 client.18777 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:24:16.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.564+0000 7fa93b7f5740 1 -- 172.21.15.2:0/3308741074 shutdown_connections 2024-09-19T06:24:16.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.564+0000 7fa93b7f5740 1 -- 172.21.15.2:0/3308741074 wait complete. 2024-09-19T06:24:16.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.564+0000 7fa93b7f5740 20 client.18777 trim_cache size 0 max 16384 2024-09-19T06:24:16.571 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:24:16.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.565+0000 7fa93941c640 1 -- 172.21.15.2:0/2236045095 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa9200a3430 msgr2=0x7fa9200a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:16.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.565+0000 7fa93941c640 1 --2- 172.21.15.2:0/2236045095 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa9200a3430 0x7fa9200a58f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa92c0cd530 tx=0x7fa92c06eef0 comp rx=0 tx=0).stop 2024-09-19T06:24:16.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.565+0000 7fa93941c640 1 -- 172.21.15.2:0/2236045095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa934106a80 msgr2=0x7fa93419ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:16.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.565+0000 7fa93941c640 1 --2- 172.21.15.2:0/2236045095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa934106a80 0x7fa93419ee20 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7fa92c00eaa0 tx=0x7fa92c00ef60 comp rx=0 tx=0).stop 2024-09-19T06:24:16.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.565+0000 7fa93941c640 1 -- 172.21.15.2:0/2236045095 shutdown_connections 2024-09-19T06:24:16.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.565+0000 7fa93941c640 1 --2- 172.21.15.2:0/2236045095 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa9200a3430 0x7fa9200a58f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:16.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.565+0000 7fa93941c640 1 --2- 172.21.15.2:0/2236045095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa934106a80 0x7fa93419ee20 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:16.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.565+0000 7fa93941c640 1 --2- 172.21.15.2:0/2236045095 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa934101420 0x7fa93419aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:16.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.565+0000 7fa93941c640 1 --2- 172.21.15.2:0/2236045095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa934100a80 0x7fa93419a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:16.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.565+0000 7fa93941c640 1 -- 172.21.15.2:0/2236045095 >> 172.21.15.2:0/2236045095 conn(0x7fa9340fc7a0 msgr2=0x7fa93406a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:16.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.565+0000 7fa93941c640 1 -- 172.21.15.2:0/2236045095 shutdown_connections 2024-09-19T06:24:16.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:16.565+0000 7fa93941c640 1 -- 172.21.15.2:0/2236045095 wait complete. 2024-09-19T06:24:17.271 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:24:17.535 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:24:17.655 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:17 smithi002 ceph-mon[30982]: pgmap v295: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T06:24:17.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:17 smithi090 ceph-mon[34497]: pgmap v295: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T06:24:17.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:17 smithi089 ceph-mon[34160]: pgmap v295: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T06:24:17.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.948+0000 7fe73fc0f640 1 -- 172.21.15.2:0/4199466338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe738074eb0 msgr2=0x7fe738112650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:17.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.948+0000 7fe73fc0f640 1 --2- 172.21.15.2:0/4199466338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe738074eb0 0x7fe738112650 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fe728009900 tx=0x7fe72802a480 comp rx=0 tx=0).stop 2024-09-19T06:24:17.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.948+0000 7fe73fc0f640 1 -- 172.21.15.2:0/4199466338 shutdown_connections 2024-09-19T06:24:17.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.948+0000 7fe73fc0f640 1 --2- 172.21.15.2:0/4199466338 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe738112b90 0x7fe738114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:17.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.948+0000 7fe73fc0f640 1 --2- 172.21.15.2:0/4199466338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe738074eb0 0x7fe738112650 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:17.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.948+0000 7fe73fc0f640 1 --2- 172.21.15.2:0/4199466338 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe738074590 0x7fe738074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:17.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.948+0000 7fe73fc0f640 1 -- 172.21.15.2:0/4199466338 >> 172.21.15.2:0/4199466338 conn(0x7fe7380fd8c0 msgr2=0x7fe7380ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:17.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.948+0000 7fe73fc0f640 1 -- 172.21.15.2:0/4199466338 shutdown_connections 2024-09-19T06:24:17.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.948+0000 7fe73fc0f640 1 -- 172.21.15.2:0/4199466338 wait complete. 2024-09-19T06:24:17.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.949+0000 7fe73fc0f640 1 Processor -- start 2024-09-19T06:24:17.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.949+0000 7fe73fc0f640 1 -- start start 2024-09-19T06:24:17.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.949+0000 7fe73fc0f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe738074590 0x7fe7381a4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:17.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.949+0000 7fe73fc0f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe738074eb0 0x7fe7381a4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:17.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.949+0000 7fe73fc0f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe738112b90 0x7fe73819e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:17.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.949+0000 7fe73fc0f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe738118460 con 0x7fe738112b90 2024-09-19T06:24:17.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.949+0000 7fe73fc0f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe7381182e0 con 0x7fe738074eb0 2024-09-19T06:24:17.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.949+0000 7fe73fc0f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe7381185e0 con 0x7fe738074590 2024-09-19T06:24:17.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.949+0000 7fe73e1ac640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe738112b90 0x7fe73819e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:17.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.949+0000 7fe73e1ac640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe738112b90 0x7fe73819e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57428/0 (socket says 172.21.15.2:57428) 2024-09-19T06:24:17.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.949+0000 7fe73e1ac640 1 -- 172.21.15.2:0/80759293 learned_addr learned my addr 172.21.15.2:0/80759293 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:17.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.949+0000 7fe73d9ab640 1 --2- 172.21.15.2:0/80759293 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe738074590 0x7fe7381a4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:17.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.949+0000 7fe73d1aa640 1 --2- 172.21.15.2:0/80759293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe738074eb0 0x7fe7381a4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:17.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.950+0000 7fe73e1ac640 1 -- 172.21.15.2:0/80759293 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe738074590 msgr2=0x7fe7381a4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:17.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.950+0000 7fe73e1ac640 1 --2- 172.21.15.2:0/80759293 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe738074590 0x7fe7381a4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:17.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.950+0000 7fe73e1ac640 1 -- 172.21.15.2:0/80759293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe738074eb0 msgr2=0x7fe7381a4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:17.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.950+0000 7fe73e1ac640 1 --2- 172.21.15.2:0/80759293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe738074eb0 0x7fe7381a4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:17.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.950+0000 7fe73e1ac640 1 -- 172.21.15.2:0/80759293 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe73819efb0 con 0x7fe738112b90 2024-09-19T06:24:17.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.950+0000 7fe73e1ac640 1 --2- 172.21.15.2:0/80759293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe738112b90 0x7fe73819e810 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7fe73000cad0 tx=0x7fe73000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:17.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.950+0000 7fe72effd640 1 -- 172.21.15.2:0/80759293 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe73000ae20 con 0x7fe738112b90 2024-09-19T06:24:17.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.950+0000 7fe72effd640 1 -- 172.21.15.2:0/80759293 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe730003e40 con 0x7fe738112b90 2024-09-19T06:24:17.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.950+0000 7fe73fc0f640 1 -- 172.21.15.2:0/80759293 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe73819f2a0 con 0x7fe738112b90 2024-09-19T06:24:17.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.950+0000 7fe72effd640 1 -- 172.21.15.2:0/80759293 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe73000f6b0 con 0x7fe738112b90 2024-09-19T06:24:17.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.950+0000 7fe73fc0f640 1 -- 172.21.15.2:0/80759293 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7381ab4f0 con 0x7fe738112b90 2024-09-19T06:24:17.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.952+0000 7fe72effd640 1 -- 172.21.15.2:0/80759293 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fe730004000 con 0x7fe738112b90 2024-09-19T06:24:17.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.953+0000 7fe741fe8740 1 Processor -- start 2024-09-19T06:24:17.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.953+0000 7fe741fe8740 1 -- start start 2024-09-19T06:24:17.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.953+0000 7fe741fe8740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b187bcb40 0x556b187bb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:17.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.953+0000 7fe741fe8740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b187bb5d0 0x556b187bba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:17.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.953+0000 7fe741fe8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b187c6370 0x556b187c8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:17.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.953+0000 7fe741fe8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556b187212f0 con 0x556b187c6370 2024-09-19T06:24:17.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.953+0000 7fe741fe8740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x556b186c8cf0 con 0x556b187bb5d0 2024-09-19T06:24:17.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.953+0000 7fe741fe8740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556b1871d2b0 con 0x556b187bcb40 2024-09-19T06:24:17.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.953+0000 7fe73d1aa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b187c6370 0x556b187c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:17.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.954+0000 7fe73d1aa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b187c6370 0x556b187c8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57436/0 (socket says 172.21.15.2:57436) 2024-09-19T06:24:17.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.954+0000 7fe73d1aa640 1 -- 172.21.15.2:0/2690709059 learned_addr learned my addr 172.21.15.2:0/2690709059 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:17.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.954+0000 7fe72effd640 1 --2- 172.21.15.2:0/80759293 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe7240a33b0 0x7fe7240a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:17.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.954+0000 7fe73e1ac640 1 --2- 172.21.15.2:0/80759293 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe7240a33b0 0x7fe7240a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:17.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.954+0000 7fe73d9ab640 1 --2- 172.21.15.2:0/2690709059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b187bb5d0 0x556b187bba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:17.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.954+0000 7fe73d1aa640 1 --2- 172.21.15.2:0/2690709059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b187bcb40 0x556b187bb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:17.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.954+0000 7fe73d1aa640 1 -- 172.21.15.2:0/2690709059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b187bcb40 msgr2=0x556b187bb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:17.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.954+0000 7fe72effd640 1 -- 172.21.15.2:0/80759293 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7fe7300cffd0 con 0x7fe738112b90 2024-09-19T06:24:17.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.954+0000 7fe73d1aa640 1 --2- 172.21.15.2:0/2690709059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b187bcb40 0x556b187bb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:17.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.954+0000 7fe73d1aa640 1 -- 172.21.15.2:0/2690709059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b187bb5d0 msgr2=0x556b187bba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:17.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.954+0000 7fe73d1aa640 1 --2- 172.21.15.2:0/2690709059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b187bb5d0 0x556b187bba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:17.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.954+0000 7fe73d1aa640 1 -- 172.21.15.2:0/2690709059 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b186ad3a0 con 0x556b187c6370 2024-09-19T06:24:17.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.954+0000 7fe73d9ab640 1 --2- 172.21.15.2:0/2690709059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b187bb5d0 0x556b187bba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:24:17.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.954+0000 7fe73d1aa640 1 --2- 172.21.15.2:0/2690709059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b187c6370 0x556b187c8760 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7fe728009900 tx=0x7fe728005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57a8bd702fb8b489 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:17.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.954+0000 7fe73e1ac640 1 --2- 172.21.15.2:0/80759293 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe7240a33b0 0x7fe7240a5870 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe73009c290 tx=0x7fe73006aff0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:17.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.954+0000 7fe723fff640 1 -- 172.21.15.2:0/2690709059 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe728035070 con 0x556b187c6370 2024-09-19T06:24:17.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.954+0000 7fe723fff640 1 -- 172.21.15.2:0/2690709059 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe728003b20 con 0x556b187c6370 2024-09-19T06:24:17.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.954+0000 7fe723fff640 1 -- 172.21.15.2:0/2690709059 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe728031c10 con 0x556b187c6370 2024-09-19T06:24:17.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.955+0000 7fe741fe8740 1 -- 172.21.15.2:0/2690709059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b187c6370 msgr2=0x556b187c8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:17.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.955+0000 7fe741fe8740 1 --2- 172.21.15.2:0/2690709059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b187c6370 0x556b187c8760 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7fe728009900 tx=0x7fe728005fd0 comp rx=0 tx=0).stop 2024-09-19T06:24:17.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.955+0000 7fe741fe8740 1 -- 172.21.15.2:0/2690709059 shutdown_connections 2024-09-19T06:24:17.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.955+0000 7fe741fe8740 1 --2- 172.21.15.2:0/2690709059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b187c6370 0x556b187c8760 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:17.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.955+0000 7fe741fe8740 1 --2- 172.21.15.2:0/2690709059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b187bb5d0 0x556b187bba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:17.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.955+0000 7fe741fe8740 1 --2- 172.21.15.2:0/2690709059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b187bcb40 0x556b187bb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:17.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.955+0000 7fe741fe8740 1 -- 172.21.15.2:0/2690709059 >> 172.21.15.2:0/2690709059 conn(0x556b18784310 msgr2=0x556b187b7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:17.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.955+0000 7fe741fe8740 1 -- 172.21.15.2:0/2690709059 shutdown_connections 2024-09-19T06:24:17.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.955+0000 7fe741fe8740 1 -- 172.21.15.2:0/2690709059 wait complete. 2024-09-19T06:24:17.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.955+0000 7fe741fe8740 1 -- start start 2024-09-19T06:24:17.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.956+0000 7fe741fe8740 1 Processor -- start 2024-09-19T06:24:17.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.956+0000 7fe741fe8740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b187bb5d0 0x556b187c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:17.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.956+0000 7fe741fe8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b187bcb40 0x556b187c3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:17.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.956+0000 7fe741fe8740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b187c6370 0x556b187c3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:17.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.956+0000 7fe741fe8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556b187c9010 con 0x556b187bcb40 2024-09-19T06:24:17.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.956+0000 7fe741fe8740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x556b186dc060 con 0x556b187c6370 2024-09-19T06:24:17.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.956+0000 7fe741fe8740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556b187c9190 con 0x556b187bb5d0 2024-09-19T06:24:17.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.956+0000 7fe741fe8740 10 client.0 _ll_register_callbacks cb 0x556b1842f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:17.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.956+0000 7fe73d9ab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b187bcb40 0x556b187c3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:17.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.956+0000 7fe73d9ab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b187bcb40 0x556b187c3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57438/0 (socket says 172.21.15.2:57438) 2024-09-19T06:24:17.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.956+0000 7fe73d9ab640 1 -- 172.21.15.2:0/1986761111 learned_addr learned my addr 172.21.15.2:0/1986761111 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:17.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.956+0000 7fe73d1aa640 1 --2- 172.21.15.2:0/1986761111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b187c6370 0x556b187c3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:17.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.956+0000 7fe73d1aa640 1 --2- 172.21.15.2:0/1986761111 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b187bb5d0 0x556b187c5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:17.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.957+0000 7fe73d9ab640 1 -- 172.21.15.2:0/1986761111 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b187bb5d0 msgr2=0x556b187c5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:17.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.957+0000 7fe73d9ab640 1 --2- 172.21.15.2:0/1986761111 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b187bb5d0 0x556b187c5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:17.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.957+0000 7fe73d9ab640 1 -- 172.21.15.2:0/1986761111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b187c6370 msgr2=0x556b187c3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:17.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.957+0000 7fe73d9ab640 1 --2- 172.21.15.2:0/1986761111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b187c6370 0x556b187c3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:17.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.957+0000 7fe73d9ab640 1 -- 172.21.15.2:0/1986761111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b184923c0 con 0x556b187bcb40 2024-09-19T06:24:17.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.957+0000 7fe73d1aa640 1 --2- 172.21.15.2:0/1986761111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b187c6370 0x556b187c3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:24:17.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.957+0000 7fe73d9ab640 1 --2- 172.21.15.2:0/1986761111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b187bcb40 0x556b187c3020 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fe73400baa0 tx=0x7fe73400bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbbfe2d936905145 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:17.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.957+0000 7fe7217fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:24:17.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.957+0000 7fe7217fa640 1 -- 172.21.15.2:0/1986761111 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe73401b640 con 0x556b187bcb40 2024-09-19T06:24:17.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.957+0000 7fe741fe8740 1 -- 172.21.15.2:0/1986761111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe728003b20 con 0x556b187bcb40 2024-09-19T06:24:17.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.957+0000 7fe7217fa640 1 -- 172.21.15.2:0/1986761111 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7fe734011440 con 0x556b187bcb40 2024-09-19T06:24:17.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.957+0000 7fe7217fa640 1 -- 172.21.15.2:0/1986761111 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe73401b7e0 con 0x556b187bcb40 2024-09-19T06:24:17.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.957+0000 7fe741fe8740 10 client.18789 fetch_fsmap learned FSMap version 26 2024-09-19T06:24:17.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.957+0000 7fe741fe8740 1 -- 172.21.15.2:0/1986761111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556b187d4b10 con 0x556b187bcb40 2024-09-19T06:24:17.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.957+0000 7fe7217fa640 1 -- 172.21.15.2:0/1986761111 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe728003b20 con 0x556b187bcb40 2024-09-19T06:24:17.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.958+0000 7fe7217fa640 1 -- 172.21.15.2:0/1986761111 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fe734019020 con 0x556b187bcb40 2024-09-19T06:24:17.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.958+0000 7fe741fe8740 10 client.18789 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:24:17.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.958+0000 7fe741fe8740 10 client.18789 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:24:17.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.958+0000 7fe741fe8740 20 client.18789 populate_metadata read hostname 'smithi002' 2024-09-19T06:24:17.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.958+0000 7fe741fe8740 1 --2- 172.21.15.2:0/1986761111 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x556b187d5f70 0x556b187d8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:17.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.958+0000 7fe741fe8740 4 client.18789 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:24:17.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.958+0000 7fe741fe8740 1 -- 172.21.15.2:0/1986761111 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b1872e860 con 0x556b187d5f70 2024-09-19T06:24:17.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.958+0000 7fe73d1aa640 1 --2- 172.21.15.2:0/1986761111 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x556b187d5f70 0x556b187d8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:17.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.958+0000 7fe7217fa640 10 client.18789 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:24:17.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.958+0000 7fe73d1aa640 1 --2- 172.21.15.2:0/1986761111 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x556b187d5f70 0x556b187d8390 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4c675bc079d55c1d server_cookie=bd586955f9784445 in_seq=0 out_seq=0 2024-09-19T06:24:17.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.959+0000 7fe7217fa640 1 -- 172.21.15.2:0/1986761111 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556b1872e860 con 0x556b187d5f70 2024-09-19T06:24:17.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.959+0000 7fe7217fa640 10 client.18789 handle_command_reply: tid=0 2024-09-19T06:24:17.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.959+0000 7fe741fe8740 1 client.18789 shutdown 2024-09-19T06:24:17.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.959+0000 7fe741fe8740 1 -- 172.21.15.2:0/1986761111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b187bcb40 msgr2=0x556b187c3020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:17.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.959+0000 7fe741fe8740 1 --2- 172.21.15.2:0/1986761111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b187bcb40 0x556b187c3020 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fe73400baa0 tx=0x7fe73400bf60 comp rx=0 tx=0).stop 2024-09-19T06:24:17.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.959+0000 7fe741fe8740 1 -- 172.21.15.2:0/1986761111 shutdown_connections 2024-09-19T06:24:17.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.959+0000 7fe741fe8740 1 --2- 172.21.15.2:0/1986761111 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x556b187d5f70 0x556b187d8390 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:17.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.959+0000 7fe741fe8740 1 --2- 172.21.15.2:0/1986761111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b187c6370 0x556b187c3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:17.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.959+0000 7fe741fe8740 1 --2- 172.21.15.2:0/1986761111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b187bcb40 0x556b187c3020 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:17.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.959+0000 7fe741fe8740 1 --2- 172.21.15.2:0/1986761111 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b187bb5d0 0x556b187c5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:17.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.959+0000 7fe7217fa640 0 client.18789 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:24:17.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.959+0000 7fe741fe8740 1 -- 172.21.15.2:0/1986761111 >> 172.21.15.2:0/1986761111 conn(0x556b18784310 msgr2=0x556b187bd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:17.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.959+0000 7fe741fe8740 1 -- 172.21.15.2:0/1986761111 shutdown_connections 2024-09-19T06:24:17.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.960+0000 7fe741fe8740 1 -- 172.21.15.2:0/1986761111 wait complete. 2024-09-19T06:24:17.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.960+0000 7fe741fe8740 20 client.18789 trim_cache size 0 max 16384 2024-09-19T06:24:17.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.973+0000 7fe741fe8740 1 Processor -- start 2024-09-19T06:24:17.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.973+0000 7fe741fe8740 1 -- start start 2024-09-19T06:24:17.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.973+0000 7fe741fe8740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b187bb5d0 0x556b187d22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:17.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.973+0000 7fe741fe8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b187bcb40 0x556b187b2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:17.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.973+0000 7fe741fe8740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b187c6370 0x556b187c2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:17.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.973+0000 7fe741fe8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe7381b67a0 con 0x556b187bcb40 2024-09-19T06:24:17.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.973+0000 7fe741fe8740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe7381b4070 con 0x556b187bb5d0 2024-09-19T06:24:17.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.973+0000 7fe741fe8740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe7381b1ee0 con 0x556b187c6370 2024-09-19T06:24:17.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.973+0000 7fe73d9ab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b187bcb40 0x556b187b2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:17.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.973+0000 7fe73d9ab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b187bcb40 0x556b187b2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57452/0 (socket says 172.21.15.2:57452) 2024-09-19T06:24:17.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.973+0000 7fe73d9ab640 1 -- 172.21.15.2:0/1912348219 learned_addr learned my addr 172.21.15.2:0/1912348219 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:17.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.973+0000 7fe73d9ab640 1 -- 172.21.15.2:0/1912348219 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b187c6370 msgr2=0x556b187c2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:17.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.973+0000 7fe73d1aa640 1 --2- 172.21.15.2:0/1912348219 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b187c6370 0x556b187c2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:17.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.973+0000 7fe73d9ab640 1 --2- 172.21.15.2:0/1912348219 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b187c6370 0x556b187c2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:17.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.973+0000 7fe73d1aa640 1 --2- 172.21.15.2:0/1912348219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b187bb5d0 0x556b187d22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:17.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.973+0000 7fe73d9ab640 1 -- 172.21.15.2:0/1912348219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b187bb5d0 msgr2=0x556b187d22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:17.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.973+0000 7fe73d9ab640 1 --2- 172.21.15.2:0/1912348219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b187bb5d0 0x556b187d22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:17.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.973+0000 7fe73d9ab640 1 -- 172.21.15.2:0/1912348219 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b187b7de0 con 0x556b187bcb40 2024-09-19T06:24:17.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.973+0000 7fe73d1aa640 1 --2- 172.21.15.2:0/1912348219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b187bb5d0 0x556b187d22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:24:17.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.973+0000 7fe73d9ab640 1 --2- 172.21.15.2:0/1912348219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b187bcb40 0x556b187b2ad0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fe734011f10 tx=0x7fe734004440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c938e24a464129a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:17.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.974+0000 7fe7237fe640 1 -- 172.21.15.2:0/1912348219 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe73401b640 con 0x556b187bcb40 2024-09-19T06:24:17.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.974+0000 7fe7237fe640 1 -- 172.21.15.2:0/1912348219 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe734024480 con 0x556b187bcb40 2024-09-19T06:24:17.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.974+0000 7fe7237fe640 1 -- 172.21.15.2:0/1912348219 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe734011440 con 0x556b187bcb40 2024-09-19T06:24:17.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.974+0000 7fe741fe8740 1 -- 172.21.15.2:0/1912348219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b187bcb40 msgr2=0x556b187b2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:17.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.974+0000 7fe741fe8740 1 --2- 172.21.15.2:0/1912348219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b187bcb40 0x556b187b2ad0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fe734011f10 tx=0x7fe734004440 comp rx=0 tx=0).stop 2024-09-19T06:24:17.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.974+0000 7fe741fe8740 1 -- 172.21.15.2:0/1912348219 shutdown_connections 2024-09-19T06:24:17.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.974+0000 7fe741fe8740 1 --2- 172.21.15.2:0/1912348219 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b187c6370 0x556b187c2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:17.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.974+0000 7fe741fe8740 1 --2- 172.21.15.2:0/1912348219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b187bcb40 0x556b187b2ad0 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:17.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.974+0000 7fe741fe8740 1 --2- 172.21.15.2:0/1912348219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b187bb5d0 0x556b187d22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:17.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.974+0000 7fe741fe8740 1 -- 172.21.15.2:0/1912348219 >> 172.21.15.2:0/1912348219 conn(0x556b18784310 msgr2=0x556b187c1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:17.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.975+0000 7fe741fe8740 1 -- 172.21.15.2:0/1912348219 shutdown_connections 2024-09-19T06:24:17.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.975+0000 7fe741fe8740 1 -- 172.21.15.2:0/1912348219 wait complete. 2024-09-19T06:24:17.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.975+0000 7fe741fe8740 1 -- start start 2024-09-19T06:24:17.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.975+0000 7fe741fe8740 1 Processor -- start 2024-09-19T06:24:17.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.975+0000 7fe741fe8740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b187bb5d0 0x556b187ce420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:17.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.975+0000 7fe741fe8740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b187bcb40 0x556b187ce960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:17.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.975+0000 7fe741fe8740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b187c6370 0x556b187bf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:17.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.975+0000 7fe741fe8740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe7381b2530 con 0x556b187c6370 2024-09-19T06:24:17.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.975+0000 7fe741fe8740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe7381b39a0 con 0x556b187bb5d0 2024-09-19T06:24:17.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.975+0000 7fe741fe8740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe7381b2c00 con 0x556b187bcb40 2024-09-19T06:24:17.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.975+0000 7fe741fe8740 10 client.0 _ll_register_callbacks cb 0x7fe734004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:17.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.976+0000 7fe73d1aa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b187c6370 0x556b187bf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:17.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.976+0000 7fe73d1aa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b187c6370 0x556b187bf6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57466/0 (socket says 172.21.15.2:57466) 2024-09-19T06:24:17.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.976+0000 7fe73d1aa640 1 -- 172.21.15.2:0/3983441333 learned_addr learned my addr 172.21.15.2:0/3983441333 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:17.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.976+0000 7fe73d1aa640 1 --2- 172.21.15.2:0/3983441333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b187bb5d0 0x556b187ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:17.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.976+0000 7fe73d9ab640 1 --2- 172.21.15.2:0/3983441333 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b187bcb40 0x556b187ce960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:17.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.976+0000 7fe73d1aa640 1 -- 172.21.15.2:0/3983441333 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b187bcb40 msgr2=0x556b187ce960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:17.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.976+0000 7fe73d1aa640 1 --2- 172.21.15.2:0/3983441333 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b187bcb40 0x556b187ce960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:17.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.976+0000 7fe73d1aa640 1 -- 172.21.15.2:0/3983441333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b187bb5d0 msgr2=0x556b187ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:17.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.976+0000 7fe73d1aa640 1 --2- 172.21.15.2:0/3983441333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b187bb5d0 0x556b187ce420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:17.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.976+0000 7fe73d1aa640 1 -- 172.21.15.2:0/3983441333 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b187bfcb0 con 0x556b187c6370 2024-09-19T06:24:17.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.976+0000 7fe73d9ab640 1 --2- 172.21.15.2:0/3983441333 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b187bcb40 0x556b187ce960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:24:17.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.976+0000 7fe73d1aa640 1 --2- 172.21.15.2:0/3983441333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b187c6370 0x556b187bf6c0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fe728000c00 tx=0x7fe72804b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9209a1ca249583bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:17.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.976+0000 7fe7217fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:24:17.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.976+0000 7fe7217fa640 1 -- 172.21.15.2:0/3983441333 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe728035040 con 0x556b187c6370 2024-09-19T06:24:17.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.976+0000 7fe7217fa640 1 -- 172.21.15.2:0/3983441333 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7fe728031ab0 con 0x556b187c6370 2024-09-19T06:24:17.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.976+0000 7fe741fe8740 1 -- 172.21.15.2:0/3983441333 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556b18728d70 con 0x556b187c6370 2024-09-19T06:24:17.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.977+0000 7fe7217fa640 1 -- 172.21.15.2:0/3983441333 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe7280314a0 con 0x556b187c6370 2024-09-19T06:24:17.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.977+0000 7fe741fe8740 10 client.18795 fetch_fsmap learned FSMap version 26 2024-09-19T06:24:17.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.977+0000 7fe741fe8740 1 -- 172.21.15.2:0/3983441333 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556b18840440 con 0x556b187c6370 2024-09-19T06:24:17.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.977+0000 7fe7217fa640 1 -- 172.21.15.2:0/3983441333 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x556b18728d70 con 0x556b187c6370 2024-09-19T06:24:17.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.977+0000 7fe7217fa640 1 -- 172.21.15.2:0/3983441333 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fe72803d450 con 0x556b187c6370 2024-09-19T06:24:17.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.977+0000 7fe741fe8740 10 client.18795 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:24:17.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.977+0000 7fe741fe8740 10 client.18795 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:24:17.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.977+0000 7fe741fe8740 20 client.18795 populate_metadata read hostname 'smithi002' 2024-09-19T06:24:17.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.977+0000 7fe741fe8740 1 --2- 172.21.15.2:0/3983441333 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x556b18840770 0x556b18842b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:17.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.977+0000 7fe741fe8740 4 client.18795 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:24:17.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.977+0000 7fe741fe8740 1 -- 172.21.15.2:0/3983441333 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556b186a5170 con 0x556b18840770 2024-09-19T06:24:17.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.978+0000 7fe73d9ab640 1 --2- 172.21.15.2:0/3983441333 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x556b18840770 0x556b18842b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:17.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.978+0000 7fe7217fa640 10 client.18795 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:24:17.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.978+0000 7fe73d9ab640 1 --2- 172.21.15.2:0/3983441333 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x556b18840770 0x556b18842b60 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d2880fe2fb79290f server_cookie=4521c862c54fa17b in_seq=0 out_seq=0 2024-09-19T06:24:17.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.978+0000 7fe7217fa640 1 -- 172.21.15.2:0/3983441333 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556b186a5170 con 0x556b18840770 2024-09-19T06:24:17.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.978+0000 7fe7217fa640 10 client.18795 handle_command_reply: tid=0 2024-09-19T06:24:17.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.978+0000 7fe741fe8740 1 client.18795 shutdown 2024-09-19T06:24:17.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.978+0000 7fe741fe8740 1 -- 172.21.15.2:0/3983441333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b187c6370 msgr2=0x556b187bf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:17.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.978+0000 7fe741fe8740 1 --2- 172.21.15.2:0/3983441333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b187c6370 0x556b187bf6c0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fe728000c00 tx=0x7fe72804b040 comp rx=0 tx=0).stop 2024-09-19T06:24:17.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.978+0000 7fe741fe8740 1 -- 172.21.15.2:0/3983441333 shutdown_connections 2024-09-19T06:24:17.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.978+0000 7fe741fe8740 1 --2- 172.21.15.2:0/3983441333 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x556b18840770 0x556b18842b60 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:17.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.978+0000 7fe741fe8740 1 --2- 172.21.15.2:0/3983441333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556b187c6370 0x556b187bf6c0 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:17.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.978+0000 7fe741fe8740 1 --2- 172.21.15.2:0/3983441333 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556b187bcb40 0x556b187ce960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:17.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.978+0000 7fe7217fa640 0 client.18795 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:24:17.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.978+0000 7fe741fe8740 1 --2- 172.21.15.2:0/3983441333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556b187bb5d0 0x556b187ce420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:17.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.978+0000 7fe741fe8740 1 -- 172.21.15.2:0/3983441333 >> 172.21.15.2:0/3983441333 conn(0x556b18784310 msgr2=0x556b187b64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:17.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.979+0000 7fe741fe8740 1 -- 172.21.15.2:0/3983441333 shutdown_connections 2024-09-19T06:24:17.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.979+0000 7fe741fe8740 1 -- 172.21.15.2:0/3983441333 wait complete. 2024-09-19T06:24:17.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.979+0000 7fe741fe8740 20 client.18795 trim_cache size 0 max 16384 2024-09-19T06:24:17.996 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:24:17.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.979+0000 7fe73fc0f640 1 -- 172.21.15.2:0/80759293 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe7240a33b0 msgr2=0x7fe7240a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:17.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.979+0000 7fe73fc0f640 1 --2- 172.21.15.2:0/80759293 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe7240a33b0 0x7fe7240a5870 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe73009c290 tx=0x7fe73006aff0 comp rx=0 tx=0).stop 2024-09-19T06:24:17.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.979+0000 7fe73fc0f640 1 -- 172.21.15.2:0/80759293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe738112b90 msgr2=0x7fe73819e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:17.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.979+0000 7fe73fc0f640 1 --2- 172.21.15.2:0/80759293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe738112b90 0x7fe73819e810 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7fe73000cad0 tx=0x7fe73000cf90 comp rx=0 tx=0).stop 2024-09-19T06:24:17.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.979+0000 7fe73fc0f640 1 -- 172.21.15.2:0/80759293 shutdown_connections 2024-09-19T06:24:17.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.979+0000 7fe73fc0f640 1 --2- 172.21.15.2:0/80759293 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fe7240a33b0 0x7fe7240a5870 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:17.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.979+0000 7fe73fc0f640 1 --2- 172.21.15.2:0/80759293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe738112b90 0x7fe73819e810 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:17.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.979+0000 7fe73fc0f640 1 --2- 172.21.15.2:0/80759293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe738074eb0 0x7fe7381a4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:17.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.979+0000 7fe73fc0f640 1 --2- 172.21.15.2:0/80759293 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe738074590 0x7fe7381a4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:17.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.979+0000 7fe73fc0f640 1 -- 172.21.15.2:0/80759293 >> 172.21.15.2:0/80759293 conn(0x7fe7380fd8c0 msgr2=0x7fe7380ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:17.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.979+0000 7fe73fc0f640 1 -- 172.21.15.2:0/80759293 shutdown_connections 2024-09-19T06:24:17.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:17.980+0000 7fe73fc0f640 1 -- 172.21.15.2:0/80759293 wait complete. 2024-09-19T06:24:18.644 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:24:18.902 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:24:19.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.333+0000 7fb326906640 1 -- 172.21.15.2:0/2604043826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb320103660 msgr2=0x7fb32010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:19.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.333+0000 7fb326906640 1 --2- 172.21.15.2:0/2604043826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb320103660 0x7fb32010bb50 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fb314009900 tx=0x7fb31402a480 comp rx=0 tx=0).stop 2024-09-19T06:24:19.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.333+0000 7fb326906640 1 -- 172.21.15.2:0/2604043826 shutdown_connections 2024-09-19T06:24:19.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.333+0000 7fb326906640 1 --2- 172.21.15.2:0/2604043826 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb32010c170 0x7fb32010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:19.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.333+0000 7fb326906640 1 --2- 172.21.15.2:0/2604043826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb320103660 0x7fb32010bb50 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:19.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.334+0000 7fb326906640 1 --2- 172.21.15.2:0/2604043826 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb320102d40 0x7fb320103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:19.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.334+0000 7fb326906640 1 -- 172.21.15.2:0/2604043826 >> 172.21.15.2:0/2604043826 conn(0x7fb3200fc7a0 msgr2=0x7fb3200febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:19.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.334+0000 7fb326906640 1 -- 172.21.15.2:0/2604043826 shutdown_connections 2024-09-19T06:24:19.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.334+0000 7fb326906640 1 -- 172.21.15.2:0/2604043826 wait complete. 2024-09-19T06:24:19.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.334+0000 7fb326906640 1 Processor -- start 2024-09-19T06:24:19.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.334+0000 7fb326906640 1 -- start start 2024-09-19T06:24:19.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.335+0000 7fb326906640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb320102d40 0x7fb320198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:19.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.335+0000 7fb326906640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb320103660 0x7fb320198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:19.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.335+0000 7fb326906640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb32010c170 0x7fb32019ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:19.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.335+0000 7fb326906640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb320111e60 con 0x7fb320102d40 2024-09-19T06:24:19.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.335+0000 7fb326906640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb320111ce0 con 0x7fb32010c170 2024-09-19T06:24:19.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.335+0000 7fb326906640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb320111fe0 con 0x7fb320103660 2024-09-19T06:24:19.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.335+0000 7fb31ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb320102d40 0x7fb320198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:19.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.335+0000 7fb31ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb320102d40 0x7fb320198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57480/0 (socket says 172.21.15.2:57480) 2024-09-19T06:24:19.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.335+0000 7fb31ffff640 1 -- 172.21.15.2:0/4006087354 learned_addr learned my addr 172.21.15.2:0/4006087354 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:19.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.335+0000 7fb31f7fe640 1 --2- 172.21.15.2:0/4006087354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb320103660 0x7fb320198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:19.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.335+0000 7fb324ea3640 1 --2- 172.21.15.2:0/4006087354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb32010c170 0x7fb32019ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:19.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.335+0000 7fb31ffff640 1 -- 172.21.15.2:0/4006087354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb320103660 msgr2=0x7fb320198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:19.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.335+0000 7fb31ffff640 1 --2- 172.21.15.2:0/4006087354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb320103660 0x7fb320198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:19.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.335+0000 7fb31ffff640 1 -- 172.21.15.2:0/4006087354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb32010c170 msgr2=0x7fb32019ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:19.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.335+0000 7fb31ffff640 1 --2- 172.21.15.2:0/4006087354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb32010c170 0x7fb32019ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:19.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.335+0000 7fb31ffff640 1 -- 172.21.15.2:0/4006087354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb32019d3b0 con 0x7fb320102d40 2024-09-19T06:24:19.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.335+0000 7fb31f7fe640 1 --2- 172.21.15.2:0/4006087354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb320103660 0x7fb320198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:24:19.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.335+0000 7fb324ea3640 1 --2- 172.21.15.2:0/4006087354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb32010c170 0x7fb32019ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:24:19.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.335+0000 7fb31ffff640 1 --2- 172.21.15.2:0/4006087354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb320102d40 0x7fb320198400 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fb31000b4a0 tx=0x7fb31000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:19.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.336+0000 7fb31d7fa640 1 -- 172.21.15.2:0/4006087354 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb310014070 con 0x7fb320102d40 2024-09-19T06:24:19.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.336+0000 7fb326906640 1 -- 172.21.15.2:0/4006087354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb32019d6a0 con 0x7fb320102d40 2024-09-19T06:24:19.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.336+0000 7fb31d7fa640 1 -- 172.21.15.2:0/4006087354 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb310010ac0 con 0x7fb320102d40 2024-09-19T06:24:19.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.336+0000 7fb31d7fa640 1 -- 172.21.15.2:0/4006087354 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb310017c30 con 0x7fb320102d40 2024-09-19T06:24:19.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.336+0000 7fb326906640 1 -- 172.21.15.2:0/4006087354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3201a4f80 con 0x7fb320102d40 2024-09-19T06:24:19.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.338+0000 7fb31d7fa640 1 -- 172.21.15.2:0/4006087354 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fb310017070 con 0x7fb320102d40 2024-09-19T06:24:19.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.338+0000 7fb328cdf740 1 Processor -- start 2024-09-19T06:24:19.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.338+0000 7fb328cdf740 1 -- start start 2024-09-19T06:24:19.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.339+0000 7fb328cdf740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560559788b40 0x560559787090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:19.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.339+0000 7fb328cdf740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605597875d0 0x560559787a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:19.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.339+0000 7fb328cdf740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560559792370 0x560559794760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:19.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.339+0000 7fb328cdf740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5605596ed2f0 con 0x5605597875d0 2024-09-19T06:24:19.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.339+0000 7fb328cdf740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x560559694cf0 con 0x560559792370 2024-09-19T06:24:19.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.339+0000 7fb328cdf740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5605596e92b0 con 0x560559788b40 2024-09-19T06:24:19.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.339+0000 7fb31ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605597875d0 0x560559787a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:19.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.339+0000 7fb31ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605597875d0 0x560559787a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57492/0 (socket says 172.21.15.2:57492) 2024-09-19T06:24:19.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.339+0000 7fb31ffff640 1 -- 172.21.15.2:0/2768550418 learned_addr learned my addr 172.21.15.2:0/2768550418 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:19.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.339+0000 7fb31d7fa640 1 --2- 172.21.15.2:0/4006087354 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb3080a33b0 0x7fb3080a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:19.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.339+0000 7fb324ea3640 1 --2- 172.21.15.2:0/2768550418 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560559788b40 0x560559787090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:19.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.339+0000 7fb31f7fe640 1 --2- 172.21.15.2:0/2768550418 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560559792370 0x560559794760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:19.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.339+0000 7fb324ea3640 1 --2- 172.21.15.2:0/4006087354 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb3080a33b0 0x7fb3080a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:19.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.339+0000 7fb31d7fa640 1 -- 172.21.15.2:0/4006087354 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7fb3100cf0a0 con 0x7fb320102d40 2024-09-19T06:24:19.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.339+0000 7fb31ffff640 1 -- 172.21.15.2:0/2768550418 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560559788b40 msgr2=0x560559787090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:19.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.339+0000 7fb31ffff640 1 --2- 172.21.15.2:0/2768550418 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560559788b40 0x560559787090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:19.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.339+0000 7fb31ffff640 1 -- 172.21.15.2:0/2768550418 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560559792370 msgr2=0x560559794760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:19.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.339+0000 7fb31ffff640 1 --2- 172.21.15.2:0/2768550418 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560559792370 0x560559794760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:19.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.339+0000 7fb31ffff640 1 -- 172.21.15.2:0/2768550418 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605596793a0 con 0x5605597875d0 2024-09-19T06:24:19.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.339+0000 7fb31f7fe640 1 --2- 172.21.15.2:0/2768550418 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560559792370 0x560559794760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:24:19.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.340+0000 7fb31ffff640 1 --2- 172.21.15.2:0/2768550418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605597875d0 0x560559787a10 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fb31009b130 tx=0x7fb31000bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59b8739352788e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:19.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.340+0000 7fb324ea3640 1 --2- 172.21.15.2:0/4006087354 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb3080a33b0 0x7fb3080a5870 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb318009fd0 tx=0x7fb318004ab0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:19.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.340+0000 7fb3067fc640 1 -- 172.21.15.2:0/2768550418 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31001e070 con 0x5605597875d0 2024-09-19T06:24:19.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.340+0000 7fb3067fc640 1 -- 172.21.15.2:0/2768550418 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb31009bb30 con 0x5605597875d0 2024-09-19T06:24:19.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.340+0000 7fb3067fc640 1 -- 172.21.15.2:0/2768550418 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb310010c70 con 0x5605597875d0 2024-09-19T06:24:19.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.340+0000 7fb328cdf740 1 -- 172.21.15.2:0/2768550418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605597875d0 msgr2=0x560559787a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:19.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.340+0000 7fb328cdf740 1 --2- 172.21.15.2:0/2768550418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605597875d0 0x560559787a10 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fb31009b130 tx=0x7fb31000bf90 comp rx=0 tx=0).stop 2024-09-19T06:24:19.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.341+0000 7fb328cdf740 1 -- 172.21.15.2:0/2768550418 shutdown_connections 2024-09-19T06:24:19.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.341+0000 7fb328cdf740 1 --2- 172.21.15.2:0/2768550418 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560559792370 0x560559794760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:19.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.341+0000 7fb328cdf740 1 --2- 172.21.15.2:0/2768550418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5605597875d0 0x560559787a10 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:19.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.341+0000 7fb328cdf740 1 --2- 172.21.15.2:0/2768550418 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560559788b40 0x560559787090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:19.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.341+0000 7fb328cdf740 1 -- 172.21.15.2:0/2768550418 >> 172.21.15.2:0/2768550418 conn(0x560559750310 msgr2=0x560559783c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:19.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.341+0000 7fb328cdf740 1 -- 172.21.15.2:0/2768550418 shutdown_connections 2024-09-19T06:24:19.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.341+0000 7fb328cdf740 1 -- 172.21.15.2:0/2768550418 wait complete. 2024-09-19T06:24:19.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.341+0000 7fb328cdf740 1 -- start start 2024-09-19T06:24:19.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.341+0000 7fb328cdf740 1 Processor -- start 2024-09-19T06:24:19.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.341+0000 7fb328cdf740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5605597875d0 0x560559791dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:19.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.341+0000 7fb328cdf740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560559788b40 0x56055978f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:19.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.341+0000 7fb328cdf740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560559792370 0x56055978f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:19.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.341+0000 7fb328cdf740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560559795070 con 0x560559792370 2024-09-19T06:24:19.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.341+0000 7fb328cdf740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5605596a8060 con 0x560559788b40 2024-09-19T06:24:19.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.341+0000 7fb328cdf740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5605597951f0 con 0x5605597875d0 2024-09-19T06:24:19.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.342+0000 7fb328cdf740 10 client.0 _ll_register_callbacks cb 0x5605593fb8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:19.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.342+0000 7fb324ea3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560559792370 0x56055978f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:19.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.342+0000 7fb324ea3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560559792370 0x56055978f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57498/0 (socket says 172.21.15.2:57498) 2024-09-19T06:24:19.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.342+0000 7fb324ea3640 1 -- 172.21.15.2:0/203738811 learned_addr learned my addr 172.21.15.2:0/203738811 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:19.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.342+0000 7fb31f7fe640 1 --2- 172.21.15.2:0/203738811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560559788b40 0x56055978f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:19.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.342+0000 7fb31ffff640 1 --2- 172.21.15.2:0/203738811 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5605597875d0 0x560559791dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:19.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.342+0000 7fb324ea3640 1 -- 172.21.15.2:0/203738811 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5605597875d0 msgr2=0x560559791dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:19.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.342+0000 7fb324ea3640 1 --2- 172.21.15.2:0/203738811 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5605597875d0 0x560559791dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:19.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.342+0000 7fb324ea3640 1 -- 172.21.15.2:0/203738811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560559788b40 msgr2=0x56055978f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:19.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.342+0000 7fb324ea3640 1 --2- 172.21.15.2:0/203738811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560559788b40 0x56055978f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:19.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.342+0000 7fb324ea3640 1 -- 172.21.15.2:0/203738811 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56055945e3c0 con 0x560559792370 2024-09-19T06:24:19.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.342+0000 7fb324ea3640 1 --2- 172.21.15.2:0/203738811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560559792370 0x56055978f810 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fb318009e20 tx=0x7fb318004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58dde5f23cd0f15a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:19.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.342+0000 7fb2ff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:24:19.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.342+0000 7fb2ff7fe640 1 -- 172.21.15.2:0/203738811 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb318027070 con 0x560559792370 2024-09-19T06:24:19.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.342+0000 7fb2ff7fe640 1 -- 172.21.15.2:0/203738811 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7fb318021650 con 0x560559792370 2024-09-19T06:24:19.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.342+0000 7fb328cdf740 1 -- 172.21.15.2:0/203738811 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb31009bb30 con 0x560559792370 2024-09-19T06:24:19.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.343+0000 7fb2ff7fe640 1 -- 172.21.15.2:0/203738811 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb318033050 con 0x560559792370 2024-09-19T06:24:19.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.343+0000 7fb328cdf740 10 client.18807 fetch_fsmap learned FSMap version 26 2024-09-19T06:24:19.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.343+0000 7fb328cdf740 1 -- 172.21.15.2:0/203738811 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5605597a0b90 con 0x560559792370 2024-09-19T06:24:19.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.343+0000 7fb2ff7fe640 1 -- 172.21.15.2:0/203738811 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb31009bb30 con 0x560559792370 2024-09-19T06:24:19.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.343+0000 7fb2ff7fe640 1 -- 172.21.15.2:0/203738811 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fb31800f070 con 0x560559792370 2024-09-19T06:24:19.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.343+0000 7fb328cdf740 10 client.18807 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:24:19.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.343+0000 7fb328cdf740 10 client.18807 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:24:19.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.343+0000 7fb328cdf740 20 client.18807 populate_metadata read hostname 'smithi002' 2024-09-19T06:24:19.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.343+0000 7fb328cdf740 1 --2- 172.21.15.2:0/203738811 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5605597a1fa0 0x5605597a4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:19.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.343+0000 7fb328cdf740 4 client.18807 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:24:19.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.343+0000 7fb328cdf740 1 -- 172.21.15.2:0/203738811 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5605596fa860 con 0x5605597a1fa0 2024-09-19T06:24:19.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.343+0000 7fb31ffff640 1 --2- 172.21.15.2:0/203738811 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5605597a1fa0 0x5605597a4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:19.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.344+0000 7fb31ffff640 1 --2- 172.21.15.2:0/203738811 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5605597a1fa0 0x5605597a4400 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c93bee5a564e52eb server_cookie=fdc431fac04db9fe in_seq=0 out_seq=0 2024-09-19T06:24:19.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.344+0000 7fb2ff7fe640 10 client.18807 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:19.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.344+0000 7fb2ff7fe640 1 -- 172.21.15.2:0/203738811 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5605596fa860 con 0x5605597a1fa0 2024-09-19T06:24:19.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.344+0000 7fb2ff7fe640 10 client.18807 handle_command_reply: tid=0 2024-09-19T06:24:19.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.344+0000 7fb328cdf740 1 client.18807 shutdown 2024-09-19T06:24:19.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.345+0000 7fb328cdf740 1 -- 172.21.15.2:0/203738811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560559792370 msgr2=0x56055978f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:19.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.345+0000 7fb328cdf740 1 --2- 172.21.15.2:0/203738811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560559792370 0x56055978f810 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fb318009e20 tx=0x7fb318004a40 comp rx=0 tx=0).stop 2024-09-19T06:24:19.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.345+0000 7fb328cdf740 1 -- 172.21.15.2:0/203738811 shutdown_connections 2024-09-19T06:24:19.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.345+0000 7fb328cdf740 1 --2- 172.21.15.2:0/203738811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560559792370 0x56055978f810 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:19.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.345+0000 7fb328cdf740 1 --2- 172.21.15.2:0/203738811 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5605597a1fa0 0x5605597a4400 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:19.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.345+0000 7fb328cdf740 1 --2- 172.21.15.2:0/203738811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560559788b40 0x56055978f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:19.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.345+0000 7fb328cdf740 1 --2- 172.21.15.2:0/203738811 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5605597875d0 0x560559791dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:19.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.345+0000 7fb328cdf740 1 -- 172.21.15.2:0/203738811 >> 172.21.15.2:0/203738811 conn(0x560559750310 msgr2=0x560559789990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:19.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.345+0000 7fb2ff7fe640 0 client.18807 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:19.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.345+0000 7fb328cdf740 1 -- 172.21.15.2:0/203738811 shutdown_connections 2024-09-19T06:24:19.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.345+0000 7fb328cdf740 1 -- 172.21.15.2:0/203738811 wait complete. 2024-09-19T06:24:19.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.345+0000 7fb328cdf740 20 client.18807 trim_cache size 0 max 16384 2024-09-19T06:24:19.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.358+0000 7fb328cdf740 1 Processor -- start 2024-09-19T06:24:19.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.358+0000 7fb328cdf740 1 -- start start 2024-09-19T06:24:19.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.358+0000 7fb328cdf740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605597875d0 0x560559783e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:19.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.358+0000 7fb328cdf740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560559788b40 0x56055978a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:19.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.358+0000 7fb328cdf740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560559792370 0x56055978a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:19.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.358+0000 7fb328cdf740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb3201b00f0 con 0x560559792370 2024-09-19T06:24:19.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.358+0000 7fb328cdf740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb3201ad9c0 con 0x5605597875d0 2024-09-19T06:24:19.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.358+0000 7fb328cdf740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb3201ab830 con 0x560559788b40 2024-09-19T06:24:19.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.358+0000 7fb324ea3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560559792370 0x56055978a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:19.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.358+0000 7fb324ea3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560559792370 0x56055978a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57512/0 (socket says 172.21.15.2:57512) 2024-09-19T06:24:19.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.358+0000 7fb324ea3640 1 -- 172.21.15.2:0/849664904 learned_addr learned my addr 172.21.15.2:0/849664904 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:19.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.358+0000 7fb31ffff640 1 --2- 172.21.15.2:0/849664904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605597875d0 0x560559783e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:19.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.358+0000 7fb324ea3640 1 -- 172.21.15.2:0/849664904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560559788b40 msgr2=0x56055978a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:19.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.358+0000 7fb324ea3640 1 --2- 172.21.15.2:0/849664904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560559788b40 0x56055978a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:19.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.358+0000 7fb324ea3640 1 -- 172.21.15.2:0/849664904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605597875d0 msgr2=0x560559783e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:19.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.358+0000 7fb324ea3640 1 --2- 172.21.15.2:0/849664904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605597875d0 0x560559783e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:19.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.358+0000 7fb324ea3640 1 -- 172.21.15.2:0/849664904 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56055978d5d0 con 0x560559792370 2024-09-19T06:24:19.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.359+0000 7fb324ea3640 1 --2- 172.21.15.2:0/849664904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560559792370 0x56055978a660 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fb318017010 tx=0x7fb3180099f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c4a5b829a539013 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:19.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.359+0000 7fb305ffb640 1 -- 172.21.15.2:0/849664904 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31803b020 con 0x560559792370 2024-09-19T06:24:19.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.359+0000 7fb305ffb640 1 -- 172.21.15.2:0/849664904 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb318015aa0 con 0x560559792370 2024-09-19T06:24:19.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.359+0000 7fb305ffb640 1 -- 172.21.15.2:0/849664904 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb318027040 con 0x560559792370 2024-09-19T06:24:19.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.359+0000 7fb328cdf740 1 -- 172.21.15.2:0/849664904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560559792370 msgr2=0x56055978a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:19.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.359+0000 7fb328cdf740 1 --2- 172.21.15.2:0/849664904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560559792370 0x56055978a660 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fb318017010 tx=0x7fb3180099f0 comp rx=0 tx=0).stop 2024-09-19T06:24:19.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.359+0000 7fb328cdf740 1 -- 172.21.15.2:0/849664904 shutdown_connections 2024-09-19T06:24:19.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.359+0000 7fb328cdf740 1 --2- 172.21.15.2:0/849664904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560559792370 0x56055978a660 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:19.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.359+0000 7fb328cdf740 1 --2- 172.21.15.2:0/849664904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560559788b40 0x56055978a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:19.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.359+0000 7fb328cdf740 1 --2- 172.21.15.2:0/849664904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605597875d0 0x560559783e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:19.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.359+0000 7fb328cdf740 1 -- 172.21.15.2:0/849664904 >> 172.21.15.2:0/849664904 conn(0x560559750310 msgr2=0x560559783700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:19.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.360+0000 7fb328cdf740 1 -- 172.21.15.2:0/849664904 shutdown_connections 2024-09-19T06:24:19.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.360+0000 7fb328cdf740 1 -- 172.21.15.2:0/849664904 wait complete. 2024-09-19T06:24:19.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.360+0000 7fb328cdf740 1 -- start start 2024-09-19T06:24:19.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.360+0000 7fb328cdf740 1 Processor -- start 2024-09-19T06:24:19.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.360+0000 7fb328cdf740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5605597875d0 0x56055979ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:19.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.360+0000 7fb328cdf740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560559788b40 0x560559795f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:19.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.360+0000 7fb328cdf740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560559792370 0x5605597964f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:19.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.360+0000 7fb328cdf740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb3201abe80 con 0x560559788b40 2024-09-19T06:24:19.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.360+0000 7fb328cdf740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb3201ad2f0 con 0x560559792370 2024-09-19T06:24:19.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.360+0000 7fb328cdf740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb3201ac550 con 0x5605597875d0 2024-09-19T06:24:19.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.360+0000 7fb328cdf740 10 client.0 _ll_register_callbacks cb 0x7fb318015960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:19.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.360+0000 7fb31f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560559788b40 0x560559795f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:19.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.361+0000 7fb31ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5605597875d0 0x56055979ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:19.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.361+0000 7fb31f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560559788b40 0x560559795f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57524/0 (socket says 172.21.15.2:57524) 2024-09-19T06:24:19.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.361+0000 7fb31f7fe640 1 -- 172.21.15.2:0/368110154 learned_addr learned my addr 172.21.15.2:0/368110154 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:19.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.361+0000 7fb324ea3640 1 --2- 172.21.15.2:0/368110154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560559792370 0x5605597964f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:19.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.361+0000 7fb31ffff640 1 -- 172.21.15.2:0/368110154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560559792370 msgr2=0x5605597964f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:19.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.361+0000 7fb31ffff640 1 --2- 172.21.15.2:0/368110154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560559792370 0x5605597964f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:19.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.361+0000 7fb31ffff640 1 -- 172.21.15.2:0/368110154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560559788b40 msgr2=0x560559795f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:19.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.361+0000 7fb31ffff640 1 --2- 172.21.15.2:0/368110154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560559788b40 0x560559795f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:19.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.361+0000 7fb31ffff640 1 -- 172.21.15.2:0/368110154 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560559796d20 con 0x5605597875d0 2024-09-19T06:24:19.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.361+0000 7fb31f7fe640 1 --2- 172.21.15.2:0/368110154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560559788b40 0x560559795f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:24:19.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.361+0000 7fb31ffff640 1 --2- 172.21.15.2:0/368110154 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5605597875d0 0x56055979ac60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb3100996e0 tx=0x7fb3100046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6619031dcfd4afff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:19.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.361+0000 7fb2ff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-19T06:24:19.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.361+0000 7fb2ff7fe640 1 -- 172.21.15.2:0/368110154 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31001e040 con 0x5605597875d0 2024-09-19T06:24:19.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.361+0000 7fb328cdf740 1 -- 172.21.15.2:0/368110154 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5605596f4d70 con 0x5605597875d0 2024-09-19T06:24:19.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.361+0000 7fb2ff7fe640 1 -- 172.21.15.2:0/368110154 <== mon.1 v2:172.21.15.90:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7fb310010c70 con 0x5605597875d0 2024-09-19T06:24:19.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.361+0000 7fb2ff7fe640 1 -- 172.21.15.2:0/368110154 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb31009bb30 con 0x5605597875d0 2024-09-19T06:24:19.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.361+0000 7fb328cdf740 10 client.27637 fetch_fsmap learned FSMap version 26 2024-09-19T06:24:19.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.361+0000 7fb328cdf740 1 -- 172.21.15.2:0/368110154 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56055980cd80 con 0x5605597875d0 2024-09-19T06:24:19.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.362+0000 7fb2ff7fe640 1 -- 172.21.15.2:0/368110154 <== mon.1 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x5605596f4d70 con 0x5605597875d0 2024-09-19T06:24:19.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.362+0000 7fb2ff7fe640 1 -- 172.21.15.2:0/368110154 <== mon.1 v2:172.21.15.90:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fb3100b4200 con 0x5605597875d0 2024-09-19T06:24:19.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.362+0000 7fb328cdf740 10 client.27637 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:24:19.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.362+0000 7fb328cdf740 10 client.27637 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:24:19.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.362+0000 7fb328cdf740 20 client.27637 populate_metadata read hostname 'smithi002' 2024-09-19T06:24:19.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.362+0000 7fb328cdf740 1 --2- 172.21.15.2:0/368110154 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x56055980d010 0x56055980f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:19.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.362+0000 7fb328cdf740 4 client.27637 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:24:19.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.362+0000 7fb328cdf740 1 -- 172.21.15.2:0/368110154 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560559671170 con 0x56055980d010 2024-09-19T06:24:19.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.362+0000 7fb31f7fe640 1 --2- 172.21.15.2:0/368110154 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x56055980d010 0x56055980f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:19.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.363+0000 7fb2ff7fe640 10 client.27637 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:19.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.363+0000 7fb31f7fe640 1 --2- 172.21.15.2:0/368110154 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x56055980d010 0x56055980f400 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee6f76d3760a5a59 server_cookie=5b0183189487142d in_seq=0 out_seq=0 2024-09-19T06:24:19.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.363+0000 7fb2ff7fe640 1 -- 172.21.15.2:0/368110154 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560559671170 con 0x56055980d010 2024-09-19T06:24:19.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.363+0000 7fb2ff7fe640 10 client.27637 handle_command_reply: tid=0 2024-09-19T06:24:19.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.363+0000 7fb328cdf740 1 client.27637 shutdown 2024-09-19T06:24:19.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.363+0000 7fb328cdf740 1 -- 172.21.15.2:0/368110154 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5605597875d0 msgr2=0x56055979ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:19.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.363+0000 7fb328cdf740 1 --2- 172.21.15.2:0/368110154 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5605597875d0 0x56055979ac60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb3100996e0 tx=0x7fb3100046c0 comp rx=0 tx=0).stop 2024-09-19T06:24:19.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.363+0000 7fb328cdf740 1 -- 172.21.15.2:0/368110154 shutdown_connections 2024-09-19T06:24:19.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.363+0000 7fb328cdf740 1 --2- 172.21.15.2:0/368110154 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x56055980d010 0x56055980f400 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:19.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.363+0000 7fb328cdf740 1 --2- 172.21.15.2:0/368110154 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560559792370 0x5605597964f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:19.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.363+0000 7fb328cdf740 1 --2- 172.21.15.2:0/368110154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560559788b40 0x560559795f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:19.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.363+0000 7fb2ff7fe640 0 client.27637 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:19.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.363+0000 7fb328cdf740 1 --2- 172.21.15.2:0/368110154 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5605597875d0 0x56055979ac60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:19.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.363+0000 7fb328cdf740 1 -- 172.21.15.2:0/368110154 >> 172.21.15.2:0/368110154 conn(0x560559750310 msgr2=0x5605597824e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:19.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.363+0000 7fb328cdf740 1 -- 172.21.15.2:0/368110154 shutdown_connections 2024-09-19T06:24:19.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.363+0000 7fb328cdf740 1 -- 172.21.15.2:0/368110154 wait complete. 2024-09-19T06:24:19.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.363+0000 7fb328cdf740 20 client.27637 trim_cache size 0 max 16384 2024-09-19T06:24:19.370 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:24:19.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.364+0000 7fb326906640 1 -- 172.21.15.2:0/4006087354 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb3080a33b0 msgr2=0x7fb3080a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:19.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.364+0000 7fb326906640 1 --2- 172.21.15.2:0/4006087354 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb3080a33b0 0x7fb3080a5870 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb318009fd0 tx=0x7fb318004ab0 comp rx=0 tx=0).stop 2024-09-19T06:24:19.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.364+0000 7fb326906640 1 -- 172.21.15.2:0/4006087354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb320102d40 msgr2=0x7fb320198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:19.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.364+0000 7fb326906640 1 --2- 172.21.15.2:0/4006087354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb320102d40 0x7fb320198400 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fb31000b4a0 tx=0x7fb31000b960 comp rx=0 tx=0).stop 2024-09-19T06:24:19.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.364+0000 7fb326906640 1 -- 172.21.15.2:0/4006087354 shutdown_connections 2024-09-19T06:24:19.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.364+0000 7fb326906640 1 --2- 172.21.15.2:0/4006087354 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb3080a33b0 0x7fb3080a5870 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:19.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.364+0000 7fb326906640 1 --2- 172.21.15.2:0/4006087354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb32010c170 0x7fb32019ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:19.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.364+0000 7fb326906640 1 --2- 172.21.15.2:0/4006087354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb320103660 0x7fb320198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:19.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.364+0000 7fb326906640 1 --2- 172.21.15.2:0/4006087354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb320102d40 0x7fb320198400 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:19.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.364+0000 7fb326906640 1 -- 172.21.15.2:0/4006087354 >> 172.21.15.2:0/4006087354 conn(0x7fb3200fc7a0 msgr2=0x7fb3200fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:19.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.364+0000 7fb326906640 1 -- 172.21.15.2:0/4006087354 shutdown_connections 2024-09-19T06:24:19.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:19.364+0000 7fb326906640 1 -- 172.21.15.2:0/4006087354 wait complete. 2024-09-19T06:24:19.670 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:19 smithi002 ceph-mon[30982]: pgmap v296: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 206 B/s wr, 7 op/s 2024-09-19T06:24:19.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:19 smithi090 ceph-mon[34497]: pgmap v296: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 206 B/s wr, 7 op/s 2024-09-19T06:24:19.791 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:19 smithi089 ceph-mon[34160]: pgmap v296: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 206 B/s wr, 7 op/s 2024-09-19T06:24:21.078 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:24:21.078 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:24:21.349 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:24:21.691 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:21 smithi002 ceph-mon[30982]: pgmap v297: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-19T06:24:21.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:21 smithi090 ceph-mon[34497]: pgmap v297: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-19T06:24:21.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.775+0000 7fd409c82640 1 -- 172.21.15.2:0/222357681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd404106f10 msgr2=0x7fd40410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:21.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.775+0000 7fd409c82640 1 --2- 172.21.15.2:0/222357681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd404106f10 0x7fd40410ea90 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc009ca0 tx=0x7fd3fc02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:24:21.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.775+0000 7fd409c82640 1 -- 172.21.15.2:0/222357681 shutdown_connections 2024-09-19T06:24:21.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.775+0000 7fd409c82640 1 --2- 172.21.15.2:0/222357681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd404106f10 0x7fd40410ea90 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:21.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.775+0000 7fd409c82640 1 --2- 172.21.15.2:0/222357681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd404102790 0x7fd4041067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:21.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.775+0000 7fd409c82640 1 --2- 172.21.15.2:0/222357681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd404101de0 0x7fd4041021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:21.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.775+0000 7fd409c82640 1 -- 172.21.15.2:0/222357681 >> 172.21.15.2:0/222357681 conn(0x7fd4040fd8c0 msgr2=0x7fd4040ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:21.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.775+0000 7fd409c82640 1 -- 172.21.15.2:0/222357681 shutdown_connections 2024-09-19T06:24:21.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.775+0000 7fd409c82640 1 -- 172.21.15.2:0/222357681 wait complete. 2024-09-19T06:24:21.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.776+0000 7fd409c82640 1 Processor -- start 2024-09-19T06:24:21.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.776+0000 7fd409c82640 1 -- start start 2024-09-19T06:24:21.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.776+0000 7fd409c82640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd404101de0 0x7fd4040744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:21.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.776+0000 7fd409c82640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd404102790 0x7fd404074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:21.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.776+0000 7fd409c82640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd404106f10 0x7fd404074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:21.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.776+0000 7fd409c82640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd404111e20 con 0x7fd404101de0 2024-09-19T06:24:21.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.776+0000 7fd409c82640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd404111ca0 con 0x7fd404102790 2024-09-19T06:24:21.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.776+0000 7fd409c82640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd404111fa0 con 0x7fd404106f10 2024-09-19T06:24:21.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.776+0000 7fd4037fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd404101de0 0x7fd4040744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:21.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.777+0000 7fd4037fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd404101de0 0x7fd4040744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57544/0 (socket says 172.21.15.2:57544) 2024-09-19T06:24:21.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.777+0000 7fd4037fe640 1 -- 172.21.15.2:0/3566784560 learned_addr learned my addr 172.21.15.2:0/3566784560 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:21.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.777+0000 7fd402ffd640 1 --2- 172.21.15.2:0/3566784560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd404102790 0x7fd404074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:21.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.777+0000 7fd403fff640 1 --2- 172.21.15.2:0/3566784560 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd404106f10 0x7fd404074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:21.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.777+0000 7fd4037fe640 1 -- 172.21.15.2:0/3566784560 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd404106f10 msgr2=0x7fd404074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:21.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.777+0000 7fd4037fe640 1 --2- 172.21.15.2:0/3566784560 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd404106f10 0x7fd404074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:21.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.777+0000 7fd4037fe640 1 -- 172.21.15.2:0/3566784560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd404102790 msgr2=0x7fd404074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:21.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.777+0000 7fd4037fe640 1 --2- 172.21.15.2:0/3566784560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd404102790 0x7fd404074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:21.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.777+0000 7fd4037fe640 1 -- 172.21.15.2:0/3566784560 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4041a6740 con 0x7fd404101de0 2024-09-19T06:24:21.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.777+0000 7fd403fff640 1 --2- 172.21.15.2:0/3566784560 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd404106f10 0x7fd404074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:24:21.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.777+0000 7fd4037fe640 1 --2- 172.21.15.2:0/3566784560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd404101de0 0x7fd4040744f0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec00d770 tx=0x7fd3ec00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:21.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.777+0000 7fd400ff9640 1 -- 172.21.15.2:0/3566784560 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec017070 con 0x7fd404101de0 2024-09-19T06:24:21.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.777+0000 7fd400ff9640 1 -- 172.21.15.2:0/3566784560 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd3ec0054d0 con 0x7fd404101de0 2024-09-19T06:24:21.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.777+0000 7fd409c82640 1 -- 172.21.15.2:0/3566784560 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4041a6a30 con 0x7fd404101de0 2024-09-19T06:24:21.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.777+0000 7fd400ff9640 1 -- 172.21.15.2:0/3566784560 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec004cf0 con 0x7fd404101de0 2024-09-19T06:24:21.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.777+0000 7fd409c82640 1 -- 172.21.15.2:0/3566784560 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4041a6f20 con 0x7fd404101de0 2024-09-19T06:24:21.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.779+0000 7fd400ff9640 1 -- 172.21.15.2:0/3566784560 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fd3ec004e90 con 0x7fd404101de0 2024-09-19T06:24:21.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.780+0000 7fd40c05b740 1 Processor -- start 2024-09-19T06:24:21.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.780+0000 7fd40c05b740 1 -- start start 2024-09-19T06:24:21.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.780+0000 7fd40c05b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f99bc5b60 0x558f99bc5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:21.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.780+0000 7fd40c05b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f99bc6480 0x558f99bd0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:21.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.780+0000 7fd40c05b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f99bd0d40 0x558f99bd3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:21.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.780+0000 7fd40c05b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558f99b2b280 con 0x558f99bc5b60 2024-09-19T06:24:21.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.780+0000 7fd40c05b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x558f99ad2b10 con 0x558f99bc6480 2024-09-19T06:24:21.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.780+0000 7fd40c05b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x558f99b27240 con 0x558f99bd0d40 2024-09-19T06:24:21.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.780+0000 7fd403fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f99bc5b60 0x558f99bc5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:21.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.780+0000 7fd400ff9640 1 --2- 172.21.15.2:0/3566784560 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fd3f00a33b0 0x7fd3f00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:21.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.780+0000 7fd403fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f99bc5b60 0x558f99bc5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57552/0 (socket says 172.21.15.2:57552) 2024-09-19T06:24:21.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.780+0000 7fd403fff640 1 -- 172.21.15.2:0/3985530148 learned_addr learned my addr 172.21.15.2:0/3985530148 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:21.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.780+0000 7fd403fff640 1 --2- 172.21.15.2:0/3566784560 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fd3f00a33b0 0x7fd3f00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:21.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.781+0000 7fd402ffd640 1 --2- 172.21.15.2:0/3985530148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f99bd0d40 0x558f99bd3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:21.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.781+0000 7fd400ff9640 1 -- 172.21.15.2:0/3566784560 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7fd3ec0cf840 con 0x7fd404101de0 2024-09-19T06:24:21.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.781+0000 7fd4037fe640 1 --2- 172.21.15.2:0/3985530148 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f99bc6480 0x558f99bd0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:21.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.781+0000 7fd403fff640 1 -- 172.21.15.2:0/3985530148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f99bd0d40 msgr2=0x558f99bd3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:21.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.781+0000 7fd403fff640 1 --2- 172.21.15.2:0/3985530148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f99bd0d40 0x558f99bd3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:21.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.781+0000 7fd403fff640 1 -- 172.21.15.2:0/3985530148 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f99bc6480 msgr2=0x558f99bd0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:21.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.781+0000 7fd403fff640 1 --2- 172.21.15.2:0/3985530148 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f99bc6480 0x558f99bd0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:21.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.781+0000 7fd403fff640 1 -- 172.21.15.2:0/3985530148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f99adf1f0 con 0x558f99bc5b60 2024-09-19T06:24:21.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.781+0000 7fd402ffd640 1 --2- 172.21.15.2:0/3985530148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f99bd0d40 0x558f99bd3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:24:21.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.781+0000 7fd403fff640 1 --2- 172.21.15.2:0/3985530148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f99bc5b60 0x558f99bc5f40 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc004af0 tx=0x7fd3fc031f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0e7bd3c18d51995 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:21.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.781+0000 7fd3f9ffb640 1 -- 172.21.15.2:0/3985530148 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc004b40 con 0x558f99bc5b60 2024-09-19T06:24:21.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.781+0000 7fd3f9ffb640 1 -- 172.21.15.2:0/3985530148 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd3fc04d070 con 0x558f99bc5b60 2024-09-19T06:24:21.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.781+0000 7fd3f9ffb640 1 -- 172.21.15.2:0/3985530148 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc0305c0 con 0x558f99bc5b60 2024-09-19T06:24:21.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.782+0000 7fd40c05b740 1 -- 172.21.15.2:0/3985530148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f99bc5b60 msgr2=0x558f99bc5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:21.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.782+0000 7fd403fff640 1 --2- 172.21.15.2:0/3566784560 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fd3f00a33b0 0x7fd3f00a5870 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc04c000 tx=0x7fd3fc04a000 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:21.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.782+0000 7fd40c05b740 1 --2- 172.21.15.2:0/3985530148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f99bc5b60 0x558f99bc5f40 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc004af0 tx=0x7fd3fc031f60 comp rx=0 tx=0).stop 2024-09-19T06:24:21.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.782+0000 7fd40c05b740 1 -- 172.21.15.2:0/3985530148 shutdown_connections 2024-09-19T06:24:21.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.782+0000 7fd40c05b740 1 --2- 172.21.15.2:0/3985530148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f99bd0d40 0x558f99bd3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:21.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.782+0000 7fd40c05b740 1 --2- 172.21.15.2:0/3985530148 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f99bc6480 0x558f99bd0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:21.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.782+0000 7fd40c05b740 1 --2- 172.21.15.2:0/3985530148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f99bc5b60 0x558f99bc5f40 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:21.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.782+0000 7fd40c05b740 1 -- 172.21.15.2:0/3985530148 >> 172.21.15.2:0/3985530148 conn(0x558f99bc20f0 msgr2=0x558f99bc24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:21.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.782+0000 7fd40c05b740 1 -- 172.21.15.2:0/3985530148 shutdown_connections 2024-09-19T06:24:21.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.782+0000 7fd40c05b740 1 -- 172.21.15.2:0/3985530148 wait complete. 2024-09-19T06:24:21.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.782+0000 7fd40c05b740 1 -- start start 2024-09-19T06:24:21.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.783+0000 7fd40c05b740 1 Processor -- start 2024-09-19T06:24:21.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.783+0000 7fd40c05b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f99bc5b60 0x558f99bcdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:21.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.783+0000 7fd40c05b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f99bc6480 0x558f99bce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:21.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.783+0000 7fd40c05b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f99bd0d40 0x558f99bce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:21.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.783+0000 7fd40c05b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558f99bd3910 con 0x558f99bc5b60 2024-09-19T06:24:21.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.783+0000 7fd40c05b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x558f99ae5f10 con 0x558f99bd0d40 2024-09-19T06:24:21.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.783+0000 7fd40c05b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x558f99bd3a90 con 0x558f99bc6480 2024-09-19T06:24:21.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.783+0000 7fd4037fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f99bc5b60 0x558f99bcdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:21.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.783+0000 7fd40c05b740 10 client.0 _ll_register_callbacks cb 0x558f99aaea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:21.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.783+0000 7fd4037fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f99bc5b60 0x558f99bcdba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57562/0 (socket says 172.21.15.2:57562) 2024-09-19T06:24:21.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.783+0000 7fd4037fe640 1 -- 172.21.15.2:0/662114753 learned_addr learned my addr 172.21.15.2:0/662114753 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:21.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.783+0000 7fd402ffd640 1 --2- 172.21.15.2:0/662114753 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f99bc6480 0x558f99bce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:21.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.783+0000 7fd4037fe640 1 -- 172.21.15.2:0/662114753 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f99bc6480 msgr2=0x558f99bce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:21.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.783+0000 7fd4037fe640 1 --2- 172.21.15.2:0/662114753 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f99bc6480 0x558f99bce0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:21.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.783+0000 7fd4037fe640 1 -- 172.21.15.2:0/662114753 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f99bd0d40 msgr2=0x558f99bce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:21.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.783+0000 7fd4037fe640 1 --2- 172.21.15.2:0/662114753 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f99bd0d40 0x558f99bce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:21.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.783+0000 7fd4037fe640 1 -- 172.21.15.2:0/662114753 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f9989c6a0 con 0x558f99bc5b60 2024-09-19T06:24:21.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.783+0000 7fd402ffd640 1 --2- 172.21.15.2:0/662114753 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f99bc6480 0x558f99bce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:24:21.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.784+0000 7fd4037fe640 1 --2- 172.21.15.2:0/662114753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f99bc5b60 0x558f99bcdba0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec097f80 tx=0x7fd3ec09b540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=193bdbeb6cd7701c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:21.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.784+0000 7fd3e2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:24:21.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.784+0000 7fd3e2ffd640 1 -- 172.21.15.2:0/662114753 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec020040 con 0x558f99bc5b60 2024-09-19T06:24:21.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.784+0000 7fd3e2ffd640 1 -- 172.21.15.2:0/662114753 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7fd3ec0a4300 con 0x558f99bc5b60 2024-09-19T06:24:21.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.784+0000 7fd40c05b740 1 -- 172.21.15.2:0/662114753 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3fc04d070 con 0x558f99bc5b60 2024-09-19T06:24:21.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.784+0000 7fd3e2ffd640 1 -- 172.21.15.2:0/662114753 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd3ec09bb20 con 0x558f99bc5b60 2024-09-19T06:24:21.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.784+0000 7fd40c05b740 10 client.18825 fetch_fsmap learned FSMap version 26 2024-09-19T06:24:21.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.784+0000 7fd40c05b740 1 -- 172.21.15.2:0/662114753 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x558f99bdf410 con 0x558f99bc5b60 2024-09-19T06:24:21.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.784+0000 7fd3e2ffd640 1 -- 172.21.15.2:0/662114753 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd3fc04d070 con 0x558f99bc5b60 2024-09-19T06:24:21.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.784+0000 7fd3e2ffd640 1 -- 172.21.15.2:0/662114753 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fd3ec097870 con 0x558f99bc5b60 2024-09-19T06:24:21.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.784+0000 7fd40c05b740 10 client.18825 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:24:21.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.784+0000 7fd40c05b740 10 client.18825 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:24:21.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.784+0000 7fd40c05b740 20 client.18825 populate_metadata read hostname 'smithi002' 2024-09-19T06:24:21.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.784+0000 7fd40c05b740 1 --2- 172.21.15.2:0/662114753 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558f99be0870 0x558f99be2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:21.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.784+0000 7fd40c05b740 4 client.18825 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:24:21.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.784+0000 7fd40c05b740 1 -- 172.21.15.2:0/662114753 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558f99b387f0 con 0x558f99be0870 2024-09-19T06:24:21.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.785+0000 7fd402ffd640 1 --2- 172.21.15.2:0/662114753 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558f99be0870 0x558f99be2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:21.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.785+0000 7fd3e2ffd640 10 client.18825 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:21.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.785+0000 7fd402ffd640 1 --2- 172.21.15.2:0/662114753 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558f99be0870 0x558f99be2ce0 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1902e88d37d7fcb6 server_cookie=456eff435eb6602f in_seq=0 out_seq=0 2024-09-19T06:24:21.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.786+0000 7fd3e2ffd640 1 -- 172.21.15.2:0/662114753 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558f99b387f0 con 0x558f99be0870 2024-09-19T06:24:21.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.786+0000 7fd3e2ffd640 10 client.18825 handle_command_reply: tid=0 2024-09-19T06:24:21.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.786+0000 7fd40c05b740 1 client.18825 shutdown 2024-09-19T06:24:21.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.786+0000 7fd40c05b740 1 -- 172.21.15.2:0/662114753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f99bc5b60 msgr2=0x558f99bcdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:21.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.786+0000 7fd40c05b740 1 --2- 172.21.15.2:0/662114753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f99bc5b60 0x558f99bcdba0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec097f80 tx=0x7fd3ec09b540 comp rx=0 tx=0).stop 2024-09-19T06:24:21.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.786+0000 7fd40c05b740 1 -- 172.21.15.2:0/662114753 shutdown_connections 2024-09-19T06:24:21.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.786+0000 7fd40c05b740 1 --2- 172.21.15.2:0/662114753 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558f99be0870 0x558f99be2ce0 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:21.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.786+0000 7fd40c05b740 1 --2- 172.21.15.2:0/662114753 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f99bd0d40 0x558f99bce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:21.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.786+0000 7fd40c05b740 1 --2- 172.21.15.2:0/662114753 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f99bc6480 0x558f99bce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:21.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.786+0000 7fd40c05b740 1 --2- 172.21.15.2:0/662114753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f99bc5b60 0x558f99bcdba0 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:21.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.786+0000 7fd40c05b740 1 -- 172.21.15.2:0/662114753 >> 172.21.15.2:0/662114753 conn(0x558f99bc20f0 msgr2=0x558f99bc7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:21.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.786+0000 7fd3e2ffd640 0 client.18825 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:21.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.786+0000 7fd40c05b740 1 -- 172.21.15.2:0/662114753 shutdown_connections 2024-09-19T06:24:21.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.786+0000 7fd40c05b740 1 -- 172.21.15.2:0/662114753 wait complete. 2024-09-19T06:24:21.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.786+0000 7fd40c05b740 20 client.18825 trim_cache size 0 max 16384 2024-09-19T06:24:21.813 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:21 smithi089 ceph-mon[34160]: pgmap v297: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-19T06:24:21.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.804+0000 7fd40c05b740 1 Processor -- start 2024-09-19T06:24:21.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.804+0000 7fd40c05b740 1 -- start start 2024-09-19T06:24:21.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.804+0000 7fd40c05b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f99bc5b60 0x558f99bccb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:21.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.804+0000 7fd40c05b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f99bc6480 0x558f99be85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:21.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.804+0000 7fd40c05b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f99bd0d40 0x558f99be8af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:21.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.804+0000 7fd40c05b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd4041b21f0 con 0x558f99bd0d40 2024-09-19T06:24:21.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.804+0000 7fd40c05b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd4041afac0 con 0x558f99bc5b60 2024-09-19T06:24:21.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.804+0000 7fd40c05b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd4041ad930 con 0x558f99bc6480 2024-09-19T06:24:21.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.804+0000 7fd403fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f99bd0d40 0x558f99be8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:21.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.804+0000 7fd403fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f99bd0d40 0x558f99be8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57576/0 (socket says 172.21.15.2:57576) 2024-09-19T06:24:21.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.804+0000 7fd403fff640 1 -- 172.21.15.2:0/3778366910 learned_addr learned my addr 172.21.15.2:0/3778366910 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:21.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.804+0000 7fd402ffd640 1 --2- 172.21.15.2:0/3778366910 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f99bc6480 0x558f99be85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:21.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.804+0000 7fd4037fe640 1 --2- 172.21.15.2:0/3778366910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f99bc5b60 0x558f99bccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:21.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.804+0000 7fd403fff640 1 -- 172.21.15.2:0/3778366910 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f99bc6480 msgr2=0x558f99be85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:21.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.804+0000 7fd403fff640 1 --2- 172.21.15.2:0/3778366910 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f99bc6480 0x558f99be85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:21.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.804+0000 7fd403fff640 1 -- 172.21.15.2:0/3778366910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f99bc5b60 msgr2=0x558f99bccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:21.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.804+0000 7fd403fff640 1 --2- 172.21.15.2:0/3778366910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f99bc5b60 0x558f99bccb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:21.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.804+0000 7fd403fff640 1 -- 172.21.15.2:0/3778366910 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f99bc1f20 con 0x558f99bd0d40 2024-09-19T06:24:21.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.804+0000 7fd403fff640 1 --2- 172.21.15.2:0/3778366910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f99bd0d40 0x558f99be8af0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc009430 tx=0x7fd3fc0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deefa94214e769e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:21.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.805+0000 7fd3f97fa640 1 -- 172.21.15.2:0/3778366910 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc059030 con 0x558f99bd0d40 2024-09-19T06:24:21.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.805+0000 7fd3f97fa640 1 -- 172.21.15.2:0/3778366910 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd3fc04d040 con 0x558f99bd0d40 2024-09-19T06:24:21.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.805+0000 7fd3f97fa640 1 -- 172.21.15.2:0/3778366910 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc004b40 con 0x558f99bd0d40 2024-09-19T06:24:21.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.805+0000 7fd40c05b740 1 -- 172.21.15.2:0/3778366910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f99bd0d40 msgr2=0x558f99be8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:21.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.805+0000 7fd40c05b740 1 --2- 172.21.15.2:0/3778366910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f99bd0d40 0x558f99be8af0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc009430 tx=0x7fd3fc0095c0 comp rx=0 tx=0).stop 2024-09-19T06:24:21.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.805+0000 7fd40c05b740 1 -- 172.21.15.2:0/3778366910 shutdown_connections 2024-09-19T06:24:21.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.805+0000 7fd40c05b740 1 --2- 172.21.15.2:0/3778366910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f99bd0d40 0x558f99be8af0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:21.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.805+0000 7fd40c05b740 1 --2- 172.21.15.2:0/3778366910 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f99bc6480 0x558f99be85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:21.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.805+0000 7fd40c05b740 1 --2- 172.21.15.2:0/3778366910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f99bc5b60 0x558f99bccb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:21.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.805+0000 7fd40c05b740 1 -- 172.21.15.2:0/3778366910 >> 172.21.15.2:0/3778366910 conn(0x558f99bc20f0 msgr2=0x558f99bc1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:21.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.805+0000 7fd40c05b740 1 -- 172.21.15.2:0/3778366910 shutdown_connections 2024-09-19T06:24:21.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.805+0000 7fd40c05b740 1 -- 172.21.15.2:0/3778366910 wait complete. 2024-09-19T06:24:21.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.806+0000 7fd40c05b740 1 -- start start 2024-09-19T06:24:21.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.806+0000 7fd40c05b740 1 Processor -- start 2024-09-19T06:24:21.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.806+0000 7fd40c05b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f99bc5b60 0x558f99bd8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:21.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.806+0000 7fd40c05b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f99bc6480 0x558f99bd9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:21.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.806+0000 7fd40c05b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f99bd0d40 0x558f99bd5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:21.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.806+0000 7fd40c05b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd4041adf80 con 0x558f99bc5b60 2024-09-19T06:24:21.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.806+0000 7fd40c05b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd4041af3f0 con 0x558f99bc6480 2024-09-19T06:24:21.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.806+0000 7fd40c05b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd4041ae650 con 0x558f99bd0d40 2024-09-19T06:24:21.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.806+0000 7fd40c05b740 10 client.0 _ll_register_callbacks cb 0x7fd3ec097e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:21.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.806+0000 7fd4037fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f99bc5b60 0x558f99bd8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:21.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.806+0000 7fd4037fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f99bc5b60 0x558f99bd8ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57578/0 (socket says 172.21.15.2:57578) 2024-09-19T06:24:21.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.806+0000 7fd4037fe640 1 -- 172.21.15.2:0/4234735759 learned_addr learned my addr 172.21.15.2:0/4234735759 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:21.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.806+0000 7fd403fff640 1 --2- 172.21.15.2:0/4234735759 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f99bd0d40 0x558f99bd5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:21.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.806+0000 7fd402ffd640 1 --2- 172.21.15.2:0/4234735759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f99bc6480 0x558f99bd9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:21.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.807+0000 7fd4037fe640 1 -- 172.21.15.2:0/4234735759 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f99bd0d40 msgr2=0x558f99bd5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:21.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.807+0000 7fd4037fe640 1 --2- 172.21.15.2:0/4234735759 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f99bd0d40 0x558f99bd5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:21.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.807+0000 7fd4037fe640 1 -- 172.21.15.2:0/4234735759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f99bc6480 msgr2=0x558f99bd9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:21.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.807+0000 7fd4037fe640 1 --2- 172.21.15.2:0/4234735759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f99bc6480 0x558f99bd9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:21.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.807+0000 7fd4037fe640 1 -- 172.21.15.2:0/4234735759 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f99bc89d0 con 0x558f99bc5b60 2024-09-19T06:24:21.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.807+0000 7fd4037fe640 1 --2- 172.21.15.2:0/4234735759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f99bc5b60 0x558f99bd8ce0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec0984f0 tx=0x7fd3ec097aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed193a63f22fd23f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:21.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.807+0000 7fd3e2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:24:21.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.807+0000 7fd3e2ffd640 1 -- 172.21.15.2:0/4234735759 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec020070 con 0x558f99bc5b60 2024-09-19T06:24:21.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.807+0000 7fd3e2ffd640 1 -- 172.21.15.2:0/4234735759 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7fd3ec0a4300 con 0x558f99bc5b60 2024-09-19T06:24:21.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.807+0000 7fd40c05b740 1 -- 172.21.15.2:0/4234735759 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3fc04d040 con 0x558f99bc5b60 2024-09-19T06:24:21.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.807+0000 7fd3e2ffd640 1 -- 172.21.15.2:0/4234735759 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd3ec09b8f0 con 0x558f99bc5b60 2024-09-19T06:24:21.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.807+0000 7fd40c05b740 10 client.18831 fetch_fsmap learned FSMap version 26 2024-09-19T06:24:21.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.807+0000 7fd40c05b740 1 -- 172.21.15.2:0/4234735759 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x558f99c4bb10 con 0x558f99bc5b60 2024-09-19T06:24:21.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.807+0000 7fd3e2ffd640 1 -- 172.21.15.2:0/4234735759 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd3fc04d040 con 0x558f99bc5b60 2024-09-19T06:24:21.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.807+0000 7fd3e2ffd640 1 -- 172.21.15.2:0/4234735759 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fd3ec0a1060 con 0x558f99bc5b60 2024-09-19T06:24:21.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.808+0000 7fd40c05b740 10 client.18831 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:24:21.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.808+0000 7fd40c05b740 10 client.18831 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:24:21.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.808+0000 7fd40c05b740 20 client.18831 populate_metadata read hostname 'smithi002' 2024-09-19T06:24:21.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.808+0000 7fd40c05b740 1 --2- 172.21.15.2:0/4234735759 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558f99c4c0a0 0x558f99c4e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:21.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.808+0000 7fd40c05b740 4 client.18831 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:24:21.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.808+0000 7fd40c05b740 1 -- 172.21.15.2:0/4234735759 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558f99b32d00 con 0x558f99c4c0a0 2024-09-19T06:24:21.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.808+0000 7fd402ffd640 1 --2- 172.21.15.2:0/4234735759 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558f99c4c0a0 0x558f99c4e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:21.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.808+0000 7fd402ffd640 1 --2- 172.21.15.2:0/4234735759 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558f99c4c0a0 0x558f99c4e490 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77107047d4370f30 server_cookie=3d629f633612bf87 in_seq=0 out_seq=0 2024-09-19T06:24:21.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.808+0000 7fd3e2ffd640 10 client.18831 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:21.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.809+0000 7fd3e2ffd640 1 -- 172.21.15.2:0/4234735759 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558f99b32d00 con 0x558f99c4c0a0 2024-09-19T06:24:21.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.809+0000 7fd3e2ffd640 10 client.18831 handle_command_reply: tid=0 2024-09-19T06:24:21.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.809+0000 7fd40c05b740 1 client.18831 shutdown 2024-09-19T06:24:21.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.809+0000 7fd40c05b740 1 -- 172.21.15.2:0/4234735759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f99bc5b60 msgr2=0x558f99bd8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:21.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.809+0000 7fd40c05b740 1 --2- 172.21.15.2:0/4234735759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f99bc5b60 0x558f99bd8ce0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec0984f0 tx=0x7fd3ec097aa0 comp rx=0 tx=0).stop 2024-09-19T06:24:21.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.810+0000 7fd40c05b740 1 -- 172.21.15.2:0/4234735759 shutdown_connections 2024-09-19T06:24:21.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.810+0000 7fd40c05b740 1 --2- 172.21.15.2:0/4234735759 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558f99bd0d40 0x558f99bd5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:21.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.810+0000 7fd40c05b740 1 --2- 172.21.15.2:0/4234735759 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558f99c4c0a0 0x558f99c4e490 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:21.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.810+0000 7fd40c05b740 1 --2- 172.21.15.2:0/4234735759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f99bc6480 0x558f99bd9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:21.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.810+0000 7fd40c05b740 1 --2- 172.21.15.2:0/4234735759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558f99bc5b60 0x558f99bd8ce0 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:21.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.810+0000 7fd40c05b740 1 -- 172.21.15.2:0/4234735759 >> 172.21.15.2:0/4234735759 conn(0x558f99bc20f0 msgr2=0x558f99bdbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:21.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.810+0000 7fd3e2ffd640 0 client.18831 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:21.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.810+0000 7fd40c05b740 1 -- 172.21.15.2:0/4234735759 shutdown_connections 2024-09-19T06:24:21.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.810+0000 7fd40c05b740 1 -- 172.21.15.2:0/4234735759 wait complete. 2024-09-19T06:24:21.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.810+0000 7fd40c05b740 20 client.18831 trim_cache size 0 max 16384 2024-09-19T06:24:21.837 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:24:21.837 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T06:24:21.837 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "a68b0373-efe2-47f5-ac61-327846893e53", 2024-09-19T06:24:21.838 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T06:24:21.838 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:24:21.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.810+0000 7fd409c82640 1 -- 172.21.15.2:0/3566784560 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fd3f00a33b0 msgr2=0x7fd3f00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:21.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.810+0000 7fd409c82640 1 --2- 172.21.15.2:0/3566784560 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fd3f00a33b0 0x7fd3f00a5870 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc04c000 tx=0x7fd3fc04a000 comp rx=0 tx=0).stop 2024-09-19T06:24:21.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.810+0000 7fd409c82640 1 -- 172.21.15.2:0/3566784560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd404101de0 msgr2=0x7fd4040744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:21.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.810+0000 7fd409c82640 1 --2- 172.21.15.2:0/3566784560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd404101de0 0x7fd4040744f0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec00d770 tx=0x7fd3ec00dc30 comp rx=0 tx=0).stop 2024-09-19T06:24:21.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.811+0000 7fd409c82640 1 -- 172.21.15.2:0/3566784560 shutdown_connections 2024-09-19T06:24:21.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.811+0000 7fd409c82640 1 --2- 172.21.15.2:0/3566784560 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fd3f00a33b0 0x7fd3f00a5870 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:21.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.811+0000 7fd409c82640 1 --2- 172.21.15.2:0/3566784560 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd404106f10 0x7fd404074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:21.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.811+0000 7fd409c82640 1 --2- 172.21.15.2:0/3566784560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd404102790 0x7fd404074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:21.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.811+0000 7fd409c82640 1 --2- 172.21.15.2:0/3566784560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd404101de0 0x7fd4040744f0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:21.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.811+0000 7fd409c82640 1 -- 172.21.15.2:0/3566784560 >> 172.21.15.2:0/3566784560 conn(0x7fd4040fd8c0 msgr2=0x7fd4040feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:21.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.811+0000 7fd409c82640 1 -- 172.21.15.2:0/3566784560 shutdown_connections 2024-09-19T06:24:21.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:21.811+0000 7fd409c82640 1 -- 172.21.15.2:0/3566784560 wait complete. 2024-09-19T06:24:22.431 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:22 smithi002 ceph-mon[30982]: scrub queued for path: / 2024-09-19T06:24:22.431 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:22 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:24:22.432 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:22 smithi002 ceph-mon[30982]: scrub summary: active paths [/] 2024-09-19T06:24:22.432 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:22 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:24:22.433 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:24:22.690 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:24:22.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:22 smithi090 ceph-mon[34497]: scrub queued for path: / 2024-09-19T06:24:22.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:22 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:24:22.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:22 smithi090 ceph-mon[34497]: scrub summary: active paths [/] 2024-09-19T06:24:22.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:22 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:24:22.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:22 smithi089 ceph-mon[34160]: scrub queued for path: / 2024-09-19T06:24:22.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:22 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:24:22.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:22 smithi089 ceph-mon[34160]: scrub summary: active paths [/] 2024-09-19T06:24:22.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:22 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:24:23.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.115+0000 7f12bfb17640 1 -- 172.21.15.2:0/3416054441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12b8102de0 msgr2=0x7f12b81031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:23.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.115+0000 7f12bfb17640 1 --2- 172.21.15.2:0/3416054441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12b8102de0 0x7f12b81031c0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f12b4009900 tx=0x7f12b402a480 comp rx=0 tx=0).stop 2024-09-19T06:24:23.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.115+0000 7f12bfb17640 1 -- 172.21.15.2:0/3416054441 shutdown_connections 2024-09-19T06:24:23.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.115+0000 7f12bfb17640 1 --2- 172.21.15.2:0/3416054441 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b810c180 0x7f12b810e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:23.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.115+0000 7f12bfb17640 1 --2- 172.21.15.2:0/3416054441 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f12b8103700 0x7f12b810bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:23.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.115+0000 7f12bfb17640 1 --2- 172.21.15.2:0/3416054441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12b8102de0 0x7f12b81031c0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:23.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.115+0000 7f12bfb17640 1 -- 172.21.15.2:0/3416054441 >> 172.21.15.2:0/3416054441 conn(0x7f12b80fc780 msgr2=0x7f12b80feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:23.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.115+0000 7f12bfb17640 1 -- 172.21.15.2:0/3416054441 shutdown_connections 2024-09-19T06:24:23.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.115+0000 7f12bfb17640 1 -- 172.21.15.2:0/3416054441 wait complete. 2024-09-19T06:24:23.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.116+0000 7f12bfb17640 1 Processor -- start 2024-09-19T06:24:23.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.116+0000 7f12bfb17640 1 -- start start 2024-09-19T06:24:23.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.116+0000 7f12bfb17640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f12b8102de0 0x7f12b8100a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:23.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.116+0000 7f12bfb17640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b8103700 0x7f12b8100f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:23.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.116+0000 7f12bfb17640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12b810c180 0x7f12b81014c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:23.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.116+0000 7f12bfb17640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f12b8111e00 con 0x7f12b810c180 2024-09-19T06:24:23.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.116+0000 7f12bfb17640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f12b8111c80 con 0x7f12b8103700 2024-09-19T06:24:23.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.116+0000 7f12bfb17640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f12b8111f80 con 0x7f12b8102de0 2024-09-19T06:24:23.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.116+0000 7f12be0b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12b810c180 0x7f12b81014c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:23.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.116+0000 7f12be0b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12b810c180 0x7f12b81014c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57598/0 (socket says 172.21.15.2:57598) 2024-09-19T06:24:23.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.116+0000 7f12be0b4640 1 -- 172.21.15.2:0/4281968997 learned_addr learned my addr 172.21.15.2:0/4281968997 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:23.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.116+0000 7f12bd0b2640 1 --2- 172.21.15.2:0/4281968997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b8103700 0x7f12b8100f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:23.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.116+0000 7f12bd8b3640 1 --2- 172.21.15.2:0/4281968997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f12b8102de0 0x7f12b8100a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:23.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.117+0000 7f12be0b4640 1 -- 172.21.15.2:0/4281968997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f12b8102de0 msgr2=0x7f12b8100a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:23.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.117+0000 7f12be0b4640 1 --2- 172.21.15.2:0/4281968997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f12b8102de0 0x7f12b8100a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:23.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.117+0000 7f12be0b4640 1 -- 172.21.15.2:0/4281968997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b8103700 msgr2=0x7f12b8100f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:23.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.117+0000 7f12be0b4640 1 --2- 172.21.15.2:0/4281968997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b8103700 0x7f12b8100f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:23.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.117+0000 7f12be0b4640 1 -- 172.21.15.2:0/4281968997 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12b81a68e0 con 0x7f12b810c180 2024-09-19T06:24:23.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.117+0000 7f12bd0b2640 1 --2- 172.21.15.2:0/4281968997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b8103700 0x7f12b8100f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:24:23.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.117+0000 7f12bd8b3640 1 --2- 172.21.15.2:0/4281968997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f12b8102de0 0x7f12b8100a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:24:23.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.117+0000 7f12be0b4640 1 --2- 172.21.15.2:0/4281968997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12b810c180 0x7f12b81014c0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f12b000eaa0 tx=0x7f12b000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:23.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.117+0000 7f12aeffd640 1 -- 172.21.15.2:0/4281968997 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b000cdb0 con 0x7f12b810c180 2024-09-19T06:24:23.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.117+0000 7f12aeffd640 1 -- 172.21.15.2:0/4281968997 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f12b0005020 con 0x7f12b810c180 2024-09-19T06:24:23.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.117+0000 7f12bfb17640 1 -- 172.21.15.2:0/4281968997 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12b81a6bd0 con 0x7f12b810c180 2024-09-19T06:24:23.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.117+0000 7f12aeffd640 1 -- 172.21.15.2:0/4281968997 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b00116d0 con 0x7f12b810c180 2024-09-19T06:24:23.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.117+0000 7f12bfb17640 1 -- 172.21.15.2:0/4281968997 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12b81a7110 con 0x7f12b810c180 2024-09-19T06:24:23.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.119+0000 7f12aeffd640 1 -- 172.21.15.2:0/4281968997 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f12b00051d0 con 0x7f12b810c180 2024-09-19T06:24:23.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.120+0000 7f12c1ef0740 1 Processor -- start 2024-09-19T06:24:23.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.120+0000 7f12c1ef0740 1 -- start start 2024-09-19T06:24:23.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.120+0000 7f12c1ef0740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560597dad4a0 0x560597dad880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:23.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.120+0000 7f12c1ef0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560597daddc0 0x560597db8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:23.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.120+0000 7f12c1ef0740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560597db8680 0x560597dbaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:23.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.120+0000 7f12c1ef0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560597d132e0 con 0x560597daddc0 2024-09-19T06:24:23.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.120+0000 7f12c1ef0740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x560597cbace0 con 0x560597dad4a0 2024-09-19T06:24:23.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.120+0000 7f12c1ef0740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560597d0f2a0 con 0x560597db8680 2024-09-19T06:24:23.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.120+0000 7f12bd8b3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560597daddc0 0x560597db8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:23.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.120+0000 7f12bd8b3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560597daddc0 0x560597db8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57600/0 (socket says 172.21.15.2:57600) 2024-09-19T06:24:23.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.120+0000 7f12bd8b3640 1 -- 172.21.15.2:0/3874850365 learned_addr learned my addr 172.21.15.2:0/3874850365 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:23.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.120+0000 7f12aeffd640 1 --2- 172.21.15.2:0/4281968997 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f12a40a3430 0x7f12a40a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:23.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.120+0000 7f12bd0b2640 1 --2- 172.21.15.2:0/3874850365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560597dad4a0 0x560597dad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:23.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.121+0000 7f12bd0b2640 1 --2- 172.21.15.2:0/3874850365 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560597db8680 0x560597dbaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:23.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.121+0000 7f12be0b4640 1 --2- 172.21.15.2:0/4281968997 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f12a40a3430 0x7f12a40a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:23.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.121+0000 7f12bd8b3640 1 -- 172.21.15.2:0/3874850365 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560597db8680 msgr2=0x560597dbaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:23.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.121+0000 7f12bd8b3640 1 --2- 172.21.15.2:0/3874850365 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560597db8680 0x560597dbaa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:23.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.121+0000 7f12bd8b3640 1 -- 172.21.15.2:0/3874850365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560597dad4a0 msgr2=0x560597dad880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:23.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.121+0000 7f12bd8b3640 1 --2- 172.21.15.2:0/3874850365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560597dad4a0 0x560597dad880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:23.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.121+0000 7f12bd8b3640 1 -- 172.21.15.2:0/3874850365 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560597c9f440 con 0x560597daddc0 2024-09-19T06:24:23.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.121+0000 7f12aeffd640 1 -- 172.21.15.2:0/4281968997 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7f12b00cff40 con 0x7f12b810c180 2024-09-19T06:24:23.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.121+0000 7f12bd8b3640 1 --2- 172.21.15.2:0/3874850365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560597daddc0 0x560597db8140 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f12b402a9a0 tx=0x7f12b4032e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43338ce0cdfee5ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:23.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.121+0000 7f12be0b4640 1 --2- 172.21.15.2:0/4281968997 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f12a40a3430 0x7f12a40a58f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f12b0098620 tx=0x7f12b0067040 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:23.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.121+0000 7f12a3fff640 1 -- 172.21.15.2:0/3874850365 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b403f070 con 0x560597daddc0 2024-09-19T06:24:23.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.121+0000 7f12a3fff640 1 -- 172.21.15.2:0/3874850365 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f12b4031760 con 0x560597daddc0 2024-09-19T06:24:23.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.121+0000 7f12a3fff640 1 -- 172.21.15.2:0/3874850365 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b4035070 con 0x560597daddc0 2024-09-19T06:24:23.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.122+0000 7f12c1ef0740 1 -- 172.21.15.2:0/3874850365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560597daddc0 msgr2=0x560597db8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:23.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.122+0000 7f12c1ef0740 1 --2- 172.21.15.2:0/3874850365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560597daddc0 0x560597db8140 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f12b402a9a0 tx=0x7f12b4032e50 comp rx=0 tx=0).stop 2024-09-19T06:24:23.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.122+0000 7f12c1ef0740 1 -- 172.21.15.2:0/3874850365 shutdown_connections 2024-09-19T06:24:23.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.122+0000 7f12c1ef0740 1 --2- 172.21.15.2:0/3874850365 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560597db8680 0x560597dbaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:23.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.122+0000 7f12c1ef0740 1 --2- 172.21.15.2:0/3874850365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560597daddc0 0x560597db8140 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:23.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.122+0000 7f12c1ef0740 1 --2- 172.21.15.2:0/3874850365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560597dad4a0 0x560597dad880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:23.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.122+0000 7f12c1ef0740 1 -- 172.21.15.2:0/3874850365 >> 172.21.15.2:0/3874850365 conn(0x560597da9a30 msgr2=0x560597da9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:23.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.122+0000 7f12c1ef0740 1 -- 172.21.15.2:0/3874850365 shutdown_connections 2024-09-19T06:24:23.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.122+0000 7f12c1ef0740 1 -- 172.21.15.2:0/3874850365 wait complete. 2024-09-19T06:24:23.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.123+0000 7f12c1ef0740 1 -- start start 2024-09-19T06:24:23.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.123+0000 7f12c1ef0740 1 Processor -- start 2024-09-19T06:24:23.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.123+0000 7f12c1ef0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560597dad4a0 0x560597db7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:23.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.123+0000 7f12c1ef0740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560597daddc0 0x560597db51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:23.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.123+0000 7f12c1ef0740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560597db8680 0x560597db5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:23.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.123+0000 7f12c1ef0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560597dbb250 con 0x560597dad4a0 2024-09-19T06:24:23.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.123+0000 7f12c1ef0740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x560597cce050 con 0x560597db8680 2024-09-19T06:24:23.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.123+0000 7f12c1ef0740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x560597dbb3d0 con 0x560597daddc0 2024-09-19T06:24:23.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.123+0000 7f12c1ef0740 10 client.0 _ll_register_callbacks cb 0x560597d0e160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:23.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.123+0000 7f12bd0b2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560597dad4a0 0x560597db7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:23.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.123+0000 7f12bd0b2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560597dad4a0 0x560597db7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57604/0 (socket says 172.21.15.2:57604) 2024-09-19T06:24:23.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.123+0000 7f12bd0b2640 1 -- 172.21.15.2:0/4194848850 learned_addr learned my addr 172.21.15.2:0/4194848850 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:23.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.123+0000 7f12bd0b2640 1 --2- 172.21.15.2:0/4194848850 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560597db8680 0x560597db5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:23.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.123+0000 7f12bd8b3640 1 --2- 172.21.15.2:0/4194848850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560597daddc0 0x560597db51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:23.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.124+0000 7f12bd0b2640 1 -- 172.21.15.2:0/4194848850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560597daddc0 msgr2=0x560597db51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:23.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.124+0000 7f12bd0b2640 1 --2- 172.21.15.2:0/4194848850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560597daddc0 0x560597db51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:23.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.124+0000 7f12bd0b2640 1 -- 172.21.15.2:0/4194848850 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560597db8680 msgr2=0x560597db5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:23.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.124+0000 7f12bd0b2640 1 --2- 172.21.15.2:0/4194848850 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560597db8680 0x560597db5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:23.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.124+0000 7f12bd0b2640 1 -- 172.21.15.2:0/4194848850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560597a843c0 con 0x560597dad4a0 2024-09-19T06:24:23.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.124+0000 7f12bd0b2640 1 --2- 172.21.15.2:0/4194848850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560597dad4a0 0x560597db7f40 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f12a8013f60 tx=0x7f12a8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=542c2c0d6f510157 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:23.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.124+0000 7f12a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:24:23.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.124+0000 7f12a17fa640 1 -- 172.21.15.2:0/4194848850 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a8010e00 con 0x560597dad4a0 2024-09-19T06:24:23.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.124+0000 7f12a17fa640 1 -- 172.21.15.2:0/4194848850 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7f12a8013110 con 0x560597dad4a0 2024-09-19T06:24:23.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.124+0000 7f12c1ef0740 1 -- 172.21.15.2:0/4194848850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12b4031760 con 0x560597dad4a0 2024-09-19T06:24:23.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.124+0000 7f12a17fa640 1 -- 172.21.15.2:0/4194848850 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f12a8004020 con 0x560597dad4a0 2024-09-19T06:24:23.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.124+0000 7f12c1ef0740 10 client.18843 fetch_fsmap learned FSMap version 26 2024-09-19T06:24:23.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.124+0000 7f12c1ef0740 1 -- 172.21.15.2:0/4194848850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560597dc6c30 con 0x560597dad4a0 2024-09-19T06:24:23.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.124+0000 7f12a17fa640 1 -- 172.21.15.2:0/4194848850 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f12b4031760 con 0x560597dad4a0 2024-09-19T06:24:23.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.125+0000 7f12a17fa640 1 -- 172.21.15.2:0/4194848850 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f12a80047a0 con 0x560597dad4a0 2024-09-19T06:24:23.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.125+0000 7f12c1ef0740 10 client.18843 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:24:23.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.125+0000 7f12c1ef0740 10 client.18843 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:24:23.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.125+0000 7f12c1ef0740 20 client.18843 populate_metadata read hostname 'smithi002' 2024-09-19T06:24:23.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.125+0000 7f12c1ef0740 1 --2- 172.21.15.2:0/4194848850 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560597dc80f0 0x560597dca560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:23.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.125+0000 7f12c1ef0740 4 client.18843 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:24:23.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.125+0000 7f12c1ef0740 1 -- 172.21.15.2:0/4194848850 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560597d20850 con 0x560597dc80f0 2024-09-19T06:24:23.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.125+0000 7f12bd8b3640 1 --2- 172.21.15.2:0/4194848850 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560597dc80f0 0x560597dca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:23.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.125+0000 7f12bd8b3640 1 --2- 172.21.15.2:0/4194848850 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560597dc80f0 0x560597dca560 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f20b321431e08031 server_cookie=daea2f999e11018f in_seq=0 out_seq=0 2024-09-19T06:24:23.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.125+0000 7f12a17fa640 10 client.18843 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:23.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.126+0000 7f12a17fa640 1 -- 172.21.15.2:0/4194848850 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560597d20850 con 0x560597dc80f0 2024-09-19T06:24:23.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.126+0000 7f12a17fa640 10 client.18843 handle_command_reply: tid=0 2024-09-19T06:24:23.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.126+0000 7f12c1ef0740 1 client.18843 shutdown 2024-09-19T06:24:23.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.126+0000 7f12c1ef0740 1 -- 172.21.15.2:0/4194848850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560597dad4a0 msgr2=0x560597db7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:23.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.126+0000 7f12c1ef0740 1 --2- 172.21.15.2:0/4194848850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560597dad4a0 0x560597db7f40 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f12a8013f60 tx=0x7f12a8004730 comp rx=0 tx=0).stop 2024-09-19T06:24:23.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.126+0000 7f12c1ef0740 1 -- 172.21.15.2:0/4194848850 shutdown_connections 2024-09-19T06:24:23.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.126+0000 7f12c1ef0740 1 --2- 172.21.15.2:0/4194848850 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560597dc80f0 0x560597dca560 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:23.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.126+0000 7f12c1ef0740 1 --2- 172.21.15.2:0/4194848850 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560597db8680 0x560597db5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:23.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.126+0000 7f12c1ef0740 1 --2- 172.21.15.2:0/4194848850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560597daddc0 0x560597db51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:23.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.126+0000 7f12c1ef0740 1 --2- 172.21.15.2:0/4194848850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560597dad4a0 0x560597db7f40 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:23.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.126+0000 7f12a17fa640 0 client.18843 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:23.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.126+0000 7f12c1ef0740 1 -- 172.21.15.2:0/4194848850 >> 172.21.15.2:0/4194848850 conn(0x560597da9a30 msgr2=0x560597da8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:23.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.126+0000 7f12c1ef0740 1 -- 172.21.15.2:0/4194848850 shutdown_connections 2024-09-19T06:24:23.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.127+0000 7f12c1ef0740 1 -- 172.21.15.2:0/4194848850 wait complete. 2024-09-19T06:24:23.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.127+0000 7f12c1ef0740 20 client.18843 trim_cache size 0 max 16384 2024-09-19T06:24:23.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.144+0000 7f12c1ef0740 1 Processor -- start 2024-09-19T06:24:23.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.144+0000 7f12c1ef0740 1 -- start start 2024-09-19T06:24:23.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.144+0000 7f12c1ef0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560597dad4a0 0x560597dc44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:23.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.144+0000 7f12c1ef0740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560597daddc0 0x560597daf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:23.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.144+0000 7f12c1ef0740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560597db8680 0x560597dcfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:23.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.144+0000 7f12c1ef0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f12b81b2250 con 0x560597dad4a0 2024-09-19T06:24:23.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.144+0000 7f12c1ef0740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f12b81afb20 con 0x560597db8680 2024-09-19T06:24:23.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.144+0000 7f12c1ef0740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f12b81ad990 con 0x560597daddc0 2024-09-19T06:24:23.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.144+0000 7f12bd0b2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560597dad4a0 0x560597dc44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:23.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.144+0000 7f12bd0b2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560597dad4a0 0x560597dc44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57616/0 (socket says 172.21.15.2:57616) 2024-09-19T06:24:23.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.144+0000 7f12bd0b2640 1 -- 172.21.15.2:0/3857848608 learned_addr learned my addr 172.21.15.2:0/3857848608 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:23.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.144+0000 7f12bd8b3640 1 --2- 172.21.15.2:0/3857848608 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560597daddc0 0x560597daf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:23.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.144+0000 7f12bd0b2640 1 -- 172.21.15.2:0/3857848608 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560597daddc0 msgr2=0x560597daf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:23.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.144+0000 7f12bd0b2640 1 --2- 172.21.15.2:0/3857848608 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560597daddc0 0x560597daf650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:23.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.144+0000 7f12bd0b2640 1 -- 172.21.15.2:0/3857848608 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560597db8680 msgr2=0x560597dcfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:23.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.144+0000 7f12bd0b2640 1 --2- 172.21.15.2:0/3857848608 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560597db8680 0x560597dcfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:23.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.144+0000 7f12bd0b2640 1 -- 172.21.15.2:0/3857848608 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560597db82b0 con 0x560597dad4a0 2024-09-19T06:24:23.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.145+0000 7f12bd0b2640 1 --2- 172.21.15.2:0/3857848608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560597dad4a0 0x560597dc44e0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f12a8005cd0 tx=0x7f12a800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cd2caaed2a6d4dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:23.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.145+0000 7f12a37fe640 1 -- 172.21.15.2:0/3857848608 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a802f070 con 0x560597dad4a0 2024-09-19T06:24:23.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.145+0000 7f12a37fe640 1 -- 172.21.15.2:0/3857848608 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f12a8013110 con 0x560597dad4a0 2024-09-19T06:24:23.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.145+0000 7f12a37fe640 1 -- 172.21.15.2:0/3857848608 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a8004420 con 0x560597dad4a0 2024-09-19T06:24:23.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.145+0000 7f12c1ef0740 1 -- 172.21.15.2:0/3857848608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560597dad4a0 msgr2=0x560597dc44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:23.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.145+0000 7f12c1ef0740 1 --2- 172.21.15.2:0/3857848608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560597dad4a0 0x560597dc44e0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f12a8005cd0 tx=0x7f12a800b880 comp rx=0 tx=0).stop 2024-09-19T06:24:23.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.145+0000 7f12c1ef0740 1 -- 172.21.15.2:0/3857848608 shutdown_connections 2024-09-19T06:24:23.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.145+0000 7f12c1ef0740 1 --2- 172.21.15.2:0/3857848608 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560597db8680 0x560597dcfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:23.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.145+0000 7f12c1ef0740 1 --2- 172.21.15.2:0/3857848608 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560597daddc0 0x560597daf650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:23.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.145+0000 7f12c1ef0740 1 --2- 172.21.15.2:0/3857848608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560597dad4a0 0x560597dc44e0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:23.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.146+0000 7f12c1ef0740 1 -- 172.21.15.2:0/3857848608 >> 172.21.15.2:0/3857848608 conn(0x560597da9a30 msgr2=0x560597daef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:23.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.146+0000 7f12c1ef0740 1 -- 172.21.15.2:0/3857848608 shutdown_connections 2024-09-19T06:24:23.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.146+0000 7f12c1ef0740 1 -- 172.21.15.2:0/3857848608 wait complete. 2024-09-19T06:24:23.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.146+0000 7f12c1ef0740 1 -- start start 2024-09-19T06:24:23.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.146+0000 7f12c1ef0740 1 Processor -- start 2024-09-19T06:24:23.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.146+0000 7f12c1ef0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560597dad4a0 0x560597dbc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:23.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.146+0000 7f12c1ef0740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560597daddc0 0x560597dbca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:23.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.146+0000 7f12c1ef0740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560597db8680 0x560597dbcfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:23.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.146+0000 7f12c1ef0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f12b81adfe0 con 0x560597dad4a0 2024-09-19T06:24:23.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.146+0000 7f12c1ef0740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f12b81af450 con 0x560597db8680 2024-09-19T06:24:23.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.146+0000 7f12c1ef0740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f12b81ae6b0 con 0x560597daddc0 2024-09-19T06:24:23.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.147+0000 7f12c1ef0740 10 client.0 _ll_register_callbacks cb 0x7f12a8013b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:23.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.147+0000 7f12bd0b2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560597dad4a0 0x560597dbc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:23.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.147+0000 7f12bd0b2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560597dad4a0 0x560597dbc520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57622/0 (socket says 172.21.15.2:57622) 2024-09-19T06:24:23.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.147+0000 7f12bd0b2640 1 -- 172.21.15.2:0/2872936458 learned_addr learned my addr 172.21.15.2:0/2872936458 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:23.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.147+0000 7f12bd8b3640 1 --2- 172.21.15.2:0/2872936458 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560597daddc0 0x560597dbca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:23.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.147+0000 7f12bd0b2640 1 --2- 172.21.15.2:0/2872936458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560597db8680 0x560597dbcfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:23.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.147+0000 7f12bd0b2640 1 -- 172.21.15.2:0/2872936458 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560597daddc0 msgr2=0x560597dbca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:23.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.147+0000 7f12bd0b2640 1 --2- 172.21.15.2:0/2872936458 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560597daddc0 0x560597dbca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:23.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.147+0000 7f12bd0b2640 1 -- 172.21.15.2:0/2872936458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560597db8680 msgr2=0x560597dbcfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:23.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.147+0000 7f12bd0b2640 1 --2- 172.21.15.2:0/2872936458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560597db8680 0x560597dbcfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:23.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.147+0000 7f12bd0b2640 1 -- 172.21.15.2:0/2872936458 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560597e31f60 con 0x560597dad4a0 2024-09-19T06:24:23.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.147+0000 7f12bd0b2640 1 --2- 172.21.15.2:0/2872936458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560597dad4a0 0x560597dbc520 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f12a8013850 tx=0x7f12a8005a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f38bc526ec5ff35 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:23.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.147+0000 7f12a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:24:23.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.147+0000 7f12a17fa640 1 -- 172.21.15.2:0/2872936458 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a802f040 con 0x560597dad4a0 2024-09-19T06:24:23.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.147+0000 7f12a17fa640 1 -- 172.21.15.2:0/2872936458 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7f12a800e660 con 0x560597dad4a0 2024-09-19T06:24:23.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.147+0000 7f12c1ef0740 1 -- 172.21.15.2:0/2872936458 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12a8013110 con 0x560597dad4a0 2024-09-19T06:24:23.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.148+0000 7f12a17fa640 1 -- 172.21.15.2:0/2872936458 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f12a803c050 con 0x560597dad4a0 2024-09-19T06:24:23.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.148+0000 7f12c1ef0740 10 client.18849 fetch_fsmap learned FSMap version 26 2024-09-19T06:24:23.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.148+0000 7f12c1ef0740 1 -- 172.21.15.2:0/2872936458 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560597e33210 con 0x560597dad4a0 2024-09-19T06:24:23.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.148+0000 7f12a17fa640 1 -- 172.21.15.2:0/2872936458 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f12a8013110 con 0x560597dad4a0 2024-09-19T06:24:23.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.148+0000 7f12a17fa640 1 -- 172.21.15.2:0/2872936458 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f12a8035060 con 0x560597dad4a0 2024-09-19T06:24:23.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.148+0000 7f12c1ef0740 10 client.18849 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:24:23.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.148+0000 7f12c1ef0740 10 client.18849 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:24:23.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.148+0000 7f12c1ef0740 20 client.18849 populate_metadata read hostname 'smithi002' 2024-09-19T06:24:23.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.148+0000 7f12c1ef0740 1 --2- 172.21.15.2:0/2872936458 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560597e33860 0x560597e35c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:23.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.148+0000 7f12c1ef0740 4 client.18849 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:24:23.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.148+0000 7f12c1ef0740 1 -- 172.21.15.2:0/2872936458 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560597d1ad60 con 0x560597e33860 2024-09-19T06:24:23.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.148+0000 7f12bd8b3640 1 --2- 172.21.15.2:0/2872936458 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560597e33860 0x560597e35c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:23.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.149+0000 7f12bd8b3640 1 --2- 172.21.15.2:0/2872936458 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560597e33860 0x560597e35c50 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68e8e6c8816d0350 server_cookie=3893f7ec12a42b8d in_seq=0 out_seq=0 2024-09-19T06:24:23.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.149+0000 7f12a17fa640 10 client.18849 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:23.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.149+0000 7f12a17fa640 1 -- 172.21.15.2:0/2872936458 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x560597d1ad60 con 0x560597e33860 2024-09-19T06:24:23.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.149+0000 7f12a17fa640 10 client.18849 handle_command_reply: tid=0 2024-09-19T06:24:23.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.149+0000 7f12c1ef0740 1 client.18849 shutdown 2024-09-19T06:24:23.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.149+0000 7f12c1ef0740 1 -- 172.21.15.2:0/2872936458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560597dad4a0 msgr2=0x560597dbc520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:23.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.149+0000 7f12c1ef0740 1 --2- 172.21.15.2:0/2872936458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560597dad4a0 0x560597dbc520 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f12a8013850 tx=0x7f12a8005a10 comp rx=0 tx=0).stop 2024-09-19T06:24:23.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.149+0000 7f12c1ef0740 1 -- 172.21.15.2:0/2872936458 shutdown_connections 2024-09-19T06:24:23.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.149+0000 7f12c1ef0740 1 --2- 172.21.15.2:0/2872936458 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x560597e33860 0x560597e35c50 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:23.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.149+0000 7f12c1ef0740 1 --2- 172.21.15.2:0/2872936458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560597db8680 0x560597dbcfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:23.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.149+0000 7f12c1ef0740 1 --2- 172.21.15.2:0/2872936458 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x560597daddc0 0x560597dbca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:23.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.149+0000 7f12c1ef0740 1 --2- 172.21.15.2:0/2872936458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560597dad4a0 0x560597dbc520 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:23.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.149+0000 7f12a17fa640 0 client.18849 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:23.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.149+0000 7f12c1ef0740 1 -- 172.21.15.2:0/2872936458 >> 172.21.15.2:0/2872936458 conn(0x560597da9a30 msgr2=0x560597da8b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:23.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.149+0000 7f12c1ef0740 1 -- 172.21.15.2:0/2872936458 shutdown_connections 2024-09-19T06:24:23.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.149+0000 7f12c1ef0740 1 -- 172.21.15.2:0/2872936458 wait complete. 2024-09-19T06:24:23.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.149+0000 7f12c1ef0740 20 client.18849 trim_cache size 0 max 16384 2024-09-19T06:24:23.157 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:24:23.157 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T06:24:23.157 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T06:24:23.157 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:24:23.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.150+0000 7f12bfb17640 1 -- 172.21.15.2:0/4281968997 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f12a40a3430 msgr2=0x7f12a40a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:23.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.150+0000 7f12bfb17640 1 --2- 172.21.15.2:0/4281968997 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f12a40a3430 0x7f12a40a58f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f12b0098620 tx=0x7f12b0067040 comp rx=0 tx=0).stop 2024-09-19T06:24:23.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.150+0000 7f12bfb17640 1 -- 172.21.15.2:0/4281968997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12b810c180 msgr2=0x7f12b81014c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:23.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.150+0000 7f12bfb17640 1 --2- 172.21.15.2:0/4281968997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12b810c180 0x7f12b81014c0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f12b000eaa0 tx=0x7f12b000ef60 comp rx=0 tx=0).stop 2024-09-19T06:24:23.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.150+0000 7f12bfb17640 1 -- 172.21.15.2:0/4281968997 shutdown_connections 2024-09-19T06:24:23.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.150+0000 7f12bfb17640 1 --2- 172.21.15.2:0/4281968997 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f12a40a3430 0x7f12a40a58f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:23.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.150+0000 7f12bfb17640 1 --2- 172.21.15.2:0/4281968997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12b810c180 0x7f12b81014c0 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:23.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.150+0000 7f12bfb17640 1 --2- 172.21.15.2:0/4281968997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b8103700 0x7f12b8100f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:23.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.150+0000 7f12bfb17640 1 --2- 172.21.15.2:0/4281968997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f12b8102de0 0x7f12b8100a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:23.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.150+0000 7f12bfb17640 1 -- 172.21.15.2:0/4281968997 >> 172.21.15.2:0/4281968997 conn(0x7f12b80fc780 msgr2=0x7f12b80fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:23.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.150+0000 7f12bfb17640 1 -- 172.21.15.2:0/4281968997 shutdown_connections 2024-09-19T06:24:23.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:23.150+0000 7f12bfb17640 1 -- 172.21.15.2:0/4281968997 wait complete. 2024-09-19T06:24:23.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:23 smithi002 ceph-mon[30982]: pgmap v298: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-19T06:24:23.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:23 smithi002 ceph-mon[30982]: scrub summary: idle 2024-09-19T06:24:23.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:23 smithi090 ceph-mon[34497]: pgmap v298: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-19T06:24:23.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:23 smithi090 ceph-mon[34497]: scrub summary: idle 2024-09-19T06:24:23.791 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:24:23.791 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:24:23.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:23 smithi089 ceph-mon[34160]: pgmap v298: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-19T06:24:23.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:23 smithi089 ceph-mon[34160]: scrub summary: idle 2024-09-19T06:24:24.053 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:24:24.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.511+0000 7f45bfcd2640 1 -- 172.21.15.2:0/724971982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45b810c170 msgr2=0x7f45b810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:24.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.511+0000 7f45bfcd2640 1 --2- 172.21.15.2:0/724971982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45b810c170 0x7f45b810e610 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f45b0009ca0 tx=0x7f45b002a950 comp rx=0 tx=0).stop 2024-09-19T06:24:24.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.511+0000 7f45bfcd2640 1 -- 172.21.15.2:0/724971982 shutdown_connections 2024-09-19T06:24:24.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.511+0000 7f45bfcd2640 1 --2- 172.21.15.2:0/724971982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45b810c170 0x7f45b810e610 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:24.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.511+0000 7f45bfcd2640 1 --2- 172.21.15.2:0/724971982 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45b8103660 0x7f45b810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:24.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.511+0000 7f45bfcd2640 1 --2- 172.21.15.2:0/724971982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45b8102d40 0x7f45b8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:24.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.511+0000 7f45bfcd2640 1 -- 172.21.15.2:0/724971982 >> 172.21.15.2:0/724971982 conn(0x7f45b80fc7a0 msgr2=0x7f45b80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:24.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.511+0000 7f45bfcd2640 1 -- 172.21.15.2:0/724971982 shutdown_connections 2024-09-19T06:24:24.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.511+0000 7f45bfcd2640 1 -- 172.21.15.2:0/724971982 wait complete. 2024-09-19T06:24:24.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.512+0000 7f45bfcd2640 1 Processor -- start 2024-09-19T06:24:24.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.512+0000 7f45bfcd2640 1 -- start start 2024-09-19T06:24:24.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.512+0000 7f45bfcd2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45b8102d40 0x7f45b81009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:24.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.512+0000 7f45bfcd2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45b8103660 0x7f45b8100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:24.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.512+0000 7f45bfcd2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45b810c170 0x7f45b8101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:24.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.512+0000 7f45bfcd2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f45b8111e60 con 0x7f45b8102d40 2024-09-19T06:24:24.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.512+0000 7f45bfcd2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f45b8111ce0 con 0x7f45b810c170 2024-09-19T06:24:24.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.512+0000 7f45bfcd2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f45b8111fe0 con 0x7f45b8103660 2024-09-19T06:24:24.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.512+0000 7f45bda6e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45b8102d40 0x7f45b81009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:24.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.512+0000 7f45bda6e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45b8102d40 0x7f45b81009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57632/0 (socket says 172.21.15.2:57632) 2024-09-19T06:24:24.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.512+0000 7f45bda6e640 1 -- 172.21.15.2:0/3714767221 learned_addr learned my addr 172.21.15.2:0/3714767221 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:24.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.513+0000 7f45bd26d640 1 --2- 172.21.15.2:0/3714767221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45b8103660 0x7f45b8100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:24.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.513+0000 7f45be26f640 1 --2- 172.21.15.2:0/3714767221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45b810c170 0x7f45b8101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:24.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.513+0000 7f45bda6e640 1 -- 172.21.15.2:0/3714767221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45b8103660 msgr2=0x7f45b8100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:24.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.513+0000 7f45bda6e640 1 --2- 172.21.15.2:0/3714767221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45b8103660 0x7f45b8100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:24.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.513+0000 7f45bda6e640 1 -- 172.21.15.2:0/3714767221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45b810c170 msgr2=0x7f45b8101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:24.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.513+0000 7f45bda6e640 1 --2- 172.21.15.2:0/3714767221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45b810c170 0x7f45b8101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:24.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.513+0000 7f45bda6e640 1 -- 172.21.15.2:0/3714767221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45b81a6840 con 0x7f45b8102d40 2024-09-19T06:24:24.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.513+0000 7f45bda6e640 1 --2- 172.21.15.2:0/3714767221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45b8102d40 0x7f45b81009a0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f45a800c890 tx=0x7f45a800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:24.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.513+0000 7f45b6ffd640 1 -- 172.21.15.2:0/3714767221 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a8004220 con 0x7f45b8102d40 2024-09-19T06:24:24.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.513+0000 7f45b6ffd640 1 -- 172.21.15.2:0/3714767221 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f45a80043c0 con 0x7f45b8102d40 2024-09-19T06:24:24.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.513+0000 7f45b6ffd640 1 -- 172.21.15.2:0/3714767221 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a8004a00 con 0x7f45b8102d40 2024-09-19T06:24:24.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.513+0000 7f45bfcd2640 1 -- 172.21.15.2:0/3714767221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45b81a6b30 con 0x7f45b8102d40 2024-09-19T06:24:24.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.513+0000 7f45bfcd2640 1 -- 172.21.15.2:0/3714767221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45b81a7070 con 0x7f45b8102d40 2024-09-19T06:24:24.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.514+0000 7f45bfcd2640 1 -- 172.21.15.2:0/3714767221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45b8103120 con 0x7f45b8102d40 2024-09-19T06:24:24.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.516+0000 7f45b6ffd640 1 -- 172.21.15.2:0/3714767221 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f45a8004ba0 con 0x7f45b8102d40 2024-09-19T06:24:24.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.516+0000 7f45b6ffd640 1 --2- 172.21.15.2:0/3714767221 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f45a00a33b0 0x7f45a00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:24.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.516+0000 7f45bd26d640 1 --2- 172.21.15.2:0/3714767221 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f45a00a33b0 0x7f45a00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:24.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.516+0000 7f45b6ffd640 1 -- 172.21.15.2:0/3714767221 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7f45a80cfd60 con 0x7f45b8102d40 2024-09-19T06:24:24.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.517+0000 7f45bd26d640 1 --2- 172.21.15.2:0/3714767221 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f45a00a33b0 0x7f45a00a5870 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f45b8102430 tx=0x7f45ac009060 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:24.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.519+0000 7f45b6ffd640 1 -- 172.21.15.2:0/3714767221 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f45a8014030 con 0x7f45b8102d40 2024-09-19T06:24:24.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.735+0000 7f45bfcd2640 1 -- 172.21.15.2:0/3714767221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f45b8101ed0 con 0x7f45b8102d40 2024-09-19T06:24:24.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.736+0000 7f45b6ffd640 1 -- 172.21.15.2:0/3714767221 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11882 (secure 0 0 0) 0x7f45b8101ed0 con 0x7f45b8102d40 2024-09-19T06:24:24.737 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:24:24.738 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-09-19T06:14:49:104280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:14:48.191083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24470,24472,24497]},"id":1}]} 2024-09-19T06:24:24.738 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-09-19T06:24:24.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.738+0000 7f45bfcd2640 1 -- 172.21.15.2:0/3714767221 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f45a00a33b0 msgr2=0x7f45a00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:24.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.738+0000 7f45bfcd2640 1 --2- 172.21.15.2:0/3714767221 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f45a00a33b0 0x7f45a00a5870 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f45b8102430 tx=0x7f45ac009060 comp rx=0 tx=0).stop 2024-09-19T06:24:24.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.738+0000 7f45bfcd2640 1 -- 172.21.15.2:0/3714767221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45b8102d40 msgr2=0x7f45b81009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:24.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.738+0000 7f45bfcd2640 1 --2- 172.21.15.2:0/3714767221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45b8102d40 0x7f45b81009a0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f45a800c890 tx=0x7f45a800cd50 comp rx=0 tx=0).stop 2024-09-19T06:24:24.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.738+0000 7f45bfcd2640 1 -- 172.21.15.2:0/3714767221 shutdown_connections 2024-09-19T06:24:24.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.738+0000 7f45bfcd2640 1 --2- 172.21.15.2:0/3714767221 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f45a00a33b0 0x7f45a00a5870 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:24.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.738+0000 7f45bfcd2640 1 --2- 172.21.15.2:0/3714767221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45b810c170 0x7f45b8101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:24.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.738+0000 7f45bfcd2640 1 --2- 172.21.15.2:0/3714767221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45b8103660 0x7f45b8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:24.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.738+0000 7f45bfcd2640 1 --2- 172.21.15.2:0/3714767221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45b8102d40 0x7f45b81009a0 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:24.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.738+0000 7f45bfcd2640 1 -- 172.21.15.2:0/3714767221 >> 172.21.15.2:0/3714767221 conn(0x7f45b80fc7a0 msgr2=0x7f45b80fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:24.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.738+0000 7f45bfcd2640 1 -- 172.21.15.2:0/3714767221 shutdown_connections 2024-09-19T06:24:24.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:24.738+0000 7f45bfcd2640 1 -- 172.21.15.2:0/3714767221 wait complete. 2024-09-19T06:24:25.402 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:24:25.659 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:24:25.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:25 smithi002 ceph-mon[30982]: pgmap v299: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 92 B/s wr, 10 op/s 2024-09-19T06:24:25.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:25 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/3714767221' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:24:25.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:25 smithi090 ceph-mon[34497]: pgmap v299: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 92 B/s wr, 10 op/s 2024-09-19T06:24:25.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:25 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/3714767221' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:24:25.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:25 smithi089 ceph-mon[34160]: pgmap v299: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 92 B/s wr, 10 op/s 2024-09-19T06:24:25.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:25 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/3714767221' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:24:26.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.087+0000 7fa41854e640 1 -- 172.21.15.2:0/1447487938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa410103720 msgr2=0x7fa41010bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:26.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.087+0000 7fa41854e640 1 --2- 172.21.15.2:0/1447487938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa410103720 0x7fa41010bc10 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fa400009900 tx=0x7fa40002a480 comp rx=0 tx=0).stop 2024-09-19T06:24:26.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.087+0000 7fa41854e640 1 -- 172.21.15.2:0/1447487938 shutdown_connections 2024-09-19T06:24:26.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.087+0000 7fa41854e640 1 --2- 172.21.15.2:0/1447487938 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa41010c1a0 0x7fa41010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:26.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.087+0000 7fa41854e640 1 --2- 172.21.15.2:0/1447487938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa410103720 0x7fa41010bc10 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:26.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.087+0000 7fa41854e640 1 --2- 172.21.15.2:0/1447487938 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa410102e00 0x7fa4101031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:26.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.087+0000 7fa41854e640 1 -- 172.21.15.2:0/1447487938 >> 172.21.15.2:0/1447487938 conn(0x7fa4100fc7a0 msgr2=0x7fa4100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:26.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.088+0000 7fa41854e640 1 -- 172.21.15.2:0/1447487938 shutdown_connections 2024-09-19T06:24:26.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.088+0000 7fa41854e640 1 -- 172.21.15.2:0/1447487938 wait complete. 2024-09-19T06:24:26.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.088+0000 7fa41854e640 1 Processor -- start 2024-09-19T06:24:26.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.088+0000 7fa41854e640 1 -- start start 2024-09-19T06:24:26.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.088+0000 7fa41854e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa410102e00 0x7fa4101983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:26.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.088+0000 7fa41854e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa410103720 0x7fa410198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:26.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.089+0000 7fa41854e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa41010c1a0 0x7fa41019ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:26.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.089+0000 7fa41854e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa410111e20 con 0x7fa410103720 2024-09-19T06:24:26.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.089+0000 7fa41854e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa410111ca0 con 0x7fa410102e00 2024-09-19T06:24:26.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.089+0000 7fa41854e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa410111fa0 con 0x7fa41010c1a0 2024-09-19T06:24:26.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.089+0000 7fa415ae9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa410103720 0x7fa410198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:26.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.089+0000 7fa415ae9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa410103720 0x7fa410198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54874/0 (socket says 172.21.15.2:54874) 2024-09-19T06:24:26.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.089+0000 7fa415ae9640 1 -- 172.21.15.2:0/450673196 learned_addr learned my addr 172.21.15.2:0/450673196 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:26.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.089+0000 7fa4162ea640 1 --2- 172.21.15.2:0/450673196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa410102e00 0x7fa4101983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:26.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.089+0000 7fa416aeb640 1 --2- 172.21.15.2:0/450673196 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa41010c1a0 0x7fa41019ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:26.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.089+0000 7fa415ae9640 1 -- 172.21.15.2:0/450673196 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa41010c1a0 msgr2=0x7fa41019ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:26.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.089+0000 7fa415ae9640 1 --2- 172.21.15.2:0/450673196 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa41010c1a0 0x7fa41019ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:26.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.089+0000 7fa415ae9640 1 -- 172.21.15.2:0/450673196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa410102e00 msgr2=0x7fa4101983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:26.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.089+0000 7fa415ae9640 1 --2- 172.21.15.2:0/450673196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa410102e00 0x7fa4101983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:26.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.089+0000 7fa415ae9640 1 -- 172.21.15.2:0/450673196 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa41019d390 con 0x7fa410103720 2024-09-19T06:24:26.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.089+0000 7fa415ae9640 1 --2- 172.21.15.2:0/450673196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa410103720 0x7fa410198920 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fa400005940 tx=0x7fa400004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:26.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.089+0000 7fa4077fe640 1 -- 172.21.15.2:0/450673196 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40003f030 con 0x7fa410103720 2024-09-19T06:24:26.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.089+0000 7fa41854e640 1 -- 172.21.15.2:0/450673196 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa41019d620 con 0x7fa410103720 2024-09-19T06:24:26.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.089+0000 7fa4077fe640 1 -- 172.21.15.2:0/450673196 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa400003aa0 con 0x7fa410103720 2024-09-19T06:24:26.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.090+0000 7fa4077fe640 1 -- 172.21.15.2:0/450673196 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa400035070 con 0x7fa410103720 2024-09-19T06:24:26.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.090+0000 7fa41854e640 1 -- 172.21.15.2:0/450673196 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4101a4f60 con 0x7fa410103720 2024-09-19T06:24:26.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.092+0000 7fa4077fe640 1 -- 172.21.15.2:0/450673196 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fa400042030 con 0x7fa410103720 2024-09-19T06:24:26.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.092+0000 7fa41a927740 1 Processor -- start 2024-09-19T06:24:26.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.092+0000 7fa41a927740 1 -- start start 2024-09-19T06:24:26.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.093+0000 7fa41a927740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a4cdc00b40 0x55a4cdbff090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:26.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.093+0000 7fa41a927740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4cdbff5d0 0x55a4cdbffa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:26.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.093+0000 7fa41a927740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4cdc0a370 0x55a4cdc0c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:26.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.093+0000 7fa41a927740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a4cdb652f0 con 0x55a4cdbff5d0 2024-09-19T06:24:26.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.093+0000 7fa41a927740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55a4cdb0ccf0 con 0x55a4cdc0a370 2024-09-19T06:24:26.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.093+0000 7fa41a927740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55a4cdb612b0 con 0x55a4cdc00b40 2024-09-19T06:24:26.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.093+0000 7fa4077fe640 1 --2- 172.21.15.2:0/450673196 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa3fc0a33b0 0x7fa3fc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:26.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.093+0000 7fa4162ea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4cdbff5d0 0x55a4cdbffa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:26.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.093+0000 7fa4162ea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4cdbff5d0 0x55a4cdbffa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54890/0 (socket says 172.21.15.2:54890) 2024-09-19T06:24:26.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.093+0000 7fa4162ea640 1 -- 172.21.15.2:0/2374190092 learned_addr learned my addr 172.21.15.2:0/2374190092 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:26.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.093+0000 7fa415ae9640 1 --2- 172.21.15.2:0/2374190092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4cdc0a370 0x55a4cdc0c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:26.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.093+0000 7fa416aeb640 1 --2- 172.21.15.2:0/450673196 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa3fc0a33b0 0x7fa3fc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:26.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.093+0000 7fa416aeb640 1 --2- 172.21.15.2:0/2374190092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a4cdc00b40 0x55a4cdbff090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:26.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.093+0000 7fa4162ea640 1 -- 172.21.15.2:0/2374190092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a4cdc00b40 msgr2=0x55a4cdbff090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:26.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.093+0000 7fa4162ea640 1 --2- 172.21.15.2:0/2374190092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a4cdc00b40 0x55a4cdbff090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:26.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.093+0000 7fa4162ea640 1 -- 172.21.15.2:0/2374190092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4cdc0a370 msgr2=0x55a4cdc0c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:26.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.093+0000 7fa4162ea640 1 --2- 172.21.15.2:0/2374190092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4cdc0a370 0x55a4cdc0c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:26.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.093+0000 7fa4162ea640 1 -- 172.21.15.2:0/2374190092 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4cdaf13a0 con 0x55a4cdbff5d0 2024-09-19T06:24:26.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.093+0000 7fa4077fe640 1 -- 172.21.15.2:0/450673196 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7fa4000f0240 con 0x7fa410103720 2024-09-19T06:24:26.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.093+0000 7fa4162ea640 1 --2- 172.21.15.2:0/2374190092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4cdbff5d0 0x55a4cdbffa10 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fa40c00bd10 tx=0x7fa40c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84a0353c518f6aed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:26.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.093+0000 7fa416aeb640 1 --2- 172.21.15.2:0/450673196 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa3fc0a33b0 0x7fa3fc0a5870 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa408009fd0 tx=0x7fa408004a40 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:26.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.094+0000 7fa404ff9640 1 -- 172.21.15.2:0/2374190092 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40c004030 con 0x55a4cdbff5d0 2024-09-19T06:24:26.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.094+0000 7fa404ff9640 1 -- 172.21.15.2:0/2374190092 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa40c0035f0 con 0x55a4cdbff5d0 2024-09-19T06:24:26.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.094+0000 7fa404ff9640 1 -- 172.21.15.2:0/2374190092 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40c0117b0 con 0x55a4cdbff5d0 2024-09-19T06:24:26.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.094+0000 7fa41a927740 1 -- 172.21.15.2:0/2374190092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4cdbff5d0 msgr2=0x55a4cdbffa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:26.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.094+0000 7fa41a927740 1 --2- 172.21.15.2:0/2374190092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4cdbff5d0 0x55a4cdbffa10 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fa40c00bd10 tx=0x7fa40c0107a0 comp rx=0 tx=0).stop 2024-09-19T06:24:26.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.095+0000 7fa41a927740 1 -- 172.21.15.2:0/2374190092 shutdown_connections 2024-09-19T06:24:26.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.095+0000 7fa41a927740 1 --2- 172.21.15.2:0/2374190092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4cdc0a370 0x55a4cdc0c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:26.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.095+0000 7fa41a927740 1 --2- 172.21.15.2:0/2374190092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4cdbff5d0 0x55a4cdbffa10 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:26.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.095+0000 7fa41a927740 1 --2- 172.21.15.2:0/2374190092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a4cdc00b40 0x55a4cdbff090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:26.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.095+0000 7fa41a927740 1 -- 172.21.15.2:0/2374190092 >> 172.21.15.2:0/2374190092 conn(0x55a4cdbc8310 msgr2=0x55a4cdbfbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:26.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.095+0000 7fa41a927740 1 -- 172.21.15.2:0/2374190092 shutdown_connections 2024-09-19T06:24:26.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.095+0000 7fa41a927740 1 -- 172.21.15.2:0/2374190092 wait complete. 2024-09-19T06:24:26.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.095+0000 7fa41a927740 1 -- start start 2024-09-19T06:24:26.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.096+0000 7fa41a927740 1 Processor -- start 2024-09-19T06:24:26.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.096+0000 7fa41a927740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4cdbff5d0 0x55a4cdc09d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:26.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.096+0000 7fa41a927740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4cdc00b40 0x55a4cdc07010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:26.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.096+0000 7fa41a927740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a4cdc0a370 0x55a4cdc07600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:26.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.096+0000 7fa41a927740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a4cdc0d070 con 0x55a4cdbff5d0 2024-09-19T06:24:26.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.096+0000 7fa41a927740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55a4cdb20060 con 0x55a4cdc00b40 2024-09-19T06:24:26.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.096+0000 7fa41a927740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55a4cdc0d1f0 con 0x55a4cdc0a370 2024-09-19T06:24:26.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.096+0000 7fa41a927740 10 client.0 _ll_register_callbacks cb 0x55a4cd8738c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:26.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.096+0000 7fa4162ea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4cdbff5d0 0x55a4cdc09d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:26.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.096+0000 7fa4162ea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4cdbff5d0 0x55a4cdc09d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54896/0 (socket says 172.21.15.2:54896) 2024-09-19T06:24:26.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.096+0000 7fa4162ea640 1 -- 172.21.15.2:0/2327519557 learned_addr learned my addr 172.21.15.2:0/2327519557 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:26.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.096+0000 7fa416aeb640 1 --2- 172.21.15.2:0/2327519557 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a4cdc0a370 0x55a4cdc07600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:26.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.096+0000 7fa415ae9640 1 --2- 172.21.15.2:0/2327519557 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4cdc00b40 0x55a4cdc07010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:26.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.096+0000 7fa4162ea640 1 -- 172.21.15.2:0/2327519557 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a4cdc0a370 msgr2=0x55a4cdc07600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:26.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.096+0000 7fa4162ea640 1 --2- 172.21.15.2:0/2327519557 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a4cdc0a370 0x55a4cdc07600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:26.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.096+0000 7fa4162ea640 1 -- 172.21.15.2:0/2327519557 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4cdc00b40 msgr2=0x55a4cdc07010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:26.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.096+0000 7fa4162ea640 1 --2- 172.21.15.2:0/2327519557 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4cdc00b40 0x55a4cdc07010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:26.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.096+0000 7fa4162ea640 1 -- 172.21.15.2:0/2327519557 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4cd8d63c0 con 0x55a4cdbff5d0 2024-09-19T06:24:26.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.097+0000 7fa4162ea640 1 --2- 172.21.15.2:0/2327519557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4cdbff5d0 0x55a4cdc09d60 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fa40c005cd0 tx=0x7fa40c00b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49aa853f8d7b5504 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:26.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.097+0000 7fa3f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:24:26.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.097+0000 7fa3f9ffb640 1 -- 172.21.15.2:0/2327519557 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40c029060 con 0x55a4cdbff5d0 2024-09-19T06:24:26.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.097+0000 7fa3f9ffb640 1 -- 172.21.15.2:0/2327519557 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7fa40c003fa0 con 0x55a4cdbff5d0 2024-09-19T06:24:26.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.097+0000 7fa41a927740 1 -- 172.21.15.2:0/2327519557 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa40c0035f0 con 0x55a4cdbff5d0 2024-09-19T06:24:26.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.097+0000 7fa3f9ffb640 1 -- 172.21.15.2:0/2327519557 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa40c003a30 con 0x55a4cdbff5d0 2024-09-19T06:24:26.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.097+0000 7fa41a927740 10 client.18867 fetch_fsmap learned FSMap version 26 2024-09-19T06:24:26.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.097+0000 7fa41a927740 1 -- 172.21.15.2:0/2327519557 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a4cdc18a80 con 0x55a4cdbff5d0 2024-09-19T06:24:26.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.098+0000 7fa3f9ffb640 1 -- 172.21.15.2:0/2327519557 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa40c0035f0 con 0x55a4cdbff5d0 2024-09-19T06:24:26.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.098+0000 7fa3f9ffb640 1 -- 172.21.15.2:0/2327519557 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fa40c004750 con 0x55a4cdbff5d0 2024-09-19T06:24:26.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.098+0000 7fa41a927740 10 client.18867 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:24:26.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.098+0000 7fa41a927740 10 client.18867 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:24:26.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.098+0000 7fa41a927740 20 client.18867 populate_metadata read hostname 'smithi002' 2024-09-19T06:24:26.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.098+0000 7fa41a927740 1 --2- 172.21.15.2:0/2327519557 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55a4cdc19dd0 0x55a4cdc1c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:26.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.098+0000 7fa41a927740 4 client.18867 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:24:26.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.098+0000 7fa41a927740 1 -- 172.21.15.2:0/2327519557 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a4cdb72860 con 0x55a4cdc19dd0 2024-09-19T06:24:26.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.098+0000 7fa415ae9640 1 --2- 172.21.15.2:0/2327519557 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55a4cdc19dd0 0x55a4cdc1c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:26.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.098+0000 7fa415ae9640 1 --2- 172.21.15.2:0/2327519557 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55a4cdc19dd0 0x55a4cdc1c1c0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4d2c485977d40c21 server_cookie=a2b6849a6e9fd69b in_seq=0 out_seq=0 2024-09-19T06:24:26.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.098+0000 7fa3f9ffb640 10 client.18867 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:24:26.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.099+0000 7fa3f9ffb640 1 -- 172.21.15.2:0/2327519557 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a4cdb72860 con 0x55a4cdc19dd0 2024-09-19T06:24:26.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.099+0000 7fa3f9ffb640 10 client.18867 handle_command_reply: tid=0 2024-09-19T06:24:26.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.099+0000 7fa41a927740 1 client.18867 shutdown 2024-09-19T06:24:26.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.099+0000 7fa41a927740 1 -- 172.21.15.2:0/2327519557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4cdbff5d0 msgr2=0x55a4cdc09d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:26.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.099+0000 7fa41a927740 1 --2- 172.21.15.2:0/2327519557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4cdbff5d0 0x55a4cdc09d60 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fa40c005cd0 tx=0x7fa40c00b950 comp rx=0 tx=0).stop 2024-09-19T06:24:26.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.099+0000 7fa41a927740 1 -- 172.21.15.2:0/2327519557 shutdown_connections 2024-09-19T06:24:26.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.099+0000 7fa41a927740 1 --2- 172.21.15.2:0/2327519557 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55a4cdc19dd0 0x55a4cdc1c1c0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:26.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.099+0000 7fa41a927740 1 --2- 172.21.15.2:0/2327519557 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a4cdc0a370 0x55a4cdc07600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:26.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.099+0000 7fa41a927740 1 --2- 172.21.15.2:0/2327519557 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4cdc00b40 0x55a4cdc07010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:26.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.099+0000 7fa41a927740 1 --2- 172.21.15.2:0/2327519557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4cdbff5d0 0x55a4cdc09d60 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:26.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.099+0000 7fa3f9ffb640 0 client.18867 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:24:26.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.099+0000 7fa41a927740 1 -- 172.21.15.2:0/2327519557 >> 172.21.15.2:0/2327519557 conn(0x55a4cdbc8310 msgr2=0x55a4cdc01960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:26.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.100+0000 7fa41a927740 1 -- 172.21.15.2:0/2327519557 shutdown_connections 2024-09-19T06:24:26.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.100+0000 7fa41a927740 1 -- 172.21.15.2:0/2327519557 wait complete. 2024-09-19T06:24:26.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.100+0000 7fa41a927740 20 client.18867 trim_cache size 0 max 16384 2024-09-19T06:24:26.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.112+0000 7fa41a927740 1 Processor -- start 2024-09-19T06:24:26.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.113+0000 7fa41a927740 1 -- start start 2024-09-19T06:24:26.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.113+0000 7fa41a927740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4cdbff5d0 0x55a4cdbfabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:26.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.113+0000 7fa41a927740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4cdc00b40 0x55a4cdc04290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:26.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.113+0000 7fa41a927740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a4cdc0a370 0x55a4cdc047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:26.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.113+0000 7fa41a927740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa4101b0060 con 0x55a4cdc00b40 2024-09-19T06:24:26.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.113+0000 7fa41a927740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa4101ad930 con 0x55a4cdbff5d0 2024-09-19T06:24:26.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.113+0000 7fa41a927740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa4101ab7a0 con 0x55a4cdc0a370 2024-09-19T06:24:26.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.113+0000 7fa415ae9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4cdc00b40 0x55a4cdc04290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:26.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.113+0000 7fa415ae9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4cdc00b40 0x55a4cdc04290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54904/0 (socket says 172.21.15.2:54904) 2024-09-19T06:24:26.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.113+0000 7fa415ae9640 1 -- 172.21.15.2:0/3109870233 learned_addr learned my addr 172.21.15.2:0/3109870233 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:26.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.113+0000 7fa4162ea640 1 --2- 172.21.15.2:0/3109870233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4cdbff5d0 0x55a4cdbfabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:26.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.113+0000 7fa416aeb640 1 --2- 172.21.15.2:0/3109870233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a4cdc0a370 0x55a4cdc047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:26.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.113+0000 7fa415ae9640 1 -- 172.21.15.2:0/3109870233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a4cdc0a370 msgr2=0x55a4cdc047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:26.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.113+0000 7fa415ae9640 1 --2- 172.21.15.2:0/3109870233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a4cdc0a370 0x55a4cdc047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:26.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.113+0000 7fa415ae9640 1 -- 172.21.15.2:0/3109870233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4cdbff5d0 msgr2=0x55a4cdbfabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:26.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.113+0000 7fa415ae9640 1 --2- 172.21.15.2:0/3109870233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4cdbff5d0 0x55a4cdbfabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:26.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.113+0000 7fa415ae9640 1 -- 172.21.15.2:0/3109870233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4cdbfc960 con 0x55a4cdc00b40 2024-09-19T06:24:26.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.113+0000 7fa416aeb640 1 --2- 172.21.15.2:0/3109870233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a4cdc0a370 0x55a4cdc047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:24:26.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.113+0000 7fa415ae9640 1 --2- 172.21.15.2:0/3109870233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4cdc00b40 0x55a4cdc04290 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fa4000ed9f0 tx=0x7fa40008e350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c54144456ad065c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:26.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.114+0000 7fa3fbfff640 1 -- 172.21.15.2:0/3109870233 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40008b020 con 0x55a4cdc00b40 2024-09-19T06:24:26.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.114+0000 7fa3fbfff640 1 -- 172.21.15.2:0/3109870233 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa4000c08d0 con 0x55a4cdc00b40 2024-09-19T06:24:26.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.114+0000 7fa3fbfff640 1 -- 172.21.15.2:0/3109870233 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa400049040 con 0x55a4cdc00b40 2024-09-19T06:24:26.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.114+0000 7fa41a927740 1 -- 172.21.15.2:0/3109870233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4cdc00b40 msgr2=0x55a4cdc04290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:26.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.114+0000 7fa41a927740 1 --2- 172.21.15.2:0/3109870233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4cdc00b40 0x55a4cdc04290 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fa4000ed9f0 tx=0x7fa40008e350 comp rx=0 tx=0).stop 2024-09-19T06:24:26.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.114+0000 7fa41a927740 1 -- 172.21.15.2:0/3109870233 shutdown_connections 2024-09-19T06:24:26.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.114+0000 7fa41a927740 1 --2- 172.21.15.2:0/3109870233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a4cdc0a370 0x55a4cdc047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:26.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.114+0000 7fa41a927740 1 --2- 172.21.15.2:0/3109870233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4cdc00b40 0x55a4cdc04290 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:26.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.114+0000 7fa41a927740 1 --2- 172.21.15.2:0/3109870233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4cdbff5d0 0x55a4cdbfabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:26.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.114+0000 7fa41a927740 1 -- 172.21.15.2:0/3109870233 >> 172.21.15.2:0/3109870233 conn(0x55a4cdbc8310 msgr2=0x55a4cdbfa4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:26.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.114+0000 7fa41a927740 1 -- 172.21.15.2:0/3109870233 shutdown_connections 2024-09-19T06:24:26.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.114+0000 7fa41a927740 1 -- 172.21.15.2:0/3109870233 wait complete. 2024-09-19T06:24:26.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.115+0000 7fa41a927740 1 -- start start 2024-09-19T06:24:26.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.115+0000 7fa41a927740 1 Processor -- start 2024-09-19T06:24:26.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.115+0000 7fa41a927740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4cdbff5d0 0x55a4cdc1d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:26.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.115+0000 7fa41a927740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a4cdc00b40 0x55a4cdc1d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:26.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.115+0000 7fa41a927740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4cdc0a370 0x55a4cdc1dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:26.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.115+0000 7fa41a927740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa4101abdf0 con 0x55a4cdc0a370 2024-09-19T06:24:26.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.115+0000 7fa41a927740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa4101ad260 con 0x55a4cdbff5d0 2024-09-19T06:24:26.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.115+0000 7fa41a927740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa4101ac4c0 con 0x55a4cdc00b40 2024-09-19T06:24:26.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.115+0000 7fa41a927740 10 client.0 _ll_register_callbacks cb 0x7fa40c00bb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:26.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.115+0000 7fa416aeb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4cdc0a370 0x55a4cdc1dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:26.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.115+0000 7fa416aeb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4cdc0a370 0x55a4cdc1dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54912/0 (socket says 172.21.15.2:54912) 2024-09-19T06:24:26.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.115+0000 7fa416aeb640 1 -- 172.21.15.2:0/4048671121 learned_addr learned my addr 172.21.15.2:0/4048671121 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:26.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.115+0000 7fa415ae9640 1 --2- 172.21.15.2:0/4048671121 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a4cdc00b40 0x55a4cdc1d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:26.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.115+0000 7fa4162ea640 1 --2- 172.21.15.2:0/4048671121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4cdbff5d0 0x55a4cdc1d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:26.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.115+0000 7fa416aeb640 1 -- 172.21.15.2:0/4048671121 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a4cdc00b40 msgr2=0x55a4cdc1d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:26.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.115+0000 7fa416aeb640 1 --2- 172.21.15.2:0/4048671121 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a4cdc00b40 0x55a4cdc1d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:26.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.115+0000 7fa416aeb640 1 -- 172.21.15.2:0/4048671121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4cdbff5d0 msgr2=0x55a4cdc1d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:26.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.115+0000 7fa416aeb640 1 --2- 172.21.15.2:0/4048671121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4cdbff5d0 0x55a4cdc1d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:26.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.115+0000 7fa416aeb640 1 -- 172.21.15.2:0/4048671121 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4cdc87dc0 con 0x55a4cdc0a370 2024-09-19T06:24:26.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.116+0000 7fa416aeb640 1 --2- 172.21.15.2:0/4048671121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4cdc0a370 0x55a4cdc1dc80 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fa40801e9c0 tx=0x7fa408004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f17cc192a526d6b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:26.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.116+0000 7fa3f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:24:26.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.116+0000 7fa3f9ffb640 1 -- 172.21.15.2:0/4048671121 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40802e060 con 0x55a4cdc0a370 2024-09-19T06:24:26.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.116+0000 7fa3f9ffb640 1 -- 172.21.15.2:0/4048671121 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7fa408019070 con 0x55a4cdc0a370 2024-09-19T06:24:26.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.116+0000 7fa41a927740 1 -- 172.21.15.2:0/4048671121 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4000c08d0 con 0x55a4cdc0a370 2024-09-19T06:24:26.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.116+0000 7fa3f9ffb640 1 -- 172.21.15.2:0/4048671121 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa408020bf0 con 0x55a4cdc0a370 2024-09-19T06:24:26.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.116+0000 7fa41a927740 10 client.18873 fetch_fsmap learned FSMap version 26 2024-09-19T06:24:26.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.116+0000 7fa41a927740 1 -- 172.21.15.2:0/4048671121 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a4cdc89100 con 0x55a4cdc0a370 2024-09-19T06:24:26.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.116+0000 7fa3f9ffb640 1 -- 172.21.15.2:0/4048671121 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa4000c08d0 con 0x55a4cdc0a370 2024-09-19T06:24:26.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.116+0000 7fa3f9ffb640 1 -- 172.21.15.2:0/4048671121 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fa408028070 con 0x55a4cdc0a370 2024-09-19T06:24:26.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.116+0000 7fa41a927740 10 client.18873 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:24:26.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.116+0000 7fa41a927740 10 client.18873 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:24:26.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.117+0000 7fa41a927740 20 client.18873 populate_metadata read hostname 'smithi002' 2024-09-19T06:24:26.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.117+0000 7fa41a927740 1 --2- 172.21.15.2:0/4048671121 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55a4cdc89880 0x55a4cdc8bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:26.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.117+0000 7fa41a927740 4 client.18873 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:24:26.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.117+0000 7fa41a927740 1 -- 172.21.15.2:0/4048671121 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a4cdb6cd70 con 0x55a4cdc89880 2024-09-19T06:24:26.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.117+0000 7fa4162ea640 1 --2- 172.21.15.2:0/4048671121 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55a4cdc89880 0x55a4cdc8bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:26.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.117+0000 7fa4162ea640 1 --2- 172.21.15.2:0/4048671121 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55a4cdc89880 0x55a4cdc8bca0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c8f0fbad6678b97 server_cookie=55b4f20d5e2c3eea in_seq=0 out_seq=0 2024-09-19T06:24:26.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.117+0000 7fa3f9ffb640 10 client.18873 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:24:26.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.117+0000 7fa3f9ffb640 1 -- 172.21.15.2:0/4048671121 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a4cdb6cd70 con 0x55a4cdc89880 2024-09-19T06:24:26.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.117+0000 7fa3f9ffb640 10 client.18873 handle_command_reply: tid=0 2024-09-19T06:24:26.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.117+0000 7fa41a927740 1 client.18873 shutdown 2024-09-19T06:24:26.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.117+0000 7fa41a927740 1 -- 172.21.15.2:0/4048671121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4cdc0a370 msgr2=0x55a4cdc1dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:26.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.117+0000 7fa41a927740 1 --2- 172.21.15.2:0/4048671121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4cdc0a370 0x55a4cdc1dc80 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fa40801e9c0 tx=0x7fa408004ab0 comp rx=0 tx=0).stop 2024-09-19T06:24:26.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.118+0000 7fa41a927740 1 -- 172.21.15.2:0/4048671121 shutdown_connections 2024-09-19T06:24:26.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.118+0000 7fa41a927740 1 --2- 172.21.15.2:0/4048671121 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x55a4cdc89880 0x55a4cdc8bca0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:26.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.118+0000 7fa41a927740 1 --2- 172.21.15.2:0/4048671121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4cdc0a370 0x55a4cdc1dc80 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:26.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.118+0000 7fa41a927740 1 --2- 172.21.15.2:0/4048671121 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55a4cdc00b40 0x55a4cdc1d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:26.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.118+0000 7fa3f9ffb640 0 client.18873 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:24:26.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.118+0000 7fa41a927740 1 --2- 172.21.15.2:0/4048671121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4cdbff5d0 0x55a4cdc1d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:26.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.118+0000 7fa41a927740 1 -- 172.21.15.2:0/4048671121 >> 172.21.15.2:0/4048671121 conn(0x55a4cdbc8310 msgr2=0x55a4cdbfad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:26.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.118+0000 7fa41a927740 1 -- 172.21.15.2:0/4048671121 shutdown_connections 2024-09-19T06:24:26.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.118+0000 7fa41a927740 1 -- 172.21.15.2:0/4048671121 wait complete. 2024-09-19T06:24:26.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.118+0000 7fa41a927740 20 client.18873 trim_cache size 0 max 16384 2024-09-19T06:24:26.125 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:24:26.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.118+0000 7fa41854e640 1 -- 172.21.15.2:0/450673196 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa3fc0a33b0 msgr2=0x7fa3fc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:26.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.118+0000 7fa41854e640 1 --2- 172.21.15.2:0/450673196 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa3fc0a33b0 0x7fa3fc0a5870 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa408009fd0 tx=0x7fa408004a40 comp rx=0 tx=0).stop 2024-09-19T06:24:26.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.118+0000 7fa41854e640 1 -- 172.21.15.2:0/450673196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa410103720 msgr2=0x7fa410198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:26.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.118+0000 7fa41854e640 1 --2- 172.21.15.2:0/450673196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa410103720 0x7fa410198920 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fa400005940 tx=0x7fa400004270 comp rx=0 tx=0).stop 2024-09-19T06:24:26.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.118+0000 7fa41854e640 1 -- 172.21.15.2:0/450673196 shutdown_connections 2024-09-19T06:24:26.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.118+0000 7fa41854e640 1 --2- 172.21.15.2:0/450673196 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fa3fc0a33b0 0x7fa3fc0a5870 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:26.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.118+0000 7fa41854e640 1 --2- 172.21.15.2:0/450673196 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa41010c1a0 0x7fa41019ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:26.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.118+0000 7fa41854e640 1 --2- 172.21.15.2:0/450673196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa410103720 0x7fa410198920 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:26.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.118+0000 7fa41854e640 1 --2- 172.21.15.2:0/450673196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa410102e00 0x7fa4101983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:26.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.118+0000 7fa41854e640 1 -- 172.21.15.2:0/450673196 >> 172.21.15.2:0/450673196 conn(0x7fa4100fc7a0 msgr2=0x7fa4100fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:26.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.119+0000 7fa41854e640 1 -- 172.21.15.2:0/450673196 shutdown_connections 2024-09-19T06:24:26.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:26.119+0000 7fa41854e640 1 -- 172.21.15.2:0/450673196 wait complete. 2024-09-19T06:24:26.679 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:24:26.933 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:24:27.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.477+0000 7f882f701640 1 -- 172.21.15.2:0/1817000874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8828074e30 msgr2=0x7f882810df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:27.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.477+0000 7f882f701640 1 --2- 172.21.15.2:0/1817000874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8828074e30 0x7f882810df00 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f8818009900 tx=0x7f881802a480 comp rx=0 tx=0).stop 2024-09-19T06:24:27.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.477+0000 7f882f701640 1 -- 172.21.15.2:0/1817000874 shutdown_connections 2024-09-19T06:24:27.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.477+0000 7f882f701640 1 --2- 172.21.15.2:0/1817000874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f882810e440 0x7f8828110830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.477+0000 7f882f701640 1 --2- 172.21.15.2:0/1817000874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8828074e30 0x7f882810df00 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.477+0000 7f882f701640 1 --2- 172.21.15.2:0/1817000874 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8828074510 0x7f88280748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.477+0000 7f882f701640 1 -- 172.21.15.2:0/1817000874 >> 172.21.15.2:0/1817000874 conn(0x7f88280fd8c0 msgr2=0x7f88280ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:27.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.477+0000 7f882f701640 1 -- 172.21.15.2:0/1817000874 shutdown_connections 2024-09-19T06:24:27.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.477+0000 7f882f701640 1 -- 172.21.15.2:0/1817000874 wait complete. 2024-09-19T06:24:27.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.478+0000 7f882f701640 1 Processor -- start 2024-09-19T06:24:27.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.478+0000 7f882f701640 1 -- start start 2024-09-19T06:24:27.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.478+0000 7f882f701640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8828074510 0x7f882819a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:27.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.478+0000 7f882f701640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8828074e30 0x7f882819ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:27.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.478+0000 7f882f701640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f882810e440 0x7f882819eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:27.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.478+0000 7f882f701640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8828113ff0 con 0x7f882810e440 2024-09-19T06:24:27.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.478+0000 7f882f701640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8828113e70 con 0x7f8828074510 2024-09-19T06:24:27.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.478+0000 7f882f701640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8828114170 con 0x7f8828074e30 2024-09-19T06:24:27.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.478+0000 7f882dc9e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f882810e440 0x7f882819eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:27.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.478+0000 7f882dc9e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f882810e440 0x7f882819eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54928/0 (socket says 172.21.15.2:54928) 2024-09-19T06:24:27.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.478+0000 7f882dc9e640 1 -- 172.21.15.2:0/1059454915 learned_addr learned my addr 172.21.15.2:0/1059454915 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:27.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.479+0000 7f882d49d640 1 --2- 172.21.15.2:0/1059454915 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8828074510 0x7f882819a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:27.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.479+0000 7f882cc9c640 1 --2- 172.21.15.2:0/1059454915 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8828074e30 0x7f882819ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:27.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.479+0000 7f882dc9e640 1 -- 172.21.15.2:0/1059454915 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8828074e30 msgr2=0x7f882819ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:27.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.479+0000 7f882dc9e640 1 --2- 172.21.15.2:0/1059454915 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8828074e30 0x7f882819ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.479+0000 7f882dc9e640 1 -- 172.21.15.2:0/1059454915 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8828074510 msgr2=0x7f882819a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:27.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.479+0000 7f882dc9e640 1 --2- 172.21.15.2:0/1059454915 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8828074510 0x7f882819a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.479+0000 7f882dc9e640 1 -- 172.21.15.2:0/1059454915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f882819f5a0 con 0x7f882810e440 2024-09-19T06:24:27.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.479+0000 7f882cc9c640 1 --2- 172.21.15.2:0/1059454915 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8828074e30 0x7f882819ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:24:27.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.479+0000 7f882dc9e640 1 --2- 172.21.15.2:0/1059454915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f882810e440 0x7f882819eec0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f882000e9d0 tx=0x7f882000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:27.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.479+0000 7f881e7fc640 1 -- 172.21.15.2:0/1059454915 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882000cd80 con 0x7f882810e440 2024-09-19T06:24:27.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.479+0000 7f882f701640 1 -- 172.21.15.2:0/1059454915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f882819f890 con 0x7f882810e440 2024-09-19T06:24:27.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.479+0000 7f881e7fc640 1 -- 172.21.15.2:0/1059454915 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8820005020 con 0x7f882810e440 2024-09-19T06:24:27.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.479+0000 7f881e7fc640 1 -- 172.21.15.2:0/1059454915 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88200116d0 con 0x7f882810e440 2024-09-19T06:24:27.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.479+0000 7f882f701640 1 -- 172.21.15.2:0/1059454915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88281a7170 con 0x7f882810e440 2024-09-19T06:24:27.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.482+0000 7f881e7fc640 1 -- 172.21.15.2:0/1059454915 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f88200051d0 con 0x7f882810e440 2024-09-19T06:24:27.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.482+0000 7f8831ada740 1 Processor -- start 2024-09-19T06:24:27.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.482+0000 7f8831ada740 1 -- start start 2024-09-19T06:24:27.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.482+0000 7f8831ada740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55adaa30bb40 0x55adaa30a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:27.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.482+0000 7f8831ada740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55adaa30a5d0 0x55adaa30aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:27.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.482+0000 7f8831ada740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55adaa315370 0x55adaa317760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:27.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.482+0000 7f8831ada740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55adaa2702f0 con 0x55adaa30bb40 2024-09-19T06:24:27.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.482+0000 7f8831ada740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55adaa217cf0 con 0x55adaa30a5d0 2024-09-19T06:24:27.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.482+0000 7f8831ada740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55adaa26c2b0 con 0x55adaa315370 2024-09-19T06:24:27.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.482+0000 7f881e7fc640 1 --2- 172.21.15.2:0/1059454915 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f88140a33b0 0x7f88140a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:27.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.482+0000 7f882cc9c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55adaa30bb40 0x55adaa30a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:27.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.483+0000 7f882cc9c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55adaa30bb40 0x55adaa30a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54934/0 (socket says 172.21.15.2:54934) 2024-09-19T06:24:27.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.483+0000 7f882cc9c640 1 -- 172.21.15.2:0/704514716 learned_addr learned my addr 172.21.15.2:0/704514716 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:27.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.483+0000 7f882d49d640 1 --2- 172.21.15.2:0/704514716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55adaa30a5d0 0x55adaa30aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:27.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.483+0000 7f882dc9e640 1 --2- 172.21.15.2:0/1059454915 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f88140a33b0 0x7f88140a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:27.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.483+0000 7f881e7fc640 1 -- 172.21.15.2:0/1059454915 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7f88200cff80 con 0x7f882810e440 2024-09-19T06:24:27.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.483+0000 7f882cc9c640 1 --2- 172.21.15.2:0/704514716 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55adaa315370 0x55adaa317760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:27.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.483+0000 7f882cc9c640 1 -- 172.21.15.2:0/704514716 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55adaa315370 msgr2=0x55adaa317760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:27.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.483+0000 7f882cc9c640 1 --2- 172.21.15.2:0/704514716 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55adaa315370 0x55adaa317760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.483+0000 7f882cc9c640 1 -- 172.21.15.2:0/704514716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55adaa30a5d0 msgr2=0x55adaa30aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:27.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.483+0000 7f882cc9c640 1 --2- 172.21.15.2:0/704514716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55adaa30a5d0 0x55adaa30aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.483+0000 7f882cc9c640 1 -- 172.21.15.2:0/704514716 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adaa1fc3a0 con 0x55adaa30bb40 2024-09-19T06:24:27.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.483+0000 7f882d49d640 1 --2- 172.21.15.2:0/704514716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55adaa30a5d0 0x55adaa30aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:24:27.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.483+0000 7f882cc9c640 1 --2- 172.21.15.2:0/704514716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55adaa30bb40 0x55adaa30a090 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f8818005ec0 tx=0x7f8818005b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=532af55685f78a69 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:27.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.483+0000 7f882dc9e640 1 --2- 172.21.15.2:0/1059454915 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f88140a33b0 0x7f88140a5870 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f88200cd780 tx=0x7f8820005b40 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:27.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.483+0000 7f88137fe640 1 -- 172.21.15.2:0/704514716 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8818045070 con 0x55adaa30bb40 2024-09-19T06:24:27.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.483+0000 7f88137fe640 1 -- 172.21.15.2:0/704514716 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8818005040 con 0x55adaa30bb40 2024-09-19T06:24:27.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.483+0000 7f88137fe640 1 -- 172.21.15.2:0/704514716 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8818035050 con 0x55adaa30bb40 2024-09-19T06:24:27.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.484+0000 7f8831ada740 1 -- 172.21.15.2:0/704514716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55adaa30bb40 msgr2=0x55adaa30a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:27.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.484+0000 7f8831ada740 1 --2- 172.21.15.2:0/704514716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55adaa30bb40 0x55adaa30a090 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f8818005ec0 tx=0x7f8818005b70 comp rx=0 tx=0).stop 2024-09-19T06:24:27.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.484+0000 7f8831ada740 1 -- 172.21.15.2:0/704514716 shutdown_connections 2024-09-19T06:24:27.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.484+0000 7f8831ada740 1 --2- 172.21.15.2:0/704514716 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55adaa315370 0x55adaa317760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.484+0000 7f8831ada740 1 --2- 172.21.15.2:0/704514716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55adaa30a5d0 0x55adaa30aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.484+0000 7f8831ada740 1 --2- 172.21.15.2:0/704514716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55adaa30bb40 0x55adaa30a090 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.484+0000 7f8831ada740 1 -- 172.21.15.2:0/704514716 >> 172.21.15.2:0/704514716 conn(0x55adaa2d3310 msgr2=0x55adaa306c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:27.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.484+0000 7f8831ada740 1 -- 172.21.15.2:0/704514716 shutdown_connections 2024-09-19T06:24:27.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.484+0000 7f8831ada740 1 -- 172.21.15.2:0/704514716 wait complete. 2024-09-19T06:24:27.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.484+0000 7f8831ada740 1 -- start start 2024-09-19T06:24:27.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.485+0000 7f8831ada740 1 Processor -- start 2024-09-19T06:24:27.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.485+0000 7f8831ada740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55adaa30a5d0 0x55adaa314de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:27.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.485+0000 7f8831ada740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55adaa30bb40 0x55adaa312090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:27.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.485+0000 7f8831ada740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55adaa315370 0x55adaa3127d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:27.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.485+0000 7f8831ada740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55adaa318010 con 0x55adaa30a5d0 2024-09-19T06:24:27.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.485+0000 7f8831ada740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55adaa22b060 con 0x55adaa30bb40 2024-09-19T06:24:27.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.485+0000 7f8831ada740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55adaa318190 con 0x55adaa315370 2024-09-19T06:24:27.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.485+0000 7f8831ada740 10 client.0 _ll_register_callbacks cb 0x55ada9f7e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:27.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.485+0000 7f882cc9c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55adaa30a5d0 0x55adaa314de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:27.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.485+0000 7f882cc9c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55adaa30a5d0 0x55adaa314de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54942/0 (socket says 172.21.15.2:54942) 2024-09-19T06:24:27.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.485+0000 7f882cc9c640 1 -- 172.21.15.2:0/2997560373 learned_addr learned my addr 172.21.15.2:0/2997560373 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:27.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.485+0000 7f882d49d640 1 --2- 172.21.15.2:0/2997560373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55adaa30bb40 0x55adaa312090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:27.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.485+0000 7f882cc9c640 1 -- 172.21.15.2:0/2997560373 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55adaa315370 msgr2=0x55adaa3127d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:27.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.485+0000 7f882cc9c640 1 --2- 172.21.15.2:0/2997560373 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55adaa315370 0x55adaa3127d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.485+0000 7f882cc9c640 1 -- 172.21.15.2:0/2997560373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55adaa30bb40 msgr2=0x55adaa312090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:27.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.485+0000 7f882cc9c640 1 --2- 172.21.15.2:0/2997560373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55adaa30bb40 0x55adaa312090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.485+0000 7f882cc9c640 1 -- 172.21.15.2:0/2997560373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ada9fe13c0 con 0x55adaa30a5d0 2024-09-19T06:24:27.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.485+0000 7f882d49d640 1 --2- 172.21.15.2:0/2997560373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55adaa30bb40 0x55adaa312090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:24:27.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.486+0000 7f882cc9c640 1 --2- 172.21.15.2:0/2997560373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55adaa30a5d0 0x55adaa314de0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f8818043040 tx=0x7f88180044d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ec5e3f788dce371 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:27.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.486+0000 7f8810ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:24:27.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.486+0000 7f8810ff9640 1 -- 172.21.15.2:0/2997560373 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f881804e060 con 0x55adaa30a5d0 2024-09-19T06:24:27.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.486+0000 7f8810ff9640 1 -- 172.21.15.2:0/2997560373 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7f88180053f0 con 0x55adaa30a5d0 2024-09-19T06:24:27.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.486+0000 7f8831ada740 1 -- 172.21.15.2:0/2997560373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8818005040 con 0x55adaa30a5d0 2024-09-19T06:24:27.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.486+0000 7f8810ff9640 1 -- 172.21.15.2:0/2997560373 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8818035040 con 0x55adaa30a5d0 2024-09-19T06:24:27.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.486+0000 7f8831ada740 10 client.18885 fetch_fsmap learned FSMap version 26 2024-09-19T06:24:27.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.486+0000 7f8831ada740 1 -- 172.21.15.2:0/2997560373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55adaa323b40 con 0x55adaa30a5d0 2024-09-19T06:24:27.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.486+0000 7f8810ff9640 1 -- 172.21.15.2:0/2997560373 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8818005040 con 0x55adaa30a5d0 2024-09-19T06:24:27.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.486+0000 7f8810ff9640 1 -- 172.21.15.2:0/2997560373 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f8818003680 con 0x55adaa30a5d0 2024-09-19T06:24:27.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.486+0000 7f8831ada740 10 client.18885 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:24:27.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.486+0000 7f8831ada740 10 client.18885 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:24:27.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.486+0000 7f8831ada740 20 client.18885 populate_metadata read hostname 'smithi002' 2024-09-19T06:24:27.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.486+0000 7f8831ada740 1 --2- 172.21.15.2:0/2997560373 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55adaa324e90 0x55adaa327280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:27.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.486+0000 7f8831ada740 4 client.18885 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:24:27.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.486+0000 7f8831ada740 1 -- 172.21.15.2:0/2997560373 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55adaa27d860 con 0x55adaa324e90 2024-09-19T06:24:27.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.487+0000 7f882d49d640 1 --2- 172.21.15.2:0/2997560373 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55adaa324e90 0x55adaa327280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:27.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.487+0000 7f8810ff9640 10 client.18885 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:24:27.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.487+0000 7f882d49d640 1 --2- 172.21.15.2:0/2997560373 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55adaa324e90 0x55adaa327280 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c64dd20ca4fe7903 server_cookie=705a6d1fbffca6be in_seq=0 out_seq=0 2024-09-19T06:24:27.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.488+0000 7f8810ff9640 1 -- 172.21.15.2:0/2997560373 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55adaa27d860 con 0x55adaa324e90 2024-09-19T06:24:27.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.488+0000 7f8810ff9640 10 client.18885 handle_command_reply: tid=0 2024-09-19T06:24:27.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.488+0000 7f8831ada740 1 client.18885 shutdown 2024-09-19T06:24:27.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.488+0000 7f8831ada740 1 -- 172.21.15.2:0/2997560373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55adaa30a5d0 msgr2=0x55adaa314de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:27.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.488+0000 7f8831ada740 1 --2- 172.21.15.2:0/2997560373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55adaa30a5d0 0x55adaa314de0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f8818043040 tx=0x7f88180044d0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.488+0000 7f8831ada740 1 -- 172.21.15.2:0/2997560373 shutdown_connections 2024-09-19T06:24:27.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.488+0000 7f8831ada740 1 --2- 172.21.15.2:0/2997560373 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55adaa324e90 0x55adaa327280 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.488+0000 7f8831ada740 1 --2- 172.21.15.2:0/2997560373 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55adaa315370 0x55adaa3127d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.488+0000 7f8831ada740 1 --2- 172.21.15.2:0/2997560373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55adaa30bb40 0x55adaa312090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.488+0000 7f8831ada740 1 --2- 172.21.15.2:0/2997560373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55adaa30a5d0 0x55adaa314de0 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.488+0000 7f8831ada740 1 -- 172.21.15.2:0/2997560373 >> 172.21.15.2:0/2997560373 conn(0x55adaa2d3310 msgr2=0x55adaa30c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:27.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.488+0000 7f8810ff9640 0 client.18885 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:24:27.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.488+0000 7f8831ada740 1 -- 172.21.15.2:0/2997560373 shutdown_connections 2024-09-19T06:24:27.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.488+0000 7f8831ada740 1 -- 172.21.15.2:0/2997560373 wait complete. 2024-09-19T06:24:27.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.488+0000 7f8831ada740 20 client.18885 trim_cache size 0 max 16384 2024-09-19T06:24:27.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.501+0000 7f8831ada740 1 Processor -- start 2024-09-19T06:24:27.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.501+0000 7f8831ada740 1 -- start start 2024-09-19T06:24:27.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.501+0000 7f8831ada740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55adaa30a5d0 0x55adaa321430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:27.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.501+0000 7f8831ada740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55adaa30bb40 0x55adaa30d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:27.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.501+0000 7f8831ada740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55adaa315370 0x55adaa30d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:27.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.501+0000 7f8831ada740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f88281b2190 con 0x55adaa30bb40 2024-09-19T06:24:27.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.501+0000 7f8831ada740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f88281afa60 con 0x55adaa315370 2024-09-19T06:24:27.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.501+0000 7f8831ada740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f88281ad8d0 con 0x55adaa30a5d0 2024-09-19T06:24:27.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.502+0000 7f882d49d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55adaa30bb40 0x55adaa30d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:27.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.502+0000 7f882d49d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55adaa30bb40 0x55adaa30d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54956/0 (socket says 172.21.15.2:54956) 2024-09-19T06:24:27.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.502+0000 7f882d49d640 1 -- 172.21.15.2:0/1945828595 learned_addr learned my addr 172.21.15.2:0/1945828595 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:27.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.502+0000 7f882cc9c640 1 --2- 172.21.15.2:0/1945828595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55adaa30a5d0 0x55adaa321430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:27.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.502+0000 7f882d49d640 1 -- 172.21.15.2:0/1945828595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55adaa30a5d0 msgr2=0x55adaa321430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:27.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.502+0000 7f882d49d640 1 --2- 172.21.15.2:0/1945828595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55adaa30a5d0 0x55adaa321430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.502+0000 7f882d49d640 1 -- 172.21.15.2:0/1945828595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55adaa315370 msgr2=0x55adaa30d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:27.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.502+0000 7f882d49d640 1 --2- 172.21.15.2:0/1945828595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55adaa315370 0x55adaa30d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.502+0000 7f882d49d640 1 -- 172.21.15.2:0/1945828595 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adaa306ed0 con 0x55adaa30bb40 2024-09-19T06:24:27.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.502+0000 7f882d49d640 1 --2- 172.21.15.2:0/1945828595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55adaa30bb40 0x55adaa30d120 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x55adaa307ac0 tx=0x7f882400c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b383a932c3a6c712 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:27.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.502+0000 7f8812ffd640 1 -- 172.21.15.2:0/1945828595 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8824003ad0 con 0x55adaa30bb40 2024-09-19T06:24:27.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.502+0000 7f8812ffd640 1 -- 172.21.15.2:0/1945828595 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8824003c70 con 0x55adaa30bb40 2024-09-19T06:24:27.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.502+0000 7f8812ffd640 1 -- 172.21.15.2:0/1945828595 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88240116a0 con 0x55adaa30bb40 2024-09-19T06:24:27.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.503+0000 7f8831ada740 1 -- 172.21.15.2:0/1945828595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55adaa30bb40 msgr2=0x55adaa30d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:27.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.503+0000 7f8831ada740 1 --2- 172.21.15.2:0/1945828595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55adaa30bb40 0x55adaa30d120 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x55adaa307ac0 tx=0x7f882400c4b0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.503+0000 7f8831ada740 1 -- 172.21.15.2:0/1945828595 shutdown_connections 2024-09-19T06:24:27.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.503+0000 7f8831ada740 1 --2- 172.21.15.2:0/1945828595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55adaa315370 0x55adaa30d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.503+0000 7f8831ada740 1 --2- 172.21.15.2:0/1945828595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55adaa30bb40 0x55adaa30d120 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.503+0000 7f8831ada740 1 --2- 172.21.15.2:0/1945828595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55adaa30a5d0 0x55adaa321430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.503+0000 7f8831ada740 1 -- 172.21.15.2:0/1945828595 >> 172.21.15.2:0/1945828595 conn(0x55adaa2d3310 msgr2=0x55adaa311180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:27.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.503+0000 7f8831ada740 1 -- 172.21.15.2:0/1945828595 shutdown_connections 2024-09-19T06:24:27.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.503+0000 7f8831ada740 1 -- 172.21.15.2:0/1945828595 wait complete. 2024-09-19T06:24:27.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.503+0000 7f8831ada740 1 -- start start 2024-09-19T06:24:27.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.503+0000 7f8831ada740 1 Processor -- start 2024-09-19T06:24:27.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.504+0000 7f8831ada740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55adaa30a5d0 0x55adaa386b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:27.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.504+0000 7f8831ada740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55adaa30bb40 0x55adaa3870c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:27.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.504+0000 7f8831ada740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55adaa315370 0x55adaa327510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:27.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.504+0000 7f8831ada740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f88281adf20 con 0x55adaa30bb40 2024-09-19T06:24:27.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.504+0000 7f8831ada740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f88281af390 con 0x55adaa315370 2024-09-19T06:24:27.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.504+0000 7f8831ada740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f88281ae5f0 con 0x55adaa30a5d0 2024-09-19T06:24:27.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.504+0000 7f8831ada740 10 client.0 _ll_register_callbacks cb 0x7f8818043070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:27.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.504+0000 7f882d49d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55adaa30bb40 0x55adaa3870c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:27.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.504+0000 7f882d49d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55adaa30bb40 0x55adaa3870c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54972/0 (socket says 172.21.15.2:54972) 2024-09-19T06:24:27.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.504+0000 7f882d49d640 1 -- 172.21.15.2:0/4139600920 learned_addr learned my addr 172.21.15.2:0/4139600920 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:27.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.504+0000 7f882cc9c640 1 --2- 172.21.15.2:0/4139600920 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55adaa30a5d0 0x55adaa386b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:27.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.504+0000 7f882cc9c640 1 --2- 172.21.15.2:0/4139600920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55adaa315370 0x55adaa327510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:27.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.504+0000 7f882d49d640 1 -- 172.21.15.2:0/4139600920 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55adaa30a5d0 msgr2=0x55adaa386b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:27.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.504+0000 7f882d49d640 1 --2- 172.21.15.2:0/4139600920 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55adaa30a5d0 0x55adaa386b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.504+0000 7f882d49d640 1 -- 172.21.15.2:0/4139600920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55adaa315370 msgr2=0x55adaa327510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:27.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.504+0000 7f882d49d640 1 --2- 172.21.15.2:0/4139600920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55adaa315370 0x55adaa327510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.504+0000 7f882d49d640 1 -- 172.21.15.2:0/4139600920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55adaa327d40 con 0x55adaa30bb40 2024-09-19T06:24:27.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.504+0000 7f882cc9c640 1 --2- 172.21.15.2:0/4139600920 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55adaa30a5d0 0x55adaa386b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:24:27.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.504+0000 7f882d49d640 1 --2- 172.21.15.2:0/4139600920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55adaa30bb40 0x55adaa3870c0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f882401ad20 tx=0x7f882400cfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf8d72f740bab3b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:27.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.504+0000 7f8810ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:24:27.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.504+0000 7f8810ff9640 1 -- 172.21.15.2:0/4139600920 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8824030060 con 0x55adaa30bb40 2024-09-19T06:24:27.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.504+0000 7f8810ff9640 1 -- 172.21.15.2:0/4139600920 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7f882401a740 con 0x55adaa30bb40 2024-09-19T06:24:27.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.504+0000 7f8831ada740 1 -- 172.21.15.2:0/4139600920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8824003c70 con 0x55adaa30bb40 2024-09-19T06:24:27.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.505+0000 7f8810ff9640 1 -- 172.21.15.2:0/4139600920 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f882401a940 con 0x55adaa30bb40 2024-09-19T06:24:27.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.505+0000 7f8831ada740 10 client.18891 fetch_fsmap learned FSMap version 26 2024-09-19T06:24:27.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.505+0000 7f8831ada740 1 -- 172.21.15.2:0/4139600920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55adaa38f360 con 0x55adaa30bb40 2024-09-19T06:24:27.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.505+0000 7f8810ff9640 1 -- 172.21.15.2:0/4139600920 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8824003c70 con 0x55adaa30bb40 2024-09-19T06:24:27.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.505+0000 7f8810ff9640 1 -- 172.21.15.2:0/4139600920 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f882402a030 con 0x55adaa30bb40 2024-09-19T06:24:27.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.505+0000 7f8831ada740 10 client.18891 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:24:27.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.505+0000 7f8831ada740 10 client.18891 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:24:27.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.505+0000 7f8831ada740 20 client.18891 populate_metadata read hostname 'smithi002' 2024-09-19T06:24:27.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.505+0000 7f8831ada740 1 --2- 172.21.15.2:0/4139600920 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55adaa38fa80 0x55adaa391ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:27.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.505+0000 7f8831ada740 4 client.18891 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:24:27.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.505+0000 7f8831ada740 1 -- 172.21.15.2:0/4139600920 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55adaa277d70 con 0x55adaa38fa80 2024-09-19T06:24:27.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.505+0000 7f882cc9c640 1 --2- 172.21.15.2:0/4139600920 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55adaa38fa80 0x55adaa391ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:27.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.506+0000 7f882cc9c640 1 --2- 172.21.15.2:0/4139600920 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55adaa38fa80 0x55adaa391ea0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fdc9d4bca4380c18 server_cookie=bb6542ab7c65d57c in_seq=0 out_seq=0 2024-09-19T06:24:27.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.506+0000 7f8810ff9640 10 client.18891 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:24:27.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.506+0000 7f8810ff9640 1 -- 172.21.15.2:0/4139600920 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55adaa277d70 con 0x55adaa38fa80 2024-09-19T06:24:27.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.506+0000 7f8810ff9640 10 client.18891 handle_command_reply: tid=0 2024-09-19T06:24:27.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.506+0000 7f8831ada740 1 client.18891 shutdown 2024-09-19T06:24:27.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.506+0000 7f8831ada740 1 -- 172.21.15.2:0/4139600920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55adaa30bb40 msgr2=0x55adaa3870c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:27.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.506+0000 7f8831ada740 1 --2- 172.21.15.2:0/4139600920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55adaa30bb40 0x55adaa3870c0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f882401ad20 tx=0x7f882400cfa0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.506+0000 7f8831ada740 1 -- 172.21.15.2:0/4139600920 shutdown_connections 2024-09-19T06:24:27.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.506+0000 7f8831ada740 1 --2- 172.21.15.2:0/4139600920 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x55adaa38fa80 0x55adaa391ea0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.506+0000 7f8831ada740 1 --2- 172.21.15.2:0/4139600920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55adaa315370 0x55adaa327510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.506+0000 7f8831ada740 1 --2- 172.21.15.2:0/4139600920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55adaa30bb40 0x55adaa3870c0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.506+0000 7f8810ff9640 0 client.18891 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:24:27.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.506+0000 7f8831ada740 1 --2- 172.21.15.2:0/4139600920 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55adaa30a5d0 0x55adaa386b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.506+0000 7f8831ada740 1 -- 172.21.15.2:0/4139600920 >> 172.21.15.2:0/4139600920 conn(0x55adaa2d3310 msgr2=0x55adaa3138f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:27.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.506+0000 7f8831ada740 1 -- 172.21.15.2:0/4139600920 shutdown_connections 2024-09-19T06:24:27.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.506+0000 7f8831ada740 1 -- 172.21.15.2:0/4139600920 wait complete. 2024-09-19T06:24:27.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.506+0000 7f8831ada740 20 client.18891 trim_cache size 0 max 16384 2024-09-19T06:24:27.531 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:24:27.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.507+0000 7f882f701640 1 -- 172.21.15.2:0/1059454915 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f88140a33b0 msgr2=0x7f88140a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:27.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.507+0000 7f882f701640 1 --2- 172.21.15.2:0/1059454915 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f88140a33b0 0x7f88140a5870 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f88200cd780 tx=0x7f8820005b40 comp rx=0 tx=0).stop 2024-09-19T06:24:27.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.507+0000 7f882f701640 1 -- 172.21.15.2:0/1059454915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f882810e440 msgr2=0x7f882819eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:27.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.507+0000 7f882f701640 1 --2- 172.21.15.2:0/1059454915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f882810e440 0x7f882819eec0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f882000e9d0 tx=0x7f882000ee90 comp rx=0 tx=0).stop 2024-09-19T06:24:27.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.507+0000 7f882f701640 1 -- 172.21.15.2:0/1059454915 shutdown_connections 2024-09-19T06:24:27.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.507+0000 7f882f701640 1 --2- 172.21.15.2:0/1059454915 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f88140a33b0 0x7f88140a5870 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.507+0000 7f882f701640 1 --2- 172.21.15.2:0/1059454915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f882810e440 0x7f882819eec0 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.507+0000 7f882f701640 1 --2- 172.21.15.2:0/1059454915 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8828074e30 0x7f882819ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.507+0000 7f882f701640 1 --2- 172.21.15.2:0/1059454915 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8828074510 0x7f882819a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.507+0000 7f882f701640 1 -- 172.21.15.2:0/1059454915 >> 172.21.15.2:0/1059454915 conn(0x7f88280fd8c0 msgr2=0x7f88280ff080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:27.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.507+0000 7f882f701640 1 -- 172.21.15.2:0/1059454915 shutdown_connections 2024-09-19T06:24:27.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:27.507+0000 7f882f701640 1 -- 172.21.15.2:0/1059454915 wait complete. 2024-09-19T06:24:27.721 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:27 smithi002 ceph-mon[30982]: pgmap v300: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:24:27.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:27 smithi090 ceph-mon[34497]: pgmap v300: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:24:27.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:27 smithi089 ceph-mon[34160]: pgmap v300: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:24:28.201 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:24:28.463 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:24:28.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.876+0000 7f9c25b4e640 1 -- 172.21.15.2:0/1984400629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c201082a0 msgr2=0x7f9c2010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:28.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.876+0000 7f9c25b4e640 1 --2- 172.21.15.2:0/1984400629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c201082a0 0x7f9c2010ec40 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f9c18009cd0 tx=0x7f9c1802a8e0 comp rx=0 tx=0).stop 2024-09-19T06:24:28.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.876+0000 7f9c25b4e640 1 -- 172.21.15.2:0/1984400629 shutdown_connections 2024-09-19T06:24:28.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.876+0000 7f9c25b4e640 1 --2- 172.21.15.2:0/1984400629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c201082a0 0x7f9c2010ec40 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:28.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.876+0000 7f9c25b4e640 1 --2- 172.21.15.2:0/1984400629 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c201036e0 0x7f9c20107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:28.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.876+0000 7f9c25b4e640 1 --2- 172.21.15.2:0/1984400629 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c20102d30 0x7f9c20103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:28.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.876+0000 7f9c25b4e640 1 -- 172.21.15.2:0/1984400629 >> 172.21.15.2:0/1984400629 conn(0x7f9c200fc7d0 msgr2=0x7f9c200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:28.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.876+0000 7f9c25b4e640 1 -- 172.21.15.2:0/1984400629 shutdown_connections 2024-09-19T06:24:28.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.876+0000 7f9c25b4e640 1 -- 172.21.15.2:0/1984400629 wait complete. 2024-09-19T06:24:28.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.877+0000 7f9c25b4e640 1 Processor -- start 2024-09-19T06:24:28.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.877+0000 7f9c25b4e640 1 -- start start 2024-09-19T06:24:28.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.877+0000 7f9c25b4e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c20102d30 0x7f9c201984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:28.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.877+0000 7f9c25b4e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c201036e0 0x7f9c20198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:28.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.877+0000 7f9c25b4e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c201082a0 0x7f9c2019cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:28.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.877+0000 7f9c25b4e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9c20111f50 con 0x7f9c201082a0 2024-09-19T06:24:28.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.877+0000 7f9c25b4e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9c20111dd0 con 0x7f9c201036e0 2024-09-19T06:24:28.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.877+0000 7f9c25b4e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9c201120d0 con 0x7f9c20102d30 2024-09-19T06:24:28.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.877+0000 7f9c1ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c201082a0 0x7f9c2019cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:28.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.877+0000 7f9c1ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c201082a0 0x7f9c2019cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55000/0 (socket says 172.21.15.2:55000) 2024-09-19T06:24:28.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.877+0000 7f9c1ffff640 1 -- 172.21.15.2:0/2326838001 learned_addr learned my addr 172.21.15.2:0/2326838001 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:28.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.877+0000 7f9c1f7fe640 1 --2- 172.21.15.2:0/2326838001 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c20102d30 0x7f9c201984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:28.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.878+0000 7f9c1effd640 1 --2- 172.21.15.2:0/2326838001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c201036e0 0x7f9c20198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:28.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.878+0000 7f9c1ffff640 1 -- 172.21.15.2:0/2326838001 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c20102d30 msgr2=0x7f9c201984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:28.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.878+0000 7f9c1ffff640 1 --2- 172.21.15.2:0/2326838001 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c20102d30 0x7f9c201984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:28.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.878+0000 7f9c1ffff640 1 -- 172.21.15.2:0/2326838001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c201036e0 msgr2=0x7f9c20198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:28.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.878+0000 7f9c1ffff640 1 --2- 172.21.15.2:0/2326838001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c201036e0 0x7f9c20198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:28.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.878+0000 7f9c1ffff640 1 -- 172.21.15.2:0/2326838001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c2019d4a0 con 0x7f9c201082a0 2024-09-19T06:24:28.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.878+0000 7f9c1f7fe640 1 --2- 172.21.15.2:0/2326838001 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c20102d30 0x7f9c201984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:24:28.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.878+0000 7f9c1ffff640 1 --2- 172.21.15.2:0/2326838001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c201082a0 0x7f9c2019cdc0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f9c18005cc0 tx=0x7f9c18003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:28.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.878+0000 7f9c1cff9640 1 -- 172.21.15.2:0/2326838001 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c18004450 con 0x7f9c201082a0 2024-09-19T06:24:28.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.878+0000 7f9c1cff9640 1 -- 172.21.15.2:0/2326838001 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9c18031c90 con 0x7f9c201082a0 2024-09-19T06:24:28.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.878+0000 7f9c25b4e640 1 -- 172.21.15.2:0/2326838001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c2019d730 con 0x7f9c201082a0 2024-09-19T06:24:28.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.878+0000 7f9c1cff9640 1 -- 172.21.15.2:0/2326838001 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1803b400 con 0x7f9c201082a0 2024-09-19T06:24:28.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.878+0000 7f9c25b4e640 1 -- 172.21.15.2:0/2326838001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c201a5070 con 0x7f9c201082a0 2024-09-19T06:24:28.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.880+0000 7f9c1cff9640 1 -- 172.21.15.2:0/2326838001 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f9c18004680 con 0x7f9c201082a0 2024-09-19T06:24:28.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.881+0000 7f9c27f27740 1 Processor -- start 2024-09-19T06:24:28.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.881+0000 7f9c27f27740 1 -- start start 2024-09-19T06:24:28.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.881+0000 7f9c27f27740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556fb5d69b40 0x556fb5d68090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:28.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.881+0000 7f9c27f27740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556fb5d685d0 0x556fb5d68a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:28.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.881+0000 7f9c27f27740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fb5d77780 0x556fb5d79b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:28.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.881+0000 7f9c27f27740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556fb5cce2f0 con 0x556fb5d77780 2024-09-19T06:24:28.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.881+0000 7f9c27f27740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x556fb5c75cf0 con 0x556fb5d685d0 2024-09-19T06:24:28.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.881+0000 7f9c27f27740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556fb5cca2b0 con 0x556fb5d69b40 2024-09-19T06:24:28.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.881+0000 7f9c1cff9640 1 --2- 172.21.15.2:0/2326838001 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9c080a3430 0x7f9c080a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:28.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.881+0000 7f9c1effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fb5d77780 0x556fb5d79b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:28.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.881+0000 7f9c1effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fb5d77780 0x556fb5d79b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55016/0 (socket says 172.21.15.2:55016) 2024-09-19T06:24:28.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.881+0000 7f9c1effd640 1 -- 172.21.15.2:0/1491716820 learned_addr learned my addr 172.21.15.2:0/1491716820 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:28.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.881+0000 7f9c1ffff640 1 --2- 172.21.15.2:0/2326838001 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9c080a3430 0x7f9c080a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:28.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.881+0000 7f9c1f7fe640 1 --2- 172.21.15.2:0/1491716820 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556fb5d685d0 0x556fb5d68a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:28.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.882+0000 7f9c1effd640 1 --2- 172.21.15.2:0/1491716820 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556fb5d69b40 0x556fb5d68090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:28.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.882+0000 7f9c1cff9640 1 -- 172.21.15.2:0/2326838001 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7f9c1802e030 con 0x7f9c201082a0 2024-09-19T06:24:28.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.882+0000 7f9c1f7fe640 1 -- 172.21.15.2:0/1491716820 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556fb5d69b40 msgr2=0x556fb5d68090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:28.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.882+0000 7f9c1f7fe640 1 --2- 172.21.15.2:0/1491716820 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556fb5d69b40 0x556fb5d68090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:28.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.882+0000 7f9c1f7fe640 1 -- 172.21.15.2:0/1491716820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fb5d77780 msgr2=0x556fb5d79b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:28.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.882+0000 7f9c1f7fe640 1 --2- 172.21.15.2:0/1491716820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fb5d77780 0x556fb5d79b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:28.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.882+0000 7f9c1f7fe640 1 -- 172.21.15.2:0/1491716820 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fb5c5a3a0 con 0x556fb5d685d0 2024-09-19T06:24:28.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.882+0000 7f9c1effd640 1 --2- 172.21.15.2:0/1491716820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fb5d77780 0x556fb5d79b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:24:28.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.882+0000 7f9c1ffff640 1 --2- 172.21.15.2:0/2326838001 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9c080a3430 0x7f9c080a58f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9c180b9aa0 tx=0x7f9c1808ee50 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:28.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.882+0000 7f9c1f7fe640 1 --2- 172.21.15.2:0/1491716820 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556fb5d685d0 0x556fb5d68a10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9c10005fd0 tx=0x7f9c1000bf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c71f290081239a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:28.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.882+0000 7f9c05ffb640 1 -- 172.21.15.2:0/1491716820 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c10011700 con 0x556fb5d685d0 2024-09-19T06:24:28.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.882+0000 7f9c05ffb640 1 -- 172.21.15.2:0/1491716820 <== mon.2 v2:172.21.15.89:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9c10011d50 con 0x556fb5d685d0 2024-09-19T06:24:28.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.882+0000 7f9c05ffb640 1 -- 172.21.15.2:0/1491716820 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c10019e30 con 0x556fb5d685d0 2024-09-19T06:24:28.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.883+0000 7f9c27f27740 1 -- 172.21.15.2:0/1491716820 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556fb5d685d0 msgr2=0x556fb5d68a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:28.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.883+0000 7f9c27f27740 1 --2- 172.21.15.2:0/1491716820 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556fb5d685d0 0x556fb5d68a10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9c10005fd0 tx=0x7f9c1000bf90 comp rx=0 tx=0).stop 2024-09-19T06:24:28.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.883+0000 7f9c27f27740 1 -- 172.21.15.2:0/1491716820 shutdown_connections 2024-09-19T06:24:28.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.883+0000 7f9c27f27740 1 --2- 172.21.15.2:0/1491716820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fb5d77780 0x556fb5d79b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:28.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.883+0000 7f9c27f27740 1 --2- 172.21.15.2:0/1491716820 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556fb5d685d0 0x556fb5d68a10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:28.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.883+0000 7f9c27f27740 1 --2- 172.21.15.2:0/1491716820 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556fb5d69b40 0x556fb5d68090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:28.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.883+0000 7f9c27f27740 1 -- 172.21.15.2:0/1491716820 >> 172.21.15.2:0/1491716820 conn(0x556fb5d31310 msgr2=0x556fb5d64c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:28.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.883+0000 7f9c27f27740 1 -- 172.21.15.2:0/1491716820 shutdown_connections 2024-09-19T06:24:28.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.883+0000 7f9c27f27740 1 -- 172.21.15.2:0/1491716820 wait complete. 2024-09-19T06:24:28.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.883+0000 7f9c27f27740 1 -- start start 2024-09-19T06:24:28.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.884+0000 7f9c27f27740 1 Processor -- start 2024-09-19T06:24:28.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.884+0000 7f9c27f27740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fb5d685d0 0x556fb5d77110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:28.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.884+0000 7f9c27f27740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556fb5d69b40 0x556fb5d743c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:28.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.884+0000 7f9c27f27740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556fb5d77780 0x556fb5d74940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:28.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.884+0000 7f9c27f27740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556fb5d7a480 con 0x556fb5d685d0 2024-09-19T06:24:28.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.884+0000 7f9c27f27740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x556fb5c89060 con 0x556fb5d69b40 2024-09-19T06:24:28.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.884+0000 7f9c27f27740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556fb5d7a600 con 0x556fb5d77780 2024-09-19T06:24:28.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.884+0000 7f9c27f27740 10 client.0 _ll_register_callbacks cb 0x556fb59dc8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:28.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.884+0000 7f9c1effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fb5d685d0 0x556fb5d77110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:28.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.884+0000 7f9c1effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fb5d685d0 0x556fb5d77110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55020/0 (socket says 172.21.15.2:55020) 2024-09-19T06:24:28.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.884+0000 7f9c1effd640 1 -- 172.21.15.2:0/1239057700 learned_addr learned my addr 172.21.15.2:0/1239057700 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:28.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.884+0000 7f9c1effd640 1 --2- 172.21.15.2:0/1239057700 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556fb5d77780 0x556fb5d74940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:28.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.884+0000 7f9c1f7fe640 1 --2- 172.21.15.2:0/1239057700 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556fb5d69b40 0x556fb5d743c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:28.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.884+0000 7f9c1effd640 1 -- 172.21.15.2:0/1239057700 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556fb5d77780 msgr2=0x556fb5d74940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:28.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.884+0000 7f9c1effd640 1 --2- 172.21.15.2:0/1239057700 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556fb5d77780 0x556fb5d74940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:28.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.884+0000 7f9c1effd640 1 -- 172.21.15.2:0/1239057700 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556fb5d69b40 msgr2=0x556fb5d743c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:28.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.884+0000 7f9c1effd640 1 --2- 172.21.15.2:0/1239057700 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556fb5d69b40 0x556fb5d743c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:28.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.885+0000 7f9c1effd640 1 -- 172.21.15.2:0/1239057700 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fb5a3f3c0 con 0x556fb5d685d0 2024-09-19T06:24:28.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.885+0000 7f9c1effd640 1 --2- 172.21.15.2:0/1239057700 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fb5d685d0 0x556fb5d77110 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f9c14012a80 tx=0x7f9c14014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e43b9551f6a5dbf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:28.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.885+0000 7f9bfeffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:24:28.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.885+0000 7f9bfeffd640 1 -- 172.21.15.2:0/1239057700 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c14010d40 con 0x556fb5d685d0 2024-09-19T06:24:28.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.885+0000 7f9bfeffd640 1 -- 172.21.15.2:0/1239057700 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7f9c14005020 con 0x556fb5d685d0 2024-09-19T06:24:28.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.885+0000 7f9c27f27740 1 -- 172.21.15.2:0/1239057700 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c10011d50 con 0x556fb5d685d0 2024-09-19T06:24:28.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.885+0000 7f9bfeffd640 1 -- 172.21.15.2:0/1239057700 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9c14005220 con 0x556fb5d685d0 2024-09-19T06:24:28.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.885+0000 7f9c27f27740 10 client.18903 fetch_fsmap learned FSMap version 26 2024-09-19T06:24:28.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.885+0000 7f9c27f27740 1 -- 172.21.15.2:0/1239057700 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556fb5d85f10 con 0x556fb5d685d0 2024-09-19T06:24:28.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.885+0000 7f9bfeffd640 1 -- 172.21.15.2:0/1239057700 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9c10011d50 con 0x556fb5d685d0 2024-09-19T06:24:28.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.886+0000 7f9bfeffd640 1 -- 172.21.15.2:0/1239057700 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f9c1402c480 con 0x556fb5d685d0 2024-09-19T06:24:28.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.886+0000 7f9c27f27740 10 client.18903 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:24:28.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.886+0000 7f9c27f27740 10 client.18903 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:24:28.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.886+0000 7f9c27f27740 20 client.18903 populate_metadata read hostname 'smithi002' 2024-09-19T06:24:28.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.886+0000 7f9c27f27740 1 --2- 172.21.15.2:0/1239057700 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556fb5d87320 0x556fb5d89710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:28.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.886+0000 7f9c27f27740 4 client.18903 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:24:28.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.886+0000 7f9c27f27740 1 -- 172.21.15.2:0/1239057700 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556fb5cdb860 con 0x556fb5d87320 2024-09-19T06:24:28.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.886+0000 7f9c1f7fe640 1 --2- 172.21.15.2:0/1239057700 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556fb5d87320 0x556fb5d89710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:28.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.886+0000 7f9bfeffd640 10 client.18903 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:28.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.886+0000 7f9c1f7fe640 1 --2- 172.21.15.2:0/1239057700 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556fb5d87320 0x556fb5d89710 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9382d1b89558bc0 server_cookie=a52b8dc50825808f in_seq=0 out_seq=0 2024-09-19T06:24:28.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.887+0000 7f9bfeffd640 1 -- 172.21.15.2:0/1239057700 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556fb5cdb860 con 0x556fb5d87320 2024-09-19T06:24:28.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.887+0000 7f9bfeffd640 10 client.18903 handle_command_reply: tid=0 2024-09-19T06:24:28.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.887+0000 7f9c27f27740 1 client.18903 shutdown 2024-09-19T06:24:28.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.887+0000 7f9c27f27740 1 -- 172.21.15.2:0/1239057700 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fb5d685d0 msgr2=0x556fb5d77110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:28.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.887+0000 7f9c27f27740 1 --2- 172.21.15.2:0/1239057700 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fb5d685d0 0x556fb5d77110 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f9c14012a80 tx=0x7f9c14014040 comp rx=0 tx=0).stop 2024-09-19T06:24:28.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.887+0000 7f9c27f27740 1 -- 172.21.15.2:0/1239057700 shutdown_connections 2024-09-19T06:24:28.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.887+0000 7f9c27f27740 1 --2- 172.21.15.2:0/1239057700 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556fb5d77780 0x556fb5d74940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:28.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.887+0000 7f9c27f27740 1 --2- 172.21.15.2:0/1239057700 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556fb5d87320 0x556fb5d89710 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:28.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.887+0000 7f9c27f27740 1 --2- 172.21.15.2:0/1239057700 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556fb5d69b40 0x556fb5d743c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:28.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.887+0000 7f9c27f27740 1 --2- 172.21.15.2:0/1239057700 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fb5d685d0 0x556fb5d77110 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:28.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.887+0000 7f9c27f27740 1 -- 172.21.15.2:0/1239057700 >> 172.21.15.2:0/1239057700 conn(0x556fb5d31310 msgr2=0x556fb5d6a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:28.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.887+0000 7f9bfeffd640 0 client.18903 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:28.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.887+0000 7f9c27f27740 1 -- 172.21.15.2:0/1239057700 shutdown_connections 2024-09-19T06:24:28.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.887+0000 7f9c27f27740 1 -- 172.21.15.2:0/1239057700 wait complete. 2024-09-19T06:24:28.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.887+0000 7f9c27f27740 20 client.18903 trim_cache size 0 max 16384 2024-09-19T06:24:28.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.900+0000 7f9c27f27740 1 Processor -- start 2024-09-19T06:24:28.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.900+0000 7f9c27f27740 1 -- start start 2024-09-19T06:24:28.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.901+0000 7f9c27f27740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556fb5d685d0 0x556fb5d83720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:28.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.901+0000 7f9c27f27740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556fb5d69b40 0x556fb5d64700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:28.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.901+0000 7f9c27f27740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fb5d77780 0x556fb5d64c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:28.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.901+0000 7f9c27f27740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9c201adda0 con 0x556fb5d77780 2024-09-19T06:24:28.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.901+0000 7f9c27f27740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9c201ab670 con 0x556fb5d685d0 2024-09-19T06:24:28.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.901+0000 7f9c27f27740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9c201a94c0 con 0x556fb5d69b40 2024-09-19T06:24:28.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.901+0000 7f9c1effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fb5d77780 0x556fb5d64c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:28.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.901+0000 7f9c1effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fb5d77780 0x556fb5d64c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55036/0 (socket says 172.21.15.2:55036) 2024-09-19T06:24:28.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.901+0000 7f9c1effd640 1 -- 172.21.15.2:0/628476107 learned_addr learned my addr 172.21.15.2:0/628476107 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:28.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.901+0000 7f9c1f7fe640 1 --2- 172.21.15.2:0/628476107 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556fb5d69b40 0x556fb5d64700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:28.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.901+0000 7f9c1effd640 1 --2- 172.21.15.2:0/628476107 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556fb5d685d0 0x556fb5d83720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:28.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.901+0000 7f9c1effd640 1 -- 172.21.15.2:0/628476107 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556fb5d69b40 msgr2=0x556fb5d64700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:28.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.901+0000 7f9c1effd640 1 --2- 172.21.15.2:0/628476107 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556fb5d69b40 0x556fb5d64700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:28.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.901+0000 7f9c1effd640 1 -- 172.21.15.2:0/628476107 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556fb5d685d0 msgr2=0x556fb5d83720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:28.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.901+0000 7f9c1effd640 1 --2- 172.21.15.2:0/628476107 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556fb5d685d0 0x556fb5d83720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:28.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.901+0000 7f9c1effd640 1 -- 172.21.15.2:0/628476107 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fb5d65180 con 0x556fb5d77780 2024-09-19T06:24:28.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.901+0000 7f9c1effd640 1 --2- 172.21.15.2:0/628476107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fb5d77780 0x556fb5d64c40 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f9c1400b500 tx=0x7f9c1400b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbf70ec041fba06 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:28.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.901+0000 7f9c057fa640 1 -- 172.21.15.2:0/628476107 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1402c480 con 0x556fb5d77780 2024-09-19T06:24:28.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.901+0000 7f9c057fa640 1 -- 172.21.15.2:0/628476107 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9c14033040 con 0x556fb5d77780 2024-09-19T06:24:28.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.901+0000 7f9c057fa640 1 -- 172.21.15.2:0/628476107 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c14005600 con 0x556fb5d77780 2024-09-19T06:24:28.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.902+0000 7f9c27f27740 1 -- 172.21.15.2:0/628476107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fb5d77780 msgr2=0x556fb5d64c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:28.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.902+0000 7f9c27f27740 1 --2- 172.21.15.2:0/628476107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fb5d77780 0x556fb5d64c40 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f9c1400b500 tx=0x7f9c1400b390 comp rx=0 tx=0).stop 2024-09-19T06:24:28.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.902+0000 7f9c27f27740 1 -- 172.21.15.2:0/628476107 shutdown_connections 2024-09-19T06:24:28.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.902+0000 7f9c27f27740 1 --2- 172.21.15.2:0/628476107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fb5d77780 0x556fb5d64c40 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:28.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.902+0000 7f9c27f27740 1 --2- 172.21.15.2:0/628476107 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556fb5d69b40 0x556fb5d64700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:28.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.902+0000 7f9c27f27740 1 --2- 172.21.15.2:0/628476107 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556fb5d685d0 0x556fb5d83720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:28.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.902+0000 7f9c27f27740 1 -- 172.21.15.2:0/628476107 >> 172.21.15.2:0/628476107 conn(0x556fb5d31310 msgr2=0x556fb5d6f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:28.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.902+0000 7f9c27f27740 1 -- 172.21.15.2:0/628476107 shutdown_connections 2024-09-19T06:24:28.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.902+0000 7f9c27f27740 1 -- 172.21.15.2:0/628476107 wait complete. 2024-09-19T06:24:28.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.902+0000 7f9c27f27740 1 -- start start 2024-09-19T06:24:28.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.903+0000 7f9c27f27740 1 Processor -- start 2024-09-19T06:24:28.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.903+0000 7f9c27f27740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556fb5d685d0 0x556fb5d7fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:28.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.903+0000 7f9c27f27740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fb5d69b40 0x556fb5d71030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:28.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.903+0000 7f9c27f27740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556fb5d77780 0x556fb5d71570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:28.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.903+0000 7f9c27f27740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9c201a9b30 con 0x556fb5d69b40 2024-09-19T06:24:28.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.903+0000 7f9c27f27740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9c201aafa0 con 0x556fb5d685d0 2024-09-19T06:24:28.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.903+0000 7f9c27f27740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9c201aa200 con 0x556fb5d77780 2024-09-19T06:24:28.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.903+0000 7f9c27f27740 10 client.0 _ll_register_callbacks cb 0x7f9c1400bc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:28.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.903+0000 7f9c1f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fb5d69b40 0x556fb5d71030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:28.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.903+0000 7f9c1f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fb5d69b40 0x556fb5d71030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55040/0 (socket says 172.21.15.2:55040) 2024-09-19T06:24:28.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.903+0000 7f9c1f7fe640 1 -- 172.21.15.2:0/1119198219 learned_addr learned my addr 172.21.15.2:0/1119198219 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:28.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.903+0000 7f9c1effd640 1 --2- 172.21.15.2:0/1119198219 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556fb5d77780 0x556fb5d71570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:28.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.903+0000 7f9c1effd640 1 --2- 172.21.15.2:0/1119198219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556fb5d685d0 0x556fb5d7fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:28.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.903+0000 7f9c1f7fe640 1 -- 172.21.15.2:0/1119198219 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556fb5d77780 msgr2=0x556fb5d71570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:28.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.903+0000 7f9c1f7fe640 1 --2- 172.21.15.2:0/1119198219 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556fb5d77780 0x556fb5d71570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:28.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.903+0000 7f9c1f7fe640 1 -- 172.21.15.2:0/1119198219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556fb5d685d0 msgr2=0x556fb5d7fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:28.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.903+0000 7f9c1f7fe640 1 --2- 172.21.15.2:0/1119198219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556fb5d685d0 0x556fb5d7fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:28.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.903+0000 7f9c1f7fe640 1 -- 172.21.15.2:0/1119198219 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fb5d71c60 con 0x556fb5d69b40 2024-09-19T06:24:28.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.903+0000 7f9c1effd640 1 --2- 172.21.15.2:0/1119198219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556fb5d685d0 0x556fb5d7fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:24:28.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.903+0000 7f9c1f7fe640 1 --2- 172.21.15.2:0/1119198219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fb5d69b40 0x556fb5d71030 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f9c1000b4f0 tx=0x7f9c100195a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a3da25e401eda4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:28.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.903+0000 7f9bfeffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:24:28.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.904+0000 7f9bfeffd640 1 -- 172.21.15.2:0/1119198219 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c10005870 con 0x556fb5d69b40 2024-09-19T06:24:28.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.904+0000 7f9bfeffd640 1 -- 172.21.15.2:0/1119198219 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7f9c10019a00 con 0x556fb5d69b40 2024-09-19T06:24:28.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.904+0000 7f9c27f27740 1 -- 172.21.15.2:0/1119198219 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c14033040 con 0x556fb5d69b40 2024-09-19T06:24:28.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.904+0000 7f9bfeffd640 1 -- 172.21.15.2:0/1119198219 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9c10019c00 con 0x556fb5d69b40 2024-09-19T06:24:28.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.904+0000 7f9c27f27740 10 client.18909 fetch_fsmap learned FSMap version 26 2024-09-19T06:24:28.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.904+0000 7f9c27f27740 1 -- 172.21.15.2:0/1119198219 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556fb5df1f10 con 0x556fb5d69b40 2024-09-19T06:24:28.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.904+0000 7f9bfeffd640 1 -- 172.21.15.2:0/1119198219 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9c14033040 con 0x556fb5d69b40 2024-09-19T06:24:28.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.904+0000 7f9bfeffd640 1 -- 172.21.15.2:0/1119198219 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f9c100048d0 con 0x556fb5d69b40 2024-09-19T06:24:28.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.904+0000 7f9c27f27740 10 client.18909 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:24:28.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.904+0000 7f9c27f27740 10 client.18909 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:24:28.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.904+0000 7f9c27f27740 20 client.18909 populate_metadata read hostname 'smithi002' 2024-09-19T06:24:28.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.904+0000 7f9c27f27740 1 --2- 172.21.15.2:0/1119198219 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556fb5df23b0 0x556fb5df47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:28.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.904+0000 7f9c27f27740 4 client.18909 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:24:28.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.904+0000 7f9c27f27740 1 -- 172.21.15.2:0/1119198219 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556fb5cd5d70 con 0x556fb5df23b0 2024-09-19T06:24:28.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.905+0000 7f9c1effd640 1 --2- 172.21.15.2:0/1119198219 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556fb5df23b0 0x556fb5df47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:28.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.905+0000 7f9bfeffd640 10 client.18909 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:28.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.905+0000 7f9c1effd640 1 --2- 172.21.15.2:0/1119198219 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556fb5df23b0 0x556fb5df47a0 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ab756590a2fe460 server_cookie=3caae9067ea670e8 in_seq=0 out_seq=0 2024-09-19T06:24:28.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.905+0000 7f9bfeffd640 1 -- 172.21.15.2:0/1119198219 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556fb5cd5d70 con 0x556fb5df23b0 2024-09-19T06:24:28.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.905+0000 7f9bfeffd640 10 client.18909 handle_command_reply: tid=0 2024-09-19T06:24:28.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.905+0000 7f9c27f27740 1 client.18909 shutdown 2024-09-19T06:24:28.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.905+0000 7f9c27f27740 1 -- 172.21.15.2:0/1119198219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fb5d69b40 msgr2=0x556fb5d71030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:28.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.905+0000 7f9c27f27740 1 --2- 172.21.15.2:0/1119198219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fb5d69b40 0x556fb5d71030 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f9c1000b4f0 tx=0x7f9c100195a0 comp rx=0 tx=0).stop 2024-09-19T06:24:28.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.905+0000 7f9c27f27740 1 -- 172.21.15.2:0/1119198219 shutdown_connections 2024-09-19T06:24:28.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.905+0000 7f9c27f27740 1 --2- 172.21.15.2:0/1119198219 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556fb5d77780 0x556fb5d71570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:28.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.905+0000 7f9c27f27740 1 --2- 172.21.15.2:0/1119198219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556fb5d69b40 0x556fb5d71030 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:28.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.905+0000 7f9c27f27740 1 --2- 172.21.15.2:0/1119198219 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x556fb5df23b0 0x556fb5df47a0 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:28.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.905+0000 7f9c27f27740 1 --2- 172.21.15.2:0/1119198219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556fb5d685d0 0x556fb5d7fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:28.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.905+0000 7f9c27f27740 1 -- 172.21.15.2:0/1119198219 >> 172.21.15.2:0/1119198219 conn(0x556fb5d31310 msgr2=0x556fb5d728a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:28.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.905+0000 7f9bfeffd640 0 client.18909 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:28.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.906+0000 7f9c27f27740 1 -- 172.21.15.2:0/1119198219 shutdown_connections 2024-09-19T06:24:28.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.906+0000 7f9c27f27740 1 -- 172.21.15.2:0/1119198219 wait complete. 2024-09-19T06:24:28.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.906+0000 7f9c27f27740 20 client.18909 trim_cache size 0 max 16384 2024-09-19T06:24:28.913 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:24:28.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.906+0000 7f9c25b4e640 1 -- 172.21.15.2:0/2326838001 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9c080a3430 msgr2=0x7f9c080a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:28.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.906+0000 7f9c25b4e640 1 --2- 172.21.15.2:0/2326838001 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9c080a3430 0x7f9c080a58f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9c180b9aa0 tx=0x7f9c1808ee50 comp rx=0 tx=0).stop 2024-09-19T06:24:28.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.906+0000 7f9c25b4e640 1 -- 172.21.15.2:0/2326838001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c201082a0 msgr2=0x7f9c2019cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:28.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.906+0000 7f9c25b4e640 1 --2- 172.21.15.2:0/2326838001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c201082a0 0x7f9c2019cdc0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f9c18005cc0 tx=0x7f9c18003c20 comp rx=0 tx=0).stop 2024-09-19T06:24:28.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.906+0000 7f9c25b4e640 1 -- 172.21.15.2:0/2326838001 shutdown_connections 2024-09-19T06:24:28.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.906+0000 7f9c25b4e640 1 --2- 172.21.15.2:0/2326838001 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9c080a3430 0x7f9c080a58f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:28.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.906+0000 7f9c25b4e640 1 --2- 172.21.15.2:0/2326838001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c201082a0 0x7f9c2019cdc0 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:28.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.906+0000 7f9c25b4e640 1 --2- 172.21.15.2:0/2326838001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c201036e0 0x7f9c20198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:28.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.906+0000 7f9c25b4e640 1 --2- 172.21.15.2:0/2326838001 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c20102d30 0x7f9c201984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:28.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.906+0000 7f9c25b4e640 1 -- 172.21.15.2:0/2326838001 >> 172.21.15.2:0/2326838001 conn(0x7f9c200fc7d0 msgr2=0x7f9c20105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:28.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.906+0000 7f9c25b4e640 1 -- 172.21.15.2:0/2326838001 shutdown_connections 2024-09-19T06:24:28.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:28.907+0000 7f9c25b4e640 1 -- 172.21.15.2:0/2326838001 wait complete. 2024-09-19T06:24:29.599 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:29 smithi002 ceph-mon[30982]: pgmap v301: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:24:29.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:29 smithi090 ceph-mon[34497]: pgmap v301: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:24:29.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:29 smithi089 ceph-mon[34160]: pgmap v301: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:24:30.630 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:24:30.630 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:24:30.900 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:24:31.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.388+0000 7f4a92662640 1 -- 172.21.15.2:0/1941147706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a8c10c590 msgr2=0x7f4a8c10c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:31.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.388+0000 7f4a92662640 1 --2- 172.21.15.2:0/1941147706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a8c10c590 0x7f4a8c10c9f0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f4a74009900 tx=0x7f4a7402a410 comp rx=0 tx=0).stop 2024-09-19T06:24:31.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.388+0000 7f4a92662640 1 -- 172.21.15.2:0/1941147706 shutdown_connections 2024-09-19T06:24:31.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.388+0000 7f4a92662640 1 --2- 172.21.15.2:0/1941147706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a8c10cf30 0x7f4a8c119410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.388+0000 7f4a92662640 1 --2- 172.21.15.2:0/1941147706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a8c10c590 0x7f4a8c10c9f0 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.388+0000 7f4a92662640 1 --2- 172.21.15.2:0/1941147706 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a8c112640 0x7f4a8c112a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.388+0000 7f4a92662640 1 -- 172.21.15.2:0/1941147706 >> 172.21.15.2:0/1941147706 conn(0x7f4a8c06cdc0 msgr2=0x7f4a8c06d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:31.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.388+0000 7f4a92662640 1 -- 172.21.15.2:0/1941147706 shutdown_connections 2024-09-19T06:24:31.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.388+0000 7f4a92662640 1 -- 172.21.15.2:0/1941147706 wait complete. 2024-09-19T06:24:31.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.389+0000 7f4a92662640 1 Processor -- start 2024-09-19T06:24:31.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.389+0000 7f4a92662640 1 -- start start 2024-09-19T06:24:31.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.389+0000 7f4a92662640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a8c10c590 0x7f4a8c1a2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:31.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.389+0000 7f4a92662640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a8c10cf30 0x7f4a8c1a3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:31.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.389+0000 7f4a92662640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a8c112640 0x7f4a8c1a75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:31.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.389+0000 7f4a92662640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8c11c850 con 0x7f4a8c10c590 2024-09-19T06:24:31.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.389+0000 7f4a92662640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8c11c6d0 con 0x7f4a8c112640 2024-09-19T06:24:31.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.389+0000 7f4a92662640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8c11c9d0 con 0x7f4a8c10cf30 2024-09-19T06:24:31.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.389+0000 7f4a8bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a8c10c590 0x7f4a8c1a2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:31.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.389+0000 7f4a8bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a8c10c590 0x7f4a8c1a2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55048/0 (socket says 172.21.15.2:55048) 2024-09-19T06:24:31.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.389+0000 7f4a8bfff640 1 -- 172.21.15.2:0/2440159786 learned_addr learned my addr 172.21.15.2:0/2440159786 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:31.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.389+0000 7f4a83fff640 1 --2- 172.21.15.2:0/2440159786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a8c10cf30 0x7f4a8c1a3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:31.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.389+0000 7f4a90bff640 1 --2- 172.21.15.2:0/2440159786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a8c112640 0x7f4a8c1a75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:31.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.390+0000 7f4a8bfff640 1 -- 172.21.15.2:0/2440159786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a8c10cf30 msgr2=0x7f4a8c1a3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:31.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.390+0000 7f4a8bfff640 1 --2- 172.21.15.2:0/2440159786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a8c10cf30 0x7f4a8c1a3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.390+0000 7f4a8bfff640 1 -- 172.21.15.2:0/2440159786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a8c112640 msgr2=0x7f4a8c1a75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:31.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.390+0000 7f4a8bfff640 1 --2- 172.21.15.2:0/2440159786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a8c112640 0x7f4a8c1a75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.390+0000 7f4a8bfff640 1 -- 172.21.15.2:0/2440159786 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a8c1a7cc0 con 0x7f4a8c10c590 2024-09-19T06:24:31.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.390+0000 7f4a90bff640 1 --2- 172.21.15.2:0/2440159786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a8c112640 0x7f4a8c1a75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:24:31.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.390+0000 7f4a8bfff640 1 --2- 172.21.15.2:0/2440159786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a8c10c590 0x7f4a8c1a2d10 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c00e9f0 tx=0x7f4a7c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:31.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.390+0000 7f4a89ffb640 1 -- 172.21.15.2:0/2440159786 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c00cd80 con 0x7f4a8c10c590 2024-09-19T06:24:31.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.390+0000 7f4a89ffb640 1 -- 172.21.15.2:0/2440159786 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4a7c0054d0 con 0x7f4a8c10c590 2024-09-19T06:24:31.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.390+0000 7f4a92662640 1 -- 172.21.15.2:0/2440159786 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a8c1a7fb0 con 0x7f4a8c10c590 2024-09-19T06:24:31.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.390+0000 7f4a89ffb640 1 -- 172.21.15.2:0/2440159786 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c010490 con 0x7f4a8c10c590 2024-09-19T06:24:31.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.390+0000 7f4a92662640 1 -- 172.21.15.2:0/2440159786 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a8c1af890 con 0x7f4a8c10c590 2024-09-19T06:24:31.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.392+0000 7f4a89ffb640 1 -- 172.21.15.2:0/2440159786 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f4a7c005020 con 0x7f4a8c10c590 2024-09-19T06:24:31.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.393+0000 7f4a94a3b740 1 Processor -- start 2024-09-19T06:24:31.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.393+0000 7f4a94a3b740 1 -- start start 2024-09-19T06:24:31.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.393+0000 7f4a94a3b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b86904ab60 0x55b86904af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:31.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.393+0000 7f4a94a3b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b86904b480 0x55b869055800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:31.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.393+0000 7f4a94a3b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b869055d40 0x55b869058130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:31.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.393+0000 7f4a94a3b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b868fb0280 con 0x55b869055d40 2024-09-19T06:24:31.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.393+0000 7f4a94a3b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55b868f57b10 con 0x55b86904ab60 2024-09-19T06:24:31.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.393+0000 7f4a94a3b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55b868fac240 con 0x55b86904b480 2024-09-19T06:24:31.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.393+0000 7f4a83fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b869055d40 0x55b869058130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:31.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.393+0000 7f4a83fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b869055d40 0x55b869058130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55064/0 (socket says 172.21.15.2:55064) 2024-09-19T06:24:31.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.393+0000 7f4a83fff640 1 -- 172.21.15.2:0/2957747826 learned_addr learned my addr 172.21.15.2:0/2957747826 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:31.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.393+0000 7f4a90bff640 1 --2- 172.21.15.2:0/2957747826 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b86904ab60 0x55b86904af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:31.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.393+0000 7f4a8bfff640 1 --2- 172.21.15.2:0/2957747826 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b86904b480 0x55b869055800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:31.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.393+0000 7f4a89ffb640 1 --2- 172.21.15.2:0/2440159786 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4a780a3430 0x7f4a780a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:31.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.394+0000 7f4a83fff640 1 -- 172.21.15.2:0/2957747826 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b86904b480 msgr2=0x55b869055800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:31.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.394+0000 7f4a83fff640 1 --2- 172.21.15.2:0/2957747826 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b86904b480 0x55b869055800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.394+0000 7f4a83fff640 1 -- 172.21.15.2:0/2957747826 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b86904ab60 msgr2=0x55b86904af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:31.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.394+0000 7f4a83fff640 1 --2- 172.21.15.2:0/2957747826 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b86904ab60 0x55b86904af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.394+0000 7f4a83fff640 1 -- 172.21.15.2:0/2957747826 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b868f641f0 con 0x55b869055d40 2024-09-19T06:24:31.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.394+0000 7f4a8bfff640 1 --2- 172.21.15.2:0/2957747826 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b86904b480 0x55b869055800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:24:31.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.394+0000 7f4a90bff640 1 --2- 172.21.15.2:0/2440159786 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4a780a3430 0x7f4a780a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:31.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.394+0000 7f4a89ffb640 1 -- 172.21.15.2:0/2440159786 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7f4a7c0d0110 con 0x7f4a8c10c590 2024-09-19T06:24:31.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.394+0000 7f4a83fff640 1 --2- 172.21.15.2:0/2957747826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b869055d40 0x55b869058130 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f4a74009900 tx=0x7f4a74005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7aa7a7c33f89b9c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:31.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.394+0000 7f4a827fc640 1 -- 172.21.15.2:0/2957747826 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a74040070 con 0x55b869055d40 2024-09-19T06:24:31.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.394+0000 7f4a90bff640 1 --2- 172.21.15.2:0/2440159786 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4a780a3430 0x7f4a780a58f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4a84005fd0 tx=0x7f4a84004a40 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:31.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.394+0000 7f4a827fc640 1 -- 172.21.15.2:0/2957747826 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4a74004030 con 0x55b869055d40 2024-09-19T06:24:31.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.394+0000 7f4a827fc640 1 -- 172.21.15.2:0/2957747826 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a74035040 con 0x55b869055d40 2024-09-19T06:24:31.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.395+0000 7f4a94a3b740 1 -- 172.21.15.2:0/2957747826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b869055d40 msgr2=0x55b869058130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:31.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.395+0000 7f4a94a3b740 1 --2- 172.21.15.2:0/2957747826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b869055d40 0x55b869058130 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f4a74009900 tx=0x7f4a74005c00 comp rx=0 tx=0).stop 2024-09-19T06:24:31.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.395+0000 7f4a94a3b740 1 -- 172.21.15.2:0/2957747826 shutdown_connections 2024-09-19T06:24:31.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.395+0000 7f4a94a3b740 1 --2- 172.21.15.2:0/2957747826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b869055d40 0x55b869058130 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.395+0000 7f4a94a3b740 1 --2- 172.21.15.2:0/2957747826 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b86904b480 0x55b869055800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.395+0000 7f4a94a3b740 1 --2- 172.21.15.2:0/2957747826 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b86904ab60 0x55b86904af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.395+0000 7f4a94a3b740 1 -- 172.21.15.2:0/2957747826 >> 172.21.15.2:0/2957747826 conn(0x55b8690470f0 msgr2=0x55b8690474d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:31.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.395+0000 7f4a94a3b740 1 -- 172.21.15.2:0/2957747826 shutdown_connections 2024-09-19T06:24:31.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.395+0000 7f4a94a3b740 1 -- 172.21.15.2:0/2957747826 wait complete. 2024-09-19T06:24:31.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.395+0000 7f4a94a3b740 1 -- start start 2024-09-19T06:24:31.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.396+0000 7f4a94a3b740 1 Processor -- start 2024-09-19T06:24:31.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.396+0000 7f4a94a3b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b86904ab60 0x55b869052bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:31.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.396+0000 7f4a94a3b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b86904b480 0x55b869053130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:31.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.396+0000 7f4a94a3b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b869055d40 0x55b869053670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:31.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.396+0000 7f4a94a3b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b869058910 con 0x55b86904b480 2024-09-19T06:24:31.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.396+0000 7f4a94a3b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55b868f6af10 con 0x55b86904ab60 2024-09-19T06:24:31.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.396+0000 7f4a94a3b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55b869058a90 con 0x55b869055d40 2024-09-19T06:24:31.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.396+0000 7f4a94a3b740 10 client.0 _ll_register_callbacks cb 0x55b868f33a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:31.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.396+0000 7f4a83fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b86904b480 0x55b869053130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:31.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.396+0000 7f4a83fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b86904b480 0x55b869053130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55078/0 (socket says 172.21.15.2:55078) 2024-09-19T06:24:31.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.396+0000 7f4a83fff640 1 -- 172.21.15.2:0/3130847697 learned_addr learned my addr 172.21.15.2:0/3130847697 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:31.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.396+0000 7f4a90bff640 1 --2- 172.21.15.2:0/3130847697 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b869055d40 0x55b869053670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:31.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.396+0000 7f4a8bfff640 1 --2- 172.21.15.2:0/3130847697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b86904ab60 0x55b869052bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:31.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.396+0000 7f4a83fff640 1 -- 172.21.15.2:0/3130847697 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b869055d40 msgr2=0x55b869053670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:31.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.396+0000 7f4a83fff640 1 --2- 172.21.15.2:0/3130847697 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b869055d40 0x55b869053670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.396+0000 7f4a83fff640 1 -- 172.21.15.2:0/3130847697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b86904ab60 msgr2=0x55b869052bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:31.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.396+0000 7f4a83fff640 1 --2- 172.21.15.2:0/3130847697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b86904ab60 0x55b869052bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.396+0000 7f4a83fff640 1 -- 172.21.15.2:0/3130847697 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b868d216a0 con 0x55b86904b480 2024-09-19T06:24:31.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.397+0000 7f4a8bfff640 1 --2- 172.21.15.2:0/3130847697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b86904ab60 0x55b869052bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:24:31.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.397+0000 7f4a83fff640 1 --2- 172.21.15.2:0/3130847697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b86904b480 0x55b869053130 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f4a74000c00 tx=0x7f4a740095f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6544aeeb6b5ec2b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:31.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.397+0000 7f4a6b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:24:31.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.397+0000 7f4a6b7fe640 1 -- 172.21.15.2:0/3130847697 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a74040030 con 0x55b86904b480 2024-09-19T06:24:31.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.397+0000 7f4a6b7fe640 1 -- 172.21.15.2:0/3130847697 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7f4a74031430 con 0x55b86904b480 2024-09-19T06:24:31.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.397+0000 7f4a94a3b740 1 -- 172.21.15.2:0/3130847697 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a74004030 con 0x55b86904b480 2024-09-19T06:24:31.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.397+0000 7f4a6b7fe640 1 -- 172.21.15.2:0/3130847697 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4a74035070 con 0x55b86904b480 2024-09-19T06:24:31.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.397+0000 7f4a94a3b740 10 client.18921 fetch_fsmap learned FSMap version 26 2024-09-19T06:24:31.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.397+0000 7f4a94a3b740 1 -- 172.21.15.2:0/3130847697 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b8690644e0 con 0x55b86904b480 2024-09-19T06:24:31.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.397+0000 7f4a6b7fe640 1 -- 172.21.15.2:0/3130847697 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4a74004030 con 0x55b86904b480 2024-09-19T06:24:31.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.397+0000 7f4a6b7fe640 1 -- 172.21.15.2:0/3130847697 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f4a740049b0 con 0x55b86904b480 2024-09-19T06:24:31.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.398+0000 7f4a94a3b740 10 client.18921 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:24:31.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.398+0000 7f4a94a3b740 10 client.18921 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:24:31.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.398+0000 7f4a94a3b740 20 client.18921 populate_metadata read hostname 'smithi002' 2024-09-19T06:24:31.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.398+0000 7f4a94a3b740 1 --2- 172.21.15.2:0/3130847697 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55b869065830 0x55b869067c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:31.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.398+0000 7f4a94a3b740 4 client.18921 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:24:31.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.398+0000 7f4a94a3b740 1 -- 172.21.15.2:0/3130847697 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b868fbd7f0 con 0x55b869065830 2024-09-19T06:24:31.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.398+0000 7f4a8bfff640 1 --2- 172.21.15.2:0/3130847697 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55b869065830 0x55b869067c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:31.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.398+0000 7f4a8bfff640 1 --2- 172.21.15.2:0/3130847697 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55b869065830 0x55b869067c20 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e2888a215a31779 server_cookie=93a44e62419d72f6 in_seq=0 out_seq=0 2024-09-19T06:24:31.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.398+0000 7f4a6b7fe640 10 client.18921 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:31.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.399+0000 7f4a6b7fe640 1 -- 172.21.15.2:0/3130847697 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b868fbd7f0 con 0x55b869065830 2024-09-19T06:24:31.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.399+0000 7f4a6b7fe640 10 client.18921 handle_command_reply: tid=0 2024-09-19T06:24:31.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.399+0000 7f4a94a3b740 1 client.18921 shutdown 2024-09-19T06:24:31.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.399+0000 7f4a94a3b740 1 -- 172.21.15.2:0/3130847697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b86904b480 msgr2=0x55b869053130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:31.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.399+0000 7f4a94a3b740 1 --2- 172.21.15.2:0/3130847697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b86904b480 0x55b869053130 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f4a74000c00 tx=0x7f4a740095f0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.399+0000 7f4a94a3b740 1 -- 172.21.15.2:0/3130847697 shutdown_connections 2024-09-19T06:24:31.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.399+0000 7f4a94a3b740 1 --2- 172.21.15.2:0/3130847697 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b869055d40 0x55b869053670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.399+0000 7f4a94a3b740 1 --2- 172.21.15.2:0/3130847697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b86904b480 0x55b869053130 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.399+0000 7f4a94a3b740 1 --2- 172.21.15.2:0/3130847697 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55b869065830 0x55b869067c20 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.399+0000 7f4a94a3b740 1 --2- 172.21.15.2:0/3130847697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b86904ab60 0x55b869052bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.399+0000 7f4a94a3b740 1 -- 172.21.15.2:0/3130847697 >> 172.21.15.2:0/3130847697 conn(0x55b8690470f0 msgr2=0x55b86904cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:31.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.399+0000 7f4a6b7fe640 0 client.18921 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:31.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.399+0000 7f4a94a3b740 1 -- 172.21.15.2:0/3130847697 shutdown_connections 2024-09-19T06:24:31.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.399+0000 7f4a94a3b740 1 -- 172.21.15.2:0/3130847697 wait complete. 2024-09-19T06:24:31.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.400+0000 7f4a94a3b740 20 client.18921 trim_cache size 0 max 16384 2024-09-19T06:24:31.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.419+0000 7f4a94a3b740 1 Processor -- start 2024-09-19T06:24:31.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.419+0000 7f4a94a3b740 1 -- start start 2024-09-19T06:24:31.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.420+0000 7f4a94a3b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b86904ab60 0x55b8690613f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:31.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.420+0000 7f4a94a3b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b86904b480 0x55b86906ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:31.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.420+0000 7f4a94a3b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b869055d40 0x55b86906b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:31.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.420+0000 7f4a94a3b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8c1baa20 con 0x55b869055d40 2024-09-19T06:24:31.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.420+0000 7f4a94a3b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8c1b82f0 con 0x55b86904b480 2024-09-19T06:24:31.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.420+0000 7f4a94a3b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8c1b6160 con 0x55b86904ab60 2024-09-19T06:24:31.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.420+0000 7f4a90bff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b869055d40 0x55b86906b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:31.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.420+0000 7f4a90bff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b869055d40 0x55b86906b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55092/0 (socket says 172.21.15.2:55092) 2024-09-19T06:24:31.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.420+0000 7f4a90bff640 1 -- 172.21.15.2:0/2747081587 learned_addr learned my addr 172.21.15.2:0/2747081587 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:31.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.420+0000 7f4a83fff640 1 --2- 172.21.15.2:0/2747081587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b86904b480 0x55b86906ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:31.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.420+0000 7f4a8bfff640 1 --2- 172.21.15.2:0/2747081587 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b86904ab60 0x55b8690613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:31.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.420+0000 7f4a90bff640 1 -- 172.21.15.2:0/2747081587 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b86904ab60 msgr2=0x55b8690613f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:31.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.420+0000 7f4a90bff640 1 --2- 172.21.15.2:0/2747081587 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b86904ab60 0x55b8690613f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.420+0000 7f4a90bff640 1 -- 172.21.15.2:0/2747081587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b86904b480 msgr2=0x55b86906ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:31.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.420+0000 7f4a90bff640 1 --2- 172.21.15.2:0/2747081587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b86904b480 0x55b86906ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.420+0000 7f4a90bff640 1 -- 172.21.15.2:0/2747081587 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8690554c0 con 0x55b869055d40 2024-09-19T06:24:31.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.420+0000 7f4a8bfff640 1 --2- 172.21.15.2:0/2747081587 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b86904ab60 0x55b8690613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:24:31.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.420+0000 7f4a90bff640 1 --2- 172.21.15.2:0/2747081587 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b869055d40 0x55b86906b180 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f4a840107f0 tx=0x7f4a84018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63f1b35a12a694c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:31.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.421+0000 7f4a81ffb640 1 -- 172.21.15.2:0/2747081587 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a8402c070 con 0x55b869055d40 2024-09-19T06:24:31.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.421+0000 7f4a81ffb640 1 -- 172.21.15.2:0/2747081587 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4a8401c930 con 0x55b869055d40 2024-09-19T06:24:31.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.421+0000 7f4a81ffb640 1 -- 172.21.15.2:0/2747081587 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a84027af0 con 0x55b869055d40 2024-09-19T06:24:31.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.421+0000 7f4a94a3b740 1 -- 172.21.15.2:0/2747081587 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b869055d40 msgr2=0x55b86906b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:31.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.421+0000 7f4a94a3b740 1 --2- 172.21.15.2:0/2747081587 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b869055d40 0x55b86906b180 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f4a840107f0 tx=0x7f4a84018000 comp rx=0 tx=0).stop 2024-09-19T06:24:31.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.421+0000 7f4a94a3b740 1 -- 172.21.15.2:0/2747081587 shutdown_connections 2024-09-19T06:24:31.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.421+0000 7f4a94a3b740 1 --2- 172.21.15.2:0/2747081587 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b869055d40 0x55b86906b180 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.421+0000 7f4a94a3b740 1 --2- 172.21.15.2:0/2747081587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b86904b480 0x55b86906ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.421+0000 7f4a94a3b740 1 --2- 172.21.15.2:0/2747081587 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b86904ab60 0x55b8690613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.421+0000 7f4a94a3b740 1 -- 172.21.15.2:0/2747081587 >> 172.21.15.2:0/2747081587 conn(0x55b8690470f0 msgr2=0x55b869060ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:31.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.421+0000 7f4a94a3b740 1 -- 172.21.15.2:0/2747081587 shutdown_connections 2024-09-19T06:24:31.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.421+0000 7f4a94a3b740 1 -- 172.21.15.2:0/2747081587 wait complete. 2024-09-19T06:24:31.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.422+0000 7f4a94a3b740 1 -- start start 2024-09-19T06:24:31.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.422+0000 7f4a94a3b740 1 Processor -- start 2024-09-19T06:24:31.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.422+0000 7f4a94a3b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b86904ab60 0x55b869068a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:31.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.422+0000 7f4a94a3b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b86904b480 0x55b869068f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:31.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.422+0000 7f4a94a3b740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b869055d40 0x55b8690694c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:31.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.422+0000 7f4a94a3b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8c1b67b0 con 0x55b86904b480 2024-09-19T06:24:31.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.422+0000 7f4a94a3b740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8c1b7c20 con 0x55b869055d40 2024-09-19T06:24:31.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.422+0000 7f4a94a3b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8c1b6e80 con 0x55b86904ab60 2024-09-19T06:24:31.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.422+0000 7f4a94a3b740 10 client.0 _ll_register_callbacks cb 0x7f4a840096a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:31.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.423+0000 7f4a83fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b86904b480 0x55b869068f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:31.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.423+0000 7f4a83fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b86904b480 0x55b869068f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55096/0 (socket says 172.21.15.2:55096) 2024-09-19T06:24:31.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.423+0000 7f4a83fff640 1 -- 172.21.15.2:0/134655155 learned_addr learned my addr 172.21.15.2:0/134655155 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:31.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.423+0000 7f4a90bff640 1 --2- 172.21.15.2:0/134655155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b869055d40 0x55b8690694c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:31.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.423+0000 7f4a8bfff640 1 --2- 172.21.15.2:0/134655155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b86904ab60 0x55b869068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:31.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.423+0000 7f4a83fff640 1 -- 172.21.15.2:0/134655155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b86904ab60 msgr2=0x55b869068a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:31.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.423+0000 7f4a83fff640 1 --2- 172.21.15.2:0/134655155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b86904ab60 0x55b869068a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.423+0000 7f4a83fff640 1 -- 172.21.15.2:0/134655155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b869055d40 msgr2=0x55b8690694c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:31.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.423+0000 7f4a83fff640 1 --2- 172.21.15.2:0/134655155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b869055d40 0x55b8690694c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.423+0000 7f4a83fff640 1 -- 172.21.15.2:0/134655155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8690cf1f0 con 0x55b86904b480 2024-09-19T06:24:31.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.423+0000 7f4a83fff640 1 --2- 172.21.15.2:0/134655155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b86904b480 0x55b869068f80 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f4a74009800 tx=0x7f4a74004970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61cc0597abd7d0da server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:31.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.423+0000 7f4a6b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:24:31.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.423+0000 7f4a6b7fe640 1 -- 172.21.15.2:0/134655155 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7405c030 con 0x55b86904b480 2024-09-19T06:24:31.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.423+0000 7f4a94a3b740 1 -- 172.21.15.2:0/134655155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a8401c930 con 0x55b86904b480 2024-09-19T06:24:31.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.423+0000 7f4a6b7fe640 1 -- 172.21.15.2:0/134655155 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7f4a7404a070 con 0x55b86904b480 2024-09-19T06:24:31.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.424+0000 7f4a6b7fe640 1 -- 172.21.15.2:0/134655155 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4a74066050 con 0x55b86904b480 2024-09-19T06:24:31.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.424+0000 7f4a94a3b740 10 client.18927 fetch_fsmap learned FSMap version 26 2024-09-19T06:24:31.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.424+0000 7f4a94a3b740 1 -- 172.21.15.2:0/134655155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b8690d0510 con 0x55b86904b480 2024-09-19T06:24:31.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.424+0000 7f4a6b7fe640 1 -- 172.21.15.2:0/134655155 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4a8401c930 con 0x55b86904b480 2024-09-19T06:24:31.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.424+0000 7f4a6b7fe640 1 -- 172.21.15.2:0/134655155 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f4a740576b0 con 0x55b86904b480 2024-09-19T06:24:31.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.424+0000 7f4a94a3b740 10 client.18927 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:24:31.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.424+0000 7f4a94a3b740 10 client.18927 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:24:31.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.424+0000 7f4a94a3b740 20 client.18927 populate_metadata read hostname 'smithi002' 2024-09-19T06:24:31.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.424+0000 7f4a94a3b740 1 --2- 172.21.15.2:0/134655155 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55b8690d0bf0 0x55b8690d3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:31.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.424+0000 7f4a94a3b740 4 client.18927 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:24:31.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.424+0000 7f4a94a3b740 1 -- 172.21.15.2:0/134655155 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b868fb7d00 con 0x55b8690d0bf0 2024-09-19T06:24:31.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.424+0000 7f4a8bfff640 1 --2- 172.21.15.2:0/134655155 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55b8690d0bf0 0x55b8690d3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:31.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.425+0000 7f4a8bfff640 1 --2- 172.21.15.2:0/134655155 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55b8690d0bf0 0x55b8690d3010 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b8ef8eb00b58908 server_cookie=a90ed6e5f6448b16 in_seq=0 out_seq=0 2024-09-19T06:24:31.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.425+0000 7f4a6b7fe640 10 client.18927 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:31.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.425+0000 7f4a6b7fe640 1 -- 172.21.15.2:0/134655155 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b868fb7d00 con 0x55b8690d0bf0 2024-09-19T06:24:31.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.426+0000 7f4a6b7fe640 10 client.18927 handle_command_reply: tid=0 2024-09-19T06:24:31.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.426+0000 7f4a94a3b740 1 client.18927 shutdown 2024-09-19T06:24:31.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.426+0000 7f4a94a3b740 1 -- 172.21.15.2:0/134655155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b86904b480 msgr2=0x55b869068f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:31.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.426+0000 7f4a94a3b740 1 --2- 172.21.15.2:0/134655155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b86904b480 0x55b869068f80 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f4a74009800 tx=0x7f4a74004970 comp rx=0 tx=0).stop 2024-09-19T06:24:31.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.426+0000 7f4a94a3b740 1 -- 172.21.15.2:0/134655155 shutdown_connections 2024-09-19T06:24:31.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.426+0000 7f4a94a3b740 1 --2- 172.21.15.2:0/134655155 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55b8690d0bf0 0x55b8690d3010 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.426+0000 7f4a94a3b740 1 --2- 172.21.15.2:0/134655155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b869055d40 0x55b8690694c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.426+0000 7f4a94a3b740 1 --2- 172.21.15.2:0/134655155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b86904b480 0x55b869068f80 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.426+0000 7f4a94a3b740 1 --2- 172.21.15.2:0/134655155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b86904ab60 0x55b869068a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.426+0000 7f4a6b7fe640 0 client.18927 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:31.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.426+0000 7f4a94a3b740 1 -- 172.21.15.2:0/134655155 >> 172.21.15.2:0/134655155 conn(0x55b8690470f0 msgr2=0x55b869046270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:31.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.426+0000 7f4a94a3b740 1 -- 172.21.15.2:0/134655155 shutdown_connections 2024-09-19T06:24:31.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.426+0000 7f4a94a3b740 1 -- 172.21.15.2:0/134655155 wait complete. 2024-09-19T06:24:31.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.426+0000 7f4a94a3b740 20 client.18927 trim_cache size 0 max 16384 2024-09-19T06:24:31.432 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:24:31.433 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-09-19T06:24:31.433 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "7a8e6393-a1a4-4131-ab17-01c8d20c67d2", 2024-09-19T06:24:31.433 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-09-19T06:24:31.433 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:24:31.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.427+0000 7f4a92662640 1 -- 172.21.15.2:0/2440159786 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4a780a3430 msgr2=0x7f4a780a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:31.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.427+0000 7f4a92662640 1 --2- 172.21.15.2:0/2440159786 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4a780a3430 0x7f4a780a58f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4a84005fd0 tx=0x7f4a84004a40 comp rx=0 tx=0).stop 2024-09-19T06:24:31.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.427+0000 7f4a92662640 1 -- 172.21.15.2:0/2440159786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a8c10c590 msgr2=0x7f4a8c1a2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:31.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.427+0000 7f4a92662640 1 --2- 172.21.15.2:0/2440159786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a8c10c590 0x7f4a8c1a2d10 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c00e9f0 tx=0x7f4a7c00edf0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.427+0000 7f4a92662640 1 -- 172.21.15.2:0/2440159786 shutdown_connections 2024-09-19T06:24:31.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.427+0000 7f4a92662640 1 --2- 172.21.15.2:0/2440159786 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4a780a3430 0x7f4a780a58f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.427+0000 7f4a92662640 1 --2- 172.21.15.2:0/2440159786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a8c112640 0x7f4a8c1a75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.427+0000 7f4a92662640 1 --2- 172.21.15.2:0/2440159786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a8c10cf30 0x7f4a8c1a3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.427+0000 7f4a92662640 1 --2- 172.21.15.2:0/2440159786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a8c10c590 0x7f4a8c1a2d10 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.427+0000 7f4a92662640 1 -- 172.21.15.2:0/2440159786 >> 172.21.15.2:0/2440159786 conn(0x7f4a8c06cdc0 msgr2=0x7f4a8c10af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:31.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.427+0000 7f4a92662640 1 -- 172.21.15.2:0/2440159786 shutdown_connections 2024-09-19T06:24:31.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:31.427+0000 7f4a92662640 1 -- 172.21.15.2:0/2440159786 wait complete. 2024-09-19T06:24:31.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:31 smithi002 ceph-mon[30982]: pgmap v302: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:24:31.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:31 smithi090 ceph-mon[34497]: pgmap v302: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:24:31.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:31 smithi089 ceph-mon[34160]: pgmap v302: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:24:32.149 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:24:32.411 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:24:32.665 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:32 smithi002 ceph-mon[30982]: scrub queued for path: / 2024-09-19T06:24:32.665 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:32 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:24:32.665 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:32 smithi002 ceph-mon[30982]: scrub summary: active paths [/] 2024-09-19T06:24:32.666 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:32 smithi002 ceph-mon[30982]: scrub summary: idle+waiting paths [/] 2024-09-19T06:24:32.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:32 smithi090 ceph-mon[34497]: scrub queued for path: / 2024-09-19T06:24:32.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:32 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:24:32.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:32 smithi090 ceph-mon[34497]: scrub summary: active paths [/] 2024-09-19T06:24:32.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:32 smithi090 ceph-mon[34497]: scrub summary: idle+waiting paths [/] 2024-09-19T06:24:32.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:32 smithi089 ceph-mon[34160]: scrub queued for path: / 2024-09-19T06:24:32.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:32 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:24:32.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:32 smithi089 ceph-mon[34160]: scrub summary: active paths [/] 2024-09-19T06:24:32.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:32 smithi089 ceph-mon[34160]: scrub summary: idle+waiting paths [/] 2024-09-19T06:24:32.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.860+0000 7f85b6431640 1 -- 172.21.15.2:0/2704906533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85b0106f10 msgr2=0x7f85b010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:32.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.860+0000 7f85b6431640 1 --2- 172.21.15.2:0/2704906533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85b0106f10 0x7f85b010ea90 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f85a8009ca0 tx=0x7f85a802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:24:32.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.860+0000 7f85b6431640 1 -- 172.21.15.2:0/2704906533 shutdown_connections 2024-09-19T06:24:32.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.860+0000 7f85b6431640 1 --2- 172.21.15.2:0/2704906533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85b0106f10 0x7f85b010ea90 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:32.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.860+0000 7f85b6431640 1 --2- 172.21.15.2:0/2704906533 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85b0102790 0x7f85b01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:32.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.860+0000 7f85b6431640 1 --2- 172.21.15.2:0/2704906533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85b0101de0 0x7f85b01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:32.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.860+0000 7f85b6431640 1 -- 172.21.15.2:0/2704906533 >> 172.21.15.2:0/2704906533 conn(0x7f85b00fd8c0 msgr2=0x7f85b00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:32.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.861+0000 7f85b6431640 1 -- 172.21.15.2:0/2704906533 shutdown_connections 2024-09-19T06:24:32.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.861+0000 7f85b6431640 1 -- 172.21.15.2:0/2704906533 wait complete. 2024-09-19T06:24:32.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.861+0000 7f85b6431640 1 Processor -- start 2024-09-19T06:24:32.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.861+0000 7f85b6431640 1 -- start start 2024-09-19T06:24:32.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.862+0000 7f85b6431640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85b0101de0 0x7f85b01982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:32.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.862+0000 7f85b6431640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85b0102790 0x7f85b0198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:32.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.862+0000 7f85b6431640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85b0106f10 0x7f85b019cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:32.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.862+0000 7f85b6431640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f85b0111e20 con 0x7f85b0101de0 2024-09-19T06:24:32.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.862+0000 7f85b6431640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f85b0111ca0 con 0x7f85b0102790 2024-09-19T06:24:32.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.862+0000 7f85b6431640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f85b0111fa0 con 0x7f85b0106f10 2024-09-19T06:24:32.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.862+0000 7f85affff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85b0101de0 0x7f85b01982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:32.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.862+0000 7f85affff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85b0101de0 0x7f85b01982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55124/0 (socket says 172.21.15.2:55124) 2024-09-19T06:24:32.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.862+0000 7f85affff640 1 -- 172.21.15.2:0/1854791580 learned_addr learned my addr 172.21.15.2:0/1854791580 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:32.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.862+0000 7f85af7fe640 1 --2- 172.21.15.2:0/1854791580 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85b0102790 0x7f85b0198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:32.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.862+0000 7f85b49ce640 1 --2- 172.21.15.2:0/1854791580 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85b0106f10 0x7f85b019cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:32.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.862+0000 7f85affff640 1 -- 172.21.15.2:0/1854791580 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85b0106f10 msgr2=0x7f85b019cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:32.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.862+0000 7f85affff640 1 --2- 172.21.15.2:0/1854791580 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85b0106f10 0x7f85b019cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:32.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.862+0000 7f85affff640 1 -- 172.21.15.2:0/1854791580 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85b0102790 msgr2=0x7f85b0198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:32.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.862+0000 7f85affff640 1 --2- 172.21.15.2:0/1854791580 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85b0102790 0x7f85b0198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:32.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.862+0000 7f85affff640 1 -- 172.21.15.2:0/1854791580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85b019d2a0 con 0x7f85b0101de0 2024-09-19T06:24:32.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.862+0000 7f85affff640 1 --2- 172.21.15.2:0/1854791580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85b0101de0 0x7f85b01982f0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f85a000e9f0 tx=0x7f85a000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:32.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.862+0000 7f85ad7fa640 1 -- 172.21.15.2:0/1854791580 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a000cd80 con 0x7f85b0101de0 2024-09-19T06:24:32.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.863+0000 7f85b6431640 1 -- 172.21.15.2:0/1854791580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85b019d590 con 0x7f85b0101de0 2024-09-19T06:24:32.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.863+0000 7f85ad7fa640 1 -- 172.21.15.2:0/1854791580 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f85a00108e0 con 0x7f85b0101de0 2024-09-19T06:24:32.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.863+0000 7f85ad7fa640 1 -- 172.21.15.2:0/1854791580 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a0018920 con 0x7f85b0101de0 2024-09-19T06:24:32.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.863+0000 7f85b6431640 1 -- 172.21.15.2:0/1854791580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85b01a4e70 con 0x7f85b0101de0 2024-09-19T06:24:32.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.865+0000 7f85ad7fa640 1 -- 172.21.15.2:0/1854791580 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f85a0010a90 con 0x7f85b0101de0 2024-09-19T06:24:32.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.865+0000 7f85b880a740 1 Processor -- start 2024-09-19T06:24:32.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.865+0000 7f85b880a740 1 -- start start 2024-09-19T06:24:32.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.865+0000 7f85b880a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558489d994a0 0x558489d99880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:32.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.865+0000 7f85b880a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558489d99dc0 0x558489da4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:32.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.865+0000 7f85b880a740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558489da4680 0x558489da6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:32.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.865+0000 7f85b880a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558489cff2e0 con 0x558489d994a0 2024-09-19T06:24:32.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.865+0000 7f85b880a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x558489ca6ce0 con 0x558489d99dc0 2024-09-19T06:24:32.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.865+0000 7f85b880a740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x558489cfb2a0 con 0x558489da4680 2024-09-19T06:24:32.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.865+0000 7f85b49ce640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558489d994a0 0x558489d99880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:32.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.866+0000 7f85b49ce640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558489d994a0 0x558489d99880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55134/0 (socket says 172.21.15.2:55134) 2024-09-19T06:24:32.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.866+0000 7f85b49ce640 1 -- 172.21.15.2:0/3993732471 learned_addr learned my addr 172.21.15.2:0/3993732471 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:32.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.866+0000 7f85ad7fa640 1 --2- 172.21.15.2:0/1854791580 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f85980a3430 0x7f85980a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:32.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.866+0000 7f85affff640 1 --2- 172.21.15.2:0/3993732471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558489d99dc0 0x558489da4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:32.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.866+0000 7f85b49ce640 1 --2- 172.21.15.2:0/1854791580 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f85980a3430 0x7f85980a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:32.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.866+0000 7f85af7fe640 1 --2- 172.21.15.2:0/3993732471 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558489da4680 0x558489da6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:32.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.866+0000 7f85b49ce640 1 -- 172.21.15.2:0/3993732471 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558489da4680 msgr2=0x558489da6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:32.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.866+0000 7f85b49ce640 1 --2- 172.21.15.2:0/3993732471 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558489da4680 0x558489da6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:32.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.866+0000 7f85b49ce640 1 -- 172.21.15.2:0/3993732471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558489d99dc0 msgr2=0x558489da4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:32.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.866+0000 7f85b49ce640 1 --2- 172.21.15.2:0/3993732471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558489d99dc0 0x558489da4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:32.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.866+0000 7f85b49ce640 1 -- 172.21.15.2:0/3993732471 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558489c8b440 con 0x558489d994a0 2024-09-19T06:24:32.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.866+0000 7f85ad7fa640 1 -- 172.21.15.2:0/1854791580 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7f85a00cff90 con 0x7f85b0101de0 2024-09-19T06:24:32.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.866+0000 7f85b49ce640 1 --2- 172.21.15.2:0/3993732471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558489d994a0 0x558489d99880 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f85a8004af0 tx=0x7f85a8031ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba7df0df5aaccb97 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:32.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.866+0000 7f85967fc640 1 -- 172.21.15.2:0/3993732471 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a8003d40 con 0x558489d994a0 2024-09-19T06:24:32.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.866+0000 7f85967fc640 1 -- 172.21.15.2:0/3993732471 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f85a8036070 con 0x558489d994a0 2024-09-19T06:24:32.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.867+0000 7f85b880a740 1 -- 172.21.15.2:0/3993732471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558489d994a0 msgr2=0x558489d99880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:32.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.867+0000 7f85b49ce640 1 --2- 172.21.15.2:0/1854791580 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f85980a3430 0x7f85980a58f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f85a804e000 tx=0x7f85a804c000 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:32.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.867+0000 7f85b880a740 1 --2- 172.21.15.2:0/3993732471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558489d994a0 0x558489d99880 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f85a8004af0 tx=0x7f85a8031ef0 comp rx=0 tx=0).stop 2024-09-19T06:24:32.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.867+0000 7f85b880a740 1 -- 172.21.15.2:0/3993732471 shutdown_connections 2024-09-19T06:24:32.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.867+0000 7f85b880a740 1 --2- 172.21.15.2:0/3993732471 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558489da4680 0x558489da6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:32.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.867+0000 7f85b880a740 1 --2- 172.21.15.2:0/3993732471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558489d99dc0 0x558489da4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:32.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.867+0000 7f85b880a740 1 --2- 172.21.15.2:0/3993732471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558489d994a0 0x558489d99880 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:32.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.867+0000 7f85b880a740 1 -- 172.21.15.2:0/3993732471 >> 172.21.15.2:0/3993732471 conn(0x558489d95a30 msgr2=0x558489d95e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:32.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.867+0000 7f85b880a740 1 -- 172.21.15.2:0/3993732471 shutdown_connections 2024-09-19T06:24:32.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.867+0000 7f85b880a740 1 -- 172.21.15.2:0/3993732471 wait complete. 2024-09-19T06:24:32.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.868+0000 7f85b880a740 1 -- start start 2024-09-19T06:24:32.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.868+0000 7f85b880a740 1 Processor -- start 2024-09-19T06:24:32.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.868+0000 7f85b880a740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558489d994a0 0x558489da3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:32.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.868+0000 7f85b880a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558489d99dc0 0x558489da1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:32.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.868+0000 7f85b880a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558489da4680 0x558489da16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:32.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.868+0000 7f85b880a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558489dab4e0 con 0x558489da4680 2024-09-19T06:24:32.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.868+0000 7f85b880a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x558489cba050 con 0x558489d99dc0 2024-09-19T06:24:32.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.868+0000 7f85b880a740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x558489dab660 con 0x558489d994a0 2024-09-19T06:24:32.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.868+0000 7f85b880a740 10 client.0 _ll_register_callbacks cb 0x558489cfa160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:32.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.868+0000 7f85b49ce640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558489da4680 0x558489da16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:32.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.868+0000 7f85b49ce640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558489da4680 0x558489da16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55140/0 (socket says 172.21.15.2:55140) 2024-09-19T06:24:32.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.868+0000 7f85b49ce640 1 -- 172.21.15.2:0/3147950374 learned_addr learned my addr 172.21.15.2:0/3147950374 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:32.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.869+0000 7f85af7fe640 1 --2- 172.21.15.2:0/3147950374 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558489d99dc0 0x558489da1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:32.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.869+0000 7f85affff640 1 --2- 172.21.15.2:0/3147950374 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558489d994a0 0x558489da3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:32.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.869+0000 7f85b49ce640 1 -- 172.21.15.2:0/3147950374 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558489d994a0 msgr2=0x558489da3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:32.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.869+0000 7f85b49ce640 1 --2- 172.21.15.2:0/3147950374 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558489d994a0 0x558489da3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:32.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.869+0000 7f85b49ce640 1 -- 172.21.15.2:0/3147950374 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558489d99dc0 msgr2=0x558489da1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:32.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.869+0000 7f85b49ce640 1 --2- 172.21.15.2:0/3147950374 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558489d99dc0 0x558489da1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:32.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.869+0000 7f85b49ce640 1 -- 172.21.15.2:0/3147950374 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558489a703c0 con 0x558489da4680 2024-09-19T06:24:32.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.869+0000 7f85b49ce640 1 --2- 172.21.15.2:0/3147950374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558489da4680 0x558489da16c0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f85a802ade0 tx=0x7f85a802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1b0761009700a43 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:32.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.869+0000 7f858f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:24:32.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.869+0000 7f858f7fe640 1 -- 172.21.15.2:0/3147950374 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a8031b00 con 0x558489da4680 2024-09-19T06:24:32.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.869+0000 7f858f7fe640 1 -- 172.21.15.2:0/3147950374 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7f85a8004b40 con 0x558489da4680 2024-09-19T06:24:32.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.869+0000 7f85b880a740 1 -- 172.21.15.2:0/3147950374 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85a8036070 con 0x558489da4680 2024-09-19T06:24:32.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.869+0000 7f858f7fe640 1 -- 172.21.15.2:0/3147950374 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f85a8004d40 con 0x558489da4680 2024-09-19T06:24:32.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.869+0000 7f85b880a740 10 client.18939 fetch_fsmap learned FSMap version 26 2024-09-19T06:24:32.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.869+0000 7f85b880a740 1 -- 172.21.15.2:0/3147950374 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x558489dab4e0 con 0x558489da4680 2024-09-19T06:24:32.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.870+0000 7f858f7fe640 1 -- 172.21.15.2:0/3147950374 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f85a8036070 con 0x558489da4680 2024-09-19T06:24:32.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.870+0000 7f858f7fe640 1 -- 172.21.15.2:0/3147950374 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f85a8066780 con 0x558489da4680 2024-09-19T06:24:32.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.870+0000 7f85b880a740 10 client.18939 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:24:32.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.870+0000 7f85b880a740 10 client.18939 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:24:32.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.870+0000 7f85b880a740 20 client.18939 populate_metadata read hostname 'smithi002' 2024-09-19T06:24:32.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.870+0000 7f85b880a740 1 --2- 172.21.15.2:0/3147950374 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558489db8070 0x558489dba460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:32.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.870+0000 7f85b880a740 4 client.18939 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:24:32.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.870+0000 7f85b880a740 1 -- 172.21.15.2:0/3147950374 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558489d0c850 con 0x558489db8070 2024-09-19T06:24:32.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.870+0000 7f85affff640 1 --2- 172.21.15.2:0/3147950374 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558489db8070 0x558489dba460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:32.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.870+0000 7f85affff640 1 --2- 172.21.15.2:0/3147950374 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558489db8070 0x558489dba460 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b6be89a4538ba5a server_cookie=a6fd1d074b07b180 in_seq=0 out_seq=0 2024-09-19T06:24:32.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.870+0000 7f858f7fe640 10 client.18939 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:32.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.871+0000 7f858f7fe640 1 -- 172.21.15.2:0/3147950374 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558489d0c850 con 0x558489db8070 2024-09-19T06:24:32.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.871+0000 7f858f7fe640 10 client.18939 handle_command_reply: tid=0 2024-09-19T06:24:32.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.871+0000 7f85b880a740 1 client.18939 shutdown 2024-09-19T06:24:32.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.871+0000 7f85b880a740 1 -- 172.21.15.2:0/3147950374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558489da4680 msgr2=0x558489da16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:32.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.871+0000 7f85b880a740 1 --2- 172.21.15.2:0/3147950374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558489da4680 0x558489da16c0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f85a802ade0 tx=0x7f85a802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:24:32.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.871+0000 7f85b880a740 1 -- 172.21.15.2:0/3147950374 shutdown_connections 2024-09-19T06:24:32.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.871+0000 7f85b880a740 1 --2- 172.21.15.2:0/3147950374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558489da4680 0x558489da16c0 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:32.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.871+0000 7f85b880a740 1 --2- 172.21.15.2:0/3147950374 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558489db8070 0x558489dba460 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:32.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.871+0000 7f85b880a740 1 --2- 172.21.15.2:0/3147950374 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558489d99dc0 0x558489da1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:32.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.871+0000 7f85b880a740 1 --2- 172.21.15.2:0/3147950374 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558489d994a0 0x558489da3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:32.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.871+0000 7f858f7fe640 0 client.18939 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:32.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.871+0000 7f85b880a740 1 -- 172.21.15.2:0/3147950374 >> 172.21.15.2:0/3147950374 conn(0x558489d95a30 msgr2=0x558489d94b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:32.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.871+0000 7f85b880a740 1 -- 172.21.15.2:0/3147950374 shutdown_connections 2024-09-19T06:24:32.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.871+0000 7f85b880a740 1 -- 172.21.15.2:0/3147950374 wait complete. 2024-09-19T06:24:32.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.872+0000 7f85b880a740 20 client.18939 trim_cache size 0 max 16384 2024-09-19T06:24:32.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.889+0000 7f85b880a740 1 Processor -- start 2024-09-19T06:24:32.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.889+0000 7f85b880a740 1 -- start start 2024-09-19T06:24:32.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.889+0000 7f85b880a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558489d994a0 0x558489daade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:32.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.889+0000 7f85b880a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558489d99dc0 0x558489da29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:32.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.889+0000 7f85b880a740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558489da4680 0x558489dbfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:32.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.889+0000 7f85b880a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f85b01adf30 con 0x558489d994a0 2024-09-19T06:24:32.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.889+0000 7f85b880a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f85b01ab800 con 0x558489d99dc0 2024-09-19T06:24:32.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.889+0000 7f85b880a740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f85b01a9670 con 0x558489da4680 2024-09-19T06:24:32.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.889+0000 7f85affff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558489d994a0 0x558489daade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:32.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.889+0000 7f85affff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558489d994a0 0x558489daade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55150/0 (socket says 172.21.15.2:55150) 2024-09-19T06:24:32.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.889+0000 7f85affff640 1 -- 172.21.15.2:0/3243903323 learned_addr learned my addr 172.21.15.2:0/3243903323 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:32.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.889+0000 7f85affff640 1 -- 172.21.15.2:0/3243903323 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558489da4680 msgr2=0x558489dbfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:32.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.889+0000 7f85af7fe640 1 --2- 172.21.15.2:0/3243903323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558489d99dc0 0x558489da29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:32.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.889+0000 7f85b49ce640 1 --2- 172.21.15.2:0/3243903323 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558489da4680 0x558489dbfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:32.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.889+0000 7f85affff640 1 --2- 172.21.15.2:0/3243903323 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558489da4680 0x558489dbfd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:32.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.889+0000 7f85affff640 1 -- 172.21.15.2:0/3243903323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558489d99dc0 msgr2=0x558489da29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:32.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.889+0000 7f85affff640 1 --2- 172.21.15.2:0/3243903323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558489d99dc0 0x558489da29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:32.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.889+0000 7f85affff640 1 -- 172.21.15.2:0/3243903323 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558489da3890 con 0x558489d994a0 2024-09-19T06:24:32.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.889+0000 7f85af7fe640 1 --2- 172.21.15.2:0/3243903323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558489d99dc0 0x558489da29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:24:32.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.889+0000 7f85affff640 1 --2- 172.21.15.2:0/3243903323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558489d994a0 0x558489daade0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f85a00cd740 tx=0x7f85a00bc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e25f6f7d45a6eb78 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:32.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.890+0000 7f8595ffb640 1 -- 172.21.15.2:0/3243903323 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a009a620 con 0x558489d994a0 2024-09-19T06:24:32.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.890+0000 7f8595ffb640 1 -- 172.21.15.2:0/3243903323 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f85a00cd960 con 0x558489d994a0 2024-09-19T06:24:32.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.890+0000 7f8595ffb640 1 -- 172.21.15.2:0/3243903323 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a00bc0b0 con 0x558489d994a0 2024-09-19T06:24:32.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.890+0000 7f85b880a740 1 -- 172.21.15.2:0/3243903323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558489d994a0 msgr2=0x558489daade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:32.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.890+0000 7f85b880a740 1 --2- 172.21.15.2:0/3243903323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558489d994a0 0x558489daade0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f85a00cd740 tx=0x7f85a00bc040 comp rx=0 tx=0).stop 2024-09-19T06:24:32.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.890+0000 7f85b880a740 1 -- 172.21.15.2:0/3243903323 shutdown_connections 2024-09-19T06:24:32.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.890+0000 7f85b880a740 1 --2- 172.21.15.2:0/3243903323 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558489da4680 0x558489dbfd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:32.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.890+0000 7f85b880a740 1 --2- 172.21.15.2:0/3243903323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558489d99dc0 0x558489da29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:32.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.890+0000 7f85b880a740 1 --2- 172.21.15.2:0/3243903323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558489d994a0 0x558489daade0 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:32.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.890+0000 7f85b880a740 1 -- 172.21.15.2:0/3243903323 >> 172.21.15.2:0/3243903323 conn(0x558489d95a30 msgr2=0x558489d94b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:32.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.890+0000 7f85b880a740 1 -- 172.21.15.2:0/3243903323 shutdown_connections 2024-09-19T06:24:32.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.890+0000 7f85b880a740 1 -- 172.21.15.2:0/3243903323 wait complete. 2024-09-19T06:24:32.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.891+0000 7f85b880a740 1 -- start start 2024-09-19T06:24:32.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.891+0000 7f85b880a740 1 Processor -- start 2024-09-19T06:24:32.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.891+0000 7f85b880a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558489d994a0 0x558489db1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:32.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.891+0000 7f85b880a740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558489d99dc0 0x558489da9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:32.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.891+0000 7f85b880a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558489da4680 0x558489daa6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:32.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.891+0000 7f85b880a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f85b01a9cc0 con 0x558489da4680 2024-09-19T06:24:32.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.891+0000 7f85b880a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f85b01ab130 con 0x558489d994a0 2024-09-19T06:24:32.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.891+0000 7f85b880a740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f85b01aa390 con 0x558489d99dc0 2024-09-19T06:24:32.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.891+0000 7f85b49ce640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558489da4680 0x558489daa6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:32.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.891+0000 7f85b880a740 10 client.0 _ll_register_callbacks cb 0x7f85a009c0f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:32.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.891+0000 7f85b49ce640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558489da4680 0x558489daa6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55158/0 (socket says 172.21.15.2:55158) 2024-09-19T06:24:32.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.891+0000 7f85b49ce640 1 -- 172.21.15.2:0/3000002579 learned_addr learned my addr 172.21.15.2:0/3000002579 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:32.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.891+0000 7f85af7fe640 1 --2- 172.21.15.2:0/3000002579 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558489d99dc0 0x558489da9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:32.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.892+0000 7f85affff640 1 --2- 172.21.15.2:0/3000002579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558489d994a0 0x558489db1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:32.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.892+0000 7f85b49ce640 1 -- 172.21.15.2:0/3000002579 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558489d99dc0 msgr2=0x558489da9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:32.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.892+0000 7f85b49ce640 1 --2- 172.21.15.2:0/3000002579 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558489d99dc0 0x558489da9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:32.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.892+0000 7f85b49ce640 1 -- 172.21.15.2:0/3000002579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558489d994a0 msgr2=0x558489db1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:32.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.892+0000 7f85b49ce640 1 --2- 172.21.15.2:0/3000002579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558489d994a0 0x558489db1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:32.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.892+0000 7f85b49ce640 1 -- 172.21.15.2:0/3000002579 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558489da4240 con 0x558489da4680 2024-09-19T06:24:32.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.892+0000 7f85b49ce640 1 --2- 172.21.15.2:0/3000002579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558489da4680 0x558489daa6d0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f85a8009430 tx=0x7f85a8005f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26563fa6b7814440 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:32.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.892+0000 7f858f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:24:32.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.892+0000 7f858f7fe640 1 -- 172.21.15.2:0/3000002579 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a806b060 con 0x558489da4680 2024-09-19T06:24:32.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.892+0000 7f858f7fe640 1 -- 172.21.15.2:0/3000002579 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7f85a8004b40 con 0x558489da4680 2024-09-19T06:24:32.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.892+0000 7f85b880a740 1 -- 172.21.15.2:0/3000002579 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85a00cd960 con 0x558489da4680 2024-09-19T06:24:32.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.892+0000 7f858f7fe640 1 -- 172.21.15.2:0/3000002579 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f85a8031b00 con 0x558489da4680 2024-09-19T06:24:32.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.892+0000 7f85b880a740 10 client.18945 fetch_fsmap learned FSMap version 26 2024-09-19T06:24:32.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.892+0000 7f85b880a740 1 -- 172.21.15.2:0/3000002579 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x558489da0130 con 0x558489da4680 2024-09-19T06:24:32.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.892+0000 7f858f7fe640 1 -- 172.21.15.2:0/3000002579 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f85a00cd960 con 0x558489da4680 2024-09-19T06:24:32.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.893+0000 7f858f7fe640 1 -- 172.21.15.2:0/3000002579 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f85a804a7c0 con 0x558489da4680 2024-09-19T06:24:32.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.893+0000 7f85b880a740 10 client.18945 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:24:32.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.893+0000 7f85b880a740 10 client.18945 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:24:32.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.893+0000 7f85b880a740 20 client.18945 populate_metadata read hostname 'smithi002' 2024-09-19T06:24:32.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.893+0000 7f85b880a740 1 --2- 172.21.15.2:0/3000002579 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558489e278f0 0x558489e29ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:32.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.893+0000 7f85b880a740 4 client.18945 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:24:32.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.893+0000 7f85b880a740 1 -- 172.21.15.2:0/3000002579 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558489d06d60 con 0x558489e278f0 2024-09-19T06:24:32.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.893+0000 7f85affff640 1 --2- 172.21.15.2:0/3000002579 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558489e278f0 0x558489e29ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:32.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.893+0000 7f858f7fe640 10 client.18945 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:32.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.893+0000 7f85affff640 1 --2- 172.21.15.2:0/3000002579 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558489e278f0 0x558489e29ce0 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7c20a0f49405532 server_cookie=bd1b7775381477a2 in_seq=0 out_seq=0 2024-09-19T06:24:32.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.894+0000 7f858f7fe640 1 -- 172.21.15.2:0/3000002579 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x558489d06d60 con 0x558489e278f0 2024-09-19T06:24:32.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.894+0000 7f858f7fe640 10 client.18945 handle_command_reply: tid=0 2024-09-19T06:24:32.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.894+0000 7f85b880a740 1 client.18945 shutdown 2024-09-19T06:24:32.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.894+0000 7f85b880a740 1 -- 172.21.15.2:0/3000002579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558489da4680 msgr2=0x558489daa6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:32.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.894+0000 7f85b880a740 1 --2- 172.21.15.2:0/3000002579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558489da4680 0x558489daa6d0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f85a8009430 tx=0x7f85a8005f70 comp rx=0 tx=0).stop 2024-09-19T06:24:32.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.894+0000 7f85b880a740 1 -- 172.21.15.2:0/3000002579 shutdown_connections 2024-09-19T06:24:32.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.894+0000 7f85b880a740 1 --2- 172.21.15.2:0/3000002579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558489da4680 0x558489daa6d0 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:32.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.894+0000 7f85b880a740 1 --2- 172.21.15.2:0/3000002579 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558489d99dc0 0x558489da9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:32.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.894+0000 7f85b880a740 1 --2- 172.21.15.2:0/3000002579 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x558489e278f0 0x558489e29ce0 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:32.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.894+0000 7f85b880a740 1 --2- 172.21.15.2:0/3000002579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558489d994a0 0x558489db1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:32.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.894+0000 7f85b880a740 1 -- 172.21.15.2:0/3000002579 >> 172.21.15.2:0/3000002579 conn(0x558489d95a30 msgr2=0x558489d94350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:32.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.894+0000 7f858f7fe640 0 client.18945 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:24:32.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.894+0000 7f85b880a740 1 -- 172.21.15.2:0/3000002579 shutdown_connections 2024-09-19T06:24:32.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.894+0000 7f85b880a740 1 -- 172.21.15.2:0/3000002579 wait complete. 2024-09-19T06:24:32.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.894+0000 7f85b880a740 20 client.18945 trim_cache size 0 max 16384 2024-09-19T06:24:32.901 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:24:32.901 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:24:32.901 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-09-19T06:24:32.901 INFO:teuthology.orchestra.run.smithi002.stdout: "7a8e6393-a1a4-4131-ab17-01c8d20c67d2": { 2024-09-19T06:24:32.902 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-19T06:24:32.902 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "7a8e6393-a1a4-4131-ab17-01c8d20c67d2", 2024-09-19T06:24:32.902 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-09-19T06:24:32.902 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:24:32.902 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:24:32.902 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:24:32.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.894+0000 7f85b6431640 1 -- 172.21.15.2:0/1854791580 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f85980a3430 msgr2=0x7f85980a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:32.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.894+0000 7f85b6431640 1 --2- 172.21.15.2:0/1854791580 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f85980a3430 0x7f85980a58f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f85a804e000 tx=0x7f85a804c000 comp rx=0 tx=0).stop 2024-09-19T06:24:32.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.895+0000 7f85b6431640 1 -- 172.21.15.2:0/1854791580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85b0101de0 msgr2=0x7f85b01982f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:32.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.895+0000 7f85b6431640 1 --2- 172.21.15.2:0/1854791580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85b0101de0 0x7f85b01982f0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f85a000e9f0 tx=0x7f85a000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:24:32.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.895+0000 7f85b6431640 1 -- 172.21.15.2:0/1854791580 shutdown_connections 2024-09-19T06:24:32.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.895+0000 7f85b6431640 1 --2- 172.21.15.2:0/1854791580 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f85980a3430 0x7f85980a58f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:32.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.895+0000 7f85b6431640 1 --2- 172.21.15.2:0/1854791580 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85b0106f10 0x7f85b019cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:32.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.895+0000 7f85b6431640 1 --2- 172.21.15.2:0/1854791580 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85b0102790 0x7f85b0198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:32.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.895+0000 7f85b6431640 1 --2- 172.21.15.2:0/1854791580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85b0101de0 0x7f85b01982f0 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:32.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.895+0000 7f85b6431640 1 -- 172.21.15.2:0/1854791580 >> 172.21.15.2:0/1854791580 conn(0x7f85b00fd8c0 msgr2=0x7f85b00fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:32.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.895+0000 7f85b6431640 1 -- 172.21.15.2:0/1854791580 shutdown_connections 2024-09-19T06:24:32.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:32.895+0000 7f85b6431640 1 -- 172.21.15.2:0/1854791580 wait complete. 2024-09-19T06:24:33.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:33 smithi002 ceph-mon[30982]: pgmap v303: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:24:33.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:33 smithi002 ceph-mon[30982]: scrub summary: idle 2024-09-19T06:24:33.611 INFO:tasks.cephfs.filesystem:scrub status for tag:7a8e6393-a1a4-4131-ab17-01c8d20c67d2 - {'path': '/', 'tag': '7a8e6393-a1a4-4131-ab17-01c8d20c67d2', 'options': 'recursive,force'} 2024-09-19T06:24:33.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:33 smithi090 ceph-mon[34497]: pgmap v303: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:24:33.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:33 smithi090 ceph-mon[34497]: scrub summary: idle 2024-09-19T06:24:33.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:33 smithi089 ceph-mon[34160]: pgmap v303: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:24:33.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:33 smithi089 ceph-mon[34160]: scrub summary: idle 2024-09-19T06:24:35.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:35 smithi002 ceph-mon[30982]: pgmap v304: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2024-09-19T06:24:35.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:35 smithi090 ceph-mon[34497]: pgmap v304: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2024-09-19T06:24:35.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:35 smithi089 ceph-mon[34160]: pgmap v304: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2024-09-19T06:24:37.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:37 smithi002 ceph-mon[30982]: pgmap v305: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:24:37.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:37 smithi090 ceph-mon[34497]: pgmap v305: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:24:37.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:37 smithi089 ceph-mon[34160]: pgmap v305: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:24:39.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:39 smithi002 ceph-mon[30982]: pgmap v306: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:24:39.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:39 smithi090 ceph-mon[34497]: pgmap v306: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:24:39.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:39 smithi089 ceph-mon[34160]: pgmap v306: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:24:41.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:41 smithi002 ceph-mon[30982]: pgmap v307: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:24:41.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:41 smithi090 ceph-mon[34497]: pgmap v307: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:24:41.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:41 smithi089 ceph-mon[34160]: pgmap v307: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:24:43.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:43 smithi002 ceph-mon[30982]: pgmap v308: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:24:43.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:43 smithi090 ceph-mon[34497]: pgmap v308: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:24:43.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:43 smithi089 ceph-mon[34160]: pgmap v308: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-09-19T06:24:45.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:45 smithi002 ceph-mon[30982]: pgmap v309: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:24:45.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:45 smithi090 ceph-mon[34497]: pgmap v309: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:24:45.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:45 smithi089 ceph-mon[34160]: pgmap v309: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-19T06:24:47.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:47 smithi002 ceph-mon[30982]: pgmap v310: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:24:47.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:47 smithi090 ceph-mon[34497]: pgmap v310: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:24:47.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:47 smithi089 ceph-mon[34160]: pgmap v310: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:24:49.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:49 smithi002 ceph-mon[30982]: pgmap v311: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:24:49.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:49 smithi090 ceph-mon[34497]: pgmap v311: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:24:49.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:49 smithi089 ceph-mon[34160]: pgmap v311: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:24:51.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:51 smithi002 ceph-mon[30982]: pgmap v312: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:24:51.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:51 smithi090 ceph-mon[34497]: pgmap v312: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:24:51.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:51 smithi089 ceph-mon[34160]: pgmap v312: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:24:53.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:53 smithi002 ceph-mon[30982]: pgmap v313: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T06:24:53.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:53 smithi090 ceph-mon[34497]: pgmap v313: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T06:24:53.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:53 smithi089 ceph-mon[34160]: pgmap v313: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T06:24:55.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:55 smithi002 ceph-mon[30982]: pgmap v314: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:24:55.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:55 smithi090 ceph-mon[34497]: pgmap v314: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:24:55.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:55 smithi089 ceph-mon[34160]: pgmap v314: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:24:57.725 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:57 smithi002 ceph-mon[30982]: pgmap v315: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T06:24:57.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:57 smithi090 ceph-mon[34497]: pgmap v315: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T06:24:57.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:57 smithi089 ceph-mon[34160]: pgmap v315: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T06:24:59.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:24:59 smithi002 ceph-mon[30982]: pgmap v316: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T06:24:59.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:24:59 smithi090 ceph-mon[34497]: pgmap v316: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T06:24:59.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:24:59 smithi089 ceph-mon[34160]: pgmap v316: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T06:24:59.833 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-19T06:24:59.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:59.951+0000 7f4a60328640 1 -- 172.21.15.2:0/3197611157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a581069b0 msgr2=0x7f4a58106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:59.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:59.951+0000 7f4a60328640 1 --2- 172.21.15.2:0/3197611157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a581069b0 0x7f4a58106d90 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f4a54009930 tx=0x7f4a5402a420 comp rx=0 tx=0).stop 2024-09-19T06:24:59.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:59.951+0000 7f4a60328640 1 -- 172.21.15.2:0/3197611157 shutdown_connections 2024-09-19T06:24:59.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:59.951+0000 7f4a60328640 1 --2- 172.21.15.2:0/3197611157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a58101340 0x7f4a5810d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:59.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:59.951+0000 7f4a60328640 1 --2- 172.21.15.2:0/3197611157 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a581009a0 0x7f4a58100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:59.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:59.951+0000 7f4a60328640 1 --2- 172.21.15.2:0/3197611157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a581069b0 0x7f4a58106d90 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:59.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:59.951+0000 7f4a60328640 1 -- 172.21.15.2:0/3197611157 >> 172.21.15.2:0/3197611157 conn(0x7f4a580779a0 msgr2=0x7f4a580fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:59.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:59.951+0000 7f4a60328640 1 -- 172.21.15.2:0/3197611157 shutdown_connections 2024-09-19T06:24:59.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:59.951+0000 7f4a60328640 1 -- 172.21.15.2:0/3197611157 wait complete. 2024-09-19T06:24:59.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:59.952+0000 7f4a60328640 1 Processor -- start 2024-09-19T06:24:59.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:59.952+0000 7f4a60328640 1 -- start start 2024-09-19T06:24:59.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:59.952+0000 7f4a60328640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a581009a0 0x7f4a5819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:59.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:59.952+0000 7f4a60328640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a58101340 0x7f4a5819aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:59.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:59.952+0000 7f4a60328640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a581069b0 0x7f4a5819ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:59.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:59.952+0000 7f4a60328640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4a58110c70 con 0x7f4a58101340 2024-09-19T06:24:59.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:59.952+0000 7f4a60328640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4a58110af0 con 0x7f4a581069b0 2024-09-19T06:24:59.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:59.952+0000 7f4a60328640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4a58110df0 con 0x7f4a581009a0 2024-09-19T06:24:59.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:59.952+0000 7f4a5d8c3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a58101340 0x7f4a5819aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:59.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:59.952+0000 7f4a5d8c3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a58101340 0x7f4a5819aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34272/0 (socket says 172.21.15.2:34272) 2024-09-19T06:24:59.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:59.952+0000 7f4a5d8c3640 1 -- 172.21.15.2:0/585408362 learned_addr learned my addr 172.21.15.2:0/585408362 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:24:59.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:59.952+0000 7f4a5e8c5640 1 --2- 172.21.15.2:0/585408362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a581069b0 0x7f4a5819ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:59.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:59.952+0000 7f4a5e0c4640 1 --2- 172.21.15.2:0/585408362 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a581009a0 0x7f4a5819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:59.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:59.952+0000 7f4a5d8c3640 1 -- 172.21.15.2:0/585408362 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a581009a0 msgr2=0x7f4a5819a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:59.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:59.952+0000 7f4a5d8c3640 1 --2- 172.21.15.2:0/585408362 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a581009a0 0x7f4a5819a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:59.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:59.952+0000 7f4a5d8c3640 1 -- 172.21.15.2:0/585408362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a581069b0 msgr2=0x7f4a5819ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:59.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:59.952+0000 7f4a5d8c3640 1 --2- 172.21.15.2:0/585408362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a581069b0 0x7f4a5819ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:59.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:59.952+0000 7f4a5d8c3640 1 -- 172.21.15.2:0/585408362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a5819f4b0 con 0x7f4a58101340 2024-09-19T06:24:59.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:59.953+0000 7f4a5d8c3640 1 --2- 172.21.15.2:0/585408362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a58101340 0x7f4a5819aa00 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f4a4800c920 tx=0x7f4a4800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:59.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:59.953+0000 7f4a4f7fe640 1 -- 172.21.15.2:0/585408362 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a48007c70 con 0x7f4a58101340 2024-09-19T06:24:59.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:59.953+0000 7f4a4f7fe640 1 -- 172.21.15.2:0/585408362 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4a48007e10 con 0x7f4a58101340 2024-09-19T06:24:59.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:59.953+0000 7f4a4f7fe640 1 -- 172.21.15.2:0/585408362 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a48018820 con 0x7f4a58101340 2024-09-19T06:24:59.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:59.953+0000 7f4a60328640 1 -- 172.21.15.2:0/585408362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a5819f7a0 con 0x7f4a58101340 2024-09-19T06:24:59.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:59.953+0000 7f4a60328640 1 -- 172.21.15.2:0/585408362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a581a7030 con 0x7f4a58101340 2024-09-19T06:24:59.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:59.954+0000 7f4a60328640 1 -- 172.21.15.2:0/585408362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a581020e0 con 0x7f4a58101340 2024-09-19T06:24:59.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:59.956+0000 7f4a4f7fe640 1 -- 172.21.15.2:0/585408362 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f4a480189c0 con 0x7f4a58101340 2024-09-19T06:24:59.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:59.956+0000 7f4a4f7fe640 1 --2- 172.21.15.2:0/585408362 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4a440a3430 0x7f4a440a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:59.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:59.957+0000 7f4a4f7fe640 1 -- 172.21.15.2:0/585408362 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7f4a480cffe0 con 0x7f4a58101340 2024-09-19T06:24:59.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:59.957+0000 7f4a5e0c4640 1 --2- 172.21.15.2:0/585408362 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4a440a3430 0x7f4a440a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:59.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:59.957+0000 7f4a5e0c4640 1 --2- 172.21.15.2:0/585408362 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4a440a3430 0x7f4a440a58f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4a54006010 tx=0x7f4a54000bc0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:59.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:24:59.960+0000 7f4a4f7fe640 1 -- 172.21.15.2:0/585408362 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4a48014030 con 0x7f4a58101340 2024-09-19T06:25:00.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.156+0000 7f4a60328640 1 -- 172.21.15.2:0/585408362 --> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f4a580fedc0 con 0x7f4a440a3430 2024-09-19T06:25:00.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.164+0000 7f4a4f7fe640 1 -- 172.21.15.2:0/585408362 <== mgr.15144 v2:172.21.15.2:6800/1594569191 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f4a580fedc0 con 0x7f4a440a3430 2024-09-19T06:25:00.165 INFO:teuthology.orchestra.run.smithi002.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-19T00:00:00", "created": "2024-09-19T06:14:58", "first": "2024-09-19T06:15:00", "last": "2024-09-19T06:24:00", "last_pruned": "2024-09-19T06:24:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-09-19T06:25:00.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.166+0000 7f4a60328640 1 -- 172.21.15.2:0/585408362 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4a440a3430 msgr2=0x7f4a440a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:00.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.166+0000 7f4a60328640 1 --2- 172.21.15.2:0/585408362 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4a440a3430 0x7f4a440a58f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4a54006010 tx=0x7f4a54000bc0 comp rx=0 tx=0).stop 2024-09-19T06:25:00.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.166+0000 7f4a60328640 1 -- 172.21.15.2:0/585408362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a58101340 msgr2=0x7f4a5819aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:00.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.166+0000 7f4a60328640 1 --2- 172.21.15.2:0/585408362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a58101340 0x7f4a5819aa00 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f4a4800c920 tx=0x7f4a4800cde0 comp rx=0 tx=0).stop 2024-09-19T06:25:00.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.166+0000 7f4a60328640 1 -- 172.21.15.2:0/585408362 shutdown_connections 2024-09-19T06:25:00.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.166+0000 7f4a60328640 1 --2- 172.21.15.2:0/585408362 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f4a440a3430 0x7f4a440a58f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:00.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.166+0000 7f4a60328640 1 --2- 172.21.15.2:0/585408362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a581069b0 0x7f4a5819ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:00.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.166+0000 7f4a60328640 1 --2- 172.21.15.2:0/585408362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a58101340 0x7f4a5819aa00 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:00.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.166+0000 7f4a60328640 1 --2- 172.21.15.2:0/585408362 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a581009a0 0x7f4a5819a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:00.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.166+0000 7f4a60328640 1 -- 172.21.15.2:0/585408362 >> 172.21.15.2:0/585408362 conn(0x7f4a580779a0 msgr2=0x7f4a58104a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:00.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.166+0000 7f4a60328640 1 -- 172.21.15.2:0/585408362 shutdown_connections 2024-09-19T06:25:00.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.166+0000 7f4a60328640 1 -- 172.21.15.2:0/585408362 wait complete. 2024-09-19T06:25:00.179 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-19T06:25:00.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.283+0000 7faa6f67b640 1 -- 172.21.15.2:0/4217196006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa6810e3c0 msgr2=0x7faa681107b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:00.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.283+0000 7faa6f67b640 1 --2- 172.21.15.2:0/4217196006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa6810e3c0 0x7faa681107b0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7faa60009ca0 tx=0x7faa6002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:25:00.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.283+0000 7faa6f67b640 1 -- 172.21.15.2:0/4217196006 shutdown_connections 2024-09-19T06:25:00.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.283+0000 7faa6f67b640 1 --2- 172.21.15.2:0/4217196006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa6810e3c0 0x7faa681107b0 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:00.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.283+0000 7faa6f67b640 1 --2- 172.21.15.2:0/4217196006 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa681011c0 0x7faa6810de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:00.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.283+0000 7faa6f67b640 1 --2- 172.21.15.2:0/4217196006 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa681008a0 0x7faa68100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:00.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.283+0000 7faa6f67b640 1 -- 172.21.15.2:0/4217196006 >> 172.21.15.2:0/4217196006 conn(0x7faa680fc6e0 msgr2=0x7faa680feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:00.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.283+0000 7faa6f67b640 1 -- 172.21.15.2:0/4217196006 shutdown_connections 2024-09-19T06:25:00.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.284+0000 7faa6f67b640 1 -- 172.21.15.2:0/4217196006 wait complete. 2024-09-19T06:25:00.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.284+0000 7faa6f67b640 1 Processor -- start 2024-09-19T06:25:00.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.284+0000 7faa6f67b640 1 -- start start 2024-09-19T06:25:00.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.284+0000 7faa6f67b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa681008a0 0x7faa6819a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:00.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.284+0000 7faa6f67b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa681011c0 0x7faa6819a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:00.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.284+0000 7faa6f67b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa6810e3c0 0x7faa6819ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:00.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.284+0000 7faa6f67b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faa68113f30 con 0x7faa681011c0 2024-09-19T06:25:00.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.284+0000 7faa6f67b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7faa68113db0 con 0x7faa681008a0 2024-09-19T06:25:00.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.284+0000 7faa6f67b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7faa681140b0 con 0x7faa6810e3c0 2024-09-19T06:25:00.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.284+0000 7faa6cc16640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa681011c0 0x7faa6819a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:00.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.284+0000 7faa6cc16640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa681011c0 0x7faa6819a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34298/0 (socket says 172.21.15.2:34298) 2024-09-19T06:25:00.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.284+0000 7faa6cc16640 1 -- 172.21.15.2:0/3926447733 learned_addr learned my addr 172.21.15.2:0/3926447733 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:25:00.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.285+0000 7faa6dc18640 1 --2- 172.21.15.2:0/3926447733 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa6810e3c0 0x7faa6819ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:00.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.285+0000 7faa6d417640 1 --2- 172.21.15.2:0/3926447733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa681008a0 0x7faa6819a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:00.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.285+0000 7faa6cc16640 1 -- 172.21.15.2:0/3926447733 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa6810e3c0 msgr2=0x7faa6819ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:00.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.285+0000 7faa6cc16640 1 --2- 172.21.15.2:0/3926447733 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa6810e3c0 0x7faa6819ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:00.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.285+0000 7faa6cc16640 1 -- 172.21.15.2:0/3926447733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa681008a0 msgr2=0x7faa6819a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:00.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.285+0000 7faa6cc16640 1 --2- 172.21.15.2:0/3926447733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa681008a0 0x7faa6819a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:00.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.285+0000 7faa6cc16640 1 -- 172.21.15.2:0/3926447733 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa6819f3b0 con 0x7faa681011c0 2024-09-19T06:25:00.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.285+0000 7faa6dc18640 1 --2- 172.21.15.2:0/3926447733 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa6810e3c0 0x7faa6819ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:25:00.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.285+0000 7faa6cc16640 1 --2- 172.21.15.2:0/3926447733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa681011c0 0x7faa6819a900 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7faa5800c920 tx=0x7faa5800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:00.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.285+0000 7faa5e7fc640 1 -- 172.21.15.2:0/3926447733 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa58007c70 con 0x7faa681011c0 2024-09-19T06:25:00.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.285+0000 7faa5e7fc640 1 -- 172.21.15.2:0/3926447733 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7faa58007e10 con 0x7faa681011c0 2024-09-19T06:25:00.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.285+0000 7faa6f67b640 1 -- 172.21.15.2:0/3926447733 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa6819f6a0 con 0x7faa681011c0 2024-09-19T06:25:00.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.285+0000 7faa5e7fc640 1 -- 172.21.15.2:0/3926447733 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa58018820 con 0x7faa681011c0 2024-09-19T06:25:00.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.285+0000 7faa6f67b640 1 -- 172.21.15.2:0/3926447733 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa681a6f30 con 0x7faa681011c0 2024-09-19T06:25:00.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.286+0000 7faa6f67b640 1 -- 172.21.15.2:0/3926447733 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa6806ac20 con 0x7faa681011c0 2024-09-19T06:25:00.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.288+0000 7faa5e7fc640 1 -- 172.21.15.2:0/3926447733 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7faa580189c0 con 0x7faa681011c0 2024-09-19T06:25:00.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.288+0000 7faa5e7fc640 1 --2- 172.21.15.2:0/3926447733 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7faa540a3430 0x7faa540a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:00.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.288+0000 7faa6d417640 1 --2- 172.21.15.2:0/3926447733 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7faa540a3430 0x7faa540a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:00.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.288+0000 7faa5e7fc640 1 -- 172.21.15.2:0/3926447733 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7faa580cfe60 con 0x7faa681011c0 2024-09-19T06:25:00.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.289+0000 7faa6d417640 1 --2- 172.21.15.2:0/3926447733 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7faa540a3430 0x7faa540a58f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7faa64005e10 tx=0x7faa64005da0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:00.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.292+0000 7faa5e7fc640 1 -- 172.21.15.2:0/3926447733 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faa58014030 con 0x7faa681011c0 2024-09-19T06:25:00.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.493+0000 7faa6f67b640 1 -- 172.21.15.2:0/3926447733 --> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7faa68062630 con 0x7faa540a3430 2024-09-19T06:25:00.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.501+0000 7faa5e7fc640 1 -- 172.21.15.2:0/3926447733 <== mgr.15144 v2:172.21.15.2:6800/1594569191 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7faa68062630 con 0x7faa540a3430 2024-09-19T06:25:00.503 INFO:teuthology.orchestra.run.smithi002.stdout:/ 1m 6m3h 2024-09-19T06:25:00.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.504+0000 7faa6f67b640 1 -- 172.21.15.2:0/3926447733 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7faa540a3430 msgr2=0x7faa540a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:00.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.504+0000 7faa6f67b640 1 --2- 172.21.15.2:0/3926447733 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7faa540a3430 0x7faa540a58f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7faa64005e10 tx=0x7faa64005da0 comp rx=0 tx=0).stop 2024-09-19T06:25:00.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.504+0000 7faa6f67b640 1 -- 172.21.15.2:0/3926447733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa681011c0 msgr2=0x7faa6819a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:00.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.504+0000 7faa6f67b640 1 --2- 172.21.15.2:0/3926447733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa681011c0 0x7faa6819a900 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7faa5800c920 tx=0x7faa5800cde0 comp rx=0 tx=0).stop 2024-09-19T06:25:00.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.504+0000 7faa6f67b640 1 -- 172.21.15.2:0/3926447733 shutdown_connections 2024-09-19T06:25:00.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.504+0000 7faa6f67b640 1 --2- 172.21.15.2:0/3926447733 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7faa540a3430 0x7faa540a58f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:00.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.504+0000 7faa6f67b640 1 --2- 172.21.15.2:0/3926447733 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa6810e3c0 0x7faa6819ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:00.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.504+0000 7faa6f67b640 1 --2- 172.21.15.2:0/3926447733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa681011c0 0x7faa6819a900 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:00.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.504+0000 7faa6f67b640 1 --2- 172.21.15.2:0/3926447733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa681008a0 0x7faa6819a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:00.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.504+0000 7faa6f67b640 1 -- 172.21.15.2:0/3926447733 >> 172.21.15.2:0/3926447733 conn(0x7faa680fc6e0 msgr2=0x7faa680fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:00.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.504+0000 7faa6f67b640 1 -- 172.21.15.2:0/3926447733 shutdown_connections 2024-09-19T06:25:00.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:00.504+0000 7faa6f67b640 1 -- 172.21.15.2:0/3926447733 wait complete. 2024-09-19T06:25:00.516 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-19T06:25:00.528 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-19T06:25:01.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:01 smithi002 ceph-mon[30982]: from='client.18951 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:25:01.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:01 smithi002 ceph-mon[30982]: pgmap v317: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:25:01.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:01 smithi002 ceph-mon[30982]: from='client.18957 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:25:01.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:01 smithi090 ceph-mon[34497]: from='client.18951 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:25:01.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:01 smithi090 ceph-mon[34497]: pgmap v317: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:25:01.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:01 smithi090 ceph-mon[34497]: from='client.18957 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:25:01.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:01 smithi089 ceph-mon[34160]: from='client.18951 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:25:01.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:01 smithi089 ceph-mon[34160]: pgmap v317: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:25:01.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:01 smithi089 ceph-mon[34160]: from='client.18957 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:25:03.613 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:25:03.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:03 smithi002 ceph-mon[30982]: pgmap v318: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:25:03.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:03 smithi090 ceph-mon[34497]: pgmap v318: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:25:03.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:03 smithi089 ceph-mon[34160]: pgmap v318: 97 pgs: 97 active+clean; 1.9 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:25:03.887 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:25:04.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.340+0000 7f841b9e4640 1 -- 172.21.15.2:0/90664949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8414102570 msgr2=0x7f84141029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:04.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.340+0000 7f841b9e4640 1 --2- 172.21.15.2:0/90664949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8414102570 0x7f84141029b0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f8404009900 tx=0x7f840402a480 comp rx=0 tx=0).stop 2024-09-19T06:25:04.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.340+0000 7f841b9e4640 1 -- 172.21.15.2:0/90664949 shutdown_connections 2024-09-19T06:25:04.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.340+0000 7f841b9e4640 1 --2- 172.21.15.2:0/90664949 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8414102ef0 0x7f841410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:04.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.340+0000 7f841b9e4640 1 --2- 172.21.15.2:0/90664949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8414102570 0x7f84141029b0 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:04.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.340+0000 7f841b9e4640 1 --2- 172.21.15.2:0/90664949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8414100e20 0x7f8414101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:04.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.340+0000 7f841b9e4640 1 -- 172.21.15.2:0/90664949 >> 172.21.15.2:0/90664949 conn(0x7f84140fc7d0 msgr2=0x7f84140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:04.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.340+0000 7f841b9e4640 1 -- 172.21.15.2:0/90664949 shutdown_connections 2024-09-19T06:25:04.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.340+0000 7f841b9e4640 1 -- 172.21.15.2:0/90664949 wait complete. 2024-09-19T06:25:04.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.341+0000 7f841b9e4640 1 Processor -- start 2024-09-19T06:25:04.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.341+0000 7f841b9e4640 1 -- start start 2024-09-19T06:25:04.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.341+0000 7f841b9e4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8414100e20 0x7f841419a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:04.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.341+0000 7f841b9e4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8414102570 0x7f841419aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:04.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.341+0000 7f841b9e4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8414102ef0 0x7f841419edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:04.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.341+0000 7f841b9e4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8414110e80 con 0x7f8414102570 2024-09-19T06:25:04.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.341+0000 7f841b9e4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8414110d00 con 0x7f8414100e20 2024-09-19T06:25:04.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.341+0000 7f841b9e4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8414111000 con 0x7f8414102ef0 2024-09-19T06:25:04.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.341+0000 7f8418f7f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8414102570 0x7f841419aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:04.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.341+0000 7f8418f7f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8414102570 0x7f841419aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34324/0 (socket says 172.21.15.2:34324) 2024-09-19T06:25:04.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.341+0000 7f8418f7f640 1 -- 172.21.15.2:0/668909276 learned_addr learned my addr 172.21.15.2:0/668909276 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:25:04.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.342+0000 7f8419780640 1 --2- 172.21.15.2:0/668909276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8414100e20 0x7f841419a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:04.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.342+0000 7f8419f81640 1 --2- 172.21.15.2:0/668909276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8414102ef0 0x7f841419edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:04.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.342+0000 7f8418f7f640 1 -- 172.21.15.2:0/668909276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8414102ef0 msgr2=0x7f841419edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:04.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.342+0000 7f8418f7f640 1 --2- 172.21.15.2:0/668909276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8414102ef0 0x7f841419edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:04.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.342+0000 7f8418f7f640 1 -- 172.21.15.2:0/668909276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8414100e20 msgr2=0x7f841419a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:04.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.342+0000 7f8418f7f640 1 --2- 172.21.15.2:0/668909276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8414100e20 0x7f841419a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:04.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.342+0000 7f8418f7f640 1 -- 172.21.15.2:0/668909276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f841419f4d0 con 0x7f8414102570 2024-09-19T06:25:04.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.342+0000 7f8418f7f640 1 --2- 172.21.15.2:0/668909276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8414102570 0x7f841419aa60 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f8404006010 tx=0x7f8404003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:04.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.342+0000 7f840a7fc640 1 -- 172.21.15.2:0/668909276 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840403f070 con 0x7f8414102570 2024-09-19T06:25:04.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.342+0000 7f840a7fc640 1 -- 172.21.15.2:0/668909276 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f840403bd20 con 0x7f8414102570 2024-09-19T06:25:04.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.342+0000 7f840a7fc640 1 -- 172.21.15.2:0/668909276 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8404035030 con 0x7f8414102570 2024-09-19T06:25:04.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.342+0000 7f841b9e4640 1 -- 172.21.15.2:0/668909276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f841419f760 con 0x7f8414102570 2024-09-19T06:25:04.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.342+0000 7f841b9e4640 1 -- 172.21.15.2:0/668909276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84141a70a0 con 0x7f8414102570 2024-09-19T06:25:04.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.345+0000 7f840a7fc640 1 -- 172.21.15.2:0/668909276 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f8404042070 con 0x7f8414102570 2024-09-19T06:25:04.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.345+0000 7f841ddbd740 1 Processor -- start 2024-09-19T06:25:04.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.345+0000 7f841ddbd740 1 -- start start 2024-09-19T06:25:04.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.346+0000 7f841ddbd740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db1b5bf4a0 0x55db1b5bf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:04.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.346+0000 7f841ddbd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db1b5bfdc0 0x55db1b5ca140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:04.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.346+0000 7f841ddbd740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55db1b5ca680 0x55db1b5cca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:04.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.346+0000 7f841ddbd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55db1b5252e0 con 0x55db1b5bfdc0 2024-09-19T06:25:04.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.346+0000 7f841ddbd740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55db1b4ccce0 con 0x55db1b5ca680 2024-09-19T06:25:04.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.346+0000 7f841ddbd740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55db1b5212a0 con 0x55db1b5bf4a0 2024-09-19T06:25:04.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.346+0000 7f8419780640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db1b5bfdc0 0x55db1b5ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:04.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.346+0000 7f8419780640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db1b5bfdc0 0x55db1b5ca140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34338/0 (socket says 172.21.15.2:34338) 2024-09-19T06:25:04.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.346+0000 7f8419780640 1 -- 172.21.15.2:0/4243593019 learned_addr learned my addr 172.21.15.2:0/4243593019 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:25:04.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.346+0000 7f8419f81640 1 --2- 172.21.15.2:0/4243593019 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db1b5bf4a0 0x55db1b5bf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:04.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.346+0000 7f8418f7f640 1 --2- 172.21.15.2:0/4243593019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55db1b5ca680 0x55db1b5cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:04.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.346+0000 7f840a7fc640 1 --2- 172.21.15.2:0/668909276 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f84000a33b0 0x7f84000a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:04.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.346+0000 7f8419780640 1 -- 172.21.15.2:0/4243593019 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db1b5bf4a0 msgr2=0x55db1b5bf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:25:04.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.346+0000 7f8419780640 1 --2- 172.21.15.2:0/4243593019 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db1b5bf4a0 0x55db1b5bf880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:04.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.346+0000 7f8419780640 1 -- 172.21.15.2:0/4243593019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55db1b5ca680 msgr2=0x55db1b5cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:25:04.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.346+0000 7f8419780640 1 --2- 172.21.15.2:0/4243593019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55db1b5ca680 0x55db1b5cca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:04.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.346+0000 7f8419f81640 1 --2- 172.21.15.2:0/668909276 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f84000a33b0 0x7f84000a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:04.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.346+0000 7f8419780640 1 -- 172.21.15.2:0/4243593019 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db1b4b1440 con 0x55db1b5bfdc0 2024-09-19T06:25:04.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.346+0000 7f840a7fc640 1 -- 172.21.15.2:0/668909276 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7f84040f0630 con 0x7f8414102570 2024-09-19T06:25:04.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.347+0000 7f8419780640 1 --2- 172.21.15.2:0/4243593019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db1b5bfdc0 0x55db1b5ca140 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f841000ad00 tx=0x7f841000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aa03d78b1c70cf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:04.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.347+0000 7f8419f81640 1 --2- 172.21.15.2:0/668909276 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f84000a33b0 0x7f84000a5870 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f840c007f30 tx=0x7f840c004a40 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:04.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.347+0000 7f83ff7fe640 1 -- 172.21.15.2:0/4243593019 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841001d070 con 0x55db1b5bfdc0 2024-09-19T06:25:04.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.347+0000 7f83ff7fe640 1 -- 172.21.15.2:0/4243593019 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8410018af0 con 0x55db1b5bfdc0 2024-09-19T06:25:04.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.347+0000 7f83ff7fe640 1 -- 172.21.15.2:0/4243593019 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8410010b40 con 0x55db1b5bfdc0 2024-09-19T06:25:04.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.347+0000 7f841ddbd740 1 -- 172.21.15.2:0/4243593019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db1b5bfdc0 msgr2=0x55db1b5ca140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:04.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.347+0000 7f841ddbd740 1 --2- 172.21.15.2:0/4243593019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db1b5bfdc0 0x55db1b5ca140 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f841000ad00 tx=0x7f841000f790 comp rx=0 tx=0).stop 2024-09-19T06:25:04.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.348+0000 7f841ddbd740 1 -- 172.21.15.2:0/4243593019 shutdown_connections 2024-09-19T06:25:04.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.348+0000 7f841ddbd740 1 --2- 172.21.15.2:0/4243593019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55db1b5ca680 0x55db1b5cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:04.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.348+0000 7f841ddbd740 1 --2- 172.21.15.2:0/4243593019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db1b5bfdc0 0x55db1b5ca140 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:04.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.348+0000 7f841ddbd740 1 --2- 172.21.15.2:0/4243593019 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db1b5bf4a0 0x55db1b5bf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:04.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.348+0000 7f841ddbd740 1 -- 172.21.15.2:0/4243593019 >> 172.21.15.2:0/4243593019 conn(0x55db1b5bba30 msgr2=0x55db1b5bbe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:04.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.348+0000 7f841ddbd740 1 -- 172.21.15.2:0/4243593019 shutdown_connections 2024-09-19T06:25:04.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.348+0000 7f841ddbd740 1 -- 172.21.15.2:0/4243593019 wait complete. 2024-09-19T06:25:04.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.348+0000 7f841ddbd740 1 -- start start 2024-09-19T06:25:04.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.348+0000 7f841ddbd740 1 Processor -- start 2024-09-19T06:25:04.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.349+0000 7f841ddbd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db1b5bf4a0 0x55db1b5c9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:04.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.349+0000 7f841ddbd740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db1b5bfdc0 0x55db1b5c7290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:04.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.349+0000 7f841ddbd740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55db1b5ca680 0x55db1b5c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:04.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.349+0000 7f841ddbd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55db1b5cd250 con 0x55db1b5bf4a0 2024-09-19T06:25:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.349+0000 7f841ddbd740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55db1b4e0050 con 0x55db1b5ca680 2024-09-19T06:25:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.349+0000 7f841ddbd740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55db1b5cd3d0 con 0x55db1b5bfdc0 2024-09-19T06:25:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.349+0000 7f841ddbd740 10 client.0 _ll_register_callbacks cb 0x55db1b520160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:25:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.349+0000 7f8419780640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db1b5bf4a0 0x55db1b5c9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.349+0000 7f8419780640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db1b5bf4a0 0x55db1b5c9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34346/0 (socket says 172.21.15.2:34346) 2024-09-19T06:25:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.349+0000 7f8418f7f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db1b5bfdc0 0x55db1b5c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.349+0000 7f8419780640 1 -- 172.21.15.2:0/88025531 learned_addr learned my addr 172.21.15.2:0/88025531 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:25:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.349+0000 7f8419f81640 1 --2- 172.21.15.2:0/88025531 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55db1b5ca680 0x55db1b5c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.349+0000 7f8419780640 1 -- 172.21.15.2:0/88025531 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db1b5bfdc0 msgr2=0x55db1b5c7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:25:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.349+0000 7f8419780640 1 --2- 172.21.15.2:0/88025531 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db1b5bfdc0 0x55db1b5c7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.349+0000 7f8419780640 1 -- 172.21.15.2:0/88025531 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55db1b5ca680 msgr2=0x55db1b5c77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:25:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.349+0000 7f8419780640 1 --2- 172.21.15.2:0/88025531 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55db1b5ca680 0x55db1b5c77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.349+0000 7f8419780640 1 -- 172.21.15.2:0/88025531 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db1b2963c0 con 0x55db1b5bf4a0 2024-09-19T06:25:04.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.349+0000 7f8418f7f640 1 --2- 172.21.15.2:0/88025531 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db1b5bfdc0 0x55db1b5c7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:25:04.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.349+0000 7f8419780640 1 --2- 172.21.15.2:0/88025531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db1b5bf4a0 0x55db1b5c9f90 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f841000a550 tx=0x7f8410018670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c236f85dc4fefb3b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:04.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.349+0000 7f83fcff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:25:04.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.350+0000 7f83fcff9640 1 -- 172.21.15.2:0/88025531 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841001d040 con 0x55db1b5bf4a0 2024-09-19T06:25:04.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.350+0000 7f841ddbd740 1 -- 172.21.15.2:0/88025531 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8410018af0 con 0x55db1b5bf4a0 2024-09-19T06:25:04.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.350+0000 7f83fcff9640 1 -- 172.21.15.2:0/88025531 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7f8410005040 con 0x55db1b5bf4a0 2024-09-19T06:25:04.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.350+0000 7f83fcff9640 1 -- 172.21.15.2:0/88025531 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8410031050 con 0x55db1b5bf4a0 2024-09-19T06:25:04.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.350+0000 7f841ddbd740 10 client.18969 fetch_fsmap learned FSMap version 26 2024-09-19T06:25:04.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.350+0000 7f841ddbd740 1 -- 172.21.15.2:0/88025531 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55db1b5d8c20 con 0x55db1b5bf4a0 2024-09-19T06:25:04.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.350+0000 7f83fcff9640 1 -- 172.21.15.2:0/88025531 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8410018af0 con 0x55db1b5bf4a0 2024-09-19T06:25:04.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.350+0000 7f83fcff9640 1 -- 172.21.15.2:0/88025531 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f8410020030 con 0x55db1b5bf4a0 2024-09-19T06:25:04.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.350+0000 7f841ddbd740 10 client.18969 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:25:04.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.350+0000 7f841ddbd740 10 client.18969 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:25:04.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.350+0000 7f841ddbd740 20 client.18969 populate_metadata read hostname 'smithi002' 2024-09-19T06:25:04.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.350+0000 7f841ddbd740 1 --2- 172.21.15.2:0/88025531 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55db1b5da0e0 0x55db1b5dc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:04.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.350+0000 7f841ddbd740 4 client.18969 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:25:04.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.350+0000 7f841ddbd740 1 -- 172.21.15.2:0/88025531 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55db1b532850 con 0x55db1b5da0e0 2024-09-19T06:25:04.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.350+0000 7f8418f7f640 1 --2- 172.21.15.2:0/88025531 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55db1b5da0e0 0x55db1b5dc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:04.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.351+0000 7f8418f7f640 1 --2- 172.21.15.2:0/88025531 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55db1b5da0e0 0x55db1b5dc4d0 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=466f5263d3580a1b server_cookie=474c5e39b04bf8da in_seq=0 out_seq=0 2024-09-19T06:25:04.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.351+0000 7f83fcff9640 10 client.18969 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:25:04.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.351+0000 7f83fcff9640 1 -- 172.21.15.2:0/88025531 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55db1b532850 con 0x55db1b5da0e0 2024-09-19T06:25:04.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.351+0000 7f83fcff9640 10 client.18969 handle_command_reply: tid=0 2024-09-19T06:25:04.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.352+0000 7f841ddbd740 1 client.18969 shutdown 2024-09-19T06:25:04.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.352+0000 7f841ddbd740 1 -- 172.21.15.2:0/88025531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db1b5bf4a0 msgr2=0x55db1b5c9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:04.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.352+0000 7f841ddbd740 1 --2- 172.21.15.2:0/88025531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db1b5bf4a0 0x55db1b5c9f90 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f841000a550 tx=0x7f8410018670 comp rx=0 tx=0).stop 2024-09-19T06:25:04.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.352+0000 7f841ddbd740 1 -- 172.21.15.2:0/88025531 shutdown_connections 2024-09-19T06:25:04.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.352+0000 7f841ddbd740 1 --2- 172.21.15.2:0/88025531 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55db1b5da0e0 0x55db1b5dc4d0 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:04.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.352+0000 7f841ddbd740 1 --2- 172.21.15.2:0/88025531 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55db1b5ca680 0x55db1b5c77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:04.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.352+0000 7f841ddbd740 1 --2- 172.21.15.2:0/88025531 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db1b5bfdc0 0x55db1b5c7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:04.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.352+0000 7f841ddbd740 1 --2- 172.21.15.2:0/88025531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db1b5bf4a0 0x55db1b5c9f90 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:04.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.352+0000 7f83fcff9640 0 client.18969 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:25:04.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.352+0000 7f841ddbd740 1 -- 172.21.15.2:0/88025531 >> 172.21.15.2:0/88025531 conn(0x55db1b5bba30 msgr2=0x55db1b5c1710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:04.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.352+0000 7f841ddbd740 1 -- 172.21.15.2:0/88025531 shutdown_connections 2024-09-19T06:25:04.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.352+0000 7f841ddbd740 1 -- 172.21.15.2:0/88025531 wait complete. 2024-09-19T06:25:04.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.352+0000 7f841ddbd740 20 client.18969 trim_cache size 0 max 16384 2024-09-19T06:25:04.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.369+0000 7f841ddbd740 1 Processor -- start 2024-09-19T06:25:04.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.369+0000 7f841ddbd740 1 -- start start 2024-09-19T06:25:04.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.369+0000 7f841ddbd740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55db1b5bf4a0 0x55db1b5d64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:04.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.369+0000 7f841ddbd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db1b5bfdc0 0x55db1b5e1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:04.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.369+0000 7f841ddbd740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db1b5ca680 0x55db1b5e20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:04.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.369+0000 7f841ddbd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f84141b20a0 con 0x55db1b5bfdc0 2024-09-19T06:25:04.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.369+0000 7f841ddbd740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f84141af970 con 0x55db1b5bf4a0 2024-09-19T06:25:04.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.369+0000 7f841ddbd740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f84141ad7e0 con 0x55db1b5ca680 2024-09-19T06:25:04.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.369+0000 7f8418f7f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db1b5bfdc0 0x55db1b5e1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:04.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.369+0000 7f8418f7f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db1b5bfdc0 0x55db1b5e1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34350/0 (socket says 172.21.15.2:34350) 2024-09-19T06:25:04.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.369+0000 7f8418f7f640 1 -- 172.21.15.2:0/491520616 learned_addr learned my addr 172.21.15.2:0/491520616 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:25:04.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.370+0000 7f8419780640 1 --2- 172.21.15.2:0/491520616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55db1b5bf4a0 0x55db1b5d64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:04.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.370+0000 7f8419f81640 1 --2- 172.21.15.2:0/491520616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db1b5ca680 0x55db1b5e20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:04.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.370+0000 7f8418f7f640 1 -- 172.21.15.2:0/491520616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db1b5ca680 msgr2=0x55db1b5e20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:25:04.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.370+0000 7f8418f7f640 1 --2- 172.21.15.2:0/491520616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db1b5ca680 0x55db1b5e20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:04.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.370+0000 7f8418f7f640 1 -- 172.21.15.2:0/491520616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55db1b5bf4a0 msgr2=0x55db1b5d64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:25:04.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.370+0000 7f8418f7f640 1 --2- 172.21.15.2:0/491520616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55db1b5bf4a0 0x55db1b5d64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:04.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.370+0000 7f8418f7f640 1 -- 172.21.15.2:0/491520616 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db1b5c0330 con 0x55db1b5bfdc0 2024-09-19T06:25:04.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.370+0000 7f8419f81640 1 --2- 172.21.15.2:0/491520616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db1b5ca680 0x55db1b5e20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:25:04.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.370+0000 7f8418f7f640 1 --2- 172.21.15.2:0/491520616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db1b5bfdc0 0x55db1b5e1b60 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f84040b92e0 tx=0x7f84040a7040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f5a634151206ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:04.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.370+0000 7f83feffd640 1 -- 172.21.15.2:0/491520616 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8404049040 con 0x55db1b5bfdc0 2024-09-19T06:25:04.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.370+0000 7f83feffd640 1 -- 172.21.15.2:0/491520616 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f84040a70b0 con 0x55db1b5bfdc0 2024-09-19T06:25:04.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.370+0000 7f83feffd640 1 -- 172.21.15.2:0/491520616 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8404031550 con 0x55db1b5bfdc0 2024-09-19T06:25:04.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.371+0000 7f841ddbd740 1 -- 172.21.15.2:0/491520616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db1b5bfdc0 msgr2=0x55db1b5e1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:04.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.371+0000 7f841ddbd740 1 --2- 172.21.15.2:0/491520616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db1b5bfdc0 0x55db1b5e1b60 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f84040b92e0 tx=0x7f84040a7040 comp rx=0 tx=0).stop 2024-09-19T06:25:04.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.371+0000 7f841ddbd740 1 -- 172.21.15.2:0/491520616 shutdown_connections 2024-09-19T06:25:04.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.371+0000 7f841ddbd740 1 --2- 172.21.15.2:0/491520616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db1b5ca680 0x55db1b5e20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:04.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.371+0000 7f841ddbd740 1 --2- 172.21.15.2:0/491520616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db1b5bfdc0 0x55db1b5e1b60 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:04.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.371+0000 7f841ddbd740 1 --2- 172.21.15.2:0/491520616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55db1b5bf4a0 0x55db1b5d64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:04.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.371+0000 7f841ddbd740 1 -- 172.21.15.2:0/491520616 >> 172.21.15.2:0/491520616 conn(0x55db1b5bba30 msgr2=0x55db1b5c1710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:04.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.371+0000 7f841ddbd740 1 -- 172.21.15.2:0/491520616 shutdown_connections 2024-09-19T06:25:04.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.371+0000 7f841ddbd740 1 -- 172.21.15.2:0/491520616 wait complete. 2024-09-19T06:25:04.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.371+0000 7f841ddbd740 1 -- start start 2024-09-19T06:25:04.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.371+0000 7f841ddbd740 1 Processor -- start 2024-09-19T06:25:04.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.371+0000 7f841ddbd740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db1b5bf4a0 0x55db1b5d2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:04.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.371+0000 7f841ddbd740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db1b5bfdc0 0x55db1b5d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:04.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.372+0000 7f841ddbd740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55db1b5ca680 0x55db1b5c3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:04.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.372+0000 7f841ddbd740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f84141ade30 con 0x55db1b5bfdc0 2024-09-19T06:25:04.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.372+0000 7f841ddbd740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f84141af2a0 con 0x55db1b5ca680 2024-09-19T06:25:04.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.372+0000 7f841ddbd740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f84141ae500 con 0x55db1b5bf4a0 2024-09-19T06:25:04.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.372+0000 7f841ddbd740 10 client.0 _ll_register_callbacks cb 0x7f841001b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:25:04.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.372+0000 7f8418f7f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db1b5bfdc0 0x55db1b5d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:04.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.372+0000 7f8418f7f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db1b5bfdc0 0x55db1b5d2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34366/0 (socket says 172.21.15.2:34366) 2024-09-19T06:25:04.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.372+0000 7f8418f7f640 1 -- 172.21.15.2:0/1326572171 learned_addr learned my addr 172.21.15.2:0/1326572171 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:25:04.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.372+0000 7f8419780640 1 --2- 172.21.15.2:0/1326572171 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db1b5bf4a0 0x55db1b5d2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:04.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.372+0000 7f8419f81640 1 --2- 172.21.15.2:0/1326572171 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55db1b5ca680 0x55db1b5c3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:04.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.372+0000 7f8418f7f640 1 -- 172.21.15.2:0/1326572171 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db1b5bf4a0 msgr2=0x55db1b5d2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:25:04.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.372+0000 7f8418f7f640 1 --2- 172.21.15.2:0/1326572171 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db1b5bf4a0 0x55db1b5d2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:04.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.372+0000 7f8418f7f640 1 -- 172.21.15.2:0/1326572171 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55db1b5ca680 msgr2=0x55db1b5c3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:25:04.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.372+0000 7f8418f7f640 1 --2- 172.21.15.2:0/1326572171 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55db1b5ca680 0x55db1b5c3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:04.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.372+0000 7f8418f7f640 1 -- 172.21.15.2:0/1326572171 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db1b5c42a0 con 0x55db1b5bfdc0 2024-09-19T06:25:04.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.372+0000 7f8418f7f640 1 --2- 172.21.15.2:0/1326572171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db1b5bfdc0 0x55db1b5d2d40 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f84040ede30 tx=0x7f8404009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=504f399fc167f51 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:04.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.372+0000 7f83fcff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:25:04.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.372+0000 7f83fcff9640 1 -- 172.21.15.2:0/1326572171 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8404049040 con 0x55db1b5bfdc0 2024-09-19T06:25:04.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.372+0000 7f83fcff9640 1 -- 172.21.15.2:0/1326572171 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7f84040ee000 con 0x55db1b5bfdc0 2024-09-19T06:25:04.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.372+0000 7f841ddbd740 1 -- 172.21.15.2:0/1326572171 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55db1b52cd60 con 0x55db1b5bfdc0 2024-09-19T06:25:04.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.372+0000 7f83fcff9640 1 -- 172.21.15.2:0/1326572171 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f84040bd010 con 0x55db1b5bfdc0 2024-09-19T06:25:04.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.373+0000 7f841ddbd740 10 client.18975 fetch_fsmap learned FSMap version 26 2024-09-19T06:25:04.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.373+0000 7f841ddbd740 1 -- 172.21.15.2:0/1326572171 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55db1b6445c0 con 0x55db1b5bfdc0 2024-09-19T06:25:04.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.373+0000 7f83fcff9640 1 -- 172.21.15.2:0/1326572171 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55db1b52cd60 con 0x55db1b5bfdc0 2024-09-19T06:25:04.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.374+0000 7f83fcff9640 1 -- 172.21.15.2:0/1326572171 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f84040bcc40 con 0x55db1b5bfdc0 2024-09-19T06:25:04.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.374+0000 7f841ddbd740 10 client.18975 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:25:04.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.374+0000 7f841ddbd740 10 client.18975 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:25:04.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.374+0000 7f841ddbd740 20 client.18975 populate_metadata read hostname 'smithi002' 2024-09-19T06:25:04.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.374+0000 7f841ddbd740 1 --2- 172.21.15.2:0/1326572171 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55db1b644bd0 0x55db1b646ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:04.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.374+0000 7f841ddbd740 4 client.18975 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:25:04.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.374+0000 7f841ddbd740 1 -- 172.21.15.2:0/1326572171 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55db1b4a9210 con 0x55db1b644bd0 2024-09-19T06:25:04.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.374+0000 7f8419780640 1 --2- 172.21.15.2:0/1326572171 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55db1b644bd0 0x55db1b646ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:04.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.374+0000 7f8419780640 1 --2- 172.21.15.2:0/1326572171 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55db1b644bd0 0x55db1b646ff0 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc6a8235976e6622 server_cookie=9842639dfc3062e in_seq=0 out_seq=0 2024-09-19T06:25:04.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.374+0000 7f83fcff9640 10 client.18975 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:25:04.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.375+0000 7f83fcff9640 1 -- 172.21.15.2:0/1326572171 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55db1b4a9210 con 0x55db1b644bd0 2024-09-19T06:25:04.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.375+0000 7f83fcff9640 10 client.18975 handle_command_reply: tid=0 2024-09-19T06:25:04.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.375+0000 7f841ddbd740 1 client.18975 shutdown 2024-09-19T06:25:04.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.375+0000 7f841ddbd740 1 -- 172.21.15.2:0/1326572171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db1b5bfdc0 msgr2=0x55db1b5d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:04.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.375+0000 7f841ddbd740 1 --2- 172.21.15.2:0/1326572171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db1b5bfdc0 0x55db1b5d2d40 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f84040ede30 tx=0x7f8404009680 comp rx=0 tx=0).stop 2024-09-19T06:25:04.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.375+0000 7f841ddbd740 1 -- 172.21.15.2:0/1326572171 shutdown_connections 2024-09-19T06:25:04.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.375+0000 7f841ddbd740 1 --2- 172.21.15.2:0/1326572171 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x55db1b644bd0 0x55db1b646ff0 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:04.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.375+0000 7f841ddbd740 1 --2- 172.21.15.2:0/1326572171 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55db1b5ca680 0x55db1b5c3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:04.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.375+0000 7f841ddbd740 1 --2- 172.21.15.2:0/1326572171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db1b5bfdc0 0x55db1b5d2d40 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:04.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.375+0000 7f841ddbd740 1 --2- 172.21.15.2:0/1326572171 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db1b5bf4a0 0x55db1b5d2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:04.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.375+0000 7f841ddbd740 1 -- 172.21.15.2:0/1326572171 >> 172.21.15.2:0/1326572171 conn(0x55db1b5bba30 msgr2=0x55db1b5c8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:04.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.375+0000 7f83fcff9640 0 client.18975 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:25:04.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.375+0000 7f841ddbd740 1 -- 172.21.15.2:0/1326572171 shutdown_connections 2024-09-19T06:25:04.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.375+0000 7f841ddbd740 1 -- 172.21.15.2:0/1326572171 wait complete. 2024-09-19T06:25:04.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.375+0000 7f841ddbd740 20 client.18975 trim_cache size 0 max 16384 2024-09-19T06:25:04.393 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:25:04.393 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-09-19T06:25:04.393 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-09-19T06:25:04.394 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:25:04.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.376+0000 7f841b9e4640 1 -- 172.21.15.2:0/668909276 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f84000a33b0 msgr2=0x7f84000a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:04.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.376+0000 7f841b9e4640 1 --2- 172.21.15.2:0/668909276 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f84000a33b0 0x7f84000a5870 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f840c007f30 tx=0x7f840c004a40 comp rx=0 tx=0).stop 2024-09-19T06:25:04.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.376+0000 7f841b9e4640 1 -- 172.21.15.2:0/668909276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8414102570 msgr2=0x7f841419aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:04.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.376+0000 7f841b9e4640 1 --2- 172.21.15.2:0/668909276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8414102570 0x7f841419aa60 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f8404006010 tx=0x7f8404003d50 comp rx=0 tx=0).stop 2024-09-19T06:25:04.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.376+0000 7f841b9e4640 1 -- 172.21.15.2:0/668909276 shutdown_connections 2024-09-19T06:25:04.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.376+0000 7f841b9e4640 1 --2- 172.21.15.2:0/668909276 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f84000a33b0 0x7f84000a5870 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:04.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.376+0000 7f841b9e4640 1 --2- 172.21.15.2:0/668909276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8414102ef0 0x7f841419edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:04.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.376+0000 7f841b9e4640 1 --2- 172.21.15.2:0/668909276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8414102570 0x7f841419aa60 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:04.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.376+0000 7f841b9e4640 1 --2- 172.21.15.2:0/668909276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8414100e20 0x7f841419a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:04.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.376+0000 7f841b9e4640 1 -- 172.21.15.2:0/668909276 >> 172.21.15.2:0/668909276 conn(0x7f84140fc7d0 msgr2=0x7f8414069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:04.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.376+0000 7f841b9e4640 1 -- 172.21.15.2:0/668909276 shutdown_connections 2024-09-19T06:25:04.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:04.376+0000 7f841b9e4640 1 -- 172.21.15.2:0/668909276 wait complete. 2024-09-19T06:25:05.171 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:25:05.171 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:25:05.435 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:25:05.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:05 smithi002 ceph-mon[30982]: pgmap v319: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-09-19T06:25:05.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:05 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:25:05.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:05 smithi090 ceph-mon[34497]: pgmap v319: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-09-19T06:25:05.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:05 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:25:05.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:05 smithi089 ceph-mon[34160]: pgmap v319: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-09-19T06:25:05.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:05 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:25:05.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:05.871+0000 7f62d0ee4640 1 -- 172.21.15.2:0/3190292114 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62cc101420 msgr2=0x7f62cc10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:05.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:05.871+0000 7f62d0ee4640 1 --2- 172.21.15.2:0/3190292114 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62cc101420 0x7f62cc10d950 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f62c4009930 tx=0x7f62c402a420 comp rx=0 tx=0).stop 2024-09-19T06:25:05.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:05.871+0000 7f62d0ee4640 1 -- 172.21.15.2:0/3190292114 shutdown_connections 2024-09-19T06:25:05.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:05.871+0000 7f62d0ee4640 1 --2- 172.21.15.2:0/3190292114 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62cc101420 0x7f62cc10d950 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:05.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:05.871+0000 7f62d0ee4640 1 --2- 172.21.15.2:0/3190292114 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62cc100a80 0x7f62cc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:05.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:05.871+0000 7f62d0ee4640 1 --2- 172.21.15.2:0/3190292114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62cc106a80 0x7f62cc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:05.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:05.871+0000 7f62d0ee4640 1 -- 172.21.15.2:0/3190292114 >> 172.21.15.2:0/3190292114 conn(0x7f62cc0fc7a0 msgr2=0x7f62cc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:05.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:05.871+0000 7f62d0ee4640 1 -- 172.21.15.2:0/3190292114 shutdown_connections 2024-09-19T06:25:05.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:05.871+0000 7f62d0ee4640 1 -- 172.21.15.2:0/3190292114 wait complete. 2024-09-19T06:25:05.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:05.872+0000 7f62d0ee4640 1 Processor -- start 2024-09-19T06:25:05.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:05.872+0000 7f62d0ee4640 1 -- start start 2024-09-19T06:25:05.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:05.873+0000 7f62d0ee4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62cc100a80 0x7f62cc197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:05.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:05.873+0000 7f62d0ee4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62cc101420 0x7f62cc1977b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:05.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:05.873+0000 7f62d0ee4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62cc106a80 0x7f62cc19bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:05.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:05.873+0000 7f62d0ee4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f62cc110d30 con 0x7f62cc106a80 2024-09-19T06:25:05.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:05.873+0000 7f62d0ee4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f62cc110bb0 con 0x7f62cc101420 2024-09-19T06:25:05.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:05.873+0000 7f62d0ee4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f62cc110eb0 con 0x7f62cc100a80 2024-09-19T06:25:05.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:05.873+0000 7f62cad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62cc106a80 0x7f62cc19bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:05.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:05.873+0000 7f62cad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62cc106a80 0x7f62cc19bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52366/0 (socket says 172.21.15.2:52366) 2024-09-19T06:25:05.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:05.873+0000 7f62c9d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62cc101420 0x7f62cc1977b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:05.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:05.873+0000 7f62cad9d640 1 -- 172.21.15.2:0/1348576371 learned_addr learned my addr 172.21.15.2:0/1348576371 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:25:05.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:05.873+0000 7f62ca59c640 1 --2- 172.21.15.2:0/1348576371 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62cc100a80 0x7f62cc197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:05.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:05.873+0000 7f62c9d9b640 1 -- 172.21.15.2:0/1348576371 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62cc100a80 msgr2=0x7f62cc197270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:05.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:05.873+0000 7f62c9d9b640 1 --2- 172.21.15.2:0/1348576371 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62cc100a80 0x7f62cc197270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:05.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:05.873+0000 7f62c9d9b640 1 -- 172.21.15.2:0/1348576371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62cc106a80 msgr2=0x7f62cc19bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:05.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:05.873+0000 7f62c9d9b640 1 --2- 172.21.15.2:0/1348576371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62cc106a80 0x7f62cc19bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:05.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:05.873+0000 7f62c9d9b640 1 -- 172.21.15.2:0/1348576371 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62cc19c220 con 0x7f62cc101420 2024-09-19T06:25:05.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:05.873+0000 7f62cad9d640 1 --2- 172.21.15.2:0/1348576371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62cc106a80 0x7f62cc19bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:25:05.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:05.874+0000 7f62c9d9b640 1 --2- 172.21.15.2:0/1348576371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62cc101420 0x7f62cc1977b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f62c0009fd0 tx=0x7f62c000b690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:05.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:05.874+0000 7f62bb7fe640 1 -- 172.21.15.2:0/1348576371 <== mon.2 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c000be60 con 0x7f62cc101420 2024-09-19T06:25:05.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:05.874+0000 7f62bb7fe640 1 -- 172.21.15.2:0/1348576371 <== mon.2 v2:172.21.15.89:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f62c0017520 con 0x7f62cc101420 2024-09-19T06:25:05.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:05.874+0000 7f62d0ee4640 1 -- 172.21.15.2:0/1348576371 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62cc19c510 con 0x7f62cc101420 2024-09-19T06:25:05.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:05.874+0000 7f62bb7fe640 1 -- 172.21.15.2:0/1348576371 <== mon.2 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c00197c0 con 0x7f62cc101420 2024-09-19T06:25:05.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:05.874+0000 7f62d0ee4640 1 -- 172.21.15.2:0/1348576371 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62cc06a790 con 0x7f62cc101420 2024-09-19T06:25:05.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:05.875+0000 7f62d0ee4640 1 -- 172.21.15.2:0/1348576371 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62cc100ee0 con 0x7f62cc101420 2024-09-19T06:25:05.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:05.876+0000 7f62bb7fe640 1 -- 172.21.15.2:0/1348576371 <== mon.2 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f62c00176d0 con 0x7f62cc101420 2024-09-19T06:25:05.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:05.877+0000 7f62bb7fe640 1 --2- 172.21.15.2:0/1348576371 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f62b40a3430 0x7f62b40a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:05.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:05.877+0000 7f62ca59c640 1 --2- 172.21.15.2:0/1348576371 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f62b40a3430 0x7f62b40a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:05.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:05.877+0000 7f62bb7fe640 1 -- 172.21.15.2:0/1348576371 <== mon.2 v2:172.21.15.89:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7f62c00d3e60 con 0x7f62cc101420 2024-09-19T06:25:05.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:05.877+0000 7f62ca59c640 1 --2- 172.21.15.2:0/1348576371 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f62b40a3430 0x7f62b40a58f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f62bc009b50 tx=0x7f62bc005f90 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:05.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:05.880+0000 7f62bb7fe640 1 -- 172.21.15.2:0/1348576371 <== mon.2 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f62c00a0190 con 0x7f62cc101420 2024-09-19T06:25:06.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:06.099+0000 7f62d0ee4640 1 -- 172.21.15.2:0/1348576371 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f62cc06b1e0 con 0x7f62cc101420 2024-09-19T06:25:06.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:06.100+0000 7f62bb7fe640 1 -- 172.21.15.2:0/1348576371 <== mon.2 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11882 (secure 0 0 0) 0x7f62c00a4490 con 0x7f62cc101420 2024-09-19T06:25:06.102 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:25:06.102 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-09-19T06:14:49:104280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:14:48.191083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24470,24472,24497]},"id":1}]} 2024-09-19T06:25:06.103 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-09-19T06:25:06.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:06.102+0000 7f62d0ee4640 1 -- 172.21.15.2:0/1348576371 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f62b40a3430 msgr2=0x7f62b40a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:06.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:06.102+0000 7f62d0ee4640 1 --2- 172.21.15.2:0/1348576371 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f62b40a3430 0x7f62b40a58f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f62bc009b50 tx=0x7f62bc005f90 comp rx=0 tx=0).stop 2024-09-19T06:25:06.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:06.102+0000 7f62d0ee4640 1 -- 172.21.15.2:0/1348576371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62cc101420 msgr2=0x7f62cc1977b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:06.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:06.102+0000 7f62d0ee4640 1 --2- 172.21.15.2:0/1348576371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62cc101420 0x7f62cc1977b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f62c0009fd0 tx=0x7f62c000b690 comp rx=0 tx=0).stop 2024-09-19T06:25:06.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:06.102+0000 7f62d0ee4640 1 -- 172.21.15.2:0/1348576371 shutdown_connections 2024-09-19T06:25:06.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:06.102+0000 7f62d0ee4640 1 --2- 172.21.15.2:0/1348576371 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f62b40a3430 0x7f62b40a58f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:06.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:06.102+0000 7f62d0ee4640 1 --2- 172.21.15.2:0/1348576371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62cc106a80 0x7f62cc19bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:06.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:06.102+0000 7f62d0ee4640 1 --2- 172.21.15.2:0/1348576371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62cc101420 0x7f62cc1977b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:06.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:06.102+0000 7f62d0ee4640 1 --2- 172.21.15.2:0/1348576371 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62cc100a80 0x7f62cc197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:06.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:06.102+0000 7f62d0ee4640 1 -- 172.21.15.2:0/1348576371 >> 172.21.15.2:0/1348576371 conn(0x7f62cc0fc7a0 msgr2=0x7f62cc0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:06.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:06.102+0000 7f62d0ee4640 1 -- 172.21.15.2:0/1348576371 shutdown_connections 2024-09-19T06:25:06.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:06.102+0000 7f62d0ee4640 1 -- 172.21.15.2:0/1348576371 wait complete. 2024-09-19T06:25:06.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:06 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1348576371' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:25:06.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:06 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1348576371' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:25:06.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:06 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1348576371' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:25:07.357 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:25:07.643 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:25:07.912 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:07 smithi002 ceph-mon[30982]: pgmap v320: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T06:25:07.912 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:07 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:25:07.912 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:07 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:25:07.912 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:07 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:25:07.912 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:07 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:25:07.912 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:07 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:25:07.912 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:07 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:25:07.912 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:07 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:25:07.912 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:07 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:25:07.912 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:07 smithi002 ceph-mon[30982]: Adjusting osd_memory_target on smithi090 to 176.0M 2024-09-19T06:25:07.913 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:07 smithi002 ceph-mon[30982]: Unable to set osd_memory_target on smithi090 to 184555212: error parsing value: Value '184555212' is below minimum 939524096 2024-09-19T06:25:07.913 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:07 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:25:07.913 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:07 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:25:07.913 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:07 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:25:07.913 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:07 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:25:07.913 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:07 smithi002 ceph-mon[30982]: Adjusting osd_memory_target on smithi089 to 175.9M 2024-09-19T06:25:07.913 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:07 smithi002 ceph-mon[30982]: Unable to set osd_memory_target on smithi089 to 184520806: error parsing value: Value '184520806' is below minimum 939524096 2024-09-19T06:25:07.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:07 smithi090 ceph-mon[34497]: pgmap v320: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T06:25:07.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:07 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:25:07.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:07 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:25:07.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:07 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:25:07.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:07 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:25:07.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:07 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:25:07.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:07 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:25:07.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:07 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:25:07.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:07 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:25:07.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:07 smithi090 ceph-mon[34497]: Adjusting osd_memory_target on smithi090 to 176.0M 2024-09-19T06:25:07.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:07 smithi090 ceph-mon[34497]: Unable to set osd_memory_target on smithi090 to 184555212: error parsing value: Value '184555212' is below minimum 939524096 2024-09-19T06:25:07.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:07 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:25:07.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:07 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:25:07.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:07 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:25:07.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:07 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:25:07.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:07 smithi090 ceph-mon[34497]: Adjusting osd_memory_target on smithi089 to 175.9M 2024-09-19T06:25:07.991 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:07 smithi090 ceph-mon[34497]: Unable to set osd_memory_target on smithi089 to 184520806: error parsing value: Value '184520806' is below minimum 939524096 2024-09-19T06:25:08.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:07 smithi089 ceph-mon[34160]: pgmap v320: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T06:25:08.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:07 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:25:08.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:07 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:25:08.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:07 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:25:08.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:07 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:25:08.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:07 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:25:08.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:07 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:25:08.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:07 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:25:08.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:07 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:25:08.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:07 smithi089 ceph-mon[34160]: Adjusting osd_memory_target on smithi090 to 176.0M 2024-09-19T06:25:08.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:07 smithi089 ceph-mon[34160]: Unable to set osd_memory_target on smithi090 to 184555212: error parsing value: Value '184555212' is below minimum 939524096 2024-09-19T06:25:08.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:07 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:25:08.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:07 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:25:08.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:07 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:25:08.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:07 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:25:08.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:07 smithi089 ceph-mon[34160]: Adjusting osd_memory_target on smithi089 to 175.9M 2024-09-19T06:25:08.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:07 smithi089 ceph-mon[34160]: Unable to set osd_memory_target on smithi089 to 184520806: error parsing value: Value '184520806' is below minimum 939524096 2024-09-19T06:25:08.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.103+0000 7f22d3967640 1 -- 172.21.15.2:0/1958525531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22cc074eb0 msgr2=0x7f22cc112650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:08.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.103+0000 7f22d3967640 1 --2- 172.21.15.2:0/1958525531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22cc074eb0 0x7f22cc112650 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f22bc009900 tx=0x7f22bc02a480 comp rx=0 tx=0).stop 2024-09-19T06:25:08.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.103+0000 7f22d3967640 1 -- 172.21.15.2:0/1958525531 shutdown_connections 2024-09-19T06:25:08.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.103+0000 7f22d3967640 1 --2- 172.21.15.2:0/1958525531 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22cc112b90 0x7f22cc114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:08.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.103+0000 7f22d3967640 1 --2- 172.21.15.2:0/1958525531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22cc074eb0 0x7f22cc112650 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:08.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.103+0000 7f22d3967640 1 --2- 172.21.15.2:0/1958525531 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22cc074590 0x7f22cc074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:08.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.103+0000 7f22d3967640 1 -- 172.21.15.2:0/1958525531 >> 172.21.15.2:0/1958525531 conn(0x7f22cc0fd8c0 msgr2=0x7f22cc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:08.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.104+0000 7f22d3967640 1 -- 172.21.15.2:0/1958525531 shutdown_connections 2024-09-19T06:25:08.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.104+0000 7f22d3967640 1 -- 172.21.15.2:0/1958525531 wait complete. 2024-09-19T06:25:08.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.104+0000 7f22d3967640 1 Processor -- start 2024-09-19T06:25:08.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.104+0000 7f22d3967640 1 -- start start 2024-09-19T06:25:08.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.105+0000 7f22d3967640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22cc074590 0x7f22cc1a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:08.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.105+0000 7f22d3967640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22cc074eb0 0x7f22cc1a4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:08.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.105+0000 7f22d3967640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22cc112b90 0x7f22cc19e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:08.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.105+0000 7f22d3967640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc118410 con 0x7f22cc112b90 2024-09-19T06:25:08.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.105+0000 7f22d3967640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc118290 con 0x7f22cc074590 2024-09-19T06:25:08.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.105+0000 7f22d3967640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc118590 con 0x7f22cc074eb0 2024-09-19T06:25:08.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.105+0000 7f22d1f04640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22cc112b90 0x7f22cc19e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:08.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.105+0000 7f22d1f04640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22cc112b90 0x7f22cc19e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52390/0 (socket says 172.21.15.2:52390) 2024-09-19T06:25:08.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.105+0000 7f22d1f04640 1 -- 172.21.15.2:0/3914220878 learned_addr learned my addr 172.21.15.2:0/3914220878 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:25:08.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.105+0000 7f22d0f02640 1 --2- 172.21.15.2:0/3914220878 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22cc074eb0 0x7f22cc1a4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:08.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.105+0000 7f22d1703640 1 --2- 172.21.15.2:0/3914220878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22cc074590 0x7f22cc1a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:08.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.105+0000 7f22d1f04640 1 -- 172.21.15.2:0/3914220878 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22cc074eb0 msgr2=0x7f22cc1a4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:08.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.105+0000 7f22d1f04640 1 --2- 172.21.15.2:0/3914220878 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22cc074eb0 0x7f22cc1a4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:08.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.105+0000 7f22d1f04640 1 -- 172.21.15.2:0/3914220878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22cc074590 msgr2=0x7f22cc1a46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:08.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.105+0000 7f22d1f04640 1 --2- 172.21.15.2:0/3914220878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22cc074590 0x7f22cc1a46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:08.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.105+0000 7f22d1f04640 1 -- 172.21.15.2:0/3914220878 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22cc19efc0 con 0x7f22cc112b90 2024-09-19T06:25:08.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.106+0000 7f22d1f04640 1 --2- 172.21.15.2:0/3914220878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22cc112b90 0x7f22cc19e820 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f22c400cad0 tx=0x7f22c400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:08.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.106+0000 7f22c27fc640 1 -- 172.21.15.2:0/3914220878 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c400ae20 con 0x7f22cc112b90 2024-09-19T06:25:08.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.106+0000 7f22c27fc640 1 -- 172.21.15.2:0/3914220878 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f22c4003e40 con 0x7f22cc112b90 2024-09-19T06:25:08.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.106+0000 7f22d3967640 1 -- 172.21.15.2:0/3914220878 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22cc19f2b0 con 0x7f22cc112b90 2024-09-19T06:25:08.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.106+0000 7f22c27fc640 1 -- 172.21.15.2:0/3914220878 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c400f6b0 con 0x7f22cc112b90 2024-09-19T06:25:08.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.106+0000 7f22d3967640 1 -- 172.21.15.2:0/3914220878 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22cc1ab500 con 0x7f22cc112b90 2024-09-19T06:25:08.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.108+0000 7f22c27fc640 1 -- 172.21.15.2:0/3914220878 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f22c4004000 con 0x7f22cc112b90 2024-09-19T06:25:08.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.109+0000 7f22d5d40740 1 Processor -- start 2024-09-19T06:25:08.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.109+0000 7f22d5d40740 1 -- start start 2024-09-19T06:25:08.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.109+0000 7f22d5d40740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f8960eb40 0x562f8960d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:08.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.109+0000 7f22d5d40740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f8960d5d0 0x562f8960da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:08.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.109+0000 7f22d5d40740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f89618370 0x562f8961a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:08.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.109+0000 7f22d5d40740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562f895732f0 con 0x562f89618370 2024-09-19T06:25:08.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.109+0000 7f22d5d40740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562f8951acf0 con 0x562f8960d5d0 2024-09-19T06:25:08.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.109+0000 7f22d5d40740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562f8956f2b0 con 0x562f8960eb40 2024-09-19T06:25:08.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.109+0000 7f22c27fc640 1 --2- 172.21.15.2:0/3914220878 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f22b80a33b0 0x7f22b80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:08.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.109+0000 7f22d1f04640 1 --2- 172.21.15.2:0/3914220878 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f22b80a33b0 0x7f22b80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:08.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.109+0000 7f22d0f02640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f89618370 0x562f8961a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:08.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.109+0000 7f22d0f02640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f89618370 0x562f8961a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52398/0 (socket says 172.21.15.2:52398) 2024-09-19T06:25:08.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.109+0000 7f22d0f02640 1 -- 172.21.15.2:0/2615191476 learned_addr learned my addr 172.21.15.2:0/2615191476 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:25:08.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.109+0000 7f22d0f02640 1 --2- 172.21.15.2:0/2615191476 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f8960eb40 0x562f8960d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:08.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.109+0000 7f22d1703640 1 --2- 172.21.15.2:0/2615191476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f8960d5d0 0x562f8960da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:08.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.109+0000 7f22c27fc640 1 -- 172.21.15.2:0/3914220878 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7f22c40cffd0 con 0x7f22cc112b90 2024-09-19T06:25:08.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.110+0000 7f22d0f02640 1 -- 172.21.15.2:0/2615191476 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f8960eb40 msgr2=0x562f8960d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:25:08.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.110+0000 7f22d0f02640 1 --2- 172.21.15.2:0/2615191476 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f8960eb40 0x562f8960d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:08.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.110+0000 7f22d0f02640 1 -- 172.21.15.2:0/2615191476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f8960d5d0 msgr2=0x562f8960da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:25:08.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.110+0000 7f22d0f02640 1 --2- 172.21.15.2:0/2615191476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f8960d5d0 0x562f8960da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:08.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.110+0000 7f22d0f02640 1 -- 172.21.15.2:0/2615191476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f894ff3a0 con 0x562f89618370 2024-09-19T06:25:08.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.110+0000 7f22d1f04640 1 --2- 172.21.15.2:0/3914220878 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f22b80a33b0 0x7f22b80a5870 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f22c4098760 tx=0x7f22c409f040 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:08.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.110+0000 7f22d0f02640 1 --2- 172.21.15.2:0/2615191476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f89618370 0x562f8961a760 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f22bc02a9a0 tx=0x7f22bc005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6f3587be8a1d0b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:08.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.110+0000 7f22b77fe640 1 -- 172.21.15.2:0/2615191476 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22bc035070 con 0x562f89618370 2024-09-19T06:25:08.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.110+0000 7f22b77fe640 1 -- 172.21.15.2:0/2615191476 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f22bc0035f0 con 0x562f89618370 2024-09-19T06:25:08.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.110+0000 7f22b77fe640 1 -- 172.21.15.2:0/2615191476 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22bc0044e0 con 0x562f89618370 2024-09-19T06:25:08.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.111+0000 7f22d5d40740 1 -- 172.21.15.2:0/2615191476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f89618370 msgr2=0x562f8961a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:08.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.111+0000 7f22d5d40740 1 --2- 172.21.15.2:0/2615191476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f89618370 0x562f8961a760 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f22bc02a9a0 tx=0x7f22bc005db0 comp rx=0 tx=0).stop 2024-09-19T06:25:08.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.111+0000 7f22d5d40740 1 -- 172.21.15.2:0/2615191476 shutdown_connections 2024-09-19T06:25:08.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.111+0000 7f22d5d40740 1 --2- 172.21.15.2:0/2615191476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f89618370 0x562f8961a760 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:08.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.111+0000 7f22d5d40740 1 --2- 172.21.15.2:0/2615191476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f8960d5d0 0x562f8960da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:08.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.111+0000 7f22d5d40740 1 --2- 172.21.15.2:0/2615191476 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f8960eb40 0x562f8960d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:08.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.111+0000 7f22d5d40740 1 -- 172.21.15.2:0/2615191476 >> 172.21.15.2:0/2615191476 conn(0x562f895d6310 msgr2=0x562f89609c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:08.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.111+0000 7f22d5d40740 1 -- 172.21.15.2:0/2615191476 shutdown_connections 2024-09-19T06:25:08.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.111+0000 7f22d5d40740 1 -- 172.21.15.2:0/2615191476 wait complete. 2024-09-19T06:25:08.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.111+0000 7f22d5d40740 1 -- start start 2024-09-19T06:25:08.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.111+0000 7f22d5d40740 1 Processor -- start 2024-09-19T06:25:08.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.112+0000 7f22d5d40740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f8960d5d0 0x562f89617dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:08.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.112+0000 7f22d5d40740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f8960eb40 0x562f89615070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:08.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.112+0000 7f22d5d40740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f89618370 0x562f89615800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:08.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.112+0000 7f22d5d40740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562f8961b010 con 0x562f8960d5d0 2024-09-19T06:25:08.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.112+0000 7f22d5d40740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562f8952e060 con 0x562f8960eb40 2024-09-19T06:25:08.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.112+0000 7f22d5d40740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562f8961b190 con 0x562f89618370 2024-09-19T06:25:08.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.112+0000 7f22d5d40740 10 client.0 _ll_register_callbacks cb 0x562f892818c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:25:08.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.112+0000 7f22d0f02640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f8960d5d0 0x562f89617dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:08.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.112+0000 7f22d0f02640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f8960d5d0 0x562f89617dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52412/0 (socket says 172.21.15.2:52412) 2024-09-19T06:25:08.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.112+0000 7f22d0f02640 1 -- 172.21.15.2:0/2676215595 learned_addr learned my addr 172.21.15.2:0/2676215595 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:25:08.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.112+0000 7f22d1703640 1 --2- 172.21.15.2:0/2676215595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f8960eb40 0x562f89615070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:08.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.112+0000 7f22d0f02640 1 --2- 172.21.15.2:0/2676215595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f89618370 0x562f89615800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:08.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.112+0000 7f22d0f02640 1 -- 172.21.15.2:0/2676215595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f89618370 msgr2=0x562f89615800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:25:08.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.112+0000 7f22d0f02640 1 --2- 172.21.15.2:0/2676215595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f89618370 0x562f89615800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:08.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.112+0000 7f22d0f02640 1 -- 172.21.15.2:0/2676215595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f8960eb40 msgr2=0x562f89615070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:25:08.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.112+0000 7f22d0f02640 1 --2- 172.21.15.2:0/2676215595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f8960eb40 0x562f89615070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:08.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.112+0000 7f22d0f02640 1 -- 172.21.15.2:0/2676215595 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f892e43c0 con 0x562f8960d5d0 2024-09-19T06:25:08.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.112+0000 7f22d0f02640 1 --2- 172.21.15.2:0/2676215595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f8960d5d0 0x562f89617dc0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f22bc032cb0 tx=0x7f22bc02a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2892b71ace55dd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:08.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.112+0000 7f22b4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:25:08.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.113+0000 7f22b4ff9640 1 -- 172.21.15.2:0/2676215595 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22bc051030 con 0x562f8960d5d0 2024-09-19T06:25:08.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.113+0000 7f22b4ff9640 1 -- 172.21.15.2:0/2676215595 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7f22bc042070 con 0x562f8960d5d0 2024-09-19T06:25:08.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.113+0000 7f22d5d40740 1 -- 172.21.15.2:0/2676215595 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22bc0035f0 con 0x562f8960d5d0 2024-09-19T06:25:08.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.113+0000 7f22b4ff9640 1 -- 172.21.15.2:0/2676215595 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f22bc041030 con 0x562f8960d5d0 2024-09-19T06:25:08.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.113+0000 7f22d5d40740 10 client.18993 fetch_fsmap learned FSMap version 26 2024-09-19T06:25:08.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.113+0000 7f22d5d40740 1 -- 172.21.15.2:0/2676215595 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562f89626b20 con 0x562f8960d5d0 2024-09-19T06:25:08.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.113+0000 7f22b4ff9640 1 -- 172.21.15.2:0/2676215595 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f22bc0035f0 con 0x562f8960d5d0 2024-09-19T06:25:08.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.113+0000 7f22b4ff9640 1 -- 172.21.15.2:0/2676215595 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f22bc005140 con 0x562f8960d5d0 2024-09-19T06:25:08.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.113+0000 7f22d5d40740 10 client.18993 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:25:08.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.113+0000 7f22d5d40740 10 client.18993 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:25:08.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.113+0000 7f22d5d40740 20 client.18993 populate_metadata read hostname 'smithi002' 2024-09-19T06:25:08.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.113+0000 7f22d5d40740 1 --2- 172.21.15.2:0/2676215595 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x562f89627e70 0x562f8962a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:08.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.113+0000 7f22d5d40740 4 client.18993 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:25:08.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.113+0000 7f22d5d40740 1 -- 172.21.15.2:0/2676215595 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f89580860 con 0x562f89627e70 2024-09-19T06:25:08.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.114+0000 7f22d1703640 1 --2- 172.21.15.2:0/2676215595 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x562f89627e70 0x562f8962a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:08.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.114+0000 7f22d1703640 1 --2- 172.21.15.2:0/2676215595 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x562f89627e70 0x562f8962a260 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=88ac200f962e1b4 server_cookie=12dacb1d692f2405 in_seq=0 out_seq=0 2024-09-19T06:25:08.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.114+0000 7f22b4ff9640 10 client.18993 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:25:08.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.115+0000 7f22b4ff9640 1 -- 172.21.15.2:0/2676215595 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562f89580860 con 0x562f89627e70 2024-09-19T06:25:08.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.115+0000 7f22b4ff9640 10 client.18993 handle_command_reply: tid=0 2024-09-19T06:25:08.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.115+0000 7f22d5d40740 1 client.18993 shutdown 2024-09-19T06:25:08.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.115+0000 7f22d5d40740 1 -- 172.21.15.2:0/2676215595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f8960d5d0 msgr2=0x562f89617dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:08.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.115+0000 7f22d5d40740 1 --2- 172.21.15.2:0/2676215595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f8960d5d0 0x562f89617dc0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f22bc032cb0 tx=0x7f22bc02a480 comp rx=0 tx=0).stop 2024-09-19T06:25:08.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.115+0000 7f22d5d40740 1 -- 172.21.15.2:0/2676215595 shutdown_connections 2024-09-19T06:25:08.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.115+0000 7f22d5d40740 1 --2- 172.21.15.2:0/2676215595 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x562f89627e70 0x562f8962a260 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:08.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.115+0000 7f22d5d40740 1 --2- 172.21.15.2:0/2676215595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f89618370 0x562f89615800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:08.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.115+0000 7f22d5d40740 1 --2- 172.21.15.2:0/2676215595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f8960eb40 0x562f89615070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:08.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.115+0000 7f22d5d40740 1 --2- 172.21.15.2:0/2676215595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f8960d5d0 0x562f89617dc0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:08.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.115+0000 7f22d5d40740 1 -- 172.21.15.2:0/2676215595 >> 172.21.15.2:0/2676215595 conn(0x562f895d6310 msgr2=0x562f8960f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:08.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.115+0000 7f22b4ff9640 0 client.18993 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:25:08.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.115+0000 7f22d5d40740 1 -- 172.21.15.2:0/2676215595 shutdown_connections 2024-09-19T06:25:08.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.115+0000 7f22d5d40740 1 -- 172.21.15.2:0/2676215595 wait complete. 2024-09-19T06:25:08.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.115+0000 7f22d5d40740 20 client.18993 trim_cache size 0 max 16384 2024-09-19T06:25:08.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.128+0000 7f22d5d40740 1 Processor -- start 2024-09-19T06:25:08.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.128+0000 7f22d5d40740 1 -- start start 2024-09-19T06:25:08.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.129+0000 7f22d5d40740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f8960d5d0 0x562f89609e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:08.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.129+0000 7f22d5d40740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f8960eb40 0x562f8962cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:08.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.129+0000 7f22d5d40740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f89618370 0x562f8962d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:08.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.129+0000 7f22d5d40740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc1b6740 con 0x562f8960eb40 2024-09-19T06:25:08.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.129+0000 7f22d5d40740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc1b4010 con 0x562f89618370 2024-09-19T06:25:08.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.129+0000 7f22d5d40740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc1b1e80 con 0x562f8960d5d0 2024-09-19T06:25:08.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.129+0000 7f22d1703640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f8960eb40 0x562f8962cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:08.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.129+0000 7f22d1703640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f8960eb40 0x562f8962cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52418/0 (socket says 172.21.15.2:52418) 2024-09-19T06:25:08.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.129+0000 7f22d1703640 1 -- 172.21.15.2:0/1313592151 learned_addr learned my addr 172.21.15.2:0/1313592151 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:25:08.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.129+0000 7f22d0f02640 1 --2- 172.21.15.2:0/1313592151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f89618370 0x562f8962d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:08.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.129+0000 7f22d0f02640 1 --2- 172.21.15.2:0/1313592151 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f8960d5d0 0x562f89609e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:08.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.129+0000 7f22d1703640 1 -- 172.21.15.2:0/1313592151 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f8960d5d0 msgr2=0x562f89609e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:25:08.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.129+0000 7f22d1703640 1 --2- 172.21.15.2:0/1313592151 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f8960d5d0 0x562f89609e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:08.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.129+0000 7f22d1703640 1 -- 172.21.15.2:0/1313592151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f89618370 msgr2=0x562f8962d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:25:08.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.129+0000 7f22d1703640 1 --2- 172.21.15.2:0/1313592151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f89618370 0x562f8962d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:08.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.129+0000 7f22d1703640 1 -- 172.21.15.2:0/1313592151 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f89615de0 con 0x562f8960eb40 2024-09-19T06:25:08.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.129+0000 7f22d0f02640 1 --2- 172.21.15.2:0/1313592151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f89618370 0x562f8962d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:25:08.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.129+0000 7f22d1703640 1 --2- 172.21.15.2:0/1313592151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f8960eb40 0x562f8962cea0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x562f89614900 tx=0x7f22c800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d84a7b44a2b2dca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:08.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.129+0000 7f22b6ffd640 1 -- 172.21.15.2:0/1313592151 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c8003ea0 con 0x562f8960eb40 2024-09-19T06:25:08.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.130+0000 7f22b6ffd640 1 -- 172.21.15.2:0/1313592151 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f22c80118f0 con 0x562f8960eb40 2024-09-19T06:25:08.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.130+0000 7f22b6ffd640 1 -- 172.21.15.2:0/1313592151 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c801d7e0 con 0x562f8960eb40 2024-09-19T06:25:08.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.130+0000 7f22d5d40740 1 -- 172.21.15.2:0/1313592151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f8960eb40 msgr2=0x562f8962cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:08.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.130+0000 7f22d5d40740 1 --2- 172.21.15.2:0/1313592151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f8960eb40 0x562f8962cea0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x562f89614900 tx=0x7f22c800b390 comp rx=0 tx=0).stop 2024-09-19T06:25:08.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.130+0000 7f22d5d40740 1 -- 172.21.15.2:0/1313592151 shutdown_connections 2024-09-19T06:25:08.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.130+0000 7f22d5d40740 1 --2- 172.21.15.2:0/1313592151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f89618370 0x562f8962d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:08.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.130+0000 7f22d5d40740 1 --2- 172.21.15.2:0/1313592151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f8960eb40 0x562f8962cea0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:08.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.130+0000 7f22d5d40740 1 --2- 172.21.15.2:0/1313592151 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f8960d5d0 0x562f89609e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:08.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.130+0000 7f22d5d40740 1 -- 172.21.15.2:0/1313592151 >> 172.21.15.2:0/1313592151 conn(0x562f895d6310 msgr2=0x562f89609700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:08.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.130+0000 7f22d5d40740 1 -- 172.21.15.2:0/1313592151 shutdown_connections 2024-09-19T06:25:08.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.130+0000 7f22d5d40740 1 -- 172.21.15.2:0/1313592151 wait complete. 2024-09-19T06:25:08.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.131+0000 7f22d5d40740 1 -- start start 2024-09-19T06:25:08.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.131+0000 7f22d5d40740 1 Processor -- start 2024-09-19T06:25:08.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.131+0000 7f22d5d40740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f8960d5d0 0x562f89629ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:08.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.131+0000 7f22d5d40740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f8960eb40 0x562f8962a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:08.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.131+0000 7f22d5d40740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f89618370 0x562f896907a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:08.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.131+0000 7f22d5d40740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc1b24d0 con 0x562f89618370 2024-09-19T06:25:08.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.131+0000 7f22d5d40740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc1b3940 con 0x562f8960d5d0 2024-09-19T06:25:08.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.131+0000 7f22d5d40740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc1b2ba0 con 0x562f8960eb40 2024-09-19T06:25:08.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.131+0000 7f22d5d40740 10 client.0 _ll_register_callbacks cb 0x7f22c8004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:25:08.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.131+0000 7f22d0f02640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f89618370 0x562f896907a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:08.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.131+0000 7f22d1703640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f8960eb40 0x562f8962a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:08.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.131+0000 7f22d0f02640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f89618370 0x562f896907a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52426/0 (socket says 172.21.15.2:52426) 2024-09-19T06:25:08.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.132+0000 7f22d1703640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f8960eb40 0x562f8962a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:37836/0 (socket says 172.21.15.2:37836) 2024-09-19T06:25:08.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.132+0000 7f22d0f02640 1 -- 172.21.15.2:0/1526308665 learned_addr learned my addr 172.21.15.2:0/1526308665 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:25:08.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.132+0000 7f22d0f02640 1 --2- 172.21.15.2:0/1526308665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f8960d5d0 0x562f89629ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:08.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.132+0000 7f22d1703640 1 -- 172.21.15.2:0/1526308665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f8960d5d0 msgr2=0x562f89629ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:25:08.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.132+0000 7f22d1703640 1 --2- 172.21.15.2:0/1526308665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f8960d5d0 0x562f89629ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:08.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.132+0000 7f22d1703640 1 -- 172.21.15.2:0/1526308665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f89618370 msgr2=0x562f896907a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:25:08.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.132+0000 7f22d1703640 1 --2- 172.21.15.2:0/1526308665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f89618370 0x562f896907a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:08.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.132+0000 7f22d1703640 1 -- 172.21.15.2:0/1526308665 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f89690ce0 con 0x562f8960eb40 2024-09-19T06:25:08.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.132+0000 7f22d1703640 1 --2- 172.21.15.2:0/1526308665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f8960eb40 0x562f8962a530 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x562f89615c80 tx=0x7f22c8003d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbb49af32d833936 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:08.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.132+0000 7f22b4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-19T06:25:08.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.132+0000 7f22b4ff9640 1 -- 172.21.15.2:0/1526308665 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c8011640 con 0x562f8960eb40 2024-09-19T06:25:08.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.132+0000 7f22d5d40740 1 -- 172.21.15.2:0/1526308665 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22c80118f0 con 0x562f8960eb40 2024-09-19T06:25:08.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.132+0000 7f22b4ff9640 1 -- 172.21.15.2:0/1526308665 <== mon.1 v2:172.21.15.90:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8521+0+0 (secure 0 0 0) 0x7f22c8011aa0 con 0x562f8960eb40 2024-09-19T06:25:08.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.133+0000 7f22b4ff9640 1 -- 172.21.15.2:0/1526308665 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f22c8011cc0 con 0x562f8960eb40 2024-09-19T06:25:08.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.133+0000 7f22d5d40740 10 client.27790 fetch_fsmap learned FSMap version 26 2024-09-19T06:25:08.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.133+0000 7f22d5d40740 1 -- 172.21.15.2:0/1526308665 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562f89691e60 con 0x562f8960eb40 2024-09-19T06:25:08.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.133+0000 7f22b4ff9640 1 -- 172.21.15.2:0/1526308665 <== mon.1 v2:172.21.15.90:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f22c80118f0 con 0x562f8960eb40 2024-09-19T06:25:08.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.133+0000 7f22b4ff9640 1 -- 172.21.15.2:0/1526308665 <== mon.1 v2:172.21.15.90:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f22c8024020 con 0x562f8960eb40 2024-09-19T06:25:08.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.133+0000 7f22d5d40740 10 client.27790 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:25:08.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.133+0000 7f22d5d40740 10 client.27790 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:25:08.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.133+0000 7f22d5d40740 20 client.27790 populate_metadata read hostname 'smithi002' 2024-09-19T06:25:08.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.133+0000 7f22d5d40740 1 --2- 172.21.15.2:0/1526308665 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x562f896924e0 0x562f89694900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:08.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.133+0000 7f22d5d40740 4 client.27790 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:25:08.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.133+0000 7f22d5d40740 1 -- 172.21.15.2:0/1526308665 --> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562f8957ad70 con 0x562f896924e0 2024-09-19T06:25:08.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.133+0000 7f22d0f02640 1 --2- 172.21.15.2:0/1526308665 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x562f896924e0 0x562f89694900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:08.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.134+0000 7f22b4ff9640 10 client.27790 ms_handle_connect on v2:172.21.15.89:6836/1620064646 2024-09-19T06:25:08.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.134+0000 7f22d0f02640 1 --2- 172.21.15.2:0/1526308665 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x562f896924e0 0x562f89694900 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d5af6eee8a7fd70 server_cookie=1d1725ecc1199d00 in_seq=0 out_seq=0 2024-09-19T06:25:08.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.134+0000 7f22b4ff9640 1 -- 172.21.15.2:0/1526308665 <== mds.2 v2:172.21.15.89:6836/1620064646 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562f8957ad70 con 0x562f896924e0 2024-09-19T06:25:08.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.134+0000 7f22b4ff9640 10 client.27790 handle_command_reply: tid=0 2024-09-19T06:25:08.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.134+0000 7f22d5d40740 1 client.27790 shutdown 2024-09-19T06:25:08.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.134+0000 7f22d5d40740 1 -- 172.21.15.2:0/1526308665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f8960eb40 msgr2=0x562f8962a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:08.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.134+0000 7f22d5d40740 1 --2- 172.21.15.2:0/1526308665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f8960eb40 0x562f8962a530 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x562f89615c80 tx=0x7f22c8003d20 comp rx=0 tx=0).stop 2024-09-19T06:25:08.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.134+0000 7f22d5d40740 1 -- 172.21.15.2:0/1526308665 shutdown_connections 2024-09-19T06:25:08.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.134+0000 7f22d5d40740 1 --2- 172.21.15.2:0/1526308665 >> [v2:172.21.15.89:6836/1620064646,v1:172.21.15.89:6837/1620064646] conn(0x562f896924e0 0x562f89694900 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:08.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.134+0000 7f22d5d40740 1 --2- 172.21.15.2:0/1526308665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562f89618370 0x562f896907a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:08.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.134+0000 7f22d5d40740 1 --2- 172.21.15.2:0/1526308665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f8960eb40 0x562f8962a530 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:08.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.134+0000 7f22b4ff9640 0 client.27790 ms_handle_reset on v2:172.21.15.89:6836/1620064646 2024-09-19T06:25:08.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.134+0000 7f22d5d40740 1 --2- 172.21.15.2:0/1526308665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f8960d5d0 0x562f89629ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:08.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.134+0000 7f22d5d40740 1 -- 172.21.15.2:0/1526308665 >> 172.21.15.2:0/1526308665 conn(0x562f895d6310 msgr2=0x562f89613940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:08.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.134+0000 7f22d5d40740 1 -- 172.21.15.2:0/1526308665 shutdown_connections 2024-09-19T06:25:08.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.135+0000 7f22d5d40740 1 -- 172.21.15.2:0/1526308665 wait complete. 2024-09-19T06:25:08.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.135+0000 7f22d5d40740 20 client.27790 trim_cache size 0 max 16384 2024-09-19T06:25:08.141 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:25:08.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.135+0000 7f22d3967640 1 -- 172.21.15.2:0/3914220878 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f22b80a33b0 msgr2=0x7f22b80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:08.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.135+0000 7f22d3967640 1 --2- 172.21.15.2:0/3914220878 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f22b80a33b0 0x7f22b80a5870 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f22c4098760 tx=0x7f22c409f040 comp rx=0 tx=0).stop 2024-09-19T06:25:08.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.135+0000 7f22d3967640 1 -- 172.21.15.2:0/3914220878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22cc112b90 msgr2=0x7f22cc19e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:08.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.135+0000 7f22d3967640 1 --2- 172.21.15.2:0/3914220878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22cc112b90 0x7f22cc19e820 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f22c400cad0 tx=0x7f22c400cf90 comp rx=0 tx=0).stop 2024-09-19T06:25:08.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.135+0000 7f22d3967640 1 -- 172.21.15.2:0/3914220878 shutdown_connections 2024-09-19T06:25:08.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.135+0000 7f22d3967640 1 --2- 172.21.15.2:0/3914220878 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f22b80a33b0 0x7f22b80a5870 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:08.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.135+0000 7f22d3967640 1 --2- 172.21.15.2:0/3914220878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22cc112b90 0x7f22cc19e820 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:08.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.135+0000 7f22d3967640 1 --2- 172.21.15.2:0/3914220878 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22cc074eb0 0x7f22cc1a4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:08.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.135+0000 7f22d3967640 1 --2- 172.21.15.2:0/3914220878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22cc074590 0x7f22cc1a46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:08.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.135+0000 7f22d3967640 1 -- 172.21.15.2:0/3914220878 >> 172.21.15.2:0/3914220878 conn(0x7f22cc0fd8c0 msgr2=0x7f22cc0ff5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:08.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.135+0000 7f22d3967640 1 -- 172.21.15.2:0/3914220878 shutdown_connections 2024-09-19T06:25:08.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:08.135+0000 7f22d3967640 1 -- 172.21.15.2:0/3914220878 wait complete. 2024-09-19T06:25:08.961 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:25:08.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:08 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:25:08.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:08 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:25:08.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:08 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:25:08.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:08 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:25:08.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:08 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:25:08.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:08 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:25:08.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:08 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:25:08.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:08 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:25:08.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:08 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:25:08.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:08 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:25:08.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:08 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:25:08.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:08 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:25:08.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:08 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:25:08.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:08 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:25:08.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:08 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:25:08.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:08 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:25:08.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:08 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:25:08.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:08 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:25:09.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:08 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:25:09.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:08 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:25:09.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:08 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:25:09.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:08 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:25:09.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:08 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:25:09.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:08 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:25:09.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:08 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:25:09.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:08 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:25:09.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:08 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' 2024-09-19T06:25:09.219 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:25:09.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.677+0000 7fc9cc761640 1 -- 172.21.15.2:0/3506265917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9c4102da0 msgr2=0x7fc9c4103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:09.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.677+0000 7fc9cc761640 1 --2- 172.21.15.2:0/3506265917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9c4102da0 0x7fc9c4103180 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0009900 tx=0x7fc9c002a4b0 comp rx=0 tx=0).stop 2024-09-19T06:25:09.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.678+0000 7fc9cc761640 1 -- 172.21.15.2:0/3506265917 shutdown_connections 2024-09-19T06:25:09.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.678+0000 7fc9cc761640 1 --2- 172.21.15.2:0/3506265917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9c410c180 0x7fc9c410e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:09.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.678+0000 7fc9cc761640 1 --2- 172.21.15.2:0/3506265917 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9c41036c0 0x7fc9c410bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:09.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.678+0000 7fc9cc761640 1 --2- 172.21.15.2:0/3506265917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9c4102da0 0x7fc9c4103180 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:09.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.678+0000 7fc9cc761640 1 -- 172.21.15.2:0/3506265917 >> 172.21.15.2:0/3506265917 conn(0x7fc9c40fc7a0 msgr2=0x7fc9c40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:09.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.678+0000 7fc9cc761640 1 -- 172.21.15.2:0/3506265917 shutdown_connections 2024-09-19T06:25:09.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.678+0000 7fc9cc761640 1 -- 172.21.15.2:0/3506265917 wait complete. 2024-09-19T06:25:09.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.678+0000 7fc9cc761640 1 Processor -- start 2024-09-19T06:25:09.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.678+0000 7fc9cc761640 1 -- start start 2024-09-19T06:25:09.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.679+0000 7fc9cc761640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9c4102da0 0x7fc9c4100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:09.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.679+0000 7fc9cc761640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9c41036c0 0x7fc9c4100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:09.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.679+0000 7fc9cc761640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9c410c180 0x7fc9c4101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:09.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.679+0000 7fc9cc761640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c4111e50 con 0x7fc9c410c180 2024-09-19T06:25:09.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.679+0000 7fc9cc761640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c4111cd0 con 0x7fc9c41036c0 2024-09-19T06:25:09.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.679+0000 7fc9cc761640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c4111fd0 con 0x7fc9c4102da0 2024-09-19T06:25:09.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.679+0000 7fc9cacfe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9c410c180 0x7fc9c4101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:09.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.679+0000 7fc9cacfe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9c410c180 0x7fc9c4101480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52448/0 (socket says 172.21.15.2:52448) 2024-09-19T06:25:09.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.679+0000 7fc9ca4fd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9c4102da0 0x7fc9c4100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:09.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.679+0000 7fc9cacfe640 1 -- 172.21.15.2:0/3397681637 learned_addr learned my addr 172.21.15.2:0/3397681637 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:25:09.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.679+0000 7fc9c9cfc640 1 --2- 172.21.15.2:0/3397681637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9c41036c0 0x7fc9c4100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:09.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.679+0000 7fc9cacfe640 1 -- 172.21.15.2:0/3397681637 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9c4102da0 msgr2=0x7fc9c4100a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:09.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.679+0000 7fc9cacfe640 1 --2- 172.21.15.2:0/3397681637 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9c4102da0 0x7fc9c4100a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:09.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.679+0000 7fc9cacfe640 1 -- 172.21.15.2:0/3397681637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9c41036c0 msgr2=0x7fc9c4100f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:09.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.679+0000 7fc9cacfe640 1 --2- 172.21.15.2:0/3397681637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9c41036c0 0x7fc9c4100f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:09.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.679+0000 7fc9cacfe640 1 -- 172.21.15.2:0/3397681637 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9c41a68b0 con 0x7fc9c410c180 2024-09-19T06:25:09.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.679+0000 7fc9cacfe640 1 --2- 172.21.15.2:0/3397681637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9c410c180 0x7fc9c4101480 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc00b970 tx=0x7fc9bc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:09.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.679+0000 7fc9bb7fe640 1 -- 172.21.15.2:0/3397681637 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc019070 con 0x7fc9c410c180 2024-09-19T06:25:09.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.680+0000 7fc9cc761640 1 -- 172.21.15.2:0/3397681637 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9c41a6ba0 con 0x7fc9c410c180 2024-09-19T06:25:09.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.680+0000 7fc9bb7fe640 1 -- 172.21.15.2:0/3397681637 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc9bc014440 con 0x7fc9c410c180 2024-09-19T06:25:09.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.680+0000 7fc9bb7fe640 1 -- 172.21.15.2:0/3397681637 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc0075d0 con 0x7fc9c410c180 2024-09-19T06:25:09.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.680+0000 7fc9cc761640 1 -- 172.21.15.2:0/3397681637 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9c41a7090 con 0x7fc9c410c180 2024-09-19T06:25:09.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.682+0000 7fc9bb7fe640 1 -- 172.21.15.2:0/3397681637 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fc9bc01c070 con 0x7fc9c410c180 2024-09-19T06:25:09.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.682+0000 7fc9ceb3a740 1 Processor -- start 2024-09-19T06:25:09.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.682+0000 7fc9ceb3a740 1 -- start start 2024-09-19T06:25:09.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.683+0000 7fc9ceb3a740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a1ee11b40 0x563a1ee10090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:09.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.683+0000 7fc9ceb3a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a1ee105d0 0x563a1ee10a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:09.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.683+0000 7fc9ceb3a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a1ee1b370 0x563a1ee1d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:09.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.683+0000 7fc9ceb3a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563a1ed762f0 con 0x563a1ee1b370 2024-09-19T06:25:09.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.683+0000 7fc9ceb3a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563a1ed1dcf0 con 0x563a1ee105d0 2024-09-19T06:25:09.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.683+0000 7fc9ceb3a740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x563a1ed722b0 con 0x563a1ee11b40 2024-09-19T06:25:09.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.683+0000 7fc9c9cfc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a1ee1b370 0x563a1ee1d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:09.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.683+0000 7fc9c9cfc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a1ee1b370 0x563a1ee1d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52458/0 (socket says 172.21.15.2:52458) 2024-09-19T06:25:09.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.683+0000 7fc9c9cfc640 1 -- 172.21.15.2:0/4172109718 learned_addr learned my addr 172.21.15.2:0/4172109718 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:25:09.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.683+0000 7fc9c9cfc640 1 --2- 172.21.15.2:0/4172109718 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a1ee11b40 0x563a1ee10090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:09.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.683+0000 7fc9ca4fd640 1 --2- 172.21.15.2:0/4172109718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a1ee105d0 0x563a1ee10a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:09.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.683+0000 7fc9c9cfc640 1 -- 172.21.15.2:0/4172109718 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a1ee11b40 msgr2=0x563a1ee10090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:25:09.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.683+0000 7fc9c9cfc640 1 --2- 172.21.15.2:0/4172109718 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a1ee11b40 0x563a1ee10090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:09.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.683+0000 7fc9c9cfc640 1 -- 172.21.15.2:0/4172109718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a1ee105d0 msgr2=0x563a1ee10a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:25:09.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.683+0000 7fc9bb7fe640 1 --2- 172.21.15.2:0/3397681637 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc9b00a33b0 0x7fc9b00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:09.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.683+0000 7fc9c9cfc640 1 --2- 172.21.15.2:0/4172109718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a1ee105d0 0x563a1ee10a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:09.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.683+0000 7fc9c9cfc640 1 -- 172.21.15.2:0/4172109718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a1ed023a0 con 0x563a1ee1b370 2024-09-19T06:25:09.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.683+0000 7fc9cacfe640 1 --2- 172.21.15.2:0/3397681637 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc9b00a33b0 0x7fc9b00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:09.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.683+0000 7fc9c9cfc640 1 --2- 172.21.15.2:0/4172109718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a1ee1b370 0x563a1ee1d760 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fc9b40127c0 tx=0x7fc9b400b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=805337252d482ede server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:09.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.683+0000 7fc9bb7fe640 1 -- 172.21.15.2:0/3397681637 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8565+0+0 (secure 0 0 0) 0x7fc9bc0cf210 con 0x7fc9c410c180 2024-09-19T06:25:09.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.684+0000 7fc9b8ff9640 1 -- 172.21.15.2:0/4172109718 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4012e00 con 0x563a1ee1b370 2024-09-19T06:25:09.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.684+0000 7fc9b8ff9640 1 -- 172.21.15.2:0/4172109718 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc9b4010c20 con 0x563a1ee1b370 2024-09-19T06:25:09.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.684+0000 7fc9b8ff9640 1 -- 172.21.15.2:0/4172109718 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b401ea70 con 0x563a1ee1b370 2024-09-19T06:25:09.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.684+0000 7fc9ceb3a740 1 -- 172.21.15.2:0/4172109718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a1ee1b370 msgr2=0x563a1ee1d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:09.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.684+0000 7fc9ceb3a740 1 --2- 172.21.15.2:0/4172109718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a1ee1b370 0x563a1ee1d760 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fc9b40127c0 tx=0x7fc9b400b7c0 comp rx=0 tx=0).stop 2024-09-19T06:25:09.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.684+0000 7fc9cacfe640 1 --2- 172.21.15.2:0/3397681637 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc9b00a33b0 0x7fc9b00a5870 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc0ccaf0 tx=0x7fc9bc00e040 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:09.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.684+0000 7fc9ceb3a740 1 -- 172.21.15.2:0/4172109718 shutdown_connections 2024-09-19T06:25:09.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.684+0000 7fc9ceb3a740 1 --2- 172.21.15.2:0/4172109718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a1ee1b370 0x563a1ee1d760 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:09.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.684+0000 7fc9ceb3a740 1 --2- 172.21.15.2:0/4172109718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a1ee105d0 0x563a1ee10a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:09.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.684+0000 7fc9ceb3a740 1 --2- 172.21.15.2:0/4172109718 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a1ee11b40 0x563a1ee10090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:09.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.684+0000 7fc9ceb3a740 1 -- 172.21.15.2:0/4172109718 >> 172.21.15.2:0/4172109718 conn(0x563a1edd9310 msgr2=0x563a1ee0cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:09.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.685+0000 7fc9ceb3a740 1 -- 172.21.15.2:0/4172109718 shutdown_connections 2024-09-19T06:25:09.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.685+0000 7fc9ceb3a740 1 -- 172.21.15.2:0/4172109718 wait complete. 2024-09-19T06:25:09.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.685+0000 7fc9ceb3a740 1 -- start start 2024-09-19T06:25:09.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.685+0000 7fc9ceb3a740 1 Processor -- start 2024-09-19T06:25:09.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.685+0000 7fc9ceb3a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a1ee105d0 0x563a1ee1ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:09.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.685+0000 7fc9ceb3a740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a1ee11b40 0x563a1ee18040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:09.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.685+0000 7fc9ceb3a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a1ee1b370 0x563a1ee18650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:09.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.685+0000 7fc9ceb3a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563a1ee1e070 con 0x563a1ee1b370 2024-09-19T06:25:09.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.685+0000 7fc9ceb3a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563a1ed31060 con 0x563a1ee105d0 2024-09-19T06:25:09.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.685+0000 7fc9ceb3a740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x563a1ee1e1f0 con 0x563a1ee11b40 2024-09-19T06:25:09.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.685+0000 7fc9ceb3a740 10 client.0 _ll_register_callbacks cb 0x563a1ea848c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:25:09.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.686+0000 7fc9c9cfc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a1ee1b370 0x563a1ee18650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:09.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.686+0000 7fc9ca4fd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a1ee11b40 0x563a1ee18040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:09.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.686+0000 7fc9c9cfc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a1ee1b370 0x563a1ee18650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52468/0 (socket says 172.21.15.2:52468) 2024-09-19T06:25:09.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.686+0000 7fc9c9cfc640 1 -- 172.21.15.2:0/3238953879 learned_addr learned my addr 172.21.15.2:0/3238953879 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:25:09.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.686+0000 7fc9ca4fd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a1ee11b40 0x563a1ee18040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:37880/0 (socket says 172.21.15.2:37880) 2024-09-19T06:25:09.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.686+0000 7fc9c9cfc640 1 --2- 172.21.15.2:0/3238953879 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a1ee105d0 0x563a1ee1ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:09.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.686+0000 7fc9c9cfc640 1 -- 172.21.15.2:0/3238953879 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a1ee11b40 msgr2=0x563a1ee18040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:25:09.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.686+0000 7fc9c9cfc640 1 --2- 172.21.15.2:0/3238953879 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a1ee11b40 0x563a1ee18040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:09.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.686+0000 7fc9c9cfc640 1 -- 172.21.15.2:0/3238953879 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a1ee105d0 msgr2=0x563a1ee1ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:25:09.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.686+0000 7fc9c9cfc640 1 --2- 172.21.15.2:0/3238953879 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a1ee105d0 0x563a1ee1ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:09.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.686+0000 7fc9c9cfc640 1 -- 172.21.15.2:0/3238953879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a1eae73c0 con 0x563a1ee1b370 2024-09-19T06:25:09.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.686+0000 7fc9ca4fd640 1 --2- 172.21.15.2:0/3238953879 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a1ee11b40 0x563a1ee18040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:25:09.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.686+0000 7fc9c9cfc640 1 --2- 172.21.15.2:0/3238953879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a1ee1b370 0x563a1ee18650 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4005d00 tx=0x7fc9b4014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c748055ef594875d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:09.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.686+0000 7fc9adffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:25:09.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.686+0000 7fc9adffb640 1 -- 172.21.15.2:0/3238953879 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4024040 con 0x563a1ee1b370 2024-09-19T06:25:09.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.686+0000 7fc9adffb640 1 -- 172.21.15.2:0/3238953879 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8565+0+0 (secure 0 0 0) 0x7fc9b4010770 con 0x563a1ee1b370 2024-09-19T06:25:09.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.686+0000 7fc9ceb3a740 1 -- 172.21.15.2:0/3238953879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9b4010c20 con 0x563a1ee1b370 2024-09-19T06:25:09.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.687+0000 7fc9adffb640 1 -- 172.21.15.2:0/3238953879 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc9b4010970 con 0x563a1ee1b370 2024-09-19T06:25:09.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.687+0000 7fc9ceb3a740 10 client.19011 fetch_fsmap learned FSMap version 26 2024-09-19T06:25:09.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.687+0000 7fc9ceb3a740 1 -- 172.21.15.2:0/3238953879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563a1ee29b40 con 0x563a1ee1b370 2024-09-19T06:25:09.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.687+0000 7fc9adffb640 1 -- 172.21.15.2:0/3238953879 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc9b4010c20 con 0x563a1ee1b370 2024-09-19T06:25:09.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.687+0000 7fc9adffb640 1 -- 172.21.15.2:0/3238953879 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fc9b402a070 con 0x563a1ee1b370 2024-09-19T06:25:09.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.687+0000 7fc9ceb3a740 10 client.19011 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:25:09.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.687+0000 7fc9ceb3a740 10 client.19011 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:25:09.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.687+0000 7fc9ceb3a740 20 client.19011 populate_metadata read hostname 'smithi002' 2024-09-19T06:25:09.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.687+0000 7fc9ceb3a740 1 --2- 172.21.15.2:0/3238953879 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x563a1ee2ae90 0x563a1ee2d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:09.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.687+0000 7fc9ceb3a740 4 client.19011 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:25:09.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.687+0000 7fc9ceb3a740 1 -- 172.21.15.2:0/3238953879 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a1ed83860 con 0x563a1ee2ae90 2024-09-19T06:25:09.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.687+0000 7fc9ca4fd640 1 --2- 172.21.15.2:0/3238953879 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x563a1ee2ae90 0x563a1ee2d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:09.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.688+0000 7fc9ca4fd640 1 --2- 172.21.15.2:0/3238953879 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x563a1ee2ae90 0x563a1ee2d280 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fde1fa2c865aeceb server_cookie=eab0ca944ec80da6 in_seq=0 out_seq=0 2024-09-19T06:25:09.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.688+0000 7fc9adffb640 10 client.19011 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:25:09.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.688+0000 7fc9adffb640 1 -- 172.21.15.2:0/3238953879 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563a1ed83860 con 0x563a1ee2ae90 2024-09-19T06:25:09.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.688+0000 7fc9adffb640 10 client.19011 handle_command_reply: tid=0 2024-09-19T06:25:09.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.689+0000 7fc9ceb3a740 1 client.19011 shutdown 2024-09-19T06:25:09.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.689+0000 7fc9ceb3a740 1 -- 172.21.15.2:0/3238953879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a1ee1b370 msgr2=0x563a1ee18650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:09.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.689+0000 7fc9ceb3a740 1 --2- 172.21.15.2:0/3238953879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a1ee1b370 0x563a1ee18650 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4005d00 tx=0x7fc9b4014040 comp rx=0 tx=0).stop 2024-09-19T06:25:09.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.689+0000 7fc9ceb3a740 1 -- 172.21.15.2:0/3238953879 shutdown_connections 2024-09-19T06:25:09.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.689+0000 7fc9ceb3a740 1 --2- 172.21.15.2:0/3238953879 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x563a1ee2ae90 0x563a1ee2d280 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:09.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.689+0000 7fc9ceb3a740 1 --2- 172.21.15.2:0/3238953879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a1ee1b370 0x563a1ee18650 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:09.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.689+0000 7fc9ceb3a740 1 --2- 172.21.15.2:0/3238953879 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a1ee11b40 0x563a1ee18040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:09.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.689+0000 7fc9ceb3a740 1 --2- 172.21.15.2:0/3238953879 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a1ee105d0 0x563a1ee1ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:09.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.689+0000 7fc9adffb640 0 client.19011 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:25:09.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.689+0000 7fc9ceb3a740 1 -- 172.21.15.2:0/3238953879 >> 172.21.15.2:0/3238953879 conn(0x563a1edd9310 msgr2=0x563a1ee12990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:09.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.689+0000 7fc9ceb3a740 1 -- 172.21.15.2:0/3238953879 shutdown_connections 2024-09-19T06:25:09.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.689+0000 7fc9ceb3a740 1 -- 172.21.15.2:0/3238953879 wait complete. 2024-09-19T06:25:09.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.689+0000 7fc9ceb3a740 20 client.19011 trim_cache size 0 max 16384 2024-09-19T06:25:09.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.702+0000 7fc9ceb3a740 1 Processor -- start 2024-09-19T06:25:09.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.702+0000 7fc9ceb3a740 1 -- start start 2024-09-19T06:25:09.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.702+0000 7fc9ceb3a740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a1ee105d0 0x563a1ee27310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:09.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.702+0000 7fc9ceb3a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a1ee11b40 0x563a1ee1c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:09.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.702+0000 7fc9ceb3a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a1ee1b370 0x563a1ee1cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:09.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.702+0000 7fc9ceb3a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c41b2320 con 0x563a1ee1b370 2024-09-19T06:25:09.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.702+0000 7fc9ceb3a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c41afbf0 con 0x563a1ee11b40 2024-09-19T06:25:09.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.702+0000 7fc9ceb3a740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c41ada60 con 0x563a1ee105d0 2024-09-19T06:25:09.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.702+0000 7fc9c9cfc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a1ee1b370 0x563a1ee1cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:09.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.703+0000 7fc9c9cfc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a1ee1b370 0x563a1ee1cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52482/0 (socket says 172.21.15.2:52482) 2024-09-19T06:25:09.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.703+0000 7fc9c9cfc640 1 -- 172.21.15.2:0/3732698437 learned_addr learned my addr 172.21.15.2:0/3732698437 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:25:09.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.703+0000 7fc9c9cfc640 1 --2- 172.21.15.2:0/3732698437 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a1ee105d0 0x563a1ee27310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:09.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.703+0000 7fc9ca4fd640 1 --2- 172.21.15.2:0/3732698437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a1ee11b40 0x563a1ee1c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:09.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.703+0000 7fc9c9cfc640 1 -- 172.21.15.2:0/3732698437 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a1ee105d0 msgr2=0x563a1ee27310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:25:09.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.703+0000 7fc9c9cfc640 1 --2- 172.21.15.2:0/3732698437 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a1ee105d0 0x563a1ee27310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:09.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.703+0000 7fc9c9cfc640 1 -- 172.21.15.2:0/3732698437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a1ee11b40 msgr2=0x563a1ee1c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:25:09.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.703+0000 7fc9c9cfc640 1 --2- 172.21.15.2:0/3732698437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a1ee11b40 0x563a1ee1c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:09.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.703+0000 7fc9c9cfc640 1 -- 172.21.15.2:0/3732698437 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a1ee13120 con 0x563a1ee1b370 2024-09-19T06:25:09.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.703+0000 7fc9ca4fd640 1 --2- 172.21.15.2:0/3732698437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a1ee11b40 0x563a1ee1c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:25:09.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.703+0000 7fc9c9cfc640 1 --2- 172.21.15.2:0/3732698437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a1ee1b370 0x563a1ee1cca0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7fc9b400bf10 tx=0x7fc9b400b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0d5cb4624d4ea86 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:09.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.703+0000 7fc9affff640 1 -- 172.21.15.2:0/3732698437 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4010740 con 0x563a1ee1b370 2024-09-19T06:25:09.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.703+0000 7fc9affff640 1 -- 172.21.15.2:0/3732698437 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc9b4016040 con 0x563a1ee1b370 2024-09-19T06:25:09.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.703+0000 7fc9affff640 1 -- 172.21.15.2:0/3732698437 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4010c10 con 0x563a1ee1b370 2024-09-19T06:25:09.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.704+0000 7fc9ceb3a740 1 -- 172.21.15.2:0/3732698437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a1ee1b370 msgr2=0x563a1ee1cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:09.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.704+0000 7fc9ceb3a740 1 --2- 172.21.15.2:0/3732698437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a1ee1b370 0x563a1ee1cca0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7fc9b400bf10 tx=0x7fc9b400b7c0 comp rx=0 tx=0).stop 2024-09-19T06:25:09.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.704+0000 7fc9ceb3a740 1 -- 172.21.15.2:0/3732698437 shutdown_connections 2024-09-19T06:25:09.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.704+0000 7fc9ceb3a740 1 --2- 172.21.15.2:0/3732698437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a1ee1b370 0x563a1ee1cca0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:09.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.704+0000 7fc9ceb3a740 1 --2- 172.21.15.2:0/3732698437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a1ee11b40 0x563a1ee1c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:09.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.704+0000 7fc9ceb3a740 1 --2- 172.21.15.2:0/3732698437 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a1ee105d0 0x563a1ee27310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:09.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.704+0000 7fc9ceb3a740 1 -- 172.21.15.2:0/3732698437 >> 172.21.15.2:0/3732698437 conn(0x563a1edd9310 msgr2=0x563a1ee18000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:09.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.704+0000 7fc9ceb3a740 1 -- 172.21.15.2:0/3732698437 shutdown_connections 2024-09-19T06:25:09.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.704+0000 7fc9ceb3a740 1 -- 172.21.15.2:0/3732698437 wait complete. 2024-09-19T06:25:09.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.704+0000 7fc9ceb3a740 1 -- start start 2024-09-19T06:25:09.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.704+0000 7fc9ceb3a740 1 Processor -- start 2024-09-19T06:25:09.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.705+0000 7fc9ceb3a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a1ee105d0 0x563a1ee239f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:09.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.705+0000 7fc9ceb3a740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a1ee11b40 0x563a1ee32080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:09.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.705+0000 7fc9ceb3a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a1ee1b370 0x563a1ee325c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:09.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.705+0000 7fc9ceb3a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c41ae0b0 con 0x563a1ee1b370 2024-09-19T06:25:09.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.705+0000 7fc9ceb3a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c41af520 con 0x563a1ee105d0 2024-09-19T06:25:09.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.705+0000 7fc9ceb3a740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c41ae780 con 0x563a1ee11b40 2024-09-19T06:25:09.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.705+0000 7fc9ceb3a740 10 client.0 _ll_register_callbacks cb 0x7fc9c0005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:25:09.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.705+0000 7fc9c9cfc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a1ee1b370 0x563a1ee325c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:09.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.705+0000 7fc9c9cfc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a1ee1b370 0x563a1ee325c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52486/0 (socket says 172.21.15.2:52486) 2024-09-19T06:25:09.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.705+0000 7fc9c9cfc640 1 -- 172.21.15.2:0/1792340097 learned_addr learned my addr 172.21.15.2:0/1792340097 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:25:09.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.705+0000 7fc9c9cfc640 1 --2- 172.21.15.2:0/1792340097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a1ee105d0 0x563a1ee239f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:09.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.705+0000 7fc9ca4fd640 1 --2- 172.21.15.2:0/1792340097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a1ee11b40 0x563a1ee32080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:09.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.705+0000 7fc9c9cfc640 1 -- 172.21.15.2:0/1792340097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a1ee11b40 msgr2=0x563a1ee32080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:25:09.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.705+0000 7fc9c9cfc640 1 --2- 172.21.15.2:0/1792340097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a1ee11b40 0x563a1ee32080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:09.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.705+0000 7fc9c9cfc640 1 -- 172.21.15.2:0/1792340097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a1ee105d0 msgr2=0x563a1ee239f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:25:09.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.705+0000 7fc9c9cfc640 1 --2- 172.21.15.2:0/1792340097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a1ee105d0 0x563a1ee239f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:09.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.705+0000 7fc9c9cfc640 1 -- 172.21.15.2:0/1792340097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a1ee0c4f0 con 0x563a1ee1b370 2024-09-19T06:25:09.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.705+0000 7fc9c9cfc640 1 --2- 172.21.15.2:0/1792340097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a1ee1b370 0x563a1ee325c0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4033a20 tx=0x7fc9b4010b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45b2b6a3991fc3da server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:09.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.705+0000 7fc9adffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:25:09.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.705+0000 7fc9adffb640 1 -- 172.21.15.2:0/1792340097 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4043060 con 0x563a1ee1b370 2024-09-19T06:25:09.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.705+0000 7fc9adffb640 1 -- 172.21.15.2:0/1792340097 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8565+0+0 (secure 0 0 0) 0x7fc9b4033450 con 0x563a1ee1b370 2024-09-19T06:25:09.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.705+0000 7fc9ceb3a740 1 -- 172.21.15.2:0/1792340097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9b4016040 con 0x563a1ee1b370 2024-09-19T06:25:09.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.706+0000 7fc9adffb640 1 -- 172.21.15.2:0/1792340097 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc9b401e3e0 con 0x563a1ee1b370 2024-09-19T06:25:09.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.706+0000 7fc9ceb3a740 10 client.19017 fetch_fsmap learned FSMap version 26 2024-09-19T06:25:09.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.706+0000 7fc9ceb3a740 1 -- 172.21.15.2:0/1792340097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563a1ee220b0 con 0x563a1ee1b370 2024-09-19T06:25:09.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.706+0000 7fc9adffb640 1 -- 172.21.15.2:0/1792340097 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc9b4016040 con 0x563a1ee1b370 2024-09-19T06:25:09.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.706+0000 7fc9adffb640 1 -- 172.21.15.2:0/1792340097 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fc9b402a070 con 0x563a1ee1b370 2024-09-19T06:25:09.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.706+0000 7fc9ceb3a740 10 client.19017 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:25:09.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.706+0000 7fc9ceb3a740 10 client.19017 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:25:09.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.706+0000 7fc9ceb3a740 20 client.19017 populate_metadata read hostname 'smithi002' 2024-09-19T06:25:09.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.706+0000 7fc9ceb3a740 1 --2- 172.21.15.2:0/1792340097 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x563a1ee95ab0 0x563a1ee97ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:09.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.706+0000 7fc9ceb3a740 4 client.19017 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:25:09.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.706+0000 7fc9ceb3a740 1 -- 172.21.15.2:0/1792340097 --> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563a1ed7dd70 con 0x563a1ee95ab0 2024-09-19T06:25:09.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.706+0000 7fc9ca4fd640 1 --2- 172.21.15.2:0/1792340097 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x563a1ee95ab0 0x563a1ee97ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:09.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.707+0000 7fc9ca4fd640 1 --2- 172.21.15.2:0/1792340097 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x563a1ee95ab0 0x563a1ee97ea0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d45d124e03489ede server_cookie=4d0abbbcc32d0f9c in_seq=0 out_seq=0 2024-09-19T06:25:09.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.707+0000 7fc9adffb640 10 client.19017 ms_handle_connect on v2:172.21.15.90:6838/3866538228 2024-09-19T06:25:09.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.707+0000 7fc9adffb640 1 -- 172.21.15.2:0/1792340097 <== mds.1 v2:172.21.15.90:6838/3866538228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563a1ed7dd70 con 0x563a1ee95ab0 2024-09-19T06:25:09.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.707+0000 7fc9adffb640 10 client.19017 handle_command_reply: tid=0 2024-09-19T06:25:09.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.707+0000 7fc9ceb3a740 1 client.19017 shutdown 2024-09-19T06:25:09.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.707+0000 7fc9ceb3a740 1 -- 172.21.15.2:0/1792340097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a1ee1b370 msgr2=0x563a1ee325c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:09.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.707+0000 7fc9ceb3a740 1 --2- 172.21.15.2:0/1792340097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a1ee1b370 0x563a1ee325c0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4033a20 tx=0x7fc9b4010b10 comp rx=0 tx=0).stop 2024-09-19T06:25:09.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.707+0000 7fc9ceb3a740 1 -- 172.21.15.2:0/1792340097 shutdown_connections 2024-09-19T06:25:09.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.707+0000 7fc9ceb3a740 1 --2- 172.21.15.2:0/1792340097 >> [v2:172.21.15.90:6838/3866538228,v1:172.21.15.90:6839/3866538228] conn(0x563a1ee95ab0 0x563a1ee97ea0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:09.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.707+0000 7fc9ceb3a740 1 --2- 172.21.15.2:0/1792340097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a1ee1b370 0x563a1ee325c0 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:09.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.707+0000 7fc9ceb3a740 1 --2- 172.21.15.2:0/1792340097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563a1ee11b40 0x563a1ee32080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:09.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.707+0000 7fc9ceb3a740 1 --2- 172.21.15.2:0/1792340097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563a1ee105d0 0x563a1ee239f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:09.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.707+0000 7fc9ceb3a740 1 -- 172.21.15.2:0/1792340097 >> 172.21.15.2:0/1792340097 conn(0x563a1edd9310 msgr2=0x563a1ee12080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:09.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.707+0000 7fc9adffb640 0 client.19017 ms_handle_reset on v2:172.21.15.90:6838/3866538228 2024-09-19T06:25:09.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.707+0000 7fc9ceb3a740 1 -- 172.21.15.2:0/1792340097 shutdown_connections 2024-09-19T06:25:09.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.707+0000 7fc9ceb3a740 1 -- 172.21.15.2:0/1792340097 wait complete. 2024-09-19T06:25:09.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.707+0000 7fc9ceb3a740 20 client.19017 trim_cache size 0 max 16384 2024-09-19T06:25:09.715 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:25:09.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.708+0000 7fc9cc761640 1 -- 172.21.15.2:0/3397681637 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc9b00a33b0 msgr2=0x7fc9b00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:09.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.708+0000 7fc9cc761640 1 --2- 172.21.15.2:0/3397681637 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc9b00a33b0 0x7fc9b00a5870 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc0ccaf0 tx=0x7fc9bc00e040 comp rx=0 tx=0).stop 2024-09-19T06:25:09.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.708+0000 7fc9cc761640 1 -- 172.21.15.2:0/3397681637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9c410c180 msgr2=0x7fc9c4101480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:09.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.708+0000 7fc9cc761640 1 --2- 172.21.15.2:0/3397681637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9c410c180 0x7fc9c4101480 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc00b970 tx=0x7fc9bc00be30 comp rx=0 tx=0).stop 2024-09-19T06:25:09.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.708+0000 7fc9cc761640 1 -- 172.21.15.2:0/3397681637 shutdown_connections 2024-09-19T06:25:09.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.708+0000 7fc9cc761640 1 --2- 172.21.15.2:0/3397681637 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc9b00a33b0 0x7fc9b00a5870 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:09.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.708+0000 7fc9cc761640 1 --2- 172.21.15.2:0/3397681637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9c410c180 0x7fc9c4101480 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:09.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.708+0000 7fc9cc761640 1 --2- 172.21.15.2:0/3397681637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9c41036c0 0x7fc9c4100f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:09.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.708+0000 7fc9cc761640 1 --2- 172.21.15.2:0/3397681637 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9c4102da0 0x7fc9c4100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:09.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.708+0000 7fc9cc761640 1 -- 172.21.15.2:0/3397681637 >> 172.21.15.2:0/3397681637 conn(0x7fc9c40fc7a0 msgr2=0x7fc9c40fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:09.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.708+0000 7fc9cc761640 1 -- 172.21.15.2:0/3397681637 shutdown_connections 2024-09-19T06:25:09.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:09.708+0000 7fc9cc761640 1 -- 172.21.15.2:0/3397681637 wait complete. 2024-09-19T06:25:09.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:09 smithi002 ceph-mon[30982]: pgmap v321: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T06:25:09.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:09 smithi002 ceph-mon[30982]: Adjusting osd_memory_target on smithi002 to 177.0M 2024-09-19T06:25:09.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:09 smithi002 ceph-mon[30982]: Unable to set osd_memory_target on smithi002 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-19T06:25:09.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:09 smithi002 ceph-mon[30982]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T06:25:09.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:09 smithi090 ceph-mon[34497]: pgmap v321: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T06:25:09.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:09 smithi090 ceph-mon[34497]: Adjusting osd_memory_target on smithi002 to 177.0M 2024-09-19T06:25:09.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:09 smithi090 ceph-mon[34497]: Unable to set osd_memory_target on smithi002 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-19T06:25:09.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:09 smithi090 ceph-mon[34497]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T06:25:10.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:09 smithi089 ceph-mon[34160]: pgmap v321: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T06:25:10.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:09 smithi089 ceph-mon[34160]: Adjusting osd_memory_target on smithi002 to 177.0M 2024-09-19T06:25:10.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:09 smithi089 ceph-mon[34160]: Unable to set osd_memory_target on smithi002 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-19T06:25:10.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:09 smithi089 ceph-mon[34160]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T06:25:10.451 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:25:10.754 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:25:11.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.144+0000 7f1d042c6640 1 -- 172.21.15.2:0/2744366260 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cfc102d40 msgr2=0x7f1cfc103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:11.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.144+0000 7f1d042c6640 1 --2- 172.21.15.2:0/2744366260 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cfc102d40 0x7f1cfc103120 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8009900 tx=0x7f1cf802a480 comp rx=0 tx=0).stop 2024-09-19T06:25:11.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.144+0000 7f1d042c6640 1 -- 172.21.15.2:0/2744366260 shutdown_connections 2024-09-19T06:25:11.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.144+0000 7f1d042c6640 1 --2- 172.21.15.2:0/2744366260 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1cfc10c170 0x7f1cfc10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:11.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.144+0000 7f1d042c6640 1 --2- 172.21.15.2:0/2744366260 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1cfc103660 0x7f1cfc10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:11.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.144+0000 7f1d042c6640 1 --2- 172.21.15.2:0/2744366260 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cfc102d40 0x7f1cfc103120 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:11.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.144+0000 7f1d042c6640 1 -- 172.21.15.2:0/2744366260 >> 172.21.15.2:0/2744366260 conn(0x7f1cfc0fc7a0 msgr2=0x7f1cfc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:11.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.144+0000 7f1d042c6640 1 -- 172.21.15.2:0/2744366260 shutdown_connections 2024-09-19T06:25:11.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.144+0000 7f1d042c6640 1 -- 172.21.15.2:0/2744366260 wait complete. 2024-09-19T06:25:11.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.145+0000 7f1d042c6640 1 Processor -- start 2024-09-19T06:25:11.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.145+0000 7f1d042c6640 1 -- start start 2024-09-19T06:25:11.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.145+0000 7f1d042c6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1cfc102d40 0x7f1cfc198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:11.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.145+0000 7f1d042c6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cfc103660 0x7f1cfc1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:11.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.145+0000 7f1d042c6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1cfc10c170 0x7f1cfc19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:11.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.145+0000 7f1d042c6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1cfc111e60 con 0x7f1cfc103660 2024-09-19T06:25:11.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.145+0000 7f1d042c6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f1cfc111ce0 con 0x7f1cfc102d40 2024-09-19T06:25:11.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.145+0000 7f1d042c6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1cfc111fe0 con 0x7f1cfc10c170 2024-09-19T06:25:11.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.145+0000 7f1d01861640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cfc103660 0x7f1cfc1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:11.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.145+0000 7f1d01861640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cfc103660 0x7f1cfc1989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52510/0 (socket says 172.21.15.2:52510) 2024-09-19T06:25:11.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.145+0000 7f1d01861640 1 -- 172.21.15.2:0/3430106234 learned_addr learned my addr 172.21.15.2:0/3430106234 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:25:11.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.145+0000 7f1d02863640 1 --2- 172.21.15.2:0/3430106234 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1cfc10c170 0x7f1cfc19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:11.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.145+0000 7f1d02062640 1 --2- 172.21.15.2:0/3430106234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1cfc102d40 0x7f1cfc198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:11.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.146+0000 7f1d01861640 1 -- 172.21.15.2:0/3430106234 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1cfc10c170 msgr2=0x7f1cfc19cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:11.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.146+0000 7f1d01861640 1 --2- 172.21.15.2:0/3430106234 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1cfc10c170 0x7f1cfc19cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:11.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.146+0000 7f1d01861640 1 -- 172.21.15.2:0/3430106234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1cfc102d40 msgr2=0x7f1cfc198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:11.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.146+0000 7f1d01861640 1 --2- 172.21.15.2:0/3430106234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1cfc102d40 0x7f1cfc198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:11.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.146+0000 7f1d01861640 1 -- 172.21.15.2:0/3430106234 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cfc19d420 con 0x7f1cfc103660 2024-09-19T06:25:11.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.146+0000 7f1d01861640 1 --2- 172.21.15.2:0/3430106234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cfc103660 0x7f1cfc1989b0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f1cec00c940 tx=0x7f1cec00ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:11.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.146+0000 7f1cf37fe640 1 -- 172.21.15.2:0/3430106234 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cec004220 con 0x7f1cfc103660 2024-09-19T06:25:11.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.146+0000 7f1d042c6640 1 -- 172.21.15.2:0/3430106234 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cfc19d710 con 0x7f1cfc103660 2024-09-19T06:25:11.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.146+0000 7f1cf37fe640 1 -- 172.21.15.2:0/3430106234 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1cec0043c0 con 0x7f1cfc103660 2024-09-19T06:25:11.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.146+0000 7f1cf37fe640 1 -- 172.21.15.2:0/3430106234 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cec004a00 con 0x7f1cfc103660 2024-09-19T06:25:11.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.146+0000 7f1d042c6640 1 -- 172.21.15.2:0/3430106234 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cfc1a4ff0 con 0x7f1cfc103660 2024-09-19T06:25:11.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.149+0000 7f1cf37fe640 1 -- 172.21.15.2:0/3430106234 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f1cec0079b0 con 0x7f1cfc103660 2024-09-19T06:25:11.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.149+0000 7f1d0669f740 1 Processor -- start 2024-09-19T06:25:11.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.150+0000 7f1d0669f740 1 -- start start 2024-09-19T06:25:11.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.150+0000 7f1d0669f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640fd7cfb40 0x5640fd7ce090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:11.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.150+0000 7f1d0669f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5640fd7ce5d0 0x5640fd7cea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:11.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.150+0000 7f1d0669f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5640fd7d9370 0x5640fd7db760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:11.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.150+0000 7f1d0669f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5640fd7342f0 con 0x5640fd7cfb40 2024-09-19T06:25:11.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.150+0000 7f1d0669f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5640fd6dbcf0 con 0x5640fd7ce5d0 2024-09-19T06:25:11.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.150+0000 7f1d0669f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5640fd7302b0 con 0x5640fd7d9370 2024-09-19T06:25:11.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.150+0000 7f1d02863640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640fd7cfb40 0x5640fd7ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:11.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.150+0000 7f1d02863640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640fd7cfb40 0x5640fd7ce090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52518/0 (socket says 172.21.15.2:52518) 2024-09-19T06:25:11.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.150+0000 7f1d01861640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5640fd7d9370 0x5640fd7db760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:11.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.150+0000 7f1d02863640 1 -- 172.21.15.2:0/3199142369 learned_addr learned my addr 172.21.15.2:0/3199142369 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:25:11.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.150+0000 7f1d02062640 1 --2- 172.21.15.2:0/3199142369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5640fd7ce5d0 0x5640fd7cea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:11.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.150+0000 7f1d02863640 1 -- 172.21.15.2:0/3199142369 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5640fd7d9370 msgr2=0x5640fd7db760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:25:11.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.150+0000 7f1d02863640 1 --2- 172.21.15.2:0/3199142369 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5640fd7d9370 0x5640fd7db760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:11.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.150+0000 7f1d02863640 1 -- 172.21.15.2:0/3199142369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5640fd7ce5d0 msgr2=0x5640fd7cea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:25:11.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.150+0000 7f1d02863640 1 --2- 172.21.15.2:0/3199142369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5640fd7ce5d0 0x5640fd7cea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:11.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.150+0000 7f1d02863640 1 -- 172.21.15.2:0/3199142369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640fd6c03a0 con 0x5640fd7cfb40 2024-09-19T06:25:11.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.150+0000 7f1cf37fe640 1 --2- 172.21.15.2:0/3430106234 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f1ce80a33b0 0x7f1ce80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:11.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.151+0000 7f1d02062640 1 --2- 172.21.15.2:0/3430106234 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f1ce80a33b0 0x7f1ce80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:11.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.151+0000 7f1cf37fe640 1 -- 172.21.15.2:0/3430106234 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8565+0+0 (secure 0 0 0) 0x7f1cec0cfe20 con 0x7f1cfc103660 2024-09-19T06:25:11.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.151+0000 7f1d02863640 1 --2- 172.21.15.2:0/3199142369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640fd7cfb40 0x5640fd7ce090 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4009f20 tx=0x7f1cf400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf01e8cdd0dba57 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:11.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.151+0000 7f1cf0dea640 1 -- 172.21.15.2:0/3199142369 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf401a070 con 0x5640fd7cfb40 2024-09-19T06:25:11.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.151+0000 7f1cf0dea640 1 -- 172.21.15.2:0/3199142369 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1cf40158c0 con 0x5640fd7cfb40 2024-09-19T06:25:11.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.151+0000 7f1cf0dea640 1 -- 172.21.15.2:0/3199142369 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf400a760 con 0x5640fd7cfb40 2024-09-19T06:25:11.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.152+0000 7f1d0669f740 1 -- 172.21.15.2:0/3199142369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640fd7cfb40 msgr2=0x5640fd7ce090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:11.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.152+0000 7f1d0669f740 1 --2- 172.21.15.2:0/3199142369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640fd7cfb40 0x5640fd7ce090 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4009f20 tx=0x7f1cf400c8b0 comp rx=0 tx=0).stop 2024-09-19T06:25:11.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.152+0000 7f1d02062640 1 --2- 172.21.15.2:0/3430106234 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f1ce80a33b0 0x7f1ce80a5870 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8031440 tx=0x7f1cf8005a20 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:11.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.152+0000 7f1d0669f740 1 -- 172.21.15.2:0/3199142369 shutdown_connections 2024-09-19T06:25:11.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.152+0000 7f1d0669f740 1 --2- 172.21.15.2:0/3199142369 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5640fd7d9370 0x5640fd7db760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:11.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.152+0000 7f1d0669f740 1 --2- 172.21.15.2:0/3199142369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5640fd7ce5d0 0x5640fd7cea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:11.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.152+0000 7f1d0669f740 1 --2- 172.21.15.2:0/3199142369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640fd7cfb40 0x5640fd7ce090 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:11.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.152+0000 7f1d0669f740 1 -- 172.21.15.2:0/3199142369 >> 172.21.15.2:0/3199142369 conn(0x5640fd797310 msgr2=0x5640fd7cac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:11.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.152+0000 7f1d0669f740 1 -- 172.21.15.2:0/3199142369 shutdown_connections 2024-09-19T06:25:11.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.152+0000 7f1d0669f740 1 -- 172.21.15.2:0/3199142369 wait complete. 2024-09-19T06:25:11.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.152+0000 7f1d0669f740 1 -- start start 2024-09-19T06:25:11.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.152+0000 7f1d0669f740 1 Processor -- start 2024-09-19T06:25:11.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.152+0000 7f1d0669f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640fd7ce5d0 0x5640fd7d8d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:11.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.152+0000 7f1d0669f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5640fd7cfb40 0x5640fd7d6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:11.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.153+0000 7f1d0669f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5640fd7d9370 0x5640fd7d6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:11.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.153+0000 7f1d0669f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5640fd7dc070 con 0x5640fd7ce5d0 2024-09-19T06:25:11.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.153+0000 7f1d0669f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5640fd6ef060 con 0x5640fd7cfb40 2024-09-19T06:25:11.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.153+0000 7f1d0669f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5640fd7dc1f0 con 0x5640fd7d9370 2024-09-19T06:25:11.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.153+0000 7f1d0669f740 10 client.0 _ll_register_callbacks cb 0x5640fd4428c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:25:11.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.153+0000 7f1d02062640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640fd7ce5d0 0x5640fd7d8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:11.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.153+0000 7f1d02062640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640fd7ce5d0 0x5640fd7d8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52534/0 (socket says 172.21.15.2:52534) 2024-09-19T06:25:11.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.153+0000 7f1d02062640 1 -- 172.21.15.2:0/4074962690 learned_addr learned my addr 172.21.15.2:0/4074962690 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:25:11.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.153+0000 7f1d01861640 1 --2- 172.21.15.2:0/4074962690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5640fd7cfb40 0x5640fd7d6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:11.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.153+0000 7f1d02863640 1 --2- 172.21.15.2:0/4074962690 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5640fd7d9370 0x5640fd7d6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:11.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.153+0000 7f1d02062640 1 -- 172.21.15.2:0/4074962690 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5640fd7d9370 msgr2=0x5640fd7d6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:25:11.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.153+0000 7f1d02062640 1 --2- 172.21.15.2:0/4074962690 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5640fd7d9370 0x5640fd7d6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:11.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.153+0000 7f1d02062640 1 -- 172.21.15.2:0/4074962690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5640fd7cfb40 msgr2=0x5640fd7d6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:25:11.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.153+0000 7f1d02062640 1 --2- 172.21.15.2:0/4074962690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5640fd7cfb40 0x5640fd7d6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:11.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.153+0000 7f1d02062640 1 -- 172.21.15.2:0/4074962690 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640fd4a53c0 con 0x5640fd7ce5d0 2024-09-19T06:25:11.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.153+0000 7f1d02062640 1 --2- 172.21.15.2:0/4074962690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640fd7ce5d0 0x5640fd7d8d70 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8033000 tx=0x7f1cf8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62da614a52ec76a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:11.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.153+0000 7f1ce5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:25:11.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.153+0000 7f1ce5ffb640 1 -- 172.21.15.2:0/4074962690 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf804c070 con 0x5640fd7ce5d0 2024-09-19T06:25:11.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.153+0000 7f1ce5ffb640 1 -- 172.21.15.2:0/4074962690 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8565+0+0 (secure 0 0 0) 0x7f1cf8004250 con 0x5640fd7ce5d0 2024-09-19T06:25:11.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.153+0000 7f1d0669f740 1 -- 172.21.15.2:0/4074962690 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1cf40158c0 con 0x5640fd7ce5d0 2024-09-19T06:25:11.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.154+0000 7f1ce5ffb640 1 -- 172.21.15.2:0/4074962690 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1cf8058050 con 0x5640fd7ce5d0 2024-09-19T06:25:11.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.154+0000 7f1d0669f740 10 client.19029 fetch_fsmap learned FSMap version 26 2024-09-19T06:25:11.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.154+0000 7f1d0669f740 1 -- 172.21.15.2:0/4074962690 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5640fd7e7b10 con 0x5640fd7ce5d0 2024-09-19T06:25:11.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.154+0000 7f1ce5ffb640 1 -- 172.21.15.2:0/4074962690 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1cf40158c0 con 0x5640fd7ce5d0 2024-09-19T06:25:11.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.154+0000 7f1ce5ffb640 1 -- 172.21.15.2:0/4074962690 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f1cf8048440 con 0x5640fd7ce5d0 2024-09-19T06:25:11.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.154+0000 7f1d0669f740 10 client.19029 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:25:11.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.154+0000 7f1d0669f740 10 client.19029 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:25:11.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.154+0000 7f1d0669f740 20 client.19029 populate_metadata read hostname 'smithi002' 2024-09-19T06:25:11.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.154+0000 7f1d0669f740 1 --2- 172.21.15.2:0/4074962690 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5640fd7e9010 0x5640fd7eb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:11.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.154+0000 7f1d0669f740 4 client.19029 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:25:11.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.154+0000 7f1d0669f740 1 -- 172.21.15.2:0/4074962690 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640fd741860 con 0x5640fd7e9010 2024-09-19T06:25:11.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.154+0000 7f1d01861640 1 --2- 172.21.15.2:0/4074962690 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5640fd7e9010 0x5640fd7eb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:11.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.155+0000 7f1d01861640 1 --2- 172.21.15.2:0/4074962690 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5640fd7e9010 0x5640fd7eb400 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2dd8f57bc655da86 server_cookie=25b5fa09858dcd3a in_seq=0 out_seq=0 2024-09-19T06:25:11.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.155+0000 7f1ce5ffb640 10 client.19029 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:25:11.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.155+0000 7f1ce5ffb640 1 -- 172.21.15.2:0/4074962690 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5640fd741860 con 0x5640fd7e9010 2024-09-19T06:25:11.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.155+0000 7f1ce5ffb640 10 client.19029 handle_command_reply: tid=0 2024-09-19T06:25:11.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.155+0000 7f1d0669f740 1 client.19029 shutdown 2024-09-19T06:25:11.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.156+0000 7f1d0669f740 1 -- 172.21.15.2:0/4074962690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640fd7ce5d0 msgr2=0x5640fd7d8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:11.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.156+0000 7f1d0669f740 1 --2- 172.21.15.2:0/4074962690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640fd7ce5d0 0x5640fd7d8d70 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8033000 tx=0x7f1cf8009260 comp rx=0 tx=0).stop 2024-09-19T06:25:11.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.156+0000 7f1d0669f740 1 -- 172.21.15.2:0/4074962690 shutdown_connections 2024-09-19T06:25:11.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.156+0000 7f1d0669f740 1 --2- 172.21.15.2:0/4074962690 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5640fd7d9370 0x5640fd7d6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:11.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.156+0000 7f1d0669f740 1 --2- 172.21.15.2:0/4074962690 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5640fd7e9010 0x5640fd7eb400 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:11.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.156+0000 7f1d0669f740 1 --2- 172.21.15.2:0/4074962690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5640fd7cfb40 0x5640fd7d6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:11.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.156+0000 7f1ce5ffb640 0 client.19029 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:25:11.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.156+0000 7f1d0669f740 1 --2- 172.21.15.2:0/4074962690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640fd7ce5d0 0x5640fd7d8d70 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:11.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.156+0000 7f1d0669f740 1 -- 172.21.15.2:0/4074962690 >> 172.21.15.2:0/4074962690 conn(0x5640fd797310 msgr2=0x5640fd7d0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:11.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.156+0000 7f1d0669f740 1 -- 172.21.15.2:0/4074962690 shutdown_connections 2024-09-19T06:25:11.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.156+0000 7f1d0669f740 1 -- 172.21.15.2:0/4074962690 wait complete. 2024-09-19T06:25:11.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.156+0000 7f1d0669f740 20 client.19029 trim_cache size 0 max 16384 2024-09-19T06:25:11.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.169+0000 7f1d0669f740 1 Processor -- start 2024-09-19T06:25:11.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.169+0000 7f1d0669f740 1 -- start start 2024-09-19T06:25:11.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.169+0000 7f1d0669f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5640fd7ce5d0 0x5640fd7e5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:11.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.169+0000 7f1d0669f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5640fd7cfb40 0x5640fd7d5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:11.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.169+0000 7f1d0669f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640fd7d9370 0x5640fd7d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:11.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.169+0000 7f1d0669f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1cfc1b0210 con 0x5640fd7d9370 2024-09-19T06:25:11.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.169+0000 7f1d0669f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f1cfc1adae0 con 0x5640fd7cfb40 2024-09-19T06:25:11.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.169+0000 7f1d0669f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1cfc1ab950 con 0x5640fd7ce5d0 2024-09-19T06:25:11.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.169+0000 7f1d02863640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640fd7d9370 0x5640fd7d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:11.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.169+0000 7f1d02863640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640fd7d9370 0x5640fd7d0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52550/0 (socket says 172.21.15.2:52550) 2024-09-19T06:25:11.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.169+0000 7f1d02863640 1 -- 172.21.15.2:0/2144328493 learned_addr learned my addr 172.21.15.2:0/2144328493 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:25:11.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.169+0000 7f1d02062640 1 --2- 172.21.15.2:0/2144328493 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5640fd7ce5d0 0x5640fd7e5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:11.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.170+0000 7f1d01861640 1 --2- 172.21.15.2:0/2144328493 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5640fd7cfb40 0x5640fd7d5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:11.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.170+0000 7f1d02863640 1 -- 172.21.15.2:0/2144328493 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5640fd7ce5d0 msgr2=0x5640fd7e5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:25:11.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.170+0000 7f1d02863640 1 --2- 172.21.15.2:0/2144328493 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5640fd7ce5d0 0x5640fd7e5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:11.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.170+0000 7f1d02863640 1 -- 172.21.15.2:0/2144328493 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5640fd7cfb40 msgr2=0x5640fd7d5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:25:11.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.170+0000 7f1d02863640 1 --2- 172.21.15.2:0/2144328493 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5640fd7cfb40 0x5640fd7d5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:11.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.170+0000 7f1d02863640 1 -- 172.21.15.2:0/2144328493 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640fd7eba30 con 0x5640fd7d9370 2024-09-19T06:25:11.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.170+0000 7f1d01861640 1 --2- 172.21.15.2:0/2144328493 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5640fd7cfb40 0x5640fd7d5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:25:11.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.170+0000 7f1d02863640 1 --2- 172.21.15.2:0/2144328493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640fd7d9370 0x5640fd7d0820 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4009f20 tx=0x7f1cf400a400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7918331a6328a39 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:11.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.170+0000 7f1ce7fff640 1 -- 172.21.15.2:0/2144328493 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf4024070 con 0x5640fd7d9370 2024-09-19T06:25:11.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.170+0000 7f1ce7fff640 1 -- 172.21.15.2:0/2144328493 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1cf400a920 con 0x5640fd7d9370 2024-09-19T06:25:11.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.170+0000 7f1ce7fff640 1 -- 172.21.15.2:0/2144328493 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf401a040 con 0x5640fd7d9370 2024-09-19T06:25:11.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.171+0000 7f1d0669f740 1 -- 172.21.15.2:0/2144328493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640fd7d9370 msgr2=0x5640fd7d0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:11.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.171+0000 7f1d0669f740 1 --2- 172.21.15.2:0/2144328493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640fd7d9370 0x5640fd7d0820 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4009f20 tx=0x7f1cf400a400 comp rx=0 tx=0).stop 2024-09-19T06:25:11.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.171+0000 7f1d0669f740 1 -- 172.21.15.2:0/2144328493 shutdown_connections 2024-09-19T06:25:11.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.171+0000 7f1d0669f740 1 --2- 172.21.15.2:0/2144328493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640fd7d9370 0x5640fd7d0820 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:11.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.171+0000 7f1d0669f740 1 --2- 172.21.15.2:0/2144328493 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5640fd7cfb40 0x5640fd7d5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:11.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.171+0000 7f1d0669f740 1 --2- 172.21.15.2:0/2144328493 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5640fd7ce5d0 0x5640fd7e5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:11.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.171+0000 7f1d0669f740 1 -- 172.21.15.2:0/2144328493 >> 172.21.15.2:0/2144328493 conn(0x5640fd797310 msgr2=0x5640fd7d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:11.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.171+0000 7f1d0669f740 1 -- 172.21.15.2:0/2144328493 shutdown_connections 2024-09-19T06:25:11.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.171+0000 7f1d0669f740 1 -- 172.21.15.2:0/2144328493 wait complete. 2024-09-19T06:25:11.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.171+0000 7f1d0669f740 1 -- start start 2024-09-19T06:25:11.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.171+0000 7f1d0669f740 1 Processor -- start 2024-09-19T06:25:11.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.171+0000 7f1d0669f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640fd7ce5d0 0x5640fd7e1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:11.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.171+0000 7f1d0669f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5640fd7cfb40 0x5640fd7e1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:11.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.171+0000 7f1d0669f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5640fd7d9370 0x5640fd7d2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:11.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.171+0000 7f1d0669f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1cfc1abfa0 con 0x5640fd7ce5d0 2024-09-19T06:25:11.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.171+0000 7f1d0669f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f1cfc1ad410 con 0x5640fd7d9370 2024-09-19T06:25:11.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.171+0000 7f1d0669f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1cfc1ac670 con 0x5640fd7cfb40 2024-09-19T06:25:11.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.172+0000 7f1d0669f740 10 client.0 _ll_register_callbacks cb 0x7f1cf8005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:25:11.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.172+0000 7f1d02062640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640fd7ce5d0 0x5640fd7e1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:11.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.172+0000 7f1d02062640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640fd7ce5d0 0x5640fd7e1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52562/0 (socket says 172.21.15.2:52562) 2024-09-19T06:25:11.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.172+0000 7f1d01861640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5640fd7cfb40 0x5640fd7e1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:11.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.172+0000 7f1d02062640 1 -- 172.21.15.2:0/1097740435 learned_addr learned my addr 172.21.15.2:0/1097740435 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:25:11.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.172+0000 7f1d02863640 1 --2- 172.21.15.2:0/1097740435 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5640fd7d9370 0x5640fd7d2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:11.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.172+0000 7f1d02062640 1 -- 172.21.15.2:0/1097740435 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5640fd7cfb40 msgr2=0x5640fd7e1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:25:11.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.172+0000 7f1d02062640 1 --2- 172.21.15.2:0/1097740435 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5640fd7cfb40 0x5640fd7e1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:11.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.172+0000 7f1d02062640 1 -- 172.21.15.2:0/1097740435 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5640fd7d9370 msgr2=0x5640fd7d2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:25:11.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.172+0000 7f1d02062640 1 --2- 172.21.15.2:0/1097740435 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5640fd7d9370 0x5640fd7d2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:11.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.172+0000 7f1d02062640 1 -- 172.21.15.2:0/1097740435 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640fd7d3470 con 0x5640fd7ce5d0 2024-09-19T06:25:11.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.172+0000 7f1d02863640 1 --2- 172.21.15.2:0/1097740435 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5640fd7d9370 0x5640fd7d2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:25:11.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.172+0000 7f1d01861640 1 --2- 172.21.15.2:0/1097740435 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5640fd7cfb40 0x5640fd7e1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:25:11.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.172+0000 7f1d02062640 1 --2- 172.21.15.2:0/1097740435 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640fd7ce5d0 0x5640fd7e1830 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8009900 tx=0x7f1cf8048670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b791bb00a2d45ac7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:11.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.172+0000 7f1ce5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-19T06:25:11.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.172+0000 7f1ce5ffb640 1 -- 172.21.15.2:0/1097740435 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf8060020 con 0x5640fd7ce5d0 2024-09-19T06:25:11.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.172+0000 7f1ce5ffb640 1 -- 172.21.15.2:0/1097740435 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8565+0+0 (secure 0 0 0) 0x7f1cf8004040 con 0x5640fd7ce5d0 2024-09-19T06:25:11.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.172+0000 7f1d0669f740 1 -- 172.21.15.2:0/1097740435 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1cf400a920 con 0x5640fd7ce5d0 2024-09-19T06:25:11.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.173+0000 7f1ce5ffb640 1 -- 172.21.15.2:0/1097740435 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1cf806b050 con 0x5640fd7ce5d0 2024-09-19T06:25:11.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.173+0000 7f1d0669f740 10 client.19035 fetch_fsmap learned FSMap version 26 2024-09-19T06:25:11.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.173+0000 7f1d0669f740 1 -- 172.21.15.2:0/1097740435 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5640fd853890 con 0x5640fd7ce5d0 2024-09-19T06:25:11.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.173+0000 7f1ce5ffb640 1 -- 172.21.15.2:0/1097740435 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1cf400a920 con 0x5640fd7ce5d0 2024-09-19T06:25:11.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.173+0000 7f1ce5ffb640 1 -- 172.21.15.2:0/1097740435 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f1cf8003b10 con 0x5640fd7ce5d0 2024-09-19T06:25:11.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.173+0000 7f1d0669f740 10 client.19035 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T06:25:11.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.173+0000 7f1d0669f740 10 client.19035 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:25:11.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.173+0000 7f1d0669f740 20 client.19035 populate_metadata read hostname 'smithi002' 2024-09-19T06:25:11.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.173+0000 7f1d0669f740 1 --2- 172.21.15.2:0/1097740435 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5640fd854060 0x5640fd856480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:11.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.173+0000 7f1d0669f740 4 client.19035 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:25:11.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.173+0000 7f1d0669f740 1 -- 172.21.15.2:0/1097740435 --> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5640fd73bd70 con 0x5640fd854060 2024-09-19T06:25:11.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.173+0000 7f1d01861640 1 --2- 172.21.15.2:0/1097740435 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5640fd854060 0x5640fd856480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:11.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.174+0000 7f1ce5ffb640 10 client.19035 ms_handle_connect on v2:172.21.15.89:6838/3897636568 2024-09-19T06:25:11.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.174+0000 7f1d01861640 1 --2- 172.21.15.2:0/1097740435 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5640fd854060 0x5640fd856480 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b80b87e919ed066 server_cookie=c5401980519739d1 in_seq=0 out_seq=0 2024-09-19T06:25:11.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.174+0000 7f1ce5ffb640 1 -- 172.21.15.2:0/1097740435 <== mds.0 v2:172.21.15.89:6838/3897636568 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5640fd73bd70 con 0x5640fd854060 2024-09-19T06:25:11.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.174+0000 7f1ce5ffb640 10 client.19035 handle_command_reply: tid=0 2024-09-19T06:25:11.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.174+0000 7f1d0669f740 1 client.19035 shutdown 2024-09-19T06:25:11.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.174+0000 7f1d0669f740 1 -- 172.21.15.2:0/1097740435 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640fd7ce5d0 msgr2=0x5640fd7e1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:11.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.174+0000 7f1d0669f740 1 --2- 172.21.15.2:0/1097740435 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640fd7ce5d0 0x5640fd7e1830 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8009900 tx=0x7f1cf8048670 comp rx=0 tx=0).stop 2024-09-19T06:25:11.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.174+0000 7f1d0669f740 1 -- 172.21.15.2:0/1097740435 shutdown_connections 2024-09-19T06:25:11.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.174+0000 7f1d0669f740 1 --2- 172.21.15.2:0/1097740435 >> [v2:172.21.15.89:6838/3897636568,v1:172.21.15.89:6839/3897636568] conn(0x5640fd854060 0x5640fd856480 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:11.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.174+0000 7f1d0669f740 1 --2- 172.21.15.2:0/1097740435 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5640fd7d9370 0x5640fd7d2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:11.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.174+0000 7f1d0669f740 1 --2- 172.21.15.2:0/1097740435 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5640fd7cfb40 0x5640fd7e1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:11.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.174+0000 7f1d0669f740 1 --2- 172.21.15.2:0/1097740435 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5640fd7ce5d0 0x5640fd7e1830 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:11.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.174+0000 7f1d0669f740 1 -- 172.21.15.2:0/1097740435 >> 172.21.15.2:0/1097740435 conn(0x5640fd797310 msgr2=0x5640fd7d0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:11.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.174+0000 7f1ce5ffb640 0 client.19035 ms_handle_reset on v2:172.21.15.89:6838/3897636568 2024-09-19T06:25:11.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.174+0000 7f1d0669f740 1 -- 172.21.15.2:0/1097740435 shutdown_connections 2024-09-19T06:25:11.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.174+0000 7f1d0669f740 1 -- 172.21.15.2:0/1097740435 wait complete. 2024-09-19T06:25:11.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.174+0000 7f1d0669f740 20 client.19035 trim_cache size 0 max 16384 2024-09-19T06:25:11.186 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-19T06:25:11.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.175+0000 7f1d042c6640 1 -- 172.21.15.2:0/3430106234 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f1ce80a33b0 msgr2=0x7f1ce80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:11.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.175+0000 7f1d042c6640 1 --2- 172.21.15.2:0/3430106234 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f1ce80a33b0 0x7f1ce80a5870 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8031440 tx=0x7f1cf8005a20 comp rx=0 tx=0).stop 2024-09-19T06:25:11.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.175+0000 7f1d042c6640 1 -- 172.21.15.2:0/3430106234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cfc103660 msgr2=0x7f1cfc1989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:11.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.175+0000 7f1d042c6640 1 --2- 172.21.15.2:0/3430106234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cfc103660 0x7f1cfc1989b0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f1cec00c940 tx=0x7f1cec00ce00 comp rx=0 tx=0).stop 2024-09-19T06:25:11.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.175+0000 7f1d042c6640 1 -- 172.21.15.2:0/3430106234 shutdown_connections 2024-09-19T06:25:11.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.175+0000 7f1d042c6640 1 --2- 172.21.15.2:0/3430106234 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f1ce80a33b0 0x7f1ce80a5870 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:11.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.175+0000 7f1d042c6640 1 --2- 172.21.15.2:0/3430106234 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1cfc10c170 0x7f1cfc19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:11.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.175+0000 7f1d042c6640 1 --2- 172.21.15.2:0/3430106234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cfc103660 0x7f1cfc1989b0 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:11.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.175+0000 7f1d042c6640 1 --2- 172.21.15.2:0/3430106234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1cfc102d40 0x7f1cfc198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:11.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.175+0000 7f1d042c6640 1 -- 172.21.15.2:0/3430106234 >> 172.21.15.2:0/3430106234 conn(0x7f1cfc0fc7a0 msgr2=0x7f1cfc0fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:11.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.175+0000 7f1d042c6640 1 -- 172.21.15.2:0/3430106234 shutdown_connections 2024-09-19T06:25:11.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.175+0000 7f1d042c6640 1 -- 172.21.15.2:0/3430106234 wait complete. 2024-09-19T06:25:11.866 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-19T06:25:11.867 INFO:tasks.fwd_scrub:done joining 2024-09-19T06:25:11.867 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-19T06:25:11.878 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T06:25:11.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:11 smithi090 ceph-mon[34497]: pgmap v323: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 29 op/s 2024-09-19T06:25:11.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.988+0000 7fef8bb98640 1 -- 172.21.15.2:0/3655123643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef8410c100 msgr2=0x7fef8410e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:11.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.988+0000 7fef8bb98640 1 --2- 172.21.15.2:0/3655123643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef8410c100 0x7fef8410e570 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fef7c009ca0 tx=0x7fef7c02a950 comp rx=0 tx=0).stop 2024-09-19T06:25:11.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.988+0000 7fef8bb98640 1 -- 172.21.15.2:0/3655123643 shutdown_connections 2024-09-19T06:25:11.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.988+0000 7fef8bb98640 1 --2- 172.21.15.2:0/3655123643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef8410c100 0x7fef8410e570 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:11.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.988+0000 7fef8bb98640 1 --2- 172.21.15.2:0/3655123643 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef84103650 0x7fef8410bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:11.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.988+0000 7fef8bb98640 1 --2- 172.21.15.2:0/3655123643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef84102d30 0x7fef84103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:11.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.988+0000 7fef8bb98640 1 -- 172.21.15.2:0/3655123643 >> 172.21.15.2:0/3655123643 conn(0x7fef84077a10 msgr2=0x7fef840fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:11.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.988+0000 7fef8bb98640 1 -- 172.21.15.2:0/3655123643 shutdown_connections 2024-09-19T06:25:11.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.989+0000 7fef8bb98640 1 -- 172.21.15.2:0/3655123643 wait complete. 2024-09-19T06:25:11.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.989+0000 7fef8bb98640 1 Processor -- start 2024-09-19T06:25:11.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.989+0000 7fef8bb98640 1 -- start start 2024-09-19T06:25:11.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.989+0000 7fef8bb98640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef84102d30 0x7fef841982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:11.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.989+0000 7fef8bb98640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef84103650 0x7fef84198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:11.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.989+0000 7fef8bb98640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef8410c100 0x7fef8419cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:11.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.989+0000 7fef8bb98640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fef84111e10 con 0x7fef84103650 2024-09-19T06:25:11.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.989+0000 7fef8bb98640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fef84111c90 con 0x7fef84102d30 2024-09-19T06:25:11.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.989+0000 7fef8bb98640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fef84111f90 con 0x7fef8410c100 2024-09-19T06:25:11.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.989+0000 7fef89133640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef84103650 0x7fef84198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:11.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.990+0000 7fef89133640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef84103650 0x7fef84198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52574/0 (socket says 172.21.15.2:52574) 2024-09-19T06:25:11.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.990+0000 7fef89133640 1 -- 172.21.15.2:0/1427824609 learned_addr learned my addr 172.21.15.2:0/1427824609 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:25:11.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.990+0000 7fef89934640 1 --2- 172.21.15.2:0/1427824609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef84102d30 0x7fef841982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:11.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.990+0000 7fef8a135640 1 --2- 172.21.15.2:0/1427824609 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef8410c100 0x7fef8419cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:11.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.990+0000 7fef89133640 1 -- 172.21.15.2:0/1427824609 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef8410c100 msgr2=0x7fef8419cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:11.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.990+0000 7fef89133640 1 --2- 172.21.15.2:0/1427824609 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef8410c100 0x7fef8419cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:11.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.990+0000 7fef89133640 1 -- 172.21.15.2:0/1427824609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef84102d30 msgr2=0x7fef841982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:11.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.990+0000 7fef89133640 1 --2- 172.21.15.2:0/1427824609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef84102d30 0x7fef841982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:11.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.990+0000 7fef89133640 1 -- 172.21.15.2:0/1427824609 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef8419d2d0 con 0x7fef84103650 2024-09-19T06:25:11.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.990+0000 7fef8a135640 1 --2- 172.21.15.2:0/1427824609 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef8410c100 0x7fef8419cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:25:11.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.990+0000 7fef89133640 1 --2- 172.21.15.2:0/1427824609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef84103650 0x7fef84198820 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fef7400c890 tx=0x7fef7400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:11.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.990+0000 7fef7affd640 1 -- 172.21.15.2:0/1427824609 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef74004220 con 0x7fef84103650 2024-09-19T06:25:11.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.990+0000 7fef7affd640 1 -- 172.21.15.2:0/1427824609 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fef740043c0 con 0x7fef84103650 2024-09-19T06:25:11.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.990+0000 7fef8bb98640 1 -- 172.21.15.2:0/1427824609 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef8419d5c0 con 0x7fef84103650 2024-09-19T06:25:11.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.990+0000 7fef7affd640 1 -- 172.21.15.2:0/1427824609 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef74004a00 con 0x7fef84103650 2024-09-19T06:25:11.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.990+0000 7fef8bb98640 1 -- 172.21.15.2:0/1427824609 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef841a4e50 con 0x7fef84103650 2024-09-19T06:25:11.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.991+0000 7fef8bb98640 1 -- 172.21.15.2:0/1427824609 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef84103110 con 0x7fef84103650 2024-09-19T06:25:11.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.993+0000 7fef7affd640 1 -- 172.21.15.2:0/1427824609 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fef740079b0 con 0x7fef84103650 2024-09-19T06:25:11.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.993+0000 7fef7affd640 1 --2- 172.21.15.2:0/1427824609 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fef700a33c0 0x7fef700a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:11.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.993+0000 7fef7affd640 1 -- 172.21.15.2:0/1427824609 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8565+0+0 (secure 0 0 0) 0x7fef740cfe50 con 0x7fef84103650 2024-09-19T06:25:11.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.993+0000 7fef89934640 1 --2- 172.21.15.2:0/1427824609 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fef700a33c0 0x7fef700a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:11.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.994+0000 7fef89934640 1 --2- 172.21.15.2:0/1427824609 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fef700a33c0 0x7fef700a5880 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fef80009990 tx=0x7fef80009110 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:11.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:11.996+0000 7fef7affd640 1 -- 172.21.15.2:0/1427824609 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fef74014030 con 0x7fef84103650 2024-09-19T06:25:12.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:11 smithi089 ceph-mon[34160]: pgmap v323: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 29 op/s 2024-09-19T06:25:12.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.173+0000 7fef8bb98640 1 -- 172.21.15.2:0/1427824609 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fef84199630 con 0x7fef84103650 2024-09-19T06:25:12.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.174+0000 7fef7affd640 1 -- 172.21.15.2:0/1427824609 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+23106 (secure 0 0 0) 0x7fef84199630 con 0x7fef84103650 2024-09-19T06:25:12.176 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:25:12.176 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":91,"fsid":"078f6612-764d-11ef-bceb-c7b262605968","created":"2024-09-19T06:05:17.607927+0000","modified":"2024-09-19T06:25:08.716370+0000","last_up_change":"2024-09-19T06:12:13.856684+0000","last_in_change":"2024-09-19T06:11:49.745266+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:08:28.425566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:13:00.482789+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:13:02.768221+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":91,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0de97a3d-2d27-455b-9998-ddd2319c148d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6803","nonce":915165910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6805","nonce":915165910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6809","nonce":915165910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6807","nonce":915165910}]},"public_addr":"172.21.15.2:6803/915165910","cluster_addr":"172.21.15.2:6805/915165910","heartbeat_back_addr":"172.21.15.2:6809/915165910","heartbeat_front_addr":"172.21.15.2:6807/915165910","state":["exists","up"]},{"osd":1,"uuid":"056d229e-2de4-4902-922e-21e1a5d3f061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6801","nonce":4097264171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6803","nonce":4097264171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6807","nonce":4097264171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6805","nonce":4097264171}]},"public_addr":"172.21.15.89:6801/4097264171","cluster_addr":"172.21.15.89:6803/4097264171","heartbeat_back_addr":"172.21.15.89:6807/4097264171","heartbeat_front_addr":"172.21.15.89:6805/4097264171","state":["exists","up"]},{"osd":2,"uuid":"2a4e7147-4125-4ee6-b5ad-85518d7066d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6801","nonce":1479908200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6803","nonce":1479908200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6807","nonce":1479908200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6805","nonce":1479908200}]},"public_addr":"172.21.15.90:6801/1479908200","cluster_addr":"172.21.15.90:6803/1479908200","heartbeat_back_addr":"172.21.15.90:6807/1479908200","heartbeat_front_addr":"172.21.15.90:6805/1479908200","state":["exists","up"]},{"osd":3,"uuid":"7b3da775-0f0a-4b46-a8dc-9ec822a54301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6811","nonce":1796948193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6813","nonce":1796948193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6817","nonce":1796948193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6815","nonce":1796948193}]},"public_addr":"172.21.15.2:6811/1796948193","cluster_addr":"172.21.15.2:6813/1796948193","heartbeat_back_addr":"172.21.15.2:6817/1796948193","heartbeat_front_addr":"172.21.15.2:6815/1796948193","state":["exists","up"]},{"osd":4,"uuid":"d4c8bafc-c844-4ff1-a3d8-7a53576e6b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6809","nonce":4256848315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6811","nonce":4256848315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6815","nonce":4256848315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6813","nonce":4256848315}]},"public_addr":"172.21.15.89:6809/4256848315","cluster_addr":"172.21.15.89:6811/4256848315","heartbeat_back_addr":"172.21.15.89:6815/4256848315","heartbeat_front_addr":"172.21.15.89:6813/4256848315","state":["exists","up"]},{"osd":5,"uuid":"8dc9bb55-29e0-4b04-9415-3b9bb5ed05cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6809","nonce":189855967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6811","nonce":189855967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6815","nonce":189855967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6813","nonce":189855967}]},"public_addr":"172.21.15.90:6809/189855967","cluster_addr":"172.21.15.90:6811/189855967","heartbeat_back_addr":"172.21.15.90:6815/189855967","heartbeat_front_addr":"172.21.15.90:6813/189855967","state":["exists","up"]},{"osd":6,"uuid":"86d1443a-9b43-46de-abd7-4c95b43207f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6819","nonce":3886336279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6821","nonce":3886336279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6825","nonce":3886336279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6823","nonce":3886336279}]},"public_addr":"172.21.15.2:6819/3886336279","cluster_addr":"172.21.15.2:6821/3886336279","heartbeat_back_addr":"172.21.15.2:6825/3886336279","heartbeat_front_addr":"172.21.15.2:6823/3886336279","state":["exists","up"]},{"osd":7,"uuid":"1cc5554c-80d2-4e77-b29a-fd2ada68d82d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6817","nonce":508513510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6819","nonce":508513510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6823","nonce":508513510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6821","nonce":508513510}]},"public_addr":"172.21.15.89:6817/508513510","cluster_addr":"172.21.15.89:6819/508513510","heartbeat_back_addr":"172.21.15.89:6823/508513510","heartbeat_front_addr":"172.21.15.89:6821/508513510","state":["exists","up"]},{"osd":8,"uuid":"e9b2eb92-9af2-4f26-a259-fcaf972e4fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6817","nonce":3558544480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6819","nonce":3558544480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6823","nonce":3558544480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6821","nonce":3558544480}]},"public_addr":"172.21.15.90:6817/3558544480","cluster_addr":"172.21.15.90:6819/3558544480","heartbeat_back_addr":"172.21.15.90:6823/3558544480","heartbeat_front_addr":"172.21.15.90:6821/3558544480","state":["exists","up"]},{"osd":9,"uuid":"194d4c64-dd29-4d35-bc54-0858c44815cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6827","nonce":2690758100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6829","nonce":2690758100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6833","nonce":2690758100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6831","nonce":2690758100}]},"public_addr":"172.21.15.2:6827/2690758100","cluster_addr":"172.21.15.2:6829/2690758100","heartbeat_back_addr":"172.21.15.2:6833/2690758100","heartbeat_front_addr":"172.21.15.2:6831/2690758100","state":["exists","up"]},{"osd":10,"uuid":"7695fa4a-b94e-4afc-b166-690a197ad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6825","nonce":1141925395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6827","nonce":1141925395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6831","nonce":1141925395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6829","nonce":1141925395}]},"public_addr":"172.21.15.89:6825/1141925395","cluster_addr":"172.21.15.89:6827/1141925395","heartbeat_back_addr":"172.21.15.89:6831/1141925395","heartbeat_front_addr":"172.21.15.89:6829/1141925395","state":["exists","up"]},{"osd":11,"uuid":"1815a999-bfdb-46b9-afcd-632ee8ba56d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6825","nonce":468380924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6827","nonce":468380924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6831","nonce":468380924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6829","nonce":468380924}]},"public_addr":"172.21.15.90:6825/468380924","cluster_addr":"172.21.15.90:6827/468380924","heartbeat_back_addr":"172.21.15.90:6831/468380924","heartbeat_front_addr":"172.21.15.90:6829/468380924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:07:36.125754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:01.415356+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:26.420808+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:51.722673+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:09:16.562300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:09:41.958465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:10:07.056167+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:10:32.066195+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:10:56.497875+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:11:21.973083+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:11:46.891515+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:12:11.910012+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9},{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/3813883133":"2024-09-20T06:14:48.099112+0000","172.21.15.2:0/2612001712":"2024-09-20T06:14:48.099112+0000","172.21.15.2:0/2508383651":"2024-09-20T06:14:48.099112+0000","172.21.15.2:0/3763089457":"2024-09-20T06:05:47.538477+0000","172.21.15.2:0/1361067708":"2024-09-20T06:05:47.538477+0000","172.21.15.2:6801/1200011821":"2024-09-20T06:06:11.912585+0000","172.21.15.2:0/3899165140":"2024-09-20T06:05:47.538477+0000","172.21.15.2:6800/1200011821":"2024-09-20T06:06:11.912585+0000","172.21.15.2:6800/1602650352":"2024-09-20T06:05:47.538477+0000","172.21.15.2:0/2976372536":"2024-09-20T06:06:11.912585+0000","172.21.15.2:0/1280963020":"2024-09-20T06:06:11.912585+0000","172.21.15.2:6800/4180340554":"2024-09-20T06:14:48.099112+0000","172.21.15.2:6801/1602650352":"2024-09-20T06:05:47.538477+0000","172.21.15.2:0/874985787":"2024-09-20T06:06:11.912585+0000","172.21.15.2:6801/4180340554":"2024-09-20T06:14:48.099112+0000","172.21.15.2:0/2134106196":"2024-09-20T06:14:48.099112+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:25:12.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.177+0000 7fef8bb98640 1 -- 172.21.15.2:0/1427824609 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fef700a33c0 msgr2=0x7fef700a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:12.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.177+0000 7fef8bb98640 1 --2- 172.21.15.2:0/1427824609 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fef700a33c0 0x7fef700a5880 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fef80009990 tx=0x7fef80009110 comp rx=0 tx=0).stop 2024-09-19T06:25:12.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.177+0000 7fef8bb98640 1 -- 172.21.15.2:0/1427824609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef84103650 msgr2=0x7fef84198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:12.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.177+0000 7fef8bb98640 1 --2- 172.21.15.2:0/1427824609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef84103650 0x7fef84198820 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fef7400c890 tx=0x7fef7400cc90 comp rx=0 tx=0).stop 2024-09-19T06:25:12.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.177+0000 7fef8bb98640 1 -- 172.21.15.2:0/1427824609 shutdown_connections 2024-09-19T06:25:12.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.177+0000 7fef8bb98640 1 --2- 172.21.15.2:0/1427824609 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fef700a33c0 0x7fef700a5880 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:12.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.177+0000 7fef8bb98640 1 --2- 172.21.15.2:0/1427824609 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef8410c100 0x7fef8419cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:12.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.177+0000 7fef8bb98640 1 --2- 172.21.15.2:0/1427824609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef84103650 0x7fef84198820 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:12.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.177+0000 7fef8bb98640 1 --2- 172.21.15.2:0/1427824609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef84102d30 0x7fef841982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:12.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.177+0000 7fef8bb98640 1 -- 172.21.15.2:0/1427824609 >> 172.21.15.2:0/1427824609 conn(0x7fef84077a10 msgr2=0x7fef840fd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:12.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.177+0000 7fef8bb98640 1 -- 172.21.15.2:0/1427824609 shutdown_connections 2024-09-19T06:25:12.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.177+0000 7fef8bb98640 1 -- 172.21.15.2:0/1427824609 wait complete. 2024-09-19T06:25:12.188 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:11 smithi002 ceph-mon[30982]: pgmap v323: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 29 op/s 2024-09-19T06:25:12.190 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T06:08:28.425566+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T06:13:00.482789+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T06:13:02.768221+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '91', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 17, 'snap_epoch': 91, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T06:25:12.190 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T06:25:12.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.295+0000 7fd6efe2c640 1 -- 172.21.15.2:0/2232138338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6e8103650 msgr2=0x7fd6e810bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:12.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.295+0000 7fd6efe2c640 1 --2- 172.21.15.2:0/2232138338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6e8103650 0x7fd6e810bb30 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8009900 tx=0x7fd6d802a410 comp rx=0 tx=0).stop 2024-09-19T06:25:12.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.295+0000 7fd6efe2c640 1 -- 172.21.15.2:0/2232138338 shutdown_connections 2024-09-19T06:25:12.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.295+0000 7fd6efe2c640 1 --2- 172.21.15.2:0/2232138338 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd6e810c100 0x7fd6e810e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:12.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.295+0000 7fd6efe2c640 1 --2- 172.21.15.2:0/2232138338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6e8103650 0x7fd6e810bb30 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:12.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.295+0000 7fd6efe2c640 1 --2- 172.21.15.2:0/2232138338 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6e8102d30 0x7fd6e8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:12.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.295+0000 7fd6efe2c640 1 -- 172.21.15.2:0/2232138338 >> 172.21.15.2:0/2232138338 conn(0x7fd6e80fc6a0 msgr2=0x7fd6e80feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:12.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.295+0000 7fd6efe2c640 1 -- 172.21.15.2:0/2232138338 shutdown_connections 2024-09-19T06:25:12.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.295+0000 7fd6efe2c640 1 -- 172.21.15.2:0/2232138338 wait complete. 2024-09-19T06:25:12.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.296+0000 7fd6efe2c640 1 Processor -- start 2024-09-19T06:25:12.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.296+0000 7fd6efe2c640 1 -- start start 2024-09-19T06:25:12.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.296+0000 7fd6efe2c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6e8102d30 0x7fd6e81982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:12.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.296+0000 7fd6efe2c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd6e8103650 0x7fd6e8198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:12.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.296+0000 7fd6efe2c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6e810c100 0x7fd6e819cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:12.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.296+0000 7fd6efe2c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e8111d40 con 0x7fd6e810c100 2024-09-19T06:25:12.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.296+0000 7fd6efe2c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e8111bc0 con 0x7fd6e8102d30 2024-09-19T06:25:12.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.296+0000 7fd6efe2c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e8111ec0 con 0x7fd6e8103650 2024-09-19T06:25:12.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.296+0000 7fd6ee3c9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6e810c100 0x7fd6e819cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:12.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.296+0000 7fd6ee3c9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6e810c100 0x7fd6e819cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52584/0 (socket says 172.21.15.2:52584) 2024-09-19T06:25:12.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.296+0000 7fd6ee3c9640 1 -- 172.21.15.2:0/2000080661 learned_addr learned my addr 172.21.15.2:0/2000080661 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:25:12.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.296+0000 7fd6ed3c7640 1 --2- 172.21.15.2:0/2000080661 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd6e8103650 0x7fd6e8198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:12.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.296+0000 7fd6edbc8640 1 --2- 172.21.15.2:0/2000080661 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6e8102d30 0x7fd6e81982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:12.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.296+0000 7fd6ee3c9640 1 -- 172.21.15.2:0/2000080661 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd6e8103650 msgr2=0x7fd6e8198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:12.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.296+0000 7fd6ee3c9640 1 --2- 172.21.15.2:0/2000080661 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd6e8103650 0x7fd6e8198810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:12.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.296+0000 7fd6ee3c9640 1 -- 172.21.15.2:0/2000080661 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6e8102d30 msgr2=0x7fd6e81982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:12.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.296+0000 7fd6ee3c9640 1 --2- 172.21.15.2:0/2000080661 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6e8102d30 0x7fd6e81982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:12.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.296+0000 7fd6ee3c9640 1 -- 172.21.15.2:0/2000080661 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6e819d2c0 con 0x7fd6e810c100 2024-09-19T06:25:12.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.296+0000 7fd6edbc8640 1 --2- 172.21.15.2:0/2000080661 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6e8102d30 0x7fd6e81982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:25:12.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.297+0000 7fd6ee3c9640 1 --2- 172.21.15.2:0/2000080661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6e810c100 0x7fd6e819cb90 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fd6e000eb10 tx=0x7fd6e000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:12.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.297+0000 7fd6deffd640 1 -- 172.21.15.2:0/2000080661 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0004b20 con 0x7fd6e810c100 2024-09-19T06:25:12.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.297+0000 7fd6deffd640 1 -- 172.21.15.2:0/2000080661 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd6e0004cc0 con 0x7fd6e810c100 2024-09-19T06:25:12.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.297+0000 7fd6efe2c640 1 -- 172.21.15.2:0/2000080661 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6e819d5b0 con 0x7fd6e810c100 2024-09-19T06:25:12.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.297+0000 7fd6deffd640 1 -- 172.21.15.2:0/2000080661 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0010690 con 0x7fd6e810c100 2024-09-19T06:25:12.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.297+0000 7fd6efe2c640 1 -- 172.21.15.2:0/2000080661 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6e81a4e40 con 0x7fd6e810c100 2024-09-19T06:25:12.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.298+0000 7fd6efe2c640 1 -- 172.21.15.2:0/2000080661 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6e8103110 con 0x7fd6e810c100 2024-09-19T06:25:12.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.299+0000 7fd6deffd640 1 -- 172.21.15.2:0/2000080661 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fd6e0005020 con 0x7fd6e810c100 2024-09-19T06:25:12.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.300+0000 7fd6deffd640 1 --2- 172.21.15.2:0/2000080661 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fd6d40a33c0 0x7fd6d40a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:12.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.300+0000 7fd6edbc8640 1 --2- 172.21.15.2:0/2000080661 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fd6d40a33c0 0x7fd6d40a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:12.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.300+0000 7fd6deffd640 1 -- 172.21.15.2:0/2000080661 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8565+0+0 (secure 0 0 0) 0x7fd6e00d04b0 con 0x7fd6e810c100 2024-09-19T06:25:12.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.300+0000 7fd6edbc8640 1 --2- 172.21.15.2:0/2000080661 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fd6d40a33c0 0x7fd6d40a5880 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4005d00 tx=0x7fd6e4009550 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:12.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.304+0000 7fd6deffd640 1 -- 172.21.15.2:0/2000080661 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd6e009ce00 con 0x7fd6e810c100 2024-09-19T06:25:12.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.479+0000 7fd6efe2c640 1 -- 172.21.15.2:0/2000080661 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd6e802d7c0 con 0x7fd6e810c100 2024-09-19T06:25:12.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.480+0000 7fd6deffd640 1 -- 172.21.15.2:0/2000080661 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) ==== 93+0+10 (secure 0 0 0) 0x7fd6e009c700 con 0x7fd6e810c100 2024-09-19T06:25:12.481 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-09-19T06:25:12.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.482+0000 7fd6efe2c640 1 -- 172.21.15.2:0/2000080661 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fd6d40a33c0 msgr2=0x7fd6d40a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:12.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.482+0000 7fd6efe2c640 1 --2- 172.21.15.2:0/2000080661 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fd6d40a33c0 0x7fd6d40a5880 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4005d00 tx=0x7fd6e4009550 comp rx=0 tx=0).stop 2024-09-19T06:25:12.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.482+0000 7fd6efe2c640 1 -- 172.21.15.2:0/2000080661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6e810c100 msgr2=0x7fd6e819cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:12.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.482+0000 7fd6efe2c640 1 --2- 172.21.15.2:0/2000080661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6e810c100 0x7fd6e819cb90 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fd6e000eb10 tx=0x7fd6e000c2d0 comp rx=0 tx=0).stop 2024-09-19T06:25:12.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.482+0000 7fd6efe2c640 1 -- 172.21.15.2:0/2000080661 shutdown_connections 2024-09-19T06:25:12.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.482+0000 7fd6efe2c640 1 --2- 172.21.15.2:0/2000080661 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fd6d40a33c0 0x7fd6d40a5880 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:12.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.482+0000 7fd6efe2c640 1 --2- 172.21.15.2:0/2000080661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6e810c100 0x7fd6e819cb90 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:12.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.482+0000 7fd6efe2c640 1 --2- 172.21.15.2:0/2000080661 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd6e8103650 0x7fd6e8198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:12.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.482+0000 7fd6efe2c640 1 --2- 172.21.15.2:0/2000080661 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6e8102d30 0x7fd6e81982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:12.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.482+0000 7fd6efe2c640 1 -- 172.21.15.2:0/2000080661 >> 172.21.15.2:0/2000080661 conn(0x7fd6e80fc6a0 msgr2=0x7fd6e80fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:12.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.482+0000 7fd6efe2c640 1 -- 172.21.15.2:0/2000080661 shutdown_connections 2024-09-19T06:25:12.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.482+0000 7fd6efe2c640 1 -- 172.21.15.2:0/2000080661 wait complete. 2024-09-19T06:25:12.494 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T06:25:12.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.600+0000 7febffb31640 1 -- 172.21.15.2:0/1322106413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febf8101a90 msgr2=0x7febf8101ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:12.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.600+0000 7febffb31640 1 --2- 172.21.15.2:0/1322106413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febf8101a90 0x7febf8101ef0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7febe8009930 tx=0x7febe802a420 comp rx=0 tx=0).stop 2024-09-19T06:25:12.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.600+0000 7febffb31640 1 -- 172.21.15.2:0/1322106413 shutdown_connections 2024-09-19T06:25:12.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.600+0000 7febffb31640 1 --2- 172.21.15.2:0/1322106413 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7febf8102430 0x7febf810e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:12.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.600+0000 7febffb31640 1 --2- 172.21.15.2:0/1322106413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febf8101a90 0x7febf8101ef0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:12.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.600+0000 7febffb31640 1 --2- 172.21.15.2:0/1322106413 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7febf8107aa0 0x7febf8107e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:12.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.600+0000 7febffb31640 1 -- 172.21.15.2:0/1322106413 >> 172.21.15.2:0/1322106413 conn(0x7febf80fd7b0 msgr2=0x7febf80ffbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:12.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.600+0000 7febffb31640 1 -- 172.21.15.2:0/1322106413 shutdown_connections 2024-09-19T06:25:12.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.600+0000 7febffb31640 1 -- 172.21.15.2:0/1322106413 wait complete. 2024-09-19T06:25:12.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.601+0000 7febffb31640 1 Processor -- start 2024-09-19T06:25:12.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.601+0000 7febffb31640 1 -- start start 2024-09-19T06:25:12.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.601+0000 7febffb31640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7febf8101a90 0x7febf81982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:12.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.601+0000 7febffb31640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7febf8102430 0x7febf8198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:12.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.601+0000 7febffb31640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febf8107aa0 0x7febf819cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:12.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.601+0000 7febffb31640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7febf8111d90 con 0x7febf8107aa0 2024-09-19T06:25:12.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.601+0000 7febffb31640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7febf8111c10 con 0x7febf8101a90 2024-09-19T06:25:12.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.601+0000 7febffb31640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7febf8111f10 con 0x7febf8102430 2024-09-19T06:25:12.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.601+0000 7febfe0ce640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febf8107aa0 0x7febf819cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:12.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.601+0000 7febfe0ce640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febf8107aa0 0x7febf819cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52598/0 (socket says 172.21.15.2:52598) 2024-09-19T06:25:12.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.601+0000 7febfe0ce640 1 -- 172.21.15.2:0/3944723094 learned_addr learned my addr 172.21.15.2:0/3944723094 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:25:12.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.601+0000 7febfd0cc640 1 --2- 172.21.15.2:0/3944723094 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7febf8102430 0x7febf8198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:12.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.601+0000 7febfd8cd640 1 --2- 172.21.15.2:0/3944723094 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7febf8101a90 0x7febf81982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:12.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.601+0000 7febfe0ce640 1 -- 172.21.15.2:0/3944723094 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7febf8102430 msgr2=0x7febf8198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:12.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.601+0000 7febfe0ce640 1 --2- 172.21.15.2:0/3944723094 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7febf8102430 0x7febf8198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:12.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.601+0000 7febfe0ce640 1 -- 172.21.15.2:0/3944723094 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7febf8101a90 msgr2=0x7febf81982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:12.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.601+0000 7febfe0ce640 1 --2- 172.21.15.2:0/3944723094 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7febf8101a90 0x7febf81982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:12.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.601+0000 7febfe0ce640 1 -- 172.21.15.2:0/3944723094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febf819d2d0 con 0x7febf8107aa0 2024-09-19T06:25:12.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.601+0000 7febfd8cd640 1 --2- 172.21.15.2:0/3944723094 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7febf8101a90 0x7febf81982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:25:12.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.601+0000 7febfe0ce640 1 --2- 172.21.15.2:0/3944723094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febf8107aa0 0x7febf819cba0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7febf000cad0 tx=0x7febf000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:12.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.602+0000 7febeeffd640 1 -- 172.21.15.2:0/3944723094 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf000ae20 con 0x7febf8107aa0 2024-09-19T06:25:12.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.602+0000 7febeeffd640 1 -- 172.21.15.2:0/3944723094 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7febf0005020 con 0x7febf8107aa0 2024-09-19T06:25:12.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.602+0000 7febeeffd640 1 -- 172.21.15.2:0/3944723094 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf000f6b0 con 0x7febf8107aa0 2024-09-19T06:25:12.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.602+0000 7febffb31640 1 -- 172.21.15.2:0/3944723094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febf819d5c0 con 0x7febf8107aa0 2024-09-19T06:25:12.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.602+0000 7febffb31640 1 -- 172.21.15.2:0/3944723094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febf81a4e50 con 0x7febf8107aa0 2024-09-19T06:25:12.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.603+0000 7febffb31640 1 -- 172.21.15.2:0/3944723094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febf8101ef0 con 0x7febf8107aa0 2024-09-19T06:25:12.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.604+0000 7febeeffd640 1 -- 172.21.15.2:0/3944723094 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7febf00051d0 con 0x7febf8107aa0 2024-09-19T06:25:12.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.605+0000 7febeeffd640 1 --2- 172.21.15.2:0/3944723094 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7febe40a33c0 0x7febe40a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:12.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.605+0000 7febfd8cd640 1 --2- 172.21.15.2:0/3944723094 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7febe40a33c0 0x7febe40a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:12.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.605+0000 7febeeffd640 1 -- 172.21.15.2:0/3944723094 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8565+0+0 (secure 0 0 0) 0x7febf00cfd90 con 0x7febf8107aa0 2024-09-19T06:25:12.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.605+0000 7febfd8cd640 1 --2- 172.21.15.2:0/3944723094 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7febe40a33c0 0x7febe40a5880 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7febf4005e10 tx=0x7febf4005da0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:12.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.609+0000 7febeeffd640 1 -- 172.21.15.2:0/3944723094 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7febf0014030 con 0x7febf8107aa0 2024-09-19T06:25:12.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.784+0000 7febffb31640 1 -- 172.21.15.2:0/3944723094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7febf802d7c0 con 0x7febf8107aa0 2024-09-19T06:25:12.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.785+0000 7febeeffd640 1 -- 172.21.15.2:0/3944723094 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) ==== 104+0+11 (secure 0 0 0) 0x7febf009c740 con 0x7febf8107aa0 2024-09-19T06:25:12.786 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-09-19T06:25:12.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.787+0000 7febffb31640 1 -- 172.21.15.2:0/3944723094 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7febe40a33c0 msgr2=0x7febe40a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:12.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.787+0000 7febffb31640 1 --2- 172.21.15.2:0/3944723094 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7febe40a33c0 0x7febe40a5880 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7febf4005e10 tx=0x7febf4005da0 comp rx=0 tx=0).stop 2024-09-19T06:25:12.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.787+0000 7febffb31640 1 -- 172.21.15.2:0/3944723094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febf8107aa0 msgr2=0x7febf819cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:12.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.787+0000 7febffb31640 1 --2- 172.21.15.2:0/3944723094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febf8107aa0 0x7febf819cba0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7febf000cad0 tx=0x7febf000cf90 comp rx=0 tx=0).stop 2024-09-19T06:25:12.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.787+0000 7febffb31640 1 -- 172.21.15.2:0/3944723094 shutdown_connections 2024-09-19T06:25:12.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.787+0000 7febffb31640 1 --2- 172.21.15.2:0/3944723094 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7febe40a33c0 0x7febe40a5880 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:12.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.787+0000 7febffb31640 1 --2- 172.21.15.2:0/3944723094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febf8107aa0 0x7febf819cba0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:12.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.787+0000 7febffb31640 1 --2- 172.21.15.2:0/3944723094 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7febf8102430 0x7febf8198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:12.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.787+0000 7febffb31640 1 --2- 172.21.15.2:0/3944723094 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7febf8101a90 0x7febf81982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:12.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.787+0000 7febffb31640 1 -- 172.21.15.2:0/3944723094 >> 172.21.15.2:0/3944723094 conn(0x7febf80fd7b0 msgr2=0x7febf80fdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:12.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.787+0000 7febffb31640 1 -- 172.21.15.2:0/3944723094 shutdown_connections 2024-09-19T06:25:12.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.787+0000 7febffb31640 1 -- 172.21.15.2:0/3944723094 wait complete. 2024-09-19T06:25:12.798 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:12 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1427824609' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:25:12.798 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:12 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/2000080661' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:25:12.799 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T06:25:12.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.905+0000 7f254a34b640 1 -- 172.21.15.2:0/1574183306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25441017a0 msgr2=0x7f254410d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:12.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.905+0000 7f254a34b640 1 --2- 172.21.15.2:0/1574183306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25441017a0 0x7f254410d870 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f253c009cd0 tx=0x7f253c02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:25:12.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.905+0000 7f254a34b640 1 -- 172.21.15.2:0/1574183306 shutdown_connections 2024-09-19T06:25:12.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.905+0000 7f254a34b640 1 --2- 172.21.15.2:0/1574183306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25441017a0 0x7f254410d870 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:12.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.905+0000 7f254a34b640 1 --2- 172.21.15.2:0/1574183306 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2544100e00 0x7f2544101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:12.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.905+0000 7f254a34b640 1 --2- 172.21.15.2:0/1574183306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25441069b0 0x7f2544106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:12.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.905+0000 7f254a34b640 1 -- 172.21.15.2:0/1574183306 >> 172.21.15.2:0/1574183306 conn(0x7f25440766f0 msgr2=0x7f2544076b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:12.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.905+0000 7f254a34b640 1 -- 172.21.15.2:0/1574183306 shutdown_connections 2024-09-19T06:25:12.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.905+0000 7f254a34b640 1 -- 172.21.15.2:0/1574183306 wait complete. 2024-09-19T06:25:12.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.905+0000 7f254a34b640 1 Processor -- start 2024-09-19T06:25:12.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.905+0000 7f254a34b640 1 -- start start 2024-09-19T06:25:12.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.906+0000 7f254a34b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2544100e00 0x7f2544197110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:12.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.906+0000 7f254a34b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25441017a0 0x7f2544197650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:12.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.906+0000 7f254a34b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25441069b0 0x7f254419b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:12.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.906+0000 7f254a34b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2544110ca0 con 0x7f25441069b0 2024-09-19T06:25:12.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.906+0000 7f254a34b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2544110b20 con 0x7f25441017a0 2024-09-19T06:25:12.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.906+0000 7f254a34b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2544110e20 con 0x7f2544100e00 2024-09-19T06:25:12.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.906+0000 7f25488e8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25441069b0 0x7f254419b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:12.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.906+0000 7f25488e8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25441069b0 0x7f254419b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52610/0 (socket says 172.21.15.2:52610) 2024-09-19T06:25:12.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.906+0000 7f25488e8640 1 -- 172.21.15.2:0/3563178110 learned_addr learned my addr 172.21.15.2:0/3563178110 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:25:12.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.906+0000 7f2543fff640 1 --2- 172.21.15.2:0/3563178110 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2544100e00 0x7f2544197110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:12.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.906+0000 7f25437fe640 1 --2- 172.21.15.2:0/3563178110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25441017a0 0x7f2544197650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:12.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.906+0000 7f25488e8640 1 -- 172.21.15.2:0/3563178110 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2544100e00 msgr2=0x7f2544197110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:12.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.906+0000 7f25488e8640 1 --2- 172.21.15.2:0/3563178110 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2544100e00 0x7f2544197110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:12.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.906+0000 7f25488e8640 1 -- 172.21.15.2:0/3563178110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25441017a0 msgr2=0x7f2544197650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:12.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.906+0000 7f25488e8640 1 --2- 172.21.15.2:0/3563178110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25441017a0 0x7f2544197650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:12.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.906+0000 7f25488e8640 1 -- 172.21.15.2:0/3563178110 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f254419c100 con 0x7f25441069b0 2024-09-19T06:25:12.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.906+0000 7f25437fe640 1 --2- 172.21.15.2:0/3563178110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25441017a0 0x7f2544197650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:25:12.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.906+0000 7f25488e8640 1 --2- 172.21.15.2:0/3563178110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25441069b0 0x7f254419b9d0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f253c005cc0 tx=0x7f253c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:12.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.906+0000 7f25417fa640 1 -- 172.21.15.2:0/3563178110 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253c004450 con 0x7f25441069b0 2024-09-19T06:25:12.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.907+0000 7f254a34b640 1 -- 172.21.15.2:0/3563178110 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f254419c390 con 0x7f25441069b0 2024-09-19T06:25:12.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.907+0000 7f25417fa640 1 -- 172.21.15.2:0/3563178110 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f253c031c90 con 0x7f25441069b0 2024-09-19T06:25:12.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.907+0000 7f25417fa640 1 -- 172.21.15.2:0/3563178110 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253c03b400 con 0x7f25441069b0 2024-09-19T06:25:12.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.907+0000 7f254a34b640 1 -- 172.21.15.2:0/3563178110 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25441a3c80 con 0x7f25441069b0 2024-09-19T06:25:12.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.908+0000 7f254a34b640 1 -- 172.21.15.2:0/3563178110 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2544101260 con 0x7f25441069b0 2024-09-19T06:25:12.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.909+0000 7f25417fa640 1 -- 172.21.15.2:0/3563178110 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f253c004680 con 0x7f25441069b0 2024-09-19T06:25:12.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.910+0000 7f25417fa640 1 --2- 172.21.15.2:0/3563178110 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f252c0a33c0 0x7f252c0a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:12.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.910+0000 7f25417fa640 1 -- 172.21.15.2:0/3563178110 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8565+0+0 (secure 0 0 0) 0x7f253c02e030 con 0x7f25441069b0 2024-09-19T06:25:12.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.910+0000 7f2543fff640 1 --2- 172.21.15.2:0/3563178110 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f252c0a33c0 0x7f252c0a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:12.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.910+0000 7f2543fff640 1 --2- 172.21.15.2:0/3563178110 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f252c0a33c0 0x7f252c0a5880 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f253400bb60 tx=0x7f253400b390 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:12.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:12.914+0000 7f25417fa640 1 -- 172.21.15.2:0/3563178110 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f253c0bd8f0 con 0x7f25441069b0 2024-09-19T06:25:12.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:12 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1427824609' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:25:12.990 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:12 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/2000080661' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:25:13.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:12 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1427824609' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:25:13.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:12 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/2000080661' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:25:13.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.090+0000 7f254a34b640 1 -- 172.21.15.2:0/3563178110 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f25441a3f20 con 0x7f25441069b0 2024-09-19T06:25:13.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.091+0000 7f25417fa640 1 -- 172.21.15.2:0/3563178110 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) ==== 100+0+11 (secure 0 0 0) 0x7f253c0098b0 con 0x7f25441069b0 2024-09-19T06:25:13.093 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2024-09-19T06:25:13.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.093+0000 7f254a34b640 1 -- 172.21.15.2:0/3563178110 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f252c0a33c0 msgr2=0x7f252c0a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:13.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.093+0000 7f254a34b640 1 --2- 172.21.15.2:0/3563178110 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f252c0a33c0 0x7f252c0a5880 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f253400bb60 tx=0x7f253400b390 comp rx=0 tx=0).stop 2024-09-19T06:25:13.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.093+0000 7f254a34b640 1 -- 172.21.15.2:0/3563178110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25441069b0 msgr2=0x7f254419b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:13.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.093+0000 7f254a34b640 1 --2- 172.21.15.2:0/3563178110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25441069b0 0x7f254419b9d0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f253c005cc0 tx=0x7f253c003c20 comp rx=0 tx=0).stop 2024-09-19T06:25:13.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.093+0000 7f254a34b640 1 -- 172.21.15.2:0/3563178110 shutdown_connections 2024-09-19T06:25:13.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.093+0000 7f254a34b640 1 --2- 172.21.15.2:0/3563178110 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f252c0a33c0 0x7f252c0a5880 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:13.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.093+0000 7f254a34b640 1 --2- 172.21.15.2:0/3563178110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25441069b0 0x7f254419b9d0 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:13.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.093+0000 7f254a34b640 1 --2- 172.21.15.2:0/3563178110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25441017a0 0x7f2544197650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:13.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.093+0000 7f254a34b640 1 --2- 172.21.15.2:0/3563178110 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2544100e00 0x7f2544197110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:13.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.093+0000 7f254a34b640 1 -- 172.21.15.2:0/3563178110 >> 172.21.15.2:0/3563178110 conn(0x7f25440766f0 msgr2=0x7f25440fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:13.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.093+0000 7f254a34b640 1 -- 172.21.15.2:0/3563178110 shutdown_connections 2024-09-19T06:25:13.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.094+0000 7f254a34b640 1 -- 172.21.15.2:0/3563178110 wait complete. 2024-09-19T06:25:13.106 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-19T06:25:13.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.208+0000 7fc72c023640 1 -- 172.21.15.2:0/3234058445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7241069b0 msgr2=0x7fc724106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:13.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.208+0000 7fc72c023640 1 --2- 172.21.15.2:0/3234058445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7241069b0 0x7fc724106d90 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fc720009930 tx=0x7fc72002a420 comp rx=0 tx=0).stop 2024-09-19T06:25:13.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.208+0000 7fc72c023640 1 -- 172.21.15.2:0/3234058445 shutdown_connections 2024-09-19T06:25:13.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.208+0000 7fc72c023640 1 --2- 172.21.15.2:0/3234058445 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc724101340 0x7fc72410d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:13.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.208+0000 7fc72c023640 1 --2- 172.21.15.2:0/3234058445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7241009a0 0x7fc724100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:13.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.208+0000 7fc72c023640 1 --2- 172.21.15.2:0/3234058445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7241069b0 0x7fc724106d90 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:13.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.208+0000 7fc72c023640 1 -- 172.21.15.2:0/3234058445 >> 172.21.15.2:0/3234058445 conn(0x7fc7240fc6a0 msgr2=0x7fc7240feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:13.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.208+0000 7fc72c023640 1 -- 172.21.15.2:0/3234058445 shutdown_connections 2024-09-19T06:25:13.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.208+0000 7fc72c023640 1 -- 172.21.15.2:0/3234058445 wait complete. 2024-09-19T06:25:13.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.208+0000 7fc72c023640 1 Processor -- start 2024-09-19T06:25:13.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.208+0000 7fc72c023640 1 -- start start 2024-09-19T06:25:13.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.209+0000 7fc72c023640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7241009a0 0x7fc724198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:13.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.209+0000 7fc72c023640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc724101340 0x7fc724198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:13.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.209+0000 7fc72c023640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7241069b0 0x7fc72419cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:13.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.209+0000 7fc72c023640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc724110ca0 con 0x7fc724101340 2024-09-19T06:25:13.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.209+0000 7fc72c023640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc724110b20 con 0x7fc7241069b0 2024-09-19T06:25:13.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.209+0000 7fc72c023640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc724110e20 con 0x7fc7241009a0 2024-09-19T06:25:13.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.209+0000 7fc7295be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc724101340 0x7fc724198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:13.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.209+0000 7fc7295be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc724101340 0x7fc724198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52626/0 (socket says 172.21.15.2:52626) 2024-09-19T06:25:13.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.209+0000 7fc7295be640 1 -- 172.21.15.2:0/43238728 learned_addr learned my addr 172.21.15.2:0/43238728 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:25:13.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.209+0000 7fc729dbf640 1 --2- 172.21.15.2:0/43238728 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7241009a0 0x7fc724198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:13.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.209+0000 7fc72a5c0640 1 --2- 172.21.15.2:0/43238728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7241069b0 0x7fc72419cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:13.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.209+0000 7fc7295be640 1 -- 172.21.15.2:0/43238728 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7241009a0 msgr2=0x7fc724198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:13.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.209+0000 7fc7295be640 1 --2- 172.21.15.2:0/43238728 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7241009a0 0x7fc724198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:13.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.209+0000 7fc7295be640 1 -- 172.21.15.2:0/43238728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7241069b0 msgr2=0x7fc72419cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:13.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.209+0000 7fc7295be640 1 --2- 172.21.15.2:0/43238728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7241069b0 0x7fc72419cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:13.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.209+0000 7fc7295be640 1 -- 172.21.15.2:0/43238728 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc72419d320 con 0x7fc724101340 2024-09-19T06:25:13.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.209+0000 7fc72a5c0640 1 --2- 172.21.15.2:0/43238728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7241069b0 0x7fc72419cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:25:13.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.209+0000 7fc7295be640 1 --2- 172.21.15.2:0/43238728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc724101340 0x7fc724198870 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fc71400d950 tx=0x7fc71400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:13.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.209+0000 7fc71affd640 1 -- 172.21.15.2:0/43238728 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc714017070 con 0x7fc724101340 2024-09-19T06:25:13.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.209+0000 7fc71affd640 1 -- 172.21.15.2:0/43238728 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc714009c30 con 0x7fc724101340 2024-09-19T06:25:13.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.209+0000 7fc72c023640 1 -- 172.21.15.2:0/43238728 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc72419d610 con 0x7fc724101340 2024-09-19T06:25:13.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.209+0000 7fc71affd640 1 -- 172.21.15.2:0/43238728 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc71400f620 con 0x7fc724101340 2024-09-19T06:25:13.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.210+0000 7fc72c023640 1 -- 172.21.15.2:0/43238728 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7241a4ea0 con 0x7fc724101340 2024-09-19T06:25:13.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.210+0000 7fc72c023640 1 -- 172.21.15.2:0/43238728 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc724100e00 con 0x7fc724101340 2024-09-19T06:25:13.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.212+0000 7fc71affd640 1 -- 172.21.15.2:0/43238728 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fc7140109a0 con 0x7fc724101340 2024-09-19T06:25:13.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.212+0000 7fc71affd640 1 --2- 172.21.15.2:0/43238728 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc7100a33c0 0x7fc7100a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:13.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.212+0000 7fc729dbf640 1 --2- 172.21.15.2:0/43238728 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc7100a33c0 0x7fc7100a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:13.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.212+0000 7fc71affd640 1 -- 172.21.15.2:0/43238728 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8565+0+0 (secure 0 0 0) 0x7fc7140cf980 con 0x7fc724101340 2024-09-19T06:25:13.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.213+0000 7fc729dbf640 1 --2- 172.21.15.2:0/43238728 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc7100a33c0 0x7fc7100a5880 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc720009900 tx=0x7fc720000bc0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:13.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.217+0000 7fc71affd640 1 -- 172.21.15.2:0/43238728 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc714009de0 con 0x7fc724101340 2024-09-19T06:25:13.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.444+0000 7fc72c023640 1 -- 172.21.15.2:0/43238728 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fc724109990 con 0x7fc724101340 2024-09-19T06:25:13.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.451+0000 7fc71affd640 1 -- 172.21.15.2:0/43238728 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) ==== 81+0+742863 (secure 0 0 0) 0x7fc71409c330 con 0x7fc724101340 2024-09-19T06:25:13.463 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:25:13.463 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:25:13.463 INFO:teuthology.orchestra.run.smithi002.stdout: "epoch": 25, 2024-09-19T06:25:13.463 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.463 INFO:teuthology.orchestra.run.smithi002.stdout: "active_gid": 15144, 2024-09-19T06:25:13.463 INFO:teuthology.orchestra.run.smithi002.stdout: "active_name": "x", 2024-09-19T06:25:13.463 INFO:teuthology.orchestra.run.smithi002.stdout: "active_addrs": { 2024-09-19T06:25:13.463 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-09-19T06:25:13.463 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:13.463 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-09-19T06:25:13.464 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6800", 2024-09-19T06:25:13.464 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 1594569191 2024-09-19T06:25:13.464 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.464 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:13.464 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2024-09-19T06:25:13.464 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6801", 2024-09-19T06:25:13.464 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 1594569191 2024-09-19T06:25:13.464 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.464 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-19T06:25:13.464 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.464 INFO:teuthology.orchestra.run.smithi002.stdout: "active_addr": "172.21.15.2:6801/1594569191", 2024-09-19T06:25:13.464 INFO:teuthology.orchestra.run.smithi002.stdout: "active_change": "2024-09-19T06:14:48.099312+0000", 2024-09-19T06:25:13.465 INFO:teuthology.orchestra.run.smithi002.stdout: "active_mgr_features": 4540701547738038271, 2024-09-19T06:25:13.465 INFO:teuthology.orchestra.run.smithi002.stdout: "available": true, 2024-09-19T06:25:13.465 INFO:teuthology.orchestra.run.smithi002.stdout: "standbys": [ 2024-09-19T06:25:13.465 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:13.465 INFO:teuthology.orchestra.run.smithi002.stdout: "gid": 24832, 2024-09-19T06:25:13.465 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "z", 2024-09-19T06:25:13.465 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_features": 4540701547738038271, 2024-09-19T06:25:13.465 INFO:teuthology.orchestra.run.smithi002.stdout: "available_modules": [ 2024-09-19T06:25:13.465 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:13.465 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "alerts", 2024-09-19T06:25:13.465 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:13.465 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:13.465 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:13.466 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-19T06:25:13.466 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-19T06:25:13.466 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:13.466 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.466 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.466 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-19T06:25:13.466 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.466 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.466 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.466 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T06:25:13.466 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.466 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.467 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.467 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.467 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:13.467 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:13.467 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.467 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.467 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.467 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.467 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.467 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.467 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.467 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.467 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.468 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.468 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.468 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.468 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.468 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.468 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.468 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.468 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.468 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.468 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.468 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:13.468 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:13.468 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.469 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.469 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.469 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.469 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.469 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.469 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.469 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.469 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.469 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.469 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.469 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.469 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:13.469 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:13.470 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.470 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.470 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.470 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:13.470 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.470 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.470 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.470 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.470 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.470 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.470 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.470 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.470 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.471 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.471 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.471 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.471 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.471 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.471 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.471 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:13.471 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:13.471 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.471 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.471 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.471 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.471 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.472 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.472 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.472 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.472 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.472 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.472 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.472 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.472 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_destination": { 2024-09-19T06:25:13.472 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_destination", 2024-09-19T06:25:13.472 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.472 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.472 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.472 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.473 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.473 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.473 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.473 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email address to send alerts to", 2024-09-19T06:25:13.473 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.473 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.473 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.473 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.473 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_from_name": { 2024-09-19T06:25:13.473 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_from_name", 2024-09-19T06:25:13.473 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.473 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.473 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.474 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "Ceph", 2024-09-19T06:25:13.474 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.474 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.474 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.474 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email From: name", 2024-09-19T06:25:13.474 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.474 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.474 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.474 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.474 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_host": { 2024-09-19T06:25:13.474 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_host", 2024-09-19T06:25:13.474 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.474 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.475 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.475 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.475 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.475 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.475 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.475 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP server", 2024-09-19T06:25:13.475 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.475 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.475 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.475 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.475 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_password": { 2024-09-19T06:25:13.475 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_password", 2024-09-19T06:25:13.475 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.476 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.476 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.476 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.476 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.476 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.476 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.476 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Password to authenticate with", 2024-09-19T06:25:13.476 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.476 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.476 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.476 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.476 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_port": { 2024-09-19T06:25:13.476 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_port", 2024-09-19T06:25:13.477 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.477 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.477 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.477 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "465", 2024-09-19T06:25:13.477 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.477 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.477 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.477 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP port", 2024-09-19T06:25:13.477 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.477 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.477 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.477 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.477 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_sender": { 2024-09-19T06:25:13.478 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_sender", 2024-09-19T06:25:13.478 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.478 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.478 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.478 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.478 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.478 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.478 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.478 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP envelope sender", 2024-09-19T06:25:13.478 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.478 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.479 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.479 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.479 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_ssl": { 2024-09-19T06:25:13.479 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_ssl", 2024-09-19T06:25:13.479 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.479 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.479 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.479 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.479 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.480 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.480 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.480 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T06:25:13.480 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.480 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.480 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.480 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.480 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_user": { 2024-09-19T06:25:13.480 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_user", 2024-09-19T06:25:13.480 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.480 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.480 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.481 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.481 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.481 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.481 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.481 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "User to authenticate as", 2024-09-19T06:25:13.481 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.481 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.481 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.481 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.481 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.481 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.481 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:13.482 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "balancer", 2024-09-19T06:25:13.482 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:13.482 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:13.482 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:13.482 INFO:teuthology.orchestra.run.smithi002.stdout: "active": { 2024-09-19T06:25:13.482 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "active", 2024-09-19T06:25:13.482 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.482 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.482 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.482 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.482 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.482 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.482 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.483 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T06:25:13.483 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.483 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.483 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.483 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.483 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_time": { 2024-09-19T06:25:13.483 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_time", 2024-09-19T06:25:13.483 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.483 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.483 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.483 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0000", 2024-09-19T06:25:13.484 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.484 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.484 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.484 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T06:25:13.484 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T06:25:13.484 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.484 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.484 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.484 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_weekday": { 2024-09-19T06:25:13.484 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_weekday", 2024-09-19T06:25:13.484 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-19T06:25:13.484 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.485 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.485 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-19T06:25:13.485 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-09-19T06:25:13.485 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-09-19T06:25:13.485 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.485 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T06:25:13.485 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T06:25:13.485 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.485 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.485 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.485 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_max_iterations": { 2024-09-19T06:25:13.485 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_max_iterations", 2024-09-19T06:25:13.486 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-19T06:25:13.486 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.486 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.486 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "25", 2024-09-19T06:25:13.486 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-19T06:25:13.486 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "250", 2024-09-19T06:25:13.486 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.486 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T06:25:13.486 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.486 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.486 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.486 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.487 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_metrics": { 2024-09-19T06:25:13.487 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_metrics", 2024-09-19T06:25:13.487 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.487 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.487 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.487 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T06:25:13.487 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.487 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.487 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.487 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T06:25:13.487 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T06:25:13.487 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.487 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.488 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.488 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_step": { 2024-09-19T06:25:13.488 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_step", 2024-09-19T06:25:13.488 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-19T06:25:13.488 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.488 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.488 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.5", 2024-09-19T06:25:13.488 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0.001", 2024-09-19T06:25:13.488 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "0.999", 2024-09-19T06:25:13.488 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.488 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "aggressiveness of optimization", 2024-09-19T06:25:13.488 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T06:25:13.488 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.489 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.489 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.489 INFO:teuthology.orchestra.run.smithi002.stdout: "end_time": { 2024-09-19T06:25:13.489 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_time", 2024-09-19T06:25:13.489 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.489 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.489 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.489 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2359", 2024-09-19T06:25:13.489 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.489 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.489 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.489 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T06:25:13.489 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T06:25:13.490 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.490 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.490 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.490 INFO:teuthology.orchestra.run.smithi002.stdout: "end_weekday": { 2024-09-19T06:25:13.490 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_weekday", 2024-09-19T06:25:13.490 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-19T06:25:13.490 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.490 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.490 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-19T06:25:13.490 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-09-19T06:25:13.490 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-09-19T06:25:13.490 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.490 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T06:25:13.491 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T06:25:13.491 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.491 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.491 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.491 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:13.491 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:13.491 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.491 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.491 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.491 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.491 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.491 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.491 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.492 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.492 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.492 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.492 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.492 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.492 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.492 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.492 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.492 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.492 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.492 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.492 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.492 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:13.492 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:13.493 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.493 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.493 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.493 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.493 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.493 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.493 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.493 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.493 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.493 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.493 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.494 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.494 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:13.494 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:13.494 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.494 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.494 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.494 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:13.494 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.494 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.494 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.494 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.494 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.494 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.495 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.495 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.495 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.495 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.495 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.495 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.495 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.495 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.495 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.495 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:13.495 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:13.495 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.495 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.495 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.496 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.496 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.496 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.496 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.496 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.496 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.496 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.496 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.496 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.496 INFO:teuthology.orchestra.run.smithi002.stdout: "min_score": { 2024-09-19T06:25:13.496 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_score", 2024-09-19T06:25:13.496 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-19T06:25:13.496 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.497 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.497 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-19T06:25:13.497 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.497 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.497 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.497 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T06:25:13.497 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.497 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.497 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.497 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.497 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-09-19T06:25:13.497 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-09-19T06:25:13.497 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.498 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.498 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.498 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "upmap", 2024-09-19T06:25:13.498 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.498 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.498 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.498 INFO:teuthology.orchestra.run.smithi002.stdout: "crush-compat", 2024-09-19T06:25:13.498 INFO:teuthology.orchestra.run.smithi002.stdout: "none", 2024-09-19T06:25:13.498 INFO:teuthology.orchestra.run.smithi002.stdout: "read", 2024-09-19T06:25:13.498 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap", 2024-09-19T06:25:13.498 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap-read" 2024-09-19T06:25:13.498 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.498 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Balancer mode", 2024-09-19T06:25:13.499 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.499 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.499 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.499 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.499 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_ids": { 2024-09-19T06:25:13.499 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_ids", 2024-09-19T06:25:13.499 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.499 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.499 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.499 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.499 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.499 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.499 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.500 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T06:25:13.500 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.500 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.500 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.500 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.500 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-19T06:25:13.500 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-19T06:25:13.500 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:13.500 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.500 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.500 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-19T06:25:13.500 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.501 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.501 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.501 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T06:25:13.501 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.501 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.501 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.501 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.501 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_deviation": { 2024-09-19T06:25:13.501 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_deviation", 2024-09-19T06:25:13.501 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.501 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.501 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.501 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-19T06:25:13.501 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-19T06:25:13.502 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.502 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.502 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T06:25:13.502 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T06:25:13.502 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.502 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.502 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.502 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_optimizations": { 2024-09-19T06:25:13.502 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_optimizations", 2024-09-19T06:25:13.502 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-19T06:25:13.502 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.502 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.502 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T06:25:13.503 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.503 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.503 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.503 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T06:25:13.503 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.503 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.503 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.503 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.503 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.503 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.503 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:13.503 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm", 2024-09-19T06:25:13.503 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:13.503 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:13.504 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:13.504 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_down_multiplier": { 2024-09-19T06:25:13.504 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_down_multiplier", 2024-09-19T06:25:13.504 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-19T06:25:13.504 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.504 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.504 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-09-19T06:25:13.504 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.504 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.504 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.504 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T06:25:13.504 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.504 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.505 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.505 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.505 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_refresh_rate": { 2024-09-19T06:25:13.505 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_refresh_rate", 2024-09-19T06:25:13.505 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:13.505 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.505 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.505 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "20", 2024-09-19T06:25:13.505 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.505 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.505 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.505 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T06:25:13.505 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.506 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.506 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.506 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.506 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_starting_port": { 2024-09-19T06:25:13.506 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_starting_port", 2024-09-19T06:25:13.506 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.506 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.506 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.506 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4721", 2024-09-19T06:25:13.506 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.506 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.506 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.506 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T06:25:13.507 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.507 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.507 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.507 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.507 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_ptrace": { 2024-09-19T06:25:13.507 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_ptrace", 2024-09-19T06:25:13.507 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.507 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.507 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.507 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.507 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.508 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.508 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.508 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T06:25:13.508 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T06:25:13.508 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.508 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.508 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.508 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_interval": { 2024-09-19T06:25:13.508 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_interval", 2024-09-19T06:25:13.508 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:13.508 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.508 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.509 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-19T06:25:13.509 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.509 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.509 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.509 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T06:25:13.509 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.509 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.509 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.509 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.509 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_memory_target_ratio": { 2024-09-19T06:25:13.509 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T06:25:13.509 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-19T06:25:13.510 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.510 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.510 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.7", 2024-09-19T06:25:13.510 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.510 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.510 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.510 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T06:25:13.510 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.510 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.510 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.510 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.510 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm_log_destination": { 2024-09-19T06:25:13.510 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm_log_destination", 2024-09-19T06:25:13.511 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.511 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.511 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.511 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.511 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.511 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.511 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.511 INFO:teuthology.orchestra.run.smithi002.stdout: "file", 2024-09-19T06:25:13.511 INFO:teuthology.orchestra.run.smithi002.stdout: "file,syslog", 2024-09-19T06:25:13.511 INFO:teuthology.orchestra.run.smithi002.stdout: "syslog" 2024-09-19T06:25:13.511 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.511 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T06:25:13.511 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.512 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.512 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.512 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.512 INFO:teuthology.orchestra.run.smithi002.stdout: "cgroups_split": { 2024-09-19T06:25:13.512 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cgroups_split", 2024-09-19T06:25:13.512 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.512 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.512 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.512 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.512 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.512 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.512 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.512 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T06:25:13.513 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.513 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.513 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.513 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.513 INFO:teuthology.orchestra.run.smithi002.stdout: "config_checks_enabled": { 2024-09-19T06:25:13.513 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_checks_enabled", 2024-09-19T06:25:13.513 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.513 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.513 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.513 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.513 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.513 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.513 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.514 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T06:25:13.514 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.514 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.514 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.514 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.514 INFO:teuthology.orchestra.run.smithi002.stdout: "config_dashboard": { 2024-09-19T06:25:13.514 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_dashboard", 2024-09-19T06:25:13.514 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.514 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.514 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.514 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.514 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.514 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.515 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.515 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T06:25:13.515 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.515 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.515 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.515 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.515 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_alertmanager": { 2024-09-19T06:25:13.515 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_alertmanager", 2024-09-19T06:25:13.515 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.515 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.515 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.515 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T06:25:13.515 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.516 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.516 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.516 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-19T06:25:13.516 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.516 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.516 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.516 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.516 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_base": { 2024-09-19T06:25:13.516 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_base", 2024-09-19T06:25:13.516 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.516 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.516 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.516 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T06:25:13.517 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.517 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.517 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.517 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Container image name, without the tag", 2024-09-19T06:25:13.517 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.517 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.517 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.517 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.517 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_elasticsearch": { 2024-09-19T06:25:13.517 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_elasticsearch", 2024-09-19T06:25:13.517 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.517 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.517 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.518 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T06:25:13.518 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.518 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.518 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.518 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "elasticsearch container image", 2024-09-19T06:25:13.518 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.518 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.518 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.518 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.518 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_grafana": { 2024-09-19T06:25:13.518 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_grafana", 2024-09-19T06:25:13.518 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.518 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.518 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.519 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T06:25:13.519 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.519 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.519 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.519 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-19T06:25:13.519 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.519 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.519 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.519 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.519 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_haproxy": { 2024-09-19T06:25:13.519 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_haproxy", 2024-09-19T06:25:13.519 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.519 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.520 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.520 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T06:25:13.520 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.520 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.520 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.520 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "HAproxy container image", 2024-09-19T06:25:13.520 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.520 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.520 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.520 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.520 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_agent": { 2024-09-19T06:25:13.520 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_agent", 2024-09-19T06:25:13.521 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.521 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.521 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.521 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T06:25:13.521 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.521 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.521 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.521 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger agent container image", 2024-09-19T06:25:13.521 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.521 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.521 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.521 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.521 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_collector": { 2024-09-19T06:25:13.522 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_collector", 2024-09-19T06:25:13.522 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.522 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.522 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.522 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T06:25:13.522 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.522 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.522 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.522 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger collector container image", 2024-09-19T06:25:13.522 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.522 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.522 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.523 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.523 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_query": { 2024-09-19T06:25:13.523 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_query", 2024-09-19T06:25:13.523 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.523 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.523 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.523 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T06:25:13.523 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.523 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.523 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.523 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger query container image", 2024-09-19T06:25:13.523 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.524 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.524 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.524 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.524 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_keepalived": { 2024-09-19T06:25:13.524 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_keepalived", 2024-09-19T06:25:13.524 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.524 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.524 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.524 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T06:25:13.524 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.524 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.524 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.524 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Keepalived container image", 2024-09-19T06:25:13.525 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.525 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.525 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.525 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.525 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_loki": { 2024-09-19T06:25:13.525 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_loki", 2024-09-19T06:25:13.525 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.525 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.525 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.525 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T06:25:13.525 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.525 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.525 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.526 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Loki container image", 2024-09-19T06:25:13.526 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.526 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.526 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.526 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.526 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_node_exporter": { 2024-09-19T06:25:13.526 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_node_exporter", 2024-09-19T06:25:13.526 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.526 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.526 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.526 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T06:25:13.526 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.527 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.527 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.527 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-19T06:25:13.527 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.527 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.527 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.527 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.527 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_nvmeof": { 2024-09-19T06:25:13.527 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_nvmeof", 2024-09-19T06:25:13.527 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.527 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.527 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.527 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T06:25:13.528 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.528 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.528 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.528 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Nvme-of container image", 2024-09-19T06:25:13.528 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.528 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.528 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.528 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.528 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_prometheus": { 2024-09-19T06:25:13.528 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_prometheus", 2024-09-19T06:25:13.528 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.528 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.528 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.529 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T06:25:13.529 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.529 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.529 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.529 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-19T06:25:13.529 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.529 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.529 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.529 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.529 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_promtail": { 2024-09-19T06:25:13.529 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_promtail", 2024-09-19T06:25:13.529 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.529 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.530 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.530 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T06:25:13.530 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.530 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.530 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.530 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Promtail container image", 2024-09-19T06:25:13.530 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.530 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.530 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.530 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.530 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_samba": { 2024-09-19T06:25:13.530 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_samba", 2024-09-19T06:25:13.531 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.531 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.531 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.531 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T06:25:13.531 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.531 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.531 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.531 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Samba/SMB container image", 2024-09-19T06:25:13.531 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.531 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.531 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.531 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.532 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_snmp_gateway": { 2024-09-19T06:25:13.532 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_snmp_gateway", 2024-09-19T06:25:13.532 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.532 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.532 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.532 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T06:25:13.532 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.532 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.532 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.532 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SNMP Gateway container image", 2024-09-19T06:25:13.532 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.532 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.532 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.533 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.533 INFO:teuthology.orchestra.run.smithi002.stdout: "container_init": { 2024-09-19T06:25:13.533 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_init", 2024-09-19T06:25:13.533 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.533 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.533 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.533 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.533 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.533 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.533 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.533 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T06:25:13.533 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.534 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.534 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.534 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.534 INFO:teuthology.orchestra.run.smithi002.stdout: "daemon_cache_timeout": { 2024-09-19T06:25:13.534 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "daemon_cache_timeout", 2024-09-19T06:25:13.534 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:13.534 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.534 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.534 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-19T06:25:13.534 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.534 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.534 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.534 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T06:25:13.535 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.535 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.535 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.535 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.535 INFO:teuthology.orchestra.run.smithi002.stdout: "default_cephadm_command_timeout": { 2024-09-19T06:25:13.535 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T06:25:13.535 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.535 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.535 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.535 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "900", 2024-09-19T06:25:13.535 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.535 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.535 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.536 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T06:25:13.536 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.536 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.536 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.536 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.536 INFO:teuthology.orchestra.run.smithi002.stdout: "default_registry": { 2024-09-19T06:25:13.536 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_registry", 2024-09-19T06:25:13.536 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.536 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.536 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.536 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io", 2024-09-19T06:25:13.536 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.536 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.537 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.537 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T06:25:13.537 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.537 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.537 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.537 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.537 INFO:teuthology.orchestra.run.smithi002.stdout: "device_cache_timeout": { 2024-09-19T06:25:13.537 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_cache_timeout", 2024-09-19T06:25:13.537 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:13.537 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.537 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.537 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1800", 2024-09-19T06:25:13.537 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.538 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.538 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.538 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache device inventory", 2024-09-19T06:25:13.538 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.538 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.538 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.538 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.538 INFO:teuthology.orchestra.run.smithi002.stdout: "device_enhanced_scan": { 2024-09-19T06:25:13.538 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_enhanced_scan", 2024-09-19T06:25:13.538 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.538 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.538 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.538 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.539 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.539 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.539 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.539 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T06:25:13.539 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.539 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.539 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.539 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.539 INFO:teuthology.orchestra.run.smithi002.stdout: "facts_cache_timeout": { 2024-09-19T06:25:13.539 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "facts_cache_timeout", 2024-09-19T06:25:13.539 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:13.539 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.539 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.540 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-19T06:25:13.540 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.540 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.540 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.540 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache host facts data", 2024-09-19T06:25:13.540 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.540 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.540 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.540 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.540 INFO:teuthology.orchestra.run.smithi002.stdout: "grafana_dashboards_path": { 2024-09-19T06:25:13.540 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "grafana_dashboards_path", 2024-09-19T06:25:13.540 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.540 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.541 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.541 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T06:25:13.541 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.541 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.541 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.541 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T06:25:13.541 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.541 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.541 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.541 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.541 INFO:teuthology.orchestra.run.smithi002.stdout: "host_check_interval": { 2024-09-19T06:25:13.541 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "host_check_interval", 2024-09-19T06:25:13.542 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:13.542 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.542 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.542 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-19T06:25:13.542 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.542 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.542 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.542 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to perform a host check", 2024-09-19T06:25:13.542 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.542 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.542 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.542 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.542 INFO:teuthology.orchestra.run.smithi002.stdout: "hw_monitoring": { 2024-09-19T06:25:13.543 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hw_monitoring", 2024-09-19T06:25:13.543 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.543 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.543 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.543 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.543 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.543 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.543 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.543 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T06:25:13.543 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.543 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.543 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.543 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.543 INFO:teuthology.orchestra.run.smithi002.stdout: "inventory_list_all": { 2024-09-19T06:25:13.544 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "inventory_list_all", 2024-09-19T06:25:13.544 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.544 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.544 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.544 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.544 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.544 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.544 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.544 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T06:25:13.544 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.544 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.544 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.544 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.545 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:13.545 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:13.545 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.545 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.545 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.545 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.545 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.545 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.545 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.545 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.545 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.545 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.545 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.546 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.546 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.546 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.546 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.546 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.546 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.546 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.546 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.546 INFO:teuthology.orchestra.run.smithi002.stdout: "log_refresh_metadata": { 2024-09-19T06:25:13.546 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_refresh_metadata", 2024-09-19T06:25:13.546 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.546 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.546 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.547 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.547 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.547 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.547 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.547 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T06:25:13.547 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.547 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.547 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.547 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.547 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:13.547 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:13.547 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.548 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.548 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.548 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.548 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.548 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.548 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.548 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T06:25:13.548 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.548 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.548 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.548 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.548 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:13.549 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:13.549 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.549 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.549 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.549 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:13.549 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.549 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.549 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.549 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.549 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.549 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.549 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.549 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.550 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.550 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.550 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.550 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.550 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.550 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.550 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.550 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:13.550 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:13.550 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.551 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.551 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.551 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.551 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.551 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.551 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.551 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.551 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.551 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.551 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.551 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.551 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T06:25:13.551 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T06:25:13.552 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.552 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.552 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.552 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.552 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.552 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.552 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.552 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T06:25:13.552 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.552 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.552 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.552 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.553 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T06:25:13.553 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T06:25:13.553 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.553 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.553 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.553 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "*", 2024-09-19T06:25:13.553 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.553 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.553 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.553 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T06:25:13.553 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.553 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.553 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.554 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.554 INFO:teuthology.orchestra.run.smithi002.stdout: "max_count_per_host": { 2024-09-19T06:25:13.554 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_count_per_host", 2024-09-19T06:25:13.554 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.554 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.554 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.554 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T06:25:13.554 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.554 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.554 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.554 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of daemons per service per host", 2024-09-19T06:25:13.554 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.554 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.555 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.555 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.555 INFO:teuthology.orchestra.run.smithi002.stdout: "max_osd_draining_count": { 2024-09-19T06:25:13.555 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_osd_draining_count", 2024-09-19T06:25:13.555 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.555 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.555 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.555 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T06:25:13.555 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.555 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.555 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.555 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T06:25:13.555 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.556 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.556 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.556 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.556 INFO:teuthology.orchestra.run.smithi002.stdout: "migration_current": { 2024-09-19T06:25:13.556 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "migration_current", 2024-09-19T06:25:13.556 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.556 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.556 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.556 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.556 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.556 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.556 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.557 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "internal - do not modify", 2024-09-19T06:25:13.557 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.557 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.557 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.557 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.557 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-09-19T06:25:13.557 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-09-19T06:25:13.557 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.557 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.557 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.557 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "root", 2024-09-19T06:25:13.557 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.557 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.558 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.558 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm-package", 2024-09-19T06:25:13.558 INFO:teuthology.orchestra.run.smithi002.stdout: "root" 2024-09-19T06:25:13.558 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.558 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T06:25:13.558 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.558 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.558 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.558 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.558 INFO:teuthology.orchestra.run.smithi002.stdout: "oob_default_addr": { 2024-09-19T06:25:13.558 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "oob_default_addr", 2024-09-19T06:25:13.558 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.558 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.559 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.559 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "169.254.1.1", 2024-09-19T06:25:13.559 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.559 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.559 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.559 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T06:25:13.559 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.559 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.559 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.559 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.559 INFO:teuthology.orchestra.run.smithi002.stdout: "prometheus_alerts_path": { 2024-09-19T06:25:13.559 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus_alerts_path", 2024-09-19T06:25:13.560 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.560 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.560 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.560 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T06:25:13.560 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.560 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.560 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.560 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T06:25:13.560 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.560 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.560 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.560 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.560 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_insecure": { 2024-09-19T06:25:13.561 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_insecure", 2024-09-19T06:25:13.561 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.561 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.561 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.561 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.561 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.561 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.561 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.561 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T06:25:13.561 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.561 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.562 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.562 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.562 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_password": { 2024-09-19T06:25:13.562 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_password", 2024-09-19T06:25:13.562 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.562 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.562 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.562 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.562 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.562 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.562 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.562 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T06:25:13.562 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.562 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.563 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.563 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.563 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_url": { 2024-09-19T06:25:13.563 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_url", 2024-09-19T06:25:13.563 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.563 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.563 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.563 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.563 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.563 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.563 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.563 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T06:25:13.563 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.564 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.564 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.564 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.564 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_username": { 2024-09-19T06:25:13.564 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_username", 2024-09-19T06:25:13.564 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.564 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.564 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.564 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.564 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.564 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.564 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.564 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T06:25:13.565 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.565 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.565 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.565 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.565 INFO:teuthology.orchestra.run.smithi002.stdout: "secure_monitoring_stack": { 2024-09-19T06:25:13.565 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "secure_monitoring_stack", 2024-09-19T06:25:13.565 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.565 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.565 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.565 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.565 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.565 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.565 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.566 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T06:25:13.566 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.566 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.566 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.566 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.566 INFO:teuthology.orchestra.run.smithi002.stdout: "service_discovery_port": { 2024-09-19T06:25:13.566 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "service_discovery_port", 2024-09-19T06:25:13.566 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.566 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.566 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.566 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8765", 2024-09-19T06:25:13.566 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.566 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.567 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.567 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "cephadm service discovery port", 2024-09-19T06:25:13.567 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.567 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.567 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.567 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.567 INFO:teuthology.orchestra.run.smithi002.stdout: "ssh_config_file": { 2024-09-19T06:25:13.567 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssh_config_file", 2024-09-19T06:25:13.567 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.567 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.567 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.567 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.567 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.568 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.568 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.568 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T06:25:13.568 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.568 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.568 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.568 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.568 INFO:teuthology.orchestra.run.smithi002.stdout: "use_agent": { 2024-09-19T06:25:13.568 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_agent", 2024-09-19T06:25:13.568 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.568 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.568 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.569 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.569 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.569 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.569 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.569 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T06:25:13.569 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.569 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.569 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.569 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.569 INFO:teuthology.orchestra.run.smithi002.stdout: "use_repo_digest": { 2024-09-19T06:25:13.569 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_repo_digest", 2024-09-19T06:25:13.569 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.569 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.570 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.570 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.570 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.570 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.570 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.570 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T06:25:13.570 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.570 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.570 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.570 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.570 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_failed_host_check": { 2024-09-19T06:25:13.570 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_failed_host_check", 2024-09-19T06:25:13.571 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.571 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.571 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.571 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.571 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.571 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.571 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.571 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T06:25:13.571 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.571 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.571 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.571 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.571 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_daemons": { 2024-09-19T06:25:13.572 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_daemons", 2024-09-19T06:25:13.572 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.572 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.572 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.572 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.572 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.572 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.572 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.572 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T06:25:13.572 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.572 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.572 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.572 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.573 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_hosts": { 2024-09-19T06:25:13.573 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_hosts", 2024-09-19T06:25:13.573 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.573 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.573 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.573 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.573 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.573 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.573 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.573 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T06:25:13.573 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.573 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.573 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.574 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.574 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.574 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.574 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:13.574 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crash", 2024-09-19T06:25:13.574 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:13.574 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:13.574 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:13.574 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:13.574 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:13.574 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.574 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.575 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.575 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.575 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.575 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.575 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.575 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.575 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.575 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.575 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.575 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.575 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.575 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.575 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.576 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.576 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.576 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.576 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.576 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:13.576 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:13.576 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.576 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.576 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.576 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.576 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.576 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.577 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.577 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.577 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.577 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.577 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.577 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.577 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:13.577 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:13.577 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.577 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.577 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.577 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:13.577 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.577 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.578 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.578 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.578 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.578 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.578 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.578 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.578 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.578 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.578 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.578 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.578 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.578 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.578 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.579 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:13.579 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:13.579 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.579 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.579 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.579 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.579 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.579 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.579 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.579 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.579 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.580 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.580 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.580 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.580 INFO:teuthology.orchestra.run.smithi002.stdout: "retain_interval": { 2024-09-19T06:25:13.580 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retain_interval", 2024-09-19T06:25:13.580 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:13.580 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.580 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.580 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "31536000", 2024-09-19T06:25:13.580 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.580 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.581 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.581 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T06:25:13.581 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.581 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.581 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.581 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.581 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_recent_interval": { 2024-09-19T06:25:13.581 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_recent_interval", 2024-09-19T06:25:13.581 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:13.581 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.581 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.581 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1209600", 2024-09-19T06:25:13.582 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.582 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.582 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.582 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T06:25:13.582 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.582 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.582 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.582 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.582 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.582 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.582 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:13.582 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dashboard", 2024-09-19T06:25:13.582 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:13.583 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:13.583 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:13.583 INFO:teuthology.orchestra.run.smithi002.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T06:25:13.583 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T06:25:13.583 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.583 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.583 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.583 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T06:25:13.583 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.583 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.583 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.583 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.583 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.583 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.584 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.584 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.584 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T06:25:13.584 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T06:25:13.584 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.584 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.584 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.584 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.584 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.584 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.584 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.584 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.585 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.585 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.585 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.585 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.585 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T06:25:13.585 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T06:25:13.585 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.585 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.585 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.585 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.585 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.585 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.586 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.586 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.586 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.586 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.586 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.586 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.586 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_ENABLED": { 2024-09-19T06:25:13.586 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T06:25:13.586 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.586 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.586 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.586 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.586 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.587 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.587 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.587 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.587 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.587 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.587 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.587 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.587 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T06:25:13.587 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T06:25:13.587 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.587 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.587 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.587 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.588 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.588 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.588 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.588 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.588 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.588 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.588 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.588 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.588 INFO:teuthology.orchestra.run.smithi002.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T06:25:13.588 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T06:25:13.588 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.588 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.589 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.589 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.589 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.589 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.589 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.589 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.589 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.589 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.589 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.589 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.589 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T06:25:13.589 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T06:25:13.590 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.590 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.590 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.590 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.590 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.590 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.590 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.590 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.590 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.590 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.590 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.590 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.590 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T06:25:13.591 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T06:25:13.591 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.591 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.591 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.591 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.591 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.591 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.591 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.591 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.591 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.591 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.591 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.591 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.592 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T06:25:13.592 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T06:25:13.592 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.592 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.592 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.592 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.592 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.592 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.592 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.592 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.592 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.592 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.593 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.593 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.593 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T06:25:13.593 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T06:25:13.593 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.593 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.593 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.593 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.593 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.593 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.593 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.593 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.594 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.594 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.594 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.594 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.594 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T06:25:13.594 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T06:25:13.594 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.594 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.594 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.594 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.594 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.594 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.594 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.595 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.595 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.595 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.595 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.595 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.595 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T06:25:13.595 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T06:25:13.595 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.595 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.595 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.595 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.595 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.595 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.596 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.596 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.596 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.596 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.596 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.596 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.596 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T06:25:13.596 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T06:25:13.596 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.596 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.596 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.596 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.596 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.597 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.597 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.597 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.597 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.597 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.597 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.597 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.597 INFO:teuthology.orchestra.run.smithi002.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T06:25:13.597 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T06:25:13.597 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.597 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.597 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.597 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.598 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.598 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.598 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.598 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.598 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.598 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.598 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.598 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.598 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T06:25:13.598 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T06:25:13.598 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.598 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.599 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.599 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-19T06:25:13.599 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.599 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.599 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.599 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.599 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.599 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.599 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.599 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.599 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T06:25:13.599 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T06:25:13.599 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.600 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.600 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.600 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.600 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.600 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.600 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.600 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.600 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.600 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.600 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.600 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.600 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_URL": { 2024-09-19T06:25:13.600 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_URL", 2024-09-19T06:25:13.601 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.601 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.601 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.601 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.601 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.601 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.601 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.601 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.601 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.601 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.601 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.601 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.601 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T06:25:13.601 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T06:25:13.602 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.602 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.602 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.602 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-19T06:25:13.602 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.602 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.602 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.602 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.602 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.602 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.602 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.602 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.602 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T06:25:13.603 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T06:25:13.603 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.603 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.603 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.603 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.603 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.603 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.603 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.603 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.603 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.603 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.603 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.603 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.604 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T06:25:13.604 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T06:25:13.604 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.604 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.604 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.604 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.604 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.604 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.604 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.604 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.604 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.604 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.605 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.605 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.605 INFO:teuthology.orchestra.run.smithi002.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T06:25:13.605 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T06:25:13.605 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.605 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.605 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.605 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.605 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.605 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.605 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.605 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.605 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.606 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.606 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.606 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.606 INFO:teuthology.orchestra.run.smithi002.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T06:25:13.606 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T06:25:13.606 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.606 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.606 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.606 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.606 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.606 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.606 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.606 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.607 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.607 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.607 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.607 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.607 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T06:25:13.607 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T06:25:13.607 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.607 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.607 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.607 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.607 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.607 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.608 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.608 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.608 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.608 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.608 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.608 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.608 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T06:25:13.608 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T06:25:13.608 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.608 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.608 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.608 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.608 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.609 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.609 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.609 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.609 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.609 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.609 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.609 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.609 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T06:25:13.609 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T06:25:13.609 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.609 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.609 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.610 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.610 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.610 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.610 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.610 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.610 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.610 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.610 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.610 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.610 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T06:25:13.610 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T06:25:13.610 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.611 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.611 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.611 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.611 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.611 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.611 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.611 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.611 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.611 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.611 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.611 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.611 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T06:25:13.611 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T06:25:13.611 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.612 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.612 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.612 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.612 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.612 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.612 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.612 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.612 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.612 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.612 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.612 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.612 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T06:25:13.613 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T06:25:13.613 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.613 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.613 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.613 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.613 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.613 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.613 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.613 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.613 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.613 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.613 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.613 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.614 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T06:25:13.614 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T06:25:13.614 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.614 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.614 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.614 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.614 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.614 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.614 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.614 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.614 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.614 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.614 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.615 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.615 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T06:25:13.615 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T06:25:13.615 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.615 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.615 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.615 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.615 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.615 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.615 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.615 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.615 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.615 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.616 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.616 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.616 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T06:25:13.616 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T06:25:13.616 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.616 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.616 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.616 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.616 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.616 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.616 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.616 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.616 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.617 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.617 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.617 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.617 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T06:25:13.617 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T06:25:13.617 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.617 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.617 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.617 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.617 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.617 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.617 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.617 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.618 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.618 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.618 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.618 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.618 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T06:25:13.618 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T06:25:13.618 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.618 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.618 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.618 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T06:25:13.618 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.619 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.619 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.619 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.619 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.619 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.619 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.619 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.619 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T06:25:13.619 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T06:25:13.619 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.619 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.619 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.620 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T06:25:13.620 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.620 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.620 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.620 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.620 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.620 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.620 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.620 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.620 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T06:25:13.620 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T06:25:13.620 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.620 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.621 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.621 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8", 2024-09-19T06:25:13.621 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.621 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.621 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.621 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.621 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.621 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.621 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.621 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.621 INFO:teuthology.orchestra.run.smithi002.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T06:25:13.621 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T06:25:13.622 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.622 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.622 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.622 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "45", 2024-09-19T06:25:13.622 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.622 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.622 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.622 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.622 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.622 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.622 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.622 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.622 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T06:25:13.623 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T06:25:13.623 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.623 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.623 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.623 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.623 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.623 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.623 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.623 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.623 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.623 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.623 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.623 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.624 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T06:25:13.624 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T06:25:13.624 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.624 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.624 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.624 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-19T06:25:13.624 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.624 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.624 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.624 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.624 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.624 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.625 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.625 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.625 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T06:25:13.625 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T06:25:13.625 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.625 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.625 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.625 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.625 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.625 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.625 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.625 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.626 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.626 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.626 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.626 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.626 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T06:25:13.626 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T06:25:13.626 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.626 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.626 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.626 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.626 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.626 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.627 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.627 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.627 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.627 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.627 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.627 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.627 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T06:25:13.627 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T06:25:13.627 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.627 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.627 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.627 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-19T06:25:13.627 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.628 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.628 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.628 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.628 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.628 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.628 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.628 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.628 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T06:25:13.628 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T06:25:13.628 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.628 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.628 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.629 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T06:25:13.629 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.629 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.629 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.629 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.629 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.629 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.629 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.629 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.629 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T06:25:13.629 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T06:25:13.629 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.629 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.630 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.630 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-19T06:25:13.630 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.630 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.630 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.630 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.630 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.630 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.630 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.630 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.630 INFO:teuthology.orchestra.run.smithi002.stdout: "cross_origin_url": { 2024-09-19T06:25:13.630 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cross_origin_url", 2024-09-19T06:25:13.630 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.631 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.631 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.631 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.631 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.631 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.631 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.631 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.631 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.631 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.631 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.631 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.631 INFO:teuthology.orchestra.run.smithi002.stdout: "crt_file": { 2024-09-19T06:25:13.631 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crt_file", 2024-09-19T06:25:13.632 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.632 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.632 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.632 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.632 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.632 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.632 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.632 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.632 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.632 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.632 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.632 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.632 INFO:teuthology.orchestra.run.smithi002.stdout: "debug": { 2024-09-19T06:25:13.633 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "debug", 2024-09-19T06:25:13.633 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.633 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.633 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.633 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.633 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.633 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.633 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.633 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable/disable debug options", 2024-09-19T06:25:13.633 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.633 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.634 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.634 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.634 INFO:teuthology.orchestra.run.smithi002.stdout: "jwt_token_ttl": { 2024-09-19T06:25:13.634 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "jwt_token_ttl", 2024-09-19T06:25:13.634 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.634 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.634 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.634 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "28800", 2024-09-19T06:25:13.634 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.634 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.634 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.634 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.635 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.635 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.635 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.635 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.635 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-09-19T06:25:13.635 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-09-19T06:25:13.635 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.635 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.635 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.635 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.635 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.635 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.635 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.636 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.636 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.636 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.636 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.636 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.636 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:13.636 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:13.636 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.636 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.636 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.636 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.636 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.636 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.637 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.637 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.637 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.637 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.637 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.637 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.637 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.637 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.637 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.637 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.637 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.637 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.638 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.638 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:13.638 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:13.638 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.638 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.638 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.638 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.638 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.638 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.638 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.638 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.638 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.638 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.639 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.639 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.639 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:13.639 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:13.639 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.639 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.639 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.639 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:13.639 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.639 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.639 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.640 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.640 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.640 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.640 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.640 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.640 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.640 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.640 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.640 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.640 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.641 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.641 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.641 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:13.641 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:13.641 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.641 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.641 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.641 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.641 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.641 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.641 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.641 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.641 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.642 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.642 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.642 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.642 INFO:teuthology.orchestra.run.smithi002.stdout: "motd": { 2024-09-19T06:25:13.642 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "motd", 2024-09-19T06:25:13.642 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.642 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.642 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.642 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.642 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.642 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.642 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.642 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "The message of the day", 2024-09-19T06:25:13.643 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.643 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.643 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.643 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.643 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect_resolve_ip_addr": { 2024-09-19T06:25:13.643 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T06:25:13.643 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.643 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.643 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.643 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.643 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.643 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.643 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.644 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.644 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.644 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.644 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.644 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.644 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-19T06:25:13.644 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-19T06:25:13.644 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.644 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.644 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.644 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-09-19T06:25:13.644 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.644 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.645 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.645 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.645 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.645 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.645 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.645 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.645 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-19T06:25:13.645 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-19T06:25:13.645 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.645 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.645 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.645 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8080", 2024-09-19T06:25:13.645 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.645 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.646 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.646 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.646 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.646 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.646 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.646 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.646 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-09-19T06:25:13.646 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-09-19T06:25:13.646 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.646 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.646 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.646 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.646 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.647 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.647 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.647 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.647 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.647 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.647 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.647 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.647 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl_server_port": { 2024-09-19T06:25:13.647 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl_server_port", 2024-09-19T06:25:13.647 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.647 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.647 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.647 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8443", 2024-09-19T06:25:13.648 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.648 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.648 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.648 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.648 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.648 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.648 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.648 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.648 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-09-19T06:25:13.648 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-09-19T06:25:13.648 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.648 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.648 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.649 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "redirect", 2024-09-19T06:25:13.649 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.649 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.649 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.649 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.649 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect" 2024-09-19T06:25:13.649 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.649 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.649 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.649 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.649 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.649 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.649 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-09-19T06:25:13.650 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-09-19T06:25:13.650 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.650 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.650 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.650 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-09-19T06:25:13.650 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-09-19T06:25:13.650 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-09-19T06:25:13.650 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.650 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.650 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.650 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.650 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.650 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.651 INFO:teuthology.orchestra.run.smithi002.stdout: "url_prefix": { 2024-09-19T06:25:13.651 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url_prefix", 2024-09-19T06:25:13.651 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.651 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.651 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.651 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.651 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.651 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.651 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.651 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.651 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.651 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.651 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.651 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.652 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.652 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.652 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:13.652 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "devicehealth", 2024-09-19T06:25:13.652 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:13.652 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:13.652 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:13.652 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_monitoring": { 2024-09-19T06:25:13.652 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_monitoring", 2024-09-19T06:25:13.652 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.652 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.652 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.653 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.653 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.653 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.653 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.653 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "monitor device health metrics", 2024-09-19T06:25:13.653 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.653 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.653 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.653 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.653 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:13.653 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:13.653 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.653 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.654 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.654 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.654 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.654 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.654 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.654 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.654 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.654 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.654 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.654 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.654 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.654 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.654 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.655 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.655 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.655 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.655 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.655 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:13.655 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:13.655 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.655 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.655 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.655 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.655 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.655 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.655 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.656 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.656 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.656 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.656 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.656 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.656 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:13.656 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:13.656 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.656 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.656 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.656 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:13.656 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.656 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.657 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.657 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.657 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.657 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.657 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.657 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.657 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.657 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.657 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.657 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.657 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.657 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.657 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.658 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:13.658 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:13.658 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.658 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.658 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.658 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.658 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.658 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.658 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.658 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.658 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.658 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.658 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.659 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.659 INFO:teuthology.orchestra.run.smithi002.stdout: "mark_out_threshold": { 2024-09-19T06:25:13.659 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mark_out_threshold", 2024-09-19T06:25:13.659 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:13.659 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.659 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.659 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2419200", 2024-09-19T06:25:13.659 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.659 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.659 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.659 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T06:25:13.659 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.659 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.660 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.660 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.660 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": { 2024-09-19T06:25:13.660 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_name", 2024-09-19T06:25:13.660 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.660 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.660 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.660 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "device_health_metrics", 2024-09-19T06:25:13.660 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.660 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.660 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.660 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T06:25:13.661 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.661 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.661 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.661 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.661 INFO:teuthology.orchestra.run.smithi002.stdout: "retention_period": { 2024-09-19T06:25:13.661 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retention_period", 2024-09-19T06:25:13.661 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:13.661 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.661 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.661 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15552000", 2024-09-19T06:25:13.661 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.661 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.661 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.662 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain device health metrics", 2024-09-19T06:25:13.662 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.662 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.662 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.662 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.662 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_frequency": { 2024-09-19T06:25:13.662 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_frequency", 2024-09-19T06:25:13.662 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:13.662 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.662 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.662 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-09-19T06:25:13.662 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.663 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.663 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.663 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T06:25:13.663 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.663 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.663 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.663 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.663 INFO:teuthology.orchestra.run.smithi002.stdout: "self_heal": { 2024-09-19T06:25:13.663 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "self_heal", 2024-09-19T06:25:13.663 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.663 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.663 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.664 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.664 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.664 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.664 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.664 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T06:25:13.664 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.664 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.664 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.664 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.664 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-19T06:25:13.664 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-19T06:25:13.664 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:13.665 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.665 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.665 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-19T06:25:13.665 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.665 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.665 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.665 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T06:25:13.665 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.665 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.665 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.665 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.665 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_threshold": { 2024-09-19T06:25:13.666 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_threshold", 2024-09-19T06:25:13.666 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:13.666 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.666 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.666 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7257600", 2024-09-19T06:25:13.666 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.666 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.666 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.666 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T06:25:13.666 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.666 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.666 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.667 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.667 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.667 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.667 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:13.667 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "diskprediction_local", 2024-09-19T06:25:13.667 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:13.667 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:13.667 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:13.667 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:13.667 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:13.667 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.667 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.667 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.668 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.668 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.668 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.668 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.668 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.668 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.668 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.668 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.668 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.668 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.668 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.668 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.668 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.669 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.669 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.669 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.669 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:13.669 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:13.669 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.669 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.669 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.669 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.669 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.669 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.669 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.669 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.670 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.670 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.670 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.670 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.670 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:13.670 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:13.670 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.670 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.670 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.670 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:13.670 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.670 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.670 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.671 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.671 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.671 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.671 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.671 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.671 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.671 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.671 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.671 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.671 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.671 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.671 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.671 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:13.672 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:13.672 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.672 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.672 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.672 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.672 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.672 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.672 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.672 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.672 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.672 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.672 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.672 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.673 INFO:teuthology.orchestra.run.smithi002.stdout: "predict_interval": { 2024-09-19T06:25:13.673 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predict_interval", 2024-09-19T06:25:13.673 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.673 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.673 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.673 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-09-19T06:25:13.673 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.673 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.673 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.673 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.673 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.673 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.674 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.674 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.674 INFO:teuthology.orchestra.run.smithi002.stdout: "predictor_model": { 2024-09-19T06:25:13.674 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predictor_model", 2024-09-19T06:25:13.674 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.674 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.674 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.674 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "prophetstor", 2024-09-19T06:25:13.674 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.674 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.674 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.674 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.674 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.675 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.675 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.675 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.675 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-19T06:25:13.675 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-19T06:25:13.675 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.675 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.675 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.675 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-19T06:25:13.675 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.675 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.675 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.675 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.675 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.676 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.676 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.676 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.676 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.676 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.676 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:13.676 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "influx", 2024-09-19T06:25:13.676 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": false, 2024-09-19T06:25:13.676 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "influxdb python module not found", 2024-09-19T06:25:13.676 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:13.676 INFO:teuthology.orchestra.run.smithi002.stdout: "batch_size": { 2024-09-19T06:25:13.676 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "batch_size", 2024-09-19T06:25:13.676 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.677 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.677 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.677 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5000", 2024-09-19T06:25:13.677 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.677 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.677 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.677 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T06:25:13.677 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.677 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.677 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.677 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.677 INFO:teuthology.orchestra.run.smithi002.stdout: "database": { 2024-09-19T06:25:13.677 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "database", 2024-09-19T06:25:13.678 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.678 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.678 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.678 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "ceph", 2024-09-19T06:25:13.678 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.678 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.678 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.678 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T06:25:13.678 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.678 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.678 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.678 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.678 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": { 2024-09-19T06:25:13.679 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hostname", 2024-09-19T06:25:13.679 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.679 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.679 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.679 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.679 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.679 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.679 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.679 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server hostname", 2024-09-19T06:25:13.679 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.679 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.679 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.679 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.680 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-19T06:25:13.680 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-19T06:25:13.680 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:13.680 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.680 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.680 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "30", 2024-09-19T06:25:13.680 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "5", 2024-09-19T06:25:13.680 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.680 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.680 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T06:25:13.680 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.680 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.680 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.681 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.681 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:13.681 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:13.681 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.681 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.681 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.681 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.681 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.681 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.681 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.681 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.681 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.681 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.682 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.682 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.682 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.682 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.682 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.682 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.682 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.682 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.682 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.682 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:13.682 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:13.682 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.682 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.683 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.683 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.683 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.683 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.683 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.683 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.683 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.683 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.683 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.683 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.683 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:13.683 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:13.683 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.684 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.684 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.684 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:13.684 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.684 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.684 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.684 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.684 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.684 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.684 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.684 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.684 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.684 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.685 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.685 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.685 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.685 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.685 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.685 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:13.685 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:13.685 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.685 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.685 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.685 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.685 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.685 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.686 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.686 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.686 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.686 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.686 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.686 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.686 INFO:teuthology.orchestra.run.smithi002.stdout: "password": { 2024-09-19T06:25:13.686 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "password", 2024-09-19T06:25:13.686 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.686 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.686 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.686 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.686 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.687 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.687 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.687 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "password of InfluxDB server user", 2024-09-19T06:25:13.687 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.687 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.687 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.687 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.687 INFO:teuthology.orchestra.run.smithi002.stdout: "port": { 2024-09-19T06:25:13.687 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "port", 2024-09-19T06:25:13.687 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.687 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.687 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.687 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8086", 2024-09-19T06:25:13.687 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.688 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.688 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.688 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server port", 2024-09-19T06:25:13.688 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.688 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.688 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.688 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.688 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-09-19T06:25:13.688 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-09-19T06:25:13.688 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.688 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.688 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.688 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "false", 2024-09-19T06:25:13.689 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.689 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.689 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.689 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T06:25:13.689 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.689 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.689 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.689 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.689 INFO:teuthology.orchestra.run.smithi002.stdout: "threads": { 2024-09-19T06:25:13.689 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threads", 2024-09-19T06:25:13.689 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.689 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.689 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.690 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-19T06:25:13.690 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-19T06:25:13.690 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "32", 2024-09-19T06:25:13.690 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.690 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T06:25:13.690 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.690 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.690 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.690 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.690 INFO:teuthology.orchestra.run.smithi002.stdout: "username": { 2024-09-19T06:25:13.690 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "username", 2024-09-19T06:25:13.690 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.690 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.690 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.691 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.691 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.691 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.691 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.691 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "username of InfluxDB server user", 2024-09-19T06:25:13.691 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.691 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.691 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.691 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.691 INFO:teuthology.orchestra.run.smithi002.stdout: "verify_ssl": { 2024-09-19T06:25:13.691 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "verify_ssl", 2024-09-19T06:25:13.691 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.692 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.692 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.692 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "true", 2024-09-19T06:25:13.692 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.692 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.692 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.692 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T06:25:13.692 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.692 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.692 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.692 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.692 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.692 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.693 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:13.693 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "insights", 2024-09-19T06:25:13.693 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:13.693 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:13.693 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:13.693 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:13.693 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:13.693 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.693 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.693 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.693 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.693 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.694 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.694 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.694 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.694 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.694 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.694 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.694 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.694 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.694 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.694 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.694 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.694 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.694 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.695 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.695 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:13.695 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:13.695 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.695 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.695 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.695 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.695 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.695 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.695 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.695 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.695 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.696 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.696 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.696 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.696 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:13.696 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:13.696 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.696 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.696 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.696 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:13.696 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.696 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.696 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.696 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.697 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.697 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.697 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.697 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.697 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.697 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.697 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.697 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.697 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.697 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.697 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.697 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:13.697 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:13.698 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.698 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.698 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.698 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.698 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.698 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.698 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.698 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.698 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.698 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.698 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.698 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.698 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.699 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.699 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:13.699 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "iostat", 2024-09-19T06:25:13.699 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:13.699 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:13.699 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:13.699 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:13.699 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:13.699 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.699 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.699 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.699 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.699 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.700 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.700 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.700 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.700 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.700 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.700 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.700 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.700 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.700 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.700 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.700 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.700 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.700 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.701 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.701 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:13.701 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:13.701 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.701 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.701 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.701 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.701 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.701 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.701 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.701 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.701 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.701 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.702 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.702 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.702 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:13.702 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:13.702 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.702 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.702 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.702 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:13.702 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.702 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.702 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.702 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.703 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.703 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.703 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.703 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.703 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.703 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.703 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.703 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.703 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.703 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.703 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.703 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:13.703 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:13.703 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.704 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.704 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.704 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.704 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.704 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.704 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.704 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.704 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.704 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.704 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.704 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.704 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.704 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.705 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:13.705 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "k8sevents", 2024-09-19T06:25:13.705 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:13.705 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:13.705 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:13.705 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_event_retention_days": { 2024-09-19T06:25:13.705 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ceph_event_retention_days", 2024-09-19T06:25:13.705 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.705 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.705 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.705 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7", 2024-09-19T06:25:13.705 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.706 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.706 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.706 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T06:25:13.706 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.706 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.706 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.706 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.706 INFO:teuthology.orchestra.run.smithi002.stdout: "config_check_secs": { 2024-09-19T06:25:13.706 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_check_secs", 2024-09-19T06:25:13.706 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.706 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.706 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.706 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T06:25:13.707 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "10", 2024-09-19T06:25:13.707 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.707 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.707 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T06:25:13.707 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.707 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.707 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.707 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.707 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:13.707 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:13.707 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.707 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.708 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.708 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.708 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.708 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.708 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.708 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.708 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.708 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.708 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.708 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.708 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.708 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.708 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.709 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.709 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.709 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.709 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.709 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:13.709 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:13.709 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.709 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.709 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.709 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.709 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.709 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.710 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.710 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.710 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.710 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.710 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.710 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.710 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:13.710 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:13.710 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.710 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.710 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.710 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:13.711 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.711 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.711 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.711 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.711 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.711 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.711 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.711 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.711 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.711 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.711 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.711 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.711 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.712 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.712 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.712 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:13.712 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:13.712 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.712 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.712 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.712 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.712 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.712 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.712 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.713 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.713 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.713 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.713 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.713 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.713 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.713 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.713 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:13.713 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "localpool", 2024-09-19T06:25:13.713 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:13.713 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:13.713 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:13.713 INFO:teuthology.orchestra.run.smithi002.stdout: "failure_domain": { 2024-09-19T06:25:13.714 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "failure_domain", 2024-09-19T06:25:13.714 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.714 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.714 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.714 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "host", 2024-09-19T06:25:13.714 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.714 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.714 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.714 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "failure domain for any created local pool", 2024-09-19T06:25:13.714 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T06:25:13.714 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.714 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.715 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.715 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:13.715 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:13.715 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.715 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.715 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.715 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.715 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.715 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.715 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.715 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.715 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.715 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.715 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.716 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.716 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.716 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.716 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.716 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.716 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.716 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.716 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.716 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:13.716 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:13.716 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.716 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.717 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.717 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.717 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.717 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.717 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.717 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.717 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.717 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.717 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.717 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.717 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:13.717 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:13.717 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.718 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.718 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.718 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:13.718 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.718 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.718 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.718 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.718 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.718 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.718 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.718 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.718 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.718 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.718 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.718 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.719 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.719 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.719 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.719 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:13.719 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:13.719 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.719 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.719 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.719 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.719 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.719 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.719 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.719 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.720 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.720 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.720 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.720 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.720 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": { 2024-09-19T06:25:13.720 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_size", 2024-09-19T06:25:13.720 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.720 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.720 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.720 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.720 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.720 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.720 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.721 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default min_size for any created local pool", 2024-09-19T06:25:13.721 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T06:25:13.721 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.721 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.721 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.721 INFO:teuthology.orchestra.run.smithi002.stdout: "num_rep": { 2024-09-19T06:25:13.721 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "num_rep", 2024-09-19T06:25:13.721 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.721 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.721 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.721 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3", 2024-09-19T06:25:13.721 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.721 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.722 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.722 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default replica count for any created local pool", 2024-09-19T06:25:13.722 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.722 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.722 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.722 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.722 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": { 2024-09-19T06:25:13.722 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_num", 2024-09-19T06:25:13.722 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.722 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.722 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.722 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "128", 2024-09-19T06:25:13.722 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.723 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.723 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.723 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T06:25:13.723 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.723 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.723 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.723 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.723 INFO:teuthology.orchestra.run.smithi002.stdout: "prefix": { 2024-09-19T06:25:13.723 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prefix", 2024-09-19T06:25:13.723 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.723 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.723 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.723 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.724 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.724 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.724 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.724 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name prefix for any created local pool", 2024-09-19T06:25:13.724 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.724 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.724 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.724 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.724 INFO:teuthology.orchestra.run.smithi002.stdout: "subtree": { 2024-09-19T06:25:13.724 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "subtree", 2024-09-19T06:25:13.724 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.724 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.725 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.725 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "rack", 2024-09-19T06:25:13.725 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.725 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.725 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.725 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T06:25:13.725 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T06:25:13.725 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.725 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.725 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.725 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.725 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.726 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:13.726 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mds_autoscaler", 2024-09-19T06:25:13.726 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:13.726 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:13.726 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:13.726 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:13.726 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:13.726 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.726 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.726 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.726 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.726 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.727 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.727 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.727 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.727 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.727 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.727 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.727 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.727 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.727 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.727 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.727 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.727 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.727 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.728 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.728 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:13.728 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:13.728 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.728 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.728 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.728 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.728 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.728 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.728 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.728 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.728 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.728 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.729 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.729 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.729 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:13.729 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:13.729 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.729 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.729 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.729 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:13.729 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.729 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.729 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.729 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.729 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.730 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.730 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.730 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.730 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.730 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.730 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.730 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.730 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.730 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.730 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.730 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:13.730 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:13.731 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.731 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.731 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.731 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.731 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.731 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.731 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.731 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.731 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.731 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.731 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.731 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.731 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.732 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.732 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:13.732 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirroring", 2024-09-19T06:25:13.732 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:13.732 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:13.732 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:13.732 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:13.732 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:13.732 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.732 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.732 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.732 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.732 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.733 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.733 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.733 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.733 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.733 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.733 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.733 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.733 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.733 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.733 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.733 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.733 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.734 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.734 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.734 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:13.734 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:13.734 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.734 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.734 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.734 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.734 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.734 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.734 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.734 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.735 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.735 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.735 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.735 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.735 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:13.735 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:13.735 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.735 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.735 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.735 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:13.735 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.735 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.735 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.735 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.736 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.736 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.736 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.736 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.736 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.736 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.736 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.736 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.736 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.736 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.736 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.736 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:13.736 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:13.736 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.737 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.737 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.737 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.737 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.737 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.737 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.737 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.737 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.737 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.737 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.737 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.737 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.737 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.737 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:13.738 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "nfs", 2024-09-19T06:25:13.738 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:13.738 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:13.738 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:13.738 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:13.738 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:13.738 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.738 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.738 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.738 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.738 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.738 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.738 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.738 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.739 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.739 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.739 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.739 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.739 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.739 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.739 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.739 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.739 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.739 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.739 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.739 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:13.739 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:13.740 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.740 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.740 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.740 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.740 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.740 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.740 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.740 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.740 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.740 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.740 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.740 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.740 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:13.741 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:13.741 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.741 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.741 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.741 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:13.741 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.741 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.741 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.741 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.741 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.741 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.741 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.741 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.742 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.742 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.742 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.742 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.742 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.742 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.742 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.742 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:13.742 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:13.742 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.742 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.742 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.743 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.743 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.743 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.743 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.743 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.743 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.743 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.743 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.743 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.743 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.743 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.743 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:13.743 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-09-19T06:25:13.744 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:13.744 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:13.744 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:13.744 INFO:teuthology.orchestra.run.smithi002.stdout: "fail_fs": { 2024-09-19T06:25:13.744 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "fail_fs", 2024-09-19T06:25:13.744 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.744 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.744 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.744 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.744 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.744 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.744 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.745 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T06:25:13.745 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.745 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.745 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.745 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.745 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:13.745 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:13.745 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.745 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.745 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.745 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.745 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.745 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.746 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.746 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.746 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.746 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.746 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.746 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.746 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.746 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.746 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.746 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.746 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.746 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.746 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.746 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:13.747 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:13.747 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.747 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.747 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.747 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.747 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.747 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.747 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.747 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.747 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.747 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.747 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.748 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.748 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:13.748 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:13.748 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.748 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.748 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.748 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:13.748 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.748 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.748 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.748 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.748 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.748 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.749 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.749 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.749 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.749 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.749 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.749 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.749 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.749 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.749 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.749 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:13.749 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:13.749 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.749 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.750 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.750 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.750 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.750 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.750 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.750 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.750 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.750 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.750 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.750 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.750 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator": { 2024-09-19T06:25:13.751 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-09-19T06:25:13.751 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.751 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.751 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.751 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.751 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.751 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.751 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.751 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm", 2024-09-19T06:25:13.751 INFO:teuthology.orchestra.run.smithi002.stdout: "rook", 2024-09-19T06:25:13.751 INFO:teuthology.orchestra.run.smithi002.stdout: "test_orchestrator" 2024-09-19T06:25:13.752 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.752 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Orchestrator backend", 2024-09-19T06:25:13.752 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.752 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.752 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.752 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.752 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.752 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.752 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:13.752 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_perf_query", 2024-09-19T06:25:13.752 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:13.753 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:13.753 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:13.753 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:13.753 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:13.753 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.753 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.753 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.753 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.753 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.753 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.753 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.754 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.754 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.754 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.754 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.754 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.754 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.754 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.754 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.754 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.754 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.754 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.754 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.754 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:13.755 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:13.755 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.755 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.755 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.755 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.755 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.755 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.755 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.755 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.755 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.755 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.756 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.756 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.756 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:13.756 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:13.756 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.756 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.756 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.756 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:13.756 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.756 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.756 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.756 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.757 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.757 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.757 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.757 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.757 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.757 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.757 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.757 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.757 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.757 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.757 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.757 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:13.757 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:13.758 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.758 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.758 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.758 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.758 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.758 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.758 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.758 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.758 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.758 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.758 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.758 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.758 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.759 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.759 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:13.759 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_support", 2024-09-19T06:25:13.759 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:13.759 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:13.759 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:13.759 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:13.759 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:13.759 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.759 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.759 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.759 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.759 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.759 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.760 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.760 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.760 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.760 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.760 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.760 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.760 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.760 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.760 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.760 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.760 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.760 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.761 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.761 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:13.761 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:13.761 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.761 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.761 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.761 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.761 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.761 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.761 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.761 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.761 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.761 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.762 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.762 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.762 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:13.762 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:13.762 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.762 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.762 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.762 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:13.762 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.762 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.762 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.762 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.762 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.763 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.763 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.763 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.763 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.763 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.763 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.763 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.763 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.763 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.763 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.763 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:13.763 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:13.763 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.763 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.764 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.764 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.764 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.764 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.764 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.764 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.764 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.764 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.764 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.764 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.764 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.764 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.764 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:13.765 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_autoscaler", 2024-09-19T06:25:13.765 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:13.765 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:13.765 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:13.765 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:13.765 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:13.765 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.765 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.765 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.765 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.765 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.765 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.765 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.766 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.766 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.766 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.766 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.766 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.766 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.766 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.766 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.766 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.766 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.766 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.766 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.766 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:13.766 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:13.767 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.767 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.767 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.767 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.767 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.767 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.767 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.767 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.767 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.767 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.767 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.767 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.767 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:13.767 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:13.768 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.768 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.768 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.768 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:13.768 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.768 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.768 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.768 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.768 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.768 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.769 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.769 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.769 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.769 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.769 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.769 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.769 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.769 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.769 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.769 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:13.769 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:13.769 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.769 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.770 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.770 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.770 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.770 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.770 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.770 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.770 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.770 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.770 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.770 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.770 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-19T06:25:13.771 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-19T06:25:13.771 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:13.771 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.771 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.771 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-19T06:25:13.771 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.771 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.771 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.771 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.771 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.771 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.772 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.772 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.772 INFO:teuthology.orchestra.run.smithi002.stdout: "threshold": { 2024-09-19T06:25:13.772 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threshold", 2024-09-19T06:25:13.772 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-19T06:25:13.772 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.772 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.772 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-09-19T06:25:13.772 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1.0", 2024-09-19T06:25:13.772 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.772 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.773 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "scaling threshold", 2024-09-19T06:25:13.773 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T06:25:13.773 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.773 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.773 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.773 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.773 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.773 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:13.773 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "progress", 2024-09-19T06:25:13.773 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:13.773 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:13.773 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:13.774 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_pg_recovery_event": { 2024-09-19T06:25:13.774 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_pg_recovery_event", 2024-09-19T06:25:13.774 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.774 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.774 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.774 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.774 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.774 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.774 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.774 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T06:25:13.774 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.774 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.775 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.775 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.775 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-09-19T06:25:13.775 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-09-19T06:25:13.775 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.775 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.775 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.775 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.775 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.775 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.775 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.775 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.776 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.776 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.776 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.776 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.776 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:13.776 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:13.776 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.776 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.776 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.776 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.776 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.776 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.776 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.777 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.777 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.777 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.777 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.777 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.777 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.777 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.777 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.777 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.777 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.777 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.777 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.777 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:13.778 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:13.778 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.778 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.778 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.778 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.778 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.778 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.778 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.778 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.778 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.778 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.778 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.779 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.779 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:13.779 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:13.779 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.779 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.779 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.779 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:13.779 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.779 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.779 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.779 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.779 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.780 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.780 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.780 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.780 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.780 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.780 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.780 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.780 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.780 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.780 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.780 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:13.781 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:13.781 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.781 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.781 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.781 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.781 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.781 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.781 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.781 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.781 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.781 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.781 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.781 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.781 INFO:teuthology.orchestra.run.smithi002.stdout: "max_completed_events": { 2024-09-19T06:25:13.782 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_completed_events", 2024-09-19T06:25:13.782 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.782 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.782 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.782 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "50", 2024-09-19T06:25:13.782 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.782 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.782 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.782 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "number of past completed events to remember", 2024-09-19T06:25:13.782 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.782 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.782 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.782 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.782 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-19T06:25:13.783 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-19T06:25:13.783 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:13.783 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.783 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.783 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-19T06:25:13.783 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.783 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.783 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.783 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long the module is going to sleep", 2024-09-19T06:25:13.783 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.783 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.784 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.784 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.784 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.784 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.784 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:13.784 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus", 2024-09-19T06:25:13.784 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:13.784 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:13.784 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:13.784 INFO:teuthology.orchestra.run.smithi002.stdout: "cache": { 2024-09-19T06:25:13.784 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cache", 2024-09-19T06:25:13.784 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.784 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.785 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.785 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.785 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.785 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.785 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.785 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.785 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.785 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.785 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.785 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.785 INFO:teuthology.orchestra.run.smithi002.stdout: "exclude_perf_counters": { 2024-09-19T06:25:13.785 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "exclude_perf_counters", 2024-09-19T06:25:13.785 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.786 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.786 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.786 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.786 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.786 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.786 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.786 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T06:25:13.786 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T06:25:13.786 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.786 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.786 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.786 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:13.786 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:13.787 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.787 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.787 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.787 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.787 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.787 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.787 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.787 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.787 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.787 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.787 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.787 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.787 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.788 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.788 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.788 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.788 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.788 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.788 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.788 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:13.788 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:13.788 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.788 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.788 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.788 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.789 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.789 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.789 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.789 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.789 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.789 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.789 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.789 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.789 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:13.789 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:13.789 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.789 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.789 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.790 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:13.790 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.790 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.790 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.790 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.790 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.790 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.790 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.790 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.790 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.790 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.790 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.791 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.791 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.791 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.791 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.791 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:13.791 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:13.791 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.791 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.791 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.791 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.791 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.791 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.791 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.792 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.792 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.792 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.792 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.792 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.792 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools": { 2024-09-19T06:25:13.792 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools", 2024-09-19T06:25:13.792 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.792 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.792 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.792 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.792 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.792 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.793 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.793 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.793 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.793 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.793 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.793 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.793 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T06:25:13.793 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T06:25:13.793 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.793 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.793 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.793 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "300", 2024-09-19T06:25:13.793 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.793 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.794 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.794 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.794 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.794 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.794 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.794 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.794 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_interval": { 2024-09-19T06:25:13.794 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_interval", 2024-09-19T06:25:13.794 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-19T06:25:13.794 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.794 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.794 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15.0", 2024-09-19T06:25:13.794 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.795 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.795 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.795 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.795 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.795 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.795 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.795 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.795 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-19T06:25:13.795 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-19T06:25:13.795 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.795 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.795 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.795 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-09-19T06:25:13.796 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.796 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.796 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.796 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T06:25:13.796 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.796 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.796 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.796 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.796 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-19T06:25:13.796 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-19T06:25:13.796 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.796 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.796 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.797 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "9283", 2024-09-19T06:25:13.797 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.797 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.797 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.797 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T06:25:13.797 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.797 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.797 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.797 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.797 INFO:teuthology.orchestra.run.smithi002.stdout: "stale_cache_strategy": { 2024-09-19T06:25:13.797 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stale_cache_strategy", 2024-09-19T06:25:13.797 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.798 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.798 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.798 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "log", 2024-09-19T06:25:13.798 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.798 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.798 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.798 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.798 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.798 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.798 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.798 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.798 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-09-19T06:25:13.798 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-09-19T06:25:13.799 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.799 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.799 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.799 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "default", 2024-09-19T06:25:13.799 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.799 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.799 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.799 INFO:teuthology.orchestra.run.smithi002.stdout: "default", 2024-09-19T06:25:13.799 INFO:teuthology.orchestra.run.smithi002.stdout: "error" 2024-09-19T06:25:13.799 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.799 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.799 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.799 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.800 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.800 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.800 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-09-19T06:25:13.800 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-09-19T06:25:13.800 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.800 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.800 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.800 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-09-19T06:25:13.800 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-09-19T06:25:13.800 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-09-19T06:25:13.800 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.800 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.800 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.801 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.801 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.801 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.801 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.801 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.801 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:13.801 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_support", 2024-09-19T06:25:13.801 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:13.801 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:13.801 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:13.801 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:13.801 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:13.801 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.802 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.802 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.802 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.802 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.802 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.802 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.802 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.802 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.802 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.802 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.802 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.802 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.803 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.803 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.803 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.803 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.803 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.803 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.803 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:13.803 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:13.803 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.803 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.803 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.803 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.803 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.804 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.804 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.804 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.804 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.804 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.804 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.804 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.804 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:13.804 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:13.804 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.804 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.804 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.805 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:13.805 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.805 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.805 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.805 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.805 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.805 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.805 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.805 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.805 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.805 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.805 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.806 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.806 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.806 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.806 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.806 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:13.806 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:13.806 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.806 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.806 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.806 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.806 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.806 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.807 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.807 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.807 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.807 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.807 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.807 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.807 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_snap_create": { 2024-09-19T06:25:13.807 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_snap_create", 2024-09-19T06:25:13.807 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.807 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.807 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.807 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T06:25:13.807 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.807 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.808 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.808 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.808 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.808 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.808 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.808 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.808 INFO:teuthology.orchestra.run.smithi002.stdout: "mirror_snapshot_schedule": { 2024-09-19T06:25:13.808 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T06:25:13.808 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.808 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.808 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.808 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.808 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.809 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.809 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.809 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.809 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.809 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.809 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.809 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.809 INFO:teuthology.orchestra.run.smithi002.stdout: "trash_purge_schedule": { 2024-09-19T06:25:13.809 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "trash_purge_schedule", 2024-09-19T06:25:13.809 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.809 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.809 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.809 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.810 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.810 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.810 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.810 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.810 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.810 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.810 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.810 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.810 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.810 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.810 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:13.810 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "restful", 2024-09-19T06:25:13.810 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:13.810 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:13.811 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:13.811 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_auth": { 2024-09-19T06:25:13.811 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_auth", 2024-09-19T06:25:13.811 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.811 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.811 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.811 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.811 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.811 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.811 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.811 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.811 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.811 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.811 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.812 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.812 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-09-19T06:25:13.812 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-09-19T06:25:13.812 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.812 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.812 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.812 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.812 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.812 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.812 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.812 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.812 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.813 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.813 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.813 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.813 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:13.813 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:13.813 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.813 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.813 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.813 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.813 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.814 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.814 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.814 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.814 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.814 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.814 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.814 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.814 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.814 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.814 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.814 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.814 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.814 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.814 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.815 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:13.815 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:13.815 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.815 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.815 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.815 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.815 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.815 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.815 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.815 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.815 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.815 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.815 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.816 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.816 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:13.816 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:13.816 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.816 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.816 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.816 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:13.816 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.816 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.816 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.816 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.816 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.817 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.817 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.817 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.817 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.817 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.817 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.817 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.817 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.817 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.817 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.817 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:13.817 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:13.817 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.818 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.818 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.818 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.818 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.818 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.818 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.818 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.818 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.818 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.818 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.818 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.818 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-19T06:25:13.818 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-19T06:25:13.819 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.819 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.819 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.819 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.819 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.819 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.819 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.819 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.819 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.819 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.819 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.819 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.819 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-19T06:25:13.820 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-19T06:25:13.820 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.820 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.820 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.820 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.820 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.820 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.820 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.820 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.820 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.820 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.820 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.820 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.821 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.821 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.821 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:13.821 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rgw", 2024-09-19T06:25:13.821 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:13.821 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:13.821 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:13.821 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:13.821 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:13.821 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.821 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.821 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.821 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.822 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.822 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.822 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.822 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.822 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.822 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.822 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.822 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.822 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.822 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.822 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.822 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.822 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.823 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.823 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.823 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:13.823 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:13.823 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.823 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.823 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.823 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.823 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.823 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.823 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.823 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.823 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.824 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.824 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.824 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.824 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:13.824 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:13.824 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.824 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.824 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.824 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:13.824 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.824 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.824 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.824 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.825 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.825 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.825 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.825 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.825 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.825 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.825 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.825 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.825 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.825 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.825 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.825 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:13.825 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:13.826 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.826 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.826 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.826 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.826 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.826 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.826 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.826 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.826 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.826 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.826 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.826 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.826 INFO:teuthology.orchestra.run.smithi002.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T06:25:13.827 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T06:25:13.827 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.827 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.827 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.827 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-19T06:25:13.827 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.827 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.827 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.827 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T06:25:13.827 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.827 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.827 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.827 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.828 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.828 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.828 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:13.828 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rook", 2024-09-19T06:25:13.828 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:13.828 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:13.828 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:13.828 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:13.828 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:13.828 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.828 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.829 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.829 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.829 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.829 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.829 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.829 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.829 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.829 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.829 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.829 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.829 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.829 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.830 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.830 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.830 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.830 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.830 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.830 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:13.830 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:13.830 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.830 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.830 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.830 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.830 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.830 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.831 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.831 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.831 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.831 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.831 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.831 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.831 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:13.831 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:13.831 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.831 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.831 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.831 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:13.831 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.832 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.832 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.832 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.832 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.832 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.832 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.832 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.832 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.832 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.832 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.832 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.832 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.832 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.833 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.833 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:13.833 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:13.833 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.833 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.833 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.833 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.833 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.833 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.833 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.833 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.833 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.833 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.834 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.834 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.834 INFO:teuthology.orchestra.run.smithi002.stdout: "storage_class": { 2024-09-19T06:25:13.834 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "storage_class", 2024-09-19T06:25:13.834 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.834 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.834 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.834 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "local", 2024-09-19T06:25:13.834 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.834 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.834 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.834 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T06:25:13.835 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.835 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.835 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.835 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.835 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.835 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.835 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:13.835 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "selftest", 2024-09-19T06:25:13.835 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:13.835 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:13.835 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:13.835 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:13.835 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:13.836 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.836 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.836 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.836 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.836 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.836 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.836 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.836 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.836 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.836 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.836 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.836 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.836 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.837 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.837 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.837 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.837 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.837 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.837 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.837 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:13.837 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:13.837 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.837 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.837 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.837 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.837 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.837 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.838 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.838 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.838 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.838 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.838 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.838 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.838 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:13.838 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:13.838 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.838 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.838 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.838 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:13.838 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.839 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.839 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.839 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.839 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.839 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.839 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.839 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.839 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.839 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.839 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.839 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.839 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.839 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.840 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.840 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:13.840 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:13.840 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.840 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.840 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.840 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.840 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.840 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.840 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.840 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.840 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.841 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.841 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.841 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.841 INFO:teuthology.orchestra.run.smithi002.stdout: "roption1": { 2024-09-19T06:25:13.841 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption1", 2024-09-19T06:25:13.841 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.841 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.841 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.841 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.841 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.841 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.841 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.841 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.842 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.842 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.842 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.842 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.842 INFO:teuthology.orchestra.run.smithi002.stdout: "roption2": { 2024-09-19T06:25:13.842 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption2", 2024-09-19T06:25:13.842 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.842 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.842 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.842 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "xyz", 2024-09-19T06:25:13.842 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.842 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.842 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.842 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.843 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.843 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.843 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.843 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.843 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption1": { 2024-09-19T06:25:13.843 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption1", 2024-09-19T06:25:13.843 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.843 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.843 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.843 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.843 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.844 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.844 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.844 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.844 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.844 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.844 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.844 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.844 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption2": { 2024-09-19T06:25:13.844 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption2", 2024-09-19T06:25:13.844 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.844 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.844 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.845 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.845 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.845 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.845 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.845 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.845 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.845 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.845 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.845 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.845 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption3": { 2024-09-19T06:25:13.845 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption3", 2024-09-19T06:25:13.845 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-19T06:25:13.845 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.846 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.846 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.846 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.846 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.846 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.846 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.846 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.846 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.846 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.846 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.846 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption4": { 2024-09-19T06:25:13.846 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption4", 2024-09-19T06:25:13.847 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.847 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.847 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.847 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.847 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.847 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.847 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.847 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.847 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.847 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.847 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.847 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.848 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption5": { 2024-09-19T06:25:13.848 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption5", 2024-09-19T06:25:13.848 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.848 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.848 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.848 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.848 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.848 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.848 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.848 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.848 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.848 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.849 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.849 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.849 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption6": { 2024-09-19T06:25:13.849 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption6", 2024-09-19T06:25:13.849 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.849 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.849 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.849 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.849 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.849 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.849 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.849 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.849 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.850 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.850 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.850 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.850 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption7": { 2024-09-19T06:25:13.850 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption7", 2024-09-19T06:25:13.850 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.850 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.850 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.850 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.850 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-19T06:25:13.850 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "42", 2024-09-19T06:25:13.850 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.851 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.851 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.851 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.851 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.851 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.851 INFO:teuthology.orchestra.run.smithi002.stdout: "testkey": { 2024-09-19T06:25:13.851 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testkey", 2024-09-19T06:25:13.851 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.851 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.851 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.851 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.851 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.852 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.852 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.852 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.852 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.852 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.852 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.852 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.852 INFO:teuthology.orchestra.run.smithi002.stdout: "testlkey": { 2024-09-19T06:25:13.852 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testlkey", 2024-09-19T06:25:13.852 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.852 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.852 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.853 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.853 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.853 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.853 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.853 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.853 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.853 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.853 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.853 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.853 INFO:teuthology.orchestra.run.smithi002.stdout: "testnewline": { 2024-09-19T06:25:13.853 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testnewline", 2024-09-19T06:25:13.853 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.853 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.854 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.854 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.854 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.854 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.854 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.854 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.854 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.854 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.854 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.854 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.854 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.854 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.854 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:13.855 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snap_schedule", 2024-09-19T06:25:13.855 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:13.855 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:13.855 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:13.855 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_m_granularity": { 2024-09-19T06:25:13.855 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_m_granularity", 2024-09-19T06:25:13.855 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.855 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.855 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.855 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.855 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.855 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.855 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.856 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T06:25:13.856 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.856 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.856 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.856 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.856 INFO:teuthology.orchestra.run.smithi002.stdout: "dump_on_update": { 2024-09-19T06:25:13.856 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dump_on_update", 2024-09-19T06:25:13.856 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.856 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.856 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.856 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.856 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.857 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.857 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.857 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "dump database to debug log on update", 2024-09-19T06:25:13.857 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.857 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.857 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.857 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.857 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:13.857 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:13.857 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.857 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.857 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.857 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.858 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.858 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.858 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.858 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.858 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.858 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.858 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.858 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.858 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.858 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.858 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.858 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.858 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.859 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.859 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.859 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:13.859 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:13.859 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.859 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.859 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.859 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.859 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.859 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.859 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.859 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.860 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.860 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.860 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.860 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.860 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:13.860 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:13.860 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.860 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.860 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.860 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:13.860 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.860 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.860 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.861 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.861 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.861 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.861 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.861 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.861 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.861 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.861 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.861 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.861 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.861 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.861 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.862 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:13.862 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:13.862 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.862 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.862 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.862 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.862 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.862 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.862 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.862 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.862 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.862 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.862 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.863 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.863 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.863 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.863 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:13.863 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stats", 2024-09-19T06:25:13.863 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:13.863 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:13.863 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:13.863 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:13.863 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:13.863 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.863 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.863 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.864 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.864 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.864 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.864 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.864 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.864 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.864 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.864 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.864 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.864 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.864 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.864 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.864 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.865 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.865 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.865 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.865 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:13.865 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:13.865 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.865 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.865 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.865 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.865 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.865 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.865 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.865 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.866 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.866 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.866 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.866 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.866 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:13.866 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:13.866 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.866 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.866 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.866 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:13.866 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.866 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.867 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.867 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.867 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.867 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.867 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.867 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.867 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.867 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.867 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.867 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.867 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.867 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.867 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.868 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:13.868 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:13.868 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.868 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.868 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.868 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.868 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.868 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.868 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.868 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.868 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.868 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.868 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.869 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.869 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.869 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.869 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:13.869 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "status", 2024-09-19T06:25:13.869 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:13.869 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:13.869 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:13.869 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:13.869 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:13.869 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.869 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.869 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.870 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.870 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.870 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.870 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.870 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.870 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.870 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.870 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.870 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.870 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.870 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.870 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.870 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.871 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.871 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.871 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.871 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:13.871 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:13.871 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.871 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.871 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.871 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.871 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.871 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.871 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.871 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.872 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.872 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.872 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.872 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.872 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:13.872 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:13.872 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.872 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.872 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.872 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:13.872 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.872 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.872 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.873 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.873 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.873 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.873 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.873 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.873 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.873 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.873 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.873 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.873 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.873 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.873 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.873 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:13.874 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:13.874 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.874 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.874 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.874 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.874 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.874 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.874 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.874 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.874 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.874 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.874 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.875 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.875 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.875 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.875 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:13.875 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telegraf", 2024-09-19T06:25:13.875 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:13.875 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:13.875 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:13.875 INFO:teuthology.orchestra.run.smithi002.stdout: "address": { 2024-09-19T06:25:13.875 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "address", 2024-09-19T06:25:13.875 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.875 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.876 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.876 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T06:25:13.876 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.876 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.876 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.876 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.876 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.876 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.876 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.876 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.876 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-19T06:25:13.876 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-19T06:25:13.876 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:13.877 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.877 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.877 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15", 2024-09-19T06:25:13.877 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.877 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.877 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.877 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.877 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.877 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.877 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.877 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.877 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:13.877 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:13.878 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.878 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.878 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.878 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.878 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.878 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.878 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.878 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.878 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.878 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.878 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.878 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.878 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.879 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.879 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.879 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.879 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.879 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.879 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.879 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:13.879 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:13.879 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.879 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.879 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.879 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.879 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.880 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.880 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.880 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.880 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.880 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.880 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.880 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.880 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:13.880 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:13.880 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.880 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.880 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.880 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:13.881 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.881 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.881 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.881 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.881 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.881 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.881 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.881 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.881 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.881 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.881 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.881 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.881 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.882 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.882 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.882 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:13.882 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:13.882 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.882 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.882 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.882 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.882 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.882 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.882 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.882 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.883 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.883 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.883 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.883 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.883 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.883 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.883 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:13.883 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telemetry", 2024-09-19T06:25:13.883 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:13.883 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:13.883 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:13.883 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_basic": { 2024-09-19T06:25:13.883 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_basic", 2024-09-19T06:25:13.883 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.884 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.884 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.884 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.884 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.884 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.884 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.884 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T06:25:13.884 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.884 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.884 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.884 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.884 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_crash": { 2024-09-19T06:25:13.885 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_crash", 2024-09-19T06:25:13.885 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.885 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.885 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.885 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.885 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.885 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.885 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.885 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T06:25:13.885 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.885 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.885 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.885 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.885 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_device": { 2024-09-19T06:25:13.886 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_device", 2024-09-19T06:25:13.886 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.886 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.886 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.886 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.886 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.886 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.886 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.886 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T06:25:13.888 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.888 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.888 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.888 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.888 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_ident": { 2024-09-19T06:25:13.888 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_ident", 2024-09-19T06:25:13.888 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.888 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.888 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.888 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.888 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.888 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.889 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.889 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T06:25:13.889 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.889 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.889 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.889 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.889 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_perf": { 2024-09-19T06:25:13.889 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_perf", 2024-09-19T06:25:13.889 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.889 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.889 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.889 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.889 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.890 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.890 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.890 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T06:25:13.890 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.890 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.890 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.890 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.890 INFO:teuthology.orchestra.run.smithi002.stdout: "contact": { 2024-09-19T06:25:13.890 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "contact", 2024-09-19T06:25:13.890 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.890 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.890 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.891 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.891 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.891 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.891 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.891 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.891 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.891 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.891 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.891 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.891 INFO:teuthology.orchestra.run.smithi002.stdout: "description": { 2024-09-19T06:25:13.891 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "description", 2024-09-19T06:25:13.891 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.892 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.892 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.892 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.892 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.892 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.892 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.892 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.892 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.892 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.892 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.892 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.892 INFO:teuthology.orchestra.run.smithi002.stdout: "device_url": { 2024-09-19T06:25:13.892 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_url", 2024-09-19T06:25:13.893 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.893 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.893 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.893 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T06:25:13.893 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.893 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.893 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.893 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.893 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.893 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.893 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.893 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.894 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-09-19T06:25:13.894 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-09-19T06:25:13.894 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.894 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.894 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.894 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.894 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.894 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.894 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.894 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.894 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.894 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.894 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.895 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.895 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-19T06:25:13.895 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-19T06:25:13.895 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.895 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.895 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.895 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "24", 2024-09-19T06:25:13.895 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "8", 2024-09-19T06:25:13.895 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.895 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.895 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.895 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.895 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.896 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.896 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.896 INFO:teuthology.orchestra.run.smithi002.stdout: "last_opt_revision": { 2024-09-19T06:25:13.896 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "last_opt_revision", 2024-09-19T06:25:13.896 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.896 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.896 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.896 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1", 2024-09-19T06:25:13.896 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.896 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.896 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.896 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.896 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.897 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.897 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.897 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.897 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard": { 2024-09-19T06:25:13.897 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard", 2024-09-19T06:25:13.897 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.897 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.897 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.897 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.897 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.897 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.897 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.897 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.898 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.898 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.898 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.898 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.898 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard_description": { 2024-09-19T06:25:13.898 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard_description", 2024-09-19T06:25:13.898 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.898 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.898 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.898 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.898 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.898 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.898 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.899 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.899 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.899 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.899 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.899 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.899 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:13.899 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:13.899 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.899 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.899 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.899 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.899 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.899 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.900 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.900 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.900 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.900 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.900 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.900 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.900 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.900 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.900 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.900 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.900 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.900 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.901 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.901 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:13.901 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:13.901 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.901 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.901 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.901 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.901 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.901 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.901 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.901 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.901 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.901 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.901 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.902 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.902 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:13.902 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:13.902 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.902 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.902 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.902 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:13.902 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.902 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.902 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.902 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.902 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.902 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.903 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.903 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.903 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.903 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.903 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.903 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.903 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.903 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.903 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.903 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:13.903 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:13.903 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.903 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.904 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.904 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.904 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.904 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.904 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.904 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.904 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.904 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.904 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.904 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.904 INFO:teuthology.orchestra.run.smithi002.stdout: "organization": { 2024-09-19T06:25:13.904 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "organization", 2024-09-19T06:25:13.904 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.905 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.905 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.905 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.905 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.905 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.905 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.905 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.905 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.905 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.905 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.905 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.905 INFO:teuthology.orchestra.run.smithi002.stdout: "proxy": { 2024-09-19T06:25:13.906 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "proxy", 2024-09-19T06:25:13.906 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.906 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.906 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.906 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.906 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.906 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.906 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.906 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.906 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.906 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.906 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.907 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.907 INFO:teuthology.orchestra.run.smithi002.stdout: "url": { 2024-09-19T06:25:13.907 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url", 2024-09-19T06:25:13.907 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.907 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.907 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.907 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T06:25:13.907 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.907 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.907 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.907 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.907 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.907 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.908 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.908 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.908 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.908 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.908 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:13.908 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "test_orchestrator", 2024-09-19T06:25:13.908 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:13.908 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:13.908 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:13.908 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:13.908 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:13.908 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.909 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.909 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.909 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.909 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.909 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.909 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.909 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.909 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.909 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.909 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.909 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.909 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.909 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.910 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.910 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.910 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.910 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.910 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.910 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:13.910 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:13.910 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.910 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.910 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.910 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.910 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.910 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.911 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.911 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.911 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.911 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.911 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.911 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.911 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:13.911 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:13.911 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.911 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.911 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.911 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:13.911 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.912 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.912 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.912 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.912 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.912 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.912 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.912 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.912 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.912 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.912 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.912 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.912 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.912 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.913 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.913 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:13.913 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:13.913 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.913 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.913 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.913 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.913 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.913 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.913 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.913 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.913 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.913 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.914 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.914 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.914 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.914 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.914 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:13.914 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "volumes", 2024-09-19T06:25:13.914 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:13.914 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:13.914 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:13.914 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:13.914 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:13.914 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.914 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.915 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.915 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.915 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.915 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.915 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.915 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.915 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.915 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.915 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.915 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.915 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.915 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.915 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.915 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.916 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.916 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.916 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.916 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:13.916 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:13.916 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.916 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.916 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.916 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.916 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.916 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.916 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.916 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.917 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.917 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.917 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.917 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.917 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:13.917 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:13.917 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.917 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.917 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.917 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:13.917 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.917 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.917 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.918 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.918 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.918 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.918 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.918 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.918 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.918 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.918 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.918 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.918 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.918 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.918 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.918 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:13.919 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:13.919 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.919 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.919 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.919 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.919 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.919 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.919 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.919 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.919 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.919 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.919 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.919 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.920 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_clones": { 2024-09-19T06:25:13.920 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_clones", 2024-09-19T06:25:13.920 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.920 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.920 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.920 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4", 2024-09-19T06:25:13.920 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.920 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.920 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.920 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T06:25:13.920 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.920 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.921 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.921 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.921 INFO:teuthology.orchestra.run.smithi002.stdout: "periodic_async_work": { 2024-09-19T06:25:13.921 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "periodic_async_work", 2024-09-19T06:25:13.921 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.921 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.921 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.921 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.921 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.921 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.921 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.921 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Periodically check for async work", 2024-09-19T06:25:13.921 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.922 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.922 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.922 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.922 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_delay": { 2024-09-19T06:25:13.922 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_delay", 2024-09-19T06:25:13.922 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.922 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.922 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.922 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-19T06:25:13.922 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.922 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.922 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.922 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T06:25:13.923 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.923 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.923 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.923 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.923 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_no_wait": { 2024-09-19T06:25:13.923 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T06:25:13.923 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.923 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.923 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.923 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.923 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.923 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.923 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.924 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T06:25:13.924 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.924 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.924 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.924 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.924 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.924 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.924 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:13.924 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix", 2024-09-19T06:25:13.924 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:13.924 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:13.924 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:13.924 INFO:teuthology.orchestra.run.smithi002.stdout: "discovery_interval": { 2024-09-19T06:25:13.925 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "discovery_interval", 2024-09-19T06:25:13.925 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-19T06:25:13.925 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.925 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.925 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "100", 2024-09-19T06:25:13.925 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.925 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.925 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.925 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.925 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.925 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.925 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.925 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.926 INFO:teuthology.orchestra.run.smithi002.stdout: "identifier": { 2024-09-19T06:25:13.926 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "identifier", 2024-09-19T06:25:13.926 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.926 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.926 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.926 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.926 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.926 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.926 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.926 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.926 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.926 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.926 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.927 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.927 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-19T06:25:13.927 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-19T06:25:13.927 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:13.927 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.927 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.927 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-19T06:25:13.927 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.927 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.927 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.927 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.927 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.927 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.928 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.928 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.928 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:13.928 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:13.928 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.928 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.928 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.928 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.928 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.928 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.928 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.928 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.928 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.929 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.929 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.929 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.929 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.929 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.929 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.929 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.929 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.929 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.929 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.929 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:13.929 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:13.929 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.929 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.930 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.930 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.930 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.930 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.930 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.930 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.930 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.930 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.930 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.930 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.930 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:13.930 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:13.930 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.931 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.931 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.931 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:13.931 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.931 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.931 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.931 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.931 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.931 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.931 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.931 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.931 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.931 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.931 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.932 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.932 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.932 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.932 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.932 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:13.932 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:13.932 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.932 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.932 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.932 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.932 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.932 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.932 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.933 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.933 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.933 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.933 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.933 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.933 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_host": { 2024-09-19T06:25:13.933 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_host", 2024-09-19T06:25:13.933 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.933 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.933 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.933 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.933 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.933 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.934 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.934 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.934 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.934 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.934 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.934 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.934 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_port": { 2024-09-19T06:25:13.934 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_port", 2024-09-19T06:25:13.934 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.934 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.934 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.934 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10051", 2024-09-19T06:25:13.934 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.935 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.935 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.935 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.935 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.935 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.935 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.935 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.935 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_sender": { 2024-09-19T06:25:13.935 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_sender", 2024-09-19T06:25:13.935 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.935 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.935 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.936 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T06:25:13.936 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.936 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.936 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.936 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.936 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.936 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.936 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.936 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.936 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.936 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.936 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-19T06:25:13.936 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.937 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:13.937 INFO:teuthology.orchestra.run.smithi002.stdout: "gid": 24893, 2024-09-19T06:25:13.937 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "y", 2024-09-19T06:25:13.937 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_features": 4540701547738038271, 2024-09-19T06:25:13.937 INFO:teuthology.orchestra.run.smithi002.stdout: "available_modules": [ 2024-09-19T06:25:13.937 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:13.937 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "alerts", 2024-09-19T06:25:13.937 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:13.937 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:13.937 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:13.937 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-19T06:25:13.937 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-19T06:25:13.938 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:13.938 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.938 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.938 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-19T06:25:13.938 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.938 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.938 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.938 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T06:25:13.938 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.938 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.938 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.938 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.938 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:13.939 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:13.939 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.939 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.939 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.939 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.939 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.939 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.939 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.939 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.939 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.939 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.939 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.939 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.940 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.940 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.940 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.940 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.940 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.940 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.940 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.940 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:13.940 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:13.940 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.940 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.940 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.940 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.941 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.941 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.941 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.941 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.941 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.941 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.941 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.941 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.941 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:13.941 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:13.941 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.941 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.941 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.942 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:13.942 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.942 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.942 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.942 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.942 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.942 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.942 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.942 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.942 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.942 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.942 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.942 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.943 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.943 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.943 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.943 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:13.943 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:13.943 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.943 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.943 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.943 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.943 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.943 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.944 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.944 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.944 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.944 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.944 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.944 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.944 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_destination": { 2024-09-19T06:25:13.944 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_destination", 2024-09-19T06:25:13.944 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.944 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.944 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.944 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.945 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.945 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.945 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.945 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email address to send alerts to", 2024-09-19T06:25:13.945 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.945 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.945 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.945 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.945 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_from_name": { 2024-09-19T06:25:13.945 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_from_name", 2024-09-19T06:25:13.945 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.945 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.945 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.946 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "Ceph", 2024-09-19T06:25:13.946 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.946 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.946 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.946 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email From: name", 2024-09-19T06:25:13.946 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.946 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.946 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.946 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.946 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_host": { 2024-09-19T06:25:13.946 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_host", 2024-09-19T06:25:13.946 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.946 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.947 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.947 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.947 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.947 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.947 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.947 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP server", 2024-09-19T06:25:13.947 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.947 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.947 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.947 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.947 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_password": { 2024-09-19T06:25:13.947 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_password", 2024-09-19T06:25:13.947 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.948 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.948 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.948 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.948 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.948 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.948 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.948 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Password to authenticate with", 2024-09-19T06:25:13.948 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.948 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.948 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.948 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.948 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_port": { 2024-09-19T06:25:13.948 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_port", 2024-09-19T06:25:13.948 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.949 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.949 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.949 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "465", 2024-09-19T06:25:13.949 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.949 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.949 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.949 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP port", 2024-09-19T06:25:13.949 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.949 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.949 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.949 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.949 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_sender": { 2024-09-19T06:25:13.949 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_sender", 2024-09-19T06:25:13.950 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.950 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.950 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.950 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.950 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.950 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.950 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.950 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP envelope sender", 2024-09-19T06:25:13.950 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.950 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.950 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.950 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.951 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_ssl": { 2024-09-19T06:25:13.951 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_ssl", 2024-09-19T06:25:13.951 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.951 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.951 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.951 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.951 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.951 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.951 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.951 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T06:25:13.951 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.951 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.951 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.952 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.952 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_user": { 2024-09-19T06:25:13.952 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_user", 2024-09-19T06:25:13.952 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.952 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.952 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.952 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.952 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.952 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.952 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.952 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "User to authenticate as", 2024-09-19T06:25:13.952 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.953 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.953 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.953 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.953 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.953 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.953 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:13.953 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "balancer", 2024-09-19T06:25:13.953 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:13.953 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:13.953 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:13.953 INFO:teuthology.orchestra.run.smithi002.stdout: "active": { 2024-09-19T06:25:13.953 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "active", 2024-09-19T06:25:13.954 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.954 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.954 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.954 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.954 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.954 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.954 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.954 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T06:25:13.954 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.954 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.954 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.954 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.955 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_time": { 2024-09-19T06:25:13.955 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_time", 2024-09-19T06:25:13.955 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.955 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.955 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.955 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0000", 2024-09-19T06:25:13.955 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.955 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.955 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.955 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T06:25:13.955 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T06:25:13.955 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.956 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.956 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.956 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_weekday": { 2024-09-19T06:25:13.956 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_weekday", 2024-09-19T06:25:13.956 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-19T06:25:13.956 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.956 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.956 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-19T06:25:13.956 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-09-19T06:25:13.956 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-09-19T06:25:13.956 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.957 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T06:25:13.957 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T06:25:13.957 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.957 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.957 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.957 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_max_iterations": { 2024-09-19T06:25:13.957 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_max_iterations", 2024-09-19T06:25:13.957 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-19T06:25:13.957 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.957 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.957 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "25", 2024-09-19T06:25:13.957 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-19T06:25:13.957 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "250", 2024-09-19T06:25:13.958 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.958 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T06:25:13.958 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.958 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.958 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.958 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.958 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_metrics": { 2024-09-19T06:25:13.958 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_metrics", 2024-09-19T06:25:13.958 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.958 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.958 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.958 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T06:25:13.958 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.958 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.959 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.959 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T06:25:13.959 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T06:25:13.959 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.959 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.959 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.959 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_step": { 2024-09-19T06:25:13.959 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_step", 2024-09-19T06:25:13.959 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-19T06:25:13.959 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.959 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.959 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.5", 2024-09-19T06:25:13.959 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0.001", 2024-09-19T06:25:13.960 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "0.999", 2024-09-19T06:25:13.960 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.960 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "aggressiveness of optimization", 2024-09-19T06:25:13.960 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T06:25:13.960 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.960 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.960 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.960 INFO:teuthology.orchestra.run.smithi002.stdout: "end_time": { 2024-09-19T06:25:13.960 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_time", 2024-09-19T06:25:13.960 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.960 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.960 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.960 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2359", 2024-09-19T06:25:13.960 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.961 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.961 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.961 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T06:25:13.961 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T06:25:13.961 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.961 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.961 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.961 INFO:teuthology.orchestra.run.smithi002.stdout: "end_weekday": { 2024-09-19T06:25:13.961 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_weekday", 2024-09-19T06:25:13.961 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-19T06:25:13.961 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.961 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.961 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-19T06:25:13.962 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-09-19T06:25:13.962 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-09-19T06:25:13.962 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.962 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T06:25:13.962 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T06:25:13.962 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.962 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.962 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.962 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:13.962 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:13.962 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.962 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.962 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.963 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.963 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.963 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.963 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.963 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.963 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.963 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.963 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.963 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.963 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.963 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.963 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.963 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.963 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.964 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.964 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.964 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:13.964 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:13.964 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.964 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.964 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.964 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.964 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.964 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.964 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.964 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.965 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.965 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.965 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.965 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.965 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:13.965 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:13.965 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.965 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.965 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.965 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:13.965 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.965 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.965 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.966 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:13.966 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:13.966 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:13.966 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:13.966 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:13.966 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:13.966 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.966 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.966 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.966 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.966 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.966 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.966 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:13.967 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:13.967 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.967 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.967 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.967 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.967 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.967 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.967 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.967 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:13.967 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.967 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.967 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.967 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.968 INFO:teuthology.orchestra.run.smithi002.stdout: "min_score": { 2024-09-19T06:25:13.968 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_score", 2024-09-19T06:25:13.968 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-19T06:25:13.968 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.968 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.968 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-19T06:25:13.968 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.968 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.968 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.968 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T06:25:13.968 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.968 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.969 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.969 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.969 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-09-19T06:25:13.969 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-09-19T06:25:13.969 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.969 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.969 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.969 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "upmap", 2024-09-19T06:25:13.969 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.969 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.969 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.969 INFO:teuthology.orchestra.run.smithi002.stdout: "crush-compat", 2024-09-19T06:25:13.969 INFO:teuthology.orchestra.run.smithi002.stdout: "none", 2024-09-19T06:25:13.970 INFO:teuthology.orchestra.run.smithi002.stdout: "read", 2024-09-19T06:25:13.970 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap", 2024-09-19T06:25:13.970 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap-read" 2024-09-19T06:25:13.970 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.970 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Balancer mode", 2024-09-19T06:25:13.970 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.970 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.970 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.970 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.970 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_ids": { 2024-09-19T06:25:13.970 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_ids", 2024-09-19T06:25:13.970 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.970 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.970 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.971 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.971 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.971 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.971 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.971 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T06:25:13.971 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.971 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.971 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.971 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.971 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-19T06:25:13.971 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-19T06:25:13.971 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:13.971 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.972 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.972 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-19T06:25:13.972 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.972 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.972 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.972 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T06:25:13.972 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.972 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.972 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.972 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.972 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_deviation": { 2024-09-19T06:25:13.972 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_deviation", 2024-09-19T06:25:13.972 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.973 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.973 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.973 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-19T06:25:13.973 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-19T06:25:13.973 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.973 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.973 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T06:25:13.973 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T06:25:13.973 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.973 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.973 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.973 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_optimizations": { 2024-09-19T06:25:13.973 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_optimizations", 2024-09-19T06:25:13.973 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-19T06:25:13.974 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.974 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.974 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T06:25:13.974 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.974 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.974 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.974 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T06:25:13.974 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.974 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.974 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.974 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.974 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:13.974 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.974 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:13.975 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm", 2024-09-19T06:25:13.975 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:13.975 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:13.975 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:13.975 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_down_multiplier": { 2024-09-19T06:25:13.975 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_down_multiplier", 2024-09-19T06:25:13.975 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-19T06:25:13.975 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.975 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.975 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-09-19T06:25:13.975 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.975 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.975 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.976 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T06:25:13.976 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.976 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.976 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.976 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.976 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_refresh_rate": { 2024-09-19T06:25:13.976 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_refresh_rate", 2024-09-19T06:25:13.976 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:13.976 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.976 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.976 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "20", 2024-09-19T06:25:13.976 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.976 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.976 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.977 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T06:25:13.977 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.977 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.977 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.977 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.977 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_starting_port": { 2024-09-19T06:25:13.977 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_starting_port", 2024-09-19T06:25:13.977 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:13.977 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.977 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.977 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4721", 2024-09-19T06:25:13.977 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.977 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.978 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.978 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T06:25:13.978 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.978 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.978 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.978 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.978 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_ptrace": { 2024-09-19T06:25:13.978 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_ptrace", 2024-09-19T06:25:13.978 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.978 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.978 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.978 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.978 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.979 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.979 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.979 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T06:25:13.979 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T06:25:13.979 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.979 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.979 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.979 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_interval": { 2024-09-19T06:25:13.979 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_interval", 2024-09-19T06:25:13.979 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:13.979 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.979 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.979 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-19T06:25:13.980 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.980 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.980 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.980 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T06:25:13.980 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.980 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.980 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.980 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.980 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_memory_target_ratio": { 2024-09-19T06:25:13.980 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T06:25:13.980 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-19T06:25:13.980 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.980 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.981 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.7", 2024-09-19T06:25:13.981 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.981 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.981 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.981 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T06:25:13.981 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.981 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.981 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.981 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.981 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm_log_destination": { 2024-09-19T06:25:13.981 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm_log_destination", 2024-09-19T06:25:13.981 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.982 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.982 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.982 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:13.982 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.982 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.982 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:13.982 INFO:teuthology.orchestra.run.smithi002.stdout: "file", 2024-09-19T06:25:13.982 INFO:teuthology.orchestra.run.smithi002.stdout: "file,syslog", 2024-09-19T06:25:13.982 INFO:teuthology.orchestra.run.smithi002.stdout: "syslog" 2024-09-19T06:25:13.982 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:13.982 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T06:25:13.982 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.982 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.983 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.983 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.983 INFO:teuthology.orchestra.run.smithi002.stdout: "cgroups_split": { 2024-09-19T06:25:13.983 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cgroups_split", 2024-09-19T06:25:13.983 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.983 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.983 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.983 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.983 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.983 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.983 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.983 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T06:25:13.983 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.984 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.984 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.984 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.984 INFO:teuthology.orchestra.run.smithi002.stdout: "config_checks_enabled": { 2024-09-19T06:25:13.984 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_checks_enabled", 2024-09-19T06:25:13.984 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.984 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.984 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.984 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:13.984 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.984 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.984 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.985 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T06:25:13.985 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.985 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.985 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.985 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.985 INFO:teuthology.orchestra.run.smithi002.stdout: "config_dashboard": { 2024-09-19T06:25:13.985 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_dashboard", 2024-09-19T06:25:13.985 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:13.985 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.985 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.985 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:13.985 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.986 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.986 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.986 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T06:25:13.986 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.986 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.986 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.986 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.986 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_alertmanager": { 2024-09-19T06:25:13.986 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_alertmanager", 2024-09-19T06:25:13.986 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.986 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.986 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.986 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T06:25:13.986 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.987 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.987 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.987 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-19T06:25:13.987 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.987 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.987 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.987 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.987 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_base": { 2024-09-19T06:25:13.987 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_base", 2024-09-19T06:25:13.987 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.987 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.987 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:13.987 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T06:25:13.988 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.988 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.988 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.988 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Container image name, without the tag", 2024-09-19T06:25:13.988 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.988 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.988 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.988 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.988 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_elasticsearch": { 2024-09-19T06:25:13.988 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_elasticsearch", 2024-09-19T06:25:13.988 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.988 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.988 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.989 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T06:25:13.989 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.989 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.989 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.989 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "elasticsearch container image", 2024-09-19T06:25:13.989 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.989 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.989 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.989 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.989 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_grafana": { 2024-09-19T06:25:13.989 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_grafana", 2024-09-19T06:25:13.989 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.989 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.990 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.990 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T06:25:13.990 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.990 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.990 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.990 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-19T06:25:13.990 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.990 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.990 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.990 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.990 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_haproxy": { 2024-09-19T06:25:13.990 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_haproxy", 2024-09-19T06:25:13.990 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.991 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.991 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.991 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T06:25:13.991 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.991 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.991 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.991 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "HAproxy container image", 2024-09-19T06:25:13.991 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.991 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.991 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.991 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.991 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_agent": { 2024-09-19T06:25:13.991 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_agent", 2024-09-19T06:25:13.992 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.992 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.992 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.992 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T06:25:13.992 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.992 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.992 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.992 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger agent container image", 2024-09-19T06:25:13.992 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.992 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.992 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.992 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.992 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_collector": { 2024-09-19T06:25:13.993 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_collector", 2024-09-19T06:25:13.993 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.993 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.993 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.993 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T06:25:13.993 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.993 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.993 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.993 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger collector container image", 2024-09-19T06:25:13.993 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.993 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.993 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.993 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.994 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_query": { 2024-09-19T06:25:13.994 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_query", 2024-09-19T06:25:13.994 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.994 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.994 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.994 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T06:25:13.994 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.994 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.994 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.994 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger query container image", 2024-09-19T06:25:13.994 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.994 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.994 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.994 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.995 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_keepalived": { 2024-09-19T06:25:13.995 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_keepalived", 2024-09-19T06:25:13.995 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.995 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.995 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.995 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T06:25:13.995 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.995 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.995 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.995 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Keepalived container image", 2024-09-19T06:25:13.995 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.995 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.995 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.996 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.996 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_loki": { 2024-09-19T06:25:13.996 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_loki", 2024-09-19T06:25:13.996 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.996 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.996 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.996 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T06:25:13.996 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.996 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.996 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.996 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Loki container image", 2024-09-19T06:25:13.996 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.996 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.997 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.997 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.997 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_node_exporter": { 2024-09-19T06:25:13.997 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_node_exporter", 2024-09-19T06:25:13.997 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.997 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.997 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.997 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T06:25:13.997 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.997 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.997 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:13.997 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-19T06:25:13.997 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:13.997 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:13.999 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:13.999 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:13.999 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_nvmeof": { 2024-09-19T06:25:13.999 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_nvmeof", 2024-09-19T06:25:13.999 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:13.999 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:13.999 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:13.999 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T06:25:13.999 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:13.999 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:13.999 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.000 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Nvme-of container image", 2024-09-19T06:25:14.000 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.000 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.000 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.000 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.000 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_prometheus": { 2024-09-19T06:25:14.000 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_prometheus", 2024-09-19T06:25:14.000 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.000 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.000 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.000 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T06:25:14.000 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.001 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.001 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.001 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-19T06:25:14.001 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.001 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.001 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.001 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.001 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_promtail": { 2024-09-19T06:25:14.001 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_promtail", 2024-09-19T06:25:14.001 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.001 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.001 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.001 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T06:25:14.001 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.002 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.002 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.002 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Promtail container image", 2024-09-19T06:25:14.002 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.002 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.002 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.002 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.002 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_samba": { 2024-09-19T06:25:14.002 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_samba", 2024-09-19T06:25:14.002 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.002 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.002 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.002 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T06:25:14.002 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.003 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.003 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.003 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Samba/SMB container image", 2024-09-19T06:25:14.003 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.003 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.003 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.003 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.003 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_snmp_gateway": { 2024-09-19T06:25:14.003 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_snmp_gateway", 2024-09-19T06:25:14.003 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.003 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.003 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.003 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T06:25:14.004 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.004 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.004 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.004 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SNMP Gateway container image", 2024-09-19T06:25:14.004 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.004 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.004 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.004 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.004 INFO:teuthology.orchestra.run.smithi002.stdout: "container_init": { 2024-09-19T06:25:14.004 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_init", 2024-09-19T06:25:14.004 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.005 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.005 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.005 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.005 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.005 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.005 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.005 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T06:25:14.005 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.005 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.005 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.005 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.005 INFO:teuthology.orchestra.run.smithi002.stdout: "daemon_cache_timeout": { 2024-09-19T06:25:14.006 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "daemon_cache_timeout", 2024-09-19T06:25:14.006 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:14.006 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.006 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.006 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-19T06:25:14.006 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.006 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.006 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.006 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T06:25:14.006 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.006 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.006 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.007 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.007 INFO:teuthology.orchestra.run.smithi002.stdout: "default_cephadm_command_timeout": { 2024-09-19T06:25:14.007 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T06:25:14.007 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.007 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.007 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.007 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "900", 2024-09-19T06:25:14.007 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.007 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.007 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.007 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T06:25:14.007 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.008 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.008 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.008 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.008 INFO:teuthology.orchestra.run.smithi002.stdout: "default_registry": { 2024-09-19T06:25:14.008 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_registry", 2024-09-19T06:25:14.008 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.008 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.008 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.008 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io", 2024-09-19T06:25:14.008 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.008 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.008 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.008 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T06:25:14.008 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.009 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.009 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.009 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.009 INFO:teuthology.orchestra.run.smithi002.stdout: "device_cache_timeout": { 2024-09-19T06:25:14.009 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_cache_timeout", 2024-09-19T06:25:14.009 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:14.009 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.009 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.009 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1800", 2024-09-19T06:25:14.009 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.009 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.009 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.010 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache device inventory", 2024-09-19T06:25:14.010 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.010 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.010 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.010 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.010 INFO:teuthology.orchestra.run.smithi002.stdout: "device_enhanced_scan": { 2024-09-19T06:25:14.010 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_enhanced_scan", 2024-09-19T06:25:14.010 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.010 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.010 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.010 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.010 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.010 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.011 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.011 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T06:25:14.011 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.011 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.011 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.011 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.011 INFO:teuthology.orchestra.run.smithi002.stdout: "facts_cache_timeout": { 2024-09-19T06:25:14.011 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "facts_cache_timeout", 2024-09-19T06:25:14.011 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:14.011 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.011 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.011 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-19T06:25:14.012 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.012 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.012 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.012 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache host facts data", 2024-09-19T06:25:14.012 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.012 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.012 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.012 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.012 INFO:teuthology.orchestra.run.smithi002.stdout: "grafana_dashboards_path": { 2024-09-19T06:25:14.012 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "grafana_dashboards_path", 2024-09-19T06:25:14.012 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.012 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.013 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.013 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T06:25:14.013 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.013 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.013 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.013 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T06:25:14.013 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.013 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.013 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.013 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.013 INFO:teuthology.orchestra.run.smithi002.stdout: "host_check_interval": { 2024-09-19T06:25:14.013 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "host_check_interval", 2024-09-19T06:25:14.013 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:14.014 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.014 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.014 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-19T06:25:14.014 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.014 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.014 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.014 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to perform a host check", 2024-09-19T06:25:14.014 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.014 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.014 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.014 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.014 INFO:teuthology.orchestra.run.smithi002.stdout: "hw_monitoring": { 2024-09-19T06:25:14.015 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hw_monitoring", 2024-09-19T06:25:14.015 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.015 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.015 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.015 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.015 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.015 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.015 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.015 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T06:25:14.015 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.015 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.015 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.015 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.016 INFO:teuthology.orchestra.run.smithi002.stdout: "inventory_list_all": { 2024-09-19T06:25:14.016 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "inventory_list_all", 2024-09-19T06:25:14.016 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.016 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.016 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.016 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.016 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.016 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.016 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.016 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T06:25:14.017 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.017 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.017 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.017 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.017 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.017 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.017 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.017 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.017 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.017 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.017 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.017 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.017 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.018 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.018 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.018 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.018 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.018 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.018 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.018 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.018 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.018 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.018 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.018 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.018 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.019 INFO:teuthology.orchestra.run.smithi002.stdout: "log_refresh_metadata": { 2024-09-19T06:25:14.019 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_refresh_metadata", 2024-09-19T06:25:14.019 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.019 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.019 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.019 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.019 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.019 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.019 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.019 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T06:25:14.019 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.019 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.020 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.020 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.020 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.020 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.020 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.020 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.020 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.020 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.020 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.020 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.020 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.020 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T06:25:14.021 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.021 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.021 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.021 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.021 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.021 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.021 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.021 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.021 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.021 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.021 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.021 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.021 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.022 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.022 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.022 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.022 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.022 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.022 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.022 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.022 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.022 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.022 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.022 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.022 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.023 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.023 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.023 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.023 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.023 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.023 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.023 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.023 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.023 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.023 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.023 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.023 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.023 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.024 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.024 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T06:25:14.024 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T06:25:14.024 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.024 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.024 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.024 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.024 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.024 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.024 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.024 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T06:25:14.024 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.025 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.025 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.025 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.025 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T06:25:14.025 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T06:25:14.025 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.025 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.025 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.025 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "*", 2024-09-19T06:25:14.025 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.025 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.025 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.025 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T06:25:14.026 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.026 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.026 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.026 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.026 INFO:teuthology.orchestra.run.smithi002.stdout: "max_count_per_host": { 2024-09-19T06:25:14.026 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_count_per_host", 2024-09-19T06:25:14.026 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.026 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.026 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.026 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T06:25:14.026 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.026 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.026 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.026 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of daemons per service per host", 2024-09-19T06:25:14.027 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.027 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.027 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.027 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.027 INFO:teuthology.orchestra.run.smithi002.stdout: "max_osd_draining_count": { 2024-09-19T06:25:14.027 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_osd_draining_count", 2024-09-19T06:25:14.027 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.027 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.027 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.027 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T06:25:14.027 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.027 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.027 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.028 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T06:25:14.028 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.028 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.028 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.028 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.028 INFO:teuthology.orchestra.run.smithi002.stdout: "migration_current": { 2024-09-19T06:25:14.028 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "migration_current", 2024-09-19T06:25:14.028 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.028 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.028 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.028 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.028 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.028 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.029 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.029 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "internal - do not modify", 2024-09-19T06:25:14.029 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.029 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.029 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.029 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.029 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-09-19T06:25:14.029 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-09-19T06:25:14.029 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.029 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.029 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.029 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "root", 2024-09-19T06:25:14.029 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.030 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.030 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.030 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm-package", 2024-09-19T06:25:14.030 INFO:teuthology.orchestra.run.smithi002.stdout: "root" 2024-09-19T06:25:14.030 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.030 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T06:25:14.030 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.030 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.030 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.030 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.030 INFO:teuthology.orchestra.run.smithi002.stdout: "oob_default_addr": { 2024-09-19T06:25:14.030 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "oob_default_addr", 2024-09-19T06:25:14.031 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.031 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.031 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.031 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "169.254.1.1", 2024-09-19T06:25:14.031 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.031 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.031 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.031 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T06:25:14.031 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.031 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.031 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.031 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.031 INFO:teuthology.orchestra.run.smithi002.stdout: "prometheus_alerts_path": { 2024-09-19T06:25:14.031 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus_alerts_path", 2024-09-19T06:25:14.032 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.032 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.032 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.032 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T06:25:14.032 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.032 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.032 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.032 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T06:25:14.032 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.032 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.032 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.033 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.033 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_insecure": { 2024-09-19T06:25:14.033 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_insecure", 2024-09-19T06:25:14.033 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.033 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.033 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.033 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.033 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.033 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.033 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.033 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T06:25:14.033 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.034 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.034 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.034 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.034 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_password": { 2024-09-19T06:25:14.034 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_password", 2024-09-19T06:25:14.034 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.034 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.034 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.034 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.034 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.034 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.034 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.034 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T06:25:14.035 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.035 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.035 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.035 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.035 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_url": { 2024-09-19T06:25:14.035 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_url", 2024-09-19T06:25:14.035 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.035 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.035 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.035 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.035 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.035 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.035 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.036 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T06:25:14.036 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.036 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.036 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.036 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.036 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_username": { 2024-09-19T06:25:14.036 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_username", 2024-09-19T06:25:14.036 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.036 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.036 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.036 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.036 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.036 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.037 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.037 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T06:25:14.037 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.037 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.037 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.037 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.037 INFO:teuthology.orchestra.run.smithi002.stdout: "secure_monitoring_stack": { 2024-09-19T06:25:14.037 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "secure_monitoring_stack", 2024-09-19T06:25:14.037 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.037 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.037 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.037 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.037 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.038 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.038 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.038 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T06:25:14.038 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.038 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.038 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.038 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.038 INFO:teuthology.orchestra.run.smithi002.stdout: "service_discovery_port": { 2024-09-19T06:25:14.038 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "service_discovery_port", 2024-09-19T06:25:14.038 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.038 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.038 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.038 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8765", 2024-09-19T06:25:14.039 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.039 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.039 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.039 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "cephadm service discovery port", 2024-09-19T06:25:14.039 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.039 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.039 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.039 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.039 INFO:teuthology.orchestra.run.smithi002.stdout: "ssh_config_file": { 2024-09-19T06:25:14.039 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssh_config_file", 2024-09-19T06:25:14.039 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.039 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.039 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.039 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.040 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.040 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.040 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.040 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T06:25:14.040 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.040 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.040 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.040 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.040 INFO:teuthology.orchestra.run.smithi002.stdout: "use_agent": { 2024-09-19T06:25:14.040 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_agent", 2024-09-19T06:25:14.040 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.040 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.041 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.041 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.041 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.041 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.041 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.041 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T06:25:14.041 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.041 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.041 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.041 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.041 INFO:teuthology.orchestra.run.smithi002.stdout: "use_repo_digest": { 2024-09-19T06:25:14.041 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_repo_digest", 2024-09-19T06:25:14.041 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.042 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.042 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.042 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.042 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.042 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.042 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.042 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T06:25:14.042 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.042 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.042 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.042 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.042 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_failed_host_check": { 2024-09-19T06:25:14.042 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_failed_host_check", 2024-09-19T06:25:14.042 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.043 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.043 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.043 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.043 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.043 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.043 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.043 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T06:25:14.043 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.043 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.043 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.043 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.043 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_daemons": { 2024-09-19T06:25:14.044 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_daemons", 2024-09-19T06:25:14.044 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.044 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.044 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.044 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.044 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.044 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.044 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.044 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T06:25:14.044 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.044 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.044 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.044 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.045 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_hosts": { 2024-09-19T06:25:14.045 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_hosts", 2024-09-19T06:25:14.045 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.045 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.045 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.045 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.045 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.045 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.045 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.045 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T06:25:14.045 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.045 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.045 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.046 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.046 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.046 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.046 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.046 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crash", 2024-09-19T06:25:14.046 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.046 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.046 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.046 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.046 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.046 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.046 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.047 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.047 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.047 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.047 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.047 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.047 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.047 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.047 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.047 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.047 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.047 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.047 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.047 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.047 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.048 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.048 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.048 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.048 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.048 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.048 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.048 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.048 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.048 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.048 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.048 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.048 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.049 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.049 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.049 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.049 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.049 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.049 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.049 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.049 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.049 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.049 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.049 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.049 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.049 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.050 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.050 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.050 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.050 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.050 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.050 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.050 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.050 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.050 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.050 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.050 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.050 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.050 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.050 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.051 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.051 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.051 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.051 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.051 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.051 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.051 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.051 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.051 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.051 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.051 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.051 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.052 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.052 INFO:teuthology.orchestra.run.smithi002.stdout: "retain_interval": { 2024-09-19T06:25:14.052 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retain_interval", 2024-09-19T06:25:14.052 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:14.052 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.052 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.052 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "31536000", 2024-09-19T06:25:14.052 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.052 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.052 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.052 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T06:25:14.052 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.053 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.053 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.053 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.053 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_recent_interval": { 2024-09-19T06:25:14.053 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_recent_interval", 2024-09-19T06:25:14.053 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:14.053 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.053 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.053 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1209600", 2024-09-19T06:25:14.053 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.053 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.053 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.053 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T06:25:14.054 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.054 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.054 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.054 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.054 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.054 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.054 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.054 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dashboard", 2024-09-19T06:25:14.054 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.054 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.054 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.055 INFO:teuthology.orchestra.run.smithi002.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T06:25:14.055 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T06:25:14.055 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.055 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.055 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.055 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T06:25:14.055 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.055 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.055 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.055 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.055 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.055 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.055 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.056 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.056 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T06:25:14.056 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T06:25:14.056 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.056 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.056 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.056 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.056 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.056 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.056 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.056 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.056 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.056 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.057 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.057 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.057 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T06:25:14.057 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T06:25:14.057 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.057 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.057 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.057 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.057 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.057 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.057 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.057 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.058 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.058 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.058 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.058 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.058 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_ENABLED": { 2024-09-19T06:25:14.058 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T06:25:14.058 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.058 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.058 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.058 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.058 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.058 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.058 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.059 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.059 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.059 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.059 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.059 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.059 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T06:25:14.059 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T06:25:14.059 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.059 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.059 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.059 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.059 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.059 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.060 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.060 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.060 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.060 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.060 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.060 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.060 INFO:teuthology.orchestra.run.smithi002.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T06:25:14.060 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T06:25:14.060 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.060 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.060 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.060 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.060 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.061 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.061 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.061 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.061 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.061 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.061 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.061 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.061 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T06:25:14.061 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T06:25:14.061 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.061 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.062 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.062 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.062 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.062 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.062 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.062 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.062 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.062 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.062 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.062 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.062 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T06:25:14.062 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T06:25:14.062 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.063 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.063 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.063 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.063 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.063 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.063 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.063 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.063 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.063 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.063 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.063 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.063 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T06:25:14.063 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T06:25:14.064 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.064 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.064 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.064 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.064 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.064 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.064 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.064 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.064 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.064 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.064 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.064 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.065 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T06:25:14.065 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T06:25:14.065 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.065 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.065 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.065 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.065 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.065 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.065 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.065 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.065 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.065 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.065 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.066 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.066 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T06:25:14.066 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T06:25:14.066 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.066 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.066 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.066 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.066 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.066 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.066 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.066 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.066 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.066 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.067 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.067 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.067 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T06:25:14.067 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T06:25:14.067 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.067 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.067 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.067 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.067 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.067 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.067 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.067 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.067 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.067 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.068 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.068 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.068 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T06:25:14.068 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T06:25:14.068 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.068 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.068 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.068 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.068 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.068 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.068 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.068 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.069 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.069 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.069 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.069 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.069 INFO:teuthology.orchestra.run.smithi002.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T06:25:14.069 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T06:25:14.069 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.069 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.069 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.069 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.069 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.069 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.069 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.070 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.070 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.070 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.070 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.070 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.070 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T06:25:14.070 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T06:25:14.070 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.070 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.070 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.070 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-19T06:25:14.070 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.070 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.071 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.071 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.071 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.071 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.071 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.071 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.071 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T06:25:14.071 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T06:25:14.071 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.071 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.071 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.071 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.071 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.071 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.072 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.072 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.072 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.072 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.072 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.072 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.072 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_URL": { 2024-09-19T06:25:14.072 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_URL", 2024-09-19T06:25:14.072 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.072 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.072 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.072 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.072 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.073 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.073 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.073 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.073 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.073 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.073 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.073 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.073 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T06:25:14.073 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T06:25:14.073 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.073 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.073 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.074 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-19T06:25:14.074 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.074 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.074 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.074 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.074 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.074 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.074 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.074 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.074 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T06:25:14.074 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T06:25:14.074 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.074 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.075 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.075 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.075 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.075 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.075 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.075 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.075 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.075 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.075 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.075 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.075 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T06:25:14.075 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T06:25:14.076 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.076 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.076 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.076 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.076 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.076 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.076 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.076 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.076 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.076 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.076 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.076 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.076 INFO:teuthology.orchestra.run.smithi002.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T06:25:14.077 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T06:25:14.077 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.077 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.077 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.077 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.077 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.077 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.077 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.077 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.077 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.077 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.077 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.077 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.078 INFO:teuthology.orchestra.run.smithi002.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T06:25:14.078 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T06:25:14.078 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.078 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.078 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.078 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.078 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.078 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.078 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.078 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.078 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.078 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.078 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.079 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.079 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T06:25:14.079 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T06:25:14.079 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.079 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.079 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.079 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.079 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.079 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.079 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.079 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.079 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.079 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.080 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.080 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.080 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T06:25:14.080 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T06:25:14.080 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.080 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.080 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.080 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.080 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.080 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.080 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.080 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.080 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.081 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.081 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.081 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.081 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T06:25:14.081 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T06:25:14.081 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.081 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.081 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.081 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.081 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.081 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.082 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.082 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.082 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.082 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.082 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.082 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.082 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T06:25:14.082 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T06:25:14.082 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.082 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.082 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.082 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.083 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.083 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.083 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.083 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.083 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.083 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.083 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.083 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.083 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T06:25:14.083 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T06:25:14.083 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.083 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.083 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.084 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.084 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.084 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.084 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.084 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.084 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.084 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.084 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.084 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.084 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T06:25:14.084 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T06:25:14.084 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.084 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.085 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.085 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.085 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.085 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.085 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.085 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.085 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.085 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.085 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.085 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.085 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T06:25:14.085 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T06:25:14.085 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.085 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.086 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.086 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.086 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.086 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.086 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.086 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.086 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.086 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.086 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.086 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.086 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T06:25:14.086 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T06:25:14.086 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.087 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.087 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.087 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.087 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.087 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.087 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.087 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.087 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.087 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.087 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.087 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.087 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T06:25:14.087 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T06:25:14.087 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.088 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.088 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.088 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.088 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.088 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.088 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.088 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.088 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.088 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.088 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.088 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.088 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T06:25:14.088 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T06:25:14.089 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.089 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.089 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.089 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.089 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.089 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.089 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.089 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.089 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.089 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.089 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.089 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.090 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T06:25:14.090 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T06:25:14.090 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.090 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.090 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.090 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T06:25:14.090 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.090 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.090 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.090 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.090 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.090 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.090 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.091 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.091 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T06:25:14.091 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T06:25:14.091 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.091 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.091 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.091 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T06:25:14.091 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.091 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.091 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.091 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.091 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.091 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.092 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.092 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.092 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T06:25:14.092 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T06:25:14.092 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.092 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.092 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.092 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8", 2024-09-19T06:25:14.092 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.092 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.092 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.092 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.092 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.093 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.093 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.093 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.093 INFO:teuthology.orchestra.run.smithi002.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T06:25:14.093 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T06:25:14.093 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.093 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.093 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.093 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "45", 2024-09-19T06:25:14.093 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.093 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.093 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.093 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.094 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.094 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.094 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.094 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.094 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T06:25:14.094 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T06:25:14.094 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.094 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.094 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.094 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.094 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.094 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.094 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.095 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.095 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.095 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.095 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.095 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.095 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T06:25:14.095 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T06:25:14.095 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.095 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.095 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.095 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-19T06:25:14.095 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.095 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.095 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.096 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.096 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.096 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.096 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.096 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.096 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T06:25:14.096 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T06:25:14.096 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.096 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.096 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.096 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.097 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.097 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.097 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.097 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.097 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.097 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.097 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.097 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.097 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T06:25:14.097 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T06:25:14.097 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.097 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.097 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.098 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.098 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.098 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.098 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.098 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.098 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.098 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.098 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.098 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.098 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T06:25:14.098 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T06:25:14.098 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.098 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.099 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.099 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-19T06:25:14.099 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.099 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.099 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.099 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.099 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.099 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.099 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.099 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.099 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T06:25:14.099 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T06:25:14.099 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.099 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.100 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.100 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T06:25:14.100 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.100 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.100 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.100 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.100 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.100 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.100 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.100 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.100 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T06:25:14.100 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T06:25:14.101 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.101 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.101 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.101 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-19T06:25:14.101 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.101 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.101 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.101 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.101 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.101 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.101 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.101 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.101 INFO:teuthology.orchestra.run.smithi002.stdout: "cross_origin_url": { 2024-09-19T06:25:14.102 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cross_origin_url", 2024-09-19T06:25:14.102 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.102 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.102 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.102 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.102 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.102 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.102 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.102 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.102 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.102 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.102 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.102 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.102 INFO:teuthology.orchestra.run.smithi002.stdout: "crt_file": { 2024-09-19T06:25:14.103 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crt_file", 2024-09-19T06:25:14.103 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.103 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.103 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.103 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.103 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.103 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.103 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.103 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.103 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.103 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.103 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.103 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.104 INFO:teuthology.orchestra.run.smithi002.stdout: "debug": { 2024-09-19T06:25:14.104 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "debug", 2024-09-19T06:25:14.104 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.104 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.104 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.104 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.104 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.104 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.104 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.104 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable/disable debug options", 2024-09-19T06:25:14.104 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.104 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.105 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.105 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.105 INFO:teuthology.orchestra.run.smithi002.stdout: "jwt_token_ttl": { 2024-09-19T06:25:14.105 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "jwt_token_ttl", 2024-09-19T06:25:14.105 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.105 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.105 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.105 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "28800", 2024-09-19T06:25:14.105 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.105 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.105 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.105 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.105 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.106 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.106 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.106 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.106 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-09-19T06:25:14.106 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-09-19T06:25:14.106 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.106 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.106 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.106 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.106 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.106 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.106 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.106 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.106 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.107 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.107 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.107 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.107 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.107 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.107 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.107 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.107 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.107 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.107 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.107 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.107 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.107 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.108 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.108 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.108 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.108 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.108 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.108 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.108 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.108 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.108 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.108 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.108 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.108 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.108 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.109 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.109 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.109 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.109 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.109 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.109 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.109 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.109 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.109 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.109 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.109 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.109 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.109 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.110 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.110 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.110 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.110 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.110 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.110 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.110 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.110 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.110 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.110 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.110 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.110 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.110 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.111 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.111 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.111 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.111 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.111 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.111 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.111 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.111 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.111 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.111 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.111 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.111 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.111 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.111 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.112 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.112 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.112 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.112 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.112 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.112 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.112 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.112 INFO:teuthology.orchestra.run.smithi002.stdout: "motd": { 2024-09-19T06:25:14.112 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "motd", 2024-09-19T06:25:14.112 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.112 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.112 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.113 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.113 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.113 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.113 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.113 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "The message of the day", 2024-09-19T06:25:14.113 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.113 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.113 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.113 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.113 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect_resolve_ip_addr": { 2024-09-19T06:25:14.113 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T06:25:14.113 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.113 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.114 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.114 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.114 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.114 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.114 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.114 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.114 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.114 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.114 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.114 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.114 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-19T06:25:14.114 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-19T06:25:14.114 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.115 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.115 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.115 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-09-19T06:25:14.115 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.115 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.115 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.115 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.115 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.115 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.115 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.115 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.115 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-19T06:25:14.115 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-19T06:25:14.116 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.116 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.116 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.116 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8080", 2024-09-19T06:25:14.116 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.116 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.116 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.116 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.116 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.116 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.116 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.116 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.116 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-09-19T06:25:14.116 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-09-19T06:25:14.117 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.117 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.117 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.117 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.117 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.117 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.117 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.117 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.117 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.117 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.117 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.117 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.117 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl_server_port": { 2024-09-19T06:25:14.118 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl_server_port", 2024-09-19T06:25:14.118 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.118 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.118 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.118 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8443", 2024-09-19T06:25:14.118 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.118 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.118 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.118 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.118 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.118 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.119 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.119 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.119 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-09-19T06:25:14.119 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-09-19T06:25:14.119 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.119 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.119 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.119 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "redirect", 2024-09-19T06:25:14.119 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.119 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.119 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.119 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.120 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect" 2024-09-19T06:25:14.120 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.120 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.120 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.120 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.120 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.120 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.120 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-09-19T06:25:14.120 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-09-19T06:25:14.120 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.120 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.120 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.121 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-09-19T06:25:14.121 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-09-19T06:25:14.121 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-09-19T06:25:14.121 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.121 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.121 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.121 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.121 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.121 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.121 INFO:teuthology.orchestra.run.smithi002.stdout: "url_prefix": { 2024-09-19T06:25:14.121 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url_prefix", 2024-09-19T06:25:14.121 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.121 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.122 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.122 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.122 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.122 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.122 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.122 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.122 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.122 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.122 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.122 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.122 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.122 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.122 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.123 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "devicehealth", 2024-09-19T06:25:14.123 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.123 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.123 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.123 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_monitoring": { 2024-09-19T06:25:14.123 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_monitoring", 2024-09-19T06:25:14.123 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.123 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.123 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.123 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.123 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.123 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.123 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.124 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "monitor device health metrics", 2024-09-19T06:25:14.124 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.124 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.124 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.124 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.124 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.124 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.124 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.124 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.124 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.124 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.125 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.125 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.125 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.125 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.125 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.125 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.125 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.125 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.125 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.125 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.125 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.125 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.125 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.126 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.126 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.126 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.126 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.126 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.126 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.126 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.126 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.126 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.126 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.126 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.126 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.126 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.127 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.127 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.127 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.127 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.127 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.127 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.127 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.127 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.127 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.127 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.127 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.127 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.127 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.128 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.128 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.128 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.128 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.128 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.128 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.128 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.128 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.128 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.128 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.128 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.128 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.128 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.129 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.129 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.129 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.129 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.129 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.129 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.129 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.129 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.129 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.129 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.129 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.129 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.129 INFO:teuthology.orchestra.run.smithi002.stdout: "mark_out_threshold": { 2024-09-19T06:25:14.129 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mark_out_threshold", 2024-09-19T06:25:14.130 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:14.130 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.130 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.130 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2419200", 2024-09-19T06:25:14.130 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.130 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.130 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.130 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T06:25:14.130 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.130 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.130 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.130 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.130 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": { 2024-09-19T06:25:14.131 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_name", 2024-09-19T06:25:14.131 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.131 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.131 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.131 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "device_health_metrics", 2024-09-19T06:25:14.131 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.131 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.131 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.131 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T06:25:14.131 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.131 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.131 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.131 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.131 INFO:teuthology.orchestra.run.smithi002.stdout: "retention_period": { 2024-09-19T06:25:14.132 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retention_period", 2024-09-19T06:25:14.132 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:14.132 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.132 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.132 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15552000", 2024-09-19T06:25:14.132 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.132 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.132 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.132 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain device health metrics", 2024-09-19T06:25:14.132 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.132 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.132 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.132 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.133 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_frequency": { 2024-09-19T06:25:14.133 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_frequency", 2024-09-19T06:25:14.133 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:14.133 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.133 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.133 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-09-19T06:25:14.133 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.133 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.133 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.133 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T06:25:14.133 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.133 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.134 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.134 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.134 INFO:teuthology.orchestra.run.smithi002.stdout: "self_heal": { 2024-09-19T06:25:14.134 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "self_heal", 2024-09-19T06:25:14.134 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.134 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.134 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.134 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.134 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.134 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.134 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.134 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T06:25:14.134 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.135 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.135 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.135 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.135 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-19T06:25:14.135 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-19T06:25:14.135 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:14.135 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.135 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.135 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-19T06:25:14.135 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.135 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.135 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.135 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T06:25:14.135 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.136 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.136 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.136 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.136 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_threshold": { 2024-09-19T06:25:14.136 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_threshold", 2024-09-19T06:25:14.136 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:14.136 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.136 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.136 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7257600", 2024-09-19T06:25:14.136 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.136 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.136 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.137 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T06:25:14.137 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.137 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.137 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.137 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.137 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.137 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.137 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.137 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "diskprediction_local", 2024-09-19T06:25:14.137 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.137 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.137 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.137 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.137 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.138 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.138 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.138 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.138 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.138 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.138 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.138 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.138 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.138 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.138 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.138 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.138 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.138 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.139 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.139 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.139 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.139 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.139 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.139 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.139 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.139 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.139 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.139 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.139 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.139 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.139 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.140 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.140 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.140 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.140 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.140 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.140 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.140 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.140 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.140 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.140 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.140 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.140 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.140 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.141 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.141 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.141 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.141 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.141 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.141 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.141 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.141 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.141 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.141 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.141 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.141 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.141 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.141 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.142 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.142 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.142 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.142 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.142 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.142 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.142 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.142 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.142 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.142 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.142 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.142 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.142 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.143 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.143 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.143 INFO:teuthology.orchestra.run.smithi002.stdout: "predict_interval": { 2024-09-19T06:25:14.143 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predict_interval", 2024-09-19T06:25:14.143 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.143 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.143 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.143 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-09-19T06:25:14.143 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.143 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.143 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.143 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.143 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.144 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.144 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.144 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.144 INFO:teuthology.orchestra.run.smithi002.stdout: "predictor_model": { 2024-09-19T06:25:14.144 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predictor_model", 2024-09-19T06:25:14.144 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.144 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.144 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.144 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "prophetstor", 2024-09-19T06:25:14.144 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.144 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.144 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.144 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.145 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.145 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.145 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.145 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.145 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-19T06:25:14.145 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-19T06:25:14.145 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.145 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.145 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.145 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-19T06:25:14.145 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.145 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.145 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.146 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.146 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.146 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.146 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.146 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.146 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.146 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.146 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.146 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "influx", 2024-09-19T06:25:14.146 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": false, 2024-09-19T06:25:14.146 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "influxdb python module not found", 2024-09-19T06:25:14.146 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.146 INFO:teuthology.orchestra.run.smithi002.stdout: "batch_size": { 2024-09-19T06:25:14.146 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "batch_size", 2024-09-19T06:25:14.147 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.147 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.147 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.147 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5000", 2024-09-19T06:25:14.147 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.147 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.147 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.147 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T06:25:14.147 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.147 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.147 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.147 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.148 INFO:teuthology.orchestra.run.smithi002.stdout: "database": { 2024-09-19T06:25:14.148 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "database", 2024-09-19T06:25:14.148 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.148 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.148 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.148 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "ceph", 2024-09-19T06:25:14.148 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.148 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.148 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.148 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T06:25:14.148 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.148 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.149 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.149 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.149 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": { 2024-09-19T06:25:14.149 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hostname", 2024-09-19T06:25:14.149 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.149 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.149 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.149 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.149 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.149 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.149 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.149 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server hostname", 2024-09-19T06:25:14.149 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.150 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.150 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.150 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.150 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-19T06:25:14.150 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-19T06:25:14.150 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:14.150 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.150 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.150 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "30", 2024-09-19T06:25:14.150 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "5", 2024-09-19T06:25:14.150 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.150 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.151 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T06:25:14.151 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.151 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.151 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.151 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.151 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.151 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.151 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.151 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.151 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.151 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.151 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.151 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.151 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.152 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.152 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.152 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.152 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.152 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.152 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.152 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.152 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.152 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.152 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.152 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.152 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.152 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.153 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.153 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.153 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.153 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.153 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.153 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.153 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.153 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.153 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.153 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.153 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.153 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.153 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.154 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.154 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.154 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.154 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.154 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.154 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.154 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.154 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.154 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.154 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.154 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.154 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.154 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.155 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.155 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.155 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.155 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.155 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.155 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.155 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.155 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.155 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.155 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.155 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.155 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.155 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.156 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.156 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.156 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.156 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.156 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.156 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.156 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.156 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.156 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.156 INFO:teuthology.orchestra.run.smithi002.stdout: "password": { 2024-09-19T06:25:14.156 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "password", 2024-09-19T06:25:14.156 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.156 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.157 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.157 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.157 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.157 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.157 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.157 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "password of InfluxDB server user", 2024-09-19T06:25:14.157 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.157 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.157 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.157 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.157 INFO:teuthology.orchestra.run.smithi002.stdout: "port": { 2024-09-19T06:25:14.157 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "port", 2024-09-19T06:25:14.157 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.157 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.158 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.158 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8086", 2024-09-19T06:25:14.158 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.158 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.158 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.158 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server port", 2024-09-19T06:25:14.158 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.158 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.158 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.158 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.158 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-09-19T06:25:14.158 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-09-19T06:25:14.158 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.159 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.159 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.159 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "false", 2024-09-19T06:25:14.159 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.159 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.159 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.159 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T06:25:14.159 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.159 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.159 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.159 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.159 INFO:teuthology.orchestra.run.smithi002.stdout: "threads": { 2024-09-19T06:25:14.159 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threads", 2024-09-19T06:25:14.159 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.160 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.160 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.160 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-19T06:25:14.160 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-19T06:25:14.160 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "32", 2024-09-19T06:25:14.160 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.160 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T06:25:14.160 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.160 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.160 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.160 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.160 INFO:teuthology.orchestra.run.smithi002.stdout: "username": { 2024-09-19T06:25:14.160 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "username", 2024-09-19T06:25:14.161 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.161 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.161 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.161 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.161 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.161 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.161 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.161 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "username of InfluxDB server user", 2024-09-19T06:25:14.161 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.161 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.161 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.161 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.162 INFO:teuthology.orchestra.run.smithi002.stdout: "verify_ssl": { 2024-09-19T06:25:14.162 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "verify_ssl", 2024-09-19T06:25:14.162 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.162 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.162 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.162 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "true", 2024-09-19T06:25:14.162 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.162 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.162 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.162 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T06:25:14.162 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.162 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.162 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.163 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.163 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.163 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.163 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.163 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "insights", 2024-09-19T06:25:14.163 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.163 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.163 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.163 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.163 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.163 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.163 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.163 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.164 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.164 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.164 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.164 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.164 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.164 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.164 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.164 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.164 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.164 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.164 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.164 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.164 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.165 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.165 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.165 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.165 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.165 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.165 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.165 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.165 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.165 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.165 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.165 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.165 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.166 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.166 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.166 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.166 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.166 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.166 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.166 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.166 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.166 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.166 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.166 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.166 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.166 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.167 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.167 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.167 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.167 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.167 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.167 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.167 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.167 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.167 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.167 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.167 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.167 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.167 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.168 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.168 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.168 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.168 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.168 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.168 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.168 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.168 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.168 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.168 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.168 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.168 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.168 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.169 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.169 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.169 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.169 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.169 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "iostat", 2024-09-19T06:25:14.169 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.169 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.169 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.169 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.169 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.169 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.169 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.169 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.170 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.170 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.170 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.170 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.170 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.170 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.170 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.170 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.170 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.170 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.170 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.170 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.170 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.171 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.171 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.171 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.171 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.171 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.171 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.171 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.171 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.171 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.171 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.171 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.171 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.171 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.171 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.172 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.172 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.172 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.172 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.172 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.172 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.172 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.172 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.172 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.172 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.172 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.172 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.172 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.172 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.173 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.173 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.173 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.173 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.173 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.173 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.173 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.173 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.173 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.173 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.173 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.173 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.173 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.174 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.174 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.174 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.174 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.174 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.174 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.174 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.174 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.174 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.174 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.174 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.174 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.174 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.175 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.175 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "k8sevents", 2024-09-19T06:25:14.175 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.175 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.175 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.175 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_event_retention_days": { 2024-09-19T06:25:14.175 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ceph_event_retention_days", 2024-09-19T06:25:14.175 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.175 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.175 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.175 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7", 2024-09-19T06:25:14.175 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.175 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.175 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.176 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T06:25:14.176 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.176 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.176 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.176 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.176 INFO:teuthology.orchestra.run.smithi002.stdout: "config_check_secs": { 2024-09-19T06:25:14.176 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_check_secs", 2024-09-19T06:25:14.176 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.176 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.176 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.176 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T06:25:14.177 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "10", 2024-09-19T06:25:14.177 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.177 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.177 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T06:25:14.177 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.177 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.177 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.177 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.177 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.177 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.177 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.177 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.177 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.178 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.178 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.178 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.178 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.178 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.178 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.178 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.178 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.178 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.178 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.178 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.178 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.178 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.179 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.179 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.179 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.179 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.179 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.179 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.179 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.179 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.179 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.179 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.179 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.179 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.179 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.179 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.180 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.180 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.180 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.180 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.180 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.180 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.180 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.180 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.180 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.180 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.180 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.180 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.180 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.181 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.181 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.181 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.181 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.181 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.181 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.181 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.181 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.181 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.181 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.181 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.181 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.181 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.182 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.182 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.182 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.182 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.182 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.182 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.182 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.182 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.182 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.182 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.182 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.182 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.182 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.182 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.183 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.183 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "localpool", 2024-09-19T06:25:14.183 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.183 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.183 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.183 INFO:teuthology.orchestra.run.smithi002.stdout: "failure_domain": { 2024-09-19T06:25:14.183 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "failure_domain", 2024-09-19T06:25:14.183 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.183 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.183 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.183 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "host", 2024-09-19T06:25:14.183 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.183 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.184 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.184 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "failure domain for any created local pool", 2024-09-19T06:25:14.184 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T06:25:14.184 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.184 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.184 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.184 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.184 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.184 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.184 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.184 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.184 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.184 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.185 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.185 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.185 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.185 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.185 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.185 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.185 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.185 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.185 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.185 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.185 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.185 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.185 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.186 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.186 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.186 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.186 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.186 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.186 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.186 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.186 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.186 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.186 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.186 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.186 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.186 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.186 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.187 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.187 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.187 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.187 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.187 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.187 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.187 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.187 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.187 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.187 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.187 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.187 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.187 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.187 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.187 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.188 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.188 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.188 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.188 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.188 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.188 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.188 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.188 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.188 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.188 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.188 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.188 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.188 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.189 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.189 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.189 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.189 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.189 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.189 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.189 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.189 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.189 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": { 2024-09-19T06:25:14.189 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_size", 2024-09-19T06:25:14.189 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.189 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.189 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.190 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.190 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.190 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.190 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.190 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default min_size for any created local pool", 2024-09-19T06:25:14.190 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T06:25:14.190 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.190 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.190 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.190 INFO:teuthology.orchestra.run.smithi002.stdout: "num_rep": { 2024-09-19T06:25:14.190 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "num_rep", 2024-09-19T06:25:14.190 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.191 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.191 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.191 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3", 2024-09-19T06:25:14.191 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.191 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.191 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.191 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default replica count for any created local pool", 2024-09-19T06:25:14.191 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.191 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.191 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.192 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.192 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": { 2024-09-19T06:25:14.192 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_num", 2024-09-19T06:25:14.192 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.192 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.192 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.192 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "128", 2024-09-19T06:25:14.192 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.192 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.192 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.192 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T06:25:14.192 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.193 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.193 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.193 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.193 INFO:teuthology.orchestra.run.smithi002.stdout: "prefix": { 2024-09-19T06:25:14.193 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prefix", 2024-09-19T06:25:14.193 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.193 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.193 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.193 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.193 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.193 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.193 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.194 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name prefix for any created local pool", 2024-09-19T06:25:14.194 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.194 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.194 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.194 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.194 INFO:teuthology.orchestra.run.smithi002.stdout: "subtree": { 2024-09-19T06:25:14.194 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "subtree", 2024-09-19T06:25:14.194 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.194 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.194 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.194 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "rack", 2024-09-19T06:25:14.194 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.194 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.195 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.195 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T06:25:14.195 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T06:25:14.195 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.195 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.195 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.195 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.195 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.195 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.195 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mds_autoscaler", 2024-09-19T06:25:14.195 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.195 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.196 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.196 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.196 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.196 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.196 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.196 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.196 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.196 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.196 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.196 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.196 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.196 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.197 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.197 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.197 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.197 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.197 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.197 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.197 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.197 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.197 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.197 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.197 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.197 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.198 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.198 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.198 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.198 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.198 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.198 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.198 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.198 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.198 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.198 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.198 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.198 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.198 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.199 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.199 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.199 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.199 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.199 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.199 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.199 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.199 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.199 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.199 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.199 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.199 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.199 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.199 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.200 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.200 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.200 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.200 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.200 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.200 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.200 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.200 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.200 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.200 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.200 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.200 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.200 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.201 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.201 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.201 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.201 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.201 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.201 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.201 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.201 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.201 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.201 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.201 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirroring", 2024-09-19T06:25:14.201 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.201 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.202 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.202 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.202 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.202 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.202 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.202 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.202 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.202 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.202 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.202 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.202 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.202 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.203 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.203 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.203 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.203 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.203 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.203 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.203 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.203 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.203 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.203 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.203 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.203 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.203 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.203 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.204 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.204 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.204 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.204 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.204 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.204 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.204 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.204 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.204 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.204 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.204 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.204 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.205 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.205 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.205 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.205 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.205 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.205 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.205 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.205 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.205 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.205 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.205 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.205 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.205 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.205 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.206 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.206 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.206 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.206 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.206 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.206 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.206 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.206 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.206 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.206 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.206 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.206 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.207 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.207 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.207 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.207 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.207 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.207 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.207 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.207 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.207 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.207 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.207 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "nfs", 2024-09-19T06:25:14.207 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.207 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.208 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.208 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.208 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.208 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.208 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.208 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.208 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.208 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.208 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.208 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.208 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.208 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.208 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.209 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.209 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.209 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.209 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.209 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.209 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.209 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.209 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.209 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.209 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.209 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.209 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.209 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.210 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.210 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.210 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.210 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.210 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.210 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.210 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.210 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.210 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.210 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.210 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.210 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.210 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.211 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.211 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.211 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.211 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.211 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.211 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.211 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.211 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.211 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.211 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.211 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.211 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.211 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.212 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.212 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.212 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.212 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.212 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.212 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.212 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.212 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.212 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.212 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.212 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.212 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.213 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.213 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.213 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.213 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.213 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.213 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.213 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.213 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.213 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.213 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.213 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-09-19T06:25:14.213 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.213 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.213 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.214 INFO:teuthology.orchestra.run.smithi002.stdout: "fail_fs": { 2024-09-19T06:25:14.214 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "fail_fs", 2024-09-19T06:25:14.214 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.214 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.214 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.214 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.214 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.214 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.214 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.214 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T06:25:14.214 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.214 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.215 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.215 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.215 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.215 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.215 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.215 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.215 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.215 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.215 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.215 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.215 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.215 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.215 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.216 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.216 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.216 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.216 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.216 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.216 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.216 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.216 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.216 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.216 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.216 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.216 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.216 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.217 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.217 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.217 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.217 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.217 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.217 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.217 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.217 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.217 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.217 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.217 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.217 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.218 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.218 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.218 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.218 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.218 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.218 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.218 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.218 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.218 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.218 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.218 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.218 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.218 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.219 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.219 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.219 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.219 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.219 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.219 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.219 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.219 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.219 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.219 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.219 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.219 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.219 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.220 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.220 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.220 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.220 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.220 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.220 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.220 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.220 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.220 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator": { 2024-09-19T06:25:14.220 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-09-19T06:25:14.220 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.220 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.221 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.221 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.221 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.221 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.221 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.221 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm", 2024-09-19T06:25:14.221 INFO:teuthology.orchestra.run.smithi002.stdout: "rook", 2024-09-19T06:25:14.221 INFO:teuthology.orchestra.run.smithi002.stdout: "test_orchestrator" 2024-09-19T06:25:14.221 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.221 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Orchestrator backend", 2024-09-19T06:25:14.221 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.221 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.222 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.222 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.222 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.222 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.222 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.222 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_perf_query", 2024-09-19T06:25:14.222 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.222 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.222 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.222 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.222 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.222 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.222 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.223 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.223 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.223 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.223 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.223 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.223 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.223 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.223 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.223 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.223 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.223 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.224 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.224 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.224 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.224 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.224 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.224 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.224 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.224 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.224 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.224 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.224 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.224 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.225 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.225 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.225 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.225 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.225 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.225 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.225 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.225 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.225 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.225 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.225 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.225 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.225 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.226 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.226 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.226 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.226 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.226 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.226 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.226 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.226 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.226 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.226 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.226 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.226 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.226 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.227 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.227 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.227 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.227 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.227 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.227 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.227 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.227 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.227 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.227 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.227 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.227 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.228 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.228 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.228 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.228 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.228 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.228 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.228 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.228 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.228 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_support", 2024-09-19T06:25:14.228 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.228 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.228 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.228 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.229 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.229 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.229 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.229 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.229 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.229 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.229 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.229 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.229 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.229 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.229 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.229 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.230 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.230 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.230 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.230 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.230 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.230 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.230 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.230 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.230 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.230 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.230 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.230 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.230 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.230 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.231 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.231 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.231 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.231 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.231 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.231 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.231 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.231 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.231 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.231 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.231 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.231 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.232 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.232 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.232 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.232 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.232 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.232 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.232 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.232 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.232 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.232 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.232 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.232 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.232 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.233 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.233 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.233 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.233 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.233 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.233 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.233 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.233 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.233 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.233 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.233 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.233 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.233 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.234 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.234 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.234 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.234 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.234 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.234 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.234 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.234 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.234 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_autoscaler", 2024-09-19T06:25:14.234 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.234 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.234 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.234 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.235 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.235 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.235 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.235 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.235 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.235 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.235 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.235 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.235 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.235 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.235 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.235 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.235 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.236 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.236 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.236 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.236 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.236 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.236 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.236 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.236 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.236 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.236 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.236 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.236 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.237 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.237 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.237 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.237 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.237 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.237 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.237 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.237 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.237 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.237 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.237 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.238 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.238 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.238 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.238 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.238 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.238 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.238 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.238 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.238 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.238 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.238 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.239 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.239 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.239 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.239 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.239 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.239 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.239 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.239 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.239 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.239 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.239 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.239 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.239 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.240 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.240 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.240 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.240 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.240 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.240 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.240 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.240 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.240 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.240 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-19T06:25:14.240 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-19T06:25:14.241 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:14.241 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.241 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.241 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-19T06:25:14.241 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.241 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.241 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.241 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.241 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.241 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.241 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.241 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.241 INFO:teuthology.orchestra.run.smithi002.stdout: "threshold": { 2024-09-19T06:25:14.242 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threshold", 2024-09-19T06:25:14.242 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-19T06:25:14.242 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.242 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.242 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-09-19T06:25:14.242 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1.0", 2024-09-19T06:25:14.242 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.242 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.242 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "scaling threshold", 2024-09-19T06:25:14.242 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T06:25:14.242 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.242 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.243 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.243 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.243 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.243 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.243 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "progress", 2024-09-19T06:25:14.243 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.243 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.243 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.243 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_pg_recovery_event": { 2024-09-19T06:25:14.243 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_pg_recovery_event", 2024-09-19T06:25:14.243 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.243 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.243 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.244 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.244 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.244 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.244 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.244 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T06:25:14.244 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.244 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.244 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.244 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.244 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-09-19T06:25:14.244 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-09-19T06:25:14.244 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.244 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.245 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.245 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.245 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.245 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.245 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.245 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.245 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.245 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.245 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.245 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.245 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.245 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.246 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.246 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.246 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.246 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.246 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.246 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.246 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.246 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.246 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.246 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.246 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.246 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.246 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.246 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.247 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.247 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.247 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.247 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.247 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.247 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.247 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.247 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.247 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.247 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.247 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.247 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.247 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.248 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.248 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.248 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.248 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.248 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.248 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.248 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.248 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.248 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.248 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.248 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.248 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.248 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.249 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.249 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.249 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.249 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.249 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.249 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.249 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.249 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.249 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.249 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.249 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.249 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.249 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.250 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.250 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.250 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.250 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.250 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.250 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.250 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.250 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.250 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.250 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.250 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.250 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.250 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.250 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.251 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.251 INFO:teuthology.orchestra.run.smithi002.stdout: "max_completed_events": { 2024-09-19T06:25:14.251 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_completed_events", 2024-09-19T06:25:14.251 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.251 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.251 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.251 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "50", 2024-09-19T06:25:14.251 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.251 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.251 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.251 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "number of past completed events to remember", 2024-09-19T06:25:14.251 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.251 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.252 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.252 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.252 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-19T06:25:14.252 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-19T06:25:14.252 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:14.252 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.252 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.252 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-19T06:25:14.252 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.252 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.252 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.252 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long the module is going to sleep", 2024-09-19T06:25:14.253 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.253 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.253 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.253 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.253 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.253 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.253 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.253 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus", 2024-09-19T06:25:14.253 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.253 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.254 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.254 INFO:teuthology.orchestra.run.smithi002.stdout: "cache": { 2024-09-19T06:25:14.254 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cache", 2024-09-19T06:25:14.254 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.254 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.254 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.254 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.254 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.254 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.254 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.254 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.254 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.254 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.255 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.255 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.255 INFO:teuthology.orchestra.run.smithi002.stdout: "exclude_perf_counters": { 2024-09-19T06:25:14.255 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "exclude_perf_counters", 2024-09-19T06:25:14.255 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.255 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.255 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.255 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.255 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.255 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.255 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.255 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T06:25:14.255 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T06:25:14.256 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.256 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.256 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.256 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.256 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.256 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.256 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.256 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.256 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.256 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.256 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.256 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.256 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.257 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.257 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.257 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.257 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.257 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.257 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.257 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.257 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.257 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.257 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.257 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.257 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.257 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.258 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.258 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.258 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.258 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.258 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.258 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.258 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.258 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.258 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.258 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.258 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.258 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.259 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.259 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.259 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.259 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.259 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.259 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.259 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.259 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.259 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.259 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.259 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.259 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.259 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.260 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.260 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.260 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.260 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.260 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.260 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.260 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.260 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.260 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.260 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.260 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.260 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.260 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.261 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.261 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.261 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.261 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.261 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.261 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.261 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.261 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.261 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.261 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools": { 2024-09-19T06:25:14.261 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools", 2024-09-19T06:25:14.261 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.261 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.261 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.262 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.262 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.262 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.262 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.262 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.262 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.262 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.262 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.262 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.262 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T06:25:14.262 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T06:25:14.262 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.262 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.263 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.263 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "300", 2024-09-19T06:25:14.263 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.263 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.263 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.263 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.263 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.263 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.263 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.263 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.263 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_interval": { 2024-09-19T06:25:14.263 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_interval", 2024-09-19T06:25:14.263 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-19T06:25:14.264 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.264 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.264 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15.0", 2024-09-19T06:25:14.264 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.264 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.264 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.264 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.264 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.264 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.264 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.264 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.265 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-19T06:25:14.265 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-19T06:25:14.265 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.265 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.265 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.265 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-09-19T06:25:14.265 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.265 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.265 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.265 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T06:25:14.265 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.265 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.265 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.266 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.266 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-19T06:25:14.266 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-19T06:25:14.266 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.266 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.266 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.266 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "9283", 2024-09-19T06:25:14.266 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.266 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.266 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.266 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T06:25:14.267 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.267 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.267 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.267 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.267 INFO:teuthology.orchestra.run.smithi002.stdout: "stale_cache_strategy": { 2024-09-19T06:25:14.267 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stale_cache_strategy", 2024-09-19T06:25:14.267 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.267 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.267 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.267 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "log", 2024-09-19T06:25:14.267 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.268 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.268 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.268 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.268 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.268 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.268 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.268 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.268 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-09-19T06:25:14.268 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-09-19T06:25:14.268 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.268 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.269 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.269 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "default", 2024-09-19T06:25:14.269 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.269 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.269 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.269 INFO:teuthology.orchestra.run.smithi002.stdout: "default", 2024-09-19T06:25:14.269 INFO:teuthology.orchestra.run.smithi002.stdout: "error" 2024-09-19T06:25:14.269 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.269 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.269 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.269 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.269 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.269 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.270 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-09-19T06:25:14.270 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-09-19T06:25:14.270 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.270 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.270 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.270 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-09-19T06:25:14.270 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-09-19T06:25:14.270 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-09-19T06:25:14.270 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.270 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.270 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.270 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.270 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.271 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.271 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.271 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.271 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.271 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_support", 2024-09-19T06:25:14.271 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.271 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.271 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.271 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.271 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.271 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.271 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.271 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.272 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.272 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.272 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.272 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.272 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.272 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.272 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.272 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.272 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.272 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.272 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.272 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.273 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.273 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.273 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.273 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.273 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.273 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.273 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.273 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.273 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.273 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.273 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.273 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.273 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.274 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.274 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.274 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.274 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.274 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.274 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.274 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.274 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.274 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.274 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.274 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.274 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.274 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.275 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.275 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.275 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.275 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.275 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.275 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.275 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.275 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.275 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.275 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.275 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.275 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.275 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.276 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.276 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.276 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.276 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.276 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.276 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.276 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.276 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.276 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.276 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.276 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.276 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.277 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.277 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.277 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_snap_create": { 2024-09-19T06:25:14.277 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_snap_create", 2024-09-19T06:25:14.277 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.277 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.277 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.277 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T06:25:14.277 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.277 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.277 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.277 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.277 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.278 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.278 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.278 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.278 INFO:teuthology.orchestra.run.smithi002.stdout: "mirror_snapshot_schedule": { 2024-09-19T06:25:14.278 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T06:25:14.278 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.278 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.278 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.278 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.278 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.278 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.278 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.279 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.279 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.279 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.279 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.279 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.279 INFO:teuthology.orchestra.run.smithi002.stdout: "trash_purge_schedule": { 2024-09-19T06:25:14.279 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "trash_purge_schedule", 2024-09-19T06:25:14.279 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.279 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.279 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.279 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.279 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.279 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.280 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.280 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.280 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.280 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.280 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.280 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.280 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.280 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.280 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.280 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "restful", 2024-09-19T06:25:14.280 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.280 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.280 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.281 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_auth": { 2024-09-19T06:25:14.281 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_auth", 2024-09-19T06:25:14.281 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.281 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.281 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.281 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.281 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.281 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.281 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.281 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.281 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.281 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.281 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.282 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.282 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-09-19T06:25:14.282 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-09-19T06:25:14.282 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.282 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.282 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.282 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.282 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.282 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.282 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.282 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.282 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.283 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.283 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.283 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.283 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.283 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.283 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.283 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.283 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.283 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.283 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.283 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.283 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.283 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.284 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.284 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.284 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.284 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.284 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.284 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.284 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.284 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.284 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.284 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.284 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.284 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.285 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.285 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.285 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.285 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.285 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.285 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.285 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.285 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.285 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.285 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.285 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.285 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.285 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.286 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.286 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.286 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.286 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.286 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.286 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.286 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.286 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.286 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.286 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.286 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.286 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.286 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.286 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.287 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.287 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.287 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.287 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.287 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.287 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.287 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.287 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.287 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.287 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.287 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.288 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.288 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.288 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.288 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.288 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.288 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.288 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.288 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.288 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.288 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.288 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-19T06:25:14.288 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-19T06:25:14.289 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.289 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.289 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.289 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.289 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.289 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.289 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.289 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.289 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.289 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.289 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.289 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.289 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-19T06:25:14.290 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-19T06:25:14.290 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.290 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.290 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.290 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.290 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.290 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.290 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.290 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.290 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.290 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.290 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.290 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.290 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.291 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.291 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.291 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rgw", 2024-09-19T06:25:14.291 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.291 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.291 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.291 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.291 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.291 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.291 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.291 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.291 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.291 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.292 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.292 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.292 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.292 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.292 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.292 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.292 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.292 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.292 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.292 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.292 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.292 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.292 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.293 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.293 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.293 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.293 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.293 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.293 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.293 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.293 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.293 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.293 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.293 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.293 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.293 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.294 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.294 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.294 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.294 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.294 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.294 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.294 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.294 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.294 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.294 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.294 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.294 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.294 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.295 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.295 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.295 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.295 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.295 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.295 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.295 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.295 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.295 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.295 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.295 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.295 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.295 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.296 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.296 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.296 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.296 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.296 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.296 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.296 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.296 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.296 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.296 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.296 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.296 INFO:teuthology.orchestra.run.smithi002.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T06:25:14.297 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T06:25:14.297 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.297 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.297 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.297 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-19T06:25:14.297 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.297 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.297 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.297 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T06:25:14.297 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.297 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.297 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.298 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.298 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.298 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.298 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.298 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rook", 2024-09-19T06:25:14.298 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.298 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.298 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.298 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.298 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.298 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.298 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.298 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.299 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.299 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.299 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.299 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.299 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.299 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.299 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.299 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.299 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.299 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.299 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.299 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.300 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.300 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.300 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.300 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.300 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.300 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.300 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.300 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.300 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.300 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.300 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.300 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.301 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.301 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.301 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.301 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.301 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.301 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.301 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.301 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.301 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.301 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.301 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.301 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.301 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.302 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.302 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.302 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.302 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.302 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.302 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.302 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.302 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.302 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.302 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.302 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.302 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.303 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.303 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.303 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.303 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.303 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.303 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.303 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.303 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.303 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.303 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.303 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.303 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.303 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.303 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.304 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.304 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.304 INFO:teuthology.orchestra.run.smithi002.stdout: "storage_class": { 2024-09-19T06:25:14.304 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "storage_class", 2024-09-19T06:25:14.304 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.304 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.304 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.304 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "local", 2024-09-19T06:25:14.304 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.304 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.304 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.304 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T06:25:14.305 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.305 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.305 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.305 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.305 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.305 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.305 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.305 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "selftest", 2024-09-19T06:25:14.305 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.305 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.305 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.305 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.305 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.305 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.306 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.306 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.306 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.306 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.306 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.306 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.306 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.306 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.306 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.306 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.306 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.306 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.306 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.307 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.307 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.307 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.307 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.307 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.307 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.307 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.307 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.307 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.307 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.307 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.307 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.308 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.308 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.308 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.308 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.308 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.308 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.308 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.308 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.308 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.308 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.308 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.309 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.309 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.309 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.309 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.309 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.309 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.309 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.309 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.309 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.309 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.310 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.310 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.310 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.310 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.310 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.310 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.310 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.310 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.310 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.310 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.310 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.311 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.311 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.311 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.311 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.311 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.311 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.311 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.311 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.311 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.311 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.311 INFO:teuthology.orchestra.run.smithi002.stdout: "roption1": { 2024-09-19T06:25:14.312 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption1", 2024-09-19T06:25:14.312 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.312 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.312 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.312 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.312 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.312 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.312 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.312 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.312 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.312 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.312 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.312 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.313 INFO:teuthology.orchestra.run.smithi002.stdout: "roption2": { 2024-09-19T06:25:14.313 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption2", 2024-09-19T06:25:14.313 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.313 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.313 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.313 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "xyz", 2024-09-19T06:25:14.313 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.313 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.313 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.313 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.313 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.313 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.314 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.314 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.314 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption1": { 2024-09-19T06:25:14.314 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption1", 2024-09-19T06:25:14.314 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.314 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.314 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.314 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.314 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.314 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.314 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.315 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.315 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.315 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.315 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.315 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.315 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption2": { 2024-09-19T06:25:14.315 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption2", 2024-09-19T06:25:14.315 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.315 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.315 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.315 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.315 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.316 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.316 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.316 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.316 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.316 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.316 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.316 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.316 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption3": { 2024-09-19T06:25:14.316 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption3", 2024-09-19T06:25:14.316 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-19T06:25:14.316 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.317 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.317 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.317 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.317 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.317 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.317 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.317 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.317 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.317 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.317 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.317 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption4": { 2024-09-19T06:25:14.317 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption4", 2024-09-19T06:25:14.317 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.318 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.318 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.318 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.318 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.318 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.318 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.318 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.318 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.318 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.318 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.318 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.318 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption5": { 2024-09-19T06:25:14.318 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption5", 2024-09-19T06:25:14.319 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.319 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.319 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.319 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.319 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.319 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.319 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.319 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.319 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.319 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.319 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.319 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.319 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption6": { 2024-09-19T06:25:14.320 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption6", 2024-09-19T06:25:14.320 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.320 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.320 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.320 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.320 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.320 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.320 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.320 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.320 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.320 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.320 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.321 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.321 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption7": { 2024-09-19T06:25:14.321 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption7", 2024-09-19T06:25:14.321 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.321 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.321 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.321 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.321 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-19T06:25:14.321 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "42", 2024-09-19T06:25:14.321 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.321 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.321 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.321 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.322 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.322 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.322 INFO:teuthology.orchestra.run.smithi002.stdout: "testkey": { 2024-09-19T06:25:14.322 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testkey", 2024-09-19T06:25:14.322 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.322 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.322 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.322 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.322 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.322 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.322 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.322 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.322 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.323 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.323 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.323 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.323 INFO:teuthology.orchestra.run.smithi002.stdout: "testlkey": { 2024-09-19T06:25:14.323 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testlkey", 2024-09-19T06:25:14.323 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.323 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.323 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.323 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.323 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.323 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.323 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.323 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.324 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.324 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.324 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.324 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.324 INFO:teuthology.orchestra.run.smithi002.stdout: "testnewline": { 2024-09-19T06:25:14.324 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testnewline", 2024-09-19T06:25:14.324 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.324 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.324 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.324 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.324 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.324 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.324 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.325 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.325 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.325 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.325 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.325 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.325 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.325 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.325 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.325 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snap_schedule", 2024-09-19T06:25:14.325 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.325 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.325 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.326 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_m_granularity": { 2024-09-19T06:25:14.326 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_m_granularity", 2024-09-19T06:25:14.326 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.326 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.326 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.326 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.326 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.326 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.326 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.326 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T06:25:14.326 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.326 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.326 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.327 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.327 INFO:teuthology.orchestra.run.smithi002.stdout: "dump_on_update": { 2024-09-19T06:25:14.327 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dump_on_update", 2024-09-19T06:25:14.327 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.327 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.327 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.327 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.327 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.327 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.327 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.327 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "dump database to debug log on update", 2024-09-19T06:25:14.327 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.327 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.328 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.328 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.328 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.328 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.328 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.328 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.328 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.328 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.328 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.328 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.328 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.328 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.329 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.329 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.329 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.329 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.329 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.329 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.329 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.329 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.329 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.329 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.329 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.329 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.330 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.330 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.330 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.330 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.330 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.330 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.330 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.330 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.330 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.330 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.330 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.330 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.330 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.331 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.331 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.331 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.331 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.331 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.331 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.331 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.331 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.331 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.331 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.331 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.331 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.331 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.332 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.332 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.332 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.332 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.332 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.332 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.332 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.332 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.333 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.333 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.333 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.333 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.333 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.333 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.333 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.333 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.333 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.333 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.333 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.334 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.334 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.334 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.334 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.334 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.334 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.334 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stats", 2024-09-19T06:25:14.334 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.334 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.334 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.334 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.334 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.335 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.335 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.335 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.335 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.335 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.335 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.335 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.335 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.335 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.335 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.335 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.335 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.336 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.336 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.336 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.336 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.336 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.336 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.336 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.336 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.336 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.336 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.336 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.336 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.337 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.337 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.337 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.337 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.337 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.337 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.337 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.337 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.337 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.337 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.337 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.337 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.337 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.338 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.338 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.338 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.338 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.338 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.338 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.338 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.338 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.338 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.338 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.338 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.338 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.338 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.339 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.339 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.339 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.339 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.339 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.339 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.339 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.339 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.339 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.339 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.339 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.339 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.340 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.340 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.340 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.340 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.340 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.340 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.340 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.340 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.340 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.340 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "status", 2024-09-19T06:25:14.340 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.340 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.340 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.341 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.341 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.341 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.341 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.341 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.341 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.341 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.341 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.341 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.341 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.341 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.341 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.341 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.341 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.342 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.342 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.342 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.342 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.342 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.342 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.342 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.342 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.342 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.342 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.342 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.342 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.342 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.343 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.343 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.343 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.343 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.343 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.343 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.343 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.343 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.343 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.343 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.343 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.343 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.343 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.344 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.344 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.344 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.344 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.344 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.344 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.344 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.344 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.344 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.344 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.344 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.344 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.344 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.345 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.345 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.345 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.345 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.345 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.345 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.345 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.345 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.345 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.345 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.345 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.345 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.346 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.346 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.346 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.346 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.346 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.346 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.346 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.346 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.346 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telegraf", 2024-09-19T06:25:14.346 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.346 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.346 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.346 INFO:teuthology.orchestra.run.smithi002.stdout: "address": { 2024-09-19T06:25:14.347 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "address", 2024-09-19T06:25:14.347 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.347 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.347 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.347 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T06:25:14.347 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.347 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.347 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.347 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.347 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.347 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.347 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.347 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.347 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-19T06:25:14.348 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-19T06:25:14.348 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:14.348 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.348 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.348 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15", 2024-09-19T06:25:14.348 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.348 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.348 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.348 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.348 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.348 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.348 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.349 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.349 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.349 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.349 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.349 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.349 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.349 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.349 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.349 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.349 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.349 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.349 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.349 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.350 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.350 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.350 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.350 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.350 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.350 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.350 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.350 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.350 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.350 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.350 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.350 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.350 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.350 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.351 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.351 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.351 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.351 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.351 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.351 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.351 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.351 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.351 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.351 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.351 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.351 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.352 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.352 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.352 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.352 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.352 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.352 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.352 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.352 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.352 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.352 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.352 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.352 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.352 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.353 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.353 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.353 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.353 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.353 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.353 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.353 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.353 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.353 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.353 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.353 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.353 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.353 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.354 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.354 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.354 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.354 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.354 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.354 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.354 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.354 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.354 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.354 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telemetry", 2024-09-19T06:25:14.354 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.354 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.354 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.354 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_basic": { 2024-09-19T06:25:14.355 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_basic", 2024-09-19T06:25:14.355 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.355 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.355 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.355 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.355 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.355 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.355 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.355 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T06:25:14.355 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.355 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.355 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.355 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.356 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_crash": { 2024-09-19T06:25:14.356 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_crash", 2024-09-19T06:25:14.356 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.356 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.356 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.356 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.356 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.356 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.356 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.356 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T06:25:14.356 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.356 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.356 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.356 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.357 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_device": { 2024-09-19T06:25:14.357 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_device", 2024-09-19T06:25:14.357 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.357 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.357 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.357 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.357 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.357 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.357 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.357 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T06:25:14.357 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.357 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.357 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.358 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.358 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_ident": { 2024-09-19T06:25:14.358 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_ident", 2024-09-19T06:25:14.358 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.358 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.358 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.358 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.358 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.358 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.358 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.358 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T06:25:14.358 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.358 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.358 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.359 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.359 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_perf": { 2024-09-19T06:25:14.359 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_perf", 2024-09-19T06:25:14.359 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.359 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.359 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.359 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.359 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.359 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.359 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.359 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T06:25:14.359 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.360 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.360 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.360 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.360 INFO:teuthology.orchestra.run.smithi002.stdout: "contact": { 2024-09-19T06:25:14.360 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "contact", 2024-09-19T06:25:14.360 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.360 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.360 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.360 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.360 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.360 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.360 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.360 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.361 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.361 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.361 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.361 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.361 INFO:teuthology.orchestra.run.smithi002.stdout: "description": { 2024-09-19T06:25:14.361 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "description", 2024-09-19T06:25:14.361 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.361 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.361 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.361 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.361 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.361 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.361 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.362 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.362 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.362 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.362 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.362 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.362 INFO:teuthology.orchestra.run.smithi002.stdout: "device_url": { 2024-09-19T06:25:14.362 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_url", 2024-09-19T06:25:14.362 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.362 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.362 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.362 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T06:25:14.362 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.362 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.363 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.363 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.363 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.363 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.363 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.363 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.363 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-09-19T06:25:14.363 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-09-19T06:25:14.363 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.364 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.364 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.364 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.364 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.364 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.364 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.364 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.364 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.364 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.364 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.364 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.365 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-19T06:25:14.365 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-19T06:25:14.365 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.365 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.365 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.365 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "24", 2024-09-19T06:25:14.365 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "8", 2024-09-19T06:25:14.365 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.365 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.365 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.366 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.366 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.366 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.366 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.366 INFO:teuthology.orchestra.run.smithi002.stdout: "last_opt_revision": { 2024-09-19T06:25:14.366 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "last_opt_revision", 2024-09-19T06:25:14.366 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.366 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.366 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.366 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1", 2024-09-19T06:25:14.367 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.367 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.367 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.367 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.367 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.367 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.367 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.367 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.367 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard": { 2024-09-19T06:25:14.367 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard", 2024-09-19T06:25:14.367 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.368 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.368 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.368 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.368 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.368 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.368 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.368 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.368 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.368 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.368 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.369 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.369 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard_description": { 2024-09-19T06:25:14.369 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard_description", 2024-09-19T06:25:14.369 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.369 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.369 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.369 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.369 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.369 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.369 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.369 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.369 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.369 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.370 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.370 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.370 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.370 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.370 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.370 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.370 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.370 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.370 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.370 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.370 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.370 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.370 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.371 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.371 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.371 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.371 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.371 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.371 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.371 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.371 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.371 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.371 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.371 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.371 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.371 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.372 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.372 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.372 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.372 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.372 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.372 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.372 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.372 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.372 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.372 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.372 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.372 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.372 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.373 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.373 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.373 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.373 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.373 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.373 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.373 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.373 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.373 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.373 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.373 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.373 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.373 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.373 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.374 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.374 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.374 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.374 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.374 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.374 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.374 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.374 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.374 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.374 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.374 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.374 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.375 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.375 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.375 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.375 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.375 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.375 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.375 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.375 INFO:teuthology.orchestra.run.smithi002.stdout: "organization": { 2024-09-19T06:25:14.375 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "organization", 2024-09-19T06:25:14.375 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.375 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.375 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.375 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.376 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.376 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.376 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.376 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.376 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.376 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.376 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.376 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.376 INFO:teuthology.orchestra.run.smithi002.stdout: "proxy": { 2024-09-19T06:25:14.376 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "proxy", 2024-09-19T06:25:14.376 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.376 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.377 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.377 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.377 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.377 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.377 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.377 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.377 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.377 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.377 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.377 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.377 INFO:teuthology.orchestra.run.smithi002.stdout: "url": { 2024-09-19T06:25:14.377 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url", 2024-09-19T06:25:14.377 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.378 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.378 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.378 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T06:25:14.378 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.378 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.378 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.378 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.378 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.378 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.378 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.378 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.378 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.379 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.379 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.379 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "test_orchestrator", 2024-09-19T06:25:14.379 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.379 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.379 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.379 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.379 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.379 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.379 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.379 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.379 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.379 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.380 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.380 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.380 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.380 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.380 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.380 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.380 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.380 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.380 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.380 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.380 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.380 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.380 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.381 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.381 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.381 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.381 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.381 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.381 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.381 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.381 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.381 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.381 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.381 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.381 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.381 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.382 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.382 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.382 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.382 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.382 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.382 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.382 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.382 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.382 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.382 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.382 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.382 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.382 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.383 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.383 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.383 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.383 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.383 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.383 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.383 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.383 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.383 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.383 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.383 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.383 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.383 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.384 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.384 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.384 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.384 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.384 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.384 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.384 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.384 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.384 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.384 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.384 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.384 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.384 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.385 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.385 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "volumes", 2024-09-19T06:25:14.385 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.385 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.385 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.385 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.385 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.385 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.385 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.385 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.385 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.385 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.385 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.386 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.386 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.386 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.386 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.386 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.386 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.386 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.386 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.386 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.386 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.386 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.386 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.386 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.387 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.387 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.387 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.387 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.387 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.387 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.387 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.387 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.387 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.387 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.387 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.387 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.387 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.388 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.388 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.388 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.388 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.388 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.388 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.388 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.388 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.388 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.388 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.388 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.388 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.388 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.389 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.389 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.389 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.389 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.389 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.389 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.389 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.389 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.389 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.389 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.389 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.389 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.389 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.390 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.390 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.390 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.390 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.390 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.390 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.390 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.390 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.390 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.390 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.390 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_clones": { 2024-09-19T06:25:14.390 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_clones", 2024-09-19T06:25:14.391 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.391 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.391 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.391 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4", 2024-09-19T06:25:14.391 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.391 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.391 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.391 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T06:25:14.391 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.391 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.391 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.391 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.392 INFO:teuthology.orchestra.run.smithi002.stdout: "periodic_async_work": { 2024-09-19T06:25:14.392 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "periodic_async_work", 2024-09-19T06:25:14.392 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.392 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.392 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.392 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.392 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.392 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.392 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.392 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Periodically check for async work", 2024-09-19T06:25:14.392 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.392 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.393 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.393 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.393 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_delay": { 2024-09-19T06:25:14.393 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_delay", 2024-09-19T06:25:14.393 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.393 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.393 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.393 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-19T06:25:14.393 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.393 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.393 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.393 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T06:25:14.394 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.394 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.394 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.394 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.394 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_no_wait": { 2024-09-19T06:25:14.394 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T06:25:14.394 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.394 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.394 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.394 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.394 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.394 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.395 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.395 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T06:25:14.395 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.395 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.395 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.395 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.395 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.395 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.395 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.395 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix", 2024-09-19T06:25:14.395 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.395 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.395 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.395 INFO:teuthology.orchestra.run.smithi002.stdout: "discovery_interval": { 2024-09-19T06:25:14.396 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "discovery_interval", 2024-09-19T06:25:14.396 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-19T06:25:14.396 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.396 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.396 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "100", 2024-09-19T06:25:14.396 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.396 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.396 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.396 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.396 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.396 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.396 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.397 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.397 INFO:teuthology.orchestra.run.smithi002.stdout: "identifier": { 2024-09-19T06:25:14.397 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "identifier", 2024-09-19T06:25:14.397 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.397 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.397 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.397 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.397 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.397 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.397 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.397 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.397 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.397 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.398 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.398 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.398 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-19T06:25:14.398 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-19T06:25:14.398 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:14.398 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.398 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.398 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-19T06:25:14.398 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.398 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.398 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.398 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.398 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.399 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.399 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.399 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.399 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.399 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.399 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.399 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.399 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.399 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.399 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.399 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.399 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.399 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.400 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.400 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.400 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.400 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.400 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.400 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.400 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.400 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.400 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.400 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.400 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.400 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.400 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.401 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.401 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.401 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.401 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.401 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.401 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.401 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.401 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.401 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.401 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.401 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.401 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.401 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.402 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.402 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.402 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.402 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.402 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.402 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.402 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.402 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.402 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.402 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.403 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.403 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.403 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.403 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.403 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.403 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.403 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.403 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.403 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.403 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.403 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.403 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.404 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.404 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.404 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.404 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.404 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.404 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.404 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.404 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.404 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.404 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.404 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.404 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.405 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_host": { 2024-09-19T06:25:14.405 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_host", 2024-09-19T06:25:14.405 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.405 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.405 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.405 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.405 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.405 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.405 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.405 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.405 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.405 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.406 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.406 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.406 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_port": { 2024-09-19T06:25:14.406 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_port", 2024-09-19T06:25:14.406 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.406 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.406 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.406 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10051", 2024-09-19T06:25:14.406 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.406 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.406 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.407 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.407 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.407 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.407 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.407 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.407 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_sender": { 2024-09-19T06:25:14.407 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_sender", 2024-09-19T06:25:14.407 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.407 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.407 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.407 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T06:25:14.407 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.407 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.408 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.408 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.408 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.408 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.408 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.408 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.408 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.408 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.408 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-19T06:25:14.408 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.409 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.409 INFO:teuthology.orchestra.run.smithi002.stdout: "modules": [ 2024-09-19T06:25:14.409 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm", 2024-09-19T06:25:14.409 INFO:teuthology.orchestra.run.smithi002.stdout: "dashboard", 2024-09-19T06:25:14.409 INFO:teuthology.orchestra.run.smithi002.stdout: "iostat", 2024-09-19T06:25:14.409 INFO:teuthology.orchestra.run.smithi002.stdout: "nfs", 2024-09-19T06:25:14.409 INFO:teuthology.orchestra.run.smithi002.stdout: "restful", 2024-09-19T06:25:14.409 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_schedule" 2024-09-19T06:25:14.409 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.409 INFO:teuthology.orchestra.run.smithi002.stdout: "available_modules": [ 2024-09-19T06:25:14.409 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.409 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "alerts", 2024-09-19T06:25:14.410 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.410 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.410 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.410 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-19T06:25:14.410 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-19T06:25:14.410 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:14.410 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.410 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.410 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-19T06:25:14.410 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.410 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.410 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.410 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T06:25:14.411 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.411 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.411 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.411 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.411 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.411 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.411 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.411 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.411 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.411 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.411 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.411 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.411 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.411 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.412 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.412 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.412 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.412 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.412 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.412 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.412 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.412 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.412 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.412 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.412 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.412 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.413 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.413 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.413 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.413 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.413 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.413 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.413 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.413 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.413 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.413 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.413 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.413 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.413 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.414 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.414 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.414 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.414 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.414 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.414 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.414 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.414 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.414 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.414 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.414 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.414 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.415 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.415 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.415 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.415 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.415 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.415 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.415 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.415 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.415 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.415 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.415 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.415 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.415 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.416 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.416 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.416 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.416 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.416 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.416 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.416 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.416 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.416 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.416 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.416 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_destination": { 2024-09-19T06:25:14.416 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_destination", 2024-09-19T06:25:14.417 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.417 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.417 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.417 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.417 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.417 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.417 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.417 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email address to send alerts to", 2024-09-19T06:25:14.417 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.417 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.417 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.417 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.417 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_from_name": { 2024-09-19T06:25:14.418 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_from_name", 2024-09-19T06:25:14.418 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.418 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.418 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.418 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "Ceph", 2024-09-19T06:25:14.418 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.418 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.418 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.418 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email From: name", 2024-09-19T06:25:14.418 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.418 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.418 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.418 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.419 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_host": { 2024-09-19T06:25:14.419 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_host", 2024-09-19T06:25:14.419 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.419 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.419 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.419 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.419 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.419 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.419 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.419 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP server", 2024-09-19T06:25:14.419 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.419 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.419 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.419 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.420 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_password": { 2024-09-19T06:25:14.420 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_password", 2024-09-19T06:25:14.420 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.420 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.420 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.420 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.420 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.420 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.420 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.420 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Password to authenticate with", 2024-09-19T06:25:14.420 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.420 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.420 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.421 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.421 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_port": { 2024-09-19T06:25:14.421 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_port", 2024-09-19T06:25:14.421 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.421 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.421 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.421 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "465", 2024-09-19T06:25:14.421 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.421 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.421 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.421 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP port", 2024-09-19T06:25:14.421 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.421 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.422 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.422 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.422 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_sender": { 2024-09-19T06:25:14.422 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_sender", 2024-09-19T06:25:14.422 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.422 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.422 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.422 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.422 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.422 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.422 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.422 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP envelope sender", 2024-09-19T06:25:14.422 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.422 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.423 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.423 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.423 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_ssl": { 2024-09-19T06:25:14.423 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_ssl", 2024-09-19T06:25:14.423 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.423 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.423 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.423 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.423 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.423 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.423 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.423 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T06:25:14.423 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.423 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.424 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.424 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.424 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_user": { 2024-09-19T06:25:14.424 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_user", 2024-09-19T06:25:14.424 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.424 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.424 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.424 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.424 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.424 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.424 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.424 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "User to authenticate as", 2024-09-19T06:25:14.424 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.425 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.425 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.425 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.425 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.425 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.425 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.425 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "balancer", 2024-09-19T06:25:14.425 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.425 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.425 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.425 INFO:teuthology.orchestra.run.smithi002.stdout: "active": { 2024-09-19T06:25:14.425 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "active", 2024-09-19T06:25:14.426 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.426 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.426 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.426 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.426 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.426 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.426 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.426 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T06:25:14.426 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.426 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.426 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.426 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.426 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_time": { 2024-09-19T06:25:14.427 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_time", 2024-09-19T06:25:14.427 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.427 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.427 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.427 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0000", 2024-09-19T06:25:14.427 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.427 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.427 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.427 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T06:25:14.427 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T06:25:14.427 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.428 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.428 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.428 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_weekday": { 2024-09-19T06:25:14.428 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_weekday", 2024-09-19T06:25:14.428 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-19T06:25:14.428 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.428 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.428 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-19T06:25:14.428 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-09-19T06:25:14.428 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-09-19T06:25:14.428 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.428 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T06:25:14.428 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T06:25:14.429 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.429 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.429 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.429 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_max_iterations": { 2024-09-19T06:25:14.429 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_max_iterations", 2024-09-19T06:25:14.429 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-19T06:25:14.429 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.429 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.429 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "25", 2024-09-19T06:25:14.429 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-19T06:25:14.429 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "250", 2024-09-19T06:25:14.430 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.430 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T06:25:14.430 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.430 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.430 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.430 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.430 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_metrics": { 2024-09-19T06:25:14.430 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_metrics", 2024-09-19T06:25:14.430 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.430 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.430 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.430 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T06:25:14.431 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.431 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.431 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.431 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T06:25:14.431 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T06:25:14.431 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.431 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.431 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.431 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_step": { 2024-09-19T06:25:14.431 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_step", 2024-09-19T06:25:14.431 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-19T06:25:14.431 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.431 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.432 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.5", 2024-09-19T06:25:14.432 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0.001", 2024-09-19T06:25:14.432 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "0.999", 2024-09-19T06:25:14.432 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.432 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "aggressiveness of optimization", 2024-09-19T06:25:14.432 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T06:25:14.432 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.432 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.432 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.432 INFO:teuthology.orchestra.run.smithi002.stdout: "end_time": { 2024-09-19T06:25:14.432 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_time", 2024-09-19T06:25:14.432 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.433 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.433 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.433 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2359", 2024-09-19T06:25:14.433 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.433 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.433 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.433 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T06:25:14.433 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T06:25:14.433 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.433 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.433 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.434 INFO:teuthology.orchestra.run.smithi002.stdout: "end_weekday": { 2024-09-19T06:25:14.434 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_weekday", 2024-09-19T06:25:14.434 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-19T06:25:14.434 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.434 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.434 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-19T06:25:14.434 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-09-19T06:25:14.434 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-09-19T06:25:14.434 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.434 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T06:25:14.434 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T06:25:14.434 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.434 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.435 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.435 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.435 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.435 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.435 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.435 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.435 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.435 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.435 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.435 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.435 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.435 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.435 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.435 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.436 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.436 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.436 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.436 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.436 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.436 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.436 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.436 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.436 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.436 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.436 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.437 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.437 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.437 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.437 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.437 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.437 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.437 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.437 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.437 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.437 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.437 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.437 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.437 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.438 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.438 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.438 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.438 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.438 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.438 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.438 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.438 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.438 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.438 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.438 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.438 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.438 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.439 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.439 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.439 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.439 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.439 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.439 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.439 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.439 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.439 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.439 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.439 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.439 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.439 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.440 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.440 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.440 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.440 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.440 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.440 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.440 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.440 INFO:teuthology.orchestra.run.smithi002.stdout: "min_score": { 2024-09-19T06:25:14.440 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_score", 2024-09-19T06:25:14.440 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-19T06:25:14.440 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.440 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.440 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-19T06:25:14.441 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.441 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.441 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.441 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T06:25:14.441 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.441 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.441 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.441 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.441 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-09-19T06:25:14.441 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-09-19T06:25:14.441 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.441 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.441 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.442 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "upmap", 2024-09-19T06:25:14.442 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.442 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.442 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.442 INFO:teuthology.orchestra.run.smithi002.stdout: "crush-compat", 2024-09-19T06:25:14.442 INFO:teuthology.orchestra.run.smithi002.stdout: "none", 2024-09-19T06:25:14.442 INFO:teuthology.orchestra.run.smithi002.stdout: "read", 2024-09-19T06:25:14.442 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap", 2024-09-19T06:25:14.442 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap-read" 2024-09-19T06:25:14.442 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.442 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Balancer mode", 2024-09-19T06:25:14.442 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.443 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.443 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.443 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.443 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_ids": { 2024-09-19T06:25:14.443 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_ids", 2024-09-19T06:25:14.443 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.443 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.443 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.443 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.443 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.443 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.443 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.443 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T06:25:14.444 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.444 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.444 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.444 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.444 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-19T06:25:14.444 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-19T06:25:14.444 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:14.444 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.444 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.444 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-19T06:25:14.444 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.444 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.445 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.445 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T06:25:14.445 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.445 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.445 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.445 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.445 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_deviation": { 2024-09-19T06:25:14.445 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_deviation", 2024-09-19T06:25:14.445 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.445 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.445 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.445 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-19T06:25:14.445 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-19T06:25:14.446 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.446 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.446 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T06:25:14.446 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T06:25:14.446 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.446 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.446 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.446 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_optimizations": { 2024-09-19T06:25:14.446 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_optimizations", 2024-09-19T06:25:14.446 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-19T06:25:14.446 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.446 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.446 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T06:25:14.447 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.447 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.447 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.447 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T06:25:14.447 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.447 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.447 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.447 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.447 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.447 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.447 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.447 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm", 2024-09-19T06:25:14.447 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.448 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.448 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.448 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_down_multiplier": { 2024-09-19T06:25:14.448 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_down_multiplier", 2024-09-19T06:25:14.448 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-19T06:25:14.448 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.448 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.448 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-09-19T06:25:14.448 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.448 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.448 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.448 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T06:25:14.449 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.449 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.449 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.449 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.449 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_refresh_rate": { 2024-09-19T06:25:14.449 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_refresh_rate", 2024-09-19T06:25:14.449 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:14.449 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.449 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.449 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "20", 2024-09-19T06:25:14.449 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.449 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.449 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.450 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T06:25:14.450 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.450 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.450 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.450 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.450 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_starting_port": { 2024-09-19T06:25:14.450 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_starting_port", 2024-09-19T06:25:14.450 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.450 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.450 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.450 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4721", 2024-09-19T06:25:14.450 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.450 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.451 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.451 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T06:25:14.451 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.451 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.451 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.451 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.451 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_ptrace": { 2024-09-19T06:25:14.451 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_ptrace", 2024-09-19T06:25:14.451 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.451 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.451 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.451 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.451 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.452 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.452 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.452 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T06:25:14.452 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T06:25:14.452 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.452 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.452 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.452 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_interval": { 2024-09-19T06:25:14.452 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_interval", 2024-09-19T06:25:14.452 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:14.452 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.452 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.453 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-19T06:25:14.453 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.453 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.453 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.453 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T06:25:14.453 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.453 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.453 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.453 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.453 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_memory_target_ratio": { 2024-09-19T06:25:14.453 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T06:25:14.453 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-19T06:25:14.453 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.454 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.454 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.7", 2024-09-19T06:25:14.454 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.454 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.454 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.454 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T06:25:14.454 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.454 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.454 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.454 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.454 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm_log_destination": { 2024-09-19T06:25:14.454 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm_log_destination", 2024-09-19T06:25:14.454 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.455 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.455 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.455 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.455 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.455 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.455 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.455 INFO:teuthology.orchestra.run.smithi002.stdout: "file", 2024-09-19T06:25:14.455 INFO:teuthology.orchestra.run.smithi002.stdout: "file,syslog", 2024-09-19T06:25:14.455 INFO:teuthology.orchestra.run.smithi002.stdout: "syslog" 2024-09-19T06:25:14.455 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.455 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T06:25:14.455 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.456 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.456 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.456 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.456 INFO:teuthology.orchestra.run.smithi002.stdout: "cgroups_split": { 2024-09-19T06:25:14.456 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cgroups_split", 2024-09-19T06:25:14.456 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.456 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.456 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.456 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.456 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.456 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.456 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.456 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T06:25:14.457 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.457 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.457 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.457 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.457 INFO:teuthology.orchestra.run.smithi002.stdout: "config_checks_enabled": { 2024-09-19T06:25:14.457 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_checks_enabled", 2024-09-19T06:25:14.457 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.457 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.457 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.457 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.457 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.458 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.458 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.458 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T06:25:14.458 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.458 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.458 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.458 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.458 INFO:teuthology.orchestra.run.smithi002.stdout: "config_dashboard": { 2024-09-19T06:25:14.458 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_dashboard", 2024-09-19T06:25:14.458 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.458 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.458 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.459 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.459 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.459 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.459 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.459 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T06:25:14.459 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.459 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.459 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.459 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.459 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_alertmanager": { 2024-09-19T06:25:14.459 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_alertmanager", 2024-09-19T06:25:14.459 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.460 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.460 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.460 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T06:25:14.460 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.460 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.460 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.460 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-19T06:25:14.460 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.460 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.460 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.460 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.460 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_base": { 2024-09-19T06:25:14.461 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_base", 2024-09-19T06:25:14.461 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.461 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.461 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.461 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T06:25:14.461 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.461 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.461 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.461 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Container image name, without the tag", 2024-09-19T06:25:14.461 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.461 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.461 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.462 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.462 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_elasticsearch": { 2024-09-19T06:25:14.462 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_elasticsearch", 2024-09-19T06:25:14.462 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.462 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.462 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.462 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T06:25:14.462 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.462 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.462 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.462 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "elasticsearch container image", 2024-09-19T06:25:14.462 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.462 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.463 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.463 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.463 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_grafana": { 2024-09-19T06:25:14.463 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_grafana", 2024-09-19T06:25:14.463 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.463 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.463 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.463 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T06:25:14.463 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.463 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.463 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.463 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-19T06:25:14.463 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.464 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.464 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.464 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.464 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_haproxy": { 2024-09-19T06:25:14.464 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_haproxy", 2024-09-19T06:25:14.464 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.464 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.464 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.464 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T06:25:14.464 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.464 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.464 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.465 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "HAproxy container image", 2024-09-19T06:25:14.465 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.465 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.465 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.465 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.465 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_agent": { 2024-09-19T06:25:14.465 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_agent", 2024-09-19T06:25:14.465 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.465 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.465 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.465 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T06:25:14.465 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.466 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.466 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.466 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger agent container image", 2024-09-19T06:25:14.466 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.466 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.466 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.466 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.466 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_collector": { 2024-09-19T06:25:14.466 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_collector", 2024-09-19T06:25:14.466 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.466 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.466 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.466 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T06:25:14.467 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.467 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.467 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.467 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger collector container image", 2024-09-19T06:25:14.467 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.467 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.467 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.467 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.467 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_query": { 2024-09-19T06:25:14.467 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_query", 2024-09-19T06:25:14.467 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.467 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.467 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.468 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T06:25:14.468 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.468 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.468 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.468 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger query container image", 2024-09-19T06:25:14.468 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.468 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.468 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.468 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.468 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_keepalived": { 2024-09-19T06:25:14.468 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_keepalived", 2024-09-19T06:25:14.468 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.468 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.469 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.469 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T06:25:14.469 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.469 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.469 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.469 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Keepalived container image", 2024-09-19T06:25:14.469 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.469 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.469 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.469 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.469 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_loki": { 2024-09-19T06:25:14.469 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_loki", 2024-09-19T06:25:14.469 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.470 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.470 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.470 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T06:25:14.470 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.470 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.470 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.470 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Loki container image", 2024-09-19T06:25:14.470 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.470 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.470 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.470 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.470 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_node_exporter": { 2024-09-19T06:25:14.470 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_node_exporter", 2024-09-19T06:25:14.470 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.471 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.471 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.471 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T06:25:14.471 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.471 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.471 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.471 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-19T06:25:14.471 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.471 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.471 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.471 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.471 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_nvmeof": { 2024-09-19T06:25:14.471 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_nvmeof", 2024-09-19T06:25:14.472 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.472 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.472 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.472 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T06:25:14.472 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.472 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.472 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.472 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Nvme-of container image", 2024-09-19T06:25:14.472 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.472 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.472 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.472 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.472 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_prometheus": { 2024-09-19T06:25:14.473 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_prometheus", 2024-09-19T06:25:14.473 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.473 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.473 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.473 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T06:25:14.473 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.473 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.473 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.473 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-19T06:25:14.473 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.473 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.473 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.473 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.474 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_promtail": { 2024-09-19T06:25:14.474 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_promtail", 2024-09-19T06:25:14.474 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.474 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.474 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.474 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T06:25:14.474 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.474 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.474 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.474 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Promtail container image", 2024-09-19T06:25:14.474 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.474 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.475 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.475 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.475 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_samba": { 2024-09-19T06:25:14.475 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_samba", 2024-09-19T06:25:14.475 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.475 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.475 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.475 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T06:25:14.475 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.475 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.475 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.475 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Samba/SMB container image", 2024-09-19T06:25:14.476 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.476 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.476 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.476 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.476 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_snmp_gateway": { 2024-09-19T06:25:14.476 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_snmp_gateway", 2024-09-19T06:25:14.476 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.476 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.476 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.476 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T06:25:14.476 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.476 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.477 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.477 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SNMP Gateway container image", 2024-09-19T06:25:14.477 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.477 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.477 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.477 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.477 INFO:teuthology.orchestra.run.smithi002.stdout: "container_init": { 2024-09-19T06:25:14.477 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_init", 2024-09-19T06:25:14.477 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.477 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.477 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.477 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.477 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.478 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.478 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.478 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T06:25:14.478 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.478 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.478 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.478 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.478 INFO:teuthology.orchestra.run.smithi002.stdout: "daemon_cache_timeout": { 2024-09-19T06:25:14.478 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "daemon_cache_timeout", 2024-09-19T06:25:14.478 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:14.478 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.478 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.478 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-19T06:25:14.479 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.479 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.479 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.479 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T06:25:14.479 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.479 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.479 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.479 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.479 INFO:teuthology.orchestra.run.smithi002.stdout: "default_cephadm_command_timeout": { 2024-09-19T06:25:14.479 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T06:25:14.479 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.479 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.480 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.480 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "900", 2024-09-19T06:25:14.480 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.480 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.480 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.480 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T06:25:14.480 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.480 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.480 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.480 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.480 INFO:teuthology.orchestra.run.smithi002.stdout: "default_registry": { 2024-09-19T06:25:14.480 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_registry", 2024-09-19T06:25:14.481 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.481 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.481 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.481 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io", 2024-09-19T06:25:14.481 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.481 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.481 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.481 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T06:25:14.481 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.481 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.481 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.481 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.482 INFO:teuthology.orchestra.run.smithi002.stdout: "device_cache_timeout": { 2024-09-19T06:25:14.482 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_cache_timeout", 2024-09-19T06:25:14.482 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:14.482 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.482 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.482 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1800", 2024-09-19T06:25:14.482 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.482 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.482 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.482 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache device inventory", 2024-09-19T06:25:14.482 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.482 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.483 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.483 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.483 INFO:teuthology.orchestra.run.smithi002.stdout: "device_enhanced_scan": { 2024-09-19T06:25:14.483 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_enhanced_scan", 2024-09-19T06:25:14.483 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.483 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.483 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.483 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.483 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.483 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.483 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.483 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T06:25:14.483 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.484 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.484 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.484 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.484 INFO:teuthology.orchestra.run.smithi002.stdout: "facts_cache_timeout": { 2024-09-19T06:25:14.484 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "facts_cache_timeout", 2024-09-19T06:25:14.484 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:14.484 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.484 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.484 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-19T06:25:14.484 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.484 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.484 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.485 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache host facts data", 2024-09-19T06:25:14.485 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.485 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.485 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.485 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.485 INFO:teuthology.orchestra.run.smithi002.stdout: "grafana_dashboards_path": { 2024-09-19T06:25:14.485 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "grafana_dashboards_path", 2024-09-19T06:25:14.485 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.485 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.485 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.485 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T06:25:14.485 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.485 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.486 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.486 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T06:25:14.486 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.486 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.486 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.486 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.486 INFO:teuthology.orchestra.run.smithi002.stdout: "host_check_interval": { 2024-09-19T06:25:14.486 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "host_check_interval", 2024-09-19T06:25:14.486 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:14.486 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.486 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.486 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-19T06:25:14.487 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.487 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.487 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.487 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to perform a host check", 2024-09-19T06:25:14.487 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.487 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.487 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.487 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.487 INFO:teuthology.orchestra.run.smithi002.stdout: "hw_monitoring": { 2024-09-19T06:25:14.487 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hw_monitoring", 2024-09-19T06:25:14.487 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.487 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.488 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.488 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.488 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.488 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.488 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.488 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T06:25:14.488 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.488 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.488 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.488 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.488 INFO:teuthology.orchestra.run.smithi002.stdout: "inventory_list_all": { 2024-09-19T06:25:14.488 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "inventory_list_all", 2024-09-19T06:25:14.488 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.489 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.489 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.489 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.489 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.489 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.489 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.489 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T06:25:14.489 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.489 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.489 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.489 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.489 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.489 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.490 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.490 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.490 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.490 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.490 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.490 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.490 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.490 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.490 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.490 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.490 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.490 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.490 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.491 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.491 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.491 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.491 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.491 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.491 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.491 INFO:teuthology.orchestra.run.smithi002.stdout: "log_refresh_metadata": { 2024-09-19T06:25:14.491 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_refresh_metadata", 2024-09-19T06:25:14.491 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.491 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.491 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.491 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.491 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.492 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.492 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.492 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T06:25:14.492 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.492 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.492 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.492 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.492 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.492 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.492 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.492 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.492 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.492 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.493 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.493 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.493 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.493 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T06:25:14.493 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.493 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.493 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.493 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.493 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.493 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.493 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.493 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.494 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.494 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.494 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.494 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.494 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.494 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.494 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.494 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.494 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.494 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.494 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.494 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.494 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.495 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.495 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.495 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.495 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.495 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.495 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.495 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.495 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.495 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.495 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.495 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.495 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.496 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.496 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.496 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.496 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.496 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.496 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.496 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T06:25:14.496 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T06:25:14.496 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.496 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.496 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.496 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.496 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.497 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.497 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.497 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T06:25:14.497 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.497 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.497 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.497 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.497 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T06:25:14.497 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T06:25:14.497 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.497 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.497 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.498 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "*", 2024-09-19T06:25:14.498 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.498 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.498 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.498 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T06:25:14.498 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.498 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.498 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.498 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.498 INFO:teuthology.orchestra.run.smithi002.stdout: "max_count_per_host": { 2024-09-19T06:25:14.498 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_count_per_host", 2024-09-19T06:25:14.498 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.499 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.499 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.499 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T06:25:14.499 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.499 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.499 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.499 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of daemons per service per host", 2024-09-19T06:25:14.499 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.499 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.499 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.499 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.499 INFO:teuthology.orchestra.run.smithi002.stdout: "max_osd_draining_count": { 2024-09-19T06:25:14.499 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_osd_draining_count", 2024-09-19T06:25:14.500 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.500 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.500 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.500 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T06:25:14.500 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.500 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.500 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.500 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T06:25:14.500 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.500 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.500 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.500 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.500 INFO:teuthology.orchestra.run.smithi002.stdout: "migration_current": { 2024-09-19T06:25:14.501 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "migration_current", 2024-09-19T06:25:14.501 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.501 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.501 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.501 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.501 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.501 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.501 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.501 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "internal - do not modify", 2024-09-19T06:25:14.501 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.501 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.501 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.501 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.502 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-09-19T06:25:14.502 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-09-19T06:25:14.502 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.502 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.502 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.502 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "root", 2024-09-19T06:25:14.502 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.502 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.502 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.502 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm-package", 2024-09-19T06:25:14.502 INFO:teuthology.orchestra.run.smithi002.stdout: "root" 2024-09-19T06:25:14.502 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.503 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T06:25:14.503 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.503 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.503 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.503 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.503 INFO:teuthology.orchestra.run.smithi002.stdout: "oob_default_addr": { 2024-09-19T06:25:14.503 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "oob_default_addr", 2024-09-19T06:25:14.503 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.503 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.503 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.503 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "169.254.1.1", 2024-09-19T06:25:14.503 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.503 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.504 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.504 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T06:25:14.504 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.504 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.504 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.504 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.504 INFO:teuthology.orchestra.run.smithi002.stdout: "prometheus_alerts_path": { 2024-09-19T06:25:14.504 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus_alerts_path", 2024-09-19T06:25:14.504 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.504 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.504 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.504 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T06:25:14.505 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.505 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.505 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.505 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T06:25:14.505 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.505 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.505 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.505 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.505 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_insecure": { 2024-09-19T06:25:14.505 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_insecure", 2024-09-19T06:25:14.505 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.505 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.506 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.506 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.506 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.506 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.506 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.506 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T06:25:14.506 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.506 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.506 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.506 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.506 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_password": { 2024-09-19T06:25:14.506 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_password", 2024-09-19T06:25:14.507 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.507 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.507 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.507 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.507 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.507 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.507 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.507 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T06:25:14.507 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.507 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.507 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.507 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.508 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_url": { 2024-09-19T06:25:14.508 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_url", 2024-09-19T06:25:14.508 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.508 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.508 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.508 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.508 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.508 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.508 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.508 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T06:25:14.509 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.509 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.509 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.509 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.509 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_username": { 2024-09-19T06:25:14.509 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_username", 2024-09-19T06:25:14.509 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.509 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.509 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.509 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.509 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.510 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.510 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.510 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T06:25:14.510 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.510 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.510 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.510 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.510 INFO:teuthology.orchestra.run.smithi002.stdout: "secure_monitoring_stack": { 2024-09-19T06:25:14.510 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "secure_monitoring_stack", 2024-09-19T06:25:14.510 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.510 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.510 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.510 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.511 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.511 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.511 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.511 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T06:25:14.511 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.511 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.511 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.511 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.511 INFO:teuthology.orchestra.run.smithi002.stdout: "service_discovery_port": { 2024-09-19T06:25:14.511 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "service_discovery_port", 2024-09-19T06:25:14.511 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.511 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.511 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.512 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8765", 2024-09-19T06:25:14.512 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.512 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.512 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.512 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "cephadm service discovery port", 2024-09-19T06:25:14.512 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.512 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.512 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.512 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.512 INFO:teuthology.orchestra.run.smithi002.stdout: "ssh_config_file": { 2024-09-19T06:25:14.512 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssh_config_file", 2024-09-19T06:25:14.512 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.513 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.513 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.513 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.513 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.513 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.513 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.513 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T06:25:14.513 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.513 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.513 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.513 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.513 INFO:teuthology.orchestra.run.smithi002.stdout: "use_agent": { 2024-09-19T06:25:14.513 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_agent", 2024-09-19T06:25:14.514 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.514 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.514 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.514 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.514 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.514 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.514 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.514 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T06:25:14.514 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.514 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.514 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.514 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.514 INFO:teuthology.orchestra.run.smithi002.stdout: "use_repo_digest": { 2024-09-19T06:25:14.515 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_repo_digest", 2024-09-19T06:25:14.515 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.515 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.515 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.515 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.515 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.515 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.515 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.515 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T06:25:14.515 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.515 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.515 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.515 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.516 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_failed_host_check": { 2024-09-19T06:25:14.516 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_failed_host_check", 2024-09-19T06:25:14.516 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.516 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.516 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.516 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.516 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.516 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.516 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.516 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T06:25:14.516 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.516 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.516 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.517 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.517 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_daemons": { 2024-09-19T06:25:14.517 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_daemons", 2024-09-19T06:25:14.517 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.517 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.517 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.517 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.517 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.517 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.517 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.517 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T06:25:14.517 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.517 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.517 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.518 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.518 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_hosts": { 2024-09-19T06:25:14.518 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_hosts", 2024-09-19T06:25:14.518 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.518 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.518 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.518 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.518 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.518 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.518 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.518 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T06:25:14.518 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.519 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.519 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.519 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.519 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.519 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.519 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.519 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crash", 2024-09-19T06:25:14.519 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.519 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.519 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.519 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.519 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.519 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.520 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.520 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.520 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.520 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.520 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.520 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.520 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.520 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.520 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.520 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.520 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.521 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.521 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.521 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.521 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.521 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.521 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.521 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.521 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.521 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.521 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.521 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.521 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.522 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.522 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.522 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.522 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.522 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.522 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.522 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.522 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.522 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.522 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.522 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.522 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.522 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.523 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.523 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.523 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.523 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.523 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.523 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.523 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.523 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.523 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.523 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.523 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.523 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.523 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.524 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.524 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.524 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.524 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.524 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.524 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.524 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.524 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.524 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.524 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.524 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.524 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.524 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.525 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.525 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.525 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.525 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.525 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.525 INFO:teuthology.orchestra.run.smithi002.stdout: "retain_interval": { 2024-09-19T06:25:14.525 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retain_interval", 2024-09-19T06:25:14.525 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:14.525 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.525 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.525 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "31536000", 2024-09-19T06:25:14.525 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.526 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.526 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.526 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T06:25:14.526 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.526 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.526 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.526 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.526 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_recent_interval": { 2024-09-19T06:25:14.526 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_recent_interval", 2024-09-19T06:25:14.526 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:14.526 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.526 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.526 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1209600", 2024-09-19T06:25:14.527 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.527 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.527 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.527 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T06:25:14.527 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.527 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.527 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.527 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.527 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.527 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.527 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.527 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dashboard", 2024-09-19T06:25:14.527 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.528 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.528 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.528 INFO:teuthology.orchestra.run.smithi002.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T06:25:14.528 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T06:25:14.528 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.528 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.528 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.528 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T06:25:14.528 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.528 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.528 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.528 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.529 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.529 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.529 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.529 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.529 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T06:25:14.529 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T06:25:14.529 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.529 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.529 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.529 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.529 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.529 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.530 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.530 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.530 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.530 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.530 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.530 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.530 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T06:25:14.530 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T06:25:14.530 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.530 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.530 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.530 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.531 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.531 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.531 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.531 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.531 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.531 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.531 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.531 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.531 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_ENABLED": { 2024-09-19T06:25:14.531 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T06:25:14.531 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.531 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.531 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.532 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.532 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.532 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.532 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.532 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.532 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.532 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.532 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.532 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.532 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T06:25:14.532 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T06:25:14.533 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.533 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.533 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.533 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.533 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.533 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.533 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.533 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.533 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.533 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.533 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.533 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.533 INFO:teuthology.orchestra.run.smithi002.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T06:25:14.534 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T06:25:14.534 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.534 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.534 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.534 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.534 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.534 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.534 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.534 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.534 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.534 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.534 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.534 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.535 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T06:25:14.535 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T06:25:14.535 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.535 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.535 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.535 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.535 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.535 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.535 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.535 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.535 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.535 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.535 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.535 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.536 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T06:25:14.536 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T06:25:14.536 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.536 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.536 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.536 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.536 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.536 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.536 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.536 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.536 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.536 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.536 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.537 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.537 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T06:25:14.537 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T06:25:14.537 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.537 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.537 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.537 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.537 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.537 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.537 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.537 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.538 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.538 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.538 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.538 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.538 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T06:25:14.538 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T06:25:14.538 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.538 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.538 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.538 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.538 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.538 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.538 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.539 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.539 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.539 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.539 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.539 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.539 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T06:25:14.539 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T06:25:14.539 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.539 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.539 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.539 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.539 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.540 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.540 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.540 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.540 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.540 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.540 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.540 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.540 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T06:25:14.540 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T06:25:14.540 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.540 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.540 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.540 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.541 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.541 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.541 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.541 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.541 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.541 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.541 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.541 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.541 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T06:25:14.541 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T06:25:14.541 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.541 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.542 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.542 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.542 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.542 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.542 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.542 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.542 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.542 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.542 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.542 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.542 INFO:teuthology.orchestra.run.smithi002.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T06:25:14.542 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T06:25:14.542 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.543 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.543 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.543 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.543 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.543 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.543 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.543 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.543 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.543 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.543 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.543 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.543 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T06:25:14.544 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T06:25:14.544 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.544 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.544 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.544 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-19T06:25:14.544 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.544 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.544 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.544 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.544 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.545 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.545 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.545 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.545 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T06:25:14.545 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T06:25:14.545 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.545 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.545 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.545 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.545 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.545 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.545 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.546 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.546 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.546 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.546 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.546 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.546 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_URL": { 2024-09-19T06:25:14.546 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_URL", 2024-09-19T06:25:14.546 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.546 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.546 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.546 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.547 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.547 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.547 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.547 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.547 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.547 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.547 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.547 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.547 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T06:25:14.547 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T06:25:14.547 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.547 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.548 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.548 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-19T06:25:14.548 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.548 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.548 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.548 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.548 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.548 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.548 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.548 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.548 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T06:25:14.549 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T06:25:14.549 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.549 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.549 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.549 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.549 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.549 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.549 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.549 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.549 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.549 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.550 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.550 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.550 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T06:25:14.550 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T06:25:14.550 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.550 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.550 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.550 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.550 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.550 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.550 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.551 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.551 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.551 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.551 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.551 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.551 INFO:teuthology.orchestra.run.smithi002.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T06:25:14.551 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T06:25:14.551 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.551 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.551 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.551 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.552 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.552 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.552 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.552 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.552 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.552 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.552 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.552 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.552 INFO:teuthology.orchestra.run.smithi002.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T06:25:14.552 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T06:25:14.552 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.552 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.553 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.553 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.553 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.553 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.553 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.553 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.553 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.553 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.553 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.553 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.553 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T06:25:14.554 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T06:25:14.554 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.554 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.554 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.554 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.554 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.554 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.554 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.554 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.554 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.554 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.554 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.554 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.555 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T06:25:14.555 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T06:25:14.555 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.555 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.555 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.555 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.555 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.555 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.555 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.555 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.555 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.555 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.555 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.556 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.556 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T06:25:14.556 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T06:25:14.556 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.556 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.556 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.556 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.556 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.556 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.556 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.556 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.556 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.556 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.557 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.557 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.557 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T06:25:14.557 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T06:25:14.557 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.557 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.557 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.557 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.557 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.557 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.557 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.557 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.558 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.558 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.558 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.558 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.558 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T06:25:14.558 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T06:25:14.558 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.558 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.558 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.558 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.558 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.558 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.558 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.559 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.559 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.559 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.559 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.559 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.559 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T06:25:14.559 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T06:25:14.559 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.559 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.559 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.559 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.559 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.560 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.560 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.560 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.560 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.560 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.560 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.560 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.560 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T06:25:14.560 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T06:25:14.560 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.560 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.560 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.560 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.561 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.561 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.561 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.561 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.561 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.561 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.561 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.561 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.561 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T06:25:14.561 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T06:25:14.561 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.561 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.562 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.562 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.562 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.562 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.562 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.562 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.562 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.562 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.562 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.562 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.562 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T06:25:14.562 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T06:25:14.562 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.563 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.563 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.563 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.563 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.563 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.563 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.563 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.563 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.563 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.563 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.563 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.563 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T06:25:14.564 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T06:25:14.564 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.564 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.564 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.564 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.564 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.564 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.564 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.564 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.564 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.564 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.564 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.564 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.565 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T06:25:14.565 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T06:25:14.565 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.565 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.565 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.565 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T06:25:14.565 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.565 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.565 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.565 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.565 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.565 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.565 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.566 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.566 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T06:25:14.566 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T06:25:14.566 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.566 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.566 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.566 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T06:25:14.566 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.566 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.566 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.566 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.566 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.566 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.567 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.567 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.567 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T06:25:14.567 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T06:25:14.567 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.567 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.567 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.567 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8", 2024-09-19T06:25:14.567 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.567 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.567 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.567 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.567 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.568 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.568 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.568 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.568 INFO:teuthology.orchestra.run.smithi002.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T06:25:14.568 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T06:25:14.568 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.568 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.568 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.568 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "45", 2024-09-19T06:25:14.568 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.568 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.568 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.569 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.569 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.569 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.569 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.569 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.569 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T06:25:14.569 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T06:25:14.569 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.569 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.569 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.569 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.569 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.569 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.570 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.570 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.570 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.570 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.570 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.570 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.570 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T06:25:14.570 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T06:25:14.570 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.570 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.570 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.570 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-19T06:25:14.570 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.570 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.571 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.571 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.571 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.571 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.571 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.571 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.571 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T06:25:14.571 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T06:25:14.571 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.571 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.571 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.571 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.571 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.572 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.572 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.572 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.572 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.572 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.572 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.572 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.572 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T06:25:14.572 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T06:25:14.572 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.572 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.572 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.572 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.573 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.573 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.573 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.573 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.573 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.573 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.573 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.573 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.573 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T06:25:14.573 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T06:25:14.573 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.573 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.573 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.574 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-19T06:25:14.574 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.574 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.574 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.574 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.574 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.574 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.574 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.574 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.574 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T06:25:14.574 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T06:25:14.574 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.574 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.575 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.575 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T06:25:14.575 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.575 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.575 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.575 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.575 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.575 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.575 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.575 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.575 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T06:25:14.575 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T06:25:14.575 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.576 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.576 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.576 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-19T06:25:14.576 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.576 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.576 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.576 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.576 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.576 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.576 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.576 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.576 INFO:teuthology.orchestra.run.smithi002.stdout: "cross_origin_url": { 2024-09-19T06:25:14.576 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cross_origin_url", 2024-09-19T06:25:14.577 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.577 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.577 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.577 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.577 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.577 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.577 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.577 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.577 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.577 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.577 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.577 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.577 INFO:teuthology.orchestra.run.smithi002.stdout: "crt_file": { 2024-09-19T06:25:14.578 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crt_file", 2024-09-19T06:25:14.578 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.578 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.578 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.578 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.578 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.578 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.578 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.578 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.578 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.578 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.578 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.578 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.579 INFO:teuthology.orchestra.run.smithi002.stdout: "debug": { 2024-09-19T06:25:14.579 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "debug", 2024-09-19T06:25:14.579 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.579 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.579 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.579 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.579 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.579 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.579 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.579 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable/disable debug options", 2024-09-19T06:25:14.579 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.579 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.580 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.580 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.580 INFO:teuthology.orchestra.run.smithi002.stdout: "jwt_token_ttl": { 2024-09-19T06:25:14.580 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "jwt_token_ttl", 2024-09-19T06:25:14.580 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.580 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.580 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.580 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "28800", 2024-09-19T06:25:14.580 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.580 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.580 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.580 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.580 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.581 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.581 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.581 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.581 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-09-19T06:25:14.581 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-09-19T06:25:14.581 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.581 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.581 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.581 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.581 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.581 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.581 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.581 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.582 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.582 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.582 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.582 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.582 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.582 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.582 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.582 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.582 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.582 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.582 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.582 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.582 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.583 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.583 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.583 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.583 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.583 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.583 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.583 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.583 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.583 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.583 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.583 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.583 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.583 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.584 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.584 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.584 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.584 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.584 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.584 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.584 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.584 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.584 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.584 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.584 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.584 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.585 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.585 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.585 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.585 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.585 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.585 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.585 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.585 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.585 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.585 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.585 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.585 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.585 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.586 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.586 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.586 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.586 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.586 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.586 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.586 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.586 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.586 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.586 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.586 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.586 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.587 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.587 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.587 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.587 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.587 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.587 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.587 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.587 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.587 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.587 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.587 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.587 INFO:teuthology.orchestra.run.smithi002.stdout: "motd": { 2024-09-19T06:25:14.587 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "motd", 2024-09-19T06:25:14.588 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.588 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.588 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.588 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.588 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.588 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.588 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.588 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "The message of the day", 2024-09-19T06:25:14.588 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.588 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.588 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.588 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.588 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect_resolve_ip_addr": { 2024-09-19T06:25:14.589 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T06:25:14.589 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.589 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.589 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.589 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.589 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.589 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.589 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.589 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.589 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.589 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.589 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.590 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.590 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-19T06:25:14.590 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-19T06:25:14.590 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.590 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.590 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.590 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-09-19T06:25:14.590 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.590 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.590 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.590 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.590 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.590 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.591 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.591 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.591 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-19T06:25:14.591 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-19T06:25:14.591 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.591 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.591 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.591 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8080", 2024-09-19T06:25:14.591 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.591 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.591 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.591 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.591 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.592 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.592 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.592 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.592 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-09-19T06:25:14.592 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-09-19T06:25:14.592 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.592 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.592 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.592 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.592 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.592 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.592 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.593 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.593 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.593 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.593 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.593 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.593 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl_server_port": { 2024-09-19T06:25:14.593 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl_server_port", 2024-09-19T06:25:14.593 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.593 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.593 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.593 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8443", 2024-09-19T06:25:14.593 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.593 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.594 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.594 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.594 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.594 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.594 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.594 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.594 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-09-19T06:25:14.594 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-09-19T06:25:14.594 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.594 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.594 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.594 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "redirect", 2024-09-19T06:25:14.594 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.595 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.595 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.595 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.595 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect" 2024-09-19T06:25:14.595 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.595 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.595 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.595 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.595 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.595 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.595 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-09-19T06:25:14.595 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-09-19T06:25:14.595 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.596 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.596 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.596 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-09-19T06:25:14.596 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-09-19T06:25:14.596 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-09-19T06:25:14.596 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.596 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.596 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.596 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.596 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.596 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.596 INFO:teuthology.orchestra.run.smithi002.stdout: "url_prefix": { 2024-09-19T06:25:14.596 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url_prefix", 2024-09-19T06:25:14.597 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.597 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.597 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.597 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.597 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.597 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.597 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.597 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.597 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.597 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.597 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.597 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.597 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.598 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.598 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.598 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "devicehealth", 2024-09-19T06:25:14.598 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.598 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.598 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.598 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_monitoring": { 2024-09-19T06:25:14.598 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_monitoring", 2024-09-19T06:25:14.598 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.598 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.598 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.598 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.599 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.599 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.599 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.599 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "monitor device health metrics", 2024-09-19T06:25:14.599 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.599 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.599 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.599 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.599 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.599 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.599 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.599 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.599 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.600 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.600 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.600 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.600 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.600 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.600 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.600 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.600 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.600 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.600 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.600 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.600 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.600 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.601 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.601 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.601 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.601 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.601 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.601 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.601 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.601 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.601 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.601 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.601 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.601 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.601 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.602 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.602 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.602 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.602 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.602 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.602 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.602 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.602 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.602 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.602 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.602 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.602 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.602 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.602 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.603 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.603 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.603 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.603 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.603 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.603 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.603 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.603 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.603 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.603 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.603 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.603 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.603 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.604 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.604 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.604 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.604 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.604 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.604 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.604 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.604 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.604 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.604 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.604 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.604 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.605 INFO:teuthology.orchestra.run.smithi002.stdout: "mark_out_threshold": { 2024-09-19T06:25:14.605 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mark_out_threshold", 2024-09-19T06:25:14.605 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:14.605 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.605 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.605 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2419200", 2024-09-19T06:25:14.605 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.605 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.605 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.605 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T06:25:14.605 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.605 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.606 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.606 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.606 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": { 2024-09-19T06:25:14.606 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_name", 2024-09-19T06:25:14.606 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.606 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.606 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.606 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "device_health_metrics", 2024-09-19T06:25:14.606 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.606 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.606 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.606 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T06:25:14.606 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.607 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.607 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.607 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.607 INFO:teuthology.orchestra.run.smithi002.stdout: "retention_period": { 2024-09-19T06:25:14.607 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retention_period", 2024-09-19T06:25:14.607 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:14.607 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.607 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.607 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15552000", 2024-09-19T06:25:14.607 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.607 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.607 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.607 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain device health metrics", 2024-09-19T06:25:14.607 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.608 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.608 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.608 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.608 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_frequency": { 2024-09-19T06:25:14.608 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_frequency", 2024-09-19T06:25:14.608 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:14.608 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.608 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.608 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-09-19T06:25:14.608 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.608 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.608 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.608 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T06:25:14.609 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.609 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.609 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.609 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.609 INFO:teuthology.orchestra.run.smithi002.stdout: "self_heal": { 2024-09-19T06:25:14.609 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "self_heal", 2024-09-19T06:25:14.609 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.609 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.609 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.609 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.609 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.609 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.609 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.610 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T06:25:14.610 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.610 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.610 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.610 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.610 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-19T06:25:14.610 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-19T06:25:14.610 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:14.610 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.610 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.610 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-19T06:25:14.610 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.610 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.611 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.611 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T06:25:14.611 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.611 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.611 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.611 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.611 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_threshold": { 2024-09-19T06:25:14.611 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_threshold", 2024-09-19T06:25:14.611 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:14.611 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.611 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.611 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7257600", 2024-09-19T06:25:14.611 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.611 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.612 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.612 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T06:25:14.612 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.612 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.612 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.612 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.612 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.612 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.612 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.612 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "diskprediction_local", 2024-09-19T06:25:14.612 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.612 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.613 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.613 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.613 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.613 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.613 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.613 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.613 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.613 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.613 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.613 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.613 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.613 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.613 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.613 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.614 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.614 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.614 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.614 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.614 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.614 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.614 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.614 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.614 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.614 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.614 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.614 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.614 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.615 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.615 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.615 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.615 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.615 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.615 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.615 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.615 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.615 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.615 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.616 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.616 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.616 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.616 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.616 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.616 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.616 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.616 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.616 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.616 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.616 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.616 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.617 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.617 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.617 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.617 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.617 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.617 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.617 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.617 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.617 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.617 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.617 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.617 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.617 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.618 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.618 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.618 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.618 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.618 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.618 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.618 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.618 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.618 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.618 INFO:teuthology.orchestra.run.smithi002.stdout: "predict_interval": { 2024-09-19T06:25:14.618 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predict_interval", 2024-09-19T06:25:14.618 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.618 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.619 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.619 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-09-19T06:25:14.619 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.619 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.619 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.619 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.619 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.619 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.619 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.619 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.619 INFO:teuthology.orchestra.run.smithi002.stdout: "predictor_model": { 2024-09-19T06:25:14.619 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predictor_model", 2024-09-19T06:25:14.619 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.620 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.620 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.620 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "prophetstor", 2024-09-19T06:25:14.620 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.620 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.620 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.620 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.620 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.620 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.620 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.620 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.620 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-19T06:25:14.620 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-19T06:25:14.621 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.621 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.621 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.621 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-19T06:25:14.621 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.621 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.621 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.621 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.621 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.621 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.621 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.621 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.621 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.622 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.622 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.622 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "influx", 2024-09-19T06:25:14.622 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": false, 2024-09-19T06:25:14.622 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "influxdb python module not found", 2024-09-19T06:25:14.622 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.622 INFO:teuthology.orchestra.run.smithi002.stdout: "batch_size": { 2024-09-19T06:25:14.622 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "batch_size", 2024-09-19T06:25:14.622 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.622 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.622 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.622 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5000", 2024-09-19T06:25:14.622 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.623 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.623 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.623 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T06:25:14.623 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.623 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.623 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.623 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.623 INFO:teuthology.orchestra.run.smithi002.stdout: "database": { 2024-09-19T06:25:14.623 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "database", 2024-09-19T06:25:14.623 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.623 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.623 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.624 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "ceph", 2024-09-19T06:25:14.624 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.624 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.624 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.624 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T06:25:14.624 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.624 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.624 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.624 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.624 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": { 2024-09-19T06:25:14.624 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hostname", 2024-09-19T06:25:14.624 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.625 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.625 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.625 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.625 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.625 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.625 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.625 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server hostname", 2024-09-19T06:25:14.625 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.625 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.625 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.625 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.625 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-19T06:25:14.625 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-19T06:25:14.626 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:14.626 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.626 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.626 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "30", 2024-09-19T06:25:14.626 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "5", 2024-09-19T06:25:14.626 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.626 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.626 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T06:25:14.626 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.626 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.626 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.626 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.626 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.627 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.627 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.627 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.627 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.627 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.627 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.627 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.627 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.627 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.627 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.627 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.627 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.627 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.628 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.628 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.628 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.628 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.628 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.628 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.628 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.628 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.628 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.628 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.628 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.628 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.628 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.629 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.629 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.629 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.629 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.629 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.629 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.629 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.629 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.629 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.629 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.629 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.629 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.629 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.630 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.630 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.630 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.630 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.630 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.630 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.630 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.630 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.630 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.630 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.630 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.630 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.630 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.631 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.631 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.631 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.631 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.631 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.631 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.631 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.631 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.631 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.631 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.631 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.631 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.631 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.632 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.632 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.632 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.632 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.632 INFO:teuthology.orchestra.run.smithi002.stdout: "password": { 2024-09-19T06:25:14.632 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "password", 2024-09-19T06:25:14.632 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.632 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.632 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.632 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.632 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.632 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.632 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.632 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "password of InfluxDB server user", 2024-09-19T06:25:14.633 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.633 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.633 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.633 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.633 INFO:teuthology.orchestra.run.smithi002.stdout: "port": { 2024-09-19T06:25:14.633 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "port", 2024-09-19T06:25:14.633 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.633 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.633 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.633 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8086", 2024-09-19T06:25:14.633 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.633 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.633 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.634 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server port", 2024-09-19T06:25:14.634 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.634 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.634 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.634 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.634 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-09-19T06:25:14.634 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-09-19T06:25:14.634 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.634 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.634 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.634 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "false", 2024-09-19T06:25:14.634 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.635 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.635 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.635 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T06:25:14.635 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.635 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.635 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.635 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.635 INFO:teuthology.orchestra.run.smithi002.stdout: "threads": { 2024-09-19T06:25:14.635 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threads", 2024-09-19T06:25:14.635 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.635 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.635 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.635 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-19T06:25:14.635 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-19T06:25:14.636 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "32", 2024-09-19T06:25:14.636 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.636 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T06:25:14.636 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.636 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.636 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.636 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.636 INFO:teuthology.orchestra.run.smithi002.stdout: "username": { 2024-09-19T06:25:14.636 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "username", 2024-09-19T06:25:14.636 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.636 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.636 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.636 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.637 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.637 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.637 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.637 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "username of InfluxDB server user", 2024-09-19T06:25:14.637 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.637 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.637 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.637 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.637 INFO:teuthology.orchestra.run.smithi002.stdout: "verify_ssl": { 2024-09-19T06:25:14.637 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "verify_ssl", 2024-09-19T06:25:14.637 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.637 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.637 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.638 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "true", 2024-09-19T06:25:14.638 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.638 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.638 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.638 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T06:25:14.638 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.638 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.638 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.638 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.638 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.638 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.638 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.638 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "insights", 2024-09-19T06:25:14.639 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.639 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.639 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.639 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.639 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.639 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.639 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.639 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.639 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.639 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.639 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.639 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.640 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.640 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.640 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.640 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.640 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.640 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.640 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.640 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.641 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.641 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.641 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.641 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.641 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.641 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.641 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.641 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.641 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.641 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.641 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.641 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.641 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.642 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.642 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.642 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.642 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.642 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.642 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.642 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.642 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.642 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.642 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.642 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.642 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.643 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.643 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.643 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.643 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.643 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.643 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.643 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.643 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.643 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.643 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.643 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.643 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.643 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.644 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.644 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.644 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.644 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.644 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.644 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.644 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.644 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.644 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.644 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.644 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.645 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.645 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.645 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.645 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.645 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.645 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.645 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.645 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "iostat", 2024-09-19T06:25:14.645 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.645 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.645 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.645 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.645 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.646 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.646 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.646 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.646 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.646 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.646 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.646 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.646 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.646 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.646 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.646 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.646 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.646 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.647 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.647 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.647 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.647 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.647 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.647 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.647 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.647 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.647 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.647 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.647 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.647 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.647 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.647 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.648 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.648 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.648 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.648 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.648 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.648 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.648 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.648 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.648 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.648 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.648 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.648 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.648 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.649 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.649 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.649 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.649 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.649 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.649 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.649 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.649 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.649 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.649 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.649 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.649 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.649 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.650 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.650 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.650 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.650 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.650 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.650 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.650 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.650 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.650 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.650 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.650 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.650 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.650 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.651 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.651 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.651 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.651 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.651 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.651 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "k8sevents", 2024-09-19T06:25:14.651 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.651 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.651 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.651 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_event_retention_days": { 2024-09-19T06:25:14.651 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ceph_event_retention_days", 2024-09-19T06:25:14.651 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.651 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.652 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.652 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7", 2024-09-19T06:25:14.652 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.652 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.652 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.652 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T06:25:14.652 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.652 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.652 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.652 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.652 INFO:teuthology.orchestra.run.smithi002.stdout: "config_check_secs": { 2024-09-19T06:25:14.653 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_check_secs", 2024-09-19T06:25:14.653 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.653 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.653 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.653 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T06:25:14.653 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "10", 2024-09-19T06:25:14.653 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.653 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.653 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T06:25:14.653 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.653 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.653 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.654 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.654 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.654 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.654 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.654 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.654 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.654 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.654 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.654 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.654 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.654 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.654 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.654 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.655 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.655 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.655 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.655 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.655 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.655 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.655 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.655 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.655 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.655 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.655 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.655 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.655 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.656 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.656 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.656 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.656 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.656 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.656 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.656 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.656 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.656 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.656 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.656 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.656 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.656 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.657 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.657 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.657 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.657 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.657 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.657 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.657 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.657 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.657 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.657 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.657 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.657 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.658 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.658 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.658 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.658 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.658 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.658 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.658 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.658 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.658 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.658 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.658 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.658 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.658 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.659 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.659 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.659 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.659 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.659 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.659 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.659 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.659 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.659 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.659 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.659 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "localpool", 2024-09-19T06:25:14.659 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.659 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.659 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.660 INFO:teuthology.orchestra.run.smithi002.stdout: "failure_domain": { 2024-09-19T06:25:14.660 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "failure_domain", 2024-09-19T06:25:14.660 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.660 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.660 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.660 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "host", 2024-09-19T06:25:14.660 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.660 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.660 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.660 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "failure domain for any created local pool", 2024-09-19T06:25:14.660 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T06:25:14.660 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.661 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.661 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.661 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.661 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.661 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.661 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.661 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.661 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.661 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.661 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.661 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.661 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.661 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.661 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.662 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.662 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.662 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.662 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.662 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.662 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.662 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.662 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.662 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.662 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.662 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.662 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.662 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.663 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.663 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.663 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.663 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.663 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.663 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.663 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.663 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.663 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.663 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.663 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.663 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.663 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.664 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.664 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.664 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.664 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.664 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.664 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.664 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.664 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.664 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.664 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.664 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.664 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.664 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.665 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.665 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.665 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.665 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.665 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.665 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.665 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.665 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.665 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.665 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.665 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.665 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.665 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.665 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.666 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.666 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.666 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.666 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.666 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.666 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": { 2024-09-19T06:25:14.666 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_size", 2024-09-19T06:25:14.666 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.666 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.666 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.666 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.666 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.666 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.667 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.667 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default min_size for any created local pool", 2024-09-19T06:25:14.667 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T06:25:14.667 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.667 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.667 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.667 INFO:teuthology.orchestra.run.smithi002.stdout: "num_rep": { 2024-09-19T06:25:14.667 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "num_rep", 2024-09-19T06:25:14.667 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.667 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.667 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.667 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3", 2024-09-19T06:25:14.667 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.668 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.668 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.668 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default replica count for any created local pool", 2024-09-19T06:25:14.668 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.668 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.668 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.668 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.668 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": { 2024-09-19T06:25:14.668 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_num", 2024-09-19T06:25:14.668 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.668 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.669 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.669 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "128", 2024-09-19T06:25:14.669 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.669 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.669 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.669 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T06:25:14.669 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.669 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.669 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.669 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.669 INFO:teuthology.orchestra.run.smithi002.stdout: "prefix": { 2024-09-19T06:25:14.669 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prefix", 2024-09-19T06:25:14.669 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.670 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.670 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.670 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.670 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.670 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.670 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.670 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name prefix for any created local pool", 2024-09-19T06:25:14.670 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.670 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.670 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.670 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.670 INFO:teuthology.orchestra.run.smithi002.stdout: "subtree": { 2024-09-19T06:25:14.670 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "subtree", 2024-09-19T06:25:14.671 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.671 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.671 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.671 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "rack", 2024-09-19T06:25:14.671 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.671 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.671 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.671 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T06:25:14.671 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T06:25:14.671 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.671 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.671 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.671 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.672 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.672 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.672 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mds_autoscaler", 2024-09-19T06:25:14.672 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.672 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.672 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.672 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.672 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.672 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.672 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.672 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.672 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.672 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.673 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.673 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.673 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.673 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.673 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.673 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.673 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.673 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.673 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.673 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.673 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.673 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.673 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.674 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.674 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.674 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.674 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.674 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.674 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.674 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.674 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.674 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.674 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.674 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.674 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.674 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.675 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.675 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.675 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.675 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.675 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.675 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.675 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.675 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.675 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.675 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.675 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.675 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.675 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.676 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.676 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.676 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.676 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.676 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.676 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.676 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.676 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.676 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.676 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.676 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.676 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.676 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.677 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.677 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.677 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.677 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.677 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.677 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.677 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.677 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.677 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.677 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.677 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.677 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.677 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.678 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.678 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirroring", 2024-09-19T06:25:14.678 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.678 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.678 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.678 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.678 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.678 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.678 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.678 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.678 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.678 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.678 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.679 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.679 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.679 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.679 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.679 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.679 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.679 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.679 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.679 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.679 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.679 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.679 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.679 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.680 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.680 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.680 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.680 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.680 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.680 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.680 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.680 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.680 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.680 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.680 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.680 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.680 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.681 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.681 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.681 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.681 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.681 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.681 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.681 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.681 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.681 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.681 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.681 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.681 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.681 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.682 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.682 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.682 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.682 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.682 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.682 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.682 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.682 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.682 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.682 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.682 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.682 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.683 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.683 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.683 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.683 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.683 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.683 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.683 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.683 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.683 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.683 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.683 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.683 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.684 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.684 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.684 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "nfs", 2024-09-19T06:25:14.684 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.684 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.684 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.684 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.684 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.684 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.684 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.684 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.684 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.685 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.685 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.685 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.685 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.685 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.685 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.685 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.685 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.685 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.685 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.685 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.685 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.686 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.686 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.686 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.686 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.686 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.686 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.686 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.686 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.686 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.686 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.686 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.686 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.687 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.687 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.687 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.687 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.687 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.687 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.687 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.687 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.687 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.687 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.687 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.687 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.687 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.687 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.688 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.688 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.688 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.688 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.688 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.688 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.688 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.688 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.688 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.688 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.688 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.688 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.688 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.688 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.689 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.689 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.689 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.689 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.689 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.689 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.689 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.689 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.689 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.689 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.689 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.689 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.689 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.690 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.690 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.690 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-09-19T06:25:14.690 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.690 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.690 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.690 INFO:teuthology.orchestra.run.smithi002.stdout: "fail_fs": { 2024-09-19T06:25:14.690 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "fail_fs", 2024-09-19T06:25:14.690 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.690 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.690 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.690 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.690 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.691 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.691 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.691 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T06:25:14.691 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.691 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.691 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.691 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.691 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.691 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.691 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.691 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.691 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.691 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.692 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.692 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.692 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.692 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.692 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.692 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.692 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.692 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.692 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.692 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.692 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.692 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.693 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.693 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.693 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.693 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.693 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.693 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.693 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.693 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.693 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.693 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.693 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.693 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.693 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.694 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.694 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.694 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.694 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.694 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.694 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.694 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.694 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.694 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.694 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.694 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.694 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.694 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.695 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.695 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.695 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.695 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.695 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.695 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.695 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.695 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.695 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.695 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.695 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.695 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.695 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.696 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.696 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.696 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.696 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.696 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.696 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.696 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.696 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.696 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.696 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.696 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.696 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.696 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.697 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator": { 2024-09-19T06:25:14.697 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-09-19T06:25:14.697 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.697 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.697 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.697 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.697 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.697 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.697 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.697 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm", 2024-09-19T06:25:14.697 INFO:teuthology.orchestra.run.smithi002.stdout: "rook", 2024-09-19T06:25:14.697 INFO:teuthology.orchestra.run.smithi002.stdout: "test_orchestrator" 2024-09-19T06:25:14.697 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.698 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Orchestrator backend", 2024-09-19T06:25:14.698 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.698 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.698 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.698 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.698 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.698 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.698 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.698 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_perf_query", 2024-09-19T06:25:14.698 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.698 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.698 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.698 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.698 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.699 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.699 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.699 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.699 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.699 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.699 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.699 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.699 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.699 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.699 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.699 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.699 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.699 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.700 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.700 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.700 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.700 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.700 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.700 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.700 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.700 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.700 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.700 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.700 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.700 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.700 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.701 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.701 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.701 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.701 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.701 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.701 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.701 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.701 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.701 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.701 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.701 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.701 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.701 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.702 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.702 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.702 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.702 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.702 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.702 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.702 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.702 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.702 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.702 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.702 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.702 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.702 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.702 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.703 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.703 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.703 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.703 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.703 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.703 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.703 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.703 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.703 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.703 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.703 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.703 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.703 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.703 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.704 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.704 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.704 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.704 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.704 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_support", 2024-09-19T06:25:14.704 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.704 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.704 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.704 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.704 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.704 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.704 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.704 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.705 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.705 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.705 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.705 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.705 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.705 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.705 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.705 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.705 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.705 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.705 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.705 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.705 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.705 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.706 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.706 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.706 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.706 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.706 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.706 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.706 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.706 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.706 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.706 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.706 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.706 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.706 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.707 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.707 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.707 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.707 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.707 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.707 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.707 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.707 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.707 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.707 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.707 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.707 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.708 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.708 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.708 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.708 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.708 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.708 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.708 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.708 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.708 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.708 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.708 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.708 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.709 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.709 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.709 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.709 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.709 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.709 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.709 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.709 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.709 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.709 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.709 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.709 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.710 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.710 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.710 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.710 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.710 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.710 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_autoscaler", 2024-09-19T06:25:14.710 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.710 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.710 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.710 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.710 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.710 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.711 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.711 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.711 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.711 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.711 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.711 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.711 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.711 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.711 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.711 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.711 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.711 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.711 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.712 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.712 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.712 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.712 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.712 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.712 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.712 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.712 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.712 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.712 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.712 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.712 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.712 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.713 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.713 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.713 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.713 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.713 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.713 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.713 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.713 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.713 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.713 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.713 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.713 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.713 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.714 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.714 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.714 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.714 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.714 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.714 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.714 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.714 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.714 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.714 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.714 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.714 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.714 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.715 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.715 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.715 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.715 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.715 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.715 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.715 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.715 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.715 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.715 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.715 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.715 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.716 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.716 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.716 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.716 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-19T06:25:14.716 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-19T06:25:14.716 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:14.716 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.716 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.716 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-19T06:25:14.716 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.716 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.716 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.716 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.717 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.717 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.717 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.717 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.717 INFO:teuthology.orchestra.run.smithi002.stdout: "threshold": { 2024-09-19T06:25:14.717 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threshold", 2024-09-19T06:25:14.717 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-19T06:25:14.717 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.717 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.717 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-09-19T06:25:14.717 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1.0", 2024-09-19T06:25:14.717 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.718 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.718 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "scaling threshold", 2024-09-19T06:25:14.718 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T06:25:14.718 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.718 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.718 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.718 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.718 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.718 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.718 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "progress", 2024-09-19T06:25:14.718 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.718 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.718 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.719 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_pg_recovery_event": { 2024-09-19T06:25:14.719 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_pg_recovery_event", 2024-09-19T06:25:14.719 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.719 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.719 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.719 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.719 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.719 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.719 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.719 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T06:25:14.719 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.719 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.719 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.720 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.720 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-09-19T06:25:14.720 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-09-19T06:25:14.720 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.720 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.720 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.720 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.720 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.720 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.720 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.720 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.720 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.721 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.721 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.721 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.721 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.721 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.721 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.721 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.721 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.721 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.721 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.721 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.721 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.721 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.722 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.722 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.722 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.722 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.722 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.722 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.722 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.722 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.722 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.722 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.722 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.722 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.722 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.722 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.723 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.723 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.723 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.723 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.723 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.723 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.723 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.723 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.723 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.723 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.723 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.723 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.723 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.724 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.724 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.724 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.724 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.724 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.724 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.724 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.724 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.724 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.724 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.724 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.724 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.724 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.725 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.725 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.725 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.725 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.725 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.725 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.725 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.725 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.725 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.725 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.725 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.725 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.725 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.725 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.726 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.726 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.726 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.726 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.726 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.726 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.726 INFO:teuthology.orchestra.run.smithi002.stdout: "max_completed_events": { 2024-09-19T06:25:14.726 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_completed_events", 2024-09-19T06:25:14.726 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.726 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.726 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.726 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "50", 2024-09-19T06:25:14.726 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.727 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.727 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.727 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "number of past completed events to remember", 2024-09-19T06:25:14.727 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.727 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.727 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.727 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.727 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-19T06:25:14.727 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-19T06:25:14.727 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:14.727 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.727 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.727 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-19T06:25:14.728 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.728 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.728 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.728 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long the module is going to sleep", 2024-09-19T06:25:14.728 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.728 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.728 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.728 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.728 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.728 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.728 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.728 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus", 2024-09-19T06:25:14.728 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.729 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.729 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.729 INFO:teuthology.orchestra.run.smithi002.stdout: "cache": { 2024-09-19T06:25:14.729 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cache", 2024-09-19T06:25:14.729 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.729 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.729 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.729 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.729 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.729 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.729 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.729 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.729 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.730 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.730 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.730 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.730 INFO:teuthology.orchestra.run.smithi002.stdout: "exclude_perf_counters": { 2024-09-19T06:25:14.730 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "exclude_perf_counters", 2024-09-19T06:25:14.730 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.730 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.730 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.730 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.730 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.730 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.730 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.730 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T06:25:14.731 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T06:25:14.731 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.731 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.731 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.731 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.731 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.731 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.731 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.731 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.731 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.731 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.731 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.731 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.732 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.732 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.732 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.732 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.732 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.732 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.732 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.732 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.732 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.732 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.732 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.732 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.732 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.732 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.733 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.733 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.733 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.733 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.733 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.733 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.733 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.733 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.733 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.733 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.733 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.733 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.734 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.734 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.734 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.734 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.734 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.734 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.734 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.734 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.734 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.734 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.734 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.734 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.734 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.734 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.735 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.735 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.735 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.735 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.735 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.735 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.735 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.735 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.735 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.735 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.735 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.735 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.735 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.736 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.736 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.736 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.736 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.736 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.736 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.736 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.736 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.736 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools": { 2024-09-19T06:25:14.736 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools", 2024-09-19T06:25:14.736 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.736 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.736 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.737 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.737 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.737 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.737 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.737 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.737 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.737 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.737 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.737 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.737 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T06:25:14.737 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T06:25:14.737 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.737 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.737 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.738 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "300", 2024-09-19T06:25:14.738 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.738 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.738 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.738 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.738 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.738 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.738 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.738 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.738 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_interval": { 2024-09-19T06:25:14.738 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_interval", 2024-09-19T06:25:14.738 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-19T06:25:14.738 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.739 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.739 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15.0", 2024-09-19T06:25:14.739 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.739 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.739 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.739 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.739 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.739 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.739 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.739 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.739 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-19T06:25:14.739 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-19T06:25:14.739 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.740 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.740 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.740 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-09-19T06:25:14.740 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.740 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.740 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.740 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T06:25:14.740 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.740 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.740 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.740 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.740 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-19T06:25:14.740 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-19T06:25:14.740 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.741 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.741 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.741 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "9283", 2024-09-19T06:25:14.741 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.741 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.741 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.741 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T06:25:14.741 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.741 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.741 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.741 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.741 INFO:teuthology.orchestra.run.smithi002.stdout: "stale_cache_strategy": { 2024-09-19T06:25:14.741 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stale_cache_strategy", 2024-09-19T06:25:14.742 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.742 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.742 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.742 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "log", 2024-09-19T06:25:14.742 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.742 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.742 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.742 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.742 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.742 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.742 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.742 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.742 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-09-19T06:25:14.742 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-09-19T06:25:14.743 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.743 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.743 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.743 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "default", 2024-09-19T06:25:14.743 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.743 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.743 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.743 INFO:teuthology.orchestra.run.smithi002.stdout: "default", 2024-09-19T06:25:14.743 INFO:teuthology.orchestra.run.smithi002.stdout: "error" 2024-09-19T06:25:14.743 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.743 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.743 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.743 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.744 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.744 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.744 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-09-19T06:25:14.744 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-09-19T06:25:14.744 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.744 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.744 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.744 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-09-19T06:25:14.744 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-09-19T06:25:14.744 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-09-19T06:25:14.744 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.744 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.744 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.745 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.745 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.745 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.745 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.745 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.745 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.745 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_support", 2024-09-19T06:25:14.745 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.745 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.745 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.745 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.745 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.745 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.746 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.746 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.746 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.746 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.746 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.746 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.746 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.746 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.746 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.746 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.746 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.746 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.746 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.747 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.747 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.747 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.747 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.747 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.747 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.747 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.747 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.747 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.747 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.747 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.747 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.747 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.748 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.748 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.748 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.748 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.748 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.748 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.748 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.748 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.748 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.748 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.748 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.748 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.748 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.749 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.749 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.749 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.749 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.749 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.749 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.749 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.749 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.749 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.749 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.749 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.749 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.749 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.750 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.750 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.750 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.750 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.750 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.750 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.750 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.750 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.750 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.750 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.750 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.750 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.750 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.751 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.751 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.751 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_snap_create": { 2024-09-19T06:25:14.751 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_snap_create", 2024-09-19T06:25:14.751 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.751 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.751 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.751 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-19T06:25:14.751 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.751 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.751 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.751 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.752 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.752 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.752 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.752 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.752 INFO:teuthology.orchestra.run.smithi002.stdout: "mirror_snapshot_schedule": { 2024-09-19T06:25:14.752 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T06:25:14.752 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.752 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.752 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.752 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.752 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.752 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.752 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.752 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.753 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.753 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.753 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.753 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.753 INFO:teuthology.orchestra.run.smithi002.stdout: "trash_purge_schedule": { 2024-09-19T06:25:14.753 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "trash_purge_schedule", 2024-09-19T06:25:14.753 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.753 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.753 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.753 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.753 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.753 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.753 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.754 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.754 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.754 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.754 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.754 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.754 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.754 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.754 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.754 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "restful", 2024-09-19T06:25:14.754 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.754 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.754 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.754 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_auth": { 2024-09-19T06:25:14.755 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_auth", 2024-09-19T06:25:14.755 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.755 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.755 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.755 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.755 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.755 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.755 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.755 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.755 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.755 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.755 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.755 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.756 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-09-19T06:25:14.756 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-09-19T06:25:14.756 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.756 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.756 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.756 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.756 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.756 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.756 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.756 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.756 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.756 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.757 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.757 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.757 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.757 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.757 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.757 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.757 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.757 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.757 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.757 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.757 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.757 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.757 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.758 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.758 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.758 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.758 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.758 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.758 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.758 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.758 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.758 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.758 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.758 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.758 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.758 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.759 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.759 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.759 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.759 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.759 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.759 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.759 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.759 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.759 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.759 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.759 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.759 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.759 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.760 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.760 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.760 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.760 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.760 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.760 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.760 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.760 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.760 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.760 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.760 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.760 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.760 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.761 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.761 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.761 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.761 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.761 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.761 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.761 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.761 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.761 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.761 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.761 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.761 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.761 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.762 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.762 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.762 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.762 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.762 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.762 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.762 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.762 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-19T06:25:14.762 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-19T06:25:14.762 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.762 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.762 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.762 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.763 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.763 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.763 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.763 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.763 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.763 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.763 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.763 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.763 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-19T06:25:14.763 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-19T06:25:14.763 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.763 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.763 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.764 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.764 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.764 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.764 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.764 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.764 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.764 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.764 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.764 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.764 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.764 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.764 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.765 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rgw", 2024-09-19T06:25:14.765 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.765 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.765 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.765 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.765 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.765 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.765 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.765 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.765 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.765 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.765 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.765 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.766 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.766 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.766 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.766 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.766 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.766 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.766 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.766 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.766 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.766 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.766 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.766 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.767 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.767 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.767 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.767 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.767 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.767 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.767 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.767 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.767 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.767 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.767 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.767 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.767 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.767 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.768 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.768 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.768 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.768 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.768 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.768 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.768 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.768 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.768 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.768 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.768 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.768 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.769 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.769 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.769 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.769 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.769 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.769 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.769 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.769 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.769 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.769 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.769 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.769 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.769 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.770 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.770 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.770 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.770 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.770 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.770 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.770 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.770 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.770 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.770 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.770 INFO:teuthology.orchestra.run.smithi002.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T06:25:14.770 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T06:25:14.770 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.770 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.771 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.771 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-19T06:25:14.771 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.771 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.771 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.771 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T06:25:14.771 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.771 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.771 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.771 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.771 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.771 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.772 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.772 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rook", 2024-09-19T06:25:14.772 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.772 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.772 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.772 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.772 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.772 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.772 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.772 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.772 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.772 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.772 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.773 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.773 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.773 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.773 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.773 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.773 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.773 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.773 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.773 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.773 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.773 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.773 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.773 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.774 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.774 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.774 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.774 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.774 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.774 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.774 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.774 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.774 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.774 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.774 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.774 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.774 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.774 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.775 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.775 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.775 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.775 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.775 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.775 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.775 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.775 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.775 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.775 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.775 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.775 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.775 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.776 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.776 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.776 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.776 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.776 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.776 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.776 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.776 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.776 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.776 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.776 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.776 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.777 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.777 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.777 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.777 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.777 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.777 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.777 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.777 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.777 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.777 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.777 INFO:teuthology.orchestra.run.smithi002.stdout: "storage_class": { 2024-09-19T06:25:14.777 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "storage_class", 2024-09-19T06:25:14.777 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.778 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.778 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.778 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "local", 2024-09-19T06:25:14.778 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.778 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.778 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.778 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T06:25:14.778 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.778 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.778 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.778 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.778 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.778 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.779 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.779 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "selftest", 2024-09-19T06:25:14.779 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.779 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.779 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.779 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.779 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.779 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.779 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.779 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.779 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.779 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.779 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.780 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.780 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.780 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.780 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.780 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.780 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.780 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.780 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.780 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.780 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.780 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.780 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.780 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.781 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.781 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.781 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.781 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.781 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.781 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.781 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.781 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.781 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.781 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.781 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.781 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.781 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.782 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.782 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.782 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.782 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.782 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.782 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.782 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.782 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.782 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.782 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.782 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.782 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.782 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.782 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.783 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.783 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.783 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.783 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.783 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.783 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.783 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.783 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.783 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.783 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.783 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.783 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.783 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.784 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.784 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.784 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.784 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.784 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.784 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.784 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.784 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.784 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.784 INFO:teuthology.orchestra.run.smithi002.stdout: "roption1": { 2024-09-19T06:25:14.784 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption1", 2024-09-19T06:25:14.784 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.785 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.785 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.785 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.785 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.785 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.785 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.785 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.785 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.785 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.785 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.785 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.785 INFO:teuthology.orchestra.run.smithi002.stdout: "roption2": { 2024-09-19T06:25:14.785 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption2", 2024-09-19T06:25:14.785 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.786 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.786 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.786 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "xyz", 2024-09-19T06:25:14.786 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.786 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.786 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.786 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.786 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.786 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.786 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.786 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.786 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption1": { 2024-09-19T06:25:14.786 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption1", 2024-09-19T06:25:14.787 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.787 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.787 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.787 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.787 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.787 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.787 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.787 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.787 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.787 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.787 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.787 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.787 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption2": { 2024-09-19T06:25:14.788 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption2", 2024-09-19T06:25:14.788 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.788 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.788 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.788 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.788 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.788 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.788 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.788 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.788 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.788 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.788 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.788 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.789 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption3": { 2024-09-19T06:25:14.789 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption3", 2024-09-19T06:25:14.789 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-19T06:25:14.789 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.789 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.789 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.789 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.789 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.789 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.789 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.789 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.789 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.789 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.789 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.790 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption4": { 2024-09-19T06:25:14.790 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption4", 2024-09-19T06:25:14.790 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.790 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.790 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.790 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.790 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.790 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.790 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.790 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.790 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.790 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.790 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.791 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.791 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption5": { 2024-09-19T06:25:14.791 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption5", 2024-09-19T06:25:14.791 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.791 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.791 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.791 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.791 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.791 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.791 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.791 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.791 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.791 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.792 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.792 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.792 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption6": { 2024-09-19T06:25:14.792 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption6", 2024-09-19T06:25:14.792 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.792 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.792 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.792 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.792 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.792 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.792 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.792 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.792 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.793 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.793 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.793 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.793 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption7": { 2024-09-19T06:25:14.793 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption7", 2024-09-19T06:25:14.793 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.793 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.793 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.793 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.793 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-19T06:25:14.793 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "42", 2024-09-19T06:25:14.793 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.793 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.793 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.794 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.794 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.794 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.794 INFO:teuthology.orchestra.run.smithi002.stdout: "testkey": { 2024-09-19T06:25:14.794 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testkey", 2024-09-19T06:25:14.794 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.794 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.794 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.794 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.794 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.794 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.794 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.794 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.795 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.795 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.795 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.795 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.795 INFO:teuthology.orchestra.run.smithi002.stdout: "testlkey": { 2024-09-19T06:25:14.795 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testlkey", 2024-09-19T06:25:14.795 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.795 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.795 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.795 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.795 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.796 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.796 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.796 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.796 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.796 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.796 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.796 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.796 INFO:teuthology.orchestra.run.smithi002.stdout: "testnewline": { 2024-09-19T06:25:14.796 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testnewline", 2024-09-19T06:25:14.796 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.796 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.796 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.797 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.797 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.797 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.797 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.797 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.797 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.797 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.797 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.797 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.797 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.797 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.797 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.798 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snap_schedule", 2024-09-19T06:25:14.798 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.798 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.798 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.798 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_m_granularity": { 2024-09-19T06:25:14.798 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_m_granularity", 2024-09-19T06:25:14.798 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.798 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.798 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.798 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.798 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.798 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.798 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.799 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T06:25:14.799 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.799 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.799 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.799 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.799 INFO:teuthology.orchestra.run.smithi002.stdout: "dump_on_update": { 2024-09-19T06:25:14.799 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dump_on_update", 2024-09-19T06:25:14.799 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.799 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.799 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.799 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.799 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.800 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.800 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.800 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "dump database to debug log on update", 2024-09-19T06:25:14.800 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.800 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.800 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.800 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.800 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.800 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.800 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.800 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.800 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.801 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.801 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.801 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.801 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.801 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.801 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.801 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.801 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.801 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.801 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.801 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.801 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.801 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.802 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.802 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.802 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.802 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.802 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.802 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.802 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.802 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.802 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.802 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.802 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.802 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.803 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.803 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.803 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.803 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.803 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.803 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.803 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.803 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.803 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.803 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.803 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.803 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.803 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.804 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.804 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.804 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.804 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.804 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.804 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.804 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.804 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.804 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.804 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.804 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.804 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.804 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.805 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.805 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.805 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.805 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.805 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.805 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.805 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.805 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.805 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.805 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.805 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.805 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.806 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.806 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.806 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.806 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.806 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.806 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stats", 2024-09-19T06:25:14.806 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.806 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.806 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.806 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.806 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.807 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.807 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.807 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.807 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.807 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.807 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.807 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.807 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.807 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.807 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.807 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.807 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.808 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.808 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.808 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.808 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.808 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.808 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.808 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.808 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.808 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.808 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.808 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.808 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.808 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.809 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.809 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.809 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.809 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.809 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.809 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.809 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.809 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.809 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.809 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.809 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.809 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.810 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.810 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.810 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.810 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.810 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.810 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.810 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.810 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.810 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.810 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.810 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.811 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.811 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.811 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.811 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.811 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.811 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.811 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.811 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.811 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.811 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.811 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.811 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.811 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.812 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.812 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.812 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.812 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.812 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.812 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.812 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.812 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.812 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.812 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.813 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "status", 2024-09-19T06:25:14.813 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.813 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.813 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.813 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.813 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.813 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.813 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.813 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.813 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.813 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.813 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.813 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.814 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.814 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.814 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.814 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.814 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.814 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.814 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.814 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.814 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.814 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.814 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.814 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.814 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.815 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.815 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.815 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.815 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.815 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.815 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.815 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.815 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.815 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.815 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.815 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.815 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.815 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.816 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.816 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.816 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.816 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.816 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.816 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.816 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.816 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.816 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.816 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.816 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.816 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.816 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.817 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.817 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.817 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.817 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.817 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.817 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.817 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.817 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.817 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.817 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.817 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.817 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.818 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.818 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.818 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.818 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.818 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.818 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.818 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.818 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.818 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.818 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.818 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.818 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.818 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.819 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telegraf", 2024-09-19T06:25:14.819 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.819 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.819 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.819 INFO:teuthology.orchestra.run.smithi002.stdout: "address": { 2024-09-19T06:25:14.819 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "address", 2024-09-19T06:25:14.819 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.819 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.819 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.819 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T06:25:14.819 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.819 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.820 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.820 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.820 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.820 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.820 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.820 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.820 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-19T06:25:14.820 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-19T06:25:14.820 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:14.820 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.820 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.820 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15", 2024-09-19T06:25:14.820 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.821 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.821 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.821 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.821 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.821 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.821 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.821 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.821 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.821 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.821 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.821 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.821 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.821 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.822 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.822 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.822 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.822 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.822 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.822 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.822 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.822 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.822 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.822 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.822 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.822 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.823 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.823 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.823 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.823 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.823 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.823 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.823 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.823 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.823 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.823 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.823 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.823 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.823 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.824 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.824 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.824 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.824 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.824 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.824 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.824 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.824 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.824 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.824 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.824 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.824 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.824 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.825 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.825 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.825 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.825 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.825 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.825 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.825 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.825 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.825 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.825 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.825 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.825 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.825 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.826 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.826 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.826 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.826 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.826 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.826 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.826 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.826 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.826 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.826 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.826 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.826 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.826 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.827 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.827 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.827 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.827 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telemetry", 2024-09-19T06:25:14.827 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.827 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.827 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.827 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_basic": { 2024-09-19T06:25:14.827 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_basic", 2024-09-19T06:25:14.827 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.827 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.827 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.827 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.828 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.828 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.828 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.828 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T06:25:14.828 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.828 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.828 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.828 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.828 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_crash": { 2024-09-19T06:25:14.828 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_crash", 2024-09-19T06:25:14.828 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.828 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.829 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.829 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.829 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.829 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.829 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.829 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T06:25:14.829 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.829 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.829 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.829 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.829 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_device": { 2024-09-19T06:25:14.829 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_device", 2024-09-19T06:25:14.829 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.830 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.830 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.830 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.830 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.830 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.830 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.830 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T06:25:14.830 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.830 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.830 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.830 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.830 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_ident": { 2024-09-19T06:25:14.830 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_ident", 2024-09-19T06:25:14.831 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.831 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.831 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.831 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.831 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.831 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.831 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.831 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T06:25:14.831 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.831 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.831 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.831 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.831 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_perf": { 2024-09-19T06:25:14.832 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_perf", 2024-09-19T06:25:14.832 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.832 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.832 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.832 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.832 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.832 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.832 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.832 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T06:25:14.832 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.832 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.832 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.832 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.833 INFO:teuthology.orchestra.run.smithi002.stdout: "contact": { 2024-09-19T06:25:14.833 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "contact", 2024-09-19T06:25:14.833 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.833 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.833 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.833 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.833 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.833 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.833 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.833 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.833 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.833 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.833 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.834 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.834 INFO:teuthology.orchestra.run.smithi002.stdout: "description": { 2024-09-19T06:25:14.834 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "description", 2024-09-19T06:25:14.834 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.834 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.834 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.834 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.834 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.834 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.834 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.834 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.834 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.834 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.835 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.835 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.835 INFO:teuthology.orchestra.run.smithi002.stdout: "device_url": { 2024-09-19T06:25:14.835 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_url", 2024-09-19T06:25:14.835 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.835 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.835 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.835 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T06:25:14.835 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.835 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.835 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.835 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.835 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.835 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.836 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.836 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.836 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-09-19T06:25:14.836 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-09-19T06:25:14.836 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.836 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.836 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.836 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.836 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.836 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.836 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.836 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.837 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.837 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.837 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.837 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.837 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-19T06:25:14.837 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-19T06:25:14.837 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.837 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.837 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.837 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "24", 2024-09-19T06:25:14.837 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "8", 2024-09-19T06:25:14.837 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.837 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.838 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.838 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.838 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.838 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.838 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.838 INFO:teuthology.orchestra.run.smithi002.stdout: "last_opt_revision": { 2024-09-19T06:25:14.838 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "last_opt_revision", 2024-09-19T06:25:14.838 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.838 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.838 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.838 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1", 2024-09-19T06:25:14.838 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.838 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.838 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.839 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.839 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.839 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.839 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.839 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.839 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard": { 2024-09-19T06:25:14.839 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard", 2024-09-19T06:25:14.839 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.839 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.839 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.839 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.839 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.839 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.840 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.840 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.840 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.840 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.840 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.840 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.840 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard_description": { 2024-09-19T06:25:14.840 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard_description", 2024-09-19T06:25:14.840 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.840 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.840 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.840 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.840 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.841 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.841 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.841 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.841 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.841 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.841 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.841 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.841 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.841 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.841 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.841 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.841 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.841 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.842 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.842 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.842 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.842 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.842 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.842 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.842 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.842 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.842 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.842 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.842 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.842 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.842 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.843 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.843 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.843 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.843 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.843 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.843 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.843 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.843 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.843 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.843 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.843 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.843 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.843 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.844 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.844 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.844 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.844 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.844 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.844 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.844 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.844 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.844 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.844 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.844 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.844 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.844 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.845 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.845 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.845 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.845 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.845 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.845 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.845 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.845 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.845 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.845 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.845 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.845 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.846 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.846 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.846 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.846 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.846 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.846 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.846 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.846 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.846 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.846 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.846 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.846 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.846 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.847 INFO:teuthology.orchestra.run.smithi002.stdout: "organization": { 2024-09-19T06:25:14.847 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "organization", 2024-09-19T06:25:14.847 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.847 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.847 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.847 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.847 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.847 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.847 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.847 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.847 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.847 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.847 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.847 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.848 INFO:teuthology.orchestra.run.smithi002.stdout: "proxy": { 2024-09-19T06:25:14.848 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "proxy", 2024-09-19T06:25:14.848 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.848 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.848 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.848 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.848 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.848 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.848 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.848 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.848 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.848 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.848 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.849 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.849 INFO:teuthology.orchestra.run.smithi002.stdout: "url": { 2024-09-19T06:25:14.849 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url", 2024-09-19T06:25:14.849 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.849 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.849 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.849 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T06:25:14.849 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.849 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.849 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.849 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.849 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.849 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.850 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.850 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.850 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.850 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.850 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.850 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "test_orchestrator", 2024-09-19T06:25:14.850 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.850 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.850 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.850 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.850 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.850 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.850 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.851 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.851 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.851 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.851 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.851 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.851 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.851 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.851 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.851 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.851 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.851 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.851 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.851 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.852 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.852 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.852 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.852 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.852 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.852 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.852 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.852 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.852 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.852 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.852 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.852 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.852 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.852 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.853 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.853 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.853 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.853 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.853 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.853 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.853 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.853 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.853 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.853 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.853 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.853 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.853 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.854 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.854 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.854 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.854 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.854 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.854 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.854 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.854 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.854 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.854 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.854 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.854 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.854 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.855 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.855 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.855 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.855 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.855 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.855 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.855 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.855 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.855 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.855 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.855 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.855 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.855 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.856 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.856 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.856 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.856 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "volumes", 2024-09-19T06:25:14.856 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.856 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.856 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.856 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.856 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.856 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.856 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.856 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.856 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.857 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.857 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.857 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.857 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.857 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.857 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.857 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.857 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.857 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.857 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.857 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.857 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.857 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.858 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.858 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.858 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.858 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.858 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.858 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.858 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.858 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.858 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.858 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.858 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.858 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.859 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.859 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.859 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.859 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.859 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.859 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.859 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.859 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.859 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.859 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.859 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.859 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.859 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.860 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.860 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.860 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.860 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.860 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.860 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.860 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.860 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.860 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.860 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.860 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.860 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.860 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.861 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.861 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.861 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.861 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.861 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.861 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.861 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.861 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.861 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.861 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.861 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.861 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.861 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.862 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_clones": { 2024-09-19T06:25:14.862 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_clones", 2024-09-19T06:25:14.862 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.862 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.862 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.862 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4", 2024-09-19T06:25:14.862 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.862 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.862 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.862 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T06:25:14.862 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.862 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.862 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.863 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.863 INFO:teuthology.orchestra.run.smithi002.stdout: "periodic_async_work": { 2024-09-19T06:25:14.863 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "periodic_async_work", 2024-09-19T06:25:14.863 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.863 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.863 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.863 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.863 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.863 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.863 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.863 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Periodically check for async work", 2024-09-19T06:25:14.863 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.863 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.864 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.864 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.864 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_delay": { 2024-09-19T06:25:14.864 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_delay", 2024-09-19T06:25:14.864 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.864 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.864 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.864 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-19T06:25:14.864 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.864 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.864 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.864 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T06:25:14.865 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.865 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.865 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.865 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.865 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_no_wait": { 2024-09-19T06:25:14.865 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T06:25:14.865 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.865 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.865 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.865 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-19T06:25:14.865 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.865 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.865 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.866 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T06:25:14.866 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.866 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.866 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.866 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.866 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.866 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.866 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.866 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix", 2024-09-19T06:25:14.866 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-19T06:25:14.866 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-19T06:25:14.866 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-19T06:25:14.866 INFO:teuthology.orchestra.run.smithi002.stdout: "discovery_interval": { 2024-09-19T06:25:14.867 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "discovery_interval", 2024-09-19T06:25:14.867 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-19T06:25:14.867 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.867 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.867 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "100", 2024-09-19T06:25:14.867 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.867 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.867 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.867 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.867 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.867 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.867 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.867 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.867 INFO:teuthology.orchestra.run.smithi002.stdout: "identifier": { 2024-09-19T06:25:14.868 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "identifier", 2024-09-19T06:25:14.868 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.868 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.868 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.868 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.868 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.868 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.868 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.868 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.868 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.868 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.868 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.868 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.869 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-19T06:25:14.869 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-19T06:25:14.869 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-19T06:25:14.869 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.869 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.869 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-19T06:25:14.869 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.869 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.869 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.869 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.869 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.869 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.869 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.870 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.870 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-19T06:25:14.870 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-19T06:25:14.870 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.870 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.870 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.870 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.870 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.870 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.870 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.870 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.870 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.870 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.871 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.871 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.871 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.871 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.871 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.871 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.871 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.871 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.871 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.871 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-19T06:25:14.871 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-19T06:25:14.871 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.871 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.871 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.872 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.872 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.872 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.872 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.872 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.872 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.872 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.872 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.872 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.872 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-19T06:25:14.872 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-19T06:25:14.872 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.872 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.873 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.873 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-19T06:25:14.873 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.873 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.873 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-19T06:25:14.873 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-19T06:25:14.873 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-19T06:25:14.873 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-19T06:25:14.873 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-19T06:25:14.873 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-19T06:25:14.873 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-19T06:25:14.873 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.873 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.874 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.874 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.874 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.874 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.874 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-19T06:25:14.874 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-19T06:25:14.874 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-19T06:25:14.874 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.874 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-19T06:25:14.874 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-19T06:25:14.874 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.874 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.874 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.875 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.875 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.875 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.875 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.875 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.875 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_host": { 2024-09-19T06:25:14.875 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_host", 2024-09-19T06:25:14.875 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.875 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.875 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.875 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-19T06:25:14.875 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.875 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.876 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.876 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.876 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.876 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.876 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.876 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.876 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_port": { 2024-09-19T06:25:14.876 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_port", 2024-09-19T06:25:14.876 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-19T06:25:14.876 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.876 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.876 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10051", 2024-09-19T06:25:14.876 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.877 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.877 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.877 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.877 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.877 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.877 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.877 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.877 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_sender": { 2024-09-19T06:25:14.877 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_sender", 2024-09-19T06:25:14.877 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-19T06:25:14.877 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-19T06:25:14.877 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-19T06:25:14.877 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T06:25:14.878 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-19T06:25:14.878 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-19T06:25:14.878 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-19T06:25:14.878 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-19T06:25:14.878 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-19T06:25:14.878 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-19T06:25:14.878 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-19T06:25:14.878 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.878 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.878 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.878 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.878 INFO:teuthology.orchestra.run.smithi002.stdout: "services": { 2024-09-19T06:25:14.878 INFO:teuthology.orchestra.run.smithi002.stdout: "dashboard": "https://172.21.15.2:8443/" 2024-09-19T06:25:14.879 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.879 INFO:teuthology.orchestra.run.smithi002.stdout: "always_on_modules": { 2024-09-19T06:25:14.879 INFO:teuthology.orchestra.run.smithi002.stdout: "octopus": [ 2024-09-19T06:25:14.879 INFO:teuthology.orchestra.run.smithi002.stdout: "balancer", 2024-09-19T06:25:14.879 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-09-19T06:25:14.879 INFO:teuthology.orchestra.run.smithi002.stdout: "devicehealth", 2024-09-19T06:25:14.879 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator", 2024-09-19T06:25:14.879 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscaler", 2024-09-19T06:25:14.879 INFO:teuthology.orchestra.run.smithi002.stdout: "progress", 2024-09-19T06:25:14.879 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_support", 2024-09-19T06:25:14.879 INFO:teuthology.orchestra.run.smithi002.stdout: "status", 2024-09-19T06:25:14.879 INFO:teuthology.orchestra.run.smithi002.stdout: "telemetry", 2024-09-19T06:25:14.879 INFO:teuthology.orchestra.run.smithi002.stdout: "volumes" 2024-09-19T06:25:14.880 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.880 INFO:teuthology.orchestra.run.smithi002.stdout: "pacific": [ 2024-09-19T06:25:14.880 INFO:teuthology.orchestra.run.smithi002.stdout: "balancer", 2024-09-19T06:25:14.880 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-09-19T06:25:14.880 INFO:teuthology.orchestra.run.smithi002.stdout: "devicehealth", 2024-09-19T06:25:14.880 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator", 2024-09-19T06:25:14.880 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscaler", 2024-09-19T06:25:14.880 INFO:teuthology.orchestra.run.smithi002.stdout: "progress", 2024-09-19T06:25:14.880 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_support", 2024-09-19T06:25:14.880 INFO:teuthology.orchestra.run.smithi002.stdout: "status", 2024-09-19T06:25:14.880 INFO:teuthology.orchestra.run.smithi002.stdout: "telemetry", 2024-09-19T06:25:14.880 INFO:teuthology.orchestra.run.smithi002.stdout: "volumes" 2024-09-19T06:25:14.880 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.881 INFO:teuthology.orchestra.run.smithi002.stdout: "quincy": [ 2024-09-19T06:25:14.881 INFO:teuthology.orchestra.run.smithi002.stdout: "balancer", 2024-09-19T06:25:14.881 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-09-19T06:25:14.881 INFO:teuthology.orchestra.run.smithi002.stdout: "devicehealth", 2024-09-19T06:25:14.881 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator", 2024-09-19T06:25:14.881 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscaler", 2024-09-19T06:25:14.881 INFO:teuthology.orchestra.run.smithi002.stdout: "progress", 2024-09-19T06:25:14.881 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_support", 2024-09-19T06:25:14.881 INFO:teuthology.orchestra.run.smithi002.stdout: "status", 2024-09-19T06:25:14.881 INFO:teuthology.orchestra.run.smithi002.stdout: "telemetry", 2024-09-19T06:25:14.881 INFO:teuthology.orchestra.run.smithi002.stdout: "volumes" 2024-09-19T06:25:14.882 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.882 INFO:teuthology.orchestra.run.smithi002.stdout: "reef": [ 2024-09-19T06:25:14.882 INFO:teuthology.orchestra.run.smithi002.stdout: "balancer", 2024-09-19T06:25:14.882 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-09-19T06:25:14.882 INFO:teuthology.orchestra.run.smithi002.stdout: "devicehealth", 2024-09-19T06:25:14.882 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator", 2024-09-19T06:25:14.882 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscaler", 2024-09-19T06:25:14.882 INFO:teuthology.orchestra.run.smithi002.stdout: "progress", 2024-09-19T06:25:14.882 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_support", 2024-09-19T06:25:14.882 INFO:teuthology.orchestra.run.smithi002.stdout: "status", 2024-09-19T06:25:14.882 INFO:teuthology.orchestra.run.smithi002.stdout: "telemetry", 2024-09-19T06:25:14.882 INFO:teuthology.orchestra.run.smithi002.stdout: "volumes" 2024-09-19T06:25:14.882 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-19T06:25:14.883 INFO:teuthology.orchestra.run.smithi002.stdout: "squid": [ 2024-09-19T06:25:14.883 INFO:teuthology.orchestra.run.smithi002.stdout: "balancer", 2024-09-19T06:25:14.883 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-09-19T06:25:14.883 INFO:teuthology.orchestra.run.smithi002.stdout: "devicehealth", 2024-09-19T06:25:14.883 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator", 2024-09-19T06:25:14.883 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscaler", 2024-09-19T06:25:14.883 INFO:teuthology.orchestra.run.smithi002.stdout: "progress", 2024-09-19T06:25:14.883 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_support", 2024-09-19T06:25:14.883 INFO:teuthology.orchestra.run.smithi002.stdout: "status", 2024-09-19T06:25:14.883 INFO:teuthology.orchestra.run.smithi002.stdout: "telemetry", 2024-09-19T06:25:14.883 INFO:teuthology.orchestra.run.smithi002.stdout: "volumes" 2024-09-19T06:25:14.883 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-19T06:25:14.884 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.884 INFO:teuthology.orchestra.run.smithi002.stdout: "last_failure_osd_epoch": 82, 2024-09-19T06:25:14.884 INFO:teuthology.orchestra.run.smithi002.stdout: "active_clients": [ 2024-09-19T06:25:14.884 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.884 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "devicehealth", 2024-09-19T06:25:14.884 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-09-19T06:25:14.884 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.884 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-09-19T06:25:14.884 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-09-19T06:25:14.884 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 3809968233 2024-09-19T06:25:14.884 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.884 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-19T06:25:14.884 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.885 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.885 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "libcephsqlite", 2024-09-19T06:25:14.885 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-09-19T06:25:14.885 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.885 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-09-19T06:25:14.885 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-09-19T06:25:14.885 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 3485594426 2024-09-19T06:25:14.885 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.885 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-19T06:25:14.885 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.885 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.885 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_support", 2024-09-19T06:25:14.885 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-09-19T06:25:14.885 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.886 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-09-19T06:25:14.886 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-09-19T06:25:14.886 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 2304103947 2024-09-19T06:25:14.886 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.886 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-19T06:25:14.886 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.886 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.886 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snap_schedule", 2024-09-19T06:25:14.886 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-09-19T06:25:14.886 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.886 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-09-19T06:25:14.886 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-09-19T06:25:14.886 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 2441058187 2024-09-19T06:25:14.886 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.887 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-19T06:25:14.887 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.887 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.887 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snap_schedule", 2024-09-19T06:25:14.887 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-09-19T06:25:14.887 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.887 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-09-19T06:25:14.887 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-09-19T06:25:14.887 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 3260136724 2024-09-19T06:25:14.887 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.887 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-19T06:25:14.887 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:14.888 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.888 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "volumes", 2024-09-19T06:25:14.888 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-09-19T06:25:14.888 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-19T06:25:14.888 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-09-19T06:25:14.888 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-09-19T06:25:14.888 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 2394468991 2024-09-19T06:25:14.888 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.888 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-19T06:25:14.888 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:14.888 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-19T06:25:14.888 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:25:14.890 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:13 smithi089 ceph-mon[34160]: pgmap v324: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 29 op/s 2024-09-19T06:25:14.890 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:13 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/3944723094' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T06:25:14.890 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:13 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/3563178110' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T06:25:14.890 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:13 smithi089 ceph-mon[34160]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T06:25:14.890 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:13 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/43238728' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T06:25:14.890 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:13 smithi090 ceph-mon[34497]: pgmap v324: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 29 op/s 2024-09-19T06:25:14.890 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:13 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/3944723094' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T06:25:14.890 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:13 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/3563178110' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T06:25:14.891 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:13 smithi090 ceph-mon[34497]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T06:25:14.891 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:13 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/43238728' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T06:25:14.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.457+0000 7fc72c023640 1 -- 172.21.15.2:0/43238728 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc7100a33c0 msgr2=0x7fc7100a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:14.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.457+0000 7fc72c023640 1 --2- 172.21.15.2:0/43238728 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc7100a33c0 0x7fc7100a5880 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc720009900 tx=0x7fc720000bc0 comp rx=0 tx=0).stop 2024-09-19T06:25:14.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.457+0000 7fc72c023640 1 -- 172.21.15.2:0/43238728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc724101340 msgr2=0x7fc724198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:14.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.457+0000 7fc72c023640 1 --2- 172.21.15.2:0/43238728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc724101340 0x7fc724198870 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fc71400d950 tx=0x7fc71400de10 comp rx=0 tx=0).stop 2024-09-19T06:25:14.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.457+0000 7fc72c023640 1 -- 172.21.15.2:0/43238728 shutdown_connections 2024-09-19T06:25:14.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.457+0000 7fc72c023640 1 --2- 172.21.15.2:0/43238728 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fc7100a33c0 0x7fc7100a5880 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:14.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.457+0000 7fc72c023640 1 --2- 172.21.15.2:0/43238728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7241069b0 0x7fc72419cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:14.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.457+0000 7fc72c023640 1 --2- 172.21.15.2:0/43238728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc724101340 0x7fc724198870 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:14.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.457+0000 7fc72c023640 1 --2- 172.21.15.2:0/43238728 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7241009a0 0x7fc724198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:14.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.457+0000 7fc72c023640 1 -- 172.21.15.2:0/43238728 >> 172.21.15.2:0/43238728 conn(0x7fc7240fc6a0 msgr2=0x7fc72406a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:14.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.457+0000 7fc72c023640 1 -- 172.21.15.2:0/43238728 shutdown_connections 2024-09-19T06:25:14.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:13.457+0000 7fc72c023640 1 -- 172.21.15.2:0/43238728 wait complete. 2024-09-19T06:25:14.955 DEBUG:tasks.check_counter:Getting stats from a 2024-09-19T06:25:14.955 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-19T06:25:14.956 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:13 smithi002 ceph-mon[30982]: pgmap v324: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 29 op/s 2024-09-19T06:25:14.956 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:13 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/3944723094' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T06:25:14.956 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:13 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/3563178110' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T06:25:14.956 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:13 smithi002 ceph-mon[30982]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T06:25:14.956 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:13 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/43238728' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T06:25:15.228 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:25:15.740 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:25:15.740 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:25:15.740 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 215, 2024-09-19T06:25:15.740 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 203, 2024-09-19T06:25:15.740 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 1448544, 2024-09-19T06:25:15.741 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 123872, 2024-09-19T06:25:15.741 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 4, 2024-09-19T06:25:15.741 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 0, 2024-09-19T06:25:15.741 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.040830800, 2024-09-19T06:25:15.741 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.014838530, 2024-09-19T06:25:15.741 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.035980417, 2024-09-19T06:25:15.741 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:25:15.741 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:25:15.741 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 203, 2024-09-19T06:25:15.741 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.015476023, 2024-09-19T06:25:15.741 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000076236 2024-09-19T06:25:15.741 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:15.742 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:25:15.742 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-19T06:25:15.742 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-19T06:25:15.742 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-19T06:25:15.742 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:15.742 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 1448544, 2024-09-19T06:25:15.742 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 123872 2024-09-19T06:25:15.742 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:15.742 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:25:15.742 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 2, 2024-09-19T06:25:15.742 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 154, 2024-09-19T06:25:15.742 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 320, 2024-09-19T06:25:15.742 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 184336, 2024-09-19T06:25:15.743 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 5, 2024-09-19T06:25:15.743 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 3, 2024-09-19T06:25:15.743 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.012184698, 2024-09-19T06:25:15.743 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.008256678, 2024-09-19T06:25:15.743 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.001792565, 2024-09-19T06:25:15.743 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:25:15.743 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:25:15.743 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 151, 2024-09-19T06:25:15.743 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.014001213, 2024-09-19T06:25:15.743 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000092723 2024-09-19T06:25:15.743 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:15.743 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:25:15.743 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-19T06:25:15.744 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-19T06:25:15.744 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-19T06:25:15.744 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:15.744 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T06:25:15.744 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 184336 2024-09-19T06:25:15.744 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:15.744 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:25:15.744 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 0, 2024-09-19T06:25:15.744 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 2, 2024-09-19T06:25:15.744 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 0, 2024-09-19T06:25:15.744 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 0, 2024-09-19T06:25:15.744 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 2, 2024-09-19T06:25:15.745 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 1, 2024-09-19T06:25:15.745 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.000329812, 2024-09-19T06:25:15.745 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T06:25:15.745 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.000224280, 2024-09-19T06:25:15.745 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:25:15.745 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:25:15.745 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-19T06:25:15.745 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-19T06:25:15.745 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-19T06:25:15.745 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:15.745 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:25:15.745 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-19T06:25:15.746 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-19T06:25:15.746 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-19T06:25:15.746 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:15.746 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T06:25:15.746 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T06:25:15.746 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:15.746 INFO:teuthology.orchestra.run.smithi002.stdout: "cct": { 2024-09-19T06:25:15.746 INFO:teuthology.orchestra.run.smithi002.stdout: "total_workers": 0, 2024-09-19T06:25:15.746 INFO:teuthology.orchestra.run.smithi002.stdout: "unhealthy_workers": 0 2024-09-19T06:25:15.746 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:15.746 INFO:teuthology.orchestra.run.smithi002.stdout: "mempool": { 2024-09-19T06:25:15.746 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:25:15.746 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_items": 0, 2024-09-19T06:25:15.747 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:25:15.747 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:25:15.747 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:25:15.747 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:25:15.747 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:25:15.747 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:25:15.747 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:25:15.747 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:25:15.747 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:25:15.747 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:25:15.747 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:25:15.747 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:25:15.747 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:25:15.748 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_items": 0, 2024-09-19T06:25:15.748 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:25:15.748 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_items": 0, 2024-09-19T06:25:15.748 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:25:15.748 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:25:15.748 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:25:15.748 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:25:15.748 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:25:15.748 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:25:15.748 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:25:15.748 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_items": 0, 2024-09-19T06:25:15.748 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:25:15.748 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:25:15.749 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:25:15.749 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_items": 0, 2024-09-19T06:25:15.749 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_bytes": 0, 2024-09-19T06:25:15.749 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_items": 0, 2024-09-19T06:25:15.749 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:25:15.749 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:25:15.749 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:25:15.749 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:25:15.749 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_bytes": 149057, 2024-09-19T06:25:15.752 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_items": 32, 2024-09-19T06:25:15.752 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:25:15.752 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_items": 0, 2024-09-19T06:25:15.752 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_bytes": 0, 2024-09-19T06:25:15.752 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_items": 0, 2024-09-19T06:25:15.752 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:25:15.752 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_items": 0, 2024-09-19T06:25:15.752 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:25:15.752 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_items": 0, 2024-09-19T06:25:15.753 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_bytes": 0, 2024-09-19T06:25:15.753 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_items": 0, 2024-09-19T06:25:15.753 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:25:15.753 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:25:15.753 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_bytes": 0, 2024-09-19T06:25:15.753 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_items": 0, 2024-09-19T06:25:15.753 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_bytes": 928, 2024-09-19T06:25:15.753 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_items": 2, 2024-09-19T06:25:15.753 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_bytes": 0, 2024-09-19T06:25:15.753 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_items": 0, 2024-09-19T06:25:15.753 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_bytes": 0, 2024-09-19T06:25:15.753 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_items": 0 2024-09-19T06:25:15.753 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:15.754 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:25:15.754 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-09-19T06:25:15.754 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 104857600, 2024-09-19T06:25:15.754 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-09-19T06:25:15.754 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 213, 2024-09-19T06:25:15.754 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 1415740, 2024-09-19T06:25:15.754 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:15.754 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 213, 2024-09-19T06:25:15.754 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 0, 2024-09-19T06:25:15.754 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 0, 2024-09-19T06:25:15.754 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 213, 2024-09-19T06:25:15.754 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 1415740, 2024-09-19T06:25:15.754 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-09-19T06:25:15.755 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-19T06:25:15.755 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-19T06:25:15.755 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-19T06:25:15.755 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:15.755 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:15.755 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:25:15.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:15 smithi002 ceph-mon[30982]: pgmap v326: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T06:25:15.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:15 smithi090 ceph-mon[34497]: pgmap v326: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T06:25:16.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:15 smithi089 ceph-mon[34160]: pgmap v326: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T06:25:16.493 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-19T06:25:16.494 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-19T06:25:16.494 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-09-19T06:25:16.494 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-09-19T06:25:16.494 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-09-19T06:25:16.494 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-09-19T06:25:16.494 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-09-19T06:25:16.494 DEBUG:tasks.check_counter:Getting stats from d 2024-09-19T06:25:16.494 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-19T06:25:16.758 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:25:17.208 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:25:17.208 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:25:17.208 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 0, 2024-09-19T06:25:17.208 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 2, 2024-09-19T06:25:17.208 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 0, 2024-09-19T06:25:17.208 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 0, 2024-09-19T06:25:17.209 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 4, 2024-09-19T06:25:17.209 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 0, 2024-09-19T06:25:17.209 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.001231979, 2024-09-19T06:25:17.209 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T06:25:17.209 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.000224571, 2024-09-19T06:25:17.209 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:25:17.209 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:25:17.209 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-19T06:25:17.209 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-19T06:25:17.209 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-19T06:25:17.209 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:17.209 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:25:17.209 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-19T06:25:17.210 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-19T06:25:17.210 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-19T06:25:17.210 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:17.210 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T06:25:17.210 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T06:25:17.210 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:17.210 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:25:17.210 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 216, 2024-09-19T06:25:17.210 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 206, 2024-09-19T06:25:17.210 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 1446864, 2024-09-19T06:25:17.210 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 126624, 2024-09-19T06:25:17.211 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 2, 2024-09-19T06:25:17.211 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 1, 2024-09-19T06:25:17.211 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.039955639, 2024-09-19T06:25:17.211 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.015020369, 2024-09-19T06:25:17.211 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.036269433, 2024-09-19T06:25:17.211 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:25:17.211 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:25:17.211 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 205, 2024-09-19T06:25:17.211 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.010315151, 2024-09-19T06:25:17.211 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000050317 2024-09-19T06:25:17.211 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:17.211 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:25:17.211 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-19T06:25:17.212 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-19T06:25:17.212 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-19T06:25:17.212 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:17.212 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 1446864, 2024-09-19T06:25:17.212 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 126624 2024-09-19T06:25:17.212 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:17.212 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:25:17.212 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 6, 2024-09-19T06:25:17.212 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 160, 2024-09-19T06:25:17.212 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 3360, 2024-09-19T06:25:17.212 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 185488, 2024-09-19T06:25:17.212 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 5, 2024-09-19T06:25:17.213 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 3, 2024-09-19T06:25:17.213 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.014091039, 2024-09-19T06:25:17.213 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.008099950, 2024-09-19T06:25:17.213 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.003862735, 2024-09-19T06:25:17.213 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:25:17.213 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:25:17.213 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 158, 2024-09-19T06:25:17.213 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.022357376, 2024-09-19T06:25:17.213 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000141502 2024-09-19T06:25:17.213 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:17.213 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:25:17.213 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-19T06:25:17.213 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-19T06:25:17.214 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-19T06:25:17.214 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:17.214 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 3360, 2024-09-19T06:25:17.214 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 185488 2024-09-19T06:25:17.214 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:17.214 INFO:teuthology.orchestra.run.smithi002.stdout: "cct": { 2024-09-19T06:25:17.214 INFO:teuthology.orchestra.run.smithi002.stdout: "total_workers": 0, 2024-09-19T06:25:17.214 INFO:teuthology.orchestra.run.smithi002.stdout: "unhealthy_workers": 0 2024-09-19T06:25:17.214 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:17.214 INFO:teuthology.orchestra.run.smithi002.stdout: "mempool": { 2024-09-19T06:25:17.215 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:25:17.215 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_items": 0, 2024-09-19T06:25:17.215 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:25:17.215 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:25:17.215 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:25:17.215 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:25:17.215 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:25:17.215 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:25:17.215 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:25:17.215 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:25:17.215 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:25:17.215 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:25:17.215 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:25:17.216 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:25:17.216 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:25:17.216 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_items": 0, 2024-09-19T06:25:17.216 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:25:17.216 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_items": 0, 2024-09-19T06:25:17.216 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:25:17.216 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:25:17.216 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:25:17.216 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:25:17.216 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:25:17.216 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:25:17.216 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:25:17.216 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_items": 0, 2024-09-19T06:25:17.217 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:25:17.217 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:25:17.217 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:25:17.217 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_items": 0, 2024-09-19T06:25:17.217 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_bytes": 0, 2024-09-19T06:25:17.217 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_items": 0, 2024-09-19T06:25:17.217 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:25:17.217 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:25:17.217 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:25:17.217 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:25:17.217 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_bytes": 148977, 2024-09-19T06:25:17.217 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_items": 30, 2024-09-19T06:25:17.217 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:25:17.218 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_items": 0, 2024-09-19T06:25:17.218 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_bytes": 0, 2024-09-19T06:25:17.218 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_items": 0, 2024-09-19T06:25:17.218 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:25:17.218 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_items": 0, 2024-09-19T06:25:17.218 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:25:17.218 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_items": 0, 2024-09-19T06:25:17.218 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_bytes": 0, 2024-09-19T06:25:17.218 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_items": 0, 2024-09-19T06:25:17.218 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:25:17.218 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:25:17.218 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_bytes": 0, 2024-09-19T06:25:17.218 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_items": 0, 2024-09-19T06:25:17.219 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_bytes": 928, 2024-09-19T06:25:17.219 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_items": 2, 2024-09-19T06:25:17.219 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_bytes": 0, 2024-09-19T06:25:17.219 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_items": 0, 2024-09-19T06:25:17.219 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_bytes": 0, 2024-09-19T06:25:17.219 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_items": 0 2024-09-19T06:25:17.219 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:17.219 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:25:17.219 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-09-19T06:25:17.219 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 104857600, 2024-09-19T06:25:17.219 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-09-19T06:25:17.219 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 218, 2024-09-19T06:25:17.219 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 1416390, 2024-09-19T06:25:17.219 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:17.220 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 218, 2024-09-19T06:25:17.220 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 0, 2024-09-19T06:25:17.220 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 0, 2024-09-19T06:25:17.220 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 218, 2024-09-19T06:25:17.220 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 1416390, 2024-09-19T06:25:17.220 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-09-19T06:25:17.220 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-19T06:25:17.220 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-19T06:25:17.220 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-19T06:25:17.220 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:17.220 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:17.220 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:25:17.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:17 smithi002 ceph-mon[30982]: pgmap v327: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T06:25:17.915 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-19T06:25:17.915 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-19T06:25:17.915 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-19T06:25:17.916 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-19T06:25:17.916 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-19T06:25:17.916 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-19T06:25:17.916 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-19T06:25:17.916 DEBUG:tasks.check_counter:Getting stats from g 2024-09-19T06:25:17.916 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-19T06:25:17.989 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:17 smithi090 ceph-mon[34497]: pgmap v327: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T06:25:18.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:17 smithi089 ceph-mon[34160]: pgmap v327: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T06:25:18.177 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:25:18.698 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:25:18.698 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:25:18.698 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 4, 2024-09-19T06:25:18.698 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 4, 2024-09-19T06:25:18.698 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 3040, 2024-09-19T06:25:18.698 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 448, 2024-09-19T06:25:18.699 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 4, 2024-09-19T06:25:18.699 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 0, 2024-09-19T06:25:18.699 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.003549452, 2024-09-19T06:25:18.699 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.000043024, 2024-09-19T06:25:18.699 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.002408524, 2024-09-19T06:25:18.699 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:25:18.699 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:25:18.699 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 3, 2024-09-19T06:25:18.699 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.004209486, 2024-09-19T06:25:18.699 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.001403162 2024-09-19T06:25:18.699 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:18.699 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:25:18.700 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-19T06:25:18.700 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-19T06:25:18.700 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-19T06:25:18.700 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:18.700 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-09-19T06:25:18.700 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T06:25:18.700 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:18.700 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:25:18.700 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 212, 2024-09-19T06:25:18.701 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 202, 2024-09-19T06:25:18.701 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 1445776, 2024-09-19T06:25:18.701 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 124064, 2024-09-19T06:25:18.701 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 2, 2024-09-19T06:25:18.701 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 1, 2024-09-19T06:25:18.701 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.038412623, 2024-09-19T06:25:18.701 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.013238532, 2024-09-19T06:25:18.701 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.037109695, 2024-09-19T06:25:18.701 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:25:18.701 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:25:18.701 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 201, 2024-09-19T06:25:18.701 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.010622488, 2024-09-19T06:25:18.702 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000052848 2024-09-19T06:25:18.702 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:18.702 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:25:18.702 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-19T06:25:18.702 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-19T06:25:18.702 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-19T06:25:18.702 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:18.702 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 1445776, 2024-09-19T06:25:18.702 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 124064 2024-09-19T06:25:18.702 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:18.702 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:25:18.702 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 2, 2024-09-19T06:25:18.702 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 155, 2024-09-19T06:25:18.703 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 320, 2024-09-19T06:25:18.703 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 184512, 2024-09-19T06:25:18.703 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 5, 2024-09-19T06:25:18.703 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 3, 2024-09-19T06:25:18.703 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.013880413, 2024-09-19T06:25:18.703 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.009291385, 2024-09-19T06:25:18.703 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.002325476, 2024-09-19T06:25:18.703 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:25:18.703 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:25:18.703 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 152, 2024-09-19T06:25:18.703 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.011372922, 2024-09-19T06:25:18.703 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000074821 2024-09-19T06:25:18.703 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:18.703 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:25:18.704 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-19T06:25:18.704 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-19T06:25:18.704 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-19T06:25:18.704 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:18.704 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T06:25:18.704 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 184512 2024-09-19T06:25:18.704 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:18.704 INFO:teuthology.orchestra.run.smithi002.stdout: "cct": { 2024-09-19T06:25:18.704 INFO:teuthology.orchestra.run.smithi002.stdout: "total_workers": 0, 2024-09-19T06:25:18.704 INFO:teuthology.orchestra.run.smithi002.stdout: "unhealthy_workers": 0 2024-09-19T06:25:18.704 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:18.704 INFO:teuthology.orchestra.run.smithi002.stdout: "mempool": { 2024-09-19T06:25:18.704 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:25:18.705 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_items": 0, 2024-09-19T06:25:18.705 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:25:18.705 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:25:18.705 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:25:18.705 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:25:18.705 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:25:18.705 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:25:18.705 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:25:18.705 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:25:18.706 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:25:18.706 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:25:18.706 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:25:18.706 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:25:18.706 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:25:18.706 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_items": 0, 2024-09-19T06:25:18.706 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:25:18.706 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_items": 0, 2024-09-19T06:25:18.706 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:25:18.706 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:25:18.706 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:25:18.706 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:25:18.706 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:25:18.706 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:25:18.707 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:25:18.707 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_items": 0, 2024-09-19T06:25:18.707 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:25:18.707 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:25:18.707 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:25:18.707 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_items": 0, 2024-09-19T06:25:18.707 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_bytes": 0, 2024-09-19T06:25:18.707 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_items": 0, 2024-09-19T06:25:18.707 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:25:18.707 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:25:18.708 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:25:18.708 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:25:18.708 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_bytes": 148977, 2024-09-19T06:25:18.708 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_items": 30, 2024-09-19T06:25:18.708 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:25:18.708 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_items": 0, 2024-09-19T06:25:18.708 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_bytes": 0, 2024-09-19T06:25:18.708 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_items": 0, 2024-09-19T06:25:18.708 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:25:18.708 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_items": 0, 2024-09-19T06:25:18.708 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:25:18.708 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_items": 0, 2024-09-19T06:25:18.709 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_bytes": 0, 2024-09-19T06:25:18.709 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_items": 0, 2024-09-19T06:25:18.709 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:25:18.709 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:25:18.709 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_bytes": 0, 2024-09-19T06:25:18.709 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_items": 0, 2024-09-19T06:25:18.709 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_bytes": 928, 2024-09-19T06:25:18.709 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_items": 2, 2024-09-19T06:25:18.709 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_bytes": 0, 2024-09-19T06:25:18.709 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_items": 0, 2024-09-19T06:25:18.709 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_bytes": 0, 2024-09-19T06:25:18.709 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_items": 0 2024-09-19T06:25:18.709 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:18.710 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:25:18.710 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-09-19T06:25:18.710 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 104857600, 2024-09-19T06:25:18.710 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-09-19T06:25:18.710 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 214, 2024-09-19T06:25:18.710 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 1415870, 2024-09-19T06:25:18.710 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:18.710 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 214, 2024-09-19T06:25:18.710 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 0, 2024-09-19T06:25:18.710 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 0, 2024-09-19T06:25:18.710 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 214, 2024-09-19T06:25:18.711 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 1415870, 2024-09-19T06:25:18.711 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-09-19T06:25:18.711 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-19T06:25:18.711 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-19T06:25:18.711 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-19T06:25:18.711 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:18.711 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:18.711 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:25:19.372 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:19 smithi002 ceph-mon[30982]: pgmap v328: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 214 B/s wr, 6 op/s 2024-09-19T06:25:19.404 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-19T06:25:19.404 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-19T06:25:19.404 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-09-19T06:25:19.404 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-09-19T06:25:19.404 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-09-19T06:25:19.404 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-09-19T06:25:19.404 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-09-19T06:25:19.404 DEBUG:tasks.check_counter:Getting stats from j 2024-09-19T06:25:19.405 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-19T06:25:19.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:19 smithi089 ceph-mon[34160]: pgmap v328: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 214 B/s wr, 6 op/s 2024-09-19T06:25:19.663 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:25:19.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:19 smithi090 ceph-mon[34497]: pgmap v328: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 214 B/s wr, 6 op/s 2024-09-19T06:25:20.115 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-19T06:25:20.115 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:25:20.115 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 217, 2024-09-19T06:25:20.115 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 207, 2024-09-19T06:25:20.115 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 1447136, 2024-09-19T06:25:20.115 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 127264, 2024-09-19T06:25:20.115 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 4, 2024-09-19T06:25:20.116 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 0, 2024-09-19T06:25:20.116 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.042537013, 2024-09-19T06:25:20.116 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.015152014, 2024-09-19T06:25:20.116 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.038232286, 2024-09-19T06:25:20.116 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:25:20.116 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:25:20.116 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 206, 2024-09-19T06:25:20.116 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.011422651, 2024-09-19T06:25:20.116 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000055449 2024-09-19T06:25:20.116 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:20.116 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:25:20.116 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-19T06:25:20.117 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-19T06:25:20.117 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-19T06:25:20.117 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:20.117 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 1447136, 2024-09-19T06:25:20.117 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 127264 2024-09-19T06:25:20.117 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:20.117 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:25:20.117 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 2, 2024-09-19T06:25:20.117 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 159, 2024-09-19T06:25:20.117 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 320, 2024-09-19T06:25:20.117 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 185216, 2024-09-19T06:25:20.117 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 5, 2024-09-19T06:25:20.117 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 3, 2024-09-19T06:25:20.118 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.013562857, 2024-09-19T06:25:20.118 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.009153861, 2024-09-19T06:25:20.118 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.002123827, 2024-09-19T06:25:20.118 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:25:20.118 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:25:20.118 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 156, 2024-09-19T06:25:20.118 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.013149997, 2024-09-19T06:25:20.118 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000084294 2024-09-19T06:25:20.118 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:20.118 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:25:20.118 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-19T06:25:20.118 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-19T06:25:20.118 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-19T06:25:20.119 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:20.119 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T06:25:20.119 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 185216 2024-09-19T06:25:20.119 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:20.119 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:25:20.119 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 4, 2024-09-19T06:25:20.119 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 4, 2024-09-19T06:25:20.119 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 3040, 2024-09-19T06:25:20.119 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 448, 2024-09-19T06:25:20.119 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 2, 2024-09-19T06:25:20.119 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 1, 2024-09-19T06:25:20.119 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.003574696, 2024-09-19T06:25:20.119 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.000050789, 2024-09-19T06:25:20.120 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.003500195, 2024-09-19T06:25:20.120 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:25:20.120 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:25:20.120 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 3, 2024-09-19T06:25:20.120 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.006337177, 2024-09-19T06:25:20.120 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.002112392 2024-09-19T06:25:20.120 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:20.120 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:25:20.120 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-19T06:25:20.120 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-19T06:25:20.120 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-19T06:25:20.120 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:20.121 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-09-19T06:25:20.121 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T06:25:20.121 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:20.121 INFO:teuthology.orchestra.run.smithi002.stdout: "cct": { 2024-09-19T06:25:20.121 INFO:teuthology.orchestra.run.smithi002.stdout: "total_workers": 0, 2024-09-19T06:25:20.121 INFO:teuthology.orchestra.run.smithi002.stdout: "unhealthy_workers": 0 2024-09-19T06:25:20.121 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:20.121 INFO:teuthology.orchestra.run.smithi002.stdout: "mempool": { 2024-09-19T06:25:20.121 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:25:20.121 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_items": 0, 2024-09-19T06:25:20.122 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:25:20.122 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:25:20.122 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:25:20.122 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:25:20.122 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:25:20.122 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:25:20.122 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:25:20.122 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:25:20.122 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:25:20.122 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:25:20.122 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:25:20.122 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:25:20.122 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:25:20.123 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_items": 0, 2024-09-19T06:25:20.123 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:25:20.123 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_items": 0, 2024-09-19T06:25:20.123 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:25:20.123 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:25:20.123 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:25:20.123 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:25:20.123 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:25:20.123 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:25:20.123 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:25:20.123 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_items": 0, 2024-09-19T06:25:20.123 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:25:20.123 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:25:20.124 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:25:20.124 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_items": 0, 2024-09-19T06:25:20.124 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_bytes": 0, 2024-09-19T06:25:20.124 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_items": 0, 2024-09-19T06:25:20.124 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:25:20.124 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:25:20.124 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:25:20.124 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:25:20.124 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_bytes": 148977, 2024-09-19T06:25:20.124 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_items": 30, 2024-09-19T06:25:20.124 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:25:20.124 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_items": 0, 2024-09-19T06:25:20.124 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_bytes": 0, 2024-09-19T06:25:20.125 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_items": 0, 2024-09-19T06:25:20.125 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:25:20.125 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_items": 0, 2024-09-19T06:25:20.125 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:25:20.125 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_items": 0, 2024-09-19T06:25:20.125 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_bytes": 0, 2024-09-19T06:25:20.125 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_items": 0, 2024-09-19T06:25:20.125 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:25:20.125 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:25:20.125 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_bytes": 0, 2024-09-19T06:25:20.125 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_items": 0, 2024-09-19T06:25:20.125 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_bytes": 928, 2024-09-19T06:25:20.125 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_items": 2, 2024-09-19T06:25:20.125 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_bytes": 0, 2024-09-19T06:25:20.126 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_items": 0, 2024-09-19T06:25:20.126 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_bytes": 0, 2024-09-19T06:25:20.126 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_items": 0 2024-09-19T06:25:20.126 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-19T06:25:20.126 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:25:20.126 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-09-19T06:25:20.126 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 104857600, 2024-09-19T06:25:20.126 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-09-19T06:25:20.126 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 219, 2024-09-19T06:25:20.126 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 1416520, 2024-09-19T06:25:20.126 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:20.126 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 219, 2024-09-19T06:25:20.126 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 0, 2024-09-19T06:25:20.127 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 0, 2024-09-19T06:25:20.127 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 219, 2024-09-19T06:25:20.127 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 1416520, 2024-09-19T06:25:20.127 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-09-19T06:25:20.127 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-19T06:25:20.127 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-19T06:25:20.127 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-19T06:25:20.127 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:20.127 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-19T06:25:20.127 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-19T06:25:20.829 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-19T06:25:20.829 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-19T06:25:20.829 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-19T06:25:20.829 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-19T06:25:20.830 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-19T06:25:20.830 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-19T06:25:20.830 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-19T06:25:20.830 DEBUG:tasks.check_counter:Getting stats from b 2024-09-19T06:25:20.830 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-19T06:25:21.087 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:25:21.477 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:21 smithi089 ceph-mon[34160]: pgmap v329: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T06:25:21.706 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-19T06:25:21.706 INFO:teuthology.orchestra.run.smithi089.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:25:21.706 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_messages": 2763, 2024-09-19T06:25:21.706 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages": 1918, 2024-09-19T06:25:21.706 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_bytes": 2325470, 2024-09-19T06:25:21.706 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_bytes": 3538164, 2024-09-19T06:25:21.707 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_created_connections": 243, 2024-09-19T06:25:21.707 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_active_connections": 7, 2024-09-19T06:25:21.707 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_total_time": 0.345260482, 2024-09-19T06:25:21.707 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_send_time": 0.078014533, 2024-09-19T06:25:21.707 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_recv_time": 0.185666015, 2024-09-19T06:25:21.707 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_fast_dispatch_time": 0.074553118, 2024-09-19T06:25:21.707 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:25:21.707 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 1916, 2024-09-19T06:25:21.707 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.300447266, 2024-09-19T06:25:21.707 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000156809 2024-09-19T06:25:21.707 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.707 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:25:21.707 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 1543, 2024-09-19T06:25:21.708 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000305935, 2024-09-19T06:25:21.708 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000198 2024-09-19T06:25:21.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.708 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_encrypted_bytes": 1976960, 2024-09-19T06:25:21.708 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_encrypted_bytes": 308224 2024-09-19T06:25:21.708 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.708 INFO:teuthology.orchestra.run.smithi089.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:25:21.708 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_messages": 2660, 2024-09-19T06:25:21.708 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages": 2285, 2024-09-19T06:25:21.708 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_bytes": 791423, 2024-09-19T06:25:21.708 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_bytes": 1485883, 2024-09-19T06:25:21.708 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_created_connections": 35, 2024-09-19T06:25:21.709 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_active_connections": 8, 2024-09-19T06:25:21.709 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_total_time": 0.217989063, 2024-09-19T06:25:21.709 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_send_time": 0.053384061, 2024-09-19T06:25:21.709 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_recv_time": 0.071272535, 2024-09-19T06:25:21.709 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_fast_dispatch_time": 0.082180733, 2024-09-19T06:25:21.709 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:25:21.709 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 2280, 2024-09-19T06:25:21.709 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.357369580, 2024-09-19T06:25:21.709 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000156741 2024-09-19T06:25:21.709 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.709 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:25:21.709 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 935, 2024-09-19T06:25:21.709 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000200918, 2024-09-19T06:25:21.710 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000214 2024-09-19T06:25:21.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.710 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T06:25:21.710 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_encrypted_bytes": 442832 2024-09-19T06:25:21.710 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.710 INFO:teuthology.orchestra.run.smithi089.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:25:21.710 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_messages": 2644, 2024-09-19T06:25:21.710 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages": 2430, 2024-09-19T06:25:21.710 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_bytes": 926541, 2024-09-19T06:25:21.710 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_bytes": 1520992, 2024-09-19T06:25:21.710 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_created_connections": 9, 2024-09-19T06:25:21.710 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_active_connections": 5, 2024-09-19T06:25:21.710 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_total_time": 0.214332034, 2024-09-19T06:25:21.711 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_send_time": 0.078708530, 2024-09-19T06:25:21.711 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_recv_time": 0.103531237, 2024-09-19T06:25:21.711 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_fast_dispatch_time": 0.041150771, 2024-09-19T06:25:21.711 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:25:21.711 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 2432, 2024-09-19T06:25:21.711 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.429802155, 2024-09-19T06:25:21.711 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000176727 2024-09-19T06:25:21.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.711 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:25:21.711 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 2152, 2024-09-19T06:25:21.711 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000401685, 2024-09-19T06:25:21.711 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000186 2024-09-19T06:25:21.711 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.712 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_encrypted_bytes": 45136, 2024-09-19T06:25:21.712 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_encrypted_bytes": 2864 2024-09-19T06:25:21.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.712 INFO:teuthology.orchestra.run.smithi089.stdout: "cct": { 2024-09-19T06:25:21.712 INFO:teuthology.orchestra.run.smithi089.stdout: "total_workers": 1, 2024-09-19T06:25:21.712 INFO:teuthology.orchestra.run.smithi089.stdout: "unhealthy_workers": 0 2024-09-19T06:25:21.712 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.712 INFO:teuthology.orchestra.run.smithi089.stdout: "finisher-MDSRank": { 2024-09-19T06:25:21.712 INFO:teuthology.orchestra.run.smithi089.stdout: "queue_len": 0, 2024-09-19T06:25:21.712 INFO:teuthology.orchestra.run.smithi089.stdout: "complete_latency": { 2024-09-19T06:25:21.712 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 904, 2024-09-19T06:25:21.713 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.197606431, 2024-09-19T06:25:21.713 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000218591 2024-09-19T06:25:21.713 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-19T06:25:21.713 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.713 INFO:teuthology.orchestra.run.smithi089.stdout: "finisher-PurgeQueue": { 2024-09-19T06:25:21.713 INFO:teuthology.orchestra.run.smithi089.stdout: "queue_len": 0, 2024-09-19T06:25:21.713 INFO:teuthology.orchestra.run.smithi089.stdout: "complete_latency": { 2024-09-19T06:25:21.713 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 2913, 2024-09-19T06:25:21.713 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.081487591, 2024-09-19T06:25:21.713 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000027973 2024-09-19T06:25:21.713 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-19T06:25:21.713 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.713 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-19T06:25:21.714 INFO:teuthology.orchestra.run.smithi089.stdout: "request": 178, 2024-09-19T06:25:21.714 INFO:teuthology.orchestra.run.smithi089.stdout: "reply": 178, 2024-09-19T06:25:21.714 INFO:teuthology.orchestra.run.smithi089.stdout: "reply_latency": { 2024-09-19T06:25:21.714 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 178, 2024-09-19T06:25:21.714 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.169673175, 2024-09-19T06:25:21.714 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000953220 2024-09-19T06:25:21.714 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.714 INFO:teuthology.orchestra.run.smithi089.stdout: "slow_reply": 0, 2024-09-19T06:25:21.714 INFO:teuthology.orchestra.run.smithi089.stdout: "forward": 0, 2024-09-19T06:25:21.714 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_fetch_complete": 0, 2024-09-19T06:25:21.714 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_fetch_keys": 0, 2024-09-19T06:25:21.714 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_commit": 84, 2024-09-19T06:25:21.715 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_split": 0, 2024-09-19T06:25:21.715 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_merge": 0, 2024-09-19T06:25:21.715 INFO:teuthology.orchestra.run.smithi089.stdout: "inodes": 32, 2024-09-19T06:25:21.715 INFO:teuthology.orchestra.run.smithi089.stdout: "inodes_top": 7, 2024-09-19T06:25:21.715 INFO:teuthology.orchestra.run.smithi089.stdout: "inodes_bottom": 25, 2024-09-19T06:25:21.715 INFO:teuthology.orchestra.run.smithi089.stdout: "inodes_pin_tail": 0, 2024-09-19T06:25:21.715 INFO:teuthology.orchestra.run.smithi089.stdout: "inodes_pinned": 22, 2024-09-19T06:25:21.715 INFO:teuthology.orchestra.run.smithi089.stdout: "inodes_expired": 0, 2024-09-19T06:25:21.715 INFO:teuthology.orchestra.run.smithi089.stdout: "inodes_with_caps": 3, 2024-09-19T06:25:21.715 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": 3, 2024-09-19T06:25:21.715 INFO:teuthology.orchestra.run.smithi089.stdout: "subtrees": 2, 2024-09-19T06:25:21.715 INFO:teuthology.orchestra.run.smithi089.stdout: "traverse": 258, 2024-09-19T06:25:21.715 INFO:teuthology.orchestra.run.smithi089.stdout: "traverse_hit": 246, 2024-09-19T06:25:21.715 INFO:teuthology.orchestra.run.smithi089.stdout: "traverse_forward": 0, 2024-09-19T06:25:21.716 INFO:teuthology.orchestra.run.smithi089.stdout: "traverse_discover": 0, 2024-09-19T06:25:21.716 INFO:teuthology.orchestra.run.smithi089.stdout: "traverse_dir_fetch": 0, 2024-09-19T06:25:21.716 INFO:teuthology.orchestra.run.smithi089.stdout: "traverse_remote_ino": 0, 2024-09-19T06:25:21.716 INFO:teuthology.orchestra.run.smithi089.stdout: "traverse_lock": 0, 2024-09-19T06:25:21.716 INFO:teuthology.orchestra.run.smithi089.stdout: "load_cent": 0, 2024-09-19T06:25:21.716 INFO:teuthology.orchestra.run.smithi089.stdout: "q": 0, 2024-09-19T06:25:21.716 INFO:teuthology.orchestra.run.smithi089.stdout: "exported": 0, 2024-09-19T06:25:21.716 INFO:teuthology.orchestra.run.smithi089.stdout: "exported_inodes": 0, 2024-09-19T06:25:21.716 INFO:teuthology.orchestra.run.smithi089.stdout: "imported": 0, 2024-09-19T06:25:21.716 INFO:teuthology.orchestra.run.smithi089.stdout: "imported_inodes": 0, 2024-09-19T06:25:21.716 INFO:teuthology.orchestra.run.smithi089.stdout: "openino_dir_fetch": 0, 2024-09-19T06:25:21.716 INFO:teuthology.orchestra.run.smithi089.stdout: "openino_backtrace_fetch": 398, 2024-09-19T06:25:21.717 INFO:teuthology.orchestra.run.smithi089.stdout: "openino_peer_discover": 0, 2024-09-19T06:25:21.717 INFO:teuthology.orchestra.run.smithi089.stdout: "root_rfiles": 4, 2024-09-19T06:25:21.717 INFO:teuthology.orchestra.run.smithi089.stdout: "root_rbytes": 234, 2024-09-19T06:25:21.717 INFO:teuthology.orchestra.run.smithi089.stdout: "root_rsnaps": 6, 2024-09-19T06:25:21.717 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_backtrace_fetch": 398, 2024-09-19T06:25:21.717 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_set_tag": 0, 2024-09-19T06:25:21.717 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T06:25:21.717 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_inotable_repaired": 0, 2024-09-19T06:25:21.717 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_dir_inodes": 254, 2024-09-19T06:25:21.717 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_dir_base_inodes": 35, 2024-09-19T06:25:21.717 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_dirfrag_rstats": 219, 2024-09-19T06:25:21.717 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_file_inodes": 144, 2024-09-19T06:25:21.717 INFO:teuthology.orchestra.run.smithi089.stdout: "handle_inode_file_caps": 0, 2024-09-19T06:25:21.717 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_cap_op_revoke": 18, 2024-09-19T06:25:21.718 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_cap_op_grant": 73, 2024-09-19T06:25:21.718 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T06:25:21.718 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T06:25:21.718 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T06:25:21.718 INFO:teuthology.orchestra.run.smithi089.stdout: "handle_client_caps": 83, 2024-09-19T06:25:21.718 INFO:teuthology.orchestra.run.smithi089.stdout: "handle_client_caps_dirty": 60, 2024-09-19T06:25:21.718 INFO:teuthology.orchestra.run.smithi089.stdout: "handle_client_cap_release": 3, 2024-09-19T06:25:21.718 INFO:teuthology.orchestra.run.smithi089.stdout: "process_request_cap_release": 32 2024-09-19T06:25:21.718 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.718 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_cache": { 2024-09-19T06:25:21.718 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_update": 7, 2024-09-19T06:25:21.718 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_update_receipt": 0, 2024-09-19T06:25:21.718 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_try_discover": 0, 2024-09-19T06:25:21.719 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_send_discover": 0, 2024-09-19T06:25:21.719 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_handle_discover": 15, 2024-09-19T06:25:21.719 INFO:teuthology.orchestra.run.smithi089.stdout: "num_strays": 2, 2024-09-19T06:25:21.719 INFO:teuthology.orchestra.run.smithi089.stdout: "num_strays_delayed": 0, 2024-09-19T06:25:21.719 INFO:teuthology.orchestra.run.smithi089.stdout: "num_strays_enqueuing": 0, 2024-09-19T06:25:21.719 INFO:teuthology.orchestra.run.smithi089.stdout: "strays_created": 5, 2024-09-19T06:25:21.719 INFO:teuthology.orchestra.run.smithi089.stdout: "strays_enqueued": 3, 2024-09-19T06:25:21.719 INFO:teuthology.orchestra.run.smithi089.stdout: "strays_reintegrated": 0, 2024-09-19T06:25:21.719 INFO:teuthology.orchestra.run.smithi089.stdout: "strays_migrated": 0, 2024-09-19T06:25:21.719 INFO:teuthology.orchestra.run.smithi089.stdout: "num_recovering_processing": 0, 2024-09-19T06:25:21.719 INFO:teuthology.orchestra.run.smithi089.stdout: "num_recovering_enqueued": 0, 2024-09-19T06:25:21.719 INFO:teuthology.orchestra.run.smithi089.stdout: "num_recovering_prioritized": 0, 2024-09-19T06:25:21.719 INFO:teuthology.orchestra.run.smithi089.stdout: "recovery_started": 0, 2024-09-19T06:25:21.719 INFO:teuthology.orchestra.run.smithi089.stdout: "recovery_completed": 0, 2024-09-19T06:25:21.720 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_quiesce_path": 0, 2024-09-19T06:25:21.720 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_quiesce_inode": 0, 2024-09-19T06:25:21.720 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_enqueue_scrub": 35, 2024-09-19T06:25:21.720 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_exportdir": 0, 2024-09-19T06:25:21.720 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_flush": 0, 2024-09-19T06:25:21.720 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_fragmentdir": 0, 2024-09-19T06:25:21.720 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_fragstats": 0, 2024-09-19T06:25:21.720 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_inodestats": 0 2024-09-19T06:25:21.720 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.720 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_log": { 2024-09-19T06:25:21.720 INFO:teuthology.orchestra.run.smithi089.stdout: "evlrg": 0, 2024-09-19T06:25:21.720 INFO:teuthology.orchestra.run.smithi089.stdout: "evadd": 215, 2024-09-19T06:25:21.721 INFO:teuthology.orchestra.run.smithi089.stdout: "evex": 150, 2024-09-19T06:25:21.721 INFO:teuthology.orchestra.run.smithi089.stdout: "evtrm": 150, 2024-09-19T06:25:21.721 INFO:teuthology.orchestra.run.smithi089.stdout: "ev": 65, 2024-09-19T06:25:21.721 INFO:teuthology.orchestra.run.smithi089.stdout: "evexg": 0, 2024-09-19T06:25:21.721 INFO:teuthology.orchestra.run.smithi089.stdout: "evexd": 3, 2024-09-19T06:25:21.721 INFO:teuthology.orchestra.run.smithi089.stdout: "segadd": 14, 2024-09-19T06:25:21.721 INFO:teuthology.orchestra.run.smithi089.stdout: "segex": 13, 2024-09-19T06:25:21.721 INFO:teuthology.orchestra.run.smithi089.stdout: "segtrm": 13, 2024-09-19T06:25:21.721 INFO:teuthology.orchestra.run.smithi089.stdout: "seg": 1, 2024-09-19T06:25:21.721 INFO:teuthology.orchestra.run.smithi089.stdout: "segmjr": 1, 2024-09-19T06:25:21.721 INFO:teuthology.orchestra.run.smithi089.stdout: "segexg": 0, 2024-09-19T06:25:21.721 INFO:teuthology.orchestra.run.smithi089.stdout: "segexd": 1, 2024-09-19T06:25:21.721 INFO:teuthology.orchestra.run.smithi089.stdout: "expos": 4793665, 2024-09-19T06:25:21.721 INFO:teuthology.orchestra.run.smithi089.stdout: "wrpos": 4884473, 2024-09-19T06:25:21.722 INFO:teuthology.orchestra.run.smithi089.stdout: "rdpos": 0, 2024-09-19T06:25:21.722 INFO:teuthology.orchestra.run.smithi089.stdout: "jlat": { 2024-09-19T06:25:21.722 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 178, 2024-09-19T06:25:21.722 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.645598447, 2024-09-19T06:25:21.722 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.003626957 2024-09-19T06:25:21.722 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.722 INFO:teuthology.orchestra.run.smithi089.stdout: "replayed": 0 2024-09-19T06:25:21.722 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.722 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_mem": { 2024-09-19T06:25:21.722 INFO:teuthology.orchestra.run.smithi089.stdout: "ino": 26, 2024-09-19T06:25:21.722 INFO:teuthology.orchestra.run.smithi089.stdout: "ino+": 64, 2024-09-19T06:25:21.722 INFO:teuthology.orchestra.run.smithi089.stdout: "ino-": 38, 2024-09-19T06:25:21.723 INFO:teuthology.orchestra.run.smithi089.stdout: "dir": 20, 2024-09-19T06:25:21.723 INFO:teuthology.orchestra.run.smithi089.stdout: "dir+": 20, 2024-09-19T06:25:21.723 INFO:teuthology.orchestra.run.smithi089.stdout: "dir-": 0, 2024-09-19T06:25:21.723 INFO:teuthology.orchestra.run.smithi089.stdout: "dn": 32, 2024-09-19T06:25:21.723 INFO:teuthology.orchestra.run.smithi089.stdout: "dn+": 37, 2024-09-19T06:25:21.723 INFO:teuthology.orchestra.run.smithi089.stdout: "dn-": 5, 2024-09-19T06:25:21.723 INFO:teuthology.orchestra.run.smithi089.stdout: "cap": 3, 2024-09-19T06:25:21.723 INFO:teuthology.orchestra.run.smithi089.stdout: "cap+": 24, 2024-09-19T06:25:21.723 INFO:teuthology.orchestra.run.smithi089.stdout: "cap-": 21, 2024-09-19T06:25:21.723 INFO:teuthology.orchestra.run.smithi089.stdout: "rss": 54260, 2024-09-19T06:25:21.723 INFO:teuthology.orchestra.run.smithi089.stdout: "heap": 231712 2024-09-19T06:25:21.723 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.723 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_server": { 2024-09-19T06:25:21.724 INFO:teuthology.orchestra.run.smithi089.stdout: "dispatch_client_request": 232, 2024-09-19T06:25:21.724 INFO:teuthology.orchestra.run.smithi089.stdout: "dispatch_server_request": 1, 2024-09-19T06:25:21.724 INFO:teuthology.orchestra.run.smithi089.stdout: "handle_client_request": 178, 2024-09-19T06:25:21.724 INFO:teuthology.orchestra.run.smithi089.stdout: "handle_client_session": 36, 2024-09-19T06:25:21.724 INFO:teuthology.orchestra.run.smithi089.stdout: "handle_peer_request": 2, 2024-09-19T06:25:21.724 INFO:teuthology.orchestra.run.smithi089.stdout: "req_create_latency": { 2024-09-19T06:25:21.724 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 7, 2024-09-19T06:25:21.724 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.008074091, 2024-09-19T06:25:21.724 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.001153441 2024-09-19T06:25:21.724 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.724 INFO:teuthology.orchestra.run.smithi089.stdout: "req_getattr_latency": { 2024-09-19T06:25:21.725 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 113, 2024-09-19T06:25:21.725 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.021290152, 2024-09-19T06:25:21.725 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000188408 2024-09-19T06:25:21.725 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.725 INFO:teuthology.orchestra.run.smithi089.stdout: "req_getfilelock_latency": { 2024-09-19T06:25:21.725 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:21.725 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:21.725 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:21.725 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.725 INFO:teuthology.orchestra.run.smithi089.stdout: "req_link_latency": { 2024-09-19T06:25:21.725 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:21.725 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:21.726 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:21.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.726 INFO:teuthology.orchestra.run.smithi089.stdout: "req_lookup_latency": { 2024-09-19T06:25:21.726 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 4, 2024-09-19T06:25:21.726 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000600508, 2024-09-19T06:25:21.726 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000150127 2024-09-19T06:25:21.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.726 INFO:teuthology.orchestra.run.smithi089.stdout: "req_lookuphash_latency": { 2024-09-19T06:25:21.726 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:21.726 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:21.726 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:21.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.726 INFO:teuthology.orchestra.run.smithi089.stdout: "req_lookupino_latency": { 2024-09-19T06:25:21.726 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:21.727 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:21.727 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:21.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.727 INFO:teuthology.orchestra.run.smithi089.stdout: "req_lookupname_latency": { 2024-09-19T06:25:21.727 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:21.727 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:21.727 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:21.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.727 INFO:teuthology.orchestra.run.smithi089.stdout: "req_lookupparent_latency": { 2024-09-19T06:25:21.727 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:21.728 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:21.728 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:21.728 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.728 INFO:teuthology.orchestra.run.smithi089.stdout: "req_lookupsnap_latency": { 2024-09-19T06:25:21.728 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:21.728 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:21.728 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:21.728 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.728 INFO:teuthology.orchestra.run.smithi089.stdout: "req_lssnap_latency": { 2024-09-19T06:25:21.728 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 11, 2024-09-19T06:25:21.728 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.001504250, 2024-09-19T06:25:21.728 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000136750 2024-09-19T06:25:21.729 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:21 smithi002 ceph-mon[30982]: pgmap v329: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T06:25:21.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.730 INFO:teuthology.orchestra.run.smithi089.stdout: "req_mkdir_latency": { 2024-09-19T06:25:21.730 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 8, 2024-09-19T06:25:21.730 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.014545362, 2024-09-19T06:25:21.730 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.001818170 2024-09-19T06:25:21.730 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.730 INFO:teuthology.orchestra.run.smithi089.stdout: "req_mknod_latency": { 2024-09-19T06:25:21.730 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:21.730 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:21.730 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:21.731 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.731 INFO:teuthology.orchestra.run.smithi089.stdout: "req_mksnap_latency": { 2024-09-19T06:25:21.731 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 11, 2024-09-19T06:25:21.731 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.057213804, 2024-09-19T06:25:21.731 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.005201254 2024-09-19T06:25:21.731 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.731 INFO:teuthology.orchestra.run.smithi089.stdout: "req_open_latency": { 2024-09-19T06:25:21.731 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 1, 2024-09-19T06:25:21.731 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000843756, 2024-09-19T06:25:21.731 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000843756 2024-09-19T06:25:21.731 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.731 INFO:teuthology.orchestra.run.smithi089.stdout: "req_readdir_latency": { 2024-09-19T06:25:21.731 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 2, 2024-09-19T06:25:21.732 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.006167315, 2024-09-19T06:25:21.732 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.003083657 2024-09-19T06:25:21.732 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.732 INFO:teuthology.orchestra.run.smithi089.stdout: "req_rename_latency": { 2024-09-19T06:25:21.732 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 2, 2024-09-19T06:25:21.732 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.002781228, 2024-09-19T06:25:21.732 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.001390614 2024-09-19T06:25:21.732 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.732 INFO:teuthology.orchestra.run.smithi089.stdout: "req_renamesnap_latency": { 2024-09-19T06:25:21.732 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:21.732 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:21.732 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:21.732 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.733 INFO:teuthology.orchestra.run.smithi089.stdout: "req_snapdiff_latency": { 2024-09-19T06:25:21.733 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:21.733 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:21.733 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:21.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.733 INFO:teuthology.orchestra.run.smithi089.stdout: "req_rmdir_latency": { 2024-09-19T06:25:21.733 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 2, 2024-09-19T06:25:21.733 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.006236257, 2024-09-19T06:25:21.733 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.003118128 2024-09-19T06:25:21.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.733 INFO:teuthology.orchestra.run.smithi089.stdout: "req_rmsnap_latency": { 2024-09-19T06:25:21.733 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 5, 2024-09-19T06:25:21.733 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.020848447, 2024-09-19T06:25:21.734 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.004169689 2024-09-19T06:25:21.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.734 INFO:teuthology.orchestra.run.smithi089.stdout: "req_rmxattr_latency": { 2024-09-19T06:25:21.734 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:21.734 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:21.734 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:21.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.734 INFO:teuthology.orchestra.run.smithi089.stdout: "req_setattr_latency": { 2024-09-19T06:25:21.734 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 1, 2024-09-19T06:25:21.734 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000832150, 2024-09-19T06:25:21.734 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000832150 2024-09-19T06:25:21.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.734 INFO:teuthology.orchestra.run.smithi089.stdout: "req_setdirlayout_latency": { 2024-09-19T06:25:21.735 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:21.735 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:21.735 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:21.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.735 INFO:teuthology.orchestra.run.smithi089.stdout: "req_setfilelock_latency": { 2024-09-19T06:25:21.735 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:21.735 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:21.735 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:21.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.735 INFO:teuthology.orchestra.run.smithi089.stdout: "req_setlayout_latency": { 2024-09-19T06:25:21.735 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:21.735 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:21.735 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:21.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.736 INFO:teuthology.orchestra.run.smithi089.stdout: "req_setxattr_latency": { 2024-09-19T06:25:21.736 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 8, 2024-09-19T06:25:21.736 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.022380384, 2024-09-19T06:25:21.736 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.002797548 2024-09-19T06:25:21.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.736 INFO:teuthology.orchestra.run.smithi089.stdout: "req_symlink_latency": { 2024-09-19T06:25:21.736 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:21.736 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:21.736 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:21.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.736 INFO:teuthology.orchestra.run.smithi089.stdout: "req_unlink_latency": { 2024-09-19T06:25:21.736 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 3, 2024-09-19T06:25:21.737 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.006355471, 2024-09-19T06:25:21.737 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.002118490 2024-09-19T06:25:21.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.737 INFO:teuthology.orchestra.run.smithi089.stdout: "cap_revoke_eviction": 0, 2024-09-19T06:25:21.737 INFO:teuthology.orchestra.run.smithi089.stdout: "cap_acquisition_throttle": 0, 2024-09-19T06:25:21.737 INFO:teuthology.orchestra.run.smithi089.stdout: "req_getvxattr_latency": { 2024-09-19T06:25:21.737 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:21.737 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:21.737 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:21.737 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-19T06:25:21.737 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.737 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_sessions": { 2024-09-19T06:25:21.737 INFO:teuthology.orchestra.run.smithi089.stdout: "session_count": 2, 2024-09-19T06:25:21.738 INFO:teuthology.orchestra.run.smithi089.stdout: "session_add": 6, 2024-09-19T06:25:21.738 INFO:teuthology.orchestra.run.smithi089.stdout: "session_remove": 4, 2024-09-19T06:25:21.738 INFO:teuthology.orchestra.run.smithi089.stdout: "sessions_open": 2, 2024-09-19T06:25:21.738 INFO:teuthology.orchestra.run.smithi089.stdout: "sessions_stale": 0, 2024-09-19T06:25:21.738 INFO:teuthology.orchestra.run.smithi089.stdout: "total_load": 27, 2024-09-19T06:25:21.738 INFO:teuthology.orchestra.run.smithi089.stdout: "average_load": 13, 2024-09-19T06:25:21.738 INFO:teuthology.orchestra.run.smithi089.stdout: "avg_session_uptime": 624, 2024-09-19T06:25:21.738 INFO:teuthology.orchestra.run.smithi089.stdout: "mdthresh_evicted": 0 2024-09-19T06:25:21.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.738 INFO:teuthology.orchestra.run.smithi089.stdout: "mempool": { 2024-09-19T06:25:21.738 INFO:teuthology.orchestra.run.smithi089.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:25:21.738 INFO:teuthology.orchestra.run.smithi089.stdout: "bloom_filter_items": 0, 2024-09-19T06:25:21.739 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:25:21.739 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:25:21.739 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:25:21.739 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:25:21.739 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:25:21.739 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:25:21.739 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:25:21.739 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:25:21.739 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:25:21.739 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:25:21.739 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:25:21.740 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:25:21.740 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:25:21.740 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_extent_items": 0, 2024-09-19T06:25:21.740 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:25:21.740 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_blob_items": 0, 2024-09-19T06:25:21.740 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:25:21.740 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:25:21.740 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:25:21.740 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:25:21.740 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:25:21.740 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:25:21.740 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:25:21.740 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_txc_items": 0, 2024-09-19T06:25:21.741 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:25:21.741 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:25:21.741 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:25:21.741 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_writing_items": 0, 2024-09-19T06:25:21.741 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_bytes": 0, 2024-09-19T06:25:21.741 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_items": 0, 2024-09-19T06:25:21.741 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:25:21.741 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:25:21.741 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:25:21.741 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:25:21.741 INFO:teuthology.orchestra.run.smithi089.stdout: "buffer_anon_bytes": 342617, 2024-09-19T06:25:21.741 INFO:teuthology.orchestra.run.smithi089.stdout: "buffer_anon_items": 134, 2024-09-19T06:25:21.741 INFO:teuthology.orchestra.run.smithi089.stdout: "buffer_meta_bytes": 264, 2024-09-19T06:25:21.742 INFO:teuthology.orchestra.run.smithi089.stdout: "buffer_meta_items": 3, 2024-09-19T06:25:21.742 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_bytes": 0, 2024-09-19T06:25:21.742 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_items": 0, 2024-09-19T06:25:21.742 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:25:21.742 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mapbl_items": 0, 2024-09-19T06:25:21.742 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:25:21.742 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pglog_items": 0, 2024-09-19T06:25:21.742 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_bytes": 8136, 2024-09-19T06:25:21.742 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_items": 180, 2024-09-19T06:25:21.742 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:25:21.742 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:25:21.742 INFO:teuthology.orchestra.run.smithi089.stdout: "pgmap_bytes": 0, 2024-09-19T06:25:21.742 INFO:teuthology.orchestra.run.smithi089.stdout: "pgmap_items": 0, 2024-09-19T06:25:21.742 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_co_bytes": 125844, 2024-09-19T06:25:21.743 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_co_items": 923, 2024-09-19T06:25:21.743 INFO:teuthology.orchestra.run.smithi089.stdout: "unittest_1_bytes": 0, 2024-09-19T06:25:21.743 INFO:teuthology.orchestra.run.smithi089.stdout: "unittest_1_items": 0, 2024-09-19T06:25:21.743 INFO:teuthology.orchestra.run.smithi089.stdout: "unittest_2_bytes": 0, 2024-09-19T06:25:21.743 INFO:teuthology.orchestra.run.smithi089.stdout: "unittest_2_items": 0 2024-09-19T06:25:21.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.743 INFO:teuthology.orchestra.run.smithi089.stdout: "objecter": { 2024-09-19T06:25:21.743 INFO:teuthology.orchestra.run.smithi089.stdout: "op_active": 0, 2024-09-19T06:25:21.743 INFO:teuthology.orchestra.run.smithi089.stdout: "op_laggy": 0, 2024-09-19T06:25:21.743 INFO:teuthology.orchestra.run.smithi089.stdout: "op_send": 4467, 2024-09-19T06:25:21.743 INFO:teuthology.orchestra.run.smithi089.stdout: "op_send_bytes": 851454, 2024-09-19T06:25:21.743 INFO:teuthology.orchestra.run.smithi089.stdout: "op_resend": 37, 2024-09-19T06:25:21.743 INFO:teuthology.orchestra.run.smithi089.stdout: "op_reply": 4467, 2024-09-19T06:25:21.744 INFO:teuthology.orchestra.run.smithi089.stdout: "op_latency": { 2024-09-19T06:25:21.744 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 4467, 2024-09-19T06:25:21.744 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 34.889189379, 2024-09-19T06:25:21.744 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.007810429 2024-09-19T06:25:21.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.744 INFO:teuthology.orchestra.run.smithi089.stdout: "op_inflight": 0, 2024-09-19T06:25:21.744 INFO:teuthology.orchestra.run.smithi089.stdout: "oplen_avg": { 2024-09-19T06:25:21.744 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 4467, 2024-09-19T06:25:21.744 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 4701 2024-09-19T06:25:21.744 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.744 INFO:teuthology.orchestra.run.smithi089.stdout: "op": 4467, 2024-09-19T06:25:21.744 INFO:teuthology.orchestra.run.smithi089.stdout: "op_r": 471, 2024-09-19T06:25:21.744 INFO:teuthology.orchestra.run.smithi089.stdout: "op_w": 3996, 2024-09-19T06:25:21.745 INFO:teuthology.orchestra.run.smithi089.stdout: "op_rmw": 0, 2024-09-19T06:25:21.745 INFO:teuthology.orchestra.run.smithi089.stdout: "op_pg": 0, 2024-09-19T06:25:21.745 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_stat": 64, 2024-09-19T06:25:21.745 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_create": 31, 2024-09-19T06:25:21.745 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_read": 38, 2024-09-19T06:25:21.745 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_write": 181, 2024-09-19T06:25:21.745 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_writefull": 66, 2024-09-19T06:25:21.745 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_writesame": 0, 2024-09-19T06:25:21.745 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_append": 0, 2024-09-19T06:25:21.745 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_zero": 0, 2024-09-19T06:25:21.745 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_truncate": 0, 2024-09-19T06:25:21.745 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_delete": 3584, 2024-09-19T06:25:21.745 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_mapext": 0, 2024-09-19T06:25:21.746 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_sparse_read": 0, 2024-09-19T06:25:21.746 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_clonerange": 0, 2024-09-19T06:25:21.746 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_getxattr": 433, 2024-09-19T06:25:21.746 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_setxattr": 62, 2024-09-19T06:25:21.746 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_cmpxattr": 0, 2024-09-19T06:25:21.746 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_rmxattr": 0, 2024-09-19T06:25:21.746 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_resetxattrs": 0, 2024-09-19T06:25:21.746 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_call": 0, 2024-09-19T06:25:21.746 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_watch": 0, 2024-09-19T06:25:21.746 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_notify": 0, 2024-09-19T06:25:21.746 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T06:25:21.746 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_pgls": 0, 2024-09-19T06:25:21.746 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_pgls_filter": 0, 2024-09-19T06:25:21.746 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_other": 0, 2024-09-19T06:25:21.747 INFO:teuthology.orchestra.run.smithi089.stdout: "linger_active": 0, 2024-09-19T06:25:21.747 INFO:teuthology.orchestra.run.smithi089.stdout: "linger_send": 0, 2024-09-19T06:25:21.747 INFO:teuthology.orchestra.run.smithi089.stdout: "linger_resend": 0, 2024-09-19T06:25:21.747 INFO:teuthology.orchestra.run.smithi089.stdout: "linger_ping": 0, 2024-09-19T06:25:21.747 INFO:teuthology.orchestra.run.smithi089.stdout: "poolop_active": 0, 2024-09-19T06:25:21.747 INFO:teuthology.orchestra.run.smithi089.stdout: "poolop_send": 0, 2024-09-19T06:25:21.747 INFO:teuthology.orchestra.run.smithi089.stdout: "poolop_resend": 0, 2024-09-19T06:25:21.747 INFO:teuthology.orchestra.run.smithi089.stdout: "poolstat_active": 0, 2024-09-19T06:25:21.747 INFO:teuthology.orchestra.run.smithi089.stdout: "poolstat_send": 0, 2024-09-19T06:25:21.747 INFO:teuthology.orchestra.run.smithi089.stdout: "poolstat_resend": 0, 2024-09-19T06:25:21.747 INFO:teuthology.orchestra.run.smithi089.stdout: "statfs_active": 0, 2024-09-19T06:25:21.747 INFO:teuthology.orchestra.run.smithi089.stdout: "statfs_send": 0, 2024-09-19T06:25:21.747 INFO:teuthology.orchestra.run.smithi089.stdout: "statfs_resend": 0, 2024-09-19T06:25:21.748 INFO:teuthology.orchestra.run.smithi089.stdout: "command_active": 0, 2024-09-19T06:25:21.748 INFO:teuthology.orchestra.run.smithi089.stdout: "command_send": 0, 2024-09-19T06:25:21.748 INFO:teuthology.orchestra.run.smithi089.stdout: "command_resend": 0, 2024-09-19T06:25:21.748 INFO:teuthology.orchestra.run.smithi089.stdout: "map_epoch": 92, 2024-09-19T06:25:21.748 INFO:teuthology.orchestra.run.smithi089.stdout: "map_full": 0, 2024-09-19T06:25:21.748 INFO:teuthology.orchestra.run.smithi089.stdout: "map_inc": 13, 2024-09-19T06:25:21.748 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_sessions": 12, 2024-09-19T06:25:21.748 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_session_open": 12, 2024-09-19T06:25:21.748 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_session_close": 0, 2024-09-19T06:25:21.748 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_laggy": 0, 2024-09-19T06:25:21.748 INFO:teuthology.orchestra.run.smithi089.stdout: "omap_wr": 222, 2024-09-19T06:25:21.748 INFO:teuthology.orchestra.run.smithi089.stdout: "omap_rd": 0, 2024-09-19T06:25:21.748 INFO:teuthology.orchestra.run.smithi089.stdout: "omap_del": 20 2024-09-19T06:25:21.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.749 INFO:teuthology.orchestra.run.smithi089.stdout: "oft": { 2024-09-19T06:25:21.749 INFO:teuthology.orchestra.run.smithi089.stdout: "omap_total_objs": 1, 2024-09-19T06:25:21.749 INFO:teuthology.orchestra.run.smithi089.stdout: "omap_total_kv_pairs": 0, 2024-09-19T06:25:21.749 INFO:teuthology.orchestra.run.smithi089.stdout: "omap_total_updates": 0, 2024-09-19T06:25:21.749 INFO:teuthology.orchestra.run.smithi089.stdout: "omap_total_removes": 0 2024-09-19T06:25:21.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.749 INFO:teuthology.orchestra.run.smithi089.stdout: "osd-slow-ops": { 2024-09-19T06:25:21.749 INFO:teuthology.orchestra.run.smithi089.stdout: "slow_ops_count": 0 2024-09-19T06:25:21.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.749 INFO:teuthology.orchestra.run.smithi089.stdout: "purge_queue": { 2024-09-19T06:25:21.749 INFO:teuthology.orchestra.run.smithi089.stdout: "pq_executing_ops": 0, 2024-09-19T06:25:21.749 INFO:teuthology.orchestra.run.smithi089.stdout: "pq_executing_ops_high_water": 2560, 2024-09-19T06:25:21.750 INFO:teuthology.orchestra.run.smithi089.stdout: "pq_executing": 0, 2024-09-19T06:25:21.750 INFO:teuthology.orchestra.run.smithi089.stdout: "pq_executing_high_water": 1, 2024-09-19T06:25:21.750 INFO:teuthology.orchestra.run.smithi089.stdout: "pq_executed_ops": 3072, 2024-09-19T06:25:21.750 INFO:teuthology.orchestra.run.smithi089.stdout: "pq_executed": 3, 2024-09-19T06:25:21.750 INFO:teuthology.orchestra.run.smithi089.stdout: "pq_item_in_journal": 0 2024-09-19T06:25:21.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.750 INFO:teuthology.orchestra.run.smithi089.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:25:21.750 INFO:teuthology.orchestra.run.smithi089.stdout: "val": 0, 2024-09-19T06:25:21.750 INFO:teuthology.orchestra.run.smithi089.stdout: "max": 104857600, 2024-09-19T06:25:21.750 INFO:teuthology.orchestra.run.smithi089.stdout: "get_started": 0, 2024-09-19T06:25:21.750 INFO:teuthology.orchestra.run.smithi089.stdout: "get": 8063, 2024-09-19T06:25:21.750 INFO:teuthology.orchestra.run.smithi089.stdout: "get_sum": 3244669, 2024-09-19T06:25:21.750 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:21.751 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_success": 8063, 2024-09-19T06:25:21.751 INFO:teuthology.orchestra.run.smithi089.stdout: "take": 0, 2024-09-19T06:25:21.751 INFO:teuthology.orchestra.run.smithi089.stdout: "take_sum": 0, 2024-09-19T06:25:21.751 INFO:teuthology.orchestra.run.smithi089.stdout: "put": 8063, 2024-09-19T06:25:21.751 INFO:teuthology.orchestra.run.smithi089.stdout: "put_sum": 3244669, 2024-09-19T06:25:21.751 INFO:teuthology.orchestra.run.smithi089.stdout: "wait": { 2024-09-19T06:25:21.751 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:21.751 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:21.751 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:21.751 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-19T06:25:21.751 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.751 INFO:teuthology.orchestra.run.smithi089.stdout: "throttle-objecter_bytes": { 2024-09-19T06:25:21.751 INFO:teuthology.orchestra.run.smithi089.stdout: "val": 0, 2024-09-19T06:25:21.751 INFO:teuthology.orchestra.run.smithi089.stdout: "max": 104857600, 2024-09-19T06:25:21.752 INFO:teuthology.orchestra.run.smithi089.stdout: "get_started": 0, 2024-09-19T06:25:21.752 INFO:teuthology.orchestra.run.smithi089.stdout: "get": 0, 2024-09-19T06:25:21.752 INFO:teuthology.orchestra.run.smithi089.stdout: "get_sum": 0, 2024-09-19T06:25:21.752 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:21.752 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_success": 0, 2024-09-19T06:25:21.752 INFO:teuthology.orchestra.run.smithi089.stdout: "take": 4467, 2024-09-19T06:25:21.752 INFO:teuthology.orchestra.run.smithi089.stdout: "take_sum": 851765, 2024-09-19T06:25:21.752 INFO:teuthology.orchestra.run.smithi089.stdout: "put": 4467, 2024-09-19T06:25:21.752 INFO:teuthology.orchestra.run.smithi089.stdout: "put_sum": 851765, 2024-09-19T06:25:21.752 INFO:teuthology.orchestra.run.smithi089.stdout: "wait": { 2024-09-19T06:25:21.752 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:21.752 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:21.752 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:21.753 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-19T06:25:21.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.753 INFO:teuthology.orchestra.run.smithi089.stdout: "throttle-objecter_ops": { 2024-09-19T06:25:21.753 INFO:teuthology.orchestra.run.smithi089.stdout: "val": 0, 2024-09-19T06:25:21.753 INFO:teuthology.orchestra.run.smithi089.stdout: "max": 1024, 2024-09-19T06:25:21.753 INFO:teuthology.orchestra.run.smithi089.stdout: "get_started": 0, 2024-09-19T06:25:21.753 INFO:teuthology.orchestra.run.smithi089.stdout: "get": 0, 2024-09-19T06:25:21.753 INFO:teuthology.orchestra.run.smithi089.stdout: "get_sum": 0, 2024-09-19T06:25:21.753 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:21.753 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_success": 0, 2024-09-19T06:25:21.753 INFO:teuthology.orchestra.run.smithi089.stdout: "take": 4467, 2024-09-19T06:25:21.753 INFO:teuthology.orchestra.run.smithi089.stdout: "take_sum": 4467, 2024-09-19T06:25:21.753 INFO:teuthology.orchestra.run.smithi089.stdout: "put": 4467, 2024-09-19T06:25:21.754 INFO:teuthology.orchestra.run.smithi089.stdout: "put_sum": 4467, 2024-09-19T06:25:21.754 INFO:teuthology.orchestra.run.smithi089.stdout: "wait": { 2024-09-19T06:25:21.754 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:21.754 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:21.754 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:21.754 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-19T06:25:21.754 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.754 INFO:teuthology.orchestra.run.smithi089.stdout: "throttle-write_buf_throttle": { 2024-09-19T06:25:21.754 INFO:teuthology.orchestra.run.smithi089.stdout: "val": 0, 2024-09-19T06:25:21.754 INFO:teuthology.orchestra.run.smithi089.stdout: "max": 3758096384, 2024-09-19T06:25:21.754 INFO:teuthology.orchestra.run.smithi089.stdout: "get_started": 0, 2024-09-19T06:25:21.754 INFO:teuthology.orchestra.run.smithi089.stdout: "get": 3, 2024-09-19T06:25:21.754 INFO:teuthology.orchestra.run.smithi089.stdout: "get_sum": 311, 2024-09-19T06:25:21.754 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:21.755 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_success": 3, 2024-09-19T06:25:21.755 INFO:teuthology.orchestra.run.smithi089.stdout: "take": 0, 2024-09-19T06:25:21.755 INFO:teuthology.orchestra.run.smithi089.stdout: "take_sum": 0, 2024-09-19T06:25:21.755 INFO:teuthology.orchestra.run.smithi089.stdout: "put": 3, 2024-09-19T06:25:21.755 INFO:teuthology.orchestra.run.smithi089.stdout: "put_sum": 311, 2024-09-19T06:25:21.755 INFO:teuthology.orchestra.run.smithi089.stdout: "wait": { 2024-09-19T06:25:21.755 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:21.755 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:21.755 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:21.755 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-19T06:25:21.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:21.755 INFO:teuthology.orchestra.run.smithi089.stdout: "throttle-write_buf_throttle-0x559023096500": { 2024-09-19T06:25:21.755 INFO:teuthology.orchestra.run.smithi089.stdout: "val": 0, 2024-09-19T06:25:21.755 INFO:teuthology.orchestra.run.smithi089.stdout: "max": 3758096384, 2024-09-19T06:25:21.756 INFO:teuthology.orchestra.run.smithi089.stdout: "get_started": 0, 2024-09-19T06:25:21.756 INFO:teuthology.orchestra.run.smithi089.stdout: "get": 215, 2024-09-19T06:25:21.756 INFO:teuthology.orchestra.run.smithi089.stdout: "get_sum": 690169, 2024-09-19T06:25:21.756 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:21.756 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_success": 215, 2024-09-19T06:25:21.756 INFO:teuthology.orchestra.run.smithi089.stdout: "take": 0, 2024-09-19T06:25:21.756 INFO:teuthology.orchestra.run.smithi089.stdout: "take_sum": 0, 2024-09-19T06:25:21.756 INFO:teuthology.orchestra.run.smithi089.stdout: "put": 178, 2024-09-19T06:25:21.756 INFO:teuthology.orchestra.run.smithi089.stdout: "put_sum": 690169, 2024-09-19T06:25:21.756 INFO:teuthology.orchestra.run.smithi089.stdout: "wait": { 2024-09-19T06:25:21.756 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:21.756 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:21.756 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:21.757 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-19T06:25:21.757 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-19T06:25:21.757 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-19T06:25:21.757 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:21 smithi090 ceph-mon[34497]: pgmap v329: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T06:25:22.605 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-09-19T06:25:22.605 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-09-19T06:25:22.605 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=7 2024-09-19T06:25:22.605 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=0 2024-09-19T06:25:22.605 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-19T06:25:22.605 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=11 2024-09-19T06:25:22.605 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=5 2024-09-19T06:25:22.605 DEBUG:tasks.check_counter:Getting stats from e 2024-09-19T06:25:22.605 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-19T06:25:22.850 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:25:23.371 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-19T06:25:23.371 INFO:teuthology.orchestra.run.smithi089.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:25:23.371 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_messages": 2093, 2024-09-19T06:25:23.371 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages": 2095, 2024-09-19T06:25:23.371 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_bytes": 595036, 2024-09-19T06:25:23.372 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_bytes": 665581, 2024-09-19T06:25:23.372 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_created_connections": 6, 2024-09-19T06:25:23.372 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_active_connections": 2, 2024-09-19T06:25:23.372 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_total_time": 0.160356013, 2024-09-19T06:25:23.372 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_send_time": 0.052796977, 2024-09-19T06:25:23.372 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_recv_time": 0.039681588, 2024-09-19T06:25:23.372 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_fast_dispatch_time": 0.055430297, 2024-09-19T06:25:23.372 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:25:23.372 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 2093, 2024-09-19T06:25:23.372 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.067323616, 2024-09-19T06:25:23.372 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000032166 2024-09-19T06:25:23.372 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.373 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:25:23.373 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:23.373 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:23.373 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:23.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.373 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T06:25:23.373 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T06:25:23.373 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.373 INFO:teuthology.orchestra.run.smithi089.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:25:23.373 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_messages": 8, 2024-09-19T06:25:23.373 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages": 162, 2024-09-19T06:25:23.373 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_bytes": 3916, 2024-09-19T06:25:23.374 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_bytes": 437450, 2024-09-19T06:25:23.374 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_created_connections": 6, 2024-09-19T06:25:23.374 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_active_connections": 4, 2024-09-19T06:25:23.374 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_total_time": 0.012035804, 2024-09-19T06:25:23.374 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_send_time": 0.006340718, 2024-09-19T06:25:23.374 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_recv_time": 0.003885935, 2024-09-19T06:25:23.374 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_fast_dispatch_time": 0.000063565, 2024-09-19T06:25:23.374 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:25:23.374 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 160, 2024-09-19T06:25:23.374 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.017917244, 2024-09-19T06:25:23.374 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000111982 2024-09-19T06:25:23.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.375 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:25:23.375 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:23.375 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:23.375 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:23.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.375 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_encrypted_bytes": 3360, 2024-09-19T06:25:23.375 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_encrypted_bytes": 436752 2024-09-19T06:25:23.375 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.375 INFO:teuthology.orchestra.run.smithi089.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:25:23.376 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_messages": 235, 2024-09-19T06:25:23.376 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages": 224, 2024-09-19T06:25:23.376 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_bytes": 1472268, 2024-09-19T06:25:23.376 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_bytes": 130350, 2024-09-19T06:25:23.376 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_created_connections": 3, 2024-09-19T06:25:23.376 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_active_connections": 2, 2024-09-19T06:25:23.376 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_total_time": 0.041679131, 2024-09-19T06:25:23.376 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_send_time": 0.015255053, 2024-09-19T06:25:23.376 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_recv_time": 0.039201185, 2024-09-19T06:25:23.376 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_fast_dispatch_time": 0.000022278, 2024-09-19T06:25:23.376 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:25:23.377 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 223, 2024-09-19T06:25:23.377 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.012846412, 2024-09-19T06:25:23.377 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000057607 2024-09-19T06:25:23.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.377 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:25:23.377 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:23.377 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:23.377 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:23.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.377 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_encrypted_bytes": 1472000, 2024-09-19T06:25:23.377 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_encrypted_bytes": 130032 2024-09-19T06:25:23.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.377 INFO:teuthology.orchestra.run.smithi089.stdout: "cct": { 2024-09-19T06:25:23.378 INFO:teuthology.orchestra.run.smithi089.stdout: "total_workers": 1, 2024-09-19T06:25:23.378 INFO:teuthology.orchestra.run.smithi089.stdout: "unhealthy_workers": 0 2024-09-19T06:25:23.378 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.378 INFO:teuthology.orchestra.run.smithi089.stdout: "finisher-MDSRank": { 2024-09-19T06:25:23.378 INFO:teuthology.orchestra.run.smithi089.stdout: "queue_len": 0, 2024-09-19T06:25:23.378 INFO:teuthology.orchestra.run.smithi089.stdout: "complete_latency": { 2024-09-19T06:25:23.378 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 3547, 2024-09-19T06:25:23.378 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.082225562, 2024-09-19T06:25:23.379 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000023181 2024-09-19T06:25:23.379 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-19T06:25:23.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.379 INFO:teuthology.orchestra.run.smithi089.stdout: "finisher-PurgeQueue": { 2024-09-19T06:25:23.379 INFO:teuthology.orchestra.run.smithi089.stdout: "queue_len": 0, 2024-09-19T06:25:23.379 INFO:teuthology.orchestra.run.smithi089.stdout: "complete_latency": { 2024-09-19T06:25:23.379 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:23.379 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:23.379 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:23.379 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-19T06:25:23.379 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.379 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-19T06:25:23.380 INFO:teuthology.orchestra.run.smithi089.stdout: "request": 0, 2024-09-19T06:25:23.380 INFO:teuthology.orchestra.run.smithi089.stdout: "reply": 0, 2024-09-19T06:25:23.380 INFO:teuthology.orchestra.run.smithi089.stdout: "reply_latency": { 2024-09-19T06:25:23.380 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:23.380 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:23.380 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:23.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.380 INFO:teuthology.orchestra.run.smithi089.stdout: "slow_reply": 0, 2024-09-19T06:25:23.380 INFO:teuthology.orchestra.run.smithi089.stdout: "forward": 0, 2024-09-19T06:25:23.381 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_fetch_complete": 0, 2024-09-19T06:25:23.381 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_fetch_keys": 0, 2024-09-19T06:25:23.381 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_commit": 0, 2024-09-19T06:25:23.381 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_split": 0, 2024-09-19T06:25:23.381 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_merge": 0, 2024-09-19T06:25:23.381 INFO:teuthology.orchestra.run.smithi089.stdout: "inodes": 0, 2024-09-19T06:25:23.381 INFO:teuthology.orchestra.run.smithi089.stdout: "inodes_top": 0, 2024-09-19T06:25:23.381 INFO:teuthology.orchestra.run.smithi089.stdout: "inodes_bottom": 0, 2024-09-19T06:25:23.381 INFO:teuthology.orchestra.run.smithi089.stdout: "inodes_pin_tail": 0, 2024-09-19T06:25:23.381 INFO:teuthology.orchestra.run.smithi089.stdout: "inodes_pinned": 0, 2024-09-19T06:25:23.381 INFO:teuthology.orchestra.run.smithi089.stdout: "inodes_expired": 0, 2024-09-19T06:25:23.382 INFO:teuthology.orchestra.run.smithi089.stdout: "inodes_with_caps": 0, 2024-09-19T06:25:23.382 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": 0, 2024-09-19T06:25:23.382 INFO:teuthology.orchestra.run.smithi089.stdout: "subtrees": 1, 2024-09-19T06:25:23.382 INFO:teuthology.orchestra.run.smithi089.stdout: "traverse": 0, 2024-09-19T06:25:23.382 INFO:teuthology.orchestra.run.smithi089.stdout: "traverse_hit": 0, 2024-09-19T06:25:23.382 INFO:teuthology.orchestra.run.smithi089.stdout: "traverse_forward": 0, 2024-09-19T06:25:23.382 INFO:teuthology.orchestra.run.smithi089.stdout: "traverse_discover": 0, 2024-09-19T06:25:23.382 INFO:teuthology.orchestra.run.smithi089.stdout: "traverse_dir_fetch": 0, 2024-09-19T06:25:23.382 INFO:teuthology.orchestra.run.smithi089.stdout: "traverse_remote_ino": 0, 2024-09-19T06:25:23.382 INFO:teuthology.orchestra.run.smithi089.stdout: "traverse_lock": 0, 2024-09-19T06:25:23.382 INFO:teuthology.orchestra.run.smithi089.stdout: "load_cent": 0, 2024-09-19T06:25:23.382 INFO:teuthology.orchestra.run.smithi089.stdout: "q": 0, 2024-09-19T06:25:23.382 INFO:teuthology.orchestra.run.smithi089.stdout: "exported": 0, 2024-09-19T06:25:23.383 INFO:teuthology.orchestra.run.smithi089.stdout: "exported_inodes": 0, 2024-09-19T06:25:23.383 INFO:teuthology.orchestra.run.smithi089.stdout: "imported": 0, 2024-09-19T06:25:23.383 INFO:teuthology.orchestra.run.smithi089.stdout: "imported_inodes": 0, 2024-09-19T06:25:23.383 INFO:teuthology.orchestra.run.smithi089.stdout: "openino_dir_fetch": 0, 2024-09-19T06:25:23.383 INFO:teuthology.orchestra.run.smithi089.stdout: "openino_backtrace_fetch": 0, 2024-09-19T06:25:23.383 INFO:teuthology.orchestra.run.smithi089.stdout: "openino_peer_discover": 0, 2024-09-19T06:25:23.383 INFO:teuthology.orchestra.run.smithi089.stdout: "root_rfiles": 0, 2024-09-19T06:25:23.383 INFO:teuthology.orchestra.run.smithi089.stdout: "root_rbytes": 0, 2024-09-19T06:25:23.383 INFO:teuthology.orchestra.run.smithi089.stdout: "root_rsnaps": 0, 2024-09-19T06:25:23.383 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T06:25:23.383 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_set_tag": 0, 2024-09-19T06:25:23.383 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T06:25:23.384 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_inotable_repaired": 0, 2024-09-19T06:25:23.384 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_dir_inodes": 0, 2024-09-19T06:25:23.384 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T06:25:23.384 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T06:25:23.384 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_file_inodes": 0, 2024-09-19T06:25:23.384 INFO:teuthology.orchestra.run.smithi089.stdout: "handle_inode_file_caps": 0, 2024-09-19T06:25:23.384 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T06:25:23.384 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_cap_op_grant": 0, 2024-09-19T06:25:23.384 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T06:25:23.384 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T06:25:23.384 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T06:25:23.384 INFO:teuthology.orchestra.run.smithi089.stdout: "handle_client_caps": 0, 2024-09-19T06:25:23.384 INFO:teuthology.orchestra.run.smithi089.stdout: "handle_client_caps_dirty": 0, 2024-09-19T06:25:23.385 INFO:teuthology.orchestra.run.smithi089.stdout: "handle_client_cap_release": 0, 2024-09-19T06:25:23.385 INFO:teuthology.orchestra.run.smithi089.stdout: "process_request_cap_release": 0 2024-09-19T06:25:23.385 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.385 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_cache": { 2024-09-19T06:25:23.385 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_update": 0, 2024-09-19T06:25:23.385 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_update_receipt": 0, 2024-09-19T06:25:23.385 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_try_discover": 0, 2024-09-19T06:25:23.385 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_send_discover": 0, 2024-09-19T06:25:23.385 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_handle_discover": 0, 2024-09-19T06:25:23.385 INFO:teuthology.orchestra.run.smithi089.stdout: "num_strays": 0, 2024-09-19T06:25:23.385 INFO:teuthology.orchestra.run.smithi089.stdout: "num_strays_delayed": 0, 2024-09-19T06:25:23.385 INFO:teuthology.orchestra.run.smithi089.stdout: "num_strays_enqueuing": 0, 2024-09-19T06:25:23.386 INFO:teuthology.orchestra.run.smithi089.stdout: "strays_created": 0, 2024-09-19T06:25:23.386 INFO:teuthology.orchestra.run.smithi089.stdout: "strays_enqueued": 0, 2024-09-19T06:25:23.386 INFO:teuthology.orchestra.run.smithi089.stdout: "strays_reintegrated": 0, 2024-09-19T06:25:23.386 INFO:teuthology.orchestra.run.smithi089.stdout: "strays_migrated": 0, 2024-09-19T06:25:23.386 INFO:teuthology.orchestra.run.smithi089.stdout: "num_recovering_processing": 0, 2024-09-19T06:25:23.386 INFO:teuthology.orchestra.run.smithi089.stdout: "num_recovering_enqueued": 0, 2024-09-19T06:25:23.386 INFO:teuthology.orchestra.run.smithi089.stdout: "num_recovering_prioritized": 0, 2024-09-19T06:25:23.386 INFO:teuthology.orchestra.run.smithi089.stdout: "recovery_started": 0, 2024-09-19T06:25:23.386 INFO:teuthology.orchestra.run.smithi089.stdout: "recovery_completed": 0, 2024-09-19T06:25:23.386 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_quiesce_path": 0, 2024-09-19T06:25:23.386 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_quiesce_inode": 0, 2024-09-19T06:25:23.386 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T06:25:23.386 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_exportdir": 0, 2024-09-19T06:25:23.387 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_flush": 0, 2024-09-19T06:25:23.387 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_fragmentdir": 0, 2024-09-19T06:25:23.387 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_fragstats": 0, 2024-09-19T06:25:23.387 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_inodestats": 0 2024-09-19T06:25:23.387 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.387 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_log": { 2024-09-19T06:25:23.387 INFO:teuthology.orchestra.run.smithi089.stdout: "evlrg": 0, 2024-09-19T06:25:23.387 INFO:teuthology.orchestra.run.smithi089.stdout: "evadd": 0, 2024-09-19T06:25:23.387 INFO:teuthology.orchestra.run.smithi089.stdout: "evex": 0, 2024-09-19T06:25:23.387 INFO:teuthology.orchestra.run.smithi089.stdout: "evtrm": 0, 2024-09-19T06:25:23.387 INFO:teuthology.orchestra.run.smithi089.stdout: "ev": 9, 2024-09-19T06:25:23.387 INFO:teuthology.orchestra.run.smithi089.stdout: "evexg": 0, 2024-09-19T06:25:23.387 INFO:teuthology.orchestra.run.smithi089.stdout: "evexd": 0, 2024-09-19T06:25:23.388 INFO:teuthology.orchestra.run.smithi089.stdout: "segadd": 0, 2024-09-19T06:25:23.388 INFO:teuthology.orchestra.run.smithi089.stdout: "segex": 0, 2024-09-19T06:25:23.388 INFO:teuthology.orchestra.run.smithi089.stdout: "segtrm": 0, 2024-09-19T06:25:23.388 INFO:teuthology.orchestra.run.smithi089.stdout: "seg": 2, 2024-09-19T06:25:23.388 INFO:teuthology.orchestra.run.smithi089.stdout: "segmjr": 2, 2024-09-19T06:25:23.388 INFO:teuthology.orchestra.run.smithi089.stdout: "segexg": 0, 2024-09-19T06:25:23.388 INFO:teuthology.orchestra.run.smithi089.stdout: "segexd": 0, 2024-09-19T06:25:23.388 INFO:teuthology.orchestra.run.smithi089.stdout: "expos": 4194304, 2024-09-19T06:25:23.388 INFO:teuthology.orchestra.run.smithi089.stdout: "wrpos": 4196989, 2024-09-19T06:25:23.388 INFO:teuthology.orchestra.run.smithi089.stdout: "rdpos": 4196848, 2024-09-19T06:25:23.388 INFO:teuthology.orchestra.run.smithi089.stdout: "jlat": { 2024-09-19T06:25:23.388 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:23.389 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:23.389 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:23.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.389 INFO:teuthology.orchestra.run.smithi089.stdout: "replayed": 9 2024-09-19T06:25:23.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.389 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_mem": { 2024-09-19T06:25:23.389 INFO:teuthology.orchestra.run.smithi089.stdout: "ino": 3, 2024-09-19T06:25:23.389 INFO:teuthology.orchestra.run.smithi089.stdout: "ino+": 3, 2024-09-19T06:25:23.389 INFO:teuthology.orchestra.run.smithi089.stdout: "ino-": 0, 2024-09-19T06:25:23.389 INFO:teuthology.orchestra.run.smithi089.stdout: "dir": 1, 2024-09-19T06:25:23.389 INFO:teuthology.orchestra.run.smithi089.stdout: "dir+": 1, 2024-09-19T06:25:23.389 INFO:teuthology.orchestra.run.smithi089.stdout: "dir-": 0, 2024-09-19T06:25:23.389 INFO:teuthology.orchestra.run.smithi089.stdout: "dn": 0, 2024-09-19T06:25:23.390 INFO:teuthology.orchestra.run.smithi089.stdout: "dn+": 0, 2024-09-19T06:25:23.390 INFO:teuthology.orchestra.run.smithi089.stdout: "dn-": 0, 2024-09-19T06:25:23.390 INFO:teuthology.orchestra.run.smithi089.stdout: "cap": 0, 2024-09-19T06:25:23.390 INFO:teuthology.orchestra.run.smithi089.stdout: "cap+": 0, 2024-09-19T06:25:23.390 INFO:teuthology.orchestra.run.smithi089.stdout: "cap-": 0, 2024-09-19T06:25:23.390 INFO:teuthology.orchestra.run.smithi089.stdout: "rss": 48832, 2024-09-19T06:25:23.390 INFO:teuthology.orchestra.run.smithi089.stdout: "heap": 215328 2024-09-19T06:25:23.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.390 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_server": { 2024-09-19T06:25:23.390 INFO:teuthology.orchestra.run.smithi089.stdout: "dispatch_client_request": 0, 2024-09-19T06:25:23.390 INFO:teuthology.orchestra.run.smithi089.stdout: "dispatch_server_request": 0, 2024-09-19T06:25:23.390 INFO:teuthology.orchestra.run.smithi089.stdout: "handle_client_request": 0, 2024-09-19T06:25:23.390 INFO:teuthology.orchestra.run.smithi089.stdout: "handle_client_session": 0, 2024-09-19T06:25:23.391 INFO:teuthology.orchestra.run.smithi089.stdout: "handle_peer_request": 0, 2024-09-19T06:25:23.391 INFO:teuthology.orchestra.run.smithi089.stdout: "req_create_latency": { 2024-09-19T06:25:23.391 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:23.391 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:23.391 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:23.391 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.391 INFO:teuthology.orchestra.run.smithi089.stdout: "req_getattr_latency": { 2024-09-19T06:25:23.391 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:23.391 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:23.391 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:23.391 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.391 INFO:teuthology.orchestra.run.smithi089.stdout: "req_getfilelock_latency": { 2024-09-19T06:25:23.391 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:23.392 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:23.392 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:23.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.392 INFO:teuthology.orchestra.run.smithi089.stdout: "req_link_latency": { 2024-09-19T06:25:23.392 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:23.392 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:23.392 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:23.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.392 INFO:teuthology.orchestra.run.smithi089.stdout: "req_lookup_latency": { 2024-09-19T06:25:23.392 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:23.392 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:23.392 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:23.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.393 INFO:teuthology.orchestra.run.smithi089.stdout: "req_lookuphash_latency": { 2024-09-19T06:25:23.393 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:23.393 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:23.393 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:23.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.393 INFO:teuthology.orchestra.run.smithi089.stdout: "req_lookupino_latency": { 2024-09-19T06:25:23.393 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:23.393 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:23.393 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:23.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.394 INFO:teuthology.orchestra.run.smithi089.stdout: "req_lookupname_latency": { 2024-09-19T06:25:23.394 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:23.394 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:23.394 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:23.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.394 INFO:teuthology.orchestra.run.smithi089.stdout: "req_lookupparent_latency": { 2024-09-19T06:25:23.394 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:23.394 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:23.394 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:23.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.394 INFO:teuthology.orchestra.run.smithi089.stdout: "req_lookupsnap_latency": { 2024-09-19T06:25:23.394 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:23.394 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:23.394 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:23.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.395 INFO:teuthology.orchestra.run.smithi089.stdout: "req_lssnap_latency": { 2024-09-19T06:25:23.395 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:23.395 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:23.395 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:23.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.395 INFO:teuthology.orchestra.run.smithi089.stdout: "req_mkdir_latency": { 2024-09-19T06:25:23.395 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:23.395 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:23.395 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:23.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.395 INFO:teuthology.orchestra.run.smithi089.stdout: "req_mknod_latency": { 2024-09-19T06:25:23.396 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:23.396 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:23.396 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:23.396 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.396 INFO:teuthology.orchestra.run.smithi089.stdout: "req_mksnap_latency": { 2024-09-19T06:25:23.396 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:23.396 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:23.396 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:23.396 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.396 INFO:teuthology.orchestra.run.smithi089.stdout: "req_open_latency": { 2024-09-19T06:25:23.396 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:23.396 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:23.396 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:23.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.397 INFO:teuthology.orchestra.run.smithi089.stdout: "req_readdir_latency": { 2024-09-19T06:25:23.397 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:23.397 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:23.397 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:23.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.397 INFO:teuthology.orchestra.run.smithi089.stdout: "req_rename_latency": { 2024-09-19T06:25:23.397 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:23.397 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:23.397 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:23.397 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.398 INFO:teuthology.orchestra.run.smithi089.stdout: "req_renamesnap_latency": { 2024-09-19T06:25:23.398 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:23.398 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:23.398 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:23.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.398 INFO:teuthology.orchestra.run.smithi089.stdout: "req_snapdiff_latency": { 2024-09-19T06:25:23.398 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:23.398 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:23.398 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:23.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.398 INFO:teuthology.orchestra.run.smithi089.stdout: "req_rmdir_latency": { 2024-09-19T06:25:23.398 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:23.398 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:23.399 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:23.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.399 INFO:teuthology.orchestra.run.smithi089.stdout: "req_rmsnap_latency": { 2024-09-19T06:25:23.399 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:23.399 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:23.399 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:23.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.399 INFO:teuthology.orchestra.run.smithi089.stdout: "req_rmxattr_latency": { 2024-09-19T06:25:23.399 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:23.399 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:23.399 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:23.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.399 INFO:teuthology.orchestra.run.smithi089.stdout: "req_setattr_latency": { 2024-09-19T06:25:23.400 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:23.400 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:23.400 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:23.400 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.400 INFO:teuthology.orchestra.run.smithi089.stdout: "req_setdirlayout_latency": { 2024-09-19T06:25:23.400 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:23.400 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:23.400 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:23.400 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.400 INFO:teuthology.orchestra.run.smithi089.stdout: "req_setfilelock_latency": { 2024-09-19T06:25:23.400 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:23.400 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:23.400 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:23.401 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.401 INFO:teuthology.orchestra.run.smithi089.stdout: "req_setlayout_latency": { 2024-09-19T06:25:23.401 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:23.401 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:23.401 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:23.401 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.401 INFO:teuthology.orchestra.run.smithi089.stdout: "req_setxattr_latency": { 2024-09-19T06:25:23.401 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:23.401 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:23.401 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:23.401 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.401 INFO:teuthology.orchestra.run.smithi089.stdout: "req_symlink_latency": { 2024-09-19T06:25:23.401 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:23.402 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:23.402 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:23.402 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.402 INFO:teuthology.orchestra.run.smithi089.stdout: "req_unlink_latency": { 2024-09-19T06:25:23.402 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:23.402 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:23.402 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:23.402 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.402 INFO:teuthology.orchestra.run.smithi089.stdout: "cap_revoke_eviction": 0, 2024-09-19T06:25:23.402 INFO:teuthology.orchestra.run.smithi089.stdout: "cap_acquisition_throttle": 0, 2024-09-19T06:25:23.402 INFO:teuthology.orchestra.run.smithi089.stdout: "req_getvxattr_latency": { 2024-09-19T06:25:23.402 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:23.402 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:23.403 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:23.403 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-19T06:25:23.403 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.403 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_sessions": { 2024-09-19T06:25:23.403 INFO:teuthology.orchestra.run.smithi089.stdout: "session_count": 1, 2024-09-19T06:25:23.403 INFO:teuthology.orchestra.run.smithi089.stdout: "session_add": 4, 2024-09-19T06:25:23.403 INFO:teuthology.orchestra.run.smithi089.stdout: "session_remove": 3, 2024-09-19T06:25:23.403 INFO:teuthology.orchestra.run.smithi089.stdout: "sessions_open": 4, 2024-09-19T06:25:23.403 INFO:teuthology.orchestra.run.smithi089.stdout: "sessions_stale": 0, 2024-09-19T06:25:23.403 INFO:teuthology.orchestra.run.smithi089.stdout: "total_load": 0, 2024-09-19T06:25:23.403 INFO:teuthology.orchestra.run.smithi089.stdout: "average_load": 0, 2024-09-19T06:25:23.403 INFO:teuthology.orchestra.run.smithi089.stdout: "avg_session_uptime": 4797, 2024-09-19T06:25:23.403 INFO:teuthology.orchestra.run.smithi089.stdout: "mdthresh_evicted": 0 2024-09-19T06:25:23.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.404 INFO:teuthology.orchestra.run.smithi089.stdout: "mempool": { 2024-09-19T06:25:23.404 INFO:teuthology.orchestra.run.smithi089.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:25:23.404 INFO:teuthology.orchestra.run.smithi089.stdout: "bloom_filter_items": 0, 2024-09-19T06:25:23.404 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:25:23.404 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:25:23.404 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:25:23.404 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:25:23.404 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:25:23.404 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:25:23.404 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:25:23.404 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:25:23.404 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:25:23.404 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:25:23.405 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:25:23.405 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:25:23.405 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:25:23.405 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_extent_items": 0, 2024-09-19T06:25:23.405 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:25:23.405 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_blob_items": 0, 2024-09-19T06:25:23.405 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:25:23.405 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:25:23.405 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:25:23.405 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:25:23.405 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:25:23.405 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:25:23.405 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:25:23.406 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_txc_items": 0, 2024-09-19T06:25:23.406 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:25:23.406 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:25:23.406 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:25:23.406 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_writing_items": 0, 2024-09-19T06:25:23.406 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_bytes": 0, 2024-09-19T06:25:23.406 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_items": 0, 2024-09-19T06:25:23.406 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:25:23.406 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:25:23.406 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:25:23.406 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:25:23.406 INFO:teuthology.orchestra.run.smithi089.stdout: "buffer_anon_bytes": 181313, 2024-09-19T06:25:23.406 INFO:teuthology.orchestra.run.smithi089.stdout: "buffer_anon_items": 47, 2024-09-19T06:25:23.407 INFO:teuthology.orchestra.run.smithi089.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:25:23.407 INFO:teuthology.orchestra.run.smithi089.stdout: "buffer_meta_items": 0, 2024-09-19T06:25:23.407 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_bytes": 0, 2024-09-19T06:25:23.407 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_items": 0, 2024-09-19T06:25:23.407 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:25:23.407 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mapbl_items": 0, 2024-09-19T06:25:23.407 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:25:23.407 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pglog_items": 0, 2024-09-19T06:25:23.407 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_bytes": 8136, 2024-09-19T06:25:23.407 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_items": 180, 2024-09-19T06:25:23.407 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:25:23.407 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:25:23.408 INFO:teuthology.orchestra.run.smithi089.stdout: "pgmap_bytes": 0, 2024-09-19T06:25:23.408 INFO:teuthology.orchestra.run.smithi089.stdout: "pgmap_items": 0, 2024-09-19T06:25:23.408 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_co_bytes": 8512, 2024-09-19T06:25:23.408 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_co_items": 13, 2024-09-19T06:25:23.408 INFO:teuthology.orchestra.run.smithi089.stdout: "unittest_1_bytes": 0, 2024-09-19T06:25:23.408 INFO:teuthology.orchestra.run.smithi089.stdout: "unittest_1_items": 0, 2024-09-19T06:25:23.408 INFO:teuthology.orchestra.run.smithi089.stdout: "unittest_2_bytes": 0, 2024-09-19T06:25:23.408 INFO:teuthology.orchestra.run.smithi089.stdout: "unittest_2_items": 0 2024-09-19T06:25:23.408 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.408 INFO:teuthology.orchestra.run.smithi089.stdout: "objecter": { 2024-09-19T06:25:23.408 INFO:teuthology.orchestra.run.smithi089.stdout: "op_active": 0, 2024-09-19T06:25:23.409 INFO:teuthology.orchestra.run.smithi089.stdout: "op_laggy": 0, 2024-09-19T06:25:23.409 INFO:teuthology.orchestra.run.smithi089.stdout: "op_send": 2096, 2024-09-19T06:25:23.409 INFO:teuthology.orchestra.run.smithi089.stdout: "op_send_bytes": 21, 2024-09-19T06:25:23.409 INFO:teuthology.orchestra.run.smithi089.stdout: "op_resend": 3, 2024-09-19T06:25:23.409 INFO:teuthology.orchestra.run.smithi089.stdout: "op_reply": 2096, 2024-09-19T06:25:23.409 INFO:teuthology.orchestra.run.smithi089.stdout: "op_latency": { 2024-09-19T06:25:23.409 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 2096, 2024-09-19T06:25:23.409 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 1.129973756, 2024-09-19T06:25:23.409 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000539109 2024-09-19T06:25:23.409 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.409 INFO:teuthology.orchestra.run.smithi089.stdout: "op_inflight": 0, 2024-09-19T06:25:23.409 INFO:teuthology.orchestra.run.smithi089.stdout: "oplen_avg": { 2024-09-19T06:25:23.410 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 2096, 2024-09-19T06:25:23.410 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 2097 2024-09-19T06:25:23.410 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.410 INFO:teuthology.orchestra.run.smithi089.stdout: "op": 2096, 2024-09-19T06:25:23.410 INFO:teuthology.orchestra.run.smithi089.stdout: "op_r": 2096, 2024-09-19T06:25:23.410 INFO:teuthology.orchestra.run.smithi089.stdout: "op_w": 0, 2024-09-19T06:25:23.410 INFO:teuthology.orchestra.run.smithi089.stdout: "op_rmw": 0, 2024-09-19T06:25:23.410 INFO:teuthology.orchestra.run.smithi089.stdout: "op_pg": 0, 2024-09-19T06:25:23.410 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_stat": 1361, 2024-09-19T06:25:23.410 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_create": 0, 2024-09-19T06:25:23.411 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_read": 733, 2024-09-19T06:25:23.411 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_write": 0, 2024-09-19T06:25:23.411 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_writefull": 0, 2024-09-19T06:25:23.411 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_writesame": 0, 2024-09-19T06:25:23.411 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_append": 0, 2024-09-19T06:25:23.411 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_zero": 0, 2024-09-19T06:25:23.411 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_truncate": 0, 2024-09-19T06:25:23.411 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_delete": 0, 2024-09-19T06:25:23.411 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_mapext": 0, 2024-09-19T06:25:23.411 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_sparse_read": 0, 2024-09-19T06:25:23.411 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_clonerange": 0, 2024-09-19T06:25:23.411 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_getxattr": 1, 2024-09-19T06:25:23.412 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_setxattr": 0, 2024-09-19T06:25:23.412 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_cmpxattr": 0, 2024-09-19T06:25:23.412 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_rmxattr": 0, 2024-09-19T06:25:23.412 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_resetxattrs": 0, 2024-09-19T06:25:23.412 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_call": 0, 2024-09-19T06:25:23.412 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_watch": 0, 2024-09-19T06:25:23.412 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_notify": 0, 2024-09-19T06:25:23.412 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T06:25:23.412 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_pgls": 0, 2024-09-19T06:25:23.413 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_pgls_filter": 0, 2024-09-19T06:25:23.413 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_other": 0, 2024-09-19T06:25:23.413 INFO:teuthology.orchestra.run.smithi089.stdout: "linger_active": 0, 2024-09-19T06:25:23.413 INFO:teuthology.orchestra.run.smithi089.stdout: "linger_send": 0, 2024-09-19T06:25:23.413 INFO:teuthology.orchestra.run.smithi089.stdout: "linger_resend": 0, 2024-09-19T06:25:23.413 INFO:teuthology.orchestra.run.smithi089.stdout: "linger_ping": 0, 2024-09-19T06:25:23.413 INFO:teuthology.orchestra.run.smithi089.stdout: "poolop_active": 0, 2024-09-19T06:25:23.413 INFO:teuthology.orchestra.run.smithi089.stdout: "poolop_send": 0, 2024-09-19T06:25:23.413 INFO:teuthology.orchestra.run.smithi089.stdout: "poolop_resend": 0, 2024-09-19T06:25:23.413 INFO:teuthology.orchestra.run.smithi089.stdout: "poolstat_active": 0, 2024-09-19T06:25:23.413 INFO:teuthology.orchestra.run.smithi089.stdout: "poolstat_send": 0, 2024-09-19T06:25:23.413 INFO:teuthology.orchestra.run.smithi089.stdout: "poolstat_resend": 0, 2024-09-19T06:25:23.413 INFO:teuthology.orchestra.run.smithi089.stdout: "statfs_active": 0, 2024-09-19T06:25:23.414 INFO:teuthology.orchestra.run.smithi089.stdout: "statfs_send": 0, 2024-09-19T06:25:23.414 INFO:teuthology.orchestra.run.smithi089.stdout: "statfs_resend": 0, 2024-09-19T06:25:23.414 INFO:teuthology.orchestra.run.smithi089.stdout: "command_active": 0, 2024-09-19T06:25:23.414 INFO:teuthology.orchestra.run.smithi089.stdout: "command_send": 0, 2024-09-19T06:25:23.414 INFO:teuthology.orchestra.run.smithi089.stdout: "command_resend": 0, 2024-09-19T06:25:23.414 INFO:teuthology.orchestra.run.smithi089.stdout: "map_epoch": 92, 2024-09-19T06:25:23.414 INFO:teuthology.orchestra.run.smithi089.stdout: "map_full": 0, 2024-09-19T06:25:23.414 INFO:teuthology.orchestra.run.smithi089.stdout: "map_inc": 11, 2024-09-19T06:25:23.414 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_sessions": 4, 2024-09-19T06:25:23.414 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_session_open": 4, 2024-09-19T06:25:23.414 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_session_close": 0, 2024-09-19T06:25:23.414 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_laggy": 0, 2024-09-19T06:25:23.415 INFO:teuthology.orchestra.run.smithi089.stdout: "omap_wr": 0, 2024-09-19T06:25:23.415 INFO:teuthology.orchestra.run.smithi089.stdout: "omap_rd": 2, 2024-09-19T06:25:23.415 INFO:teuthology.orchestra.run.smithi089.stdout: "omap_del": 0 2024-09-19T06:25:23.415 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.415 INFO:teuthology.orchestra.run.smithi089.stdout: "oft": { 2024-09-19T06:25:23.415 INFO:teuthology.orchestra.run.smithi089.stdout: "omap_total_objs": 0, 2024-09-19T06:25:23.415 INFO:teuthology.orchestra.run.smithi089.stdout: "omap_total_kv_pairs": 0, 2024-09-19T06:25:23.415 INFO:teuthology.orchestra.run.smithi089.stdout: "omap_total_updates": 0, 2024-09-19T06:25:23.415 INFO:teuthology.orchestra.run.smithi089.stdout: "omap_total_removes": 0 2024-09-19T06:25:23.415 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.416 INFO:teuthology.orchestra.run.smithi089.stdout: "osd-slow-ops": { 2024-09-19T06:25:23.416 INFO:teuthology.orchestra.run.smithi089.stdout: "slow_ops_count": 0 2024-09-19T06:25:23.416 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.416 INFO:teuthology.orchestra.run.smithi089.stdout: "purge_queue": { 2024-09-19T06:25:23.416 INFO:teuthology.orchestra.run.smithi089.stdout: "pq_executing_ops": 0, 2024-09-19T06:25:23.416 INFO:teuthology.orchestra.run.smithi089.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T06:25:23.416 INFO:teuthology.orchestra.run.smithi089.stdout: "pq_executing": 0, 2024-09-19T06:25:23.416 INFO:teuthology.orchestra.run.smithi089.stdout: "pq_executing_high_water": 0, 2024-09-19T06:25:23.416 INFO:teuthology.orchestra.run.smithi089.stdout: "pq_executed_ops": 0, 2024-09-19T06:25:23.416 INFO:teuthology.orchestra.run.smithi089.stdout: "pq_executed": 0, 2024-09-19T06:25:23.416 INFO:teuthology.orchestra.run.smithi089.stdout: "pq_item_in_journal": 0 2024-09-19T06:25:23.416 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.417 INFO:teuthology.orchestra.run.smithi089.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:25:23.417 INFO:teuthology.orchestra.run.smithi089.stdout: "val": 0, 2024-09-19T06:25:23.417 INFO:teuthology.orchestra.run.smithi089.stdout: "max": 104857600, 2024-09-19T06:25:23.417 INFO:teuthology.orchestra.run.smithi089.stdout: "get_started": 0, 2024-09-19T06:25:23.417 INFO:teuthology.orchestra.run.smithi089.stdout: "get": 2332, 2024-09-19T06:25:23.417 INFO:teuthology.orchestra.run.smithi089.stdout: "get_sum": 1846270, 2024-09-19T06:25:23.417 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:23.417 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_success": 2332, 2024-09-19T06:25:23.417 INFO:teuthology.orchestra.run.smithi089.stdout: "take": 0, 2024-09-19T06:25:23.417 INFO:teuthology.orchestra.run.smithi089.stdout: "take_sum": 0, 2024-09-19T06:25:23.417 INFO:teuthology.orchestra.run.smithi089.stdout: "put": 2332, 2024-09-19T06:25:23.417 INFO:teuthology.orchestra.run.smithi089.stdout: "put_sum": 1846270, 2024-09-19T06:25:23.417 INFO:teuthology.orchestra.run.smithi089.stdout: "wait": { 2024-09-19T06:25:23.418 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:23.418 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:23.418 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:23.418 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-19T06:25:23.418 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.418 INFO:teuthology.orchestra.run.smithi089.stdout: "throttle-objecter_bytes": { 2024-09-19T06:25:23.418 INFO:teuthology.orchestra.run.smithi089.stdout: "val": 0, 2024-09-19T06:25:23.418 INFO:teuthology.orchestra.run.smithi089.stdout: "max": 104857600, 2024-09-19T06:25:23.418 INFO:teuthology.orchestra.run.smithi089.stdout: "get_started": 0, 2024-09-19T06:25:23.418 INFO:teuthology.orchestra.run.smithi089.stdout: "get": 0, 2024-09-19T06:25:23.418 INFO:teuthology.orchestra.run.smithi089.stdout: "get_sum": 0, 2024-09-19T06:25:23.418 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:23.418 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_success": 0, 2024-09-19T06:25:23.418 INFO:teuthology.orchestra.run.smithi089.stdout: "take": 2096, 2024-09-19T06:25:23.419 INFO:teuthology.orchestra.run.smithi089.stdout: "take_sum": 2690, 2024-09-19T06:25:23.419 INFO:teuthology.orchestra.run.smithi089.stdout: "put": 2096, 2024-09-19T06:25:23.419 INFO:teuthology.orchestra.run.smithi089.stdout: "put_sum": 2690, 2024-09-19T06:25:23.419 INFO:teuthology.orchestra.run.smithi089.stdout: "wait": { 2024-09-19T06:25:23.419 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:23.419 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:23.419 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:23.419 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-19T06:25:23.419 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.419 INFO:teuthology.orchestra.run.smithi089.stdout: "throttle-objecter_ops": { 2024-09-19T06:25:23.419 INFO:teuthology.orchestra.run.smithi089.stdout: "val": 0, 2024-09-19T06:25:23.419 INFO:teuthology.orchestra.run.smithi089.stdout: "max": 1024, 2024-09-19T06:25:23.420 INFO:teuthology.orchestra.run.smithi089.stdout: "get_started": 0, 2024-09-19T06:25:23.420 INFO:teuthology.orchestra.run.smithi089.stdout: "get": 0, 2024-09-19T06:25:23.420 INFO:teuthology.orchestra.run.smithi089.stdout: "get_sum": 0, 2024-09-19T06:25:23.420 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:23.420 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_success": 0, 2024-09-19T06:25:23.420 INFO:teuthology.orchestra.run.smithi089.stdout: "take": 2096, 2024-09-19T06:25:23.420 INFO:teuthology.orchestra.run.smithi089.stdout: "take_sum": 2096, 2024-09-19T06:25:23.420 INFO:teuthology.orchestra.run.smithi089.stdout: "put": 2096, 2024-09-19T06:25:23.420 INFO:teuthology.orchestra.run.smithi089.stdout: "put_sum": 2096, 2024-09-19T06:25:23.420 INFO:teuthology.orchestra.run.smithi089.stdout: "wait": { 2024-09-19T06:25:23.420 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:23.420 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:23.420 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:23.421 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-19T06:25:23.421 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.421 INFO:teuthology.orchestra.run.smithi089.stdout: "throttle-write_buf_throttle": { 2024-09-19T06:25:23.421 INFO:teuthology.orchestra.run.smithi089.stdout: "val": 0, 2024-09-19T06:25:23.421 INFO:teuthology.orchestra.run.smithi089.stdout: "max": 3758096384, 2024-09-19T06:25:23.421 INFO:teuthology.orchestra.run.smithi089.stdout: "get_started": 0, 2024-09-19T06:25:23.421 INFO:teuthology.orchestra.run.smithi089.stdout: "get": 0, 2024-09-19T06:25:23.421 INFO:teuthology.orchestra.run.smithi089.stdout: "get_sum": 0, 2024-09-19T06:25:23.421 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:23.421 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_success": 0, 2024-09-19T06:25:23.421 INFO:teuthology.orchestra.run.smithi089.stdout: "take": 0, 2024-09-19T06:25:23.421 INFO:teuthology.orchestra.run.smithi089.stdout: "take_sum": 0, 2024-09-19T06:25:23.421 INFO:teuthology.orchestra.run.smithi089.stdout: "put": 0, 2024-09-19T06:25:23.421 INFO:teuthology.orchestra.run.smithi089.stdout: "put_sum": 0, 2024-09-19T06:25:23.422 INFO:teuthology.orchestra.run.smithi089.stdout: "wait": { 2024-09-19T06:25:23.422 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:23.422 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:23.422 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:23.422 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-19T06:25:23.422 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:23.422 INFO:teuthology.orchestra.run.smithi089.stdout: "throttle-write_buf_throttle-0x55d8854046e0": { 2024-09-19T06:25:23.422 INFO:teuthology.orchestra.run.smithi089.stdout: "val": 0, 2024-09-19T06:25:23.422 INFO:teuthology.orchestra.run.smithi089.stdout: "max": 3758096384, 2024-09-19T06:25:23.422 INFO:teuthology.orchestra.run.smithi089.stdout: "get_started": 0, 2024-09-19T06:25:23.422 INFO:teuthology.orchestra.run.smithi089.stdout: "get": 0, 2024-09-19T06:25:23.422 INFO:teuthology.orchestra.run.smithi089.stdout: "get_sum": 0, 2024-09-19T06:25:23.422 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:23.423 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_success": 0, 2024-09-19T06:25:23.423 INFO:teuthology.orchestra.run.smithi089.stdout: "take": 0, 2024-09-19T06:25:23.423 INFO:teuthology.orchestra.run.smithi089.stdout: "take_sum": 0, 2024-09-19T06:25:23.423 INFO:teuthology.orchestra.run.smithi089.stdout: "put": 0, 2024-09-19T06:25:23.423 INFO:teuthology.orchestra.run.smithi089.stdout: "put_sum": 0, 2024-09-19T06:25:23.423 INFO:teuthology.orchestra.run.smithi089.stdout: "wait": { 2024-09-19T06:25:23.423 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:23.423 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:23.423 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:23.423 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-19T06:25:23.423 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-19T06:25:23.423 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-19T06:25:23.542 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:23 smithi089 ceph-mon[34160]: pgmap v330: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T06:25:23.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:23 smithi002 ceph-mon[30982]: pgmap v330: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T06:25:23.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:23 smithi090 ceph-mon[34497]: pgmap v330: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T06:25:24.077 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-19T06:25:24.077 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-19T06:25:24.077 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-09-19T06:25:24.077 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-09-19T06:25:24.078 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2024-09-19T06:25:24.078 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-09-19T06:25:24.078 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T06:25:24.078 DEBUG:tasks.check_counter:Getting stats from h 2024-09-19T06:25:24.078 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-19T06:25:24.323 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:25:24.830 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-19T06:25:24.830 INFO:teuthology.orchestra.run.smithi089.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:25:24.830 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_messages": 498, 2024-09-19T06:25:24.830 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages": 563, 2024-09-19T06:25:24.830 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_bytes": 143969, 2024-09-19T06:25:24.830 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_bytes": 199958, 2024-09-19T06:25:24.830 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_created_connections": 8, 2024-09-19T06:25:24.830 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_active_connections": 3, 2024-09-19T06:25:24.830 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_total_time": 0.067254681, 2024-09-19T06:25:24.831 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_send_time": 0.028631766, 2024-09-19T06:25:24.831 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_recv_time": 0.029461260, 2024-09-19T06:25:24.831 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_fast_dispatch_time": 0.003626605, 2024-09-19T06:25:24.831 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:25:24.831 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 561, 2024-09-19T06:25:24.831 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.037916788, 2024-09-19T06:25:24.831 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000067587 2024-09-19T06:25:24.831 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.831 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:25:24.831 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 1021, 2024-09-19T06:25:24.831 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000225696, 2024-09-19T06:25:24.831 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000221 2024-09-19T06:25:24.831 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.832 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T06:25:24.832 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T06:25:24.832 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.832 INFO:teuthology.orchestra.run.smithi089.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:25:24.832 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_messages": 30, 2024-09-19T06:25:24.832 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages": 202, 2024-09-19T06:25:24.832 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_bytes": 6294, 2024-09-19T06:25:24.832 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_bytes": 501675, 2024-09-19T06:25:24.832 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_created_connections": 14, 2024-09-19T06:25:24.832 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_active_connections": 4, 2024-09-19T06:25:24.832 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_total_time": 0.016161739, 2024-09-19T06:25:24.833 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_send_time": 0.007731440, 2024-09-19T06:25:24.833 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_recv_time": 0.006002316, 2024-09-19T06:25:24.833 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_fast_dispatch_time": 0.000369893, 2024-09-19T06:25:24.833 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:25:24.833 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 199, 2024-09-19T06:25:24.833 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.032214949, 2024-09-19T06:25:24.833 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000161884 2024-09-19T06:25:24.833 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.833 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:25:24.833 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 38, 2024-09-19T06:25:24.833 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000009646, 2024-09-19T06:25:24.834 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000253 2024-09-19T06:25:24.834 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.834 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T06:25:24.834 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_encrypted_bytes": 439536 2024-09-19T06:25:24.834 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.834 INFO:teuthology.orchestra.run.smithi089.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:25:24.834 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_messages": 348, 2024-09-19T06:25:24.834 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages": 331, 2024-09-19T06:25:24.834 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_bytes": 1502175, 2024-09-19T06:25:24.834 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_bytes": 990582, 2024-09-19T06:25:24.834 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_created_connections": 75, 2024-09-19T06:25:24.834 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_active_connections": 7, 2024-09-19T06:25:24.835 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_total_time": 0.071855138, 2024-09-19T06:25:24.835 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_send_time": 0.017500391, 2024-09-19T06:25:24.835 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_recv_time": 0.067464486, 2024-09-19T06:25:24.835 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_fast_dispatch_time": 0.000149947, 2024-09-19T06:25:24.835 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:25:24.835 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 331, 2024-09-19T06:25:24.835 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.031449982, 2024-09-19T06:25:24.835 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000095015 2024-09-19T06:25:24.835 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.835 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:25:24.835 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 70, 2024-09-19T06:25:24.835 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000005948, 2024-09-19T06:25:24.836 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000084 2024-09-19T06:25:24.836 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.836 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_encrypted_bytes": 1490416, 2024-09-19T06:25:24.836 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_encrypted_bytes": 134816 2024-09-19T06:25:24.836 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.836 INFO:teuthology.orchestra.run.smithi089.stdout: "cct": { 2024-09-19T06:25:24.836 INFO:teuthology.orchestra.run.smithi089.stdout: "total_workers": 1, 2024-09-19T06:25:24.836 INFO:teuthology.orchestra.run.smithi089.stdout: "unhealthy_workers": 0 2024-09-19T06:25:24.836 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.836 INFO:teuthology.orchestra.run.smithi089.stdout: "finisher-MDSRank": { 2024-09-19T06:25:24.836 INFO:teuthology.orchestra.run.smithi089.stdout: "queue_len": 0, 2024-09-19T06:25:24.837 INFO:teuthology.orchestra.run.smithi089.stdout: "complete_latency": { 2024-09-19T06:25:24.837 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 45, 2024-09-19T06:25:24.837 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.001229598, 2024-09-19T06:25:24.837 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000027324 2024-09-19T06:25:24.837 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-19T06:25:24.837 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.837 INFO:teuthology.orchestra.run.smithi089.stdout: "finisher-PurgeQueue": { 2024-09-19T06:25:24.837 INFO:teuthology.orchestra.run.smithi089.stdout: "queue_len": 0, 2024-09-19T06:25:24.838 INFO:teuthology.orchestra.run.smithi089.stdout: "complete_latency": { 2024-09-19T06:25:24.838 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 2, 2024-09-19T06:25:24.838 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000011981, 2024-09-19T06:25:24.838 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000005990 2024-09-19T06:25:24.838 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-19T06:25:24.838 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.838 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-19T06:25:24.838 INFO:teuthology.orchestra.run.smithi089.stdout: "request": 0, 2024-09-19T06:25:24.838 INFO:teuthology.orchestra.run.smithi089.stdout: "reply": 0, 2024-09-19T06:25:24.838 INFO:teuthology.orchestra.run.smithi089.stdout: "reply_latency": { 2024-09-19T06:25:24.838 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:24.839 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:24.839 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:24.839 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.839 INFO:teuthology.orchestra.run.smithi089.stdout: "slow_reply": 0, 2024-09-19T06:25:24.839 INFO:teuthology.orchestra.run.smithi089.stdout: "forward": 0, 2024-09-19T06:25:24.839 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_fetch_complete": 0, 2024-09-19T06:25:24.839 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_fetch_keys": 0, 2024-09-19T06:25:24.839 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_commit": 11, 2024-09-19T06:25:24.840 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_split": 0, 2024-09-19T06:25:24.840 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_merge": 0, 2024-09-19T06:25:24.840 INFO:teuthology.orchestra.run.smithi089.stdout: "inodes": 16, 2024-09-19T06:25:24.840 INFO:teuthology.orchestra.run.smithi089.stdout: "inodes_top": 0, 2024-09-19T06:25:24.840 INFO:teuthology.orchestra.run.smithi089.stdout: "inodes_bottom": 16, 2024-09-19T06:25:24.840 INFO:teuthology.orchestra.run.smithi089.stdout: "inodes_pin_tail": 0, 2024-09-19T06:25:24.840 INFO:teuthology.orchestra.run.smithi089.stdout: "inodes_pinned": 13, 2024-09-19T06:25:24.840 INFO:teuthology.orchestra.run.smithi089.stdout: "inodes_expired": 2, 2024-09-19T06:25:24.840 INFO:teuthology.orchestra.run.smithi089.stdout: "inodes_with_caps": 0, 2024-09-19T06:25:24.840 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": 0, 2024-09-19T06:25:24.840 INFO:teuthology.orchestra.run.smithi089.stdout: "subtrees": 3, 2024-09-19T06:25:24.840 INFO:teuthology.orchestra.run.smithi089.stdout: "traverse": 6, 2024-09-19T06:25:24.841 INFO:teuthology.orchestra.run.smithi089.stdout: "traverse_hit": 3, 2024-09-19T06:25:24.841 INFO:teuthology.orchestra.run.smithi089.stdout: "traverse_forward": 0, 2024-09-19T06:25:24.841 INFO:teuthology.orchestra.run.smithi089.stdout: "traverse_discover": 3, 2024-09-19T06:25:24.841 INFO:teuthology.orchestra.run.smithi089.stdout: "traverse_dir_fetch": 0, 2024-09-19T06:25:24.841 INFO:teuthology.orchestra.run.smithi089.stdout: "traverse_remote_ino": 0, 2024-09-19T06:25:24.841 INFO:teuthology.orchestra.run.smithi089.stdout: "traverse_lock": 0, 2024-09-19T06:25:24.841 INFO:teuthology.orchestra.run.smithi089.stdout: "load_cent": 0, 2024-09-19T06:25:24.841 INFO:teuthology.orchestra.run.smithi089.stdout: "q": 0, 2024-09-19T06:25:24.841 INFO:teuthology.orchestra.run.smithi089.stdout: "exported": 0, 2024-09-19T06:25:24.841 INFO:teuthology.orchestra.run.smithi089.stdout: "exported_inodes": 0, 2024-09-19T06:25:24.841 INFO:teuthology.orchestra.run.smithi089.stdout: "imported": 0, 2024-09-19T06:25:24.841 INFO:teuthology.orchestra.run.smithi089.stdout: "imported_inodes": 0, 2024-09-19T06:25:24.841 INFO:teuthology.orchestra.run.smithi089.stdout: "openino_dir_fetch": 0, 2024-09-19T06:25:24.842 INFO:teuthology.orchestra.run.smithi089.stdout: "openino_backtrace_fetch": 0, 2024-09-19T06:25:24.842 INFO:teuthology.orchestra.run.smithi089.stdout: "openino_peer_discover": 0, 2024-09-19T06:25:24.842 INFO:teuthology.orchestra.run.smithi089.stdout: "root_rfiles": 4, 2024-09-19T06:25:24.842 INFO:teuthology.orchestra.run.smithi089.stdout: "root_rbytes": 234, 2024-09-19T06:25:24.842 INFO:teuthology.orchestra.run.smithi089.stdout: "root_rsnaps": 6, 2024-09-19T06:25:24.842 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T06:25:24.842 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_set_tag": 0, 2024-09-19T06:25:24.842 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T06:25:24.842 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_inotable_repaired": 0, 2024-09-19T06:25:24.842 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_dir_inodes": 0, 2024-09-19T06:25:24.842 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T06:25:24.842 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T06:25:24.842 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_file_inodes": 0, 2024-09-19T06:25:24.843 INFO:teuthology.orchestra.run.smithi089.stdout: "handle_inode_file_caps": 0, 2024-09-19T06:25:24.843 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T06:25:24.843 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_cap_op_grant": 0, 2024-09-19T06:25:24.843 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T06:25:24.843 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T06:25:24.843 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T06:25:24.843 INFO:teuthology.orchestra.run.smithi089.stdout: "handle_client_caps": 0, 2024-09-19T06:25:24.843 INFO:teuthology.orchestra.run.smithi089.stdout: "handle_client_caps_dirty": 0, 2024-09-19T06:25:24.843 INFO:teuthology.orchestra.run.smithi089.stdout: "handle_client_cap_release": 0, 2024-09-19T06:25:24.843 INFO:teuthology.orchestra.run.smithi089.stdout: "process_request_cap_release": 0 2024-09-19T06:25:24.843 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.843 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_cache": { 2024-09-19T06:25:24.843 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_update": 0, 2024-09-19T06:25:24.843 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_update_receipt": 9, 2024-09-19T06:25:24.844 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_try_discover": 6, 2024-09-19T06:25:24.844 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_send_discover": 7, 2024-09-19T06:25:24.844 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_handle_discover": 0, 2024-09-19T06:25:24.844 INFO:teuthology.orchestra.run.smithi089.stdout: "num_strays": 0, 2024-09-19T06:25:24.844 INFO:teuthology.orchestra.run.smithi089.stdout: "num_strays_delayed": 0, 2024-09-19T06:25:24.844 INFO:teuthology.orchestra.run.smithi089.stdout: "num_strays_enqueuing": 0, 2024-09-19T06:25:24.844 INFO:teuthology.orchestra.run.smithi089.stdout: "strays_created": 0, 2024-09-19T06:25:24.844 INFO:teuthology.orchestra.run.smithi089.stdout: "strays_enqueued": 0, 2024-09-19T06:25:24.844 INFO:teuthology.orchestra.run.smithi089.stdout: "strays_reintegrated": 0, 2024-09-19T06:25:24.844 INFO:teuthology.orchestra.run.smithi089.stdout: "strays_migrated": 0, 2024-09-19T06:25:24.844 INFO:teuthology.orchestra.run.smithi089.stdout: "num_recovering_processing": 0, 2024-09-19T06:25:24.844 INFO:teuthology.orchestra.run.smithi089.stdout: "num_recovering_enqueued": 0, 2024-09-19T06:25:24.844 INFO:teuthology.orchestra.run.smithi089.stdout: "num_recovering_prioritized": 0, 2024-09-19T06:25:24.845 INFO:teuthology.orchestra.run.smithi089.stdout: "recovery_started": 0, 2024-09-19T06:25:24.845 INFO:teuthology.orchestra.run.smithi089.stdout: "recovery_completed": 0, 2024-09-19T06:25:24.845 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_quiesce_path": 0, 2024-09-19T06:25:24.845 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_quiesce_inode": 0, 2024-09-19T06:25:24.845 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T06:25:24.845 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_exportdir": 0, 2024-09-19T06:25:24.845 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_flush": 0, 2024-09-19T06:25:24.845 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_fragmentdir": 0, 2024-09-19T06:25:24.845 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_fragstats": 0, 2024-09-19T06:25:24.845 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_inodestats": 0 2024-09-19T06:25:24.845 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.845 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_log": { 2024-09-19T06:25:24.846 INFO:teuthology.orchestra.run.smithi089.stdout: "evlrg": 0, 2024-09-19T06:25:24.846 INFO:teuthology.orchestra.run.smithi089.stdout: "evadd": 3, 2024-09-19T06:25:24.846 INFO:teuthology.orchestra.run.smithi089.stdout: "evex": 0, 2024-09-19T06:25:24.846 INFO:teuthology.orchestra.run.smithi089.stdout: "evtrm": 0, 2024-09-19T06:25:24.846 INFO:teuthology.orchestra.run.smithi089.stdout: "ev": 3, 2024-09-19T06:25:24.846 INFO:teuthology.orchestra.run.smithi089.stdout: "evexg": 0, 2024-09-19T06:25:24.846 INFO:teuthology.orchestra.run.smithi089.stdout: "evexd": 0, 2024-09-19T06:25:24.846 INFO:teuthology.orchestra.run.smithi089.stdout: "segadd": 2, 2024-09-19T06:25:24.846 INFO:teuthology.orchestra.run.smithi089.stdout: "segex": 0, 2024-09-19T06:25:24.846 INFO:teuthology.orchestra.run.smithi089.stdout: "segtrm": 0, 2024-09-19T06:25:24.846 INFO:teuthology.orchestra.run.smithi089.stdout: "seg": 2, 2024-09-19T06:25:24.846 INFO:teuthology.orchestra.run.smithi089.stdout: "segmjr": 2, 2024-09-19T06:25:24.846 INFO:teuthology.orchestra.run.smithi089.stdout: "segexg": 0, 2024-09-19T06:25:24.846 INFO:teuthology.orchestra.run.smithi089.stdout: "segexd": 0, 2024-09-19T06:25:24.847 INFO:teuthology.orchestra.run.smithi089.stdout: "expos": 4194304, 2024-09-19T06:25:24.847 INFO:teuthology.orchestra.run.smithi089.stdout: "wrpos": 4195387, 2024-09-19T06:25:24.847 INFO:teuthology.orchestra.run.smithi089.stdout: "rdpos": 0, 2024-09-19T06:25:24.847 INFO:teuthology.orchestra.run.smithi089.stdout: "jlat": { 2024-09-19T06:25:24.847 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 2, 2024-09-19T06:25:24.847 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.002951659, 2024-09-19T06:25:24.847 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.001475829 2024-09-19T06:25:24.847 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.847 INFO:teuthology.orchestra.run.smithi089.stdout: "replayed": 0 2024-09-19T06:25:24.848 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.848 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_mem": { 2024-09-19T06:25:24.848 INFO:teuthology.orchestra.run.smithi089.stdout: "ino": 20, 2024-09-19T06:25:24.848 INFO:teuthology.orchestra.run.smithi089.stdout: "ino+": 21, 2024-09-19T06:25:24.848 INFO:teuthology.orchestra.run.smithi089.stdout: "ino-": 1, 2024-09-19T06:25:24.848 INFO:teuthology.orchestra.run.smithi089.stdout: "dir": 19, 2024-09-19T06:25:24.848 INFO:teuthology.orchestra.run.smithi089.stdout: "dir+": 21, 2024-09-19T06:25:24.848 INFO:teuthology.orchestra.run.smithi089.stdout: "dir-": 2, 2024-09-19T06:25:24.848 INFO:teuthology.orchestra.run.smithi089.stdout: "dn": 16, 2024-09-19T06:25:24.849 INFO:teuthology.orchestra.run.smithi089.stdout: "dn+": 18, 2024-09-19T06:25:24.849 INFO:teuthology.orchestra.run.smithi089.stdout: "dn-": 2, 2024-09-19T06:25:24.849 INFO:teuthology.orchestra.run.smithi089.stdout: "cap": 0, 2024-09-19T06:25:24.849 INFO:teuthology.orchestra.run.smithi089.stdout: "cap+": 0, 2024-09-19T06:25:24.849 INFO:teuthology.orchestra.run.smithi089.stdout: "cap-": 0, 2024-09-19T06:25:24.849 INFO:teuthology.orchestra.run.smithi089.stdout: "rss": 49744, 2024-09-19T06:25:24.849 INFO:teuthology.orchestra.run.smithi089.stdout: "heap": 223520 2024-09-19T06:25:24.849 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.849 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_server": { 2024-09-19T06:25:24.849 INFO:teuthology.orchestra.run.smithi089.stdout: "dispatch_client_request": 0, 2024-09-19T06:25:24.849 INFO:teuthology.orchestra.run.smithi089.stdout: "dispatch_server_request": 0, 2024-09-19T06:25:24.849 INFO:teuthology.orchestra.run.smithi089.stdout: "handle_client_request": 0, 2024-09-19T06:25:24.850 INFO:teuthology.orchestra.run.smithi089.stdout: "handle_client_session": 9, 2024-09-19T06:25:24.850 INFO:teuthology.orchestra.run.smithi089.stdout: "handle_peer_request": 0, 2024-09-19T06:25:24.850 INFO:teuthology.orchestra.run.smithi089.stdout: "req_create_latency": { 2024-09-19T06:25:24.850 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:24.850 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:24.850 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:24.850 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.850 INFO:teuthology.orchestra.run.smithi089.stdout: "req_getattr_latency": { 2024-09-19T06:25:24.850 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:24.850 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:24.850 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:24.850 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.850 INFO:teuthology.orchestra.run.smithi089.stdout: "req_getfilelock_latency": { 2024-09-19T06:25:24.851 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:24.851 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:24.851 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:24.851 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.851 INFO:teuthology.orchestra.run.smithi089.stdout: "req_link_latency": { 2024-09-19T06:25:24.851 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:24.851 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:24.851 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:24.851 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.851 INFO:teuthology.orchestra.run.smithi089.stdout: "req_lookup_latency": { 2024-09-19T06:25:24.851 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:24.851 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:24.851 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:24.852 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.852 INFO:teuthology.orchestra.run.smithi089.stdout: "req_lookuphash_latency": { 2024-09-19T06:25:24.852 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:24.852 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:24.852 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:24.852 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.852 INFO:teuthology.orchestra.run.smithi089.stdout: "req_lookupino_latency": { 2024-09-19T06:25:24.852 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:24.852 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:24.852 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:24.852 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.852 INFO:teuthology.orchestra.run.smithi089.stdout: "req_lookupname_latency": { 2024-09-19T06:25:24.852 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:24.853 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:24.853 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:24.853 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.853 INFO:teuthology.orchestra.run.smithi089.stdout: "req_lookupparent_latency": { 2024-09-19T06:25:24.853 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:24.853 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:24.853 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:24.853 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.853 INFO:teuthology.orchestra.run.smithi089.stdout: "req_lookupsnap_latency": { 2024-09-19T06:25:24.853 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:24.853 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:24.853 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:24.854 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.854 INFO:teuthology.orchestra.run.smithi089.stdout: "req_lssnap_latency": { 2024-09-19T06:25:24.854 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:24.854 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:24.854 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:24.854 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.854 INFO:teuthology.orchestra.run.smithi089.stdout: "req_mkdir_latency": { 2024-09-19T06:25:24.854 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:24.855 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:24.855 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:24.855 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.855 INFO:teuthology.orchestra.run.smithi089.stdout: "req_mknod_latency": { 2024-09-19T06:25:24.855 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:24.855 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:24.855 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:24.855 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.855 INFO:teuthology.orchestra.run.smithi089.stdout: "req_mksnap_latency": { 2024-09-19T06:25:24.856 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:24.856 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:24.856 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:24.856 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.856 INFO:teuthology.orchestra.run.smithi089.stdout: "req_open_latency": { 2024-09-19T06:25:24.856 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:24.856 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:24.856 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:24.856 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.856 INFO:teuthology.orchestra.run.smithi089.stdout: "req_readdir_latency": { 2024-09-19T06:25:24.856 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:24.856 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:24.857 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:24.857 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.857 INFO:teuthology.orchestra.run.smithi089.stdout: "req_rename_latency": { 2024-09-19T06:25:24.857 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:24.857 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:24.857 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:24.857 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.857 INFO:teuthology.orchestra.run.smithi089.stdout: "req_renamesnap_latency": { 2024-09-19T06:25:24.857 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:24.857 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:24.857 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:24.857 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.857 INFO:teuthology.orchestra.run.smithi089.stdout: "req_snapdiff_latency": { 2024-09-19T06:25:24.858 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:24.858 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:24.858 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:24.858 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.858 INFO:teuthology.orchestra.run.smithi089.stdout: "req_rmdir_latency": { 2024-09-19T06:25:24.858 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:24.858 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:24.858 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:24.858 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.858 INFO:teuthology.orchestra.run.smithi089.stdout: "req_rmsnap_latency": { 2024-09-19T06:25:24.858 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:24.858 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:24.859 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:24.859 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.859 INFO:teuthology.orchestra.run.smithi089.stdout: "req_rmxattr_latency": { 2024-09-19T06:25:24.859 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:24.859 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:24.859 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:24.859 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.859 INFO:teuthology.orchestra.run.smithi089.stdout: "req_setattr_latency": { 2024-09-19T06:25:24.859 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:24.859 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:24.859 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:24.859 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.859 INFO:teuthology.orchestra.run.smithi089.stdout: "req_setdirlayout_latency": { 2024-09-19T06:25:24.860 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:24.860 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:24.860 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:24.860 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.860 INFO:teuthology.orchestra.run.smithi089.stdout: "req_setfilelock_latency": { 2024-09-19T06:25:24.860 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:24.860 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:24.860 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:24.860 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.860 INFO:teuthology.orchestra.run.smithi089.stdout: "req_setlayout_latency": { 2024-09-19T06:25:24.860 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:24.860 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:24.860 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:24.861 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.861 INFO:teuthology.orchestra.run.smithi089.stdout: "req_setxattr_latency": { 2024-09-19T06:25:24.861 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:24.861 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:24.861 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:24.861 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.861 INFO:teuthology.orchestra.run.smithi089.stdout: "req_symlink_latency": { 2024-09-19T06:25:24.861 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:24.861 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:24.861 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:24.861 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.861 INFO:teuthology.orchestra.run.smithi089.stdout: "req_unlink_latency": { 2024-09-19T06:25:24.861 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:24.862 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:24.862 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:24.862 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.862 INFO:teuthology.orchestra.run.smithi089.stdout: "cap_revoke_eviction": 0, 2024-09-19T06:25:24.862 INFO:teuthology.orchestra.run.smithi089.stdout: "cap_acquisition_throttle": 0, 2024-09-19T06:25:24.862 INFO:teuthology.orchestra.run.smithi089.stdout: "req_getvxattr_latency": { 2024-09-19T06:25:24.862 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:24.862 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:24.862 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:24.862 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-19T06:25:24.862 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.862 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_sessions": { 2024-09-19T06:25:24.862 INFO:teuthology.orchestra.run.smithi089.stdout: "session_count": 1, 2024-09-19T06:25:24.863 INFO:teuthology.orchestra.run.smithi089.stdout: "session_add": 1, 2024-09-19T06:25:24.863 INFO:teuthology.orchestra.run.smithi089.stdout: "session_remove": 0, 2024-09-19T06:25:24.863 INFO:teuthology.orchestra.run.smithi089.stdout: "sessions_open": 1, 2024-09-19T06:25:24.863 INFO:teuthology.orchestra.run.smithi089.stdout: "sessions_stale": 0, 2024-09-19T06:25:24.863 INFO:teuthology.orchestra.run.smithi089.stdout: "total_load": 0, 2024-09-19T06:25:24.863 INFO:teuthology.orchestra.run.smithi089.stdout: "average_load": 0, 2024-09-19T06:25:24.863 INFO:teuthology.orchestra.run.smithi089.stdout: "avg_session_uptime": 635, 2024-09-19T06:25:24.863 INFO:teuthology.orchestra.run.smithi089.stdout: "mdthresh_evicted": 0 2024-09-19T06:25:24.863 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.863 INFO:teuthology.orchestra.run.smithi089.stdout: "mempool": { 2024-09-19T06:25:24.863 INFO:teuthology.orchestra.run.smithi089.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:25:24.864 INFO:teuthology.orchestra.run.smithi089.stdout: "bloom_filter_items": 0, 2024-09-19T06:25:24.864 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:25:24.864 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:25:24.864 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:25:24.864 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:25:24.864 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:25:24.864 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:25:24.864 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:25:24.864 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:25:24.864 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:25:24.864 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:25:24.864 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:25:24.864 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:25:24.865 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:25:24.865 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_extent_items": 0, 2024-09-19T06:25:24.865 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:25:24.865 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_blob_items": 0, 2024-09-19T06:25:24.865 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:25:24.865 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:25:24.865 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:25:24.865 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:25:24.865 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:25:24.865 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:25:24.865 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:25:24.865 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_txc_items": 0, 2024-09-19T06:25:24.866 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:25:24.866 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:25:24.866 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:25:24.866 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_writing_items": 0, 2024-09-19T06:25:24.866 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_bytes": 0, 2024-09-19T06:25:24.866 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_items": 0, 2024-09-19T06:25:24.866 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:25:24.866 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:25:24.866 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:25:24.866 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:25:24.866 INFO:teuthology.orchestra.run.smithi089.stdout: "buffer_anon_bytes": 246359, 2024-09-19T06:25:24.866 INFO:teuthology.orchestra.run.smithi089.stdout: "buffer_anon_items": 82, 2024-09-19T06:25:24.867 INFO:teuthology.orchestra.run.smithi089.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:25:24.867 INFO:teuthology.orchestra.run.smithi089.stdout: "buffer_meta_items": 0, 2024-09-19T06:25:24.867 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_bytes": 0, 2024-09-19T06:25:24.867 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_items": 0, 2024-09-19T06:25:24.867 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:25:24.867 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mapbl_items": 0, 2024-09-19T06:25:24.867 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:25:24.867 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pglog_items": 0, 2024-09-19T06:25:24.867 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_bytes": 8136, 2024-09-19T06:25:24.867 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_items": 180, 2024-09-19T06:25:24.867 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:25:24.867 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:25:24.867 INFO:teuthology.orchestra.run.smithi089.stdout: "pgmap_bytes": 0, 2024-09-19T06:25:24.868 INFO:teuthology.orchestra.run.smithi089.stdout: "pgmap_items": 0, 2024-09-19T06:25:24.868 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_co_bytes": 84917, 2024-09-19T06:25:24.868 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_co_items": 328, 2024-09-19T06:25:24.868 INFO:teuthology.orchestra.run.smithi089.stdout: "unittest_1_bytes": 0, 2024-09-19T06:25:24.868 INFO:teuthology.orchestra.run.smithi089.stdout: "unittest_1_items": 0, 2024-09-19T06:25:24.868 INFO:teuthology.orchestra.run.smithi089.stdout: "unittest_2_bytes": 0, 2024-09-19T06:25:24.868 INFO:teuthology.orchestra.run.smithi089.stdout: "unittest_2_items": 0 2024-09-19T06:25:24.868 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.868 INFO:teuthology.orchestra.run.smithi089.stdout: "objecter": { 2024-09-19T06:25:24.868 INFO:teuthology.orchestra.run.smithi089.stdout: "op_active": 0, 2024-09-19T06:25:24.868 INFO:teuthology.orchestra.run.smithi089.stdout: "op_laggy": 0, 2024-09-19T06:25:24.868 INFO:teuthology.orchestra.run.smithi089.stdout: "op_send": 37, 2024-09-19T06:25:24.869 INFO:teuthology.orchestra.run.smithi089.stdout: "op_send_bytes": 11295, 2024-09-19T06:25:24.869 INFO:teuthology.orchestra.run.smithi089.stdout: "op_resend": 33, 2024-09-19T06:25:24.869 INFO:teuthology.orchestra.run.smithi089.stdout: "op_reply": 37, 2024-09-19T06:25:24.869 INFO:teuthology.orchestra.run.smithi089.stdout: "op_latency": { 2024-09-19T06:25:24.869 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 37, 2024-09-19T06:25:24.869 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 2.189949482, 2024-09-19T06:25:24.869 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.059187823 2024-09-19T06:25:24.869 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.869 INFO:teuthology.orchestra.run.smithi089.stdout: "op_inflight": 0, 2024-09-19T06:25:24.869 INFO:teuthology.orchestra.run.smithi089.stdout: "oplen_avg": { 2024-09-19T06:25:24.869 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 37, 2024-09-19T06:25:24.869 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 59 2024-09-19T06:25:24.870 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.870 INFO:teuthology.orchestra.run.smithi089.stdout: "op": 37, 2024-09-19T06:25:24.870 INFO:teuthology.orchestra.run.smithi089.stdout: "op_r": 0, 2024-09-19T06:25:24.870 INFO:teuthology.orchestra.run.smithi089.stdout: "op_w": 37, 2024-09-19T06:25:24.870 INFO:teuthology.orchestra.run.smithi089.stdout: "op_rmw": 0, 2024-09-19T06:25:24.870 INFO:teuthology.orchestra.run.smithi089.stdout: "op_pg": 0, 2024-09-19T06:25:24.870 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_stat": 0, 2024-09-19T06:25:24.870 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_create": 10, 2024-09-19T06:25:24.870 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_read": 0, 2024-09-19T06:25:24.870 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_write": 2, 2024-09-19T06:25:24.870 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_writefull": 6, 2024-09-19T06:25:24.870 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_writesame": 0, 2024-09-19T06:25:24.870 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_append": 0, 2024-09-19T06:25:24.871 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_zero": 0, 2024-09-19T06:25:24.871 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_truncate": 0, 2024-09-19T06:25:24.871 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_delete": 6, 2024-09-19T06:25:24.871 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_mapext": 0, 2024-09-19T06:25:24.871 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_sparse_read": 0, 2024-09-19T06:25:24.871 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_clonerange": 0, 2024-09-19T06:25:24.871 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_getxattr": 0, 2024-09-19T06:25:24.871 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_setxattr": 20, 2024-09-19T06:25:24.871 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_cmpxattr": 0, 2024-09-19T06:25:24.871 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_rmxattr": 0, 2024-09-19T06:25:24.871 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_resetxattrs": 0, 2024-09-19T06:25:24.871 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_call": 0, 2024-09-19T06:25:24.872 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_watch": 0, 2024-09-19T06:25:24.872 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_notify": 0, 2024-09-19T06:25:24.872 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T06:25:24.872 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_pgls": 0, 2024-09-19T06:25:24.872 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_pgls_filter": 0, 2024-09-19T06:25:24.872 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_other": 0, 2024-09-19T06:25:24.872 INFO:teuthology.orchestra.run.smithi089.stdout: "linger_active": 0, 2024-09-19T06:25:24.872 INFO:teuthology.orchestra.run.smithi089.stdout: "linger_send": 0, 2024-09-19T06:25:24.872 INFO:teuthology.orchestra.run.smithi089.stdout: "linger_resend": 0, 2024-09-19T06:25:24.872 INFO:teuthology.orchestra.run.smithi089.stdout: "linger_ping": 0, 2024-09-19T06:25:24.872 INFO:teuthology.orchestra.run.smithi089.stdout: "poolop_active": 0, 2024-09-19T06:25:24.872 INFO:teuthology.orchestra.run.smithi089.stdout: "poolop_send": 0, 2024-09-19T06:25:24.872 INFO:teuthology.orchestra.run.smithi089.stdout: "poolop_resend": 0, 2024-09-19T06:25:24.873 INFO:teuthology.orchestra.run.smithi089.stdout: "poolstat_active": 0, 2024-09-19T06:25:24.873 INFO:teuthology.orchestra.run.smithi089.stdout: "poolstat_send": 0, 2024-09-19T06:25:24.873 INFO:teuthology.orchestra.run.smithi089.stdout: "poolstat_resend": 0, 2024-09-19T06:25:24.873 INFO:teuthology.orchestra.run.smithi089.stdout: "statfs_active": 0, 2024-09-19T06:25:24.873 INFO:teuthology.orchestra.run.smithi089.stdout: "statfs_send": 0, 2024-09-19T06:25:24.873 INFO:teuthology.orchestra.run.smithi089.stdout: "statfs_resend": 0, 2024-09-19T06:25:24.873 INFO:teuthology.orchestra.run.smithi089.stdout: "command_active": 0, 2024-09-19T06:25:24.873 INFO:teuthology.orchestra.run.smithi089.stdout: "command_send": 0, 2024-09-19T06:25:24.873 INFO:teuthology.orchestra.run.smithi089.stdout: "command_resend": 0, 2024-09-19T06:25:24.873 INFO:teuthology.orchestra.run.smithi089.stdout: "map_epoch": 92, 2024-09-19T06:25:24.873 INFO:teuthology.orchestra.run.smithi089.stdout: "map_full": 0, 2024-09-19T06:25:24.873 INFO:teuthology.orchestra.run.smithi089.stdout: "map_inc": 12, 2024-09-19T06:25:24.874 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_sessions": 9, 2024-09-19T06:25:24.874 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_session_open": 9, 2024-09-19T06:25:24.874 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_session_close": 0, 2024-09-19T06:25:24.874 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_laggy": 0, 2024-09-19T06:25:24.874 INFO:teuthology.orchestra.run.smithi089.stdout: "omap_wr": 14, 2024-09-19T06:25:24.874 INFO:teuthology.orchestra.run.smithi089.stdout: "omap_rd": 0, 2024-09-19T06:25:24.874 INFO:teuthology.orchestra.run.smithi089.stdout: "omap_del": 1 2024-09-19T06:25:24.874 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.874 INFO:teuthology.orchestra.run.smithi089.stdout: "oft": { 2024-09-19T06:25:24.874 INFO:teuthology.orchestra.run.smithi089.stdout: "omap_total_objs": 1, 2024-09-19T06:25:24.874 INFO:teuthology.orchestra.run.smithi089.stdout: "omap_total_kv_pairs": 0, 2024-09-19T06:25:24.874 INFO:teuthology.orchestra.run.smithi089.stdout: "omap_total_updates": 0, 2024-09-19T06:25:24.874 INFO:teuthology.orchestra.run.smithi089.stdout: "omap_total_removes": 0 2024-09-19T06:25:24.874 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.875 INFO:teuthology.orchestra.run.smithi089.stdout: "osd-slow-ops": { 2024-09-19T06:25:24.875 INFO:teuthology.orchestra.run.smithi089.stdout: "slow_ops_count": 0 2024-09-19T06:25:24.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.875 INFO:teuthology.orchestra.run.smithi089.stdout: "purge_queue": { 2024-09-19T06:25:24.875 INFO:teuthology.orchestra.run.smithi089.stdout: "pq_executing_ops": 0, 2024-09-19T06:25:24.875 INFO:teuthology.orchestra.run.smithi089.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T06:25:24.875 INFO:teuthology.orchestra.run.smithi089.stdout: "pq_executing": 0, 2024-09-19T06:25:24.875 INFO:teuthology.orchestra.run.smithi089.stdout: "pq_executing_high_water": 0, 2024-09-19T06:25:24.875 INFO:teuthology.orchestra.run.smithi089.stdout: "pq_executed_ops": 0, 2024-09-19T06:25:24.875 INFO:teuthology.orchestra.run.smithi089.stdout: "pq_executed": 0, 2024-09-19T06:25:24.875 INFO:teuthology.orchestra.run.smithi089.stdout: "pq_item_in_journal": 0 2024-09-19T06:25:24.875 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.876 INFO:teuthology.orchestra.run.smithi089.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:25:24.876 INFO:teuthology.orchestra.run.smithi089.stdout: "val": 0, 2024-09-19T06:25:24.876 INFO:teuthology.orchestra.run.smithi089.stdout: "max": 104857600, 2024-09-19T06:25:24.876 INFO:teuthology.orchestra.run.smithi089.stdout: "get_started": 0, 2024-09-19T06:25:24.876 INFO:teuthology.orchestra.run.smithi089.stdout: "get": 872, 2024-09-19T06:25:24.876 INFO:teuthology.orchestra.run.smithi089.stdout: "get_sum": 1557338, 2024-09-19T06:25:24.876 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:24.876 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_success": 872, 2024-09-19T06:25:24.876 INFO:teuthology.orchestra.run.smithi089.stdout: "take": 0, 2024-09-19T06:25:24.876 INFO:teuthology.orchestra.run.smithi089.stdout: "take_sum": 0, 2024-09-19T06:25:24.876 INFO:teuthology.orchestra.run.smithi089.stdout: "put": 872, 2024-09-19T06:25:24.876 INFO:teuthology.orchestra.run.smithi089.stdout: "put_sum": 1557338, 2024-09-19T06:25:24.876 INFO:teuthology.orchestra.run.smithi089.stdout: "wait": { 2024-09-19T06:25:24.877 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:24.877 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:24.877 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:24.877 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-19T06:25:24.877 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.877 INFO:teuthology.orchestra.run.smithi089.stdout: "throttle-objecter_bytes": { 2024-09-19T06:25:24.877 INFO:teuthology.orchestra.run.smithi089.stdout: "val": 0, 2024-09-19T06:25:24.877 INFO:teuthology.orchestra.run.smithi089.stdout: "max": 104857600, 2024-09-19T06:25:24.877 INFO:teuthology.orchestra.run.smithi089.stdout: "get_started": 0, 2024-09-19T06:25:24.877 INFO:teuthology.orchestra.run.smithi089.stdout: "get": 0, 2024-09-19T06:25:24.877 INFO:teuthology.orchestra.run.smithi089.stdout: "get_sum": 0, 2024-09-19T06:25:24.877 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:24.877 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_success": 0, 2024-09-19T06:25:24.878 INFO:teuthology.orchestra.run.smithi089.stdout: "take": 37, 2024-09-19T06:25:24.878 INFO:teuthology.orchestra.run.smithi089.stdout: "take_sum": 11295, 2024-09-19T06:25:24.878 INFO:teuthology.orchestra.run.smithi089.stdout: "put": 37, 2024-09-19T06:25:24.878 INFO:teuthology.orchestra.run.smithi089.stdout: "put_sum": 11295, 2024-09-19T06:25:24.878 INFO:teuthology.orchestra.run.smithi089.stdout: "wait": { 2024-09-19T06:25:24.878 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:24.878 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:24.878 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:24.878 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-19T06:25:24.878 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.878 INFO:teuthology.orchestra.run.smithi089.stdout: "throttle-objecter_ops": { 2024-09-19T06:25:24.878 INFO:teuthology.orchestra.run.smithi089.stdout: "val": 0, 2024-09-19T06:25:24.878 INFO:teuthology.orchestra.run.smithi089.stdout: "max": 1024, 2024-09-19T06:25:24.879 INFO:teuthology.orchestra.run.smithi089.stdout: "get_started": 0, 2024-09-19T06:25:24.879 INFO:teuthology.orchestra.run.smithi089.stdout: "get": 0, 2024-09-19T06:25:24.879 INFO:teuthology.orchestra.run.smithi089.stdout: "get_sum": 0, 2024-09-19T06:25:24.879 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:24.879 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_success": 0, 2024-09-19T06:25:24.879 INFO:teuthology.orchestra.run.smithi089.stdout: "take": 37, 2024-09-19T06:25:24.879 INFO:teuthology.orchestra.run.smithi089.stdout: "take_sum": 37, 2024-09-19T06:25:24.879 INFO:teuthology.orchestra.run.smithi089.stdout: "put": 37, 2024-09-19T06:25:24.879 INFO:teuthology.orchestra.run.smithi089.stdout: "put_sum": 37, 2024-09-19T06:25:24.879 INFO:teuthology.orchestra.run.smithi089.stdout: "wait": { 2024-09-19T06:25:24.879 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:24.879 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:24.880 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:24.880 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-19T06:25:24.880 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.880 INFO:teuthology.orchestra.run.smithi089.stdout: "throttle-write_buf_throttle": { 2024-09-19T06:25:24.880 INFO:teuthology.orchestra.run.smithi089.stdout: "val": 0, 2024-09-19T06:25:24.880 INFO:teuthology.orchestra.run.smithi089.stdout: "max": 3758096384, 2024-09-19T06:25:24.880 INFO:teuthology.orchestra.run.smithi089.stdout: "get_started": 0, 2024-09-19T06:25:24.880 INFO:teuthology.orchestra.run.smithi089.stdout: "get": 0, 2024-09-19T06:25:24.880 INFO:teuthology.orchestra.run.smithi089.stdout: "get_sum": 0, 2024-09-19T06:25:24.880 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:24.880 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_success": 0, 2024-09-19T06:25:24.880 INFO:teuthology.orchestra.run.smithi089.stdout: "take": 0, 2024-09-19T06:25:24.881 INFO:teuthology.orchestra.run.smithi089.stdout: "take_sum": 0, 2024-09-19T06:25:24.881 INFO:teuthology.orchestra.run.smithi089.stdout: "put": 0, 2024-09-19T06:25:24.881 INFO:teuthology.orchestra.run.smithi089.stdout: "put_sum": 0, 2024-09-19T06:25:24.881 INFO:teuthology.orchestra.run.smithi089.stdout: "wait": { 2024-09-19T06:25:24.881 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:24.881 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:24.881 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:24.881 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-19T06:25:24.881 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:24.881 INFO:teuthology.orchestra.run.smithi089.stdout: "throttle-write_buf_throttle-0x562d35828500": { 2024-09-19T06:25:24.881 INFO:teuthology.orchestra.run.smithi089.stdout: "val": 0, 2024-09-19T06:25:24.881 INFO:teuthology.orchestra.run.smithi089.stdout: "max": 3758096384, 2024-09-19T06:25:24.881 INFO:teuthology.orchestra.run.smithi089.stdout: "get_started": 0, 2024-09-19T06:25:24.882 INFO:teuthology.orchestra.run.smithi089.stdout: "get": 3, 2024-09-19T06:25:24.882 INFO:teuthology.orchestra.run.smithi089.stdout: "get_sum": 1083, 2024-09-19T06:25:24.882 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:24.882 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_success": 3, 2024-09-19T06:25:24.882 INFO:teuthology.orchestra.run.smithi089.stdout: "take": 0, 2024-09-19T06:25:24.882 INFO:teuthology.orchestra.run.smithi089.stdout: "take_sum": 0, 2024-09-19T06:25:24.882 INFO:teuthology.orchestra.run.smithi089.stdout: "put": 2, 2024-09-19T06:25:24.882 INFO:teuthology.orchestra.run.smithi089.stdout: "put_sum": 1083, 2024-09-19T06:25:24.882 INFO:teuthology.orchestra.run.smithi089.stdout: "wait": { 2024-09-19T06:25:24.882 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:24.882 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:24.882 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:24.882 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-19T06:25:24.883 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-19T06:25:24.883 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-19T06:25:25.503 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-19T06:25:25.503 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-19T06:25:25.503 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-09-19T06:25:25.503 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=9 2024-09-19T06:25:25.503 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2024-09-19T06:25:25.504 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-09-19T06:25:25.504 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T06:25:25.504 DEBUG:tasks.check_counter:Getting stats from k 2024-09-19T06:25:25.504 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-19T06:25:25.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:25 smithi002 ceph-mon[30982]: pgmap v331: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-09-19T06:25:25.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:25 smithi090 ceph-mon[34497]: pgmap v331: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-09-19T06:25:25.748 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:25:25.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:25 smithi089 ceph-mon[34160]: pgmap v331: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 92 B/s wr, 8 op/s 2024-09-19T06:25:26.244 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-19T06:25:26.244 INFO:teuthology.orchestra.run.smithi089.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:25:26.244 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_messages": 0, 2024-09-19T06:25:26.245 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages": 2, 2024-09-19T06:25:26.245 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_bytes": 0, 2024-09-19T06:25:26.245 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_bytes": 0, 2024-09-19T06:25:26.245 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_created_connections": 4, 2024-09-19T06:25:26.245 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_active_connections": 0, 2024-09-19T06:25:26.245 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_total_time": 0.001018375, 2024-09-19T06:25:26.245 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T06:25:26.245 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_recv_time": 0.000254567, 2024-09-19T06:25:26.245 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:25:26.245 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:25:26.245 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:26.246 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:26.246 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:26.246 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:26.246 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:25:26.246 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:26.246 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:26.246 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:26.246 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:26.246 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T06:25:26.246 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T06:25:26.246 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:26.246 INFO:teuthology.orchestra.run.smithi089.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:25:26.247 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_messages": 224, 2024-09-19T06:25:26.247 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages": 212, 2024-09-19T06:25:26.247 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_bytes": 1450992, 2024-09-19T06:25:26.247 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_bytes": 129632, 2024-09-19T06:25:26.247 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_created_connections": 2, 2024-09-19T06:25:26.247 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_active_connections": 1, 2024-09-19T06:25:26.247 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_total_time": 0.043934696, 2024-09-19T06:25:26.247 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_send_time": 0.015749200, 2024-09-19T06:25:26.247 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_recv_time": 0.041144645, 2024-09-19T06:25:26.247 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:25:26.247 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:25:26.247 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 212, 2024-09-19T06:25:26.247 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.016804525, 2024-09-19T06:25:26.248 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000079266 2024-09-19T06:25:26.248 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:26.248 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:25:26.248 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:26.248 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:26.248 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:26.248 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:26.248 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_encrypted_bytes": 1450992, 2024-09-19T06:25:26.248 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_encrypted_bytes": 129632 2024-09-19T06:25:26.248 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:26.248 INFO:teuthology.orchestra.run.smithi089.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:25:26.248 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_messages": 2, 2024-09-19T06:25:26.248 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages": 161, 2024-09-19T06:25:26.249 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_bytes": 320, 2024-09-19T06:25:26.249 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_bytes": 185568, 2024-09-19T06:25:26.249 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_created_connections": 5, 2024-09-19T06:25:26.249 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_active_connections": 3, 2024-09-19T06:25:26.249 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_total_time": 0.011596567, 2024-09-19T06:25:26.249 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_send_time": 0.007604428, 2024-09-19T06:25:26.249 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_recv_time": 0.001774815, 2024-09-19T06:25:26.249 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:25:26.249 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:25:26.249 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 158, 2024-09-19T06:25:26.249 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.022766606, 2024-09-19T06:25:26.249 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000144092 2024-09-19T06:25:26.250 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:26.250 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:25:26.250 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:26.250 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:26.250 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:26.250 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:26.250 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T06:25:26.250 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_encrypted_bytes": 185568 2024-09-19T06:25:26.250 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:26.250 INFO:teuthology.orchestra.run.smithi089.stdout: "cct": { 2024-09-19T06:25:26.250 INFO:teuthology.orchestra.run.smithi089.stdout: "total_workers": 0, 2024-09-19T06:25:26.250 INFO:teuthology.orchestra.run.smithi089.stdout: "unhealthy_workers": 0 2024-09-19T06:25:26.250 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:26.251 INFO:teuthology.orchestra.run.smithi089.stdout: "mempool": { 2024-09-19T06:25:26.251 INFO:teuthology.orchestra.run.smithi089.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:25:26.251 INFO:teuthology.orchestra.run.smithi089.stdout: "bloom_filter_items": 0, 2024-09-19T06:25:26.251 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:25:26.251 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:25:26.251 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:25:26.251 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:25:26.251 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:25:26.251 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:25:26.251 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:25:26.251 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:25:26.251 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:25:26.251 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:25:26.252 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:25:26.252 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:25:26.252 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:25:26.252 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_extent_items": 0, 2024-09-19T06:25:26.252 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:25:26.252 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_blob_items": 0, 2024-09-19T06:25:26.252 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:25:26.252 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:25:26.252 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:25:26.252 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:25:26.252 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:25:26.252 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:25:26.252 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:25:26.253 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_txc_items": 0, 2024-09-19T06:25:26.253 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:25:26.253 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:25:26.253 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:25:26.253 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_writing_items": 0, 2024-09-19T06:25:26.253 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_bytes": 0, 2024-09-19T06:25:26.253 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_items": 0, 2024-09-19T06:25:26.253 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:25:26.253 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:25:26.253 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:25:26.253 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:25:26.253 INFO:teuthology.orchestra.run.smithi089.stdout: "buffer_anon_bytes": 149017, 2024-09-19T06:25:26.253 INFO:teuthology.orchestra.run.smithi089.stdout: "buffer_anon_items": 31, 2024-09-19T06:25:26.254 INFO:teuthology.orchestra.run.smithi089.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:25:26.254 INFO:teuthology.orchestra.run.smithi089.stdout: "buffer_meta_items": 0, 2024-09-19T06:25:26.254 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_bytes": 0, 2024-09-19T06:25:26.254 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_items": 0, 2024-09-19T06:25:26.254 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:25:26.254 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mapbl_items": 0, 2024-09-19T06:25:26.254 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:25:26.254 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pglog_items": 0, 2024-09-19T06:25:26.254 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_bytes": 0, 2024-09-19T06:25:26.254 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_items": 0, 2024-09-19T06:25:26.254 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:25:26.254 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:25:26.254 INFO:teuthology.orchestra.run.smithi089.stdout: "pgmap_bytes": 0, 2024-09-19T06:25:26.254 INFO:teuthology.orchestra.run.smithi089.stdout: "pgmap_items": 0, 2024-09-19T06:25:26.255 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_co_bytes": 928, 2024-09-19T06:25:26.255 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_co_items": 2, 2024-09-19T06:25:26.255 INFO:teuthology.orchestra.run.smithi089.stdout: "unittest_1_bytes": 0, 2024-09-19T06:25:26.255 INFO:teuthology.orchestra.run.smithi089.stdout: "unittest_1_items": 0, 2024-09-19T06:25:26.255 INFO:teuthology.orchestra.run.smithi089.stdout: "unittest_2_bytes": 0, 2024-09-19T06:25:26.255 INFO:teuthology.orchestra.run.smithi089.stdout: "unittest_2_items": 0 2024-09-19T06:25:26.255 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-19T06:25:26.255 INFO:teuthology.orchestra.run.smithi089.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:25:26.255 INFO:teuthology.orchestra.run.smithi089.stdout: "val": 0, 2024-09-19T06:25:26.255 INFO:teuthology.orchestra.run.smithi089.stdout: "max": 104857600, 2024-09-19T06:25:26.255 INFO:teuthology.orchestra.run.smithi089.stdout: "get_started": 0, 2024-09-19T06:25:26.255 INFO:teuthology.orchestra.run.smithi089.stdout: "get": 222, 2024-09-19T06:25:26.255 INFO:teuthology.orchestra.run.smithi089.stdout: "get_sum": 1416910, 2024-09-19T06:25:26.255 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:26.256 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_success": 222, 2024-09-19T06:25:26.256 INFO:teuthology.orchestra.run.smithi089.stdout: "take": 0, 2024-09-19T06:25:26.256 INFO:teuthology.orchestra.run.smithi089.stdout: "take_sum": 0, 2024-09-19T06:25:26.256 INFO:teuthology.orchestra.run.smithi089.stdout: "put": 222, 2024-09-19T06:25:26.256 INFO:teuthology.orchestra.run.smithi089.stdout: "put_sum": 1416910, 2024-09-19T06:25:26.256 INFO:teuthology.orchestra.run.smithi089.stdout: "wait": { 2024-09-19T06:25:26.256 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-19T06:25:26.256 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-19T06:25:26.256 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-19T06:25:26.256 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-19T06:25:26.256 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-19T06:25:26.256 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-19T06:25:26.967 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-19T06:25:26.967 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-19T06:25:26.968 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-09-19T06:25:26.968 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-09-19T06:25:26.968 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-09-19T06:25:26.968 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-09-19T06:25:26.968 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-09-19T06:25:26.968 DEBUG:tasks.check_counter:Getting stats from c 2024-09-19T06:25:26.968 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-19T06:25:27.228 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:25:27.600 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:27 smithi090 ceph-mon[34497]: pgmap v332: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:25:27.707 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-19T06:25:27.707 INFO:teuthology.orchestra.run.smithi090.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:25:27.707 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_messages": 236, 2024-09-19T06:25:27.707 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages": 225, 2024-09-19T06:25:27.707 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_bytes": 1472428, 2024-09-19T06:25:27.707 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_bytes": 130510, 2024-09-19T06:25:27.707 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_created_connections": 5, 2024-09-19T06:25:27.708 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_active_connections": 1, 2024-09-19T06:25:27.708 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_total_time": 0.041184538, 2024-09-19T06:25:27.708 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_send_time": 0.015121676, 2024-09-19T06:25:27.708 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_recv_time": 0.038310516, 2024-09-19T06:25:27.708 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_fast_dispatch_time": 0.000049548, 2024-09-19T06:25:27.708 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:25:27.708 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 224, 2024-09-19T06:25:27.708 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.014610437, 2024-09-19T06:25:27.708 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000065225 2024-09-19T06:25:27.708 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.708 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:25:27.708 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:27.709 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:27.709 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:27.709 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.709 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_encrypted_bytes": 1472160, 2024-09-19T06:25:27.709 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_encrypted_bytes": 130192 2024-09-19T06:25:27.709 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.709 INFO:teuthology.orchestra.run.smithi090.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:25:27.709 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_messages": 1557, 2024-09-19T06:25:27.709 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages": 1711, 2024-09-19T06:25:27.709 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_bytes": 1152999, 2024-09-19T06:25:27.709 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_bytes": 931647, 2024-09-19T06:25:27.709 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_created_connections": 7, 2024-09-19T06:25:27.709 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_active_connections": 5, 2024-09-19T06:25:27.709 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_total_time": 0.153445387, 2024-09-19T06:25:27.710 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_send_time": 0.051292113, 2024-09-19T06:25:27.710 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_recv_time": 0.041914397, 2024-09-19T06:25:27.710 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_fast_dispatch_time": 0.045291745, 2024-09-19T06:25:27.710 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:25:27.710 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 1709, 2024-09-19T06:25:27.710 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.078585310, 2024-09-19T06:25:27.710 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000045983 2024-09-19T06:25:27.710 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.710 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:25:27.710 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:27.710 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:27.710 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:27.710 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.711 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_encrypted_bytes": 3360, 2024-09-19T06:25:27.711 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_encrypted_bytes": 438368 2024-09-19T06:25:27.711 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.711 INFO:teuthology.orchestra.run.smithi090.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:25:27.711 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_messages": 729, 2024-09-19T06:25:27.711 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages": 731, 2024-09-19T06:25:27.711 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_bytes": 180026, 2024-09-19T06:25:27.711 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_bytes": 231838, 2024-09-19T06:25:27.711 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_created_connections": 5, 2024-09-19T06:25:27.711 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_active_connections": 4, 2024-09-19T06:25:27.711 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_total_time": 0.071845784, 2024-09-19T06:25:27.711 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_send_time": 0.026278906, 2024-09-19T06:25:27.711 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_recv_time": 0.015883471, 2024-09-19T06:25:27.712 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_fast_dispatch_time": 0.022736081, 2024-09-19T06:25:27.712 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:25:27.712 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 729, 2024-09-19T06:25:27.712 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.034412439, 2024-09-19T06:25:27.712 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000047204 2024-09-19T06:25:27.712 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.712 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:25:27.712 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:27.713 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:27.713 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:27.713 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.713 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T06:25:27.713 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T06:25:27.713 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.714 INFO:teuthology.orchestra.run.smithi090.stdout: "cct": { 2024-09-19T06:25:27.714 INFO:teuthology.orchestra.run.smithi090.stdout: "total_workers": 1, 2024-09-19T06:25:27.714 INFO:teuthology.orchestra.run.smithi090.stdout: "unhealthy_workers": 0 2024-09-19T06:25:27.714 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.714 INFO:teuthology.orchestra.run.smithi090.stdout: "finisher-MDSRank": { 2024-09-19T06:25:27.714 INFO:teuthology.orchestra.run.smithi090.stdout: "queue_len": 0, 2024-09-19T06:25:27.715 INFO:teuthology.orchestra.run.smithi090.stdout: "complete_latency": { 2024-09-19T06:25:27.715 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 3751, 2024-09-19T06:25:27.715 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.103640895, 2024-09-19T06:25:27.715 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000027630 2024-09-19T06:25:27.715 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-19T06:25:27.715 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.716 INFO:teuthology.orchestra.run.smithi090.stdout: "finisher-PurgeQueue": { 2024-09-19T06:25:27.716 INFO:teuthology.orchestra.run.smithi090.stdout: "queue_len": 0, 2024-09-19T06:25:27.716 INFO:teuthology.orchestra.run.smithi090.stdout: "complete_latency": { 2024-09-19T06:25:27.716 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:27.716 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:27.716 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:27.717 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-19T06:25:27.717 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.717 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": { 2024-09-19T06:25:27.717 INFO:teuthology.orchestra.run.smithi090.stdout: "request": 0, 2024-09-19T06:25:27.717 INFO:teuthology.orchestra.run.smithi090.stdout: "reply": 0, 2024-09-19T06:25:27.717 INFO:teuthology.orchestra.run.smithi090.stdout: "reply_latency": { 2024-09-19T06:25:27.718 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:27.718 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:27.718 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:27.718 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.719 INFO:teuthology.orchestra.run.smithi090.stdout: "slow_reply": 0, 2024-09-19T06:25:27.719 INFO:teuthology.orchestra.run.smithi090.stdout: "forward": 0, 2024-09-19T06:25:27.719 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_fetch_complete": 0, 2024-09-19T06:25:27.719 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_fetch_keys": 0, 2024-09-19T06:25:27.719 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_commit": 0, 2024-09-19T06:25:27.719 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_split": 0, 2024-09-19T06:25:27.720 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_merge": 0, 2024-09-19T06:25:27.720 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes": 28, 2024-09-19T06:25:27.720 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_top": 9, 2024-09-19T06:25:27.720 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_bottom": 19, 2024-09-19T06:25:27.720 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_pin_tail": 0, 2024-09-19T06:25:27.721 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_pinned": 16, 2024-09-19T06:25:27.721 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_expired": 0, 2024-09-19T06:25:27.721 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_with_caps": 0, 2024-09-19T06:25:27.721 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": 0, 2024-09-19T06:25:27.721 INFO:teuthology.orchestra.run.smithi090.stdout: "subtrees": 2, 2024-09-19T06:25:27.721 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse": 0, 2024-09-19T06:25:27.722 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_hit": 0, 2024-09-19T06:25:27.722 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_forward": 0, 2024-09-19T06:25:27.722 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_discover": 0, 2024-09-19T06:25:27.722 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_dir_fetch": 0, 2024-09-19T06:25:27.722 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_remote_ino": 0, 2024-09-19T06:25:27.722 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_lock": 0, 2024-09-19T06:25:27.723 INFO:teuthology.orchestra.run.smithi090.stdout: "load_cent": 0, 2024-09-19T06:25:27.723 INFO:teuthology.orchestra.run.smithi090.stdout: "q": 0, 2024-09-19T06:25:27.723 INFO:teuthology.orchestra.run.smithi090.stdout: "exported": 0, 2024-09-19T06:25:27.723 INFO:teuthology.orchestra.run.smithi090.stdout: "exported_inodes": 0, 2024-09-19T06:25:27.723 INFO:teuthology.orchestra.run.smithi090.stdout: "imported": 0, 2024-09-19T06:25:27.724 INFO:teuthology.orchestra.run.smithi090.stdout: "imported_inodes": 0, 2024-09-19T06:25:27.724 INFO:teuthology.orchestra.run.smithi090.stdout: "openino_dir_fetch": 0, 2024-09-19T06:25:27.724 INFO:teuthology.orchestra.run.smithi090.stdout: "openino_backtrace_fetch": 0, 2024-09-19T06:25:27.724 INFO:teuthology.orchestra.run.smithi090.stdout: "openino_peer_discover": 0, 2024-09-19T06:25:27.724 INFO:teuthology.orchestra.run.smithi090.stdout: "root_rfiles": 4, 2024-09-19T06:25:27.724 INFO:teuthology.orchestra.run.smithi090.stdout: "root_rbytes": 234, 2024-09-19T06:25:27.725 INFO:teuthology.orchestra.run.smithi090.stdout: "root_rsnaps": 6, 2024-09-19T06:25:27.725 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T06:25:27.725 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_set_tag": 0, 2024-09-19T06:25:27.725 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T06:25:27.725 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_inotable_repaired": 0, 2024-09-19T06:25:27.726 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_dir_inodes": 0, 2024-09-19T06:25:27.726 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T06:25:27.726 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T06:25:27.726 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_file_inodes": 0, 2024-09-19T06:25:27.726 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_inode_file_caps": 0, 2024-09-19T06:25:27.726 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T06:25:27.726 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_cap_op_grant": 0, 2024-09-19T06:25:27.727 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T06:25:27.727 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T06:25:27.727 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T06:25:27.727 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_client_caps": 0, 2024-09-19T06:25:27.727 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_client_caps_dirty": 0, 2024-09-19T06:25:27.728 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_client_cap_release": 0, 2024-09-19T06:25:27.728 INFO:teuthology.orchestra.run.smithi090.stdout: "process_request_cap_release": 0 2024-09-19T06:25:27.728 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.728 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_cache": { 2024-09-19T06:25:27.728 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_update": 0, 2024-09-19T06:25:27.728 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_update_receipt": 0, 2024-09-19T06:25:27.729 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_try_discover": 0, 2024-09-19T06:25:27.729 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_send_discover": 0, 2024-09-19T06:25:27.729 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_handle_discover": 0, 2024-09-19T06:25:27.729 INFO:teuthology.orchestra.run.smithi090.stdout: "num_strays": 0, 2024-09-19T06:25:27.729 INFO:teuthology.orchestra.run.smithi090.stdout: "num_strays_delayed": 0, 2024-09-19T06:25:27.730 INFO:teuthology.orchestra.run.smithi090.stdout: "num_strays_enqueuing": 0, 2024-09-19T06:25:27.730 INFO:teuthology.orchestra.run.smithi090.stdout: "strays_created": 0, 2024-09-19T06:25:27.730 INFO:teuthology.orchestra.run.smithi090.stdout: "strays_enqueued": 0, 2024-09-19T06:25:27.730 INFO:teuthology.orchestra.run.smithi090.stdout: "strays_reintegrated": 0, 2024-09-19T06:25:27.730 INFO:teuthology.orchestra.run.smithi090.stdout: "strays_migrated": 0, 2024-09-19T06:25:27.731 INFO:teuthology.orchestra.run.smithi090.stdout: "num_recovering_processing": 0, 2024-09-19T06:25:27.731 INFO:teuthology.orchestra.run.smithi090.stdout: "num_recovering_enqueued": 0, 2024-09-19T06:25:27.731 INFO:teuthology.orchestra.run.smithi090.stdout: "num_recovering_prioritized": 0, 2024-09-19T06:25:27.731 INFO:teuthology.orchestra.run.smithi090.stdout: "recovery_started": 0, 2024-09-19T06:25:27.732 INFO:teuthology.orchestra.run.smithi090.stdout: "recovery_completed": 0, 2024-09-19T06:25:27.732 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_quiesce_path": 0, 2024-09-19T06:25:27.732 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_quiesce_inode": 0, 2024-09-19T06:25:27.732 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T06:25:27.732 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_exportdir": 0, 2024-09-19T06:25:27.732 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_flush": 0, 2024-09-19T06:25:27.733 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_fragmentdir": 0, 2024-09-19T06:25:27.733 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_fragstats": 0, 2024-09-19T06:25:27.733 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_inodestats": 0 2024-09-19T06:25:27.733 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.733 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_log": { 2024-09-19T06:25:27.733 INFO:teuthology.orchestra.run.smithi090.stdout: "evlrg": 0, 2024-09-19T06:25:27.734 INFO:teuthology.orchestra.run.smithi090.stdout: "evadd": 0, 2024-09-19T06:25:27.734 INFO:teuthology.orchestra.run.smithi090.stdout: "evex": 0, 2024-09-19T06:25:27.734 INFO:teuthology.orchestra.run.smithi090.stdout: "evtrm": 0, 2024-09-19T06:25:27.734 INFO:teuthology.orchestra.run.smithi090.stdout: "ev": 215, 2024-09-19T06:25:27.734 INFO:teuthology.orchestra.run.smithi090.stdout: "evexg": 0, 2024-09-19T06:25:27.735 INFO:teuthology.orchestra.run.smithi090.stdout: "evexd": 0, 2024-09-19T06:25:27.735 INFO:teuthology.orchestra.run.smithi090.stdout: "segadd": 0, 2024-09-19T06:25:27.735 INFO:teuthology.orchestra.run.smithi090.stdout: "segex": 0, 2024-09-19T06:25:27.735 INFO:teuthology.orchestra.run.smithi090.stdout: "segtrm": 0, 2024-09-19T06:25:27.735 INFO:teuthology.orchestra.run.smithi090.stdout: "seg": 2, 2024-09-19T06:25:27.735 INFO:teuthology.orchestra.run.smithi090.stdout: "segmjr": 14, 2024-09-19T06:25:27.736 INFO:teuthology.orchestra.run.smithi090.stdout: "segexg": 0, 2024-09-19T06:25:27.736 INFO:teuthology.orchestra.run.smithi090.stdout: "segexd": 0, 2024-09-19T06:25:27.736 INFO:teuthology.orchestra.run.smithi090.stdout: "expos": 4793665, 2024-09-19T06:25:27.736 INFO:teuthology.orchestra.run.smithi090.stdout: "wrpos": 4884473, 2024-09-19T06:25:27.737 INFO:teuthology.orchestra.run.smithi090.stdout: "rdpos": 4884361, 2024-09-19T06:25:27.737 INFO:teuthology.orchestra.run.smithi090.stdout: "jlat": { 2024-09-19T06:25:27.737 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:27.737 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:27.737 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:27.737 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.738 INFO:teuthology.orchestra.run.smithi090.stdout: "replayed": 215 2024-09-19T06:25:27.738 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.738 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_mem": { 2024-09-19T06:25:27.738 INFO:teuthology.orchestra.run.smithi090.stdout: "ino": 19, 2024-09-19T06:25:27.738 INFO:teuthology.orchestra.run.smithi090.stdout: "ino+": 22, 2024-09-19T06:25:27.739 INFO:teuthology.orchestra.run.smithi090.stdout: "ino-": 3, 2024-09-19T06:25:27.739 INFO:teuthology.orchestra.run.smithi090.stdout: "dir": 13, 2024-09-19T06:25:27.739 INFO:teuthology.orchestra.run.smithi090.stdout: "dir+": 13, 2024-09-19T06:25:27.739 INFO:teuthology.orchestra.run.smithi090.stdout: "dir-": 0, 2024-09-19T06:25:27.739 INFO:teuthology.orchestra.run.smithi090.stdout: "dn": 28, 2024-09-19T06:25:27.739 INFO:teuthology.orchestra.run.smithi090.stdout: "dn+": 28, 2024-09-19T06:25:27.740 INFO:teuthology.orchestra.run.smithi090.stdout: "dn-": 0, 2024-09-19T06:25:27.740 INFO:teuthology.orchestra.run.smithi090.stdout: "cap": 0, 2024-09-19T06:25:27.740 INFO:teuthology.orchestra.run.smithi090.stdout: "cap+": 0, 2024-09-19T06:25:27.740 INFO:teuthology.orchestra.run.smithi090.stdout: "cap-": 0, 2024-09-19T06:25:27.740 INFO:teuthology.orchestra.run.smithi090.stdout: "rss": 51652, 2024-09-19T06:25:27.740 INFO:teuthology.orchestra.run.smithi090.stdout: "heap": 215328 2024-09-19T06:25:27.741 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.741 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_server": { 2024-09-19T06:25:27.741 INFO:teuthology.orchestra.run.smithi090.stdout: "dispatch_client_request": 0, 2024-09-19T06:25:27.741 INFO:teuthology.orchestra.run.smithi090.stdout: "dispatch_server_request": 0, 2024-09-19T06:25:27.741 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_client_request": 0, 2024-09-19T06:25:27.742 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_client_session": 0, 2024-09-19T06:25:27.742 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_peer_request": 0, 2024-09-19T06:25:27.742 INFO:teuthology.orchestra.run.smithi090.stdout: "req_create_latency": { 2024-09-19T06:25:27.742 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:27.742 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:27.742 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:27.742 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.742 INFO:teuthology.orchestra.run.smithi090.stdout: "req_getattr_latency": { 2024-09-19T06:25:27.742 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:27.742 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:27.743 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:27.743 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.743 INFO:teuthology.orchestra.run.smithi090.stdout: "req_getfilelock_latency": { 2024-09-19T06:25:27.743 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:27.743 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:27.743 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:27.743 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.743 INFO:teuthology.orchestra.run.smithi090.stdout: "req_link_latency": { 2024-09-19T06:25:27.743 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:27.743 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:27.743 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:27.744 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.744 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookup_latency": { 2024-09-19T06:25:27.744 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:27.744 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:27.744 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:27.744 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.744 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookuphash_latency": { 2024-09-19T06:25:27.744 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:27.744 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:27.744 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:27.744 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.744 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookupino_latency": { 2024-09-19T06:25:27.745 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:27.745 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:27.745 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:27.745 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.745 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookupname_latency": { 2024-09-19T06:25:27.745 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:27.745 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:27.745 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:27.745 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.745 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookupparent_latency": { 2024-09-19T06:25:27.745 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:27.745 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:27.746 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:27.746 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.746 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookupsnap_latency": { 2024-09-19T06:25:27.746 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:27.746 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:27.746 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:27.746 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.746 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lssnap_latency": { 2024-09-19T06:25:27.746 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:27.746 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:27.746 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:27.746 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.746 INFO:teuthology.orchestra.run.smithi090.stdout: "req_mkdir_latency": { 2024-09-19T06:25:27.747 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:27.747 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:27 smithi002 ceph-mon[30982]: pgmap v332: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:25:27.748 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:27.748 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:27.748 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.748 INFO:teuthology.orchestra.run.smithi090.stdout: "req_mknod_latency": { 2024-09-19T06:25:27.748 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:27.748 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:27.748 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:27.748 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.748 INFO:teuthology.orchestra.run.smithi090.stdout: "req_mksnap_latency": { 2024-09-19T06:25:27.748 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:27.748 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:27.748 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:27.749 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.749 INFO:teuthology.orchestra.run.smithi090.stdout: "req_open_latency": { 2024-09-19T06:25:27.749 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:27.749 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:27.749 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:27.749 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.749 INFO:teuthology.orchestra.run.smithi090.stdout: "req_readdir_latency": { 2024-09-19T06:25:27.749 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:27.749 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:27.750 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:27.750 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.750 INFO:teuthology.orchestra.run.smithi090.stdout: "req_rename_latency": { 2024-09-19T06:25:27.750 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:27.750 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:27.750 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:27.750 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.750 INFO:teuthology.orchestra.run.smithi090.stdout: "req_renamesnap_latency": { 2024-09-19T06:25:27.750 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:27.750 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:27.750 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:27.750 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.750 INFO:teuthology.orchestra.run.smithi090.stdout: "req_snapdiff_latency": { 2024-09-19T06:25:27.751 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:27.751 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:27.751 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:27.751 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.751 INFO:teuthology.orchestra.run.smithi090.stdout: "req_rmdir_latency": { 2024-09-19T06:25:27.751 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:27.751 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:27.751 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:27.751 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.751 INFO:teuthology.orchestra.run.smithi090.stdout: "req_rmsnap_latency": { 2024-09-19T06:25:27.751 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:27.752 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:27.752 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:27.752 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.752 INFO:teuthology.orchestra.run.smithi090.stdout: "req_rmxattr_latency": { 2024-09-19T06:25:27.752 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:27.752 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:27.752 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:27.752 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.753 INFO:teuthology.orchestra.run.smithi090.stdout: "req_setattr_latency": { 2024-09-19T06:25:27.753 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:27.753 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:27.753 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:27.753 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.753 INFO:teuthology.orchestra.run.smithi090.stdout: "req_setdirlayout_latency": { 2024-09-19T06:25:27.753 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:27.753 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:27.753 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:27.753 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.753 INFO:teuthology.orchestra.run.smithi090.stdout: "req_setfilelock_latency": { 2024-09-19T06:25:27.754 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:27.754 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:27.754 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:27.754 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.754 INFO:teuthology.orchestra.run.smithi090.stdout: "req_setlayout_latency": { 2024-09-19T06:25:27.754 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:27.754 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:27.754 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:27.754 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.754 INFO:teuthology.orchestra.run.smithi090.stdout: "req_setxattr_latency": { 2024-09-19T06:25:27.754 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:27.754 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:27.754 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:27.755 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.755 INFO:teuthology.orchestra.run.smithi090.stdout: "req_symlink_latency": { 2024-09-19T06:25:27.755 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:27.755 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:27.755 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:27.755 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.755 INFO:teuthology.orchestra.run.smithi090.stdout: "req_unlink_latency": { 2024-09-19T06:25:27.755 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:27.755 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:27.755 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:27.755 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.755 INFO:teuthology.orchestra.run.smithi090.stdout: "cap_revoke_eviction": 0, 2024-09-19T06:25:27.756 INFO:teuthology.orchestra.run.smithi090.stdout: "cap_acquisition_throttle": 0, 2024-09-19T06:25:27.756 INFO:teuthology.orchestra.run.smithi090.stdout: "req_getvxattr_latency": { 2024-09-19T06:25:27.756 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:27.756 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:27.756 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:27.756 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-19T06:25:27.756 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.756 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_sessions": { 2024-09-19T06:25:27.756 INFO:teuthology.orchestra.run.smithi090.stdout: "session_count": 2, 2024-09-19T06:25:27.756 INFO:teuthology.orchestra.run.smithi090.stdout: "session_add": 6, 2024-09-19T06:25:27.756 INFO:teuthology.orchestra.run.smithi090.stdout: "session_remove": 4, 2024-09-19T06:25:27.756 INFO:teuthology.orchestra.run.smithi090.stdout: "sessions_open": 5, 2024-09-19T06:25:27.757 INFO:teuthology.orchestra.run.smithi090.stdout: "sessions_stale": 0, 2024-09-19T06:25:27.757 INFO:teuthology.orchestra.run.smithi090.stdout: "total_load": 0, 2024-09-19T06:25:27.757 INFO:teuthology.orchestra.run.smithi090.stdout: "average_load": 0, 2024-09-19T06:25:27.757 INFO:teuthology.orchestra.run.smithi090.stdout: "avg_session_uptime": 3114, 2024-09-19T06:25:27.757 INFO:teuthology.orchestra.run.smithi090.stdout: "mdthresh_evicted": 0 2024-09-19T06:25:27.757 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.757 INFO:teuthology.orchestra.run.smithi090.stdout: "mempool": { 2024-09-19T06:25:27.757 INFO:teuthology.orchestra.run.smithi090.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:25:27.757 INFO:teuthology.orchestra.run.smithi090.stdout: "bloom_filter_items": 0, 2024-09-19T06:25:27.757 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:25:27.757 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:25:27.757 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:25:27.757 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:25:27.758 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:25:27.758 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:25:27.758 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:25:27.758 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:25:27.758 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:25:27.758 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:25:27.758 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:25:27.758 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:25:27.758 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:25:27.758 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_extent_items": 0, 2024-09-19T06:25:27.758 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:25:27.758 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_blob_items": 0, 2024-09-19T06:25:27.758 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:25:27.759 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:25:27.759 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:25:27.759 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:25:27.759 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:25:27.759 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:25:27.759 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:25:27.759 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_txc_items": 0, 2024-09-19T06:25:27.759 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:25:27.759 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:25:27.759 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:25:27.759 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_items": 0, 2024-09-19T06:25:27.759 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_bytes": 0, 2024-09-19T06:25:27.759 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_items": 0, 2024-09-19T06:25:27.760 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:25:27.760 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:25:27.760 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:25:27.760 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:25:27.760 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_anon_bytes": 197473, 2024-09-19T06:25:27.760 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_anon_items": 55, 2024-09-19T06:25:27.760 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:25:27.760 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_meta_items": 0, 2024-09-19T06:25:27.760 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_bytes": 0, 2024-09-19T06:25:27.760 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_items": 0, 2024-09-19T06:25:27.760 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:25:27.760 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_mapbl_items": 0, 2024-09-19T06:25:27.760 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:25:27.761 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_pglog_items": 0, 2024-09-19T06:25:27.761 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_bytes": 8136, 2024-09-19T06:25:27.761 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_items": 180, 2024-09-19T06:25:27.761 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:25:27.761 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:25:27.761 INFO:teuthology.orchestra.run.smithi090.stdout: "pgmap_bytes": 0, 2024-09-19T06:25:27.761 INFO:teuthology.orchestra.run.smithi090.stdout: "pgmap_items": 0, 2024-09-19T06:25:27.761 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_co_bytes": 93756, 2024-09-19T06:25:27.761 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_co_items": 504, 2024-09-19T06:25:27.761 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_1_bytes": 0, 2024-09-19T06:25:27.761 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_1_items": 0, 2024-09-19T06:25:27.761 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_2_bytes": 0, 2024-09-19T06:25:27.762 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_2_items": 0 2024-09-19T06:25:27.762 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.762 INFO:teuthology.orchestra.run.smithi090.stdout: "objecter": { 2024-09-19T06:25:27.762 INFO:teuthology.orchestra.run.smithi090.stdout: "op_active": 0, 2024-09-19T06:25:27.762 INFO:teuthology.orchestra.run.smithi090.stdout: "op_laggy": 0, 2024-09-19T06:25:27.762 INFO:teuthology.orchestra.run.smithi090.stdout: "op_send": 2281, 2024-09-19T06:25:27.762 INFO:teuthology.orchestra.run.smithi090.stdout: "op_send_bytes": 26, 2024-09-19T06:25:27.762 INFO:teuthology.orchestra.run.smithi090.stdout: "op_resend": 4, 2024-09-19T06:25:27.762 INFO:teuthology.orchestra.run.smithi090.stdout: "op_reply": 2281, 2024-09-19T06:25:27.762 INFO:teuthology.orchestra.run.smithi090.stdout: "op_latency": { 2024-09-19T06:25:27.762 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 2281, 2024-09-19T06:25:27.762 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 1.253979401, 2024-09-19T06:25:27.762 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000549749 2024-09-19T06:25:27.763 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.763 INFO:teuthology.orchestra.run.smithi090.stdout: "op_inflight": 0, 2024-09-19T06:25:27.763 INFO:teuthology.orchestra.run.smithi090.stdout: "oplen_avg": { 2024-09-19T06:25:27.763 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 2281, 2024-09-19T06:25:27.763 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 2282 2024-09-19T06:25:27.763 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.763 INFO:teuthology.orchestra.run.smithi090.stdout: "op": 2281, 2024-09-19T06:25:27.763 INFO:teuthology.orchestra.run.smithi090.stdout: "op_r": 2281, 2024-09-19T06:25:27.763 INFO:teuthology.orchestra.run.smithi090.stdout: "op_w": 0, 2024-09-19T06:25:27.763 INFO:teuthology.orchestra.run.smithi090.stdout: "op_rmw": 0, 2024-09-19T06:25:27.763 INFO:teuthology.orchestra.run.smithi090.stdout: "op_pg": 0, 2024-09-19T06:25:27.764 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_stat": 1453, 2024-09-19T06:25:27.764 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_create": 0, 2024-09-19T06:25:27.764 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_read": 825, 2024-09-19T06:25:27.764 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_write": 0, 2024-09-19T06:25:27.764 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_writefull": 0, 2024-09-19T06:25:27.764 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_writesame": 0, 2024-09-19T06:25:27.764 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_append": 0, 2024-09-19T06:25:27.764 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_zero": 0, 2024-09-19T06:25:27.764 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_truncate": 0, 2024-09-19T06:25:27.764 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_delete": 0, 2024-09-19T06:25:27.764 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_mapext": 0, 2024-09-19T06:25:27.764 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_sparse_read": 0, 2024-09-19T06:25:27.765 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_clonerange": 0, 2024-09-19T06:25:27.765 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_getxattr": 2, 2024-09-19T06:25:27.765 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_setxattr": 0, 2024-09-19T06:25:27.765 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_cmpxattr": 0, 2024-09-19T06:25:27.765 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_rmxattr": 0, 2024-09-19T06:25:27.765 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_resetxattrs": 0, 2024-09-19T06:25:27.765 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_call": 0, 2024-09-19T06:25:27.765 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_watch": 0, 2024-09-19T06:25:27.765 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_notify": 0, 2024-09-19T06:25:27.765 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T06:25:27.765 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_pgls": 0, 2024-09-19T06:25:27.765 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_pgls_filter": 0, 2024-09-19T06:25:27.765 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_other": 0, 2024-09-19T06:25:27.766 INFO:teuthology.orchestra.run.smithi090.stdout: "linger_active": 0, 2024-09-19T06:25:27.766 INFO:teuthology.orchestra.run.smithi090.stdout: "linger_send": 0, 2024-09-19T06:25:27.766 INFO:teuthology.orchestra.run.smithi090.stdout: "linger_resend": 0, 2024-09-19T06:25:27.766 INFO:teuthology.orchestra.run.smithi090.stdout: "linger_ping": 0, 2024-09-19T06:25:27.766 INFO:teuthology.orchestra.run.smithi090.stdout: "poolop_active": 0, 2024-09-19T06:25:27.766 INFO:teuthology.orchestra.run.smithi090.stdout: "poolop_send": 0, 2024-09-19T06:25:27.766 INFO:teuthology.orchestra.run.smithi090.stdout: "poolop_resend": 0, 2024-09-19T06:25:27.766 INFO:teuthology.orchestra.run.smithi090.stdout: "poolstat_active": 0, 2024-09-19T06:25:27.766 INFO:teuthology.orchestra.run.smithi090.stdout: "poolstat_send": 0, 2024-09-19T06:25:27.766 INFO:teuthology.orchestra.run.smithi090.stdout: "poolstat_resend": 0, 2024-09-19T06:25:27.766 INFO:teuthology.orchestra.run.smithi090.stdout: "statfs_active": 0, 2024-09-19T06:25:27.766 INFO:teuthology.orchestra.run.smithi090.stdout: "statfs_send": 0, 2024-09-19T06:25:27.766 INFO:teuthology.orchestra.run.smithi090.stdout: "statfs_resend": 0, 2024-09-19T06:25:27.766 INFO:teuthology.orchestra.run.smithi090.stdout: "command_active": 0, 2024-09-19T06:25:27.767 INFO:teuthology.orchestra.run.smithi090.stdout: "command_send": 0, 2024-09-19T06:25:27.767 INFO:teuthology.orchestra.run.smithi090.stdout: "command_resend": 0, 2024-09-19T06:25:27.767 INFO:teuthology.orchestra.run.smithi090.stdout: "map_epoch": 92, 2024-09-19T06:25:27.767 INFO:teuthology.orchestra.run.smithi090.stdout: "map_full": 0, 2024-09-19T06:25:27.767 INFO:teuthology.orchestra.run.smithi090.stdout: "map_inc": 11, 2024-09-19T06:25:27.767 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_sessions": 6, 2024-09-19T06:25:27.767 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_session_open": 6, 2024-09-19T06:25:27.767 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_session_close": 0, 2024-09-19T06:25:27.767 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_laggy": 0, 2024-09-19T06:25:27.767 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_wr": 0, 2024-09-19T06:25:27.767 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_rd": 2, 2024-09-19T06:25:27.767 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_del": 0 2024-09-19T06:25:27.767 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.767 INFO:teuthology.orchestra.run.smithi090.stdout: "oft": { 2024-09-19T06:25:27.768 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_total_objs": 0, 2024-09-19T06:25:27.768 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_total_kv_pairs": 0, 2024-09-19T06:25:27.768 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_total_updates": 0, 2024-09-19T06:25:27.768 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_total_removes": 0 2024-09-19T06:25:27.768 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.768 INFO:teuthology.orchestra.run.smithi090.stdout: "osd-slow-ops": { 2024-09-19T06:25:27.768 INFO:teuthology.orchestra.run.smithi090.stdout: "slow_ops_count": 0 2024-09-19T06:25:27.768 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.768 INFO:teuthology.orchestra.run.smithi090.stdout: "purge_queue": { 2024-09-19T06:25:27.768 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executing_ops": 0, 2024-09-19T06:25:27.768 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T06:25:27.768 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executing": 0, 2024-09-19T06:25:27.769 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executing_high_water": 0, 2024-09-19T06:25:27.769 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executed_ops": 0, 2024-09-19T06:25:27.769 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executed": 0, 2024-09-19T06:25:27.769 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_item_in_journal": 0 2024-09-19T06:25:27.769 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.769 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:25:27.769 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-09-19T06:25:27.769 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 104857600, 2024-09-19T06:25:27.769 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-09-19T06:25:27.769 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 2518, 2024-09-19T06:25:27.769 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 2563717, 2024-09-19T06:25:27.769 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:27.770 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 2518, 2024-09-19T06:25:27.770 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 0, 2024-09-19T06:25:27.770 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 0, 2024-09-19T06:25:27.770 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 2518, 2024-09-19T06:25:27.770 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 2563717, 2024-09-19T06:25:27.770 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-09-19T06:25:27.770 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:27.770 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:27.770 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:27.770 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-19T06:25:27.770 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.770 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-objecter_bytes": { 2024-09-19T06:25:27.770 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-09-19T06:25:27.771 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 104857600, 2024-09-19T06:25:27.771 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-09-19T06:25:27.771 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 0, 2024-09-19T06:25:27.771 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 0, 2024-09-19T06:25:27.771 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:27.771 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 0, 2024-09-19T06:25:27.771 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 2281, 2024-09-19T06:25:27.771 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 690179, 2024-09-19T06:25:27.771 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 2281, 2024-09-19T06:25:27.771 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 690179, 2024-09-19T06:25:27.771 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-09-19T06:25:27.771 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:27.771 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:27.772 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:27.772 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-19T06:25:27.772 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.772 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-objecter_ops": { 2024-09-19T06:25:27.772 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-09-19T06:25:27.772 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 1024, 2024-09-19T06:25:27.772 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-09-19T06:25:27.772 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 0, 2024-09-19T06:25:27.772 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 0, 2024-09-19T06:25:27.772 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:27.772 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 0, 2024-09-19T06:25:27.772 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 2281, 2024-09-19T06:25:27.773 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 2281, 2024-09-19T06:25:27.773 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 2281, 2024-09-19T06:25:27.773 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 2281, 2024-09-19T06:25:27.773 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-09-19T06:25:27.773 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:27.773 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:27.773 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:27.773 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-19T06:25:27.773 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.773 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-write_buf_throttle": { 2024-09-19T06:25:27.773 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-09-19T06:25:27.774 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 3758096384, 2024-09-19T06:25:27.774 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-09-19T06:25:27.774 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 0, 2024-09-19T06:25:27.774 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 0, 2024-09-19T06:25:27.774 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:27.774 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 0, 2024-09-19T06:25:27.774 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 0, 2024-09-19T06:25:27.774 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 0, 2024-09-19T06:25:27.774 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 0, 2024-09-19T06:25:27.774 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 0, 2024-09-19T06:25:27.775 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-09-19T06:25:27.775 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:27.775 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:27.775 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:27.775 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-19T06:25:27.775 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:27.775 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-write_buf_throttle-0x56267e7986e0": { 2024-09-19T06:25:27.775 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-09-19T06:25:27.776 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 3758096384, 2024-09-19T06:25:27.776 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-09-19T06:25:27.776 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 0, 2024-09-19T06:25:27.776 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 0, 2024-09-19T06:25:27.776 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:27.776 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 0, 2024-09-19T06:25:27.776 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 0, 2024-09-19T06:25:27.776 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 0, 2024-09-19T06:25:27.777 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 0, 2024-09-19T06:25:27.777 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 0, 2024-09-19T06:25:27.777 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-09-19T06:25:27.777 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:27.777 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:27.777 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:27.777 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-19T06:25:27.777 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-19T06:25:27.777 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-19T06:25:27.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:27 smithi089 ceph-mon[34160]: pgmap v332: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:25:28.568 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-19T06:25:28.568 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-19T06:25:28.569 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-09-19T06:25:28.569 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2024-09-19T06:25:28.569 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2024-09-19T06:25:28.569 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-09-19T06:25:28.569 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T06:25:28.569 DEBUG:tasks.check_counter:Getting stats from f 2024-09-19T06:25:28.569 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-19T06:25:28.821 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:25:29.314 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-19T06:25:29.314 INFO:teuthology.orchestra.run.smithi090.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:25:29.314 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_messages": 236, 2024-09-19T06:25:29.314 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages": 225, 2024-09-19T06:25:29.314 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_bytes": 1472518, 2024-09-19T06:25:29.314 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_bytes": 130995, 2024-09-19T06:25:29.314 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_created_connections": 5, 2024-09-19T06:25:29.314 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_active_connections": 1, 2024-09-19T06:25:29.314 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_total_time": 0.042235511, 2024-09-19T06:25:29.315 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_send_time": 0.015136460, 2024-09-19T06:25:29.315 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_recv_time": 0.039603985, 2024-09-19T06:25:29.315 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_fast_dispatch_time": 0.000026183, 2024-09-19T06:25:29.315 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:25:29.315 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 224, 2024-09-19T06:25:29.315 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.013386989, 2024-09-19T06:25:29.315 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000059763 2024-09-19T06:25:29.315 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.315 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:25:29.315 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:29.315 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:29.315 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:29.316 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.316 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_encrypted_bytes": 1472272, 2024-09-19T06:25:29.316 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_encrypted_bytes": 130672 2024-09-19T06:25:29.316 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.316 INFO:teuthology.orchestra.run.smithi090.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:25:29.316 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_messages": 4, 2024-09-19T06:25:29.316 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages": 162, 2024-09-19T06:25:29.316 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_bytes": 1422, 2024-09-19T06:25:29.316 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_bytes": 440530, 2024-09-19T06:25:29.316 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_created_connections": 7, 2024-09-19T06:25:29.316 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_active_connections": 5, 2024-09-19T06:25:29.316 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_total_time": 0.010186010, 2024-09-19T06:25:29.316 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_send_time": 0.006116639, 2024-09-19T06:25:29.317 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_recv_time": 0.002249948, 2024-09-19T06:25:29.317 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_fast_dispatch_time": 0.000046279, 2024-09-19T06:25:29.317 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:25:29.317 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 159, 2024-09-19T06:25:29.317 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.019187038, 2024-09-19T06:25:29.317 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000120673 2024-09-19T06:25:29.317 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.317 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:25:29.317 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:29.317 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:29.317 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:29.317 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.317 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T06:25:29.318 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_encrypted_bytes": 439888 2024-09-19T06:25:29.318 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.318 INFO:teuthology.orchestra.run.smithi090.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:25:29.318 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_messages": 2112, 2024-09-19T06:25:29.318 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages": 2112, 2024-09-19T06:25:29.318 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_bytes": 600276, 2024-09-19T06:25:29.318 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_bytes": 670850, 2024-09-19T06:25:29.318 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_created_connections": 5, 2024-09-19T06:25:29.318 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_active_connections": 4, 2024-09-19T06:25:29.318 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_total_time": 0.188339034, 2024-09-19T06:25:29.318 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_send_time": 0.052366645, 2024-09-19T06:25:29.318 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_recv_time": 0.051643097, 2024-09-19T06:25:29.318 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_fast_dispatch_time": 0.068809418, 2024-09-19T06:25:29.319 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:25:29.319 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 2111, 2024-09-19T06:25:29.319 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.085705257, 2024-09-19T06:25:29.319 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000040599 2024-09-19T06:25:29.319 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.319 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:25:29.319 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:29.319 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:29.319 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:29.319 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.319 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-09-19T06:25:29.319 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T06:25:29.319 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.320 INFO:teuthology.orchestra.run.smithi090.stdout: "cct": { 2024-09-19T06:25:29.320 INFO:teuthology.orchestra.run.smithi090.stdout: "total_workers": 1, 2024-09-19T06:25:29.320 INFO:teuthology.orchestra.run.smithi090.stdout: "unhealthy_workers": 0 2024-09-19T06:25:29.320 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.320 INFO:teuthology.orchestra.run.smithi090.stdout: "finisher-MDSRank": { 2024-09-19T06:25:29.320 INFO:teuthology.orchestra.run.smithi090.stdout: "queue_len": 0, 2024-09-19T06:25:29.320 INFO:teuthology.orchestra.run.smithi090.stdout: "complete_latency": { 2024-09-19T06:25:29.320 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 3547, 2024-09-19T06:25:29.320 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.101832600, 2024-09-19T06:25:29.320 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000028709 2024-09-19T06:25:29.320 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-19T06:25:29.320 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.320 INFO:teuthology.orchestra.run.smithi090.stdout: "finisher-PurgeQueue": { 2024-09-19T06:25:29.321 INFO:teuthology.orchestra.run.smithi090.stdout: "queue_len": 0, 2024-09-19T06:25:29.321 INFO:teuthology.orchestra.run.smithi090.stdout: "complete_latency": { 2024-09-19T06:25:29.321 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:29.321 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:29.321 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:29.321 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-19T06:25:29.321 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.321 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": { 2024-09-19T06:25:29.321 INFO:teuthology.orchestra.run.smithi090.stdout: "request": 0, 2024-09-19T06:25:29.321 INFO:teuthology.orchestra.run.smithi090.stdout: "reply": 0, 2024-09-19T06:25:29.321 INFO:teuthology.orchestra.run.smithi090.stdout: "reply_latency": { 2024-09-19T06:25:29.321 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:29.321 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:29.322 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:29.322 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.322 INFO:teuthology.orchestra.run.smithi090.stdout: "slow_reply": 0, 2024-09-19T06:25:29.322 INFO:teuthology.orchestra.run.smithi090.stdout: "forward": 0, 2024-09-19T06:25:29.322 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_fetch_complete": 0, 2024-09-19T06:25:29.322 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_fetch_keys": 0, 2024-09-19T06:25:29.322 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_commit": 0, 2024-09-19T06:25:29.322 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_split": 0, 2024-09-19T06:25:29.322 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_merge": 0, 2024-09-19T06:25:29.322 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes": 0, 2024-09-19T06:25:29.322 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_top": 0, 2024-09-19T06:25:29.322 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_bottom": 0, 2024-09-19T06:25:29.322 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_pin_tail": 0, 2024-09-19T06:25:29.323 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_pinned": 0, 2024-09-19T06:25:29.323 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_expired": 0, 2024-09-19T06:25:29.323 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_with_caps": 0, 2024-09-19T06:25:29.323 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": 0, 2024-09-19T06:25:29.323 INFO:teuthology.orchestra.run.smithi090.stdout: "subtrees": 1, 2024-09-19T06:25:29.323 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse": 0, 2024-09-19T06:25:29.323 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_hit": 0, 2024-09-19T06:25:29.323 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_forward": 0, 2024-09-19T06:25:29.323 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_discover": 0, 2024-09-19T06:25:29.323 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_dir_fetch": 0, 2024-09-19T06:25:29.323 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_remote_ino": 0, 2024-09-19T06:25:29.323 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_lock": 0, 2024-09-19T06:25:29.323 INFO:teuthology.orchestra.run.smithi090.stdout: "load_cent": 0, 2024-09-19T06:25:29.324 INFO:teuthology.orchestra.run.smithi090.stdout: "q": 0, 2024-09-19T06:25:29.324 INFO:teuthology.orchestra.run.smithi090.stdout: "exported": 0, 2024-09-19T06:25:29.324 INFO:teuthology.orchestra.run.smithi090.stdout: "exported_inodes": 0, 2024-09-19T06:25:29.324 INFO:teuthology.orchestra.run.smithi090.stdout: "imported": 0, 2024-09-19T06:25:29.324 INFO:teuthology.orchestra.run.smithi090.stdout: "imported_inodes": 0, 2024-09-19T06:25:29.324 INFO:teuthology.orchestra.run.smithi090.stdout: "openino_dir_fetch": 0, 2024-09-19T06:25:29.324 INFO:teuthology.orchestra.run.smithi090.stdout: "openino_backtrace_fetch": 0, 2024-09-19T06:25:29.324 INFO:teuthology.orchestra.run.smithi090.stdout: "openino_peer_discover": 0, 2024-09-19T06:25:29.324 INFO:teuthology.orchestra.run.smithi090.stdout: "root_rfiles": 0, 2024-09-19T06:25:29.324 INFO:teuthology.orchestra.run.smithi090.stdout: "root_rbytes": 0, 2024-09-19T06:25:29.324 INFO:teuthology.orchestra.run.smithi090.stdout: "root_rsnaps": 0, 2024-09-19T06:25:29.325 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T06:25:29.325 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_set_tag": 0, 2024-09-19T06:25:29.325 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T06:25:29.325 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_inotable_repaired": 0, 2024-09-19T06:25:29.325 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_dir_inodes": 0, 2024-09-19T06:25:29.325 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T06:25:29.325 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T06:25:29.325 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_file_inodes": 0, 2024-09-19T06:25:29.325 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_inode_file_caps": 0, 2024-09-19T06:25:29.325 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T06:25:29.325 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_cap_op_grant": 0, 2024-09-19T06:25:29.325 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T06:25:29.325 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T06:25:29.326 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T06:25:29.326 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_client_caps": 0, 2024-09-19T06:25:29.326 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_client_caps_dirty": 0, 2024-09-19T06:25:29.326 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_client_cap_release": 0, 2024-09-19T06:25:29.326 INFO:teuthology.orchestra.run.smithi090.stdout: "process_request_cap_release": 0 2024-09-19T06:25:29.326 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.326 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_cache": { 2024-09-19T06:25:29.326 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_update": 0, 2024-09-19T06:25:29.326 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_update_receipt": 0, 2024-09-19T06:25:29.326 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_try_discover": 0, 2024-09-19T06:25:29.326 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_send_discover": 0, 2024-09-19T06:25:29.326 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_handle_discover": 0, 2024-09-19T06:25:29.326 INFO:teuthology.orchestra.run.smithi090.stdout: "num_strays": 0, 2024-09-19T06:25:29.327 INFO:teuthology.orchestra.run.smithi090.stdout: "num_strays_delayed": 0, 2024-09-19T06:25:29.327 INFO:teuthology.orchestra.run.smithi090.stdout: "num_strays_enqueuing": 0, 2024-09-19T06:25:29.327 INFO:teuthology.orchestra.run.smithi090.stdout: "strays_created": 0, 2024-09-19T06:25:29.327 INFO:teuthology.orchestra.run.smithi090.stdout: "strays_enqueued": 0, 2024-09-19T06:25:29.327 INFO:teuthology.orchestra.run.smithi090.stdout: "strays_reintegrated": 0, 2024-09-19T06:25:29.327 INFO:teuthology.orchestra.run.smithi090.stdout: "strays_migrated": 0, 2024-09-19T06:25:29.327 INFO:teuthology.orchestra.run.smithi090.stdout: "num_recovering_processing": 0, 2024-09-19T06:25:29.327 INFO:teuthology.orchestra.run.smithi090.stdout: "num_recovering_enqueued": 0, 2024-09-19T06:25:29.327 INFO:teuthology.orchestra.run.smithi090.stdout: "num_recovering_prioritized": 0, 2024-09-19T06:25:29.327 INFO:teuthology.orchestra.run.smithi090.stdout: "recovery_started": 0, 2024-09-19T06:25:29.327 INFO:teuthology.orchestra.run.smithi090.stdout: "recovery_completed": 0, 2024-09-19T06:25:29.327 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_quiesce_path": 0, 2024-09-19T06:25:29.328 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_quiesce_inode": 0, 2024-09-19T06:25:29.328 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T06:25:29.328 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_exportdir": 0, 2024-09-19T06:25:29.328 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_flush": 0, 2024-09-19T06:25:29.328 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_fragmentdir": 0, 2024-09-19T06:25:29.328 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_fragstats": 0, 2024-09-19T06:25:29.328 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_inodestats": 0 2024-09-19T06:25:29.328 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.328 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_log": { 2024-09-19T06:25:29.328 INFO:teuthology.orchestra.run.smithi090.stdout: "evlrg": 0, 2024-09-19T06:25:29.328 INFO:teuthology.orchestra.run.smithi090.stdout: "evadd": 0, 2024-09-19T06:25:29.328 INFO:teuthology.orchestra.run.smithi090.stdout: "evex": 0, 2024-09-19T06:25:29.329 INFO:teuthology.orchestra.run.smithi090.stdout: "evtrm": 0, 2024-09-19T06:25:29.329 INFO:teuthology.orchestra.run.smithi090.stdout: "ev": 3, 2024-09-19T06:25:29.329 INFO:teuthology.orchestra.run.smithi090.stdout: "evexg": 0, 2024-09-19T06:25:29.329 INFO:teuthology.orchestra.run.smithi090.stdout: "evexd": 0, 2024-09-19T06:25:29.329 INFO:teuthology.orchestra.run.smithi090.stdout: "segadd": 0, 2024-09-19T06:25:29.329 INFO:teuthology.orchestra.run.smithi090.stdout: "segex": 0, 2024-09-19T06:25:29.329 INFO:teuthology.orchestra.run.smithi090.stdout: "segtrm": 0, 2024-09-19T06:25:29.329 INFO:teuthology.orchestra.run.smithi090.stdout: "seg": 2, 2024-09-19T06:25:29.329 INFO:teuthology.orchestra.run.smithi090.stdout: "segmjr": 2, 2024-09-19T06:25:29.329 INFO:teuthology.orchestra.run.smithi090.stdout: "segexg": 0, 2024-09-19T06:25:29.329 INFO:teuthology.orchestra.run.smithi090.stdout: "segexd": 0, 2024-09-19T06:25:29.329 INFO:teuthology.orchestra.run.smithi090.stdout: "expos": 4194304, 2024-09-19T06:25:29.329 INFO:teuthology.orchestra.run.smithi090.stdout: "wrpos": 4195387, 2024-09-19T06:25:29.330 INFO:teuthology.orchestra.run.smithi090.stdout: "rdpos": 4194892, 2024-09-19T06:25:29.330 INFO:teuthology.orchestra.run.smithi090.stdout: "jlat": { 2024-09-19T06:25:29.330 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:29.330 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:29.330 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:29.330 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.330 INFO:teuthology.orchestra.run.smithi090.stdout: "replayed": 3 2024-09-19T06:25:29.330 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.330 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_mem": { 2024-09-19T06:25:29.330 INFO:teuthology.orchestra.run.smithi090.stdout: "ino": 3, 2024-09-19T06:25:29.330 INFO:teuthology.orchestra.run.smithi090.stdout: "ino+": 3, 2024-09-19T06:25:29.330 INFO:teuthology.orchestra.run.smithi090.stdout: "ino-": 0, 2024-09-19T06:25:29.330 INFO:teuthology.orchestra.run.smithi090.stdout: "dir": 1, 2024-09-19T06:25:29.330 INFO:teuthology.orchestra.run.smithi090.stdout: "dir+": 1, 2024-09-19T06:25:29.331 INFO:teuthology.orchestra.run.smithi090.stdout: "dir-": 0, 2024-09-19T06:25:29.331 INFO:teuthology.orchestra.run.smithi090.stdout: "dn": 0, 2024-09-19T06:25:29.331 INFO:teuthology.orchestra.run.smithi090.stdout: "dn+": 0, 2024-09-19T06:25:29.331 INFO:teuthology.orchestra.run.smithi090.stdout: "dn-": 0, 2024-09-19T06:25:29.331 INFO:teuthology.orchestra.run.smithi090.stdout: "cap": 0, 2024-09-19T06:25:29.331 INFO:teuthology.orchestra.run.smithi090.stdout: "cap+": 0, 2024-09-19T06:25:29.331 INFO:teuthology.orchestra.run.smithi090.stdout: "cap-": 0, 2024-09-19T06:25:29.331 INFO:teuthology.orchestra.run.smithi090.stdout: "rss": 49272, 2024-09-19T06:25:29.331 INFO:teuthology.orchestra.run.smithi090.stdout: "heap": 215328 2024-09-19T06:25:29.331 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.331 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_server": { 2024-09-19T06:25:29.331 INFO:teuthology.orchestra.run.smithi090.stdout: "dispatch_client_request": 0, 2024-09-19T06:25:29.332 INFO:teuthology.orchestra.run.smithi090.stdout: "dispatch_server_request": 0, 2024-09-19T06:25:29.332 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_client_request": 0, 2024-09-19T06:25:29.332 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_client_session": 0, 2024-09-19T06:25:29.332 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_peer_request": 0, 2024-09-19T06:25:29.332 INFO:teuthology.orchestra.run.smithi090.stdout: "req_create_latency": { 2024-09-19T06:25:29.332 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:29.332 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:29.332 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:29.332 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.332 INFO:teuthology.orchestra.run.smithi090.stdout: "req_getattr_latency": { 2024-09-19T06:25:29.332 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:29.332 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:29.332 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:29.333 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.333 INFO:teuthology.orchestra.run.smithi090.stdout: "req_getfilelock_latency": { 2024-09-19T06:25:29.333 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:29.333 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:29.333 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:29.333 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.333 INFO:teuthology.orchestra.run.smithi090.stdout: "req_link_latency": { 2024-09-19T06:25:29.333 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:29.333 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:29.333 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:29.333 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.333 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookup_latency": { 2024-09-19T06:25:29.333 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:29.333 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:29.334 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:29.334 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.334 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookuphash_latency": { 2024-09-19T06:25:29.334 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:29.334 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:29.334 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:29.334 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.334 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookupino_latency": { 2024-09-19T06:25:29.334 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:29.334 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:29.334 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:29.334 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.334 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookupname_latency": { 2024-09-19T06:25:29.335 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:29.335 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:29.335 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:29.335 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.335 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookupparent_latency": { 2024-09-19T06:25:29.335 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:29.335 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:29.335 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:29.335 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.335 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookupsnap_latency": { 2024-09-19T06:25:29.335 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:29.335 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:29.335 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:29.336 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.336 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lssnap_latency": { 2024-09-19T06:25:29.336 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:29.336 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:29.336 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:29.336 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.336 INFO:teuthology.orchestra.run.smithi090.stdout: "req_mkdir_latency": { 2024-09-19T06:25:29.336 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:29.336 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:29.336 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:29.336 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.337 INFO:teuthology.orchestra.run.smithi090.stdout: "req_mknod_latency": { 2024-09-19T06:25:29.337 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:29.337 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:29.337 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:29.337 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.337 INFO:teuthology.orchestra.run.smithi090.stdout: "req_mksnap_latency": { 2024-09-19T06:25:29.337 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:29.337 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:29.337 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:29.337 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.337 INFO:teuthology.orchestra.run.smithi090.stdout: "req_open_latency": { 2024-09-19T06:25:29.337 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:29.337 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:29.338 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:29.338 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.338 INFO:teuthology.orchestra.run.smithi090.stdout: "req_readdir_latency": { 2024-09-19T06:25:29.338 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:29.338 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:29.338 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:29.338 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.338 INFO:teuthology.orchestra.run.smithi090.stdout: "req_rename_latency": { 2024-09-19T06:25:29.338 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:29.338 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:29.338 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:29.338 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.339 INFO:teuthology.orchestra.run.smithi090.stdout: "req_renamesnap_latency": { 2024-09-19T06:25:29.339 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:29.339 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:29.339 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:29.339 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.339 INFO:teuthology.orchestra.run.smithi090.stdout: "req_snapdiff_latency": { 2024-09-19T06:25:29.339 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:29.339 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:29.339 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:29.339 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.339 INFO:teuthology.orchestra.run.smithi090.stdout: "req_rmdir_latency": { 2024-09-19T06:25:29.339 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:29.340 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:29.340 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:29.340 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.340 INFO:teuthology.orchestra.run.smithi090.stdout: "req_rmsnap_latency": { 2024-09-19T06:25:29.340 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:29.340 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:29.340 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:29.340 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.340 INFO:teuthology.orchestra.run.smithi090.stdout: "req_rmxattr_latency": { 2024-09-19T06:25:29.340 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:29.340 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:29.340 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:29.341 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.341 INFO:teuthology.orchestra.run.smithi090.stdout: "req_setattr_latency": { 2024-09-19T06:25:29.341 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:29.341 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:29.341 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:29.341 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.341 INFO:teuthology.orchestra.run.smithi090.stdout: "req_setdirlayout_latency": { 2024-09-19T06:25:29.341 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:29.341 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:29.341 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:29.341 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.341 INFO:teuthology.orchestra.run.smithi090.stdout: "req_setfilelock_latency": { 2024-09-19T06:25:29.341 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:29.342 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:29.342 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:29.342 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.342 INFO:teuthology.orchestra.run.smithi090.stdout: "req_setlayout_latency": { 2024-09-19T06:25:29.342 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:29.342 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:29.342 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:29.342 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.342 INFO:teuthology.orchestra.run.smithi090.stdout: "req_setxattr_latency": { 2024-09-19T06:25:29.342 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:29.342 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:29.342 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:29.342 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.343 INFO:teuthology.orchestra.run.smithi090.stdout: "req_symlink_latency": { 2024-09-19T06:25:29.343 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:29.343 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:29.343 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:29.343 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.343 INFO:teuthology.orchestra.run.smithi090.stdout: "req_unlink_latency": { 2024-09-19T06:25:29.343 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:29.343 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:29.343 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:29.343 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.343 INFO:teuthology.orchestra.run.smithi090.stdout: "cap_revoke_eviction": 0, 2024-09-19T06:25:29.343 INFO:teuthology.orchestra.run.smithi090.stdout: "cap_acquisition_throttle": 0, 2024-09-19T06:25:29.343 INFO:teuthology.orchestra.run.smithi090.stdout: "req_getvxattr_latency": { 2024-09-19T06:25:29.344 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:29.344 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:29.344 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:29.344 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-19T06:25:29.344 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.344 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_sessions": { 2024-09-19T06:25:29.344 INFO:teuthology.orchestra.run.smithi090.stdout: "session_count": 1, 2024-09-19T06:25:29.344 INFO:teuthology.orchestra.run.smithi090.stdout: "session_add": 1, 2024-09-19T06:25:29.344 INFO:teuthology.orchestra.run.smithi090.stdout: "session_remove": 0, 2024-09-19T06:25:29.344 INFO:teuthology.orchestra.run.smithi090.stdout: "sessions_open": 1, 2024-09-19T06:25:29.344 INFO:teuthology.orchestra.run.smithi090.stdout: "sessions_stale": 0, 2024-09-19T06:25:29.344 INFO:teuthology.orchestra.run.smithi090.stdout: "total_load": 0, 2024-09-19T06:25:29.344 INFO:teuthology.orchestra.run.smithi090.stdout: "average_load": 0, 2024-09-19T06:25:29.345 INFO:teuthology.orchestra.run.smithi090.stdout: "avg_session_uptime": 1629, 2024-09-19T06:25:29.345 INFO:teuthology.orchestra.run.smithi090.stdout: "mdthresh_evicted": 0 2024-09-19T06:25:29.345 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.345 INFO:teuthology.orchestra.run.smithi090.stdout: "mempool": { 2024-09-19T06:25:29.345 INFO:teuthology.orchestra.run.smithi090.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:25:29.345 INFO:teuthology.orchestra.run.smithi090.stdout: "bloom_filter_items": 0, 2024-09-19T06:25:29.345 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:25:29.345 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:25:29.345 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:25:29.345 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:25:29.345 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:25:29.345 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:25:29.345 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:25:29.346 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:25:29.346 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:25:29.346 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:25:29.346 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:25:29.346 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:25:29.346 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:25:29.346 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_extent_items": 0, 2024-09-19T06:25:29.346 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:25:29.346 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_blob_items": 0, 2024-09-19T06:25:29.346 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:25:29.346 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:25:29.346 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:25:29.346 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:25:29.347 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:25:29.347 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:25:29.347 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:25:29.347 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_txc_items": 0, 2024-09-19T06:25:29.347 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:25:29.347 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:25:29.347 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:25:29.347 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_items": 0, 2024-09-19T06:25:29.347 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_bytes": 0, 2024-09-19T06:25:29.347 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_items": 0, 2024-09-19T06:25:29.347 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:25:29.347 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:25:29.347 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:25:29.348 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:25:29.348 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_anon_bytes": 197490, 2024-09-19T06:25:29.348 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_anon_items": 56, 2024-09-19T06:25:29.348 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:25:29.348 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_meta_items": 0, 2024-09-19T06:25:29.348 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_bytes": 0, 2024-09-19T06:25:29.348 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_items": 0, 2024-09-19T06:25:29.348 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:25:29.348 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_mapbl_items": 0, 2024-09-19T06:25:29.348 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:25:29.348 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_pglog_items": 0, 2024-09-19T06:25:29.348 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_bytes": 8136, 2024-09-19T06:25:29.348 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_items": 180, 2024-09-19T06:25:29.349 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:25:29.349 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:25:29.349 INFO:teuthology.orchestra.run.smithi090.stdout: "pgmap_bytes": 0, 2024-09-19T06:25:29.349 INFO:teuthology.orchestra.run.smithi090.stdout: "pgmap_items": 0, 2024-09-19T06:25:29.349 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_co_bytes": 8512, 2024-09-19T06:25:29.349 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_co_items": 13, 2024-09-19T06:25:29.349 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_1_bytes": 0, 2024-09-19T06:25:29.349 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_1_items": 0, 2024-09-19T06:25:29.349 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_2_bytes": 0, 2024-09-19T06:25:29.349 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_2_items": 0 2024-09-19T06:25:29.349 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.349 INFO:teuthology.orchestra.run.smithi090.stdout: "objecter": { 2024-09-19T06:25:29.349 INFO:teuthology.orchestra.run.smithi090.stdout: "op_active": 0, 2024-09-19T06:25:29.350 INFO:teuthology.orchestra.run.smithi090.stdout: "op_laggy": 0, 2024-09-19T06:25:29.350 INFO:teuthology.orchestra.run.smithi090.stdout: "op_send": 2111, 2024-09-19T06:25:29.350 INFO:teuthology.orchestra.run.smithi090.stdout: "op_send_bytes": 21, 2024-09-19T06:25:29.350 INFO:teuthology.orchestra.run.smithi090.stdout: "op_resend": 3, 2024-09-19T06:25:29.350 INFO:teuthology.orchestra.run.smithi090.stdout: "op_reply": 2111, 2024-09-19T06:25:29.350 INFO:teuthology.orchestra.run.smithi090.stdout: "op_latency": { 2024-09-19T06:25:29.350 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 2111, 2024-09-19T06:25:29.350 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 1.187980501, 2024-09-19T06:25:29.350 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000562757 2024-09-19T06:25:29.350 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.350 INFO:teuthology.orchestra.run.smithi090.stdout: "op_inflight": 0, 2024-09-19T06:25:29.350 INFO:teuthology.orchestra.run.smithi090.stdout: "oplen_avg": { 2024-09-19T06:25:29.350 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 2111, 2024-09-19T06:25:29.351 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 2112 2024-09-19T06:25:29.351 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.351 INFO:teuthology.orchestra.run.smithi090.stdout: "op": 2111, 2024-09-19T06:25:29.351 INFO:teuthology.orchestra.run.smithi090.stdout: "op_r": 2111, 2024-09-19T06:25:29.351 INFO:teuthology.orchestra.run.smithi090.stdout: "op_w": 0, 2024-09-19T06:25:29.351 INFO:teuthology.orchestra.run.smithi090.stdout: "op_rmw": 0, 2024-09-19T06:25:29.351 INFO:teuthology.orchestra.run.smithi090.stdout: "op_pg": 0, 2024-09-19T06:25:29.351 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_stat": 1373, 2024-09-19T06:25:29.351 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_create": 0, 2024-09-19T06:25:29.351 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_read": 736, 2024-09-19T06:25:29.351 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_write": 0, 2024-09-19T06:25:29.351 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_writefull": 0, 2024-09-19T06:25:29.351 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_writesame": 0, 2024-09-19T06:25:29.352 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_append": 0, 2024-09-19T06:25:29.352 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_zero": 0, 2024-09-19T06:25:29.352 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_truncate": 0, 2024-09-19T06:25:29.352 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_delete": 0, 2024-09-19T06:25:29.352 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_mapext": 0, 2024-09-19T06:25:29.352 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_sparse_read": 0, 2024-09-19T06:25:29.352 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_clonerange": 0, 2024-09-19T06:25:29.352 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_getxattr": 1, 2024-09-19T06:25:29.352 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_setxattr": 0, 2024-09-19T06:25:29.352 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_cmpxattr": 0, 2024-09-19T06:25:29.352 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_rmxattr": 0, 2024-09-19T06:25:29.352 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_resetxattrs": 0, 2024-09-19T06:25:29.352 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_call": 0, 2024-09-19T06:25:29.353 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_watch": 0, 2024-09-19T06:25:29.353 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_notify": 0, 2024-09-19T06:25:29.353 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T06:25:29.353 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_pgls": 0, 2024-09-19T06:25:29.353 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_pgls_filter": 0, 2024-09-19T06:25:29.353 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_other": 0, 2024-09-19T06:25:29.353 INFO:teuthology.orchestra.run.smithi090.stdout: "linger_active": 0, 2024-09-19T06:25:29.353 INFO:teuthology.orchestra.run.smithi090.stdout: "linger_send": 0, 2024-09-19T06:25:29.353 INFO:teuthology.orchestra.run.smithi090.stdout: "linger_resend": 0, 2024-09-19T06:25:29.353 INFO:teuthology.orchestra.run.smithi090.stdout: "linger_ping": 0, 2024-09-19T06:25:29.353 INFO:teuthology.orchestra.run.smithi090.stdout: "poolop_active": 0, 2024-09-19T06:25:29.353 INFO:teuthology.orchestra.run.smithi090.stdout: "poolop_send": 0, 2024-09-19T06:25:29.353 INFO:teuthology.orchestra.run.smithi090.stdout: "poolop_resend": 0, 2024-09-19T06:25:29.354 INFO:teuthology.orchestra.run.smithi090.stdout: "poolstat_active": 0, 2024-09-19T06:25:29.354 INFO:teuthology.orchestra.run.smithi090.stdout: "poolstat_send": 0, 2024-09-19T06:25:29.354 INFO:teuthology.orchestra.run.smithi090.stdout: "poolstat_resend": 0, 2024-09-19T06:25:29.354 INFO:teuthology.orchestra.run.smithi090.stdout: "statfs_active": 0, 2024-09-19T06:25:29.354 INFO:teuthology.orchestra.run.smithi090.stdout: "statfs_send": 0, 2024-09-19T06:25:29.354 INFO:teuthology.orchestra.run.smithi090.stdout: "statfs_resend": 0, 2024-09-19T06:25:29.354 INFO:teuthology.orchestra.run.smithi090.stdout: "command_active": 0, 2024-09-19T06:25:29.354 INFO:teuthology.orchestra.run.smithi090.stdout: "command_send": 0, 2024-09-19T06:25:29.354 INFO:teuthology.orchestra.run.smithi090.stdout: "command_resend": 0, 2024-09-19T06:25:29.354 INFO:teuthology.orchestra.run.smithi090.stdout: "map_epoch": 92, 2024-09-19T06:25:29.354 INFO:teuthology.orchestra.run.smithi090.stdout: "map_full": 0, 2024-09-19T06:25:29.354 INFO:teuthology.orchestra.run.smithi090.stdout: "map_inc": 11, 2024-09-19T06:25:29.354 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_sessions": 6, 2024-09-19T06:25:29.355 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_session_open": 6, 2024-09-19T06:25:29.355 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_session_close": 0, 2024-09-19T06:25:29.355 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_laggy": 0, 2024-09-19T06:25:29.355 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_wr": 0, 2024-09-19T06:25:29.355 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_rd": 2, 2024-09-19T06:25:29.355 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_del": 0 2024-09-19T06:25:29.355 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.355 INFO:teuthology.orchestra.run.smithi090.stdout: "oft": { 2024-09-19T06:25:29.355 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_total_objs": 0, 2024-09-19T06:25:29.355 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_total_kv_pairs": 0, 2024-09-19T06:25:29.355 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_total_updates": 0, 2024-09-19T06:25:29.355 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_total_removes": 0 2024-09-19T06:25:29.355 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.355 INFO:teuthology.orchestra.run.smithi090.stdout: "osd-slow-ops": { 2024-09-19T06:25:29.356 INFO:teuthology.orchestra.run.smithi090.stdout: "slow_ops_count": 0 2024-09-19T06:25:29.356 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.356 INFO:teuthology.orchestra.run.smithi090.stdout: "purge_queue": { 2024-09-19T06:25:29.356 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executing_ops": 0, 2024-09-19T06:25:29.356 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T06:25:29.356 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executing": 0, 2024-09-19T06:25:29.356 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executing_high_water": 0, 2024-09-19T06:25:29.356 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executed_ops": 0, 2024-09-19T06:25:29.356 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executed": 0, 2024-09-19T06:25:29.356 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_item_in_journal": 0 2024-09-19T06:25:29.356 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.357 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:25:29.357 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-09-19T06:25:29.357 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 104857600, 2024-09-19T06:25:29.357 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-09-19T06:25:29.357 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 2348, 2024-09-19T06:25:29.357 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 1847774, 2024-09-19T06:25:29.357 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:29.357 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 2348, 2024-09-19T06:25:29.357 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 0, 2024-09-19T06:25:29.357 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 0, 2024-09-19T06:25:29.357 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 2348, 2024-09-19T06:25:29.357 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 1847774, 2024-09-19T06:25:29.357 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-09-19T06:25:29.357 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:29.358 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:29.358 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:29.358 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-19T06:25:29.358 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.358 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-objecter_bytes": { 2024-09-19T06:25:29.358 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-09-19T06:25:29.358 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 104857600, 2024-09-19T06:25:29.358 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-09-19T06:25:29.358 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 0, 2024-09-19T06:25:29.358 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 0, 2024-09-19T06:25:29.358 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:29.358 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 0, 2024-09-19T06:25:29.358 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 2111, 2024-09-19T06:25:29.359 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 1088, 2024-09-19T06:25:29.359 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 2111, 2024-09-19T06:25:29.359 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 1088, 2024-09-19T06:25:29.359 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-09-19T06:25:29.359 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:29.359 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:29.359 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:29.359 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-19T06:25:29.359 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.359 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-objecter_ops": { 2024-09-19T06:25:29.359 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-09-19T06:25:29.359 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 1024, 2024-09-19T06:25:29.359 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-09-19T06:25:29.360 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 0, 2024-09-19T06:25:29.360 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 0, 2024-09-19T06:25:29.360 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:29.360 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 0, 2024-09-19T06:25:29.360 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 2111, 2024-09-19T06:25:29.360 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 2111, 2024-09-19T06:25:29.360 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 2111, 2024-09-19T06:25:29.360 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 2111, 2024-09-19T06:25:29.360 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-09-19T06:25:29.360 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:29.360 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:29.360 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:29.360 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-19T06:25:29.361 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.361 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-write_buf_throttle": { 2024-09-19T06:25:29.361 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-09-19T06:25:29.361 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 3758096384, 2024-09-19T06:25:29.361 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-09-19T06:25:29.361 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 0, 2024-09-19T06:25:29.361 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 0, 2024-09-19T06:25:29.361 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:29.361 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 0, 2024-09-19T06:25:29.361 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 0, 2024-09-19T06:25:29.361 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 0, 2024-09-19T06:25:29.361 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 0, 2024-09-19T06:25:29.361 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 0, 2024-09-19T06:25:29.362 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-09-19T06:25:29.362 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:29.362 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:29.362 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:29.362 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-19T06:25:29.362 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:29.362 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-write_buf_throttle-0x5557d292a6e0": { 2024-09-19T06:25:29.362 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-09-19T06:25:29.362 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 3758096384, 2024-09-19T06:25:29.362 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-09-19T06:25:29.362 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 0, 2024-09-19T06:25:29.362 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 0, 2024-09-19T06:25:29.362 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:29.363 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 0, 2024-09-19T06:25:29.363 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 0, 2024-09-19T06:25:29.363 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 0, 2024-09-19T06:25:29.363 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 0, 2024-09-19T06:25:29.363 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 0, 2024-09-19T06:25:29.363 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-09-19T06:25:29.363 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:29.363 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:29.363 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:29.363 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-19T06:25:29.363 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-19T06:25:29.363 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-19T06:25:29.489 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:29 smithi090 ceph-mon[34497]: pgmap v333: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:25:29.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:29 smithi002 ceph-mon[30982]: pgmap v333: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:25:29.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:29 smithi089 ceph-mon[34160]: pgmap v333: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:25:29.945 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-19T06:25:29.945 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-19T06:25:29.945 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-09-19T06:25:29.945 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-09-19T06:25:29.945 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=0 2024-09-19T06:25:29.945 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-09-19T06:25:29.945 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T06:25:29.945 DEBUG:tasks.check_counter:Getting stats from i 2024-09-19T06:25:29.946 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-19T06:25:30.191 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:25:30.640 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-19T06:25:30.640 INFO:teuthology.orchestra.run.smithi090.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:25:30.640 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_messages": 35, 2024-09-19T06:25:30.640 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages": 171, 2024-09-19T06:25:30.641 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_bytes": 8399, 2024-09-19T06:25:30.641 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_bytes": 383865, 2024-09-19T06:25:30.641 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_created_connections": 15, 2024-09-19T06:25:30.641 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_active_connections": 4, 2024-09-19T06:25:30.641 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_total_time": 0.018394401, 2024-09-19T06:25:30.641 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_send_time": 0.005710709, 2024-09-19T06:25:30.641 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_recv_time": 0.004201227, 2024-09-19T06:25:30.641 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_fast_dispatch_time": 0.000546568, 2024-09-19T06:25:30.641 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:25:30.642 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 166, 2024-09-19T06:25:30.642 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.037162044, 2024-09-19T06:25:30.642 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000223867 2024-09-19T06:25:30.642 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.642 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:25:30.642 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 13, 2024-09-19T06:25:30.642 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000002140, 2024-09-19T06:25:30.642 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000164 2024-09-19T06:25:30.642 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.643 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_encrypted_bytes": 1088, 2024-09-19T06:25:30.643 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_encrypted_bytes": 320720 2024-09-19T06:25:30.643 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.643 INFO:teuthology.orchestra.run.smithi090.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:25:30.643 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_messages": 529, 2024-09-19T06:25:30.643 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages": 656, 2024-09-19T06:25:30.643 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_bytes": 153645, 2024-09-19T06:25:30.643 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_bytes": 378898, 2024-09-19T06:25:30.643 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_created_connections": 9, 2024-09-19T06:25:30.643 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_active_connections": 4, 2024-09-19T06:25:30.644 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_total_time": 0.063669401, 2024-09-19T06:25:30.644 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_send_time": 0.024264194, 2024-09-19T06:25:30.644 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_recv_time": 0.034608885, 2024-09-19T06:25:30.644 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_fast_dispatch_time": 0.004578749, 2024-09-19T06:25:30.644 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:25:30.644 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 657, 2024-09-19T06:25:30.644 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.043936868, 2024-09-19T06:25:30.644 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000066874 2024-09-19T06:25:30.645 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.645 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:25:30.645 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 1118, 2024-09-19T06:25:30.645 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000253455, 2024-09-19T06:25:30.645 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000226 2024-09-19T06:25:30.645 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.645 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_encrypted_bytes": 5376, 2024-09-19T06:25:30.645 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_encrypted_bytes": 126384 2024-09-19T06:25:30.645 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.646 INFO:teuthology.orchestra.run.smithi090.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:25:30.646 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_messages": 351, 2024-09-19T06:25:30.646 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages": 336, 2024-09-19T06:25:30.646 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_bytes": 1504842, 2024-09-19T06:25:30.646 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_bytes": 997808, 2024-09-19T06:25:30.647 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_created_connections": 76, 2024-09-19T06:25:30.647 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_active_connections": 5, 2024-09-19T06:25:30.647 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_total_time": 0.067081080, 2024-09-19T06:25:30.647 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_send_time": 0.017520678, 2024-09-19T06:25:30.647 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_recv_time": 0.060297286, 2024-09-19T06:25:30.647 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_fast_dispatch_time": 0.000274321, 2024-09-19T06:25:30.648 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:25:30.648 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 335, 2024-09-19T06:25:30.648 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.022952915, 2024-09-19T06:25:30.648 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000068516 2024-09-19T06:25:30.648 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.649 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:25:30.649 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 79, 2024-09-19T06:25:30.649 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000006748, 2024-09-19T06:25:30.649 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000085 2024-09-19T06:25:30.649 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.650 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_encrypted_bytes": 1492208, 2024-09-19T06:25:30.650 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_encrypted_bytes": 135280 2024-09-19T06:25:30.650 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.650 INFO:teuthology.orchestra.run.smithi090.stdout: "cct": { 2024-09-19T06:25:30.650 INFO:teuthology.orchestra.run.smithi090.stdout: "total_workers": 1, 2024-09-19T06:25:30.651 INFO:teuthology.orchestra.run.smithi090.stdout: "unhealthy_workers": 0 2024-09-19T06:25:30.651 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.651 INFO:teuthology.orchestra.run.smithi090.stdout: "finisher-MDSRank": { 2024-09-19T06:25:30.651 INFO:teuthology.orchestra.run.smithi090.stdout: "queue_len": 0, 2024-09-19T06:25:30.651 INFO:teuthology.orchestra.run.smithi090.stdout: "complete_latency": { 2024-09-19T06:25:30.651 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 51, 2024-09-19T06:25:30.652 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.001639163, 2024-09-19T06:25:30.652 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000032140 2024-09-19T06:25:30.652 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-19T06:25:30.652 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.652 INFO:teuthology.orchestra.run.smithi090.stdout: "finisher-PurgeQueue": { 2024-09-19T06:25:30.653 INFO:teuthology.orchestra.run.smithi090.stdout: "queue_len": 0, 2024-09-19T06:25:30.653 INFO:teuthology.orchestra.run.smithi090.stdout: "complete_latency": { 2024-09-19T06:25:30.653 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 2, 2024-09-19T06:25:30.653 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000012363, 2024-09-19T06:25:30.653 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000006181 2024-09-19T06:25:30.653 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-19T06:25:30.654 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.654 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": { 2024-09-19T06:25:30.654 INFO:teuthology.orchestra.run.smithi090.stdout: "request": 8, 2024-09-19T06:25:30.654 INFO:teuthology.orchestra.run.smithi090.stdout: "reply": 6, 2024-09-19T06:25:30.654 INFO:teuthology.orchestra.run.smithi090.stdout: "reply_latency": { 2024-09-19T06:25:30.655 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 6, 2024-09-19T06:25:30.655 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.002186927, 2024-09-19T06:25:30.655 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000364487 2024-09-19T06:25:30.655 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.655 INFO:teuthology.orchestra.run.smithi090.stdout: "slow_reply": 0, 2024-09-19T06:25:30.655 INFO:teuthology.orchestra.run.smithi090.stdout: "forward": 2, 2024-09-19T06:25:30.656 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_fetch_complete": 0, 2024-09-19T06:25:30.656 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_fetch_keys": 0, 2024-09-19T06:25:30.656 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_commit": 11, 2024-09-19T06:25:30.656 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_split": 0, 2024-09-19T06:25:30.656 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_merge": 0, 2024-09-19T06:25:30.656 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes": 16, 2024-09-19T06:25:30.657 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_top": 0, 2024-09-19T06:25:30.657 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_bottom": 16, 2024-09-19T06:25:30.657 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_pin_tail": 0, 2024-09-19T06:25:30.657 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_pinned": 13, 2024-09-19T06:25:30.658 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_expired": 2, 2024-09-19T06:25:30.658 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_with_caps": 3, 2024-09-19T06:25:30.658 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": 3, 2024-09-19T06:25:30.658 INFO:teuthology.orchestra.run.smithi090.stdout: "subtrees": 3, 2024-09-19T06:25:30.658 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse": 18, 2024-09-19T06:25:30.659 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_hit": 14, 2024-09-19T06:25:30.659 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_forward": 1, 2024-09-19T06:25:30.659 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_discover": 3, 2024-09-19T06:25:30.659 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_dir_fetch": 0, 2024-09-19T06:25:30.659 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_remote_ino": 0, 2024-09-19T06:25:30.660 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_lock": 0, 2024-09-19T06:25:30.660 INFO:teuthology.orchestra.run.smithi090.stdout: "load_cent": 0, 2024-09-19T06:25:30.660 INFO:teuthology.orchestra.run.smithi090.stdout: "q": 0, 2024-09-19T06:25:30.660 INFO:teuthology.orchestra.run.smithi090.stdout: "exported": 0, 2024-09-19T06:25:30.660 INFO:teuthology.orchestra.run.smithi090.stdout: "exported_inodes": 0, 2024-09-19T06:25:30.660 INFO:teuthology.orchestra.run.smithi090.stdout: "imported": 0, 2024-09-19T06:25:30.660 INFO:teuthology.orchestra.run.smithi090.stdout: "imported_inodes": 0, 2024-09-19T06:25:30.660 INFO:teuthology.orchestra.run.smithi090.stdout: "openino_dir_fetch": 0, 2024-09-19T06:25:30.660 INFO:teuthology.orchestra.run.smithi090.stdout: "openino_backtrace_fetch": 0, 2024-09-19T06:25:30.660 INFO:teuthology.orchestra.run.smithi090.stdout: "openino_peer_discover": 0, 2024-09-19T06:25:30.661 INFO:teuthology.orchestra.run.smithi090.stdout: "root_rfiles": 4, 2024-09-19T06:25:30.661 INFO:teuthology.orchestra.run.smithi090.stdout: "root_rbytes": 234, 2024-09-19T06:25:30.661 INFO:teuthology.orchestra.run.smithi090.stdout: "root_rsnaps": 6, 2024-09-19T06:25:30.661 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T06:25:30.661 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_set_tag": 0, 2024-09-19T06:25:30.661 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T06:25:30.661 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_inotable_repaired": 0, 2024-09-19T06:25:30.661 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_dir_inodes": 0, 2024-09-19T06:25:30.661 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T06:25:30.661 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T06:25:30.661 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_file_inodes": 0, 2024-09-19T06:25:30.662 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_inode_file_caps": 0, 2024-09-19T06:25:30.662 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T06:25:30.662 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_cap_op_grant": 0, 2024-09-19T06:25:30.662 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T06:25:30.662 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T06:25:30.662 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T06:25:30.662 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_client_caps": 0, 2024-09-19T06:25:30.662 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_client_caps_dirty": 0, 2024-09-19T06:25:30.662 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_client_cap_release": 0, 2024-09-19T06:25:30.662 INFO:teuthology.orchestra.run.smithi090.stdout: "process_request_cap_release": 0 2024-09-19T06:25:30.662 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.662 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_cache": { 2024-09-19T06:25:30.662 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_update": 0, 2024-09-19T06:25:30.663 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_update_receipt": 11, 2024-09-19T06:25:30.663 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_try_discover": 7, 2024-09-19T06:25:30.663 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_send_discover": 8, 2024-09-19T06:25:30.663 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_handle_discover": 0, 2024-09-19T06:25:30.663 INFO:teuthology.orchestra.run.smithi090.stdout: "num_strays": 0, 2024-09-19T06:25:30.663 INFO:teuthology.orchestra.run.smithi090.stdout: "num_strays_delayed": 0, 2024-09-19T06:25:30.663 INFO:teuthology.orchestra.run.smithi090.stdout: "num_strays_enqueuing": 0, 2024-09-19T06:25:30.663 INFO:teuthology.orchestra.run.smithi090.stdout: "strays_created": 0, 2024-09-19T06:25:30.663 INFO:teuthology.orchestra.run.smithi090.stdout: "strays_enqueued": 0, 2024-09-19T06:25:30.663 INFO:teuthology.orchestra.run.smithi090.stdout: "strays_reintegrated": 0, 2024-09-19T06:25:30.664 INFO:teuthology.orchestra.run.smithi090.stdout: "strays_migrated": 0, 2024-09-19T06:25:30.664 INFO:teuthology.orchestra.run.smithi090.stdout: "num_recovering_processing": 0, 2024-09-19T06:25:30.664 INFO:teuthology.orchestra.run.smithi090.stdout: "num_recovering_enqueued": 0, 2024-09-19T06:25:30.664 INFO:teuthology.orchestra.run.smithi090.stdout: "num_recovering_prioritized": 0, 2024-09-19T06:25:30.664 INFO:teuthology.orchestra.run.smithi090.stdout: "recovery_started": 0, 2024-09-19T06:25:30.664 INFO:teuthology.orchestra.run.smithi090.stdout: "recovery_completed": 0, 2024-09-19T06:25:30.664 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_quiesce_path": 0, 2024-09-19T06:25:30.664 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_quiesce_inode": 0, 2024-09-19T06:25:30.664 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T06:25:30.664 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_exportdir": 0, 2024-09-19T06:25:30.664 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_flush": 0, 2024-09-19T06:25:30.664 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_fragmentdir": 0, 2024-09-19T06:25:30.665 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_fragstats": 0, 2024-09-19T06:25:30.665 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_inodestats": 0 2024-09-19T06:25:30.665 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.665 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_log": { 2024-09-19T06:25:30.665 INFO:teuthology.orchestra.run.smithi090.stdout: "evlrg": 0, 2024-09-19T06:25:30.665 INFO:teuthology.orchestra.run.smithi090.stdout: "evadd": 9, 2024-09-19T06:25:30.665 INFO:teuthology.orchestra.run.smithi090.stdout: "evex": 0, 2024-09-19T06:25:30.665 INFO:teuthology.orchestra.run.smithi090.stdout: "evtrm": 0, 2024-09-19T06:25:30.665 INFO:teuthology.orchestra.run.smithi090.stdout: "ev": 9, 2024-09-19T06:25:30.665 INFO:teuthology.orchestra.run.smithi090.stdout: "evexg": 0, 2024-09-19T06:25:30.665 INFO:teuthology.orchestra.run.smithi090.stdout: "evexd": 0, 2024-09-19T06:25:30.666 INFO:teuthology.orchestra.run.smithi090.stdout: "segadd": 2, 2024-09-19T06:25:30.666 INFO:teuthology.orchestra.run.smithi090.stdout: "segex": 0, 2024-09-19T06:25:30.666 INFO:teuthology.orchestra.run.smithi090.stdout: "segtrm": 0, 2024-09-19T06:25:30.666 INFO:teuthology.orchestra.run.smithi090.stdout: "seg": 2, 2024-09-19T06:25:30.666 INFO:teuthology.orchestra.run.smithi090.stdout: "segmjr": 2, 2024-09-19T06:25:30.666 INFO:teuthology.orchestra.run.smithi090.stdout: "segexg": 0, 2024-09-19T06:25:30.666 INFO:teuthology.orchestra.run.smithi090.stdout: "segexd": 0, 2024-09-19T06:25:30.666 INFO:teuthology.orchestra.run.smithi090.stdout: "expos": 4194304, 2024-09-19T06:25:30.666 INFO:teuthology.orchestra.run.smithi090.stdout: "wrpos": 4196989, 2024-09-19T06:25:30.666 INFO:teuthology.orchestra.run.smithi090.stdout: "rdpos": 0, 2024-09-19T06:25:30.667 INFO:teuthology.orchestra.run.smithi090.stdout: "jlat": { 2024-09-19T06:25:30.667 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 8, 2024-09-19T06:25:30.667 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.010955284, 2024-09-19T06:25:30.667 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.001369410 2024-09-19T06:25:30.667 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.667 INFO:teuthology.orchestra.run.smithi090.stdout: "replayed": 0 2024-09-19T06:25:30.667 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.667 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_mem": { 2024-09-19T06:25:30.667 INFO:teuthology.orchestra.run.smithi090.stdout: "ino": 20, 2024-09-19T06:25:30.667 INFO:teuthology.orchestra.run.smithi090.stdout: "ino+": 21, 2024-09-19T06:25:30.667 INFO:teuthology.orchestra.run.smithi090.stdout: "ino-": 1, 2024-09-19T06:25:30.667 INFO:teuthology.orchestra.run.smithi090.stdout: "dir": 19, 2024-09-19T06:25:30.667 INFO:teuthology.orchestra.run.smithi090.stdout: "dir+": 22, 2024-09-19T06:25:30.667 INFO:teuthology.orchestra.run.smithi090.stdout: "dir-": 3, 2024-09-19T06:25:30.668 INFO:teuthology.orchestra.run.smithi090.stdout: "dn": 16, 2024-09-19T06:25:30.668 INFO:teuthology.orchestra.run.smithi090.stdout: "dn+": 18, 2024-09-19T06:25:30.668 INFO:teuthology.orchestra.run.smithi090.stdout: "dn-": 2, 2024-09-19T06:25:30.668 INFO:teuthology.orchestra.run.smithi090.stdout: "cap": 3, 2024-09-19T06:25:30.668 INFO:teuthology.orchestra.run.smithi090.stdout: "cap+": 6, 2024-09-19T06:25:30.668 INFO:teuthology.orchestra.run.smithi090.stdout: "cap-": 3, 2024-09-19T06:25:30.668 INFO:teuthology.orchestra.run.smithi090.stdout: "rss": 50456, 2024-09-19T06:25:30.668 INFO:teuthology.orchestra.run.smithi090.stdout: "heap": 223520 2024-09-19T06:25:30.668 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.668 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_server": { 2024-09-19T06:25:30.668 INFO:teuthology.orchestra.run.smithi090.stdout: "dispatch_client_request": 11, 2024-09-19T06:25:30.668 INFO:teuthology.orchestra.run.smithi090.stdout: "dispatch_server_request": 0, 2024-09-19T06:25:30.669 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_client_request": 8, 2024-09-19T06:25:30.669 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_client_session": 21, 2024-09-19T06:25:30.669 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_peer_request": 1, 2024-09-19T06:25:30.669 INFO:teuthology.orchestra.run.smithi090.stdout: "req_create_latency": { 2024-09-19T06:25:30.669 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:30.669 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:30.669 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:30.669 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.669 INFO:teuthology.orchestra.run.smithi090.stdout: "req_getattr_latency": { 2024-09-19T06:25:30.669 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 4, 2024-09-19T06:25:30.669 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.001883149, 2024-09-19T06:25:30.670 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000470787 2024-09-19T06:25:30.670 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.670 INFO:teuthology.orchestra.run.smithi090.stdout: "req_getfilelock_latency": { 2024-09-19T06:25:30.670 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:30.670 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:30.670 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:30.670 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.670 INFO:teuthology.orchestra.run.smithi090.stdout: "req_link_latency": { 2024-09-19T06:25:30.670 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:30.670 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:30.670 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:30.670 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.670 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookup_latency": { 2024-09-19T06:25:30.670 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 2, 2024-09-19T06:25:30.671 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000303778, 2024-09-19T06:25:30.671 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000151889 2024-09-19T06:25:30.671 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.671 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookuphash_latency": { 2024-09-19T06:25:30.671 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:30.671 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:30.671 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:30.671 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.671 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookupino_latency": { 2024-09-19T06:25:30.671 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:30.671 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:30.671 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:30.671 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.671 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookupname_latency": { 2024-09-19T06:25:30.672 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:30.672 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:30.672 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:30.672 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.672 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookupparent_latency": { 2024-09-19T06:25:30.672 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:30.672 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:30.672 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:30.672 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.672 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookupsnap_latency": { 2024-09-19T06:25:30.672 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:30.672 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:30.672 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:30.673 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.673 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lssnap_latency": { 2024-09-19T06:25:30.673 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:30.673 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:30.673 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:30.673 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.673 INFO:teuthology.orchestra.run.smithi090.stdout: "req_mkdir_latency": { 2024-09-19T06:25:30.673 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:30.674 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:30.674 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:30.674 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.674 INFO:teuthology.orchestra.run.smithi090.stdout: "req_mknod_latency": { 2024-09-19T06:25:30.674 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:30.674 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:30.674 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:30.674 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.674 INFO:teuthology.orchestra.run.smithi090.stdout: "req_mksnap_latency": { 2024-09-19T06:25:30.674 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:30.674 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:30.675 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:30.675 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.675 INFO:teuthology.orchestra.run.smithi090.stdout: "req_open_latency": { 2024-09-19T06:25:30.675 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:30.675 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:30.675 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:30.675 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.675 INFO:teuthology.orchestra.run.smithi090.stdout: "req_readdir_latency": { 2024-09-19T06:25:30.675 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:30.675 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:30.675 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:30.675 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.675 INFO:teuthology.orchestra.run.smithi090.stdout: "req_rename_latency": { 2024-09-19T06:25:30.676 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:30.676 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:30.676 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:30.676 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.676 INFO:teuthology.orchestra.run.smithi090.stdout: "req_renamesnap_latency": { 2024-09-19T06:25:30.676 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:30.676 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:30.676 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:30.676 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.676 INFO:teuthology.orchestra.run.smithi090.stdout: "req_snapdiff_latency": { 2024-09-19T06:25:30.676 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:30.676 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:30.676 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:30.676 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.677 INFO:teuthology.orchestra.run.smithi090.stdout: "req_rmdir_latency": { 2024-09-19T06:25:30.677 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:30.677 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:30.677 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:30.677 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.677 INFO:teuthology.orchestra.run.smithi090.stdout: "req_rmsnap_latency": { 2024-09-19T06:25:30.677 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:30.677 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:30.677 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:30.677 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.677 INFO:teuthology.orchestra.run.smithi090.stdout: "req_rmxattr_latency": { 2024-09-19T06:25:30.677 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:30.677 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:30.678 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:30.678 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.678 INFO:teuthology.orchestra.run.smithi090.stdout: "req_setattr_latency": { 2024-09-19T06:25:30.678 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:30.678 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:30.678 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:30.678 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.678 INFO:teuthology.orchestra.run.smithi090.stdout: "req_setdirlayout_latency": { 2024-09-19T06:25:30.678 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:30.678 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:30.678 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:30.678 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.678 INFO:teuthology.orchestra.run.smithi090.stdout: "req_setfilelock_latency": { 2024-09-19T06:25:30.679 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:30.679 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:30.679 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:30.679 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.679 INFO:teuthology.orchestra.run.smithi090.stdout: "req_setlayout_latency": { 2024-09-19T06:25:30.679 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:30.679 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:30.679 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:30.679 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.679 INFO:teuthology.orchestra.run.smithi090.stdout: "req_setxattr_latency": { 2024-09-19T06:25:30.679 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:30.679 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:30.679 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:30.679 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.680 INFO:teuthology.orchestra.run.smithi090.stdout: "req_symlink_latency": { 2024-09-19T06:25:30.680 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:30.680 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:30.680 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:30.680 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.680 INFO:teuthology.orchestra.run.smithi090.stdout: "req_unlink_latency": { 2024-09-19T06:25:30.680 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:30.680 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:30.680 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:30.680 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.680 INFO:teuthology.orchestra.run.smithi090.stdout: "cap_revoke_eviction": 0, 2024-09-19T06:25:30.680 INFO:teuthology.orchestra.run.smithi090.stdout: "cap_acquisition_throttle": 0, 2024-09-19T06:25:30.680 INFO:teuthology.orchestra.run.smithi090.stdout: "req_getvxattr_latency": { 2024-09-19T06:25:30.681 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:30.681 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:30.681 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:30.681 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-19T06:25:30.681 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.681 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_sessions": { 2024-09-19T06:25:30.681 INFO:teuthology.orchestra.run.smithi090.stdout: "session_count": 1, 2024-09-19T06:25:30.681 INFO:teuthology.orchestra.run.smithi090.stdout: "session_add": 4, 2024-09-19T06:25:30.681 INFO:teuthology.orchestra.run.smithi090.stdout: "session_remove": 3, 2024-09-19T06:25:30.681 INFO:teuthology.orchestra.run.smithi090.stdout: "sessions_open": 1, 2024-09-19T06:25:30.681 INFO:teuthology.orchestra.run.smithi090.stdout: "sessions_stale": 0, 2024-09-19T06:25:30.681 INFO:teuthology.orchestra.run.smithi090.stdout: "total_load": 5, 2024-09-19T06:25:30.681 INFO:teuthology.orchestra.run.smithi090.stdout: "average_load": 1, 2024-09-19T06:25:30.682 INFO:teuthology.orchestra.run.smithi090.stdout: "avg_session_uptime": 642, 2024-09-19T06:25:30.682 INFO:teuthology.orchestra.run.smithi090.stdout: "mdthresh_evicted": 0 2024-09-19T06:25:30.682 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.682 INFO:teuthology.orchestra.run.smithi090.stdout: "mempool": { 2024-09-19T06:25:30.682 INFO:teuthology.orchestra.run.smithi090.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:25:30.682 INFO:teuthology.orchestra.run.smithi090.stdout: "bloom_filter_items": 0, 2024-09-19T06:25:30.682 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:25:30.682 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:25:30.682 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:25:30.682 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:25:30.682 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:25:30.682 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:25:30.682 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:25:30.682 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:25:30.683 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:25:30.683 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:25:30.683 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:25:30.683 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:25:30.683 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:25:30.683 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_extent_items": 0, 2024-09-19T06:25:30.683 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:25:30.683 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_blob_items": 0, 2024-09-19T06:25:30.683 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:25:30.683 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:25:30.684 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:25:30.684 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:25:30.684 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:25:30.684 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:25:30.684 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:25:30.684 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_txc_items": 0, 2024-09-19T06:25:30.684 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:25:30.684 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:25:30.684 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:25:30.684 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_items": 0, 2024-09-19T06:25:30.684 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_bytes": 0, 2024-09-19T06:25:30.684 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_items": 0, 2024-09-19T06:25:30.684 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:25:30.685 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:25:30.685 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:25:30.685 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:25:30.685 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_anon_bytes": 247708, 2024-09-19T06:25:30.685 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_anon_items": 87, 2024-09-19T06:25:30.685 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_meta_bytes": 88, 2024-09-19T06:25:30.685 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_meta_items": 1, 2024-09-19T06:25:30.685 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_bytes": 0, 2024-09-19T06:25:30.685 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_items": 0, 2024-09-19T06:25:30.685 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:25:30.685 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_mapbl_items": 0, 2024-09-19T06:25:30.685 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:25:30.685 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_pglog_items": 0, 2024-09-19T06:25:30.686 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_bytes": 8136, 2024-09-19T06:25:30.686 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_items": 180, 2024-09-19T06:25:30.686 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:25:30.686 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:25:30.686 INFO:teuthology.orchestra.run.smithi090.stdout: "pgmap_bytes": 0, 2024-09-19T06:25:30.686 INFO:teuthology.orchestra.run.smithi090.stdout: "pgmap_items": 0, 2024-09-19T06:25:30.686 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_co_bytes": 86117, 2024-09-19T06:25:30.686 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_co_items": 346, 2024-09-19T06:25:30.686 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_1_bytes": 0, 2024-09-19T06:25:30.686 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_1_items": 0, 2024-09-19T06:25:30.686 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_2_bytes": 0, 2024-09-19T06:25:30.686 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_2_items": 0 2024-09-19T06:25:30.686 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.686 INFO:teuthology.orchestra.run.smithi090.stdout: "objecter": { 2024-09-19T06:25:30.687 INFO:teuthology.orchestra.run.smithi090.stdout: "op_active": 0, 2024-09-19T06:25:30.687 INFO:teuthology.orchestra.run.smithi090.stdout: "op_laggy": 0, 2024-09-19T06:25:30.687 INFO:teuthology.orchestra.run.smithi090.stdout: "op_send": 45, 2024-09-19T06:25:30.687 INFO:teuthology.orchestra.run.smithi090.stdout: "op_send_bytes": 13146, 2024-09-19T06:25:30.687 INFO:teuthology.orchestra.run.smithi090.stdout: "op_resend": 30, 2024-09-19T06:25:30.687 INFO:teuthology.orchestra.run.smithi090.stdout: "op_reply": 45, 2024-09-19T06:25:30.687 INFO:teuthology.orchestra.run.smithi090.stdout: "op_latency": { 2024-09-19T06:25:30.687 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 45, 2024-09-19T06:25:30.687 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.216996461, 2024-09-19T06:25:30.687 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.004822143 2024-09-19T06:25:30.687 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.687 INFO:teuthology.orchestra.run.smithi090.stdout: "op_inflight": 0, 2024-09-19T06:25:30.687 INFO:teuthology.orchestra.run.smithi090.stdout: "oplen_avg": { 2024-09-19T06:25:30.687 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 45, 2024-09-19T06:25:30.688 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 68 2024-09-19T06:25:30.688 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.688 INFO:teuthology.orchestra.run.smithi090.stdout: "op": 45, 2024-09-19T06:25:30.688 INFO:teuthology.orchestra.run.smithi090.stdout: "op_r": 0, 2024-09-19T06:25:30.688 INFO:teuthology.orchestra.run.smithi090.stdout: "op_w": 45, 2024-09-19T06:25:30.688 INFO:teuthology.orchestra.run.smithi090.stdout: "op_rmw": 0, 2024-09-19T06:25:30.688 INFO:teuthology.orchestra.run.smithi090.stdout: "op_pg": 0, 2024-09-19T06:25:30.688 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_stat": 0, 2024-09-19T06:25:30.688 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_create": 10, 2024-09-19T06:25:30.688 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_read": 0, 2024-09-19T06:25:30.688 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_write": 8, 2024-09-19T06:25:30.688 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_writefull": 7, 2024-09-19T06:25:30.688 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_writesame": 0, 2024-09-19T06:25:30.689 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_append": 0, 2024-09-19T06:25:30.689 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_zero": 0, 2024-09-19T06:25:30.689 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_truncate": 0, 2024-09-19T06:25:30.689 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_delete": 6, 2024-09-19T06:25:30.689 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_mapext": 0, 2024-09-19T06:25:30.689 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_sparse_read": 0, 2024-09-19T06:25:30.689 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_clonerange": 0, 2024-09-19T06:25:30.689 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_getxattr": 0, 2024-09-19T06:25:30.689 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_setxattr": 20, 2024-09-19T06:25:30.689 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_cmpxattr": 0, 2024-09-19T06:25:30.689 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_rmxattr": 0, 2024-09-19T06:25:30.689 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_resetxattrs": 0, 2024-09-19T06:25:30.689 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_call": 0, 2024-09-19T06:25:30.689 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_watch": 0, 2024-09-19T06:25:30.690 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_notify": 0, 2024-09-19T06:25:30.690 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T06:25:30.690 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_pgls": 0, 2024-09-19T06:25:30.690 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_pgls_filter": 0, 2024-09-19T06:25:30.690 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_other": 0, 2024-09-19T06:25:30.690 INFO:teuthology.orchestra.run.smithi090.stdout: "linger_active": 0, 2024-09-19T06:25:30.690 INFO:teuthology.orchestra.run.smithi090.stdout: "linger_send": 0, 2024-09-19T06:25:30.690 INFO:teuthology.orchestra.run.smithi090.stdout: "linger_resend": 0, 2024-09-19T06:25:30.690 INFO:teuthology.orchestra.run.smithi090.stdout: "linger_ping": 0, 2024-09-19T06:25:30.690 INFO:teuthology.orchestra.run.smithi090.stdout: "poolop_active": 0, 2024-09-19T06:25:30.690 INFO:teuthology.orchestra.run.smithi090.stdout: "poolop_send": 0, 2024-09-19T06:25:30.690 INFO:teuthology.orchestra.run.smithi090.stdout: "poolop_resend": 0, 2024-09-19T06:25:30.690 INFO:teuthology.orchestra.run.smithi090.stdout: "poolstat_active": 0, 2024-09-19T06:25:30.690 INFO:teuthology.orchestra.run.smithi090.stdout: "poolstat_send": 0, 2024-09-19T06:25:30.691 INFO:teuthology.orchestra.run.smithi090.stdout: "poolstat_resend": 0, 2024-09-19T06:25:30.691 INFO:teuthology.orchestra.run.smithi090.stdout: "statfs_active": 0, 2024-09-19T06:25:30.691 INFO:teuthology.orchestra.run.smithi090.stdout: "statfs_send": 0, 2024-09-19T06:25:30.691 INFO:teuthology.orchestra.run.smithi090.stdout: "statfs_resend": 0, 2024-09-19T06:25:30.691 INFO:teuthology.orchestra.run.smithi090.stdout: "command_active": 0, 2024-09-19T06:25:30.691 INFO:teuthology.orchestra.run.smithi090.stdout: "command_send": 0, 2024-09-19T06:25:30.691 INFO:teuthology.orchestra.run.smithi090.stdout: "command_resend": 0, 2024-09-19T06:25:30.691 INFO:teuthology.orchestra.run.smithi090.stdout: "map_epoch": 92, 2024-09-19T06:25:30.691 INFO:teuthology.orchestra.run.smithi090.stdout: "map_full": 0, 2024-09-19T06:25:30.691 INFO:teuthology.orchestra.run.smithi090.stdout: "map_inc": 13, 2024-09-19T06:25:30.691 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_sessions": 9, 2024-09-19T06:25:30.691 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_session_open": 9, 2024-09-19T06:25:30.691 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_session_close": 0, 2024-09-19T06:25:30.691 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_laggy": 0, 2024-09-19T06:25:30.692 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_wr": 16, 2024-09-19T06:25:30.692 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_rd": 0, 2024-09-19T06:25:30.692 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_del": 1 2024-09-19T06:25:30.692 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.692 INFO:teuthology.orchestra.run.smithi090.stdout: "oft": { 2024-09-19T06:25:30.692 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_total_objs": 1, 2024-09-19T06:25:30.692 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_total_kv_pairs": 0, 2024-09-19T06:25:30.692 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_total_updates": 0, 2024-09-19T06:25:30.692 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_total_removes": 0 2024-09-19T06:25:30.692 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.692 INFO:teuthology.orchestra.run.smithi090.stdout: "osd-slow-ops": { 2024-09-19T06:25:30.692 INFO:teuthology.orchestra.run.smithi090.stdout: "slow_ops_count": 0 2024-09-19T06:25:30.692 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.693 INFO:teuthology.orchestra.run.smithi090.stdout: "purge_queue": { 2024-09-19T06:25:30.693 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executing_ops": 0, 2024-09-19T06:25:30.693 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T06:25:30.693 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executing": 0, 2024-09-19T06:25:30.693 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executing_high_water": 0, 2024-09-19T06:25:30.693 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executed_ops": 0, 2024-09-19T06:25:30.693 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executed": 0, 2024-09-19T06:25:30.693 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_item_in_journal": 0 2024-09-19T06:25:30.693 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.693 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:25:30.693 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-09-19T06:25:30.693 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 104857600, 2024-09-19T06:25:30.693 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-09-19T06:25:30.693 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 911, 2024-09-19T06:25:30.694 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 1567591, 2024-09-19T06:25:30.694 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:30.694 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 911, 2024-09-19T06:25:30.694 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 0, 2024-09-19T06:25:30.694 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 0, 2024-09-19T06:25:30.694 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 911, 2024-09-19T06:25:30.694 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 1567591, 2024-09-19T06:25:30.694 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-09-19T06:25:30.694 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:30.694 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:30.694 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:30.694 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-19T06:25:30.694 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.694 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-objecter_bytes": { 2024-09-19T06:25:30.695 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-09-19T06:25:30.695 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 104857600, 2024-09-19T06:25:30.695 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-09-19T06:25:30.695 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 0, 2024-09-19T06:25:30.695 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 0, 2024-09-19T06:25:30.695 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:30.695 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 0, 2024-09-19T06:25:30.695 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 45, 2024-09-19T06:25:30.695 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 13146, 2024-09-19T06:25:30.695 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 45, 2024-09-19T06:25:30.695 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 13146, 2024-09-19T06:25:30.695 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-09-19T06:25:30.695 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:30.696 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:30.696 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:30.696 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-19T06:25:30.696 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.696 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-objecter_ops": { 2024-09-19T06:25:30.696 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-09-19T06:25:30.696 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 1024, 2024-09-19T06:25:30.696 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-09-19T06:25:30.696 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 0, 2024-09-19T06:25:30.696 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 0, 2024-09-19T06:25:30.696 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:30.696 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 0, 2024-09-19T06:25:30.696 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 45, 2024-09-19T06:25:30.697 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 45, 2024-09-19T06:25:30.697 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 45, 2024-09-19T06:25:30.697 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 45, 2024-09-19T06:25:30.697 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-09-19T06:25:30.697 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:30.697 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:30.697 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:30.697 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-19T06:25:30.697 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.698 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-write_buf_throttle": { 2024-09-19T06:25:30.698 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-09-19T06:25:30.698 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 3758096384, 2024-09-19T06:25:30.698 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-09-19T06:25:30.698 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 0, 2024-09-19T06:25:30.698 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 0, 2024-09-19T06:25:30.698 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:30.698 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 0, 2024-09-19T06:25:30.698 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 0, 2024-09-19T06:25:30.698 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 0, 2024-09-19T06:25:30.698 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 0, 2024-09-19T06:25:30.698 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 0, 2024-09-19T06:25:30.698 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-09-19T06:25:30.698 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:30.699 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:30.699 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:30.699 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-19T06:25:30.699 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:30.699 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-write_buf_throttle-0x565325e16500": { 2024-09-19T06:25:30.699 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-09-19T06:25:30.699 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 3758096384, 2024-09-19T06:25:30.699 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-09-19T06:25:30.699 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 9, 2024-09-19T06:25:30.699 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 2685, 2024-09-19T06:25:30.699 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:30.699 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 9, 2024-09-19T06:25:30.699 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 0, 2024-09-19T06:25:30.699 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 0, 2024-09-19T06:25:30.700 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 8, 2024-09-19T06:25:30.700 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 2685, 2024-09-19T06:25:30.700 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-09-19T06:25:30.700 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:30.700 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:30.700 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:30.700 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-19T06:25:30.700 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-19T06:25:30.700 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-19T06:25:31.489 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:31 smithi090 ceph-mon[34497]: pgmap v334: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:25:31.557 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-09-19T06:25:31.557 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-09-19T06:25:31.557 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=0 2024-09-19T06:25:31.557 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=11 2024-09-19T06:25:31.557 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-09-19T06:25:31.557 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-09-19T06:25:31.557 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T06:25:31.557 DEBUG:tasks.check_counter:Getting stats from l 2024-09-19T06:25:31.558 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-19T06:25:31.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:31 smithi002 ceph-mon[30982]: pgmap v334: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:25:31.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:31 smithi089 ceph-mon[34160]: pgmap v334: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:25:31.801 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:25:32.266 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-19T06:25:32.266 INFO:teuthology.orchestra.run.smithi090.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:25:32.266 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_messages": 0, 2024-09-19T06:25:32.267 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages": 2, 2024-09-19T06:25:32.267 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_bytes": 0, 2024-09-19T06:25:32.267 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_bytes": 0, 2024-09-19T06:25:32.267 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_created_connections": 4, 2024-09-19T06:25:32.267 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_active_connections": 0, 2024-09-19T06:25:32.267 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_total_time": 0.000968059, 2024-09-19T06:25:32.267 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T06:25:32.267 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_recv_time": 0.000203116, 2024-09-19T06:25:32.267 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:25:32.267 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:25:32.267 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:32.267 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:32.267 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:32.268 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:32.268 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:25:32.268 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:32.268 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:32.268 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:32.268 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:32.268 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T06:25:32.268 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T06:25:32.268 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:32.268 INFO:teuthology.orchestra.run.smithi090.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:25:32.268 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_messages": 226, 2024-09-19T06:25:32.268 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages": 214, 2024-09-19T06:25:32.268 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_bytes": 1451536, 2024-09-19T06:25:32.269 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_bytes": 130912, 2024-09-19T06:25:32.269 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_created_connections": 2, 2024-09-19T06:25:32.269 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_active_connections": 1, 2024-09-19T06:25:32.269 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_total_time": 0.043907615, 2024-09-19T06:25:32.269 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_send_time": 0.015072752, 2024-09-19T06:25:32.269 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_recv_time": 0.042365724, 2024-09-19T06:25:32.269 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:25:32.269 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:25:32.269 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 214, 2024-09-19T06:25:32.269 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.017754298, 2024-09-19T06:25:32.269 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000082964 2024-09-19T06:25:32.269 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:32.269 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:25:32.270 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:32.270 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:32.270 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:32.270 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:32.270 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_encrypted_bytes": 1451536, 2024-09-19T06:25:32.270 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_encrypted_bytes": 130912 2024-09-19T06:25:32.270 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:32.270 INFO:teuthology.orchestra.run.smithi090.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:25:32.270 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_messages": 2, 2024-09-19T06:25:32.270 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages": 163, 2024-09-19T06:25:32.270 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_bytes": 320, 2024-09-19T06:25:32.270 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_bytes": 185920, 2024-09-19T06:25:32.270 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_created_connections": 5, 2024-09-19T06:25:32.271 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_active_connections": 3, 2024-09-19T06:25:32.271 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_total_time": 0.010968927, 2024-09-19T06:25:32.271 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_send_time": 0.007301475, 2024-09-19T06:25:32.271 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_recv_time": 0.001491798, 2024-09-19T06:25:32.271 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:25:32.271 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:25:32.271 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 160, 2024-09-19T06:25:32.271 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.022115681, 2024-09-19T06:25:32.271 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000138223 2024-09-19T06:25:32.271 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:32.271 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:25:32.272 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:32.272 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:32.272 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:32.272 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:32.272 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T06:25:32.272 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_encrypted_bytes": 185920 2024-09-19T06:25:32.272 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:32.272 INFO:teuthology.orchestra.run.smithi090.stdout: "cct": { 2024-09-19T06:25:32.272 INFO:teuthology.orchestra.run.smithi090.stdout: "total_workers": 0, 2024-09-19T06:25:32.272 INFO:teuthology.orchestra.run.smithi090.stdout: "unhealthy_workers": 0 2024-09-19T06:25:32.272 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:32.273 INFO:teuthology.orchestra.run.smithi090.stdout: "mempool": { 2024-09-19T06:25:32.273 INFO:teuthology.orchestra.run.smithi090.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:25:32.273 INFO:teuthology.orchestra.run.smithi090.stdout: "bloom_filter_items": 0, 2024-09-19T06:25:32.273 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:25:32.273 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:25:32.273 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:25:32.273 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:25:32.273 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:25:32.273 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:25:32.273 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:25:32.273 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:25:32.273 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:25:32.273 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:25:32.273 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:25:32.274 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:25:32.274 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:25:32.274 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_extent_items": 0, 2024-09-19T06:25:32.274 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:25:32.274 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_blob_items": 0, 2024-09-19T06:25:32.274 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:25:32.274 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:25:32.274 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:25:32.274 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:25:32.274 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:25:32.274 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:25:32.274 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:25:32.275 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_txc_items": 0, 2024-09-19T06:25:32.275 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:25:32.275 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:25:32.275 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:25:32.275 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_items": 0, 2024-09-19T06:25:32.275 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_bytes": 0, 2024-09-19T06:25:32.275 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_items": 0, 2024-09-19T06:25:32.275 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:25:32.275 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:25:32.275 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:25:32.275 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:25:32.275 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_anon_bytes": 149057, 2024-09-19T06:25:32.275 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_anon_items": 32, 2024-09-19T06:25:32.275 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:25:32.276 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_meta_items": 0, 2024-09-19T06:25:32.276 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_bytes": 0, 2024-09-19T06:25:32.276 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_items": 0, 2024-09-19T06:25:32.276 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:25:32.276 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_mapbl_items": 0, 2024-09-19T06:25:32.276 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:25:32.276 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_pglog_items": 0, 2024-09-19T06:25:32.276 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_bytes": 0, 2024-09-19T06:25:32.276 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_items": 0, 2024-09-19T06:25:32.276 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:25:32.276 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:25:32.276 INFO:teuthology.orchestra.run.smithi090.stdout: "pgmap_bytes": 0, 2024-09-19T06:25:32.276 INFO:teuthology.orchestra.run.smithi090.stdout: "pgmap_items": 0, 2024-09-19T06:25:32.277 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_co_bytes": 928, 2024-09-19T06:25:32.277 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_co_items": 2, 2024-09-19T06:25:32.277 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_1_bytes": 0, 2024-09-19T06:25:32.277 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_1_items": 0, 2024-09-19T06:25:32.277 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_2_bytes": 0, 2024-09-19T06:25:32.277 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_2_items": 0 2024-09-19T06:25:32.277 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-19T06:25:32.277 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:25:32.277 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-09-19T06:25:32.277 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 104857600, 2024-09-19T06:25:32.277 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-09-19T06:25:32.277 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 224, 2024-09-19T06:25:32.277 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 1417170, 2024-09-19T06:25:32.278 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:32.278 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 224, 2024-09-19T06:25:32.278 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 0, 2024-09-19T06:25:32.278 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 0, 2024-09-19T06:25:32.278 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 224, 2024-09-19T06:25:32.278 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 1417170, 2024-09-19T06:25:32.278 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-09-19T06:25:32.278 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-19T06:25:32.278 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-19T06:25:32.278 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-19T06:25:32.278 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-19T06:25:32.278 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-19T06:25:32.278 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-19T06:25:33.196 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-09-19T06:25:33.196 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-09-19T06:25:33.196 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2024-09-19T06:25:33.196 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2024-09-19T06:25:33.196 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-09-19T06:25:33.196 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-09-19T06:25:33.196 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-09-19T06:25:33.196 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-19T06:25:33.206 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-19T06:25:33.207 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-19T06:25:33.207 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T06:25:33.230 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-19T06:25:33.230 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T06:25:33.292 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T06:25:33.489 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:33 smithi090 ceph-mon[34497]: pgmap v335: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:25:33.601 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:25:33.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:33 smithi002 ceph-mon[30982]: pgmap v335: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:25:33.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:33 smithi089 ceph-mon[34160]: pgmap v335: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:25:34.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.055+0000 7f8d9a591640 1 -- 172.21.15.2:0/664254978 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d94102d30 msgr2=0x7f8d94103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:34.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.055+0000 7f8d9a591640 1 --2- 172.21.15.2:0/664254978 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d94102d30 0x7f8d94103110 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f8d84009930 tx=0x7f8d8402a420 comp rx=0 tx=0).stop 2024-09-19T06:25:34.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.055+0000 7f8d9a591640 1 -- 172.21.15.2:0/664254978 shutdown_connections 2024-09-19T06:25:34.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.055+0000 7f8d9a591640 1 --2- 172.21.15.2:0/664254978 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d941082a0 0x7f8d9410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:34.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.055+0000 7f8d9a591640 1 --2- 172.21.15.2:0/664254978 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d941036e0 0x7f8d94107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:34.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.055+0000 7f8d9a591640 1 --2- 172.21.15.2:0/664254978 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d94102d30 0x7f8d94103110 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:34.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.055+0000 7f8d9a591640 1 -- 172.21.15.2:0/664254978 >> 172.21.15.2:0/664254978 conn(0x7f8d940fc7d0 msgr2=0x7f8d940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:34.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.055+0000 7f8d9a591640 1 -- 172.21.15.2:0/664254978 shutdown_connections 2024-09-19T06:25:34.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.055+0000 7f8d9a591640 1 -- 172.21.15.2:0/664254978 wait complete. 2024-09-19T06:25:34.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.055+0000 7f8d9a591640 1 Processor -- start 2024-09-19T06:25:34.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.056+0000 7f8d9a591640 1 -- start start 2024-09-19T06:25:34.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.056+0000 7f8d9a591640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d94102d30 0x7f8d94100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:34.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.056+0000 7f8d9a591640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d941036e0 0x7f8d94100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:34.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.056+0000 7f8d9a591640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d941082a0 0x7f8d94101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:34.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.056+0000 7f8d9a591640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8d94111f50 con 0x7f8d941082a0 2024-09-19T06:25:34.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.056+0000 7f8d9a591640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8d94111dd0 con 0x7f8d94102d30 2024-09-19T06:25:34.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.056+0000 7f8d9a591640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8d941120d0 con 0x7f8d941036e0 2024-09-19T06:25:34.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.056+0000 7f8d98b2e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d941082a0 0x7f8d94101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:34.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.056+0000 7f8d98b2e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d941082a0 0x7f8d94101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48322/0 (socket says 172.21.15.2:48322) 2024-09-19T06:25:34.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.056+0000 7f8d98b2e640 1 -- 172.21.15.2:0/2346920891 learned_addr learned my addr 172.21.15.2:0/2346920891 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:25:34.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.056+0000 7f8d93fff640 1 --2- 172.21.15.2:0/2346920891 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d94102d30 0x7f8d94100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:34.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.056+0000 7f8d937fe640 1 --2- 172.21.15.2:0/2346920891 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d941036e0 0x7f8d94100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:34.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.056+0000 7f8d98b2e640 1 -- 172.21.15.2:0/2346920891 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d941036e0 msgr2=0x7f8d94100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:34.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.056+0000 7f8d98b2e640 1 --2- 172.21.15.2:0/2346920891 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d941036e0 0x7f8d94100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:34.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.056+0000 7f8d98b2e640 1 -- 172.21.15.2:0/2346920891 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d94102d30 msgr2=0x7f8d94100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:34.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.056+0000 7f8d98b2e640 1 --2- 172.21.15.2:0/2346920891 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d94102d30 0x7f8d94100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:34.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.056+0000 7f8d98b2e640 1 -- 172.21.15.2:0/2346920891 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d941a69b0 con 0x7f8d941082a0 2024-09-19T06:25:34.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.057+0000 7f8d98b2e640 1 --2- 172.21.15.2:0/2346920891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d941082a0 0x7f8d94101410 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c00eaa0 tx=0x7f8d8c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:34.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.057+0000 7f8d917fa640 1 -- 172.21.15.2:0/2346920891 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c00cdb0 con 0x7f8d941082a0 2024-09-19T06:25:34.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.057+0000 7f8d9a591640 1 -- 172.21.15.2:0/2346920891 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d941a6ca0 con 0x7f8d941082a0 2024-09-19T06:25:34.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.057+0000 7f8d917fa640 1 -- 172.21.15.2:0/2346920891 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8d8c005020 con 0x7f8d941082a0 2024-09-19T06:25:34.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.057+0000 7f8d917fa640 1 -- 172.21.15.2:0/2346920891 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c0116d0 con 0x7f8d941082a0 2024-09-19T06:25:34.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.057+0000 7f8d9a591640 1 -- 172.21.15.2:0/2346920891 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d941a7190 con 0x7f8d941082a0 2024-09-19T06:25:34.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.058+0000 7f8d9a591640 1 -- 172.21.15.2:0/2346920891 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d9406a850 con 0x7f8d941082a0 2024-09-19T06:25:34.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.059+0000 7f8d917fa640 1 -- 172.21.15.2:0/2346920891 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f8d8c0051d0 con 0x7f8d941082a0 2024-09-19T06:25:34.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.060+0000 7f8d917fa640 1 --2- 172.21.15.2:0/2346920891 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f8d7c0a33b0 0x7f8d7c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:34.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.060+0000 7f8d93fff640 1 --2- 172.21.15.2:0/2346920891 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f8d7c0a33b0 0x7f8d7c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:34.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.060+0000 7f8d917fa640 1 -- 172.21.15.2:0/2346920891 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8521+0+0 (secure 0 0 0) 0x7f8d8c0cfe60 con 0x7f8d941082a0 2024-09-19T06:25:34.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.060+0000 7f8d93fff640 1 --2- 172.21.15.2:0/2346920891 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f8d7c0a33b0 0x7f8d7c0a5870 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8d84009900 tx=0x7f8d84000bc0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:34.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.064+0000 7f8d917fa640 1 -- 172.21.15.2:0/2346920891 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8d8c016030 con 0x7f8d941082a0 2024-09-19T06:25:34.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.252+0000 7f8d9a591640 1 -- 172.21.15.2:0/2346920891 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8d9410a2b0 con 0x7f8d941082a0 2024-09-19T06:25:34.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.253+0000 7f8d917fa640 1 -- 172.21.15.2:0/2346920891 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v92) ==== 81+0+929 (secure 0 0 0) 0x7f8d8c09c190 con 0x7f8d941082a0 2024-09-19T06:25:34.255 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3813883133 2024-09-20T06:14:48.099112+0000 2024-09-19T06:25:34.255 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2612001712 2024-09-20T06:14:48.099112+0000 2024-09-19T06:25:34.255 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2508383651 2024-09-20T06:14:48.099112+0000 2024-09-19T06:25:34.256 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3763089457 2024-09-20T06:05:47.538477+0000 2024-09-19T06:25:34.256 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1361067708 2024-09-20T06:05:47.538477+0000 2024-09-19T06:25:34.256 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/1200011821 2024-09-20T06:06:11.912585+0000 2024-09-19T06:25:34.256 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3899165140 2024-09-20T06:05:47.538477+0000 2024-09-19T06:25:34.256 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/1200011821 2024-09-20T06:06:11.912585+0000 2024-09-19T06:25:34.256 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/1602650352 2024-09-20T06:05:47.538477+0000 2024-09-19T06:25:34.257 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2976372536 2024-09-20T06:06:11.912585+0000 2024-09-19T06:25:34.257 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1280963020 2024-09-20T06:06:11.912585+0000 2024-09-19T06:25:34.257 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/4180340554 2024-09-20T06:14:48.099112+0000 2024-09-19T06:25:34.257 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/1602650352 2024-09-20T06:05:47.538477+0000 2024-09-19T06:25:34.257 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/874985787 2024-09-20T06:06:11.912585+0000 2024-09-19T06:25:34.257 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/4180340554 2024-09-20T06:14:48.099112+0000 2024-09-19T06:25:34.258 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2134106196 2024-09-20T06:14:48.099112+0000 2024-09-19T06:25:34.259 INFO:teuthology.orchestra.run.smithi002.stderr:listed 16 entries 2024-09-19T06:25:34.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.255+0000 7f8d9a591640 1 -- 172.21.15.2:0/2346920891 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f8d7c0a33b0 msgr2=0x7f8d7c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:34.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.255+0000 7f8d9a591640 1 --2- 172.21.15.2:0/2346920891 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f8d7c0a33b0 0x7f8d7c0a5870 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8d84009900 tx=0x7f8d84000bc0 comp rx=0 tx=0).stop 2024-09-19T06:25:34.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.255+0000 7f8d9a591640 1 -- 172.21.15.2:0/2346920891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d941082a0 msgr2=0x7f8d94101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:34.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.255+0000 7f8d9a591640 1 --2- 172.21.15.2:0/2346920891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d941082a0 0x7f8d94101410 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c00eaa0 tx=0x7f8d8c00ef60 comp rx=0 tx=0).stop 2024-09-19T06:25:34.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.255+0000 7f8d9a591640 1 -- 172.21.15.2:0/2346920891 shutdown_connections 2024-09-19T06:25:34.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.255+0000 7f8d9a591640 1 --2- 172.21.15.2:0/2346920891 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f8d7c0a33b0 0x7f8d7c0a5870 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:34.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.255+0000 7f8d9a591640 1 --2- 172.21.15.2:0/2346920891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d941082a0 0x7f8d94101410 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:34.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.255+0000 7f8d9a591640 1 --2- 172.21.15.2:0/2346920891 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d941036e0 0x7f8d94100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:34.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.255+0000 7f8d9a591640 1 --2- 172.21.15.2:0/2346920891 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d94102d30 0x7f8d94100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:34.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.255+0000 7f8d9a591640 1 -- 172.21.15.2:0/2346920891 >> 172.21.15.2:0/2346920891 conn(0x7f8d940fc7d0 msgr2=0x7f8d94105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:34.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.255+0000 7f8d9a591640 1 -- 172.21.15.2:0/2346920891 shutdown_connections 2024-09-19T06:25:34.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:34.255+0000 7f8d9a591640 1 -- 172.21.15.2:0/2346920891 wait complete. 2024-09-19T06:25:34.586 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:34 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/2346920891' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T06:25:34.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:34 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/2346920891' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T06:25:34.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:34 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/2346920891' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T06:25:34.979 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-19T06:25:34.980 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T06:25:34.998 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T06:25:35.300 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:25:35.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:35 smithi002 ceph-mon[30982]: pgmap v336: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:25:35.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:35 smithi090 ceph-mon[34497]: pgmap v336: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:25:35.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.729+0000 7f6847cb3640 1 -- 172.21.15.2:0/349312160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6840103660 msgr2=0x7f684010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:35.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.729+0000 7f6847cb3640 1 --2- 172.21.15.2:0/349312160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6840103660 0x7f684010bb50 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f6830009900 tx=0x7f683002a480 comp rx=0 tx=0).stop 2024-09-19T06:25:35.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.729+0000 7f6847cb3640 1 -- 172.21.15.2:0/349312160 shutdown_connections 2024-09-19T06:25:35.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.729+0000 7f6847cb3640 1 --2- 172.21.15.2:0/349312160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f684010c170 0x7f684010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:35.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.729+0000 7f6847cb3640 1 --2- 172.21.15.2:0/349312160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6840103660 0x7f684010bb50 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:35.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.729+0000 7f6847cb3640 1 --2- 172.21.15.2:0/349312160 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6840102d40 0x7f6840103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:35.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.729+0000 7f6847cb3640 1 -- 172.21.15.2:0/349312160 >> 172.21.15.2:0/349312160 conn(0x7f68400fc7a0 msgr2=0x7f68400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:35.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.729+0000 7f6847cb3640 1 -- 172.21.15.2:0/349312160 shutdown_connections 2024-09-19T06:25:35.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.729+0000 7f6847cb3640 1 -- 172.21.15.2:0/349312160 wait complete. 2024-09-19T06:25:35.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.730+0000 7f6847cb3640 1 Processor -- start 2024-09-19T06:25:35.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.730+0000 7f6847cb3640 1 -- start start 2024-09-19T06:25:35.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.730+0000 7f6847cb3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6840102d40 0x7f68401983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:35.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.730+0000 7f6847cb3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6840103660 0x7f6840198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:35.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.730+0000 7f6847cb3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f684010c170 0x7f684019cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:35.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.730+0000 7f6847cb3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6840111ed0 con 0x7f684010c170 2024-09-19T06:25:35.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.730+0000 7f6847cb3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6840111d50 con 0x7f6840102d40 2024-09-19T06:25:35.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.730+0000 7f6847cb3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6840112050 con 0x7f6840103660 2024-09-19T06:25:35.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.730+0000 7f6846250640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f684010c170 0x7f684019cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:35.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.730+0000 7f6846250640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f684010c170 0x7f684019cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51620/0 (socket says 172.21.15.2:51620) 2024-09-19T06:25:35.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.730+0000 7f6846250640 1 -- 172.21.15.2:0/1438408310 learned_addr learned my addr 172.21.15.2:0/1438408310 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:25:35.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.730+0000 7f684524e640 1 --2- 172.21.15.2:0/1438408310 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6840103660 0x7f6840198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:35.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.730+0000 7f6845a4f640 1 --2- 172.21.15.2:0/1438408310 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6840102d40 0x7f68401983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:35.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.730+0000 7f6846250640 1 -- 172.21.15.2:0/1438408310 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6840103660 msgr2=0x7f6840198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:35.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.730+0000 7f6846250640 1 --2- 172.21.15.2:0/1438408310 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6840103660 0x7f6840198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:35.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.730+0000 7f6846250640 1 -- 172.21.15.2:0/1438408310 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6840102d40 msgr2=0x7f68401983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:35.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.730+0000 7f6846250640 1 --2- 172.21.15.2:0/1438408310 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6840102d40 0x7f68401983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:35.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.730+0000 7f6846250640 1 -- 172.21.15.2:0/1438408310 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f684019d380 con 0x7f684010c170 2024-09-19T06:25:35.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.731+0000 7f6846250640 1 --2- 172.21.15.2:0/1438408310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f684010c170 0x7f684019cca0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f683800eaa0 tx=0x7f683800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:35.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.731+0000 7f6836ffd640 1 -- 172.21.15.2:0/1438408310 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6838004d20 con 0x7f684010c170 2024-09-19T06:25:35.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.731+0000 7f6836ffd640 1 -- 172.21.15.2:0/1438408310 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6838005020 con 0x7f684010c170 2024-09-19T06:25:35.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.731+0000 7f6847cb3640 1 -- 172.21.15.2:0/1438408310 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f684019d670 con 0x7f684010c170 2024-09-19T06:25:35.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.731+0000 7f6836ffd640 1 -- 172.21.15.2:0/1438408310 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68380116b0 con 0x7f684010c170 2024-09-19T06:25:35.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.731+0000 7f6847cb3640 1 -- 172.21.15.2:0/1438408310 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68401a4f50 con 0x7f684010c170 2024-09-19T06:25:35.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.732+0000 7f6847cb3640 1 -- 172.21.15.2:0/1438408310 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6840103120 con 0x7f684010c170 2024-09-19T06:25:35.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.733+0000 7f6836ffd640 1 -- 172.21.15.2:0/1438408310 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f68380051d0 con 0x7f684010c170 2024-09-19T06:25:35.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.734+0000 7f6836ffd640 1 --2- 172.21.15.2:0/1438408310 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f682c0a3430 0x7f682c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:35.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.734+0000 7f6845a4f640 1 --2- 172.21.15.2:0/1438408310 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f682c0a3430 0x7f682c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:35.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.734+0000 7f6836ffd640 1 -- 172.21.15.2:0/1438408310 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8521+0+0 (secure 0 0 0) 0x7f68380cfe20 con 0x7f684010c170 2024-09-19T06:25:35.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.735+0000 7f6845a4f640 1 --2- 172.21.15.2:0/1438408310 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f682c0a3430 0x7f682c0a58f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f683c009990 tx=0x7f683c009110 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:35.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.738+0000 7f6836ffd640 1 -- 172.21.15.2:0/1438408310 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6838016030 con 0x7f684010c170 2024-09-19T06:25:35.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:35 smithi089 ceph-mon[34160]: pgmap v336: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T06:25:35.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.931+0000 7f6847cb3640 1 -- 172.21.15.2:0/1438408310 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f684002d7c0 con 0x7f684010c170 2024-09-19T06:25:35.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.931+0000 7f6836ffd640 1 -- 172.21.15.2:0/1438408310 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v92) ==== 81+0+929 (secure 0 0 0) 0x7f683809c800 con 0x7f684010c170 2024-09-19T06:25:35.933 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3813883133 2024-09-20T06:14:48.099112+0000 2024-09-19T06:25:35.933 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2612001712 2024-09-20T06:14:48.099112+0000 2024-09-19T06:25:35.933 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2508383651 2024-09-20T06:14:48.099112+0000 2024-09-19T06:25:35.933 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3763089457 2024-09-20T06:05:47.538477+0000 2024-09-19T06:25:35.934 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1361067708 2024-09-20T06:05:47.538477+0000 2024-09-19T06:25:35.934 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/1200011821 2024-09-20T06:06:11.912585+0000 2024-09-19T06:25:35.934 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3899165140 2024-09-20T06:05:47.538477+0000 2024-09-19T06:25:35.934 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/1200011821 2024-09-20T06:06:11.912585+0000 2024-09-19T06:25:35.934 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/1602650352 2024-09-20T06:05:47.538477+0000 2024-09-19T06:25:35.934 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2976372536 2024-09-20T06:06:11.912585+0000 2024-09-19T06:25:35.934 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1280963020 2024-09-20T06:06:11.912585+0000 2024-09-19T06:25:35.934 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/4180340554 2024-09-20T06:14:48.099112+0000 2024-09-19T06:25:35.934 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/1602650352 2024-09-20T06:05:47.538477+0000 2024-09-19T06:25:35.934 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/874985787 2024-09-20T06:06:11.912585+0000 2024-09-19T06:25:35.934 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/4180340554 2024-09-20T06:14:48.099112+0000 2024-09-19T06:25:35.934 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2134106196 2024-09-20T06:14:48.099112+0000 2024-09-19T06:25:35.935 INFO:teuthology.orchestra.run.smithi002.stderr:listed 16 entries 2024-09-19T06:25:35.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.934+0000 7f6847cb3640 1 -- 172.21.15.2:0/1438408310 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f682c0a3430 msgr2=0x7f682c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:35.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.934+0000 7f6847cb3640 1 --2- 172.21.15.2:0/1438408310 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f682c0a3430 0x7f682c0a58f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f683c009990 tx=0x7f683c009110 comp rx=0 tx=0).stop 2024-09-19T06:25:35.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.934+0000 7f6847cb3640 1 -- 172.21.15.2:0/1438408310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f684010c170 msgr2=0x7f684019cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:35.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.934+0000 7f6847cb3640 1 --2- 172.21.15.2:0/1438408310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f684010c170 0x7f684019cca0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f683800eaa0 tx=0x7f683800eea0 comp rx=0 tx=0).stop 2024-09-19T06:25:35.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.934+0000 7f6847cb3640 1 -- 172.21.15.2:0/1438408310 shutdown_connections 2024-09-19T06:25:35.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.934+0000 7f6847cb3640 1 --2- 172.21.15.2:0/1438408310 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f682c0a3430 0x7f682c0a58f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:35.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.934+0000 7f6847cb3640 1 --2- 172.21.15.2:0/1438408310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f684010c170 0x7f684019cca0 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:35.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.934+0000 7f6847cb3640 1 --2- 172.21.15.2:0/1438408310 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6840103660 0x7f6840198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:35.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.934+0000 7f6847cb3640 1 --2- 172.21.15.2:0/1438408310 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6840102d40 0x7f68401983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:35.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.934+0000 7f6847cb3640 1 -- 172.21.15.2:0/1438408310 >> 172.21.15.2:0/1438408310 conn(0x7f68400fc7a0 msgr2=0x7f68400fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:35.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.934+0000 7f6847cb3640 1 -- 172.21.15.2:0/1438408310 shutdown_connections 2024-09-19T06:25:35.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:35.934+0000 7f6847cb3640 1 -- 172.21.15.2:0/1438408310 wait complete. 2024-09-19T06:25:36.627 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:36 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1438408310' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T06:25:36.660 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi002.front.sepia.ceph.com... 2024-09-19T06:25:36.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:25:36.660 DEBUG:teuthology.orchestra.run.smithi002:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-19T06:25:36.693 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[81726]: fuse finished with error 0 and tester_r 0 2024-09-19T06:25:36.694 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T06:25:36.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:36 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1438408310' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T06:25:36.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:36 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1438408310' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T06:25:37.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:37 smithi002 ceph-mon[30982]: pgmap v337: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:25:37.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:37 smithi090 ceph-mon[34497]: pgmap v337: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:25:37.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:37 smithi089 ceph-mon[34160]: pgmap v337: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:25:39.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:39 smithi002 ceph-mon[30982]: pgmap v338: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:25:39.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:39 smithi090 ceph-mon[34497]: pgmap v338: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:25:39.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:39 smithi089 ceph-mon[34160]: pgmap v338: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:25:41.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:41 smithi002 ceph-mon[30982]: pgmap v339: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-19T06:25:41.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:41 smithi090 ceph-mon[34497]: pgmap v339: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-19T06:25:41.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:41 smithi089 ceph-mon[34160]: pgmap v339: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-19T06:25:42.795 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2024-09-19T06:25:42.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:25:42.796 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T06:25:42.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:25:42.835 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-09-19T06:25:42.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T06:25:42.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:25:42.895 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T06:25:42.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:25:42.967 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link delete ceph-brx 2024-09-19T06:25:43.078 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-19T06:25:43.090 INFO:tasks.cephadm:Teardown begin 2024-09-19T06:25:43.091 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T06:25:43.091 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:25:43.354 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:25:43.681 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:43 smithi002 ceph-mon[30982]: pgmap v340: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-19T06:25:43.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:43 smithi090 ceph-mon[34497]: pgmap v340: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-19T06:25:43.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.764+0000 7f23dbb1b640 1 -- 172.21.15.2:0/3371079901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23d41008d0 msgr2=0x7f23d4100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:43.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.764+0000 7f23dbb1b640 1 --2- 172.21.15.2:0/3371079901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23d41008d0 0x7f23d4100cb0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f23d0009900 tx=0x7f23d002a410 comp rx=0 tx=0).stop 2024-09-19T06:25:43.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.764+0000 7f23dbb1b640 1 -- 172.21.15.2:0/3371079901 shutdown_connections 2024-09-19T06:25:43.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.764+0000 7f23dbb1b640 1 --2- 172.21.15.2:0/3371079901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23d410e480 0x7f23d4110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:43.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.764+0000 7f23dbb1b640 1 --2- 172.21.15.2:0/3371079901 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23d4101280 0x7f23d410df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:43.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.764+0000 7f23dbb1b640 1 --2- 172.21.15.2:0/3371079901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23d41008d0 0x7f23d4100cb0 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:43.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.764+0000 7f23dbb1b640 1 -- 172.21.15.2:0/3371079901 >> 172.21.15.2:0/3371079901 conn(0x7f23d40fc7a0 msgr2=0x7f23d40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:43.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.764+0000 7f23dbb1b640 1 -- 172.21.15.2:0/3371079901 shutdown_connections 2024-09-19T06:25:43.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.764+0000 7f23dbb1b640 1 -- 172.21.15.2:0/3371079901 wait complete. 2024-09-19T06:25:43.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.764+0000 7f23dbb1b640 1 Processor -- start 2024-09-19T06:25:43.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.764+0000 7f23dbb1b640 1 -- start start 2024-09-19T06:25:43.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.765+0000 7f23dbb1b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23d41008d0 0x7f23d419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:43.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.765+0000 7f23dbb1b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23d4101280 0x7f23d419ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:43.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.765+0000 7f23dbb1b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23d410e480 0x7f23d419ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:43.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.765+0000 7f23dbb1b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f23d4114060 con 0x7f23d41008d0 2024-09-19T06:25:43.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.765+0000 7f23dbb1b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f23d4113ee0 con 0x7f23d4101280 2024-09-19T06:25:43.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.765+0000 7f23dbb1b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f23d41141e0 con 0x7f23d410e480 2024-09-19T06:25:43.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.765+0000 7f23d98b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23d41008d0 0x7f23d419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:43.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.765+0000 7f23d98b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23d41008d0 0x7f23d419a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51642/0 (socket says 172.21.15.2:51642) 2024-09-19T06:25:43.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.765+0000 7f23d98b7640 1 -- 172.21.15.2:0/3346320836 learned_addr learned my addr 172.21.15.2:0/3346320836 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:25:43.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.765+0000 7f23d90b6640 1 --2- 172.21.15.2:0/3346320836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23d4101280 0x7f23d419ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:43.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.765+0000 7f23da0b8640 1 --2- 172.21.15.2:0/3346320836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23d410e480 0x7f23d419ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:43.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.765+0000 7f23d98b7640 1 -- 172.21.15.2:0/3346320836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23d410e480 msgr2=0x7f23d419ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:43.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.765+0000 7f23d98b7640 1 --2- 172.21.15.2:0/3346320836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23d410e480 0x7f23d419ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:43.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.765+0000 7f23d98b7640 1 -- 172.21.15.2:0/3346320836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23d4101280 msgr2=0x7f23d419ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:43.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.765+0000 7f23d98b7640 1 --2- 172.21.15.2:0/3346320836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23d4101280 0x7f23d419ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:43.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.765+0000 7f23d98b7640 1 -- 172.21.15.2:0/3346320836 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23d419f570 con 0x7f23d41008d0 2024-09-19T06:25:43.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.765+0000 7f23d90b6640 1 --2- 172.21.15.2:0/3346320836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23d4101280 0x7f23d419ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:25:43.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.765+0000 7f23d98b7640 1 --2- 172.21.15.2:0/3346320836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23d41008d0 0x7f23d419a5c0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f23d0005940 tx=0x7f23d0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:43.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.765+0000 7f23caffd640 1 -- 172.21.15.2:0/3346320836 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d003f030 con 0x7f23d41008d0 2024-09-19T06:25:43.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.765+0000 7f23caffd640 1 -- 172.21.15.2:0/3346320836 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f23d0003aa0 con 0x7f23d41008d0 2024-09-19T06:25:43.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.766+0000 7f23dbb1b640 1 -- 172.21.15.2:0/3346320836 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23d419f800 con 0x7f23d41008d0 2024-09-19T06:25:43.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.766+0000 7f23caffd640 1 -- 172.21.15.2:0/3346320836 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d0035070 con 0x7f23d41008d0 2024-09-19T06:25:43.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.766+0000 7f23dbb1b640 1 -- 172.21.15.2:0/3346320836 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23d41a7140 con 0x7f23d41008d0 2024-09-19T06:25:43.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.767+0000 7f23dbb1b640 1 -- 172.21.15.2:0/3346320836 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23d4100cb0 con 0x7f23d41008d0 2024-09-19T06:25:43.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.768+0000 7f23caffd640 1 -- 172.21.15.2:0/3346320836 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f23d0042030 con 0x7f23d41008d0 2024-09-19T06:25:43.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.768+0000 7f23caffd640 1 --2- 172.21.15.2:0/3346320836 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f23c00a3430 0x7f23c00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:43.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.768+0000 7f23d90b6640 1 --2- 172.21.15.2:0/3346320836 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f23c00a3430 0x7f23c00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:43.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.769+0000 7f23caffd640 1 -- 172.21.15.2:0/3346320836 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8521+0+0 (secure 0 0 0) 0x7f23d00f0520 con 0x7f23d41008d0 2024-09-19T06:25:43.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.769+0000 7f23d90b6640 1 --2- 172.21.15.2:0/3346320836 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f23c00a3430 0x7f23c00a58f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f23c40058c0 tx=0x7f23c4005850 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:43.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.773+0000 7f23caffd640 1 -- 172.21.15.2:0/3346320836 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f23d00bcf00 con 0x7f23d41008d0 2024-09-19T06:25:43.791 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:43 smithi089 ceph-mon[34160]: pgmap v340: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-19T06:25:43.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.987+0000 7f23dbb1b640 1 -- 172.21.15.2:0/3346320836 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f23d4109610 con 0x7f23d41008d0 2024-09-19T06:25:43.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.988+0000 7f23caffd640 1 -- 172.21.15.2:0/3346320836 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11882 (secure 0 0 0) 0x7f23d00bc800 con 0x7f23d41008d0 2024-09-19T06:25:43.990 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:25:43.990 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-09-19T06:14:49:104280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:14:48.191083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24470,24472,24497]},"id":1}]} 2024-09-19T06:25:43.990 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-09-19T06:25:43.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.990+0000 7f23dbb1b640 1 -- 172.21.15.2:0/3346320836 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f23c00a3430 msgr2=0x7f23c00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:43.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.990+0000 7f23dbb1b640 1 --2- 172.21.15.2:0/3346320836 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f23c00a3430 0x7f23c00a58f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f23c40058c0 tx=0x7f23c4005850 comp rx=0 tx=0).stop 2024-09-19T06:25:43.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.990+0000 7f23dbb1b640 1 -- 172.21.15.2:0/3346320836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23d41008d0 msgr2=0x7f23d419a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:43.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.990+0000 7f23dbb1b640 1 --2- 172.21.15.2:0/3346320836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23d41008d0 0x7f23d419a5c0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f23d0005940 tx=0x7f23d0004270 comp rx=0 tx=0).stop 2024-09-19T06:25:43.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.990+0000 7f23dbb1b640 1 -- 172.21.15.2:0/3346320836 shutdown_connections 2024-09-19T06:25:43.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.990+0000 7f23dbb1b640 1 --2- 172.21.15.2:0/3346320836 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f23c00a3430 0x7f23c00a58f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:43.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.990+0000 7f23dbb1b640 1 --2- 172.21.15.2:0/3346320836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23d410e480 0x7f23d419ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:43.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.990+0000 7f23dbb1b640 1 --2- 172.21.15.2:0/3346320836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23d4101280 0x7f23d419ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:43.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.990+0000 7f23dbb1b640 1 --2- 172.21.15.2:0/3346320836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23d41008d0 0x7f23d419a5c0 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:43.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.990+0000 7f23dbb1b640 1 -- 172.21.15.2:0/3346320836 >> 172.21.15.2:0/3346320836 conn(0x7f23d40fc7a0 msgr2=0x7f23d40feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:43.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.990+0000 7f23dbb1b640 1 -- 172.21.15.2:0/3346320836 shutdown_connections 2024-09-19T06:25:43.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:43.990+0000 7f23dbb1b640 1 -- 172.21.15.2:0/3346320836 wait complete. 2024-09-19T06:25:44.643 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:44 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/3346320836' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:25:44.675 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:25:44.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:44 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/3346320836' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:25:44.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:44 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/3346320836' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:25:44.933 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:25:45.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.413+0000 7f0c64a3b640 1 -- 172.21.15.2:0/2328396971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c60106a80 msgr2=0x7f0c60106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:45.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.413+0000 7f0c64a3b640 1 --2- 172.21.15.2:0/2328396971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c60106a80 0x7f0c60106e60 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f0c50009930 tx=0x7f0c5002a420 comp rx=0 tx=0).stop 2024-09-19T06:25:45.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.413+0000 7f0c64a3b640 1 -- 172.21.15.2:0/2328396971 shutdown_connections 2024-09-19T06:25:45.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.413+0000 7f0c64a3b640 1 --2- 172.21.15.2:0/2328396971 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c60101420 0x7f0c6010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:45.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.413+0000 7f0c64a3b640 1 --2- 172.21.15.2:0/2328396971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c60100a80 0x7f0c60100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:45.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.413+0000 7f0c64a3b640 1 --2- 172.21.15.2:0/2328396971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c60106a80 0x7f0c60106e60 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:45.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.413+0000 7f0c64a3b640 1 -- 172.21.15.2:0/2328396971 >> 172.21.15.2:0/2328396971 conn(0x7f0c600fc7a0 msgr2=0x7f0c600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:45.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.414+0000 7f0c64a3b640 1 -- 172.21.15.2:0/2328396971 shutdown_connections 2024-09-19T06:25:45.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.414+0000 7f0c64a3b640 1 -- 172.21.15.2:0/2328396971 wait complete. 2024-09-19T06:25:45.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.414+0000 7f0c64a3b640 1 Processor -- start 2024-09-19T06:25:45.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.414+0000 7f0c64a3b640 1 -- start start 2024-09-19T06:25:45.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.415+0000 7f0c64a3b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c60100a80 0x7f0c60199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:45.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.415+0000 7f0c64a3b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c60101420 0x7f0c601996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:45.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.415+0000 7f0c64a3b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c60106a80 0x7f0c601a4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:45.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.415+0000 7f0c64a3b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0c60110d30 con 0x7f0c60106a80 2024-09-19T06:25:45.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.415+0000 7f0c64a3b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0c60110bb0 con 0x7f0c60101420 2024-09-19T06:25:45.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.415+0000 7f0c64a3b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0c60110eb0 con 0x7f0c60100a80 2024-09-19T06:25:45.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.415+0000 7f0c5ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c60106a80 0x7f0c601a4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:45.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.415+0000 7f0c5ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c60106a80 0x7f0c601a4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54666/0 (socket says 172.21.15.2:54666) 2024-09-19T06:25:45.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.415+0000 7f0c5ed9d640 1 -- 172.21.15.2:0/2011682165 learned_addr learned my addr 172.21.15.2:0/2011682165 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:25:45.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.415+0000 7f0c5dd9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c60101420 0x7f0c601996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:45.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.415+0000 7f0c5e59c640 1 --2- 172.21.15.2:0/2011682165 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c60100a80 0x7f0c60199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:45.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.415+0000 7f0c5ed9d640 1 -- 172.21.15.2:0/2011682165 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c60100a80 msgr2=0x7f0c60199180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:45.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.415+0000 7f0c5ed9d640 1 --2- 172.21.15.2:0/2011682165 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c60100a80 0x7f0c60199180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:45.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.415+0000 7f0c5ed9d640 1 -- 172.21.15.2:0/2011682165 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c60101420 msgr2=0x7f0c601996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:45.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.415+0000 7f0c5ed9d640 1 --2- 172.21.15.2:0/2011682165 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c60101420 0x7f0c601996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:45.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.415+0000 7f0c5ed9d640 1 -- 172.21.15.2:0/2011682165 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c601a4740 con 0x7f0c60106a80 2024-09-19T06:25:45.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.415+0000 7f0c5ed9d640 1 --2- 172.21.15.2:0/2011682165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c60106a80 0x7f0c601a4200 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f0c5800cad0 tx=0x7f0c5800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:45.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.415+0000 7f0c4f7fe640 1 -- 172.21.15.2:0/2011682165 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c5800ad60 con 0x7f0c60106a80 2024-09-19T06:25:45.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.415+0000 7f0c4f7fe640 1 -- 172.21.15.2:0/2011682165 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0c58005020 con 0x7f0c60106a80 2024-09-19T06:25:45.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.415+0000 7f0c4f7fe640 1 -- 172.21.15.2:0/2011682165 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c5800f6b0 con 0x7f0c60106a80 2024-09-19T06:25:45.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.416+0000 7f0c64a3b640 1 -- 172.21.15.2:0/2011682165 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c601a4910 con 0x7f0c60106a80 2024-09-19T06:25:45.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.416+0000 7f0c64a3b640 1 -- 172.21.15.2:0/2011682165 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c601a4dd0 con 0x7f0c60106a80 2024-09-19T06:25:45.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.417+0000 7f0c64a3b640 1 -- 172.21.15.2:0/2011682165 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c60100ee0 con 0x7f0c60106a80 2024-09-19T06:25:45.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.418+0000 7f0c4f7fe640 1 -- 172.21.15.2:0/2011682165 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f0c580051d0 con 0x7f0c60106a80 2024-09-19T06:25:45.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.418+0000 7f0c4f7fe640 1 --2- 172.21.15.2:0/2011682165 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f0c480a33b0 0x7f0c480a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:45.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.419+0000 7f0c5e59c640 1 --2- 172.21.15.2:0/2011682165 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f0c480a33b0 0x7f0c480a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:45.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.419+0000 7f0c4f7fe640 1 -- 172.21.15.2:0/2011682165 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8521+0+0 (secure 0 0 0) 0x7f0c580cfcc0 con 0x7f0c60106a80 2024-09-19T06:25:45.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.419+0000 7f0c5e59c640 1 --2- 172.21.15.2:0/2011682165 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f0c480a33b0 0x7f0c480a5870 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0c50000c00 tx=0x7f0c50031400 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:45.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.422+0000 7f0c4f7fe640 1 -- 172.21.15.2:0/2011682165 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0c58014030 con 0x7f0c60106a80 2024-09-19T06:25:45.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.634+0000 7f0c64a3b640 1 -- 172.21.15.2:0/2011682165 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c60108a60 con 0x7f0c60106a80 2024-09-19T06:25:45.635 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:45 smithi002 ceph-mon[30982]: pgmap v341: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-19T06:25:45.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.635+0000 7f0c4f7fe640 1 -- 172.21.15.2:0/2011682165 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11882 (secure 0 0 0) 0x7f0c5809c6a0 con 0x7f0c60106a80 2024-09-19T06:25:45.637 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:25:45.637 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-09-19T06:14:49:104280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/528892925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":528892925},{"type":"v1","addr":"172.21.15.2:6835","nonce":528892925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2791215527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2791215527},{"type":"v1","addr":"172.21.15.2:6837","nonce":2791215527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3747228076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3747228076},{"type":"v1","addr":"172.21.15.2:6839","nonce":3747228076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3902749142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3902749142},{"type":"v1","addr":"172.21.15.2:6841","nonce":3902749142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/2529057952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2529057952},{"type":"v1","addr":"172.21.15.89:6833","nonce":2529057952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/3201908791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":3201908791},{"type":"v1","addr":"172.21.15.90:6833","nonce":3201908791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:13:04.348577+0000","modified":"2024-09-19T06:14:48.191083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24472,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1607170353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1607170353},{"type":"v1","addr":"172.21.15.90:6835","nonce":1607170353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/56684343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":56684343},{"type":"v1","addr":"172.21.15.89:6835","nonce":56684343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/2402014616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":2402014616},{"type":"v1","addr":"172.21.15.90:6837","nonce":2402014616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.89:6837/1620064646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1620064646},{"type":"v1","addr":"172.21.15.89:6837","nonce":1620064646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6839/3866538228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3866538228},{"type":"v1","addr":"172.21.15.90:6839","nonce":3866538228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.89:6839/3897636568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":3897636568},{"type":"v1","addr":"172.21.15.89:6839","nonce":3897636568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24470,24472,24497]},"id":1}]} 2024-09-19T06:25:45.637 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-09-19T06:25:45.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.637+0000 7f0c64a3b640 1 -- 172.21.15.2:0/2011682165 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f0c480a33b0 msgr2=0x7f0c480a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:45.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.637+0000 7f0c64a3b640 1 --2- 172.21.15.2:0/2011682165 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f0c480a33b0 0x7f0c480a5870 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0c50000c00 tx=0x7f0c50031400 comp rx=0 tx=0).stop 2024-09-19T06:25:45.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.637+0000 7f0c64a3b640 1 -- 172.21.15.2:0/2011682165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c60106a80 msgr2=0x7f0c601a4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:45.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.637+0000 7f0c64a3b640 1 --2- 172.21.15.2:0/2011682165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c60106a80 0x7f0c601a4200 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f0c5800cad0 tx=0x7f0c5800ced0 comp rx=0 tx=0).stop 2024-09-19T06:25:45.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.637+0000 7f0c64a3b640 1 -- 172.21.15.2:0/2011682165 shutdown_connections 2024-09-19T06:25:45.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.637+0000 7f0c64a3b640 1 --2- 172.21.15.2:0/2011682165 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f0c480a33b0 0x7f0c480a5870 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:45.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.637+0000 7f0c64a3b640 1 --2- 172.21.15.2:0/2011682165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c60106a80 0x7f0c601a4200 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:45.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.637+0000 7f0c64a3b640 1 --2- 172.21.15.2:0/2011682165 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c60101420 0x7f0c601996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:45.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.637+0000 7f0c64a3b640 1 --2- 172.21.15.2:0/2011682165 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c60100a80 0x7f0c60199180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:45.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.637+0000 7f0c64a3b640 1 -- 172.21.15.2:0/2011682165 >> 172.21.15.2:0/2011682165 conn(0x7f0c600fc7a0 msgr2=0x7f0c600fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:45.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.637+0000 7f0c64a3b640 1 -- 172.21.15.2:0/2011682165 shutdown_connections 2024-09-19T06:25:45.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:45.637+0000 7f0c64a3b640 1 -- 172.21.15.2:0/2011682165 wait complete. 2024-09-19T06:25:45.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:45 smithi090 ceph-mon[34497]: pgmap v341: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-19T06:25:45.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:45 smithi089 ceph-mon[34160]: pgmap v341: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-19T06:25:46.239 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:25:46.499 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:25:46.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:46 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/2011682165' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:25:46.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:46 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/2011682165' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:25:46.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:46 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/2011682165' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:25:46.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:46.926+0000 7faeb0dfe640 1 -- 172.21.15.2:0/3532163993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faeac106f20 msgr2=0x7faeac10eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:46.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:46.926+0000 7faeb0dfe640 1 --2- 172.21.15.2:0/3532163993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faeac106f20 0x7faeac10eaa0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7faea4009ca0 tx=0x7faea402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:25:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:46.926+0000 7faeb0dfe640 1 -- 172.21.15.2:0/3532163993 shutdown_connections 2024-09-19T06:25:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:46.926+0000 7faeb0dfe640 1 --2- 172.21.15.2:0/3532163993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faeac106f20 0x7faeac10eaa0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:46.926+0000 7faeb0dfe640 1 --2- 172.21.15.2:0/3532163993 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faeac1027a0 0x7faeac1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:46.926+0000 7faeb0dfe640 1 --2- 172.21.15.2:0/3532163993 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faeac101df0 0x7faeac1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:46.926+0000 7faeb0dfe640 1 -- 172.21.15.2:0/3532163993 >> 172.21.15.2:0/3532163993 conn(0x7faeac0fd8b0 msgr2=0x7faeac0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:46.926+0000 7faeb0dfe640 1 -- 172.21.15.2:0/3532163993 shutdown_connections 2024-09-19T06:25:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:46.926+0000 7faeb0dfe640 1 -- 172.21.15.2:0/3532163993 wait complete. 2024-09-19T06:25:46.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:46.926+0000 7faeb0dfe640 1 Processor -- start 2024-09-19T06:25:46.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:46.927+0000 7faeb0dfe640 1 -- start start 2024-09-19T06:25:46.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:46.927+0000 7faeb0dfe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faeac101df0 0x7faeac1982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:46.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:46.927+0000 7faeb0dfe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faeac1027a0 0x7faeac1987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:46.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:46.927+0000 7faeb0dfe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faeac106f20 0x7faeac19cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:46.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:46.927+0000 7faeb0dfe640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faeac111e30 con 0x7faeac101df0 2024-09-19T06:25:46.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:46.927+0000 7faeb0dfe640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7faeac111cb0 con 0x7faeac1027a0 2024-09-19T06:25:46.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:46.927+0000 7faeb0dfe640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7faeac111fb0 con 0x7faeac106f20 2024-09-19T06:25:46.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:46.927+0000 7faeaa59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faeac101df0 0x7faeac1982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:46.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:46.927+0000 7faeaa59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faeac101df0 0x7faeac1982b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54682/0 (socket says 172.21.15.2:54682) 2024-09-19T06:25:46.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:46.927+0000 7faeaa59c640 1 -- 172.21.15.2:0/1904334674 learned_addr learned my addr 172.21.15.2:0/1904334674 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:25:46.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:46.927+0000 7faea9d9b640 1 --2- 172.21.15.2:0/1904334674 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faeac1027a0 0x7faeac1987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:46.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:46.927+0000 7faeaad9d640 1 --2- 172.21.15.2:0/1904334674 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faeac106f20 0x7faeac19cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:46.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:46.927+0000 7faeaa59c640 1 -- 172.21.15.2:0/1904334674 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faeac106f20 msgr2=0x7faeac19cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:46.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:46.927+0000 7faeaa59c640 1 --2- 172.21.15.2:0/1904334674 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faeac106f20 0x7faeac19cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:46.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:46.927+0000 7faeaa59c640 1 -- 172.21.15.2:0/1904334674 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faeac1027a0 msgr2=0x7faeac1987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:46.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:46.927+0000 7faeaa59c640 1 --2- 172.21.15.2:0/1904334674 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faeac1027a0 0x7faeac1987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:46.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:46.927+0000 7faeaa59c640 1 -- 172.21.15.2:0/1904334674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeac19d260 con 0x7faeac101df0 2024-09-19T06:25:46.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:46.928+0000 7faeaa59c640 1 --2- 172.21.15.2:0/1904334674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faeac101df0 0x7faeac1982b0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7fae9c00d950 tx=0x7fae9c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:46.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:46.928+0000 7faea37fe640 1 -- 172.21.15.2:0/1904334674 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae9c017070 con 0x7faeac101df0 2024-09-19T06:25:46.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:46.928+0000 7faea37fe640 1 -- 172.21.15.2:0/1904334674 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fae9c009c30 con 0x7faeac101df0 2024-09-19T06:25:46.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:46.928+0000 7faeb0dfe640 1 -- 172.21.15.2:0/1904334674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faeac19d550 con 0x7faeac101df0 2024-09-19T06:25:46.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:46.928+0000 7faea37fe640 1 -- 172.21.15.2:0/1904334674 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae9c00f620 con 0x7faeac101df0 2024-09-19T06:25:46.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:46.928+0000 7faeb0dfe640 1 -- 172.21.15.2:0/1904334674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faeac1a4e30 con 0x7faeac101df0 2024-09-19T06:25:46.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:46.929+0000 7faeb0dfe640 1 -- 172.21.15.2:0/1904334674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faeac1021d0 con 0x7faeac101df0 2024-09-19T06:25:46.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:46.930+0000 7faea37fe640 1 -- 172.21.15.2:0/1904334674 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fae9c0109a0 con 0x7faeac101df0 2024-09-19T06:25:46.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:46.931+0000 7faea37fe640 1 --2- 172.21.15.2:0/1904334674 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fae980a3430 0x7fae980a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:46.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:46.931+0000 7faea9d9b640 1 --2- 172.21.15.2:0/1904334674 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fae980a3430 0x7fae980a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:46.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:46.931+0000 7faea37fe640 1 -- 172.21.15.2:0/1904334674 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8521+0+0 (secure 0 0 0) 0x7fae9c0cf840 con 0x7faeac101df0 2024-09-19T06:25:46.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:46.932+0000 7faea9d9b640 1 --2- 172.21.15.2:0/1904334674 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fae980a3430 0x7fae980a58f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7faeac0fdd60 tx=0x7fae9400b390 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:46.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:46.934+0000 7faea37fe640 1 -- 172.21.15.2:0/1904334674 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fae9c009de0 con 0x7faeac101df0 2024-09-19T06:25:47.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:47.108+0000 7faeb0dfe640 1 -- 172.21.15.2:0/1904334674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faeac109b70 con 0x7faeac101df0 2024-09-19T06:25:47.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:47.110+0000 7faea37fe640 1 -- 172.21.15.2:0/1904334674 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+23039 (secure 0 0 0) 0x7fae9c09bbf0 con 0x7faeac101df0 2024-09-19T06:25:47.157 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-19T06:25:47.157 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":92,"fsid":"078f6612-764d-11ef-bceb-c7b262605968","created":"2024-09-19T06:05:17.607927+0000","modified":"2024-09-19T06:25:13.228551+0000","last_up_change":"2024-09-19T06:12:13.856684+0000","last_in_change":"2024-09-19T06:11:49.745266+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:08:28.425566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:13:00.482789+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:13:02.768221+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":91,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0de97a3d-2d27-455b-9998-ddd2319c148d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6803","nonce":915165910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6805","nonce":915165910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6809","nonce":915165910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":915165910},{"type":"v1","addr":"172.21.15.2:6807","nonce":915165910}]},"public_addr":"172.21.15.2:6803/915165910","cluster_addr":"172.21.15.2:6805/915165910","heartbeat_back_addr":"172.21.15.2:6809/915165910","heartbeat_front_addr":"172.21.15.2:6807/915165910","state":["exists","up"]},{"osd":1,"uuid":"056d229e-2de4-4902-922e-21e1a5d3f061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6801","nonce":4097264171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6803","nonce":4097264171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6807","nonce":4097264171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":4097264171},{"type":"v1","addr":"172.21.15.89:6805","nonce":4097264171}]},"public_addr":"172.21.15.89:6801/4097264171","cluster_addr":"172.21.15.89:6803/4097264171","heartbeat_back_addr":"172.21.15.89:6807/4097264171","heartbeat_front_addr":"172.21.15.89:6805/4097264171","state":["exists","up"]},{"osd":2,"uuid":"2a4e7147-4125-4ee6-b5ad-85518d7066d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6801","nonce":1479908200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6803","nonce":1479908200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6807","nonce":1479908200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1479908200},{"type":"v1","addr":"172.21.15.90:6805","nonce":1479908200}]},"public_addr":"172.21.15.90:6801/1479908200","cluster_addr":"172.21.15.90:6803/1479908200","heartbeat_back_addr":"172.21.15.90:6807/1479908200","heartbeat_front_addr":"172.21.15.90:6805/1479908200","state":["exists","up"]},{"osd":3,"uuid":"7b3da775-0f0a-4b46-a8dc-9ec822a54301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6811","nonce":1796948193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6813","nonce":1796948193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6817","nonce":1796948193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1796948193},{"type":"v1","addr":"172.21.15.2:6815","nonce":1796948193}]},"public_addr":"172.21.15.2:6811/1796948193","cluster_addr":"172.21.15.2:6813/1796948193","heartbeat_back_addr":"172.21.15.2:6817/1796948193","heartbeat_front_addr":"172.21.15.2:6815/1796948193","state":["exists","up"]},{"osd":4,"uuid":"d4c8bafc-c844-4ff1-a3d8-7a53576e6b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6809","nonce":4256848315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6811","nonce":4256848315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6815","nonce":4256848315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":4256848315},{"type":"v1","addr":"172.21.15.89:6813","nonce":4256848315}]},"public_addr":"172.21.15.89:6809/4256848315","cluster_addr":"172.21.15.89:6811/4256848315","heartbeat_back_addr":"172.21.15.89:6815/4256848315","heartbeat_front_addr":"172.21.15.89:6813/4256848315","state":["exists","up"]},{"osd":5,"uuid":"8dc9bb55-29e0-4b04-9415-3b9bb5ed05cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6809","nonce":189855967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6811","nonce":189855967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6815","nonce":189855967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":189855967},{"type":"v1","addr":"172.21.15.90:6813","nonce":189855967}]},"public_addr":"172.21.15.90:6809/189855967","cluster_addr":"172.21.15.90:6811/189855967","heartbeat_back_addr":"172.21.15.90:6815/189855967","heartbeat_front_addr":"172.21.15.90:6813/189855967","state":["exists","up"]},{"osd":6,"uuid":"86d1443a-9b43-46de-abd7-4c95b43207f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6819","nonce":3886336279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6821","nonce":3886336279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6825","nonce":3886336279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":3886336279},{"type":"v1","addr":"172.21.15.2:6823","nonce":3886336279}]},"public_addr":"172.21.15.2:6819/3886336279","cluster_addr":"172.21.15.2:6821/3886336279","heartbeat_back_addr":"172.21.15.2:6825/3886336279","heartbeat_front_addr":"172.21.15.2:6823/3886336279","state":["exists","up"]},{"osd":7,"uuid":"1cc5554c-80d2-4e77-b29a-fd2ada68d82d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6817","nonce":508513510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6819","nonce":508513510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6823","nonce":508513510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":508513510},{"type":"v1","addr":"172.21.15.89:6821","nonce":508513510}]},"public_addr":"172.21.15.89:6817/508513510","cluster_addr":"172.21.15.89:6819/508513510","heartbeat_back_addr":"172.21.15.89:6823/508513510","heartbeat_front_addr":"172.21.15.89:6821/508513510","state":["exists","up"]},{"osd":8,"uuid":"e9b2eb92-9af2-4f26-a259-fcaf972e4fd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6817","nonce":3558544480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6819","nonce":3558544480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6823","nonce":3558544480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3558544480},{"type":"v1","addr":"172.21.15.90:6821","nonce":3558544480}]},"public_addr":"172.21.15.90:6817/3558544480","cluster_addr":"172.21.15.90:6819/3558544480","heartbeat_back_addr":"172.21.15.90:6823/3558544480","heartbeat_front_addr":"172.21.15.90:6821/3558544480","state":["exists","up"]},{"osd":9,"uuid":"194d4c64-dd29-4d35-bc54-0858c44815cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6827","nonce":2690758100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6829","nonce":2690758100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6833","nonce":2690758100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2690758100},{"type":"v1","addr":"172.21.15.2:6831","nonce":2690758100}]},"public_addr":"172.21.15.2:6827/2690758100","cluster_addr":"172.21.15.2:6829/2690758100","heartbeat_back_addr":"172.21.15.2:6833/2690758100","heartbeat_front_addr":"172.21.15.2:6831/2690758100","state":["exists","up"]},{"osd":10,"uuid":"7695fa4a-b94e-4afc-b166-690a197ad730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6825","nonce":1141925395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6827","nonce":1141925395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6831","nonce":1141925395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1141925395},{"type":"v1","addr":"172.21.15.89:6829","nonce":1141925395}]},"public_addr":"172.21.15.89:6825/1141925395","cluster_addr":"172.21.15.89:6827/1141925395","heartbeat_back_addr":"172.21.15.89:6831/1141925395","heartbeat_front_addr":"172.21.15.89:6829/1141925395","state":["exists","up"]},{"osd":11,"uuid":"1815a999-bfdb-46b9-afcd-632ee8ba56d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6825","nonce":468380924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6827","nonce":468380924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6831","nonce":468380924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":468380924},{"type":"v1","addr":"172.21.15.90:6829","nonce":468380924}]},"public_addr":"172.21.15.90:6825/468380924","cluster_addr":"172.21.15.90:6827/468380924","heartbeat_back_addr":"172.21.15.90:6831/468380924","heartbeat_front_addr":"172.21.15.90:6829/468380924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:07:36.125754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:01.415356+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:26.420808+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:51.722673+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:09:16.562300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:09:41.958465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:10:07.056167+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:10:32.066195+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:10:56.497875+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:11:21.973083+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:11:46.891515+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:12:11.910012+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9},{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/3813883133":"2024-09-20T06:14:48.099112+0000","172.21.15.2:0/2612001712":"2024-09-20T06:14:48.099112+0000","172.21.15.2:0/2508383651":"2024-09-20T06:14:48.099112+0000","172.21.15.2:0/3763089457":"2024-09-20T06:05:47.538477+0000","172.21.15.2:0/1361067708":"2024-09-20T06:05:47.538477+0000","172.21.15.2:6801/1200011821":"2024-09-20T06:06:11.912585+0000","172.21.15.2:0/3899165140":"2024-09-20T06:05:47.538477+0000","172.21.15.2:6800/1200011821":"2024-09-20T06:06:11.912585+0000","172.21.15.2:6800/1602650352":"2024-09-20T06:05:47.538477+0000","172.21.15.2:0/2976372536":"2024-09-20T06:06:11.912585+0000","172.21.15.2:0/1280963020":"2024-09-20T06:06:11.912585+0000","172.21.15.2:6800/4180340554":"2024-09-20T06:14:48.099112+0000","172.21.15.2:6801/1602650352":"2024-09-20T06:05:47.538477+0000","172.21.15.2:0/874985787":"2024-09-20T06:06:11.912585+0000","172.21.15.2:6801/4180340554":"2024-09-20T06:14:48.099112+0000","172.21.15.2:0/2134106196":"2024-09-20T06:14:48.099112+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:25:47.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:47.112+0000 7faeb0dfe640 1 -- 172.21.15.2:0/1904334674 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fae980a3430 msgr2=0x7fae980a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:47.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:47.112+0000 7faeb0dfe640 1 --2- 172.21.15.2:0/1904334674 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fae980a3430 0x7fae980a58f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7faeac0fdd60 tx=0x7fae9400b390 comp rx=0 tx=0).stop 2024-09-19T06:25:47.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:47.112+0000 7faeb0dfe640 1 -- 172.21.15.2:0/1904334674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faeac101df0 msgr2=0x7faeac1982b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:47.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:47.112+0000 7faeb0dfe640 1 --2- 172.21.15.2:0/1904334674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faeac101df0 0x7faeac1982b0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7fae9c00d950 tx=0x7fae9c00de10 comp rx=0 tx=0).stop 2024-09-19T06:25:47.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:47.112+0000 7faeb0dfe640 1 -- 172.21.15.2:0/1904334674 shutdown_connections 2024-09-19T06:25:47.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:47.112+0000 7faeb0dfe640 1 --2- 172.21.15.2:0/1904334674 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fae980a3430 0x7fae980a58f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:47.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:47.112+0000 7faeb0dfe640 1 --2- 172.21.15.2:0/1904334674 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faeac106f20 0x7faeac19cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:47.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:47.112+0000 7faeb0dfe640 1 --2- 172.21.15.2:0/1904334674 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faeac1027a0 0x7faeac1987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:47.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:47.112+0000 7faeb0dfe640 1 --2- 172.21.15.2:0/1904334674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faeac101df0 0x7faeac1982b0 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:47.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:47.112+0000 7faeb0dfe640 1 -- 172.21.15.2:0/1904334674 >> 172.21.15.2:0/1904334674 conn(0x7faeac0fd8b0 msgr2=0x7faeac0feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:47.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:47.112+0000 7faeb0dfe640 1 -- 172.21.15.2:0/1904334674 shutdown_connections 2024-09-19T06:25:47.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:47.112+0000 7faeb0dfe640 1 -- 172.21.15.2:0/1904334674 wait complete. 2024-09-19T06:25:47.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:47 smithi002 ceph-mon[30982]: pgmap v342: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-19T06:25:47.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:47 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1904334674' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:25:47.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:47 smithi090 ceph-mon[34497]: pgmap v342: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-19T06:25:47.739 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:47 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1904334674' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:25:47.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:47 smithi089 ceph-mon[34160]: pgmap v342: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-19T06:25:47.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:47 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1904334674' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:25:47.800 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs fail cephfs 2024-09-19T06:25:48.059 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:25:48.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.526+0000 7fb2de5f3640 1 -- 172.21.15.2:0/2049445622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2d810c170 msgr2=0x7fb2d810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:48.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.526+0000 7fb2de5f3640 1 --2- 172.21.15.2:0/2049445622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2d810c170 0x7fb2d810e610 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0009ca0 tx=0x7fb2d002a950 comp rx=0 tx=0).stop 2024-09-19T06:25:48.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.526+0000 7fb2de5f3640 1 -- 172.21.15.2:0/2049445622 shutdown_connections 2024-09-19T06:25:48.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.526+0000 7fb2de5f3640 1 --2- 172.21.15.2:0/2049445622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2d810c170 0x7fb2d810e610 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:48.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.526+0000 7fb2de5f3640 1 --2- 172.21.15.2:0/2049445622 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2d8103660 0x7fb2d810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:48.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.526+0000 7fb2de5f3640 1 --2- 172.21.15.2:0/2049445622 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2d8102d40 0x7fb2d8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:48.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.526+0000 7fb2de5f3640 1 -- 172.21.15.2:0/2049445622 >> 172.21.15.2:0/2049445622 conn(0x7fb2d80fc7a0 msgr2=0x7fb2d80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:48.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.526+0000 7fb2de5f3640 1 -- 172.21.15.2:0/2049445622 shutdown_connections 2024-09-19T06:25:48.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.526+0000 7fb2de5f3640 1 -- 172.21.15.2:0/2049445622 wait complete. 2024-09-19T06:25:48.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.527+0000 7fb2de5f3640 1 Processor -- start 2024-09-19T06:25:48.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.527+0000 7fb2de5f3640 1 -- start start 2024-09-19T06:25:48.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.527+0000 7fb2de5f3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2d8102d40 0x7fb2d8198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:48.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.527+0000 7fb2de5f3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2d8103660 0x7fb2d81988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:48.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.527+0000 7fb2de5f3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2d810c170 0x7fb2d819cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:48.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.527+0000 7fb2de5f3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d8111e00 con 0x7fb2d8102d40 2024-09-19T06:25:48.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.527+0000 7fb2de5f3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d8111c80 con 0x7fb2d8103660 2024-09-19T06:25:48.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.527+0000 7fb2de5f3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d8111f80 con 0x7fb2d810c170 2024-09-19T06:25:48.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.527+0000 7fb2d7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2d8102d40 0x7fb2d8198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:48.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.528+0000 7fb2d7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2d8102d40 0x7fb2d8198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54710/0 (socket says 172.21.15.2:54710) 2024-09-19T06:25:48.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.528+0000 7fb2d7fff640 1 -- 172.21.15.2:0/2563817052 learned_addr learned my addr 172.21.15.2:0/2563817052 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:25:48.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.528+0000 7fb2d77fe640 1 --2- 172.21.15.2:0/2563817052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2d8103660 0x7fb2d81988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:48.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.528+0000 7fb2dcb90640 1 --2- 172.21.15.2:0/2563817052 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2d810c170 0x7fb2d819cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:48.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.528+0000 7fb2d7fff640 1 -- 172.21.15.2:0/2563817052 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2d810c170 msgr2=0x7fb2d819cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:48.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.528+0000 7fb2d7fff640 1 --2- 172.21.15.2:0/2563817052 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2d810c170 0x7fb2d819cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:48.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.528+0000 7fb2d7fff640 1 -- 172.21.15.2:0/2563817052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2d8103660 msgr2=0x7fb2d81988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:48.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.528+0000 7fb2d7fff640 1 --2- 172.21.15.2:0/2563817052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2d8103660 0x7fb2d81988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:48.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.528+0000 7fb2d7fff640 1 -- 172.21.15.2:0/2563817052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d819d310 con 0x7fb2d8102d40 2024-09-19T06:25:48.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.528+0000 7fb2dcb90640 1 --2- 172.21.15.2:0/2563817052 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2d810c170 0x7fb2d819cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:25:48.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.528+0000 7fb2d7fff640 1 --2- 172.21.15.2:0/2563817052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2d8102d40 0x7fb2d8198360 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fb2c800c890 tx=0x7fb2c800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:48.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.528+0000 7fb2d57fa640 1 -- 172.21.15.2:0/2563817052 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c8004220 con 0x7fb2d8102d40 2024-09-19T06:25:48.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.528+0000 7fb2de5f3640 1 -- 172.21.15.2:0/2563817052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2d819d600 con 0x7fb2d8102d40 2024-09-19T06:25:48.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.528+0000 7fb2d57fa640 1 -- 172.21.15.2:0/2563817052 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb2c80043c0 con 0x7fb2d8102d40 2024-09-19T06:25:48.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.528+0000 7fb2d57fa640 1 -- 172.21.15.2:0/2563817052 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c8004a00 con 0x7fb2d8102d40 2024-09-19T06:25:48.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.528+0000 7fb2de5f3640 1 -- 172.21.15.2:0/2563817052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2d81a4ee0 con 0x7fb2d8102d40 2024-09-19T06:25:48.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.529+0000 7fb2de5f3640 1 -- 172.21.15.2:0/2563817052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2d8103120 con 0x7fb2d8102d40 2024-09-19T06:25:48.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.531+0000 7fb2d57fa640 1 -- 172.21.15.2:0/2563817052 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7fb2c8004ba0 con 0x7fb2d8102d40 2024-09-19T06:25:48.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.531+0000 7fb2d57fa640 1 --2- 172.21.15.2:0/2563817052 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb2c00a33b0 0x7fb2c00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:48.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.531+0000 7fb2d57fa640 1 -- 172.21.15.2:0/2563817052 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8521+0+0 (secure 0 0 0) 0x7fb2c80cf9e0 con 0x7fb2d8102d40 2024-09-19T06:25:48.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.531+0000 7fb2d77fe640 1 --2- 172.21.15.2:0/2563817052 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb2c00a33b0 0x7fb2c00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:48.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.532+0000 7fb2d77fe640 1 --2- 172.21.15.2:0/2563817052 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb2c00a33b0 0x7fb2c00a5870 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb2d80fee10 tx=0x7fb2cc00b2e0 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:48.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.535+0000 7fb2d57fa640 1 -- 172.21.15.2:0/2563817052 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb2c8014030 con 0x7fb2d8102d40 2024-09-19T06:25:48.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.747+0000 7fb2de5f3640 1 -- 172.21.15.2:0/2563817052 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb2d81996c0 con 0x7fb2d8102d40 2024-09-19T06:25:48.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.749+0000 7fb2d57fa640 1 -- 172.21.15.2:0/2563817052 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v27) ==== 161+0+0 (secure 0 0 0) 0x7fb2c809c3c0 con 0x7fb2d8102d40 2024-09-19T06:25:48.751 INFO:teuthology.orchestra.run.smithi002.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T06:25:48.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.752+0000 7fb2de5f3640 1 -- 172.21.15.2:0/2563817052 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb2c00a33b0 msgr2=0x7fb2c00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:48.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.752+0000 7fb2de5f3640 1 --2- 172.21.15.2:0/2563817052 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb2c00a33b0 0x7fb2c00a5870 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb2d80fee10 tx=0x7fb2cc00b2e0 comp rx=0 tx=0).stop 2024-09-19T06:25:48.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.752+0000 7fb2de5f3640 1 -- 172.21.15.2:0/2563817052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2d8102d40 msgr2=0x7fb2d8198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:48.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.752+0000 7fb2de5f3640 1 --2- 172.21.15.2:0/2563817052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2d8102d40 0x7fb2d8198360 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fb2c800c890 tx=0x7fb2c800cd50 comp rx=0 tx=0).stop 2024-09-19T06:25:48.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.752+0000 7fb2de5f3640 1 -- 172.21.15.2:0/2563817052 shutdown_connections 2024-09-19T06:25:48.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.752+0000 7fb2de5f3640 1 --2- 172.21.15.2:0/2563817052 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7fb2c00a33b0 0x7fb2c00a5870 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:48.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.752+0000 7fb2de5f3640 1 --2- 172.21.15.2:0/2563817052 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2d810c170 0x7fb2d819cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:48.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.752+0000 7fb2de5f3640 1 --2- 172.21.15.2:0/2563817052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb2d8103660 0x7fb2d81988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:48.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.752+0000 7fb2de5f3640 1 --2- 172.21.15.2:0/2563817052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2d8102d40 0x7fb2d8198360 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:48.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.752+0000 7fb2de5f3640 1 -- 172.21.15.2:0/2563817052 >> 172.21.15.2:0/2563817052 conn(0x7fb2d80fc7a0 msgr2=0x7fb2d80fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:48.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.753+0000 7fb2de5f3640 1 -- 172.21.15.2:0/2563817052 shutdown_connections 2024-09-19T06:25:48.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:48.753+0000 7fb2de5f3640 1 -- 172.21.15.2:0/2563817052 wait complete. 2024-09-19T06:25:49.107 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:48 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mon-a[30978]: 2024-09-19T06:25:48.748+0000 7f9f0a11d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T06:25:49.240 INFO:journalctl@ceph.mds.c.smithi090.stdout:Sep 19 06:25:48 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-c[64672]: ignoring --setuser ceph since I am not root 2024-09-19T06:25:49.240 INFO:journalctl@ceph.mds.c.smithi090.stdout:Sep 19 06:25:48 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-c[64672]: ignoring --setgroup ceph since I am not root 2024-09-19T06:25:49.240 INFO:journalctl@ceph.mds.c.smithi090.stdout:Sep 19 06:25:48 smithi090 ceph-mds[64676]: -- 172.21.15.90:0/536057759 <== mon.1 v2:172.21.15.90:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556f1f1db860 con 0x556f1f1b9400 2024-09-19T06:25:49.240 INFO:journalctl@ceph.mds.c.smithi090.stdout:Sep 19 06:25:48 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-c[64672]: starting mds.c at 2024-09-19T06:25:49.240 INFO:journalctl@ceph.mds.f.smithi090.stdout:Sep 19 06:25:48 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-f[64370]: ignoring --setuser ceph since I am not root 2024-09-19T06:25:49.240 INFO:journalctl@ceph.mds.f.smithi090.stdout:Sep 19 06:25:48 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-f[64370]: ignoring --setgroup ceph since I am not root 2024-09-19T06:25:49.240 INFO:journalctl@ceph.mds.f.smithi090.stdout:Sep 19 06:25:48 smithi090 ceph-mds[64374]: -- 172.21.15.90:0/2725184755 <== mon.1 v2:172.21.15.90:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557e415ff860 con 0x557e415dd000 2024-09-19T06:25:49.241 INFO:journalctl@ceph.mds.f.smithi090.stdout:Sep 19 06:25:48 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-f[64370]: starting mds.f at 2024-09-19T06:25:49.241 INFO:journalctl@ceph.mds.i.smithi090.stdout:Sep 19 06:25:48 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-i[64973]: ignoring --setuser ceph since I am not root 2024-09-19T06:25:49.241 INFO:journalctl@ceph.mds.i.smithi090.stdout:Sep 19 06:25:48 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-i[64973]: ignoring --setgroup ceph since I am not root 2024-09-19T06:25:49.241 INFO:journalctl@ceph.mds.i.smithi090.stdout:Sep 19 06:25:48 smithi090 ceph-mds[64977]: -- 172.21.15.90:0/3254497560 <== mon.2 v2:172.21.15.89:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561d825ebc20 con 0x561d825c9000 2024-09-19T06:25:49.241 INFO:journalctl@ceph.mds.i.smithi090.stdout:Sep 19 06:25:48 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-i[64973]: starting mds.i at 2024-09-19T06:25:49.292 INFO:journalctl@ceph.mds.e.smithi089.stdout:Sep 19 06:25:48 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-e[63257]: ignoring --setuser ceph since I am not root 2024-09-19T06:25:49.292 INFO:journalctl@ceph.mds.e.smithi089.stdout:Sep 19 06:25:48 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-e[63257]: ignoring --setgroup ceph since I am not root 2024-09-19T06:25:49.292 INFO:journalctl@ceph.mds.e.smithi089.stdout:Sep 19 06:25:48 smithi089 ceph-mds[63261]: -- 172.21.15.89:0/2404439982 <== mon.1 v2:172.21.15.90:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563bf4dd1860 con 0x563bf4daf400 2024-09-19T06:25:49.292 INFO:journalctl@ceph.mds.e.smithi089.stdout:Sep 19 06:25:48 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-e[63257]: starting mds.e at 2024-09-19T06:25:49.293 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 19 06:25:48 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-b[63859]: ignoring --setuser ceph since I am not root 2024-09-19T06:25:49.293 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 19 06:25:48 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-b[63859]: ignoring --setgroup ceph since I am not root 2024-09-19T06:25:49.293 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 19 06:25:48 smithi089 ceph-mds[63863]: -- 172.21.15.89:0/369644820 <== mon.0 v2:172.21.15.2:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557e1af1d860 con 0x557e1aefb400 2024-09-19T06:25:49.293 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 19 06:25:48 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-b[63859]: starting mds.b at 2024-09-19T06:25:49.293 INFO:journalctl@ceph.mds.h.smithi089.stdout:Sep 19 06:25:48 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-h[63558]: ignoring --setuser ceph since I am not root 2024-09-19T06:25:49.293 INFO:journalctl@ceph.mds.h.smithi089.stdout:Sep 19 06:25:48 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-h[63558]: ignoring --setgroup ceph since I am not root 2024-09-19T06:25:49.293 INFO:journalctl@ceph.mds.h.smithi089.stdout:Sep 19 06:25:48 smithi089 ceph-mds[63562]: -- 172.21.15.89:0/423408288 <== mon.2 v2:172.21.15.89:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55828f415860 con 0x55828f3f2800 2024-09-19T06:25:49.293 INFO:journalctl@ceph.mds.h.smithi089.stdout:Sep 19 06:25:48 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-h[63558]: starting mds.h at 2024-09-19T06:25:49.474 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T06:25:49.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:49 smithi002 ceph-mon[30982]: pgmap v343: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-19T06:25:49.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:49 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/2563817052' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T06:25:49.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:49 smithi002 ceph-mon[30982]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T06:25:49.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:49 smithi002 ceph-mon[30982]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T06:25:49.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:49 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/2563817052' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T06:25:49.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:49 smithi002 ceph-mon[30982]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T06:25:49.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:49 smithi002 ceph-mon[30982]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-19T06:25:49.735 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:25:49.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:49 smithi090 ceph-mon[34497]: pgmap v343: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-19T06:25:49.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:49 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/2563817052' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T06:25:49.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:49 smithi090 ceph-mon[34497]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T06:25:49.740 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:49 smithi090 ceph-mon[34497]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T06:25:49.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:49 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/2563817052' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T06:25:49.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:49 smithi090 ceph-mon[34497]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T06:25:49.741 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:49 smithi090 ceph-mon[34497]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-19T06:25:49.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:49 smithi089 ceph-mon[34160]: pgmap v343: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-19T06:25:49.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:49 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/2563817052' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T06:25:49.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:49 smithi089 ceph-mon[34160]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T06:25:49.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:49 smithi089 ceph-mon[34160]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T06:25:49.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:49 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/2563817052' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T06:25:49.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:49 smithi089 ceph-mon[34160]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T06:25:49.792 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:49 smithi089 ceph-mon[34160]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-19T06:25:50.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.177+0000 7f912edf2640 1 -- 172.21.15.2:0/1360905679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9128101420 msgr2=0x7f912810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:50.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.177+0000 7f912edf2640 1 --2- 172.21.15.2:0/1360905679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9128101420 0x7f912810d950 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f9120009cd0 tx=0x7f912002a8e0 comp rx=0 tx=0).stop 2024-09-19T06:25:50.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.177+0000 7f912edf2640 1 -- 172.21.15.2:0/1360905679 shutdown_connections 2024-09-19T06:25:50.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.177+0000 7f912edf2640 1 --2- 172.21.15.2:0/1360905679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9128101420 0x7f912810d950 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:50.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.177+0000 7f912edf2640 1 --2- 172.21.15.2:0/1360905679 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9128100a80 0x7f9128100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:50.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.177+0000 7f912edf2640 1 --2- 172.21.15.2:0/1360905679 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9128106a80 0x7f9128106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:50.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.177+0000 7f912edf2640 1 -- 172.21.15.2:0/1360905679 >> 172.21.15.2:0/1360905679 conn(0x7f91280fc7a0 msgr2=0x7f91280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:50.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.177+0000 7f912edf2640 1 -- 172.21.15.2:0/1360905679 shutdown_connections 2024-09-19T06:25:50.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.177+0000 7f912edf2640 1 -- 172.21.15.2:0/1360905679 wait complete. 2024-09-19T06:25:50.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.178+0000 7f912edf2640 1 Processor -- start 2024-09-19T06:25:50.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.178+0000 7f912edf2640 1 -- start start 2024-09-19T06:25:50.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.178+0000 7f912edf2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9128100a80 0x7f91280fce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:50.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.178+0000 7f912edf2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9128101420 0x7f91280fd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:50.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.178+0000 7f912edf2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9128106a80 0x7f91280fd910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:50.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.178+0000 7f912edf2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9128110da0 con 0x7f9128106a80 2024-09-19T06:25:50.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.178+0000 7f912edf2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9128110c20 con 0x7f9128100a80 2024-09-19T06:25:50.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.178+0000 7f912edf2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9128110f20 con 0x7f9128101420 2024-09-19T06:25:50.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.178+0000 7f912d38f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9128106a80 0x7f91280fd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:50.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.178+0000 7f912d38f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9128106a80 0x7f91280fd910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54736/0 (socket says 172.21.15.2:54736) 2024-09-19T06:25:50.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.178+0000 7f912d38f640 1 -- 172.21.15.2:0/2796539424 learned_addr learned my addr 172.21.15.2:0/2796539424 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:25:50.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.178+0000 7f9127fff640 1 --2- 172.21.15.2:0/2796539424 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9128101420 0x7f91280fd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:50.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.178+0000 7f912cb8e640 1 --2- 172.21.15.2:0/2796539424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9128100a80 0x7f91280fce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:50.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.178+0000 7f912d38f640 1 -- 172.21.15.2:0/2796539424 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9128101420 msgr2=0x7f91280fd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:50.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.178+0000 7f912d38f640 1 --2- 172.21.15.2:0/2796539424 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9128101420 0x7f91280fd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:50.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.178+0000 7f912d38f640 1 -- 172.21.15.2:0/2796539424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9128100a80 msgr2=0x7f91280fce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:50.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.178+0000 7f912d38f640 1 --2- 172.21.15.2:0/2796539424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9128100a80 0x7f91280fce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:50.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.179+0000 7f912d38f640 1 -- 172.21.15.2:0/2796539424 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91281a6830 con 0x7f9128106a80 2024-09-19T06:25:50.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.179+0000 7f912cb8e640 1 --2- 172.21.15.2:0/2796539424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9128100a80 0x7f91280fce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:25:50.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.179+0000 7f912d38f640 1 --2- 172.21.15.2:0/2796539424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9128106a80 0x7f91280fd910 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f9120005e30 tx=0x7f9120003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:50.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.179+0000 7f9125ffb640 1 -- 172.21.15.2:0/2796539424 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9120004240 con 0x7f9128106a80 2024-09-19T06:25:50.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.179+0000 7f912edf2640 1 -- 172.21.15.2:0/2796539424 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91281a6ac0 con 0x7f9128106a80 2024-09-19T06:25:50.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.179+0000 7f9125ffb640 1 -- 172.21.15.2:0/2796539424 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9120031ce0 con 0x7f9128106a80 2024-09-19T06:25:50.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.179+0000 7f9125ffb640 1 -- 172.21.15.2:0/2796539424 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9120046480 con 0x7f9128106a80 2024-09-19T06:25:50.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.179+0000 7f912edf2640 1 -- 172.21.15.2:0/2796539424 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91281a7000 con 0x7f9128106a80 2024-09-19T06:25:50.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.180+0000 7f912edf2640 1 -- 172.21.15.2:0/2796539424 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9128100ee0 con 0x7f9128106a80 2024-09-19T06:25:50.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.181+0000 7f9125ffb640 1 -- 172.21.15.2:0/2796539424 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f91200043e0 con 0x7f9128106a80 2024-09-19T06:25:50.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.182+0000 7f9125ffb640 1 --2- 172.21.15.2:0/2796539424 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f91140a33b0 0x7f91140a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:50.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.182+0000 7f912cb8e640 1 --2- 172.21.15.2:0/2796539424 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f91140a33b0 0x7f91140a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:50.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.182+0000 7f9125ffb640 1 -- 172.21.15.2:0/2796539424 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8735+0+0 (secure 0 0 0) 0x7f912002e030 con 0x7f9128106a80 2024-09-19T06:25:50.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.182+0000 7f912cb8e640 1 --2- 172.21.15.2:0/2796539424 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f91140a33b0 0x7f91140a5870 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f91180058c0 tx=0x7f9118005850 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:50.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.186+0000 7f9125ffb640 1 -- 172.21.15.2:0/2796539424 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f912004b060 con 0x7f9128106a80 2024-09-19T06:25:50.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.397+0000 7f912edf2640 1 -- 172.21.15.2:0/2796539424 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f912810a020 con 0x7f9128106a80 2024-09-19T06:25:50.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.756+0000 7f9125ffb640 1 -- 172.21.15.2:0/2796539424 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v29) ==== 104+0+0 (secure 0 0 0) 0x7f91200b9030 con 0x7f9128106a80 2024-09-19T06:25:50.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.759+0000 7f912edf2640 1 -- 172.21.15.2:0/2796539424 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f91140a33b0 msgr2=0x7f91140a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:50.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.760+0000 7f912edf2640 1 --2- 172.21.15.2:0/2796539424 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f91140a33b0 0x7f91140a5870 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f91180058c0 tx=0x7f9118005850 comp rx=0 tx=0).stop 2024-09-19T06:25:50.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.760+0000 7f912edf2640 1 -- 172.21.15.2:0/2796539424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9128106a80 msgr2=0x7f91280fd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:50.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.760+0000 7f912edf2640 1 --2- 172.21.15.2:0/2796539424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9128106a80 0x7f91280fd910 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f9120005e30 tx=0x7f9120003ba0 comp rx=0 tx=0).stop 2024-09-19T06:25:50.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.760+0000 7f912edf2640 1 -- 172.21.15.2:0/2796539424 shutdown_connections 2024-09-19T06:25:50.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.760+0000 7f912edf2640 1 --2- 172.21.15.2:0/2796539424 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f91140a33b0 0x7f91140a5870 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:50.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.760+0000 7f912edf2640 1 --2- 172.21.15.2:0/2796539424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9128106a80 0x7f91280fd910 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:50.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.760+0000 7f912edf2640 1 --2- 172.21.15.2:0/2796539424 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9128101420 0x7f91280fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:50.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.760+0000 7f912edf2640 1 --2- 172.21.15.2:0/2796539424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9128100a80 0x7f91280fce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:50.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.760+0000 7f912edf2640 1 -- 172.21.15.2:0/2796539424 >> 172.21.15.2:0/2796539424 conn(0x7f91280fc7a0 msgr2=0x7f912806aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:50.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.760+0000 7f912edf2640 1 -- 172.21.15.2:0/2796539424 shutdown_connections 2024-09-19T06:25:50.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:50.760+0000 7f912edf2640 1 -- 172.21.15.2:0/2796539424 wait complete. 2024-09-19T06:25:51.015 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:50 smithi002 ceph-mon[30982]: mds.? [v2:172.21.15.90:6835/663863978,v1:172.21.15.90:6838/663863978] up:boot 2024-09-19T06:25:51.015 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:50 smithi002 ceph-mon[30982]: mds.? [v2:172.21.15.90:6834/1485956054,v1:172.21.15.90:6837/1485956054] up:boot 2024-09-19T06:25:51.015 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:50 smithi002 ceph-mon[30982]: mds.? [v2:172.21.15.90:6836/300504950,v1:172.21.15.90:6839/300504950] up:boot 2024-09-19T06:25:51.015 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:50 smithi002 ceph-mon[30982]: mds.? [v2:172.21.15.89:6834/4251470508,v1:172.21.15.89:6835/4251470508] up:boot 2024-09-19T06:25:51.015 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:50 smithi002 ceph-mon[30982]: mds.? [v2:172.21.15.89:6836/683402740,v1:172.21.15.89:6838/683402740] up:boot 2024-09-19T06:25:51.015 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:50 smithi002 ceph-mon[30982]: mds.? [v2:172.21.15.89:6837/591220728,v1:172.21.15.89:6839/591220728] up:boot 2024-09-19T06:25:51.015 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:50 smithi002 ceph-mon[30982]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-19T06:25:51.016 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:50 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T06:25:51.016 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:50 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T06:25:51.016 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:50 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:25:51.016 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:50 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:25:51.016 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:50 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T06:25:51.016 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:50 smithi002 ceph-mon[30982]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T06:25:51.016 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:50 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/2796539424' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:25:51.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:50 smithi089 ceph-mon[34160]: mds.? [v2:172.21.15.90:6835/663863978,v1:172.21.15.90:6838/663863978] up:boot 2024-09-19T06:25:51.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:50 smithi089 ceph-mon[34160]: mds.? [v2:172.21.15.90:6834/1485956054,v1:172.21.15.90:6837/1485956054] up:boot 2024-09-19T06:25:51.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:50 smithi089 ceph-mon[34160]: mds.? [v2:172.21.15.90:6836/300504950,v1:172.21.15.90:6839/300504950] up:boot 2024-09-19T06:25:51.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:50 smithi089 ceph-mon[34160]: mds.? [v2:172.21.15.89:6834/4251470508,v1:172.21.15.89:6835/4251470508] up:boot 2024-09-19T06:25:51.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:50 smithi089 ceph-mon[34160]: mds.? [v2:172.21.15.89:6836/683402740,v1:172.21.15.89:6838/683402740] up:boot 2024-09-19T06:25:51.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:50 smithi089 ceph-mon[34160]: mds.? [v2:172.21.15.89:6837/591220728,v1:172.21.15.89:6839/591220728] up:boot 2024-09-19T06:25:51.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:50 smithi089 ceph-mon[34160]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-19T06:25:51.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:50 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T06:25:51.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:50 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T06:25:51.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:50 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:25:51.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:50 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:25:51.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:50 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T06:25:51.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:50 smithi089 ceph-mon[34160]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T06:25:51.043 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:50 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/2796539424' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:25:51.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:50 smithi090 ceph-mon[34497]: mds.? [v2:172.21.15.90:6835/663863978,v1:172.21.15.90:6838/663863978] up:boot 2024-09-19T06:25:51.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:50 smithi090 ceph-mon[34497]: mds.? [v2:172.21.15.90:6834/1485956054,v1:172.21.15.90:6837/1485956054] up:boot 2024-09-19T06:25:51.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:50 smithi090 ceph-mon[34497]: mds.? [v2:172.21.15.90:6836/300504950,v1:172.21.15.90:6839/300504950] up:boot 2024-09-19T06:25:51.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:50 smithi090 ceph-mon[34497]: mds.? [v2:172.21.15.89:6834/4251470508,v1:172.21.15.89:6835/4251470508] up:boot 2024-09-19T06:25:51.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:50 smithi090 ceph-mon[34497]: mds.? [v2:172.21.15.89:6836/683402740,v1:172.21.15.89:6838/683402740] up:boot 2024-09-19T06:25:51.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:50 smithi090 ceph-mon[34497]: mds.? [v2:172.21.15.89:6837/591220728,v1:172.21.15.89:6839/591220728] up:boot 2024-09-19T06:25:51.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:50 smithi090 ceph-mon[34497]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-19T06:25:51.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:50 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T06:25:51.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:50 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T06:25:51.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:50 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:25:51.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:50 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:25:51.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:50 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T06:25:51.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:50 smithi090 ceph-mon[34497]: from='mgr.15144 172.21.15.2:0/1173800599' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T06:25:51.241 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:50 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/2796539424' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:25:51.324 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T06:25:51.585 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:25:51.943 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:51 smithi002 ceph-mon[30982]: pgmap v345: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-19T06:25:51.943 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:51 smithi002 ceph-mon[30982]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T06:25:51.944 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:51 smithi002 ceph-mon[30982]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T06:25:51.944 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:51 smithi002 ceph-mon[30982]: Cluster is now healthy 2024-09-19T06:25:51.944 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:51 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/2796539424' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T06:25:51.944 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:51 smithi002 ceph-mon[30982]: fsmap 12 up:standby 2024-09-19T06:25:52.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.029+0000 7ff10868b640 1 -- 172.21.15.2:0/1896777098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff100102790 msgr2=0x7ff1001067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:52.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.029+0000 7ff10868b640 1 --2- 172.21.15.2:0/1896777098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff100102790 0x7ff1001067e0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0009900 tx=0x7ff0f002a410 comp rx=0 tx=0).stop 2024-09-19T06:25:52.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.029+0000 7ff10868b640 1 -- 172.21.15.2:0/1896777098 shutdown_connections 2024-09-19T06:25:52.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.029+0000 7ff10868b640 1 --2- 172.21.15.2:0/1896777098 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff100106f10 0x7ff10010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:52.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.029+0000 7ff10868b640 1 --2- 172.21.15.2:0/1896777098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff100102790 0x7ff1001067e0 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:52.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.029+0000 7ff10868b640 1 --2- 172.21.15.2:0/1896777098 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff100101de0 0x7ff1001021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:52.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.029+0000 7ff10868b640 1 -- 172.21.15.2:0/1896777098 >> 172.21.15.2:0/1896777098 conn(0x7ff1000fd8c0 msgr2=0x7ff1000ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:52.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.029+0000 7ff10868b640 1 -- 172.21.15.2:0/1896777098 shutdown_connections 2024-09-19T06:25:52.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.029+0000 7ff10868b640 1 -- 172.21.15.2:0/1896777098 wait complete. 2024-09-19T06:25:52.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.030+0000 7ff10868b640 1 Processor -- start 2024-09-19T06:25:52.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.030+0000 7ff10868b640 1 -- start start 2024-09-19T06:25:52.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.030+0000 7ff10868b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff100101de0 0x7ff1001984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:52.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.030+0000 7ff10868b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff100102790 0x7ff100198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:52.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.030+0000 7ff10868b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff100106f10 0x7ff10019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:52.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.030+0000 7ff10868b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff100111f10 con 0x7ff100106f10 2024-09-19T06:25:52.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.030+0000 7ff10868b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff100111d90 con 0x7ff100102790 2024-09-19T06:25:52.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.030+0000 7ff10868b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff100112090 con 0x7ff100101de0 2024-09-19T06:25:52.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.030+0000 7ff106c28640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff100106f10 0x7ff10019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:52.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.030+0000 7ff106c28640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff100106f10 0x7ff10019cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54744/0 (socket says 172.21.15.2:54744) 2024-09-19T06:25:52.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.030+0000 7ff106c28640 1 -- 172.21.15.2:0/1525565711 learned_addr learned my addr 172.21.15.2:0/1525565711 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:25:52.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.030+0000 7ff105c26640 1 --2- 172.21.15.2:0/1525565711 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff100102790 0x7ff100198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:52.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.030+0000 7ff106427640 1 --2- 172.21.15.2:0/1525565711 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff100101de0 0x7ff1001984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:52.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.030+0000 7ff106c28640 1 -- 172.21.15.2:0/1525565711 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff100101de0 msgr2=0x7ff1001984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:52.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.030+0000 7ff106c28640 1 --2- 172.21.15.2:0/1525565711 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff100101de0 0x7ff1001984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:52.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.030+0000 7ff106c28640 1 -- 172.21.15.2:0/1525565711 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff100102790 msgr2=0x7ff100198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:52.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.030+0000 7ff106c28640 1 --2- 172.21.15.2:0/1525565711 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff100102790 0x7ff100198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:52.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.030+0000 7ff106c28640 1 -- 172.21.15.2:0/1525565711 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff10019d470 con 0x7ff100106f10 2024-09-19T06:25:52.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.030+0000 7ff106427640 1 --2- 172.21.15.2:0/1525565711 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff100101de0 0x7ff1001984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:25:52.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.031+0000 7ff106c28640 1 --2- 172.21.15.2:0/1525565711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff100106f10 0x7ff10019cd90 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7ff0f800b970 tx=0x7ff0f800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:52.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.031+0000 7ff0f77fe640 1 -- 172.21.15.2:0/1525565711 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f8019070 con 0x7ff100106f10 2024-09-19T06:25:52.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.031+0000 7ff0f77fe640 1 -- 172.21.15.2:0/1525565711 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff0f8014440 con 0x7ff100106f10 2024-09-19T06:25:52.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.031+0000 7ff10868b640 1 -- 172.21.15.2:0/1525565711 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff10019d760 con 0x7ff100106f10 2024-09-19T06:25:52.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.031+0000 7ff0f77fe640 1 -- 172.21.15.2:0/1525565711 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f80075d0 con 0x7ff100106f10 2024-09-19T06:25:52.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.031+0000 7ff10868b640 1 -- 172.21.15.2:0/1525565711 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1001a5040 con 0x7ff100106f10 2024-09-19T06:25:52.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.032+0000 7ff10868b640 1 -- 172.21.15.2:0/1525565711 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff100102240 con 0x7ff100106f10 2024-09-19T06:25:52.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.033+0000 7ff0f77fe640 1 -- 172.21.15.2:0/1525565711 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7ff0f801c070 con 0x7ff100106f10 2024-09-19T06:25:52.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.034+0000 7ff0f77fe640 1 --2- 172.21.15.2:0/1525565711 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff0ec0a33b0 0x7ff0ec0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:52.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.034+0000 7ff0f77fe640 1 -- 172.21.15.2:0/1525565711 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8735+0+0 (secure 0 0 0) 0x7ff0f80cf2b0 con 0x7ff100106f10 2024-09-19T06:25:52.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.034+0000 7ff106427640 1 --2- 172.21.15.2:0/1525565711 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff0ec0a33b0 0x7ff0ec0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:52.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.034+0000 7ff106427640 1 --2- 172.21.15.2:0/1525565711 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff0ec0a33b0 0x7ff0ec0a5870 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc009930 tx=0x7ff0fc008040 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:52.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.038+0000 7ff0f77fe640 1 -- 172.21.15.2:0/1525565711 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff0f809b680 con 0x7ff100106f10 2024-09-19T06:25:52.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:51 smithi089 ceph-mon[34160]: pgmap v345: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-19T06:25:52.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:51 smithi089 ceph-mon[34160]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T06:25:52.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:51 smithi089 ceph-mon[34160]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T06:25:52.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:51 smithi089 ceph-mon[34160]: Cluster is now healthy 2024-09-19T06:25:52.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:51 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/2796539424' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T06:25:52.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:51 smithi089 ceph-mon[34160]: fsmap 12 up:standby 2024-09-19T06:25:52.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.216+0000 7ff10868b640 1 -- 172.21.15.2:0/1525565711 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff10010a120 con 0x7ff100106f10 2024-09-19T06:25:52.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:51 smithi090 ceph-mon[34497]: pgmap v345: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-19T06:25:52.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:51 smithi090 ceph-mon[34497]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T06:25:52.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:51 smithi090 ceph-mon[34497]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T06:25:52.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:51 smithi090 ceph-mon[34497]: Cluster is now healthy 2024-09-19T06:25:52.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:51 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/2796539424' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T06:25:52.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:51 smithi090 ceph-mon[34497]: fsmap 12 up:standby 2024-09-19T06:25:52.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.764+0000 7ff0f77fe640 1 -- 172.21.15.2:0/1525565711 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v94) ==== 181+0+0 (secure 0 0 0) 0x7ff0f809f980 con 0x7ff100106f10 2024-09-19T06:25:52.765 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' removed 2024-09-19T06:25:52.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.767+0000 7ff10868b640 1 -- 172.21.15.2:0/1525565711 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff0ec0a33b0 msgr2=0x7ff0ec0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:52.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.768+0000 7ff10868b640 1 --2- 172.21.15.2:0/1525565711 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff0ec0a33b0 0x7ff0ec0a5870 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc009930 tx=0x7ff0fc008040 comp rx=0 tx=0).stop 2024-09-19T06:25:52.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.768+0000 7ff10868b640 1 -- 172.21.15.2:0/1525565711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff100106f10 msgr2=0x7ff10019cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:52.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.768+0000 7ff10868b640 1 --2- 172.21.15.2:0/1525565711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff100106f10 0x7ff10019cd90 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7ff0f800b970 tx=0x7ff0f800be30 comp rx=0 tx=0).stop 2024-09-19T06:25:52.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.768+0000 7ff10868b640 1 -- 172.21.15.2:0/1525565711 shutdown_connections 2024-09-19T06:25:52.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.768+0000 7ff10868b640 1 --2- 172.21.15.2:0/1525565711 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7ff0ec0a33b0 0x7ff0ec0a5870 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:52.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.768+0000 7ff10868b640 1 --2- 172.21.15.2:0/1525565711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff100106f10 0x7ff10019cd90 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:52.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.768+0000 7ff10868b640 1 --2- 172.21.15.2:0/1525565711 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff100102790 0x7ff100198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:52.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.768+0000 7ff10868b640 1 --2- 172.21.15.2:0/1525565711 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff100101de0 0x7ff1001984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:52.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.768+0000 7ff10868b640 1 -- 172.21.15.2:0/1525565711 >> 172.21.15.2:0/1525565711 conn(0x7ff1000fd8c0 msgr2=0x7ff1000fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:52.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.768+0000 7ff10868b640 1 -- 172.21.15.2:0/1525565711 shutdown_connections 2024-09-19T06:25:52.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:52.768+0000 7ff10868b640 1 -- 172.21.15.2:0/1525565711 wait complete. 2024-09-19T06:25:53.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:52 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1525565711' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T06:25:53.114 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:52 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1525565711' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T06:25:53.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:52 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1525565711' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T06:25:53.550 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 078f6612-764d-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T06:25:53.816 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:25:54.024 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:53 smithi002 ceph-mon[30982]: pgmap v346: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-19T06:25:54.024 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:53 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1525565711' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T06:25:54.024 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:53 smithi002 ceph-mon[30982]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T06:25:54.041 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:53 smithi089 ceph-mon[34160]: pgmap v346: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-19T06:25:54.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:53 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1525565711' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T06:25:54.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:53 smithi089 ceph-mon[34160]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T06:25:54.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:53 smithi090 ceph-mon[34497]: pgmap v346: 97 pgs: 97 active+clean; 1.9 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-19T06:25:54.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:53 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1525565711' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T06:25:54.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:53 smithi090 ceph-mon[34497]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T06:25:54.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.237+0000 7f9c9fea5640 1 -- 172.21.15.2:0/1544108673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c98102570 msgr2=0x7f9c981029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:54.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.237+0000 7f9c9fea5640 1 --2- 172.21.15.2:0/1544108673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c98102570 0x7f9c981029b0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c009900 tx=0x7f9c8c02a480 comp rx=0 tx=0).stop 2024-09-19T06:25:54.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.237+0000 7f9c9fea5640 1 -- 172.21.15.2:0/1544108673 shutdown_connections 2024-09-19T06:25:54.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.237+0000 7f9c9fea5640 1 --2- 172.21.15.2:0/1544108673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c98102ef0 0x7f9c9810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:54.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.237+0000 7f9c9fea5640 1 --2- 172.21.15.2:0/1544108673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c98102570 0x7f9c981029b0 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:54.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.237+0000 7f9c9fea5640 1 --2- 172.21.15.2:0/1544108673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c98100e20 0x7f9c98101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:54.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.237+0000 7f9c9fea5640 1 -- 172.21.15.2:0/1544108673 >> 172.21.15.2:0/1544108673 conn(0x7f9c980fc7d0 msgr2=0x7f9c980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:54.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.237+0000 7f9c9fea5640 1 -- 172.21.15.2:0/1544108673 shutdown_connections 2024-09-19T06:25:54.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.237+0000 7f9c9fea5640 1 -- 172.21.15.2:0/1544108673 wait complete. 2024-09-19T06:25:54.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.237+0000 7f9c9fea5640 1 Processor -- start 2024-09-19T06:25:54.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.237+0000 7f9c9fea5640 1 -- start start 2024-09-19T06:25:54.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.238+0000 7f9c9fea5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c98100e20 0x7f9c981984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:54.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.238+0000 7f9c9fea5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c98102570 0x7f9c98198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:54.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.238+0000 7f9c9fea5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c98102ef0 0x7f9c9819cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:54.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.238+0000 7f9c9fea5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9c98112020 con 0x7f9c98100e20 2024-09-19T06:25:54.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.238+0000 7f9c9fea5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9c98111ea0 con 0x7f9c98102ef0 2024-09-19T06:25:54.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.238+0000 7f9c9fea5640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9c981121a0 con 0x7f9c98102570 2024-09-19T06:25:54.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.238+0000 7f9c9dc41640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c98100e20 0x7f9c981984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:54.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.238+0000 7f9c9dc41640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c98100e20 0x7f9c981984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54764/0 (socket says 172.21.15.2:54764) 2024-09-19T06:25:54.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.238+0000 7f9c9dc41640 1 -- 172.21.15.2:0/1678853637 learned_addr learned my addr 172.21.15.2:0/1678853637 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-19T06:25:54.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.238+0000 7f9c9d440640 1 --2- 172.21.15.2:0/1678853637 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c98102570 0x7f9c98198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:54.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.238+0000 7f9c9e442640 1 --2- 172.21.15.2:0/1678853637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c98102ef0 0x7f9c9819cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:54.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.238+0000 7f9c9dc41640 1 -- 172.21.15.2:0/1678853637 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c98102570 msgr2=0x7f9c98198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:54.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.238+0000 7f9c9dc41640 1 --2- 172.21.15.2:0/1678853637 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c98102570 0x7f9c98198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:54.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.238+0000 7f9c9dc41640 1 -- 172.21.15.2:0/1678853637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c98102ef0 msgr2=0x7f9c9819cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:54.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.238+0000 7f9c9dc41640 1 --2- 172.21.15.2:0/1678853637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c98102ef0 0x7f9c9819cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:54.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.238+0000 7f9c9dc41640 1 -- 172.21.15.2:0/1678853637 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c9819d4a0 con 0x7f9c98100e20 2024-09-19T06:25:54.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.238+0000 7f9c9e442640 1 --2- 172.21.15.2:0/1678853637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c98102ef0 0x7f9c9819cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:25:54.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.238+0000 7f9c9dc41640 1 --2- 172.21.15.2:0/1678853637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c98100e20 0x7f9c981984f0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f9c8800ba50 tx=0x7f9c8800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:54.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.239+0000 7f9c96ffd640 1 -- 172.21.15.2:0/1678853637 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c88019070 con 0x7f9c98100e20 2024-09-19T06:25:54.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.239+0000 7f9c96ffd640 1 -- 172.21.15.2:0/1678853637 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9c8800cbe0 con 0x7f9c98100e20 2024-09-19T06:25:54.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.239+0000 7f9c9fea5640 1 -- 172.21.15.2:0/1678853637 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c9819d790 con 0x7f9c98100e20 2024-09-19T06:25:54.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.239+0000 7f9c96ffd640 1 -- 172.21.15.2:0/1678853637 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c880075d0 con 0x7f9c98100e20 2024-09-19T06:25:54.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.239+0000 7f9c9fea5640 1 -- 172.21.15.2:0/1678853637 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c981a5070 con 0x7f9c98100e20 2024-09-19T06:25:54.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.240+0000 7f9c9fea5640 1 -- 172.21.15.2:0/1678853637 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c98101200 con 0x7f9c98100e20 2024-09-19T06:25:54.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.241+0000 7f9c96ffd640 1 -- 172.21.15.2:0/1678853637 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) ==== 138485+0+0 (secure 0 0 0) 0x7f9c8801c070 con 0x7f9c98100e20 2024-09-19T06:25:54.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.242+0000 7f9c96ffd640 1 --2- 172.21.15.2:0/1678853637 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9c800a3430 0x7f9c800a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:54.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.242+0000 7f9c96ffd640 1 -- 172.21.15.2:0/1678853637 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8181+0+0 (secure 0 0 0) 0x7f9c880cf120 con 0x7f9c98100e20 2024-09-19T06:25:54.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.242+0000 7f9c9d440640 1 --2- 172.21.15.2:0/1678853637 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9c800a3430 0x7f9c800a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:54.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.242+0000 7f9c9d440640 1 --2- 172.21.15.2:0/1678853637 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9c800a3430 0x7f9c800a58f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c000c00 tx=0x7f9c8c005a20 comp rx=0 tx=0).ready entity=mgr.15144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:54.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.246+0000 7f9c96ffd640 1 -- 172.21.15.2:0/1678853637 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9c8809bd60 con 0x7f9c98100e20 2024-09-19T06:25:54.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.423+0000 7f9c9fea5640 1 -- 172.21.15.2:0/1678853637 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9c98109090 con 0x7f9c98100e20 2024-09-19T06:25:54.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.770+0000 7f9c96ffd640 1 -- 172.21.15.2:0/1678853637 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v95) ==== 169+0+0 (secure 0 0 0) 0x7f9c8809b660 con 0x7f9c98100e20 2024-09-19T06:25:54.772 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' removed 2024-09-19T06:25:54.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.773+0000 7f9c9fea5640 1 -- 172.21.15.2:0/1678853637 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9c800a3430 msgr2=0x7f9c800a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:54.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.773+0000 7f9c9fea5640 1 --2- 172.21.15.2:0/1678853637 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9c800a3430 0x7f9c800a58f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c000c00 tx=0x7f9c8c005a20 comp rx=0 tx=0).stop 2024-09-19T06:25:54.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.773+0000 7f9c9fea5640 1 -- 172.21.15.2:0/1678853637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c98100e20 msgr2=0x7f9c981984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:54.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.773+0000 7f9c9fea5640 1 --2- 172.21.15.2:0/1678853637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c98100e20 0x7f9c981984f0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f9c8800ba50 tx=0x7f9c8800bf10 comp rx=0 tx=0).stop 2024-09-19T06:25:54.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.774+0000 7f9c9fea5640 1 -- 172.21.15.2:0/1678853637 shutdown_connections 2024-09-19T06:25:54.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.774+0000 7f9c9fea5640 1 --2- 172.21.15.2:0/1678853637 >> [v2:172.21.15.2:6800/1594569191,v1:172.21.15.2:6801/1594569191] conn(0x7f9c800a3430 0x7f9c800a58f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:54.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.774+0000 7f9c9fea5640 1 --2- 172.21.15.2:0/1678853637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c98102ef0 0x7f9c9819cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:54.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.774+0000 7f9c9fea5640 1 --2- 172.21.15.2:0/1678853637 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c98102570 0x7f9c98198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:54.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.774+0000 7f9c9fea5640 1 --2- 172.21.15.2:0/1678853637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c98100e20 0x7f9c981984f0 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:54.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.774+0000 7f9c9fea5640 1 -- 172.21.15.2:0/1678853637 >> 172.21.15.2:0/1678853637 conn(0x7f9c980fc7d0 msgr2=0x7f9c980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:54.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.775+0000 7f9c9fea5640 1 -- 172.21.15.2:0/1678853637 shutdown_connections 2024-09-19T06:25:54.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-19T06:25:54.775+0000 7f9c9fea5640 1 -- 172.21.15.2:0/1678853637 wait complete. 2024-09-19T06:25:55.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:54 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1678853637' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T06:25:55.062 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:54 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1678853637' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T06:25:55.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:54 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1678853637' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T06:25:55.390 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:25:55.421 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:25:55.453 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:25:55.485 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-19T06:25:55.486 DEBUG:teuthology.orchestra.run.smithi002:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T06:25:55.504 DEBUG:teuthology.orchestra.run.smithi089:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T06:25:55.521 DEBUG:teuthology.orchestra.run.smithi090:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T06:25:55.544 INFO:tasks.cephadm:Stopping all daemons... 2024-09-19T06:25:55.544 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-19T06:25:55.544 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-078f6612-764d-11ef-bceb-c7b262605968@mon.a 2024-09-19T06:25:55.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:55 smithi002 systemd[1]: Stopping Ceph mon.a for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:25:56.041 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:55 smithi002 ceph-mon[30982]: pgmap v348: 65 pgs: 65 active+clean; 577 KiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:25:56.041 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:55 smithi002 ceph-mon[30982]: from='client.? 172.21.15.2:0/1678853637' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T06:25:56.041 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:55 smithi002 ceph-mon[30982]: osdmap e95: 12 total, 12 up, 12 in 2024-09-19T06:25:56.041 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:55 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mon-a[30978]: 2024-09-19T06:25:55.865+0000 7f9f0f928640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:25:56.041 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:55 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mon-a[30978]: 2024-09-19T06:25:55.865+0000 7f9f0f928640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-19T06:25:56.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:55 smithi089 ceph-mon[34160]: pgmap v348: 65 pgs: 65 active+clean; 577 KiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:25:56.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:55 smithi089 ceph-mon[34160]: from='client.? 172.21.15.2:0/1678853637' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T06:25:56.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:55 smithi089 ceph-mon[34160]: osdmap e95: 12 total, 12 up, 12 in 2024-09-19T06:25:56.239 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:55 smithi090 ceph-mon[34497]: pgmap v348: 65 pgs: 65 active+clean; 577 KiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:25:56.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:55 smithi090 ceph-mon[34497]: from='client.? 172.21.15.2:0/1678853637' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T06:25:56.240 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:55 smithi090 ceph-mon[34497]: osdmap e95: 12 total, 12 up, 12 in 2024-09-19T06:25:56.327 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:56 smithi002 podman[118583]: 2024-09-19 06:25:56.040182832 +0000 UTC m=+0.285065963 container died 61e6476b375d0595726df2baaf0abdfbe8296ac4482c3b3e828206d2431c9d1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mon-a, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-19T06:25:56.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:56 smithi002 podman[118583]: 2024-09-19 06:25:56.516537556 +0000 UTC m=+0.761420687 container cleanup 61e6476b375d0595726df2baaf0abdfbe8296ac4482c3b3e828206d2431c9d1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-19T06:25:56.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 19 06:25:56 smithi002 bash[118583]: ceph-078f6612-764d-11ef-bceb-c7b262605968-mon-a 2024-09-19T06:25:56.881 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@mon.a.service' 2024-09-19T06:25:56.924 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:25:56.925 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-19T06:25:56.925 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-19T06:25:56.925 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-078f6612-764d-11ef-bceb-c7b262605968@mon.b 2024-09-19T06:25:57.221 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:56 smithi089 systemd[1]: Stopping Ceph mon.b for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:25:57.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:57 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mon-b[34156]: 2024-09-19T06:25:57.218+0000 7f679a8aa640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:25:57.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:57 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mon-b[34156]: 2024-09-19T06:25:57.218+0000 7f679a8aa640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-19T06:25:57.543 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:57 smithi089 podman[69011]: 2024-09-19 06:25:57.444849007 +0000 UTC m=+0.325714545 container died 10e7a033d3342b8a56d802310516e64a810b0a0033bedc39000d5fbd81683ab5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mon-b, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-19T06:25:58.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:57 smithi089 podman[69011]: 2024-09-19 06:25:57.835891339 +0000 UTC m=+0.716756875 container cleanup 10e7a033d3342b8a56d802310516e64a810b0a0033bedc39000d5fbd81683ab5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mon-b, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux ) 2024-09-19T06:25:58.042 INFO:journalctl@ceph.mon.b.smithi089.stdout:Sep 19 06:25:57 smithi089 bash[69011]: ceph-078f6612-764d-11ef-bceb-c7b262605968-mon-b 2024-09-19T06:25:58.260 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@mon.b.service' 2024-09-19T06:25:58.335 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:25:58.335 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-19T06:25:58.336 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-19T06:25:58.336 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ceph-078f6612-764d-11ef-bceb-c7b262605968@mon.c 2024-09-19T06:25:58.639 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:58 smithi090 systemd[1]: Stopping Ceph mon.c for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:25:58.901 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:58 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mon-c[34493]: 2024-09-19T06:25:58.637+0000 7f7094dcb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:25:58.901 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:58 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mon-c[34493]: 2024-09-19T06:25:58.637+0000 7f7094dcb640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-19T06:25:58.901 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:58 smithi090 podman[70324]: 2024-09-19 06:25:58.81091905 +0000 UTC m=+0.278567605 container died ddaf5a97aa8b1603dea8bd23e7da4bfe34d711bcb0817c8867252cb0c0529d78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mon-c, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:25:59.432 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:59 smithi090 podman[70324]: 2024-09-19 06:25:59.180544116 +0000 UTC m=+0.648192680 container cleanup ddaf5a97aa8b1603dea8bd23e7da4bfe34d711bcb0817c8867252cb0c0529d78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mon-c, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:25:59.433 INFO:journalctl@ceph.mon.c.smithi090.stdout:Sep 19 06:25:59 smithi090 bash[70324]: ceph-078f6612-764d-11ef-bceb-c7b262605968-mon-c 2024-09-19T06:25:59.653 DEBUG:teuthology.orchestra.run.smithi090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@mon.c.service' 2024-09-19T06:25:59.701 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:25:59.701 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-19T06:25:59.702 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-19T06:25:59.702 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-078f6612-764d-11ef-bceb-c7b262605968@mgr.x 2024-09-19T06:25:59.997 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:25:59 smithi002 systemd[1]: Stopping Ceph mgr.x for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:26:00.281 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:25:59 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x[31211]: 2024-09-19T06:25:59.994+0000 7fbd01243640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:26:00.281 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:26:00 smithi002 podman[118706]: 2024-09-19 06:26:00.026476854 +0000 UTC m=+0.124703228 container died 74011ddbdaeee5c381e1eaafd453238de364f4c71fff97f3ca852131caa9ea42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2) 2024-09-19T06:26:00.722 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:26:00 smithi002 podman[118706]: 2024-09-19 06:26:00.479028705 +0000 UTC m=+0.577255078 container cleanup 74011ddbdaeee5c381e1eaafd453238de364f4c71fff97f3ca852131caa9ea42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-19T06:26:00.722 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 19 06:26:00 smithi002 bash[118706]: ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-x 2024-09-19T06:26:00.904 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-19T06:26:00.941 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:26:00.941 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-19T06:26:00.941 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-19T06:26:00.941 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-078f6612-764d-11ef-bceb-c7b262605968@mgr.y 2024-09-19T06:26:01.272 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:26:00 smithi089 systemd[1]: Stopping Ceph mgr.y for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:26:01.542 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:26:01 smithi089 podman[69136]: 2024-09-19 06:26:01.271267835 +0000 UTC m=+0.140702388 container died a85a1cae896c99f0e8ef37d17bc88f23a3756938746cb1fdbff0bdb2fc0c0622 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2) 2024-09-19T06:26:01.918 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:26:01 smithi089 podman[69136]: 2024-09-19 06:26:01.657320836 +0000 UTC m=+0.526755457 container cleanup a85a1cae896c99f0e8ef37d17bc88f23a3756938746cb1fdbff0bdb2fc0c0622 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True) 2024-09-19T06:26:01.918 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 19 06:26:01 smithi089 bash[69136]: ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-y 2024-09-19T06:26:02.092 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-19T06:26:02.128 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:26:02.128 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-19T06:26:02.128 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-19T06:26:02.128 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ceph-078f6612-764d-11ef-bceb-c7b262605968@mgr.z 2024-09-19T06:26:02.451 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:26:02 smithi090 systemd[1]: Stopping Ceph mgr.z for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:26:02.740 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:26:02 smithi090 podman[70461]: 2024-09-19 06:26:02.449722105 +0000 UTC m=+0.128575563 container died dbce46062315ffbfb32897cf0229a8efb5ff89d635ab4dc3f4bc2d069481cdf7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux ) 2024-09-19T06:26:03.056 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:26:02 smithi090 podman[70461]: 2024-09-19 06:26:02.862336814 +0000 UTC m=+0.541190266 container cleanup dbce46062315ffbfb32897cf0229a8efb5ff89d635ab4dc3f4bc2d069481cdf7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T06:26:03.056 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:26:02 smithi090 bash[70461]: ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z 2024-09-19T06:26:03.306 DEBUG:teuthology.orchestra.run.smithi090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-19T06:26:03.329 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:26:03 smithi090 podman[70474]: 2024-09-19 06:26:03.055581691 +0000 UTC m=+0.609014513 container remove dbce46062315ffbfb32897cf0229a8efb5ff89d635ab4dc3f4bc2d069481cdf7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mgr-z, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:26:03.329 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:26:03 smithi090 systemd[1]: ceph-078f6612-764d-11ef-bceb-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-09-19T06:26:03.329 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:26:03 smithi090 systemd[1]: ceph-078f6612-764d-11ef-bceb-c7b262605968@mgr.z.service: Failed with result 'exit-code'. 2024-09-19T06:26:03.329 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:26:03 smithi090 systemd[1]: Stopped Ceph mgr.z for 078f6612-764d-11ef-bceb-c7b262605968. 2024-09-19T06:26:03.330 INFO:journalctl@ceph.mgr.z.smithi090.stdout:Sep 19 06:26:03 smithi090 systemd[1]: ceph-078f6612-764d-11ef-bceb-c7b262605968@mgr.z.service: Consumed 11.408s CPU time. 2024-09-19T06:26:03.343 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:26:03.343 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-19T06:26:03.343 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-19T06:26:03.343 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-078f6612-764d-11ef-bceb-c7b262605968@osd.0 2024-09-19T06:26:03.634 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 06:26:03 smithi002 systemd[1]: Stopping Ceph osd.0 for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:26:03.972 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 06:26:03 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-0[44988]: 2024-09-19T06:26:03.632+0000 7efd08a1a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:26:03.972 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 06:26:03 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-0[44988]: 2024-09-19T06:26:03.632+0000 7efd08a1a640 -1 osd.0 95 *** Got signal Terminated *** 2024-09-19T06:26:03.972 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 06:26:03 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-0[44988]: 2024-09-19T06:26:03.632+0000 7efd08a1a640 -1 osd.0 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:26:09.244 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 06:26:08 smithi002 podman[118829]: 2024-09-19 06:26:08.977382293 +0000 UTC m=+5.442493273 container died b98423a23efa7d2443e7b9fdbb254868204aceaf30a67439c693786d30b9dea9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-19T06:26:09.602 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 06:26:09 smithi002 podman[118829]: 2024-09-19 06:26:09.407959887 +0000 UTC m=+5.873070855 container cleanup b98423a23efa7d2443e7b9fdbb254868204aceaf30a67439c693786d30b9dea9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True) 2024-09-19T06:26:09.602 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 06:26:09 smithi002 bash[118829]: ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-0 2024-09-19T06:26:09.972 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 06:26:09 smithi002 podman[118845]: 2024-09-19 06:26:09.601117908 +0000 UTC m=+0.620908713 container remove b98423a23efa7d2443e7b9fdbb254868204aceaf30a67439c693786d30b9dea9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0) 2024-09-19T06:26:10.321 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 06:26:10 smithi002 podman[118932]: 2024-09-19 06:26:09.931205559 +0000 UTC m=+0.016220449 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:26:10.321 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 06:26:10 smithi002 podman[118932]: 2024-09-19 06:26:10.035094074 +0000 UTC m=+0.120108944 container create a461ad94758e1816f08dfc706c1bff7c1a1a895d759c11dce0546d724fddd38a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-0-deactivate, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-19T06:26:10.322 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 06:26:10 smithi002 podman[118932]: 2024-09-19 06:26:10.245800872 +0000 UTC m=+0.330815754 container init a461ad94758e1816f08dfc706c1bff7c1a1a895d759c11dce0546d724fddd38a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True) 2024-09-19T06:26:10.322 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 06:26:10 smithi002 podman[118932]: 2024-09-19 06:26:10.249190886 +0000 UTC m=+0.334205763 container start a461ad94758e1816f08dfc706c1bff7c1a1a895d759c11dce0546d724fddd38a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:26:10.322 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 06:26:10 smithi002 podman[118932]: 2024-09-19 06:26:10.320789785 +0000 UTC m=+0.405804664 container attach a461ad94758e1816f08dfc706c1bff7c1a1a895d759c11dce0546d724fddd38a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:26:10.708 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 06:26:10 smithi002 podman[118932]: 2024-09-19 06:26:10.440154252 +0000 UTC m=+0.525169132 container died a461ad94758e1816f08dfc706c1bff7c1a1a895d759c11dce0546d724fddd38a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-19T06:26:10.964 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 19 06:26:10 smithi002 podman[118956]: 2024-09-19 06:26:10.949426487 +0000 UTC m=+0.499585627 container remove a461ad94758e1816f08dfc706c1bff7c1a1a895d759c11dce0546d724fddd38a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-19T06:26:10.969 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@osd.0.service' 2024-09-19T06:26:11.013 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:26:11.013 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-19T06:26:11.013 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-19T06:26:11.013 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-078f6612-764d-11ef-bceb-c7b262605968@osd.1 2024-09-19T06:26:11.292 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 19 06:26:11 smithi089 systemd[1]: Stopping Ceph osd.1 for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:26:11.792 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 19 06:26:11 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-1[38628]: 2024-09-19T06:26:11.318+0000 7fdc89642640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:26:11.792 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 19 06:26:11 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-1[38628]: 2024-09-19T06:26:11.318+0000 7fdc89642640 -1 osd.1 95 *** Got signal Terminated *** 2024-09-19T06:26:11.792 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 19 06:26:11 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-1[38628]: 2024-09-19T06:26:11.318+0000 7fdc89642640 -1 osd.1 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:26:17.163 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 19 06:26:16 smithi089 podman[69261]: 2024-09-19 06:26:16.863251863 +0000 UTC m=+5.654539249 container died ac406e8754bda7a486202e4f55f1054a3db341256559bbd8c5c93d4cebbfca67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-1, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-19T06:26:17.446 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 19 06:26:17 smithi089 podman[69261]: 2024-09-19 06:26:17.260989165 +0000 UTC m=+6.052276541 container cleanup ac406e8754bda7a486202e4f55f1054a3db341256559bbd8c5c93d4cebbfca67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-1, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:26:17.446 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 19 06:26:17 smithi089 bash[69261]: ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-1 2024-09-19T06:26:17.792 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 19 06:26:17 smithi089 podman[69277]: 2024-09-19 06:26:17.445675214 +0000 UTC m=+0.577721232 container remove ac406e8754bda7a486202e4f55f1054a3db341256559bbd8c5c93d4cebbfca67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-1, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:26:18.133 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 19 06:26:17 smithi089 podman[69363]: 2024-09-19 06:26:17.772723662 +0000 UTC m=+0.015804136 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:26:18.133 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 19 06:26:17 smithi089 podman[69363]: 2024-09-19 06:26:17.888263387 +0000 UTC m=+0.131343855 container create 6c075a101022d70f3b0c29eaf17655bf00b9ccd46a137ed4926b8874b75d20f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, io.buildah.version=1.37.2) 2024-09-19T06:26:18.542 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 19 06:26:18 smithi089 podman[69363]: 2024-09-19 06:26:18.132263377 +0000 UTC m=+0.375343854 container init 6c075a101022d70f3b0c29eaf17655bf00b9ccd46a137ed4926b8874b75d20f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0) 2024-09-19T06:26:18.542 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 19 06:26:18 smithi089 podman[69363]: 2024-09-19 06:26:18.135825422 +0000 UTC m=+0.378905892 container start 6c075a101022d70f3b0c29eaf17655bf00b9ccd46a137ed4926b8874b75d20f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:26:18.542 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 19 06:26:18 smithi089 podman[69363]: 2024-09-19 06:26:18.257383291 +0000 UTC m=+0.500463763 container attach 6c075a101022d70f3b0c29eaf17655bf00b9ccd46a137ed4926b8874b75d20f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-19T06:26:18.542 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 19 06:26:18 smithi089 podman[69363]: 2024-09-19 06:26:18.330765357 +0000 UTC m=+0.573845824 container died 6c075a101022d70f3b0c29eaf17655bf00b9ccd46a137ed4926b8874b75d20f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-19T06:26:18.993 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@osd.1.service' 2024-09-19T06:26:19.037 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:26:19.037 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-19T06:26:19.037 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-19T06:26:19.037 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ceph-078f6612-764d-11ef-bceb-c7b262605968@osd.2 2024-09-19T06:26:19.344 INFO:journalctl@ceph.osd.2.smithi090.stdout:Sep 19 06:26:19 smithi090 systemd[1]: Stopping Ceph osd.2 for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:26:19.740 INFO:journalctl@ceph.osd.2.smithi090.stdout:Sep 19 06:26:19 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-2[39473]: 2024-09-19T06:26:19.342+0000 7f5152231640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:26:19.740 INFO:journalctl@ceph.osd.2.smithi090.stdout:Sep 19 06:26:19 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-2[39473]: 2024-09-19T06:26:19.342+0000 7f5152231640 -1 osd.2 95 *** Got signal Terminated *** 2024-09-19T06:26:19.740 INFO:journalctl@ceph.osd.2.smithi090.stdout:Sep 19 06:26:19 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-2[39473]: 2024-09-19T06:26:19.342+0000 7f5152231640 -1 osd.2 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:26:25.047 INFO:journalctl@ceph.osd.2.smithi090.stdout:Sep 19 06:26:24 smithi090 podman[70587]: 2024-09-19 06:26:24.771417536 +0000 UTC m=+5.538661211 container died cc12f0767f4a3e429bfd2a0a0c74d870ea258d80ed6923eaaab4d74bdccdfdfe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-19T06:26:25.397 INFO:journalctl@ceph.osd.2.smithi090.stdout:Sep 19 06:26:25 smithi090 podman[70587]: 2024-09-19 06:26:25.14499865 +0000 UTC m=+5.912242318 container cleanup cc12f0767f4a3e429bfd2a0a0c74d870ea258d80ed6923eaaab4d74bdccdfdfe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-19T06:26:25.398 INFO:journalctl@ceph.osd.2.smithi090.stdout:Sep 19 06:26:25 smithi090 bash[70587]: ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-2 2024-09-19T06:26:25.713 INFO:journalctl@ceph.osd.2.smithi090.stdout:Sep 19 06:26:25 smithi090 podman[70602]: 2024-09-19 06:26:25.396933802 +0000 UTC m=+0.624376003 container remove cc12f0767f4a3e429bfd2a0a0c74d870ea258d80ed6923eaaab4d74bdccdfdfe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-19T06:26:25.968 INFO:journalctl@ceph.osd.2.smithi090.stdout:Sep 19 06:26:25 smithi090 podman[70690]: 2024-09-19 06:26:25.614912803 +0000 UTC m=+0.015955893 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:26:25.968 INFO:journalctl@ceph.osd.2.smithi090.stdout:Sep 19 06:26:25 smithi090 podman[70690]: 2024-09-19 06:26:25.714594375 +0000 UTC m=+0.115637450 container create c7837e1c0a065b09221b5d8865851423158c2f2f80b8465b1271442be9b3ffa5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-19T06:26:25.968 INFO:journalctl@ceph.osd.2.smithi090.stdout:Sep 19 06:26:25 smithi090 podman[70690]: 2024-09-19 06:26:25.967612281 +0000 UTC m=+0.368655356 container init c7837e1c0a065b09221b5d8865851423158c2f2f80b8465b1271442be9b3ffa5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-19T06:26:26.240 INFO:journalctl@ceph.osd.2.smithi090.stdout:Sep 19 06:26:25 smithi090 podman[70690]: 2024-09-19 06:26:25.970935102 +0000 UTC m=+0.371978178 container start c7837e1c0a065b09221b5d8865851423158c2f2f80b8465b1271442be9b3ffa5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-2-deactivate, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-19T06:26:26.240 INFO:journalctl@ceph.osd.2.smithi090.stdout:Sep 19 06:26:26 smithi090 podman[70690]: 2024-09-19 06:26:26.067801278 +0000 UTC m=+0.468844361 container attach c7837e1c0a065b09221b5d8865851423158c2f2f80b8465b1271442be9b3ffa5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-2-deactivate, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:26:26.240 INFO:journalctl@ceph.osd.2.smithi090.stdout:Sep 19 06:26:26 smithi090 podman[70690]: 2024-09-19 06:26:26.168348093 +0000 UTC m=+0.569391178 container died c7837e1c0a065b09221b5d8865851423158c2f2f80b8465b1271442be9b3ffa5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-19T06:26:26.771 DEBUG:teuthology.orchestra.run.smithi090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@osd.2.service' 2024-09-19T06:26:26.810 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:26:26.810 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-19T06:26:26.811 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-19T06:26:26.811 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-078f6612-764d-11ef-bceb-c7b262605968@osd.3 2024-09-19T06:26:27.110 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 19 06:26:26 smithi002 systemd[1]: Stopping Ceph osd.3 for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:26:27.472 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 19 06:26:27 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-3[51470]: 2024-09-19T06:26:27.107+0000 7f4af645b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:26:27.472 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 19 06:26:27 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-3[51470]: 2024-09-19T06:26:27.107+0000 7f4af645b640 -1 osd.3 95 *** Got signal Terminated *** 2024-09-19T06:26:27.472 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 19 06:26:27 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-3[51470]: 2024-09-19T06:26:27.107+0000 7f4af645b640 -1 osd.3 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:26:30.042 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:29 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:29.982+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:26:30.722 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:30 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:30.363+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:03.820828+0000 front 2024-09-19T06:26:03.820911+0000 (oldest deadline 2024-09-19T06:26:29.720849+0000) 2024-09-19T06:26:30.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:30 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:30.472+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:26:31.292 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:30 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:30.988+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:26:31.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:31 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:31.486+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:26:31.722 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:31 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:31.334+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:03.820828+0000 front 2024-09-19T06:26:03.820911+0000 (oldest deadline 2024-09-19T06:26:29.720849+0000) 2024-09-19T06:26:32.239 INFO:journalctl@ceph.osd.5.smithi090.stdout:Sep 19 06:26:31 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-5[46234]: 2024-09-19T06:26:31.906+0000 7f3ea46b3640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.873978+0000 front 2024-09-19T06:26:06.873941+0000 (oldest deadline 2024-09-19T06:26:30.973777+0000) 2024-09-19T06:26:32.292 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:31 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:31.967+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:26:32.722 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:32 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:32.342+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:03.820828+0000 front 2024-09-19T06:26:03.820911+0000 (oldest deadline 2024-09-19T06:26:29.720849+0000) 2024-09-19T06:26:32.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:32 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:32.468+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:26:32.723 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 19 06:26:32 smithi002 podman[119036]: 2024-09-19 06:26:32.569271629 +0000 UTC m=+5.552639846 container died 2f5c9b5a760bb9124dde2c9063241a9d409dc53cb5b7f915238f3d500a16b10b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-3, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:26:32.903 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:32 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:32.636+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:26:33.222 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 19 06:26:33 smithi002 podman[119036]: 2024-09-19 06:26:33.050530536 +0000 UTC m=+6.033898796 container cleanup 2f5c9b5a760bb9124dde2c9063241a9d409dc53cb5b7f915238f3d500a16b10b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-19T06:26:33.222 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 19 06:26:33 smithi002 bash[119036]: ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-3 2024-09-19T06:26:33.239 INFO:journalctl@ceph.osd.5.smithi090.stdout:Sep 19 06:26:32 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-5[46234]: 2024-09-19T06:26:32.902+0000 7f3ea46b3640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.873978+0000 front 2024-09-19T06:26:06.873941+0000 (oldest deadline 2024-09-19T06:26:30.973777+0000) 2024-09-19T06:26:33.292 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:32 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:32.930+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:26:33.658 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:33 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:33.315+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:03.820828+0000 front 2024-09-19T06:26:03.820911+0000 (oldest deadline 2024-09-19T06:26:29.720849+0000) 2024-09-19T06:26:33.658 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:33 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:33.425+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:26:33.659 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 19 06:26:33 smithi002 podman[119053]: 2024-09-19 06:26:33.344372644 +0000 UTC m=+0.766402898 container remove 2f5c9b5a760bb9124dde2c9063241a9d409dc53cb5b7f915238f3d500a16b10b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:26:33.911 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:33 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:33.657+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:26:33.972 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 19 06:26:33 smithi002 podman[119140]: 2024-09-19 06:26:33.559688868 +0000 UTC m=+0.015983554 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:26:33.972 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 19 06:26:33 smithi002 podman[119140]: 2024-09-19 06:26:33.678429293 +0000 UTC m=+0.134723963 container create cfefb753244c1bd208e6a5a77142a0ab5efe5282c30f20b14aa11de98b0e4c3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-19T06:26:33.972 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 19 06:26:33 smithi002 podman[119140]: 2024-09-19 06:26:33.86417722 +0000 UTC m=+0.320471901 container init cfefb753244c1bd208e6a5a77142a0ab5efe5282c30f20b14aa11de98b0e4c3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:26:33.972 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 19 06:26:33 smithi002 podman[119140]: 2024-09-19 06:26:33.867720076 +0000 UTC m=+0.324014754 container start cfefb753244c1bd208e6a5a77142a0ab5efe5282c30f20b14aa11de98b0e4c3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-19T06:26:34.239 INFO:journalctl@ceph.osd.5.smithi090.stdout:Sep 19 06:26:33 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-5[46234]: 2024-09-19T06:26:33.910+0000 7f3ea46b3640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.873978+0000 front 2024-09-19T06:26:06.873941+0000 (oldest deadline 2024-09-19T06:26:30.973777+0000) 2024-09-19T06:26:34.277 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 19 06:26:33 smithi002 podman[119140]: 2024-09-19 06:26:33.972245439 +0000 UTC m=+0.428540116 container attach cfefb753244c1bd208e6a5a77142a0ab5efe5282c30f20b14aa11de98b0e4c3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2) 2024-09-19T06:26:34.277 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 19 06:26:34 smithi002 podman[119140]: 2024-09-19 06:26:34.070462488 +0000 UTC m=+0.526757192 container died cfefb753244c1bd208e6a5a77142a0ab5efe5282c30f20b14aa11de98b0e4c3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-19T06:26:34.292 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:33 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:33.949+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:26:34.643 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:34 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:34.275+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:03.820828+0000 front 2024-09-19T06:26:03.820911+0000 (oldest deadline 2024-09-19T06:26:29.720849+0000) 2024-09-19T06:26:34.644 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:34 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:34.401+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:26:34.674 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@osd.3.service' 2024-09-19T06:26:34.717 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:26:34.717 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-19T06:26:34.717 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-19T06:26:34.718 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-078f6612-764d-11ef-bceb-c7b262605968@osd.4 2024-09-19T06:26:34.866 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:34 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:34.612+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:26:34.867 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:34 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:34.840+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.373916+0000 front 2024-09-19T06:26:06.373780+0000 (oldest deadline 2024-09-19T06:26:33.974229+0000) 2024-09-19T06:26:35.022 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 19 06:26:34 smithi089 systemd[1]: Stopping Ceph osd.4 for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:26:35.022 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:34 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:34.988+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:26:35.239 INFO:journalctl@ceph.osd.5.smithi090.stdout:Sep 19 06:26:34 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-5[46234]: 2024-09-19T06:26:34.865+0000 7f3ea46b3640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.873978+0000 front 2024-09-19T06:26:06.873941+0000 (oldest deadline 2024-09-19T06:26:30.973777+0000) 2024-09-19T06:26:35.292 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 19 06:26:35 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-4[45135]: 2024-09-19T06:26:35.021+0000 7f5449f3a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:26:35.292 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 19 06:26:35 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-4[45135]: 2024-09-19T06:26:35.021+0000 7f5449f3a640 -1 osd.4 95 *** Got signal Terminated *** 2024-09-19T06:26:35.292 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 19 06:26:35 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-4[45135]: 2024-09-19T06:26:35.021+0000 7f5449f3a640 -1 osd.4 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:26:35.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:35 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:35.393+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:26:35.723 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:35 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:35.282+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:03.820828+0000 front 2024-09-19T06:26:03.820911+0000 (oldest deadline 2024-09-19T06:26:29.720849+0000) 2024-09-19T06:26:35.905 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:35 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:35.613+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:26:35.905 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:35 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:35.810+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.373916+0000 front 2024-09-19T06:26:06.373780+0000 (oldest deadline 2024-09-19T06:26:33.974229+0000) 2024-09-19T06:26:36.239 INFO:journalctl@ceph.osd.5.smithi090.stdout:Sep 19 06:26:35 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-5[46234]: 2024-09-19T06:26:35.904+0000 7f3ea46b3640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.873978+0000 front 2024-09-19T06:26:06.873941+0000 (oldest deadline 2024-09-19T06:26:30.973777+0000) 2024-09-19T06:26:36.292 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:35 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:35.960+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:26:36.722 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:36 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:36.292+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:03.820828+0000 front 2024-09-19T06:26:03.820911+0000 (oldest deadline 2024-09-19T06:26:29.720849+0000) 2024-09-19T06:26:36.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:36 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:36.352+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:26:36.853 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:36 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:36.580+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:26:37.239 INFO:journalctl@ceph.osd.5.smithi090.stdout:Sep 19 06:26:36 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-5[46234]: 2024-09-19T06:26:36.949+0000 7f3ea46b3640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.873978+0000 front 2024-09-19T06:26:06.873941+0000 (oldest deadline 2024-09-19T06:26:30.973777+0000) 2024-09-19T06:26:37.240 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:36 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:36.852+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.373916+0000 front 2024-09-19T06:26:06.373780+0000 (oldest deadline 2024-09-19T06:26:33.974229+0000) 2024-09-19T06:26:37.292 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:37 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:37.007+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:26:37.722 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:37 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:37.329+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:03.820828+0000 front 2024-09-19T06:26:03.820911+0000 (oldest deadline 2024-09-19T06:26:29.720849+0000) 2024-09-19T06:26:37.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:37 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:37.359+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:26:37.739 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:37 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:37.587+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:26:38.240 INFO:journalctl@ceph.osd.5.smithi090.stdout:Sep 19 06:26:37 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-5[46234]: 2024-09-19T06:26:37.991+0000 7f3ea46b3640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.873978+0000 front 2024-09-19T06:26:06.873941+0000 (oldest deadline 2024-09-19T06:26:30.973777+0000) 2024-09-19T06:26:38.240 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:37 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:37.892+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.373916+0000 front 2024-09-19T06:26:06.373780+0000 (oldest deadline 2024-09-19T06:26:33.974229+0000) 2024-09-19T06:26:38.292 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:38 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:38.020+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:26:38.722 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:38 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:38.308+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:03.820828+0000 front 2024-09-19T06:26:03.820911+0000 (oldest deadline 2024-09-19T06:26:29.720849+0000) 2024-09-19T06:26:38.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:38 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:38.385+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:26:38.948 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:38 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:38.633+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:26:38.948 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:38 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:38.871+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.373916+0000 front 2024-09-19T06:26:06.373780+0000 (oldest deadline 2024-09-19T06:26:33.974229+0000) 2024-09-19T06:26:39.239 INFO:journalctl@ceph.osd.5.smithi090.stdout:Sep 19 06:26:38 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-5[46234]: 2024-09-19T06:26:38.946+0000 7f3ea46b3640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.873978+0000 front 2024-09-19T06:26:06.873941+0000 (oldest deadline 2024-09-19T06:26:30.973777+0000) 2024-09-19T06:26:39.292 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 19 06:26:39 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-4[45135]: 2024-09-19T06:26:39.184+0000 7f5442537640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:12.911730+0000 front 2024-09-19T06:26:12.911756+0000 (oldest deadline 2024-09-19T06:26:38.211852+0000) 2024-09-19T06:26:39.292 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:39 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:39.020+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:26:39.292 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:39 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:39.020+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:26:39.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:39 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:39.434+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:26:39.722 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:39 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:39.344+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:03.820828+0000 front 2024-09-19T06:26:03.820911+0000 (oldest deadline 2024-09-19T06:26:29.720849+0000) 2024-09-19T06:26:39.935 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:39 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:39.820+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.373916+0000 front 2024-09-19T06:26:06.373780+0000 (oldest deadline 2024-09-19T06:26:33.974229+0000) 2024-09-19T06:26:39.936 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:39 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:39.590+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:26:40.239 INFO:journalctl@ceph.osd.5.smithi090.stdout:Sep 19 06:26:39 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-5[46234]: 2024-09-19T06:26:39.933+0000 7f3ea46b3640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.873978+0000 front 2024-09-19T06:26:06.873941+0000 (oldest deadline 2024-09-19T06:26:30.973777+0000) 2024-09-19T06:26:40.292 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:40 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:40.032+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:26:40.292 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:40 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:40.032+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:26:40.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:40 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:40.478+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:26:40.722 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:40 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:40.302+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:03.820828+0000 front 2024-09-19T06:26:03.820911+0000 (oldest deadline 2024-09-19T06:26:29.720849+0000) 2024-09-19T06:26:40.722 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:40 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:40.302+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.422857+0000 front 2024-09-19T06:26:15.422879+0000 (oldest deadline 2024-09-19T06:26:39.522874+0000) 2024-09-19T06:26:40.784 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 19 06:26:40 smithi089 podman[69479]: 2024-09-19 06:26:40.496599913 +0000 UTC m=+5.579945190 container died b269eff3a9b5a146fa3771bd3a8513d9788557c72525b99bf7fbf2c24ee24308 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-4, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-19T06:26:40.968 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:40 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:40.621+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:26:40.968 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:40 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:40.810+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.373916+0000 front 2024-09-19T06:26:06.373780+0000 (oldest deadline 2024-09-19T06:26:33.974229+0000) 2024-09-19T06:26:41.042 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 19 06:26:40 smithi089 podman[69479]: 2024-09-19 06:26:40.887605359 +0000 UTC m=+5.970950622 container cleanup b269eff3a9b5a146fa3771bd3a8513d9788557c72525b99bf7fbf2c24ee24308 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-19T06:26:41.042 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 19 06:26:40 smithi089 bash[69479]: ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-4 2024-09-19T06:26:41.042 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:41 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:41.030+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:26:41.042 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:41 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:41.030+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:26:41.239 INFO:journalctl@ceph.osd.5.smithi090.stdout:Sep 19 06:26:40 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-5[46234]: 2024-09-19T06:26:40.967+0000 7f3ea46b3640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.873978+0000 front 2024-09-19T06:26:06.873941+0000 (oldest deadline 2024-09-19T06:26:30.973777+0000) 2024-09-19T06:26:41.458 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 19 06:26:41 smithi089 podman[69494]: 2024-09-19 06:26:41.139153584 +0000 UTC m=+0.645314523 container remove b269eff3a9b5a146fa3771bd3a8513d9788557c72525b99bf7fbf2c24ee24308 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-19T06:26:41.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:41 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:41.475+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:26:41.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:41 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:41.475+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.318946+0000 front 2024-09-19T06:26:15.318994+0000 (oldest deadline 2024-09-19T06:26:41.218838+0000) 2024-09-19T06:26:41.722 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:41 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:41.333+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:03.820828+0000 front 2024-09-19T06:26:03.820911+0000 (oldest deadline 2024-09-19T06:26:29.720849+0000) 2024-09-19T06:26:41.722 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:41 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:41.333+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.422857+0000 front 2024-09-19T06:26:15.422879+0000 (oldest deadline 2024-09-19T06:26:39.522874+0000) 2024-09-19T06:26:41.726 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 19 06:26:41 smithi089 podman[69582]: 2024-09-19 06:26:41.360374946 +0000 UTC m=+0.015488616 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:26:41.726 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 19 06:26:41 smithi089 podman[69582]: 2024-09-19 06:26:41.473065556 +0000 UTC m=+0.128179212 container create 7aa359b99cdcee992e367ce5ac122855a51d3b1e7524d64d50706b45c054ec28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-4-deactivate, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-19T06:26:41.726 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 19 06:26:41 smithi089 podman[69582]: 2024-09-19 06:26:41.725596534 +0000 UTC m=+0.380710190 container init 7aa359b99cdcee992e367ce5ac122855a51d3b1e7524d64d50706b45c054ec28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:26:41.977 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:41 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:41.799+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.373916+0000 front 2024-09-19T06:26:06.373780+0000 (oldest deadline 2024-09-19T06:26:33.974229+0000) 2024-09-19T06:26:41.977 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:41 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:41.799+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.675600+0000 front 2024-09-19T06:26:15.675449+0000 (oldest deadline 2024-09-19T06:26:41.575417+0000) 2024-09-19T06:26:41.977 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:41 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:41.650+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:26:41.977 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:41 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:41.650+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:26:42.042 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:26:41 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:26:41.972+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.991287+0000 front 2024-09-19T06:26:15.991210+0000 (oldest deadline 2024-09-19T06:26:41.291410+0000) 2024-09-19T06:26:42.042 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 19 06:26:41 smithi089 podman[69582]: 2024-09-19 06:26:41.729247814 +0000 UTC m=+0.384361471 container start 7aa359b99cdcee992e367ce5ac122855a51d3b1e7524d64d50706b45c054ec28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:26:42.042 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 19 06:26:41 smithi089 podman[69582]: 2024-09-19 06:26:41.817414695 +0000 UTC m=+0.472528363 container attach 7aa359b99cdcee992e367ce5ac122855a51d3b1e7524d64d50706b45c054ec28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-19T06:26:42.042 INFO:journalctl@ceph.osd.4.smithi089.stdout:Sep 19 06:26:41 smithi089 podman[69582]: 2024-09-19 06:26:41.912698321 +0000 UTC m=+0.567811978 container died 7aa359b99cdcee992e367ce5ac122855a51d3b1e7524d64d50706b45c054ec28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, RELEASE=squid-2f599a4) 2024-09-19T06:26:42.240 INFO:journalctl@ceph.osd.5.smithi090.stdout:Sep 19 06:26:41 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-5[46234]: 2024-09-19T06:26:41.975+0000 7f3ea46b3640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.873978+0000 front 2024-09-19T06:26:06.873941+0000 (oldest deadline 2024-09-19T06:26:30.973777+0000) 2024-09-19T06:26:42.529 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:42 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:42.048+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:26:42.530 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:42 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:42.048+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:26:42.551 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@osd.4.service' 2024-09-19T06:26:42.592 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:26:42.592 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-19T06:26:42.592 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-19T06:26:42.593 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ceph-078f6612-764d-11ef-bceb-c7b262605968@osd.5 2024-09-19T06:26:42.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:42 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:42.511+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:26:42.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:42 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:42.511+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.318946+0000 front 2024-09-19T06:26:15.318994+0000 (oldest deadline 2024-09-19T06:26:41.218838+0000) 2024-09-19T06:26:42.722 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:42 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:42.328+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:03.820828+0000 front 2024-09-19T06:26:03.820911+0000 (oldest deadline 2024-09-19T06:26:29.720849+0000) 2024-09-19T06:26:42.722 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:42 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:42.328+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.422857+0000 front 2024-09-19T06:26:15.422879+0000 (oldest deadline 2024-09-19T06:26:39.522874+0000) 2024-09-19T06:26:42.904 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:42 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:42.660+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:26:42.904 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:42 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:42.660+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:26:42.904 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:42 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:42.815+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.373916+0000 front 2024-09-19T06:26:06.373780+0000 (oldest deadline 2024-09-19T06:26:33.974229+0000) 2024-09-19T06:26:42.904 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:42 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:42.815+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.675600+0000 front 2024-09-19T06:26:15.675449+0000 (oldest deadline 2024-09-19T06:26:41.575417+0000) 2024-09-19T06:26:42.905 INFO:journalctl@ceph.osd.5.smithi090.stdout:Sep 19 06:26:42 smithi090 systemd[1]: Stopping Ceph osd.5 for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:26:42.905 INFO:journalctl@ceph.osd.5.smithi090.stdout:Sep 19 06:26:42 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-5[46234]: 2024-09-19T06:26:42.902+0000 7f3ea80ae640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:26:42.905 INFO:journalctl@ceph.osd.5.smithi090.stdout:Sep 19 06:26:42 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-5[46234]: 2024-09-19T06:26:42.902+0000 7f3ea80ae640 -1 osd.5 95 *** Got signal Terminated *** 2024-09-19T06:26:42.905 INFO:journalctl@ceph.osd.5.smithi090.stdout:Sep 19 06:26:42 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-5[46234]: 2024-09-19T06:26:42.902+0000 7f3ea80ae640 -1 osd.5 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:26:43.239 INFO:journalctl@ceph.osd.5.smithi090.stdout:Sep 19 06:26:43 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-5[46234]: 2024-09-19T06:26:43.020+0000 7f3ea46b3640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.873978+0000 front 2024-09-19T06:26:06.873941+0000 (oldest deadline 2024-09-19T06:26:30.973777+0000) 2024-09-19T06:26:43.239 INFO:journalctl@ceph.osd.5.smithi090.stdout:Sep 19 06:26:43 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-5[46234]: 2024-09-19T06:26:43.020+0000 7f3ea46b3640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:13.274833+0000 front 2024-09-19T06:26:13.274800+0000 (oldest deadline 2024-09-19T06:26:42.675243+0000) 2024-09-19T06:26:43.292 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:26:43 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:26:43.019+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.991287+0000 front 2024-09-19T06:26:15.991210+0000 (oldest deadline 2024-09-19T06:26:41.291410+0000) 2024-09-19T06:26:43.292 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:43 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:43.067+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:26:43.292 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:43 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:43.067+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:26:43.563 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:43 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:43.282+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:03.820828+0000 front 2024-09-19T06:26:03.820911+0000 (oldest deadline 2024-09-19T06:26:29.720849+0000) 2024-09-19T06:26:43.563 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:43 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:43.282+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.422857+0000 front 2024-09-19T06:26:15.422879+0000 (oldest deadline 2024-09-19T06:26:39.522874+0000) 2024-09-19T06:26:43.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:43 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:43.561+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:26:43.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:43 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:43.561+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.318946+0000 front 2024-09-19T06:26:15.318994+0000 (oldest deadline 2024-09-19T06:26:41.218838+0000) 2024-09-19T06:26:43.989 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:43 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:43.849+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.373916+0000 front 2024-09-19T06:26:06.373780+0000 (oldest deadline 2024-09-19T06:26:33.974229+0000) 2024-09-19T06:26:43.989 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:43 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:43.849+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.675600+0000 front 2024-09-19T06:26:15.675449+0000 (oldest deadline 2024-09-19T06:26:41.575417+0000) 2024-09-19T06:26:43.990 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:43 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:43.669+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:26:43.990 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:43 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:43.669+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:26:44.293 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:26:44 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:26:44.039+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.991287+0000 front 2024-09-19T06:26:15.991210+0000 (oldest deadline 2024-09-19T06:26:41.291410+0000) 2024-09-19T06:26:44.293 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:44 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:44.108+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:26:44.293 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:44 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:44.108+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:26:44.489 INFO:journalctl@ceph.osd.5.smithi090.stdout:Sep 19 06:26:44 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-5[46234]: 2024-09-19T06:26:44.061+0000 7f3ea46b3640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.873978+0000 front 2024-09-19T06:26:06.873941+0000 (oldest deadline 2024-09-19T06:26:30.973777+0000) 2024-09-19T06:26:44.490 INFO:journalctl@ceph.osd.5.smithi090.stdout:Sep 19 06:26:44 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-5[46234]: 2024-09-19T06:26:44.061+0000 7f3ea46b3640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:13.274833+0000 front 2024-09-19T06:26:13.274800+0000 (oldest deadline 2024-09-19T06:26:42.675243+0000) 2024-09-19T06:26:44.599 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:44 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:44.259+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:03.820828+0000 front 2024-09-19T06:26:03.820911+0000 (oldest deadline 2024-09-19T06:26:29.720849+0000) 2024-09-19T06:26:44.599 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:44 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:44.259+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.422857+0000 front 2024-09-19T06:26:15.422879+0000 (oldest deadline 2024-09-19T06:26:39.522874+0000) 2024-09-19T06:26:44.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:44 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:44.597+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:26:44.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:44 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:44.597+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.318946+0000 front 2024-09-19T06:26:15.318994+0000 (oldest deadline 2024-09-19T06:26:41.218838+0000) 2024-09-19T06:26:44.989 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:44 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:44.849+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.373916+0000 front 2024-09-19T06:26:06.373780+0000 (oldest deadline 2024-09-19T06:26:33.974229+0000) 2024-09-19T06:26:44.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:44 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:44.849+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.675600+0000 front 2024-09-19T06:26:15.675449+0000 (oldest deadline 2024-09-19T06:26:41.575417+0000) 2024-09-19T06:26:44.990 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:44 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:44.626+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:26:44.990 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:44 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:44.626+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:26:45.489 INFO:journalctl@ceph.osd.5.smithi090.stdout:Sep 19 06:26:45 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-5[46234]: 2024-09-19T06:26:45.082+0000 7f3ea46b3640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.873978+0000 front 2024-09-19T06:26:06.873941+0000 (oldest deadline 2024-09-19T06:26:30.973777+0000) 2024-09-19T06:26:45.490 INFO:journalctl@ceph.osd.5.smithi090.stdout:Sep 19 06:26:45 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-5[46234]: 2024-09-19T06:26:45.082+0000 7f3ea46b3640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:13.274833+0000 front 2024-09-19T06:26:13.274800+0000 (oldest deadline 2024-09-19T06:26:42.675243+0000) 2024-09-19T06:26:45.490 INFO:journalctl@ceph.osd.5.smithi090.stdout:Sep 19 06:26:45 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-5[46234]: 2024-09-19T06:26:45.082+0000 7f3ea46b3640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.675554+0000 front 2024-09-19T06:26:22.675579+0000 (oldest deadline 2024-09-19T06:26:44.975716+0000) 2024-09-19T06:26:45.542 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:26:45 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:26:45.045+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.991287+0000 front 2024-09-19T06:26:15.991210+0000 (oldest deadline 2024-09-19T06:26:41.291410+0000) 2024-09-19T06:26:45.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:45 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:45.102+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:26:45.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:45 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:45.102+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:26:45.596 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:45 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:45.300+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:03.820828+0000 front 2024-09-19T06:26:03.820911+0000 (oldest deadline 2024-09-19T06:26:29.720849+0000) 2024-09-19T06:26:45.596 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:45 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:45.300+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.422857+0000 front 2024-09-19T06:26:15.422879+0000 (oldest deadline 2024-09-19T06:26:39.522874+0000) 2024-09-19T06:26:45.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:45 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:45.594+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:26:45.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:45 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:45.594+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.318946+0000 front 2024-09-19T06:26:15.318994+0000 (oldest deadline 2024-09-19T06:26:41.218838+0000) 2024-09-19T06:26:45.989 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:45 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:45.802+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.373916+0000 front 2024-09-19T06:26:06.373780+0000 (oldest deadline 2024-09-19T06:26:33.974229+0000) 2024-09-19T06:26:45.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:45 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:45.802+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.675600+0000 front 2024-09-19T06:26:15.675449+0000 (oldest deadline 2024-09-19T06:26:41.575417+0000) 2024-09-19T06:26:45.990 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:45 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:45.626+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:26:45.990 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:45 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:45.626+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:26:45.990 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:45 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:45.626+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:26:46.489 INFO:journalctl@ceph.osd.5.smithi090.stdout:Sep 19 06:26:46 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-5[46234]: 2024-09-19T06:26:46.047+0000 7f3ea46b3640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.873978+0000 front 2024-09-19T06:26:06.873941+0000 (oldest deadline 2024-09-19T06:26:30.973777+0000) 2024-09-19T06:26:46.490 INFO:journalctl@ceph.osd.5.smithi090.stdout:Sep 19 06:26:46 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-5[46234]: 2024-09-19T06:26:46.047+0000 7f3ea46b3640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:13.274833+0000 front 2024-09-19T06:26:13.274800+0000 (oldest deadline 2024-09-19T06:26:42.675243+0000) 2024-09-19T06:26:46.490 INFO:journalctl@ceph.osd.5.smithi090.stdout:Sep 19 06:26:46 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-5[46234]: 2024-09-19T06:26:46.047+0000 7f3ea46b3640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.675554+0000 front 2024-09-19T06:26:22.675579+0000 (oldest deadline 2024-09-19T06:26:44.975716+0000) 2024-09-19T06:26:46.542 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:26:46 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:26:46.068+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.991287+0000 front 2024-09-19T06:26:15.991210+0000 (oldest deadline 2024-09-19T06:26:41.291410+0000) 2024-09-19T06:26:46.542 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:26:46 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:26:46.068+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.291969+0000 front 2024-09-19T06:26:21.292104+0000 (oldest deadline 2024-09-19T06:26:45.991859+0000) 2024-09-19T06:26:46.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:46 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:46.070+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:26:46.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:46 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:46.070+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:26:46.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:46 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:46.070+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.716143+0000 front 2024-09-19T06:26:21.716261+0000 (oldest deadline 2024-09-19T06:26:45.215937+0000) 2024-09-19T06:26:46.722 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:46 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:46.335+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:03.820828+0000 front 2024-09-19T06:26:03.820911+0000 (oldest deadline 2024-09-19T06:26:29.720849+0000) 2024-09-19T06:26:46.722 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:46 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:46.335+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.422857+0000 front 2024-09-19T06:26:15.422879+0000 (oldest deadline 2024-09-19T06:26:39.522874+0000) 2024-09-19T06:26:46.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:46 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:46.560+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:26:46.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:46 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:46.560+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.318946+0000 front 2024-09-19T06:26:15.318994+0000 (oldest deadline 2024-09-19T06:26:41.218838+0000) 2024-09-19T06:26:46.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:46 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:46.560+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.919900+0000 front 2024-09-19T06:26:22.919984+0000 (oldest deadline 2024-09-19T06:26:45.819888+0000) 2024-09-19T06:26:46.849 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:46 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:46.581+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:26:46.849 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:46 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:46.581+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:26:46.850 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:46 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:46.581+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:26:47.239 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:46 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:46.848+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.373916+0000 front 2024-09-19T06:26:06.373780+0000 (oldest deadline 2024-09-19T06:26:33.974229+0000) 2024-09-19T06:26:47.240 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:46 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:46.848+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.675600+0000 front 2024-09-19T06:26:15.675449+0000 (oldest deadline 2024-09-19T06:26:41.575417+0000) 2024-09-19T06:26:47.240 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:46 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:46.848+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.076265+0000 front 2024-09-19T06:26:22.076250+0000 (oldest deadline 2024-09-19T06:26:46.776197+0000) 2024-09-19T06:26:47.240 INFO:journalctl@ceph.osd.5.smithi090.stdout:Sep 19 06:26:47 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-5[46234]: 2024-09-19T06:26:47.095+0000 7f3ea46b3640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.873978+0000 front 2024-09-19T06:26:06.873941+0000 (oldest deadline 2024-09-19T06:26:30.973777+0000) 2024-09-19T06:26:47.240 INFO:journalctl@ceph.osd.5.smithi090.stdout:Sep 19 06:26:47 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-5[46234]: 2024-09-19T06:26:47.095+0000 7f3ea46b3640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:13.274833+0000 front 2024-09-19T06:26:13.274800+0000 (oldest deadline 2024-09-19T06:26:42.675243+0000) 2024-09-19T06:26:47.240 INFO:journalctl@ceph.osd.5.smithi090.stdout:Sep 19 06:26:47 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-5[46234]: 2024-09-19T06:26:47.095+0000 7f3ea46b3640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.675554+0000 front 2024-09-19T06:26:22.675579+0000 (oldest deadline 2024-09-19T06:26:44.975716+0000) 2024-09-19T06:26:47.542 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:26:47 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:26:47.057+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.991287+0000 front 2024-09-19T06:26:15.991210+0000 (oldest deadline 2024-09-19T06:26:41.291410+0000) 2024-09-19T06:26:47.542 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:26:47 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:26:47.057+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.291969+0000 front 2024-09-19T06:26:21.292104+0000 (oldest deadline 2024-09-19T06:26:45.991859+0000) 2024-09-19T06:26:47.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:47 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:47.104+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:26:47.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:47 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:47.104+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:26:47.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:47 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:47.104+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.716143+0000 front 2024-09-19T06:26:21.716261+0000 (oldest deadline 2024-09-19T06:26:45.215937+0000) 2024-09-19T06:26:47.722 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:47 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:47.309+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:03.820828+0000 front 2024-09-19T06:26:03.820911+0000 (oldest deadline 2024-09-19T06:26:29.720849+0000) 2024-09-19T06:26:47.722 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:47 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:47.309+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.422857+0000 front 2024-09-19T06:26:15.422879+0000 (oldest deadline 2024-09-19T06:26:39.522874+0000) 2024-09-19T06:26:47.723 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:47 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:47.556+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:26:47.723 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:47 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:47.556+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.318946+0000 front 2024-09-19T06:26:15.318994+0000 (oldest deadline 2024-09-19T06:26:41.218838+0000) 2024-09-19T06:26:47.723 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:47 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:47.556+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.919900+0000 front 2024-09-19T06:26:22.919984+0000 (oldest deadline 2024-09-19T06:26:45.819888+0000) 2024-09-19T06:26:47.802 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:47 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:47.538+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:26:47.802 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:47 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:47.538+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:26:47.802 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:47 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:47.538+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:26:48.240 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:47 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:47.801+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.373916+0000 front 2024-09-19T06:26:06.373780+0000 (oldest deadline 2024-09-19T06:26:33.974229+0000) 2024-09-19T06:26:48.240 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:47 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:47.801+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.675600+0000 front 2024-09-19T06:26:15.675449+0000 (oldest deadline 2024-09-19T06:26:41.575417+0000) 2024-09-19T06:26:48.240 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:47 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:47.801+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.076265+0000 front 2024-09-19T06:26:22.076250+0000 (oldest deadline 2024-09-19T06:26:46.776197+0000) 2024-09-19T06:26:48.542 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:26:48 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:26:48.066+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.991287+0000 front 2024-09-19T06:26:15.991210+0000 (oldest deadline 2024-09-19T06:26:41.291410+0000) 2024-09-19T06:26:48.542 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:26:48 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:26:48.066+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.291969+0000 front 2024-09-19T06:26:21.292104+0000 (oldest deadline 2024-09-19T06:26:45.991859+0000) 2024-09-19T06:26:48.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:48 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:48.080+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:26:48.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:48 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:48.080+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:26:48.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:48 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:48.080+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.716143+0000 front 2024-09-19T06:26:21.716261+0000 (oldest deadline 2024-09-19T06:26:45.215937+0000) 2024-09-19T06:26:48.571 INFO:journalctl@ceph.osd.5.smithi090.stdout:Sep 19 06:26:48 smithi090 podman[70803]: 2024-09-19 06:26:48.314179684 +0000 UTC m=+5.524697766 container died e0e910b97d5661ad21d0d3ac02837d10b37d605dc6a64357bd4bf0b03d57b412 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-5, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-19T06:26:48.572 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:48 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:48.500+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:26:48.572 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:48 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:48.500+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:26:48.572 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:48 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:48.500+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:26:48.590 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:48 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:48.268+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:03.820828+0000 front 2024-09-19T06:26:03.820911+0000 (oldest deadline 2024-09-19T06:26:29.720849+0000) 2024-09-19T06:26:48.590 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:48 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:48.268+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.422857+0000 front 2024-09-19T06:26:15.422879+0000 (oldest deadline 2024-09-19T06:26:39.522874+0000) 2024-09-19T06:26:48.932 INFO:journalctl@ceph.osd.5.smithi090.stdout:Sep 19 06:26:48 smithi090 podman[70803]: 2024-09-19 06:26:48.671406998 +0000 UTC m=+5.881925086 container cleanup e0e910b97d5661ad21d0d3ac02837d10b37d605dc6a64357bd4bf0b03d57b412 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS) 2024-09-19T06:26:48.932 INFO:journalctl@ceph.osd.5.smithi090.stdout:Sep 19 06:26:48 smithi090 bash[70803]: ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-5 2024-09-19T06:26:48.933 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:48 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:48.799+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.373916+0000 front 2024-09-19T06:26:06.373780+0000 (oldest deadline 2024-09-19T06:26:33.974229+0000) 2024-09-19T06:26:48.933 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:48 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:48.799+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.675600+0000 front 2024-09-19T06:26:15.675449+0000 (oldest deadline 2024-09-19T06:26:41.575417+0000) 2024-09-19T06:26:48.933 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:48 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:48.799+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.076265+0000 front 2024-09-19T06:26:22.076250+0000 (oldest deadline 2024-09-19T06:26:46.776197+0000) 2024-09-19T06:26:48.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:48 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:48.588+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:26:48.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:48 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:48.588+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.318946+0000 front 2024-09-19T06:26:15.318994+0000 (oldest deadline 2024-09-19T06:26:41.218838+0000) 2024-09-19T06:26:48.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:48 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:48.588+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.919900+0000 front 2024-09-19T06:26:22.919984+0000 (oldest deadline 2024-09-19T06:26:45.819888+0000) 2024-09-19T06:26:49.239 INFO:journalctl@ceph.osd.5.smithi090.stdout:Sep 19 06:26:48 smithi090 podman[70820]: 2024-09-19 06:26:48.931297373 +0000 UTC m=+0.618447282 container remove e0e910b97d5661ad21d0d3ac02837d10b37d605dc6a64357bd4bf0b03d57b412 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-5, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-19T06:26:49.528 INFO:journalctl@ceph.osd.5.smithi090.stdout:Sep 19 06:26:49 smithi090 podman[70907]: 2024-09-19 06:26:49.274018534 +0000 UTC m=+0.106645404 container create f5bd12ae28e182a471907b4f12fc62dd93eed6ef76e8d33c1f511317c127736c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True) 2024-09-19T06:26:49.529 INFO:journalctl@ceph.osd.5.smithi090.stdout:Sep 19 06:26:49 smithi090 podman[70907]: 2024-09-19 06:26:49.183307807 +0000 UTC m=+0.015934690 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:26:49.529 INFO:journalctl@ceph.osd.5.smithi090.stdout:Sep 19 06:26:49 smithi090 podman[70907]: 2024-09-19 06:26:49.50186573 +0000 UTC m=+0.334492600 container init f5bd12ae28e182a471907b4f12fc62dd93eed6ef76e8d33c1f511317c127736c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-5-deactivate, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-19T06:26:49.529 INFO:journalctl@ceph.osd.5.smithi090.stdout:Sep 19 06:26:49 smithi090 podman[70907]: 2024-09-19 06:26:49.505420314 +0000 UTC m=+0.338047185 container start f5bd12ae28e182a471907b4f12fc62dd93eed6ef76e8d33c1f511317c127736c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2) 2024-09-19T06:26:49.543 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:26:49 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:26:49.106+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.991287+0000 front 2024-09-19T06:26:15.991210+0000 (oldest deadline 2024-09-19T06:26:41.291410+0000) 2024-09-19T06:26:49.543 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:26:49 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:26:49.106+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.291969+0000 front 2024-09-19T06:26:21.292104+0000 (oldest deadline 2024-09-19T06:26:45.991859+0000) 2024-09-19T06:26:49.543 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:49 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:49.061+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:26:49.543 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:49 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:49.061+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:26:49.544 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:49 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:49.061+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.716143+0000 front 2024-09-19T06:26:21.716261+0000 (oldest deadline 2024-09-19T06:26:45.215937+0000) 2024-09-19T06:26:49.565 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:49 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:49.244+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:03.820828+0000 front 2024-09-19T06:26:03.820911+0000 (oldest deadline 2024-09-19T06:26:29.720849+0000) 2024-09-19T06:26:49.565 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:49 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:49.244+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.422857+0000 front 2024-09-19T06:26:15.422879+0000 (oldest deadline 2024-09-19T06:26:39.522874+0000) 2024-09-19T06:26:49.565 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:49 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:49.244+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.624052+0000 front 2024-09-19T06:26:23.623993+0000 (oldest deadline 2024-09-19T06:26:48.323989+0000) 2024-09-19T06:26:49.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:49 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:49.563+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:26:49.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:49 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:49.563+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.318946+0000 front 2024-09-19T06:26:15.318994+0000 (oldest deadline 2024-09-19T06:26:41.218838+0000) 2024-09-19T06:26:49.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:49 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:49.563+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.919900+0000 front 2024-09-19T06:26:22.919984+0000 (oldest deadline 2024-09-19T06:26:45.819888+0000) 2024-09-19T06:26:49.980 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:49 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:49.526+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:26:49.980 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:49 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:49.526+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:26:49.981 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:49 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:49.526+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:26:49.981 INFO:journalctl@ceph.osd.5.smithi090.stdout:Sep 19 06:26:49 smithi090 podman[70907]: 2024-09-19 06:26:49.593576006 +0000 UTC m=+0.426202895 container attach f5bd12ae28e182a471907b4f12fc62dd93eed6ef76e8d33c1f511317c127736c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-19T06:26:49.981 INFO:journalctl@ceph.osd.5.smithi090.stdout:Sep 19 06:26:49 smithi090 podman[70907]: 2024-09-19 06:26:49.691432764 +0000 UTC m=+0.524059636 container died f5bd12ae28e182a471907b4f12fc62dd93eed6ef76e8d33c1f511317c127736c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-19T06:26:49.981 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:49 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:49.753+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.373916+0000 front 2024-09-19T06:26:06.373780+0000 (oldest deadline 2024-09-19T06:26:33.974229+0000) 2024-09-19T06:26:49.981 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:49 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:49.753+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.675600+0000 front 2024-09-19T06:26:15.675449+0000 (oldest deadline 2024-09-19T06:26:41.575417+0000) 2024-09-19T06:26:49.981 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:49 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:49.753+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.076265+0000 front 2024-09-19T06:26:22.076250+0000 (oldest deadline 2024-09-19T06:26:46.776197+0000) 2024-09-19T06:26:50.443 DEBUG:teuthology.orchestra.run.smithi090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@osd.5.service' 2024-09-19T06:26:50.482 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:26:50.482 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-19T06:26:50.483 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-19T06:26:50.483 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-078f6612-764d-11ef-bceb-c7b262605968@osd.6 2024-09-19T06:26:50.512 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:50 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:50.234+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:03.820828+0000 front 2024-09-19T06:26:03.820911+0000 (oldest deadline 2024-09-19T06:26:29.720849+0000) 2024-09-19T06:26:50.512 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:50 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:50.234+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.422857+0000 front 2024-09-19T06:26:15.422879+0000 (oldest deadline 2024-09-19T06:26:39.522874+0000) 2024-09-19T06:26:50.512 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:50 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:50.234+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.624052+0000 front 2024-09-19T06:26:23.623993+0000 (oldest deadline 2024-09-19T06:26:48.323989+0000) 2024-09-19T06:26:50.542 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:26:50 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:26:50.138+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.991287+0000 front 2024-09-19T06:26:15.991210+0000 (oldest deadline 2024-09-19T06:26:41.291410+0000) 2024-09-19T06:26:50.542 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:26:50 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:26:50.138+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.291969+0000 front 2024-09-19T06:26:21.292104+0000 (oldest deadline 2024-09-19T06:26:45.991859+0000) 2024-09-19T06:26:50.543 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:50 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:50.071+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:26:50.543 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:50 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:50.071+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:26:50.543 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:50 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:50.071+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.716143+0000 front 2024-09-19T06:26:21.716261+0000 (oldest deadline 2024-09-19T06:26:45.215937+0000) 2024-09-19T06:26:50.739 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:50 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:50.527+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:26:50.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:50 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:50.527+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:26:50.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:50 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:50.527+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:26:50.812 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:50 smithi002 systemd[1]: Stopping Ceph osd.6 for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:26:50.812 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:50 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:50.810+0000 7f8f85329640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:26:50.812 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:50 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:50.591+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:26:50.813 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:50 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:50.591+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.318946+0000 front 2024-09-19T06:26:15.318994+0000 (oldest deadline 2024-09-19T06:26:41.218838+0000) 2024-09-19T06:26:50.813 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:50 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:50.591+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.919900+0000 front 2024-09-19T06:26:22.919984+0000 (oldest deadline 2024-09-19T06:26:45.819888+0000) 2024-09-19T06:26:51.218 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:50 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:50.810+0000 7f8f85329640 -1 osd.6 95 *** Got signal Terminated *** 2024-09-19T06:26:51.218 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:50 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:50.810+0000 7f8f85329640 -1 osd.6 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:26:51.218 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:51 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:51.216+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:03.820828+0000 front 2024-09-19T06:26:03.820911+0000 (oldest deadline 2024-09-19T06:26:29.720849+0000) 2024-09-19T06:26:51.218 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:51 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:51.216+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.422857+0000 front 2024-09-19T06:26:15.422879+0000 (oldest deadline 2024-09-19T06:26:39.522874+0000) 2024-09-19T06:26:51.239 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:50 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:50.755+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.373916+0000 front 2024-09-19T06:26:06.373780+0000 (oldest deadline 2024-09-19T06:26:33.974229+0000) 2024-09-19T06:26:51.240 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:50 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:50.755+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.675600+0000 front 2024-09-19T06:26:15.675449+0000 (oldest deadline 2024-09-19T06:26:41.575417+0000) 2024-09-19T06:26:51.240 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:50 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:50.755+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.076265+0000 front 2024-09-19T06:26:22.076250+0000 (oldest deadline 2024-09-19T06:26:46.776197+0000) 2024-09-19T06:26:51.472 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:51 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:51.216+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.624052+0000 front 2024-09-19T06:26:23.623993+0000 (oldest deadline 2024-09-19T06:26:48.323989+0000) 2024-09-19T06:26:51.542 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:26:51 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:26:51.107+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.991287+0000 front 2024-09-19T06:26:15.991210+0000 (oldest deadline 2024-09-19T06:26:41.291410+0000) 2024-09-19T06:26:51.542 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:26:51 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:26:51.107+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.291969+0000 front 2024-09-19T06:26:21.292104+0000 (oldest deadline 2024-09-19T06:26:45.991859+0000) 2024-09-19T06:26:51.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:51 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:51.114+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:26:51.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:51 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:51.114+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:26:51.543 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:51 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:51.114+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.716143+0000 front 2024-09-19T06:26:21.716261+0000 (oldest deadline 2024-09-19T06:26:45.215937+0000) 2024-09-19T06:26:51.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:51 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:51.565+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:26:51.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:51 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:51.565+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.318946+0000 front 2024-09-19T06:26:15.318994+0000 (oldest deadline 2024-09-19T06:26:41.218838+0000) 2024-09-19T06:26:51.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:51 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:51.565+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.919900+0000 front 2024-09-19T06:26:22.919984+0000 (oldest deadline 2024-09-19T06:26:45.819888+0000) 2024-09-19T06:26:51.989 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:51 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:51.719+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.373916+0000 front 2024-09-19T06:26:06.373780+0000 (oldest deadline 2024-09-19T06:26:33.974229+0000) 2024-09-19T06:26:51.989 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:51 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:51.719+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.675600+0000 front 2024-09-19T06:26:15.675449+0000 (oldest deadline 2024-09-19T06:26:41.575417+0000) 2024-09-19T06:26:51.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:51 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:51.719+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.076265+0000 front 2024-09-19T06:26:22.076250+0000 (oldest deadline 2024-09-19T06:26:46.776197+0000) 2024-09-19T06:26:51.990 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:51 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:51.549+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:26:51.990 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:51 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:51.549+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:26:51.990 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:51 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:51.549+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:26:52.542 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:26:52 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:26:52.110+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.991287+0000 front 2024-09-19T06:26:15.991210+0000 (oldest deadline 2024-09-19T06:26:41.291410+0000) 2024-09-19T06:26:52.542 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:26:52 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:26:52.110+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.291969+0000 front 2024-09-19T06:26:21.292104+0000 (oldest deadline 2024-09-19T06:26:45.991859+0000) 2024-09-19T06:26:52.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:52 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:52.105+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:26:52.543 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:52 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:52.105+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:26:52.543 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:52 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:52.105+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.716143+0000 front 2024-09-19T06:26:21.716261+0000 (oldest deadline 2024-09-19T06:26:45.215937+0000) 2024-09-19T06:26:52.585 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:52 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:52.249+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:03.820828+0000 front 2024-09-19T06:26:03.820911+0000 (oldest deadline 2024-09-19T06:26:29.720849+0000) 2024-09-19T06:26:52.585 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:52 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:52.249+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.422857+0000 front 2024-09-19T06:26:15.422879+0000 (oldest deadline 2024-09-19T06:26:39.522874+0000) 2024-09-19T06:26:52.585 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:52 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:52.249+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.624052+0000 front 2024-09-19T06:26:23.623993+0000 (oldest deadline 2024-09-19T06:26:48.323989+0000) 2024-09-19T06:26:52.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:52 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:52.584+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:26:52.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:52 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:52.584+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.318946+0000 front 2024-09-19T06:26:15.318994+0000 (oldest deadline 2024-09-19T06:26:41.218838+0000) 2024-09-19T06:26:52.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:52 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:52.584+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.919900+0000 front 2024-09-19T06:26:22.919984+0000 (oldest deadline 2024-09-19T06:26:45.819888+0000) 2024-09-19T06:26:52.989 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:52 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:52.685+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.373916+0000 front 2024-09-19T06:26:06.373780+0000 (oldest deadline 2024-09-19T06:26:33.974229+0000) 2024-09-19T06:26:52.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:52 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:52.685+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.675600+0000 front 2024-09-19T06:26:15.675449+0000 (oldest deadline 2024-09-19T06:26:41.575417+0000) 2024-09-19T06:26:52.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:52 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:52.685+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.076265+0000 front 2024-09-19T06:26:22.076250+0000 (oldest deadline 2024-09-19T06:26:46.776197+0000) 2024-09-19T06:26:52.990 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:52 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:52.547+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:26:52.990 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:52 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:52.547+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:26:52.990 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:52 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:52.547+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:26:53.542 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:26:53 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:26:53.098+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.991287+0000 front 2024-09-19T06:26:15.991210+0000 (oldest deadline 2024-09-19T06:26:41.291410+0000) 2024-09-19T06:26:53.542 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:26:53 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:26:53.098+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.291969+0000 front 2024-09-19T06:26:21.292104+0000 (oldest deadline 2024-09-19T06:26:45.991859+0000) 2024-09-19T06:26:53.543 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:53 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:53.154+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:26:53.543 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:53 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:53.154+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:26:53.543 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:53 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:53.154+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.716143+0000 front 2024-09-19T06:26:21.716261+0000 (oldest deadline 2024-09-19T06:26:45.215937+0000) 2024-09-19T06:26:53.543 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:53 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:53.154+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:29.118125+0000 front 2024-09-19T06:26:29.118102+0000 (oldest deadline 2024-09-19T06:26:52.617920+0000) 2024-09-19T06:26:53.583 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:53 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:53.293+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:03.820828+0000 front 2024-09-19T06:26:03.820911+0000 (oldest deadline 2024-09-19T06:26:29.720849+0000) 2024-09-19T06:26:53.583 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:53 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:53.293+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.422857+0000 front 2024-09-19T06:26:15.422879+0000 (oldest deadline 2024-09-19T06:26:39.522874+0000) 2024-09-19T06:26:53.583 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:53 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:53.293+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.624052+0000 front 2024-09-19T06:26:23.623993+0000 (oldest deadline 2024-09-19T06:26:48.323989+0000) 2024-09-19T06:26:53.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:53 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:53.582+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:26:53.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:53 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:53.582+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.318946+0000 front 2024-09-19T06:26:15.318994+0000 (oldest deadline 2024-09-19T06:26:41.218838+0000) 2024-09-19T06:26:53.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:53 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:53.582+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.919900+0000 front 2024-09-19T06:26:22.919984+0000 (oldest deadline 2024-09-19T06:26:45.819888+0000) 2024-09-19T06:26:53.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:53 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:53.582+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:31.621525+0000 front 2024-09-19T06:26:31.621549+0000 (oldest deadline 2024-09-19T06:26:52.721789+0000) 2024-09-19T06:26:53.990 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:53 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:53.545+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:26:53.990 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:53 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:53.545+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:26:53.990 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:53 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:53.545+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:26:53.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:53 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:53.687+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.373916+0000 front 2024-09-19T06:26:06.373780+0000 (oldest deadline 2024-09-19T06:26:33.974229+0000) 2024-09-19T06:26:53.991 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:53 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:53.687+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.675600+0000 front 2024-09-19T06:26:15.675449+0000 (oldest deadline 2024-09-19T06:26:41.575417+0000) 2024-09-19T06:26:53.991 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:53 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:53.687+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.076265+0000 front 2024-09-19T06:26:22.076250+0000 (oldest deadline 2024-09-19T06:26:46.776197+0000) 2024-09-19T06:26:54.542 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:26:54 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:26:54.115+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.991287+0000 front 2024-09-19T06:26:15.991210+0000 (oldest deadline 2024-09-19T06:26:41.291410+0000) 2024-09-19T06:26:54.542 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:26:54 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:26:54.115+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.291969+0000 front 2024-09-19T06:26:21.292104+0000 (oldest deadline 2024-09-19T06:26:45.991859+0000) 2024-09-19T06:26:54.542 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:26:54 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:26:54.115+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:28.892984+0000 front 2024-09-19T06:26:28.893006+0000 (oldest deadline 2024-09-19T06:26:53.592929+0000) 2024-09-19T06:26:54.543 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:54 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:54.121+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:26:54.543 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:54 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:54.121+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:26:54.543 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:54 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:54.121+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.716143+0000 front 2024-09-19T06:26:21.716261+0000 (oldest deadline 2024-09-19T06:26:45.215937+0000) 2024-09-19T06:26:54.543 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:54 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:54.121+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:29.118125+0000 front 2024-09-19T06:26:29.118102+0000 (oldest deadline 2024-09-19T06:26:52.617920+0000) 2024-09-19T06:26:54.553 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:54 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:54.264+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:03.820828+0000 front 2024-09-19T06:26:03.820911+0000 (oldest deadline 2024-09-19T06:26:29.720849+0000) 2024-09-19T06:26:54.553 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:54 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:54.264+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.422857+0000 front 2024-09-19T06:26:15.422879+0000 (oldest deadline 2024-09-19T06:26:39.522874+0000) 2024-09-19T06:26:54.553 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:54 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:54.264+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.624052+0000 front 2024-09-19T06:26:23.623993+0000 (oldest deadline 2024-09-19T06:26:48.323989+0000) 2024-09-19T06:26:54.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:54 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:54.552+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:26:54.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:54 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:54.552+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.318946+0000 front 2024-09-19T06:26:15.318994+0000 (oldest deadline 2024-09-19T06:26:41.218838+0000) 2024-09-19T06:26:54.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:54 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:54.552+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.919900+0000 front 2024-09-19T06:26:22.919984+0000 (oldest deadline 2024-09-19T06:26:45.819888+0000) 2024-09-19T06:26:54.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:54 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:54.552+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:31.621525+0000 front 2024-09-19T06:26:31.621549+0000 (oldest deadline 2024-09-19T06:26:52.721789+0000) 2024-09-19T06:26:54.989 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:54 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:54.516+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:26:54.990 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:54 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:54.516+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:26:54.990 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:54 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:54.516+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:26:54.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:54 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:54.699+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.373916+0000 front 2024-09-19T06:26:06.373780+0000 (oldest deadline 2024-09-19T06:26:33.974229+0000) 2024-09-19T06:26:54.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:54 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:54.699+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.675600+0000 front 2024-09-19T06:26:15.675449+0000 (oldest deadline 2024-09-19T06:26:41.575417+0000) 2024-09-19T06:26:54.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:54 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:54.699+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.076265+0000 front 2024-09-19T06:26:22.076250+0000 (oldest deadline 2024-09-19T06:26:46.776197+0000) 2024-09-19T06:26:55.506 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:55 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:55.234+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:03.820828+0000 front 2024-09-19T06:26:03.820911+0000 (oldest deadline 2024-09-19T06:26:29.720849+0000) 2024-09-19T06:26:55.506 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:55 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:55.234+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.422857+0000 front 2024-09-19T06:26:15.422879+0000 (oldest deadline 2024-09-19T06:26:39.522874+0000) 2024-09-19T06:26:55.506 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:55 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:55.234+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.624052+0000 front 2024-09-19T06:26:23.623993+0000 (oldest deadline 2024-09-19T06:26:48.323989+0000) 2024-09-19T06:26:55.506 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:55 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6[57993]: 2024-09-19T06:26:55.234+0000 7f8f7d926640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:30.024892+0000 front 2024-09-19T06:26:30.024927+0000 (oldest deadline 2024-09-19T06:26:54.725033+0000) 2024-09-19T06:26:55.542 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:26:55 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:26:55.099+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.991287+0000 front 2024-09-19T06:26:15.991210+0000 (oldest deadline 2024-09-19T06:26:41.291410+0000) 2024-09-19T06:26:55.542 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:26:55 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:26:55.099+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.291969+0000 front 2024-09-19T06:26:21.292104+0000 (oldest deadline 2024-09-19T06:26:45.991859+0000) 2024-09-19T06:26:55.542 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:26:55 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:26:55.099+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:28.892984+0000 front 2024-09-19T06:26:28.893006+0000 (oldest deadline 2024-09-19T06:26:53.592929+0000) 2024-09-19T06:26:55.543 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:55 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:55.163+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:26:55.543 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:55 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:55.163+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:26:55.543 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:55 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:55.163+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.716143+0000 front 2024-09-19T06:26:21.716261+0000 (oldest deadline 2024-09-19T06:26:45.215937+0000) 2024-09-19T06:26:55.543 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:55 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:55.163+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:29.118125+0000 front 2024-09-19T06:26:29.118102+0000 (oldest deadline 2024-09-19T06:26:52.617920+0000) 2024-09-19T06:26:55.740 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:55 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:55.664+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.373916+0000 front 2024-09-19T06:26:06.373780+0000 (oldest deadline 2024-09-19T06:26:33.974229+0000) 2024-09-19T06:26:55.740 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:55 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:55.664+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.675600+0000 front 2024-09-19T06:26:15.675449+0000 (oldest deadline 2024-09-19T06:26:41.575417+0000) 2024-09-19T06:26:55.740 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:55 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:55.664+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.076265+0000 front 2024-09-19T06:26:22.076250+0000 (oldest deadline 2024-09-19T06:26:46.776197+0000) 2024-09-19T06:26:55.741 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:55 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:55.470+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:26:55.741 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:55 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:55.470+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:26:55.741 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:55 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:55.470+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:26:55.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:55 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:55.504+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:26:55.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:55 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:55.504+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.318946+0000 front 2024-09-19T06:26:15.318994+0000 (oldest deadline 2024-09-19T06:26:41.218838+0000) 2024-09-19T06:26:55.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:55 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:55.504+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.919900+0000 front 2024-09-19T06:26:22.919984+0000 (oldest deadline 2024-09-19T06:26:45.819888+0000) 2024-09-19T06:26:55.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:55 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:55.504+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:31.621525+0000 front 2024-09-19T06:26:31.621549+0000 (oldest deadline 2024-09-19T06:26:52.721789+0000) 2024-09-19T06:26:56.542 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:26:56 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:26:56.144+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.991287+0000 front 2024-09-19T06:26:15.991210+0000 (oldest deadline 2024-09-19T06:26:41.291410+0000) 2024-09-19T06:26:56.542 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:26:56 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:26:56.144+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.291969+0000 front 2024-09-19T06:26:21.292104+0000 (oldest deadline 2024-09-19T06:26:45.991859+0000) 2024-09-19T06:26:56.542 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:26:56 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:26:56.144+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:28.892984+0000 front 2024-09-19T06:26:28.893006+0000 (oldest deadline 2024-09-19T06:26:53.592929+0000) 2024-09-19T06:26:56.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:56 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:56.152+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:26:56.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:56 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:56.152+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:26:56.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:56 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:56.152+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.716143+0000 front 2024-09-19T06:26:21.716261+0000 (oldest deadline 2024-09-19T06:26:45.215937+0000) 2024-09-19T06:26:56.543 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:56 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:56.152+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:29.118125+0000 front 2024-09-19T06:26:29.118102+0000 (oldest deadline 2024-09-19T06:26:52.617920+0000) 2024-09-19T06:26:56.612 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:56 smithi002 podman[119243]: 2024-09-19 06:26:56.359673572 +0000 UTC m=+5.673583595 container died f0e4b3b45587d268847cdc2f45fa3991b1a88bb502c5432e9e5fb1ef7eb4102b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-19T06:26:56.612 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:56 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:56.501+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:26:56.612 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:56 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:56.501+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.318946+0000 front 2024-09-19T06:26:15.318994+0000 (oldest deadline 2024-09-19T06:26:41.218838+0000) 2024-09-19T06:26:56.612 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:56 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:56.501+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.919900+0000 front 2024-09-19T06:26:22.919984+0000 (oldest deadline 2024-09-19T06:26:45.819888+0000) 2024-09-19T06:26:56.613 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:56 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:56.501+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:31.621525+0000 front 2024-09-19T06:26:31.621549+0000 (oldest deadline 2024-09-19T06:26:52.721789+0000) 2024-09-19T06:26:56.706 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:56 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:56.431+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:26:56.706 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:56 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:56.431+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:26:56.706 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:56 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:56.431+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:26:56.972 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:56 smithi002 podman[119243]: 2024-09-19 06:26:56.785681556 +0000 UTC m=+6.099591614 container cleanup f0e4b3b45587d268847cdc2f45fa3991b1a88bb502c5432e9e5fb1ef7eb4102b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:26:56.972 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:56 smithi002 bash[119243]: ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6 2024-09-19T06:26:56.989 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:56 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:56.705+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.373916+0000 front 2024-09-19T06:26:06.373780+0000 (oldest deadline 2024-09-19T06:26:33.974229+0000) 2024-09-19T06:26:56.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:56 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:56.705+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.675600+0000 front 2024-09-19T06:26:15.675449+0000 (oldest deadline 2024-09-19T06:26:41.575417+0000) 2024-09-19T06:26:56.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:56 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:56.705+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.076265+0000 front 2024-09-19T06:26:22.076250+0000 (oldest deadline 2024-09-19T06:26:46.776197+0000) 2024-09-19T06:26:56.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:56 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:56.705+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:31.277819+0000 front 2024-09-19T06:26:31.277805+0000 (oldest deadline 2024-09-19T06:26:56.577903+0000) 2024-09-19T06:26:57.458 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:57 smithi002 podman[119258]: 2024-09-19 06:26:57.003744692 +0000 UTC m=+0.632316922 container remove f0e4b3b45587d268847cdc2f45fa3991b1a88bb502c5432e9e5fb1ef7eb4102b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-19T06:26:57.542 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:26:57 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:26:57.126+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.991287+0000 front 2024-09-19T06:26:15.991210+0000 (oldest deadline 2024-09-19T06:26:41.291410+0000) 2024-09-19T06:26:57.542 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:26:57 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:26:57.126+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.291969+0000 front 2024-09-19T06:26:21.292104+0000 (oldest deadline 2024-09-19T06:26:45.991859+0000) 2024-09-19T06:26:57.542 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:26:57 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:26:57.126+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:28.892984+0000 front 2024-09-19T06:26:28.893006+0000 (oldest deadline 2024-09-19T06:26:53.592929+0000) 2024-09-19T06:26:57.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:57 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:57.144+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:26:57.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:57 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:57.144+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:26:57.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:57 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:57.144+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.716143+0000 front 2024-09-19T06:26:21.716261+0000 (oldest deadline 2024-09-19T06:26:45.215937+0000) 2024-09-19T06:26:57.543 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:57 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:57.144+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:29.118125+0000 front 2024-09-19T06:26:29.118102+0000 (oldest deadline 2024-09-19T06:26:52.617920+0000) 2024-09-19T06:26:57.688 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:57 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:57.418+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:26:57.688 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:57 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:57.418+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:26:57.688 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:57 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:57.418+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:26:57.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:57 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:57.477+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:26:57.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:57 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:57.477+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.318946+0000 front 2024-09-19T06:26:15.318994+0000 (oldest deadline 2024-09-19T06:26:41.218838+0000) 2024-09-19T06:26:57.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:57 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:57.477+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.919900+0000 front 2024-09-19T06:26:22.919984+0000 (oldest deadline 2024-09-19T06:26:45.819888+0000) 2024-09-19T06:26:57.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:57 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:57.477+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:31.621525+0000 front 2024-09-19T06:26:31.621549+0000 (oldest deadline 2024-09-19T06:26:52.721789+0000) 2024-09-19T06:26:57.722 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:57 smithi002 podman[119343]: 2024-09-19 06:26:57.3603102 +0000 UTC m=+0.016350519 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:26:57.722 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:57 smithi002 podman[119343]: 2024-09-19 06:26:57.479461271 +0000 UTC m=+0.135501577 container create 1c1d941f8008787115f8dd3fa763ae8073d295a269b4f937e7e13227351008e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T06:26:57.723 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:57 smithi002 podman[119343]: 2024-09-19 06:26:57.698476743 +0000 UTC m=+0.354517050 container init 1c1d941f8008787115f8dd3fa763ae8073d295a269b4f937e7e13227351008e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-19T06:26:57.723 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:57 smithi002 podman[119343]: 2024-09-19 06:26:57.701828261 +0000 UTC m=+0.357868568 container start 1c1d941f8008787115f8dd3fa763ae8073d295a269b4f937e7e13227351008e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-19T06:26:57.989 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:57 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:57.687+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.373916+0000 front 2024-09-19T06:26:06.373780+0000 (oldest deadline 2024-09-19T06:26:33.974229+0000) 2024-09-19T06:26:57.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:57 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:57.687+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.675600+0000 front 2024-09-19T06:26:15.675449+0000 (oldest deadline 2024-09-19T06:26:41.575417+0000) 2024-09-19T06:26:57.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:57 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:57.687+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.076265+0000 front 2024-09-19T06:26:22.076250+0000 (oldest deadline 2024-09-19T06:26:46.776197+0000) 2024-09-19T06:26:57.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:57 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:57.687+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:31.277819+0000 front 2024-09-19T06:26:31.277805+0000 (oldest deadline 2024-09-19T06:26:56.577903+0000) 2024-09-19T06:26:58.179 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:57 smithi002 podman[119343]: 2024-09-19 06:26:57.798574989 +0000 UTC m=+0.454615307 container attach 1c1d941f8008787115f8dd3fa763ae8073d295a269b4f937e7e13227351008e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-19T06:26:58.179 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 19 06:26:57 smithi002 podman[119343]: 2024-09-19 06:26:57.895372762 +0000 UTC m=+0.551413078 container died 1c1d941f8008787115f8dd3fa763ae8073d295a269b4f937e7e13227351008e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-19T06:26:58.523 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@osd.6.service' 2024-09-19T06:26:58.542 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:26:58 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:26:58.081+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.991287+0000 front 2024-09-19T06:26:15.991210+0000 (oldest deadline 2024-09-19T06:26:41.291410+0000) 2024-09-19T06:26:58.542 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:26:58 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:26:58.081+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.291969+0000 front 2024-09-19T06:26:21.292104+0000 (oldest deadline 2024-09-19T06:26:45.991859+0000) 2024-09-19T06:26:58.542 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:26:58 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:26:58.081+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:28.892984+0000 front 2024-09-19T06:26:28.893006+0000 (oldest deadline 2024-09-19T06:26:53.592929+0000) 2024-09-19T06:26:58.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:58 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:58.180+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:26:58.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:58 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:58.180+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:26:58.543 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:58 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:58.180+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.716143+0000 front 2024-09-19T06:26:21.716261+0000 (oldest deadline 2024-09-19T06:26:45.215937+0000) 2024-09-19T06:26:58.543 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:58 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:58.180+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:29.118125+0000 front 2024-09-19T06:26:29.118102+0000 (oldest deadline 2024-09-19T06:26:52.617920+0000) 2024-09-19T06:26:58.606 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:26:58.606 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-19T06:26:58.606 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-19T06:26:58.606 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-078f6612-764d-11ef-bceb-c7b262605968@osd.7 2024-09-19T06:26:58.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:58 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:58.450+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:26:58.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:58 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:58.450+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.318946+0000 front 2024-09-19T06:26:15.318994+0000 (oldest deadline 2024-09-19T06:26:41.218838+0000) 2024-09-19T06:26:58.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:58 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:58.450+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.919900+0000 front 2024-09-19T06:26:22.919984+0000 (oldest deadline 2024-09-19T06:26:45.819888+0000) 2024-09-19T06:26:58.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:58 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:58.450+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:31.621525+0000 front 2024-09-19T06:26:31.621549+0000 (oldest deadline 2024-09-19T06:26:52.721789+0000) 2024-09-19T06:26:58.739 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:58 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:58.707+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.373916+0000 front 2024-09-19T06:26:06.373780+0000 (oldest deadline 2024-09-19T06:26:33.974229+0000) 2024-09-19T06:26:58.740 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:58 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:58.707+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.675600+0000 front 2024-09-19T06:26:15.675449+0000 (oldest deadline 2024-09-19T06:26:41.575417+0000) 2024-09-19T06:26:58.740 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:58 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:58.707+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.076265+0000 front 2024-09-19T06:26:22.076250+0000 (oldest deadline 2024-09-19T06:26:46.776197+0000) 2024-09-19T06:26:58.740 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:58 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:58.707+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:31.277819+0000 front 2024-09-19T06:26:31.277805+0000 (oldest deadline 2024-09-19T06:26:56.577903+0000) 2024-09-19T06:26:58.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:58 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:58.459+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:26:58.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:58 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:58.459+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:26:58.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:58 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:58.459+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:26:58.924 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:26:58 smithi089 systemd[1]: Stopping Ceph osd.7 for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:26:59.182 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:26:58 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:26:58.922+0000 7f221eff6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:26:59.182 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:26:58 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:26:58.922+0000 7f221eff6640 -1 osd.7 95 *** Got signal Terminated *** 2024-09-19T06:26:59.182 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:26:58 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:26:58.922+0000 7f221eff6640 -1 osd.7 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:26:59.182 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:26:59 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:26:59.060+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.991287+0000 front 2024-09-19T06:26:15.991210+0000 (oldest deadline 2024-09-19T06:26:41.291410+0000) 2024-09-19T06:26:59.182 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:26:59 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:26:59.060+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.291969+0000 front 2024-09-19T06:26:21.292104+0000 (oldest deadline 2024-09-19T06:26:45.991859+0000) 2024-09-19T06:26:59.182 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:26:59 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:26:59.060+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:28.892984+0000 front 2024-09-19T06:26:28.893006+0000 (oldest deadline 2024-09-19T06:26:53.592929+0000) 2024-09-19T06:26:59.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:59 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:59.180+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:26:59.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:59 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:59.180+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:26:59.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:59 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:59.180+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.716143+0000 front 2024-09-19T06:26:21.716261+0000 (oldest deadline 2024-09-19T06:26:45.215937+0000) 2024-09-19T06:26:59.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:26:59 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:26:59.180+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:29.118125+0000 front 2024-09-19T06:26:29.118102+0000 (oldest deadline 2024-09-19T06:26:52.617920+0000) 2024-09-19T06:26:59.739 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:59 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:59.671+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.373916+0000 front 2024-09-19T06:26:06.373780+0000 (oldest deadline 2024-09-19T06:26:33.974229+0000) 2024-09-19T06:26:59.740 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:59 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:59.671+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.675600+0000 front 2024-09-19T06:26:15.675449+0000 (oldest deadline 2024-09-19T06:26:41.575417+0000) 2024-09-19T06:26:59.740 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:59 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:59.671+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.076265+0000 front 2024-09-19T06:26:22.076250+0000 (oldest deadline 2024-09-19T06:26:46.776197+0000) 2024-09-19T06:26:59.740 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:26:59 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:26:59.671+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:31.277819+0000 front 2024-09-19T06:26:31.277805+0000 (oldest deadline 2024-09-19T06:26:56.577903+0000) 2024-09-19T06:26:59.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:59 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:59.458+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:26:59.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:59 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:59.458+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:26:59.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:26:59 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:26:59.458+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:26:59.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:59 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:59.489+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:26:59.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:59 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:59.489+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.318946+0000 front 2024-09-19T06:26:15.318994+0000 (oldest deadline 2024-09-19T06:26:41.218838+0000) 2024-09-19T06:26:59.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:59 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:59.489+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.919900+0000 front 2024-09-19T06:26:22.919984+0000 (oldest deadline 2024-09-19T06:26:45.819888+0000) 2024-09-19T06:26:59.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:26:59 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:26:59.489+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:31.621525+0000 front 2024-09-19T06:26:31.621549+0000 (oldest deadline 2024-09-19T06:26:52.721789+0000) 2024-09-19T06:27:00.292 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:27:00 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:27:00.020+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.991287+0000 front 2024-09-19T06:26:15.991210+0000 (oldest deadline 2024-09-19T06:26:41.291410+0000) 2024-09-19T06:27:00.292 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:27:00 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:27:00.020+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.291969+0000 front 2024-09-19T06:26:21.292104+0000 (oldest deadline 2024-09-19T06:26:45.991859+0000) 2024-09-19T06:27:00.292 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:27:00 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:27:00.020+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:28.892984+0000 front 2024-09-19T06:26:28.893006+0000 (oldest deadline 2024-09-19T06:26:53.592929+0000) 2024-09-19T06:27:00.292 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:00 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:00.131+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:27:00.293 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:00 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:00.131+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:27:00.293 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:00 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:00.131+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.716143+0000 front 2024-09-19T06:26:21.716261+0000 (oldest deadline 2024-09-19T06:26:45.215937+0000) 2024-09-19T06:27:00.293 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:00 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:00.131+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:29.118125+0000 front 2024-09-19T06:26:29.118102+0000 (oldest deadline 2024-09-19T06:26:52.617920+0000) 2024-09-19T06:27:00.702 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:00 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:00.429+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:27:00.702 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:00 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:00.429+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:27:00.702 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:00 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:00.429+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:27:00.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:00 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:00.449+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:27:00.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:00 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:00.449+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.318946+0000 front 2024-09-19T06:26:15.318994+0000 (oldest deadline 2024-09-19T06:26:41.218838+0000) 2024-09-19T06:27:00.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:00 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:00.449+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.919900+0000 front 2024-09-19T06:26:22.919984+0000 (oldest deadline 2024-09-19T06:26:45.819888+0000) 2024-09-19T06:27:00.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:00 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:00.449+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:31.621525+0000 front 2024-09-19T06:26:31.621549+0000 (oldest deadline 2024-09-19T06:26:52.721789+0000) 2024-09-19T06:27:00.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:00 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:00.700+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.373916+0000 front 2024-09-19T06:26:06.373780+0000 (oldest deadline 2024-09-19T06:26:33.974229+0000) 2024-09-19T06:27:00.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:00 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:00.700+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.675600+0000 front 2024-09-19T06:26:15.675449+0000 (oldest deadline 2024-09-19T06:26:41.575417+0000) 2024-09-19T06:27:00.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:00 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:00.700+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.076265+0000 front 2024-09-19T06:26:22.076250+0000 (oldest deadline 2024-09-19T06:26:46.776197+0000) 2024-09-19T06:27:00.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:00 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:00.700+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:31.277819+0000 front 2024-09-19T06:26:31.277805+0000 (oldest deadline 2024-09-19T06:26:56.577903+0000) 2024-09-19T06:27:01.292 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:27:00 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:27:00.990+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.991287+0000 front 2024-09-19T06:26:15.991210+0000 (oldest deadline 2024-09-19T06:26:41.291410+0000) 2024-09-19T06:27:01.292 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:27:00 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:27:00.990+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.291969+0000 front 2024-09-19T06:26:21.292104+0000 (oldest deadline 2024-09-19T06:26:45.991859+0000) 2024-09-19T06:27:01.292 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:27:00 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:27:00.990+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:28.892984+0000 front 2024-09-19T06:26:28.893006+0000 (oldest deadline 2024-09-19T06:26:53.592929+0000) 2024-09-19T06:27:01.292 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:01 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:01.088+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:27:01.292 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:01 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:01.088+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:27:01.293 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:01 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:01.088+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.716143+0000 front 2024-09-19T06:26:21.716261+0000 (oldest deadline 2024-09-19T06:26:45.215937+0000) 2024-09-19T06:27:01.293 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:01 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:01.089+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:29.118125+0000 front 2024-09-19T06:26:29.118102+0000 (oldest deadline 2024-09-19T06:26:52.617920+0000) 2024-09-19T06:27:01.293 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:01 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:01.089+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:35.518654+0000 front 2024-09-19T06:26:35.518703+0000 (oldest deadline 2024-09-19T06:27:00.818859+0000) 2024-09-19T06:27:01.679 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:01 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:01.383+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:27:01.679 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:01 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:01.383+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:27:01.679 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:01 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:01.383+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:27:01.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:01 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:01.466+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:27:01.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:01 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:01.466+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.318946+0000 front 2024-09-19T06:26:15.318994+0000 (oldest deadline 2024-09-19T06:26:41.218838+0000) 2024-09-19T06:27:01.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:01 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:01.466+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.919900+0000 front 2024-09-19T06:26:22.919984+0000 (oldest deadline 2024-09-19T06:26:45.819888+0000) 2024-09-19T06:27:01.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:01 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:01.466+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:31.621525+0000 front 2024-09-19T06:26:31.621549+0000 (oldest deadline 2024-09-19T06:26:52.721789+0000) 2024-09-19T06:27:01.989 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:01 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:01.677+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.373916+0000 front 2024-09-19T06:26:06.373780+0000 (oldest deadline 2024-09-19T06:26:33.974229+0000) 2024-09-19T06:27:01.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:01 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:01.677+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.675600+0000 front 2024-09-19T06:26:15.675449+0000 (oldest deadline 2024-09-19T06:26:41.575417+0000) 2024-09-19T06:27:01.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:01 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:01.677+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.076265+0000 front 2024-09-19T06:26:22.076250+0000 (oldest deadline 2024-09-19T06:26:46.776197+0000) 2024-09-19T06:27:01.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:01 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:01.677+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:31.277819+0000 front 2024-09-19T06:26:31.277805+0000 (oldest deadline 2024-09-19T06:26:56.577903+0000) 2024-09-19T06:27:02.292 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:27:02 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:27:02.023+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.991287+0000 front 2024-09-19T06:26:15.991210+0000 (oldest deadline 2024-09-19T06:26:41.291410+0000) 2024-09-19T06:27:02.292 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:27:02 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:27:02.023+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.291969+0000 front 2024-09-19T06:26:21.292104+0000 (oldest deadline 2024-09-19T06:26:45.991859+0000) 2024-09-19T06:27:02.292 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:27:02 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:27:02.023+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:28.892984+0000 front 2024-09-19T06:26:28.893006+0000 (oldest deadline 2024-09-19T06:26:53.592929+0000) 2024-09-19T06:27:02.292 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:27:02 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:27:02.023+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:36.394099+0000 front 2024-09-19T06:26:36.394121+0000 (oldest deadline 2024-09-19T06:27:01.694329+0000) 2024-09-19T06:27:02.292 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:02 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:02.045+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:27:02.293 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:02 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:02.045+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:27:02.293 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:02 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:02.045+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.716143+0000 front 2024-09-19T06:26:21.716261+0000 (oldest deadline 2024-09-19T06:26:45.215937+0000) 2024-09-19T06:27:02.293 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:02 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:02.045+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:29.118125+0000 front 2024-09-19T06:26:29.118102+0000 (oldest deadline 2024-09-19T06:26:52.617920+0000) 2024-09-19T06:27:02.293 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:02 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:02.045+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:35.518654+0000 front 2024-09-19T06:26:35.518703+0000 (oldest deadline 2024-09-19T06:27:00.818859+0000) 2024-09-19T06:27:02.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:02 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:02.431+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:27:02.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:02 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:02.431+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.318946+0000 front 2024-09-19T06:26:15.318994+0000 (oldest deadline 2024-09-19T06:26:41.218838+0000) 2024-09-19T06:27:02.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:02 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:02.431+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.919900+0000 front 2024-09-19T06:26:22.919984+0000 (oldest deadline 2024-09-19T06:26:45.819888+0000) 2024-09-19T06:27:02.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:02 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:02.431+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:31.621525+0000 front 2024-09-19T06:26:31.621549+0000 (oldest deadline 2024-09-19T06:26:52.721789+0000) 2024-09-19T06:27:02.739 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:02 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:02.653+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.373916+0000 front 2024-09-19T06:26:06.373780+0000 (oldest deadline 2024-09-19T06:26:33.974229+0000) 2024-09-19T06:27:02.740 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:02 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:02.653+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.675600+0000 front 2024-09-19T06:26:15.675449+0000 (oldest deadline 2024-09-19T06:26:41.575417+0000) 2024-09-19T06:27:02.740 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:02 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:02.653+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.076265+0000 front 2024-09-19T06:26:22.076250+0000 (oldest deadline 2024-09-19T06:26:46.776197+0000) 2024-09-19T06:27:02.740 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:02 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:02.653+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:31.277819+0000 front 2024-09-19T06:26:31.277805+0000 (oldest deadline 2024-09-19T06:26:56.577903+0000) 2024-09-19T06:27:02.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:02 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:02.412+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:27:02.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:02 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:02.412+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:27:02.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:02 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:02.412+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:27:02.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:02 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:02.412+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:38.544834+0000 front 2024-09-19T06:26:38.544764+0000 (oldest deadline 2024-09-19T06:27:02.044779+0000) 2024-09-19T06:27:03.542 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:27:03 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:27:03.047+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.991287+0000 front 2024-09-19T06:26:15.991210+0000 (oldest deadline 2024-09-19T06:26:41.291410+0000) 2024-09-19T06:27:03.542 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:27:03 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:27:03.047+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.291969+0000 front 2024-09-19T06:26:21.292104+0000 (oldest deadline 2024-09-19T06:26:45.991859+0000) 2024-09-19T06:27:03.542 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:27:03 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:27:03.047+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:28.892984+0000 front 2024-09-19T06:26:28.893006+0000 (oldest deadline 2024-09-19T06:26:53.592929+0000) 2024-09-19T06:27:03.542 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:27:03 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7[52124]: 2024-09-19T06:27:03.047+0000 7f221b5fb640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:36.394099+0000 front 2024-09-19T06:26:36.394121+0000 (oldest deadline 2024-09-19T06:27:01.694329+0000) 2024-09-19T06:27:03.543 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:03 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:03.076+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:27:03.543 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:03 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:03.076+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:27:03.543 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:03 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:03.076+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.716143+0000 front 2024-09-19T06:26:21.716261+0000 (oldest deadline 2024-09-19T06:26:45.215937+0000) 2024-09-19T06:27:03.543 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:03 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:03.076+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:29.118125+0000 front 2024-09-19T06:26:29.118102+0000 (oldest deadline 2024-09-19T06:26:52.617920+0000) 2024-09-19T06:27:03.543 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:03 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:03.076+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:35.518654+0000 front 2024-09-19T06:26:35.518703+0000 (oldest deadline 2024-09-19T06:27:00.818859+0000) 2024-09-19T06:27:03.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:03 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:03.438+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:27:03.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:03 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:03.438+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.318946+0000 front 2024-09-19T06:26:15.318994+0000 (oldest deadline 2024-09-19T06:26:41.218838+0000) 2024-09-19T06:27:03.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:03 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:03.438+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.919900+0000 front 2024-09-19T06:26:22.919984+0000 (oldest deadline 2024-09-19T06:26:45.819888+0000) 2024-09-19T06:27:03.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:03 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:03.438+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:31.621525+0000 front 2024-09-19T06:26:31.621549+0000 (oldest deadline 2024-09-19T06:26:52.721789+0000) 2024-09-19T06:27:03.740 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:03 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:03.611+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.373916+0000 front 2024-09-19T06:26:06.373780+0000 (oldest deadline 2024-09-19T06:26:33.974229+0000) 2024-09-19T06:27:03.740 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:03 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:03.611+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.675600+0000 front 2024-09-19T06:26:15.675449+0000 (oldest deadline 2024-09-19T06:26:41.575417+0000) 2024-09-19T06:27:03.740 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:03 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:03.611+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.076265+0000 front 2024-09-19T06:26:22.076250+0000 (oldest deadline 2024-09-19T06:26:46.776197+0000) 2024-09-19T06:27:03.740 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:03 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:03.611+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:31.277819+0000 front 2024-09-19T06:26:31.277805+0000 (oldest deadline 2024-09-19T06:26:56.577903+0000) 2024-09-19T06:27:03.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:03 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:03.411+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:27:03.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:03 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:03.411+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:27:03.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:03 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:03.411+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:27:03.741 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:03 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:03.411+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:38.544834+0000 front 2024-09-19T06:26:38.544764+0000 (oldest deadline 2024-09-19T06:27:02.044779+0000) 2024-09-19T06:27:04.542 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:27:04 smithi089 podman[69683]: 2024-09-19 06:27:04.272795759 +0000 UTC m=+5.472700603 container died c7745e17838bd90af69596f0b2092ccfbf035f55e90418ee5f5ccabff2fbc102 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-19T06:27:04.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:04 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:04.068+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:27:04.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:04 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:04.068+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:27:04.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:04 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:04.068+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.716143+0000 front 2024-09-19T06:26:21.716261+0000 (oldest deadline 2024-09-19T06:26:45.215937+0000) 2024-09-19T06:27:04.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:04 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:04.068+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:29.118125+0000 front 2024-09-19T06:26:29.118102+0000 (oldest deadline 2024-09-19T06:26:52.617920+0000) 2024-09-19T06:27:04.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:04 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:04.068+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:35.518654+0000 front 2024-09-19T06:26:35.518703+0000 (oldest deadline 2024-09-19T06:27:00.818859+0000) 2024-09-19T06:27:04.740 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:04 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:04.625+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.373916+0000 front 2024-09-19T06:26:06.373780+0000 (oldest deadline 2024-09-19T06:26:33.974229+0000) 2024-09-19T06:27:04.740 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:04 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:04.625+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.675600+0000 front 2024-09-19T06:26:15.675449+0000 (oldest deadline 2024-09-19T06:26:41.575417+0000) 2024-09-19T06:27:04.740 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:04 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:04.625+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.076265+0000 front 2024-09-19T06:26:22.076250+0000 (oldest deadline 2024-09-19T06:26:46.776197+0000) 2024-09-19T06:27:04.740 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:04 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:04.625+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:31.277819+0000 front 2024-09-19T06:26:31.277805+0000 (oldest deadline 2024-09-19T06:26:56.577903+0000) 2024-09-19T06:27:04.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:04 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:04.433+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:27:04.741 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:04 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:04.433+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:27:04.741 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:04 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:04.433+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:27:04.741 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:04 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:04.433+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:38.544834+0000 front 2024-09-19T06:26:38.544764+0000 (oldest deadline 2024-09-19T06:27:02.044779+0000) 2024-09-19T06:27:04.900 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:27:04 smithi089 podman[69683]: 2024-09-19 06:27:04.655497506 +0000 UTC m=+5.855402343 container cleanup c7745e17838bd90af69596f0b2092ccfbf035f55e90418ee5f5ccabff2fbc102 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-19T06:27:04.900 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:27:04 smithi089 bash[69683]: ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7 2024-09-19T06:27:04.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:04 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:04.485+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:27:04.973 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:04 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:04.485+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.318946+0000 front 2024-09-19T06:26:15.318994+0000 (oldest deadline 2024-09-19T06:26:41.218838+0000) 2024-09-19T06:27:04.973 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:04 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:04.485+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.919900+0000 front 2024-09-19T06:26:22.919984+0000 (oldest deadline 2024-09-19T06:26:45.819888+0000) 2024-09-19T06:27:04.973 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:04 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:04.485+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:31.621525+0000 front 2024-09-19T06:26:31.621549+0000 (oldest deadline 2024-09-19T06:26:52.721789+0000) 2024-09-19T06:27:05.200 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:27:04 smithi089 podman[69711]: 2024-09-19 06:27:04.898543411 +0000 UTC m=+0.626290945 container remove c7745e17838bd90af69596f0b2092ccfbf035f55e90418ee5f5ccabff2fbc102 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-19T06:27:05.200 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:05 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:05.073+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:27:05.200 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:05 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:05.073+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:27:05.200 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:05 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:05.073+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.716143+0000 front 2024-09-19T06:26:21.716261+0000 (oldest deadline 2024-09-19T06:26:45.215937+0000) 2024-09-19T06:27:05.200 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:05 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:05.073+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:29.118125+0000 front 2024-09-19T06:26:29.118102+0000 (oldest deadline 2024-09-19T06:26:52.617920+0000) 2024-09-19T06:27:05.200 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:05 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:05.073+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:35.518654+0000 front 2024-09-19T06:26:35.518703+0000 (oldest deadline 2024-09-19T06:27:00.818859+0000) 2024-09-19T06:27:05.502 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:27:05 smithi089 podman[69804]: 2024-09-19 06:27:05.199272325 +0000 UTC m=+0.104880351 container create 7e3d18d5be06d50c6e0d2cb6f7a7428102d54b3402cb9858309a6baa43cad238 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-19T06:27:05.502 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:27:05 smithi089 podman[69804]: 2024-09-19 06:27:05.110127139 +0000 UTC m=+0.015735131 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:27:05.502 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:27:05 smithi089 podman[69804]: 2024-09-19 06:27:05.418397665 +0000 UTC m=+0.324005652 container init 7e3d18d5be06d50c6e0d2cb6f7a7428102d54b3402cb9858309a6baa43cad238 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4) 2024-09-19T06:27:05.502 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:27:05 smithi089 podman[69804]: 2024-09-19 06:27:05.421678788 +0000 UTC m=+0.327286769 container start 7e3d18d5be06d50c6e0d2cb6f7a7428102d54b3402cb9858309a6baa43cad238 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-19T06:27:05.502 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:27:05 smithi089 podman[69804]: 2024-09-19 06:27:05.501378461 +0000 UTC m=+0.406986456 container attach 7e3d18d5be06d50c6e0d2cb6f7a7428102d54b3402cb9858309a6baa43cad238 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-19T06:27:05.740 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:05 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:05.601+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.373916+0000 front 2024-09-19T06:26:06.373780+0000 (oldest deadline 2024-09-19T06:26:33.974229+0000) 2024-09-19T06:27:05.740 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:05 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:05.601+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.675600+0000 front 2024-09-19T06:26:15.675449+0000 (oldest deadline 2024-09-19T06:26:41.575417+0000) 2024-09-19T06:27:05.740 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:05 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:05.601+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.076265+0000 front 2024-09-19T06:26:22.076250+0000 (oldest deadline 2024-09-19T06:26:46.776197+0000) 2024-09-19T06:27:05.740 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:05 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:05.601+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:31.277819+0000 front 2024-09-19T06:26:31.277805+0000 (oldest deadline 2024-09-19T06:26:56.577903+0000) 2024-09-19T06:27:05.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:05 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:05.418+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:27:05.741 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:05 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:05.418+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:27:05.741 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:05 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:05.418+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:27:05.741 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:05 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:05.418+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:38.544834+0000 front 2024-09-19T06:26:38.544764+0000 (oldest deadline 2024-09-19T06:27:02.044779+0000) 2024-09-19T06:27:05.792 INFO:journalctl@ceph.osd.7.smithi089.stdout:Sep 19 06:27:05 smithi089 podman[69804]: 2024-09-19 06:27:05.609305617 +0000 UTC m=+0.514913611 container died 7e3d18d5be06d50c6e0d2cb6f7a7428102d54b3402cb9858309a6baa43cad238 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-19T06:27:05.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:05 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:05.489+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:27:05.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:05 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:05.489+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.318946+0000 front 2024-09-19T06:26:15.318994+0000 (oldest deadline 2024-09-19T06:26:41.218838+0000) 2024-09-19T06:27:05.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:05 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:05.489+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.919900+0000 front 2024-09-19T06:26:22.919984+0000 (oldest deadline 2024-09-19T06:26:45.819888+0000) 2024-09-19T06:27:05.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:05 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:05.489+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:31.621525+0000 front 2024-09-19T06:26:31.621549+0000 (oldest deadline 2024-09-19T06:26:52.721789+0000) 2024-09-19T06:27:05.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:05 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:05.489+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:39.123628+0000 front 2024-09-19T06:26:39.123673+0000 (oldest deadline 2024-09-19T06:27:05.023542+0000) 2024-09-19T06:27:06.272 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:06 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:06.086+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:27:06.272 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:06 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:06.086+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:27:06.272 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:06 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:06.086+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.716143+0000 front 2024-09-19T06:26:21.716261+0000 (oldest deadline 2024-09-19T06:26:45.215937+0000) 2024-09-19T06:27:06.272 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:06 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:06.086+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:29.118125+0000 front 2024-09-19T06:26:29.118102+0000 (oldest deadline 2024-09-19T06:26:52.617920+0000) 2024-09-19T06:27:06.272 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:06 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:06.086+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:35.518654+0000 front 2024-09-19T06:26:35.518703+0000 (oldest deadline 2024-09-19T06:27:00.818859+0000) 2024-09-19T06:27:06.298 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@osd.7.service' 2024-09-19T06:27:06.339 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:27:06.339 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-19T06:27:06.340 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-19T06:27:06.340 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ceph-078f6612-764d-11ef-bceb-c7b262605968@osd.8 2024-09-19T06:27:06.623 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:06 smithi090 systemd[1]: Stopping Ceph osd.8 for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:27:06.624 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:06 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:06.432+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:27:06.624 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:06 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:06.433+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:27:06.624 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:06 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:06.433+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:27:06.624 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:06 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:06.433+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:38.544834+0000 front 2024-09-19T06:26:38.544764+0000 (oldest deadline 2024-09-19T06:27:02.044779+0000) 2024-09-19T06:27:06.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:06 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:06.476+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:27:06.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:06 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:06.476+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.318946+0000 front 2024-09-19T06:26:15.318994+0000 (oldest deadline 2024-09-19T06:26:41.218838+0000) 2024-09-19T06:27:06.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:06 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:06.476+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.919900+0000 front 2024-09-19T06:26:22.919984+0000 (oldest deadline 2024-09-19T06:26:45.819888+0000) 2024-09-19T06:27:06.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:06 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:06.476+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:31.621525+0000 front 2024-09-19T06:26:31.621549+0000 (oldest deadline 2024-09-19T06:26:52.721789+0000) 2024-09-19T06:27:06.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:06 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:06.476+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:39.123628+0000 front 2024-09-19T06:26:39.123673+0000 (oldest deadline 2024-09-19T06:27:05.023542+0000) 2024-09-19T06:27:06.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:06 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:06.622+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.373916+0000 front 2024-09-19T06:26:06.373780+0000 (oldest deadline 2024-09-19T06:26:33.974229+0000) 2024-09-19T06:27:06.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:06 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:06.622+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.675600+0000 front 2024-09-19T06:26:15.675449+0000 (oldest deadline 2024-09-19T06:26:41.575417+0000) 2024-09-19T06:27:06.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:06 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:06.622+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.076265+0000 front 2024-09-19T06:26:22.076250+0000 (oldest deadline 2024-09-19T06:26:46.776197+0000) 2024-09-19T06:27:06.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:06 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:06.622+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:31.277819+0000 front 2024-09-19T06:26:31.277805+0000 (oldest deadline 2024-09-19T06:26:56.577903+0000) 2024-09-19T06:27:06.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:06 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:06.644+0000 7fab86f27640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:27:06.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:06 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:06.644+0000 7fab86f27640 -1 osd.8 95 *** Got signal Terminated *** 2024-09-19T06:27:06.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:06 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:06.644+0000 7fab86f27640 -1 osd.8 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:27:07.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:07 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:07.089+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:27:07.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:07 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:07.089+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:27:07.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:07 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:07.089+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.716143+0000 front 2024-09-19T06:26:21.716261+0000 (oldest deadline 2024-09-19T06:26:45.215937+0000) 2024-09-19T06:27:07.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:07 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:07.089+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:29.118125+0000 front 2024-09-19T06:26:29.118102+0000 (oldest deadline 2024-09-19T06:26:52.617920+0000) 2024-09-19T06:27:07.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:07 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:07.089+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:35.518654+0000 front 2024-09-19T06:26:35.518703+0000 (oldest deadline 2024-09-19T06:27:00.818859+0000) 2024-09-19T06:27:07.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:07 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:07.454+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:27:07.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:07 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:07.454+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.318946+0000 front 2024-09-19T06:26:15.318994+0000 (oldest deadline 2024-09-19T06:26:41.218838+0000) 2024-09-19T06:27:07.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:07 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:07.454+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.919900+0000 front 2024-09-19T06:26:22.919984+0000 (oldest deadline 2024-09-19T06:26:45.819888+0000) 2024-09-19T06:27:07.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:07 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:07.454+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:31.621525+0000 front 2024-09-19T06:26:31.621549+0000 (oldest deadline 2024-09-19T06:26:52.721789+0000) 2024-09-19T06:27:07.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:07 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:07.454+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:39.123628+0000 front 2024-09-19T06:26:39.123673+0000 (oldest deadline 2024-09-19T06:27:05.023542+0000) 2024-09-19T06:27:07.739 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:07 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:07.405+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:27:07.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:07 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:07.405+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:27:07.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:07 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:07.405+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:27:07.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:07 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:07.405+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:38.544834+0000 front 2024-09-19T06:26:38.544764+0000 (oldest deadline 2024-09-19T06:27:02.044779+0000) 2024-09-19T06:27:07.740 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:07 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:07.644+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.373916+0000 front 2024-09-19T06:26:06.373780+0000 (oldest deadline 2024-09-19T06:26:33.974229+0000) 2024-09-19T06:27:07.740 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:07 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:07.644+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.675600+0000 front 2024-09-19T06:26:15.675449+0000 (oldest deadline 2024-09-19T06:26:41.575417+0000) 2024-09-19T06:27:07.740 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:07 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:07.644+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.076265+0000 front 2024-09-19T06:26:22.076250+0000 (oldest deadline 2024-09-19T06:26:46.776197+0000) 2024-09-19T06:27:07.740 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:07 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:07.644+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:31.277819+0000 front 2024-09-19T06:26:31.277805+0000 (oldest deadline 2024-09-19T06:26:56.577903+0000) 2024-09-19T06:27:08.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:08 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:08.122+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:27:08.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:08 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:08.122+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:27:08.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:08 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:08.122+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.716143+0000 front 2024-09-19T06:26:21.716261+0000 (oldest deadline 2024-09-19T06:26:45.215937+0000) 2024-09-19T06:27:08.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:08 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:08.122+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:29.118125+0000 front 2024-09-19T06:26:29.118102+0000 (oldest deadline 2024-09-19T06:26:52.617920+0000) 2024-09-19T06:27:08.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:08 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:08.122+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:35.518654+0000 front 2024-09-19T06:26:35.518703+0000 (oldest deadline 2024-09-19T06:27:00.818859+0000) 2024-09-19T06:27:08.695 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:08 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:08.382+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:27:08.695 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:08 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:08.382+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:27:08.695 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:08 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:08.382+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:27:08.695 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:08 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:08.382+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:38.544834+0000 front 2024-09-19T06:26:38.544764+0000 (oldest deadline 2024-09-19T06:27:02.044779+0000) 2024-09-19T06:27:08.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:08 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:08.426+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:27:08.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:08 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:08.426+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.318946+0000 front 2024-09-19T06:26:15.318994+0000 (oldest deadline 2024-09-19T06:26:41.218838+0000) 2024-09-19T06:27:08.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:08 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:08.426+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.919900+0000 front 2024-09-19T06:26:22.919984+0000 (oldest deadline 2024-09-19T06:26:45.819888+0000) 2024-09-19T06:27:08.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:08 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:08.426+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:31.621525+0000 front 2024-09-19T06:26:31.621549+0000 (oldest deadline 2024-09-19T06:26:52.721789+0000) 2024-09-19T06:27:08.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:08 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:08.426+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:39.123628+0000 front 2024-09-19T06:26:39.123673+0000 (oldest deadline 2024-09-19T06:27:05.023542+0000) 2024-09-19T06:27:08.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:08 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:08.693+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.373916+0000 front 2024-09-19T06:26:06.373780+0000 (oldest deadline 2024-09-19T06:26:33.974229+0000) 2024-09-19T06:27:08.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:08 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:08.693+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.675600+0000 front 2024-09-19T06:26:15.675449+0000 (oldest deadline 2024-09-19T06:26:41.575417+0000) 2024-09-19T06:27:08.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:08 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:08.693+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.076265+0000 front 2024-09-19T06:26:22.076250+0000 (oldest deadline 2024-09-19T06:26:46.776197+0000) 2024-09-19T06:27:08.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:08 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:08.693+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:31.277819+0000 front 2024-09-19T06:26:31.277805+0000 (oldest deadline 2024-09-19T06:26:56.577903+0000) 2024-09-19T06:27:09.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:09 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:09.171+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:27:09.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:09 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:09.171+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:27:09.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:09 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:09.171+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.716143+0000 front 2024-09-19T06:26:21.716261+0000 (oldest deadline 2024-09-19T06:26:45.215937+0000) 2024-09-19T06:27:09.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:09 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:09.171+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:29.118125+0000 front 2024-09-19T06:26:29.118102+0000 (oldest deadline 2024-09-19T06:26:52.617920+0000) 2024-09-19T06:27:09.543 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:09 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:09.171+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:35.518654+0000 front 2024-09-19T06:26:35.518703+0000 (oldest deadline 2024-09-19T06:27:00.818859+0000) 2024-09-19T06:27:09.543 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:09 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:09.171+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:43.119825+0000 front 2024-09-19T06:26:43.119733+0000 (oldest deadline 2024-09-19T06:27:09.019695+0000) 2024-09-19T06:27:09.651 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:09 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:09.379+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:27:09.652 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:09 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:09.379+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:27:09.652 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:09 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:09.379+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:27:09.652 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:09 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:09.379+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:38.544834+0000 front 2024-09-19T06:26:38.544764+0000 (oldest deadline 2024-09-19T06:27:02.044779+0000) 2024-09-19T06:27:09.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:09 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:09.397+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:27:09.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:09 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:09.397+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.318946+0000 front 2024-09-19T06:26:15.318994+0000 (oldest deadline 2024-09-19T06:26:41.218838+0000) 2024-09-19T06:27:09.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:09 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:09.397+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.919900+0000 front 2024-09-19T06:26:22.919984+0000 (oldest deadline 2024-09-19T06:26:45.819888+0000) 2024-09-19T06:27:09.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:09 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:09.397+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:31.621525+0000 front 2024-09-19T06:26:31.621549+0000 (oldest deadline 2024-09-19T06:26:52.721789+0000) 2024-09-19T06:27:09.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:09 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:09.397+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:39.123628+0000 front 2024-09-19T06:26:39.123673+0000 (oldest deadline 2024-09-19T06:27:05.023542+0000) 2024-09-19T06:27:09.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:09 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:09.650+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.373916+0000 front 2024-09-19T06:26:06.373780+0000 (oldest deadline 2024-09-19T06:26:33.974229+0000) 2024-09-19T06:27:09.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:09 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:09.650+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.675600+0000 front 2024-09-19T06:26:15.675449+0000 (oldest deadline 2024-09-19T06:26:41.575417+0000) 2024-09-19T06:27:09.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:09 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:09.650+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.076265+0000 front 2024-09-19T06:26:22.076250+0000 (oldest deadline 2024-09-19T06:26:46.776197+0000) 2024-09-19T06:27:09.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:09 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:09.650+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:31.277819+0000 front 2024-09-19T06:26:31.277805+0000 (oldest deadline 2024-09-19T06:26:56.577903+0000) 2024-09-19T06:27:09.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:09 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:09.650+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:47.079655+0000 front 2024-09-19T06:26:47.079633+0000 (oldest deadline 2024-09-19T06:27:09.379659+0000) 2024-09-19T06:27:10.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:10 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:10.199+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:27:10.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:10 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:10.199+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:27:10.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:10 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:10.199+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.716143+0000 front 2024-09-19T06:26:21.716261+0000 (oldest deadline 2024-09-19T06:26:45.215937+0000) 2024-09-19T06:27:10.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:10 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:10.199+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:29.118125+0000 front 2024-09-19T06:26:29.118102+0000 (oldest deadline 2024-09-19T06:26:52.617920+0000) 2024-09-19T06:27:10.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:10 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:10.199+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:35.518654+0000 front 2024-09-19T06:26:35.518703+0000 (oldest deadline 2024-09-19T06:27:00.818859+0000) 2024-09-19T06:27:10.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:10 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:10.199+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:43.119825+0000 front 2024-09-19T06:26:43.119733+0000 (oldest deadline 2024-09-19T06:27:09.019695+0000) 2024-09-19T06:27:10.674 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:10 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:10.393+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:27:10.674 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:10 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:10.393+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:27:10.674 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:10 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:10.393+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:27:10.675 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:10 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:10.393+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:38.544834+0000 front 2024-09-19T06:26:38.544764+0000 (oldest deadline 2024-09-19T06:27:02.044779+0000) 2024-09-19T06:27:10.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:10 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:10.350+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:27:10.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:10 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:10.350+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.318946+0000 front 2024-09-19T06:26:15.318994+0000 (oldest deadline 2024-09-19T06:26:41.218838+0000) 2024-09-19T06:27:10.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:10 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:10.350+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.919900+0000 front 2024-09-19T06:26:22.919984+0000 (oldest deadline 2024-09-19T06:26:45.819888+0000) 2024-09-19T06:27:10.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:10 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:10.350+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:31.621525+0000 front 2024-09-19T06:26:31.621549+0000 (oldest deadline 2024-09-19T06:26:52.721789+0000) 2024-09-19T06:27:10.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:10 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:10.350+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:39.123628+0000 front 2024-09-19T06:26:39.123673+0000 (oldest deadline 2024-09-19T06:27:05.023542+0000) 2024-09-19T06:27:10.989 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:10 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:10.672+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:06.373916+0000 front 2024-09-19T06:26:06.373780+0000 (oldest deadline 2024-09-19T06:26:33.974229+0000) 2024-09-19T06:27:10.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:10 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:10.672+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.675600+0000 front 2024-09-19T06:26:15.675449+0000 (oldest deadline 2024-09-19T06:26:41.575417+0000) 2024-09-19T06:27:10.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:10 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:10.672+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.076265+0000 front 2024-09-19T06:26:22.076250+0000 (oldest deadline 2024-09-19T06:26:46.776197+0000) 2024-09-19T06:27:10.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:10 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:10.672+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:31.277819+0000 front 2024-09-19T06:26:31.277805+0000 (oldest deadline 2024-09-19T06:26:56.577903+0000) 2024-09-19T06:27:10.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:10 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8[52733]: 2024-09-19T06:27:10.672+0000 7fab7f524640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:47.079655+0000 front 2024-09-19T06:26:47.079633+0000 (oldest deadline 2024-09-19T06:27:09.379659+0000) 2024-09-19T06:27:11.292 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:11 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:11.219+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:27:11.292 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:11 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:11.219+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:27:11.292 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:11 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:11.219+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.716143+0000 front 2024-09-19T06:26:21.716261+0000 (oldest deadline 2024-09-19T06:26:45.215937+0000) 2024-09-19T06:27:11.292 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:11 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:11.219+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:29.118125+0000 front 2024-09-19T06:26:29.118102+0000 (oldest deadline 2024-09-19T06:26:52.617920+0000) 2024-09-19T06:27:11.292 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:11 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:11.219+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:35.518654+0000 front 2024-09-19T06:26:35.518703+0000 (oldest deadline 2024-09-19T06:27:00.818859+0000) 2024-09-19T06:27:11.293 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:11 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:11.219+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:43.119825+0000 front 2024-09-19T06:26:43.119733+0000 (oldest deadline 2024-09-19T06:27:09.019695+0000) 2024-09-19T06:27:11.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:11 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:11.355+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:27:11.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:11 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:11.355+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.318946+0000 front 2024-09-19T06:26:15.318994+0000 (oldest deadline 2024-09-19T06:26:41.218838+0000) 2024-09-19T06:27:11.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:11 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:11.355+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.919900+0000 front 2024-09-19T06:26:22.919984+0000 (oldest deadline 2024-09-19T06:26:45.819888+0000) 2024-09-19T06:27:11.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:11 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:11.355+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:31.621525+0000 front 2024-09-19T06:26:31.621549+0000 (oldest deadline 2024-09-19T06:26:52.721789+0000) 2024-09-19T06:27:11.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:11 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:11.355+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:39.123628+0000 front 2024-09-19T06:26:39.123673+0000 (oldest deadline 2024-09-19T06:27:05.023542+0000) 2024-09-19T06:27:11.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:11 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:11.355+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:47.825012+0000 front 2024-09-19T06:26:47.824981+0000 (oldest deadline 2024-09-19T06:27:10.724861+0000) 2024-09-19T06:27:11.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:11 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:11.393+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:27:11.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:11 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:11.393+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:27:11.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:11 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:11.393+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:27:11.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:11 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:11.393+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:38.544834+0000 front 2024-09-19T06:26:38.544764+0000 (oldest deadline 2024-09-19T06:27:02.044779+0000) 2024-09-19T06:27:12.490 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:12 smithi090 podman[71022]: 2024-09-19 06:27:12.159714191 +0000 UTC m=+5.623353948 container died 682d18ab398948c84327e63ecea0b2d033b9c34c730526b3b040b724a8dc2455 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4) 2024-09-19T06:27:12.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:12 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:12.368+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:27:12.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:12 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:12.368+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:27:12.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:12 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:12.368+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:27:12.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:12 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:12.368+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:38.544834+0000 front 2024-09-19T06:26:38.544764+0000 (oldest deadline 2024-09-19T06:27:02.044779+0000) 2024-09-19T06:27:12.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:12 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:12.368+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:47.345648+0000 front 2024-09-19T06:26:47.345566+0000 (oldest deadline 2024-09-19T06:27:12.045605+0000) 2024-09-19T06:27:12.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:12 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:12.218+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:27:12.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:12 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:12.218+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:27:12.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:12 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:12.218+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.716143+0000 front 2024-09-19T06:26:21.716261+0000 (oldest deadline 2024-09-19T06:26:45.215937+0000) 2024-09-19T06:27:12.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:12 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:12.218+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:29.118125+0000 front 2024-09-19T06:26:29.118102+0000 (oldest deadline 2024-09-19T06:26:52.617920+0000) 2024-09-19T06:27:12.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:12 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:12.218+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:35.518654+0000 front 2024-09-19T06:26:35.518703+0000 (oldest deadline 2024-09-19T06:27:00.818859+0000) 2024-09-19T06:27:12.543 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:12 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:12.218+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:43.119825+0000 front 2024-09-19T06:26:43.119733+0000 (oldest deadline 2024-09-19T06:27:09.019695+0000) 2024-09-19T06:27:12.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:12 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:12.341+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:27:12.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:12 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:12.341+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.318946+0000 front 2024-09-19T06:26:15.318994+0000 (oldest deadline 2024-09-19T06:26:41.218838+0000) 2024-09-19T06:27:12.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:12 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:12.341+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.919900+0000 front 2024-09-19T06:26:22.919984+0000 (oldest deadline 2024-09-19T06:26:45.819888+0000) 2024-09-19T06:27:12.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:12 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:12.341+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:31.621525+0000 front 2024-09-19T06:26:31.621549+0000 (oldest deadline 2024-09-19T06:26:52.721789+0000) 2024-09-19T06:27:12.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:12 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:12.341+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:39.123628+0000 front 2024-09-19T06:26:39.123673+0000 (oldest deadline 2024-09-19T06:27:05.023542+0000) 2024-09-19T06:27:12.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:12 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:12.341+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:47.825012+0000 front 2024-09-19T06:26:47.824981+0000 (oldest deadline 2024-09-19T06:27:10.724861+0000) 2024-09-19T06:27:12.989 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:12 smithi090 podman[71022]: 2024-09-19 06:27:12.495387018 +0000 UTC m=+5.959026773 container cleanup 682d18ab398948c84327e63ecea0b2d033b9c34c730526b3b040b724a8dc2455 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-19T06:27:12.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:12 smithi090 bash[71022]: ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8 2024-09-19T06:27:12.990 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:12 smithi090 podman[71036]: 2024-09-19 06:27:12.690003298 +0000 UTC m=+0.532378221 container remove 682d18ab398948c84327e63ecea0b2d033b9c34c730526b3b040b724a8dc2455 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-19T06:27:13.402 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:13 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:13.324+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:27:13.403 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:13 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:13.324+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:27:13.403 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:13 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:13.324+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:27:13.403 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:13 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:13.324+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:38.544834+0000 front 2024-09-19T06:26:38.544764+0000 (oldest deadline 2024-09-19T06:27:02.044779+0000) 2024-09-19T06:27:13.403 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:13 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:13.324+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:47.345648+0000 front 2024-09-19T06:26:47.345566+0000 (oldest deadline 2024-09-19T06:27:12.045605+0000) 2024-09-19T06:27:13.403 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:13 smithi090 podman[71122]: 2024-09-19 06:27:13.091085054 +0000 UTC m=+0.099108797 container create 79fc842fe3dd043651c1ed38a8b0d8bde01ecb173086cbd897382864eacd87b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-19T06:27:13.403 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:13 smithi090 podman[71122]: 2024-09-19 06:27:13.007693892 +0000 UTC m=+0.015717649 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:27:13.403 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:13 smithi090 podman[71122]: 2024-09-19 06:27:13.302021034 +0000 UTC m=+0.310044782 container init 79fc842fe3dd043651c1ed38a8b0d8bde01ecb173086cbd897382864eacd87b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-19T06:27:13.403 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:13 smithi090 podman[71122]: 2024-09-19 06:27:13.305193604 +0000 UTC m=+0.313217357 container start 79fc842fe3dd043651c1ed38a8b0d8bde01ecb173086cbd897382864eacd87b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-19T06:27:13.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:13 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:13.264+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:27:13.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:13 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:13.264+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:27:13.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:13 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:13.264+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.716143+0000 front 2024-09-19T06:26:21.716261+0000 (oldest deadline 2024-09-19T06:26:45.215937+0000) 2024-09-19T06:27:13.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:13 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:13.264+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:29.118125+0000 front 2024-09-19T06:26:29.118102+0000 (oldest deadline 2024-09-19T06:26:52.617920+0000) 2024-09-19T06:27:13.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:13 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:13.264+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:35.518654+0000 front 2024-09-19T06:26:35.518703+0000 (oldest deadline 2024-09-19T06:27:00.818859+0000) 2024-09-19T06:27:13.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:13 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:13.264+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:43.119825+0000 front 2024-09-19T06:26:43.119733+0000 (oldest deadline 2024-09-19T06:27:09.019695+0000) 2024-09-19T06:27:13.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:13 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:13.335+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:27:13.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:13 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:13.335+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.318946+0000 front 2024-09-19T06:26:15.318994+0000 (oldest deadline 2024-09-19T06:26:41.218838+0000) 2024-09-19T06:27:13.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:13 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:13.335+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.919900+0000 front 2024-09-19T06:26:22.919984+0000 (oldest deadline 2024-09-19T06:26:45.819888+0000) 2024-09-19T06:27:13.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:13 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:13.335+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:31.621525+0000 front 2024-09-19T06:26:31.621549+0000 (oldest deadline 2024-09-19T06:26:52.721789+0000) 2024-09-19T06:27:13.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:13 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:13.335+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:39.123628+0000 front 2024-09-19T06:26:39.123673+0000 (oldest deadline 2024-09-19T06:27:05.023542+0000) 2024-09-19T06:27:13.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:13 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:13.335+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:47.825012+0000 front 2024-09-19T06:26:47.824981+0000 (oldest deadline 2024-09-19T06:27:10.724861+0000) 2024-09-19T06:27:13.739 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:13 smithi090 podman[71122]: 2024-09-19 06:27:13.402021115 +0000 UTC m=+0.410044887 container attach 79fc842fe3dd043651c1ed38a8b0d8bde01ecb173086cbd897382864eacd87b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:27:13.740 INFO:journalctl@ceph.osd.8.smithi090.stdout:Sep 19 06:27:13 smithi090 podman[71122]: 2024-09-19 06:27:13.502201805 +0000 UTC m=+0.510225561 container died 79fc842fe3dd043651c1ed38a8b0d8bde01ecb173086cbd897382864eacd87b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T06:27:14.160 DEBUG:teuthology.orchestra.run.smithi090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@osd.8.service' 2024-09-19T06:27:14.199 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:27:14.199 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-19T06:27:14.200 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-19T06:27:14.200 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-078f6612-764d-11ef-bceb-c7b262605968@osd.9 2024-09-19T06:27:14.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:14 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:14.304+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:27:14.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:14 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:14.304+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:27:14.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:14 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:14.304+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:27:14.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:14 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:14.304+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:38.544834+0000 front 2024-09-19T06:26:38.544764+0000 (oldest deadline 2024-09-19T06:27:02.044779+0000) 2024-09-19T06:27:14.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:14 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:14.304+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:47.345648+0000 front 2024-09-19T06:26:47.345566+0000 (oldest deadline 2024-09-19T06:27:12.045605+0000) 2024-09-19T06:27:14.499 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:14 smithi002 systemd[1]: Stopping Ceph osd.9 for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:27:14.499 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:14 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:14.343+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:27:14.499 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:14 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:14.343+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.318946+0000 front 2024-09-19T06:26:15.318994+0000 (oldest deadline 2024-09-19T06:26:41.218838+0000) 2024-09-19T06:27:14.499 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:14 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:14.343+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.919900+0000 front 2024-09-19T06:26:22.919984+0000 (oldest deadline 2024-09-19T06:26:45.819888+0000) 2024-09-19T06:27:14.499 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:14 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:14.343+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:31.621525+0000 front 2024-09-19T06:26:31.621549+0000 (oldest deadline 2024-09-19T06:26:52.721789+0000) 2024-09-19T06:27:14.499 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:14 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:14.343+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:39.123628+0000 front 2024-09-19T06:26:39.123673+0000 (oldest deadline 2024-09-19T06:27:05.023542+0000) 2024-09-19T06:27:14.499 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:14 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:14.343+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:47.825012+0000 front 2024-09-19T06:26:47.824981+0000 (oldest deadline 2024-09-19T06:27:10.724861+0000) 2024-09-19T06:27:14.499 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:14 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:14.497+0000 7f415c5d4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:27:14.499 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:14 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:14.497+0000 7f415c5d4640 -1 osd.9 95 *** Got signal Terminated *** 2024-09-19T06:27:14.499 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:14 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:14.497+0000 7f415c5d4640 -1 osd.9 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:27:14.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:14 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:14.279+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:27:14.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:14 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:14.279+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:27:14.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:14 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:14.279+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.716143+0000 front 2024-09-19T06:26:21.716261+0000 (oldest deadline 2024-09-19T06:26:45.215937+0000) 2024-09-19T06:27:14.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:14 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:14.279+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:29.118125+0000 front 2024-09-19T06:26:29.118102+0000 (oldest deadline 2024-09-19T06:26:52.617920+0000) 2024-09-19T06:27:14.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:14 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:14.279+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:35.518654+0000 front 2024-09-19T06:26:35.518703+0000 (oldest deadline 2024-09-19T06:27:00.818859+0000) 2024-09-19T06:27:14.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:14 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:14.279+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:43.119825+0000 front 2024-09-19T06:26:43.119733+0000 (oldest deadline 2024-09-19T06:27:09.019695+0000) 2024-09-19T06:27:15.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:15 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:15.322+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:27:15.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:15 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:15.322+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.318946+0000 front 2024-09-19T06:26:15.318994+0000 (oldest deadline 2024-09-19T06:26:41.218838+0000) 2024-09-19T06:27:15.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:15 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:15.322+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.919900+0000 front 2024-09-19T06:26:22.919984+0000 (oldest deadline 2024-09-19T06:26:45.819888+0000) 2024-09-19T06:27:15.723 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:15 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:15.322+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:31.621525+0000 front 2024-09-19T06:26:31.621549+0000 (oldest deadline 2024-09-19T06:26:52.721789+0000) 2024-09-19T06:27:15.723 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:15 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:15.322+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:39.123628+0000 front 2024-09-19T06:26:39.123673+0000 (oldest deadline 2024-09-19T06:27:05.023542+0000) 2024-09-19T06:27:15.723 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:15 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:15.322+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:47.825012+0000 front 2024-09-19T06:26:47.824981+0000 (oldest deadline 2024-09-19T06:27:10.724861+0000) 2024-09-19T06:27:15.739 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:15 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:15.335+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:27:15.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:15 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:15.335+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:27:15.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:15 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:15.335+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:27:15.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:15 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:15.335+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:38.544834+0000 front 2024-09-19T06:26:38.544764+0000 (oldest deadline 2024-09-19T06:27:02.044779+0000) 2024-09-19T06:27:15.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:15 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:15.335+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:47.345648+0000 front 2024-09-19T06:26:47.345566+0000 (oldest deadline 2024-09-19T06:27:12.045605+0000) 2024-09-19T06:27:15.792 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:15 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:15.322+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:27:15.792 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:15 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:15.322+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:27:15.792 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:15 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:15.322+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.716143+0000 front 2024-09-19T06:26:21.716261+0000 (oldest deadline 2024-09-19T06:26:45.215937+0000) 2024-09-19T06:27:15.792 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:15 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:15.322+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:29.118125+0000 front 2024-09-19T06:26:29.118102+0000 (oldest deadline 2024-09-19T06:26:52.617920+0000) 2024-09-19T06:27:15.792 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:15 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:15.322+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:35.518654+0000 front 2024-09-19T06:26:35.518703+0000 (oldest deadline 2024-09-19T06:27:00.818859+0000) 2024-09-19T06:27:15.793 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:15 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:15.322+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:43.119825+0000 front 2024-09-19T06:26:43.119733+0000 (oldest deadline 2024-09-19T06:27:09.019695+0000) 2024-09-19T06:27:16.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:16 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:16.272+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:27:16.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:16 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:16.272+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:27:16.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:16 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:16.272+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.716143+0000 front 2024-09-19T06:26:21.716261+0000 (oldest deadline 2024-09-19T06:26:45.215937+0000) 2024-09-19T06:27:16.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:16 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:16.272+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:29.118125+0000 front 2024-09-19T06:26:29.118102+0000 (oldest deadline 2024-09-19T06:26:52.617920+0000) 2024-09-19T06:27:16.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:16 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:16.272+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:35.518654+0000 front 2024-09-19T06:26:35.518703+0000 (oldest deadline 2024-09-19T06:27:00.818859+0000) 2024-09-19T06:27:16.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:16 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:16.272+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:43.119825+0000 front 2024-09-19T06:26:43.119733+0000 (oldest deadline 2024-09-19T06:27:09.019695+0000) 2024-09-19T06:27:16.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:16 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:16.352+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:27:16.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:16 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:16.352+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.318946+0000 front 2024-09-19T06:26:15.318994+0000 (oldest deadline 2024-09-19T06:26:41.218838+0000) 2024-09-19T06:27:16.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:16 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:16.352+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.919900+0000 front 2024-09-19T06:26:22.919984+0000 (oldest deadline 2024-09-19T06:26:45.819888+0000) 2024-09-19T06:27:16.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:16 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:16.352+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:31.621525+0000 front 2024-09-19T06:26:31.621549+0000 (oldest deadline 2024-09-19T06:26:52.721789+0000) 2024-09-19T06:27:16.723 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:16 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:16.352+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:39.123628+0000 front 2024-09-19T06:26:39.123673+0000 (oldest deadline 2024-09-19T06:27:05.023542+0000) 2024-09-19T06:27:16.723 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:16 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:16.352+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:47.825012+0000 front 2024-09-19T06:26:47.824981+0000 (oldest deadline 2024-09-19T06:27:10.724861+0000) 2024-09-19T06:27:16.739 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:16 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:16.326+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:27:16.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:16 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:16.326+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:27:16.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:16 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:16.326+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:27:16.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:16 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:16.326+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:38.544834+0000 front 2024-09-19T06:26:38.544764+0000 (oldest deadline 2024-09-19T06:27:02.044779+0000) 2024-09-19T06:27:16.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:16 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:16.326+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:47.345648+0000 front 2024-09-19T06:26:47.345566+0000 (oldest deadline 2024-09-19T06:27:12.045605+0000) 2024-09-19T06:27:17.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:17 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:17.243+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:27:17.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:17 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:17.243+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:27:17.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:17 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:17.243+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.716143+0000 front 2024-09-19T06:26:21.716261+0000 (oldest deadline 2024-09-19T06:26:45.215937+0000) 2024-09-19T06:27:17.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:17 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:17.243+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:29.118125+0000 front 2024-09-19T06:26:29.118102+0000 (oldest deadline 2024-09-19T06:26:52.617920+0000) 2024-09-19T06:27:17.543 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:17 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:17.243+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:35.518654+0000 front 2024-09-19T06:26:35.518703+0000 (oldest deadline 2024-09-19T06:27:00.818859+0000) 2024-09-19T06:27:17.543 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:17 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:17.243+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:43.119825+0000 front 2024-09-19T06:26:43.119733+0000 (oldest deadline 2024-09-19T06:27:09.019695+0000) 2024-09-19T06:27:17.543 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:17 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:17.243+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-19T06:26:52.520871+0000 front 2024-09-19T06:26:52.520922+0000 (oldest deadline 2024-09-19T06:27:16.620777+0000) 2024-09-19T06:27:17.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:17 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:17.382+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:27:17.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:17 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:17.382+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.318946+0000 front 2024-09-19T06:26:15.318994+0000 (oldest deadline 2024-09-19T06:26:41.218838+0000) 2024-09-19T06:27:17.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:17 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:17.382+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.919900+0000 front 2024-09-19T06:26:22.919984+0000 (oldest deadline 2024-09-19T06:26:45.819888+0000) 2024-09-19T06:27:17.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:17 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:17.382+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:31.621525+0000 front 2024-09-19T06:26:31.621549+0000 (oldest deadline 2024-09-19T06:26:52.721789+0000) 2024-09-19T06:27:17.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:17 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:17.383+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:39.123628+0000 front 2024-09-19T06:26:39.123673+0000 (oldest deadline 2024-09-19T06:27:05.023542+0000) 2024-09-19T06:27:17.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:17 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:17.383+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:47.825012+0000 front 2024-09-19T06:26:47.824981+0000 (oldest deadline 2024-09-19T06:27:10.724861+0000) 2024-09-19T06:27:17.739 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:17 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:17.328+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:27:17.739 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:17 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:17.328+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:27:17.739 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:17 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:17.328+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:27:17.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:17 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:17.328+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:38.544834+0000 front 2024-09-19T06:26:38.544764+0000 (oldest deadline 2024-09-19T06:27:02.044779+0000) 2024-09-19T06:27:17.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:17 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:17.328+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:47.345648+0000 front 2024-09-19T06:26:47.345566+0000 (oldest deadline 2024-09-19T06:27:12.045605+0000) 2024-09-19T06:27:18.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:18 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:18.249+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:27:18.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:18 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:18.249+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:27:18.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:18 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:18.249+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.716143+0000 front 2024-09-19T06:26:21.716261+0000 (oldest deadline 2024-09-19T06:26:45.215937+0000) 2024-09-19T06:27:18.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:18 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:18.249+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:29.118125+0000 front 2024-09-19T06:26:29.118102+0000 (oldest deadline 2024-09-19T06:26:52.617920+0000) 2024-09-19T06:27:18.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:18 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:18.249+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:35.518654+0000 front 2024-09-19T06:26:35.518703+0000 (oldest deadline 2024-09-19T06:27:00.818859+0000) 2024-09-19T06:27:18.543 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:18 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:18.249+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:43.119825+0000 front 2024-09-19T06:26:43.119733+0000 (oldest deadline 2024-09-19T06:27:09.019695+0000) 2024-09-19T06:27:18.543 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:18 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:18.249+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-19T06:26:52.520871+0000 front 2024-09-19T06:26:52.520922+0000 (oldest deadline 2024-09-19T06:27:16.620777+0000) 2024-09-19T06:27:18.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:18 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:18.395+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:27:18.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:18 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:18.395+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.318946+0000 front 2024-09-19T06:26:15.318994+0000 (oldest deadline 2024-09-19T06:26:41.218838+0000) 2024-09-19T06:27:18.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:18 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:18.395+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.919900+0000 front 2024-09-19T06:26:22.919984+0000 (oldest deadline 2024-09-19T06:26:45.819888+0000) 2024-09-19T06:27:18.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:18 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:18.395+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:31.621525+0000 front 2024-09-19T06:26:31.621549+0000 (oldest deadline 2024-09-19T06:26:52.721789+0000) 2024-09-19T06:27:18.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:18 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:18.395+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:39.123628+0000 front 2024-09-19T06:26:39.123673+0000 (oldest deadline 2024-09-19T06:27:05.023542+0000) 2024-09-19T06:27:18.723 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:18 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:18.395+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:47.825012+0000 front 2024-09-19T06:26:47.824981+0000 (oldest deadline 2024-09-19T06:27:10.724861+0000) 2024-09-19T06:27:18.723 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:18 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:18.395+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-19T06:26:54.225788+0000 front 2024-09-19T06:26:54.225829+0000 (oldest deadline 2024-09-19T06:27:18.325830+0000) 2024-09-19T06:27:18.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:18 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:18.316+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:27:18.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:18 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:18.316+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:27:18.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:18 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:18.316+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:27:18.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:18 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:18.316+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:38.544834+0000 front 2024-09-19T06:26:38.544764+0000 (oldest deadline 2024-09-19T06:27:02.044779+0000) 2024-09-19T06:27:18.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:18 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:18.316+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:47.345648+0000 front 2024-09-19T06:26:47.345566+0000 (oldest deadline 2024-09-19T06:27:12.045605+0000) 2024-09-19T06:27:19.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:19 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:19.273+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:27:19.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:19 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:19.273+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:27:19.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:19 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:19.273+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.716143+0000 front 2024-09-19T06:26:21.716261+0000 (oldest deadline 2024-09-19T06:26:45.215937+0000) 2024-09-19T06:27:19.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:19 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:19.273+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:29.118125+0000 front 2024-09-19T06:26:29.118102+0000 (oldest deadline 2024-09-19T06:26:52.617920+0000) 2024-09-19T06:27:19.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:19 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:19.273+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:35.518654+0000 front 2024-09-19T06:26:35.518703+0000 (oldest deadline 2024-09-19T06:27:00.818859+0000) 2024-09-19T06:27:19.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:19 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:19.273+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:43.119825+0000 front 2024-09-19T06:26:43.119733+0000 (oldest deadline 2024-09-19T06:27:09.019695+0000) 2024-09-19T06:27:19.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:19 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:19.273+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-19T06:26:52.520871+0000 front 2024-09-19T06:26:52.520922+0000 (oldest deadline 2024-09-19T06:27:16.620777+0000) 2024-09-19T06:27:19.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:19 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:19.399+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.717836+0000 front 2024-09-19T06:26:07.717703+0000 (oldest deadline 2024-09-19T06:26:30.017919+0000) 2024-09-19T06:27:19.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:19 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:19.399+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.318946+0000 front 2024-09-19T06:26:15.318994+0000 (oldest deadline 2024-09-19T06:26:41.218838+0000) 2024-09-19T06:27:19.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:19 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:19.399+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:22.919900+0000 front 2024-09-19T06:26:22.919984+0000 (oldest deadline 2024-09-19T06:26:45.819888+0000) 2024-09-19T06:27:19.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:19 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:19.399+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:31.621525+0000 front 2024-09-19T06:26:31.621549+0000 (oldest deadline 2024-09-19T06:26:52.721789+0000) 2024-09-19T06:27:19.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:19 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:19.399+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:39.123628+0000 front 2024-09-19T06:26:39.123673+0000 (oldest deadline 2024-09-19T06:27:05.023542+0000) 2024-09-19T06:27:19.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:19 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:19.399+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:47.825012+0000 front 2024-09-19T06:26:47.824981+0000 (oldest deadline 2024-09-19T06:27:10.724861+0000) 2024-09-19T06:27:19.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:19 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9[64557]: 2024-09-19T06:27:19.399+0000 7f4158bd9640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-19T06:26:54.225788+0000 front 2024-09-19T06:26:54.225829+0000 (oldest deadline 2024-09-19T06:27:18.325830+0000) 2024-09-19T06:27:19.739 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:19 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:19.282+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:27:19.739 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:19 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:19.282+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:27:19.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:19 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:19.282+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:27:19.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:19 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:19.282+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:38.544834+0000 front 2024-09-19T06:26:38.544764+0000 (oldest deadline 2024-09-19T06:27:02.044779+0000) 2024-09-19T06:27:19.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:19 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:19.282+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:47.345648+0000 front 2024-09-19T06:26:47.345566+0000 (oldest deadline 2024-09-19T06:27:12.045605+0000) 2024-09-19T06:27:19.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:19 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:19.282+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-19T06:26:53.146482+0000 front 2024-09-19T06:26:53.146453+0000 (oldest deadline 2024-09-19T06:27:19.046368+0000) 2024-09-19T06:27:20.222 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:19 smithi002 podman[119445]: 2024-09-19 06:27:19.8401259 +0000 UTC m=+5.441324933 container died 1f0fd5a2dfb94518e7c6c6d43171aa24851cc8125d389ad5241392471e0c09e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:27:20.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:20 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:20.268+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:27:20.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:20 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:20.268+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:27:20.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:20 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:20.268+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.716143+0000 front 2024-09-19T06:26:21.716261+0000 (oldest deadline 2024-09-19T06:26:45.215937+0000) 2024-09-19T06:27:20.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:20 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:20.268+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:29.118125+0000 front 2024-09-19T06:26:29.118102+0000 (oldest deadline 2024-09-19T06:26:52.617920+0000) 2024-09-19T06:27:20.543 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:20 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:20.268+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:35.518654+0000 front 2024-09-19T06:26:35.518703+0000 (oldest deadline 2024-09-19T06:27:00.818859+0000) 2024-09-19T06:27:20.543 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:20 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:20.268+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:43.119825+0000 front 2024-09-19T06:26:43.119733+0000 (oldest deadline 2024-09-19T06:27:09.019695+0000) 2024-09-19T06:27:20.543 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:20 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:20.268+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-19T06:26:52.520871+0000 front 2024-09-19T06:26:52.520922+0000 (oldest deadline 2024-09-19T06:27:16.620777+0000) 2024-09-19T06:27:20.666 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:20 smithi002 podman[119445]: 2024-09-19 06:27:20.472016428 +0000 UTC m=+6.073215516 container cleanup 1f0fd5a2dfb94518e7c6c6d43171aa24851cc8125d389ad5241392471e0c09e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0) 2024-09-19T06:27:20.666 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:20 smithi002 bash[119445]: ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9 2024-09-19T06:27:20.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:20 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:20.268+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:27:20.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:20 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:20.268+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:27:20.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:20 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:20.268+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:27:20.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:20 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:20.268+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:38.544834+0000 front 2024-09-19T06:26:38.544764+0000 (oldest deadline 2024-09-19T06:27:02.044779+0000) 2024-09-19T06:27:20.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:20 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:20.268+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:47.345648+0000 front 2024-09-19T06:26:47.345566+0000 (oldest deadline 2024-09-19T06:27:12.045605+0000) 2024-09-19T06:27:20.740 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:20 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:20.268+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-19T06:26:53.146482+0000 front 2024-09-19T06:26:53.146453+0000 (oldest deadline 2024-09-19T06:27:19.046368+0000) 2024-09-19T06:27:20.972 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:20 smithi002 podman[119460]: 2024-09-19 06:27:20.665242834 +0000 UTC m=+0.820029816 container remove 1f0fd5a2dfb94518e7c6c6d43171aa24851cc8125d389ad5241392471e0c09e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-19T06:27:21.377 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:21 smithi002 podman[119549]: 2024-09-19 06:27:21.074311346 +0000 UTC m=+0.093553736 container create 48b2d68c3ae0cf2c8f7c367c88060eded0fc0e4b9d9f6266ba54ecd8567459df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-19T06:27:21.377 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:21 smithi002 podman[119549]: 2024-09-19 06:27:20.99690953 +0000 UTC m=+0.016151944 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:27:21.377 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:21 smithi002 podman[119549]: 2024-09-19 06:27:21.302146168 +0000 UTC m=+0.321388570 container init 48b2d68c3ae0cf2c8f7c367c88060eded0fc0e4b9d9f6266ba54ecd8567459df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:27:21.377 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:21 smithi002 podman[119549]: 2024-09-19 06:27:21.30575174 +0000 UTC m=+0.324994138 container start 48b2d68c3ae0cf2c8f7c367c88060eded0fc0e4b9d9f6266ba54ecd8567459df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-19T06:27:21.377 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:21 smithi002 podman[119549]: 2024-09-19 06:27:21.376502562 +0000 UTC m=+0.395744952 container attach 48b2d68c3ae0cf2c8f7c367c88060eded0fc0e4b9d9f6266ba54ecd8567459df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4) 2024-09-19T06:27:21.489 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:21 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:21.225+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:27:21.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:21 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:21.225+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:27:21.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:21 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:21.225+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:27:21.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:21 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:21.225+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:38.544834+0000 front 2024-09-19T06:26:38.544764+0000 (oldest deadline 2024-09-19T06:27:02.044779+0000) 2024-09-19T06:27:21.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:21 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:21.225+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:47.345648+0000 front 2024-09-19T06:26:47.345566+0000 (oldest deadline 2024-09-19T06:27:12.045605+0000) 2024-09-19T06:27:21.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:21 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:21.225+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-19T06:26:53.146482+0000 front 2024-09-19T06:26:53.146453+0000 (oldest deadline 2024-09-19T06:27:19.046368+0000) 2024-09-19T06:27:21.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:21 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:21.267+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:27:21.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:21 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:21.267+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:27:21.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:21 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:21.267+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.716143+0000 front 2024-09-19T06:26:21.716261+0000 (oldest deadline 2024-09-19T06:26:45.215937+0000) 2024-09-19T06:27:21.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:21 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:21.267+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:29.118125+0000 front 2024-09-19T06:26:29.118102+0000 (oldest deadline 2024-09-19T06:26:52.617920+0000) 2024-09-19T06:27:21.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:21 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:21.267+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:35.518654+0000 front 2024-09-19T06:26:35.518703+0000 (oldest deadline 2024-09-19T06:27:00.818859+0000) 2024-09-19T06:27:21.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:21 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:21.267+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:43.119825+0000 front 2024-09-19T06:26:43.119733+0000 (oldest deadline 2024-09-19T06:27:09.019695+0000) 2024-09-19T06:27:21.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:21 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:21.267+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-19T06:26:52.520871+0000 front 2024-09-19T06:26:52.520922+0000 (oldest deadline 2024-09-19T06:27:16.620777+0000) 2024-09-19T06:27:21.722 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 19 06:27:21 smithi002 podman[119549]: 2024-09-19 06:27:21.501272901 +0000 UTC m=+0.520515291 container died 48b2d68c3ae0cf2c8f7c367c88060eded0fc0e4b9d9f6266ba54ecd8567459df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, ceph=True) 2024-09-19T06:27:22.292 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@osd.9.service' 2024-09-19T06:27:22.335 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:27:22.336 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-19T06:27:22.336 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-19T06:27:22.336 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-078f6612-764d-11ef-bceb-c7b262605968@osd.10 2024-09-19T06:27:22.491 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:22 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:22.186+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:27:22.491 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:22 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:22.186+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:27:22.491 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:22 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:22.186+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:27:22.491 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:22 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:22.186+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:38.544834+0000 front 2024-09-19T06:26:38.544764+0000 (oldest deadline 2024-09-19T06:27:02.044779+0000) 2024-09-19T06:27:22.492 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:22 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:22.186+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:47.345648+0000 front 2024-09-19T06:26:47.345566+0000 (oldest deadline 2024-09-19T06:27:12.045605+0000) 2024-09-19T06:27:22.492 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:22 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:22.186+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-19T06:26:53.146482+0000 front 2024-09-19T06:26:53.146453+0000 (oldest deadline 2024-09-19T06:27:19.046368+0000) 2024-09-19T06:27:22.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:22 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:22.219+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:27:22.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:22 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:22.219+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:27:22.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:22 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:22.219+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.716143+0000 front 2024-09-19T06:26:21.716261+0000 (oldest deadline 2024-09-19T06:26:45.215937+0000) 2024-09-19T06:27:22.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:22 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:22.219+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:29.118125+0000 front 2024-09-19T06:26:29.118102+0000 (oldest deadline 2024-09-19T06:26:52.617920+0000) 2024-09-19T06:27:22.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:22 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:22.219+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:35.518654+0000 front 2024-09-19T06:26:35.518703+0000 (oldest deadline 2024-09-19T06:27:00.818859+0000) 2024-09-19T06:27:22.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:22 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:22.219+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:43.119825+0000 front 2024-09-19T06:26:43.119733+0000 (oldest deadline 2024-09-19T06:27:09.019695+0000) 2024-09-19T06:27:22.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:22 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:22.219+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-19T06:26:52.520871+0000 front 2024-09-19T06:26:52.520922+0000 (oldest deadline 2024-09-19T06:27:16.620777+0000) 2024-09-19T06:27:22.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:22 smithi089 systemd[1]: Stopping Ceph osd.10 for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:27:23.042 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:22 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:22.630+0000 7f6dcc494640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:27:23.042 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:22 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:22.630+0000 7f6dcc494640 -1 osd.10 95 *** Got signal Terminated *** 2024-09-19T06:27:23.042 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:22 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:22.630+0000 7f6dcc494640 -1 osd.10 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:27:23.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:23 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:23.164+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:27:23.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:23 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:23.164+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:27:23.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:23 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:23.164+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:27:23.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:23 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:23.164+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:38.544834+0000 front 2024-09-19T06:26:38.544764+0000 (oldest deadline 2024-09-19T06:27:02.044779+0000) 2024-09-19T06:27:23.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:23 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:23.164+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:47.345648+0000 front 2024-09-19T06:26:47.345566+0000 (oldest deadline 2024-09-19T06:27:12.045605+0000) 2024-09-19T06:27:23.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:23 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:23.164+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-19T06:26:53.146482+0000 front 2024-09-19T06:26:53.146453+0000 (oldest deadline 2024-09-19T06:27:19.046368+0000) 2024-09-19T06:27:23.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:23 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:23.267+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:27:23.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:23 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:23.267+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:27:23.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:23 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:23.267+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.716143+0000 front 2024-09-19T06:26:21.716261+0000 (oldest deadline 2024-09-19T06:26:45.215937+0000) 2024-09-19T06:27:23.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:23 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:23.267+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:29.118125+0000 front 2024-09-19T06:26:29.118102+0000 (oldest deadline 2024-09-19T06:26:52.617920+0000) 2024-09-19T06:27:23.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:23 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:23.267+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:35.518654+0000 front 2024-09-19T06:26:35.518703+0000 (oldest deadline 2024-09-19T06:27:00.818859+0000) 2024-09-19T06:27:23.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:23 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:23.267+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:43.119825+0000 front 2024-09-19T06:26:43.119733+0000 (oldest deadline 2024-09-19T06:27:09.019695+0000) 2024-09-19T06:27:23.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:23 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:23.267+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-19T06:26:52.520871+0000 front 2024-09-19T06:26:52.520922+0000 (oldest deadline 2024-09-19T06:27:16.620777+0000) 2024-09-19T06:27:24.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:24 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:24.126+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:27:24.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:24 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:24.126+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:27:24.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:24 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:24.126+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:27:24.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:24 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:24.126+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:38.544834+0000 front 2024-09-19T06:26:38.544764+0000 (oldest deadline 2024-09-19T06:27:02.044779+0000) 2024-09-19T06:27:24.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:24 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:24.126+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:47.345648+0000 front 2024-09-19T06:26:47.345566+0000 (oldest deadline 2024-09-19T06:27:12.045605+0000) 2024-09-19T06:27:24.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:24 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:24.126+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-19T06:26:53.146482+0000 front 2024-09-19T06:26:53.146453+0000 (oldest deadline 2024-09-19T06:27:19.046368+0000) 2024-09-19T06:27:24.792 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:24 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:24.293+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:27:24.792 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:24 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:24.293+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:27:24.792 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:24 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:24.293+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.716143+0000 front 2024-09-19T06:26:21.716261+0000 (oldest deadline 2024-09-19T06:26:45.215937+0000) 2024-09-19T06:27:24.792 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:24 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:24.293+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:29.118125+0000 front 2024-09-19T06:26:29.118102+0000 (oldest deadline 2024-09-19T06:26:52.617920+0000) 2024-09-19T06:27:24.792 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:24 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:24.293+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:35.518654+0000 front 2024-09-19T06:26:35.518703+0000 (oldest deadline 2024-09-19T06:27:00.818859+0000) 2024-09-19T06:27:24.792 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:24 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:24.293+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:43.119825+0000 front 2024-09-19T06:26:43.119733+0000 (oldest deadline 2024-09-19T06:27:09.019695+0000) 2024-09-19T06:27:24.792 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:24 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:24.293+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-19T06:26:52.520871+0000 front 2024-09-19T06:26:52.520922+0000 (oldest deadline 2024-09-19T06:27:16.620777+0000) 2024-09-19T06:27:25.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:25 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:25.150+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:27:25.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:25 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:25.150+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:27:25.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:25 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:25.150+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:27:25.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:25 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:25.150+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:38.544834+0000 front 2024-09-19T06:26:38.544764+0000 (oldest deadline 2024-09-19T06:27:02.044779+0000) 2024-09-19T06:27:25.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:25 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:25.150+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:47.345648+0000 front 2024-09-19T06:26:47.345566+0000 (oldest deadline 2024-09-19T06:27:12.045605+0000) 2024-09-19T06:27:25.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:25 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:25.150+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-19T06:26:53.146482+0000 front 2024-09-19T06:26:53.146453+0000 (oldest deadline 2024-09-19T06:27:19.046368+0000) 2024-09-19T06:27:25.792 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:25 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:25.296+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:27:25.792 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:25 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:25.296+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:27:25.792 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:25 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:25.296+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.716143+0000 front 2024-09-19T06:26:21.716261+0000 (oldest deadline 2024-09-19T06:26:45.215937+0000) 2024-09-19T06:27:25.792 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:25 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:25.296+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:29.118125+0000 front 2024-09-19T06:26:29.118102+0000 (oldest deadline 2024-09-19T06:26:52.617920+0000) 2024-09-19T06:27:25.793 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:25 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:25.296+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:35.518654+0000 front 2024-09-19T06:26:35.518703+0000 (oldest deadline 2024-09-19T06:27:00.818859+0000) 2024-09-19T06:27:25.793 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:25 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:25.296+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:43.119825+0000 front 2024-09-19T06:26:43.119733+0000 (oldest deadline 2024-09-19T06:27:09.019695+0000) 2024-09-19T06:27:25.793 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:25 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:25.296+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-19T06:26:52.520871+0000 front 2024-09-19T06:26:52.520922+0000 (oldest deadline 2024-09-19T06:27:16.620777+0000) 2024-09-19T06:27:26.489 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:26 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:26.149+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:27:26.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:26 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:26.149+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:27:26.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:26 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:26.149+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:27:26.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:26 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:26.149+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:38.544834+0000 front 2024-09-19T06:26:38.544764+0000 (oldest deadline 2024-09-19T06:27:02.044779+0000) 2024-09-19T06:27:26.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:26 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:26.149+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:47.345648+0000 front 2024-09-19T06:26:47.345566+0000 (oldest deadline 2024-09-19T06:27:12.045605+0000) 2024-09-19T06:27:26.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:26 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:26.149+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-19T06:26:53.146482+0000 front 2024-09-19T06:26:53.146453+0000 (oldest deadline 2024-09-19T06:27:19.046368+0000) 2024-09-19T06:27:26.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:26 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:26.272+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:27:26.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:26 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:26.272+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:27:26.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:26 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:26.272+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.716143+0000 front 2024-09-19T06:26:21.716261+0000 (oldest deadline 2024-09-19T06:26:45.215937+0000) 2024-09-19T06:27:26.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:26 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:26.272+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:29.118125+0000 front 2024-09-19T06:26:29.118102+0000 (oldest deadline 2024-09-19T06:26:52.617920+0000) 2024-09-19T06:27:26.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:26 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:26.272+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:35.518654+0000 front 2024-09-19T06:26:35.518703+0000 (oldest deadline 2024-09-19T06:27:00.818859+0000) 2024-09-19T06:27:26.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:26 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:26.272+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:43.119825+0000 front 2024-09-19T06:26:43.119733+0000 (oldest deadline 2024-09-19T06:27:09.019695+0000) 2024-09-19T06:27:26.543 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:26 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:26.272+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-19T06:26:52.520871+0000 front 2024-09-19T06:26:52.520922+0000 (oldest deadline 2024-09-19T06:27:16.620777+0000) 2024-09-19T06:27:27.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:27 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:27.128+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:27:27.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:27 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:27.128+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:27:27.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:27 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:27.128+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:27:27.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:27 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:27.128+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:38.544834+0000 front 2024-09-19T06:26:38.544764+0000 (oldest deadline 2024-09-19T06:27:02.044779+0000) 2024-09-19T06:27:27.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:27 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:27.128+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:47.345648+0000 front 2024-09-19T06:26:47.345566+0000 (oldest deadline 2024-09-19T06:27:12.045605+0000) 2024-09-19T06:27:27.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:27 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:27.128+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-19T06:26:53.146482+0000 front 2024-09-19T06:26:53.146453+0000 (oldest deadline 2024-09-19T06:27:19.046368+0000) 2024-09-19T06:27:27.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:27 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:27.128+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6820 osd.7 since back 2024-09-19T06:27:01.947457+0000 front 2024-09-19T06:27:01.947506+0000 (oldest deadline 2024-09-19T06:27:26.647186+0000) 2024-09-19T06:27:27.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:27 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:27.279+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.114196+0000 front 2024-09-19T06:26:07.114140+0000 (oldest deadline 2024-09-19T06:26:29.414140+0000) 2024-09-19T06:27:27.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:27 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:27.279+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:14.715017+0000 front 2024-09-19T06:26:14.715048+0000 (oldest deadline 2024-09-19T06:26:38.215112+0000) 2024-09-19T06:27:27.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:27 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:27.279+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:21.716143+0000 front 2024-09-19T06:26:21.716261+0000 (oldest deadline 2024-09-19T06:26:45.215937+0000) 2024-09-19T06:27:27.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:27 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:27.279+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-19T06:26:29.118125+0000 front 2024-09-19T06:26:29.118102+0000 (oldest deadline 2024-09-19T06:26:52.617920+0000) 2024-09-19T06:27:27.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:27 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:27.279+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:35.518654+0000 front 2024-09-19T06:26:35.518703+0000 (oldest deadline 2024-09-19T06:27:00.818859+0000) 2024-09-19T06:27:27.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:27 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:27.279+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:43.119825+0000 front 2024-09-19T06:26:43.119733+0000 (oldest deadline 2024-09-19T06:27:09.019695+0000) 2024-09-19T06:27:27.542 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:27 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10[58666]: 2024-09-19T06:27:27.279+0000 7f6dc8a99640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-19T06:26:52.520871+0000 front 2024-09-19T06:26:52.520922+0000 (oldest deadline 2024-09-19T06:27:16.620777+0000) 2024-09-19T06:27:28.432 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:28 smithi089 podman[69907]: 2024-09-19 06:27:28.158028422 +0000 UTC m=+5.634236002 container died 88bfe72a4138b97ef1a3ac6ba797b1fcc0dace46a6d973c30171861018b80a5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-19T06:27:28.489 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:28 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:28.164+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:27:28.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:28 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:28.164+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:27:28.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:28 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:28.164+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:27:28.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:28 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:28.164+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:38.544834+0000 front 2024-09-19T06:26:38.544764+0000 (oldest deadline 2024-09-19T06:27:02.044779+0000) 2024-09-19T06:27:28.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:28 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:28.164+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:47.345648+0000 front 2024-09-19T06:26:47.345566+0000 (oldest deadline 2024-09-19T06:27:12.045605+0000) 2024-09-19T06:27:28.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:28 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:28.164+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-19T06:26:53.146482+0000 front 2024-09-19T06:26:53.146453+0000 (oldest deadline 2024-09-19T06:27:19.046368+0000) 2024-09-19T06:27:28.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:28 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:28.164+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6820 osd.7 since back 2024-09-19T06:27:01.947457+0000 front 2024-09-19T06:27:01.947506+0000 (oldest deadline 2024-09-19T06:27:26.647186+0000) 2024-09-19T06:27:28.792 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:28 smithi089 podman[69907]: 2024-09-19 06:27:28.530904644 +0000 UTC m=+6.007112225 container cleanup 88bfe72a4138b97ef1a3ac6ba797b1fcc0dace46a6d973c30171861018b80a5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10, RELEASE=squid-2f599a4, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-19T06:27:28.792 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:28 smithi089 bash[69907]: ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10 2024-09-19T06:27:29.137 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:28 smithi089 podman[69921]: 2024-09-19 06:27:28.815511538 +0000 UTC m=+0.657920319 container remove 88bfe72a4138b97ef1a3ac6ba797b1fcc0dace46a6d973c30171861018b80a5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-19T06:27:29.427 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:29 smithi089 podman[70009]: 2024-09-19 06:27:29.039285286 +0000 UTC m=+0.015676367 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:27:29.427 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:29 smithi089 podman[70009]: 2024-09-19 06:27:29.169916241 +0000 UTC m=+0.146307320 container create e0dd0b6601afda2ece03f5d558c99d1ddadf28f70155264c25e90cac5623cf1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-19T06:27:29.489 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:29 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:29.124+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:27:29.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:29 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:29.124+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:27:29.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:29 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:29.124+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:27:29.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:29 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:29.124+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:38.544834+0000 front 2024-09-19T06:26:38.544764+0000 (oldest deadline 2024-09-19T06:27:02.044779+0000) 2024-09-19T06:27:29.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:29 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:29.124+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:47.345648+0000 front 2024-09-19T06:26:47.345566+0000 (oldest deadline 2024-09-19T06:27:12.045605+0000) 2024-09-19T06:27:29.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:29 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:29.124+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-19T06:26:53.146482+0000 front 2024-09-19T06:26:53.146453+0000 (oldest deadline 2024-09-19T06:27:19.046368+0000) 2024-09-19T06:27:29.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:29 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:29.124+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6820 osd.7 since back 2024-09-19T06:27:01.947457+0000 front 2024-09-19T06:27:01.947506+0000 (oldest deadline 2024-09-19T06:27:26.647186+0000) 2024-09-19T06:27:29.792 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:29 smithi089 podman[70009]: 2024-09-19 06:27:29.426901261 +0000 UTC m=+0.403292349 container init e0dd0b6601afda2ece03f5d558c99d1ddadf28f70155264c25e90cac5623cf1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:27:29.792 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:29 smithi089 podman[70009]: 2024-09-19 06:27:29.430206963 +0000 UTC m=+0.406598043 container start e0dd0b6601afda2ece03f5d558c99d1ddadf28f70155264c25e90cac5623cf1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10-deactivate, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-19T06:27:29.792 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:29 smithi089 podman[70009]: 2024-09-19 06:27:29.518692393 +0000 UTC m=+0.495083492 container attach e0dd0b6601afda2ece03f5d558c99d1ddadf28f70155264c25e90cac5623cf1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=) 2024-09-19T06:27:29.792 INFO:journalctl@ceph.osd.10.smithi089.stdout:Sep 19 06:27:29 smithi089 podman[70009]: 2024-09-19 06:27:29.617158479 +0000 UTC m=+0.593549561 container died e0dd0b6601afda2ece03f5d558c99d1ddadf28f70155264c25e90cac5623cf1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-19T06:27:30.192 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@osd.10.service' 2024-09-19T06:27:30.228 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:27:30.229 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-19T06:27:30.229 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-19T06:27:30.229 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ceph-078f6612-764d-11ef-bceb-c7b262605968@osd.11 2024-09-19T06:27:30.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:30 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:30.134+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:27:30.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:30 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:30.134+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:27:30.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:30 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:30.134+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:27:30.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:30 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:30.134+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:38.544834+0000 front 2024-09-19T06:26:38.544764+0000 (oldest deadline 2024-09-19T06:27:02.044779+0000) 2024-09-19T06:27:30.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:30 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:30.134+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:47.345648+0000 front 2024-09-19T06:26:47.345566+0000 (oldest deadline 2024-09-19T06:27:12.045605+0000) 2024-09-19T06:27:30.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:30 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:30.134+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-19T06:26:53.146482+0000 front 2024-09-19T06:26:53.146453+0000 (oldest deadline 2024-09-19T06:27:19.046368+0000) 2024-09-19T06:27:30.491 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:30 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:30.134+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6820 osd.7 since back 2024-09-19T06:27:01.947457+0000 front 2024-09-19T06:27:01.947506+0000 (oldest deadline 2024-09-19T06:27:26.647186+0000) 2024-09-19T06:27:30.491 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:30 smithi090 systemd[1]: Stopping Ceph osd.11 for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:27:30.989 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:30 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:30.511+0000 7f1ec1cda640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:27:30.990 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:30 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:30.511+0000 7f1ec1cda640 -1 osd.11 95 *** Got signal Terminated *** 2024-09-19T06:27:30.990 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:30 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:30.511+0000 7f1ec1cda640 -1 osd.11 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:27:31.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:31 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:31.145+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:27:31.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:31 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:31.145+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:27:31.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:31 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:31.145+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:27:31.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:31 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:31.145+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:38.544834+0000 front 2024-09-19T06:26:38.544764+0000 (oldest deadline 2024-09-19T06:27:02.044779+0000) 2024-09-19T06:27:31.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:31 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:31.145+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:47.345648+0000 front 2024-09-19T06:26:47.345566+0000 (oldest deadline 2024-09-19T06:27:12.045605+0000) 2024-09-19T06:27:31.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:31 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:31.145+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-19T06:26:53.146482+0000 front 2024-09-19T06:26:53.146453+0000 (oldest deadline 2024-09-19T06:27:19.046368+0000) 2024-09-19T06:27:31.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:31 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:31.145+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6820 osd.7 since back 2024-09-19T06:27:01.947457+0000 front 2024-09-19T06:27:01.947506+0000 (oldest deadline 2024-09-19T06:27:26.647186+0000) 2024-09-19T06:27:32.391 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:32 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:32.129+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:27:32.392 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:32 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:32.129+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:27:32.392 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:32 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:32.129+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:27:32.392 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:32 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:32.129+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:38.544834+0000 front 2024-09-19T06:26:38.544764+0000 (oldest deadline 2024-09-19T06:27:02.044779+0000) 2024-09-19T06:27:32.392 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:32 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:32.129+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:47.345648+0000 front 2024-09-19T06:26:47.345566+0000 (oldest deadline 2024-09-19T06:27:12.045605+0000) 2024-09-19T06:27:32.392 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:32 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:32.129+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-19T06:26:53.146482+0000 front 2024-09-19T06:26:53.146453+0000 (oldest deadline 2024-09-19T06:27:19.046368+0000) 2024-09-19T06:27:32.392 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:32 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:32.129+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6820 osd.7 since back 2024-09-19T06:27:01.947457+0000 front 2024-09-19T06:27:01.947506+0000 (oldest deadline 2024-09-19T06:27:26.647186+0000) 2024-09-19T06:27:33.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:33 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:33.143+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:27:33.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:33 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:33.143+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:27:33.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:33 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:33.143+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:27:33.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:33 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:33.143+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:38.544834+0000 front 2024-09-19T06:26:38.544764+0000 (oldest deadline 2024-09-19T06:27:02.044779+0000) 2024-09-19T06:27:33.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:33 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:33.143+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:47.345648+0000 front 2024-09-19T06:26:47.345566+0000 (oldest deadline 2024-09-19T06:27:12.045605+0000) 2024-09-19T06:27:33.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:33 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:33.143+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-19T06:26:53.146482+0000 front 2024-09-19T06:26:53.146453+0000 (oldest deadline 2024-09-19T06:27:19.046368+0000) 2024-09-19T06:27:33.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:33 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:33.143+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6820 osd.7 since back 2024-09-19T06:27:01.947457+0000 front 2024-09-19T06:27:01.947506+0000 (oldest deadline 2024-09-19T06:27:26.647186+0000) 2024-09-19T06:27:34.492 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:34 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:34.161+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:27:34.492 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:34 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:34.161+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:27:34.493 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:34 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:34.161+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:27:34.493 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:34 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:34.161+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:38.544834+0000 front 2024-09-19T06:26:38.544764+0000 (oldest deadline 2024-09-19T06:27:02.044779+0000) 2024-09-19T06:27:34.493 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:34 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:34.161+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:47.345648+0000 front 2024-09-19T06:26:47.345566+0000 (oldest deadline 2024-09-19T06:27:12.045605+0000) 2024-09-19T06:27:34.493 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:34 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:34.161+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-19T06:26:53.146482+0000 front 2024-09-19T06:26:53.146453+0000 (oldest deadline 2024-09-19T06:27:19.046368+0000) 2024-09-19T06:27:34.493 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:34 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:34.161+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6820 osd.7 since back 2024-09-19T06:27:01.947457+0000 front 2024-09-19T06:27:01.947506+0000 (oldest deadline 2024-09-19T06:27:26.647186+0000) 2024-09-19T06:27:35.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:35 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:35.205+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-19T06:26:07.739852+0000 front 2024-09-19T06:26:07.739771+0000 (oldest deadline 2024-09-19T06:26:31.839755+0000) 2024-09-19T06:27:35.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:35 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:35.205+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6804 osd.1 since back 2024-09-19T06:26:15.940818+0000 front 2024-09-19T06:26:15.940646+0000 (oldest deadline 2024-09-19T06:26:40.640722+0000) 2024-09-19T06:27:35.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:35 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:35.205+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6804 osd.2 since back 2024-09-19T06:26:23.541746+0000 front 2024-09-19T06:26:23.541993+0000 (oldest deadline 2024-09-19T06:26:45.241829+0000) 2024-09-19T06:27:35.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:35 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:35.205+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6812 osd.4 since back 2024-09-19T06:26:38.544834+0000 front 2024-09-19T06:26:38.544764+0000 (oldest deadline 2024-09-19T06:27:02.044779+0000) 2024-09-19T06:27:35.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:35 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:35.205+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6812 osd.5 since back 2024-09-19T06:26:47.345648+0000 front 2024-09-19T06:26:47.345566+0000 (oldest deadline 2024-09-19T06:27:12.045605+0000) 2024-09-19T06:27:35.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:35 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:35.205+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-19T06:26:53.146482+0000 front 2024-09-19T06:26:53.146453+0000 (oldest deadline 2024-09-19T06:27:19.046368+0000) 2024-09-19T06:27:35.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:35 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:35.205+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.89:6820 osd.7 since back 2024-09-19T06:27:01.947457+0000 front 2024-09-19T06:27:01.947506+0000 (oldest deadline 2024-09-19T06:27:26.647186+0000) 2024-09-19T06:27:35.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:35 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11[59704]: 2024-09-19T06:27:35.205+0000 7f1ebe2df640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.90:6820 osd.8 since back 2024-09-19T06:27:11.347925+0000 front 2024-09-19T06:27:11.347961+0000 (oldest deadline 2024-09-19T06:27:34.848041+0000) 2024-09-19T06:27:36.172 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:35 smithi090 podman[71238]: 2024-09-19 06:27:35.856960985 +0000 UTC m=+5.433004595 container died 0b6c0b327cd6d87635227865c058711cc233690bd1d9479054df1a919db62768 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T06:27:36.172 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:36 smithi090 podman[71238]: 2024-09-19 06:27:36.171320644 +0000 UTC m=+5.747364255 container cleanup 0b6c0b327cd6d87635227865c058711cc233690bd1d9479054df1a919db62768 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T06:27:36.489 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:36 smithi090 bash[71238]: ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11 2024-09-19T06:27:36.490 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:36 smithi090 podman[71266]: 2024-09-19 06:27:36.390698397 +0000 UTC m=+0.526007832 container remove 0b6c0b327cd6d87635227865c058711cc233690bd1d9479054df1a919db62768 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-19T06:27:36.990 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:36 smithi090 podman[71353]: 2024-09-19 06:27:36.708282415 +0000 UTC m=+0.111140392 container create d8126cad9a154ba14531462b40d55d7d6e748325efe78ab5549c2532d2158e79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-19T06:27:36.990 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:36 smithi090 podman[71353]: 2024-09-19 06:27:36.613171978 +0000 UTC m=+0.016029955 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:27:36.990 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:36 smithi090 podman[71353]: 2024-09-19 06:27:36.927724948 +0000 UTC m=+0.330582934 container init d8126cad9a154ba14531462b40d55d7d6e748325efe78ab5549c2532d2158e79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2) 2024-09-19T06:27:36.990 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:36 smithi090 podman[71353]: 2024-09-19 06:27:36.930924593 +0000 UTC m=+0.333782570 container start d8126cad9a154ba14531462b40d55d7d6e748325efe78ab5549c2532d2158e79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-19T06:27:37.357 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:37 smithi090 podman[71353]: 2024-09-19 06:27:37.027671544 +0000 UTC m=+0.430529531 container attach d8126cad9a154ba14531462b40d55d7d6e748325efe78ab5549c2532d2158e79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:27:37.357 INFO:journalctl@ceph.osd.11.smithi090.stdout:Sep 19 06:27:37 smithi090 podman[71353]: 2024-09-19 06:27:37.115066938 +0000 UTC m=+0.517924931 container died d8126cad9a154ba14531462b40d55d7d6e748325efe78ab5549c2532d2158e79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-19T06:27:37.670 DEBUG:teuthology.orchestra.run.smithi090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@osd.11.service' 2024-09-19T06:27:37.710 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:27:37.710 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-19T06:27:37.710 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-19T06:27:37.711 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-078f6612-764d-11ef-bceb-c7b262605968@mds.a 2024-09-19T06:27:38.007 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 19 06:27:37 smithi002 systemd[1]: Stopping Ceph mds.a for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:27:38.472 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 19 06:27:38 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-a[71487]: 2024-09-19T06:27:38.005+0000 7f22bb073640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:27:38.472 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 19 06:27:38 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-a[71487]: 2024-09-19T06:27:38.005+0000 7f22bb073640 -1 mds.a *** got signal Terminated *** 2024-09-19T06:27:42.273 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 19 06:27:42 smithi002 podman[119651]: 2024-09-19 06:27:42.020625535 +0000 UTC m=+4.110475356 container died 687570e27fbe3debf3a2c07d6cf1029cdee29e443a838bc9d387a6bd6ebc9342 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-a, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:27:42.640 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 19 06:27:42 smithi002 podman[119651]: 2024-09-19 06:27:42.405315863 +0000 UTC m=+4.495165679 container cleanup 687570e27fbe3debf3a2c07d6cf1029cdee29e443a838bc9d387a6bd6ebc9342 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-a, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:27:42.640 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 19 06:27:42 smithi002 bash[119651]: ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-a 2024-09-19T06:27:42.793 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@mds.a.service' 2024-09-19T06:27:42.828 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:27:42.829 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-19T06:27:42.829 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-19T06:27:42.829 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-078f6612-764d-11ef-bceb-c7b262605968@mds.d 2024-09-19T06:27:43.222 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 19 06:27:42 smithi002 systemd[1]: Stopping Ceph mds.d for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:27:43.223 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 19 06:27:43 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-d[70294]: 2024-09-19T06:27:43.133+0000 7f3f194c3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:27:43.223 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 19 06:27:43 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-d[70294]: 2024-09-19T06:27:43.133+0000 7f3f194c3640 -1 mds.d *** got signal Terminated *** 2024-09-19T06:27:47.472 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 19 06:27:47 smithi002 podman[119772]: 2024-09-19 06:27:47.146345041 +0000 UTC m=+4.097402229 container died fe9f8ad5291e77d3114a5b2d3e63b033081fd77ece2003caf4f1122ce2b1c428 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-d, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-19T06:27:47.972 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 19 06:27:47 smithi002 podman[119772]: 2024-09-19 06:27:47.583653509 +0000 UTC m=+4.534710698 container cleanup fe9f8ad5291e77d3114a5b2d3e63b033081fd77ece2003caf4f1122ce2b1c428 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-d, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD) 2024-09-19T06:27:47.972 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 19 06:27:47 smithi002 bash[119772]: ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-d 2024-09-19T06:27:47.972 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 19 06:27:47 smithi002 podman[119785]: 2024-09-19 06:27:47.759731751 +0000 UTC m=+0.612923878 container remove fe9f8ad5291e77d3114a5b2d3e63b033081fd77ece2003caf4f1122ce2b1c428 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-d, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-19T06:27:48.017 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@mds.d.service' 2024-09-19T06:27:48.050 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:27:48.051 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-19T06:27:48.051 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-19T06:27:48.051 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-078f6612-764d-11ef-bceb-c7b262605968@mds.g 2024-09-19T06:27:48.363 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 19 06:27:48 smithi002 systemd[1]: Stopping Ceph mds.g for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:27:48.722 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 19 06:27:48 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-g[71066]: 2024-09-19T06:27:48.361+0000 7f5183abb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:27:48.722 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 19 06:27:48 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-g[71066]: 2024-09-19T06:27:48.361+0000 7f5183abb640 -1 mds.g *** got signal Terminated *** 2024-09-19T06:27:51.406 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 19 06:27:51 smithi002 podman[119894]: 2024-09-19 06:27:51.153428153 +0000 UTC m=+2.882185550 container died c798fe82c2bf5227d5aa50134219a77c748faa06bd742c74cedfdbf666d9203a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-g, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4) 2024-09-19T06:27:51.722 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 19 06:27:51 smithi002 podman[119894]: 2024-09-19 06:27:51.470358464 +0000 UTC m=+3.199115854 container cleanup c798fe82c2bf5227d5aa50134219a77c748faa06bd742c74cedfdbf666d9203a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-g, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-19T06:27:51.722 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 19 06:27:51 smithi002 bash[119894]: ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-g 2024-09-19T06:27:52.054 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 19 06:27:51 smithi002 podman[119906]: 2024-09-19 06:27:51.796482061 +0000 UTC m=+0.638286355 container remove c798fe82c2bf5227d5aa50134219a77c748faa06bd742c74cedfdbf666d9203a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-19T06:27:52.058 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@mds.g.service' 2024-09-19T06:27:52.091 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:27:52.092 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-19T06:27:52.092 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-19T06:27:52.092 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-078f6612-764d-11ef-bceb-c7b262605968@mds.j 2024-09-19T06:27:52.408 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 19 06:27:52 smithi002 systemd[1]: Stopping Ceph mds.j for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:27:52.722 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 19 06:27:52 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-j[69876]: 2024-09-19T06:27:52.407+0000 7f559e90f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:27:52.722 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 19 06:27:52 smithi002 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-j[69876]: 2024-09-19T06:27:52.407+0000 7f559e90f640 -1 mds.j *** got signal Terminated *** 2024-09-19T06:27:56.684 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 19 06:27:56 smithi002 podman[120013]: 2024-09-19 06:27:56.417912061 +0000 UTC m=+4.107545616 container died 2ba4e9513e7a0bc6a32e9a78a4026a3d3f050cdb1a581071fa7ab3cb736a4025 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-j, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4) 2024-09-19T06:27:56.684 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 19 06:27:56 smithi002 podman[120013]: 2024-09-19 06:27:56.664960183 +0000 UTC m=+4.354593735 container cleanup 2ba4e9513e7a0bc6a32e9a78a4026a3d3f050cdb1a581071fa7ab3cb736a4025 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-j, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True) 2024-09-19T06:27:56.684 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 19 06:27:56 smithi002 bash[120013]: ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-j 2024-09-19T06:27:57.059 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@mds.j.service' 2024-09-19T06:27:57.092 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:27:57.092 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-19T06:27:57.092 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-19T06:27:57.093 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-078f6612-764d-11ef-bceb-c7b262605968@mds.b 2024-09-19T06:27:57.407 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 19 06:27:57 smithi089 systemd[1]: Stopping Ceph mds.b for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:27:57.792 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 19 06:27:57 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-b[63859]: 2024-09-19T06:27:57.405+0000 7fa35ebb0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:27:57.792 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 19 06:27:57 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-b[63859]: 2024-09-19T06:27:57.405+0000 7fa35ebb0640 -1 mds.b *** got signal Terminated *** 2024-09-19T06:28:01.090 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 19 06:28:00 smithi089 podman[70123]: 2024-09-19 06:28:00.819289984 +0000 UTC m=+3.527283586 container died f173cf3a545657e02798a2ccbc71ed5fd036e771909c8a1296195838639c32cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-b, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4) 2024-09-19T06:28:01.465 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 19 06:28:01 smithi089 podman[70123]: 2024-09-19 06:28:01.204853537 +0000 UTC m=+3.912847135 container cleanup f173cf3a545657e02798a2ccbc71ed5fd036e771909c8a1296195838639c32cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-b, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4) 2024-09-19T06:28:01.465 INFO:journalctl@ceph.mds.b.smithi089.stdout:Sep 19 06:28:01 smithi089 bash[70123]: ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-b 2024-09-19T06:28:01.591 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@mds.b.service' 2024-09-19T06:28:01.625 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:28:01.626 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-19T06:28:01.626 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-19T06:28:01.626 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-078f6612-764d-11ef-bceb-c7b262605968@mds.e 2024-09-19T06:28:01.792 INFO:journalctl@ceph.mds.e.smithi089.stdout:Sep 19 06:28:01 smithi089 systemd[1]: Stopping Ceph mds.e for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:28:02.292 INFO:journalctl@ceph.mds.e.smithi089.stdout:Sep 19 06:28:01 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-e[63257]: 2024-09-19T06:28:01.933+0000 7efef1bee640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:28:02.292 INFO:journalctl@ceph.mds.e.smithi089.stdout:Sep 19 06:28:01 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-e[63257]: 2024-09-19T06:28:01.933+0000 7efef1bee640 -1 mds.e *** got signal Terminated *** 2024-09-19T06:28:05.094 INFO:journalctl@ceph.mds.e.smithi089.stdout:Sep 19 06:28:04 smithi089 podman[70247]: 2024-09-19 06:28:04.820313192 +0000 UTC m=+2.970511706 container died 886a88d8b8ad245715ae2575c233baff337dc38a5c7d811de830350488f58472 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-e, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-19T06:28:05.460 INFO:journalctl@ceph.mds.e.smithi089.stdout:Sep 19 06:28:05 smithi089 podman[70247]: 2024-09-19 06:28:05.174962175 +0000 UTC m=+3.325160687 container cleanup 886a88d8b8ad245715ae2575c233baff337dc38a5c7d811de830350488f58472 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:28:05.460 INFO:journalctl@ceph.mds.e.smithi089.stdout:Sep 19 06:28:05 smithi089 bash[70247]: ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-e 2024-09-19T06:28:05.590 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@mds.e.service' 2024-09-19T06:28:05.622 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:28:05.623 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-19T06:28:05.623 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-19T06:28:05.623 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-078f6612-764d-11ef-bceb-c7b262605968@mds.h 2024-09-19T06:28:05.792 INFO:journalctl@ceph.mds.h.smithi089.stdout:Sep 19 06:28:05 smithi089 systemd[1]: Stopping Ceph mds.h for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:28:06.292 INFO:journalctl@ceph.mds.h.smithi089.stdout:Sep 19 06:28:05 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-h[63558]: 2024-09-19T06:28:05.935+0000 7f2a7267f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:28:06.292 INFO:journalctl@ceph.mds.h.smithi089.stdout:Sep 19 06:28:05 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-h[63558]: 2024-09-19T06:28:05.935+0000 7f2a7267f640 -1 mds.h *** got signal Terminated *** 2024-09-19T06:28:09.096 INFO:journalctl@ceph.mds.h.smithi089.stdout:Sep 19 06:28:08 smithi089 podman[70369]: 2024-09-19 06:28:08.822713946 +0000 UTC m=+2.985844982 container died e38fe5bd3cc8c263e3ed3c7aaf3427d025119be0b1bb6d54e5c217006225a028 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-h, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-19T06:28:09.447 INFO:journalctl@ceph.mds.h.smithi089.stdout:Sep 19 06:28:09 smithi089 podman[70369]: 2024-09-19 06:28:09.178538736 +0000 UTC m=+3.341669804 container cleanup e38fe5bd3cc8c263e3ed3c7aaf3427d025119be0b1bb6d54e5c217006225a028 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-h, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:28:09.447 INFO:journalctl@ceph.mds.h.smithi089.stdout:Sep 19 06:28:09 smithi089 bash[70369]: ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-h 2024-09-19T06:28:09.579 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@mds.h.service' 2024-09-19T06:28:09.611 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:28:09.611 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-19T06:28:09.611 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-19T06:28:09.611 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-078f6612-764d-11ef-bceb-c7b262605968@mds.k 2024-09-19T06:28:09.792 INFO:journalctl@ceph.mds.k.smithi089.stdout:Sep 19 06:28:09 smithi089 systemd[1]: Stopping Ceph mds.k for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:28:10.292 INFO:journalctl@ceph.mds.k.smithi089.stdout:Sep 19 06:28:09 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-k[62952]: 2024-09-19T06:28:09.940+0000 7fd151df9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:28:10.292 INFO:journalctl@ceph.mds.k.smithi089.stdout:Sep 19 06:28:09 smithi089 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-k[62952]: 2024-09-19T06:28:09.940+0000 7fd151df9640 -1 mds.k *** got signal Terminated *** 2024-09-19T06:28:13.942 INFO:journalctl@ceph.mds.k.smithi089.stdout:Sep 19 06:28:13 smithi089 podman[70491]: 2024-09-19 06:28:13.630242838 +0000 UTC m=+3.799201742 container died 78935390e7860dd9fdec25ad3d534cbb00e9cfa8631db3a3478d29e95fc6d6d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-k, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:28:14.292 INFO:journalctl@ceph.mds.k.smithi089.stdout:Sep 19 06:28:14 smithi089 podman[70491]: 2024-09-19 06:28:14.015327516 +0000 UTC m=+4.184286414 container cleanup 78935390e7860dd9fdec25ad3d534cbb00e9cfa8631db3a3478d29e95fc6d6d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-19T06:28:14.292 INFO:journalctl@ceph.mds.k.smithi089.stdout:Sep 19 06:28:14 smithi089 bash[70491]: ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-k 2024-09-19T06:28:14.477 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@mds.k.service' 2024-09-19T06:28:14.508 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:28:14.509 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-19T06:28:14.509 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-19T06:28:14.509 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ceph-078f6612-764d-11ef-bceb-c7b262605968@mds.c 2024-09-19T06:28:14.804 INFO:journalctl@ceph.mds.c.smithi090.stdout:Sep 19 06:28:14 smithi090 systemd[1]: Stopping Ceph mds.c for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:28:15.239 INFO:journalctl@ceph.mds.c.smithi090.stdout:Sep 19 06:28:14 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-c[64672]: 2024-09-19T06:28:14.802+0000 7f9bb0ac8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:28:15.239 INFO:journalctl@ceph.mds.c.smithi090.stdout:Sep 19 06:28:14 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-c[64672]: 2024-09-19T06:28:14.802+0000 7f9bb0ac8640 -1 mds.c *** got signal Terminated *** 2024-09-19T06:28:17.080 INFO:journalctl@ceph.mds.c.smithi090.stdout:Sep 19 06:28:16 smithi090 podman[71458]: 2024-09-19 06:28:16.812075298 +0000 UTC m=+2.115646539 container died e0f74ff4e3feb06550129c1ce97170aff6ab7badb96cf7678789979dca140000 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-c, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:28:17.439 INFO:journalctl@ceph.mds.c.smithi090.stdout:Sep 19 06:28:17 smithi090 podman[71458]: 2024-09-19 06:28:17.17852776 +0000 UTC m=+2.482098998 container cleanup e0f74ff4e3feb06550129c1ce97170aff6ab7badb96cf7678789979dca140000 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-c, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:28:17.440 INFO:journalctl@ceph.mds.c.smithi090.stdout:Sep 19 06:28:17 smithi090 bash[71458]: ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-c 2024-09-19T06:28:17.600 DEBUG:teuthology.orchestra.run.smithi090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@mds.c.service' 2024-09-19T06:28:17.636 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:28:17.636 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-19T06:28:17.636 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-19T06:28:17.636 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ceph-078f6612-764d-11ef-bceb-c7b262605968@mds.f 2024-09-19T06:28:17.951 INFO:journalctl@ceph.mds.f.smithi090.stdout:Sep 19 06:28:17 smithi090 systemd[1]: Stopping Ceph mds.f for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:28:18.240 INFO:journalctl@ceph.mds.f.smithi090.stdout:Sep 19 06:28:17 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-f[64370]: 2024-09-19T06:28:17.949+0000 7fcb68fc9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:28:18.240 INFO:journalctl@ceph.mds.f.smithi090.stdout:Sep 19 06:28:17 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-f[64370]: 2024-09-19T06:28:17.949+0000 7fcb68fc9640 -1 mds.f *** got signal Terminated *** 2024-09-19T06:28:21.111 INFO:journalctl@ceph.mds.f.smithi090.stdout:Sep 19 06:28:20 smithi090 podman[71588]: 2024-09-19 06:28:20.816893803 +0000 UTC m=+2.964739595 container died ec0f0937d3fc452b5ed62d5d90339c4d8440981686636d7987847849b034a30f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-f, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-19T06:28:21.461 INFO:journalctl@ceph.mds.f.smithi090.stdout:Sep 19 06:28:21 smithi090 podman[71588]: 2024-09-19 06:28:21.192808408 +0000 UTC m=+3.340654199 container cleanup ec0f0937d3fc452b5ed62d5d90339c4d8440981686636d7987847849b034a30f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-f, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-19T06:28:21.461 INFO:journalctl@ceph.mds.f.smithi090.stdout:Sep 19 06:28:21 smithi090 bash[71588]: ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-f 2024-09-19T06:28:21.634 DEBUG:teuthology.orchestra.run.smithi090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@mds.f.service' 2024-09-19T06:28:21.668 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:28:21.668 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-19T06:28:21.668 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-19T06:28:21.668 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ceph-078f6612-764d-11ef-bceb-c7b262605968@mds.i 2024-09-19T06:28:21.989 INFO:journalctl@ceph.mds.i.smithi090.stdout:Sep 19 06:28:21 smithi090 systemd[1]: Stopping Ceph mds.i for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:28:22.489 INFO:journalctl@ceph.mds.i.smithi090.stdout:Sep 19 06:28:21 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-i[64973]: 2024-09-19T06:28:21.987+0000 7f68f39b7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:28:22.490 INFO:journalctl@ceph.mds.i.smithi090.stdout:Sep 19 06:28:21 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-i[64973]: 2024-09-19T06:28:21.987+0000 7f68f39b7640 -1 mds.i *** got signal Terminated *** 2024-09-19T06:28:25.123 INFO:journalctl@ceph.mds.i.smithi090.stdout:Sep 19 06:28:24 smithi090 podman[71708]: 2024-09-19 06:28:24.81046644 +0000 UTC m=+2.920619667 container died 1f2d0c1584a5878e490cbb1763825e0fb82311a7924140a423832788239ad1d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-i, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4) 2024-09-19T06:28:25.433 INFO:journalctl@ceph.mds.i.smithi090.stdout:Sep 19 06:28:25 smithi090 podman[71708]: 2024-09-19 06:28:25.222360533 +0000 UTC m=+3.332513761 container cleanup 1f2d0c1584a5878e490cbb1763825e0fb82311a7924140a423832788239ad1d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-i, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, io.buildah.version=1.37.2) 2024-09-19T06:28:25.433 INFO:journalctl@ceph.mds.i.smithi090.stdout:Sep 19 06:28:25 smithi090 bash[71708]: ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-i 2024-09-19T06:28:25.574 DEBUG:teuthology.orchestra.run.smithi090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@mds.i.service' 2024-09-19T06:28:25.607 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:28:25.608 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-19T06:28:25.608 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-19T06:28:25.608 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ceph-078f6612-764d-11ef-bceb-c7b262605968@mds.l 2024-09-19T06:28:25.989 INFO:journalctl@ceph.mds.l.smithi090.stdout:Sep 19 06:28:25 smithi090 systemd[1]: Stopping Ceph mds.l for 078f6612-764d-11ef-bceb-c7b262605968... 2024-09-19T06:28:25.990 INFO:journalctl@ceph.mds.l.smithi090.stdout:Sep 19 06:28:25 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-l[64067]: 2024-09-19T06:28:25.919+0000 7f7fc3c39640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:28:25.990 INFO:journalctl@ceph.mds.l.smithi090.stdout:Sep 19 06:28:25 smithi090 ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-l[64067]: 2024-09-19T06:28:25.919+0000 7f7fc3c39640 -1 mds.l *** got signal Terminated *** 2024-09-19T06:28:27.205 INFO:journalctl@ceph.mds.l.smithi090.stdout:Sep 19 06:28:26 smithi090 podman[71828]: 2024-09-19 06:28:26.992323618 +0000 UTC m=+1.164013843 container died 776c0eda70fd4009d0359f0a0881a2baeea881c8a9193f71cb6df2bbbae4a64c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-l, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-19T06:28:27.489 INFO:journalctl@ceph.mds.l.smithi090.stdout:Sep 19 06:28:27 smithi090 podman[71828]: 2024-09-19 06:28:27.29549125 +0000 UTC m=+1.467181472 container cleanup 776c0eda70fd4009d0359f0a0881a2baeea881c8a9193f71cb6df2bbbae4a64c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-l, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-19T06:28:27.490 INFO:journalctl@ceph.mds.l.smithi090.stdout:Sep 19 06:28:27 smithi090 bash[71828]: ceph-078f6612-764d-11ef-bceb-c7b262605968-mds-l 2024-09-19T06:28:27.717 DEBUG:teuthology.orchestra.run.smithi090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-078f6612-764d-11ef-bceb-c7b262605968@mds.l.service' 2024-09-19T06:28:27.750 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:28:27.750 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-19T06:28:27.750 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 078f6612-764d-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T06:28:27.965 INFO:teuthology.orchestra.run.smithi002.stdout:Deleting cluster with fsid: 078f6612-764d-11ef-bceb-c7b262605968 2024-09-19T06:28:30.511 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 078f6612-764d-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T06:28:30.712 INFO:teuthology.orchestra.run.smithi089.stdout:Deleting cluster with fsid: 078f6612-764d-11ef-bceb-c7b262605968 2024-09-19T06:28:33.062 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 078f6612-764d-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T06:28:33.262 INFO:teuthology.orchestra.run.smithi090.stdout:Deleting cluster with fsid: 078f6612-764d-11ef-bceb-c7b262605968 2024-09-19T06:28:35.656 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:28:35.690 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:28:35.723 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:28:35.751 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-19T06:28:35.753 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911712/remote/smithi002/crash 2024-09-19T06:28:35.754 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/crash -- . 2024-09-19T06:28:35.795 INFO:teuthology.orchestra.run.smithi002.stderr:tar: /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T06:28:35.795 INFO:teuthology.orchestra.run.smithi002.stderr:tar: Error is not recoverable: exiting now 2024-09-19T06:28:35.797 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911712/remote/smithi089/crash 2024-09-19T06:28:35.798 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/crash -- . 2024-09-19T06:28:35.842 INFO:teuthology.orchestra.run.smithi089.stderr:tar: /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T06:28:35.843 INFO:teuthology.orchestra.run.smithi089.stderr:tar: Error is not recoverable: exiting now 2024-09-19T06:28:35.844 DEBUG:teuthology.misc:Transferring archived files from smithi090:/var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911712/remote/smithi090/crash 2024-09-19T06:28:35.845 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar c -f - -C /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/crash -- . 2024-09-19T06:28:35.885 INFO:teuthology.orchestra.run.smithi090.stderr:tar: /var/lib/ceph/078f6612-764d-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T06:28:35.885 INFO:teuthology.orchestra.run.smithi090.stderr:tar: Error is not recoverable: exiting now 2024-09-19T06:28:35.886 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-19T06:28:35.887 DEBUG:teuthology.orchestra.run.smithi002:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-19T06:28:35.926 INFO:tasks.cephadm:Compressing logs... 2024-09-19T06:28:35.926 DEBUG:teuthology.orchestra.run.smithi002:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T06:28:35.969 DEBUG:teuthology.orchestra.run.smithi089:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T06:28:35.971 DEBUG:teuthology.orchestra.run.smithi090:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T06:28:35.994 INFO:teuthology.orchestra.run.smithi002.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-19T06:28:35.995 INFO:teuthology.orchestra.run.smithi002.stderr:: No such file or directory 2024-09-19T06:28:35.995 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-osd.9.log 2024-09-19T06:28:36.011 INFO:teuthology.orchestra.run.smithi090.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T06:28:36.011 INFO:teuthology.orchestra.run.smithi090.stderr:: No such file or directory 2024-09-19T06:28:36.011 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T06:28:36.011 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mds.i.log 2024-09-19T06:28:36.011 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mon.c.log 2024-09-19T06:28:36.011 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T06:28:36.011 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-osd.11.log 2024-09-19T06:28:36.011 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mon.c.log: /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-19T06:28:36.011 INFO:teuthology.orchestra.run.smithi090.stderr: 81.3% -- replaced with /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T06:28:36.012 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-19T06:28:36.012 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5/var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-osd.2.log: --verbose -- /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph.log 2024-09-19T06:28:36.012 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mds.l.log 2024-09-19T06:28:36.012 INFO:teuthology.orchestra.run.smithi090.stderr: 90.4% -- replaced with /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T06:28:36.012 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-osd.8.log 2024-09-19T06:28:36.012 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mds.l.log: 87.7% -- replaced with /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T06:28:36.012 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mgr.z.log 2024-09-19T06:28:36.012 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-osd.8.log: 94.5% -- replaced with /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mds.l.log.gz 2024-09-19T06:28:36.012 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mds.c.log 2024-09-19T06:28:36.012 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mgr.z.log: 90.8% -- replaced with /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T06:28:36.015 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T06:28:36.016 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-osd.0.log: /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T06:28:36.016 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mds.a.log 2024-09-19T06:28:36.016 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T06:28:36.016 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph.audit.log: /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mon.a.log 2024-09-19T06:28:36.016 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mds.g.log 2024-09-19T06:28:36.016 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mon.a.log: 84.2% -- replaced with /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph.cephadm.log.gzgzip -5 --verbose -- /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-osd.6.log 2024-09-19T06:28:36.016 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-19T06:28:36.016 INFO:teuthology.orchestra.run.smithi002.stderr:gzip/var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mds.g.log: -5 --verbose -- /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph.log 2024-09-19T06:28:36.016 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-osd.6.log: 90.2% -- replaced with /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T06:28:36.016 INFO:teuthology.orchestra.run.smithi002.stderr: 94.6% -- replaced with /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mds.a.log.gz 2024-09-19T06:28:36.016 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mds.d.log 2024-09-19T06:28:36.016 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mgr.x.log 2024-09-19T06:28:36.017 INFO:teuthology.orchestra.run.smithi002.stderr: 94.5% -- replaced with /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mds.g.log.gz 2024-09-19T06:28:36.017 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mds.j.log 2024-09-19T06:28:36.017 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mgr.x.log: 87.6% -- replaced with /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T06:28:36.017 INFO:teuthology.orchestra.run.smithi002.stderr: 94.5% -- replaced with /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mds.d.log.gz 2024-09-19T06:28:36.017 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-19T06:28:36.017 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-19T06:28:36.017 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-osd.3.log: /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mds.j.log: 90.9% -- replaced with /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T06:28:36.017 INFO:teuthology.orchestra.run.smithi002.stderr: 94.6% -- replaced with /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mds.j.log.gz 2024-09-19T06:28:36.017 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T06:28:36.019 INFO:teuthology.orchestra.run.smithi089.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-osd.10.log 2024-09-19T06:28:36.019 INFO:teuthology.orchestra.run.smithi089.stderr:: No such file or directory 2024-09-19T06:28:36.019 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-19T06:28:36.020 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-osd.7.log 2024-09-19T06:28:36.020 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-osd.10.log: /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T06:28:36.020 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mds.b.log 2024-09-19T06:28:36.020 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mds.k.log 2024-09-19T06:28:36.020 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-19T06:28:36.020 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T06:28:36.020 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T06:28:36.020 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph.audit.log: 90.4% -- replaced with /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T06:28:36.020 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mgr.y.log 2024-09-19T06:28:36.020 INFO:teuthology.orchestra.run.smithi089.stderr: 94.4% -- replaced with /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mds.k.log.gz 2024-09-19T06:28:36.020 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph.cephadm.log: 81.4% -- replaced with /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T06:28:36.020 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph.log 2024-09-19T06:28:36.021 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mds.h.log 2024-09-19T06:28:36.021 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph.log: 87.7% -- replaced with /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T06:28:36.021 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mon.b.log 2024-09-19T06:28:36.021 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mds.h.log: 91.0% -- replaced with /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T06:28:36.021 INFO:teuthology.orchestra.run.smithi089.stderr: 91.8% -- replaced with /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mgr.y.log.gz 2024-09-19T06:28:36.021 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mds.e.log 2024-09-19T06:28:36.021 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T06:28:36.022 INFO:teuthology.orchestra.run.smithi090.stderr: 91.9% -- replaced with /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mgr.z.log.gz 2024-09-19T06:28:36.022 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mds.f.log 2024-09-19T06:28:36.022 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T06:28:36.028 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.log: /var/log/ceph/cephadm.log: 94.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T06:28:36.029 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T06:28:36.039 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T06:28:36.068 INFO:teuthology.orchestra.run.smithi090.stderr: 92.5% -- replaced with /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mds.i.log.gz 2024-09-19T06:28:36.079 INFO:teuthology.orchestra.run.smithi090.stderr: 94.4% -- replaced with /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mds.f.log.gz 2024-09-19T06:28:36.080 INFO:teuthology.orchestra.run.smithi089.stderr: 94.5% -- replaced with /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mds.e.log.gz 2024-09-19T06:28:36.082 INFO:teuthology.orchestra.run.smithi089.stderr: 92.5% -- replaced with /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mds.h.log.gz 2024-09-19T06:28:36.097 INFO:teuthology.orchestra.run.smithi090.stderr: 93.7% -- replaced with /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mds.c.log.gz 2024-09-19T06:28:36.324 INFO:teuthology.orchestra.run.smithi089.stderr: 92.6% -- replaced with /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mds.b.log.gz 2024-09-19T06:28:36.324 INFO:teuthology.orchestra.run.smithi090.stderr: 91.7% -- replaced with /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mon.c.log.gz 2024-09-19T06:28:36.383 INFO:teuthology.orchestra.run.smithi002.stderr: 90.2% -- replaced with /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mgr.x.log.gz 2024-09-19T06:28:36.480 INFO:teuthology.orchestra.run.smithi089.stderr: 91.7% -- replaced with /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mon.b.log.gz 2024-09-19T06:28:36.706 INFO:teuthology.orchestra.run.smithi090.stderr: 93.3% -- replaced with /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-osd.11.log.gz 2024-09-19T06:28:36.759 INFO:teuthology.orchestra.run.smithi090.stderr: 93.0% -- replaced with /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-19T06:28:36.792 INFO:teuthology.orchestra.run.smithi089.stderr: 92.9% -- replaced with /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-19T06:28:36.801 INFO:teuthology.orchestra.run.smithi090.stderr: 93.0% -- replaced with /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-osd.8.log.gz 2024-09-19T06:28:36.840 INFO:teuthology.orchestra.run.smithi002.stderr: 93.0% -- replaced with /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-osd.6.log.gz 2024-09-19T06:28:36.905 INFO:teuthology.orchestra.run.smithi002.stderr: 93.0% -- replaced with /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-osd.9.log.gz 2024-09-19T06:28:36.913 INFO:teuthology.orchestra.run.smithi089.stderr: 93.2% -- replaced with /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-osd.7.log.gz 2024-09-19T06:28:36.975 INFO:teuthology.orchestra.run.smithi089.stderr: 93.0% -- replaced with /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-osd.10.log.gz 2024-09-19T06:28:36.999 INFO:teuthology.orchestra.run.smithi089.stderr: 93.1% -- replaced with /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-19T06:28:37.001 INFO:teuthology.orchestra.run.smithi089.stderr: 2024-09-19T06:28:37.001 INFO:teuthology.orchestra.run.smithi089.stderr:real 0m1.016s 2024-09-19T06:28:37.001 INFO:teuthology.orchestra.run.smithi089.stderr:user 0m4.474s 2024-09-19T06:28:37.001 INFO:teuthology.orchestra.run.smithi089.stderr:sys 0m0.201s 2024-09-19T06:28:37.060 INFO:teuthology.orchestra.run.smithi090.stderr: 93.0% -- replaced with /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-19T06:28:37.062 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-09-19T06:28:37.062 INFO:teuthology.orchestra.run.smithi090.stderr:real 0m1.076s 2024-09-19T06:28:37.062 INFO:teuthology.orchestra.run.smithi090.stderr:user 0m3.778s 2024-09-19T06:28:37.062 INFO:teuthology.orchestra.run.smithi090.stderr:sys 0m0.155s 2024-09-19T06:28:37.121 INFO:teuthology.orchestra.run.smithi002.stderr: 93.2% -- replaced with /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-19T06:28:37.164 INFO:teuthology.orchestra.run.smithi002.stderr: 90.4% -- replaced with /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-mon.a.log.gz 2024-09-19T06:28:37.208 INFO:teuthology.orchestra.run.smithi002.stderr: 93.1% -- replaced with /var/log/ceph/078f6612-764d-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-19T06:28:44.391 INFO:teuthology.orchestra.run.smithi002.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-19T06:28:44.392 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-19T06:28:44.392 INFO:teuthology.orchestra.run.smithi002.stderr:real 0m8.409s 2024-09-19T06:28:44.392 INFO:teuthology.orchestra.run.smithi002.stderr:user 0m13.600s 2024-09-19T06:28:44.393 INFO:teuthology.orchestra.run.smithi002.stderr:sys 0m0.462s 2024-09-19T06:28:44.393 INFO:tasks.cephadm:Archiving logs... 2024-09-19T06:28:44.393 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911712/remote/smithi002/log 2024-09-19T06:28:44.394 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T06:28:45.886 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911712/remote/smithi089/log 2024-09-19T06:28:45.887 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T06:28:46.588 DEBUG:teuthology.misc:Transferring archived files from smithi090:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911712/remote/smithi090/log 2024-09-19T06:28:46.589 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T06:28:47.155 INFO:tasks.cephadm:Removing cluster... 2024-09-19T06:28:47.155 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 078f6612-764d-11ef-bceb-c7b262605968 --force 2024-09-19T06:28:47.366 INFO:teuthology.orchestra.run.smithi002.stdout:Deleting cluster with fsid: 078f6612-764d-11ef-bceb-c7b262605968 2024-09-19T06:28:47.633 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 078f6612-764d-11ef-bceb-c7b262605968 --force 2024-09-19T06:28:47.832 INFO:teuthology.orchestra.run.smithi089.stdout:Deleting cluster with fsid: 078f6612-764d-11ef-bceb-c7b262605968 2024-09-19T06:28:48.093 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 078f6612-764d-11ef-bceb-c7b262605968 --force 2024-09-19T06:28:48.285 INFO:teuthology.orchestra.run.smithi090.stdout:Deleting cluster with fsid: 078f6612-764d-11ef-bceb-c7b262605968 2024-09-19T06:28:48.546 INFO:tasks.cephadm:Removing cephadm ... 2024-09-19T06:28:48.546 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T06:28:48.567 DEBUG:teuthology.orchestra.run.smithi089:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T06:28:48.584 DEBUG:teuthology.orchestra.run.smithi090:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T06:28:48.600 INFO:tasks.cephadm:Teardown complete 2024-09-19T06:28:48.601 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-19T06:28:48.620 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-19T06:28:48.620 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T06:28:48.623 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T06:28:48.626 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T06:28:48.739 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-19T06:28:48.753 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-19T06:28:48.753 DEBUG:teuthology.orchestra.run.smithi002:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T06:28:48.756 DEBUG:teuthology.orchestra.run.smithi089:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T06:28:48.758 DEBUG:teuthology.orchestra.run.smithi090:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T06:28:48.772 INFO:teuthology.orchestra.run.smithi089.stderr:bash: line 1: ntpq: command not found 2024-09-19T06:28:48.772 INFO:teuthology.orchestra.run.smithi002.stderr:bash: line 1: ntpq: command not found 2024-09-19T06:28:48.773 INFO:teuthology.orchestra.run.smithi090.stderr:bash: line 1: ntpq: command not found 2024-09-19T06:28:48.776 INFO:teuthology.orchestra.run.smithi089.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T06:28:48.777 INFO:teuthology.orchestra.run.smithi089.stdout:=============================================================================== 2024-09-19T06:28:48.777 INFO:teuthology.orchestra.run.smithi089.stdout:^* hv01.front.sepia.ceph.com 3 6 377 9 -14us[-6278ns] +/- 46ms 2024-09-19T06:28:48.777 INFO:teuthology.orchestra.run.smithi089.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 10 +253us[ +261us] +/- 77ms 2024-09-19T06:28:48.777 INFO:teuthology.orchestra.run.smithi089.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 11 -200us[ -193us] +/- 70ms 2024-09-19T06:28:48.777 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:28:48.779 INFO:teuthology.orchestra.run.smithi090.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T06:28:48.780 INFO:teuthology.orchestra.run.smithi090.stdout:=============================================================================== 2024-09-19T06:28:48.780 INFO:teuthology.orchestra.run.smithi090.stdout:^* hv01.front.sepia.ceph.com 3 6 377 12 +3118ns[+3283ns] +/- 46ms 2024-09-19T06:28:48.780 INFO:teuthology.orchestra.run.smithi090.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 8 +241us[ +241us] +/- 77ms 2024-09-19T06:28:48.780 INFO:teuthology.orchestra.run.smithi090.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 12 -205us[ -205us] +/- 70ms 2024-09-19T06:28:48.780 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:28:48.780 INFO:teuthology.orchestra.run.smithi002.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T06:28:48.781 INFO:teuthology.orchestra.run.smithi002.stdout:=============================================================================== 2024-09-19T06:28:48.781 INFO:teuthology.orchestra.run.smithi002.stdout:^* hv01.front.sepia.ceph.com 3 6 377 13 +34us[ +44us] +/- 46ms 2024-09-19T06:28:48.781 INFO:teuthology.orchestra.run.smithi002.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 12 +282us[ +282us] +/- 77ms 2024-09-19T06:28:48.781 INFO:teuthology.orchestra.run.smithi002.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 11 -164us[ -164us] +/- 70ms 2024-09-19T06:28:48.781 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:28:48.782 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-19T06:28:48.799 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-19T06:28:48.800 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-19T06:28:48.821 DEBUG:teuthology.orchestra.run.smithi002:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T06:28:48.915 DEBUG:teuthology.orchestra.run.smithi089:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T06:28:48.984 DEBUG:teuthology.orchestra.run.smithi090:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T06:28:49.052 DEBUG:teuthology.orchestra.run.smithi002:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T06:28:49.084 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:28:49.085 DEBUG:teuthology.orchestra.run.smithi089:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T06:28:49.113 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:28:49.114 DEBUG:teuthology.orchestra.run.smithi090:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T06:28:49.141 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:28:49.141 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-19T06:28:49.153 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-19T06:28:49.166 INFO:teuthology.task.internal:Duration was 1798.910626 seconds 2024-09-19T06:28:49.166 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-19T06:28:49.179 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-19T06:28:49.180 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T06:28:49.183 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T06:28:49.185 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T06:28:49.222 INFO:teuthology.orchestra.run.smithi089.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T06:28:49.223 INFO:teuthology.orchestra.run.smithi090.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T06:28:49.225 INFO:teuthology.orchestra.run.smithi002.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T06:28:49.580 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-19T06:28:49.580 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi002.front.sepia.ceph.com 2024-09-19T06:28:49.581 DEBUG:teuthology.orchestra.run.smithi002:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T06:28:49.605 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi089.front.sepia.ceph.com 2024-09-19T06:28:49.605 DEBUG:teuthology.orchestra.run.smithi089:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T06:28:49.647 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi090.front.sepia.ceph.com 2024-09-19T06:28:49.648 DEBUG:teuthology.orchestra.run.smithi090:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T06:28:49.675 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-19T06:28:49.675 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T06:28:49.677 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T06:28:49.690 DEBUG:teuthology.orchestra.run.smithi090:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T06:28:49.741 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-19T06:28:49.742 DEBUG:teuthology.orchestra.run.smithi002:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T06:28:49.747 DEBUG:teuthology.orchestra.run.smithi089:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T06:28:49.757 DEBUG:teuthology.orchestra.run.smithi090:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T06:28:51.235 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-19T06:28:51.247 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-19T06:28:51.247 DEBUG:teuthology.orchestra.run.smithi002:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T06:28:51.273 DEBUG:teuthology.orchestra.run.smithi089:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T06:28:51.304 DEBUG:teuthology.orchestra.run.smithi090:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T06:28:51.334 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-19T06:28:51.347 DEBUG:teuthology.orchestra.run.smithi002:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T06:28:51.350 DEBUG:teuthology.orchestra.run.smithi089:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T06:28:51.353 DEBUG:teuthology.orchestra.run.smithi090:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T06:28:51.371 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = core 2024-09-19T06:28:51.378 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = core 2024-09-19T06:28:51.401 INFO:teuthology.orchestra.run.smithi090.stdout:kernel.core_pattern = core 2024-09-19T06:28:51.421 DEBUG:teuthology.orchestra.run.smithi002:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T06:28:51.440 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:28:51.441 DEBUG:teuthology.orchestra.run.smithi089:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T06:28:51.457 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:28:51.457 DEBUG:teuthology.orchestra.run.smithi090:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T06:28:51.477 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:28:51.477 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-19T06:28:51.488 INFO:teuthology.task.internal:Transferring archived files... 2024-09-19T06:28:51.489 DEBUG:teuthology.misc:Transferring archived files from smithi002:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911712/remote/smithi002 2024-09-19T06:28:51.489 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T06:28:51.561 DEBUG:teuthology.misc:Transferring archived files from smithi089:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911712/remote/smithi089 2024-09-19T06:28:51.562 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T06:28:51.601 DEBUG:teuthology.misc:Transferring archived files from smithi090:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911712/remote/smithi090 2024-09-19T06:28:51.601 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T06:28:51.641 INFO:teuthology.task.internal:Removing archive directory... 2024-09-19T06:28:51.641 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T06:28:51.643 DEBUG:teuthology.orchestra.run.smithi089:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T06:28:51.646 DEBUG:teuthology.orchestra.run.smithi090:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T06:28:51.691 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-19T06:28:51.710 INFO:teuthology.task.internal:Not uploading archives. 2024-09-19T06:28:51.710 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-19T06:28:51.726 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-19T06:28:51.727 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T06:28:51.729 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T06:28:51.732 DEBUG:teuthology.orchestra.run.smithi090:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T06:28:51.745 INFO:teuthology.orchestra.run.smithi002.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 06:28 /home/ubuntu/cephtest 2024-09-19T06:28:51.746 INFO:teuthology.orchestra.run.smithi089.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 06:28 /home/ubuntu/cephtest 2024-09-19T06:28:51.748 INFO:teuthology.orchestra.run.smithi090.stdout: 266044 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 06:28 /home/ubuntu/cephtest 2024-09-19T06:28:51.749 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-19T06:28:51.767 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-19T06:28:51.799 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/suites/iozone}} duration: 1798.9106261730194 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-19T06:28:51.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T06:28:51.896 INFO:teuthology.run:pass